2024-08-31T05:49:21.337 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-08-31T05:49:21.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T05:49:21.451 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380 branch: wip-mchangir-testing-20240828.085847-main-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} email: mchangir@redhat.com first_in_suite: false job_id: '7881380' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20240828.085847-main-debug ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240828.085847-main-debug sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 owner: scheduled_mchangir@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5413 sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 sleep_before_teardown: 0 subset: 347/512 suite: fs suite_branch: wip-mchangir-testing-20240828.085847-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMlWR2dKUVnAQVjpSOt1XFDLwlXsiIj1rLCYob5nfSZDof96V/5puB9oYMjBbXY7xdHeeeBmEiJCYj+MOWLTgY= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBABkPKJUcZmYXZgMZMWF78SlKabYB3eGqu/Z0BELZnmjHxNbFszU7An6ceDBGBh2tTkYTdkk7lhYYQQCsg/4ktU= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM8zoLHZ92lqSMQvnn6M2LOlftQ+249auU866bmG33t+V0nMCaz3WtwTlVJmArba7NhC1b/X72BFYhEoaFJqUGI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-08-30_08:30:37 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-31T05:49:21.451 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa; will attempt to use it 2024-08-31T05:49:21.452 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks 2024-08-31T05:49:21.452 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-31T05:49:21.454 INFO:teuthology.task.internal:Checking packages... 2024-08-31T05:49:21.476 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd19e6118f7015f0047264006cb0c873528eb3ae6' 2024-08-31T05:49:21.476 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T05:49:21.476 INFO:teuthology.packaging:ref: None 2024-08-31T05:49:21.476 INFO:teuthology.packaging:tag: None 2024-08-31T05:49:21.476 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T05:49:21.476 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:49:21.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T05:49:21.616 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4560.gd19e6118 2024-08-31T05:49:21.618 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-31T05:49:21.627 INFO:teuthology.task.internal:no buildpackages task found 2024-08-31T05:49:21.627 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-31T05:49:21.640 INFO:teuthology.task.internal:Saving configuration 2024-08-31T05:49:21.661 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-31T05:49:21.673 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-31T05:49:21.695 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 05:44:07.999748', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMlWR2dKUVnAQVjpSOt1XFDLwlXsiIj1rLCYob5nfSZDof96V/5puB9oYMjBbXY7xdHeeeBmEiJCYj+MOWLTgY='} 2024-08-31T05:49:21.720 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 05:44:07.998637', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBABkPKJUcZmYXZgMZMWF78SlKabYB3eGqu/Z0BELZnmjHxNbFszU7An6ceDBGBh2tTkYTdkk7lhYYQQCsg/4ktU='} 2024-08-31T05:49:21.745 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 05:44:07.997299', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM8zoLHZ92lqSMQvnn6M2LOlftQ+249auU866bmG33t+V0nMCaz3WtwTlVJmArba7NhC1b/X72BFYhEoaFJqUGI='} 2024-08-31T05:49:21.745 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-31T05:49:21.757 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-31T05:49:21.757 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-31T05:49:21.757 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-31T05:49:21.757 INFO:teuthology.run_tasks:Running task console_log... 2024-08-31T05:49:21.848 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc77dd270a0>, signals=[15]) 2024-08-31T05:49:21.849 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-31T05:49:21.860 INFO:teuthology.task.internal:Opening connections... 2024-08-31T05:49:21.860 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-08-31T05:49:21.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:49:21.941 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-08-31T05:49:21.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:49:22.018 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-08-31T05:49:22.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:49:22.098 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-31T05:49:22.109 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-08-31T05:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-08-31T05:49:22.128 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-08-31T05:49:22.186 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-08-31T05:49:22.186 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-08-31T05:49:22.186 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-08-31T05:49:22.186 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-08-31T05:49:22.187 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-08-31T05:49:22.187 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-08-31T05:49:22.187 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T05:49:22.187 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-08-31T05:49:22.187 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-08-31T05:49:22.187 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T05:49:22.187 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-08-31T05:49:22.187 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T05:49:22.187 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T05:49:22.187 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T05:49:22.188 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-08-31T05:49:22.219 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-08-31T05:49:22.238 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-08-31T05:49:22.238 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-08-31T05:49:22.295 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-08-31T05:49:22.296 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-08-31T05:49:22.296 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-08-31T05:49:22.296 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-08-31T05:49:22.296 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-08-31T05:49:22.296 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-08-31T05:49:22.296 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T05:49:22.296 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-08-31T05:49:22.296 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-08-31T05:49:22.296 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T05:49:22.296 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-08-31T05:49:22.296 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T05:49:22.297 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T05:49:22.297 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T05:49:22.297 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-08-31T05:49:22.319 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-08-31T05:49:22.338 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-08-31T05:49:22.338 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-08-31T05:49:22.396 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-08-31T05:49:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-08-31T05:49:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-08-31T05:49:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-08-31T05:49:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-08-31T05:49:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-08-31T05:49:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T05:49:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-08-31T05:49:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-08-31T05:49:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T05:49:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-08-31T05:49:22.397 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T05:49:22.398 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T05:49:22.398 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T05:49:22.398 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-08-31T05:49:22.419 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-31T05:49:22.431 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-31T05:49:22.443 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-31T05:49:22.443 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-08-31T05:49:22.445 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-08-31T05:49:22.448 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-08-31T05:49:22.464 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-31T05:49:22.473 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-31T05:49:22.473 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-08-31T05:49:22.503 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-08-31T05:49:22.505 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-08-31T05:49:22.591 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-31T05:49:22.672 INFO:teuthology.run_tasks:Running task kernel... 2024-08-31T05:49:22.692 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-31T05:49:22.693 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-31T05:49:22.693 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T05:49:22.693 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T05:49:22.694 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T05:49:22.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:49:22.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:49:22.712 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-08-31T05:49:22.712 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-08-31T05:49:22.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:49:22.713 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-08-31T05:49:22.769 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-503.el9.x86_64 2024-08-31T05:49:22.770 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.14.0-503.el9.x86_64 2024-08-31T05:49:22.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum install -y kernel 2024-08-31T05:49:22.771 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-503.el9.x86_64 2024-08-31T05:49:22.772 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-503.el9.x86_64 2024-08-31T05:49:22.772 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.14.0-503.el9.x86_64 2024-08-31T05:49:22.772 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum install -y kernel 2024-08-31T05:49:22.772 INFO:teuthology.task.kernel:Running kernel on smithi130: 5.14.0-503.el9.x86_64 2024-08-31T05:49:22.772 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum install -y kernel 2024-08-31T05:49:24.981 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-08-31T05:49:25.135 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-08-31T05:49:25.164 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-08-31T05:49:27.082 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-08-31T05:49:30.036 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 20 MB 00:03 2024-08-31T05:49:30.323 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 4.9 MB/s | 20 MB 00:04 2024-08-31T05:49:32.424 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.6 MB 00:01 2024-08-31T05:49:34.216 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 18 kB 00:00 2024-08-31T05:49:35.300 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 23 MB/s | 22 MB 00:00 2024-08-31T05:49:35.932 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.6 MB 00:01 2024-08-31T05:49:36.420 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.6 MB 00:02 2024-08-31T05:49:37.424 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 18 kB 00:00 2024-08-31T05:49:38.195 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 35 MB/s | 22 MB 00:00 2024-08-31T05:49:38.679 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 18 kB 00:01 2024-08-31T05:49:39.650 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-31T05:49:40.801 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-08-31T05:49:42.849 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T05:49:42.849 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T05:49:42.935 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-08-31T05:49:42.936 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-08-31T05:49:42.936 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-08-31T05:49:43.031 DEBUG:teuthology.orchestra.run.smithi153:> echo no | sudo yum reinstall kernel || true 2024-08-31T05:49:43.569 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 05:49:40 AM UTC. 2024-08-31T05:49:43.706 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-08-31T05:49:43.717 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-08-31T05:49:43.717 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-08-31T05:49:43.717 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-08-31T05:49:43.717 INFO:teuthology.orchestra.run.smithi153.stdout:Reinstalling: 2024-08-31T05:49:43.717 INFO:teuthology.orchestra.run.smithi153.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:49:43.717 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:49:43.717 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-08-31T05:49:43.718 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-08-31T05:49:43.718 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:49:43.718 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 1.9 M 2024-08-31T05:49:43.718 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 0 2024-08-31T05:49:43.718 INFO:teuthology.orchestra.run.smithi153.stderr:Operation aborted. 2024-08-31T05:49:43.770 INFO:teuthology.orchestra.run.smithi153.stdout:Is this ok [y/N]: 2024-08-31T05:49:43.770 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum reinstall -y kernel || true 2024-08-31T05:49:43.876 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-31T05:49:44.307 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:04 ago on Sat 31 Aug 2024 05:49:40 AM UTC. 2024-08-31T05:49:44.433 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-08-31T05:49:44.434 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-08-31T05:49:44.434 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-08-31T05:49:44.434 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-08-31T05:49:44.434 INFO:teuthology.orchestra.run.smithi153.stdout:Reinstalling: 2024-08-31T05:49:44.434 INFO:teuthology.orchestra.run.smithi153.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:49:44.435 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:49:44.435 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-08-31T05:49:44.435 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-08-31T05:49:44.435 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:49:44.435 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 1.9 M 2024-08-31T05:49:44.435 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 0 2024-08-31T05:49:44.435 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-08-31T05:49:45.081 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-08-31T05:49:45.411 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-5.14.0-503.el9.x86_64.rpm 2.0 MB/s | 1.9 MB 00:00 2024-08-31T05:49:45.411 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:49:45.411 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.9 MB/s | 1.9 MB 00:00 2024-08-31T05:49:45.441 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-08-31T05:49:45.676 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-08-31T05:49:45.676 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-08-31T05:49:45.707 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-08-31T05:49:45.707 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-08-31T05:49:45.881 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-08-31T05:49:45.963 INFO:teuthology.orchestra.run.smithi153.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:49:45.963 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:49:45.974 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T05:49:45.974 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T05:49:46.061 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-08-31T05:49:46.062 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-08-31T05:49:46.062 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-08-31T05:49:46.171 DEBUG:teuthology.orchestra.run.smithi053:> echo no | sudo yum reinstall kernel || true 2024-08-31T05:49:46.664 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:49:46.664 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:49:46.720 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 05:49:43 AM UTC. 2024-08-31T05:49:46.873 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-08-31T05:49:46.878 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-08-31T05:49:46.878 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-08-31T05:49:46.879 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-08-31T05:49:46.879 INFO:teuthology.orchestra.run.smithi053.stdout:Reinstalling: 2024-08-31T05:49:46.879 INFO:teuthology.orchestra.run.smithi053.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:49:46.879 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:49:46.879 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-08-31T05:49:46.879 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-08-31T05:49:46.879 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:49:46.879 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 1.9 M 2024-08-31T05:49:46.879 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 0 2024-08-31T05:49:46.879 INFO:teuthology.orchestra.run.smithi053.stderr:Operation aborted. 2024-08-31T05:49:46.941 INFO:teuthology.orchestra.run.smithi053.stdout:Is this ok [y/N]: 2024-08-31T05:49:46.941 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum reinstall -y kernel || true 2024-08-31T05:49:47.121 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T05:49:47.121 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T05:49:47.202 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-08-31T05:49:47.203 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2024-08-31T05:49:47.203 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-08-31T05:49:47.316 DEBUG:teuthology.orchestra.run.smithi130:> echo no | sudo yum reinstall kernel || true 2024-08-31T05:49:47.362 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:49:47.362 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:49:47.362 INFO:teuthology.orchestra.run.smithi153.stdout:Reinstalled: 2024-08-31T05:49:47.362 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T05:49:47.362 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:49:47.362 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-08-31T05:49:47.489 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:04 ago on Sat 31 Aug 2024 05:49:43 AM UTC. 2024-08-31T05:49:47.570 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T05:49:47.620 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-08-31T05:49:47.620 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-08-31T05:49:47.620 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-08-31T05:49:47.621 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-08-31T05:49:47.621 INFO:teuthology.orchestra.run.smithi053.stdout:Reinstalling: 2024-08-31T05:49:47.621 INFO:teuthology.orchestra.run.smithi053.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:49:47.621 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:49:47.621 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-08-31T05:49:47.621 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-08-31T05:49:47.621 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:49:47.621 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 1.9 M 2024-08-31T05:49:47.621 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 0 2024-08-31T05:49:47.621 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-08-31T05:49:47.630 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T05:49:47.630 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T05:49:47.630 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T05:49:47.631 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-08-31T05:49:47.631 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T05:49:47.667 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-08-31T05:49:47.688 DEBUG:teuthology.parallel:result is None 2024-08-31T05:49:47.895 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:00:02 ago on Sat 31 Aug 2024 05:49:45 AM UTC. 2024-08-31T05:49:47.978 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-503.el9.x86_64.rpm 7.5 MB/s | 1.9 MB 00:00 2024-08-31T05:49:47.978 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:49:47.978 INFO:teuthology.orchestra.run.smithi053.stdout:Total 5.3 MB/s | 1.9 MB 00:00 2024-08-31T05:49:48.007 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-08-31T05:49:48.032 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-08-31T05:49:48.040 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-08-31T05:49:48.040 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2024-08-31T05:49:48.040 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-08-31T05:49:48.040 INFO:teuthology.orchestra.run.smithi130.stdout:Reinstalling: 2024-08-31T05:49:48.040 INFO:teuthology.orchestra.run.smithi130.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:49:48.040 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:49:48.040 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-08-31T05:49:48.041 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-08-31T05:49:48.041 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:49:48.041 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 1.9 M 2024-08-31T05:49:48.041 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 0 2024-08-31T05:49:48.041 INFO:teuthology.orchestra.run.smithi130.stderr:Operation aborted. 2024-08-31T05:49:48.092 INFO:teuthology.orchestra.run.smithi130.stdout:Is this ok [y/N]: 2024-08-31T05:49:48.092 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum reinstall -y kernel || true 2024-08-31T05:49:48.238 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-08-31T05:49:48.238 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-08-31T05:49:48.270 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-08-31T05:49:48.271 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-08-31T05:49:48.444 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-08-31T05:49:48.580 INFO:teuthology.orchestra.run.smithi053.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:49:48.581 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:49:48.625 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 05:49:45 AM UTC. 2024-08-31T05:49:48.752 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout:Reinstalling: 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 1.9 M 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 0 2024-08-31T05:49:48.753 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-08-31T05:49:49.340 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:49:49.340 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:49:49.508 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-5.14.0-503.el9.x86_64.rpm 2.9 MB/s | 1.9 MB 00:00 2024-08-31T05:49:49.508 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:49:49.508 INFO:teuthology.orchestra.run.smithi130.stdout:Total 2.5 MB/s | 1.9 MB 00:00 2024-08-31T05:49:49.537 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-08-31T05:49:49.801 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-08-31T05:49:49.801 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-08-31T05:49:49.831 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-08-31T05:49:49.832 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-08-31T05:49:49.984 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-08-31T05:49:50.085 INFO:teuthology.orchestra.run.smithi130.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:49:50.085 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:49:50.110 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:49:50.110 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:49:50.110 INFO:teuthology.orchestra.run.smithi053.stdout:Reinstalled: 2024-08-31T05:49:50.110 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T05:49:50.110 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:49:50.110 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-08-31T05:49:50.293 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T05:49:50.352 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T05:49:50.352 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T05:49:50.352 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T05:49:50.352 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-31T05:49:50.352 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T05:49:50.384 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-08-31T05:49:50.408 DEBUG:teuthology.parallel:result is None 2024-08-31T05:49:50.830 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:49:50.830 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:49:51.593 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:49:51.593 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:49:51.593 INFO:teuthology.orchestra.run.smithi130.stdout:Reinstalled: 2024-08-31T05:49:51.593 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T05:49:51.593 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:49:51.593 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-08-31T05:49:51.771 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T05:49:51.830 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T05:49:51.831 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T05:49:51.831 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T05:49:51.831 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-31T05:49:51.831 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T05:49:51.861 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2024-08-31T05:49:51.885 DEBUG:teuthology.parallel:result is None 2024-08-31T05:49:51.885 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-31T05:49:51.897 INFO:teuthology.task.internal:Creating test directory... 2024-08-31T05:49:51.897 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T05:49:51.900 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T05:49:51.928 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T05:49:51.946 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-31T05:49:51.964 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-31T05:49:51.981 INFO:teuthology.task.internal:Creating archive directory... 2024-08-31T05:49:51.981 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T05:49:51.983 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T05:49:51.985 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T05:49:52.314 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-31T05:49:52.324 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-31T05:49:52.324 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T05:49:52.326 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T05:49:52.329 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T05:49:52.353 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:49:52.355 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:49:52.363 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:49:52.368 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:49:52.406 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:49:52.419 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:49:52.421 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-31T05:49:52.430 INFO:teuthology.task.internal:Configuring sudo... 2024-08-31T05:49:52.430 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T05:49:52.433 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T05:49:52.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T05:49:52.464 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-31T05:49:52.474 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-31T05:49:52.474 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T05:49:52.503 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T05:49:52.505 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T05:49:52.523 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:49:52.606 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:49:52.658 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:49:52.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:49:52.785 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:49:52.786 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T05:49:52.853 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:49:52.889 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:49:52.946 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:49:53.022 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:49:53.067 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-31T05:49:53.067 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T05:49:53.132 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:49:53.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:49:53.234 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:49:53.314 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:49:53.363 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-31T05:49:53.364 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T05:49:53.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-08-31T05:49:53.433 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-08-31T05:49:53.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-08-31T05:49:53.475 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T05:49:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T05:49:53.516 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T05:49:53.967 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-31T05:49:53.975 INFO:teuthology.task.internal:Starting timer... 2024-08-31T05:49:53.975 INFO:teuthology.run_tasks:Running task pcp... 2024-08-31T05:49:53.998 INFO:teuthology.run_tasks:Running task selinux... 2024-08-31T05:49:54.006 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-31T05:49:54.007 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2024-08-31T05:49:54.068 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2024-08-31T05:49:54.069 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2024-08-31T05:49:54.106 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2024-08-31T05:49:54.108 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-08-31T05:49:54.161 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-08-31T05:49:54.162 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-31T05:49:54.163 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2024-08-31T05:49:54.185 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2024-08-31T05:49:54.185 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2024-08-31T05:49:54.212 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2024-08-31T05:49:54.213 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-08-31T05:49:54.232 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-08-31T05:49:54.232 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi053.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi130.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2024-08-31T05:49:54.232 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T05:49:54.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:49:54.259 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T05:49:54.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:49:54.285 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T05:49:54.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:49:54.312 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-31T05:49:54.312 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2024-08-31T05:49:54.354 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2024-08-31T05:49:54.395 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-08-31T05:49:54.443 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-31T05:49:54.454 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-31T05:49:54.468 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-31T05:49:54.469 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi130.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-31T05:51:41.256 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-08-31T05:51:41.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-08-31T05:51:41.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:51:41.352 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-08-31T05:51:41.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-08-31T05:51:41.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-08-31T05:51:41.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:51:41.496 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-08-31T05:51:41.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-08-31T05:51:41.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-08-31T05:51:41.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:51:41.654 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-08-31T05:51:41.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-08-31T05:51:41.743 INFO:teuthology.run_tasks:Running task clock... 2024-08-31T05:51:41.754 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-31T05:51:41.754 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T05:51:41.755 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T05:51:41.757 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T05:51:41.757 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T05:51:41.760 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T05:51:41.760 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T05:51:41.787 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T05:51:41.788 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T05:51:41.803 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T05:51:41.803 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T05:51:41.819 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T05:51:41.828 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2024-08-31T05:51:41.829 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2024-08-31T05:51:41.835 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T05:51:41.839 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2024-08-31T05:51:41.841 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2024-08-31T05:51:41.853 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T05:51:41.856 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T05:51:41.862 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-08-31T05:51:41.867 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T05:51:41.870 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T05:51:41.873 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-08-31T05:51:41.888 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T05:51:41.903 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T05:51:41.922 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-08-31T05:51:41.925 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T05:51:41.925 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-08-31T05:51:41.926 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.926 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.926 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.926 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.940 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-08-31T05:51:41.943 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T05:51:41.943 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-08-31T05:51:41.943 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.944 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.944 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.944 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.959 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-08-31T05:51:41.964 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T05:51:41.964 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-08-31T05:51:41.964 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.964 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.964 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.964 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:51:41.964 INFO:teuthology.run_tasks:Running task install... 2024-08-31T05:51:41.972 DEBUG:teuthology.task.install:project ceph 2024-08-31T05:51:41.973 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}} 2024-08-31T05:51:41.973 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-31T05:51:41.973 INFO:teuthology.task.install:Using flavor: default 2024-08-31T05:51:41.979 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-31T05:51:41.979 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-31T05:51:41.979 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T05:51:41.980 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:51:41.983 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T05:51:41.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:51:41.985 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T05:51:41.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:51:42.126 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T05:51:42.127 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T05:51:42.137 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T05:51:42.138 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T05:51:42.144 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T05:51:42.144 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T05:51:42.238 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T05:51:42.238 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:51:42.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T05:51:42.251 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T05:51:42.251 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-31T05:51:42.252 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T05:51:42.254 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T05:51:42.254 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-31T05:51:42.254 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T05:51:42.265 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T05:51:42.266 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T05:51:42.280 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T05:51:42.280 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T05:51:42.281 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T05:51:42.282 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T05:51:42.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T05:51:42.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T05:51:42.348 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T05:51:42.409 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T05:51:42.421 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T05:51:42.422 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T05:51:42.474 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2024-08-31T05:51:42.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2024-08-31T05:51:42.485 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-08-31T05:51:42.486 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2024-08-31T05:51:42.487 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-08-31T05:51:42.488 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2024-08-31T05:51:42.708 INFO:teuthology.orchestra.run.smithi053.stdout:45 files removed 2024-08-31T05:51:42.713 INFO:teuthology.orchestra.run.smithi153.stdout:45 files removed 2024-08-31T05:51:42.715 INFO:teuthology.orchestra.run.smithi130.stdout:45 files removed 2024-08-31T05:51:42.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T05:51:42.739 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T05:51:42.743 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T05:51:43.274 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 323 kB/s | 84 kB 00:00 2024-08-31T05:51:43.283 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-08-31T05:51:43.284 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-08-31T05:51:43.559 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-08-31T05:51:43.568 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-08-31T05:51:43.575 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-08-31T05:51:43.826 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-08-31T05:51:43.851 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-31T05:51:43.852 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-08-31T05:51:44.276 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-08-31T05:51:44.418 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-08-31T05:51:45.669 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-08-31T05:51:46.845 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-08-31T05:51:49.628 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 20 MB 00:02 2024-08-31T05:51:50.202 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 4.2 MB/s | 20 MB 00:04 2024-08-31T05:51:51.729 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 6.6 MB 00:00 2024-08-31T05:51:53.213 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 18 kB 00:00 2024-08-31T05:51:53.976 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 35 MB/s | 22 MB 00:00 2024-08-31T05:51:54.885 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.6 MB 00:00 2024-08-31T05:51:55.221 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.6 MB 00:01 2024-08-31T05:51:56.619 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 18 kB 00:00 2024-08-31T05:51:56.746 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 18 kB 00:00 2024-08-31T05:51:57.498 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-31T05:51:57.600 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-31T05:51:59.773 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-08-31T05:52:02.134 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:52:02.135 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:52:02.147 INFO:teuthology.orchestra.run.smithi053.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T05:52:02.148 INFO:teuthology.orchestra.run.smithi053.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T05:52:02.149 INFO:teuthology.orchestra.run.smithi053.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T05:52:02.150 INFO:teuthology.orchestra.run.smithi053.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T05:52:02.151 INFO:teuthology.orchestra.run.smithi053.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T05:52:02.154 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T05:52:02.155 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T05:52:02.220 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-08-31T05:52:02.229 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-08-31T05:52:02.229 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-08-31T05:52:02.229 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-08-31T05:52:02.229 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-08-31T05:52:02.229 INFO:teuthology.orchestra.run.smithi053.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T05:52:02.229 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T05:52:02.229 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T05:52:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T05:52:02.231 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T05:52:02.232 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T05:52:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T05:52:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T05:52:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T05:52:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T05:52:02.237 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T05:52:02.238 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T05:52:02.239 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T05:52:02.240 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout:Installing weak dependencies: 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-08-31T05:52:02.241 INFO:teuthology.orchestra.run.smithi053.stdout:Install 148 Packages 2024-08-31T05:52:02.242 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 2 Packages 2024-08-31T05:52:02.242 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:52:02.242 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 224 M 2024-08-31T05:52:02.242 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-08-31T05:52:02.930 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-08-31T05:52:03.031 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-08-31T05:52:03.425 INFO:teuthology.orchestra.run.smithi053.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-08-31T05:52:03.625 INFO:teuthology.orchestra.run.smithi053.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 4.3 MB/s | 874 kB 00:00 2024-08-31T05:52:03.725 INFO:teuthology.orchestra.run.smithi053.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 1.4 MB/s | 148 kB 00:00 2024-08-31T05:52:03.801 INFO:teuthology.orchestra.run.smithi053.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 5.5 MB 00:00 2024-08-31T05:52:03.884 INFO:teuthology.orchestra.run.smithi053.stdout:(5/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 18 MB/s | 1.5 MB 00:00 2024-08-31T05:52:03.968 INFO:teuthology.orchestra.run.smithi053.stdout:(6/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 9.4 MB/s | 2.3 MB 00:00 2024-08-31T05:52:04.176 INFO:teuthology.orchestra.run.smithi053.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 17 MB/s | 4.9 MB 00:00 2024-08-31T05:52:04.468 INFO:teuthology.orchestra.run.smithi053.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 17 MB/s | 20 MB 00:01 2024-08-31T05:52:04.518 INFO:teuthology.orchestra.run.smithi053.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 507 kB/s | 25 kB 00:00 2024-08-31T05:52:05.019 INFO:teuthology.orchestra.run.smithi053.stdout:(10/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 17 MB/s | 18 MB 00:01 2024-08-31T05:52:05.078 INFO:teuthology.orchestra.run.smithi053.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 3.8 MB/s | 226 kB 00:00 2024-08-31T05:52:05.217 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:52:05.217 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:52:05.230 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T05:52:05.231 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T05:52:05.233 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T05:52:05.234 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T05:52:05.235 INFO:teuthology.orchestra.run.smithi153.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T05:52:05.238 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T05:52:05.239 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T05:52:05.248 INFO:teuthology.orchestra.run.smithi053.stdout:(12/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 9.7 MB/s | 10 MB 00:01 2024-08-31T05:52:05.299 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-08-31T05:52:05.307 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-08-31T05:52:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-08-31T05:52:05.307 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-08-31T05:52:05.307 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-08-31T05:52:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T05:52:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T05:52:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T05:52:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T05:52:05.307 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T05:52:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T05:52:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T05:52:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T05:52:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T05:52:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T05:52:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T05:52:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T05:52:05.308 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T05:52:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T05:52:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T05:52:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T05:52:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T05:52:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T05:52:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T05:52:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T05:52:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T05:52:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T05:52:05.309 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T05:52:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T05:52:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T05:52:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T05:52:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T05:52:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T05:52:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T05:52:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T05:52:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T05:52:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T05:52:05.310 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T05:52:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T05:52:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:52:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T05:52:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T05:52:05.311 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-08-31T05:52:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T05:52:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:52:05.311 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-08-31T05:52:05.311 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T05:52:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T05:52:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T05:52:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T05:52:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T05:52:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T05:52:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T05:52:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T05:52:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T05:52:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T05:52:05.312 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T05:52:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T05:52:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T05:52:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T05:52:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T05:52:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T05:52:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T05:52:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T05:52:05.313 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T05:52:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T05:52:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T05:52:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T05:52:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T05:52:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T05:52:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T05:52:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T05:52:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T05:52:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T05:52:05.314 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T05:52:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T05:52:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T05:52:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T05:52:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T05:52:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T05:52:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T05:52:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T05:52:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T05:52:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T05:52:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T05:52:05.315 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T05:52:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T05:52:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T05:52:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T05:52:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T05:52:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T05:52:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T05:52:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T05:52:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T05:52:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T05:52:05.316 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T05:52:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T05:52:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T05:52:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T05:52:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T05:52:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T05:52:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T05:52:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T05:52:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T05:52:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T05:52:05.317 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T05:52:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T05:52:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T05:52:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T05:52:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T05:52:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T05:52:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T05:52:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T05:52:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T05:52:05.318 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T05:52:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T05:52:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T05:52:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T05:52:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T05:52:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T05:52:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T05:52:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T05:52:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T05:52:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T05:52:05.319 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T05:52:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T05:52:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T05:52:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T05:52:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T05:52:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T05:52:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T05:52:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T05:52:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T05:52:05.320 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T05:52:05.321 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T05:52:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T05:52:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T05:52:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T05:52:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T05:52:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T05:52:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T05:52:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T05:52:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T05:52:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T05:52:05.322 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T05:52:05.322 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-08-31T05:52:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T05:52:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:52:05.323 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-08-31T05:52:05.323 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-08-31T05:52:05.323 INFO:teuthology.orchestra.run.smithi153.stdout:Install 148 Packages 2024-08-31T05:52:05.323 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 2 Packages 2024-08-31T05:52:05.323 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:52:05.324 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:52:05.324 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:52:05.324 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 224 M 2024-08-31T05:52:05.324 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-08-31T05:52:05.328 INFO:teuthology.orchestra.run.smithi130.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T05:52:05.329 INFO:teuthology.orchestra.run.smithi130.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T05:52:05.329 INFO:teuthology.orchestra.run.smithi130.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T05:52:05.330 INFO:teuthology.orchestra.run.smithi130.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T05:52:05.332 INFO:teuthology.orchestra.run.smithi130.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T05:52:05.334 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T05:52:05.335 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T05:52:05.370 INFO:teuthology.orchestra.run.smithi053.stdout:(13/150): cephfs-shell-19.3.0-4560.gd19e6118.el 93 kB/s | 27 kB 00:00 2024-08-31T05:52:05.395 INFO:teuthology.orchestra.run.smithi053.stdout:(14/150): libcephfs-devel-19.3.0-4560.gd19e6118 216 kB/s | 32 kB 00:00 2024-08-31T05:52:05.396 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-08-31T05:52:05.404 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-08-31T05:52:05.404 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2024-08-31T05:52:05.404 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-08-31T05:52:05.404 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2024-08-31T05:52:05.404 INFO:teuthology.orchestra.run.smithi130.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T05:52:05.404 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T05:52:05.404 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T05:52:05.404 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T05:52:05.404 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T05:52:05.405 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T05:52:05.405 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T05:52:05.405 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T05:52:05.405 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T05:52:05.405 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T05:52:05.405 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T05:52:05.405 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T05:52:05.405 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T05:52:05.405 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T05:52:05.405 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T05:52:05.406 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T05:52:05.406 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T05:52:05.406 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T05:52:05.406 INFO:teuthology.orchestra.run.smithi130.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T05:52:05.406 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T05:52:05.406 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T05:52:05.406 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T05:52:05.406 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T05:52:05.406 INFO:teuthology.orchestra.run.smithi130.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T05:52:05.406 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T05:52:05.406 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T05:52:05.407 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T05:52:05.407 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T05:52:05.407 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T05:52:05.407 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T05:52:05.407 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T05:52:05.407 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T05:52:05.407 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T05:52:05.407 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T05:52:05.407 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:52:05.407 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T05:52:05.408 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T05:52:05.408 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2024-08-31T05:52:05.408 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T05:52:05.408 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:52:05.408 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2024-08-31T05:52:05.408 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T05:52:05.408 INFO:teuthology.orchestra.run.smithi130.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T05:52:05.408 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T05:52:05.408 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T05:52:05.408 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T05:52:05.409 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T05:52:05.409 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T05:52:05.409 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T05:52:05.409 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T05:52:05.409 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T05:52:05.409 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T05:52:05.409 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T05:52:05.409 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T05:52:05.409 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T05:52:05.409 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T05:52:05.409 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T05:52:05.410 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T05:52:05.410 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T05:52:05.410 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T05:52:05.410 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T05:52:05.410 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T05:52:05.410 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T05:52:05.410 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T05:52:05.410 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T05:52:05.410 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T05:52:05.410 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T05:52:05.411 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T05:52:05.411 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T05:52:05.411 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T05:52:05.411 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T05:52:05.411 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T05:52:05.411 INFO:teuthology.orchestra.run.smithi130.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T05:52:05.411 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T05:52:05.411 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T05:52:05.411 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T05:52:05.412 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T05:52:05.412 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T05:52:05.412 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T05:52:05.412 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T05:52:05.412 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T05:52:05.412 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T05:52:05.412 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T05:52:05.412 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T05:52:05.412 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T05:52:05.412 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T05:52:05.413 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T05:52:05.413 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T05:52:05.413 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T05:52:05.413 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T05:52:05.413 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T05:52:05.413 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T05:52:05.413 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T05:52:05.413 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T05:52:05.413 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T05:52:05.413 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T05:52:05.414 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T05:52:05.414 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T05:52:05.414 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T05:52:05.414 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T05:52:05.414 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T05:52:05.414 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T05:52:05.414 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T05:52:05.414 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T05:52:05.414 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T05:52:05.414 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T05:52:05.415 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T05:52:05.415 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T05:52:05.415 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T05:52:05.415 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T05:52:05.415 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T05:52:05.415 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T05:52:05.415 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T05:52:05.415 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T05:52:05.415 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T05:52:05.415 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T05:52:05.416 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T05:52:05.416 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T05:52:05.416 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T05:52:05.416 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T05:52:05.416 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T05:52:05.416 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T05:52:05.416 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T05:52:05.416 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T05:52:05.416 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T05:52:05.416 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T05:52:05.417 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T05:52:05.417 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T05:52:05.417 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T05:52:05.417 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T05:52:05.417 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T05:52:05.417 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T05:52:05.417 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T05:52:05.417 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T05:52:05.417 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T05:52:05.417 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T05:52:05.417 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T05:52:05.418 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T05:52:05.418 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T05:52:05.418 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T05:52:05.418 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T05:52:05.418 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T05:52:05.418 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T05:52:05.418 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T05:52:05.418 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T05:52:05.418 INFO:teuthology.orchestra.run.smithi130.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T05:52:05.418 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T05:52:05.418 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T05:52:05.419 INFO:teuthology.orchestra.run.smithi130.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T05:52:05.419 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T05:52:05.419 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T05:52:05.419 INFO:teuthology.orchestra.run.smithi130.stdout:Installing weak dependencies: 2024-08-31T05:52:05.419 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T05:52:05.419 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:52:05.419 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-08-31T05:52:05.419 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-08-31T05:52:05.419 INFO:teuthology.orchestra.run.smithi130.stdout:Install 148 Packages 2024-08-31T05:52:05.419 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 2 Packages 2024-08-31T05:52:05.419 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:52:05.420 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 224 M 2024-08-31T05:52:05.420 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-08-31T05:52:05.437 INFO:teuthology.orchestra.run.smithi053.stdout:(15/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 11 MB/s | 766 kB 00:00 2024-08-31T05:52:05.462 INFO:teuthology.orchestra.run.smithi053.stdout:(16/150): libcephsqlite-19.3.0-4560.gd19e6118.e 2.3 MB/s | 159 kB 00:00 2024-08-31T05:52:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 2.5 MB/s | 127 kB 00:00 2024-08-31T05:52:05.521 INFO:teuthology.orchestra.run.smithi053.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 8.5 MB/s | 506 kB 00:00 2024-08-31T05:52:05.580 INFO:teuthology.orchestra.run.smithi053.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 774 kB/s | 45 kB 00:00 2024-08-31T05:52:05.663 INFO:teuthology.orchestra.run.smithi053.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 1.7 MB/s | 141 kB 00:00 2024-08-31T05:52:05.739 INFO:teuthology.orchestra.run.smithi053.stdout:(21/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 21 MB/s | 5.3 MB 00:00 2024-08-31T05:52:05.764 INFO:teuthology.orchestra.run.smithi053.stdout:(22/150): python3-cephfs-19.3.0-4560.gd19e6118. 1.6 MB/s | 161 kB 00:00 2024-08-31T05:52:05.789 INFO:teuthology.orchestra.run.smithi053.stdout:(23/150): python3-rados-19.3.0-4560.gd19e6118.e 6.2 MB/s | 321 kB 00:00 2024-08-31T05:52:05.815 INFO:teuthology.orchestra.run.smithi053.stdout:(24/150): python3-rbd-19.3.0-4560.gd19e6118.el9 6.0 MB/s | 305 kB 00:00 2024-08-31T05:52:05.840 INFO:teuthology.orchestra.run.smithi053.stdout:(25/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.9 MB/s | 99 kB 00:00 2024-08-31T05:52:05.865 INFO:teuthology.orchestra.run.smithi053.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.7 MB/s | 86 kB 00:00 2024-08-31T05:52:05.933 INFO:teuthology.orchestra.run.smithi053.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 2.5 MB/s | 170 kB 00:00 2024-08-31T05:52:05.983 INFO:teuthology.orchestra.run.smithi053.stdout:(28/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 22 MB/s | 3.1 MB 00:00 2024-08-31T05:52:06.008 INFO:teuthology.orchestra.run.smithi053.stdout:(29/150): ceph-grafana-dashboards-19.3.0-4560.g 454 kB/s | 34 kB 00:00 2024-08-31T05:52:06.033 INFO:teuthology.orchestra.run.smithi053.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 3.0 MB/s | 154 kB 00:00 2024-08-31T05:52:06.451 INFO:teuthology.orchestra.run.smithi053.stdout:(31/150): ceph-mgr-diskprediction-local-19.3.0- 18 MB/s | 7.4 MB 00:00 2024-08-31T05:52:06.456 INFO:teuthology.orchestra.run.smithi153.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-08-31T05:52:06.534 INFO:teuthology.orchestra.run.smithi053.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 3.4 MB/s | 290 kB 00:00 2024-08-31T05:52:06.601 INFO:teuthology.orchestra.run.smithi053.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 742 kB/s | 49 kB 00:00 2024-08-31T05:52:06.668 INFO:teuthology.orchestra.run.smithi053.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 247 kB/s | 16 kB 00:00 2024-08-31T05:52:06.674 INFO:teuthology.orchestra.run.smithi130.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 10 kB/s | 6.6 kB 00:00 2024-08-31T05:52:06.898 INFO:teuthology.orchestra.run.smithi153.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 1.9 MB/s | 874 kB 00:00 2024-08-31T05:52:07.048 INFO:teuthology.orchestra.run.smithi153.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 988 kB/s | 148 kB 00:00 2024-08-31T05:52:07.060 INFO:teuthology.orchestra.run.smithi053.stdout:(35/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 17 MB/s | 44 MB 00:02 2024-08-31T05:52:07.086 INFO:teuthology.orchestra.run.smithi053.stdout:(36/150): ceph-volume-19.3.0-4560.gd19e6118.el9 684 kB/s | 285 kB 00:00 2024-08-31T05:52:07.125 INFO:teuthology.orchestra.run.smithi130.stdout:(2/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 5.1 MB/s | 5.5 MB 00:01 2024-08-31T05:52:07.153 INFO:teuthology.orchestra.run.smithi053.stdout:(37/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 274 kB/s | 18 kB 00:00 2024-08-31T05:52:07.166 INFO:teuthology.orchestra.run.smithi130.stdout:(3/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 1.7 MB/s | 874 kB 00:00 2024-08-31T05:52:07.192 INFO:teuthology.orchestra.run.smithi130.stdout:(4/150): ceph-immutable-object-cache-19.3.0-456 2.2 MB/s | 148 kB 00:00 2024-08-31T05:52:07.194 INFO:teuthology.orchestra.run.smithi053.stdout:(38/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 5.7 MB/s | 781 kB 00:00 2024-08-31T05:52:07.309 INFO:teuthology.orchestra.run.smithi130.stdout:(5/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 13 MB/s | 1.5 MB 00:00 2024-08-31T05:52:07.345 INFO:teuthology.orchestra.run.smithi053.stdout:(39/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 11 MB/s | 14 MB 00:01 2024-08-31T05:52:07.370 INFO:teuthology.orchestra.run.smithi053.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 368 kB/s | 80 kB 00:00 2024-08-31T05:52:07.512 INFO:teuthology.orchestra.run.smithi053.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-08-31T05:52:07.537 INFO:teuthology.orchestra.run.smithi053.stdout:(42/150): libquadmath-11.5.0-2.el9.x86_64.rpm 996 kB/s | 191 kB 00:00 2024-08-31T05:52:07.587 INFO:teuthology.orchestra.run.smithi053.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-31T05:52:07.621 INFO:teuthology.orchestra.run.smithi053.stdout:(44/150): libgfortran-11.5.0-2.el9.x86_64.rpm 1.8 MB/s | 801 kB 00:00 2024-08-31T05:52:07.648 INFO:teuthology.orchestra.run.smithi153.stdout:(4/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 3.8 MB/s | 2.3 MB 00:00 2024-08-31T05:52:07.663 INFO:teuthology.orchestra.run.smithi053.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-08-31T05:52:07.688 INFO:teuthology.orchestra.run.smithi053.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-08-31T05:52:07.726 INFO:teuthology.orchestra.run.smithi130.stdout:(6/150): ceph-common-19.3.0-4560.gd19e6118.el9. 12 MB/s | 20 MB 00:01 2024-08-31T05:52:07.755 INFO:teuthology.orchestra.run.smithi053.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-08-31T05:52:07.793 INFO:teuthology.orchestra.run.smithi130.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 10 MB/s | 4.9 MB 00:00 2024-08-31T05:52:07.843 INFO:teuthology.orchestra.run.smithi130.stdout:(8/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 3.4 MB/s | 2.3 MB 00:00 2024-08-31T05:52:07.847 INFO:teuthology.orchestra.run.smithi053.stdout:(48/150): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-08-31T05:52:07.865 INFO:teuthology.orchestra.run.smithi153.stdout:(5/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 3.3 MB/s | 5.5 MB 00:01 2024-08-31T05:52:07.893 INFO:teuthology.orchestra.run.smithi130.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 503 kB/s | 25 kB 00:00 2024-08-31T05:52:07.907 INFO:teuthology.orchestra.run.smithi153.stdout:(6/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 5.9 MB/s | 1.5 MB 00:00 2024-08-31T05:52:08.523 INFO:teuthology.orchestra.run.smithi053.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 158 kB/s | 107 kB 00:00 2024-08-31T05:52:08.560 INFO:teuthology.orchestra.run.smithi130.stdout:(10/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 21 MB/s | 18 MB 00:00 2024-08-31T05:52:08.573 INFO:teuthology.orchestra.run.smithi053.stdout:(50/150): automake-1.16.2-8.el9.noarch.rpm 779 kB/s | 689 kB 00:00 2024-08-31T05:52:08.669 INFO:teuthology.orchestra.run.smithi130.stdout:(11/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 12 MB/s | 10 MB 00:00 2024-08-31T05:52:08.690 INFO:teuthology.orchestra.run.smithi153.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 5.9 MB/s | 4.9 MB 00:00 2024-08-31T05:52:08.702 INFO:teuthology.orchestra.run.smithi130.stdout:(12/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 1.6 MB/s | 226 kB 00:00 2024-08-31T05:52:08.706 INFO:teuthology.orchestra.run.smithi053.stdout:(51/150): bison-3.7.4-5.el9.x86_64.rpm 992 kB/s | 943 kB 00:00 2024-08-31T05:52:08.728 INFO:teuthology.orchestra.run.smithi130.stdout:(13/150): cephfs-shell-19.3.0-4560.gd19e6118.el 463 kB/s | 27 kB 00:00 2024-08-31T05:52:08.745 INFO:teuthology.orchestra.run.smithi130.stdout:(14/150): libcephfs-devel-19.3.0-4560.gd19e6118 757 kB/s | 32 kB 00:00 2024-08-31T05:52:08.795 INFO:teuthology.orchestra.run.smithi130.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 3.1 MB/s | 159 kB 00:00 2024-08-31T05:52:08.828 INFO:teuthology.orchestra.run.smithi130.stdout:(16/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 7.4 MB/s | 766 kB 00:00 2024-08-31T05:52:08.853 INFO:teuthology.orchestra.run.smithi130.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 2.1 MB/s | 127 kB 00:00 2024-08-31T05:52:08.895 INFO:teuthology.orchestra.run.smithi130.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 7.4 MB/s | 506 kB 00:00 2024-08-31T05:52:08.979 INFO:teuthology.orchestra.run.smithi130.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 542 kB/s | 45 kB 00:00 2024-08-31T05:52:09.080 INFO:teuthology.orchestra.run.smithi130.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 1.4 MB/s | 141 kB 00:00 2024-08-31T05:52:09.090 INFO:teuthology.orchestra.run.smithi053.stdout:(52/150): elfutils-libelf-devel-0.191-4.el9.x86 38 kB/s | 22 kB 00:00 2024-08-31T05:52:09.155 INFO:teuthology.orchestra.run.smithi130.stdout:(21/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 18 MB/s | 5.3 MB 00:00 2024-08-31T05:52:09.181 INFO:teuthology.orchestra.run.smithi130.stdout:(22/150): python3-cephfs-19.3.0-4560.gd19e6118. 1.6 MB/s | 161 kB 00:00 2024-08-31T05:52:09.247 INFO:teuthology.orchestra.run.smithi130.stdout:(23/150): python3-rados-19.3.0-4560.gd19e6118.e 3.4 MB/s | 321 kB 00:00 2024-08-31T05:52:09.273 INFO:teuthology.orchestra.run.smithi130.stdout:(24/150): python3-rbd-19.3.0-4560.gd19e6118.el9 3.3 MB/s | 305 kB 00:00 2024-08-31T05:52:09.273 INFO:teuthology.orchestra.run.smithi053.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2024-08-31T05:52:09.315 INFO:teuthology.orchestra.run.smithi130.stdout:(25/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.5 MB/s | 99 kB 00:00 2024-08-31T05:52:09.340 INFO:teuthology.orchestra.run.smithi130.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.3 MB/s | 86 kB 00:00 2024-08-31T05:52:09.357 INFO:teuthology.orchestra.run.smithi053.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 400 kB/s | 313 kB 00:00 2024-08-31T05:52:09.432 INFO:teuthology.orchestra.run.smithi130.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 1.8 MB/s | 170 kB 00:00 2024-08-31T05:52:09.499 INFO:teuthology.orchestra.run.smithi130.stdout:(28/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 17 MB/s | 3.1 MB 00:00 2024-08-31T05:52:09.524 INFO:teuthology.orchestra.run.smithi130.stdout:(29/150): ceph-grafana-dashboards-19.3.0-4560.g 374 kB/s | 34 kB 00:00 2024-08-31T05:52:09.558 INFO:teuthology.orchestra.run.smithi130.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 2.6 MB/s | 154 kB 00:00 2024-08-31T05:52:09.740 INFO:teuthology.orchestra.run.smithi153.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 5.6 MB/s | 20 MB 00:03 2024-08-31T05:52:09.774 INFO:teuthology.orchestra.run.smithi053.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-08-31T05:52:09.841 INFO:teuthology.orchestra.run.smithi153.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 252 kB/s | 25 kB 00:00 2024-08-31T05:52:09.842 INFO:teuthology.orchestra.run.smithi053.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-08-31T05:52:10.008 INFO:teuthology.orchestra.run.smithi130.stdout:(31/150): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-08-31T05:52:10.092 INFO:teuthology.orchestra.run.smithi130.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 3.4 MB/s | 290 kB 00:00 2024-08-31T05:52:10.150 INFO:teuthology.orchestra.run.smithi053.stdout:(57/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-08-31T05:52:10.167 INFO:teuthology.orchestra.run.smithi130.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 659 kB/s | 49 kB 00:00 2024-08-31T05:52:10.242 INFO:teuthology.orchestra.run.smithi130.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 219 kB/s | 16 kB 00:00 2024-08-31T05:52:10.326 INFO:teuthology.orchestra.run.smithi130.stdout:(35/150): ceph-volume-19.3.0-4560.gd19e6118.el9 3.4 MB/s | 285 kB 00:00 2024-08-31T05:52:10.409 INFO:teuthology.orchestra.run.smithi130.stdout:(36/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 9.2 MB/s | 781 kB 00:00 2024-08-31T05:52:10.416 INFO:teuthology.orchestra.run.smithi153.stdout:(10/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 6.1 MB/s | 10 MB 00:01 2024-08-31T05:52:10.433 INFO:teuthology.orchestra.run.smithi053.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2024-08-31T05:52:10.460 INFO:teuthology.orchestra.run.smithi130.stdout:(37/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 365 kB/s | 18 kB 00:00 2024-08-31T05:52:10.491 INFO:teuthology.orchestra.run.smithi153.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 3.0 MB/s | 226 kB 00:00 2024-08-31T05:52:10.500 INFO:teuthology.orchestra.run.smithi053.stdout:(59/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 221 kB/s | 160 kB 00:00 2024-08-31T05:52:10.558 INFO:teuthology.orchestra.run.smithi153.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 404 kB/s | 27 kB 00:00 2024-08-31T05:52:10.617 INFO:teuthology.orchestra.run.smithi153.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 545 kB/s | 32 kB 00:00 2024-08-31T05:52:10.660 INFO:teuthology.orchestra.run.smithi130.stdout:(38/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 12 MB/s | 14 MB 00:01 2024-08-31T05:52:10.702 INFO:teuthology.orchestra.run.smithi130.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 330 kB/s | 80 kB 00:00 2024-08-31T05:52:10.734 INFO:teuthology.orchestra.run.smithi153.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 6.4 MB/s | 766 kB 00:00 2024-08-31T05:52:10.792 INFO:teuthology.orchestra.run.smithi153.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 2.7 MB/s | 159 kB 00:00 2024-08-31T05:52:10.828 INFO:teuthology.orchestra.run.smithi130.stdout:(40/150): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-08-31T05:52:10.842 INFO:teuthology.orchestra.run.smithi153.stdout:(16/150): librados-devel-19.3.0-4560.gd19e6118. 2.5 MB/s | 127 kB 00:00 2024-08-31T05:52:11.001 INFO:teuthology.orchestra.run.smithi153.stdout:(17/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 5.8 MB/s | 18 MB 00:03 2024-08-31T05:52:11.017 INFO:teuthology.orchestra.run.smithi053.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 765 kB/s | 662 kB 00:00 2024-08-31T05:52:11.035 INFO:teuthology.orchestra.run.smithi153.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 2.6 MB/s | 506 kB 00:00 2024-08-31T05:52:11.043 INFO:teuthology.orchestra.run.smithi053.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 45 kB/s | 24 kB 00:00 2024-08-31T05:52:11.085 INFO:teuthology.orchestra.run.smithi153.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 906 kB/s | 45 kB 00:00 2024-08-31T05:52:11.135 INFO:teuthology.orchestra.run.smithi153.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 2.8 MB/s | 141 kB 00:00 2024-08-31T05:52:11.186 INFO:teuthology.orchestra.run.smithi153.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 3.2 MB/s | 161 kB 00:00 2024-08-31T05:52:11.219 INFO:teuthology.orchestra.run.smithi130.stdout:(41/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 13 MB/s | 44 MB 00:03 2024-08-31T05:52:11.236 INFO:teuthology.orchestra.run.smithi153.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 6.3 MB/s | 321 kB 00:00 2024-08-31T05:52:11.245 INFO:teuthology.orchestra.run.smithi130.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 608 kB/s | 253 kB 00:00 2024-08-31T05:52:11.293 INFO:teuthology.orchestra.run.smithi053.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 676 kB/s | 581 kB 00:00 2024-08-31T05:52:11.295 INFO:teuthology.orchestra.run.smithi153.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 5.1 MB/s | 305 kB 00:00 2024-08-31T05:52:11.311 INFO:teuthology.orchestra.run.smithi130.stdout:(43/150): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-08-31T05:52:11.337 INFO:teuthology.orchestra.run.smithi130.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-08-31T05:52:11.345 INFO:teuthology.orchestra.run.smithi153.stdout:(24/150): python3-rgw-19.3.0-4560.gd19e6118.el9 2.0 MB/s | 99 kB 00:00 2024-08-31T05:52:11.370 INFO:teuthology.orchestra.run.smithi130.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-31T05:52:11.395 INFO:teuthology.orchestra.run.smithi153.stdout:(25/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.7 MB/s | 86 kB 00:00 2024-08-31T05:52:11.404 INFO:teuthology.orchestra.run.smithi130.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-08-31T05:52:11.438 INFO:teuthology.orchestra.run.smithi130.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-08-31T05:52:11.537 INFO:teuthology.orchestra.run.smithi153.stdout:(26/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 9.9 MB/s | 5.3 MB 00:00 2024-08-31T05:52:11.580 INFO:teuthology.orchestra.run.smithi130.stdout:(48/150): python3-cryptography-36.0.1-4.el9.x86 3.4 MB/s | 1.2 MB 00:00 2024-08-31T05:52:11.588 INFO:teuthology.orchestra.run.smithi153.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 3.3 MB/s | 170 kB 00:00 2024-08-31T05:52:11.638 INFO:teuthology.orchestra.run.smithi153.stdout:(28/150): ceph-grafana-dashboards-19.3.0-4560.g 687 kB/s | 34 kB 00:00 2024-08-31T05:52:11.643 INFO:teuthology.orchestra.run.smithi053.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-08-31T05:52:11.672 INFO:teuthology.orchestra.run.smithi130.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-08-31T05:52:11.688 INFO:teuthology.orchestra.run.smithi153.stdout:(29/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 3.0 MB/s | 154 kB 00:00 2024-08-31T05:52:11.714 INFO:teuthology.orchestra.run.smithi130.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-08-31T05:52:11.739 INFO:teuthology.orchestra.run.smithi130.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-08-31T05:52:11.747 INFO:teuthology.orchestra.run.smithi153.stdout:(30/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 8.8 MB/s | 3.1 MB 00:00 2024-08-31T05:52:11.764 INFO:teuthology.orchestra.run.smithi130.stdout:(52/150): boost-program-options-1.75.0-8.el9.x8 580 kB/s | 107 kB 00:00 2024-08-31T05:52:11.790 INFO:teuthology.orchestra.run.smithi130.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-08-31T05:52:11.818 INFO:teuthology.orchestra.run.smithi053.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 377 kB/s | 292 kB 00:00 2024-08-31T05:52:11.823 INFO:teuthology.orchestra.run.smithi130.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-08-31T05:52:11.848 INFO:teuthology.orchestra.run.smithi130.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-08-31T05:52:11.874 INFO:teuthology.orchestra.run.smithi130.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-08-31T05:52:11.899 INFO:teuthology.orchestra.run.smithi130.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-31T05:52:11.924 INFO:teuthology.orchestra.run.smithi130.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-08-31T05:52:11.966 INFO:teuthology.orchestra.run.smithi130.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-31T05:52:11.992 INFO:teuthology.orchestra.run.smithi130.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-08-31T05:52:12.017 INFO:teuthology.orchestra.run.smithi130.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 488 kB/s | 24 kB 00:00 2024-08-31T05:52:12.027 INFO:teuthology.orchestra.run.smithi053.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 257 kB/s | 188 kB 00:00 2024-08-31T05:52:12.042 INFO:teuthology.orchestra.run.smithi130.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-08-31T05:52:12.067 INFO:teuthology.orchestra.run.smithi130.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-31T05:52:12.093 INFO:teuthology.orchestra.run.smithi130.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-08-31T05:52:12.118 INFO:teuthology.orchestra.run.smithi130.stdout:(65/150): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-08-31T05:52:12.194 INFO:teuthology.orchestra.run.smithi130.stdout:(66/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.0 MB/s | 3.0 MB 00:00 2024-08-31T05:52:12.252 INFO:teuthology.orchestra.run.smithi053.stdout:(66/150): openblas-0.3.26-2.el9.x86_64.rpm 63 kB/s | 38 kB 00:00 2024-08-31T05:52:12.289 INFO:teuthology.orchestra.run.smithi153.stdout:(31/150): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-08-31T05:52:12.294 INFO:teuthology.orchestra.run.smithi130.stdout:(67/150): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-08-31T05:52:12.339 INFO:teuthology.orchestra.run.smithi153.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 5.7 MB/s | 290 kB 00:00 2024-08-31T05:52:12.361 INFO:teuthology.orchestra.run.smithi130.stdout:(68/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-08-31T05:52:12.389 INFO:teuthology.orchestra.run.smithi153.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 986 kB/s | 49 kB 00:00 2024-08-31T05:52:12.394 INFO:teuthology.orchestra.run.smithi130.stdout:(69/150): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-08-31T05:52:12.419 INFO:teuthology.orchestra.run.smithi130.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-08-31T05:52:12.440 INFO:teuthology.orchestra.run.smithi153.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 329 kB/s | 16 kB 00:00 2024-08-31T05:52:12.462 INFO:teuthology.orchestra.run.smithi130.stdout:(71/150): postgresql-13.16-1.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-08-31T05:52:12.490 INFO:teuthology.orchestra.run.smithi153.stdout:(35/150): ceph-volume-19.3.0-4560.gd19e6118.el9 5.6 MB/s | 285 kB 00:00 2024-08-31T05:52:12.503 INFO:teuthology.orchestra.run.smithi130.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-08-31T05:52:12.529 INFO:teuthology.orchestra.run.smithi130.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-08-31T05:52:12.579 INFO:teuthology.orchestra.run.smithi130.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-08-31T05:52:12.590 INFO:teuthology.orchestra.run.smithi153.stdout:(36/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 7.6 MB/s | 781 kB 00:00 2024-08-31T05:52:12.632 INFO:teuthology.orchestra.run.smithi153.stdout:(37/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 438 kB/s | 18 kB 00:00 2024-08-31T05:52:12.654 INFO:teuthology.orchestra.run.smithi130.stdout:(75/150): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-08-31T05:52:12.688 INFO:teuthology.orchestra.run.smithi130.stdout:(76/150): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-08-31T05:52:12.713 INFO:teuthology.orchestra.run.smithi130.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-08-31T05:52:12.739 INFO:teuthology.orchestra.run.smithi130.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-08-31T05:52:12.764 INFO:teuthology.orchestra.run.smithi130.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-08-31T05:52:12.774 INFO:teuthology.orchestra.run.smithi153.stdout:(38/150): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-08-31T05:52:12.839 INFO:teuthology.orchestra.run.smithi130.stdout:(80/150): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-08-31T05:52:12.865 INFO:teuthology.orchestra.run.smithi130.stdout:(81/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-08-31T05:52:12.890 INFO:teuthology.orchestra.run.smithi130.stdout:(82/150): python3-markupsafe-1.1.1-12.el9.x86_6 277 kB/s | 35 kB 00:00 2024-08-31T05:52:12.924 INFO:teuthology.orchestra.run.smithi130.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.1 MB/s | 250 kB 00:00 2024-08-31T05:52:12.944 INFO:teuthology.orchestra.run.smithi053.stdout:(67/150): openblas-openmp-0.3.26-2.el9.x86_64.r 4.4 MB/s | 4.9 MB 00:01 2024-08-31T05:52:12.949 INFO:teuthology.orchestra.run.smithi130.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-08-31T05:52:12.957 INFO:teuthology.orchestra.run.smithi153.stdout:(39/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 11 MB/s | 14 MB 00:01 2024-08-31T05:52:12.975 INFO:teuthology.orchestra.run.smithi130.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-31T05:52:13.000 INFO:teuthology.orchestra.run.smithi130.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-08-31T05:52:13.026 INFO:teuthology.orchestra.run.smithi130.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-08-31T05:52:13.051 INFO:teuthology.orchestra.run.smithi130.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-31T05:52:13.058 INFO:teuthology.orchestra.run.smithi153.stdout:(40/150): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-08-31T05:52:13.078 INFO:teuthology.orchestra.run.smithi130.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 5.3 MB/s | 279 kB 00:00 2024-08-31T05:52:13.095 INFO:teuthology.orchestra.run.smithi130.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 51 kB 00:00 2024-08-31T05:52:13.112 INFO:teuthology.orchestra.run.smithi130.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-08-31T05:52:13.116 INFO:teuthology.orchestra.run.smithi153.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-08-31T05:52:13.159 INFO:teuthology.orchestra.run.smithi153.stdout:(42/150): libquadmath-11.5.0-2.el9.x86_64.rpm 954 kB/s | 191 kB 00:00 2024-08-31T05:52:13.351 INFO:teuthology.orchestra.run.smithi053.stdout:(68/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-08-31T05:52:13.352 INFO:teuthology.orchestra.run.smithi153.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-08-31T05:52:13.352 INFO:teuthology.orchestra.run.smithi153.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 980 kB/s | 106 kB 00:00 2024-08-31T05:52:13.352 INFO:teuthology.orchestra.run.smithi153.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-31T05:52:13.352 INFO:teuthology.orchestra.run.smithi153.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-31T05:52:13.352 INFO:teuthology.orchestra.run.smithi130.stdout:(92/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-08-31T05:52:13.353 INFO:teuthology.orchestra.run.smithi130.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-08-31T05:52:13.353 INFO:teuthology.orchestra.run.smithi130.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-08-31T05:52:13.353 INFO:teuthology.orchestra.run.smithi130.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-08-31T05:52:13.353 INFO:teuthology.orchestra.run.smithi130.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-08-31T05:52:13.353 INFO:teuthology.orchestra.run.smithi130.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-08-31T05:52:13.353 INFO:teuthology.orchestra.run.smithi130.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-31T05:52:13.353 INFO:teuthology.orchestra.run.smithi130.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-08-31T05:52:13.353 INFO:teuthology.orchestra.run.smithi053.stdout:(69/150): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-08-31T05:52:13.372 INFO:teuthology.orchestra.run.smithi130.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-08-31T05:52:13.398 INFO:teuthology.orchestra.run.smithi130.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-31T05:52:13.423 INFO:teuthology.orchestra.run.smithi130.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-08-31T05:52:13.710 INFO:teuthology.orchestra.run.smithi153.stdout:(47/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 11 MB/s | 44 MB 00:03 2024-08-31T05:52:13.735 INFO:teuthology.orchestra.run.smithi153.stdout:(48/150): python3-urllib3-1.26.5-6.el9.noarch.r 486 kB/s | 215 kB 00:00 2024-08-31T05:52:13.760 INFO:teuthology.orchestra.run.smithi153.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 1.5 MB/s | 689 kB 00:00 2024-08-31T05:52:13.794 INFO:teuthology.orchestra.run.smithi153.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-08-31T05:52:13.819 INFO:teuthology.orchestra.run.smithi153.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 369 kB/s | 22 kB 00:00 2024-08-31T05:52:13.853 INFO:teuthology.orchestra.run.smithi153.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-08-31T05:52:13.878 INFO:teuthology.orchestra.run.smithi153.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-08-31T05:52:13.890 INFO:teuthology.orchestra.run.smithi130.stdout:(103/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-08-31T05:52:13.937 INFO:teuthology.orchestra.run.smithi153.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-08-31T05:52:13.948 INFO:teuthology.orchestra.run.smithi130.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 9.4 MB/s | 548 kB 00:00 2024-08-31T05:52:13.982 INFO:teuthology.orchestra.run.smithi130.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-08-31T05:52:13.995 INFO:teuthology.orchestra.run.smithi153.stdout:(55/150): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-08-31T05:52:14.007 INFO:teuthology.orchestra.run.smithi130.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-08-31T05:52:14.021 INFO:teuthology.orchestra.run.smithi153.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-08-31T05:52:14.028 INFO:teuthology.orchestra.run.smithi053.stdout:(70/150): postgresql-contrib-13.16-1.el9.x86_64 840 kB/s | 910 kB 00:01 2024-08-31T05:52:14.058 INFO:teuthology.orchestra.run.smithi130.stdout:(107/150): lua-devel-5.4.4-4.el9.x86_64.rpm 34 kB/s | 22 kB 00:00 2024-08-31T05:52:14.062 INFO:teuthology.orchestra.run.smithi053.stdout:(71/150): postgresql-private-libs-13.16-1.el9.x 183 kB/s | 137 kB 00:00 2024-08-31T05:52:14.079 INFO:teuthology.orchestra.run.smithi153.stdout:(57/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-08-31T05:52:14.099 INFO:teuthology.orchestra.run.smithi130.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-08-31T05:52:14.105 INFO:teuthology.orchestra.run.smithi153.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-08-31T05:52:14.125 INFO:teuthology.orchestra.run.smithi130.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-31T05:52:14.130 INFO:teuthology.orchestra.run.smithi153.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-08-31T05:52:14.150 INFO:teuthology.orchestra.run.smithi130.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-31T05:52:14.163 INFO:teuthology.orchestra.run.smithi153.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-08-31T05:52:14.188 INFO:teuthology.orchestra.run.smithi153.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-08-31T05:52:14.192 INFO:teuthology.orchestra.run.smithi130.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-08-31T05:52:14.214 INFO:teuthology.orchestra.run.smithi153.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-08-31T05:52:14.247 INFO:teuthology.orchestra.run.smithi153.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-08-31T05:52:14.273 INFO:teuthology.orchestra.run.smithi153.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-08-31T05:52:14.293 INFO:teuthology.orchestra.run.smithi130.stdout:(112/150): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-08-31T05:52:14.298 INFO:teuthology.orchestra.run.smithi153.stdout:(65/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-08-31T05:52:14.323 INFO:teuthology.orchestra.run.smithi153.stdout:(66/150): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-08-31T05:52:14.335 INFO:teuthology.orchestra.run.smithi130.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-08-31T05:52:14.360 INFO:teuthology.orchestra.run.smithi130.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T05:52:14.402 INFO:teuthology.orchestra.run.smithi130.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 774 kB/s | 32 kB 00:00 2024-08-31T05:52:14.427 INFO:teuthology.orchestra.run.smithi130.stdout:(116/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.5 MB/s | 839 kB 00:00 2024-08-31T05:52:14.432 INFO:teuthology.orchestra.run.smithi153.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-31T05:52:14.453 INFO:teuthology.orchestra.run.smithi130.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 279 kB/s | 14 kB 00:00 2024-08-31T05:52:14.478 INFO:teuthology.orchestra.run.smithi130.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-31T05:52:14.503 INFO:teuthology.orchestra.run.smithi130.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-08-31T05:52:14.524 INFO:teuthology.orchestra.run.smithi153.stdout:(68/150): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-08-31T05:52:14.528 INFO:teuthology.orchestra.run.smithi130.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-08-31T05:52:14.546 INFO:teuthology.orchestra.run.smithi053.stdout:(72/150): postgresql-server-13.16-1.el9.x86_64. 4.8 MB/s | 5.8 MB 00:01 2024-08-31T05:52:14.554 INFO:teuthology.orchestra.run.smithi130.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-31T05:52:14.579 INFO:teuthology.orchestra.run.smithi130.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-31T05:52:14.591 INFO:teuthology.orchestra.run.smithi153.stdout:(69/150): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-08-31T05:52:14.613 INFO:teuthology.orchestra.run.smithi130.stdout:(123/150): protobuf-compiler-3.14.0-13.el9.x86_ 726 kB/s | 863 kB 00:01 2024-08-31T05:52:14.616 INFO:teuthology.orchestra.run.smithi153.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-08-31T05:52:14.638 INFO:teuthology.orchestra.run.smithi130.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-08-31T05:52:14.663 INFO:teuthology.orchestra.run.smithi130.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-08-31T05:52:14.684 INFO:teuthology.orchestra.run.smithi153.stdout:(71/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-08-31T05:52:14.697 INFO:teuthology.orchestra.run.smithi130.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 755 kB/s | 19 kB 00:00 2024-08-31T05:52:14.722 INFO:teuthology.orchestra.run.smithi130.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 858 kB/s | 20 kB 00:00 2024-08-31T05:52:14.742 INFO:teuthology.orchestra.run.smithi153.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-08-31T05:52:14.746 INFO:teuthology.orchestra.run.smithi053.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 128 kB/s | 87 kB 00:00 2024-08-31T05:52:14.747 INFO:teuthology.orchestra.run.smithi130.stdout:(128/150): python3-jaraco-collections-3.0.0-8.e 212 kB/s | 23 kB 00:00 2024-08-31T05:52:14.767 INFO:teuthology.orchestra.run.smithi153.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-08-31T05:52:14.773 INFO:teuthology.orchestra.run.smithi130.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T05:52:14.798 INFO:teuthology.orchestra.run.smithi130.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-31T05:52:14.823 INFO:teuthology.orchestra.run.smithi130.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-31T05:52:14.857 INFO:teuthology.orchestra.run.smithi130.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-31T05:52:14.882 INFO:teuthology.orchestra.run.smithi130.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-08-31T05:52:14.908 INFO:teuthology.orchestra.run.smithi130.stdout:(134/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-31T05:52:14.909 INFO:teuthology.orchestra.run.smithi153.stdout:(74/150): postgresql-server-13.16-1.el9.x86_64. 18 MB/s | 5.8 MB 00:00 2024-08-31T05:52:14.933 INFO:teuthology.orchestra.run.smithi130.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-31T05:52:14.966 INFO:teuthology.orchestra.run.smithi130.stdout:(136/150): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-08-31T05:52:14.967 INFO:teuthology.orchestra.run.smithi153.stdout:(75/150): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-08-31T05:52:14.984 INFO:teuthology.orchestra.run.smithi153.stdout:(76/150): python3-colorama-0.4.6-3.el9.noarch.r 282 kB/s | 61 kB 00:00 2024-08-31T05:52:14.992 INFO:teuthology.orchestra.run.smithi130.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-08-31T05:52:15.004 INFO:teuthology.orchestra.run.smithi053.stdout:(74/150): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-08-31T05:52:15.017 INFO:teuthology.orchestra.run.smithi130.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-31T05:52:15.043 INFO:teuthology.orchestra.run.smithi130.stdout:(139/150): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-31T05:52:15.059 INFO:teuthology.orchestra.run.smithi153.stdout:(77/150): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-08-31T05:52:15.068 INFO:teuthology.orchestra.run.smithi130.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-08-31T05:52:15.076 INFO:teuthology.orchestra.run.smithi153.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 279 kB/s | 26 kB 00:00 2024-08-31T05:52:15.093 INFO:teuthology.orchestra.run.smithi130.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-31T05:52:15.101 INFO:teuthology.orchestra.run.smithi153.stdout:(79/150): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-08-31T05:52:15.118 INFO:teuthology.orchestra.run.smithi130.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-31T05:52:15.127 INFO:teuthology.orchestra.run.smithi153.stdout:(80/150): python3-jsonpointer-2.0-4.el9.noarch. 285 kB/s | 19 kB 00:00 2024-08-31T05:52:15.144 INFO:teuthology.orchestra.run.smithi130.stdout:(143/150): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-31T05:52:15.152 INFO:teuthology.orchestra.run.smithi153.stdout:(81/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-08-31T05:52:15.178 INFO:teuthology.orchestra.run.smithi153.stdout:(82/150): python3-markupsafe-1.1.1-12.el9.x86_6 458 kB/s | 35 kB 00:00 2024-08-31T05:52:15.186 INFO:teuthology.orchestra.run.smithi130.stdout:(144/150): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-08-31T05:52:15.211 INFO:teuthology.orchestra.run.smithi130.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-08-31T05:52:15.228 INFO:teuthology.orchestra.run.smithi153.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.2 MB/s | 250 kB 00:00 2024-08-31T05:52:15.236 INFO:teuthology.orchestra.run.smithi130.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T05:52:15.253 INFO:teuthology.orchestra.run.smithi153.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-08-31T05:52:15.270 INFO:teuthology.orchestra.run.smithi130.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-08-31T05:52:15.295 INFO:teuthology.orchestra.run.smithi153.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-08-31T05:52:15.320 INFO:teuthology.orchestra.run.smithi153.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 42 kB 00:00 2024-08-31T05:52:15.321 INFO:teuthology.orchestra.run.smithi130.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-31T05:52:15.354 INFO:teuthology.orchestra.run.smithi053.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 101 kB/s | 61 kB 00:00 2024-08-31T05:52:15.387 INFO:teuthology.orchestra.run.smithi153.stdout:(87/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-08-31T05:52:15.404 INFO:teuthology.orchestra.run.smithi153.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-08-31T05:52:15.438 INFO:teuthology.orchestra.run.smithi153.stdout:(89/150): python3-protobuf-3.14.0-13.el9.noarch 1.8 MB/s | 269 kB 00:00 2024-08-31T05:52:15.463 INFO:teuthology.orchestra.run.smithi153.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-08-31T05:52:15.489 INFO:teuthology.orchestra.run.smithi153.stdout:(91/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-08-31T05:52:15.504 INFO:teuthology.orchestra.run.smithi130.stdout:(149/150): librados2-19.3.0-4560.gd19e6118.el9. 13 MB/s | 3.4 MB 00:00 2024-08-31T05:52:15.514 INFO:teuthology.orchestra.run.smithi153.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-08-31T05:52:15.539 INFO:teuthology.orchestra.run.smithi153.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-08-31T05:52:15.555 INFO:teuthology.orchestra.run.smithi130.stdout:(150/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 3.1 MB 00:00 2024-08-31T05:52:15.561 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:52:15.561 INFO:teuthology.orchestra.run.smithi130.stdout:Total 22 MB/s | 224 MB 00:10 2024-08-31T05:52:15.581 INFO:teuthology.orchestra.run.smithi153.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-08-31T05:52:15.606 INFO:teuthology.orchestra.run.smithi153.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-08-31T05:52:15.640 INFO:teuthology.orchestra.run.smithi153.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 611 kB/s | 36 kB 00:00 2024-08-31T05:52:15.667 INFO:teuthology.orchestra.run.smithi153.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 786 kB/s | 47 kB 00:00 2024-08-31T05:52:15.680 INFO:teuthology.orchestra.run.smithi053.stdout:(76/150): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2024-08-31T05:52:15.717 INFO:teuthology.orchestra.run.smithi153.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 3.9 MB/s | 304 kB 00:00 2024-08-31T05:52:15.742 INFO:teuthology.orchestra.run.smithi153.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-08-31T05:52:15.792 INFO:teuthology.orchestra.run.smithi153.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-08-31T05:52:15.818 INFO:teuthology.orchestra.run.smithi153.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 64 kB 00:00 2024-08-31T05:52:15.838 INFO:teuthology.orchestra.run.smithi053.stdout:(77/150): python3-devel-3.9.19-8.el9.x86_64.rpm 294 kB/s | 245 kB 00:00 2024-08-31T05:52:15.860 INFO:teuthology.orchestra.run.smithi153.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 668 kB/s | 45 kB 00:00 2024-08-31T05:52:16.027 INFO:teuthology.orchestra.run.smithi153.stdout:(103/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-08-31T05:52:16.046 INFO:teuthology.orchestra.run.smithi153.stdout:(104/150): lua-devel-5.4.4-4.el9.x86_64.rpm 98 kB/s | 22 kB 00:00 2024-08-31T05:52:16.113 INFO:teuthology.orchestra.run.smithi153.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-08-31T05:52:16.138 INFO:teuthology.orchestra.run.smithi153.stdout:(106/150): abseil-cpp-20211102.0-3.el9.x86_64.r 4.8 MB/s | 548 kB 00:00 2024-08-31T05:52:16.155 INFO:teuthology.orchestra.run.smithi053.stdout:(78/150): python3-jinja2-2.11.3-6.el9.noarch.rp 310 kB/s | 248 kB 00:00 2024-08-31T05:52:16.163 INFO:teuthology.orchestra.run.smithi153.stdout:(107/150): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-08-31T05:52:16.188 INFO:teuthology.orchestra.run.smithi153.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-08-31T05:52:16.214 INFO:teuthology.orchestra.run.smithi153.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-31T05:52:16.234 INFO:teuthology.orchestra.run.smithi053.stdout:(79/150): python3-jsonpatch-1.21-16.el9.noarch. 46 kB/s | 26 kB 00:00 2024-08-31T05:52:16.239 INFO:teuthology.orchestra.run.smithi153.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-31T05:52:16.264 INFO:teuthology.orchestra.run.smithi153.stdout:(111/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-08-31T05:52:16.298 INFO:teuthology.orchestra.run.smithi153.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-08-31T05:52:16.349 INFO:teuthology.orchestra.run.smithi153.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-08-31T05:52:16.374 INFO:teuthology.orchestra.run.smithi153.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T05:52:16.384 INFO:teuthology.orchestra.run.smithi053.stdout:(80/150): python3-jsonpointer-2.0-4.el9.noarch. 35 kB/s | 19 kB 00:00 2024-08-31T05:52:16.399 INFO:teuthology.orchestra.run.smithi153.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-31T05:52:16.424 INFO:teuthology.orchestra.run.smithi153.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 562 kB/s | 14 kB 00:00 2024-08-31T05:52:16.483 INFO:teuthology.orchestra.run.smithi153.stdout:(117/150): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-08-31T05:52:16.508 INFO:teuthology.orchestra.run.smithi153.stdout:(118/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-08-31T05:52:16.533 INFO:teuthology.orchestra.run.smithi153.stdout:(119/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-08-31T05:52:16.559 INFO:teuthology.orchestra.run.smithi153.stdout:(120/150): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-08-31T05:52:16.584 INFO:teuthology.orchestra.run.smithi153.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-08-31T05:52:16.609 INFO:teuthology.orchestra.run.smithi153.stdout:(122/150): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-08-31T05:52:16.634 INFO:teuthology.orchestra.run.smithi153.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-08-31T05:52:16.660 INFO:teuthology.orchestra.run.smithi153.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-08-31T05:52:16.660 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-08-31T05:52:16.685 INFO:teuthology.orchestra.run.smithi153.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-08-31T05:52:16.710 INFO:teuthology.orchestra.run.smithi153.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-08-31T05:52:16.736 INFO:teuthology.orchestra.run.smithi153.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-08-31T05:52:16.761 INFO:teuthology.orchestra.run.smithi153.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 389 kB/s | 20 kB 00:00 2024-08-31T05:52:16.786 INFO:teuthology.orchestra.run.smithi153.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T05:52:16.787 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-08-31T05:52:16.787 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-08-31T05:52:16.810 INFO:teuthology.orchestra.run.smithi053.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 60 kB/s | 35 kB 00:00 2024-08-31T05:52:16.820 INFO:teuthology.orchestra.run.smithi153.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-08-31T05:52:16.845 INFO:teuthology.orchestra.run.smithi153.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-31T05:52:16.879 INFO:teuthology.orchestra.run.smithi153.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-08-31T05:52:16.893 INFO:teuthology.orchestra.run.smithi053.stdout:(82/150): python3-mako-1.1.4-6.el9.noarch.rpm 233 kB/s | 172 kB 00:00 2024-08-31T05:52:16.921 INFO:teuthology.orchestra.run.smithi153.stdout:(133/150): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-08-31T05:52:16.946 INFO:teuthology.orchestra.run.smithi153.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-08-31T05:52:16.963 INFO:teuthology.orchestra.run.smithi153.stdout:(135/150): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-08-31T05:52:16.980 INFO:teuthology.orchestra.run.smithi153.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 841 kB/s | 28 kB 00:00 2024-08-31T05:52:16.997 INFO:teuthology.orchestra.run.smithi153.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 923 kB/s | 31 kB 00:00 2024-08-31T05:52:17.022 INFO:teuthology.orchestra.run.smithi153.stdout:(138/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 889 kB/s | 90 kB 00:00 2024-08-31T05:52:17.039 INFO:teuthology.orchestra.run.smithi153.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-08-31T05:52:17.081 INFO:teuthology.orchestra.run.smithi153.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2024-08-31T05:52:17.106 INFO:teuthology.orchestra.run.smithi153.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-08-31T05:52:17.134 INFO:teuthology.orchestra.run.smithi153.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 791 kB/s | 74 kB 00:00 2024-08-31T05:52:17.159 INFO:teuthology.orchestra.run.smithi153.stdout:(143/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.9 MB/s | 230 kB 00:00 2024-08-31T05:52:17.184 INFO:teuthology.orchestra.run.smithi153.stdout:(144/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-31T05:52:17.209 INFO:teuthology.orchestra.run.smithi153.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-08-31T05:52:17.235 INFO:teuthology.orchestra.run.smithi153.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T05:52:17.268 INFO:teuthology.orchestra.run.smithi153.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-31T05:52:17.336 INFO:teuthology.orchestra.run.smithi153.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-08-31T05:52:17.585 INFO:teuthology.orchestra.run.smithi053.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-08-31T05:52:17.610 INFO:teuthology.orchestra.run.smithi053.stdout:(84/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 313 kB/s | 250 kB 00:00 2024-08-31T05:52:17.626 INFO:teuthology.orchestra.run.smithi153.stdout:(149/150): librados2-19.3.0-4560.gd19e6118.el9. 8.7 MB/s | 3.4 MB 00:00 2024-08-31T05:52:17.711 INFO:teuthology.orchestra.run.smithi053.stdout:(85/150): python3-oauthlib-3.1.1-5.el9.noarch.r 272 kB/s | 222 kB 00:00 2024-08-31T05:52:17.794 INFO:teuthology.orchestra.run.smithi153.stdout:(150/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 6.0 MB/s | 3.1 MB 00:00 2024-08-31T05:52:17.800 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:52:17.800 INFO:teuthology.orchestra.run.smithi153.stdout:Total 18 MB/s | 224 MB 00:12 2024-08-31T05:52:18.197 INFO:teuthology.orchestra.run.smithi053.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 72 kB/s | 42 kB 00:00 2024-08-31T05:52:18.231 INFO:teuthology.orchestra.run.smithi053.stdout:(87/150): python3-packaging-20.9-5.el9.noarch.r 120 kB/s | 77 kB 00:00 2024-08-31T05:52:18.482 INFO:teuthology.orchestra.run.smithi053.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 350 kB/s | 269 kB 00:00 2024-08-31T05:52:18.535 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-08-31T05:52:18.536 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-08-31T05:52:18.873 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-08-31T05:52:18.923 INFO:teuthology.orchestra.run.smithi053.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 219 kB/s | 159 kB 00:00 2024-08-31T05:52:18.999 INFO:teuthology.orchestra.run.smithi053.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 363 kB/s | 279 kB 00:00 2024-08-31T05:52:19.000 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-08-31T05:52:19.001 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-08-31T05:52:19.099 INFO:teuthology.orchestra.run.smithi053.stdout:(91/150): python3-pytz-2021.1-5.el9.noarch.rpm 83 kB/s | 51 kB 00:00 2024-08-31T05:52:19.532 INFO:teuthology.orchestra.run.smithi053.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 88 kB/s | 54 kB 00:00 2024-08-31T05:52:19.708 INFO:teuthology.orchestra.run.smithi053.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2024-08-31T05:52:20.100 INFO:teuthology.orchestra.run.smithi053.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-08-31T05:52:20.583 INFO:teuthology.orchestra.run.smithi053.stdout:(95/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-08-31T05:52:20.609 INFO:teuthology.orchestra.run.smithi053.stdout:(96/150): qatlib-24.02.0-1.el9.x86_64.rpm 245 kB/s | 221 kB 00:00 2024-08-31T05:52:20.743 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-08-31T05:52:20.743 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-08-31T05:52:20.775 INFO:teuthology.orchestra.run.smithi053.stdout:(97/150): qatlib-service-24.02.0-1.el9.x86_64.r 53 kB/s | 36 kB 00:00 2024-08-31T05:52:21.159 INFO:teuthology.orchestra.run.smithi053.stdout:(98/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 83 kB/s | 47 kB 00:00 2024-08-31T05:52:21.384 INFO:teuthology.orchestra.run.smithi053.stdout:(99/150): socat-1.7.4.1-6.el9.x86_64.rpm 392 kB/s | 304 kB 00:00 2024-08-31T05:52:21.409 INFO:teuthology.orchestra.run.smithi053.stdout:(100/150): uuid-1.6.2-55.el9.x86_64.rpm 91 kB/s | 58 kB 00:00 2024-08-31T05:52:21.835 INFO:teuthology.orchestra.run.smithi053.stdout:(101/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 142 kB/s | 96 kB 00:00 2024-08-31T05:52:21.952 INFO:teuthology.orchestra.run.smithi053.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 192 kB/s | 22 kB 00:00 2024-08-31T05:52:21.994 INFO:teuthology.orchestra.run.smithi053.stdout:(103/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2024-08-31T05:52:22.019 INFO:teuthology.orchestra.run.smithi053.stdout:(104/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-08-31T05:52:22.061 INFO:teuthology.orchestra.run.smithi053.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-08-31T05:52:22.078 INFO:teuthology.orchestra.run.smithi053.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 1.3 MB/s | 19 kB 00:00 2024-08-31T05:52:22.134 INFO:teuthology.orchestra.run.smithi053.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 2.7 MB/s | 309 kB 00:00 2024-08-31T05:52:22.162 INFO:teuthology.orchestra.run.smithi053.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 937 kB/s | 26 kB 00:00 2024-08-31T05:52:22.187 INFO:teuthology.orchestra.run.smithi053.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-31T05:52:22.213 INFO:teuthology.orchestra.run.smithi053.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-31T05:52:22.238 INFO:teuthology.orchestra.run.smithi053.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-08-31T05:52:22.271 INFO:teuthology.orchestra.run.smithi053.stdout:(112/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-08-31T05:52:22.322 INFO:teuthology.orchestra.run.smithi053.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-08-31T05:52:22.347 INFO:teuthology.orchestra.run.smithi053.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T05:52:22.372 INFO:teuthology.orchestra.run.smithi053.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-31T05:52:22.398 INFO:teuthology.orchestra.run.smithi053.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-08-31T05:52:22.431 INFO:teuthology.orchestra.run.smithi053.stdout:(117/150): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-08-31T05:52:22.457 INFO:teuthology.orchestra.run.smithi053.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-08-31T05:52:22.490 INFO:teuthology.orchestra.run.smithi053.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-08-31T05:52:22.515 INFO:teuthology.orchestra.run.smithi053.stdout:(120/150): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-08-31T05:52:22.549 INFO:teuthology.orchestra.run.smithi053.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-08-31T05:52:22.583 INFO:teuthology.orchestra.run.smithi053.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-08-31T05:52:22.608 INFO:teuthology.orchestra.run.smithi053.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-08-31T05:52:22.633 INFO:teuthology.orchestra.run.smithi053.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-08-31T05:52:22.658 INFO:teuthology.orchestra.run.smithi053.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-08-31T05:52:22.684 INFO:teuthology.orchestra.run.smithi053.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-08-31T05:52:22.709 INFO:teuthology.orchestra.run.smithi053.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-08-31T05:52:22.768 INFO:teuthology.orchestra.run.smithi053.stdout:(128/150): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-08-31T05:52:22.793 INFO:teuthology.orchestra.run.smithi053.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T05:52:22.860 INFO:teuthology.orchestra.run.smithi053.stdout:(130/150): libarrow-9.0.0-11.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-08-31T05:52:22.888 INFO:teuthology.orchestra.run.smithi053.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 837 kB/s | 79 kB 00:00 2024-08-31T05:52:22.938 INFO:teuthology.orchestra.run.smithi053.stdout:(132/150): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-08-31T05:52:22.963 INFO:teuthology.orchestra.run.smithi053.stdout:(133/150): python3-natsort-7.1.1-5.el9.noarch.r 770 kB/s | 58 kB 00:00 2024-08-31T05:52:22.988 INFO:teuthology.orchestra.run.smithi053.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-08-31T05:52:23.013 INFO:teuthology.orchestra.run.smithi053.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-31T05:52:23.039 INFO:teuthology.orchestra.run.smithi053.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-08-31T05:52:23.064 INFO:teuthology.orchestra.run.smithi053.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-08-31T05:52:23.089 INFO:teuthology.orchestra.run.smithi053.stdout:(138/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-08-31T05:52:23.115 INFO:teuthology.orchestra.run.smithi053.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-08-31T05:52:23.140 INFO:teuthology.orchestra.run.smithi053.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-08-31T05:52:23.165 INFO:teuthology.orchestra.run.smithi053.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-08-31T05:52:23.190 INFO:teuthology.orchestra.run.smithi053.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-08-31T05:52:23.224 INFO:teuthology.orchestra.run.smithi053.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-08-31T05:52:23.249 INFO:teuthology.orchestra.run.smithi053.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 810 kB/s | 20 kB 00:00 2024-08-31T05:52:23.275 INFO:teuthology.orchestra.run.smithi053.stdout:(145/150): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-08-31T05:52:23.300 INFO:teuthology.orchestra.run.smithi053.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T05:52:23.325 INFO:teuthology.orchestra.run.smithi053.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-31T05:52:23.375 INFO:teuthology.orchestra.run.smithi053.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-31T05:52:23.567 INFO:teuthology.orchestra.run.smithi053.stdout:(149/150): librados2-19.3.0-4560.gd19e6118.el9. 13 MB/s | 3.4 MB 00:00 2024-08-31T05:52:23.626 INFO:teuthology.orchestra.run.smithi053.stdout:(150/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 10 MB/s | 3.1 MB 00:00 2024-08-31T05:52:23.632 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:52:23.632 INFO:teuthology.orchestra.run.smithi053.stdout:Total 10 MB/s | 224 MB 00:21 2024-08-31T05:52:24.462 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-08-31T05:52:24.548 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T05:52:24.573 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T05:52:24.616 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T05:52:24.762 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-08-31T05:52:24.903 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-08-31T05:52:24.903 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-08-31T05:52:24.996 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T05:52:25.099 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:52:25.243 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:52:25.277 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:52:25.369 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:52:25.411 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:52:25.440 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T05:52:25.466 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T05:52:25.618 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T05:52:25.662 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T05:52:25.690 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:52:25.796 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:52:25.824 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:52:25.887 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:52:25.908 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:52:25.929 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:52:26.228 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:52:26.266 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:52:26.374 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T05:52:26.407 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T05:52:26.450 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T05:52:26.525 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T05:52:26.577 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T05:52:26.592 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-08-31T05:52:26.617 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T05:52:26.660 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T05:52:26.671 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T05:52:26.692 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T05:52:26.696 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T05:52:26.720 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T05:52:26.730 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T05:52:26.754 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-08-31T05:52:26.754 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-08-31T05:52:26.791 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T05:52:26.868 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T05:52:26.898 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T05:52:26.942 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T05:52:27.020 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T05:52:27.061 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T05:52:27.079 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T05:52:27.104 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T05:52:27.132 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T05:52:27.188 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:52:27.213 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T05:52:27.256 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T05:52:27.298 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:52:27.323 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:52:27.331 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T05:52:27.414 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:52:27.475 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T05:52:27.482 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:52:27.510 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T05:52:27.533 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T05:52:27.536 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T05:52:27.690 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T05:52:27.742 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T05:52:27.770 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:52:27.877 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:52:27.904 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:52:27.958 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:52:27.980 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:52:27.998 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:52:28.064 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T05:52:28.153 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T05:52:28.190 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T05:52:28.233 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T05:52:28.271 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T05:52:28.304 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T05:52:28.309 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:52:28.395 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T05:52:28.433 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:52:28.460 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T05:52:28.532 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T05:52:28.564 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T05:52:28.622 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T05:52:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T05:52:28.653 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T05:52:28.680 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T05:52:28.688 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T05:52:28.716 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T05:52:28.763 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T05:52:28.824 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T05:52:28.863 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T05:52:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T05:52:28.906 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T05:52:28.938 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T05:52:28.966 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T05:52:29.026 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T05:52:29.036 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T05:52:29.089 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T05:52:29.118 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T05:52:29.154 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T05:52:29.163 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T05:52:29.203 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T05:52:29.231 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T05:52:29.244 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T05:52:29.265 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T05:52:29.308 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T05:52:29.337 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T05:52:29.346 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T05:52:29.386 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T05:52:29.408 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T05:52:29.425 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T05:52:29.451 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T05:52:29.452 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T05:52:29.476 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T05:52:29.527 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T05:52:29.550 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T05:52:29.671 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T05:52:29.677 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T05:52:29.707 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T05:52:29.729 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T05:52:29.735 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T05:52:30.005 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T05:52:30.050 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T05:52:30.095 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T05:52:30.143 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T05:52:30.180 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T05:52:30.215 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T05:52:30.249 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T05:52:30.266 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T05:52:30.290 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T05:52:30.324 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T05:52:30.350 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T05:52:30.378 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T05:52:30.413 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T05:52:30.429 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T05:52:30.467 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T05:52:30.470 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T05:52:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T05:52:30.501 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T05:52:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T05:52:30.604 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T05:52:30.648 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T05:52:30.652 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T05:52:30.729 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T05:52:30.760 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T05:52:30.796 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T05:52:30.843 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T05:52:30.879 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T05:52:30.922 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T05:52:30.964 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T05:52:31.103 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T05:52:31.149 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T05:52:31.190 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T05:52:31.297 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T05:52:31.332 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T05:52:31.372 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T05:52:31.379 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T05:52:31.397 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T05:52:31.422 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T05:52:31.439 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T05:52:31.472 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T05:52:31.497 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T05:52:31.573 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T05:52:31.625 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T05:52:31.627 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T05:52:31.663 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T05:52:31.672 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T05:52:31.691 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T05:52:31.725 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T05:52:31.768 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T05:52:31.769 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T05:52:31.806 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T05:52:31.808 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T05:52:31.838 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T05:52:31.868 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T05:52:31.902 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T05:52:31.992 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T05:52:32.031 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T05:52:32.104 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T05:52:32.109 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T05:52:32.154 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T05:52:32.187 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T05:52:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T05:52:32.326 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T05:52:32.365 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T05:52:32.471 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T05:52:32.524 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T05:52:32.704 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-08-31T05:52:32.757 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T05:52:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T05:52:32.871 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T05:52:33.049 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T05:52:33.099 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T05:52:33.263 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T05:52:33.304 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T05:52:33.338 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T05:52:33.439 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T05:52:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T05:52:33.510 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T05:52:33.563 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T05:52:33.579 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:52:33.653 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T05:52:33.699 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T05:52:33.709 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:52:33.741 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:52:33.831 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:52:33.873 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:52:33.883 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T05:52:33.901 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T05:52:33.913 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T05:52:33.927 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T05:52:33.991 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T05:52:34.088 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T05:52:34.112 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T05:52:34.141 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T05:52:34.168 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:52:34.183 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:52:34.211 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T05:52:34.244 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T05:52:34.260 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:52:34.286 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:52:34.332 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:52:34.356 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:52:34.378 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:52:34.575 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T05:52:34.663 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T05:52:34.685 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:52:34.716 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:52:34.720 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:52:34.779 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T05:52:34.806 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:52:34.832 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T05:52:34.837 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T05:52:34.860 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T05:52:34.873 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T05:52:34.904 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T05:52:34.981 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T05:52:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T05:52:35.071 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T05:52:35.114 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T05:52:35.155 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T05:52:35.183 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T05:52:35.256 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T05:52:35.316 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T05:52:35.344 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T05:52:35.378 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T05:52:35.388 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T05:52:35.468 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T05:52:35.498 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T05:52:35.542 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T05:52:35.570 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T05:52:35.603 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:52:35.646 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T05:52:35.681 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:52:35.693 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T05:52:35.712 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T05:52:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T05:52:35.935 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T05:52:36.014 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T05:52:36.038 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T05:52:36.116 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:52:36.144 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T05:52:36.177 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T05:52:36.504 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T05:52:36.548 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:52:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T05:52:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:52:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T05:52:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T05:52:36.719 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T05:52:36.754 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T05:52:36.796 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T05:52:36.835 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T05:52:36.868 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T05:52:36.966 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T05:52:37.026 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T05:52:37.107 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T05:52:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T05:52:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T05:52:37.194 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T05:52:37.226 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:52:37.237 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T05:52:37.271 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T05:52:37.297 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:52:37.315 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T05:52:37.327 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T05:52:37.358 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T05:52:37.503 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T05:52:37.542 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T05:52:37.592 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T05:52:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T05:52:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T05:52:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T05:52:37.815 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T05:52:37.840 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T05:52:37.919 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T05:52:38.048 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T05:52:38.080 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:52:38.088 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T05:52:38.116 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:52:38.125 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T05:52:38.167 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T05:52:38.212 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T05:52:38.250 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T05:52:38.290 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T05:52:38.319 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T05:52:38.353 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T05:52:38.387 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T05:52:38.429 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T05:52:38.463 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T05:52:38.555 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T05:52:38.610 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T05:52:38.641 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T05:52:38.686 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:52:38.727 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:52:38.750 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T05:52:38.801 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T05:52:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:52:38.805 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T05:52:38.805 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T05:52:38.805 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:52:38.838 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:52:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T05:52:39.587 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:52:39.635 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:52:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T05:52:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T05:52:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T05:52:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T05:52:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T05:52:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T05:52:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T05:52:40.206 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:52:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T05:52:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T05:52:40.252 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:52:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T05:52:40.348 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:52:40.349 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T05:52:40.349 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T05:52:40.349 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:52:40.378 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:52:41.019 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T05:52:41.141 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T05:52:42.462 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T05:52:42.533 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:52:42.561 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T05:52:42.595 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T05:52:42.940 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T05:52:42.990 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:52:43.091 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:52:43.120 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T05:52:43.165 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T05:52:43.691 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T05:52:43.718 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:52:43.781 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:52:43.810 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T05:52:46.175 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:52:46.224 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:52:46.825 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:52:46.868 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:52:46.963 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:52:46.963 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T05:52:46.963 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T05:52:46.963 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:52:46.994 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:52:50.736 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:52:50.736 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2024-08-31T05:52:50.736 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2024-08-31T05:52:50.736 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2024-08-31T05:52:50.736 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2024-08-31T05:52:50.736 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2024-08-31T05:52:50.736 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /root 2024-08-31T05:52:50.736 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2024-08-31T05:52:50.736 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:52:50.920 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:52:50.939 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:52:50.939 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:52:50.940 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T05:52:50.940 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:52:52.401 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:52:52.401 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-08-31T05:52:52.401 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-08-31T05:52:52.401 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-08-31T05:52:52.401 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-08-31T05:52:52.401 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-08-31T05:52:52.401 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2024-08-31T05:52:52.401 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-08-31T05:52:52.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:52:52.542 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:52:52.568 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:52:52.568 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:52:52.569 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T05:52:52.569 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:52:52.569 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:52:52.569 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:52:52.583 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:52:52.599 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:52:52.599 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:52:52.600 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T05:52:52.600 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:52:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:52:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:52:52.824 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:52:52.824 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T05:52:52.824 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:52:52.824 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:52:52.824 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:52:53.285 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:52:53.308 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:52:53.308 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:52:53.308 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T05:52:53.309 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:52:53.309 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:52:53.309 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:52:53.414 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T05:52:53.471 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T05:52:53.527 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T05:52:53.719 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T05:52:53.768 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T05:52:53.837 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T05:52:53.925 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T05:52:54.065 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T05:52:54.101 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T05:52:54.133 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T05:52:54.161 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T05:52:54.178 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:52:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:52:54.205 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:52:54.205 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T05:52:54.205 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:52:54.205 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:52:54.205 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:52:54.429 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:52:54.452 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:52:54.452 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:52:54.452 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T05:52:54.452 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:52:54.452 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:52:54.453 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:52:54.675 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:52:54.701 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:52:54.733 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T05:52:54.799 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T05:52:54.824 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:52:54.921 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:52:54.944 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:52:54.944 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:52:54.944 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T05:52:54.944 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:52:54.944 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:52:54.945 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:52:55.050 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T05:52:55.124 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T05:52:55.179 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T05:52:55.366 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T05:52:55.421 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T05:52:55.499 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T05:52:55.586 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T05:52:55.726 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T05:52:55.771 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T05:52:55.803 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T05:52:55.830 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T05:52:56.253 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:52:56.278 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:52:56.302 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T05:52:56.367 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T05:52:56.395 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:52:57.998 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:52:58.064 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:52:59.026 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:52:59.047 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:52:59.162 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:52:59.338 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T05:52:59.365 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:52:59.390 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:52:59.390 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:52:59.390 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T05:52:59.390 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:52:59.390 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:52:59.391 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:52:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:52:59.398 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2024-08-31T05:52:59.399 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2024-08-31T05:52:59.399 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2024-08-31T05:52:59.399 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2024-08-31T05:52:59.399 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2024-08-31T05:52:59.399 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /root 2024-08-31T05:52:59.399 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2024-08-31T05:52:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:52:59.441 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:52:59.452 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:52:59.551 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T05:52:59.562 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:52:59.582 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:52:59.597 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T05:52:59.598 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:52:59.598 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:52:59.599 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T05:52:59.599 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:52:59.617 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:53:00.557 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T05:53:00.578 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:53:00.585 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:53:00.608 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:53:00.609 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:00.609 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T05:53:00.609 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:53:00.609 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:53:00.609 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:53:00.609 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:53:00.652 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:53:00.675 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:53:00.675 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:00.675 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T05:53:00.675 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:53:00.722 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:53:00.736 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:53:00.759 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:53:00.759 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:00.759 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T05:53:00.759 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:53:00.759 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:53:00.759 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:53:00.893 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T05:53:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:53:00.952 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:53:00.952 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:00.952 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T05:53:00.952 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:53:00.952 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:53:00.952 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:53:01.004 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:53:01.015 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:53:01.095 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:53:01.114 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T05:53:01.119 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:53:01.119 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:01.119 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T05:53:01.119 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:53:01.119 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:53:01.119 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:53:01.160 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T05:53:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:53:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:53:01.271 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:01.271 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T05:53:01.271 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:53:01.271 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:53:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:53:01.503 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:53:01.526 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:53:01.526 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:01.526 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T05:53:01.526 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:53:01.526 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:53:01.526 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:53:02.012 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:53:02.035 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:53:02.035 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:02.035 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T05:53:02.035 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:53:02.035 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:53:02.035 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:53:02.127 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T05:53:02.142 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T05:53:02.156 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:53:02.180 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:53:02.180 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:02.180 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T05:53:02.181 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:53:02.181 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:53:02.181 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:53:02.192 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T05:53:02.223 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:53:02.246 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:53:02.246 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:02.246 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T05:53:02.247 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:53:02.256 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T05:53:02.299 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:53:02.322 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:53:02.322 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:02.323 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T05:53:02.323 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:53:02.323 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:53:02.323 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:53:02.451 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T05:53:02.496 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T05:53:02.577 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T05:53:02.658 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:53:02.674 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T05:53:02.681 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:53:02.681 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:02.681 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T05:53:02.681 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:53:02.681 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:53:02.682 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:53:02.816 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T05:53:02.854 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T05:53:02.886 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T05:53:02.913 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T05:53:03.302 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:53:03.328 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:53:03.361 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T05:53:03.429 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T05:53:03.459 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:53:05.457 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T05:53:05.498 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T05:53:05.539 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T05:53:05.571 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T05:53:05.598 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T05:53:05.786 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T05:53:05.829 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T05:53:05.859 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T05:53:06.476 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:53:06.523 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:53:06.543 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:53:06.810 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:53:06.866 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:53:07.022 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T05:53:07.070 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T05:53:07.111 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T05:53:07.142 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T05:53:07.169 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T05:53:07.348 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T05:53:07.370 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T05:53:07.390 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T05:53:07.429 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T05:53:07.568 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T05:53:07.610 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T05:53:07.692 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T05:53:07.739 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T05:53:07.739 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:53:07.822 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:53:07.823 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:53:07.880 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:53:07.907 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:53:08.026 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:53:08.049 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:53:08.093 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:53:08.113 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:53:08.207 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T05:53:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:53:08.258 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:53:08.259 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:08.259 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T05:53:08.259 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:53:08.259 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:53:08.259 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:53:08.310 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:53:08.322 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:53:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T05:53:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T05:53:08.950 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T05:53:09.039 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T05:53:09.080 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T05:53:09.169 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T05:53:09.201 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T05:53:09.201 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:53:09.285 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:53:09.285 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:53:09.489 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T05:53:09.521 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:53:09.544 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:53:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T05:53:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:53:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:53:09.545 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:53:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:53:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:53:09.610 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:09.611 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T05:53:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:53:09.663 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:53:09.686 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:53:09.686 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:09.687 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T05:53:09.687 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:53:09.687 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:53:09.687 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:53:10.022 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:53:10.046 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:53:10.046 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:53:10.046 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T05:53:10.046 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:53:10.046 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:53:10.046 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:53:14.248 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:53:14.248 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:53:14.249 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T05:53:14.250 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T05:53:14.251 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T05:53:14.251 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T05:53:14.251 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T05:53:14.251 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T05:53:14.251 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T05:53:14.263 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T05:53:14.263 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T05:53:14.264 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T05:53:14.264 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T05:53:14.264 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T05:53:14.264 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T05:53:14.264 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T05:53:14.264 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T05:53:14.265 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T05:53:14.265 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T05:53:14.265 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T05:53:14.265 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T05:53:14.265 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T05:53:14.265 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T05:53:14.266 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T05:53:14.266 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T05:53:14.266 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T05:53:14.266 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T05:53:14.266 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T05:53:14.267 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T05:53:14.267 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T05:53:14.267 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T05:53:14.267 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T05:53:14.267 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T05:53:14.267 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T05:53:14.268 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T05:53:14.268 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T05:53:14.268 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T05:53:14.268 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T05:53:14.268 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T05:53:14.268 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T05:53:14.269 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T05:53:14.269 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T05:53:14.269 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T05:53:14.269 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T05:53:14.269 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T05:53:14.270 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T05:53:14.270 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T05:53:14.270 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T05:53:14.270 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T05:53:14.270 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T05:53:14.270 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T05:53:14.271 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T05:53:14.271 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T05:53:14.271 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T05:53:14.271 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T05:53:14.271 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T05:53:14.271 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T05:53:14.272 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T05:53:14.272 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T05:53:14.272 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T05:53:14.272 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T05:53:14.272 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T05:53:14.272 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T05:53:14.273 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T05:53:14.273 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T05:53:14.273 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T05:53:14.273 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T05:53:14.276 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T05:53:14.276 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T05:53:14.276 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T05:53:14.276 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T05:53:14.277 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:53:14.277 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T05:53:14.277 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T05:53:14.277 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T05:53:14.277 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T05:53:14.278 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T05:53:14.278 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T05:53:14.278 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T05:53:14.278 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T05:53:14.278 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T05:53:14.278 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T05:53:14.279 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T05:53:14.279 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T05:53:14.279 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T05:53:14.279 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T05:53:14.279 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T05:53:14.279 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T05:53:14.280 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T05:53:14.280 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T05:53:14.280 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T05:53:14.280 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T05:53:14.280 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T05:53:14.281 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T05:53:14.281 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T05:53:14.281 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T05:53:14.281 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T05:53:14.281 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T05:53:14.281 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T05:53:14.282 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T05:53:14.282 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T05:53:14.282 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T05:53:14.282 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T05:53:14.282 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T05:53:14.282 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T05:53:14.283 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T05:53:14.283 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T05:53:14.283 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T05:53:14.283 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T05:53:14.283 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T05:53:14.284 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T05:53:14.284 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T05:53:14.284 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T05:53:14.284 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T05:53:14.284 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T05:53:14.285 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T05:53:14.285 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T05:53:14.285 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T05:53:14.285 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T05:53:14.285 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T05:53:14.285 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T05:53:14.286 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T05:53:14.286 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T05:53:14.286 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T05:53:14.286 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T05:53:14.286 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T05:53:14.286 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T05:53:14.287 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T05:53:14.287 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T05:53:14.287 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T05:53:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T05:53:14.688 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T05:53:14.727 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T05:53:14.759 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T05:53:14.786 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T05:53:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T05:53:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T05:53:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T05:53:15.640 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:53:15.676 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:53:15.696 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:53:15.813 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:53:15.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T05:53:15.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T05:53:15.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T05:53:15.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T05:53:15.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T05:53:15.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T05:53:15.827 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T05:53:15.828 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T05:53:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T05:53:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T05:53:15.831 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T05:53:15.832 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T05:53:15.833 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T05:53:15.834 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T05:53:15.835 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T05:53:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T05:53:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T05:53:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T05:53:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T05:53:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T05:53:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T05:53:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T05:53:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T05:53:15.836 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T05:53:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:53:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:53:16.485 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2024-08-31T05:53:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.485 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2024-08-31T05:53:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T05:53:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T05:53:16.485 INFO:teuthology.orchestra.run.smithi130.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:16.486 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:16.487 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.488 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T05:53:16.489 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T05:53:16.490 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T05:53:16.491 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T05:53:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T05:53:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T05:53:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T05:53:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T05:53:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T05:53:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T05:53:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T05:53:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T05:53:16.492 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T05:53:16.493 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T05:53:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T05:53:16.495 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:16.496 INFO:teuthology.orchestra.run.smithi130.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T05:53:16.497 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T05:53:16.497 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T05:53:16.497 INFO:teuthology.orchestra.run.smithi130.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T05:53:16.498 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T05:53:16.498 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T05:53:16.498 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T05:53:16.498 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:53:16.498 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-08-31T05:53:16.594 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T05:53:16.680 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T05:53:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T05:53:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T05:53:16.830 DEBUG:teuthology.parallel:result is None 2024-08-31T05:53:16.836 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T05:53:16.836 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:53:16.917 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:53:16.917 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:53:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:53:18.107 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:53:18.108 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-08-31T05:53:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.108 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-08-31T05:53:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T05:53:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T05:53:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T05:53:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T05:53:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.108 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:18.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T05:53:18.110 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T05:53:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T05:53:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T05:53:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T05:53:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T05:53:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T05:53:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T05:53:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T05:53:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T05:53:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T05:53:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.112 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.112 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T05:53:18.112 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T05:53:18.112 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T05:53:18.112 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T05:53:18.112 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T05:53:18.112 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.112 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T05:53:18.113 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T05:53:18.114 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T05:53:18.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T05:53:18.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T05:53:18.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T05:53:18.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T05:53:18.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T05:53:18.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T05:53:18.116 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T05:53:18.117 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.118 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T05:53:18.119 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T05:53:18.120 INFO:teuthology.orchestra.run.smithi153.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T05:53:18.121 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T05:53:18.121 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T05:53:18.121 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T05:53:18.121 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:53:18.121 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-08-31T05:53:18.445 DEBUG:teuthology.parallel:result is None 2024-08-31T05:53:23.676 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:53:23.676 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T05:53:23.676 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T05:53:23.676 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T05:53:23.676 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T05:53:23.677 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T05:53:23.677 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:53:23.677 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:53:23.677 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T05:53:23.677 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T05:53:23.677 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T05:53:23.677 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T05:53:23.677 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:53:23.677 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T05:53:23.678 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T05:53:23.678 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T05:53:23.678 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T05:53:23.678 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T05:53:23.678 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T05:53:23.678 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T05:53:23.678 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T05:53:23.678 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T05:53:23.678 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T05:53:23.678 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T05:53:23.678 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T05:53:23.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T05:53:23.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T05:53:23.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T05:53:23.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T05:53:23.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T05:53:23.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T05:53:23.691 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T05:53:23.691 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T05:53:23.691 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T05:53:23.692 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T05:53:23.692 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T05:53:23.692 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T05:53:23.692 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T05:53:23.692 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T05:53:23.692 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T05:53:23.692 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T05:53:23.692 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T05:53:23.692 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T05:53:23.692 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T05:53:23.692 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T05:53:23.693 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T05:53:23.693 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T05:53:23.693 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T05:53:23.693 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T05:53:23.693 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T05:53:23.693 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T05:53:23.693 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T05:53:23.693 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T05:53:23.693 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T05:53:23.693 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T05:53:23.694 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T05:53:23.694 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T05:53:23.694 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T05:53:23.694 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T05:53:23.694 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T05:53:23.694 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T05:53:23.694 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T05:53:23.694 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T05:53:23.694 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T05:53:23.694 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T05:53:23.694 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T05:53:23.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T05:53:23.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T05:53:23.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T05:53:23.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T05:53:23.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T05:53:23.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T05:53:23.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T05:53:23.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T05:53:23.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T05:53:23.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T05:53:23.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T05:53:23.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T05:53:23.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T05:53:23.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T05:53:23.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T05:53:23.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T05:53:23.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:53:23.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T05:53:23.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T05:53:23.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T05:53:23.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T05:53:23.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T05:53:23.698 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T05:53:23.698 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T05:53:23.698 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T05:53:23.698 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T05:53:23.698 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T05:53:23.698 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T05:53:23.698 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T05:53:23.698 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T05:53:23.698 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T05:53:23.698 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T05:53:23.698 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T05:53:23.699 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T05:53:23.699 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T05:53:23.699 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T05:53:23.699 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T05:53:23.699 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T05:53:23.699 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T05:53:23.699 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T05:53:23.699 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T05:53:23.699 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T05:53:23.699 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T05:53:23.699 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T05:53:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T05:53:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T05:53:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T05:53:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T05:53:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T05:53:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T05:53:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T05:53:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T05:53:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T05:53:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T05:53:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T05:53:23.701 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T05:53:23.701 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T05:53:23.701 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T05:53:23.701 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T05:53:23.701 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T05:53:23.701 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T05:53:23.701 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T05:53:23.701 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T05:53:23.701 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T05:53:23.701 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T05:53:23.702 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T05:53:23.702 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T05:53:23.702 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T05:53:23.702 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T05:53:23.702 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T05:53:23.702 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T05:53:23.702 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T05:53:23.702 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T05:53:23.702 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T05:53:23.702 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T05:53:25.949 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:53:25.949 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:53:25.949 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2024-08-31T05:53:25.949 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.949 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.949 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-08-31T05:53:25.949 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T05:53:25.949 INFO:teuthology.orchestra.run.smithi053.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T05:53:25.949 INFO:teuthology.orchestra.run.smithi053.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T05:53:25.950 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T05:53:25.950 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.950 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.950 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.950 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.950 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:25.950 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.950 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.950 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.950 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:25.950 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:25.951 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.952 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.952 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:53:25.952 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T05:53:25.952 INFO:teuthology.orchestra.run.smithi053.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T05:53:25.952 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T05:53:25.952 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T05:53:25.952 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T05:53:25.952 INFO:teuthology.orchestra.run.smithi053.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T05:53:25.952 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T05:53:25.952 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T05:53:25.952 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T05:53:25.953 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T05:53:25.954 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T05:53:25.955 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T05:53:25.956 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T05:53:25.957 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T05:53:25.957 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T05:53:25.957 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T05:53:25.957 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T05:53:25.957 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T05:53:25.957 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T05:53:25.960 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T05:53:25.960 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T05:53:25.960 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T05:53:25.960 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T05:53:25.960 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T05:53:25.960 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T05:53:25.960 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T05:53:25.961 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T05:53:25.962 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T05:53:25.963 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T05:53:25.964 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T05:53:25.964 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T05:53:25.964 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:53:25.964 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-08-31T05:53:26.317 DEBUG:teuthology.parallel:result is None 2024-08-31T05:53:26.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:53:26.462 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T05:53:26.483 INFO:teuthology.orchestra.run.smithi053.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T05:53:26.484 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T05:53:26.484 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T05:53:26.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:53:26.625 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T05:53:26.652 INFO:teuthology.orchestra.run.smithi130.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T05:53:26.653 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T05:53:26.653 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T05:53:26.655 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:53:26.792 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T05:53:26.818 INFO:teuthology.orchestra.run.smithi153.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T05:53:26.818 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T05:53:26.818 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T05:53:26.820 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-31T05:53:26.821 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:53:26.821 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T05:53:26.848 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-31T05:53:26.848 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T05:53:26.884 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-31T05:53:26.884 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T05:53:26.917 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-31T05:53:26.917 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:53:26.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T05:53:26.942 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T05:53:27.008 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-31T05:53:27.008 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T05:53:27.037 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T05:53:27.107 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-31T05:53:27.107 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T05:53:27.137 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T05:53:27.206 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-31T05:53:27.206 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:53:27.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T05:53:27.230 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T05:53:27.296 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-31T05:53:27.296 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T05:53:27.326 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T05:53:27.394 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-31T05:53:27.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T05:53:27.423 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T05:53:27.492 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-31T05:53:27.492 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:53:27.492 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T05:53:27.517 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T05:53:27.581 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-31T05:53:27.581 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T05:53:27.608 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T05:53:27.677 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-31T05:53:27.677 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T05:53:27.704 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T05:53:27.771 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-31T05:53:27.873 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug'}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-31T05:53:27.873 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:53:27.874 INFO:tasks.cephadm:Cluster fsid is 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:53:27.874 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-31T05:53:27.874 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.53', 'mon.b': '172.21.15.130', 'mon.c': '172.21.15.153'} 2024-08-31T05:53:27.874 INFO:tasks.cephadm:First mon is mon.a on smithi053 2024-08-31T05:53:27.874 INFO:tasks.cephadm:First mgr is x 2024-08-31T05:53:27.874 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-31T05:53:27.875 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname $(hostname -s) 2024-08-31T05:53:27.900 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname $(hostname -s) 2024-08-31T05:53:27.929 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname $(hostname -s) 2024-08-31T05:53:27.956 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-31T05:53:27.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:53:28.102 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82586/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4560-gd19e6118', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4560.gd19e6118'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-28 11:15:32.801765', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-20240828.085847-main-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-31T05:53:28.240 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-mchangir-testing-20240828.085847-main-debug, sha1 d19e6118f7015f0047264006cb0c873528eb3ae6 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:53:28.242 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T05:53:28.242 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T05:53:28.242 DEBUG:teuthology.orchestra.run.smithi053:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T05:53:28.850 INFO:teuthology.orchestra.run.smithi053.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 05:53 /home/ubuntu/cephtest/cephadm 2024-08-31T05:53:28.851 DEBUG:teuthology.orchestra.run.smithi130:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T05:53:29.448 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 05:53 /home/ubuntu/cephtest/cephadm 2024-08-31T05:53:29.449 DEBUG:teuthology.orchestra.run.smithi153:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T05:53:30.048 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 05:53 /home/ubuntu/cephtest/cephadm 2024-08-31T05:53:30.048 DEBUG:teuthology.orchestra.run.smithi053:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T05:53:30.068 DEBUG:teuthology.orchestra.run.smithi130:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T05:53:30.087 DEBUG:teuthology.orchestra.run.smithi153:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T05:53:30.121 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 on all hosts... 2024-08-31T05:53:30.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T05:53:30.123 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T05:53:30.130 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T05:53:31.706 INFO:teuthology.orchestra.run.smithi053.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T05:53:31.771 INFO:teuthology.orchestra.run.smithi153.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T05:53:31.891 INFO:teuthology.orchestra.run.smithi130.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T05:54:00.300 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-31T05:54:00.301 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T05:54:00.301 INFO:teuthology.orchestra.run.smithi130.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T05:54:00.301 INFO:teuthology.orchestra.run.smithi130.stdout: "repo_digests": [ 2024-08-31T05:54:00.301 INFO:teuthology.orchestra.run.smithi130.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T05:54:00.301 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-08-31T05:54:00.301 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-31T05:54:03.866 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-31T05:54:03.866 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T05:54:03.867 INFO:teuthology.orchestra.run.smithi153.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T05:54:03.867 INFO:teuthology.orchestra.run.smithi153.stdout: "repo_digests": [ 2024-08-31T05:54:03.867 INFO:teuthology.orchestra.run.smithi153.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T05:54:03.867 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-08-31T05:54:03.867 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-31T05:54:05.154 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T05:54:05.154 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T05:54:05.154 INFO:teuthology.orchestra.run.smithi053.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T05:54:05.154 INFO:teuthology.orchestra.run.smithi053.stdout: "repo_digests": [ 2024-08-31T05:54:05.155 INFO:teuthology.orchestra.run.smithi053.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T05:54:05.155 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T05:54:05.155 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T05:54:05.182 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph 2024-08-31T05:54:05.210 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph 2024-08-31T05:54:05.243 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph 2024-08-31T05:54:05.276 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /etc/ceph 2024-08-31T05:54:05.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /etc/ceph 2024-08-31T05:54:05.329 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /etc/ceph 2024-08-31T05:54:05.358 INFO:tasks.cephadm:Writing seed config... 2024-08-31T05:54:05.359 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-08-31T05:54:05.359 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-31T05:54:05.359 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-31T05:54:05.359 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-31T05:54:05.359 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-31T05:54:05.359 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-31T05:54:05.359 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-08-31T05:54:05.360 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-31T05:54:05.361 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-31T05:54:05.361 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-31T05:54:05.361 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-31T05:54:05.361 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-31T05:54:05.361 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-31T05:54:05.361 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-08-31T05:54:05.362 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:54:05.362 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-31T05:54:05.377 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 580e8a36-675d-11ef-bcd4-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-08-31T05:54:05.378 DEBUG:teuthology.orchestra.run.smithi053:mon.a> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.a.service 2024-08-31T05:54:05.420 DEBUG:teuthology.orchestra.run.smithi053:mgr.x> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.x.service 2024-08-31T05:54:05.462 INFO:tasks.cephadm:Bootstrapping... 2024-08-31T05:54:05.463 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 -v bootstrap --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.53 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:54:05.670 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:54:05.670 INFO:teuthology.orchestra.run.smithi053.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', '-v', 'bootstrap', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.53', '--skip-admin-label'] 2024-08-31T05:54:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-31T05:54:05.671 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying podman|docker is present... 2024-08-31T05:54:05.694 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stdout 5.2.2 2024-08-31T05:54:05.694 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying lvm2 is present... 2024-08-31T05:54:05.694 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying time synchronization is in place... 2024-08-31T05:54:05.702 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T05:54:05.702 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T05:54:05.708 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T05:54:05.709 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-08-31T05:54:05.715 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout enabled 2024-08-31T05:54:05.721 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout active 2024-08-31T05:54:05.721 INFO:teuthology.orchestra.run.smithi053.stdout:Unit chronyd.service is enabled and running 2024-08-31T05:54:05.721 INFO:teuthology.orchestra.run.smithi053.stdout:Repeating the final host check... 2024-08-31T05:54:05.743 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stdout 5.2.2 2024-08-31T05:54:05.744 INFO:teuthology.orchestra.run.smithi053.stdout:podman (/bin/podman) version 5.2.2 is present 2024-08-31T05:54:05.744 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl is present 2024-08-31T05:54:05.744 INFO:teuthology.orchestra.run.smithi053.stdout:lvcreate is present 2024-08-31T05:54:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T05:54:05.751 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T05:54:05.756 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T05:54:05.757 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-08-31T05:54:05.763 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout enabled 2024-08-31T05:54:05.769 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout active 2024-08-31T05:54:05.769 INFO:teuthology.orchestra.run.smithi053.stdout:Unit chronyd.service is enabled and running 2024-08-31T05:54:05.769 INFO:teuthology.orchestra.run.smithi053.stdout:Host looks OK 2024-08-31T05:54:05.769 INFO:teuthology.orchestra.run.smithi053.stdout:Cluster fsid: 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:05.769 INFO:teuthology.orchestra.run.smithi053.stdout:Acquiring lock 139997248369712 on /run/cephadm/580e8a36-675d-11ef-bcd4-c7b262605968.lock 2024-08-31T05:54:05.769 INFO:teuthology.orchestra.run.smithi053.stdout:Lock 139997248369712 acquired on /run/cephadm/580e8a36-675d-11ef-bcd4-c7b262605968.lock 2024-08-31T05:54:05.770 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying IP 172.21.15.53 port 3300 ... 2024-08-31T05:54:05.770 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying IP 172.21.15.53 port 6789 ... 2024-08-31T05:54:05.770 INFO:teuthology.orchestra.run.smithi053.stdout:Base mon IP(s) is [172.21.15.53:3300, 172.21.15.53:6789], mon addrv is [v2:172.21.15.53:3300,v1:172.21.15.53:6789] 2024-08-31T05:54:05.773 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.53 metric 100 2024-08-31T05:54:05.773 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.53 metric 100 2024-08-31T05:54:05.776 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-31T05:54:05.776 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-08-31T05:54:05.776 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-08-31T05:54:05.778 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-31T05:54:05.778 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-31T05:54:05.779 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T05:54:05.779 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-31T05:54:05.779 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout inet6 fe80::ed15:1297:9a9f:8d8f/64 scope link noprefixroute 2024-08-31T05:54:05.779 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T05:54:05.779 INFO:teuthology.orchestra.run.smithi053.stdout:Mon IP `172.21.15.53` is in CIDR network `172.21.0.0/20` 2024-08-31T05:54:05.779 INFO:teuthology.orchestra.run.smithi053.stdout:Mon IP `172.21.15.53` is in CIDR network `172.21.0.0/20` 2024-08-31T05:54:05.779 INFO:teuthology.orchestra.run.smithi053.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-31T05:54:05.780 INFO:teuthology.orchestra.run.smithi053.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-31T05:54:05.780 INFO:teuthology.orchestra.run.smithi053.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T05:54:06.366 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stdout 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T05:54:06.366 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T05:54:06.366 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Getting image source signatures 2024-08-31T05:54:06.366 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Copying blob sha256:1c7f48e91f1eb9e77df623f13bab8a42aaf12d95954655c07fb62a1a85ca19b2 2024-08-31T05:54:06.366 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-31T05:54:06.366 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Copying config sha256:79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T05:54:06.366 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-31T05:54:07.345 INFO:teuthology.orchestra.run.smithi053.stdout:ceph: stdout ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T05:54:07.345 INFO:teuthology.orchestra.run.smithi053.stdout:Ceph version: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T05:54:07.346 INFO:teuthology.orchestra.run.smithi053.stdout:Extracting ceph user uid/gid from container image... 2024-08-31T05:54:08.360 INFO:teuthology.orchestra.run.smithi053.stdout:stat: stdout 167 167 2024-08-31T05:54:08.361 INFO:teuthology.orchestra.run.smithi053.stdout:Creating initial keys... 2024-08-31T05:54:09.308 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-authtool: stdout AQAAsNJmKcSEKRAAFxZ7AOTIqg+scsUIkO1+bw== 2024-08-31T05:54:10.282 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-authtool: stdout AQABsNJm5jm1JRAAMfbjww15aAWBkkqoX86XHg== 2024-08-31T05:54:11.272 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-authtool: stdout AQACsNJmsnOKJRAALuHz5pcgVxGGU4y7/CrPQw== 2024-08-31T05:54:11.272 INFO:teuthology.orchestra.run.smithi053.stdout:Creating initial monmap... 2024-08-31T05:54:12.227 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T05:54:12.227 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-31T05:54:12.227 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:12.227 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T05:54:12.227 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool for a [v2:172.21.15.53:3300,v1:172.21.15.53:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T05:54:12.227 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = quincy 2024-08-31T05:54:12.228 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: set fsid to 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:12.228 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T05:54:12.228 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:54:12.228 INFO:teuthology.orchestra.run.smithi053.stdout:Creating mon... 2024-08-31T05:54:13.083 INFO:teuthology.orchestra.run.smithi053.stdout:create mon.a on 2024-08-31T05:54:13.294 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-31T05:54:13.651 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-31T05:54:14.072 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-580e8a36-675d-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-580e8a36-675d-11ef-bcd4-c7b262605968.target. 2024-08-31T05:54:14.073 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-580e8a36-675d-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-580e8a36-675d-11ef-bcd4-c7b262605968.target. 2024-08-31T05:54:14.879 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.a 2024-08-31T05:54:14.879 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to reset failed state of unit ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.a.service: Unit ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.a.service not loaded. 2024-08-31T05:54:15.220 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-580e8a36-675d-11ef-bcd4-c7b262605968.target.wants/ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.a.service → /etc/systemd/system/ceph-580e8a36-675d-11ef-bcd4-c7b262605968@.service. 2024-08-31T05:54:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:15 smithi053 podman[18534]: 2024-08-31 05:54:15.358979384 +0000 UTC m=+0.016107824 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:54:16.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:16 smithi053 podman[18534]: 2024-08-31 05:54:16.347841182 +0000 UTC m=+1.004969604 container create 41a0e5bfbec75c73ac95b8b052ac9df9a9150f667425c699eb1620593ad2827c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:54:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:18 smithi053 podman[18534]: 2024-08-31 05:54:18.118026538 +0000 UTC m=+2.775154957 container init 41a0e5bfbec75c73ac95b8b052ac9df9a9150f667425c699eb1620593ad2827c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:54:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:18 smithi053 podman[18534]: 2024-08-31 05:54:18.122416583 +0000 UTC m=+2.779545002 container start 41a0e5bfbec75c73ac95b8b052ac9df9a9150f667425c699eb1620593ad2827c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:54:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:18 smithi053 ceph-mon[18553]: mkfs 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:18 smithi053 ceph-mon[18553]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T05:54:19.149 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:54:19.150 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout disabled 2024-08-31T05:54:19.158 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:54:19.158 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-08-31T05:54:19.158 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld.service is not enabled 2024-08-31T05:54:19.158 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T05:54:19.158 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mon to start... 2024-08-31T05:54:19.159 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mon... 2024-08-31T05:54:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 bash[18534]: 41a0e5bfbec75c73ac95b8b052ac9df9a9150f667425c699eb1620593ad2827c 2024-08-31T05:54:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 systemd[1]: Started Ceph mon.a for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T05:54:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 ceph-mon[18553]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T05:54:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 ceph-mon[18553]: monmap epoch 1 2024-08-31T05:54:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 ceph-mon[18553]: fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 ceph-mon[18553]: last_changed 2024-08-31T05:54:11.618583+0000 2024-08-31T05:54:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 ceph-mon[18553]: created 2024-08-31T05:54:11.618583+0000 2024-08-31T05:54:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 ceph-mon[18553]: min_mon_release 19 (squid) 2024-08-31T05:54:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 ceph-mon[18553]: election_strategy: 1 2024-08-31T05:54:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 ceph-mon[18553]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-08-31T05:54:19.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 ceph-mon[18553]: fsmap 2024-08-31T05:54:19.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 ceph-mon[18553]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T05:54:19.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:19 smithi053 ceph-mon[18553]: mgrmap e1: no daemons active 2024-08-31T05:54:22.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:22 smithi053 ceph-mon[18553]: from='client.? 172.21.15.53:0/927635337' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-08-31T05:54:25.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout cluster: 2024-08-31T05:54:25.313 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout id: 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:25.313 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-31T05:54:25.313 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:25.313 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout services: 2024-08-31T05:54:25.313 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 4s) 2024-08-31T05:54:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-31T05:54:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-31T05:54:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout data: 2024-08-31T05:54:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-31T05:54:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-31T05:54:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-31T05:54:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout pgs: 2024-08-31T05:54:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:mon is available 2024-08-31T05:54:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:Assimilating anything we can from ceph.conf... 2024-08-31T05:54:25.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:25 smithi053 ceph-mon[18553]: from='client.? 172.21.15.53:0/3341340566' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T05:54:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:25 smithi053 ceph-mon[18553]: from='client.? 172.21.15.53:0/3341340566' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-31T05:54:26.435 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:26.435 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout fsid = 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.53:3300,v1:172.21.15.53:6789] 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T05:54:26.436 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-08-31T05:54:26.437 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T05:54:26.437 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T05:54:26.437 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T05:54:26.437 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T05:54:26.437 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T05:54:26.437 INFO:teuthology.orchestra.run.smithi053.stdout:Generating new minimal ceph.conf... 2024-08-31T05:54:27.202 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:26 smithi053 ceph-mon[18553]: from='client.? 172.21.15.53:0/1374644768' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:54:27.432 INFO:teuthology.orchestra.run.smithi053.stdout:Restarting the monitor... 2024-08-31T05:54:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:27 smithi053 systemd[1]: Stopping Ceph mon.a for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T05:54:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:27 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a[18549]: 2024-08-31T05:54:27.704+0000 7fdfe5293640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:54:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:27 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a[18549]: 2024-08-31T05:54:27.704+0000 7fdfe5293640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-31T05:54:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:27 smithi053 podman[18798]: 2024-08-31 05:54:27.930341053 +0000 UTC m=+0.333257199 container died 41a0e5bfbec75c73ac95b8b052ac9df9a9150f667425c699eb1620593ad2827c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T05:54:28.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:28 smithi053 podman[18798]: 2024-08-31 05:54:28.304945087 +0000 UTC m=+0.707861232 container cleanup 41a0e5bfbec75c73ac95b8b052ac9df9a9150f667425c699eb1620593ad2827c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:54:28.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:28 smithi053 bash[18798]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a 2024-08-31T05:54:28.858 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:28 smithi053 podman[18810]: 2024-08-31 05:54:28.531117249 +0000 UTC m=+0.596291801 container remove 41a0e5bfbec75c73ac95b8b052ac9df9a9150f667425c699eb1620593ad2827c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:54:28.858 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:28 smithi053 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-31T05:54:28.858 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:28 smithi053 systemd[1]: Stopped Ceph mon.a for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T05:54:28.858 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:28 smithi053 systemd[1]: Starting Ceph mon.a for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T05:54:29.135 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:28 smithi053 podman[18905]: 2024-08-31 05:54:28.856702933 +0000 UTC m=+0.102359479 container create f269de74543e1cd427361da5b4cfe03d44bc86990c4055da0eebd78e54df0641 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:54:29.136 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:28 smithi053 podman[18905]: 2024-08-31 05:54:28.770287849 +0000 UTC m=+0.015944407 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:54:29.136 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 podman[18905]: 2024-08-31 05:54:29.059160295 +0000 UTC m=+0.304816845 container init f269de74543e1cd427361da5b4cfe03d44bc86990c4055da0eebd78e54df0641 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:54:29.136 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 podman[18905]: 2024-08-31 05:54:29.062300329 +0000 UTC m=+0.307956876 container start f269de74543e1cd427361da5b4cfe03d44bc86990c4055da0eebd78e54df0641 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-31T05:54:29.136 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T05:54:29.136 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T05:54:29.136 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: pidfile_write: ignore empty --pid-file 2024-08-31T05:54:29.136 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: load: jerasure load: lrc 2024-08-31T05:54:29.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: RocksDB version: 7.9.2 2024-08-31T05:54:29.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Git sha 0 2024-08-31T05:54:29.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T05:54:29.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: DB SUMMARY 2024-08-31T05:54:29.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: DB Session ID: 5FTP27EBXENX87Y0TF71 2024-08-31T05:54:29.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: CURRENT file: CURRENT 2024-08-31T05:54:29.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T05:54:29.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-31T05:54:29.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-31T05:54:29.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95066 ; 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.error_if_exists: 0 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.create_if_missing: 0 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.paranoid_checks: 1 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.env: 0x5566df9515a0 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.info_log: 0x5566e42154e0 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.statistics: (nil) 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.use_fsync: 0 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_log_file_size: 0 2024-08-31T05:54:29.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.allow_fallocate: 1 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.use_direct_reads: 0 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.db_log_dir: 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.wal_dir: 2024-08-31T05:54:29.139 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.write_buffer_manager: 0x5566e42195e0 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T05:54:29.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T05:54:29.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T05:54:29.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T05:54:29.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T05:54:29.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T05:54:29.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.unordered_write: 0 2024-08-31T05:54:29.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T05:54:29.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T05:54:29.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T05:54:29.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T05:54:29.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.row_cache: None 2024-08-31T05:54:29.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.wal_filter: None 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.two_write_queues: 0 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.wal_compression: 0 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.atomic_flush: 0 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.log_readahead_size: 0 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T05:54:29.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_background_jobs: 2 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_background_compactions: -1 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_subcompactions: 1 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T05:54:29.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_open_files: -1 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_background_flushes: -1 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Compression algorithms supported: 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: kZSTD supported: 0 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: kXpressCompression supported: 0 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: kBZip2Compression supported: 0 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: kLZ4Compression supported: 1 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: kZlibCompression supported: 1 2024-08-31T05:54:29.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: kSnappyCompression supported: 1 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.merge_operator: 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_filter: None 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5566e4215100) 2024-08-31T05:54:29.146 INFO:journalctl@ceph.mon.a.smithi053.stdout: cache_index_and_filter_blocks: 1 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: pin_top_level_index_and_filter: 1 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: index_type: 0 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: data_block_index_type: 0 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: index_shortening: 1 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: checksum: 4 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: no_block_cache: 0 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: block_cache: 0x5566e01d8850 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: block_cache_name: BinnedLRUCache 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: block_cache_options: 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: capacity : 536870912 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: num_shard_bits : 4 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: strict_capacity_limit : 0 2024-08-31T05:54:29.147 INFO:journalctl@ceph.mon.a.smithi053.stdout: high_pri_pool_ratio: 0.000 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: block_cache_compressed: (nil) 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: persistent_cache: (nil) 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: block_size: 4096 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: block_size_deviation: 10 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: block_restart_interval: 16 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: index_block_restart_interval: 1 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: metadata_block_size: 4096 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: partition_filters: 0 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: use_delta_encoding: 1 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: filter_policy: bloomfilter 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: whole_key_filtering: 1 2024-08-31T05:54:29.148 INFO:journalctl@ceph.mon.a.smithi053.stdout: verify_compression: 0 2024-08-31T05:54:29.149 INFO:journalctl@ceph.mon.a.smithi053.stdout: read_amp_bytes_per_bit: 0 2024-08-31T05:54:29.149 INFO:journalctl@ceph.mon.a.smithi053.stdout: format_version: 5 2024-08-31T05:54:29.149 INFO:journalctl@ceph.mon.a.smithi053.stdout: enable_index_compression: 1 2024-08-31T05:54:29.149 INFO:journalctl@ceph.mon.a.smithi053.stdout: block_align: 0 2024-08-31T05:54:29.149 INFO:journalctl@ceph.mon.a.smithi053.stdout: max_auto_readahead_size: 262144 2024-08-31T05:54:29.149 INFO:journalctl@ceph.mon.a.smithi053.stdout: prepopulate_block_cache: 0 2024-08-31T05:54:29.149 INFO:journalctl@ceph.mon.a.smithi053.stdout: initial_auto_readahead_size: 8192 2024-08-31T05:54:29.149 INFO:journalctl@ceph.mon.a.smithi053.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compression: NoCompression 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.num_levels: 7 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T05:54:29.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T05:54:29.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T05:54:29.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T05:54:29.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.inplace_update_support: 0 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.bloom_locality: 0 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.max_successive_merges: 0 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T05:54:29.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.ttl: 2592000 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.enable_blob_files: false 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.min_blob_size: 0 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T05:54:29.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 744f8f98-8463-498e-bc1c-8f3e900e3411 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725083669098140, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725083669099287, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91073, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 89121, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11617, "raw_average_key_size": 47, "raw_value_size": 82597, "raw_average_value_size": 339, "num_data_blocks": 12, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725083669, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "744f8f98-8463-498e-bc1c-8f3e900e3411", "db_session_id": "5FTP27EBXENX87Y0TF71", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725083669099361, "job": 1, "event": "recovery_finished"} 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-31T05:54:29.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5566e4238a80 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: DB pointer 0x5566e4fda000 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout: ** DB Stats ** 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:54:29.157 INFO:journalctl@ceph.mon.a.smithi053.stdout: 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: ** Compaction Stats [default] ** 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: L0 2/0 90.80 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 120.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: Sum 2/0 90.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 120.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 120.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: ** Compaction Stats [default] ** 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 120.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T05:54:29.158 INFO:journalctl@ceph.mon.a.smithi053.stdout: 2024-08-31T05:54:29.159 INFO:journalctl@ceph.mon.a.smithi053.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:54:29.159 INFO:journalctl@ceph.mon.a.smithi053.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T05:54:29.159 INFO:journalctl@ceph.mon.a.smithi053.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T05:54:29.159 INFO:journalctl@ceph.mon.a.smithi053.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T05:54:29.159 INFO:journalctl@ceph.mon.a.smithi053.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T05:54:29.159 INFO:journalctl@ceph.mon.a.smithi053.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T05:54:29.159 INFO:journalctl@ceph.mon.a.smithi053.stdout: Cumulative compaction: 0.00 GB write, 24.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:54:29.159 INFO:journalctl@ceph.mon.a.smithi053.stdout: Interval compaction: 0.00 GB write, 24.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:54:29.159 INFO:journalctl@ceph.mon.a.smithi053.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T05:54:29.159 INFO:journalctl@ceph.mon.a.smithi053.stdout: Block cache BinnedLRUCache@0x5566e01d8850#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-31T05:54:29.160 INFO:journalctl@ceph.mon.a.smithi053.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-31T05:54:29.160 INFO:journalctl@ceph.mon.a.smithi053.stdout: 2024-08-31T05:54:29.160 INFO:journalctl@ceph.mon.a.smithi053.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T05:54:29.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: starting mon.a rank 0 at public addrs [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] at bind addrs [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:29.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: mon.a@-1(???) e1 preinit fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:29.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: mon.a@-1(???).mds e1 new map 2024-08-31T05:54:29.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: mon.a@-1(???).mds e1 print_map 2024-08-31T05:54:29.160 INFO:journalctl@ceph.mon.a.smithi053.stdout: e1 2024-08-31T05:54:29.160 INFO:journalctl@ceph.mon.a.smithi053.stdout: btime 2024-08-31T05:54:18:179948+0000 2024-08-31T05:54:29.160 INFO:journalctl@ceph.mon.a.smithi053.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:54:29.160 INFO:journalctl@ceph.mon.a.smithi053.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:54:29.161 INFO:journalctl@ceph.mon.a.smithi053.stdout: legacy client fscid: -1 2024-08-31T05:54:29.161 INFO:journalctl@ceph.mon.a.smithi053.stdout: 2024-08-31T05:54:29.161 INFO:journalctl@ceph.mon.a.smithi053.stdout: No filesystems configured 2024-08-31T05:54:29.161 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T05:54:29.161 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:54:29.161 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:54:29.161 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:54:29.161 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-31T05:54:29.161 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 bash[18905]: f269de74543e1cd427361da5b4cfe03d44bc86990c4055da0eebd78e54df0641 2024-08-31T05:54:29.161 INFO:teuthology.orchestra.run.smithi053.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-31T05:54:29.422 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 systemd[1]: Started Ceph mon.a for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T05:54:29.422 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T05:54:29.422 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: monmap epoch 1 2024-08-31T05:54:29.423 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:29.423 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: last_changed 2024-08-31T05:54:11.618583+0000 2024-08-31T05:54:29.423 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: created 2024-08-31T05:54:11.618583+0000 2024-08-31T05:54:29.423 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: min_mon_release 19 (squid) 2024-08-31T05:54:29.423 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: election_strategy: 1 2024-08-31T05:54:29.423 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-08-31T05:54:29.423 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: fsmap 2024-08-31T05:54:29.423 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T05:54:29.423 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:29 smithi053 ceph-mon[18924]: mgrmap e1: no daemons active 2024-08-31T05:54:30.456 INFO:teuthology.orchestra.run.smithi053.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-31T05:54:30.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:30 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3842197393' entity='client.admin' 2024-08-31T05:54:30.771 INFO:teuthology.orchestra.run.smithi053.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:54:30.772 INFO:teuthology.orchestra.run.smithi053.stdout:Creating mgr... 2024-08-31T05:54:30.772 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-31T05:54:30.773 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-31T05:54:31.828 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T05:54:31.828 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to reset failed state of unit ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.x.service: Unit ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.x.service not loaded. 2024-08-31T05:54:32.148 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-580e8a36-675d-11ef-bcd4-c7b262605968.target.wants/ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-580e8a36-675d-11ef-bcd4-c7b262605968@.service. 2024-08-31T05:54:32.476 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:32 smithi053 podman[19136]: 2024-08-31 05:54:32.286458665 +0000 UTC m=+0.015679551 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:54:33.038 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:32 smithi053 podman[19136]: 2024-08-31 05:54:32.750512427 +0000 UTC m=+0.479733309 container create c16941624955e357dc03a3bb69ef86ca61bca62f02b2425b6ebdc23da24848cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-31T05:54:33.038 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:32 smithi053 podman[19136]: 2024-08-31 05:54:32.959437461 +0000 UTC m=+0.688658335 container init c16941624955e357dc03a3bb69ef86ca61bca62f02b2425b6ebdc23da24848cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:54:33.038 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:32 smithi053 podman[19136]: 2024-08-31 05:54:32.962562047 +0000 UTC m=+0.691782938 container start c16941624955e357dc03a3bb69ef86ca61bca62f02b2425b6ebdc23da24848cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T05:54:33.038 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:33 smithi053 bash[19136]: c16941624955e357dc03a3bb69ef86ca61bca62f02b2425b6ebdc23da24848cf 2024-08-31T05:54:33.052 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:54:33.052 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout disabled 2024-08-31T05:54:33.060 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:54:33.060 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-08-31T05:54:33.060 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld.service is not enabled 2024-08-31T05:54:33.060 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T05:54:33.068 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:54:33.068 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout disabled 2024-08-31T05:54:33.076 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:54:33.076 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-08-31T05:54:33.076 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld.service is not enabled 2024-08-31T05:54:33.076 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-31T05:54:33.076 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr to start... 2024-08-31T05:54:33.076 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr... 2024-08-31T05:54:33.290 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:33 smithi053 systemd[1]: Started Ceph mgr.x for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T05:54:33.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:33 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2853885122' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T05:54:34.082 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:34.082 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:54:34.082 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T05:54:34.082 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T05:54:34.082 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T05:54:34.082 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 0 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T05:54:34.083 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:34.084 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T05:54:34.084 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:34.084 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T05:54:34.084 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T05:54:34.084 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T05:54:34.084 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T05:54:34.084 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T05:54:34.084 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T05:54:34.087 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:34.087 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T05:54:34.087 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T05:54:34.087 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T05:54:18:179948+0000", 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:34.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T05:54:18.180858+0000", 2024-08-31T05:54:34.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:54:34.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:34.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T05:54:34.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:54:34.090 INFO:teuthology.orchestra.run.smithi053.stdout:mgr not available, waiting (1/15)... 2024-08-31T05:54:36.908 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:36 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1557195680' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T05:54:37.231 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:37.231 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:54:37.231 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T05:54:37.231 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T05:54:37.231 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T05:54:37.231 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T05:54:37.231 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T05:54:37.231 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 0 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T05:54:37.232 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T05:54:37.233 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:37.233 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T05:54:37.233 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:37.233 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T05:54:37.233 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T05:54:37.233 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T05:54:37.233 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T05:54:37.233 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T05:54:37.233 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T05:54:37.236 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:37.236 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T05:54:37.236 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T05:54:18:179948+0000", 2024-08-31T05:54:37.237 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T05:54:37.238 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:37.239 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T05:54:18.180858+0000", 2024-08-31T05:54:37.239 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:54:37.239 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:37.239 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T05:54:37.239 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:54:37.239 INFO:teuthology.orchestra.run.smithi053.stdout:mgr not available, waiting (2/15)... 2024-08-31T05:54:38.644 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: Activating manager daemon x 2024-08-31T05:54:38.644 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: mgrmap e2: x(active, starting, since 0.00378474s) 2024-08-31T05:54:38.644 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: from='mgr.14100 172.21.15.53:0/265971182' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:54:38.644 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: from='mgr.14100 172.21.15.53:0/265971182' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:54:38.644 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: from='mgr.14100 172.21.15.53:0/265971182' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:54:38.644 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: from='mgr.14100 172.21.15.53:0/265971182' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:54:38.644 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: from='mgr.14100 172.21.15.53:0/265971182' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:54:38.644 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: Manager daemon x is now available 2024-08-31T05:54:38.644 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: from='mgr.14100 172.21.15.53:0/265971182' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:54:38.645 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: from='mgr.14100 172.21.15.53:0/265971182' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:54:38.645 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: from='mgr.14100 172.21.15.53:0/265971182' entity='mgr.x' 2024-08-31T05:54:38.645 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: from='mgr.14100 172.21.15.53:0/265971182' entity='mgr.x' 2024-08-31T05:54:38.645 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:38 smithi053 ceph-mon[18924]: from='mgr.14100 172.21.15.53:0/265971182' entity='mgr.x' 2024-08-31T05:54:40.459 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:40.459 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:54:40.459 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T05:54:40.459 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T05:54:40.459 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T05:54:40.459 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T05:54:40.459 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T05:54:40.459 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T05:54:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T05:54:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 0 2024-08-31T05:54:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:54:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T05:54:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T05:54:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:54:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-08-31T05:54:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T05:54:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T05:54:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T05:54:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T05:54:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T05:54:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T05:54:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T05:54:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T05:54:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T05:54:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T05:54:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T05:54:18:179948+0000", 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T05:54:40.462 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T05:54:18.180858+0000", 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:54:40.463 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:54:40.464 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T05:54:40.464 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:54:40.464 INFO:teuthology.orchestra.run.smithi053.stdout:mgr is available 2024-08-31T05:54:40.575 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:40 smithi053 ceph-mon[18924]: mgrmap e3: x(active, since 1.00704s) 2024-08-31T05:54:40.575 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:40 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2729309016' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T05:54:41.689 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:41 smithi053 ceph-mon[18924]: mgrmap e4: x(active, since 2s) 2024-08-31T05:54:41.689 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:41 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1260163432' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T05:54:41.693 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T05:54:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout fsid = 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T05:54:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.53:3300,v1:172.21.15.53:6789] 2024-08-31T05:54:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T05:54:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T05:54:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T05:54:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T05:54:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T05:54:41.694 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T05:54:41.695 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-08-31T05:54:41.695 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T05:54:41.695 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-08-31T05:54:41.695 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T05:54:41.695 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T05:54:41.695 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T05:54:41.695 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T05:54:41.695 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T05:54:41.695 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling cephadm module... 2024-08-31T05:54:42.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:42 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1493997693' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-08-31T05:54:42.726 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:42 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: ignoring --setuser ceph since I am not root 2024-08-31T05:54:42.726 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:42 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: ignoring --setgroup ceph since I am not root 2024-08-31T05:54:43.598 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1493997693' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-31T05:54:43.599 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:43 smithi053 ceph-mon[18924]: mgrmap e5: x(active, since 4s) 2024-08-31T05:54:44.197 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:54:44.197 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-31T05:54:44.197 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T05:54:44.197 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T05:54:44.197 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T05:54:44.198 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:54:44.198 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for the mgr to restart... 2024-08-31T05:54:44.198 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr epoch 5... 2024-08-31T05:54:44.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:44 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2045010731' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T05:54:47.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:47 smithi053 ceph-mon[18924]: Active manager daemon x restarted 2024-08-31T05:54:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:47 smithi053 ceph-mon[18924]: Activating manager daemon x 2024-08-31T05:54:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:47 smithi053 ceph-mon[18924]: osdmap e2: 0 total, 0 up, 0 in 2024-08-31T05:54:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:47 smithi053 ceph-mon[18924]: mgrmap e6: x(active, starting, since 0.00377813s) 2024-08-31T05:54:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:47 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:54:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:47 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:54:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:47 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:54:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:47 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:54:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:47 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:54:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:47 smithi053 ceph-mon[18924]: Manager daemon x is now available 2024-08-31T05:54:49.202 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:54:49.203 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-31T05:54:49.203 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T05:54:49.203 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:54:49.203 INFO:teuthology.orchestra.run.smithi053.stdout:mgr epoch 5 is available 2024-08-31T05:54:49.203 INFO:teuthology.orchestra.run.smithi053.stdout:Setting orchestrator backend to cephadm... 2024-08-31T05:54:49.852 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:54:49.852 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:54:49.852 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: Found migration_current of "None". Setting to last migration. 2024-08-31T05:54:49.852 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:54:49.852 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:54:49.852 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:54:49.852 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:54:49.852 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:54:49.853 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:54:49.853 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-31T05:54:49.853 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: mgrmap e7: x(active, since 1.00603s) 2024-08-31T05:54:49.853 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:49 smithi053 ceph-mon[18924]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-31T05:54:50.132 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T05:54:50.038+0000 7f4d963f3640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:05:54:50] ENGINE Error in HTTPServer.serve 2024-08-31T05:54:50.132 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: Traceback (most recent call last): 2024-08-31T05:54:50.132 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:54:50.132 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self._connections.run(self.expiration_interval) 2024-08-31T05:54:50.132 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:54:50.132 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self._run(expiration_interval) 2024-08-31T05:54:50.132 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:54:50.132 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:54:50.132 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:54:50.133 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:54:50.133 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:54:50.133 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: s = self.context.wrap_socket( 2024-08-31T05:54:50.133 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:54:50.133 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: return self.sslsocket_class._create( 2024-08-31T05:54:50.133 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:54:50.133 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self.do_handshake() 2024-08-31T05:54:50.133 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:54:50.134 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self._sslobj.do_handshake() 2024-08-31T05:54:50.134 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:54:50.134 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T05:54:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-mon[18924]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:54:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:54:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-mon[18924]: [31/Aug/2024:05:54:49] ENGINE Bus STARTING 2024-08-31T05:54:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-mon[18924]: [31/Aug/2024:05:54:50] ENGINE Serving on https://172.21.15.53:7150 2024-08-31T05:54:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-mon[18924]: [31/Aug/2024:05:54:50] ENGINE Error in HTTPServer.serve 2024-08-31T05:54:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout: Traceback (most recent call last): 2024-08-31T05:54:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:54:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:54:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: self._run(expiration_interval) 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: s = self.context.wrap_socket( 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: return self.sslsocket_class._create( 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: self.do_handshake() 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:54:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout: self._sslobj.do_handshake() 2024-08-31T05:54:50.978 INFO:journalctl@ceph.mon.a.smithi053.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:54:50.978 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-mon[18924]: [31/Aug/2024:05:54:50] ENGINE Serving on http://172.21.15.53:8765 2024-08-31T05:54:50.978 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-mon[18924]: [31/Aug/2024:05:54:50] ENGINE Bus STARTED 2024-08-31T05:54:50.978 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:54:50.978 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:50 smithi053 ceph-mon[18924]: mgrmap e8: x(active, since 2s) 2024-08-31T05:54:51.525 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-31T05:54:51.525 INFO:teuthology.orchestra.run.smithi053.stdout:Generating ssh key... 2024-08-31T05:54:52.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:51 smithi053 ceph-mon[18924]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:52.520 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: Generating public/private rsa key pair. 2024-08-31T05:54:52.520 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: Your identification has been saved in /tmp/tmpy49qzbxj/key 2024-08-31T05:54:52.520 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: Your public key has been saved in /tmp/tmpy49qzbxj/key.pub 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: The key fingerprint is: 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: SHA256:HOX/SnQx/82PO07rnP2AyKtiEh+s4foJsVKuA1zVucc ceph-580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: The key's randomart image is: 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: +---[RSA 3072]----+ 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: | . . . | 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: | . o o | 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: | . + . o | 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: | . o E . + | 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: |. + . S o . .| 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: |.+ oo o . o + .o| 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: |o +. = . o o + +| 2024-08-31T05:54:52.521 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: |.o .+.+ o +.*.| 2024-08-31T05:54:52.522 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: |...ooo .... .oOo=| 2024-08-31T05:54:52.522 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:54:52 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: +----[SHA256]-----+ 2024-08-31T05:54:53.422 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:53 smithi053 ceph-mon[18924]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:53.422 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:53 smithi053 ceph-mon[18924]: Generating ssh key... 2024-08-31T05:54:53.422 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:53 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:54:53.422 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:53 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:54:53.979 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwXeGY0EphfRNALTW76CdBZ7VsbNUY93kh4VX7KEmIig4Au0GkmQg5pgvSxpD0FB7XhwDo5/Oed1jfdfVk+9r14LDgrzJLNWp2ZHpr3hQYvi51wOxw2nX6N1dmHRU9zl6pPw6+R8jD5VoOTKSAn4yq9GclQKfwM2hKfq+u6wLZpPbJdxIX4/LT/jIEZk8RSi1cohq6qQuMDeIBB5WDUxCGZnnDMpRQyrPFgfpL5oqyM4Gx3ehKVM9bTkYh9ufJfWLC5UoxwkU1oT/17JFheVHh472JDjs/Cws6f5f66oDRB63XwizWsiQrOq43aV2yxXYb4ZUvagipBlsesuV4jdjUJteqWlqOUQIh8QtbhpZe4F9q78kGYY7dbeNiI7cHTWUROwMZTBdu9g9axBFJNxqsoziYnonrZf5Nij3wHtexC2dh20+94EFB0Z/5a8wujc6ngQzOxj2jlrhNl5pTU+zFg9vApS84KSUK3cdFmB2E3RzIUBS2YujkacYz5mVhgck= ceph-580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:54:53.980 INFO:teuthology.orchestra.run.smithi053.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-31T05:54:53.980 INFO:teuthology.orchestra.run.smithi053.stdout:Adding key to root@localhost authorized_keys... 2024-08-31T05:54:53.980 INFO:teuthology.orchestra.run.smithi053.stdout:Adding host smithi053... 2024-08-31T05:54:54.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:54 smithi053 ceph-mon[18924]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:55.680 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:55 smithi053 ceph-mon[18924]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi053", "addr": "172.21.15.53", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:56.905 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:56 smithi053 ceph-mon[18924]: Deploying cephadm binary to smithi053 2024-08-31T05:54:59.213 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Added host 'smithi053' with addr '172.21.15.53' 2024-08-31T05:54:59.213 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying unmanaged mon service... 2024-08-31T05:54:59.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:59 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:54:59.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:59 smithi053 ceph-mon[18924]: Added host smithi053 2024-08-31T05:54:59.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:54:59 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:55:01.065 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:00 smithi053 ceph-mon[18924]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:01.065 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:00 smithi053 ceph-mon[18924]: Saving service mon spec with placement count:5 2024-08-31T05:55:01.065 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:00 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:55:01.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-31T05:55:01.429 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying unmanaged mgr service... 2024-08-31T05:55:02.412 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:02 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:55:02.413 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:02 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:55:03.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:03 smithi053 ceph-mon[18924]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:03.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:03 smithi053 ceph-mon[18924]: Saving service mgr spec with placement count:2 2024-08-31T05:55:03.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:03 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:55:03.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-31T05:55:04.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:04 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:55:04.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:04 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1756744286' entity='client.admin' 2024-08-31T05:55:04.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:04 smithi053 ceph-mon[18924]: from='mgr.14118 172.21.15.53:0/3802402788' entity='mgr.x' 2024-08-31T05:55:05.614 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling the dashboard module... 2024-08-31T05:55:06.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:06 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2694967259' entity='client.admin' 2024-08-31T05:55:07.023 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:07 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2863668013' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-08-31T05:55:07.388 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:07 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: ignoring --setuser ceph since I am not root 2024-08-31T05:55:07.388 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:07 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: ignoring --setgroup ceph since I am not root 2024-08-31T05:55:08.343 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:08 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2863668013' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-31T05:55:08.343 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:08 smithi053 ceph-mon[18924]: mgrmap e9: x(active, since 19s) 2024-08-31T05:55:08.901 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:55:08.901 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-31T05:55:08.901 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T05:55:08.901 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T05:55:08.901 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T05:55:08.901 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:55:08.902 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for the mgr to restart... 2024-08-31T05:55:08.902 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr epoch 9... 2024-08-31T05:55:09.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:09 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4287318496' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T05:55:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:12 smithi053 ceph-mon[18924]: Active manager daemon x restarted 2024-08-31T05:55:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:12 smithi053 ceph-mon[18924]: Activating manager daemon x 2024-08-31T05:55:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:12 smithi053 ceph-mon[18924]: osdmap e3: 0 total, 0 up, 0 in 2024-08-31T05:55:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:12 smithi053 ceph-mon[18924]: mgrmap e10: x(active, starting, since 0.00393018s) 2024-08-31T05:55:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:12 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:55:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:12 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:55:12.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:12 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:55:12.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:12 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:55:12.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:12 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:55:12.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:12 smithi053 ceph-mon[18924]: Manager daemon x is now available 2024-08-31T05:55:13.587 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:13 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:55:13.587 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:13 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:55:13.587 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:13 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:55:13.588 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:13 smithi053 ceph-mon[18924]: mgrmap e11: x(active, since 1.00722s) 2024-08-31T05:55:13.865 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:55:13.865 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-31T05:55:13.866 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T05:55:13.866 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:55:13.866 INFO:teuthology.orchestra.run.smithi053.stdout:mgr epoch 9 is available 2024-08-31T05:55:13.866 INFO:teuthology.orchestra.run.smithi053.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-08-31T05:55:14.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:14 smithi053 ceph-mon[18924]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-31T05:55:14.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:14 smithi053 ceph-mon[18924]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-31T05:55:15.413 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-mon[18924]: mgrmap e12: x(active, since 2s) 2024-08-31T05:55:15.414 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-mon[18924]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:15.414 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:15.683 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUU3YIEZiBmUUExgt0WJAIfQNjC/YwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDgzMTA1NTUxNVoXDTM0\nMDkwMTA1NTUxNVowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjUzMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAt/jvbrkpC2EQbaLzao30Bgn6oM+G6qsfH6qK\n+GMfArQ7zpsF/bfasCBbdsLNqbM27Q+ODEKmrK5rW9KLLQkvudMCGHqXHsTGqSYP\nX+D7uf/OtbZistd8qKVDGqO3+W6JsjhYzfK2kLhT9rltCLSBFzy3CJ1fvgl2VWw/\n5Whaz0cYFEJNb9TF00uqEC95r7ntlIv/dybJWMfraD+zzJkgU69e5gpB69Et2IHZ\nxaCuDgc1ClBn0A2+lMOfqKRxj8ZaIAJ+Q/o6SX98wl2N3RBdFhX8oEzGzH3R0QCy\npUfPgB+Eifx9WGFBtieqB+64hr/aqLf+EphcNFAQoCHZAVEXNniq6DIduDsBf59F\neGr64moAlK411u8734BACieOnMd6hc9m96sUf9IPsXv84jXZZizP/SgCVLKjlh2W\ne1NSFaXIgk2fntwVppkUfgVQuJ70GdxnMGz+fDO97TvWYL9yWUZXQUw4+5EP4g/a\nt9tpdVJQyk0M8ny7qiHlZkGjpd9AbQKv6kR/G45/tEEs+OXBP0IVSDfJZCflcs11\nMMe0UUIModhxMpUaGYUP2BA1/hPiuPB6ynG14oSFxo7AeUsxinBjBm9ofOTIM3yv\nKWTv9j2/c1AjZm57czVR6n6HvJsh3HiGjBsQtSIU0YLu+1WWwkV9WadVaAk16f/e\nfpKVc+UCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDUzghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPNTAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQB+\nhK44CACPlZMd57CCpxgyNc3SET5Ql2gwAcoVIEnmSdtATEY8FcDsr1fZ0MOC8A3k\nnUswGEamCKxHUj7CWV3PeJe9A3LzoZPiL0JqS7UCrOr8N5ET4YZkeHIXpj9455N9\n+b+4HgqHjuOXS2oAsIINbtthWqaaU4gXmNVC5+925lGDR/NXsKHLZARy8L+6GA5w\nfCN49Y/wrP4Nrmwj6D13TIaUyGHWdzBZxX7u0qRcLYrNHaaFM3DOeNKTA81MLPPE\nxDVGCtJRcWP6G3MdttcucalQGwC0pipjb0cjT6sYWMePY/GH/Bd7KEWJxpf4k0uW\nPWkVNTsNHRLu2P6YxSDzGRb0xss7/7cRiuFPn9pGMsvjTdz0rYxGixS4flwUZOBI\nRqI0LEvM/JGperZXayklFJ4RgQk6xsKJpSkBT7pSHkSyWuk/BY8OLcneyj4HRF0C\n45AzREZsKpVqN8gEC5xw+90w4WypfxVBauJZTuQmNJXESktoMKbEEB0JpiMx/P+r\n6tboo38JvxjJZrTqzbtHppnQxnGtmQ1GOJU8OB47VO9t92Urqca5U2e9/DyzJUIq\nM1P1nrTlYgbkXyRzBypTRms3xYWsZvETv71KMJJ+TXn07vWElnx0kHkiVZmhMRW1\nlBPfl+Qs9Q+HncjCSq1LpWETJ3K9C8pYU9EPgW6fCg==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKgIBAAKCAgEAt/jvbrkpC2EQbaLzao30Bgn6oM+G6qsfH6qK+GMfArQ7zpsF\n/bfasCBbdsLNqbM27Q+ODEKmrK5rW9KLLQkvudMCGHqXHsTGqSYPX+D7uf/OtbZi\nstd8qKVDGqO3+W6JsjhYzfK2kLhT9rltCLSBFzy3CJ1fvgl2VWw/5Whaz0cYFEJN\nb9TF00uqEC95r7ntlIv/dybJWMfraD+zzJkgU69e5gpB69Et2IHZxaCuDgc1ClBn\n0A2+lMOfqKRxj8ZaIAJ+Q/o6SX98wl2N3RBdFhX8oEzGzH3R0QCypUfPgB+Eifx9\nWGFBtieqB+64hr/aqLf+EphcNFAQoCHZAVEXNniq6DIduDsBf59FeGr64moAlK41\n1u8734BACieOnMd6hc9m96sUf9IPsXv84jXZZizP/SgCVLKjlh2We1NSFaXIgk2f\nntwVppkUfgVQuJ70GdxnMGz+fDO97TvWYL9yWUZXQUw4+5EP4g/at9tpdVJQyk0M\n8ny7qiHlZkGjpd9AbQKv6kR/G45/tEEs+OXBP0IVSDfJZCflcs11MMe0UUIModhx\nMpUaGYUP2BA1/hPiuPB6ynG14oSFxo7AeUsxinBjBm9ofOTIM3yvKWTv9j2/c1Aj\nZm57czVR6n6HvJsh3HiGjBsQtSIU0YLu+1WWwkV9WadVaAk16f/efpKVc+UCAwEA\nAQKCAgAH47aM5obilIqKURskPisxWRs060FrbeQ7TOqBxWpuiMEp1o8Wttw7gl+5\nw5fjR6q61thuISuZqy8ydGCAkWzJCMoFt7gkWybz2Qx+vZy9+MDqHQS1i7UuXEv4\n5/17RmjESlNQnbCDm0wKgCAzZ95DW1i0F1+kPC6lcit5UJTYX8GiGMfOXG8RZSTJ\nZefPh+cu4CQX/YNT+drYESdKRmTTAenNbrIuBT30k3j91yqvslJte05AZ159bbg6\nmLbABi8WQVUd4CzAuyVkBnQPf2SmjlHTpAdAfMLTNjbzDJXS9kcOTdQoRp91StUp\nWuzx5mdfpehQ7tTBb4+O9nSicFJQ8lewbtUTPA2mExFEG/RejLvbYNWkkvQ42oVe\nquNU6kQbgzIqBchs+rUHFV0ioPQ+EOjuxEP1rf9DsOn0m3gJp3AtrHi5IQb5KIRf\noZajNUgma/yI+ObZaLR2PHwX0aeWCxHm2zxOIuy5U0mP4OG3OyrHcOJZ5ITvJt01\njNb0BfIQ6svkYmFAO+3+u+zYlwe9R9p77ra4wgp3MLkJok+L0tnTIf04eQiEQU+V\nMuFmMTMLktvqdjmZGm8clvMHn8TBZdStyyfd3E2ojVQvocm5TD6uR+NLD8HtSl9v\n6AnKfp16czVZrrWmUKP6UYziH69cnEoXdK9vJCuJq0nos8VMTwKCAQEA/voG+ep8\nKNkEHOvigHaovOjt/W9eCryUWGH6B8xrtJpm1rl9Ih2ZhieXCwtiPadkStOEmPKA\n3YGkZ3mr5BvEtz2a9vSr6zmCjCMwTf5D8RJqDH97I4I9pV85gXonXASbVxOuJ6+m\ndBMbXonbSmTn6zRHWjCf/RC8AAMcabZbVbfSMdnkeNen0iKQjaCXCLN/VYUY60Yd\npbNCbrtV+5dJCtvTcVdMLI7FBxaGR671q2s81k1kWVkPzoQDghy0hqv7Od9IRWE1\nIyahqmV2/z73/hJQTHNkyc3sQzCTx0MJyp+JtYYYDn62WahhMY0nDr3r2Zumwouy\nJY0c0L5HIvdkEwKCAQEAuLX0nn125sQMIrkeqcFvdCA/p1iJ3xicSsdpI1tIBMzr\n+weihutxvRTkQRpOupYzguQ5yCca7gzLe/CtPPbojF223dmq3kTUE7nFxbB54Oc5\nekmKEnCC6Xf761XGXlYh4217Q/JeEHnFME0oT3jcNCWzkwKwscgEVJYlxMC3cOLu\nFPDgeHq3zo9zOkI8cCETzoaj30kSyvRGNrfReYbRQQO4PXE129DZRGBK3TH/G7RO\nVvqWrWAeLHIpPlEZuYLbceV3xNyaxEVbcZPMuUbedlSZDpDQUKaw9IX25QWG0/kM\nm5RMJcVpX7FCOa5fOUbArvLkVCbc3XL71iBx8WqXJwKCAQEA4xjIC+G4ch1QF35U\n/7wv8Am6psaBSSjLK6kgK7/7kiEPRWJyPGeGrMEoO3MJLgagQjEAYcVj12Y3it4I\npiPBYr+g/SHQ2bIgPza8OEsmMloHUFhe0bKXu2oD6vlkgwWrYbQqojhFFg9KijpY\nsXsMQSYQAxlZ9ejouU4MCW+dC8ysjzAV2Teixnt4qlwFCX/uArqIBk0t7L6rhbqf\nC3WkXeKLAeER/IGwpO5/7Oq87s+VoP3PSfEULgjQoxt0Apq9KL9hPEInNMacqQq0\nIQTxlj6zfFQuybr6GqHyjUB9QRY1bhMf7BEZ0uMwphSlW/D2VpvWvGH16pIzvwwq\nic80NwKCAQEAhm+QSeZBKvYXaxJXOfBawSdTjOYI+sI7xsVaRWyDf1LykfNdnFsy\nng7djnCqSm1VsnePgpjLpeTUGTHztIJ0gO0YUmHBViK8RFsakaa/HizMja+GeaM/\n9NLqHL+CMFj6M0AUzkBRrCYkmeIea7EofB/QkjgMCGjule3uMUSeft/7rmwexDF1\nJDcOA6H/wRCiDNe736Cct/CQRfUF1jCEjpA5gSarr4BTEcwP0Ow5o51Ywz+BeVCS\nxYCVehCm63lNZJlB0ZtKXX2pb4HGKDdnZLJv78UAiSK5ek8igk/CcPc78OQ/g+Ip\nrociDz9VeSeAyBRqkMD0UY0FtDRLGg2dUwKCAQEA63ZmoThPyvGUsLquAnrmaCDv\n4VmuoJqSyS81feHXw0i+omiao5cO53zg5y1GMoNHj43UZl3OoUPyivxK0uU042lz\ngsDNpz67p4W26zFVsGdJ5VzMJHH/q6l0XIjVRUorYeYv8JCPzMLDkeiJ3j9wqARr\nGRO49KsNOqH/qzUGjIFws3Wt5rXCOBr+hSVMYy8JRrdCFSUoEZhhIQMVwJ7JzI4m\nOH1RADrr+QtQ/4s0ipZH0CsH6K5GD+jzbgBnb454KZYMOYamk8lC6g++jpaLs8De\nGHIv0ZGEdr9eGjFO2tlcJVqvOd2qQoBRzF/QODJZV4ztPLBcOajVHFWzk0o5Tw==\n-----END RSA PRIVATE KEY-----\n"} 2024-08-31T05:55:16.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T05:55:15.958+0000 7fd9a793d640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:05:55:15] ENGINE Error in HTTPServer.serve 2024-08-31T05:55:16.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: Traceback (most recent call last): 2024-08-31T05:55:16.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:55:16.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self._connections.run(self.expiration_interval) 2024-08-31T05:55:16.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:55:16.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self._run(expiration_interval) 2024-08-31T05:55:16.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: s = self.context.wrap_socket( 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: return self.sslsocket_class._create( 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self.do_handshake() 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self._sslobj.do_handshake() 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:55:16.227 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:55:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T05:55:16.892 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-08-31T05:55:17.014 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:16 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:17.014 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:16 smithi053 ceph-mon[18924]: [31/Aug/2024:05:55:15] ENGINE Bus STARTING 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:16 smithi053 ceph-mon[18924]: [31/Aug/2024:05:55:15] ENGINE Serving on https://172.21.15.53:7150 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:16 smithi053 ceph-mon[18924]: [31/Aug/2024:05:55:15] ENGINE Error in HTTPServer.serve 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout: Traceback (most recent call last): 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout: self._run(expiration_interval) 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:55:17.015 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:55:17.016 INFO:journalctl@ceph.mon.a.smithi053.stdout: s = self.context.wrap_socket( 2024-08-31T05:55:17.016 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:55:17.016 INFO:journalctl@ceph.mon.a.smithi053.stdout: return self.sslsocket_class._create( 2024-08-31T05:55:17.016 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:55:17.016 INFO:journalctl@ceph.mon.a.smithi053.stdout: self.do_handshake() 2024-08-31T05:55:17.016 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:55:17.016 INFO:journalctl@ceph.mon.a.smithi053.stdout: self._sslobj.do_handshake() 2024-08-31T05:55:17.016 INFO:journalctl@ceph.mon.a.smithi053.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:55:17.016 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:16 smithi053 ceph-mon[18924]: [31/Aug/2024:05:55:16] ENGINE Serving on http://172.21.15.53:8765 2024-08-31T05:55:17.016 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:16 smithi053 ceph-mon[18924]: [31/Aug/2024:05:55:16] ENGINE Bus STARTED 2024-08-31T05:55:17.016 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:16 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:17.971 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:17 smithi053 ceph-mon[18924]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:18.653 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-08-31T05:55:18.653 INFO:teuthology.orchestra.run.smithi053.stdout:Creating initial admin user... 2024-08-31T05:55:19.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:18 smithi053 ceph-mon[18924]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:19.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:18 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:20.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$pzE0ZrC5zvxEbrNRAVEuLu9HAVEyWyBZs23eU6UdyGqU8WQAFB4be", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725083719, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-31T05:55:20.109 INFO:teuthology.orchestra.run.smithi053.stdout:Fetching dashboard port number... 2024-08-31T05:55:20.717 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:20 smithi053 ceph-mon[18924]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:20.717 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:20 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:21.258 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 8443 2024-08-31T05:55:21.269 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:55:21.269 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout disabled 2024-08-31T05:55:21.276 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:55:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-08-31T05:55:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld.service is not enabled 2024-08-31T05:55:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-31T05:55:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:Ceph Dashboard is now available at: 2024-08-31T05:55:21.278 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:21.278 INFO:teuthology.orchestra.run.smithi053.stdout: URL: https://smithi053:8443/ 2024-08-31T05:55:21.279 INFO:teuthology.orchestra.run.smithi053.stdout: User: admin 2024-08-31T05:55:21.279 INFO:teuthology.orchestra.run.smithi053.stdout: Password: mf9tqb0r4c 2024-08-31T05:55:21.279 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:Saving cluster configuration to /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config directory 2024-08-31T05:55:21.963 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:21 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1480560434' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-08-31T05:55:22.531 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-31T05:55:22.531 INFO:teuthology.orchestra.run.smithi053.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-31T05:55:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:55:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:22.531 INFO:teuthology.orchestra.run.smithi053.stdout:Or, if you are only running a single cluster on this host: 2024-08-31T05:55:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-31T05:55:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:22.531 INFO:teuthology.orchestra.run.smithi053.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-31T05:55:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: ceph telemetry on 2024-08-31T05:55:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:22.532 INFO:teuthology.orchestra.run.smithi053.stdout:For more information see: 2024-08-31T05:55:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-31T05:55:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:22.532 INFO:teuthology.orchestra.run.smithi053.stdout:Bootstrap complete. 2024-08-31T05:55:22.573 INFO:tasks.cephadm:Fetching config... 2024-08-31T05:55:22.574 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:55:22.574 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-31T05:55:22.590 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-31T05:55:22.590 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:55:22.590 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-31T05:55:22.645 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-31T05:55:22.645 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:55:22.645 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-31T05:55:22.710 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-31T05:55:22.710 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:55:22.710 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-31T05:55:22.765 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-31T05:55:22.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwXeGY0EphfRNALTW76CdBZ7VsbNUY93kh4VX7KEmIig4Au0GkmQg5pgvSxpD0FB7XhwDo5/Oed1jfdfVk+9r14LDgrzJLNWp2ZHpr3hQYvi51wOxw2nX6N1dmHRU9zl6pPw6+R8jD5VoOTKSAn4yq9GclQKfwM2hKfq+u6wLZpPbJdxIX4/LT/jIEZk8RSi1cohq6qQuMDeIBB5WDUxCGZnnDMpRQyrPFgfpL5oqyM4Gx3ehKVM9bTkYh9ufJfWLC5UoxwkU1oT/17JFheVHh472JDjs/Cws6f5f66oDRB63XwizWsiQrOq43aV2yxXYb4ZUvagipBlsesuV4jdjUJteqWlqOUQIh8QtbhpZe4F9q78kGYY7dbeNiI7cHTWUROwMZTBdu9g9axBFJNxqsoziYnonrZf5Nij3wHtexC2dh20+94EFB0Z/5a8wujc6ngQzOxj2jlrhNl5pTU+zFg9vApS84KSUK3cdFmB2E3RzIUBS2YujkacYz5mVhgck= ceph-580e8a36-675d-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T05:55:22.840 INFO:teuthology.orchestra.run.smithi053.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwXeGY0EphfRNALTW76CdBZ7VsbNUY93kh4VX7KEmIig4Au0GkmQg5pgvSxpD0FB7XhwDo5/Oed1jfdfVk+9r14LDgrzJLNWp2ZHpr3hQYvi51wOxw2nX6N1dmHRU9zl6pPw6+R8jD5VoOTKSAn4yq9GclQKfwM2hKfq+u6wLZpPbJdxIX4/LT/jIEZk8RSi1cohq6qQuMDeIBB5WDUxCGZnnDMpRQyrPFgfpL5oqyM4Gx3ehKVM9bTkYh9ufJfWLC5UoxwkU1oT/17JFheVHh472JDjs/Cws6f5f66oDRB63XwizWsiQrOq43aV2yxXYb4ZUvagipBlsesuV4jdjUJteqWlqOUQIh8QtbhpZe4F9q78kGYY7dbeNiI7cHTWUROwMZTBdu9g9axBFJNxqsoziYnonrZf5Nij3wHtexC2dh20+94EFB0Z/5a8wujc6ngQzOxj2jlrhNl5pTU+zFg9vApS84KSUK3cdFmB2E3RzIUBS2YujkacYz5mVhgck= ceph-580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:55:22.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwXeGY0EphfRNALTW76CdBZ7VsbNUY93kh4VX7KEmIig4Au0GkmQg5pgvSxpD0FB7XhwDo5/Oed1jfdfVk+9r14LDgrzJLNWp2ZHpr3hQYvi51wOxw2nX6N1dmHRU9zl6pPw6+R8jD5VoOTKSAn4yq9GclQKfwM2hKfq+u6wLZpPbJdxIX4/LT/jIEZk8RSi1cohq6qQuMDeIBB5WDUxCGZnnDMpRQyrPFgfpL5oqyM4Gx3ehKVM9bTkYh9ufJfWLC5UoxwkU1oT/17JFheVHh472JDjs/Cws6f5f66oDRB63XwizWsiQrOq43aV2yxXYb4ZUvagipBlsesuV4jdjUJteqWlqOUQIh8QtbhpZe4F9q78kGYY7dbeNiI7cHTWUROwMZTBdu9g9axBFJNxqsoziYnonrZf5Nij3wHtexC2dh20+94EFB0Z/5a8wujc6ngQzOxj2jlrhNl5pTU+zFg9vApS84KSUK3cdFmB2E3RzIUBS2YujkacYz5mVhgck= ceph-580e8a36-675d-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T05:55:22.893 INFO:teuthology.orchestra.run.smithi130.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwXeGY0EphfRNALTW76CdBZ7VsbNUY93kh4VX7KEmIig4Au0GkmQg5pgvSxpD0FB7XhwDo5/Oed1jfdfVk+9r14LDgrzJLNWp2ZHpr3hQYvi51wOxw2nX6N1dmHRU9zl6pPw6+R8jD5VoOTKSAn4yq9GclQKfwM2hKfq+u6wLZpPbJdxIX4/LT/jIEZk8RSi1cohq6qQuMDeIBB5WDUxCGZnnDMpRQyrPFgfpL5oqyM4Gx3ehKVM9bTkYh9ufJfWLC5UoxwkU1oT/17JFheVHh472JDjs/Cws6f5f66oDRB63XwizWsiQrOq43aV2yxXYb4ZUvagipBlsesuV4jdjUJteqWlqOUQIh8QtbhpZe4F9q78kGYY7dbeNiI7cHTWUROwMZTBdu9g9axBFJNxqsoziYnonrZf5Nij3wHtexC2dh20+94EFB0Z/5a8wujc6ngQzOxj2jlrhNl5pTU+zFg9vApS84KSUK3cdFmB2E3RzIUBS2YujkacYz5mVhgck= ceph-580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:55:22.905 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwXeGY0EphfRNALTW76CdBZ7VsbNUY93kh4VX7KEmIig4Au0GkmQg5pgvSxpD0FB7XhwDo5/Oed1jfdfVk+9r14LDgrzJLNWp2ZHpr3hQYvi51wOxw2nX6N1dmHRU9zl6pPw6+R8jD5VoOTKSAn4yq9GclQKfwM2hKfq+u6wLZpPbJdxIX4/LT/jIEZk8RSi1cohq6qQuMDeIBB5WDUxCGZnnDMpRQyrPFgfpL5oqyM4Gx3ehKVM9bTkYh9ufJfWLC5UoxwkU1oT/17JFheVHh472JDjs/Cws6f5f66oDRB63XwizWsiQrOq43aV2yxXYb4ZUvagipBlsesuV4jdjUJteqWlqOUQIh8QtbhpZe4F9q78kGYY7dbeNiI7cHTWUROwMZTBdu9g9axBFJNxqsoziYnonrZf5Nij3wHtexC2dh20+94EFB0Z/5a8wujc6ngQzOxj2jlrhNl5pTU+zFg9vApS84KSUK3cdFmB2E3RzIUBS2YujkacYz5mVhgck= ceph-580e8a36-675d-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T05:55:22.946 INFO:teuthology.orchestra.run.smithi153.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwXeGY0EphfRNALTW76CdBZ7VsbNUY93kh4VX7KEmIig4Au0GkmQg5pgvSxpD0FB7XhwDo5/Oed1jfdfVk+9r14LDgrzJLNWp2ZHpr3hQYvi51wOxw2nX6N1dmHRU9zl6pPw6+R8jD5VoOTKSAn4yq9GclQKfwM2hKfq+u6wLZpPbJdxIX4/LT/jIEZk8RSi1cohq6qQuMDeIBB5WDUxCGZnnDMpRQyrPFgfpL5oqyM4Gx3ehKVM9bTkYh9ufJfWLC5UoxwkU1oT/17JFheVHh472JDjs/Cws6f5f66oDRB63XwizWsiQrOq43aV2yxXYb4ZUvagipBlsesuV4jdjUJteqWlqOUQIh8QtbhpZe4F9q78kGYY7dbeNiI7cHTWUROwMZTBdu9g9axBFJNxqsoziYnonrZf5Nij3wHtexC2dh20+94EFB0Z/5a8wujc6ngQzOxj2jlrhNl5pTU+zFg9vApS84KSUK3cdFmB2E3RzIUBS2YujkacYz5mVhgck= ceph-580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:55:22.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-31T05:55:23.213 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:55:23.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:22 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1642897416' entity='client.admin' 2024-08-31T05:55:24.668 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-31T05:55:24.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-31T05:55:25.158 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:55:25.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:24 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/970428333' entity='client.admin' 2024-08-31T05:55:26.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:25 smithi053 ceph-mon[18924]: mgrmap e13: x(active, since 12s) 2024-08-31T05:55:26.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:25 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:26.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:25 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:26.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:25 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"} : dispatch 2024-08-31T05:55:26.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:25 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:26.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:25 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:55:26.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:25 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:27.453 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:27.453 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:27.453 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:55:27.453 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:27.453 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:55:27.454 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: Updating smithi053:/etc/ceph/ceph.conf 2024-08-31T05:55:27.454 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: Updating smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:55:27.454 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:55:27.454 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: Updating smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:55:27.454 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:27.454 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:27.454 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:27 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:27.481 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi130 2024-08-31T05:55:27.481 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-31T05:55:27.482 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/etc/ceph/ceph.conf 2024-08-31T05:55:27.500 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-31T05:55:27.501 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:55:27.559 INFO:tasks.cephadm:Adding host smithi130 to orchestrator... 2024-08-31T05:55:27.559 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch host add smithi130 2024-08-31T05:55:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:55:29.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:29 smithi053 ceph-mon[18924]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi130", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:30.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:30 smithi053 ceph-mon[18924]: Deploying cephadm binary to smithi130 2024-08-31T05:55:32.528 INFO:teuthology.orchestra.run.smithi053.stdout:Added host 'smithi130' with addr '172.21.15.130' 2024-08-31T05:55:33.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T05:55:33.590 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:55:33.686 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:33 smithi053 ceph-mon[18924]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:33.686 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:33 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:33.686 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:33 smithi053 ceph-mon[18924]: Added host smithi130 2024-08-31T05:55:33.686 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:33 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:55:33.686 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:33 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:33.687 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:33 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:34.328 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:34.328 INFO:teuthology.orchestra.run.smithi053.stdout:[{"addr": "172.21.15.53", "hostname": "smithi053", "labels": [], "status": ""}, {"addr": "172.21.15.130", "hostname": "smithi130", "labels": [], "status": ""}] 2024-08-31T05:55:34.902 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:34 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:34.904 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi153 2024-08-31T05:55:34.904 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-31T05:55:34.904 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.conf 2024-08-31T05:55:34.923 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-31T05:55:34.923 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:55:34.981 INFO:tasks.cephadm:Adding host smithi153 to orchestrator... 2024-08-31T05:55:34.981 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch host add smithi153 2024-08-31T05:55:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:55:35.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:35 smithi053 ceph-mon[18924]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:35.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:35 smithi053 ceph-mon[18924]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:55:37.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:36 smithi053 ceph-mon[18924]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:37.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:36 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:37.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:36 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:37.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:36 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:37.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:36 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:37.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:36 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"} : dispatch 2024-08-31T05:55:37.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:36 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:37.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:36 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:55:38.127 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:37 smithi053 ceph-mon[18924]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:38.127 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:37 smithi053 ceph-mon[18924]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-31T05:55:38.128 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:37 smithi053 ceph-mon[18924]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:55:38.128 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:37 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:38.128 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:37 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:38.128 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:37 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:39.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:38 smithi053 ceph-mon[18924]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:55:39.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:38 smithi053 ceph-mon[18924]: Deploying cephadm binary to smithi153 2024-08-31T05:55:39.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:38 smithi053 ceph-mon[18924]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:55:39.947 INFO:teuthology.orchestra.run.smithi053.stdout:Added host 'smithi153' with addr '172.21.15.153' 2024-08-31T05:55:40.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:39 smithi053 ceph-mon[18924]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:40.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T05:55:40.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:40 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:40.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:40 smithi053 ceph-mon[18924]: Added host smithi153 2024-08-31T05:55:40.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:40 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:55:40.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:40 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:40.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:40 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:40.990 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:55:41.692 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:55:41.693 INFO:teuthology.orchestra.run.smithi053.stdout:[{"addr": "172.21.15.53", "hostname": "smithi053", "labels": [], "status": ""}, {"addr": "172.21.15.130", "hostname": "smithi130", "labels": [], "status": ""}, {"addr": "172.21.15.153", "hostname": "smithi153", "labels": [], "status": ""}] 2024-08-31T05:55:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:41 smithi053 ceph-mon[18924]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:41 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:42.276 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-31T05:55:42.276 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd crush tunables default 2024-08-31T05:55:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:55:43.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:42 smithi053 ceph-mon[18924]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:55:43.949 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2024-08-31T05:55:44.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:43 smithi053 ceph-mon[18924]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:44.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/379109209' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T05:55:44.584 INFO:tasks.cephadm:Adding mon.a on smithi053 2024-08-31T05:55:44.584 INFO:tasks.cephadm:Adding mon.b on smithi130 2024-08-31T05:55:44.584 INFO:tasks.cephadm:Adding mon.c on smithi153 2024-08-31T05:55:44.584 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch apply mon '3;smithi053:172.21.15.53=a;smithi130:172.21.15.130=b;smithi153:172.21.15.153=c' 2024-08-31T05:55:44.833 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:55:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:44 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/379109209' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T05:55:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:44 smithi053 ceph-mon[18924]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:55:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:44 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:44 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:44 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:44 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:44 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"} : dispatch 2024-08-31T05:55:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:44 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:44 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:55:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:44 smithi053 ceph-mon[18924]: Updating smithi153:/etc/ceph/ceph.conf 2024-08-31T05:55:45.498 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mon update... 2024-08-31T05:55:46.117 DEBUG:teuthology.orchestra.run.smithi130:mon.b> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.b.service 2024-08-31T05:55:46.120 DEBUG:teuthology.orchestra.run.smithi153:mon.c> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.c.service 2024-08-31T05:55:46.123 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T05:55:46.123 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:55:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:46.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:55:46.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:45 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:47.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:46 smithi053 ceph-mon[18924]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi053:172.21.15.53=a;smithi130:172.21.15.130=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:47.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:46 smithi053 ceph-mon[18924]: Saving service mon spec with placement smithi053:172.21.15.53=a;smithi130:172.21.15.130=b;smithi153:172.21.15.153=c;count:3 2024-08-31T05:55:47.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:46 smithi053 ceph-mon[18924]: Deploying daemon mon.c on smithi153 2024-08-31T05:55:48.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:47 smithi053 ceph-mon[18924]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:48.226 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:55:49.113 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:55:49.113 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:54:11.618583Z","created":"2024-08-31T05:54:11.618583Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:55:49.113 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-08-31T05:55:49.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:49 smithi153 podman[22301]: 2024-08-31 05:55:49.772265224 +0000 UTC m=+0.015828216 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:55:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:49 smithi053 ceph-mon[18924]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:49 smithi053 ceph-mon[18924]: from='client.? 172.21.15.153:0/2701775346' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:55:50.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 podman[22301]: 2024-08-31 05:55:50.027905469 +0000 UTC m=+0.271468449 container init edfdf3191eb47f791829c4eb2b780d4848024d627dffc6feee4ec0ca2884943e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-c, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:55:50.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 podman[22301]: 2024-08-31 05:55:50.030970918 +0000 UTC m=+0.274533905 container start edfdf3191eb47f791829c4eb2b780d4848024d627dffc6feee4ec0ca2884943e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:55:50.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T05:55:50.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T05:55:50.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: pidfile_write: ignore empty --pid-file 2024-08-31T05:55:50.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: load: jerasure load: lrc 2024-08-31T05:55:50.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: RocksDB version: 7.9.2 2024-08-31T05:55:50.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Git sha 0 2024-08-31T05:55:50.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T05:55:50.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: DB SUMMARY 2024-08-31T05:55:50.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: DB Session ID: MABO01ZZF4CCV9M0VN32 2024-08-31T05:55:50.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: CURRENT file: CURRENT 2024-08-31T05:55:50.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T05:55:50.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-31T05:55:50.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-31T05:55:50.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-31T05:55:50.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.error_if_exists: 0 2024-08-31T05:55:50.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.create_if_missing: 0 2024-08-31T05:55:50.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.paranoid_checks: 1 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.env: 0x55eb610c55a0 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.info_log: 0x55eb66cb94e0 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.statistics: (nil) 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.use_fsync: 0 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_log_file_size: 0 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T05:55:50.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.allow_fallocate: 1 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.use_direct_reads: 0 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.db_log_dir: 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.wal_dir: 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T05:55:50.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.write_buffer_manager: 0x55eb66cbd5e0 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T05:55:50.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.unordered_write: 0 2024-08-31T05:55:50.268 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T05:55:50.268 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T05:55:50.268 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T05:55:50.268 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T05:55:50.268 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.row_cache: None 2024-08-31T05:55:50.269 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.wal_filter: None 2024-08-31T05:55:50.269 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.two_write_queues: 0 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.wal_compression: 0 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.atomic_flush: 0 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.log_readahead_size: 0 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T05:55:50.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_background_jobs: 2 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_background_compactions: -1 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_subcompactions: 1 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T05:55:50.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_open_files: -1 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_background_flushes: -1 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Compression algorithms supported: 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: kZSTD supported: 0 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: kXpressCompression supported: 0 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: kBZip2Compression supported: 0 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: kLZ4Compression supported: 1 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: kZlibCompression supported: 1 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: kSnappyCompression supported: 1 2024-08-31T05:55:50.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.merge_operator: 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_filter: None 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55eb66cb9100) 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout: cache_index_and_filter_blocks: 1 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T05:55:50.273 INFO:journalctl@ceph.mon.c.smithi153.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: pin_top_level_index_and_filter: 1 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: index_type: 0 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: data_block_index_type: 0 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: index_shortening: 1 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: checksum: 4 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: no_block_cache: 0 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache: 0x55eb62c7c850 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache_name: BinnedLRUCache 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache_options: 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: capacity : 536870912 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: num_shard_bits : 4 2024-08-31T05:55:50.274 INFO:journalctl@ceph.mon.c.smithi153.stdout: strict_capacity_limit : 0 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: high_pri_pool_ratio: 0.000 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache_compressed: (nil) 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: persistent_cache: (nil) 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_size: 4096 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_size_deviation: 10 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_restart_interval: 16 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: index_block_restart_interval: 1 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: metadata_block_size: 4096 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: partition_filters: 0 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: use_delta_encoding: 1 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: filter_policy: bloomfilter 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: whole_key_filtering: 1 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: verify_compression: 0 2024-08-31T05:55:50.275 INFO:journalctl@ceph.mon.c.smithi153.stdout: read_amp_bytes_per_bit: 0 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout: format_version: 5 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout: enable_index_compression: 1 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_align: 0 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout: max_auto_readahead_size: 262144 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout: prepopulate_block_cache: 0 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout: initial_auto_readahead_size: 8192 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compression: NoCompression 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T05:55:50.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.num_levels: 7 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T05:55:50.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T05:55:50.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T05:55:50.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T05:55:50.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.inplace_update_support: 0 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.bloom_locality: 0 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.max_successive_merges: 0 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.ttl: 2592000 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T05:55:50.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.enable_blob_files: false 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.min_blob_size: 0 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-31T05:55:50.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bfd240f3-b756-4642-a81c-f0e7b2d6be7d 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725083750124720, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725083750125163, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725083750, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bfd240f3-b756-4642-a81c-f0e7b2d6be7d", "db_session_id": "MABO01ZZF4CCV9M0VN32", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725083750125258, "job": 1, "event": "recovery_finished"} 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55eb66cdca80 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: DB pointer 0x55eb67a7e000 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** DB Stats ** 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T05:55:50.283 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** Compaction Stats [default] ** 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-08-31T05:55:50.284 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** Compaction Stats [default] ** 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:55:50.285 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout: Block cache BinnedLRUCache@0x55eb62c7c850#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: using public_addr v2:172.21.15.153:0/0 -> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: starting mon.c rank -1 at public addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] at bind addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(???) e0 preinit fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).mds e1 new map 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).mds e1 print_map 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout: e1 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout: btime 2024-08-31T05:54:18:179948+0000 2024-08-31T05:55:50.286 INFO:journalctl@ceph.mon.c.smithi153.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout: legacy client fscid: -1 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout: No filesystems configured 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:55:50.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"} : dispatch 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:55:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Deploying cephadm binary to smithi153 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Added host smithi153 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/379109209' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/379109209' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"} : dispatch 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Updating smithi153:/etc/ceph/ceph.conf 2024-08-31T05:55:50.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi053:172.21.15.53=a;smithi130:172.21.15.130=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:50.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Saving service mon spec with placement smithi053:172.21.15.53=a;smithi130:172.21.15.130=b;smithi153:172.21.15.153=c;count:3 2024-08-31T05:55:50.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: Deploying daemon mon.c on smithi153 2024-08-31T05:55:50.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:50.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:50.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: from='client.? 172.21.15.153:0/2701775346' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:55:50.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 ceph-mon[22320]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-31T05:55:50.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 bash[22301]: edfdf3191eb47f791829c4eb2b780d4848024d627dffc6feee4ec0ca2884943e 2024-08-31T05:55:50.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:50 smithi153 systemd[1]: Started Ceph mon.c for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T05:55:50.671 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T05:55:50.671 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:55:50.939 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:55:55.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:55:55.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: mon.a calling monitor election 2024-08-31T05:55:55.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:55.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: mon.c calling monitor election 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: monmap epoch 2 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: last_changed 2024-08-31T05:55:50.153906+0000 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: created 2024-08-31T05:54:11.618583+0000 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: min_mon_release 19 (squid) 2024-08-31T05:55:55.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: election_strategy: 1 2024-08-31T05:55:55.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-08-31T05:55:55.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-08-31T05:55:55.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: fsmap 2024-08-31T05:55:55.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:55:55.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: mgrmap e13: x(active, since 42s) 2024-08-31T05:55:55.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: overall HEALTH_OK 2024-08-31T05:55:55.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:55.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:55.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:55.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:55:55.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:55 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:55.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:55:55.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: mon.a calling monitor election 2024-08-31T05:55:55.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:55.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: mon.c calling monitor election 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: monmap epoch 2 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: last_changed 2024-08-31T05:55:50.153906+0000 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: created 2024-08-31T05:54:11.618583+0000 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: min_mon_release 19 (squid) 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: election_strategy: 1 2024-08-31T05:55:55.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-08-31T05:55:55.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-08-31T05:55:55.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: fsmap 2024-08-31T05:55:55.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:55:55.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: mgrmap e13: x(active, since 42s) 2024-08-31T05:55:55.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: overall HEALTH_OK 2024-08-31T05:55:55.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:55.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:55.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:55.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:55:55.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:55 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:56.036 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:55:56.036 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:55:50.153906Z","created":"2024-08-31T05:54:11.618583Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T05:55:56.037 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 2 2024-08-31T05:55:56.336 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:56 smithi153 ceph-mon[22320]: Deploying daemon mon.b on smithi130 2024-08-31T05:55:56.336 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:56 smithi153 ceph-mon[22320]: from='client.? 172.21.15.153:0/4243850840' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:55:56.336 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:56 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:56.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:56 smithi053 ceph-mon[18924]: Deploying daemon mon.b on smithi130 2024-08-31T05:55:56.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:56 smithi053 ceph-mon[18924]: from='client.? 172.21.15.153:0/4243850840' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:55:56.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:56 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:57.631 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T05:55:57.631 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:55:57.660 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:55:57 smithi153 ceph-mon[22320]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:57.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:55:57 smithi053 ceph-mon[18924]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:55:58.511 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 systemd[1]: Starting Ceph mon.b for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T05:55:58.589 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:55:58.589 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:55:50.153906Z","created":"2024-08-31T05:54:11.618583Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T05:55:58.589 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 2 2024-08-31T05:55:58.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 podman[22247]: 2024-08-31 05:55:58.690262442 +0000 UTC m=+0.110380475 container create 5efdc58039f122fea57be8e55e36e876cb37a80c98c57d44789d9d2ef550c63f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-31T05:55:58.791 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 podman[22247]: 2024-08-31 05:55:58.595468525 +0000 UTC m=+0.015586565 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:55:59.050 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 podman[22247]: 2024-08-31 05:55:58.892468791 +0000 UTC m=+0.312586833 container init 5efdc58039f122fea57be8e55e36e876cb37a80c98c57d44789d9d2ef550c63f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 podman[22247]: 2024-08-31 05:55:58.89568531 +0000 UTC m=+0.315803345 container start 5efdc58039f122fea57be8e55e36e876cb37a80c98c57d44789d9d2ef550c63f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pidfile_write: ignore empty --pid-file 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: load: jerasure load: lrc 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: RocksDB version: 7.9.2 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Git sha 0 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: DB SUMMARY 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: DB Session ID: UXAQHESCUQFT9O1ZRVIN 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: CURRENT file: CURRENT 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T05:55:59.051 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.error_if_exists: 0 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.create_if_missing: 0 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.paranoid_checks: 1 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.env: 0x55b3ff9f55a0 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.info_log: 0x55b404be54e0 2024-08-31T05:55:59.052 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T05:55:59.053 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.statistics: (nil) 2024-08-31T05:55:59.053 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.use_fsync: 0 2024-08-31T05:55:59.053 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_log_file_size: 0 2024-08-31T05:55:59.053 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.allow_fallocate: 1 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.use_direct_reads: 0 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.db_log_dir: 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.wal_dir: 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T05:55:59.054 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.write_buffer_manager: 0x55b404be95e0 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T05:55:59.055 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.unordered_write: 0 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.row_cache: None 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.wal_filter: None 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.two_write_queues: 0 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T05:55:59.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.wal_compression: 0 2024-08-31T05:55:59.057 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.atomic_flush: 0 2024-08-31T05:55:59.057 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T05:55:59.057 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T05:55:59.057 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T05:55:59.057 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.log_readahead_size: 0 2024-08-31T05:55:59.057 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T05:55:59.057 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T05:55:59.057 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T05:55:59.057 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T05:55:59.057 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T05:55:59.057 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_background_jobs: 2 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_background_compactions: -1 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_subcompactions: 1 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T05:55:59.058 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_open_files: -1 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_background_flushes: -1 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Compression algorithms supported: 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: kZSTD supported: 0 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: kXpressCompression supported: 0 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: kBZip2Compression supported: 0 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: kLZ4Compression supported: 1 2024-08-31T05:55:59.059 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: kZlibCompression supported: 1 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: kSnappyCompression supported: 1 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.merge_operator: 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_filter: None 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T05:55:59.060 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b404be5100) 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout: cache_index_and_filter_blocks: 1 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout: pin_top_level_index_and_filter: 1 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout: index_type: 0 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout: data_block_index_type: 0 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout: index_shortening: 1 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout: checksum: 4 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout: no_block_cache: 0 2024-08-31T05:55:59.061 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_cache: 0x55b400ba8850 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_cache_name: BinnedLRUCache 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_cache_options: 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: capacity : 536870912 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: num_shard_bits : 4 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: strict_capacity_limit : 0 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: high_pri_pool_ratio: 0.000 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_cache_compressed: (nil) 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: persistent_cache: (nil) 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_size: 4096 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_size_deviation: 10 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_restart_interval: 16 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: index_block_restart_interval: 1 2024-08-31T05:55:59.062 INFO:journalctl@ceph.mon.b.smithi130.stdout: metadata_block_size: 4096 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: partition_filters: 0 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: use_delta_encoding: 1 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: filter_policy: bloomfilter 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: whole_key_filtering: 1 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: verify_compression: 0 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: read_amp_bytes_per_bit: 0 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: format_version: 5 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: enable_index_compression: 1 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: block_align: 0 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: max_auto_readahead_size: 262144 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: prepopulate_block_cache: 0 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: initial_auto_readahead_size: 8192 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T05:55:59.063 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compression: NoCompression 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.num_levels: 7 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:55:59.064 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T05:55:59.065 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T05:55:59.065 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:55:59.065 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:55:59.065 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T05:55:59.065 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T05:55:59.065 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T05:55:59.065 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T05:55:59.065 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:55:59.065 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:55:59.065 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T05:55:59.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T05:55:59.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:55:59.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T05:55:59.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T05:55:59.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T05:55:59.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T05:55:59.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T05:55:59.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T05:55:59.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T05:55:59.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T05:55:59.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T05:55:59.067 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T05:55:59.067 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T05:55:59.067 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T05:55:59.068 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.inplace_update_support: 0 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T05:55:59.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.bloom_locality: 0 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.max_successive_merges: 0 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.ttl: 2592000 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.enable_blob_files: false 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.min_blob_size: 0 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T05:55:59.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f67042f0-94f8-4c4b-9b52-92966f695e47 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725083758932923, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725083758933523, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725083758, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f67042f0-94f8-4c4b-9b52-92966f695e47", "db_session_id": "UXAQHESCUQFT9O1ZRVIN", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725083758933650, "job": 1, "event": "recovery_finished"} 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-31T05:55:59.071 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b404c08a80 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: DB pointer 0x55b4059aa000 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout: ** DB Stats ** 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:55:59.072 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: ** Compaction Stats [default] ** 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: ** Compaction Stats [default] ** 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-08-31T05:55:59.073 INFO:journalctl@ceph.mon.b.smithi130.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: Cumulative compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: Interval compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: Block cache BinnedLRUCache@0x55b400ba8850#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-08-31T05:55:59.074 INFO:journalctl@ceph.mon.b.smithi130.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: using public_addr v2:172.21.15.130:0/0 -> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: starting mon.b rank -1 at public addrs [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] at bind addrs [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(???) e0 preinit fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).mds e1 new map 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).mds e1 print_map 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout: e1 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout: btime 2024-08-31T05:54:18:179948+0000 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout: legacy client fscid: -1 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout: No filesystems configured 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-31T05:55:59.075 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.076 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"} : dispatch 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Deploying cephadm binary to smithi153 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.077 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Added host smithi153 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/379109209' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/379109209' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.078 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"} : dispatch 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Updating smithi153:/etc/ceph/ceph.conf 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:59.079 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi053:172.21.15.53=a;smithi130:172.21.15.130=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Saving service mon spec with placement smithi053:172.21.15.53=a;smithi130:172.21.15.130=b;smithi153:172.21.15.153=c;count:3 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Deploying daemon mon.c on smithi153 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='client.? 172.21.15.153:0/2701775346' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.a calling monitor election 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:59.080 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.c calling monitor election 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: monmap epoch 2 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: last_changed 2024-08-31T05:55:50.153906+0000 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: created 2024-08-31T05:54:11.618583+0000 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: min_mon_release 19 (squid) 2024-08-31T05:55:59.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: election_strategy: 1 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: fsmap 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mgrmap e13: x(active, since 42s) 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: overall HEALTH_OK 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: Deploying daemon mon.b on smithi130 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='client.? 172.21.15.153:0/4243850840' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:55:59.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:55:59.083 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 ceph-mon[22266]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-31T05:55:59.083 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 bash[22247]: 5efdc58039f122fea57be8e55e36e876cb37a80c98c57d44789d9d2ef550c63f 2024-08-31T05:55:59.083 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:55:58 smithi130 systemd[1]: Started Ceph mon.b for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T05:56:00.171 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T05:56:00.171 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:56:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:56:04.329 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:56:04.329 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":3,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:55:58.967487Z","created":"2024-08-31T05:54:11.618583Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3300","nonce":0},{"type":"v1","addr":"172.21.15.130:6789","nonce":0}]},"addr":"172.21.15.130:6789/0","public_addr":"172.21.15.130:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-08-31T05:56:04.329 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 3 2024-08-31T05:56:04.329 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: mon.a calling monitor election 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: mon.c calling monitor election 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: mon.b calling monitor election 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: monmap epoch 3 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: last_changed 2024-08-31T05:55:58.967487+0000 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: created 2024-08-31T05:54:11.618583+0000 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: min_mon_release 19 (squid) 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: election_strategy: 1 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: fsmap 2024-08-31T05:56:04.331 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:56:04.332 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: mgrmap e13: x(active, since 51s) 2024-08-31T05:56:04.332 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: overall HEALTH_OK 2024-08-31T05:56:04.332 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.332 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.332 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.332 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:04 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: mon.a calling monitor election 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: mon.c calling monitor election 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: mon.b calling monitor election 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: monmap epoch 3 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: last_changed 2024-08-31T05:55:58.967487+0000 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: created 2024-08-31T05:54:11.618583+0000 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: min_mon_release 19 (squid) 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: election_strategy: 1 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: fsmap 2024-08-31T05:56:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:56:04.381 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: mgrmap e13: x(active, since 51s) 2024-08-31T05:56:04.381 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: overall HEALTH_OK 2024-08-31T05:56:04.381 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.381 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.381 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.381 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:04 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:56:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: mon.a calling monitor election 2024-08-31T05:56:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:56:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: mon.c calling monitor election 2024-08-31T05:56:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: mon.b calling monitor election 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: monmap epoch 3 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: last_changed 2024-08-31T05:55:58.967487+0000 2024-08-31T05:56:04.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: created 2024-08-31T05:54:11.618583+0000 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: min_mon_release 19 (squid) 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: election_strategy: 1 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: fsmap 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: mgrmap e13: x(active, since 51s) 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: overall HEALTH_OK 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:04 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:04.936 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-31T05:56:04.936 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config generate-minimal-conf 2024-08-31T05:56:05.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:05 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:05.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:05 smithi153 ceph-mon[22320]: from='client.? 172.21.15.153:0/2572382910' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:56:05.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:05 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:05.198 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:05.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:05 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:05.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:05 smithi053 ceph-mon[18924]: from='client.? 172.21.15.153:0/2572382910' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:56:05.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:05 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:05.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:05 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:05.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:05 smithi130 ceph-mon[22266]: from='client.? 172.21.15.153:0/2572382910' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:56:05.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:05 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:05.837 INFO:teuthology.orchestra.run.smithi053.stdout:# minimal ceph.conf for 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:56:05.837 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-08-31T05:56:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T05:56:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: mon_host = [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-08-31T05:56:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:06 smithi053 ceph-mon[18924]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:06 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:06 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:06 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3997996573' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:06 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:06 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:06 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:06 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:06 smithi130 ceph-mon[22266]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:06 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:06 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:06 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3997996573' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:06 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:06 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:06 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:06.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:06 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:06 smithi153 ceph-mon[22320]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:06 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:06 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:06 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3997996573' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:06.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:06 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:06 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:06.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:06 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:06.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:06 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:06.569 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-31T05:56:06.569 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:56:06.569 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T05:56:06.596 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:56:06.597 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:06.662 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-31T05:56:06.663 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T05:56:06.690 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-31T05:56:06.690 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:06.755 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-31T05:56:06.755 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T05:56:06.782 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-31T05:56:06.783 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:06.848 INFO:tasks.cephadm:enabling module snap_schedule 2024-08-31T05:56:06.848 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-08-31T05:56:07.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: Updating smithi053:/etc/ceph/ceph.conf 2024-08-31T05:56:07.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-31T05:56:07.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: Updating smithi153:/etc/ceph/ceph.conf 2024-08-31T05:56:07.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:07.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:07 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: Updating smithi053:/etc/ceph/ceph.conf 2024-08-31T05:56:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-31T05:56:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: Updating smithi153:/etc/ceph/ceph.conf 2024-08-31T05:56:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:07 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:07.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: Updating smithi053:/etc/ceph/ceph.conf 2024-08-31T05:56:07.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-31T05:56:07.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: Updating smithi153:/etc/ceph/ceph.conf 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:07.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:07.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:07 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:07.955 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:08.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: Updating smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:08.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:08.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:08.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:08.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T05:56:08.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: Reconfiguring daemon mon.a on smithi053 2024-08-31T05:56:08.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:08.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:08.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:08.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:08.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:08.303 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:08 smithi053 ceph-mon[18924]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: Updating smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T05:56:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: Reconfiguring daemon mon.a on smithi053 2024-08-31T05:56:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:08.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:08.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:08.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:08.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:08 smithi130 ceph-mon[22266]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: Updating smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:08.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:08.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T05:56:08.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: Reconfiguring daemon mon.a on smithi053 2024-08-31T05:56:08.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:08.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:08.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' 2024-08-31T05:56:08.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:08.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:08.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:08 smithi153 ceph-mon[22320]: from='mgr.14150 172.21.15.53:0/1257957896' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:09.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:09 smithi053 ceph-mon[18924]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:56:09.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:09 smithi053 ceph-mon[18924]: Reconfiguring daemon mon.b on smithi130 2024-08-31T05:56:09.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:09 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2461670971' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T05:56:09.376 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:09 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: ignoring --setuser ceph since I am not root 2024-08-31T05:56:09.376 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:09 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: ignoring --setgroup ceph since I am not root 2024-08-31T05:56:09.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:09 smithi130 ceph-mon[22266]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:56:09.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:09 smithi130 ceph-mon[22266]: Reconfiguring daemon mon.b on smithi130 2024-08-31T05:56:09.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:09 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2461670971' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T05:56:09.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:09 smithi153 ceph-mon[22320]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:56:09.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:09 smithi153 ceph-mon[22320]: Reconfiguring daemon mon.b on smithi130 2024-08-31T05:56:09.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:09 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2461670971' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T05:56:09.698 INFO:tasks.cephadm:Adding mgr.x on smithi053 2024-08-31T05:56:09.698 INFO:tasks.cephadm:Adding mgr.y on smithi130 2024-08-31T05:56:09.698 INFO:tasks.cephadm:Adding mgr.z on smithi153 2024-08-31T05:56:09.698 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch apply mgr '3;smithi053=x;smithi130=y;smithi153=z' 2024-08-31T05:56:09.940 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:56:10.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:10 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2461670971' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T05:56:10.330 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:10 smithi153 ceph-mon[22320]: mgrmap e14: x(active, since 56s) 2024-08-31T05:56:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:10 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2461670971' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T05:56:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:10 smithi130 ceph-mon[22266]: mgrmap e14: x(active, since 56s) 2024-08-31T05:56:10.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:10 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2461670971' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T05:56:10.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:10 smithi053 ceph-mon[18924]: mgrmap e14: x(active, since 56s) 2024-08-31T05:56:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: Active manager daemon x restarted 2024-08-31T05:56:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: Activating manager daemon x 2024-08-31T05:56:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T05:56:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: mgrmap e15: x(active, starting, since 0.00486122s) 2024-08-31T05:56:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:56:14.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:14.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:56:14.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:56:14.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:56:14.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:56:14.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:56:14.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:14 smithi130 ceph-mon[22266]: Manager daemon x is now available 2024-08-31T05:56:14.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: Active manager daemon x restarted 2024-08-31T05:56:14.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: Activating manager daemon x 2024-08-31T05:56:14.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T05:56:14.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: mgrmap e15: x(active, starting, since 0.00486122s) 2024-08-31T05:56:14.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:56:14.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:14.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:56:14.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:56:14.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:56:14.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:56:14.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:56:14.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:14 smithi153 ceph-mon[22320]: Manager daemon x is now available 2024-08-31T05:56:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: Active manager daemon x restarted 2024-08-31T05:56:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: Activating manager daemon x 2024-08-31T05:56:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T05:56:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: mgrmap e15: x(active, starting, since 0.00486122s) 2024-08-31T05:56:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:56:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:56:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:56:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:56:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:56:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:56:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:56:14.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:14 smithi053 ceph-mon[18924]: Manager daemon x is now available 2024-08-31T05:56:15.315 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mgr update... 2024-08-31T05:56:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:56:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:56:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:15 smithi130 ceph-mon[22266]: mgrmap e16: x(active, since 1.01099s) 2024-08-31T05:56:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:15.664 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:15.664 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:56:15.664 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:56:15.664 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-mon[18924]: mgrmap e16: x(active, since 1.01099s) 2024-08-31T05:56:15.664 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:15.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:15.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:56:15.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:56:15.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:15 smithi153 ceph-mon[22320]: mgrmap e16: x(active, since 1.01099s) 2024-08-31T05:56:15.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:15.928 DEBUG:teuthology.orchestra.run.smithi130:mgr.y> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.y.service 2024-08-31T05:56:15.931 DEBUG:teuthology.orchestra.run.smithi153:mgr.z> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.z.service 2024-08-31T05:56:15.933 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-31T05:56:15.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-31T05:56:15.936 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-31T05:56:15.936 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set client debug_client 20 2024-08-31T05:56:15.956 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T05:56:15.857+0000 7ff3d1eee640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:05:56:15] ENGINE Error in HTTPServer.serve 2024-08-31T05:56:15.956 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: Traceback (most recent call last): 2024-08-31T05:56:15.957 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:56:15.957 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self._connections.run(self.expiration_interval) 2024-08-31T05:56:15.957 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:56:15.957 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self._run(expiration_interval) 2024-08-31T05:56:15.957 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:56:15.957 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:56:15.957 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:56:15.957 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:56:15.958 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:56:15.958 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: s = self.context.wrap_socket( 2024-08-31T05:56:15.958 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:56:15.958 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: return self.sslsocket_class._create( 2024-08-31T05:56:15.958 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:56:15.958 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self.do_handshake() 2024-08-31T05:56:15.958 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:56:15.958 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: self._sslobj.do_handshake() 2024-08-31T05:56:15.958 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:56:15.958 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 05:56:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T05:56:15.959 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-31T05:56:15.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set client debug_ms 1 2024-08-31T05:56:16.002 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-31T05:56:16.003 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-31T05:56:16.045 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-31T05:56:16.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-31T05:56:16.089 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-31T05:56:16.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-31T05:56:16.133 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-31T05:56:16.133 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-31T05:56:16.178 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-31T05:56:16.178 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-31T05:56:16.223 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-31T05:56:16.224 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-08-31T05:56:16.264 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:16.277 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-08-31T05:56:16.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-08-31T05:56:16.296 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:16.298 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-08-31T05:56:16.299 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-08-31T05:56:16.344 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-08-31T05:56:16.344 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-08-31T05:56:16.388 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-31T05:56:16.388 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-31T05:56:16.431 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-31T05:56:16.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-31T05:56:16.474 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-31T05:56:16.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-31T05:56:16.518 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-31T05:56:16.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-31T05:56:16.570 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-31T05:56:16.571 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-31T05:56:16.625 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-31T05:56:16.625 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-31T05:56:16.678 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-31T05:56:16.678 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-31T05:56:16.722 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-08-31T05:56:16.722 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mgr debug_cephsqlite 20 2024-08-31T05:56:16.775 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-08-31T05:56:16.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-08-31T05:56:16.828 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-08-31T05:56:16.828 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-08-31T05:56:16.875 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-08-31T05:56:16.875 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-08-31T05:56:16.940 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-31T05:56:16.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-31T05:56:16.997 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-31T05:56:16.997 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-31T05:56:17.051 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-31T05:56:17.051 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-31T05:56:17.137 DEBUG:tasks.cephadm:set 26 configs 2024-08-31T05:56:17.137 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi053') 2024-08-31T05:56:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:17.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: Saving service mgr spec with placement smithi053=x;smithi130=y;smithi153=z;count:3 2024-08-31T05:56:17.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: [31/Aug/2024:05:56:15] ENGINE Bus STARTING 2024-08-31T05:56:17.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: [31/Aug/2024:05:56:15] ENGINE Serving on http://172.21.15.53:8765 2024-08-31T05:56:17.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: [31/Aug/2024:05:56:15] ENGINE Serving on https://172.21.15.53:7150 2024-08-31T05:56:17.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: [31/Aug/2024:05:56:15] ENGINE Bus STARTED 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: [31/Aug/2024:05:56:15] ENGINE Error in HTTPServer.serve 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: Traceback (most recent call last): 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._run(expiration_interval) 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: s = self.context.wrap_socket( 2024-08-31T05:56:17.379 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout: return self.sslsocket_class._create( 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout: self.do_handshake() 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout: self._sslobj.do_handshake() 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.381 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.381 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"} : dispatch 2024-08-31T05:56:17.385 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: Saving service mgr spec with placement smithi053=x;smithi130=y;smithi153=z;count:3 2024-08-31T05:56:17.385 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: [31/Aug/2024:05:56:15] ENGINE Bus STARTING 2024-08-31T05:56:17.385 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: [31/Aug/2024:05:56:15] ENGINE Serving on http://172.21.15.53:8765 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: [31/Aug/2024:05:56:15] ENGINE Serving on https://172.21.15.53:7150 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: [31/Aug/2024:05:56:15] ENGINE Bus STARTED 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: [31/Aug/2024:05:56:15] ENGINE Error in HTTPServer.serve 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout: Traceback (most recent call last): 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout: self._run(expiration_interval) 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:56:17.386 INFO:journalctl@ceph.mon.a.smithi053.stdout: s = self.context.wrap_socket( 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout: return self.sslsocket_class._create( 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout: self.do_handshake() 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout: self._sslobj.do_handshake() 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.387 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.388 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.388 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.388 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"} : dispatch 2024-08-31T05:56:17.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: Saving service mgr spec with placement smithi053=x;smithi130=y;smithi153=z;count:3 2024-08-31T05:56:17.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: [31/Aug/2024:05:56:15] ENGINE Bus STARTING 2024-08-31T05:56:17.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: [31/Aug/2024:05:56:15] ENGINE Serving on http://172.21.15.53:8765 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: [31/Aug/2024:05:56:15] ENGINE Serving on https://172.21.15.53:7150 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: [31/Aug/2024:05:56:15] ENGINE Bus STARTED 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: [31/Aug/2024:05:56:15] ENGINE Error in HTTPServer.serve 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout: Traceback (most recent call last): 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout: self._run(expiration_interval) 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:56:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout: s = self.context.wrap_socket( 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout: return self.sslsocket_class._create( 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout: self.do_handshake() 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout: self._sslobj.do_handshake() 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.428 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.428 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:17.428 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"} : dispatch 2024-08-31T05:56:17.584 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:18 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:18 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:18 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"} : dispatch 2024-08-31T05:56:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:18 smithi130 ceph-mon[22266]: mgrmap e17: x(active, since 2s) 2024-08-31T05:56:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:18 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/368460262' entity='client.admin' 2024-08-31T05:56:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:18 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1743460129' entity='client.admin' 2024-08-31T05:56:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:18 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:18 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:18 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"} : dispatch 2024-08-31T05:56:18.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:18 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:18.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:18 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:18.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:18 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:18 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:18 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"} : dispatch 2024-08-31T05:56:18.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:18 smithi053 ceph-mon[18924]: mgrmap e17: x(active, since 2s) 2024-08-31T05:56:18.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:18 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/368460262' entity='client.admin' 2024-08-31T05:56:18.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:18 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1743460129' entity='client.admin' 2024-08-31T05:56:18.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:18 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:18 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:18 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"} : dispatch 2024-08-31T05:56:18.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:18 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:18.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:18 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:18.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:18 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:18 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:18 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"} : dispatch 2024-08-31T05:56:18.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:18 smithi153 ceph-mon[22320]: mgrmap e17: x(active, since 2s) 2024-08-31T05:56:18.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:18 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/368460262' entity='client.admin' 2024-08-31T05:56:18.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:18 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1743460129' entity='client.admin' 2024-08-31T05:56:18.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:18 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:18 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:18.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:18 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"} : dispatch 2024-08-31T05:56:18.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:18 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:18.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:18 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:18.901 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.903 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.903 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.913 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.913 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.913 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.914 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.914 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.926 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.926 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.929 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.943 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.950 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.964 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.970 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:18.981 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:19.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 -- 172.21.15.53:0/1172040687 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbae403f2d0 msgr2=0x7fbae40417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:19.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 --2- 172.21.15.53:0/1172040687 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbae403f2d0 0x7fbae40417e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbae8005d90 tx=0x7fbae8005e50 comp rx=0 tx=0).stop 2024-08-31T05:56:19.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 -- 172.21.15.53:0/1172040687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf8109bb0 msgr2=0x7fbaf819f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:19.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 --2- 172.21.15.53:0/1172040687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf8109bb0 0x7fbaf819f740 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000eb10 tx=0x7fbaf000c2d0 comp rx=0 tx=0).stop 2024-08-31T05:56:19.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 -- 172.21.15.53:0/1172040687 shutdown_connections 2024-08-31T05:56:19.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 --2- 172.21.15.53:0/1172040687 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbae403f2d0 0x7fbae40417e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:19.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 --2- 172.21.15.53:0/1172040687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf8109bb0 0x7fbaf819f740 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:19.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 --2- 172.21.15.53:0/1172040687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf8109260 0x7fbaf819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:19.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 --2- 172.21.15.53:0/1172040687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbaf8103920 0x7fbaf8199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:19.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 -- 172.21.15.53:0/1172040687 >> 172.21.15.53:0/1172040687 conn(0x7fbaf807b670 msgr2=0x7fbaf81074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:19.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 -- 172.21.15.53:0/1172040687 shutdown_connections 2024-08-31T05:56:19.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.422+0000 7fbafd4e5640 1 -- 172.21.15.53:0/1172040687 wait complete. 2024-08-31T05:56:19.811 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi053') 2024-08-31T05:56:19.811 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi053') 2024-08-31T05:56:19.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.975+0000 7f97da9aa640 1 -- 172.21.15.53:0/883308356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97d410dbd0 msgr2=0x7f97d41100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:19.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.975+0000 7f97da9aa640 1 --2- 172.21.15.53:0/883308356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97d410dbd0 0x7f97d41100e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009ca0 tx=0x7f97cc02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:56:19.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.975+0000 7f97da9aa640 1 -- 172.21.15.53:0/883308356 shutdown_connections 2024-08-31T05:56:19.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.975+0000 7f97da9aa640 1 --2- 172.21.15.53:0/883308356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97d410dbd0 0x7f97d41100e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:19.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.975+0000 7f97da9aa640 1 --2- 172.21.15.53:0/883308356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d4105050 0x7f97d410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:19.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.975+0000 7f97da9aa640 1 --2- 172.21.15.53:0/883308356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d4104620 0x7f97d4104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:19.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.975+0000 7f97da9aa640 1 -- 172.21.15.53:0/883308356 >> 172.21.15.53:0/883308356 conn(0x7f97d4079580 msgr2=0x7f97d4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:19.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.975+0000 7f97da9aa640 1 -- 172.21.15.53:0/883308356 shutdown_connections 2024-08-31T05:56:19.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.975+0000 7f97da9aa640 1 -- 172.21.15.53:0/883308356 wait complete. 2024-08-31T05:56:19.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.976+0000 7f97da9aa640 1 Processor -- start 2024-08-31T05:56:19.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.976+0000 7f97da9aa640 1 -- start start 2024-08-31T05:56:19.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.976+0000 7f97da9aa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d4104620 0x7f97d4199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:19.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.976+0000 7f97da9aa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d4105050 0x7f97d419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:19.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.976+0000 7f97da9aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97d410dbd0 0x7f97d419f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:19.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.976+0000 7f97da9aa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4113510 con 0x7f97d410dbd0 2024-08-31T05:56:19.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.976+0000 7f97da9aa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4113390 con 0x7f97d4105050 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.976+0000 7f97da9aa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4113690 con 0x7f97d4104620 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.976+0000 7f97d8f47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97d410dbd0 0x7f97d419f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d8f47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97d410dbd0 0x7f97d419f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54494/0 (socket says 172.21.15.53:54494) 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d8f47640 1 -- 172.21.15.53:0/905667885 learned_addr learned my addr 172.21.15.53:0/905667885 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d3fff640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d4104620 0x7f97d4199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d37fe640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d4105050 0x7f97d419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d8f47640 1 -- 172.21.15.53:0/905667885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d4104620 msgr2=0x7f97d4199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d8f47640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d4104620 0x7f97d4199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d8f47640 1 -- 172.21.15.53:0/905667885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d4105050 msgr2=0x7f97d419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d8f47640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d4105050 0x7f97d419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d8f47640 1 -- 172.21.15.53:0/905667885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d419fef0 con 0x7f97d410dbd0 2024-08-31T05:56:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d8f47640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97d410dbd0 0x7f97d419f7c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f97cc031040 tx=0x7f97cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:19.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d17fa640 1 -- 172.21.15.53:0/905667885 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0305c0 con 0x7f97d410dbd0 2024-08-31T05:56:19.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d17fa640 1 -- 172.21.15.53:0/905667885 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f97cc030bb0 con 0x7f97d410dbd0 2024-08-31T05:56:19.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97d17fa640 1 -- 172.21.15.53:0/905667885 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0319c0 con 0x7f97d410dbd0 2024-08-31T05:56:19.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97da9aa640 1 -- 172.21.15.53:0/905667885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d41a0180 con 0x7f97d410dbd0 2024-08-31T05:56:19.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.977+0000 7f97da9aa640 1 -- 172.21.15.53:0/905667885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d41a6940 con 0x7f97d410dbd0 2024-08-31T05:56:19.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.979+0000 7f97d17fa640 1 -- 172.21.15.53:0/905667885 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f97cc031b60 con 0x7f97d410dbd0 2024-08-31T05:56:19.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.978+0000 7f97da9aa640 1 -- 172.21.15.53:0/905667885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d4104a30 con 0x7f97d410dbd0 2024-08-31T05:56:19.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.979+0000 7f97d17fa640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97bc03f2d0 0x7f97bc0417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:19.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.979+0000 7f97d17fa640 1 -- 172.21.15.53:0/905667885 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f97cc074de0 con 0x7f97d410dbd0 2024-08-31T05:56:19.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.979+0000 7f97d3fff640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97bc03f2d0 0x7f97bc0417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:19.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.979+0000 7f97d3fff640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97bc03f2d0 0x7f97bc0417e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f97c4005fd0 tx=0x7f97c400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:19.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:19.984+0000 7f97d17fa640 1 -- 172.21.15.53:0/905667885 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f97cc0422e0 con 0x7f97d410dbd0 2024-08-31T05:56:20.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.174+0000 7f97da9aa640 1 -- 172.21.15.53:0/905667885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f97d4108d50 con 0x7f97d410dbd0 2024-08-31T05:56:20.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.177+0000 7f97d17fa640 1 -- 172.21.15.53:0/905667885 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f97cc009870 con 0x7f97d410dbd0 2024-08-31T05:56:20.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.178+0000 7f97d17fa640 1 -- 172.21.15.53:0/905667885 <== mon.0 v2:172.21.15.53:3300/0 8 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f97cc036020 con 0x7f97d410dbd0 2024-08-31T05:56:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 -- 172.21.15.53:0/905667885 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97bc03f2d0 msgr2=0x7f97bc0417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97bc03f2d0 0x7f97bc0417e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f97c4005fd0 tx=0x7f97c400b390 comp rx=0 tx=0).stop 2024-08-31T05:56:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 -- 172.21.15.53:0/905667885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97d410dbd0 msgr2=0x7f97d419f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97d410dbd0 0x7f97d419f7c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f97cc031040 tx=0x7f97cc0045e0 comp rx=0 tx=0).stop 2024-08-31T05:56:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 -- 172.21.15.53:0/905667885 shutdown_connections 2024-08-31T05:56:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97bc03f2d0 0x7f97bc0417e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97d410dbd0 0x7f97d419f7c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97d4105050 0x7f97d419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 --2- 172.21.15.53:0/905667885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97d4104620 0x7f97d4199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 -- 172.21.15.53:0/905667885 >> 172.21.15.53:0/905667885 conn(0x7f97d4079580 msgr2=0x7f97d4100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 -- 172.21.15.53:0/905667885 shutdown_connections 2024-08-31T05:56:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.180+0000 7f97da9aa640 1 -- 172.21.15.53:0/905667885 wait complete. 2024-08-31T05:56:20.319 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi053:/etc/ceph/ceph.conf 2024-08-31T05:56:20.319 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-31T05:56:20.319 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi153:/etc/ceph/ceph.conf 2024-08-31T05:56:20.319 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:20.319 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:20.319 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.320 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.321 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.321 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:56:20.321 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:56:20.321 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:56:20.321 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:20.321 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:20 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1172040687' entity='client.admin' 2024-08-31T05:56:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi053:/etc/ceph/ceph.conf 2024-08-31T05:56:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-31T05:56:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi153:/etc/ceph/ceph.conf 2024-08-31T05:56:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:56:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:56:20.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:56:20.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:20.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:20 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1172040687' entity='client.admin' 2024-08-31T05:56:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi053:/etc/ceph/ceph.conf 2024-08-31T05:56:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-31T05:56:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi153:/etc/ceph/ceph.conf 2024-08-31T05:56:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: Updating smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:56:20.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:56:20.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:56:20.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:20.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:20 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1172040687' entity='client.admin' 2024-08-31T05:56:21.076 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 05:56:20 smithi153 systemd[1]: Starting Ceph mgr.z for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T05:56:21.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:21 smithi053 ceph-mon[18924]: Deploying daemon mgr.z on smithi153 2024-08-31T05:56:21.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:21 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/905667885' entity='client.admin' 2024-08-31T05:56:21.311 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi053') 2024-08-31T05:56:21.373 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:21 smithi153 ceph-mon[22320]: Deploying daemon mgr.z on smithi153 2024-08-31T05:56:21.373 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:21 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/905667885' entity='client.admin' 2024-08-31T05:56:21.373 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 05:56:21 smithi153 podman[24948]: 2024-08-31 05:56:21.088465498 +0000 UTC m=+0.015984310 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:56:21.374 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 05:56:21 smithi153 podman[24948]: 2024-08-31 05:56:21.194916156 +0000 UTC m=+0.122434968 container create dffe1658655773ba9f7baff0d2dcb52911d9f03e6ca82c6ec5f658ca113e8727 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-31T05:56:21.374 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 05:56:21 smithi153 podman[24948]: 2024-08-31 05:56:21.372343154 +0000 UTC m=+0.299861963 container init dffe1658655773ba9f7baff0d2dcb52911d9f03e6ca82c6ec5f658ca113e8727 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS) 2024-08-31T05:56:21.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:21 smithi130 ceph-mon[22266]: Deploying daemon mgr.z on smithi153 2024-08-31T05:56:21.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:21 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/905667885' entity='client.admin' 2024-08-31T05:56:21.675 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 05:56:21 smithi153 podman[24948]: 2024-08-31 05:56:21.375234992 +0000 UTC m=+0.302753802 container start dffe1658655773ba9f7baff0d2dcb52911d9f03e6ca82c6ec5f658ca113e8727 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1) 2024-08-31T05:56:21.675 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 05:56:21 smithi153 ceph-mgr[24967]: -- 172.21.15.153:0/2935448633 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577c58af0e0 con 0x5577c58cda80 2024-08-31T05:56:21.675 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 05:56:21 smithi153 bash[24948]: dffe1658655773ba9f7baff0d2dcb52911d9f03e6ca82c6ec5f658ca113e8727 2024-08-31T05:56:21.676 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 05:56:21 smithi153 systemd[1]: Started Ceph mgr.z for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T05:56:21.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.907+0000 7ff9e525a640 1 -- 172.21.15.53:0/599194078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e0102880 msgr2=0x7ff9e0102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:21.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.907+0000 7ff9e525a640 1 --2- 172.21.15.53:0/599194078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e0102880 0x7ff9e0102c90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009900 tx=0x7ff9d002a410 comp rx=0 tx=0).stop 2024-08-31T05:56:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.907+0000 7ff9e525a640 1 -- 172.21.15.53:0/599194078 shutdown_connections 2024-08-31T05:56:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.907+0000 7ff9e525a640 1 --2- 172.21.15.53:0/599194078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0108ac0 0x7ff9e010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.907+0000 7ff9e525a640 1 --2- 172.21.15.53:0/599194078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e0108170 0x7ff9e0108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.907+0000 7ff9e525a640 1 --2- 172.21.15.53:0/599194078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e0102880 0x7ff9e0102c90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.907+0000 7ff9e525a640 1 -- 172.21.15.53:0/599194078 >> 172.21.15.53:0/599194078 conn(0x7ff9e0079500 msgr2=0x7ff9e0079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.907+0000 7ff9e525a640 1 -- 172.21.15.53:0/599194078 shutdown_connections 2024-08-31T05:56:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.907+0000 7ff9e525a640 1 -- 172.21.15.53:0/599194078 wait complete. 2024-08-31T05:56:21.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.908+0000 7ff9e525a640 1 Processor -- start 2024-08-31T05:56:21.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.908+0000 7ff9e525a640 1 -- start start 2024-08-31T05:56:21.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9e525a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e0102880 0x7ff9e019ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:21.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9e525a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e0108170 0x7ff9e019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:21.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9e525a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0108ac0 0x7ff9e019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:21.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9e525a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0112490 con 0x7ff9e0102880 2024-08-31T05:56:21.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9e525a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0112310 con 0x7ff9e0108ac0 2024-08-31T05:56:21.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9e525a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0112610 con 0x7ff9e0108170 2024-08-31T05:56:21.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9ded9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e0102880 0x7ff9e019ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:21.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9ded9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e0102880 0x7ff9e019ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54546/0 (socket says 172.21.15.53:54546) 2024-08-31T05:56:21.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9ded9d640 1 -- 172.21.15.53:0/605846946 learned_addr learned my addr 172.21.15.53:0/605846946 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9df59e640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0108ac0 0x7ff9e019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9de59c640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e0108170 0x7ff9e019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9ded9d640 1 -- 172.21.15.53:0/605846946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e0108170 msgr2=0x7ff9e019b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9ded9d640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e0108170 0x7ff9e019b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9ded9d640 1 -- 172.21.15.53:0/605846946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0108ac0 msgr2=0x7ff9e019b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9ded9d640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0108ac0 0x7ff9e019b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9ded9d640 1 -- 172.21.15.53:0/605846946 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e01a60f0 con 0x7ff9e0102880 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.909+0000 7ff9ded9d640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e0102880 0x7ff9e019ae60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0006010 tx=0x7ff9d0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.910+0000 7ff9d7fff640 1 -- 172.21.15.53:0/605846946 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d003f070 con 0x7ff9e0102880 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.910+0000 7ff9d7fff640 1 -- 172.21.15.53:0/605846946 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff9d003bce0 con 0x7ff9e0102880 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.910+0000 7ff9e525a640 1 -- 172.21.15.53:0/605846946 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e0198c50 con 0x7ff9e0102880 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.910+0000 7ff9d7fff640 1 -- 172.21.15.53:0/605846946 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0035030 con 0x7ff9e0102880 2024-08-31T05:56:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.910+0000 7ff9e525a640 1 -- 172.21.15.53:0/605846946 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e0199130 con 0x7ff9e0102880 2024-08-31T05:56:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.911+0000 7ff9d7fff640 1 -- 172.21.15.53:0/605846946 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7ff9d0042070 con 0x7ff9e0102880 2024-08-31T05:56:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.911+0000 7ff9e525a640 1 -- 172.21.15.53:0/605846946 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e0103ab0 con 0x7ff9e0102880 2024-08-31T05:56:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.911+0000 7ff9d7fff640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff9cc03f300 0x7ff9cc041810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.911+0000 7ff9d7fff640 1 -- 172.21.15.53:0/605846946 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff9d0074460 con 0x7ff9e0102880 2024-08-31T05:56:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.911+0000 7ff9de59c640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff9cc03f300 0x7ff9cc041810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.912+0000 7ff9de59c640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff9cc03f300 0x7ff9cc041810 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0079d50 tx=0x7ff9c800b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.916+0000 7ff9d7fff640 1 -- 172.21.15.53:0/605846946 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff9d0042360 con 0x7ff9e0102880 2024-08-31T05:56:22.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.107+0000 7ff9e525a640 1 -- 172.21.15.53:0/605846946 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7ff9e006bcf0 con 0x7ff9e0102880 2024-08-31T05:56:22.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.110+0000 7ff9d7fff640 1 -- 172.21.15.53:0/605846946 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7ff9e006bcf0 con 0x7ff9e0102880 2024-08-31T05:56:22.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.112+0000 7ff9e525a640 1 -- 172.21.15.53:0/605846946 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff9cc03f300 msgr2=0x7ff9cc041810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.112+0000 7ff9e525a640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff9cc03f300 0x7ff9cc041810 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0079d50 tx=0x7ff9c800b410 comp rx=0 tx=0).stop 2024-08-31T05:56:22.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.112+0000 7ff9e525a640 1 -- 172.21.15.53:0/605846946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e0102880 msgr2=0x7ff9e019ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.112+0000 7ff9e525a640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e0102880 0x7ff9e019ae60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0006010 tx=0x7ff9d0003c80 comp rx=0 tx=0).stop 2024-08-31T05:56:22.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.112+0000 7ff9e525a640 1 -- 172.21.15.53:0/605846946 shutdown_connections 2024-08-31T05:56:22.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.112+0000 7ff9e525a640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff9cc03f300 0x7ff9cc041810 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.112+0000 7ff9e525a640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0108ac0 0x7ff9e019b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.112+0000 7ff9e525a640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9e0108170 0x7ff9e019b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.112+0000 7ff9e525a640 1 --2- 172.21.15.53:0/605846946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9e0102880 0x7ff9e019ae60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.112+0000 7ff9e525a640 1 -- 172.21.15.53:0/605846946 >> 172.21.15.53:0/605846946 conn(0x7ff9e0079500 msgr2=0x7ff9e0101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:22.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.113+0000 7ff9e525a640 1 -- 172.21.15.53:0/605846946 shutdown_connections 2024-08-31T05:56:22.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.113+0000 7ff9e525a640 1 -- 172.21.15.53:0/605846946 wait complete. 2024-08-31T05:56:22.311 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:22 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1246805487' entity='client.admin' 2024-08-31T05:56:22.311 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:22.312 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:22.312 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:22.312 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:56:22.312 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:56:22.312 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:56:22.312 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:22.312 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:22 smithi130 ceph-mon[22266]: Deploying daemon mgr.y on smithi130 2024-08-31T05:56:22.312 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:22 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/605846946' entity='client.admin' 2024-08-31T05:56:22.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:22 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1246805487' entity='client.admin' 2024-08-31T05:56:22.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:22.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:22.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:22.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:56:22.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:56:22.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:56:22.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:22.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:22 smithi053 ceph-mon[18924]: Deploying daemon mgr.y on smithi130 2024-08-31T05:56:22.383 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:22 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/605846946' entity='client.admin' 2024-08-31T05:56:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:22 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1246805487' entity='client.admin' 2024-08-31T05:56:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:56:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:56:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:56:22.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:22.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:22 smithi153 ceph-mon[22320]: Deploying daemon mgr.y on smithi130 2024-08-31T05:56:22.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:22 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/605846946' entity='client.admin' 2024-08-31T05:56:22.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.563+0000 7f951742d640 1 -- 172.21.15.53:0/3224784438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9510103900 msgr2=0x7f9510103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.563+0000 7f951742d640 1 --2- 172.21.15.53:0/3224784438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9510103900 0x7f9510103d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f950c009900 tx=0x7f950c02a410 comp rx=0 tx=0).stop 2024-08-31T05:56:22.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.563+0000 7f951742d640 1 -- 172.21.15.53:0/3224784438 shutdown_connections 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.563+0000 7f951742d640 1 --2- 172.21.15.53:0/3224784438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9510109b90 0x7f95101103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.563+0000 7f951742d640 1 --2- 172.21.15.53:0/3224784438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9510109240 0x7f9510109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.563+0000 7f951742d640 1 --2- 172.21.15.53:0/3224784438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9510103900 0x7f9510103d10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.563+0000 7f951742d640 1 -- 172.21.15.53:0/3224784438 >> 172.21.15.53:0/3224784438 conn(0x7f951007b5f0 msgr2=0x7f951007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.563+0000 7f951742d640 1 -- 172.21.15.53:0/3224784438 shutdown_connections 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.563+0000 7f951742d640 1 -- 172.21.15.53:0/3224784438 wait complete. 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f951742d640 1 Processor -- start 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f951742d640 1 -- start start 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f951742d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9510103900 0x7f951019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f951742d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9510109240 0x7f951019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f951742d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9510109b90 0x7f951019f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f951742d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9510113630 con 0x7f9510109240 2024-08-31T05:56:22.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f951742d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f95101134b0 con 0x7f9510109b90 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f951742d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95101137b0 con 0x7f9510103900 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f95149c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9510109240 0x7f951019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f95149c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9510109240 0x7f951019a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54560/0 (socket says 172.21.15.53:54560) 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f95149c8640 1 -- 172.21.15.53:0/1564368683 learned_addr learned my addr 172.21.15.53:0/1564368683 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.564+0000 7f95151c9640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9510103900 0x7f951019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95159ca640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9510109b90 0x7f951019f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95149c8640 1 -- 172.21.15.53:0/1564368683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9510103900 msgr2=0x7f951019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95149c8640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9510103900 0x7f951019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95149c8640 1 -- 172.21.15.53:0/1564368683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9510109b90 msgr2=0x7f951019f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95149c8640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9510109b90 0x7f951019f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95149c8640 1 -- 172.21.15.53:0/1564368683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95101a0010 con 0x7f9510109240 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95159ca640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9510109b90 0x7f951019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95151c9640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9510103900 0x7f951019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:56:22.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95149c8640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9510109240 0x7f951019a700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f950000e9c0 tx=0x7f950000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95067fc640 1 -- 172.21.15.53:0/1564368683 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950000ccc0 con 0x7f9510109240 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95067fc640 1 -- 172.21.15.53:0/1564368683 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9500005490 con 0x7f9510109240 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f951742d640 1 -- 172.21.15.53:0/1564368683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95101a0300 con 0x7f9510109240 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f95067fc640 1 -- 172.21.15.53:0/1564368683 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500010430 con 0x7f9510109240 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.565+0000 7f951742d640 1 -- 172.21.15.53:0/1564368683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95101a6b20 con 0x7f9510109240 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.566+0000 7f95067fc640 1 -- 172.21.15.53:0/1564368683 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f95000105d0 con 0x7f9510109240 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.566+0000 7f951742d640 1 -- 172.21.15.53:0/1564368683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9510103d10 con 0x7f9510109240 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.566+0000 7f95067fc640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f94fc03f300 0x7f94fc041810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.567+0000 7f95067fc640 1 -- 172.21.15.53:0/1564368683 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9500053fa0 con 0x7f9510109240 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.567+0000 7f95151c9640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f94fc03f300 0x7f94fc041810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.567+0000 7f95151c9640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f94fc03f300 0x7f94fc041810 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f950c005ab0 tx=0x7f950c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:22.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.571+0000 7f95067fc640 1 -- 172.21.15.53:0/1564368683 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9500016330 con 0x7f9510109240 2024-08-31T05:56:22.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.759+0000 7f951742d640 1 -- 172.21.15.53:0/1564368683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f951010b910 con 0x7f9510109240 2024-08-31T05:56:22.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.763+0000 7f95067fc640 1 -- 172.21.15.53:0/1564368683 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f95000108c0 con 0x7f9510109240 2024-08-31T05:56:22.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 -- 172.21.15.53:0/1564368683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f94fc03f300 msgr2=0x7f94fc041810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f94fc03f300 0x7f94fc041810 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f950c005ab0 tx=0x7f950c005a20 comp rx=0 tx=0).stop 2024-08-31T05:56:22.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 -- 172.21.15.53:0/1564368683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9510109240 msgr2=0x7f951019a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9510109240 0x7f951019a700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f950000e9c0 tx=0x7f950000ee80 comp rx=0 tx=0).stop 2024-08-31T05:56:22.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 -- 172.21.15.53:0/1564368683 shutdown_connections 2024-08-31T05:56:22.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f94fc03f300 0x7f94fc041810 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9510109b90 0x7f951019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9510109240 0x7f951019a700 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 --2- 172.21.15.53:0/1564368683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9510103900 0x7f951019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 -- 172.21.15.53:0/1564368683 >> 172.21.15.53:0/1564368683 conn(0x7f951007b5f0 msgr2=0x7f9510107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:22.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 -- 172.21.15.53:0/1564368683 shutdown_connections 2024-08-31T05:56:22.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.765+0000 7f951742d640 1 -- 172.21.15.53:0/1564368683 wait complete. 2024-08-31T05:56:22.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.784+0000 7ff7eaa11640 1 -- 172.21.15.53:0/1103326500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e4102840 msgr2=0x7ff7e4102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.784+0000 7ff7eaa11640 1 --2- 172.21.15.53:0/1103326500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e4102840 0x7ff7e4102c50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009900 tx=0x7ff7d402a410 comp rx=0 tx=0).stop 2024-08-31T05:56:22.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.784+0000 7ff7eaa11640 1 -- 172.21.15.53:0/1103326500 shutdown_connections 2024-08-31T05:56:22.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.784+0000 7ff7eaa11640 1 --2- 172.21.15.53:0/1103326500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7e4108ad0 0x7ff7e410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.784+0000 7ff7eaa11640 1 --2- 172.21.15.53:0/1103326500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e4108180 0x7ff7e4108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.784+0000 7ff7eaa11640 1 --2- 172.21.15.53:0/1103326500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e4102840 0x7ff7e4102c50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.784+0000 7ff7eaa11640 1 -- 172.21.15.53:0/1103326500 >> 172.21.15.53:0/1103326500 conn(0x7ff7e4079580 msgr2=0x7ff7e4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:22.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.784+0000 7ff7eaa11640 1 -- 172.21.15.53:0/1103326500 shutdown_connections 2024-08-31T05:56:22.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.784+0000 7ff7eaa11640 1 -- 172.21.15.53:0/1103326500 wait complete. 2024-08-31T05:56:22.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.785+0000 7ff7eaa11640 1 Processor -- start 2024-08-31T05:56:22.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.785+0000 7ff7eaa11640 1 -- start start 2024-08-31T05:56:22.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.785+0000 7ff7eaa11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e4102840 0x7ff7e419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:22.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7eaa11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e4108180 0x7ff7e419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:22.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7eaa11640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7e4108ad0 0x7ff7e419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:22.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7eaa11640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e41124c0 con 0x7ff7e4108180 2024-08-31T05:56:22.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7eaa11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e4112340 con 0x7ff7e4102840 2024-08-31T05:56:22.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7eaa11640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e4112640 con 0x7ff7e4108ad0 2024-08-31T05:56:22.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7e37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e4108180 0x7ff7e419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:22.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7e37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e4108180 0x7ff7e419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54576/0 (socket says 172.21.15.53:54576) 2024-08-31T05:56:22.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7e37fe640 1 -- 172.21.15.53:0/2688654599 learned_addr learned my addr 172.21.15.53:0/2688654599 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:22.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7e3fff640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e4102840 0x7ff7e419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:22.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7e8fae640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7e4108ad0 0x7ff7e419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:22.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7e37fe640 1 -- 172.21.15.53:0/2688654599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7e4108ad0 msgr2=0x7ff7e419f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7e37fe640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7e4108ad0 0x7ff7e419f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7e37fe640 1 -- 172.21.15.53:0/2688654599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e4102840 msgr2=0x7ff7e419a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7e37fe640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e4102840 0x7ff7e419a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7e37fe640 1 -- 172.21.15.53:0/2688654599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e419ffd0 con 0x7ff7e4108180 2024-08-31T05:56:22.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.786+0000 7ff7e37fe640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e4108180 0x7ff7e419a600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800e9c0 tx=0x7ff7d800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:22.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.787+0000 7ff7e17fa640 1 -- 172.21.15.53:0/2688654599 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d800cd80 con 0x7ff7e4108180 2024-08-31T05:56:22.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.787+0000 7ff7e17fa640 1 -- 172.21.15.53:0/2688654599 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff7d8005490 con 0x7ff7e4108180 2024-08-31T05:56:22.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.787+0000 7ff7e17fa640 1 -- 172.21.15.53:0/2688654599 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8004e20 con 0x7ff7e4108180 2024-08-31T05:56:22.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.787+0000 7ff7eaa11640 1 -- 172.21.15.53:0/2688654599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e41a02c0 con 0x7ff7e4108180 2024-08-31T05:56:22.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.787+0000 7ff7eaa11640 1 -- 172.21.15.53:0/2688654599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e41a6a20 con 0x7ff7e4108180 2024-08-31T05:56:22.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.788+0000 7ff7e17fa640 1 -- 172.21.15.53:0/2688654599 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7ff7d8021440 con 0x7ff7e4108180 2024-08-31T05:56:22.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.788+0000 7ff7eaa11640 1 -- 172.21.15.53:0/2688654599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e4102c50 con 0x7ff7e4108180 2024-08-31T05:56:22.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.788+0000 7ff7e17fa640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff7cc03f2d0 0x7ff7cc0417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:22.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.788+0000 7ff7e17fa640 1 -- 172.21.15.53:0/2688654599 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff7d8053e20 con 0x7ff7e4108180 2024-08-31T05:56:22.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.788+0000 7ff7e3fff640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff7cc03f2d0 0x7ff7cc0417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:22.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.789+0000 7ff7e3fff640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff7cc03f2d0 0x7ff7cc0417e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009230 tx=0x7ff7d40058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:22.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.794+0000 7ff7e17fa640 1 -- 172.21.15.53:0/2688654599 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff7d8016330 con 0x7ff7e4108180 2024-08-31T05:56:22.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.988+0000 7ff7eaa11640 1 -- 172.21.15.53:0/2688654599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7ff7e41a6d60 con 0x7ff7e4108180 2024-08-31T05:56:22.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.991+0000 7ff7e17fa640 1 -- 172.21.15.53:0/2688654599 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v17)=0 v17) ==== 133+0+0 (secure 0 0 0) 0x7ff7d8007d10 con 0x7ff7e4108180 2024-08-31T05:56:22.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 -- 172.21.15.53:0/2688654599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff7cc03f2d0 msgr2=0x7ff7cc0417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff7cc03f2d0 0x7ff7cc0417e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009230 tx=0x7ff7d40058d0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 -- 172.21.15.53:0/2688654599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e4108180 msgr2=0x7ff7e419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:22.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e4108180 0x7ff7e419a600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800e9c0 tx=0x7ff7d800ee80 comp rx=0 tx=0).stop 2024-08-31T05:56:22.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 -- 172.21.15.53:0/2688654599 shutdown_connections 2024-08-31T05:56:22.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff7cc03f2d0 0x7ff7cc0417e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7e4108ad0 0x7ff7e419f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e4108180 0x7ff7e419a600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 --2- 172.21.15.53:0/2688654599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e4102840 0x7ff7e419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:22.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 -- 172.21.15.53:0/2688654599 >> 172.21.15.53:0/2688654599 conn(0x7ff7e4079580 msgr2=0x7ff7e4101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:22.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 -- 172.21.15.53:0/2688654599 shutdown_connections 2024-08-31T05:56:22.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:22.994+0000 7ff7eaa11640 1 -- 172.21.15.53:0/2688654599 wait complete. 2024-08-31T05:56:23.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.371+0000 7f8dabfff640 1 -- 172.21.15.53:0/3233977548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4031770 con 0x7f8db4109240 2024-08-31T05:56:23.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.372+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3233977548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db4109240 msgr2=0x7f8db4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:23.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.372+0000 7f8dbb41a640 1 --2- 172.21.15.53:0/3233977548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db4109240 0x7f8db4109650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009900 tx=0x7f8da402a410 comp rx=0 tx=0).stop 2024-08-31T05:56:23.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.372+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3233977548 shutdown_connections 2024-08-31T05:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.372+0000 7f8dbb41a640 1 --2- 172.21.15.53:0/3233977548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db4109b90 0x7f8db41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.372+0000 7f8dbb41a640 1 --2- 172.21.15.53:0/3233977548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db4109240 0x7f8db4109650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.372+0000 7f8dbb41a640 1 --2- 172.21.15.53:0/3233977548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8db4103900 0x7f8db4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.372+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3233977548 >> 172.21.15.53:0/3233977548 conn(0x7f8db407b5f0 msgr2=0x7f8db407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.372+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3233977548 shutdown_connections 2024-08-31T05:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.372+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3233977548 wait complete. 2024-08-31T05:56:23.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8dbb41a640 1 Processor -- start 2024-08-31T05:56:23.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8dbb41a640 1 -- start start 2024-08-31T05:56:23.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8dbb41a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db4103900 0x7f8db419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:23.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8dbb41a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8db4109240 0x7f8db419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:23.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8dbb41a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db4109b90 0x7f8db419f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8dbb41a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8db4113630 con 0x7f8db4109b90 2024-08-31T05:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8dbb41a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8db41134b0 con 0x7f8db4109240 2024-08-31T05:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8dbb41a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8db41137b0 con 0x7f8db4103900 2024-08-31T05:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8db99b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db4109b90 0x7f8db419f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8db91b6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db4103900 0x7f8db419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8db91b6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db4103900 0x7f8db419a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49104/0 (socket says 172.21.15.53:49104) 2024-08-31T05:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8db91b6640 1 -- 172.21.15.53:0/3948799350 learned_addr learned my addr 172.21.15.53:0/3948799350 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.373+0000 7f8db89b5640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8db4109240 0x7f8db419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.374+0000 7f8db91b6640 1 -- 172.21.15.53:0/3948799350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8db4109240 msgr2=0x7f8db419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.374+0000 7f8db91b6640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8db4109240 0x7f8db419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.374+0000 7f8db91b6640 1 -- 172.21.15.53:0/3948799350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db4109b90 msgr2=0x7f8db419f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.374+0000 7f8db91b6640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db4109b90 0x7f8db419f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.374+0000 7f8db91b6640 1 -- 172.21.15.53:0/3948799350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db41a0000 con 0x7f8db4103900 2024-08-31T05:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.374+0000 7f8db91b6640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db4103900 0x7f8db419a090 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8db000d950 tx=0x7f8db000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.374+0000 7f8daa7fc640 1 -- 172.21.15.53:0/3948799350 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0017070 con 0x7f8db4103900 2024-08-31T05:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.374+0000 7f8daa7fc640 1 -- 172.21.15.53:0/3948799350 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8db0009c30 con 0x7f8db4103900 2024-08-31T05:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.374+0000 7f8daa7fc640 1 -- 172.21.15.53:0/3948799350 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db000f620 con 0x7f8db4103900 2024-08-31T05:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.374+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3948799350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db41a02f0 con 0x7f8db4103900 2024-08-31T05:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.374+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3948799350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db41a6a50 con 0x7f8db4103900 2024-08-31T05:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.375+0000 7f8daa7fc640 1 -- 172.21.15.53:0/3948799350 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f8db000f7c0 con 0x7f8db4103900 2024-08-31T05:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.375+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3948799350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db4103d10 con 0x7f8db4103900 2024-08-31T05:56:23.380 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 05:56:23 smithi130 systemd[1]: Starting Ceph mgr.y for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T05:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.375+0000 7f8daa7fc640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8da003f2d0 0x7f8da00417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.375+0000 7f8daa7fc640 1 -- 172.21.15.53:0/3948799350 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8db00537f0 con 0x7f8db4103900 2024-08-31T05:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.376+0000 7f8db89b5640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8da003f2d0 0x7f8da00417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.376+0000 7f8db89b5640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8da003f2d0 0x7f8da00417e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005940 tx=0x7f8da40058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:23.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.381+0000 7f8daa7fc640 1 -- 172.21.15.53:0/3948799350 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8db0010e10 con 0x7f8db4103900 2024-08-31T05:56:23.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.559+0000 7fa87a2ac640 1 -- 172.21.15.53:0/2025084497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa874102880 msgr2=0x7fa874102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:23.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.559+0000 7fa87a2ac640 1 --2- 172.21.15.53:0/2025084497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa874102880 0x7fa874102c90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa864009900 tx=0x7fa86402a410 comp rx=0 tx=0).stop 2024-08-31T05:56:23.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.559+0000 7fa87a2ac640 1 -- 172.21.15.53:0/2025084497 shutdown_connections 2024-08-31T05:56:23.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.559+0000 7fa87a2ac640 1 --2- 172.21.15.53:0/2025084497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa874108ac0 0x7fa87410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.559+0000 7fa87a2ac640 1 --2- 172.21.15.53:0/2025084497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa874108170 0x7fa874108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.559+0000 7fa87a2ac640 1 --2- 172.21.15.53:0/2025084497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa874102880 0x7fa874102c90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.559+0000 7fa87a2ac640 1 -- 172.21.15.53:0/2025084497 >> 172.21.15.53:0/2025084497 conn(0x7fa874079550 msgr2=0x7fa874079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:23.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.559+0000 7fa87a2ac640 1 -- 172.21.15.53:0/2025084497 shutdown_connections 2024-08-31T05:56:23.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.559+0000 7fa87a2ac640 1 -- 172.21.15.53:0/2025084497 wait complete. 2024-08-31T05:56:23.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.560+0000 7fa87a2ac640 1 Processor -- start 2024-08-31T05:56:23.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.560+0000 7fa87a2ac640 1 -- start start 2024-08-31T05:56:23.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.560+0000 7fa87a2ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa874102880 0x7fa87410fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:23.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.560+0000 7fa87a2ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa874108170 0x7fa874110310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:23.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.560+0000 7fa87a2ac640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa874108ac0 0x7fa874110850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:23.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.560+0000 7fa87a2ac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa874113630 con 0x7fa874108170 2024-08-31T05:56:23.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.560+0000 7fa87a2ac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741134b0 con 0x7fa874102880 2024-08-31T05:56:23.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.560+0000 7fa87a2ac640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741137b0 con 0x7fa874108ac0 2024-08-31T05:56:23.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa874108170 0x7fa874110310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:23.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa874108170 0x7fa874110310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33806/0 (socket says 172.21.15.53:33806) 2024-08-31T05:56:23.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8737fe640 1 -- 172.21.15.53:0/1204815289 learned_addr learned my addr 172.21.15.53:0/1204815289 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:23.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa878849640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa874108ac0 0x7fa874110850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:23.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8737fe640 1 -- 172.21.15.53:0/1204815289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa874108ac0 msgr2=0x7fa874110850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:23.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8737fe640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa874108ac0 0x7fa874110850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8737fe640 1 -- 172.21.15.53:0/1204815289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa874102880 msgr2=0x7fa87410fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:23.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8737fe640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa874102880 0x7fa87410fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8737fe640 1 -- 172.21.15.53:0/1204815289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8741a8380 con 0x7fa874108170 2024-08-31T05:56:23.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8737fe640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa874108170 0x7fa874110310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa86800d740 tx=0x7fa86800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:23.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8717fa640 1 -- 172.21.15.53:0/1204815289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868017070 con 0x7fa874108170 2024-08-31T05:56:23.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8717fa640 1 -- 172.21.15.53:0/1204815289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fa86800de50 con 0x7fa874108170 2024-08-31T05:56:23.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa8717fa640 1 -- 172.21.15.53:0/1204815289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86800f3c0 con 0x7fa874108170 2024-08-31T05:56:23.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa87a2ac640 1 -- 172.21.15.53:0/1204815289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8741a8670 con 0x7fa874108170 2024-08-31T05:56:23.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.561+0000 7fa87a2ac640 1 -- 172.21.15.53:0/1204815289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8741a8b60 con 0x7fa874108170 2024-08-31T05:56:23.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.562+0000 7fa87a2ac640 1 -- 172.21.15.53:0/1204815289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa874102c90 con 0x7fa874108170 2024-08-31T05:56:23.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.562+0000 7fa8717fa640 1 -- 172.21.15.53:0/1204815289 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7fa86801a070 con 0x7fa874108170 2024-08-31T05:56:23.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.563+0000 7fa8717fa640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa85c03f2d0 0x7fa85c0417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:23.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.563+0000 7fa8717fa640 1 -- 172.21.15.53:0/1204815289 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa8680534b0 con 0x7fa874108170 2024-08-31T05:56:23.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.563+0000 7fa873fff640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa85c03f2d0 0x7fa85c0417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:23.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.563+0000 7fa873fff640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa85c03f2d0 0x7fa85c0417e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa86402a930 tx=0x7fa864000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:23.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.568+0000 7fa8717fa640 1 -- 172.21.15.53:0/1204815289 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa868009c30 con 0x7fa874108170 2024-08-31T05:56:23.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.570+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3948799350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f8db402e430 con 0x7f8db4103900 2024-08-31T05:56:23.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.575+0000 7f8daa7fc640 1 -- 172.21.15.53:0/3948799350 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v18)=0 v18) ==== 127+0+0 (secure 0 0 0) 0x7f8db0022cf0 con 0x7f8db4103900 2024-08-31T05:56:23.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.577+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3948799350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8da003f2d0 msgr2=0x7f8da00417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.577+0000 7f8dbb41a640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8da003f2d0 0x7f8da00417e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005940 tx=0x7f8da40058d0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.577+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3948799350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db4103900 msgr2=0x7f8db419a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.577+0000 7f8dbb41a640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db4103900 0x7f8db419a090 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8db000d950 tx=0x7f8db000de10 comp rx=0 tx=0).stop 2024-08-31T05:56:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.577+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3948799350 shutdown_connections 2024-08-31T05:56:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.577+0000 7f8dbb41a640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8da003f2d0 0x7f8da00417e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.577+0000 7f8dbb41a640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db4109b90 0x7f8db419f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.577+0000 7f8dbb41a640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8db4109240 0x7f8db419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.577+0000 7f8dbb41a640 1 --2- 172.21.15.53:0/3948799350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8db4103900 0x7f8db419a090 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.577+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3948799350 >> 172.21.15.53:0/3948799350 conn(0x7f8db407b5f0 msgr2=0x7f8db41073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.578+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3948799350 shutdown_connections 2024-08-31T05:56:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.578+0000 7f8dbb41a640 1 -- 172.21.15.53:0/3948799350 wait complete. 2024-08-31T05:56:23.707 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 05:56:23 smithi130 podman[24567]: 2024-08-31 05:56:23.358063723 +0000 UTC m=+0.016186890 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:56:23.707 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 05:56:23 smithi130 podman[24567]: 2024-08-31 05:56:23.456804401 +0000 UTC m=+0.114927552 container create ce9573d8edcf829f17ea3da5bb93bafd33562f23211371c26341bae855eeeb26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:56:23.707 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 05:56:23 smithi130 podman[24567]: 2024-08-31 05:56:23.667685225 +0000 UTC m=+0.325808376 container init ce9573d8edcf829f17ea3da5bb93bafd33562f23211371c26341bae855eeeb26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:56:23.707 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 05:56:23 smithi130 podman[24567]: 2024-08-31 05:56:23.67077939 +0000 UTC m=+0.328902549 container start ce9573d8edcf829f17ea3da5bb93bafd33562f23211371c26341bae855eeeb26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-08-31T05:56:23.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.761+0000 7fa87a2ac640 1 -- 172.21.15.53:0/1204815289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fa87402e430 con 0x7fa874108170 2024-08-31T05:56:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.772+0000 7fa8717fa640 1 -- 172.21.15.53:0/1204815289 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v19)=0 v19) ==== 106+0+0 (secure 0 0 0) 0x7fa86801fd50 con 0x7fa874108170 2024-08-31T05:56:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 -- 172.21.15.53:0/1204815289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa85c03f2d0 msgr2=0x7fa85c0417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa85c03f2d0 0x7fa85c0417e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa86402a930 tx=0x7fa864000bc0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 -- 172.21.15.53:0/1204815289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa874108170 msgr2=0x7fa874110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa874108170 0x7fa874110310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa86800d740 tx=0x7fa86800dc00 comp rx=0 tx=0).stop 2024-08-31T05:56:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 -- 172.21.15.53:0/1204815289 shutdown_connections 2024-08-31T05:56:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa85c03f2d0 0x7fa85c0417e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa874108ac0 0x7fa874110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa874108170 0x7fa874110310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 --2- 172.21.15.53:0/1204815289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa874102880 0x7fa87410fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 -- 172.21.15.53:0/1204815289 >> 172.21.15.53:0/1204815289 conn(0x7fa874079550 msgr2=0x7fa874106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 -- 172.21.15.53:0/1204815289 shutdown_connections 2024-08-31T05:56:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:23.774+0000 7fa87a2ac640 1 -- 172.21.15.53:0/1204815289 wait complete. 2024-08-31T05:56:23.818 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:23 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1564368683' entity='client.admin' 2024-08-31T05:56:23.818 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:23 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2688654599' entity='client.admin' 2024-08-31T05:56:23.818 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:23 smithi053 ceph-mon[18924]: from='client.? ' entity='client.admin' 2024-08-31T05:56:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:23 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1564368683' entity='client.admin' 2024-08-31T05:56:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:23 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2688654599' entity='client.admin' 2024-08-31T05:56:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:23 smithi130 ceph-mon[22266]: from='client.? ' entity='client.admin' 2024-08-31T05:56:24.128 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 05:56:23 smithi130 ceph-mgr[24586]: -- 172.21.15.130:0/888499799 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55714c0290e0 con 0x55714c047a80 2024-08-31T05:56:24.128 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 05:56:23 smithi130 bash[24567]: ce9573d8edcf829f17ea3da5bb93bafd33562f23211371c26341bae855eeeb26 2024-08-31T05:56:24.128 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 05:56:23 smithi130 systemd[1]: Started Ceph mgr.y for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T05:56:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:23 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1564368683' entity='client.admin' 2024-08-31T05:56:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:23 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2688654599' entity='client.admin' 2024-08-31T05:56:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:23 smithi153 ceph-mon[22320]: from='client.? ' entity='client.admin' 2024-08-31T05:56:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:24 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1204815289' entity='client.admin' 2024-08-31T05:56:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:24 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:24 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:24 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:24 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:24 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:24 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.883 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:24 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1204815289' entity='client.admin' 2024-08-31T05:56:24.883 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:24 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.883 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:24 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.883 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:24 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.884 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:24 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.884 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:24 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:24.884 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:24 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:24 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1204815289' entity='client.admin' 2024-08-31T05:56:24.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:24 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:24 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:24 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:24 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:24.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:24 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:24.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:24 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T05:56:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:56:26.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:56:26.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:26.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:25 smithi053 ceph-mon[18924]: Reconfiguring daemon mgr.x on smithi053 2024-08-31T05:56:26.330 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi053') 2024-08-31T05:56:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T05:56:26.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:56:26.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:56:26.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:26.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:25 smithi130 ceph-mon[22266]: Reconfiguring daemon mgr.x on smithi053 2024-08-31T05:56:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:26.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:26.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:26.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T05:56:26.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:56:26.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:56:26.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:26.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:25 smithi153 ceph-mon[22320]: Reconfiguring daemon mgr.x on smithi053 2024-08-31T05:56:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.798+0000 7f3d58ff7640 1 -- 172.21.15.53:0/1764163330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d54108a90 msgr2=0x7f3d5410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.798+0000 7f3d58ff7640 1 --2- 172.21.15.53:0/1764163330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d54108a90 0x7f3d5410f2c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009ca0 tx=0x7f3d4c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:56:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.798+0000 7f3d58ff7640 1 -- 172.21.15.53:0/1764163330 shutdown_connections 2024-08-31T05:56:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.798+0000 7f3d58ff7640 1 --2- 172.21.15.53:0/1764163330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d54108a90 0x7f3d5410f2c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.798+0000 7f3d58ff7640 1 --2- 172.21.15.53:0/1764163330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d54108140 0x7f3d54108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.798+0000 7f3d58ff7640 1 --2- 172.21.15.53:0/1764163330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d54102800 0x7f3d54102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.798+0000 7f3d58ff7640 1 -- 172.21.15.53:0/1764163330 >> 172.21.15.53:0/1764163330 conn(0x7f3d540794d0 msgr2=0x7f3d540798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.798+0000 7f3d58ff7640 1 -- 172.21.15.53:0/1764163330 shutdown_connections 2024-08-31T05:56:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.798+0000 7f3d58ff7640 1 -- 172.21.15.53:0/1764163330 wait complete. 2024-08-31T05:56:26.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d58ff7640 1 Processor -- start 2024-08-31T05:56:26.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d58ff7640 1 -- start start 2024-08-31T05:56:26.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d58ff7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d54102800 0x7f3d5419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:26.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d58ff7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d54108140 0x7f3d5419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:26.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d58ff7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d54108a90 0x7f3d5419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:26.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d58ff7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3d54112460 con 0x7f3d54102800 2024-08-31T05:56:26.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d58ff7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541122e0 con 0x7f3d54108140 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d58ff7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541125e0 con 0x7f3d54108a90 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d5259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d54102800 0x7f3d5419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d5259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d54102800 0x7f3d5419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33852/0 (socket says 172.21.15.53:33852) 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d5259c640 1 -- 172.21.15.53:0/2878230804 learned_addr learned my addr 172.21.15.53:0/2878230804 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.799+0000 7f3d4bfff640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d54108140 0x7f3d5419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d52d9d640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d54108a90 0x7f3d5419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d5259c640 1 -- 172.21.15.53:0/2878230804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d54108a90 msgr2=0x7f3d5419f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d5259c640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d54108a90 0x7f3d5419f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d5259c640 1 -- 172.21.15.53:0/2878230804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d54108140 msgr2=0x7f3d5419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d5259c640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d54108140 0x7f3d5419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d5259c640 1 -- 172.21.15.53:0/2878230804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5419ff30 con 0x7f3d54102800 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d5259c640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d54102800 0x7f3d5419a080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400c920 tx=0x7f3d4400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:26.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d4b7fe640 1 -- 172.21.15.53:0/2878230804 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44007c70 con 0x7f3d54102800 2024-08-31T05:56:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d58ff7640 1 -- 172.21.15.53:0/2878230804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d541a0220 con 0x7f3d54102800 2024-08-31T05:56:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d4b7fe640 1 -- 172.21.15.53:0/2878230804 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f3d44007e10 con 0x7f3d54102800 2024-08-31T05:56:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d4b7fe640 1 -- 172.21.15.53:0/2878230804 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44018660 con 0x7f3d54102800 2024-08-31T05:56:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.800+0000 7f3d58ff7640 1 -- 172.21.15.53:0/2878230804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d541a6a40 con 0x7f3d54102800 2024-08-31T05:56:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.801+0000 7f3d4b7fe640 1 -- 172.21.15.53:0/2878230804 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f3d44005020 con 0x7f3d54102800 2024-08-31T05:56:26.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.801+0000 7f3d58ff7640 1 -- 172.21.15.53:0/2878230804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d54102c10 con 0x7f3d54102800 2024-08-31T05:56:26.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.802+0000 7f3d4b7fe640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3d4003f300 0x7f3d40041810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:26.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.802+0000 7f3d4b7fe640 1 -- 172.21.15.53:0/2878230804 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3d44053ad0 con 0x7f3d54102800 2024-08-31T05:56:26.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.802+0000 7f3d4bfff640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3d4003f300 0x7f3d40041810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:26.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.802+0000 7f3d4bfff640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3d4003f300 0x7f3d40041810 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d54107880 tx=0x7f3d3c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:26.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.806+0000 7f3d4b7fe640 1 -- 172.21.15.53:0/2878230804 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3d44014030 con 0x7f3d54102800 2024-08-31T05:56:26.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.996+0000 7f3d58ff7640 1 -- 172.21.15.53:0/2878230804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f3d541a6d20 con 0x7f3d54102800 2024-08-31T05:56:27.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.999+0000 7f3d4b7fe640 1 -- 172.21.15.53:0/2878230804 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v21)=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7f3d44008230 con 0x7f3d54102800 2024-08-31T05:56:27.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.001+0000 7f3d58ff7640 1 -- 172.21.15.53:0/2878230804 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3d4003f300 msgr2=0x7f3d40041810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.001+0000 7f3d58ff7640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3d4003f300 0x7f3d40041810 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d54107880 tx=0x7f3d3c005f90 comp rx=0 tx=0).stop 2024-08-31T05:56:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.002+0000 7f3d58ff7640 1 -- 172.21.15.53:0/2878230804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d54102800 msgr2=0x7f3d5419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.002+0000 7f3d58ff7640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d54102800 0x7f3d5419a080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400c920 tx=0x7f3d4400cde0 comp rx=0 tx=0).stop 2024-08-31T05:56:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.002+0000 7f3d58ff7640 1 -- 172.21.15.53:0/2878230804 shutdown_connections 2024-08-31T05:56:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.002+0000 7f3d58ff7640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3d4003f300 0x7f3d40041810 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.002+0000 7f3d58ff7640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d54108a90 0x7f3d5419f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.002+0000 7f3d58ff7640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d54108140 0x7f3d5419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.002+0000 7f3d58ff7640 1 --2- 172.21.15.53:0/2878230804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d54102800 0x7f3d5419a080 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.002+0000 7f3d58ff7640 1 -- 172.21.15.53:0/2878230804 >> 172.21.15.53:0/2878230804 conn(0x7f3d540794d0 msgr2=0x7f3d541017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.002+0000 7f3d58ff7640 1 -- 172.21.15.53:0/2878230804 shutdown_connections 2024-08-31T05:56:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.002+0000 7f3d58ff7640 1 -- 172.21.15.53:0/2878230804 wait complete. 2024-08-31T05:56:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:27 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1965661554' entity='client.admin' 2024-08-31T05:56:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:27 smithi053 ceph-mon[18924]: Standby manager daemon z started 2024-08-31T05:56:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:27 smithi053 ceph-mon[18924]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T05:56:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:27 smithi053 ceph-mon[18924]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:56:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:27 smithi053 ceph-mon[18924]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T05:56:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:27 smithi053 ceph-mon[18924]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:56:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:27 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2878230804' entity='client.admin' 2024-08-31T05:56:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:27 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1965661554' entity='client.admin' 2024-08-31T05:56:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:27 smithi130 ceph-mon[22266]: Standby manager daemon z started 2024-08-31T05:56:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:27 smithi130 ceph-mon[22266]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T05:56:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:27 smithi130 ceph-mon[22266]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:56:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:27 smithi130 ceph-mon[22266]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T05:56:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:27 smithi130 ceph-mon[22266]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:56:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:27 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2878230804' entity='client.admin' 2024-08-31T05:56:27.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:27 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1965661554' entity='client.admin' 2024-08-31T05:56:27.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:27 smithi153 ceph-mon[22320]: Standby manager daemon z started 2024-08-31T05:56:27.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:27 smithi153 ceph-mon[22320]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T05:56:27.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:27 smithi153 ceph-mon[22320]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:56:27.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:27 smithi153 ceph-mon[22320]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T05:56:27.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:27 smithi153 ceph-mon[22320]: from='mgr.? 172.21.15.153:0/2319480495' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:56:27.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:27 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2878230804' entity='client.admin' 2024-08-31T05:56:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.802+0000 7f167e05e640 1 -- 172.21.15.53:0/2352800241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1678109b90 msgr2=0x7f16781103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.802+0000 7f167e05e640 1 --2- 172.21.15.53:0/2352800241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1678109b90 0x7f16781103c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1670009ca0 tx=0x7f167002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:56:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.802+0000 7f167e05e640 1 -- 172.21.15.53:0/2352800241 shutdown_connections 2024-08-31T05:56:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.802+0000 7f167e05e640 1 --2- 172.21.15.53:0/2352800241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1678109b90 0x7f16781103c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.802+0000 7f167e05e640 1 --2- 172.21.15.53:0/2352800241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1678109240 0x7f1678109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.802+0000 7f167e05e640 1 --2- 172.21.15.53:0/2352800241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1678103900 0x7f1678103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.802+0000 7f167e05e640 1 -- 172.21.15.53:0/2352800241 >> 172.21.15.53:0/2352800241 conn(0x7f167807b5f0 msgr2=0x7f167807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.802+0000 7f167e05e640 1 -- 172.21.15.53:0/2352800241 shutdown_connections 2024-08-31T05:56:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.802+0000 7f167e05e640 1 -- 172.21.15.53:0/2352800241 wait complete. 2024-08-31T05:56:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.803+0000 7f167e05e640 1 Processor -- start 2024-08-31T05:56:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.803+0000 7f167e05e640 1 -- start start 2024-08-31T05:56:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.803+0000 7f167e05e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1678103900 0x7f167819a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.803+0000 7f167e05e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1678109240 0x7f167819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.803+0000 7f167e05e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1678109b90 0x7f167819f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f167e05e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1678113630 con 0x7f1678109240 2024-08-31T05:56:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f167e05e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f16781134b0 con 0x7f1678103900 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f167e05e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f16781137b0 con 0x7f1678109b90 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f166effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1678109240 0x7f167819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f166effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1678109240 0x7f167819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33872/0 (socket says 172.21.15.53:33872) 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f166effd640 1 -- 172.21.15.53:0/4068495530 learned_addr learned my addr 172.21.15.53:0/4068495530 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f16777fe640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1678103900 0x7f167819a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f1677fff640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1678109b90 0x7f167819f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f166effd640 1 -- 172.21.15.53:0/4068495530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1678109b90 msgr2=0x7f167819f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f166effd640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1678109b90 0x7f167819f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f166effd640 1 -- 172.21.15.53:0/4068495530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1678103900 msgr2=0x7f167819a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f166effd640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1678103900 0x7f167819a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f166effd640 1 -- 172.21.15.53:0/4068495530 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16781a0070 con 0x7f1678109240 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f1677fff640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1678109b90 0x7f167819f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:56:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f16777fe640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1678103900 0x7f167819a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:56:27.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f166effd640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1678109240 0x7f167819a6a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f166000d750 tx=0x7f166000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:27.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f16757fa640 1 -- 172.21.15.53:0/4068495530 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660017070 con 0x7f1678109240 2024-08-31T05:56:27.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f16757fa640 1 -- 172.21.15.53:0/4068495530 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1660005490 con 0x7f1678109240 2024-08-31T05:56:27.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.804+0000 7f167e05e640 1 -- 172.21.15.53:0/4068495530 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16781a0360 con 0x7f1678109240 2024-08-31T05:56:27.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.805+0000 7f16757fa640 1 -- 172.21.15.53:0/4068495530 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660004b00 con 0x7f1678109240 2024-08-31T05:56:27.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.805+0000 7f167e05e640 1 -- 172.21.15.53:0/4068495530 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16781a6ac0 con 0x7f1678109240 2024-08-31T05:56:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.806+0000 7f167e05e640 1 -- 172.21.15.53:0/4068495530 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1678103d10 con 0x7f1678109240 2024-08-31T05:56:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.806+0000 7f16757fa640 1 -- 172.21.15.53:0/4068495530 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) ==== 101904+0+0 (secure 0 0 0) 0x7f1660004ca0 con 0x7f1678109240 2024-08-31T05:56:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.807+0000 7f16757fa640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1664079ee0 0x7f166407c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.807+0000 7f16757fa640 1 -- 172.21.15.53:0/4068495530 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f166009b050 con 0x7f1678109240 2024-08-31T05:56:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.807+0000 7f16777fe640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1664079ee0 0x7f166407c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.807+0000 7f16777fe640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1664079ee0 0x7f166407c3f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1668009fc0 tx=0x7f1668005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.812+0000 7f16757fa640 1 -- 172.21.15.53:0/4068495530 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f16600638d0 con 0x7f1678109240 2024-08-31T05:56:28.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:27.999+0000 7f167e05e640 1 -- 172.21.15.53:0/4068495530 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f167810b980 con 0x7f1678109240 2024-08-31T05:56:28.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.003+0000 7f16757fa640 1 -- 172.21.15.53:0/4068495530 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f1660068090 con 0x7f1678109240 2024-08-31T05:56:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 -- 172.21.15.53:0/4068495530 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1664079ee0 msgr2=0x7f166407c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1664079ee0 0x7f166407c3f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1668009fc0 tx=0x7f1668005f90 comp rx=0 tx=0).stop 2024-08-31T05:56:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 -- 172.21.15.53:0/4068495530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1678109240 msgr2=0x7f167819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1678109240 0x7f167819a6a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f166000d750 tx=0x7f166000dc10 comp rx=0 tx=0).stop 2024-08-31T05:56:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 -- 172.21.15.53:0/4068495530 shutdown_connections 2024-08-31T05:56:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1664079ee0 0x7f166407c3f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1678109b90 0x7f167819f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1678109240 0x7f167819a6a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 --2- 172.21.15.53:0/4068495530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1678103900 0x7f167819a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 -- 172.21.15.53:0/4068495530 >> 172.21.15.53:0/4068495530 conn(0x7f167807b5f0 msgr2=0x7f1678107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 -- 172.21.15.53:0/4068495530 shutdown_connections 2024-08-31T05:56:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:28.005+0000 7f167e05e640 1 -- 172.21.15.53:0/4068495530 wait complete. 2024-08-31T05:56:28.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.953+0000 7f4f88a6d640 1 -- 172.21.15.53:0/3878673769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f84108a90 msgr2=0x7f4f8410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:28.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.953+0000 7f4f88a6d640 1 --2- 172.21.15.53:0/3878673769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f84108a90 0x7f4f8410f2c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009ca0 tx=0x7f4f7c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.953+0000 7f4f88a6d640 1 -- 172.21.15.53:0/3878673769 shutdown_connections 2024-08-31T05:56:28.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.953+0000 7f4f88a6d640 1 --2- 172.21.15.53:0/3878673769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f84108a90 0x7f4f8410f2c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.953+0000 7f4f88a6d640 1 --2- 172.21.15.53:0/3878673769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f84108140 0x7f4f84108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.953+0000 7f4f88a6d640 1 --2- 172.21.15.53:0/3878673769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f84102800 0x7f4f84102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.953+0000 7f4f88a6d640 1 -- 172.21.15.53:0/3878673769 >> 172.21.15.53:0/3878673769 conn(0x7f4f840794d0 msgr2=0x7f4f840798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.953+0000 7f4f88a6d640 1 -- 172.21.15.53:0/3878673769 shutdown_connections 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.953+0000 7f4f88a6d640 1 -- 172.21.15.53:0/3878673769 wait complete. 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f88a6d640 1 Processor -- start 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f88a6d640 1 -- start start 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f88a6d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f84102800 0x7f4f84104e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f88a6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f84108140 0x7f4f841053c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f88a6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f84108a90 0x7f4f84105900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f88a6d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4f84112460 con 0x7f4f84108140 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f88a6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4f841122e0 con 0x7f4f84108a90 2024-08-31T05:56:28.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f88a6d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f841125e0 con 0x7f4f84102800 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f81d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f84108140 0x7f4f841053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f81d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f84108140 0x7f4f841053c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54520/0 (socket says 172.21.15.53:54520) 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f81d9b640 1 -- 172.21.15.53:0/1246805487 learned_addr learned my addr 172.21.15.53:0/1246805487 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.954+0000 7f4f8259c640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f84102800 0x7f4f84104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f82d9d640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f84108a90 0x7f4f84105900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f81d9b640 1 -- 172.21.15.53:0/1246805487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f84102800 msgr2=0x7f4f84104e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f81d9b640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f84102800 0x7f4f84104e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f81d9b640 1 -- 172.21.15.53:0/1246805487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f84108a90 msgr2=0x7f4f84105900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f81d9b640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f84108a90 0x7f4f84105900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f81d9b640 1 -- 172.21.15.53:0/1246805487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f841a82b0 con 0x7f4f84108140 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f82d9d640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f84108a90 0x7f4f84105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f81d9b640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f84108140 0x7f4f841053c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800e9c0 tx=0x7f4f7800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:28.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f737fe640 1 -- 172.21.15.53:0/1246805487 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800cd80 con 0x7f4f84108140 2024-08-31T05:56:28.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f88a6d640 1 -- 172.21.15.53:0/1246805487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f841a85a0 con 0x7f4f84108140 2024-08-31T05:56:28.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f737fe640 1 -- 172.21.15.53:0/1246805487 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4f78005490 con 0x7f4f84108140 2024-08-31T05:56:28.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f737fe640 1 -- 172.21.15.53:0/1246805487 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78004e20 con 0x7f4f84108140 2024-08-31T05:56:28.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.955+0000 7f4f88a6d640 1 -- 172.21.15.53:0/1246805487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f841a8ae0 con 0x7f4f84108140 2024-08-31T05:56:28.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.956+0000 7f4f88a6d640 1 -- 172.21.15.53:0/1246805487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f84102c10 con 0x7f4f84108140 2024-08-31T05:56:28.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.956+0000 7f4f737fe640 1 -- 172.21.15.53:0/1246805487 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f4f78021440 con 0x7f4f84108140 2024-08-31T05:56:28.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.957+0000 7f4f737fe640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f6c03f2d0 0x7f4f6c0417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:28.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.957+0000 7f4f737fe640 1 -- 172.21.15.53:0/1246805487 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4f78053f80 con 0x7f4f84108140 2024-08-31T05:56:28.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.957+0000 7f4f8259c640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f6c03f2d0 0x7f4f6c0417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:28.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.958+0000 7f4f8259c640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f6c03f2d0 0x7f4f6c0417e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4f841068d0 tx=0x7f4f7400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:28.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:20.962+0000 7f4f737fe640 1 -- 172.21.15.53:0/1246805487 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4f78016330 con 0x7f4f84108140 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.149+0000 7f4f88a6d640 1 -- 172.21.15.53:0/1246805487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f4f8402e430 con 0x7f4f84108140 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.152+0000 7f4f737fe640 1 -- 172.21.15.53:0/1246805487 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v14)=0 v14) ==== 138+0+0 (secure 0 0 0) 0x7f4f78021730 con 0x7f4f84108140 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 -- 172.21.15.53:0/1246805487 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f6c03f2d0 msgr2=0x7f4f6c0417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f6c03f2d0 0x7f4f6c0417e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4f841068d0 tx=0x7f4f7400b390 comp rx=0 tx=0).stop 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 -- 172.21.15.53:0/1246805487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f84108140 msgr2=0x7f4f841053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f84108140 0x7f4f841053c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800e9c0 tx=0x7f4f7800ee80 comp rx=0 tx=0).stop 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 -- 172.21.15.53:0/1246805487 shutdown_connections 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f6c03f2d0 0x7f4f6c0417e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f84108a90 0x7f4f84105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f84108140 0x7f4f841053c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 --2- 172.21.15.53:0/1246805487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f84102800 0x7f4f84104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 -- 172.21.15.53:0/1246805487 >> 172.21.15.53:0/1246805487 conn(0x7f4f840794d0 msgr2=0x7f4f8406b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:28.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 -- 172.21.15.53:0/1246805487 shutdown_connections 2024-08-31T05:56:28.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:21.154+0000 7f4f88a6d640 1 -- 172.21.15.53:0/1246805487 wait complete. 2024-08-31T05:56:28.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:28 smithi053 ceph-mon[18924]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-31T05:56:28.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:28 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T05:56:28.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:28 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4068495530' entity='client.admin' 2024-08-31T05:56:28.498 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:28 smithi130 ceph-mon[22266]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-31T05:56:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:28 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T05:56:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:28 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4068495530' entity='client.admin' 2024-08-31T05:56:28.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:28 smithi153 ceph-mon[22320]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-31T05:56:28.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:28 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T05:56:28.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:28 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4068495530' entity='client.admin' 2024-08-31T05:56:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.123+0000 7f104bd83640 1 -- 172.21.15.53:0/2659821855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1044102880 msgr2=0x7f1044102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.123+0000 7f104bd83640 1 --2- 172.21.15.53:0/2659821855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1044102880 0x7f1044102c90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1038009900 tx=0x7f103802a410 comp rx=0 tx=0).stop 2024-08-31T05:56:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.124+0000 7f104bd83640 1 -- 172.21.15.53:0/2659821855 shutdown_connections 2024-08-31T05:56:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.124+0000 7f104bd83640 1 --2- 172.21.15.53:0/2659821855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1044108b10 0x7f104410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.124+0000 7f104bd83640 1 --2- 172.21.15.53:0/2659821855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10441081c0 0x7f10441085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.124+0000 7f104bd83640 1 --2- 172.21.15.53:0/2659821855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1044102880 0x7f1044102c90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.124+0000 7f104bd83640 1 -- 172.21.15.53:0/2659821855 >> 172.21.15.53:0/2659821855 conn(0x7f1044079510 msgr2=0x7f1044079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.124+0000 7f104bd83640 1 -- 172.21.15.53:0/2659821855 shutdown_connections 2024-08-31T05:56:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.124+0000 7f104bd83640 1 -- 172.21.15.53:0/2659821855 wait complete. 2024-08-31T05:56:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.124+0000 7f104bd83640 1 Processor -- start 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.124+0000 7f104bd83640 1 -- start start 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104bd83640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1044102880 0x7f1044198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104bd83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10441081c0 0x7f1044199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104bd83640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1044108b10 0x7f104419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104bd83640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1044112550 con 0x7f10441081c0 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104bd83640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f10441123d0 con 0x7f1044108b10 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104bd83640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10441126d0 con 0x7f1044102880 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104931e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10441081c0 0x7f1044199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104931e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10441081c0 0x7f1044199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33898/0 (socket says 172.21.15.53:33898) 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104931e640 1 -- 172.21.15.53:0/895516587 learned_addr learned my addr 172.21.15.53:0/895516587 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f1049b1f640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1044102880 0x7f1044198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104a320640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1044108b10 0x7f104419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104931e640 1 -- 172.21.15.53:0/895516587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1044102880 msgr2=0x7f1044198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104931e640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1044102880 0x7f1044198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104931e640 1 -- 172.21.15.53:0/895516587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1044108b10 msgr2=0x7f104419e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104931e640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1044108b10 0x7f104419e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104931e640 1 -- 172.21.15.53:0/895516587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104419ef50 con 0x7f10441081c0 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104931e640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10441081c0 0x7f1044199580 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f104000d950 tx=0x7f104000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f1036ffd640 1 -- 172.21.15.53:0/895516587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040017070 con 0x7f10441081c0 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f1036ffd640 1 -- 172.21.15.53:0/895516587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1040004490 con 0x7f10441081c0 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f1036ffd640 1 -- 172.21.15.53:0/895516587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040005540 con 0x7f10441081c0 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104bd83640 1 -- 172.21.15.53:0/895516587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104419f240 con 0x7f10441081c0 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.125+0000 7f104bd83640 1 -- 172.21.15.53:0/895516587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10441a59a0 con 0x7f10441081c0 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.127+0000 7f104bd83640 1 -- 172.21.15.53:0/895516587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1044103b00 con 0x7f10441081c0 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.127+0000 7f1036ffd640 1 -- 172.21.15.53:0/895516587 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) ==== 101904+0+0 (secure 0 0 0) 0x7f1040009c30 con 0x7f10441081c0 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.128+0000 7f1036ffd640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1030079ee0 0x7f103007c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.128+0000 7f1049b1f640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1030079ee0 0x7f103007c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.128+0000 7f1036ffd640 1 -- 172.21.15.53:0/895516587 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f104009b440 con 0x7f10441081c0 2024-08-31T05:56:29.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.128+0000 7f1049b1f640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1030079ee0 0x7f103007c3f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1038009230 tx=0x7f10380058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:29.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.132+0000 7f1036ffd640 1 -- 172.21.15.53:0/895516587 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1040020020 con 0x7f10441081c0 2024-08-31T05:56:29.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.227+0000 7f1036ffd640 1 -- 172.21.15.53:0/895516587 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f104005fed0 con 0x7f10441081c0 2024-08-31T05:56:29.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.320+0000 7f104bd83640 1 -- 172.21.15.53:0/895516587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f1044102c90 con 0x7f10441081c0 2024-08-31T05:56:29.323 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:29 smithi053 ceph-mon[18924]: Standby manager daemon y started 2024-08-31T05:56:29.323 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:29 smithi053 ceph-mon[18924]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T05:56:29.323 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:29 smithi053 ceph-mon[18924]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:56:29.323 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:29 smithi053 ceph-mon[18924]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T05:56:29.323 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:29 smithi053 ceph-mon[18924]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:56:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.324+0000 7f1036ffd640 1 -- 172.21.15.53:0/895516587 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v23)=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7f10400b02b0 con 0x7f10441081c0 2024-08-31T05:56:29.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 -- 172.21.15.53:0/895516587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1030079ee0 msgr2=0x7f103007c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1030079ee0 0x7f103007c3f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1038009230 tx=0x7f10380058d0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 -- 172.21.15.53:0/895516587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10441081c0 msgr2=0x7f1044199580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10441081c0 0x7f1044199580 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f104000d950 tx=0x7f104000de10 comp rx=0 tx=0).stop 2024-08-31T05:56:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 -- 172.21.15.53:0/895516587 shutdown_connections 2024-08-31T05:56:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1030079ee0 0x7f103007c3f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1044108b10 0x7f104419e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10441081c0 0x7f1044199580 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 --2- 172.21.15.53:0/895516587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1044102880 0x7f1044198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 -- 172.21.15.53:0/895516587 >> 172.21.15.53:0/895516587 conn(0x7f1044079510 msgr2=0x7f1044106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 -- 172.21.15.53:0/895516587 shutdown_connections 2024-08-31T05:56:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.327+0000 7f104bd83640 1 -- 172.21.15.53:0/895516587 wait complete. 2024-08-31T05:56:29.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.008+0000 7fde391e8640 1 -- 172.21.15.53:0/3343512086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde34103900 msgr2=0x7fde34103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.008+0000 7fde391e8640 1 --2- 172.21.15.53:0/3343512086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde34103900 0x7fde34103d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fde24009900 tx=0x7fde2402a410 comp rx=0 tx=0).stop 2024-08-31T05:56:29.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.008+0000 7fde391e8640 1 -- 172.21.15.53:0/3343512086 shutdown_connections 2024-08-31T05:56:29.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.008+0000 7fde391e8640 1 --2- 172.21.15.53:0/3343512086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde34109b90 0x7fde341103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.008+0000 7fde391e8640 1 --2- 172.21.15.53:0/3343512086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde34109240 0x7fde34109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.008+0000 7fde391e8640 1 --2- 172.21.15.53:0/3343512086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde34103900 0x7fde34103d10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.008+0000 7fde391e8640 1 -- 172.21.15.53:0/3343512086 >> 172.21.15.53:0/3343512086 conn(0x7fde3407b5f0 msgr2=0x7fde3407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:29.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.009+0000 7fde391e8640 1 -- 172.21.15.53:0/3343512086 shutdown_connections 2024-08-31T05:56:29.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.009+0000 7fde391e8640 1 -- 172.21.15.53:0/3343512086 wait complete. 2024-08-31T05:56:29.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.009+0000 7fde391e8640 1 Processor -- start 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde391e8640 1 -- start start 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde391e8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde34103900 0x7fde3419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde391e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde34109240 0x7fde3419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde391e8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde34109b90 0x7fde3419f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde391e8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fde341135e0 con 0x7fde34109240 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde391e8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fde34113460 con 0x7fde34109b90 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde391e8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fde34113760 con 0x7fde34103900 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde3259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde34109240 0x7fde3419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde3259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde34109240 0x7fde3419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33824/0 (socket says 172.21.15.53:33824) 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde3259c640 1 -- 172.21.15.53:0/1965661554 learned_addr learned my addr 172.21.15.53:0/1965661554 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde32d9d640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde34103900 0x7fde3419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde3359e640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde34109b90 0x7fde3419f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde3259c640 1 -- 172.21.15.53:0/1965661554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde34103900 msgr2=0x7fde3419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde3259c640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde34103900 0x7fde3419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde3259c640 1 -- 172.21.15.53:0/1965661554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde34109b90 msgr2=0x7fde3419f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde3259c640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde34109b90 0x7fde3419f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.010+0000 7fde3259c640 1 -- 172.21.15.53:0/1965661554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde341a0080 con 0x7fde34109240 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.011+0000 7fde3259c640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde34109240 0x7fde3419a6b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde2800d740 tx=0x7fde2800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.011+0000 7fde1bfff640 1 -- 172.21.15.53:0/1965661554 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28017070 con 0x7fde34109240 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.011+0000 7fde391e8640 1 -- 172.21.15.53:0/1965661554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde341a0370 con 0x7fde34109240 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.011+0000 7fde1bfff640 1 -- 172.21.15.53:0/1965661554 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fde2800de50 con 0x7fde34109240 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.011+0000 7fde1bfff640 1 -- 172.21.15.53:0/1965661554 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2800f3c0 con 0x7fde34109240 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.011+0000 7fde391e8640 1 -- 172.21.15.53:0/1965661554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde341a6ad0 con 0x7fde34109240 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.012+0000 7fde1bfff640 1 -- 172.21.15.53:0/1965661554 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7fde2801a070 con 0x7fde34109240 2024-08-31T05:56:29.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.012+0000 7fde1bfff640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde1c03f2d0 0x7fde1c0417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.012+0000 7fde1bfff640 1 -- 172.21.15.53:0/1965661554 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fde280542b0 con 0x7fde34109240 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.012+0000 7fde32d9d640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde1c03f2d0 0x7fde1c0417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.012+0000 7fde391e8640 1 -- 172.21.15.53:0/1965661554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde34103d10 con 0x7fde34109240 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.013+0000 7fde32d9d640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde1c03f2d0 0x7fde1c0417e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fde24009230 tx=0x7fde240058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.017+0000 7fde1bfff640 1 -- 172.21.15.53:0/1965661554 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fde28009c30 con 0x7fde34109240 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.203+0000 7fde391e8640 1 -- 172.21.15.53:0/1965661554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fde3410b910 con 0x7fde34109240 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.207+0000 7fde1bfff640 1 -- 172.21.15.53:0/1965661554 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7fde2801bdc0 con 0x7fde34109240 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 -- 172.21.15.53:0/1965661554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde1c03f2d0 msgr2=0x7fde1c0417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde1c03f2d0 0x7fde1c0417e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fde24009230 tx=0x7fde240058d0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 -- 172.21.15.53:0/1965661554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde34109240 msgr2=0x7fde3419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde34109240 0x7fde3419a6b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde2800d740 tx=0x7fde2800dc00 comp rx=0 tx=0).stop 2024-08-31T05:56:29.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 -- 172.21.15.53:0/1965661554 shutdown_connections 2024-08-31T05:56:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde1c03f2d0 0x7fde1c0417e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde34109b90 0x7fde3419f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde34109240 0x7fde3419a6b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 --2- 172.21.15.53:0/1965661554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde34103900 0x7fde3419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 -- 172.21.15.53:0/1965661554 >> 172.21.15.53:0/1965661554 conn(0x7fde3407b5f0 msgr2=0x7fde34107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 -- 172.21.15.53:0/1965661554 shutdown_connections 2024-08-31T05:56:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:26.209+0000 7fde391e8640 1 -- 172.21.15.53:0/1965661554 wait complete. 2024-08-31T05:56:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:29.529 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:29 smithi130 ceph-mon[22266]: Standby manager daemon y started 2024-08-31T05:56:29.529 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:29 smithi130 ceph-mon[22266]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T05:56:29.529 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:29 smithi130 ceph-mon[22266]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:56:29.529 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:29 smithi130 ceph-mon[22266]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T05:56:29.529 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:29 smithi130 ceph-mon[22266]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:56:29.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:29 smithi153 ceph-mon[22320]: Standby manager daemon y started 2024-08-31T05:56:29.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:29 smithi153 ceph-mon[22320]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T05:56:29.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:29 smithi153 ceph-mon[22320]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:56:29.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:29 smithi153 ceph-mon[22320]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T05:56:29.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:29 smithi153 ceph-mon[22320]: from='mgr.? 172.21.15.130:0/200079681' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:56:29.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.946+0000 7fb871d92640 1 -- 172.21.15.53:0/655726607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c105090 msgr2=0x7fb86c10d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.946+0000 7fb871d92640 1 --2- 172.21.15.53:0/655726607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c105090 0x7fb86c10d6d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb860009900 tx=0x7fb86002a410 comp rx=0 tx=0).stop 2024-08-31T05:56:29.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.946+0000 7fb871d92640 1 -- 172.21.15.53:0/655726607 shutdown_connections 2024-08-31T05:56:29.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.946+0000 7fb871d92640 1 --2- 172.21.15.53:0/655726607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c10dc10 0x7fb86c110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.946+0000 7fb871d92640 1 --2- 172.21.15.53:0/655726607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c105090 0x7fb86c10d6d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.946+0000 7fb871d92640 1 --2- 172.21.15.53:0/655726607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c104660 0x7fb86c104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.946+0000 7fb871d92640 1 -- 172.21.15.53:0/655726607 >> 172.21.15.53:0/655726607 conn(0x7fb86c079510 msgr2=0x7fb86c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:29.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.946+0000 7fb871d92640 1 -- 172.21.15.53:0/655726607 shutdown_connections 2024-08-31T05:56:29.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.946+0000 7fb871d92640 1 -- 172.21.15.53:0/655726607 wait complete. 2024-08-31T05:56:29.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.947+0000 7fb871d92640 1 Processor -- start 2024-08-31T05:56:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.947+0000 7fb871d92640 1 -- start start 2024-08-31T05:56:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb871d92640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c104660 0x7fb86c102570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb871d92640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c105090 0x7fb86c102ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb871d92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c10dc10 0x7fb86c102ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb871d92640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c113620 con 0x7fb86c10dc10 2024-08-31T05:56:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb871d92640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c1134a0 con 0x7fb86c104660 2024-08-31T05:56:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb871d92640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c1137a0 con 0x7fb86c105090 2024-08-31T05:56:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c104660 0x7fb86c102570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c10dc10 0x7fb86c102ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c104660 0x7fb86c102570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36844/0 (socket says 172.21.15.53:36844) 2024-08-31T05:56:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c10dc10 0x7fb86c102ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33932/0 (socket says 172.21.15.53:33932) 2024-08-31T05:56:29.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86b7fe640 1 -- 172.21.15.53:0/855741341 learned_addr learned my addr 172.21.15.53:0/855741341 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:29.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86affd640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c105090 0x7fb86c102ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86b7fe640 1 -- 172.21.15.53:0/855741341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c105090 msgr2=0x7fb86c102ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c105090 0x7fb86c102ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86b7fe640 1 -- 172.21.15.53:0/855741341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c10dc10 msgr2=0x7fb86c102ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:29.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c10dc10 0x7fb86c102ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:29.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86b7fe640 1 -- 172.21.15.53:0/855741341 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86c1a8410 con 0x7fb86c104660 2024-08-31T05:56:29.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86bfff640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c10dc10 0x7fb86c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:56:29.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c104660 0x7fb86c102570 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00e9f0 tx=0x7fb85c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:29.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.948+0000 7fb868ff9640 1 -- 172.21.15.53:0/855741341 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00cd80 con 0x7fb86c104660 2024-08-31T05:56:29.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.949+0000 7fb868ff9640 1 -- 172.21.15.53:0/855741341 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fb85c005490 con 0x7fb86c104660 2024-08-31T05:56:29.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.949+0000 7fb871d92640 1 -- 172.21.15.53:0/855741341 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86c1a8700 con 0x7fb86c104660 2024-08-31T05:56:29.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.949+0000 7fb868ff9640 1 -- 172.21.15.53:0/855741341 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c010430 con 0x7fb86c104660 2024-08-31T05:56:29.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.949+0000 7fb871d92640 1 -- 172.21.15.53:0/855741341 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86c1a8bc0 con 0x7fb86c104660 2024-08-31T05:56:29.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.950+0000 7fb871d92640 1 -- 172.21.15.53:0/855741341 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb86c06bfa0 con 0x7fb86c104660 2024-08-31T05:56:29.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.951+0000 7fb868ff9640 1 -- 172.21.15.53:0/855741341 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fb85c0046c0 con 0x7fb86c104660 2024-08-31T05:56:29.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.952+0000 7fb868ff9640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4af0 0x7fb8540b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:29.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.952+0000 7fb86affd640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4af0 0x7fb8540b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:29.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.952+0000 7fb868ff9640 1 -- 172.21.15.53:0/855741341 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb85c0e3940 con 0x7fb86c104660 2024-08-31T05:56:29.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.952+0000 7fb86affd640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4af0 0x7fb8540b7000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb860005940 tx=0x7fb8600058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.955+0000 7fb868ff9640 1 -- 172.21.15.53:0/855741341 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb85c0ac5d0 con 0x7fb86c104660 2024-08-31T05:56:30.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.139+0000 7fbc4c809640 1 -- 172.21.15.53:0/25766758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc4810dbd0 msgr2=0x7fbc481100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.139+0000 7fbc4c809640 1 --2- 172.21.15.53:0/25766758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc4810dbd0 0x7fbc481100e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009ca0 tx=0x7fbc4002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.139+0000 7fbc4c809640 1 -- 172.21.15.53:0/25766758 shutdown_connections 2024-08-31T05:56:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.139+0000 7fbc4c809640 1 --2- 172.21.15.53:0/25766758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc4810dbd0 0x7fbc481100e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.139+0000 7fbc4c809640 1 --2- 172.21.15.53:0/25766758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc48105050 0x7fbc4810d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.139+0000 7fbc4c809640 1 --2- 172.21.15.53:0/25766758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc48104620 0x7fbc48104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.139+0000 7fbc4c809640 1 -- 172.21.15.53:0/25766758 >> 172.21.15.53:0/25766758 conn(0x7fbc48079580 msgr2=0x7fbc48079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.139+0000 7fbc4c809640 1 -- 172.21.15.53:0/25766758 shutdown_connections 2024-08-31T05:56:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.139+0000 7fbc4c809640 1 -- 172.21.15.53:0/25766758 wait complete. 2024-08-31T05:56:30.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.140+0000 7fbc4c809640 1 Processor -- start 2024-08-31T05:56:30.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.140+0000 7fbc4c809640 1 -- start start 2024-08-31T05:56:30.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.140+0000 7fbc4c809640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc48104620 0x7fbc4819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:30.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.140+0000 7fbc4c809640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc48105050 0x7fbc4819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:30.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.140+0000 7fbc4c809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc4810dbd0 0x7fbc4819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.140+0000 7fbc4c809640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbc48113630 con 0x7fbc4810dbd0 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.140+0000 7fbc4c809640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbc481134b0 con 0x7fbc48105050 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.140+0000 7fbc4c809640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbc481137b0 con 0x7fbc48104620 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc46d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc4810dbd0 0x7fbc4819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc46d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc4810dbd0 0x7fbc4819f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33944/0 (socket says 172.21.15.53:33944) 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc46d9d640 1 -- 172.21.15.53:0/2027140120 learned_addr learned my addr 172.21.15.53:0/2027140120 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc45d9b640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc48105050 0x7fbc4819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc4659c640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc48104620 0x7fbc4819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc46d9d640 1 -- 172.21.15.53:0/2027140120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc48104620 msgr2=0x7fbc4819a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc46d9d640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc48104620 0x7fbc4819a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc46d9d640 1 -- 172.21.15.53:0/2027140120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc48105050 msgr2=0x7fbc4819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc46d9d640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc48105050 0x7fbc4819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc46d9d640 1 -- 172.21.15.53:0/2027140120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc481a0010 con 0x7fbc4810dbd0 2024-08-31T05:56:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc46d9d640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc4810dbd0 0x7fbc4819f8e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009430 tx=0x7fbc40003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc3f7fe640 1 -- 172.21.15.53:0/2027140120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40032e10 con 0x7fbc4810dbd0 2024-08-31T05:56:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc3f7fe640 1 -- 172.21.15.53:0/2027140120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fbc400044b0 con 0x7fbc4810dbd0 2024-08-31T05:56:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc4c809640 1 -- 172.21.15.53:0/2027140120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc481a02a0 con 0x7fbc4810dbd0 2024-08-31T05:56:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc3f7fe640 1 -- 172.21.15.53:0/2027140120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40030af0 con 0x7fbc4810dbd0 2024-08-31T05:56:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.141+0000 7fbc4c809640 1 -- 172.21.15.53:0/2027140120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc481a6a60 con 0x7fbc4810dbd0 2024-08-31T05:56:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.142+0000 7fbc4c809640 1 -- 172.21.15.53:0/2027140120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc48104a30 con 0x7fbc4810dbd0 2024-08-31T05:56:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.144+0000 7fbc3f7fe640 1 -- 172.21.15.53:0/2027140120 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fbc40004660 con 0x7fbc4810dbd0 2024-08-31T05:56:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.145+0000 7fb871d92640 1 -- 172.21.15.53:0/855741341 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fb86c104a70 con 0x7fb86c104660 2024-08-31T05:56:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.145+0000 7fbc3f7fe640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc340b4af0 0x7fbc340b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.145+0000 7fbc4659c640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc340b4af0 0x7fbc340b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.145+0000 7fbc3f7fe640 1 -- 172.21.15.53:0/2027140120 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fbc40104ae0 con 0x7fbc4810dbd0 2024-08-31T05:56:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.145+0000 7fbc4659c640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc340b4af0 0x7fbc340b7000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc4806c360 tx=0x7fbc38005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:30.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.148+0000 7fbc3f7fe640 1 -- 172.21.15.53:0/2027140120 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbc40083130 con 0x7fbc4810dbd0 2024-08-31T05:56:30.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.153+0000 7fb868ff9640 1 -- 172.21.15.53:0/855741341 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v25)=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7fb85c0abed0 con 0x7fb86c104660 2024-08-31T05:56:30.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 -- 172.21.15.53:0/855741341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4af0 msgr2=0x7fb8540b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:30.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4af0 0x7fb8540b7000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb860005940 tx=0x7fb8600058d0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 -- 172.21.15.53:0/855741341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c104660 msgr2=0x7fb86c102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:30.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c104660 0x7fb86c102570 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00e9f0 tx=0x7fb85c00edf0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 -- 172.21.15.53:0/855741341 shutdown_connections 2024-08-31T05:56:30.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4af0 0x7fb8540b7000 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c10dc10 0x7fb86c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c105090 0x7fb86c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 --2- 172.21.15.53:0/855741341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c104660 0x7fb86c102570 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 -- 172.21.15.53:0/855741341 >> 172.21.15.53:0/855741341 conn(0x7fb86c079510 msgr2=0x7fb86c0ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:30.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 -- 172.21.15.53:0/855741341 shutdown_connections 2024-08-31T05:56:30.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.156+0000 7fb871d92640 1 -- 172.21.15.53:0/855741341 wait complete. 2024-08-31T05:56:30.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.340+0000 7fbc4c809640 1 -- 172.21.15.53:0/2027140120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fbc481a6c90 con 0x7fbc4810dbd0 2024-08-31T05:56:30.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.344+0000 7fbc3f7fe640 1 -- 172.21.15.53:0/2027140120 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v26)=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fbc400cd810 con 0x7fbc4810dbd0 2024-08-31T05:56:30.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 -- 172.21.15.53:0/2027140120 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc340b4af0 msgr2=0x7fbc340b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:30.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc340b4af0 0x7fbc340b7000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc4806c360 tx=0x7fbc38005f90 comp rx=0 tx=0).stop 2024-08-31T05:56:30.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 -- 172.21.15.53:0/2027140120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc4810dbd0 msgr2=0x7fbc4819f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:30.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc4810dbd0 0x7fbc4819f8e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009430 tx=0x7fbc40003f10 comp rx=0 tx=0).stop 2024-08-31T05:56:30.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 -- 172.21.15.53:0/2027140120 shutdown_connections 2024-08-31T05:56:30.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc340b4af0 0x7fbc340b7000 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc4810dbd0 0x7fbc4819f8e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc48105050 0x7fbc4819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 --2- 172.21.15.53:0/2027140120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc48104620 0x7fbc4819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:30.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 -- 172.21.15.53:0/2027140120 >> 172.21.15.53:0/2027140120 conn(0x7fbc48079580 msgr2=0x7fbc48107770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:30.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 -- 172.21.15.53:0/2027140120 shutdown_connections 2024-08-31T05:56:30.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:30.347+0000 7fbc4c809640 1 -- 172.21.15.53:0/2027140120 wait complete. 2024-08-31T05:56:30.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:30 smithi130 ceph-mon[22266]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-08-31T05:56:30.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:30 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T05:56:30.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:30 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/895516587' entity='client.admin' 2024-08-31T05:56:30.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:30 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/809188028' entity='client.admin' 2024-08-31T05:56:30.541 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:30 smithi130 ceph-mon[22266]: from='client.? ' entity='client.admin' 2024-08-31T05:56:30.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:30 smithi153 ceph-mon[22320]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-08-31T05:56:30.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:30 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T05:56:30.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:30 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/895516587' entity='client.admin' 2024-08-31T05:56:30.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:30 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/809188028' entity='client.admin' 2024-08-31T05:56:30.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:30 smithi153 ceph-mon[22320]: from='client.? ' entity='client.admin' 2024-08-31T05:56:30.719 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:30 smithi053 ceph-mon[18924]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-08-31T05:56:30.720 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:30 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T05:56:30.720 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:30 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/895516587' entity='client.admin' 2024-08-31T05:56:30.720 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:30 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/809188028' entity='client.admin' 2024-08-31T05:56:30.720 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:30 smithi053 ceph-mon[18924]: from='client.? ' entity='client.admin' 2024-08-31T05:56:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.342+0000 7f854d76d640 1 -- 172.21.15.53:0/491689925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8548102800 msgr2=0x7f8548102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.342+0000 7f854d76d640 1 --2- 172.21.15.53:0/491689925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8548102800 0x7f8548102c10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8538009900 tx=0x7f853802a410 comp rx=0 tx=0).stop 2024-08-31T05:56:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.342+0000 7f854d76d640 1 -- 172.21.15.53:0/491689925 shutdown_connections 2024-08-31T05:56:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.342+0000 7f854d76d640 1 --2- 172.21.15.53:0/491689925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8548108a90 0x7f854810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.342+0000 7f854d76d640 1 --2- 172.21.15.53:0/491689925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8548108140 0x7f8548108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.342+0000 7f854d76d640 1 --2- 172.21.15.53:0/491689925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8548102800 0x7f8548102c10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.342+0000 7f854d76d640 1 -- 172.21.15.53:0/491689925 >> 172.21.15.53:0/491689925 conn(0x7f85480794d0 msgr2=0x7f85480798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.342+0000 7f854d76d640 1 -- 172.21.15.53:0/491689925 shutdown_connections 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.342+0000 7f854d76d640 1 -- 172.21.15.53:0/491689925 wait complete. 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.343+0000 7f854d76d640 1 Processor -- start 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.343+0000 7f854d76d640 1 -- start start 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.343+0000 7f854d76d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8548102800 0x7f854819aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.343+0000 7f854d76d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8548108140 0x7f854819b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.343+0000 7f854d76d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8548108a90 0x7f854819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.343+0000 7f854d76d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8548112480 con 0x7f8548108a90 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.343+0000 7f854d76d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8548112300 con 0x7f8548102800 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.343+0000 7f854d76d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8548112600 con 0x7f8548108140 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f85477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8548108a90 0x7f854819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f85477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8548108a90 0x7f854819b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33908/0 (socket says 172.21.15.53:33908) 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f85477fe640 1 -- 172.21.15.53:0/809188028 learned_addr learned my addr 172.21.15.53:0/809188028 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f8546ffd640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8548102800 0x7f854819aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f85467fc640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8548108140 0x7f854819b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f85477fe640 1 -- 172.21.15.53:0/809188028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8548108140 msgr2=0x7f854819b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f85477fe640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8548108140 0x7f854819b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f85477fe640 1 -- 172.21.15.53:0/809188028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8548102800 msgr2=0x7f854819aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f85477fe640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8548102800 0x7f854819aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f85477fe640 1 -- 172.21.15.53:0/809188028 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85481a61b0 con 0x7f8548108a90 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f8546ffd640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8548102800 0x7f854819aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f85477fe640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8548108a90 0x7f854819b970 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f854000eb10 tx=0x7f854000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f852ffff640 1 -- 172.21.15.53:0/809188028 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540004b20 con 0x7f8548108a90 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f854d76d640 1 -- 172.21.15.53:0/809188028 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85481a64a0 con 0x7f8548108a90 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f852ffff640 1 -- 172.21.15.53:0/809188028 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8540004cc0 con 0x7f8548108a90 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.344+0000 7f852ffff640 1 -- 172.21.15.53:0/809188028 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540010690 con 0x7f8548108a90 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.345+0000 7f854d76d640 1 -- 172.21.15.53:0/809188028 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85481a6990 con 0x7f8548108a90 2024-08-31T05:56:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.346+0000 7f854d76d640 1 -- 172.21.15.53:0/809188028 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8548102c10 con 0x7f8548108a90 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.347+0000 7f852ffff640 1 -- 172.21.15.53:0/809188028 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f8540010830 con 0x7f8548108a90 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.348+0000 7f852ffff640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85300b4af0 0x7f85300b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.348+0000 7f8546ffd640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85300b4af0 0x7f85300b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.348+0000 7f852ffff640 1 -- 172.21.15.53:0/809188028 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f85400e3ad0 con 0x7f8548108a90 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.348+0000 7f8546ffd640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85300b4af0 0x7f85300b7000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f854806b780 tx=0x7f85380058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.352+0000 7f852ffff640 1 -- 172.21.15.53:0/809188028 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f85400ac800 con 0x7f8548108a90 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.541+0000 7f854d76d640 1 -- 172.21.15.53:0/809188028 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f854802e430 con 0x7f8548108a90 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.545+0000 7f852ffff640 1 -- 172.21.15.53:0/809188028 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v24)=0 v24) ==== 116+0+0 (secure 0 0 0) 0x7f85400059e0 con 0x7f8548108a90 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 -- 172.21.15.53:0/809188028 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85300b4af0 msgr2=0x7f85300b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85300b4af0 0x7f85300b7000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f854806b780 tx=0x7f85380058d0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 -- 172.21.15.53:0/809188028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8548108a90 msgr2=0x7f854819b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8548108a90 0x7f854819b970 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f854000eb10 tx=0x7f854000c2d0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 -- 172.21.15.53:0/809188028 shutdown_connections 2024-08-31T05:56:31.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85300b4af0 0x7f85300b7000 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8548108a90 0x7f854819b970 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8548108140 0x7f854819b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 --2- 172.21.15.53:0/809188028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8548102800 0x7f854819aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 -- 172.21.15.53:0/809188028 >> 172.21.15.53:0/809188028 conn(0x7f85480794d0 msgr2=0x7f8548101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:31.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 -- 172.21.15.53:0/809188028 shutdown_connections 2024-08-31T05:56:31.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:29.548+0000 7f854d76d640 1 -- 172.21.15.53:0/809188028 wait complete. 2024-08-31T05:56:31.570 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:31 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2027140120' entity='client.admin' 2024-08-31T05:56:31.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:31 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2027140120' entity='client.admin' 2024-08-31T05:56:31.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:31 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2027140120' entity='client.admin' 2024-08-31T05:56:31.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.934+0000 7f60a55c1640 1 -- 172.21.15.53:0/769941759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a0108a90 msgr2=0x7f60a010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:31.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.934+0000 7f60a55c1640 1 --2- 172.21.15.53:0/769941759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a0108a90 0x7f60a010f2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6094009900 tx=0x7f609402a410 comp rx=0 tx=0).stop 2024-08-31T05:56:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.934+0000 7f60a55c1640 1 -- 172.21.15.53:0/769941759 shutdown_connections 2024-08-31T05:56:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.934+0000 7f60a55c1640 1 --2- 172.21.15.53:0/769941759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a0108a90 0x7f60a010f2c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.934+0000 7f60a55c1640 1 --2- 172.21.15.53:0/769941759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a0108140 0x7f60a0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.934+0000 7f60a55c1640 1 --2- 172.21.15.53:0/769941759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a0102800 0x7f60a0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.934+0000 7f60a55c1640 1 -- 172.21.15.53:0/769941759 >> 172.21.15.53:0/769941759 conn(0x7f60a00794d0 msgr2=0x7f60a00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.934+0000 7f60a55c1640 1 -- 172.21.15.53:0/769941759 shutdown_connections 2024-08-31T05:56:31.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.934+0000 7f60a55c1640 1 -- 172.21.15.53:0/769941759 wait complete. 2024-08-31T05:56:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.935+0000 7f60a55c1640 1 Processor -- start 2024-08-31T05:56:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f60a55c1640 1 -- start start 2024-08-31T05:56:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f60a55c1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a0102800 0x7f60a0199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f60a55c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a0108140 0x7f60a01995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f60a55c1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a0108a90 0x7f60a019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f60a55c1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f60a0112480 con 0x7f60a0108140 2024-08-31T05:56:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f60a55c1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f60a0112300 con 0x7f60a0108a90 2024-08-31T05:56:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f60a55c1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60a0112600 con 0x7f60a0102800 2024-08-31T05:56:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f609e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a0108140 0x7f60a01995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f609e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a0108140 0x7f60a01995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33954/0 (socket says 172.21.15.53:33954) 2024-08-31T05:56:31.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f609e7fc640 1 -- 172.21.15.53:0/2892603976 learned_addr learned my addr 172.21.15.53:0/2892603976 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f609effd640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a0102800 0x7f60a0199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f609f7fe640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a0108a90 0x7f60a019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f609e7fc640 1 -- 172.21.15.53:0/2892603976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a0102800 msgr2=0x7f60a0199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f609e7fc640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a0102800 0x7f60a0199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.936+0000 7f609e7fc640 1 -- 172.21.15.53:0/2892603976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a0108a90 msgr2=0x7f60a019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.937+0000 7f609e7fc640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a0108a90 0x7f60a019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.937+0000 7f609e7fc640 1 -- 172.21.15.53:0/2892603976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a019efc0 con 0x7f60a0108140 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.937+0000 7f609f7fe640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a0108a90 0x7f60a019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.937+0000 7f609e7fc640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a0108140 0x7f60a01995f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f609800dbf0 tx=0x7f609800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.937+0000 7f6087fff640 1 -- 172.21.15.53:0/2892603976 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098017070 con 0x7f60a0108140 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.937+0000 7f60a55c1640 1 -- 172.21.15.53:0/2892603976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a019f2b0 con 0x7f60a0108140 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.937+0000 7f6087fff640 1 -- 172.21.15.53:0/2892603976 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f6098003de0 con 0x7f60a0108140 2024-08-31T05:56:31.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.937+0000 7f6087fff640 1 -- 172.21.15.53:0/2892603976 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098010460 con 0x7f60a0108140 2024-08-31T05:56:31.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.937+0000 7f60a55c1640 1 -- 172.21.15.53:0/2892603976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a01a5a10 con 0x7f60a0108140 2024-08-31T05:56:31.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.938+0000 7f60a55c1640 1 -- 172.21.15.53:0/2892603976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a0102c10 con 0x7f60a0108140 2024-08-31T05:56:31.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.941+0000 7f6087fff640 1 -- 172.21.15.53:0/2892603976 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f60980040b0 con 0x7f60a0108140 2024-08-31T05:56:31.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.942+0000 7f6087fff640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60880b4af0 0x7f60880b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:31.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.942+0000 7f6087fff640 1 -- 172.21.15.53:0/2892603976 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f60980e31f0 con 0x7f60a0108140 2024-08-31T05:56:31.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.943+0000 7f609effd640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60880b4af0 0x7f60880b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:31.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.943+0000 7f609effd640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60880b4af0 0x7f60880b7000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6090005fd0 tx=0x7f609000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:31.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:31.947+0000 7f6087fff640 1 -- 172.21.15.53:0/2892603976 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f60980abf20 con 0x7f60a0108140 2024-08-31T05:56:32.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.135+0000 7f60a55c1640 1 -- 172.21.15.53:0/2892603976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f60a010a880 con 0x7f60a0108140 2024-08-31T05:56:32.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.139+0000 7f6087fff640 1 -- 172.21.15.53:0/2892603976 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v27)=0 v27) ==== 129+0+0 (secure 0 0 0) 0x7f60980ab820 con 0x7f60a0108140 2024-08-31T05:56:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 -- 172.21.15.53:0/2892603976 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60880b4af0 msgr2=0x7f60880b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60880b4af0 0x7f60880b7000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6090005fd0 tx=0x7f609000b390 comp rx=0 tx=0).stop 2024-08-31T05:56:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 -- 172.21.15.53:0/2892603976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a0108140 msgr2=0x7f60a01995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a0108140 0x7f60a01995f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f609800dbf0 tx=0x7f609800b630 comp rx=0 tx=0).stop 2024-08-31T05:56:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 -- 172.21.15.53:0/2892603976 shutdown_connections 2024-08-31T05:56:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60880b4af0 0x7f60880b7000 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a0108a90 0x7f60a019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a0108140 0x7f60a01995f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:32.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 --2- 172.21.15.53:0/2892603976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a0102800 0x7f60a0199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:32.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 -- 172.21.15.53:0/2892603976 >> 172.21.15.53:0/2892603976 conn(0x7f60a00794d0 msgr2=0x7f60a01042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:32.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 -- 172.21.15.53:0/2892603976 shutdown_connections 2024-08-31T05:56:32.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:32.142+0000 7f60a55c1640 1 -- 172.21.15.53:0/2892603976 wait complete. 2024-08-31T05:56:33.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.276+0000 7f92eb05e640 1 -- 172.21.15.53:0/3629541300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e4103930 msgr2=0x7f92e4103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:33.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.276+0000 7f92eb05e640 1 --2- 172.21.15.53:0/3629541300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e4103930 0x7f92e4103d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009900 tx=0x7f92d802a410 comp rx=0 tx=0).stop 2024-08-31T05:56:33.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.276+0000 7f92eb05e640 1 -- 172.21.15.53:0/3629541300 shutdown_connections 2024-08-31T05:56:33.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.276+0000 7f92eb05e640 1 --2- 172.21.15.53:0/3629541300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92e4109bc0 0x7f92e41103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.276+0000 7f92eb05e640 1 --2- 172.21.15.53:0/3629541300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92e4109270 0x7f92e4109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.276+0000 7f92eb05e640 1 --2- 172.21.15.53:0/3629541300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e4103930 0x7f92e4103d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.276+0000 7f92eb05e640 1 -- 172.21.15.53:0/3629541300 >> 172.21.15.53:0/3629541300 conn(0x7f92e40ff3a0 msgr2=0x7f92e41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:33.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.276+0000 7f92eb05e640 1 -- 172.21.15.53:0/3629541300 shutdown_connections 2024-08-31T05:56:33.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.276+0000 7f92eb05e640 1 -- 172.21.15.53:0/3629541300 wait complete. 2024-08-31T05:56:33.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.277+0000 7f92eb05e640 1 Processor -- start 2024-08-31T05:56:33.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.277+0000 7f92eb05e640 1 -- start start 2024-08-31T05:56:33.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.277+0000 7f92eb05e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e4103930 0x7f92e419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:33.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.277+0000 7f92eb05e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92e4109270 0x7f92e419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:33.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.277+0000 7f92eb05e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92e4109bc0 0x7f92e419f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:33.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.277+0000 7f92eb05e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f92e4113610 con 0x7f92e4103930 2024-08-31T05:56:33.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.277+0000 7f92eb05e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f92e4113490 con 0x7f92e4109270 2024-08-31T05:56:33.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.277+0000 7f92eb05e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f92e4113790 con 0x7f92e4109bc0 2024-08-31T05:56:33.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e8dfa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e4103930 0x7f92e419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:33.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e8dfa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e4103930 0x7f92e419a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43966/0 (socket says 172.21.15.53:43966) 2024-08-31T05:56:33.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e8dfa640 1 -- 172.21.15.53:0/2399689504 learned_addr learned my addr 172.21.15.53:0/2399689504 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:33.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e3fff640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92e4109270 0x7f92e419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:33.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e95fb640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92e4109bc0 0x7f92e419f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:33.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e8dfa640 1 -- 172.21.15.53:0/2399689504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92e4109bc0 msgr2=0x7f92e419f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:33.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e8dfa640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92e4109bc0 0x7f92e419f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e8dfa640 1 -- 172.21.15.53:0/2399689504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92e4109270 msgr2=0x7f92e419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:33.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e8dfa640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92e4109270 0x7f92e419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e8dfa640 1 -- 172.21.15.53:0/2399689504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e41a0050 con 0x7f92e4103930 2024-08-31T05:56:33.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e8dfa640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e4103930 0x7f92e419a0e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f92d8006010 tx=0x7f92d8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:33.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e1ffb640 1 -- 172.21.15.53:0/2399689504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d803f070 con 0x7f92e4103930 2024-08-31T05:56:33.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e1ffb640 1 -- 172.21.15.53:0/2399689504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f92d803bce0 con 0x7f92e4103930 2024-08-31T05:56:33.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92eb05e640 1 -- 172.21.15.53:0/2399689504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e41a02e0 con 0x7f92e4103930 2024-08-31T05:56:33.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.278+0000 7f92e1ffb640 1 -- 172.21.15.53:0/2399689504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8035030 con 0x7f92e4103930 2024-08-31T05:56:33.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.279+0000 7f92eb05e640 1 -- 172.21.15.53:0/2399689504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e41a6aa0 con 0x7f92e4103930 2024-08-31T05:56:33.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.279+0000 7f92eb05e640 1 -- 172.21.15.53:0/2399689504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e4104bb0 con 0x7f92e4103930 2024-08-31T05:56:33.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.281+0000 7f92e1ffb640 1 -- 172.21.15.53:0/2399689504 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f92d8042070 con 0x7f92e4103930 2024-08-31T05:56:33.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.282+0000 7f92e1ffb640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f92d40b4b70 0x7f92d40b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:33.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.282+0000 7f92e3fff640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f92d40b4b70 0x7f92d40b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:33.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.282+0000 7f92e1ffb640 1 -- 172.21.15.53:0/2399689504 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f92d81040f0 con 0x7f92e4103930 2024-08-31T05:56:33.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.282+0000 7f92e3fff640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f92d40b4b70 0x7f92d40b7080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f92e4108ef0 tx=0x7f92d000b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:33.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.285+0000 7f92e1ffb640 1 -- 172.21.15.53:0/2399689504 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f92d80cc7d0 con 0x7f92e4103930 2024-08-31T05:56:33.387 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:33 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2892603976' entity='client.admin' 2024-08-31T05:56:33.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:33 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2892603976' entity='client.admin' 2024-08-31T05:56:33.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.474+0000 7f92eb05e640 1 -- 172.21.15.53:0/2399689504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f92e4103d40 con 0x7f92e4103930 2024-08-31T05:56:33.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.478+0000 7f92e1ffb640 1 -- 172.21.15.53:0/2399689504 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v28)=0 v28) ==== 123+0+0 (secure 0 0 0) 0x7f92e4103d40 con 0x7f92e4103930 2024-08-31T05:56:33.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.479+0000 7f92e1ffb640 1 -- 172.21.15.53:0/2399689504 <== mon.0 v2:172.21.15.53:3300/0 8 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92d80cc2e0 con 0x7f92e4103930 2024-08-31T05:56:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 -- 172.21.15.53:0/2399689504 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f92d40b4b70 msgr2=0x7f92d40b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f92d40b4b70 0x7f92d40b7080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f92e4108ef0 tx=0x7f92d000b410 comp rx=0 tx=0).stop 2024-08-31T05:56:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 -- 172.21.15.53:0/2399689504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e4103930 msgr2=0x7f92e419a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e4103930 0x7f92e419a0e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f92d8006010 tx=0x7f92d8003c80 comp rx=0 tx=0).stop 2024-08-31T05:56:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 -- 172.21.15.53:0/2399689504 shutdown_connections 2024-08-31T05:56:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f92d40b4b70 0x7f92d40b7080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92e4109bc0 0x7f92e419f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92e4109270 0x7f92e419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 --2- 172.21.15.53:0/2399689504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e4103930 0x7f92e419a0e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 -- 172.21.15.53:0/2399689504 >> 172.21.15.53:0/2399689504 conn(0x7f92e40ff3a0 msgr2=0x7f92e41017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:33.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f3f655ea640 1 -- 172.21.15.53:0/3790520308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f6010dbb0 msgr2=0x7f3f601100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:33.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f3f655ea640 1 --2- 172.21.15.53:0/3790520308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f6010dbb0 0x7f3f601100a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009900 tx=0x7f3f5802a410 comp rx=0 tx=0).stop 2024-08-31T05:56:33.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f3f655ea640 1 -- 172.21.15.53:0/3790520308 shutdown_connections 2024-08-31T05:56:33.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f3f655ea640 1 --2- 172.21.15.53:0/3790520308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f6010dbb0 0x7f3f601100a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f3f655ea640 1 --2- 172.21.15.53:0/3790520308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f601050a0 0x7f3f6010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f3f655ea640 1 --2- 172.21.15.53:0/3790520308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f60104750 0x7f3f60104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f3f655ea640 1 -- 172.21.15.53:0/3790520308 >> 172.21.15.53:0/3790520308 conn(0x7f3f600794d0 msgr2=0x7f3f600798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:33.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f3f655ea640 1 -- 172.21.15.53:0/3790520308 shutdown_connections 2024-08-31T05:56:33.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f3f655ea640 1 -- 172.21.15.53:0/3790520308 wait complete. 2024-08-31T05:56:33.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 -- 172.21.15.53:0/2399689504 shutdown_connections 2024-08-31T05:56:33.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.481+0000 7f92eb05e640 1 -- 172.21.15.53:0/2399689504 wait complete. 2024-08-31T05:56:33.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f655ea640 1 Processor -- start 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f655ea640 1 -- start start 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f655ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f60104750 0x7f3f6019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f655ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f601050a0 0x7f3f6019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f655ea640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f6010dbb0 0x7f3f6019f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f655ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3f601136c0 con 0x7f3f601050a0 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f655ea640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60113540 con 0x7f3f60104750 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f655ea640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60113840 con 0x7f3f6010dbb0 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f5e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f601050a0 0x7f3f6019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f5e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f601050a0 0x7f3f6019a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43990/0 (socket says 172.21.15.53:43990) 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f5e7fc640 1 -- 172.21.15.53:0/3319779347 learned_addr learned my addr 172.21.15.53:0/3319779347 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f5f7fe640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f6010dbb0 0x7f3f6019f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:33.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.482+0000 7f3f5effd640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f60104750 0x7f3f6019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.483+0000 7f3f5e7fc640 1 -- 172.21.15.53:0/3319779347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f6010dbb0 msgr2=0x7f3f6019f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.483+0000 7f3f5e7fc640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f6010dbb0 0x7f3f6019f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.483+0000 7f3f5e7fc640 1 -- 172.21.15.53:0/3319779347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f60104750 msgr2=0x7f3f6019a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.483+0000 7f3f5e7fc640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f60104750 0x7f3f6019a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.483+0000 7f3f5e7fc640 1 -- 172.21.15.53:0/3319779347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f601a0060 con 0x7f3f601050a0 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.483+0000 7f3f5e7fc640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f601050a0 0x7f3f6019a690 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800e9f0 tx=0x7f3f4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.483+0000 7f3f57fff640 1 -- 172.21.15.53:0/3319779347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800ccc0 con 0x7f3f601050a0 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.483+0000 7f3f655ea640 1 -- 172.21.15.53:0/3319779347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f601a0350 con 0x7f3f601050a0 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.483+0000 7f3f57fff640 1 -- 172.21.15.53:0/3319779347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f480108c0 con 0x7f3f601050a0 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.483+0000 7f3f57fff640 1 -- 172.21.15.53:0/3319779347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48018660 con 0x7f3f601050a0 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.483+0000 7f3f655ea640 1 -- 172.21.15.53:0/3319779347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f601a6ab0 con 0x7f3f601050a0 2024-08-31T05:56:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.484+0000 7f3f655ea640 1 -- 172.21.15.53:0/3319779347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f60104b60 con 0x7f3f601050a0 2024-08-31T05:56:33.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.487+0000 7f3f57fff640 1 -- 172.21.15.53:0/3319779347 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f3f48010430 con 0x7f3f601050a0 2024-08-31T05:56:33.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.487+0000 7f3f57fff640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3f4c0b4af0 0x7f3f4c0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:33.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.488+0000 7f3f57fff640 1 -- 172.21.15.53:0/3319779347 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3f480e3df0 con 0x7f3f601050a0 2024-08-31T05:56:33.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.488+0000 7f3f5effd640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3f4c0b4af0 0x7f3f4c0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:33.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.488+0000 7f3f5effd640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3f4c0b4af0 0x7f3f4c0b7000 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3f6006ba00 tx=0x7f3f50009670 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:33.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.491+0000 7f3f57fff640 1 -- 172.21.15.53:0/3319779347 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3f480ac430 con 0x7f3f601050a0 2024-08-31T05:56:33.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:33 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2892603976' entity='client.admin' 2024-08-31T05:56:33.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.681+0000 7f3f655ea640 1 -- 172.21.15.53:0/3319779347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f3f6019b220 con 0x7f3f601050a0 2024-08-31T05:56:33.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.685+0000 7f3f57fff640 1 -- 172.21.15.53:0/3319779347 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f3f480b0bf0 con 0x7f3f601050a0 2024-08-31T05:56:33.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 -- 172.21.15.53:0/3319779347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3f4c0b4af0 msgr2=0x7f3f4c0b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:33.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3f4c0b4af0 0x7f3f4c0b7000 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3f6006ba00 tx=0x7f3f50009670 comp rx=0 tx=0).stop 2024-08-31T05:56:33.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 -- 172.21.15.53:0/3319779347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f601050a0 msgr2=0x7f3f6019a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:33.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f601050a0 0x7f3f6019a690 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800e9f0 tx=0x7f3f4800eeb0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 -- 172.21.15.53:0/3319779347 shutdown_connections 2024-08-31T05:56:33.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3f4c0b4af0 0x7f3f4c0b7000 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f6010dbb0 0x7f3f6019f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f601050a0 0x7f3f6019a690 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 --2- 172.21.15.53:0/3319779347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f60104750 0x7f3f6019a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:33.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 -- 172.21.15.53:0/3319779347 >> 172.21.15.53:0/3319779347 conn(0x7f3f600794d0 msgr2=0x7f3f60100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:33.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 -- 172.21.15.53:0/3319779347 shutdown_connections 2024-08-31T05:56:33.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:33.687+0000 7f3f655ea640 1 -- 172.21.15.53:0/3319779347 wait complete. 2024-08-31T05:56:34.304 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi053') 2024-08-31T05:56:34.304 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi053') 2024-08-31T05:56:34.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:34 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2399689504' entity='client.admin' 2024-08-31T05:56:34.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:34 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3319779347' entity='client.admin' 2024-08-31T05:56:34.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:34 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2399689504' entity='client.admin' 2024-08-31T05:56:34.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:34 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3319779347' entity='client.admin' 2024-08-31T05:56:34.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:34 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2399689504' entity='client.admin' 2024-08-31T05:56:34.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:34 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3319779347' entity='client.admin' 2024-08-31T05:56:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.528+0000 7f9141231640 1 -- 172.21.15.53:0/1859637678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c108a90 msgr2=0x7f913c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.528+0000 7f9141231640 1 --2- 172.21.15.53:0/1859637678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c108a90 0x7f913c10f2c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9134009ca0 tx=0x7f913402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:56:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.528+0000 7f9141231640 1 -- 172.21.15.53:0/1859637678 shutdown_connections 2024-08-31T05:56:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.528+0000 7f9141231640 1 --2- 172.21.15.53:0/1859637678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c108a90 0x7f913c10f2c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.528+0000 7f9141231640 1 --2- 172.21.15.53:0/1859637678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f913c108140 0x7f913c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.528+0000 7f9141231640 1 --2- 172.21.15.53:0/1859637678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f913c102800 0x7f913c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.528+0000 7f9141231640 1 -- 172.21.15.53:0/1859637678 >> 172.21.15.53:0/1859637678 conn(0x7f913c0794d0 msgr2=0x7f913c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.528+0000 7f9141231640 1 -- 172.21.15.53:0/1859637678 shutdown_connections 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.528+0000 7f9141231640 1 -- 172.21.15.53:0/1859637678 wait complete. 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.529+0000 7f9141231640 1 Processor -- start 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.529+0000 7f9141231640 1 -- start start 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.529+0000 7f9141231640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c102800 0x7f913c19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.529+0000 7f9141231640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f913c108140 0x7f913c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.529+0000 7f9141231640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f913c108a90 0x7f913c19f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.529+0000 7f9141231640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f913c1125f0 con 0x7f913c102800 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.529+0000 7f9141231640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f913c112470 con 0x7f913c108140 2024-08-31T05:56:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.529+0000 7f9141231640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f913c112770 con 0x7f913c108a90 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.529+0000 7f913ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c102800 0x7f913c19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.529+0000 7f913ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c102800 0x7f913c19a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44010/0 (socket says 172.21.15.53:44010) 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.529+0000 7f913ad9d640 1 -- 172.21.15.53:0/3258019643 learned_addr learned my addr 172.21.15.53:0/3258019643 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f913a59c640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f913c108140 0x7f913c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f913b59e640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f913c108a90 0x7f913c19f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f913ad9d640 1 -- 172.21.15.53:0/3258019643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f913c108a90 msgr2=0x7f913c19f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f913ad9d640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f913c108a90 0x7f913c19f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f913ad9d640 1 -- 172.21.15.53:0/3258019643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f913c108140 msgr2=0x7f913c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f913ad9d640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f913c108140 0x7f913c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f913ad9d640 1 -- 172.21.15.53:0/3258019643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913c19ff80 con 0x7f913c102800 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f913ad9d640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c102800 0x7f913c19a0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f912c00d950 tx=0x7f912c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f9123fff640 1 -- 172.21.15.53:0/3258019643 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c017070 con 0x7f913c102800 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f9141231640 1 -- 172.21.15.53:0/3258019643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913c1a0270 con 0x7f913c102800 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f9123fff640 1 -- 172.21.15.53:0/3258019643 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f912c009c30 con 0x7f913c102800 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f9123fff640 1 -- 172.21.15.53:0/3258019643 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c00f620 con 0x7f913c102800 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.530+0000 7f9141231640 1 -- 172.21.15.53:0/3258019643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f913c1a6a90 con 0x7f913c102800 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.531+0000 7f9141231640 1 -- 172.21.15.53:0/3258019643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f913c102c10 con 0x7f913c102800 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.533+0000 7f9123fff640 1 -- 172.21.15.53:0/3258019643 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f912c005030 con 0x7f913c102800 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.533+0000 7f9123fff640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91240b4b20 0x7f91240b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.534+0000 7f9123fff640 1 -- 172.21.15.53:0/3258019643 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f912c0e3230 con 0x7f913c102800 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.534+0000 7f913a59c640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91240b4b20 0x7f91240b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.534+0000 7f913a59c640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91240b4b20 0x7f91240b7030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9130005e10 tx=0x7f9130005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.537+0000 7f9123fff640 1 -- 172.21.15.53:0/3258019643 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f912c0abf60 con 0x7f913c102800 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.723+0000 7f9141231640 1 -- 172.21.15.53:0/3258019643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f913c10b890 con 0x7f913c102800 2024-08-31T05:56:35.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.728+0000 7f9123fff640 1 -- 172.21.15.53:0/3258019643 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v30)=0 v30) ==== 120+0+0 (secure 0 0 0) 0x7f912c009de0 con 0x7f913c102800 2024-08-31T05:56:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.730+0000 7f9141231640 1 -- 172.21.15.53:0/3258019643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91240b4b20 msgr2=0x7f91240b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.730+0000 7f9141231640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91240b4b20 0x7f91240b7030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9130005e10 tx=0x7f9130005da0 comp rx=0 tx=0).stop 2024-08-31T05:56:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.730+0000 7f9141231640 1 -- 172.21.15.53:0/3258019643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c102800 msgr2=0x7f913c19a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.730+0000 7f9141231640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c102800 0x7f913c19a0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f912c00d950 tx=0x7f912c00de10 comp rx=0 tx=0).stop 2024-08-31T05:56:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.731+0000 7f9141231640 1 -- 172.21.15.53:0/3258019643 shutdown_connections 2024-08-31T05:56:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.731+0000 7f9141231640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91240b4b20 0x7f91240b7030 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.731+0000 7f9141231640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f913c108a90 0x7f913c19f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.731+0000 7f9141231640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f913c108140 0x7f913c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:35.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.731+0000 7f9141231640 1 --2- 172.21.15.53:0/3258019643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f913c102800 0x7f913c19a0d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:35.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.731+0000 7f9141231640 1 -- 172.21.15.53:0/3258019643 >> 172.21.15.53:0/3258019643 conn(0x7f913c0794d0 msgr2=0x7f913c06af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:35.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.731+0000 7f9141231640 1 -- 172.21.15.53:0/3258019643 shutdown_connections 2024-08-31T05:56:35.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:34.731+0000 7f9141231640 1 -- 172.21.15.53:0/3258019643 wait complete. 2024-08-31T05:56:35.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:35 smithi053 ceph-mon[18924]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:35.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:35 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3258019643' entity='client.admin' 2024-08-31T05:56:35.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:35 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3542612124' entity='client.admin' 2024-08-31T05:56:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:35 smithi130 ceph-mon[22266]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:35 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3258019643' entity='client.admin' 2024-08-31T05:56:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:35 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3542612124' entity='client.admin' 2024-08-31T05:56:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:35 smithi153 ceph-mon[22320]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:35 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3258019643' entity='client.admin' 2024-08-31T05:56:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:35 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3542612124' entity='client.admin' 2024-08-31T05:56:36.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.038+0000 7fa307690640 1 -- 172.21.15.53:0/2627930995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa300108160 msgr2=0x7fa300108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:36.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.038+0000 7fa307690640 1 --2- 172.21.15.53:0/2627930995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa300108160 0x7fa300108570 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009900 tx=0x7fa2f002a410 comp rx=0 tx=0).stop 2024-08-31T05:56:36.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.038+0000 7fa307690640 1 -- 172.21.15.53:0/2627930995 shutdown_connections 2024-08-31T05:56:36.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.038+0000 7fa307690640 1 --2- 172.21.15.53:0/2627930995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa300108ab0 0x7fa30010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:36.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.038+0000 7fa307690640 1 --2- 172.21.15.53:0/2627930995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa300108160 0x7fa300108570 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:36.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.038+0000 7fa307690640 1 --2- 172.21.15.53:0/2627930995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa300102870 0x7fa300102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:36.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.038+0000 7fa307690640 1 -- 172.21.15.53:0/2627930995 >> 172.21.15.53:0/2627930995 conn(0x7fa300079470 msgr2=0x7fa300079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:36.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.038+0000 7fa307690640 1 -- 172.21.15.53:0/2627930995 shutdown_connections 2024-08-31T05:56:36.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.038+0000 7fa307690640 1 -- 172.21.15.53:0/2627930995 wait complete. 2024-08-31T05:56:36.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa307690640 1 Processor -- start 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa307690640 1 -- start start 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa307690640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa300102870 0x7fa3001990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa307690640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa300108160 0x7fa300199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa307690640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa300108ab0 0x7fa30019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa307690640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa3001125f0 con 0x7fa300108160 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa307690640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa300112470 con 0x7fa300108ab0 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa307690640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa300112770 con 0x7fa300102870 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa304c2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa300108160 0x7fa300199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa304c2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa300108160 0x7fa300199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44028/0 (socket says 172.21.15.53:44028) 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa304c2b640 1 -- 172.21.15.53:0/3542612124 learned_addr learned my addr 172.21.15.53:0/3542612124 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa30542c640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa300102870 0x7fa3001990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:36.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa305c2d640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa300108ab0 0x7fa30019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa304c2b640 1 -- 172.21.15.53:0/3542612124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa300102870 msgr2=0x7fa3001990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa304c2b640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa300102870 0x7fa3001990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa304c2b640 1 -- 172.21.15.53:0/3542612124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa300108ab0 msgr2=0x7fa30019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa304c2b640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa300108ab0 0x7fa30019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa304c2b640 1 -- 172.21.15.53:0/3542612124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30019f050 con 0x7fa300108160 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa305c2d640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa300108ab0 0x7fa30019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.039+0000 7fa304c2b640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa300108160 0x7fa300199680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0005940 tx=0x7fa2f0005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.040+0000 7fa2f67fc640 1 -- 172.21.15.53:0/3542612124 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f003f030 con 0x7fa300108160 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.040+0000 7fa2f67fc640 1 -- 172.21.15.53:0/3542612124 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2f00043d0 con 0x7fa300108160 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.040+0000 7fa307690640 1 -- 172.21.15.53:0/3542612124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30019f2e0 con 0x7fa300108160 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.040+0000 7fa2f67fc640 1 -- 172.21.15.53:0/3542612124 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0035070 con 0x7fa300108160 2024-08-31T05:56:36.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.040+0000 7fa307690640 1 -- 172.21.15.53:0/3542612124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa30019f730 con 0x7fa300108160 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.041+0000 7fa307690640 1 -- 172.21.15.53:0/3542612124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa300103aa0 con 0x7fa300108160 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.042+0000 7fa2f67fc640 1 -- 172.21.15.53:0/3542612124 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fa2f0042030 con 0x7fa300108160 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.044+0000 7fa2f67fc640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2ec0b4af0 0x7fa2ec0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.044+0000 7fa30542c640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2ec0b4af0 0x7fa2ec0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.044+0000 7fa2f67fc640 1 -- 172.21.15.53:0/3542612124 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa2f0103d10 con 0x7fa300108160 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.044+0000 7fa30542c640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2ec0b4af0 0x7fa2ec0b7000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009bd0 tx=0x7fa2fc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.047+0000 7fa2f67fc640 1 -- 172.21.15.53:0/3542612124 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa2f00cca40 con 0x7fa300108160 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.232+0000 7fa307690640 1 -- 172.21.15.53:0/3542612124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fa300102c80 con 0x7fa300108160 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.237+0000 7fa2f67fc640 1 -- 172.21.15.53:0/3542612124 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7fa2f00cc340 con 0x7fa300108160 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 -- 172.21.15.53:0/3542612124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2ec0b4af0 msgr2=0x7fa2ec0b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2ec0b4af0 0x7fa2ec0b7000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009bd0 tx=0x7fa2fc005f90 comp rx=0 tx=0).stop 2024-08-31T05:56:36.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 -- 172.21.15.53:0/3542612124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa300108160 msgr2=0x7fa300199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:36.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa300108160 0x7fa300199680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0005940 tx=0x7fa2f0005e10 comp rx=0 tx=0).stop 2024-08-31T05:56:36.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 -- 172.21.15.53:0/3542612124 shutdown_connections 2024-08-31T05:56:36.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2ec0b4af0 0x7fa2ec0b7000 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:36.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa300108ab0 0x7fa30019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:36.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa300108160 0x7fa300199680 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:36.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 --2- 172.21.15.53:0/3542612124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa300102870 0x7fa3001990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:36.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 -- 172.21.15.53:0/3542612124 >> 172.21.15.53:0/3542612124 conn(0x7fa300079470 msgr2=0x7fa300106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:36.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 -- 172.21.15.53:0/3542612124 shutdown_connections 2024-08-31T05:56:36.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:35.239+0000 7fa307690640 1 -- 172.21.15.53:0/3542612124 wait complete. 2024-08-31T05:56:37.847 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:37 smithi053 ceph-mon[18924]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:37 smithi130 ceph-mon[22266]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:38.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:37 smithi153 ceph-mon[22320]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:39.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:39 smithi053 ceph-mon[18924]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:39 smithi130 ceph-mon[22266]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:39 smithi153 ceph-mon[22320]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.242+0000 7fc3282dd640 1 -- 172.21.15.53:0/1142912570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc320108a90 msgr2=0x7fc32010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.242+0000 7fc3282dd640 1 --2- 172.21.15.53:0/1142912570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc320108a90 0x7fc32010f2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc318009ca0 tx=0x7fc31802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.242+0000 7fc3282dd640 1 -- 172.21.15.53:0/1142912570 shutdown_connections 2024-08-31T05:56:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.242+0000 7fc3282dd640 1 --2- 172.21.15.53:0/1142912570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc320108a90 0x7fc32010f2c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.242+0000 7fc3282dd640 1 --2- 172.21.15.53:0/1142912570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc320108140 0x7fc320108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.242+0000 7fc3282dd640 1 --2- 172.21.15.53:0/1142912570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc320102800 0x7fc320102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.242+0000 7fc3282dd640 1 -- 172.21.15.53:0/1142912570 >> 172.21.15.53:0/1142912570 conn(0x7fc3200794d0 msgr2=0x7fc3200798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.243+0000 7fc3282dd640 1 -- 172.21.15.53:0/1142912570 shutdown_connections 2024-08-31T05:56:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.243+0000 7fc3282dd640 1 -- 172.21.15.53:0/1142912570 wait complete. 2024-08-31T05:56:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.243+0000 7fc3282dd640 1 Processor -- start 2024-08-31T05:56:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.243+0000 7fc3282dd640 1 -- start start 2024-08-31T05:56:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.243+0000 7fc3282dd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc320102800 0x7fc32019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.243+0000 7fc3282dd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc320108140 0x7fc32019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.243+0000 7fc3282dd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc320108a90 0x7fc32019f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.243+0000 7fc3282dd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc320112610 con 0x7fc320108140 2024-08-31T05:56:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.243+0000 7fc3282dd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc320112490 con 0x7fc320102800 2024-08-31T05:56:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.243+0000 7fc3282dd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc320112790 con 0x7fc320108a90 2024-08-31T05:56:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc325878640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc320108140 0x7fc32019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc325878640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc320108140 0x7fc32019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44050/0 (socket says 172.21.15.53:44050) 2024-08-31T05:56:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc325878640 1 -- 172.21.15.53:0/395980585 learned_addr learned my addr 172.21.15.53:0/395980585 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc326079640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc320102800 0x7fc32019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc32687a640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc320108a90 0x7fc32019f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc325878640 1 -- 172.21.15.53:0/395980585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc320108a90 msgr2=0x7fc32019f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc325878640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc320108a90 0x7fc32019f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc325878640 1 -- 172.21.15.53:0/395980585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc320102800 msgr2=0x7fc32019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc325878640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc320102800 0x7fc32019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc325878640 1 -- 172.21.15.53:0/395980585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3201a00a0 con 0x7fc320108140 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc325878640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc320108140 0x7fc32019a6d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc31400e9c0 tx=0x7fc31400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc3137fe640 1 -- 172.21.15.53:0/395980585 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31400cd80 con 0x7fc320108140 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc3137fe640 1 -- 172.21.15.53:0/395980585 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3140054b0 con 0x7fc320108140 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc3282dd640 1 -- 172.21.15.53:0/395980585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3201a0390 con 0x7fc320108140 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc3137fe640 1 -- 172.21.15.53:0/395980585 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314010430 con 0x7fc320108140 2024-08-31T05:56:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.244+0000 7fc3282dd640 1 -- 172.21.15.53:0/395980585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3201a6af0 con 0x7fc320108140 2024-08-31T05:56:41.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.246+0000 7fc3282dd640 1 -- 172.21.15.53:0/395980585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc320102c10 con 0x7fc320108140 2024-08-31T05:56:41.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.247+0000 7fc3137fe640 1 -- 172.21.15.53:0/395980585 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fc314004f20 con 0x7fc320108140 2024-08-31T05:56:41.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.248+0000 7fc3137fe640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc30c0b4b70 0x7fc30c0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:41.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.248+0000 7fc326079640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc30c0b4b70 0x7fc30c0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:41.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.248+0000 7fc3137fe640 1 -- 172.21.15.53:0/395980585 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc3140e3be0 con 0x7fc320108140 2024-08-31T05:56:41.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.248+0000 7fc326079640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc30c0b4b70 0x7fc30c0b7080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc31c005fd0 tx=0x7fc31c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:41.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.252+0000 7fc3137fe640 1 -- 172.21.15.53:0/395980585 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc3140ac870 con 0x7fc320108140 2024-08-31T05:56:41.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:41.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:41.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:41 smithi053 ceph-mon[18924]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:56:41.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:41.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:41.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:41.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:41 smithi053 ceph-mon[18924]: Reconfiguring daemon mon.b on smithi130 2024-08-31T05:56:41.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:41 smithi053 ceph-mon[18924]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:41.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:41.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:41.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:41 smithi153 ceph-mon[22320]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:56:41.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:41.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:41.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:41.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:41 smithi153 ceph-mon[22320]: Reconfiguring daemon mon.b on smithi130 2024-08-31T05:56:41.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:41 smithi153 ceph-mon[22320]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:41.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:41.427 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:41.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:41 smithi130 ceph-mon[22266]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:56:41.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:41.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:41.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:41.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:41 smithi130 ceph-mon[22266]: Reconfiguring daemon mon.b on smithi130 2024-08-31T05:56:41.428 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:41 smithi130 ceph-mon[22266]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:41.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.440+0000 7fc3282dd640 1 -- 172.21.15.53:0/395980585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fc3201a6e30 con 0x7fc320108140 2024-08-31T05:56:41.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.445+0000 7fc3137fe640 1 -- 172.21.15.53:0/395980585 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v32)=0 v32) ==== 120+0+0 (secure 0 0 0) 0x7fc3140ac170 con 0x7fc320108140 2024-08-31T05:56:41.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.447+0000 7fc3282dd640 1 -- 172.21.15.53:0/395980585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc30c0b4b70 msgr2=0x7fc30c0b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:41.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.447+0000 7fc3282dd640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc30c0b4b70 0x7fc30c0b7080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc31c005fd0 tx=0x7fc31c00b390 comp rx=0 tx=0).stop 2024-08-31T05:56:41.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.448+0000 7fc3282dd640 1 -- 172.21.15.53:0/395980585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc320108140 msgr2=0x7fc32019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:41.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.448+0000 7fc3282dd640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc320108140 0x7fc32019a6d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc31400e9c0 tx=0x7fc31400ee80 comp rx=0 tx=0).stop 2024-08-31T05:56:41.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.448+0000 7fc3282dd640 1 -- 172.21.15.53:0/395980585 shutdown_connections 2024-08-31T05:56:41.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.448+0000 7fc3282dd640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc30c0b4b70 0x7fc30c0b7080 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.448+0000 7fc3282dd640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc320108a90 0x7fc32019f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.448+0000 7fc3282dd640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc320108140 0x7fc32019a6d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.448+0000 7fc3282dd640 1 --2- 172.21.15.53:0/395980585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc320102800 0x7fc32019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.448+0000 7fc3282dd640 1 -- 172.21.15.53:0/395980585 >> 172.21.15.53:0/395980585 conn(0x7fc3200794d0 msgr2=0x7fc3201017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:41.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.448+0000 7fc3282dd640 1 -- 172.21.15.53:0/395980585 shutdown_connections 2024-08-31T05:56:41.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.448+0000 7fc3282dd640 1 -- 172.21.15.53:0/395980585 wait complete. 2024-08-31T05:56:41.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.472+0000 7f88a333d640 1 -- 172.21.15.53:0/3141949825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f889c10df20 msgr2=0x7f889c10e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:41.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.472+0000 7f88a333d640 1 --2- 172.21.15.53:0/3141949825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f889c10df20 0x7f889c10e330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f888c009900 tx=0x7f888c02a410 comp rx=0 tx=0).stop 2024-08-31T05:56:41.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.472+0000 7f88a333d640 1 -- 172.21.15.53:0/3141949825 shutdown_connections 2024-08-31T05:56:41.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.472+0000 7f88a333d640 1 --2- 172.21.15.53:0/3141949825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c10e870 0x7f889c117270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.472+0000 7f88a333d640 1 --2- 172.21.15.53:0/3141949825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f889c10df20 0x7f889c10e330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.472+0000 7f88a333d640 1 --2- 172.21.15.53:0/3141949825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f889c10ac80 0x7f889c10b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.472+0000 7f88a333d640 1 -- 172.21.15.53:0/3141949825 >> 172.21.15.53:0/3141949825 conn(0x7f889c070c60 msgr2=0x7f889c071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:41.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.472+0000 7f88a333d640 1 -- 172.21.15.53:0/3141949825 shutdown_connections 2024-08-31T05:56:41.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.472+0000 7f88a333d640 1 -- 172.21.15.53:0/3141949825 wait complete. 2024-08-31T05:56:41.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.473+0000 7f88a333d640 1 Processor -- start 2024-08-31T05:56:41.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.473+0000 7f88a333d640 1 -- start start 2024-08-31T05:56:41.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a333d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f889c10ac80 0x7f889c1a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:41.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a333d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c10df20 0x7f889c1a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:41.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a333d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f889c10e870 0x7f889c1a2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:41.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a333d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f889c11a540 con 0x7f889c10ac80 2024-08-31T05:56:41.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a333d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f889c11a3c0 con 0x7f889c10e870 2024-08-31T05:56:41.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a333d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f889c11a6c0 con 0x7f889c10df20 2024-08-31T05:56:41.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a18da640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f889c10e870 0x7f889c1a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:41.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a10d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f889c10ac80 0x7f889c1a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:41.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a18da640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f889c10e870 0x7f889c1a2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43506/0 (socket says 172.21.15.53:43506) 2024-08-31T05:56:41.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a18da640 1 -- 172.21.15.53:0/3758242661 learned_addr learned my addr 172.21.15.53:0/3758242661 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:41.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a08d8640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c10df20 0x7f889c1a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:41.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a10d9640 1 -- 172.21.15.53:0/3758242661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c10df20 msgr2=0x7f889c1a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:41.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a10d9640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c10df20 0x7f889c1a1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a10d9640 1 -- 172.21.15.53:0/3758242661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f889c10e870 msgr2=0x7f889c1a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:41.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a10d9640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f889c10e870 0x7f889c1a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.474+0000 7f88a10d9640 1 -- 172.21.15.53:0/3758242661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c1b0c50 con 0x7f889c10ac80 2024-08-31T05:56:41.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.475+0000 7f88a18da640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f889c10e870 0x7f889c1a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:56:41.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.475+0000 7f88a10d9640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f889c10ac80 0x7f889c1a15d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f889800c970 tx=0x7f889800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:41.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.476+0000 7f88927fc640 1 -- 172.21.15.53:0/3758242661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898007bb0 con 0x7f889c10ac80 2024-08-31T05:56:41.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.476+0000 7f88927fc640 1 -- 172.21.15.53:0/3758242661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8898007d50 con 0x7f889c10ac80 2024-08-31T05:56:41.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.476+0000 7f88927fc640 1 -- 172.21.15.53:0/3758242661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88980186f0 con 0x7f889c10ac80 2024-08-31T05:56:41.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.476+0000 7f88a333d640 1 -- 172.21.15.53:0/3758242661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c1b0ee0 con 0x7f889c10ac80 2024-08-31T05:56:41.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.477+0000 7f88a333d640 1 -- 172.21.15.53:0/3758242661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c1b1390 con 0x7f889c10ac80 2024-08-31T05:56:41.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.478+0000 7f88a333d640 1 -- 172.21.15.53:0/3758242661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889c10b090 con 0x7f889c10ac80 2024-08-31T05:56:41.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.481+0000 7f88927fc640 1 -- 172.21.15.53:0/3758242661 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f889800f450 con 0x7f889c10ac80 2024-08-31T05:56:41.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.482+0000 7f88927fc640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88880b4cc0 0x7f88880b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:41.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.482+0000 7f88a08d8640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88880b4cc0 0x7f88880b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:41.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.483+0000 7f88927fc640 1 -- 172.21.15.53:0/3758242661 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f88980e3910 con 0x7f889c10ac80 2024-08-31T05:56:41.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.483+0000 7f88a08d8640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88880b4cc0 0x7f88880b71d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f888c02a930 tx=0x7f888c000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:41.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.484+0000 7f88927fc640 1 -- 172.21.15.53:0/3758242661 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8898014030 con 0x7f889c10ac80 2024-08-31T05:56:41.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.686+0000 7f88a333d640 1 -- 172.21.15.53:0/3758242661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f889c1b17e0 con 0x7f889c10ac80 2024-08-31T05:56:41.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.690+0000 7f88927fc640 1 -- 172.21.15.53:0/3758242661 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v33)=0 v33) ==== 115+0+0 (secure 0 0 0) 0x7f88980ac6a0 con 0x7f889c10ac80 2024-08-31T05:56:41.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.692+0000 7f88a333d640 1 -- 172.21.15.53:0/3758242661 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88880b4cc0 msgr2=0x7f88880b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:41.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.692+0000 7f88a333d640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88880b4cc0 0x7f88880b71d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f888c02a930 tx=0x7f888c000bc0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.692+0000 7f88a333d640 1 -- 172.21.15.53:0/3758242661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f889c10ac80 msgr2=0x7f889c1a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:41.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.692+0000 7f88a333d640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f889c10ac80 0x7f889c1a15d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f889800c970 tx=0x7f889800ce30 comp rx=0 tx=0).stop 2024-08-31T05:56:41.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.692+0000 7f88a333d640 1 -- 172.21.15.53:0/3758242661 shutdown_connections 2024-08-31T05:56:41.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.692+0000 7f88a333d640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88880b4cc0 0x7f88880b71d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.692+0000 7f88a333d640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f889c10e870 0x7f889c1a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.692+0000 7f88a333d640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f889c10df20 0x7f889c1a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.692+0000 7f88a333d640 1 --2- 172.21.15.53:0/3758242661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f889c10ac80 0x7f889c1a15d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:41.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.692+0000 7f88a333d640 1 -- 172.21.15.53:0/3758242661 >> 172.21.15.53:0/3758242661 conn(0x7f889c070c60 msgr2=0x7f889c072fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:41.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.693+0000 7f88a333d640 1 -- 172.21.15.53:0/3758242661 shutdown_connections 2024-08-31T05:56:41.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:41.693+0000 7f88a333d640 1 -- 172.21.15.53:0/3758242661 wait complete. 2024-08-31T05:56:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:42 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/395980585' entity='client.admin' 2024-08-31T05:56:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:42 smithi153 ceph-mon[22320]: Reconfiguring mon.c (monmap changed)... 2024-08-31T05:56:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:42.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:42.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:42.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:42 smithi153 ceph-mon[22320]: Reconfiguring daemon mon.c on smithi153 2024-08-31T05:56:42.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:42 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3758242661' entity='client.admin' 2024-08-31T05:56:42.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:42 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/395980585' entity='client.admin' 2024-08-31T05:56:42.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:42.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:42.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:42 smithi053 ceph-mon[18924]: Reconfiguring mon.c (monmap changed)... 2024-08-31T05:56:42.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:42.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:42.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:42.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:42 smithi053 ceph-mon[18924]: Reconfiguring daemon mon.c on smithi153 2024-08-31T05:56:42.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:42 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3758242661' entity='client.admin' 2024-08-31T05:56:42.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:42 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/395980585' entity='client.admin' 2024-08-31T05:56:42.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:42.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:42.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:42 smithi130 ceph-mon[22266]: Reconfiguring mon.c (monmap changed)... 2024-08-31T05:56:42.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:56:42.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:56:42.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:42.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:42 smithi130 ceph-mon[22266]: Reconfiguring daemon mon.c on smithi153 2024-08-31T05:56:42.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:42 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3758242661' entity='client.admin' 2024-08-31T05:56:43.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.165+0000 7f1cf727e640 1 -- 172.21.15.53:0/2670214137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf0109bc0 msgr2=0x7f1cf01103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:43.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.165+0000 7f1cf727e640 1 --2- 172.21.15.53:0/2670214137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf0109bc0 0x7f1cf01103f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009ca0 tx=0x7f1ce802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:56:43.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.165+0000 7f1cf727e640 1 -- 172.21.15.53:0/2670214137 shutdown_connections 2024-08-31T05:56:43.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.165+0000 7f1cf727e640 1 --2- 172.21.15.53:0/2670214137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf0109bc0 0x7f1cf01103f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:43.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.165+0000 7f1cf727e640 1 --2- 172.21.15.53:0/2670214137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cf0109270 0x7f1cf0109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.165+0000 7f1cf727e640 1 --2- 172.21.15.53:0/2670214137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1cf0103930 0x7f1cf0103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.165+0000 7f1cf727e640 1 -- 172.21.15.53:0/2670214137 >> 172.21.15.53:0/2670214137 conn(0x7f1cf00ff380 msgr2=0x7f1cf01017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.165+0000 7f1cf727e640 1 -- 172.21.15.53:0/2670214137 shutdown_connections 2024-08-31T05:56:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.165+0000 7f1cf727e640 1 -- 172.21.15.53:0/2670214137 wait complete. 2024-08-31T05:56:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf727e640 1 Processor -- start 2024-08-31T05:56:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf727e640 1 -- start start 2024-08-31T05:56:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf727e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cf0103930 0x7f1cf019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf727e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1cf0109270 0x7f1cf019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf727e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf0109bc0 0x7f1cf019f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf727e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0113780 con 0x7f1cf0109bc0 2024-08-31T05:56:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf727e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0113600 con 0x7f1cf0109270 2024-08-31T05:56:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf727e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0113900 con 0x7f1cf0103930 2024-08-31T05:56:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf581b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf0109bc0 0x7f1cf019f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf581b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf0109bc0 0x7f1cf019f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44060/0 (socket says 172.21.15.53:44060) 2024-08-31T05:56:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf581b640 1 -- 172.21.15.53:0/2160280625 learned_addr learned my addr 172.21.15.53:0/2160280625 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf501a640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cf0103930 0x7f1cf019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf4819640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1cf0109270 0x7f1cf019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf501a640 1 -- 172.21.15.53:0/2160280625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1cf0109270 msgr2=0x7f1cf019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf501a640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1cf0109270 0x7f1cf019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf501a640 1 -- 172.21.15.53:0/2160280625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf0109bc0 msgr2=0x7f1cf019f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf501a640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf0109bc0 0x7f1cf019f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.166+0000 7f1cf501a640 1 -- 172.21.15.53:0/2160280625 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf01a0080 con 0x7f1cf0103930 2024-08-31T05:56:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.167+0000 7f1cf501a640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cf0103930 0x7f1cf019a110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00d6d0 tx=0x7f1cec00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:43.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.167+0000 7f1ce67fc640 1 -- 172.21.15.53:0/2160280625 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec017070 con 0x7f1cf0103930 2024-08-31T05:56:43.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.167+0000 7f1ce67fc640 1 -- 172.21.15.53:0/2160280625 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cec009820 con 0x7f1cf0103930 2024-08-31T05:56:43.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.167+0000 7f1cf727e640 1 -- 172.21.15.53:0/2160280625 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf01a0370 con 0x7f1cf0103930 2024-08-31T05:56:43.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.168+0000 7f1ce67fc640 1 -- 172.21.15.53:0/2160280625 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec004bc0 con 0x7f1cf0103930 2024-08-31T05:56:43.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.168+0000 7f1cf727e640 1 -- 172.21.15.53:0/2160280625 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf01a6ad0 con 0x7f1cf0103930 2024-08-31T05:56:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.169+0000 7f1cf727e640 1 -- 172.21.15.53:0/2160280625 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf0103d40 con 0x7f1cf0103930 2024-08-31T05:56:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.170+0000 7f1ce67fc640 1 -- 172.21.15.53:0/2160280625 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f1cec005220 con 0x7f1cf0103930 2024-08-31T05:56:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.170+0000 7f1ce67fc640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1cdc0b4b70 0x7f1cdc0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.171+0000 7f1cf4819640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1cdc0b4b70 0x7f1cdc0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:43.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.171+0000 7f1ce67fc640 1 -- 172.21.15.53:0/2160280625 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1cec0e3080 con 0x7f1cf0103930 2024-08-31T05:56:43.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.171+0000 7f1cf4819640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1cdc0b4b70 0x7f1cdc0b7080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0108d20 tx=0x7f1ce0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:43.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.175+0000 7f1ce67fc640 1 -- 172.21.15.53:0/2160280625 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1cec0abd10 con 0x7f1cf0103930 2024-08-31T05:56:43.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.362+0000 7f1cf727e640 1 -- 172.21.15.53:0/2160280625 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1cf010b9b0 con 0x7f1cf0103930 2024-08-31T05:56:43.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.369+0000 7f1ce67fc640 1 -- 172.21.15.53:0/2160280625 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v34)=0 v34) ==== 121+0+0 (secure 0 0 0) 0x7f1cec0ab610 con 0x7f1cf0103930 2024-08-31T05:56:43.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.371+0000 7f1cf727e640 1 -- 172.21.15.53:0/2160280625 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1cdc0b4b70 msgr2=0x7f1cdc0b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.371+0000 7f1cf727e640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1cdc0b4b70 0x7f1cdc0b7080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0108d20 tx=0x7f1ce0005f90 comp rx=0 tx=0).stop 2024-08-31T05:56:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.371+0000 7f1cf727e640 1 -- 172.21.15.53:0/2160280625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cf0103930 msgr2=0x7f1cf019a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.371+0000 7f1cf727e640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cf0103930 0x7f1cf019a110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00d6d0 tx=0x7f1cec00db90 comp rx=0 tx=0).stop 2024-08-31T05:56:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.371+0000 7f1cf727e640 1 -- 172.21.15.53:0/2160280625 shutdown_connections 2024-08-31T05:56:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.371+0000 7f1cf727e640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1cdc0b4b70 0x7f1cdc0b7080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.371+0000 7f1cf727e640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf0109bc0 0x7f1cf019f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.371+0000 7f1cf727e640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1cf0109270 0x7f1cf019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.372+0000 7f1cf727e640 1 --2- 172.21.15.53:0/2160280625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cf0103930 0x7f1cf019a110 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.372+0000 7f1cf727e640 1 -- 172.21.15.53:0/2160280625 >> 172.21.15.53:0/2160280625 conn(0x7f1cf00ff380 msgr2=0x7f1cf01017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.372+0000 7f1cf727e640 1 -- 172.21.15.53:0/2160280625 shutdown_connections 2024-08-31T05:56:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:43.372+0000 7f1cf727e640 1 -- 172.21.15.53:0/2160280625 wait complete. 2024-08-31T05:56:43.552 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.552 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.552 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.552 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.552 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.553 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.553 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.553 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.553 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.553 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.553 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.553 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.553 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.554 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.554 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.554 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.554 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi053') 2024-08-31T05:56:43.554 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi053') 2024-08-31T05:56:44.079 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:43 smithi053 ceph-mon[18924]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:44.079 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:44.079 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:44.079 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:44.079 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:44.079 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:44.079 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:44.079 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:43 smithi053 ceph-mon[18924]: from='client.? ' entity='client.admin' 2024-08-31T05:56:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:43 smithi130 ceph-mon[22266]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:44.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:44.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:44.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:43 smithi130 ceph-mon[22266]: from='client.? ' entity='client.admin' 2024-08-31T05:56:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:43 smithi153 ceph-mon[22320]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:56:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:56:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:56:44.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:43 smithi153 ceph-mon[22320]: from='client.? ' entity='client.admin' 2024-08-31T05:56:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.324+0000 7fb42bd91640 1 -- 172.21.15.53:0/1704682041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb424109240 msgr2=0x7fb424109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.324+0000 7fb42bd91640 1 --2- 172.21.15.53:0/1704682041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb424109240 0x7fb424109650 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb414009900 tx=0x7fb41402a410 comp rx=0 tx=0).stop 2024-08-31T05:56:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.324+0000 7fb42bd91640 1 -- 172.21.15.53:0/1704682041 shutdown_connections 2024-08-31T05:56:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.324+0000 7fb42bd91640 1 --2- 172.21.15.53:0/1704682041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424109b90 0x7fb4241103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.324+0000 7fb42bd91640 1 --2- 172.21.15.53:0/1704682041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb424109240 0x7fb424109650 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.324+0000 7fb42bd91640 1 --2- 172.21.15.53:0/1704682041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb424103900 0x7fb424103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.325+0000 7fb42bd91640 1 -- 172.21.15.53:0/1704682041 >> 172.21.15.53:0/1704682041 conn(0x7fb42407b5f0 msgr2=0x7fb42407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.325+0000 7fb42bd91640 1 -- 172.21.15.53:0/1704682041 shutdown_connections 2024-08-31T05:56:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.325+0000 7fb42bd91640 1 -- 172.21.15.53:0/1704682041 wait complete. 2024-08-31T05:56:44.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.325+0000 7fb42bd91640 1 Processor -- start 2024-08-31T05:56:44.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.325+0000 7fb42bd91640 1 -- start start 2024-08-31T05:56:44.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb42bd91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb424103900 0x7fb42419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb42bd91640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb424109240 0x7fb42419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb42bd91640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424109b90 0x7fb42419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb42bd91640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb424113700 con 0x7fb424103900 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb42bd91640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb424113580 con 0x7fb424109b90 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb42bd91640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb424113880 con 0x7fb424109240 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb429b2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb424103900 0x7fb42419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb429b2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb424103900 0x7fb42419a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39000/0 (socket says 172.21.15.53:39000) 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb429b2d640 1 -- 172.21.15.53:0/2687398262 learned_addr learned my addr 172.21.15.53:0/2687398262 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb42932c640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb424109240 0x7fb42419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb42a32e640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424109b90 0x7fb42419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb429b2d640 1 -- 172.21.15.53:0/2687398262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb424109240 msgr2=0x7fb42419a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb429b2d640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb424109240 0x7fb42419a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb429b2d640 1 -- 172.21.15.53:0/2687398262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424109b90 msgr2=0x7fb42419fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb429b2d640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424109b90 0x7fb42419fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb429b2d640 1 -- 172.21.15.53:0/2687398262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4241a0180 con 0x7fb424103900 2024-08-31T05:56:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.326+0000 7fb429b2d640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb424103900 0x7fb42419a210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb42000d770 tx=0x7fb42000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.327+0000 7fb41affd640 1 -- 172.21.15.53:0/2687398262 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420017070 con 0x7fb424103900 2024-08-31T05:56:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.327+0000 7fb41affd640 1 -- 172.21.15.53:0/2687398262 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4200054b0 con 0x7fb424103900 2024-08-31T05:56:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.327+0000 7fb41affd640 1 -- 172.21.15.53:0/2687398262 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420004c60 con 0x7fb424103900 2024-08-31T05:56:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.327+0000 7fb42bd91640 1 -- 172.21.15.53:0/2687398262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4241a0470 con 0x7fb424103900 2024-08-31T05:56:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.327+0000 7fb42bd91640 1 -- 172.21.15.53:0/2687398262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4241a6bd0 con 0x7fb424103900 2024-08-31T05:56:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.328+0000 7fb42bd91640 1 -- 172.21.15.53:0/2687398262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb424104b80 con 0x7fb424103900 2024-08-31T05:56:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.330+0000 7fb41affd640 1 -- 172.21.15.53:0/2687398262 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fb420004e00 con 0x7fb424103900 2024-08-31T05:56:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.330+0000 7fb41affd640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4100b4b70 0x7fb4100b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.330+0000 7fb42932c640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4100b4b70 0x7fb4100b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.330+0000 7fb41affd640 1 -- 172.21.15.53:0/2687398262 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb4200e32a0 con 0x7fb424103900 2024-08-31T05:56:44.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.331+0000 7fb42932c640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4100b4b70 0x7fb4100b7080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb414005940 tx=0x7fb4140058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:44.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.333+0000 7fb41affd640 1 -- 172.21.15.53:0/2687398262 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb4200aba00 con 0x7fb424103900 2024-08-31T05:56:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.519+0000 7fb42bd91640 1 -- 172.21.15.53:0/2687398262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fb424103d10 con 0x7fb424103900 2024-08-31T05:56:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.523+0000 7fb41affd640 1 -- 172.21.15.53:0/2687398262 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v35)=0 v35) ==== 125+0+0 (secure 0 0 0) 0x7fb424103d10 con 0x7fb424103900 2024-08-31T05:56:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 -- 172.21.15.53:0/2687398262 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4100b4b70 msgr2=0x7fb4100b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4100b4b70 0x7fb4100b7080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb414005940 tx=0x7fb4140058d0 comp rx=0 tx=0).stop 2024-08-31T05:56:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 -- 172.21.15.53:0/2687398262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb424103900 msgr2=0x7fb42419a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb424103900 0x7fb42419a210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb42000d770 tx=0x7fb42000dc30 comp rx=0 tx=0).stop 2024-08-31T05:56:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 -- 172.21.15.53:0/2687398262 shutdown_connections 2024-08-31T05:56:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4100b4b70 0x7fb4100b7080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb424109b90 0x7fb42419fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb424109240 0x7fb42419a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 --2- 172.21.15.53:0/2687398262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb424103900 0x7fb42419a210 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 -- 172.21.15.53:0/2687398262 >> 172.21.15.53:0/2687398262 conn(0x7fb42407b5f0 msgr2=0x7fb4241053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 -- 172.21.15.53:0/2687398262 shutdown_connections 2024-08-31T05:56:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:44.525+0000 7fb42bd91640 1 -- 172.21.15.53:0/2687398262 wait complete. 2024-08-31T05:56:45.111 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '580e8a36-675d-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi053') 2024-08-31T05:56:45.111 INFO:tasks.cephadm:Deploying OSDs... 2024-08-31T05:56:45.111 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T05:56:45.111 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T05:56:45.128 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T05:56:45.128 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-08-31T05:56:45.183 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T05:56:45.183 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:45.183 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-31T05:56:45.183 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:45.184 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:45.184 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-08-31 05:55:26.090610554 +0000 2024-08-31T05:56:45.184 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-08-31 05:51:20.005567992 +0000 2024-08-31T05:56:45.184 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-08-31 05:51:20.005567992 +0000 2024-08-31T05:56:45.184 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-08-31 05:51:20.005567992 +0000 2024-08-31T05:56:45.184 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T05:56:45.249 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-08-31T05:56:45.249 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-08-31T05:56:45.249 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000111844 s, 4.6 MB/s 2024-08-31T05:56:45.250 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T05:56:45.307 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-08-31T05:56:45.363 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T05:56:45.363 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:45.363 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-31T05:56:45.363 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:45.363 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:45.363 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-08-31 05:55:26.117609987 +0000 2024-08-31T05:56:45.363 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-08-31 05:51:20.317561391 +0000 2024-08-31T05:56:45.363 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-08-31 05:51:20.317561391 +0000 2024-08-31T05:56:45.363 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-08-31 05:51:20.317561391 +0000 2024-08-31T05:56:45.363 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T05:56:45.426 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-08-31T05:56:45.426 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-08-31T05:56:45.426 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 8.8794e-05 s, 5.8 MB/s 2024-08-31T05:56:45.427 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T05:56:45.484 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-08-31T05:56:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T05:56:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:45.539 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-08-31T05:56:45.539 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:45.539 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:45.539 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-08-31 05:55:26.151609273 +0000 2024-08-31T05:56:45.539 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-08-31 05:51:20.624554896 +0000 2024-08-31T05:56:45.539 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-08-31 05:51:20.624554896 +0000 2024-08-31T05:56:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-08-31 05:51:20.624554896 +0000 2024-08-31T05:56:45.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T05:56:45.601 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-08-31T05:56:45.601 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-08-31T05:56:45.601 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000107766 s, 4.8 MB/s 2024-08-31T05:56:45.602 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T05:56:45.658 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-08-31T05:56:45.713 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T05:56:45.713 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:45.713 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-08-31T05:56:45.713 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:45.713 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:45.714 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-08-31 05:55:26.185608559 +0000 2024-08-31T05:56:45.714 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-08-31 05:51:20.933548358 +0000 2024-08-31T05:56:45.714 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-08-31 05:51:20.933548358 +0000 2024-08-31T05:56:45.714 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-08-31 05:51:20.933548358 +0000 2024-08-31T05:56:45.714 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T05:56:45.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:45 smithi053 ceph-mon[18924]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:45.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:45 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2687398262' entity='client.admin' 2024-08-31T05:56:45.747 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-08-31T05:56:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-08-31T05:56:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000107111 s, 4.8 MB/s 2024-08-31T05:56:45.749 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T05:56:45.804 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-31T05:56:45.804 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T05:56:45.824 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T05:56:45.824 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-08-31T05:56:45.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:45 smithi130 ceph-mon[22266]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:45.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:45 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2687398262' entity='client.admin' 2024-08-31T05:56:45.883 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T05:56:45.884 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:45.884 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-31T05:56:45.884 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:45.884 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:45.884 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-31 05:56:23.189294119 +0000 2024-08-31T05:56:45.884 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-31 05:51:20.004502156 +0000 2024-08-31T05:56:45.884 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-31 05:51:20.004502156 +0000 2024-08-31T05:56:45.884 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-31 05:51:20.004502156 +0000 2024-08-31T05:56:45.884 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T05:56:45.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:45 smithi153 ceph-mon[22320]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:45.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:45 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2687398262' entity='client.admin' 2024-08-31T05:56:45.954 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-31T05:56:45.954 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-31T05:56:45.954 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000211645 s, 2.4 MB/s 2024-08-31T05:56:45.955 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T05:56:46.015 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-08-31T05:56:46.072 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T05:56:46.072 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:46.072 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-31T05:56:46.072 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:46.072 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:46.072 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-31 05:56:23.189294119 +0000 2024-08-31T05:56:46.072 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-31 05:51:20.362495108 +0000 2024-08-31T05:56:46.072 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-31 05:51:20.362495108 +0000 2024-08-31T05:56:46.072 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-31 05:51:20.362495108 +0000 2024-08-31T05:56:46.073 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T05:56:46.137 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-31T05:56:46.138 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-31T05:56:46.138 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.00018696 s, 2.7 MB/s 2024-08-31T05:56:46.139 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T05:56:46.197 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-08-31T05:56:46.253 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T05:56:46.253 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:46.254 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-08-31T05:56:46.254 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:46.254 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:46.254 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-31 05:56:23.189294119 +0000 2024-08-31T05:56:46.254 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-31 05:51:20.685488749 +0000 2024-08-31T05:56:46.254 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-31 05:51:20.685488749 +0000 2024-08-31T05:56:46.254 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-31 05:51:20.685488749 +0000 2024-08-31T05:56:46.254 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T05:56:46.318 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-31T05:56:46.318 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-31T05:56:46.319 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000201524 s, 2.5 MB/s 2024-08-31T05:56:46.320 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T05:56:46.377 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-08-31T05:56:46.433 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T05:56:46.433 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:46.433 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-08-31T05:56:46.433 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:46.433 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:46.433 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-31 05:56:23.190294100 +0000 2024-08-31T05:56:46.434 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-31 05:51:21.009482371 +0000 2024-08-31T05:56:46.434 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-31 05:51:21.009482371 +0000 2024-08-31T05:56:46.434 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-31 05:51:21.009482371 +0000 2024-08-31T05:56:46.434 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T05:56:46.498 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-31T05:56:46.498 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-31T05:56:46.498 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000221613 s, 2.3 MB/s 2024-08-31T05:56:46.499 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T05:56:46.555 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-08-31T05:56:46.555 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T05:56:46.575 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T05:56:46.576 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-08-31T05:56:46.634 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T05:56:46.634 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:46.635 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-08-31T05:56:46.635 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:46.635 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:46.635 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-08-31 05:56:20.913588387 +0000 2024-08-31T05:56:46.635 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-08-31 05:51:20.075309492 +0000 2024-08-31T05:56:46.635 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-08-31 05:51:20.075309492 +0000 2024-08-31T05:56:46.635 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-08-31 05:51:20.075309492 +0000 2024-08-31T05:56:46.635 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T05:56:46.706 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-08-31T05:56:46.706 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-08-31T05:56:46.706 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000293203 s, 1.7 MB/s 2024-08-31T05:56:46.707 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T05:56:46.766 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-08-31T05:56:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T05:56:46.824 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:46.824 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-31T05:56:46.824 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:46.824 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:46.825 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-08-31 05:56:20.914588371 +0000 2024-08-31T05:56:46.825 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-08-31 05:51:20.399304144 +0000 2024-08-31T05:56:46.825 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-08-31 05:51:20.399304144 +0000 2024-08-31T05:56:46.825 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-08-31 05:51:20.399304144 +0000 2024-08-31T05:56:46.825 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T05:56:46.891 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-08-31T05:56:46.891 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-08-31T05:56:46.891 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000210486 s, 2.4 MB/s 2024-08-31T05:56:46.893 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T05:56:46.950 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-08-31T05:56:47.007 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T05:56:47.007 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:47.007 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-08-31T05:56:47.007 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:47.007 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:47.007 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-08-31 05:56:20.914588371 +0000 2024-08-31T05:56:47.007 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-08-31 05:51:20.725298762 +0000 2024-08-31T05:56:47.007 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-08-31 05:51:20.725298762 +0000 2024-08-31T05:56:47.007 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-08-31 05:51:20.725298762 +0000 2024-08-31T05:56:47.008 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T05:56:47.072 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-08-31T05:56:47.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-08-31T05:56:47.073 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000226795 s, 2.3 MB/s 2024-08-31T05:56:47.074 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T05:56:47.130 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-08-31T05:56:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T05:56:47.186 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:56:47.186 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-31T05:56:47.186 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:56:47.187 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:56:47.187 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-08-31 05:56:20.915588355 +0000 2024-08-31T05:56:47.187 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-08-31 05:51:21.057293281 +0000 2024-08-31T05:56:47.187 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-08-31 05:51:21.057293281 +0000 2024-08-31T05:56:47.187 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-08-31 05:51:21.057293281 +0000 2024-08-31T05:56:47.187 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T05:56:47.251 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-08-31T05:56:47.251 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-08-31T05:56:47.251 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000243604 s, 2.1 MB/s 2024-08-31T05:56:47.252 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T05:56:47.309 INFO:tasks.cephadm:Deploying osd.0 on smithi053 with /dev/vg_nvme/lv_4... 2024-08-31T05:56:47.310 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T05:56:47.570 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:47.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:47 smithi053 ceph-mon[18924]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:47.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:47 smithi130 ceph-mon[22266]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:47.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:47 smithi153 ceph-mon[22320]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:49.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:49 smithi053 ceph-mon[18924]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:49.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:49 smithi130 ceph-mon[22266]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:49.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:49 smithi153 ceph-mon[22320]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:50.001 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:56:50.035 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi053:vg_nvme/lv_4 2024-08-31T05:56:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:56:50.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.716+0000 7fdbea468640 1 -- 172.21.15.53:0/1907790223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4108160 msgr2=0x7fdbe4108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:50.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.716+0000 7fdbea468640 1 --2- 172.21.15.53:0/1907790223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4108160 0x7fdbe4108570 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009900 tx=0x7fdbd802a410 comp rx=0 tx=0).stop 2024-08-31T05:56:50.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.716+0000 7fdbea468640 1 -- 172.21.15.53:0/1907790223 shutdown_connections 2024-08-31T05:56:50.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.716+0000 7fdbea468640 1 --2- 172.21.15.53:0/1907790223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbe4108ab0 0x7fdbe410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:50.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.716+0000 7fdbea468640 1 --2- 172.21.15.53:0/1907790223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4108160 0x7fdbe4108570 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.717+0000 7fdbea468640 1 --2- 172.21.15.53:0/1907790223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbe4102820 0x7fdbe4102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.717+0000 7fdbea468640 1 -- 172.21.15.53:0/1907790223 >> 172.21.15.53:0/1907790223 conn(0x7fdbe40794e0 msgr2=0x7fdbe40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:56:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.717+0000 7fdbea468640 1 -- 172.21.15.53:0/1907790223 shutdown_connections 2024-08-31T05:56:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.717+0000 7fdbea468640 1 -- 172.21.15.53:0/1907790223 wait complete. 2024-08-31T05:56:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.717+0000 7fdbea468640 1 Processor -- start 2024-08-31T05:56:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.717+0000 7fdbea468640 1 -- start start 2024-08-31T05:56:50.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbea468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4102820 0x7fdbe4198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:50.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbea468640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbe4108160 0x7fdbe4199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:50.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbea468640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbe4108ab0 0x7fdbe4199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:50.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbea468640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe4112590 con 0x7fdbe4102820 2024-08-31T05:56:50.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbea468640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe4112410 con 0x7fdbe4108160 2024-08-31T05:56:50.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbea468640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe4112710 con 0x7fdbe4108ab0 2024-08-31T05:56:50.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4102820 0x7fdbe4198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:50.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4102820 0x7fdbe4198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39020/0 (socket says 172.21.15.53:39020) 2024-08-31T05:56:50.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe3fff640 1 -- 172.21.15.53:0/1710190401 learned_addr learned my addr 172.21.15.53:0/1710190401 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:56:50.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe37fe640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbe4108160 0x7fdbe4199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:50.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe8a05640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbe4108ab0 0x7fdbe4199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe3fff640 1 -- 172.21.15.53:0/1710190401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbe4108ab0 msgr2=0x7fdbe4199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe3fff640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbe4108ab0 0x7fdbe4199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe3fff640 1 -- 172.21.15.53:0/1710190401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbe4108160 msgr2=0x7fdbe4199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe3fff640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbe4108160 0x7fdbe4199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe3fff640 1 -- 172.21.15.53:0/1710190401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe41a84a0 con 0x7fdbe4102820 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe8a05640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbe4108ab0 0x7fdbe4199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe37fe640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbe4108160 0x7fdbe4199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.718+0000 7fdbe3fff640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4102820 0x7fdbe4198df0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400c890 tx=0x7fdbd400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.719+0000 7fdbe17fa640 1 -- 172.21.15.53:0/1710190401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4004220 con 0x7fdbe4102820 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.719+0000 7fdbe17fa640 1 -- 172.21.15.53:0/1710190401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbd4007e40 con 0x7fdbe4102820 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.719+0000 7fdbea468640 1 -- 172.21.15.53:0/1710190401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe41a8790 con 0x7fdbe4102820 2024-08-31T05:56:50.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.719+0000 7fdbe17fa640 1 -- 172.21.15.53:0/1710190401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4004a00 con 0x7fdbe4102820 2024-08-31T05:56:50.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.719+0000 7fdbea468640 1 -- 172.21.15.53:0/1710190401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe41a8cf0 con 0x7fdbe4102820 2024-08-31T05:56:50.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.720+0000 7fdbea468640 1 -- 172.21.15.53:0/1710190401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe4103aa0 con 0x7fdbe4102820 2024-08-31T05:56:50.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.721+0000 7fdbe17fa640 1 -- 172.21.15.53:0/1710190401 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fdbd40079b0 con 0x7fdbe4102820 2024-08-31T05:56:50.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.722+0000 7fdbe17fa640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbcc0b4b70 0x7fdbcc0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:56:50.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.722+0000 7fdbe37fe640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbcc0b4b70 0x7fdbcc0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:56:50.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.722+0000 7fdbe17fa640 1 -- 172.21.15.53:0/1710190401 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdbd40e32d0 con 0x7fdbe4102820 2024-08-31T05:56:50.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.723+0000 7fdbe37fe640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbcc0b4b70 0x7fdbcc0b7080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8006010 tx=0x7fdbd8005de0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:56:50.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.726+0000 7fdbe17fa640 1 -- 172.21.15.53:0/1710190401 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdbd4014030 con 0x7fdbe4102820 2024-08-31T05:56:50.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:56:50.924+0000 7fdbea468640 1 -- 172.21.15.53:0/1710190401 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdbe40635a0 con 0x7fdbcc0b4b70 2024-08-31T05:56:51.611 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:51 smithi053 ceph-mon[18924]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:51.612 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:51 smithi053 ceph-mon[18924]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:51.612 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:56:51.612 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:56:51.612 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:51.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:51 smithi130 ceph-mon[22266]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:51.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:51 smithi130 ceph-mon[22266]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:51.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:56:51.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:56:51.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:51.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:51 smithi153 ceph-mon[22320]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:51.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:51 smithi153 ceph-mon[22320]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:51.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:56:51.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:56:51.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:56:53.867 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:53 smithi053 ceph-mon[18924]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:53.868 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:53 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/839133208' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a814231b-c1a5-4760-90e4-4eb5e2b05107"} : dispatch 2024-08-31T05:56:53.868 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:53 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/839133208' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a814231b-c1a5-4760-90e4-4eb5e2b05107"}]': finished 2024-08-31T05:56:53.868 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:53 smithi053 ceph-mon[18924]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T05:56:53.868 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:56:53.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:53 smithi130 ceph-mon[22266]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:53.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:53 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/839133208' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a814231b-c1a5-4760-90e4-4eb5e2b05107"} : dispatch 2024-08-31T05:56:53.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:53 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/839133208' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a814231b-c1a5-4760-90e4-4eb5e2b05107"}]': finished 2024-08-31T05:56:53.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:53 smithi130 ceph-mon[22266]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T05:56:53.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:56:53.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:53 smithi153 ceph-mon[22320]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:53.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:53 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/839133208' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a814231b-c1a5-4760-90e4-4eb5e2b05107"} : dispatch 2024-08-31T05:56:53.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:53 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/839133208' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a814231b-c1a5-4760-90e4-4eb5e2b05107"}]': finished 2024-08-31T05:56:53.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:53 smithi153 ceph-mon[22320]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T05:56:53.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:56:54.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:54 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2803176256' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:56:54.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:54 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2803176256' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:56:54.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:54 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2803176256' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:56:55.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:55 smithi130 ceph-mon[22266]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:55.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:55 smithi153 ceph-mon[22320]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:55.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:55 smithi053 ceph-mon[18924]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:57.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:57 smithi130 ceph-mon[22266]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:57.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:57 smithi153 ceph-mon[22320]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:57.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:57 smithi053 ceph-mon[18924]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:59.868 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:56:59 smithi053 ceph-mon[18924]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:59.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:56:59 smithi130 ceph-mon[22266]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:56:59.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:56:59 smithi153 ceph-mon[22320]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:01.713 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:01 smithi053 ceph-mon[18924]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:01.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:01 smithi130 ceph-mon[22266]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:01.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:01 smithi153 ceph-mon[22320]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:02.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T05:57:02.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:02.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:02 smithi053 ceph-mon[18924]: Deploying daemon osd.0 on smithi053 2024-08-31T05:57:02.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T05:57:02.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:02.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:02 smithi130 ceph-mon[22266]: Deploying daemon osd.0 on smithi053 2024-08-31T05:57:02.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T05:57:02.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:02.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:02 smithi153 ceph-mon[22320]: Deploying daemon osd.0 on smithi053 2024-08-31T05:57:03.667 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:03 smithi053 ceph-mon[18924]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:03.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:03 smithi130 ceph-mon[22266]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:03.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:03 smithi153 ceph-mon[22320]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:05.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:05 smithi130 ceph-mon[22266]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:05.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:05 smithi153 ceph-mon[22320]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:05 smithi053 ceph-mon[18924]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:07.818 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:07 smithi053 ceph-mon[18924]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:07.819 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:07.819 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:07.819 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:07.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:07 smithi130 ceph-mon[22266]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:07.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:07.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:07.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:07.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:07 smithi153 ceph-mon[22320]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:07.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:07.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:07.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:09.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:09 smithi053 ceph-mon[18924]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:09.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:09 smithi130 ceph-mon[22266]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:09.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:09 smithi153 ceph-mon[22320]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:10.960 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:10 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:10.960 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:10 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:10.960 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:10 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:10.961 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:10 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:10.961 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:10 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:11.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.001+0000 7fdbe17fa640 1 -- 172.21.15.53:0/1710190401 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdbe40635a0 con 0x7fdbcc0b4b70 2024-08-31T05:57:11.005 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 0 on host 'smithi053' 2024-08-31T05:57:11.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.004+0000 7fdbea468640 1 -- 172.21.15.53:0/1710190401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbcc0b4b70 msgr2=0x7fdbcc0b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:11.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.004+0000 7fdbea468640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbcc0b4b70 0x7fdbcc0b7080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8006010 tx=0x7fdbd8005de0 comp rx=0 tx=0).stop 2024-08-31T05:57:11.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.004+0000 7fdbea468640 1 -- 172.21.15.53:0/1710190401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4102820 msgr2=0x7fdbe4198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:11.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.004+0000 7fdbea468640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4102820 0x7fdbe4198df0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400c890 tx=0x7fdbd400cd50 comp rx=0 tx=0).stop 2024-08-31T05:57:11.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.004+0000 7fdbea468640 1 -- 172.21.15.53:0/1710190401 shutdown_connections 2024-08-31T05:57:11.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.004+0000 7fdbea468640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbcc0b4b70 0x7fdbcc0b7080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:11.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.004+0000 7fdbea468640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbe4108ab0 0x7fdbe4199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:11.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.004+0000 7fdbea468640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbe4108160 0x7fdbe4199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:11.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.004+0000 7fdbea468640 1 --2- 172.21.15.53:0/1710190401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4102820 0x7fdbe4198df0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:11.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.004+0000 7fdbea468640 1 -- 172.21.15.53:0/1710190401 >> 172.21.15.53:0/1710190401 conn(0x7fdbe40794e0 msgr2=0x7fdbe41042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:57:11.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.004+0000 7fdbea468640 1 -- 172.21.15.53:0/1710190401 shutdown_connections 2024-08-31T05:57:11.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:57:11.005+0000 7fdbea468640 1 -- 172.21.15.53:0/1710190401 wait complete. 2024-08-31T05:57:11.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:10 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:11.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:10 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:11.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:10 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:11.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:10 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:11.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:10 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:11.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:10 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:11.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:10 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:11.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:10 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:11.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:10 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:11.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:10 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:11.674 DEBUG:teuthology.orchestra.run.smithi053:osd.0> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.0.service 2024-08-31T05:57:11.677 INFO:tasks.cephadm:Deploying osd.1 on smithi130 with /dev/vg_nvme/lv_4... 2024-08-31T05:57:11.677 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T05:57:11.929 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:57:11.971 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:11 smithi053 ceph-mon[18924]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:11.971 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:11.971 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:11.971 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:11.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:11 smithi130 ceph-mon[22266]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:11.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:11.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:11.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:11 smithi153 ceph-mon[22320]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:13.476 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 05:57:13 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0[36903]: 2024-08-31T05:57:13.185+0000 7f684ce08640 -1 osd.0 0 log_to_monitors true 2024-08-31T05:57:14.122 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:13 smithi130 ceph-mon[22266]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:14.123 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:13 smithi130 ceph-mon[22266]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T05:57:14.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:13 smithi053 ceph-mon[18924]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:14.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:13 smithi053 ceph-mon[18924]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T05:57:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:13 smithi153 ceph-mon[22320]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:13 smithi153 ceph-mon[22320]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T05:57:14.401 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:57:14.429 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_4 2024-08-31T05:57:14.688 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:57:15.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T05:57:15.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T05:57:15.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T05:57:15.069 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:15.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:57:15.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:15.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:15.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T05:57:15.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T05:57:15.070 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:15.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.162+0000 7f80c04ee640 1 -- 172.21.15.130:0/764731825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80b8108b10 msgr2=0x7f80b810f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:15.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.162+0000 7f80c04ee640 1 --2- 172.21.15.130:0/764731825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80b8108b10 0x7f80b810f340 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009ca0 tx=0x7f80b002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:57:15.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.162+0000 7f80c04ee640 1 -- 172.21.15.130:0/764731825 shutdown_connections 2024-08-31T05:57:15.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.162+0000 7f80c04ee640 1 --2- 172.21.15.130:0/764731825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80b8108b10 0x7f80b810f340 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:15.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.162+0000 7f80c04ee640 1 --2- 172.21.15.130:0/764731825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80b81081c0 0x7f80b81085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:15.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.162+0000 7f80c04ee640 1 --2- 172.21.15.130:0/764731825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80b8102880 0x7f80b8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:15.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.162+0000 7f80c04ee640 1 -- 172.21.15.130:0/764731825 >> 172.21.15.130:0/764731825 conn(0x7f80b8079450 msgr2=0x7f80b8079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:57:15.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.162+0000 7f80c04ee640 1 -- 172.21.15.130:0/764731825 shutdown_connections 2024-08-31T05:57:15.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.162+0000 7f80c04ee640 1 -- 172.21.15.130:0/764731825 wait complete. 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.162+0000 7f80c04ee640 1 Processor -- start 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.162+0000 7f80c04ee640 1 -- start start 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80c04ee640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80b8102880 0x7f80b80ff430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80c04ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80b81081c0 0x7f80b80ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80c04ee640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80b8108b10 0x7f80b80ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80c04ee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f80b81126e0 con 0x7f80b81081c0 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80c04ee640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8112560 con 0x7f80b8102880 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80c04ee640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8112860 con 0x7f80b8108b10 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80be28a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80b8102880 0x7f80b80ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80be28a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80b8102880 0x7f80b80ff430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57778/0 (socket says 172.21.15.130:57778) 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80be28a640 1 -- 172.21.15.130:0/3441446827 learned_addr learned my addr 172.21.15.130:0/3441446827 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80bda89640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80b81081c0 0x7f80b80ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:57:15.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80bea8b640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80b8108b10 0x7f80b80ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80be28a640 1 -- 172.21.15.130:0/3441446827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80b8108b10 msgr2=0x7f80b80ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80be28a640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80b8108b10 0x7f80b80ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80be28a640 1 -- 172.21.15.130:0/3441446827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80b81081c0 msgr2=0x7f80b80ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80be28a640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80b81081c0 0x7f80b80ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80be28a640 1 -- 172.21.15.130:0/3441446827 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b81a8440 con 0x7f80b8102880 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.163+0000 7f80be28a640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80b8102880 0x7f80b80ff430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80b400e9f0 tx=0x7f80b400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.164+0000 7f80af7fe640 1 -- 172.21.15.130:0/3441446827 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b400cd80 con 0x7f80b8102880 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.164+0000 7f80af7fe640 1 -- 172.21.15.130:0/3441446827 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80b40108c0 con 0x7f80b8102880 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.164+0000 7f80c04ee640 1 -- 172.21.15.130:0/3441446827 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b81a8730 con 0x7f80b8102880 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.164+0000 7f80af7fe640 1 -- 172.21.15.130:0/3441446827 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b40187c0 con 0x7f80b8102880 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.164+0000 7f80c04ee640 1 -- 172.21.15.130:0/3441446827 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b81a8c70 con 0x7f80b8102880 2024-08-31T05:57:15.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.165+0000 7f80c04ee640 1 -- 172.21.15.130:0/3441446827 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b8103b00 con 0x7f80b8102880 2024-08-31T05:57:15.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.166+0000 7f80af7fe640 1 -- 172.21.15.130:0/3441446827 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f80b4010430 con 0x7f80b8102880 2024-08-31T05:57:15.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.167+0000 7f80af7fe640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80a40b4af0 0x7f80a40b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:57:15.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.167+0000 7f80bda89640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80a40b4af0 0x7f80a40b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:57:15.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.167+0000 7f80af7fe640 1 -- 172.21.15.130:0/3441446827 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7f80b40e3a30 con 0x7f80b8102880 2024-08-31T05:57:15.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.168+0000 7f80bda89640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80a40b4af0 0x7f80a40b7000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f80b806c900 tx=0x7f80a8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:57:15.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.172+0000 7f80af7fe640 1 -- 172.21.15.130:0/3441446827 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f80b40abfc0 con 0x7f80b8102880 2024-08-31T05:57:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T05:57:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T05:57:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T05:57:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:57:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T05:57:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T05:57:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T05:57:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T05:57:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T05:57:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:57:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T05:57:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T05:57:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:15.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:15.355+0000 7f80c04ee640 1 -- 172.21.15.130:0/3441446827 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f80b80635a0 con 0x7f80a40b4af0 2024-08-31T05:57:15.725 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 05:57:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0[36903]: 2024-08-31T05:57:15.471+0000 7f6848d8a640 -1 osd.0 0 waiting for initial osdmap 2024-08-31T05:57:15.726 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 05:57:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0[36903]: 2024-08-31T05:57:15.474+0000 7f6840b80640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:57:16.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:15 smithi130 ceph-mon[22266]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:16.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:15 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi053 2024-08-31T05:57:16.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:15 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi053 to 17092M 2024-08-31T05:57:16.037 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:16.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:57:16.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:57:16.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:16.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:15 smithi130 ceph-mon[22266]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' 2024-08-31T05:57:16.038 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:16.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:15 smithi153 ceph-mon[22320]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:16.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:15 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi053 2024-08-31T05:57:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:15 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi053 to 17092M 2024-08-31T05:57:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:57:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:57:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:15 smithi153 ceph-mon[22320]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' 2024-08-31T05:57:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:16.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:15 smithi053 ceph-mon[18924]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:16.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:15 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi053 2024-08-31T05:57:16.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:15 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi053 to 17092M 2024-08-31T05:57:16.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:16.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:57:16.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:57:16.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:16.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:15 smithi053 ceph-mon[18924]: from='osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672]' entity='osd.0' 2024-08-31T05:57:16.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:16.885 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:16 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T05:57:16.885 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:16 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T05:57:16.885 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:16 smithi130 ceph-mon[22266]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:16.886 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:16 smithi130 ceph-mon[22266]: osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672] boot 2024-08-31T05:57:16.886 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:16 smithi130 ceph-mon[22266]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T05:57:16.886 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:16 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:17.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:16 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T05:57:17.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:16 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T05:57:17.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:16 smithi153 ceph-mon[22320]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:17.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:16 smithi153 ceph-mon[22320]: osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672] boot 2024-08-31T05:57:17.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:16 smithi153 ceph-mon[22320]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T05:57:17.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:16 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:17.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:16 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T05:57:17.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:16 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T05:57:17.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:16 smithi053 ceph-mon[18924]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:17.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:16 smithi053 ceph-mon[18924]: osd.0 [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672] boot 2024-08-31T05:57:17.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:16 smithi053 ceph-mon[18924]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T05:57:17.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:16 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:57:18.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:17 smithi130 ceph-mon[22266]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:18.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:17 smithi130 ceph-mon[22266]: from='client.? 172.21.15.130:0/911638880' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3387502-2a41-4afb-8e8b-321e68a8e362"} : dispatch 2024-08-31T05:57:18.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:17 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3387502-2a41-4afb-8e8b-321e68a8e362"} : dispatch 2024-08-31T05:57:18.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:17 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3387502-2a41-4afb-8e8b-321e68a8e362"}]': finished 2024-08-31T05:57:18.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:17 smithi130 ceph-mon[22266]: osdmap e10: 2 total, 1 up, 2 in 2024-08-31T05:57:18.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:18.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:17 smithi153 ceph-mon[22320]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:18.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:17 smithi153 ceph-mon[22320]: from='client.? 172.21.15.130:0/911638880' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3387502-2a41-4afb-8e8b-321e68a8e362"} : dispatch 2024-08-31T05:57:18.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:17 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3387502-2a41-4afb-8e8b-321e68a8e362"} : dispatch 2024-08-31T05:57:18.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:17 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3387502-2a41-4afb-8e8b-321e68a8e362"}]': finished 2024-08-31T05:57:18.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:17 smithi153 ceph-mon[22320]: osdmap e10: 2 total, 1 up, 2 in 2024-08-31T05:57:18.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:18.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:17 smithi053 ceph-mon[18924]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:57:18.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:17 smithi053 ceph-mon[18924]: from='client.? 172.21.15.130:0/911638880' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3387502-2a41-4afb-8e8b-321e68a8e362"} : dispatch 2024-08-31T05:57:18.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:17 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3387502-2a41-4afb-8e8b-321e68a8e362"} : dispatch 2024-08-31T05:57:18.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:17 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3387502-2a41-4afb-8e8b-321e68a8e362"}]': finished 2024-08-31T05:57:18.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:17 smithi053 ceph-mon[18924]: osdmap e10: 2 total, 1 up, 2 in 2024-08-31T05:57:18.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:19.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:18 smithi130 ceph-mon[22266]: from='client.? 172.21.15.130:0/3386602130' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:57:19.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:18 smithi153 ceph-mon[22320]: from='client.? 172.21.15.130:0/3386602130' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:57:19.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:18 smithi053 ceph-mon[18924]: from='client.? 172.21.15.130:0/3386602130' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:57:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:19 smithi130 ceph-mon[22266]: pgmap v30: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:20.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:19 smithi153 ceph-mon[22320]: pgmap v30: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:20.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:19 smithi053 ceph-mon[18924]: pgmap v30: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:21 smithi130 ceph-mon[22266]: pgmap v31: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:21 smithi153 ceph-mon[22320]: pgmap v31: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:22.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:21 smithi053 ceph-mon[18924]: pgmap v31: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:23.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:23 smithi130 ceph-mon[22266]: pgmap v32: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:23 smithi153 ceph-mon[22320]: pgmap v32: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:24.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:23 smithi053 ceph-mon[18924]: pgmap v32: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:25 smithi130 ceph-mon[22266]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:25 smithi153 ceph-mon[22320]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:25 smithi053 ceph-mon[18924]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:26.847 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T05:57:26.847 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:27.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T05:57:27.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:27.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T05:57:27.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:27.999 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:27 smithi130 ceph-mon[22266]: Deploying daemon osd.1 on smithi130 2024-08-31T05:57:27.999 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:27 smithi130 ceph-mon[22266]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:28.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:27 smithi153 ceph-mon[22320]: Deploying daemon osd.1 on smithi130 2024-08-31T05:57:28.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:27 smithi153 ceph-mon[22320]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:28.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:27 smithi053 ceph-mon[18924]: Deploying daemon osd.1 on smithi130 2024-08-31T05:57:28.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:27 smithi053 ceph-mon[18924]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:29.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:29 smithi130 ceph-mon[22266]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:30.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:29 smithi153 ceph-mon[22320]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:30.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:29 smithi053 ceph-mon[18924]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:32.096 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:31 smithi130 ceph-mon[22266]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:32.096 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:31 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:32.096 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:31 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:32.096 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:31 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:31 smithi153 ceph-mon[22320]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:31 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:31 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:32.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:31 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:32.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:31 smithi053 ceph-mon[18924]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:31 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:31 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:31 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:33 smithi130 ceph-mon[22266]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:33 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:33 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:33 smithi153 ceph-mon[22320]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:33 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:33 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:34.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:33 smithi053 ceph-mon[18924]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:34.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:33 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:34.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:33 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:35.125 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:34 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:35.125 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:34 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:35.125 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:34 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:35.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:34 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:35.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:34 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:35.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:34 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:35.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:34 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:35.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:34 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:35.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:34 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:35.441 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 1 on host 'smithi130' 2024-08-31T05:57:35.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.438+0000 7f80af7fe640 1 -- 172.21.15.130:0/3441446827 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f80b80635a0 con 0x7f80a40b4af0 2024-08-31T05:57:35.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.441+0000 7f80c04ee640 1 -- 172.21.15.130:0/3441446827 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80a40b4af0 msgr2=0x7f80a40b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.441+0000 7f80c04ee640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80a40b4af0 0x7f80a40b7000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f80b806c900 tx=0x7f80a8005f90 comp rx=0 tx=0).stop 2024-08-31T05:57:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.441+0000 7f80c04ee640 1 -- 172.21.15.130:0/3441446827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80b8102880 msgr2=0x7f80b80ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.441+0000 7f80c04ee640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80b8102880 0x7f80b80ff430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80b400e9f0 tx=0x7f80b400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:57:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.441+0000 7f80c04ee640 1 -- 172.21.15.130:0/3441446827 shutdown_connections 2024-08-31T05:57:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.441+0000 7f80c04ee640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80a40b4af0 0x7f80a40b7000 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.441+0000 7f80c04ee640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80b8108b10 0x7f80b80ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.441+0000 7f80c04ee640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80b81081c0 0x7f80b80ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.441+0000 7f80c04ee640 1 --2- 172.21.15.130:0/3441446827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80b8102880 0x7f80b80ff430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.441+0000 7f80c04ee640 1 -- 172.21.15.130:0/3441446827 >> 172.21.15.130:0/3441446827 conn(0x7f80b8079450 msgr2=0x7f80b8101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:57:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.442+0000 7f80c04ee640 1 -- 172.21.15.130:0/3441446827 shutdown_connections 2024-08-31T05:57:35.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:57:35.442+0000 7f80c04ee640 1 -- 172.21.15.130:0/3441446827 wait complete. 2024-08-31T05:57:36.114 DEBUG:teuthology.orchestra.run.smithi130:osd.1> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.1.service 2024-08-31T05:57:36.118 INFO:tasks.cephadm:Deploying osd.2 on smithi153 with /dev/vg_nvme/lv_4... 2024-08-31T05:57:36.118 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T05:57:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:57:36.374 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:36 smithi130 ceph-mon[22266]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:36.374 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:36 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:36.374 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:36 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:36.374 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:36 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:36.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:36 smithi153 ceph-mon[22320]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:36.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:36 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:36.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:36 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:36.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:36 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:36.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:36 smithi053 ceph-mon[18924]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:36.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:36 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:36.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:36 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:36.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:36 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:37.878 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 05:57:37 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1[27911]: 2024-08-31T05:57:37.436+0000 7fa275109640 -1 osd.1 0 log_to_monitors true 2024-08-31T05:57:38.201 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:38 smithi153 ceph-mon[22320]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:38.201 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:38 smithi153 ceph-mon[22320]: from='osd.1 [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:57:38.201 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:38 smithi153 ceph-mon[22320]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:57:38.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:38 smithi130 ceph-mon[22266]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:38.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:38 smithi130 ceph-mon[22266]: from='osd.1 [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:57:38.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:38 smithi130 ceph-mon[22266]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:57:38.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:38 smithi053 ceph-mon[18924]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:38.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:38 smithi053 ceph-mon[18924]: from='osd.1 [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:57:38.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:38 smithi053 ceph-mon[18924]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:57:38.746 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:57:38.772 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi153:vg_nvme/lv_4 2024-08-31T05:57:39.024 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:57:39.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T05:57:39.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T05:57:39.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:39.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: from='osd.1 [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:57:39.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:57:39.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:57:39.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:39.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:39.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T05:57:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T05:57:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: from='osd.1 [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:57:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:57:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:57:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.488+0000 7f5e84a21640 1 -- 172.21.15.153:0/2456793792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e80108150 msgr2=0x7f5e80108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.488+0000 7f5e84a21640 1 --2- 172.21.15.153:0/2456793792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e80108150 0x7f5e80108560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009900 tx=0x7f5e7402a410 comp rx=0 tx=0).stop 2024-08-31T05:57:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.488+0000 7f5e84a21640 1 -- 172.21.15.153:0/2456793792 shutdown_connections 2024-08-31T05:57:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.488+0000 7f5e84a21640 1 --2- 172.21.15.153:0/2456793792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e80108aa0 0x7f5e8010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.488+0000 7f5e84a21640 1 --2- 172.21.15.153:0/2456793792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e80108150 0x7f5e80108560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.488+0000 7f5e84a21640 1 --2- 172.21.15.153:0/2456793792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e80102810 0x7f5e80102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.488+0000 7f5e84a21640 1 -- 172.21.15.153:0/2456793792 >> 172.21.15.153:0/2456793792 conn(0x7f5e800794b0 msgr2=0x7f5e800798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:57:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.488+0000 7f5e84a21640 1 -- 172.21.15.153:0/2456793792 shutdown_connections 2024-08-31T05:57:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.488+0000 7f5e84a21640 1 -- 172.21.15.153:0/2456793792 wait complete. 2024-08-31T05:57:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.489+0000 7f5e84a21640 1 Processor -- start 2024-08-31T05:57:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.489+0000 7f5e84a21640 1 -- start start 2024-08-31T05:57:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.489+0000 7f5e84a21640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e80102810 0x7f5e8019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:57:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.489+0000 7f5e84a21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e80108150 0x7f5e8019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:57:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.489+0000 7f5e84a21640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e80108aa0 0x7f5e8019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:57:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.489+0000 7f5e84a21640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80113760 con 0x7f5e80108150 2024-08-31T05:57:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.489+0000 7f5e84a21640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5e801135e0 con 0x7f5e80108aa0 2024-08-31T05:57:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.489+0000 7f5e84a21640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5e801138e0 con 0x7f5e80102810 2024-08-31T05:57:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.489+0000 7f5e7e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e80102810 0x7f5e8019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:57:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.489+0000 7f5e7e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e80102810 0x7f5e8019a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55180/0 (socket says 172.21.15.153:55180) 2024-08-31T05:57:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.489+0000 7f5e7e59c640 1 -- 172.21.15.153:0/3133734642 learned_addr learned my addr 172.21.15.153:0/3133734642 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-31T05:57:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e7dd9b640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e80108150 0x7f5e8019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:57:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e7ed9d640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e80108aa0 0x7f5e8019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e7e59c640 1 -- 172.21.15.153:0/3133734642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e80108aa0 msgr2=0x7f5e8019f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e7e59c640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e80108aa0 0x7f5e8019f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e7e59c640 1 -- 172.21.15.153:0/3133734642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e80108150 msgr2=0x7f5e8019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e7e59c640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e80108150 0x7f5e8019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e7e59c640 1 -- 172.21.15.153:0/3133734642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e801a00c0 con 0x7f5e80102810 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e7e59c640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e80102810 0x7f5e8019a150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000ebc0 tx=0x7f5e7000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e6f7fe640 1 -- 172.21.15.153:0/3133734642 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70010630 con 0x7f5e80102810 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e6f7fe640 1 -- 172.21.15.153:0/3133734642 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e70010c60 con 0x7f5e80102810 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e84a21640 1 -- 172.21.15.153:0/3133734642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e801a03b0 con 0x7f5e80102810 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e6f7fe640 1 -- 172.21.15.153:0/3133734642 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70018b00 con 0x7f5e80102810 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.490+0000 7f5e84a21640 1 -- 172.21.15.153:0/3133734642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e801a6b10 con 0x7f5e80102810 2024-08-31T05:57:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.491+0000 7f5e84a21640 1 -- 172.21.15.153:0/3133734642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e80103a90 con 0x7f5e80102810 2024-08-31T05:57:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.493+0000 7f5e6f7fe640 1 -- 172.21.15.153:0/3133734642 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f5e70018ca0 con 0x7f5e80102810 2024-08-31T05:57:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.493+0000 7f5e6f7fe640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5e680b4af0 0x7f5e680b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:57:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.494+0000 7f5e6f7fe640 1 -- 172.21.15.153:0/3133734642 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2244+0+0 (secure 0 0 0) 0x7f5e700e42d0 con 0x7f5e80102810 2024-08-31T05:57:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.494+0000 7f5e7dd9b640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5e680b4af0 0x7f5e680b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:57:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.494+0000 7f5e7dd9b640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5e680b4af0 0x7f5e680b7000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5e7402a930 tx=0x7f5e74005a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:57:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.497+0000 7f5e6f7fe640 1 -- 172.21.15.153:0/3133734642 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5e700ac640 con 0x7f5e80102810 2024-08-31T05:57:39.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T05:57:39.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T05:57:39.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:39.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: from='osd.1 [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:57:39.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:57:39.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:57:39.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:39.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:39.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:39.685+0000 7f5e84a21640 1 -- 172.21.15.153:0/3133734642 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5e800635a0 con 0x7f5e680b4af0 2024-08-31T05:57:40.378 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1[27911]: 2024-08-31T05:57:40.043+0000 7fa27108b640 -1 osd.1 0 waiting for initial osdmap 2024-08-31T05:57:40.378 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1[27911]: 2024-08-31T05:57:40.184+0000 7fa268e81640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:57:40.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-mon[22266]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:40.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi130 2024-08-31T05:57:40.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi130 to 17088M 2024-08-31T05:57:40.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-mon[22266]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T05:57:40.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-mon[22266]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T05:57:40.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:40.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:40.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:57:40.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:57:40.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:40.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:40 smithi130 ceph-mon[22266]: from='osd.1 ' entity='osd.1' 2024-08-31T05:57:40.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:40 smithi153 ceph-mon[22320]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:40.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:40 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi130 2024-08-31T05:57:40.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:40 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi130 to 17088M 2024-08-31T05:57:40.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:40 smithi153 ceph-mon[22320]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T05:57:40.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:40 smithi153 ceph-mon[22320]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T05:57:40.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:40.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:40.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:57:40.416 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:57:40.416 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:40.416 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:40 smithi153 ceph-mon[22320]: from='osd.1 ' entity='osd.1' 2024-08-31T05:57:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:40 smithi053 ceph-mon[18924]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:40 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi130 2024-08-31T05:57:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:40 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi130 to 17088M 2024-08-31T05:57:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:40 smithi053 ceph-mon[18924]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T05:57:40.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:40 smithi053 ceph-mon[18924]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T05:57:40.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:40.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:40.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:57:40.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:57:40.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:40.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:40 smithi053 ceph-mon[18924]: from='osd.1 ' entity='osd.1' 2024-08-31T05:57:41.305 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:41 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T05:57:41.305 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:41 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T05:57:41.306 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:41 smithi153 ceph-mon[22320]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:41.306 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:41.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:41 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T05:57:41.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:41 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T05:57:41.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:41 smithi053 ceph-mon[18924]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:41.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:41.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:41 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T05:57:41.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:41 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T05:57:41.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:41 smithi130 ceph-mon[22266]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:41.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:42 smithi153 ceph-mon[22320]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:42.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:42 smithi153 ceph-mon[22320]: osd.1 [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383] boot 2024-08-31T05:57:42.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:42 smithi153 ceph-mon[22320]: osdmap e13: 2 total, 2 up, 2 in 2024-08-31T05:57:42.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:42.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:42 smithi153 ceph-mon[22320]: from='client.? 172.21.15.153:0/2992846626' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9ffe46e-6cc8-419d-9078-dbb40bfa3b12"} : dispatch 2024-08-31T05:57:42.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:42 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9ffe46e-6cc8-419d-9078-dbb40bfa3b12"} : dispatch 2024-08-31T05:57:42.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:42 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9ffe46e-6cc8-419d-9078-dbb40bfa3b12"}]': finished 2024-08-31T05:57:42.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:42 smithi153 ceph-mon[22320]: osdmap e14: 3 total, 2 up, 3 in 2024-08-31T05:57:42.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:57:42.445 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:42 smithi130 ceph-mon[22266]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:42.445 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:42 smithi130 ceph-mon[22266]: osd.1 [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383] boot 2024-08-31T05:57:42.445 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:42 smithi130 ceph-mon[22266]: osdmap e13: 2 total, 2 up, 2 in 2024-08-31T05:57:42.445 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:42.446 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:42 smithi130 ceph-mon[22266]: from='client.? 172.21.15.153:0/2992846626' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9ffe46e-6cc8-419d-9078-dbb40bfa3b12"} : dispatch 2024-08-31T05:57:42.446 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:42 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9ffe46e-6cc8-419d-9078-dbb40bfa3b12"} : dispatch 2024-08-31T05:57:42.446 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:42 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9ffe46e-6cc8-419d-9078-dbb40bfa3b12"}]': finished 2024-08-31T05:57:42.446 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:42 smithi130 ceph-mon[22266]: osdmap e14: 3 total, 2 up, 3 in 2024-08-31T05:57:42.446 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:57:42.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:42 smithi053 ceph-mon[18924]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:57:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:42 smithi053 ceph-mon[18924]: osd.1 [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383] boot 2024-08-31T05:57:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:42 smithi053 ceph-mon[18924]: osdmap e13: 2 total, 2 up, 2 in 2024-08-31T05:57:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:57:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:42 smithi053 ceph-mon[18924]: from='client.? 172.21.15.153:0/2992846626' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9ffe46e-6cc8-419d-9078-dbb40bfa3b12"} : dispatch 2024-08-31T05:57:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:42 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9ffe46e-6cc8-419d-9078-dbb40bfa3b12"} : dispatch 2024-08-31T05:57:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:42 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9ffe46e-6cc8-419d-9078-dbb40bfa3b12"}]': finished 2024-08-31T05:57:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:42 smithi053 ceph-mon[18924]: osdmap e14: 3 total, 2 up, 3 in 2024-08-31T05:57:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:57:43.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:43 smithi130 ceph-mon[22266]: from='client.? 172.21.15.153:0/810157894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:57:43.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:43 smithi153 ceph-mon[22320]: from='client.? 172.21.15.153:0/810157894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:57:43.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.153:0/810157894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:57:44.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:44 smithi130 ceph-mon[22266]: pgmap v46: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:44.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:44 smithi153 ceph-mon[22320]: pgmap v46: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:44.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:44 smithi053 ceph-mon[18924]: pgmap v46: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:45.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:45 smithi130 ceph-mon[22266]: pgmap v47: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:45.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:45 smithi153 ceph-mon[22320]: pgmap v47: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:45.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:45 smithi053 ceph-mon[18924]: pgmap v47: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:47.518 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:47 smithi153 ceph-mon[22320]: pgmap v48: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:47.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:47 smithi130 ceph-mon[22266]: pgmap v48: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:47.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:47 smithi053 ceph-mon[18924]: pgmap v48: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:49.624 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:49 smithi053 ceph-mon[18924]: pgmap v49: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:49.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:49 smithi130 ceph-mon[22266]: pgmap v49: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:49.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:49 smithi153 ceph-mon[22320]: pgmap v49: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:51.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:51 smithi153 ceph-mon[22320]: pgmap v50: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:51.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T05:57:51.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:51.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:51 smithi153 ceph-mon[22320]: Deploying daemon osd.2 on smithi153 2024-08-31T05:57:51.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:51 smithi130 ceph-mon[22266]: pgmap v50: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:51.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T05:57:51.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:51.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:51 smithi130 ceph-mon[22266]: Deploying daemon osd.2 on smithi153 2024-08-31T05:57:51.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:51 smithi053 ceph-mon[18924]: pgmap v50: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:51.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T05:57:51.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:51.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:51 smithi053 ceph-mon[18924]: Deploying daemon osd.2 on smithi153 2024-08-31T05:57:53.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:53 smithi153 ceph-mon[22320]: pgmap v51: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:53.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:53 smithi130 ceph-mon[22266]: pgmap v51: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:53.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:53 smithi053 ceph-mon[18924]: pgmap v51: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:55.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:55 smithi130 ceph-mon[22266]: pgmap v52: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:55.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:55 smithi153 ceph-mon[22320]: pgmap v52: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:55.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:55 smithi053 ceph-mon[18924]: pgmap v52: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:56 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:56 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:56 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:56.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:56 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:56.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:56 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:56.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:56 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:56.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:56 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:57:56.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:56 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:56.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:56 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:57.834 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:57 smithi153 ceph-mon[22320]: pgmap v53: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:57.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:57 smithi130 ceph-mon[22266]: pgmap v53: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:57.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:57 smithi053 ceph-mon[18924]: pgmap v53: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:59.304 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:59 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:59.304 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:59 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:59.304 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:59 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:59.304 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:59 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:59.305 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:59 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:59.305 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:57:59 smithi153 ceph-mon[22320]: pgmap v54: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:59.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.344+0000 7f5e6f7fe640 1 -- 172.21.15.153:0/3133734642 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5e800635a0 con 0x7f5e680b4af0 2024-08-31T05:57:59.348 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 2 on host 'smithi153' 2024-08-31T05:57:59.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 -- 172.21.15.153:0/3133734642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5e680b4af0 msgr2=0x7f5e680b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:59.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5e680b4af0 0x7f5e680b7000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5e7402a930 tx=0x7f5e74005a40 comp rx=0 tx=0).stop 2024-08-31T05:57:59.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 -- 172.21.15.153:0/3133734642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e80102810 msgr2=0x7f5e8019a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:57:59.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e80102810 0x7f5e8019a150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000ebc0 tx=0x7f5e7000c6a0 comp rx=0 tx=0).stop 2024-08-31T05:57:59.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 -- 172.21.15.153:0/3133734642 shutdown_connections 2024-08-31T05:57:59.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5e680b4af0 0x7f5e680b7000 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:59.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e80108aa0 0x7f5e8019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:59.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e80108150 0x7f5e8019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:59.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 --2- 172.21.15.153:0/3133734642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e80102810 0x7f5e8019a150 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:57:59.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 -- 172.21.15.153:0/3133734642 >> 172.21.15.153:0/3133734642 conn(0x7f5e800794b0 msgr2=0x7f5e80106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:57:59.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 -- 172.21.15.153:0/3133734642 shutdown_connections 2024-08-31T05:57:59.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:57:59.347+0000 7f5e84a21640 1 -- 172.21.15.153:0/3133734642 wait complete. 2024-08-31T05:57:59.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:59 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:59.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:59 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:59.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:59 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:59.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:59 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:59.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:59 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:59.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:57:59 smithi053 ceph-mon[18924]: pgmap v54: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:59.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:59 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:59.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:59 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:59.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:59 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:57:59.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:59 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:57:59.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:59 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:57:59.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:57:59 smithi130 ceph-mon[22266]: pgmap v54: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:57:59.972 DEBUG:teuthology.orchestra.run.smithi153:osd.2> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.2.service 2024-08-31T05:57:59.974 INFO:tasks.cephadm:Deploying osd.3 on smithi053 with /dev/vg_nvme/lv_3... 2024-08-31T05:57:59.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T05:58:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:58:00.357 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:00 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:00.357 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:00 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:00.357 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:00 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:00.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:00 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:00.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:00 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:00.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:00 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:00.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:00 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:00.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:00 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:00.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:00 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:01.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:01 smithi153 ceph-mon[22320]: pgmap v55: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:58:01.349 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:01 smithi053 ceph-mon[18924]: pgmap v55: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:58:01.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:01 smithi130 ceph-mon[22266]: pgmap v55: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:58:02.175 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 05:58:01 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2[28428]: 2024-08-31T05:58:01.791+0000 7f51f79fd640 -1 osd.2 0 log_to_monitors true 2024-08-31T05:58:02.528 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:02 smithi053 ceph-mon[18924]: from='osd.2 [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:58:02.528 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:02 smithi053 ceph-mon[18924]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:58:02.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:02 smithi153 ceph-mon[22320]: from='osd.2 [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:58:02.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:02 smithi153 ceph-mon[22320]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:58:02.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:02 smithi130 ceph-mon[22266]: from='osd.2 [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:58:02.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:02 smithi130 ceph-mon[22266]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:58:02.743 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:58:02.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi053:vg_nvme/lv_3 2024-08-31T05:58:03.025 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:58:03.408 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T05:58:03.408 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: osdmap e15: 3 total, 2 up, 3 in 2024-08-31T05:58:03.408 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: from='osd.2 [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:58:03.408 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:03.409 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:58:03.409 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: pgmap v57: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:58:03.409 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi153 2024-08-31T05:58:03.409 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.409 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.409 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:03.409 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi153 to 17088M 2024-08-31T05:58:03.409 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.409 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:03.409 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:03.409 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.503+0000 7fe73f85e640 1 -- 172.21.15.53:0/317140819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe738109240 msgr2=0x7fe738109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.503+0000 7fe73f85e640 1 --2- 172.21.15.53:0/317140819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe738109240 0x7fe738109650 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe728009900 tx=0x7fe72802a410 comp rx=0 tx=0).stop 2024-08-31T05:58:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.503+0000 7fe73f85e640 1 -- 172.21.15.53:0/317140819 shutdown_connections 2024-08-31T05:58:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.503+0000 7fe73f85e640 1 --2- 172.21.15.53:0/317140819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe738109b90 0x7fe7381103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.503+0000 7fe73f85e640 1 --2- 172.21.15.53:0/317140819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe738109240 0x7fe738109650 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.503+0000 7fe73f85e640 1 --2- 172.21.15.53:0/317140819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe738103900 0x7fe738103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.503+0000 7fe73f85e640 1 -- 172.21.15.53:0/317140819 >> 172.21.15.53:0/317140819 conn(0x7fe73807b5f0 msgr2=0x7fe73807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:58:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.503+0000 7fe73f85e640 1 -- 172.21.15.53:0/317140819 shutdown_connections 2024-08-31T05:58:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.503+0000 7fe73f85e640 1 -- 172.21.15.53:0/317140819 wait complete. 2024-08-31T05:58:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73f85e640 1 Processor -- start 2024-08-31T05:58:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73f85e640 1 -- start start 2024-08-31T05:58:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73f85e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe738103900 0x7fe73819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73f85e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe738109240 0x7fe73819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73f85e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe738109b90 0x7fe73819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73f85e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe738113700 con 0x7fe738109240 2024-08-31T05:58:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73f85e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe738113580 con 0x7fe738109b90 2024-08-31T05:58:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73f85e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe738113880 con 0x7fe738103900 2024-08-31T05:58:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73cdf9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe738109240 0x7fe73819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73cdf9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe738109240 0x7fe73819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57762/0 (socket says 172.21.15.53:57762) 2024-08-31T05:58:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73cdf9640 1 -- 172.21.15.53:0/1745172695 learned_addr learned my addr 172.21.15.53:0/1745172695 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:58:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73ddfb640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe738109b90 0x7fe73819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.504+0000 7fe73d5fa640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe738103900 0x7fe73819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.505+0000 7fe73cdf9640 1 -- 172.21.15.53:0/1745172695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe738103900 msgr2=0x7fe73819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.505+0000 7fe73cdf9640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe738103900 0x7fe73819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.505+0000 7fe73cdf9640 1 -- 172.21.15.53:0/1745172695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe738109b90 msgr2=0x7fe73819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.505+0000 7fe73cdf9640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe738109b90 0x7fe73819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.505+0000 7fe73cdf9640 1 -- 172.21.15.53:0/1745172695 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7381a0060 con 0x7fe738109240 2024-08-31T05:58:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.505+0000 7fe73cdf9640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe738109240 0x7fe73819a750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe728005940 tx=0x7fe7280040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:58:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.505+0000 7fe72e7fc640 1 -- 172.21.15.53:0/1745172695 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72803f030 con 0x7fe738109240 2024-08-31T05:58:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.505+0000 7fe73f85e640 1 -- 172.21.15.53:0/1745172695 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7381a02f0 con 0x7fe738109240 2024-08-31T05:58:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.505+0000 7fe72e7fc640 1 -- 172.21.15.53:0/1745172695 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe728003a80 con 0x7fe738109240 2024-08-31T05:58:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.505+0000 7fe72e7fc640 1 -- 172.21.15.53:0/1745172695 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728035070 con 0x7fe738109240 2024-08-31T05:58:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.505+0000 7fe73f85e640 1 -- 172.21.15.53:0/1745172695 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7381a0820 con 0x7fe738109240 2024-08-31T05:58:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.506+0000 7fe73f85e640 1 -- 172.21.15.53:0/1745172695 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe738103d10 con 0x7fe738109240 2024-08-31T05:58:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.508+0000 7fe72e7fc640 1 -- 172.21.15.53:0/1745172695 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fe728042030 con 0x7fe738109240 2024-08-31T05:58:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.509+0000 7fe72e7fc640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe7240b4ba0 0x7fe7240b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.509+0000 7fe73d5fa640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe7240b4ba0 0x7fe7240b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.509+0000 7fe72e7fc640 1 -- 172.21.15.53:0/1745172695 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2786+0+0 (secure 0 0 0) 0x7fe728104410 con 0x7fe738109240 2024-08-31T05:58:03.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.510+0000 7fe73d5fa640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe7240b4ba0 0x7fe7240b70b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe734005fd0 tx=0x7fe734005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:58:03.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.512+0000 7fe72e7fc640 1 -- 172.21.15.53:0/1745172695 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe7381a0820 con 0x7fe738109240 2024-08-31T05:58:03.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T05:58:03.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: osdmap e15: 3 total, 2 up, 3 in 2024-08-31T05:58:03.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: from='osd.2 [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: pgmap v57: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi153 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi153 to 17088M 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.676 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2[28428]: 2024-08-31T05:58:03.254+0000 7f51f397f640 -1 osd.2 0 waiting for initial osdmap 2024-08-31T05:58:03.676 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2[28428]: 2024-08-31T05:58:03.258+0000 7f51ef77d640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:58:03.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T05:58:03.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: osdmap e15: 3 total, 2 up, 3 in 2024-08-31T05:58:03.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: from='osd.2 [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:58:03.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:03.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:58:03.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: pgmap v57: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:58:03.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi153 2024-08-31T05:58:03.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:03.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi153 to 17088M 2024-08-31T05:58:03.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:03.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:03.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:03.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:03.708+0000 7fe73f85e640 1 -- 172.21.15.53:0/1745172695 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe7380635a0 con 0x7fe7240b4ba0 2024-08-31T05:58:04.380 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:04 smithi053 ceph-mon[18924]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T05:58:04.380 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:04 smithi053 ceph-mon[18924]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T05:58:04.380 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:04.380 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:04.380 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:04 smithi053 ceph-mon[18924]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:04.380 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:58:04.380 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:58:04.380 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:04 smithi130 ceph-mon[22266]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T05:58:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:04 smithi130 ceph-mon[22266]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T05:58:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:04 smithi130 ceph-mon[22266]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:58:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:58:04.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:04.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:04 smithi153 ceph-mon[22320]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T05:58:04.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:04 smithi153 ceph-mon[22320]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T05:58:04.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:04.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:04.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:04 smithi153 ceph-mon[22320]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:04.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:58:04.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:58:04.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:05.412 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:05 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T05:58:05.412 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:05 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T05:58:05.412 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:05 smithi053 ceph-mon[18924]: osd.2 [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014] boot 2024-08-31T05:58:05.413 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:05 smithi053 ceph-mon[18924]: osdmap e17: 3 total, 3 up, 3 in 2024-08-31T05:58:05.413 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:05.413 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:05 smithi053 ceph-mon[18924]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:58:05.413 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:58:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:05 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T05:58:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:05 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T05:58:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:05 smithi130 ceph-mon[22266]: osd.2 [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014] boot 2024-08-31T05:58:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:05 smithi130 ceph-mon[22266]: osdmap e17: 3 total, 3 up, 3 in 2024-08-31T05:58:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:05 smithi130 ceph-mon[22266]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:58:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:58:05.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:05 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T05:58:05.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:05 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T05:58:05.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:05 smithi153 ceph-mon[22320]: osd.2 [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014] boot 2024-08-31T05:58:05.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:05 smithi153 ceph-mon[22320]: osdmap e17: 3 total, 3 up, 3 in 2024-08-31T05:58:05.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:58:05.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:05 smithi153 ceph-mon[22320]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:58:05.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:58:06.476 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41490]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:58:06.476 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41490]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.477 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.477 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41490]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:06.477 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41495]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:58:06.477 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41495]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.477 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.478 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41495]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:06.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T05:58:06.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 ceph-mon[18924]: osdmap e18: 3 total, 3 up, 3 in 2024-08-31T05:58:06.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:58:06.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4245706289' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "251aec00-eb9e-49b9-8c6b-816e44a7da13"} : dispatch 2024-08-31T05:58:06.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T05:58:06.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4245706289' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "251aec00-eb9e-49b9-8c6b-816e44a7da13"}]': finished 2024-08-31T05:58:06.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 ceph-mon[18924]: osdmap e19: 4 total, 3 up, 4 in 2024-08-31T05:58:06.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:06.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41499]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:58:06.480 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41499]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.480 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.480 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41499]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:06.480 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41507]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:58:06.480 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41507]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.481 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.481 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:06 smithi053 sudo[41507]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:06.521 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31882]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:58:06.521 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31882]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.521 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.521 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31882]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:06.521 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31885]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:58:06.522 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31885]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.522 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.522 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31885]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:06.522 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T05:58:06.523 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 ceph-mon[22266]: osdmap e18: 3 total, 3 up, 3 in 2024-08-31T05:58:06.523 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:58:06.523 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4245706289' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "251aec00-eb9e-49b9-8c6b-816e44a7da13"} : dispatch 2024-08-31T05:58:06.523 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T05:58:06.523 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4245706289' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "251aec00-eb9e-49b9-8c6b-816e44a7da13"}]': finished 2024-08-31T05:58:06.524 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 ceph-mon[22266]: osdmap e19: 4 total, 3 up, 4 in 2024-08-31T05:58:06.524 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:06.524 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31888]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:58:06.524 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31888]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.524 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31888]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:06.676 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32041]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:58:06.739 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32041]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.739 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.739 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32041]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:06.739 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32044]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:58:06.739 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32044]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.739 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.739 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32044]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:06.740 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T05:58:06.740 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 ceph-mon[22320]: osdmap e18: 3 total, 3 up, 3 in 2024-08-31T05:58:06.740 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:58:06.740 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4245706289' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "251aec00-eb9e-49b9-8c6b-816e44a7da13"} : dispatch 2024-08-31T05:58:06.740 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T05:58:06.740 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4245706289' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "251aec00-eb9e-49b9-8c6b-816e44a7da13"}]': finished 2024-08-31T05:58:06.740 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 ceph-mon[22320]: osdmap e19: 4 total, 3 up, 4 in 2024-08-31T05:58:06.740 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:06.740 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32047]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:58:06.741 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32047]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.741 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.741 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32047]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:06.741 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32050]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:58:06.741 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32050]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.741 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.741 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:06 smithi153 sudo[32050]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:06.880 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31891]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:58:06.880 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31891]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:58:06.880 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:58:06.880 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:06 smithi130 sudo[31891]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:58:07.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:07.286+0000 7fe72e7fc640 1 -- 172.21.15.53:0/1745172695 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fe7280c86a0 con 0x7fe738109240 2024-08-31T05:58:07.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:07.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:07.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:07.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:58:07.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:58:07.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:58:07.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:58:07.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1330806949' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:58:07.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: osdmap e20: 4 total, 3 up, 4 in 2024-08-31T05:58:07.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:07.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:07.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:58:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:58:07.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:58:07.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:58:07.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:58:07.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:58:07.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:58:07.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1330806949' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:58:07.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: osdmap e20: 4 total, 3 up, 4 in 2024-08-31T05:58:07.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1330806949' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: osdmap e20: 4 total, 3 up, 4 in 2024-08-31T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:08.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:08 smithi130 ceph-mon[22266]: mgrmap e20: x(active, since 113s), standbys: z, y 2024-08-31T05:58:08.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:08 smithi053 ceph-mon[18924]: mgrmap e20: x(active, since 113s), standbys: z, y 2024-08-31T05:58:08.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:08 smithi153 ceph-mon[22320]: mgrmap e20: x(active, since 113s), standbys: z, y 2024-08-31T05:58:09.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:09 smithi130 ceph-mon[22266]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:09.638 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:09 smithi053 ceph-mon[18924]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:09.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:09 smithi153 ceph-mon[22320]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:11.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:11 smithi053 ceph-mon[18924]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:11.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:11 smithi130 ceph-mon[22266]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:11.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:11 smithi153 ceph-mon[22320]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:13.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:13 smithi053 ceph-mon[18924]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:13.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:13 smithi130 ceph-mon[22266]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:13.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:13 smithi153 ceph-mon[22320]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:15 smithi053 ceph-mon[18924]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:15.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T05:58:15.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:15.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:15 smithi053 ceph-mon[18924]: Deploying daemon osd.3 on smithi053 2024-08-31T05:58:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:15 smithi130 ceph-mon[22266]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T05:58:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:15 smithi130 ceph-mon[22266]: Deploying daemon osd.3 on smithi053 2024-08-31T05:58:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:15 smithi153 ceph-mon[22320]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T05:58:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:15 smithi153 ceph-mon[22320]: Deploying daemon osd.3 on smithi053 2024-08-31T05:58:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:17 smithi053 ceph-mon[18924]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:17 smithi130 ceph-mon[22266]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:17.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:17 smithi153 ceph-mon[22320]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:19.579 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:19 smithi053 ceph-mon[18924]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:19.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:19 smithi130 ceph-mon[22266]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:19.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:19 smithi153 ceph-mon[22320]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:20.499 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:20.499 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:20.499 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:20 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:20 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:20.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:20.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:20.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:20 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:21.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:21 smithi130 ceph-mon[22266]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:22.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:21 smithi053 ceph-mon[18924]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:21 smithi153 ceph-mon[22320]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:23.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.232+0000 7fe72e7fc640 1 -- 172.21.15.53:0/1745172695 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe7380635a0 con 0x7fe7240b4ba0 2024-08-31T05:58:23.235 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 3 on host 'smithi053' 2024-08-31T05:58:23.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 -- 172.21.15.53:0/1745172695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe7240b4ba0 msgr2=0x7fe7240b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:23.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe7240b4ba0 0x7fe7240b70b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe734005fd0 tx=0x7fe734005850 comp rx=0 tx=0).stop 2024-08-31T05:58:23.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 -- 172.21.15.53:0/1745172695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe738109240 msgr2=0x7fe73819a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:23.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe738109240 0x7fe73819a750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe728005940 tx=0x7fe7280040e0 comp rx=0 tx=0).stop 2024-08-31T05:58:23.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 -- 172.21.15.53:0/1745172695 shutdown_connections 2024-08-31T05:58:23.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe7240b4ba0 0x7fe7240b70b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:23.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe738109b90 0x7fe73819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:23.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe738109240 0x7fe73819a750 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:23.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 --2- 172.21.15.53:0/1745172695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe738103900 0x7fe73819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:23.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 -- 172.21.15.53:0/1745172695 >> 172.21.15.53:0/1745172695 conn(0x7fe73807b5f0 msgr2=0x7fe738105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:58:23.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 -- 172.21.15.53:0/1745172695 shutdown_connections 2024-08-31T05:58:23.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:58:23.234+0000 7fe73f85e640 1 -- 172.21.15.53:0/1745172695 wait complete. 2024-08-31T05:58:23.847 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:23 smithi053 ceph-mon[18924]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:23.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:23.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:23.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:23.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.875 DEBUG:teuthology.orchestra.run.smithi053:osd.3> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.3.service 2024-08-31T05:58:23.877 INFO:tasks.cephadm:Deploying osd.4 on smithi130 with /dev/vg_nvme/lv_3... 2024-08-31T05:58:23.878 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T05:58:23.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:23 smithi130 ceph-mon[22266]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:23.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:23.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:23.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:23.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:23 smithi153 ceph-mon[22320]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:23.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:23.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:23.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:23.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:23.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:24.136 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:58:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:25 smithi130 ceph-mon[22266]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:25 smithi153 ceph-mon[22320]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:25 smithi053 ceph-mon[18924]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:26.253 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:58:26.279 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_3 2024-08-31T05:58:26.378 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 05:58:26 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3[43509]: 2024-08-31T05:58:26.148+0000 7f1c9230c640 -1 osd.3 0 log_to_monitors true 2024-08-31T05:58:26.527 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:58:26.670 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:26 smithi053 ceph-mon[18924]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T05:58:26.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:26 smithi130 ceph-mon[22266]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T05:58:26.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:26 smithi153 ceph-mon[22320]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T05:58:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.013+0000 7f3860e7d640 1 -- 172.21.15.130:0/695172751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c109c60 msgr2=0x7f385c110490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.013+0000 7f3860e7d640 1 --2- 172.21.15.130:0/695172751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c109c60 0x7f385c110490 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f384c009900 tx=0x7f384c02a410 comp rx=0 tx=0).stop 2024-08-31T05:58:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.013+0000 7f3860e7d640 1 -- 172.21.15.130:0/695172751 shutdown_connections 2024-08-31T05:58:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.013+0000 7f3860e7d640 1 --2- 172.21.15.130:0/695172751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c109c60 0x7f385c110490 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.013+0000 7f3860e7d640 1 --2- 172.21.15.130:0/695172751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f385c109310 0x7f385c109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.013+0000 7f3860e7d640 1 --2- 172.21.15.130:0/695172751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385c1039d0 0x7f385c103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.013+0000 7f3860e7d640 1 -- 172.21.15.130:0/695172751 >> 172.21.15.130:0/695172751 conn(0x7f385c07b670 msgr2=0x7f385c07ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:58:27.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.013+0000 7f3860e7d640 1 -- 172.21.15.130:0/695172751 shutdown_connections 2024-08-31T05:58:27.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.013+0000 7f3860e7d640 1 -- 172.21.15.130:0/695172751 wait complete. 2024-08-31T05:58:27.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.014+0000 7f3860e7d640 1 Processor -- start 2024-08-31T05:58:27.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.014+0000 7f3860e7d640 1 -- start start 2024-08-31T05:58:27.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f3860e7d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385c1039d0 0x7f385c19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:27.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f3860e7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f385c109310 0x7f385c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f3860e7d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c109c60 0x7f385c19f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f3860e7d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f385c113730 con 0x7f385c109310 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f3860e7d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f385c1135b0 con 0x7f385c109c60 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f3860e7d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f385c1138b0 con 0x7f385c1039d0 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f385ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c109c60 0x7f385c19f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f385ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c109c60 0x7f385c19f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34680/0 (socket says 172.21.15.130:34680) 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f385ad9d640 1 -- 172.21.15.130:0/3650968535 learned_addr learned my addr 172.21.15.130:0/3650968535 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f3859d9b640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f385c109310 0x7f385c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f385a59c640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385c1039d0 0x7f385c19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f385ad9d640 1 -- 172.21.15.130:0/3650968535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385c1039d0 msgr2=0x7f385c19a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f385ad9d640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385c1039d0 0x7f385c19a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:27.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f385ad9d640 1 -- 172.21.15.130:0/3650968535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f385c109310 msgr2=0x7f385c19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:27.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f385ad9d640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f385c109310 0x7f385c19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:27.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f385ad9d640 1 -- 172.21.15.130:0/3650968535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c1a0070 con 0x7f385c109c60 2024-08-31T05:58:27.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.015+0000 7f385ad9d640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c109c60 0x7f385c19f940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f384c004770 tx=0x7f384c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:58:27.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.016+0000 7f38537fe640 1 -- 172.21.15.130:0/3650968535 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c03f030 con 0x7f385c109c60 2024-08-31T05:58:27.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.016+0000 7f38537fe640 1 -- 172.21.15.130:0/3650968535 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f384c004440 con 0x7f385c109c60 2024-08-31T05:58:27.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.016+0000 7f3860e7d640 1 -- 172.21.15.130:0/3650968535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385c1a0300 con 0x7f385c109c60 2024-08-31T05:58:27.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.016+0000 7f38537fe640 1 -- 172.21.15.130:0/3650968535 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c035070 con 0x7f385c109c60 2024-08-31T05:58:27.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.016+0000 7f3860e7d640 1 -- 172.21.15.130:0/3650968535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f385c1a6ac0 con 0x7f385c109c60 2024-08-31T05:58:27.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.017+0000 7f3860e7d640 1 -- 172.21.15.130:0/3650968535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f385c104c50 con 0x7f385c109c60 2024-08-31T05:58:27.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.018+0000 7f38537fe640 1 -- 172.21.15.130:0/3650968535 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f384c042030 con 0x7f385c109c60 2024-08-31T05:58:27.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.019+0000 7f38537fe640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38480b4b80 0x7f38480b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:27.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.019+0000 7f385a59c640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38480b4b80 0x7f38480b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:27.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.019+0000 7f38537fe640 1 -- 172.21.15.130:0/3650968535 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3588+0+0 (secure 0 0 0) 0x7f384c1046c0 con 0x7f385c109c60 2024-08-31T05:58:27.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.020+0000 7f385a59c640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38480b4b80 0x7f38480b7090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3854005fd0 tx=0x7f3854009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:58:27.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.023+0000 7f38537fe640 1 -- 172.21.15.130:0/3650968535 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f384c0cc410 con 0x7f385c109c60 2024-08-31T05:58:27.217 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:27.215+0000 7f3860e7d640 1 -- 172.21.15.130:0/3650968535 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f385c0635a0 con 0x7f38480b4b80 2024-08-31T05:58:27.848 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:27.848 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T05:58:27.848 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: osdmap e21: 4 total, 3 up, 4 in 2024-08-31T05:58:27.848 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T05:58:27.848 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:27.848 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi053 2024-08-31T05:58:27.848 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.848 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:27.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:27.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi053 to 8546M 2024-08-31T05:58:27.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:27.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:27.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:58:27.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:58:27.849 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T05:58:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: osdmap e21: 4 total, 3 up, 4 in 2024-08-31T05:58:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T05:58:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi053 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi053 to 8546M 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:58:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:27.975 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3[43509]: 2024-08-31T05:58:27.605+0000 7f1c8e28e640 -1 osd.3 0 waiting for initial osdmap 2024-08-31T05:58:27.976 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3[43509]: 2024-08-31T05:58:27.613+0000 7f1c8a08c640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:58:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T05:58:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: osdmap e21: 4 total, 3 up, 4 in 2024-08-31T05:58:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T05:58:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi053 2024-08-31T05:58:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:27.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:27.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi053 to 8546M 2024-08-31T05:58:27.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:27.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:27.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:27.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:58:27.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:58:27.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:28.828 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:28 smithi130 ceph-mon[22266]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:28.828 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:28 smithi130 ceph-mon[22266]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T05:58:28.828 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:28 smithi130 ceph-mon[22266]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T05:58:28.828 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:28 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:28.828 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:28 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:28.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:28 smithi153 ceph-mon[22320]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:28.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:28 smithi153 ceph-mon[22320]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T05:58:28.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:28 smithi153 ceph-mon[22320]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T05:58:28.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:28 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:28.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:28 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:28.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:28 smithi053 ceph-mon[18924]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:28.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:28 smithi053 ceph-mon[18924]: from='osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T05:58:28.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:28 smithi053 ceph-mon[18924]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T05:58:28.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:28 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:28.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:28 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:29.864 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T05:58:29.864 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T05:58:29.865 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:29.865 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211] boot 2024-08-31T05:58:29.865 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: osdmap e23: 4 total, 4 up, 4 in 2024-08-31T05:58:29.865 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:29.865 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: osdmap e24: 4 total, 4 up, 4 in 2024-08-31T05:58:29.865 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: from='client.? 172.21.15.130:0/256854826' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03860b7f-13ce-4461-8d17-b44bb2bc232a"} : dispatch 2024-08-31T05:58:29.865 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03860b7f-13ce-4461-8d17-b44bb2bc232a"} : dispatch 2024-08-31T05:58:29.865 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03860b7f-13ce-4461-8d17-b44bb2bc232a"}]': finished 2024-08-31T05:58:29.865 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: osdmap e25: 5 total, 4 up, 5 in 2024-08-31T05:58:29.865 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:29 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T05:58:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T05:58:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:29.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211] boot 2024-08-31T05:58:29.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: osdmap e23: 4 total, 4 up, 4 in 2024-08-31T05:58:29.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:29.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: osdmap e24: 4 total, 4 up, 4 in 2024-08-31T05:58:29.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: from='client.? 172.21.15.130:0/256854826' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03860b7f-13ce-4461-8d17-b44bb2bc232a"} : dispatch 2024-08-31T05:58:29.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03860b7f-13ce-4461-8d17-b44bb2bc232a"} : dispatch 2024-08-31T05:58:29.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03860b7f-13ce-4461-8d17-b44bb2bc232a"}]': finished 2024-08-31T05:58:29.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: osdmap e25: 5 total, 4 up, 5 in 2024-08-31T05:58:29.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:29 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T05:58:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T05:58:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:58:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: osd.3 [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211] boot 2024-08-31T05:58:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: osdmap e23: 4 total, 4 up, 4 in 2024-08-31T05:58:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:58:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: osdmap e24: 4 total, 4 up, 4 in 2024-08-31T05:58:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: from='client.? 172.21.15.130:0/256854826' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03860b7f-13ce-4461-8d17-b44bb2bc232a"} : dispatch 2024-08-31T05:58:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03860b7f-13ce-4461-8d17-b44bb2bc232a"} : dispatch 2024-08-31T05:58:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03860b7f-13ce-4461-8d17-b44bb2bc232a"}]': finished 2024-08-31T05:58:29.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: osdmap e25: 5 total, 4 up, 5 in 2024-08-31T05:58:29.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:29 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:30.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:30 smithi153 ceph-mon[22320]: from='client.? 172.21.15.130:0/93569177' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:58:30.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:30 smithi053 ceph-mon[18924]: from='client.? 172.21.15.130:0/93569177' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:58:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:30 smithi130 ceph-mon[22266]: from='client.? 172.21.15.130:0/93569177' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:58:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:31 smithi153 ceph-mon[22320]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:31 smithi053 ceph-mon[18924]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:31 smithi130 ceph-mon[22266]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:33 smithi153 ceph-mon[22320]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-08-31T05:58:33.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:33 smithi053 ceph-mon[18924]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-08-31T05:58:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:33 smithi130 ceph-mon[22266]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-08-31T05:58:35.923 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:35 smithi130 ceph-mon[22266]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:58:35.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:35 smithi153 ceph-mon[22320]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:58:35.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:35 smithi053 ceph-mon[18924]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:58:37.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:37 smithi130 ceph-mon[22266]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T05:58:37.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:37 smithi153 ceph-mon[22320]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T05:58:37.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:37 smithi053 ceph-mon[18924]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T05:58:38.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T05:58:38.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:38.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:38 smithi130 ceph-mon[22266]: Deploying daemon osd.4 on smithi130 2024-08-31T05:58:38.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T05:58:38.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:38.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:38 smithi153 ceph-mon[22320]: Deploying daemon osd.4 on smithi130 2024-08-31T05:58:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T05:58:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:38 smithi053 ceph-mon[18924]: Deploying daemon osd.4 on smithi130 2024-08-31T05:58:39.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:39 smithi130 ceph-mon[22266]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T05:58:39.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:39 smithi053 ceph-mon[18924]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T05:58:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:39 smithi153 ceph-mon[22320]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T05:58:41.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:41 smithi130 ceph-mon[22266]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T05:58:41.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:41 smithi053 ceph-mon[18924]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T05:58:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:41 smithi153 ceph-mon[22320]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T05:58:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:43 smithi130 ceph-mon[22266]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:58:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:43 smithi053 ceph-mon[18924]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:58:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:43 smithi153 ceph-mon[22320]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:58:44.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:44.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:44.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:45 smithi053 ceph-mon[18924]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:45 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:45 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:45 smithi130 ceph-mon[22266]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:45 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:45 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:46.175 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 4 on host 'smithi130' 2024-08-31T05:58:46.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.172+0000 7f38537fe640 1 -- 172.21.15.130:0/3650968535 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f385c0635a0 con 0x7f38480b4b80 2024-08-31T05:58:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:45 smithi153 ceph-mon[22320]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:45 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:45 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 -- 172.21.15.130:0/3650968535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38480b4b80 msgr2=0x7f38480b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38480b4b80 0x7f38480b7090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3854005fd0 tx=0x7f3854009680 comp rx=0 tx=0).stop 2024-08-31T05:58:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 -- 172.21.15.130:0/3650968535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c109c60 msgr2=0x7f385c19f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c109c60 0x7f385c19f940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f384c004770 tx=0x7f384c004040 comp rx=0 tx=0).stop 2024-08-31T05:58:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 -- 172.21.15.130:0/3650968535 shutdown_connections 2024-08-31T05:58:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38480b4b80 0x7f38480b7090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f385c109c60 0x7f385c19f940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f385c109310 0x7f385c19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 --2- 172.21.15.130:0/3650968535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385c1039d0 0x7f385c19a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 -- 172.21.15.130:0/3650968535 >> 172.21.15.130:0/3650968535 conn(0x7f385c07b670 msgr2=0x7f385c1052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:58:46.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 -- 172.21.15.130:0/3650968535 shutdown_connections 2024-08-31T05:58:46.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:58:46.175+0000 7f3860e7d640 1 -- 172.21.15.130:0/3650968535 wait complete. 2024-08-31T05:58:46.738 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:46.738 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:46.738 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:46.738 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:46.738 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:46.738 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:46.740 DEBUG:teuthology.orchestra.run.smithi130:osd.4> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.4.service 2024-08-31T05:58:46.742 INFO:tasks.cephadm:Deploying osd.5 on smithi153 with /dev/vg_nvme/lv_3... 2024-08-31T05:58:46.742 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T05:58:46.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:46.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:46.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:46.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:46.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:46.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:46.997 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:58:47.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:47.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:47.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:47.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:58:47.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:47.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:48.232 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:48 smithi153 ceph-mon[22320]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:48.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:48 smithi130 ceph-mon[22266]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:48.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:48 smithi053 ceph-mon[18924]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:49.256 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T05:58:49.283 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi153:vg_nvme/lv_3 2024-08-31T05:58:49.425 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:49 smithi130 ceph-mon[22266]: from='osd.4 [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:58:49.425 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:49 smithi130 ceph-mon[22266]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:58:49.425 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 05:58:49 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4[34509]: 2024-08-31T05:58:49.141+0000 7f813f0a3640 -1 osd.4 0 log_to_monitors true 2024-08-31T05:58:49.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:49 smithi053 ceph-mon[18924]: from='osd.4 [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:58:49.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:49 smithi053 ceph-mon[18924]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:58:49.537 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:58:49.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:49 smithi153 ceph-mon[22320]: from='osd.4 [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:58:49.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:49 smithi153 ceph-mon[22320]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:58:49.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.970+0000 7fc542b34640 1 -- 172.21.15.153:0/1975136245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc53c102f40 msgr2=0x7fc53c103350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:49.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.970+0000 7fc542b34640 1 --2- 172.21.15.153:0/1975136245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc53c102f40 0x7fc53c103350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc530009930 tx=0x7fc53002a420 comp rx=0 tx=0).stop 2024-08-31T05:58:49.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.970+0000 7fc542b34640 1 -- 172.21.15.153:0/1975136245 shutdown_connections 2024-08-31T05:58:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.970+0000 7fc542b34640 1 --2- 172.21.15.153:0/1975136245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc53c1058a0 0x7fc53c10f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.970+0000 7fc542b34640 1 --2- 172.21.15.153:0/1975136245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c104f50 0x7fc53c105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.970+0000 7fc542b34640 1 --2- 172.21.15.153:0/1975136245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc53c102f40 0x7fc53c103350 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.970+0000 7fc542b34640 1 -- 172.21.15.153:0/1975136245 >> 172.21.15.153:0/1975136245 conn(0x7fc53c077a60 msgr2=0x7fc53c077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:58:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.971+0000 7fc542b34640 1 -- 172.21.15.153:0/1975136245 shutdown_connections 2024-08-31T05:58:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.971+0000 7fc542b34640 1 -- 172.21.15.153:0/1975136245 wait complete. 2024-08-31T05:58:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.971+0000 7fc542b34640 1 Processor -- start 2024-08-31T05:58:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.971+0000 7fc542b34640 1 -- start start 2024-08-31T05:58:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc542b34640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc53c102f40 0x7fc53c199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc542b34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c104f50 0x7fc53c1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc542b34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc53c1058a0 0x7fc53c19e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc542b34640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c112630 con 0x7fc53c104f50 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc542b34640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c1124b0 con 0x7fc53c1058a0 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc542b34640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c1127b0 con 0x7fc53c102f40 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc5408d0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc53c102f40 0x7fc53c199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc5408d0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc53c102f40 0x7fc53c199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47486/0 (socket says 172.21.15.153:47486) 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc5408d0640 1 -- 172.21.15.153:0/437740013 learned_addr learned my addr 172.21.15.153:0/437740013 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc53bfff640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c104f50 0x7fc53c1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc5410d1640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc53c1058a0 0x7fc53c19e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc5408d0640 1 -- 172.21.15.153:0/437740013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc53c1058a0 msgr2=0x7fc53c19e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc5408d0640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc53c1058a0 0x7fc53c19e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc5408d0640 1 -- 172.21.15.153:0/437740013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c104f50 msgr2=0x7fc53c1996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:58:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc5408d0640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c104f50 0x7fc53c1996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:58:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc5408d0640 1 -- 172.21.15.153:0/437740013 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c19f090 con 0x7fc53c102f40 2024-08-31T05:58:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc5410d1640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc53c1058a0 0x7fc53c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:58:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.972+0000 7fc5408d0640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc53c102f40 0x7fc53c199120 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc530005940 tx=0x7fc5300040e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:58:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.973+0000 7fc539ffb640 1 -- 172.21.15.153:0/437740013 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53003f030 con 0x7fc53c102f40 2024-08-31T05:58:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.973+0000 7fc542b34640 1 -- 172.21.15.153:0/437740013 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc53c19f320 con 0x7fc53c102f40 2024-08-31T05:58:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.973+0000 7fc539ffb640 1 -- 172.21.15.153:0/437740013 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc530003a80 con 0x7fc53c102f40 2024-08-31T05:58:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.973+0000 7fc539ffb640 1 -- 172.21.15.153:0/437740013 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530035070 con 0x7fc53c102f40 2024-08-31T05:58:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.973+0000 7fc542b34640 1 -- 172.21.15.153:0/437740013 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc53c1a5ae0 con 0x7fc53c102f40 2024-08-31T05:58:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.974+0000 7fc542b34640 1 -- 172.21.15.153:0/437740013 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc53c103350 con 0x7fc53c102f40 2024-08-31T05:58:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.975+0000 7fc539ffb640 1 -- 172.21.15.153:0/437740013 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fc530042030 con 0x7fc53c102f40 2024-08-31T05:58:49.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.976+0000 7fc539ffb640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc52c0b4b80 0x7fc52c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:58:49.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.976+0000 7fc539ffb640 1 -- 172.21.15.153:0/437740013 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4020+0+0 (secure 0 0 0) 0x7fc530104650 con 0x7fc53c102f40 2024-08-31T05:58:49.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.976+0000 7fc53bfff640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc52c0b4b80 0x7fc52c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:58:49.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.977+0000 7fc53bfff640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc52c0b4b80 0x7fc52c0b7090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc53c1083d0 tx=0x7fc52800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:58:49.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:49.981+0000 7fc539ffb640 1 -- 172.21.15.153:0/437740013 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc5300cc840 con 0x7fc53c102f40 2024-08-31T05:58:50.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:58:50.174+0000 7fc542b34640 1 -- 172.21.15.153:0/437740013 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc53c10a990 con 0x7fc52c0b4b80 2024-08-31T05:58:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T05:58:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: osdmap e26: 5 total, 4 up, 5 in 2024-08-31T05:58:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='osd.4 [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:58:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:58:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:50.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:50.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T05:58:50.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: osdmap e26: 5 total, 4 up, 5 in 2024-08-31T05:58:50.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:50.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='osd.4 [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:58:50.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:58:50.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:50.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:50.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:50.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:50.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:50.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:50.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:50.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:50.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:50.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: osdmap e26: 5 total, 4 up, 5 in 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='osd.4 [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:58:50.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:58:51.378 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4[34509]: 2024-08-31T05:58:51.090+0000 7f813b025640 -1 osd.4 0 waiting for initial osdmap 2024-08-31T05:58:51.378 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4[34509]: 2024-08-31T05:58:51.174+0000 7f8132e1b640 -1 osd.4 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:58:51.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi130 2024-08-31T05:58:51.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi130 to 8544M 2024-08-31T05:58:51.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:51.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:58:51.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T05:58:51.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: osdmap e27: 5 total, 4 up, 5 in 2024-08-31T05:58:51.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:51.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:58:51.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:51.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:51.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:51.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:51 smithi130 ceph-mon[22266]: from='osd.4 ' entity='osd.4' 2024-08-31T05:58:51.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi130 2024-08-31T05:58:51.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi130 to 8544M 2024-08-31T05:58:51.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:51.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:58:51.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T05:58:51.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: osdmap e27: 5 total, 4 up, 5 in 2024-08-31T05:58:51.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:51.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:58:51.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:51.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:51.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:51.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:51 smithi053 ceph-mon[18924]: from='osd.4 ' entity='osd.4' 2024-08-31T05:58:51.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi130 2024-08-31T05:58:51.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi130 to 8544M 2024-08-31T05:58:51.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:51.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:58:51.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T05:58:51.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: osdmap e27: 5 total, 4 up, 5 in 2024-08-31T05:58:51.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:51.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:58:51.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:58:51.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:51.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:58:51.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:51 smithi153 ceph-mon[22320]: from='osd.4 ' entity='osd.4' 2024-08-31T05:58:52.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:52 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T05:58:52.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:52 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T05:58:52.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:52 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:52.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:52 smithi153 ceph-mon[22320]: osd.4 [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664] boot 2024-08-31T05:58:52.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:52 smithi153 ceph-mon[22320]: osdmap e28: 5 total, 5 up, 5 in 2024-08-31T05:58:52.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:52 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:52 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T05:58:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:52 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T05:58:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:52 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:52 smithi053 ceph-mon[18924]: osd.4 [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664] boot 2024-08-31T05:58:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:52 smithi053 ceph-mon[18924]: osdmap e28: 5 total, 5 up, 5 in 2024-08-31T05:58:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:52 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:52 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T05:58:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:52 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T05:58:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:52 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:52 smithi130 ceph-mon[22266]: osd.4 [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664] boot 2024-08-31T05:58:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:52 smithi130 ceph-mon[22266]: osdmap e28: 5 total, 5 up, 5 in 2024-08-31T05:58:52.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:52 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:58:53.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:53 smithi153 ceph-mon[22320]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:58:53.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:53 smithi153 ceph-mon[22320]: from='client.? 172.21.15.153:0/1085000576' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fc8b987-9839-4db8-a64e-15c233be0651"} : dispatch 2024-08-31T05:58:53.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:53 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fc8b987-9839-4db8-a64e-15c233be0651"} : dispatch 2024-08-31T05:58:53.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:53 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fc8b987-9839-4db8-a64e-15c233be0651"}]': finished 2024-08-31T05:58:53.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:53 smithi153 ceph-mon[22320]: osdmap e29: 6 total, 5 up, 6 in 2024-08-31T05:58:53.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:58:53.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:53 smithi153 ceph-mon[22320]: from='client.? 172.21.15.153:0/1172616444' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:58:53.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:53 smithi053 ceph-mon[18924]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:58:53.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:53 smithi053 ceph-mon[18924]: from='client.? 172.21.15.153:0/1085000576' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fc8b987-9839-4db8-a64e-15c233be0651"} : dispatch 2024-08-31T05:58:53.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:53 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fc8b987-9839-4db8-a64e-15c233be0651"} : dispatch 2024-08-31T05:58:53.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:53 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fc8b987-9839-4db8-a64e-15c233be0651"}]': finished 2024-08-31T05:58:53.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:53 smithi053 ceph-mon[18924]: osdmap e29: 6 total, 5 up, 6 in 2024-08-31T05:58:53.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:58:53.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:53 smithi053 ceph-mon[18924]: from='client.? 172.21.15.153:0/1172616444' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:58:53.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:53 smithi130 ceph-mon[22266]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:58:53.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:53 smithi130 ceph-mon[22266]: from='client.? 172.21.15.153:0/1085000576' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fc8b987-9839-4db8-a64e-15c233be0651"} : dispatch 2024-08-31T05:58:53.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:53 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9fc8b987-9839-4db8-a64e-15c233be0651"} : dispatch 2024-08-31T05:58:53.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:53 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fc8b987-9839-4db8-a64e-15c233be0651"}]': finished 2024-08-31T05:58:53.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:53 smithi130 ceph-mon[22266]: osdmap e29: 6 total, 5 up, 6 in 2024-08-31T05:58:53.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:58:53.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:53 smithi130 ceph-mon[22266]: from='client.? 172.21.15.153:0/1172616444' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:58:55.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:55 smithi130 ceph-mon[22266]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:58:55.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:55 smithi153 ceph-mon[22320]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:58:55.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:55 smithi053 ceph-mon[18924]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:58:57.607 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:57 smithi153 ceph-mon[22320]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:58:57.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:57 smithi130 ceph-mon[22266]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:58:57.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:57 smithi053 ceph-mon[18924]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:58:59.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:58:59 smithi153 ceph-mon[22320]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:58:59.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:58:59 smithi130 ceph-mon[22266]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:58:59.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:58:59 smithi053 ceph-mon[18924]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:01.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:01 smithi153 ceph-mon[22320]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:01.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:01 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T05:59:01.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:01 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:01.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:01 smithi153 ceph-mon[22320]: Deploying daemon osd.5 on smithi153 2024-08-31T05:59:01.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:01 smithi130 ceph-mon[22266]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:01.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:01 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T05:59:01.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:01 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:01.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:01 smithi130 ceph-mon[22266]: Deploying daemon osd.5 on smithi153 2024-08-31T05:59:01.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:01 smithi053 ceph-mon[18924]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:01.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:01 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T05:59:01.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:01 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:01.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:01 smithi053 ceph-mon[18924]: Deploying daemon osd.5 on smithi153 2024-08-31T05:59:03.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:03 smithi130 ceph-mon[22266]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:03.639 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:03 smithi153 ceph-mon[22320]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:03.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:03 smithi053 ceph-mon[18924]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:05 smithi130 ceph-mon[22266]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:05.649 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:05 smithi153 ceph-mon[22320]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:05.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:05 smithi053 ceph-mon[18924]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:06.618 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:06 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:06.619 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:06 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:06.619 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:06 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:06 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:06 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:06 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:06.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:06 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:06.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:06 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:06.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:06 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:08.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:08 smithi153 ceph-mon[22320]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:08.798 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:08 smithi130 ceph-mon[22266]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:08.798 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:08 smithi053 ceph-mon[18924]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:09.750 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:09 smithi153 ceph-mon[22320]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:09.750 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:09.750 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:09.750 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:09.751 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:09.751 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:09.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:09 smithi130 ceph-mon[22266]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:09.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:09.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:09.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:09.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:09.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:09.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:09 smithi053 ceph-mon[18924]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:09.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:09.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:09.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:09.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:09.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:10.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.021+0000 7fc539ffb640 1 -- 172.21.15.153:0/437740013 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc53c10a990 con 0x7fc52c0b4b80 2024-08-31T05:59:10.025 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 5 on host 'smithi153' 2024-08-31T05:59:10.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 -- 172.21.15.153:0/437740013 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc52c0b4b80 msgr2=0x7fc52c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:10.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc52c0b4b80 0x7fc52c0b7090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc53c1083d0 tx=0x7fc52800a2d0 comp rx=0 tx=0).stop 2024-08-31T05:59:10.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 -- 172.21.15.153:0/437740013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc53c102f40 msgr2=0x7fc53c199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:10.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc53c102f40 0x7fc53c199120 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc530005940 tx=0x7fc5300040e0 comp rx=0 tx=0).stop 2024-08-31T05:59:10.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 -- 172.21.15.153:0/437740013 shutdown_connections 2024-08-31T05:59:10.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc52c0b4b80 0x7fc52c0b7090 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:10.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc53c1058a0 0x7fc53c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:10.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c104f50 0x7fc53c1996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:10.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 --2- 172.21.15.153:0/437740013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc53c102f40 0x7fc53c199120 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:10.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 -- 172.21.15.153:0/437740013 >> 172.21.15.153:0/437740013 conn(0x7fc53c077a60 msgr2=0x7fc53c106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:59:10.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 -- 172.21.15.153:0/437740013 shutdown_connections 2024-08-31T05:59:10.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T05:59:10.024+0000 7fc542b34640 1 -- 172.21.15.153:0/437740013 wait complete. 2024-08-31T05:59:10.645 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:10 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:10.646 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:10 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:10.646 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:10 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:10.672 DEBUG:teuthology.orchestra.run.smithi153:osd.5> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.5.service 2024-08-31T05:59:10.675 INFO:tasks.cephadm:Deploying osd.6 on smithi053 with /dev/vg_nvme/lv_2... 2024-08-31T05:59:10.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T05:59:10.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:10 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:10.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:10 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:10.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:10 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:10.937 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:59:10.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:10 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:10.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:10 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:10.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:10 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:12.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:12 smithi153 ceph-mon[22320]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:12.090 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 05:59:12 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T05:59:12.039+0000 7fdc05b9a640 -1 osd.5 0 log_to_monitors true 2024-08-31T05:59:12.298 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:12 smithi053 ceph-mon[18924]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:12 smithi130 ceph-mon[22266]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:13.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:13 smithi053 ceph-mon[18924]: from='osd.5 [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:59:13.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:13 smithi053 ceph-mon[18924]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:59:13.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:13 smithi130 ceph-mon[22266]: from='osd.5 [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:59:13.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:13 smithi130 ceph-mon[22266]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:59:13.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:13 smithi153 ceph-mon[22320]: from='osd.5 [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:59:13.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:13 smithi153 ceph-mon[22320]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:59:13.588 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T05:59:13.616 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi053:vg_nvme/lv_2 2024-08-31T05:59:13.870 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:59:14.187 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:14.187 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T05:59:14.187 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: osdmap e30: 6 total, 5 up, 6 in 2024-08-31T05:59:14.187 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:14.187 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='osd.5 [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:59:14.187 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:59:14.188 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.188 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.188 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:14.188 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:14.188 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.188 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:14.188 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:14.188 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T05:59:14.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: osdmap e30: 6 total, 5 up, 6 in 2024-08-31T05:59:14.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:14.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='osd.5 [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:59:14.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:59:14.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:14.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:14.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:14.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:14.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.399+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/1056972553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7acc102800 msgr2=0x7f7acc102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:14.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.399+0000 7f7ad1a3c640 1 --2- 172.21.15.53:0/1056972553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7acc102800 0x7f7acc102c10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009900 tx=0x7f7abc02a410 comp rx=0 tx=0).stop 2024-08-31T05:59:14.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.399+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/1056972553 shutdown_connections 2024-08-31T05:59:14.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.399+0000 7f7ad1a3c640 1 --2- 172.21.15.53:0/1056972553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7acc108a90 0x7f7acc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.399+0000 7f7ad1a3c640 1 --2- 172.21.15.53:0/1056972553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7acc108140 0x7f7acc108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.399+0000 7f7ad1a3c640 1 --2- 172.21.15.53:0/1056972553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7acc102800 0x7f7acc102c10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.399+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/1056972553 >> 172.21.15.53:0/1056972553 conn(0x7f7acc0794d0 msgr2=0x7f7acc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:59:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.399+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/1056972553 shutdown_connections 2024-08-31T05:59:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.399+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/1056972553 wait complete. 2024-08-31T05:59:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.399+0000 7f7ad1a3c640 1 Processor -- start 2024-08-31T05:59:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.399+0000 7f7ad1a3c640 1 -- start start 2024-08-31T05:59:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7ad1a3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7acc102800 0x7f7acc19af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:59:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7ad1a3c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7acc108140 0x7f7acc19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:59:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7ad1a3c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7acc108a90 0x7f7acc19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:59:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7ad1a3c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc1125a0 con 0x7f7acc102800 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7ad1a3c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc112420 con 0x7f7acc108a90 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7ad1a3c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc112720 con 0x7f7acc108140 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7acaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7acc102800 0x7f7acc19af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7acaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7acc102800 0x7f7acc19af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54744/0 (socket says 172.21.15.53:54744) 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7acaffd640 1 -- 172.21.15.53:0/4090566836 learned_addr learned my addr 172.21.15.53:0/4090566836 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7ac3fff640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7acc108140 0x7f7acc19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7acb7fe640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7acc108a90 0x7f7acc19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7acaffd640 1 -- 172.21.15.53:0/4090566836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7acc108140 msgr2=0x7f7acc19b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7acaffd640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7acc108140 0x7f7acc19b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7acaffd640 1 -- 172.21.15.53:0/4090566836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7acc108a90 msgr2=0x7f7acc19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7acaffd640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7acc108a90 0x7f7acc19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.400+0000 7f7acaffd640 1 -- 172.21.15.53:0/4090566836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc198d20 con 0x7f7acc102800 2024-08-31T05:59:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.401+0000 7f7acaffd640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7acc102800 0x7f7acc19af30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009230 tx=0x7f7abc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:59:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.401+0000 7f7ad0a3a640 1 -- 172.21.15.53:0/4090566836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc03f030 con 0x7f7acc102800 2024-08-31T05:59:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.401+0000 7f7ad0a3a640 1 -- 172.21.15.53:0/4090566836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7abc003a80 con 0x7f7acc102800 2024-08-31T05:59:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.401+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/4090566836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7acc198fb0 con 0x7f7acc102800 2024-08-31T05:59:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.401+0000 7f7ad0a3a640 1 -- 172.21.15.53:0/4090566836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc035070 con 0x7f7acc102800 2024-08-31T05:59:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.401+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/4090566836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7acc199490 con 0x7f7acc102800 2024-08-31T05:59:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.402+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/4090566836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7acc102c10 con 0x7f7acc102800 2024-08-31T05:59:14.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.403+0000 7f7ad0a3a640 1 -- 172.21.15.53:0/4090566836 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f7abc042030 con 0x7f7acc102800 2024-08-31T05:59:14.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.404+0000 7f7ad0a3a640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ab80b4bb0 0x7f7ab80b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:59:14.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.404+0000 7f7ac3fff640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ab80b4bb0 0x7f7ab80b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:59:14.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.404+0000 7f7ad0a3a640 1 -- 172.21.15.53:0/4090566836 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4781+0+0 (secure 0 0 0) 0x7f7abc104dd0 con 0x7f7acc102800 2024-08-31T05:59:14.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.405+0000 7f7ac3fff640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ab80b4bb0 0x7f7ab80b70c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7acc100c10 tx=0x7f7ab4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:59:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.408+0000 7f7ad0a3a640 1 -- 172.21.15.53:0/4090566836 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7abc0cc680 con 0x7f7acc102800 2024-08-31T05:59:14.425 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T05:59:14.039+0000 7fdc01b1c640 -1 osd.5 0 waiting for initial osdmap 2024-08-31T05:59:14.425 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T05:59:14.045+0000 7fdbfd91a640 -1 osd.5 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:59:14.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: osdmap e30: 6 total, 5 up, 6 in 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='osd.5 [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:14.604+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/4090566836 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7acc02e460 con 0x7f7ab80b4bb0 2024-08-31T05:59:15.270 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi153 2024-08-31T05:59:15.271 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi153 to 8544M 2024-08-31T05:59:15.271 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T05:59:15.271 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: osdmap e31: 6 total, 5 up, 6 in 2024-08-31T05:59:15.271 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:15.271 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:15.271 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: osd.5 [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031] boot 2024-08-31T05:59:15.271 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: osdmap e32: 6 total, 6 up, 6 in 2024-08-31T05:59:15.271 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:15.271 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:59:15.271 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:59:15.271 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi153 2024-08-31T05:59:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi153 to 8544M 2024-08-31T05:59:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T05:59:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: osdmap e31: 6 total, 5 up, 6 in 2024-08-31T05:59:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: osd.5 [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031] boot 2024-08-31T05:59:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: osdmap e32: 6 total, 6 up, 6 in 2024-08-31T05:59:15.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:15.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:59:15.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:59:15.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:15.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi153 2024-08-31T05:59:15.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi153 to 8544M 2024-08-31T05:59:15.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T05:59:15.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: osdmap e31: 6 total, 5 up, 6 in 2024-08-31T05:59:15.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:15.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:15.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: osd.5 [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031] boot 2024-08-31T05:59:15.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: osdmap e32: 6 total, 6 up, 6 in 2024-08-31T05:59:15.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:59:15.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:59:15.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:59:15.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:16.286 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:16 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T05:59:16.286 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:16 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T05:59:16.286 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:16 smithi053 ceph-mon[18924]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:16.286 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:16 smithi053 ceph-mon[18924]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:16.287 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:16 smithi053 ceph-mon[18924]: osdmap e33: 6 total, 6 up, 6 in 2024-08-31T05:59:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:16 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T05:59:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:16 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T05:59:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:16 smithi130 ceph-mon[22266]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:16 smithi130 ceph-mon[22266]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:16 smithi130 ceph-mon[22266]: osdmap e33: 6 total, 6 up, 6 in 2024-08-31T05:59:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:16 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T05:59:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:16 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T05:59:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:16 smithi153 ceph-mon[22320]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:59:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:16 smithi153 ceph-mon[22320]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:16 smithi153 ceph-mon[22320]: osdmap e33: 6 total, 6 up, 6 in 2024-08-31T05:59:17.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:17 smithi153 ceph-mon[22320]: osdmap e34: 6 total, 6 up, 6 in 2024-08-31T05:59:17.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:17 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2463685867' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57f5870f-b022-4942-ab08-80d3bdf8d51b"} : dispatch 2024-08-31T05:59:17.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:17 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2463685867' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57f5870f-b022-4942-ab08-80d3bdf8d51b"}]': finished 2024-08-31T05:59:17.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:17 smithi153 ceph-mon[22320]: osdmap e35: 7 total, 6 up, 7 in 2024-08-31T05:59:17.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:17 smithi053 ceph-mon[18924]: osdmap e34: 6 total, 6 up, 6 in 2024-08-31T05:59:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:17 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2463685867' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57f5870f-b022-4942-ab08-80d3bdf8d51b"} : dispatch 2024-08-31T05:59:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:17 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2463685867' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57f5870f-b022-4942-ab08-80d3bdf8d51b"}]': finished 2024-08-31T05:59:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:17 smithi053 ceph-mon[18924]: osdmap e35: 7 total, 6 up, 7 in 2024-08-31T05:59:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:17 smithi130 ceph-mon[22266]: osdmap e34: 6 total, 6 up, 6 in 2024-08-31T05:59:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:17 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2463685867' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57f5870f-b022-4942-ab08-80d3bdf8d51b"} : dispatch 2024-08-31T05:59:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:17 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2463685867' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57f5870f-b022-4942-ab08-80d3bdf8d51b"}]': finished 2024-08-31T05:59:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:17 smithi130 ceph-mon[22266]: osdmap e35: 7 total, 6 up, 7 in 2024-08-31T05:59:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:18.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:18 smithi153 ceph-mon[22320]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:18.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:18 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3641335728' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:59:18.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:18 smithi053 ceph-mon[18924]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:18.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:18 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3641335728' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:59:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:18 smithi130 ceph-mon[22266]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:18 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3641335728' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:59:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:20 smithi153 ceph-mon[22320]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-08-31T05:59:20.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:20 smithi053 ceph-mon[18924]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-08-31T05:59:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:20 smithi130 ceph-mon[22266]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-08-31T05:59:22.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:22 smithi053 ceph-mon[18924]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:59:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:22 smithi130 ceph-mon[22266]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:59:22.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:22 smithi153 ceph-mon[22320]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:59:24.404 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:24 smithi053 ceph-mon[18924]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-08-31T05:59:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:24 smithi130 ceph-mon[22266]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-08-31T05:59:24.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:24 smithi153 ceph-mon[22320]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-08-31T05:59:26.448 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:26 smithi053 ceph-mon[18924]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-08-31T05:59:26.448 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T05:59:26.448 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:26 smithi130 ceph-mon[22266]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-08-31T05:59:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T05:59:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:26.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:26 smithi153 ceph-mon[22320]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-08-31T05:59:26.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T05:59:26.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:27 smithi053 ceph-mon[18924]: Deploying daemon osd.6 on smithi053 2024-08-31T05:59:27.577 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:27 smithi153 ceph-mon[22320]: Deploying daemon osd.6 on smithi053 2024-08-31T05:59:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:27 smithi130 ceph-mon[22266]: Deploying daemon osd.6 on smithi053 2024-08-31T05:59:28.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:28 smithi053 ceph-mon[18924]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:59:28.597 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:28 smithi153 ceph-mon[22320]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:59:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:28 smithi130 ceph-mon[22266]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:59:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:29 smithi053 ceph-mon[18924]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-31T05:59:29.529 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:29 smithi130 ceph-mon[22266]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-31T05:59:29.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:29 smithi153 ceph-mon[22320]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-31T05:59:31.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:31 smithi053 ceph-mon[18924]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:31.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:31 smithi130 ceph-mon[22266]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:31.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:31 smithi153 ceph-mon[22320]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:32.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:32 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:32.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:32 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:32.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:32 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:32.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:32 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:32.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:32 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:32.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:32 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:32.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:32 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:32.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:32 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:32.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:32 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:33.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:33 smithi130 ceph-mon[22266]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:33.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:33 smithi153 ceph-mon[22320]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:33.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:33 smithi053 ceph-mon[18924]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:35.149 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:35 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:35.149 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:35 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:35.149 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:35 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:35.149 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:35 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:35.149 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:35 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:35.192 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 6 on host 'smithi053' 2024-08-31T05:59:35.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.190+0000 7f7ad0a3a640 1 -- 172.21.15.53:0/4090566836 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7acc02e460 con 0x7f7ab80b4bb0 2024-08-31T05:59:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/4090566836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ab80b4bb0 msgr2=0x7f7ab80b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ab80b4bb0 0x7f7ab80b70c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7acc100c10 tx=0x7f7ab4005f90 comp rx=0 tx=0).stop 2024-08-31T05:59:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/4090566836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7acc102800 msgr2=0x7f7acc19af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7acc102800 0x7f7acc19af30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009230 tx=0x7f7abc004270 comp rx=0 tx=0).stop 2024-08-31T05:59:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/4090566836 shutdown_connections 2024-08-31T05:59:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ab80b4bb0 0x7f7ab80b70c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7acc108a90 0x7f7acc19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7acc108140 0x7f7acc19b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 --2- 172.21.15.53:0/4090566836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7acc102800 0x7f7acc19af30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/4090566836 >> 172.21.15.53:0/4090566836 conn(0x7f7acc0794d0 msgr2=0x7f7acc1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:59:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/4090566836 shutdown_connections 2024-08-31T05:59:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T05:59:35.192+0000 7f7ad1a3c640 1 -- 172.21.15.53:0/4090566836 wait complete. 2024-08-31T05:59:35.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:35 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:35.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:35 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:35.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:35 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:35.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:35 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:35.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:35 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:35.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:35 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:35.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:35 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:35.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:35 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:35.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:35 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:35.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:35 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:35.797 DEBUG:teuthology.orchestra.run.smithi053:osd.6> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.6.service 2024-08-31T05:59:35.801 INFO:tasks.cephadm:Deploying osd.7 on smithi130 with /dev/vg_nvme/lv_2... 2024-08-31T05:59:35.801 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T05:59:36.059 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:59:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:36 smithi130 ceph-mon[22266]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:36 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:36 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:36.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:36 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:36.339 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:36 smithi053 ceph-mon[18924]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:36.340 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:36 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:36.340 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:36 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:36.340 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:36 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:36.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:36 smithi153 ceph-mon[22320]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:36.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:36 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:36.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:36 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:36.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:36 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:37.726 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 05:59:37 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T05:59:37.504+0000 7ffa57579640 -1 osd.6 0 log_to_monitors true 2024-08-31T05:59:38.319 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:38 smithi130 ceph-mon[22266]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:38.319 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:38 smithi130 ceph-mon[22266]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T05:59:38.322 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T05:59:38.347 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_2 2024-08-31T05:59:38.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:38 smithi153 ceph-mon[22320]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:38.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:38 smithi153 ceph-mon[22320]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T05:59:38.467 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:38 smithi053 ceph-mon[18924]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:38.467 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:38 smithi053 ceph-mon[18924]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T05:59:38.591 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:59:39.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.065+0000 7f82285e4640 1 -- 172.21.15.130:0/2386010690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8220109270 msgr2=0x7f8220109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:39.295 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.065+0000 7f82285e4640 1 --2- 172.21.15.130:0/2386010690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8220109270 0x7f8220109680 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8210009900 tx=0x7f821002a410 comp rx=0 tx=0).stop 2024-08-31T05:59:39.295 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.066+0000 7f82285e4640 1 -- 172.21.15.130:0/2386010690 shutdown_connections 2024-08-31T05:59:39.295 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.066+0000 7f82285e4640 1 --2- 172.21.15.130:0/2386010690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220109bc0 0x7f82201103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:39.295 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.066+0000 7f82285e4640 1 --2- 172.21.15.130:0/2386010690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8220109270 0x7f8220109680 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.066+0000 7f82285e4640 1 --2- 172.21.15.130:0/2386010690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8220103930 0x7f8220103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.066+0000 7f82285e4640 1 -- 172.21.15.130:0/2386010690 >> 172.21.15.130:0/2386010690 conn(0x7f82200ff380 msgr2=0x7f82201017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:59:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.066+0000 7f82285e4640 1 -- 172.21.15.130:0/2386010690 shutdown_connections 2024-08-31T05:59:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.066+0000 7f82285e4640 1 -- 172.21.15.130:0/2386010690 wait complete. 2024-08-31T05:59:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.066+0000 7f82285e4640 1 Processor -- start 2024-08-31T05:59:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.066+0000 7f82285e4640 1 -- start start 2024-08-31T05:59:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f82285e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220103930 0x7f82200754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:59:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f82285e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8220109270 0x7f82200759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:59:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f82285e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8220109bc0 0x7f8220075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:59:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f82285e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8220113730 con 0x7f8220109270 2024-08-31T05:59:39.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f82285e4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82201135b0 con 0x7f8220109bc0 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f82285e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82201138b0 con 0x7f8220103930 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f8226b81640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8220109bc0 0x7f8220075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f8226b81640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8220109bc0 0x7f8220075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:36984/0 (socket says 172.21.15.130:36984) 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f8226b81640 1 -- 172.21.15.130:0/1909126483 learned_addr learned my addr 172.21.15.130:0/1909126483 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f8225b7f640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8220109270 0x7f82200759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f8226380640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220103930 0x7f82200754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f8226b81640 1 -- 172.21.15.130:0/1909126483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220103930 msgr2=0x7f82200754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f8226b81640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220103930 0x7f82200754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f8226b81640 1 -- 172.21.15.130:0/1909126483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8220109270 msgr2=0x7f82200759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f8226b81640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8220109270 0x7f82200759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f8226b81640 1 -- 172.21.15.130:0/1909126483 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82201a8480 con 0x7f8220109bc0 2024-08-31T05:59:39.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f8226b81640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8220109bc0 0x7f8220075f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f821800eaa0 tx=0x7f821800ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f82177fe640 1 -- 172.21.15.130:0/1909126483 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821800cdb0 con 0x7f8220109bc0 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f82177fe640 1 -- 172.21.15.130:0/1909126483 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8218005020 con 0x7f8220109bc0 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f82285e4640 1 -- 172.21.15.130:0/1909126483 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82201a8770 con 0x7f8220109bc0 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.067+0000 7f82177fe640 1 -- 172.21.15.130:0/1909126483 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82180116d0 con 0x7f8220109bc0 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.068+0000 7f82285e4640 1 -- 172.21.15.130:0/1909126483 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82201a8c80 con 0x7f8220109bc0 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.068+0000 7f82285e4640 1 -- 172.21.15.130:0/1909126483 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8220103d40 con 0x7f8220109bc0 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.070+0000 7f82177fe640 1 -- 172.21.15.130:0/1909126483 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f82180051d0 con 0x7f8220109bc0 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.071+0000 7f82177fe640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f820c0b4b80 0x7f820c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.071+0000 7f82177fe640 1 -- 172.21.15.130:0/1909126483 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4900+0+0 (secure 0 0 0) 0x7f82180e4900 con 0x7f8220109bc0 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.071+0000 7f8226380640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f820c0b4b80 0x7f820c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.071+0000 7f8226380640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f820c0b4b80 0x7f820c0b7090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8220076f00 tx=0x7f821c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:59:39.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.074+0000 7f82177fe640 1 -- 172.21.15.130:0/1909126483 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8218016030 con 0x7f8220109bc0 2024-08-31T05:59:39.299 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:39.262+0000 7f82285e4640 1 -- 172.21.15.130:0/1909126483 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f82200635a0 con 0x7f820c0b4b80 2024-08-31T05:59:39.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T05:59:39.299 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: osdmap e36: 7 total, 6 up, 7 in 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T05:59:39.300 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: osdmap e37: 7 total, 6 up, 7 in 2024-08-31T05:59:39.301 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:39.322 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T05:59:39.322 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: osdmap e36: 7 total, 6 up, 7 in 2024-08-31T05:59:39.322 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T05:59:39.322 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: osdmap e37: 7 total, 6 up, 7 in 2024-08-31T05:59:39.323 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:39.476 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T05:59:39.059+0000 7ffa534fb640 -1 osd.6 0 waiting for initial osdmap 2024-08-31T05:59:39.476 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T05:59:39.070+0000 7ffa4f2f9640 -1 osd.6 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:59:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T05:59:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: osdmap e36: 7 total, 6 up, 7 in 2024-08-31T05:59:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T05:59:39.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: osdmap e37: 7 total, 6 up, 7 in 2024-08-31T05:59:39.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:40 smithi153 ceph-mon[22320]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:40 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi053 2024-08-31T05:59:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:40 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi053 to 5697M 2024-08-31T05:59:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:59:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:59:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:40.321 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:40 smithi130 ceph-mon[22266]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:40.322 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:40 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi053 2024-08-31T05:59:40.322 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:40 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi053 to 5697M 2024-08-31T05:59:40.322 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:40.322 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:59:40.322 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:59:40.322 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:40.322 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:40 smithi053 ceph-mon[18924]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:40 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi053 2024-08-31T05:59:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:40 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi053 to 5697M 2024-08-31T05:59:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:59:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:59:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:41 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T05:59:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:41 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T05:59:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:41 smithi130 ceph-mon[22266]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:41 smithi130 ceph-mon[22266]: osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382] boot 2024-08-31T05:59:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:41 smithi130 ceph-mon[22266]: osdmap e38: 7 total, 7 up, 7 in 2024-08-31T05:59:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:41.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:41 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T05:59:41.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:41 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T05:59:41.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:41 smithi053 ceph-mon[18924]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:41.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:41 smithi053 ceph-mon[18924]: osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382] boot 2024-08-31T05:59:41.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:41 smithi053 ceph-mon[18924]: osdmap e38: 7 total, 7 up, 7 in 2024-08-31T05:59:41.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:41.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:41 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T05:59:41.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:41 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T05:59:41.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:41 smithi153 ceph-mon[22320]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:41.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:41 smithi153 ceph-mon[22320]: osd.6 [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382] boot 2024-08-31T05:59:41.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:41 smithi153 ceph-mon[22320]: osdmap e38: 7 total, 7 up, 7 in 2024-08-31T05:59:41.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:59:42.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:42 smithi130 ceph-mon[22266]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:42.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:42 smithi130 ceph-mon[22266]: osdmap e39: 7 total, 7 up, 7 in 2024-08-31T05:59:42.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:42 smithi130 ceph-mon[22266]: from='client.? 172.21.15.130:0/3166787439' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "29c0cbe5-22d9-4256-92c3-44edf317fd58"} : dispatch 2024-08-31T05:59:42.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:42 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "29c0cbe5-22d9-4256-92c3-44edf317fd58"} : dispatch 2024-08-31T05:59:42.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:42 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29c0cbe5-22d9-4256-92c3-44edf317fd58"}]': finished 2024-08-31T05:59:42.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:42 smithi130 ceph-mon[22266]: osdmap e40: 8 total, 7 up, 8 in 2024-08-31T05:59:42.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:59:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:42 smithi153 ceph-mon[22320]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:42 smithi153 ceph-mon[22320]: osdmap e39: 7 total, 7 up, 7 in 2024-08-31T05:59:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:42 smithi153 ceph-mon[22320]: from='client.? 172.21.15.130:0/3166787439' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "29c0cbe5-22d9-4256-92c3-44edf317fd58"} : dispatch 2024-08-31T05:59:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:42 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "29c0cbe5-22d9-4256-92c3-44edf317fd58"} : dispatch 2024-08-31T05:59:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:42 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29c0cbe5-22d9-4256-92c3-44edf317fd58"}]': finished 2024-08-31T05:59:42.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:42 smithi153 ceph-mon[22320]: osdmap e40: 8 total, 7 up, 8 in 2024-08-31T05:59:42.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:59:42.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:42 smithi053 ceph-mon[18924]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:59:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:42 smithi053 ceph-mon[18924]: osdmap e39: 7 total, 7 up, 7 in 2024-08-31T05:59:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:42 smithi053 ceph-mon[18924]: from='client.? 172.21.15.130:0/3166787439' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "29c0cbe5-22d9-4256-92c3-44edf317fd58"} : dispatch 2024-08-31T05:59:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:42 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "29c0cbe5-22d9-4256-92c3-44edf317fd58"} : dispatch 2024-08-31T05:59:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:42 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29c0cbe5-22d9-4256-92c3-44edf317fd58"}]': finished 2024-08-31T05:59:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:42 smithi053 ceph-mon[18924]: osdmap e40: 8 total, 7 up, 8 in 2024-08-31T05:59:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:59:43.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:43 smithi130 ceph-mon[22266]: from='client.? 172.21.15.130:0/3102302803' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:59:43.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:43 smithi153 ceph-mon[22320]: from='client.? 172.21.15.130:0/3102302803' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:59:43.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.130:0/3102302803' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:59:44.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:44 smithi130 ceph-mon[22266]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:44.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:44 smithi153 ceph-mon[22320]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:44.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:44 smithi053 ceph-mon[18924]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:46 smithi130 ceph-mon[22266]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:46.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:46 smithi153 ceph-mon[22320]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:46.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:46 smithi053 ceph-mon[18924]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:48.126 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:48 smithi130 ceph-mon[22266]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:48.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:48 smithi153 ceph-mon[22320]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:48.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:48 smithi053 ceph-mon[18924]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:50.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:50 smithi130 ceph-mon[22266]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:50.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T05:59:50.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:50.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:50 smithi153 ceph-mon[22320]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:50.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T05:59:50.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:50.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:50 smithi053 ceph-mon[18924]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T05:59:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:51.318 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:51 smithi130 ceph-mon[22266]: Deploying daemon osd.7 on smithi130 2024-08-31T05:59:51.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:51 smithi153 ceph-mon[22320]: Deploying daemon osd.7 on smithi130 2024-08-31T05:59:51.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:51 smithi053 ceph-mon[18924]: Deploying daemon osd.7 on smithi130 2024-08-31T05:59:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:52 smithi130 ceph-mon[22266]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:52.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:52 smithi153 ceph-mon[22320]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:52 smithi053 ceph-mon[18924]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:54.333 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:54 smithi130 ceph-mon[22266]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:54.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:54 smithi153 ceph-mon[22320]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:54.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:54 smithi053 ceph-mon[18924]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:55.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:55 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:55.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:55 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:55.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:55 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:55.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:55 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:55.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:55 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:55.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:55 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:55.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:55 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:55.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:55 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:55.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:55 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:56.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:56 smithi130 ceph-mon[22266]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:56.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:56 smithi153 ceph-mon[22320]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:56.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:56 smithi053 ceph-mon[18924]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:58 smithi130 ceph-mon[22266]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:58 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:58 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:58 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:58 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:58.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:58 smithi153 ceph-mon[22320]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:58.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:58 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:58.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:58 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:58.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:58 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:58.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:58 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:58.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:58 smithi053 ceph-mon[18924]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:59:58.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:58 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:58.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:58 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:58.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:58 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:59:58.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:58 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:59:58.680 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.677+0000 7f82177fe640 1 -- 172.21.15.130:0/1909126483 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f82200635a0 con 0x7f820c0b4b80 2024-08-31T05:59:58.680 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 7 on host 'smithi130' 2024-08-31T05:59:58.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 -- 172.21.15.130:0/1909126483 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f820c0b4b80 msgr2=0x7f820c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:58.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f820c0b4b80 0x7f820c0b7090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8220076f00 tx=0x7f821c005f90 comp rx=0 tx=0).stop 2024-08-31T05:59:58.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 -- 172.21.15.130:0/1909126483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8220109bc0 msgr2=0x7f8220075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:59:58.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8220109bc0 0x7f8220075f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f821800eaa0 tx=0x7f821800ef60 comp rx=0 tx=0).stop 2024-08-31T05:59:58.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 -- 172.21.15.130:0/1909126483 shutdown_connections 2024-08-31T05:59:58.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f820c0b4b80 0x7f820c0b7090 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:58.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8220109bc0 0x7f8220075f30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:58.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8220109270 0x7f82200759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:58.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 --2- 172.21.15.130:0/1909126483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220103930 0x7f82200754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:59:58.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 -- 172.21.15.130:0/1909126483 >> 172.21.15.130:0/1909126483 conn(0x7f82200ff380 msgr2=0x7f82201017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:59:58.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 -- 172.21.15.130:0/1909126483 shutdown_connections 2024-08-31T05:59:58.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T05:59:58.680+0000 7f82285e4640 1 -- 172.21.15.130:0/1909126483 wait complete. 2024-08-31T05:59:59.258 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:59 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:59.258 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:59 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:59.258 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:59 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:59.259 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 05:59:59 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:59.286 DEBUG:teuthology.orchestra.run.smithi130:osd.7> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.7.service 2024-08-31T05:59:59.288 INFO:tasks.cephadm:Deploying osd.8 on smithi153 with /dev/vg_nvme/lv_2... 2024-08-31T05:59:59.288 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T05:59:59.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:59 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:59.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:59 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:59.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:59 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:59.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 05:59:59 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:59.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:59 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:59.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:59 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:59:59.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:59 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:59.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 05:59:59 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T05:59:59.536 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:00:00.348 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:00 smithi130 ceph-mon[22266]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:00.349 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:00 smithi130 ceph-mon[22266]: overall HEALTH_OK 2024-08-31T06:00:00.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:00 smithi153 ceph-mon[22320]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:00.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:00 smithi153 ceph-mon[22320]: overall HEALTH_OK 2024-08-31T06:00:00.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:00 smithi053 ceph-mon[18924]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:00 smithi053 ceph-mon[18924]: overall HEALTH_OK 2024-08-31T06:00:01.628 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:00:01 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:00:01.472+0000 7fd064fa4640 -1 osd.7 0 log_to_monitors true 2024-08-31T06:00:01.904 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T06:00:01.930 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi153:vg_nvme/lv_2 2024-08-31T06:00:02.178 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:00:02.299 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:02.299 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: from='osd.7 [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:00:02.299 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:00:02.299 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.299 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.299 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:02.300 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:02.300 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:02.300 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.300 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:02.300 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:02.300 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: from='osd.7 [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:00:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:00:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:02.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:02.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:02.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:02.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: from='osd.7 [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:00:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:00:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:02.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.670+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3176851301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb8109260 msgr2=0x7f7bb8109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:02.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.670+0000 7f7bbd07b640 1 --2- 172.21.15.153:0/3176851301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb8109260 0x7f7bb8109670 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009900 tx=0x7f7bac02a410 comp rx=0 tx=0).stop 2024-08-31T06:00:02.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.670+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3176851301 shutdown_connections 2024-08-31T06:00:02.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.670+0000 7f7bbd07b640 1 --2- 172.21.15.153:0/3176851301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bb8109bb0 0x7f7bb81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:02.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.670+0000 7f7bbd07b640 1 --2- 172.21.15.153:0/3176851301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb8109260 0x7f7bb8109670 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:02.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.670+0000 7f7bbd07b640 1 --2- 172.21.15.153:0/3176851301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8103920 0x7f7bb8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:02.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.670+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3176851301 >> 172.21.15.153:0/3176851301 conn(0x7f7bb80ff370 msgr2=0x7f7bb81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:00:02.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.670+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3176851301 shutdown_connections 2024-08-31T06:00:02.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.670+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3176851301 wait complete. 2024-08-31T06:00:02.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.671+0000 7f7bbd07b640 1 Processor -- start 2024-08-31T06:00:02.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.671+0000 7f7bbd07b640 1 -- start start 2024-08-31T06:00:02.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.671+0000 7f7bbd07b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8103920 0x7f7bb819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:02.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.671+0000 7f7bbd07b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb8109260 0x7f7bb819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:02.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.671+0000 7f7bbd07b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bb8109bb0 0x7f7bb819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:02.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.671+0000 7f7bbd07b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb8113720 con 0x7f7bb8109bb0 2024-08-31T06:00:02.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.671+0000 7f7bbd07b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb81135a0 con 0x7f7bb8103920 2024-08-31T06:00:02.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.671+0000 7f7bbd07b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb81138a0 con 0x7f7bb8109260 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.671+0000 7f7bb659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb8109260 0x7f7bb819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bb659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb8109260 0x7f7bb819a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53948/0 (socket says 172.21.15.153:53948) 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bb659c640 1 -- 172.21.15.153:0/3368496098 learned_addr learned my addr 172.21.15.153:0/3368496098 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bb6d9d640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8103920 0x7f7bb819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bb759e640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bb8109bb0 0x7f7bb819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bb659c640 1 -- 172.21.15.153:0/3368496098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8103920 msgr2=0x7f7bb819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bb659c640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8103920 0x7f7bb819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bb659c640 1 -- 172.21.15.153:0/3368496098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bb8109bb0 msgr2=0x7f7bb819fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bb659c640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bb8109bb0 0x7f7bb819fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bb659c640 1 -- 172.21.15.153:0/3368496098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb81a00c0 con 0x7f7bb8109260 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bb659c640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb8109260 0x7f7bb819a7b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7bac005940 tx=0x7f7bac0040e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7b9ffff640 1 -- 172.21.15.153:0/3368496098 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac03f030 con 0x7f7bb8109260 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3368496098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb81a0350 con 0x7f7bb8109260 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7b9ffff640 1 -- 172.21.15.153:0/3368496098 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7bac003a80 con 0x7f7bb8109260 2024-08-31T06:00:02.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3368496098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb81a0880 con 0x7f7bb8109260 2024-08-31T06:00:02.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.672+0000 7f7b9ffff640 1 -- 172.21.15.153:0/3368496098 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac035070 con 0x7f7bb8109260 2024-08-31T06:00:02.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.673+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3368496098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb8103d30 con 0x7f7bb8109260 2024-08-31T06:00:02.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.676+0000 7f7b9ffff640 1 -- 172.21.15.153:0/3368496098 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f7bac042030 con 0x7f7bb8109260 2024-08-31T06:00:02.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.677+0000 7f7b9ffff640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ba00b4bb0 0x7f7ba00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:02.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.677+0000 7f7b9ffff640 1 -- 172.21.15.153:0/3368496098 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5316+0+0 (secure 0 0 0) 0x7f7bac104e60 con 0x7f7bb8109260 2024-08-31T06:00:02.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.677+0000 7f7bb6d9d640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ba00b4bb0 0x7f7ba00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:02.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.678+0000 7f7bb6d9d640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ba00b4bb0 0x7f7ba00b70c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800bbe0 tx=0x7f7ba800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:00:02.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.680+0000 7f7b9ffff640 1 -- 172.21.15.153:0/3368496098 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7bb81a0880 con 0x7f7bb8109260 2024-08-31T06:00:02.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:02.867+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3368496098 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7bb810b9b0 con 0x7f7ba00b4bb0 2024-08-31T06:00:03.414 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:03 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi130 2024-08-31T06:00:03.414 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:03 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi130 to 5696M 2024-08-31T06:00:03.414 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:03 smithi153 ceph-mon[22320]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T06:00:03.414 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:03 smithi153 ceph-mon[22320]: osdmap e41: 8 total, 7 up, 8 in 2024-08-31T06:00:03.414 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:03.414 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:03 smithi153 ceph-mon[22320]: from='osd.7 [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:00:03.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:03 smithi153 ceph-mon[22320]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:00:03.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:00:03.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:00:03.415 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:03.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:03 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi130 2024-08-31T06:00:03.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:03 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi130 to 5696M 2024-08-31T06:00:03.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:03 smithi053 ceph-mon[18924]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T06:00:03.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:03 smithi053 ceph-mon[18924]: osdmap e41: 8 total, 7 up, 8 in 2024-08-31T06:00:03.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:03.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:03 smithi053 ceph-mon[18924]: from='osd.7 [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:00:03.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:03 smithi053 ceph-mon[18924]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:00:03.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:00:03.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:00:03.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:03.628 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:00:03.145+0000 7fd060f26640 -1 osd.7 0 waiting for initial osdmap 2024-08-31T06:00:03.628 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:00:03.155+0000 7fd05cd24640 -1 osd.7 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:00:03.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi130 2024-08-31T06:00:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi130 to 5696M 2024-08-31T06:00:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-mon[22266]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T06:00:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-mon[22266]: osdmap e41: 8 total, 7 up, 8 in 2024-08-31T06:00:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-mon[22266]: from='osd.7 [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:00:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-mon[22266]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:00:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:00:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:00:03.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:04 smithi153 ceph-mon[22320]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:04 smithi153 ceph-mon[22320]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:04 smithi153 ceph-mon[22320]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T06:00:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:04 smithi153 ceph-mon[22320]: osdmap e42: 8 total, 7 up, 8 in 2024-08-31T06:00:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:04 smithi053 ceph-mon[18924]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:04 smithi053 ceph-mon[18924]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:04 smithi053 ceph-mon[18924]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T06:00:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:04 smithi053 ceph-mon[18924]: osdmap e42: 8 total, 7 up, 8 in 2024-08-31T06:00:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:04 smithi130 ceph-mon[22266]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:04 smithi130 ceph-mon[22266]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:04 smithi130 ceph-mon[22266]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T06:00:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:04 smithi130 ceph-mon[22266]: osdmap e42: 8 total, 7 up, 8 in 2024-08-31T06:00:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:05.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:05 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T06:00:05.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:05 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T06:00:05.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:05.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:05 smithi153 ceph-mon[22320]: osd.7 [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156] boot 2024-08-31T06:00:05.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:05 smithi153 ceph-mon[22320]: osdmap e43: 8 total, 8 up, 8 in 2024-08-31T06:00:05.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:05.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:05 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T06:00:05.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:05 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T06:00:05.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:05.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:05 smithi053 ceph-mon[18924]: osd.7 [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156] boot 2024-08-31T06:00:05.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:05 smithi053 ceph-mon[18924]: osdmap e43: 8 total, 8 up, 8 in 2024-08-31T06:00:05.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:05 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T06:00:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:05 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T06:00:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:05 smithi130 ceph-mon[22266]: osd.7 [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156] boot 2024-08-31T06:00:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:05 smithi130 ceph-mon[22266]: osdmap e43: 8 total, 8 up, 8 in 2024-08-31T06:00:05.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:00:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:06 smithi153 ceph-mon[22320]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:06 smithi153 ceph-mon[22320]: osdmap e44: 8 total, 8 up, 8 in 2024-08-31T06:00:06.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:06 smithi153 ceph-mon[22320]: from='client.? 172.21.15.153:0/1520764380' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b05f2429-ef03-4103-b2f0-a4bc66189d72"} : dispatch 2024-08-31T06:00:06.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:06 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b05f2429-ef03-4103-b2f0-a4bc66189d72"} : dispatch 2024-08-31T06:00:06.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:06 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b05f2429-ef03-4103-b2f0-a4bc66189d72"}]': finished 2024-08-31T06:00:06.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:06 smithi153 ceph-mon[22320]: osdmap e45: 9 total, 8 up, 9 in 2024-08-31T06:00:06.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:06 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:06.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:06 smithi153 ceph-mon[22320]: from='client.? 172.21.15.153:0/2326253952' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:00:06.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:06 smithi053 ceph-mon[18924]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:06 smithi053 ceph-mon[18924]: osdmap e44: 8 total, 8 up, 8 in 2024-08-31T06:00:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:06 smithi053 ceph-mon[18924]: from='client.? 172.21.15.153:0/1520764380' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b05f2429-ef03-4103-b2f0-a4bc66189d72"} : dispatch 2024-08-31T06:00:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:06 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b05f2429-ef03-4103-b2f0-a4bc66189d72"} : dispatch 2024-08-31T06:00:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:06 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b05f2429-ef03-4103-b2f0-a4bc66189d72"}]': finished 2024-08-31T06:00:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:06 smithi053 ceph-mon[18924]: osdmap e45: 9 total, 8 up, 9 in 2024-08-31T06:00:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:06 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:06 smithi053 ceph-mon[18924]: from='client.? 172.21.15.153:0/2326253952' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:00:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:06 smithi130 ceph-mon[22266]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:00:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:06 smithi130 ceph-mon[22266]: osdmap e44: 8 total, 8 up, 8 in 2024-08-31T06:00:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:06 smithi130 ceph-mon[22266]: from='client.? 172.21.15.153:0/1520764380' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b05f2429-ef03-4103-b2f0-a4bc66189d72"} : dispatch 2024-08-31T06:00:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:06 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b05f2429-ef03-4103-b2f0-a4bc66189d72"} : dispatch 2024-08-31T06:00:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:06 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b05f2429-ef03-4103-b2f0-a4bc66189d72"}]': finished 2024-08-31T06:00:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:06 smithi130 ceph-mon[22266]: osdmap e45: 9 total, 8 up, 9 in 2024-08-31T06:00:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:06 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:06.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:06 smithi130 ceph-mon[22266]: from='client.? 172.21.15.153:0/2326253952' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:00:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:08 smithi153 ceph-mon[22320]: pgmap v149: 1 pgs: 1 remapped; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:08.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:08 smithi053 ceph-mon[18924]: pgmap v149: 1 pgs: 1 remapped; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:08.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:08 smithi130 ceph-mon[22266]: pgmap v149: 1 pgs: 1 remapped; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:10.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:10 smithi153 ceph-mon[22320]: pgmap v150: 1 pgs: 1 remapped; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:10.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:10 smithi053 ceph-mon[18924]: pgmap v150: 1 pgs: 1 remapped; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:10.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:10 smithi130 ceph-mon[22266]: pgmap v150: 1 pgs: 1 remapped; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:12.381 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:12 smithi153 ceph-mon[22320]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T06:00:12.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:12 smithi053 ceph-mon[18924]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T06:00:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:12 smithi130 ceph-mon[22266]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T06:00:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:14 smithi153 ceph-mon[22320]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:00:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T06:00:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:14.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:14 smithi053 ceph-mon[18924]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:00:14.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T06:00:14.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:14 smithi130 ceph-mon[22266]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:00:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T06:00:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:15 smithi053 ceph-mon[18924]: Deploying daemon osd.8 on smithi153 2024-08-31T06:00:15.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:15 smithi153 ceph-mon[22320]: Deploying daemon osd.8 on smithi153 2024-08-31T06:00:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:15 smithi130 ceph-mon[22266]: Deploying daemon osd.8 on smithi153 2024-08-31T06:00:16.451 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:16 smithi153 ceph-mon[22320]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-08-31T06:00:16.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:16 smithi053 ceph-mon[18924]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-08-31T06:00:16.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:16 smithi130 ceph-mon[22266]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-08-31T06:00:18.317 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:18 smithi153 ceph-mon[22320]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-31T06:00:18.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:18 smithi053 ceph-mon[18924]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-31T06:00:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:18 smithi130 ceph-mon[22266]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-31T06:00:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:19.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:19.596 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:19.596 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:19.596 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:19.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:19.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:19.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:20.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:20 smithi053 ceph-mon[18924]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:00:20.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:20 smithi153 ceph-mon[22320]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:00:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:20 smithi130 ceph-mon[22266]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:00:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:22 smithi153 ceph-mon[22320]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:00:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:22.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:22.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:22.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:22.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:22 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:22.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:22 smithi053 ceph-mon[18924]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:00:22.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:22.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:22.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:22.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:22.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:22 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:22.487 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 8 on host 'smithi153' 2024-08-31T06:00:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.485+0000 7f7b9ffff640 1 -- 172.21.15.153:0/3368496098 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7bb810b9b0 con 0x7f7ba00b4bb0 2024-08-31T06:00:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3368496098 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ba00b4bb0 msgr2=0x7f7ba00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ba00b4bb0 0x7f7ba00b70c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800bbe0 tx=0x7f7ba800b390 comp rx=0 tx=0).stop 2024-08-31T06:00:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3368496098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb8109260 msgr2=0x7f7bb819a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb8109260 0x7f7bb819a7b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7bac005940 tx=0x7f7bac0040e0 comp rx=0 tx=0).stop 2024-08-31T06:00:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3368496098 shutdown_connections 2024-08-31T06:00:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ba00b4bb0 0x7f7ba00b70c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bb8109bb0 0x7f7bb819fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb8109260 0x7f7bb819a7b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 --2- 172.21.15.153:0/3368496098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bb8103920 0x7f7bb819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3368496098 >> 172.21.15.153:0/3368496098 conn(0x7f7bb80ff370 msgr2=0x7f7bb8101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:00:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3368496098 shutdown_connections 2024-08-31T06:00:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:00:22.487+0000 7f7bbd07b640 1 -- 172.21.15.153:0/3368496098 wait complete. 2024-08-31T06:00:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:22 smithi130 ceph-mon[22266]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:00:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:22 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:23.083 DEBUG:teuthology.orchestra.run.smithi153:osd.8> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.8.service 2024-08-31T06:00:23.085 INFO:tasks.cephadm:Deploying osd.9 on smithi053 with /dev/vg_nvme/lv_1... 2024-08-31T06:00:23.085 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T06:00:23.326 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:23.326 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:23.326 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:23.352 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:00:23.472 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:23.473 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:23.473 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:23.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:23.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:23.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:24.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:24 smithi153 ceph-mon[22320]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:24.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:24 smithi053 ceph-mon[18924]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:24 smithi130 ceph-mon[22266]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:25.307 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:25 smithi153 ceph-mon[22320]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:25.307 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:25 smithi153 ceph-mon[22320]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T06:00:25.307 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:00:24 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:00:24.996+0000 7f5e4037c640 -1 osd.8 0 log_to_monitors true 2024-08-31T06:00:25.405 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:25 smithi053 ceph-mon[18924]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:25.405 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:25 smithi053 ceph-mon[18924]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T06:00:25.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:25 smithi130 ceph-mon[22266]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:25.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:25 smithi130 ceph-mon[22266]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T06:00:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:00:26.162 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi053:vg_nvme/lv_1 2024-08-31T06:00:26.418 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:00:26.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T06:00:26.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: osdmap e46: 9 total, 8 up, 9 in 2024-08-31T06:00:26.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T06:00:26.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:26.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi153 2024-08-31T06:00:26.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:26.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:26.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:26.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi153 to 5696M 2024-08-31T06:00:26.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:26.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:26.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T06:00:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: osdmap e46: 9 total, 8 up, 9 in 2024-08-31T06:00:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T06:00:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi153 2024-08-31T06:00:26.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:26.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:26.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:26.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi153 to 5696M 2024-08-31T06:00:26.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:26.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:26.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T06:00:26.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: osdmap e46: 9 total, 8 up, 9 in 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi153 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi153 to 5696M 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:26.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:26.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.873+0000 7f05ef735640 1 -- 172.21.15.53:0/3097614102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05e810ff40 msgr2=0x7f05e8112360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.873+0000 7f05ef735640 1 --2- 172.21.15.53:0/3097614102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05e810ff40 0x7f05e8112360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009ca0 tx=0x7f05e002a950 comp rx=0 tx=0).stop 2024-08-31T06:00:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.873+0000 7f05ef735640 1 -- 172.21.15.53:0/3097614102 shutdown_connections 2024-08-31T06:00:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.873+0000 7f05ef735640 1 --2- 172.21.15.53:0/3097614102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05e810ff40 0x7f05e8112360 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.873+0000 7f05ef735640 1 --2- 172.21.15.53:0/3097614102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e8102ce0 0x7f05e810fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.873+0000 7f05ef735640 1 --2- 172.21.15.53:0/3097614102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05e8102390 0x7f05e81027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.873+0000 7f05ef735640 1 -- 172.21.15.53:0/3097614102 >> 172.21.15.53:0/3097614102 conn(0x7f05e80794e0 msgr2=0x7f05e80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:00:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.873+0000 7f05ef735640 1 -- 172.21.15.53:0/3097614102 shutdown_connections 2024-08-31T06:00:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.873+0000 7f05ef735640 1 -- 172.21.15.53:0/3097614102 wait complete. 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.873+0000 7f05ef735640 1 Processor -- start 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ef735640 1 -- start start 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ef735640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05e8102390 0x7f05e819c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ef735640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e8102ce0 0x7f05e819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ef735640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05e810ff40 0x7f05e81a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ef735640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f05e81158e0 con 0x7f05e8102390 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ef735640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f05e8115760 con 0x7f05e8102ce0 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ef735640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f05e8115a60 con 0x7f05e810ff40 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ed4d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05e8102390 0x7f05e819c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ed4d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05e8102390 0x7f05e819c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40564/0 (socket says 172.21.15.53:40564) 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ed4d1640 1 -- 172.21.15.53:0/94396054 learned_addr learned my addr 172.21.15.53:0/94396054 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:00:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05edcd2640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05e810ff40 0x7f05e81a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05eccd0640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e8102ce0 0x7f05e819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ed4d1640 1 -- 172.21.15.53:0/94396054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05e810ff40 msgr2=0x7f05e81a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ed4d1640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05e810ff40 0x7f05e81a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ed4d1640 1 -- 172.21.15.53:0/94396054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e8102ce0 msgr2=0x7f05e819c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ed4d1640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e8102ce0 0x7f05e819c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.874+0000 7f05ed4d1640 1 -- 172.21.15.53:0/94396054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e81a2260 con 0x7f05e8102390 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.875+0000 7f05ed4d1640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05e8102390 0x7f05e819c2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f05e400e9f0 tx=0x7f05e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.875+0000 7f05de7fc640 1 -- 172.21.15.53:0/94396054 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e400cd80 con 0x7f05e8102390 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.875+0000 7f05de7fc640 1 -- 172.21.15.53:0/94396054 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f05e40054b0 con 0x7f05e8102390 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.875+0000 7f05ef735640 1 -- 172.21.15.53:0/94396054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e81a2550 con 0x7f05e8102390 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.875+0000 7f05de7fc640 1 -- 172.21.15.53:0/94396054 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e4010430 con 0x7f05e8102390 2024-08-31T06:00:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.875+0000 7f05ef735640 1 -- 172.21.15.53:0/94396054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e81a8cb0 con 0x7f05e8102390 2024-08-31T06:00:26.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.876+0000 7f05ef735640 1 -- 172.21.15.53:0/94396054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e806bfe0 con 0x7f05e8102390 2024-08-31T06:00:26.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.877+0000 7f05de7fc640 1 -- 172.21.15.53:0/94396054 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f05e40046c0 con 0x7f05e8102390 2024-08-31T06:00:26.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.878+0000 7f05de7fc640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05d40b4c00 0x7f05d40b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:26.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.878+0000 7f05eccd0640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05d40b4c00 0x7f05d40b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:26.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.878+0000 7f05de7fc640 1 -- 172.21.15.53:0/94396054 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5764+0+0 (secure 0 0 0) 0x7f05e40e4cf0 con 0x7f05e8102390 2024-08-31T06:00:26.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.878+0000 7f05eccd0640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05d40b4c00 0x7f05d40b7110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f05e8079d00 tx=0x7f05d800b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:00:26.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:26.881+0000 7f05de7fc640 1 -- 172.21.15.53:0/94396054 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f05e4056130 con 0x7f05e8102390 2024-08-31T06:00:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:27.077+0000 7f05ef735640 1 -- 172.21.15.53:0/94396054 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f05e80635a0 con 0x7f05d40b4c00 2024-08-31T06:00:27.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:00:27.156+0000 7f5e3cb13640 -1 osd.8 0 waiting for initial osdmap 2024-08-31T06:00:27.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:00:27.319+0000 7f5e340f4640 -1 osd.8 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:00:27.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-mon[22320]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T06:00:27.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-mon[22320]: osdmap e47: 9 total, 8 up, 9 in 2024-08-31T06:00:27.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:27.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:27.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-mon[22320]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:27.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-mon[22320]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:27.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:00:27.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:00:27.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:27.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:27 smithi153 ceph-mon[22320]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' 2024-08-31T06:00:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:27 smithi053 ceph-mon[18924]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T06:00:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:27 smithi053 ceph-mon[18924]: osdmap e47: 9 total, 8 up, 9 in 2024-08-31T06:00:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:27 smithi053 ceph-mon[18924]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:27 smithi053 ceph-mon[18924]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:00:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:00:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:27.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:27 smithi053 ceph-mon[18924]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' 2024-08-31T06:00:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:27 smithi130 ceph-mon[22266]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T06:00:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:27 smithi130 ceph-mon[22266]: osdmap e47: 9 total, 8 up, 9 in 2024-08-31T06:00:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:27 smithi130 ceph-mon[22266]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:27.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:27 smithi130 ceph-mon[22266]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:27.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:00:27.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:00:27.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:27.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:27 smithi130 ceph-mon[22266]: from='osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578]' entity='osd.8' 2024-08-31T06:00:28.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:28 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T06:00:28.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:28 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T06:00:28.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:28 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:28.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:28 smithi053 ceph-mon[18924]: osdmap e48: 9 total, 8 up, 9 in 2024-08-31T06:00:28.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:28 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:28 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T06:00:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:28 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T06:00:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:28 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:28 smithi130 ceph-mon[22266]: osdmap e48: 9 total, 8 up, 9 in 2024-08-31T06:00:28.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:28 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:28.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:28 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T06:00:28.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:28 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T06:00:28.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:28 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:28.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:28 smithi153 ceph-mon[22320]: osdmap e48: 9 total, 8 up, 9 in 2024-08-31T06:00:28.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:28 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:29 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:29 smithi053 ceph-mon[18924]: osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578] boot 2024-08-31T06:00:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:29 smithi053 ceph-mon[18924]: osdmap e49: 9 total, 9 up, 9 in 2024-08-31T06:00:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:29 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:29 smithi053 ceph-mon[18924]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:29 smithi053 ceph-mon[18924]: osdmap e50: 9 total, 9 up, 9 in 2024-08-31T06:00:29.529 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:29 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:29.530 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:29 smithi130 ceph-mon[22266]: osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578] boot 2024-08-31T06:00:29.530 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:29 smithi130 ceph-mon[22266]: osdmap e49: 9 total, 9 up, 9 in 2024-08-31T06:00:29.530 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:29 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:29.530 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:29 smithi130 ceph-mon[22266]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:29.530 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:29 smithi130 ceph-mon[22266]: osdmap e50: 9 total, 9 up, 9 in 2024-08-31T06:00:29.599 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:29 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:29.599 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:29 smithi153 ceph-mon[22320]: osd.8 [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578] boot 2024-08-31T06:00:29.599 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:29 smithi153 ceph-mon[22320]: osdmap e49: 9 total, 9 up, 9 in 2024-08-31T06:00:29.599 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:29 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:00:29.599 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:29 smithi153 ceph-mon[22320]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:00:29.599 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:29 smithi153 ceph-mon[22320]: osdmap e50: 9 total, 9 up, 9 in 2024-08-31T06:00:30.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:30 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/418065577' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a462e056-c6d3-45bd-ad44-c7a6f3c25033"} : dispatch 2024-08-31T06:00:30.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:30 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/418065577' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a462e056-c6d3-45bd-ad44-c7a6f3c25033"}]': finished 2024-08-31T06:00:30.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:30 smithi153 ceph-mon[22320]: osdmap e51: 10 total, 9 up, 10 in 2024-08-31T06:00:30.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:30 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:30 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/418065577' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a462e056-c6d3-45bd-ad44-c7a6f3c25033"} : dispatch 2024-08-31T06:00:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:30 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/418065577' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a462e056-c6d3-45bd-ad44-c7a6f3c25033"}]': finished 2024-08-31T06:00:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:30 smithi130 ceph-mon[22266]: osdmap e51: 10 total, 9 up, 10 in 2024-08-31T06:00:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:30 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:30.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:30 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/418065577' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a462e056-c6d3-45bd-ad44-c7a6f3c25033"} : dispatch 2024-08-31T06:00:30.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:30 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/418065577' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a462e056-c6d3-45bd-ad44-c7a6f3c25033"}]': finished 2024-08-31T06:00:30.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:30 smithi053 ceph-mon[18924]: osdmap e51: 10 total, 9 up, 10 in 2024-08-31T06:00:30.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:30 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:31.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:31 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/273808374' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:00:31.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:31 smithi130 ceph-mon[22266]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T06:00:31.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:31 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/273808374' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:00:31.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:31 smithi153 ceph-mon[22320]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T06:00:31.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:31 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/273808374' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:00:31.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:31 smithi053 ceph-mon[18924]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T06:00:33.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:33 smithi130 ceph-mon[22266]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-08-31T06:00:33.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:33 smithi153 ceph-mon[22320]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-08-31T06:00:33.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:33 smithi053 ceph-mon[18924]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-08-31T06:00:35.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:35 smithi130 ceph-mon[22266]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-08-31T06:00:35.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:35 smithi153 ceph-mon[22320]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-08-31T06:00:35.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:35 smithi053 ceph-mon[18924]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-08-31T06:00:37.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:37 smithi130 ceph-mon[22266]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:00:37.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:37 smithi153 ceph-mon[22320]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:00:37.701 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:37 smithi053 ceph-mon[18924]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:00:38.527 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T06:00:38.527 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:38.527 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:38 smithi053 ceph-mon[18924]: Deploying daemon osd.9 on smithi053 2024-08-31T06:00:38.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T06:00:38.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:38.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:38 smithi130 ceph-mon[22266]: Deploying daemon osd.9 on smithi053 2024-08-31T06:00:38.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T06:00:38.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:38.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:38 smithi153 ceph-mon[22320]: Deploying daemon osd.9 on smithi053 2024-08-31T06:00:39.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:39 smithi130 ceph-mon[22266]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T06:00:39.672 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:39 smithi053 ceph-mon[18924]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T06:00:39.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:39 smithi153 ceph-mon[22320]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T06:00:41.587 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:41 smithi053 ceph-mon[18924]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T06:00:41.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:41 smithi153 ceph-mon[22320]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T06:00:41.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:41 smithi130 ceph-mon[22266]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T06:00:43.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:43 smithi153 ceph-mon[22320]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:43.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:43 smithi053 ceph-mon[18924]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:43 smithi130 ceph-mon[22266]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:44.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:44.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:44.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:44.695 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:44.695 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:44.695 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:44.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:44.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:44.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:45.687 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:45 smithi053 ceph-mon[18924]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:45.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:45 smithi130 ceph-mon[22266]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:45.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:45 smithi153 ceph-mon[22320]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:46.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.826+0000 7f05de7fc640 1 -- 172.21.15.53:0/94396054 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f05e80635a0 con 0x7f05d40b4c00 2024-08-31T06:00:46.830 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 9 on host 'smithi053' 2024-08-31T06:00:46.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 -- 172.21.15.53:0/94396054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05d40b4c00 msgr2=0x7f05d40b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:46.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05d40b4c00 0x7f05d40b7110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f05e8079d00 tx=0x7f05d800b410 comp rx=0 tx=0).stop 2024-08-31T06:00:46.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 -- 172.21.15.53:0/94396054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05e8102390 msgr2=0x7f05e819c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05e8102390 0x7f05e819c2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f05e400e9f0 tx=0x7f05e400edf0 comp rx=0 tx=0).stop 2024-08-31T06:00:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 -- 172.21.15.53:0/94396054 shutdown_connections 2024-08-31T06:00:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05d40b4c00 0x7f05d40b7110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05e810ff40 0x7f05e81a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e8102ce0 0x7f05e819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 --2- 172.21.15.53:0/94396054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05e8102390 0x7f05e819c2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 -- 172.21.15.53:0/94396054 >> 172.21.15.53:0/94396054 conn(0x7f05e80794e0 msgr2=0x7f05e81113c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:00:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 -- 172.21.15.53:0/94396054 shutdown_connections 2024-08-31T06:00:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:00:46.829+0000 7f05ef735640 1 -- 172.21.15.53:0/94396054 wait complete. 2024-08-31T06:00:47.516 DEBUG:teuthology.orchestra.run.smithi053:osd.9> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.9.service 2024-08-31T06:00:47.518 INFO:tasks.cephadm:Deploying osd.10 on smithi130 with /dev/vg_nvme/lv_1... 2024-08-31T06:00:47.519 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T06:00:47.778 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:00:48.123 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:47 smithi053 ceph-mon[18924]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:48.124 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:48.124 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:48.124 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:48.124 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:47 smithi130 ceph-mon[22266]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:47 smithi153 ceph-mon[22320]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:48.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:49.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:00:49 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:00:49.377+0000 7fc788fed640 -1 osd.9 0 log_to_monitors true 2024-08-31T06:00:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:49 smithi130 ceph-mon[22266]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:50.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:49 smithi130 ceph-mon[22266]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T06:00:50.136 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-31T06:00:50.164 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_1 2024-08-31T06:00:50.170 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:49 smithi053 ceph-mon[18924]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:50.170 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:49 smithi053 ceph-mon[18924]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T06:00:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:49 smithi153 ceph-mon[22320]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:49 smithi153 ceph-mon[22320]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T06:00:50.416 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:00:50.962 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T06:00:50.962 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: osdmap e52: 10 total, 9 up, 10 in 2024-08-31T06:00:50.962 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T06:00:50.962 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:50.962 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:50.962 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:50.962 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:50.963 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:50.963 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:50.963 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:50.963 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:50.963 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:50.963 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:50.963 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:50.963 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:50 smithi130 ceph-mon[22266]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T06:00:51.048 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T06:00:51.048 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: osdmap e52: 10 total, 9 up, 10 in 2024-08-31T06:00:51.048 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T06:00:51.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:51.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:51.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:51.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:51.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:51.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:51.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:51.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:51.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:51.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:51.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:51.050 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:50 smithi053 ceph-mon[18924]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T06:00:51.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.056+0000 7f40fd9d4640 1 -- 172.21.15.130:0/3857812427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f81050a0 msgr2=0x7f40f810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:51.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.056+0000 7f40fd9d4640 1 --2- 172.21.15.130:0/3857812427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f81050a0 0x7f40f810d5f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009900 tx=0x7f40ec02a410 comp rx=0 tx=0).stop 2024-08-31T06:00:51.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.056+0000 7f40fd9d4640 1 -- 172.21.15.130:0/3857812427 shutdown_connections 2024-08-31T06:00:51.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.056+0000 7f40fd9d4640 1 --2- 172.21.15.130:0/3857812427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40f810dbb0 0x7f40f81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:51.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.056+0000 7f40fd9d4640 1 --2- 172.21.15.130:0/3857812427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f81050a0 0x7f40f810d5f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:51.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.056+0000 7f40fd9d4640 1 --2- 172.21.15.130:0/3857812427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40f8104750 0x7f40f8104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:51.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.056+0000 7f40fd9d4640 1 -- 172.21.15.130:0/3857812427 >> 172.21.15.130:0/3857812427 conn(0x7f40f80794d0 msgr2=0x7f40f80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:00:51.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.056+0000 7f40fd9d4640 1 -- 172.21.15.130:0/3857812427 shutdown_connections 2024-08-31T06:00:51.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.056+0000 7f40fd9d4640 1 -- 172.21.15.130:0/3857812427 wait complete. 2024-08-31T06:00:51.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40fd9d4640 1 Processor -- start 2024-08-31T06:00:51.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40fd9d4640 1 -- start start 2024-08-31T06:00:51.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40fd9d4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f8104750 0x7f40f819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:51.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40fd9d4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40f81050a0 0x7f40f819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:51.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40fd9d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40f810dbb0 0x7f40f819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:51.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40fd9d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40f81136a0 con 0x7f40f810dbb0 2024-08-31T06:00:51.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40fd9d4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40f8113520 con 0x7f40f8104750 2024-08-31T06:00:51.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40fd9d4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40f8113820 con 0x7f40f81050a0 2024-08-31T06:00:51.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40f6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f8104750 0x7f40f819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:51.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40f6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f8104750 0x7f40f819a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40892/0 (socket says 172.21.15.130:40892) 2024-08-31T06:00:51.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40f6ffd640 1 -- 172.21.15.130:0/677069137 learned_addr learned my addr 172.21.15.130:0/677069137 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-31T06:00:51.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40f67fc640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40f81050a0 0x7f40f819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:51.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.057+0000 7f40f77fe640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40f810dbb0 0x7f40f819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:51.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.058+0000 7f40f6ffd640 1 -- 172.21.15.130:0/677069137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40f81050a0 msgr2=0x7f40f819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:51.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.058+0000 7f40f6ffd640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40f81050a0 0x7f40f819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:51.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.058+0000 7f40f6ffd640 1 -- 172.21.15.130:0/677069137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40f810dbb0 msgr2=0x7f40f819fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:00:51.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.058+0000 7f40f6ffd640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40f810dbb0 0x7f40f819fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:00:51.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.058+0000 7f40f6ffd640 1 -- 172.21.15.130:0/677069137 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f81a0180 con 0x7f40f8104750 2024-08-31T06:00:51.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.058+0000 7f40f6ffd640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f8104750 0x7f40f819a210 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f40e800e9c0 tx=0x7f40e800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:00:51.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.058+0000 7f40fc9d2640 1 -- 172.21.15.130:0/677069137 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e800cd80 con 0x7f40f8104750 2024-08-31T06:00:51.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.058+0000 7f40fd9d4640 1 -- 172.21.15.130:0/677069137 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f81a0470 con 0x7f40f8104750 2024-08-31T06:00:51.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.058+0000 7f40fc9d2640 1 -- 172.21.15.130:0/677069137 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40e80044b0 con 0x7f40f8104750 2024-08-31T06:00:51.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.058+0000 7f40fc9d2640 1 -- 172.21.15.130:0/677069137 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8010430 con 0x7f40f8104750 2024-08-31T06:00:51.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.058+0000 7f40fd9d4640 1 -- 172.21.15.130:0/677069137 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f81a6bd0 con 0x7f40f8104750 2024-08-31T06:00:51.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.059+0000 7f40fd9d4640 1 -- 172.21.15.130:0/677069137 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f8104b60 con 0x7f40f8104750 2024-08-31T06:00:51.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.061+0000 7f40fc9d2640 1 -- 172.21.15.130:0/677069137 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f40e8003f00 con 0x7f40f8104750 2024-08-31T06:00:51.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.062+0000 7f40fc9d2640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40e00b4b80 0x7f40e00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:00:51.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.062+0000 7f40fc9d2640 1 -- 172.21.15.130:0/677069137 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6196+0+0 (secure 0 0 0) 0x7f40e80e4dd0 con 0x7f40f8104750 2024-08-31T06:00:51.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.062+0000 7f40f67fc640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40e00b4b80 0x7f40e00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:00:51.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.062+0000 7f40f67fc640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40e00b4b80 0x7f40e00b7090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f40ec005940 tx=0x7f40ec0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:00:51.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.069+0000 7f40fc9d2640 1 -- 172.21.15.130:0/677069137 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f40e80ac7d0 con 0x7f40f8104750 2024-08-31T06:00:51.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: osdmap e52: 10 total, 9 up, 10 in 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi053", "root=default"]} : dispatch 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:51.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:51.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:50 smithi153 ceph-mon[22320]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-08-31T06:00:51.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:00:51.261+0000 7f40fd9d4640 1 -- 172.21.15.130:0/677069137 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f40f80635a0 con 0x7f40e00b4b80 2024-08-31T06:00:51.841 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:00:51.573+0000 7fc785784640 -1 osd.9 0 waiting for initial osdmap 2024-08-31T06:00:51.841 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:00:51.585+0000 7fc77cd65640 -1 osd.9 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:00:51.965 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:51.965 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi053 2024-08-31T06:00:51.965 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi053 to 4273M 2024-08-31T06:00:51.965 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: osdmap e53: 10 total, 9 up, 10 in 2024-08-31T06:00:51.966 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:51.966 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:51.966 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:51.966 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:51.966 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:51.966 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:51.966 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:00:51.966 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:00:51.966 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:51.966 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' 2024-08-31T06:00:51.966 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi053 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi053 to 4273M 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: osdmap e53: 10 total, 9 up, 10 in 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' 2024-08-31T06:00:52.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi053 2024-08-31T06:00:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi053 to 4273M 2024-08-31T06:00:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: osdmap e53: 10 total, 9 up, 10 in 2024-08-31T06:00:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:52.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:00:52.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:52.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:00:52.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:00:52.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:00:52.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:00:52.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:00:52.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: from='osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365]' entity='osd.9' 2024-08-31T06:00:52.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:52.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:52 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T06:00:52.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:52 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T06:00:52.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:52 smithi130 ceph-mon[22266]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:52.989 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:52 smithi130 ceph-mon[22266]: osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365] boot 2024-08-31T06:00:52.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:52 smithi130 ceph-mon[22266]: osdmap e54: 10 total, 10 up, 10 in 2024-08-31T06:00:52.990 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:52 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:53.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:52 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T06:00:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:52 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T06:00:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:52 smithi153 ceph-mon[22320]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:52 smithi153 ceph-mon[22320]: osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365] boot 2024-08-31T06:00:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:52 smithi153 ceph-mon[22320]: osdmap e54: 10 total, 10 up, 10 in 2024-08-31T06:00:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:52 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:53.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:52 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T06:00:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:52 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T06:00:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:52 smithi053 ceph-mon[18924]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:52 smithi053 ceph-mon[18924]: osd.9 [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365] boot 2024-08-31T06:00:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:52 smithi053 ceph-mon[18924]: osdmap e54: 10 total, 10 up, 10 in 2024-08-31T06:00:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:52 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:00:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:53 smithi130 ceph-mon[22266]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:53 smithi130 ceph-mon[22266]: from='client.? 172.21.15.130:0/543777007' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05716830-2ec8-49f3-9cce-3efc73c935c9"} : dispatch 2024-08-31T06:00:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:53 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05716830-2ec8-49f3-9cce-3efc73c935c9"} : dispatch 2024-08-31T06:00:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:53 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05716830-2ec8-49f3-9cce-3efc73c935c9"}]': finished 2024-08-31T06:00:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:53 smithi130 ceph-mon[22266]: osdmap e55: 11 total, 10 up, 11 in 2024-08-31T06:00:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:00:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:53 smithi153 ceph-mon[22320]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:53 smithi153 ceph-mon[22320]: from='client.? 172.21.15.130:0/543777007' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05716830-2ec8-49f3-9cce-3efc73c935c9"} : dispatch 2024-08-31T06:00:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:53 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05716830-2ec8-49f3-9cce-3efc73c935c9"} : dispatch 2024-08-31T06:00:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:53 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05716830-2ec8-49f3-9cce-3efc73c935c9"}]': finished 2024-08-31T06:00:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:53 smithi153 ceph-mon[22320]: osdmap e55: 11 total, 10 up, 11 in 2024-08-31T06:00:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:00:54.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:53 smithi053 ceph-mon[18924]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:00:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:53 smithi053 ceph-mon[18924]: from='client.? 172.21.15.130:0/543777007' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05716830-2ec8-49f3-9cce-3efc73c935c9"} : dispatch 2024-08-31T06:00:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:53 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05716830-2ec8-49f3-9cce-3efc73c935c9"} : dispatch 2024-08-31T06:00:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:53 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05716830-2ec8-49f3-9cce-3efc73c935c9"}]': finished 2024-08-31T06:00:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:53 smithi053 ceph-mon[18924]: osdmap e55: 11 total, 10 up, 11 in 2024-08-31T06:00:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:00:55.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:54 smithi153 ceph-mon[22320]: from='client.? 172.21.15.130:0/588178013' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:00:55.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:54 smithi053 ceph-mon[18924]: from='client.? 172.21.15.130:0/588178013' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:00:55.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:54 smithi130 ceph-mon[22266]: from='client.? 172.21.15.130:0/588178013' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:00:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:55 smithi153 ceph-mon[22320]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:00:56.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:55 smithi053 ceph-mon[18924]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:00:56.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:55 smithi130 ceph-mon[22266]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:00:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:57 smithi153 ceph-mon[22320]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:00:58.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:57 smithi053 ceph-mon[18924]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:00:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:57 smithi130 ceph-mon[22266]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:00:59 smithi130 ceph-mon[22266]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:00:59 smithi153 ceph-mon[22320]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:00.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:00:59 smithi053 ceph-mon[18924]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:01 smithi153 ceph-mon[22320]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:02.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:01 smithi053 ceph-mon[18924]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:02.331 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:01 smithi130 ceph-mon[22266]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:03.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T06:01:03.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:03.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:02 smithi153 ceph-mon[22320]: Deploying daemon osd.10 on smithi130 2024-08-31T06:01:03.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T06:01:03.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:03.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:02 smithi053 ceph-mon[18924]: Deploying daemon osd.10 on smithi130 2024-08-31T06:01:03.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T06:01:03.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:03.249 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:02 smithi130 ceph-mon[22266]: Deploying daemon osd.10 on smithi130 2024-08-31T06:01:04.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:03 smithi130 ceph-mon[22266]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:03 smithi153 ceph-mon[22320]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:04.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:03 smithi053 ceph-mon[18924]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:05 smithi130 ceph-mon[22266]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:05 smithi153 ceph-mon[22320]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:05 smithi053 ceph-mon[18924]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:08.003 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:07 smithi130 ceph-mon[22266]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:08.003 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:08.003 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:08.003 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:08.029 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:07 smithi053 ceph-mon[18924]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:08.029 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:08.029 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:08.029 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:07 smithi153 ceph-mon[22320]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:10.175 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:09 smithi130 ceph-mon[22266]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:09 smithi153 ceph-mon[22320]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:09 smithi053 ceph-mon[18924]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:10.969 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 10 on host 'smithi130' 2024-08-31T06:01:10.969 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.966+0000 7f40fc9d2640 1 -- 172.21.15.130:0/677069137 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f40f80635a0 con 0x7f40e00b4b80 2024-08-31T06:01:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 -- 172.21.15.130:0/677069137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40e00b4b80 msgr2=0x7f40e00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40e00b4b80 0x7f40e00b7090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f40ec005940 tx=0x7f40ec0058d0 comp rx=0 tx=0).stop 2024-08-31T06:01:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 -- 172.21.15.130:0/677069137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f8104750 msgr2=0x7f40f819a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f8104750 0x7f40f819a210 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f40e800e9c0 tx=0x7f40e800ee80 comp rx=0 tx=0).stop 2024-08-31T06:01:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 -- 172.21.15.130:0/677069137 shutdown_connections 2024-08-31T06:01:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40e00b4b80 0x7f40e00b7090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40f810dbb0 0x7f40f819fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40f81050a0 0x7f40f819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:10.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 --2- 172.21.15.130:0/677069137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40f8104750 0x7f40f819a210 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 -- 172.21.15.130:0/677069137 >> 172.21.15.130:0/677069137 conn(0x7f40f80794d0 msgr2=0x7f40f81006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 -- 172.21.15.130:0/677069137 shutdown_connections 2024-08-31T06:01:10.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-31T06:01:10.969+0000 7f40fd9d4640 1 -- 172.21.15.130:0/677069137 wait complete. 2024-08-31T06:01:11.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.558 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.558 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.558 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:11.558 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:11.558 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.558 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:11.558 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.558 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.586 DEBUG:teuthology.orchestra.run.smithi130:osd.10> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.10.service 2024-08-31T06:01:11.588 INFO:tasks.cephadm:Deploying osd.11 on smithi153 with /dev/vg_nvme/lv_1... 2024-08-31T06:01:11.588 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T06:01:11.616 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.616 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.616 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:11.617 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:11.617 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.617 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:11.617 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.617 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:01:12.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:12 smithi153 ceph-mon[22320]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:12.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:12 smithi130 ceph-mon[22266]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:12.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:12 smithi053 ceph-mon[18924]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:13.628 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:01:13 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:01:13.358+0000 7f8d9b203640 -1 osd.10 0 log_to_monitors true 2024-08-31T06:01:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:14 smithi130 ceph-mon[22266]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:14 smithi130 ceph-mon[22266]: from='osd.10 [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:01:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:14 smithi130 ceph-mon[22266]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:01:14.422 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:14 smithi153 ceph-mon[22320]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:14.422 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:14 smithi153 ceph-mon[22320]: from='osd.10 [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:01:14.422 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:14 smithi153 ceph-mon[22320]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:01:14.425 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-08-31T06:01:14.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi153:vg_nvme/lv_1 2024-08-31T06:01:14.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:14 smithi053 ceph-mon[18924]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:14.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:14 smithi053 ceph-mon[18924]: from='osd.10 [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:01:14.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:14 smithi053 ceph-mon[18924]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:01:14.763 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:01:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.169+0000 7efeac241640 1 -- 172.21.15.153:0/3496726699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efea4106040 msgr2=0x7efea4106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.169+0000 7efeac241640 1 --2- 172.21.15.153:0/3496726699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efea4106040 0x7efea4106450 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efea0009930 tx=0x7efea002a420 comp rx=0 tx=0).stop 2024-08-31T06:01:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.169+0000 7efeac241640 1 -- 172.21.15.153:0/3496726699 shutdown_connections 2024-08-31T06:01:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.169+0000 7efeac241640 1 --2- 172.21.15.153:0/3496726699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efea4106990 0x7efea4110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.169+0000 7efeac241640 1 --2- 172.21.15.153:0/3496726699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efea4106040 0x7efea4106450 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.169+0000 7efeac241640 1 --2- 172.21.15.153:0/3496726699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efea4101df0 0x7efea4102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.169+0000 7efeac241640 1 -- 172.21.15.153:0/3496726699 >> 172.21.15.153:0/3496726699 conn(0x7efea4077a00 msgr2=0x7efea4077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.170+0000 7efeac241640 1 -- 172.21.15.153:0/3496726699 shutdown_connections 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.170+0000 7efeac241640 1 -- 172.21.15.153:0/3496726699 wait complete. 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.170+0000 7efeac241640 1 Processor -- start 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.170+0000 7efeac241640 1 -- start start 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efeac241640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efea4101df0 0x7efea419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efeac241640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efea4106040 0x7efea419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efeac241640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efea4106990 0x7efea41a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efeac241640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efea4103530 con 0x7efea4106040 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efeac241640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efea41033b0 con 0x7efea4106990 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efeac241640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efea41036b0 con 0x7efea4101df0 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efea9fdd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efea4101df0 0x7efea419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efea9fdd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efea4101df0 0x7efea419c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40158/0 (socket says 172.21.15.153:40158) 2024-08-31T06:01:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efea9fdd640 1 -- 172.21.15.153:0/4157925236 learned_addr learned my addr 172.21.15.153:0/4157925236 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-31T06:01:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efea97dc640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efea4106040 0x7efea419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efeaa7de640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efea4106990 0x7efea41a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efea9fdd640 1 -- 172.21.15.153:0/4157925236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efea4106990 msgr2=0x7efea41a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efea9fdd640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efea4106990 0x7efea41a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efea9fdd640 1 -- 172.21.15.153:0/4157925236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efea4106040 msgr2=0x7efea419c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efea9fdd640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efea4106040 0x7efea419c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efea9fdd640 1 -- 172.21.15.153:0/4157925236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea41a22f0 con 0x7efea4101df0 2024-08-31T06:01:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efeaa7de640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efea4106990 0x7efea41a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:01:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efea9fdd640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efea4101df0 0x7efea419c380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efe9400e9c0 tx=0x7efe9400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.171+0000 7efe9affd640 1 -- 172.21.15.153:0/4157925236 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9400cd80 con 0x7efea4101df0 2024-08-31T06:01:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.172+0000 7efeac241640 1 -- 172.21.15.153:0/4157925236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea41a25e0 con 0x7efea4101df0 2024-08-31T06:01:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.172+0000 7efe9affd640 1 -- 172.21.15.153:0/4157925236 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe940035f0 con 0x7efea4101df0 2024-08-31T06:01:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.172+0000 7efe9affd640 1 -- 172.21.15.153:0/4157925236 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe940044c0 con 0x7efea4101df0 2024-08-31T06:01:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.172+0000 7efeac241640 1 -- 172.21.15.153:0/4157925236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea41a8d40 con 0x7efea4101df0 2024-08-31T06:01:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.173+0000 7efeac241640 1 -- 172.21.15.153:0/4157925236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea4102200 con 0x7efea4101df0 2024-08-31T06:01:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.174+0000 7efe9affd640 1 -- 172.21.15.153:0/4157925236 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7efe94004000 con 0x7efea4101df0 2024-08-31T06:01:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.175+0000 7efe9affd640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efe900b4c00 0x7efe900b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.175+0000 7efe9affd640 1 -- 172.21.15.153:0/4157925236 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6613+0+0 (secure 0 0 0) 0x7efe940e4f80 con 0x7efea4101df0 2024-08-31T06:01:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.175+0000 7efea97dc640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efe900b4c00 0x7efe900b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:15.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.176+0000 7efea97dc640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efe900b4c00 0x7efe900b7110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efea0009900 tx=0x7efea00058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.182+0000 7efe9affd640 1 -- 172.21.15.153:0/4157925236 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efe940ac750 con 0x7efea4101df0 2024-08-31T06:01:15.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:15.371+0000 7efeac241640 1 -- 172.21.15.153:0/4157925236 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7efea4104520 con 0x7efe900b4c00 2024-08-31T06:01:15.374 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T06:01:15.374 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: osdmap e56: 11 total, 10 up, 11 in 2024-08-31T06:01:15.374 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='osd.10 [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:01:15.374 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:15.374 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:01:15.374 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.374 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.374 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.375 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.375 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.375 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.375 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.375 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:15.375 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:15.375 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.375 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:15 smithi153 ceph-mon[22320]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T06:01:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T06:01:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: osdmap e56: 11 total, 10 up, 11 in 2024-08-31T06:01:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='osd.10 [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:01:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:01:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:15.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:15.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:15 smithi053 ceph-mon[18924]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T06:01:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T06:01:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: osdmap e56: 11 total, 10 up, 11 in 2024-08-31T06:01:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='osd.10 [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:01:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:15 smithi130 ceph-mon[22266]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-31T06:01:16.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:01:16.083+0000 7f8d97185640 -1 osd.10 0 waiting for initial osdmap 2024-08-31T06:01:16.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:01:16.247+0000 7f8d8ef7b640 -1 osd.10 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:01:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi130 2024-08-31T06:01:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi130 to 4272M 2024-08-31T06:01:16.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: osdmap e57: 11 total, 10 up, 11 in 2024-08-31T06:01:16.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:16.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:16.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:16.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:01:16.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:01:16.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:16.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: from='osd.10 ' entity='osd.10' 2024-08-31T06:01:16.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:16 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi130 2024-08-31T06:01:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi130 to 4272M 2024-08-31T06:01:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: osdmap e57: 11 total, 10 up, 11 in 2024-08-31T06:01:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:01:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:01:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: from='osd.10 ' entity='osd.10' 2024-08-31T06:01:16.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:16 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:16.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi130 2024-08-31T06:01:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi130 to 4272M 2024-08-31T06:01:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: osdmap e57: 11 total, 10 up, 11 in 2024-08-31T06:01:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:01:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:01:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: from='osd.10 ' entity='osd.10' 2024-08-31T06:01:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:16 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:17.318 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:17 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T06:01:17.318 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:17 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T06:01:17.319 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:17 smithi153 ceph-mon[22320]: osdmap e58: 11 total, 10 up, 11 in 2024-08-31T06:01:17.319 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:17.319 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:17 smithi153 ceph-mon[22320]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:17.319 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:17 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:17 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T06:01:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:17 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T06:01:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:17 smithi130 ceph-mon[22266]: osdmap e58: 11 total, 10 up, 11 in 2024-08-31T06:01:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:17 smithi130 ceph-mon[22266]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:17 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:17.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:17 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T06:01:17.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:17 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T06:01:17.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:17 smithi053 ceph-mon[18924]: osdmap e58: 11 total, 10 up, 11 in 2024-08-31T06:01:17.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:17.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:17 smithi053 ceph-mon[18924]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:01:17.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:17 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:18.412 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:18 smithi153 ceph-mon[22320]: osd.10 [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437] boot 2024-08-31T06:01:18.412 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:18 smithi153 ceph-mon[22320]: osdmap e59: 11 total, 11 up, 11 in 2024-08-31T06:01:18.412 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:18 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:18.412 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:18 smithi153 ceph-mon[22320]: from='client.? 172.21.15.153:0/2624055866' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99124195-0220-48f7-88fe-200568ae4d31"} : dispatch 2024-08-31T06:01:18.412 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:18 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99124195-0220-48f7-88fe-200568ae4d31"} : dispatch 2024-08-31T06:01:18.412 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:18 smithi153 ceph-mon[22320]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99124195-0220-48f7-88fe-200568ae4d31"}]': finished 2024-08-31T06:01:18.412 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:18 smithi153 ceph-mon[22320]: osdmap e60: 12 total, 11 up, 12 in 2024-08-31T06:01:18.413 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:18 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:18 smithi130 ceph-mon[22266]: osd.10 [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437] boot 2024-08-31T06:01:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:18 smithi130 ceph-mon[22266]: osdmap e59: 11 total, 11 up, 11 in 2024-08-31T06:01:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:18 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:18 smithi130 ceph-mon[22266]: from='client.? 172.21.15.153:0/2624055866' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99124195-0220-48f7-88fe-200568ae4d31"} : dispatch 2024-08-31T06:01:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:18 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99124195-0220-48f7-88fe-200568ae4d31"} : dispatch 2024-08-31T06:01:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:18 smithi130 ceph-mon[22266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99124195-0220-48f7-88fe-200568ae4d31"}]': finished 2024-08-31T06:01:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:18 smithi130 ceph-mon[22266]: osdmap e60: 12 total, 11 up, 12 in 2024-08-31T06:01:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:18 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:18.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:18 smithi053 ceph-mon[18924]: osd.10 [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437] boot 2024-08-31T06:01:18.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:18 smithi053 ceph-mon[18924]: osdmap e59: 11 total, 11 up, 11 in 2024-08-31T06:01:18.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:18 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:01:18.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:18 smithi053 ceph-mon[18924]: from='client.? 172.21.15.153:0/2624055866' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99124195-0220-48f7-88fe-200568ae4d31"} : dispatch 2024-08-31T06:01:18.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:18 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99124195-0220-48f7-88fe-200568ae4d31"} : dispatch 2024-08-31T06:01:18.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:18 smithi053 ceph-mon[18924]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99124195-0220-48f7-88fe-200568ae4d31"}]': finished 2024-08-31T06:01:18.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:18 smithi053 ceph-mon[18924]: osdmap e60: 12 total, 11 up, 12 in 2024-08-31T06:01:18.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:18 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:19.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:19 smithi130 ceph-mon[22266]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:19.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:19 smithi130 ceph-mon[22266]: from='client.? 172.21.15.153:0/1743736722' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:01:19.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:19 smithi130 ceph-mon[22266]: osdmap e61: 12 total, 11 up, 12 in 2024-08-31T06:01:19.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:19.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:19 smithi153 ceph-mon[22320]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:19.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:19 smithi153 ceph-mon[22320]: from='client.? 172.21.15.153:0/1743736722' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:01:19.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:19 smithi153 ceph-mon[22320]: osdmap e61: 12 total, 11 up, 12 in 2024-08-31T06:01:19.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:19.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:19 smithi053 ceph-mon[18924]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:19.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:19 smithi053 ceph-mon[18924]: from='client.? 172.21.15.153:0/1743736722' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:01:19.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:19 smithi053 ceph-mon[18924]: osdmap e61: 12 total, 11 up, 12 in 2024-08-31T06:01:19.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:21.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:21 smithi130 ceph-mon[22266]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-08-31T06:01:21.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:21 smithi153 ceph-mon[22320]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-08-31T06:01:21.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:21 smithi053 ceph-mon[18924]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-08-31T06:01:23.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:23 smithi153 ceph-mon[22320]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:01:23.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:23 smithi053 ceph-mon[18924]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:01:23.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:23 smithi130 ceph-mon[22266]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:01:25.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:25 smithi153 ceph-mon[22320]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-08-31T06:01:25.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:25 smithi053 ceph-mon[18924]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-08-31T06:01:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:25 smithi130 ceph-mon[22266]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-08-31T06:01:26.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T06:01:26.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:26 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:26.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T06:01:26.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:26 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:26.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T06:01:26.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:26 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:27.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:27 smithi153 ceph-mon[22320]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-08-31T06:01:27.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:27 smithi153 ceph-mon[22320]: Deploying daemon osd.11 on smithi153 2024-08-31T06:01:27.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:27 smithi053 ceph-mon[18924]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-08-31T06:01:27.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:27 smithi053 ceph-mon[18924]: Deploying daemon osd.11 on smithi153 2024-08-31T06:01:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:27 smithi130 ceph-mon[22266]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-08-31T06:01:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:27 smithi130 ceph-mon[22266]: Deploying daemon osd.11 on smithi153 2024-08-31T06:01:29.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:29 smithi153 ceph-mon[22320]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T06:01:29.680 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:29 smithi130 ceph-mon[22266]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T06:01:29.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:29 smithi053 ceph-mon[18924]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T06:01:31.492 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:31 smithi153 ceph-mon[22320]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T06:01:31.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:31 smithi053 ceph-mon[18924]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T06:01:31.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:31 smithi130 ceph-mon[22266]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T06:01:32.526 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:32 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:32.526 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:32 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:32.526 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:32 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:32.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:32 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:32.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:32 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:32.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:32 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:32.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:32 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:32.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:32 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:32.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:32 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:33.774 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:33 smithi153 ceph-mon[22320]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:33 smithi130 ceph-mon[22266]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:33.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:33 smithi053 ceph-mon[18924]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:34.760 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 11 on host 'smithi153' 2024-08-31T06:01:34.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.758+0000 7efe9affd640 1 -- 172.21.15.153:0/4157925236 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7efea4104520 con 0x7efe900b4c00 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 -- 172.21.15.153:0/4157925236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efe900b4c00 msgr2=0x7efe900b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efe900b4c00 0x7efe900b7110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efea0009900 tx=0x7efea00058d0 comp rx=0 tx=0).stop 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 -- 172.21.15.153:0/4157925236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efea4101df0 msgr2=0x7efea419c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efea4101df0 0x7efea419c380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efe9400e9c0 tx=0x7efe9400ee80 comp rx=0 tx=0).stop 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 -- 172.21.15.153:0/4157925236 shutdown_connections 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efe900b4c00 0x7efe900b7110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efea4106990 0x7efea41a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efea4106040 0x7efea419c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 --2- 172.21.15.153:0/4157925236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efea4101df0 0x7efea419c380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 -- 172.21.15.153:0/4157925236 >> 172.21.15.153:0/4157925236 conn(0x7efea4077a00 msgr2=0x7efea4103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 -- 172.21.15.153:0/4157925236 shutdown_connections 2024-08-31T06:01:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:34.761+0000 7efeac241640 1 -- 172.21.15.153:0/4157925236 wait complete. 2024-08-31T06:01:35.426 DEBUG:teuthology.orchestra.run.smithi153:osd.11> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.11.service 2024-08-31T06:01:35.428 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-31T06:01:35.428 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T06:01:35.696 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:01:36.041 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:35 smithi153 ceph-mon[22320]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:36.041 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:35 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.041 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:35 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.041 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:35 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.041 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:35 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.067 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:35 smithi053 ceph-mon[18924]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:36.067 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:35 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.067 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:35 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.067 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:35 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.067 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:35 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:35 smithi130 ceph-mon[22266]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:35 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:35 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:35 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:35 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:36.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.158+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/4128516843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109280 msgr2=0x7fe5d0109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.158+0000 7fe5d6eeb640 1 --2- 172.21.15.53:0/4128516843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109280 0x7fe5d0109690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009900 tx=0x7fe5bc02a410 comp rx=0 tx=0).stop 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.158+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/4128516843 shutdown_connections 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.158+0000 7fe5d6eeb640 1 --2- 172.21.15.53:0/4128516843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0109bd0 0x7fe5d0110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.158+0000 7fe5d6eeb640 1 --2- 172.21.15.53:0/4128516843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109280 0x7fe5d0109690 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.158+0000 7fe5d6eeb640 1 --2- 172.21.15.53:0/4128516843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0103940 0x7fe5d0103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.158+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/4128516843 >> 172.21.15.53:0/4128516843 conn(0x7fe5d00ff3d0 msgr2=0x7fe5d0101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.158+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/4128516843 shutdown_connections 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.158+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/4128516843 wait complete. 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d6eeb640 1 Processor -- start 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d6eeb640 1 -- start start 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d6eeb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0103940 0x7fe5d00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:36.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d6eeb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0109280 0x7fe5d00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d6eeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109bd0 0x7fe5d0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d6eeb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d0113740 con 0x7fe5d0109bd0 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d6eeb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d01135c0 con 0x7fe5d0103940 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d6eeb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d01138c0 con 0x7fe5d0109280 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d5488640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109bd0 0x7fe5d0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d5488640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109bd0 0x7fe5d0075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37042/0 (socket says 172.21.15.53:37042) 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d5488640 1 -- 172.21.15.53:0/66524461 learned_addr learned my addr 172.21.15.53:0/66524461 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5cffff640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0109280 0x7fe5d00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.159+0000 7fe5d4c87640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0103940 0x7fe5d00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.160+0000 7fe5d5488640 1 -- 172.21.15.53:0/66524461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0109280 msgr2=0x7fe5d00759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.160+0000 7fe5d5488640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0109280 0x7fe5d00759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:36.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.160+0000 7fe5d5488640 1 -- 172.21.15.53:0/66524461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0103940 msgr2=0x7fe5d00754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.160+0000 7fe5d5488640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0103940 0x7fe5d00754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.160+0000 7fe5d5488640 1 -- 172.21.15.53:0/66524461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d01a83c0 con 0x7fe5d0109bd0 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.160+0000 7fe5d5488640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109bd0 0x7fe5d0075f30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800eaa0 tx=0x7fe5c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.160+0000 7fe5cdffb640 1 -- 172.21.15.53:0/66524461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800cdb0 con 0x7fe5d0109bd0 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.160+0000 7fe5cdffb640 1 -- 172.21.15.53:0/66524461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5c8005020 con 0x7fe5d0109bd0 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.160+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/66524461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d01a86b0 con 0x7fe5d0109bd0 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.160+0000 7fe5cdffb640 1 -- 172.21.15.53:0/66524461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80116d0 con 0x7fe5d0109bd0 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.160+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/66524461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d01a8bc0 con 0x7fe5d0109bd0 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.161+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/66524461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d0103d50 con 0x7fe5d0109bd0 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.163+0000 7fe5cdffb640 1 -- 172.21.15.53:0/66524461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fe5c8004b20 con 0x7fe5d0109bd0 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.163+0000 7fe5cdffb640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5c00b4b80 0x7fe5c00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.164+0000 7fe5d4c87640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5c00b4b80 0x7fe5c00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:36.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.164+0000 7fe5cdffb640 1 -- 172.21.15.53:0/66524461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 7024+0+0 (secure 0 0 0) 0x7fe5c80e4e70 con 0x7fe5d0109bd0 2024-08-31T06:01:36.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.164+0000 7fe5d4c87640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5c00b4b80 0x7fe5c00b7090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4005e10 tx=0x7fe5c4005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:36.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.168+0000 7fe5cdffb640 1 -- 172.21.15.53:0/66524461 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe5c8016030 con 0x7fe5d0109bd0 2024-08-31T06:01:36.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.354+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/66524461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe5d002e430 con 0x7fe5d0109bd0 2024-08-31T06:01:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.355+0000 7fe5cdffb640 1 -- 172.21.15.53:0/66524461 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v61) ==== 74+0+133 (secure 0 0 0) 0x7fe5c80ac4b0 con 0x7fe5d0109bd0 2024-08-31T06:01:36.358 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:01:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/66524461 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5c00b4b80 msgr2=0x7fe5c00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5c00b4b80 0x7fe5c00b7090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4005e10 tx=0x7fe5c4005da0 comp rx=0 tx=0).stop 2024-08-31T06:01:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/66524461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109bd0 msgr2=0x7fe5d0075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109bd0 0x7fe5d0075f30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800eaa0 tx=0x7fe5c800ef60 comp rx=0 tx=0).stop 2024-08-31T06:01:36.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/66524461 shutdown_connections 2024-08-31T06:01:36.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5c00b4b80 0x7fe5c00b7090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:36.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109bd0 0x7fe5d0075f30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:36.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0109280 0x7fe5d00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:36.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 --2- 172.21.15.53:0/66524461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0103940 0x7fe5d00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:36.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/66524461 >> 172.21.15.53:0/66524461 conn(0x7fe5d00ff3d0 msgr2=0x7fe5d01017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:36.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/66524461 shutdown_connections 2024-08-31T06:01:36.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:36.357+0000 7fe5d6eeb640 1 -- 172.21.15.53:0/66524461 wait complete. 2024-08-31T06:01:37.045 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:36 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/66524461' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:01:37.046 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:36 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/66524461' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:01:37.073 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":61,"num_osds":12,"num_up_osds":11,"osd_up_since":1725084077,"num_in_osds":12,"osd_in_since":1725084077,"num_remapped_pgs":0} 2024-08-31T06:01:37.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:36 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/66524461' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:01:37.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:01:37 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:01:37.350+0000 7ff94a9fd640 -1 osd.11 0 log_to_monitors true 2024-08-31T06:01:38.074 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T06:01:38.099 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:37 smithi053 ceph-mon[18924]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:38.099 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:37 smithi053 ceph-mon[18924]: from='osd.11 [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:01:38.099 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:37 smithi053 ceph-mon[18924]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:01:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:37 smithi130 ceph-mon[22266]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:37 smithi130 ceph-mon[22266]: from='osd.11 [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:01:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:37 smithi130 ceph-mon[22266]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:01:38.169 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:37 smithi153 ceph-mon[22320]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:38.169 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:37 smithi153 ceph-mon[22320]: from='osd.11 [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:01:38.169 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:37 smithi153 ceph-mon[22320]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:01:38.328 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:01:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.849+0000 7fbcf7210640 1 -- 172.21.15.53:0/3791151727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0109250 msgr2=0x7fbcf0109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.849+0000 7fbcf7210640 1 --2- 172.21.15.53:0/3791151727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0109250 0x7fbcf0109660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009900 tx=0x7fbcdc02a410 comp rx=0 tx=0).stop 2024-08-31T06:01:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.849+0000 7fbcf7210640 1 -- 172.21.15.53:0/3791151727 shutdown_connections 2024-08-31T06:01:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.849+0000 7fbcf7210640 1 --2- 172.21.15.53:0/3791151727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcf0109ba0 0x7fbcf01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.849+0000 7fbcf7210640 1 --2- 172.21.15.53:0/3791151727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0109250 0x7fbcf0109660 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.849+0000 7fbcf7210640 1 --2- 172.21.15.53:0/3791151727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0101d10 0x7fbcf0102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.849+0000 7fbcf7210640 1 -- 172.21.15.53:0/3791151727 >> 172.21.15.53:0/3791151727 conn(0x7fbcf0077a00 msgr2=0x7fbcf0077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.849+0000 7fbcf7210640 1 -- 172.21.15.53:0/3791151727 shutdown_connections 2024-08-31T06:01:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.849+0000 7fbcf7210640 1 -- 172.21.15.53:0/3791151727 wait complete. 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf7210640 1 Processor -- start 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf7210640 1 -- start start 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf7210640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0101d10 0x7fbcf019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf7210640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0109250 0x7fbcf019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf7210640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcf0109ba0 0x7fbcf019f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf7210640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0113710 con 0x7fbcf0101d10 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf7210640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0113590 con 0x7fbcf0109ba0 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf7210640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0113890 con 0x7fbcf0109250 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf4fac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0101d10 0x7fbcf019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf4fac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0101d10 0x7fbcf019a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37058/0 (socket says 172.21.15.53:37058) 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf4fac640 1 -- 172.21.15.53:0/4087253414 learned_addr learned my addr 172.21.15.53:0/4087253414 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbceffff640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0109250 0x7fbcf019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.850+0000 7fbcf57ad640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcf0109ba0 0x7fbcf019f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcf4fac640 1 -- 172.21.15.53:0/4087253414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0109250 msgr2=0x7fbcf019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcf4fac640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0109250 0x7fbcf019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcf4fac640 1 -- 172.21.15.53:0/4087253414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcf0109ba0 msgr2=0x7fbcf019f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcf4fac640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcf0109ba0 0x7fbcf019f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcf4fac640 1 -- 172.21.15.53:0/4087253414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf01a0110 con 0x7fbcf0101d10 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcf57ad640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcf0109ba0 0x7fbcf019f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcf4fac640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0101d10 0x7fbcf019a1a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbce400d770 tx=0x7fbce400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcedffb640 1 -- 172.21.15.53:0/4087253414 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4017070 con 0x7fbcf0101d10 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcf7210640 1 -- 172.21.15.53:0/4087253414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf01a0400 con 0x7fbcf0101d10 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcedffb640 1 -- 172.21.15.53:0/4087253414 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbce40054b0 con 0x7fbcf0101d10 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcedffb640 1 -- 172.21.15.53:0/4087253414 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4004c60 con 0x7fbcf0101d10 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.851+0000 7fbcf7210640 1 -- 172.21.15.53:0/4087253414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf01a6b60 con 0x7fbcf0101d10 2024-08-31T06:01:38.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.852+0000 7fbcf7210640 1 -- 172.21.15.53:0/4087253414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf0102120 con 0x7fbcf0101d10 2024-08-31T06:01:38.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.854+0000 7fbcedffb640 1 -- 172.21.15.53:0/4087253414 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fbce4004e00 con 0x7fbcf0101d10 2024-08-31T06:01:38.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.854+0000 7fbcedffb640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbce00b4b80 0x7fbce00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:38.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.854+0000 7fbceffff640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbce00b4b80 0x7fbce00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:38.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.855+0000 7fbcedffb640 1 -- 172.21.15.53:0/4087253414 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 7062+0+0 (secure 0 0 0) 0x7fbce40e4730 con 0x7fbcf0101d10 2024-08-31T06:01:38.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.855+0000 7fbceffff640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbce00b4b80 0x7fbce00b7090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc005940 tx=0x7fbcdc0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:38.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:38.859+0000 7fbcedffb640 1 -- 172.21.15.53:0/4087253414 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbce40abd40 con 0x7fbcf0101d10 2024-08-31T06:01:39.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.044+0000 7fbcf7210640 1 -- 172.21.15.53:0/4087253414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fbcf010b9d0 con 0x7fbcf0101d10 2024-08-31T06:01:39.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.045+0000 7fbcedffb640 1 -- 172.21.15.53:0/4087253414 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v63) ==== 74+0+133 (secure 0 0 0) 0x7fbce40ab640 con 0x7fbcf0101d10 2024-08-31T06:01:39.048 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:01:39.048 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T06:01:39.048 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: osdmap e62: 12 total, 11 up, 12 in 2024-08-31T06:01:39.048 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='osd.11 [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.049 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:39.050 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:39.050 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:39.050 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:38 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 -- 172.21.15.53:0/4087253414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbce00b4b80 msgr2=0x7fbce00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbce00b4b80 0x7fbce00b7090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc005940 tx=0x7fbcdc0058d0 comp rx=0 tx=0).stop 2024-08-31T06:01:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 -- 172.21.15.53:0/4087253414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0101d10 msgr2=0x7fbcf019a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0101d10 0x7fbcf019a1a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbce400d770 tx=0x7fbce400dc30 comp rx=0 tx=0).stop 2024-08-31T06:01:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 -- 172.21.15.53:0/4087253414 shutdown_connections 2024-08-31T06:01:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbce00b4b80 0x7fbce00b7090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbcf0109ba0 0x7fbcf019f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf0109250 0x7fbcf019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 --2- 172.21.15.53:0/4087253414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0101d10 0x7fbcf019a1a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 -- 172.21.15.53:0/4087253414 >> 172.21.15.53:0/4087253414 conn(0x7fbcf0077a00 msgr2=0x7fbcf0105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 -- 172.21.15.53:0/4087253414 shutdown_connections 2024-08-31T06:01:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:39.047+0000 7fbcf7210640 1 -- 172.21.15.53:0/4087253414 wait complete. 2024-08-31T06:01:39.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T06:01:39.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: osdmap e62: 12 total, 11 up, 12 in 2024-08-31T06:01:39.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:39.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='osd.11 [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:39.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:39.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:39.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:38 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:01:38.775+0000 7ff94697f640 -1 osd.11 0 waiting for initial osdmap 2024-08-31T06:01:39.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:01:38.790+0000 7ff94277d640 -1 osd.11 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:01:39.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: osdmap e62: 12 total, 11 up, 12 in 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='osd.11 [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]} : dispatch 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:39.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:39.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:39.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:39.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:39.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:38 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:39.798 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"num_osds":12,"num_up_osds":11,"osd_up_since":1725084077,"num_in_osds":12,"osd_in_since":1725084077,"num_remapped_pgs":0} 2024-08-31T06:01:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:39 smithi130 ceph-mon[22266]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:39 smithi130 ceph-mon[22266]: Detected new or changed devices on smithi153 2024-08-31T06:01:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:39 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi153 to 4272M 2024-08-31T06:01:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:39 smithi130 ceph-mon[22266]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T06:01:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:39 smithi130 ceph-mon[22266]: osdmap e63: 12 total, 11 up, 12 in 2024-08-31T06:01:40.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:40.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:40.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:39 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4087253414' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:01:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:39 smithi153 ceph-mon[22320]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:39 smithi153 ceph-mon[22320]: Detected new or changed devices on smithi153 2024-08-31T06:01:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:39 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi153 to 4272M 2024-08-31T06:01:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:39 smithi153 ceph-mon[22320]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T06:01:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:39 smithi153 ceph-mon[22320]: osdmap e63: 12 total, 11 up, 12 in 2024-08-31T06:01:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:39 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4087253414' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:01:40.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:39 smithi053 ceph-mon[18924]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:01:40.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:39 smithi053 ceph-mon[18924]: Detected new or changed devices on smithi153 2024-08-31T06:01:40.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:39 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi153 to 4272M 2024-08-31T06:01:40.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:39 smithi053 ceph-mon[18924]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-08-31T06:01:40.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:39 smithi053 ceph-mon[18924]: osdmap e63: 12 total, 11 up, 12 in 2024-08-31T06:01:40.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:40.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:40.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:39 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4087253414' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:01:40.800 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T06:01:41.062 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:01:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:40 smithi130 ceph-mon[22266]: purged_snaps scrub starts 2024-08-31T06:01:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:40 smithi130 ceph-mon[22266]: purged_snaps scrub ok 2024-08-31T06:01:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:40 smithi130 ceph-mon[22266]: osd.11 [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062] boot 2024-08-31T06:01:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:40 smithi130 ceph-mon[22266]: osdmap e64: 12 total, 12 up, 12 in 2024-08-31T06:01:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:41.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:40 smithi153 ceph-mon[22320]: purged_snaps scrub starts 2024-08-31T06:01:41.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:40 smithi153 ceph-mon[22320]: purged_snaps scrub ok 2024-08-31T06:01:41.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:40 smithi153 ceph-mon[22320]: osd.11 [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062] boot 2024-08-31T06:01:41.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:40 smithi153 ceph-mon[22320]: osdmap e64: 12 total, 12 up, 12 in 2024-08-31T06:01:41.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:41.182 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:40 smithi053 ceph-mon[18924]: purged_snaps scrub starts 2024-08-31T06:01:41.182 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:40 smithi053 ceph-mon[18924]: purged_snaps scrub ok 2024-08-31T06:01:41.182 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:40 smithi053 ceph-mon[18924]: osd.11 [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062] boot 2024-08-31T06:01:41.183 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:40 smithi053 ceph-mon[18924]: osdmap e64: 12 total, 12 up, 12 in 2024-08-31T06:01:41.183 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:01:41.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.519+0000 7f7f762d9640 1 -- 172.21.15.53:0/895498497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f70108a90 msgr2=0x7f7f7010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:41.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.519+0000 7f7f762d9640 1 --2- 172.21.15.53:0/895498497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f70108a90 0x7f7f7010f2c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009ca0 tx=0x7f7f6802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:01:41.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.519+0000 7f7f762d9640 1 -- 172.21.15.53:0/895498497 shutdown_connections 2024-08-31T06:01:41.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.519+0000 7f7f762d9640 1 --2- 172.21.15.53:0/895498497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f70108a90 0x7f7f7010f2c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:41.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.519+0000 7f7f762d9640 1 --2- 172.21.15.53:0/895498497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70108140 0x7f7f70108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:41.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.519+0000 7f7f762d9640 1 --2- 172.21.15.53:0/895498497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f70102800 0x7f7f70102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:41.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.519+0000 7f7f762d9640 1 -- 172.21.15.53:0/895498497 >> 172.21.15.53:0/895498497 conn(0x7f7f700794d0 msgr2=0x7f7f700798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:41.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.519+0000 7f7f762d9640 1 -- 172.21.15.53:0/895498497 shutdown_connections 2024-08-31T06:01:41.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.519+0000 7f7f762d9640 1 -- 172.21.15.53:0/895498497 wait complete. 2024-08-31T06:01:41.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f762d9640 1 Processor -- start 2024-08-31T06:01:41.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f762d9640 1 -- start start 2024-08-31T06:01:41.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f762d9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f70102800 0x7f7f7019afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:41.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f762d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f70108140 0x7f7f7019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:41.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f762d9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70108a90 0x7f7f7019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:41.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f762d9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f701126e0 con 0x7f7f70108140 2024-08-31T06:01:41.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f762d9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70112560 con 0x7f7f70102800 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f762d9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70112860 con 0x7f7f70108a90 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f6f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f70108140 0x7f7f7019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f6f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f70108140 0x7f7f7019b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37080/0 (socket says 172.21.15.53:37080) 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f6f7fe640 1 -- 172.21.15.53:0/3377618948 learned_addr learned my addr 172.21.15.53:0/3377618948 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.520+0000 7f7f6ffff640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f70102800 0x7f7f7019afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f74876640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70108a90 0x7f7f7019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f6f7fe640 1 -- 172.21.15.53:0/3377618948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70108a90 msgr2=0x7f7f7019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f6f7fe640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70108a90 0x7f7f7019ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f6f7fe640 1 -- 172.21.15.53:0/3377618948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f70102800 msgr2=0x7f7f7019afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f6f7fe640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f70102800 0x7f7f7019afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f6f7fe640 1 -- 172.21.15.53:0/3377618948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f701a6290 con 0x7f7f70108140 2024-08-31T06:01:41.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f74876640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70108a90 0x7f7f7019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:01:41.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f6f7fe640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f70108140 0x7f7f7019b510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400b450 tx=0x7f7f6400b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:41.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f6d7fa640 1 -- 172.21.15.53:0/3377618948 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64015020 con 0x7f7f70108140 2024-08-31T06:01:41.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f762d9640 1 -- 172.21.15.53:0/3377618948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f701a6580 con 0x7f7f70108140 2024-08-31T06:01:41.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f6d7fa640 1 -- 172.21.15.53:0/3377618948 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f64011cc0 con 0x7f7f70108140 2024-08-31T06:01:41.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f6d7fa640 1 -- 172.21.15.53:0/3377618948 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64010d00 con 0x7f7f70108140 2024-08-31T06:01:41.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.521+0000 7f7f762d9640 1 -- 172.21.15.53:0/3377618948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f701a6b40 con 0x7f7f70108140 2024-08-31T06:01:41.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.522+0000 7f7f762d9640 1 -- 172.21.15.53:0/3377618948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f70102c10 con 0x7f7f70108140 2024-08-31T06:01:41.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.525+0000 7f7f6d7fa640 1 -- 172.21.15.53:0/3377618948 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f7f64018020 con 0x7f7f70108140 2024-08-31T06:01:41.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.525+0000 7f7f6d7fa640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f580b4b80 0x7f7f580b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:41.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.525+0000 7f7f6ffff640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f580b4b80 0x7f7f580b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:41.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.525+0000 7f7f6d7fa640 1 -- 172.21.15.53:0/3377618948 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7f7f640e4b70 con 0x7f7f70108140 2024-08-31T06:01:41.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.526+0000 7f7f6ffff640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f580b4b80 0x7f7f580b7090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7f7006b780 tx=0x7f7f60009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:41.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.529+0000 7f7f6d7fa640 1 -- 172.21.15.53:0/3377618948 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7f6401f020 con 0x7f7f70108140 2024-08-31T06:01:41.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.714+0000 7f7f762d9640 1 -- 172.21.15.53:0/3377618948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7f7006b030 con 0x7f7f70108140 2024-08-31T06:01:41.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.714+0000 7f7f6d7fa640 1 -- 172.21.15.53:0/3377618948 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f7f640ac070 con 0x7f7f70108140 2024-08-31T06:01:41.718 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:01:41.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.716+0000 7f7f762d9640 1 -- 172.21.15.53:0/3377618948 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f580b4b80 msgr2=0x7f7f580b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:41.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.716+0000 7f7f762d9640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f580b4b80 0x7f7f580b7090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7f7006b780 tx=0x7f7f60009110 comp rx=0 tx=0).stop 2024-08-31T06:01:41.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.716+0000 7f7f762d9640 1 -- 172.21.15.53:0/3377618948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f70108140 msgr2=0x7f7f7019b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:41.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.716+0000 7f7f762d9640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f70108140 0x7f7f7019b510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400b450 tx=0x7f7f6400b850 comp rx=0 tx=0).stop 2024-08-31T06:01:41.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.717+0000 7f7f762d9640 1 -- 172.21.15.53:0/3377618948 shutdown_connections 2024-08-31T06:01:41.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.717+0000 7f7f762d9640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f580b4b80 0x7f7f580b7090 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:41.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.717+0000 7f7f762d9640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70108a90 0x7f7f7019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:41.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.717+0000 7f7f762d9640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f70108140 0x7f7f7019b510 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:41.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.717+0000 7f7f762d9640 1 --2- 172.21.15.53:0/3377618948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f70102800 0x7f7f7019afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:41.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.717+0000 7f7f762d9640 1 -- 172.21.15.53:0/3377618948 >> 172.21.15.53:0/3377618948 conn(0x7f7f700794d0 msgr2=0x7f7f70104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:41.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.717+0000 7f7f762d9640 1 -- 172.21.15.53:0/3377618948 shutdown_connections 2024-08-31T06:01:41.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:41.717+0000 7f7f762d9640 1 -- 172.21.15.53:0/3377618948 wait complete. 2024-08-31T06:01:41.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:41 smithi053 ceph-mon[18924]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:41.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:41 smithi053 ceph-mon[18924]: osdmap e65: 12 total, 12 up, 12 in 2024-08-31T06:01:41.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:41 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3377618948' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:01:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:41 smithi130 ceph-mon[22266]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:41 smithi130 ceph-mon[22266]: osdmap e65: 12 total, 12 up, 12 in 2024-08-31T06:01:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:41 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3377618948' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:01:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:41 smithi153 ceph-mon[22320]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:42.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:41 smithi153 ceph-mon[22320]: osdmap e65: 12 total, 12 up, 12 in 2024-08-31T06:01:42.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:41 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3377618948' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:01:42.509 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":65,"num_osds":12,"num_up_osds":12,"osd_up_since":1725084099,"num_in_osds":12,"osd_in_since":1725084077,"num_remapped_pgs":0} 2024-08-31T06:01:42.510 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:01:42.763 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:01:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.341+0000 7ffab516f640 1 -- 172.21.15.53:0/1246207074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffab0103940 msgr2=0x7ffab0103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.341+0000 7ffab516f640 1 --2- 172.21.15.53:0/1246207074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffab0103940 0x7ffab0103d50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009900 tx=0x7ffaa402a410 comp rx=0 tx=0).stop 2024-08-31T06:01:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.341+0000 7ffab516f640 1 -- 172.21.15.53:0/1246207074 shutdown_connections 2024-08-31T06:01:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.341+0000 7ffab516f640 1 --2- 172.21.15.53:0/1246207074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffab0109bd0 0x7ffab0110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.341+0000 7ffab516f640 1 --2- 172.21.15.53:0/1246207074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0109280 0x7ffab0109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.341+0000 7ffab516f640 1 --2- 172.21.15.53:0/1246207074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffab0103940 0x7ffab0103d50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.341+0000 7ffab516f640 1 -- 172.21.15.53:0/1246207074 >> 172.21.15.53:0/1246207074 conn(0x7ffab00ff3d0 msgr2=0x7ffab0101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.341+0000 7ffab516f640 1 -- 172.21.15.53:0/1246207074 shutdown_connections 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.341+0000 7ffab516f640 1 -- 172.21.15.53:0/1246207074 wait complete. 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.342+0000 7ffab516f640 1 Processor -- start 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.342+0000 7ffab516f640 1 -- start start 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.342+0000 7ffab516f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0103940 0x7ffab019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.342+0000 7ffab516f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffab0109280 0x7ffab019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.342+0000 7ffab516f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffab0109bd0 0x7ffab019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.342+0000 7ffab516f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffab0113800 con 0x7ffab0109280 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.342+0000 7ffab516f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffab0113680 con 0x7ffab0109bd0 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.342+0000 7ffab516f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffab0113980 con 0x7ffab0103940 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.342+0000 7ffaae59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffab0109280 0x7ffab019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.342+0000 7ffaae59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffab0109280 0x7ffab019a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36780/0 (socket says 172.21.15.53:36780) 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.342+0000 7ffaae59c640 1 -- 172.21.15.53:0/2491701597 learned_addr learned my addr 172.21.15.53:0/2491701597 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffaaed9d640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0103940 0x7ffab019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffaaf59e640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffab0109bd0 0x7ffab019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffaae59c640 1 -- 172.21.15.53:0/2491701597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0103940 msgr2=0x7ffab019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffaae59c640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0103940 0x7ffab019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffaae59c640 1 -- 172.21.15.53:0/2491701597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffab0109bd0 msgr2=0x7ffab019fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffaae59c640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffab0109bd0 0x7ffab019fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffaae59c640 1 -- 172.21.15.53:0/2491701597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab01a0260 con 0x7ffab0109280 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffaaf59e640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffab0109bd0 0x7ffab019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffaae59c640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffab0109280 0x7ffab019a890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0006fd0 tx=0x7ffaa000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffa97fff640 1 -- 172.21.15.53:0/2491701597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0011830 con 0x7ffab0109280 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffa97fff640 1 -- 172.21.15.53:0/2491701597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffaa0016070 con 0x7ffab0109280 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffab516f640 1 -- 172.21.15.53:0/2491701597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab01a0550 con 0x7ffab0109280 2024-08-31T06:01:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffa97fff640 1 -- 172.21.15.53:0/2491701597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0010d30 con 0x7ffab0109280 2024-08-31T06:01:43.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.343+0000 7ffab516f640 1 -- 172.21.15.53:0/2491701597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab01a6cb0 con 0x7ffab0109280 2024-08-31T06:01:43.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.344+0000 7ffab516f640 1 -- 172.21.15.53:0/2491701597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab0103dd0 con 0x7ffab0109280 2024-08-31T06:01:43.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.346+0000 7ffa97fff640 1 -- 172.21.15.53:0/2491701597 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7ffaa00119d0 con 0x7ffab0109280 2024-08-31T06:01:43.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.347+0000 7ffa97fff640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa980b4c00 0x7ffa980b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.347+0000 7ffaaed9d640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa980b4c00 0x7ffa980b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.347+0000 7ffa97fff640 1 -- 172.21.15.53:0/2491701597 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7ffaa00e4a40 con 0x7ffab0109280 2024-08-31T06:01:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.347+0000 7ffaaed9d640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa980b4c00 0x7ffa980b7110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4000c00 tx=0x7ffaa4005d50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.350+0000 7ffa97fff640 1 -- 172.21.15.53:0/2491701597 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffaa00abf40 con 0x7ffab0109280 2024-08-31T06:01:43.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.534+0000 7ffab516f640 1 -- 172.21.15.53:0/2491701597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffab002e430 con 0x7ffab0109280 2024-08-31T06:01:43.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.536+0000 7ffa97fff640 1 -- 172.21.15.53:0/2491701597 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+18774 (secure 0 0 0) 0x7ffaa00ab840 con 0x7ffab0109280 2024-08-31T06:01:43.538 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:01:43.538 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":65,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:01:40.776052+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:01:43.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 -- 172.21.15.53:0/2491701597 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa980b4c00 msgr2=0x7ffa980b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:43.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa980b4c00 0x7ffa980b7110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4000c00 tx=0x7ffaa4005d50 comp rx=0 tx=0).stop 2024-08-31T06:01:43.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 -- 172.21.15.53:0/2491701597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffab0109280 msgr2=0x7ffab019a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:43.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffab0109280 0x7ffab019a890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0006fd0 tx=0x7ffaa000b8e0 comp rx=0 tx=0).stop 2024-08-31T06:01:43.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 -- 172.21.15.53:0/2491701597 shutdown_connections 2024-08-31T06:01:43.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa980b4c00 0x7ffa980b7110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffab0109bd0 0x7ffab019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffab0109280 0x7ffab019a890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 --2- 172.21.15.53:0/2491701597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffab0103940 0x7ffab019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 -- 172.21.15.53:0/2491701597 >> 172.21.15.53:0/2491701597 conn(0x7ffab00ff3d0 msgr2=0x7ffab01017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 -- 172.21.15.53:0/2491701597 shutdown_connections 2024-08-31T06:01:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:43.538+0000 7ffab516f640 1 -- 172.21.15.53:0/2491701597 wait complete. 2024-08-31T06:01:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:43 smithi130 ceph-mon[22266]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:43 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2491701597' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:01:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:43 smithi153 ceph-mon[22320]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:43 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2491701597' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:01:44.218 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:43 smithi053 ceph-mon[18924]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:44.219 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2491701597' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:01:44.250 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T05:58:04.713426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T06:01:44.251 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-31T06:01:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:01:44.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.979+0000 7f52a13e3640 1 -- 172.21.15.53:0/3658109892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f529c1050c0 msgr2=0x7f529c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:44.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.979+0000 7f52a13e3640 1 --2- 172.21.15.53:0/3658109892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f529c1050c0 0x7f529c10d610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5290009900 tx=0x7f529002a410 comp rx=0 tx=0).stop 2024-08-31T06:01:44.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.979+0000 7f52a13e3640 1 -- 172.21.15.53:0/3658109892 shutdown_connections 2024-08-31T06:01:44.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.979+0000 7f52a13e3640 1 --2- 172.21.15.53:0/3658109892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f529c10dbd0 0x7f529c1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:44.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.979+0000 7f52a13e3640 1 --2- 172.21.15.53:0/3658109892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f529c1050c0 0x7f529c10d610 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:44.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.979+0000 7f52a13e3640 1 --2- 172.21.15.53:0/3658109892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f529c104770 0x7f529c104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:44.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.979+0000 7f52a13e3640 1 -- 172.21.15.53:0/3658109892 >> 172.21.15.53:0/3658109892 conn(0x7f529c0794e0 msgr2=0x7f529c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:44.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.979+0000 7f52a13e3640 1 -- 172.21.15.53:0/3658109892 shutdown_connections 2024-08-31T06:01:44.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.979+0000 7f52a13e3640 1 -- 172.21.15.53:0/3658109892 wait complete. 2024-08-31T06:01:44.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.980+0000 7f52a13e3640 1 Processor -- start 2024-08-31T06:01:44.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.980+0000 7f52a13e3640 1 -- start start 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.980+0000 7f52a13e3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f529c104770 0x7f529c1024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.980+0000 7f52a13e3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f529c1050c0 0x7f529c1029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.980+0000 7f52a13e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f529c10dbd0 0x7f529c102f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.980+0000 7f52a13e3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f529c113720 con 0x7f529c10dbd0 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.980+0000 7f52a13e3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f529c1135a0 con 0x7f529c1050c0 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.980+0000 7f52a13e3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f529c1138a0 con 0x7f529c104770 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.980+0000 7f529b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f529c10dbd0 0x7f529c102f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.980+0000 7f529b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f529c10dbd0 0x7f529c102f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36798/0 (socket says 172.21.15.53:36798) 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.980+0000 7f529b7fe640 1 -- 172.21.15.53:0/1174838734 learned_addr learned my addr 172.21.15.53:0/1174838734 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f529a7fc640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f529c1050c0 0x7f529c1029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f529affd640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f529c104770 0x7f529c1024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:44.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f529b7fe640 1 -- 172.21.15.53:0/1174838734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f529c104770 msgr2=0x7f529c1024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:44.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f529b7fe640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f529c104770 0x7f529c1024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:44.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f529b7fe640 1 -- 172.21.15.53:0/1174838734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f529c1050c0 msgr2=0x7f529c1029f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:44.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f529b7fe640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f529c1050c0 0x7f529c1029f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:44.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f529b7fe640 1 -- 172.21.15.53:0/1174838734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c1a84f0 con 0x7f529c10dbd0 2024-08-31T06:01:44.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f529b7fe640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f529c10dbd0 0x7f529c102f30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f529400b970 tx=0x7f529400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:44.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f5283fff640 1 -- 172.21.15.53:0/1174838734 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5294019070 con 0x7f529c10dbd0 2024-08-31T06:01:44.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f5283fff640 1 -- 172.21.15.53:0/1174838734 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5294014440 con 0x7f529c10dbd0 2024-08-31T06:01:44.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f52a13e3640 1 -- 172.21.15.53:0/1174838734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529c1a87e0 con 0x7f529c10dbd0 2024-08-31T06:01:44.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f5283fff640 1 -- 172.21.15.53:0/1174838734 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52940075d0 con 0x7f529c10dbd0 2024-08-31T06:01:44.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.981+0000 7f52a13e3640 1 -- 172.21.15.53:0/1174838734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529c1a8cf0 con 0x7f529c10dbd0 2024-08-31T06:01:44.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.982+0000 7f52a13e3640 1 -- 172.21.15.53:0/1174838734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f529c06bfe0 con 0x7f529c10dbd0 2024-08-31T06:01:44.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.984+0000 7f5283fff640 1 -- 172.21.15.53:0/1174838734 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f529401c070 con 0x7f529c10dbd0 2024-08-31T06:01:44.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.984+0000 7f5283fff640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52840b4b80 0x7f52840b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:44.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.984+0000 7f529affd640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52840b4b80 0x7f52840b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:44.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.985+0000 7f5283fff640 1 -- 172.21.15.53:0/1174838734 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7f52940e42b0 con 0x7f529c10dbd0 2024-08-31T06:01:44.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.985+0000 7f529affd640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52840b4b80 0x7f52840b7090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f529c103f00 tx=0x7f528c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:44.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:44.989+0000 7f5283fff640 1 -- 172.21.15.53:0/1174838734 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f52940ab7b0 con 0x7f529c10dbd0 2024-08-31T06:01:45.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.173+0000 7f52a13e3640 1 -- 172.21.15.53:0/1174838734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f529c1037b0 con 0x7f529c10dbd0 2024-08-31T06:01:45.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.173+0000 7f5283fff640 1 -- 172.21.15.53:0/1174838734 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) ==== 93+0+10 (secure 0 0 0) 0x7f52940ab0b0 con 0x7f529c10dbd0 2024-08-31T06:01:45.184 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-08-31T06:01:45.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 -- 172.21.15.53:0/1174838734 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52840b4b80 msgr2=0x7f52840b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:45.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52840b4b80 0x7f52840b7090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f529c103f00 tx=0x7f528c005f90 comp rx=0 tx=0).stop 2024-08-31T06:01:45.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 -- 172.21.15.53:0/1174838734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f529c10dbd0 msgr2=0x7f529c102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:45.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f529c10dbd0 0x7f529c102f30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f529400b970 tx=0x7f529400be30 comp rx=0 tx=0).stop 2024-08-31T06:01:45.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 -- 172.21.15.53:0/1174838734 shutdown_connections 2024-08-31T06:01:45.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52840b4b80 0x7f52840b7090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:45.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f529c10dbd0 0x7f529c102f30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:45.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f529c1050c0 0x7f529c1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:45.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 --2- 172.21.15.53:0/1174838734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f529c104770 0x7f529c1024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:45.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 -- 172.21.15.53:0/1174838734 >> 172.21.15.53:0/1174838734 conn(0x7f529c0794e0 msgr2=0x7f529c100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:45.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 -- 172.21.15.53:0/1174838734 shutdown_connections 2024-08-31T06:01:45.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:45.176+0000 7f52a13e3640 1 -- 172.21.15.53:0/1174838734 wait complete. 2024-08-31T06:01:45.882 INFO:tasks.cephadm:Adding mds.a on smithi053 2024-08-31T06:01:45.882 INFO:tasks.cephadm:Adding mds.d on smithi053 2024-08-31T06:01:45.882 INFO:tasks.cephadm:Adding mds.g on smithi053 2024-08-31T06:01:45.882 INFO:tasks.cephadm:Adding mds.j on smithi053 2024-08-31T06:01:45.882 INFO:tasks.cephadm:Adding mds.b on smithi130 2024-08-31T06:01:45.882 INFO:tasks.cephadm:Adding mds.e on smithi130 2024-08-31T06:01:45.883 INFO:tasks.cephadm:Adding mds.h on smithi130 2024-08-31T06:01:45.883 INFO:tasks.cephadm:Adding mds.k on smithi130 2024-08-31T06:01:45.883 INFO:tasks.cephadm:Adding mds.c on smithi153 2024-08-31T06:01:45.883 INFO:tasks.cephadm:Adding mds.f on smithi153 2024-08-31T06:01:45.883 INFO:tasks.cephadm:Adding mds.i on smithi153 2024-08-31T06:01:45.883 INFO:tasks.cephadm:Adding mds.l on smithi153 2024-08-31T06:01:45.883 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph orch apply mds all '12;smithi053=a;smithi053=d;smithi053=g;smithi053=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l' 2024-08-31T06:01:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:45 smithi130 ceph-mon[22266]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:45 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1174838734' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:01:46.143 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:01:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:45 smithi153 ceph-mon[22320]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:45 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1174838734' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:01:46.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:45 smithi053 ceph-mon[18924]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:45 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1174838734' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:01:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.601+0000 7fe88fc83640 1 -- 172.21.15.153:0/2073255764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe888109260 msgr2=0x7fe888109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.601+0000 7fe88fc83640 1 --2- 172.21.15.153:0/2073255764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe888109260 0x7fe888109670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe884009900 tx=0x7fe88402a410 comp rx=0 tx=0).stop 2024-08-31T06:01:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.601+0000 7fe88fc83640 1 -- 172.21.15.153:0/2073255764 shutdown_connections 2024-08-31T06:01:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.601+0000 7fe88fc83640 1 --2- 172.21.15.153:0/2073255764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe888109bb0 0x7fe8881103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.601+0000 7fe88fc83640 1 --2- 172.21.15.153:0/2073255764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe888109260 0x7fe888109670 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.601+0000 7fe88fc83640 1 --2- 172.21.15.153:0/2073255764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe888103920 0x7fe888103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.601+0000 7fe88fc83640 1 -- 172.21.15.153:0/2073255764 >> 172.21.15.153:0/2073255764 conn(0x7fe8880ff3b0 msgr2=0x7fe888101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.601+0000 7fe88fc83640 1 -- 172.21.15.153:0/2073255764 shutdown_connections 2024-08-31T06:01:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.601+0000 7fe88fc83640 1 -- 172.21.15.153:0/2073255764 wait complete. 2024-08-31T06:01:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.602+0000 7fe88fc83640 1 Processor -- start 2024-08-31T06:01:46.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.602+0000 7fe88fc83640 1 -- start start 2024-08-31T06:01:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.602+0000 7fe88fc83640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe888103920 0x7fe88819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.602+0000 7fe88fc83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe888109260 0x7fe88819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.602+0000 7fe88fc83640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe888109bb0 0x7fe88819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.602+0000 7fe88fc83640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe888113720 con 0x7fe888109260 2024-08-31T06:01:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.602+0000 7fe88fc83640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe8881135a0 con 0x7fe888103920 2024-08-31T06:01:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.602+0000 7fe88fc83640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8881138a0 con 0x7fe888109bb0 2024-08-31T06:01:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88e220640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe888109bb0 0x7fe88819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88e220640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe888109bb0 0x7fe88819f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60746/0 (socket says 172.21.15.153:60746) 2024-08-31T06:01:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88e220640 1 -- 172.21.15.153:0/2086184290 learned_addr learned my addr 172.21.15.153:0/2086184290 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-08-31T06:01:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88d21e640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe888109260 0x7fe88819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88da1f640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe888103920 0x7fe88819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88e220640 1 -- 172.21.15.153:0/2086184290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe888103920 msgr2=0x7fe88819a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88e220640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe888103920 0x7fe88819a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88e220640 1 -- 172.21.15.153:0/2086184290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe888109260 msgr2=0x7fe88819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88e220640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe888109260 0x7fe88819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88e220640 1 -- 172.21.15.153:0/2086184290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8881a00e0 con 0x7fe888109bb0 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88da1f640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe888103920 0x7fe88819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88e220640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe888109bb0 0x7fe88819f9b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe88000eaa0 tx=0x7fe88000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe87effd640 1 -- 172.21.15.153:0/2086184290 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88000cdb0 con 0x7fe888109bb0 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe87effd640 1 -- 172.21.15.153:0/2086184290 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe880005020 con 0x7fe888109bb0 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.603+0000 7fe88fc83640 1 -- 172.21.15.153:0/2086184290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8881a03d0 con 0x7fe888109bb0 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.604+0000 7fe87effd640 1 -- 172.21.15.153:0/2086184290 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8800116d0 con 0x7fe888109bb0 2024-08-31T06:01:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.604+0000 7fe88fc83640 1 -- 172.21.15.153:0/2086184290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8881a6b30 con 0x7fe888109bb0 2024-08-31T06:01:46.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.605+0000 7fe88fc83640 1 -- 172.21.15.153:0/2086184290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe888103d30 con 0x7fe888109bb0 2024-08-31T06:01:46.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.607+0000 7fe87effd640 1 -- 172.21.15.153:0/2086184290 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fe8800051d0 con 0x7fe888109bb0 2024-08-31T06:01:46.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.608+0000 7fe87effd640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8740b4b80 0x7fe8740b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:46.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.608+0000 7fe87effd640 1 -- 172.21.15.153:0/2086184290 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7fe8800e5340 con 0x7fe888109bb0 2024-08-31T06:01:46.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.609+0000 7fe88da1f640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8740b4b80 0x7fe8740b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:46.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.609+0000 7fe88da1f640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8740b4b80 0x7fe8740b7090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8780058c0 tx=0x7fe878005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:46.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.612+0000 7fe87effd640 1 -- 172.21.15.153:0/2086184290 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe880016030 con 0x7fe888109bb0 2024-08-31T06:01:46.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.805+0000 7fe88fc83640 1 -- 172.21.15.153:0/2086184290 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi053=a;smithi053=d;smithi053=g;smithi053=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}) -- 0x7fe8880635a0 con 0x7fe8740b4b80 2024-08-31T06:01:46.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.814+0000 7fe87effd640 1 -- 172.21.15.153:0/2086184290 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fe8880635a0 con 0x7fe8740b4b80 2024-08-31T06:01:46.816 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mds.all update... 2024-08-31T06:01:46.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 -- 172.21.15.153:0/2086184290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8740b4b80 msgr2=0x7fe8740b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:46.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8740b4b80 0x7fe8740b7090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8780058c0 tx=0x7fe878005850 comp rx=0 tx=0).stop 2024-08-31T06:01:46.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 -- 172.21.15.153:0/2086184290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe888109bb0 msgr2=0x7fe88819f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:46.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe888109bb0 0x7fe88819f9b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe88000eaa0 tx=0x7fe88000ef60 comp rx=0 tx=0).stop 2024-08-31T06:01:46.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 -- 172.21.15.153:0/2086184290 shutdown_connections 2024-08-31T06:01:46.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8740b4b80 0x7fe8740b7090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:46.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe888109bb0 0x7fe88819f9b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:46.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe888109260 0x7fe88819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:46.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 --2- 172.21.15.153:0/2086184290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe888103920 0x7fe88819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:46.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 -- 172.21.15.153:0/2086184290 >> 172.21.15.153:0/2086184290 conn(0x7fe8880ff3b0 msgr2=0x7fe8881017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:46.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 -- 172.21.15.153:0/2086184290 shutdown_connections 2024-08-31T06:01:46.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-08-31T06:01:46.816+0000 7fe88fc83640 1 -- 172.21.15.153:0/2086184290 wait complete. 2024-08-31T06:01:47.553 DEBUG:teuthology.orchestra.run.smithi053:mds.a> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.a.service 2024-08-31T06:01:47.556 DEBUG:teuthology.orchestra.run.smithi053:mds.d> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.d.service 2024-08-31T06:01:47.599 DEBUG:teuthology.orchestra.run.smithi053:mds.g> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.g.service 2024-08-31T06:01:47.641 DEBUG:teuthology.orchestra.run.smithi053:mds.j> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.j.service 2024-08-31T06:01:47.685 DEBUG:teuthology.orchestra.run.smithi130:mds.b> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.b.service 2024-08-31T06:01:47.688 DEBUG:teuthology.orchestra.run.smithi130:mds.e> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.e.service 2024-08-31T06:01:47.731 DEBUG:teuthology.orchestra.run.smithi130:mds.h> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.h.service 2024-08-31T06:01:47.775 DEBUG:teuthology.orchestra.run.smithi130:mds.k> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.k.service 2024-08-31T06:01:47.821 DEBUG:teuthology.orchestra.run.smithi153:mds.c> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.c.service 2024-08-31T06:01:47.824 DEBUG:teuthology.orchestra.run.smithi153:mds.f> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.f.service 2024-08-31T06:01:47.867 DEBUG:teuthology.orchestra.run.smithi153:mds.i> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.i.service 2024-08-31T06:01:47.910 DEBUG:teuthology.orchestra.run.smithi153:mds.l> sudo journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.l.service 2024-08-31T06:01:47.954 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-31T06:01:47.954 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:01:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi053=a;smithi053=d;smithi053=g;smithi053=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: Saving service mds.all spec with placement smithi053=a;smithi053=d;smithi053=g;smithi053=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-08-31T06:01:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:47.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:47.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:47.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:47 smithi053 ceph-mon[18924]: Deploying daemon mds.l on smithi153 2024-08-31T06:01:48.047 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:48.047 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi053=a;smithi053=d;smithi053=g;smithi053=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:48.047 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: Saving service mds.all spec with placement smithi053=a;smithi053=d;smithi053=g;smithi053=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-08-31T06:01:48.047 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:48.047 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:48.047 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:48.047 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:48.047 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:48.048 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:48.048 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:48.048 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:48.048 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:47 smithi153 ceph-mon[22320]: Deploying daemon mds.l on smithi153 2024-08-31T06:01:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi053=a;smithi053=d;smithi053=g;smithi053=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: Saving service mds.all spec with placement smithi053=a;smithi053=d;smithi053=g;smithi053=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-08-31T06:01:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:01:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:01:48.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:48.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:48.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:48.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:48.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:47 smithi130 ceph-mon[22266]: Deploying daemon mds.l on smithi153 2024-08-31T06:01:48.207 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:01:48.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.642+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3529386466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a44102820 msgr2=0x7f2a44102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:48.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.642+0000 7f2a4ba9b640 1 --2- 172.21.15.53:0/3529386466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a44102820 0x7f2a44102c30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009900 tx=0x7f2a4002a410 comp rx=0 tx=0).stop 2024-08-31T06:01:48.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.642+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3529386466 shutdown_connections 2024-08-31T06:01:48.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.642+0000 7f2a4ba9b640 1 --2- 172.21.15.53:0/3529386466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a44108ab0 0x7f2a4410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:48.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.642+0000 7f2a4ba9b640 1 --2- 172.21.15.53:0/3529386466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a44108160 0x7f2a44108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:48.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.642+0000 7f2a4ba9b640 1 --2- 172.21.15.53:0/3529386466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a44102820 0x7f2a44102c30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:48.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.642+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3529386466 >> 172.21.15.53:0/3529386466 conn(0x7f2a440794e0 msgr2=0x7f2a440798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:48.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.642+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3529386466 shutdown_connections 2024-08-31T06:01:48.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.642+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3529386466 wait complete. 2024-08-31T06:01:48.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.643+0000 7f2a4ba9b640 1 Processor -- start 2024-08-31T06:01:48.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.643+0000 7f2a4ba9b640 1 -- start start 2024-08-31T06:01:48.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.643+0000 7f2a4ba9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a44102820 0x7f2a4419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:48.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.643+0000 7f2a4ba9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a44108160 0x7f2a4419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:48.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.643+0000 7f2a4ba9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a44108ab0 0x7f2a4419f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:48.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.643+0000 7f2a4ba9b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441136f0 con 0x7f2a44108ab0 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.643+0000 7f2a4ba9b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2a44113570 con 0x7f2a44108160 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.643+0000 7f2a4ba9b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2a44113870 con 0x7f2a44102820 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a4a038640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a44108ab0 0x7f2a4419f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a4a038640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a44108ab0 0x7f2a4419f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36822/0 (socket says 172.21.15.53:36822) 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a4a038640 1 -- 172.21.15.53:0/3228703933 learned_addr learned my addr 172.21.15.53:0/3228703933 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a49837640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a44102820 0x7f2a4419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a49036640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a44108160 0x7f2a4419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a4a038640 1 -- 172.21.15.53:0/3228703933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a44102820 msgr2=0x7f2a4419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a4a038640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a44102820 0x7f2a4419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a4a038640 1 -- 172.21.15.53:0/3228703933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a44108160 msgr2=0x7f2a4419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a4a038640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a44108160 0x7f2a4419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:48.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a4a038640 1 -- 172.21.15.53:0/3228703933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a441a0070 con 0x7f2a44108ab0 2024-08-31T06:01:48.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a49036640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a44108160 0x7f2a4419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:01:48.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a4a038640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a44108ab0 0x7f2a4419f940 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00eaa0 tx=0x7f2a3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:48.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a3affd640 1 -- 172.21.15.53:0/3228703933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c00cdb0 con 0x7f2a44108ab0 2024-08-31T06:01:48.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3228703933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a441a0360 con 0x7f2a44108ab0 2024-08-31T06:01:48.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a3affd640 1 -- 172.21.15.53:0/3228703933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a3c005020 con 0x7f2a44108ab0 2024-08-31T06:01:48.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.644+0000 7f2a3affd640 1 -- 172.21.15.53:0/3228703933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0116d0 con 0x7f2a44108ab0 2024-08-31T06:01:48.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.645+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3228703933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a441a6ac0 con 0x7f2a44108ab0 2024-08-31T06:01:48.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.646+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3228703933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a44103aa0 con 0x7f2a44108ab0 2024-08-31T06:01:48.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.647+0000 7f2a3affd640 1 -- 172.21.15.53:0/3228703933 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f2a3c004a40 con 0x7f2a44108ab0 2024-08-31T06:01:48.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.648+0000 7f2a3affd640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a300b4b80 0x7f2a300b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:48.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.648+0000 7f2a49837640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a300b4b80 0x7f2a300b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:48.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.648+0000 7f2a3affd640 1 -- 172.21.15.53:0/3228703933 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7f2a3c0e5330 con 0x7f2a44108ab0 2024-08-31T06:01:48.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.648+0000 7f2a49837640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a300b4b80 0x7f2a300b7090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2a400057c0 tx=0x7f2a400058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:48.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.651+0000 7f2a3affd640 1 -- 172.21.15.53:0/3228703933 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2a3c016030 con 0x7f2a44108ab0 2024-08-31T06:01:48.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.876+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3228703933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a44102c30 con 0x7f2a44108ab0 2024-08-31T06:01:48.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.877+0000 7f2a3affd640 1 -- 172.21.15.53:0/3228703933 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f2a44102c30 con 0x7f2a44108ab0 2024-08-31T06:01:48.879 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:01:48.880 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":1,"btime":"2024-08-31T05:54:18:179948+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-31T06:01:48.880 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 1 2024-08-31T06:01:48.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3228703933 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a300b4b80 msgr2=0x7f2a300b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:48.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a300b4b80 0x7f2a300b7090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2a400057c0 tx=0x7f2a400058d0 comp rx=0 tx=0).stop 2024-08-31T06:01:48.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3228703933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a44108ab0 msgr2=0x7f2a4419f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a44108ab0 0x7f2a4419f940 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00eaa0 tx=0x7f2a3c00ef60 comp rx=0 tx=0).stop 2024-08-31T06:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3228703933 shutdown_connections 2024-08-31T06:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a300b4b80 0x7f2a300b7090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a44108ab0 0x7f2a4419f940 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a44108160 0x7f2a4419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 --2- 172.21.15.53:0/3228703933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a44102820 0x7f2a4419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3228703933 >> 172.21.15.53:0/3228703933 conn(0x7f2a440794e0 msgr2=0x7f2a44101330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3228703933 shutdown_connections 2024-08-31T06:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:48.879+0000 7f2a4ba9b640 1 -- 172.21.15.53:0/3228703933 wait complete. 2024-08-31T06:01:49.324 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:01:49 smithi153 systemd[1]: Starting Ceph mds.l for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:01:49.599 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:01:49 smithi153 podman[52925]: 2024-08-31 06:01:49.225237209 +0000 UTC m=+0.016736910 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:01:49.599 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:01:49 smithi153 podman[52925]: 2024-08-31 06:01:49.359428091 +0000 UTC m=+0.150927792 container create 223cfc7e0ce950ea0f1413e86ca896ae071c706e6b56881b818e1c5d426ba421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:01:49.599 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:01:49 smithi153 podman[52925]: 2024-08-31 06:01:49.561675746 +0000 UTC m=+0.353175444 container init 223cfc7e0ce950ea0f1413e86ca896ae071c706e6b56881b818e1c5d426ba421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS) 2024-08-31T06:01:49.599 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:01:49 smithi153 podman[52925]: 2024-08-31 06:01:49.564418596 +0000 UTC m=+0.355918303 container start 223cfc7e0ce950ea0f1413e86ca896ae071c706e6b56881b818e1c5d426ba421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-08-31T06:01:49.600 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mds[52944]: -- 172.21.15.153:0/2384296561 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561b01f07860 con 0x561b060ada80 2024-08-31T06:01:49.925 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l[52940]: starting mds.l at 2024-08-31T06:01:49.925 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:01:49 smithi153 bash[52925]: 223cfc7e0ce950ea0f1413e86ca896ae071c706e6b56881b818e1c5d426ba421 2024-08-31T06:01:49.925 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:01:49 smithi153 systemd[1]: Started Ceph mds.l for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:01:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mon[22320]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3228703933' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:01:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.153:6832/4101202303,v1:172.21.15.153:6833/4101202303] up:boot 2024-08-31T06:01:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mon[22320]: fsmap 1 up:standby 2024-08-31T06:01:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T06:01:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:49 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:49 smithi130 ceph-mon[22266]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:49 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3228703933' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:01:50.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:49 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.153:6832/4101202303,v1:172.21.15.153:6833/4101202303] up:boot 2024-08-31T06:01:50.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:49 smithi130 ceph-mon[22266]: fsmap 1 up:standby 2024-08-31T06:01:50.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:49 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T06:01:50.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:49 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:50.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:49 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:50.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:49 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:50.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:49 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:50.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:49 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:50.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:49 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:49 smithi053 ceph-mon[18924]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:49 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3228703933' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:01:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:49 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.153:6832/4101202303,v1:172.21.15.153:6833/4101202303] up:boot 2024-08-31T06:01:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:49 smithi053 ceph-mon[18924]: fsmap 1 up:standby 2024-08-31T06:01:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:49 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T06:01:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:49 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:49 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:49 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:49 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:49 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:50.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:49 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:51.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:50 smithi130 ceph-mon[22266]: Deploying daemon mds.k on smithi130 2024-08-31T06:01:51.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:50 smithi153 ceph-mon[22320]: Deploying daemon mds.k on smithi130 2024-08-31T06:01:51.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:50 smithi053 ceph-mon[18924]: Deploying daemon mds.k on smithi130 2024-08-31T06:01:51.582 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:01:51.824 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:01:51 smithi130 systemd[1]: Starting Ceph mds.k for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:01:51.846 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:01:51.966 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:51 smithi053 ceph-mon[18924]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:51 smithi130 ceph-mon[22266]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:52.128 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:01:51 smithi130 podman[52989]: 2024-08-31 06:01:51.798802129 +0000 UTC m=+0.015793761 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:01:52.128 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:01:51 smithi130 podman[52989]: 2024-08-31 06:01:51.913856195 +0000 UTC m=+0.130847826 container create 57d40490a116ba986f54699352cd4a7f067cdfb75ed241407df5f253a6f3c6de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:01:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:51 smithi153 ceph-mon[22320]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:52.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.267+0000 7f3834c10640 1 -- 172.21.15.53:0/125412794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3830102840 msgr2=0x7f3830102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:52.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.267+0000 7f3834c10640 1 --2- 172.21.15.53:0/125412794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3830102840 0x7f3830102c50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3820009900 tx=0x7f382002a410 comp rx=0 tx=0).stop 2024-08-31T06:01:52.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.267+0000 7f3834c10640 1 -- 172.21.15.53:0/125412794 shutdown_connections 2024-08-31T06:01:52.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.267+0000 7f3834c10640 1 --2- 172.21.15.53:0/125412794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3830108ad0 0x7f383010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:52.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.267+0000 7f3834c10640 1 --2- 172.21.15.53:0/125412794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3830108180 0x7f3830108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:52.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.267+0000 7f3834c10640 1 --2- 172.21.15.53:0/125412794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3830102840 0x7f3830102c50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:52.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.267+0000 7f3834c10640 1 -- 172.21.15.53:0/125412794 >> 172.21.15.53:0/125412794 conn(0x7f3830079580 msgr2=0x7f3830079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.268+0000 7f3834c10640 1 -- 172.21.15.53:0/125412794 shutdown_connections 2024-08-31T06:01:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.268+0000 7f3834c10640 1 -- 172.21.15.53:0/125412794 wait complete. 2024-08-31T06:01:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.268+0000 7f3834c10640 1 Processor -- start 2024-08-31T06:01:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.268+0000 7f3834c10640 1 -- start start 2024-08-31T06:01:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f3834c10640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3830102840 0x7f383019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f3834c10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3830108180 0x7f383019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f3834c10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3830108ad0 0x7f383019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f3834c10640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3830113740 con 0x7f3830108180 2024-08-31T06:01:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f3834c10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38301135c0 con 0x7f3830108ad0 2024-08-31T06:01:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f3834c10640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38301138c0 con 0x7f3830102840 2024-08-31T06:01:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f382dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3830108180 0x7f383019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f382dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3830108180 0x7f383019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36828/0 (socket says 172.21.15.53:36828) 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f382dd9b640 1 -- 172.21.15.53:0/1755141459 learned_addr learned my addr 172.21.15.53:0/1755141459 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f382ed9d640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3830108ad0 0x7f383019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f382e59c640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3830102840 0x7f383019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f382dd9b640 1 -- 172.21.15.53:0/1755141459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3830102840 msgr2=0x7f383019a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f382dd9b640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3830102840 0x7f383019a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f382dd9b640 1 -- 172.21.15.53:0/1755141459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3830108ad0 msgr2=0x7f383019f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f382dd9b640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3830108ad0 0x7f383019f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f382dd9b640 1 -- 172.21.15.53:0/1755141459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38301a00c0 con 0x7f3830108180 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.269+0000 7f382dd9b640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3830108180 0x7f383019a6f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f382400d740 tx=0x7f382400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.272+0000 7f381f7fe640 1 -- 172.21.15.53:0/1755141459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824017070 con 0x7f3830108180 2024-08-31T06:01:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.272+0000 7f3834c10640 1 -- 172.21.15.53:0/1755141459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38301a03b0 con 0x7f3830108180 2024-08-31T06:01:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.272+0000 7f381f7fe640 1 -- 172.21.15.53:0/1755141459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f382400de50 con 0x7f3830108180 2024-08-31T06:01:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.272+0000 7f381f7fe640 1 -- 172.21.15.53:0/1755141459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824004c60 con 0x7f3830108180 2024-08-31T06:01:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.272+0000 7f3834c10640 1 -- 172.21.15.53:0/1755141459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38301a6b10 con 0x7f3830108180 2024-08-31T06:01:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.273+0000 7f3834c10640 1 -- 172.21.15.53:0/1755141459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3830102c50 con 0x7f3830108180 2024-08-31T06:01:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.274+0000 7f381f7fe640 1 -- 172.21.15.53:0/1755141459 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f3824004e00 con 0x7f3830108180 2024-08-31T06:01:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.275+0000 7f381f7fe640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38180b4b80 0x7f38180b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.275+0000 7f382e59c640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38180b4b80 0x7f38180b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.275+0000 7f381f7fe640 1 -- 172.21.15.53:0/1755141459 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7f38240e4ae0 con 0x7f3830108180 2024-08-31T06:01:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.276+0000 7f382e59c640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38180b4b80 0x7f38180b7090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3820006010 tx=0x7f3820000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:52.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.280+0000 7f381f7fe640 1 -- 172.21.15.53:0/1755141459 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f38240ab990 con 0x7f3830108180 2024-08-31T06:01:52.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.508+0000 7f3834c10640 1 -- 172.21.15.53:0/1755141459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f383019b280 con 0x7f3830108180 2024-08-31T06:01:52.511 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:01:52.511 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":2,"btime":"2024-08-31T06:01:49:603046+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T06:01:52.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.509+0000 7f381f7fe640 1 -- 172.21.15.53:0/1755141459 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f38240b0150 con 0x7f3830108180 2024-08-31T06:01:52.511 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 2 2024-08-31T06:01:52.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.512+0000 7f3834c10640 1 -- 172.21.15.53:0/1755141459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38180b4b80 msgr2=0x7f38180b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:52.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.512+0000 7f3834c10640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38180b4b80 0x7f38180b7090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3820006010 tx=0x7f3820000bc0 comp rx=0 tx=0).stop 2024-08-31T06:01:52.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.512+0000 7f3834c10640 1 -- 172.21.15.53:0/1755141459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3830108180 msgr2=0x7f383019a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:52.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.512+0000 7f3834c10640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3830108180 0x7f383019a6f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f382400d740 tx=0x7f382400dc00 comp rx=0 tx=0).stop 2024-08-31T06:01:52.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.512+0000 7f3834c10640 1 -- 172.21.15.53:0/1755141459 shutdown_connections 2024-08-31T06:01:52.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.512+0000 7f3834c10640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38180b4b80 0x7f38180b7090 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:52.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.512+0000 7f3834c10640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3830108ad0 0x7f383019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:52.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.512+0000 7f3834c10640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3830108180 0x7f383019a6f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:52.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.512+0000 7f3834c10640 1 --2- 172.21.15.53:0/1755141459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3830102840 0x7f383019a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:52.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.512+0000 7f3834c10640 1 -- 172.21.15.53:0/1755141459 >> 172.21.15.53:0/1755141459 conn(0x7f3830079580 msgr2=0x7f3830101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:52.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.513+0000 7f3834c10640 1 -- 172.21.15.53:0/1755141459 shutdown_connections 2024-08-31T06:01:52.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:52.513+0000 7f3834c10640 1 -- 172.21.15.53:0/1755141459 wait complete. 2024-08-31T06:01:52.628 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:01:52 smithi130 podman[52989]: 2024-08-31 06:01:52.133072008 +0000 UTC m=+0.350063654 container init 57d40490a116ba986f54699352cd4a7f067cdfb75ed241407df5f253a6f3c6de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-31T06:01:52.629 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:01:52 smithi130 podman[52989]: 2024-08-31 06:01:52.13578133 +0000 UTC m=+0.352772962 container start 57d40490a116ba986f54699352cd4a7f067cdfb75ed241407df5f253a6f3c6de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:01:52.629 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:01:52 smithi130 ceph-mds[53008]: -- 172.21.15.130:0/2194509136 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc1611f860 con 0x55dc1a2c5a80 2024-08-31T06:01:52.629 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:01:52 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k[53004]: starting mds.k at 2024-08-31T06:01:52.629 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:01:52 smithi130 bash[52989]: 57d40490a116ba986f54699352cd4a7f067cdfb75ed241407df5f253a6f3c6de 2024-08-31T06:01:52.629 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:01:52 smithi130 systemd[1]: Started Ceph mds.k for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:01:53.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:53.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:53.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:53.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:53.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:53.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:53.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: Deploying daemon mds.j on smithi053 2024-08-31T06:01:53.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:53.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1755141459' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:01:53.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.130:6832/4017894222,v1:172.21.15.130:6833/4017894222] up:boot 2024-08-31T06:01:53.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: fsmap 2 up:standby 2024-08-31T06:01:53.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T06:01:53.544 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:53.544 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:53.544 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:53.544 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:53.544 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:53.545 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:53.545 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: Deploying daemon mds.j on smithi053 2024-08-31T06:01:53.545 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:53.545 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1755141459' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:01:53.549 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.130:6832/4017894222,v1:172.21.15.130:6833/4017894222] up:boot 2024-08-31T06:01:53.549 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: fsmap 2 up:standby 2024-08-31T06:01:53.550 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T06:01:53.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: Deploying daemon mds.j on smithi053 2024-08-31T06:01:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1755141459' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:01:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.130:6832/4017894222,v1:172.21.15.130:6833/4017894222] up:boot 2024-08-31T06:01:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: fsmap 2 up:standby 2024-08-31T06:01:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T06:01:54.918 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:01:54 smithi053 systemd[1]: Starting Ceph mds.j for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:01:55.185 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:01:54 smithi053 podman[62473]: 2024-08-31 06:01:54.819334457 +0000 UTC m=+0.015864292 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:01:55.185 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:01:54 smithi053 podman[62473]: 2024-08-31 06:01:54.947875284 +0000 UTC m=+0.144405110 container create 2c78564a4a1b810b7b1df6a27bab114ae1d71777ba46b98fba149c8a69eb2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:01:55.185 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:01:55 smithi053 podman[62473]: 2024-08-31 06:01:55.183972382 +0000 UTC m=+0.380502220 container init 2c78564a4a1b810b7b1df6a27bab114ae1d71777ba46b98fba149c8a69eb2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-j, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1) 2024-08-31T06:01:55.280 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:01:55.476 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:01:55 smithi053 podman[62473]: 2024-08-31 06:01:55.187764985 +0000 UTC m=+0.384294811 container start 2c78564a4a1b810b7b1df6a27bab114ae1d71777ba46b98fba149c8a69eb2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:01:55.476 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:01:55 smithi053 ceph-mds[62492]: -- 172.21.15.53:0/3145624609 <== mon.0 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5606d6d65860 con 0x5606daf0b180 2024-08-31T06:01:55.476 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:01:55 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-j[62488]: starting mds.j at 2024-08-31T06:01:55.476 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:01:55 smithi053 bash[62473]: 2c78564a4a1b810b7b1df6a27bab114ae1d71777ba46b98fba149c8a69eb2319 2024-08-31T06:01:55.476 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:01:55 smithi053 systemd[1]: Started Ceph mds.j for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:01:55.549 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:01:56.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.003+0000 7fb65a117640 1 -- 172.21.15.53:0/2351010350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb654103900 msgr2=0x7fb654103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:56.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.003+0000 7fb65a117640 1 --2- 172.21.15.53:0/2351010350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb654103900 0x7fb654103d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb644009900 tx=0x7fb64402a410 comp rx=0 tx=0).stop 2024-08-31T06:01:56.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.004+0000 7fb65a117640 1 -- 172.21.15.53:0/2351010350 shutdown_connections 2024-08-31T06:01:56.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.004+0000 7fb65a117640 1 --2- 172.21.15.53:0/2351010350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654109b90 0x7fb6541103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:56.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.004+0000 7fb65a117640 1 --2- 172.21.15.53:0/2351010350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb654109240 0x7fb654109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.004+0000 7fb65a117640 1 --2- 172.21.15.53:0/2351010350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb654103900 0x7fb654103d10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.004+0000 7fb65a117640 1 -- 172.21.15.53:0/2351010350 >> 172.21.15.53:0/2351010350 conn(0x7fb65407b5f0 msgr2=0x7fb65407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.004+0000 7fb65a117640 1 -- 172.21.15.53:0/2351010350 shutdown_connections 2024-08-31T06:01:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.004+0000 7fb65a117640 1 -- 172.21.15.53:0/2351010350 wait complete. 2024-08-31T06:01:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.004+0000 7fb65a117640 1 Processor -- start 2024-08-31T06:01:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.004+0000 7fb65a117640 1 -- start start 2024-08-31T06:01:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb65a117640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb654103900 0x7fb65419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb65a117640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb654109240 0x7fb65419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb65a117640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654109b90 0x7fb65419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb65a117640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb654113700 con 0x7fb654103900 2024-08-31T06:01:56.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb65a117640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb654113580 con 0x7fb654109240 2024-08-31T06:01:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb65a117640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb654113880 con 0x7fb654109b90 2024-08-31T06:01:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb6537fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb654103900 0x7fb65419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb6537fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb654103900 0x7fb65419a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47970/0 (socket says 172.21.15.53:47970) 2024-08-31T06:01:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb6537fe640 1 -- 172.21.15.53:0/3712552270 learned_addr learned my addr 172.21.15.53:0/3712552270 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:01:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb652ffd640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb654109240 0x7fb65419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb653fff640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654109b90 0x7fb65419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb6537fe640 1 -- 172.21.15.53:0/3712552270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654109b90 msgr2=0x7fb65419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb6537fe640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654109b90 0x7fb65419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:56.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb6537fe640 1 -- 172.21.15.53:0/3712552270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb654109240 msgr2=0x7fb65419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb6537fe640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb654109240 0x7fb65419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb6537fe640 1 -- 172.21.15.53:0/3712552270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6541a00a0 con 0x7fb654103900 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb653fff640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654109b90 0x7fb65419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.005+0000 7fb6537fe640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb654103900 0x7fb65419a1f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb644009230 tx=0x7fb644004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.006+0000 7fb650ff9640 1 -- 172.21.15.53:0/3712552270 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64403f030 con 0x7fb654103900 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.006+0000 7fb650ff9640 1 -- 172.21.15.53:0/3712552270 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb644003a80 con 0x7fb654103900 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.006+0000 7fb650ff9640 1 -- 172.21.15.53:0/3712552270 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644035070 con 0x7fb654103900 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.006+0000 7fb65a117640 1 -- 172.21.15.53:0/3712552270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6541a0330 con 0x7fb654103900 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.006+0000 7fb65a117640 1 -- 172.21.15.53:0/3712552270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6541a0860 con 0x7fb654103900 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.007+0000 7fb65a117640 1 -- 172.21.15.53:0/3712552270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb654103d10 con 0x7fb654103900 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.008+0000 7fb650ff9640 1 -- 172.21.15.53:0/3712552270 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fb644042030 con 0x7fb654103900 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.009+0000 7fb650ff9640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6400b4c30 0x7fb6400b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:56.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.009+0000 7fb652ffd640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6400b4c30 0x7fb6400b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:56.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.009+0000 7fb650ff9640 1 -- 172.21.15.53:0/3712552270 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7fb6441058e0 con 0x7fb654103900 2024-08-31T06:01:56.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.010+0000 7fb652ffd640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6400b4c30 0x7fb6400b7140 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb654106340 tx=0x7fb63c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:56.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.012+0000 7fb650ff9640 1 -- 172.21.15.53:0/3712552270 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb6541a0860 con 0x7fb654103900 2024-08-31T06:01:56.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.254+0000 7fb65a117640 1 -- 172.21.15.53:0/3712552270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb65419b320 con 0x7fb654103900 2024-08-31T06:01:56.256 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:56 smithi053 ceph-mon[18924]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:56.256 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:56 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:56.256 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:56 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:56.256 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:56 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:56.257 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:56 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:56.257 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:56 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:56.257 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:56 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:56.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.254+0000 7fb650ff9640 1 -- 172.21.15.53:0/3712552270 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7fb6440ccde0 con 0x7fb654103900 2024-08-31T06:01:56.257 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:01:56.258 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":4,"btime":"2024-08-31T06:01:56:196218+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-31T06:01:56.258 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 4 2024-08-31T06:01:56.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 -- 172.21.15.53:0/3712552270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6400b4c30 msgr2=0x7fb6400b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:56.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6400b4c30 0x7fb6400b7140 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb654106340 tx=0x7fb63c00b390 comp rx=0 tx=0).stop 2024-08-31T06:01:56.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 -- 172.21.15.53:0/3712552270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb654103900 msgr2=0x7fb65419a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:56.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb654103900 0x7fb65419a1f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb644009230 tx=0x7fb644004270 comp rx=0 tx=0).stop 2024-08-31T06:01:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 -- 172.21.15.53:0/3712552270 shutdown_connections 2024-08-31T06:01:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6400b4c30 0x7fb6400b7140 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654109b90 0x7fb65419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb654109240 0x7fb65419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 --2- 172.21.15.53:0/3712552270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb654103900 0x7fb65419a1f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 -- 172.21.15.53:0/3712552270 >> 172.21.15.53:0/3712552270 conn(0x7fb65407b5f0 msgr2=0x7fb6541073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 -- 172.21.15.53:0/3712552270 shutdown_connections 2024-08-31T06:01:56.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:56.257+0000 7fb65a117640 1 -- 172.21.15.53:0/3712552270 wait complete. 2024-08-31T06:01:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:56 smithi130 ceph-mon[22266]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:56 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:56.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:56 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:56.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:56 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:56.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:56 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:56.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:56 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:56.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:56 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:56.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:56 smithi153 ceph-mon[22320]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:56.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:56 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:56.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:56 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:56.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:56 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:01:56.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:56 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:01:56.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:56 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:01:56.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:56 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:01:57.345 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:57 smithi053 ceph-mon[18924]: Deploying daemon mds.d on smithi053 2024-08-31T06:01:57.346 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:57 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.53:6834/2455063100,v1:172.21.15.53:6835/2455063100] up:boot 2024-08-31T06:01:57.346 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:57 smithi053 ceph-mon[18924]: fsmap 3 up:standby 2024-08-31T06:01:57.346 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:57 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T06:01:57.346 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:57 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3712552270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:01:57.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:57 smithi130 ceph-mon[22266]: Deploying daemon mds.d on smithi053 2024-08-31T06:01:57.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:57 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.53:6834/2455063100,v1:172.21.15.53:6835/2455063100] up:boot 2024-08-31T06:01:57.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:57 smithi130 ceph-mon[22266]: fsmap 3 up:standby 2024-08-31T06:01:57.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:57 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T06:01:57.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:57 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3712552270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:01:57.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:57 smithi153 ceph-mon[22320]: Deploying daemon mds.d on smithi053 2024-08-31T06:01:57.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:57 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.53:6834/2455063100,v1:172.21.15.53:6835/2455063100] up:boot 2024-08-31T06:01:57.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:57 smithi153 ceph-mon[22320]: fsmap 3 up:standby 2024-08-31T06:01:57.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:57 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T06:01:57.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:57 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3712552270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:01:58.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:01:58 smithi053 ceph-mon[18924]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:58.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:01:58 smithi130 ceph-mon[22266]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:58.675 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:01:58 smithi053 systemd[1]: Starting Ceph mds.d for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:01:58.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:01:58 smithi153 ceph-mon[22320]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:01:58.970 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:01:58 smithi053 podman[62883]: 2024-08-31 06:01:58.575635064 +0000 UTC m=+0.015959323 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:01:58.971 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:01:58 smithi053 podman[62883]: 2024-08-31 06:01:58.711062882 +0000 UTC m=+0.151387124 container create 5cde249fd20d9287dcc3e36dd224480e3f4b256b09ee30d5ebf60bbae8306342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-d, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-31T06:01:58.971 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:01:58 smithi053 podman[62883]: 2024-08-31 06:01:58.969253097 +0000 UTC m=+0.409577347 container init 5cde249fd20d9287dcc3e36dd224480e3f4b256b09ee30d5ebf60bbae8306342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-31T06:01:59.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:01:59.226 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:01:58 smithi053 podman[62883]: 2024-08-31 06:01:58.972029369 +0000 UTC m=+0.412353610 container start 5cde249fd20d9287dcc3e36dd224480e3f4b256b09ee30d5ebf60bbae8306342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:01:59.226 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:01:59 smithi053 ceph-mds[62902]: -- 172.21.15.53:0/3423697802 <== mon.0 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564328a97860 con 0x56432cc3d180 2024-08-31T06:01:59.226 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:01:59 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-d[62898]: starting mds.d at 2024-08-31T06:01:59.226 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:01:59 smithi053 bash[62883]: 5cde249fd20d9287dcc3e36dd224480e3f4b256b09ee30d5ebf60bbae8306342 2024-08-31T06:01:59.226 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:01:59 smithi053 systemd[1]: Started Ceph mds.d for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:01:59.392 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:01:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.888+0000 7fc52fe91640 1 -- 172.21.15.53:0/3938558714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc528109250 msgr2=0x7fc528109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.888+0000 7fc52fe91640 1 --2- 172.21.15.53:0/3938558714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc528109250 0x7fc528109660 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009900 tx=0x7fc51c02a410 comp rx=0 tx=0).stop 2024-08-31T06:01:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.888+0000 7fc52fe91640 1 -- 172.21.15.53:0/3938558714 shutdown_connections 2024-08-31T06:01:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.888+0000 7fc52fe91640 1 --2- 172.21.15.53:0/3938558714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc528109ba0 0x7fc5281103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.888+0000 7fc52fe91640 1 --2- 172.21.15.53:0/3938558714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc528109250 0x7fc528109660 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.888+0000 7fc52fe91640 1 --2- 172.21.15.53:0/3938558714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc528103960 0x7fc528103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.888+0000 7fc52fe91640 1 -- 172.21.15.53:0/3938558714 >> 172.21.15.53:0/3938558714 conn(0x7fc52807b6b0 msgr2=0x7fc52807bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:01:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.888+0000 7fc52fe91640 1 -- 172.21.15.53:0/3938558714 shutdown_connections 2024-08-31T06:01:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.888+0000 7fc52fe91640 1 -- 172.21.15.53:0/3938558714 wait complete. 2024-08-31T06:01:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.889+0000 7fc52fe91640 1 Processor -- start 2024-08-31T06:01:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.889+0000 7fc52fe91640 1 -- start start 2024-08-31T06:01:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.889+0000 7fc52fe91640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc528103960 0x7fc5280754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.889+0000 7fc52fe91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc528109250 0x7fc5280759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.889+0000 7fc52fe91640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc528109ba0 0x7fc528075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.889+0000 7fc52fe91640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc528113710 con 0x7fc528109250 2024-08-31T06:01:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.889+0000 7fc52fe91640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc528113590 con 0x7fc528109ba0 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.889+0000 7fc52fe91640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc528113890 con 0x7fc528103960 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.889+0000 7fc52d42c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc528109250 0x7fc5280759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.889+0000 7fc52d42c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc528109250 0x7fc5280759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48000/0 (socket says 172.21.15.53:48000) 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.889+0000 7fc52d42c640 1 -- 172.21.15.53:0/3740800330 learned_addr learned my addr 172.21.15.53:0/3740800330 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc52e42e640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc528109ba0 0x7fc528075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc52dc2d640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc528103960 0x7fc5280754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc52d42c640 1 -- 172.21.15.53:0/3740800330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc528103960 msgr2=0x7fc5280754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc52d42c640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc528103960 0x7fc5280754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc52d42c640 1 -- 172.21.15.53:0/3740800330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc528109ba0 msgr2=0x7fc528075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc52d42c640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc528109ba0 0x7fc528075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc52d42c640 1 -- 172.21.15.53:0/3740800330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5281a8400 con 0x7fc528109250 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc52dc2d640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc528103960 0x7fc5280754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:01:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc52d42c640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc528109250 0x7fc5280759f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc51c004770 tx=0x7fc51c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc526ffd640 1 -- 172.21.15.53:0/3740800330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c03f030 con 0x7fc528109250 2024-08-31T06:01:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc526ffd640 1 -- 172.21.15.53:0/3740800330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc51c004440 con 0x7fc528109250 2024-08-31T06:01:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc52fe91640 1 -- 172.21.15.53:0/3740800330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5281a8690 con 0x7fc528109250 2024-08-31T06:01:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc526ffd640 1 -- 172.21.15.53:0/3740800330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c035070 con 0x7fc528109250 2024-08-31T06:01:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.890+0000 7fc52fe91640 1 -- 172.21.15.53:0/3740800330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5281a8bc0 con 0x7fc528109250 2024-08-31T06:01:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.891+0000 7fc52fe91640 1 -- 172.21.15.53:0/3740800330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc528103d70 con 0x7fc528109250 2024-08-31T06:01:59.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.893+0000 7fc526ffd640 1 -- 172.21.15.53:0/3740800330 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fc51c042030 con 0x7fc528109250 2024-08-31T06:01:59.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.894+0000 7fc526ffd640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5100b4c00 0x7fc5100b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:01:59.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.894+0000 7fc52dc2d640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5100b4c00 0x7fc5100b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:01:59.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.894+0000 7fc526ffd640 1 -- 172.21.15.53:0/3740800330 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7fc51c105690 con 0x7fc528109250 2024-08-31T06:01:59.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.894+0000 7fc52dc2d640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5100b4c00 0x7fc5100b7110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc528076f00 tx=0x7fc518009530 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:01:59.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:01:59.897+0000 7fc526ffd640 1 -- 172.21.15.53:0/3740800330 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc51c0ccaf0 con 0x7fc528109250 2024-08-31T06:02:00.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.121+0000 7fc52fe91640 1 -- 172.21.15.53:0/3740800330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5280767b0 con 0x7fc528109250 2024-08-31T06:02:00.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.122+0000 7fc526ffd640 1 -- 172.21.15.53:0/3740800330 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7fc51c0cc3f0 con 0x7fc528109250 2024-08-31T06:02:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:00.124 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"btime":"2024-08-31T06:01:59:209727+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-31T06:02:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 5 2024-08-31T06:02:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 -- 172.21.15.53:0/3740800330 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5100b4c00 msgr2=0x7fc5100b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5100b4c00 0x7fc5100b7110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc528076f00 tx=0x7fc518009530 comp rx=0 tx=0).stop 2024-08-31T06:02:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 -- 172.21.15.53:0/3740800330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc528109250 msgr2=0x7fc5280759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc528109250 0x7fc5280759f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc51c004770 tx=0x7fc51c004040 comp rx=0 tx=0).stop 2024-08-31T06:02:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 -- 172.21.15.53:0/3740800330 shutdown_connections 2024-08-31T06:02:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5100b4c00 0x7fc5100b7110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc528109ba0 0x7fc528075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc528109250 0x7fc5280759f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 --2- 172.21.15.53:0/3740800330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc528103960 0x7fc5280754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 -- 172.21.15.53:0/3740800330 >> 172.21.15.53:0/3740800330 conn(0x7fc52807b6b0 msgr2=0x7fc5281073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 -- 172.21.15.53:0/3740800330 shutdown_connections 2024-08-31T06:02:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:00.124+0000 7fc52fe91640 1 -- 172.21.15.53:0/3740800330 wait complete. 2024-08-31T06:02:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:00 smithi130 ceph-mon[22266]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:00 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:00 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:00 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:00 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:00 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:00 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:00.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:00 smithi130 ceph-mon[22266]: Deploying daemon mds.e on smithi130 2024-08-31T06:02:00.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:00 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.53:6836/3626996637,v1:172.21.15.53:6837/3626996637] up:boot 2024-08-31T06:02:00.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:00 smithi130 ceph-mon[22266]: fsmap 4 up:standby 2024-08-31T06:02:00.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:00 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T06:02:00.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:00 smithi153 ceph-mon[22320]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:00.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:00 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:00.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:00 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:00.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:00 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:00.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:00 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:00.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:00 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:00.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:00 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:00.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:00 smithi153 ceph-mon[22320]: Deploying daemon mds.e on smithi130 2024-08-31T06:02:00.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:00 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.53:6836/3626996637,v1:172.21.15.53:6837/3626996637] up:boot 2024-08-31T06:02:00.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:00 smithi153 ceph-mon[22320]: fsmap 4 up:standby 2024-08-31T06:02:00.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:00 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T06:02:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:00 smithi053 ceph-mon[18924]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:00 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:00 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:00 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:00 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:00 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:00 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:00 smithi053 ceph-mon[18924]: Deploying daemon mds.e on smithi130 2024-08-31T06:02:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:00 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.53:6836/3626996637,v1:172.21.15.53:6837/3626996637] up:boot 2024-08-31T06:02:00.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:00 smithi053 ceph-mon[18924]: fsmap 4 up:standby 2024-08-31T06:02:00.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:00 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T06:02:01.102 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:02:00 smithi130 systemd[1]: Starting Ceph mds.e for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:02:01.363 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:01 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3740800330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:01.363 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:02:01 smithi130 podman[53308]: 2024-08-31 06:02:01.117568659 +0000 UTC m=+0.095544474 container create db2c1bd3c1b7ea20be5b91a94f49940b5c969fcf06bf42876b450c0675b54bd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-31T06:02:01.363 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:02:01 smithi130 podman[53308]: 2024-08-31 06:02:01.037780428 +0000 UTC m=+0.015756255 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:02:01.363 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:02:01 smithi130 podman[53308]: 2024-08-31 06:02:01.30349961 +0000 UTC m=+0.281475425 container init db2c1bd3c1b7ea20be5b91a94f49940b5c969fcf06bf42876b450c0675b54bd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True) 2024-08-31T06:02:01.364 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:02:01 smithi130 podman[53308]: 2024-08-31 06:02:01.306158849 +0000 UTC m=+0.284134674 container start db2c1bd3c1b7ea20be5b91a94f49940b5c969fcf06bf42876b450c0675b54bd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731) 2024-08-31T06:02:01.364 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:02:01 smithi130 ceph-mds[53327]: -- 172.21.15.130:0/742599844 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a2459e5c20 con 0x55a249b8ba80 2024-08-31T06:02:01.364 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:02:01 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e[53323]: starting mds.e at 2024-08-31T06:02:01.364 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:02:01 smithi130 bash[53308]: db2c1bd3c1b7ea20be5b91a94f49940b5c969fcf06bf42876b450c0675b54bd1 2024-08-31T06:02:01.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:01 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3740800330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:01.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:01 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3740800330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:01.628 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:02:01 smithi130 systemd[1]: Started Ceph mds.e for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:02:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:02 smithi130 ceph-mon[22266]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:02 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:02.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:02 smithi153 ceph-mon[22320]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:02.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:02.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:02.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:02.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:02.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:02.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:02 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:02 smithi053 ceph-mon[18924]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:02 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:02.864 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:02:03.134 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:03.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:03 smithi053 ceph-mon[18924]: Deploying daemon mds.f on smithi153 2024-08-31T06:02:03.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:03 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.130:6834/3456535570,v1:172.21.15.130:6835/3456535570] up:boot 2024-08-31T06:02:03.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:03 smithi053 ceph-mon[18924]: fsmap 5 up:standby 2024-08-31T06:02:03.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:03 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:02:03.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:03 smithi130 ceph-mon[22266]: Deploying daemon mds.f on smithi153 2024-08-31T06:02:03.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:03 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.130:6834/3456535570,v1:172.21.15.130:6835/3456535570] up:boot 2024-08-31T06:02:03.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:03 smithi130 ceph-mon[22266]: fsmap 5 up:standby 2024-08-31T06:02:03.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:03 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:02:03.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:03 smithi153 ceph-mon[22320]: Deploying daemon mds.f on smithi153 2024-08-31T06:02:03.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:03 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.130:6834/3456535570,v1:172.21.15.130:6835/3456535570] up:boot 2024-08-31T06:02:03.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:03 smithi153 ceph-mon[22320]: fsmap 5 up:standby 2024-08-31T06:02:03.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:03 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:02:03.426 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:02:03 smithi153 systemd[1]: Starting Ceph mds.f for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:02:03.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.653+0000 7f5d826bb640 1 -- 172.21.15.53:0/1513273300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d7c109300 msgr2=0x7f5d7c109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:03.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.653+0000 7f5d826bb640 1 --2- 172.21.15.53:0/1513273300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d7c109300 0x7f5d7c109710 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009900 tx=0x7f5d6402a410 comp rx=0 tx=0).stop 2024-08-31T06:02:03.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.653+0000 7f5d826bb640 1 -- 172.21.15.53:0/1513273300 shutdown_connections 2024-08-31T06:02:03.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.653+0000 7f5d826bb640 1 --2- 172.21.15.53:0/1513273300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c109c50 0x7f5d7c110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:03.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.653+0000 7f5d826bb640 1 --2- 172.21.15.53:0/1513273300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d7c109300 0x7f5d7c109710 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.653+0000 7f5d826bb640 1 --2- 172.21.15.53:0/1513273300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d7c101e20 0x7f5d7c102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.653+0000 7f5d826bb640 1 -- 172.21.15.53:0/1513273300 >> 172.21.15.53:0/1513273300 conn(0x7f5d7c079c60 msgr2=0x7f5d7c07a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.653+0000 7f5d826bb640 1 -- 172.21.15.53:0/1513273300 shutdown_connections 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.653+0000 7f5d826bb640 1 -- 172.21.15.53:0/1513273300 wait complete. 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.653+0000 7f5d826bb640 1 Processor -- start 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d826bb640 1 -- start start 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d826bb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c101e20 0x7f5d7c19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d826bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d7c109300 0x7f5d7c19a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d826bb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d7c109c50 0x7f5d7c19faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d826bb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c1137c0 con 0x7f5d7c109300 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d826bb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c113640 con 0x7f5d7c101e20 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d826bb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c113940 con 0x7f5d7c109c50 2024-08-31T06:02:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d73fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d7c109300 0x7f5d7c19a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d73fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d7c109300 0x7f5d7c19a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53264/0 (socket says 172.21.15.53:53264) 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d73fff640 1 -- 172.21.15.53:0/1894100427 learned_addr learned my addr 172.21.15.53:0/1894100427 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d7bfff640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c101e20 0x7f5d7c19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d80c58640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d7c109c50 0x7f5d7c19faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d73fff640 1 -- 172.21.15.53:0/1894100427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d7c109c50 msgr2=0x7f5d7c19faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d73fff640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d7c109c50 0x7f5d7c19faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d73fff640 1 -- 172.21.15.53:0/1894100427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c101e20 msgr2=0x7f5d7c19a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d73fff640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c101e20 0x7f5d7c19a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d73fff640 1 -- 172.21.15.53:0/1894100427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c1a0220 con 0x7f5d7c109300 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.654+0000 7f5d73fff640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d7c109300 0x7f5d7c19a850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d64005940 tx=0x7f5d640040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.655+0000 7f5d79ffb640 1 -- 172.21.15.53:0/1894100427 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6403f030 con 0x7f5d7c109300 2024-08-31T06:02:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.655+0000 7f5d826bb640 1 -- 172.21.15.53:0/1894100427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7c1a04b0 con 0x7f5d7c109300 2024-08-31T06:02:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.655+0000 7f5d79ffb640 1 -- 172.21.15.53:0/1894100427 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d64003a80 con 0x7f5d7c109300 2024-08-31T06:02:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.655+0000 7f5d79ffb640 1 -- 172.21.15.53:0/1894100427 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64035070 con 0x7f5d7c109300 2024-08-31T06:02:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.655+0000 7f5d826bb640 1 -- 172.21.15.53:0/1894100427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7c1a6c70 con 0x7f5d7c109300 2024-08-31T06:02:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.656+0000 7f5d826bb640 1 -- 172.21.15.53:0/1894100427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7c06b690 con 0x7f5d7c109300 2024-08-31T06:02:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.657+0000 7f5d79ffb640 1 -- 172.21.15.53:0/1894100427 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f5d64042030 con 0x7f5d7c109300 2024-08-31T06:02:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.658+0000 7f5d79ffb640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5d680b4b80 0x7f5d680b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.658+0000 7f5d7bfff640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5d680b4b80 0x7f5d680b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.658+0000 7f5d79ffb640 1 -- 172.21.15.53:0/1894100427 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7f5d64105660 con 0x7f5d7c109300 2024-08-31T06:02:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.658+0000 7f5d7bfff640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5d680b4b80 0x7f5d680b7090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005fd0 tx=0x7f5d6c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.661+0000 7f5d79ffb640 1 -- 172.21.15.53:0/1894100427 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5d640cc510 con 0x7f5d7c109300 2024-08-31T06:02:03.718 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:02:03 smithi153 podman[53240]: 2024-08-31 06:02:03.341130862 +0000 UTC m=+0.016080107 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:02:03.719 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:02:03 smithi153 podman[53240]: 2024-08-31 06:02:03.478336559 +0000 UTC m=+0.153285834 container create 2f3551e89d687e25748f1a0a33fb269961ed1205b02d6e6e5fb4cd48eea66a1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:02:03.719 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:02:03 smithi153 podman[53240]: 2024-08-31 06:02:03.680381154 +0000 UTC m=+0.355330386 container init 2f3551e89d687e25748f1a0a33fb269961ed1205b02d6e6e5fb4cd48eea66a1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-31T06:02:03.719 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:02:03 smithi153 podman[53240]: 2024-08-31 06:02:03.683317388 +0000 UTC m=+0.358266626 container start 2f3551e89d687e25748f1a0a33fb269961ed1205b02d6e6e5fb4cd48eea66a1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T06:02:03.719 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:02:03 smithi153 ceph-mds[53259]: -- 172.21.15.153:0/1255901575 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5590ccc79860 con 0x5590d0e1f180 2024-08-31T06:02:03.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.894+0000 7f5d826bb640 1 -- 172.21.15.53:0/1894100427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d7c10ba40 con 0x7f5d7c109300 2024-08-31T06:02:03.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.895+0000 7f5d79ffb640 1 -- 172.21.15.53:0/1894100427 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7f5d640d0cd0 con 0x7f5d7c109300 2024-08-31T06:02:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:03.897 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":6,"btime":"2024-08-31T06:02:02:098995+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-31T06:02:03.897 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 6 2024-08-31T06:02:03.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 -- 172.21.15.53:0/1894100427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5d680b4b80 msgr2=0x7f5d680b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:03.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5d680b4b80 0x7f5d680b7090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005fd0 tx=0x7f5d6c00b390 comp rx=0 tx=0).stop 2024-08-31T06:02:03.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 -- 172.21.15.53:0/1894100427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d7c109300 msgr2=0x7f5d7c19a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:03.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d7c109300 0x7f5d7c19a850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d64005940 tx=0x7f5d640040e0 comp rx=0 tx=0).stop 2024-08-31T06:02:03.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 -- 172.21.15.53:0/1894100427 shutdown_connections 2024-08-31T06:02:03.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5d680b4b80 0x7f5d680b7090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:03.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d7c109c50 0x7f5d7c19faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:03.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d7c109300 0x7f5d7c19a850 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:03.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 --2- 172.21.15.53:0/1894100427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d7c101e20 0x7f5d7c19a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:03.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 -- 172.21.15.53:0/1894100427 >> 172.21.15.53:0/1894100427 conn(0x7f5d7c079c60 msgr2=0x7f5d7c107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:03.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 -- 172.21.15.53:0/1894100427 shutdown_connections 2024-08-31T06:02:03.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:03.897+0000 7f5d826bb640 1 -- 172.21.15.53:0/1894100427 wait complete. 2024-08-31T06:02:04.121 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:02:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f[53255]: starting mds.f at 2024-08-31T06:02:04.122 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:02:03 smithi153 bash[53240]: 2f3551e89d687e25748f1a0a33fb269961ed1205b02d6e6e5fb4cd48eea66a1e 2024-08-31T06:02:04.122 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:02:03 smithi153 systemd[1]: Started Ceph mds.f for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:02:04.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:04 smithi053 ceph-mon[18924]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:04.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:04.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:04.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:04.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:04.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:04.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:04.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:04 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1894100427' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:04 smithi130 ceph-mon[22266]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:04 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1894100427' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:04 smithi153 ceph-mon[22320]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:04.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:04.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:04.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:04.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:04.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:04 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1894100427' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:05.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:05 smithi153 ceph-mon[22320]: Deploying daemon mds.c on smithi153 2024-08-31T06:02:05.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:05 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] up:boot 2024-08-31T06:02:05.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:05 smithi153 ceph-mon[22320]: fsmap 6 up:standby 2024-08-31T06:02:05.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:02:05.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:05 smithi053 ceph-mon[18924]: Deploying daemon mds.c on smithi153 2024-08-31T06:02:05.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:05 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] up:boot 2024-08-31T06:02:05.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:05 smithi053 ceph-mon[18924]: fsmap 6 up:standby 2024-08-31T06:02:05.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:02:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:05 smithi130 ceph-mon[22266]: Deploying daemon mds.c on smithi153 2024-08-31T06:02:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:05 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] up:boot 2024-08-31T06:02:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:05 smithi130 ceph-mon[22266]: fsmap 6 up:standby 2024-08-31T06:02:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:02:05.925 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:02:05 smithi153 systemd[1]: Starting Ceph mds.c for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:02:06.212 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:06 smithi153 ceph-mon[22320]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:06.213 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:02:05 smithi153 podman[53541]: 2024-08-31 06:02:05.943483853 +0000 UTC m=+0.105307418 container create 0ab220a68f515ccc2274c639f0940781e480d60c7aa7a2a29a5ee2b7600a81c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-31T06:02:06.213 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:02:05 smithi153 podman[53541]: 2024-08-31 06:02:05.853736016 +0000 UTC m=+0.015559594 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:02:06.213 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:02:06 smithi153 podman[53541]: 2024-08-31 06:02:06.174763446 +0000 UTC m=+0.336587016 container init 0ab220a68f515ccc2274c639f0940781e480d60c7aa7a2a29a5ee2b7600a81c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-31T06:02:06.213 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:02:06 smithi153 podman[53541]: 2024-08-31 06:02:06.177797879 +0000 UTC m=+0.339621456 container start 0ab220a68f515ccc2274c639f0940781e480d60c7aa7a2a29a5ee2b7600a81c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:02:06.213 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:02:06 smithi153 ceph-mds[53560]: -- 172.21.15.153:0/3093529384 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564f86711860 con 0x564f8a8b7180 2024-08-31T06:02:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:06 smithi053 ceph-mon[18924]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:06 smithi130 ceph-mon[22266]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:06.675 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:02:06 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c[53556]: starting mds.c at 2024-08-31T06:02:06.675 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:02:06 smithi153 bash[53541]: 0ab220a68f515ccc2274c639f0940781e480d60c7aa7a2a29a5ee2b7600a81c4 2024-08-31T06:02:06.675 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:02:06 smithi153 systemd[1]: Started Ceph mds.c for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:02:06.754 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:02:07.020 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:07 smithi130 ceph-mon[22266]: Deploying daemon mds.h on smithi130 2024-08-31T06:02:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:07 smithi130 ceph-mon[22266]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:07 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] up:boot 2024-08-31T06:02:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:07 smithi130 ceph-mon[22266]: fsmap 7 up:standby 2024-08-31T06:02:07.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:07 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:02:07.430 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:07.430 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:07.430 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:07.430 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:07.430 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:07.430 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:07.430 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:07 smithi053 ceph-mon[18924]: Deploying daemon mds.h on smithi130 2024-08-31T06:02:07.430 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:07 smithi053 ceph-mon[18924]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:07.430 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:07 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] up:boot 2024-08-31T06:02:07.431 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:07 smithi053 ceph-mon[18924]: fsmap 7 up:standby 2024-08-31T06:02:07.431 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:07 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:02:07.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.522+0000 7f7be428e640 1 -- 172.21.15.53:0/4197974369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bdc102840 msgr2=0x7f7bdc102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:07.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.522+0000 7f7be428e640 1 --2- 172.21.15.53:0/4197974369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bdc102840 0x7f7bdc102c50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009900 tx=0x7f7bd802a410 comp rx=0 tx=0).stop 2024-08-31T06:02:07.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.523+0000 7f7be428e640 1 -- 172.21.15.53:0/4197974369 shutdown_connections 2024-08-31T06:02:07.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.523+0000 7f7be428e640 1 --2- 172.21.15.53:0/4197974369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc108ad0 0x7f7bdc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:07.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.523+0000 7f7be428e640 1 --2- 172.21.15.53:0/4197974369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bdc108180 0x7f7bdc108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:07.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.523+0000 7f7be428e640 1 --2- 172.21.15.53:0/4197974369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bdc102840 0x7f7bdc102c50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:07.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.523+0000 7f7be428e640 1 -- 172.21.15.53:0/4197974369 >> 172.21.15.53:0/4197974369 conn(0x7f7bdc079580 msgr2=0x7f7bdc079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:07.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.523+0000 7f7be428e640 1 -- 172.21.15.53:0/4197974369 shutdown_connections 2024-08-31T06:02:07.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.523+0000 7f7be428e640 1 -- 172.21.15.53:0/4197974369 wait complete. 2024-08-31T06:02:07.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.523+0000 7f7be428e640 1 Processor -- start 2024-08-31T06:02:07.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.523+0000 7f7be428e640 1 -- start start 2024-08-31T06:02:07.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be428e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc102840 0x7f7bdc19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:07.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be428e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bdc108180 0x7f7bdc19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:07.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be428e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bdc108ad0 0x7f7bdc19f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:07.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be428e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc112600 con 0x7f7bdc108ad0 2024-08-31T06:02:07.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be428e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc112480 con 0x7f7bdc108180 2024-08-31T06:02:07.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be428e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc112780 con 0x7f7bdc102840 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be282b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bdc108ad0 0x7f7bdc19f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be282b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bdc108ad0 0x7f7bdc19f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53290/0 (socket says 172.21.15.53:53290) 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be282b640 1 -- 172.21.15.53:0/3505369820 learned_addr learned my addr 172.21.15.53:0/3505369820 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be202a640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc102840 0x7f7bdc19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be1829640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bdc108180 0x7f7bdc19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be282b640 1 -- 172.21.15.53:0/3505369820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc102840 msgr2=0x7f7bdc19a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be282b640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc102840 0x7f7bdc19a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be282b640 1 -- 172.21.15.53:0/3505369820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bdc108180 msgr2=0x7f7bdc19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be282b640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bdc108180 0x7f7bdc19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be282b640 1 -- 172.21.15.53:0/3505369820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc1a0090 con 0x7f7bdc108ad0 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.524+0000 7f7be282b640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bdc108ad0 0x7f7bdc19f960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400eaa0 tx=0x7f7bd400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:07.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.525+0000 7f7bd37fe640 1 -- 172.21.15.53:0/3505369820 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400cdb0 con 0x7f7bdc108ad0 2024-08-31T06:02:07.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.525+0000 7f7be428e640 1 -- 172.21.15.53:0/3505369820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc1a0380 con 0x7f7bdc108ad0 2024-08-31T06:02:07.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.525+0000 7f7bd37fe640 1 -- 172.21.15.53:0/3505369820 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7bd4005020 con 0x7f7bdc108ad0 2024-08-31T06:02:07.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.525+0000 7f7bd37fe640 1 -- 172.21.15.53:0/3505369820 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40116d0 con 0x7f7bdc108ad0 2024-08-31T06:02:07.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.525+0000 7f7be428e640 1 -- 172.21.15.53:0/3505369820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc1a6ae0 con 0x7f7bdc108ad0 2024-08-31T06:02:07.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.526+0000 7f7be428e640 1 -- 172.21.15.53:0/3505369820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bdc102c50 con 0x7f7bdc108ad0 2024-08-31T06:02:07.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.527+0000 7f7bd37fe640 1 -- 172.21.15.53:0/3505369820 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f7bd40051d0 con 0x7f7bdc108ad0 2024-08-31T06:02:07.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.528+0000 7f7bd37fe640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7bc80b4b80 0x7f7bc80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:07.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.528+0000 7f7be202a640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7bc80b4b80 0x7f7bc80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:07.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.528+0000 7f7bd37fe640 1 -- 172.21.15.53:0/3505369820 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7f7bd40e4f40 con 0x7f7bdc108ad0 2024-08-31T06:02:07.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.529+0000 7f7be202a640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7bc80b4b80 0x7f7bc80b7090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80057c0 tx=0x7f7bd80058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:07.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.533+0000 7f7bd37fe640 1 -- 172.21.15.53:0/3505369820 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7bd4016030 con 0x7f7bdc108ad0 2024-08-31T06:02:07.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:07.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:07 smithi153 ceph-mon[22320]: Deploying daemon mds.h on smithi130 2024-08-31T06:02:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:07 smithi153 ceph-mon[22320]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:07 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] up:boot 2024-08-31T06:02:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:07 smithi153 ceph-mon[22320]: fsmap 7 up:standby 2024-08-31T06:02:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:07 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:02:07.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.756+0000 7f7be428e640 1 -- 172.21.15.53:0/3505369820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bdc1a6eb0 con 0x7f7bdc108ad0 2024-08-31T06:02:07.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.757+0000 7f7bd37fe640 1 -- 172.21.15.53:0/3505369820 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6400 (secure 0 0 0) 0x7f7bd40abd50 con 0x7f7bdc108ad0 2024-08-31T06:02:07.759 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:07.759 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":8,"btime":"2024-08-31T06:02:07:127345+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24613,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24619,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-31T06:02:07.759 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 8 2024-08-31T06:02:07.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 -- 172.21.15.53:0/3505369820 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7bc80b4b80 msgr2=0x7f7bc80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:07.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7bc80b4b80 0x7f7bc80b7090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80057c0 tx=0x7f7bd80058d0 comp rx=0 tx=0).stop 2024-08-31T06:02:07.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 -- 172.21.15.53:0/3505369820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bdc108ad0 msgr2=0x7f7bdc19f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:07.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bdc108ad0 0x7f7bdc19f960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400eaa0 tx=0x7f7bd400ef60 comp rx=0 tx=0).stop 2024-08-31T06:02:07.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 -- 172.21.15.53:0/3505369820 shutdown_connections 2024-08-31T06:02:07.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7bc80b4b80 0x7f7bc80b7090 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:07.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bdc108ad0 0x7f7bdc19f960 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:07.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bdc108180 0x7f7bdc19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:07.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 --2- 172.21.15.53:0/3505369820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bdc102840 0x7f7bdc19a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:07.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 -- 172.21.15.53:0/3505369820 >> 172.21.15.53:0/3505369820 conn(0x7f7bdc079580 msgr2=0x7f7bdc1018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:07.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 -- 172.21.15.53:0/3505369820 shutdown_connections 2024-08-31T06:02:07.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:07.759+0000 7f7be428e640 1 -- 172.21.15.53:0/3505369820 wait complete. 2024-08-31T06:02:08.320 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:02:08 smithi130 systemd[1]: Starting Ceph mds.h for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:02:08.620 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:08 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3505369820' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:08.620 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:02:08 smithi130 podman[53606]: 2024-08-31 06:02:08.270267512 +0000 UTC m=+0.015674181 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:02:08.620 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:02:08 smithi130 podman[53606]: 2024-08-31 06:02:08.488201839 +0000 UTC m=+0.233608505 container create ccd3bda244674cbe9768c2dd18b69c16003e65f6b921f93c796557f850733113 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:02:08.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:08 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3505369820' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:08.693 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:08 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3505369820' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:08.878 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:02:08 smithi130 podman[53606]: 2024-08-31 06:02:08.740929151 +0000 UTC m=+0.486335818 container init ccd3bda244674cbe9768c2dd18b69c16003e65f6b921f93c796557f850733113 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=) 2024-08-31T06:02:08.878 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:02:08 smithi130 podman[53606]: 2024-08-31 06:02:08.744239418 +0000 UTC m=+0.489646092 container start ccd3bda244674cbe9768c2dd18b69c16003e65f6b921f93c796557f850733113 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:02:08.878 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:02:08 smithi130 ceph-mds[53625]: -- 172.21.15.130:0/3411435112 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558fda8b7860 con 0x558fdea5d180 2024-08-31T06:02:08.878 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:02:08 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h[53621]: starting mds.h at 2024-08-31T06:02:08.878 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:02:08 smithi130 bash[53606]: ccd3bda244674cbe9768c2dd18b69c16003e65f6b921f93c796557f850733113 2024-08-31T06:02:08.878 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:02:08 smithi130 systemd[1]: Started Ceph mds.h for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:02:09.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:09 smithi153 ceph-mon[22320]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:09.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:09.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:09.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:09.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:09.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:09.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:09.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:09 smithi153 ceph-mon[22320]: Deploying daemon mds.i on smithi153 2024-08-31T06:02:09.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:09 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] up:boot 2024-08-31T06:02:09.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:09 smithi153 ceph-mon[22320]: fsmap 8 up:standby 2024-08-31T06:02:09.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:09 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:02:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:09 smithi130 ceph-mon[22266]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:10.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:10.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:10.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:10.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:09 smithi130 ceph-mon[22266]: Deploying daemon mds.i on smithi153 2024-08-31T06:02:10.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:09 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] up:boot 2024-08-31T06:02:10.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:09 smithi130 ceph-mon[22266]: fsmap 8 up:standby 2024-08-31T06:02:10.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:09 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:02:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:09 smithi053 ceph-mon[18924]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:10.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:10.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:10.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:09 smithi053 ceph-mon[18924]: Deploying daemon mds.i on smithi153 2024-08-31T06:02:10.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:09 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] up:boot 2024-08-31T06:02:10.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:09 smithi053 ceph-mon[18924]: fsmap 8 up:standby 2024-08-31T06:02:10.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:09 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:02:10.514 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:02:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:10.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:02:10 smithi153 systemd[1]: Starting Ceph mds.i for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:02:11.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.259+0000 7fa14508b640 1 -- 172.21.15.53:0/3959042909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa140108ac0 msgr2=0x7fa14010f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:11.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.259+0000 7fa14508b640 1 --2- 172.21.15.53:0/3959042909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa140108ac0 0x7fa14010f2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa138009ca0 tx=0x7fa13802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:02:11.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.259+0000 7fa14508b640 1 -- 172.21.15.53:0/3959042909 shutdown_connections 2024-08-31T06:02:11.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.259+0000 7fa14508b640 1 --2- 172.21.15.53:0/3959042909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa140108ac0 0x7fa14010f2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:11.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.259+0000 7fa14508b640 1 --2- 172.21.15.53:0/3959042909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa140108170 0x7fa140108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:11.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.259+0000 7fa14508b640 1 --2- 172.21.15.53:0/3959042909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa140102880 0x7fa140102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:11.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.259+0000 7fa14508b640 1 -- 172.21.15.53:0/3959042909 >> 172.21.15.53:0/3959042909 conn(0x7fa140079500 msgr2=0x7fa140079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:11.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.259+0000 7fa14508b640 1 -- 172.21.15.53:0/3959042909 shutdown_connections 2024-08-31T06:02:11.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.259+0000 7fa14508b640 1 -- 172.21.15.53:0/3959042909 wait complete. 2024-08-31T06:02:11.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.260+0000 7fa14508b640 1 Processor -- start 2024-08-31T06:02:11.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.260+0000 7fa14508b640 1 -- start start 2024-08-31T06:02:11.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa14508b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa140102880 0x7fa140198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:11.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa14508b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa140108170 0x7fa140199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:11.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa14508b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa140108ac0 0x7fa140199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:11.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa14508b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa140112620 con 0x7fa140108170 2024-08-31T06:02:11.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa14508b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401124a0 con 0x7fa140102880 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa14508b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401127a0 con 0x7fa140108ac0 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa13e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa140108170 0x7fa140199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa13e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa140108170 0x7fa140199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53304/0 (socket says 172.21.15.53:53304) 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa13f59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa140108ac0 0x7fa140199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa13e59c640 1 -- 172.21.15.53:0/3279740268 learned_addr learned my addr 172.21.15.53:0/3279740268 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa13ed9d640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa140102880 0x7fa140198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa13e59c640 1 -- 172.21.15.53:0/3279740268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa140108ac0 msgr2=0x7fa140199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa13e59c640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa140108ac0 0x7fa140199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa13e59c640 1 -- 172.21.15.53:0/3279740268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa140102880 msgr2=0x7fa140198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa13e59c640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa140102880 0x7fa140198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa13e59c640 1 -- 172.21.15.53:0/3279740268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1401a83b0 con 0x7fa140108170 2024-08-31T06:02:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.261+0000 7fa13e59c640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa140108170 0x7fa140199240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa134005fd0 tx=0x7fa13400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.262+0000 7fa127fff640 1 -- 172.21.15.53:0/3279740268 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134017070 con 0x7fa140108170 2024-08-31T06:02:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.262+0000 7fa14508b640 1 -- 172.21.15.53:0/3279740268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1401a86a0 con 0x7fa140108170 2024-08-31T06:02:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.262+0000 7fa127fff640 1 -- 172.21.15.53:0/3279740268 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa134009c30 con 0x7fa140108170 2024-08-31T06:02:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.262+0000 7fa127fff640 1 -- 172.21.15.53:0/3279740268 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134003c70 con 0x7fa140108170 2024-08-31T06:02:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.262+0000 7fa14508b640 1 -- 172.21.15.53:0/3279740268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1401a8c30 con 0x7fa140108170 2024-08-31T06:02:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.263+0000 7fa14508b640 1 -- 172.21.15.53:0/3279740268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa140103ab0 con 0x7fa140108170 2024-08-31T06:02:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.264+0000 7fa127fff640 1 -- 172.21.15.53:0/3279740268 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fa134003e10 con 0x7fa140108170 2024-08-31T06:02:11.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.265+0000 7fa127fff640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1280b4b80 0x7fa1280b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:11.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.265+0000 7fa13ed9d640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1280b4b80 0x7fa1280b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:11.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.266+0000 7fa127fff640 1 -- 172.21.15.53:0/3279740268 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7fa1340e5200 con 0x7fa140108170 2024-08-31T06:02:11.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.266+0000 7fa13ed9d640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1280b4b80 0x7fa1280b7090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa140079a70 tx=0x7fa13000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:11.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.269+0000 7fa127fff640 1 -- 172.21.15.53:0/3279740268 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa134020030 con 0x7fa140108170 2024-08-31T06:02:11.348 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:02:11 smithi153 podman[53840]: 2024-08-31 06:02:10.968263331 +0000 UTC m=+0.015886644 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:02:11.348 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:02:11 smithi153 podman[53840]: 2024-08-31 06:02:11.066241003 +0000 UTC m=+0.113864302 container create e4de4d4a385aabf8abfa6c158a7a68d29ccb15887d3b3e4df762fc4318cf4bde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-31T06:02:11.348 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:02:11 smithi153 podman[53840]: 2024-08-31 06:02:11.31040502 +0000 UTC m=+0.358028320 container init e4de4d4a385aabf8abfa6c158a7a68d29ccb15887d3b3e4df762fc4318cf4bde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_CLEAN=True) 2024-08-31T06:02:11.348 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:02:11 smithi153 podman[53840]: 2024-08-31 06:02:11.31325261 +0000 UTC m=+0.360875924 container start e4de4d4a385aabf8abfa6c158a7a68d29ccb15887d3b3e4df762fc4318cf4bde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-08-31T06:02:11.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.508+0000 7fa14508b640 1 -- 172.21.15.53:0/3279740268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa14006bcf0 con 0x7fa140108170 2024-08-31T06:02:11.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.509+0000 7fa127fff640 1 -- 172.21.15.53:0/3279740268 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7228 (secure 0 0 0) 0x7fa14006bcf0 con 0x7fa140108170 2024-08-31T06:02:11.511 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:11.511 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":9,"btime":"2024-08-31T06:02:09:318235+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24613,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24619,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24632,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-31T06:02:11.511 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 9 2024-08-31T06:02:11.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 -- 172.21.15.53:0/3279740268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1280b4b80 msgr2=0x7fa1280b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:11.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1280b4b80 0x7fa1280b7090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa140079a70 tx=0x7fa13000b390 comp rx=0 tx=0).stop 2024-08-31T06:02:11.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 -- 172.21.15.53:0/3279740268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa140108170 msgr2=0x7fa140199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:11.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa140108170 0x7fa140199240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa134005fd0 tx=0x7fa13400dde0 comp rx=0 tx=0).stop 2024-08-31T06:02:11.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 -- 172.21.15.53:0/3279740268 shutdown_connections 2024-08-31T06:02:11.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1280b4b80 0x7fa1280b7090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:11.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa140108ac0 0x7fa140199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:11.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa140108170 0x7fa140199240 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:11.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 --2- 172.21.15.53:0/3279740268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa140102880 0x7fa140198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:11.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 -- 172.21.15.53:0/3279740268 >> 172.21.15.53:0/3279740268 conn(0x7fa140079500 msgr2=0x7fa1401041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:11.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 -- 172.21.15.53:0/3279740268 shutdown_connections 2024-08-31T06:02:11.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:11.511+0000 7fa14508b640 1 -- 172.21.15.53:0/3279740268 wait complete. 2024-08-31T06:02:11.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:02:11 smithi153 ceph-mds[53859]: -- 172.21.15.153:0/3251669408 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fb1c315860 con 0x55fb204bb600 2024-08-31T06:02:11.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:02:11 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i[53855]: starting mds.i at 2024-08-31T06:02:11.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:02:11 smithi153 bash[53840]: e4de4d4a385aabf8abfa6c158a7a68d29ccb15887d3b3e4df762fc4318cf4bde 2024-08-31T06:02:11.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:02:11 smithi153 systemd[1]: Started Ceph mds.i for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:02:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:11 smithi153 ceph-mon[22320]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:12.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:12.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:12.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:12.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:11 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3279740268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:12.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:11 smithi053 ceph-mon[18924]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:11 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3279740268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:11 smithi130 ceph-mon[22266]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:12.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:12.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:12.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:11 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3279740268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:13.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:12 smithi153 ceph-mon[22320]: Deploying daemon mds.g on smithi053 2024-08-31T06:02:13.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:12 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] up:boot 2024-08-31T06:02:13.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:12 smithi153 ceph-mon[22320]: fsmap 9 up:standby 2024-08-31T06:02:13.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:12 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:02:13.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:12 smithi053 ceph-mon[18924]: Deploying daemon mds.g on smithi053 2024-08-31T06:02:13.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:12 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] up:boot 2024-08-31T06:02:13.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:12 smithi053 ceph-mon[18924]: fsmap 9 up:standby 2024-08-31T06:02:13.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:12 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:02:13.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:12 smithi130 ceph-mon[22266]: Deploying daemon mds.g on smithi053 2024-08-31T06:02:13.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:12 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] up:boot 2024-08-31T06:02:13.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:12 smithi130 ceph-mon[22266]: fsmap 9 up:standby 2024-08-31T06:02:13.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:12 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:02:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:13 smithi153 ceph-mon[22320]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:14.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:13 smithi053 ceph-mon[18924]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:14.192 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:02:13 smithi053 systemd[1]: Starting Ceph mds.g for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:02:14.262 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:02:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:13 smithi130 ceph-mon[22266]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:14.461 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:02:14 smithi053 podman[63654]: 2024-08-31 06:02:14.093130119 +0000 UTC m=+0.016112182 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:02:14.462 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:02:14 smithi053 podman[63654]: 2024-08-31 06:02:14.215901448 +0000 UTC m=+0.138883507 container create 139dbbde6324d185cd0abdde001f454a5089716a748379660212f339b62949f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-31T06:02:14.462 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:02:14 smithi053 podman[63654]: 2024-08-31 06:02:14.460273905 +0000 UTC m=+0.383255958 container init 139dbbde6324d185cd0abdde001f454a5089716a748379660212f339b62949f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2) 2024-08-31T06:02:14.636 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:14.726 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:02:14 smithi053 podman[63654]: 2024-08-31 06:02:14.463747705 +0000 UTC m=+0.386729762 container start 139dbbde6324d185cd0abdde001f454a5089716a748379660212f339b62949f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:02:14.726 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:02:14 smithi053 ceph-mds[63702]: -- 172.21.15.53:0/2038584570 <== mon.0 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55711ed91860 con 0x557122f37180 2024-08-31T06:02:14.726 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:02:14 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g[63687]: starting mds.g at 2024-08-31T06:02:14.726 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:02:14 smithi053 bash[63654]: 139dbbde6324d185cd0abdde001f454a5089716a748379660212f339b62949f7 2024-08-31T06:02:14.726 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:02:14 smithi053 systemd[1]: Started Ceph mds.g for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:02:15.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.130+0000 7f78bfd43640 1 -- 172.21.15.53:0/3223584015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b8109260 msgr2=0x7f78b8109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:15.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.130+0000 7f78bfd43640 1 --2- 172.21.15.53:0/3223584015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b8109260 0x7f78b8109670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009900 tx=0x7f78a802a410 comp rx=0 tx=0).stop 2024-08-31T06:02:15.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.130+0000 7f78bfd43640 1 -- 172.21.15.53:0/3223584015 shutdown_connections 2024-08-31T06:02:15.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.130+0000 7f78bfd43640 1 --2- 172.21.15.53:0/3223584015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b8109bb0 0x7f78b81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:15.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.130+0000 7f78bfd43640 1 --2- 172.21.15.53:0/3223584015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b8109260 0x7f78b8109670 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:15.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.130+0000 7f78bfd43640 1 --2- 172.21.15.53:0/3223584015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78b8103920 0x7f78b8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:15.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.130+0000 7f78bfd43640 1 -- 172.21.15.53:0/3223584015 >> 172.21.15.53:0/3223584015 conn(0x7f78b80ff370 msgr2=0x7f78b81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.130+0000 7f78bfd43640 1 -- 172.21.15.53:0/3223584015 shutdown_connections 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.130+0000 7f78bfd43640 1 -- 172.21.15.53:0/3223584015 wait complete. 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.131+0000 7f78bfd43640 1 Processor -- start 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.131+0000 7f78bfd43640 1 -- start start 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.131+0000 7f78bfd43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b8103920 0x7f78b80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.131+0000 7f78bfd43640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b8109260 0x7f78b80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.131+0000 7f78bfd43640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78b8109bb0 0x7f78b8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bfd43640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f78b8113720 con 0x7f78b8103920 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bfd43640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f78b81135a0 con 0x7f78b8109260 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bfd43640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78b81138a0 con 0x7f78b8109bb0 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bdadf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b8103920 0x7f78b80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bdadf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b8103920 0x7f78b80754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34062/0 (socket says 172.21.15.53:34062) 2024-08-31T06:02:15.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bdadf640 1 -- 172.21.15.53:0/4268331138 learned_addr learned my addr 172.21.15.53:0/4268331138 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bd2de640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b8109260 0x7f78b80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78be2e0640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78b8109bb0 0x7f78b8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bdadf640 1 -- 172.21.15.53:0/4268331138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78b8109bb0 msgr2=0x7f78b8075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bdadf640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78b8109bb0 0x7f78b8075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bdadf640 1 -- 172.21.15.53:0/4268331138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b8109260 msgr2=0x7f78b80759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bdadf640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b8109260 0x7f78b80759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bdadf640 1 -- 172.21.15.53:0/4268331138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b81a8450 con 0x7f78b8103920 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bdadf640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b8103920 0x7f78b80754b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c970 tx=0x7f78b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78aeffd640 1 -- 172.21.15.53:0/4268331138 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4007bb0 con 0x7f78b8103920 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bfd43640 1 -- 172.21.15.53:0/4268331138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b81a8740 con 0x7f78b8103920 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78aeffd640 1 -- 172.21.15.53:0/4268331138 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78b4007d50 con 0x7f78b8103920 2024-08-31T06:02:15.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78aeffd640 1 -- 172.21.15.53:0/4268331138 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4004e40 con 0x7f78b8103920 2024-08-31T06:02:15.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.132+0000 7f78bfd43640 1 -- 172.21.15.53:0/4268331138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b81a8c00 con 0x7f78b8103920 2024-08-31T06:02:15.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.133+0000 7f78bfd43640 1 -- 172.21.15.53:0/4268331138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b8103d30 con 0x7f78b8103920 2024-08-31T06:02:15.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.135+0000 7f78aeffd640 1 -- 172.21.15.53:0/4268331138 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f78b4005000 con 0x7f78b8103920 2024-08-31T06:02:15.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.136+0000 7f78aeffd640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f78a40b4b80 0x7f78a40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:15.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.136+0000 7f78bd2de640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f78a40b4b80 0x7f78a40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:15.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.136+0000 7f78aeffd640 1 -- 172.21.15.53:0/4268331138 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7f78b40e4e90 con 0x7f78b8103920 2024-08-31T06:02:15.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.137+0000 7f78bd2de640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f78a40b4b80 0x7f78a40b7090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f78a8005940 tx=0x7f78a80058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:15.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.140+0000 7f78aeffd640 1 -- 172.21.15.53:0/4268331138 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f78b4014030 con 0x7f78b8103920 2024-08-31T06:02:15.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.371+0000 7f78bfd43640 1 -- 172.21.15.53:0/4268331138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78b80767b0 con 0x7f78b8103920 2024-08-31T06:02:15.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.372+0000 7f78aeffd640 1 -- 172.21.15.53:0/4268331138 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8881 (secure 0 0 0) 0x7f78b40abd20 con 0x7f78b8103920 2024-08-31T06:02:15.374 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:15.374 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":11,"btime":"2024-08-31T06:02:14:892225+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14829,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24613,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24619,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24632,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24640,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-31T06:02:15.374 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 11 2024-08-31T06:02:15.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 -- 172.21.15.53:0/4268331138 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f78a40b4b80 msgr2=0x7f78a40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:15.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f78a40b4b80 0x7f78a40b7090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f78a8005940 tx=0x7f78a80058d0 comp rx=0 tx=0).stop 2024-08-31T06:02:15.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 -- 172.21.15.53:0/4268331138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b8103920 msgr2=0x7f78b80754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b8103920 0x7f78b80754b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c970 tx=0x7f78b400ce30 comp rx=0 tx=0).stop 2024-08-31T06:02:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 -- 172.21.15.53:0/4268331138 shutdown_connections 2024-08-31T06:02:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f78a40b4b80 0x7f78a40b7090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78b8109bb0 0x7f78b8075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78b8109260 0x7f78b80759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 --2- 172.21.15.53:0/4268331138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b8103920 0x7f78b80754b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 -- 172.21.15.53:0/4268331138 >> 172.21.15.53:0/4268331138 conn(0x7f78b80ff370 msgr2=0x7f78b8101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 -- 172.21.15.53:0/4268331138 shutdown_connections 2024-08-31T06:02:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:15.374+0000 7f78bfd43640 1 -- 172.21.15.53:0/4268331138 wait complete. 2024-08-31T06:02:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:15.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:15.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:15.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:15.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:15.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: Deploying daemon mds.a on smithi053 2024-08-31T06:02:15.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.53:6838/1079311184,v1:172.21.15.53:6839/1079311184] up:boot 2024-08-31T06:02:15.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: fsmap 10 up:standby 2024-08-31T06:02:15.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T06:02:15.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:15 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4268331138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: Deploying daemon mds.a on smithi053 2024-08-31T06:02:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.53:6838/1079311184,v1:172.21.15.53:6839/1079311184] up:boot 2024-08-31T06:02:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: fsmap 10 up:standby 2024-08-31T06:02:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T06:02:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:15 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4268331138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: Deploying daemon mds.a on smithi053 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.53:6838/1079311184,v1:172.21.15.53:6839/1079311184] up:boot 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: fsmap 10 up:standby 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T06:02:15.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:15 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4268331138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:17.603 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:02:17 smithi053 systemd[1]: Starting Ceph mds.a for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:02:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:17 smithi130 ceph-mon[22266]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:17.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:17 smithi053 ceph-mon[18924]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:17.921 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:02:17 smithi053 podman[64063]: 2024-08-31 06:02:17.56807907 +0000 UTC m=+0.015982245 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:02:17.921 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:02:17 smithi053 podman[64063]: 2024-08-31 06:02:17.70084124 +0000 UTC m=+0.148744418 container create a5e77ff2626b0e7b1eaf7b7a4e55a4c3d398292379e78fd6cd8544c35a9dab89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:02:17.921 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:02:17 smithi053 podman[64063]: 2024-08-31 06:02:17.919834881 +0000 UTC m=+0.367738059 container init a5e77ff2626b0e7b1eaf7b7a4e55a4c3d398292379e78fd6cd8544c35a9dab89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-31T06:02:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:17 smithi153 ceph-mon[22320]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:17.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:02:18.225 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:02:17 smithi053 podman[64063]: 2024-08-31 06:02:17.922789666 +0000 UTC m=+0.370692848 container start a5e77ff2626b0e7b1eaf7b7a4e55a4c3d398292379e78fd6cd8544c35a9dab89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-08-31T06:02:18.226 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:02:17 smithi053 ceph-mds[64082]: -- 172.21.15.53:0/410019408 <== mon.0 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617c2939860 con 0x5617c6adf600 2024-08-31T06:02:18.226 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:02:17 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a[64078]: starting mds.a at 2024-08-31T06:02:18.226 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:02:18 smithi053 bash[64063]: a5e77ff2626b0e7b1eaf7b7a4e55a4c3d398292379e78fd6cd8544c35a9dab89 2024-08-31T06:02:18.226 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:02:18 smithi053 systemd[1]: Started Ceph mds.a for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:02:18.248 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.746+0000 7fb62b8d2640 1 -- 172.21.15.53:0/1468978580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb624109310 msgr2=0x7fb624109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.746+0000 7fb62b8d2640 1 --2- 172.21.15.53:0/1468978580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb624109310 0x7fb624109720 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb614009900 tx=0x7fb61402a410 comp rx=0 tx=0).stop 2024-08-31T06:02:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.746+0000 7fb62b8d2640 1 -- 172.21.15.53:0/1468978580 shutdown_connections 2024-08-31T06:02:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.746+0000 7fb62b8d2640 1 --2- 172.21.15.53:0/1468978580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb624109c60 0x7fb624110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.746+0000 7fb62b8d2640 1 --2- 172.21.15.53:0/1468978580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb624109310 0x7fb624109720 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.746+0000 7fb62b8d2640 1 --2- 172.21.15.53:0/1468978580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6241039d0 0x7fb624103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.746+0000 7fb62b8d2640 1 -- 172.21.15.53:0/1468978580 >> 172.21.15.53:0/1468978580 conn(0x7fb62407b670 msgr2=0x7fb62407ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.746+0000 7fb62b8d2640 1 -- 172.21.15.53:0/1468978580 shutdown_connections 2024-08-31T06:02:18.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.746+0000 7fb62b8d2640 1 -- 172.21.15.53:0/1468978580 wait complete. 2024-08-31T06:02:18.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.747+0000 7fb62b8d2640 1 Processor -- start 2024-08-31T06:02:18.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.747+0000 7fb62b8d2640 1 -- start start 2024-08-31T06:02:18.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.747+0000 7fb62b8d2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6241039d0 0x7fb62419a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:18.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.747+0000 7fb62b8d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb624109310 0x7fb62419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:18.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.747+0000 7fb62b8d2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb624109c60 0x7fb62419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:18.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.747+0000 7fb62b8d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb624113730 con 0x7fb624109310 2024-08-31T06:02:18.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.747+0000 7fb62b8d2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb6241135b0 con 0x7fb624109c60 2024-08-31T06:02:18.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.747+0000 7fb62b8d2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb6241138b0 con 0x7fb6241039d0 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.747+0000 7fb628e6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb624109310 0x7fb62419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb628e6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb624109310 0x7fb62419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34096/0 (socket says 172.21.15.53:34096) 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb628e6d640 1 -- 172.21.15.53:0/3040049168 learned_addr learned my addr 172.21.15.53:0/3040049168 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb629e6f640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb624109c60 0x7fb62419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb62966e640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6241039d0 0x7fb62419a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb628e6d640 1 -- 172.21.15.53:0/3040049168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6241039d0 msgr2=0x7fb62419a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb628e6d640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6241039d0 0x7fb62419a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb628e6d640 1 -- 172.21.15.53:0/3040049168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb624109c60 msgr2=0x7fb62419f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb628e6d640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb624109c60 0x7fb62419f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb628e6d640 1 -- 172.21.15.53:0/3040049168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6241a00d0 con 0x7fb624109310 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb628e6d640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb624109310 0x7fb62419a700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb614004770 tx=0x7fb614004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb61a7fc640 1 -- 172.21.15.53:0/3040049168 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61403f030 con 0x7fb624109310 2024-08-31T06:02:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb62b8d2640 1 -- 172.21.15.53:0/3040049168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6241a0360 con 0x7fb624109310 2024-08-31T06:02:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb61a7fc640 1 -- 172.21.15.53:0/3040049168 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb614004440 con 0x7fb624109310 2024-08-31T06:02:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb61a7fc640 1 -- 172.21.15.53:0/3040049168 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614035070 con 0x7fb624109310 2024-08-31T06:02:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.748+0000 7fb62b8d2640 1 -- 172.21.15.53:0/3040049168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6241a6b20 con 0x7fb624109310 2024-08-31T06:02:18.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.750+0000 7fb62b8d2640 1 -- 172.21.15.53:0/3040049168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb624103de0 con 0x7fb624109310 2024-08-31T06:02:18.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.751+0000 7fb61a7fc640 1 -- 172.21.15.53:0/3040049168 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fb614042030 con 0x7fb624109310 2024-08-31T06:02:18.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.752+0000 7fb61a7fc640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6100b4c00 0x7fb6100b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:18.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.752+0000 7fb62966e640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6100b4c00 0x7fb6100b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:18.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.752+0000 7fb61a7fc640 1 -- 172.21.15.53:0/3040049168 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7fb6141055e0 con 0x7fb624109310 2024-08-31T06:02:18.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.753+0000 7fb62966e640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6100b4c00 0x7fb6100b7110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb620005fd0 tx=0x7fb620005e20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:18.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.755+0000 7fb61a7fc640 1 -- 172.21.15.53:0/3040049168 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb6140cca40 con 0x7fb624109310 2024-08-31T06:02:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.977+0000 7fb62b8d2640 1 -- 172.21.15.53:0/3040049168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb62419b290 con 0x7fb624109310 2024-08-31T06:02:18.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.978+0000 7fb61a7fc640 1 -- 172.21.15.53:0/3040049168 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9707 (secure 0 0 0) 0x7fb6140cc340 con 0x7fb624109310 2024-08-31T06:02:18.981 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:18.981 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":12,"btime":"2024-08-31T06:02:18:601768+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14829,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14841,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24613,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24619,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24632,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24640,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-31T06:02:18.981 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 12 2024-08-31T06:02:18.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.980+0000 7fb62b8d2640 1 -- 172.21.15.53:0/3040049168 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6100b4c00 msgr2=0x7fb6100b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:18.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.980+0000 7fb62b8d2640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6100b4c00 0x7fb6100b7110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb620005fd0 tx=0x7fb620005e20 comp rx=0 tx=0).stop 2024-08-31T06:02:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.980+0000 7fb62b8d2640 1 -- 172.21.15.53:0/3040049168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb624109310 msgr2=0x7fb62419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.980+0000 7fb62b8d2640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb624109310 0x7fb62419a700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb614004770 tx=0x7fb614004040 comp rx=0 tx=0).stop 2024-08-31T06:02:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.980+0000 7fb62b8d2640 1 -- 172.21.15.53:0/3040049168 shutdown_connections 2024-08-31T06:02:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.980+0000 7fb62b8d2640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6100b4c00 0x7fb6100b7110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.980+0000 7fb62b8d2640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb624109c60 0x7fb62419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.980+0000 7fb62b8d2640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb624109310 0x7fb62419a700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.980+0000 7fb62b8d2640 1 --2- 172.21.15.53:0/3040049168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6241039d0 0x7fb62419a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.980+0000 7fb62b8d2640 1 -- 172.21.15.53:0/3040049168 >> 172.21.15.53:0/3040049168 conn(0x7fb62407b670 msgr2=0x7fb624105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.981+0000 7fb62b8d2640 1 -- 172.21.15.53:0/3040049168 shutdown_connections 2024-08-31T06:02:18.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:18.981+0000 7fb62b8d2640 1 -- 172.21.15.53:0/3040049168 wait complete. 2024-08-31T06:02:19.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:19.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:19.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:19.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:19.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:19.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:19.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:19 smithi130 ceph-mon[22266]: Deploying daemon mds.b on smithi130 2024-08-31T06:02:19.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:19 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.53:6840/2812306532,v1:172.21.15.53:6841/2812306532] up:boot 2024-08-31T06:02:19.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:19 smithi130 ceph-mon[22266]: fsmap 11 up:standby 2024-08-31T06:02:19.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T06:02:19.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:19 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3040049168' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:19.381 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:19.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:19.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:19.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:19.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:19.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:19.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:19 smithi053 ceph-mon[18924]: Deploying daemon mds.b on smithi130 2024-08-31T06:02:19.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:19 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.53:6840/2812306532,v1:172.21.15.53:6841/2812306532] up:boot 2024-08-31T06:02:19.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:19 smithi053 ceph-mon[18924]: fsmap 11 up:standby 2024-08-31T06:02:19.407 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T06:02:19.407 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:19 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3040049168' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:19.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:19.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:19.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:19.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:02:19.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:02:19.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:19.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:19 smithi153 ceph-mon[22320]: Deploying daemon mds.b on smithi130 2024-08-31T06:02:19.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:19 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.53:6840/2812306532,v1:172.21.15.53:6841/2812306532] up:boot 2024-08-31T06:02:19.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:19 smithi153 ceph-mon[22320]: fsmap 11 up:standby 2024-08-31T06:02:19.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T06:02:19.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:19 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3040049168' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:20.204 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:20 smithi130 systemd[1]: Starting Ceph mds.b for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:02:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:20 smithi053 ceph-mon[18924]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:20.478 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:20 smithi130 ceph-mon[22266]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:20.479 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:20 smithi130 podman[53908]: 2024-08-31 06:02:20.166628603 +0000 UTC m=+0.015760547 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:02:20.479 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:20 smithi130 podman[53908]: 2024-08-31 06:02:20.295678112 +0000 UTC m=+0.144810054 container create a9e57cff43b68878e811b84a711a063f87da9d77135d9e9398ed8de7e8fdcfa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-31T06:02:20.479 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:20 smithi130 podman[53908]: 2024-08-31 06:02:20.477548621 +0000 UTC m=+0.326680562 container init a9e57cff43b68878e811b84a711a063f87da9d77135d9e9398ed8de7e8fdcfa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-31T06:02:20.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:20 smithi153 ceph-mon[22320]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:20.878 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:20 smithi130 podman[53908]: 2024-08-31 06:02:20.480399409 +0000 UTC m=+0.329531361 container start a9e57cff43b68878e811b84a711a063f87da9d77135d9e9398ed8de7e8fdcfa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-08-31T06:02:20.878 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:20 smithi130 ceph-mds[53928]: -- 172.21.15.130:0/12816866 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5613e14f9860 con 0x5613e569f600 2024-08-31T06:02:20.878 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:20 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: starting mds.b at 2024-08-31T06:02:20.878 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:20 smithi130 bash[53908]: a9e57cff43b68878e811b84a711a063f87da9d77135d9e9398ed8de7e8fdcfa7 2024-08-31T06:02:20.878 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:20 smithi130 systemd[1]: Started Ceph mds.b for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:02:21.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:02:21.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:21 smithi153 ceph-mon[22320]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:21.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:21.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:21.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:21.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:21.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:21.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:02:21.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:21 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] up:boot 2024-08-31T06:02:21.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:21 smithi153 ceph-mon[22320]: fsmap 12 up:standby 2024-08-31T06:02:21.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:02:21.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:21 smithi053 ceph-mon[18924]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:02:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:21 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] up:boot 2024-08-31T06:02:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:21 smithi053 ceph-mon[18924]: fsmap 12 up:standby 2024-08-31T06:02:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:02:22.004 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:21 smithi130 ceph-mon[22266]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:02:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:21 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] up:boot 2024-08-31T06:02:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:21 smithi130 ceph-mon[22266]: fsmap 12 up:standby 2024-08-31T06:02:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:02:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.518+0000 7f0fa40f3640 1 -- 172.21.15.53:0/850595972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f9c103900 msgr2=0x7f0f9c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.518+0000 7f0fa40f3640 1 --2- 172.21.15.53:0/850595972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f9c103900 0x7f0f9c103d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009900 tx=0x7f0f9402a410 comp rx=0 tx=0).stop 2024-08-31T06:02:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.518+0000 7f0fa40f3640 1 -- 172.21.15.53:0/850595972 shutdown_connections 2024-08-31T06:02:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.518+0000 7f0fa40f3640 1 --2- 172.21.15.53:0/850595972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f9c109b90 0x7f0f9c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.518+0000 7f0fa40f3640 1 --2- 172.21.15.53:0/850595972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f9c109240 0x7f0f9c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.518+0000 7f0fa40f3640 1 --2- 172.21.15.53:0/850595972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f9c103900 0x7f0f9c103d10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.518+0000 7f0fa40f3640 1 -- 172.21.15.53:0/850595972 >> 172.21.15.53:0/850595972 conn(0x7f0f9c07b5f0 msgr2=0x7f0f9c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.518+0000 7f0fa40f3640 1 -- 172.21.15.53:0/850595972 shutdown_connections 2024-08-31T06:02:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.518+0000 7f0fa40f3640 1 -- 172.21.15.53:0/850595972 wait complete. 2024-08-31T06:02:22.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.519+0000 7f0fa40f3640 1 Processor -- start 2024-08-31T06:02:22.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.519+0000 7f0fa40f3640 1 -- start start 2024-08-31T06:02:22.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.519+0000 7f0fa40f3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f9c103900 0x7f0f9c19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:22.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.519+0000 7f0fa40f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f9c109240 0x7f0f9c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:22.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.519+0000 7f0fa40f3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f9c109b90 0x7f0f9c19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:22.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.519+0000 7f0fa40f3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c113700 con 0x7f0f9c109240 2024-08-31T06:02:22.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.519+0000 7f0fa40f3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c113580 con 0x7f0f9c109b90 2024-08-31T06:02:22.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.519+0000 7f0fa40f3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c113880 con 0x7f0f9c103900 2024-08-31T06:02:22.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.519+0000 7f0fa168e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f9c109240 0x7f0f9c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:22.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.519+0000 7f0fa168e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f9c109240 0x7f0f9c19a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34114/0 (socket says 172.21.15.53:34114) 2024-08-31T06:02:22.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.519+0000 7f0fa168e640 1 -- 172.21.15.53:0/3486636437 learned_addr learned my addr 172.21.15.53:0/3486636437 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:22.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0fa1e8f640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f9c103900 0x7f0f9c19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:22.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0fa2690640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f9c109b90 0x7f0f9c19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:22.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0fa168e640 1 -- 172.21.15.53:0/3486636437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f9c103900 msgr2=0x7f0f9c19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:22.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0fa168e640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f9c103900 0x7f0f9c19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:22.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0fa168e640 1 -- 172.21.15.53:0/3486636437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f9c109b90 msgr2=0x7f0f9c19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:22.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0fa168e640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f9c109b90 0x7f0f9c19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:22.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0fa168e640 1 -- 172.21.15.53:0/3486636437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c1a0080 con 0x7f0f9c109240 2024-08-31T06:02:22.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0fa2690640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f9c109b90 0x7f0f9c19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:02:22.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0fa168e640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f9c109240 0x7f0f9c19a770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000e9c0 tx=0x7f0f9000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:22.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0f9affd640 1 -- 172.21.15.53:0/3486636437 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9000ccc0 con 0x7f0f9c109240 2024-08-31T06:02:22.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0fa40f3640 1 -- 172.21.15.53:0/3486636437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9c1a0370 con 0x7f0f9c109240 2024-08-31T06:02:22.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0f9affd640 1 -- 172.21.15.53:0/3486636437 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f900054b0 con 0x7f0f9c109240 2024-08-31T06:02:22.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0f9affd640 1 -- 172.21.15.53:0/3486636437 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f90010430 con 0x7f0f9c109240 2024-08-31T06:02:22.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.520+0000 7f0fa40f3640 1 -- 172.21.15.53:0/3486636437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9c1a6b90 con 0x7f0f9c109240 2024-08-31T06:02:22.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.521+0000 7f0fa40f3640 1 -- 172.21.15.53:0/3486636437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f9c103d10 con 0x7f0f9c109240 2024-08-31T06:02:22.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.523+0000 7f0f9affd640 1 -- 172.21.15.53:0/3486636437 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f0f90004ee0 con 0x7f0f9c109240 2024-08-31T06:02:22.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.524+0000 7f0f9affd640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0f840b4bb0 0x7f0f840b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:22.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.524+0000 7f0fa1e8f640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0f840b4bb0 0x7f0f840b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:22.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.524+0000 7f0f9affd640 1 -- 172.21.15.53:0/3486636437 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7f0f900e53d0 con 0x7f0f9c109240 2024-08-31T06:02:22.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.524+0000 7f0fa1e8f640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0f840b4bb0 0x7f0f840b70c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0f940057c0 tx=0x7f0f940058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:22.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.527+0000 7f0f9affd640 1 -- 172.21.15.53:0/3486636437 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0f90056130 con 0x7f0f9c109240 2024-08-31T06:02:22.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.795+0000 7f0fa40f3640 1 -- 172.21.15.53:0/3486636437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f9c19b300 con 0x7f0f9c109240 2024-08-31T06:02:22.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.795+0000 7f0f9affd640 1 -- 172.21.15.53:0/3486636437 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10536 (secure 0 0 0) 0x7f0f9c19b300 con 0x7f0f9c109240 2024-08-31T06:02:22.799 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:22.799 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"btime":"2024-08-31T06:02:21:202408+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14829,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14841,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24613,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24619,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24632,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24640,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24668,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-08-31T06:02:22.799 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2024-08-31T06:02:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 -- 172.21.15.53:0/3486636437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0f840b4bb0 msgr2=0x7f0f840b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0f840b4bb0 0x7f0f840b70c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0f940057c0 tx=0x7f0f940058d0 comp rx=0 tx=0).stop 2024-08-31T06:02:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 -- 172.21.15.53:0/3486636437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f9c109240 msgr2=0x7f0f9c19a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f9c109240 0x7f0f9c19a770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000e9c0 tx=0x7f0f9000ee80 comp rx=0 tx=0).stop 2024-08-31T06:02:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 -- 172.21.15.53:0/3486636437 shutdown_connections 2024-08-31T06:02:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0f840b4bb0 0x7f0f840b70c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f9c109b90 0x7f0f9c19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f9c109240 0x7f0f9c19a770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 --2- 172.21.15.53:0/3486636437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f9c103900 0x7f0f9c19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 -- 172.21.15.53:0/3486636437 >> 172.21.15.53:0/3486636437 conn(0x7f0f9c07b5f0 msgr2=0x7f0f9c1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 -- 172.21.15.53:0/3486636437 shutdown_connections 2024-08-31T06:02:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:22.798+0000 7f0fa40f3640 1 -- 172.21.15.53:0/3486636437 wait complete. 2024-08-31T06:02:23.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:23 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:23 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3486636437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:23.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:23 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:23 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3486636437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:23.459 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.460 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.460 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.460 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.460 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.460 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:23 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:23.460 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:23 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3486636437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:23.492 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-31T06:02:24.274 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:24.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:24 smithi130 ceph-mon[22266]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:24.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:24 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:24.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:24 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:02:24.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:24 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:24.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:24 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:02:24.388 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:24 smithi053 ceph-mon[18924]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:24.388 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:24 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:24.389 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:24 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:02:24.389 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:24 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:24.389 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:24 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:02:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:24 smithi153 ceph-mon[22320]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:24 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:24 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:02:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:24 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:24.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:24 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:02:24.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.746+0000 7f935130b640 1 -- 172.21.15.53:0/1072566670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f934c108160 msgr2=0x7f934c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:24.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.746+0000 7f935130b640 1 --2- 172.21.15.53:0/1072566670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f934c108160 0x7f934c108570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9340009900 tx=0x7f934002a410 comp rx=0 tx=0).stop 2024-08-31T06:02:24.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.746+0000 7f935130b640 1 -- 172.21.15.53:0/1072566670 shutdown_connections 2024-08-31T06:02:24.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.746+0000 7f935130b640 1 --2- 172.21.15.53:0/1072566670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f934c108ab0 0x7f934c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:24.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.746+0000 7f935130b640 1 --2- 172.21.15.53:0/1072566670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f934c108160 0x7f934c108570 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:24.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.746+0000 7f935130b640 1 --2- 172.21.15.53:0/1072566670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f934c102820 0x7f934c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.746+0000 7f935130b640 1 -- 172.21.15.53:0/1072566670 >> 172.21.15.53:0/1072566670 conn(0x7f934c0794e0 msgr2=0x7f934c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.746+0000 7f935130b640 1 -- 172.21.15.53:0/1072566670 shutdown_connections 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.746+0000 7f935130b640 1 -- 172.21.15.53:0/1072566670 wait complete. 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f935130b640 1 Processor -- start 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f935130b640 1 -- start start 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f935130b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f934c102820 0x7f934c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f935130b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f934c108160 0x7f934c19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f935130b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f934c108ab0 0x7f934c19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f935130b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f934c112620 con 0x7f934c108ab0 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f935130b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1124a0 con 0x7f934c108160 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f935130b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1127a0 con 0x7f934c102820 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f934b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f934c108ab0 0x7f934c19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:24.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f934a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f934c108160 0x7f934c19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f934b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f934c108ab0 0x7f934c19fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53910/0 (socket says 172.21.15.53:53910) 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f934b7fe640 1 -- 172.21.15.53:0/3613204320 learned_addr learned my addr 172.21.15.53:0/3613204320 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f934a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f934c108160 0x7f934c19a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39980/0 (socket says 172.21.15.53:39980) 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.747+0000 7f934affd640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f934c102820 0x7f934c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f934b7fe640 1 -- 172.21.15.53:0/3613204320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f934c102820 msgr2=0x7f934c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f934b7fe640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f934c102820 0x7f934c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f934b7fe640 1 -- 172.21.15.53:0/3613204320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f934c108160 msgr2=0x7f934c19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f934b7fe640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f934c108160 0x7f934c19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f934b7fe640 1 -- 172.21.15.53:0/3613204320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c1a01f0 con 0x7f934c108ab0 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f934a7fc640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f934c108160 0x7f934c19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f934b7fe640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f934c108ab0 0x7f934c19fac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f934400eaa0 tx=0x7f934400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f9333fff640 1 -- 172.21.15.53:0/3613204320 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934400cdb0 con 0x7f934c108ab0 2024-08-31T06:02:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f935130b640 1 -- 172.21.15.53:0/3613204320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c1a04e0 con 0x7f934c108ab0 2024-08-31T06:02:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f9333fff640 1 -- 172.21.15.53:0/3613204320 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9344005020 con 0x7f934c108ab0 2024-08-31T06:02:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f9333fff640 1 -- 172.21.15.53:0/3613204320 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93440116d0 con 0x7f934c108ab0 2024-08-31T06:02:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.748+0000 7f935130b640 1 -- 172.21.15.53:0/3613204320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c1a6c40 con 0x7f934c108ab0 2024-08-31T06:02:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.749+0000 7f935130b640 1 -- 172.21.15.53:0/3613204320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934c103aa0 con 0x7f934c108ab0 2024-08-31T06:02:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.751+0000 7f9333fff640 1 -- 172.21.15.53:0/3613204320 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f9344004a40 con 0x7f934c108ab0 2024-08-31T06:02:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.751+0000 7f9333fff640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f93340b4b80 0x7f93340b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.752+0000 7f934affd640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f93340b4b80 0x7f93340b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.752+0000 7f9333fff640 1 -- 172.21.15.53:0/3613204320 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7f93440e5240 con 0x7f934c108ab0 2024-08-31T06:02:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.752+0000 7f934affd640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f93340b4b80 0x7f93340b7090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f933c0058c0 tx=0x7f933c00a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.755+0000 7f9333fff640 1 -- 172.21.15.53:0/3613204320 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9344016030 con 0x7f934c108ab0 2024-08-31T06:02:24.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.969+0000 7f935130b640 1 -- 172.21.15.53:0/3613204320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f934c102c30 con 0x7f934c108ab0 2024-08-31T06:02:24.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.970+0000 7f9333fff640 1 -- 172.21.15.53:0/3613204320 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) ==== 84+0+65 (secure 0 0 0) 0x7f934c102c30 con 0x7f934c108ab0 2024-08-31T06:02:24.973 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:24.973 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-08-31T06:02:24.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:02:24.974 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-08-31T06:02:24.974 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-08-31T06:02:24.974 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:02:24.974 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-08-31T06:02:24.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.972+0000 7f935130b640 1 -- 172.21.15.53:0/3613204320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f93340b4b80 msgr2=0x7f93340b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:24.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.972+0000 7f935130b640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f93340b4b80 0x7f93340b7090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f933c0058c0 tx=0x7f933c00a250 comp rx=0 tx=0).stop 2024-08-31T06:02:24.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.972+0000 7f935130b640 1 -- 172.21.15.53:0/3613204320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f934c108ab0 msgr2=0x7f934c19fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:24.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.972+0000 7f935130b640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f934c108ab0 0x7f934c19fac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f934400eaa0 tx=0x7f934400ef60 comp rx=0 tx=0).stop 2024-08-31T06:02:24.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.973+0000 7f935130b640 1 -- 172.21.15.53:0/3613204320 shutdown_connections 2024-08-31T06:02:24.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.973+0000 7f935130b640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f93340b4b80 0x7f93340b7090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:24.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.973+0000 7f935130b640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f934c108ab0 0x7f934c19fac0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:24.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.973+0000 7f935130b640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f934c108160 0x7f934c19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:24.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.973+0000 7f935130b640 1 --2- 172.21.15.53:0/3613204320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f934c102820 0x7f934c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:24.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.973+0000 7f935130b640 1 -- 172.21.15.53:0/3613204320 >> 172.21.15.53:0/3613204320 conn(0x7f934c0794e0 msgr2=0x7f934c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:24.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.973+0000 7f935130b640 1 -- 172.21.15.53:0/3613204320 shutdown_connections 2024-08-31T06:02:24.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:24.973+0000 7f935130b640 1 -- 172.21.15.53:0/3613204320 wait complete. 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3613204320' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:02:25.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.657 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-31T06:02:25.658 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-31T06:02:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3613204320' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T06:02:25.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:25.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:02:25.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.910 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3613204320' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T06:02:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:02:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:02:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:02:26.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.399+0000 7f1f25633640 1 -- 172.21.15.53:0/1363615123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f20103910 msgr2=0x7f1f20103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:26.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.399+0000 7f1f25633640 1 --2- 172.21.15.53:0/1363615123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f20103910 0x7f1f20103d20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009900 tx=0x7f1f1002a410 comp rx=0 tx=0).stop 2024-08-31T06:02:26.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.399+0000 7f1f25633640 1 -- 172.21.15.53:0/1363615123 shutdown_connections 2024-08-31T06:02:26.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.399+0000 7f1f25633640 1 --2- 172.21.15.53:0/1363615123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f20109ba0 0x7f1f201103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:26.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.399+0000 7f1f25633640 1 --2- 172.21.15.53:0/1363615123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f20109250 0x7f1f20109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:26.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.399+0000 7f1f25633640 1 --2- 172.21.15.53:0/1363615123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f20103910 0x7f1f20103d20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:26.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.399+0000 7f1f25633640 1 -- 172.21.15.53:0/1363615123 >> 172.21.15.53:0/1363615123 conn(0x7f1f200ff380 msgr2=0x7f1f201017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:26.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.399+0000 7f1f25633640 1 -- 172.21.15.53:0/1363615123 shutdown_connections 2024-08-31T06:02:26.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.399+0000 7f1f25633640 1 -- 172.21.15.53:0/1363615123 wait complete. 2024-08-31T06:02:26.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.399+0000 7f1f25633640 1 Processor -- start 2024-08-31T06:02:26.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f25633640 1 -- start start 2024-08-31T06:02:26.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f25633640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f20103910 0x7f1f2019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:26.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f25633640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f20109250 0x7f1f2019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:26.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f25633640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f20109ba0 0x7f1f2019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:26.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f25633640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1f20113710 con 0x7f1f20109ba0 2024-08-31T06:02:26.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f25633640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f20113590 con 0x7f1f20103910 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f25633640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1f20113890 con 0x7f1f20109250 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f20109ba0 0x7f1f2019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f20109ba0 0x7f1f2019fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53922/0 (socket says 172.21.15.53:53922) 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f1f7fe640 1 -- 172.21.15.53:0/3254348285 learned_addr learned my addr 172.21.15.53:0/3254348285 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f1effd640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f20103910 0x7f1f2019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f1e7fc640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f20109250 0x7f1f2019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f1f7fe640 1 -- 172.21.15.53:0/3254348285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f20109250 msgr2=0x7f1f2019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f1f7fe640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f20109250 0x7f1f2019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f1f7fe640 1 -- 172.21.15.53:0/3254348285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f20103910 msgr2=0x7f1f2019a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f1f7fe640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f20103910 0x7f1f2019a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.400+0000 7f1f1f7fe640 1 -- 172.21.15.53:0/3254348285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f201a0070 con 0x7f1f20109ba0 2024-08-31T06:02:26.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.401+0000 7f1f1f7fe640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f20109ba0 0x7f1f2019fa00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800cce0 tx=0x7f1f1800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:26.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.401+0000 7f1f07fff640 1 -- 172.21.15.53:0/3254348285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800f450 con 0x7f1f20109ba0 2024-08-31T06:02:26.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.401+0000 7f1f25633640 1 -- 172.21.15.53:0/3254348285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f201a0360 con 0x7f1f20109ba0 2024-08-31T06:02:26.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.401+0000 7f1f07fff640 1 -- 172.21.15.53:0/3254348285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f1800fa80 con 0x7f1f20109ba0 2024-08-31T06:02:26.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.401+0000 7f1f07fff640 1 -- 172.21.15.53:0/3254348285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18018ad0 con 0x7f1f20109ba0 2024-08-31T06:02:26.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.401+0000 7f1f25633640 1 -- 172.21.15.53:0/3254348285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f201a6b80 con 0x7f1f20109ba0 2024-08-31T06:02:26.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.402+0000 7f1f25633640 1 -- 172.21.15.53:0/3254348285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f20103d20 con 0x7f1f20109ba0 2024-08-31T06:02:26.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.404+0000 7f1f07fff640 1 -- 172.21.15.53:0/3254348285 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f1f1800f5f0 con 0x7f1f20109ba0 2024-08-31T06:02:26.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.404+0000 7f1f07fff640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f080b4bb0 0x7f1f080b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:26.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.404+0000 7f1f1effd640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f080b4bb0 0x7f1f080b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:26.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.404+0000 7f1f07fff640 1 -- 172.21.15.53:0/3254348285 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7342+0+0 (secure 0 0 0) 0x7f1f180e5640 con 0x7f1f20109ba0 2024-08-31T06:02:26.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.405+0000 7f1f1effd640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f080b4bb0 0x7f1f080b70c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1f100057c0 tx=0x7f1f100058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:26.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.407+0000 7f1f07fff640 1 -- 172.21.15.53:0/3254348285 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1f18014030 con 0x7f1f20109ba0 2024-08-31T06:02:26.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:26.597+0000 7f1f25633640 1 -- 172.21.15.53:0/3254348285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1f2019b2f0 con 0x7f1f20109ba0 2024-08-31T06:02:27.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.566+0000 7f1f07fff640 1 -- 172.21.15.53:0/3254348285 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) ==== 138+0+0 (secure 0 0 0) 0x7f1f2019b2f0 con 0x7f1f20109ba0 2024-08-31T06:02:27.569 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-08-31T06:02:27.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 -- 172.21.15.53:0/3254348285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f080b4bb0 msgr2=0x7f1f080b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:27.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f080b4bb0 0x7f1f080b70c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1f100057c0 tx=0x7f1f100058d0 comp rx=0 tx=0).stop 2024-08-31T06:02:27.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 -- 172.21.15.53:0/3254348285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f20109ba0 msgr2=0x7f1f2019fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:27.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f20109ba0 0x7f1f2019fa00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800cce0 tx=0x7f1f1800a620 comp rx=0 tx=0).stop 2024-08-31T06:02:27.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 -- 172.21.15.53:0/3254348285 shutdown_connections 2024-08-31T06:02:27.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f080b4bb0 0x7f1f080b70c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:27.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f20109ba0 0x7f1f2019fa00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:27.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f20109250 0x7f1f2019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:27.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 --2- 172.21.15.53:0/3254348285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f20103910 0x7f1f2019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:27.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 -- 172.21.15.53:0/3254348285 >> 172.21.15.53:0/3254348285 conn(0x7f1f200ff380 msgr2=0x7f1f201017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:27.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 -- 172.21.15.53:0/3254348285 shutdown_connections 2024-08-31T06:02:27.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:27.569+0000 7f1f25633640 1 -- 172.21.15.53:0/3254348285 wait complete. 2024-08-31T06:02:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:27 smithi130 ceph-mon[22266]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:27 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3254348285' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T06:02:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:27 smithi153 ceph-mon[22320]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:27 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3254348285' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T06:02:27.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:27 smithi053 ceph-mon[18924]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:27.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:27 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3254348285' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T06:02:28.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-31T06:02:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:28.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:28 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3254348285' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T06:02:28.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:28 smithi130 ceph-mon[22266]: osdmap e66: 12 total, 12 up, 12 in 2024-08-31T06:02:28.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:28 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3254348285' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T06:02:28.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:28 smithi153 ceph-mon[22320]: osdmap e66: 12 total, 12 up, 12 in 2024-08-31T06:02:28.939 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:28 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3254348285' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T06:02:28.939 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:28 smithi053 ceph-mon[18924]: osdmap e66: 12 total, 12 up, 12 in 2024-08-31T06:02:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.034+0000 7fee8059e640 1 -- 172.21.15.53:0/2986553999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee78108ab0 msgr2=0x7fee7810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.034+0000 7fee8059e640 1 --2- 172.21.15.53:0/2986553999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee78108ab0 0x7fee7810f2e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fee70009ca0 tx=0x7fee7002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:02:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.034+0000 7fee8059e640 1 -- 172.21.15.53:0/2986553999 shutdown_connections 2024-08-31T06:02:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.035+0000 7fee8059e640 1 --2- 172.21.15.53:0/2986553999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee78108ab0 0x7fee7810f2e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.035+0000 7fee8059e640 1 --2- 172.21.15.53:0/2986553999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78108160 0x7fee78108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.035+0000 7fee8059e640 1 --2- 172.21.15.53:0/2986553999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee78102820 0x7fee78102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.035+0000 7fee8059e640 1 -- 172.21.15.53:0/2986553999 >> 172.21.15.53:0/2986553999 conn(0x7fee780794e0 msgr2=0x7fee780798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.035+0000 7fee8059e640 1 -- 172.21.15.53:0/2986553999 shutdown_connections 2024-08-31T06:02:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.035+0000 7fee8059e640 1 -- 172.21.15.53:0/2986553999 wait complete. 2024-08-31T06:02:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.035+0000 7fee8059e640 1 Processor -- start 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.035+0000 7fee8059e640 1 -- start start 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee8059e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee78102820 0x7fee7819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee8059e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee78108160 0x7fee7819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee8059e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78108ab0 0x7fee7819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee8059e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fee78112630 con 0x7fee78108160 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee8059e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fee781124b0 con 0x7fee78102820 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee8059e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fee781127b0 con 0x7fee78108ab0 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7db39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee78108160 0x7fee7819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7db39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee78108160 0x7fee7819b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53928/0 (socket says 172.21.15.53:53928) 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7db39640 1 -- 172.21.15.53:0/715498851 learned_addr learned my addr 172.21.15.53:0/715498851 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7e33a640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee78102820 0x7fee7819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7eb3b640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78108ab0 0x7fee7819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7db39640 1 -- 172.21.15.53:0/715498851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78108ab0 msgr2=0x7fee7819b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7db39640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78108ab0 0x7fee7819b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7db39640 1 -- 172.21.15.53:0/715498851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee78102820 msgr2=0x7fee7819af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7db39640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee78102820 0x7fee7819af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7db39640 1 -- 172.21.15.53:0/715498851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee781a61c0 con 0x7fee78108160 2024-08-31T06:02:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7e33a640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee78102820 0x7fee7819af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:02:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee7db39640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee78108160 0x7fee7819b440 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fee6800d740 tx=0x7fee6800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee6f7fe640 1 -- 172.21.15.53:0/715498851 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68017070 con 0x7fee78108160 2024-08-31T06:02:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.036+0000 7fee8059e640 1 -- 172.21.15.53:0/715498851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee781a64b0 con 0x7fee78108160 2024-08-31T06:02:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.037+0000 7fee6f7fe640 1 -- 172.21.15.53:0/715498851 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee6800de50 con 0x7fee78108160 2024-08-31T06:02:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.037+0000 7fee6f7fe640 1 -- 172.21.15.53:0/715498851 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68004c60 con 0x7fee78108160 2024-08-31T06:02:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.037+0000 7fee8059e640 1 -- 172.21.15.53:0/715498851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee781a69f0 con 0x7fee78108160 2024-08-31T06:02:29.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.038+0000 7fee6d7fa640 1 -- 172.21.15.53:0/715498851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee60005290 con 0x7fee78108160 2024-08-31T06:02:29.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.039+0000 7fee6f7fe640 1 -- 172.21.15.53:0/715498851 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fee68004e00 con 0x7fee78108160 2024-08-31T06:02:29.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.040+0000 7fee6f7fe640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee640b4b80 0x7fee640b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:29.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.040+0000 7fee7e33a640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee640b4b80 0x7fee640b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:29.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.040+0000 7fee6f7fe640 1 -- 172.21.15.53:0/715498851 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7712+0+0 (secure 0 0 0) 0x7fee680e4e80 con 0x7fee78108160 2024-08-31T06:02:29.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.041+0000 7fee7e33a640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee640b4b80 0x7fee640b7090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee7806c460 tx=0x7fee74005e70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:29.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.044+0000 7fee6f7fe640 1 -- 172.21.15.53:0/715498851 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fee680ac190 con 0x7fee78108160 2024-08-31T06:02:29.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.232+0000 7fee6d7fa640 1 -- 172.21.15.53:0/715498851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fee60005580 con 0x7fee78108160 2024-08-31T06:02:29.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.577+0000 7fee6f7fe640 1 -- 172.21.15.53:0/715498851 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v68) ==== 170+0+0 (secure 0 0 0) 0x7fee680a7020 con 0x7fee78108160 2024-08-31T06:02:29.580 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-08-31T06:02:29.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 -- 172.21.15.53:0/715498851 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee640b4b80 msgr2=0x7fee640b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:29.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee640b4b80 0x7fee640b7090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee7806c460 tx=0x7fee74005e70 comp rx=0 tx=0).stop 2024-08-31T06:02:29.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 -- 172.21.15.53:0/715498851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee78108160 msgr2=0x7fee7819b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:29.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee78108160 0x7fee7819b440 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fee6800d740 tx=0x7fee6800dc00 comp rx=0 tx=0).stop 2024-08-31T06:02:29.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 -- 172.21.15.53:0/715498851 shutdown_connections 2024-08-31T06:02:29.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee640b4b80 0x7fee640b7090 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:29.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee78108ab0 0x7fee7819b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:29.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee78108160 0x7fee7819b440 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:29.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 --2- 172.21.15.53:0/715498851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee78102820 0x7fee7819af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:29.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 -- 172.21.15.53:0/715498851 >> 172.21.15.53:0/715498851 conn(0x7fee780794e0 msgr2=0x7fee78105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:29.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 -- 172.21.15.53:0/715498851 shutdown_connections 2024-08-31T06:02:29.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:29.580+0000 7fee6d7fa640 1 -- 172.21.15.53:0/715498851 wait complete. 2024-08-31T06:02:29.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:29 smithi130 ceph-mon[22266]: pgmap v241: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:29.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:29 smithi130 ceph-mon[22266]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T06:02:29.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:29 smithi130 ceph-mon[22266]: osdmap e67: 12 total, 12 up, 12 in 2024-08-31T06:02:29.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:29 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/715498851' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T06:02:29.911 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:29 smithi053 ceph-mon[18924]: pgmap v241: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:29.911 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:29 smithi053 ceph-mon[18924]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T06:02:29.911 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:29 smithi053 ceph-mon[18924]: osdmap e67: 12 total, 12 up, 12 in 2024-08-31T06:02:29.911 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:29 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/715498851' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T06:02:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:29 smithi153 ceph-mon[22320]: pgmap v241: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:29 smithi153 ceph-mon[22320]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T06:02:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:29 smithi153 ceph-mon[22320]: osdmap e67: 12 total, 12 up, 12 in 2024-08-31T06:02:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:29 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/715498851' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T06:02:30.201 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-31T06:02:30.460 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:30.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:30 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/715498851' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T06:02:30.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:30 smithi130 ceph-mon[22266]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T06:02:30.905 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:30 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/715498851' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T06:02:30.906 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:30 smithi053 ceph-mon[18924]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T06:02:30.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:30 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/715498851' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T06:02:30.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:30 smithi153 ceph-mon[22320]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T06:02:30.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.997+0000 7ff2516c6640 1 -- 172.21.15.53:0/3529773806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff24c108aa0 msgr2=0x7ff24c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:30.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.997+0000 7ff2516c6640 1 --2- 172.21.15.53:0/3529773806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff24c108aa0 0x7ff24c10f2d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff244009900 tx=0x7ff24402a410 comp rx=0 tx=0).stop 2024-08-31T06:02:30.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.997+0000 7ff2516c6640 1 -- 172.21.15.53:0/3529773806 shutdown_connections 2024-08-31T06:02:30.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.997+0000 7ff2516c6640 1 --2- 172.21.15.53:0/3529773806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff24c108aa0 0x7ff24c10f2d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:30.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.997+0000 7ff2516c6640 1 --2- 172.21.15.53:0/3529773806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff24c108150 0x7ff24c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:30.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.997+0000 7ff2516c6640 1 --2- 172.21.15.53:0/3529773806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c102810 0x7ff24c102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:31.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.997+0000 7ff2516c6640 1 -- 172.21.15.53:0/3529773806 >> 172.21.15.53:0/3529773806 conn(0x7ff24c0794d0 msgr2=0x7ff24c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:31.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.997+0000 7ff2516c6640 1 -- 172.21.15.53:0/3529773806 shutdown_connections 2024-08-31T06:02:31.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.997+0000 7ff2516c6640 1 -- 172.21.15.53:0/3529773806 wait complete. 2024-08-31T06:02:31.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.997+0000 7ff2516c6640 1 Processor -- start 2024-08-31T06:02:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff2516c6640 1 -- start start 2024-08-31T06:02:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff2516c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c102810 0x7ff24c19a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff2516c6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff24c108150 0x7ff24c19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff2516c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff24c108aa0 0x7ff24c19f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff2516c6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c1125d0 con 0x7ff24c108aa0 2024-08-31T06:02:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff2516c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c112450 con 0x7ff24c102810 2024-08-31T06:02:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff2516c6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c112750 con 0x7ff24c108150 2024-08-31T06:02:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff24c108aa0 0x7ff24c19f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24a7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff24c108150 0x7ff24c19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff24c108aa0 0x7ff24c19f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53948/0 (socket says 172.21.15.53:53948) 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24b7fe640 1 -- 172.21.15.53:0/1436626738 learned_addr learned my addr 172.21.15.53:0/1436626738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24affd640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c102810 0x7ff24c19a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24b7fe640 1 -- 172.21.15.53:0/1436626738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff24c108150 msgr2=0x7ff24c19a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24b7fe640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff24c108150 0x7ff24c19a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24b7fe640 1 -- 172.21.15.53:0/1436626738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c102810 msgr2=0x7ff24c19a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24b7fe640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c102810 0x7ff24c19a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24b7fe640 1 -- 172.21.15.53:0/1436626738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24c1a0100 con 0x7ff24c108aa0 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24a7fc640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff24c108150 0x7ff24c19a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.998+0000 7ff24affd640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c102810 0x7ff24c19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.999+0000 7ff24b7fe640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff24c108aa0 0x7ff24c19f9d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff244005ab0 tx=0x7ff244005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.999+0000 7ff233fff640 1 -- 172.21.15.53:0/1436626738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24403f030 con 0x7ff24c108aa0 2024-08-31T06:02:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.999+0000 7ff2516c6640 1 -- 172.21.15.53:0/1436626738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24c1a0390 con 0x7ff24c108aa0 2024-08-31T06:02:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.999+0000 7ff233fff640 1 -- 172.21.15.53:0/1436626738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2440043d0 con 0x7ff24c108aa0 2024-08-31T06:02:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.999+0000 7ff233fff640 1 -- 172.21.15.53:0/1436626738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff244035070 con 0x7ff24c108aa0 2024-08-31T06:02:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:30.999+0000 7ff2516c6640 1 -- 172.21.15.53:0/1436626738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff24c1a6b50 con 0x7ff24c108aa0 2024-08-31T06:02:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.000+0000 7ff2516c6640 1 -- 172.21.15.53:0/1436626738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff24c103a90 con 0x7ff24c108aa0 2024-08-31T06:02:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.003+0000 7ff233fff640 1 -- 172.21.15.53:0/1436626738 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7ff244042030 con 0x7ff24c108aa0 2024-08-31T06:02:31.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.003+0000 7ff233fff640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2340b4b80 0x7ff2340b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:31.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.003+0000 7ff24affd640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2340b4b80 0x7ff2340b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:31.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.004+0000 7ff233fff640 1 -- 172.21.15.53:0/1436626738 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 8094+0+0 (secure 0 0 0) 0x7ff2441057b0 con 0x7ff24c108aa0 2024-08-31T06:02:31.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.004+0000 7ff24affd640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2340b4b80 0x7ff2340b7090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff23c005fd0 tx=0x7ff23c009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.007+0000 7ff233fff640 1 -- 172.21.15.53:0/1436626738 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff2440cc370 con 0x7ff24c108aa0 2024-08-31T06:02:31.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.232+0000 7ff2516c6640 1 -- 172.21.15.53:0/1436626738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff24c102c20 con 0x7ff24c108aa0 2024-08-31T06:02:31.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.592+0000 7ff233fff640 1 -- 172.21.15.53:0/1436626738 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7ff2440d0b30 con 0x7ff24c108aa0 2024-08-31T06:02:31.595 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 2 and data pool 3 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.596+0000 7ff2516c6640 1 -- 172.21.15.53:0/1436626738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2340b4b80 msgr2=0x7ff2340b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.596+0000 7ff2516c6640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2340b4b80 0x7ff2340b7090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff23c005fd0 tx=0x7ff23c009500 comp rx=0 tx=0).stop 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.596+0000 7ff2516c6640 1 -- 172.21.15.53:0/1436626738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff24c108aa0 msgr2=0x7ff24c19f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.596+0000 7ff2516c6640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff24c108aa0 0x7ff24c19f9d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff244005ab0 tx=0x7ff244005e10 comp rx=0 tx=0).stop 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.596+0000 7ff2516c6640 1 -- 172.21.15.53:0/1436626738 shutdown_connections 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.596+0000 7ff2516c6640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2340b4b80 0x7ff2340b7090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.596+0000 7ff2516c6640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff24c108aa0 0x7ff24c19f9d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.596+0000 7ff2516c6640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff24c108150 0x7ff24c19a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.596+0000 7ff2516c6640 1 --2- 172.21.15.53:0/1436626738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24c102810 0x7ff24c19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.596+0000 7ff2516c6640 1 -- 172.21.15.53:0/1436626738 >> 172.21.15.53:0/1436626738 conn(0x7ff24c0794d0 msgr2=0x7ff24c0ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.597+0000 7ff2516c6640 1 -- 172.21.15.53:0/1436626738 shutdown_connections 2024-08-31T06:02:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:31.597+0000 7ff2516c6640 1 -- 172.21.15.53:0/1436626738 wait complete. 2024-08-31T06:02:31.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:31 smithi130 ceph-mon[22266]: pgmap v244: 97 pgs: 1 creating+activating, 30 creating+peering, 47 unknown, 19 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:31.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:31 smithi130 ceph-mon[22266]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T06:02:31.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:31 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1436626738' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T06:02:31.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:31 smithi130 ceph-mon[22266]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T06:02:31.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:31 smithi053 ceph-mon[18924]: pgmap v244: 97 pgs: 1 creating+activating, 30 creating+peering, 47 unknown, 19 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:31.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:31 smithi053 ceph-mon[18924]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T06:02:31.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:31 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1436626738' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T06:02:31.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:31 smithi053 ceph-mon[18924]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T06:02:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:31 smithi153 ceph-mon[22320]: pgmap v244: 97 pgs: 1 creating+activating, 30 creating+peering, 47 unknown, 19 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:02:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:31 smithi153 ceph-mon[22320]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T06:02:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:31 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1436626738' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T06:02:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:31 smithi153 ceph-mon[22320]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T06:02:32.251 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:02:32.508 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:32.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:32 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1436626738' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T06:02:32.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:32 smithi130 ceph-mon[22266]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T06:02:32.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:32 smithi130 ceph-mon[22266]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T06:02:32.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:32 smithi130 ceph-mon[22266]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T06:02:32.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:32 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1436626738' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T06:02:32.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:32 smithi053 ceph-mon[18924]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T06:02:32.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:32 smithi053 ceph-mon[18924]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T06:02:32.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:32 smithi053 ceph-mon[18924]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T06:02:32.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:32 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1436626738' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T06:02:32.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:32 smithi153 ceph-mon[22320]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T06:02:32.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:32 smithi153 ceph-mon[22320]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T06:02:32.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:32 smithi153 ceph-mon[22320]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T06:02:33.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.009+0000 7f001daf5640 1 -- 172.21.15.53:0/925298150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0018108b40 msgr2=0x7f001810f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:33.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.009+0000 7f001daf5640 1 --2- 172.21.15.53:0/925298150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0018108b40 0x7f001810f370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0010009ca0 tx=0x7f001002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:02:33.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.010+0000 7f001daf5640 1 -- 172.21.15.53:0/925298150 shutdown_connections 2024-08-31T06:02:33.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.010+0000 7f001daf5640 1 --2- 172.21.15.53:0/925298150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0018108b40 0x7f001810f370 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:33.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.010+0000 7f001daf5640 1 --2- 172.21.15.53:0/925298150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00181081f0 0x7f0018108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.010+0000 7f001daf5640 1 --2- 172.21.15.53:0/925298150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00181028b0 0x7f0018102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.010+0000 7f001daf5640 1 -- 172.21.15.53:0/925298150 >> 172.21.15.53:0/925298150 conn(0x7f0018079470 msgr2=0x7f0018079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.010+0000 7f001daf5640 1 -- 172.21.15.53:0/925298150 shutdown_connections 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.010+0000 7f001daf5640 1 -- 172.21.15.53:0/925298150 wait complete. 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.010+0000 7f001daf5640 1 Processor -- start 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.010+0000 7f001daf5640 1 -- start start 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f001daf5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00181028b0 0x7f001819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f001daf5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00181081f0 0x7f001819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f001daf5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0018108b40 0x7f001819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f001daf5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f00181137f0 con 0x7f00181028b0 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f001daf5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0018113670 con 0x7f0018108b40 2024-08-31T06:02:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f001daf5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0018113970 con 0x7f00181081f0 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f00177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00181028b0 0x7f001819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f00177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00181028b0 0x7f001819a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53960/0 (socket says 172.21.15.53:53960) 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f00177fe640 1 -- 172.21.15.53:0/3056166340 learned_addr learned my addr 172.21.15.53:0/3056166340 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f0017fff640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0018108b40 0x7f001819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f0016ffd640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00181081f0 0x7f001819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f00177fe640 1 -- 172.21.15.53:0/3056166340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00181081f0 msgr2=0x7f001819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f00177fe640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00181081f0 0x7f001819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f00177fe640 1 -- 172.21.15.53:0/3056166340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0018108b40 msgr2=0x7f001819f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f00177fe640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0018108b40 0x7f001819f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f00177fe640 1 -- 172.21.15.53:0/3056166340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00181a0110 con 0x7f00181028b0 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f0016ffd640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00181081f0 0x7f001819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f00177fe640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00181028b0 0x7f001819a1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f000800d950 tx=0x7f000800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.011+0000 7f0014ff9640 1 -- 172.21.15.53:0/3056166340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008017070 con 0x7f00181028b0 2024-08-31T06:02:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.012+0000 7f001daf5640 1 -- 172.21.15.53:0/3056166340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00181a0400 con 0x7f00181028b0 2024-08-31T06:02:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.012+0000 7f0014ff9640 1 -- 172.21.15.53:0/3056166340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0008009c30 con 0x7f00181028b0 2024-08-31T06:02:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.012+0000 7f0014ff9640 1 -- 172.21.15.53:0/3056166340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000800f620 con 0x7f00181028b0 2024-08-31T06:02:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.012+0000 7f001daf5640 1 -- 172.21.15.53:0/3056166340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00181a6b60 con 0x7f00181028b0 2024-08-31T06:02:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.013+0000 7f001daf5640 1 -- 172.21.15.53:0/3056166340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0018102cc0 con 0x7f00181028b0 2024-08-31T06:02:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.015+0000 7f0014ff9640 1 -- 172.21.15.53:0/3056166340 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f0008005030 con 0x7f00181028b0 2024-08-31T06:02:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.016+0000 7f0014ff9640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00000b4b80 0x7f00000b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.016+0000 7f0016ffd640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00000b4b80 0x7f00000b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.016+0000 7f0014ff9640 1 -- 172.21.15.53:0/3056166340 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f00080e4da0 con 0x7f00181028b0 2024-08-31T06:02:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.016+0000 7f0016ffd640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00000b4b80 0x7f00000b7090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0018107250 tx=0x7f000c005d30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.019+0000 7f0014ff9640 1 -- 172.21.15.53:0/3056166340 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f00080abe90 con 0x7f00181028b0 2024-08-31T06:02:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.205+0000 7f001daf5640 1 -- 172.21.15.53:0/3056166340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f001810a990 con 0x7f00181028b0 2024-08-31T06:02:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.206+0000 7f0014ff9640 1 -- 172.21.15.53:0/3056166340 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+22585 (secure 0 0 0) 0x7f0008009de0 con 0x7f00181028b0 2024-08-31T06:02:33.209 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:33.209 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":70,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:02:31.233657+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:02:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 -- 172.21.15.53:0/3056166340 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00000b4b80 msgr2=0x7f00000b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00000b4b80 0x7f00000b7090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0018107250 tx=0x7f000c005d30 comp rx=0 tx=0).stop 2024-08-31T06:02:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 -- 172.21.15.53:0/3056166340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00181028b0 msgr2=0x7f001819a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00181028b0 0x7f001819a1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f000800d950 tx=0x7f000800de10 comp rx=0 tx=0).stop 2024-08-31T06:02:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 -- 172.21.15.53:0/3056166340 shutdown_connections 2024-08-31T06:02:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00000b4b80 0x7f00000b7090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0018108b40 0x7f001819f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00181081f0 0x7f001819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 --2- 172.21.15.53:0/3056166340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00181028b0 0x7f001819a1a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 -- 172.21.15.53:0/3056166340 >> 172.21.15.53:0/3056166340 conn(0x7f0018079470 msgr2=0x7f0018106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:33.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 -- 172.21.15.53:0/3056166340 shutdown_connections 2024-08-31T06:02:33.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:33.209+0000 7f001daf5640 1 -- 172.21.15.53:0/3056166340 wait complete. 2024-08-31T06:02:33.809 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:33 smithi053 ceph-mon[18924]: pgmap v247: 97 pgs: 1 creating+activating, 30 creating+peering, 18 unknown, 48 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T06:02:33.810 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:33 smithi053 ceph-mon[18924]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T06:02:33.810 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:33 smithi053 ceph-mon[18924]: Cluster is now healthy 2024-08-31T06:02:33.810 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:33 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] up:active 2024-08-31T06:02:33.810 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:33 smithi053 ceph-mon[18924]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:33.810 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:33 smithi053 ceph-mon[18924]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:33.810 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:33 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3056166340' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:02:33.837 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:02:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:33 smithi130 ceph-mon[22266]: pgmap v247: 97 pgs: 1 creating+activating, 30 creating+peering, 18 unknown, 48 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T06:02:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:33 smithi130 ceph-mon[22266]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T06:02:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:33 smithi130 ceph-mon[22266]: Cluster is now healthy 2024-08-31T06:02:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:33 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] up:active 2024-08-31T06:02:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:33 smithi130 ceph-mon[22266]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:33 smithi130 ceph-mon[22266]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:33 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3056166340' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:02:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:33 smithi153 ceph-mon[22320]: pgmap v247: 97 pgs: 1 creating+activating, 30 creating+peering, 18 unknown, 48 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T06:02:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:33 smithi153 ceph-mon[22320]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T06:02:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:33 smithi153 ceph-mon[22320]: Cluster is now healthy 2024-08-31T06:02:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:33 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] up:active 2024-08-31T06:02:33.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:33 smithi153 ceph-mon[22320]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:33.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:33 smithi153 ceph-mon[22320]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:33.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:33 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3056166340' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:02:34.087 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.618+0000 7f7d8d74a640 1 -- 172.21.15.53:0/1402193969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d88108a90 msgr2=0x7f7d8810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.618+0000 7f7d8d74a640 1 --2- 172.21.15.53:0/1402193969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d88108a90 0x7f7d8810f2c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009ca0 tx=0x7f7d8002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:02:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.618+0000 7f7d8d74a640 1 -- 172.21.15.53:0/1402193969 shutdown_connections 2024-08-31T06:02:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.618+0000 7f7d8d74a640 1 --2- 172.21.15.53:0/1402193969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d88108a90 0x7f7d8810f2c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.618+0000 7f7d8d74a640 1 --2- 172.21.15.53:0/1402193969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88108140 0x7f7d88108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.618+0000 7f7d8d74a640 1 --2- 172.21.15.53:0/1402193969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d88102800 0x7f7d88102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.618+0000 7f7d8d74a640 1 -- 172.21.15.53:0/1402193969 >> 172.21.15.53:0/1402193969 conn(0x7f7d880794d0 msgr2=0x7f7d880798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.618+0000 7f7d8d74a640 1 -- 172.21.15.53:0/1402193969 shutdown_connections 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.618+0000 7f7d8d74a640 1 -- 172.21.15.53:0/1402193969 wait complete. 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.618+0000 7f7d8d74a640 1 Processor -- start 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d8d74a640 1 -- start start 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d8d74a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88102800 0x7f7d8819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d8d74a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d88108140 0x7f7d8819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d8d74a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d88108a90 0x7f7d8819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d8d74a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881125f0 con 0x7f7d88108140 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d8d74a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88112470 con 0x7f7d88108a90 2024-08-31T06:02:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d8d74a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88112770 con 0x7f7d88102800 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d7e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d88108140 0x7f7d8819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d7e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d88108140 0x7f7d8819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59180/0 (socket says 172.21.15.53:59180) 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d7e7fc640 1 -- 172.21.15.53:0/2560971975 learned_addr learned my addr 172.21.15.53:0/2560971975 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d86ffd640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88102800 0x7f7d8819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d877fe640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d88108a90 0x7f7d8819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d7e7fc640 1 -- 172.21.15.53:0/2560971975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88102800 msgr2=0x7f7d8819a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d7e7fc640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88102800 0x7f7d8819a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d7e7fc640 1 -- 172.21.15.53:0/2560971975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d88108a90 msgr2=0x7f7d8819f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d7e7fc640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d88108a90 0x7f7d8819f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.619+0000 7f7d7e7fc640 1 -- 172.21.15.53:0/2560971975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d881a0040 con 0x7f7d88108140 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.620+0000 7f7d7e7fc640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d88108140 0x7f7d8819a670 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7d70005fd0 tx=0x7f7d7000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.620+0000 7f7d84ff9640 1 -- 172.21.15.53:0/2560971975 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d70017070 con 0x7f7d88108140 2024-08-31T06:02:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.620+0000 7f7d84ff9640 1 -- 172.21.15.53:0/2560971975 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d70009c30 con 0x7f7d88108140 2024-08-31T06:02:34.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.620+0000 7f7d8d74a640 1 -- 172.21.15.53:0/2560971975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d881a0330 con 0x7f7d88108140 2024-08-31T06:02:34.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.620+0000 7f7d84ff9640 1 -- 172.21.15.53:0/2560971975 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d70003c70 con 0x7f7d88108140 2024-08-31T06:02:34.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.620+0000 7f7d8d74a640 1 -- 172.21.15.53:0/2560971975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d881a6a90 con 0x7f7d88108140 2024-08-31T06:02:34.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.621+0000 7f7d8d74a640 1 -- 172.21.15.53:0/2560971975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d88102c10 con 0x7f7d88108140 2024-08-31T06:02:34.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.622+0000 7f7d84ff9640 1 -- 172.21.15.53:0/2560971975 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f7d70003e10 con 0x7f7d88108140 2024-08-31T06:02:34.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.623+0000 7f7d84ff9640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d740b4b80 0x7f7d740b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:34.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.624+0000 7f7d86ffd640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d740b4b80 0x7f7d740b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:34.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.624+0000 7f7d84ff9640 1 -- 172.21.15.53:0/2560971975 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f7d700e5590 con 0x7f7d88108140 2024-08-31T06:02:34.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.624+0000 7f7d86ffd640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d740b4b80 0x7f7d740b7090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800bbe0 tx=0x7f7d7800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:34.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.627+0000 7f7d84ff9640 1 -- 172.21.15.53:0/2560971975 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7d70020030 con 0x7f7d88108140 2024-08-31T06:02:34.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.812+0000 7f7d8d74a640 1 -- 172.21.15.53:0/2560971975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d8810b8f0 con 0x7f7d88108140 2024-08-31T06:02:34.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.814+0000 7f7d84ff9640 1 -- 172.21.15.53:0/2560971975 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+22585 (secure 0 0 0) 0x7f7d700ac6e0 con 0x7f7d88108140 2024-08-31T06:02:34.816 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:34.816 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":70,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:02:31.233657+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:02:34.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 -- 172.21.15.53:0/2560971975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d740b4b80 msgr2=0x7f7d740b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:34.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d740b4b80 0x7f7d740b7090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800bbe0 tx=0x7f7d7800b390 comp rx=0 tx=0).stop 2024-08-31T06:02:34.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 -- 172.21.15.53:0/2560971975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d88108140 msgr2=0x7f7d8819a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:34.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d88108140 0x7f7d8819a670 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7d70005fd0 tx=0x7f7d7000dde0 comp rx=0 tx=0).stop 2024-08-31T06:02:34.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 -- 172.21.15.53:0/2560971975 shutdown_connections 2024-08-31T06:02:34.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d740b4b80 0x7f7d740b7090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:34.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d88108a90 0x7f7d8819f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:34.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d88108140 0x7f7d8819a670 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:34.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 --2- 172.21.15.53:0/2560971975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88102800 0x7f7d8819a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:34.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 -- 172.21.15.53:0/2560971975 >> 172.21.15.53:0/2560971975 conn(0x7f7d880794d0 msgr2=0x7f7d8806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:34.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 -- 172.21.15.53:0/2560971975 shutdown_connections 2024-08-31T06:02:34.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:34.816+0000 7f7d8d74a640 1 -- 172.21.15.53:0/2560971975 wait complete. 2024-08-31T06:02:35.545 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-31T06:02:35.799 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:35 smithi130 ceph-mon[22266]: pgmap v248: 97 pgs: 24 creating+peering, 73 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s wr, 5 op/s 2024-08-31T06:02:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:35 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2560971975' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:02:35.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:35 smithi053 ceph-mon[18924]: pgmap v248: 97 pgs: 24 creating+peering, 73 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s wr, 5 op/s 2024-08-31T06:02:35.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:35 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2560971975' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:02:35.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:35 smithi153 ceph-mon[22320]: pgmap v248: 97 pgs: 24 creating+peering, 73 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s wr, 5 op/s 2024-08-31T06:02:35.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:35 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2560971975' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:02:36.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.268+0000 7f5030730640 1 -- 172.21.15.53:0/1211508777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5028108160 msgr2=0x7f5028108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:36.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.268+0000 7f5030730640 1 --2- 172.21.15.53:0/1211508777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5028108160 0x7f5028108570 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5018009900 tx=0x7f501802a410 comp rx=0 tx=0).stop 2024-08-31T06:02:36.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.268+0000 7f5030730640 1 -- 172.21.15.53:0/1211508777 shutdown_connections 2024-08-31T06:02:36.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.268+0000 7f5030730640 1 --2- 172.21.15.53:0/1211508777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5028108ab0 0x7f502810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.268+0000 7f5030730640 1 --2- 172.21.15.53:0/1211508777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5028108160 0x7f5028108570 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.268+0000 7f5030730640 1 --2- 172.21.15.53:0/1211508777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5028102820 0x7f5028102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.268+0000 7f5030730640 1 -- 172.21.15.53:0/1211508777 >> 172.21.15.53:0/1211508777 conn(0x7f50280794e0 msgr2=0x7f50280798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.268+0000 7f5030730640 1 -- 172.21.15.53:0/1211508777 shutdown_connections 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.268+0000 7f5030730640 1 -- 172.21.15.53:0/1211508777 wait complete. 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f5030730640 1 Processor -- start 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f5030730640 1 -- start start 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f5030730640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5028102820 0x7f502819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f5030730640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5028108160 0x7f502819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f5030730640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5028108ab0 0x7f502819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f5030730640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f50281136f0 con 0x7f5028108160 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f5030730640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5028113570 con 0x7f5028108ab0 2024-08-31T06:02:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f5030730640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5028113870 con 0x7f5028102820 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f502dccb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5028108160 0x7f502819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f502dccb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5028108160 0x7f502819a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59194/0 (socket says 172.21.15.53:59194) 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f502dccb640 1 -- 172.21.15.53:0/3168691844 learned_addr learned my addr 172.21.15.53:0/3168691844 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.269+0000 7f502e4cc640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5028102820 0x7f502819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f502eccd640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5028108ab0 0x7f502819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f502dccb640 1 -- 172.21.15.53:0/3168691844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5028102820 msgr2=0x7f502819a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f502dccb640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5028102820 0x7f502819a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f502dccb640 1 -- 172.21.15.53:0/3168691844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5028108ab0 msgr2=0x7f502819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f502dccb640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5028108ab0 0x7f502819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f502dccb640 1 -- 172.21.15.53:0/3168691844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50281a00b0 con 0x7f5028108160 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f502eccd640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5028108ab0 0x7f502819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:02:36.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f502dccb640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5028108160 0x7f502819a7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5018005940 tx=0x7f50180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:36.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f501f7fe640 1 -- 172.21.15.53:0/3168691844 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501803f030 con 0x7f5028108160 2024-08-31T06:02:36.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f501f7fe640 1 -- 172.21.15.53:0/3168691844 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5018003c90 con 0x7f5028108160 2024-08-31T06:02:36.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f5030730640 1 -- 172.21.15.53:0/3168691844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50281a0340 con 0x7f5028108160 2024-08-31T06:02:36.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f501f7fe640 1 -- 172.21.15.53:0/3168691844 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018035070 con 0x7f5028108160 2024-08-31T06:02:36.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.270+0000 7f5030730640 1 -- 172.21.15.53:0/3168691844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50281a0870 con 0x7f5028108160 2024-08-31T06:02:36.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.271+0000 7f5030730640 1 -- 172.21.15.53:0/3168691844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5028103aa0 con 0x7f5028108160 2024-08-31T06:02:36.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.273+0000 7f501f7fe640 1 -- 172.21.15.53:0/3168691844 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f5018042030 con 0x7f5028108160 2024-08-31T06:02:36.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.274+0000 7f501f7fe640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50140b4c30 0x7f50140b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:36.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.274+0000 7f502e4cc640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50140b4c30 0x7f50140b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:36.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.274+0000 7f501f7fe640 1 -- 172.21.15.53:0/3168691844 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f50181056e0 con 0x7f5028108160 2024-08-31T06:02:36.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.274+0000 7f502e4cc640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50140b4c30 0x7f50140b7140 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f502400abe0 tx=0x7f502400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:36.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.279+0000 7f501f7fe640 1 -- 172.21.15.53:0/3168691844 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f50281a0870 con 0x7f5028108160 2024-08-31T06:02:36.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.504+0000 7f5030730640 1 -- 172.21.15.53:0/3168691844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f502802e430 con 0x7f5028108160 2024-08-31T06:02:36.614 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:36 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:02:36.215+0000 7f2f9bf06640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T06:02:36.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.617+0000 7f501f7fe640 1 -- 172.21.15.53:0/3168691844 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f50180cc830 con 0x7f5028108160 2024-08-31T06:02:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 -- 172.21.15.53:0/3168691844 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50140b4c30 msgr2=0x7f50140b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50140b4c30 0x7f50140b7140 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f502400abe0 tx=0x7f502400a2d0 comp rx=0 tx=0).stop 2024-08-31T06:02:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 -- 172.21.15.53:0/3168691844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5028108160 msgr2=0x7f502819a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5028108160 0x7f502819a7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5018005940 tx=0x7f50180042f0 comp rx=0 tx=0).stop 2024-08-31T06:02:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 -- 172.21.15.53:0/3168691844 shutdown_connections 2024-08-31T06:02:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50140b4c30 0x7f50140b7140 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5028108ab0 0x7f502819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:36.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5028108160 0x7f502819a7a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:36.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 --2- 172.21.15.53:0/3168691844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5028102820 0x7f502819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:36.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 -- 172.21.15.53:0/3168691844 >> 172.21.15.53:0/3168691844 conn(0x7f50280794e0 msgr2=0x7f5028105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:36.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 -- 172.21.15.53:0/3168691844 shutdown_connections 2024-08-31T06:02:36.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:36.620+0000 7f5030730640 1 -- 172.21.15.53:0/3168691844 wait complete. 2024-08-31T06:02:36.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:36 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3168691844' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T06:02:36.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:36 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3168691844' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T06:02:36.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:36 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3168691844' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T06:02:37.329 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-31T06:02:37.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-08-31T06:02:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:37.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:37 smithi130 ceph-mon[22266]: pgmap v249: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-08-31T06:02:37.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:37 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3168691844' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T06:02:37.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:37 smithi130 ceph-mon[22266]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:37.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:37 smithi153 ceph-mon[22320]: pgmap v249: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-08-31T06:02:37.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:37 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3168691844' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T06:02:37.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:37 smithi153 ceph-mon[22320]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:37.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:37 smithi053 ceph-mon[18924]: pgmap v249: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-08-31T06:02:37.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:37 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3168691844' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T06:02:37.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:37 smithi053 ceph-mon[18924]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.069+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/362983847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d4107920 msgr2=0x7fa2d4107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.069+0000 7fa2d8aa1640 1 --2- 172.21.15.53:0/362983847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d4107920 0x7fa2d4107d30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009900 tx=0x7fa2c402a410 comp rx=0 tx=0).stop 2024-08-31T06:02:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.070+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/362983847 shutdown_connections 2024-08-31T06:02:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.070+0000 7fa2d8aa1640 1 --2- 172.21.15.53:0/362983847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d4108270 0x7fa2d410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.070+0000 7fa2d8aa1640 1 --2- 172.21.15.53:0/362983847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d4107920 0x7fa2d4107d30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.070+0000 7fa2d8aa1640 1 --2- 172.21.15.53:0/362983847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4101fe0 0x7fa2d41023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.070+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/362983847 >> 172.21.15.53:0/362983847 conn(0x7fa2d4079d30 msgr2=0x7fa2d407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.070+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/362983847 shutdown_connections 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.070+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/362983847 wait complete. 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.070+0000 7fa2d8aa1640 1 Processor -- start 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d8aa1640 1 -- start start 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d8aa1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4101fe0 0x7fa2d419c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d8aa1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d4107920 0x7fa2d419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d8aa1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d4108270 0x7fa2d41a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d8aa1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4112700 con 0x7fa2d4107920 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d8aa1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4112580 con 0x7fa2d4101fe0 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d8aa1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4112880 con 0x7fa2d4108270 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d4107920 0x7fa2d419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d4107920 0x7fa2d419cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59206/0 (socket says 172.21.15.53:59206) 2024-08-31T06:02:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d1d9b640 1 -- 172.21.15.53:0/3953857684 learned_addr learned my addr 172.21.15.53:0/3953857684 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d259c640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4101fe0 0x7fa2d419c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d2d9d640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d4108270 0x7fa2d41a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d1d9b640 1 -- 172.21.15.53:0/3953857684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d4108270 msgr2=0x7fa2d41a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d1d9b640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d4108270 0x7fa2d41a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d1d9b640 1 -- 172.21.15.53:0/3953857684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4101fe0 msgr2=0x7fa2d419c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d1d9b640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4101fe0 0x7fa2d419c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d1d9b640 1 -- 172.21.15.53:0/3953857684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d41a24f0 con 0x7fa2d4107920 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d2d9d640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d4108270 0x7fa2d41a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d259c640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4101fe0 0x7fa2d419c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.071+0000 7fa2d1d9b640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d4107920 0x7fa2d419cb20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4005940 tx=0x7fa2c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.072+0000 7fa2c37fe640 1 -- 172.21.15.53:0/3953857684 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c403f030 con 0x7fa2d4107920 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.072+0000 7fa2c37fe640 1 -- 172.21.15.53:0/3953857684 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2c4003c90 con 0x7fa2d4107920 2024-08-31T06:02:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.072+0000 7fa2c37fe640 1 -- 172.21.15.53:0/3953857684 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4035070 con 0x7fa2d4107920 2024-08-31T06:02:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.072+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/3953857684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d41a2780 con 0x7fa2d4107920 2024-08-31T06:02:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.072+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/3953857684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d41a8f40 con 0x7fa2d4107920 2024-08-31T06:02:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.073+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/3953857684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d4102470 con 0x7fa2d4107920 2024-08-31T06:02:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.075+0000 7fa2c37fe640 1 -- 172.21.15.53:0/3953857684 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fa2c4042030 con 0x7fa2d4107920 2024-08-31T06:02:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.075+0000 7fa2c37fe640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2bc0b4c00 0x7fa2bc0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.075+0000 7fa2d259c640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2bc0b4c00 0x7fa2bc0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.075+0000 7fa2c37fe640 1 -- 172.21.15.53:0/3953857684 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7fa2c4105ab0 con 0x7fa2d4107920 2024-08-31T06:02:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.076+0000 7fa2d259c640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2bc0b4c00 0x7fa2bc0b7110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009930 tx=0x7fa2c8008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.079+0000 7fa2c37fe640 1 -- 172.21.15.53:0/3953857684 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa2c40ccc00 con 0x7fa2d4107920 2024-08-31T06:02:38.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.303+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/3953857684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fa2d41a9110 con 0x7fa2d4107920 2024-08-31T06:02:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.625+0000 7fa2c37fe640 1 -- 172.21.15.53:0/3953857684 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fa2c40d5140 con 0x7fa2d4107920 2024-08-31T06:02:38.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.627+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/3953857684 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2bc0b4c00 msgr2=0x7fa2bc0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:38.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.627+0000 7fa2d8aa1640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2bc0b4c00 0x7fa2bc0b7110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009930 tx=0x7fa2c8008040 comp rx=0 tx=0).stop 2024-08-31T06:02:38.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.627+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/3953857684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d4107920 msgr2=0x7fa2d419cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:38.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.627+0000 7fa2d8aa1640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d4107920 0x7fa2d419cb20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4005940 tx=0x7fa2c40042f0 comp rx=0 tx=0).stop 2024-08-31T06:02:38.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.628+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/3953857684 shutdown_connections 2024-08-31T06:02:38.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.628+0000 7fa2d8aa1640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2bc0b4c00 0x7fa2bc0b7110 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:38.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.628+0000 7fa2d8aa1640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d4108270 0x7fa2d41a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:38.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.628+0000 7fa2d8aa1640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d4107920 0x7fa2d419cb20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:38.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.628+0000 7fa2d8aa1640 1 --2- 172.21.15.53:0/3953857684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4101fe0 0x7fa2d419c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:38.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.628+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/3953857684 >> 172.21.15.53:0/3953857684 conn(0x7fa2d4079d30 msgr2=0x7fa2d410f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:38.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.628+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/3953857684 shutdown_connections 2024-08-31T06:02:38.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:38.628+0000 7fa2d8aa1640 1 -- 172.21.15.53:0/3953857684 wait complete. 2024-08-31T06:02:38.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:38 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3953857684' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-31T06:02:38.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:38 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3953857684' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-31T06:02:38.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:38 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3953857684' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-31T06:02:39.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-31T06:02:39.535 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:39.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:39 smithi130 ceph-mon[22266]: pgmap v250: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T06:02:39.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:39 smithi130 ceph-mon[22266]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T06:02:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:39 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3953857684' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-31T06:02:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:39 smithi130 ceph-mon[22266]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T06:02:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:39 smithi130 ceph-mon[22266]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:39 smithi130 ceph-mon[22266]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-31T06:02:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:39 smithi130 ceph-mon[22266]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-31T06:02:39.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:39 smithi153 ceph-mon[22320]: pgmap v250: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T06:02:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:39 smithi153 ceph-mon[22320]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T06:02:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:39 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3953857684' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-31T06:02:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:39 smithi153 ceph-mon[22320]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T06:02:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:39 smithi153 ceph-mon[22320]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:39 smithi153 ceph-mon[22320]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-31T06:02:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:39 smithi153 ceph-mon[22320]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-31T06:02:39.948 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:39 smithi053 ceph-mon[18924]: pgmap v250: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T06:02:39.948 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:39 smithi053 ceph-mon[18924]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T06:02:39.948 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:39 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3953857684' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-31T06:02:39.948 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:39 smithi053 ceph-mon[18924]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T06:02:39.948 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:39 smithi053 ceph-mon[18924]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:02:39.948 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:39 smithi053 ceph-mon[18924]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-31T06:02:39.948 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:39 smithi053 ceph-mon[18924]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-31T06:02:40.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.060+0000 7f3700718640 1 -- 172.21.15.53:0/2909681258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f8105040 msgr2=0x7f36f810d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:40.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.060+0000 7f3700718640 1 --2- 172.21.15.53:0/2909681258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f8105040 0x7f36f810d6d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009900 tx=0x7f36e802a410 comp rx=0 tx=0).stop 2024-08-31T06:02:40.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.061+0000 7f3700718640 1 -- 172.21.15.53:0/2909681258 shutdown_connections 2024-08-31T06:02:40.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.061+0000 7f3700718640 1 --2- 172.21.15.53:0/2909681258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f810dc10 0x7f36f81100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:40.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.061+0000 7f3700718640 1 --2- 172.21.15.53:0/2909681258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f8105040 0x7f36f810d6d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:40.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.061+0000 7f3700718640 1 --2- 172.21.15.53:0/2909681258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36f8104660 0x7f36f8104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:40.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.061+0000 7f3700718640 1 -- 172.21.15.53:0/2909681258 >> 172.21.15.53:0/2909681258 conn(0x7f36f8079530 msgr2=0x7f36f8079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:40.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.061+0000 7f3700718640 1 -- 172.21.15.53:0/2909681258 shutdown_connections 2024-08-31T06:02:40.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.061+0000 7f3700718640 1 -- 172.21.15.53:0/2909681258 wait complete. 2024-08-31T06:02:40.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.061+0000 7f3700718640 1 Processor -- start 2024-08-31T06:02:40.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.061+0000 7f3700718640 1 -- start start 2024-08-31T06:02:40.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f3700718640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36f8104660 0x7f36f819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:40.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f3700718640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f8105040 0x7f36f819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:40.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f3700718640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f810dc10 0x7f36f819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:40.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f3700718640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f36f8113740 con 0x7f36f810dc10 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f3700718640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f36f81135c0 con 0x7f36f8104660 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f3700718640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36f81138c0 con 0x7f36f8105040 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f36fecb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f810dc10 0x7f36f819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f36fecb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f810dc10 0x7f36f819fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59224/0 (socket says 172.21.15.53:59224) 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f36fecb5640 1 -- 172.21.15.53:0/4037025271 learned_addr learned my addr 172.21.15.53:0/4037025271 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f36fdcb3640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f8105040 0x7f36f819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f36fe4b4640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36f8104660 0x7f36f819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f36fecb5640 1 -- 172.21.15.53:0/4037025271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f8105040 msgr2=0x7f36f819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f36fecb5640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f8105040 0x7f36f819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f36fecb5640 1 -- 172.21.15.53:0/4037025271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36f8104660 msgr2=0x7f36f819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f36fecb5640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36f8104660 0x7f36f819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f36fecb5640 1 -- 172.21.15.53:0/4037025271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f81a0180 con 0x7f36f810dc10 2024-08-31T06:02:40.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.062+0000 7f36fecb5640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f810dc10 0x7f36f819fa50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f36f000b970 tx=0x7f36f000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:40.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.063+0000 7f36ef7fe640 1 -- 172.21.15.53:0/4037025271 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0019070 con 0x7f36f810dc10 2024-08-31T06:02:40.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.063+0000 7f3700718640 1 -- 172.21.15.53:0/4037025271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f81a0470 con 0x7f36f810dc10 2024-08-31T06:02:40.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.063+0000 7f36ef7fe640 1 -- 172.21.15.53:0/4037025271 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36f0014440 con 0x7f36f810dc10 2024-08-31T06:02:40.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.063+0000 7f36ef7fe640 1 -- 172.21.15.53:0/4037025271 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f00075d0 con 0x7f36f810dc10 2024-08-31T06:02:40.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.063+0000 7f3700718640 1 -- 172.21.15.53:0/4037025271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f81a6bd0 con 0x7f36f810dc10 2024-08-31T06:02:40.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.064+0000 7f3700718640 1 -- 172.21.15.53:0/4037025271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f8104a70 con 0x7f36f810dc10 2024-08-31T06:02:40.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.065+0000 7f36ef7fe640 1 -- 172.21.15.53:0/4037025271 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f36f001c070 con 0x7f36f810dc10 2024-08-31T06:02:40.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.066+0000 7f36ef7fe640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36e40b4b80 0x7f36e40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:40.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.066+0000 7f36fe4b4640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36e40b4b80 0x7f36e40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:40.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.066+0000 7f36ef7fe640 1 -- 172.21.15.53:0/4037025271 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f36f00e4ae0 con 0x7f36f810dc10 2024-08-31T06:02:40.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.067+0000 7f36fe4b4640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36e40b4b80 0x7f36e40b7090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36f400bbe0 tx=0x7f36f400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:40.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.069+0000 7f36ef7fe640 1 -- 172.21.15.53:0/4037025271 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f36f00ab5e0 con 0x7f36f810dc10 2024-08-31T06:02:40.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.295+0000 7f3700718640 1 -- 172.21.15.53:0/4037025271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f36f802e430 con 0x7f36f810dc10 2024-08-31T06:02:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.647+0000 7f36ef7fe640 1 -- 172.21.15.53:0/4037025271 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f36f00b4170 con 0x7f36f810dc10 2024-08-31T06:02:40.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.649+0000 7f3700718640 1 -- 172.21.15.53:0/4037025271 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36e40b4b80 msgr2=0x7f36e40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:40.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.649+0000 7f3700718640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36e40b4b80 0x7f36e40b7090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36f400bbe0 tx=0x7f36f400b390 comp rx=0 tx=0).stop 2024-08-31T06:02:40.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.649+0000 7f3700718640 1 -- 172.21.15.53:0/4037025271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f810dc10 msgr2=0x7f36f819fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:40.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.649+0000 7f3700718640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f810dc10 0x7f36f819fa50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f36f000b970 tx=0x7f36f000be30 comp rx=0 tx=0).stop 2024-08-31T06:02:40.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.649+0000 7f3700718640 1 -- 172.21.15.53:0/4037025271 shutdown_connections 2024-08-31T06:02:40.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.649+0000 7f3700718640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36e40b4b80 0x7f36e40b7090 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:40.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.649+0000 7f3700718640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f810dc10 0x7f36f819fa50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:40.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.649+0000 7f3700718640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f8105040 0x7f36f819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:40.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.649+0000 7f3700718640 1 --2- 172.21.15.53:0/4037025271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36f8104660 0x7f36f819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:40.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.649+0000 7f3700718640 1 -- 172.21.15.53:0/4037025271 >> 172.21.15.53:0/4037025271 conn(0x7f36f8079530 msgr2=0x7f36f8100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:40.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.650+0000 7f3700718640 1 -- 172.21.15.53:0/4037025271 shutdown_connections 2024-08-31T06:02:40.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:40.650+0000 7f3700718640 1 -- 172.21.15.53:0/4037025271 wait complete. 2024-08-31T06:02:40.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:40 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] up:active 2024-08-31T06:02:40.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:40 smithi130 ceph-mon[22266]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T06:02:40.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:40 smithi130 ceph-mon[22266]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-31T06:02:40.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:40 smithi130 ceph-mon[22266]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-08-31T06:02:40.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:40 smithi130 ceph-mon[22266]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-08-31T06:02:40.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:40 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4037025271' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T06:02:40.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:40 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] up:active 2024-08-31T06:02:40.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:40 smithi153 ceph-mon[22320]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T06:02:40.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:40 smithi153 ceph-mon[22320]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-31T06:02:40.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:40 smithi153 ceph-mon[22320]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-08-31T06:02:40.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:40 smithi153 ceph-mon[22320]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-08-31T06:02:40.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:40 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4037025271' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T06:02:40.971 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:40 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] up:active 2024-08-31T06:02:40.971 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:40 smithi053 ceph-mon[18924]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T06:02:40.971 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:40 smithi053 ceph-mon[18924]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-31T06:02:40.971 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:40 smithi053 ceph-mon[18924]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-08-31T06:02:40.971 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:40 smithi053 ceph-mon[18924]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-08-31T06:02:40.971 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:40 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4037025271' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T06:02:41.228 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-31T06:02:41.378 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:41 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:02:41.216+0000 7f2f9bf06640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-08-31T06:02:41.378 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:41 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:02:41.216+0000 7f2f9bf06640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-08-31T06:02:41.485 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:41.871 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:41 smithi053 ceph-mon[18924]: pgmap v251: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 7 op/s 2024-08-31T06:02:41.872 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:41 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4037025271' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T06:02:41.872 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:41 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] up:active 2024-08-31T06:02:41.872 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:41 smithi053 ceph-mon[18924]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-31T06:02:41.872 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:41 smithi053 ceph-mon[18924]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-08-31T06:02:41.872 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:41 smithi053 ceph-mon[18924]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-08-31T06:02:41.872 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:41 smithi053 ceph-mon[18924]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-08-31T06:02:41.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:41 smithi153 ceph-mon[22320]: pgmap v251: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 7 op/s 2024-08-31T06:02:41.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:41 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4037025271' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T06:02:41.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:41 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] up:active 2024-08-31T06:02:41.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:41 smithi153 ceph-mon[22320]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-31T06:02:41.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:41 smithi153 ceph-mon[22320]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-08-31T06:02:41.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:41 smithi153 ceph-mon[22320]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-08-31T06:02:41.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:41 smithi153 ceph-mon[22320]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-08-31T06:02:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.964+0000 7fa539dc3640 1 -- 172.21.15.53:0/2093528741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa534108170 msgr2=0x7fa534108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.964+0000 7fa539dc3640 1 --2- 172.21.15.53:0/2093528741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa534108170 0x7fa534108580 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa528009900 tx=0x7fa52802a410 comp rx=0 tx=0).stop 2024-08-31T06:02:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.964+0000 7fa539dc3640 1 -- 172.21.15.53:0/2093528741 shutdown_connections 2024-08-31T06:02:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.964+0000 7fa539dc3640 1 --2- 172.21.15.53:0/2093528741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa534108ac0 0x7fa53410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.964+0000 7fa539dc3640 1 --2- 172.21.15.53:0/2093528741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa534108170 0x7fa534108580 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.964+0000 7fa539dc3640 1 --2- 172.21.15.53:0/2093528741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa534102880 0x7fa534102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.964+0000 7fa539dc3640 1 -- 172.21.15.53:0/2093528741 >> 172.21.15.53:0/2093528741 conn(0x7fa534079530 msgr2=0x7fa534079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.964+0000 7fa539dc3640 1 -- 172.21.15.53:0/2093528741 shutdown_connections 2024-08-31T06:02:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.964+0000 7fa539dc3640 1 -- 172.21.15.53:0/2093528741 wait complete. 2024-08-31T06:02:41.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.965+0000 7fa539dc3640 1 Processor -- start 2024-08-31T06:02:41.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.965+0000 7fa539dc3640 1 -- start start 2024-08-31T06:02:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.965+0000 7fa539dc3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa534102880 0x7fa5340ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.965+0000 7fa539dc3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa534108170 0x7fa5340ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.965+0000 7fa539dc3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa534108ac0 0x7fa5340ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa539dc3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa5341125e0 con 0x7fa534108ac0 2024-08-31T06:02:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa539dc3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa534112460 con 0x7fa534102880 2024-08-31T06:02:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa539dc3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa534112760 con 0x7fa534108170 2024-08-31T06:02:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa534108ac0 0x7fa5340ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa534108ac0 0x7fa5340ffe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59244/0 (socket says 172.21.15.53:59244) 2024-08-31T06:02:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa533fff640 1 -- 172.21.15.53:0/3293783451 learned_addr learned my addr 172.21.15.53:0/3293783451 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa5337fe640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa534102880 0x7fa5340ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa532ffd640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa534108170 0x7fa5340ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa533fff640 1 -- 172.21.15.53:0/3293783451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa534108170 msgr2=0x7fa5340ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa533fff640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa534108170 0x7fa5340ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa533fff640 1 -- 172.21.15.53:0/3293783451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa534102880 msgr2=0x7fa5340ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa533fff640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa534102880 0x7fa5340ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa533fff640 1 -- 172.21.15.53:0/3293783451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5341a84a0 con 0x7fa534108ac0 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa5337fe640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa534102880 0x7fa5340ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa533fff640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa534108ac0 0x7fa5340ffe90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00cad0 tx=0x7fa52c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa530ff9640 1 -- 172.21.15.53:0/3293783451 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00ae20 con 0x7fa534108ac0 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa539dc3640 1 -- 172.21.15.53:0/3293783451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5341a8790 con 0x7fa534108ac0 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa530ff9640 1 -- 172.21.15.53:0/3293783451 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa52c005020 con 0x7fa534108ac0 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa530ff9640 1 -- 172.21.15.53:0/3293783451 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00f6b0 con 0x7fa534108ac0 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.966+0000 7fa539dc3640 1 -- 172.21.15.53:0/3293783451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5341a8ca0 con 0x7fa534108ac0 2024-08-31T06:02:41.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.968+0000 7fa539dc3640 1 -- 172.21.15.53:0/3293783451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa534103ab0 con 0x7fa534108ac0 2024-08-31T06:02:41.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.969+0000 7fa530ff9640 1 -- 172.21.15.53:0/3293783451 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fa52c0051d0 con 0x7fa534108ac0 2024-08-31T06:02:41.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.970+0000 7fa530ff9640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa51c0b4c00 0x7fa51c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:41.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.970+0000 7fa5337fe640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa51c0b4c00 0x7fa51c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:41.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.970+0000 7fa530ff9640 1 -- 172.21.15.53:0/3293783451 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7fa52c0e56f0 con 0x7fa534108ac0 2024-08-31T06:02:41.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.971+0000 7fa5337fe640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa51c0b4c00 0x7fa51c0b7110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa524005fd0 tx=0x7fa524005ec0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:41.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:41.973+0000 7fa530ff9640 1 -- 172.21.15.53:0/3293783451 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa52c014030 con 0x7fa534108ac0 2024-08-31T06:02:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:41 smithi130 ceph-mon[22266]: pgmap v251: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 7 op/s 2024-08-31T06:02:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:41 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4037025271' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T06:02:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:41 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] up:active 2024-08-31T06:02:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:41 smithi130 ceph-mon[22266]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-31T06:02:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:41 smithi130 ceph-mon[22266]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-08-31T06:02:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:41 smithi130 ceph-mon[22266]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-08-31T06:02:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:41 smithi130 ceph-mon[22266]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-08-31T06:02:42.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.199+0000 7fa539dc3640 1 -- 172.21.15.53:0/3293783451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fa534102c90 con 0x7fa534108ac0 2024-08-31T06:02:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.666+0000 7fa530ff9640 1 -- 172.21.15.53:0/3293783451 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fa52c0ac8c0 con 0x7fa534108ac0 2024-08-31T06:02:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 -- 172.21.15.53:0/3293783451 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa51c0b4c00 msgr2=0x7fa51c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa51c0b4c00 0x7fa51c0b7110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa524005fd0 tx=0x7fa524005ec0 comp rx=0 tx=0).stop 2024-08-31T06:02:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 -- 172.21.15.53:0/3293783451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa534108ac0 msgr2=0x7fa5340ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa534108ac0 0x7fa5340ffe90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00cad0 tx=0x7fa52c00cf90 comp rx=0 tx=0).stop 2024-08-31T06:02:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 -- 172.21.15.53:0/3293783451 shutdown_connections 2024-08-31T06:02:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa51c0b4c00 0x7fa51c0b7110 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa534108ac0 0x7fa5340ffe90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa534108170 0x7fa5340ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 --2- 172.21.15.53:0/3293783451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa534102880 0x7fa5340ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 -- 172.21.15.53:0/3293783451 >> 172.21.15.53:0/3293783451 conn(0x7fa534079530 msgr2=0x7fa534101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 -- 172.21.15.53:0/3293783451 shutdown_connections 2024-08-31T06:02:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:42.668+0000 7fa539dc3640 1 -- 172.21.15.53:0/3293783451 wait complete. 2024-08-31T06:02:42.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:42 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] up:active 2024-08-31T06:02:42.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:42 smithi153 ceph-mon[22320]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-31T06:02:42.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:42 smithi153 ceph-mon[22320]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T06:02:42.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:42 smithi153 ceph-mon[22320]: Cluster is now healthy 2024-08-31T06:02:42.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:42 smithi153 ceph-mon[22320]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-08-31T06:02:42.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:42 smithi153 ceph-mon[22320]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-31T06:02:42.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:42 smithi153 ceph-mon[22320]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-08-31T06:02:42.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:42 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3293783451' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T06:02:42.967 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:42 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] up:active 2024-08-31T06:02:42.967 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:42 smithi053 ceph-mon[18924]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-31T06:02:42.967 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:42 smithi053 ceph-mon[18924]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T06:02:42.967 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:42 smithi053 ceph-mon[18924]: Cluster is now healthy 2024-08-31T06:02:42.967 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:42 smithi053 ceph-mon[18924]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-08-31T06:02:42.968 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:42 smithi053 ceph-mon[18924]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-31T06:02:42.968 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:42 smithi053 ceph-mon[18924]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-08-31T06:02:42.968 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:42 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3293783451' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T06:02:43.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:42 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] up:active 2024-08-31T06:02:43.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:42 smithi130 ceph-mon[22266]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-31T06:02:43.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:42 smithi130 ceph-mon[22266]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T06:02:43.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:42 smithi130 ceph-mon[22266]: Cluster is now healthy 2024-08-31T06:02:43.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:42 smithi130 ceph-mon[22266]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-08-31T06:02:43.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:42 smithi130 ceph-mon[22266]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-31T06:02:43.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:42 smithi130 ceph-mon[22266]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-08-31T06:02:43.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:42 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3293783451' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T06:02:43.334 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-08-31T06:02:43.334 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-31T06:02:43.593 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:43 smithi153 ceph-mon[22320]: pgmap v252: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 9 op/s 2024-08-31T06:02:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:43 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3293783451' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T06:02:43.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:43 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] up:active 2024-08-31T06:02:43.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:43 smithi153 ceph-mon[22320]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-31T06:02:43.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:43 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:02:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:43 smithi053 ceph-mon[18924]: pgmap v252: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 9 op/s 2024-08-31T06:02:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3293783451' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T06:02:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:43 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] up:active 2024-08-31T06:02:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:43 smithi053 ceph-mon[18924]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-31T06:02:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:43 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:02:44.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.089+0000 7fb26be40640 1 -- 172.21.15.53:0/1779519234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb264109240 msgr2=0x7fb264109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:44.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.089+0000 7fb26be40640 1 --2- 172.21.15.53:0/1779519234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb264109240 0x7fb264109650 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb254009900 tx=0x7fb25402a410 comp rx=0 tx=0).stop 2024-08-31T06:02:44.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.089+0000 7fb26be40640 1 -- 172.21.15.53:0/1779519234 shutdown_connections 2024-08-31T06:02:44.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.089+0000 7fb26be40640 1 --2- 172.21.15.53:0/1779519234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb264109b90 0x7fb2641103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:44.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.089+0000 7fb26be40640 1 --2- 172.21.15.53:0/1779519234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb264109240 0x7fb264109650 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:44.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.089+0000 7fb26be40640 1 --2- 172.21.15.53:0/1779519234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb264103900 0x7fb264103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:44.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.089+0000 7fb26be40640 1 -- 172.21.15.53:0/1779519234 >> 172.21.15.53:0/1779519234 conn(0x7fb26407b5f0 msgr2=0x7fb26407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:44.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.090+0000 7fb26be40640 1 -- 172.21.15.53:0/1779519234 shutdown_connections 2024-08-31T06:02:44.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.090+0000 7fb26be40640 1 -- 172.21.15.53:0/1779519234 wait complete. 2024-08-31T06:02:44.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.090+0000 7fb26be40640 1 Processor -- start 2024-08-31T06:02:44.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.090+0000 7fb26be40640 1 -- start start 2024-08-31T06:02:44.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26be40640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb264103900 0x7fb26419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:44.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26be40640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb264109240 0x7fb26419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:44.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26be40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb264109b90 0x7fb26419f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:44.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26be40640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb264113700 con 0x7fb264109b90 2024-08-31T06:02:44.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26be40640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb264113580 con 0x7fb264109240 2024-08-31T06:02:44.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26be40640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb264113880 con 0x7fb264103900 2024-08-31T06:02:44.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26a3dd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb264109b90 0x7fb26419f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:44.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26a3dd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb264109b90 0x7fb26419f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47386/0 (socket says 172.21.15.53:47386) 2024-08-31T06:02:44.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26a3dd640 1 -- 172.21.15.53:0/3490083545 learned_addr learned my addr 172.21.15.53:0/3490083545 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:44.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb2693db640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb264109240 0x7fb26419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb269bdc640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb264103900 0x7fb26419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26a3dd640 1 -- 172.21.15.53:0/3490083545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb264103900 msgr2=0x7fb26419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26a3dd640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb264103900 0x7fb26419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26a3dd640 1 -- 172.21.15.53:0/3490083545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb264109240 msgr2=0x7fb26419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26a3dd640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb264109240 0x7fb26419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26a3dd640 1 -- 172.21.15.53:0/3490083545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2641a0120 con 0x7fb264109b90 2024-08-31T06:02:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb269bdc640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb264103900 0x7fb26419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:02:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.091+0000 7fb26a3dd640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb264109b90 0x7fb26419f9f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00eaa0 tx=0x7fb25c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.092+0000 7fb25affd640 1 -- 172.21.15.53:0/3490083545 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c00cdb0 con 0x7fb264109b90 2024-08-31T06:02:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.092+0000 7fb26be40640 1 -- 172.21.15.53:0/3490083545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2641a0410 con 0x7fb264109b90 2024-08-31T06:02:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.092+0000 7fb25affd640 1 -- 172.21.15.53:0/3490083545 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb25c005020 con 0x7fb264109b90 2024-08-31T06:02:44.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.092+0000 7fb25affd640 1 -- 172.21.15.53:0/3490083545 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c0116d0 con 0x7fb264109b90 2024-08-31T06:02:44.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.092+0000 7fb26be40640 1 -- 172.21.15.53:0/3490083545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2641a6b70 con 0x7fb264109b90 2024-08-31T06:02:44.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.093+0000 7fb26be40640 1 -- 172.21.15.53:0/3490083545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb264103d10 con 0x7fb264109b90 2024-08-31T06:02:44.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.094+0000 7fb25affd640 1 -- 172.21.15.53:0/3490083545 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fb25c004a40 con 0x7fb264109b90 2024-08-31T06:02:44.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.095+0000 7fb25affd640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2500b4b80 0x7fb2500b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:44.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.095+0000 7fb25affd640 1 -- 172.21.15.53:0/3490083545 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7fb25c0e56e0 con 0x7fb264109b90 2024-08-31T06:02:44.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.095+0000 7fb269bdc640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2500b4b80 0x7fb2500b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:44.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.096+0000 7fb269bdc640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2500b4b80 0x7fb2500b7090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb2600058c0 tx=0x7fb260005ec0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:44.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.098+0000 7fb25affd640 1 -- 172.21.15.53:0/3490083545 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb25c016030 con 0x7fb264109b90 2024-08-31T06:02:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:43 smithi130 ceph-mon[22266]: pgmap v252: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 9 op/s 2024-08-31T06:02:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:43 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3293783451' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T06:02:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:43 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] up:active 2024-08-31T06:02:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:43 smithi130 ceph-mon[22266]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-31T06:02:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:43 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:02:44.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.308+0000 7fb26be40640 1 -- 172.21.15.53:0/3490083545 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb2640635a0 con 0x7fb2500b4b80 2024-08-31T06:02:44.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.339+0000 7fb25affd640 1 -- 172.21.15.53:0/3490083545 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb2640635a0 con 0x7fb2500b4b80 2024-08-31T06:02:44.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.341+0000 7fb26be40640 1 -- 172.21.15.53:0/3490083545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2500b4b80 msgr2=0x7fb2500b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:44.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.341+0000 7fb26be40640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2500b4b80 0x7fb2500b7090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb2600058c0 tx=0x7fb260005ec0 comp rx=0 tx=0).stop 2024-08-31T06:02:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.341+0000 7fb26be40640 1 -- 172.21.15.53:0/3490083545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb264109b90 msgr2=0x7fb26419f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.341+0000 7fb26be40640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb264109b90 0x7fb26419f9f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00eaa0 tx=0x7fb25c00ef60 comp rx=0 tx=0).stop 2024-08-31T06:02:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.341+0000 7fb26be40640 1 -- 172.21.15.53:0/3490083545 shutdown_connections 2024-08-31T06:02:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.341+0000 7fb26be40640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2500b4b80 0x7fb2500b7090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.341+0000 7fb26be40640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb264109b90 0x7fb26419f9f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.341+0000 7fb26be40640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb264109240 0x7fb26419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.341+0000 7fb26be40640 1 --2- 172.21.15.53:0/3490083545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb264103900 0x7fb26419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.341+0000 7fb26be40640 1 -- 172.21.15.53:0/3490083545 >> 172.21.15.53:0/3490083545 conn(0x7fb26407b5f0 msgr2=0x7fb264107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.341+0000 7fb26be40640 1 -- 172.21.15.53:0/3490083545 shutdown_connections 2024-08-31T06:02:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:44.342+0000 7fb26be40640 1 -- 172.21.15.53:0/3490083545 wait complete. 2024-08-31T06:02:44.633 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:02:44 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T06:02:44.314+0000 7ff3df142640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:02:44.634 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:02:44 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T06:02:44.314+0000 7ff3df142640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:02:44.634 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:02:44 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T06:02:44.314+0000 7ff3df142640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:02:44.634 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:02:44 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T06:02:44.314+0000 7ff3df142640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:02:44.634 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:02:44 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T06:02:44.314+0000 7ff3df142640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:02:44.997 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-31T06:02:45.249 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:45.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.675+0000 7fa847e33640 1 -- 172.21.15.53:0/2895123631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa840102820 msgr2=0x7fa840102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:45.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.675+0000 7fa847e33640 1 --2- 172.21.15.53:0/2895123631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa840102820 0x7fa840102c30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009900 tx=0x7fa83c02a410 comp rx=0 tx=0).stop 2024-08-31T06:02:45.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.675+0000 7fa847e33640 1 -- 172.21.15.53:0/2895123631 shutdown_connections 2024-08-31T06:02:45.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.675+0000 7fa847e33640 1 --2- 172.21.15.53:0/2895123631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa840108ab0 0x7fa84010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:45.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.675+0000 7fa847e33640 1 --2- 172.21.15.53:0/2895123631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa840108160 0x7fa840108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:45.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.675+0000 7fa847e33640 1 --2- 172.21.15.53:0/2895123631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa840102820 0x7fa840102c30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:45.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.675+0000 7fa847e33640 1 -- 172.21.15.53:0/2895123631 >> 172.21.15.53:0/2895123631 conn(0x7fa8400794e0 msgr2=0x7fa8400798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:45.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.675+0000 7fa847e33640 1 -- 172.21.15.53:0/2895123631 shutdown_connections 2024-08-31T06:02:45.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.675+0000 7fa847e33640 1 -- 172.21.15.53:0/2895123631 wait complete. 2024-08-31T06:02:45.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.676+0000 7fa847e33640 1 Processor -- start 2024-08-31T06:02:45.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.676+0000 7fa847e33640 1 -- start start 2024-08-31T06:02:45.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.676+0000 7fa847e33640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa840102820 0x7fa840199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:45.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa847e33640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa840108160 0x7fa840199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:45.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa847e33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa840108ab0 0x7fa84019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa847e33640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa840112630 con 0x7fa840108ab0 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa847e33640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401124b0 con 0x7fa840108160 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa847e33640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401127b0 con 0x7fa840102820 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa8463d0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa840108ab0 0x7fa84019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa845bcf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa840102820 0x7fa840199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa8463d0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa840108ab0 0x7fa84019e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47412/0 (socket says 172.21.15.53:47412) 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa8463d0640 1 -- 172.21.15.53:0/1566360672 learned_addr learned my addr 172.21.15.53:0/1566360672 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa8453ce640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa840108160 0x7fa840199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa8463d0640 1 -- 172.21.15.53:0/1566360672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa840102820 msgr2=0x7fa840199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa8463d0640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa840102820 0x7fa840199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa8463d0640 1 -- 172.21.15.53:0/1566360672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa840108160 msgr2=0x7fa840199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa8463d0640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa840108160 0x7fa840199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:45.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa8463d0640 1 -- 172.21.15.53:0/1566360672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84019eff0 con 0x7fa840108ab0 2024-08-31T06:02:45.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.677+0000 7fa8463d0640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa840108ab0 0x7fa84019e8c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa83800eaa0 tx=0x7fa83800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:45.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.679+0000 7fa836ffd640 1 -- 172.21.15.53:0/1566360672 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838004d20 con 0x7fa840108ab0 2024-08-31T06:02:45.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.679+0000 7fa836ffd640 1 -- 172.21.15.53:0/1566360672 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa838005020 con 0x7fa840108ab0 2024-08-31T06:02:45.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.679+0000 7fa836ffd640 1 -- 172.21.15.53:0/1566360672 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8380116d0 con 0x7fa840108ab0 2024-08-31T06:02:45.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.679+0000 7fa847e33640 1 -- 172.21.15.53:0/1566360672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84019f2e0 con 0x7fa840108ab0 2024-08-31T06:02:45.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.679+0000 7fa847e33640 1 -- 172.21.15.53:0/1566360672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84006b8e0 con 0x7fa840108ab0 2024-08-31T06:02:45.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.680+0000 7fa847e33640 1 -- 172.21.15.53:0/1566360672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa840103aa0 con 0x7fa840108ab0 2024-08-31T06:02:45.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.682+0000 7fa836ffd640 1 -- 172.21.15.53:0/1566360672 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa8380051d0 con 0x7fa840108ab0 2024-08-31T06:02:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.683+0000 7fa836ffd640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa82c0b4c90 0x7fa82c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.683+0000 7fa845bcf640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa82c0b4c90 0x7fa82c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.683+0000 7fa836ffd640 1 -- 172.21.15.53:0/1566360672 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7fa8380e57e0 con 0x7fa840108ab0 2024-08-31T06:02:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.684+0000 7fa845bcf640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa82c0b4c90 0x7fa82c0b71a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0057c0 tx=0x7fa83c0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:45.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.686+0000 7fa836ffd640 1 -- 172.21.15.53:0/1566360672 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa838016030 con 0x7fa840108ab0 2024-08-31T06:02:45.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.898+0000 7fa847e33640 1 -- 172.21.15.53:0/1566360672 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa84006c3d0 con 0x7fa82c0b4c90 2024-08-31T06:02:45.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.925+0000 7fa836ffd640 1 -- 172.21.15.53:0/1566360672 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa84006c3d0 con 0x7fa82c0b4c90 2024-08-31T06:02:45.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:45 smithi053 ceph-mon[18924]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:45.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:45 smithi053 ceph-mon[18924]: pgmap v253: 97 pgs: 97 active+clean; 583 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-08-31T06:02:45.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:45 smithi053 ceph-mon[18924]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-08-31T06:02:45.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.927+0000 7fa847e33640 1 -- 172.21.15.53:0/1566360672 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa82c0b4c90 msgr2=0x7fa82c0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:45.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.927+0000 7fa847e33640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa82c0b4c90 0x7fa82c0b71a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0057c0 tx=0x7fa83c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:02:45.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.927+0000 7fa847e33640 1 -- 172.21.15.53:0/1566360672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa840108ab0 msgr2=0x7fa84019e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:45.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.927+0000 7fa847e33640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa840108ab0 0x7fa84019e8c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa83800eaa0 tx=0x7fa83800eea0 comp rx=0 tx=0).stop 2024-08-31T06:02:45.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.927+0000 7fa847e33640 1 -- 172.21.15.53:0/1566360672 shutdown_connections 2024-08-31T06:02:45.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.927+0000 7fa847e33640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa82c0b4c90 0x7fa82c0b71a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:45.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.927+0000 7fa847e33640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa840108ab0 0x7fa84019e8c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:45.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.927+0000 7fa847e33640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa840108160 0x7fa840199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:45.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.927+0000 7fa847e33640 1 --2- 172.21.15.53:0/1566360672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa840102820 0x7fa840199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:45.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.927+0000 7fa847e33640 1 -- 172.21.15.53:0/1566360672 >> 172.21.15.53:0/1566360672 conn(0x7fa8400794e0 msgr2=0x7fa8401012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:45.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.928+0000 7fa847e33640 1 -- 172.21.15.53:0/1566360672 shutdown_connections 2024-08-31T06:02:45.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:45.928+0000 7fa847e33640 1 -- 172.21.15.53:0/1566360672 wait complete. 2024-08-31T06:02:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:45 smithi130 ceph-mon[22266]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:45 smithi130 ceph-mon[22266]: pgmap v253: 97 pgs: 97 active+clean; 583 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-08-31T06:02:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:45 smithi130 ceph-mon[22266]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-08-31T06:02:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:45 smithi153 ceph-mon[22320]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:45 smithi153 ceph-mon[22320]: pgmap v253: 97 pgs: 97 active+clean; 583 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-08-31T06:02:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:45 smithi153 ceph-mon[22320]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-08-31T06:02:46.618 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-31T06:02:46.628 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:02:46 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:02:46.216+0000 7f2f9bf06640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-08-31T06:02:46.875 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:46.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:46 smithi053 ceph-mon[18924]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:47.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:46 smithi130 ceph-mon[22266]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:47.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:46 smithi153 ceph-mon[22320]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.348+0000 7f672c898640 1 -- 172.21.15.53:0/692797382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728103900 msgr2=0x7f6728103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.348+0000 7f672c898640 1 --2- 172.21.15.53:0/692797382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728103900 0x7f6728103d10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6718009900 tx=0x7f671802a410 comp rx=0 tx=0).stop 2024-08-31T06:02:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.349+0000 7f672c898640 1 -- 172.21.15.53:0/692797382 shutdown_connections 2024-08-31T06:02:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.349+0000 7f672c898640 1 --2- 172.21.15.53:0/692797382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728109b90 0x7f67281103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.349+0000 7f672c898640 1 --2- 172.21.15.53:0/692797382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728109240 0x7f6728109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.349+0000 7f672c898640 1 --2- 172.21.15.53:0/692797382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728103900 0x7f6728103d10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.349+0000 7f672c898640 1 -- 172.21.15.53:0/692797382 >> 172.21.15.53:0/692797382 conn(0x7f672807b5f0 msgr2=0x7f672807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.349+0000 7f672c898640 1 -- 172.21.15.53:0/692797382 shutdown_connections 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.349+0000 7f672c898640 1 -- 172.21.15.53:0/692797382 wait complete. 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.349+0000 7f672c898640 1 Processor -- start 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.349+0000 7f672c898640 1 -- start start 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f672c898640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728103900 0x7f672819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f672c898640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728109240 0x7f672819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f672c898640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728109b90 0x7f672819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f672c898640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6728113740 con 0x7f6728109240 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f672c898640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67281135c0 con 0x7f6728103900 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f672c898640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67281138c0 con 0x7f6728109b90 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f6725d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728109240 0x7f672819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f6725d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728109240 0x7f672819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47416/0 (socket says 172.21.15.53:47416) 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f6725d9b640 1 -- 172.21.15.53:0/3287314005 learned_addr learned my addr 172.21.15.53:0/3287314005 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f672659c640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728103900 0x7f672819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f6726d9d640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728109b90 0x7f672819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f6725d9b640 1 -- 172.21.15.53:0/3287314005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728109b90 msgr2=0x7f672819f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f6725d9b640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728109b90 0x7f672819f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f6725d9b640 1 -- 172.21.15.53:0/3287314005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728103900 msgr2=0x7f672819a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f6725d9b640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728103900 0x7f672819a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f6725d9b640 1 -- 172.21.15.53:0/3287314005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67281a0100 con 0x7f6728109240 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f6726d9d640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728109b90 0x7f672819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.350+0000 7f6725d9b640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728109240 0x7f672819a730 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f671c006fd0 tx=0x7f671c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.351+0000 7f67177fe640 1 -- 172.21.15.53:0/3287314005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c011830 con 0x7f6728109240 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.351+0000 7f67177fe640 1 -- 172.21.15.53:0/3287314005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f671c016070 con 0x7f6728109240 2024-08-31T06:02:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.351+0000 7f672c898640 1 -- 172.21.15.53:0/3287314005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67281a03f0 con 0x7f6728109240 2024-08-31T06:02:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.351+0000 7f67177fe640 1 -- 172.21.15.53:0/3287314005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c010d30 con 0x7f6728109240 2024-08-31T06:02:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.351+0000 7f672c898640 1 -- 172.21.15.53:0/3287314005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67281a6b50 con 0x7f6728109240 2024-08-31T06:02:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.352+0000 7f672c898640 1 -- 172.21.15.53:0/3287314005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6728103d10 con 0x7f6728109240 2024-08-31T06:02:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.353+0000 7f67177fe640 1 -- 172.21.15.53:0/3287314005 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f671c0119d0 con 0x7f6728109240 2024-08-31T06:02:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.354+0000 7f67177fe640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4c10 0x7f67100b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.354+0000 7f672659c640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4c10 0x7f67100b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.354+0000 7f67177fe640 1 -- 172.21.15.53:0/3287314005 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f671c0e4f10 con 0x7f6728109240 2024-08-31T06:02:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.354+0000 7f672659c640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4c10 0x7f67100b7120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f67180057c0 tx=0x7f67180058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.357+0000 7f67177fe640 1 -- 172.21.15.53:0/3287314005 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f671c0abf00 con 0x7f6728109240 2024-08-31T06:02:47.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.572+0000 7f672c898640 1 -- 172.21.15.53:0/3287314005 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f672810b9c0 con 0x7f67100b4c10 2024-08-31T06:02:47.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.578+0000 7f67177fe640 1 -- 172.21.15.53:0/3287314005 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f672810b9c0 con 0x7f67100b4c10 2024-08-31T06:02:47.580 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f 2024-08-31T06:02:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 -- 172.21.15.53:0/3287314005 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4c10 msgr2=0x7f67100b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4c10 0x7f67100b7120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f67180057c0 tx=0x7f67180058d0 comp rx=0 tx=0).stop 2024-08-31T06:02:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 -- 172.21.15.53:0/3287314005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728109240 msgr2=0x7f672819a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728109240 0x7f672819a730 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f671c006fd0 tx=0x7f671c00b8e0 comp rx=0 tx=0).stop 2024-08-31T06:02:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 -- 172.21.15.53:0/3287314005 shutdown_connections 2024-08-31T06:02:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4c10 0x7f67100b7120 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728109b90 0x7f672819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728109240 0x7f672819a730 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 --2- 172.21.15.53:0/3287314005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728103900 0x7f672819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 -- 172.21.15.53:0/3287314005 >> 172.21.15.53:0/3287314005 conn(0x7f672807b5f0 msgr2=0x7f6728107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 -- 172.21.15.53:0/3287314005 shutdown_connections 2024-08-31T06:02:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:47.580+0000 7f672c898640 1 -- 172.21.15.53:0/3287314005 wait complete. 2024-08-31T06:02:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:47 smithi053 ceph-mon[18924]: pgmap v254: 97 pgs: 97 active+clean; 585 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-08-31T06:02:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:47 smithi130 ceph-mon[22266]: pgmap v254: 97 pgs: 97 active+clean; 585 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-08-31T06:02:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:47 smithi153 ceph-mon[22320]: pgmap v254: 97 pgs: 97 active+clean; 585 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-08-31T06:02:48.197 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-31T06:02:48.451 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:48.838 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:48 smithi053 ceph-mon[18924]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:48.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.932+0000 7f49d31b5640 1 -- 172.21.15.53:0/453440311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49cc104f80 msgr2=0x7f49cc105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:48.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.932+0000 7f49d31b5640 1 --2- 172.21.15.53:0/453440311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49cc104f80 0x7f49cc105390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009900 tx=0x7f49b802a410 comp rx=0 tx=0).stop 2024-08-31T06:02:48.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.932+0000 7f49d31b5640 1 -- 172.21.15.53:0/453440311 shutdown_connections 2024-08-31T06:02:48.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.932+0000 7f49d31b5640 1 --2- 172.21.15.53:0/453440311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc1058d0 0x7f49cc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:48.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.932+0000 7f49d31b5640 1 --2- 172.21.15.53:0/453440311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49cc104f80 0x7f49cc105390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:48.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.932+0000 7f49d31b5640 1 --2- 172.21.15.53:0/453440311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49cc102fb0 0x7f49cc1033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:48.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.933+0000 7f49d31b5640 1 -- 172.21.15.53:0/453440311 >> 172.21.15.53:0/453440311 conn(0x7f49cc079d30 msgr2=0x7f49cc07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:48.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.933+0000 7f49d31b5640 1 -- 172.21.15.53:0/453440311 shutdown_connections 2024-08-31T06:02:48.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.933+0000 7f49d31b5640 1 -- 172.21.15.53:0/453440311 wait complete. 2024-08-31T06:02:48.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.933+0000 7f49d31b5640 1 Processor -- start 2024-08-31T06:02:48.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.933+0000 7f49d31b5640 1 -- start start 2024-08-31T06:02:48.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49d31b5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49cc102fb0 0x7f49cc19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:48.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49d31b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49cc104f80 0x7f49cc19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49d31b5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc1058d0 0x7f49cc19fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49d31b5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc113760 con 0x7f49cc104f80 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49d31b5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1135e0 con 0x7f49cc1058d0 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49d31b5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1138e0 con 0x7f49cc102fb0 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49cc104f80 0x7f49cc19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49cc104f80 0x7f49cc19a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47424/0 (socket says 172.21.15.53:47424) 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49cbfff640 1 -- 172.21.15.53:0/4214104318 learned_addr learned my addr 172.21.15.53:0/4214104318 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49d0f51640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49cc102fb0 0x7f49cc19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49d1752640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc1058d0 0x7f49cc19fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49cbfff640 1 -- 172.21.15.53:0/4214104318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49cc102fb0 msgr2=0x7f49cc19a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49cbfff640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49cc102fb0 0x7f49cc19a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49cbfff640 1 -- 172.21.15.53:0/4214104318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc1058d0 msgr2=0x7f49cc19fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49cbfff640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc1058d0 0x7f49cc19fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49cbfff640 1 -- 172.21.15.53:0/4214104318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49cc1a01e0 con 0x7f49cc104f80 2024-08-31T06:02:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49d1752640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc1058d0 0x7f49cc19fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:02:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49cbfff640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49cc104f80 0x7f49cc19a810 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49b8005940 tx=0x7f49b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49c9ffb640 1 -- 172.21.15.53:0/4214104318 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b803f030 con 0x7f49cc104f80 2024-08-31T06:02:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49c9ffb640 1 -- 172.21.15.53:0/4214104318 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49b8003c90 con 0x7f49cc104f80 2024-08-31T06:02:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49d31b5640 1 -- 172.21.15.53:0/4214104318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49cc1a0470 con 0x7f49cc104f80 2024-08-31T06:02:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.934+0000 7f49c9ffb640 1 -- 172.21.15.53:0/4214104318 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8035070 con 0x7f49cc104f80 2024-08-31T06:02:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.935+0000 7f49d31b5640 1 -- 172.21.15.53:0/4214104318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49cc1a6c30 con 0x7f49cc104f80 2024-08-31T06:02:48.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.936+0000 7f49d31b5640 1 -- 172.21.15.53:0/4214104318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49cc06b690 con 0x7f49cc104f80 2024-08-31T06:02:48.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.937+0000 7f49c9ffb640 1 -- 172.21.15.53:0/4214104318 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f49b8042030 con 0x7f49cc104f80 2024-08-31T06:02:48.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.938+0000 7f49c9ffb640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49bc0b4c10 0x7f49bc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:48.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.938+0000 7f49d0f51640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49bc0b4c10 0x7f49bc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:48.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.938+0000 7f49c9ffb640 1 -- 172.21.15.53:0/4214104318 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f49b8105880 con 0x7f49cc104f80 2024-08-31T06:02:48.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.939+0000 7f49d0f51640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49bc0b4c10 0x7f49bc0b7120 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009990 tx=0x7f49c0009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:48.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:48.943+0000 7f49c9ffb640 1 -- 172.21.15.53:0/4214104318 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f49b80cc870 con 0x7f49cc104f80 2024-08-31T06:02:49.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:48 smithi130 ceph-mon[22266]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:49.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.155+0000 7f49d31b5640 1 -- 172.21.15.53:0/4214104318 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f49cc0635a0 con 0x7f49bc0b4c10 2024-08-31T06:02:49.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:48 smithi153 ceph-mon[22320]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.187+0000 7f49c9ffb640 1 -- 172.21.15.53:0/4214104318 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f49cc0635a0 con 0x7f49bc0b4c10 2024-08-31T06:02:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 -- 172.21.15.53:0/4214104318 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49bc0b4c10 msgr2=0x7f49bc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49bc0b4c10 0x7f49bc0b7120 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009990 tx=0x7f49c0009110 comp rx=0 tx=0).stop 2024-08-31T06:02:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 -- 172.21.15.53:0/4214104318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49cc104f80 msgr2=0x7f49cc19a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49cc104f80 0x7f49cc19a810 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49b8005940 tx=0x7f49b80042f0 comp rx=0 tx=0).stop 2024-08-31T06:02:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 -- 172.21.15.53:0/4214104318 shutdown_connections 2024-08-31T06:02:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49bc0b4c10 0x7f49bc0b7120 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49cc1058d0 0x7f49cc19fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49cc104f80 0x7f49cc19a810 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 --2- 172.21.15.53:0/4214104318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49cc102fb0 0x7f49cc19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 -- 172.21.15.53:0/4214104318 >> 172.21.15.53:0/4214104318 conn(0x7f49cc079d30 msgr2=0x7f49cc106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 -- 172.21.15.53:0/4214104318 shutdown_connections 2024-08-31T06:02:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:49.189+0000 7f49d31b5640 1 -- 172.21.15.53:0/4214104318 wait complete. 2024-08-31T06:02:49.914 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-31T06:02:49.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:49 smithi053 ceph-mon[18924]: pgmap v255: 97 pgs: 97 active+clean; 605 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-08-31T06:02:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:49 smithi053 ceph-mon[18924]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:49 smithi130 ceph-mon[22266]: pgmap v255: 97 pgs: 97 active+clean; 605 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-08-31T06:02:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:49 smithi130 ceph-mon[22266]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:49 smithi153 ceph-mon[22320]: pgmap v255: 97 pgs: 97 active+clean; 605 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-08-31T06:02:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:49 smithi153 ceph-mon[22320]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:50.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.616+0000 7f697d568640 1 -- 172.21.15.53:0/3967376476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6978108b10 msgr2=0x7f697810f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:50.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.616+0000 7f697d568640 1 --2- 172.21.15.53:0/3967376476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6978108b10 0x7f697810f340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6970009ca0 tx=0x7f697002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:02:50.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.616+0000 7f697d568640 1 -- 172.21.15.53:0/3967376476 shutdown_connections 2024-08-31T06:02:50.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.616+0000 7f697d568640 1 --2- 172.21.15.53:0/3967376476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6978108b10 0x7f697810f340 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:50.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.616+0000 7f697d568640 1 --2- 172.21.15.53:0/3967376476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69781081c0 0x7f69781085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:50.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.616+0000 7f697d568640 1 --2- 172.21.15.53:0/3967376476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6978102880 0x7f6978102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:50.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.616+0000 7f697d568640 1 -- 172.21.15.53:0/3967376476 >> 172.21.15.53:0/3967376476 conn(0x7f6978079510 msgr2=0x7f6978079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:50.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.616+0000 7f697d568640 1 -- 172.21.15.53:0/3967376476 shutdown_connections 2024-08-31T06:02:50.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.617+0000 7f697d568640 1 -- 172.21.15.53:0/3967376476 wait complete. 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.617+0000 7f697d568640 1 Processor -- start 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.617+0000 7f697d568640 1 -- start start 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f697d568640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6978102880 0x7f697819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f697d568640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69781081c0 0x7f697819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f697d568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6978108b10 0x7f697819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f697d568640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6978112730 con 0x7f6978108b10 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f697d568640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69781125b0 con 0x7f69781081c0 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f697d568640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69781128b0 con 0x7f6978102880 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f69777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6978108b10 0x7f697819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f69777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6978108b10 0x7f697819fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47446/0 (socket says 172.21.15.53:47446) 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f69777fe640 1 -- 172.21.15.53:0/322465164 learned_addr learned my addr 172.21.15.53:0/322465164 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f6976ffd640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6978102880 0x7f697819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:50.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f69767fc640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69781081c0 0x7f697819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f69777fe640 1 -- 172.21.15.53:0/322465164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6978102880 msgr2=0x7f697819a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f69777fe640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6978102880 0x7f697819a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f69777fe640 1 -- 172.21.15.53:0/322465164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69781081c0 msgr2=0x7f697819a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f69777fe640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69781081c0 0x7f697819a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f69777fe640 1 -- 172.21.15.53:0/322465164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69781a00a0 con 0x7f6978108b10 2024-08-31T06:02:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.618+0000 7f69777fe640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6978108b10 0x7f697819fa30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6970005cc0 tx=0x7f6970032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.619+0000 7f695ffff640 1 -- 172.21.15.53:0/322465164 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970004040 con 0x7f6978108b10 2024-08-31T06:02:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.619+0000 7f695ffff640 1 -- 172.21.15.53:0/322465164 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6970004670 con 0x7f6978108b10 2024-08-31T06:02:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.619+0000 7f697d568640 1 -- 172.21.15.53:0/322465164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69781a0330 con 0x7f6978108b10 2024-08-31T06:02:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.619+0000 7f695ffff640 1 -- 172.21.15.53:0/322465164 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970030cc0 con 0x7f6978108b10 2024-08-31T06:02:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.619+0000 7f697d568640 1 -- 172.21.15.53:0/322465164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69781a0870 con 0x7f6978108b10 2024-08-31T06:02:50.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.620+0000 7f697d568640 1 -- 172.21.15.53:0/322465164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6978103b00 con 0x7f6978108b10 2024-08-31T06:02:50.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.621+0000 7f695ffff640 1 -- 172.21.15.53:0/322465164 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f69700041e0 con 0x7f6978108b10 2024-08-31T06:02:50.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.622+0000 7f695ffff640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69600b4c40 0x7f69600b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:50.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.622+0000 7f6976ffd640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69600b4c40 0x7f69600b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:50.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.622+0000 7f695ffff640 1 -- 172.21.15.53:0/322465164 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f6970106960 con 0x7f6978108b10 2024-08-31T06:02:50.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.622+0000 7f6976ffd640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69600b4c40 0x7f69600b7150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6968009990 tx=0x7f6968009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.626+0000 7f695ffff640 1 -- 172.21.15.53:0/322465164 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f69700cd950 con 0x7f6978108b10 2024-08-31T06:02:50.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.839+0000 7f697d568640 1 -- 172.21.15.53:0/322465164 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f69780635a0 con 0x7f69600b4c40 2024-08-31T06:02:50.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.845+0000 7f695ffff640 1 -- 172.21.15.53:0/322465164 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f69780635a0 con 0x7f69600b4c40 2024-08-31T06:02:50.847 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/qa/sv_1/80118854-9463-4484-8faa-25f7d14faee5 2024-08-31T06:02:50.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 -- 172.21.15.53:0/322465164 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69600b4c40 msgr2=0x7f69600b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:50.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69600b4c40 0x7f69600b7150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6968009990 tx=0x7f6968009110 comp rx=0 tx=0).stop 2024-08-31T06:02:50.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 -- 172.21.15.53:0/322465164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6978108b10 msgr2=0x7f697819fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:50.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6978108b10 0x7f697819fa30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6970005cc0 tx=0x7f6970032c40 comp rx=0 tx=0).stop 2024-08-31T06:02:50.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 -- 172.21.15.53:0/322465164 shutdown_connections 2024-08-31T06:02:50.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69600b4c40 0x7f69600b7150 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6978108b10 0x7f697819fa30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69781081c0 0x7f697819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 --2- 172.21.15.53:0/322465164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6978102880 0x7f697819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 -- 172.21.15.53:0/322465164 >> 172.21.15.53:0/322465164 conn(0x7f6978079510 msgr2=0x7f6978101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 -- 172.21.15.53:0/322465164 shutdown_connections 2024-08-31T06:02:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:50.847+0000 7f697d568640 1 -- 172.21.15.53:0/322465164 wait complete. 2024-08-31T06:02:51.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:02:51.896 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:51 smithi053 ceph-mon[18924]: pgmap v256: 97 pgs: 97 active+clean; 606 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-08-31T06:02:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:51 smithi053 ceph-mon[18924]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:51 smithi130 ceph-mon[22266]: pgmap v256: 97 pgs: 97 active+clean; 606 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-08-31T06:02:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:51 smithi130 ceph-mon[22266]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:51 smithi153 ceph-mon[22320]: pgmap v256: 97 pgs: 97 active+clean; 606 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-08-31T06:02:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:51 smithi153 ceph-mon[22320]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:52.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.394+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/3349902154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b08109240 msgr2=0x7f6b08109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.394+0000 7f6b0d8ea640 1 --2- 172.21.15.53:0/3349902154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b08109240 0x7f6b08109650 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009900 tx=0x7f6afc02a410 comp rx=0 tx=0).stop 2024-08-31T06:02:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.394+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/3349902154 shutdown_connections 2024-08-31T06:02:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.394+0000 7f6b0d8ea640 1 --2- 172.21.15.53:0/3349902154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b08109b90 0x7f6b081103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.394+0000 7f6b0d8ea640 1 --2- 172.21.15.53:0/3349902154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b08109240 0x7f6b08109650 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.394+0000 7f6b0d8ea640 1 --2- 172.21.15.53:0/3349902154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b08103900 0x7f6b08103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.394+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/3349902154 >> 172.21.15.53:0/3349902154 conn(0x7f6b0807b5f0 msgr2=0x7f6b0807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.394+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/3349902154 shutdown_connections 2024-08-31T06:02:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.394+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/3349902154 wait complete. 2024-08-31T06:02:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.395+0000 7f6b0d8ea640 1 Processor -- start 2024-08-31T06:02:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.395+0000 7f6b0d8ea640 1 -- start start 2024-08-31T06:02:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.395+0000 7f6b0d8ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b08103900 0x7f6b0819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b0d8ea640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b08109240 0x7f6b0819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b0d8ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b08109b90 0x7f6b0819fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b0d8ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6b08113720 con 0x7f6b08109b90 2024-08-31T06:02:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b0d8ea640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6b081135a0 con 0x7f6b08103900 2024-08-31T06:02:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b0d8ea640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b081138a0 con 0x7f6b08109240 2024-08-31T06:02:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b08109b90 0x7f6b0819fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b08109b90 0x7f6b0819fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47460/0 (socket says 172.21.15.53:47460) 2024-08-31T06:02:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b077fe640 1 -- 172.21.15.53:0/2278321213 learned_addr learned my addr 172.21.15.53:0/2278321213 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b067fc640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b08109240 0x7f6b0819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b06ffd640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b08103900 0x7f6b0819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b077fe640 1 -- 172.21.15.53:0/2278321213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b08109240 msgr2=0x7f6b0819a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b077fe640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b08109240 0x7f6b0819a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b077fe640 1 -- 172.21.15.53:0/2278321213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b08103900 msgr2=0x7f6b0819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b077fe640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b08103900 0x7f6b0819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b077fe640 1 -- 172.21.15.53:0/2278321213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b081a01c0 con 0x7f6b08109b90 2024-08-31T06:02:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b077fe640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b08109b90 0x7f6b0819fa90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000b970 tx=0x7f6b0000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.396+0000 7f6b0c8e8640 1 -- 172.21.15.53:0/2278321213 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00019070 con 0x7f6b08109b90 2024-08-31T06:02:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.397+0000 7f6b0c8e8640 1 -- 172.21.15.53:0/2278321213 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b00014440 con 0x7f6b08109b90 2024-08-31T06:02:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.397+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/2278321213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b081a04b0 con 0x7f6b08109b90 2024-08-31T06:02:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.397+0000 7f6b0c8e8640 1 -- 172.21.15.53:0/2278321213 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b000075d0 con 0x7f6b08109b90 2024-08-31T06:02:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.397+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/2278321213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b081a6c10 con 0x7f6b08109b90 2024-08-31T06:02:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.398+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/2278321213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b08103d10 con 0x7f6b08109b90 2024-08-31T06:02:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.399+0000 7f6b0c8e8640 1 -- 172.21.15.53:0/2278321213 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f6b0001c070 con 0x7f6b08109b90 2024-08-31T06:02:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.400+0000 7f6b0c8e8640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6af00b4c10 0x7f6af00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.400+0000 7f6b06ffd640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6af00b4c10 0x7f6af00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.400+0000 7f6b0c8e8640 1 -- 172.21.15.53:0/2278321213 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f6b000e4c30 con 0x7f6b08109b90 2024-08-31T06:02:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.401+0000 7f6b06ffd640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6af00b4c10 0x7f6af00b7120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6af800bbe0 tx=0x7f6af800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.403+0000 7f6b0c8e8640 1 -- 172.21.15.53:0/2278321213 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6b000ab570 con 0x7f6b08109b90 2024-08-31T06:02:52.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.624+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/2278321213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b0819b380 con 0x7f6b08109b90 2024-08-31T06:02:52.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.625+0000 7f6b0c8e8640 1 -- 172.21.15.53:0/2278321213 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11985 (secure 0 0 0) 0x7f6b0819b380 con 0x7f6b08109b90 2024-08-31T06:02:52.627 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:52.628 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"btime":"2024-08-31T06:02:42:670578+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:02:42.670556+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:02:52.628 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 27 2024-08-31T06:02:52.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.627+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/2278321213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6af00b4c10 msgr2=0x7f6af00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:52.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.627+0000 7f6b0d8ea640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6af00b4c10 0x7f6af00b7120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6af800bbe0 tx=0x7f6af800b390 comp rx=0 tx=0).stop 2024-08-31T06:02:52.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.627+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/2278321213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b08109b90 msgr2=0x7f6b0819fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:52.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.627+0000 7f6b0d8ea640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b08109b90 0x7f6b0819fa90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000b970 tx=0x7f6b0000be30 comp rx=0 tx=0).stop 2024-08-31T06:02:52.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.628+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/2278321213 shutdown_connections 2024-08-31T06:02:52.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.628+0000 7f6b0d8ea640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6af00b4c10 0x7f6af00b7120 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:52.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.628+0000 7f6b0d8ea640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b08109b90 0x7f6b0819fa90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:52.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.628+0000 7f6b0d8ea640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b08109240 0x7f6b0819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:52.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.628+0000 7f6b0d8ea640 1 --2- 172.21.15.53:0/2278321213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b08103900 0x7f6b0819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:52.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.628+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/2278321213 >> 172.21.15.53:0/2278321213 conn(0x7f6b0807b5f0 msgr2=0x7f6b081073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:52.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.628+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/2278321213 shutdown_connections 2024-08-31T06:02:52.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:52.628+0000 7f6b0d8ea640 1 -- 172.21.15.53:0/2278321213 wait complete. 2024-08-31T06:02:52.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:52 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2278321213' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:53.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:52 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2278321213' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:53.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:52 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2278321213' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:02:53.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:02:53.541 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:53.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:53 smithi053 ceph-mon[18924]: pgmap v257: 97 pgs: 97 active+clean; 606 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.9 KiB/s wr, 21 op/s 2024-08-31T06:02:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.018+0000 7f4f94b02640 1 -- 172.21.15.53:0/1849436409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f90101e20 msgr2=0x7f4f90102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.018+0000 7f4f94b02640 1 --2- 172.21.15.53:0/1849436409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f90101e20 0x7f4f90102230 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009900 tx=0x7f4f8002a410 comp rx=0 tx=0).stop 2024-08-31T06:02:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.018+0000 7f4f94b02640 1 -- 172.21.15.53:0/1849436409 shutdown_connections 2024-08-31T06:02:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.018+0000 7f4f94b02640 1 --2- 172.21.15.53:0/1849436409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f90109c50 0x7f4f90110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.018+0000 7f4f94b02640 1 --2- 172.21.15.53:0/1849436409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f90109300 0x7f4f90109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.018+0000 7f4f94b02640 1 --2- 172.21.15.53:0/1849436409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f90101e20 0x7f4f90102230 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.018+0000 7f4f94b02640 1 -- 172.21.15.53:0/1849436409 >> 172.21.15.53:0/1849436409 conn(0x7f4f90079c60 msgr2=0x7f4f9007a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.018+0000 7f4f94b02640 1 -- 172.21.15.53:0/1849436409 shutdown_connections 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.018+0000 7f4f94b02640 1 -- 172.21.15.53:0/1849436409 wait complete. 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.019+0000 7f4f94b02640 1 Processor -- start 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.019+0000 7f4f94b02640 1 -- start start 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.019+0000 7f4f94b02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f90101e20 0x7f4f90102dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.019+0000 7f4f94b02640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f90109300 0x7f4f90103300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.019+0000 7f4f94b02640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f90109c50 0x7f4f90103840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.019+0000 7f4f94b02640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4f901137c0 con 0x7f4f90101e20 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.019+0000 7f4f94b02640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90113640 con 0x7f4f90109c50 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.019+0000 7f4f94b02640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90113940 con 0x7f4f90109300 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f90101e20 0x7f4f90102dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f90101e20 0x7f4f90102dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60432/0 (socket says 172.21.15.53:60432) 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8e59c640 1 -- 172.21.15.53:0/933842470 learned_addr learned my addr 172.21.15.53:0/933842470 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8dd9b640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f90109300 0x7f4f90103300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8ed9d640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f90109c50 0x7f4f90103840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8e59c640 1 -- 172.21.15.53:0/933842470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f90109300 msgr2=0x7f4f90103300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8e59c640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f90109300 0x7f4f90103300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8e59c640 1 -- 172.21.15.53:0/933842470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f90109c50 msgr2=0x7f4f90103840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8e59c640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f90109c50 0x7f4f90103840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8e59c640 1 -- 172.21.15.53:0/933842470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f901a84d0 con 0x7f4f90101e20 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8ed9d640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f90109c50 0x7f4f90103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f8e59c640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f90101e20 0x7f4f90102dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009230 tx=0x7f4f80004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f7f7fe640 1 -- 172.21.15.53:0/933842470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8003f030 con 0x7f4f90101e20 2024-08-31T06:02:54.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f7f7fe640 1 -- 172.21.15.53:0/933842470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f80003a80 con 0x7f4f90101e20 2024-08-31T06:02:54.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f94b02640 1 -- 172.21.15.53:0/933842470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f901a8760 con 0x7f4f90101e20 2024-08-31T06:02:54.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f7f7fe640 1 -- 172.21.15.53:0/933842470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80035070 con 0x7f4f90101e20 2024-08-31T06:02:54.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.020+0000 7f4f94b02640 1 -- 172.21.15.53:0/933842470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f901a8c40 con 0x7f4f90101e20 2024-08-31T06:02:54.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.021+0000 7f4f94b02640 1 -- 172.21.15.53:0/933842470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f90102230 con 0x7f4f90101e20 2024-08-31T06:02:54.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.023+0000 7f4f7f7fe640 1 -- 172.21.15.53:0/933842470 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f4f80042030 con 0x7f4f90101e20 2024-08-31T06:02:54.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.024+0000 7f4f7f7fe640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f780b4c10 0x7f4f780b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:54.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.024+0000 7f4f8dd9b640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f780b4c10 0x7f4f780b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:54.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.024+0000 7f4f7f7fe640 1 -- 172.21.15.53:0/933842470 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f4f80105e30 con 0x7f4f90101e20 2024-08-31T06:02:54.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.024+0000 7f4f8dd9b640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f780b4c10 0x7f4f780b7120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4f9007a5c0 tx=0x7f4f8400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:54.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.027+0000 7f4f7f7fe640 1 -- 172.21.15.53:0/933842470 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4f800cce20 con 0x7f4f90101e20 2024-08-31T06:02:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:53 smithi130 ceph-mon[22266]: pgmap v257: 97 pgs: 97 active+clean; 606 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.9 KiB/s wr, 21 op/s 2024-08-31T06:02:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:53 smithi153 ceph-mon[22320]: pgmap v257: 97 pgs: 97 active+clean; 606 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.9 KiB/s wr, 21 op/s 2024-08-31T06:02:54.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.213+0000 7f4f94b02640 1 -- 172.21.15.53:0/933842470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f901040c0 con 0x7f4f90101e20 2024-08-31T06:02:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.215+0000 7f4f7f7fe640 1 -- 172.21.15.53:0/933842470 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+22585 (secure 0 0 0) 0x7f4f800d5360 con 0x7f4f90101e20 2024-08-31T06:02:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:54.218 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":70,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:02:31.233657+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:02:54.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 -- 172.21.15.53:0/933842470 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f780b4c10 msgr2=0x7f4f780b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:54.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f780b4c10 0x7f4f780b7120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4f9007a5c0 tx=0x7f4f8400b390 comp rx=0 tx=0).stop 2024-08-31T06:02:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 -- 172.21.15.53:0/933842470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f90101e20 msgr2=0x7f4f90102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f90101e20 0x7f4f90102dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009230 tx=0x7f4f80004270 comp rx=0 tx=0).stop 2024-08-31T06:02:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 -- 172.21.15.53:0/933842470 shutdown_connections 2024-08-31T06:02:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f780b4c10 0x7f4f780b7120 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f90109c50 0x7f4f90103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f90109300 0x7f4f90103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 --2- 172.21.15.53:0/933842470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f90101e20 0x7f4f90102dc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 -- 172.21.15.53:0/933842470 >> 172.21.15.53:0/933842470 conn(0x7f4f90079c60 msgr2=0x7f4f901073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 -- 172.21.15.53:0/933842470 shutdown_connections 2024-08-31T06:02:54.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:54.217+0000 7f4f94b02640 1 -- 172.21.15.53:0/933842470 wait complete. 2024-08-31T06:02:54.901 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:54 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/933842470' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:02:54.931 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T06:02:54.931 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:02:55.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:54 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/933842470' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:02:55.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:54 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/933842470' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:02:55.183 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:55.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.634+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/1725440163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c94102880 msgr2=0x7f2c94102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:55.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.634+0000 7f2c9c5d8640 1 --2- 172.21.15.53:0/1725440163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c94102880 0x7f2c94102c90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009900 tx=0x7f2c9002a410 comp rx=0 tx=0).stop 2024-08-31T06:02:55.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.635+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/1725440163 shutdown_connections 2024-08-31T06:02:55.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.635+0000 7f2c9c5d8640 1 --2- 172.21.15.53:0/1725440163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c94108b10 0x7f2c9410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:55.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.635+0000 7f2c9c5d8640 1 --2- 172.21.15.53:0/1725440163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c941081c0 0x7f2c941085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:55.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.635+0000 7f2c9c5d8640 1 --2- 172.21.15.53:0/1725440163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c94102880 0x7f2c94102c90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:55.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.635+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/1725440163 >> 172.21.15.53:0/1725440163 conn(0x7f2c94079510 msgr2=0x7f2c94079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:55.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.635+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/1725440163 shutdown_connections 2024-08-31T06:02:55.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.635+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/1725440163 wait complete. 2024-08-31T06:02:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.635+0000 7f2c9c5d8640 1 Processor -- start 2024-08-31T06:02:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9c5d8640 1 -- start start 2024-08-31T06:02:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9c5d8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c94102880 0x7f2c9419b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9c5d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c941081c0 0x7f2c9419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9c5d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c94108b10 0x7f2c9419bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9c5d8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2c94112740 con 0x7f2c94108b10 2024-08-31T06:02:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9c5d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2c941125c0 con 0x7f2c941081c0 2024-08-31T06:02:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9c5d8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2c941128c0 con 0x7f2c94102880 2024-08-31T06:02:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9ab75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c94108b10 0x7f2c9419bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9ab75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c94108b10 0x7f2c9419bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60438/0 (socket says 172.21.15.53:60438) 2024-08-31T06:02:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9ab75640 1 -- 172.21.15.53:0/3775778160 learned_addr learned my addr 172.21.15.53:0/3775778160 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9a374640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c94102880 0x7f2c9419b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c99b73640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c941081c0 0x7f2c9419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9ab75640 1 -- 172.21.15.53:0/3775778160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c94102880 msgr2=0x7f2c9419b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9ab75640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c94102880 0x7f2c9419b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9ab75640 1 -- 172.21.15.53:0/3775778160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c941081c0 msgr2=0x7f2c9419b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9ab75640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c941081c0 0x7f2c9419b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c9ab75640 1 -- 172.21.15.53:0/3775778160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c941a63a0 con 0x7f2c94108b10 2024-08-31T06:02:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.636+0000 7f2c99b73640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c941081c0 0x7f2c9419b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:02:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.637+0000 7f2c9ab75640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c94108b10 0x7f2c9419bb90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00b970 tx=0x7f2c8c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:55.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.637+0000 7f2c8b7fe640 1 -- 172.21.15.53:0/3775778160 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c019070 con 0x7f2c94108b10 2024-08-31T06:02:55.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.637+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/3775778160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c941a6690 con 0x7f2c94108b10 2024-08-31T06:02:55.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.637+0000 7f2c8b7fe640 1 -- 172.21.15.53:0/3775778160 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c8c014440 con 0x7f2c94108b10 2024-08-31T06:02:55.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.637+0000 7f2c8b7fe640 1 -- 172.21.15.53:0/3775778160 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c0075d0 con 0x7f2c94108b10 2024-08-31T06:02:55.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.637+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/3775778160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c941a6c00 con 0x7f2c94108b10 2024-08-31T06:02:55.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.638+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/3775778160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c94103b00 con 0x7f2c94108b10 2024-08-31T06:02:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.640+0000 7f2c8b7fe640 1 -- 172.21.15.53:0/3775778160 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f2c8c01c070 con 0x7f2c94108b10 2024-08-31T06:02:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.640+0000 7f2c8b7fe640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c800b4c40 0x7f2c800b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.640+0000 7f2c8b7fe640 1 -- 172.21.15.53:0/3775778160 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f2c8c0e4bd0 con 0x7f2c94108b10 2024-08-31T06:02:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.640+0000 7f2c9a374640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c800b4c40 0x7f2c800b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.641+0000 7f2c9a374640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c800b4c40 0x7f2c800b7150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2c9406c460 tx=0x7f2c900058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:55.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.643+0000 7f2c8b7fe640 1 -- 172.21.15.53:0/3775778160 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2c8c0ab570 con 0x7f2c94108b10 2024-08-31T06:02:55.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.825+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/3775778160 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c940635a0 con 0x7f2c800b4c40 2024-08-31T06:02:55.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.830+0000 7f2c8b7fe640 1 -- 172.21.15.53:0/3775778160 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258734 (secure 0 0 0) 0x7f2c940635a0 con 0x7f2c800b4c40 2024-08-31T06:02:55.834 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-08-31T06:02:55.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/3775778160 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c800b4c40 msgr2=0x7f2c800b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:55.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c800b4c40 0x7f2c800b7150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2c9406c460 tx=0x7f2c900058d0 comp rx=0 tx=0).stop 2024-08-31T06:02:55.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/3775778160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c94108b10 msgr2=0x7f2c9419bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:55.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c94108b10 0x7f2c9419bb90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00b970 tx=0x7f2c8c00be30 comp rx=0 tx=0).stop 2024-08-31T06:02:55.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/3775778160 shutdown_connections 2024-08-31T06:02:55.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c800b4c40 0x7f2c800b7150 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:55.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c94108b10 0x7f2c9419bb90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:55.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c941081c0 0x7f2c9419b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:55.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 --2- 172.21.15.53:0/3775778160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c94102880 0x7f2c9419b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:55.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/3775778160 >> 172.21.15.53:0/3775778160 conn(0x7f2c94079510 msgr2=0x7f2c94106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:55.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/3775778160 shutdown_connections 2024-08-31T06:02:55.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:55.832+0000 7f2c9c5d8640 1 -- 172.21.15.53:0/3775778160 wait complete. 2024-08-31T06:02:55.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:55 smithi053 ceph-mon[18924]: pgmap v258: 97 pgs: 97 active+clean; 629 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 21 op/s 2024-08-31T06:02:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:55 smithi130 ceph-mon[22266]: pgmap v258: 97 pgs: 97 active+clean; 629 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 21 op/s 2024-08-31T06:02:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:55 smithi153 ceph-mon[22320]: pgmap v258: 97 pgs: 97 active+clean; 629 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 21 op/s 2024-08-31T06:02:56.488 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2024-08-31T06:02:54.341575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644606,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":217,"num_read_kb":202,"num_write":356,"num_write_kb":2269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":294,"ondisk_log_size":294,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":389516,"kb_used_data":11148,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124552308,"statfs":{"total":1151940427776,"available":1151541563392,"internally_reserved":0,"allocated":11415552,"data_stored":6472148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49252,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":136,"num_read_kb":133,"num_write":128,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002911"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.616014+0000","last_change":"2024-08-31T06:02:30.611733+0000","last_active":"2024-08-31T06:02:31.616014+0000","last_peered":"2024-08-31T06:02:31.616014+0000","last_clean":"2024-08-31T06:02:31.616014+0000","last_became_active":"2024-08-31T06:02:30.610339+0000","last_became_peered":"2024-08-31T06:02:30.610339+0000","last_unstale":"2024-08-31T06:02:31.616014+0000","last_undegraded":"2024-08-31T06:02:31.616014+0000","last_fullsized":"2024-08-31T06:02:31.616014+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:20.628524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609010+0000","last_change":"2024-08-31T06:02:30.604550+0000","last_active":"2024-08-31T06:02:31.609010+0000","last_peered":"2024-08-31T06:02:31.609010+0000","last_clean":"2024-08-31T06:02:31.609010+0000","last_became_active":"2024-08-31T06:02:30.604200+0000","last_became_peered":"2024-08-31T06:02:30.604200+0000","last_unstale":"2024-08-31T06:02:31.609010+0000","last_undegraded":"2024-08-31T06:02:31.609010+0000","last_fullsized":"2024-08-31T06:02:31.609010+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:31.191972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609431+0000","last_change":"2024-08-31T06:02:30.606102+0000","last_active":"2024-08-31T06:02:31.609431+0000","last_peered":"2024-08-31T06:02:31.609431+0000","last_clean":"2024-08-31T06:02:31.609431+0000","last_became_active":"2024-08-31T06:02:30.605738+0000","last_became_peered":"2024-08-31T06:02:30.605738+0000","last_unstale":"2024-08-31T06:02:31.609431+0000","last_undegraded":"2024-08-31T06:02:31.609431+0000","last_fullsized":"2024-08-31T06:02:31.609431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:50:34.993218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.611279+0000","last_change":"2024-08-31T06:02:30.603207+0000","last_active":"2024-08-31T06:02:31.611279+0000","last_peered":"2024-08-31T06:02:31.611279+0000","last_clean":"2024-08-31T06:02:31.611279+0000","last_became_active":"2024-08-31T06:02:30.602829+0000","last_became_peered":"2024-08-31T06:02:30.602829+0000","last_unstale":"2024-08-31T06:02:31.611279+0000","last_undegraded":"2024-08-31T06:02:31.611279+0000","last_fullsized":"2024-08-31T06:02:31.611279+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:02.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609242+0000","last_change":"2024-08-31T06:02:30.590760+0000","last_active":"2024-08-31T06:02:31.609242+0000","last_peered":"2024-08-31T06:02:31.609242+0000","last_clean":"2024-08-31T06:02:31.609242+0000","last_became_active":"2024-08-31T06:02:30.590198+0000","last_became_peered":"2024-08-31T06:02:30.590198+0000","last_unstale":"2024-08-31T06:02:31.609242+0000","last_undegraded":"2024-08-31T06:02:31.609242+0000","last_fullsized":"2024-08-31T06:02:31.609242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:50.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606568+0000","last_change":"2024-08-31T06:02:30.599924+0000","last_active":"2024-08-31T06:02:31.606568+0000","last_peered":"2024-08-31T06:02:31.606568+0000","last_clean":"2024-08-31T06:02:31.606568+0000","last_became_active":"2024-08-31T06:02:30.599566+0000","last_became_peered":"2024-08-31T06:02:30.599566+0000","last_unstale":"2024-08-31T06:02:31.606568+0000","last_undegraded":"2024-08-31T06:02:31.606568+0000","last_fullsized":"2024-08-31T06:02:31.606568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:58.265673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.613443+0000","last_change":"2024-08-31T06:02:30.605179+0000","last_active":"2024-08-31T06:02:31.613443+0000","last_peered":"2024-08-31T06:02:31.613443+0000","last_clean":"2024-08-31T06:02:31.613443+0000","last_became_active":"2024-08-31T06:02:30.604847+0000","last_became_peered":"2024-08-31T06:02:30.604847+0000","last_unstale":"2024-08-31T06:02:31.613443+0000","last_undegraded":"2024-08-31T06:02:31.613443+0000","last_fullsized":"2024-08-31T06:02:31.613443+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:00.997025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606100+0000","last_change":"2024-08-31T06:02:30.610057+0000","last_active":"2024-08-31T06:02:31.606100+0000","last_peered":"2024-08-31T06:02:31.606100+0000","last_clean":"2024-08-31T06:02:31.606100+0000","last_became_active":"2024-08-31T06:02:30.609654+0000","last_became_peered":"2024-08-31T06:02:30.609654+0000","last_unstale":"2024-08-31T06:02:31.606100+0000","last_undegraded":"2024-08-31T06:02:31.606100+0000","last_fullsized":"2024-08-31T06:02:31.606100+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:32:14.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.599543+0000","last_change":"2024-08-31T06:02:30.606437+0000","last_active":"2024-08-31T06:02:31.599543+0000","last_peered":"2024-08-31T06:02:31.599543+0000","last_clean":"2024-08-31T06:02:31.599543+0000","last_became_active":"2024-08-31T06:02:30.605632+0000","last_became_peered":"2024-08-31T06:02:30.605632+0000","last_unstale":"2024-08-31T06:02:31.599543+0000","last_undegraded":"2024-08-31T06:02:31.599543+0000","last_fullsized":"2024-08-31T06:02:31.599543+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:47.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.607296+0000","last_change":"2024-08-31T06:02:30.605456+0000","last_active":"2024-08-31T06:02:31.607296+0000","last_peered":"2024-08-31T06:02:31.607296+0000","last_clean":"2024-08-31T06:02:31.607296+0000","last_became_active":"2024-08-31T06:02:30.604927+0000","last_became_peered":"2024-08-31T06:02:30.604927+0000","last_unstale":"2024-08-31T06:02:31.607296+0000","last_undegraded":"2024-08-31T06:02:31.607296+0000","last_fullsized":"2024-08-31T06:02:31.607296+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:30.340609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.614052+0000","last_change":"2024-08-31T06:02:30.608595+0000","last_active":"2024-08-31T06:02:31.614052+0000","last_peered":"2024-08-31T06:02:31.614052+0000","last_clean":"2024-08-31T06:02:31.614052+0000","last_became_active":"2024-08-31T06:02:30.607695+0000","last_became_peered":"2024-08-31T06:02:30.607695+0000","last_unstale":"2024-08-31T06:02:31.614052+0000","last_undegraded":"2024-08-31T06:02:31.614052+0000","last_fullsized":"2024-08-31T06:02:31.614052+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:44:53.655598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.611234+0000","last_change":"2024-08-31T06:02:30.595775+0000","last_active":"2024-08-31T06:02:31.611234+0000","last_peered":"2024-08-31T06:02:31.611234+0000","last_clean":"2024-08-31T06:02:31.611234+0000","last_became_active":"2024-08-31T06:02:30.595424+0000","last_became_peered":"2024-08-31T06:02:30.595424+0000","last_unstale":"2024-08-31T06:02:31.611234+0000","last_undegraded":"2024-08-31T06:02:31.611234+0000","last_fullsized":"2024-08-31T06:02:31.611234+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:56.382633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596472+0000","last_change":"2024-08-31T06:02:30.603465+0000","last_active":"2024-08-31T06:02:31.596472+0000","last_peered":"2024-08-31T06:02:31.596472+0000","last_clean":"2024-08-31T06:02:31.596472+0000","last_became_active":"2024-08-31T06:02:30.603041+0000","last_became_peered":"2024-08-31T06:02:30.603041+0000","last_unstale":"2024-08-31T06:02:31.596472+0000","last_undegraded":"2024-08-31T06:02:31.596472+0000","last_fullsized":"2024-08-31T06:02:31.596472+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:19:00.139973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.608658+0000","last_change":"2024-08-31T06:02:30.593807+0000","last_active":"2024-08-31T06:02:31.608658+0000","last_peered":"2024-08-31T06:02:31.608658+0000","last_clean":"2024-08-31T06:02:31.608658+0000","last_became_active":"2024-08-31T06:02:30.593389+0000","last_became_peered":"2024-08-31T06:02:30.593389+0000","last_unstale":"2024-08-31T06:02:31.608658+0000","last_undegraded":"2024-08-31T06:02:31.608658+0000","last_fullsized":"2024-08-31T06:02:31.608658+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:01:04.398867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.608696+0000","last_change":"2024-08-31T06:02:30.605207+0000","last_active":"2024-08-31T06:02:31.608696+0000","last_peered":"2024-08-31T06:02:31.608696+0000","last_clean":"2024-08-31T06:02:31.608696+0000","last_became_active":"2024-08-31T06:02:30.604866+0000","last_became_peered":"2024-08-31T06:02:30.604866+0000","last_unstale":"2024-08-31T06:02:31.608696+0000","last_undegraded":"2024-08-31T06:02:31.608696+0000","last_fullsized":"2024-08-31T06:02:31.608696+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:56.305638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.598698+0000","last_change":"2024-08-31T06:02:30.601457+0000","last_active":"2024-08-31T06:02:31.598698+0000","last_peered":"2024-08-31T06:02:31.598698+0000","last_clean":"2024-08-31T06:02:31.598698+0000","last_became_active":"2024-08-31T06:02:30.601077+0000","last_became_peered":"2024-08-31T06:02:30.601077+0000","last_unstale":"2024-08-31T06:02:31.598698+0000","last_undegraded":"2024-08-31T06:02:31.598698+0000","last_fullsized":"2024-08-31T06:02:31.598698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:51:42.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.616358+0000","last_change":"2024-08-31T06:02:30.612475+0000","last_active":"2024-08-31T06:02:31.616358+0000","last_peered":"2024-08-31T06:02:31.616358+0000","last_clean":"2024-08-31T06:02:31.616358+0000","last_became_active":"2024-08-31T06:02:30.612088+0000","last_became_peered":"2024-08-31T06:02:30.612088+0000","last_unstale":"2024-08-31T06:02:31.616358+0000","last_undegraded":"2024-08-31T06:02:31.616358+0000","last_fullsized":"2024-08-31T06:02:31.616358+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:34.348645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609641+0000","last_change":"2024-08-31T06:02:30.605612+0000","last_active":"2024-08-31T06:02:31.609641+0000","last_peered":"2024-08-31T06:02:31.609641+0000","last_clean":"2024-08-31T06:02:31.609641+0000","last_became_active":"2024-08-31T06:02:30.605271+0000","last_became_peered":"2024-08-31T06:02:30.605271+0000","last_unstale":"2024-08-31T06:02:31.609641+0000","last_undegraded":"2024-08-31T06:02:31.609641+0000","last_fullsized":"2024-08-31T06:02:31.609641+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:38.003500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596327+0000","last_change":"2024-08-31T06:02:30.610328+0000","last_active":"2024-08-31T06:02:31.596327+0000","last_peered":"2024-08-31T06:02:31.596327+0000","last_clean":"2024-08-31T06:02:31.596327+0000","last_became_active":"2024-08-31T06:02:30.609935+0000","last_became_peered":"2024-08-31T06:02:30.609935+0000","last_unstale":"2024-08-31T06:02:31.596327+0000","last_undegraded":"2024-08-31T06:02:31.596327+0000","last_fullsized":"2024-08-31T06:02:31.596327+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:22.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.615467+0000","last_change":"2024-08-31T06:02:30.609207+0000","last_active":"2024-08-31T06:02:31.615467+0000","last_peered":"2024-08-31T06:02:31.615467+0000","last_clean":"2024-08-31T06:02:31.615467+0000","last_became_active":"2024-08-31T06:02:30.608635+0000","last_became_peered":"2024-08-31T06:02:30.608635+0000","last_unstale":"2024-08-31T06:02:31.615467+0000","last_undegraded":"2024-08-31T06:02:31.615467+0000","last_fullsized":"2024-08-31T06:02:31.615467+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:43.898073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596394+0000","last_change":"2024-08-31T06:02:30.595829+0000","last_active":"2024-08-31T06:02:31.596394+0000","last_peered":"2024-08-31T06:02:31.596394+0000","last_clean":"2024-08-31T06:02:31.596394+0000","last_became_active":"2024-08-31T06:02:30.595427+0000","last_became_peered":"2024-08-31T06:02:30.595427+0000","last_unstale":"2024-08-31T06:02:31.596394+0000","last_undegraded":"2024-08-31T06:02:31.596394+0000","last_fullsized":"2024-08-31T06:02:31.596394+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:09:39.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.599093+0000","last_change":"2024-08-31T06:02:30.599513+0000","last_active":"2024-08-31T06:02:31.599093+0000","last_peered":"2024-08-31T06:02:31.599093+0000","last_clean":"2024-08-31T06:02:31.599093+0000","last_became_active":"2024-08-31T06:02:30.599195+0000","last_became_peered":"2024-08-31T06:02:30.599195+0000","last_unstale":"2024-08-31T06:02:31.599093+0000","last_undegraded":"2024-08-31T06:02:31.599093+0000","last_fullsized":"2024-08-31T06:02:31.599093+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:26.669658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606242+0000","last_change":"2024-08-31T06:02:30.609229+0000","last_active":"2024-08-31T06:02:31.606242+0000","last_peered":"2024-08-31T06:02:31.606242+0000","last_clean":"2024-08-31T06:02:31.606242+0000","last_became_active":"2024-08-31T06:02:30.608536+0000","last_became_peered":"2024-08-31T06:02:30.608536+0000","last_unstale":"2024-08-31T06:02:31.606242+0000","last_undegraded":"2024-08-31T06:02:31.606242+0000","last_fullsized":"2024-08-31T06:02:31.606242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:08.917901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606859+0000","last_change":"2024-08-31T06:02:30.603663+0000","last_active":"2024-08-31T06:02:31.606859+0000","last_peered":"2024-08-31T06:02:31.606859+0000","last_clean":"2024-08-31T06:02:31.606859+0000","last_became_active":"2024-08-31T06:02:30.603220+0000","last_became_peered":"2024-08-31T06:02:30.603220+0000","last_unstale":"2024-08-31T06:02:31.606859+0000","last_undegraded":"2024-08-31T06:02:31.606859+0000","last_fullsized":"2024-08-31T06:02:31.606859+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:09.433078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.605970+0000","last_change":"2024-08-31T06:02:30.608474+0000","last_active":"2024-08-31T06:02:31.605970+0000","last_peered":"2024-08-31T06:02:31.605970+0000","last_clean":"2024-08-31T06:02:31.605970+0000","last_became_active":"2024-08-31T06:02:30.608118+0000","last_became_peered":"2024-08-31T06:02:30.608118+0000","last_unstale":"2024-08-31T06:02:31.605970+0000","last_undegraded":"2024-08-31T06:02:31.605970+0000","last_fullsized":"2024-08-31T06:02:31.605970+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:55.124001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596322+0000","last_change":"2024-08-31T06:02:30.614255+0000","last_active":"2024-08-31T06:02:31.596322+0000","last_peered":"2024-08-31T06:02:31.596322+0000","last_clean":"2024-08-31T06:02:31.596322+0000","last_became_active":"2024-08-31T06:02:30.613805+0000","last_became_peered":"2024-08-31T06:02:30.613805+0000","last_unstale":"2024-08-31T06:02:31.596322+0000","last_undegraded":"2024-08-31T06:02:31.596322+0000","last_fullsized":"2024-08-31T06:02:31.596322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.892997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.615746+0000","last_change":"2024-08-31T06:02:30.609877+0000","last_active":"2024-08-31T06:02:31.615746+0000","last_peered":"2024-08-31T06:02:31.615746+0000","last_clean":"2024-08-31T06:02:31.615746+0000","last_became_active":"2024-08-31T06:02:30.608805+0000","last_became_peered":"2024-08-31T06:02:30.608805+0000","last_unstale":"2024-08-31T06:02:31.615746+0000","last_undegraded":"2024-08-31T06:02:31.615746+0000","last_fullsized":"2024-08-31T06:02:31.615746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:52.172745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596431+0000","last_change":"2024-08-31T06:02:30.594684+0000","last_active":"2024-08-31T06:02:31.596431+0000","last_peered":"2024-08-31T06:02:31.596431+0000","last_clean":"2024-08-31T06:02:31.596431+0000","last_became_active":"2024-08-31T06:02:30.594293+0000","last_became_peered":"2024-08-31T06:02:30.594293+0000","last_unstale":"2024-08-31T06:02:31.596431+0000","last_undegraded":"2024-08-31T06:02:31.596431+0000","last_fullsized":"2024-08-31T06:02:31.596431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:58:39.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609128+0000","last_change":"2024-08-31T06:02:30.602765+0000","last_active":"2024-08-31T06:02:31.609128+0000","last_peered":"2024-08-31T06:02:31.609128+0000","last_clean":"2024-08-31T06:02:31.609128+0000","last_became_active":"2024-08-31T06:02:30.602410+0000","last_became_peered":"2024-08-31T06:02:30.602410+0000","last_unstale":"2024-08-31T06:02:31.609128+0000","last_undegraded":"2024-08-31T06:02:31.609128+0000","last_fullsized":"2024-08-31T06:02:31.609128+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:12.370967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596805+0000","last_change":"2024-08-31T06:02:30.611818+0000","last_active":"2024-08-31T06:02:31.596805+0000","last_peered":"2024-08-31T06:02:31.596805+0000","last_clean":"2024-08-31T06:02:31.596805+0000","last_became_active":"2024-08-31T06:02:30.610917+0000","last_became_peered":"2024-08-31T06:02:30.610917+0000","last_unstale":"2024-08-31T06:02:31.596805+0000","last_undegraded":"2024-08-31T06:02:31.596805+0000","last_fullsized":"2024-08-31T06:02:31.596805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:00.895825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596211+0000","last_change":"2024-08-31T06:02:30.612186+0000","last_active":"2024-08-31T06:02:31.596211+0000","last_peered":"2024-08-31T06:02:31.596211+0000","last_clean":"2024-08-31T06:02:31.596211+0000","last_became_active":"2024-08-31T06:02:30.610496+0000","last_became_peered":"2024-08-31T06:02:30.610496+0000","last_unstale":"2024-08-31T06:02:31.596211+0000","last_undegraded":"2024-08-31T06:02:31.596211+0000","last_fullsized":"2024-08-31T06:02:31.596211+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:48:19.954998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.615503+0000","last_change":"2024-08-31T06:02:30.616281+0000","last_active":"2024-08-31T06:02:31.615503+0000","last_peered":"2024-08-31T06:02:31.615503+0000","last_clean":"2024-08-31T06:02:31.615503+0000","last_became_active":"2024-08-31T06:02:30.615905+0000","last_became_peered":"2024-08-31T06:02:30.615905+0000","last_unstale":"2024-08-31T06:02:31.615503+0000","last_undegraded":"2024-08-31T06:02:31.615503+0000","last_fullsized":"2024-08-31T06:02:31.615503+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:59:33.731440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.608763+0000","last_change":"2024-08-31T06:02:30.607864+0000","last_active":"2024-08-31T06:02:31.608763+0000","last_peered":"2024-08-31T06:02:31.608763+0000","last_clean":"2024-08-31T06:02:31.608763+0000","last_became_active":"2024-08-31T06:02:30.607299+0000","last_became_peered":"2024-08-31T06:02:30.607299+0000","last_unstale":"2024-08-31T06:02:31.608763+0000","last_undegraded":"2024-08-31T06:02:31.608763+0000","last_fullsized":"2024-08-31T06:02:31.608763+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:19.302279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"70'6","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:48.692577+0000","last_change":"2024-08-31T06:02:28.594973+0000","last_active":"2024-08-31T06:02:48.692577+0000","last_peered":"2024-08-31T06:02:48.692577+0000","last_clean":"2024-08-31T06:02:48.692577+0000","last_became_active":"2024-08-31T06:02:28.594588+0000","last_became_peered":"2024-08-31T06:02:28.594588+0000","last_unstale":"2024-08-31T06:02:48.692577+0000","last_undegraded":"2024-08-31T06:02:48.692577+0000","last_fullsized":"2024-08-31T06:02:48.692577+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:29:48.016888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.608044+0000","last_change":"2024-08-31T06:02:30.610083+0000","last_active":"2024-08-31T06:02:31.608044+0000","last_peered":"2024-08-31T06:02:31.608044+0000","last_clean":"2024-08-31T06:02:31.608044+0000","last_became_active":"2024-08-31T06:02:30.609376+0000","last_became_peered":"2024-08-31T06:02:30.609376+0000","last_unstale":"2024-08-31T06:02:31.608044+0000","last_undegraded":"2024-08-31T06:02:31.608044+0000","last_fullsized":"2024-08-31T06:02:31.608044+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:15.416670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"70'7","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:40.663855+0000","last_change":"2024-08-31T06:02:28.589152+0000","last_active":"2024-08-31T06:02:40.663855+0000","last_peered":"2024-08-31T06:02:40.663855+0000","last_clean":"2024-08-31T06:02:40.663855+0000","last_became_active":"2024-08-31T06:02:28.588758+0000","last_became_peered":"2024-08-31T06:02:28.588758+0000","last_unstale":"2024-08-31T06:02:40.663855+0000","last_undegraded":"2024-08-31T06:02:40.663855+0000","last_fullsized":"2024-08-31T06:02:40.663855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:31.814105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"70'3","reported_seq":22,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:39.649625+0000","last_change":"2024-08-31T06:02:28.585410+0000","last_active":"2024-08-31T06:02:39.649625+0000","last_peered":"2024-08-31T06:02:39.649625+0000","last_clean":"2024-08-31T06:02:39.649625+0000","last_became_active":"2024-08-31T06:02:28.584998+0000","last_became_peered":"2024-08-31T06:02:28.584998+0000","last_unstale":"2024-08-31T06:02:39.649625+0000","last_undegraded":"2024-08-31T06:02:39.649625+0000","last_fullsized":"2024-08-31T06:02:39.649625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:30.705460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.605598+0000","last_change":"2024-08-31T06:02:30.597295+0000","last_active":"2024-08-31T06:02:31.605598+0000","last_peered":"2024-08-31T06:02:31.605598+0000","last_clean":"2024-08-31T06:02:31.605598+0000","last_became_active":"2024-08-31T06:02:30.596968+0000","last_became_peered":"2024-08-31T06:02:30.596968+0000","last_unstale":"2024-08-31T06:02:31.605598+0000","last_undegraded":"2024-08-31T06:02:31.605598+0000","last_fullsized":"2024-08-31T06:02:31.605598+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:38.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"70'3","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.669741+0000","last_change":"2024-08-31T06:02:28.594164+0000","last_active":"2024-08-31T06:02:41.669741+0000","last_peered":"2024-08-31T06:02:41.669741+0000","last_clean":"2024-08-31T06:02:41.669741+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:02:41.669741+0000","last_undegraded":"2024-08-31T06:02:41.669741+0000","last_fullsized":"2024-08-31T06:02:41.669741+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:21.780202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609973+0000","last_change":"2024-08-31T06:02:30.597500+0000","last_active":"2024-08-31T06:02:31.609973+0000","last_peered":"2024-08-31T06:02:31.609973+0000","last_clean":"2024-08-31T06:02:31.609973+0000","last_became_active":"2024-08-31T06:02:30.597147+0000","last_became_peered":"2024-08-31T06:02:30.597147+0000","last_unstale":"2024-08-31T06:02:31.609973+0000","last_undegraded":"2024-08-31T06:02:31.609973+0000","last_fullsized":"2024-08-31T06:02:31.609973+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:34.111288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"70'4","reported_seq":45,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:52.697949+0000","last_change":"2024-08-31T06:02:28.585769+0000","last_active":"2024-08-31T06:02:52.697949+0000","last_peered":"2024-08-31T06:02:52.697949+0000","last_clean":"2024-08-31T06:02:52.697949+0000","last_became_active":"2024-08-31T06:02:28.585310+0000","last_became_peered":"2024-08-31T06:02:28.585310+0000","last_unstale":"2024-08-31T06:02:52.697949+0000","last_undegraded":"2024-08-31T06:02:52.697949+0000","last_fullsized":"2024-08-31T06:02:52.697949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:40.595986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.599344+0000","last_change":"2024-08-31T06:02:30.601434+0000","last_active":"2024-08-31T06:02:31.599344+0000","last_peered":"2024-08-31T06:02:31.599344+0000","last_clean":"2024-08-31T06:02:31.599344+0000","last_became_active":"2024-08-31T06:02:30.601060+0000","last_became_peered":"2024-08-31T06:02:30.601060+0000","last_unstale":"2024-08-31T06:02:31.599344+0000","last_undegraded":"2024-08-31T06:02:31.599344+0000","last_fullsized":"2024-08-31T06:02:31.599344+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:32.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"70'4","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.669325+0000","last_change":"2024-08-31T06:02:28.593217+0000","last_active":"2024-08-31T06:02:41.669325+0000","last_peered":"2024-08-31T06:02:41.669325+0000","last_clean":"2024-08-31T06:02:41.669325+0000","last_became_active":"2024-08-31T06:02:28.592801+0000","last_became_peered":"2024-08-31T06:02:28.592801+0000","last_unstale":"2024-08-31T06:02:41.669325+0000","last_undegraded":"2024-08-31T06:02:41.669325+0000","last_fullsized":"2024-08-31T06:02:41.669325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:21.561089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609280+0000","last_change":"2024-08-31T06:02:30.606747+0000","last_active":"2024-08-31T06:02:31.609280+0000","last_peered":"2024-08-31T06:02:31.609280+0000","last_clean":"2024-08-31T06:02:31.609280+0000","last_became_active":"2024-08-31T06:02:30.606347+0000","last_became_peered":"2024-08-31T06:02:30.606347+0000","last_unstale":"2024-08-31T06:02:31.609280+0000","last_undegraded":"2024-08-31T06:02:31.609280+0000","last_fullsized":"2024-08-31T06:02:31.609280+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:57:30.014026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"70'5","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:40.664371+0000","last_change":"2024-08-31T06:02:28.781606+0000","last_active":"2024-08-31T06:02:40.664371+0000","last_peered":"2024-08-31T06:02:40.664371+0000","last_clean":"2024-08-31T06:02:40.664371+0000","last_became_active":"2024-08-31T06:02:28.780886+0000","last_became_peered":"2024-08-31T06:02:28.780886+0000","last_unstale":"2024-08-31T06:02:40.664371+0000","last_undegraded":"2024-08-31T06:02:40.664371+0000","last_fullsized":"2024-08-31T06:02:40.664371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:07.540461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.598999+0000","last_change":"2024-08-31T06:02:30.604358+0000","last_active":"2024-08-31T06:02:31.598999+0000","last_peered":"2024-08-31T06:02:31.598999+0000","last_clean":"2024-08-31T06:02:31.598999+0000","last_became_active":"2024-08-31T06:02:30.603980+0000","last_became_peered":"2024-08-31T06:02:30.603980+0000","last_unstale":"2024-08-31T06:02:31.598999+0000","last_undegraded":"2024-08-31T06:02:31.598999+0000","last_fullsized":"2024-08-31T06:02:31.598999+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:43:03.062141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"70'24","reported_seq":71,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:52.699380+0000","last_change":"2024-08-31T06:02:28.590795+0000","last_active":"2024-08-31T06:02:52.699380+0000","last_peered":"2024-08-31T06:02:52.699380+0000","last_clean":"2024-08-31T06:02:52.699380+0000","last_became_active":"2024-08-31T06:02:28.590397+0000","last_became_peered":"2024-08-31T06:02:28.590397+0000","last_unstale":"2024-08-31T06:02:52.699380+0000","last_undegraded":"2024-08-31T06:02:52.699380+0000","last_fullsized":"2024-08-31T06:02:52.699380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:30.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":59,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.610254+0000","last_change":"2024-08-31T06:02:30.603110+0000","last_active":"2024-08-31T06:02:31.610254+0000","last_peered":"2024-08-31T06:02:31.610254+0000","last_clean":"2024-08-31T06:02:31.610254+0000","last_became_active":"2024-08-31T06:02:30.602691+0000","last_became_peered":"2024-08-31T06:02:30.602691+0000","last_unstale":"2024-08-31T06:02:31.610254+0000","last_undegraded":"2024-08-31T06:02:31.610254+0000","last_fullsized":"2024-08-31T06:02:31.610254+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:20.009202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"70'9","reported_seq":30,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:42.679344+0000","last_change":"2024-08-31T06:02:28.591126+0000","last_active":"2024-08-31T06:02:42.679344+0000","last_peered":"2024-08-31T06:02:42.679344+0000","last_clean":"2024-08-31T06:02:42.679344+0000","last_became_active":"2024-08-31T06:02:28.590744+0000","last_became_peered":"2024-08-31T06:02:28.590744+0000","last_unstale":"2024-08-31T06:02:42.679344+0000","last_undegraded":"2024-08-31T06:02:42.679344+0000","last_fullsized":"2024-08-31T06:02:42.679344+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:43.910807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.595922+0000","last_change":"2024-08-31T06:02:30.599843+0000","last_active":"2024-08-31T06:02:31.595922+0000","last_peered":"2024-08-31T06:02:31.595922+0000","last_clean":"2024-08-31T06:02:31.595922+0000","last_became_active":"2024-08-31T06:02:30.599440+0000","last_became_peered":"2024-08-31T06:02:30.599440+0000","last_unstale":"2024-08-31T06:02:31.595922+0000","last_undegraded":"2024-08-31T06:02:31.595922+0000","last_fullsized":"2024-08-31T06:02:31.595922+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:01.029482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"70'5","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.669213+0000","last_change":"2024-08-31T06:02:28.594178+0000","last_active":"2024-08-31T06:02:41.669213+0000","last_peered":"2024-08-31T06:02:41.669213+0000","last_clean":"2024-08-31T06:02:41.669213+0000","last_became_active":"2024-08-31T06:02:28.593802+0000","last_became_peered":"2024-08-31T06:02:28.593802+0000","last_unstale":"2024-08-31T06:02:41.669213+0000","last_undegraded":"2024-08-31T06:02:41.669213+0000","last_fullsized":"2024-08-31T06:02:41.669213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:52.561582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.613848+0000","last_change":"2024-08-31T06:02:30.595979+0000","last_active":"2024-08-31T06:02:31.613848+0000","last_peered":"2024-08-31T06:02:31.613848+0000","last_clean":"2024-08-31T06:02:31.613848+0000","last_became_active":"2024-08-31T06:02:30.595665+0000","last_became_peered":"2024-08-31T06:02:30.595665+0000","last_unstale":"2024-08-31T06:02:31.613848+0000","last_undegraded":"2024-08-31T06:02:31.613848+0000","last_fullsized":"2024-08-31T06:02:31.613848+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:40.347954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"70'6","reported_seq":38,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:50.695991+0000","last_change":"2024-08-31T06:02:28.594117+0000","last_active":"2024-08-31T06:02:50.695991+0000","last_peered":"2024-08-31T06:02:50.695991+0000","last_clean":"2024-08-31T06:02:50.695991+0000","last_became_active":"2024-08-31T06:02:28.593721+0000","last_became_peered":"2024-08-31T06:02:28.593721+0000","last_unstale":"2024-08-31T06:02:50.695991+0000","last_undegraded":"2024-08-31T06:02:50.695991+0000","last_fullsized":"2024-08-31T06:02:50.695991+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:48:49.400841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.612401+0000","last_change":"2024-08-31T06:02:30.606967+0000","last_active":"2024-08-31T06:02:31.612401+0000","last_peered":"2024-08-31T06:02:31.612401+0000","last_clean":"2024-08-31T06:02:31.612401+0000","last_became_active":"2024-08-31T06:02:30.605730+0000","last_became_peered":"2024-08-31T06:02:30.605730+0000","last_unstale":"2024-08-31T06:02:31.612401+0000","last_undegraded":"2024-08-31T06:02:31.612401+0000","last_fullsized":"2024-08-31T06:02:31.612401+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:30.656071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"70'17","reported_seq":37,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.669350+0000","last_change":"2024-08-31T06:02:28.780911+0000","last_active":"2024-08-31T06:02:41.669350+0000","last_peered":"2024-08-31T06:02:41.669350+0000","last_clean":"2024-08-31T06:02:41.669350+0000","last_became_active":"2024-08-31T06:02:28.780375+0000","last_became_peered":"2024-08-31T06:02:28.780375+0000","last_unstale":"2024-08-31T06:02:41.669350+0000","last_undegraded":"2024-08-31T06:02:41.669350+0000","last_fullsized":"2024-08-31T06:02:41.669350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:46.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606897+0000","last_change":"2024-08-31T06:02:30.606871+0000","last_active":"2024-08-31T06:02:31.606897+0000","last_peered":"2024-08-31T06:02:31.606897+0000","last_clean":"2024-08-31T06:02:31.606897+0000","last_became_active":"2024-08-31T06:02:30.606507+0000","last_became_peered":"2024-08-31T06:02:30.606507+0000","last_unstale":"2024-08-31T06:02:31.606897+0000","last_undegraded":"2024-08-31T06:02:31.606897+0000","last_fullsized":"2024-08-31T06:02:31.606897+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:16:31.502034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"70'2","reported_seq":22,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.642642+0000","last_change":"2024-08-31T06:02:28.588078+0000","last_active":"2024-08-31T06:02:41.642642+0000","last_peered":"2024-08-31T06:02:41.642642+0000","last_clean":"2024-08-31T06:02:41.642642+0000","last_became_active":"2024-08-31T06:02:28.587642+0000","last_became_peered":"2024-08-31T06:02:28.587642+0000","last_unstale":"2024-08-31T06:02:41.642642+0000","last_undegraded":"2024-08-31T06:02:41.642642+0000","last_fullsized":"2024-08-31T06:02:41.642642+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:59.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.615598+0000","last_change":"2024-08-31T06:02:30.605647+0000","last_active":"2024-08-31T06:02:31.615598+0000","last_peered":"2024-08-31T06:02:31.615598+0000","last_clean":"2024-08-31T06:02:31.615598+0000","last_became_active":"2024-08-31T06:02:30.605267+0000","last_became_peered":"2024-08-31T06:02:30.605267+0000","last_unstale":"2024-08-31T06:02:31.615598+0000","last_undegraded":"2024-08-31T06:02:31.615598+0000","last_fullsized":"2024-08-31T06:02:31.615598+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:08:34.741030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"70'5","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.668155+0000","last_change":"2024-08-31T06:02:28.585295+0000","last_active":"2024-08-31T06:02:41.668155+0000","last_peered":"2024-08-31T06:02:41.668155+0000","last_clean":"2024-08-31T06:02:41.668155+0000","last_became_active":"2024-08-31T06:02:28.584895+0000","last_became_peered":"2024-08-31T06:02:28.584895+0000","last_unstale":"2024-08-31T06:02:41.668155+0000","last_undegraded":"2024-08-31T06:02:41.668155+0000","last_fullsized":"2024-08-31T06:02:41.668155+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:57:12.658937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.614401+0000","last_change":"2024-08-31T06:02:30.603593+0000","last_active":"2024-08-31T06:02:31.614401+0000","last_peered":"2024-08-31T06:02:31.614401+0000","last_clean":"2024-08-31T06:02:31.614401+0000","last_became_active":"2024-08-31T06:02:30.603274+0000","last_became_peered":"2024-08-31T06:02:30.603274+0000","last_unstale":"2024-08-31T06:02:31.614401+0000","last_undegraded":"2024-08-31T06:02:31.614401+0000","last_fullsized":"2024-08-31T06:02:31.614401+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:07.720406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"70'3","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.669599+0000","last_change":"2024-08-31T06:02:28.586920+0000","last_active":"2024-08-31T06:02:41.669599+0000","last_peered":"2024-08-31T06:02:41.669599+0000","last_clean":"2024-08-31T06:02:41.669599+0000","last_became_active":"2024-08-31T06:02:28.586362+0000","last_became_peered":"2024-08-31T06:02:28.586362+0000","last_unstale":"2024-08-31T06:02:41.669599+0000","last_undegraded":"2024-08-31T06:02:41.669599+0000","last_fullsized":"2024-08-31T06:02:41.669599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:52.065879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"70'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.614022+0000","last_change":"2024-08-31T06:02:30.603800+0000","last_active":"2024-08-31T06:02:31.614022+0000","last_peered":"2024-08-31T06:02:31.614022+0000","last_clean":"2024-08-31T06:02:31.614022+0000","last_became_active":"2024-08-31T06:02:30.603439+0000","last_became_peered":"2024-08-31T06:02:30.603439+0000","last_unstale":"2024-08-31T06:02:31.614022+0000","last_undegraded":"2024-08-31T06:02:31.614022+0000","last_fullsized":"2024-08-31T06:02:31.614022+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:39.992719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"70'5","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:48.692756+0000","last_change":"2024-08-31T06:02:28.936404+0000","last_active":"2024-08-31T06:02:48.692756+0000","last_peered":"2024-08-31T06:02:48.692756+0000","last_clean":"2024-08-31T06:02:48.692756+0000","last_became_active":"2024-08-31T06:02:28.935898+0000","last_became_peered":"2024-08-31T06:02:28.935898+0000","last_unstale":"2024-08-31T06:02:48.692756+0000","last_undegraded":"2024-08-31T06:02:48.692756+0000","last_fullsized":"2024-08-31T06:02:48.692756+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:35.004510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.614082+0000","last_change":"2024-08-31T06:02:30.608258+0000","last_active":"2024-08-31T06:02:31.614082+0000","last_peered":"2024-08-31T06:02:31.614082+0000","last_clean":"2024-08-31T06:02:31.614082+0000","last_became_active":"2024-08-31T06:02:30.607067+0000","last_became_peered":"2024-08-31T06:02:30.607067+0000","last_unstale":"2024-08-31T06:02:31.614082+0000","last_undegraded":"2024-08-31T06:02:31.614082+0000","last_fullsized":"2024-08-31T06:02:31.614082+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:03:09.362812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":88,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.613595+0000","last_change":"2024-08-31T06:01:19.125033+0000","last_active":"2024-08-31T06:02:31.613595+0000","last_peered":"2024-08-31T06:02:31.613595+0000","last_clean":"2024-08-31T06:02:31.613595+0000","last_became_active":"2024-08-31T06:01:19.118469+0000","last_became_peered":"2024-08-31T06:01:19.118469+0000","last_unstale":"2024-08-31T06:02:31.613595+0000","last_undegraded":"2024-08-31T06:02:31.613595+0000","last_fullsized":"2024-08-31T06:02:31.613595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_clean_scrub_stamp":"2024-08-31T05:58:05.259854+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:33.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"70'6","reported_seq":28,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:42.680394+0000","last_change":"2024-08-31T06:02:28.588276+0000","last_active":"2024-08-31T06:02:42.680394+0000","last_peered":"2024-08-31T06:02:42.680394+0000","last_clean":"2024-08-31T06:02:42.680394+0000","last_became_active":"2024-08-31T06:02:28.587184+0000","last_became_peered":"2024-08-31T06:02:28.587184+0000","last_unstale":"2024-08-31T06:02:42.680394+0000","last_undegraded":"2024-08-31T06:02:42.680394+0000","last_fullsized":"2024-08-31T06:02:42.680394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:12.762919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.605836+0000","last_change":"2024-08-31T06:02:30.610801+0000","last_active":"2024-08-31T06:02:31.605836+0000","last_peered":"2024-08-31T06:02:31.605836+0000","last_clean":"2024-08-31T06:02:31.605836+0000","last_became_active":"2024-08-31T06:02:30.610446+0000","last_became_peered":"2024-08-31T06:02:30.610446+0000","last_unstale":"2024-08-31T06:02:31.605836+0000","last_undegraded":"2024-08-31T06:02:31.605836+0000","last_fullsized":"2024-08-31T06:02:31.605836+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:17.891734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"70'4","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:39.647723+0000","last_change":"2024-08-31T06:02:28.594648+0000","last_active":"2024-08-31T06:02:39.647723+0000","last_peered":"2024-08-31T06:02:39.647723+0000","last_clean":"2024-08-31T06:02:39.647723+0000","last_became_active":"2024-08-31T06:02:28.594260+0000","last_became_peered":"2024-08-31T06:02:28.594260+0000","last_unstale":"2024-08-31T06:02:39.647723+0000","last_undegraded":"2024-08-31T06:02:39.647723+0000","last_fullsized":"2024-08-31T06:02:39.647723+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:32:01.540348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.595896+0000","last_change":"2024-08-31T06:02:30.601509+0000","last_active":"2024-08-31T06:02:31.595896+0000","last_peered":"2024-08-31T06:02:31.595896+0000","last_clean":"2024-08-31T06:02:31.595896+0000","last_became_active":"2024-08-31T06:02:30.601021+0000","last_became_peered":"2024-08-31T06:02:30.601021+0000","last_unstale":"2024-08-31T06:02:31.595896+0000","last_undegraded":"2024-08-31T06:02:31.595896+0000","last_fullsized":"2024-08-31T06:02:31.595896+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:16:19.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"70'5","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:49.693930+0000","last_change":"2024-08-31T06:02:28.780419+0000","last_active":"2024-08-31T06:02:49.693930+0000","last_peered":"2024-08-31T06:02:49.693930+0000","last_clean":"2024-08-31T06:02:49.693930+0000","last_became_active":"2024-08-31T06:02:28.779814+0000","last_became_peered":"2024-08-31T06:02:28.779814+0000","last_unstale":"2024-08-31T06:02:49.693930+0000","last_undegraded":"2024-08-31T06:02:49.693930+0000","last_fullsized":"2024-08-31T06:02:49.693930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:36.183841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606915+0000","last_change":"2024-08-31T06:02:30.605961+0000","last_active":"2024-08-31T06:02:31.606915+0000","last_peered":"2024-08-31T06:02:31.606915+0000","last_clean":"2024-08-31T06:02:31.606915+0000","last_became_active":"2024-08-31T06:02:30.605523+0000","last_became_peered":"2024-08-31T06:02:30.605523+0000","last_unstale":"2024-08-31T06:02:31.606915+0000","last_undegraded":"2024-08-31T06:02:31.606915+0000","last_fullsized":"2024-08-31T06:02:31.606915+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:07.540336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"70'5","reported_seq":33,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:48.692580+0000","last_change":"2024-08-31T06:02:28.594220+0000","last_active":"2024-08-31T06:02:48.692580+0000","last_peered":"2024-08-31T06:02:48.692580+0000","last_clean":"2024-08-31T06:02:48.692580+0000","last_became_active":"2024-08-31T06:02:28.593729+0000","last_became_peered":"2024-08-31T06:02:28.593729+0000","last_unstale":"2024-08-31T06:02:48.692580+0000","last_undegraded":"2024-08-31T06:02:48.692580+0000","last_fullsized":"2024-08-31T06:02:48.692580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:37:03.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606719+0000","last_change":"2024-08-31T06:02:30.600008+0000","last_active":"2024-08-31T06:02:31.606719+0000","last_peered":"2024-08-31T06:02:31.606719+0000","last_clean":"2024-08-31T06:02:31.606719+0000","last_became_active":"2024-08-31T06:02:30.599677+0000","last_became_peered":"2024-08-31T06:02:30.599677+0000","last_unstale":"2024-08-31T06:02:31.606719+0000","last_undegraded":"2024-08-31T06:02:31.606719+0000","last_fullsized":"2024-08-31T06:02:31.606719+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:59.520544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"70'1","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609201+0000","last_change":"2024-08-31T06:02:28.780554+0000","last_active":"2024-08-31T06:02:31.609201+0000","last_peered":"2024-08-31T06:02:31.609201+0000","last_clean":"2024-08-31T06:02:31.609201+0000","last_became_active":"2024-08-31T06:02:28.780137+0000","last_became_peered":"2024-08-31T06:02:28.780137+0000","last_unstale":"2024-08-31T06:02:31.609201+0000","last_undegraded":"2024-08-31T06:02:31.609201+0000","last_fullsized":"2024-08-31T06:02:31.609201+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:57.523667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"70'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:33.212705+0000","last_change":"2024-08-31T06:02:30.597438+0000","last_active":"2024-08-31T06:02:33.212705+0000","last_peered":"2024-08-31T06:02:33.212705+0000","last_clean":"2024-08-31T06:02:33.212705+0000","last_became_active":"2024-08-31T06:02:30.597108+0000","last_became_peered":"2024-08-31T06:02:30.597108+0000","last_unstale":"2024-08-31T06:02:33.212705+0000","last_undegraded":"2024-08-31T06:02:33.212705+0000","last_fullsized":"2024-08-31T06:02:33.212705+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:05.238708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"70'4","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.670177+0000","last_change":"2024-08-31T06:02:28.781006+0000","last_active":"2024-08-31T06:02:41.670177+0000","last_peered":"2024-08-31T06:02:41.670177+0000","last_clean":"2024-08-31T06:02:41.670177+0000","last_became_active":"2024-08-31T06:02:28.780468+0000","last_became_peered":"2024-08-31T06:02:28.780468+0000","last_unstale":"2024-08-31T06:02:41.670177+0000","last_undegraded":"2024-08-31T06:02:41.670177+0000","last_fullsized":"2024-08-31T06:02:41.670177+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:20.206251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596579+0000","last_change":"2024-08-31T06:02:30.600826+0000","last_active":"2024-08-31T06:02:31.596579+0000","last_peered":"2024-08-31T06:02:31.596579+0000","last_clean":"2024-08-31T06:02:31.596579+0000","last_became_active":"2024-08-31T06:02:30.600474+0000","last_became_peered":"2024-08-31T06:02:30.600474+0000","last_unstale":"2024-08-31T06:02:31.596579+0000","last_undegraded":"2024-08-31T06:02:31.596579+0000","last_fullsized":"2024-08-31T06:02:31.596579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:07.456576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"70'12","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:50.603163+0000","last_change":"2024-08-31T06:02:28.588026+0000","last_active":"2024-08-31T06:02:50.603163+0000","last_peered":"2024-08-31T06:02:50.603163+0000","last_clean":"2024-08-31T06:02:50.603163+0000","last_became_active":"2024-08-31T06:02:28.587759+0000","last_became_peered":"2024-08-31T06:02:28.587759+0000","last_unstale":"2024-08-31T06:02:50.603163+0000","last_undegraded":"2024-08-31T06:02:50.603163+0000","last_fullsized":"2024-08-31T06:02:50.603163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:44.323111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606078+0000","last_change":"2024-08-31T06:02:30.604375+0000","last_active":"2024-08-31T06:02:31.606078+0000","last_peered":"2024-08-31T06:02:31.606078+0000","last_clean":"2024-08-31T06:02:31.606078+0000","last_became_active":"2024-08-31T06:02:30.604008+0000","last_became_peered":"2024-08-31T06:02:30.604008+0000","last_unstale":"2024-08-31T06:02:31.606078+0000","last_undegraded":"2024-08-31T06:02:31.606078+0000","last_fullsized":"2024-08-31T06:02:31.606078+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:37.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"70'7","reported_seq":27,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.670343+0000","last_change":"2024-08-31T06:02:28.936568+0000","last_active":"2024-08-31T06:02:41.670343+0000","last_peered":"2024-08-31T06:02:41.670343+0000","last_clean":"2024-08-31T06:02:41.670343+0000","last_became_active":"2024-08-31T06:02:28.936185+0000","last_became_peered":"2024-08-31T06:02:28.936185+0000","last_unstale":"2024-08-31T06:02:41.670343+0000","last_undegraded":"2024-08-31T06:02:41.670343+0000","last_fullsized":"2024-08-31T06:02:41.670343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:34.080300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609172+0000","last_change":"2024-08-31T06:02:30.604263+0000","last_active":"2024-08-31T06:02:31.609172+0000","last_peered":"2024-08-31T06:02:31.609172+0000","last_clean":"2024-08-31T06:02:31.609172+0000","last_became_active":"2024-08-31T06:02:30.603887+0000","last_became_peered":"2024-08-31T06:02:30.603887+0000","last_unstale":"2024-08-31T06:02:31.609172+0000","last_undegraded":"2024-08-31T06:02:31.609172+0000","last_fullsized":"2024-08-31T06:02:31.609172+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:56.506315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"70'2","reported_seq":21,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:38.640565+0000","last_change":"2024-08-31T06:02:28.780773+0000","last_active":"2024-08-31T06:02:38.640565+0000","last_peered":"2024-08-31T06:02:38.640565+0000","last_clean":"2024-08-31T06:02:38.640565+0000","last_became_active":"2024-08-31T06:02:28.780430+0000","last_became_peered":"2024-08-31T06:02:28.780430+0000","last_unstale":"2024-08-31T06:02:38.640565+0000","last_undegraded":"2024-08-31T06:02:38.640565+0000","last_fullsized":"2024-08-31T06:02:38.640565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:22:27.052952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.608747+0000","last_change":"2024-08-31T06:02:30.604018+0000","last_active":"2024-08-31T06:02:31.608747+0000","last_peered":"2024-08-31T06:02:31.608747+0000","last_clean":"2024-08-31T06:02:31.608747+0000","last_became_active":"2024-08-31T06:02:30.603411+0000","last_became_peered":"2024-08-31T06:02:30.603411+0000","last_unstale":"2024-08-31T06:02:31.608747+0000","last_undegraded":"2024-08-31T06:02:31.608747+0000","last_fullsized":"2024-08-31T06:02:31.608747+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:34:30.732954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"70'7","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.667681+0000","last_change":"2024-08-31T06:02:28.586348+0000","last_active":"2024-08-31T06:02:41.667681+0000","last_peered":"2024-08-31T06:02:41.667681+0000","last_clean":"2024-08-31T06:02:41.667681+0000","last_became_active":"2024-08-31T06:02:28.586046+0000","last_became_peered":"2024-08-31T06:02:28.586046+0000","last_unstale":"2024-08-31T06:02:41.667681+0000","last_undegraded":"2024-08-31T06:02:41.667681+0000","last_fullsized":"2024-08-31T06:02:41.667681+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:30.987232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.615733+0000","last_change":"2024-08-31T06:02:30.616402+0000","last_active":"2024-08-31T06:02:31.615733+0000","last_peered":"2024-08-31T06:02:31.615733+0000","last_clean":"2024-08-31T06:02:31.615733+0000","last_became_active":"2024-08-31T06:02:30.616014+0000","last_became_peered":"2024-08-31T06:02:30.616014+0000","last_unstale":"2024-08-31T06:02:31.615733+0000","last_undegraded":"2024-08-31T06:02:31.615733+0000","last_fullsized":"2024-08-31T06:02:31.615733+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:42.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"70'3","reported_seq":22,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:40.662721+0000","last_change":"2024-08-31T06:02:28.590184+0000","last_active":"2024-08-31T06:02:40.662721+0000","last_peered":"2024-08-31T06:02:40.662721+0000","last_clean":"2024-08-31T06:02:40.662721+0000","last_became_active":"2024-08-31T06:02:28.588830+0000","last_became_peered":"2024-08-31T06:02:28.588830+0000","last_unstale":"2024-08-31T06:02:40.662721+0000","last_undegraded":"2024-08-31T06:02:40.662721+0000","last_fullsized":"2024-08-31T06:02:40.662721+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:03.072197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.605867+0000","last_change":"2024-08-31T06:02:30.597262+0000","last_active":"2024-08-31T06:02:31.605867+0000","last_peered":"2024-08-31T06:02:31.605867+0000","last_clean":"2024-08-31T06:02:31.605867+0000","last_became_active":"2024-08-31T06:02:30.596862+0000","last_became_peered":"2024-08-31T06:02:30.596862+0000","last_unstale":"2024-08-31T06:02:31.605867+0000","last_undegraded":"2024-08-31T06:02:31.605867+0000","last_fullsized":"2024-08-31T06:02:31.605867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:46:29.378532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"70'4","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:38.641633+0000","last_change":"2024-08-31T06:02:28.594161+0000","last_active":"2024-08-31T06:02:38.641633+0000","last_peered":"2024-08-31T06:02:38.641633+0000","last_clean":"2024-08-31T06:02:38.641633+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:02:38.641633+0000","last_undegraded":"2024-08-31T06:02:38.641633+0000","last_fullsized":"2024-08-31T06:02:38.641633+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:31:17.941172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.613730+0000","last_change":"2024-08-31T06:02:30.595194+0000","last_active":"2024-08-31T06:02:31.613730+0000","last_peered":"2024-08-31T06:02:31.613730+0000","last_clean":"2024-08-31T06:02:31.613730+0000","last_became_active":"2024-08-31T06:02:30.594812+0000","last_became_peered":"2024-08-31T06:02:30.594812+0000","last_unstale":"2024-08-31T06:02:31.613730+0000","last_undegraded":"2024-08-31T06:02:31.613730+0000","last_fullsized":"2024-08-31T06:02:31.613730+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:03.224924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.607019+0000","last_change":"2024-08-31T06:02:30.615776+0000","last_active":"2024-08-31T06:02:31.607019+0000","last_peered":"2024-08-31T06:02:31.607019+0000","last_clean":"2024-08-31T06:02:31.607019+0000","last_became_active":"2024-08-31T06:02:30.615385+0000","last_became_peered":"2024-08-31T06:02:30.615385+0000","last_unstale":"2024-08-31T06:02:31.607019+0000","last_undegraded":"2024-08-31T06:02:31.607019+0000","last_fullsized":"2024-08-31T06:02:31.607019+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:49.685443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"70'5","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.670210+0000","last_change":"2024-08-31T06:02:28.591064+0000","last_active":"2024-08-31T06:02:41.670210+0000","last_peered":"2024-08-31T06:02:41.670210+0000","last_clean":"2024-08-31T06:02:41.670210+0000","last_became_active":"2024-08-31T06:02:28.590643+0000","last_became_peered":"2024-08-31T06:02:28.590643+0000","last_unstale":"2024-08-31T06:02:41.670210+0000","last_undegraded":"2024-08-31T06:02:41.670210+0000","last_fullsized":"2024-08-31T06:02:41.670210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:01.953317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.598890+0000","last_change":"2024-08-31T06:02:30.600532+0000","last_active":"2024-08-31T06:02:31.598890+0000","last_peered":"2024-08-31T06:02:31.598890+0000","last_clean":"2024-08-31T06:02:31.598890+0000","last_became_active":"2024-08-31T06:02:30.600013+0000","last_became_peered":"2024-08-31T06:02:30.600013+0000","last_unstale":"2024-08-31T06:02:31.598890+0000","last_undegraded":"2024-08-31T06:02:31.598890+0000","last_fullsized":"2024-08-31T06:02:31.598890+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:38.753206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"70'12","reported_seq":32,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:42.680273+0000","last_change":"2024-08-31T06:02:28.593921+0000","last_active":"2024-08-31T06:02:42.680273+0000","last_peered":"2024-08-31T06:02:42.680273+0000","last_clean":"2024-08-31T06:02:42.680273+0000","last_became_active":"2024-08-31T06:02:28.593102+0000","last_became_peered":"2024-08-31T06:02:28.593102+0000","last_unstale":"2024-08-31T06:02:42.680273+0000","last_undegraded":"2024-08-31T06:02:42.680273+0000","last_fullsized":"2024-08-31T06:02:42.680273+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:30:35.791686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609031+0000","last_change":"2024-08-31T06:02:30.606524+0000","last_active":"2024-08-31T06:02:31.609031+0000","last_peered":"2024-08-31T06:02:31.609031+0000","last_clean":"2024-08-31T06:02:31.609031+0000","last_became_active":"2024-08-31T06:02:30.606132+0000","last_became_peered":"2024-08-31T06:02:30.606132+0000","last_unstale":"2024-08-31T06:02:31.609031+0000","last_undegraded":"2024-08-31T06:02:31.609031+0000","last_fullsized":"2024-08-31T06:02:31.609031+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:46.566811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"70'2","reported_seq":21,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.607901+0000","last_change":"2024-08-31T06:02:28.780596+0000","last_active":"2024-08-31T06:02:31.607901+0000","last_peered":"2024-08-31T06:02:31.607901+0000","last_clean":"2024-08-31T06:02:31.607901+0000","last_became_active":"2024-08-31T06:02:28.779908+0000","last_became_peered":"2024-08-31T06:02:28.779908+0000","last_unstale":"2024-08-31T06:02:31.607901+0000","last_undegraded":"2024-08-31T06:02:31.607901+0000","last_fullsized":"2024-08-31T06:02:31.607901+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:01.254340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606216+0000","last_change":"2024-08-31T06:02:30.610023+0000","last_active":"2024-08-31T06:02:31.606216+0000","last_peered":"2024-08-31T06:02:31.606216+0000","last_clean":"2024-08-31T06:02:31.606216+0000","last_became_active":"2024-08-31T06:02:30.609688+0000","last_became_peered":"2024-08-31T06:02:30.609688+0000","last_unstale":"2024-08-31T06:02:31.606216+0000","last_undegraded":"2024-08-31T06:02:31.606216+0000","last_fullsized":"2024-08-31T06:02:31.606216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:12.870966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"70'13","reported_seq":44,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:51.695803+0000","last_change":"2024-08-31T06:02:28.593773+0000","last_active":"2024-08-31T06:02:51.695803+0000","last_peered":"2024-08-31T06:02:51.695803+0000","last_clean":"2024-08-31T06:02:51.695803+0000","last_became_active":"2024-08-31T06:02:28.593511+0000","last_became_peered":"2024-08-31T06:02:28.593511+0000","last_unstale":"2024-08-31T06:02:51.695803+0000","last_undegraded":"2024-08-31T06:02:51.695803+0000","last_fullsized":"2024-08-31T06:02:51.695803+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:01:50.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54004,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":136,"num_read_kb":133,"num_write":231,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":520192,"data_stored":156275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906960,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717376,"statfs":{"total":95995035648,"available":95966593024,"internally_reserved":0,"allocated":770048,"data_stored":379874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070487,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36768,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708384,"statfs":{"total":95995035648,"available":95957385216,"internally_reserved":0,"allocated":1458176,"data_stored":1018094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928234011,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40280,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704872,"statfs":{"total":95995035648,"available":95953788928,"internally_reserved":0,"allocated":794624,"data_stored":379804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":790528,"data_stored":380182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593764,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28380,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716772,"statfs":{"total":95995035648,"available":95965974528,"internally_reserved":0,"allocated":1388544,"data_stored":973091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757289,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717368,"statfs":{"total":95995035648,"available":95966584832,"internally_reserved":0,"allocated":778240,"data_stored":379521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953517,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28388,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716764,"statfs":{"total":95995035648,"available":95965966336,"internally_reserved":0,"allocated":1396736,"data_stored":972261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36104,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709048,"statfs":{"total":95995035648,"available":95958065152,"internally_reserved":0,"allocated":778240,"data_stored":379773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":379346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444092,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":422108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":427234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40284,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704868,"statfs":{"total":95995035648,"available":95953784832,"internally_reserved":0,"allocated":798720,"data_stored":380860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:02:56.494 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:02:56.750 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:56.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:56 smithi053 ceph-mon[18924]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:02:57.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:56 smithi130 ceph-mon[22266]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:02:57.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:56 smithi153 ceph-mon[22320]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:02:57.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.244+0000 7fed1efc8640 1 -- 172.21.15.53:0/1893514685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed18103940 msgr2=0x7fed18103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:57.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.244+0000 7fed1efc8640 1 --2- 172.21.15.53:0/1893514685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed18103940 0x7fed18103d50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009900 tx=0x7fed0c02a410 comp rx=0 tx=0).stop 2024-08-31T06:02:57.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.244+0000 7fed1efc8640 1 -- 172.21.15.53:0/1893514685 shutdown_connections 2024-08-31T06:02:57.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.244+0000 7fed1efc8640 1 --2- 172.21.15.53:0/1893514685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed18109bd0 0x7fed18110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:57.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.244+0000 7fed1efc8640 1 --2- 172.21.15.53:0/1893514685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed18109280 0x7fed18109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:57.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.244+0000 7fed1efc8640 1 --2- 172.21.15.53:0/1893514685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed18103940 0x7fed18103d50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:57.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.244+0000 7fed1efc8640 1 -- 172.21.15.53:0/1893514685 >> 172.21.15.53:0/1893514685 conn(0x7fed180ff3d0 msgr2=0x7fed18101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.244+0000 7fed1efc8640 1 -- 172.21.15.53:0/1893514685 shutdown_connections 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.244+0000 7fed1efc8640 1 -- 172.21.15.53:0/1893514685 wait complete. 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1efc8640 1 Processor -- start 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1efc8640 1 -- start start 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1efc8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed18103940 0x7fed1819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1efc8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed18109280 0x7fed1819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1efc8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed18109bd0 0x7fed1819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1efc8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fed181137c0 con 0x7fed18109bd0 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1efc8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed18113640 con 0x7fed18109280 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1efc8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed18113940 con 0x7fed18103940 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1d565640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed18109bd0 0x7fed1819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1d565640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed18109bd0 0x7fed1819fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60462/0 (socket says 172.21.15.53:60462) 2024-08-31T06:02:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1d565640 1 -- 172.21.15.53:0/2901711256 learned_addr learned my addr 172.21.15.53:0/2901711256 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed1cd64640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed18103940 0x7fed1819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.245+0000 7fed17fff640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed18109280 0x7fed1819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.246+0000 7fed1d565640 1 -- 172.21.15.53:0/2901711256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed18103940 msgr2=0x7fed1819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.246+0000 7fed1d565640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed18103940 0x7fed1819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.246+0000 7fed1d565640 1 -- 172.21.15.53:0/2901711256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed18109280 msgr2=0x7fed1819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.246+0000 7fed1d565640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed18109280 0x7fed1819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.246+0000 7fed1d565640 1 -- 172.21.15.53:0/2901711256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed181a0180 con 0x7fed18109bd0 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.246+0000 7fed1cd64640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed18103940 0x7fed1819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.246+0000 7fed17fff640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed18109280 0x7fed1819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.246+0000 7fed1d565640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed18109bd0 0x7fed1819fa50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fed1000b970 tx=0x7fed1000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.247+0000 7fed15ffb640 1 -- 172.21.15.53:0/2901711256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10019070 con 0x7fed18109bd0 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.247+0000 7fed15ffb640 1 -- 172.21.15.53:0/2901711256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed10014440 con 0x7fed18109bd0 2024-08-31T06:02:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.247+0000 7fed15ffb640 1 -- 172.21.15.53:0/2901711256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed100075d0 con 0x7fed18109bd0 2024-08-31T06:02:57.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.247+0000 7fed1efc8640 1 -- 172.21.15.53:0/2901711256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed181a0470 con 0x7fed18109bd0 2024-08-31T06:02:57.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.247+0000 7fed1efc8640 1 -- 172.21.15.53:0/2901711256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed181a6bd0 con 0x7fed18109bd0 2024-08-31T06:02:57.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.248+0000 7fed1efc8640 1 -- 172.21.15.53:0/2901711256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed18103d50 con 0x7fed18109bd0 2024-08-31T06:02:57.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.249+0000 7fed15ffb640 1 -- 172.21.15.53:0/2901711256 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fed1001c070 con 0x7fed18109bd0 2024-08-31T06:02:57.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.250+0000 7fed15ffb640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4c90 0x7fed080b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:57.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.250+0000 7fed1cd64640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4c90 0x7fed080b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:57.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.250+0000 7fed15ffb640 1 -- 172.21.15.53:0/2901711256 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7fed100e49a0 con 0x7fed18109bd0 2024-08-31T06:02:57.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.251+0000 7fed1cd64640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4c90 0x7fed080b71a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fed0c000c00 tx=0x7fed0c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:57.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.255+0000 7fed15ffb640 1 -- 172.21.15.53:0/2901711256 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fed10053130 con 0x7fed18109bd0 2024-08-31T06:02:57.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.434+0000 7fed1efc8640 1 -- 172.21.15.53:0/2901711256 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed180635a0 con 0x7fed080b4c90 2024-08-31T06:02:57.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.441+0000 7fed15ffb640 1 -- 172.21.15.53:0/2901711256 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258732 (secure 0 0 0) 0x7fed180635a0 con 0x7fed080b4c90 2024-08-31T06:02:57.446 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:02:57.447 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-08-31T06:02:57.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 -- 172.21.15.53:0/2901711256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4c90 msgr2=0x7fed080b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:57.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4c90 0x7fed080b71a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fed0c000c00 tx=0x7fed0c005a20 comp rx=0 tx=0).stop 2024-08-31T06:02:57.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 -- 172.21.15.53:0/2901711256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed18109bd0 msgr2=0x7fed1819fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:57.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed18109bd0 0x7fed1819fa50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fed1000b970 tx=0x7fed1000be30 comp rx=0 tx=0).stop 2024-08-31T06:02:57.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 -- 172.21.15.53:0/2901711256 shutdown_connections 2024-08-31T06:02:57.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4c90 0x7fed080b71a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:57.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed18109bd0 0x7fed1819fa50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:57.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed18109280 0x7fed1819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:57.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 --2- 172.21.15.53:0/2901711256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed18103940 0x7fed1819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:57.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 -- 172.21.15.53:0/2901711256 >> 172.21.15.53:0/2901711256 conn(0x7fed180ff3d0 msgr2=0x7fed181017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:57.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 -- 172.21.15.53:0/2901711256 shutdown_connections 2024-08-31T06:02:57.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:57.445+0000 7fed1efc8640 1 -- 172.21.15.53:0/2901711256 wait complete. 2024-08-31T06:02:57.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:57 smithi053 ceph-mon[18924]: pgmap v259: 97 pgs: 97 active+clean; 629 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 15 op/s 2024-08-31T06:02:58.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:57 smithi130 ceph-mon[22266]: pgmap v259: 97 pgs: 97 active+clean; 629 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 15 op/s 2024-08-31T06:02:58.175 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-08-31T06:02:56.342102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644606,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":237,"num_read_kb":207,"num_write":356,"num_write_kb":2269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":294,"ondisk_log_size":294,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":389528,"kb_used_data":11160,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124552296,"statfs":{"total":1151940427776,"available":1151541551104,"internally_reserved":0,"allocated":11427840,"data_stored":6478002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48108,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":140,"num_read_kb":123,"num_write":52,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003007"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.616014+0000","last_change":"2024-08-31T06:02:30.611733+0000","last_active":"2024-08-31T06:02:31.616014+0000","last_peered":"2024-08-31T06:02:31.616014+0000","last_clean":"2024-08-31T06:02:31.616014+0000","last_became_active":"2024-08-31T06:02:30.610339+0000","last_became_peered":"2024-08-31T06:02:30.610339+0000","last_unstale":"2024-08-31T06:02:31.616014+0000","last_undegraded":"2024-08-31T06:02:31.616014+0000","last_fullsized":"2024-08-31T06:02:31.616014+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:20.628524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609010+0000","last_change":"2024-08-31T06:02:30.604550+0000","last_active":"2024-08-31T06:02:31.609010+0000","last_peered":"2024-08-31T06:02:31.609010+0000","last_clean":"2024-08-31T06:02:31.609010+0000","last_became_active":"2024-08-31T06:02:30.604200+0000","last_became_peered":"2024-08-31T06:02:30.604200+0000","last_unstale":"2024-08-31T06:02:31.609010+0000","last_undegraded":"2024-08-31T06:02:31.609010+0000","last_fullsized":"2024-08-31T06:02:31.609010+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:31.191972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609431+0000","last_change":"2024-08-31T06:02:30.606102+0000","last_active":"2024-08-31T06:02:31.609431+0000","last_peered":"2024-08-31T06:02:31.609431+0000","last_clean":"2024-08-31T06:02:31.609431+0000","last_became_active":"2024-08-31T06:02:30.605738+0000","last_became_peered":"2024-08-31T06:02:30.605738+0000","last_unstale":"2024-08-31T06:02:31.609431+0000","last_undegraded":"2024-08-31T06:02:31.609431+0000","last_fullsized":"2024-08-31T06:02:31.609431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:50:34.993218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.611279+0000","last_change":"2024-08-31T06:02:30.603207+0000","last_active":"2024-08-31T06:02:31.611279+0000","last_peered":"2024-08-31T06:02:31.611279+0000","last_clean":"2024-08-31T06:02:31.611279+0000","last_became_active":"2024-08-31T06:02:30.602829+0000","last_became_peered":"2024-08-31T06:02:30.602829+0000","last_unstale":"2024-08-31T06:02:31.611279+0000","last_undegraded":"2024-08-31T06:02:31.611279+0000","last_fullsized":"2024-08-31T06:02:31.611279+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:02.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609242+0000","last_change":"2024-08-31T06:02:30.590760+0000","last_active":"2024-08-31T06:02:31.609242+0000","last_peered":"2024-08-31T06:02:31.609242+0000","last_clean":"2024-08-31T06:02:31.609242+0000","last_became_active":"2024-08-31T06:02:30.590198+0000","last_became_peered":"2024-08-31T06:02:30.590198+0000","last_unstale":"2024-08-31T06:02:31.609242+0000","last_undegraded":"2024-08-31T06:02:31.609242+0000","last_fullsized":"2024-08-31T06:02:31.609242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:50.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606568+0000","last_change":"2024-08-31T06:02:30.599924+0000","last_active":"2024-08-31T06:02:31.606568+0000","last_peered":"2024-08-31T06:02:31.606568+0000","last_clean":"2024-08-31T06:02:31.606568+0000","last_became_active":"2024-08-31T06:02:30.599566+0000","last_became_peered":"2024-08-31T06:02:30.599566+0000","last_unstale":"2024-08-31T06:02:31.606568+0000","last_undegraded":"2024-08-31T06:02:31.606568+0000","last_fullsized":"2024-08-31T06:02:31.606568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:58.265673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.613443+0000","last_change":"2024-08-31T06:02:30.605179+0000","last_active":"2024-08-31T06:02:31.613443+0000","last_peered":"2024-08-31T06:02:31.613443+0000","last_clean":"2024-08-31T06:02:31.613443+0000","last_became_active":"2024-08-31T06:02:30.604847+0000","last_became_peered":"2024-08-31T06:02:30.604847+0000","last_unstale":"2024-08-31T06:02:31.613443+0000","last_undegraded":"2024-08-31T06:02:31.613443+0000","last_fullsized":"2024-08-31T06:02:31.613443+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:06:00.997025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606100+0000","last_change":"2024-08-31T06:02:30.610057+0000","last_active":"2024-08-31T06:02:31.606100+0000","last_peered":"2024-08-31T06:02:31.606100+0000","last_clean":"2024-08-31T06:02:31.606100+0000","last_became_active":"2024-08-31T06:02:30.609654+0000","last_became_peered":"2024-08-31T06:02:30.609654+0000","last_unstale":"2024-08-31T06:02:31.606100+0000","last_undegraded":"2024-08-31T06:02:31.606100+0000","last_fullsized":"2024-08-31T06:02:31.606100+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:32:14.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.599543+0000","last_change":"2024-08-31T06:02:30.606437+0000","last_active":"2024-08-31T06:02:31.599543+0000","last_peered":"2024-08-31T06:02:31.599543+0000","last_clean":"2024-08-31T06:02:31.599543+0000","last_became_active":"2024-08-31T06:02:30.605632+0000","last_became_peered":"2024-08-31T06:02:30.605632+0000","last_unstale":"2024-08-31T06:02:31.599543+0000","last_undegraded":"2024-08-31T06:02:31.599543+0000","last_fullsized":"2024-08-31T06:02:31.599543+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:47.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.607296+0000","last_change":"2024-08-31T06:02:30.605456+0000","last_active":"2024-08-31T06:02:31.607296+0000","last_peered":"2024-08-31T06:02:31.607296+0000","last_clean":"2024-08-31T06:02:31.607296+0000","last_became_active":"2024-08-31T06:02:30.604927+0000","last_became_peered":"2024-08-31T06:02:30.604927+0000","last_unstale":"2024-08-31T06:02:31.607296+0000","last_undegraded":"2024-08-31T06:02:31.607296+0000","last_fullsized":"2024-08-31T06:02:31.607296+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:30.340609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.614052+0000","last_change":"2024-08-31T06:02:30.608595+0000","last_active":"2024-08-31T06:02:31.614052+0000","last_peered":"2024-08-31T06:02:31.614052+0000","last_clean":"2024-08-31T06:02:31.614052+0000","last_became_active":"2024-08-31T06:02:30.607695+0000","last_became_peered":"2024-08-31T06:02:30.607695+0000","last_unstale":"2024-08-31T06:02:31.614052+0000","last_undegraded":"2024-08-31T06:02:31.614052+0000","last_fullsized":"2024-08-31T06:02:31.614052+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:44:53.655598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.611234+0000","last_change":"2024-08-31T06:02:30.595775+0000","last_active":"2024-08-31T06:02:31.611234+0000","last_peered":"2024-08-31T06:02:31.611234+0000","last_clean":"2024-08-31T06:02:31.611234+0000","last_became_active":"2024-08-31T06:02:30.595424+0000","last_became_peered":"2024-08-31T06:02:30.595424+0000","last_unstale":"2024-08-31T06:02:31.611234+0000","last_undegraded":"2024-08-31T06:02:31.611234+0000","last_fullsized":"2024-08-31T06:02:31.611234+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:56.382633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596472+0000","last_change":"2024-08-31T06:02:30.603465+0000","last_active":"2024-08-31T06:02:31.596472+0000","last_peered":"2024-08-31T06:02:31.596472+0000","last_clean":"2024-08-31T06:02:31.596472+0000","last_became_active":"2024-08-31T06:02:30.603041+0000","last_became_peered":"2024-08-31T06:02:30.603041+0000","last_unstale":"2024-08-31T06:02:31.596472+0000","last_undegraded":"2024-08-31T06:02:31.596472+0000","last_fullsized":"2024-08-31T06:02:31.596472+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:19:00.139973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.608658+0000","last_change":"2024-08-31T06:02:30.593807+0000","last_active":"2024-08-31T06:02:31.608658+0000","last_peered":"2024-08-31T06:02:31.608658+0000","last_clean":"2024-08-31T06:02:31.608658+0000","last_became_active":"2024-08-31T06:02:30.593389+0000","last_became_peered":"2024-08-31T06:02:30.593389+0000","last_unstale":"2024-08-31T06:02:31.608658+0000","last_undegraded":"2024-08-31T06:02:31.608658+0000","last_fullsized":"2024-08-31T06:02:31.608658+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:01:04.398867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.608696+0000","last_change":"2024-08-31T06:02:30.605207+0000","last_active":"2024-08-31T06:02:31.608696+0000","last_peered":"2024-08-31T06:02:31.608696+0000","last_clean":"2024-08-31T06:02:31.608696+0000","last_became_active":"2024-08-31T06:02:30.604866+0000","last_became_peered":"2024-08-31T06:02:30.604866+0000","last_unstale":"2024-08-31T06:02:31.608696+0000","last_undegraded":"2024-08-31T06:02:31.608696+0000","last_fullsized":"2024-08-31T06:02:31.608696+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:56.305638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.598698+0000","last_change":"2024-08-31T06:02:30.601457+0000","last_active":"2024-08-31T06:02:31.598698+0000","last_peered":"2024-08-31T06:02:31.598698+0000","last_clean":"2024-08-31T06:02:31.598698+0000","last_became_active":"2024-08-31T06:02:30.601077+0000","last_became_peered":"2024-08-31T06:02:30.601077+0000","last_unstale":"2024-08-31T06:02:31.598698+0000","last_undegraded":"2024-08-31T06:02:31.598698+0000","last_fullsized":"2024-08-31T06:02:31.598698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:51:42.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.616358+0000","last_change":"2024-08-31T06:02:30.612475+0000","last_active":"2024-08-31T06:02:31.616358+0000","last_peered":"2024-08-31T06:02:31.616358+0000","last_clean":"2024-08-31T06:02:31.616358+0000","last_became_active":"2024-08-31T06:02:30.612088+0000","last_became_peered":"2024-08-31T06:02:30.612088+0000","last_unstale":"2024-08-31T06:02:31.616358+0000","last_undegraded":"2024-08-31T06:02:31.616358+0000","last_fullsized":"2024-08-31T06:02:31.616358+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:34.348645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609641+0000","last_change":"2024-08-31T06:02:30.605612+0000","last_active":"2024-08-31T06:02:31.609641+0000","last_peered":"2024-08-31T06:02:31.609641+0000","last_clean":"2024-08-31T06:02:31.609641+0000","last_became_active":"2024-08-31T06:02:30.605271+0000","last_became_peered":"2024-08-31T06:02:30.605271+0000","last_unstale":"2024-08-31T06:02:31.609641+0000","last_undegraded":"2024-08-31T06:02:31.609641+0000","last_fullsized":"2024-08-31T06:02:31.609641+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:38.003500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596327+0000","last_change":"2024-08-31T06:02:30.610328+0000","last_active":"2024-08-31T06:02:31.596327+0000","last_peered":"2024-08-31T06:02:31.596327+0000","last_clean":"2024-08-31T06:02:31.596327+0000","last_became_active":"2024-08-31T06:02:30.609935+0000","last_became_peered":"2024-08-31T06:02:30.609935+0000","last_unstale":"2024-08-31T06:02:31.596327+0000","last_undegraded":"2024-08-31T06:02:31.596327+0000","last_fullsized":"2024-08-31T06:02:31.596327+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:22.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.615467+0000","last_change":"2024-08-31T06:02:30.609207+0000","last_active":"2024-08-31T06:02:31.615467+0000","last_peered":"2024-08-31T06:02:31.615467+0000","last_clean":"2024-08-31T06:02:31.615467+0000","last_became_active":"2024-08-31T06:02:30.608635+0000","last_became_peered":"2024-08-31T06:02:30.608635+0000","last_unstale":"2024-08-31T06:02:31.615467+0000","last_undegraded":"2024-08-31T06:02:31.615467+0000","last_fullsized":"2024-08-31T06:02:31.615467+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:43.898073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596394+0000","last_change":"2024-08-31T06:02:30.595829+0000","last_active":"2024-08-31T06:02:31.596394+0000","last_peered":"2024-08-31T06:02:31.596394+0000","last_clean":"2024-08-31T06:02:31.596394+0000","last_became_active":"2024-08-31T06:02:30.595427+0000","last_became_peered":"2024-08-31T06:02:30.595427+0000","last_unstale":"2024-08-31T06:02:31.596394+0000","last_undegraded":"2024-08-31T06:02:31.596394+0000","last_fullsized":"2024-08-31T06:02:31.596394+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:09:39.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.599093+0000","last_change":"2024-08-31T06:02:30.599513+0000","last_active":"2024-08-31T06:02:31.599093+0000","last_peered":"2024-08-31T06:02:31.599093+0000","last_clean":"2024-08-31T06:02:31.599093+0000","last_became_active":"2024-08-31T06:02:30.599195+0000","last_became_peered":"2024-08-31T06:02:30.599195+0000","last_unstale":"2024-08-31T06:02:31.599093+0000","last_undegraded":"2024-08-31T06:02:31.599093+0000","last_fullsized":"2024-08-31T06:02:31.599093+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:26.669658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606242+0000","last_change":"2024-08-31T06:02:30.609229+0000","last_active":"2024-08-31T06:02:31.606242+0000","last_peered":"2024-08-31T06:02:31.606242+0000","last_clean":"2024-08-31T06:02:31.606242+0000","last_became_active":"2024-08-31T06:02:30.608536+0000","last_became_peered":"2024-08-31T06:02:30.608536+0000","last_unstale":"2024-08-31T06:02:31.606242+0000","last_undegraded":"2024-08-31T06:02:31.606242+0000","last_fullsized":"2024-08-31T06:02:31.606242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:08.917901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606859+0000","last_change":"2024-08-31T06:02:30.603663+0000","last_active":"2024-08-31T06:02:31.606859+0000","last_peered":"2024-08-31T06:02:31.606859+0000","last_clean":"2024-08-31T06:02:31.606859+0000","last_became_active":"2024-08-31T06:02:30.603220+0000","last_became_peered":"2024-08-31T06:02:30.603220+0000","last_unstale":"2024-08-31T06:02:31.606859+0000","last_undegraded":"2024-08-31T06:02:31.606859+0000","last_fullsized":"2024-08-31T06:02:31.606859+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:09.433078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.605970+0000","last_change":"2024-08-31T06:02:30.608474+0000","last_active":"2024-08-31T06:02:31.605970+0000","last_peered":"2024-08-31T06:02:31.605970+0000","last_clean":"2024-08-31T06:02:31.605970+0000","last_became_active":"2024-08-31T06:02:30.608118+0000","last_became_peered":"2024-08-31T06:02:30.608118+0000","last_unstale":"2024-08-31T06:02:31.605970+0000","last_undegraded":"2024-08-31T06:02:31.605970+0000","last_fullsized":"2024-08-31T06:02:31.605970+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:55.124001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596322+0000","last_change":"2024-08-31T06:02:30.614255+0000","last_active":"2024-08-31T06:02:31.596322+0000","last_peered":"2024-08-31T06:02:31.596322+0000","last_clean":"2024-08-31T06:02:31.596322+0000","last_became_active":"2024-08-31T06:02:30.613805+0000","last_became_peered":"2024-08-31T06:02:30.613805+0000","last_unstale":"2024-08-31T06:02:31.596322+0000","last_undegraded":"2024-08-31T06:02:31.596322+0000","last_fullsized":"2024-08-31T06:02:31.596322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.892997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.615746+0000","last_change":"2024-08-31T06:02:30.609877+0000","last_active":"2024-08-31T06:02:31.615746+0000","last_peered":"2024-08-31T06:02:31.615746+0000","last_clean":"2024-08-31T06:02:31.615746+0000","last_became_active":"2024-08-31T06:02:30.608805+0000","last_became_peered":"2024-08-31T06:02:30.608805+0000","last_unstale":"2024-08-31T06:02:31.615746+0000","last_undegraded":"2024-08-31T06:02:31.615746+0000","last_fullsized":"2024-08-31T06:02:31.615746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:52.172745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596431+0000","last_change":"2024-08-31T06:02:30.594684+0000","last_active":"2024-08-31T06:02:31.596431+0000","last_peered":"2024-08-31T06:02:31.596431+0000","last_clean":"2024-08-31T06:02:31.596431+0000","last_became_active":"2024-08-31T06:02:30.594293+0000","last_became_peered":"2024-08-31T06:02:30.594293+0000","last_unstale":"2024-08-31T06:02:31.596431+0000","last_undegraded":"2024-08-31T06:02:31.596431+0000","last_fullsized":"2024-08-31T06:02:31.596431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:58:39.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609128+0000","last_change":"2024-08-31T06:02:30.602765+0000","last_active":"2024-08-31T06:02:31.609128+0000","last_peered":"2024-08-31T06:02:31.609128+0000","last_clean":"2024-08-31T06:02:31.609128+0000","last_became_active":"2024-08-31T06:02:30.602410+0000","last_became_peered":"2024-08-31T06:02:30.602410+0000","last_unstale":"2024-08-31T06:02:31.609128+0000","last_undegraded":"2024-08-31T06:02:31.609128+0000","last_fullsized":"2024-08-31T06:02:31.609128+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:12.370967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596805+0000","last_change":"2024-08-31T06:02:30.611818+0000","last_active":"2024-08-31T06:02:31.596805+0000","last_peered":"2024-08-31T06:02:31.596805+0000","last_clean":"2024-08-31T06:02:31.596805+0000","last_became_active":"2024-08-31T06:02:30.610917+0000","last_became_peered":"2024-08-31T06:02:30.610917+0000","last_unstale":"2024-08-31T06:02:31.596805+0000","last_undegraded":"2024-08-31T06:02:31.596805+0000","last_fullsized":"2024-08-31T06:02:31.596805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:00.895825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596211+0000","last_change":"2024-08-31T06:02:30.612186+0000","last_active":"2024-08-31T06:02:31.596211+0000","last_peered":"2024-08-31T06:02:31.596211+0000","last_clean":"2024-08-31T06:02:31.596211+0000","last_became_active":"2024-08-31T06:02:30.610496+0000","last_became_peered":"2024-08-31T06:02:30.610496+0000","last_unstale":"2024-08-31T06:02:31.596211+0000","last_undegraded":"2024-08-31T06:02:31.596211+0000","last_fullsized":"2024-08-31T06:02:31.596211+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:48:19.954998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.615503+0000","last_change":"2024-08-31T06:02:30.616281+0000","last_active":"2024-08-31T06:02:31.615503+0000","last_peered":"2024-08-31T06:02:31.615503+0000","last_clean":"2024-08-31T06:02:31.615503+0000","last_became_active":"2024-08-31T06:02:30.615905+0000","last_became_peered":"2024-08-31T06:02:30.615905+0000","last_unstale":"2024-08-31T06:02:31.615503+0000","last_undegraded":"2024-08-31T06:02:31.615503+0000","last_fullsized":"2024-08-31T06:02:31.615503+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:59:33.731440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.608763+0000","last_change":"2024-08-31T06:02:30.607864+0000","last_active":"2024-08-31T06:02:31.608763+0000","last_peered":"2024-08-31T06:02:31.608763+0000","last_clean":"2024-08-31T06:02:31.608763+0000","last_became_active":"2024-08-31T06:02:30.607299+0000","last_became_peered":"2024-08-31T06:02:30.607299+0000","last_unstale":"2024-08-31T06:02:31.608763+0000","last_undegraded":"2024-08-31T06:02:31.608763+0000","last_fullsized":"2024-08-31T06:02:31.608763+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:19.302279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"70'6","reported_seq":41,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:53.700030+0000","last_change":"2024-08-31T06:02:28.594973+0000","last_active":"2024-08-31T06:02:53.700030+0000","last_peered":"2024-08-31T06:02:53.700030+0000","last_clean":"2024-08-31T06:02:53.700030+0000","last_became_active":"2024-08-31T06:02:28.594588+0000","last_became_peered":"2024-08-31T06:02:28.594588+0000","last_unstale":"2024-08-31T06:02:53.700030+0000","last_undegraded":"2024-08-31T06:02:53.700030+0000","last_fullsized":"2024-08-31T06:02:53.700030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:29:48.016888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.608044+0000","last_change":"2024-08-31T06:02:30.610083+0000","last_active":"2024-08-31T06:02:31.608044+0000","last_peered":"2024-08-31T06:02:31.608044+0000","last_clean":"2024-08-31T06:02:31.608044+0000","last_became_active":"2024-08-31T06:02:30.609376+0000","last_became_peered":"2024-08-31T06:02:30.609376+0000","last_unstale":"2024-08-31T06:02:31.608044+0000","last_undegraded":"2024-08-31T06:02:31.608044+0000","last_fullsized":"2024-08-31T06:02:31.608044+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:15.416670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"70'7","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:40.663855+0000","last_change":"2024-08-31T06:02:28.589152+0000","last_active":"2024-08-31T06:02:40.663855+0000","last_peered":"2024-08-31T06:02:40.663855+0000","last_clean":"2024-08-31T06:02:40.663855+0000","last_became_active":"2024-08-31T06:02:28.588758+0000","last_became_peered":"2024-08-31T06:02:28.588758+0000","last_unstale":"2024-08-31T06:02:40.663855+0000","last_undegraded":"2024-08-31T06:02:40.663855+0000","last_fullsized":"2024-08-31T06:02:40.663855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:31.814105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"70'3","reported_seq":22,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:39.649625+0000","last_change":"2024-08-31T06:02:28.585410+0000","last_active":"2024-08-31T06:02:39.649625+0000","last_peered":"2024-08-31T06:02:39.649625+0000","last_clean":"2024-08-31T06:02:39.649625+0000","last_became_active":"2024-08-31T06:02:28.584998+0000","last_became_peered":"2024-08-31T06:02:28.584998+0000","last_unstale":"2024-08-31T06:02:39.649625+0000","last_undegraded":"2024-08-31T06:02:39.649625+0000","last_fullsized":"2024-08-31T06:02:39.649625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:30.705460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.605598+0000","last_change":"2024-08-31T06:02:30.597295+0000","last_active":"2024-08-31T06:02:31.605598+0000","last_peered":"2024-08-31T06:02:31.605598+0000","last_clean":"2024-08-31T06:02:31.605598+0000","last_became_active":"2024-08-31T06:02:30.596968+0000","last_became_peered":"2024-08-31T06:02:30.596968+0000","last_unstale":"2024-08-31T06:02:31.605598+0000","last_undegraded":"2024-08-31T06:02:31.605598+0000","last_fullsized":"2024-08-31T06:02:31.605598+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:38.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"70'3","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.669741+0000","last_change":"2024-08-31T06:02:28.594164+0000","last_active":"2024-08-31T06:02:41.669741+0000","last_peered":"2024-08-31T06:02:41.669741+0000","last_clean":"2024-08-31T06:02:41.669741+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:02:41.669741+0000","last_undegraded":"2024-08-31T06:02:41.669741+0000","last_fullsized":"2024-08-31T06:02:41.669741+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:21.780202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609973+0000","last_change":"2024-08-31T06:02:30.597500+0000","last_active":"2024-08-31T06:02:31.609973+0000","last_peered":"2024-08-31T06:02:31.609973+0000","last_clean":"2024-08-31T06:02:31.609973+0000","last_became_active":"2024-08-31T06:02:30.597147+0000","last_became_peered":"2024-08-31T06:02:30.597147+0000","last_unstale":"2024-08-31T06:02:31.609973+0000","last_undegraded":"2024-08-31T06:02:31.609973+0000","last_fullsized":"2024-08-31T06:02:31.609973+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:34.111288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"70'4","reported_seq":45,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:52.697949+0000","last_change":"2024-08-31T06:02:28.585769+0000","last_active":"2024-08-31T06:02:52.697949+0000","last_peered":"2024-08-31T06:02:52.697949+0000","last_clean":"2024-08-31T06:02:52.697949+0000","last_became_active":"2024-08-31T06:02:28.585310+0000","last_became_peered":"2024-08-31T06:02:28.585310+0000","last_unstale":"2024-08-31T06:02:52.697949+0000","last_undegraded":"2024-08-31T06:02:52.697949+0000","last_fullsized":"2024-08-31T06:02:52.697949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:40.595986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.599344+0000","last_change":"2024-08-31T06:02:30.601434+0000","last_active":"2024-08-31T06:02:31.599344+0000","last_peered":"2024-08-31T06:02:31.599344+0000","last_clean":"2024-08-31T06:02:31.599344+0000","last_became_active":"2024-08-31T06:02:30.601060+0000","last_became_peered":"2024-08-31T06:02:30.601060+0000","last_unstale":"2024-08-31T06:02:31.599344+0000","last_undegraded":"2024-08-31T06:02:31.599344+0000","last_fullsized":"2024-08-31T06:02:31.599344+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:32.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"70'4","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.669325+0000","last_change":"2024-08-31T06:02:28.593217+0000","last_active":"2024-08-31T06:02:41.669325+0000","last_peered":"2024-08-31T06:02:41.669325+0000","last_clean":"2024-08-31T06:02:41.669325+0000","last_became_active":"2024-08-31T06:02:28.592801+0000","last_became_peered":"2024-08-31T06:02:28.592801+0000","last_unstale":"2024-08-31T06:02:41.669325+0000","last_undegraded":"2024-08-31T06:02:41.669325+0000","last_fullsized":"2024-08-31T06:02:41.669325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:21.561089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609280+0000","last_change":"2024-08-31T06:02:30.606747+0000","last_active":"2024-08-31T06:02:31.609280+0000","last_peered":"2024-08-31T06:02:31.609280+0000","last_clean":"2024-08-31T06:02:31.609280+0000","last_became_active":"2024-08-31T06:02:30.606347+0000","last_became_peered":"2024-08-31T06:02:30.606347+0000","last_unstale":"2024-08-31T06:02:31.609280+0000","last_undegraded":"2024-08-31T06:02:31.609280+0000","last_fullsized":"2024-08-31T06:02:31.609280+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:57:30.014026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"70'5","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:40.664371+0000","last_change":"2024-08-31T06:02:28.781606+0000","last_active":"2024-08-31T06:02:40.664371+0000","last_peered":"2024-08-31T06:02:40.664371+0000","last_clean":"2024-08-31T06:02:40.664371+0000","last_became_active":"2024-08-31T06:02:28.780886+0000","last_became_peered":"2024-08-31T06:02:28.780886+0000","last_unstale":"2024-08-31T06:02:40.664371+0000","last_undegraded":"2024-08-31T06:02:40.664371+0000","last_fullsized":"2024-08-31T06:02:40.664371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:07.540461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.598999+0000","last_change":"2024-08-31T06:02:30.604358+0000","last_active":"2024-08-31T06:02:31.598999+0000","last_peered":"2024-08-31T06:02:31.598999+0000","last_clean":"2024-08-31T06:02:31.598999+0000","last_became_active":"2024-08-31T06:02:30.603980+0000","last_became_peered":"2024-08-31T06:02:30.603980+0000","last_unstale":"2024-08-31T06:02:31.598999+0000","last_undegraded":"2024-08-31T06:02:31.598999+0000","last_fullsized":"2024-08-31T06:02:31.598999+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:43:03.062141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"70'24","reported_seq":71,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:52.699380+0000","last_change":"2024-08-31T06:02:28.590795+0000","last_active":"2024-08-31T06:02:52.699380+0000","last_peered":"2024-08-31T06:02:52.699380+0000","last_clean":"2024-08-31T06:02:52.699380+0000","last_became_active":"2024-08-31T06:02:28.590397+0000","last_became_peered":"2024-08-31T06:02:28.590397+0000","last_unstale":"2024-08-31T06:02:52.699380+0000","last_undegraded":"2024-08-31T06:02:52.699380+0000","last_fullsized":"2024-08-31T06:02:52.699380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:30.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":59,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.610254+0000","last_change":"2024-08-31T06:02:30.603110+0000","last_active":"2024-08-31T06:02:31.610254+0000","last_peered":"2024-08-31T06:02:31.610254+0000","last_clean":"2024-08-31T06:02:31.610254+0000","last_became_active":"2024-08-31T06:02:30.602691+0000","last_became_peered":"2024-08-31T06:02:30.602691+0000","last_unstale":"2024-08-31T06:02:31.610254+0000","last_undegraded":"2024-08-31T06:02:31.610254+0000","last_fullsized":"2024-08-31T06:02:31.610254+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:20.009202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"70'9","reported_seq":30,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:42.679344+0000","last_change":"2024-08-31T06:02:28.591126+0000","last_active":"2024-08-31T06:02:42.679344+0000","last_peered":"2024-08-31T06:02:42.679344+0000","last_clean":"2024-08-31T06:02:42.679344+0000","last_became_active":"2024-08-31T06:02:28.590744+0000","last_became_peered":"2024-08-31T06:02:28.590744+0000","last_unstale":"2024-08-31T06:02:42.679344+0000","last_undegraded":"2024-08-31T06:02:42.679344+0000","last_fullsized":"2024-08-31T06:02:42.679344+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:43.910807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.595922+0000","last_change":"2024-08-31T06:02:30.599843+0000","last_active":"2024-08-31T06:02:31.595922+0000","last_peered":"2024-08-31T06:02:31.595922+0000","last_clean":"2024-08-31T06:02:31.595922+0000","last_became_active":"2024-08-31T06:02:30.599440+0000","last_became_peered":"2024-08-31T06:02:30.599440+0000","last_unstale":"2024-08-31T06:02:31.595922+0000","last_undegraded":"2024-08-31T06:02:31.595922+0000","last_fullsized":"2024-08-31T06:02:31.595922+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:01.029482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"70'5","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.669213+0000","last_change":"2024-08-31T06:02:28.594178+0000","last_active":"2024-08-31T06:02:41.669213+0000","last_peered":"2024-08-31T06:02:41.669213+0000","last_clean":"2024-08-31T06:02:41.669213+0000","last_became_active":"2024-08-31T06:02:28.593802+0000","last_became_peered":"2024-08-31T06:02:28.593802+0000","last_unstale":"2024-08-31T06:02:41.669213+0000","last_undegraded":"2024-08-31T06:02:41.669213+0000","last_fullsized":"2024-08-31T06:02:41.669213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:52.561582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.613848+0000","last_change":"2024-08-31T06:02:30.595979+0000","last_active":"2024-08-31T06:02:31.613848+0000","last_peered":"2024-08-31T06:02:31.613848+0000","last_clean":"2024-08-31T06:02:31.613848+0000","last_became_active":"2024-08-31T06:02:30.595665+0000","last_became_peered":"2024-08-31T06:02:30.595665+0000","last_unstale":"2024-08-31T06:02:31.613848+0000","last_undegraded":"2024-08-31T06:02:31.613848+0000","last_fullsized":"2024-08-31T06:02:31.613848+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:40.347954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"70'6","reported_seq":38,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:50.695991+0000","last_change":"2024-08-31T06:02:28.594117+0000","last_active":"2024-08-31T06:02:50.695991+0000","last_peered":"2024-08-31T06:02:50.695991+0000","last_clean":"2024-08-31T06:02:50.695991+0000","last_became_active":"2024-08-31T06:02:28.593721+0000","last_became_peered":"2024-08-31T06:02:28.593721+0000","last_unstale":"2024-08-31T06:02:50.695991+0000","last_undegraded":"2024-08-31T06:02:50.695991+0000","last_fullsized":"2024-08-31T06:02:50.695991+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:48:49.400841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.612401+0000","last_change":"2024-08-31T06:02:30.606967+0000","last_active":"2024-08-31T06:02:31.612401+0000","last_peered":"2024-08-31T06:02:31.612401+0000","last_clean":"2024-08-31T06:02:31.612401+0000","last_became_active":"2024-08-31T06:02:30.605730+0000","last_became_peered":"2024-08-31T06:02:30.605730+0000","last_unstale":"2024-08-31T06:02:31.612401+0000","last_undegraded":"2024-08-31T06:02:31.612401+0000","last_fullsized":"2024-08-31T06:02:31.612401+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:30.656071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"70'17","reported_seq":37,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.669350+0000","last_change":"2024-08-31T06:02:28.780911+0000","last_active":"2024-08-31T06:02:41.669350+0000","last_peered":"2024-08-31T06:02:41.669350+0000","last_clean":"2024-08-31T06:02:41.669350+0000","last_became_active":"2024-08-31T06:02:28.780375+0000","last_became_peered":"2024-08-31T06:02:28.780375+0000","last_unstale":"2024-08-31T06:02:41.669350+0000","last_undegraded":"2024-08-31T06:02:41.669350+0000","last_fullsized":"2024-08-31T06:02:41.669350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:46.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606897+0000","last_change":"2024-08-31T06:02:30.606871+0000","last_active":"2024-08-31T06:02:31.606897+0000","last_peered":"2024-08-31T06:02:31.606897+0000","last_clean":"2024-08-31T06:02:31.606897+0000","last_became_active":"2024-08-31T06:02:30.606507+0000","last_became_peered":"2024-08-31T06:02:30.606507+0000","last_unstale":"2024-08-31T06:02:31.606897+0000","last_undegraded":"2024-08-31T06:02:31.606897+0000","last_fullsized":"2024-08-31T06:02:31.606897+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:16:31.502034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"70'2","reported_seq":22,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.642642+0000","last_change":"2024-08-31T06:02:28.588078+0000","last_active":"2024-08-31T06:02:41.642642+0000","last_peered":"2024-08-31T06:02:41.642642+0000","last_clean":"2024-08-31T06:02:41.642642+0000","last_became_active":"2024-08-31T06:02:28.587642+0000","last_became_peered":"2024-08-31T06:02:28.587642+0000","last_unstale":"2024-08-31T06:02:41.642642+0000","last_undegraded":"2024-08-31T06:02:41.642642+0000","last_fullsized":"2024-08-31T06:02:41.642642+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:59.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.615598+0000","last_change":"2024-08-31T06:02:30.605647+0000","last_active":"2024-08-31T06:02:31.615598+0000","last_peered":"2024-08-31T06:02:31.615598+0000","last_clean":"2024-08-31T06:02:31.615598+0000","last_became_active":"2024-08-31T06:02:30.605267+0000","last_became_peered":"2024-08-31T06:02:30.605267+0000","last_unstale":"2024-08-31T06:02:31.615598+0000","last_undegraded":"2024-08-31T06:02:31.615598+0000","last_fullsized":"2024-08-31T06:02:31.615598+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:08:34.741030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"70'5","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.668155+0000","last_change":"2024-08-31T06:02:28.585295+0000","last_active":"2024-08-31T06:02:41.668155+0000","last_peered":"2024-08-31T06:02:41.668155+0000","last_clean":"2024-08-31T06:02:41.668155+0000","last_became_active":"2024-08-31T06:02:28.584895+0000","last_became_peered":"2024-08-31T06:02:28.584895+0000","last_unstale":"2024-08-31T06:02:41.668155+0000","last_undegraded":"2024-08-31T06:02:41.668155+0000","last_fullsized":"2024-08-31T06:02:41.668155+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:57:12.658937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.614401+0000","last_change":"2024-08-31T06:02:30.603593+0000","last_active":"2024-08-31T06:02:31.614401+0000","last_peered":"2024-08-31T06:02:31.614401+0000","last_clean":"2024-08-31T06:02:31.614401+0000","last_became_active":"2024-08-31T06:02:30.603274+0000","last_became_peered":"2024-08-31T06:02:30.603274+0000","last_unstale":"2024-08-31T06:02:31.614401+0000","last_undegraded":"2024-08-31T06:02:31.614401+0000","last_fullsized":"2024-08-31T06:02:31.614401+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:07.720406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"70'3","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.669599+0000","last_change":"2024-08-31T06:02:28.586920+0000","last_active":"2024-08-31T06:02:41.669599+0000","last_peered":"2024-08-31T06:02:41.669599+0000","last_clean":"2024-08-31T06:02:41.669599+0000","last_became_active":"2024-08-31T06:02:28.586362+0000","last_became_peered":"2024-08-31T06:02:28.586362+0000","last_unstale":"2024-08-31T06:02:41.669599+0000","last_undegraded":"2024-08-31T06:02:41.669599+0000","last_fullsized":"2024-08-31T06:02:41.669599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:52.065879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"70'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.614022+0000","last_change":"2024-08-31T06:02:30.603800+0000","last_active":"2024-08-31T06:02:31.614022+0000","last_peered":"2024-08-31T06:02:31.614022+0000","last_clean":"2024-08-31T06:02:31.614022+0000","last_became_active":"2024-08-31T06:02:30.603439+0000","last_became_peered":"2024-08-31T06:02:30.603439+0000","last_unstale":"2024-08-31T06:02:31.614022+0000","last_undegraded":"2024-08-31T06:02:31.614022+0000","last_fullsized":"2024-08-31T06:02:31.614022+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:39.992719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"70'5","reported_seq":39,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:53.699701+0000","last_change":"2024-08-31T06:02:28.936404+0000","last_active":"2024-08-31T06:02:53.699701+0000","last_peered":"2024-08-31T06:02:53.699701+0000","last_clean":"2024-08-31T06:02:53.699701+0000","last_became_active":"2024-08-31T06:02:28.935898+0000","last_became_peered":"2024-08-31T06:02:28.935898+0000","last_unstale":"2024-08-31T06:02:53.699701+0000","last_undegraded":"2024-08-31T06:02:53.699701+0000","last_fullsized":"2024-08-31T06:02:53.699701+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:35.004510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.614082+0000","last_change":"2024-08-31T06:02:30.608258+0000","last_active":"2024-08-31T06:02:31.614082+0000","last_peered":"2024-08-31T06:02:31.614082+0000","last_clean":"2024-08-31T06:02:31.614082+0000","last_became_active":"2024-08-31T06:02:30.607067+0000","last_became_peered":"2024-08-31T06:02:30.607067+0000","last_unstale":"2024-08-31T06:02:31.614082+0000","last_undegraded":"2024-08-31T06:02:31.614082+0000","last_fullsized":"2024-08-31T06:02:31.614082+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:03:09.362812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":88,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.613595+0000","last_change":"2024-08-31T06:01:19.125033+0000","last_active":"2024-08-31T06:02:31.613595+0000","last_peered":"2024-08-31T06:02:31.613595+0000","last_clean":"2024-08-31T06:02:31.613595+0000","last_became_active":"2024-08-31T06:01:19.118469+0000","last_became_peered":"2024-08-31T06:01:19.118469+0000","last_unstale":"2024-08-31T06:02:31.613595+0000","last_undegraded":"2024-08-31T06:02:31.613595+0000","last_fullsized":"2024-08-31T06:02:31.613595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_clean_scrub_stamp":"2024-08-31T05:58:05.259854+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:33.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"70'6","reported_seq":28,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:42.680394+0000","last_change":"2024-08-31T06:02:28.588276+0000","last_active":"2024-08-31T06:02:42.680394+0000","last_peered":"2024-08-31T06:02:42.680394+0000","last_clean":"2024-08-31T06:02:42.680394+0000","last_became_active":"2024-08-31T06:02:28.587184+0000","last_became_peered":"2024-08-31T06:02:28.587184+0000","last_unstale":"2024-08-31T06:02:42.680394+0000","last_undegraded":"2024-08-31T06:02:42.680394+0000","last_fullsized":"2024-08-31T06:02:42.680394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:12.762919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.605836+0000","last_change":"2024-08-31T06:02:30.610801+0000","last_active":"2024-08-31T06:02:31.605836+0000","last_peered":"2024-08-31T06:02:31.605836+0000","last_clean":"2024-08-31T06:02:31.605836+0000","last_became_active":"2024-08-31T06:02:30.610446+0000","last_became_peered":"2024-08-31T06:02:30.610446+0000","last_unstale":"2024-08-31T06:02:31.605836+0000","last_undegraded":"2024-08-31T06:02:31.605836+0000","last_fullsized":"2024-08-31T06:02:31.605836+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:17.891734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"70'4","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:39.647723+0000","last_change":"2024-08-31T06:02:28.594648+0000","last_active":"2024-08-31T06:02:39.647723+0000","last_peered":"2024-08-31T06:02:39.647723+0000","last_clean":"2024-08-31T06:02:39.647723+0000","last_became_active":"2024-08-31T06:02:28.594260+0000","last_became_peered":"2024-08-31T06:02:28.594260+0000","last_unstale":"2024-08-31T06:02:39.647723+0000","last_undegraded":"2024-08-31T06:02:39.647723+0000","last_fullsized":"2024-08-31T06:02:39.647723+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:32:01.540348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.595896+0000","last_change":"2024-08-31T06:02:30.601509+0000","last_active":"2024-08-31T06:02:31.595896+0000","last_peered":"2024-08-31T06:02:31.595896+0000","last_clean":"2024-08-31T06:02:31.595896+0000","last_became_active":"2024-08-31T06:02:30.601021+0000","last_became_peered":"2024-08-31T06:02:30.601021+0000","last_unstale":"2024-08-31T06:02:31.595896+0000","last_undegraded":"2024-08-31T06:02:31.595896+0000","last_fullsized":"2024-08-31T06:02:31.595896+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:16:19.574556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"70'5","reported_seq":39,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:54.700802+0000","last_change":"2024-08-31T06:02:28.780419+0000","last_active":"2024-08-31T06:02:54.700802+0000","last_peered":"2024-08-31T06:02:54.700802+0000","last_clean":"2024-08-31T06:02:54.700802+0000","last_became_active":"2024-08-31T06:02:28.779814+0000","last_became_peered":"2024-08-31T06:02:28.779814+0000","last_unstale":"2024-08-31T06:02:54.700802+0000","last_undegraded":"2024-08-31T06:02:54.700802+0000","last_fullsized":"2024-08-31T06:02:54.700802+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:36.183841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606915+0000","last_change":"2024-08-31T06:02:30.605961+0000","last_active":"2024-08-31T06:02:31.606915+0000","last_peered":"2024-08-31T06:02:31.606915+0000","last_clean":"2024-08-31T06:02:31.606915+0000","last_became_active":"2024-08-31T06:02:30.605523+0000","last_became_peered":"2024-08-31T06:02:30.605523+0000","last_unstale":"2024-08-31T06:02:31.606915+0000","last_undegraded":"2024-08-31T06:02:31.606915+0000","last_fullsized":"2024-08-31T06:02:31.606915+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:07.540336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"70'5","reported_seq":38,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:53.698884+0000","last_change":"2024-08-31T06:02:28.594220+0000","last_active":"2024-08-31T06:02:53.698884+0000","last_peered":"2024-08-31T06:02:53.698884+0000","last_clean":"2024-08-31T06:02:53.698884+0000","last_became_active":"2024-08-31T06:02:28.593729+0000","last_became_peered":"2024-08-31T06:02:28.593729+0000","last_unstale":"2024-08-31T06:02:53.698884+0000","last_undegraded":"2024-08-31T06:02:53.698884+0000","last_fullsized":"2024-08-31T06:02:53.698884+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:37:03.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606719+0000","last_change":"2024-08-31T06:02:30.600008+0000","last_active":"2024-08-31T06:02:31.606719+0000","last_peered":"2024-08-31T06:02:31.606719+0000","last_clean":"2024-08-31T06:02:31.606719+0000","last_became_active":"2024-08-31T06:02:30.599677+0000","last_became_peered":"2024-08-31T06:02:30.599677+0000","last_unstale":"2024-08-31T06:02:31.606719+0000","last_undegraded":"2024-08-31T06:02:31.606719+0000","last_fullsized":"2024-08-31T06:02:31.606719+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:59.520544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"70'1","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609201+0000","last_change":"2024-08-31T06:02:28.780554+0000","last_active":"2024-08-31T06:02:31.609201+0000","last_peered":"2024-08-31T06:02:31.609201+0000","last_clean":"2024-08-31T06:02:31.609201+0000","last_became_active":"2024-08-31T06:02:28.780137+0000","last_became_peered":"2024-08-31T06:02:28.780137+0000","last_unstale":"2024-08-31T06:02:31.609201+0000","last_undegraded":"2024-08-31T06:02:31.609201+0000","last_fullsized":"2024-08-31T06:02:31.609201+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:57.523667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"70'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:33.212705+0000","last_change":"2024-08-31T06:02:30.597438+0000","last_active":"2024-08-31T06:02:33.212705+0000","last_peered":"2024-08-31T06:02:33.212705+0000","last_clean":"2024-08-31T06:02:33.212705+0000","last_became_active":"2024-08-31T06:02:30.597108+0000","last_became_peered":"2024-08-31T06:02:30.597108+0000","last_unstale":"2024-08-31T06:02:33.212705+0000","last_undegraded":"2024-08-31T06:02:33.212705+0000","last_fullsized":"2024-08-31T06:02:33.212705+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:05.238708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"70'4","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.670177+0000","last_change":"2024-08-31T06:02:28.781006+0000","last_active":"2024-08-31T06:02:41.670177+0000","last_peered":"2024-08-31T06:02:41.670177+0000","last_clean":"2024-08-31T06:02:41.670177+0000","last_became_active":"2024-08-31T06:02:28.780468+0000","last_became_peered":"2024-08-31T06:02:28.780468+0000","last_unstale":"2024-08-31T06:02:41.670177+0000","last_undegraded":"2024-08-31T06:02:41.670177+0000","last_fullsized":"2024-08-31T06:02:41.670177+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:20.206251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.596579+0000","last_change":"2024-08-31T06:02:30.600826+0000","last_active":"2024-08-31T06:02:31.596579+0000","last_peered":"2024-08-31T06:02:31.596579+0000","last_clean":"2024-08-31T06:02:31.596579+0000","last_became_active":"2024-08-31T06:02:30.600474+0000","last_became_peered":"2024-08-31T06:02:30.600474+0000","last_unstale":"2024-08-31T06:02:31.596579+0000","last_undegraded":"2024-08-31T06:02:31.596579+0000","last_fullsized":"2024-08-31T06:02:31.596579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:07.456576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"70'12","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:50.603163+0000","last_change":"2024-08-31T06:02:28.588026+0000","last_active":"2024-08-31T06:02:50.603163+0000","last_peered":"2024-08-31T06:02:50.603163+0000","last_clean":"2024-08-31T06:02:50.603163+0000","last_became_active":"2024-08-31T06:02:28.587759+0000","last_became_peered":"2024-08-31T06:02:28.587759+0000","last_unstale":"2024-08-31T06:02:50.603163+0000","last_undegraded":"2024-08-31T06:02:50.603163+0000","last_fullsized":"2024-08-31T06:02:50.603163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:44.323111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606078+0000","last_change":"2024-08-31T06:02:30.604375+0000","last_active":"2024-08-31T06:02:31.606078+0000","last_peered":"2024-08-31T06:02:31.606078+0000","last_clean":"2024-08-31T06:02:31.606078+0000","last_became_active":"2024-08-31T06:02:30.604008+0000","last_became_peered":"2024-08-31T06:02:30.604008+0000","last_unstale":"2024-08-31T06:02:31.606078+0000","last_undegraded":"2024-08-31T06:02:31.606078+0000","last_fullsized":"2024-08-31T06:02:31.606078+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:37.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"70'7","reported_seq":27,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.670343+0000","last_change":"2024-08-31T06:02:28.936568+0000","last_active":"2024-08-31T06:02:41.670343+0000","last_peered":"2024-08-31T06:02:41.670343+0000","last_clean":"2024-08-31T06:02:41.670343+0000","last_became_active":"2024-08-31T06:02:28.936185+0000","last_became_peered":"2024-08-31T06:02:28.936185+0000","last_unstale":"2024-08-31T06:02:41.670343+0000","last_undegraded":"2024-08-31T06:02:41.670343+0000","last_fullsized":"2024-08-31T06:02:41.670343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:34.080300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609172+0000","last_change":"2024-08-31T06:02:30.604263+0000","last_active":"2024-08-31T06:02:31.609172+0000","last_peered":"2024-08-31T06:02:31.609172+0000","last_clean":"2024-08-31T06:02:31.609172+0000","last_became_active":"2024-08-31T06:02:30.603887+0000","last_became_peered":"2024-08-31T06:02:30.603887+0000","last_unstale":"2024-08-31T06:02:31.609172+0000","last_undegraded":"2024-08-31T06:02:31.609172+0000","last_fullsized":"2024-08-31T06:02:31.609172+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:56.506315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"70'2","reported_seq":21,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:38.640565+0000","last_change":"2024-08-31T06:02:28.780773+0000","last_active":"2024-08-31T06:02:38.640565+0000","last_peered":"2024-08-31T06:02:38.640565+0000","last_clean":"2024-08-31T06:02:38.640565+0000","last_became_active":"2024-08-31T06:02:28.780430+0000","last_became_peered":"2024-08-31T06:02:28.780430+0000","last_unstale":"2024-08-31T06:02:38.640565+0000","last_undegraded":"2024-08-31T06:02:38.640565+0000","last_fullsized":"2024-08-31T06:02:38.640565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:22:27.052952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.608747+0000","last_change":"2024-08-31T06:02:30.604018+0000","last_active":"2024-08-31T06:02:31.608747+0000","last_peered":"2024-08-31T06:02:31.608747+0000","last_clean":"2024-08-31T06:02:31.608747+0000","last_became_active":"2024-08-31T06:02:30.603411+0000","last_became_peered":"2024-08-31T06:02:30.603411+0000","last_unstale":"2024-08-31T06:02:31.608747+0000","last_undegraded":"2024-08-31T06:02:31.608747+0000","last_fullsized":"2024-08-31T06:02:31.608747+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:34:30.732954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"70'7","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.667681+0000","last_change":"2024-08-31T06:02:28.586348+0000","last_active":"2024-08-31T06:02:41.667681+0000","last_peered":"2024-08-31T06:02:41.667681+0000","last_clean":"2024-08-31T06:02:41.667681+0000","last_became_active":"2024-08-31T06:02:28.586046+0000","last_became_peered":"2024-08-31T06:02:28.586046+0000","last_unstale":"2024-08-31T06:02:41.667681+0000","last_undegraded":"2024-08-31T06:02:41.667681+0000","last_fullsized":"2024-08-31T06:02:41.667681+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:30.987232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.615733+0000","last_change":"2024-08-31T06:02:30.616402+0000","last_active":"2024-08-31T06:02:31.615733+0000","last_peered":"2024-08-31T06:02:31.615733+0000","last_clean":"2024-08-31T06:02:31.615733+0000","last_became_active":"2024-08-31T06:02:30.616014+0000","last_became_peered":"2024-08-31T06:02:30.616014+0000","last_unstale":"2024-08-31T06:02:31.615733+0000","last_undegraded":"2024-08-31T06:02:31.615733+0000","last_fullsized":"2024-08-31T06:02:31.615733+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:42.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"70'3","reported_seq":22,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:40.662721+0000","last_change":"2024-08-31T06:02:28.590184+0000","last_active":"2024-08-31T06:02:40.662721+0000","last_peered":"2024-08-31T06:02:40.662721+0000","last_clean":"2024-08-31T06:02:40.662721+0000","last_became_active":"2024-08-31T06:02:28.588830+0000","last_became_peered":"2024-08-31T06:02:28.588830+0000","last_unstale":"2024-08-31T06:02:40.662721+0000","last_undegraded":"2024-08-31T06:02:40.662721+0000","last_fullsized":"2024-08-31T06:02:40.662721+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:03.072197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.605867+0000","last_change":"2024-08-31T06:02:30.597262+0000","last_active":"2024-08-31T06:02:31.605867+0000","last_peered":"2024-08-31T06:02:31.605867+0000","last_clean":"2024-08-31T06:02:31.605867+0000","last_became_active":"2024-08-31T06:02:30.596862+0000","last_became_peered":"2024-08-31T06:02:30.596862+0000","last_unstale":"2024-08-31T06:02:31.605867+0000","last_undegraded":"2024-08-31T06:02:31.605867+0000","last_fullsized":"2024-08-31T06:02:31.605867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:46:29.378532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"70'4","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:38.641633+0000","last_change":"2024-08-31T06:02:28.594161+0000","last_active":"2024-08-31T06:02:38.641633+0000","last_peered":"2024-08-31T06:02:38.641633+0000","last_clean":"2024-08-31T06:02:38.641633+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:02:38.641633+0000","last_undegraded":"2024-08-31T06:02:38.641633+0000","last_fullsized":"2024-08-31T06:02:38.641633+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:31:17.941172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.613730+0000","last_change":"2024-08-31T06:02:30.595194+0000","last_active":"2024-08-31T06:02:31.613730+0000","last_peered":"2024-08-31T06:02:31.613730+0000","last_clean":"2024-08-31T06:02:31.613730+0000","last_became_active":"2024-08-31T06:02:30.594812+0000","last_became_peered":"2024-08-31T06:02:30.594812+0000","last_unstale":"2024-08-31T06:02:31.613730+0000","last_undegraded":"2024-08-31T06:02:31.613730+0000","last_fullsized":"2024-08-31T06:02:31.613730+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:03.224924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.607019+0000","last_change":"2024-08-31T06:02:30.615776+0000","last_active":"2024-08-31T06:02:31.607019+0000","last_peered":"2024-08-31T06:02:31.607019+0000","last_clean":"2024-08-31T06:02:31.607019+0000","last_became_active":"2024-08-31T06:02:30.615385+0000","last_became_peered":"2024-08-31T06:02:30.615385+0000","last_unstale":"2024-08-31T06:02:31.607019+0000","last_undegraded":"2024-08-31T06:02:31.607019+0000","last_fullsized":"2024-08-31T06:02:31.607019+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:49.685443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"70'5","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:41.670210+0000","last_change":"2024-08-31T06:02:28.591064+0000","last_active":"2024-08-31T06:02:41.670210+0000","last_peered":"2024-08-31T06:02:41.670210+0000","last_clean":"2024-08-31T06:02:41.670210+0000","last_became_active":"2024-08-31T06:02:28.590643+0000","last_became_peered":"2024-08-31T06:02:28.590643+0000","last_unstale":"2024-08-31T06:02:41.670210+0000","last_undegraded":"2024-08-31T06:02:41.670210+0000","last_fullsized":"2024-08-31T06:02:41.670210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:01.953317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.598890+0000","last_change":"2024-08-31T06:02:30.600532+0000","last_active":"2024-08-31T06:02:31.598890+0000","last_peered":"2024-08-31T06:02:31.598890+0000","last_clean":"2024-08-31T06:02:31.598890+0000","last_became_active":"2024-08-31T06:02:30.600013+0000","last_became_peered":"2024-08-31T06:02:30.600013+0000","last_unstale":"2024-08-31T06:02:31.598890+0000","last_undegraded":"2024-08-31T06:02:31.598890+0000","last_fullsized":"2024-08-31T06:02:31.598890+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:38.753206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"70'12","reported_seq":32,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:42.680273+0000","last_change":"2024-08-31T06:02:28.593921+0000","last_active":"2024-08-31T06:02:42.680273+0000","last_peered":"2024-08-31T06:02:42.680273+0000","last_clean":"2024-08-31T06:02:42.680273+0000","last_became_active":"2024-08-31T06:02:28.593102+0000","last_became_peered":"2024-08-31T06:02:28.593102+0000","last_unstale":"2024-08-31T06:02:42.680273+0000","last_undegraded":"2024-08-31T06:02:42.680273+0000","last_fullsized":"2024-08-31T06:02:42.680273+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:30:35.791686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.609031+0000","last_change":"2024-08-31T06:02:30.606524+0000","last_active":"2024-08-31T06:02:31.609031+0000","last_peered":"2024-08-31T06:02:31.609031+0000","last_clean":"2024-08-31T06:02:31.609031+0000","last_became_active":"2024-08-31T06:02:30.606132+0000","last_became_peered":"2024-08-31T06:02:30.606132+0000","last_unstale":"2024-08-31T06:02:31.609031+0000","last_undegraded":"2024-08-31T06:02:31.609031+0000","last_fullsized":"2024-08-31T06:02:31.609031+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:46.566811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"70'2","reported_seq":21,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.607901+0000","last_change":"2024-08-31T06:02:28.780596+0000","last_active":"2024-08-31T06:02:31.607901+0000","last_peered":"2024-08-31T06:02:31.607901+0000","last_clean":"2024-08-31T06:02:31.607901+0000","last_became_active":"2024-08-31T06:02:28.779908+0000","last_became_peered":"2024-08-31T06:02:28.779908+0000","last_unstale":"2024-08-31T06:02:31.607901+0000","last_undegraded":"2024-08-31T06:02:31.607901+0000","last_fullsized":"2024-08-31T06:02:31.607901+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:01.254340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:31.606216+0000","last_change":"2024-08-31T06:02:30.610023+0000","last_active":"2024-08-31T06:02:31.606216+0000","last_peered":"2024-08-31T06:02:31.606216+0000","last_clean":"2024-08-31T06:02:31.606216+0000","last_became_active":"2024-08-31T06:02:30.609688+0000","last_became_peered":"2024-08-31T06:02:30.609688+0000","last_unstale":"2024-08-31T06:02:31.606216+0000","last_undegraded":"2024-08-31T06:02:31.606216+0000","last_fullsized":"2024-08-31T06:02:31.606216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:12.870966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"70'13","reported_seq":44,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-08-31T06:02:51.695803+0000","last_change":"2024-08-31T06:02:28.593773+0000","last_active":"2024-08-31T06:02:51.695803+0000","last_peered":"2024-08-31T06:02:51.695803+0000","last_clean":"2024-08-31T06:02:51.695803+0000","last_became_active":"2024-08-31T06:02:28.593511+0000","last_became_peered":"2024-08-31T06:02:28.593511+0000","last_unstale":"2024-08-31T06:02:51.695803+0000","last_undegraded":"2024-08-31T06:02:51.695803+0000","last_fullsized":"2024-08-31T06:02:51.695803+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:01:50.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54004,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":156,"num_read_kb":138,"num_write":231,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":162012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906961,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717376,"statfs":{"total":95995035648,"available":95966593024,"internally_reserved":0,"allocated":770048,"data_stored":379874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070487,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36768,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708384,"statfs":{"total":95995035648,"available":95957385216,"internally_reserved":0,"allocated":1458176,"data_stored":1018094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928234011,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40280,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704872,"statfs":{"total":95995035648,"available":95953788928,"internally_reserved":0,"allocated":794624,"data_stored":379804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":790528,"data_stored":380182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593765,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28380,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716772,"statfs":{"total":95995035648,"available":95965974528,"internally_reserved":0,"allocated":1388544,"data_stored":973091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757290,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717368,"statfs":{"total":95995035648,"available":95966584832,"internally_reserved":0,"allocated":778240,"data_stored":379521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953518,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716760,"statfs":{"total":95995035648,"available":95965962240,"internally_reserved":0,"allocated":1400832,"data_stored":972378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36104,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709048,"statfs":{"total":95995035648,"available":95958065152,"internally_reserved":0,"allocated":778240,"data_stored":379773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":379346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":427845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":427234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40284,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704868,"statfs":{"total":95995035648,"available":95953784832,"internally_reserved":0,"allocated":798720,"data_stored":380860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:02:58.179 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T06:02:58.180 INFO:tasks.cephadm:Setting up client nodes... 2024-08-31T06:02:58.180 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-31T06:02:58.181 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:57 smithi153 ceph-mon[22320]: pgmap v259: 97 pgs: 97 active+clean; 629 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 15 op/s 2024-08-31T06:02:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:02:58.824 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:58 smithi053 ceph-mon[18924]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:02:58.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.922+0000 7f8e591b7640 1 -- 172.21.15.53:0/730255241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e54109250 msgr2=0x7f8e54109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:58.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.922+0000 7f8e591b7640 1 --2- 172.21.15.53:0/730255241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e54109250 0x7f8e54109660 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009900 tx=0x7f8e4802a410 comp rx=0 tx=0).stop 2024-08-31T06:02:58.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.922+0000 7f8e591b7640 1 -- 172.21.15.53:0/730255241 shutdown_connections 2024-08-31T06:02:58.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.922+0000 7f8e591b7640 1 --2- 172.21.15.53:0/730255241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e54109ba0 0x7f8e541103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:58.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.922+0000 7f8e591b7640 1 --2- 172.21.15.53:0/730255241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e54109250 0x7f8e54109660 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:58.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.922+0000 7f8e591b7640 1 --2- 172.21.15.53:0/730255241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e54103910 0x7f8e54103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:58.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.922+0000 7f8e591b7640 1 -- 172.21.15.53:0/730255241 >> 172.21.15.53:0/730255241 conn(0x7f8e540ff340 msgr2=0x7f8e54101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:58.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.922+0000 7f8e591b7640 1 -- 172.21.15.53:0/730255241 shutdown_connections 2024-08-31T06:02:58.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.922+0000 7f8e591b7640 1 -- 172.21.15.53:0/730255241 wait complete. 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.923+0000 7f8e591b7640 1 Processor -- start 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.923+0000 7f8e591b7640 1 -- start start 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.923+0000 7f8e591b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e54103910 0x7f8e540754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.923+0000 7f8e591b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e54109250 0x7f8e540759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.923+0000 7f8e591b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e54109ba0 0x7f8e54075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.923+0000 7f8e591b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8e54113710 con 0x7f8e54109250 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.923+0000 7f8e591b7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e54113590 con 0x7f8e54103910 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.923+0000 7f8e591b7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e54113890 con 0x7f8e54109ba0 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.923+0000 7f8e5259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e54109250 0x7f8e540759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.923+0000 7f8e5259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e54109250 0x7f8e540759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60480/0 (socket says 172.21.15.53:60480) 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.923+0000 7f8e5259c640 1 -- 172.21.15.53:0/1058469436 learned_addr learned my addr 172.21.15.53:0/1058469436 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:02:58.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e52d9d640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e54103910 0x7f8e540754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e5359e640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e54109ba0 0x7f8e54075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e5259c640 1 -- 172.21.15.53:0/1058469436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e54109ba0 msgr2=0x7f8e54075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e5259c640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e54109ba0 0x7f8e54075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e5259c640 1 -- 172.21.15.53:0/1058469436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e54103910 msgr2=0x7f8e540754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e5259c640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e54103910 0x7f8e540754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e5259c640 1 -- 172.21.15.53:0/1058469436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e541a8440 con 0x7f8e54109250 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e5359e640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e54109ba0 0x7f8e54075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e5259c640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e54109250 0x7f8e540759f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005940 tx=0x7f8e480040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e3bfff640 1 -- 172.21.15.53:0/1058469436 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4803f030 con 0x7f8e54109250 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e591b7640 1 -- 172.21.15.53:0/1058469436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e541a86d0 con 0x7f8e54109250 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e3bfff640 1 -- 172.21.15.53:0/1058469436 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e48003a80 con 0x7f8e54109250 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e3bfff640 1 -- 172.21.15.53:0/1058469436 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48035070 con 0x7f8e54109250 2024-08-31T06:02:58.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.924+0000 7f8e591b7640 1 -- 172.21.15.53:0/1058469436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e541a8bb0 con 0x7f8e54109250 2024-08-31T06:02:58.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.926+0000 7f8e591b7640 1 -- 172.21.15.53:0/1058469436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e54103d20 con 0x7f8e54109250 2024-08-31T06:02:58.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.927+0000 7f8e3bfff640 1 -- 172.21.15.53:0/1058469436 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f8e48042030 con 0x7f8e54109250 2024-08-31T06:02:58.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.928+0000 7f8e3bfff640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8e3c0b4c10 0x7f8e3c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:02:58.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.928+0000 7f8e52d9d640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8e3c0b4c10 0x7f8e3c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:02:58.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.928+0000 7f8e3bfff640 1 -- 172.21.15.53:0/1058469436 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f8e48105cb0 con 0x7f8e54109250 2024-08-31T06:02:58.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.928+0000 7f8e52d9d640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8e3c0b4c10 0x7f8e3c0b7120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8e54076f00 tx=0x7f8e4400b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:02:58.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:58.931+0000 7f8e3bfff640 1 -- 172.21.15.53:0/1058469436 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8e480ccc40 con 0x7f8e54109250 2024-08-31T06:02:59.029 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:58 smithi130 ceph-mon[22266]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:02:59.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:58 smithi153 ceph-mon[22320]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:02:59.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.191+0000 7f8e591b7640 1 -- 172.21.15.53:0/1058469436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f8e540767b0 con 0x7f8e54109250 2024-08-31T06:02:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.195+0000 7f8e3bfff640 1 -- 172.21.15.53:0/1058469436 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f8e480cc540 con 0x7f8e54109250 2024-08-31T06:02:59.197 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-08-31T06:02:59.197 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQATstJm3rp9CxAAHNt9kv99HD/ZSOb6sY8+rw== 2024-08-31T06:02:59.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 -- 172.21.15.53:0/1058469436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8e3c0b4c10 msgr2=0x7f8e3c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:59.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8e3c0b4c10 0x7f8e3c0b7120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8e54076f00 tx=0x7f8e4400b410 comp rx=0 tx=0).stop 2024-08-31T06:02:59.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 -- 172.21.15.53:0/1058469436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e54109250 msgr2=0x7f8e540759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:02:59.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e54109250 0x7f8e540759f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005940 tx=0x7f8e480040e0 comp rx=0 tx=0).stop 2024-08-31T06:02:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 -- 172.21.15.53:0/1058469436 shutdown_connections 2024-08-31T06:02:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8e3c0b4c10 0x7f8e3c0b7120 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e54109ba0 0x7f8e54075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e54109250 0x7f8e540759f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 --2- 172.21.15.53:0/1058469436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e54103910 0x7f8e540754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:02:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 -- 172.21.15.53:0/1058469436 >> 172.21.15.53:0/1058469436 conn(0x7f8e540ff340 msgr2=0x7f8e54101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:02:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 -- 172.21.15.53:0/1058469436 shutdown_connections 2024-08-31T06:02:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:02:59.197+0000 7f8e591b7640 1 -- 172.21.15.53:0/1058469436 wait complete. 2024-08-31T06:02:59.795 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:59 smithi053 ceph-mon[18924]: pgmap v260: 97 pgs: 97 active+clean; 637 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-08-31T06:02:59.795 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:59 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1058469436' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T06:02:59.795 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:02:59 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1058469436' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T06:02:59.822 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T06:02:59.822 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-31T06:02:59.822 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-31T06:02:59.858 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph config log 1 --format=json 2024-08-31T06:03:00.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:59 smithi153 ceph-mon[22320]: pgmap v260: 97 pgs: 97 active+clean; 637 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-08-31T06:03:00.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:59 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1058469436' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T06:03:00.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:02:59 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1058469436' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T06:03:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:59 smithi130 ceph-mon[22266]: pgmap v260: 97 pgs: 97 active+clean; 637 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-08-31T06:03:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:59 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1058469436' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T06:03:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:02:59 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1058469436' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T06:03:00.149 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:00.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.615+0000 7fb6632ae640 1 -- 172.21.15.53:0/941820200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb65c109bb0 msgr2=0x7fb65c1103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:00.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.615+0000 7fb6632ae640 1 --2- 172.21.15.53:0/941820200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb65c109bb0 0x7fb65c1103e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb654009ca0 tx=0x7fb65402a8e0 comp rx=0 tx=0).stop 2024-08-31T06:03:00.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.615+0000 7fb6632ae640 1 -- 172.21.15.53:0/941820200 shutdown_connections 2024-08-31T06:03:00.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.615+0000 7fb6632ae640 1 --2- 172.21.15.53:0/941820200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb65c109bb0 0x7fb65c1103e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:00.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.615+0000 7fb6632ae640 1 --2- 172.21.15.53:0/941820200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb65c109260 0x7fb65c109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:00.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.615+0000 7fb6632ae640 1 --2- 172.21.15.53:0/941820200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65c101d20 0x7fb65c102130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:00.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.615+0000 7fb6632ae640 1 -- 172.21.15.53:0/941820200 >> 172.21.15.53:0/941820200 conn(0x7fb65c077a90 msgr2=0x7fb65c077ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.615+0000 7fb6632ae640 1 -- 172.21.15.53:0/941820200 shutdown_connections 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.615+0000 7fb6632ae640 1 -- 172.21.15.53:0/941820200 wait complete. 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.616+0000 7fb6632ae640 1 Processor -- start 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.616+0000 7fb6632ae640 1 -- start start 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.616+0000 7fb6632ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb65c101d20 0x7fb65c19a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb6632ae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65c109260 0x7fb65c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb6632ae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb65c109bb0 0x7fb65c19f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb6632ae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c113760 con 0x7fb65c101d20 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb6632ae640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c1135e0 con 0x7fb65c109260 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb6632ae640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c1138e0 con 0x7fb65c109bb0 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb66104a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb65c101d20 0x7fb65c19a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:00.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb66104a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb65c101d20 0x7fb65c19a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60488/0 (socket says 172.21.15.53:60488) 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb66104a640 1 -- 172.21.15.53:0/3015012644 learned_addr learned my addr 172.21.15.53:0/3015012644 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb66184b640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb65c109bb0 0x7fb65c19f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb660849640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65c109260 0x7fb65c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb66104a640 1 -- 172.21.15.53:0/3015012644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb65c109bb0 msgr2=0x7fb65c19f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb66104a640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb65c109bb0 0x7fb65c19f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb66104a640 1 -- 172.21.15.53:0/3015012644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65c109260 msgr2=0x7fb65c19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb66104a640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65c109260 0x7fb65c19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb66104a640 1 -- 172.21.15.53:0/3015012644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65c19ffe0 con 0x7fb65c101d20 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb66184b640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb65c109bb0 0x7fb65c19f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb660849640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65c109260 0x7fb65c19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb66104a640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb65c101d20 0x7fb65c19a130 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb65800c920 tx=0x7fb65800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb6527fc640 1 -- 172.21.15.53:0/3015012644 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb658007c70 con 0x7fb65c101d20 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb6527fc640 1 -- 172.21.15.53:0/3015012644 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb658007e10 con 0x7fb65c101d20 2024-08-31T06:03:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb6632ae640 1 -- 172.21.15.53:0/3015012644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65c1a02d0 con 0x7fb65c101d20 2024-08-31T06:03:00.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb6527fc640 1 -- 172.21.15.53:0/3015012644 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb658018710 con 0x7fb65c101d20 2024-08-31T06:03:00.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.617+0000 7fb6632ae640 1 -- 172.21.15.53:0/3015012644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65c1a6af0 con 0x7fb65c101d20 2024-08-31T06:03:00.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.619+0000 7fb6632ae640 1 -- 172.21.15.53:0/3015012644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb65c102130 con 0x7fb65c101d20 2024-08-31T06:03:00.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.620+0000 7fb6527fc640 1 -- 172.21.15.53:0/3015012644 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fb65800f450 con 0x7fb65c101d20 2024-08-31T06:03:00.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.620+0000 7fb6527fc640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c40 0x7fb6480b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:00.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.621+0000 7fb660849640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c40 0x7fb6480b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:00.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.621+0000 7fb6527fc640 1 -- 172.21.15.53:0/3015012644 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7fb6580e5550 con 0x7fb65c101d20 2024-08-31T06:03:00.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.621+0000 7fb660849640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c40 0x7fb6480b7150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb64c006fd0 tx=0x7fb64c008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:00.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.625+0000 7fb6527fc640 1 -- 172.21.15.53:0/3015012644 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb658014030 con 0x7fb65c101d20 2024-08-31T06:03:00.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.814+0000 7fb6632ae640 1 -- 172.21.15.53:0/3015012644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fb65c02e430 con 0x7fb65c101d20 2024-08-31T06:03:00.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.815+0000 7fb6527fc640 1 -- 172.21.15.53:0/3015012644 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v54) ==== 86+0+133 (secure 0 0 0) 0x7fb6580ac540 con 0x7fb65c101d20 2024-08-31T06:03:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:03:00.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 -- 172.21.15.53:0/3015012644 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c40 msgr2=0x7fb6480b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:00.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c40 0x7fb6480b7150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb64c006fd0 tx=0x7fb64c008040 comp rx=0 tx=0).stop 2024-08-31T06:03:00.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 -- 172.21.15.53:0/3015012644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb65c101d20 msgr2=0x7fb65c19a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:00.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb65c101d20 0x7fb65c19a130 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb65800c920 tx=0x7fb65800cde0 comp rx=0 tx=0).stop 2024-08-31T06:03:00.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 -- 172.21.15.53:0/3015012644 shutdown_connections 2024-08-31T06:03:00.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c40 0x7fb6480b7150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:00.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb65c109bb0 0x7fb65c19f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65c109260 0x7fb65c19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 --2- 172.21.15.53:0/3015012644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb65c101d20 0x7fb65c19a130 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 -- 172.21.15.53:0/3015012644 >> 172.21.15.53:0/3015012644 conn(0x7fb65c077a90 msgr2=0x7fb65c1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 -- 172.21.15.53:0/3015012644 shutdown_connections 2024-08-31T06:03:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:00.817+0000 7fb6632ae640 1 -- 172.21.15.53:0/3015012644 wait complete. 2024-08-31T06:03:01.626 INFO:teuthology.orchestra.run.smithi053.stdout:[{"version":54,"timestamp":"2024-08-31T06:02:20.641330+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-08-31T06:03:01.626 INFO:tasks.ceph_manager:config epoch is 54 2024-08-31T06:03:01.626 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-31T06:03:01.626 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-31T06:03:01.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph mgr dump --format=json 2024-08-31T06:03:01.883 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:01.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:01 smithi053 ceph-mon[18924]: pgmap v261: 97 pgs: 97 active+clean; 637 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-08-31T06:03:01.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:01 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3015012644' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T06:03:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:01 smithi130 ceph-mon[22266]: pgmap v261: 97 pgs: 97 active+clean; 637 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-08-31T06:03:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:01 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3015012644' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T06:03:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:01 smithi153 ceph-mon[22320]: pgmap v261: 97 pgs: 97 active+clean; 637 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-08-31T06:03:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:01 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3015012644' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T06:03:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.363+0000 7f57a7a5b640 1 -- 172.21.15.53:0/866214924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0109bc0 msgr2=0x7f57a01103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.363+0000 7f57a7a5b640 1 --2- 172.21.15.53:0/866214924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0109bc0 0x7f57a01103f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5798009ca0 tx=0x7f579802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.363+0000 7f57a7a5b640 1 -- 172.21.15.53:0/866214924 shutdown_connections 2024-08-31T06:03:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.363+0000 7f57a7a5b640 1 --2- 172.21.15.53:0/866214924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0109bc0 0x7f57a01103f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.363+0000 7f57a7a5b640 1 --2- 172.21.15.53:0/866214924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57a0109270 0x7f57a0109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.363+0000 7f57a7a5b640 1 --2- 172.21.15.53:0/866214924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a0103930 0x7f57a0103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.363+0000 7f57a7a5b640 1 -- 172.21.15.53:0/866214924 >> 172.21.15.53:0/866214924 conn(0x7f57a00ff3a0 msgr2=0x7f57a01017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.363+0000 7f57a7a5b640 1 -- 172.21.15.53:0/866214924 shutdown_connections 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.363+0000 7f57a7a5b640 1 -- 172.21.15.53:0/866214924 wait complete. 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a7a5b640 1 Processor -- start 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a7a5b640 1 -- start start 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a7a5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0103930 0x7f57a019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a7a5b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a0109270 0x7f57a019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a7a5b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57a0109bc0 0x7f57a019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a7a5b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57a01137e0 con 0x7f57a0103930 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a7a5b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57a0113660 con 0x7f57a0109bc0 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a7a5b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57a0113960 con 0x7f57a0109270 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a57f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0103930 0x7f57a019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a57f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0103930 0x7f57a019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60494/0 (socket says 172.21.15.53:60494) 2024-08-31T06:03:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a57f7640 1 -- 172.21.15.53:0/4259664599 learned_addr learned my addr 172.21.15.53:0/4259664599 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.364+0000 7f57a4ff6640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a0109270 0x7f57a019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57a57f7640 1 -- 172.21.15.53:0/4259664599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a0109270 msgr2=0x7f57a019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57a57f7640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a0109270 0x7f57a019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57a5ff8640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57a0109bc0 0x7f57a019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57a57f7640 1 -- 172.21.15.53:0/4259664599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57a0109bc0 msgr2=0x7f57a019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57a57f7640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57a0109bc0 0x7f57a019f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57a57f7640 1 -- 172.21.15.53:0/4259664599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a01a00e0 con 0x7f57a0103930 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57a57f7640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0103930 0x7f57a019a170 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f579c00b4a0 tx=0x7f579c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57967fc640 1 -- 172.21.15.53:0/4259664599 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c014070 con 0x7f57a0103930 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57967fc640 1 -- 172.21.15.53:0/4259664599 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f579c010aa0 con 0x7f57a0103930 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57a7a5b640 1 -- 172.21.15.53:0/4259664599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a01a03d0 con 0x7f57a0103930 2024-08-31T06:03:02.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57967fc640 1 -- 172.21.15.53:0/4259664599 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c017b70 con 0x7f57a0103930 2024-08-31T06:03:02.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.365+0000 7f57a7a5b640 1 -- 172.21.15.53:0/4259664599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a01a6b30 con 0x7f57a0103930 2024-08-31T06:03:02.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.366+0000 7f57a7a5b640 1 -- 172.21.15.53:0/4259664599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a0103d40 con 0x7f57a0103930 2024-08-31T06:03:02.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.368+0000 7f57967fc640 1 -- 172.21.15.53:0/4259664599 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f579c017070 con 0x7f57a0103930 2024-08-31T06:03:02.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.368+0000 7f57967fc640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f578c0b4c10 0x7f578c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:02.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.368+0000 7f57a4ff6640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f578c0b4c10 0x7f578c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:02.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.368+0000 7f57967fc640 1 -- 172.21.15.53:0/4259664599 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f579c0e4660 con 0x7f57a0103930 2024-08-31T06:03:02.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.369+0000 7f57a4ff6640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f578c0b4c10 0x7f578c0b7120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5790005fd0 tx=0x7f5790005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:02.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.373+0000 7f57967fc640 1 -- 172.21.15.53:0/4259664599 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f579c0ab650 con 0x7f57a0103930 2024-08-31T06:03:02.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.610+0000 7f57a7a5b640 1 -- 172.21.15.53:0/4259664599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f57a002e430 con 0x7f57a0103930 2024-08-31T06:03:02.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.615+0000 7f57967fc640 1 -- 172.21.15.53:0/4259664599 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+293208 (secure 0 0 0) 0x7f579c0aaf50 con 0x7f57a0103930 2024-08-31T06:03:02.621 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.618+0000 7f57a7a5b640 1 -- 172.21.15.53:0/4259664599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f578c0b4c10 msgr2=0x7f578c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.618+0000 7f57a7a5b640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f578c0b4c10 0x7f578c0b7120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5790005fd0 tx=0x7f5790005850 comp rx=0 tx=0).stop 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.618+0000 7f57a7a5b640 1 -- 172.21.15.53:0/4259664599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0103930 msgr2=0x7f57a019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.618+0000 7f57a7a5b640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0103930 0x7f57a019a170 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f579c00b4a0 tx=0x7f579c00b960 comp rx=0 tx=0).stop 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.618+0000 7f57a7a5b640 1 -- 172.21.15.53:0/4259664599 shutdown_connections 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.618+0000 7f57a7a5b640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f578c0b4c10 0x7f578c0b7120 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.618+0000 7f57a7a5b640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57a0109bc0 0x7f57a019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.618+0000 7f57a7a5b640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57a0109270 0x7f57a019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.618+0000 7f57a7a5b640 1 --2- 172.21.15.53:0/4259664599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0103930 0x7f57a019a170 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.618+0000 7f57a7a5b640 1 -- 172.21.15.53:0/4259664599 >> 172.21.15.53:0/4259664599 conn(0x7f57a00ff3a0 msgr2=0x7f57a01017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.619+0000 7f57a7a5b640 1 -- 172.21.15.53:0/4259664599 shutdown_connections 2024-08-31T06:03:02.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:02.619+0000 7f57a7a5b640 1 -- 172.21.15.53:0/4259664599 wait complete. 2024-08-31T06:03:02.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:02 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4259664599' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T06:03:03.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:02 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4259664599' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T06:03:03.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:02 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4259664599' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T06:03:03.392 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":21,"flags":0,"active_gid":14220,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1345161100},{"type":"v1","addr":"172.21.15.53:6801","nonce":1345161100}]},"active_addr":"172.21.15.53:6801/1345161100","active_change":"2024-08-31T05:56:14.253774+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24145,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24173,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.53:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":1278905576}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":1540260730}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":4057719034}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":3487714730}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":2884391479}]}]} 2024-08-31T06:03:03.399 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-31T06:03:03.399 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-31T06:03:03.399 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:03:03.655 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:04.024 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:03 smithi053 ceph-mon[18924]: pgmap v262: 97 pgs: 97 active+clean; 637 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-08-31T06:03:04.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:03 smithi130 ceph-mon[22266]: pgmap v262: 97 pgs: 97 active+clean; 637 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-08-31T06:03:04.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.113+0000 7f7b365ee640 1 -- 172.21.15.53:0/1703724381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b30103900 msgr2=0x7f7b30103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:04.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.113+0000 7f7b365ee640 1 --2- 172.21.15.53:0/1703724381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b30103900 0x7f7b30103d10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009900 tx=0x7f7b2002a410 comp rx=0 tx=0).stop 2024-08-31T06:03:04.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.113+0000 7f7b365ee640 1 -- 172.21.15.53:0/1703724381 shutdown_connections 2024-08-31T06:03:04.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.113+0000 7f7b365ee640 1 --2- 172.21.15.53:0/1703724381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b30109b90 0x7f7b301103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.113+0000 7f7b365ee640 1 --2- 172.21.15.53:0/1703724381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b30109240 0x7f7b30109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.113+0000 7f7b365ee640 1 --2- 172.21.15.53:0/1703724381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b30103900 0x7f7b30103d10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.113+0000 7f7b365ee640 1 -- 172.21.15.53:0/1703724381 >> 172.21.15.53:0/1703724381 conn(0x7f7b3007b5f0 msgr2=0x7f7b3007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.113+0000 7f7b365ee640 1 -- 172.21.15.53:0/1703724381 shutdown_connections 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.113+0000 7f7b365ee640 1 -- 172.21.15.53:0/1703724381 wait complete. 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b365ee640 1 Processor -- start 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b365ee640 1 -- start start 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b365ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b30103900 0x7f7b3019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b365ee640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b30109240 0x7f7b3019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b365ee640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b30109b90 0x7f7b3019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b365ee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7b30113740 con 0x7f7b30103900 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b365ee640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b301135c0 con 0x7f7b30109240 2024-08-31T06:03:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b365ee640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b301138c0 con 0x7f7b30109b90 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b30103900 0x7f7b3019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b30103900 0x7f7b3019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50804/0 (socket says 172.21.15.53:50804) 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b2ffff640 1 -- 172.21.15.53:0/699710105 learned_addr learned my addr 172.21.15.53:0/699710105 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.114+0000 7f7b2f7fe640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b30109240 0x7f7b3019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b34b8b640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b30109b90 0x7f7b3019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b2ffff640 1 -- 172.21.15.53:0/699710105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b30109b90 msgr2=0x7f7b3019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b2ffff640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b30109b90 0x7f7b3019f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b2ffff640 1 -- 172.21.15.53:0/699710105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b30109240 msgr2=0x7f7b3019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b2ffff640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b30109240 0x7f7b3019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b2ffff640 1 -- 172.21.15.53:0/699710105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b301a0100 con 0x7f7b30103900 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b2ffff640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b30103900 0x7f7b3019a190 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009230 tx=0x7f7b20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b2d7fa640 1 -- 172.21.15.53:0/699710105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2003f030 con 0x7f7b30103900 2024-08-31T06:03:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b365ee640 1 -- 172.21.15.53:0/699710105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b301a0390 con 0x7f7b30103900 2024-08-31T06:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b2d7fa640 1 -- 172.21.15.53:0/699710105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b20003a80 con 0x7f7b30103900 2024-08-31T06:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b2d7fa640 1 -- 172.21.15.53:0/699710105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20035070 con 0x7f7b30103900 2024-08-31T06:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.115+0000 7f7b365ee640 1 -- 172.21.15.53:0/699710105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b301a6b50 con 0x7f7b30103900 2024-08-31T06:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.116+0000 7f7b365ee640 1 -- 172.21.15.53:0/699710105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b30103d10 con 0x7f7b30103900 2024-08-31T06:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.119+0000 7f7b2d7fa640 1 -- 172.21.15.53:0/699710105 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f7b20042030 con 0x7f7b30103900 2024-08-31T06:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.119+0000 7f7b2d7fa640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b180b4c10 0x7f7b180b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.120+0000 7f7b2f7fe640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b180b4c10 0x7f7b180b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.120+0000 7f7b2d7fa640 1 -- 172.21.15.53:0/699710105 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f7b20105f30 con 0x7f7b30103900 2024-08-31T06:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.120+0000 7f7b2f7fe640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b180b4c10 0x7f7b180b7120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7b301062d0 tx=0x7f7b24008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.123+0000 7f7b2d7fa640 1 -- 172.21.15.53:0/699710105 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7b200ccf20 con 0x7f7b30103900 2024-08-31T06:03:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:03 smithi153 ceph-mon[22320]: pgmap v262: 97 pgs: 97 active+clean; 637 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-08-31T06:03:04.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.309+0000 7f7b365ee640 1 -- 172.21.15.53:0/699710105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b3019b2c0 con 0x7f7b30103900 2024-08-31T06:03:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.311+0000 7f7b2d7fa640 1 -- 172.21.15.53:0/699710105 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+22585 (secure 0 0 0) 0x7f7b3019b2c0 con 0x7f7b30103900 2024-08-31T06:03:04.313 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:03:04.313 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":70,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:02:31.233657+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:03:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 -- 172.21.15.53:0/699710105 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b180b4c10 msgr2=0x7f7b180b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b180b4c10 0x7f7b180b7120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7b301062d0 tx=0x7f7b24008040 comp rx=0 tx=0).stop 2024-08-31T06:03:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 -- 172.21.15.53:0/699710105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b30103900 msgr2=0x7f7b3019a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b30103900 0x7f7b3019a190 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009230 tx=0x7f7b20004270 comp rx=0 tx=0).stop 2024-08-31T06:03:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 -- 172.21.15.53:0/699710105 shutdown_connections 2024-08-31T06:03:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b180b4c10 0x7f7b180b7120 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b30109b90 0x7f7b3019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b30109240 0x7f7b3019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 --2- 172.21.15.53:0/699710105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b30103900 0x7f7b3019a190 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 -- 172.21.15.53:0/699710105 >> 172.21.15.53:0/699710105 conn(0x7f7b3007b5f0 msgr2=0x7f7b30107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 -- 172.21.15.53:0/699710105 shutdown_connections 2024-08-31T06:03:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:04.313+0000 7f7b365ee640 1 -- 172.21.15.53:0/699710105 wait complete. 2024-08-31T06:03:04.995 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:04 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/699710105' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:03:05.026 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-31T06:03:05.027 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:03:05.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:04 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/699710105' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:03:05.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:04 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/699710105' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:03:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.774+0000 7f143857e640 1 -- 172.21.15.53:0/2249429469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1430108ab0 msgr2=0x7f143010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.774+0000 7f143857e640 1 --2- 172.21.15.53:0/2249429469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1430108ab0 0x7f143010f2e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1428009900 tx=0x7f142802a410 comp rx=0 tx=0).stop 2024-08-31T06:03:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.775+0000 7f143857e640 1 -- 172.21.15.53:0/2249429469 shutdown_connections 2024-08-31T06:03:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.775+0000 7f143857e640 1 --2- 172.21.15.53:0/2249429469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1430108ab0 0x7f143010f2e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.775+0000 7f143857e640 1 --2- 172.21.15.53:0/2249429469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1430108160 0x7f1430108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.775+0000 7f143857e640 1 --2- 172.21.15.53:0/2249429469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1430102820 0x7f1430102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.775+0000 7f143857e640 1 -- 172.21.15.53:0/2249429469 >> 172.21.15.53:0/2249429469 conn(0x7f14300794e0 msgr2=0x7f14300798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.775+0000 7f143857e640 1 -- 172.21.15.53:0/2249429469 shutdown_connections 2024-08-31T06:03:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.775+0000 7f143857e640 1 -- 172.21.15.53:0/2249429469 wait complete. 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.775+0000 7f143857e640 1 Processor -- start 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f143857e640 1 -- start start 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f143857e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1430102820 0x7f1430199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f143857e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1430108160 0x7f1430199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f143857e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1430108ab0 0x7f143019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f143857e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1430112630 con 0x7f1430108ab0 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f143857e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f14301124b0 con 0x7f1430108160 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f143857e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f14301127b0 con 0x7f1430102820 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f1436b1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1430108ab0 0x7f143019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f1436b1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1430108ab0 0x7f143019e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50828/0 (socket says 172.21.15.53:50828) 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f1436b1b640 1 -- 172.21.15.53:0/263483979 learned_addr learned my addr 172.21.15.53:0/263483979 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f143631a640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1430102820 0x7f1430199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f1435b19640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1430108160 0x7f1430199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f1436b1b640 1 -- 172.21.15.53:0/263483979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1430102820 msgr2=0x7f1430199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f1436b1b640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1430102820 0x7f1430199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f1436b1b640 1 -- 172.21.15.53:0/263483979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1430108160 msgr2=0x7f1430199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f1436b1b640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1430108160 0x7f1430199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f1436b1b640 1 -- 172.21.15.53:0/263483979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143019eff0 con 0x7f1430108ab0 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f143631a640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1430102820 0x7f1430199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.776+0000 7f1435b19640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1430108160 0x7f1430199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.777+0000 7f1436b1b640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1430108ab0 0x7f143019e8c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1428005ab0 tx=0x7f14280040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.777+0000 7f14237fe640 1 -- 172.21.15.53:0/263483979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142803f030 con 0x7f1430108ab0 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.777+0000 7f14237fe640 1 -- 172.21.15.53:0/263483979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1428003a80 con 0x7f1430108ab0 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.777+0000 7f14237fe640 1 -- 172.21.15.53:0/263483979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428035070 con 0x7f1430108ab0 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.777+0000 7f143857e640 1 -- 172.21.15.53:0/263483979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143019f280 con 0x7f1430108ab0 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.777+0000 7f143857e640 1 -- 172.21.15.53:0/263483979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14301a5a40 con 0x7f1430108ab0 2024-08-31T06:03:05.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.778+0000 7f143857e640 1 -- 172.21.15.53:0/263483979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1430103aa0 con 0x7f1430108ab0 2024-08-31T06:03:05.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.779+0000 7f14237fe640 1 -- 172.21.15.53:0/263483979 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f1428042030 con 0x7f1430108ab0 2024-08-31T06:03:05.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.780+0000 7f14237fe640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f141c0b4c10 0x7f141c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:05.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.780+0000 7f143631a640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f141c0b4c10 0x7f141c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:05.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.780+0000 7f14237fe640 1 -- 172.21.15.53:0/263483979 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f1428105990 con 0x7f1430108ab0 2024-08-31T06:03:05.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.781+0000 7f143631a640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f141c0b4c10 0x7f141c0b7120 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1424005fd0 tx=0x7f1424009520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:05.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.784+0000 7f14237fe640 1 -- 172.21.15.53:0/263483979 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f14280cc920 con 0x7f1430108ab0 2024-08-31T06:03:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.970+0000 7f143857e640 1 -- 172.21.15.53:0/263483979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f143010a310 con 0x7f1430108ab0 2024-08-31T06:03:05.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.971+0000 7f14237fe640 1 -- 172.21.15.53:0/263483979 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+22585 (secure 0 0 0) 0x7f14280cc220 con 0x7f1430108ab0 2024-08-31T06:03:05.976 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:03:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":70,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:02:31.233657+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:03:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 -- 172.21.15.53:0/263483979 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f141c0b4c10 msgr2=0x7f141c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f141c0b4c10 0x7f141c0b7120 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1424005fd0 tx=0x7f1424009520 comp rx=0 tx=0).stop 2024-08-31T06:03:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 -- 172.21.15.53:0/263483979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1430108ab0 msgr2=0x7f143019e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1430108ab0 0x7f143019e8c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1428005ab0 tx=0x7f14280040e0 comp rx=0 tx=0).stop 2024-08-31T06:03:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 -- 172.21.15.53:0/263483979 shutdown_connections 2024-08-31T06:03:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f141c0b4c10 0x7f141c0b7120 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1430108ab0 0x7f143019e8c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1430108160 0x7f1430199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 --2- 172.21.15.53:0/263483979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1430102820 0x7f1430199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 -- 172.21.15.53:0/263483979 >> 172.21.15.53:0/263483979 conn(0x7f14300794e0 msgr2=0x7f14301050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 -- 172.21.15.53:0/263483979 shutdown_connections 2024-08-31T06:03:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:05.974+0000 7f143857e640 1 -- 172.21.15.53:0/263483979 wait complete. 2024-08-31T06:03:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:05 smithi130 ceph-mon[22266]: pgmap v263: 97 pgs: 97 active+clean; 641 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-31T06:03:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:05 smithi153 ceph-mon[22320]: pgmap v263: 97 pgs: 97 active+clean; 641 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-31T06:03:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:05 smithi053 ceph-mon[18924]: pgmap v263: 97 pgs: 97 active+clean; 641 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-31T06:03:06.631 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-31T06:03:06.631 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-31T06:03:06.631 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-31T06:03:06.632 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-31T06:03:06.632 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-31T06:03:06.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-31T06:03:06.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-31T06:03:06.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-31T06:03:06.634 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-31T06:03:06.634 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-31T06:03:06.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-31T06:03:06.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-31T06:03:06.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:06 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/263483979' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:03:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:06 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/263483979' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:03:07.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:06 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/263483979' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:03:07.414 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.435 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.437 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.440 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.460 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.460 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.464 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.477 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.715 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.717 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:07.806 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:07 smithi053 ceph-mon[18924]: pgmap v264: 97 pgs: 97 active+clean; 641 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-31T06:03:08.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:07 smithi130 ceph-mon[22266]: pgmap v264: 97 pgs: 97 active+clean; 641 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-31T06:03:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:07 smithi153 ceph-mon[22320]: pgmap v264: 97 pgs: 97 active+clean; 641 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-31T06:03:09.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.770+0000 7f9620a0a640 1 -- 172.21.15.53:0/1321786916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f961c105890 msgr2=0x7f961c10f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.770+0000 7f9620a0a640 1 --2- 172.21.15.53:0/1321786916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f961c105890 0x7f961c10f300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9614009ca0 tx=0x7f961402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.771+0000 7f9620a0a640 1 -- 172.21.15.53:0/1321786916 shutdown_connections 2024-08-31T06:03:09.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.771+0000 7f9620a0a640 1 --2- 172.21.15.53:0/1321786916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f961c105890 0x7f961c10f300 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.771+0000 7f9620a0a640 1 --2- 172.21.15.53:0/1321786916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f961c104f40 0x7f961c105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.771+0000 7f9620a0a640 1 --2- 172.21.15.53:0/1321786916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c102ec0 0x7f961c1032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.771+0000 7f9620a0a640 1 -- 172.21.15.53:0/1321786916 >> 172.21.15.53:0/1321786916 conn(0x7f961c077a00 msgr2=0x7f961c077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:09.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.771+0000 7f9620a0a640 1 -- 172.21.15.53:0/1321786916 shutdown_connections 2024-08-31T06:03:09.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.771+0000 7f9620a0a640 1 -- 172.21.15.53:0/1321786916 wait complete. 2024-08-31T06:03:09.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.771+0000 7f9620a0a640 1 Processor -- start 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f9620a0a640 1 -- start start 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f9620a0a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c102ec0 0x7f961c19af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f9620a0a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f961c104f40 0x7f961c19b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f9620a0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f961c105890 0x7f961c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f9620a0a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f961c112610 con 0x7f961c105890 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f9620a0a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f961c112490 con 0x7f961c102ec0 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f9620a0a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f961c112790 con 0x7f961c104f40 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f961ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f961c105890 0x7f961c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f961ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f961c105890 0x7f961c19b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50884/0 (socket says 172.21.15.53:50884) 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f961ad9d640 1 -- 172.21.15.53:0/8004511 learned_addr learned my addr 172.21.15.53:0/8004511 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f961a59c640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c102ec0 0x7f961c19af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:09.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f9619d9b640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f961c104f40 0x7f961c19b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f961ad9d640 1 -- 172.21.15.53:0/8004511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f961c104f40 msgr2=0x7f961c19b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f961ad9d640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f961c104f40 0x7f961c19b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f961ad9d640 1 -- 172.21.15.53:0/8004511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c102ec0 msgr2=0x7f961c19af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f961ad9d640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c102ec0 0x7f961c19af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f961ad9d640 1 -- 172.21.15.53:0/8004511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c1a6270 con 0x7f961c105890 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.772+0000 7f961a59c640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c102ec0 0x7f961c19af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.773+0000 7f961ad9d640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f961c105890 0x7f961c19b9e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9614031ef0 tx=0x7f9614031f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.773+0000 7f960b7fe640 1 -- 172.21.15.53:0/8004511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614003c30 con 0x7f961c105890 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.773+0000 7f960b7fe640 1 -- 172.21.15.53:0/8004511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9614003dd0 con 0x7f961c105890 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.773+0000 7f960b7fe640 1 -- 172.21.15.53:0/8004511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96140046c0 con 0x7f961c105890 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.773+0000 7f9620a0a640 1 -- 172.21.15.53:0/8004511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961c1a6500 con 0x7f961c105890 2024-08-31T06:03:09.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.773+0000 7f9620a0a640 1 -- 172.21.15.53:0/8004511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f961c1a69f0 con 0x7f961c105890 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.774+0000 7f9620a0a640 1 -- 172.21.15.53:0/8004511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f961c0638f0 con 0x7f961c105890 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.776+0000 7f960b7fe640 1 -- 172.21.15.53:0/8004511 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f9614030640 con 0x7f961c105890 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.776+0000 7f960b7fe640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f96040b4c90 0x7f96040b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.776+0000 7f961a59c640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f96040b4c90 0x7f96040b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.776+0000 7f960b7fe640 1 -- 172.21.15.53:0/8004511 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f9614106420 con 0x7f961c105890 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.777+0000 7f960b7fe640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664] conn(0x7f96040be6a0 0x7f96040c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.777+0000 7f960b7fe640 1 -- 172.21.15.53:0/8004511 --> [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96040c11c0 con 0x7f96040be6a0 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.777+0000 7f960b7fe640 1 -- 172.21.15.53:0/8004511 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f9614106870 con 0x7f961c105890 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.777+0000 7f961a59c640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f96040b4c90 0x7f96040b71a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f961c1026e0 tx=0x7f960c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.777+0000 7f9619d9b640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664] conn(0x7f96040be6a0 0x7f96040c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.778+0000 7f9619d9b640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664] conn(0x7f96040be6a0 0x7f96040c0af0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:09.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.778+0000 7f960b7fe640 1 -- 172.21.15.53:0/8004511 <== osd.4 v2:172.21.15.130:6808/862414664 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96040c11c0 con 0x7f96040be6a0 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.793+0000 7f9620a0a640 1 -- 172.21.15.53:0/8004511 --> [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f961c063d40 con 0x7f96040be6a0 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.793+0000 7f960b7fe640 1 -- 172.21.15.53:0/8004511 <== osd.4 v2:172.21.15.130:6808/862414664 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f961c063d40 con 0x7f96040be6a0 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.794+0000 7f9620a0a640 1 -- 172.21.15.53:0/8004511 >> [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664] conn(0x7f96040be6a0 msgr2=0x7f96040c0af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.794+0000 7f9620a0a640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664] conn(0x7f96040be6a0 0x7f96040c0af0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.794+0000 7f9620a0a640 1 -- 172.21.15.53:0/8004511 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f96040b4c90 msgr2=0x7f96040b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.794+0000 7f9620a0a640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f96040b4c90 0x7f96040b71a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f961c1026e0 tx=0x7f960c005f90 comp rx=0 tx=0).stop 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.794+0000 7f9620a0a640 1 -- 172.21.15.53:0/8004511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f961c105890 msgr2=0x7f961c19b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.794+0000 7f9620a0a640 1 --2- 172.21.15.53:0/8004511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f961c105890 0x7f961c19b9e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9614031ef0 tx=0x7f9614031f20 comp rx=0 tx=0).stop 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.794+0000 7f961ad9d640 1 -- 172.21.15.53:0/8004511 reap_dead start 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.794+0000 7f9620a0a640 1 -- 172.21.15.53:0/8004511 shutdown_connections 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.794+0000 7f9620a0a640 1 -- 172.21.15.53:0/8004511 >> 172.21.15.53:0/8004511 conn(0x7f961c077a00 msgr2=0x7f961c107280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:09.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.794+0000 7f9620a0a640 1 -- 172.21.15.53:0/8004511 shutdown_connections 2024-08-31T06:03:09.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.794+0000 7f9620a0a640 1 -- 172.21.15.53:0/8004511 wait complete. 2024-08-31T06:03:09.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.408+0000 7f4c1ca02640 1 -- 172.21.15.53:0/1746327651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c18104440 msgr2=0x7f4c18104850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.408+0000 7f4c1ca02640 1 --2- 172.21.15.53:0/1746327651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c18104440 0x7f4c18104850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009900 tx=0x7f4c0802a410 comp rx=0 tx=0).stop 2024-08-31T06:03:09.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.408+0000 7f4c1ca02640 1 -- 172.21.15.53:0/1746327651 shutdown_connections 2024-08-31T06:03:09.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.408+0000 7f4c1ca02640 1 --2- 172.21.15.53:0/1746327651 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c1810d9f0 0x7f4c1810fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.408+0000 7f4c1ca02640 1 --2- 172.21.15.53:0/1746327651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c18104e70 0x7f4c1810d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.408+0000 7f4c1ca02640 1 --2- 172.21.15.53:0/1746327651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c18104440 0x7f4c18104850 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.408+0000 7f4c1ca02640 1 -- 172.21.15.53:0/1746327651 >> 172.21.15.53:0/1746327651 conn(0x7f4c180fe070 msgr2=0x7f4c181004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.408+0000 7f4c1ca02640 1 -- 172.21.15.53:0/1746327651 shutdown_connections 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.408+0000 7f4c1ca02640 1 -- 172.21.15.53:0/1746327651 wait complete. 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c1ca02640 1 Processor -- start 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c1ca02640 1 -- start start 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c1ca02640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c18104440 0x7f4c18199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c1ca02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c18104e70 0x7f4c1819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c1ca02640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1810d9f0 0x7f4c1819f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c1ca02640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4c181134f0 con 0x7f4c18104e70 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c1ca02640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c18113370 con 0x7f4c18104440 2024-08-31T06:03:09.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c1ca02640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c18113670 con 0x7f4c1810d9f0 2024-08-31T06:03:09.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c0ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c18104e70 0x7f4c1819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:09.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c0ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c18104e70 0x7f4c1819a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50902/0 (socket says 172.21.15.53:50902) 2024-08-31T06:03:09.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c0ffff640 1 -- 172.21.15.53:0/3369576549 learned_addr learned my addr 172.21.15.53:0/3369576549 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:09.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c16d9d640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c18104440 0x7f4c18199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:09.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c1759e640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1810d9f0 0x7f4c1819f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:09.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c0ffff640 1 -- 172.21.15.53:0/3369576549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1810d9f0 msgr2=0x7f4c1819f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c0ffff640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c1810d9f0 0x7f4c1819f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c0ffff640 1 -- 172.21.15.53:0/3369576549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c18104440 msgr2=0x7f4c18199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c0ffff640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c18104440 0x7f4c18199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.409+0000 7f4c0ffff640 1 -- 172.21.15.53:0/3369576549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1819fe30 con 0x7f4c18104e70 2024-08-31T06:03:09.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.410+0000 7f4c0ffff640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c18104e70 0x7f4c1819a520 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000e9f0 tx=0x7f4c0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:09.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.410+0000 7f4c14d99640 1 -- 172.21.15.53:0/3369576549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0000ccc0 con 0x7f4c18104e70 2024-08-31T06:03:09.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.410+0000 7f4c1ca02640 1 -- 172.21.15.53:0/3369576549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c181a0120 con 0x7f4c18104e70 2024-08-31T06:03:09.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.410+0000 7f4c14d99640 1 -- 172.21.15.53:0/3369576549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c000054b0 con 0x7f4c18104e70 2024-08-31T06:03:09.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.410+0000 7f4c14d99640 1 -- 172.21.15.53:0/3369576549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00010430 con 0x7f4c18104e70 2024-08-31T06:03:09.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.410+0000 7f4c1ca02640 1 -- 172.21.15.53:0/3369576549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c181a6940 con 0x7f4c18104e70 2024-08-31T06:03:09.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.411+0000 7f4c1ca02640 1 -- 172.21.15.53:0/3369576549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c18063830 con 0x7f4c18104e70 2024-08-31T06:03:09.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.412+0000 7f4c14d99640 1 -- 172.21.15.53:0/3369576549 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f4c000046c0 con 0x7f4c18104e70 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.413+0000 7f4c14d99640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c040b4c40 0x7f4c040b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.413+0000 7f4c16d9d640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c040b4c40 0x7f4c040b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.413+0000 7f4c14d99640 1 -- 172.21.15.53:0/3369576549 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f4c000e5b90 con 0x7f4c18104e70 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.413+0000 7f4c14d99640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578] conn(0x7f4c040be650 0x7f4c040c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.413+0000 7f4c14d99640 1 -- 172.21.15.53:0/3369576549 --> [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c0001aec0 con 0x7f4c040be650 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.413+0000 7f4c14d99640 1 -- 172.21.15.53:0/3369576549 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f4c000e5f40 con 0x7f4c18104e70 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.414+0000 7f4c16d9d640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c040b4c40 0x7f4c040b7150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4c080057c0 tx=0x7f4c080058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.414+0000 7f4c1759e640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578] conn(0x7f4c040be650 0x7f4c040c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.414+0000 7f4c1759e640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578] conn(0x7f4c040be650 0x7f4c040c0aa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.415+0000 7f4c14d99640 1 -- 172.21.15.53:0/3369576549 <== osd.8 v2:172.21.15.153:6816/2889781578 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c0001aec0 con 0x7f4c040be650 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.429+0000 7f4c1ca02640 1 -- 172.21.15.53:0/3369576549 --> [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4c18063cb0 con 0x7f4c040be650 2024-08-31T06:03:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.429+0000 7f4c14d99640 1 -- 172.21.15.53:0/3369576549 <== osd.8 v2:172.21.15.153:6816/2889781578 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4c18063cb0 con 0x7f4c040be650 2024-08-31T06:03:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.430+0000 7f4c1ca02640 1 -- 172.21.15.53:0/3369576549 >> [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578] conn(0x7f4c040be650 msgr2=0x7f4c040c0aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.430+0000 7f4c1ca02640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578] conn(0x7f4c040be650 0x7f4c040c0aa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.430+0000 7f4c1ca02640 1 -- 172.21.15.53:0/3369576549 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c040b4c40 msgr2=0x7f4c040b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.430+0000 7f4c1ca02640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c040b4c40 0x7f4c040b7150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4c080057c0 tx=0x7f4c080058d0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.430+0000 7f4c1ca02640 1 -- 172.21.15.53:0/3369576549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c18104e70 msgr2=0x7f4c1819a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.430+0000 7f4c1ca02640 1 --2- 172.21.15.53:0/3369576549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c18104e70 0x7f4c1819a520 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000e9f0 tx=0x7f4c0000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:03:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.430+0000 7f4c1759e640 1 -- 172.21.15.53:0/3369576549 reap_dead start 2024-08-31T06:03:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.430+0000 7f4c1ca02640 1 -- 172.21.15.53:0/3369576549 shutdown_connections 2024-08-31T06:03:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.430+0000 7f4c1ca02640 1 -- 172.21.15.53:0/3369576549 >> 172.21.15.53:0/3369576549 conn(0x7f4c180fe070 msgr2=0x7f4c180fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.430+0000 7f4c1ca02640 1 -- 172.21.15.53:0/3369576549 shutdown_connections 2024-08-31T06:03:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:09.430+0000 7f4c1ca02640 1 -- 172.21.15.53:0/3369576549 wait complete. 2024-08-31T06:03:09.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:09 smithi053 ceph-mon[18924]: pgmap v265: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-08-31T06:03:10.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.203+0000 7f764bc21640 1 -- 172.21.15.53:0/347447531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7644102800 msgr2=0x7f7644102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.203+0000 7f764bc21640 1 --2- 172.21.15.53:0/347447531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7644102800 0x7f7644102c10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7634009900 tx=0x7f763402a410 comp rx=0 tx=0).stop 2024-08-31T06:03:10.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.203+0000 7f764bc21640 1 -- 172.21.15.53:0/347447531 shutdown_connections 2024-08-31T06:03:10.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.203+0000 7f764bc21640 1 --2- 172.21.15.53:0/347447531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7644108a90 0x7f764410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.203+0000 7f764bc21640 1 --2- 172.21.15.53:0/347447531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7644108140 0x7f7644108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.203+0000 7f764bc21640 1 --2- 172.21.15.53:0/347447531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7644102800 0x7f7644102c10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.203+0000 7f764bc21640 1 -- 172.21.15.53:0/347447531 >> 172.21.15.53:0/347447531 conn(0x7f76440794d0 msgr2=0x7f76440798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:10.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.203+0000 7f764bc21640 1 -- 172.21.15.53:0/347447531 shutdown_connections 2024-08-31T06:03:10.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.203+0000 7f764bc21640 1 -- 172.21.15.53:0/347447531 wait complete. 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.204+0000 7f764bc21640 1 Processor -- start 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.204+0000 7f764bc21640 1 -- start start 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.204+0000 7f764bc21640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7644102800 0x7f7644103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.204+0000 7f764bc21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7644108140 0x7f7644104530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.204+0000 7f764bc21640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7644108a90 0x7f7644104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.204+0000 7f764bc21640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f76441125c0 con 0x7f7644108140 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.204+0000 7f764bc21640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7644112440 con 0x7f7644102800 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.204+0000 7f764bc21640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7644112740 con 0x7f7644108a90 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.204+0000 7f76491bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7644108140 0x7f7644104530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.204+0000 7f76491bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7644108140 0x7f7644104530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50850/0 (socket says 172.21.15.53:50850) 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.204+0000 7f76491bc640 1 -- 172.21.15.53:0/948423034 learned_addr learned my addr 172.21.15.53:0/948423034 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:10.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f764a1be640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7644108a90 0x7f7644104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f76499bd640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7644102800 0x7f7644103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f76491bc640 1 -- 172.21.15.53:0/948423034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7644108a90 msgr2=0x7f7644104a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f76491bc640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7644108a90 0x7f7644104a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f76491bc640 1 -- 172.21.15.53:0/948423034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7644102800 msgr2=0x7f7644103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f76491bc640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7644102800 0x7f7644103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f76491bc640 1 -- 172.21.15.53:0/948423034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76441a8400 con 0x7f7644108140 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f76491bc640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7644108140 0x7f7644104530 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f764000d770 tx=0x7f764000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f763affd640 1 -- 172.21.15.53:0/948423034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7640017070 con 0x7f7644108140 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f763affd640 1 -- 172.21.15.53:0/948423034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7640009c30 con 0x7f7644108140 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f763affd640 1 -- 172.21.15.53:0/948423034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764000f620 con 0x7f7644108140 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f764bc21640 1 -- 172.21.15.53:0/948423034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76441a86f0 con 0x7f7644108140 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.205+0000 7f764bc21640 1 -- 172.21.15.53:0/948423034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76441a8be0 con 0x7f7644108140 2024-08-31T06:03:10.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.206+0000 7f764bc21640 1 -- 172.21.15.53:0/948423034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f764406afa0 con 0x7f7644108140 2024-08-31T06:03:10.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.208+0000 7f763affd640 1 -- 172.21.15.53:0/948423034 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f764001a070 con 0x7f7644108140 2024-08-31T06:03:10.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.208+0000 7f763affd640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76300b4c90 0x7f76300b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:10.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.209+0000 7f76499bd640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76300b4c90 0x7f76300b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:10.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.209+0000 7f763affd640 1 -- 172.21.15.53:0/948423034 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f76400e5260 con 0x7f7644108140 2024-08-31T06:03:10.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.209+0000 7f763affd640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672] conn(0x7f76300be6a0 0x7f76300c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:10.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.209+0000 7f763affd640 1 -- 172.21.15.53:0/948423034 --> [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f764001ae50 con 0x7f76300be6a0 2024-08-31T06:03:10.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.209+0000 7f763affd640 1 -- 172.21.15.53:0/948423034 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f76400e5610 con 0x7f7644108140 2024-08-31T06:03:10.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.209+0000 7f764a1be640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672] conn(0x7f76300be6a0 0x7f76300c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.209+0000 7f76499bd640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76300b4c90 0x7f76300b71a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7634006010 tx=0x7f7634009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.209+0000 7f764a1be640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672] conn(0x7f76300be6a0 0x7f76300c0af0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.210+0000 7f763affd640 1 -- 172.21.15.53:0/948423034 <== osd.0 v2:172.21.15.53:6802/2893726672 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f764001ae50 con 0x7f76300be6a0 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.236+0000 7f764bc21640 1 -- 172.21.15.53:0/948423034 --> [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7644103a80 con 0x7f76300be6a0 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.236+0000 7f763affd640 1 -- 172.21.15.53:0/948423034 <== osd.0 v2:172.21.15.53:6802/2893726672 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7644103a80 con 0x7f76300be6a0 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.237+0000 7f764bc21640 1 -- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672] conn(0x7f76300be6a0 msgr2=0x7f76300c0af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.237+0000 7f764bc21640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672] conn(0x7f76300be6a0 0x7f76300c0af0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.237+0000 7f764bc21640 1 -- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76300b4c90 msgr2=0x7f76300b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.237+0000 7f764bc21640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76300b4c90 0x7f76300b71a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7634006010 tx=0x7f7634009680 comp rx=0 tx=0).stop 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.237+0000 7f764bc21640 1 -- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7644108140 msgr2=0x7f7644104530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.237+0000 7f764bc21640 1 --2- 172.21.15.53:0/948423034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7644108140 0x7f7644104530 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f764000d770 tx=0x7f764000dc30 comp rx=0 tx=0).stop 2024-08-31T06:03:10.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.237+0000 7f764a1be640 1 -- 172.21.15.53:0/948423034 reap_dead start 2024-08-31T06:03:10.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.237+0000 7f764bc21640 1 -- 172.21.15.53:0/948423034 shutdown_connections 2024-08-31T06:03:10.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.237+0000 7f764bc21640 1 -- 172.21.15.53:0/948423034 >> 172.21.15.53:0/948423034 conn(0x7f76440794d0 msgr2=0x7f76441018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:10.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.237+0000 7f764bc21640 1 -- 172.21.15.53:0/948423034 shutdown_connections 2024-08-31T06:03:10.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.237+0000 7f764bc21640 1 -- 172.21.15.53:0/948423034 wait complete. 2024-08-31T06:03:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:09 smithi130 ceph-mon[22266]: pgmap v265: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-08-31T06:03:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:09 smithi153 ceph-mon[22320]: pgmap v265: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-08-31T06:03:10.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.471+0000 7f28bc8cb640 1 -- 172.21.15.53:0/193824945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b8103900 msgr2=0x7f28b8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.471+0000 7f28bc8cb640 1 --2- 172.21.15.53:0/193824945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b8103900 0x7f28b8103d10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009900 tx=0x7f28a802a410 comp rx=0 tx=0).stop 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.471+0000 7f28bc8cb640 1 -- 172.21.15.53:0/193824945 shutdown_connections 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.471+0000 7f28bc8cb640 1 --2- 172.21.15.53:0/193824945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b8109b90 0x7f28b81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.471+0000 7f28bc8cb640 1 --2- 172.21.15.53:0/193824945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28b8109240 0x7f28b8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.471+0000 7f28bc8cb640 1 --2- 172.21.15.53:0/193824945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b8103900 0x7f28b8103d10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.471+0000 7f28bc8cb640 1 -- 172.21.15.53:0/193824945 >> 172.21.15.53:0/193824945 conn(0x7f28b807b5f0 msgr2=0x7f28b807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.471+0000 7f28bc8cb640 1 -- 172.21.15.53:0/193824945 shutdown_connections 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.471+0000 7f28bc8cb640 1 -- 172.21.15.53:0/193824945 wait complete. 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.472+0000 7f28bc8cb640 1 Processor -- start 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.472+0000 7f28bc8cb640 1 -- start start 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28bc8cb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b8103900 0x7f28b80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:10.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28bc8cb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28b8109240 0x7f28b80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28bc8cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b8109b90 0x7f28b8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28bc8cb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f28b8113700 con 0x7f28b8109b90 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28bc8cb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f28b8113580 con 0x7f28b8109240 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28bc8cb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28b8113880 con 0x7f28b8103900 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28b6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b8109b90 0x7f28b8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28b6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b8109b90 0x7f28b8075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50914/0 (socket says 172.21.15.53:50914) 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28b6d9d640 1 -- 172.21.15.53:0/2610721000 learned_addr learned my addr 172.21.15.53:0/2610721000 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28b659c640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b8103900 0x7f28b80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28b5d9b640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28b8109240 0x7f28b80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28b6d9d640 1 -- 172.21.15.53:0/2610721000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b8103900 msgr2=0x7f28b80754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28b6d9d640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28b8103900 0x7f28b80754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28b6d9d640 1 -- 172.21.15.53:0/2610721000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28b8109240 msgr2=0x7f28b80759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28b6d9d640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28b8109240 0x7f28b80759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28b6d9d640 1 -- 172.21.15.53:0/2610721000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b81a84b0 con 0x7f28b8109b90 2024-08-31T06:03:10.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28b6d9d640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b8109b90 0x7f28b8075f30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009fd0 tx=0x7f28b000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:10.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.473+0000 7f28a77fe640 1 -- 172.21.15.53:0/2610721000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b0017070 con 0x7f28b8109b90 2024-08-31T06:03:10.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.474+0000 7f28a77fe640 1 -- 172.21.15.53:0/2610721000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28b0003e00 con 0x7f28b8109b90 2024-08-31T06:03:10.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.474+0000 7f28a77fe640 1 -- 172.21.15.53:0/2610721000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b0010460 con 0x7f28b8109b90 2024-08-31T06:03:10.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.474+0000 7f28bc8cb640 1 -- 172.21.15.53:0/2610721000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b81a87a0 con 0x7f28b8109b90 2024-08-31T06:03:10.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.474+0000 7f28bc8cb640 1 -- 172.21.15.53:0/2610721000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b81a8c90 con 0x7f28b8109b90 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.474+0000 7f28bc8cb640 1 -- 172.21.15.53:0/2610721000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28b80638f0 con 0x7f28b8109b90 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.476+0000 7f28a77fe640 1 -- 172.21.15.53:0/2610721000 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f28b0003970 con 0x7f28b8109b90 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.477+0000 7f28a77fe640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28a00b4c10 0x7f28a00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.477+0000 7f28b659c640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28a00b4c10 0x7f28a00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.477+0000 7f28a77fe640 1 -- 172.21.15.53:0/2610721000 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f28b00e5410 con 0x7f28b8109b90 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.477+0000 7f28a77fe640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382] conn(0x7f28a00be620 0x7f28a00c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.477+0000 7f28a77fe640 1 -- 172.21.15.53:0/2610721000 --> [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28b000b0b0 con 0x7f28a00be620 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.477+0000 7f28a77fe640 1 -- 172.21.15.53:0/2610721000 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f28b00e57c0 con 0x7f28b8109b90 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.477+0000 7f28b5d9b640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382] conn(0x7f28a00be620 0x7f28a00c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.478+0000 7f28b659c640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28a00b4c10 0x7f28a00b7120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f28b8076f00 tx=0x7f28a80058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.478+0000 7f28b5d9b640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382] conn(0x7f28a00be620 0x7f28a00c0a70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:10.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.479+0000 7f28a77fe640 1 -- 172.21.15.53:0/2610721000 <== osd.6 v2:172.21.15.53:6818/997206382 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f28b000b0b0 con 0x7f28a00be620 2024-08-31T06:03:10.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.493+0000 7f28bc8cb640 1 -- 172.21.15.53:0/2610721000 --> [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f28b8063d70 con 0x7f28a00be620 2024-08-31T06:03:10.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.493+0000 7f28a77fe640 1 -- 172.21.15.53:0/2610721000 <== osd.6 v2:172.21.15.53:6818/997206382 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f28b8063d70 con 0x7f28a00be620 2024-08-31T06:03:10.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.494+0000 7f28bc8cb640 1 -- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382] conn(0x7f28a00be620 msgr2=0x7f28a00c0a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.494+0000 7f28bc8cb640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382] conn(0x7f28a00be620 0x7f28a00c0a70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.494+0000 7f28bc8cb640 1 -- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28a00b4c10 msgr2=0x7f28a00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.494+0000 7f28bc8cb640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28a00b4c10 0x7f28a00b7120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f28b8076f00 tx=0x7f28a80058d0 comp rx=0 tx=0).stop 2024-08-31T06:03:10.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.494+0000 7f28bc8cb640 1 -- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b8109b90 msgr2=0x7f28b8075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:10.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.494+0000 7f28bc8cb640 1 --2- 172.21.15.53:0/2610721000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28b8109b90 0x7f28b8075f30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009fd0 tx=0x7f28b000b260 comp rx=0 tx=0).stop 2024-08-31T06:03:10.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.494+0000 7f28b6d9d640 1 -- 172.21.15.53:0/2610721000 reap_dead start 2024-08-31T06:03:10.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.494+0000 7f28bc8cb640 1 -- 172.21.15.53:0/2610721000 shutdown_connections 2024-08-31T06:03:10.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.494+0000 7f28bc8cb640 1 -- 172.21.15.53:0/2610721000 >> 172.21.15.53:0/2610721000 conn(0x7f28b807b5f0 msgr2=0x7f28b8107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:10.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.494+0000 7f28bc8cb640 1 -- 172.21.15.53:0/2610721000 shutdown_connections 2024-08-31T06:03:10.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:10.494+0000 7f28bc8cb640 1 -- 172.21.15.53:0/2610721000 wait complete. 2024-08-31T06:03:12.082 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:11 smithi053 ceph-mon[18924]: pgmap v266: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T06:03:12.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:11 smithi130 ceph-mon[22266]: pgmap v266: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T06:03:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:11 smithi153 ceph-mon[22320]: pgmap v266: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T06:03:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.286+0000 7f626b64a640 1 -- 172.21.15.53:0/1220492105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6264102fb0 msgr2=0x7f62641033c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.286+0000 7f626b64a640 1 --2- 172.21.15.53:0/1220492105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6264102fb0 0x7f62641033c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6260009980 tx=0x7f626002c620 comp rx=0 tx=0).stop 2024-08-31T06:03:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.286+0000 7f626b64a640 1 -- 172.21.15.53:0/1220492105 shutdown_connections 2024-08-31T06:03:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.287+0000 7f626b64a640 1 --2- 172.21.15.53:0/1220492105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264105910 0x7f626410f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.287+0000 7f626b64a640 1 --2- 172.21.15.53:0/1220492105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6264104fc0 0x7f62641053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.287+0000 7f626b64a640 1 --2- 172.21.15.53:0/1220492105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6264102fb0 0x7f62641033c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.287+0000 7f626b64a640 1 -- 172.21.15.53:0/1220492105 >> 172.21.15.53:0/1220492105 conn(0x7f6264079c40 msgr2=0x7f626407a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.287+0000 7f626b64a640 1 -- 172.21.15.53:0/1220492105 shutdown_connections 2024-08-31T06:03:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.287+0000 7f626b64a640 1 -- 172.21.15.53:0/1220492105 wait complete. 2024-08-31T06:03:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.287+0000 7f626b64a640 1 Processor -- start 2024-08-31T06:03:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.287+0000 7f626b64a640 1 -- start start 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f626b64a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6264102fb0 0x7f626419c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f626b64a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6264104fc0 0x7f626419ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f626b64a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264105910 0x7f62641a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f626b64a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f62641115a0 con 0x7f6264104fc0 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f626b64a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6264111420 con 0x7f6264102fb0 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f626b64a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6264111720 con 0x7f6264105910 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f6268be5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6264104fc0 0x7f626419ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f6268be5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6264104fc0 0x7f626419ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50922/0 (socket says 172.21.15.53:50922) 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f6268be5640 1 -- 172.21.15.53:0/2031051533 learned_addr learned my addr 172.21.15.53:0/2031051533 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f6269be7640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264105910 0x7f62641a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f62693e6640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6264102fb0 0x7f626419c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f6268be5640 1 -- 172.21.15.53:0/2031051533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264105910 msgr2=0x7f62641a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f6268be5640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6264105910 0x7f62641a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f6268be5640 1 -- 172.21.15.53:0/2031051533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6264102fb0 msgr2=0x7f626419c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f6268be5640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6264102fb0 0x7f626419c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f6268be5640 1 -- 172.21.15.53:0/2031051533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62641a2450 con 0x7f6264104fc0 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f62693e6640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6264102fb0 0x7f626419c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f6268be5640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6264104fc0 0x7f626419ca80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f625800d740 tx=0x7f625800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.288+0000 7f62567fc640 1 -- 172.21.15.53:0/2031051533 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6258017070 con 0x7f6264104fc0 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.289+0000 7f62567fc640 1 -- 172.21.15.53:0/2031051533 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f625800de50 con 0x7f6264104fc0 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.289+0000 7f626b64a640 1 -- 172.21.15.53:0/2031051533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62641a2740 con 0x7f6264104fc0 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.289+0000 7f62567fc640 1 -- 172.21.15.53:0/2031051533 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625800f620 con 0x7f6264104fc0 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.289+0000 7f626b64a640 1 -- 172.21.15.53:0/2031051533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62641a8ea0 con 0x7f6264104fc0 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.289+0000 7f626b64a640 1 -- 172.21.15.53:0/2031051533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6264063870 con 0x7f6264104fc0 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.291+0000 7f62567fc640 1 -- 172.21.15.53:0/2031051533 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f625801a070 con 0x7f6264104fc0 2024-08-31T06:03:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.292+0000 7f62567fc640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f62500b4c10 0x7f62500b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.292+0000 7f62693e6640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f62500b4c10 0x7f62500b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.292+0000 7f62567fc640 1 -- 172.21.15.53:0/2031051533 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f62580e5130 con 0x7f6264104fc0 2024-08-31T06:03:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.292+0000 7f62567fc640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156] conn(0x7f62500be620 0x7f62500c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.292+0000 7f62567fc640 1 -- 172.21.15.53:0/2031051533 --> [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62500c1140 con 0x7f62500be620 2024-08-31T06:03:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.292+0000 7f62567fc640 1 -- 172.21.15.53:0/2031051533 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f62580e5580 con 0x7f6264104fc0 2024-08-31T06:03:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.292+0000 7f62693e6640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f62500b4c10 0x7f62500b7120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6260000c00 tx=0x7f6260005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.292+0000 7f6269be7640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156] conn(0x7f62500be620 0x7f62500c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.293+0000 7f6269be7640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156] conn(0x7f62500be620 0x7f62500c0a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.294+0000 7f62567fc640 1 -- 172.21.15.53:0/2031051533 <== osd.7 v2:172.21.15.130:6816/3016906156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f62500c1140 con 0x7f62500be620 2024-08-31T06:03:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.307+0000 7f626b64a640 1 -- 172.21.15.53:0/2031051533 --> [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6264063c70 con 0x7f62500be620 2024-08-31T06:03:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.308+0000 7f62567fc640 1 -- 172.21.15.53:0/2031051533 <== osd.7 v2:172.21.15.130:6816/3016906156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6264063c70 con 0x7f62500be620 2024-08-31T06:03:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.309+0000 7f626b64a640 1 -- 172.21.15.53:0/2031051533 >> [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156] conn(0x7f62500be620 msgr2=0x7f62500c0a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.309+0000 7f626b64a640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156] conn(0x7f62500be620 0x7f62500c0a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.309+0000 7f626b64a640 1 -- 172.21.15.53:0/2031051533 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f62500b4c10 msgr2=0x7f62500b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.309+0000 7f626b64a640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f62500b4c10 0x7f62500b7120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6260000c00 tx=0x7f6260005a20 comp rx=0 tx=0).stop 2024-08-31T06:03:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.309+0000 7f626b64a640 1 -- 172.21.15.53:0/2031051533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6264104fc0 msgr2=0x7f626419ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.309+0000 7f626b64a640 1 --2- 172.21.15.53:0/2031051533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6264104fc0 0x7f626419ca80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f625800d740 tx=0x7f625800dc00 comp rx=0 tx=0).stop 2024-08-31T06:03:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.309+0000 7f6269be7640 1 -- 172.21.15.53:0/2031051533 reap_dead start 2024-08-31T06:03:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.309+0000 7f626b64a640 1 -- 172.21.15.53:0/2031051533 shutdown_connections 2024-08-31T06:03:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.309+0000 7f626b64a640 1 -- 172.21.15.53:0/2031051533 >> 172.21.15.53:0/2031051533 conn(0x7f6264079c40 msgr2=0x7f6264106340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.309+0000 7f626b64a640 1 -- 172.21.15.53:0/2031051533 shutdown_connections 2024-08-31T06:03:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.309+0000 7f626b64a640 1 -- 172.21.15.53:0/2031051533 wait complete. 2024-08-31T06:03:12.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.657+0000 7f4982f8b640 1 -- 172.21.15.53:0/3256729159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c103960 msgr2=0x7f497c103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.657+0000 7f4982f8b640 1 --2- 172.21.15.53:0/3256729159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c103960 0x7f497c103d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4970009900 tx=0x7f497002a410 comp rx=0 tx=0).stop 2024-08-31T06:03:12.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.657+0000 7f4982f8b640 1 -- 172.21.15.53:0/3256729159 shutdown_connections 2024-08-31T06:03:12.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.657+0000 7f4982f8b640 1 --2- 172.21.15.53:0/3256729159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f497c109ba0 0x7f497c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.657+0000 7f4982f8b640 1 --2- 172.21.15.53:0/3256729159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f497c109250 0x7f497c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.657+0000 7f4982f8b640 1 --2- 172.21.15.53:0/3256729159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c103960 0x7f497c103d70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.657+0000 7f4982f8b640 1 -- 172.21.15.53:0/3256729159 >> 172.21.15.53:0/3256729159 conn(0x7f497c07b6b0 msgr2=0x7f497c07bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.657+0000 7f4982f8b640 1 -- 172.21.15.53:0/3256729159 shutdown_connections 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.657+0000 7f4982f8b640 1 -- 172.21.15.53:0/3256729159 wait complete. 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.658+0000 7f4982f8b640 1 Processor -- start 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.658+0000 7f4982f8b640 1 -- start start 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.658+0000 7f4982f8b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f497c103960 0x7f497c1a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.658+0000 7f4982f8b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f497c109250 0x7f497c1a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.658+0000 7f4982f8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c109ba0 0x7f497c1ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.658+0000 7f4982f8b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f497c113770 con 0x7f497c109ba0 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.658+0000 7f4982f8b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1135f0 con 0x7f497c103960 2024-08-31T06:03:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.658+0000 7f4982f8b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1138f0 con 0x7f497c109250 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.658+0000 7f4981528640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c109ba0 0x7f497c1ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4981528640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c109ba0 0x7f497c1ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50872/0 (socket says 172.21.15.53:50872) 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4981528640 1 -- 172.21.15.53:0/1953523114 learned_addr learned my addr 172.21.15.53:0/1953523114 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f497bfff640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f497c109250 0x7f497c1a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4980d27640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f497c103960 0x7f497c1a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4981528640 1 -- 172.21.15.53:0/1953523114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f497c109250 msgr2=0x7f497c1a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4981528640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f497c109250 0x7f497c1a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4981528640 1 -- 172.21.15.53:0/1953523114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f497c103960 msgr2=0x7f497c1a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4981528640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f497c103960 0x7f497c1a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4981528640 1 -- 172.21.15.53:0/1953523114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c1aca10 con 0x7f497c109ba0 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4981528640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c109ba0 0x7f497c1ac4d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f497400b970 tx=0x7f497400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4979ffb640 1 -- 172.21.15.53:0/1953523114 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974019070 con 0x7f497c109ba0 2024-08-31T06:03:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4979ffb640 1 -- 172.21.15.53:0/1953523114 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4974014440 con 0x7f497c109ba0 2024-08-31T06:03:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4982f8b640 1 -- 172.21.15.53:0/1953523114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c1acbe0 con 0x7f497c109ba0 2024-08-31T06:03:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.659+0000 7f4979ffb640 1 -- 172.21.15.53:0/1953523114 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49740075d0 con 0x7f497c109ba0 2024-08-31T06:03:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.660+0000 7f4982f8b640 1 -- 172.21.15.53:0/1953523114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c1ad070 con 0x7f497c109ba0 2024-08-31T06:03:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.661+0000 7f4982f8b640 1 -- 172.21.15.53:0/1953523114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f497c107bc0 con 0x7f497c109ba0 2024-08-31T06:03:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.662+0000 7f4979ffb640 1 -- 172.21.15.53:0/1953523114 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f497401c070 con 0x7f497c109ba0 2024-08-31T06:03:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.663+0000 7f4979ffb640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f496c0b4c10 0x7f496c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.663+0000 7f4980d27640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f496c0b4c10 0x7f496c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.663+0000 7f4979ffb640 1 -- 172.21.15.53:0/1953523114 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f49740e4710 con 0x7f497c109ba0 2024-08-31T06:03:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.663+0000 7f4979ffb640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211] conn(0x7f496c0be620 0x7f496c0c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.663+0000 7f4979ffb640 1 -- 172.21.15.53:0/1953523114 --> [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f496c0c1140 con 0x7f496c0be620 2024-08-31T06:03:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.663+0000 7f4979ffb640 1 -- 172.21.15.53:0/1953523114 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f49740eb050 con 0x7f497c109ba0 2024-08-31T06:03:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.663+0000 7f497bfff640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211] conn(0x7f496c0be620 0x7f496c0c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.663+0000 7f4980d27640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f496c0b4c10 0x7f496c0b7120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f497c1104f0 tx=0x7f49700058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.664+0000 7f497bfff640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211] conn(0x7f496c0be620 0x7f496c0c0a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.664+0000 7f4979ffb640 1 -- 172.21.15.53:0/1953523114 <== osd.3 v2:172.21.15.53:6810/1900570211 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f496c0c1140 con 0x7f496c0be620 2024-08-31T06:03:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.695+0000 7f4982f8b640 1 -- 172.21.15.53:0/1953523114 --> [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f497c104b90 con 0x7f496c0be620 2024-08-31T06:03:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.695+0000 7f4979ffb640 1 -- 172.21.15.53:0/1953523114 <== osd.3 v2:172.21.15.53:6810/1900570211 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f497c104b90 con 0x7f496c0be620 2024-08-31T06:03:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.696+0000 7f4982f8b640 1 -- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211] conn(0x7f496c0be620 msgr2=0x7f496c0c0a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.696+0000 7f4982f8b640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211] conn(0x7f496c0be620 0x7f496c0c0a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.696+0000 7f4982f8b640 1 -- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f496c0b4c10 msgr2=0x7f496c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.696+0000 7f4982f8b640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f496c0b4c10 0x7f496c0b7120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f497c1104f0 tx=0x7f49700058d0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.696+0000 7f4982f8b640 1 -- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c109ba0 msgr2=0x7f497c1ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.696+0000 7f4982f8b640 1 --2- 172.21.15.53:0/1953523114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497c109ba0 0x7f497c1ac4d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f497400b970 tx=0x7f497400be30 comp rx=0 tx=0).stop 2024-08-31T06:03:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.696+0000 7f4981528640 1 -- 172.21.15.53:0/1953523114 reap_dead start 2024-08-31T06:03:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.696+0000 7f4982f8b640 1 -- 172.21.15.53:0/1953523114 shutdown_connections 2024-08-31T06:03:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.696+0000 7f4982f8b640 1 -- 172.21.15.53:0/1953523114 >> 172.21.15.53:0/1953523114 conn(0x7f497c07b6b0 msgr2=0x7f497c107160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.696+0000 7f4982f8b640 1 -- 172.21.15.53:0/1953523114 shutdown_connections 2024-08-31T06:03:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:08.696+0000 7f4982f8b640 1 -- 172.21.15.53:0/1953523114 wait complete. 2024-08-31T06:03:12.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.810+0000 7fd06c90e640 1 -- 172.21.15.53:0/3420362080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068108ac0 msgr2=0x7fd06810f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.810+0000 7fd06c90e640 1 --2- 172.21.15.53:0/3420362080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068108ac0 0x7fd06810f2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd060009ca0 tx=0x7fd06002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.810+0000 7fd06c90e640 1 -- 172.21.15.53:0/3420362080 shutdown_connections 2024-08-31T06:03:12.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.810+0000 7fd06c90e640 1 --2- 172.21.15.53:0/3420362080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068108ac0 0x7fd06810f2f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.810+0000 7fd06c90e640 1 --2- 172.21.15.53:0/3420362080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd068108170 0x7fd068108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.810+0000 7fd06c90e640 1 --2- 172.21.15.53:0/3420362080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd068102830 0x7fd068102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.810+0000 7fd06c90e640 1 -- 172.21.15.53:0/3420362080 >> 172.21.15.53:0/3420362080 conn(0x7fd0680794d0 msgr2=0x7fd0680798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.810+0000 7fd06c90e640 1 -- 172.21.15.53:0/3420362080 shutdown_connections 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.810+0000 7fd06c90e640 1 -- 172.21.15.53:0/3420362080 wait complete. 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd06c90e640 1 Processor -- start 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd06c90e640 1 -- start start 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd06c90e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd068102830 0x7fd06819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd06c90e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd068108170 0x7fd06819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd06c90e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068108ac0 0x7fd06819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd06c90e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd068113780 con 0x7fd068108ac0 2024-08-31T06:03:12.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd06c90e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd068113600 con 0x7fd068102830 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd06c90e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd068113900 con 0x7fd068108170 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd066d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068108ac0 0x7fd06819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd066d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068108ac0 0x7fd06819f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50946/0 (socket says 172.21.15.53:50946) 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd066d9d640 1 -- 172.21.15.53:0/2990132313 learned_addr learned my addr 172.21.15.53:0/2990132313 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd065d9b640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd068108170 0x7fd06819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.811+0000 7fd06659c640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd068102830 0x7fd06819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd066d9d640 1 -- 172.21.15.53:0/2990132313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd068108170 msgr2=0x7fd06819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd066d9d640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd068108170 0x7fd06819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd066d9d640 1 -- 172.21.15.53:0/2990132313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd068102830 msgr2=0x7fd06819a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd066d9d640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd068102830 0x7fd06819a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd066d9d640 1 -- 172.21.15.53:0/2990132313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0681a0100 con 0x7fd068108ac0 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd06659c640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd068102830 0x7fd06819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd066d9d640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068108ac0 0x7fd06819f9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd060005cc0 tx=0x7fd060032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd0577fe640 1 -- 172.21.15.53:0/2990132313 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060032e00 con 0x7fd068108ac0 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd06c90e640 1 -- 172.21.15.53:0/2990132313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0681a0390 con 0x7fd068108ac0 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd0577fe640 1 -- 172.21.15.53:0/2990132313 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0600044d0 con 0x7fd068108ac0 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd0577fe640 1 -- 172.21.15.53:0/2990132313 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060030b70 con 0x7fd068108ac0 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.812+0000 7fd06c90e640 1 -- 172.21.15.53:0/2990132313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0681a6b50 con 0x7fd068108ac0 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.813+0000 7fd06c90e640 1 -- 172.21.15.53:0/2990132313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0680638f0 con 0x7fd068108ac0 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.815+0000 7fd0577fe640 1 -- 172.21.15.53:0/2990132313 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fd060030d10 con 0x7fd068108ac0 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.815+0000 7fd0577fe640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd0500b4c10 0x7fd0500b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.816+0000 7fd06659c640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd0500b4c10 0x7fd0500b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.816+0000 7fd0577fe640 1 -- 172.21.15.53:0/2990132313 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7fd0601069f0 con 0x7fd068108ac0 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.816+0000 7fd0577fe640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437] conn(0x7fd0500be620 0x7fd0500c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.816+0000 7fd0577fe640 1 -- 172.21.15.53:0/2990132313 --> [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd060004320 con 0x7fd0500be620 2024-08-31T06:03:12.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.816+0000 7fd0577fe640 1 -- 172.21.15.53:0/2990132313 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fd060106e40 con 0x7fd068108ac0 2024-08-31T06:03:12.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.816+0000 7fd06659c640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd0500b4c10 0x7fd0500b7120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd058009b40 tx=0x7fd058005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:12.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.816+0000 7fd065d9b640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437] conn(0x7fd0500be620 0x7fd0500c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:12.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.816+0000 7fd065d9b640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437] conn(0x7fd0500be620 0x7fd0500c0a70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:12.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.817+0000 7fd0577fe640 1 -- 172.21.15.53:0/2990132313 <== osd.10 v2:172.21.15.130:6824/982629437 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd060004320 con 0x7fd0500be620 2024-08-31T06:03:12.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.831+0000 7fd06c90e640 1 -- 172.21.15.53:0/2990132313 --> [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd068063cf0 con 0x7fd0500be620 2024-08-31T06:03:12.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd0577fe640 1 -- 172.21.15.53:0/2990132313 <== osd.10 v2:172.21.15.130:6824/982629437 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd068063cf0 con 0x7fd0500be620 2024-08-31T06:03:12.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd06c90e640 1 -- 172.21.15.53:0/2990132313 >> [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437] conn(0x7fd0500be620 msgr2=0x7fd0500c0a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd06c90e640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437] conn(0x7fd0500be620 0x7fd0500c0a70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:12.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd06c90e640 1 -- 172.21.15.53:0/2990132313 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd0500b4c10 msgr2=0x7fd0500b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd06c90e640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd0500b4c10 0x7fd0500b7120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd058009b40 tx=0x7fd058005e50 comp rx=0 tx=0).stop 2024-08-31T06:03:12.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd06c90e640 1 -- 172.21.15.53:0/2990132313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068108ac0 msgr2=0x7fd06819f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:12.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd06c90e640 1 --2- 172.21.15.53:0/2990132313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068108ac0 0x7fd06819f9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd060005cc0 tx=0x7fd060032a10 comp rx=0 tx=0).stop 2024-08-31T06:03:12.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd066d9d640 1 -- 172.21.15.53:0/2990132313 reap_dead start 2024-08-31T06:03:12.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd06c90e640 1 -- 172.21.15.53:0/2990132313 shutdown_connections 2024-08-31T06:03:12.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd06c90e640 1 -- 172.21.15.53:0/2990132313 >> 172.21.15.53:0/2990132313 conn(0x7fd0680794d0 msgr2=0x7fd0681041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:12.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd06c90e640 1 -- 172.21.15.53:0/2990132313 shutdown_connections 2024-08-31T06:03:12.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:12.832+0000 7fd06c90e640 1 -- 172.21.15.53:0/2990132313 wait complete. 2024-08-31T06:03:13.377 INFO:teuthology.orchestra.run.smithi053.stdout:210453397541 2024-08-31T06:03:13.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-31T06:03:14.079 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:13 smithi053 ceph-mon[18924]: pgmap v267: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-31T06:03:14.108 INFO:teuthology.orchestra.run.smithi053.stdout:98784247867 2024-08-31T06:03:14.108 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-31T06:03:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:13 smithi130 ceph-mon[22266]: pgmap v267: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-31T06:03:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:13 smithi153 ceph-mon[22320]: pgmap v267: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-31T06:03:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.539+0000 7fa2a822e640 1 -- 172.21.15.53:0/1801261903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0103920 msgr2=0x7fa2a0103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.539+0000 7fa2a822e640 1 --2- 172.21.15.53:0/1801261903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0103920 0x7fa2a0103d30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa290009900 tx=0x7fa29002a410 comp rx=0 tx=0).stop 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.539+0000 7fa2a822e640 1 -- 172.21.15.53:0/1801261903 shutdown_connections 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.539+0000 7fa2a822e640 1 --2- 172.21.15.53:0/1801261903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a0109bb0 0x7fa2a01103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.539+0000 7fa2a822e640 1 --2- 172.21.15.53:0/1801261903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a0109260 0x7fa2a0109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.539+0000 7fa2a822e640 1 --2- 172.21.15.53:0/1801261903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0103920 0x7fa2a0103d30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.539+0000 7fa2a822e640 1 -- 172.21.15.53:0/1801261903 >> 172.21.15.53:0/1801261903 conn(0x7fa2a00ff3b0 msgr2=0x7fa2a0101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.539+0000 7fa2a822e640 1 -- 172.21.15.53:0/1801261903 shutdown_connections 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.539+0000 7fa2a822e640 1 -- 172.21.15.53:0/1801261903 wait complete. 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.540+0000 7fa2a822e640 1 Processor -- start 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.540+0000 7fa2a822e640 1 -- start start 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a822e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a0103920 0x7fa2a019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a822e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a0109260 0x7fa2a019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a822e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0109bb0 0x7fa2a019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a822e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0113720 con 0x7fa2a0109bb0 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a822e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01135a0 con 0x7fa2a0103920 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a822e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01138a0 con 0x7fa2a0109260 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a67cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0109bb0 0x7fa2a019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a67cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0109bb0 0x7fa2a019fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35632/0 (socket says 172.21.15.53:35632) 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a67cb640 1 -- 172.21.15.53:0/4285258916 learned_addr learned my addr 172.21.15.53:0/4285258916 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a5fca640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a0103920 0x7fa2a019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a57c9640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a0109260 0x7fa2a019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a67cb640 1 -- 172.21.15.53:0/4285258916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a0109260 msgr2=0x7fa2a019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a67cb640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a0109260 0x7fa2a019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a67cb640 1 -- 172.21.15.53:0/4285258916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a0103920 msgr2=0x7fa2a019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a67cb640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a0103920 0x7fa2a019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a67cb640 1 -- 172.21.15.53:0/4285258916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a01a0160 con 0x7fa2a0109bb0 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a57c9640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2a0109260 0x7fa2a019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.541+0000 7fa2a67cb640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0109bb0 0x7fa2a019fa30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa298009fd0 tx=0x7fa29800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.542+0000 7fa296ffd640 1 -- 172.21.15.53:0/4285258916 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298017070 con 0x7fa2a0109bb0 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.542+0000 7fa2a822e640 1 -- 172.21.15.53:0/4285258916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a01a0450 con 0x7fa2a0109bb0 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.542+0000 7fa296ffd640 1 -- 172.21.15.53:0/4285258916 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa298003e00 con 0x7fa2a0109bb0 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.542+0000 7fa296ffd640 1 -- 172.21.15.53:0/4285258916 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298010460 con 0x7fa2a0109bb0 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.542+0000 7fa2a822e640 1 -- 172.21.15.53:0/4285258916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a01a6bb0 con 0x7fa2a0109bb0 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.542+0000 7fa2a822e640 1 -- 172.21.15.53:0/4285258916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2a00638f0 con 0x7fa2a0109bb0 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.544+0000 7fa296ffd640 1 -- 172.21.15.53:0/4285258916 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa298003970 con 0x7fa2a0109bb0 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.545+0000 7fa296ffd640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa28c0b4c10 0x7fa28c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.545+0000 7fa2a5fca640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa28c0b4c10 0x7fa28c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.545+0000 7fa296ffd640 1 -- 172.21.15.53:0/4285258916 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7fa2980e5600 con 0x7fa2a0109bb0 2024-08-31T06:03:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.545+0000 7fa296ffd640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031] conn(0x7fa28c0be620 0x7fa28c0c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.545+0000 7fa296ffd640 1 -- 172.21.15.53:0/4285258916 --> [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa28c0c1140 con 0x7fa28c0be620 2024-08-31T06:03:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.545+0000 7fa296ffd640 1 -- 172.21.15.53:0/4285258916 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fa2980e5a50 con 0x7fa2a0109bb0 2024-08-31T06:03:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.546+0000 7fa2a57c9640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031] conn(0x7fa28c0be620 0x7fa28c0c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.546+0000 7fa2a5fca640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa28c0b4c10 0x7fa28c0b7120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa2900057c0 tx=0x7fa2900058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.546+0000 7fa2a57c9640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031] conn(0x7fa28c0be620 0x7fa28c0c0a70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.547+0000 7fa296ffd640 1 -- 172.21.15.53:0/4285258916 <== osd.5 v2:172.21.15.153:6808/4190084031 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa28c0c1140 con 0x7fa28c0be620 2024-08-31T06:03:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.561+0000 7fa2a822e640 1 -- 172.21.15.53:0/4285258916 --> [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2a0063cf0 con 0x7fa28c0be620 2024-08-31T06:03:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.561+0000 7fa296ffd640 1 -- 172.21.15.53:0/4285258916 <== osd.5 v2:172.21.15.153:6808/4190084031 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa2a0063cf0 con 0x7fa28c0be620 2024-08-31T06:03:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.562+0000 7fa2a822e640 1 -- 172.21.15.53:0/4285258916 >> [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031] conn(0x7fa28c0be620 msgr2=0x7fa28c0c0a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.562+0000 7fa2a822e640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031] conn(0x7fa28c0be620 0x7fa28c0c0a70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.562+0000 7fa2a822e640 1 -- 172.21.15.53:0/4285258916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa28c0b4c10 msgr2=0x7fa28c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.562+0000 7fa2a822e640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa28c0b4c10 0x7fa28c0b7120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa2900057c0 tx=0x7fa2900058d0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.562+0000 7fa2a822e640 1 -- 172.21.15.53:0/4285258916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0109bb0 msgr2=0x7fa2a019fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.562+0000 7fa2a822e640 1 --2- 172.21.15.53:0/4285258916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0109bb0 0x7fa2a019fa30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa298009fd0 tx=0x7fa29800b260 comp rx=0 tx=0).stop 2024-08-31T06:03:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.562+0000 7fa2a67cb640 1 -- 172.21.15.53:0/4285258916 reap_dead start 2024-08-31T06:03:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.562+0000 7fa2a822e640 1 -- 172.21.15.53:0/4285258916 shutdown_connections 2024-08-31T06:03:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.562+0000 7fa2a822e640 1 -- 172.21.15.53:0/4285258916 >> 172.21.15.53:0/4285258916 conn(0x7fa2a00ff3b0 msgr2=0x7fa2a01017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.562+0000 7fa2a822e640 1 -- 172.21.15.53:0/4285258916 shutdown_connections 2024-08-31T06:03:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:13.562+0000 7fa2a822e640 1 -- 172.21.15.53:0/4285258916 wait complete. 2024-08-31T06:03:14.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.596+0000 7f460097b640 1 -- 172.21.15.53:0/1830784029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45fc102880 msgr2=0x7f45fc102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.596+0000 7f460097b640 1 --2- 172.21.15.53:0/1830784029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45fc102880 0x7f45fc102c90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009900 tx=0x7f45ec02a410 comp rx=0 tx=0).stop 2024-08-31T06:03:14.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.596+0000 7f460097b640 1 -- 172.21.15.53:0/1830784029 shutdown_connections 2024-08-31T06:03:14.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.596+0000 7f460097b640 1 --2- 172.21.15.53:0/1830784029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45fc108b10 0x7f45fc10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.596+0000 7f460097b640 1 --2- 172.21.15.53:0/1830784029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45fc1081c0 0x7f45fc1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.596+0000 7f460097b640 1 --2- 172.21.15.53:0/1830784029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45fc102880 0x7f45fc102c90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.596+0000 7f460097b640 1 -- 172.21.15.53:0/1830784029 >> 172.21.15.53:0/1830784029 conn(0x7f45fc079510 msgr2=0x7f45fc079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:14.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.596+0000 7f460097b640 1 -- 172.21.15.53:0/1830784029 shutdown_connections 2024-08-31T06:03:14.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.596+0000 7f460097b640 1 -- 172.21.15.53:0/1830784029 wait complete. 2024-08-31T06:03:14.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.597+0000 7f460097b640 1 Processor -- start 2024-08-31T06:03:14.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.597+0000 7f460097b640 1 -- start start 2024-08-31T06:03:14.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.597+0000 7f460097b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45fc102880 0x7f45fc19b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.597+0000 7f460097b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45fc1081c0 0x7f45fc19b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.597+0000 7f460097b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45fc108b10 0x7f45fc19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.597+0000 7f460097b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc1126e0 con 0x7f45fc108b10 2024-08-31T06:03:14.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.597+0000 7f460097b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc112560 con 0x7f45fc1081c0 2024-08-31T06:03:14.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.597+0000 7f460097b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc112860 con 0x7f45fc102880 2024-08-31T06:03:14.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.597+0000 7f45fad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45fc108b10 0x7f45fc19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.597+0000 7f45fad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45fc108b10 0x7f45fc19bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35650/0 (socket says 172.21.15.53:35650) 2024-08-31T06:03:14.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.597+0000 7f45fad9d640 1 -- 172.21.15.53:0/2843353062 learned_addr learned my addr 172.21.15.53:0/2843353062 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:14.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f45fa59c640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45fc102880 0x7f45fc19b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f45f3fff640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45fc1081c0 0x7f45fc19b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f45fad9d640 1 -- 172.21.15.53:0/2843353062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45fc102880 msgr2=0x7f45fc19b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f45fad9d640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45fc102880 0x7f45fc19b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f45fad9d640 1 -- 172.21.15.53:0/2843353062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45fc1081c0 msgr2=0x7f45fc19b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f45fad9d640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45fc1081c0 0x7f45fc19b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f45fad9d640 1 -- 172.21.15.53:0/2843353062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc1a63c0 con 0x7f45fc108b10 2024-08-31T06:03:14.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f45fad9d640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45fc108b10 0x7f45fc19bb30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f45f400b970 tx=0x7f45f400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:14.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f45f37fe640 1 -- 172.21.15.53:0/2843353062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4019070 con 0x7f45fc108b10 2024-08-31T06:03:14.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f45f37fe640 1 -- 172.21.15.53:0/2843353062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45f4014440 con 0x7f45fc108b10 2024-08-31T06:03:14.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f460097b640 1 -- 172.21.15.53:0/2843353062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc1a66b0 con 0x7f45fc108b10 2024-08-31T06:03:14.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f45f37fe640 1 -- 172.21.15.53:0/2843353062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f40075d0 con 0x7f45fc108b10 2024-08-31T06:03:14.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.598+0000 7f460097b640 1 -- 172.21.15.53:0/2843353062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc1a6bf0 con 0x7f45fc108b10 2024-08-31T06:03:14.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.599+0000 7f460097b640 1 -- 172.21.15.53:0/2843353062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45fc063870 con 0x7f45fc108b10 2024-08-31T06:03:14.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.601+0000 7f45f37fe640 1 -- 172.21.15.53:0/2843353062 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f45f401c070 con 0x7f45fc108b10 2024-08-31T06:03:14.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.602+0000 7f45f37fe640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45e80b4c10 0x7f45e80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.602+0000 7f45fa59c640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45e80b4c10 0x7f45e80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.602+0000 7f45f37fe640 1 -- 172.21.15.53:0/2843353062 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 8194+0+0 (secure 0 0 0) 0x7f45f40e4fd0 con 0x7f45fc108b10 2024-08-31T06:03:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.602+0000 7f45f37fe640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365] conn(0x7f45e80be620 0x7f45e80c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.602+0000 7f45f37fe640 1 -- 172.21.15.53:0/2843353062 --> [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45f4025ea0 con 0x7f45e80be620 2024-08-31T06:03:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.602+0000 7f45f37fe640 1 -- 172.21.15.53:0/2843353062 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f45f40e5420 con 0x7f45fc108b10 2024-08-31T06:03:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.602+0000 7f45f3fff640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365] conn(0x7f45e80be620 0x7f45e80c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.602+0000 7f45fa59c640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45e80b4c10 0x7f45e80b7120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f45fc06c4c0 tx=0x7f45ec0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:14.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.603+0000 7f45f3fff640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365] conn(0x7f45e80be620 0x7f45e80c0a70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:14.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.603+0000 7f45f37fe640 1 -- 172.21.15.53:0/2843353062 <== osd.9 v2:172.21.15.53:6826/2148315365 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45f4025ea0 con 0x7f45e80be620 2024-08-31T06:03:14.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.617+0000 7f460097b640 1 -- 172.21.15.53:0/2843353062 --> [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45fc063cf0 con 0x7f45e80be620 2024-08-31T06:03:14.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.617+0000 7f45f37fe640 1 -- 172.21.15.53:0/2843353062 <== osd.9 v2:172.21.15.53:6826/2148315365 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f45fc063cf0 con 0x7f45e80be620 2024-08-31T06:03:14.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.618+0000 7f460097b640 1 -- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365] conn(0x7f45e80be620 msgr2=0x7f45e80c0a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.618+0000 7f460097b640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365] conn(0x7f45e80be620 0x7f45e80c0a70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.618+0000 7f460097b640 1 -- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45e80b4c10 msgr2=0x7f45e80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.618+0000 7f460097b640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45e80b4c10 0x7f45e80b7120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f45fc06c4c0 tx=0x7f45ec0058d0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.618+0000 7f460097b640 1 -- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45fc108b10 msgr2=0x7f45fc19bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.618+0000 7f460097b640 1 --2- 172.21.15.53:0/2843353062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45fc108b10 0x7f45fc19bb30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f45f400b970 tx=0x7f45f400be30 comp rx=0 tx=0).stop 2024-08-31T06:03:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.618+0000 7f45fad9d640 1 -- 172.21.15.53:0/2843353062 reap_dead start 2024-08-31T06:03:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.618+0000 7f460097b640 1 -- 172.21.15.53:0/2843353062 shutdown_connections 2024-08-31T06:03:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.618+0000 7f460097b640 1 -- 172.21.15.53:0/2843353062 >> 172.21.15.53:0/2843353062 conn(0x7f45fc079510 msgr2=0x7f45fc1063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.618+0000 7f460097b640 1 -- 172.21.15.53:0/2843353062 shutdown_connections 2024-08-31T06:03:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.618+0000 7f460097b640 1 -- 172.21.15.53:0/2843353062 wait complete. 2024-08-31T06:03:14.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.793+0000 7f983e7b7640 1 -- 172.21.15.53:0/364569563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9838102880 msgr2=0x7f9838102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.793+0000 7f983e7b7640 1 --2- 172.21.15.53:0/364569563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9838102880 0x7f9838102c90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9828009900 tx=0x7f982802a410 comp rx=0 tx=0).stop 2024-08-31T06:03:14.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.793+0000 7f983e7b7640 1 -- 172.21.15.53:0/364569563 shutdown_connections 2024-08-31T06:03:14.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.793+0000 7f983e7b7640 1 --2- 172.21.15.53:0/364569563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9838108b10 0x7f983810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.793+0000 7f983e7b7640 1 --2- 172.21.15.53:0/364569563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98381081c0 0x7f98381085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.793+0000 7f983e7b7640 1 --2- 172.21.15.53:0/364569563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9838102880 0x7f9838102c90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.793+0000 7f983e7b7640 1 -- 172.21.15.53:0/364569563 >> 172.21.15.53:0/364569563 conn(0x7f9838079510 msgr2=0x7f9838079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:14.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.793+0000 7f983e7b7640 1 -- 172.21.15.53:0/364569563 shutdown_connections 2024-08-31T06:03:14.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.793+0000 7f983e7b7640 1 -- 172.21.15.53:0/364569563 wait complete. 2024-08-31T06:03:14.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.793+0000 7f983e7b7640 1 Processor -- start 2024-08-31T06:03:14.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f983e7b7640 1 -- start start 2024-08-31T06:03:14.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f983e7b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9838102880 0x7f983810fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f983e7b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98381081c0 0x7f9838110360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f983e7b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9838108b10 0x7f98381108a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f983e7b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f98381137a0 con 0x7f9838108b10 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f983e7b7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9838113620 con 0x7f9838102880 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f983e7b7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9838113920 con 0x7f98381081c0 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f983cd54640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9838108b10 0x7f98381108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f983cd54640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9838108b10 0x7f98381108a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35666/0 (socket says 172.21.15.53:35666) 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f983cd54640 1 -- 172.21.15.53:0/3916752933 learned_addr learned my addr 172.21.15.53:0/3916752933 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f9837fff640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9838102880 0x7f983810fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.794+0000 7f98377fe640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98381081c0 0x7f9838110360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f983cd54640 1 -- 172.21.15.53:0/3916752933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98381081c0 msgr2=0x7f9838110360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f983cd54640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98381081c0 0x7f9838110360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f983cd54640 1 -- 172.21.15.53:0/3916752933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9838102880 msgr2=0x7f983810fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f983cd54640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9838102880 0x7f983810fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f983cd54640 1 -- 172.21.15.53:0/3916752933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98381a8510 con 0x7f9838108b10 2024-08-31T06:03:14.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f98377fe640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98381081c0 0x7f9838110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:14.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f9837fff640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9838102880 0x7f983810fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:14.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f983cd54640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9838108b10 0x7f98381108a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f983000cad0 tx=0x7f983000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:14.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f98357fa640 1 -- 172.21.15.53:0/3916752933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983000ae20 con 0x7f9838108b10 2024-08-31T06:03:14.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f98357fa640 1 -- 172.21.15.53:0/3916752933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9830005020 con 0x7f9838108b10 2024-08-31T06:03:14.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f983e7b7640 1 -- 172.21.15.53:0/3916752933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98381a8800 con 0x7f9838108b10 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f98357fa640 1 -- 172.21.15.53:0/3916752933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983000f6b0 con 0x7f9838108b10 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.795+0000 7f983e7b7640 1 -- 172.21.15.53:0/3916752933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98381a8cf0 con 0x7f9838108b10 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.796+0000 7f983e7b7640 1 -- 172.21.15.53:0/3916752933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9838063870 con 0x7f9838108b10 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.798+0000 7f98357fa640 1 -- 172.21.15.53:0/3916752933 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f98300051d0 con 0x7f9838108b10 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.798+0000 7f98357fa640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f98200b4c10 0x7f98200b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.799+0000 7f9837fff640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f98200b4c10 0x7f98200b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.799+0000 7f98357fa640 1 -- 172.21.15.53:0/3916752933 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 8484+0+0 (secure 0 0 0) 0x7f98300e5a80 con 0x7f9838108b10 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.799+0000 7f98357fa640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062] conn(0x7f98200bea80 0x7f98200c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.799+0000 7f98357fa640 1 -- 172.21.15.53:0/3916752933 --> [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9830012ec0 con 0x7f98200bea80 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.799+0000 7f98357fa640 1 -- 172.21.15.53:0/3916752933 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f98300e5ed0 con 0x7f9838108b10 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.799+0000 7f9837fff640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f98200b4c10 0x7f98200b7120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9828006010 tx=0x7f9828005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:14.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.799+0000 7f98377fe640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062] conn(0x7f98200bea80 0x7f98200c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.800+0000 7f98377fe640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062] conn(0x7f98200bea80 0x7f98200c0f70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.801+0000 7f98357fa640 1 -- 172.21.15.53:0/3916752933 <== osd.11 v2:172.21.15.153:6824/16997062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9830012ec0 con 0x7f98200bea80 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.814+0000 7f983e7b7640 1 -- 172.21.15.53:0/3916752933 --> [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9838063cf0 con 0x7f98200bea80 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.815+0000 7f98357fa640 1 -- 172.21.15.53:0/3916752933 <== osd.11 v2:172.21.15.153:6824/16997062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9838063cf0 con 0x7f98200bea80 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.815+0000 7f983e7b7640 1 -- 172.21.15.53:0/3916752933 >> [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062] conn(0x7f98200bea80 msgr2=0x7f98200c0f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.815+0000 7f983e7b7640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062] conn(0x7f98200bea80 0x7f98200c0f70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.815+0000 7f983e7b7640 1 -- 172.21.15.53:0/3916752933 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f98200b4c10 msgr2=0x7f98200b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.815+0000 7f983e7b7640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f98200b4c10 0x7f98200b7120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9828006010 tx=0x7f9828005a20 comp rx=0 tx=0).stop 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.815+0000 7f983e7b7640 1 -- 172.21.15.53:0/3916752933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9838108b10 msgr2=0x7f98381108a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.815+0000 7f983e7b7640 1 --2- 172.21.15.53:0/3916752933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9838108b10 0x7f98381108a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f983000cad0 tx=0x7f983000cf90 comp rx=0 tx=0).stop 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.815+0000 7f983cd54640 1 -- 172.21.15.53:0/3916752933 reap_dead start 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.815+0000 7f983e7b7640 1 -- 172.21.15.53:0/3916752933 shutdown_connections 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.815+0000 7f983e7b7640 1 -- 172.21.15.53:0/3916752933 >> 172.21.15.53:0/3916752933 conn(0x7f9838079510 msgr2=0x7f9838106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:14.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.815+0000 7f983e7b7640 1 -- 172.21.15.53:0/3916752933 shutdown_connections 2024-08-31T06:03:14.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:14.816+0000 7f983e7b7640 1 -- 172.21.15.53:0/3916752933 wait complete. 2024-08-31T06:03:15.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-08-31T06:03:15.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-08-31T06:03:15.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-08-31T06:03:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-08-31T06:03:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]} : dispatch 2024-08-31T06:03:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]} : dispatch 2024-08-31T06:03:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-08-31T06:03:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2024-08-31T06:03:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-08-31T06:03:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]} : dispatch 2024-08-31T06:03:15.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-08-31T06:03:15.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-08-31T06:03:15.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-08-31T06:03:15.152 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-08-31T06:03:15.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]} : dispatch 2024-08-31T06:03:15.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]} : dispatch 2024-08-31T06:03:15.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-08-31T06:03:15.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2024-08-31T06:03:15.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-08-31T06:03:15.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]} : dispatch 2024-08-31T06:03:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-08-31T06:03:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-08-31T06:03:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-08-31T06:03:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-08-31T06:03:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]} : dispatch 2024-08-31T06:03:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]} : dispatch 2024-08-31T06:03:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]} : dispatch 2024-08-31T06:03:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2024-08-31T06:03:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-08-31T06:03:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]} : dispatch 2024-08-31T06:03:16.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: pgmap v268: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T06:03:16.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-08-31T06:03:16.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-08-31T06:03:16.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-31T06:03:16.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-08-31T06:03:16.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-08-31T06:03:16.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-08-31T06:03:16.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-08-31T06:03:16.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-31T06:03:16.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-08-31T06:03:16.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-08-31T06:03:16.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:15 smithi130 ceph-mon[22266]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T06:03:16.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: pgmap v268: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T06:03:16.155 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-08-31T06:03:16.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-08-31T06:03:16.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-31T06:03:16.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-08-31T06:03:16.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-08-31T06:03:16.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-08-31T06:03:16.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-08-31T06:03:16.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-31T06:03:16.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-08-31T06:03:16.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-08-31T06:03:16.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:15 smithi053 ceph-mon[18924]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T06:03:16.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: pgmap v268: 97 pgs: 97 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T06:03:16.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-08-31T06:03:16.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-08-31T06:03:16.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-31T06:03:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-08-31T06:03:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 7]}]': finished 2024-08-31T06:03:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-08-31T06:03:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-08-31T06:03:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-31T06:03:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-08-31T06:03:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-08-31T06:03:16.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:15 smithi153 ceph-mon[22320]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T06:03:16.516 INFO:teuthology.orchestra.run.smithi053.stdout:163208757293 2024-08-31T06:03:16.517 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-31T06:03:16.632 INFO:teuthology.orchestra.run.smithi053.stdout:120259084343 2024-08-31T06:03:16.632 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-31T06:03:17.057 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:16 smithi053 ceph-mon[18924]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T06:03:17.083 INFO:teuthology.orchestra.run.smithi053.stdout:38654705738 2024-08-31T06:03:17.084 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-31T06:03:17.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:16 smithi130 ceph-mon[22266]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T06:03:17.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:16 smithi153 ceph-mon[22320]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T06:03:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.432+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/4009151351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a64109240 msgr2=0x7f9a64109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.432+0000 7f9a6c2a6640 1 --2- 172.21.15.53:0/4009151351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a64109240 0x7f9a64109650 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009900 tx=0x7f9a5402a410 comp rx=0 tx=0).stop 2024-08-31T06:03:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.432+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/4009151351 shutdown_connections 2024-08-31T06:03:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.432+0000 7f9a6c2a6640 1 --2- 172.21.15.53:0/4009151351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a64109b90 0x7f9a641103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.432+0000 7f9a6c2a6640 1 --2- 172.21.15.53:0/4009151351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a64109240 0x7f9a64109650 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.432+0000 7f9a6c2a6640 1 --2- 172.21.15.53:0/4009151351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a64103900 0x7f9a64103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.432+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/4009151351 >> 172.21.15.53:0/4009151351 conn(0x7f9a6407b5f0 msgr2=0x7f9a6407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.432+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/4009151351 shutdown_connections 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.432+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/4009151351 wait complete. 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.433+0000 7f9a6c2a6640 1 Processor -- start 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.433+0000 7f9a6c2a6640 1 -- start start 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.433+0000 7f9a6c2a6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a64103900 0x7f9a6419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.433+0000 7f9a6c2a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a64109240 0x7f9a6419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.433+0000 7f9a6c2a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a64109b90 0x7f9a6419f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.433+0000 7f9a6c2a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64113720 con 0x7f9a64109b90 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.433+0000 7f9a6c2a6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641135a0 con 0x7f9a64109240 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.433+0000 7f9a6c2a6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641138a0 con 0x7f9a64103900 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.433+0000 7f9a6a843640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a64109b90 0x7f9a6419f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.433+0000 7f9a6a843640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a64109b90 0x7f9a6419f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35698/0 (socket says 172.21.15.53:35698) 2024-08-31T06:03:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.433+0000 7f9a6a843640 1 -- 172.21.15.53:0/2439740668 learned_addr learned my addr 172.21.15.53:0/2439740668 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a69841640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a64109240 0x7f9a6419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a6a843640 1 -- 172.21.15.53:0/2439740668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a64103900 msgr2=0x7f9a6419a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a6a042640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a64103900 0x7f9a6419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a6a843640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a64103900 0x7f9a6419a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a6a843640 1 -- 172.21.15.53:0/2439740668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a64109240 msgr2=0x7f9a6419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a6a843640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a64109240 0x7f9a6419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a6a843640 1 -- 172.21.15.53:0/2439740668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a641a0100 con 0x7f9a64109b90 2024-08-31T06:03:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a6a042640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a64103900 0x7f9a6419a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a69841640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a64109240 0x7f9a6419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a6a843640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a64109b90 0x7f9a6419f9d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00b970 tx=0x7f9a5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a5b7fe640 1 -- 172.21.15.53:0/2439740668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c019070 con 0x7f9a64109b90 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a5b7fe640 1 -- 172.21.15.53:0/2439740668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a5c014440 con 0x7f9a64109b90 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/2439740668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a641a03f0 con 0x7f9a64109b90 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a5b7fe640 1 -- 172.21.15.53:0/2439740668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0075d0 con 0x7f9a64109b90 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.434+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/2439740668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a641a6b50 con 0x7f9a64109b90 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.435+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/2439740668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a640638f0 con 0x7f9a64109b90 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.437+0000 7f9a5b7fe640 1 -- 172.21.15.53:0/2439740668 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f9a5c01c070 con 0x7f9a64109b90 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.437+0000 7f9a5b7fe640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a500b4c90 0x7f9a500b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.437+0000 7f9a6a042640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a500b4c90 0x7f9a500b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.437+0000 7f9a5b7fe640 1 -- 172.21.15.53:0/2439740668 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f9a5c0e5100 con 0x7f9a64109b90 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.438+0000 7f9a5b7fe640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014] conn(0x7f9a500beb00 0x7f9a500c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.438+0000 7f9a5b7fe640 1 -- 172.21.15.53:0/2439740668 --> [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a500c16c0 con 0x7f9a500beb00 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.438+0000 7f9a5b7fe640 1 -- 172.21.15.53:0/2439740668 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f9a5c0e5550 con 0x7f9a64109b90 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.438+0000 7f9a6a042640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a500b4c90 0x7f9a500b71a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9a600058c0 tx=0x7f9a60005d30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.438+0000 7f9a69841640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014] conn(0x7f9a500beb00 0x7f9a500c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.438+0000 7f9a69841640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014] conn(0x7f9a500beb00 0x7f9a500c0ff0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.439+0000 7f9a5b7fe640 1 -- 172.21.15.53:0/2439740668 <== osd.2 v2:172.21.15.153:6800/3220443014 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a500c16c0 con 0x7f9a500beb00 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.453+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/2439740668 --> [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a64063da0 con 0x7f9a500beb00 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.453+0000 7f9a5b7fe640 1 -- 172.21.15.53:0/2439740668 <== osd.2 v2:172.21.15.153:6800/3220443014 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9a64063da0 con 0x7f9a500beb00 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.454+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/2439740668 >> [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014] conn(0x7f9a500beb00 msgr2=0x7f9a500c0ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.454+0000 7f9a6c2a6640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014] conn(0x7f9a500beb00 0x7f9a500c0ff0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.454+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/2439740668 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a500b4c90 msgr2=0x7f9a500b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.454+0000 7f9a6c2a6640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a500b4c90 0x7f9a500b71a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9a600058c0 tx=0x7f9a60005d30 comp rx=0 tx=0).stop 2024-08-31T06:03:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.454+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/2439740668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a64109b90 msgr2=0x7f9a6419f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.454+0000 7f9a6c2a6640 1 --2- 172.21.15.53:0/2439740668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a64109b90 0x7f9a6419f9d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00b970 tx=0x7f9a5c00be30 comp rx=0 tx=0).stop 2024-08-31T06:03:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.454+0000 7f9a6a843640 1 -- 172.21.15.53:0/2439740668 reap_dead start 2024-08-31T06:03:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.454+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/2439740668 shutdown_connections 2024-08-31T06:03:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.454+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/2439740668 >> 172.21.15.53:0/2439740668 conn(0x7f9a6407b5f0 msgr2=0x7f9a64107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.454+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/2439740668 shutdown_connections 2024-08-31T06:03:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.454+0000 7f9a6c2a6640 1 -- 172.21.15.53:0/2439740668 wait complete. 2024-08-31T06:03:18.047 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:17 smithi053 ceph-mon[18924]: pgmap v271: 97 pgs: 5 peering, 92 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-08-31T06:03:18.073 INFO:teuthology.orchestra.run.smithi053.stdout:253403070491 2024-08-31T06:03:18.073 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-31T06:03:18.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:17 smithi130 ceph-mon[22266]: pgmap v271: 97 pgs: 5 peering, 92 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-08-31T06:03:18.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.332+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/540233454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a48102800 msgr2=0x7f9a48102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:18.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.332+0000 7f9a4ce2c640 1 --2- 172.21.15.53:0/540233454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a48102800 0x7f9a48102c10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009900 tx=0x7f9a3802a410 comp rx=0 tx=0).stop 2024-08-31T06:03:18.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.333+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/540233454 shutdown_connections 2024-08-31T06:03:18.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.333+0000 7f9a4ce2c640 1 --2- 172.21.15.53:0/540233454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a48108a90 0x7f9a4810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:18.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.333+0000 7f9a4ce2c640 1 --2- 172.21.15.53:0/540233454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a48108140 0x7f9a48108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:18.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.333+0000 7f9a4ce2c640 1 --2- 172.21.15.53:0/540233454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a48102800 0x7f9a48102c10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:18.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.333+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/540233454 >> 172.21.15.53:0/540233454 conn(0x7f9a480794d0 msgr2=0x7f9a480798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.333+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/540233454 shutdown_connections 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.333+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/540233454 wait complete. 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a4ce2c640 1 Processor -- start 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a4ce2c640 1 -- start start 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a4ce2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a48102800 0x7f9a4819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a4ce2c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a48108140 0x7f9a4819c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a4ce2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a48108a90 0x7f9a481a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a4ce2c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48112640 con 0x7f9a48108a90 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a4ce2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9a481124c0 con 0x7f9a48102800 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a4ce2c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9a481127c0 con 0x7f9a48108140 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a46d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a48108a90 0x7f9a481a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:18.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a46d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a48108a90 0x7f9a481a1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35682/0 (socket says 172.21.15.53:35682) 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a46d9d640 1 -- 172.21.15.53:0/3203468268 learned_addr learned my addr 172.21.15.53:0/3203468268 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a4659c640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a48102800 0x7f9a4819c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a45d9b640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a48108140 0x7f9a4819c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a46d9d640 1 -- 172.21.15.53:0/3203468268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a48108140 msgr2=0x7f9a4819c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a46d9d640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a48108140 0x7f9a4819c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a46d9d640 1 -- 172.21.15.53:0/3203468268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a48102800 msgr2=0x7f9a4819c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a46d9d640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a48102800 0x7f9a4819c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.334+0000 7f9a46d9d640 1 -- 172.21.15.53:0/3203468268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a481a2390 con 0x7f9a48108a90 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.335+0000 7f9a46d9d640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a48108a90 0x7f9a481a1c60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000b970 tx=0x7f9a4000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.335+0000 7f9a377fe640 1 -- 172.21.15.53:0/3203468268 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40019070 con 0x7f9a48108a90 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.335+0000 7f9a377fe640 1 -- 172.21.15.53:0/3203468268 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a40014440 con 0x7f9a48108a90 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.335+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/3203468268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a481a2680 con 0x7f9a48108a90 2024-08-31T06:03:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.335+0000 7f9a377fe640 1 -- 172.21.15.53:0/3203468268 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a400075d0 con 0x7f9a48108a90 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.335+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/3203468268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a481a8de0 con 0x7f9a48108a90 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.336+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/3203468268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a4806b6b0 con 0x7f9a48108a90 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.337+0000 7f9a377fe640 1 -- 172.21.15.53:0/3203468268 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f9a4001c070 con 0x7f9a48108a90 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.338+0000 7f9a377fe640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a300b4c10 0x7f9a300b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.338+0000 7f9a377fe640 1 -- 172.21.15.53:0/3203468268 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f9a400e50b0 con 0x7f9a48108a90 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.338+0000 7f9a4659c640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a300b4c10 0x7f9a300b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.338+0000 7f9a377fe640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383] conn(0x7f9a300bea80 0x7f9a300c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.338+0000 7f9a377fe640 1 -- 172.21.15.53:0/3203468268 --> [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a40024e50 con 0x7f9a300bea80 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.338+0000 7f9a377fe640 1 -- 172.21.15.53:0/3203468268 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f9a400e5500 con 0x7f9a48108a90 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.339+0000 7f9a45d9b640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383] conn(0x7f9a300bea80 0x7f9a300c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.339+0000 7f9a4659c640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a300b4c10 0x7f9a300b7120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9a380057c0 tx=0x7f9a380058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.339+0000 7f9a45d9b640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383] conn(0x7f9a300bea80 0x7f9a300c0f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.340+0000 7f9a377fe640 1 -- 172.21.15.53:0/3203468268 <== osd.1 v2:172.21.15.130:6800/3394793383 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a40024e50 con 0x7f9a300bea80 2024-08-31T06:03:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/3203468268 --> [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a48103a80 con 0x7f9a300bea80 2024-08-31T06:03:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a377fe640 1 -- 172.21.15.53:0/3203468268 <== osd.1 v2:172.21.15.130:6800/3394793383 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9a48103a80 con 0x7f9a300bea80 2024-08-31T06:03:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/3203468268 >> [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383] conn(0x7f9a300bea80 msgr2=0x7f9a300c0f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a4ce2c640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383] conn(0x7f9a300bea80 0x7f9a300c0f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/3203468268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a300b4c10 msgr2=0x7f9a300b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a4ce2c640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a300b4c10 0x7f9a300b7120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9a380057c0 tx=0x7f9a380058d0 comp rx=0 tx=0).stop 2024-08-31T06:03:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/3203468268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a48108a90 msgr2=0x7f9a481a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a4ce2c640 1 --2- 172.21.15.53:0/3203468268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a48108a90 0x7f9a481a1c60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000b970 tx=0x7f9a4000be30 comp rx=0 tx=0).stop 2024-08-31T06:03:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a46d9d640 1 -- 172.21.15.53:0/3203468268 reap_dead start 2024-08-31T06:03:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/3203468268 shutdown_connections 2024-08-31T06:03:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/3203468268 >> 172.21.15.53:0/3203468268 conn(0x7f9a480794d0 msgr2=0x7f9a4806ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/3203468268 shutdown_connections 2024-08-31T06:03:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:17.357+0000 7f9a4ce2c640 1 -- 172.21.15.53:0/3203468268 wait complete. 2024-08-31T06:03:18.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:17 smithi153 ceph-mon[22320]: pgmap v271: 97 pgs: 5 peering, 92 active+clean; 642 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-08-31T06:03:18.853 INFO:teuthology.orchestra.run.smithi053.stdout:274877906966 2024-08-31T06:03:18.854 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-31T06:03:19.253 INFO:teuthology.orchestra.run.smithi053.stdout:231928234016 2024-08-31T06:03:19.254 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-31T06:03:19.685 INFO:teuthology.orchestra.run.smithi053.stdout:184683593769 2024-08-31T06:03:19.685 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-31T06:03:19.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:19 smithi053 ceph-mon[18924]: pgmap v272: 97 pgs: 5 peering, 92 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:19 smithi130 ceph-mon[22266]: pgmap v272: 97 pgs: 5 peering, 92 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:20.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:19 smithi153 ceph-mon[22320]: pgmap v272: 97 pgs: 5 peering, 92 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:20.341 INFO:teuthology.orchestra.run.smithi053.stdout:137438953522 2024-08-31T06:03:20.341 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-31T06:03:20.858 INFO:teuthology.orchestra.run.smithi053.stdout:55834574919 2024-08-31T06:03:20.858 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-31T06:03:21.329 INFO:teuthology.orchestra.run.smithi053.stdout:73014444098 2024-08-31T06:03:21.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-31T06:03:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:21.353 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:21.373 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:21.831 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:21 smithi053 ceph-mon[18924]: pgmap v273: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:22.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.070+0000 7f6173b89640 1 -- 172.21.15.53:0/3696930505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c10dbc0 msgr2=0x7f616c1100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:22.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.070+0000 7f6173b89640 1 --2- 172.21.15.53:0/3696930505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c10dbc0 0x7f616c1100b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6164009ca0 tx=0x7f616402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.070+0000 7f6173b89640 1 -- 172.21.15.53:0/3696930505 shutdown_connections 2024-08-31T06:03:22.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.070+0000 7f6173b89640 1 --2- 172.21.15.53:0/3696930505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c10dbc0 0x7f616c1100b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.070+0000 7f6173b89640 1 --2- 172.21.15.53:0/3696930505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f616c105040 0x7f616c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.070+0000 7f6173b89640 1 --2- 172.21.15.53:0/3696930505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f616c104610 0x7f616c104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.070+0000 7f6173b89640 1 -- 172.21.15.53:0/3696930505 >> 172.21.15.53:0/3696930505 conn(0x7f616c0794b0 msgr2=0x7f616c0798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.070+0000 7f6173b89640 1 -- 172.21.15.53:0/3696930505 shutdown_connections 2024-08-31T06:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.070+0000 7f6173b89640 1 -- 172.21.15.53:0/3696930505 wait complete. 2024-08-31T06:03:22.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.071+0000 7f6173b89640 1 Processor -- start 2024-08-31T06:03:22.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.071+0000 7f6173b89640 1 -- start start 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.071+0000 7f6173b89640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f616c104610 0x7f616c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.071+0000 7f6173b89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c105040 0x7f616c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.071+0000 7f6173b89640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f616c10dbc0 0x7f616c19f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.071+0000 7f6173b89640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f616c113720 con 0x7f616c105040 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.071+0000 7f6173b89640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f616c1135a0 con 0x7f616c104610 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.071+0000 7f6173b89640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f616c1138a0 con 0x7f616c10dbc0 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.071+0000 7f6171124640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c105040 0x7f616c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.071+0000 7f6171124640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c105040 0x7f616c19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35742/0 (socket says 172.21.15.53:35742) 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.071+0000 7f6171124640 1 -- 172.21.15.53:0/966451546 learned_addr learned my addr 172.21.15.53:0/966451546 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6172126640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f616c10dbc0 0x7f616c19f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6171925640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f616c104610 0x7f616c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:22.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6171124640 1 -- 172.21.15.53:0/966451546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f616c10dbc0 msgr2=0x7f616c19f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:22.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6171124640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f616c10dbc0 0x7f616c19f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6171124640 1 -- 172.21.15.53:0/966451546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f616c104610 msgr2=0x7f616c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:22.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6171124640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f616c104610 0x7f616c19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6171124640 1 -- 172.21.15.53:0/966451546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c1a0020 con 0x7f616c105040 2024-08-31T06:03:22.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6171124640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c105040 0x7f616c19a710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f615c00c970 tx=0x7f615c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:22.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6162ffd640 1 -- 172.21.15.53:0/966451546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c014070 con 0x7f616c105040 2024-08-31T06:03:22.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6162ffd640 1 -- 172.21.15.53:0/966451546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f615c004440 con 0x7f616c105040 2024-08-31T06:03:22.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6173b89640 1 -- 172.21.15.53:0/966451546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f616c1a0310 con 0x7f616c105040 2024-08-31T06:03:22.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6162ffd640 1 -- 172.21.15.53:0/966451546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c003d40 con 0x7f616c105040 2024-08-31T06:03:22.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.072+0000 7f6173b89640 1 -- 172.21.15.53:0/966451546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f616c1a6b30 con 0x7f616c105040 2024-08-31T06:03:22.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.073+0000 7f6173b89640 1 -- 172.21.15.53:0/966451546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f616c06bf80 con 0x7f616c105040 2024-08-31T06:03:22.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.075+0000 7f6162ffd640 1 -- 172.21.15.53:0/966451546 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f615c017070 con 0x7f616c105040 2024-08-31T06:03:22.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.076+0000 7f6162ffd640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61580b4cc0 0x7f61580b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:22.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.076+0000 7f6171925640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61580b4cc0 0x7f61580b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:22.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.076+0000 7f6162ffd640 1 -- 172.21.15.53:0/966451546 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f615c0e55f0 con 0x7f616c105040 2024-08-31T06:03:22.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.077+0000 7f6171925640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61580b4cc0 0x7f61580b71d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6168005fd0 tx=0x7f616800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:22.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.079+0000 7f6162ffd640 1 -- 172.21.15.53:0/966451546 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f615c01e030 con 0x7f616c105040 2024-08-31T06:03:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:21 smithi130 ceph-mon[22266]: pgmap v273: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.974+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/1683875813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfd8102d40 msgr2=0x7fbfd810fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.974+0000 7fbfdfcbc640 1 --2- 172.21.15.53:0/1683875813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfd8102d40 0x7fbfd810fa60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009900 tx=0x7fbfc802a480 comp rx=0 tx=0).stop 2024-08-31T06:03:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.975+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/1683875813 shutdown_connections 2024-08-31T06:03:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.975+0000 7fbfdfcbc640 1 --2- 172.21.15.53:0/1683875813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd810ffa0 0x7fbfd81123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.975+0000 7fbfdfcbc640 1 --2- 172.21.15.53:0/1683875813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfd8102d40 0x7fbfd810fa60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.975+0000 7fbfdfcbc640 1 --2- 172.21.15.53:0/1683875813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfd81023f0 0x7fbfd8102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.975+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/1683875813 >> 172.21.15.53:0/1683875813 conn(0x7fbfd8079500 msgr2=0x7fbfd8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.975+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/1683875813 shutdown_connections 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.975+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/1683875813 wait complete. 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.975+0000 7fbfdfcbc640 1 Processor -- start 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.975+0000 7fbfdfcbc640 1 -- start start 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdfcbc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd81023f0 0x7fbfd819c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdfcbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfd8102d40 0x7fbfd819c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdfcbc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfd810ffa0 0x7fbfd81a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdfcbc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd81158f0 con 0x7fbfd8102d40 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdfcbc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd8115770 con 0x7fbfd81023f0 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdfcbc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd8115a70 con 0x7fbfd810ffa0 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdd257640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfd8102d40 0x7fbfd819c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdd257640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfd8102d40 0x7fbfd819c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35714/0 (socket says 172.21.15.53:35714) 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdd257640 1 -- 172.21.15.53:0/4190755412 learned_addr learned my addr 172.21.15.53:0/4190755412 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdda58640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd81023f0 0x7fbfd819c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfde259640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfd810ffa0 0x7fbfd81a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdd257640 1 -- 172.21.15.53:0/4190755412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfd810ffa0 msgr2=0x7fbfd81a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdd257640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfd810ffa0 0x7fbfd81a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdd257640 1 -- 172.21.15.53:0/4190755412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd81023f0 msgr2=0x7fbfd819c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdd257640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd81023f0 0x7fbfd819c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.976+0000 7fbfdd257640 1 -- 172.21.15.53:0/4190755412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd81a21f0 con 0x7fbfd8102d40 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.977+0000 7fbfdd257640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfd8102d40 0x7fbfd819c8e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009230 tx=0x7fbfc8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.977+0000 7fbfceffd640 1 -- 172.21.15.53:0/4190755412 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc803f030 con 0x7fbfd8102d40 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.977+0000 7fbfceffd640 1 -- 172.21.15.53:0/4190755412 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfc8003a80 con 0x7fbfd8102d40 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.977+0000 7fbfceffd640 1 -- 172.21.15.53:0/4190755412 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8035070 con 0x7fbfd8102d40 2024-08-31T06:03:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.977+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/4190755412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd81a2480 con 0x7fbfd8102d40 2024-08-31T06:03:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.977+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/4190755412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd81a2910 con 0x7fbfd8102d40 2024-08-31T06:03:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.978+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/4190755412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd806bf90 con 0x7fbfd8102d40 2024-08-31T06:03:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.981+0000 7fbfceffd640 1 -- 172.21.15.53:0/4190755412 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fbfc8042030 con 0x7fbfd8102d40 2024-08-31T06:03:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.982+0000 7fbfceffd640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfc40b4d40 0x7fbfc40b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.983+0000 7fbfceffd640 1 -- 172.21.15.53:0/4190755412 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fbfc8105f00 con 0x7fbfd8102d40 2024-08-31T06:03:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.983+0000 7fbfdda58640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfc40b4d40 0x7fbfc40b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.983+0000 7fbfdda58640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfc40b4d40 0x7fbfc40b7250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4005fd0 tx=0x7fbfd400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:21.988+0000 7fbfceffd640 1 -- 172.21.15.53:0/4190755412 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbfc80cc720 con 0x7fbfd8102d40 2024-08-31T06:03:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:21 smithi153 ceph-mon[22320]: pgmap v273: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:22.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.178+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/4190755412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fbfd819d470 con 0x7fbfd8102d40 2024-08-31T06:03:22.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.178+0000 7fbfceffd640 1 -- 172.21.15.53:0/4190755412 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbfc80d0ee0 con 0x7fbfd8102d40 2024-08-31T06:03:22.180 INFO:teuthology.orchestra.run.smithi053.stdout:184683593771 2024-08-31T06:03:22.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.180+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/4190755412 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfc40b4d40 msgr2=0x7fbfc40b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:22.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.180+0000 7fbfdfcbc640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfc40b4d40 0x7fbfc40b7250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4005fd0 tx=0x7fbfd400b390 comp rx=0 tx=0).stop 2024-08-31T06:03:22.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.180+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/4190755412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfd8102d40 msgr2=0x7fbfd819c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:22.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.180+0000 7fbfdfcbc640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfd8102d40 0x7fbfd819c8e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009230 tx=0x7fbfc8004270 comp rx=0 tx=0).stop 2024-08-31T06:03:22.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.180+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/4190755412 shutdown_connections 2024-08-31T06:03:22.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.180+0000 7fbfdfcbc640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfc40b4d40 0x7fbfc40b7250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.181+0000 7fbfdfcbc640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfd810ffa0 0x7fbfd81a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.181+0000 7fbfdfcbc640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfd8102d40 0x7fbfd819c8e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.181+0000 7fbfdfcbc640 1 --2- 172.21.15.53:0/4190755412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfd81023f0 0x7fbfd819c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.181+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/4190755412 >> 172.21.15.53:0/4190755412 conn(0x7fbfd8079500 msgr2=0x7fbfd8111470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:22.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.181+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/4190755412 shutdown_connections 2024-08-31T06:03:22.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.181+0000 7fbfdfcbc640 1 -- 172.21.15.53:0/4190755412 wait complete. 2024-08-31T06:03:22.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.268+0000 7f6173b89640 1 -- 172.21.15.53:0/966451546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f616c1a6e80 con 0x7f616c105040 2024-08-31T06:03:22.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.268+0000 7f6162ffd640 1 -- 172.21.15.53:0/966451546 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f615c0ac540 con 0x7f616c105040 2024-08-31T06:03:22.270 INFO:teuthology.orchestra.run.smithi053.stdout:253403070493 2024-08-31T06:03:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 -- 172.21.15.53:0/966451546 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61580b4cc0 msgr2=0x7f61580b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61580b4cc0 0x7f61580b71d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6168005fd0 tx=0x7f616800b390 comp rx=0 tx=0).stop 2024-08-31T06:03:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 -- 172.21.15.53:0/966451546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c105040 msgr2=0x7f616c19a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c105040 0x7f616c19a710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f615c00c970 tx=0x7f615c00ce30 comp rx=0 tx=0).stop 2024-08-31T06:03:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 -- 172.21.15.53:0/966451546 shutdown_connections 2024-08-31T06:03:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61580b4cc0 0x7f61580b71d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f616c10dbc0 0x7f616c19f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c105040 0x7f616c19a710 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 --2- 172.21.15.53:0/966451546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f616c104610 0x7f616c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:22.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 -- 172.21.15.53:0/966451546 >> 172.21.15.53:0/966451546 conn(0x7f616c0794b0 msgr2=0x7f616c1076d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:22.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 -- 172.21.15.53:0/966451546 shutdown_connections 2024-08-31T06:03:22.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:22.271+0000 7f6173b89640 1 -- 172.21.15.53:0/966451546 wait complete. 2024-08-31T06:03:22.957 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:22 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4190755412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T06:03:22.958 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:22 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/966451546' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T06:03:22.986 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593769 got 184683593771 for osd.7 2024-08-31T06:03:22.986 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:23.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:22 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4190755412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T06:03:23.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:22 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/966451546' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T06:03:23.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:22 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4190755412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T06:03:23.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:22 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/966451546' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T06:03:23.704 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070491 got 253403070493 for osd.10 2024-08-31T06:03:23.705 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:23.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:23 smithi053 ceph-mon[18924]: pgmap v274: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:23.956 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:23.958 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:23.959 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:23.961 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:23.961 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:23 smithi130 ceph-mon[22266]: pgmap v274: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.161+0000 7f807dd0a640 1 -- 172.21.15.53:0/4018509790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8078109b90 msgr2=0x7f80781103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.161+0000 7f807dd0a640 1 --2- 172.21.15.53:0/4018509790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8078109b90 0x7f80781103c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8070009ca0 tx=0x7f807002a8e0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.161+0000 7f807dd0a640 1 -- 172.21.15.53:0/4018509790 shutdown_connections 2024-08-31T06:03:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.161+0000 7f807dd0a640 1 --2- 172.21.15.53:0/4018509790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8078109b90 0x7f80781103c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.161+0000 7f807dd0a640 1 --2- 172.21.15.53:0/4018509790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078109240 0x7f8078109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.161+0000 7f807dd0a640 1 --2- 172.21.15.53:0/4018509790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8078103900 0x7f8078103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.161+0000 7f807dd0a640 1 -- 172.21.15.53:0/4018509790 >> 172.21.15.53:0/4018509790 conn(0x7f807807b5f0 msgr2=0x7f807807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.161+0000 7f807dd0a640 1 -- 172.21.15.53:0/4018509790 shutdown_connections 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.161+0000 7f807dd0a640 1 -- 172.21.15.53:0/4018509790 wait complete. 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.161+0000 7f807dd0a640 1 Processor -- start 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.161+0000 7f807dd0a640 1 -- start start 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f807dd0a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8078103900 0x7f807819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f807dd0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8078109240 0x7f807819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f807dd0a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078109b90 0x7f807819fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f807dd0a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f80781137c0 con 0x7f8078109240 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f807dd0a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8078113640 con 0x7f8078103900 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f807dd0a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8078113940 con 0x7f8078109b90 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f806effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8078109240 0x7f807819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:24.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f806effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8078109240 0x7f807819a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51802/0 (socket says 172.21.15.53:51802) 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f806effd640 1 -- 172.21.15.53:0/703532956 learned_addr learned my addr 172.21.15.53:0/703532956 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f80777fe640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8078103900 0x7f807819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f8077fff640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078109b90 0x7f807819fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f806effd640 1 -- 172.21.15.53:0/703532956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078109b90 msgr2=0x7f807819fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f806effd640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078109b90 0x7f807819fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f806effd640 1 -- 172.21.15.53:0/703532956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8078103900 msgr2=0x7f807819a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f806effd640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8078103900 0x7f807819a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.162+0000 7f806effd640 1 -- 172.21.15.53:0/703532956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80781a0200 con 0x7f8078109240 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.163+0000 7f806effd640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8078109240 0x7f807819a830 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8060006fd0 tx=0x7f806000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.163+0000 7f80757fa640 1 -- 172.21.15.53:0/703532956 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060015020 con 0x7f8078109240 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.163+0000 7f80757fa640 1 -- 172.21.15.53:0/703532956 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8060011cc0 con 0x7f8078109240 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.163+0000 7f807dd0a640 1 -- 172.21.15.53:0/703532956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80781a04f0 con 0x7f8078109240 2024-08-31T06:03:24.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.163+0000 7f80757fa640 1 -- 172.21.15.53:0/703532956 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060010cd0 con 0x7f8078109240 2024-08-31T06:03:24.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.163+0000 7f807dd0a640 1 -- 172.21.15.53:0/703532956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80781a6c50 con 0x7f8078109240 2024-08-31T06:03:24.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.164+0000 7f807dd0a640 1 -- 172.21.15.53:0/703532956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8078103d90 con 0x7f8078109240 2024-08-31T06:03:24.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.166+0000 7f80757fa640 1 -- 172.21.15.53:0/703532956 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f8060018020 con 0x7f8078109240 2024-08-31T06:03:24.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.166+0000 7f80757fa640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80640b4c10 0x7f80640b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:24.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.166+0000 7f80777fe640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80640b4c10 0x7f80640b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:24.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.166+0000 7f80757fa640 1 -- 172.21.15.53:0/703532956 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f80600e5090 con 0x7f8078109240 2024-08-31T06:03:24.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.167+0000 7f80777fe640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80640b4c10 0x7f80640b7120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8068009990 tx=0x7f8068009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:24.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.171+0000 7f80757fa640 1 -- 172.21.15.53:0/703532956 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f806001f020 con 0x7f8078109240 2024-08-31T06:03:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:23 smithi153 ceph-mon[22320]: pgmap v274: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:24.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.366+0000 7f807dd0a640 1 -- 172.21.15.53:0/703532956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f807819b3c0 con 0x7f8078109240 2024-08-31T06:03:24.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.367+0000 7f80757fa640 1 -- 172.21.15.53:0/703532956 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f807819b3c0 con 0x7f8078109240 2024-08-31T06:03:24.369 INFO:teuthology.orchestra.run.smithi053.stdout:210453397543 2024-08-31T06:03:24.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 -- 172.21.15.53:0/703532956 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80640b4c10 msgr2=0x7f80640b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:24.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80640b4c10 0x7f80640b7120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8068009990 tx=0x7f8068009110 comp rx=0 tx=0).stop 2024-08-31T06:03:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 -- 172.21.15.53:0/703532956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8078109240 msgr2=0x7f807819a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8078109240 0x7f807819a830 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8060006fd0 tx=0x7f806000b820 comp rx=0 tx=0).stop 2024-08-31T06:03:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 -- 172.21.15.53:0/703532956 shutdown_connections 2024-08-31T06:03:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80640b4c10 0x7f80640b7120 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078109b90 0x7f807819fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8078109240 0x7f807819a830 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 --2- 172.21.15.53:0/703532956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8078103900 0x7f807819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 -- 172.21.15.53:0/703532956 >> 172.21.15.53:0/703532956 conn(0x7f807807b5f0 msgr2=0x7f8078107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 -- 172.21.15.53:0/703532956 shutdown_connections 2024-08-31T06:03:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.369+0000 7f807dd0a640 1 -- 172.21.15.53:0/703532956 wait complete. 2024-08-31T06:03:24.691 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:24.692 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:24.693 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:24.874 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:24 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/703532956' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T06:03:24.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.887+0000 7f9dfa661640 1 -- 172.21.15.53:0/1325672902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df4108150 msgr2=0x7f9df4108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:24.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.887+0000 7f9dfa661640 1 --2- 172.21.15.53:0/1325672902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df4108150 0x7f9df4108560 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009900 tx=0x7f9de802a410 comp rx=0 tx=0).stop 2024-08-31T06:03:24.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.887+0000 7f9dfa661640 1 -- 172.21.15.53:0/1325672902 shutdown_connections 2024-08-31T06:03:24.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.887+0000 7f9dfa661640 1 --2- 172.21.15.53:0/1325672902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9df4108aa0 0x7f9df410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.887+0000 7f9dfa661640 1 --2- 172.21.15.53:0/1325672902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df4108150 0x7f9df4108560 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.887+0000 7f9dfa661640 1 --2- 172.21.15.53:0/1325672902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4102860 0x7f9df4102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.887+0000 7f9dfa661640 1 -- 172.21.15.53:0/1325672902 >> 172.21.15.53:0/1325672902 conn(0x7f9df40794c0 msgr2=0x7f9df40798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:24.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.887+0000 7f9dfa661640 1 -- 172.21.15.53:0/1325672902 shutdown_connections 2024-08-31T06:03:24.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.887+0000 7f9dfa661640 1 -- 172.21.15.53:0/1325672902 wait complete. 2024-08-31T06:03:24.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.888+0000 7f9dfa661640 1 Processor -- start 2024-08-31T06:03:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.888+0000 7f9dfa661640 1 -- start start 2024-08-31T06:03:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9dfa661640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df4102860 0x7f9df40ff3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9dfa661640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4108150 0x7f9df40ff930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9dfa661640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9df4108aa0 0x7f9df40ffe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9dfa661640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9df4112630 con 0x7f9df4102860 2024-08-31T06:03:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9dfa661640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9df41124b0 con 0x7f9df4108aa0 2024-08-31T06:03:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9dfa661640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9df41127b0 con 0x7f9df4108150 2024-08-31T06:03:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df4102860 0x7f9df40ff3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df4102860 0x7f9df40ff3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51824/0 (socket says 172.21.15.53:51824) 2024-08-31T06:03:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df3fff640 1 -- 172.21.15.53:0/1947456030 learned_addr learned my addr 172.21.15.53:0/1947456030 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:24.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df8bfe640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9df4108aa0 0x7f9df40ffe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df37fe640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4108150 0x7f9df40ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df3fff640 1 -- 172.21.15.53:0/1947456030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4108150 msgr2=0x7f9df40ff930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df3fff640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4108150 0x7f9df40ff930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df3fff640 1 -- 172.21.15.53:0/1947456030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9df4108aa0 msgr2=0x7f9df40ffe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df3fff640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9df4108aa0 0x7f9df40ffe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df3fff640 1 -- 172.21.15.53:0/1947456030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df41a8400 con 0x7f9df4102860 2024-08-31T06:03:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df37fe640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4108150 0x7f9df40ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df8bfe640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9df4108aa0 0x7f9df40ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df3fff640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df4102860 0x7f9df40ff3f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9de400b4a0 tx=0x7f9de400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:24.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df17fa640 1 -- 172.21.15.53:0/1947456030 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4014070 con 0x7f9df4102860 2024-08-31T06:03:24.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df17fa640 1 -- 172.21.15.53:0/1947456030 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9de4010aa0 con 0x7f9df4102860 2024-08-31T06:03:24.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9dfa661640 1 -- 172.21.15.53:0/1947456030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df41a86f0 con 0x7f9df4102860 2024-08-31T06:03:24.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9df17fa640 1 -- 172.21.15.53:0/1947456030 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4017b70 con 0x7f9df4102860 2024-08-31T06:03:24.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.889+0000 7f9dfa661640 1 -- 172.21.15.53:0/1947456030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df41a8c60 con 0x7f9df4102860 2024-08-31T06:03:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.890+0000 7f9dfa661640 1 -- 172.21.15.53:0/1947456030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df4102c70 con 0x7f9df4102860 2024-08-31T06:03:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.892+0000 7f9df17fa640 1 -- 172.21.15.53:0/1947456030 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f9de4017070 con 0x7f9df4102860 2024-08-31T06:03:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.893+0000 7f9df17fa640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ddc0b4c10 0x7f9ddc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.893+0000 7f9df37fe640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ddc0b4c10 0x7f9ddc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.893+0000 7f9df17fa640 1 -- 172.21.15.53:0/1947456030 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f9de40e4c20 con 0x7f9df4102860 2024-08-31T06:03:24.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.893+0000 7f9df37fe640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ddc0b4c10 0x7f9ddc0b7120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9de8006010 tx=0x7f9de8000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:24.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:24.896+0000 7f9df17fa640 1 -- 172.21.15.53:0/1947456030 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9de40aba90 con 0x7f9df4102860 2024-08-31T06:03:25.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.083+0000 7f9dfa661640 1 -- 172.21.15.53:0/1947456030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9df41006f0 con 0x7f9df4102860 2024-08-31T06:03:25.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.083+0000 7f9df17fa640 1 -- 172.21.15.53:0/1947456030 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9df41006f0 con 0x7f9df4102860 2024-08-31T06:03:25.086 INFO:teuthology.orchestra.run.smithi053.stdout:163208757296 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.085+0000 7f9dfa661640 1 -- 172.21.15.53:0/1947456030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ddc0b4c10 msgr2=0x7f9ddc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.085+0000 7f9dfa661640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ddc0b4c10 0x7f9ddc0b7120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9de8006010 tx=0x7f9de8000bc0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.085+0000 7f9dfa661640 1 -- 172.21.15.53:0/1947456030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df4102860 msgr2=0x7f9df40ff3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.085+0000 7f9dfa661640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df4102860 0x7f9df40ff3f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9de400b4a0 tx=0x7f9de400b960 comp rx=0 tx=0).stop 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.086+0000 7f9dfa661640 1 -- 172.21.15.53:0/1947456030 shutdown_connections 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.086+0000 7f9dfa661640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ddc0b4c10 0x7f9ddc0b7120 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.086+0000 7f9dfa661640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9df4108aa0 0x7f9df40ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.086+0000 7f9dfa661640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df4108150 0x7f9df40ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.086+0000 7f9dfa661640 1 --2- 172.21.15.53:0/1947456030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df4102860 0x7f9df40ff3f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.086+0000 7f9dfa661640 1 -- 172.21.15.53:0/1947456030 >> 172.21.15.53:0/1947456030 conn(0x7f9df40794c0 msgr2=0x7f9df41018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.086+0000 7f9dfa661640 1 -- 172.21.15.53:0/1947456030 shutdown_connections 2024-08-31T06:03:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.086+0000 7f9dfa661640 1 -- 172.21.15.53:0/1947456030 wait complete. 2024-08-31T06:03:25.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:24 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/703532956' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T06:03:25.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:24 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/703532956' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T06:03:25.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.375+0000 7f547228f640 1 -- 172.21.15.53:0/214678352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c108140 msgr2=0x7f546c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.375+0000 7f547228f640 1 --2- 172.21.15.53:0/214678352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c108140 0x7f546c108550 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5460009900 tx=0x7f546002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.375+0000 7f547228f640 1 -- 172.21.15.53:0/214678352 shutdown_connections 2024-08-31T06:03:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.375+0000 7f547228f640 1 --2- 172.21.15.53:0/214678352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f546c108a90 0x7f546c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.375+0000 7f547228f640 1 --2- 172.21.15.53:0/214678352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c108140 0x7f546c108550 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.375+0000 7f547228f640 1 --2- 172.21.15.53:0/214678352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546c102800 0x7f546c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.375+0000 7f547228f640 1 -- 172.21.15.53:0/214678352 >> 172.21.15.53:0/214678352 conn(0x7f546c0794d0 msgr2=0x7f546c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.375+0000 7f547228f640 1 -- 172.21.15.53:0/214678352 shutdown_connections 2024-08-31T06:03:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.375+0000 7f547228f640 1 -- 172.21.15.53:0/214678352 wait complete. 2024-08-31T06:03:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.376+0000 7f547228f640 1 Processor -- start 2024-08-31T06:03:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.376+0000 7f547228f640 1 -- start start 2024-08-31T06:03:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547228f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f546c102800 0x7f546c10fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547228f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546c108140 0x7f546c110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547228f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c108a90 0x7f546c1107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547228f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f546c1136d0 con 0x7f546c108a90 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547228f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f546c113550 con 0x7f546c102800 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547228f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f546c113850 con 0x7f546c108140 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547082c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c108a90 0x7f546c1107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547082c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c108a90 0x7f546c1107d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51852/0 (socket says 172.21.15.53:51852) 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547082c640 1 -- 172.21.15.53:0/1616591859 learned_addr learned my addr 172.21.15.53:0/1616591859 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f546bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f546c102800 0x7f546c10fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f546b7fe640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546c108140 0x7f546c110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547082c640 1 -- 172.21.15.53:0/1616591859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546c108140 msgr2=0x7f546c110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547082c640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546c108140 0x7f546c110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547082c640 1 -- 172.21.15.53:0/1616591859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f546c102800 msgr2=0x7f546c10fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547082c640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f546c102800 0x7f546c10fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547082c640 1 -- 172.21.15.53:0/1616591859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c1a8480 con 0x7f546c108a90 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.377+0000 7f547082c640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c108a90 0x7f546c1107d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5464009fd0 tx=0x7f546400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.378+0000 7f54697fa640 1 -- 172.21.15.53:0/1616591859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5464017070 con 0x7f546c108a90 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.378+0000 7f547228f640 1 -- 172.21.15.53:0/1616591859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546c1a8770 con 0x7f546c108a90 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.378+0000 7f54697fa640 1 -- 172.21.15.53:0/1616591859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5464003e00 con 0x7f546c108a90 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.378+0000 7f54697fa640 1 -- 172.21.15.53:0/1616591859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5464010460 con 0x7f546c108a90 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.378+0000 7f547228f640 1 -- 172.21.15.53:0/1616591859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f546c1a8c80 con 0x7f546c108a90 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.379+0000 7f547228f640 1 -- 172.21.15.53:0/1616591859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546c102c10 con 0x7f546c108a90 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.381+0000 7f54697fa640 1 -- 172.21.15.53:0/1616591859 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f5464003970 con 0x7f546c108a90 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.382+0000 7f54697fa640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54540b4c10 0x7f54540b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.382+0000 7f546bfff640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54540b4c10 0x7f54540b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:25.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.382+0000 7f54697fa640 1 -- 172.21.15.53:0/1616591859 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f54640e54f0 con 0x7f546c108a90 2024-08-31T06:03:25.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.383+0000 7f546bfff640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54540b4c10 0x7f54540b7120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f546c1117a0 tx=0x7f545c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:25.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.389+0000 7f54697fa640 1 -- 172.21.15.53:0/1616591859 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f54640abd70 con 0x7f546c108a90 2024-08-31T06:03:25.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.590+0000 7f547228f640 1 -- 172.21.15.53:0/1616591859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f546c111050 con 0x7f546c108a90 2024-08-31T06:03:25.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.590+0000 7f54697fa640 1 -- 172.21.15.53:0/1616591859 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f546c111050 con 0x7f546c108a90 2024-08-31T06:03:25.592 INFO:teuthology.orchestra.run.smithi053.stdout:38654705741 2024-08-31T06:03:25.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.592+0000 7f547228f640 1 -- 172.21.15.53:0/1616591859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54540b4c10 msgr2=0x7f54540b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:25.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.592+0000 7f547228f640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54540b4c10 0x7f54540b7120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f546c1117a0 tx=0x7f545c00b390 comp rx=0 tx=0).stop 2024-08-31T06:03:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.592+0000 7f547228f640 1 -- 172.21.15.53:0/1616591859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c108a90 msgr2=0x7f546c1107d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.592+0000 7f547228f640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c108a90 0x7f546c1107d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5464009fd0 tx=0x7f546400b260 comp rx=0 tx=0).stop 2024-08-31T06:03:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.593+0000 7f547228f640 1 -- 172.21.15.53:0/1616591859 shutdown_connections 2024-08-31T06:03:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.593+0000 7f547228f640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54540b4c10 0x7f54540b7120 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.593+0000 7f547228f640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f546c108a90 0x7f546c1107d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.593+0000 7f547228f640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f546c108140 0x7f546c110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.593+0000 7f547228f640 1 --2- 172.21.15.53:0/1616591859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f546c102800 0x7f546c10fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.593+0000 7f547228f640 1 -- 172.21.15.53:0/1616591859 >> 172.21.15.53:0/1616591859 conn(0x7f546c0794d0 msgr2=0x7f546c104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.593+0000 7f547228f640 1 -- 172.21.15.53:0/1616591859 shutdown_connections 2024-08-31T06:03:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.593+0000 7f547228f640 1 -- 172.21.15.53:0/1616591859 wait complete. 2024-08-31T06:03:25.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:25 smithi153 ceph-mon[22320]: pgmap v275: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:25.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:25 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1947456030' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T06:03:25.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:25 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:03:25.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:25 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2255558689' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T06:03:25.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:25 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1616591859' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T06:03:26.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:25 smithi130 ceph-mon[22266]: pgmap v275: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:26.112 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:25 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1947456030' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T06:03:26.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:25 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:03:26.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:25 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2255558689' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T06:03:26.113 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:25 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1616591859' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T06:03:26.168 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:25 smithi053 ceph-mon[18924]: pgmap v275: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:26.168 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:25 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1947456030' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T06:03:26.168 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:25 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:03:26.168 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:25 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2255558689' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T06:03:26.168 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:25 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1616591859' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T06:03:26.196 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397541 got 210453397543 for osd.8 2024-08-31T06:03:26.196 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:26.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.271+0000 7eff79e69640 1 -- 172.21.15.53:0/834113101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff741046c0 msgr2=0x7eff74104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:26.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.271+0000 7eff79e69640 1 --2- 172.21.15.53:0/834113101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff741046c0 0x7eff74104ad0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7eff64009900 tx=0x7eff6402a410 comp rx=0 tx=0).stop 2024-08-31T06:03:26.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.271+0000 7eff79e69640 1 -- 172.21.15.53:0/834113101 shutdown_connections 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.271+0000 7eff79e69640 1 --2- 172.21.15.53:0/834113101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff7410dc70 0x7eff74110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.271+0000 7eff79e69640 1 --2- 172.21.15.53:0/834113101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff741050f0 0x7eff7410d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.271+0000 7eff79e69640 1 --2- 172.21.15.53:0/834113101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff741046c0 0x7eff74104ad0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.271+0000 7eff79e69640 1 -- 172.21.15.53:0/834113101 >> 172.21.15.53:0/834113101 conn(0x7eff74079510 msgr2=0x7eff74079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.271+0000 7eff79e69640 1 -- 172.21.15.53:0/834113101 shutdown_connections 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.271+0000 7eff79e69640 1 -- 172.21.15.53:0/834113101 wait complete. 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.272+0000 7eff79e69640 1 Processor -- start 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.272+0000 7eff79e69640 1 -- start start 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.272+0000 7eff79e69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff741046c0 0x7eff741025d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.272+0000 7eff79e69640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff741050f0 0x7eff74102b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.272+0000 7eff79e69640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff7410dc70 0x7eff74103050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.272+0000 7eff79e69640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7eff74113730 con 0x7eff741046c0 2024-08-31T06:03:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.272+0000 7eff79e69640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff741135b0 con 0x7eff7410dc70 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.272+0000 7eff79e69640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7eff741138b0 con 0x7eff741050f0 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.272+0000 7eff737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff741046c0 0x7eff741025d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.272+0000 7eff737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff741046c0 0x7eff741025d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51838/0 (socket says 172.21.15.53:51838) 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.272+0000 7eff737fe640 1 -- 172.21.15.53:0/2255558689 learned_addr learned my addr 172.21.15.53:0/2255558689 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff72ffd640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff741050f0 0x7eff74102b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff73fff640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff7410dc70 0x7eff74103050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff737fe640 1 -- 172.21.15.53:0/2255558689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff741050f0 msgr2=0x7eff74102b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff737fe640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff741050f0 0x7eff74102b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff737fe640 1 -- 172.21.15.53:0/2255558689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff7410dc70 msgr2=0x7eff74103050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff737fe640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff7410dc70 0x7eff74103050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff737fe640 1 -- 172.21.15.53:0/2255558689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff741a8480 con 0x7eff741046c0 2024-08-31T06:03:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff737fe640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff741046c0 0x7eff741025d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7eff64009230 tx=0x7eff64004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff70ff9640 1 -- 172.21.15.53:0/2255558689 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6403f030 con 0x7eff741046c0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff70ff9640 1 -- 172.21.15.53:0/2255558689 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff64003a80 con 0x7eff741046c0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff79e69640 1 -- 172.21.15.53:0/2255558689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff741a8710 con 0x7eff741046c0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff70ff9640 1 -- 172.21.15.53:0/2255558689 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64035070 con 0x7eff741046c0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.273+0000 7eff79e69640 1 -- 172.21.15.53:0/2255558689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff741a8bf0 con 0x7eff741046c0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.274+0000 7eff79e69640 1 -- 172.21.15.53:0/2255558689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff7406bf40 con 0x7eff741046c0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.277+0000 7eff70ff9640 1 -- 172.21.15.53:0/2255558689 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7eff64042030 con 0x7eff741046c0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.277+0000 7eff70ff9640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff5c0b4c10 0x7eff5c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.277+0000 7eff72ffd640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff5c0b4c10 0x7eff5c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.277+0000 7eff70ff9640 1 -- 172.21.15.53:0/2255558689 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7eff64105fd0 con 0x7eff741046c0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.278+0000 7eff72ffd640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff5c0b4c10 0x7eff5c0b7120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7eff7410f730 tx=0x7eff6800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.281+0000 7eff70ff9640 1 -- 172.21.15.53:0/2255558689 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7eff640ccea0 con 0x7eff741046c0 2024-08-31T06:03:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.486+0000 7eff79e69640 1 -- 172.21.15.53:0/2255558689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7eff74104ad0 con 0x7eff741046c0 2024-08-31T06:03:26.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.486+0000 7eff70ff9640 1 -- 172.21.15.53:0/2255558689 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7eff74104ad0 con 0x7eff741046c0 2024-08-31T06:03:26.422 INFO:teuthology.orchestra.run.smithi053.stdout:137438953524 2024-08-31T06:03:26.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 -- 172.21.15.53:0/2255558689 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff5c0b4c10 msgr2=0x7eff5c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:26.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff5c0b4c10 0x7eff5c0b7120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7eff7410f730 tx=0x7eff6800b390 comp rx=0 tx=0).stop 2024-08-31T06:03:26.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 -- 172.21.15.53:0/2255558689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff741046c0 msgr2=0x7eff741025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:26.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff741046c0 0x7eff741025d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7eff64009230 tx=0x7eff64004270 comp rx=0 tx=0).stop 2024-08-31T06:03:26.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 -- 172.21.15.53:0/2255558689 shutdown_connections 2024-08-31T06:03:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff5c0b4c10 0x7eff5c0b7120 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff7410dc70 0x7eff74103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff741050f0 0x7eff74102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 --2- 172.21.15.53:0/2255558689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff741046c0 0x7eff741025d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 -- 172.21.15.53:0/2255558689 >> 172.21.15.53:0/2255558689 conn(0x7eff74079510 msgr2=0x7eff740ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 -- 172.21.15.53:0/2255558689 shutdown_connections 2024-08-31T06:03:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:25.490+0000 7eff79e69640 1 -- 172.21.15.53:0/2255558689 wait complete. 2024-08-31T06:03:27.839 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757293 got 163208757296 for osd.6 2024-08-31T06:03:27.839 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:28.050 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:27 smithi053 ceph-mon[18924]: pgmap v276: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:28.050 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.050 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.050 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.050 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:27 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.052+0000 7fa627dbb640 1 -- 172.21.15.53:0/2084646010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa620101d10 msgr2=0x7fa620102120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.052+0000 7fa627dbb640 1 --2- 172.21.15.53:0/2084646010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa620101d10 0x7fa620102120 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009900 tx=0x7fa61c02a410 comp rx=0 tx=0).stop 2024-08-31T06:03:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.052+0000 7fa627dbb640 1 -- 172.21.15.53:0/2084646010 shutdown_connections 2024-08-31T06:03:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.052+0000 7fa627dbb640 1 --2- 172.21.15.53:0/2084646010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa620109ba0 0x7fa6201103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.052+0000 7fa627dbb640 1 --2- 172.21.15.53:0/2084646010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa620109250 0x7fa620109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.052+0000 7fa627dbb640 1 --2- 172.21.15.53:0/2084646010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa620101d10 0x7fa620102120 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.052+0000 7fa627dbb640 1 -- 172.21.15.53:0/2084646010 >> 172.21.15.53:0/2084646010 conn(0x7fa620077a00 msgr2=0x7fa620077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.052+0000 7fa627dbb640 1 -- 172.21.15.53:0/2084646010 shutdown_connections 2024-08-31T06:03:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.052+0000 7fa627dbb640 1 -- 172.21.15.53:0/2084646010 wait complete. 2024-08-31T06:03:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa627dbb640 1 Processor -- start 2024-08-31T06:03:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa627dbb640 1 -- start start 2024-08-31T06:03:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa627dbb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa620101d10 0x7fa620102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa627dbb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa620109250 0x7fa6201031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa627dbb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa620109ba0 0x7fa620103730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:28.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa627dbb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa620113710 con 0x7fa620101d10 2024-08-31T06:03:28.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa627dbb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa620113590 con 0x7fa620109250 2024-08-31T06:03:28.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa627dbb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa620113890 con 0x7fa620109ba0 2024-08-31T06:03:28.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa625b57640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa620101d10 0x7fa620102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:28.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa625b57640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa620101d10 0x7fa620102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51874/0 (socket says 172.21.15.53:51874) 2024-08-31T06:03:28.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa625b57640 1 -- 172.21.15.53:0/1009673692 learned_addr learned my addr 172.21.15.53:0/1009673692 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:28.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa626358640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa620109ba0 0x7fa620103730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:28.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.053+0000 7fa625356640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa620109250 0x7fa6201031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:28.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.054+0000 7fa625b57640 1 -- 172.21.15.53:0/1009673692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa620109ba0 msgr2=0x7fa620103730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:28.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.054+0000 7fa625b57640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa620109ba0 0x7fa620103730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.054+0000 7fa625b57640 1 -- 172.21.15.53:0/1009673692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa620109250 msgr2=0x7fa6201031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:28.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.054+0000 7fa625b57640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa620109250 0x7fa6201031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.054+0000 7fa625b57640 1 -- 172.21.15.53:0/1009673692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6201a8440 con 0x7fa620101d10 2024-08-31T06:03:28.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.054+0000 7fa625b57640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa620101d10 0x7fa620102cb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009230 tx=0x7fa61c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:28.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.054+0000 7fa616ffd640 1 -- 172.21.15.53:0/1009673692 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c03f030 con 0x7fa620101d10 2024-08-31T06:03:28.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.054+0000 7fa627dbb640 1 -- 172.21.15.53:0/1009673692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6201a86d0 con 0x7fa620101d10 2024-08-31T06:03:28.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.054+0000 7fa616ffd640 1 -- 172.21.15.53:0/1009673692 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa61c003a80 con 0x7fa620101d10 2024-08-31T06:03:28.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.054+0000 7fa616ffd640 1 -- 172.21.15.53:0/1009673692 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c035070 con 0x7fa620101d10 2024-08-31T06:03:28.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.054+0000 7fa627dbb640 1 -- 172.21.15.53:0/1009673692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6201a8c00 con 0x7fa620101d10 2024-08-31T06:03:28.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.055+0000 7fa627dbb640 1 -- 172.21.15.53:0/1009673692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa620102120 con 0x7fa620101d10 2024-08-31T06:03:28.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.057+0000 7fa616ffd640 1 -- 172.21.15.53:0/1009673692 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa61c042030 con 0x7fa620101d10 2024-08-31T06:03:28.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.058+0000 7fa616ffd640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa60c0b4c10 0x7fa60c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:28.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.058+0000 7fa625356640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa60c0b4c10 0x7fa60c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:28.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.058+0000 7fa616ffd640 1 -- 172.21.15.53:0/1009673692 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fa61c105fb0 con 0x7fa620101d10 2024-08-31T06:03:28.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.058+0000 7fa625356640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa60c0b4c10 0x7fa60c0b7120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa610005d00 tx=0x7fa610005c50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:28.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.061+0000 7fa616ffd640 1 -- 172.21.15.53:0/1009673692 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa61c0cce80 con 0x7fa620101d10 2024-08-31T06:03:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:27 smithi130 ceph-mon[22266]: pgmap v276: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:27 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:27 smithi153 ceph-mon[22320]: pgmap v276: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:28.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:27 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.255+0000 7fa627dbb640 1 -- 172.21.15.53:0/1009673692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa620103fb0 con 0x7fa620101d10 2024-08-31T06:03:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.256+0000 7fa616ffd640 1 -- 172.21.15.53:0/1009673692 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa620103fb0 con 0x7fa620101d10 2024-08-31T06:03:28.258 INFO:teuthology.orchestra.run.smithi053.stdout:55834574920 2024-08-31T06:03:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.257+0000 7fa627dbb640 1 -- 172.21.15.53:0/1009673692 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa60c0b4c10 msgr2=0x7fa60c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.257+0000 7fa627dbb640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa60c0b4c10 0x7fa60c0b7120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa610005d00 tx=0x7fa610005c50 comp rx=0 tx=0).stop 2024-08-31T06:03:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.258+0000 7fa627dbb640 1 -- 172.21.15.53:0/1009673692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa620101d10 msgr2=0x7fa620102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.258+0000 7fa627dbb640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa620101d10 0x7fa620102cb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009230 tx=0x7fa61c004270 comp rx=0 tx=0).stop 2024-08-31T06:03:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.258+0000 7fa627dbb640 1 -- 172.21.15.53:0/1009673692 shutdown_connections 2024-08-31T06:03:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.258+0000 7fa627dbb640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa60c0b4c10 0x7fa60c0b7120 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.258+0000 7fa627dbb640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa620109ba0 0x7fa620103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.258+0000 7fa627dbb640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa620109250 0x7fa6201031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.258+0000 7fa627dbb640 1 --2- 172.21.15.53:0/1009673692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa620101d10 0x7fa620102cb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.258+0000 7fa627dbb640 1 -- 172.21.15.53:0/1009673692 >> 172.21.15.53:0/1009673692 conn(0x7fa620077a00 msgr2=0x7fa6201073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.258+0000 7fa627dbb640 1 -- 172.21.15.53:0/1009673692 shutdown_connections 2024-08-31T06:03:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.258+0000 7fa627dbb640 1 -- 172.21.15.53:0/1009673692 wait complete. 2024-08-31T06:03:28.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.928+0000 7fb788406640 1 -- 172.21.15.53:0/4282663904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb780103900 msgr2=0x7fb780103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:28.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.928+0000 7fb788406640 1 --2- 172.21.15.53:0/4282663904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb780103900 0x7fb780103d10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009900 tx=0x7fb77c02a410 comp rx=0 tx=0).stop 2024-08-31T06:03:28.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.928+0000 7fb788406640 1 -- 172.21.15.53:0/4282663904 shutdown_connections 2024-08-31T06:03:28.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.928+0000 7fb788406640 1 --2- 172.21.15.53:0/4282663904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb780109b90 0x7fb7801103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.928+0000 7fb788406640 1 --2- 172.21.15.53:0/4282663904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780109240 0x7fb780109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.928+0000 7fb788406640 1 --2- 172.21.15.53:0/4282663904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb780103900 0x7fb780103d10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.928+0000 7fb788406640 1 -- 172.21.15.53:0/4282663904 >> 172.21.15.53:0/4282663904 conn(0x7fb78007b5f0 msgr2=0x7fb78007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:28.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.928+0000 7fb788406640 1 -- 172.21.15.53:0/4282663904 shutdown_connections 2024-08-31T06:03:28.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.928+0000 7fb788406640 1 -- 172.21.15.53:0/4282663904 wait complete. 2024-08-31T06:03:28.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.929+0000 7fb788406640 1 Processor -- start 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.929+0000 7fb788406640 1 -- start start 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.929+0000 7fb788406640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb780103900 0x7fb78019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.929+0000 7fb788406640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb780109240 0x7fb78019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.929+0000 7fb788406640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780109b90 0x7fb78019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.929+0000 7fb788406640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb780113760 con 0x7fb780103900 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.929+0000 7fb788406640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801135e0 con 0x7fb780109b90 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.929+0000 7fb788406640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801138e0 con 0x7fb780109240 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7859a1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb780109240 0x7fb78019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7859a1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb780109240 0x7fb78019a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57912/0 (socket says 172.21.15.53:57912) 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7861a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb780103900 0x7fb78019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7859a1640 1 -- 172.21.15.53:0/4273742159 learned_addr learned my addr 172.21.15.53:0/4273742159 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:28.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7869a3640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780109b90 0x7fb78019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7861a2640 1 -- 172.21.15.53:0/4273742159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb780109240 msgr2=0x7fb78019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7861a2640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb780109240 0x7fb78019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7861a2640 1 -- 172.21.15.53:0/4273742159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780109b90 msgr2=0x7fb78019fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7861a2640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780109b90 0x7fb78019fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7861a2640 1 -- 172.21.15.53:0/4273742159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7801a0140 con 0x7fb780103900 2024-08-31T06:03:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7869a3640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780109b90 0x7fb78019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7861a2640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb780103900 0x7fb78019a1d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb77c005940 tx=0x7fb77c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7777fe640 1 -- 172.21.15.53:0/4273742159 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c03f070 con 0x7fb780103900 2024-08-31T06:03:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7777fe640 1 -- 172.21.15.53:0/4273742159 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb77c003c80 con 0x7fb780103900 2024-08-31T06:03:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb788406640 1 -- 172.21.15.53:0/4273742159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7801a03d0 con 0x7fb780103900 2024-08-31T06:03:28.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb7777fe640 1 -- 172.21.15.53:0/4273742159 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c035070 con 0x7fb780103900 2024-08-31T06:03:28.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.930+0000 7fb788406640 1 -- 172.21.15.53:0/4273742159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7801a6b90 con 0x7fb780103900 2024-08-31T06:03:28.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.931+0000 7fb788406640 1 -- 172.21.15.53:0/4273742159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb780103d10 con 0x7fb780103900 2024-08-31T06:03:28.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.933+0000 7fb7777fe640 1 -- 172.21.15.53:0/4273742159 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fb77c03b460 con 0x7fb780103900 2024-08-31T06:03:28.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.934+0000 7fb7777fe640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb76c0b4c10 0x7fb76c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:28.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.934+0000 7fb7859a1640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb76c0b4c10 0x7fb76c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:28.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.934+0000 7fb7777fe640 1 -- 172.21.15.53:0/4273742159 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fb77c1061d0 con 0x7fb780103900 2024-08-31T06:03:28.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.934+0000 7fb7859a1640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb76c0b4c10 0x7fb76c0b7120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb780106340 tx=0x7fb770009190 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:28.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:28.937+0000 7fb7777fe640 1 -- 172.21.15.53:0/4273742159 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb77c0cd0a0 con 0x7fb780103900 2024-08-31T06:03:29.030 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:28 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1009673692' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T06:03:29.040 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:28 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1009673692' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T06:03:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.123+0000 7fb788406640 1 -- 172.21.15.53:0/4273742159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb78002e430 con 0x7fb780103900 2024-08-31T06:03:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.124+0000 7fb7777fe640 1 -- 172.21.15.53:0/4273742159 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb77c0cc9a0 con 0x7fb780103900 2024-08-31T06:03:29.126 INFO:teuthology.orchestra.run.smithi053.stdout:120259084347 2024-08-31T06:03:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 -- 172.21.15.53:0/4273742159 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb76c0b4c10 msgr2=0x7fb76c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb76c0b4c10 0x7fb76c0b7120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb780106340 tx=0x7fb770009190 comp rx=0 tx=0).stop 2024-08-31T06:03:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 -- 172.21.15.53:0/4273742159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb780103900 msgr2=0x7fb78019a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb780103900 0x7fb78019a1d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb77c005940 tx=0x7fb77c0040e0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 -- 172.21.15.53:0/4273742159 shutdown_connections 2024-08-31T06:03:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb76c0b4c10 0x7fb76c0b7120 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb780109b90 0x7fb78019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb780109240 0x7fb78019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 --2- 172.21.15.53:0/4273742159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb780103900 0x7fb78019a1d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 -- 172.21.15.53:0/4273742159 >> 172.21.15.53:0/4273742159 conn(0x7fb78007b5f0 msgr2=0x7fb780107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 -- 172.21.15.53:0/4273742159 shutdown_connections 2024-08-31T06:03:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.126+0000 7fb788406640 1 -- 172.21.15.53:0/4273742159 wait complete. 2024-08-31T06:03:29.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:28 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1009673692' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T06:03:29.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.583+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/4015987237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc78102820 msgr2=0x7fdc78102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:29.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.583+0000 7fdc7d0e2640 1 --2- 172.21.15.53:0/4015987237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc78102820 0x7fdc78102c30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009ca0 tx=0x7fdc6802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.583+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/4015987237 shutdown_connections 2024-08-31T06:03:29.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.583+0000 7fdc7d0e2640 1 --2- 172.21.15.53:0/4015987237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc78108ab0 0x7fdc7810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.583+0000 7fdc7d0e2640 1 --2- 172.21.15.53:0/4015987237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc78108160 0x7fdc78108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.583+0000 7fdc7d0e2640 1 --2- 172.21.15.53:0/4015987237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc78102820 0x7fdc78102c30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.583+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/4015987237 >> 172.21.15.53:0/4015987237 conn(0x7fdc780794e0 msgr2=0x7fdc780798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:29.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.583+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/4015987237 shutdown_connections 2024-08-31T06:03:29.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.583+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/4015987237 wait complete. 2024-08-31T06:03:29.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.584+0000 7fdc7d0e2640 1 Processor -- start 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.584+0000 7fdc7d0e2640 1 -- start start 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc7d0e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc78102820 0x7fdc7819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc7d0e2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc78108160 0x7fdc7819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc7d0e2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc78108ab0 0x7fdc7819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc7d0e2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdc78112610 con 0x7fdc78102820 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc7d0e2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc78112490 con 0x7fdc78108ab0 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc7d0e2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc78112790 con 0x7fdc78108160 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc76d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc78102820 0x7fdc7819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc76d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc78102820 0x7fdc7819a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51916/0 (socket says 172.21.15.53:51916) 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc76d9d640 1 -- 172.21.15.53:0/3936053465 learned_addr learned my addr 172.21.15.53:0/3936053465 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc7759e640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc78108ab0 0x7fdc7819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc7659c640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc78108160 0x7fdc7819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:29.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc76d9d640 1 -- 172.21.15.53:0/3936053465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc78108160 msgr2=0x7fdc7819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc76d9d640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc78108160 0x7fdc7819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc76d9d640 1 -- 172.21.15.53:0/3936053465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc78108ab0 msgr2=0x7fdc7819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc76d9d640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc78108ab0 0x7fdc7819f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc76d9d640 1 -- 172.21.15.53:0/3936053465 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc781a00c0 con 0x7fdc78102820 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.585+0000 7fdc7759e640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc78108ab0 0x7fdc7819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.586+0000 7fdc76d9d640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc78102820 0x7fdc7819a150 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009dc0 tx=0x7fdc68003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.586+0000 7fdc6ffff640 1 -- 172.21.15.53:0/3936053465 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68032dd0 con 0x7fdc78102820 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.586+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/3936053465 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc781a0350 con 0x7fdc78102820 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.586+0000 7fdc6ffff640 1 -- 172.21.15.53:0/3936053465 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc680044d0 con 0x7fdc78102820 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.586+0000 7fdc6ffff640 1 -- 172.21.15.53:0/3936053465 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68030c50 con 0x7fdc78102820 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.586+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/3936053465 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc781a6b10 con 0x7fdc78102820 2024-08-31T06:03:29.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.587+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/3936053465 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc78103aa0 con 0x7fdc78102820 2024-08-31T06:03:29.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.588+0000 7fdc6ffff640 1 -- 172.21.15.53:0/3936053465 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fdc68004680 con 0x7fdc78102820 2024-08-31T06:03:29.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.589+0000 7fdc6ffff640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc640b4c10 0x7fdc640b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:29.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.589+0000 7fdc7659c640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc640b4c10 0x7fdc640b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:29.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.589+0000 7fdc6ffff640 1 -- 172.21.15.53:0/3936053465 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fdc68106760 con 0x7fdc78102820 2024-08-31T06:03:29.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.590+0000 7fdc7659c640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc640b4c10 0x7fdc640b7120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdc78079ae0 tx=0x7fdc60005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:29.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.592+0000 7fdc6ffff640 1 -- 172.21.15.53:0/3936053465 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdc680cd6c0 con 0x7fdc78102820 2024-08-31T06:03:29.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.781+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/3936053465 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fdc781a6dd0 con 0x7fdc78102820 2024-08-31T06:03:29.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.781+0000 7fdc6ffff640 1 -- 172.21.15.53:0/3936053465 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fdc680ccfc0 con 0x7fdc78102820 2024-08-31T06:03:29.783 INFO:teuthology.orchestra.run.smithi053.stdout:274877906968 2024-08-31T06:03:29.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.783+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/3936053465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc640b4c10 msgr2=0x7fdc640b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:29.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.783+0000 7fdc7d0e2640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc640b4c10 0x7fdc640b7120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdc78079ae0 tx=0x7fdc60005f90 comp rx=0 tx=0).stop 2024-08-31T06:03:29.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.783+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/3936053465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc78102820 msgr2=0x7fdc7819a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:29.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.783+0000 7fdc7d0e2640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc78102820 0x7fdc7819a150 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009dc0 tx=0x7fdc68003f80 comp rx=0 tx=0).stop 2024-08-31T06:03:29.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.783+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/3936053465 shutdown_connections 2024-08-31T06:03:29.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.783+0000 7fdc7d0e2640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc640b4c10 0x7fdc640b7120 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.783+0000 7fdc7d0e2640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc78108ab0 0x7fdc7819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.783+0000 7fdc7d0e2640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc78108160 0x7fdc7819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.783+0000 7fdc7d0e2640 1 --2- 172.21.15.53:0/3936053465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc78102820 0x7fdc7819a150 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:29.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.783+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/3936053465 >> 172.21.15.53:0/3936053465 conn(0x7fdc780794e0 msgr2=0x7fdc78101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:29.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.784+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/3936053465 shutdown_connections 2024-08-31T06:03:29.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:29.784+0000 7fdc7d0e2640 1 -- 172.21.15.53:0/3936053465 wait complete. 2024-08-31T06:03:30.031 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:29 smithi053 ceph-mon[18924]: pgmap v277: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:30.031 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:29 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4273742159' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T06:03:30.061 INFO:tasks.cephadm.ceph_manager.ceph:need seq 120259084343 got 120259084347 for osd.4 2024-08-31T06:03:30.061 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:30.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:29 smithi153 ceph-mon[22320]: pgmap v277: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:30.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:29 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4273742159' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T06:03:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:29 smithi130 ceph-mon[22266]: pgmap v277: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:29 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4273742159' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T06:03:30.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.350+0000 7f271594e640 1 -- 172.21.15.53:0/2537072451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2710103920 msgr2=0x7f2710103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:30.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.350+0000 7f271594e640 1 --2- 172.21.15.53:0/2537072451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2710103920 0x7f2710103d30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2700009900 tx=0x7f270002a410 comp rx=0 tx=0).stop 2024-08-31T06:03:30.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.350+0000 7f271594e640 1 -- 172.21.15.53:0/2537072451 shutdown_connections 2024-08-31T06:03:30.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.350+0000 7f271594e640 1 --2- 172.21.15.53:0/2537072451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2710109bb0 0x7f27101103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:30.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.350+0000 7f271594e640 1 --2- 172.21.15.53:0/2537072451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2710109260 0x7f2710109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.350+0000 7f271594e640 1 --2- 172.21.15.53:0/2537072451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2710103920 0x7f2710103d30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.350+0000 7f271594e640 1 -- 172.21.15.53:0/2537072451 >> 172.21.15.53:0/2537072451 conn(0x7f27100ff330 msgr2=0x7f2710101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.351+0000 7f271594e640 1 -- 172.21.15.53:0/2537072451 shutdown_connections 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.351+0000 7f271594e640 1 -- 172.21.15.53:0/2537072451 wait complete. 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.351+0000 7f271594e640 1 Processor -- start 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.351+0000 7f271594e640 1 -- start start 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f271594e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2710103920 0x7f271019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f271594e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2710109260 0x7f271019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f271594e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2710109bb0 0x7f271019fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f271594e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2710113720 con 0x7f2710109260 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f271594e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27101135a0 con 0x7f2710103920 2024-08-31T06:03:30.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f271594e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f27101138a0 con 0x7f2710109bb0 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f270e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2710109260 0x7f271019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f270e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2710109260 0x7f271019a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51932/0 (socket says 172.21.15.53:51932) 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f270e7fc640 1 -- 172.21.15.53:0/1080574442 learned_addr learned my addr 172.21.15.53:0/1080574442 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f270f7fe640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2710109bb0 0x7f271019fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f270effd640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2710103920 0x7f271019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f270e7fc640 1 -- 172.21.15.53:0/1080574442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2710109bb0 msgr2=0x7f271019fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f270e7fc640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2710109bb0 0x7f271019fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f270e7fc640 1 -- 172.21.15.53:0/1080574442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2710103920 msgr2=0x7f271019a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f270e7fc640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2710103920 0x7f271019a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f270e7fc640 1 -- 172.21.15.53:0/1080574442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27101a01c0 con 0x7f2710109260 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.352+0000 7f270e7fc640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2710109260 0x7f271019a7f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f270400e9c0 tx=0x7f270400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.353+0000 7f271494c640 1 -- 172.21.15.53:0/1080574442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270400ccc0 con 0x7f2710109260 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.353+0000 7f271494c640 1 -- 172.21.15.53:0/1080574442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27040054b0 con 0x7f2710109260 2024-08-31T06:03:30.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.353+0000 7f271494c640 1 -- 172.21.15.53:0/1080574442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2704010430 con 0x7f2710109260 2024-08-31T06:03:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.353+0000 7f271594e640 1 -- 172.21.15.53:0/1080574442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27101a04b0 con 0x7f2710109260 2024-08-31T06:03:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.353+0000 7f271594e640 1 -- 172.21.15.53:0/1080574442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27101a6c10 con 0x7f2710109260 2024-08-31T06:03:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.354+0000 7f271594e640 1 -- 172.21.15.53:0/1080574442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2710103d30 con 0x7f2710109260 2024-08-31T06:03:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.356+0000 7f271494c640 1 -- 172.21.15.53:0/1080574442 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f2704004f00 con 0x7f2710109260 2024-08-31T06:03:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.357+0000 7f271494c640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f26f80b4c90 0x7f26f80b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.357+0000 7f270effd640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f26f80b4c90 0x7f26f80b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.357+0000 7f271494c640 1 -- 172.21.15.53:0/1080574442 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f27040e5730 con 0x7f2710109260 2024-08-31T06:03:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.357+0000 7f270effd640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f26f80b4c90 0x7f26f80b71a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27000057c0 tx=0x7f27000058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:30.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.361+0000 7f271494c640 1 -- 172.21.15.53:0/1080574442 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f27040ac600 con 0x7f2710109260 2024-08-31T06:03:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.548+0000 7f271594e640 1 -- 172.21.15.53:0/1080574442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f271010b3f0 con 0x7f2710109260 2024-08-31T06:03:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.548+0000 7f271494c640 1 -- 172.21.15.53:0/1080574442 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f27040abf00 con 0x7f2710109260 2024-08-31T06:03:30.550 INFO:teuthology.orchestra.run.smithi053.stdout:231928234019 2024-08-31T06:03:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 -- 172.21.15.53:0/1080574442 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f26f80b4c90 msgr2=0x7f26f80b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f26f80b4c90 0x7f26f80b71a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27000057c0 tx=0x7f27000058d0 comp rx=0 tx=0).stop 2024-08-31T06:03:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 -- 172.21.15.53:0/1080574442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2710109260 msgr2=0x7f271019a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2710109260 0x7f271019a7f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f270400e9c0 tx=0x7f270400ee80 comp rx=0 tx=0).stop 2024-08-31T06:03:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 -- 172.21.15.53:0/1080574442 shutdown_connections 2024-08-31T06:03:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f26f80b4c90 0x7f26f80b71a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2710109bb0 0x7f271019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2710109260 0x7f271019a7f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 --2- 172.21.15.53:0/1080574442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2710103920 0x7f271019a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 -- 172.21.15.53:0/1080574442 >> 172.21.15.53:0/1080574442 conn(0x7f27100ff330 msgr2=0x7f2710101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 -- 172.21.15.53:0/1080574442 shutdown_connections 2024-08-31T06:03:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:30.550+0000 7f271594e640 1 -- 172.21.15.53:0/1080574442 wait complete. 2024-08-31T06:03:30.950 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:30 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3936053465' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T06:03:30.950 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:30 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1080574442' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T06:03:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:30 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3936053465' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T06:03:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:30 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1080574442' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T06:03:31.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:30 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3936053465' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T06:03:31.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:30 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1080574442' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T06:03:31.214 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234016 got 231928234019 for osd.9 2024-08-31T06:03:31.214 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:31.856 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:31 smithi053 ceph-mon[18924]: pgmap v278: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:31.888 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906966 got 274877906968 for osd.11 2024-08-31T06:03:31.888 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:31 smithi130 ceph-mon[22266]: pgmap v278: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:31 smithi153 ceph-mon[22320]: pgmap v278: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:03:32.311 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705738 got 38654705741 for osd.0 2024-08-31T06:03:32.312 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:32.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.495+0000 7fd52753a640 1 -- 172.21.15.53:0/3839046125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd520103900 msgr2=0x7fd520103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:32.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.495+0000 7fd52753a640 1 --2- 172.21.15.53:0/3839046125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd520103900 0x7fd520103d10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009900 tx=0x7fd51c02a410 comp rx=0 tx=0).stop 2024-08-31T06:03:32.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.495+0000 7fd52753a640 1 -- 172.21.15.53:0/3839046125 shutdown_connections 2024-08-31T06:03:32.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.495+0000 7fd52753a640 1 --2- 172.21.15.53:0/3839046125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd520109b90 0x7fd5201103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:32.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.495+0000 7fd52753a640 1 --2- 172.21.15.53:0/3839046125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd520109240 0x7fd520109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:32.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.495+0000 7fd52753a640 1 --2- 172.21.15.53:0/3839046125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd520103900 0x7fd520103d10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:32.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.495+0000 7fd52753a640 1 -- 172.21.15.53:0/3839046125 >> 172.21.15.53:0/3839046125 conn(0x7fd52007b5f0 msgr2=0x7fd52007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:32.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.495+0000 7fd52753a640 1 -- 172.21.15.53:0/3839046125 shutdown_connections 2024-08-31T06:03:32.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.495+0000 7fd52753a640 1 -- 172.21.15.53:0/3839046125 wait complete. 2024-08-31T06:03:32.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd52753a640 1 Processor -- start 2024-08-31T06:03:32.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd52753a640 1 -- start start 2024-08-31T06:03:32.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd52753a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd520103900 0x7fd52019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:32.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd52753a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd520109240 0x7fd52019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:32.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd52753a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd520109b90 0x7fd52019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:32.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd52753a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd520113700 con 0x7fd520109b90 2024-08-31T06:03:32.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd52753a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd520113580 con 0x7fd520109240 2024-08-31T06:03:32.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd52753a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd520113880 con 0x7fd520103900 2024-08-31T06:03:32.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd525ad7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd520109b90 0x7fd52019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:32.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd525ad7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd520109b90 0x7fd52019f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51948/0 (socket says 172.21.15.53:51948) 2024-08-31T06:03:32.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd525ad7640 1 -- 172.21.15.53:0/1864314252 learned_addr learned my addr 172.21.15.53:0/1864314252 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:32.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd524ad5640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd520109240 0x7fd52019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:32.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.496+0000 7fd5252d6640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd520103900 0x7fd52019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:32.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.497+0000 7fd525ad7640 1 -- 172.21.15.53:0/1864314252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd520103900 msgr2=0x7fd52019a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:32.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.497+0000 7fd525ad7640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd520103900 0x7fd52019a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:32.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.497+0000 7fd525ad7640 1 -- 172.21.15.53:0/1864314252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd520109240 msgr2=0x7fd52019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:32.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.497+0000 7fd525ad7640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd520109240 0x7fd52019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:32.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.497+0000 7fd525ad7640 1 -- 172.21.15.53:0/1864314252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5201a00e0 con 0x7fd520109b90 2024-08-31T06:03:32.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.497+0000 7fd525ad7640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd520109b90 0x7fd52019f9b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd51800eb10 tx=0x7fd51800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:32.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.497+0000 7fd5167fc640 1 -- 172.21.15.53:0/1864314252 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518004b20 con 0x7fd520109b90 2024-08-31T06:03:32.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.497+0000 7fd5167fc640 1 -- 172.21.15.53:0/1864314252 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd518004cc0 con 0x7fd520109b90 2024-08-31T06:03:32.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.497+0000 7fd52753a640 1 -- 172.21.15.53:0/1864314252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5201a03d0 con 0x7fd520109b90 2024-08-31T06:03:32.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.497+0000 7fd5167fc640 1 -- 172.21.15.53:0/1864314252 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518010690 con 0x7fd520109b90 2024-08-31T06:03:32.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.497+0000 7fd52753a640 1 -- 172.21.15.53:0/1864314252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5201a6b30 con 0x7fd520109b90 2024-08-31T06:03:32.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.498+0000 7fd52753a640 1 -- 172.21.15.53:0/1864314252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd520103d10 con 0x7fd520109b90 2024-08-31T06:03:32.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.500+0000 7fd5167fc640 1 -- 172.21.15.53:0/1864314252 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fd518005020 con 0x7fd520109b90 2024-08-31T06:03:32.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.500+0000 7fd5167fc640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd50c0b4c90 0x7fd50c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:32.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.501+0000 7fd5252d6640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd50c0b4c90 0x7fd50c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:32.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.501+0000 7fd5167fc640 1 -- 172.21.15.53:0/1864314252 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fd5180e5920 con 0x7fd520109b90 2024-08-31T06:03:32.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.501+0000 7fd5252d6640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd50c0b4c90 0x7fd50c0b71a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0057c0 tx=0x7fd51c0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:32.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.505+0000 7fd5167fc640 1 -- 172.21.15.53:0/1864314252 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd5180ac7f0 con 0x7fd520109b90 2024-08-31T06:03:32.550 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:32.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.694+0000 7fd52753a640 1 -- 172.21.15.53:0/1864314252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd52002e430 con 0x7fd520109b90 2024-08-31T06:03:32.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.694+0000 7fd5167fc640 1 -- 172.21.15.53:0/1864314252 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd5180ac0f0 con 0x7fd520109b90 2024-08-31T06:03:32.696 INFO:teuthology.orchestra.run.smithi053.stdout:98784247871 2024-08-31T06:03:32.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 -- 172.21.15.53:0/1864314252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd50c0b4c90 msgr2=0x7fd50c0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:32.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd50c0b4c90 0x7fd50c0b71a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0057c0 tx=0x7fd51c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:03:32.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 -- 172.21.15.53:0/1864314252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd520109b90 msgr2=0x7fd52019f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:32.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd520109b90 0x7fd52019f9b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd51800eb10 tx=0x7fd51800c2d0 comp rx=0 tx=0).stop 2024-08-31T06:03:32.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 -- 172.21.15.53:0/1864314252 shutdown_connections 2024-08-31T06:03:32.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd50c0b4c90 0x7fd50c0b71a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:32.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd520109b90 0x7fd52019f9b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:32.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd520109240 0x7fd52019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:32.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 --2- 172.21.15.53:0/1864314252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd520103900 0x7fd52019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:32.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 -- 172.21.15.53:0/1864314252 >> 172.21.15.53:0/1864314252 conn(0x7fd52007b5f0 msgr2=0x7fd520107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:32.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 -- 172.21.15.53:0/1864314252 shutdown_connections 2024-08-31T06:03:32.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:32.696+0000 7fd52753a640 1 -- 172.21.15.53:0/1864314252 wait complete. 2024-08-31T06:03:32.950 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:32 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1864314252' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T06:03:32.986 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953522 got 137438953524 for osd.5 2024-08-31T06:03:32.986 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:33.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:32 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1864314252' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T06:03:33.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:32 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1864314252' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T06:03:33.364 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574920 for osd.1 2024-08-31T06:03:33.365 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:33.851 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:33 smithi053 ceph-mon[18924]: pgmap v279: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:33.875 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247867 got 98784247871 for osd.3 2024-08-31T06:03:33.875 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:33 smithi130 ceph-mon[22266]: pgmap v279: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:33 smithi153 ceph-mon[22320]: pgmap v279: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:34.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.680+0000 7ff692c77640 1 -- 172.21.15.53:0/2064970069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff68c104750 msgr2=0x7ff68c104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.680+0000 7ff692c77640 1 --2- 172.21.15.53:0/2064970069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff68c104750 0x7ff68c104b60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff67c009900 tx=0x7ff67c02a410 comp rx=0 tx=0).stop 2024-08-31T06:03:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.680+0000 7ff692c77640 1 -- 172.21.15.53:0/2064970069 shutdown_connections 2024-08-31T06:03:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.680+0000 7ff692c77640 1 --2- 172.21.15.53:0/2064970069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff68c10dbb0 0x7ff68c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.680+0000 7ff692c77640 1 --2- 172.21.15.53:0/2064970069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff68c1050a0 0x7ff68c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.680+0000 7ff692c77640 1 --2- 172.21.15.53:0/2064970069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff68c104750 0x7ff68c104b60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.680+0000 7ff692c77640 1 -- 172.21.15.53:0/2064970069 >> 172.21.15.53:0/2064970069 conn(0x7ff68c0794d0 msgr2=0x7ff68c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.680+0000 7ff692c77640 1 -- 172.21.15.53:0/2064970069 shutdown_connections 2024-08-31T06:03:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.680+0000 7ff692c77640 1 -- 172.21.15.53:0/2064970069 wait complete. 2024-08-31T06:03:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.681+0000 7ff692c77640 1 Processor -- start 2024-08-31T06:03:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.681+0000 7ff692c77640 1 -- start start 2024-08-31T06:03:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff692c77640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff68c104750 0x7ff68c102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff692c77640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff68c1050a0 0x7ff68c1029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff692c77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff68c10dbb0 0x7ff68c102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff692c77640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c1136c0 con 0x7ff68c10dbb0 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff692c77640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c113540 con 0x7ff68c1050a0 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff692c77640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c113840 con 0x7ff68c104750 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff691214640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff68c10dbb0 0x7ff68c102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff691214640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff68c10dbb0 0x7ff68c102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46398/0 (socket says 172.21.15.53:46398) 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff691214640 1 -- 172.21.15.53:0/2006634454 learned_addr learned my addr 172.21.15.53:0/2006634454 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff690a13640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff68c104750 0x7ff68c102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff68bfff640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff68c1050a0 0x7ff68c1029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff691214640 1 -- 172.21.15.53:0/2006634454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff68c104750 msgr2=0x7ff68c102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff691214640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff68c104750 0x7ff68c102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff691214640 1 -- 172.21.15.53:0/2006634454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff68c1050a0 msgr2=0x7ff68c1029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff691214640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff68c1050a0 0x7ff68c1029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff691214640 1 -- 172.21.15.53:0/2006634454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68c1a8410 con 0x7ff68c10dbb0 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff691214640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff68c10dbb0 0x7ff68c102f10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff68400eaa0 tx=0x7ff68400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff689ffb640 1 -- 172.21.15.53:0/2006634454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68400cdb0 con 0x7ff68c10dbb0 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff689ffb640 1 -- 172.21.15.53:0/2006634454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff684005020 con 0x7ff68c10dbb0 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff692c77640 1 -- 172.21.15.53:0/2006634454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68c1a8700 con 0x7ff68c10dbb0 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.682+0000 7ff689ffb640 1 -- 172.21.15.53:0/2006634454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6840116d0 con 0x7ff68c10dbb0 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.683+0000 7ff692c77640 1 -- 172.21.15.53:0/2006634454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff68c1a8c10 con 0x7ff68c10dbb0 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.684+0000 7ff692c77640 1 -- 172.21.15.53:0/2006634454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff68c104b60 con 0x7ff68c10dbb0 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.685+0000 7ff689ffb640 1 -- 172.21.15.53:0/2006634454 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7ff6840051d0 con 0x7ff68c10dbb0 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.686+0000 7ff689ffb640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6780b4c90 0x7ff6780b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.686+0000 7ff690a13640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6780b4c90 0x7ff6780b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.686+0000 7ff689ffb640 1 -- 172.21.15.53:0/2006634454 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7ff6840e5850 con 0x7ff68c10dbb0 2024-08-31T06:03:34.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.686+0000 7ff690a13640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6780b4c90 0x7ff6780b71a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff67c004770 tx=0x7ff67c0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:34.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.689+0000 7ff689ffb640 1 -- 172.21.15.53:0/2006634454 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff684016030 con 0x7ff68c10dbb0 2024-08-31T06:03:34.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.877+0000 7ff692c77640 1 -- 172.21.15.53:0/2006634454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff68c103790 con 0x7ff68c10dbb0 2024-08-31T06:03:34.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.877+0000 7ff689ffb640 1 -- 172.21.15.53:0/2006634454 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff6840ac150 con 0x7ff68c10dbb0 2024-08-31T06:03:34.879 INFO:teuthology.orchestra.run.smithi053.stdout:73014444101 2024-08-31T06:03:34.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.879+0000 7ff692c77640 1 -- 172.21.15.53:0/2006634454 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6780b4c90 msgr2=0x7ff6780b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.879+0000 7ff692c77640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6780b4c90 0x7ff6780b71a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff67c004770 tx=0x7ff67c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:03:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.879+0000 7ff692c77640 1 -- 172.21.15.53:0/2006634454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff68c10dbb0 msgr2=0x7ff68c102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.879+0000 7ff692c77640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff68c10dbb0 0x7ff68c102f10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff68400eaa0 tx=0x7ff68400ef60 comp rx=0 tx=0).stop 2024-08-31T06:03:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.879+0000 7ff692c77640 1 -- 172.21.15.53:0/2006634454 shutdown_connections 2024-08-31T06:03:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.879+0000 7ff692c77640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6780b4c90 0x7ff6780b71a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.879+0000 7ff692c77640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff68c10dbb0 0x7ff68c102f10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.879+0000 7ff692c77640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff68c1050a0 0x7ff68c1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.879+0000 7ff692c77640 1 --2- 172.21.15.53:0/2006634454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff68c104750 0x7ff68c102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.880+0000 7ff692c77640 1 -- 172.21.15.53:0/2006634454 >> 172.21.15.53:0/2006634454 conn(0x7ff68c0794d0 msgr2=0x7ff68c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.880+0000 7ff692c77640 1 -- 172.21.15.53:0/2006634454 shutdown_connections 2024-08-31T06:03:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:34.880+0000 7ff692c77640 1 -- 172.21.15.53:0/2006634454 wait complete. 2024-08-31T06:03:35.598 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444098 got 73014444101 for osd.2 2024-08-31T06:03:35.598 DEBUG:teuthology.parallel:result is None 2024-08-31T06:03:35.599 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T06:03:35.599 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:03:35.876 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:35.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:35 smithi053 ceph-mon[18924]: pgmap v280: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:35.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:35 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2006634454' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T06:03:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:35 smithi130 ceph-mon[22266]: pgmap v280: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:35 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2006634454' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T06:03:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:35 smithi153 ceph-mon[22320]: pgmap v280: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:35 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2006634454' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T06:03:36.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.324+0000 7f5ddcdec640 1 -- 172.21.15.53:0/315198738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd8109260 msgr2=0x7f5dd8109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:36.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.324+0000 7f5ddcdec640 1 --2- 172.21.15.53:0/315198738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd8109260 0x7f5dd8109670 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009900 tx=0x7f5dcc02a410 comp rx=0 tx=0).stop 2024-08-31T06:03:36.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.324+0000 7f5ddcdec640 1 -- 172.21.15.53:0/315198738 shutdown_connections 2024-08-31T06:03:36.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.324+0000 7f5ddcdec640 1 --2- 172.21.15.53:0/315198738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5dd8109bb0 0x7f5dd81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:36.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.324+0000 7f5ddcdec640 1 --2- 172.21.15.53:0/315198738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd8109260 0x7f5dd8109670 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:36.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.324+0000 7f5ddcdec640 1 --2- 172.21.15.53:0/315198738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd8103920 0x7f5dd8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:36.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.324+0000 7f5ddcdec640 1 -- 172.21.15.53:0/315198738 >> 172.21.15.53:0/315198738 conn(0x7f5dd80ff3b0 msgr2=0x7f5dd8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:36.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.324+0000 7f5ddcdec640 1 -- 172.21.15.53:0/315198738 shutdown_connections 2024-08-31T06:03:36.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.324+0000 7f5ddcdec640 1 -- 172.21.15.53:0/315198738 wait complete. 2024-08-31T06:03:36.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.325+0000 7f5ddcdec640 1 Processor -- start 2024-08-31T06:03:36.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.325+0000 7f5ddcdec640 1 -- start start 2024-08-31T06:03:36.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.325+0000 7f5ddcdec640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd8103920 0x7f5dd80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.325+0000 7f5ddcdec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd8109260 0x7f5dd80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.325+0000 7f5ddcdec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5dd8109bb0 0x7f5dd8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.325+0000 7f5ddcdec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd8113770 con 0x7f5dd8109260 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.325+0000 7f5ddcdec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd81135f0 con 0x7f5dd8109bb0 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.325+0000 7f5ddcdec640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd81138f0 con 0x7f5dd8103920 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.325+0000 7f5dd5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd8109260 0x7f5dd80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.325+0000 7f5dd5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd8109260 0x7f5dd80759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46410/0 (socket says 172.21.15.53:46410) 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.325+0000 7f5dd5d9b640 1 -- 172.21.15.53:0/866473915 learned_addr learned my addr 172.21.15.53:0/866473915 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5dd659c640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd8103920 0x7f5dd80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5dd6d9d640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5dd8109bb0 0x7f5dd8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5dd5d9b640 1 -- 172.21.15.53:0/866473915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd8103920 msgr2=0x7f5dd80754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5dd5d9b640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd8103920 0x7f5dd80754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5dd5d9b640 1 -- 172.21.15.53:0/866473915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5dd8109bb0 msgr2=0x7f5dd8075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:36.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5dd5d9b640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5dd8109bb0 0x7f5dd8075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:36.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5dd5d9b640 1 -- 172.21.15.53:0/866473915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd81a8440 con 0x7f5dd8109260 2024-08-31T06:03:36.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5dd5d9b640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd8109260 0x7f5dd80759f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc02a930 tx=0x7f5dcc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:36.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5dc77fe640 1 -- 172.21.15.53:0/866473915 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc03f070 con 0x7f5dd8109260 2024-08-31T06:03:36.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5ddcdec640 1 -- 172.21.15.53:0/866473915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd81a86d0 con 0x7f5dd8109260 2024-08-31T06:03:36.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5dc77fe640 1 -- 172.21.15.53:0/866473915 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5dcc003e10 con 0x7f5dd8109260 2024-08-31T06:03:36.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5dc77fe640 1 -- 172.21.15.53:0/866473915 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc035030 con 0x7f5dd8109260 2024-08-31T06:03:36.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.326+0000 7f5ddcdec640 1 -- 172.21.15.53:0/866473915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd81a8c00 con 0x7f5dd8109260 2024-08-31T06:03:36.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.327+0000 7f5ddcdec640 1 -- 172.21.15.53:0/866473915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd8103d30 con 0x7f5dd8109260 2024-08-31T06:03:36.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.329+0000 7f5dc77fe640 1 -- 172.21.15.53:0/866473915 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f5dcc042070 con 0x7f5dd8109260 2024-08-31T06:03:36.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.330+0000 7f5dc77fe640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dc00b4c10 0x7f5dc00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:36.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.330+0000 7f5dd659c640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dc00b4c10 0x7f5dc00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:36.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.330+0000 7f5dc77fe640 1 -- 172.21.15.53:0/866473915 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f5dcc105ff0 con 0x7f5dd8109260 2024-08-31T06:03:36.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.330+0000 7f5dd659c640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dc00b4c10 0x7f5dc00b7120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8005fd0 tx=0x7f5dc8005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:36.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.333+0000 7f5dc77fe640 1 -- 172.21.15.53:0/866473915 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5dcc0ccec0 con 0x7f5dd8109260 2024-08-31T06:03:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.540+0000 7f5ddcdec640 1 -- 172.21.15.53:0/866473915 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5dd810b9b0 con 0x7f5dc00b4c10 2024-08-31T06:03:36.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.545+0000 7f5dc77fe640 1 -- 172.21.15.53:0/866473915 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258731 (secure 0 0 0) 0x7f5dd810b9b0 con 0x7f5dc00b4c10 2024-08-31T06:03:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:03:36.550 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-08-31T06:03:36.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 -- 172.21.15.53:0/866473915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dc00b4c10 msgr2=0x7f5dc00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:36.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dc00b4c10 0x7f5dc00b7120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8005fd0 tx=0x7f5dc8005850 comp rx=0 tx=0).stop 2024-08-31T06:03:36.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 -- 172.21.15.53:0/866473915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd8109260 msgr2=0x7f5dd80759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:36.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd8109260 0x7f5dd80759f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc02a930 tx=0x7f5dcc003c20 comp rx=0 tx=0).stop 2024-08-31T06:03:36.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 -- 172.21.15.53:0/866473915 shutdown_connections 2024-08-31T06:03:36.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dc00b4c10 0x7f5dc00b7120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:36.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5dd8109bb0 0x7f5dd8075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:36.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd8109260 0x7f5dd80759f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:36.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 --2- 172.21.15.53:0/866473915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd8103920 0x7f5dd80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:36.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 -- 172.21.15.53:0/866473915 >> 172.21.15.53:0/866473915 conn(0x7f5dd80ff3b0 msgr2=0x7f5dd81017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:36.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 -- 172.21.15.53:0/866473915 shutdown_connections 2024-08-31T06:03:36.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:36.549+0000 7f5ddcdec640 1 -- 172.21.15.53:0/866473915 wait complete. 2024-08-31T06:03:37.224 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-08-31T06:03:36.352772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657568,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":640,"num_read_kb":421,"num_write":368,"num_write_kb":2286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390020,"kb_used_data":11580,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551804,"statfs":{"total":1151940427776,"available":1151541047296,"internally_reserved":0,"allocated":11857920,"data_stored":6729456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003457"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768294+0000","last_change":"2024-08-31T06:02:30.611733+0000","last_active":"2024-08-31T06:03:15.768294+0000","last_peered":"2024-08-31T06:03:15.768294+0000","last_clean":"2024-08-31T06:03:15.768294+0000","last_became_active":"2024-08-31T06:02:30.610339+0000","last_became_peered":"2024-08-31T06:02:30.610339+0000","last_unstale":"2024-08-31T06:03:15.768294+0000","last_undegraded":"2024-08-31T06:03:15.768294+0000","last_fullsized":"2024-08-31T06:03:15.768294+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:20.628524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767803+0000","last_change":"2024-08-31T06:02:30.604550+0000","last_active":"2024-08-31T06:03:15.767803+0000","last_peered":"2024-08-31T06:03:15.767803+0000","last_clean":"2024-08-31T06:03:15.767803+0000","last_became_active":"2024-08-31T06:02:30.604200+0000","last_became_peered":"2024-08-31T06:02:30.604200+0000","last_unstale":"2024-08-31T06:03:15.767803+0000","last_undegraded":"2024-08-31T06:03:15.767803+0000","last_fullsized":"2024-08-31T06:03:15.767803+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:31.191972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768552+0000","last_change":"2024-08-31T06:02:30.606102+0000","last_active":"2024-08-31T06:03:15.768552+0000","last_peered":"2024-08-31T06:03:15.768552+0000","last_clean":"2024-08-31T06:03:15.768552+0000","last_became_active":"2024-08-31T06:02:30.605738+0000","last_became_peered":"2024-08-31T06:02:30.605738+0000","last_unstale":"2024-08-31T06:03:15.768552+0000","last_undegraded":"2024-08-31T06:03:15.768552+0000","last_fullsized":"2024-08-31T06:03:15.768552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:50:34.993218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.766002+0000","last_change":"2024-08-31T06:02:30.603207+0000","last_active":"2024-08-31T06:03:15.766002+0000","last_peered":"2024-08-31T06:03:15.766002+0000","last_clean":"2024-08-31T06:03:15.766002+0000","last_became_active":"2024-08-31T06:02:30.602829+0000","last_became_peered":"2024-08-31T06:02:30.602829+0000","last_unstale":"2024-08-31T06:03:15.766002+0000","last_undegraded":"2024-08-31T06:03:15.766002+0000","last_fullsized":"2024-08-31T06:03:15.766002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:02.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764265+0000","last_change":"2024-08-31T06:02:30.590760+0000","last_active":"2024-08-31T06:03:15.764265+0000","last_peered":"2024-08-31T06:03:15.764265+0000","last_clean":"2024-08-31T06:03:15.764265+0000","last_became_active":"2024-08-31T06:02:30.590198+0000","last_became_peered":"2024-08-31T06:02:30.590198+0000","last_unstale":"2024-08-31T06:03:15.764265+0000","last_undegraded":"2024-08-31T06:03:15.764265+0000","last_fullsized":"2024-08-31T06:03:15.764265+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:50.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:16.212000+0000","last_change":"2024-08-31T06:02:30.599924+0000","last_active":"2024-08-31T06:03:16.212000+0000","last_peered":"2024-08-31T06:03:16.212000+0000","last_clean":"2024-08-31T06:03:16.212000+0000","last_became_active":"2024-08-31T06:02:30.599566+0000","last_became_peered":"2024-08-31T06:02:30.599566+0000","last_unstale":"2024-08-31T06:03:16.212000+0000","last_undegraded":"2024-08-31T06:03:16.212000+0000","last_fullsized":"2024-08-31T06:03:16.212000+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:58.265673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.771642+0000","last_change":"2024-08-31T06:03:15.771521+0000","last_active":"2024-08-31T06:03:15.771642+0000","last_peered":"2024-08-31T06:03:15.771642+0000","last_clean":"2024-08-31T06:03:15.771642+0000","last_became_active":"2024-08-31T06:03:15.770969+0000","last_became_peered":"2024-08-31T06:03:15.770969+0000","last_unstale":"2024-08-31T06:03:15.771642+0000","last_undegraded":"2024-08-31T06:03:15.771642+0000","last_fullsized":"2024-08-31T06:03:15.771642+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:31.724213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.972972+0000","last_change":"2024-08-31T06:02:30.610057+0000","last_active":"2024-08-31T06:03:15.972972+0000","last_peered":"2024-08-31T06:03:15.972972+0000","last_clean":"2024-08-31T06:03:15.972972+0000","last_became_active":"2024-08-31T06:02:30.609654+0000","last_became_peered":"2024-08-31T06:02:30.609654+0000","last_unstale":"2024-08-31T06:03:15.972972+0000","last_undegraded":"2024-08-31T06:03:15.972972+0000","last_fullsized":"2024-08-31T06:03:15.972972+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:32:14.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770751+0000","last_change":"2024-08-31T06:02:30.606437+0000","last_active":"2024-08-31T06:03:15.770751+0000","last_peered":"2024-08-31T06:03:15.770751+0000","last_clean":"2024-08-31T06:03:15.770751+0000","last_became_active":"2024-08-31T06:02:30.605632+0000","last_became_peered":"2024-08-31T06:02:30.605632+0000","last_unstale":"2024-08-31T06:03:15.770751+0000","last_undegraded":"2024-08-31T06:03:15.770751+0000","last_fullsized":"2024-08-31T06:03:15.770751+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:47.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:16.212432+0000","last_change":"2024-08-31T06:02:30.605456+0000","last_active":"2024-08-31T06:03:16.212432+0000","last_peered":"2024-08-31T06:03:16.212432+0000","last_clean":"2024-08-31T06:03:16.212432+0000","last_became_active":"2024-08-31T06:02:30.604927+0000","last_became_peered":"2024-08-31T06:02:30.604927+0000","last_unstale":"2024-08-31T06:03:16.212432+0000","last_undegraded":"2024-08-31T06:03:16.212432+0000","last_fullsized":"2024-08-31T06:03:16.212432+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:30.340609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767283+0000","last_change":"2024-08-31T06:02:30.608595+0000","last_active":"2024-08-31T06:03:15.767283+0000","last_peered":"2024-08-31T06:03:15.767283+0000","last_clean":"2024-08-31T06:03:15.767283+0000","last_became_active":"2024-08-31T06:02:30.607695+0000","last_became_peered":"2024-08-31T06:02:30.607695+0000","last_unstale":"2024-08-31T06:03:15.767283+0000","last_undegraded":"2024-08-31T06:03:15.767283+0000","last_fullsized":"2024-08-31T06:03:15.767283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:44:53.655598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765767+0000","last_change":"2024-08-31T06:02:30.595775+0000","last_active":"2024-08-31T06:03:15.765767+0000","last_peered":"2024-08-31T06:03:15.765767+0000","last_clean":"2024-08-31T06:03:15.765767+0000","last_became_active":"2024-08-31T06:02:30.595424+0000","last_became_peered":"2024-08-31T06:02:30.595424+0000","last_unstale":"2024-08-31T06:03:15.765767+0000","last_undegraded":"2024-08-31T06:03:15.765767+0000","last_fullsized":"2024-08-31T06:03:15.765767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:56.382633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768846+0000","last_change":"2024-08-31T06:02:30.603465+0000","last_active":"2024-08-31T06:03:15.768846+0000","last_peered":"2024-08-31T06:03:15.768846+0000","last_clean":"2024-08-31T06:03:15.768846+0000","last_became_active":"2024-08-31T06:02:30.603041+0000","last_became_peered":"2024-08-31T06:02:30.603041+0000","last_unstale":"2024-08-31T06:03:15.768846+0000","last_undegraded":"2024-08-31T06:03:15.768846+0000","last_fullsized":"2024-08-31T06:03:15.768846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:19:00.139973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768033+0000","last_change":"2024-08-31T06:02:30.593807+0000","last_active":"2024-08-31T06:03:15.768033+0000","last_peered":"2024-08-31T06:03:15.768033+0000","last_clean":"2024-08-31T06:03:15.768033+0000","last_became_active":"2024-08-31T06:02:30.593389+0000","last_became_peered":"2024-08-31T06:02:30.593389+0000","last_unstale":"2024-08-31T06:03:15.768033+0000","last_undegraded":"2024-08-31T06:03:15.768033+0000","last_fullsized":"2024-08-31T06:03:15.768033+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:01:04.398867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768036+0000","last_change":"2024-08-31T06:02:30.605207+0000","last_active":"2024-08-31T06:03:15.768036+0000","last_peered":"2024-08-31T06:03:15.768036+0000","last_clean":"2024-08-31T06:03:15.768036+0000","last_became_active":"2024-08-31T06:02:30.604866+0000","last_became_peered":"2024-08-31T06:02:30.604866+0000","last_unstale":"2024-08-31T06:03:15.768036+0000","last_undegraded":"2024-08-31T06:03:15.768036+0000","last_fullsized":"2024-08-31T06:03:15.768036+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:56.305638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.771878+0000","last_change":"2024-08-31T06:02:30.601457+0000","last_active":"2024-08-31T06:03:15.771878+0000","last_peered":"2024-08-31T06:03:15.771878+0000","last_clean":"2024-08-31T06:03:15.771878+0000","last_became_active":"2024-08-31T06:02:30.601077+0000","last_became_peered":"2024-08-31T06:02:30.601077+0000","last_unstale":"2024-08-31T06:03:15.771878+0000","last_undegraded":"2024-08-31T06:03:15.771878+0000","last_fullsized":"2024-08-31T06:03:15.771878+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:51:42.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768395+0000","last_change":"2024-08-31T06:02:30.612475+0000","last_active":"2024-08-31T06:03:15.768395+0000","last_peered":"2024-08-31T06:03:15.768395+0000","last_clean":"2024-08-31T06:03:15.768395+0000","last_became_active":"2024-08-31T06:02:30.612088+0000","last_became_peered":"2024-08-31T06:02:30.612088+0000","last_unstale":"2024-08-31T06:03:15.768395+0000","last_undegraded":"2024-08-31T06:03:15.768395+0000","last_fullsized":"2024-08-31T06:03:15.768395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:34.348645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767288+0000","last_change":"2024-08-31T06:02:30.605612+0000","last_active":"2024-08-31T06:03:15.767288+0000","last_peered":"2024-08-31T06:03:15.767288+0000","last_clean":"2024-08-31T06:03:15.767288+0000","last_became_active":"2024-08-31T06:02:30.605271+0000","last_became_peered":"2024-08-31T06:02:30.605271+0000","last_unstale":"2024-08-31T06:03:15.767288+0000","last_undegraded":"2024-08-31T06:03:15.767288+0000","last_fullsized":"2024-08-31T06:03:15.767288+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:38.003500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.774707+0000","last_change":"2024-08-31T06:02:30.610328+0000","last_active":"2024-08-31T06:03:15.774707+0000","last_peered":"2024-08-31T06:03:15.774707+0000","last_clean":"2024-08-31T06:03:15.774707+0000","last_became_active":"2024-08-31T06:02:30.609935+0000","last_became_peered":"2024-08-31T06:02:30.609935+0000","last_unstale":"2024-08-31T06:03:15.774707+0000","last_undegraded":"2024-08-31T06:03:15.774707+0000","last_fullsized":"2024-08-31T06:03:15.774707+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:22.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.766951+0000","last_change":"2024-08-31T06:02:30.609207+0000","last_active":"2024-08-31T06:03:15.766951+0000","last_peered":"2024-08-31T06:03:15.766951+0000","last_clean":"2024-08-31T06:03:15.766951+0000","last_became_active":"2024-08-31T06:02:30.608635+0000","last_became_peered":"2024-08-31T06:02:30.608635+0000","last_unstale":"2024-08-31T06:03:15.766951+0000","last_undegraded":"2024-08-31T06:03:15.766951+0000","last_fullsized":"2024-08-31T06:03:15.766951+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:43.898073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768850+0000","last_change":"2024-08-31T06:02:30.595829+0000","last_active":"2024-08-31T06:03:15.768850+0000","last_peered":"2024-08-31T06:03:15.768850+0000","last_clean":"2024-08-31T06:03:15.768850+0000","last_became_active":"2024-08-31T06:02:30.595427+0000","last_became_peered":"2024-08-31T06:02:30.595427+0000","last_unstale":"2024-08-31T06:03:15.768850+0000","last_undegraded":"2024-08-31T06:03:15.768850+0000","last_fullsized":"2024-08-31T06:03:15.768850+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:09:39.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770261+0000","last_change":"2024-08-31T06:02:30.599513+0000","last_active":"2024-08-31T06:03:15.770261+0000","last_peered":"2024-08-31T06:03:15.770261+0000","last_clean":"2024-08-31T06:03:15.770261+0000","last_became_active":"2024-08-31T06:02:30.599195+0000","last_became_peered":"2024-08-31T06:02:30.599195+0000","last_unstale":"2024-08-31T06:03:15.770261+0000","last_undegraded":"2024-08-31T06:03:15.770261+0000","last_fullsized":"2024-08-31T06:03:15.770261+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:26.669658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973039+0000","last_change":"2024-08-31T06:02:30.609229+0000","last_active":"2024-08-31T06:03:15.973039+0000","last_peered":"2024-08-31T06:03:15.973039+0000","last_clean":"2024-08-31T06:03:15.973039+0000","last_became_active":"2024-08-31T06:02:30.608536+0000","last_became_peered":"2024-08-31T06:02:30.608536+0000","last_unstale":"2024-08-31T06:03:15.973039+0000","last_undegraded":"2024-08-31T06:03:15.973039+0000","last_fullsized":"2024-08-31T06:03:15.973039+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:08.917901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765060+0000","last_change":"2024-08-31T06:02:30.603663+0000","last_active":"2024-08-31T06:03:15.765060+0000","last_peered":"2024-08-31T06:03:15.765060+0000","last_clean":"2024-08-31T06:03:15.765060+0000","last_became_active":"2024-08-31T06:02:30.603220+0000","last_became_peered":"2024-08-31T06:02:30.603220+0000","last_unstale":"2024-08-31T06:03:15.765060+0000","last_undegraded":"2024-08-31T06:03:15.765060+0000","last_fullsized":"2024-08-31T06:03:15.765060+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:09.433078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973618+0000","last_change":"2024-08-31T06:02:30.608474+0000","last_active":"2024-08-31T06:03:15.973618+0000","last_peered":"2024-08-31T06:03:15.973618+0000","last_clean":"2024-08-31T06:03:15.973618+0000","last_became_active":"2024-08-31T06:02:30.608118+0000","last_became_peered":"2024-08-31T06:02:30.608118+0000","last_unstale":"2024-08-31T06:03:15.973618+0000","last_undegraded":"2024-08-31T06:03:15.973618+0000","last_fullsized":"2024-08-31T06:03:15.973618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:55.124001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.774854+0000","last_change":"2024-08-31T06:02:30.614255+0000","last_active":"2024-08-31T06:03:15.774854+0000","last_peered":"2024-08-31T06:03:15.774854+0000","last_clean":"2024-08-31T06:03:15.774854+0000","last_became_active":"2024-08-31T06:02:30.613805+0000","last_became_peered":"2024-08-31T06:02:30.613805+0000","last_unstale":"2024-08-31T06:03:15.774854+0000","last_undegraded":"2024-08-31T06:03:15.774854+0000","last_fullsized":"2024-08-31T06:03:15.774854+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.892997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767249+0000","last_change":"2024-08-31T06:02:30.609877+0000","last_active":"2024-08-31T06:03:15.767249+0000","last_peered":"2024-08-31T06:03:15.767249+0000","last_clean":"2024-08-31T06:03:15.767249+0000","last_became_active":"2024-08-31T06:02:30.608805+0000","last_became_peered":"2024-08-31T06:02:30.608805+0000","last_unstale":"2024-08-31T06:03:15.767249+0000","last_undegraded":"2024-08-31T06:03:15.767249+0000","last_fullsized":"2024-08-31T06:03:15.767249+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:52.172745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768216+0000","last_change":"2024-08-31T06:02:30.594684+0000","last_active":"2024-08-31T06:03:15.768216+0000","last_peered":"2024-08-31T06:03:15.768216+0000","last_clean":"2024-08-31T06:03:15.768216+0000","last_became_active":"2024-08-31T06:02:30.594293+0000","last_became_peered":"2024-08-31T06:02:30.594293+0000","last_unstale":"2024-08-31T06:03:15.768216+0000","last_undegraded":"2024-08-31T06:03:15.768216+0000","last_fullsized":"2024-08-31T06:03:15.768216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:58:39.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768259+0000","last_change":"2024-08-31T06:02:30.602765+0000","last_active":"2024-08-31T06:03:15.768259+0000","last_peered":"2024-08-31T06:03:15.768259+0000","last_clean":"2024-08-31T06:03:15.768259+0000","last_became_active":"2024-08-31T06:02:30.602410+0000","last_became_peered":"2024-08-31T06:02:30.602410+0000","last_unstale":"2024-08-31T06:03:15.768259+0000","last_undegraded":"2024-08-31T06:03:15.768259+0000","last_fullsized":"2024-08-31T06:03:15.768259+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:12.370967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.774287+0000","last_change":"2024-08-31T06:02:30.611818+0000","last_active":"2024-08-31T06:03:15.774287+0000","last_peered":"2024-08-31T06:03:15.774287+0000","last_clean":"2024-08-31T06:03:15.774287+0000","last_became_active":"2024-08-31T06:02:30.610917+0000","last_became_peered":"2024-08-31T06:02:30.610917+0000","last_unstale":"2024-08-31T06:03:15.774287+0000","last_undegraded":"2024-08-31T06:03:15.774287+0000","last_fullsized":"2024-08-31T06:03:15.774287+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:00.895825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.773887+0000","last_change":"2024-08-31T06:02:30.612186+0000","last_active":"2024-08-31T06:03:15.773887+0000","last_peered":"2024-08-31T06:03:15.773887+0000","last_clean":"2024-08-31T06:03:15.773887+0000","last_became_active":"2024-08-31T06:02:30.610496+0000","last_became_peered":"2024-08-31T06:02:30.610496+0000","last_unstale":"2024-08-31T06:03:15.773887+0000","last_undegraded":"2024-08-31T06:03:15.773887+0000","last_fullsized":"2024-08-31T06:03:15.773887+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:48:19.954998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.776622+0000","last_change":"2024-08-31T06:03:15.776507+0000","last_active":"2024-08-31T06:03:15.776622+0000","last_peered":"2024-08-31T06:03:15.776622+0000","last_clean":"2024-08-31T06:03:15.776622+0000","last_became_active":"2024-08-31T06:03:15.776039+0000","last_became_peered":"2024-08-31T06:03:15.776039+0000","last_unstale":"2024-08-31T06:03:15.776622+0000","last_undegraded":"2024-08-31T06:03:15.776622+0000","last_fullsized":"2024-08-31T06:03:15.776622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:41.616112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764418+0000","last_change":"2024-08-31T06:02:30.607864+0000","last_active":"2024-08-31T06:03:15.764418+0000","last_peered":"2024-08-31T06:03:15.764418+0000","last_clean":"2024-08-31T06:03:15.764418+0000","last_became_active":"2024-08-31T06:02:30.607299+0000","last_became_peered":"2024-08-31T06:02:30.607299+0000","last_unstale":"2024-08-31T06:03:15.764418+0000","last_undegraded":"2024-08-31T06:03:15.764418+0000","last_fullsized":"2024-08-31T06:03:15.764418+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:19.302279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"70'6","reported_seq":85,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:33.759558+0000","last_change":"2024-08-31T06:02:28.594973+0000","last_active":"2024-08-31T06:03:33.759558+0000","last_peered":"2024-08-31T06:03:33.759558+0000","last_clean":"2024-08-31T06:03:33.759558+0000","last_became_active":"2024-08-31T06:02:28.594588+0000","last_became_peered":"2024-08-31T06:02:28.594588+0000","last_unstale":"2024-08-31T06:03:33.759558+0000","last_undegraded":"2024-08-31T06:03:33.759558+0000","last_fullsized":"2024-08-31T06:03:33.759558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:29:48.016888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.974618+0000","last_change":"2024-08-31T06:03:15.974504+0000","last_active":"2024-08-31T06:03:15.974618+0000","last_peered":"2024-08-31T06:03:15.974618+0000","last_clean":"2024-08-31T06:03:15.974618+0000","last_became_active":"2024-08-31T06:03:15.974139+0000","last_became_peered":"2024-08-31T06:03:15.974139+0000","last_unstale":"2024-08-31T06:03:15.974618+0000","last_undegraded":"2024-08-31T06:03:15.974618+0000","last_fullsized":"2024-08-31T06:03:15.974618+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:22.742884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"70'7","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:16.212054+0000","last_change":"2024-08-31T06:02:28.589152+0000","last_active":"2024-08-31T06:03:16.212054+0000","last_peered":"2024-08-31T06:03:16.212054+0000","last_clean":"2024-08-31T06:03:16.212054+0000","last_became_active":"2024-08-31T06:02:28.588758+0000","last_became_peered":"2024-08-31T06:02:28.588758+0000","last_unstale":"2024-08-31T06:03:16.212054+0000","last_undegraded":"2024-08-31T06:03:16.212054+0000","last_fullsized":"2024-08-31T06:03:16.212054+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:31.814105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"70'3","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767905+0000","last_change":"2024-08-31T06:02:28.585410+0000","last_active":"2024-08-31T06:03:15.767905+0000","last_peered":"2024-08-31T06:03:15.767905+0000","last_clean":"2024-08-31T06:03:15.767905+0000","last_became_active":"2024-08-31T06:02:28.584998+0000","last_became_peered":"2024-08-31T06:02:28.584998+0000","last_unstale":"2024-08-31T06:03:15.767905+0000","last_undegraded":"2024-08-31T06:03:15.767905+0000","last_fullsized":"2024-08-31T06:03:15.767905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:30.705460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973054+0000","last_change":"2024-08-31T06:02:30.597295+0000","last_active":"2024-08-31T06:03:15.973054+0000","last_peered":"2024-08-31T06:03:15.973054+0000","last_clean":"2024-08-31T06:03:15.973054+0000","last_became_active":"2024-08-31T06:02:30.596968+0000","last_became_peered":"2024-08-31T06:02:30.596968+0000","last_unstale":"2024-08-31T06:03:15.973054+0000","last_undegraded":"2024-08-31T06:03:15.973054+0000","last_fullsized":"2024-08-31T06:03:15.973054+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:38.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"70'3","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765366+0000","last_change":"2024-08-31T06:02:28.594164+0000","last_active":"2024-08-31T06:03:15.765366+0000","last_peered":"2024-08-31T06:03:15.765366+0000","last_clean":"2024-08-31T06:03:15.765366+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:03:15.765366+0000","last_undegraded":"2024-08-31T06:03:15.765366+0000","last_fullsized":"2024-08-31T06:03:15.765366+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:21.780202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.766868+0000","last_change":"2024-08-31T06:02:30.597500+0000","last_active":"2024-08-31T06:03:15.766868+0000","last_peered":"2024-08-31T06:03:15.766868+0000","last_clean":"2024-08-31T06:03:15.766868+0000","last_became_active":"2024-08-31T06:02:30.597147+0000","last_became_peered":"2024-08-31T06:02:30.597147+0000","last_unstale":"2024-08-31T06:03:15.766868+0000","last_undegraded":"2024-08-31T06:03:15.766868+0000","last_fullsized":"2024-08-31T06:03:15.766868+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:34.111288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"70'4","reported_seq":129,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:32.756972+0000","last_change":"2024-08-31T06:02:28.585769+0000","last_active":"2024-08-31T06:03:32.756972+0000","last_peered":"2024-08-31T06:03:32.756972+0000","last_clean":"2024-08-31T06:03:32.756972+0000","last_became_active":"2024-08-31T06:02:28.585310+0000","last_became_peered":"2024-08-31T06:02:28.585310+0000","last_unstale":"2024-08-31T06:03:32.756972+0000","last_undegraded":"2024-08-31T06:03:32.756972+0000","last_fullsized":"2024-08-31T06:03:32.756972+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:40.595986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770539+0000","last_change":"2024-08-31T06:02:30.601434+0000","last_active":"2024-08-31T06:03:15.770539+0000","last_peered":"2024-08-31T06:03:15.770539+0000","last_clean":"2024-08-31T06:03:15.770539+0000","last_became_active":"2024-08-31T06:02:30.601060+0000","last_became_peered":"2024-08-31T06:02:30.601060+0000","last_unstale":"2024-08-31T06:03:15.770539+0000","last_undegraded":"2024-08-31T06:03:15.770539+0000","last_fullsized":"2024-08-31T06:03:15.770539+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:32.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"70'4","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767511+0000","last_change":"2024-08-31T06:02:28.593217+0000","last_active":"2024-08-31T06:03:15.767511+0000","last_peered":"2024-08-31T06:03:15.767511+0000","last_clean":"2024-08-31T06:03:15.767511+0000","last_became_active":"2024-08-31T06:02:28.592801+0000","last_became_peered":"2024-08-31T06:02:28.592801+0000","last_unstale":"2024-08-31T06:03:15.767511+0000","last_undegraded":"2024-08-31T06:03:15.767511+0000","last_fullsized":"2024-08-31T06:03:15.767511+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:21.561089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770905+0000","last_change":"2024-08-31T06:03:15.770625+0000","last_active":"2024-08-31T06:03:15.770905+0000","last_peered":"2024-08-31T06:03:15.770905+0000","last_clean":"2024-08-31T06:03:15.770905+0000","last_became_active":"2024-08-31T06:03:15.770194+0000","last_became_peered":"2024-08-31T06:03:15.770194+0000","last_unstale":"2024-08-31T06:03:15.770905+0000","last_undegraded":"2024-08-31T06:03:15.770905+0000","last_fullsized":"2024-08-31T06:03:15.770905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:33:57.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"70'5","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765567+0000","last_change":"2024-08-31T06:02:28.781606+0000","last_active":"2024-08-31T06:03:15.765567+0000","last_peered":"2024-08-31T06:03:15.765567+0000","last_clean":"2024-08-31T06:03:15.765567+0000","last_became_active":"2024-08-31T06:02:28.780886+0000","last_became_peered":"2024-08-31T06:02:28.780886+0000","last_unstale":"2024-08-31T06:03:15.765567+0000","last_undegraded":"2024-08-31T06:03:15.765567+0000","last_fullsized":"2024-08-31T06:03:15.765567+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:07.540461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770268+0000","last_change":"2024-08-31T06:02:30.604358+0000","last_active":"2024-08-31T06:03:15.770268+0000","last_peered":"2024-08-31T06:03:15.770268+0000","last_clean":"2024-08-31T06:03:15.770268+0000","last_became_active":"2024-08-31T06:02:30.603980+0000","last_became_peered":"2024-08-31T06:02:30.603980+0000","last_unstale":"2024-08-31T06:03:15.770268+0000","last_undegraded":"2024-08-31T06:03:15.770268+0000","last_fullsized":"2024-08-31T06:03:15.770268+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:43:03.062141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"70'30","reported_seq":164,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:32.757036+0000","last_change":"2024-08-31T06:02:28.590795+0000","last_active":"2024-08-31T06:03:32.757036+0000","last_peered":"2024-08-31T06:03:32.757036+0000","last_clean":"2024-08-31T06:03:32.757036+0000","last_became_active":"2024-08-31T06:02:28.590397+0000","last_became_peered":"2024-08-31T06:02:28.590397+0000","last_unstale":"2024-08-31T06:03:32.757036+0000","last_undegraded":"2024-08-31T06:03:32.757036+0000","last_fullsized":"2024-08-31T06:03:32.757036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:30.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":113,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764664+0000","last_change":"2024-08-31T06:02:30.603110+0000","last_active":"2024-08-31T06:03:15.764664+0000","last_peered":"2024-08-31T06:03:15.764664+0000","last_clean":"2024-08-31T06:03:15.764664+0000","last_became_active":"2024-08-31T06:02:30.602691+0000","last_became_peered":"2024-08-31T06:02:30.602691+0000","last_unstale":"2024-08-31T06:03:15.764664+0000","last_undegraded":"2024-08-31T06:03:15.764664+0000","last_fullsized":"2024-08-31T06:03:15.764664+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:20.009202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"70'9","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.774108+0000","last_change":"2024-08-31T06:02:28.591126+0000","last_active":"2024-08-31T06:03:15.774108+0000","last_peered":"2024-08-31T06:03:15.774108+0000","last_clean":"2024-08-31T06:03:15.774108+0000","last_became_active":"2024-08-31T06:02:28.590744+0000","last_became_peered":"2024-08-31T06:02:28.590744+0000","last_unstale":"2024-08-31T06:03:15.774108+0000","last_undegraded":"2024-08-31T06:03:15.774108+0000","last_fullsized":"2024-08-31T06:03:15.774108+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:43.910807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767860+0000","last_change":"2024-08-31T06:02:30.599843+0000","last_active":"2024-08-31T06:03:15.767860+0000","last_peered":"2024-08-31T06:03:15.767860+0000","last_clean":"2024-08-31T06:03:15.767860+0000","last_became_active":"2024-08-31T06:02:30.599440+0000","last_became_peered":"2024-08-31T06:02:30.599440+0000","last_unstale":"2024-08-31T06:03:15.767860+0000","last_undegraded":"2024-08-31T06:03:15.767860+0000","last_fullsized":"2024-08-31T06:03:15.767860+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:01.029482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"70'5","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765542+0000","last_change":"2024-08-31T06:02:28.594178+0000","last_active":"2024-08-31T06:03:15.765542+0000","last_peered":"2024-08-31T06:03:15.765542+0000","last_clean":"2024-08-31T06:03:15.765542+0000","last_became_active":"2024-08-31T06:02:28.593802+0000","last_became_peered":"2024-08-31T06:02:28.593802+0000","last_unstale":"2024-08-31T06:03:15.765542+0000","last_undegraded":"2024-08-31T06:03:15.765542+0000","last_fullsized":"2024-08-31T06:03:15.765542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:52.561582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767046+0000","last_change":"2024-08-31T06:02:30.595979+0000","last_active":"2024-08-31T06:03:15.767046+0000","last_peered":"2024-08-31T06:03:15.767046+0000","last_clean":"2024-08-31T06:03:15.767046+0000","last_became_active":"2024-08-31T06:02:30.595665+0000","last_became_peered":"2024-08-31T06:02:30.595665+0000","last_unstale":"2024-08-31T06:03:15.767046+0000","last_undegraded":"2024-08-31T06:03:15.767046+0000","last_fullsized":"2024-08-31T06:03:15.767046+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:40.347954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"70'6","reported_seq":82,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:30.754946+0000","last_change":"2024-08-31T06:02:28.594117+0000","last_active":"2024-08-31T06:03:30.754946+0000","last_peered":"2024-08-31T06:03:30.754946+0000","last_clean":"2024-08-31T06:03:30.754946+0000","last_became_active":"2024-08-31T06:02:28.593721+0000","last_became_peered":"2024-08-31T06:02:28.593721+0000","last_unstale":"2024-08-31T06:03:30.754946+0000","last_undegraded":"2024-08-31T06:03:30.754946+0000","last_fullsized":"2024-08-31T06:03:30.754946+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:48:49.400841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768131+0000","last_change":"2024-08-31T06:02:30.606967+0000","last_active":"2024-08-31T06:03:15.768131+0000","last_peered":"2024-08-31T06:03:15.768131+0000","last_clean":"2024-08-31T06:03:15.768131+0000","last_became_active":"2024-08-31T06:02:30.605730+0000","last_became_peered":"2024-08-31T06:02:30.605730+0000","last_unstale":"2024-08-31T06:03:15.768131+0000","last_undegraded":"2024-08-31T06:03:15.768131+0000","last_fullsized":"2024-08-31T06:03:15.768131+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:30.656071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"70'17","reported_seq":41,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764138+0000","last_change":"2024-08-31T06:02:28.780911+0000","last_active":"2024-08-31T06:03:15.764138+0000","last_peered":"2024-08-31T06:03:15.764138+0000","last_clean":"2024-08-31T06:03:15.764138+0000","last_became_active":"2024-08-31T06:02:28.780375+0000","last_became_peered":"2024-08-31T06:02:28.780375+0000","last_unstale":"2024-08-31T06:03:15.764138+0000","last_undegraded":"2024-08-31T06:03:15.764138+0000","last_fullsized":"2024-08-31T06:03:15.764138+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:46.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765140+0000","last_change":"2024-08-31T06:02:30.606871+0000","last_active":"2024-08-31T06:03:15.765140+0000","last_peered":"2024-08-31T06:03:15.765140+0000","last_clean":"2024-08-31T06:03:15.765140+0000","last_became_active":"2024-08-31T06:02:30.606507+0000","last_became_peered":"2024-08-31T06:02:30.606507+0000","last_unstale":"2024-08-31T06:03:15.765140+0000","last_undegraded":"2024-08-31T06:03:15.765140+0000","last_fullsized":"2024-08-31T06:03:15.765140+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:16:31.502034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"70'2","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765147+0000","last_change":"2024-08-31T06:02:28.588078+0000","last_active":"2024-08-31T06:03:15.765147+0000","last_peered":"2024-08-31T06:03:15.765147+0000","last_clean":"2024-08-31T06:03:15.765147+0000","last_became_active":"2024-08-31T06:02:28.587642+0000","last_became_peered":"2024-08-31T06:02:28.587642+0000","last_unstale":"2024-08-31T06:03:15.765147+0000","last_undegraded":"2024-08-31T06:03:15.765147+0000","last_fullsized":"2024-08-31T06:03:15.765147+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:59.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767455+0000","last_change":"2024-08-31T06:02:30.605647+0000","last_active":"2024-08-31T06:03:15.767455+0000","last_peered":"2024-08-31T06:03:15.767455+0000","last_clean":"2024-08-31T06:03:15.767455+0000","last_became_active":"2024-08-31T06:02:30.605267+0000","last_became_peered":"2024-08-31T06:02:30.605267+0000","last_unstale":"2024-08-31T06:03:15.767455+0000","last_undegraded":"2024-08-31T06:03:15.767455+0000","last_fullsized":"2024-08-31T06:03:15.767455+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:08:34.741030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"70'5","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768574+0000","last_change":"2024-08-31T06:02:28.585295+0000","last_active":"2024-08-31T06:03:15.768574+0000","last_peered":"2024-08-31T06:03:15.768574+0000","last_clean":"2024-08-31T06:03:15.768574+0000","last_became_active":"2024-08-31T06:02:28.584895+0000","last_became_peered":"2024-08-31T06:02:28.584895+0000","last_unstale":"2024-08-31T06:03:15.768574+0000","last_undegraded":"2024-08-31T06:03:15.768574+0000","last_fullsized":"2024-08-31T06:03:15.768574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:57:12.658937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767453+0000","last_change":"2024-08-31T06:02:30.603593+0000","last_active":"2024-08-31T06:03:15.767453+0000","last_peered":"2024-08-31T06:03:15.767453+0000","last_clean":"2024-08-31T06:03:15.767453+0000","last_became_active":"2024-08-31T06:02:30.603274+0000","last_became_peered":"2024-08-31T06:02:30.603274+0000","last_unstale":"2024-08-31T06:03:15.767453+0000","last_undegraded":"2024-08-31T06:03:15.767453+0000","last_fullsized":"2024-08-31T06:03:15.767453+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:07.720406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"70'3","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765605+0000","last_change":"2024-08-31T06:02:28.586920+0000","last_active":"2024-08-31T06:03:15.765605+0000","last_peered":"2024-08-31T06:03:15.765605+0000","last_clean":"2024-08-31T06:03:15.765605+0000","last_became_active":"2024-08-31T06:02:28.586362+0000","last_became_peered":"2024-08-31T06:02:28.586362+0000","last_unstale":"2024-08-31T06:03:15.765605+0000","last_undegraded":"2024-08-31T06:03:15.765605+0000","last_fullsized":"2024-08-31T06:03:15.765605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:52.065879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"70'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767127+0000","last_change":"2024-08-31T06:02:30.603800+0000","last_active":"2024-08-31T06:03:15.767127+0000","last_peered":"2024-08-31T06:03:15.767127+0000","last_clean":"2024-08-31T06:03:15.767127+0000","last_became_active":"2024-08-31T06:02:30.603439+0000","last_became_peered":"2024-08-31T06:02:30.603439+0000","last_unstale":"2024-08-31T06:03:15.767127+0000","last_undegraded":"2024-08-31T06:03:15.767127+0000","last_fullsized":"2024-08-31T06:03:15.767127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:39.992719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"70'5","reported_seq":83,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:33.759208+0000","last_change":"2024-08-31T06:02:28.936404+0000","last_active":"2024-08-31T06:03:33.759208+0000","last_peered":"2024-08-31T06:03:33.759208+0000","last_clean":"2024-08-31T06:03:33.759208+0000","last_became_active":"2024-08-31T06:02:28.935898+0000","last_became_peered":"2024-08-31T06:02:28.935898+0000","last_unstale":"2024-08-31T06:03:33.759208+0000","last_undegraded":"2024-08-31T06:03:33.759208+0000","last_fullsized":"2024-08-31T06:03:33.759208+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:35.004510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767422+0000","last_change":"2024-08-31T06:02:30.608258+0000","last_active":"2024-08-31T06:03:15.767422+0000","last_peered":"2024-08-31T06:03:15.767422+0000","last_clean":"2024-08-31T06:03:15.767422+0000","last_became_active":"2024-08-31T06:02:30.607067+0000","last_became_peered":"2024-08-31T06:02:30.607067+0000","last_unstale":"2024-08-31T06:03:15.767422+0000","last_undegraded":"2024-08-31T06:03:15.767422+0000","last_fullsized":"2024-08-31T06:03:15.767422+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:03:09.362812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":92,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768256+0000","last_change":"2024-08-31T06:01:19.125033+0000","last_active":"2024-08-31T06:03:15.768256+0000","last_peered":"2024-08-31T06:03:15.768256+0000","last_clean":"2024-08-31T06:03:15.768256+0000","last_became_active":"2024-08-31T06:01:19.118469+0000","last_became_peered":"2024-08-31T06:01:19.118469+0000","last_unstale":"2024-08-31T06:03:15.768256+0000","last_undegraded":"2024-08-31T06:03:15.768256+0000","last_fullsized":"2024-08-31T06:03:15.768256+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_clean_scrub_stamp":"2024-08-31T05:58:05.259854+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:33.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"70'6","reported_seq":32,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765883+0000","last_change":"2024-08-31T06:02:28.588276+0000","last_active":"2024-08-31T06:03:15.765883+0000","last_peered":"2024-08-31T06:03:15.765883+0000","last_clean":"2024-08-31T06:03:15.765883+0000","last_became_active":"2024-08-31T06:02:28.587184+0000","last_became_peered":"2024-08-31T06:02:28.587184+0000","last_unstale":"2024-08-31T06:03:15.765883+0000","last_undegraded":"2024-08-31T06:03:15.765883+0000","last_fullsized":"2024-08-31T06:03:15.765883+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:12.762919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973347+0000","last_change":"2024-08-31T06:02:30.610801+0000","last_active":"2024-08-31T06:03:15.973347+0000","last_peered":"2024-08-31T06:03:15.973347+0000","last_clean":"2024-08-31T06:03:15.973347+0000","last_became_active":"2024-08-31T06:02:30.610446+0000","last_became_peered":"2024-08-31T06:02:30.610446+0000","last_unstale":"2024-08-31T06:03:15.973347+0000","last_undegraded":"2024-08-31T06:03:15.973347+0000","last_fullsized":"2024-08-31T06:03:15.973347+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:17.891734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"70'4","reported_seq":38,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.777260+0000","last_change":"2024-08-31T06:03:15.777123+0000","last_active":"2024-08-31T06:03:15.777260+0000","last_peered":"2024-08-31T06:03:15.777260+0000","last_clean":"2024-08-31T06:03:15.777260+0000","last_became_active":"2024-08-31T06:03:15.773099+0000","last_became_peered":"2024-08-31T06:03:15.773099+0000","last_unstale":"2024-08-31T06:03:15.777260+0000","last_undegraded":"2024-08-31T06:03:15.777260+0000","last_fullsized":"2024-08-31T06:03:15.777260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:56:51.706692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.776507+0000","last_change":"2024-08-31T06:03:15.776402+0000","last_active":"2024-08-31T06:03:15.776507+0000","last_peered":"2024-08-31T06:03:15.776507+0000","last_clean":"2024-08-31T06:03:15.776507+0000","last_became_active":"2024-08-31T06:03:15.775949+0000","last_became_peered":"2024-08-31T06:03:15.775949+0000","last_unstale":"2024-08-31T06:03:15.776507+0000","last_undegraded":"2024-08-31T06:03:15.776507+0000","last_fullsized":"2024-08-31T06:03:15.776507+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:51:34.646125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"70'5","reported_seq":83,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:34.760126+0000","last_change":"2024-08-31T06:02:28.780419+0000","last_active":"2024-08-31T06:03:34.760126+0000","last_peered":"2024-08-31T06:03:34.760126+0000","last_clean":"2024-08-31T06:03:34.760126+0000","last_became_active":"2024-08-31T06:02:28.779814+0000","last_became_peered":"2024-08-31T06:02:28.779814+0000","last_unstale":"2024-08-31T06:03:34.760126+0000","last_undegraded":"2024-08-31T06:03:34.760126+0000","last_fullsized":"2024-08-31T06:03:34.760126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:36.183841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.776600+0000","last_change":"2024-08-31T06:03:15.776468+0000","last_active":"2024-08-31T06:03:15.776600+0000","last_peered":"2024-08-31T06:03:15.776600+0000","last_clean":"2024-08-31T06:03:15.776600+0000","last_became_active":"2024-08-31T06:03:15.776005+0000","last_became_peered":"2024-08-31T06:03:15.776005+0000","last_unstale":"2024-08-31T06:03:15.776600+0000","last_undegraded":"2024-08-31T06:03:15.776600+0000","last_fullsized":"2024-08-31T06:03:15.776600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:47:36.420584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"70'5","reported_seq":82,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:33.758687+0000","last_change":"2024-08-31T06:02:28.594220+0000","last_active":"2024-08-31T06:03:33.758687+0000","last_peered":"2024-08-31T06:03:33.758687+0000","last_clean":"2024-08-31T06:03:33.758687+0000","last_became_active":"2024-08-31T06:02:28.593729+0000","last_became_peered":"2024-08-31T06:02:28.593729+0000","last_unstale":"2024-08-31T06:03:33.758687+0000","last_undegraded":"2024-08-31T06:03:33.758687+0000","last_fullsized":"2024-08-31T06:03:33.758687+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:37:03.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:16.212155+0000","last_change":"2024-08-31T06:02:30.600008+0000","last_active":"2024-08-31T06:03:16.212155+0000","last_peered":"2024-08-31T06:03:16.212155+0000","last_clean":"2024-08-31T06:03:16.212155+0000","last_became_active":"2024-08-31T06:02:30.599677+0000","last_became_peered":"2024-08-31T06:02:30.599677+0000","last_unstale":"2024-08-31T06:03:16.212155+0000","last_undegraded":"2024-08-31T06:03:16.212155+0000","last_fullsized":"2024-08-31T06:03:16.212155+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:59.520544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"70'1","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.766686+0000","last_change":"2024-08-31T06:02:28.780554+0000","last_active":"2024-08-31T06:03:15.766686+0000","last_peered":"2024-08-31T06:03:15.766686+0000","last_clean":"2024-08-31T06:03:15.766686+0000","last_became_active":"2024-08-31T06:02:28.780137+0000","last_became_peered":"2024-08-31T06:02:28.780137+0000","last_unstale":"2024-08-31T06:03:15.766686+0000","last_undegraded":"2024-08-31T06:03:15.766686+0000","last_fullsized":"2024-08-31T06:03:15.766686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:57.523667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"70'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:16.212216+0000","last_change":"2024-08-31T06:02:30.597438+0000","last_active":"2024-08-31T06:03:16.212216+0000","last_peered":"2024-08-31T06:03:16.212216+0000","last_clean":"2024-08-31T06:03:16.212216+0000","last_became_active":"2024-08-31T06:02:30.597108+0000","last_became_peered":"2024-08-31T06:02:30.597108+0000","last_unstale":"2024-08-31T06:03:16.212216+0000","last_undegraded":"2024-08-31T06:03:16.212216+0000","last_fullsized":"2024-08-31T06:03:16.212216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:05.238708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"70'4","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764821+0000","last_change":"2024-08-31T06:02:28.781006+0000","last_active":"2024-08-31T06:03:15.764821+0000","last_peered":"2024-08-31T06:03:15.764821+0000","last_clean":"2024-08-31T06:03:15.764821+0000","last_became_active":"2024-08-31T06:02:28.780468+0000","last_became_peered":"2024-08-31T06:02:28.780468+0000","last_unstale":"2024-08-31T06:03:15.764821+0000","last_undegraded":"2024-08-31T06:03:15.764821+0000","last_fullsized":"2024-08-31T06:03:15.764821+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:20.206251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768689+0000","last_change":"2024-08-31T06:02:30.600826+0000","last_active":"2024-08-31T06:03:15.768689+0000","last_peered":"2024-08-31T06:03:15.768689+0000","last_clean":"2024-08-31T06:03:15.768689+0000","last_became_active":"2024-08-31T06:02:30.600474+0000","last_became_peered":"2024-08-31T06:02:30.600474+0000","last_unstale":"2024-08-31T06:03:15.768689+0000","last_undegraded":"2024-08-31T06:03:15.768689+0000","last_fullsized":"2024-08-31T06:03:15.768689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:07.456576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"70'15","reported_seq":38,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768385+0000","last_change":"2024-08-31T06:02:28.588026+0000","last_active":"2024-08-31T06:03:15.768385+0000","last_peered":"2024-08-31T06:03:15.768385+0000","last_clean":"2024-08-31T06:03:15.768385+0000","last_became_active":"2024-08-31T06:02:28.587759+0000","last_became_peered":"2024-08-31T06:02:28.587759+0000","last_unstale":"2024-08-31T06:03:15.768385+0000","last_undegraded":"2024-08-31T06:03:15.768385+0000","last_fullsized":"2024-08-31T06:03:15.768385+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:44.323111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973586+0000","last_change":"2024-08-31T06:02:30.604375+0000","last_active":"2024-08-31T06:03:15.973586+0000","last_peered":"2024-08-31T06:03:15.973586+0000","last_clean":"2024-08-31T06:03:15.973586+0000","last_became_active":"2024-08-31T06:02:30.604008+0000","last_became_peered":"2024-08-31T06:02:30.604008+0000","last_unstale":"2024-08-31T06:03:15.973586+0000","last_undegraded":"2024-08-31T06:03:15.973586+0000","last_fullsized":"2024-08-31T06:03:15.973586+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:37.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"70'7","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.766179+0000","last_change":"2024-08-31T06:02:28.936568+0000","last_active":"2024-08-31T06:03:15.766179+0000","last_peered":"2024-08-31T06:03:15.766179+0000","last_clean":"2024-08-31T06:03:15.766179+0000","last_became_active":"2024-08-31T06:02:28.936185+0000","last_became_peered":"2024-08-31T06:02:28.936185+0000","last_unstale":"2024-08-31T06:03:15.766179+0000","last_undegraded":"2024-08-31T06:03:15.766179+0000","last_fullsized":"2024-08-31T06:03:15.766179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:34.080300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.771795+0000","last_change":"2024-08-31T06:03:15.771653+0000","last_active":"2024-08-31T06:03:15.771795+0000","last_peered":"2024-08-31T06:03:15.771795+0000","last_clean":"2024-08-31T06:03:15.771795+0000","last_became_active":"2024-08-31T06:03:15.770903+0000","last_became_peered":"2024-08-31T06:03:15.770903+0000","last_unstale":"2024-08-31T06:03:15.771795+0000","last_undegraded":"2024-08-31T06:03:15.771795+0000","last_fullsized":"2024-08-31T06:03:15.771795+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:50.547558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"70'2","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.777706+0000","last_change":"2024-08-31T06:03:15.777577+0000","last_active":"2024-08-31T06:03:15.777706+0000","last_peered":"2024-08-31T06:03:15.777706+0000","last_clean":"2024-08-31T06:03:15.777706+0000","last_became_active":"2024-08-31T06:03:15.773006+0000","last_became_peered":"2024-08-31T06:03:15.773006+0000","last_unstale":"2024-08-31T06:03:15.777706+0000","last_undegraded":"2024-08-31T06:03:15.777706+0000","last_fullsized":"2024-08-31T06:03:15.777706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:31.531741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764100+0000","last_change":"2024-08-31T06:02:30.604018+0000","last_active":"2024-08-31T06:03:15.764100+0000","last_peered":"2024-08-31T06:03:15.764100+0000","last_clean":"2024-08-31T06:03:15.764100+0000","last_became_active":"2024-08-31T06:02:30.603411+0000","last_became_peered":"2024-08-31T06:02:30.603411+0000","last_unstale":"2024-08-31T06:03:15.764100+0000","last_undegraded":"2024-08-31T06:03:15.764100+0000","last_fullsized":"2024-08-31T06:03:15.764100+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:34:30.732954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"70'7","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973166+0000","last_change":"2024-08-31T06:02:28.586348+0000","last_active":"2024-08-31T06:03:15.973166+0000","last_peered":"2024-08-31T06:03:15.973166+0000","last_clean":"2024-08-31T06:03:15.973166+0000","last_became_active":"2024-08-31T06:02:28.586046+0000","last_became_peered":"2024-08-31T06:02:28.586046+0000","last_unstale":"2024-08-31T06:03:15.973166+0000","last_undegraded":"2024-08-31T06:03:15.973166+0000","last_fullsized":"2024-08-31T06:03:15.973166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:30.987232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767422+0000","last_change":"2024-08-31T06:02:30.616402+0000","last_active":"2024-08-31T06:03:15.767422+0000","last_peered":"2024-08-31T06:03:15.767422+0000","last_clean":"2024-08-31T06:03:15.767422+0000","last_became_active":"2024-08-31T06:02:30.616014+0000","last_became_peered":"2024-08-31T06:02:30.616014+0000","last_unstale":"2024-08-31T06:03:15.767422+0000","last_undegraded":"2024-08-31T06:03:15.767422+0000","last_fullsized":"2024-08-31T06:03:15.767422+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:42.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"70'3","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.773856+0000","last_change":"2024-08-31T06:02:28.590184+0000","last_active":"2024-08-31T06:03:15.773856+0000","last_peered":"2024-08-31T06:03:15.773856+0000","last_clean":"2024-08-31T06:03:15.773856+0000","last_became_active":"2024-08-31T06:02:28.588830+0000","last_became_peered":"2024-08-31T06:02:28.588830+0000","last_unstale":"2024-08-31T06:03:15.773856+0000","last_undegraded":"2024-08-31T06:03:15.773856+0000","last_fullsized":"2024-08-31T06:03:15.773856+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:03.072197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973253+0000","last_change":"2024-08-31T06:02:30.597262+0000","last_active":"2024-08-31T06:03:15.973253+0000","last_peered":"2024-08-31T06:03:15.973253+0000","last_clean":"2024-08-31T06:03:15.973253+0000","last_became_active":"2024-08-31T06:02:30.596862+0000","last_became_peered":"2024-08-31T06:02:30.596862+0000","last_unstale":"2024-08-31T06:03:15.973253+0000","last_undegraded":"2024-08-31T06:03:15.973253+0000","last_fullsized":"2024-08-31T06:03:15.973253+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:46:29.378532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"70'4","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764402+0000","last_change":"2024-08-31T06:02:28.594161+0000","last_active":"2024-08-31T06:03:15.764402+0000","last_peered":"2024-08-31T06:03:15.764402+0000","last_clean":"2024-08-31T06:03:15.764402+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:03:15.764402+0000","last_undegraded":"2024-08-31T06:03:15.764402+0000","last_fullsized":"2024-08-31T06:03:15.764402+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:31:17.941172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767286+0000","last_change":"2024-08-31T06:02:30.595194+0000","last_active":"2024-08-31T06:03:15.767286+0000","last_peered":"2024-08-31T06:03:15.767286+0000","last_clean":"2024-08-31T06:03:15.767286+0000","last_became_active":"2024-08-31T06:02:30.594812+0000","last_became_peered":"2024-08-31T06:02:30.594812+0000","last_unstale":"2024-08-31T06:03:15.767286+0000","last_undegraded":"2024-08-31T06:03:15.767286+0000","last_fullsized":"2024-08-31T06:03:15.767286+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:03.224924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765431+0000","last_change":"2024-08-31T06:02:30.615776+0000","last_active":"2024-08-31T06:03:15.765431+0000","last_peered":"2024-08-31T06:03:15.765431+0000","last_clean":"2024-08-31T06:03:15.765431+0000","last_became_active":"2024-08-31T06:02:30.615385+0000","last_became_peered":"2024-08-31T06:02:30.615385+0000","last_unstale":"2024-08-31T06:03:15.765431+0000","last_undegraded":"2024-08-31T06:03:15.765431+0000","last_fullsized":"2024-08-31T06:03:15.765431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:49.685443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"70'5","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764529+0000","last_change":"2024-08-31T06:02:28.591064+0000","last_active":"2024-08-31T06:03:15.764529+0000","last_peered":"2024-08-31T06:03:15.764529+0000","last_clean":"2024-08-31T06:03:15.764529+0000","last_became_active":"2024-08-31T06:02:28.590643+0000","last_became_peered":"2024-08-31T06:02:28.590643+0000","last_unstale":"2024-08-31T06:03:15.764529+0000","last_undegraded":"2024-08-31T06:03:15.764529+0000","last_fullsized":"2024-08-31T06:03:15.764529+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:01.953317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770189+0000","last_change":"2024-08-31T06:02:30.600532+0000","last_active":"2024-08-31T06:03:15.770189+0000","last_peered":"2024-08-31T06:03:15.770189+0000","last_clean":"2024-08-31T06:03:15.770189+0000","last_became_active":"2024-08-31T06:02:30.600013+0000","last_became_peered":"2024-08-31T06:02:30.600013+0000","last_unstale":"2024-08-31T06:03:15.770189+0000","last_undegraded":"2024-08-31T06:03:15.770189+0000","last_fullsized":"2024-08-31T06:03:15.770189+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:38.753206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"70'12","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764679+0000","last_change":"2024-08-31T06:02:28.593921+0000","last_active":"2024-08-31T06:03:15.764679+0000","last_peered":"2024-08-31T06:03:15.764679+0000","last_clean":"2024-08-31T06:03:15.764679+0000","last_became_active":"2024-08-31T06:02:28.593102+0000","last_became_peered":"2024-08-31T06:02:28.593102+0000","last_unstale":"2024-08-31T06:03:15.764679+0000","last_undegraded":"2024-08-31T06:03:15.764679+0000","last_fullsized":"2024-08-31T06:03:15.764679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:30:35.791686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767605+0000","last_change":"2024-08-31T06:02:30.606524+0000","last_active":"2024-08-31T06:03:15.767605+0000","last_peered":"2024-08-31T06:03:15.767605+0000","last_clean":"2024-08-31T06:03:15.767605+0000","last_became_active":"2024-08-31T06:02:30.606132+0000","last_became_peered":"2024-08-31T06:02:30.606132+0000","last_unstale":"2024-08-31T06:03:15.767605+0000","last_undegraded":"2024-08-31T06:03:15.767605+0000","last_fullsized":"2024-08-31T06:03:15.767605+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:46.566811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"70'2","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973734+0000","last_change":"2024-08-31T06:02:28.780596+0000","last_active":"2024-08-31T06:03:15.973734+0000","last_peered":"2024-08-31T06:03:15.973734+0000","last_clean":"2024-08-31T06:03:15.973734+0000","last_became_active":"2024-08-31T06:02:28.779908+0000","last_became_peered":"2024-08-31T06:02:28.779908+0000","last_unstale":"2024-08-31T06:03:15.973734+0000","last_undegraded":"2024-08-31T06:03:15.973734+0000","last_fullsized":"2024-08-31T06:03:15.973734+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:01.254340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.776979+0000","last_change":"2024-08-31T06:03:15.776271+0000","last_active":"2024-08-31T06:03:15.776979+0000","last_peered":"2024-08-31T06:03:15.776979+0000","last_clean":"2024-08-31T06:03:15.776979+0000","last_became_active":"2024-08-31T06:03:15.775821+0000","last_became_peered":"2024-08-31T06:03:15.775821+0000","last_unstale":"2024-08-31T06:03:15.776979+0000","last_undegraded":"2024-08-31T06:03:15.776979+0000","last_fullsized":"2024-08-31T06:03:15.776979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:52:34.076554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"70'13","reported_seq":88,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:31.755146+0000","last_change":"2024-08-31T06:02:28.593773+0000","last_active":"2024-08-31T06:03:31.755146+0000","last_peered":"2024-08-31T06:03:31.755146+0000","last_clean":"2024-08-31T06:03:31.755146+0000","last_became_active":"2024-08-31T06:02:28.593511+0000","last_became_peered":"2024-08-31T06:02:28.593511+0000","last_unstale":"2024-08-31T06:03:31.755146+0000","last_undegraded":"2024-08-31T06:03:31.755146+0000","last_fullsized":"2024-08-31T06:03:31.755146+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:01:50.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66966,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":559,"num_read_kb":352,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":200898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906970,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":802816,"data_stored":397588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070496,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36816,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708336,"statfs":{"total":95995035648,"available":95957336064,"internally_reserved":0,"allocated":1503232,"data_stored":1048770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928234020,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40320,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704832,"statfs":{"total":95995035648,"available":95953747968,"internally_reserved":0,"allocated":827392,"data_stored":397518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397546,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":823296,"data_stored":397896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593774,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1421312,"data_stored":990805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757299,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":811008,"data_stored":397235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953527,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1433600,"data_stored":990092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084348,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":811008,"data_stored":397487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":827392,"data_stored":397060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":458521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":872448,"data_stored":457910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40324,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704828,"statfs":{"total":95995035648,"available":95953743872,"internally_reserved":0,"allocated":831488,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:03:37.228 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:03:37.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:37 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:37.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:37 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:37.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:37 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:03:37.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:37 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:03:37.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:37 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:37.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:37 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:37.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:37 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:37.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:37 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:03:37.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:37 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:03:37.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:37 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:37.480 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:37.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:37 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:37.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:37 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:37.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:37 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:03:37.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:37 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:03:37.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:37 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:03:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.946+0000 7fe9eccf4640 1 -- 172.21.15.53:0/2670387171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e8102880 msgr2=0x7fe9e8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.946+0000 7fe9eccf4640 1 --2- 172.21.15.53:0/2670387171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e8102880 0x7fe9e8102c90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009900 tx=0x7fe9d802a410 comp rx=0 tx=0).stop 2024-08-31T06:03:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.946+0000 7fe9eccf4640 1 -- 172.21.15.53:0/2670387171 shutdown_connections 2024-08-31T06:03:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.946+0000 7fe9eccf4640 1 --2- 172.21.15.53:0/2670387171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e8108ac0 0x7fe9e810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.946+0000 7fe9eccf4640 1 --2- 172.21.15.53:0/2670387171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9e8108170 0x7fe9e8108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.946+0000 7fe9eccf4640 1 --2- 172.21.15.53:0/2670387171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e8102880 0x7fe9e8102c90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.946+0000 7fe9eccf4640 1 -- 172.21.15.53:0/2670387171 >> 172.21.15.53:0/2670387171 conn(0x7fe9e8079500 msgr2=0x7fe9e8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.946+0000 7fe9eccf4640 1 -- 172.21.15.53:0/2670387171 shutdown_connections 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.946+0000 7fe9eccf4640 1 -- 172.21.15.53:0/2670387171 wait complete. 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.947+0000 7fe9eccf4640 1 Processor -- start 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.947+0000 7fe9eccf4640 1 -- start start 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.947+0000 7fe9eccf4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e8102880 0x7fe9e819af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9eccf4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9e8108170 0x7fe9e819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9eccf4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e8108ac0 0x7fe9e819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9eccf4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e8112640 con 0x7fe9e8102880 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9eccf4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e81124c0 con 0x7fe9e8108ac0 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9eccf4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e81127c0 con 0x7fe9e8108170 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9e659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e8102880 0x7fe9e819af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9e659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e8102880 0x7fe9e819af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46418/0 (socket says 172.21.15.53:46418) 2024-08-31T06:03:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9e659c640 1 -- 172.21.15.53:0/371267869 learned_addr learned my addr 172.21.15.53:0/371267869 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9dffff640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9e8108170 0x7fe9e819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9e6d9d640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e8108ac0 0x7fe9e819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9e659c640 1 -- 172.21.15.53:0/371267869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9e8108170 msgr2=0x7fe9e819b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9e659c640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9e8108170 0x7fe9e819b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9e659c640 1 -- 172.21.15.53:0/371267869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e8108ac0 msgr2=0x7fe9e819b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9e659c640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e8108ac0 0x7fe9e819b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9e659c640 1 -- 172.21.15.53:0/371267869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e81a6280 con 0x7fe9e8102880 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9dffff640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9e8108170 0x7fe9e819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9e6d9d640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e8108ac0 0x7fe9e819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9e659c640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e8102880 0x7fe9e819af70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009a20 tx=0x7fe9d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9df7fe640 1 -- 172.21.15.53:0/371267869 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d803f030 con 0x7fe9e8102880 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9eccf4640 1 -- 172.21.15.53:0/371267869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e81a6510 con 0x7fe9e8102880 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9df7fe640 1 -- 172.21.15.53:0/371267869 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9d80035f0 con 0x7fe9e8102880 2024-08-31T06:03:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9df7fe640 1 -- 172.21.15.53:0/371267869 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8035070 con 0x7fe9e8102880 2024-08-31T06:03:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.948+0000 7fe9eccf4640 1 -- 172.21.15.53:0/371267869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e81a6ac0 con 0x7fe9e8102880 2024-08-31T06:03:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.949+0000 7fe9eccf4640 1 -- 172.21.15.53:0/371267869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e8103ab0 con 0x7fe9e8102880 2024-08-31T06:03:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.951+0000 7fe9df7fe640 1 -- 172.21.15.53:0/371267869 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fe9d8003aa0 con 0x7fe9e8102880 2024-08-31T06:03:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.952+0000 7fe9df7fe640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9d40b4c10 0x7fe9d40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.952+0000 7fe9dffff640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9d40b4c10 0x7fe9d40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.952+0000 7fe9df7fe640 1 -- 172.21.15.53:0/371267869 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fe9d81064f0 con 0x7fe9e8102880 2024-08-31T06:03:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.952+0000 7fe9dffff640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9d40b4c10 0x7fe9d40b7120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8079c00 tx=0x7fe9d0008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:37.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:37.955+0000 7fe9df7fe640 1 -- 172.21.15.53:0/371267869 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe9d80cd360 con 0x7fe9e8102880 2024-08-31T06:03:38.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.139+0000 7fe9eccf4640 1 -- 172.21.15.53:0/371267869 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9e80635a0 con 0x7fe9d40b4c10 2024-08-31T06:03:38.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.143+0000 7fe9df7fe640 1 -- 172.21.15.53:0/371267869 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258731 (secure 0 0 0) 0x7fe9e80635a0 con 0x7fe9d40b4c10 2024-08-31T06:03:38.147 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:03:38.148 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.146+0000 7fe9eccf4640 1 -- 172.21.15.53:0/371267869 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9d40b4c10 msgr2=0x7fe9d40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.146+0000 7fe9eccf4640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9d40b4c10 0x7fe9d40b7120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8079c00 tx=0x7fe9d0008040 comp rx=0 tx=0).stop 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.147+0000 7fe9eccf4640 1 -- 172.21.15.53:0/371267869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e8102880 msgr2=0x7fe9e819af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.147+0000 7fe9eccf4640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e8102880 0x7fe9e819af70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009a20 tx=0x7fe9d8004270 comp rx=0 tx=0).stop 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.147+0000 7fe9eccf4640 1 -- 172.21.15.53:0/371267869 shutdown_connections 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.147+0000 7fe9eccf4640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9d40b4c10 0x7fe9d40b7120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.147+0000 7fe9eccf4640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e8108ac0 0x7fe9e819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.147+0000 7fe9eccf4640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9e8108170 0x7fe9e819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.147+0000 7fe9eccf4640 1 --2- 172.21.15.53:0/371267869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e8102880 0x7fe9e819af70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.147+0000 7fe9eccf4640 1 -- 172.21.15.53:0/371267869 >> 172.21.15.53:0/371267869 conn(0x7fe9e8079500 msgr2=0x7fe9e8101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.147+0000 7fe9eccf4640 1 -- 172.21.15.53:0/371267869 shutdown_connections 2024-08-31T06:03:38.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:38.147+0000 7fe9eccf4640 1 -- 172.21.15.53:0/371267869 wait complete. 2024-08-31T06:03:38.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:38 smithi153 ceph-mon[22320]: pgmap v281: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:38.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:38 smithi153 ceph-mon[22320]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:03:38.437 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:38 smithi053 ceph-mon[18924]: pgmap v281: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:38.438 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:38 smithi053 ceph-mon[18924]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:03:38.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:38 smithi130 ceph-mon[22266]: pgmap v281: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:38.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:38 smithi130 ceph-mon[22266]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:03:38.850 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-08-31T06:03:36.352772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657568,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":640,"num_read_kb":421,"num_write":368,"num_write_kb":2286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390020,"kb_used_data":11580,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551804,"statfs":{"total":1151940427776,"available":1151541047296,"internally_reserved":0,"allocated":11857920,"data_stored":6729456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003457"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768294+0000","last_change":"2024-08-31T06:02:30.611733+0000","last_active":"2024-08-31T06:03:15.768294+0000","last_peered":"2024-08-31T06:03:15.768294+0000","last_clean":"2024-08-31T06:03:15.768294+0000","last_became_active":"2024-08-31T06:02:30.610339+0000","last_became_peered":"2024-08-31T06:02:30.610339+0000","last_unstale":"2024-08-31T06:03:15.768294+0000","last_undegraded":"2024-08-31T06:03:15.768294+0000","last_fullsized":"2024-08-31T06:03:15.768294+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:20.628524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767803+0000","last_change":"2024-08-31T06:02:30.604550+0000","last_active":"2024-08-31T06:03:15.767803+0000","last_peered":"2024-08-31T06:03:15.767803+0000","last_clean":"2024-08-31T06:03:15.767803+0000","last_became_active":"2024-08-31T06:02:30.604200+0000","last_became_peered":"2024-08-31T06:02:30.604200+0000","last_unstale":"2024-08-31T06:03:15.767803+0000","last_undegraded":"2024-08-31T06:03:15.767803+0000","last_fullsized":"2024-08-31T06:03:15.767803+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:31.191972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768552+0000","last_change":"2024-08-31T06:02:30.606102+0000","last_active":"2024-08-31T06:03:15.768552+0000","last_peered":"2024-08-31T06:03:15.768552+0000","last_clean":"2024-08-31T06:03:15.768552+0000","last_became_active":"2024-08-31T06:02:30.605738+0000","last_became_peered":"2024-08-31T06:02:30.605738+0000","last_unstale":"2024-08-31T06:03:15.768552+0000","last_undegraded":"2024-08-31T06:03:15.768552+0000","last_fullsized":"2024-08-31T06:03:15.768552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:50:34.993218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.766002+0000","last_change":"2024-08-31T06:02:30.603207+0000","last_active":"2024-08-31T06:03:15.766002+0000","last_peered":"2024-08-31T06:03:15.766002+0000","last_clean":"2024-08-31T06:03:15.766002+0000","last_became_active":"2024-08-31T06:02:30.602829+0000","last_became_peered":"2024-08-31T06:02:30.602829+0000","last_unstale":"2024-08-31T06:03:15.766002+0000","last_undegraded":"2024-08-31T06:03:15.766002+0000","last_fullsized":"2024-08-31T06:03:15.766002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:02.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764265+0000","last_change":"2024-08-31T06:02:30.590760+0000","last_active":"2024-08-31T06:03:15.764265+0000","last_peered":"2024-08-31T06:03:15.764265+0000","last_clean":"2024-08-31T06:03:15.764265+0000","last_became_active":"2024-08-31T06:02:30.590198+0000","last_became_peered":"2024-08-31T06:02:30.590198+0000","last_unstale":"2024-08-31T06:03:15.764265+0000","last_undegraded":"2024-08-31T06:03:15.764265+0000","last_fullsized":"2024-08-31T06:03:15.764265+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:50.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:16.212000+0000","last_change":"2024-08-31T06:02:30.599924+0000","last_active":"2024-08-31T06:03:16.212000+0000","last_peered":"2024-08-31T06:03:16.212000+0000","last_clean":"2024-08-31T06:03:16.212000+0000","last_became_active":"2024-08-31T06:02:30.599566+0000","last_became_peered":"2024-08-31T06:02:30.599566+0000","last_unstale":"2024-08-31T06:03:16.212000+0000","last_undegraded":"2024-08-31T06:03:16.212000+0000","last_fullsized":"2024-08-31T06:03:16.212000+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:58.265673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.771642+0000","last_change":"2024-08-31T06:03:15.771521+0000","last_active":"2024-08-31T06:03:15.771642+0000","last_peered":"2024-08-31T06:03:15.771642+0000","last_clean":"2024-08-31T06:03:15.771642+0000","last_became_active":"2024-08-31T06:03:15.770969+0000","last_became_peered":"2024-08-31T06:03:15.770969+0000","last_unstale":"2024-08-31T06:03:15.771642+0000","last_undegraded":"2024-08-31T06:03:15.771642+0000","last_fullsized":"2024-08-31T06:03:15.771642+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:31.724213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.972972+0000","last_change":"2024-08-31T06:02:30.610057+0000","last_active":"2024-08-31T06:03:15.972972+0000","last_peered":"2024-08-31T06:03:15.972972+0000","last_clean":"2024-08-31T06:03:15.972972+0000","last_became_active":"2024-08-31T06:02:30.609654+0000","last_became_peered":"2024-08-31T06:02:30.609654+0000","last_unstale":"2024-08-31T06:03:15.972972+0000","last_undegraded":"2024-08-31T06:03:15.972972+0000","last_fullsized":"2024-08-31T06:03:15.972972+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:32:14.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770751+0000","last_change":"2024-08-31T06:02:30.606437+0000","last_active":"2024-08-31T06:03:15.770751+0000","last_peered":"2024-08-31T06:03:15.770751+0000","last_clean":"2024-08-31T06:03:15.770751+0000","last_became_active":"2024-08-31T06:02:30.605632+0000","last_became_peered":"2024-08-31T06:02:30.605632+0000","last_unstale":"2024-08-31T06:03:15.770751+0000","last_undegraded":"2024-08-31T06:03:15.770751+0000","last_fullsized":"2024-08-31T06:03:15.770751+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:47.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:16.212432+0000","last_change":"2024-08-31T06:02:30.605456+0000","last_active":"2024-08-31T06:03:16.212432+0000","last_peered":"2024-08-31T06:03:16.212432+0000","last_clean":"2024-08-31T06:03:16.212432+0000","last_became_active":"2024-08-31T06:02:30.604927+0000","last_became_peered":"2024-08-31T06:02:30.604927+0000","last_unstale":"2024-08-31T06:03:16.212432+0000","last_undegraded":"2024-08-31T06:03:16.212432+0000","last_fullsized":"2024-08-31T06:03:16.212432+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:30.340609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767283+0000","last_change":"2024-08-31T06:02:30.608595+0000","last_active":"2024-08-31T06:03:15.767283+0000","last_peered":"2024-08-31T06:03:15.767283+0000","last_clean":"2024-08-31T06:03:15.767283+0000","last_became_active":"2024-08-31T06:02:30.607695+0000","last_became_peered":"2024-08-31T06:02:30.607695+0000","last_unstale":"2024-08-31T06:03:15.767283+0000","last_undegraded":"2024-08-31T06:03:15.767283+0000","last_fullsized":"2024-08-31T06:03:15.767283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:44:53.655598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765767+0000","last_change":"2024-08-31T06:02:30.595775+0000","last_active":"2024-08-31T06:03:15.765767+0000","last_peered":"2024-08-31T06:03:15.765767+0000","last_clean":"2024-08-31T06:03:15.765767+0000","last_became_active":"2024-08-31T06:02:30.595424+0000","last_became_peered":"2024-08-31T06:02:30.595424+0000","last_unstale":"2024-08-31T06:03:15.765767+0000","last_undegraded":"2024-08-31T06:03:15.765767+0000","last_fullsized":"2024-08-31T06:03:15.765767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:56.382633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768846+0000","last_change":"2024-08-31T06:02:30.603465+0000","last_active":"2024-08-31T06:03:15.768846+0000","last_peered":"2024-08-31T06:03:15.768846+0000","last_clean":"2024-08-31T06:03:15.768846+0000","last_became_active":"2024-08-31T06:02:30.603041+0000","last_became_peered":"2024-08-31T06:02:30.603041+0000","last_unstale":"2024-08-31T06:03:15.768846+0000","last_undegraded":"2024-08-31T06:03:15.768846+0000","last_fullsized":"2024-08-31T06:03:15.768846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:19:00.139973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768033+0000","last_change":"2024-08-31T06:02:30.593807+0000","last_active":"2024-08-31T06:03:15.768033+0000","last_peered":"2024-08-31T06:03:15.768033+0000","last_clean":"2024-08-31T06:03:15.768033+0000","last_became_active":"2024-08-31T06:02:30.593389+0000","last_became_peered":"2024-08-31T06:02:30.593389+0000","last_unstale":"2024-08-31T06:03:15.768033+0000","last_undegraded":"2024-08-31T06:03:15.768033+0000","last_fullsized":"2024-08-31T06:03:15.768033+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:01:04.398867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768036+0000","last_change":"2024-08-31T06:02:30.605207+0000","last_active":"2024-08-31T06:03:15.768036+0000","last_peered":"2024-08-31T06:03:15.768036+0000","last_clean":"2024-08-31T06:03:15.768036+0000","last_became_active":"2024-08-31T06:02:30.604866+0000","last_became_peered":"2024-08-31T06:02:30.604866+0000","last_unstale":"2024-08-31T06:03:15.768036+0000","last_undegraded":"2024-08-31T06:03:15.768036+0000","last_fullsized":"2024-08-31T06:03:15.768036+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:56.305638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.771878+0000","last_change":"2024-08-31T06:02:30.601457+0000","last_active":"2024-08-31T06:03:15.771878+0000","last_peered":"2024-08-31T06:03:15.771878+0000","last_clean":"2024-08-31T06:03:15.771878+0000","last_became_active":"2024-08-31T06:02:30.601077+0000","last_became_peered":"2024-08-31T06:02:30.601077+0000","last_unstale":"2024-08-31T06:03:15.771878+0000","last_undegraded":"2024-08-31T06:03:15.771878+0000","last_fullsized":"2024-08-31T06:03:15.771878+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:51:42.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768395+0000","last_change":"2024-08-31T06:02:30.612475+0000","last_active":"2024-08-31T06:03:15.768395+0000","last_peered":"2024-08-31T06:03:15.768395+0000","last_clean":"2024-08-31T06:03:15.768395+0000","last_became_active":"2024-08-31T06:02:30.612088+0000","last_became_peered":"2024-08-31T06:02:30.612088+0000","last_unstale":"2024-08-31T06:03:15.768395+0000","last_undegraded":"2024-08-31T06:03:15.768395+0000","last_fullsized":"2024-08-31T06:03:15.768395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:34.348645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767288+0000","last_change":"2024-08-31T06:02:30.605612+0000","last_active":"2024-08-31T06:03:15.767288+0000","last_peered":"2024-08-31T06:03:15.767288+0000","last_clean":"2024-08-31T06:03:15.767288+0000","last_became_active":"2024-08-31T06:02:30.605271+0000","last_became_peered":"2024-08-31T06:02:30.605271+0000","last_unstale":"2024-08-31T06:03:15.767288+0000","last_undegraded":"2024-08-31T06:03:15.767288+0000","last_fullsized":"2024-08-31T06:03:15.767288+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:38.003500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.774707+0000","last_change":"2024-08-31T06:02:30.610328+0000","last_active":"2024-08-31T06:03:15.774707+0000","last_peered":"2024-08-31T06:03:15.774707+0000","last_clean":"2024-08-31T06:03:15.774707+0000","last_became_active":"2024-08-31T06:02:30.609935+0000","last_became_peered":"2024-08-31T06:02:30.609935+0000","last_unstale":"2024-08-31T06:03:15.774707+0000","last_undegraded":"2024-08-31T06:03:15.774707+0000","last_fullsized":"2024-08-31T06:03:15.774707+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:22.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.766951+0000","last_change":"2024-08-31T06:02:30.609207+0000","last_active":"2024-08-31T06:03:15.766951+0000","last_peered":"2024-08-31T06:03:15.766951+0000","last_clean":"2024-08-31T06:03:15.766951+0000","last_became_active":"2024-08-31T06:02:30.608635+0000","last_became_peered":"2024-08-31T06:02:30.608635+0000","last_unstale":"2024-08-31T06:03:15.766951+0000","last_undegraded":"2024-08-31T06:03:15.766951+0000","last_fullsized":"2024-08-31T06:03:15.766951+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:43.898073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768850+0000","last_change":"2024-08-31T06:02:30.595829+0000","last_active":"2024-08-31T06:03:15.768850+0000","last_peered":"2024-08-31T06:03:15.768850+0000","last_clean":"2024-08-31T06:03:15.768850+0000","last_became_active":"2024-08-31T06:02:30.595427+0000","last_became_peered":"2024-08-31T06:02:30.595427+0000","last_unstale":"2024-08-31T06:03:15.768850+0000","last_undegraded":"2024-08-31T06:03:15.768850+0000","last_fullsized":"2024-08-31T06:03:15.768850+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:09:39.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770261+0000","last_change":"2024-08-31T06:02:30.599513+0000","last_active":"2024-08-31T06:03:15.770261+0000","last_peered":"2024-08-31T06:03:15.770261+0000","last_clean":"2024-08-31T06:03:15.770261+0000","last_became_active":"2024-08-31T06:02:30.599195+0000","last_became_peered":"2024-08-31T06:02:30.599195+0000","last_unstale":"2024-08-31T06:03:15.770261+0000","last_undegraded":"2024-08-31T06:03:15.770261+0000","last_fullsized":"2024-08-31T06:03:15.770261+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:26.669658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973039+0000","last_change":"2024-08-31T06:02:30.609229+0000","last_active":"2024-08-31T06:03:15.973039+0000","last_peered":"2024-08-31T06:03:15.973039+0000","last_clean":"2024-08-31T06:03:15.973039+0000","last_became_active":"2024-08-31T06:02:30.608536+0000","last_became_peered":"2024-08-31T06:02:30.608536+0000","last_unstale":"2024-08-31T06:03:15.973039+0000","last_undegraded":"2024-08-31T06:03:15.973039+0000","last_fullsized":"2024-08-31T06:03:15.973039+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:08.917901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765060+0000","last_change":"2024-08-31T06:02:30.603663+0000","last_active":"2024-08-31T06:03:15.765060+0000","last_peered":"2024-08-31T06:03:15.765060+0000","last_clean":"2024-08-31T06:03:15.765060+0000","last_became_active":"2024-08-31T06:02:30.603220+0000","last_became_peered":"2024-08-31T06:02:30.603220+0000","last_unstale":"2024-08-31T06:03:15.765060+0000","last_undegraded":"2024-08-31T06:03:15.765060+0000","last_fullsized":"2024-08-31T06:03:15.765060+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:09.433078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973618+0000","last_change":"2024-08-31T06:02:30.608474+0000","last_active":"2024-08-31T06:03:15.973618+0000","last_peered":"2024-08-31T06:03:15.973618+0000","last_clean":"2024-08-31T06:03:15.973618+0000","last_became_active":"2024-08-31T06:02:30.608118+0000","last_became_peered":"2024-08-31T06:02:30.608118+0000","last_unstale":"2024-08-31T06:03:15.973618+0000","last_undegraded":"2024-08-31T06:03:15.973618+0000","last_fullsized":"2024-08-31T06:03:15.973618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:55.124001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.774854+0000","last_change":"2024-08-31T06:02:30.614255+0000","last_active":"2024-08-31T06:03:15.774854+0000","last_peered":"2024-08-31T06:03:15.774854+0000","last_clean":"2024-08-31T06:03:15.774854+0000","last_became_active":"2024-08-31T06:02:30.613805+0000","last_became_peered":"2024-08-31T06:02:30.613805+0000","last_unstale":"2024-08-31T06:03:15.774854+0000","last_undegraded":"2024-08-31T06:03:15.774854+0000","last_fullsized":"2024-08-31T06:03:15.774854+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.892997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767249+0000","last_change":"2024-08-31T06:02:30.609877+0000","last_active":"2024-08-31T06:03:15.767249+0000","last_peered":"2024-08-31T06:03:15.767249+0000","last_clean":"2024-08-31T06:03:15.767249+0000","last_became_active":"2024-08-31T06:02:30.608805+0000","last_became_peered":"2024-08-31T06:02:30.608805+0000","last_unstale":"2024-08-31T06:03:15.767249+0000","last_undegraded":"2024-08-31T06:03:15.767249+0000","last_fullsized":"2024-08-31T06:03:15.767249+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:52.172745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768216+0000","last_change":"2024-08-31T06:02:30.594684+0000","last_active":"2024-08-31T06:03:15.768216+0000","last_peered":"2024-08-31T06:03:15.768216+0000","last_clean":"2024-08-31T06:03:15.768216+0000","last_became_active":"2024-08-31T06:02:30.594293+0000","last_became_peered":"2024-08-31T06:02:30.594293+0000","last_unstale":"2024-08-31T06:03:15.768216+0000","last_undegraded":"2024-08-31T06:03:15.768216+0000","last_fullsized":"2024-08-31T06:03:15.768216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:58:39.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768259+0000","last_change":"2024-08-31T06:02:30.602765+0000","last_active":"2024-08-31T06:03:15.768259+0000","last_peered":"2024-08-31T06:03:15.768259+0000","last_clean":"2024-08-31T06:03:15.768259+0000","last_became_active":"2024-08-31T06:02:30.602410+0000","last_became_peered":"2024-08-31T06:02:30.602410+0000","last_unstale":"2024-08-31T06:03:15.768259+0000","last_undegraded":"2024-08-31T06:03:15.768259+0000","last_fullsized":"2024-08-31T06:03:15.768259+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:12.370967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.774287+0000","last_change":"2024-08-31T06:02:30.611818+0000","last_active":"2024-08-31T06:03:15.774287+0000","last_peered":"2024-08-31T06:03:15.774287+0000","last_clean":"2024-08-31T06:03:15.774287+0000","last_became_active":"2024-08-31T06:02:30.610917+0000","last_became_peered":"2024-08-31T06:02:30.610917+0000","last_unstale":"2024-08-31T06:03:15.774287+0000","last_undegraded":"2024-08-31T06:03:15.774287+0000","last_fullsized":"2024-08-31T06:03:15.774287+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:00.895825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.773887+0000","last_change":"2024-08-31T06:02:30.612186+0000","last_active":"2024-08-31T06:03:15.773887+0000","last_peered":"2024-08-31T06:03:15.773887+0000","last_clean":"2024-08-31T06:03:15.773887+0000","last_became_active":"2024-08-31T06:02:30.610496+0000","last_became_peered":"2024-08-31T06:02:30.610496+0000","last_unstale":"2024-08-31T06:03:15.773887+0000","last_undegraded":"2024-08-31T06:03:15.773887+0000","last_fullsized":"2024-08-31T06:03:15.773887+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:48:19.954998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.776622+0000","last_change":"2024-08-31T06:03:15.776507+0000","last_active":"2024-08-31T06:03:15.776622+0000","last_peered":"2024-08-31T06:03:15.776622+0000","last_clean":"2024-08-31T06:03:15.776622+0000","last_became_active":"2024-08-31T06:03:15.776039+0000","last_became_peered":"2024-08-31T06:03:15.776039+0000","last_unstale":"2024-08-31T06:03:15.776622+0000","last_undegraded":"2024-08-31T06:03:15.776622+0000","last_fullsized":"2024-08-31T06:03:15.776622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:41.616112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764418+0000","last_change":"2024-08-31T06:02:30.607864+0000","last_active":"2024-08-31T06:03:15.764418+0000","last_peered":"2024-08-31T06:03:15.764418+0000","last_clean":"2024-08-31T06:03:15.764418+0000","last_became_active":"2024-08-31T06:02:30.607299+0000","last_became_peered":"2024-08-31T06:02:30.607299+0000","last_unstale":"2024-08-31T06:03:15.764418+0000","last_undegraded":"2024-08-31T06:03:15.764418+0000","last_fullsized":"2024-08-31T06:03:15.764418+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:19.302279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"70'6","reported_seq":85,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:33.759558+0000","last_change":"2024-08-31T06:02:28.594973+0000","last_active":"2024-08-31T06:03:33.759558+0000","last_peered":"2024-08-31T06:03:33.759558+0000","last_clean":"2024-08-31T06:03:33.759558+0000","last_became_active":"2024-08-31T06:02:28.594588+0000","last_became_peered":"2024-08-31T06:02:28.594588+0000","last_unstale":"2024-08-31T06:03:33.759558+0000","last_undegraded":"2024-08-31T06:03:33.759558+0000","last_fullsized":"2024-08-31T06:03:33.759558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:29:48.016888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.974618+0000","last_change":"2024-08-31T06:03:15.974504+0000","last_active":"2024-08-31T06:03:15.974618+0000","last_peered":"2024-08-31T06:03:15.974618+0000","last_clean":"2024-08-31T06:03:15.974618+0000","last_became_active":"2024-08-31T06:03:15.974139+0000","last_became_peered":"2024-08-31T06:03:15.974139+0000","last_unstale":"2024-08-31T06:03:15.974618+0000","last_undegraded":"2024-08-31T06:03:15.974618+0000","last_fullsized":"2024-08-31T06:03:15.974618+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:22.742884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"70'7","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:16.212054+0000","last_change":"2024-08-31T06:02:28.589152+0000","last_active":"2024-08-31T06:03:16.212054+0000","last_peered":"2024-08-31T06:03:16.212054+0000","last_clean":"2024-08-31T06:03:16.212054+0000","last_became_active":"2024-08-31T06:02:28.588758+0000","last_became_peered":"2024-08-31T06:02:28.588758+0000","last_unstale":"2024-08-31T06:03:16.212054+0000","last_undegraded":"2024-08-31T06:03:16.212054+0000","last_fullsized":"2024-08-31T06:03:16.212054+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:31.814105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"70'3","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767905+0000","last_change":"2024-08-31T06:02:28.585410+0000","last_active":"2024-08-31T06:03:15.767905+0000","last_peered":"2024-08-31T06:03:15.767905+0000","last_clean":"2024-08-31T06:03:15.767905+0000","last_became_active":"2024-08-31T06:02:28.584998+0000","last_became_peered":"2024-08-31T06:02:28.584998+0000","last_unstale":"2024-08-31T06:03:15.767905+0000","last_undegraded":"2024-08-31T06:03:15.767905+0000","last_fullsized":"2024-08-31T06:03:15.767905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:30.705460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973054+0000","last_change":"2024-08-31T06:02:30.597295+0000","last_active":"2024-08-31T06:03:15.973054+0000","last_peered":"2024-08-31T06:03:15.973054+0000","last_clean":"2024-08-31T06:03:15.973054+0000","last_became_active":"2024-08-31T06:02:30.596968+0000","last_became_peered":"2024-08-31T06:02:30.596968+0000","last_unstale":"2024-08-31T06:03:15.973054+0000","last_undegraded":"2024-08-31T06:03:15.973054+0000","last_fullsized":"2024-08-31T06:03:15.973054+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:38.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"70'3","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765366+0000","last_change":"2024-08-31T06:02:28.594164+0000","last_active":"2024-08-31T06:03:15.765366+0000","last_peered":"2024-08-31T06:03:15.765366+0000","last_clean":"2024-08-31T06:03:15.765366+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:03:15.765366+0000","last_undegraded":"2024-08-31T06:03:15.765366+0000","last_fullsized":"2024-08-31T06:03:15.765366+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:21.780202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.766868+0000","last_change":"2024-08-31T06:02:30.597500+0000","last_active":"2024-08-31T06:03:15.766868+0000","last_peered":"2024-08-31T06:03:15.766868+0000","last_clean":"2024-08-31T06:03:15.766868+0000","last_became_active":"2024-08-31T06:02:30.597147+0000","last_became_peered":"2024-08-31T06:02:30.597147+0000","last_unstale":"2024-08-31T06:03:15.766868+0000","last_undegraded":"2024-08-31T06:03:15.766868+0000","last_fullsized":"2024-08-31T06:03:15.766868+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:34.111288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"70'4","reported_seq":129,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:32.756972+0000","last_change":"2024-08-31T06:02:28.585769+0000","last_active":"2024-08-31T06:03:32.756972+0000","last_peered":"2024-08-31T06:03:32.756972+0000","last_clean":"2024-08-31T06:03:32.756972+0000","last_became_active":"2024-08-31T06:02:28.585310+0000","last_became_peered":"2024-08-31T06:02:28.585310+0000","last_unstale":"2024-08-31T06:03:32.756972+0000","last_undegraded":"2024-08-31T06:03:32.756972+0000","last_fullsized":"2024-08-31T06:03:32.756972+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:40.595986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770539+0000","last_change":"2024-08-31T06:02:30.601434+0000","last_active":"2024-08-31T06:03:15.770539+0000","last_peered":"2024-08-31T06:03:15.770539+0000","last_clean":"2024-08-31T06:03:15.770539+0000","last_became_active":"2024-08-31T06:02:30.601060+0000","last_became_peered":"2024-08-31T06:02:30.601060+0000","last_unstale":"2024-08-31T06:03:15.770539+0000","last_undegraded":"2024-08-31T06:03:15.770539+0000","last_fullsized":"2024-08-31T06:03:15.770539+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:32.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"70'4","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767511+0000","last_change":"2024-08-31T06:02:28.593217+0000","last_active":"2024-08-31T06:03:15.767511+0000","last_peered":"2024-08-31T06:03:15.767511+0000","last_clean":"2024-08-31T06:03:15.767511+0000","last_became_active":"2024-08-31T06:02:28.592801+0000","last_became_peered":"2024-08-31T06:02:28.592801+0000","last_unstale":"2024-08-31T06:03:15.767511+0000","last_undegraded":"2024-08-31T06:03:15.767511+0000","last_fullsized":"2024-08-31T06:03:15.767511+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:21.561089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770905+0000","last_change":"2024-08-31T06:03:15.770625+0000","last_active":"2024-08-31T06:03:15.770905+0000","last_peered":"2024-08-31T06:03:15.770905+0000","last_clean":"2024-08-31T06:03:15.770905+0000","last_became_active":"2024-08-31T06:03:15.770194+0000","last_became_peered":"2024-08-31T06:03:15.770194+0000","last_unstale":"2024-08-31T06:03:15.770905+0000","last_undegraded":"2024-08-31T06:03:15.770905+0000","last_fullsized":"2024-08-31T06:03:15.770905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:33:57.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"70'5","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765567+0000","last_change":"2024-08-31T06:02:28.781606+0000","last_active":"2024-08-31T06:03:15.765567+0000","last_peered":"2024-08-31T06:03:15.765567+0000","last_clean":"2024-08-31T06:03:15.765567+0000","last_became_active":"2024-08-31T06:02:28.780886+0000","last_became_peered":"2024-08-31T06:02:28.780886+0000","last_unstale":"2024-08-31T06:03:15.765567+0000","last_undegraded":"2024-08-31T06:03:15.765567+0000","last_fullsized":"2024-08-31T06:03:15.765567+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:07.540461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770268+0000","last_change":"2024-08-31T06:02:30.604358+0000","last_active":"2024-08-31T06:03:15.770268+0000","last_peered":"2024-08-31T06:03:15.770268+0000","last_clean":"2024-08-31T06:03:15.770268+0000","last_became_active":"2024-08-31T06:02:30.603980+0000","last_became_peered":"2024-08-31T06:02:30.603980+0000","last_unstale":"2024-08-31T06:03:15.770268+0000","last_undegraded":"2024-08-31T06:03:15.770268+0000","last_fullsized":"2024-08-31T06:03:15.770268+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:43:03.062141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"70'30","reported_seq":164,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:32.757036+0000","last_change":"2024-08-31T06:02:28.590795+0000","last_active":"2024-08-31T06:03:32.757036+0000","last_peered":"2024-08-31T06:03:32.757036+0000","last_clean":"2024-08-31T06:03:32.757036+0000","last_became_active":"2024-08-31T06:02:28.590397+0000","last_became_peered":"2024-08-31T06:02:28.590397+0000","last_unstale":"2024-08-31T06:03:32.757036+0000","last_undegraded":"2024-08-31T06:03:32.757036+0000","last_fullsized":"2024-08-31T06:03:32.757036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:30.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":113,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764664+0000","last_change":"2024-08-31T06:02:30.603110+0000","last_active":"2024-08-31T06:03:15.764664+0000","last_peered":"2024-08-31T06:03:15.764664+0000","last_clean":"2024-08-31T06:03:15.764664+0000","last_became_active":"2024-08-31T06:02:30.602691+0000","last_became_peered":"2024-08-31T06:02:30.602691+0000","last_unstale":"2024-08-31T06:03:15.764664+0000","last_undegraded":"2024-08-31T06:03:15.764664+0000","last_fullsized":"2024-08-31T06:03:15.764664+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:20.009202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"70'9","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.774108+0000","last_change":"2024-08-31T06:02:28.591126+0000","last_active":"2024-08-31T06:03:15.774108+0000","last_peered":"2024-08-31T06:03:15.774108+0000","last_clean":"2024-08-31T06:03:15.774108+0000","last_became_active":"2024-08-31T06:02:28.590744+0000","last_became_peered":"2024-08-31T06:02:28.590744+0000","last_unstale":"2024-08-31T06:03:15.774108+0000","last_undegraded":"2024-08-31T06:03:15.774108+0000","last_fullsized":"2024-08-31T06:03:15.774108+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:43.910807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767860+0000","last_change":"2024-08-31T06:02:30.599843+0000","last_active":"2024-08-31T06:03:15.767860+0000","last_peered":"2024-08-31T06:03:15.767860+0000","last_clean":"2024-08-31T06:03:15.767860+0000","last_became_active":"2024-08-31T06:02:30.599440+0000","last_became_peered":"2024-08-31T06:02:30.599440+0000","last_unstale":"2024-08-31T06:03:15.767860+0000","last_undegraded":"2024-08-31T06:03:15.767860+0000","last_fullsized":"2024-08-31T06:03:15.767860+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:01.029482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"70'5","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765542+0000","last_change":"2024-08-31T06:02:28.594178+0000","last_active":"2024-08-31T06:03:15.765542+0000","last_peered":"2024-08-31T06:03:15.765542+0000","last_clean":"2024-08-31T06:03:15.765542+0000","last_became_active":"2024-08-31T06:02:28.593802+0000","last_became_peered":"2024-08-31T06:02:28.593802+0000","last_unstale":"2024-08-31T06:03:15.765542+0000","last_undegraded":"2024-08-31T06:03:15.765542+0000","last_fullsized":"2024-08-31T06:03:15.765542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:52.561582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767046+0000","last_change":"2024-08-31T06:02:30.595979+0000","last_active":"2024-08-31T06:03:15.767046+0000","last_peered":"2024-08-31T06:03:15.767046+0000","last_clean":"2024-08-31T06:03:15.767046+0000","last_became_active":"2024-08-31T06:02:30.595665+0000","last_became_peered":"2024-08-31T06:02:30.595665+0000","last_unstale":"2024-08-31T06:03:15.767046+0000","last_undegraded":"2024-08-31T06:03:15.767046+0000","last_fullsized":"2024-08-31T06:03:15.767046+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:40.347954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"70'6","reported_seq":82,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:30.754946+0000","last_change":"2024-08-31T06:02:28.594117+0000","last_active":"2024-08-31T06:03:30.754946+0000","last_peered":"2024-08-31T06:03:30.754946+0000","last_clean":"2024-08-31T06:03:30.754946+0000","last_became_active":"2024-08-31T06:02:28.593721+0000","last_became_peered":"2024-08-31T06:02:28.593721+0000","last_unstale":"2024-08-31T06:03:30.754946+0000","last_undegraded":"2024-08-31T06:03:30.754946+0000","last_fullsized":"2024-08-31T06:03:30.754946+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:48:49.400841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768131+0000","last_change":"2024-08-31T06:02:30.606967+0000","last_active":"2024-08-31T06:03:15.768131+0000","last_peered":"2024-08-31T06:03:15.768131+0000","last_clean":"2024-08-31T06:03:15.768131+0000","last_became_active":"2024-08-31T06:02:30.605730+0000","last_became_peered":"2024-08-31T06:02:30.605730+0000","last_unstale":"2024-08-31T06:03:15.768131+0000","last_undegraded":"2024-08-31T06:03:15.768131+0000","last_fullsized":"2024-08-31T06:03:15.768131+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:30.656071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"70'17","reported_seq":41,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764138+0000","last_change":"2024-08-31T06:02:28.780911+0000","last_active":"2024-08-31T06:03:15.764138+0000","last_peered":"2024-08-31T06:03:15.764138+0000","last_clean":"2024-08-31T06:03:15.764138+0000","last_became_active":"2024-08-31T06:02:28.780375+0000","last_became_peered":"2024-08-31T06:02:28.780375+0000","last_unstale":"2024-08-31T06:03:15.764138+0000","last_undegraded":"2024-08-31T06:03:15.764138+0000","last_fullsized":"2024-08-31T06:03:15.764138+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:46.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765140+0000","last_change":"2024-08-31T06:02:30.606871+0000","last_active":"2024-08-31T06:03:15.765140+0000","last_peered":"2024-08-31T06:03:15.765140+0000","last_clean":"2024-08-31T06:03:15.765140+0000","last_became_active":"2024-08-31T06:02:30.606507+0000","last_became_peered":"2024-08-31T06:02:30.606507+0000","last_unstale":"2024-08-31T06:03:15.765140+0000","last_undegraded":"2024-08-31T06:03:15.765140+0000","last_fullsized":"2024-08-31T06:03:15.765140+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:16:31.502034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"70'2","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765147+0000","last_change":"2024-08-31T06:02:28.588078+0000","last_active":"2024-08-31T06:03:15.765147+0000","last_peered":"2024-08-31T06:03:15.765147+0000","last_clean":"2024-08-31T06:03:15.765147+0000","last_became_active":"2024-08-31T06:02:28.587642+0000","last_became_peered":"2024-08-31T06:02:28.587642+0000","last_unstale":"2024-08-31T06:03:15.765147+0000","last_undegraded":"2024-08-31T06:03:15.765147+0000","last_fullsized":"2024-08-31T06:03:15.765147+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:59.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767455+0000","last_change":"2024-08-31T06:02:30.605647+0000","last_active":"2024-08-31T06:03:15.767455+0000","last_peered":"2024-08-31T06:03:15.767455+0000","last_clean":"2024-08-31T06:03:15.767455+0000","last_became_active":"2024-08-31T06:02:30.605267+0000","last_became_peered":"2024-08-31T06:02:30.605267+0000","last_unstale":"2024-08-31T06:03:15.767455+0000","last_undegraded":"2024-08-31T06:03:15.767455+0000","last_fullsized":"2024-08-31T06:03:15.767455+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:08:34.741030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"70'5","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768574+0000","last_change":"2024-08-31T06:02:28.585295+0000","last_active":"2024-08-31T06:03:15.768574+0000","last_peered":"2024-08-31T06:03:15.768574+0000","last_clean":"2024-08-31T06:03:15.768574+0000","last_became_active":"2024-08-31T06:02:28.584895+0000","last_became_peered":"2024-08-31T06:02:28.584895+0000","last_unstale":"2024-08-31T06:03:15.768574+0000","last_undegraded":"2024-08-31T06:03:15.768574+0000","last_fullsized":"2024-08-31T06:03:15.768574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:57:12.658937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767453+0000","last_change":"2024-08-31T06:02:30.603593+0000","last_active":"2024-08-31T06:03:15.767453+0000","last_peered":"2024-08-31T06:03:15.767453+0000","last_clean":"2024-08-31T06:03:15.767453+0000","last_became_active":"2024-08-31T06:02:30.603274+0000","last_became_peered":"2024-08-31T06:02:30.603274+0000","last_unstale":"2024-08-31T06:03:15.767453+0000","last_undegraded":"2024-08-31T06:03:15.767453+0000","last_fullsized":"2024-08-31T06:03:15.767453+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:07.720406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"70'3","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765605+0000","last_change":"2024-08-31T06:02:28.586920+0000","last_active":"2024-08-31T06:03:15.765605+0000","last_peered":"2024-08-31T06:03:15.765605+0000","last_clean":"2024-08-31T06:03:15.765605+0000","last_became_active":"2024-08-31T06:02:28.586362+0000","last_became_peered":"2024-08-31T06:02:28.586362+0000","last_unstale":"2024-08-31T06:03:15.765605+0000","last_undegraded":"2024-08-31T06:03:15.765605+0000","last_fullsized":"2024-08-31T06:03:15.765605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:52.065879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"70'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767127+0000","last_change":"2024-08-31T06:02:30.603800+0000","last_active":"2024-08-31T06:03:15.767127+0000","last_peered":"2024-08-31T06:03:15.767127+0000","last_clean":"2024-08-31T06:03:15.767127+0000","last_became_active":"2024-08-31T06:02:30.603439+0000","last_became_peered":"2024-08-31T06:02:30.603439+0000","last_unstale":"2024-08-31T06:03:15.767127+0000","last_undegraded":"2024-08-31T06:03:15.767127+0000","last_fullsized":"2024-08-31T06:03:15.767127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:39.992719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"70'5","reported_seq":83,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:33.759208+0000","last_change":"2024-08-31T06:02:28.936404+0000","last_active":"2024-08-31T06:03:33.759208+0000","last_peered":"2024-08-31T06:03:33.759208+0000","last_clean":"2024-08-31T06:03:33.759208+0000","last_became_active":"2024-08-31T06:02:28.935898+0000","last_became_peered":"2024-08-31T06:02:28.935898+0000","last_unstale":"2024-08-31T06:03:33.759208+0000","last_undegraded":"2024-08-31T06:03:33.759208+0000","last_fullsized":"2024-08-31T06:03:33.759208+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:35.004510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767422+0000","last_change":"2024-08-31T06:02:30.608258+0000","last_active":"2024-08-31T06:03:15.767422+0000","last_peered":"2024-08-31T06:03:15.767422+0000","last_clean":"2024-08-31T06:03:15.767422+0000","last_became_active":"2024-08-31T06:02:30.607067+0000","last_became_peered":"2024-08-31T06:02:30.607067+0000","last_unstale":"2024-08-31T06:03:15.767422+0000","last_undegraded":"2024-08-31T06:03:15.767422+0000","last_fullsized":"2024-08-31T06:03:15.767422+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:03:09.362812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":92,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768256+0000","last_change":"2024-08-31T06:01:19.125033+0000","last_active":"2024-08-31T06:03:15.768256+0000","last_peered":"2024-08-31T06:03:15.768256+0000","last_clean":"2024-08-31T06:03:15.768256+0000","last_became_active":"2024-08-31T06:01:19.118469+0000","last_became_peered":"2024-08-31T06:01:19.118469+0000","last_unstale":"2024-08-31T06:03:15.768256+0000","last_undegraded":"2024-08-31T06:03:15.768256+0000","last_fullsized":"2024-08-31T06:03:15.768256+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_clean_scrub_stamp":"2024-08-31T05:58:05.259854+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:33.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"70'6","reported_seq":32,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765883+0000","last_change":"2024-08-31T06:02:28.588276+0000","last_active":"2024-08-31T06:03:15.765883+0000","last_peered":"2024-08-31T06:03:15.765883+0000","last_clean":"2024-08-31T06:03:15.765883+0000","last_became_active":"2024-08-31T06:02:28.587184+0000","last_became_peered":"2024-08-31T06:02:28.587184+0000","last_unstale":"2024-08-31T06:03:15.765883+0000","last_undegraded":"2024-08-31T06:03:15.765883+0000","last_fullsized":"2024-08-31T06:03:15.765883+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:12.762919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973347+0000","last_change":"2024-08-31T06:02:30.610801+0000","last_active":"2024-08-31T06:03:15.973347+0000","last_peered":"2024-08-31T06:03:15.973347+0000","last_clean":"2024-08-31T06:03:15.973347+0000","last_became_active":"2024-08-31T06:02:30.610446+0000","last_became_peered":"2024-08-31T06:02:30.610446+0000","last_unstale":"2024-08-31T06:03:15.973347+0000","last_undegraded":"2024-08-31T06:03:15.973347+0000","last_fullsized":"2024-08-31T06:03:15.973347+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:17.891734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"70'4","reported_seq":38,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.777260+0000","last_change":"2024-08-31T06:03:15.777123+0000","last_active":"2024-08-31T06:03:15.777260+0000","last_peered":"2024-08-31T06:03:15.777260+0000","last_clean":"2024-08-31T06:03:15.777260+0000","last_became_active":"2024-08-31T06:03:15.773099+0000","last_became_peered":"2024-08-31T06:03:15.773099+0000","last_unstale":"2024-08-31T06:03:15.777260+0000","last_undegraded":"2024-08-31T06:03:15.777260+0000","last_fullsized":"2024-08-31T06:03:15.777260+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:56:51.706692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.776507+0000","last_change":"2024-08-31T06:03:15.776402+0000","last_active":"2024-08-31T06:03:15.776507+0000","last_peered":"2024-08-31T06:03:15.776507+0000","last_clean":"2024-08-31T06:03:15.776507+0000","last_became_active":"2024-08-31T06:03:15.775949+0000","last_became_peered":"2024-08-31T06:03:15.775949+0000","last_unstale":"2024-08-31T06:03:15.776507+0000","last_undegraded":"2024-08-31T06:03:15.776507+0000","last_fullsized":"2024-08-31T06:03:15.776507+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:51:34.646125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"70'5","reported_seq":83,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:34.760126+0000","last_change":"2024-08-31T06:02:28.780419+0000","last_active":"2024-08-31T06:03:34.760126+0000","last_peered":"2024-08-31T06:03:34.760126+0000","last_clean":"2024-08-31T06:03:34.760126+0000","last_became_active":"2024-08-31T06:02:28.779814+0000","last_became_peered":"2024-08-31T06:02:28.779814+0000","last_unstale":"2024-08-31T06:03:34.760126+0000","last_undegraded":"2024-08-31T06:03:34.760126+0000","last_fullsized":"2024-08-31T06:03:34.760126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:36.183841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.776600+0000","last_change":"2024-08-31T06:03:15.776468+0000","last_active":"2024-08-31T06:03:15.776600+0000","last_peered":"2024-08-31T06:03:15.776600+0000","last_clean":"2024-08-31T06:03:15.776600+0000","last_became_active":"2024-08-31T06:03:15.776005+0000","last_became_peered":"2024-08-31T06:03:15.776005+0000","last_unstale":"2024-08-31T06:03:15.776600+0000","last_undegraded":"2024-08-31T06:03:15.776600+0000","last_fullsized":"2024-08-31T06:03:15.776600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:47:36.420584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"70'5","reported_seq":82,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:33.758687+0000","last_change":"2024-08-31T06:02:28.594220+0000","last_active":"2024-08-31T06:03:33.758687+0000","last_peered":"2024-08-31T06:03:33.758687+0000","last_clean":"2024-08-31T06:03:33.758687+0000","last_became_active":"2024-08-31T06:02:28.593729+0000","last_became_peered":"2024-08-31T06:02:28.593729+0000","last_unstale":"2024-08-31T06:03:33.758687+0000","last_undegraded":"2024-08-31T06:03:33.758687+0000","last_fullsized":"2024-08-31T06:03:33.758687+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:37:03.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:16.212155+0000","last_change":"2024-08-31T06:02:30.600008+0000","last_active":"2024-08-31T06:03:16.212155+0000","last_peered":"2024-08-31T06:03:16.212155+0000","last_clean":"2024-08-31T06:03:16.212155+0000","last_became_active":"2024-08-31T06:02:30.599677+0000","last_became_peered":"2024-08-31T06:02:30.599677+0000","last_unstale":"2024-08-31T06:03:16.212155+0000","last_undegraded":"2024-08-31T06:03:16.212155+0000","last_fullsized":"2024-08-31T06:03:16.212155+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:59.520544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"70'1","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.766686+0000","last_change":"2024-08-31T06:02:28.780554+0000","last_active":"2024-08-31T06:03:15.766686+0000","last_peered":"2024-08-31T06:03:15.766686+0000","last_clean":"2024-08-31T06:03:15.766686+0000","last_became_active":"2024-08-31T06:02:28.780137+0000","last_became_peered":"2024-08-31T06:02:28.780137+0000","last_unstale":"2024-08-31T06:03:15.766686+0000","last_undegraded":"2024-08-31T06:03:15.766686+0000","last_fullsized":"2024-08-31T06:03:15.766686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:57.523667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"70'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:16.212216+0000","last_change":"2024-08-31T06:02:30.597438+0000","last_active":"2024-08-31T06:03:16.212216+0000","last_peered":"2024-08-31T06:03:16.212216+0000","last_clean":"2024-08-31T06:03:16.212216+0000","last_became_active":"2024-08-31T06:02:30.597108+0000","last_became_peered":"2024-08-31T06:02:30.597108+0000","last_unstale":"2024-08-31T06:03:16.212216+0000","last_undegraded":"2024-08-31T06:03:16.212216+0000","last_fullsized":"2024-08-31T06:03:16.212216+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:05.238708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"70'4","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764821+0000","last_change":"2024-08-31T06:02:28.781006+0000","last_active":"2024-08-31T06:03:15.764821+0000","last_peered":"2024-08-31T06:03:15.764821+0000","last_clean":"2024-08-31T06:03:15.764821+0000","last_became_active":"2024-08-31T06:02:28.780468+0000","last_became_peered":"2024-08-31T06:02:28.780468+0000","last_unstale":"2024-08-31T06:03:15.764821+0000","last_undegraded":"2024-08-31T06:03:15.764821+0000","last_fullsized":"2024-08-31T06:03:15.764821+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:20.206251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768689+0000","last_change":"2024-08-31T06:02:30.600826+0000","last_active":"2024-08-31T06:03:15.768689+0000","last_peered":"2024-08-31T06:03:15.768689+0000","last_clean":"2024-08-31T06:03:15.768689+0000","last_became_active":"2024-08-31T06:02:30.600474+0000","last_became_peered":"2024-08-31T06:02:30.600474+0000","last_unstale":"2024-08-31T06:03:15.768689+0000","last_undegraded":"2024-08-31T06:03:15.768689+0000","last_fullsized":"2024-08-31T06:03:15.768689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:07.456576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"70'15","reported_seq":38,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.768385+0000","last_change":"2024-08-31T06:02:28.588026+0000","last_active":"2024-08-31T06:03:15.768385+0000","last_peered":"2024-08-31T06:03:15.768385+0000","last_clean":"2024-08-31T06:03:15.768385+0000","last_became_active":"2024-08-31T06:02:28.587759+0000","last_became_peered":"2024-08-31T06:02:28.587759+0000","last_unstale":"2024-08-31T06:03:15.768385+0000","last_undegraded":"2024-08-31T06:03:15.768385+0000","last_fullsized":"2024-08-31T06:03:15.768385+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:44.323111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973586+0000","last_change":"2024-08-31T06:02:30.604375+0000","last_active":"2024-08-31T06:03:15.973586+0000","last_peered":"2024-08-31T06:03:15.973586+0000","last_clean":"2024-08-31T06:03:15.973586+0000","last_became_active":"2024-08-31T06:02:30.604008+0000","last_became_peered":"2024-08-31T06:02:30.604008+0000","last_unstale":"2024-08-31T06:03:15.973586+0000","last_undegraded":"2024-08-31T06:03:15.973586+0000","last_fullsized":"2024-08-31T06:03:15.973586+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:37.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"70'7","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.766179+0000","last_change":"2024-08-31T06:02:28.936568+0000","last_active":"2024-08-31T06:03:15.766179+0000","last_peered":"2024-08-31T06:03:15.766179+0000","last_clean":"2024-08-31T06:03:15.766179+0000","last_became_active":"2024-08-31T06:02:28.936185+0000","last_became_peered":"2024-08-31T06:02:28.936185+0000","last_unstale":"2024-08-31T06:03:15.766179+0000","last_undegraded":"2024-08-31T06:03:15.766179+0000","last_fullsized":"2024-08-31T06:03:15.766179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:34.080300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.771795+0000","last_change":"2024-08-31T06:03:15.771653+0000","last_active":"2024-08-31T06:03:15.771795+0000","last_peered":"2024-08-31T06:03:15.771795+0000","last_clean":"2024-08-31T06:03:15.771795+0000","last_became_active":"2024-08-31T06:03:15.770903+0000","last_became_peered":"2024-08-31T06:03:15.770903+0000","last_unstale":"2024-08-31T06:03:15.771795+0000","last_undegraded":"2024-08-31T06:03:15.771795+0000","last_fullsized":"2024-08-31T06:03:15.771795+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:50.547558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"70'2","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.777706+0000","last_change":"2024-08-31T06:03:15.777577+0000","last_active":"2024-08-31T06:03:15.777706+0000","last_peered":"2024-08-31T06:03:15.777706+0000","last_clean":"2024-08-31T06:03:15.777706+0000","last_became_active":"2024-08-31T06:03:15.773006+0000","last_became_peered":"2024-08-31T06:03:15.773006+0000","last_unstale":"2024-08-31T06:03:15.777706+0000","last_undegraded":"2024-08-31T06:03:15.777706+0000","last_fullsized":"2024-08-31T06:03:15.777706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:31.531741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764100+0000","last_change":"2024-08-31T06:02:30.604018+0000","last_active":"2024-08-31T06:03:15.764100+0000","last_peered":"2024-08-31T06:03:15.764100+0000","last_clean":"2024-08-31T06:03:15.764100+0000","last_became_active":"2024-08-31T06:02:30.603411+0000","last_became_peered":"2024-08-31T06:02:30.603411+0000","last_unstale":"2024-08-31T06:03:15.764100+0000","last_undegraded":"2024-08-31T06:03:15.764100+0000","last_fullsized":"2024-08-31T06:03:15.764100+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:34:30.732954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"70'7","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973166+0000","last_change":"2024-08-31T06:02:28.586348+0000","last_active":"2024-08-31T06:03:15.973166+0000","last_peered":"2024-08-31T06:03:15.973166+0000","last_clean":"2024-08-31T06:03:15.973166+0000","last_became_active":"2024-08-31T06:02:28.586046+0000","last_became_peered":"2024-08-31T06:02:28.586046+0000","last_unstale":"2024-08-31T06:03:15.973166+0000","last_undegraded":"2024-08-31T06:03:15.973166+0000","last_fullsized":"2024-08-31T06:03:15.973166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:30.987232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767422+0000","last_change":"2024-08-31T06:02:30.616402+0000","last_active":"2024-08-31T06:03:15.767422+0000","last_peered":"2024-08-31T06:03:15.767422+0000","last_clean":"2024-08-31T06:03:15.767422+0000","last_became_active":"2024-08-31T06:02:30.616014+0000","last_became_peered":"2024-08-31T06:02:30.616014+0000","last_unstale":"2024-08-31T06:03:15.767422+0000","last_undegraded":"2024-08-31T06:03:15.767422+0000","last_fullsized":"2024-08-31T06:03:15.767422+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:42.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"70'3","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.773856+0000","last_change":"2024-08-31T06:02:28.590184+0000","last_active":"2024-08-31T06:03:15.773856+0000","last_peered":"2024-08-31T06:03:15.773856+0000","last_clean":"2024-08-31T06:03:15.773856+0000","last_became_active":"2024-08-31T06:02:28.588830+0000","last_became_peered":"2024-08-31T06:02:28.588830+0000","last_unstale":"2024-08-31T06:03:15.773856+0000","last_undegraded":"2024-08-31T06:03:15.773856+0000","last_fullsized":"2024-08-31T06:03:15.773856+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:03.072197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973253+0000","last_change":"2024-08-31T06:02:30.597262+0000","last_active":"2024-08-31T06:03:15.973253+0000","last_peered":"2024-08-31T06:03:15.973253+0000","last_clean":"2024-08-31T06:03:15.973253+0000","last_became_active":"2024-08-31T06:02:30.596862+0000","last_became_peered":"2024-08-31T06:02:30.596862+0000","last_unstale":"2024-08-31T06:03:15.973253+0000","last_undegraded":"2024-08-31T06:03:15.973253+0000","last_fullsized":"2024-08-31T06:03:15.973253+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:46:29.378532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"70'4","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764402+0000","last_change":"2024-08-31T06:02:28.594161+0000","last_active":"2024-08-31T06:03:15.764402+0000","last_peered":"2024-08-31T06:03:15.764402+0000","last_clean":"2024-08-31T06:03:15.764402+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:03:15.764402+0000","last_undegraded":"2024-08-31T06:03:15.764402+0000","last_fullsized":"2024-08-31T06:03:15.764402+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:31:17.941172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767286+0000","last_change":"2024-08-31T06:02:30.595194+0000","last_active":"2024-08-31T06:03:15.767286+0000","last_peered":"2024-08-31T06:03:15.767286+0000","last_clean":"2024-08-31T06:03:15.767286+0000","last_became_active":"2024-08-31T06:02:30.594812+0000","last_became_peered":"2024-08-31T06:02:30.594812+0000","last_unstale":"2024-08-31T06:03:15.767286+0000","last_undegraded":"2024-08-31T06:03:15.767286+0000","last_fullsized":"2024-08-31T06:03:15.767286+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:03.224924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.765431+0000","last_change":"2024-08-31T06:02:30.615776+0000","last_active":"2024-08-31T06:03:15.765431+0000","last_peered":"2024-08-31T06:03:15.765431+0000","last_clean":"2024-08-31T06:03:15.765431+0000","last_became_active":"2024-08-31T06:02:30.615385+0000","last_became_peered":"2024-08-31T06:02:30.615385+0000","last_unstale":"2024-08-31T06:03:15.765431+0000","last_undegraded":"2024-08-31T06:03:15.765431+0000","last_fullsized":"2024-08-31T06:03:15.765431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:49.685443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"70'5","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764529+0000","last_change":"2024-08-31T06:02:28.591064+0000","last_active":"2024-08-31T06:03:15.764529+0000","last_peered":"2024-08-31T06:03:15.764529+0000","last_clean":"2024-08-31T06:03:15.764529+0000","last_became_active":"2024-08-31T06:02:28.590643+0000","last_became_peered":"2024-08-31T06:02:28.590643+0000","last_unstale":"2024-08-31T06:03:15.764529+0000","last_undegraded":"2024-08-31T06:03:15.764529+0000","last_fullsized":"2024-08-31T06:03:15.764529+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:01.953317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.770189+0000","last_change":"2024-08-31T06:02:30.600532+0000","last_active":"2024-08-31T06:03:15.770189+0000","last_peered":"2024-08-31T06:03:15.770189+0000","last_clean":"2024-08-31T06:03:15.770189+0000","last_became_active":"2024-08-31T06:02:30.600013+0000","last_became_peered":"2024-08-31T06:02:30.600013+0000","last_unstale":"2024-08-31T06:03:15.770189+0000","last_undegraded":"2024-08-31T06:03:15.770189+0000","last_fullsized":"2024-08-31T06:03:15.770189+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:38.753206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"70'12","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.764679+0000","last_change":"2024-08-31T06:02:28.593921+0000","last_active":"2024-08-31T06:03:15.764679+0000","last_peered":"2024-08-31T06:03:15.764679+0000","last_clean":"2024-08-31T06:03:15.764679+0000","last_became_active":"2024-08-31T06:02:28.593102+0000","last_became_peered":"2024-08-31T06:02:28.593102+0000","last_unstale":"2024-08-31T06:03:15.764679+0000","last_undegraded":"2024-08-31T06:03:15.764679+0000","last_fullsized":"2024-08-31T06:03:15.764679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:30:35.791686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.767605+0000","last_change":"2024-08-31T06:02:30.606524+0000","last_active":"2024-08-31T06:03:15.767605+0000","last_peered":"2024-08-31T06:03:15.767605+0000","last_clean":"2024-08-31T06:03:15.767605+0000","last_became_active":"2024-08-31T06:02:30.606132+0000","last_became_peered":"2024-08-31T06:02:30.606132+0000","last_unstale":"2024-08-31T06:03:15.767605+0000","last_undegraded":"2024-08-31T06:03:15.767605+0000","last_fullsized":"2024-08-31T06:03:15.767605+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:46.566811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"70'2","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.973734+0000","last_change":"2024-08-31T06:02:28.780596+0000","last_active":"2024-08-31T06:03:15.973734+0000","last_peered":"2024-08-31T06:03:15.973734+0000","last_clean":"2024-08-31T06:03:15.973734+0000","last_became_active":"2024-08-31T06:02:28.779908+0000","last_became_peered":"2024-08-31T06:02:28.779908+0000","last_unstale":"2024-08-31T06:03:15.973734+0000","last_undegraded":"2024-08-31T06:03:15.973734+0000","last_fullsized":"2024-08-31T06:03:15.973734+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:01.254340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:15.776979+0000","last_change":"2024-08-31T06:03:15.776271+0000","last_active":"2024-08-31T06:03:15.776979+0000","last_peered":"2024-08-31T06:03:15.776979+0000","last_clean":"2024-08-31T06:03:15.776979+0000","last_became_active":"2024-08-31T06:03:15.775821+0000","last_became_peered":"2024-08-31T06:03:15.775821+0000","last_unstale":"2024-08-31T06:03:15.776979+0000","last_undegraded":"2024-08-31T06:03:15.776979+0000","last_fullsized":"2024-08-31T06:03:15.776979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:52:34.076554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"70'13","reported_seq":88,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-08-31T06:03:31.755146+0000","last_change":"2024-08-31T06:02:28.593773+0000","last_active":"2024-08-31T06:03:31.755146+0000","last_peered":"2024-08-31T06:03:31.755146+0000","last_clean":"2024-08-31T06:03:31.755146+0000","last_became_active":"2024-08-31T06:02:28.593511+0000","last_became_peered":"2024-08-31T06:02:28.593511+0000","last_unstale":"2024-08-31T06:03:31.755146+0000","last_undegraded":"2024-08-31T06:03:31.755146+0000","last_fullsized":"2024-08-31T06:03:31.755146+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:01:50.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66966,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":559,"num_read_kb":352,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":200898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906970,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":802816,"data_stored":397588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070496,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36816,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708336,"statfs":{"total":95995035648,"available":95957336064,"internally_reserved":0,"allocated":1503232,"data_stored":1048770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928234020,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40320,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704832,"statfs":{"total":95995035648,"available":95953747968,"internally_reserved":0,"allocated":827392,"data_stored":397518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397546,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":823296,"data_stored":397896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593774,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1421312,"data_stored":990805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757299,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":811008,"data_stored":397235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953527,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1433600,"data_stored":990092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084348,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":811008,"data_stored":397487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":827392,"data_stored":397060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":458521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":872448,"data_stored":457910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40324,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704828,"statfs":{"total":95995035648,"available":95953743872,"internally_reserved":0,"allocated":831488,"data_stored":398574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:03:38.854 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T06:03:38.854 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-31T06:03:38.854 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-31T06:03:38.854 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-31T06:03:39.117 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:39.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:39 smithi153 ceph-mon[22320]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:03:39.444 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:39 smithi053 ceph-mon[18924]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:03:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.598+0000 7fb664a17640 1 -- 172.21.15.53:0/2040494937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb660102880 msgr2=0x7fb660102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.598+0000 7fb664a17640 1 --2- 172.21.15.53:0/2040494937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb660102880 0x7fb660102c90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb650009900 tx=0x7fb65002a410 comp rx=0 tx=0).stop 2024-08-31T06:03:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.598+0000 7fb664a17640 1 -- 172.21.15.53:0/2040494937 shutdown_connections 2024-08-31T06:03:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.598+0000 7fb664a17640 1 --2- 172.21.15.53:0/2040494937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb660108ac0 0x7fb66010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.598+0000 7fb664a17640 1 --2- 172.21.15.53:0/2040494937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb660108170 0x7fb660108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.598+0000 7fb664a17640 1 --2- 172.21.15.53:0/2040494937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb660102880 0x7fb660102c90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.598+0000 7fb664a17640 1 -- 172.21.15.53:0/2040494937 >> 172.21.15.53:0/2040494937 conn(0x7fb660079500 msgr2=0x7fb660079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.598+0000 7fb664a17640 1 -- 172.21.15.53:0/2040494937 shutdown_connections 2024-08-31T06:03:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.598+0000 7fb664a17640 1 -- 172.21.15.53:0/2040494937 wait complete. 2024-08-31T06:03:39.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb664a17640 1 Processor -- start 2024-08-31T06:03:39.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb664a17640 1 -- start start 2024-08-31T06:03:39.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb664a17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb660102880 0x7fb66019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:39.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb664a17640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb660108170 0x7fb66019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb664a17640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb660108ac0 0x7fb66019f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb664a17640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb660113770 con 0x7fb660102880 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb664a17640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb6601135f0 con 0x7fb660108170 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb664a17640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb6601138f0 con 0x7fb660108ac0 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb65e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb660102880 0x7fb66019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb65e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb660102880 0x7fb66019a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46444/0 (socket says 172.21.15.53:46444) 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb65e59c640 1 -- 172.21.15.53:0/3861193614 learned_addr learned my addr 172.21.15.53:0/3861193614 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb65dd9b640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb660108170 0x7fb66019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb65ed9d640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb660108ac0 0x7fb66019f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb65e59c640 1 -- 172.21.15.53:0/3861193614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb660108ac0 msgr2=0x7fb66019f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb65e59c640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb660108ac0 0x7fb66019f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb65e59c640 1 -- 172.21.15.53:0/3861193614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb660108170 msgr2=0x7fb66019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb65e59c640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb660108170 0x7fb66019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb65e59c640 1 -- 172.21.15.53:0/3861193614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6601a00d0 con 0x7fb660102880 2024-08-31T06:03:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.599+0000 7fb65ed9d640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb660108ac0 0x7fb66019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.600+0000 7fb65e59c640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb660102880 0x7fb66019a160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb650009230 tx=0x7fb650004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.600+0000 7fb64f7fe640 1 -- 172.21.15.53:0/3861193614 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65003f030 con 0x7fb660102880 2024-08-31T06:03:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.600+0000 7fb664a17640 1 -- 172.21.15.53:0/3861193614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6601a0360 con 0x7fb660102880 2024-08-31T06:03:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.600+0000 7fb64f7fe640 1 -- 172.21.15.53:0/3861193614 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb650003a80 con 0x7fb660102880 2024-08-31T06:03:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.600+0000 7fb64f7fe640 1 -- 172.21.15.53:0/3861193614 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650035070 con 0x7fb660102880 2024-08-31T06:03:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.600+0000 7fb664a17640 1 -- 172.21.15.53:0/3861193614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6601a6b20 con 0x7fb660102880 2024-08-31T06:03:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.601+0000 7fb664a17640 1 -- 172.21.15.53:0/3861193614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb660103ab0 con 0x7fb660102880 2024-08-31T06:03:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.603+0000 7fb64f7fe640 1 -- 172.21.15.53:0/3861193614 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fb650042030 con 0x7fb660102880 2024-08-31T06:03:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.603+0000 7fb64f7fe640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c10 0x7fb6480b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.603+0000 7fb65dd9b640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c10 0x7fb6480b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.603+0000 7fb64f7fe640 1 -- 172.21.15.53:0/3861193614 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fb650105f60 con 0x7fb660102880 2024-08-31T06:03:39.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.604+0000 7fb65dd9b640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c10 0x7fb6480b7120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb660079c00 tx=0x7fb65400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.607+0000 7fb64f7fe640 1 -- 172.21.15.53:0/3861193614 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb6500cce30 con 0x7fb660102880 2024-08-31T06:03:39.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:39 smithi130 ceph-mon[22266]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:03:39.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.834+0000 7fb664a17640 1 -- 172.21.15.53:0/3861193614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb660102c90 con 0x7fb660102880 2024-08-31T06:03:39.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.834+0000 7fb64f7fe640 1 -- 172.21.15.53:0/3861193614 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb6500d5370 con 0x7fb660102880 2024-08-31T06:03:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:03:39.836 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-31T06:03:39.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.836+0000 7fb664a17640 1 -- 172.21.15.53:0/3861193614 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c10 msgr2=0x7fb6480b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:39.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.836+0000 7fb664a17640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c10 0x7fb6480b7120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb660079c00 tx=0x7fb65400b390 comp rx=0 tx=0).stop 2024-08-31T06:03:39.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.836+0000 7fb664a17640 1 -- 172.21.15.53:0/3861193614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb660102880 msgr2=0x7fb66019a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:39.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.836+0000 7fb664a17640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb660102880 0x7fb66019a160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb650009230 tx=0x7fb650004270 comp rx=0 tx=0).stop 2024-08-31T06:03:39.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.836+0000 7fb664a17640 1 -- 172.21.15.53:0/3861193614 shutdown_connections 2024-08-31T06:03:39.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.836+0000 7fb664a17640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb6480b4c10 0x7fb6480b7120 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:39.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.836+0000 7fb664a17640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb660108ac0 0x7fb66019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:39.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.836+0000 7fb664a17640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb660108170 0x7fb66019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:39.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.836+0000 7fb664a17640 1 --2- 172.21.15.53:0/3861193614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb660102880 0x7fb66019a160 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:39.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.836+0000 7fb664a17640 1 -- 172.21.15.53:0/3861193614 >> 172.21.15.53:0/3861193614 conn(0x7fb660079500 msgr2=0x7fb660101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:39.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.837+0000 7fb664a17640 1 -- 172.21.15.53:0/3861193614 shutdown_connections 2024-08-31T06:03:39.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:39.837+0000 7fb664a17640 1 -- 172.21.15.53:0/3861193614 wait complete. 2024-08-31T06:03:40.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:40 smithi153 ceph-mon[22320]: pgmap v282: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:40.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:40 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3861193614' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T06:03:40.456 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:40 smithi053 ceph-mon[18924]: pgmap v282: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:40.457 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:40 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3861193614' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T06:03:40.485 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-31T06:03:40.486 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:03:40.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:40 smithi130 ceph-mon[22266]: pgmap v282: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:40.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:40 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3861193614' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T06:03:40.743 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:41.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.225+0000 7fc0da500640 1 -- 172.21.15.53:0/1824549772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0d4102390 msgr2=0x7fc0d41027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:41.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.225+0000 7fc0da500640 1 --2- 172.21.15.53:0/1824549772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0d4102390 0x7fc0d41027a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009900 tx=0x7fc0c402a480 comp rx=0 tx=0).stop 2024-08-31T06:03:41.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.225+0000 7fc0da500640 1 -- 172.21.15.53:0/1824549772 shutdown_connections 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.225+0000 7fc0da500640 1 --2- 172.21.15.53:0/1824549772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d410ff40 0x7fc0d4112360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.225+0000 7fc0da500640 1 --2- 172.21.15.53:0/1824549772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4102ce0 0x7fc0d410fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.225+0000 7fc0da500640 1 --2- 172.21.15.53:0/1824549772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0d4102390 0x7fc0d41027a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.225+0000 7fc0da500640 1 -- 172.21.15.53:0/1824549772 >> 172.21.15.53:0/1824549772 conn(0x7fc0d40794e0 msgr2=0x7fc0d40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.225+0000 7fc0da500640 1 -- 172.21.15.53:0/1824549772 shutdown_connections 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.225+0000 7fc0da500640 1 -- 172.21.15.53:0/1824549772 wait complete. 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.225+0000 7fc0da500640 1 Processor -- start 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.225+0000 7fc0da500640 1 -- start start 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0da500640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0d4102390 0x7fc0d419c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0da500640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4102ce0 0x7fc0d419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0da500640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d410ff40 0x7fc0d41a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0da500640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d41158e0 con 0x7fc0d4102390 2024-08-31T06:03:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0da500640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d4115760 con 0x7fc0d4102ce0 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0da500640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d4115a60 con 0x7fc0d410ff40 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0d3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0d4102390 0x7fc0d419c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0d3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0d4102390 0x7fc0d419c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46462/0 (socket says 172.21.15.53:46462) 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0d3fff640 1 -- 172.21.15.53:0/45689584 learned_addr learned my addr 172.21.15.53:0/45689584 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0d37fe640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4102ce0 0x7fc0d419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0d8a9d640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d410ff40 0x7fc0d41a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0d3fff640 1 -- 172.21.15.53:0/45689584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d410ff40 msgr2=0x7fc0d41a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0d3fff640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d410ff40 0x7fc0d41a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0d3fff640 1 -- 172.21.15.53:0/45689584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4102ce0 msgr2=0x7fc0d419c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0d3fff640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4102ce0 0x7fc0d419c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0d3fff640 1 -- 172.21.15.53:0/45689584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d41a2280 con 0x7fc0d4102390 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.226+0000 7fc0d3fff640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0d4102390 0x7fc0d419c310 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009230 tx=0x7fc0c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.227+0000 7fc0d17fa640 1 -- 172.21.15.53:0/45689584 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c403f030 con 0x7fc0d4102390 2024-08-31T06:03:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.227+0000 7fc0d17fa640 1 -- 172.21.15.53:0/45689584 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0c4003a80 con 0x7fc0d4102390 2024-08-31T06:03:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.227+0000 7fc0da500640 1 -- 172.21.15.53:0/45689584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d41a2510 con 0x7fc0d4102390 2024-08-31T06:03:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.227+0000 7fc0d17fa640 1 -- 172.21.15.53:0/45689584 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4035070 con 0x7fc0d4102390 2024-08-31T06:03:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.227+0000 7fc0da500640 1 -- 172.21.15.53:0/45689584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d41a8cd0 con 0x7fc0d4102390 2024-08-31T06:03:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.228+0000 7fc0da500640 1 -- 172.21.15.53:0/45689584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d41027a0 con 0x7fc0d4102390 2024-08-31T06:03:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.229+0000 7fc0d17fa640 1 -- 172.21.15.53:0/45689584 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fc0c4042030 con 0x7fc0d4102390 2024-08-31T06:03:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.230+0000 7fc0d17fa640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0bc0b4c10 0x7fc0bc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.230+0000 7fc0d37fe640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0bc0b4c10 0x7fc0bc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.230+0000 7fc0d17fa640 1 -- 172.21.15.53:0/45689584 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fc0c4105f20 con 0x7fc0d4102390 2024-08-31T06:03:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.231+0000 7fc0d37fe640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0bc0b4c10 0x7fc0bc0b7120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4079d80 tx=0x7fc0c800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.233+0000 7fc0d17fa640 1 -- 172.21.15.53:0/45689584 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc0c40cc7a0 con 0x7fc0d4102390 2024-08-31T06:03:41.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.455+0000 7fc0da500640 1 -- 172.21.15.53:0/45689584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0d410b100 con 0x7fc0d4102390 2024-08-31T06:03:41.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.456+0000 7fc0d17fa640 1 -- 172.21.15.53:0/45689584 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11985 (secure 0 0 0) 0x7fc0c40d5330 con 0x7fc0d4102390 2024-08-31T06:03:41.458 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:03:41.458 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"btime":"2024-08-31T06:02:42:670578+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:02:42.670556+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:03:41.458 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 27 2024-08-31T06:03:41.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.458+0000 7fc0da500640 1 -- 172.21.15.53:0/45689584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0bc0b4c10 msgr2=0x7fc0bc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:41.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.458+0000 7fc0da500640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0bc0b4c10 0x7fc0bc0b7120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4079d80 tx=0x7fc0c800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:03:41.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.458+0000 7fc0da500640 1 -- 172.21.15.53:0/45689584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0d4102390 msgr2=0x7fc0d419c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:41.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.458+0000 7fc0da500640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0d4102390 0x7fc0d419c310 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009230 tx=0x7fc0c4004270 comp rx=0 tx=0).stop 2024-08-31T06:03:41.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.458+0000 7fc0da500640 1 -- 172.21.15.53:0/45689584 shutdown_connections 2024-08-31T06:03:41.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.458+0000 7fc0da500640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0bc0b4c10 0x7fc0bc0b7120 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:41.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.458+0000 7fc0da500640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d410ff40 0x7fc0d41a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:41.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.458+0000 7fc0da500640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0d4102ce0 0x7fc0d419c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:41.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.458+0000 7fc0da500640 1 --2- 172.21.15.53:0/45689584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0d4102390 0x7fc0d419c310 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:41.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.458+0000 7fc0da500640 1 -- 172.21.15.53:0/45689584 >> 172.21.15.53:0/45689584 conn(0x7fc0d40794e0 msgr2=0x7fc0d41113c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:41.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.459+0000 7fc0da500640 1 -- 172.21.15.53:0/45689584 shutdown_connections 2024-08-31T06:03:41.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:41.459+0000 7fc0da500640 1 -- 172.21.15.53:0/45689584 wait complete. 2024-08-31T06:03:42.103 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:03:42.357 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:42 smithi153 ceph-mon[22320]: pgmap v283: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:03:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:42 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/45689584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:03:42.474 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:42 smithi053 ceph-mon[18924]: pgmap v283: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:03:42.474 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:42 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/45689584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:03:42.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:42 smithi130 ceph-mon[22266]: pgmap v283: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:03:42.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:42 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/45689584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:03:42.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.807+0000 7fc9bceb6640 1 -- 172.21.15.53:0/223879184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9b8109270 msgr2=0x7fc9b8109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:42.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.807+0000 7fc9bceb6640 1 --2- 172.21.15.53:0/223879184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9b8109270 0x7fc9b8109680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8009900 tx=0x7fc9a802a410 comp rx=0 tx=0).stop 2024-08-31T06:03:42.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.807+0000 7fc9bceb6640 1 -- 172.21.15.53:0/223879184 shutdown_connections 2024-08-31T06:03:42.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.807+0000 7fc9bceb6640 1 --2- 172.21.15.53:0/223879184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b8109bc0 0x7fc9b81103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:42.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.807+0000 7fc9bceb6640 1 --2- 172.21.15.53:0/223879184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9b8109270 0x7fc9b8109680 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:42.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.807+0000 7fc9bceb6640 1 --2- 172.21.15.53:0/223879184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9b8103930 0x7fc9b8103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.807+0000 7fc9bceb6640 1 -- 172.21.15.53:0/223879184 >> 172.21.15.53:0/223879184 conn(0x7fc9b80ff3a0 msgr2=0x7fc9b81017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.807+0000 7fc9bceb6640 1 -- 172.21.15.53:0/223879184 shutdown_connections 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.807+0000 7fc9bceb6640 1 -- 172.21.15.53:0/223879184 wait complete. 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.808+0000 7fc9bceb6640 1 Processor -- start 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.808+0000 7fc9bceb6640 1 -- start start 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.808+0000 7fc9bceb6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9b8103930 0x7fc9b819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.808+0000 7fc9bceb6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b8109270 0x7fc9b819c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.808+0000 7fc9bceb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9b8109bc0 0x7fc9b81a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.808+0000 7fc9bceb6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8113730 con 0x7fc9b8109bc0 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.808+0000 7fc9bceb6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b81135b0 con 0x7fc9b8103930 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.808+0000 7fc9bceb6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b81138b0 con 0x7fc9b8109270 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9b8109bc0 0x7fc9b81a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:42.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9b8109bc0 0x7fc9b81a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46486/0 (socket says 172.21.15.53:46486) 2024-08-31T06:03:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b6d9d640 1 -- 172.21.15.53:0/292512922 learned_addr learned my addr 172.21.15.53:0/292512922 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b5d9b640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b8109270 0x7fc9b819c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b659c640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9b8103930 0x7fc9b819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b6d9d640 1 -- 172.21.15.53:0/292512922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b8109270 msgr2=0x7fc9b819c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b6d9d640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b8109270 0x7fc9b819c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b6d9d640 1 -- 172.21.15.53:0/292512922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9b8103930 msgr2=0x7fc9b819c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b6d9d640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9b8103930 0x7fc9b819c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b6d9d640 1 -- 172.21.15.53:0/292512922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b81a2310 con 0x7fc9b8109bc0 2024-08-31T06:03:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b5d9b640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b8109270 0x7fc9b819c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9b6d9d640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9b8109bc0 0x7fc9b81a1be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009fd0 tx=0x7fc9b000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9a77fe640 1 -- 172.21.15.53:0/292512922 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0017070 con 0x7fc9b8109bc0 2024-08-31T06:03:42.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9a77fe640 1 -- 172.21.15.53:0/292512922 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9b0003e00 con 0x7fc9b8109bc0 2024-08-31T06:03:42.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9bceb6640 1 -- 172.21.15.53:0/292512922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b81a2600 con 0x7fc9b8109bc0 2024-08-31T06:03:42.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9a77fe640 1 -- 172.21.15.53:0/292512922 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0010460 con 0x7fc9b8109bc0 2024-08-31T06:03:42.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.809+0000 7fc9bceb6640 1 -- 172.21.15.53:0/292512922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b81a8d60 con 0x7fc9b8109bc0 2024-08-31T06:03:42.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.810+0000 7fc9bceb6640 1 -- 172.21.15.53:0/292512922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b8103d40 con 0x7fc9b8109bc0 2024-08-31T06:03:42.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.813+0000 7fc9a77fe640 1 -- 172.21.15.53:0/292512922 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fc9b0003970 con 0x7fc9b8109bc0 2024-08-31T06:03:42.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.814+0000 7fc9a77fe640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9a00b4c10 0x7fc9a00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:42.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.814+0000 7fc9b659c640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9a00b4c10 0x7fc9a00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:42.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.814+0000 7fc9a77fe640 1 -- 172.21.15.53:0/292512922 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fc9b00e5690 con 0x7fc9b8109bc0 2024-08-31T06:03:42.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.814+0000 7fc9b659c640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9a00b4c10 0x7fc9a00b7120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac005fd0 tx=0x7fc9ac005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:42.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:42.817+0000 7fc9a77fe640 1 -- 172.21.15.53:0/292512922 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc9b00ac500 con 0x7fc9b8109bc0 2024-08-31T06:03:43.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.039+0000 7fc9bceb6640 1 -- 172.21.15.53:0/292512922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9b81a8f90 con 0x7fc9b8109bc0 2024-08-31T06:03:43.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.040+0000 7fc9a77fe640 1 -- 172.21.15.53:0/292512922 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11985 (secure 0 0 0) 0x7fc9b00abe00 con 0x7fc9b8109bc0 2024-08-31T06:03:43.042 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:03:43.042 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"btime":"2024-08-31T06:02:42:670578+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:02:42.670556+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:03:43.042 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 27 2024-08-31T06:03:43.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 -- 172.21.15.53:0/292512922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9a00b4c10 msgr2=0x7fc9a00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:43.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9a00b4c10 0x7fc9a00b7120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac005fd0 tx=0x7fc9ac005850 comp rx=0 tx=0).stop 2024-08-31T06:03:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 -- 172.21.15.53:0/292512922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9b8109bc0 msgr2=0x7fc9b81a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9b8109bc0 0x7fc9b81a1be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009fd0 tx=0x7fc9b000b260 comp rx=0 tx=0).stop 2024-08-31T06:03:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 -- 172.21.15.53:0/292512922 shutdown_connections 2024-08-31T06:03:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9a00b4c10 0x7fc9a00b7120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9b8109bc0 0x7fc9b81a1be0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9b8109270 0x7fc9b819c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 --2- 172.21.15.53:0/292512922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9b8103930 0x7fc9b819c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 -- 172.21.15.53:0/292512922 >> 172.21.15.53:0/292512922 conn(0x7fc9b80ff3a0 msgr2=0x7fc9b810e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 -- 172.21.15.53:0/292512922 shutdown_connections 2024-08-31T06:03:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:43.042+0000 7fc9bceb6640 1 -- 172.21.15.53:0/292512922 wait complete. 2024-08-31T06:03:43.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:43 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/292512922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:03:43.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/292512922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:03:43.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:43 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/292512922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:03:43.681 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:03:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:44.337 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:44 smithi053 ceph-mon[18924]: pgmap v284: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:44.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:44 smithi153 ceph-mon[22320]: pgmap v284: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.425+0000 7efd2302d640 1 -- 172.21.15.53:0/4014247321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1c109290 msgr2=0x7efd1c1096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.425+0000 7efd2302d640 1 --2- 172.21.15.53:0/4014247321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1c109290 0x7efd1c1096a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efd08009900 tx=0x7efd0802a410 comp rx=0 tx=0).stop 2024-08-31T06:03:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.425+0000 7efd2302d640 1 -- 172.21.15.53:0/4014247321 shutdown_connections 2024-08-31T06:03:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.425+0000 7efd2302d640 1 --2- 172.21.15.53:0/4014247321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd1c109be0 0x7efd1c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.425+0000 7efd2302d640 1 --2- 172.21.15.53:0/4014247321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1c109290 0x7efd1c1096a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.425+0000 7efd2302d640 1 --2- 172.21.15.53:0/4014247321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd1c103950 0x7efd1c103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.425+0000 7efd2302d640 1 -- 172.21.15.53:0/4014247321 >> 172.21.15.53:0/4014247321 conn(0x7efd1c0ff3a0 msgr2=0x7efd1c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.425+0000 7efd2302d640 1 -- 172.21.15.53:0/4014247321 shutdown_connections 2024-08-31T06:03:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.426+0000 7efd2302d640 1 -- 172.21.15.53:0/4014247321 wait complete. 2024-08-31T06:03:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.426+0000 7efd2302d640 1 Processor -- start 2024-08-31T06:03:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.426+0000 7efd2302d640 1 -- start start 2024-08-31T06:03:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.426+0000 7efd2302d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd1c103950 0x7efd1c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.426+0000 7efd2302d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd1c109290 0x7efd1c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd2302d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1c109be0 0x7efd1c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd2302d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c113750 con 0x7efd1c109be0 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd2302d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c1135d0 con 0x7efd1c109290 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd2302d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c1138d0 con 0x7efd1c103950 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd215ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1c109be0 0x7efd1c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd215ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1c109be0 0x7efd1c075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44926/0 (socket says 172.21.15.53:44926) 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd215ca640 1 -- 172.21.15.53:0/140696092 learned_addr learned my addr 172.21.15.53:0/140696092 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd1bfff640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd1c109290 0x7efd1c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd20dc9640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd1c103950 0x7efd1c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd215ca640 1 -- 172.21.15.53:0/140696092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd1c103950 msgr2=0x7efd1c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd215ca640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd1c103950 0x7efd1c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd215ca640 1 -- 172.21.15.53:0/140696092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd1c109290 msgr2=0x7efd1c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd215ca640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd1c109290 0x7efd1c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd215ca640 1 -- 172.21.15.53:0/140696092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1c1a8440 con 0x7efd1c109be0 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd215ca640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1c109be0 0x7efd1c075f30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efd1400eb10 tx=0x7efd1400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd19ffb640 1 -- 172.21.15.53:0/140696092 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14004b20 con 0x7efd1c109be0 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd19ffb640 1 -- 172.21.15.53:0/140696092 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd14004cc0 con 0x7efd1c109be0 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd2302d640 1 -- 172.21.15.53:0/140696092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd1c1a8730 con 0x7efd1c109be0 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.427+0000 7efd19ffb640 1 -- 172.21.15.53:0/140696092 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14010690 con 0x7efd1c109be0 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.428+0000 7efd2302d640 1 -- 172.21.15.53:0/140696092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd1c1a8c40 con 0x7efd1c109be0 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.429+0000 7efd2302d640 1 -- 172.21.15.53:0/140696092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd1c103d60 con 0x7efd1c109be0 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.430+0000 7efd19ffb640 1 -- 172.21.15.53:0/140696092 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7efd14005000 con 0x7efd1c109be0 2024-08-31T06:03:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.431+0000 7efd19ffb640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd0c0b4c10 0x7efd0c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.431+0000 7efd20dc9640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd0c0b4c10 0x7efd0c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.431+0000 7efd19ffb640 1 -- 172.21.15.53:0/140696092 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7efd140e5c10 con 0x7efd1c109be0 2024-08-31T06:03:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.431+0000 7efd20dc9640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd0c0b4c10 0x7efd0c0b7120 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efd10005fd0 tx=0x7efd10005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.434+0000 7efd19ffb640 1 -- 172.21.15.53:0/140696092 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efd14056130 con 0x7efd1c109be0 2024-08-31T06:03:44.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.620+0000 7efd2302d640 1 -- 172.21.15.53:0/140696092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd1c0767b0 con 0x7efd1c109be0 2024-08-31T06:03:44.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.622+0000 7efd19ffb640 1 -- 172.21.15.53:0/140696092 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+23053 (secure 0 0 0) 0x7efd140acae0 con 0x7efd1c109be0 2024-08-31T06:03:44.624 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:03:44.625 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":72,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:03:15.760413+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:03:44.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 -- 172.21.15.53:0/140696092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd0c0b4c10 msgr2=0x7efd0c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:44.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd0c0b4c10 0x7efd0c0b7120 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efd10005fd0 tx=0x7efd10005850 comp rx=0 tx=0).stop 2024-08-31T06:03:44.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 -- 172.21.15.53:0/140696092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1c109be0 msgr2=0x7efd1c075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:44.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1c109be0 0x7efd1c075f30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efd1400eb10 tx=0x7efd1400c2d0 comp rx=0 tx=0).stop 2024-08-31T06:03:44.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 -- 172.21.15.53:0/140696092 shutdown_connections 2024-08-31T06:03:44.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd0c0b4c10 0x7efd0c0b7120 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:44.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1c109be0 0x7efd1c075f30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:44.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd1c109290 0x7efd1c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:44.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 --2- 172.21.15.53:0/140696092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd1c103950 0x7efd1c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:44.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 -- 172.21.15.53:0/140696092 >> 172.21.15.53:0/140696092 conn(0x7efd1c0ff3a0 msgr2=0x7efd1c1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:44.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 -- 172.21.15.53:0/140696092 shutdown_connections 2024-08-31T06:03:44.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:44.624+0000 7efd2302d640 1 -- 172.21.15.53:0/140696092 wait complete. 2024-08-31T06:03:44.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:44 smithi130 ceph-mon[22266]: pgmap v284: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:45.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:45 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/140696092' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:03:45.254 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:03:45.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:45 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/140696092' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:03:45.507 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:45.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:45 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/140696092' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:03:46.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.000+0000 7f69da4b4640 1 -- 172.21.15.53:0/2034835740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d4109b90 msgr2=0x7f69d41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:46.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.000+0000 7f69da4b4640 1 --2- 172.21.15.53:0/2034835740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d4109b90 0x7f69d41103c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009ca0 tx=0x7f69cc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:46.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.000+0000 7f69da4b4640 1 -- 172.21.15.53:0/2034835740 shutdown_connections 2024-08-31T06:03:46.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.000+0000 7f69da4b4640 1 --2- 172.21.15.53:0/2034835740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d4109b90 0x7f69d41103c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:46.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.000+0000 7f69da4b4640 1 --2- 172.21.15.53:0/2034835740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69d4109240 0x7f69d4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:46.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.000+0000 7f69da4b4640 1 --2- 172.21.15.53:0/2034835740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69d4103900 0x7f69d4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:46.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.000+0000 7f69da4b4640 1 -- 172.21.15.53:0/2034835740 >> 172.21.15.53:0/2034835740 conn(0x7f69d407b5f0 msgr2=0x7f69d407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:46.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.001+0000 7f69da4b4640 1 -- 172.21.15.53:0/2034835740 shutdown_connections 2024-08-31T06:03:46.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.001+0000 7f69da4b4640 1 -- 172.21.15.53:0/2034835740 wait complete. 2024-08-31T06:03:46.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.001+0000 7f69da4b4640 1 Processor -- start 2024-08-31T06:03:46.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.001+0000 7f69da4b4640 1 -- start start 2024-08-31T06:03:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69da4b4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69d4103900 0x7f69d419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69da4b4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69d4109240 0x7f69d419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69da4b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d4109b90 0x7f69d419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69da4b4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f69d4113750 con 0x7f69d4109b90 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69da4b4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69d41135d0 con 0x7f69d4103900 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69da4b4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69d41138d0 con 0x7f69d4109240 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69d8a51640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d4109b90 0x7f69d419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69d8a51640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d4109b90 0x7f69d419faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44934/0 (socket says 172.21.15.53:44934) 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69d8a51640 1 -- 172.21.15.53:0/3537832437 learned_addr learned my addr 172.21.15.53:0/3537832437 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69d3fff640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69d4103900 0x7f69d419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69d37fe640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69d4109240 0x7f69d419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69d8a51640 1 -- 172.21.15.53:0/3537832437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69d4109240 msgr2=0x7f69d419a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69d8a51640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69d4109240 0x7f69d419a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69d8a51640 1 -- 172.21.15.53:0/3537832437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69d4103900 msgr2=0x7f69d419a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69d8a51640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69d4103900 0x7f69d419a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69d8a51640 1 -- 172.21.15.53:0/3537832437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d41a01d0 con 0x7f69d4109b90 2024-08-31T06:03:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.002+0000 7f69d8a51640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d4109b90 0x7f69d419faa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f69cc031040 tx=0x7f69cc032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.003+0000 7f69d17fa640 1 -- 172.21.15.53:0/3537832437 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc004040 con 0x7f69d4109b90 2024-08-31T06:03:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.003+0000 7f69d17fa640 1 -- 172.21.15.53:0/3537832437 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69cc004670 con 0x7f69d4109b90 2024-08-31T06:03:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.003+0000 7f69da4b4640 1 -- 172.21.15.53:0/3537832437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d41a0460 con 0x7f69d4109b90 2024-08-31T06:03:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.003+0000 7f69d17fa640 1 -- 172.21.15.53:0/3537832437 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc030bf0 con 0x7f69d4109b90 2024-08-31T06:03:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.003+0000 7f69da4b4640 1 -- 172.21.15.53:0/3537832437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d41a6c20 con 0x7f69d4109b90 2024-08-31T06:03:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.004+0000 7f69da4b4640 1 -- 172.21.15.53:0/3537832437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d4103d10 con 0x7f69d4109b90 2024-08-31T06:03:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.006+0000 7f69d17fa640 1 -- 172.21.15.53:0/3537832437 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f69cc0041e0 con 0x7f69d4109b90 2024-08-31T06:03:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.006+0000 7f69d17fa640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69bc0b4c10 0x7f69bc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.006+0000 7f69d17fa640 1 -- 172.21.15.53:0/3537832437 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f69cc106780 con 0x7f69d4109b90 2024-08-31T06:03:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.006+0000 7f69d3fff640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69bc0b4c10 0x7f69bc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.007+0000 7f69d3fff640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69bc0b4c10 0x7f69bc0b7120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f69c4005fd0 tx=0x7f69c400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.009+0000 7f69d17fa640 1 -- 172.21.15.53:0/3537832437 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f69cc0cd650 con 0x7f69d4109b90 2024-08-31T06:03:46.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.235+0000 7f69da4b4640 1 -- 172.21.15.53:0/3537832437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69d410b980 con 0x7f69d4109b90 2024-08-31T06:03:46.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.235+0000 7f69d17fa640 1 -- 172.21.15.53:0/3537832437 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11985 (secure 0 0 0) 0x7f69cc0ccf50 con 0x7f69d4109b90 2024-08-31T06:03:46.237 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:03:46.238 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"btime":"2024-08-31T06:02:42:670578+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:02:42.670556+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:03:46.238 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 27 2024-08-31T06:03:46.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.237+0000 7f69da4b4640 1 -- 172.21.15.53:0/3537832437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69bc0b4c10 msgr2=0x7f69bc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.237+0000 7f69da4b4640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69bc0b4c10 0x7f69bc0b7120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f69c4005fd0 tx=0x7f69c400b390 comp rx=0 tx=0).stop 2024-08-31T06:03:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.237+0000 7f69da4b4640 1 -- 172.21.15.53:0/3537832437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d4109b90 msgr2=0x7f69d419faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.238+0000 7f69da4b4640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d4109b90 0x7f69d419faa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f69cc031040 tx=0x7f69cc032bc0 comp rx=0 tx=0).stop 2024-08-31T06:03:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.238+0000 7f69da4b4640 1 -- 172.21.15.53:0/3537832437 shutdown_connections 2024-08-31T06:03:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.238+0000 7f69da4b4640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69bc0b4c10 0x7f69bc0b7120 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.238+0000 7f69da4b4640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d4109b90 0x7f69d419faa0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.238+0000 7f69da4b4640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69d4109240 0x7f69d419a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.238+0000 7f69da4b4640 1 --2- 172.21.15.53:0/3537832437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69d4103900 0x7f69d419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.238+0000 7f69da4b4640 1 -- 172.21.15.53:0/3537832437 >> 172.21.15.53:0/3537832437 conn(0x7f69d407b5f0 msgr2=0x7f69d41053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.238+0000 7f69da4b4640 1 -- 172.21.15.53:0/3537832437 shutdown_connections 2024-08-31T06:03:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:46.238+0000 7f69da4b4640 1 -- 172.21.15.53:0/3537832437 wait complete. 2024-08-31T06:03:46.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:46 smithi153 ceph-mon[22320]: pgmap v285: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:46.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:46 smithi053 ceph-mon[18924]: pgmap v285: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:46.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:46 smithi130 ceph-mon[22266]: pgmap v285: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:46.905 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T06:02:31.233616+0000', 'modified': '2024-08-31T06:02:42.670556+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24668, 'mds_1': 24640, 'mds_2': 24632, 'mds_3': 24619, 'mds_4': 24613}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14829': {'gid': 14829, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.53:6839/1079311184', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6838', 'nonce': 1079311184}, {'type': 'v1', 'addr': '172.21.15.53:6839', 'nonce': 1079311184}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14841': {'gid': 14841, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.53:6841/2812306532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6840', 'nonce': 2812306532}, {'type': 'v1', 'addr': '172.21.15.53:6841', 'nonce': 2812306532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24577': {'gid': 24577, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6833/4101202303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 4101202303}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 4101202303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6833/4017894222', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6832', 'nonce': 4017894222}, {'type': 'v1', 'addr': '172.21.15.130:6833', 'nonce': 4017894222}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6835/3456535570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 3456535570}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 3456535570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.153:6835/1480674420', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 1480674420}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 1480674420}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24619': {'gid': 24619, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.153:6837/3972541540', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 3972541540}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 3972541540}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24632': {'gid': 24632, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.130:6837/1323127878', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 1323127878}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 1323127878}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24640': {'gid': 24640, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.153:6839/268646865', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6838', 'nonce': 268646865}, {'type': 'v1', 'addr': '172.21.15.153:6839', 'nonce': 268646865}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24668': {'gid': 24668, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.130:6839/3403731647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 3403731647}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 3403731647}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24668, 'qdb_cluster': [24668, 24640, 24632, 24619, 24613]} 2024-08-31T06:03:46.906 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-31T06:03:46.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.f status 2024-08-31T06:03:47.158 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:47.447 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:47 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3537832437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:03:47.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:47 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3537832437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:03:47.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:47 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3537832437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:03:47.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.693+0000 7f2b693a8640 1 -- 172.21.15.53:0/2831451396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64103900 msgr2=0x7f2b64103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.693+0000 7f2b693a8640 1 --2- 172.21.15.53:0/2831451396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64103900 0x7f2b64103d10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009900 tx=0x7f2b5402a410 comp rx=0 tx=0).stop 2024-08-31T06:03:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.693+0000 7f2b693a8640 1 -- 172.21.15.53:0/2831451396 shutdown_connections 2024-08-31T06:03:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.693+0000 7f2b693a8640 1 --2- 172.21.15.53:0/2831451396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b64109b90 0x7f2b641103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.693+0000 7f2b693a8640 1 --2- 172.21.15.53:0/2831451396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b64109240 0x7f2b64109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.693+0000 7f2b693a8640 1 --2- 172.21.15.53:0/2831451396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64103900 0x7f2b64103d10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.693+0000 7f2b693a8640 1 -- 172.21.15.53:0/2831451396 >> 172.21.15.53:0/2831451396 conn(0x7f2b6407b5f0 msgr2=0x7f2b6407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.693+0000 7f2b693a8640 1 -- 172.21.15.53:0/2831451396 shutdown_connections 2024-08-31T06:03:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.693+0000 7f2b693a8640 1 -- 172.21.15.53:0/2831451396 wait complete. 2024-08-31T06:03:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b693a8640 1 Processor -- start 2024-08-31T06:03:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b693a8640 1 -- start start 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b693a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b64103900 0x7f2b6419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b693a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64109240 0x7f2b6419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b693a8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b64109b90 0x7f2b6419f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b693a8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2b64113700 con 0x7f2b64109240 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b693a8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2b64113580 con 0x7f2b64103900 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b693a8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b64113880 con 0x7f2b64109b90 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b627fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64109240 0x7f2b6419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b627fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64109240 0x7f2b6419a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44952/0 (socket says 172.21.15.53:44952) 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b627fc640 1 -- 172.21.15.53:0/2286896913 learned_addr learned my addr 172.21.15.53:0/2286896913 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b62ffd640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b64103900 0x7f2b6419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.694+0000 7f2b637fe640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b64109b90 0x7f2b6419f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b627fc640 1 -- 172.21.15.53:0/2286896913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b64109b90 msgr2=0x7f2b6419f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b627fc640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b64109b90 0x7f2b6419f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b627fc640 1 -- 172.21.15.53:0/2286896913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b64103900 msgr2=0x7f2b6419a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b627fc640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b64103900 0x7f2b6419a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b627fc640 1 -- 172.21.15.53:0/2286896913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b641a00e0 con 0x7f2b64109240 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b637fe640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b64109b90 0x7f2b6419f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b627fc640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64109240 0x7f2b6419a710 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800d740 tx=0x7f2b5800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b4bfff640 1 -- 172.21.15.53:0/2286896913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b58017070 con 0x7f2b64109240 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b4bfff640 1 -- 172.21.15.53:0/2286896913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b5800de50 con 0x7f2b64109240 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b693a8640 1 -- 172.21.15.53:0/2286896913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b641a03d0 con 0x7f2b64109240 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b4bfff640 1 -- 172.21.15.53:0/2286896913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5800f620 con 0x7f2b64109240 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.695+0000 7f2b693a8640 1 -- 172.21.15.53:0/2286896913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b641a6b30 con 0x7f2b64109240 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b6f91d740 1 Processor -- start 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b6f91d740 1 -- start start 2024-08-31T06:03:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b4bfff640 1 -- 172.21.15.53:0/2286896913 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f2b5801a070 con 0x7f2b64109240 2024-08-31T06:03:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24f1af60 0x563c252c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ef20a0 0x563c252c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c252373f0 con 0x563c24efa280 2024-08-31T06:03:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563c25226980 con 0x563c24ef20a0 2024-08-31T06:03:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c2522a930 con 0x563c24f1af60 2024-08-31T06:03:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b627fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b627fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44964/0 (socket says 172.21.15.53:44964) 2024-08-31T06:03:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b627fc640 1 -- 172.21.15.53:0/3934761582 learned_addr learned my addr 172.21.15.53:0/3934761582 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b637fe640 1 --2- 172.21.15.53:0/3934761582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24f1af60 0x563c252c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.698+0000 7f2b62ffd640 1 --2- 172.21.15.53:0/3934761582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ef20a0 0x563c252c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b627fc640 1 -- 172.21.15.53:0/3934761582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24f1af60 msgr2=0x563c252c07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b627fc640 1 --2- 172.21.15.53:0/3934761582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24f1af60 0x563c252c07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b627fc640 1 -- 172.21.15.53:0/3934761582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ef20a0 msgr2=0x563c252c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b627fc640 1 --2- 172.21.15.53:0/3934761582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ef20a0 0x563c252c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b627fc640 1 -- 172.21.15.53:0/3934761582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c24f86540 con 0x563c24efa280 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b627fc640 1 --2- 172.21.15.53:0/3934761582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252c1230 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2b580e2670 tx=0x7f2b580ed570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea238525db7e704 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b4bfff640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b4c0b4c10 0x7f2b4c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b637fe640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b4c0b4c10 0x7f2b4c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b497fa640 1 -- 172.21.15.53:0/3934761582 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b580f8070 con 0x563c24efa280 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b497fa640 1 -- 172.21.15.53:0/3934761582 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b580ab160 con 0x563c24efa280 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b497fa640 1 -- 172.21.15.53:0/3934761582 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b580aafa0 con 0x563c24efa280 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.699+0000 7f2b4bfff640 1 -- 172.21.15.53:0/2286896913 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f2b580e4e80 con 0x7f2b64109240 2024-08-31T06:03:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.700+0000 7f2b6f91d740 1 -- 172.21.15.53:0/3934761582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 msgr2=0x563c252c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.700+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/3934761582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252c1230 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2b580e2670 tx=0x7f2b580ed570 comp rx=0 tx=0).stop 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.700+0000 7f2b637fe640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b4c0b4c10 0x7f2b4c0b7120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c005fd0 tx=0x7f2b5c009800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.700+0000 7f2b6f91d740 1 -- 172.21.15.53:0/3934761582 shutdown_connections 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.700+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/3934761582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252c1230 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.700+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/3934761582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ef20a0 0x563c252c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.700+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/3934761582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24f1af60 0x563c252c07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.700+0000 7f2b6f91d740 1 -- 172.21.15.53:0/3934761582 >> 172.21.15.53:0/3934761582 conn(0x563c24f0f350 msgr2=0x563c252be6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.700+0000 7f2b6f91d740 1 -- 172.21.15.53:0/3934761582 shutdown_connections 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.700+0000 7f2b6f91d740 1 -- 172.21.15.53:0/3934761582 wait complete. 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b6f91d740 1 -- start start 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b6f91d740 1 Processor -- start 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24ef20a0 0x563c252cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24efa280 0x563c252cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24f1af60 0x563c252cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c250895f0 con 0x563c24f1af60 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563c251ad600 con 0x563c24efa280 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c252cef90 con 0x563c24ef20a0 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b6f91d740 10 client.0 _ll_register_callbacks cb 0x563c251d3af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24f1af60 0x563c252cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24f1af60 0x563c252cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44974/0 (socket says 172.21.15.53:44974) 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.701+0000 7f2b637fe640 1 -- 172.21.15.53:0/846359227 learned_addr learned my addr 172.21.15.53:0/846359227 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b62ffd640 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24ef20a0 0x563c252cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b627fc640 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24efa280 0x563c252cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b637fe640 1 -- 172.21.15.53:0/846359227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24ef20a0 msgr2=0x563c252cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b637fe640 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24ef20a0 0x563c252cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b637fe640 1 -- 172.21.15.53:0/846359227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24efa280 msgr2=0x563c252cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b637fe640 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24efa280 0x563c252cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b637fe640 1 -- 172.21.15.53:0/846359227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c251e67b0 con 0x563c24f1af60 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b627fc640 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24efa280 0x563c252cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b637fe640 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24f1af60 0x563c252cc870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c011d40 tx=0x7f2b5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6cf20b755b945d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b46ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b46ff5640 1 -- 172.21.15.53:0/846359227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c01ed30 con 0x563c24f1af60 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b46ff5640 1 -- 172.21.15.53:0/846359227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f2b5c02a480 con 0x563c24f1af60 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.702+0000 7f2b6f91d740 1 -- 172.21.15.53:0/846359227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b580ab160 con 0x563c24f1af60 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.703+0000 7f2b46ff5640 1 -- 172.21.15.53:0/846359227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2b5c02a680 con 0x563c24f1af60 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.703+0000 7f2b6f91d740 10 client.15201 fetch_fsmap learned FSMap version 27 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.703+0000 7f2b6f91d740 1 -- 172.21.15.53:0/846359227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563c252dac70 con 0x563c24f1af60 2024-08-31T06:03:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.703+0000 7f2b46ff5640 1 -- 172.21.15.53:0/846359227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b580ab160 con 0x563c24f1af60 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.703+0000 7f2b46ff5640 1 -- 172.21.15.53:0/846359227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2b5c031020 con 0x563c24f1af60 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.703+0000 7f2b6f91d740 10 client.15201 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.703+0000 7f2b6f91d740 10 client.15201 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.703+0000 7f2b6f91d740 20 client.15201 populate_metadata read hostname 'smithi053' 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.703+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563c24ed98e0 0x563c252de6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.703+0000 7f2b6f91d740 4 client.15201 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.703+0000 7f2b6f91d740 1 -- 172.21.15.53:0/846359227 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c25239340 con 0x563c24ed98e0 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.704+0000 7f2b62ffd640 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563c24ed98e0 0x563c252de6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.704+0000 7f2b62ffd640 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563c24ed98e0 0x563c252de6d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4f8cedd29c70ce8b server_cookie=612b11a4a07bf2f7 in_seq=0 out_seq=0 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.704+0000 7f2b46ff5640 10 client.15201 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.705+0000 7f2b46ff5640 1 -- 172.21.15.53:0/846359227 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c25239340 con 0x563c24ed98e0 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.705+0000 7f2b46ff5640 10 client.15201 handle_command_reply: tid=0 2024-08-31T06:03:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.705+0000 7f2b6f91d740 1 client.15201 shutdown 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.705+0000 7f2b6f91d740 1 -- 172.21.15.53:0/846359227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24f1af60 msgr2=0x563c252cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.705+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24f1af60 0x563c252cc870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c011d40 tx=0x7f2b5c004a40 comp rx=0 tx=0).stop 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.705+0000 7f2b6f91d740 1 -- 172.21.15.53:0/846359227 shutdown_connections 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.705+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24f1af60 0x563c252cc870 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.705+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24efa280 0x563c252cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.705+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563c24ed98e0 0x563c252de6d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.705+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/846359227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24ef20a0 0x563c252cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.705+0000 7f2b46ff5640 0 client.15201 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.706+0000 7f2b6f91d740 1 -- 172.21.15.53:0/846359227 >> 172.21.15.53:0/846359227 conn(0x563c24f0f350 msgr2=0x563c252c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.706+0000 7f2b6f91d740 1 -- 172.21.15.53:0/846359227 shutdown_connections 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.706+0000 7f2b6f91d740 1 -- 172.21.15.53:0/846359227 wait complete. 2024-08-31T06:03:47.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.706+0000 7f2b6f91d740 20 client.15201 trim_cache size 0 max 16384 2024-08-31T06:03:47.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.726+0000 7f2b6f91d740 1 Processor -- start 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b6f91d740 1 -- start start 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ed98e0 0x563c252dd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24ef20a0 0x563c252dc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24efa280 0x563c252c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c252dca10 con 0x563c24ef20a0 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563c252dd0e0 con 0x563c24ed98e0 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c252dd7b0 con 0x563c24efa280 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b627fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24ef20a0 0x563c252dc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b627fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24ef20a0 0x563c252dc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44980/0 (socket says 172.21.15.53:44980) 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b627fc640 1 -- 172.21.15.53:0/2310680462 learned_addr learned my addr 172.21.15.53:0/2310680462 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b637fe640 1 --2- 172.21.15.53:0/2310680462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24efa280 0x563c252c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b62ffd640 1 --2- 172.21.15.53:0/2310680462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ed98e0 0x563c252dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b627fc640 1 -- 172.21.15.53:0/2310680462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24efa280 msgr2=0x563c252c1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b627fc640 1 --2- 172.21.15.53:0/2310680462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24efa280 0x563c252c1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b627fc640 1 -- 172.21.15.53:0/2310680462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ed98e0 msgr2=0x563c252dd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b627fc640 1 --2- 172.21.15.53:0/2310680462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ed98e0 0x563c252dd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b627fc640 1 -- 172.21.15.53:0/2310680462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c252cad30 con 0x563c24ef20a0 2024-08-31T06:03:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b627fc640 1 --2- 172.21.15.53:0/2310680462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24ef20a0 0x563c252dc0e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2b580e27b0 tx=0x7f2b58000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76784a9fcd3270d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.727+0000 7f2b48ff9640 1 -- 172.21.15.53:0/2310680462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5804fab0 con 0x563c24ef20a0 2024-08-31T06:03:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.728+0000 7f2b48ff9640 1 -- 172.21.15.53:0/2310680462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b580b42b0 con 0x563c24ef20a0 2024-08-31T06:03:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.728+0000 7f2b48ff9640 1 -- 172.21.15.53:0/2310680462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5804fc80 con 0x563c24ef20a0 2024-08-31T06:03:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.728+0000 7f2b6f91d740 1 -- 172.21.15.53:0/2310680462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24ef20a0 msgr2=0x563c252dc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.728+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/2310680462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24ef20a0 0x563c252dc0e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2b580e27b0 tx=0x7f2b58000bc0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.728+0000 7f2b6f91d740 1 -- 172.21.15.53:0/2310680462 shutdown_connections 2024-08-31T06:03:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.728+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/2310680462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24efa280 0x563c252c1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.728+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/2310680462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24ef20a0 0x563c252dc0e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.728+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/2310680462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ed98e0 0x563c252dd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.728+0000 7f2b6f91d740 1 -- 172.21.15.53:0/2310680462 >> 172.21.15.53:0/2310680462 conn(0x563c24f0f350 msgr2=0x563c252c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.728+0000 7f2b6f91d740 1 -- 172.21.15.53:0/2310680462 shutdown_connections 2024-08-31T06:03:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.728+0000 7f2b6f91d740 1 -- 172.21.15.53:0/2310680462 wait complete. 2024-08-31T06:03:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b6f91d740 1 -- start start 2024-08-31T06:03:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b6f91d740 1 Processor -- start 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ed98e0 0x563c252e7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24ef20a0 0x563c252e0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b6f91d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252e0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c252de550 con 0x563c24efa280 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563c252dde80 con 0x563c24ed98e0 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b6f91d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c252dec20 con 0x563c24ef20a0 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b6f91d740 10 client.0 _ll_register_callbacks cb 0x7f2b5c0119f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252e0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252e0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44994/0 (socket says 172.21.15.53:44994) 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b637fe640 1 -- 172.21.15.53:0/860719450 learned_addr learned my addr 172.21.15.53:0/860719450 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.729+0000 7f2b627fc640 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24ef20a0 0x563c252e0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b637fe640 1 -- 172.21.15.53:0/860719450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24ef20a0 msgr2=0x563c252e0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b62ffd640 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ed98e0 0x563c252e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b637fe640 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24ef20a0 0x563c252e0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b637fe640 1 -- 172.21.15.53:0/860719450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ed98e0 msgr2=0x563c252e7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b637fe640 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ed98e0 0x563c252e7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b637fe640 1 -- 172.21.15.53:0/860719450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c252e5fc0 con 0x563c24efa280 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b62ffd640 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ed98e0 0x563c252e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b637fe640 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252e0fa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0339f0 tx=0x7f2b5c033710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c53c20b6c8b003 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b46ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b46ff5640 1 -- 172.21.15.53:0/860719450 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c01ed40 con 0x563c24efa280 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b46ff5640 1 -- 172.21.15.53:0/860719450 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f2b5c004ab0 con 0x563c24efa280 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b6f91d740 1 -- 172.21.15.53:0/860719450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c25234de0 con 0x563c24efa280 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b46ff5640 1 -- 172.21.15.53:0/860719450 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2b5c046050 con 0x563c24efa280 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b6f91d740 10 client.15207 fetch_fsmap learned FSMap version 27 2024-08-31T06:03:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b6f91d740 1 -- 172.21.15.53:0/860719450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563c25349d40 con 0x563c24efa280 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.730+0000 7f2b46ff5640 1 -- 172.21.15.53:0/860719450 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563c25234de0 con 0x563c24efa280 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.731+0000 7f2b46ff5640 1 -- 172.21.15.53:0/860719450 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2b5c031040 con 0x563c24efa280 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.731+0000 7f2b6f91d740 10 client.15207 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.731+0000 7f2b6f91d740 10 client.15207 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.731+0000 7f2b6f91d740 20 client.15207 populate_metadata read hostname 'smithi053' 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.731+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563c24f1af60 0x563c2534d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.731+0000 7f2b6f91d740 4 client.15207 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.731+0000 7f2b6f91d740 1 -- 172.21.15.53:0/860719450 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "status"}) -- 0x563c25232520 con 0x563c24f1af60 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.731+0000 7f2b62ffd640 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563c24f1af60 0x563c2534d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.731+0000 7f2b62ffd640 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563c24f1af60 0x563c2534d5f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=45a1f1beff85ec3c server_cookie=a6f6c3d5098d5306 in_seq=0 out_seq=0 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.731+0000 7f2b46ff5640 10 client.15207 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b46ff5640 1 -- 172.21.15.53:0/860719450 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563c25232520 con 0x563c24f1af60 2024-08-31T06:03:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b46ff5640 10 client.15207 handle_command_reply: tid=0 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 1 client.15207 shutdown 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 1 -- 172.21.15.53:0/860719450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 msgr2=0x563c252e0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252e0fa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0339f0 tx=0x7f2b5c033710 comp rx=0 tx=0).stop 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 1 -- 172.21.15.53:0/860719450 shutdown_connections 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c24efa280 0x563c252e0fa0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563c24f1af60 0x563c2534d5f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c24ef20a0 0x563c252e0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 1 --2- 172.21.15.53:0/860719450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c24ed98e0 0x563c252e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 1 -- 172.21.15.53:0/860719450 >> 172.21.15.53:0/860719450 conn(0x563c24f0f350 msgr2=0x563c252c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b46ff5640 0 client.15207 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 1 -- 172.21.15.53:0/860719450 shutdown_connections 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 1 -- 172.21.15.53:0/860719450 wait complete. 2024-08-31T06:03:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b6f91d740 20 client.15207 trim_cache size 0 max 16384 2024-08-31T06:03:47.740 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:03:47.740 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:03:47.740 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 4, 2024-08-31T06:03:47.740 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24613, 2024-08-31T06:03:47.740 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:03:47.740 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:03:47.740 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:03:47.740 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 66.071514754000006, 2024-08-31T06:03:47.740 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 27, 2024-08-31T06:03:47.740 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 72, 2024-08-31T06:03:47.741 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 70, 2024-08-31T06:03:47.741 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 104.012849903 2024-08-31T06:03:47.741 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:03:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b693a8640 1 -- 172.21.15.53:0/2286896913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b4c0b4c10 msgr2=0x7f2b4c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.732+0000 7f2b693a8640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b4c0b4c10 0x7f2b4c0b7120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c005fd0 tx=0x7f2b5c009800 comp rx=0 tx=0).stop 2024-08-31T06:03:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.733+0000 7f2b693a8640 1 -- 172.21.15.53:0/2286896913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64109240 msgr2=0x7f2b6419a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.733+0000 7f2b693a8640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64109240 0x7f2b6419a710 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800d740 tx=0x7f2b5800dc00 comp rx=0 tx=0).stop 2024-08-31T06:03:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.733+0000 7f2b693a8640 1 -- 172.21.15.53:0/2286896913 shutdown_connections 2024-08-31T06:03:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.733+0000 7f2b693a8640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b4c0b4c10 0x7f2b4c0b7120 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.733+0000 7f2b693a8640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b64109b90 0x7f2b6419f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.733+0000 7f2b693a8640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b64109240 0x7f2b6419a710 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.733+0000 7f2b693a8640 1 --2- 172.21.15.53:0/2286896913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b64103900 0x7f2b6419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.733+0000 7f2b693a8640 1 -- 172.21.15.53:0/2286896913 >> 172.21.15.53:0/2286896913 conn(0x7f2b6407b5f0 msgr2=0x7f2b64107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.733+0000 7f2b693a8640 1 -- 172.21.15.53:0/2286896913 shutdown_connections 2024-08-31T06:03:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:47.733+0000 7f2b693a8640 1 -- 172.21.15.53:0/2286896913 wait complete. 2024-08-31T06:03:48.375 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:48 smithi053 ceph-mon[18924]: pgmap v286: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:48.405 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.c status 2024-08-31T06:03:48.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:48 smithi130 ceph-mon[22266]: pgmap v286: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:48.660 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:48.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:48 smithi153 ceph-mon[22320]: pgmap v286: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.111+0000 7f225c260640 1 -- 172.21.15.53:0/112800950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2254109bc0 msgr2=0x7f22541103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.111+0000 7f225c260640 1 --2- 172.21.15.53:0/112800950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2254109bc0 0x7f22541103f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f224c009ca0 tx=0x7f224c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.111+0000 7f225c260640 1 -- 172.21.15.53:0/112800950 shutdown_connections 2024-08-31T06:03:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.111+0000 7f225c260640 1 --2- 172.21.15.53:0/112800950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2254109bc0 0x7f22541103f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.111+0000 7f225c260640 1 --2- 172.21.15.53:0/112800950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254109270 0x7f2254109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.111+0000 7f225c260640 1 --2- 172.21.15.53:0/112800950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2254103930 0x7f2254103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.111+0000 7f225c260640 1 -- 172.21.15.53:0/112800950 >> 172.21.15.53:0/112800950 conn(0x7f22540ff3a0 msgr2=0x7f22541017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.111+0000 7f225c260640 1 -- 172.21.15.53:0/112800950 shutdown_connections 2024-08-31T06:03:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.111+0000 7f225c260640 1 -- 172.21.15.53:0/112800950 wait complete. 2024-08-31T06:03:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f225c260640 1 Processor -- start 2024-08-31T06:03:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f225c260640 1 -- start start 2024-08-31T06:03:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f225c260640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2254103930 0x7f22540754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f225c260640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2254109270 0x7f22540759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f225c260640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254109bc0 0x7f2254075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f225c260640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f22541137e0 con 0x7f2254109270 2024-08-31T06:03:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f225c260640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2254113660 con 0x7f2254103930 2024-08-31T06:03:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f225c260640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2254113960 con 0x7f2254109bc0 2024-08-31T06:03:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f22597fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2254109270 0x7f22540759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f22597fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2254109270 0x7f22540759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45006/0 (socket says 172.21.15.53:45006) 2024-08-31T06:03:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f22597fb640 1 -- 172.21.15.53:0/838869880 learned_addr learned my addr 172.21.15.53:0/838869880 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:49.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.112+0000 7f2259ffc640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2254103930 0x7f22540754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f225a7fd640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254109bc0 0x7f2254075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f22597fb640 1 -- 172.21.15.53:0/838869880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254109bc0 msgr2=0x7f2254075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:49.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f22597fb640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254109bc0 0x7f2254075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f22597fb640 1 -- 172.21.15.53:0/838869880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2254103930 msgr2=0x7f22540754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:49.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f22597fb640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2254103930 0x7f22540754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f22597fb640 1 -- 172.21.15.53:0/838869880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22541a8470 con 0x7f2254109270 2024-08-31T06:03:49.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f225a7fd640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254109bc0 0x7f2254075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:49.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f22597fb640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2254109270 0x7f22540759f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f224400c970 tx=0x7f224400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f224affd640 1 -- 172.21.15.53:0/838869880 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244007bb0 con 0x7f2254109270 2024-08-31T06:03:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f224affd640 1 -- 172.21.15.53:0/838869880 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2244007d50 con 0x7f2254109270 2024-08-31T06:03:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f225c260640 1 -- 172.21.15.53:0/838869880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22541a8760 con 0x7f2254109270 2024-08-31T06:03:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f224affd640 1 -- 172.21.15.53:0/838869880 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244004cc0 con 0x7f2254109270 2024-08-31T06:03:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.113+0000 7f225c260640 1 -- 172.21.15.53:0/838869880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22541a8ca0 con 0x7f2254109270 2024-08-31T06:03:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f22627d5740 1 Processor -- start 2024-08-31T06:03:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f224affd640 1 -- 172.21.15.53:0/838869880 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f2244004ea0 con 0x7f2254109270 2024-08-31T06:03:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f22627d5740 1 -- start start 2024-08-31T06:03:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f22627d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6ac1f60 0x55cbe6e677b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f22627d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6a990a0 0x55cbe6e67cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f22627d5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e68230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f22627d5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6dde3f0 con 0x55cbe6aa1280 2024-08-31T06:03:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f22627d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6dcd980 con 0x55cbe6ac1f60 2024-08-31T06:03:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f22627d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6dd1930 con 0x55cbe6a990a0 2024-08-31T06:03:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f22597fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e68230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f22597fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e68230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45008/0 (socket says 172.21.15.53:45008) 2024-08-31T06:03:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f22597fb640 1 -- 172.21.15.53:0/2034254648 learned_addr learned my addr 172.21.15.53:0/2034254648 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.116+0000 7f2259ffc640 1 --2- 172.21.15.53:0/2034254648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6a990a0 0x55cbe6e67cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f225a7fd640 1 --2- 172.21.15.53:0/2034254648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6ac1f60 0x55cbe6e677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f22597fb640 1 -- 172.21.15.53:0/2034254648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6a990a0 msgr2=0x55cbe6e67cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f22597fb640 1 --2- 172.21.15.53:0/2034254648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6a990a0 0x55cbe6e67cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f22597fb640 1 -- 172.21.15.53:0/2034254648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6ac1f60 msgr2=0x55cbe6e677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f22597fb640 1 --2- 172.21.15.53:0/2034254648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6ac1f60 0x55cbe6e677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f22597fb640 1 -- 172.21.15.53:0/2034254648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbe6b2d540 con 0x55cbe6aa1280 2024-08-31T06:03:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f224affd640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22400b4c10 0x7f22400b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f22597fb640 1 --2- 172.21.15.53:0/2034254648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e68230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f22440e28f0 tx=0x7f22440ed910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9be598b58fc461 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f225a7fd640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22400b4c10 0x7f22400b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f224affd640 1 -- 172.21.15.53:0/838869880 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f22440e5100 con 0x7f2254109270 2024-08-31T06:03:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f223ffff640 1 -- 172.21.15.53:0/2034254648 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22440a7790 con 0x55cbe6aa1280 2024-08-31T06:03:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f223ffff640 1 -- 172.21.15.53:0/2034254648 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22440a7050 con 0x55cbe6aa1280 2024-08-31T06:03:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.117+0000 7f223ffff640 1 -- 172.21.15.53:0/2034254648 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22440ab040 con 0x55cbe6aa1280 2024-08-31T06:03:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.118+0000 7f22627d5740 1 -- 172.21.15.53:0/2034254648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 msgr2=0x55cbe6e68230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.118+0000 7f225a7fd640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22400b4c10 0x7f22400b7120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f224c031040 tx=0x7f224c0099b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.118+0000 7f22627d5740 1 --2- 172.21.15.53:0/2034254648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e68230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f22440e28f0 tx=0x7f22440ed910 comp rx=0 tx=0).stop 2024-08-31T06:03:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.118+0000 7f22627d5740 1 -- 172.21.15.53:0/2034254648 shutdown_connections 2024-08-31T06:03:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.118+0000 7f22627d5740 1 --2- 172.21.15.53:0/2034254648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e68230 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.118+0000 7f22627d5740 1 --2- 172.21.15.53:0/2034254648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6a990a0 0x55cbe6e67cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.118+0000 7f22627d5740 1 --2- 172.21.15.53:0/2034254648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6ac1f60 0x55cbe6e677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.118+0000 7f22627d5740 1 -- 172.21.15.53:0/2034254648 >> 172.21.15.53:0/2034254648 conn(0x55cbe6ab6350 msgr2=0x55cbe6e656a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.118+0000 7f22627d5740 1 -- 172.21.15.53:0/2034254648 shutdown_connections 2024-08-31T06:03:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.118+0000 7f22627d5740 1 -- 172.21.15.53:0/2034254648 wait complete. 2024-08-31T06:03:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f22627d5740 1 -- start start 2024-08-31T06:03:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f22627d5740 1 Processor -- start 2024-08-31T06:03:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f22627d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6a990a0 0x55cbe6e72e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f22627d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6aa1280 0x55cbe6e73380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f22627d5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ac1f60 0x55cbe6e7f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f22627d5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6c305f0 con 0x55cbe6ac1f60 2024-08-31T06:03:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f22627d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6d54600 con 0x55cbe6aa1280 2024-08-31T06:03:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f22627d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6e75f90 con 0x55cbe6a990a0 2024-08-31T06:03:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f22627d5740 10 client.0 _ll_register_callbacks cb 0x55cbe6d7aaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:03:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f225a7fd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ac1f60 0x55cbe6e7f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f225a7fd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ac1f60 0x55cbe6e7f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45016/0 (socket says 172.21.15.53:45016) 2024-08-31T06:03:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.119+0000 7f225a7fd640 1 -- 172.21.15.53:0/322786967 learned_addr learned my addr 172.21.15.53:0/322786967 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f2259ffc640 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6a990a0 0x55cbe6e72e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f22597fb640 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6aa1280 0x55cbe6e73380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f225a7fd640 1 -- 172.21.15.53:0/322786967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6a990a0 msgr2=0x55cbe6e72e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f225a7fd640 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6a990a0 0x55cbe6e72e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f225a7fd640 1 -- 172.21.15.53:0/322786967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6aa1280 msgr2=0x55cbe6e73380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f225a7fd640 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6aa1280 0x55cbe6e73380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f225a7fd640 1 -- 172.21.15.53:0/322786967 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbe6d8d7b0 con 0x55cbe6ac1f60 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f225a7fd640 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ac1f60 0x55cbe6e7f280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f224c032c10 tx=0x7f224c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db283ad06fbd230f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f223d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f223d7fa640 1 -- 172.21.15.53:0/322786967 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c04e070 con 0x55cbe6ac1f60 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f223d7fa640 1 -- 172.21.15.53:0/322786967 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f224c0305c0 con 0x55cbe6ac1f60 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f22627d5740 1 -- 172.21.15.53:0/322786967 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22440a7050 con 0x55cbe6ac1f60 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f223d7fa640 1 -- 172.21.15.53:0/322786967 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f224c05a050 con 0x55cbe6ac1f60 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.120+0000 7f22627d5740 10 client.15219 fetch_fsmap learned FSMap version 27 2024-08-31T06:03:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.121+0000 7f22627d5740 1 -- 172.21.15.53:0/322786967 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cbe6e81c70 con 0x55cbe6ac1f60 2024-08-31T06:03:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.121+0000 7f223d7fa640 1 -- 172.21.15.53:0/322786967 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22440a7050 con 0x55cbe6ac1f60 2024-08-31T06:03:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.121+0000 7f223d7fa640 1 -- 172.21.15.53:0/322786967 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f224c043040 con 0x55cbe6ac1f60 2024-08-31T06:03:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.121+0000 7f22627d5740 10 client.15219 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:03:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.121+0000 7f22627d5740 10 client.15219 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T06:03:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.121+0000 7f22627d5740 20 client.15219 populate_metadata read hostname 'smithi053' 2024-08-31T06:03:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.121+0000 7f22627d5740 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cbe6a808e0 0x55cbe6e85790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.121+0000 7f22627d5740 4 client.15219 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:03:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.121+0000 7f22627d5740 1 -- 172.21.15.53:0/322786967 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbe6de0340 con 0x55cbe6a808e0 2024-08-31T06:03:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.121+0000 7f2259ffc640 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cbe6a808e0 0x55cbe6e85790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.122+0000 7f2259ffc640 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cbe6a808e0 0x55cbe6e85790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ec49365043f867a1 server_cookie=9737db84cb7cea1a in_seq=0 out_seq=0 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.122+0000 7f223d7fa640 10 client.15219 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f223d7fa640 1 -- 172.21.15.53:0/322786967 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cbe6de0340 con 0x55cbe6a808e0 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f223d7fa640 10 client.15219 handle_command_reply: tid=0 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 1 client.15219 shutdown 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 1 -- 172.21.15.53:0/322786967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ac1f60 msgr2=0x55cbe6e7f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ac1f60 0x55cbe6e7f280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f224c032c10 tx=0x7f224c0095c0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 1 -- 172.21.15.53:0/322786967 shutdown_connections 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cbe6a808e0 0x55cbe6e85790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ac1f60 0x55cbe6e7f280 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6aa1280 0x55cbe6e73380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 1 --2- 172.21.15.53:0/322786967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6a990a0 0x55cbe6e72e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f223d7fa640 0 client.15219 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 1 -- 172.21.15.53:0/322786967 >> 172.21.15.53:0/322786967 conn(0x55cbe6ab6350 msgr2=0x55cbe6e6a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 1 -- 172.21.15.53:0/322786967 shutdown_connections 2024-08-31T06:03:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 1 -- 172.21.15.53:0/322786967 wait complete. 2024-08-31T06:03:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.123+0000 7f22627d5740 20 client.15219 trim_cache size 0 max 16384 2024-08-31T06:03:49.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.141+0000 7f22627d5740 1 Processor -- start 2024-08-31T06:03:49.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.141+0000 7f22627d5740 1 -- start start 2024-08-31T06:03:49.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f22627d5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ab6350 0x55cbe6e6dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f22627d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 0x55cbe6e6e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f22627d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6aa1280 0x55cbe6e716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f22627d5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6e83ad0 con 0x55cbe6ab6350 2024-08-31T06:03:49.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f22627d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6e841a0 con 0x55cbe6a990a0 2024-08-31T06:03:49.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f22627d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6e84870 con 0x55cbe6aa1280 2024-08-31T06:03:49.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f2259ffc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ab6350 0x55cbe6e6dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f2259ffc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ab6350 0x55cbe6e6dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45030/0 (socket says 172.21.15.53:45030) 2024-08-31T06:03:49.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f2259ffc640 1 -- 172.21.15.53:0/955173321 learned_addr learned my addr 172.21.15.53:0/955173321 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:49.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f225a7fd640 1 --2- 172.21.15.53:0/955173321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6aa1280 0x55cbe6e716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f22597fb640 1 --2- 172.21.15.53:0/955173321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 0x55cbe6e6e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f2259ffc640 1 -- 172.21.15.53:0/955173321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6aa1280 msgr2=0x55cbe6e716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f2259ffc640 1 --2- 172.21.15.53:0/955173321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6aa1280 0x55cbe6e716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f2259ffc640 1 -- 172.21.15.53:0/955173321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 msgr2=0x55cbe6e6e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f2259ffc640 1 --2- 172.21.15.53:0/955173321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 0x55cbe6e6e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f2259ffc640 1 -- 172.21.15.53:0/955173321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbe6e69aa0 con 0x55cbe6ab6350 2024-08-31T06:03:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f22597fb640 1 --2- 172.21.15.53:0/955173321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 0x55cbe6e6e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.142+0000 7f2259ffc640 1 --2- 172.21.15.53:0/955173321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ab6350 0x55cbe6e6dff0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2250009a80 tx=0x7f2250008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c534ecf516913898 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f223f7fe640 1 -- 172.21.15.53:0/955173321 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2250022070 con 0x55cbe6ab6350 2024-08-31T06:03:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f223f7fe640 1 -- 172.21.15.53:0/955173321 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2250016d10 con 0x55cbe6ab6350 2024-08-31T06:03:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f223f7fe640 1 -- 172.21.15.53:0/955173321 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2250014610 con 0x55cbe6ab6350 2024-08-31T06:03:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f22627d5740 1 -- 172.21.15.53:0/955173321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ab6350 msgr2=0x55cbe6e6dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f22627d5740 1 --2- 172.21.15.53:0/955173321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ab6350 0x55cbe6e6dff0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2250009a80 tx=0x7f2250008040 comp rx=0 tx=0).stop 2024-08-31T06:03:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f22627d5740 1 -- 172.21.15.53:0/955173321 shutdown_connections 2024-08-31T06:03:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f22627d5740 1 --2- 172.21.15.53:0/955173321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6aa1280 0x55cbe6e716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f22627d5740 1 --2- 172.21.15.53:0/955173321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 0x55cbe6e6e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f22627d5740 1 --2- 172.21.15.53:0/955173321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6ab6350 0x55cbe6e6dff0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f22627d5740 1 -- 172.21.15.53:0/955173321 >> 172.21.15.53:0/955173321 conn(0x55cbe6e7f770 msgr2=0x55cbe6e72db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f22627d5740 1 -- 172.21.15.53:0/955173321 shutdown_connections 2024-08-31T06:03:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.143+0000 7f22627d5740 1 -- 172.21.15.53:0/955173321 wait complete. 2024-08-31T06:03:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22627d5740 1 -- start start 2024-08-31T06:03:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22627d5740 1 Processor -- start 2024-08-31T06:03:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22627d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 0x55cbe6e87a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22627d5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e87f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22627d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6ab6350 0x55cbe6e88490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22627d5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6e85610 con 0x55cbe6aa1280 2024-08-31T06:03:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22627d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6e84f40 con 0x55cbe6a990a0 2024-08-31T06:03:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22627d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cbe6e85ce0 con 0x55cbe6ab6350 2024-08-31T06:03:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22627d5740 10 client.0 _ll_register_callbacks cb 0x7f224c003de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:03:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22597fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e87f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22597fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e87f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45034/0 (socket says 172.21.15.53:45034) 2024-08-31T06:03:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f22597fb640 1 -- 172.21.15.53:0/3076641777 learned_addr learned my addr 172.21.15.53:0/3076641777 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.144+0000 7f2259ffc640 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 0x55cbe6e87a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f225a7fd640 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6ab6350 0x55cbe6e88490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f22597fb640 1 -- 172.21.15.53:0/3076641777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6ab6350 msgr2=0x55cbe6e88490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f22597fb640 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6ab6350 0x55cbe6e88490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f22597fb640 1 -- 172.21.15.53:0/3076641777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 msgr2=0x55cbe6e87a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f22597fb640 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 0x55cbe6e87a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f22597fb640 1 -- 172.21.15.53:0/3076641777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbe6e8d1a0 con 0x55cbe6aa1280 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f2259ffc640 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 0x55cbe6e87a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f22597fb640 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e87f50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f22440ab5d0 tx=0x7f224401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3a8451a6a3b674 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f223d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f223d7fa640 1 -- 172.21.15.53:0/3076641777 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224401d040 con 0x55cbe6aa1280 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f223d7fa640 1 -- 172.21.15.53:0/3076641777 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f22440b4970 con 0x55cbe6aa1280 2024-08-31T06:03:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f22627d5740 1 -- 172.21.15.53:0/3076641777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2250016d10 con 0x55cbe6aa1280 2024-08-31T06:03:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f223d7fa640 1 -- 172.21.15.53:0/3076641777 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2244096070 con 0x55cbe6aa1280 2024-08-31T06:03:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f22627d5740 10 client.15225 fetch_fsmap learned FSMap version 27 2024-08-31T06:03:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.145+0000 7f22627d5740 1 -- 172.21.15.53:0/3076641777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cbe6ef0e40 con 0x55cbe6aa1280 2024-08-31T06:03:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.146+0000 7f223d7fa640 1 -- 172.21.15.53:0/3076641777 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2250016d10 con 0x55cbe6aa1280 2024-08-31T06:03:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.146+0000 7f223d7fa640 1 -- 172.21.15.53:0/3076641777 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f22440a7240 con 0x55cbe6aa1280 2024-08-31T06:03:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.146+0000 7f22627d5740 10 client.15225 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:03:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.146+0000 7f22627d5740 10 client.15225 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T06:03:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.146+0000 7f22627d5740 20 client.15225 populate_metadata read hostname 'smithi053' 2024-08-31T06:03:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.146+0000 7f22627d5740 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cbe6ac1f60 0x55cbe6ef41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.146+0000 7f22627d5740 4 client.15225 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:03:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.146+0000 7f22627d5740 1 -- 172.21.15.53:0/3076641777 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "status"}) -- 0x55cbe6ddbde0 con 0x55cbe6ac1f60 2024-08-31T06:03:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.146+0000 7f2259ffc640 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cbe6ac1f60 0x55cbe6ef41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f223d7fa640 10 client.15225 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:03:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f2259ffc640 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cbe6ac1f60 0x55cbe6ef41e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=45a59597dd6e67d server_cookie=86af2f6693e77cd3 in_seq=0 out_seq=0 2024-08-31T06:03:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f223d7fa640 1 -- 172.21.15.53:0/3076641777 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55cbe6ddbde0 con 0x55cbe6ac1f60 2024-08-31T06:03:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f223d7fa640 10 client.15225 handle_command_reply: tid=0 2024-08-31T06:03:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 1 client.15225 shutdown 2024-08-31T06:03:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 1 -- 172.21.15.53:0/3076641777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 msgr2=0x55cbe6e87f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e87f50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f22440ab5d0 tx=0x7f224401f000 comp rx=0 tx=0).stop 2024-08-31T06:03:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 1 -- 172.21.15.53:0/3076641777 shutdown_connections 2024-08-31T06:03:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbe6ab6350 0x55cbe6e88490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cbe6ac1f60 0x55cbe6ef41e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe6aa1280 0x55cbe6e87f50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 1 --2- 172.21.15.53:0/3076641777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbe6a990a0 0x55cbe6e87a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f223d7fa640 0 client.15225 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:03:49.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 1 -- 172.21.15.53:0/3076641777 >> 172.21.15.53:0/3076641777 conn(0x55cbe6e7f770 msgr2=0x55cbe6e72db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:49.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 1 -- 172.21.15.53:0/3076641777 shutdown_connections 2024-08-31T06:03:49.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 1 -- 172.21.15.53:0/3076641777 wait complete. 2024-08-31T06:03:49.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.147+0000 7f22627d5740 20 client.15225 trim_cache size 0 max 16384 2024-08-31T06:03:49.157 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:03:49.158 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:03:49.158 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 3, 2024-08-31T06:03:49.158 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24619, 2024-08-31T06:03:49.158 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:03:49.158 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:03:49.158 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:03:49.159 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 68.494129724999993, 2024-08-31T06:03:49.159 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 27, 2024-08-31T06:03:49.159 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 72, 2024-08-31T06:03:49.159 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 70, 2024-08-31T06:03:49.159 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 102.93349551999999 2024-08-31T06:03:49.159 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:03:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 -- 172.21.15.53:0/838869880 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22400b4c10 msgr2=0x7f22400b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22400b4c10 0x7f22400b7120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f224c031040 tx=0x7f224c0099b0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 -- 172.21.15.53:0/838869880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2254109270 msgr2=0x7f22540759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2254109270 0x7f22540759f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f224400c970 tx=0x7f224400cd70 comp rx=0 tx=0).stop 2024-08-31T06:03:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 -- 172.21.15.53:0/838869880 shutdown_connections 2024-08-31T06:03:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22400b4c10 0x7f22400b7120 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2254109bc0 0x7f2254075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2254109270 0x7f22540759f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 --2- 172.21.15.53:0/838869880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2254103930 0x7f22540754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 -- 172.21.15.53:0/838869880 >> 172.21.15.53:0/838869880 conn(0x7f22540ff3a0 msgr2=0x7f22541017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 -- 172.21.15.53:0/838869880 shutdown_connections 2024-08-31T06:03:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:49.148+0000 7f225c260640 1 -- 172.21.15.53:0/838869880 wait complete. 2024-08-31T06:03:49.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T06:03:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:50.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:50 smithi053 ceph-mon[18924]: pgmap v287: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:50.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:50 smithi130 ceph-mon[22266]: pgmap v287: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.612+0000 7ff52145b640 1 -- 172.21.15.53:0/462803446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff51c109270 msgr2=0x7ff51c109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.612+0000 7ff52145b640 1 --2- 172.21.15.53:0/462803446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff51c109270 0x7ff51c109680 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff510009900 tx=0x7ff51002a410 comp rx=0 tx=0).stop 2024-08-31T06:03:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.612+0000 7ff52145b640 1 -- 172.21.15.53:0/462803446 shutdown_connections 2024-08-31T06:03:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.612+0000 7ff52145b640 1 --2- 172.21.15.53:0/462803446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c109bc0 0x7ff51c1103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.612+0000 7ff52145b640 1 --2- 172.21.15.53:0/462803446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff51c109270 0x7ff51c109680 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.612+0000 7ff52145b640 1 --2- 172.21.15.53:0/462803446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff51c103930 0x7ff51c103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.612+0000 7ff52145b640 1 -- 172.21.15.53:0/462803446 >> 172.21.15.53:0/462803446 conn(0x7ff51c0ff3a0 msgr2=0x7ff51c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.612+0000 7ff52145b640 1 -- 172.21.15.53:0/462803446 shutdown_connections 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.612+0000 7ff52145b640 1 -- 172.21.15.53:0/462803446 wait complete. 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.612+0000 7ff52145b640 1 Processor -- start 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff52145b640 1 -- start start 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff52145b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff51c103930 0x7ff51c19a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff52145b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff51c109270 0x7ff51c19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff52145b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c109bc0 0x7ff51c19f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff52145b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c113730 con 0x7ff51c103930 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff52145b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c1135b0 con 0x7ff51c109bc0 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff52145b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c1138b0 con 0x7ff51c109270 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff51affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff51c103930 0x7ff51c19a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff51affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff51c103930 0x7ff51c19a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45062/0 (socket says 172.21.15.53:45062) 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff51affd640 1 -- 172.21.15.53:0/3018765919 learned_addr learned my addr 172.21.15.53:0/3018765919 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff51a7fc640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff51c109270 0x7ff51c19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c109bc0 0x7ff51c19f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff51affd640 1 -- 172.21.15.53:0/3018765919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff51c109270 msgr2=0x7ff51c19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff51affd640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff51c109270 0x7ff51c19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff51affd640 1 -- 172.21.15.53:0/3018765919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c109bc0 msgr2=0x7ff51c19f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff51affd640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c109bc0 0x7ff51c19f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.613+0000 7ff51affd640 1 -- 172.21.15.53:0/3018765919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c1a00f0 con 0x7ff51c103930 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.614+0000 7ff51affd640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff51c103930 0x7ff51c19a180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00d770 tx=0x7ff50c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.614+0000 7ff503fff640 1 -- 172.21.15.53:0/3018765919 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c017070 con 0x7ff51c103930 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.614+0000 7ff52145b640 1 -- 172.21.15.53:0/3018765919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51c1a03e0 con 0x7ff51c103930 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.614+0000 7ff503fff640 1 -- 172.21.15.53:0/3018765919 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff50c0054b0 con 0x7ff51c103930 2024-08-31T06:03:50.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.614+0000 7ff503fff640 1 -- 172.21.15.53:0/3018765919 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c004c60 con 0x7ff51c103930 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.614+0000 7ff52145b640 1 -- 172.21.15.53:0/3018765919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51c1a6b40 con 0x7ff51c103930 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.616+0000 7ff5279d0740 1 Processor -- start 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.616+0000 7ff5279d0740 1 -- start start 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff503fff640 1 -- 172.21.15.53:0/3018765919 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7ff50c004e00 con 0x7ff51c103930 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac730a0 0x56255b041cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac7b280 0x56255b042230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff5279d0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56255afb83f0 con 0x56255ac9bf60 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff5279d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56255afa7980 con 0x56255ac7b280 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff5279d0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56255afab930 con 0x56255ac730a0 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0417b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45078/0 (socket says 172.21.15.53:45078) 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff51b7fe640 1 -- 172.21.15.53:0/3372817933 learned_addr learned my addr 172.21.15.53:0/3372817933 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff51affd640 1 --2- 172.21.15.53:0/3372817933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac730a0 0x56255b041cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff51a7fc640 1 --2- 172.21.15.53:0/3372817933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac7b280 0x56255b042230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff51b7fe640 1 -- 172.21.15.53:0/3372817933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac730a0 msgr2=0x56255b041cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/3372817933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac730a0 0x56255b041cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff51b7fe640 1 -- 172.21.15.53:0/3372817933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac7b280 msgr2=0x56255b042230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/3372817933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac7b280 0x56255b042230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff51b7fe640 1 -- 172.21.15.53:0/3372817933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56255ad07540 con 0x56255ac9bf60 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.617+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/3372817933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0417b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff514009fd0 tx=0x7ff5140118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5e2d51646d4097 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.618+0000 7ff503fff640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5040b4c10 0x7ff5040b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.618+0000 7ff5017fa640 1 -- 172.21.15.53:0/3372817933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff514004d20 con 0x56255ac9bf60 2024-08-31T06:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.618+0000 7ff5017fa640 1 -- 172.21.15.53:0/3372817933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff514004050 con 0x56255ac9bf60 2024-08-31T06:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.618+0000 7ff5017fa640 1 -- 172.21.15.53:0/3372817933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff514005220 con 0x56255ac9bf60 2024-08-31T06:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.618+0000 7ff51affd640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5040b4c10 0x7ff5040b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.618+0000 7ff503fff640 1 -- 172.21.15.53:0/3018765919 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7ff50c0e4e10 con 0x7ff51c103930 2024-08-31T06:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff5279d0740 1 -- 172.21.15.53:0/3372817933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 msgr2=0x56255b0417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff51affd640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5040b4c10 0x7ff5040b7120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x56255b040430 tx=0x7ff50c0ce040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff5279d0740 1 --2- 172.21.15.53:0/3372817933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0417b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff514009fd0 tx=0x7ff5140118d0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff5279d0740 1 -- 172.21.15.53:0/3372817933 shutdown_connections 2024-08-31T06:03:50.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff5279d0740 1 --2- 172.21.15.53:0/3372817933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac7b280 0x56255b042230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff5279d0740 1 --2- 172.21.15.53:0/3372817933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac730a0 0x56255b041cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff5279d0740 1 --2- 172.21.15.53:0/3372817933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0417b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff5279d0740 1 -- 172.21.15.53:0/3372817933 >> 172.21.15.53:0/3372817933 conn(0x56255ac90350 msgr2=0x56255b03f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:50.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff5279d0740 1 -- 172.21.15.53:0/3372817933 shutdown_connections 2024-08-31T06:03:50.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff5279d0740 1 -- 172.21.15.53:0/3372817933 wait complete. 2024-08-31T06:03:50.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff5279d0740 1 -- start start 2024-08-31T06:03:50.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.619+0000 7ff5279d0740 1 Processor -- start 2024-08-31T06:03:50.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac730a0 0x56255b04ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac7b280 0x56255b04d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff5279d0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56255ae0a5f0 con 0x56255ac9bf60 2024-08-31T06:03:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff5279d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56255af2e600 con 0x56255ac730a0 2024-08-31T06:03:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff5279d0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56255b04ff90 con 0x56255ac7b280 2024-08-31T06:03:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff5279d0740 10 client.0 _ll_register_callbacks cb 0x56255af54af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:03:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45090/0 (socket says 172.21.15.53:45090) 2024-08-31T06:03:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff51b7fe640 1 -- 172.21.15.53:0/1509326726 learned_addr learned my addr 172.21.15.53:0/1509326726 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff51a7fc640 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac7b280 0x56255b04d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac730a0 0x56255b04ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff51b7fe640 1 -- 172.21.15.53:0/1509326726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac7b280 msgr2=0x56255b04d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac7b280 0x56255b04d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff51b7fe640 1 -- 172.21.15.53:0/1509326726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac730a0 msgr2=0x56255b04ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac730a0 0x56255b04ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff51b7fe640 1 -- 172.21.15.53:0/1509326726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56255af677b0 con 0x56255ac9bf60 2024-08-31T06:03:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0592b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff514004910 tx=0x7ff514000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8031e76297fe9a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff4feff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:03:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff4feff5640 1 -- 172.21.15.53:0/1509326726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51402d060 con 0x56255ac9bf60 2024-08-31T06:03:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff4feff5640 1 -- 172.21.15.53:0/1509326726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7ff514003a30 con 0x56255ac9bf60 2024-08-31T06:03:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.620+0000 7ff5279d0740 1 -- 172.21.15.53:0/1509326726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff514004050 con 0x56255ac9bf60 2024-08-31T06:03:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff4feff5640 1 -- 172.21.15.53:0/1509326726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff514003c30 con 0x56255ac9bf60 2024-08-31T06:03:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff5279d0740 10 client.15237 fetch_fsmap learned FSMap version 27 2024-08-31T06:03:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff5279d0740 1 -- 172.21.15.53:0/1509326726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56255b05bc70 con 0x56255ac9bf60 2024-08-31T06:03:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff4feff5640 1 -- 172.21.15.53:0/1509326726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff514004050 con 0x56255ac9bf60 2024-08-31T06:03:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff4feff5640 1 -- 172.21.15.53:0/1509326726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff514019430 con 0x56255ac9bf60 2024-08-31T06:03:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff5279d0740 10 client.15237 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:03:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff5279d0740 10 client.15237 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:03:50.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff5279d0740 20 client.15237 populate_metadata read hostname 'smithi053' 2024-08-31T06:03:50.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff5279d0740 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56255ac5a8e0 0x56255b05f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff5279d0740 4 client.15237 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:03:50.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff5279d0740 1 -- 172.21.15.53:0/1509326726 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56255afba340 con 0x56255ac5a8e0 2024-08-31T06:03:50.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.621+0000 7ff51a7fc640 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56255ac5a8e0 0x56255b05f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.622+0000 7ff51a7fc640 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56255ac5a8e0 0x56255b05f440 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e2240374cc315746 server_cookie=4f1d7c747536eeed in_seq=0 out_seq=0 2024-08-31T06:03:50.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.622+0000 7ff4feff5640 10 client.15237 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:03:50.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff4feff5640 1 -- 172.21.15.53:0/1509326726 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56255afba340 con 0x56255ac5a8e0 2024-08-31T06:03:50.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff4feff5640 10 client.15237 handle_command_reply: tid=0 2024-08-31T06:03:50.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 1 client.15237 shutdown 2024-08-31T06:03:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 1 -- 172.21.15.53:0/1509326726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 msgr2=0x56255b0592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0592b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff514004910 tx=0x7ff514000f40 comp rx=0 tx=0).stop 2024-08-31T06:03:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 1 -- 172.21.15.53:0/1509326726 shutdown_connections 2024-08-31T06:03:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56255ac5a8e0 0x56255b05f440 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff4feff5640 0 client.15237 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:03:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac9bf60 0x56255b0592b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac7b280 0x56255b04d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 1 --2- 172.21.15.53:0/1509326726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac730a0 0x56255b04ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 1 -- 172.21.15.53:0/1509326726 >> 172.21.15.53:0/1509326726 conn(0x56255ac90350 msgr2=0x56255b044990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:50.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 1 -- 172.21.15.53:0/1509326726 shutdown_connections 2024-08-31T06:03:50.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 1 -- 172.21.15.53:0/1509326726 wait complete. 2024-08-31T06:03:50.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.623+0000 7ff5279d0740 20 client.15237 trim_cache size 0 max 16384 2024-08-31T06:03:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.641+0000 7ff5279d0740 1 Processor -- start 2024-08-31T06:03:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.641+0000 7ff5279d0740 1 -- start start 2024-08-31T06:03:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac5a8e0 0x56255b05ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac730a0 0x56255b067b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac7b280 0x56255b068050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff5279d0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56255b05d780 con 0x56255ac730a0 2024-08-31T06:03:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff5279d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56255b05de50 con 0x56255ac7b280 2024-08-31T06:03:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff5279d0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56255b05e520 con 0x56255ac5a8e0 2024-08-31T06:03:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac730a0 0x56255b067b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac730a0 0x56255b067b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45098/0 (socket says 172.21.15.53:45098) 2024-08-31T06:03:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51a7fc640 1 -- 172.21.15.53:0/3405037171 learned_addr learned my addr 172.21.15.53:0/3405037171 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/3405037171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac5a8e0 0x56255b05ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/3405037171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac7b280 0x56255b068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51a7fc640 1 -- 172.21.15.53:0/3405037171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac5a8e0 msgr2=0x56255b05ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:50.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51a7fc640 1 --2- 172.21.15.53:0/3405037171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac5a8e0 0x56255b05ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51a7fc640 1 -- 172.21.15.53:0/3405037171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac7b280 msgr2=0x56255b068050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:50.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51a7fc640 1 --2- 172.21.15.53:0/3405037171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac7b280 0x56255b068050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51a7fc640 1 -- 172.21.15.53:0/3405037171 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56255b044610 con 0x56255ac730a0 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/3405037171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac7b280 0x56255b068050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff51a7fc640 1 --2- 172.21.15.53:0/3405037171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac730a0 0x56255b067b10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff510005940 tx=0x7ff5100058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57898442ac9d8a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff500ff9640 1 -- 172.21.15.53:0/3405037171 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51004a070 con 0x56255ac730a0 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff500ff9640 1 -- 172.21.15.53:0/3405037171 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff510031890 con 0x56255ac730a0 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.642+0000 7ff500ff9640 1 -- 172.21.15.53:0/3405037171 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510035040 con 0x56255ac730a0 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.643+0000 7ff5279d0740 1 -- 172.21.15.53:0/3405037171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac730a0 msgr2=0x56255b067b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.643+0000 7ff5279d0740 1 --2- 172.21.15.53:0/3405037171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac730a0 0x56255b067b10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff510005940 tx=0x7ff5100058d0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.643+0000 7ff5279d0740 1 -- 172.21.15.53:0/3405037171 shutdown_connections 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.643+0000 7ff5279d0740 1 --2- 172.21.15.53:0/3405037171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac7b280 0x56255b068050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.643+0000 7ff5279d0740 1 --2- 172.21.15.53:0/3405037171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac730a0 0x56255b067b10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.643+0000 7ff5279d0740 1 --2- 172.21.15.53:0/3405037171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac5a8e0 0x56255b05ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.643+0000 7ff5279d0740 1 -- 172.21.15.53:0/3405037171 >> 172.21.15.53:0/3405037171 conn(0x56255ac90350 msgr2=0x56255b03a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.643+0000 7ff5279d0740 1 -- 172.21.15.53:0/3405037171 shutdown_connections 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.643+0000 7ff5279d0740 1 -- 172.21.15.53:0/3405037171 wait complete. 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff5279d0740 1 -- start start 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff5279d0740 1 Processor -- start 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac5a8e0 0x56255b0606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac730a0 0x56255b060bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff5279d0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac7b280 0x56255b061130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff5279d0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56255b05f2c0 con 0x56255ac7b280 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff5279d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56255b05ebf0 con 0x56255ac730a0 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff5279d0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56255b05f990 con 0x56255ac5a8e0 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff5279d0740 10 client.0 _ll_register_callbacks cb 0x7ff514009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac7b280 0x56255b061130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac7b280 0x56255b061130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45100/0 (socket says 172.21.15.53:45100) 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff51b7fe640 1 -- 172.21.15.53:0/838124645 learned_addr learned my addr 172.21.15.53:0/838124645 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac5a8e0 0x56255b0606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.644+0000 7ff51a7fc640 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac730a0 0x56255b060bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff51b7fe640 1 -- 172.21.15.53:0/838124645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac5a8e0 msgr2=0x56255b0606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac5a8e0 0x56255b0606b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff51b7fe640 1 -- 172.21.15.53:0/838124645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac730a0 msgr2=0x56255b060bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac730a0 0x56255b060bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff51b7fe640 1 -- 172.21.15.53:0/838124645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56255b0cd940 con 0x56255ac7b280 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff51b7fe640 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac7b280 0x56255b061130 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x56255afef850 tx=0x7ff514000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528a646dad666b6a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff4feff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff4feff5640 1 -- 172.21.15.53:0/838124645 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51402d040 con 0x56255ac7b280 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff5279d0740 1 -- 172.21.15.53:0/838124645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff510031890 con 0x56255ac7b280 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff4feff5640 1 -- 172.21.15.53:0/838124645 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7ff5140046a0 con 0x56255ac7b280 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff4feff5640 1 -- 172.21.15.53:0/838124645 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff5140199f0 con 0x56255ac7b280 2024-08-31T06:03:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff5279d0740 10 client.15243 fetch_fsmap learned FSMap version 27 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.645+0000 7ff5279d0740 1 -- 172.21.15.53:0/838124645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56255b0cea30 con 0x56255ac7b280 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.646+0000 7ff4feff5640 1 -- 172.21.15.53:0/838124645 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff510031890 con 0x56255ac7b280 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.646+0000 7ff4feff5640 1 -- 172.21.15.53:0/838124645 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff514044050 con 0x56255ac7b280 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.646+0000 7ff5279d0740 10 client.15243 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.646+0000 7ff5279d0740 10 client.15243 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.646+0000 7ff5279d0740 20 client.15243 populate_metadata read hostname 'smithi053' 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.646+0000 7ff5279d0740 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56255ac9bf60 0x56255b0d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.646+0000 7ff5279d0740 4 client.15243 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.646+0000 7ff5279d0740 1 -- 172.21.15.53:0/838124645 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "status"}) -- 0x56255afb5de0 con 0x56255ac9bf60 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.646+0000 7ff51a7fc640 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56255ac9bf60 0x56255b0d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff4feff5640 10 client.15243 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff51a7fc640 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56255ac9bf60 0x56255b0d2260 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6e7c251ff6e3d4d3 server_cookie=c41b42c3230e6f03 in_seq=0 out_seq=0 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff4feff5640 1 -- 172.21.15.53:0/838124645 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x56255afb5de0 con 0x56255ac9bf60 2024-08-31T06:03:50.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff4feff5640 10 client.15243 handle_command_reply: tid=0 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 1 client.15243 shutdown 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 1 -- 172.21.15.53:0/838124645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac7b280 msgr2=0x56255b061130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac7b280 0x56255b061130 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x56255afef850 tx=0x7ff514000f40 comp rx=0 tx=0).stop 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 1 -- 172.21.15.53:0/838124645 shutdown_connections 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56255ac9bf60 0x56255b0d2260 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56255ac7b280 0x56255b061130 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56255ac730a0 0x56255b060bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff4feff5640 0 client.15243 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 1 --2- 172.21.15.53:0/838124645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56255ac5a8e0 0x56255b0606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 1 -- 172.21.15.53:0/838124645 >> 172.21.15.53:0/838124645 conn(0x56255ac90350 msgr2=0x56255b03a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 1 -- 172.21.15.53:0/838124645 shutdown_connections 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 1 -- 172.21.15.53:0/838124645 wait complete. 2024-08-31T06:03:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.647+0000 7ff5279d0740 20 client.15243 trim_cache size 0 max 16384 2024-08-31T06:03:50.665 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:03:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:03:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 2, 2024-08-31T06:03:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24632, 2024-08-31T06:03:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:03:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:03:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:03:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 71.010367083999995, 2024-08-31T06:03:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 27, 2024-08-31T06:03:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 72, 2024-08-31T06:03:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 70, 2024-08-31T06:03:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 101.86727526 2024-08-31T06:03:50.666 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:03:50.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 -- 172.21.15.53:0/3018765919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5040b4c10 msgr2=0x7ff5040b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:50.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5040b4c10 0x7ff5040b7120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x56255b040430 tx=0x7ff50c0ce040 comp rx=0 tx=0).stop 2024-08-31T06:03:50.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 -- 172.21.15.53:0/3018765919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff51c103930 msgr2=0x7ff51c19a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:50.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff51c103930 0x7ff51c19a180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00d770 tx=0x7ff50c00dc30 comp rx=0 tx=0).stop 2024-08-31T06:03:50.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 -- 172.21.15.53:0/3018765919 shutdown_connections 2024-08-31T06:03:50.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5040b4c10 0x7ff5040b7120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c109bc0 0x7ff51c19f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff51c109270 0x7ff51c19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 --2- 172.21.15.53:0/3018765919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff51c103930 0x7ff51c19a180 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:50.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 -- 172.21.15.53:0/3018765919 >> 172.21.15.53:0/3018765919 conn(0x7ff51c0ff3a0 msgr2=0x7ff51c1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:50.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 -- 172.21.15.53:0/3018765919 shutdown_connections 2024-08-31T06:03:50.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:50.648+0000 7ff52145b640 1 -- 172.21.15.53:0/3018765919 wait complete. 2024-08-31T06:03:50.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:50 smithi153 ceph-mon[22320]: pgmap v287: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:51.304 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T06:03:51.555 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.034+0000 7f31f9538640 1 -- 172.21.15.53:0/1304854613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f4109b90 msgr2=0x7f31f41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.034+0000 7f31f9538640 1 --2- 172.21.15.53:0/1304854613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f4109b90 0x7f31f41103c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009ca0 tx=0x7f31ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.034+0000 7f31f9538640 1 -- 172.21.15.53:0/1304854613 shutdown_connections 2024-08-31T06:03:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.034+0000 7f31f9538640 1 --2- 172.21.15.53:0/1304854613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f4109b90 0x7f31f41103c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.034+0000 7f31f9538640 1 --2- 172.21.15.53:0/1304854613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31f4109240 0x7f31f4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.034+0000 7f31f9538640 1 --2- 172.21.15.53:0/1304854613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31f4103900 0x7f31f4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.034+0000 7f31f9538640 1 -- 172.21.15.53:0/1304854613 >> 172.21.15.53:0/1304854613 conn(0x7f31f407b5f0 msgr2=0x7f31f407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.034+0000 7f31f9538640 1 -- 172.21.15.53:0/1304854613 shutdown_connections 2024-08-31T06:03:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.034+0000 7f31f9538640 1 -- 172.21.15.53:0/1304854613 wait complete. 2024-08-31T06:03:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.035+0000 7f31f9538640 1 Processor -- start 2024-08-31T06:03:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.035+0000 7f31f9538640 1 -- start start 2024-08-31T06:03:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f9538640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f4103900 0x7f31f40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f9538640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31f4109240 0x7f31f40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f9538640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31f4109b90 0x7f31f4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f9538640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f31f41137b0 con 0x7f31f4103900 2024-08-31T06:03:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f9538640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f31f4113630 con 0x7f31f4109240 2024-08-31T06:03:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f9538640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f31f4113930 con 0x7f31f4109b90 2024-08-31T06:03:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f4103900 0x7f31f40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f4103900 0x7f31f40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45114/0 (socket says 172.21.15.53:45114) 2024-08-31T06:03:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f2ffd640 1 -- 172.21.15.53:0/14440595 learned_addr learned my addr 172.21.15.53:0/14440595 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f27fc640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31f4109240 0x7f31f40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f37fe640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31f4109b90 0x7f31f4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f2ffd640 1 -- 172.21.15.53:0/14440595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31f4109b90 msgr2=0x7f31f4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31f4109b90 0x7f31f4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f2ffd640 1 -- 172.21.15.53:0/14440595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31f4109240 msgr2=0x7f31f40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31f4109240 0x7f31f40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f2ffd640 1 -- 172.21.15.53:0/14440595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f41a84d0 con 0x7f31f4103900 2024-08-31T06:03:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.036+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f4103900 0x7f31f40754b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f31e400b4a0 tx=0x7f31e400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.037+0000 7f31dbfff640 1 -- 172.21.15.53:0/14440595 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4015020 con 0x7f31f4103900 2024-08-31T06:03:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.037+0000 7f31dbfff640 1 -- 172.21.15.53:0/14440595 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31e4011cc0 con 0x7f31f4103900 2024-08-31T06:03:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.037+0000 7f31dbfff640 1 -- 172.21.15.53:0/14440595 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4010d00 con 0x7f31f4103900 2024-08-31T06:03:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.037+0000 7f31f9538640 1 -- 172.21.15.53:0/14440595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f41a87c0 con 0x7f31f4103900 2024-08-31T06:03:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.037+0000 7f31f9538640 1 -- 172.21.15.53:0/14440595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f41a8cb0 con 0x7f31f4103900 2024-08-31T06:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.039+0000 7f31ffaad740 1 Processor -- start 2024-08-31T06:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.039+0000 7f31ffaad740 1 -- start start 2024-08-31T06:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.039+0000 7f31dbfff640 1 -- 172.21.15.53:0/14440595 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f31e4018020 con 0x7f31f4103900 2024-08-31T06:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd13608f60 0x55cd139ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd135e00a0 0x55cd139aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e8280 0x55cd139af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31ffaad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cd139253f0 con 0x55cd135e8280 2024-08-31T06:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31ffaad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cd13914980 con 0x55cd13608f60 2024-08-31T06:03:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31ffaad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd13918930 con 0x55cd135e00a0 2024-08-31T06:03:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e8280 0x55cd139af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e8280 0x55cd139af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45122/0 (socket says 172.21.15.53:45122) 2024-08-31T06:03:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f27fc640 1 -- 172.21.15.53:0/1060906459 learned_addr learned my addr 172.21.15.53:0/1060906459 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/1060906459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd135e00a0 0x55cd139aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f37fe640 1 --2- 172.21.15.53:0/1060906459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd13608f60 0x55cd139ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f27fc640 1 -- 172.21.15.53:0/1060906459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd135e00a0 msgr2=0x55cd139aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f27fc640 1 --2- 172.21.15.53:0/1060906459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd135e00a0 0x55cd139aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f27fc640 1 -- 172.21.15.53:0/1060906459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd13608f60 msgr2=0x55cd139ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f27fc640 1 --2- 172.21.15.53:0/1060906459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd13608f60 0x55cd139ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f27fc640 1 -- 172.21.15.53:0/1060906459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd13674540 con 0x55cd135e8280 2024-08-31T06:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31dbfff640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31dc0b4c10 0x7f31dc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f37fe640 1 --2- 172.21.15.53:0/1060906459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd13608f60 0x55cd139ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f27fc640 1 --2- 172.21.15.53:0/1060906459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e8280 0x55cd139af230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f31e800ac30 tx=0x7f31e800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd91c8a0e5ff184 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31f37fe640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31dc0b4c10 0x7f31dc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.040+0000 7f31dbfff640 1 -- 172.21.15.53:0/14440595 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f31e40e4b60 con 0x7f31f4103900 2024-08-31T06:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.041+0000 7f31d97fa640 1 -- 172.21.15.53:0/1060906459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e801d070 con 0x55cd135e8280 2024-08-31T06:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.041+0000 7f31d97fa640 1 -- 172.21.15.53:0/1060906459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31e8018ad0 con 0x55cd135e8280 2024-08-31T06:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.041+0000 7f31d97fa640 1 -- 172.21.15.53:0/1060906459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e8010a70 con 0x55cd135e8280 2024-08-31T06:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31ffaad740 1 -- 172.21.15.53:0/1060906459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e8280 msgr2=0x55cd139af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31ffaad740 1 --2- 172.21.15.53:0/1060906459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e8280 0x55cd139af230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f31e800ac30 tx=0x7f31e800f790 comp rx=0 tx=0).stop 2024-08-31T06:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31f37fe640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31dc0b4c10 0x7f31dc0b7120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31ec006010 tx=0x7f31ec005c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31ffaad740 1 -- 172.21.15.53:0/1060906459 shutdown_connections 2024-08-31T06:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31ffaad740 1 --2- 172.21.15.53:0/1060906459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e8280 0x55cd139af230 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31ffaad740 1 --2- 172.21.15.53:0/1060906459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd135e00a0 0x55cd139aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31ffaad740 1 --2- 172.21.15.53:0/1060906459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd13608f60 0x55cd139ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31ffaad740 1 -- 172.21.15.53:0/1060906459 >> 172.21.15.53:0/1060906459 conn(0x55cd135fd350 msgr2=0x55cd139ac6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31ffaad740 1 -- 172.21.15.53:0/1060906459 shutdown_connections 2024-08-31T06:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31ffaad740 1 -- 172.21.15.53:0/1060906459 wait complete. 2024-08-31T06:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31ffaad740 1 -- start start 2024-08-31T06:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.042+0000 7f31ffaad740 1 Processor -- start 2024-08-31T06:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd135e00a0 0x55cd139b9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd13608f60 0x55cd139c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31ffaad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cd137775f0 con 0x55cd13608f60 2024-08-31T06:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31ffaad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cd1389b600 con 0x55cd135e8280 2024-08-31T06:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31ffaad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd139bcf90 con 0x55cd135e00a0 2024-08-31T06:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31ffaad740 10 client.0 _ll_register_callbacks cb 0x55cd138c1af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31f37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd13608f60 0x55cd139c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31f37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd13608f60 0x55cd139c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45138/0 (socket says 172.21.15.53:45138) 2024-08-31T06:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31f37fe640 1 -- 172.21.15.53:0/3231256041 learned_addr learned my addr 172.21.15.53:0/3231256041 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31f27fc640 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd135e00a0 0x55cd139b9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31f37fe640 1 -- 172.21.15.53:0/3231256041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd135e00a0 msgr2=0x55cd139b9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31f37fe640 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd135e00a0 0x55cd139b9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31f37fe640 1 -- 172.21.15.53:0/3231256041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 msgr2=0x55cd139ba410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31f37fe640 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139ba410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.043+0000 7f31f37fe640 1 -- 172.21.15.53:0/3231256041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd138d47b0 con 0x55cd13608f60 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31f37fe640 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd13608f60 0x55cd139c6280 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f31ec005cc0 tx=0x7f31ec02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5471caf2a57afe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31d6ff5640 1 -- 172.21.15.53:0/3231256041 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec004250 con 0x55cd13608f60 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31d6ff5640 1 -- 172.21.15.53:0/3231256041 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f31ec0043f0 con 0x55cd13608f60 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31ffaad740 1 -- 172.21.15.53:0/3231256041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31e8018ad0 con 0x55cd13608f60 2024-08-31T06:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31d6ff5640 1 -- 172.21.15.53:0/3231256041 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f31ec0045f0 con 0x55cd13608f60 2024-08-31T06:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31ffaad740 10 client.15255 fetch_fsmap learned FSMap version 27 2024-08-31T06:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31ffaad740 1 -- 172.21.15.53:0/3231256041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd139c8d00 con 0x55cd13608f60 2024-08-31T06:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31d6ff5640 1 -- 172.21.15.53:0/3231256041 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31e8018ad0 con 0x55cd13608f60 2024-08-31T06:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31d6ff5640 1 -- 172.21.15.53:0/3231256041 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f31ec05a070 con 0x55cd13608f60 2024-08-31T06:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31ffaad740 10 client.15255 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31ffaad740 10 client.15255 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.044+0000 7f31ffaad740 20 client.15255 populate_metadata read hostname 'smithi053' 2024-08-31T06:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.045+0000 7f31ffaad740 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55cd135c78e0 0x55cd139cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.045+0000 7f31ffaad740 4 client.15255 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.045+0000 7f31ffaad740 1 -- 172.21.15.53:0/3231256041 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd13927340 con 0x55cd135c78e0 2024-08-31T06:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.045+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55cd135c78e0 0x55cd139cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.045+0000 7f31d6ff5640 10 client.15255 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:03:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.045+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55cd135c78e0 0x55cd139cc800 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad54ed57900320c7 server_cookie=fc816ce73829508 in_seq=0 out_seq=0 2024-08-31T06:03:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31d6ff5640 1 -- 172.21.15.53:0/3231256041 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd13927340 con 0x55cd135c78e0 2024-08-31T06:03:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31d6ff5640 10 client.15255 handle_command_reply: tid=0 2024-08-31T06:03:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31ffaad740 1 client.15255 shutdown 2024-08-31T06:03:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31ffaad740 1 -- 172.21.15.53:0/3231256041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd13608f60 msgr2=0x55cd139c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31ffaad740 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd13608f60 0x55cd139c6280 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f31ec005cc0 tx=0x7f31ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31ffaad740 1 -- 172.21.15.53:0/3231256041 shutdown_connections 2024-08-31T06:03:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31ffaad740 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55cd135c78e0 0x55cd139cc800 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31ffaad740 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd13608f60 0x55cd139c6280 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31ffaad740 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139ba410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31ffaad740 1 --2- 172.21.15.53:0/3231256041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd135e00a0 0x55cd139b9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31ffaad740 1 -- 172.21.15.53:0/3231256041 >> 172.21.15.53:0/3231256041 conn(0x55cd135fd350 msgr2=0x55cd139b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31d6ff5640 0 client.15255 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:03:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31ffaad740 1 -- 172.21.15.53:0/3231256041 shutdown_connections 2024-08-31T06:03:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.046+0000 7f31ffaad740 1 -- 172.21.15.53:0/3231256041 wait complete. 2024-08-31T06:03:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.047+0000 7f31ffaad740 20 client.15255 trim_cache size 0 max 16384 2024-08-31T06:03:52.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31ffaad740 1 Processor -- start 2024-08-31T06:03:52.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31ffaad740 1 -- start start 2024-08-31T06:03:52.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139b9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd13608f60 0x55cd139ba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31ffaad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cd139cab40 con 0x55cd135e00a0 2024-08-31T06:03:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31ffaad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cd139cb210 con 0x55cd135e8280 2024-08-31T06:03:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31ffaad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd139cb8e0 con 0x55cd13608f60 2024-08-31T06:03:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31f2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31f2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45152/0 (socket says 172.21.15.53:45152) 2024-08-31T06:03:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31f2ffd640 1 -- 172.21.15.53:0/807406580 learned_addr learned my addr 172.21.15.53:0/807406580 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31f2ffd640 1 -- 172.21.15.53:0/807406580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd13608f60 msgr2=0x55cd139ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/807406580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd13608f60 0x55cd139ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31f2ffd640 1 -- 172.21.15.53:0/807406580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 msgr2=0x55cd139b9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:52.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/807406580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139b9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.065+0000 7f31f2ffd640 1 -- 172.21.15.53:0/807406580 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd139bb190 con 0x55cd135e00a0 2024-08-31T06:03:52.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.066+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/807406580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139c61f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f31e40ab2c0 tx=0x7f31e40b4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749236a3843b3594 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:52.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.066+0000 7f31d8ff9640 1 -- 172.21.15.53:0/807406580 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e40aaaa0 con 0x55cd135e00a0 2024-08-31T06:03:52.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.066+0000 7f31d8ff9640 1 -- 172.21.15.53:0/807406580 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31e4010ea0 con 0x55cd135e00a0 2024-08-31T06:03:52.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.066+0000 7f31d8ff9640 1 -- 172.21.15.53:0/807406580 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e40b4650 con 0x55cd135e00a0 2024-08-31T06:03:52.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 -- 172.21.15.53:0/807406580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 msgr2=0x55cd139c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:52.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 --2- 172.21.15.53:0/807406580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139c61f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f31e40ab2c0 tx=0x7f31e40b4040 comp rx=0 tx=0).stop 2024-08-31T06:03:52.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 -- 172.21.15.53:0/807406580 shutdown_connections 2024-08-31T06:03:52.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 --2- 172.21.15.53:0/807406580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd13608f60 0x55cd139ba380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 --2- 172.21.15.53:0/807406580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139b9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 --2- 172.21.15.53:0/807406580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139c61f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 -- 172.21.15.53:0/807406580 >> 172.21.15.53:0/807406580 conn(0x55cd135fd350 msgr2=0x55cd139a7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:52.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 -- 172.21.15.53:0/807406580 shutdown_connections 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 -- 172.21.15.53:0/807406580 wait complete. 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 -- start start 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 Processor -- start 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd13608f60 0x55cd139d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cd139cc680 con 0x55cd135e00a0 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cd139cbfb0 con 0x55cd135e8280 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.067+0000 7f31ffaad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd139ccd50 con 0x55cd13608f60 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31ffaad740 10 client.0 _ll_register_callbacks cb 0x7f31ec003dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45156/0 (socket says 172.21.15.53:45156) 2024-08-31T06:03:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f2ffd640 1 -- 172.21.15.53:0/1051532425 learned_addr learned my addr 172.21.15.53:0/1051532425 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f37fe640 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd13608f60 0x55cd139d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f27fc640 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f2ffd640 1 -- 172.21.15.53:0/1051532425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd13608f60 msgr2=0x55cd139d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd13608f60 0x55cd139d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f2ffd640 1 -- 172.21.15.53:0/1051532425 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 msgr2=0x55cd139ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f2ffd640 1 -- 172.21.15.53:0/1051532425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd139d3dd0 con 0x55cd135e00a0 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f27fc640 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31f2ffd640 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139ce160 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f31e40e2990 tx=0x7f31e40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29ee2150fa17131 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31d6ff5640 1 -- 172.21.15.53:0/1051532425 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e40aae40 con 0x55cd135e00a0 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31d6ff5640 1 -- 172.21.15.53:0/1051532425 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f31e40e2660 con 0x55cd135e00a0 2024-08-31T06:03:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31ffaad740 1 -- 172.21.15.53:0/1051532425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31e4010ea0 con 0x55cd135e00a0 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31d6ff5640 1 -- 172.21.15.53:0/1051532425 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f31e40aba30 con 0x55cd135e00a0 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31ffaad740 10 client.15261 fetch_fsmap learned FSMap version 27 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.068+0000 7f31ffaad740 1 -- 172.21.15.53:0/1051532425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd139d5190 con 0x55cd135e00a0 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.069+0000 7f31d6ff5640 1 -- 172.21.15.53:0/1051532425 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31e4010ea0 con 0x55cd135e00a0 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.069+0000 7f31d6ff5640 1 -- 172.21.15.53:0/1051532425 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f31e40ee040 con 0x55cd135e00a0 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.069+0000 7f31ffaad740 10 client.15261 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.069+0000 7f31ffaad740 10 client.15261 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.069+0000 7f31ffaad740 20 client.15261 populate_metadata read hostname 'smithi053' 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.069+0000 7f31ffaad740 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55cd1359cc90 0x55cd13a3a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.069+0000 7f31ffaad740 4 client.15261 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.069+0000 7f31ffaad740 1 -- 172.21.15.53:0/1051532425 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "status"}) -- 0x55cd13922de0 con 0x55cd1359cc90 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.069+0000 7f31f27fc640 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55cd1359cc90 0x55cd13a3a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31d6ff5640 10 client.15261 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31f27fc640 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55cd1359cc90 0x55cd13a3a820 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f486ca73a8a97aa server_cookie=2df0fb7398557c4f in_seq=0 out_seq=0 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31d6ff5640 1 -- 172.21.15.53:0/1051532425 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55cd13922de0 con 0x55cd1359cc90 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31d6ff5640 10 client.15261 handle_command_reply: tid=0 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 1 client.15261 shutdown 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 1 -- 172.21.15.53:0/1051532425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 msgr2=0x55cd139ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139ce160 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f31e40e2990 tx=0x7f31e40047d0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 1 -- 172.21.15.53:0/1051532425 shutdown_connections 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55cd1359cc90 0x55cd13a3a820 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31d6ff5640 0 client.15261 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd13608f60 0x55cd139d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd135e8280 0x55cd139ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 1 --2- 172.21.15.53:0/1051532425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd135e00a0 0x55cd139ce160 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 1 -- 172.21.15.53:0/1051532425 >> 172.21.15.53:0/1051532425 conn(0x55cd135fd350 msgr2=0x55cd139a7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 1 -- 172.21.15.53:0/1051532425 shutdown_connections 2024-08-31T06:03:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 1 -- 172.21.15.53:0/1051532425 wait complete. 2024-08-31T06:03:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.070+0000 7f31ffaad740 20 client.15261 trim_cache size 0 max 16384 2024-08-31T06:03:52.080 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:03:52.080 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:03:52.080 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 1, 2024-08-31T06:03:52.080 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24640, 2024-08-31T06:03:52.080 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:03:52.080 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:03:52.080 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:03:52.080 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 73.439375845000001, 2024-08-31T06:03:52.081 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 27, 2024-08-31T06:03:52.081 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 72, 2024-08-31T06:03:52.081 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 70, 2024-08-31T06:03:52.081 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 100.722150865 2024-08-31T06:03:52.081 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:03:52.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 -- 172.21.15.53:0/14440595 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31dc0b4c10 msgr2=0x7f31dc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31dc0b4c10 0x7f31dc0b7120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31ec006010 tx=0x7f31ec005c30 comp rx=0 tx=0).stop 2024-08-31T06:03:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 -- 172.21.15.53:0/14440595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f4103900 msgr2=0x7f31f40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f4103900 0x7f31f40754b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f31e400b4a0 tx=0x7f31e400b8a0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 -- 172.21.15.53:0/14440595 shutdown_connections 2024-08-31T06:03:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31dc0b4c10 0x7f31dc0b7120 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31f4109b90 0x7f31f4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31f4109240 0x7f31f40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 --2- 172.21.15.53:0/14440595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31f4103900 0x7f31f40754b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 -- 172.21.15.53:0/14440595 >> 172.21.15.53:0/14440595 conn(0x7f31f407b5f0 msgr2=0x7f31f4107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 -- 172.21.15.53:0/14440595 shutdown_connections 2024-08-31T06:03:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:52.071+0000 7f31f9538640 1 -- 172.21.15.53:0/14440595 wait complete. 2024-08-31T06:03:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:52 smithi053 ceph-mon[18924]: pgmap v288: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:03:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:52 smithi130 ceph-mon[22266]: pgmap v288: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:03:52.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:52 smithi153 ceph-mon[22320]: pgmap v288: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:03:52.763 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T06:03:53.016 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.476+0000 7f97280cf640 1 -- 172.21.15.53:0/657988693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9720109b90 msgr2=0x7f97201103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.476+0000 7f97280cf640 1 --2- 172.21.15.53:0/657988693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9720109b90 0x7f97201103c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9718009ca0 tx=0x7f971802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.476+0000 7f97280cf640 1 -- 172.21.15.53:0/657988693 shutdown_connections 2024-08-31T06:03:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.476+0000 7f97280cf640 1 --2- 172.21.15.53:0/657988693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9720109b90 0x7f97201103c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.476+0000 7f97280cf640 1 --2- 172.21.15.53:0/657988693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9720109240 0x7f9720109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.476+0000 7f97280cf640 1 --2- 172.21.15.53:0/657988693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9720103900 0x7f9720103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.476+0000 7f97280cf640 1 -- 172.21.15.53:0/657988693 >> 172.21.15.53:0/657988693 conn(0x7f972007b5f0 msgr2=0x7f972007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:53.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.476+0000 7f97280cf640 1 -- 172.21.15.53:0/657988693 shutdown_connections 2024-08-31T06:03:53.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.476+0000 7f97280cf640 1 -- 172.21.15.53:0/657988693 wait complete. 2024-08-31T06:03:53.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f97280cf640 1 Processor -- start 2024-08-31T06:03:53.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f97280cf640 1 -- start start 2024-08-31T06:03:53.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f97280cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9720103900 0x7f972019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f97280cf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9720109240 0x7f972019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f97280cf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9720109b90 0x7f972019f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f97280cf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9720113750 con 0x7f9720103900 2024-08-31T06:03:53.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f97280cf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97201135d0 con 0x7f9720109b90 2024-08-31T06:03:53.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f97280cf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97201138d0 con 0x7f9720109240 2024-08-31T06:03:53.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f9725e6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9720103900 0x7f972019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f9725e6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9720103900 0x7f972019a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38294/0 (socket says 172.21.15.53:38294) 2024-08-31T06:03:53.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f9725e6b640 1 -- 172.21.15.53:0/3857909916 learned_addr learned my addr 172.21.15.53:0/3857909916 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:53.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f972666c640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9720109b90 0x7f972019f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.477+0000 7f972566a640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9720109240 0x7f972019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f9725e6b640 1 -- 172.21.15.53:0/3857909916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9720109240 msgr2=0x7f972019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:53.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f9725e6b640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9720109240 0x7f972019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f9725e6b640 1 -- 172.21.15.53:0/3857909916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9720109b90 msgr2=0x7f972019f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:53.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f9725e6b640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9720109b90 0x7f972019f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f9725e6b640 1 -- 172.21.15.53:0/3857909916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97201a00b0 con 0x7f9720103900 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f972566a640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9720109240 0x7f972019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f972666c640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9720109b90 0x7f972019f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f9725e6b640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9720103900 0x7f972019a140 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f971c00d950 tx=0x7f971c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f9712ffd640 1 -- 172.21.15.53:0/3857909916 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c017070 con 0x7f9720103900 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f9712ffd640 1 -- 172.21.15.53:0/3857909916 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f971c009c30 con 0x7f9720103900 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f97280cf640 1 -- 172.21.15.53:0/3857909916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97201a03a0 con 0x7f9720103900 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f9712ffd640 1 -- 172.21.15.53:0/3857909916 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c00f620 con 0x7f9720103900 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.478+0000 7f97280cf640 1 -- 172.21.15.53:0/3857909916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97201a6b00 con 0x7f9720103900 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.480+0000 7f972e644740 1 Processor -- start 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f972e644740 1 -- start start 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f9712ffd640 1 -- 172.21.15.53:0/3857909916 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f971c010460 con 0x7f9720103900 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f972e644740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d28811af60 0x55d2884c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f972e644740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880f20a0 0x55d2884c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f972e644740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f972e644740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d2884373f0 con 0x55d2880fa280 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f972e644740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d288426980 con 0x55d28811af60 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f972e644740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d28842a930 con 0x55d2880f20a0 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f972566a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f972566a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38300/0 (socket says 172.21.15.53:38300) 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f972566a640 1 -- 172.21.15.53:0/3477705681 learned_addr learned my addr 172.21.15.53:0/3477705681 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f972666c640 1 --2- 172.21.15.53:0/3477705681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d28811af60 0x55d2884c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.481+0000 7f9725e6b640 1 --2- 172.21.15.53:0/3477705681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880f20a0 0x55d2884c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f972566a640 1 -- 172.21.15.53:0/3477705681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880f20a0 msgr2=0x55d2884c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f972566a640 1 --2- 172.21.15.53:0/3477705681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880f20a0 0x55d2884c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f972566a640 1 -- 172.21.15.53:0/3477705681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d28811af60 msgr2=0x55d2884c07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f972566a640 1 --2- 172.21.15.53:0/3477705681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d28811af60 0x55d2884c07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f972566a640 1 -- 172.21.15.53:0/3477705681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d288186540 con 0x55d2880fa280 2024-08-31T06:03:53.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f9712ffd640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f970c0b4c10 0x7f970c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f972566a640 1 --2- 172.21.15.53:0/3477705681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884c1230 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9714009c70 tx=0x7f9714010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92398fc3b963996 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:53.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f972666c640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f970c0b4c10 0x7f970c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f970bfff640 1 -- 172.21.15.53:0/3477705681 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714004020 con 0x55d2880fa280 2024-08-31T06:03:53.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f9712ffd640 1 -- 172.21.15.53:0/3857909916 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f971c0e5120 con 0x7f9720103900 2024-08-31T06:03:53.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f970bfff640 1 -- 172.21.15.53:0/3477705681 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97140041c0 con 0x55d2880fa280 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.482+0000 7f970bfff640 1 -- 172.21.15.53:0/3477705681 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97140126b0 con 0x55d2880fa280 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.483+0000 7f972e644740 1 -- 172.21.15.53:0/3477705681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 msgr2=0x55d2884c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.483+0000 7f972666c640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f970c0b4c10 0x7f970c0b7120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9718005e30 tx=0x7f9718005d80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.483+0000 7f972e644740 1 --2- 172.21.15.53:0/3477705681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884c1230 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9714009c70 tx=0x7f9714010740 comp rx=0 tx=0).stop 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.483+0000 7f972e644740 1 -- 172.21.15.53:0/3477705681 shutdown_connections 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.483+0000 7f972e644740 1 --2- 172.21.15.53:0/3477705681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884c1230 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.483+0000 7f972e644740 1 --2- 172.21.15.53:0/3477705681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880f20a0 0x55d2884c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.483+0000 7f972e644740 1 --2- 172.21.15.53:0/3477705681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d28811af60 0x55d2884c07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.483+0000 7f972e644740 1 -- 172.21.15.53:0/3477705681 >> 172.21.15.53:0/3477705681 conn(0x55d28810f350 msgr2=0x55d2884be6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.483+0000 7f972e644740 1 -- 172.21.15.53:0/3477705681 shutdown_connections 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.483+0000 7f972e644740 1 -- 172.21.15.53:0/3477705681 wait complete. 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972e644740 1 -- start start 2024-08-31T06:03:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972e644740 1 Processor -- start 2024-08-31T06:03:53.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972e644740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2880f20a0 0x55d2884cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972e644740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972e644740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d28811af60 0x55d2884dc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972e644740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d2882895f0 con 0x55d2880fa280 2024-08-31T06:03:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972e644740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d2883ad600 con 0x55d2880f20a0 2024-08-31T06:03:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972e644740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d2884d33a0 con 0x55d28811af60 2024-08-31T06:03:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972e644740 10 client.0 _ll_register_callbacks cb 0x55d2883d3af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:03:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972566a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972566a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38308/0 (socket says 172.21.15.53:38308) 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.484+0000 7f972566a640 1 -- 172.21.15.53:0/2271759633 learned_addr learned my addr 172.21.15.53:0/2271759633 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f972666c640 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d28811af60 0x55d2884dc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f9725e6b640 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2880f20a0 0x55d2884cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f972566a640 1 -- 172.21.15.53:0/2271759633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d28811af60 msgr2=0x55d2884dc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f972566a640 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d28811af60 0x55d2884dc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f972566a640 1 -- 172.21.15.53:0/2271759633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2880f20a0 msgr2=0x55d2884cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f972566a640 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2880f20a0 0x55d2884cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f972566a640 1 -- 172.21.15.53:0/2271759633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2883e67b0 con 0x55d2880fa280 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f972566a640 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884cc3b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9714011010 tx=0x7f97140099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a8f978a4854b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f97097fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f97097fa640 1 -- 172.21.15.53:0/2271759633 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97140035f0 con 0x55d2880fa280 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f972e644740 1 -- 172.21.15.53:0/2271759633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97140041c0 con 0x55d2880fa280 2024-08-31T06:03:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f97097fa640 1 -- 172.21.15.53:0/2271759633 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f9714003790 con 0x55d2880fa280 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f97097fa640 1 -- 172.21.15.53:0/2271759633 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9714003990 con 0x55d2880fa280 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f972e644740 10 client.15273 fetch_fsmap learned FSMap version 27 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.485+0000 7f972e644740 1 -- 172.21.15.53:0/2271759633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d2884df110 con 0x55d2880fa280 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.486+0000 7f97097fa640 1 -- 172.21.15.53:0/2271759633 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97140041c0 con 0x55d2880fa280 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.486+0000 7f97097fa640 1 -- 172.21.15.53:0/2271759633 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f971402d070 con 0x55d2880fa280 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.486+0000 7f972e644740 10 client.15273 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.486+0000 7f972e644740 10 client.15273 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.486+0000 7f972e644740 20 client.15273 populate_metadata read hostname 'smithi053' 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.486+0000 7f972e644740 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d2880d98e0 0x55d2884e2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.486+0000 7f972e644740 4 client.15273 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.486+0000 7f972e644740 1 -- 172.21.15.53:0/2271759633 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d288439340 con 0x55d2880d98e0 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.486+0000 7f9725e6b640 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d2880d98e0 0x55d2884e2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.487+0000 7f9725e6b640 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d2880d98e0 0x55d2884e2920 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70b080f9e506f21a server_cookie=52ef57d873275bf in_seq=0 out_seq=0 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.487+0000 7f97097fa640 10 client.15273 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.487+0000 7f97097fa640 1 -- 172.21.15.53:0/2271759633 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d288439340 con 0x55d2880d98e0 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f97097fa640 10 client.15273 handle_command_reply: tid=0 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 1 client.15273 shutdown 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 1 -- 172.21.15.53:0/2271759633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 msgr2=0x55d2884cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884cc3b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9714011010 tx=0x7f97140099e0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 1 -- 172.21.15.53:0/2271759633 shutdown_connections 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d2880d98e0 0x55d2884e2920 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d28811af60 0x55d2884dc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f97097fa640 0 client.15273 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880fa280 0x55d2884cc3b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 1 --2- 172.21.15.53:0/2271759633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2880f20a0 0x55d2884cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 1 -- 172.21.15.53:0/2271759633 >> 172.21.15.53:0/2271759633 conn(0x55d28810f350 msgr2=0x55d2884c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 1 -- 172.21.15.53:0/2271759633 shutdown_connections 2024-08-31T06:03:53.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 1 -- 172.21.15.53:0/2271759633 wait complete. 2024-08-31T06:03:53.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.488+0000 7f972e644740 20 client.15273 trim_cache size 0 max 16384 2024-08-31T06:03:53.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.506+0000 7f972e644740 1 Processor -- start 2024-08-31T06:03:53.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.506+0000 7f972e644740 1 -- start start 2024-08-31T06:03:53.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.506+0000 7f972e644740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2880f20a0 0x55d2884cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.506+0000 7f972e644740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880fa280 0x55d2884dc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.506+0000 7f972e644740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d28811af60 0x55d2884bdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.506+0000 7f972e644740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d2884e0c60 con 0x55d28811af60 2024-08-31T06:03:53.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.506+0000 7f972e644740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d2884e1330 con 0x55d2880f20a0 2024-08-31T06:03:53.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.506+0000 7f972e644740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d2884e1a00 con 0x55d2880fa280 2024-08-31T06:03:53.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.506+0000 7f972666c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d28811af60 0x55d2884bdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.506+0000 7f972666c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d28811af60 0x55d2884bdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38322/0 (socket says 172.21.15.53:38322) 2024-08-31T06:03:53.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.506+0000 7f972666c640 1 -- 172.21.15.53:0/1903920822 learned_addr learned my addr 172.21.15.53:0/1903920822 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:53.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f972566a640 1 --2- 172.21.15.53:0/1903920822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880fa280 0x55d2884dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f9725e6b640 1 --2- 172.21.15.53:0/1903920822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2880f20a0 0x55d2884cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f972666c640 1 -- 172.21.15.53:0/1903920822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880fa280 msgr2=0x55d2884dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:53.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f972666c640 1 --2- 172.21.15.53:0/1903920822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880fa280 0x55d2884dc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f972666c640 1 -- 172.21.15.53:0/1903920822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2880f20a0 msgr2=0x55d2884cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:53.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f972666c640 1 --2- 172.21.15.53:0/1903920822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2880f20a0 0x55d2884cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f972666c640 1 -- 172.21.15.53:0/1903920822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2884cd130 con 0x55d28811af60 2024-08-31T06:03:53.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f972566a640 1 --2- 172.21.15.53:0/1903920822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880fa280 0x55d2884dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:53.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f972666c640 1 --2- 172.21.15.53:0/1903920822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d28811af60 0x55d2884bdcf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9718035000 tx=0x7f9718041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c1809cbac0e0e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:53.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f970b7fe640 1 -- 172.21.15.53:0/1903920822 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718031b00 con 0x55d28811af60 2024-08-31T06:03:53.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f970b7fe640 1 -- 172.21.15.53:0/1903920822 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9718036040 con 0x55d28811af60 2024-08-31T06:03:53.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.507+0000 7f970b7fe640 1 -- 172.21.15.53:0/1903920822 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97180305c0 con 0x55d28811af60 2024-08-31T06:03:53.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.508+0000 7f972e644740 1 -- 172.21.15.53:0/1903920822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d28811af60 msgr2=0x55d2884bdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:53.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.508+0000 7f972e644740 1 --2- 172.21.15.53:0/1903920822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d28811af60 0x55d2884bdcf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9718035000 tx=0x7f9718041000 comp rx=0 tx=0).stop 2024-08-31T06:03:53.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.508+0000 7f972e644740 1 -- 172.21.15.53:0/1903920822 shutdown_connections 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.508+0000 7f972e644740 1 --2- 172.21.15.53:0/1903920822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d28811af60 0x55d2884bdcf0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.508+0000 7f972e644740 1 --2- 172.21.15.53:0/1903920822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880fa280 0x55d2884dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.508+0000 7f972e644740 1 --2- 172.21.15.53:0/1903920822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2880f20a0 0x55d2884cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.508+0000 7f972e644740 1 -- 172.21.15.53:0/1903920822 >> 172.21.15.53:0/1903920822 conn(0x55d28810f350 msgr2=0x55d2884cbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.508+0000 7f972e644740 1 -- 172.21.15.53:0/1903920822 shutdown_connections 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.508+0000 7f972e644740 1 -- 172.21.15.53:0/1903920822 wait complete. 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.508+0000 7f972e644740 1 -- start start 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.508+0000 7f972e644740 1 Processor -- start 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f972e644740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880f20a0 0x55d2884eb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f972e644740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880fa280 0x55d2884e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f972e644740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d28811af60 0x55d2884e5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f972e644740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d2884e27a0 con 0x55d2880f20a0 2024-08-31T06:03:53.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f972e644740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d2884e20d0 con 0x55d28811af60 2024-08-31T06:03:53.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f972e644740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d2884e2e70 con 0x55d2880fa280 2024-08-31T06:03:53.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f972e644740 10 client.0 _ll_register_callbacks cb 0x7f9714009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:03:53.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f9725e6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880f20a0 0x55d2884eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f9725e6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880f20a0 0x55d2884eb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38332/0 (socket says 172.21.15.53:38332) 2024-08-31T06:03:53.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f9725e6b640 1 -- 172.21.15.53:0/1256469672 learned_addr learned my addr 172.21.15.53:0/1256469672 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:53.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f972666c640 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d28811af60 0x55d2884e5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f972566a640 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880fa280 0x55d2884e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f9725e6b640 1 -- 172.21.15.53:0/1256469672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880fa280 msgr2=0x55d2884e4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:53.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f9725e6b640 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880fa280 0x55d2884e4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f9725e6b640 1 -- 172.21.15.53:0/1256469672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d28811af60 msgr2=0x55d2884e5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:03:53.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f9725e6b640 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d28811af60 0x55d2884e5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f9725e6b640 1 -- 172.21.15.53:0/1256469672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2884ea240 con 0x55d2880f20a0 2024-08-31T06:03:53.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f9725e6b640 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880f20a0 0x55d2884eb600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f971c0ab5f0 tx=0x7f971c0e87f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c507963dd61640de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:53.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.509+0000 7f97097fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:03:53.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f97097fa640 1 -- 172.21.15.53:0/1256469672 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c020040 con 0x55d2880f20a0 2024-08-31T06:03:53.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f97097fa640 1 -- 172.21.15.53:0/1256469672 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f971c0a7b80 con 0x55d2880f20a0 2024-08-31T06:03:53.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f972e644740 1 -- 172.21.15.53:0/1256469672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9718036040 con 0x55d2880f20a0 2024-08-31T06:03:53.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f97097fa640 1 -- 172.21.15.53:0/1256469672 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f971c0ab240 con 0x55d2880f20a0 2024-08-31T06:03:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f972e644740 10 client.15279 fetch_fsmap learned FSMap version 27 2024-08-31T06:03:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f972e644740 1 -- 172.21.15.53:0/1256469672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d28854dfb0 con 0x55d2880f20a0 2024-08-31T06:03:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f97097fa640 1 -- 172.21.15.53:0/1256469672 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9718036040 con 0x55d2880f20a0 2024-08-31T06:03:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f97097fa640 1 -- 172.21.15.53:0/1256469672 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f971c0a7260 con 0x55d2880f20a0 2024-08-31T06:03:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f972e644740 10 client.15279 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:03:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f972e644740 10 client.15279 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:03:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f972e644740 20 client.15279 populate_metadata read hostname 'smithi053' 2024-08-31T06:03:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f972e644740 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d2880aec90 0x55d288551850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f972e644740 4 client.15279 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:03:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.510+0000 7f972e644740 1 -- 172.21.15.53:0/1256469672 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "status"}) -- 0x55d288434de0 con 0x55d2880aec90 2024-08-31T06:03:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f972566a640 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d2880aec90 0x55d288551850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f972566a640 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d2880aec90 0x55d288551850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ed10c68e1f38c8 server_cookie=b2bb680a106bf56a in_seq=0 out_seq=0 2024-08-31T06:03:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f97097fa640 10 client.15279 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:03:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f97097fa640 1 -- 172.21.15.53:0/1256469672 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d288434de0 con 0x55d2880aec90 2024-08-31T06:03:53.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f97097fa640 10 client.15279 handle_command_reply: tid=0 2024-08-31T06:03:53.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f972e644740 1 client.15279 shutdown 2024-08-31T06:03:53.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f972e644740 1 -- 172.21.15.53:0/1256469672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880f20a0 msgr2=0x55d2884eb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:53.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f972e644740 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880f20a0 0x55d2884eb600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f971c0ab5f0 tx=0x7f971c0e87f0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f972e644740 1 -- 172.21.15.53:0/1256469672 shutdown_connections 2024-08-31T06:03:53.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f972e644740 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d2880aec90 0x55d288551850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f972e644740 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d28811af60 0x55d2884e5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f972e644740 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2880fa280 0x55d2884e4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f972e644740 1 --2- 172.21.15.53:0/1256469672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2880f20a0 0x55d2884eb600 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f97097fa640 0 client.15279 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:03:53.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.511+0000 7f972e644740 1 -- 172.21.15.53:0/1256469672 >> 172.21.15.53:0/1256469672 conn(0x55d28810f350 msgr2=0x55d2884ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:53.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f972e644740 1 -- 172.21.15.53:0/1256469672 shutdown_connections 2024-08-31T06:03:53.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f972e644740 1 -- 172.21.15.53:0/1256469672 wait complete. 2024-08-31T06:03:53.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f972e644740 20 client.15279 trim_cache size 0 max 16384 2024-08-31T06:03:53.525 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:03:53.525 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:03:53.525 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-08-31T06:03:53.525 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24668, 2024-08-31T06:03:53.525 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:03:53.525 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:03:53.525 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:03:53.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 81.91774187, 2024-08-31T06:03:53.525 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 27, 2024-08-31T06:03:53.526 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 72, 2024-08-31T06:03:53.526 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 70, 2024-08-31T06:03:53.526 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 92.996890105000006 2024-08-31T06:03:53.526 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:03:53.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 -- 172.21.15.53:0/3857909916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f970c0b4c10 msgr2=0x7f970c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f970c0b4c10 0x7f970c0b7120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9718005e30 tx=0x7f9718005d80 comp rx=0 tx=0).stop 2024-08-31T06:03:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 -- 172.21.15.53:0/3857909916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9720103900 msgr2=0x7f972019a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9720103900 0x7f972019a140 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f971c00d950 tx=0x7f971c00de10 comp rx=0 tx=0).stop 2024-08-31T06:03:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 -- 172.21.15.53:0/3857909916 shutdown_connections 2024-08-31T06:03:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f970c0b4c10 0x7f970c0b7120 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9720109b90 0x7f972019f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9720109240 0x7f972019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 --2- 172.21.15.53:0/3857909916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9720103900 0x7f972019a140 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 -- 172.21.15.53:0/3857909916 >> 172.21.15.53:0/3857909916 conn(0x7f972007b5f0 msgr2=0x7f97201072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 -- 172.21.15.53:0/3857909916 shutdown_connections 2024-08-31T06:03:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:53.512+0000 7f97280cf640 1 -- 172.21.15.53:0/3857909916 wait complete. 2024-08-31T06:03:54.190 INFO:tasks.cephadm:Setup complete, yielding 2024-08-31T06:03:54.191 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T06:03:54.438 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi053.front.sepia.ceph.com 2024-08-31T06:03:54.438 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch status' 2024-08-31T06:03:54.465 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:54 smithi053 ceph-mon[18924]: pgmap v289: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:54.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:54 smithi130 ceph-mon[22266]: pgmap v289: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:54.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:54 smithi153 ceph-mon[22320]: pgmap v289: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:54.705 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:55.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.142+0000 7fb3a342a640 1 -- 172.21.15.53:0/277348077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39c103900 msgr2=0x7fb39c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:55.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.142+0000 7fb3a342a640 1 --2- 172.21.15.53:0/277348077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39c103900 0x7fb39c103d10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb398009900 tx=0x7fb39802a410 comp rx=0 tx=0).stop 2024-08-31T06:03:55.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.142+0000 7fb3a342a640 1 -- 172.21.15.53:0/277348077 shutdown_connections 2024-08-31T06:03:55.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.142+0000 7fb3a342a640 1 --2- 172.21.15.53:0/277348077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb39c109b90 0x7fb39c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:55.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.142+0000 7fb3a342a640 1 --2- 172.21.15.53:0/277348077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb39c109240 0x7fb39c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:55.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.142+0000 7fb3a342a640 1 --2- 172.21.15.53:0/277348077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39c103900 0x7fb39c103d10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:55.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.142+0000 7fb3a342a640 1 -- 172.21.15.53:0/277348077 >> 172.21.15.53:0/277348077 conn(0x7fb39c07b5f0 msgr2=0x7fb39c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:55.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.142+0000 7fb3a342a640 1 -- 172.21.15.53:0/277348077 shutdown_connections 2024-08-31T06:03:55.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.142+0000 7fb3a342a640 1 -- 172.21.15.53:0/277348077 wait complete. 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.143+0000 7fb3a342a640 1 Processor -- start 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.143+0000 7fb3a342a640 1 -- start start 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.143+0000 7fb3a342a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb39c103900 0x7fb39c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.143+0000 7fb3a342a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb39c109240 0x7fb39c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.143+0000 7fb3a342a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39c109b90 0x7fb39c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.143+0000 7fb3a342a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c113700 con 0x7fb39c109b90 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.143+0000 7fb3a342a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c113580 con 0x7fb39c103900 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.143+0000 7fb3a342a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c113880 con 0x7fb39c109240 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a19c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39c109b90 0x7fb39c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a19c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39c109b90 0x7fb39c075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38344/0 (socket says 172.21.15.53:38344) 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a19c7640 1 -- 172.21.15.53:0/1128942181 learned_addr learned my addr 172.21.15.53:0/1128942181 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:55.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a11c6640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb39c103900 0x7fb39c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a09c5640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb39c109240 0x7fb39c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a19c7640 1 -- 172.21.15.53:0/1128942181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb39c109240 msgr2=0x7fb39c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a19c7640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb39c109240 0x7fb39c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a19c7640 1 -- 172.21.15.53:0/1128942181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb39c103900 msgr2=0x7fb39c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a19c7640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb39c103900 0x7fb39c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a19c7640 1 -- 172.21.15.53:0/1128942181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c1a8490 con 0x7fb39c109b90 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a19c7640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39c109b90 0x7fb39c075f30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb39400eaa0 tx=0x7fb39400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3927fc640 1 -- 172.21.15.53:0/1128942181 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39400cdb0 con 0x7fb39c109b90 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3a342a640 1 -- 172.21.15.53:0/1128942181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb39c1a8780 con 0x7fb39c109b90 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.144+0000 7fb3927fc640 1 -- 172.21.15.53:0/1128942181 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb394005020 con 0x7fb39c109b90 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.145+0000 7fb3927fc640 1 -- 172.21.15.53:0/1128942181 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3940116d0 con 0x7fb39c109b90 2024-08-31T06:03:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.145+0000 7fb3a342a640 1 -- 172.21.15.53:0/1128942181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb39c1a8c70 con 0x7fb39c109b90 2024-08-31T06:03:55.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.146+0000 7fb3a342a640 1 -- 172.21.15.53:0/1128942181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb39c103d10 con 0x7fb39c109b90 2024-08-31T06:03:55.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.147+0000 7fb3927fc640 1 -- 172.21.15.53:0/1128942181 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fb3940051d0 con 0x7fb39c109b90 2024-08-31T06:03:55.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.148+0000 7fb3927fc640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3880b4c10 0x7fb3880b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:55.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.148+0000 7fb3a11c6640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3880b4c10 0x7fb3880b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:55.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.148+0000 7fb3927fc640 1 -- 172.21.15.53:0/1128942181 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fb3940e58e0 con 0x7fb39c109b90 2024-08-31T06:03:55.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.148+0000 7fb3a11c6640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3880b4c10 0x7fb3880b7120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb39c076f00 tx=0x7fb3980058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:55.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.151+0000 7fb3927fc640 1 -- 172.21.15.53:0/1128942181 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb394016030 con 0x7fb39c109b90 2024-08-31T06:03:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.354+0000 7fb3a342a640 1 -- 172.21.15.53:0/1128942181 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fb39c0635a0 con 0x7fb3880b4c10 2024-08-31T06:03:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.356+0000 7fb3927fc640 1 -- 172.21.15.53:0/1128942181 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fb39c0635a0 con 0x7fb3880b4c10 2024-08-31T06:03:55.358 INFO:teuthology.orchestra.run.smithi053.stdout:Backend: cephadm 2024-08-31T06:03:55.359 INFO:teuthology.orchestra.run.smithi053.stdout:Available: Yes 2024-08-31T06:03:55.359 INFO:teuthology.orchestra.run.smithi053.stdout:Paused: No 2024-08-31T06:03:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 -- 172.21.15.53:0/1128942181 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3880b4c10 msgr2=0x7fb3880b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3880b4c10 0x7fb3880b7120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb39c076f00 tx=0x7fb3980058d0 comp rx=0 tx=0).stop 2024-08-31T06:03:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 -- 172.21.15.53:0/1128942181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39c109b90 msgr2=0x7fb39c075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39c109b90 0x7fb39c075f30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb39400eaa0 tx=0x7fb39400ef60 comp rx=0 tx=0).stop 2024-08-31T06:03:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 -- 172.21.15.53:0/1128942181 shutdown_connections 2024-08-31T06:03:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3880b4c10 0x7fb3880b7120 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39c109b90 0x7fb39c075f30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb39c109240 0x7fb39c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 --2- 172.21.15.53:0/1128942181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb39c103900 0x7fb39c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 -- 172.21.15.53:0/1128942181 >> 172.21.15.53:0/1128942181 conn(0x7fb39c07b5f0 msgr2=0x7fb39c1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 -- 172.21.15.53:0/1128942181 shutdown_connections 2024-08-31T06:03:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:55.358+0000 7fb3a342a640 1 -- 172.21.15.53:0/1128942181 wait complete. 2024-08-31T06:03:56.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-31T06:03:56.302 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:56.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:56 smithi053 ceph-mon[18924]: pgmap v290: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:56 smithi130 ceph-mon[22266]: pgmap v290: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:56.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:56 smithi153 ceph-mon[22320]: pgmap v290: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:03:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.775+0000 7f384f265640 1 -- 172.21.15.53:0/3310136721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3848109b90 msgr2=0x7f38481103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.775+0000 7f384f265640 1 --2- 172.21.15.53:0/3310136721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3848109b90 0x7f38481103c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3840009ca0 tx=0x7f384002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.775+0000 7f384f265640 1 -- 172.21.15.53:0/3310136721 shutdown_connections 2024-08-31T06:03:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.775+0000 7f384f265640 1 --2- 172.21.15.53:0/3310136721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3848109b90 0x7f38481103c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.775+0000 7f384f265640 1 --2- 172.21.15.53:0/3310136721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848109240 0x7f3848109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.775+0000 7f384f265640 1 --2- 172.21.15.53:0/3310136721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3848103900 0x7f3848103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.775+0000 7f384f265640 1 -- 172.21.15.53:0/3310136721 >> 172.21.15.53:0/3310136721 conn(0x7f384807b5f0 msgr2=0x7f384807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.775+0000 7f384f265640 1 -- 172.21.15.53:0/3310136721 shutdown_connections 2024-08-31T06:03:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.775+0000 7f384f265640 1 -- 172.21.15.53:0/3310136721 wait complete. 2024-08-31T06:03:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.775+0000 7f384f265640 1 Processor -- start 2024-08-31T06:03:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.775+0000 7f384f265640 1 -- start start 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384f265640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3848103900 0x7f384819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384f265640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3848109240 0x7f384819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384f265640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848109b90 0x7f384819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384f265640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3848113750 con 0x7f3848109240 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384f265640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38481135d0 con 0x7f3848103900 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384f265640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38481138d0 con 0x7f3848109b90 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384c800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3848109240 0x7f384819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384c800640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3848109240 0x7f384819a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38356/0 (socket says 172.21.15.53:38356) 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384c800640 1 -- 172.21.15.53:0/53177260 learned_addr learned my addr 172.21.15.53:0/53177260 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384d001640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3848103900 0x7f384819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384d802640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848109b90 0x7f384819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384c800640 1 -- 172.21.15.53:0/53177260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848109b90 msgr2=0x7f384819faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384c800640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848109b90 0x7f384819faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384c800640 1 -- 172.21.15.53:0/53177260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3848103900 msgr2=0x7f384819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384c800640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3848103900 0x7f384819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384c800640 1 -- 172.21.15.53:0/53177260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38481a01d0 con 0x7f3848109240 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384d802640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848109b90 0x7f384819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.776+0000 7f384c800640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3848109240 0x7f384819a800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f383800e9c0 tx=0x7f383800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.777+0000 7f383e7fc640 1 -- 172.21.15.53:0/53177260 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383800ccc0 con 0x7f3848109240 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.777+0000 7f384f265640 1 -- 172.21.15.53:0/53177260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38481a04c0 con 0x7f3848109240 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.777+0000 7f383e7fc640 1 -- 172.21.15.53:0/53177260 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38380054b0 con 0x7f3848109240 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.777+0000 7f383e7fc640 1 -- 172.21.15.53:0/53177260 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838010430 con 0x7f3848109240 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.777+0000 7f384f265640 1 -- 172.21.15.53:0/53177260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38481a6c20 con 0x7f3848109240 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.778+0000 7f384f265640 1 -- 172.21.15.53:0/53177260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3848103d10 con 0x7f3848109240 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.779+0000 7f383e7fc640 1 -- 172.21.15.53:0/53177260 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f3838004f00 con 0x7f3848109240 2024-08-31T06:03:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.780+0000 7f383e7fc640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38340b4c10 0x7f38340b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:56.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.780+0000 7f384d001640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38340b4c10 0x7f38340b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:56.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.780+0000 7f383e7fc640 1 -- 172.21.15.53:0/53177260 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f38380e5970 con 0x7f3848109240 2024-08-31T06:03:56.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.780+0000 7f384d001640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38340b4c10 0x7f38340b7120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3844005d00 tx=0x7f384400b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:56.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.783+0000 7f383e7fc640 1 -- 172.21.15.53:0/53177260 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3838056130 con 0x7f3848109240 2024-08-31T06:03:56.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.978+0000 7f384f265640 1 -- 172.21.15.53:0/53177260 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f38480635a0 con 0x7f38340b4c10 2024-08-31T06:03:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.990+0000 7f383e7fc640 1 -- 172.21.15.53:0/53177260 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f38480635a0 con 0x7f38340b4c10 2024-08-31T06:03:56.993 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.a smithi053 running (99s) 20s ago 98s 84.8M - 19.3.0-4560-gd19e6118 79f4cde5e369 a5e77ff2626b 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.b smithi130 running (96s) 30s ago 96s 93.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 a9e57cff43b6 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.c smithi153 running (111s) 30s ago 110s 84.8M - 19.3.0-4560-gd19e6118 79f4cde5e369 0ab220a68f51 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.d smithi053 running (118s) 20s ago 117s 81.7M - 19.3.0-4560-gd19e6118 79f4cde5e369 5cde249fd20d 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.e smithi130 running (115s) 30s ago 115s 87.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 db2c1bd3c1b7 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.f smithi153 running (113s) 30s ago 113s 85.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 2f3551e89d68 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.g smithi053 running (102s) 20s ago 102s 85.0M - 19.3.0-4560-gd19e6118 79f4cde5e369 139dbbde6324 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.h smithi130 running (108s) 30s ago 108s 85.4M - 19.3.0-4560-gd19e6118 79f4cde5e369 ccd3bda24467 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.i smithi153 running (106s) 30s ago 105s 85.3M - 19.3.0-4560-gd19e6118 79f4cde5e369 e4de4d4a385a 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.j smithi053 running (2m) 20s ago 2m 82.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 2c78564a4a1b 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.k smithi130 running (2m) 30s ago 2m 83.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 57d40490a116 2024-08-31T06:03:56.994 INFO:teuthology.orchestra.run.smithi053.stdout:mds.l smithi153 running (2m) 30s ago 2m 83.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 223cfc7e0ce9 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.x smithi053 *:9283,8765 running (9m) 20s ago 9m 584M - 19.3.0-4560-gd19e6118 79f4cde5e369 c16941624955 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.y smithi130 *:8443,8765 running (7m) 30s ago 7m 523M - 19.3.0-4560-gd19e6118 79f4cde5e369 ce9573d8edcf 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.z smithi153 *:8443,8765 running (7m) 30s ago 7m 522M - 19.3.0-4560-gd19e6118 79f4cde5e369 dffe16586557 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:mon.a smithi053 running (9m) 20s ago 9m 119M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 f269de74543e 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:mon.b smithi130 running (7m) 30s ago 7m 110M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 5efdc58039f1 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:mon.c smithi153 running (8m) 30s ago 8m 109M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 edfdf3191eb4 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (6m) 20s ago 6m 123M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 fc6d5c8545b3 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi130 running (6m) 30s ago 6m 125M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 f6f8f229950d 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi153 running (6m) 30s ago 6m 115M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 40e0b971e195 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi053 running (5m) 20s ago 5m 117M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 7a4ef25bf89d 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi130 running (5m) 30s ago 5m 120M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 e1c6938abb2b 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi153 running (4m) 30s ago 4m 114M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 007590d747e6 2024-08-31T06:03:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6 smithi053 running (4m) 20s ago 4m 113M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 149d5d3bf15d 2024-08-31T06:03:56.996 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7 smithi130 running (4m) 30s ago 4m 114M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 89563586b33f 2024-08-31T06:03:56.996 INFO:teuthology.orchestra.run.smithi053.stdout:osd.8 smithi153 running (3m) 30s ago 3m 120M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 32a4c7b8758f 2024-08-31T06:03:56.996 INFO:teuthology.orchestra.run.smithi053.stdout:osd.9 smithi053 running (3m) 20s ago 3m 116M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 7a8533ea5390 2024-08-31T06:03:56.996 INFO:teuthology.orchestra.run.smithi053.stdout:osd.10 smithi130 running (2m) 30s ago 2m 121M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 d42edbd51a93 2024-08-31T06:03:56.996 INFO:teuthology.orchestra.run.smithi053.stdout:osd.11 smithi153 running (2m) 30s ago 2m 110M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 12fd1b4f6f21 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 -- 172.21.15.53:0/53177260 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38340b4c10 msgr2=0x7f38340b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38340b4c10 0x7f38340b7120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3844005d00 tx=0x7f384400b410 comp rx=0 tx=0).stop 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 -- 172.21.15.53:0/53177260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3848109240 msgr2=0x7f384819a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3848109240 0x7f384819a800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f383800e9c0 tx=0x7f383800ee80 comp rx=0 tx=0).stop 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 -- 172.21.15.53:0/53177260 shutdown_connections 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38340b4c10 0x7f38340b7120 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848109b90 0x7f384819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3848109240 0x7f384819a800 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 --2- 172.21.15.53:0/53177260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3848103900 0x7f384819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 -- 172.21.15.53:0/53177260 >> 172.21.15.53:0/53177260 conn(0x7f384807b5f0 msgr2=0x7f3848107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 -- 172.21.15.53:0/53177260 shutdown_connections 2024-08-31T06:03:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:56.992+0000 7f384f265640 1 -- 172.21.15.53:0/53177260 wait complete. 2024-08-31T06:03:57.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:57 smithi053 ceph-mon[18924]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:57.619 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-31T06:03:57.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:57 smithi130 ceph-mon[22266]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:57.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:57 smithi153 ceph-mon[22320]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:57.871 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:58.327 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:58 smithi053 ceph-mon[18924]: pgmap v291: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:58.328 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:03:58 smithi053 ceph-mon[18924]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:58.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.325+0000 7f24e9b63640 1 -- 172.21.15.53:0/347631418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e4108b40 msgr2=0x7f24e410f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:58.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.325+0000 7f24e9b63640 1 --2- 172.21.15.53:0/347631418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e4108b40 0x7f24e410f370 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f24dc009ca0 tx=0x7f24dc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:58.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.325+0000 7f24e9b63640 1 -- 172.21.15.53:0/347631418 shutdown_connections 2024-08-31T06:03:58.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.325+0000 7f24e9b63640 1 --2- 172.21.15.53:0/347631418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e4108b40 0x7f24e410f370 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:58.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.325+0000 7f24e9b63640 1 --2- 172.21.15.53:0/347631418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e41081f0 0x7f24e4108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:58.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.325+0000 7f24e9b63640 1 --2- 172.21.15.53:0/347631418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24e41028b0 0x7f24e4102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:58.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.325+0000 7f24e9b63640 1 -- 172.21.15.53:0/347631418 >> 172.21.15.53:0/347631418 conn(0x7f24e4079470 msgr2=0x7f24e4079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:58.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.325+0000 7f24e9b63640 1 -- 172.21.15.53:0/347631418 shutdown_connections 2024-08-31T06:03:58.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.325+0000 7f24e9b63640 1 -- 172.21.15.53:0/347631418 wait complete. 2024-08-31T06:03:58.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.325+0000 7f24e9b63640 1 Processor -- start 2024-08-31T06:03:58.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.325+0000 7f24e9b63640 1 -- start start 2024-08-31T06:03:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24e9b63640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24e41028b0 0x7f24e419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24e9b63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e41081f0 0x7f24e419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24e9b63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e4108b40 0x7f24e419f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24e9b63640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f24e41126f0 con 0x7f24e41081f0 2024-08-31T06:03:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24e9b63640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24e4112570 con 0x7f24e4108b40 2024-08-31T06:03:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24e9b63640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f24e4112870 con 0x7f24e41028b0 2024-08-31T06:03:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24daffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e41081f0 0x7f24e419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24daffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e41081f0 0x7f24e419a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38378/0 (socket says 172.21.15.53:38378) 2024-08-31T06:03:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24daffd640 1 -- 172.21.15.53:0/577515147 learned_addr learned my addr 172.21.15.53:0/577515147 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24e37fe640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24e41028b0 0x7f24e419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24e3fff640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e4108b40 0x7f24e419f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24daffd640 1 -- 172.21.15.53:0/577515147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24e41028b0 msgr2=0x7f24e419a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24daffd640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24e41028b0 0x7f24e419a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24daffd640 1 -- 172.21.15.53:0/577515147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e4108b40 msgr2=0x7f24e419f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.326+0000 7f24daffd640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e4108b40 0x7f24e419f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.327+0000 7f24daffd640 1 -- 172.21.15.53:0/577515147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e41a0040 con 0x7f24e41081f0 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.327+0000 7f24daffd640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e41081f0 0x7f24e419a730 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f24cc00d950 tx=0x7f24cc00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.327+0000 7f24e17fa640 1 -- 172.21.15.53:0/577515147 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc017070 con 0x7f24e41081f0 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.327+0000 7f24e9b63640 1 -- 172.21.15.53:0/577515147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e41a0330 con 0x7f24e41081f0 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.327+0000 7f24e17fa640 1 -- 172.21.15.53:0/577515147 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24cc009c30 con 0x7f24e41081f0 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.327+0000 7f24e17fa640 1 -- 172.21.15.53:0/577515147 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0055c0 con 0x7f24e41081f0 2024-08-31T06:03:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.327+0000 7f24e9b63640 1 -- 172.21.15.53:0/577515147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e41a6b50 con 0x7f24e41081f0 2024-08-31T06:03:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.328+0000 7f24e9b63640 1 -- 172.21.15.53:0/577515147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e4102cc0 con 0x7f24e41081f0 2024-08-31T06:03:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.330+0000 7f24e17fa640 1 -- 172.21.15.53:0/577515147 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f24cc004020 con 0x7f24e41081f0 2024-08-31T06:03:58.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.331+0000 7f24e17fa640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24d00b4cc0 0x7f24d00b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:58.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.331+0000 7f24e37fe640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24d00b4cc0 0x7f24d00b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:58.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.331+0000 7f24e17fa640 1 -- 172.21.15.53:0/577515147 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f24cc0e5420 con 0x7f24e41081f0 2024-08-31T06:03:58.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.331+0000 7f24e37fe640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24d00b4cc0 0x7f24d00b71d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f24d400abe0 tx=0x7f24d400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.333+0000 7f24e17fa640 1 -- 172.21.15.53:0/577515147 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f24cc020020 con 0x7f24e41081f0 2024-08-31T06:03:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.528+0000 7f24e9b63640 1 -- 172.21.15.53:0/577515147 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f24e40635a0 con 0x7f24d00b4cc0 2024-08-31T06:03:58.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.534+0000 7f24e17fa640 1 -- 172.21.15.53:0/577515147 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f24e40635a0 con 0x7f24d00b4cc0 2024-08-31T06:03:58.537 INFO:teuthology.orchestra.run.smithi053.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-31T06:03:58.537 INFO:teuthology.orchestra.run.smithi053.stdout:mds.all 12/12 31s ago 2m smithi053=a;smithi053=d;smithi053=g;smithi053=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-08-31T06:03:58.537 INFO:teuthology.orchestra.run.smithi053.stdout:mgr 3/3 31s ago 7m smithi053=x;smithi130=y;smithi153=z;count:3 2024-08-31T06:03:58.537 INFO:teuthology.orchestra.run.smithi053.stdout:mon 3/3 31s ago 8m smithi053:172.21.15.53=a;smithi130:172.21.15.130=b;smithi153:172.21.15.153=c;count:3 2024-08-31T06:03:58.538 INFO:teuthology.orchestra.run.smithi053.stdout:osd 12 31s ago - 2024-08-31T06:03:58.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.536+0000 7f24e9b63640 1 -- 172.21.15.53:0/577515147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24d00b4cc0 msgr2=0x7f24d00b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:58.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.536+0000 7f24e9b63640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24d00b4cc0 0x7f24d00b71d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f24d400abe0 tx=0x7f24d400a2d0 comp rx=0 tx=0).stop 2024-08-31T06:03:58.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.537+0000 7f24e9b63640 1 -- 172.21.15.53:0/577515147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e41081f0 msgr2=0x7f24e419a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:58.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.537+0000 7f24e9b63640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e41081f0 0x7f24e419a730 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f24cc00d950 tx=0x7f24cc00dd50 comp rx=0 tx=0).stop 2024-08-31T06:03:58.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.537+0000 7f24e9b63640 1 -- 172.21.15.53:0/577515147 shutdown_connections 2024-08-31T06:03:58.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.537+0000 7f24e9b63640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24d00b4cc0 0x7f24d00b71d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:58.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.537+0000 7f24e9b63640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e4108b40 0x7f24e419f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:58.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.537+0000 7f24e9b63640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24e41081f0 0x7f24e419a730 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:58.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.537+0000 7f24e9b63640 1 --2- 172.21.15.53:0/577515147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24e41028b0 0x7f24e419a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:58.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.537+0000 7f24e9b63640 1 -- 172.21.15.53:0/577515147 >> 172.21.15.53:0/577515147 conn(0x7f24e4079470 msgr2=0x7f24e4101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:58.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.537+0000 7f24e9b63640 1 -- 172.21.15.53:0/577515147 shutdown_connections 2024-08-31T06:03:58.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:58.537+0000 7f24e9b63640 1 -- 172.21.15.53:0/577515147 wait complete. 2024-08-31T06:03:58.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:58 smithi130 ceph-mon[22266]: pgmap v291: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:58.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:03:58 smithi130 ceph-mon[22266]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:58.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:58 smithi153 ceph-mon[22320]: pgmap v291: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:03:58.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:03:58 smithi153 ceph-mon[22320]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:59.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-31T06:03:59.385 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:03:59.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.832+0000 7f0717967640 1 -- 172.21.15.53:0/303392779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0710108ab0 msgr2=0x7f071010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.832+0000 7f0717967640 1 --2- 172.21.15.53:0/303392779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0710108ab0 0x7f071010f2e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0708009ca0 tx=0x7f070802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.832+0000 7f0717967640 1 -- 172.21.15.53:0/303392779 shutdown_connections 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.832+0000 7f0717967640 1 --2- 172.21.15.53:0/303392779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0710108ab0 0x7f071010f2e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.832+0000 7f0717967640 1 --2- 172.21.15.53:0/303392779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0710108160 0x7f0710108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.832+0000 7f0717967640 1 --2- 172.21.15.53:0/303392779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0710102820 0x7f0710102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.832+0000 7f0717967640 1 -- 172.21.15.53:0/303392779 >> 172.21.15.53:0/303392779 conn(0x7f07100794e0 msgr2=0x7f07100798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.832+0000 7f0717967640 1 -- 172.21.15.53:0/303392779 shutdown_connections 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.832+0000 7f0717967640 1 -- 172.21.15.53:0/303392779 wait complete. 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.833+0000 7f0717967640 1 Processor -- start 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.833+0000 7f0717967640 1 -- start start 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.833+0000 7f0717967640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0710102820 0x7f0710104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:59.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.833+0000 7f0717967640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0710108160 0x7f07101053e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.833+0000 7f0717967640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0710108ab0 0x7f0710105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.833+0000 7f0717967640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0710112690 con 0x7f0710102820 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.833+0000 7f0717967640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0710112510 con 0x7f0710108ab0 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.833+0000 7f0717967640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0710112810 con 0x7f0710108160 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.833+0000 7f0715703640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0710102820 0x7f0710104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.833+0000 7f0715703640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0710102820 0x7f0710104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38394/0 (socket says 172.21.15.53:38394) 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.833+0000 7f0715703640 1 -- 172.21.15.53:0/3661614945 learned_addr learned my addr 172.21.15.53:0/3661614945 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0714f02640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0710108160 0x7f07101053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0715f04640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0710108ab0 0x7f0710105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0715703640 1 -- 172.21.15.53:0/3661614945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0710108160 msgr2=0x7f07101053e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0715703640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0710108160 0x7f07101053e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:59.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0715703640 1 -- 172.21.15.53:0/3661614945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0710108ab0 msgr2=0x7f0710105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0715703640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0710108ab0 0x7f0710105920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0715703640 1 -- 172.21.15.53:0/3661614945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07101a8440 con 0x7f0710102820 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0714f02640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0710108160 0x7f07101053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0715f04640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0710108ab0 0x7f0710105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0715703640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0710102820 0x7f0710104ea0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f070c00b4a0 tx=0x7f070c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f07067fc640 1 -- 172.21.15.53:0/3661614945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c014070 con 0x7f0710102820 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f07067fc640 1 -- 172.21.15.53:0/3661614945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f070c010aa0 con 0x7f0710102820 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0717967640 1 -- 172.21.15.53:0/3661614945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07101a8730 con 0x7f0710102820 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f07067fc640 1 -- 172.21.15.53:0/3661614945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c017b70 con 0x7f0710102820 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.834+0000 7f0717967640 1 -- 172.21.15.53:0/3661614945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07101a8cc0 con 0x7f0710102820 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.835+0000 7f0717967640 1 -- 172.21.15.53:0/3661614945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0710103aa0 con 0x7f0710102820 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.837+0000 7f07067fc640 1 -- 172.21.15.53:0/3661614945 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f070c017070 con 0x7f0710102820 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.837+0000 7f07067fc640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f06fc0b4c90 0x7f06fc0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:03:59.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.838+0000 7f0714f02640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f06fc0b4c90 0x7f06fc0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:03:59.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.838+0000 7f07067fc640 1 -- 172.21.15.53:0/3661614945 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f070c0e4a60 con 0x7f0710102820 2024-08-31T06:03:59.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.838+0000 7f0714f02640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f06fc0b4c90 0x7f06fc0b71a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0710079f80 tx=0x7f0700005ec0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:03:59.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:03:59.840+0000 7f07067fc640 1 -- 172.21.15.53:0/3661614945 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f070c0ab930 con 0x7f0710102820 2024-08-31T06:04:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.030+0000 7f0717967640 1 -- 172.21.15.53:0/3661614945 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f07100635a0 con 0x7f06fc0b4c90 2024-08-31T06:04:00.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.032+0000 7f07067fc640 1 -- 172.21.15.53:0/3661614945 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f07100635a0 con 0x7f06fc0b4c90 2024-08-31T06:04:00.035 INFO:teuthology.orchestra.run.smithi053.stdout:HOST ADDR LABELS STATUS 2024-08-31T06:04:00.035 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053 172.21.15.53 2024-08-31T06:04:00.035 INFO:teuthology.orchestra.run.smithi053.stdout:smithi130 172.21.15.130 2024-08-31T06:04:00.035 INFO:teuthology.orchestra.run.smithi053.stdout:smithi153 172.21.15.153 2024-08-31T06:04:00.035 INFO:teuthology.orchestra.run.smithi053.stdout:3 hosts in cluster 2024-08-31T06:04:00.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 -- 172.21.15.53:0/3661614945 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f06fc0b4c90 msgr2=0x7f06fc0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f06fc0b4c90 0x7f06fc0b71a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0710079f80 tx=0x7f0700005ec0 comp rx=0 tx=0).stop 2024-08-31T06:04:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 -- 172.21.15.53:0/3661614945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0710102820 msgr2=0x7f0710104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0710102820 0x7f0710104ea0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f070c00b4a0 tx=0x7f070c00b960 comp rx=0 tx=0).stop 2024-08-31T06:04:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 -- 172.21.15.53:0/3661614945 shutdown_connections 2024-08-31T06:04:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f06fc0b4c90 0x7f06fc0b71a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0710108ab0 0x7f0710105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0710108160 0x7f07101053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 --2- 172.21.15.53:0/3661614945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0710102820 0x7f0710104ea0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 -- 172.21.15.53:0/3661614945 >> 172.21.15.53:0/3661614945 conn(0x7f07100794e0 msgr2=0x7f071006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 -- 172.21.15.53:0/3661614945 shutdown_connections 2024-08-31T06:04:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:00.034+0000 7f0717967640 1 -- 172.21.15.53:0/3661614945 wait complete. 2024-08-31T06:04:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:00 smithi053 ceph-mon[18924]: pgmap v292: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:00 smithi053 ceph-mon[18924]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:00.477 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:00 smithi153 ceph-mon[22320]: pgmap v292: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:00.477 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:00 smithi153 ceph-mon[22320]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:00.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:00 smithi130 ceph-mon[22266]: pgmap v292: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:00.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:00 smithi130 ceph-mon[22266]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:00.688 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-31T06:04:00.943 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:01.334 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:01 smithi053 ceph-mon[18924]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:01.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.425+0000 7f33ed457640 1 -- 172.21.15.53:0/204943062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33e8109be0 msgr2=0x7f33e8110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:01.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.425+0000 7f33ed457640 1 --2- 172.21.15.53:0/204943062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33e8109be0 0x7f33e8110410 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009ca0 tx=0x7f33e002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:04:01.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.425+0000 7f33ed457640 1 -- 172.21.15.53:0/204943062 shutdown_connections 2024-08-31T06:04:01.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.425+0000 7f33ed457640 1 --2- 172.21.15.53:0/204943062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33e8109be0 0x7f33e8110410 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:01.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.425+0000 7f33ed457640 1 --2- 172.21.15.53:0/204943062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33e8109290 0x7f33e81096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:01.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.425+0000 7f33ed457640 1 --2- 172.21.15.53:0/204943062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33e8103950 0x7f33e8103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:01.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.425+0000 7f33ed457640 1 -- 172.21.15.53:0/204943062 >> 172.21.15.53:0/204943062 conn(0x7f33e80ff3a0 msgr2=0x7f33e81017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.425+0000 7f33ed457640 1 -- 172.21.15.53:0/204943062 shutdown_connections 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.425+0000 7f33ed457640 1 -- 172.21.15.53:0/204943062 wait complete. 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.425+0000 7f33ed457640 1 Processor -- start 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.425+0000 7f33ed457640 1 -- start start 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33ed457640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33e8103950 0x7f33e819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33ed457640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33e8109290 0x7f33e819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33ed457640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33e8109be0 0x7f33e819f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33ed457640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f33e81137a0 con 0x7f33e8103950 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33ed457640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8113620 con 0x7f33e8109be0 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33ed457640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8113920 con 0x7f33e8109290 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33e8103950 0x7f33e819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33e8103950 0x7f33e819a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38402/0 (socket says 172.21.15.53:38402) 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e6ffd640 1 -- 172.21.15.53:0/1371257110 learned_addr learned my addr 172.21.15.53:0/1371257110 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33dffff640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33e8109290 0x7f33e819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e77fe640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33e8109be0 0x7f33e819f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e6ffd640 1 -- 172.21.15.53:0/1371257110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33e8109290 msgr2=0x7f33e819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e6ffd640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33e8109290 0x7f33e819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e6ffd640 1 -- 172.21.15.53:0/1371257110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33e8109be0 msgr2=0x7f33e819f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e6ffd640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33e8109be0 0x7f33e819f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e6ffd640 1 -- 172.21.15.53:0/1371257110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e819ffc0 con 0x7f33e8103950 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e6ffd640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33e8103950 0x7f33e819a110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f33d800c920 tx=0x7f33d800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e4ff9640 1 -- 172.21.15.53:0/1371257110 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8007c70 con 0x7f33e8103950 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e4ff9640 1 -- 172.21.15.53:0/1371257110 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33d8007e10 con 0x7f33e8103950 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33ed457640 1 -- 172.21.15.53:0/1371257110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e81a02b0 con 0x7f33e8103950 2024-08-31T06:04:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33e4ff9640 1 -- 172.21.15.53:0/1371257110 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8018710 con 0x7f33e8103950 2024-08-31T06:04:01.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.426+0000 7f33ed457640 1 -- 172.21.15.53:0/1371257110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e81a6ad0 con 0x7f33e8103950 2024-08-31T06:04:01.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.427+0000 7f33ed457640 1 -- 172.21.15.53:0/1371257110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e8103d60 con 0x7f33e8103950 2024-08-31T06:04:01.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.429+0000 7f33e4ff9640 1 -- 172.21.15.53:0/1371257110 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f33d800f450 con 0x7f33e8103950 2024-08-31T06:04:01.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.430+0000 7f33e4ff9640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33d40b4c40 0x7f33d40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:01.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.430+0000 7f33dffff640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33d40b4c40 0x7f33d40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:01.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.430+0000 7f33e4ff9640 1 -- 172.21.15.53:0/1371257110 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f33d80e5980 con 0x7f33e8103950 2024-08-31T06:04:01.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.430+0000 7f33dffff640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33d40b4c40 0x7f33d40b7150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f33e8108d20 tx=0x7f33d000b590 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:01.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.433+0000 7f33e4ff9640 1 -- 172.21.15.53:0/1371257110 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f33d8014030 con 0x7f33e8103950 2024-08-31T06:04:01.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:01 smithi130 ceph-mon[22266]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.626+0000 7f33ed457640 1 -- 172.21.15.53:0/1371257110 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f33e80635a0 con 0x7f33d40b4c40 2024-08-31T06:04:01.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.628+0000 7f33e4ff9640 1 -- 172.21.15.53:0/1371257110 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f33e80635a0 con 0x7f33d40b4c40 2024-08-31T06:04:01.631 INFO:teuthology.orchestra.run.smithi053.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-31T06:04:01.632 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300G8480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-08-31T06:04:01.632 INFO:teuthology.orchestra.run.smithi053.stdout:smithi130 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500Q1400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-31T06:04:01.632 INFO:teuthology.orchestra.run.smithi053.stdout:smithi153 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300MV400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-31T06:04:01.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 -- 172.21.15.53:0/1371257110 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33d40b4c40 msgr2=0x7f33d40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:01.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33d40b4c40 0x7f33d40b7150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f33e8108d20 tx=0x7f33d000b590 comp rx=0 tx=0).stop 2024-08-31T06:04:01.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 -- 172.21.15.53:0/1371257110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33e8103950 msgr2=0x7f33e819a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:01.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33e8103950 0x7f33e819a110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f33d800c920 tx=0x7f33d800cde0 comp rx=0 tx=0).stop 2024-08-31T06:04:01.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 -- 172.21.15.53:0/1371257110 shutdown_connections 2024-08-31T06:04:01.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33d40b4c40 0x7f33d40b7150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:01.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33e8109be0 0x7f33e819f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:01.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33e8109290 0x7f33e819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:01.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 --2- 172.21.15.53:0/1371257110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33e8103950 0x7f33e819a110 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:01.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 -- 172.21.15.53:0/1371257110 >> 172.21.15.53:0/1371257110 conn(0x7f33e80ff3a0 msgr2=0x7f33e81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:01.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 -- 172.21.15.53:0/1371257110 shutdown_connections 2024-08-31T06:04:01.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:01.630+0000 7f33ed457640 1 -- 172.21.15.53:0/1371257110 wait complete. 2024-08-31T06:04:01.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:01 smithi153 ceph-mon[22320]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:02.276 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T06:04:02.285 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi053.front.sepia.ceph.com 2024-08-31T06:04:02.285 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-31T06:04:02.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:02 smithi053 ceph-mon[18924]: pgmap v293: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:04:02.538 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:02.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:02 smithi130 ceph-mon[22266]: pgmap v293: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:04:02.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:02 smithi153 ceph-mon[22320]: pgmap v293: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:04:03.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.021+0000 7f7b94127640 1 -- 172.21.15.53:0/1061757195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b8c109260 msgr2=0x7f7b8c109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:03.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.021+0000 7f7b94127640 1 --2- 172.21.15.53:0/1061757195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b8c109260 0x7f7b8c109670 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009900 tx=0x7f7b8802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.022+0000 7f7b94127640 1 -- 172.21.15.53:0/1061757195 shutdown_connections 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.022+0000 7f7b94127640 1 --2- 172.21.15.53:0/1061757195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c109bb0 0x7f7b8c1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.022+0000 7f7b94127640 1 --2- 172.21.15.53:0/1061757195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b8c109260 0x7f7b8c109670 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.022+0000 7f7b94127640 1 --2- 172.21.15.53:0/1061757195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c103920 0x7f7b8c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.022+0000 7f7b94127640 1 -- 172.21.15.53:0/1061757195 >> 172.21.15.53:0/1061757195 conn(0x7f7b8c0ff3b0 msgr2=0x7f7b8c101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.022+0000 7f7b94127640 1 -- 172.21.15.53:0/1061757195 shutdown_connections 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.022+0000 7f7b94127640 1 -- 172.21.15.53:0/1061757195 wait complete. 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.022+0000 7f7b94127640 1 Processor -- start 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b94127640 1 -- start start 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b94127640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c103920 0x7f7b8c19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b94127640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b8c109260 0x7f7b8c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b94127640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c109bb0 0x7f7b8c19f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b94127640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c113720 con 0x7f7b8c109260 2024-08-31T06:04:03.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b94127640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c1135a0 con 0x7f7b8c103920 2024-08-31T06:04:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b94127640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c1138a0 con 0x7f7b8c109bb0 2024-08-31T06:04:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b916c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b8c109260 0x7f7b8c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b916c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b8c109260 0x7f7b8c19a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38418/0 (socket says 172.21.15.53:38418) 2024-08-31T06:04:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b916c2640 1 -- 172.21.15.53:0/4120608082 learned_addr learned my addr 172.21.15.53:0/4120608082 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b91ec3640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c103920 0x7f7b8c19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b926c4640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c109bb0 0x7f7b8c19f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b916c2640 1 -- 172.21.15.53:0/4120608082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c109bb0 msgr2=0x7f7b8c19f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b916c2640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c109bb0 0x7f7b8c19f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b916c2640 1 -- 172.21.15.53:0/4120608082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c103920 msgr2=0x7f7b8c19a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b916c2640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c103920 0x7f7b8c19a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.023+0000 7f7b916c2640 1 -- 172.21.15.53:0/4120608082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8c19ffa0 con 0x7f7b8c109260 2024-08-31T06:04:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.024+0000 7f7b916c2640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b8c109260 0x7f7b8c19a690 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7b8802a910 tx=0x7f7b880305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.024+0000 7f7b7effd640 1 -- 172.21.15.53:0/4120608082 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8803f070 con 0x7f7b8c109260 2024-08-31T06:04:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.024+0000 7f7b7effd640 1 -- 172.21.15.53:0/4120608082 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b88004460 con 0x7f7b8c109260 2024-08-31T06:04:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.024+0000 7f7b94127640 1 -- 172.21.15.53:0/4120608082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b8c1a0230 con 0x7f7b8c109260 2024-08-31T06:04:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.024+0000 7f7b7effd640 1 -- 172.21.15.53:0/4120608082 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b88035030 con 0x7f7b8c109260 2024-08-31T06:04:03.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.024+0000 7f7b94127640 1 -- 172.21.15.53:0/4120608082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b8c1a0760 con 0x7f7b8c109260 2024-08-31T06:04:03.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.025+0000 7f7b94127640 1 -- 172.21.15.53:0/4120608082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b8c104ba0 con 0x7f7b8c109260 2024-08-31T06:04:03.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.027+0000 7f7b7effd640 1 -- 172.21.15.53:0/4120608082 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f7b88042070 con 0x7f7b8c109260 2024-08-31T06:04:03.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.028+0000 7f7b7effd640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b780b4cc0 0x7f7b780b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:03.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.028+0000 7f7b91ec3640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b780b4cc0 0x7f7b780b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:03.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.028+0000 7f7b7effd640 1 -- 172.21.15.53:0/4120608082 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f7b88106330 con 0x7f7b8c109260 2024-08-31T06:04:03.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.029+0000 7f7b91ec3640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b780b4cc0 0x7f7b780b71d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000abe0 tx=0x7f7b8000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:03.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.031+0000 7f7b7effd640 1 -- 172.21.15.53:0/4120608082 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7b8c1a0760 con 0x7f7b8c109260 2024-08-31T06:04:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.256+0000 7f7b94127640 1 -- 172.21.15.53:0/4120608082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7b8c19b220 con 0x7f7b8c109260 2024-08-31T06:04:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.256+0000 7f7b7effd640 1 -- 172.21.15.53:0/4120608082 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3136 (secure 0 0 0) 0x7f7b8c19b220 con 0x7f7b8c109260 2024-08-31T06:04:03.260 INFO:teuthology.orchestra.run.smithi053.stdout:e27 2024-08-31T06:04:03.260 INFO:teuthology.orchestra.run.smithi053.stdout:btime 2024-08-31T06:02:42:670578+0000 2024-08-31T06:04:03.260 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T06:04:03.260 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T06:04:03.260 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-08-31T06:04:03.260 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:03.260 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-08-31T06:04:03.260 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-08-31T06:04:03.260 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 27 2024-08-31T06:04:03.261 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T06:04:03.261 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-08-31T06:02:31.233616+0000 2024-08-31T06:04:03.261 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-08-31T06:02:42.670556+0000 2024-08-31T06:04:03.261 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-08-31T06:04:03.261 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-08-31T06:04:03.261 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 300 2024-08-31T06:04:03.261 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-08-31T06:04:03.261 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-08-31T06:04:03.261 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-08-31T06:04:03.262 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-08-31T06:04:03.262 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-08-31T06:04:03.262 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-08-31T06:04:03.262 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T06:04:03.262 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 5 2024-08-31T06:04:03.262 INFO:teuthology.orchestra.run.smithi053.stdout:in 0,1,2,3,4 2024-08-31T06:04:03.262 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=24668,1=24640,2=24632,3=24619,4=24613} 2024-08-31T06:04:03.263 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-08-31T06:04:03.263 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-08-31T06:04:03.263 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-08-31T06:04:03.263 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-08-31T06:04:03.263 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-08-31T06:04:03.263 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-08-31T06:04:03.263 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-08-31T06:04:03.263 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-08-31T06:04:03.264 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 0 2024-08-31T06:04:03.264 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 24668 members: 24668,24640,24632,24619,24613 2024-08-31T06:04:03.264 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b{0:24668} state up:active seq 4 addr [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.264 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.e{0:24608} state up:standby-replay seq 1 addr [v2:172.21.15.130:6834/3456535570,v1:172.21.15.130:6835/3456535570] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.264 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.i{1:24640} state up:active seq 8 addr [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.264 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.k{1:24578} state up:standby-replay seq 1 addr [v2:172.21.15.130:6832/4017894222,v1:172.21.15.130:6833/4017894222] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.264 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.h{2:24632} state up:active seq 9 addr [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.264 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.l{2:24577} state up:standby-replay seq 1 addr [v2:172.21.15.153:6832/4101202303,v1:172.21.15.153:6833/4101202303] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.264 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c{3:24619} state up:active seq 10 addr [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.264 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a{3:14841} state up:standby-replay seq 1 addr [v2:172.21.15.53:6840/2812306532,v1:172.21.15.53:6841/2812306532] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.264 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.f{4:24613} state up:active seq 11 addr [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.265 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.g{4:14829} state up:standby-replay seq 1 addr [v2:172.21.15.53:6838/1079311184,v1:172.21.15.53:6839/1079311184] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.265 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:03.265 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:03.265 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-08-31T06:04:03.265 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:03.265 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.j{-1:14760} state up:standby seq 1 addr [v2:172.21.15.53:6834/2455063100,v1:172.21.15.53:6835/2455063100] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.265 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d{-1:14772} state up:standby seq 1 addr [v2:172.21.15.53:6836/3626996637,v1:172.21.15.53:6837/3626996637] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:04:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 27 2024-08-31T06:04:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 -- 172.21.15.53:0/4120608082 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b780b4cc0 msgr2=0x7f7b780b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b780b4cc0 0x7f7b780b71d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000abe0 tx=0x7f7b8000a2d0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 -- 172.21.15.53:0/4120608082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b8c109260 msgr2=0x7f7b8c19a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b8c109260 0x7f7b8c19a690 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7b8802a910 tx=0x7f7b880305d0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 -- 172.21.15.53:0/4120608082 shutdown_connections 2024-08-31T06:04:03.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b780b4cc0 0x7f7b780b71d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c109bb0 0x7f7b8c19f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b8c109260 0x7f7b8c19a690 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 --2- 172.21.15.53:0/4120608082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b8c103920 0x7f7b8c19a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:03.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 -- 172.21.15.53:0/4120608082 >> 172.21.15.53:0/4120608082 conn(0x7f7b8c0ff3b0 msgr2=0x7f7b8c1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:03.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 -- 172.21.15.53:0/4120608082 shutdown_connections 2024-08-31T06:04:03.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:03.260+0000 7f7b94127640 1 -- 172.21.15.53:0/4120608082 wait complete. 2024-08-31T06:04:03.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:03 smithi053 ceph-mon[18924]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:03.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:03 smithi130 ceph-mon[22266]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:03.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:03 smithi153 ceph-mon[22320]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:03.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-31T06:04:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:04.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:04 smithi053 ceph-mon[18924]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:04:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:04 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4120608082' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T06:04:04.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.615+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2927489456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac109260 msgr2=0x7f7bac109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:04.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.615+0000 7f7bb1c80640 1 --2- 172.21.15.53:0/2927489456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac109260 0x7f7bac109670 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009900 tx=0x7f7b9402a410 comp rx=0 tx=0).stop 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.615+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2927489456 shutdown_connections 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.615+0000 7f7bb1c80640 1 --2- 172.21.15.53:0/2927489456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac109bb0 0x7f7bac1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.615+0000 7f7bb1c80640 1 --2- 172.21.15.53:0/2927489456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac109260 0x7f7bac109670 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.615+0000 7f7bb1c80640 1 --2- 172.21.15.53:0/2927489456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac103920 0x7f7bac103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.615+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2927489456 >> 172.21.15.53:0/2927489456 conn(0x7f7bac0ff3b0 msgr2=0x7f7bac101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.615+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2927489456 shutdown_connections 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.615+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2927489456 wait complete. 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.616+0000 7f7bb1c80640 1 Processor -- start 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.616+0000 7f7bb1c80640 1 -- start start 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.616+0000 7f7bb1c80640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac103920 0x7f7bac19a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.616+0000 7f7bb1c80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac109260 0x7f7bac19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:04.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7bb1c80640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac109bb0 0x7f7bac19f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7bb1c80640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac113720 con 0x7f7bac109260 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7bb1c80640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1135a0 con 0x7f7bac109bb0 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7bb1c80640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1138a0 con 0x7f7bac103920 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac109260 0x7f7bac19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac109260 0x7f7bac19a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50150/0 (socket says 172.21.15.53:50150) 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba3fff640 1 -- 172.21.15.53:0/2292201137 learned_addr learned my addr 172.21.15.53:0/2292201137 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7bab7fe640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac103920 0x7f7bac19a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7babfff640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac109bb0 0x7f7bac19f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba3fff640 1 -- 172.21.15.53:0/2292201137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac103920 msgr2=0x7f7bac19a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba3fff640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac103920 0x7f7bac19a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba3fff640 1 -- 172.21.15.53:0/2292201137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac109bb0 msgr2=0x7f7bac19f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba3fff640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac109bb0 0x7f7bac19f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:04.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba3fff640 1 -- 172.21.15.53:0/2292201137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bac1a0040 con 0x7f7bac109260 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba3fff640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac109260 0x7f7bac19a730 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7b94005940 tx=0x7f7b940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba97fa640 1 -- 172.21.15.53:0/2292201137 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9403f030 con 0x7f7bac109260 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba97fa640 1 -- 172.21.15.53:0/2292201137 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b94003c90 con 0x7f7bac109260 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2292201137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bac1a02d0 con 0x7f7bac109260 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7ba97fa640 1 -- 172.21.15.53:0/2292201137 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94035070 con 0x7f7bac109260 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.617+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2292201137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bac1a07b0 con 0x7f7bac109260 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.619+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2292201137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bac104ba0 con 0x7f7bac109260 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.620+0000 7f7ba97fa640 1 -- 172.21.15.53:0/2292201137 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f7b94042030 con 0x7f7bac109260 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.621+0000 7f7ba97fa640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4c40 0x7f7b980b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.621+0000 7f7bab7fe640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4c40 0x7f7b980b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.621+0000 7f7ba97fa640 1 -- 172.21.15.53:0/2292201137 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f7b94105950 con 0x7f7bac109260 2024-08-31T06:04:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.621+0000 7f7bab7fe640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4c40 0x7f7b980b7150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0058c0 tx=0x7f7b9c00a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:04.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:04 smithi130 ceph-mon[22266]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:04:04.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:04 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4120608082' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T06:04:04.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.626+0000 7f7ba97fa640 1 -- 172.21.15.53:0/2292201137 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7b940cc170 con 0x7f7bac109260 2024-08-31T06:04:04.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:04 smithi153 ceph-mon[22320]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:04:04.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:04 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4120608082' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T06:04:04.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.811+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2292201137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f7bac10b3f0 con 0x7f7bac109260 2024-08-31T06:04:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.812+0000 7f7ba97fa640 1 -- 172.21.15.53:0/2292201137 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v72) ==== 56+0+5712 (secure 0 0 0) 0x7f7b940d0930 con 0x7f7bac109260 2024-08-31T06:04:04.815 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 72 2024-08-31T06:04:04.815 INFO:teuthology.orchestra.run.smithi053.stdout:fsid 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T06:04:04.815 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-08-31T05:54:18.180159+0000 2024-08-31T06:04:04.815 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-08-31T06:03:15.760413+0000 2024-08-31T06:04:04.815 INFO:teuthology.orchestra.run.smithi053.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-31T06:04:04.815 INFO:teuthology.orchestra.run.smithi053.stdout:crush_version 26 2024-08-31T06:04:04.816 INFO:teuthology.orchestra.run.smithi053.stdout:full_ratio 0.95 2024-08-31T06:04:04.816 INFO:teuthology.orchestra.run.smithi053.stdout:backfillfull_ratio 0.9 2024-08-31T06:04:04.816 INFO:teuthology.orchestra.run.smithi053.stdout:nearfull_ratio 0.85 2024-08-31T06:04:04.816 INFO:teuthology.orchestra.run.smithi053.stdout:require_min_compat_client luminous 2024-08-31T06:04:04.817 INFO:teuthology.orchestra.run.smithi053.stdout:min_compat_client luminous 2024-08-31T06:04:04.817 INFO:teuthology.orchestra.run.smithi053.stdout:require_osd_release squid 2024-08-31T06:04:04.817 INFO:teuthology.orchestra.run.smithi053.stdout:stretch_mode_enabled false 2024-08-31T06:04:04.817 INFO:teuthology.orchestra.run.smithi053.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-31T06:04:04.817 INFO:teuthology.orchestra.run.smithi053.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 70 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-08-31T06:04:04.817 INFO:teuthology.orchestra.run.smithi053.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 70 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-08-31T06:04:04.817 INFO:teuthology.orchestra.run.smithi053.stdout:max_osd 12 2024-08-31T06:04:04.817 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 up in weight 1 up_from 9 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6802/2893726672,v1:172.21.15.53:6803/2893726672] [v2:172.21.15.53:6804/2893726672,v1:172.21.15.53:6805/2893726672] exists,up a814231b-c1a5-4760-90e4-4eb5e2b05107 2024-08-31T06:04:04.817 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 up in weight 1 up_from 13 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6800/3394793383,v1:172.21.15.130:6801/3394793383] [v2:172.21.15.130:6802/3394793383,v1:172.21.15.130:6803/3394793383] exists,up c3387502-2a41-4afb-8e8b-321e68a8e362 2024-08-31T06:04:04.817 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 up in weight 1 up_from 17 up_thru 68 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/3220443014,v1:172.21.15.153:6801/3220443014] [v2:172.21.15.153:6802/3220443014,v1:172.21.15.153:6803/3220443014] exists,up d9ffe46e-6cc8-419d-9078-dbb40bfa3b12 2024-08-31T06:04:04.817 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 up in weight 1 up_from 23 up_thru 68 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6810/1900570211,v1:172.21.15.53:6811/1900570211] [v2:172.21.15.53:6812/1900570211,v1:172.21.15.53:6813/1900570211] exists,up 251aec00-eb9e-49b9-8c6b-816e44a7da13 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 up in weight 1 up_from 28 up_thru 68 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6808/862414664,v1:172.21.15.130:6809/862414664] [v2:172.21.15.130:6810/862414664,v1:172.21.15.130:6811/862414664] exists,up 03860b7f-13ce-4461-8d17-b44bb2bc232a 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 up in weight 1 up_from 32 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6808/4190084031,v1:172.21.15.153:6809/4190084031] [v2:172.21.15.153:6810/4190084031,v1:172.21.15.153:6811/4190084031] exists,up 9fc8b987-9839-4db8-a64e-15c233be0651 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6 up in weight 1 up_from 38 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6818/997206382,v1:172.21.15.53:6819/997206382] [v2:172.21.15.53:6820/997206382,v1:172.21.15.53:6821/997206382] exists,up 57f5870f-b022-4942-ab08-80d3bdf8d51b 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7 up in weight 1 up_from 43 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6816/3016906156,v1:172.21.15.130:6817/3016906156] [v2:172.21.15.130:6818/3016906156,v1:172.21.15.130:6819/3016906156] exists,up 29c0cbe5-22d9-4256-92c3-44edf317fd58 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:osd.8 up in weight 1 up_from 49 up_thru 68 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6816/2889781578,v1:172.21.15.153:6817/2889781578] [v2:172.21.15.153:6818/2889781578,v1:172.21.15.153:6819/2889781578] exists,up b05f2429-ef03-4103-b2f0-a4bc66189d72 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:osd.9 up in weight 1 up_from 54 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6826/2148315365,v1:172.21.15.53:6827/2148315365] [v2:172.21.15.53:6828/2148315365,v1:172.21.15.53:6829/2148315365] exists,up a462e056-c6d3-45bd-ad44-c7a6f3c25033 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:osd.10 up in weight 1 up_from 59 up_thru 68 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6824/982629437,v1:172.21.15.130:6825/982629437] [v2:172.21.15.130:6826/982629437,v1:172.21.15.130:6827/982629437] exists,up 05716830-2ec8-49f3-9cce-3efc73c935c9 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:osd.11 up in weight 1 up_from 64 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6824/16997062,v1:172.21.15.153:6825/16997062] [v2:172.21.15.153:6826/16997062,v1:172.21.15.153:6827/16997062] exists,up 99124195-0220-48f7-88fe-200568ae4d31 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:pg_upmap_items 2.0 [8,1] 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:pg_upmap_items 2.8 [2,11] 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:pg_upmap_items 3.0 [4,8] 2024-08-31T06:04:04.818 INFO:teuthology.orchestra.run.smithi053.stdout:pg_upmap_items 3.1 [4,9] 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:pg_upmap_items 3.6 [3,7] 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:pg_upmap_items 3.17 [4,6] 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:pg_upmap_items 3.1b [4,6] 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:pg_upmap_items 3.1e [3,9] 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:pg_upmap_items 3.20 [5,9] 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:pg_upmap_items 3.39 [5,8] 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:0/1171085527 expires 2024-09-01T05:56:14.253642+0000 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:6800/1409851736 expires 2024-09-01T05:54:47.617757+0000 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:6801/1409851736 expires 2024-09-01T05:54:47.617757+0000 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:0/3530571634 expires 2024-09-01T05:54:47.617757+0000 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:6800/2874060887 expires 2024-09-01T05:55:12.269899+0000 2024-08-31T06:04:04.819 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:0/3925890211 expires 2024-09-01T05:56:14.253642+0000 2024-08-31T06:04:04.820 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:0/1611320170 expires 2024-09-01T05:54:47.617757+0000 2024-08-31T06:04:04.820 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:6801/2874060887 expires 2024-09-01T05:55:12.269899+0000 2024-08-31T06:04:04.820 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:6801/3855814836 expires 2024-09-01T05:56:14.253642+0000 2024-08-31T06:04:04.820 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:0/2127129432 expires 2024-09-01T05:55:12.269899+0000 2024-08-31T06:04:04.820 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:0/2464556072 expires 2024-09-01T05:54:47.617757+0000 2024-08-31T06:04:04.820 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:0/2655797197 expires 2024-09-01T05:55:12.269899+0000 2024-08-31T06:04:04.820 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:6800/3855814836 expires 2024-09-01T05:56:14.253642+0000 2024-08-31T06:04:04.820 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:0/1663932105 expires 2024-09-01T05:55:12.269899+0000 2024-08-31T06:04:04.820 INFO:teuthology.orchestra.run.smithi053.stdout:blocklist 172.21.15.53:0/2624965482 expires 2024-09-01T05:56:14.253642+0000 2024-08-31T06:04:04.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2292201137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4c40 msgr2=0x7f7b980b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:04.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4c40 0x7f7b980b7150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0058c0 tx=0x7f7b9c00a250 comp rx=0 tx=0).stop 2024-08-31T06:04:04.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2292201137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac109260 msgr2=0x7f7bac19a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:04.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac109260 0x7f7bac19a730 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7b94005940 tx=0x7f7b940042f0 comp rx=0 tx=0).stop 2024-08-31T06:04:04.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2292201137 shutdown_connections 2024-08-31T06:04:04.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4c40 0x7f7b980b7150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac109bb0 0x7f7bac19f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac109260 0x7f7bac19a730 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 --2- 172.21.15.53:0/2292201137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac103920 0x7f7bac19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2292201137 >> 172.21.15.53:0/2292201137 conn(0x7f7bac0ff3b0 msgr2=0x7f7bac1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2292201137 shutdown_connections 2024-08-31T06:04:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:04.814+0000 7f7bb1c80640 1 -- 172.21.15.53:0/2292201137 wait complete. 2024-08-31T06:04:05.438 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:05 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2292201137' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T06:04:05.467 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-31T06:04:05.481 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:04:05.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:05 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2292201137' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T06:04:05.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:05 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2292201137' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T06:04:05.731 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.239+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/142783107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d84101f90 msgr2=0x7f7d841023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.239+0000 7f7d8a1b6640 1 --2- 172.21.15.53:0/142783107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d84101f90 0x7f7d841023a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009900 tx=0x7f7d7402a410 comp rx=0 tx=0).stop 2024-08-31T06:04:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.239+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/142783107 shutdown_connections 2024-08-31T06:04:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.239+0000 7f7d8a1b6640 1 --2- 172.21.15.53:0/142783107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d84108220 0x7f7d8410ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.239+0000 7f7d8a1b6640 1 --2- 172.21.15.53:0/142783107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d841078d0 0x7f7d84107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.239+0000 7f7d8a1b6640 1 --2- 172.21.15.53:0/142783107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d84101f90 0x7f7d841023a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.239+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/142783107 >> 172.21.15.53:0/142783107 conn(0x7f7d84077a00 msgr2=0x7f7d84077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.239+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/142783107 shutdown_connections 2024-08-31T06:04:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.239+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/142783107 wait complete. 2024-08-31T06:04:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.240+0000 7f7d8a1b6640 1 Processor -- start 2024-08-31T06:04:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.240+0000 7f7d8a1b6640 1 -- start start 2024-08-31T06:04:06.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.240+0000 7f7d8a1b6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d84101f90 0x7f7d840feb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:06.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.240+0000 7f7d8a1b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d841078d0 0x7f7d840ff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:06.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.240+0000 7f7d8a1b6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d84108220 0x7f7d840ff600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:06.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.240+0000 7f7d8a1b6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7d841126c0 con 0x7f7d841078d0 2024-08-31T06:04:06.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.240+0000 7f7d8a1b6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7d84112540 con 0x7f7d84108220 2024-08-31T06:04:06.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.240+0000 7f7d8a1b6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d84112840 con 0x7f7d84101f90 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d7bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d841078d0 0x7f7d840ff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d7bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d841078d0 0x7f7d840ff0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50168/0 (socket says 172.21.15.53:50168) 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d7bfff640 1 -- 172.21.15.53:0/1601751609 learned_addr learned my addr 172.21.15.53:0/1601751609 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d837fe640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d84101f90 0x7f7d840feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d83fff640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d84108220 0x7f7d840ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d7bfff640 1 -- 172.21.15.53:0/1601751609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d84101f90 msgr2=0x7f7d840feb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d7bfff640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d84101f90 0x7f7d840feb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d7bfff640 1 -- 172.21.15.53:0/1601751609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d84108220 msgr2=0x7f7d840ff600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d7bfff640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d84108220 0x7f7d840ff600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d7bfff640 1 -- 172.21.15.53:0/1601751609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d841a8470 con 0x7f7d841078d0 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d83fff640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d84108220 0x7f7d840ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d7bfff640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d841078d0 0x7f7d840ff0c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00c8c0 tx=0x7f7d6c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d817fa640 1 -- 172.21.15.53:0/1601751609 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c007bb0 con 0x7f7d841078d0 2024-08-31T06:04:06.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d817fa640 1 -- 172.21.15.53:0/1601751609 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d6c007d50 con 0x7f7d841078d0 2024-08-31T06:04:06.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d817fa640 1 -- 172.21.15.53:0/1601751609 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0186a0 con 0x7f7d841078d0 2024-08-31T06:04:06.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/1601751609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d841a8760 con 0x7f7d841078d0 2024-08-31T06:04:06.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.241+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/1601751609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d841a8cf0 con 0x7f7d841078d0 2024-08-31T06:04:06.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.242+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/1601751609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d841023a0 con 0x7f7d841078d0 2024-08-31T06:04:06.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.244+0000 7f7d817fa640 1 -- 172.21.15.53:0/1601751609 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f7d6c00fa00 con 0x7f7d841078d0 2024-08-31T06:04:06.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.245+0000 7f7d817fa640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d700b4c90 0x7f7d700b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:06.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.245+0000 7f7d817fa640 1 -- 172.21.15.53:0/1601751609 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f7d6c0e56f0 con 0x7f7d841078d0 2024-08-31T06:04:06.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.245+0000 7f7d837fe640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d700b4c90 0x7f7d700b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:06.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.245+0000 7f7d837fe640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d700b4c90 0x7f7d700b71a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7d841005d0 tx=0x7f7d74000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:06.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.248+0000 7f7d817fa640 1 -- 172.21.15.53:0/1601751609 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7d6c014030 con 0x7f7d841078d0 2024-08-31T06:04:06.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.469+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/1601751609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d840ffe80 con 0x7f7d841078d0 2024-08-31T06:04:06.471 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:06 smithi053 ceph-mon[18924]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:06.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.470+0000 7f7d817fa640 1 -- 172.21.15.53:0/1601751609 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11985 (secure 0 0 0) 0x7f7d6c0ac6d0 con 0x7f7d841078d0 2024-08-31T06:04:06.472 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:06.472 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"btime":"2024-08-31T06:02:42:670578+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:02:42.670556+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:04:06.472 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 27 2024-08-31T06:04:06.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/1601751609 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d700b4c90 msgr2=0x7f7d700b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:06.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d700b4c90 0x7f7d700b71a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7d841005d0 tx=0x7f7d74000bc0 comp rx=0 tx=0).stop 2024-08-31T06:04:06.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/1601751609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d841078d0 msgr2=0x7f7d840ff0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:06.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d841078d0 0x7f7d840ff0c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00c8c0 tx=0x7f7d6c00cd80 comp rx=0 tx=0).stop 2024-08-31T06:04:06.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/1601751609 shutdown_connections 2024-08-31T06:04:06.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d700b4c90 0x7f7d700b71a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:06.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d84108220 0x7f7d840ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:06.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d841078d0 0x7f7d840ff0c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:06.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 --2- 172.21.15.53:0/1601751609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d84101f90 0x7f7d840feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:06.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/1601751609 >> 172.21.15.53:0/1601751609 conn(0x7f7d84077a00 msgr2=0x7f7d8410f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:06.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/1601751609 shutdown_connections 2024-08-31T06:04:06.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:06.472+0000 7f7d8a1b6640 1 -- 172.21.15.53:0/1601751609 wait complete. 2024-08-31T06:04:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:06 smithi130 ceph-mon[22266]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:06.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:06 smithi153 ceph-mon[22320]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:07.125 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:04:07.378 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:07.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:07 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1601751609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:07.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:07 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1601751609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:07.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:07 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1601751609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.864+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2563117409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3c103950 msgr2=0x7f8c3c103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.864+0000 7f8c43d1a640 1 --2- 172.21.15.53:0/2563117409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3c103950 0x7f8c3c103d60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009900 tx=0x7f8c3802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.864+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2563117409 shutdown_connections 2024-08-31T06:04:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.864+0000 7f8c43d1a640 1 --2- 172.21.15.53:0/2563117409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c3c109be0 0x7f8c3c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.864+0000 7f8c43d1a640 1 --2- 172.21.15.53:0/2563117409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c3c109290 0x7f8c3c1096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.864+0000 7f8c43d1a640 1 --2- 172.21.15.53:0/2563117409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3c103950 0x7f8c3c103d60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.864+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2563117409 >> 172.21.15.53:0/2563117409 conn(0x7f8c3c0ff3a0 msgr2=0x7f8c3c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.864+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2563117409 shutdown_connections 2024-08-31T06:04:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.864+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2563117409 wait complete. 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.864+0000 7f8c43d1a640 1 Processor -- start 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c43d1a640 1 -- start start 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c43d1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3c103950 0x7f8c3c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c43d1a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c3c109290 0x7f8c3c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c43d1a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c3c109be0 0x7f8c3c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c43d1a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3c113790 con 0x7f8c3c103950 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c43d1a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3c113610 con 0x7f8c3c109290 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c43d1a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3c113910 con 0x7f8c3c109be0 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c41ab6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3c103950 0x7f8c3c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c41ab6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3c103950 0x7f8c3c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50178/0 (socket says 172.21.15.53:50178) 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c41ab6640 1 -- 172.21.15.53:0/2972821302 learned_addr learned my addr 172.21.15.53:0/2972821302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c422b7640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c3c109be0 0x7f8c3c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c412b5640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c3c109290 0x7f8c3c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c41ab6640 1 -- 172.21.15.53:0/2972821302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c3c109be0 msgr2=0x7f8c3c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c41ab6640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c3c109be0 0x7f8c3c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c41ab6640 1 -- 172.21.15.53:0/2972821302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c3c109290 msgr2=0x7f8c3c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c41ab6640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c3c109290 0x7f8c3c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c41ab6640 1 -- 172.21.15.53:0/2972821302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3c1a8540 con 0x7f8c3c103950 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c422b7640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c3c109be0 0x7f8c3c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.865+0000 7f8c41ab6640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3c103950 0x7f8c3c0754b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009a20 tx=0x7f8c38004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.866+0000 7f8c32ffd640 1 -- 172.21.15.53:0/2972821302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3803f030 con 0x7f8c3c103950 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.866+0000 7f8c32ffd640 1 -- 172.21.15.53:0/2972821302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c380035f0 con 0x7f8c3c103950 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.866+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2972821302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c3c1a87d0 con 0x7f8c3c103950 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.866+0000 7f8c32ffd640 1 -- 172.21.15.53:0/2972821302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38035070 con 0x7f8c3c103950 2024-08-31T06:04:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.866+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2972821302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c3c1a8cb0 con 0x7f8c3c103950 2024-08-31T06:04:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.867+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2972821302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c3c103d60 con 0x7f8c3c103950 2024-08-31T06:04:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.868+0000 7f8c32ffd640 1 -- 172.21.15.53:0/2972821302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f8c38003a60 con 0x7f8c3c103950 2024-08-31T06:04:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.869+0000 7f8c32ffd640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c280b4c10 0x7f8c280b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.869+0000 7f8c412b5640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c280b4c10 0x7f8c280b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.869+0000 7f8c32ffd640 1 -- 172.21.15.53:0/2972821302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f8c381063d0 con 0x7f8c3c103950 2024-08-31T06:04:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.870+0000 7f8c412b5640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c280b4c10 0x7f8c280b7120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c108d00 tx=0x7f8c2c009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:07.872+0000 7f8c32ffd640 1 -- 172.21.15.53:0/2972821302 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8c380cd240 con 0x7f8c3c103950 2024-08-31T06:04:08.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.094+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2972821302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c3c02e430 con 0x7f8c3c103950 2024-08-31T06:04:08.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.095+0000 7f8c32ffd640 1 -- 172.21.15.53:0/2972821302 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11985 (secure 0 0 0) 0x7f8c380ccb40 con 0x7f8c3c103950 2024-08-31T06:04:08.097 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:08.097 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"btime":"2024-08-31T06:02:42:670578+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:02:42.670556+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:04:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 27 2024-08-31T06:04:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2972821302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c280b4c10 msgr2=0x7f8c280b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c280b4c10 0x7f8c280b7120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c108d00 tx=0x7f8c2c009110 comp rx=0 tx=0).stop 2024-08-31T06:04:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2972821302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3c103950 msgr2=0x7f8c3c0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3c103950 0x7f8c3c0754b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009a20 tx=0x7f8c38004270 comp rx=0 tx=0).stop 2024-08-31T06:04:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2972821302 shutdown_connections 2024-08-31T06:04:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c280b4c10 0x7f8c280b7120 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c3c109be0 0x7f8c3c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c3c109290 0x7f8c3c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 --2- 172.21.15.53:0/2972821302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3c103950 0x7f8c3c0754b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:08.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2972821302 >> 172.21.15.53:0/2972821302 conn(0x7f8c3c0ff3a0 msgr2=0x7f8c3c1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:08.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2972821302 shutdown_connections 2024-08-31T06:04:08.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:08.097+0000 7f8c43d1a640 1 -- 172.21.15.53:0/2972821302 wait complete. 2024-08-31T06:04:08.398 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:08 smithi053 ceph-mon[18924]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:04:08.398 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:08 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2972821302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:08.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:08 smithi130 ceph-mon[22266]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:04:08.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:08 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2972821302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:08.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:08 smithi153 ceph-mon[22320]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:04:08.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:08 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2972821302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:08.748 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:04:09.020 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:09.391 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:09 smithi053 ceph-mon[18924]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.482+0000 7f1a13794640 1 -- 172.21.15.53:0/3148575800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0c102810 msgr2=0x7f1a0c102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.482+0000 7f1a13794640 1 --2- 172.21.15.53:0/3148575800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0c102810 0x7f1a0c102c20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009900 tx=0x7f1a0802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.483+0000 7f1a13794640 1 -- 172.21.15.53:0/3148575800 shutdown_connections 2024-08-31T06:04:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.483+0000 7f1a13794640 1 --2- 172.21.15.53:0/3148575800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a0c108aa0 0x7f1a0c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.483+0000 7f1a13794640 1 --2- 172.21.15.53:0/3148575800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a0c108150 0x7f1a0c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.483+0000 7f1a13794640 1 --2- 172.21.15.53:0/3148575800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0c102810 0x7f1a0c102c20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.483+0000 7f1a13794640 1 -- 172.21.15.53:0/3148575800 >> 172.21.15.53:0/3148575800 conn(0x7f1a0c0794b0 msgr2=0x7f1a0c0798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.483+0000 7f1a13794640 1 -- 172.21.15.53:0/3148575800 shutdown_connections 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.483+0000 7f1a13794640 1 -- 172.21.15.53:0/3148575800 wait complete. 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.483+0000 7f1a13794640 1 Processor -- start 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.483+0000 7f1a13794640 1 -- start start 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a13794640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0c102810 0x7f1a0c199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a13794640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a0c108150 0x7f1a0c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a13794640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a0c108aa0 0x7f1a0c19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a13794640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c112600 con 0x7f1a0c102810 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a13794640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c112480 con 0x7f1a0c108aa0 2024-08-31T06:04:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a13794640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c112780 con 0x7f1a0c108150 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a11530640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0c102810 0x7f1a0c199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a11530640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0c102810 0x7f1a0c199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50200/0 (socket says 172.21.15.53:50200) 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a11530640 1 -- 172.21.15.53:0/3275443525 learned_addr learned my addr 172.21.15.53:0/3275443525 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a10d2f640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a0c108150 0x7f1a0c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a11d31640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a0c108aa0 0x7f1a0c19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a11530640 1 -- 172.21.15.53:0/3275443525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a0c108150 msgr2=0x7f1a0c199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a11530640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a0c108150 0x7f1a0c199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a11530640 1 -- 172.21.15.53:0/3275443525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a0c108aa0 msgr2=0x7f1a0c19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a11530640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a0c108aa0 0x7f1a0c19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a11530640 1 -- 172.21.15.53:0/3275443525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c19f000 con 0x7f1a0c102810 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a11530640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0c102810 0x7f1a0c199090 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009230 tx=0x7f1a08004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a027fc640 1 -- 172.21.15.53:0/3275443525 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0803f030 con 0x7f1a0c102810 2024-08-31T06:04:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a027fc640 1 -- 172.21.15.53:0/3275443525 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a08003a80 con 0x7f1a0c102810 2024-08-31T06:04:09.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.484+0000 7f1a027fc640 1 -- 172.21.15.53:0/3275443525 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08035070 con 0x7f1a0c102810 2024-08-31T06:04:09.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.485+0000 7f1a13794640 1 -- 172.21.15.53:0/3275443525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0c19f290 con 0x7f1a0c102810 2024-08-31T06:04:09.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.485+0000 7f1a13794640 1 -- 172.21.15.53:0/3275443525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0c1a5a50 con 0x7f1a0c102810 2024-08-31T06:04:09.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.485+0000 7f1a13794640 1 -- 172.21.15.53:0/3275443525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0c103a90 con 0x7f1a0c102810 2024-08-31T06:04:09.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.487+0000 7f1a027fc640 1 -- 172.21.15.53:0/3275443525 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f1a08042030 con 0x7f1a0c102810 2024-08-31T06:04:09.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.488+0000 7f1a027fc640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f80b4c10 0x7f19f80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:09.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.488+0000 7f1a10d2f640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f80b4c10 0x7f19f80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:09.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.488+0000 7f1a027fc640 1 -- 172.21.15.53:0/3275443525 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f1a08105f20 con 0x7f1a0c102810 2024-08-31T06:04:09.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.488+0000 7f1a10d2f640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f80b4c10 0x7f19f80b7120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c104670 tx=0x7f19fc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:09.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.491+0000 7f1a027fc640 1 -- 172.21.15.53:0/3275443525 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1a080cc7a0 con 0x7f1a0c102810 2024-08-31T06:04:09.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:09 smithi130 ceph-mon[22266]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:09.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:09 smithi153 ceph-mon[22320]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:09.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.679+0000 7f1a13794640 1 -- 172.21.15.53:0/3275443525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a0c10a290 con 0x7f1a0c102810 2024-08-31T06:04:09.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.681+0000 7f1a027fc640 1 -- 172.21.15.53:0/3275443525 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+23053 (secure 0 0 0) 0x7f1a080d5330 con 0x7f1a0c102810 2024-08-31T06:04:09.683 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:09.683 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":72,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:03:15.760413+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:04:09.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 -- 172.21.15.53:0/3275443525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f80b4c10 msgr2=0x7f19f80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:09.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f80b4c10 0x7f19f80b7120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c104670 tx=0x7f19fc00b390 comp rx=0 tx=0).stop 2024-08-31T06:04:09.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 -- 172.21.15.53:0/3275443525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0c102810 msgr2=0x7f1a0c199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:09.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0c102810 0x7f1a0c199090 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009230 tx=0x7f1a08004270 comp rx=0 tx=0).stop 2024-08-31T06:04:09.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 -- 172.21.15.53:0/3275443525 shutdown_connections 2024-08-31T06:04:09.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f80b4c10 0x7f19f80b7120 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:09.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a0c108aa0 0x7f1a0c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:09.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a0c108150 0x7f1a0c199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:09.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 --2- 172.21.15.53:0/3275443525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0c102810 0x7f1a0c199090 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:09.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 -- 172.21.15.53:0/3275443525 >> 172.21.15.53:0/3275443525 conn(0x7f1a0c0794b0 msgr2=0x7f1a0c1062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:09.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 -- 172.21.15.53:0/3275443525 shutdown_connections 2024-08-31T06:04:09.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:09.683+0000 7f1a13794640 1 -- 172.21.15.53:0/3275443525 wait complete. 2024-08-31T06:04:10.338 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:10 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3275443525' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:10.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T06:02:31.233616+0000', 'modified': '2024-08-31T06:02:42.670556+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24668, 'mds_1': 24640, 'mds_2': 24632, 'mds_3': 24619, 'mds_4': 24613}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14829': {'gid': 14829, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.53:6839/1079311184', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6838', 'nonce': 1079311184}, {'type': 'v1', 'addr': '172.21.15.53:6839', 'nonce': 1079311184}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14841': {'gid': 14841, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.53:6841/2812306532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6840', 'nonce': 2812306532}, {'type': 'v1', 'addr': '172.21.15.53:6841', 'nonce': 2812306532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24577': {'gid': 24577, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6833/4101202303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 4101202303}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 4101202303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6833/4017894222', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6832', 'nonce': 4017894222}, {'type': 'v1', 'addr': '172.21.15.130:6833', 'nonce': 4017894222}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6835/3456535570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 3456535570}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 3456535570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.153:6835/1480674420', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 1480674420}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 1480674420}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24619': {'gid': 24619, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.153:6837/3972541540', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 3972541540}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 3972541540}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24632': {'gid': 24632, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.130:6837/1323127878', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 1323127878}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 1323127878}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24640': {'gid': 24640, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.153:6839/268646865', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6838', 'nonce': 268646865}, {'type': 'v1', 'addr': '172.21.15.153:6839', 'nonce': 268646865}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24668': {'gid': 24668, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.130:6839/3403731647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 3403731647}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 3403731647}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24668, 'qdb_cluster': [24668, 24640, 24632, 24619, 24613]} 2024-08-31T06:04:10.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-31T06:04:10.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.f status 2024-08-31T06:04:10.624 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:10.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:10 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3275443525' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:10.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:10 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3275443525' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:11.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.213+0000 7f8f586c8640 1 -- 172.21.15.53:0/3796302850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f50104680 msgr2=0x7f8f50104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:11.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.213+0000 7f8f586c8640 1 --2- 172.21.15.53:0/3796302850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f50104680 0x7f8f50104a90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009900 tx=0x7f8f4802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:11.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.213+0000 7f8f586c8640 1 -- 172.21.15.53:0/3796302850 shutdown_connections 2024-08-31T06:04:11.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.213+0000 7f8f586c8640 1 --2- 172.21.15.53:0/3796302850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f5010dc30 0x7f8f501100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.213+0000 7f8f586c8640 1 --2- 172.21.15.53:0/3796302850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f501050b0 0x7f8f5010d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.213+0000 7f8f586c8640 1 --2- 172.21.15.53:0/3796302850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f50104680 0x7f8f50104a90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.213+0000 7f8f586c8640 1 -- 172.21.15.53:0/3796302850 >> 172.21.15.53:0/3796302850 conn(0x7f8f50079530 msgr2=0x7f8f50079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:11.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.213+0000 7f8f586c8640 1 -- 172.21.15.53:0/3796302850 shutdown_connections 2024-08-31T06:04:11.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.213+0000 7f8f586c8640 1 -- 172.21.15.53:0/3796302850 wait complete. 2024-08-31T06:04:11.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f586c8640 1 Processor -- start 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f586c8640 1 -- start start 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f586c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f50104680 0x7f8f5019c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f586c8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f501050b0 0x7f8f5019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f586c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f5010dc30 0x7f8f501a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f586c8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501136f0 con 0x7f8f5010dc30 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f586c8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50113570 con 0x7f8f50104680 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f586c8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50113870 con 0x7f8f501050b0 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f56c65640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f5010dc30 0x7f8f501a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f56c65640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f5010dc30 0x7f8f501a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50224/0 (socket says 172.21.15.53:50224) 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f56c65640 1 -- 172.21.15.53:0/2317844219 learned_addr learned my addr 172.21.15.53:0/2317844219 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.214+0000 7f8f56464640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f50104680 0x7f8f5019c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f55c63640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f501050b0 0x7f8f5019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f56c65640 1 -- 172.21.15.53:0/2317844219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f501050b0 msgr2=0x7f8f5019c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f56c65640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f501050b0 0x7f8f5019c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f56c65640 1 -- 172.21.15.53:0/2317844219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f50104680 msgr2=0x7f8f5019c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f56c65640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f50104680 0x7f8f5019c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f56c65640 1 -- 172.21.15.53:0/2317844219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f501a2230 con 0x7f8f5010dc30 2024-08-31T06:04:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f56c65640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f5010dc30 0x7f8f501a1bc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000cce0 tx=0x7f8f4000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f4f7fe640 1 -- 172.21.15.53:0/2317844219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000f450 con 0x7f8f5010dc30 2024-08-31T06:04:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f586c8640 1 -- 172.21.15.53:0/2317844219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f501a2520 con 0x7f8f5010dc30 2024-08-31T06:04:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f4f7fe640 1 -- 172.21.15.53:0/2317844219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f4000fa80 con 0x7f8f5010dc30 2024-08-31T06:04:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f4f7fe640 1 -- 172.21.15.53:0/2317844219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40018ad0 con 0x7f8f5010dc30 2024-08-31T06:04:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.215+0000 7f8f586c8640 1 -- 172.21.15.53:0/2317844219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f501a8d40 con 0x7f8f5010dc30 2024-08-31T06:04:11.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.218+0000 7f8f5ec3d740 1 Processor -- start 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.218+0000 7f8f4f7fe640 1 -- 172.21.15.53:0/2317844219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f8f4000f5f0 con 0x7f8f5010dc30 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.218+0000 7f8f5ec3d740 1 -- start start 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.218+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea0f97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.218+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d2b0a0 0x5615ea0f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.218+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea0fa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.218+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5615ea0703f0 con 0x5615e9d53f60 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.218+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5615ea05f980 con 0x5615e9d33280 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.218+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5615ea063930 con 0x5615e9d2b0a0 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.218+0000 7f8f55c63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea0f97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f55c63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea0f97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50232/0 (socket says 172.21.15.53:50232) 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f55c63640 1 -- 172.21.15.53:0/3192388316 learned_addr learned my addr 172.21.15.53:0/3192388316 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f56464640 1 --2- 172.21.15.53:0/3192388316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d2b0a0 0x5615ea0f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f55c63640 1 --2- 172.21.15.53:0/3192388316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea0fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f4f7fe640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8f380b4c40 0x7f8f380b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f55c63640 1 -- 172.21.15.53:0/3192388316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d2b0a0 msgr2=0x5615ea0f9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f55c63640 1 --2- 172.21.15.53:0/3192388316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d2b0a0 0x5615ea0f9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f55c63640 1 -- 172.21.15.53:0/3192388316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 msgr2=0x5615ea0fa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f55c63640 1 --2- 172.21.15.53:0/3192388316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea0fa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f55c63640 1 -- 172.21.15.53:0/3192388316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e9dbf540 con 0x5615e9d53f60 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f56c65640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8f380b4c40 0x7f8f380b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f4f7fe640 1 -- 172.21.15.53:0/2317844219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f8f400e5c80 con 0x7f8f5010dc30 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f55c63640 1 --2- 172.21.15.53:0/3192388316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea0f97b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400bfc0 tx=0x7f8f4400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d02cc0a5139c08a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.219+0000 7f8f4cff9640 1 -- 172.21.15.53:0/3192388316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44012860 con 0x5615e9d53f60 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.220+0000 7f8f4cff9640 1 -- 172.21.15.53:0/3192388316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f44011440 con 0x5615e9d53f60 2024-08-31T06:04:11.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.220+0000 7f8f4cff9640 1 -- 172.21.15.53:0/3192388316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400d5d0 con 0x5615e9d53f60 2024-08-31T06:04:11.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.220+0000 7f8f56c65640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8f380b4c40 0x7f8f380b7150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f400ac3e0 tx=0x7f8f40078040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:11.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.220+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/3192388316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 msgr2=0x5615ea0f97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:11.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.220+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/3192388316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea0f97b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400bfc0 tx=0x7f8f4400b410 comp rx=0 tx=0).stop 2024-08-31T06:04:11.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/3192388316 shutdown_connections 2024-08-31T06:04:11.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/3192388316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea0fa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/3192388316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d2b0a0 0x5615ea0f9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/3192388316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea0f97b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/3192388316 >> 172.21.15.53:0/3192388316 conn(0x5615e9d48350 msgr2=0x5615ea0f76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/3192388316 shutdown_connections 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/3192388316 wait complete. 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 -- start start 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 Processor -- start 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d2b0a0 0x5615ea104e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d33280 0x5615ea105390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d53f60 0x5615ea111280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5615e9ec25f0 con 0x5615e9d33280 2024-08-31T06:04:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5615e9fe6600 con 0x5615e9d2b0a0 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.221+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5615ea107f90 con 0x5615e9d53f60 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f5ec3d740 10 client.0 _ll_register_callbacks cb 0x5615ea00caf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f56464640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d33280 0x5615ea105390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f56464640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d33280 0x5615ea105390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50246/0 (socket says 172.21.15.53:50246) 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f56464640 1 -- 172.21.15.53:0/1656098597 learned_addr learned my addr 172.21.15.53:0/1656098597 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f55c63640 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d53f60 0x5615ea111280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f56464640 1 -- 172.21.15.53:0/1656098597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d53f60 msgr2=0x5615ea111280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f56464640 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d53f60 0x5615ea111280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f56464640 1 -- 172.21.15.53:0/1656098597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d2b0a0 msgr2=0x5615ea104e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f56464640 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d2b0a0 0x5615ea104e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f56464640 1 -- 172.21.15.53:0/1656098597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615ea01f7b0 con 0x5615e9d33280 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f56464640 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d33280 0x5615ea105390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8f48005940 tx=0x7f8f48031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddefdbf5e521dfd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1656098597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48035040 con 0x5615e9d33280 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1656098597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f8f48004240 con 0x5615e9d33280 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1656098597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f44011440 con 0x5615e9d33280 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1656098597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8f48004440 con 0x5615e9d33280 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f5ec3d740 10 client.15351 fetch_fsmap learned FSMap version 27 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.222+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1656098597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5615ea113c80 con 0x5615e9d33280 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.223+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1656098597 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f44011440 con 0x5615e9d33280 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.223+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1656098597 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8f4803d570 con 0x5615e9d33280 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.223+0000 7f8f5ec3d740 10 client.15351 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.223+0000 7f8f5ec3d740 10 client.15351 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.223+0000 7f8f5ec3d740 20 client.15351 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.223+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5615e9d128e0 0x5615ea1176a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.223+0000 7f8f5ec3d740 4 client.15351 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.223+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1656098597 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615ea072340 con 0x5615e9d128e0 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.223+0000 7f8f55c63640 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5615e9d128e0 0x5615ea1176a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.224+0000 7f8f55c63640 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5615e9d128e0 0x5615ea1176a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4bae6d39225111b4 server_cookie=a8cc850df3375a62 in_seq=0 out_seq=0 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.224+0000 7f8f35ffb640 10 client.15351 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1656098597 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5615ea072340 con 0x5615e9d128e0 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f35ffb640 10 client.15351 handle_command_reply: tid=0 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 1 client.15351 shutdown 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1656098597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d33280 msgr2=0x5615ea105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d33280 0x5615ea105390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8f48005940 tx=0x7f8f48031400 comp rx=0 tx=0).stop 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1656098597 shutdown_connections 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5615e9d128e0 0x5615ea1176a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d53f60 0x5615ea111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f35ffb640 0 client.15351 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:04:11.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d33280 0x5615ea105390 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1656098597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d2b0a0 0x5615ea104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1656098597 >> 172.21.15.53:0/1656098597 conn(0x5615e9d48350 msgr2=0x5615ea0fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:11.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1656098597 shutdown_connections 2024-08-31T06:04:11.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1656098597 wait complete. 2024-08-31T06:04:11.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.225+0000 7f8f5ec3d740 20 client.15351 trim_cache size 0 max 16384 2024-08-31T06:04:11.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.244+0000 7f8f5ec3d740 1 Processor -- start 2024-08-31T06:04:11.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f5ec3d740 1 -- start start 2024-08-31T06:04:11.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d2b0a0 0x5615ea1111f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea1036d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d53f60 0x5615ea103c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5615ea1159e0 con 0x5615e9d2b0a0 2024-08-31T06:04:11.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5615ea1160b0 con 0x5615e9d33280 2024-08-31T06:04:11.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5615ea116780 con 0x5615e9d53f60 2024-08-31T06:04:11.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f55c63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d2b0a0 0x5615ea1111f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f55c63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d2b0a0 0x5615ea1111f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50250/0 (socket says 172.21.15.53:50250) 2024-08-31T06:04:11.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f55c63640 1 -- 172.21.15.53:0/3663846607 learned_addr learned my addr 172.21.15.53:0/3663846607 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:11.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f56464640 1 --2- 172.21.15.53:0/3663846607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea1036d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f55c63640 1 -- 172.21.15.53:0/3663846607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d53f60 msgr2=0x5615ea103c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:11.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f55c63640 1 --2- 172.21.15.53:0/3663846607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d53f60 0x5615ea103c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f55c63640 1 -- 172.21.15.53:0/3663846607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 msgr2=0x5615ea1036d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:11.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f55c63640 1 --2- 172.21.15.53:0/3663846607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea1036d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f55c63640 1 -- 172.21.15.53:0/3663846607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615ea115800 con 0x5615e9d2b0a0 2024-08-31T06:04:11.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.245+0000 7f8f55c63640 1 --2- 172.21.15.53:0/3663846607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d2b0a0 0x5615ea1111f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8f440058c0 tx=0x7f8f44011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3dc97fd1fb8e4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:11.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.247+0000 7f8f37fff640 1 -- 172.21.15.53:0/3663846607 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4402b020 con 0x5615e9d2b0a0 2024-08-31T06:04:11.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.247+0000 7f8f37fff640 1 -- 172.21.15.53:0/3663846607 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f440054c0 con 0x5615e9d2b0a0 2024-08-31T06:04:11.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.247+0000 7f8f37fff640 1 -- 172.21.15.53:0/3663846607 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44012d60 con 0x5615e9d2b0a0 2024-08-31T06:04:11.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.248+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/3663846607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d2b0a0 msgr2=0x5615ea1111f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:11.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.248+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/3663846607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d2b0a0 0x5615ea1111f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8f440058c0 tx=0x7f8f44011e90 comp rx=0 tx=0).stop 2024-08-31T06:04:11.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.248+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/3663846607 shutdown_connections 2024-08-31T06:04:11.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.248+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/3663846607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d53f60 0x5615ea103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.248+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/3663846607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea1036d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.248+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/3663846607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d2b0a0 0x5615ea1111f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.248+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/3663846607 >> 172.21.15.53:0/3663846607 conn(0x5615e9d48350 msgr2=0x5615ea1150f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:11.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.248+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/3663846607 shutdown_connections 2024-08-31T06:04:11.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.248+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/3663846607 wait complete. 2024-08-31T06:04:11.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f5ec3d740 1 -- start start 2024-08-31T06:04:11.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f5ec3d740 1 Processor -- start 2024-08-31T06:04:11.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d2b0a0 0x5615ea11fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea119370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f5ec3d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea1198b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5615ea117520 con 0x5615e9d53f60 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5615ea116e50 con 0x5615e9d33280 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f5ec3d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5615ea117bf0 con 0x5615e9d2b0a0 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f5ec3d740 10 client.0 _ll_register_callbacks cb 0x7f8f48031b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f55c63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea1198b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f55c63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea1198b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50266/0 (socket says 172.21.15.53:50266) 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f55c63640 1 -- 172.21.15.53:0/1334305569 learned_addr learned my addr 172.21.15.53:0/1334305569 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f55c63640 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d2b0a0 0x5615ea11fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f55c63640 1 -- 172.21.15.53:0/1334305569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d2b0a0 msgr2=0x5615ea11fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:11.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f55c63640 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d2b0a0 0x5615ea11fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f56464640 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea119370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f55c63640 1 -- 172.21.15.53:0/1334305569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 msgr2=0x5615ea119370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f55c63640 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea119370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.249+0000 7f8f55c63640 1 -- 172.21.15.53:0/1334305569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615ea119df0 con 0x5615e9d53f60 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.250+0000 7f8f56464640 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea119370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.250+0000 7f8f55c63640 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea1198b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400ffd0 tx=0x7f8f44012a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefb7ad54492d86 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.250+0000 7f8f35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.250+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1334305569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44037060 con 0x5615e9d53f60 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.250+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1334305569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7f8f44012b20 con 0x5615e9d53f60 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.250+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1334305569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f440054c0 con 0x5615e9d53f60 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.250+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1334305569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8f4402b070 con 0x5615e9d53f60 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.250+0000 7f8f5ec3d740 10 client.15357 fetch_fsmap learned FSMap version 27 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.250+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1334305569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5615ea11f7b0 con 0x5615e9d53f60 2024-08-31T06:04:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.250+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1334305569 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f440054c0 con 0x5615e9d53f60 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.250+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1334305569 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8f44026040 con 0x5615e9d53f60 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.251+0000 7f8f5ec3d740 10 client.15357 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.251+0000 7f8f5ec3d740 10 client.15357 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.251+0000 7f8f5ec3d740 20 client.15357 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.251+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5615e9ce7c90 0x5615ea1859c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.251+0000 7f8f5ec3d740 4 client.15357 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.251+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1334305569 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "status"}) -- 0x5615ea06dde0 con 0x5615e9ce7c90 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.251+0000 7f8f56464640 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5615e9ce7c90 0x5615ea1859c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.251+0000 7f8f35ffb640 10 client.15357 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.251+0000 7f8f56464640 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5615e9ce7c90 0x5615ea1859c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6d03886f51d836cc server_cookie=de2e80610526336e in_seq=0 out_seq=0 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f35ffb640 1 -- 172.21.15.53:0/1334305569 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5615ea06dde0 con 0x5615e9ce7c90 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f35ffb640 10 client.15357 handle_command_reply: tid=0 2024-08-31T06:04:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 1 client.15357 shutdown 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1334305569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 msgr2=0x5615ea1198b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea1198b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400ffd0 tx=0x7f8f44012a40 comp rx=0 tx=0).stop 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1334305569 shutdown_connections 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615e9d53f60 0x5615ea1198b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615e9d33280 0x5615ea119370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5615e9ce7c90 0x5615ea1859c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 1 --2- 172.21.15.53:0/1334305569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615e9d2b0a0 0x5615ea11fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1334305569 >> 172.21.15.53:0/1334305569 conn(0x5615e9d48350 msgr2=0x5615ea1150f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f35ffb640 0 client.15357 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1334305569 shutdown_connections 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 1 -- 172.21.15.53:0/1334305569 wait complete. 2024-08-31T06:04:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f5ec3d740 20 client.15357 trim_cache size 0 max 16384 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 4, 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24613, 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 89.591579616999994, 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 27, 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 72, 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 70, 2024-08-31T06:04:11.259 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 127.532927903 2024-08-31T06:04:11.260 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:11.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.252+0000 7f8f586c8640 1 -- 172.21.15.53:0/2317844219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8f380b4c40 msgr2=0x7f8f380b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:11.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.253+0000 7f8f586c8640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8f380b4c40 0x7f8f380b7150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f400ac3e0 tx=0x7f8f40078040 comp rx=0 tx=0).stop 2024-08-31T06:04:11.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.253+0000 7f8f586c8640 1 -- 172.21.15.53:0/2317844219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f5010dc30 msgr2=0x7f8f501a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:11.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.253+0000 7f8f586c8640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f5010dc30 0x7f8f501a1bc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000cce0 tx=0x7f8f4000a620 comp rx=0 tx=0).stop 2024-08-31T06:04:11.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.253+0000 7f8f586c8640 1 -- 172.21.15.53:0/2317844219 shutdown_connections 2024-08-31T06:04:11.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.253+0000 7f8f586c8640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8f380b4c40 0x7f8f380b7150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.253+0000 7f8f586c8640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f5010dc30 0x7f8f501a1bc0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.253+0000 7f8f586c8640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f501050b0 0x7f8f5019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.253+0000 7f8f586c8640 1 --2- 172.21.15.53:0/2317844219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f50104680 0x7f8f5019c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:11.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.253+0000 7f8f586c8640 1 -- 172.21.15.53:0/2317844219 >> 172.21.15.53:0/2317844219 conn(0x7f8f50079530 msgr2=0x7f8f50109c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:11.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.253+0000 7f8f586c8640 1 -- 172.21.15.53:0/2317844219 shutdown_connections 2024-08-31T06:04:11.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:11.253+0000 7f8f586c8640 1 -- 172.21.15.53:0/2317844219 wait complete. 2024-08-31T06:04:11.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:11 smithi053 ceph-mon[18924]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:04:11.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:11 smithi130 ceph-mon[22266]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:04:11.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:11 smithi153 ceph-mon[22320]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:04:12.059 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.c status 2024-08-31T06:04:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:12.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.772+0000 7fe933cd2640 1 -- 172.21.15.53:0/2883098671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe92c109b90 msgr2=0x7fe92c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:12.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.772+0000 7fe933cd2640 1 --2- 172.21.15.53:0/2883098671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe92c109b90 0x7fe92c1103c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe924009ca0 tx=0x7fe92402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.772+0000 7fe933cd2640 1 -- 172.21.15.53:0/2883098671 shutdown_connections 2024-08-31T06:04:12.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.772+0000 7fe933cd2640 1 --2- 172.21.15.53:0/2883098671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe92c109b90 0x7fe92c1103c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.772+0000 7fe933cd2640 1 --2- 172.21.15.53:0/2883098671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe92c109240 0x7fe92c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.772+0000 7fe933cd2640 1 --2- 172.21.15.53:0/2883098671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe92c103900 0x7fe92c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.772+0000 7fe933cd2640 1 -- 172.21.15.53:0/2883098671 >> 172.21.15.53:0/2883098671 conn(0x7fe92c07b5f0 msgr2=0x7fe92c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:12.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.772+0000 7fe933cd2640 1 -- 172.21.15.53:0/2883098671 shutdown_connections 2024-08-31T06:04:12.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.772+0000 7fe933cd2640 1 -- 172.21.15.53:0/2883098671 wait complete. 2024-08-31T06:04:12.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.773+0000 7fe933cd2640 1 Processor -- start 2024-08-31T06:04:12.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.773+0000 7fe933cd2640 1 -- start start 2024-08-31T06:04:12.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.773+0000 7fe933cd2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe92c103900 0x7fe92c19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.773+0000 7fe933cd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe92c109240 0x7fe92c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.773+0000 7fe933cd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe92c109b90 0x7fe92c19f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.773+0000 7fe933cd2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c113750 con 0x7fe92c109b90 2024-08-31T06:04:12.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.773+0000 7fe933cd2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c1135d0 con 0x7fe92c109240 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.773+0000 7fe933cd2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c1138d0 con 0x7fe92c103900 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.773+0000 7fe93226f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe92c109b90 0x7fe92c19f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.773+0000 7fe93226f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe92c109b90 0x7fe92c19f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50292/0 (socket says 172.21.15.53:50292) 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe93226f640 1 -- 172.21.15.53:0/3671802881 learned_addr learned my addr 172.21.15.53:0/3671802881 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe931a6e640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe92c103900 0x7fe92c19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe93126d640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe92c109240 0x7fe92c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe93226f640 1 -- 172.21.15.53:0/3671802881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe92c103900 msgr2=0x7fe92c19a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe93226f640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe92c103900 0x7fe92c19a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe93226f640 1 -- 172.21.15.53:0/3671802881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe92c109240 msgr2=0x7fe92c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe93226f640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe92c109240 0x7fe92c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe93226f640 1 -- 172.21.15.53:0/3671802881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c1a0110 con 0x7fe92c109b90 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe931a6e640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe92c103900 0x7fe92c19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe93226f640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe92c109b90 0x7fe92c19f9e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe924005cc0 tx=0x7fe924032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe922ffd640 1 -- 172.21.15.53:0/3671802881 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924032e00 con 0x7fe92c109b90 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe922ffd640 1 -- 172.21.15.53:0/3671802881 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9240044d0 con 0x7fe92c109b90 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe922ffd640 1 -- 172.21.15.53:0/3671802881 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924030b70 con 0x7fe92c109b90 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe933cd2640 1 -- 172.21.15.53:0/3671802881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92c1a03a0 con 0x7fe92c109b90 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.774+0000 7fe933cd2640 1 -- 172.21.15.53:0/3671802881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92c1a6b60 con 0x7fe92c109b90 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.777+0000 7fe93a247740 1 Processor -- start 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.777+0000 7fe922ffd640 1 -- 172.21.15.53:0/3671802881 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fe924004680 con 0x7fe92c109b90 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.777+0000 7fe93a247740 1 -- start start 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.777+0000 7fe93a247740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d5c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.777+0000 7fe93a247740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d5ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.777+0000 7fe93a247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d7996280 0x55a6d7d5d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.777+0000 7fe93a247740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7cd33f0 con 0x55a6d798e0a0 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.777+0000 7fe93a247740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7cc2980 con 0x55a6d79b6f60 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.777+0000 7fe93a247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7cc6930 con 0x55a6d7996280 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.777+0000 7fe931a6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d5ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe931a6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d5ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50300/0 (socket says 172.21.15.53:50300) 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe931a6e640 1 -- 172.21.15.53:0/3844448367 learned_addr learned my addr 172.21.15.53:0/3844448367 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe93126d640 1 --2- 172.21.15.53:0/3844448367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d5c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe922ffd640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9180b4c90 0x7fe9180b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe93126d640 1 --2- 172.21.15.53:0/3844448367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d7996280 0x55a6d7d5d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe931a6e640 1 -- 172.21.15.53:0/3844448367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d7996280 msgr2=0x55a6d7d5d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe931a6e640 1 --2- 172.21.15.53:0/3844448367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d7996280 0x55a6d7d5d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe931a6e640 1 -- 172.21.15.53:0/3844448367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 msgr2=0x55a6d7d5c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe931a6e640 1 --2- 172.21.15.53:0/3844448367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d5c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe931a6e640 1 -- 172.21.15.53:0/3844448367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6d7a22540 con 0x55a6d798e0a0 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe93226f640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9180b4c90 0x7fe9180b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe922ffd640 1 -- 172.21.15.53:0/3671802881 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fe9241068c0 con 0x7fe92c109b90 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe931a6e640 1 --2- 172.21.15.53:0/3844448367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d5ccf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe92800bcc0 tx=0x7fe92800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefbaa75dcfc68ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe917fff640 1 -- 172.21.15.53:0/3844448367 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928005020 con 0x55a6d798e0a0 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe917fff640 1 -- 172.21.15.53:0/3844448367 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9280047a0 con 0x55a6d798e0a0 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe917fff640 1 -- 172.21.15.53:0/3844448367 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928011680 con 0x55a6d798e0a0 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.778+0000 7fe93226f640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9180b4c90 0x7fe9180b71a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe9240ccd90 tx=0x7fe92409a640 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.779+0000 7fe93a247740 1 -- 172.21.15.53:0/3844448367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 msgr2=0x55a6d7d5ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.779+0000 7fe93a247740 1 --2- 172.21.15.53:0/3844448367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d5ccf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe92800bcc0 tx=0x7fe92800f730 comp rx=0 tx=0).stop 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.779+0000 7fe93a247740 1 -- 172.21.15.53:0/3844448367 shutdown_connections 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.779+0000 7fe93a247740 1 --2- 172.21.15.53:0/3844448367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d7996280 0x55a6d7d5d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.779+0000 7fe93a247740 1 --2- 172.21.15.53:0/3844448367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d5ccf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.779+0000 7fe93a247740 1 --2- 172.21.15.53:0/3844448367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d5c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.779+0000 7fe93a247740 1 -- 172.21.15.53:0/3844448367 >> 172.21.15.53:0/3844448367 conn(0x55a6d79ab350 msgr2=0x55a6d7d5a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.779+0000 7fe93a247740 1 -- 172.21.15.53:0/3844448367 shutdown_connections 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.779+0000 7fe93a247740 1 -- 172.21.15.53:0/3844448367 wait complete. 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93a247740 1 -- start start 2024-08-31T06:04:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93a247740 1 Processor -- start 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93a247740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d67e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93a247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d7996280 0x55a6d7d68340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93a247740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93a247740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7b255f0 con 0x55a6d798e0a0 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93a247740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7c49600 con 0x55a6d79b6f60 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93a247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7d6af90 con 0x55a6d7996280 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93a247740 10 client.0 _ll_register_callbacks cb 0x55a6d7c6faf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93126d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d67e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93126d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d67e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50314/0 (socket says 172.21.15.53:50314) 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.780+0000 7fe93126d640 1 -- 172.21.15.53:0/3693601215 learned_addr learned my addr 172.21.15.53:0/3693601215 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe931a6e640 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d7996280 0x55a6d7d68340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe93126d640 1 -- 172.21.15.53:0/3693601215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d7996280 msgr2=0x55a6d7d68340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe93126d640 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d7996280 0x55a6d7d68340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe93126d640 1 -- 172.21.15.53:0/3693601215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 msgr2=0x55a6d7d688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe93126d640 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe93126d640 1 -- 172.21.15.53:0/3693601215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6d7c827b0 con 0x55a6d798e0a0 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe931a6e640 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d7996280 0x55a6d7d68340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe93126d640 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d67e00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00e620 tx=0x7fe91c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9cc380a95c45b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe9157fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe9157fa640 1 -- 172.21.15.53:0/3693601215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c012860 con 0x55a6d798e0a0 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe9157fa640 1 -- 172.21.15.53:0/3693601215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fe91c012a00 con 0x55a6d798e0a0 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe93a247740 1 -- 172.21.15.53:0/3693601215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9280047a0 con 0x55a6d798e0a0 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe9157fa640 1 -- 172.21.15.53:0/3693601215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe91c012c00 con 0x55a6d798e0a0 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe93a247740 10 client.15369 fetch_fsmap learned FSMap version 27 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.781+0000 7fe93a247740 1 -- 172.21.15.53:0/3693601215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a6d7d76ca0 con 0x55a6d798e0a0 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.782+0000 7fe9157fa640 1 -- 172.21.15.53:0/3693601215 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9280047a0 con 0x55a6d798e0a0 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.782+0000 7fe9157fa640 1 -- 172.21.15.53:0/3693601215 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe91c019070 con 0x55a6d798e0a0 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.782+0000 7fe93a247740 10 client.15369 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:04:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.782+0000 7fe93a247740 10 client.15369 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T06:04:12.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.782+0000 7fe93a247740 20 client.15369 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:12.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.782+0000 7fe93a247740 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55a6d79758e0 0x55a6d7d7a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.782+0000 7fe93a247740 4 client.15369 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:12.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.782+0000 7fe93a247740 1 -- 172.21.15.53:0/3693601215 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6d7cd5340 con 0x55a6d79758e0 2024-08-31T06:04:12.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.782+0000 7fe931a6e640 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55a6d79758e0 0x55a6d7d7a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.783+0000 7fe9157fa640 10 client.15369 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:04:12.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.783+0000 7fe931a6e640 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55a6d79758e0 0x55a6d7d7a7a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3584e8077b27a2dd server_cookie=68e510bc89c8ffd4 in_seq=0 out_seq=0 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe9157fa640 1 -- 172.21.15.53:0/3693601215 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a6d7cd5340 con 0x55a6d79758e0 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe9157fa640 10 client.15369 handle_command_reply: tid=0 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe93a247740 1 client.15369 shutdown 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe93a247740 1 -- 172.21.15.53:0/3693601215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 msgr2=0x55a6d7d67e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe93a247740 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d67e00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00e620 tx=0x7fe91c0039c0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe93a247740 1 -- 172.21.15.53:0/3693601215 shutdown_connections 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe93a247740 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe93a247740 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d7996280 0x55a6d7d68340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe93a247740 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55a6d79758e0 0x55a6d7d7a7a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe93a247740 1 --2- 172.21.15.53:0/3693601215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d798e0a0 0x55a6d7d67e00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe93a247740 1 -- 172.21.15.53:0/3693601215 >> 172.21.15.53:0/3693601215 conn(0x55a6d79ab350 msgr2=0x55a6d7d5f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe9157fa640 0 client.15369 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:04:12.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe93a247740 1 -- 172.21.15.53:0/3693601215 shutdown_connections 2024-08-31T06:04:12.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.784+0000 7fe93a247740 1 -- 172.21.15.53:0/3693601215 wait complete. 2024-08-31T06:04:12.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.785+0000 7fe93a247740 20 client.15369 trim_cache size 0 max 16384 2024-08-31T06:04:12.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93a247740 1 Processor -- start 2024-08-31T06:04:12.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93a247740 1 -- start start 2024-08-31T06:04:12.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93a247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d798e0a0 0x55a6d7d55400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93a247740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d7996280 0x55a6d7d66680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93a247740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d79b6f60 0x55a6d7d66bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93a247740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7d78ae0 con 0x55a6d79b6f60 2024-08-31T06:04:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93a247740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7d791b0 con 0x55a6d7996280 2024-08-31T06:04:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93a247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7d79880 con 0x55a6d798e0a0 2024-08-31T06:04:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93126d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d79b6f60 0x55a6d7d66bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93126d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d79b6f60 0x55a6d7d66bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50324/0 (socket says 172.21.15.53:50324) 2024-08-31T06:04:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93126d640 1 -- 172.21.15.53:0/3835322830 learned_addr learned my addr 172.21.15.53:0/3835322830 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93126d640 1 --2- 172.21.15.53:0/3835322830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d798e0a0 0x55a6d7d55400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe931a6e640 1 --2- 172.21.15.53:0/3835322830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d7996280 0x55a6d7d66680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93126d640 1 -- 172.21.15.53:0/3835322830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d798e0a0 msgr2=0x55a6d7d55400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:12.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.803+0000 7fe93126d640 1 --2- 172.21.15.53:0/3835322830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d798e0a0 0x55a6d7d55400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.804+0000 7fe93126d640 1 -- 172.21.15.53:0/3835322830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d7996280 msgr2=0x55a6d7d66680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:12.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.804+0000 7fe93126d640 1 --2- 172.21.15.53:0/3835322830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d7996280 0x55a6d7d66680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.804+0000 7fe93126d640 1 -- 172.21.15.53:0/3835322830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6d7d5af90 con 0x55a6d79b6f60 2024-08-31T06:04:12.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.804+0000 7fe93126d640 1 --2- 172.21.15.53:0/3835322830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d79b6f60 0x55a6d7d66bc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe91c005f50 tx=0x7fe91c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d6dfd506aa6d63 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:12.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.804+0000 7fe9177fe640 1 -- 172.21.15.53:0/3835322830 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c027040 con 0x55a6d79b6f60 2024-08-31T06:04:12.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.804+0000 7fe9177fe640 1 -- 172.21.15.53:0/3835322830 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe91c010de0 con 0x55a6d79b6f60 2024-08-31T06:04:12.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.804+0000 7fe9177fe640 1 -- 172.21.15.53:0/3835322830 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c01b8d0 con 0x55a6d79b6f60 2024-08-31T06:04:12.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.805+0000 7fe93a247740 1 -- 172.21.15.53:0/3835322830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d79b6f60 msgr2=0x55a6d7d66bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:12.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.805+0000 7fe93a247740 1 --2- 172.21.15.53:0/3835322830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d79b6f60 0x55a6d7d66bc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe91c005f50 tx=0x7fe91c0046c0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.805+0000 7fe93a247740 1 -- 172.21.15.53:0/3835322830 shutdown_connections 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.805+0000 7fe93a247740 1 --2- 172.21.15.53:0/3835322830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d79b6f60 0x55a6d7d66bc0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.805+0000 7fe93a247740 1 --2- 172.21.15.53:0/3835322830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d7996280 0x55a6d7d66680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.805+0000 7fe93a247740 1 --2- 172.21.15.53:0/3835322830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d798e0a0 0x55a6d7d55400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.805+0000 7fe93a247740 1 -- 172.21.15.53:0/3835322830 >> 172.21.15.53:0/3835322830 conn(0x55a6d79ab350 msgr2=0x55a6d7d62fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.805+0000 7fe93a247740 1 -- 172.21.15.53:0/3835322830 shutdown_connections 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.805+0000 7fe93a247740 1 -- 172.21.15.53:0/3835322830 wait complete. 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.805+0000 7fe93a247740 1 -- start start 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.805+0000 7fe93a247740 1 Processor -- start 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe93a247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d798e0a0 0x55a6d7d7d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe93a247740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d7996280 0x55a6d7d7d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe93a247740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d81ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe93a247740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7d7a620 con 0x55a6d7996280 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe93a247740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7d79f50 con 0x55a6d79b6f60 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe93a247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a6d7d7acf0 con 0x55a6d798e0a0 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe93a247740 10 client.0 _ll_register_callbacks cb 0x7fe91c00e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe931a6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d7996280 0x55a6d7d7d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe931a6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d7996280 0x55a6d7d7d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50340/0 (socket says 172.21.15.53:50340) 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe931a6e640 1 -- 172.21.15.53:0/2947331342 learned_addr learned my addr 172.21.15.53:0/2947331342 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe93126d640 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d81ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe93126d640 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d798e0a0 0x55a6d7d7d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe931a6e640 1 -- 172.21.15.53:0/2947331342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d798e0a0 msgr2=0x55a6d7d7d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe931a6e640 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d798e0a0 0x55a6d7d7d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe931a6e640 1 -- 172.21.15.53:0/2947331342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 msgr2=0x55a6d7d81ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe931a6e640 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d81ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe931a6e640 1 -- 172.21.15.53:0/2947331342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6d7d82550 con 0x55a6d7996280 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe93126d640 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d81ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe931a6e640 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d7996280 0x55a6d7d7d650 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe92800bfd0 tx=0x7fe92800b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f614c4fbc53449 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.806+0000 7fe9157fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe9157fa640 1 -- 172.21.15.53:0/2947331342 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928004450 con 0x55a6d7996280 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe9157fa640 1 -- 172.21.15.53:0/2947331342 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fe9280045f0 con 0x55a6d7996280 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe93a247740 1 -- 172.21.15.53:0/2947331342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe91c010de0 con 0x55a6d7996280 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe9157fa640 1 -- 172.21.15.53:0/2947331342 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe928034050 con 0x55a6d7996280 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe93a247740 10 client.15375 fetch_fsmap learned FSMap version 27 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe93a247740 1 -- 172.21.15.53:0/2947331342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a6d7d837b0 con 0x55a6d7996280 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe9157fa640 1 -- 172.21.15.53:0/2947331342 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe91c010de0 con 0x55a6d7996280 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe9157fa640 1 -- 172.21.15.53:0/2947331342 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe928011560 con 0x55a6d7996280 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe93a247740 10 client.15375 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe93a247740 10 client.15375 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T06:04:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe93a247740 20 client.15375 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe93a247740 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55a6d794ac90 0x55a6d7de9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe93a247740 4 client.15375 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.807+0000 7fe93a247740 1 -- 172.21.15.53:0/2947331342 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "status"}) -- 0x55a6d7d78930 con 0x55a6d794ac90 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.808+0000 7fe93126d640 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55a6d794ac90 0x55a6d7de9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.808+0000 7fe9157fa640 10 client.15375 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.808+0000 7fe93126d640 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55a6d794ac90 0x55a6d7de9040 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c9491a7097ac94fa server_cookie=b936d7951a2e5b3e in_seq=0 out_seq=0 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.808+0000 7fe9157fa640 1 -- 172.21.15.53:0/2947331342 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a6d7d78930 con 0x55a6d794ac90 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.808+0000 7fe9157fa640 10 client.15375 handle_command_reply: tid=0 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.808+0000 7fe93a247740 1 client.15375 shutdown 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.808+0000 7fe93a247740 1 -- 172.21.15.53:0/2947331342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d7996280 msgr2=0x55a6d7d7d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.808+0000 7fe93a247740 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d7996280 0x55a6d7d7d650 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe92800bfd0 tx=0x7fe92800b560 comp rx=0 tx=0).stop 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe93a247740 1 -- 172.21.15.53:0/2947331342 shutdown_connections 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe93a247740 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a6d79b6f60 0x55a6d7d81ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe93a247740 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55a6d794ac90 0x55a6d7de9040 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe93a247740 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a6d7996280 0x55a6d7d7d650 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe9157fa640 0 client.15375 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:04:12.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe93a247740 1 --2- 172.21.15.53:0/2947331342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a6d798e0a0 0x55a6d7d7d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe93a247740 1 -- 172.21.15.53:0/2947331342 >> 172.21.15.53:0/2947331342 conn(0x55a6d79ab350 msgr2=0x55a6d7d5d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:12.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe93a247740 1 -- 172.21.15.53:0/2947331342 shutdown_connections 2024-08-31T06:04:12.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe93a247740 1 -- 172.21.15.53:0/2947331342 wait complete. 2024-08-31T06:04:12.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe93a247740 20 client.15375 trim_cache size 0 max 16384 2024-08-31T06:04:12.816 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:12.816 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:04:12.816 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 3, 2024-08-31T06:04:12.816 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24619, 2024-08-31T06:04:12.817 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:04:12.817 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:04:12.817 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:04:12.817 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 92.155343032999994, 2024-08-31T06:04:12.817 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 27, 2024-08-31T06:04:12.817 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 72, 2024-08-31T06:04:12.817 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 70, 2024-08-31T06:04:12.817 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 126.594708696 2024-08-31T06:04:12.817 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe933cd2640 1 -- 172.21.15.53:0/3671802881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9180b4c90 msgr2=0x7fe9180b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe933cd2640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9180b4c90 0x7fe9180b71a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe9240ccd90 tx=0x7fe92409a640 comp rx=0 tx=0).stop 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe933cd2640 1 -- 172.21.15.53:0/3671802881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe92c109b90 msgr2=0x7fe92c19f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.809+0000 7fe933cd2640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe92c109b90 0x7fe92c19f9e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe924005cc0 tx=0x7fe924032a10 comp rx=0 tx=0).stop 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.810+0000 7fe933cd2640 1 -- 172.21.15.53:0/3671802881 shutdown_connections 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.810+0000 7fe933cd2640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9180b4c90 0x7fe9180b71a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.810+0000 7fe933cd2640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe92c109b90 0x7fe92c19f9e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.810+0000 7fe933cd2640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe92c109240 0x7fe92c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.810+0000 7fe933cd2640 1 --2- 172.21.15.53:0/3671802881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe92c103900 0x7fe92c19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.810+0000 7fe933cd2640 1 -- 172.21.15.53:0/3671802881 >> 172.21.15.53:0/3671802881 conn(0x7fe92c07b5f0 msgr2=0x7fe92c107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.810+0000 7fe933cd2640 1 -- 172.21.15.53:0/3671802881 shutdown_connections 2024-08-31T06:04:12.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:12.810+0000 7fe933cd2640 1 -- 172.21.15.53:0/3671802881 wait complete. 2024-08-31T06:04:13.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:13 smithi053 ceph-mon[18924]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:04:13.557 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T06:04:13.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:13 smithi153 ceph-mon[22320]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:04:13.817 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:13.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:13 smithi130 ceph-mon[22266]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:04:14.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.256+0000 7fb8541d9640 1 -- 172.21.15.53:0/703430542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84c103930 msgr2=0x7fb84c103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:14.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.256+0000 7fb8541d9640 1 --2- 172.21.15.53:0/703430542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84c103930 0x7fb84c103d40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb848009900 tx=0x7fb84802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:14.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.256+0000 7fb8541d9640 1 -- 172.21.15.53:0/703430542 shutdown_connections 2024-08-31T06:04:14.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.256+0000 7fb8541d9640 1 --2- 172.21.15.53:0/703430542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb84c109bc0 0x7fb84c1103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.256+0000 7fb8541d9640 1 --2- 172.21.15.53:0/703430542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb84c109270 0x7fb84c109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.256+0000 7fb8541d9640 1 --2- 172.21.15.53:0/703430542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84c103930 0x7fb84c103d40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.256+0000 7fb8541d9640 1 -- 172.21.15.53:0/703430542 >> 172.21.15.53:0/703430542 conn(0x7fb84c0ff3a0 msgr2=0x7fb84c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:14.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.256+0000 7fb8541d9640 1 -- 172.21.15.53:0/703430542 shutdown_connections 2024-08-31T06:04:14.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.256+0000 7fb8541d9640 1 -- 172.21.15.53:0/703430542 wait complete. 2024-08-31T06:04:14.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb8541d9640 1 Processor -- start 2024-08-31T06:04:14.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb8541d9640 1 -- start start 2024-08-31T06:04:14.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb8541d9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb84c103930 0x7fb84c19c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb8541d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84c109270 0x7fb84c19c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb8541d9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb84c109bc0 0x7fb84c1a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb8541d9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c113730 con 0x7fb84c109270 2024-08-31T06:04:14.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb8541d9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c1135b0 con 0x7fb84c109bc0 2024-08-31T06:04:14.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb8541d9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c1138b0 con 0x7fb84c103930 2024-08-31T06:04:14.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb851774640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84c109270 0x7fb84c19c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb851774640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84c109270 0x7fb84c19c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40752/0 (socket says 172.21.15.53:40752) 2024-08-31T06:04:14.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb851774640 1 -- 172.21.15.53:0/1232938088 learned_addr learned my addr 172.21.15.53:0/1232938088 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:14.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb851f75640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb84c103930 0x7fb84c19c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb852776640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb84c109bc0 0x7fb84c1a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb851774640 1 -- 172.21.15.53:0/1232938088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb84c103930 msgr2=0x7fb84c19c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:14.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.257+0000 7fb851774640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb84c103930 0x7fb84c19c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.258+0000 7fb851774640 1 -- 172.21.15.53:0/1232938088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb84c109bc0 msgr2=0x7fb84c1a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:14.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.258+0000 7fb851774640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb84c109bc0 0x7fb84c1a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.258+0000 7fb851774640 1 -- 172.21.15.53:0/1232938088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84c1a2230 con 0x7fb84c109270 2024-08-31T06:04:14.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.258+0000 7fb852776640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb84c109bc0 0x7fb84c1a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:14.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.258+0000 7fb851774640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84c109270 0x7fb84c19c920 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00c8c0 tx=0x7fb83c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.258+0000 7fb842ffd640 1 -- 172.21.15.53:0/1232938088 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c007bb0 con 0x7fb84c109270 2024-08-31T06:04:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.258+0000 7fb842ffd640 1 -- 172.21.15.53:0/1232938088 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb83c007d50 con 0x7fb84c109270 2024-08-31T06:04:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.258+0000 7fb842ffd640 1 -- 172.21.15.53:0/1232938088 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0186a0 con 0x7fb84c109270 2024-08-31T06:04:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.258+0000 7fb8541d9640 1 -- 172.21.15.53:0/1232938088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84c1a2520 con 0x7fb84c109270 2024-08-31T06:04:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.258+0000 7fb8541d9640 1 -- 172.21.15.53:0/1232938088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb84c1a8d40 con 0x7fb84c109270 2024-08-31T06:04:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.260+0000 7fb85a74e740 1 Processor -- start 2024-08-31T06:04:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb85a74e740 1 -- start start 2024-08-31T06:04:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb842ffd640 1 -- 172.21.15.53:0/1232938088 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fb83c00fa00 con 0x7fb84c109270 2024-08-31T06:04:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25dbf60 0x55ecc29817b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc2981cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc2982230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb85a74e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ecc28f83f0 con 0x55ecc25dbf60 2024-08-31T06:04:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb85a74e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ecc28e7980 con 0x55ecc25bb280 2024-08-31T06:04:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb85a74e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ecc28eb930 con 0x55ecc25b30a0 2024-08-31T06:04:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb852776640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25dbf60 0x55ecc29817b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb852776640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25dbf60 0x55ecc29817b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40766/0 (socket says 172.21.15.53:40766) 2024-08-31T06:04:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb852776640 1 -- 172.21.15.53:0/4247196951 learned_addr learned my addr 172.21.15.53:0/4247196951 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb851f75640 1 --2- 172.21.15.53:0/4247196951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc2981cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb851774640 1 --2- 172.21.15.53:0/4247196951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc2982230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb852776640 1 -- 172.21.15.53:0/4247196951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 msgr2=0x55ecc2981cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb852776640 1 --2- 172.21.15.53:0/4247196951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc2981cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb852776640 1 -- 172.21.15.53:0/4247196951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 msgr2=0x55ecc2982230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb852776640 1 --2- 172.21.15.53:0/4247196951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc2982230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.261+0000 7fb852776640 1 -- 172.21.15.53:0/4247196951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc2647540 con 0x55ecc25dbf60 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.262+0000 7fb852776640 1 --2- 172.21.15.53:0/4247196951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25dbf60 0x55ecc29817b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb844009ea0 tx=0x7fb844009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ca3c699f601c08 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.262+0000 7fb842ffd640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8380b4c40 0x7fb8380b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.262+0000 7fb837fff640 1 -- 172.21.15.53:0/4247196951 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844004d20 con 0x55ecc25dbf60 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.262+0000 7fb837fff640 1 -- 172.21.15.53:0/4247196951 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8440054b0 con 0x55ecc25dbf60 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.262+0000 7fb837fff640 1 -- 172.21.15.53:0/4247196951 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8440116f0 con 0x55ecc25dbf60 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.262+0000 7fb851f75640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8380b4c40 0x7fb8380b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.262+0000 7fb842ffd640 1 -- 172.21.15.53:0/1232938088 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fb83c0e5580 con 0x7fb84c109270 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.263+0000 7fb85a74e740 1 -- 172.21.15.53:0/4247196951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25dbf60 msgr2=0x55ecc29817b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.263+0000 7fb85a74e740 1 --2- 172.21.15.53:0/4247196951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25dbf60 0x55ecc29817b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb844009ea0 tx=0x7fb844009f90 comp rx=0 tx=0).stop 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.263+0000 7fb851f75640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8380b4c40 0x7fb8380b7150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb848000c00 tx=0x7fb848009640 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.263+0000 7fb85a74e740 1 -- 172.21.15.53:0/4247196951 shutdown_connections 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.263+0000 7fb85a74e740 1 --2- 172.21.15.53:0/4247196951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc2982230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.263+0000 7fb85a74e740 1 --2- 172.21.15.53:0/4247196951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc2981cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.263+0000 7fb85a74e740 1 --2- 172.21.15.53:0/4247196951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25dbf60 0x55ecc29817b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.263+0000 7fb85a74e740 1 -- 172.21.15.53:0/4247196951 >> 172.21.15.53:0/4247196951 conn(0x55ecc25d0350 msgr2=0x55ecc297f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.263+0000 7fb85a74e740 1 -- 172.21.15.53:0/4247196951 shutdown_connections 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.263+0000 7fb85a74e740 1 -- 172.21.15.53:0/4247196951 wait complete. 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb85a74e740 1 -- start start 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb85a74e740 1 Processor -- start 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc298ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25bb280 0x55ecc298d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25dbf60 0x55ecc2999280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb85a74e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ecc274a5f0 con 0x55ecc25bb280 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb85a74e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ecc286e600 con 0x55ecc25dbf60 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb85a74e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ecc298ff90 con 0x55ecc25b30a0 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb85a74e740 10 client.0 _ll_register_callbacks cb 0x55ecc2894af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb851774640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25bb280 0x55ecc298d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb851774640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25bb280 0x55ecc298d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40778/0 (socket says 172.21.15.53:40778) 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.264+0000 7fb851774640 1 -- 172.21.15.53:0/112712434 learned_addr learned my addr 172.21.15.53:0/112712434 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb852776640 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25dbf60 0x55ecc2999280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb851f75640 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc298ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb851774640 1 -- 172.21.15.53:0/112712434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 msgr2=0x55ecc298ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb851774640 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc298ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb851774640 1 -- 172.21.15.53:0/112712434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25dbf60 msgr2=0x55ecc2999280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb851774640 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25dbf60 0x55ecc2999280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb851774640 1 -- 172.21.15.53:0/112712434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc28a77b0 con 0x55ecc25bb280 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb852776640 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25dbf60 0x55ecc2999280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb851f75640 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc298ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb851774640 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25bb280 0x55ecc298d3f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0a7dd0 tx=0x7fb83c0ab580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2dc558793786809 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb8357fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb8357fa640 1 -- 172.21.15.53:0/112712434 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0abd50 con 0x55ecc25bb280 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb8357fa640 1 -- 172.21.15.53:0/112712434 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fb83c0b0250 con 0x55ecc25bb280 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb85a74e740 1 -- 172.21.15.53:0/112712434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8440054b0 con 0x55ecc25bb280 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb8357fa640 1 -- 172.21.15.53:0/112712434 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb83c0b05c0 con 0x55ecc25bb280 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb85a74e740 10 client.15387 fetch_fsmap learned FSMap version 27 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb85a74e740 1 -- 172.21.15.53:0/112712434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ecc299bd50 con 0x55ecc25bb280 2024-08-31T06:04:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.265+0000 7fb8357fa640 1 -- 172.21.15.53:0/112712434 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8440054b0 con 0x55ecc25bb280 2024-08-31T06:04:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.266+0000 7fb8357fa640 1 -- 172.21.15.53:0/112712434 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb83c0b4be0 con 0x55ecc25bb280 2024-08-31T06:04:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.266+0000 7fb85a74e740 10 client.15387 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:04:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.266+0000 7fb85a74e740 10 client.15387 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:04:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.266+0000 7fb85a74e740 20 client.15387 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.266+0000 7fb85a74e740 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55ecc259a8e0 0x55ecc299f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.266+0000 7fb85a74e740 4 client.15387 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.266+0000 7fb85a74e740 1 -- 172.21.15.53:0/112712434 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecc28fa340 con 0x55ecc259a8e0 2024-08-31T06:04:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.266+0000 7fb851f75640 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55ecc259a8e0 0x55ecc299f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.266+0000 7fb851f75640 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55ecc259a8e0 0x55ecc299f7b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b053207f01ab23c4 server_cookie=6357889d8237c42c in_seq=0 out_seq=0 2024-08-31T06:04:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.266+0000 7fb8357fa640 10 client.15387 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:04:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.267+0000 7fb8357fa640 1 -- 172.21.15.53:0/112712434 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ecc28fa340 con 0x55ecc259a8e0 2024-08-31T06:04:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.267+0000 7fb8357fa640 10 client.15387 handle_command_reply: tid=0 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.267+0000 7fb85a74e740 1 client.15387 shutdown 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.267+0000 7fb85a74e740 1 -- 172.21.15.53:0/112712434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25bb280 msgr2=0x55ecc298d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.267+0000 7fb85a74e740 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25bb280 0x55ecc298d3f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0a7dd0 tx=0x7fb83c0ab580 comp rx=0 tx=0).stop 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.268+0000 7fb85a74e740 1 -- 172.21.15.53:0/112712434 shutdown_connections 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.268+0000 7fb85a74e740 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55ecc259a8e0 0x55ecc299f7b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.268+0000 7fb85a74e740 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25dbf60 0x55ecc2999280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.268+0000 7fb85a74e740 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25bb280 0x55ecc298d3f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.268+0000 7fb8357fa640 0 client.15387 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.268+0000 7fb85a74e740 1 --2- 172.21.15.53:0/112712434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc298ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.268+0000 7fb85a74e740 1 -- 172.21.15.53:0/112712434 >> 172.21.15.53:0/112712434 conn(0x55ecc25d0350 msgr2=0x55ecc2984990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.268+0000 7fb85a74e740 1 -- 172.21.15.53:0/112712434 shutdown_connections 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.268+0000 7fb85a74e740 1 -- 172.21.15.53:0/112712434 wait complete. 2024-08-31T06:04:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.268+0000 7fb85a74e740 20 client.15387 trim_cache size 0 max 16384 2024-08-31T06:04:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.286+0000 7fb85a74e740 1 Processor -- start 2024-08-31T06:04:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.286+0000 7fb85a74e740 1 -- start start 2024-08-31T06:04:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.286+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc259a8e0 0x55ecc299e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.286+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc29991f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.286+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc2987ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.286+0000 7fb85a74e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ecc299daf0 con 0x55ecc259a8e0 2024-08-31T06:04:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.286+0000 7fb85a74e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ecc299e1c0 con 0x55ecc25bb280 2024-08-31T06:04:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.286+0000 7fb85a74e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ecc299e890 con 0x55ecc25b30a0 2024-08-31T06:04:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.286+0000 7fb851f75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc259a8e0 0x55ecc299e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.286+0000 7fb851f75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc259a8e0 0x55ecc299e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40788/0 (socket says 172.21.15.53:40788) 2024-08-31T06:04:14.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.286+0000 7fb851f75640 1 -- 172.21.15.53:0/541919865 learned_addr learned my addr 172.21.15.53:0/541919865 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:14.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.287+0000 7fb851f75640 1 -- 172.21.15.53:0/541919865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 msgr2=0x55ecc29991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:14.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.287+0000 7fb851f75640 1 --2- 172.21.15.53:0/541919865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc29991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.287+0000 7fb851f75640 1 -- 172.21.15.53:0/541919865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 msgr2=0x55ecc2987ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:14.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.287+0000 7fb851f75640 1 --2- 172.21.15.53:0/541919865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc2987ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.287+0000 7fb851f75640 1 -- 172.21.15.53:0/541919865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc2983aa0 con 0x55ecc259a8e0 2024-08-31T06:04:14.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.287+0000 7fb851f75640 1 --2- 172.21.15.53:0/541919865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc259a8e0 0x55ecc299e340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb848009900 tx=0x7fb84803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484e94b91cd2f93e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:14.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.287+0000 7fb8377fe640 1 -- 172.21.15.53:0/541919865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848035050 con 0x55ecc259a8e0 2024-08-31T06:04:14.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.287+0000 7fb8377fe640 1 -- 172.21.15.53:0/541919865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb848005040 con 0x55ecc259a8e0 2024-08-31T06:04:14.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.287+0000 7fb8377fe640 1 -- 172.21.15.53:0/541919865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480049b0 con 0x55ecc259a8e0 2024-08-31T06:04:14.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.288+0000 7fb85a74e740 1 -- 172.21.15.53:0/541919865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc259a8e0 msgr2=0x55ecc299e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:14.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.288+0000 7fb85a74e740 1 --2- 172.21.15.53:0/541919865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc259a8e0 0x55ecc299e340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb848009900 tx=0x7fb84803d000 comp rx=0 tx=0).stop 2024-08-31T06:04:14.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.288+0000 7fb85a74e740 1 -- 172.21.15.53:0/541919865 shutdown_connections 2024-08-31T06:04:14.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.288+0000 7fb85a74e740 1 --2- 172.21.15.53:0/541919865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc2987ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.288+0000 7fb85a74e740 1 --2- 172.21.15.53:0/541919865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc25b30a0 0x55ecc29991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.288+0000 7fb85a74e740 1 --2- 172.21.15.53:0/541919865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc259a8e0 0x55ecc299e340 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.288+0000 7fb85a74e740 1 -- 172.21.15.53:0/541919865 >> 172.21.15.53:0/541919865 conn(0x55ecc25d0350 msgr2=0x55ecc298ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:14.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.288+0000 7fb85a74e740 1 -- 172.21.15.53:0/541919865 shutdown_connections 2024-08-31T06:04:14.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.288+0000 7fb85a74e740 1 -- 172.21.15.53:0/541919865 wait complete. 2024-08-31T06:04:14.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.288+0000 7fb85a74e740 1 -- start start 2024-08-31T06:04:14.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.288+0000 7fb85a74e740 1 Processor -- start 2024-08-31T06:04:14.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc259a8e0 0x55ecc29a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25b30a0 0x55ecc29a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb85a74e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc29a6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb85a74e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ecc299f630 con 0x55ecc25b30a0 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb85a74e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ecc299ef60 con 0x55ecc25bb280 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb85a74e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ecc299fd00 con 0x55ecc259a8e0 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb85a74e740 10 client.0 _ll_register_callbacks cb 0x7fb83c0abc10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb851774640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25b30a0 0x55ecc29a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb851774640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25b30a0 0x55ecc29a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40798/0 (socket says 172.21.15.53:40798) 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb851774640 1 -- 172.21.15.53:0/1328732748 learned_addr learned my addr 172.21.15.53:0/1328732748 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb852776640 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc29a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb851f75640 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc259a8e0 0x55ecc29a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb851774640 1 -- 172.21.15.53:0/1328732748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc259a8e0 msgr2=0x55ecc29a12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb851774640 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc259a8e0 0x55ecc29a12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb851774640 1 -- 172.21.15.53:0/1328732748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 msgr2=0x55ecc29a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb851774640 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc29a6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb851774640 1 -- 172.21.15.53:0/1328732748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc29a6eb0 con 0x55ecc25b30a0 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb852776640 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc29a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb851774640 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25b30a0 0x55ecc29a18a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0e51a0 tx=0x7fb83c0b0430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f21cdba6c25bca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb8357fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.289+0000 7fb8357fa640 1 -- 172.21.15.53:0/1328732748 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0d2060 con 0x55ecc25b30a0 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb8357fa640 1 -- 172.21.15.53:0/1328732748 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 8484+0+0 (secure 0 0 0) 0x7fb83c091b40 con 0x55ecc25b30a0 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb85a74e740 1 -- 172.21.15.53:0/1328732748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb848005040 con 0x55ecc25b30a0 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb8357fa640 1 -- 172.21.15.53:0/1328732748 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb83c0abd50 con 0x55ecc25b30a0 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb85a74e740 10 client.15393 fetch_fsmap learned FSMap version 27 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb85a74e740 1 -- 172.21.15.53:0/1328732748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ecc29a8270 con 0x55ecc25b30a0 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb8357fa640 1 -- 172.21.15.53:0/1328732748 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb848005040 con 0x55ecc25b30a0 2024-08-31T06:04:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb8357fa640 1 -- 172.21.15.53:0/1328732748 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb83c0a76c0 con 0x55ecc25b30a0 2024-08-31T06:04:14.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb85a74e740 10 client.15393 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:04:14.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb85a74e740 10 client.15393 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:04:14.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb85a74e740 20 client.15393 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:14.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb85a74e740 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55ecc25dbf60 0x55ecc2a0db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:14.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb85a74e740 4 client.15393 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:04:14.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb85a74e740 1 -- 172.21.15.53:0/1328732748 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "status"}) -- 0x55ecc28f5de0 con 0x55ecc25dbf60 2024-08-31T06:04:14.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.290+0000 7fb851f75640 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55ecc25dbf60 0x55ecc2a0db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:14.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb851f75640 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55ecc25dbf60 0x55ecc2a0db40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8427fdfaaac157b server_cookie=ba6e835e712e213d in_seq=0 out_seq=0 2024-08-31T06:04:14.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb8357fa640 10 client.15393 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:04:14.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb8357fa640 1 -- 172.21.15.53:0/1328732748 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ecc28f5de0 con 0x55ecc25dbf60 2024-08-31T06:04:14.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb8357fa640 10 client.15393 handle_command_reply: tid=0 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb85a74e740 1 client.15393 shutdown 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb85a74e740 1 -- 172.21.15.53:0/1328732748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25b30a0 msgr2=0x55ecc29a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb85a74e740 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25b30a0 0x55ecc29a18a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0e51a0 tx=0x7fb83c0b0430 comp rx=0 tx=0).stop 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb85a74e740 1 -- 172.21.15.53:0/1328732748 shutdown_connections 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb85a74e740 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55ecc25dbf60 0x55ecc2a0db40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb85a74e740 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ecc25bb280 0x55ecc29a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb8357fa640 0 client.15393 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb85a74e740 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ecc25b30a0 0x55ecc29a18a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb85a74e740 1 --2- 172.21.15.53:0/1328732748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ecc259a8e0 0x55ecc29a12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.291+0000 7fb85a74e740 1 -- 172.21.15.53:0/1328732748 >> 172.21.15.53:0/1328732748 conn(0x55ecc25d0350 msgr2=0x55ecc2987ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb85a74e740 1 -- 172.21.15.53:0/1328732748 shutdown_connections 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb85a74e740 1 -- 172.21.15.53:0/1328732748 wait complete. 2024-08-31T06:04:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb85a74e740 20 client.15393 trim_cache size 0 max 16384 2024-08-31T06:04:14.300 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:14.300 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:04:14.300 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 2, 2024-08-31T06:04:14.300 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24632, 2024-08-31T06:04:14.300 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:04:14.300 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:04:14.300 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:04:14.300 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 94.654485265000005, 2024-08-31T06:04:14.300 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 27, 2024-08-31T06:04:14.300 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 72, 2024-08-31T06:04:14.300 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 70, 2024-08-31T06:04:14.301 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 125.511392908 2024-08-31T06:04:14.301 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:14.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 -- 172.21.15.53:0/1232938088 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8380b4c40 msgr2=0x7fb8380b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:14.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8380b4c40 0x7fb8380b7150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb848000c00 tx=0x7fb848009640 comp rx=0 tx=0).stop 2024-08-31T06:04:14.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 -- 172.21.15.53:0/1232938088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84c109270 msgr2=0x7fb84c19c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84c109270 0x7fb84c19c920 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00c8c0 tx=0x7fb83c00cd80 comp rx=0 tx=0).stop 2024-08-31T06:04:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 -- 172.21.15.53:0/1232938088 shutdown_connections 2024-08-31T06:04:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8380b4c40 0x7fb8380b7150 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb84c109bc0 0x7fb84c1a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84c109270 0x7fb84c19c920 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 --2- 172.21.15.53:0/1232938088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb84c103930 0x7fb84c19c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 -- 172.21.15.53:0/1232938088 >> 172.21.15.53:0/1232938088 conn(0x7fb84c0ff3a0 msgr2=0x7fb84c108960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 -- 172.21.15.53:0/1232938088 shutdown_connections 2024-08-31T06:04:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:14.292+0000 7fb8541d9640 1 -- 172.21.15.53:0/1232938088 wait complete. 2024-08-31T06:04:15.074 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T06:04:15.326 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:15 smithi153 ceph-mon[22320]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-08-31T06:04:15.700 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:15 smithi053 ceph-mon[18924]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:15.701 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-08-31T06:04:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.790+0000 7f15f620c640 1 -- 172.21.15.53:0/1038227475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15f01050a0 msgr2=0x7f15f010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.790+0000 7f15f620c640 1 --2- 172.21.15.53:0/1038227475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15f01050a0 0x7f15f010d5f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009900 tx=0x7f15d802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.790+0000 7f15f620c640 1 -- 172.21.15.53:0/1038227475 shutdown_connections 2024-08-31T06:04:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.790+0000 7f15f620c640 1 --2- 172.21.15.53:0/1038227475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f010dbb0 0x7f15f01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.790+0000 7f15f620c640 1 --2- 172.21.15.53:0/1038227475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15f01050a0 0x7f15f010d5f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.790+0000 7f15f620c640 1 --2- 172.21.15.53:0/1038227475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15f0104750 0x7f15f0104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.790+0000 7f15f620c640 1 -- 172.21.15.53:0/1038227475 >> 172.21.15.53:0/1038227475 conn(0x7f15f00794d0 msgr2=0x7f15f00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.790+0000 7f15f620c640 1 -- 172.21.15.53:0/1038227475 shutdown_connections 2024-08-31T06:04:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.790+0000 7f15f620c640 1 -- 172.21.15.53:0/1038227475 wait complete. 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.790+0000 7f15f620c640 1 Processor -- start 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15f620c640 1 -- start start 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15f620c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15f0104750 0x7f15f019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15f620c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15f01050a0 0x7f15f019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15f620c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f010dbb0 0x7f15f019fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15f620c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f15f01137a0 con 0x7f15f01050a0 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15f620c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f15f0113620 con 0x7f15f0104750 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15f620c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f15f0113920 con 0x7f15f010dbb0 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15e6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15f01050a0 0x7f15f019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15e6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15f01050a0 0x7f15f019a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40810/0 (socket says 172.21.15.53:40810) 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15e6ffd640 1 -- 172.21.15.53:0/960896415 learned_addr learned my addr 172.21.15.53:0/960896415 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15e6ffd640 1 -- 172.21.15.53:0/960896415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f010dbb0 msgr2=0x7f15f019fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15e6ffd640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f010dbb0 0x7f15f019fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15e6ffd640 1 -- 172.21.15.53:0/960896415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15f0104750 msgr2=0x7f15f019a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.791+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15f0104750 0x7f15f019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.792+0000 7f15e6ffd640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15f0104750 0x7f15f019a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.792+0000 7f15e6ffd640 1 -- 172.21.15.53:0/960896415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f01a02a0 con 0x7f15f01050a0 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.792+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15f0104750 0x7f15f019a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.792+0000 7f15e6ffd640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15f01050a0 0x7f15f019a8d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f15d8005940 tx=0x7f15d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.792+0000 7f15ed7fa640 1 -- 172.21.15.53:0/960896415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d803f030 con 0x7f15f01050a0 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.792+0000 7f15f620c640 1 -- 172.21.15.53:0/960896415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f01a0530 con 0x7f15f01050a0 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.792+0000 7f15ed7fa640 1 -- 172.21.15.53:0/960896415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15d8003c90 con 0x7f15f01050a0 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.792+0000 7f15ed7fa640 1 -- 172.21.15.53:0/960896415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8035070 con 0x7f15f01050a0 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.792+0000 7f15f620c640 1 -- 172.21.15.53:0/960896415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f01a6cf0 con 0x7f15f01050a0 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.795+0000 7f15fc781740 1 Processor -- start 2024-08-31T06:04:15.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.795+0000 7f15fc781740 1 -- start start 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.795+0000 7f15fc781740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca6df60 0x55b84ce137b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.795+0000 7f15fc781740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce13cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.795+0000 7f15fc781740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce14230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.795+0000 7f15fc781740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b84cd8a3f0 con 0x55b84ca6df60 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.795+0000 7f15fc781740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b84cd79980 con 0x55b84ca450a0 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.795+0000 7f15fc781740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b84cd7d930 con 0x55b84ca4d280 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.795+0000 7f15ed7fa640 1 -- 172.21.15.53:0/960896415 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f15d8042030 con 0x7f15f01050a0 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca6df60 0x55b84ce137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca6df60 0x55b84ce137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40820/0 (socket says 172.21.15.53:40820) 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15effff640 1 -- 172.21.15.53:0/3544160648 learned_addr learned my addr 172.21.15.53:0/3544160648 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/3544160648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce13cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15effff640 1 -- 172.21.15.53:0/3544160648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 msgr2=0x55b84ce14230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:15.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15effff640 1 --2- 172.21.15.53:0/3544160648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce14230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15effff640 1 -- 172.21.15.53:0/3544160648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 msgr2=0x55b84ce13cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15effff640 1 --2- 172.21.15.53:0/3544160648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce13cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15effff640 1 -- 172.21.15.53:0/3544160648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84cad9540 con 0x55b84ca6df60 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/3544160648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce13cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15effff640 1 --2- 172.21.15.53:0/3544160648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca6df60 0x55b84ce137b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009d00 tx=0x7f15e800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937391a7c2f3755b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15e5ffb640 1 -- 172.21.15.53:0/3544160648 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e800bd40 con 0x55b84ca6df60 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15e5ffb640 1 -- 172.21.15.53:0/3544160648 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15e8017070 con 0x55b84ca6df60 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15e5ffb640 1 -- 172.21.15.53:0/3544160648 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e80115f0 con 0x55b84ca6df60 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.796+0000 7f15ed7fa640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15dc0b4c90 0x7f15dc0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15dc0b4c90 0x7f15dc0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15ed7fa640 1 -- 172.21.15.53:0/960896415 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8513+0+0 (secure 0 0 0) 0x7f15d8105d80 con 0x7f15f01050a0 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15fc781740 1 -- 172.21.15.53:0/3544160648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca6df60 msgr2=0x55b84ce137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:15.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15dc0b4c90 0x7f15dc0b71a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f15e0006fd0 tx=0x7f15e0008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15fc781740 1 --2- 172.21.15.53:0/3544160648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca6df60 0x55b84ce137b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009d00 tx=0x7f15e800b420 comp rx=0 tx=0).stop 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15fc781740 1 -- 172.21.15.53:0/3544160648 shutdown_connections 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15fc781740 1 --2- 172.21.15.53:0/3544160648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce14230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15fc781740 1 --2- 172.21.15.53:0/3544160648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce13cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15fc781740 1 --2- 172.21.15.53:0/3544160648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca6df60 0x55b84ce137b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15fc781740 1 -- 172.21.15.53:0/3544160648 >> 172.21.15.53:0/3544160648 conn(0x55b84ca62350 msgr2=0x55b84ce116a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15fc781740 1 -- 172.21.15.53:0/3544160648 shutdown_connections 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.797+0000 7f15fc781740 1 -- 172.21.15.53:0/3544160648 wait complete. 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15fc781740 1 -- start start 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15fc781740 1 Processor -- start 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15fc781740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca450a0 0x55b84ce1ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15fc781740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce1f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15fc781740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca6df60 0x55b84ce2b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15fc781740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b84cbdc5f0 con 0x55b84ca450a0 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15fc781740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b84cd00600 con 0x55b84ca6df60 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15fc781740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b84ce21f90 con 0x55b84ca4d280 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15fc781740 10 client.0 _ll_register_callbacks cb 0x55b84cd26af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca450a0 0x55b84ce1ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca450a0 0x55b84ce1ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40828/0 (socket says 172.21.15.53:40828) 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15ef7fe640 1 -- 172.21.15.53:0/2739617649 learned_addr learned my addr 172.21.15.53:0/2739617649 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15e6ffd640 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce1f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.798+0000 7f15effff640 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca6df60 0x55b84ce2b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15ef7fe640 1 -- 172.21.15.53:0/2739617649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 msgr2=0x55b84ce1f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce1f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15ef7fe640 1 -- 172.21.15.53:0/2739617649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca6df60 msgr2=0x55b84ce2b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:15.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca6df60 0x55b84ce2b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15ef7fe640 1 -- 172.21.15.53:0/2739617649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84cd397b0 con 0x55b84ca450a0 2024-08-31T06:04:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca450a0 0x55b84ce1ee80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f15e0006fa0 tx=0x7f15e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266d0a4167c52626 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15ceffd640 1 -- 172.21.15.53:0/2739617649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0023020 con 0x55b84ca450a0 2024-08-31T06:04:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15ceffd640 1 -- 172.21.15.53:0/2739617649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8513+0+0 (secure 0 0 0) 0x7f15e0015610 con 0x55b84ca450a0 2024-08-31T06:04:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15fc781740 1 -- 172.21.15.53:0/2739617649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15e8017070 con 0x55b84ca450a0 2024-08-31T06:04:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15ceffd640 1 -- 172.21.15.53:0/2739617649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f15e002e050 con 0x55b84ca450a0 2024-08-31T06:04:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15fc781740 10 client.15405 fetch_fsmap learned FSMap version 27 2024-08-31T06:04:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.799+0000 7f15fc781740 1 -- 172.21.15.53:0/2739617649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b84ce2dd40 con 0x55b84ca450a0 2024-08-31T06:04:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.800+0000 7f15ceffd640 1 -- 172.21.15.53:0/2739617649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15e8017070 con 0x55b84ca450a0 2024-08-31T06:04:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.800+0000 7f15ceffd640 1 -- 172.21.15.53:0/2739617649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f15e001e030 con 0x55b84ca450a0 2024-08-31T06:04:15.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.800+0000 7f15fc781740 10 client.15405 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:04:15.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.800+0000 7f15fc781740 10 client.15405 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:04:15.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.800+0000 7f15fc781740 20 client.15405 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:15.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.800+0000 7f15fc781740 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b84ca2c8e0 0x55b84ce31820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.800+0000 7f15fc781740 4 client.15405 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:15.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.800+0000 7f15fc781740 1 -- 172.21.15.53:0/2739617649 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b84cd8c340 con 0x55b84ca2c8e0 2024-08-31T06:04:15.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.800+0000 7f15e6ffd640 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b84ca2c8e0 0x55b84ce31820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.801+0000 7f15ceffd640 10 client.15405 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:04:15.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.801+0000 7f15e6ffd640 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b84ca2c8e0 0x55b84ce31820 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=46f095561df77c39 server_cookie=26f3709654fbf89c in_seq=0 out_seq=0 2024-08-31T06:04:15.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.801+0000 7f15ceffd640 1 -- 172.21.15.53:0/2739617649 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b84cd8c340 con 0x55b84ca2c8e0 2024-08-31T06:04:15.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.801+0000 7f15ceffd640 10 client.15405 handle_command_reply: tid=0 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 1 client.15405 shutdown 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 1 -- 172.21.15.53:0/2739617649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca450a0 msgr2=0x55b84ce1ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca450a0 0x55b84ce1ee80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f15e0006fa0 tx=0x7f15e00046c0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 1 -- 172.21.15.53:0/2739617649 shutdown_connections 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b84ca2c8e0 0x55b84ce31820 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca6df60 0x55b84ce2b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce1f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15ceffd640 0 client.15405 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 1 --2- 172.21.15.53:0/2739617649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca450a0 0x55b84ce1ee80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 1 -- 172.21.15.53:0/2739617649 >> 172.21.15.53:0/2739617649 conn(0x55b84ca62350 msgr2=0x55b84ce16990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 1 -- 172.21.15.53:0/2739617649 shutdown_connections 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 1 -- 172.21.15.53:0/2739617649 wait complete. 2024-08-31T06:04:15.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.802+0000 7f15fc781740 20 client.15405 trim_cache size 0 max 16384 2024-08-31T06:04:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.820+0000 7f15fc781740 1 Processor -- start 2024-08-31T06:04:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.820+0000 7f15fc781740 1 -- start start 2024-08-31T06:04:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15fc781740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca2c8e0 0x55b84ce0c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15fc781740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce2b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15fc781740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce1ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15fc781740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b84ce2fb60 con 0x55b84ca2c8e0 2024-08-31T06:04:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15fc781740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b84ce30230 con 0x55b84ca450a0 2024-08-31T06:04:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15fc781740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b84ce30900 con 0x55b84ca4d280 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca2c8e0 0x55b84ce0c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca2c8e0 0x55b84ce0c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40836/0 (socket says 172.21.15.53:40836) 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15ef7fe640 1 -- 172.21.15.53:0/2307701387 learned_addr learned my addr 172.21.15.53:0/2307701387 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15e6ffd640 1 --2- 172.21.15.53:0/2307701387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce2b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15effff640 1 --2- 172.21.15.53:0/2307701387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce1ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15ef7fe640 1 -- 172.21.15.53:0/2307701387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 msgr2=0x55b84ce1ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/2307701387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce1ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15ef7fe640 1 -- 172.21.15.53:0/2307701387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 msgr2=0x55b84ce2b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/2307701387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce2b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15ef7fe640 1 -- 172.21.15.53:0/2307701387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84ce19ae0 con 0x55b84ca2c8e0 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15effff640 1 --2- 172.21.15.53:0/2307701387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce1ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:15.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.821+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/2307701387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca2c8e0 0x55b84ce0c400 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f15e0000c00 tx=0x7f15e0006be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe58df5a8036d92 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.822+0000 7f15e57fa640 1 -- 172.21.15.53:0/2307701387 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0023070 con 0x55b84ca2c8e0 2024-08-31T06:04:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.822+0000 7f15e57fa640 1 -- 172.21.15.53:0/2307701387 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15e0005e50 con 0x55b84ca2c8e0 2024-08-31T06:04:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.822+0000 7f15e57fa640 1 -- 172.21.15.53:0/2307701387 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e001b040 con 0x55b84ca2c8e0 2024-08-31T06:04:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.822+0000 7f15fc781740 1 -- 172.21.15.53:0/2307701387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca2c8e0 msgr2=0x55b84ce0c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.822+0000 7f15fc781740 1 --2- 172.21.15.53:0/2307701387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca2c8e0 0x55b84ce0c400 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f15e0000c00 tx=0x7f15e0006be0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 -- 172.21.15.53:0/2307701387 shutdown_connections 2024-08-31T06:04:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 --2- 172.21.15.53:0/2307701387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca4d280 0x55b84ce1ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 --2- 172.21.15.53:0/2307701387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce2b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 --2- 172.21.15.53:0/2307701387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca2c8e0 0x55b84ce0c400 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 -- 172.21.15.53:0/2307701387 >> 172.21.15.53:0/2307701387 conn(0x55b84ca62350 msgr2=0x55b84ce1d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 -- 172.21.15.53:0/2307701387 shutdown_connections 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 -- 172.21.15.53:0/2307701387 wait complete. 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 -- start start 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 Processor -- start 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca2c8e0 0x55b84ce3a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce33920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.823+0000 7f15fc781740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca4d280 0x55b84ce34030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15fc781740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b84ce316a0 con 0x55b84ca4d280 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15fc781740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b84ce30fd0 con 0x55b84ca450a0 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15fc781740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b84ce31d70 con 0x55b84ca2c8e0 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15fc781740 10 client.0 _ll_register_callbacks cb 0x7f15e000fce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca4d280 0x55b84ce34030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca4d280 0x55b84ce34030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40844/0 (socket says 172.21.15.53:40844) 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15effff640 1 -- 172.21.15.53:0/4002440496 learned_addr learned my addr 172.21.15.53:0/4002440496 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15e6ffd640 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce33920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca2c8e0 0x55b84ce3a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15effff640 1 -- 172.21.15.53:0/4002440496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca2c8e0 msgr2=0x55b84ce3a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15effff640 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca2c8e0 0x55b84ce3a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15effff640 1 -- 172.21.15.53:0/4002440496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 msgr2=0x55b84ce33920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15effff640 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce33920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15effff640 1 -- 172.21.15.53:0/4002440496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84ce390b0 con 0x55b84ca4d280 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15effff640 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca4d280 0x55b84ce34030 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f15e800b920 tx=0x7f15e8009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4624bd31161388 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15ceffd640 1 -- 172.21.15.53:0/4002440496 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e802a060 con 0x55b84ca4d280 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.824+0000 7f15ceffd640 1 -- 172.21.15.53:0/4002440496 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 8513+0+0 (secure 0 0 0) 0x7f15e801b600 con 0x55b84ca4d280 2024-08-31T06:04:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15fc781740 1 -- 172.21.15.53:0/4002440496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15e0005e50 con 0x55b84ca4d280 2024-08-31T06:04:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15ceffd640 1 -- 172.21.15.53:0/4002440496 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f15e8012e60 con 0x55b84ca4d280 2024-08-31T06:04:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15fc781740 10 client.15411 fetch_fsmap learned FSMap version 27 2024-08-31T06:04:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15fc781740 1 -- 172.21.15.53:0/4002440496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b84ce9ce40 con 0x55b84ca4d280 2024-08-31T06:04:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15ceffd640 1 -- 172.21.15.53:0/4002440496 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15e0005e50 con 0x55b84ca4d280 2024-08-31T06:04:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15ceffd640 1 -- 172.21.15.53:0/4002440496 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f15e8011070 con 0x55b84ca4d280 2024-08-31T06:04:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15fc781740 10 client.15411 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:04:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15fc781740 10 client.15411 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:04:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15fc781740 20 client.15411 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15fc781740 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b84ca6df60 0x55b84cea03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15fc781740 4 client.15411 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:04:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.825+0000 7f15fc781740 1 -- 172.21.15.53:0/4002440496 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "status"}) -- 0x55b84cd87de0 con 0x55b84ca6df60 2024-08-31T06:04:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b84ca6df60 0x55b84cea03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15ceffd640 10 client.15411 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15ef7fe640 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b84ca6df60 0x55b84cea03f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=536c0887659929d6 server_cookie=8d5f5d102a32732e in_seq=0 out_seq=0 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15ceffd640 1 -- 172.21.15.53:0/4002440496 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55b84cd87de0 con 0x55b84ca6df60 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15ceffd640 10 client.15411 handle_command_reply: tid=0 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15fc781740 1 client.15411 shutdown 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15fc781740 1 -- 172.21.15.53:0/4002440496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca4d280 msgr2=0x55b84ce34030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15fc781740 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca4d280 0x55b84ce34030 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f15e800b920 tx=0x7f15e8009700 comp rx=0 tx=0).stop 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15fc781740 1 -- 172.21.15.53:0/4002440496 shutdown_connections 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15fc781740 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b84ca6df60 0x55b84cea03f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15fc781740 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b84ca4d280 0x55b84ce34030 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15fc781740 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b84ca450a0 0x55b84ce33920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15fc781740 1 --2- 172.21.15.53:0/4002440496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b84ca2c8e0 0x55b84ce3a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.826+0000 7f15fc781740 1 -- 172.21.15.53:0/4002440496 >> 172.21.15.53:0/4002440496 conn(0x55b84ca62350 msgr2=0x55b84ce1ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15ceffd640 0 client.15411 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:04:15.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15fc781740 1 -- 172.21.15.53:0/4002440496 shutdown_connections 2024-08-31T06:04:15.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15fc781740 1 -- 172.21.15.53:0/4002440496 wait complete. 2024-08-31T06:04:15.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15fc781740 20 client.15411 trim_cache size 0 max 16384 2024-08-31T06:04:15.833 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:15.833 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:04:15.833 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 1, 2024-08-31T06:04:15.833 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24640, 2024-08-31T06:04:15.833 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:04:15.833 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:04:15.833 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:04:15.834 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 97.194744795999995, 2024-08-31T06:04:15.834 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 27, 2024-08-31T06:04:15.834 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 73, 2024-08-31T06:04:15.834 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 70, 2024-08-31T06:04:15.834 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 124.47752143 2024-08-31T06:04:15.834 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:15.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 -- 172.21.15.53:0/960896415 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15dc0b4c90 msgr2=0x7f15dc0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:15.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15dc0b4c90 0x7f15dc0b71a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f15e0006fd0 tx=0x7f15e0008040 comp rx=0 tx=0).stop 2024-08-31T06:04:15.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 -- 172.21.15.53:0/960896415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15f01050a0 msgr2=0x7f15f019a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15f01050a0 0x7f15f019a8d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f15d8005940 tx=0x7f15d80042f0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 -- 172.21.15.53:0/960896415 shutdown_connections 2024-08-31T06:04:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15dc0b4c90 0x7f15dc0b71a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f010dbb0 0x7f15f019fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15f01050a0 0x7f15f019a8d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 --2- 172.21.15.53:0/960896415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15f0104750 0x7f15f019a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 -- 172.21.15.53:0/960896415 >> 172.21.15.53:0/960896415 conn(0x7f15f00794d0 msgr2=0x7f15f00ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 -- 172.21.15.53:0/960896415 shutdown_connections 2024-08-31T06:04:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:15.827+0000 7f15f620c640 1 -- 172.21.15.53:0/960896415 wait complete. 2024-08-31T06:04:15.881 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:15 smithi130 ceph-mon[22266]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:04:15.881 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-08-31T06:04:16.584 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T06:04:16.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:16 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-08-31T06:04:16.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:16 smithi053 ceph-mon[18924]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T06:04:16.835 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:16.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:16 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-08-31T06:04:16.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:16 smithi130 ceph-mon[22266]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T06:04:16.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:16 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-08-31T06:04:16.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:16 smithi153 ceph-mon[22320]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T06:04:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.274+0000 7f919ca2d640 1 -- 172.21.15.53:0/3520247391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9198104770 msgr2=0x7f9198104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.274+0000 7f919ca2d640 1 --2- 172.21.15.53:0/3520247391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9198104770 0x7f9198104b80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9188009900 tx=0x7f918802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.274+0000 7f919ca2d640 1 -- 172.21.15.53:0/3520247391 shutdown_connections 2024-08-31T06:04:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.274+0000 7f919ca2d640 1 --2- 172.21.15.53:0/3520247391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919810dbd0 0x7f91981100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.274+0000 7f919ca2d640 1 --2- 172.21.15.53:0/3520247391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91981050c0 0x7f919810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.274+0000 7f919ca2d640 1 --2- 172.21.15.53:0/3520247391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9198104770 0x7f9198104b80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.274+0000 7f919ca2d640 1 -- 172.21.15.53:0/3520247391 >> 172.21.15.53:0/3520247391 conn(0x7f91980794e0 msgr2=0x7f91980798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.274+0000 7f919ca2d640 1 -- 172.21.15.53:0/3520247391 shutdown_connections 2024-08-31T06:04:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.274+0000 7f919ca2d640 1 -- 172.21.15.53:0/3520247391 wait complete. 2024-08-31T06:04:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.275+0000 7f919ca2d640 1 Processor -- start 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.275+0000 7f919ca2d640 1 -- start start 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.275+0000 7f919ca2d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9198104770 0x7f919819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.275+0000 7f919ca2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91981050c0 0x7f919819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.275+0000 7f919ca2d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919810dbd0 0x7f919819faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.275+0000 7f919ca2d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f91981137c0 con 0x7f91981050c0 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.275+0000 7f919ca2d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9198113640 con 0x7f919810dbd0 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.275+0000 7f919ca2d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9198113940 con 0x7f9198104770 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.275+0000 7f918dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91981050c0 0x7f919819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f918dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91981050c0 0x7f919819a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40868/0 (socket says 172.21.15.53:40868) 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f918dd9b640 1 -- 172.21.15.53:0/1752269664 learned_addr learned my addr 172.21.15.53:0/1752269664 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f919659c640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9198104770 0x7f919819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f918dd9b640 1 -- 172.21.15.53:0/1752269664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9198104770 msgr2=0x7f919819a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f918dd9b640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9198104770 0x7f919819a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f9196d9d640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919810dbd0 0x7f919819faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f918dd9b640 1 -- 172.21.15.53:0/1752269664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919810dbd0 msgr2=0x7f919819faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f918dd9b640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919810dbd0 0x7f919819faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f918dd9b640 1 -- 172.21.15.53:0/1752269664 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91981a0220 con 0x7f91981050c0 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f919659c640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9198104770 0x7f919819a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f918dd9b640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91981050c0 0x7f919819a850 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9180006fd0 tx=0x7f918000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f918ffff640 1 -- 172.21.15.53:0/1752269664 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180011830 con 0x7f91981050c0 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f919ca2d640 1 -- 172.21.15.53:0/1752269664 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91981a0510 con 0x7f91981050c0 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f918ffff640 1 -- 172.21.15.53:0/1752269664 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9180016070 con 0x7f91981050c0 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f918ffff640 1 -- 172.21.15.53:0/1752269664 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180010cf0 con 0x7f91981050c0 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.276+0000 7f919ca2d640 1 -- 172.21.15.53:0/1752269664 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91981a6c70 con 0x7f91981050c0 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.279+0000 7f91a2fa2740 1 Processor -- start 2024-08-31T06:04:17.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.279+0000 7f91a2fa2740 1 -- start start 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.279+0000 7f918ffff640 1 -- 172.21.15.53:0/1752269664 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f91800119d0 con 0x7f91981050c0 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02fdf60 0x556eb06a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02dd280 0x556eb06a4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556eb061a3f0 con 0x556eb02dd280 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556eb0609980 con 0x556eb02fdf60 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556eb060d930 con 0x556eb02d50a0 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f918dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02dd280 0x556eb06a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f918dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02dd280 0x556eb06a4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40870/0 (socket says 172.21.15.53:40870) 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f918dd9b640 1 -- 172.21.15.53:0/1843859207 learned_addr learned my addr 172.21.15.53:0/1843859207 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f919659c640 1 --2- 172.21.15.53:0/1843859207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f9196d9d640 1 --2- 172.21.15.53:0/1843859207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02fdf60 0x556eb06a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f918dd9b640 1 -- 172.21.15.53:0/1843859207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 msgr2=0x556eb06a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f918dd9b640 1 --2- 172.21.15.53:0/1843859207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06a3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f918dd9b640 1 -- 172.21.15.53:0/1843859207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02fdf60 msgr2=0x556eb06a37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f918dd9b640 1 --2- 172.21.15.53:0/1843859207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02fdf60 0x556eb06a37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f918dd9b640 1 -- 172.21.15.53:0/1843859207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eb0369540 con 0x556eb02dd280 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f918ffff640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91840b4c10 0x7f91840b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f918dd9b640 1 --2- 172.21.15.53:0/1843859207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02dd280 0x556eb06a4230 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f91800e2300 tx=0x7f91800ed660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e498cf4f46451674 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.280+0000 7f9196d9d640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91840b4c10 0x7f91840b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.281+0000 7f918ffff640 1 -- 172.21.15.53:0/1752269664 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f91800e4b30 con 0x7f91981050c0 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.281+0000 7f918cd99640 1 -- 172.21.15.53:0/1843859207 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91800a71a0 con 0x556eb02dd280 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.281+0000 7f918cd99640 1 -- 172.21.15.53:0/1843859207 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91800e9040 con 0x556eb02dd280 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.281+0000 7f918cd99640 1 -- 172.21.15.53:0/1843859207 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91800aaa50 con 0x556eb02dd280 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f91a2fa2740 1 -- 172.21.15.53:0/1843859207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02dd280 msgr2=0x556eb06a4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f9196d9d640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91840b4c10 0x7f91840b7120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9190007ed0 tx=0x7f91900075c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/1843859207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02dd280 0x556eb06a4230 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f91800e2300 tx=0x7f91800ed660 comp rx=0 tx=0).stop 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f91a2fa2740 1 -- 172.21.15.53:0/1843859207 shutdown_connections 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/1843859207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02dd280 0x556eb06a4230 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/1843859207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06a3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/1843859207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02fdf60 0x556eb06a37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f91a2fa2740 1 -- 172.21.15.53:0/1843859207 >> 172.21.15.53:0/1843859207 conn(0x556eb02f2350 msgr2=0x556eb06a16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f91a2fa2740 1 -- 172.21.15.53:0/1843859207 shutdown_connections 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f91a2fa2740 1 -- 172.21.15.53:0/1843859207 wait complete. 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f91a2fa2740 1 -- start start 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.282+0000 7f91a2fa2740 1 Processor -- start 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02dd280 0x556eb06b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06bf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556eb046c5f0 con 0x556eb02fdf60 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556eb0590600 con 0x556eb02dd280 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556eb06b62f0 con 0x556eb02d50a0 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f91a2fa2740 10 client.0 _ll_register_callbacks cb 0x556eb05b6af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f9196d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f9196d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06bf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40880/0 (socket says 172.21.15.53:40880) 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f9196d9d640 1 -- 172.21.15.53:0/3455384847 learned_addr learned my addr 172.21.15.53:0/3455384847 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f919659c640 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f918dd9b640 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02dd280 0x556eb06b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f9196d9d640 1 -- 172.21.15.53:0/3455384847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 msgr2=0x556eb06b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f9196d9d640 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f9196d9d640 1 -- 172.21.15.53:0/3455384847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02dd280 msgr2=0x556eb06b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f9196d9d640 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02dd280 0x556eb06b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.283+0000 7f9196d9d640 1 -- 172.21.15.53:0/3455384847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eb05c97b0 con 0x556eb02fdf60 2024-08-31T06:04:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f9196d9d640 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06bf620 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9190012e00 tx=0x7f9190004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850868b94207447a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f917dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f917dffb640 1 -- 172.21.15.53:0/3455384847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190023020 con 0x556eb02fdf60 2024-08-31T06:04:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f917dffb640 1 -- 172.21.15.53:0/3455384847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f919001f440 con 0x556eb02fdf60 2024-08-31T06:04:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3455384847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91800e9040 con 0x556eb02fdf60 2024-08-31T06:04:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f917dffb640 1 -- 172.21.15.53:0/3455384847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f919002e050 con 0x556eb02fdf60 2024-08-31T06:04:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f91a2fa2740 10 client.15423 fetch_fsmap learned FSMap version 27 2024-08-31T06:04:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3455384847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556eb06c20a0 con 0x556eb02fdf60 2024-08-31T06:04:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f917dffb640 1 -- 172.21.15.53:0/3455384847 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91800e9040 con 0x556eb02fdf60 2024-08-31T06:04:17.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f917dffb640 1 -- 172.21.15.53:0/3455384847 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9190011040 con 0x556eb02fdf60 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f91a2fa2740 10 client.15423 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f91a2fa2740 10 client.15423 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f91a2fa2740 20 client.15423 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556eb02bc8e0 0x556eb06c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f91a2fa2740 4 client.15423 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.284+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3455384847 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556eb061c340 con 0x556eb02bc8e0 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.285+0000 7f919659c640 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556eb02bc8e0 0x556eb06c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.285+0000 7f917dffb640 10 client.15423 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.285+0000 7f919659c640 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556eb02bc8e0 0x556eb06c5bb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c712896207d2b05 server_cookie=4585dd3f18ea7f1f in_seq=0 out_seq=0 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f917dffb640 1 -- 172.21.15.53:0/3455384847 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556eb061c340 con 0x556eb02bc8e0 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f917dffb640 10 client.15423 handle_command_reply: tid=0 2024-08-31T06:04:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f91a2fa2740 1 client.15423 shutdown 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3455384847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 msgr2=0x556eb06bf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06bf620 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9190012e00 tx=0x7f9190004a40 comp rx=0 tx=0).stop 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3455384847 shutdown_connections 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556eb02bc8e0 0x556eb06c5bb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06bf620 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02dd280 0x556eb06b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3455384847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f917dffb640 0 client.15423 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.286+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3455384847 >> 172.21.15.53:0/3455384847 conn(0x556eb02f2350 msgr2=0x556eb069fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.287+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3455384847 shutdown_connections 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.287+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3455384847 wait complete. 2024-08-31T06:04:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.287+0000 7f91a2fa2740 20 client.15423 trim_cache size 0 max 16384 2024-08-31T06:04:17.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f91a2fa2740 1 Processor -- start 2024-08-31T06:04:17.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f91a2fa2740 1 -- start start 2024-08-31T06:04:17.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06a8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02dd280 0x556eb06a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556eb06c3ef0 con 0x556eb02fdf60 2024-08-31T06:04:17.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556eb06c45c0 con 0x556eb02dd280 2024-08-31T06:04:17.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556eb06c4c90 con 0x556eb02d50a0 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f9196d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f9196d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40896/0 (socket says 172.21.15.53:40896) 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f9196d9d640 1 -- 172.21.15.53:0/3442092671 learned_addr learned my addr 172.21.15.53:0/3442092671 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f919659c640 1 --2- 172.21.15.53:0/3442092671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f918dd9b640 1 --2- 172.21.15.53:0/3442092671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02dd280 0x556eb06a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f9196d9d640 1 -- 172.21.15.53:0/3442092671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 msgr2=0x556eb06a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f9196d9d640 1 --2- 172.21.15.53:0/3442092671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06a8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f9196d9d640 1 -- 172.21.15.53:0/3442092671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02dd280 msgr2=0x556eb06a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f9196d9d640 1 --2- 172.21.15.53:0/3442092671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02dd280 0x556eb06a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.305+0000 7f9196d9d640 1 -- 172.21.15.53:0/3442092671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eb06b4560 con 0x556eb02fdf60 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.306+0000 7f9196d9d640 1 --2- 172.21.15.53:0/3442092671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06cdea0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9190007750 tx=0x7f9190007fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f4bd4f49a0df4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.306+0000 7f917ffff640 1 -- 172.21.15.53:0/3442092671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190023050 con 0x556eb02fdf60 2024-08-31T06:04:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.306+0000 7f917ffff640 1 -- 172.21.15.53:0/3442092671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9190018030 con 0x556eb02fdf60 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.306+0000 7f917ffff640 1 -- 172.21.15.53:0/3442092671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919001f440 con 0x556eb02fdf60 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3442092671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 msgr2=0x556eb06cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3442092671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06cdea0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9190007750 tx=0x7f9190007fa0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3442092671 shutdown_connections 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3442092671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb06cdea0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3442092671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02dd280 0x556eb06a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3442092671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02d50a0 0x556eb06a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3442092671 >> 172.21.15.53:0/3442092671 conn(0x556eb02f2350 msgr2=0x556eb06b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3442092671 shutdown_connections 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3442092671 wait complete. 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 -- start start 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 Processor -- start 2024-08-31T06:04:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02d50a0 0x556eb06ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02dd280 0x556eb06cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb072a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556eb06c5a30 con 0x556eb02fdf60 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556eb06c5360 con 0x556eb02d50a0 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.307+0000 7f91a2fa2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556eb06c6100 con 0x556eb02dd280 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f91a2fa2740 10 client.0 _ll_register_callbacks cb 0x7f9190012a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f9196d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb072a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f9196d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb072a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40902/0 (socket says 172.21.15.53:40902) 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f9196d9d640 1 -- 172.21.15.53:0/3594235259 learned_addr learned my addr 172.21.15.53:0/3594235259 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f918dd9b640 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02dd280 0x556eb06cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f919659c640 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02d50a0 0x556eb06ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f9196d9d640 1 -- 172.21.15.53:0/3594235259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02dd280 msgr2=0x556eb06cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f9196d9d640 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02dd280 0x556eb06cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f9196d9d640 1 -- 172.21.15.53:0/3594235259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02d50a0 msgr2=0x556eb06ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f9196d9d640 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02d50a0 0x556eb06ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f9196d9d640 1 -- 172.21.15.53:0/3594235259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eb072a7a0 con 0x556eb02fdf60 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f9196d9d640 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb072a130 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9190004b90 tx=0x7f91900112f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89251eca237e9c9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f917dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f917dffb640 1 -- 172.21.15.53:0/3594235259 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190023040 con 0x556eb02fdf60 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f917dffb640 1 -- 172.21.15.53:0/3594235259 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f919001e770 con 0x556eb02fdf60 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.308+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3594235259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9190018030 con 0x556eb02fdf60 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f917dffb640 1 -- 172.21.15.53:0/3594235259 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f919004c050 con 0x556eb02fdf60 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f91a2fa2740 10 client.15429 fetch_fsmap learned FSMap version 27 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3594235259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556eb0731b70 con 0x556eb02fdf60 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f917dffb640 1 -- 172.21.15.53:0/3594235259 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9190018030 con 0x556eb02fdf60 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f917dffb640 1 -- 172.21.15.53:0/3594235259 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f919001f800 con 0x556eb02fdf60 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f91a2fa2740 10 client.15429 fetch_fsmap finished waiting for FSMap version 27 2024-08-31T06:04:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f91a2fa2740 10 client.15429 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f91a2fa2740 20 client.15429 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556eb0291c90 0x556eb0735070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f91a2fa2740 4 client.15429 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3594235259 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "status"}) -- 0x556eb06a5e10 con 0x556eb0291c90 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.309+0000 7f919659c640 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556eb0291c90 0x556eb0735070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f919659c640 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556eb0291c90 0x556eb0735070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f7e3e04b43be4ff server_cookie=5d1f614b79dd2871 in_seq=0 out_seq=0 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f917dffb640 10 client.15429 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f917dffb640 1 -- 172.21.15.53:0/3594235259 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x556eb06a5e10 con 0x556eb0291c90 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f917dffb640 10 client.15429 handle_command_reply: tid=0 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f91a2fa2740 1 client.15429 shutdown 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3594235259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 msgr2=0x556eb072a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb072a130 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9190004b90 tx=0x7f91900112f0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3594235259 shutdown_connections 2024-08-31T06:04:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556eb0291c90 0x556eb0735070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556eb02fdf60 0x556eb072a130 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556eb02dd280 0x556eb06cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f91a2fa2740 1 --2- 172.21.15.53:0/3594235259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556eb02d50a0 0x556eb06ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3594235259 >> 172.21.15.53:0/3594235259 conn(0x556eb02f2350 msgr2=0x556eb06a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:17.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f917dffb640 0 client.15429 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:17.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.310+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3594235259 shutdown_connections 2024-08-31T06:04:17.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f91a2fa2740 1 -- 172.21.15.53:0/3594235259 wait complete. 2024-08-31T06:04:17.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f91a2fa2740 20 client.15429 trim_cache size 0 max 16384 2024-08-31T06:04:17.319 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:04:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-08-31T06:04:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24668, 2024-08-31T06:04:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:04:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:04:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:04:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 105.715694343, 2024-08-31T06:04:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 27, 2024-08-31T06:04:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 74, 2024-08-31T06:04:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 70, 2024-08-31T06:04:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 116.794843074 2024-08-31T06:04:17.320 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 -- 172.21.15.53:0/1752269664 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91840b4c10 msgr2=0x7f91840b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91840b4c10 0x7f91840b7120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9190007ed0 tx=0x7f91900075c0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 -- 172.21.15.53:0/1752269664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91981050c0 msgr2=0x7f919819a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91981050c0 0x7f919819a850 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9180006fd0 tx=0x7f918000b8e0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 -- 172.21.15.53:0/1752269664 shutdown_connections 2024-08-31T06:04:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91840b4c10 0x7f91840b7120 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f919810dbd0 0x7f919819faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91981050c0 0x7f919819a850 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 --2- 172.21.15.53:0/1752269664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9198104770 0x7f919819a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 -- 172.21.15.53:0/1752269664 >> 172.21.15.53:0/1752269664 conn(0x7f91980794e0 msgr2=0x7f91981007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:17.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 -- 172.21.15.53:0/1752269664 shutdown_connections 2024-08-31T06:04:17.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:17.311+0000 7f919ca2d640 1 -- 172.21.15.53:0/1752269664 wait complete. 2024-08-31T06:04:17.655 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:17 smithi053 ceph-mon[18924]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-31T06:04:17.655 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:17 smithi053 ceph-mon[18924]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T06:04:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:17 smithi130 ceph-mon[22266]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-31T06:04:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:17 smithi130 ceph-mon[22266]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T06:04:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:17 smithi153 ceph-mon[22320]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-31T06:04:17.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:17 smithi153 ceph-mon[22320]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T06:04:18.077 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-31T06:04:18.104 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-31T06:04:18.104 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-08-31T06:04:18.105 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-08-31T06:04:18.105 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T06:04:18.105 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T06:04:18.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:18.105 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-08-31T06:04:18.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:18.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2024-08-31T06:04:18.189 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2024-08-31T06:04:18.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:04:18.191 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-31T06:04:18.191 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-31T06:04:18.192 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-31T06:04:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:18.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:18 smithi053 ceph-mon[18924]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T06:04:18.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:18 smithi130 ceph-mon[22266]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T06:04:18.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:18 smithi153 ceph-mon[22320]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T06:04:18.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.951+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2837445981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a08109be0 msgr2=0x7f3a08110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:18.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.951+0000 7f3a0cb11640 1 --2- 172.21.15.53:0/2837445981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a08109be0 0x7f3a08110410 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009900 tx=0x7f3a0002a410 comp rx=0 tx=0).stop 2024-08-31T06:04:18.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.951+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2837445981 shutdown_connections 2024-08-31T06:04:18.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.951+0000 7f3a0cb11640 1 --2- 172.21.15.53:0/2837445981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a08109be0 0x7f3a08110410 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:18.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.951+0000 7f3a0cb11640 1 --2- 172.21.15.53:0/2837445981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a08109290 0x7f3a081096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:18.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.951+0000 7f3a0cb11640 1 --2- 172.21.15.53:0/2837445981 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a08103950 0x7f3a08103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:18.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.951+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2837445981 >> 172.21.15.53:0/2837445981 conn(0x7f3a080ff3a0 msgr2=0x7f3a081017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:18.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.951+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2837445981 shutdown_connections 2024-08-31T06:04:18.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.951+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2837445981 wait complete. 2024-08-31T06:04:18.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a0cb11640 1 Processor -- start 2024-08-31T06:04:18.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a0cb11640 1 -- start start 2024-08-31T06:04:18.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a0cb11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a08103950 0x7f3a0819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a0cb11640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a08109290 0x7f3a0819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a0cb11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a08109be0 0x7f3a0819f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a0cb11640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3a08113750 con 0x7f3a08109be0 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a0cb11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a081135d0 con 0x7f3a08103950 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a0cb11640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a081138d0 con 0x7f3a08109290 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a06d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a08109be0 0x7f3a0819f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a06d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a08109be0 0x7f3a0819f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40922/0 (socket says 172.21.15.53:40922) 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a06d9d640 1 -- 172.21.15.53:0/2900020545 learned_addr learned my addr 172.21.15.53:0/2900020545 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a0659c640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a08103950 0x7f3a0819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a05d9b640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a08109290 0x7f3a0819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a06d9d640 1 -- 172.21.15.53:0/2900020545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a08109290 msgr2=0x7f3a0819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a06d9d640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a08109290 0x7f3a0819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:18.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a06d9d640 1 -- 172.21.15.53:0/2900020545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a08103950 msgr2=0x7f3a0819a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a06d9d640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a08103950 0x7f3a0819a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.952+0000 7f3a06d9d640 1 -- 172.21.15.53:0/2900020545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a081a00d0 con 0x7f3a08109be0 2024-08-31T06:04:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.953+0000 7f3a06d9d640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a08109be0 0x7f3a0819f9a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3a00005ab0 tx=0x7f3a000040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.953+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2900020545 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0003f030 con 0x7f3a08109be0 2024-08-31T06:04:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.953+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2900020545 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a00003a80 con 0x7f3a08109be0 2024-08-31T06:04:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.953+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2900020545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a081a0360 con 0x7f3a08109be0 2024-08-31T06:04:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.953+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2900020545 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a00035070 con 0x7f3a08109be0 2024-08-31T06:04:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.953+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2900020545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a081a6b20 con 0x7f3a08109be0 2024-08-31T06:04:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.954+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2900020545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a08103d60 con 0x7f3a08109be0 2024-08-31T06:04:18.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.956+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2900020545 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f3a00042030 con 0x7f3a08109be0 2024-08-31T06:04:18.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.957+0000 7f39ff7fe640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f40b4b80 0x7f39f40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:18.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.957+0000 7f3a0659c640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f40b4b80 0x7f39f40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:18.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.957+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2900020545 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f3a00105b50 con 0x7f3a08109be0 2024-08-31T06:04:18.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.958+0000 7f3a0659c640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f40b4b80 0x7f39f40b7090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f39f8005fd0 tx=0x7f39f8009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:18.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:18.961+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2900020545 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3a000cc510 con 0x7f3a08109be0 2024-08-31T06:04:19.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.184+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2900020545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3a0819b290 con 0x7f3a08109be0 2024-08-31T06:04:19.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.184+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2900020545 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f3a0819b290 con 0x7f3a08109be0 2024-08-31T06:04:19.186 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-31T06:04:19.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.186+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2900020545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f40b4b80 msgr2=0x7f39f40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:19.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.186+0000 7f3a0cb11640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f40b4b80 0x7f39f40b7090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f39f8005fd0 tx=0x7f39f8009680 comp rx=0 tx=0).stop 2024-08-31T06:04:19.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.186+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2900020545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a08109be0 msgr2=0x7f3a0819f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:19.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.186+0000 7f3a0cb11640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a08109be0 0x7f3a0819f9a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3a00005ab0 tx=0x7f3a000040e0 comp rx=0 tx=0).stop 2024-08-31T06:04:19.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.186+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2900020545 shutdown_connections 2024-08-31T06:04:19.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.186+0000 7f3a0cb11640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f40b4b80 0x7f39f40b7090 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:19.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.186+0000 7f3a0cb11640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a08109be0 0x7f3a0819f9a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:19.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.186+0000 7f3a0cb11640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a08109290 0x7f3a0819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:19.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.186+0000 7f3a0cb11640 1 --2- 172.21.15.53:0/2900020545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a08103950 0x7f3a0819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:19.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.186+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2900020545 >> 172.21.15.53:0/2900020545 conn(0x7f3a080ff3a0 msgr2=0x7f3a081017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:19.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.187+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2900020545 shutdown_connections 2024-08-31T06:04:19.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19.187+0000 7f3a0cb11640 1 -- 172.21.15.53:0/2900020545 wait complete. 2024-08-31T06:04:19.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:19 smithi053 ceph-mon[18924]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 895 B/s wr, 12 op/s 2024-08-31T06:04:19.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:19 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2900020545' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T06:04:19.858 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-31T06:04:19.858 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T06:04:19.859 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-08-31T06:04:19.859 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-31T06:04:19.859 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T06:04:19.859 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-31T06:04:19.859 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T06:04:19.859 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T06:04:19.859 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-31T06:04:19.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:19.859 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-08-31T06:04:19.875 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T06:04:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T06:04:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T06:04:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-08-31T06:04:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-08-31T06:04:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-08-31T06:04:19.876 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T06:04:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-08-31T06:04:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-08-31T06:04:19.876 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T06:04:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-08-31T06:04:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-08-31T06:04:19.877 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T06:04:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-08-31T06:04:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-08-31T06:04:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-31T06:04:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42225sec preferred_lft 42225sec 2024-08-31T06:04:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ed15:1297:9a9f:8d8f/64 scope link noprefixroute 2024-08-31T06:04:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-08-31T06:04:19.877 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T06:04:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-08-31T06:04:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-08-31T06:04:19.878 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T06:04:19.878 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T06:04:19.878 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-08-31T06:04:19.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add name ceph-brx type bridge 2024-08-31T06:04:19.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr flush dev ceph-brx 2024-08-31T06:04:19.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set ceph-brx up 2024-08-31T06:04:19.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T06:04:19.878 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-08-31T06:04:19.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:19 smithi130 ceph-mon[22266]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 895 B/s wr, 12 op/s 2024-08-31T06:04:19.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:19 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2900020545' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T06:04:19.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:19 smithi153 ceph-mon[22320]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 895 B/s wr, 12 op/s 2024-08-31T06:04:19.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:19 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2900020545' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T06:04:19.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T06:04:20.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:04:20.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:20.073 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T06:04:20.097 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-08-31T06:04:20.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:20.099 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-08-31T06:04:20.195 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-08-31T06:04:20.195 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T06:04:20.195 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-31T06:04:20.195 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-31T06:04:20.195 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T06:04:20.196 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T06:04:20.196 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-08-31T06:04:20.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-31T06:04:20.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-31T06:04:20.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-31T06:04:20.196 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-08-31T06:04:20.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T06:04:20.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:04:20.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:20.456 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-08-31T06:04:20.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:20.472 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2024-08-31T06:04:20.526 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T06:04:20.527 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-08-31T06:04:20.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:04:20.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-31T06:04:20.527 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-08-31T06:04:20.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T06:04:20.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:04:20.645 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-31T06:04:20.645 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T06:04:20.645 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-08-31T06:04:20.645 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-31T06:04:20.645 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T06:04:20.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-31T06:04:20.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-31T06:04:20.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-31T06:04:20.646 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-08-31T06:04:20.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T06:04:20.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:04:20.853 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T06:04:20.853 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-08-31T06:04:20.853 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-08-31T06:04:20.853 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T06:04:20.853 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-08-31T06:04:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T06:04:20.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:04:20.930 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-08-31T06:04:20.930 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T06:04:20.930 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-31T06:04:20.945 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-31T06:04:20.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T06:04:20.946 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-31T06:04:21.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-08-31T06:04:21.066 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T06:04:21.122 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2024-08-31T06:04:21.122 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2024-08-31T06:04:21.122 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2024-08-31T06:04:21.122 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2024-08-31T06:04:21.122 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2024-08-31T06:04:21.122 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2024-08-31T06:04:21.122 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2024-08-31T06:04:21.122 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2024-08-31T06:04:21.122 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2024-08-31T06:04:21.122 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/selinux 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T06:04:21.123 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/b3f0ed6e91908c0985d456de0b0872f53f611890c1bd041cccbd9d924a45059d/merged 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/20d5c642c297701f6760a2b2a2967cfb49365e7e060526d94cf89b637700166e/merged 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/0 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/8475a4275bc7226308fc4429364b83e3a5e63e6d91a1f6ecbef78c9643ef939f/merged 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/a7766874a2a91220137adb2819f7b61dc5b4c4496bd86def4e39566f7db7ab3a/merged 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/6370a03e5804edacdea3b54cdd36868530b680df573bda0ad516c5237ca8f213/merged 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/9514548f4ac7049cf52d7bbed307b981848ff9457a3d626ab4ad400dcc867cf3/merged 2024-08-31T06:04:21.124 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/c9cd14b40d00e6da5dbda6bab920349dccbde01de70ea6dcae1c3dd83debd56d/merged 2024-08-31T06:04:21.125 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/2830c3e6a864eb202e991d4f3f247e4d33f7fb04cca79bf46ade397759aaf532/merged 2024-08-31T06:04:21.125 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/d3fc6021b8b4472a66a2c928e414a6ad3f62658f9d5d60e07432764686ef7c28/merged 2024-08-31T06:04:21.125 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/713fc6e9cb8ef4c563cab77f4e060cb8a7416c61c54c2edeee88ed2a1e46f2d3/merged 2024-08-31T06:04:21.125 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2024-08-31T06:04:21.125 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:04:21.125 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:04:21.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:21.125 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-08-31T06:04:21.176 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-31T06:04:21.177 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f --client_fs=cephfs) 2024-08-31T06:04:21.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-08-31T06:04:21.243 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T06:04:21.299 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2024-08-31T06:04:21.299 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2024-08-31T06:04:21.299 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2024-08-31T06:04:21.299 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2024-08-31T06:04:21.299 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/selinux 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2024-08-31T06:04:21.300 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/b3f0ed6e91908c0985d456de0b0872f53f611890c1bd041cccbd9d924a45059d/merged 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/20d5c642c297701f6760a2b2a2967cfb49365e7e060526d94cf89b637700166e/merged 2024-08-31T06:04:21.301 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/0 2024-08-31T06:04:21.302 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:04:21.302 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/8475a4275bc7226308fc4429364b83e3a5e63e6d91a1f6ecbef78c9643ef939f/merged 2024-08-31T06:04:21.302 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/a7766874a2a91220137adb2819f7b61dc5b4c4496bd86def4e39566f7db7ab3a/merged 2024-08-31T06:04:21.302 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/6370a03e5804edacdea3b54cdd36868530b680df573bda0ad516c5237ca8f213/merged 2024-08-31T06:04:21.302 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/9514548f4ac7049cf52d7bbed307b981848ff9457a3d626ab4ad400dcc867cf3/merged 2024-08-31T06:04:21.302 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/c9cd14b40d00e6da5dbda6bab920349dccbde01de70ea6dcae1c3dd83debd56d/merged 2024-08-31T06:04:21.302 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/2830c3e6a864eb202e991d4f3f247e4d33f7fb04cca79bf46ade397759aaf532/merged 2024-08-31T06:04:21.302 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/d3fc6021b8b4472a66a2c928e414a6ad3f62658f9d5d60e07432764686ef7c28/merged 2024-08-31T06:04:21.302 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/713fc6e9cb8ef4c563cab77f4e060cb8a7416c61c54c2edeee88ed2a1e46f2d3/merged 2024-08-31T06:04:21.303 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2024-08-31T06:04:21.303 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:04:21.303 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:04:21.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:21.303 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-08-31T06:04:21.380 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-08-31T06:04:21.378+0000 7fd635874480 -1 init, newargv = 0x7fd624056f60 newargc=15 2024-08-31T06:04:21.381 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[75048]: starting ceph client 2024-08-31T06:04:21.405 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[75048]: starting fuse 2024-08-31T06:04:21.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:21 smithi053 ceph-mon[18924]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 895 B/s wr, 12 op/s; 8 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T06:04:21.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:21 smithi130 ceph-mon[22266]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 895 B/s wr, 12 op/s; 8 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T06:04:21.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:21 smithi153 ceph-mon[22320]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 895 B/s wr, 12 op/s; 8 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T06:04:22.455 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-08-31T06:04:22.487 DEBUG:teuthology.orchestra.run.smithi053:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T06:04:22.545 INFO:teuthology.orchestra.run.smithi053.stdout:/proc 2024-08-31T06:04:22.545 INFO:teuthology.orchestra.run.smithi053.stdout:/sys 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/dev 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/security 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/shm 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/pts 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/run 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/cgroup 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/pstore 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/bpf 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/ 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/selinux 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/hugepages 2024-08-31T06:04:22.546 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/mqueue 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/debug 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/tracing 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/kernel/config 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/sys/fs/fuse/connections 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/1000 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/ceph 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay 2024-08-31T06:04:22.547 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/b3f0ed6e91908c0985d456de0b0872f53f611890c1bd041cccbd9d924a45059d/merged 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/20d5c642c297701f6760a2b2a2967cfb49365e7e060526d94cf89b637700166e/merged 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/run/user/0 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/8475a4275bc7226308fc4429364b83e3a5e63e6d91a1f6ecbef78c9643ef939f/merged 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/a7766874a2a91220137adb2819f7b61dc5b4c4496bd86def4e39566f7db7ab3a/merged 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/6370a03e5804edacdea3b54cdd36868530b680df573bda0ad516c5237ca8f213/merged 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/9514548f4ac7049cf52d7bbed307b981848ff9457a3d626ab4ad400dcc867cf3/merged 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/c9cd14b40d00e6da5dbda6bab920349dccbde01de70ea6dcae1c3dd83debd56d/merged 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/2830c3e6a864eb202e991d4f3f247e4d33f7fb04cca79bf46ade397759aaf532/merged 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/d3fc6021b8b4472a66a2c928e414a6ad3f62658f9d5d60e07432764686ef7c28/merged 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/var/lib/containers/storage/overlay/713fc6e9cb8ef4c563cab77f4e060cb8a7416c61c54c2edeee88ed2a1e46f2d3/merged 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:04:22.548 INFO:teuthology.orchestra.run.smithi053.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:04:22.549 INFO:teuthology.orchestra.run.smithi053.stdout:/home/ubuntu/cephtest/mnt.0 2024-08-31T06:04:22.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:22.549 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-08-31T06:04:22.603 INFO:teuthology.orchestra.run.smithi053.stdout:121 2024-08-31T06:04:22.604 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2024-08-31T06:04:22.604 DEBUG:teuthology.orchestra.run.smithi053:> sudo stdin-killer -- python3 -c ' 2024-08-31T06:04:22.604 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-08-31T06:04:22.604 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-08-31T06:04:22.604 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-08-31T06:04:22.604 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-08-31T06:04:22.604 DEBUG:teuthology.orchestra.run.smithi053:> 2024-08-31T06:04:22.604 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-08-31T06:04:22.604 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-31T06:04:22.604 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-08-31T06:04:22.604 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-31T06:04:22.605 DEBUG:teuthology.orchestra.run.smithi053:> 2024-08-31T06:04:22.606 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-08-31T06:04:22.606 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-08-31T06:04:22.728 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.75048.asok 2024-08-31T06:04:22.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:04:22.739 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.75048.asok 2024-08-31T06:04:22.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:22.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.75048.asok status 2024-08-31T06:04:22.884 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:22.884 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "d19e6118f7015f0047264006cb0c873528eb3ae6", 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "75048", 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f" 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 15441, 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-08-31T06:04:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 15441 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3784308033 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-08-31T06:04:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-08-31T06:04:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3784308033 2024-08-31T06:04:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:04:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.15441 192.168.0.1:0/3784308033", 2024-08-31T06:04:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3784308033", 2024-08-31T06:04:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 5, 2024-08-31T06:04:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 27, 2024-08-31T06:04:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 74, 2024-08-31T06:04:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-08-31T06:04:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-08-31T06:04:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-08-31T06:04:22.887 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:22.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:22.893 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-08-31T06:04:22.893 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-31T06:04:22.909 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-08-31T06:04:22.909 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-31T06:04:22.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:04:22.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-31T06:04:22.976 INFO:teuthology.run_tasks:Running task exec... 2024-08-31T06:04:22.990 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T06:04:22.990 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi053.front.sepia.ceph.com 2024-08-31T06:04:22.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-08-31T06:04:23.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.126+0000 7f07f1d20640 1 -- 172.21.15.53:0/3796079674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07ec108a00 msgr2=0x7f07ec10f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.126+0000 7f07f1d20640 1 --2- 172.21.15.53:0/3796079674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07ec108a00 0x7f07ec10f230 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009ca0 tx=0x7f07e402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.126+0000 7f07f1d20640 1 -- 172.21.15.53:0/3796079674 shutdown_connections 2024-08-31T06:04:23.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.126+0000 7f07f1d20640 1 --2- 172.21.15.53:0/3796079674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07ec108a00 0x7f07ec10f230 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.126+0000 7f07f1d20640 1 --2- 172.21.15.53:0/3796079674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07ec1080b0 0x7f07ec1084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.126+0000 7f07f1d20640 1 --2- 172.21.15.53:0/3796079674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07ec102780 0x7f07ec102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.126+0000 7f07f1d20640 1 -- 172.21.15.53:0/3796079674 >> 172.21.15.53:0/3796079674 conn(0x7f07ec0fe180 msgr2=0x7f07ec1005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:23.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.126+0000 7f07f1d20640 1 -- 172.21.15.53:0/3796079674 shutdown_connections 2024-08-31T06:04:23.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.126+0000 7f07f1d20640 1 -- 172.21.15.53:0/3796079674 wait complete. 2024-08-31T06:04:23.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.127+0000 7f07f1d20640 1 Processor -- start 2024-08-31T06:04:23.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.127+0000 7f07f1d20640 1 -- start start 2024-08-31T06:04:23.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.127+0000 7f07f1d20640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07ec102780 0x7f07ec19a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.127+0000 7f07f1d20640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07ec1080b0 0x7f07ec19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.127+0000 7f07f1d20640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07ec108a00 0x7f07ec19f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.127+0000 7f07f1d20640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec1125d0 con 0x7f07ec102780 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.127+0000 7f07f1d20640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec112450 con 0x7f07ec108a00 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.127+0000 7f07f1d20640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec112750 con 0x7f07ec1080b0 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.127+0000 7f07eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07ec102780 0x7f07ec19a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.127+0000 7f07eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07ec102780 0x7f07ec19a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40944/0 (socket says 172.21.15.53:40944) 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.127+0000 7f07eb7fe640 1 -- 172.21.15.53:0/3949497640 learned_addr learned my addr 172.21.15.53:0/3949497640 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07ebfff640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07ec108a00 0x7f07ec19f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07eaffd640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07ec1080b0 0x7f07ec19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07eb7fe640 1 -- 172.21.15.53:0/3949497640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07ec1080b0 msgr2=0x7f07ec19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07eb7fe640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07ec1080b0 0x7f07ec19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07eb7fe640 1 -- 172.21.15.53:0/3949497640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07ec108a00 msgr2=0x7f07ec19f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07eb7fe640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07ec108a00 0x7f07ec19f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07eb7fe640 1 -- 172.21.15.53:0/3949497640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec19ff40 con 0x7f07ec102780 2024-08-31T06:04:23.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07eb7fe640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07ec102780 0x7f07ec19a0a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00c920 tx=0x7f07dc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:23.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07e8ff9640 1 -- 172.21.15.53:0/3949497640 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc007c70 con 0x7f07ec102780 2024-08-31T06:04:23.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07e8ff9640 1 -- 172.21.15.53:0/3949497640 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07dc007e10 con 0x7f07ec102780 2024-08-31T06:04:23.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07f1d20640 1 -- 172.21.15.53:0/3949497640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ec1a0230 con 0x7f07ec102780 2024-08-31T06:04:23.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07e8ff9640 1 -- 172.21.15.53:0/3949497640 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc018710 con 0x7f07ec102780 2024-08-31T06:04:23.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.128+0000 7f07f1d20640 1 -- 172.21.15.53:0/3949497640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ec1a6a50 con 0x7f07ec102780 2024-08-31T06:04:23.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.129+0000 7f07f1d20640 1 -- 172.21.15.53:0/3949497640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07ec102b90 con 0x7f07ec102780 2024-08-31T06:04:23.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.131+0000 7f07e8ff9640 1 -- 172.21.15.53:0/3949497640 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f07dc00f450 con 0x7f07ec102780 2024-08-31T06:04:23.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.131+0000 7f07e8ff9640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07d40b4b80 0x7f07d40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.132+0000 7f07e8ff9640 1 -- 172.21.15.53:0/3949497640 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f07dc0e5660 con 0x7f07ec102780 2024-08-31T06:04:23.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.132+0000 7f07eaffd640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07d40b4b80 0x7f07d40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.132+0000 7f07eaffd640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07d40b4b80 0x7f07d40b7090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f07ec101930 tx=0x7f07e000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:23.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.135+0000 7f07e8ff9640 1 -- 172.21.15.53:0/3949497640 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f07dc014030 con 0x7f07ec102780 2024-08-31T06:04:23.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.358+0000 7f07f1d20640 1 -- 172.21.15.53:0/3949497640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f07ec1a6dc0 con 0x7f07ec102780 2024-08-31T06:04:23.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.450+0000 7f07e8ff9640 1 -- 172.21.15.53:0/3949497640 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f07dc0ac700 con 0x7f07ec102780 2024-08-31T06:04:23.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 -- 172.21.15.53:0/3949497640 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07d40b4b80 msgr2=0x7f07d40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07d40b4b80 0x7f07d40b7090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f07ec101930 tx=0x7f07e000b390 comp rx=0 tx=0).stop 2024-08-31T06:04:23.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 -- 172.21.15.53:0/3949497640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07ec102780 msgr2=0x7f07ec19a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07ec102780 0x7f07ec19a0a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00c920 tx=0x7f07dc00cde0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 -- 172.21.15.53:0/3949497640 shutdown_connections 2024-08-31T06:04:23.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07d40b4b80 0x7f07d40b7090 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07ec108a00 0x7f07ec19f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07ec1080b0 0x7f07ec19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 --2- 172.21.15.53:0/3949497640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07ec102780 0x7f07ec19a0a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 -- 172.21.15.53:0/3949497640 >> 172.21.15.53:0/3949497640 conn(0x7f07ec0fe180 msgr2=0x7f07ec1076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:23.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 -- 172.21.15.53:0/3949497640 shutdown_connections 2024-08-31T06:04:23.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.452+0000 7f07f1d20640 1 -- 172.21.15.53:0/3949497640 wait complete. 2024-08-31T06:04:23.466 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-31T06:04:23.477 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-31T06:04:23.493 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T06:04:23.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.601+0000 7f32967c1640 1 -- 172.21.15.53:0/1751446937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32901089a0 msgr2=0x7f329010f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.601+0000 7f32967c1640 1 --2- 172.21.15.53:0/1751446937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32901089a0 0x7f329010f1d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3288009ca0 tx=0x7f328802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.601+0000 7f32967c1640 1 -- 172.21.15.53:0/1751446937 shutdown_connections 2024-08-31T06:04:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.601+0000 7f32967c1640 1 --2- 172.21.15.53:0/1751446937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32901089a0 0x7f329010f1d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.601+0000 7f32967c1640 1 --2- 172.21.15.53:0/1751446937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3290108050 0x7f3290108460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.601+0000 7f32967c1640 1 --2- 172.21.15.53:0/1751446937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3290102720 0x7f3290102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.601+0000 7f32967c1640 1 -- 172.21.15.53:0/1751446937 >> 172.21.15.53:0/1751446937 conn(0x7f32900fe120 msgr2=0x7f3290100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.601+0000 7f32967c1640 1 -- 172.21.15.53:0/1751446937 shutdown_connections 2024-08-31T06:04:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.601+0000 7f32967c1640 1 -- 172.21.15.53:0/1751446937 wait complete. 2024-08-31T06:04:23.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.602+0000 7f32967c1640 1 Processor -- start 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.602+0000 7f32967c1640 1 -- start start 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.602+0000 7f32967c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3290102720 0x7f329019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.602+0000 7f32967c1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3290108050 0x7f329019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.602+0000 7f32967c1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32901089a0 0x7f329019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.602+0000 7f32967c1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3290112550 con 0x7f3290102720 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.602+0000 7f32967c1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32901123d0 con 0x7f32901089a0 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.602+0000 7f32967c1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32901126d0 con 0x7f3290108050 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.602+0000 7f328ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3290102720 0x7f329019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.602+0000 7f328ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3290102720 0x7f329019ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35826/0 (socket says 172.21.15.53:35826) 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.602+0000 7f328ffff640 1 -- 172.21.15.53:0/1349002891 learned_addr learned my addr 172.21.15.53:0/1349002891 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f3287fff640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3290108050 0x7f329019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f328ffff640 1 -- 172.21.15.53:0/1349002891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3290108050 msgr2=0x7f329019b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f328ffff640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3290108050 0x7f329019b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f3294d5e640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32901089a0 0x7f329019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f328ffff640 1 -- 172.21.15.53:0/1349002891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32901089a0 msgr2=0x7f329019b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f328ffff640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32901089a0 0x7f329019b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f328ffff640 1 -- 172.21.15.53:0/1349002891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32901a6040 con 0x7f3290102720 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f3287fff640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3290108050 0x7f329019b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f3294d5e640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32901089a0 0x7f329019b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f328ffff640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3290102720 0x7f329019ae40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f328000e9f0 tx=0x7f328000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f328dffb640 1 -- 172.21.15.53:0/1349002891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328000cd80 con 0x7f3290102720 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f328dffb640 1 -- 172.21.15.53:0/1349002891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32800108c0 con 0x7f3290102720 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f32967c1640 1 -- 172.21.15.53:0/1349002891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32901a6330 con 0x7f3290102720 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f328dffb640 1 -- 172.21.15.53:0/1349002891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32800187c0 con 0x7f3290102720 2024-08-31T06:04:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.603+0000 7f32967c1640 1 -- 172.21.15.53:0/1349002891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32901a6880 con 0x7f3290102720 2024-08-31T06:04:23.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.604+0000 7f32967c1640 1 -- 172.21.15.53:0/1349002891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3290102b30 con 0x7f3290102720 2024-08-31T06:04:23.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.606+0000 7f328dffb640 1 -- 172.21.15.53:0/1349002891 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f3280010430 con 0x7f3290102720 2024-08-31T06:04:23.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.607+0000 7f328dffb640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f327c0b4b80 0x7f327c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.607+0000 7f3287fff640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f327c0b4b80 0x7f327c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.607+0000 7f328dffb640 1 -- 172.21.15.53:0/1349002891 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f32800e5c50 con 0x7f3290102720 2024-08-31T06:04:23.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.608+0000 7f3287fff640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f327c0b4b80 0x7f327c0b7090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3290101970 tx=0x7f3278005d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:23.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.610+0000 7f328dffb640 1 -- 172.21.15.53:0/1349002891 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f32800acc60 con 0x7f3290102720 2024-08-31T06:04:23.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:23 smithi053 ceph-mon[18924]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 11 op/s; 8 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T06:04:23.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:23 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3949497640' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-31T06:04:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.796+0000 7f32967c1640 1 -- 172.21.15.53:0/1349002891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f329002e430 con 0x7f3290102720 2024-08-31T06:04:23.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.798+0000 7f328dffb640 1 -- 172.21.15.53:0/1349002891 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+23101 (secure 0 0 0) 0x7f32800b51a0 con 0x7f3290102720 2024-08-31T06:04:23.800 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:23.800 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":74,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:04:16.424259+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:04:23.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.800+0000 7f32967c1640 1 -- 172.21.15.53:0/1349002891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f327c0b4b80 msgr2=0x7f327c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.800+0000 7f32967c1640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f327c0b4b80 0x7f327c0b7090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3290101970 tx=0x7f3278005d90 comp rx=0 tx=0).stop 2024-08-31T06:04:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.800+0000 7f32967c1640 1 -- 172.21.15.53:0/1349002891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3290102720 msgr2=0x7f329019ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.800+0000 7f32967c1640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3290102720 0x7f329019ae40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f328000e9f0 tx=0x7f328000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.800+0000 7f32967c1640 1 -- 172.21.15.53:0/1349002891 shutdown_connections 2024-08-31T06:04:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.800+0000 7f32967c1640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f327c0b4b80 0x7f327c0b7090 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.800+0000 7f32967c1640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32901089a0 0x7f329019b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.800+0000 7f32967c1640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3290108050 0x7f329019b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.800+0000 7f32967c1640 1 --2- 172.21.15.53:0/1349002891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3290102720 0x7f329019ae40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.800+0000 7f32967c1640 1 -- 172.21.15.53:0/1349002891 >> 172.21.15.53:0/1349002891 conn(0x7f32900fe120 msgr2=0x7f3290106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.801+0000 7f32967c1640 1 -- 172.21.15.53:0/1349002891 shutdown_connections 2024-08-31T06:04:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.801+0000 7f32967c1640 1 -- 172.21.15.53:0/1349002891 wait complete. 2024-08-31T06:04:23.814 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T05:58:04.713426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T06:02:26.602694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T06:02:29.237487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T06:04:23.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T06:04:23.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:23 smithi130 ceph-mon[22266]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 11 op/s; 8 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T06:04:23.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:23 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3949497640' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-31T06:04:23.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:23 smithi153 ceph-mon[22320]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 11 op/s; 8 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T06:04:23.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:23 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3949497640' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-31T06:04:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.927+0000 7fa27b794640 1 -- 172.21.15.53:0/201847927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2741080a0 msgr2=0x7fa2741084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.927+0000 7fa27b794640 1 --2- 172.21.15.53:0/201847927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2741080a0 0x7fa2741084b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa264009900 tx=0x7fa26402a410 comp rx=0 tx=0).stop 2024-08-31T06:04:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.927+0000 7fa27b794640 1 -- 172.21.15.53:0/201847927 shutdown_connections 2024-08-31T06:04:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.927+0000 7fa27b794640 1 --2- 172.21.15.53:0/201847927 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2741089f0 0x7fa27410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.927+0000 7fa27b794640 1 --2- 172.21.15.53:0/201847927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2741080a0 0x7fa2741084b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.927+0000 7fa27b794640 1 --2- 172.21.15.53:0/201847927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2741027c0 0x7fa274102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.927+0000 7fa27b794640 1 -- 172.21.15.53:0/201847927 >> 172.21.15.53:0/201847927 conn(0x7fa2740793d0 msgr2=0x7fa2740797e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.927+0000 7fa27b794640 1 -- 172.21.15.53:0/201847927 shutdown_connections 2024-08-31T06:04:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.927+0000 7fa27b794640 1 -- 172.21.15.53:0/201847927 wait complete. 2024-08-31T06:04:23.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.927+0000 7fa27b794640 1 Processor -- start 2024-08-31T06:04:23.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.927+0000 7fa27b794640 1 -- start start 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa27b794640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2741027c0 0x7fa27419af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa27b794640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2741080a0 0x7fa27419b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa27b794640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2741089f0 0x7fa27419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa27b794640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa274112530 con 0x7fa2741089f0 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa27b794640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2741123b0 con 0x7fa2741080a0 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa27b794640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2741126b0 con 0x7fa2741027c0 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa279d31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2741089f0 0x7fa27419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa279d31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2741089f0 0x7fa27419b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35848/0 (socket says 172.21.15.53:35848) 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa279d31640 1 -- 172.21.15.53:0/771336035 learned_addr learned my addr 172.21.15.53:0/771336035 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa278d2f640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2741080a0 0x7fa27419b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa279530640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2741027c0 0x7fa27419af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa279d31640 1 -- 172.21.15.53:0/771336035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2741027c0 msgr2=0x7fa27419af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa279d31640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2741027c0 0x7fa27419af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa279d31640 1 -- 172.21.15.53:0/771336035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2741080a0 msgr2=0x7fa27419b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:23.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa279d31640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2741080a0 0x7fa27419b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:23.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa279d31640 1 -- 172.21.15.53:0/771336035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2741a6210 con 0x7fa2741089f0 2024-08-31T06:04:23.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa279d31640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2741089f0 0x7fa27419b980 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009fd0 tx=0x7fa26c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:23.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa26a7fc640 1 -- 172.21.15.53:0/771336035 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c017070 con 0x7fa2741089f0 2024-08-31T06:04:23.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa26a7fc640 1 -- 172.21.15.53:0/771336035 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa26c003e00 con 0x7fa2741089f0 2024-08-31T06:04:23.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa26a7fc640 1 -- 172.21.15.53:0/771336035 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c010460 con 0x7fa2741089f0 2024-08-31T06:04:23.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.928+0000 7fa27b794640 1 -- 172.21.15.53:0/771336035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2741a6500 con 0x7fa2741089f0 2024-08-31T06:04:23.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.929+0000 7fa27b794640 1 -- 172.21.15.53:0/771336035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2741a6a70 con 0x7fa2741089f0 2024-08-31T06:04:23.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.929+0000 7fa27b794640 1 -- 172.21.15.53:0/771336035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa274102bd0 con 0x7fa2741089f0 2024-08-31T06:04:23.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.931+0000 7fa26a7fc640 1 -- 172.21.15.53:0/771336035 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fa26c003970 con 0x7fa2741089f0 2024-08-31T06:04:23.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.932+0000 7fa26a7fc640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2600b4c00 0x7fa2600b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:23.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.932+0000 7fa279530640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2600b4c00 0x7fa2600b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:23.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.932+0000 7fa26a7fc640 1 -- 172.21.15.53:0/771336035 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa26c0e52e0 con 0x7fa2741089f0 2024-08-31T06:04:23.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.933+0000 7fa279530640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2600b4c00 0x7fa2600b7110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa27406c200 tx=0x7fa270005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:23.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:23.935+0000 7fa26a7fc640 1 -- 172.21.15.53:0/771336035 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa26c0abd20 con 0x7fa2741089f0 2024-08-31T06:04:24.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.118+0000 7fa27b794640 1 -- 172.21.15.53:0/771336035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa27402e430 con 0x7fa2741089f0 2024-08-31T06:04:24.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.118+0000 7fa26a7fc640 1 -- 172.21.15.53:0/771336035 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7fa26c0b04e0 con 0x7fa2741089f0 2024-08-31T06:04:24.120 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-08-31T06:04:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 -- 172.21.15.53:0/771336035 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2600b4c00 msgr2=0x7fa2600b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2600b4c00 0x7fa2600b7110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa27406c200 tx=0x7fa270005f90 comp rx=0 tx=0).stop 2024-08-31T06:04:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 -- 172.21.15.53:0/771336035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2741089f0 msgr2=0x7fa27419b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2741089f0 0x7fa27419b980 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009fd0 tx=0x7fa26c00b260 comp rx=0 tx=0).stop 2024-08-31T06:04:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 -- 172.21.15.53:0/771336035 shutdown_connections 2024-08-31T06:04:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2600b4c00 0x7fa2600b7110 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2741089f0 0x7fa27419b980 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2741080a0 0x7fa27419b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 --2- 172.21.15.53:0/771336035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2741027c0 0x7fa27419af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 -- 172.21.15.53:0/771336035 >> 172.21.15.53:0/771336035 conn(0x7fa2740793d0 msgr2=0x7fa274104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 -- 172.21.15.53:0/771336035 shutdown_connections 2024-08-31T06:04:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.120+0000 7fa27b794640 1 -- 172.21.15.53:0/771336035 wait complete. 2024-08-31T06:04:24.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T06:04:24.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.246+0000 7f7e8410b640 1 -- 172.21.15.53:0/2244466569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e7c1089b0 msgr2=0x7f7e7c10f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.246+0000 7f7e8410b640 1 --2- 172.21.15.53:0/2244466569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e7c1089b0 0x7f7e7c10f1e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009ca0 tx=0x7f7e7402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.246+0000 7f7e8410b640 1 -- 172.21.15.53:0/2244466569 shutdown_connections 2024-08-31T06:04:24.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.246+0000 7f7e8410b640 1 --2- 172.21.15.53:0/2244466569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e7c1089b0 0x7f7e7c10f1e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.246+0000 7f7e8410b640 1 --2- 172.21.15.53:0/2244466569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e7c108060 0x7f7e7c108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.246+0000 7f7e8410b640 1 --2- 172.21.15.53:0/2244466569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c102730 0x7f7e7c102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.246+0000 7f7e8410b640 1 -- 172.21.15.53:0/2244466569 >> 172.21.15.53:0/2244466569 conn(0x7f7e7c0fe150 msgr2=0x7f7e7c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.246+0000 7f7e8410b640 1 -- 172.21.15.53:0/2244466569 shutdown_connections 2024-08-31T06:04:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.246+0000 7f7e8410b640 1 -- 172.21.15.53:0/2244466569 wait complete. 2024-08-31T06:04:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e8410b640 1 Processor -- start 2024-08-31T06:04:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e8410b640 1 -- start start 2024-08-31T06:04:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e8410b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e7c102730 0x7f7e7c19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e8410b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e7c108060 0x7f7e7c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e8410b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c1089b0 0x7f7e7c19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e8410b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c112580 con 0x7f7e7c102730 2024-08-31T06:04:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e8410b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c112400 con 0x7f7e7c108060 2024-08-31T06:04:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e8410b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c112700 con 0x7f7e7c1089b0 2024-08-31T06:04:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e81ea7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e7c102730 0x7f7e7c19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:24.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e81ea7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e7c102730 0x7f7e7c19a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35868/0 (socket says 172.21.15.53:35868) 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e81ea7640 1 -- 172.21.15.53:0/1580523320 learned_addr learned my addr 172.21.15.53:0/1580523320 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e826a8640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c1089b0 0x7f7e7c19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e816a6640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e7c108060 0x7f7e7c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e81ea7640 1 -- 172.21.15.53:0/1580523320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c1089b0 msgr2=0x7f7e7c19f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e81ea7640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c1089b0 0x7f7e7c19f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e81ea7640 1 -- 172.21.15.53:0/1580523320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e7c108060 msgr2=0x7f7e7c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e81ea7640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e7c108060 0x7f7e7c19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e81ea7640 1 -- 172.21.15.53:0/1580523320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c1a0020 con 0x7f7e7c102730 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.247+0000 7f7e816a6640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e7c108060 0x7f7e7c19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.248+0000 7f7e81ea7640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e7c102730 0x7f7e7c19a0f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800d770 tx=0x7f7e7800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.248+0000 7f7e72ffd640 1 -- 172.21.15.53:0/1580523320 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78017070 con 0x7f7e7c102730 2024-08-31T06:04:24.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.248+0000 7f7e72ffd640 1 -- 172.21.15.53:0/1580523320 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e780054b0 con 0x7f7e7c102730 2024-08-31T06:04:24.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.248+0000 7f7e72ffd640 1 -- 172.21.15.53:0/1580523320 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78004c60 con 0x7f7e7c102730 2024-08-31T06:04:24.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.248+0000 7f7e8410b640 1 -- 172.21.15.53:0/1580523320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7c1a0310 con 0x7f7e7c102730 2024-08-31T06:04:24.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.248+0000 7f7e8410b640 1 -- 172.21.15.53:0/1580523320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7c1a6aa0 con 0x7f7e7c102730 2024-08-31T06:04:24.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.249+0000 7f7e8410b640 1 -- 172.21.15.53:0/1580523320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e7c102b40 con 0x7f7e7c102730 2024-08-31T06:04:24.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.252+0000 7f7e72ffd640 1 -- 172.21.15.53:0/1580523320 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f7e78004e00 con 0x7f7e7c102730 2024-08-31T06:04:24.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.252+0000 7f7e72ffd640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4c00 0x7f7e680b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:24.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.252+0000 7f7e72ffd640 1 -- 172.21.15.53:0/1580523320 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7e780e5100 con 0x7f7e7c102730 2024-08-31T06:04:24.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.252+0000 7f7e816a6640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4c00 0x7f7e680b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:24.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.253+0000 7f7e816a6640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4c00 0x7f7e680b7110 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c005fd0 tx=0x7f7e6c005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:24.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.255+0000 7f7e72ffd640 1 -- 172.21.15.53:0/1580523320 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7e780ac190 con 0x7f7e7c102730 2024-08-31T06:04:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.443+0000 7f7e8410b640 1 -- 172.21.15.53:0/1580523320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7e7c02e430 con 0x7f7e7c102730 2024-08-31T06:04:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.443+0000 7f7e72ffd640 1 -- 172.21.15.53:0/1580523320 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) ==== 104+0+11 (secure 0 0 0) 0x7f7e780a7030 con 0x7f7e7c102730 2024-08-31T06:04:24.446 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-08-31T06:04:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 -- 172.21.15.53:0/1580523320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4c00 msgr2=0x7f7e680b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4c00 0x7f7e680b7110 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c005fd0 tx=0x7f7e6c005850 comp rx=0 tx=0).stop 2024-08-31T06:04:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 -- 172.21.15.53:0/1580523320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e7c102730 msgr2=0x7f7e7c19a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e7c102730 0x7f7e7c19a0f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800d770 tx=0x7f7e7800dc30 comp rx=0 tx=0).stop 2024-08-31T06:04:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 -- 172.21.15.53:0/1580523320 shutdown_connections 2024-08-31T06:04:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4c00 0x7f7e680b7110 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c1089b0 0x7f7e7c19f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e7c108060 0x7f7e7c19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 --2- 172.21.15.53:0/1580523320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e7c102730 0x7f7e7c19a0f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 -- 172.21.15.53:0/1580523320 >> 172.21.15.53:0/1580523320 conn(0x7f7e7c0fe150 msgr2=0x7f7e7c06a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 -- 172.21.15.53:0/1580523320 shutdown_connections 2024-08-31T06:04:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.446+0000 7f7e8410b640 1 -- 172.21.15.53:0/1580523320 wait complete. 2024-08-31T06:04:24.460 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T06:04:24.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.572+0000 7f1c7345a640 1 -- 172.21.15.53:0/3247441229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c6c108060 msgr2=0x7f1c6c108470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.572+0000 7f1c7345a640 1 --2- 172.21.15.53:0/3247441229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c6c108060 0x7f1c6c108470 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009900 tx=0x7f1c5c02a410 comp rx=0 tx=0).stop 2024-08-31T06:04:24.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.572+0000 7f1c7345a640 1 -- 172.21.15.53:0/3247441229 shutdown_connections 2024-08-31T06:04:24.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.572+0000 7f1c7345a640 1 --2- 172.21.15.53:0/3247441229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1089b0 0x7f1c6c10f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.572+0000 7f1c7345a640 1 --2- 172.21.15.53:0/3247441229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c6c108060 0x7f1c6c108470 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.572+0000 7f1c7345a640 1 --2- 172.21.15.53:0/3247441229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c6c102730 0x7f1c6c102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.572+0000 7f1c7345a640 1 -- 172.21.15.53:0/3247441229 >> 172.21.15.53:0/3247441229 conn(0x7f1c6c0fe150 msgr2=0x7f1c6c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:24.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.572+0000 7f1c7345a640 1 -- 172.21.15.53:0/3247441229 shutdown_connections 2024-08-31T06:04:24.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.572+0000 7f1c7345a640 1 -- 172.21.15.53:0/3247441229 wait complete. 2024-08-31T06:04:24.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c7345a640 1 Processor -- start 2024-08-31T06:04:24.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c7345a640 1 -- start start 2024-08-31T06:04:24.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c7345a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c6c102730 0x7f1c6c19aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:24.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c7345a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c6c108060 0x7f1c6c19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:24.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c7345a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1089b0 0x7f1c6c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c7345a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c1124f0 con 0x7f1c6c102730 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c7345a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c112370 con 0x7f1c6c108060 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c7345a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c112670 con 0x7f1c6c1089b0 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c711f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c6c102730 0x7f1c6c19aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c711f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c6c102730 0x7f1c6c19aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35894/0 (socket says 172.21.15.53:35894) 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c711f6640 1 -- 172.21.15.53:0/2665458926 learned_addr learned my addr 172.21.15.53:0/2665458926 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.573+0000 7f1c719f7640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1089b0 0x7f1c6c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c709f5640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c6c108060 0x7f1c6c19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c711f6640 1 -- 172.21.15.53:0/2665458926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1089b0 msgr2=0x7f1c6c19b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c711f6640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1089b0 0x7f1c6c19b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c711f6640 1 -- 172.21.15.53:0/2665458926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c6c108060 msgr2=0x7f1c6c19b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c711f6640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c6c108060 0x7f1c6c19b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c711f6640 1 -- 172.21.15.53:0/2665458926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c1a60f0 con 0x7f1c6c102730 2024-08-31T06:04:24.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c709f5640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c6c108060 0x7f1c6c19b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:24.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c711f6640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c6c102730 0x7f1c6c19aec0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c920 tx=0x7f1c6800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:24.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c627fc640 1 -- 172.21.15.53:0/2665458926 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68007c70 con 0x7f1c6c102730 2024-08-31T06:04:24.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c627fc640 1 -- 172.21.15.53:0/2665458926 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c68007e10 con 0x7f1c6c102730 2024-08-31T06:04:24.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c7345a640 1 -- 172.21.15.53:0/2665458926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6c1a63e0 con 0x7f1c6c102730 2024-08-31T06:04:24.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c627fc640 1 -- 172.21.15.53:0/2665458926 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68018710 con 0x7f1c6c102730 2024-08-31T06:04:24.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.574+0000 7f1c7345a640 1 -- 172.21.15.53:0/2665458926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6c1a6980 con 0x7f1c6c102730 2024-08-31T06:04:24.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.575+0000 7f1c7345a640 1 -- 172.21.15.53:0/2665458926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6c102b40 con 0x7f1c6c102730 2024-08-31T06:04:24.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.577+0000 7f1c627fc640 1 -- 172.21.15.53:0/2665458926 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f1c6800f450 con 0x7f1c6c102730 2024-08-31T06:04:24.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.577+0000 7f1c627fc640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c580b4c00 0x7f1c580b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:24.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.577+0000 7f1c709f5640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c580b4c00 0x7f1c580b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:24.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.577+0000 7f1c627fc640 1 -- 172.21.15.53:0/2665458926 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1c680e5730 con 0x7f1c6c102730 2024-08-31T06:04:24.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.578+0000 7f1c709f5640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c580b4c00 0x7f1c580b7110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c006010 tx=0x7f1c5c000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:24.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.580+0000 7f1c627fc640 1 -- 172.21.15.53:0/2665458926 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1c68014030 con 0x7f1c6c102730 2024-08-31T06:04:24.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:24 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3949497640' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-31T06:04:24.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:24 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:04:24.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:24 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1349002891' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:24.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:24 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/771336035' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:04:24.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:24 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1580523320' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:04:24.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.767+0000 7f1c7345a640 1 -- 172.21.15.53:0/2665458926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1c6c02e430 con 0x7f1c6c102730 2024-08-31T06:04:24.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.768+0000 7f1c627fc640 1 -- 172.21.15.53:0/2665458926 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) ==== 100+0+11 (secure 0 0 0) 0x7f1c680ac850 con 0x7f1c6c102730 2024-08-31T06:04:24.770 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-08-31T06:04:24.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 -- 172.21.15.53:0/2665458926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c580b4c00 msgr2=0x7f1c580b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c580b4c00 0x7f1c580b7110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c006010 tx=0x7f1c5c000bc0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 -- 172.21.15.53:0/2665458926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c6c102730 msgr2=0x7f1c6c19aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c6c102730 0x7f1c6c19aec0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c920 tx=0x7f1c6800cde0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 -- 172.21.15.53:0/2665458926 shutdown_connections 2024-08-31T06:04:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c580b4c00 0x7f1c580b7110 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1089b0 0x7f1c6c19b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c6c108060 0x7f1c6c19b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 --2- 172.21.15.53:0/2665458926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c6c102730 0x7f1c6c19aec0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 -- 172.21.15.53:0/2665458926 >> 172.21.15.53:0/2665458926 conn(0x7f1c6c0fe150 msgr2=0x7f1c6c100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 -- 172.21.15.53:0/2665458926 shutdown_connections 2024-08-31T06:04:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:24.770+0000 7f1c7345a640 1 -- 172.21.15.53:0/2665458926 wait complete. 2024-08-31T06:04:24.784 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-31T06:04:24.784 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:04:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:24 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3949497640' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-31T06:04:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:24 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:04:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:24 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1349002891' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:24 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/771336035' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:04:24.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:24 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1580523320' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:04:24.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:24 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3949497640' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-31T06:04:24.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:24 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:04:24.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:24 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1349002891' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:24.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:24 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/771336035' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:04:24.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:24 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1580523320' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:04:25.038 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.546+0000 7f886ff98640 1 -- 172.21.15.53:0/352478445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868109240 msgr2=0x7f8868109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.546+0000 7f886ff98640 1 --2- 172.21.15.53:0/352478445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868109240 0x7f8868109650 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8858009900 tx=0x7f885802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:04:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.546+0000 7f886ff98640 1 -- 172.21.15.53:0/352478445 shutdown_connections 2024-08-31T06:04:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.546+0000 7f886ff98640 1 --2- 172.21.15.53:0/352478445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8868109b90 0x7f88681103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.546+0000 7f886ff98640 1 --2- 172.21.15.53:0/352478445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868109240 0x7f8868109650 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.546+0000 7f886ff98640 1 --2- 172.21.15.53:0/352478445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8868103900 0x7f8868103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.546+0000 7f886ff98640 1 -- 172.21.15.53:0/352478445 >> 172.21.15.53:0/352478445 conn(0x7f886807b5f0 msgr2=0x7f886807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.546+0000 7f886ff98640 1 -- 172.21.15.53:0/352478445 shutdown_connections 2024-08-31T06:04:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.546+0000 7f886ff98640 1 -- 172.21.15.53:0/352478445 wait complete. 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.547+0000 7f886ff98640 1 Processor -- start 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.547+0000 7f886ff98640 1 -- start start 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.547+0000 7f886ff98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868103900 0x7f886819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.547+0000 7f886ff98640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8868109240 0x7f886819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.547+0000 7f886ff98640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8868109b90 0x7f886819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.547+0000 7f886ff98640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8868113700 con 0x7f8868103900 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886ff98640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8868113580 con 0x7f8868109b90 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886ff98640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8868113880 con 0x7f8868109240 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886dd34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868103900 0x7f886819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886dd34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868103900 0x7f886819a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35906/0 (socket says 172.21.15.53:35906) 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886dd34640 1 -- 172.21.15.53:0/3151211856 learned_addr learned my addr 172.21.15.53:0/3151211856 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886d533640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8868109240 0x7f886819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886e535640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8868109b90 0x7f886819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886dd34640 1 -- 172.21.15.53:0/3151211856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8868109240 msgr2=0x7f886819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886dd34640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8868109240 0x7f886819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886dd34640 1 -- 172.21.15.53:0/3151211856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8868109b90 msgr2=0x7f886819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886dd34640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8868109b90 0x7f886819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886dd34640 1 -- 172.21.15.53:0/3151211856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88681a0080 con 0x7f8868103900 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886d533640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8868109240 0x7f886819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886e535640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8868109b90 0x7f886819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886dd34640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868103900 0x7f886819a1d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f886400d950 tx=0x7f886400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f885effd640 1 -- 172.21.15.53:0/3151211856 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864017030 con 0x7f8868103900 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f885effd640 1 -- 172.21.15.53:0/3151211856 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8864004020 con 0x7f8868103900 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886ff98640 1 -- 172.21.15.53:0/3151211856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88681a0370 con 0x7f8868103900 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f885effd640 1 -- 172.21.15.53:0/3151211856 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88640055d0 con 0x7f8868103900 2024-08-31T06:04:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.548+0000 7f886ff98640 1 -- 172.21.15.53:0/3151211856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88681a6b90 con 0x7f8868103900 2024-08-31T06:04:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.550+0000 7f886ff98640 1 -- 172.21.15.53:0/3151211856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8868103d10 con 0x7f8868103900 2024-08-31T06:04:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.551+0000 7f885effd640 1 -- 172.21.15.53:0/3151211856 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f8864009a30 con 0x7f8868103900 2024-08-31T06:04:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.552+0000 7f885effd640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88540b4bb0 0x7f88540b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.552+0000 7f886d533640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88540b4bb0 0x7f88540b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.552+0000 7f885effd640 1 -- 172.21.15.53:0/3151211856 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f88640e4de0 con 0x7f8868103900 2024-08-31T06:04:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.552+0000 7f886d533640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88540b4bb0 0x7f88540b70c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f88580057c0 tx=0x7f8858009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.556+0000 7f885effd640 1 -- 172.21.15.53:0/3151211856 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f88640abdf0 con 0x7f8868103900 2024-08-31T06:04:25.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:25 smithi053 ceph-mon[18924]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s; 7 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T06:04:25.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:25 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2665458926' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:04:25.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.782+0000 7f886ff98640 1 -- 172.21.15.53:0/3151211856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f886819b300 con 0x7f8868103900 2024-08-31T06:04:25.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.782+0000 7f885effd640 1 -- 172.21.15.53:0/3151211856 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11985 (secure 0 0 0) 0x7f88640ab6f0 con 0x7f8868103900 2024-08-31T06:04:25.784 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:25.785 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-08-31T06:04:23:449285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:04:23.359453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:04:25.785 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-08-31T06:04:25.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 -- 172.21.15.53:0/3151211856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88540b4bb0 msgr2=0x7f88540b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:25.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88540b4bb0 0x7f88540b70c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f88580057c0 tx=0x7f8858009680 comp rx=0 tx=0).stop 2024-08-31T06:04:25.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 -- 172.21.15.53:0/3151211856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868103900 msgr2=0x7f886819a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:25.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868103900 0x7f886819a1d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f886400d950 tx=0x7f886400de10 comp rx=0 tx=0).stop 2024-08-31T06:04:25.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 -- 172.21.15.53:0/3151211856 shutdown_connections 2024-08-31T06:04:25.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88540b4bb0 0x7f88540b70c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:25.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8868109b90 0x7f886819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:25.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8868109240 0x7f886819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:25.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 --2- 172.21.15.53:0/3151211856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868103900 0x7f886819a1d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:25.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 -- 172.21.15.53:0/3151211856 >> 172.21.15.53:0/3151211856 conn(0x7f886807b5f0 msgr2=0x7f88681073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:25.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 -- 172.21.15.53:0/3151211856 shutdown_connections 2024-08-31T06:04:25.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:25.785+0000 7f886ff98640 1 -- 172.21.15.53:0/3151211856 wait complete. 2024-08-31T06:04:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:25 smithi130 ceph-mon[22266]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s; 7 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T06:04:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:25 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2665458926' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:04:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:25 smithi153 ceph-mon[22320]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s; 7 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T06:04:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:25 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2665458926' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:04:26.523 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-31T06:04:26.523 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-31T06:04:26.523 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T06:04:26.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.636+0000 7f8d4110b640 1 -- 172.21.15.53:0/834992636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d3c102720 msgr2=0x7f8d3c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:26.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.636+0000 7f8d4110b640 1 --2- 172.21.15.53:0/834992636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d3c102720 0x7f8d3c102b30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009900 tx=0x7f8d2c02a410 comp rx=0 tx=0).stop 2024-08-31T06:04:26.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.636+0000 7f8d4110b640 1 -- 172.21.15.53:0/834992636 shutdown_connections 2024-08-31T06:04:26.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.636+0000 7f8d4110b640 1 --2- 172.21.15.53:0/834992636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d3c1089a0 0x7f8d3c10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:26.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.636+0000 7f8d4110b640 1 --2- 172.21.15.53:0/834992636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d3c108050 0x7f8d3c108460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:26.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.636+0000 7f8d4110b640 1 --2- 172.21.15.53:0/834992636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d3c102720 0x7f8d3c102b30 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:26.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.636+0000 7f8d4110b640 1 -- 172.21.15.53:0/834992636 >> 172.21.15.53:0/834992636 conn(0x7f8d3c0fe120 msgr2=0x7f8d3c100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:26.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.636+0000 7f8d4110b640 1 -- 172.21.15.53:0/834992636 shutdown_connections 2024-08-31T06:04:26.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.636+0000 7f8d4110b640 1 -- 172.21.15.53:0/834992636 wait complete. 2024-08-31T06:04:26.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.637+0000 7f8d4110b640 1 Processor -- start 2024-08-31T06:04:26.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.637+0000 7f8d4110b640 1 -- start start 2024-08-31T06:04:26.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.637+0000 7f8d4110b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d3c102720 0x7f8d3c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:26.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.637+0000 7f8d4110b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d3c108050 0x7f8d3c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:26.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.637+0000 7f8d4110b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d3c1089a0 0x7f8d3c19f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:26.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.637+0000 7f8d4110b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c112520 con 0x7f8d3c1089a0 2024-08-31T06:04:26.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d4110b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c1123a0 con 0x7f8d3c108050 2024-08-31T06:04:26.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d4110b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c1126a0 con 0x7f8d3c102720 2024-08-31T06:04:26.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d3c1089a0 0x7f8d3c19f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d3b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d3c1089a0 0x7f8d3c19f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35914/0 (socket says 172.21.15.53:35914) 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d3b59e640 1 -- 172.21.15.53:0/952627094 learned_addr learned my addr 172.21.15.53:0/952627094 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d3ad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d3c102720 0x7f8d3c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d3a59c640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d3c108050 0x7f8d3c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d3b59e640 1 -- 172.21.15.53:0/952627094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d3c102720 msgr2=0x7f8d3c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d3b59e640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d3c102720 0x7f8d3c19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d3b59e640 1 -- 172.21.15.53:0/952627094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d3c108050 msgr2=0x7f8d3c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d3b59e640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d3c108050 0x7f8d3c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d3b59e640 1 -- 172.21.15.53:0/952627094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3c1a00a0 con 0x7f8d3c1089a0 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d3b59e640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d3c1089a0 0x7f8d3c19f9a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400eaa0 tx=0x7f8d3400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d23fff640 1 -- 172.21.15.53:0/952627094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400cdb0 con 0x7f8d3c1089a0 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d23fff640 1 -- 172.21.15.53:0/952627094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d34005020 con 0x7f8d3c1089a0 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d23fff640 1 -- 172.21.15.53:0/952627094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d340116d0 con 0x7f8d3c1089a0 2024-08-31T06:04:26.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d4110b640 1 -- 172.21.15.53:0/952627094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3c1a0390 con 0x7f8d3c1089a0 2024-08-31T06:04:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.638+0000 7f8d4110b640 1 -- 172.21.15.53:0/952627094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3c1a6b20 con 0x7f8d3c1089a0 2024-08-31T06:04:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.640+0000 7f8d4110b640 1 -- 172.21.15.53:0/952627094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3c102b30 con 0x7f8d3c1089a0 2024-08-31T06:04:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.641+0000 7f8d23fff640 1 -- 172.21.15.53:0/952627094 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f8d340051d0 con 0x7f8d3c1089a0 2024-08-31T06:04:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.642+0000 7f8d23fff640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d240b4b80 0x7f8d240b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:26.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.642+0000 7f8d3ad9d640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d240b4b80 0x7f8d240b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:26.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.642+0000 7f8d23fff640 1 -- 172.21.15.53:0/952627094 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f8d340e56c0 con 0x7f8d3c1089a0 2024-08-31T06:04:26.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.642+0000 7f8d3ad9d640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d240b4b80 0x7f8d240b7090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0057c0 tx=0x7f8d2c0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:26.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.645+0000 7f8d23fff640 1 -- 172.21.15.53:0/952627094 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d34016030 con 0x7f8d3c1089a0 2024-08-31T06:04:26.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:26 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3151211856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:26.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.831+0000 7f8d4110b640 1 -- 172.21.15.53:0/952627094 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d3c06b740 con 0x7f8d240b4b80 2024-08-31T06:04:26.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.836+0000 7f8d23fff640 1 -- 172.21.15.53:0/952627094 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258872 (secure 0 0 0) 0x7f8d3c06b740 con 0x7f8d240b4b80 2024-08-31T06:04:26.841 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:26.842 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-08-31T06:04:26.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 -- 172.21.15.53:0/952627094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d240b4b80 msgr2=0x7f8d240b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:26.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d240b4b80 0x7f8d240b7090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0057c0 tx=0x7f8d2c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:04:26.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 -- 172.21.15.53:0/952627094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d3c1089a0 msgr2=0x7f8d3c19f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:26.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d3c1089a0 0x7f8d3c19f9a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400eaa0 tx=0x7f8d3400ef60 comp rx=0 tx=0).stop 2024-08-31T06:04:26.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 -- 172.21.15.53:0/952627094 shutdown_connections 2024-08-31T06:04:26.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d240b4b80 0x7f8d240b7090 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:26.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d3c1089a0 0x7f8d3c19f9a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d3c108050 0x7f8d3c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 --2- 172.21.15.53:0/952627094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d3c102720 0x7f8d3c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 -- 172.21.15.53:0/952627094 >> 172.21.15.53:0/952627094 conn(0x7f8d3c0fe120 msgr2=0x7f8d3c101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 -- 172.21.15.53:0/952627094 shutdown_connections 2024-08-31T06:04:26.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:26.839+0000 7f8d4110b640 1 -- 172.21.15.53:0/952627094 wait complete. 2024-08-31T06:04:26.853 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-08-31T06:04:26.365842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660564,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1148,"num_read_kb":679,"num_write":390,"num_write_kb":2303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2951908,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":821,"ondisk_log_size":821,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390364,"kb_used_data":11964,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551460,"statfs":{"total":1151940427776,"available":1151540695040,"internally_reserved":0,"allocated":12251136,"data_stored":6947014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2855,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57,"num_write":20,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002544"},"pg_stats":[{"pgid":"3.3f","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436194+0000","last_change":"2024-08-31T06:02:30.611733+0000","last_active":"2024-08-31T06:04:16.436194+0000","last_peered":"2024-08-31T06:04:16.436194+0000","last_clean":"2024-08-31T06:04:16.436194+0000","last_became_active":"2024-08-31T06:02:30.610339+0000","last_became_peered":"2024-08-31T06:02:30.610339+0000","last_unstale":"2024-08-31T06:04:16.436194+0000","last_undegraded":"2024-08-31T06:04:16.436194+0000","last_fullsized":"2024-08-31T06:04:16.436194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:20.628524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996993+0000","last_change":"2024-08-31T06:02:30.604550+0000","last_active":"2024-08-31T06:04:16.996993+0000","last_peered":"2024-08-31T06:04:16.996993+0000","last_clean":"2024-08-31T06:04:16.996993+0000","last_became_active":"2024-08-31T06:02:30.604200+0000","last_became_peered":"2024-08-31T06:02:30.604200+0000","last_unstale":"2024-08-31T06:04:16.996993+0000","last_undegraded":"2024-08-31T06:04:16.996993+0000","last_fullsized":"2024-08-31T06:04:16.996993+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:31.191972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997029+0000","last_change":"2024-08-31T06:02:30.606102+0000","last_active":"2024-08-31T06:04:16.997029+0000","last_peered":"2024-08-31T06:04:16.997029+0000","last_clean":"2024-08-31T06:04:16.997029+0000","last_became_active":"2024-08-31T06:02:30.605738+0000","last_became_peered":"2024-08-31T06:02:30.605738+0000","last_unstale":"2024-08-31T06:04:16.997029+0000","last_undegraded":"2024-08-31T06:04:16.997029+0000","last_fullsized":"2024-08-31T06:04:16.997029+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:50:34.993218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827090+0000","last_change":"2024-08-31T06:02:30.603207+0000","last_active":"2024-08-31T06:04:16.827090+0000","last_peered":"2024-08-31T06:04:16.827090+0000","last_clean":"2024-08-31T06:04:16.827090+0000","last_became_active":"2024-08-31T06:02:30.602829+0000","last_became_peered":"2024-08-31T06:02:30.602829+0000","last_unstale":"2024-08-31T06:04:16.827090+0000","last_undegraded":"2024-08-31T06:04:16.827090+0000","last_fullsized":"2024-08-31T06:04:16.827090+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:02.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997618+0000","last_change":"2024-08-31T06:02:30.590760+0000","last_active":"2024-08-31T06:04:16.997618+0000","last_peered":"2024-08-31T06:04:16.997618+0000","last_clean":"2024-08-31T06:04:16.997618+0000","last_became_active":"2024-08-31T06:02:30.590198+0000","last_became_peered":"2024-08-31T06:02:30.590198+0000","last_unstale":"2024-08-31T06:04:16.997618+0000","last_undegraded":"2024-08-31T06:04:16.997618+0000","last_fullsized":"2024-08-31T06:04:16.997618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:50.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433579+0000","last_change":"2024-08-31T06:02:30.599924+0000","last_active":"2024-08-31T06:04:16.433579+0000","last_peered":"2024-08-31T06:04:16.433579+0000","last_clean":"2024-08-31T06:04:16.433579+0000","last_became_active":"2024-08-31T06:02:30.599566+0000","last_became_peered":"2024-08-31T06:02:30.599566+0000","last_unstale":"2024-08-31T06:04:16.433579+0000","last_undegraded":"2024-08-31T06:04:16.433579+0000","last_fullsized":"2024-08-31T06:04:16.433579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:58.265673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"72'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826124+0000","last_change":"2024-08-31T06:03:15.771521+0000","last_active":"2024-08-31T06:04:16.826124+0000","last_peered":"2024-08-31T06:04:16.826124+0000","last_clean":"2024-08-31T06:04:16.826124+0000","last_became_active":"2024-08-31T06:03:15.770969+0000","last_became_peered":"2024-08-31T06:03:15.770969+0000","last_unstale":"2024-08-31T06:04:16.826124+0000","last_undegraded":"2024-08-31T06:04:16.826124+0000","last_fullsized":"2024-08-31T06:04:16.826124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:31.724213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437763+0000","last_change":"2024-08-31T06:02:30.610057+0000","last_active":"2024-08-31T06:04:16.437763+0000","last_peered":"2024-08-31T06:04:16.437763+0000","last_clean":"2024-08-31T06:04:16.437763+0000","last_became_active":"2024-08-31T06:02:30.609654+0000","last_became_peered":"2024-08-31T06:02:30.609654+0000","last_unstale":"2024-08-31T06:04:16.437763+0000","last_undegraded":"2024-08-31T06:04:16.437763+0000","last_fullsized":"2024-08-31T06:04:16.437763+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:32:14.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435055+0000","last_change":"2024-08-31T06:02:30.606437+0000","last_active":"2024-08-31T06:04:16.435055+0000","last_peered":"2024-08-31T06:04:16.435055+0000","last_clean":"2024-08-31T06:04:16.435055+0000","last_became_active":"2024-08-31T06:02:30.605632+0000","last_became_peered":"2024-08-31T06:02:30.605632+0000","last_unstale":"2024-08-31T06:04:16.435055+0000","last_undegraded":"2024-08-31T06:04:16.435055+0000","last_fullsized":"2024-08-31T06:04:16.435055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:47.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"72'16","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434609+0000","last_change":"2024-08-31T06:02:30.605456+0000","last_active":"2024-08-31T06:04:16.434609+0000","last_peered":"2024-08-31T06:04:16.434609+0000","last_clean":"2024-08-31T06:04:16.434609+0000","last_became_active":"2024-08-31T06:02:30.604927+0000","last_became_peered":"2024-08-31T06:02:30.604927+0000","last_unstale":"2024-08-31T06:04:16.434609+0000","last_undegraded":"2024-08-31T06:04:16.434609+0000","last_fullsized":"2024-08-31T06:04:16.434609+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:30.340609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826434+0000","last_change":"2024-08-31T06:02:30.608595+0000","last_active":"2024-08-31T06:04:16.826434+0000","last_peered":"2024-08-31T06:04:16.826434+0000","last_clean":"2024-08-31T06:04:16.826434+0000","last_became_active":"2024-08-31T06:02:30.607695+0000","last_became_peered":"2024-08-31T06:02:30.607695+0000","last_unstale":"2024-08-31T06:04:16.826434+0000","last_undegraded":"2024-08-31T06:04:16.826434+0000","last_fullsized":"2024-08-31T06:04:16.826434+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:44:53.655598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827095+0000","last_change":"2024-08-31T06:02:30.595775+0000","last_active":"2024-08-31T06:04:16.827095+0000","last_peered":"2024-08-31T06:04:16.827095+0000","last_clean":"2024-08-31T06:04:16.827095+0000","last_became_active":"2024-08-31T06:02:30.595424+0000","last_became_peered":"2024-08-31T06:02:30.595424+0000","last_unstale":"2024-08-31T06:04:16.827095+0000","last_undegraded":"2024-08-31T06:04:16.827095+0000","last_fullsized":"2024-08-31T06:04:16.827095+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:56.382633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431879+0000","last_change":"2024-08-31T06:02:30.603465+0000","last_active":"2024-08-31T06:04:16.431879+0000","last_peered":"2024-08-31T06:04:16.431879+0000","last_clean":"2024-08-31T06:04:16.431879+0000","last_became_active":"2024-08-31T06:02:30.603041+0000","last_became_peered":"2024-08-31T06:02:30.603041+0000","last_unstale":"2024-08-31T06:04:16.431879+0000","last_undegraded":"2024-08-31T06:04:16.431879+0000","last_fullsized":"2024-08-31T06:04:16.431879+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:19:00.139973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996811+0000","last_change":"2024-08-31T06:02:30.593807+0000","last_active":"2024-08-31T06:04:16.996811+0000","last_peered":"2024-08-31T06:04:16.996811+0000","last_clean":"2024-08-31T06:04:16.996811+0000","last_became_active":"2024-08-31T06:02:30.593389+0000","last_became_peered":"2024-08-31T06:02:30.593389+0000","last_unstale":"2024-08-31T06:04:16.996811+0000","last_undegraded":"2024-08-31T06:04:16.996811+0000","last_fullsized":"2024-08-31T06:04:16.996811+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:01:04.398867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996779+0000","last_change":"2024-08-31T06:02:30.605207+0000","last_active":"2024-08-31T06:04:16.996779+0000","last_peered":"2024-08-31T06:04:16.996779+0000","last_clean":"2024-08-31T06:04:16.996779+0000","last_became_active":"2024-08-31T06:02:30.604866+0000","last_became_peered":"2024-08-31T06:02:30.604866+0000","last_unstale":"2024-08-31T06:04:16.996779+0000","last_undegraded":"2024-08-31T06:04:16.996779+0000","last_fullsized":"2024-08-31T06:04:16.996779+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:56.305638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433428+0000","last_change":"2024-08-31T06:02:30.601457+0000","last_active":"2024-08-31T06:04:16.433428+0000","last_peered":"2024-08-31T06:04:16.433428+0000","last_clean":"2024-08-31T06:04:16.433428+0000","last_became_active":"2024-08-31T06:02:30.601077+0000","last_became_peered":"2024-08-31T06:02:30.601077+0000","last_unstale":"2024-08-31T06:04:16.433428+0000","last_undegraded":"2024-08-31T06:04:16.433428+0000","last_fullsized":"2024-08-31T06:04:16.433428+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:51:42.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436274+0000","last_change":"2024-08-31T06:02:30.612475+0000","last_active":"2024-08-31T06:04:16.436274+0000","last_peered":"2024-08-31T06:04:16.436274+0000","last_clean":"2024-08-31T06:04:16.436274+0000","last_became_active":"2024-08-31T06:02:30.612088+0000","last_became_peered":"2024-08-31T06:02:30.612088+0000","last_unstale":"2024-08-31T06:04:16.436274+0000","last_undegraded":"2024-08-31T06:04:16.436274+0000","last_fullsized":"2024-08-31T06:04:16.436274+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:34.348645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823774+0000","last_change":"2024-08-31T06:02:30.605612+0000","last_active":"2024-08-31T06:04:16.823774+0000","last_peered":"2024-08-31T06:04:16.823774+0000","last_clean":"2024-08-31T06:04:16.823774+0000","last_became_active":"2024-08-31T06:02:30.605271+0000","last_became_peered":"2024-08-31T06:02:30.605271+0000","last_unstale":"2024-08-31T06:04:16.823774+0000","last_undegraded":"2024-08-31T06:04:16.823774+0000","last_fullsized":"2024-08-31T06:04:16.823774+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:38.003500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438194+0000","last_change":"2024-08-31T06:02:30.610328+0000","last_active":"2024-08-31T06:04:16.438194+0000","last_peered":"2024-08-31T06:04:16.438194+0000","last_clean":"2024-08-31T06:04:16.438194+0000","last_became_active":"2024-08-31T06:02:30.609935+0000","last_became_peered":"2024-08-31T06:02:30.609935+0000","last_unstale":"2024-08-31T06:04:16.438194+0000","last_undegraded":"2024-08-31T06:04:16.438194+0000","last_fullsized":"2024-08-31T06:04:16.438194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:22.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435885+0000","last_change":"2024-08-31T06:02:30.609207+0000","last_active":"2024-08-31T06:04:16.435885+0000","last_peered":"2024-08-31T06:04:16.435885+0000","last_clean":"2024-08-31T06:04:16.435885+0000","last_became_active":"2024-08-31T06:02:30.608635+0000","last_became_peered":"2024-08-31T06:02:30.608635+0000","last_unstale":"2024-08-31T06:04:16.435885+0000","last_undegraded":"2024-08-31T06:04:16.435885+0000","last_fullsized":"2024-08-31T06:04:16.435885+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:43.898073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431972+0000","last_change":"2024-08-31T06:02:30.595829+0000","last_active":"2024-08-31T06:04:16.431972+0000","last_peered":"2024-08-31T06:04:16.431972+0000","last_clean":"2024-08-31T06:04:16.431972+0000","last_became_active":"2024-08-31T06:02:30.595427+0000","last_became_peered":"2024-08-31T06:02:30.595427+0000","last_unstale":"2024-08-31T06:04:16.431972+0000","last_undegraded":"2024-08-31T06:04:16.431972+0000","last_fullsized":"2024-08-31T06:04:16.431972+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:09:39.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433777+0000","last_change":"2024-08-31T06:02:30.599513+0000","last_active":"2024-08-31T06:04:16.433777+0000","last_peered":"2024-08-31T06:04:16.433777+0000","last_clean":"2024-08-31T06:04:16.433777+0000","last_became_active":"2024-08-31T06:02:30.599195+0000","last_became_peered":"2024-08-31T06:02:30.599195+0000","last_unstale":"2024-08-31T06:04:16.433777+0000","last_undegraded":"2024-08-31T06:04:16.433777+0000","last_fullsized":"2024-08-31T06:04:16.433777+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:26.669658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437790+0000","last_change":"2024-08-31T06:02:30.609229+0000","last_active":"2024-08-31T06:04:16.437790+0000","last_peered":"2024-08-31T06:04:16.437790+0000","last_clean":"2024-08-31T06:04:16.437790+0000","last_became_active":"2024-08-31T06:02:30.608536+0000","last_became_peered":"2024-08-31T06:02:30.608536+0000","last_unstale":"2024-08-31T06:04:16.437790+0000","last_undegraded":"2024-08-31T06:04:16.437790+0000","last_fullsized":"2024-08-31T06:04:16.437790+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:08.917901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825521+0000","last_change":"2024-08-31T06:02:30.603663+0000","last_active":"2024-08-31T06:04:16.825521+0000","last_peered":"2024-08-31T06:04:16.825521+0000","last_clean":"2024-08-31T06:04:16.825521+0000","last_became_active":"2024-08-31T06:02:30.603220+0000","last_became_peered":"2024-08-31T06:02:30.603220+0000","last_unstale":"2024-08-31T06:04:16.825521+0000","last_undegraded":"2024-08-31T06:04:16.825521+0000","last_fullsized":"2024-08-31T06:04:16.825521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:09.433078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438040+0000","last_change":"2024-08-31T06:02:30.608474+0000","last_active":"2024-08-31T06:04:16.438040+0000","last_peered":"2024-08-31T06:04:16.438040+0000","last_clean":"2024-08-31T06:04:16.438040+0000","last_became_active":"2024-08-31T06:02:30.608118+0000","last_became_peered":"2024-08-31T06:02:30.608118+0000","last_unstale":"2024-08-31T06:04:16.438040+0000","last_undegraded":"2024-08-31T06:04:16.438040+0000","last_fullsized":"2024-08-31T06:04:16.438040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:55.124001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438523+0000","last_change":"2024-08-31T06:02:30.614255+0000","last_active":"2024-08-31T06:04:16.438523+0000","last_peered":"2024-08-31T06:04:16.438523+0000","last_clean":"2024-08-31T06:04:16.438523+0000","last_became_active":"2024-08-31T06:02:30.613805+0000","last_became_peered":"2024-08-31T06:02:30.613805+0000","last_unstale":"2024-08-31T06:04:16.438523+0000","last_undegraded":"2024-08-31T06:04:16.438523+0000","last_fullsized":"2024-08-31T06:04:16.438523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.892997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436018+0000","last_change":"2024-08-31T06:02:30.609877+0000","last_active":"2024-08-31T06:04:16.436018+0000","last_peered":"2024-08-31T06:04:16.436018+0000","last_clean":"2024-08-31T06:04:16.436018+0000","last_became_active":"2024-08-31T06:02:30.608805+0000","last_became_peered":"2024-08-31T06:02:30.608805+0000","last_unstale":"2024-08-31T06:04:16.436018+0000","last_undegraded":"2024-08-31T06:04:16.436018+0000","last_fullsized":"2024-08-31T06:04:16.436018+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:52.172745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431812+0000","last_change":"2024-08-31T06:02:30.594684+0000","last_active":"2024-08-31T06:04:16.431812+0000","last_peered":"2024-08-31T06:04:16.431812+0000","last_clean":"2024-08-31T06:04:16.431812+0000","last_became_active":"2024-08-31T06:02:30.594293+0000","last_became_peered":"2024-08-31T06:02:30.594293+0000","last_unstale":"2024-08-31T06:04:16.431812+0000","last_undegraded":"2024-08-31T06:04:16.431812+0000","last_fullsized":"2024-08-31T06:04:16.431812+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:58:39.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997035+0000","last_change":"2024-08-31T06:02:30.602765+0000","last_active":"2024-08-31T06:04:16.997035+0000","last_peered":"2024-08-31T06:04:16.997035+0000","last_clean":"2024-08-31T06:04:16.997035+0000","last_became_active":"2024-08-31T06:02:30.602410+0000","last_became_peered":"2024-08-31T06:02:30.602410+0000","last_unstale":"2024-08-31T06:04:16.997035+0000","last_undegraded":"2024-08-31T06:04:16.997035+0000","last_fullsized":"2024-08-31T06:04:16.997035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:12.370967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437952+0000","last_change":"2024-08-31T06:02:30.611818+0000","last_active":"2024-08-31T06:04:16.437952+0000","last_peered":"2024-08-31T06:04:16.437952+0000","last_clean":"2024-08-31T06:04:16.437952+0000","last_became_active":"2024-08-31T06:02:30.610917+0000","last_became_peered":"2024-08-31T06:02:30.610917+0000","last_unstale":"2024-08-31T06:04:16.437952+0000","last_undegraded":"2024-08-31T06:04:16.437952+0000","last_fullsized":"2024-08-31T06:04:16.437952+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:00.895825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"72'12","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438263+0000","last_change":"2024-08-31T06:02:30.612186+0000","last_active":"2024-08-31T06:04:16.438263+0000","last_peered":"2024-08-31T06:04:16.438263+0000","last_clean":"2024-08-31T06:04:16.438263+0000","last_became_active":"2024-08-31T06:02:30.610496+0000","last_became_peered":"2024-08-31T06:02:30.610496+0000","last_unstale":"2024-08-31T06:04:16.438263+0000","last_undegraded":"2024-08-31T06:04:16.438263+0000","last_fullsized":"2024-08-31T06:04:16.438263+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:48:19.954998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"72'9","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435716+0000","last_change":"2024-08-31T06:03:15.776507+0000","last_active":"2024-08-31T06:04:16.435716+0000","last_peered":"2024-08-31T06:04:16.435716+0000","last_clean":"2024-08-31T06:04:16.435716+0000","last_became_active":"2024-08-31T06:03:15.776039+0000","last_became_peered":"2024-08-31T06:03:15.776039+0000","last_unstale":"2024-08-31T06:04:16.435716+0000","last_undegraded":"2024-08-31T06:04:16.435716+0000","last_fullsized":"2024-08-31T06:04:16.435716+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:41.616112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997530+0000","last_change":"2024-08-31T06:02:30.607864+0000","last_active":"2024-08-31T06:04:16.997530+0000","last_peered":"2024-08-31T06:04:16.997530+0000","last_clean":"2024-08-31T06:04:16.997530+0000","last_became_active":"2024-08-31T06:02:30.607299+0000","last_became_peered":"2024-08-31T06:02:30.607299+0000","last_unstale":"2024-08-31T06:04:16.997530+0000","last_undegraded":"2024-08-31T06:04:16.997530+0000","last_fullsized":"2024-08-31T06:04:16.997530+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:19.302279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'8","reported_seq":143,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:23.836827+0000","last_change":"2024-08-31T06:02:28.594973+0000","last_active":"2024-08-31T06:04:23.836827+0000","last_peered":"2024-08-31T06:04:23.836827+0000","last_clean":"2024-08-31T06:04:23.836827+0000","last_became_active":"2024-08-31T06:02:28.594588+0000","last_became_peered":"2024-08-31T06:02:28.594588+0000","last_unstale":"2024-08-31T06:04:23.836827+0000","last_undegraded":"2024-08-31T06:04:23.836827+0000","last_fullsized":"2024-08-31T06:04:23.836827+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:29:48.016888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"72'8","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825760+0000","last_change":"2024-08-31T06:03:15.974504+0000","last_active":"2024-08-31T06:04:16.825760+0000","last_peered":"2024-08-31T06:04:16.825760+0000","last_clean":"2024-08-31T06:04:16.825760+0000","last_became_active":"2024-08-31T06:03:15.974139+0000","last_became_peered":"2024-08-31T06:03:15.974139+0000","last_unstale":"2024-08-31T06:04:16.825760+0000","last_undegraded":"2024-08-31T06:04:16.825760+0000","last_fullsized":"2024-08-31T06:04:16.825760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:22.742884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433751+0000","last_change":"2024-08-31T06:02:28.589152+0000","last_active":"2024-08-31T06:04:16.433751+0000","last_peered":"2024-08-31T06:04:16.433751+0000","last_clean":"2024-08-31T06:04:16.433751+0000","last_became_active":"2024-08-31T06:02:28.588758+0000","last_became_peered":"2024-08-31T06:02:28.588758+0000","last_unstale":"2024-08-31T06:04:16.433751+0000","last_undegraded":"2024-08-31T06:04:16.433751+0000","last_fullsized":"2024-08-31T06:04:16.433751+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:31.814105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"70'3","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431439+0000","last_change":"2024-08-31T06:02:28.585410+0000","last_active":"2024-08-31T06:04:16.431439+0000","last_peered":"2024-08-31T06:04:16.431439+0000","last_clean":"2024-08-31T06:04:16.431439+0000","last_became_active":"2024-08-31T06:02:28.584998+0000","last_became_peered":"2024-08-31T06:02:28.584998+0000","last_unstale":"2024-08-31T06:04:16.431439+0000","last_undegraded":"2024-08-31T06:04:16.431439+0000","last_fullsized":"2024-08-31T06:04:16.431439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:30.705460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437844+0000","last_change":"2024-08-31T06:02:30.597295+0000","last_active":"2024-08-31T06:04:16.437844+0000","last_peered":"2024-08-31T06:04:16.437844+0000","last_clean":"2024-08-31T06:04:16.437844+0000","last_became_active":"2024-08-31T06:02:30.596968+0000","last_became_peered":"2024-08-31T06:02:30.596968+0000","last_unstale":"2024-08-31T06:04:16.437844+0000","last_undegraded":"2024-08-31T06:04:16.437844+0000","last_fullsized":"2024-08-31T06:04:16.437844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:38.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"70'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825895+0000","last_change":"2024-08-31T06:02:28.594164+0000","last_active":"2024-08-31T06:04:16.825895+0000","last_peered":"2024-08-31T06:04:16.825895+0000","last_clean":"2024-08-31T06:04:16.825895+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.825895+0000","last_undegraded":"2024-08-31T06:04:16.825895+0000","last_fullsized":"2024-08-31T06:04:16.825895+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:21.780202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823573+0000","last_change":"2024-08-31T06:02:30.597500+0000","last_active":"2024-08-31T06:04:16.823573+0000","last_peered":"2024-08-31T06:04:16.823573+0000","last_clean":"2024-08-31T06:04:16.823573+0000","last_became_active":"2024-08-31T06:02:30.597147+0000","last_became_peered":"2024-08-31T06:02:30.597147+0000","last_unstale":"2024-08-31T06:04:16.823573+0000","last_undegraded":"2024-08-31T06:04:16.823573+0000","last_fullsized":"2024-08-31T06:04:16.823573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:34.111288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'6","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:22.834474+0000","last_change":"2024-08-31T06:02:28.585769+0000","last_active":"2024-08-31T06:04:22.834474+0000","last_peered":"2024-08-31T06:04:22.834474+0000","last_clean":"2024-08-31T06:04:22.834474+0000","last_became_active":"2024-08-31T06:02:28.585310+0000","last_became_peered":"2024-08-31T06:02:28.585310+0000","last_unstale":"2024-08-31T06:04:22.834474+0000","last_undegraded":"2024-08-31T06:04:22.834474+0000","last_fullsized":"2024-08-31T06:04:22.834474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:40.595986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434873+0000","last_change":"2024-08-31T06:02:30.601434+0000","last_active":"2024-08-31T06:04:16.434873+0000","last_peered":"2024-08-31T06:04:16.434873+0000","last_clean":"2024-08-31T06:04:16.434873+0000","last_became_active":"2024-08-31T06:02:30.601060+0000","last_became_peered":"2024-08-31T06:02:30.601060+0000","last_unstale":"2024-08-31T06:04:16.434873+0000","last_undegraded":"2024-08-31T06:04:16.434873+0000","last_fullsized":"2024-08-31T06:04:16.434873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:32.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"70'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826424+0000","last_change":"2024-08-31T06:02:28.593217+0000","last_active":"2024-08-31T06:04:16.826424+0000","last_peered":"2024-08-31T06:04:16.826424+0000","last_clean":"2024-08-31T06:04:16.826424+0000","last_became_active":"2024-08-31T06:02:28.592801+0000","last_became_peered":"2024-08-31T06:02:28.592801+0000","last_unstale":"2024-08-31T06:04:16.826424+0000","last_undegraded":"2024-08-31T06:04:16.826424+0000","last_fullsized":"2024-08-31T06:04:16.826424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:21.561089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"72'9","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997237+0000","last_change":"2024-08-31T06:03:15.770625+0000","last_active":"2024-08-31T06:04:16.997237+0000","last_peered":"2024-08-31T06:04:16.997237+0000","last_clean":"2024-08-31T06:04:16.997237+0000","last_became_active":"2024-08-31T06:03:15.770194+0000","last_became_peered":"2024-08-31T06:03:15.770194+0000","last_unstale":"2024-08-31T06:04:16.997237+0000","last_undegraded":"2024-08-31T06:04:16.997237+0000","last_fullsized":"2024-08-31T06:04:16.997237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:33:57.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825884+0000","last_change":"2024-08-31T06:02:28.781606+0000","last_active":"2024-08-31T06:04:16.825884+0000","last_peered":"2024-08-31T06:04:16.825884+0000","last_clean":"2024-08-31T06:04:16.825884+0000","last_became_active":"2024-08-31T06:02:28.780886+0000","last_became_peered":"2024-08-31T06:02:28.780886+0000","last_unstale":"2024-08-31T06:04:16.825884+0000","last_undegraded":"2024-08-31T06:04:16.825884+0000","last_fullsized":"2024-08-31T06:04:16.825884+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:07.540461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433810+0000","last_change":"2024-08-31T06:02:30.604358+0000","last_active":"2024-08-31T06:04:16.433810+0000","last_peered":"2024-08-31T06:04:16.433810+0000","last_clean":"2024-08-31T06:04:16.433810+0000","last_became_active":"2024-08-31T06:02:30.603980+0000","last_became_peered":"2024-08-31T06:02:30.603980+0000","last_unstale":"2024-08-31T06:04:16.433810+0000","last_undegraded":"2024-08-31T06:04:16.433810+0000","last_fullsized":"2024-08-31T06:04:16.433810+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:43:03.062141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'34","reported_seq":274,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:22.834521+0000","last_change":"2024-08-31T06:02:28.590795+0000","last_active":"2024-08-31T06:04:22.834521+0000","last_peered":"2024-08-31T06:04:22.834521+0000","last_clean":"2024-08-31T06:04:22.834521+0000","last_became_active":"2024-08-31T06:02:28.590397+0000","last_became_peered":"2024-08-31T06:02:28.590397+0000","last_unstale":"2024-08-31T06:04:22.834521+0000","last_undegraded":"2024-08-31T06:04:22.834521+0000","last_fullsized":"2024-08-31T06:04:22.834521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:30.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60504,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":165,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997865+0000","last_change":"2024-08-31T06:02:30.603110+0000","last_active":"2024-08-31T06:04:16.997865+0000","last_peered":"2024-08-31T06:04:16.997865+0000","last_clean":"2024-08-31T06:04:16.997865+0000","last_became_active":"2024-08-31T06:02:30.602691+0000","last_became_peered":"2024-08-31T06:02:30.602691+0000","last_unstale":"2024-08-31T06:04:16.997865+0000","last_undegraded":"2024-08-31T06:04:16.997865+0000","last_fullsized":"2024-08-31T06:04:16.997865+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:20.009202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"70'9","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.449977+0000","last_change":"2024-08-31T06:04:16.449444+0000","last_active":"2024-08-31T06:04:16.449977+0000","last_peered":"2024-08-31T06:04:16.449977+0000","last_clean":"2024-08-31T06:04:16.449977+0000","last_became_active":"2024-08-31T06:04:16.439087+0000","last_became_peered":"2024-08-31T06:04:16.439087+0000","last_unstale":"2024-08-31T06:04:16.449977+0000","last_undegraded":"2024-08-31T06:04:16.449977+0000","last_fullsized":"2024-08-31T06:04:16.449977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:38.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431600+0000","last_change":"2024-08-31T06:02:30.599843+0000","last_active":"2024-08-31T06:04:16.431600+0000","last_peered":"2024-08-31T06:04:16.431600+0000","last_clean":"2024-08-31T06:04:16.431600+0000","last_became_active":"2024-08-31T06:02:30.599440+0000","last_became_peered":"2024-08-31T06:02:30.599440+0000","last_unstale":"2024-08-31T06:04:16.431600+0000","last_undegraded":"2024-08-31T06:04:16.431600+0000","last_fullsized":"2024-08-31T06:04:16.431600+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:01.029482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825714+0000","last_change":"2024-08-31T06:02:28.594178+0000","last_active":"2024-08-31T06:04:16.825714+0000","last_peered":"2024-08-31T06:04:16.825714+0000","last_clean":"2024-08-31T06:04:16.825714+0000","last_became_active":"2024-08-31T06:02:28.593802+0000","last_became_peered":"2024-08-31T06:02:28.593802+0000","last_unstale":"2024-08-31T06:04:16.825714+0000","last_undegraded":"2024-08-31T06:04:16.825714+0000","last_fullsized":"2024-08-31T06:04:16.825714+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:52.561582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826106+0000","last_change":"2024-08-31T06:02:30.595979+0000","last_active":"2024-08-31T06:04:16.826106+0000","last_peered":"2024-08-31T06:04:16.826106+0000","last_clean":"2024-08-31T06:04:16.826106+0000","last_became_active":"2024-08-31T06:02:30.595665+0000","last_became_peered":"2024-08-31T06:02:30.595665+0000","last_unstale":"2024-08-31T06:04:16.826106+0000","last_undegraded":"2024-08-31T06:04:16.826106+0000","last_fullsized":"2024-08-31T06:04:16.826106+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:40.347954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'8","reported_seq":140,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:21.833268+0000","last_change":"2024-08-31T06:02:28.594117+0000","last_active":"2024-08-31T06:04:21.833268+0000","last_peered":"2024-08-31T06:04:21.833268+0000","last_clean":"2024-08-31T06:04:21.833268+0000","last_became_active":"2024-08-31T06:02:28.593721+0000","last_became_peered":"2024-08-31T06:02:28.593721+0000","last_unstale":"2024-08-31T06:04:21.833268+0000","last_undegraded":"2024-08-31T06:04:21.833268+0000","last_fullsized":"2024-08-31T06:04:21.833268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:48:49.400841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825844+0000","last_change":"2024-08-31T06:02:30.606967+0000","last_active":"2024-08-31T06:04:16.825844+0000","last_peered":"2024-08-31T06:04:16.825844+0000","last_clean":"2024-08-31T06:04:16.825844+0000","last_became_active":"2024-08-31T06:02:30.605730+0000","last_became_peered":"2024-08-31T06:02:30.605730+0000","last_unstale":"2024-08-31T06:04:16.825844+0000","last_undegraded":"2024-08-31T06:04:16.825844+0000","last_fullsized":"2024-08-31T06:04:16.825844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:30.656071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"70'17","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997489+0000","last_change":"2024-08-31T06:02:28.780911+0000","last_active":"2024-08-31T06:04:16.997489+0000","last_peered":"2024-08-31T06:04:16.997489+0000","last_clean":"2024-08-31T06:04:16.997489+0000","last_became_active":"2024-08-31T06:02:28.780375+0000","last_became_peered":"2024-08-31T06:02:28.780375+0000","last_unstale":"2024-08-31T06:04:16.997489+0000","last_undegraded":"2024-08-31T06:04:16.997489+0000","last_fullsized":"2024-08-31T06:04:16.997489+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:46.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825581+0000","last_change":"2024-08-31T06:02:30.606871+0000","last_active":"2024-08-31T06:04:16.825581+0000","last_peered":"2024-08-31T06:04:16.825581+0000","last_clean":"2024-08-31T06:04:16.825581+0000","last_became_active":"2024-08-31T06:02:30.606507+0000","last_became_peered":"2024-08-31T06:02:30.606507+0000","last_unstale":"2024-08-31T06:04:16.825581+0000","last_undegraded":"2024-08-31T06:04:16.825581+0000","last_fullsized":"2024-08-31T06:04:16.825581+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:16:31.502034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998046+0000","last_change":"2024-08-31T06:02:28.588078+0000","last_active":"2024-08-31T06:04:16.998046+0000","last_peered":"2024-08-31T06:04:16.998046+0000","last_clean":"2024-08-31T06:04:16.998046+0000","last_became_active":"2024-08-31T06:02:28.587642+0000","last_became_peered":"2024-08-31T06:02:28.587642+0000","last_unstale":"2024-08-31T06:04:16.998046+0000","last_undegraded":"2024-08-31T06:04:16.998046+0000","last_fullsized":"2024-08-31T06:04:16.998046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:59.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436127+0000","last_change":"2024-08-31T06:02:30.605647+0000","last_active":"2024-08-31T06:04:16.436127+0000","last_peered":"2024-08-31T06:04:16.436127+0000","last_clean":"2024-08-31T06:04:16.436127+0000","last_became_active":"2024-08-31T06:02:30.605267+0000","last_became_peered":"2024-08-31T06:02:30.605267+0000","last_unstale":"2024-08-31T06:04:16.436127+0000","last_undegraded":"2024-08-31T06:04:16.436127+0000","last_fullsized":"2024-08-31T06:04:16.436127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:08:34.741030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"70'5","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431745+0000","last_change":"2024-08-31T06:02:28.585295+0000","last_active":"2024-08-31T06:04:16.431745+0000","last_peered":"2024-08-31T06:04:16.431745+0000","last_clean":"2024-08-31T06:04:16.431745+0000","last_became_active":"2024-08-31T06:02:28.584895+0000","last_became_peered":"2024-08-31T06:02:28.584895+0000","last_unstale":"2024-08-31T06:04:16.431745+0000","last_undegraded":"2024-08-31T06:04:16.431745+0000","last_fullsized":"2024-08-31T06:04:16.431745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:57:12.658937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826465+0000","last_change":"2024-08-31T06:02:30.603593+0000","last_active":"2024-08-31T06:04:16.826465+0000","last_peered":"2024-08-31T06:04:16.826465+0000","last_clean":"2024-08-31T06:04:16.826465+0000","last_became_active":"2024-08-31T06:02:30.603274+0000","last_became_peered":"2024-08-31T06:02:30.603274+0000","last_unstale":"2024-08-31T06:04:16.826465+0000","last_undegraded":"2024-08-31T06:04:16.826465+0000","last_fullsized":"2024-08-31T06:04:16.826465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:07.720406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"70'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825979+0000","last_change":"2024-08-31T06:02:28.586920+0000","last_active":"2024-08-31T06:04:16.825979+0000","last_peered":"2024-08-31T06:04:16.825979+0000","last_clean":"2024-08-31T06:04:16.825979+0000","last_became_active":"2024-08-31T06:02:28.586362+0000","last_became_peered":"2024-08-31T06:02:28.586362+0000","last_unstale":"2024-08-31T06:04:16.825979+0000","last_undegraded":"2024-08-31T06:04:16.825979+0000","last_fullsized":"2024-08-31T06:04:16.825979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:52.065879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826269+0000","last_change":"2024-08-31T06:02:30.603800+0000","last_active":"2024-08-31T06:04:16.826269+0000","last_peered":"2024-08-31T06:04:16.826269+0000","last_clean":"2024-08-31T06:04:16.826269+0000","last_became_active":"2024-08-31T06:02:30.603439+0000","last_became_peered":"2024-08-31T06:02:30.603439+0000","last_unstale":"2024-08-31T06:04:16.826269+0000","last_undegraded":"2024-08-31T06:04:16.826269+0000","last_fullsized":"2024-08-31T06:04:16.826269+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:39.992719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":139,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:23.836719+0000","last_change":"2024-08-31T06:02:28.936404+0000","last_active":"2024-08-31T06:04:23.836719+0000","last_peered":"2024-08-31T06:04:23.836719+0000","last_clean":"2024-08-31T06:04:23.836719+0000","last_became_active":"2024-08-31T06:02:28.935898+0000","last_became_peered":"2024-08-31T06:02:28.935898+0000","last_unstale":"2024-08-31T06:04:23.836719+0000","last_undegraded":"2024-08-31T06:04:23.836719+0000","last_fullsized":"2024-08-31T06:04:23.836719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:35.004510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826610+0000","last_change":"2024-08-31T06:02:30.608258+0000","last_active":"2024-08-31T06:04:16.826610+0000","last_peered":"2024-08-31T06:04:16.826610+0000","last_clean":"2024-08-31T06:04:16.826610+0000","last_became_active":"2024-08-31T06:02:30.607067+0000","last_became_peered":"2024-08-31T06:02:30.607067+0000","last_unstale":"2024-08-31T06:04:16.826610+0000","last_undegraded":"2024-08-31T06:04:16.826610+0000","last_fullsized":"2024-08-31T06:04:16.826610+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:03:09.362812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":97,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826255+0000","last_change":"2024-08-31T06:01:19.125033+0000","last_active":"2024-08-31T06:04:16.826255+0000","last_peered":"2024-08-31T06:04:16.826255+0000","last_clean":"2024-08-31T06:04:16.826255+0000","last_became_active":"2024-08-31T06:01:19.118469+0000","last_became_peered":"2024-08-31T06:01:19.118469+0000","last_unstale":"2024-08-31T06:04:16.826255+0000","last_undegraded":"2024-08-31T06:04:16.826255+0000","last_fullsized":"2024-08-31T06:04:16.826255+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_clean_scrub_stamp":"2024-08-31T05:58:05.259854+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:33.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"70'6","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826883+0000","last_change":"2024-08-31T06:02:28.588276+0000","last_active":"2024-08-31T06:04:16.826883+0000","last_peered":"2024-08-31T06:04:16.826883+0000","last_clean":"2024-08-31T06:04:16.826883+0000","last_became_active":"2024-08-31T06:02:28.587184+0000","last_became_peered":"2024-08-31T06:02:28.587184+0000","last_unstale":"2024-08-31T06:04:16.826883+0000","last_undegraded":"2024-08-31T06:04:16.826883+0000","last_fullsized":"2024-08-31T06:04:16.826883+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:12.762919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437980+0000","last_change":"2024-08-31T06:02:30.610801+0000","last_active":"2024-08-31T06:04:16.437980+0000","last_peered":"2024-08-31T06:04:16.437980+0000","last_clean":"2024-08-31T06:04:16.437980+0000","last_became_active":"2024-08-31T06:02:30.610446+0000","last_became_peered":"2024-08-31T06:02:30.610446+0000","last_unstale":"2024-08-31T06:04:16.437980+0000","last_undegraded":"2024-08-31T06:04:16.437980+0000","last_fullsized":"2024-08-31T06:04:16.437980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:17.891734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"70'4","reported_seq":42,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826001+0000","last_change":"2024-08-31T06:03:15.777123+0000","last_active":"2024-08-31T06:04:16.826001+0000","last_peered":"2024-08-31T06:04:16.826001+0000","last_clean":"2024-08-31T06:04:16.826001+0000","last_became_active":"2024-08-31T06:03:15.773099+0000","last_became_peered":"2024-08-31T06:03:15.773099+0000","last_unstale":"2024-08-31T06:04:16.826001+0000","last_undegraded":"2024-08-31T06:04:16.826001+0000","last_fullsized":"2024-08-31T06:04:16.826001+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:56:51.706692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"72'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431436+0000","last_change":"2024-08-31T06:03:15.776402+0000","last_active":"2024-08-31T06:04:16.431436+0000","last_peered":"2024-08-31T06:04:16.431436+0000","last_clean":"2024-08-31T06:04:16.431436+0000","last_became_active":"2024-08-31T06:03:15.775949+0000","last_became_peered":"2024-08-31T06:03:15.775949+0000","last_unstale":"2024-08-31T06:04:16.431436+0000","last_undegraded":"2024-08-31T06:04:16.431436+0000","last_fullsized":"2024-08-31T06:04:16.431436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:51:34.646125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'6","reported_seq":138,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:24.837463+0000","last_change":"2024-08-31T06:02:28.780419+0000","last_active":"2024-08-31T06:04:24.837463+0000","last_peered":"2024-08-31T06:04:24.837463+0000","last_clean":"2024-08-31T06:04:24.837463+0000","last_became_active":"2024-08-31T06:02:28.779814+0000","last_became_peered":"2024-08-31T06:02:28.779814+0000","last_unstale":"2024-08-31T06:04:24.837463+0000","last_undegraded":"2024-08-31T06:04:24.837463+0000","last_fullsized":"2024-08-31T06:04:24.837463+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:36.183841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"72'8","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825581+0000","last_change":"2024-08-31T06:03:15.776468+0000","last_active":"2024-08-31T06:04:16.825581+0000","last_peered":"2024-08-31T06:04:16.825581+0000","last_clean":"2024-08-31T06:04:16.825581+0000","last_became_active":"2024-08-31T06:03:15.776005+0000","last_became_peered":"2024-08-31T06:03:15.776005+0000","last_unstale":"2024-08-31T06:04:16.825581+0000","last_undegraded":"2024-08-31T06:04:16.825581+0000","last_fullsized":"2024-08-31T06:04:16.825581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:47:36.420584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'6","reported_seq":138,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:23.836084+0000","last_change":"2024-08-31T06:02:28.594220+0000","last_active":"2024-08-31T06:04:23.836084+0000","last_peered":"2024-08-31T06:04:23.836084+0000","last_clean":"2024-08-31T06:04:23.836084+0000","last_became_active":"2024-08-31T06:02:28.593729+0000","last_became_peered":"2024-08-31T06:02:28.593729+0000","last_unstale":"2024-08-31T06:04:23.836084+0000","last_undegraded":"2024-08-31T06:04:23.836084+0000","last_fullsized":"2024-08-31T06:04:23.836084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:37:03.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433754+0000","last_change":"2024-08-31T06:02:30.600008+0000","last_active":"2024-08-31T06:04:16.433754+0000","last_peered":"2024-08-31T06:04:16.433754+0000","last_clean":"2024-08-31T06:04:16.433754+0000","last_became_active":"2024-08-31T06:02:30.599677+0000","last_became_peered":"2024-08-31T06:02:30.599677+0000","last_unstale":"2024-08-31T06:04:16.433754+0000","last_undegraded":"2024-08-31T06:04:16.433754+0000","last_fullsized":"2024-08-31T06:04:16.433754+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:59.520544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"70'1","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823590+0000","last_change":"2024-08-31T06:02:28.780554+0000","last_active":"2024-08-31T06:04:16.823590+0000","last_peered":"2024-08-31T06:04:16.823590+0000","last_clean":"2024-08-31T06:04:16.823590+0000","last_became_active":"2024-08-31T06:02:28.780137+0000","last_became_peered":"2024-08-31T06:02:28.780137+0000","last_unstale":"2024-08-31T06:04:16.823590+0000","last_undegraded":"2024-08-31T06:04:16.823590+0000","last_fullsized":"2024-08-31T06:04:16.823590+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:57.523667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433847+0000","last_change":"2024-08-31T06:02:30.597438+0000","last_active":"2024-08-31T06:04:16.433847+0000","last_peered":"2024-08-31T06:04:16.433847+0000","last_clean":"2024-08-31T06:04:16.433847+0000","last_became_active":"2024-08-31T06:02:30.597108+0000","last_became_peered":"2024-08-31T06:02:30.597108+0000","last_unstale":"2024-08-31T06:04:16.433847+0000","last_undegraded":"2024-08-31T06:04:16.433847+0000","last_fullsized":"2024-08-31T06:04:16.433847+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:05.238708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"70'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998028+0000","last_change":"2024-08-31T06:02:28.781006+0000","last_active":"2024-08-31T06:04:16.998028+0000","last_peered":"2024-08-31T06:04:16.998028+0000","last_clean":"2024-08-31T06:04:16.998028+0000","last_became_active":"2024-08-31T06:02:28.780468+0000","last_became_peered":"2024-08-31T06:02:28.780468+0000","last_unstale":"2024-08-31T06:04:16.998028+0000","last_undegraded":"2024-08-31T06:04:16.998028+0000","last_fullsized":"2024-08-31T06:04:16.998028+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:20.206251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431841+0000","last_change":"2024-08-31T06:02:30.600826+0000","last_active":"2024-08-31T06:04:16.431841+0000","last_peered":"2024-08-31T06:04:16.431841+0000","last_clean":"2024-08-31T06:04:16.431841+0000","last_became_active":"2024-08-31T06:02:30.600474+0000","last_became_peered":"2024-08-31T06:02:30.600474+0000","last_unstale":"2024-08-31T06:04:16.431841+0000","last_undegraded":"2024-08-31T06:04:16.431841+0000","last_fullsized":"2024-08-31T06:04:16.431841+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:07.456576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'17","reported_seq":44,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823881+0000","last_change":"2024-08-31T06:02:28.588026+0000","last_active":"2024-08-31T06:04:16.823881+0000","last_peered":"2024-08-31T06:04:16.823881+0000","last_clean":"2024-08-31T06:04:16.823881+0000","last_became_active":"2024-08-31T06:02:28.587759+0000","last_became_peered":"2024-08-31T06:02:28.587759+0000","last_unstale":"2024-08-31T06:04:16.823881+0000","last_undegraded":"2024-08-31T06:04:16.823881+0000","last_fullsized":"2024-08-31T06:04:16.823881+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:44.323111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438064+0000","last_change":"2024-08-31T06:02:30.604375+0000","last_active":"2024-08-31T06:04:16.438064+0000","last_peered":"2024-08-31T06:04:16.438064+0000","last_clean":"2024-08-31T06:04:16.438064+0000","last_became_active":"2024-08-31T06:02:30.604008+0000","last_became_peered":"2024-08-31T06:02:30.604008+0000","last_unstale":"2024-08-31T06:04:16.438064+0000","last_undegraded":"2024-08-31T06:04:16.438064+0000","last_fullsized":"2024-08-31T06:04:16.438064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:37.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"70'7","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827216+0000","last_change":"2024-08-31T06:02:28.936568+0000","last_active":"2024-08-31T06:04:16.827216+0000","last_peered":"2024-08-31T06:04:16.827216+0000","last_clean":"2024-08-31T06:04:16.827216+0000","last_became_active":"2024-08-31T06:02:28.936185+0000","last_became_peered":"2024-08-31T06:02:28.936185+0000","last_unstale":"2024-08-31T06:04:16.827216+0000","last_undegraded":"2024-08-31T06:04:16.827216+0000","last_fullsized":"2024-08-31T06:04:16.827216+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:34.080300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"72'7","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996996+0000","last_change":"2024-08-31T06:03:15.771653+0000","last_active":"2024-08-31T06:04:16.996996+0000","last_peered":"2024-08-31T06:04:16.996996+0000","last_clean":"2024-08-31T06:04:16.996996+0000","last_became_active":"2024-08-31T06:03:15.770903+0000","last_became_peered":"2024-08-31T06:03:15.770903+0000","last_unstale":"2024-08-31T06:04:16.996996+0000","last_undegraded":"2024-08-31T06:04:16.996996+0000","last_fullsized":"2024-08-31T06:04:16.996996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:50.547558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"70'2","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433650+0000","last_change":"2024-08-31T06:03:15.777577+0000","last_active":"2024-08-31T06:04:16.433650+0000","last_peered":"2024-08-31T06:04:16.433650+0000","last_clean":"2024-08-31T06:04:16.433650+0000","last_became_active":"2024-08-31T06:03:15.773006+0000","last_became_peered":"2024-08-31T06:03:15.773006+0000","last_unstale":"2024-08-31T06:04:16.433650+0000","last_undegraded":"2024-08-31T06:04:16.433650+0000","last_fullsized":"2024-08-31T06:04:16.433650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:31.531741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997519+0000","last_change":"2024-08-31T06:02:30.604018+0000","last_active":"2024-08-31T06:04:16.997519+0000","last_peered":"2024-08-31T06:04:16.997519+0000","last_clean":"2024-08-31T06:04:16.997519+0000","last_became_active":"2024-08-31T06:02:30.603411+0000","last_became_peered":"2024-08-31T06:02:30.603411+0000","last_unstale":"2024-08-31T06:04:16.997519+0000","last_undegraded":"2024-08-31T06:04:16.997519+0000","last_fullsized":"2024-08-31T06:04:16.997519+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:34:30.732954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437921+0000","last_change":"2024-08-31T06:02:28.586348+0000","last_active":"2024-08-31T06:04:16.437921+0000","last_peered":"2024-08-31T06:04:16.437921+0000","last_clean":"2024-08-31T06:04:16.437921+0000","last_became_active":"2024-08-31T06:02:28.586046+0000","last_became_peered":"2024-08-31T06:02:28.586046+0000","last_unstale":"2024-08-31T06:04:16.437921+0000","last_undegraded":"2024-08-31T06:04:16.437921+0000","last_fullsized":"2024-08-31T06:04:16.437921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:30.987232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435839+0000","last_change":"2024-08-31T06:02:30.616402+0000","last_active":"2024-08-31T06:04:16.435839+0000","last_peered":"2024-08-31T06:04:16.435839+0000","last_clean":"2024-08-31T06:04:16.435839+0000","last_became_active":"2024-08-31T06:02:30.616014+0000","last_became_peered":"2024-08-31T06:02:30.616014+0000","last_unstale":"2024-08-31T06:04:16.435839+0000","last_undegraded":"2024-08-31T06:04:16.435839+0000","last_fullsized":"2024-08-31T06:04:16.435839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:42.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438077+0000","last_change":"2024-08-31T06:02:28.590184+0000","last_active":"2024-08-31T06:04:16.438077+0000","last_peered":"2024-08-31T06:04:16.438077+0000","last_clean":"2024-08-31T06:04:16.438077+0000","last_became_active":"2024-08-31T06:02:28.588830+0000","last_became_peered":"2024-08-31T06:02:28.588830+0000","last_unstale":"2024-08-31T06:04:16.438077+0000","last_undegraded":"2024-08-31T06:04:16.438077+0000","last_fullsized":"2024-08-31T06:04:16.438077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:03.072197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438070+0000","last_change":"2024-08-31T06:02:30.597262+0000","last_active":"2024-08-31T06:04:16.438070+0000","last_peered":"2024-08-31T06:04:16.438070+0000","last_clean":"2024-08-31T06:04:16.438070+0000","last_became_active":"2024-08-31T06:02:30.596862+0000","last_became_peered":"2024-08-31T06:02:30.596862+0000","last_unstale":"2024-08-31T06:04:16.438070+0000","last_undegraded":"2024-08-31T06:04:16.438070+0000","last_fullsized":"2024-08-31T06:04:16.438070+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:46:29.378532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"70'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997626+0000","last_change":"2024-08-31T06:02:28.594161+0000","last_active":"2024-08-31T06:04:16.997626+0000","last_peered":"2024-08-31T06:04:16.997626+0000","last_clean":"2024-08-31T06:04:16.997626+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.997626+0000","last_undegraded":"2024-08-31T06:04:16.997626+0000","last_fullsized":"2024-08-31T06:04:16.997626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:31:17.941172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826133+0000","last_change":"2024-08-31T06:02:30.595194+0000","last_active":"2024-08-31T06:04:16.826133+0000","last_peered":"2024-08-31T06:04:16.826133+0000","last_clean":"2024-08-31T06:04:16.826133+0000","last_became_active":"2024-08-31T06:02:30.594812+0000","last_became_peered":"2024-08-31T06:02:30.594812+0000","last_unstale":"2024-08-31T06:04:16.826133+0000","last_undegraded":"2024-08-31T06:04:16.826133+0000","last_fullsized":"2024-08-31T06:04:16.826133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:03.224924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825830+0000","last_change":"2024-08-31T06:02:30.615776+0000","last_active":"2024-08-31T06:04:16.825830+0000","last_peered":"2024-08-31T06:04:16.825830+0000","last_clean":"2024-08-31T06:04:16.825830+0000","last_became_active":"2024-08-31T06:02:30.615385+0000","last_became_peered":"2024-08-31T06:02:30.615385+0000","last_unstale":"2024-08-31T06:04:16.825830+0000","last_undegraded":"2024-08-31T06:04:16.825830+0000","last_fullsized":"2024-08-31T06:04:16.825830+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:49.685443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997930+0000","last_change":"2024-08-31T06:02:28.591064+0000","last_active":"2024-08-31T06:04:16.997930+0000","last_peered":"2024-08-31T06:04:16.997930+0000","last_clean":"2024-08-31T06:04:16.997930+0000","last_became_active":"2024-08-31T06:02:28.590643+0000","last_became_peered":"2024-08-31T06:02:28.590643+0000","last_unstale":"2024-08-31T06:04:16.997930+0000","last_undegraded":"2024-08-31T06:04:16.997930+0000","last_fullsized":"2024-08-31T06:04:16.997930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:01.953317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433533+0000","last_change":"2024-08-31T06:02:30.600532+0000","last_active":"2024-08-31T06:04:16.433533+0000","last_peered":"2024-08-31T06:04:16.433533+0000","last_clean":"2024-08-31T06:04:16.433533+0000","last_became_active":"2024-08-31T06:02:30.600013+0000","last_became_peered":"2024-08-31T06:02:30.600013+0000","last_unstale":"2024-08-31T06:04:16.433533+0000","last_undegraded":"2024-08-31T06:04:16.433533+0000","last_fullsized":"2024-08-31T06:04:16.433533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:38.753206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"70'12","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998027+0000","last_change":"2024-08-31T06:02:28.593921+0000","last_active":"2024-08-31T06:04:16.998027+0000","last_peered":"2024-08-31T06:04:16.998027+0000","last_clean":"2024-08-31T06:04:16.998027+0000","last_became_active":"2024-08-31T06:02:28.593102+0000","last_became_peered":"2024-08-31T06:02:28.593102+0000","last_unstale":"2024-08-31T06:04:16.998027+0000","last_undegraded":"2024-08-31T06:04:16.998027+0000","last_fullsized":"2024-08-31T06:04:16.998027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:30:35.791686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997199+0000","last_change":"2024-08-31T06:02:30.606524+0000","last_active":"2024-08-31T06:04:16.997199+0000","last_peered":"2024-08-31T06:04:16.997199+0000","last_clean":"2024-08-31T06:04:16.997199+0000","last_became_active":"2024-08-31T06:02:30.606132+0000","last_became_peered":"2024-08-31T06:02:30.606132+0000","last_unstale":"2024-08-31T06:04:16.997199+0000","last_undegraded":"2024-08-31T06:04:16.997199+0000","last_fullsized":"2024-08-31T06:04:16.997199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:46.566811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"70'2","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438110+0000","last_change":"2024-08-31T06:02:28.780596+0000","last_active":"2024-08-31T06:04:16.438110+0000","last_peered":"2024-08-31T06:04:16.438110+0000","last_clean":"2024-08-31T06:04:16.438110+0000","last_became_active":"2024-08-31T06:02:28.779908+0000","last_became_peered":"2024-08-31T06:02:28.779908+0000","last_unstale":"2024-08-31T06:04:16.438110+0000","last_undegraded":"2024-08-31T06:04:16.438110+0000","last_fullsized":"2024-08-31T06:04:16.438110+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:01.254340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"72'5","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823599+0000","last_change":"2024-08-31T06:03:15.776271+0000","last_active":"2024-08-31T06:04:16.823599+0000","last_peered":"2024-08-31T06:04:16.823599+0000","last_clean":"2024-08-31T06:04:16.823599+0000","last_became_active":"2024-08-31T06:03:15.775821+0000","last_became_peered":"2024-08-31T06:03:15.775821+0000","last_unstale":"2024-08-31T06:04:16.823599+0000","last_undegraded":"2024-08-31T06:04:16.823599+0000","last_fullsized":"2024-08-31T06:04:16.823599+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:52:34.076554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"74'14","reported_seq":143,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:21.832185+0000","last_change":"2024-08-31T06:02:28.593773+0000","last_active":"2024-08-31T06:04:21.832185+0000","last_peered":"2024-08-31T06:04:21.832185+0000","last_clean":"2024-08-31T06:04:21.832185+0000","last_became_active":"2024-08-31T06:02:28.593511+0000","last_became_peered":"2024-08-31T06:02:28.593511+0000","last_unstale":"2024-08-31T06:04:21.832185+0000","last_undegraded":"2024-08-31T06:04:21.832185+0000","last_fullsized":"2024-08-31T06:04:21.832185+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:01:50.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69962,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1067,"num_read_kb":610,"num_write":265,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":209886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906980,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070506,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1067609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928234030,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40344,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704808,"statfs":{"total":95995035648,"available":95953723392,"internally_reserved":0,"allocated":860160,"data_stored":414981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397556,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":415359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593784,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1454080,"data_stored":1010029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757309,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953537,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28456,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716696,"statfs":{"total":95995035648,"available":95965896704,"internally_reserved":0,"allocated":1466368,"data_stored":1008189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084358,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":415584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":414523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":477785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":905216,"data_stored":476115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":864256,"data_stored":416037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:04:26.858 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T06:04:26.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:26 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3151211856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:26.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:26 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3151211856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.002+0000 7fe8e2752640 1 -- 172.21.15.53:0/147020426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8dc102720 msgr2=0x7fe8dc102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:27.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.002+0000 7fe8e2752640 1 --2- 172.21.15.53:0/147020426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8dc102720 0x7fe8dc102b30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009900 tx=0x7fe8cc02a410 comp rx=0 tx=0).stop 2024-08-31T06:04:27.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.002+0000 7fe8e2752640 1 -- 172.21.15.53:0/147020426 shutdown_connections 2024-08-31T06:04:27.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.002+0000 7fe8e2752640 1 --2- 172.21.15.53:0/147020426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8dc1089a0 0x7fe8dc10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.002+0000 7fe8e2752640 1 --2- 172.21.15.53:0/147020426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8dc108050 0x7fe8dc108460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.002+0000 7fe8e2752640 1 --2- 172.21.15.53:0/147020426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8dc102720 0x7fe8dc102b30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.002+0000 7fe8e2752640 1 -- 172.21.15.53:0/147020426 >> 172.21.15.53:0/147020426 conn(0x7fe8dc0fe120 msgr2=0x7fe8dc100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:27.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.002+0000 7fe8e2752640 1 -- 172.21.15.53:0/147020426 shutdown_connections 2024-08-31T06:04:27.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.002+0000 7fe8e2752640 1 -- 172.21.15.53:0/147020426 wait complete. 2024-08-31T06:04:27.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8e2752640 1 Processor -- start 2024-08-31T06:04:27.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8e2752640 1 -- start start 2024-08-31T06:04:27.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8e2752640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8dc102720 0x7fe8dc19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:27.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8e2752640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8dc108050 0x7fe8dc19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:27.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8e2752640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8dc1089a0 0x7fe8dc19f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:27.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8e2752640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc112570 con 0x7fe8dc108050 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8e2752640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc1123f0 con 0x7fe8dc102720 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8e2752640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc1126f0 con 0x7fe8dc1089a0 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8dc108050 0x7fe8dc19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8dc108050 0x7fe8dc19a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35936/0 (socket says 172.21.15.53:35936) 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8db7fe640 1 -- 172.21.15.53:0/604811241 learned_addr learned my addr 172.21.15.53:0/604811241 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8dbfff640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8dc102720 0x7fe8dc19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.003+0000 7fe8e0cef640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8dc1089a0 0x7fe8dc19f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8db7fe640 1 -- 172.21.15.53:0/604811241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8dc1089a0 msgr2=0x7fe8dc19f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8db7fe640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8dc1089a0 0x7fe8dc19f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8db7fe640 1 -- 172.21.15.53:0/604811241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8dc102720 msgr2=0x7fe8dc19a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8db7fe640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8dc102720 0x7fe8dc19a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8db7fe640 1 -- 172.21.15.53:0/604811241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc19ffc0 con 0x7fe8dc108050 2024-08-31T06:04:27.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8e0cef640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8dc1089a0 0x7fe8dc19f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:27.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8db7fe640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8dc108050 0x7fe8dc19a6c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c970 tx=0x7fe8d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:27.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8d97fa640 1 -- 172.21.15.53:0/604811241 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0004220 con 0x7fe8dc108050 2024-08-31T06:04:27.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8d97fa640 1 -- 172.21.15.53:0/604811241 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8d0007e40 con 0x7fe8dc108050 2024-08-31T06:04:27.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8e2752640 1 -- 172.21.15.53:0/604811241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc1a02b0 con 0x7fe8dc108050 2024-08-31T06:04:27.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8d97fa640 1 -- 172.21.15.53:0/604811241 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d00047a0 con 0x7fe8dc108050 2024-08-31T06:04:27.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.004+0000 7fe8e2752640 1 -- 172.21.15.53:0/604811241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc1a6ad0 con 0x7fe8dc108050 2024-08-31T06:04:27.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.005+0000 7fe8e2752640 1 -- 172.21.15.53:0/604811241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc102b30 con 0x7fe8dc108050 2024-08-31T06:04:27.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.007+0000 7fe8d97fa640 1 -- 172.21.15.53:0/604811241 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fe8d00079b0 con 0x7fe8dc108050 2024-08-31T06:04:27.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.007+0000 7fe8d97fa640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8c40b4c00 0x7fe8c40b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:27.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.008+0000 7fe8dbfff640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8c40b4c00 0x7fe8c40b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:27.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.008+0000 7fe8d97fa640 1 -- 172.21.15.53:0/604811241 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fe8d00e5310 con 0x7fe8dc108050 2024-08-31T06:04:27.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.008+0000 7fe8dbfff640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8c40b4c00 0x7fe8c40b7110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc006010 tx=0x7fe8cc000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:27.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.010+0000 7fe8d97fa640 1 -- 172.21.15.53:0/604811241 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe8d0014030 con 0x7fe8dc108050 2024-08-31T06:04:27.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.192+0000 7fe8e2752640 1 -- 172.21.15.53:0/604811241 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe8dc06abd0 con 0x7fe8c40b4c00 2024-08-31T06:04:27.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.196+0000 7fe8d97fa640 1 -- 172.21.15.53:0/604811241 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258872 (secure 0 0 0) 0x7fe8dc06abd0 con 0x7fe8c40b4c00 2024-08-31T06:04:27.201 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:27.202 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-08-31T06:04:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 -- 172.21.15.53:0/604811241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8c40b4c00 msgr2=0x7fe8c40b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8c40b4c00 0x7fe8c40b7110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc006010 tx=0x7fe8cc000bc0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 -- 172.21.15.53:0/604811241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8dc108050 msgr2=0x7fe8dc19a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8dc108050 0x7fe8dc19a6c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c970 tx=0x7fe8d000ce30 comp rx=0 tx=0).stop 2024-08-31T06:04:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 -- 172.21.15.53:0/604811241 shutdown_connections 2024-08-31T06:04:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8c40b4c00 0x7fe8c40b7110 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8dc1089a0 0x7fe8dc19f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8dc108050 0x7fe8dc19a6c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 --2- 172.21.15.53:0/604811241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8dc102720 0x7fe8dc19a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 -- 172.21.15.53:0/604811241 >> 172.21.15.53:0/604811241 conn(0x7fe8dc0fe120 msgr2=0x7fe8dc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:27.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 -- 172.21.15.53:0/604811241 shutdown_connections 2024-08-31T06:04:27.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.200+0000 7fe8e2752640 1 -- 172.21.15.53:0/604811241 wait complete. 2024-08-31T06:04:27.214 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-08-31T06:04:26.365842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660564,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1148,"num_read_kb":679,"num_write":390,"num_write_kb":2303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2951908,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":821,"ondisk_log_size":821,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390364,"kb_used_data":11964,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551460,"statfs":{"total":1151940427776,"available":1151540695040,"internally_reserved":0,"allocated":12251136,"data_stored":6947014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2855,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57,"num_write":20,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002544"},"pg_stats":[{"pgid":"3.3f","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436194+0000","last_change":"2024-08-31T06:02:30.611733+0000","last_active":"2024-08-31T06:04:16.436194+0000","last_peered":"2024-08-31T06:04:16.436194+0000","last_clean":"2024-08-31T06:04:16.436194+0000","last_became_active":"2024-08-31T06:02:30.610339+0000","last_became_peered":"2024-08-31T06:02:30.610339+0000","last_unstale":"2024-08-31T06:04:16.436194+0000","last_undegraded":"2024-08-31T06:04:16.436194+0000","last_fullsized":"2024-08-31T06:04:16.436194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:20.628524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996993+0000","last_change":"2024-08-31T06:02:30.604550+0000","last_active":"2024-08-31T06:04:16.996993+0000","last_peered":"2024-08-31T06:04:16.996993+0000","last_clean":"2024-08-31T06:04:16.996993+0000","last_became_active":"2024-08-31T06:02:30.604200+0000","last_became_peered":"2024-08-31T06:02:30.604200+0000","last_unstale":"2024-08-31T06:04:16.996993+0000","last_undegraded":"2024-08-31T06:04:16.996993+0000","last_fullsized":"2024-08-31T06:04:16.996993+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:31.191972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997029+0000","last_change":"2024-08-31T06:02:30.606102+0000","last_active":"2024-08-31T06:04:16.997029+0000","last_peered":"2024-08-31T06:04:16.997029+0000","last_clean":"2024-08-31T06:04:16.997029+0000","last_became_active":"2024-08-31T06:02:30.605738+0000","last_became_peered":"2024-08-31T06:02:30.605738+0000","last_unstale":"2024-08-31T06:04:16.997029+0000","last_undegraded":"2024-08-31T06:04:16.997029+0000","last_fullsized":"2024-08-31T06:04:16.997029+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:50:34.993218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827090+0000","last_change":"2024-08-31T06:02:30.603207+0000","last_active":"2024-08-31T06:04:16.827090+0000","last_peered":"2024-08-31T06:04:16.827090+0000","last_clean":"2024-08-31T06:04:16.827090+0000","last_became_active":"2024-08-31T06:02:30.602829+0000","last_became_peered":"2024-08-31T06:02:30.602829+0000","last_unstale":"2024-08-31T06:04:16.827090+0000","last_undegraded":"2024-08-31T06:04:16.827090+0000","last_fullsized":"2024-08-31T06:04:16.827090+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:02.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997618+0000","last_change":"2024-08-31T06:02:30.590760+0000","last_active":"2024-08-31T06:04:16.997618+0000","last_peered":"2024-08-31T06:04:16.997618+0000","last_clean":"2024-08-31T06:04:16.997618+0000","last_became_active":"2024-08-31T06:02:30.590198+0000","last_became_peered":"2024-08-31T06:02:30.590198+0000","last_unstale":"2024-08-31T06:04:16.997618+0000","last_undegraded":"2024-08-31T06:04:16.997618+0000","last_fullsized":"2024-08-31T06:04:16.997618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:50.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433579+0000","last_change":"2024-08-31T06:02:30.599924+0000","last_active":"2024-08-31T06:04:16.433579+0000","last_peered":"2024-08-31T06:04:16.433579+0000","last_clean":"2024-08-31T06:04:16.433579+0000","last_became_active":"2024-08-31T06:02:30.599566+0000","last_became_peered":"2024-08-31T06:02:30.599566+0000","last_unstale":"2024-08-31T06:04:16.433579+0000","last_undegraded":"2024-08-31T06:04:16.433579+0000","last_fullsized":"2024-08-31T06:04:16.433579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:58.265673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"72'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826124+0000","last_change":"2024-08-31T06:03:15.771521+0000","last_active":"2024-08-31T06:04:16.826124+0000","last_peered":"2024-08-31T06:04:16.826124+0000","last_clean":"2024-08-31T06:04:16.826124+0000","last_became_active":"2024-08-31T06:03:15.770969+0000","last_became_peered":"2024-08-31T06:03:15.770969+0000","last_unstale":"2024-08-31T06:04:16.826124+0000","last_undegraded":"2024-08-31T06:04:16.826124+0000","last_fullsized":"2024-08-31T06:04:16.826124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:31.724213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437763+0000","last_change":"2024-08-31T06:02:30.610057+0000","last_active":"2024-08-31T06:04:16.437763+0000","last_peered":"2024-08-31T06:04:16.437763+0000","last_clean":"2024-08-31T06:04:16.437763+0000","last_became_active":"2024-08-31T06:02:30.609654+0000","last_became_peered":"2024-08-31T06:02:30.609654+0000","last_unstale":"2024-08-31T06:04:16.437763+0000","last_undegraded":"2024-08-31T06:04:16.437763+0000","last_fullsized":"2024-08-31T06:04:16.437763+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:32:14.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435055+0000","last_change":"2024-08-31T06:02:30.606437+0000","last_active":"2024-08-31T06:04:16.435055+0000","last_peered":"2024-08-31T06:04:16.435055+0000","last_clean":"2024-08-31T06:04:16.435055+0000","last_became_active":"2024-08-31T06:02:30.605632+0000","last_became_peered":"2024-08-31T06:02:30.605632+0000","last_unstale":"2024-08-31T06:04:16.435055+0000","last_undegraded":"2024-08-31T06:04:16.435055+0000","last_fullsized":"2024-08-31T06:04:16.435055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:47.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"72'16","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434609+0000","last_change":"2024-08-31T06:02:30.605456+0000","last_active":"2024-08-31T06:04:16.434609+0000","last_peered":"2024-08-31T06:04:16.434609+0000","last_clean":"2024-08-31T06:04:16.434609+0000","last_became_active":"2024-08-31T06:02:30.604927+0000","last_became_peered":"2024-08-31T06:02:30.604927+0000","last_unstale":"2024-08-31T06:04:16.434609+0000","last_undegraded":"2024-08-31T06:04:16.434609+0000","last_fullsized":"2024-08-31T06:04:16.434609+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:30.340609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826434+0000","last_change":"2024-08-31T06:02:30.608595+0000","last_active":"2024-08-31T06:04:16.826434+0000","last_peered":"2024-08-31T06:04:16.826434+0000","last_clean":"2024-08-31T06:04:16.826434+0000","last_became_active":"2024-08-31T06:02:30.607695+0000","last_became_peered":"2024-08-31T06:02:30.607695+0000","last_unstale":"2024-08-31T06:04:16.826434+0000","last_undegraded":"2024-08-31T06:04:16.826434+0000","last_fullsized":"2024-08-31T06:04:16.826434+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:44:53.655598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827095+0000","last_change":"2024-08-31T06:02:30.595775+0000","last_active":"2024-08-31T06:04:16.827095+0000","last_peered":"2024-08-31T06:04:16.827095+0000","last_clean":"2024-08-31T06:04:16.827095+0000","last_became_active":"2024-08-31T06:02:30.595424+0000","last_became_peered":"2024-08-31T06:02:30.595424+0000","last_unstale":"2024-08-31T06:04:16.827095+0000","last_undegraded":"2024-08-31T06:04:16.827095+0000","last_fullsized":"2024-08-31T06:04:16.827095+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:56.382633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431879+0000","last_change":"2024-08-31T06:02:30.603465+0000","last_active":"2024-08-31T06:04:16.431879+0000","last_peered":"2024-08-31T06:04:16.431879+0000","last_clean":"2024-08-31T06:04:16.431879+0000","last_became_active":"2024-08-31T06:02:30.603041+0000","last_became_peered":"2024-08-31T06:02:30.603041+0000","last_unstale":"2024-08-31T06:04:16.431879+0000","last_undegraded":"2024-08-31T06:04:16.431879+0000","last_fullsized":"2024-08-31T06:04:16.431879+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:19:00.139973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996811+0000","last_change":"2024-08-31T06:02:30.593807+0000","last_active":"2024-08-31T06:04:16.996811+0000","last_peered":"2024-08-31T06:04:16.996811+0000","last_clean":"2024-08-31T06:04:16.996811+0000","last_became_active":"2024-08-31T06:02:30.593389+0000","last_became_peered":"2024-08-31T06:02:30.593389+0000","last_unstale":"2024-08-31T06:04:16.996811+0000","last_undegraded":"2024-08-31T06:04:16.996811+0000","last_fullsized":"2024-08-31T06:04:16.996811+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:01:04.398867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996779+0000","last_change":"2024-08-31T06:02:30.605207+0000","last_active":"2024-08-31T06:04:16.996779+0000","last_peered":"2024-08-31T06:04:16.996779+0000","last_clean":"2024-08-31T06:04:16.996779+0000","last_became_active":"2024-08-31T06:02:30.604866+0000","last_became_peered":"2024-08-31T06:02:30.604866+0000","last_unstale":"2024-08-31T06:04:16.996779+0000","last_undegraded":"2024-08-31T06:04:16.996779+0000","last_fullsized":"2024-08-31T06:04:16.996779+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:56.305638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433428+0000","last_change":"2024-08-31T06:02:30.601457+0000","last_active":"2024-08-31T06:04:16.433428+0000","last_peered":"2024-08-31T06:04:16.433428+0000","last_clean":"2024-08-31T06:04:16.433428+0000","last_became_active":"2024-08-31T06:02:30.601077+0000","last_became_peered":"2024-08-31T06:02:30.601077+0000","last_unstale":"2024-08-31T06:04:16.433428+0000","last_undegraded":"2024-08-31T06:04:16.433428+0000","last_fullsized":"2024-08-31T06:04:16.433428+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:51:42.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436274+0000","last_change":"2024-08-31T06:02:30.612475+0000","last_active":"2024-08-31T06:04:16.436274+0000","last_peered":"2024-08-31T06:04:16.436274+0000","last_clean":"2024-08-31T06:04:16.436274+0000","last_became_active":"2024-08-31T06:02:30.612088+0000","last_became_peered":"2024-08-31T06:02:30.612088+0000","last_unstale":"2024-08-31T06:04:16.436274+0000","last_undegraded":"2024-08-31T06:04:16.436274+0000","last_fullsized":"2024-08-31T06:04:16.436274+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:34.348645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823774+0000","last_change":"2024-08-31T06:02:30.605612+0000","last_active":"2024-08-31T06:04:16.823774+0000","last_peered":"2024-08-31T06:04:16.823774+0000","last_clean":"2024-08-31T06:04:16.823774+0000","last_became_active":"2024-08-31T06:02:30.605271+0000","last_became_peered":"2024-08-31T06:02:30.605271+0000","last_unstale":"2024-08-31T06:04:16.823774+0000","last_undegraded":"2024-08-31T06:04:16.823774+0000","last_fullsized":"2024-08-31T06:04:16.823774+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:38.003500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438194+0000","last_change":"2024-08-31T06:02:30.610328+0000","last_active":"2024-08-31T06:04:16.438194+0000","last_peered":"2024-08-31T06:04:16.438194+0000","last_clean":"2024-08-31T06:04:16.438194+0000","last_became_active":"2024-08-31T06:02:30.609935+0000","last_became_peered":"2024-08-31T06:02:30.609935+0000","last_unstale":"2024-08-31T06:04:16.438194+0000","last_undegraded":"2024-08-31T06:04:16.438194+0000","last_fullsized":"2024-08-31T06:04:16.438194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:22.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435885+0000","last_change":"2024-08-31T06:02:30.609207+0000","last_active":"2024-08-31T06:04:16.435885+0000","last_peered":"2024-08-31T06:04:16.435885+0000","last_clean":"2024-08-31T06:04:16.435885+0000","last_became_active":"2024-08-31T06:02:30.608635+0000","last_became_peered":"2024-08-31T06:02:30.608635+0000","last_unstale":"2024-08-31T06:04:16.435885+0000","last_undegraded":"2024-08-31T06:04:16.435885+0000","last_fullsized":"2024-08-31T06:04:16.435885+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:43.898073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431972+0000","last_change":"2024-08-31T06:02:30.595829+0000","last_active":"2024-08-31T06:04:16.431972+0000","last_peered":"2024-08-31T06:04:16.431972+0000","last_clean":"2024-08-31T06:04:16.431972+0000","last_became_active":"2024-08-31T06:02:30.595427+0000","last_became_peered":"2024-08-31T06:02:30.595427+0000","last_unstale":"2024-08-31T06:04:16.431972+0000","last_undegraded":"2024-08-31T06:04:16.431972+0000","last_fullsized":"2024-08-31T06:04:16.431972+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:09:39.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433777+0000","last_change":"2024-08-31T06:02:30.599513+0000","last_active":"2024-08-31T06:04:16.433777+0000","last_peered":"2024-08-31T06:04:16.433777+0000","last_clean":"2024-08-31T06:04:16.433777+0000","last_became_active":"2024-08-31T06:02:30.599195+0000","last_became_peered":"2024-08-31T06:02:30.599195+0000","last_unstale":"2024-08-31T06:04:16.433777+0000","last_undegraded":"2024-08-31T06:04:16.433777+0000","last_fullsized":"2024-08-31T06:04:16.433777+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:26.669658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437790+0000","last_change":"2024-08-31T06:02:30.609229+0000","last_active":"2024-08-31T06:04:16.437790+0000","last_peered":"2024-08-31T06:04:16.437790+0000","last_clean":"2024-08-31T06:04:16.437790+0000","last_became_active":"2024-08-31T06:02:30.608536+0000","last_became_peered":"2024-08-31T06:02:30.608536+0000","last_unstale":"2024-08-31T06:04:16.437790+0000","last_undegraded":"2024-08-31T06:04:16.437790+0000","last_fullsized":"2024-08-31T06:04:16.437790+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:08.917901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825521+0000","last_change":"2024-08-31T06:02:30.603663+0000","last_active":"2024-08-31T06:04:16.825521+0000","last_peered":"2024-08-31T06:04:16.825521+0000","last_clean":"2024-08-31T06:04:16.825521+0000","last_became_active":"2024-08-31T06:02:30.603220+0000","last_became_peered":"2024-08-31T06:02:30.603220+0000","last_unstale":"2024-08-31T06:04:16.825521+0000","last_undegraded":"2024-08-31T06:04:16.825521+0000","last_fullsized":"2024-08-31T06:04:16.825521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:09.433078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438040+0000","last_change":"2024-08-31T06:02:30.608474+0000","last_active":"2024-08-31T06:04:16.438040+0000","last_peered":"2024-08-31T06:04:16.438040+0000","last_clean":"2024-08-31T06:04:16.438040+0000","last_became_active":"2024-08-31T06:02:30.608118+0000","last_became_peered":"2024-08-31T06:02:30.608118+0000","last_unstale":"2024-08-31T06:04:16.438040+0000","last_undegraded":"2024-08-31T06:04:16.438040+0000","last_fullsized":"2024-08-31T06:04:16.438040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:55.124001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438523+0000","last_change":"2024-08-31T06:02:30.614255+0000","last_active":"2024-08-31T06:04:16.438523+0000","last_peered":"2024-08-31T06:04:16.438523+0000","last_clean":"2024-08-31T06:04:16.438523+0000","last_became_active":"2024-08-31T06:02:30.613805+0000","last_became_peered":"2024-08-31T06:02:30.613805+0000","last_unstale":"2024-08-31T06:04:16.438523+0000","last_undegraded":"2024-08-31T06:04:16.438523+0000","last_fullsized":"2024-08-31T06:04:16.438523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.892997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436018+0000","last_change":"2024-08-31T06:02:30.609877+0000","last_active":"2024-08-31T06:04:16.436018+0000","last_peered":"2024-08-31T06:04:16.436018+0000","last_clean":"2024-08-31T06:04:16.436018+0000","last_became_active":"2024-08-31T06:02:30.608805+0000","last_became_peered":"2024-08-31T06:02:30.608805+0000","last_unstale":"2024-08-31T06:04:16.436018+0000","last_undegraded":"2024-08-31T06:04:16.436018+0000","last_fullsized":"2024-08-31T06:04:16.436018+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:52.172745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431812+0000","last_change":"2024-08-31T06:02:30.594684+0000","last_active":"2024-08-31T06:04:16.431812+0000","last_peered":"2024-08-31T06:04:16.431812+0000","last_clean":"2024-08-31T06:04:16.431812+0000","last_became_active":"2024-08-31T06:02:30.594293+0000","last_became_peered":"2024-08-31T06:02:30.594293+0000","last_unstale":"2024-08-31T06:04:16.431812+0000","last_undegraded":"2024-08-31T06:04:16.431812+0000","last_fullsized":"2024-08-31T06:04:16.431812+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:58:39.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997035+0000","last_change":"2024-08-31T06:02:30.602765+0000","last_active":"2024-08-31T06:04:16.997035+0000","last_peered":"2024-08-31T06:04:16.997035+0000","last_clean":"2024-08-31T06:04:16.997035+0000","last_became_active":"2024-08-31T06:02:30.602410+0000","last_became_peered":"2024-08-31T06:02:30.602410+0000","last_unstale":"2024-08-31T06:04:16.997035+0000","last_undegraded":"2024-08-31T06:04:16.997035+0000","last_fullsized":"2024-08-31T06:04:16.997035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:12.370967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437952+0000","last_change":"2024-08-31T06:02:30.611818+0000","last_active":"2024-08-31T06:04:16.437952+0000","last_peered":"2024-08-31T06:04:16.437952+0000","last_clean":"2024-08-31T06:04:16.437952+0000","last_became_active":"2024-08-31T06:02:30.610917+0000","last_became_peered":"2024-08-31T06:02:30.610917+0000","last_unstale":"2024-08-31T06:04:16.437952+0000","last_undegraded":"2024-08-31T06:04:16.437952+0000","last_fullsized":"2024-08-31T06:04:16.437952+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:00.895825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"72'12","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438263+0000","last_change":"2024-08-31T06:02:30.612186+0000","last_active":"2024-08-31T06:04:16.438263+0000","last_peered":"2024-08-31T06:04:16.438263+0000","last_clean":"2024-08-31T06:04:16.438263+0000","last_became_active":"2024-08-31T06:02:30.610496+0000","last_became_peered":"2024-08-31T06:02:30.610496+0000","last_unstale":"2024-08-31T06:04:16.438263+0000","last_undegraded":"2024-08-31T06:04:16.438263+0000","last_fullsized":"2024-08-31T06:04:16.438263+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:48:19.954998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"72'9","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435716+0000","last_change":"2024-08-31T06:03:15.776507+0000","last_active":"2024-08-31T06:04:16.435716+0000","last_peered":"2024-08-31T06:04:16.435716+0000","last_clean":"2024-08-31T06:04:16.435716+0000","last_became_active":"2024-08-31T06:03:15.776039+0000","last_became_peered":"2024-08-31T06:03:15.776039+0000","last_unstale":"2024-08-31T06:04:16.435716+0000","last_undegraded":"2024-08-31T06:04:16.435716+0000","last_fullsized":"2024-08-31T06:04:16.435716+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:41.616112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997530+0000","last_change":"2024-08-31T06:02:30.607864+0000","last_active":"2024-08-31T06:04:16.997530+0000","last_peered":"2024-08-31T06:04:16.997530+0000","last_clean":"2024-08-31T06:04:16.997530+0000","last_became_active":"2024-08-31T06:02:30.607299+0000","last_became_peered":"2024-08-31T06:02:30.607299+0000","last_unstale":"2024-08-31T06:04:16.997530+0000","last_undegraded":"2024-08-31T06:04:16.997530+0000","last_fullsized":"2024-08-31T06:04:16.997530+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:19.302279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'8","reported_seq":143,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:23.836827+0000","last_change":"2024-08-31T06:02:28.594973+0000","last_active":"2024-08-31T06:04:23.836827+0000","last_peered":"2024-08-31T06:04:23.836827+0000","last_clean":"2024-08-31T06:04:23.836827+0000","last_became_active":"2024-08-31T06:02:28.594588+0000","last_became_peered":"2024-08-31T06:02:28.594588+0000","last_unstale":"2024-08-31T06:04:23.836827+0000","last_undegraded":"2024-08-31T06:04:23.836827+0000","last_fullsized":"2024-08-31T06:04:23.836827+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:29:48.016888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"72'8","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825760+0000","last_change":"2024-08-31T06:03:15.974504+0000","last_active":"2024-08-31T06:04:16.825760+0000","last_peered":"2024-08-31T06:04:16.825760+0000","last_clean":"2024-08-31T06:04:16.825760+0000","last_became_active":"2024-08-31T06:03:15.974139+0000","last_became_peered":"2024-08-31T06:03:15.974139+0000","last_unstale":"2024-08-31T06:04:16.825760+0000","last_undegraded":"2024-08-31T06:04:16.825760+0000","last_fullsized":"2024-08-31T06:04:16.825760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:22.742884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433751+0000","last_change":"2024-08-31T06:02:28.589152+0000","last_active":"2024-08-31T06:04:16.433751+0000","last_peered":"2024-08-31T06:04:16.433751+0000","last_clean":"2024-08-31T06:04:16.433751+0000","last_became_active":"2024-08-31T06:02:28.588758+0000","last_became_peered":"2024-08-31T06:02:28.588758+0000","last_unstale":"2024-08-31T06:04:16.433751+0000","last_undegraded":"2024-08-31T06:04:16.433751+0000","last_fullsized":"2024-08-31T06:04:16.433751+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:31.814105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"70'3","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431439+0000","last_change":"2024-08-31T06:02:28.585410+0000","last_active":"2024-08-31T06:04:16.431439+0000","last_peered":"2024-08-31T06:04:16.431439+0000","last_clean":"2024-08-31T06:04:16.431439+0000","last_became_active":"2024-08-31T06:02:28.584998+0000","last_became_peered":"2024-08-31T06:02:28.584998+0000","last_unstale":"2024-08-31T06:04:16.431439+0000","last_undegraded":"2024-08-31T06:04:16.431439+0000","last_fullsized":"2024-08-31T06:04:16.431439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:30.705460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437844+0000","last_change":"2024-08-31T06:02:30.597295+0000","last_active":"2024-08-31T06:04:16.437844+0000","last_peered":"2024-08-31T06:04:16.437844+0000","last_clean":"2024-08-31T06:04:16.437844+0000","last_became_active":"2024-08-31T06:02:30.596968+0000","last_became_peered":"2024-08-31T06:02:30.596968+0000","last_unstale":"2024-08-31T06:04:16.437844+0000","last_undegraded":"2024-08-31T06:04:16.437844+0000","last_fullsized":"2024-08-31T06:04:16.437844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:38.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"70'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825895+0000","last_change":"2024-08-31T06:02:28.594164+0000","last_active":"2024-08-31T06:04:16.825895+0000","last_peered":"2024-08-31T06:04:16.825895+0000","last_clean":"2024-08-31T06:04:16.825895+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.825895+0000","last_undegraded":"2024-08-31T06:04:16.825895+0000","last_fullsized":"2024-08-31T06:04:16.825895+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:21.780202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823573+0000","last_change":"2024-08-31T06:02:30.597500+0000","last_active":"2024-08-31T06:04:16.823573+0000","last_peered":"2024-08-31T06:04:16.823573+0000","last_clean":"2024-08-31T06:04:16.823573+0000","last_became_active":"2024-08-31T06:02:30.597147+0000","last_became_peered":"2024-08-31T06:02:30.597147+0000","last_unstale":"2024-08-31T06:04:16.823573+0000","last_undegraded":"2024-08-31T06:04:16.823573+0000","last_fullsized":"2024-08-31T06:04:16.823573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:34.111288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'6","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:22.834474+0000","last_change":"2024-08-31T06:02:28.585769+0000","last_active":"2024-08-31T06:04:22.834474+0000","last_peered":"2024-08-31T06:04:22.834474+0000","last_clean":"2024-08-31T06:04:22.834474+0000","last_became_active":"2024-08-31T06:02:28.585310+0000","last_became_peered":"2024-08-31T06:02:28.585310+0000","last_unstale":"2024-08-31T06:04:22.834474+0000","last_undegraded":"2024-08-31T06:04:22.834474+0000","last_fullsized":"2024-08-31T06:04:22.834474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:40.595986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434873+0000","last_change":"2024-08-31T06:02:30.601434+0000","last_active":"2024-08-31T06:04:16.434873+0000","last_peered":"2024-08-31T06:04:16.434873+0000","last_clean":"2024-08-31T06:04:16.434873+0000","last_became_active":"2024-08-31T06:02:30.601060+0000","last_became_peered":"2024-08-31T06:02:30.601060+0000","last_unstale":"2024-08-31T06:04:16.434873+0000","last_undegraded":"2024-08-31T06:04:16.434873+0000","last_fullsized":"2024-08-31T06:04:16.434873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:32.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"70'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826424+0000","last_change":"2024-08-31T06:02:28.593217+0000","last_active":"2024-08-31T06:04:16.826424+0000","last_peered":"2024-08-31T06:04:16.826424+0000","last_clean":"2024-08-31T06:04:16.826424+0000","last_became_active":"2024-08-31T06:02:28.592801+0000","last_became_peered":"2024-08-31T06:02:28.592801+0000","last_unstale":"2024-08-31T06:04:16.826424+0000","last_undegraded":"2024-08-31T06:04:16.826424+0000","last_fullsized":"2024-08-31T06:04:16.826424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:21.561089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"72'9","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997237+0000","last_change":"2024-08-31T06:03:15.770625+0000","last_active":"2024-08-31T06:04:16.997237+0000","last_peered":"2024-08-31T06:04:16.997237+0000","last_clean":"2024-08-31T06:04:16.997237+0000","last_became_active":"2024-08-31T06:03:15.770194+0000","last_became_peered":"2024-08-31T06:03:15.770194+0000","last_unstale":"2024-08-31T06:04:16.997237+0000","last_undegraded":"2024-08-31T06:04:16.997237+0000","last_fullsized":"2024-08-31T06:04:16.997237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:33:57.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825884+0000","last_change":"2024-08-31T06:02:28.781606+0000","last_active":"2024-08-31T06:04:16.825884+0000","last_peered":"2024-08-31T06:04:16.825884+0000","last_clean":"2024-08-31T06:04:16.825884+0000","last_became_active":"2024-08-31T06:02:28.780886+0000","last_became_peered":"2024-08-31T06:02:28.780886+0000","last_unstale":"2024-08-31T06:04:16.825884+0000","last_undegraded":"2024-08-31T06:04:16.825884+0000","last_fullsized":"2024-08-31T06:04:16.825884+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:07.540461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433810+0000","last_change":"2024-08-31T06:02:30.604358+0000","last_active":"2024-08-31T06:04:16.433810+0000","last_peered":"2024-08-31T06:04:16.433810+0000","last_clean":"2024-08-31T06:04:16.433810+0000","last_became_active":"2024-08-31T06:02:30.603980+0000","last_became_peered":"2024-08-31T06:02:30.603980+0000","last_unstale":"2024-08-31T06:04:16.433810+0000","last_undegraded":"2024-08-31T06:04:16.433810+0000","last_fullsized":"2024-08-31T06:04:16.433810+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:43:03.062141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'34","reported_seq":274,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:22.834521+0000","last_change":"2024-08-31T06:02:28.590795+0000","last_active":"2024-08-31T06:04:22.834521+0000","last_peered":"2024-08-31T06:04:22.834521+0000","last_clean":"2024-08-31T06:04:22.834521+0000","last_became_active":"2024-08-31T06:02:28.590397+0000","last_became_peered":"2024-08-31T06:02:28.590397+0000","last_unstale":"2024-08-31T06:04:22.834521+0000","last_undegraded":"2024-08-31T06:04:22.834521+0000","last_fullsized":"2024-08-31T06:04:22.834521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:30.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60504,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":165,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997865+0000","last_change":"2024-08-31T06:02:30.603110+0000","last_active":"2024-08-31T06:04:16.997865+0000","last_peered":"2024-08-31T06:04:16.997865+0000","last_clean":"2024-08-31T06:04:16.997865+0000","last_became_active":"2024-08-31T06:02:30.602691+0000","last_became_peered":"2024-08-31T06:02:30.602691+0000","last_unstale":"2024-08-31T06:04:16.997865+0000","last_undegraded":"2024-08-31T06:04:16.997865+0000","last_fullsized":"2024-08-31T06:04:16.997865+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:20.009202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"70'9","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.449977+0000","last_change":"2024-08-31T06:04:16.449444+0000","last_active":"2024-08-31T06:04:16.449977+0000","last_peered":"2024-08-31T06:04:16.449977+0000","last_clean":"2024-08-31T06:04:16.449977+0000","last_became_active":"2024-08-31T06:04:16.439087+0000","last_became_peered":"2024-08-31T06:04:16.439087+0000","last_unstale":"2024-08-31T06:04:16.449977+0000","last_undegraded":"2024-08-31T06:04:16.449977+0000","last_fullsized":"2024-08-31T06:04:16.449977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:38.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431600+0000","last_change":"2024-08-31T06:02:30.599843+0000","last_active":"2024-08-31T06:04:16.431600+0000","last_peered":"2024-08-31T06:04:16.431600+0000","last_clean":"2024-08-31T06:04:16.431600+0000","last_became_active":"2024-08-31T06:02:30.599440+0000","last_became_peered":"2024-08-31T06:02:30.599440+0000","last_unstale":"2024-08-31T06:04:16.431600+0000","last_undegraded":"2024-08-31T06:04:16.431600+0000","last_fullsized":"2024-08-31T06:04:16.431600+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:01.029482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825714+0000","last_change":"2024-08-31T06:02:28.594178+0000","last_active":"2024-08-31T06:04:16.825714+0000","last_peered":"2024-08-31T06:04:16.825714+0000","last_clean":"2024-08-31T06:04:16.825714+0000","last_became_active":"2024-08-31T06:02:28.593802+0000","last_became_peered":"2024-08-31T06:02:28.593802+0000","last_unstale":"2024-08-31T06:04:16.825714+0000","last_undegraded":"2024-08-31T06:04:16.825714+0000","last_fullsized":"2024-08-31T06:04:16.825714+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:52.561582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826106+0000","last_change":"2024-08-31T06:02:30.595979+0000","last_active":"2024-08-31T06:04:16.826106+0000","last_peered":"2024-08-31T06:04:16.826106+0000","last_clean":"2024-08-31T06:04:16.826106+0000","last_became_active":"2024-08-31T06:02:30.595665+0000","last_became_peered":"2024-08-31T06:02:30.595665+0000","last_unstale":"2024-08-31T06:04:16.826106+0000","last_undegraded":"2024-08-31T06:04:16.826106+0000","last_fullsized":"2024-08-31T06:04:16.826106+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:40.347954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'8","reported_seq":140,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:21.833268+0000","last_change":"2024-08-31T06:02:28.594117+0000","last_active":"2024-08-31T06:04:21.833268+0000","last_peered":"2024-08-31T06:04:21.833268+0000","last_clean":"2024-08-31T06:04:21.833268+0000","last_became_active":"2024-08-31T06:02:28.593721+0000","last_became_peered":"2024-08-31T06:02:28.593721+0000","last_unstale":"2024-08-31T06:04:21.833268+0000","last_undegraded":"2024-08-31T06:04:21.833268+0000","last_fullsized":"2024-08-31T06:04:21.833268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:48:49.400841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825844+0000","last_change":"2024-08-31T06:02:30.606967+0000","last_active":"2024-08-31T06:04:16.825844+0000","last_peered":"2024-08-31T06:04:16.825844+0000","last_clean":"2024-08-31T06:04:16.825844+0000","last_became_active":"2024-08-31T06:02:30.605730+0000","last_became_peered":"2024-08-31T06:02:30.605730+0000","last_unstale":"2024-08-31T06:04:16.825844+0000","last_undegraded":"2024-08-31T06:04:16.825844+0000","last_fullsized":"2024-08-31T06:04:16.825844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:30.656071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"70'17","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997489+0000","last_change":"2024-08-31T06:02:28.780911+0000","last_active":"2024-08-31T06:04:16.997489+0000","last_peered":"2024-08-31T06:04:16.997489+0000","last_clean":"2024-08-31T06:04:16.997489+0000","last_became_active":"2024-08-31T06:02:28.780375+0000","last_became_peered":"2024-08-31T06:02:28.780375+0000","last_unstale":"2024-08-31T06:04:16.997489+0000","last_undegraded":"2024-08-31T06:04:16.997489+0000","last_fullsized":"2024-08-31T06:04:16.997489+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:46.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825581+0000","last_change":"2024-08-31T06:02:30.606871+0000","last_active":"2024-08-31T06:04:16.825581+0000","last_peered":"2024-08-31T06:04:16.825581+0000","last_clean":"2024-08-31T06:04:16.825581+0000","last_became_active":"2024-08-31T06:02:30.606507+0000","last_became_peered":"2024-08-31T06:02:30.606507+0000","last_unstale":"2024-08-31T06:04:16.825581+0000","last_undegraded":"2024-08-31T06:04:16.825581+0000","last_fullsized":"2024-08-31T06:04:16.825581+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:16:31.502034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998046+0000","last_change":"2024-08-31T06:02:28.588078+0000","last_active":"2024-08-31T06:04:16.998046+0000","last_peered":"2024-08-31T06:04:16.998046+0000","last_clean":"2024-08-31T06:04:16.998046+0000","last_became_active":"2024-08-31T06:02:28.587642+0000","last_became_peered":"2024-08-31T06:02:28.587642+0000","last_unstale":"2024-08-31T06:04:16.998046+0000","last_undegraded":"2024-08-31T06:04:16.998046+0000","last_fullsized":"2024-08-31T06:04:16.998046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:59.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436127+0000","last_change":"2024-08-31T06:02:30.605647+0000","last_active":"2024-08-31T06:04:16.436127+0000","last_peered":"2024-08-31T06:04:16.436127+0000","last_clean":"2024-08-31T06:04:16.436127+0000","last_became_active":"2024-08-31T06:02:30.605267+0000","last_became_peered":"2024-08-31T06:02:30.605267+0000","last_unstale":"2024-08-31T06:04:16.436127+0000","last_undegraded":"2024-08-31T06:04:16.436127+0000","last_fullsized":"2024-08-31T06:04:16.436127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:08:34.741030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"70'5","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431745+0000","last_change":"2024-08-31T06:02:28.585295+0000","last_active":"2024-08-31T06:04:16.431745+0000","last_peered":"2024-08-31T06:04:16.431745+0000","last_clean":"2024-08-31T06:04:16.431745+0000","last_became_active":"2024-08-31T06:02:28.584895+0000","last_became_peered":"2024-08-31T06:02:28.584895+0000","last_unstale":"2024-08-31T06:04:16.431745+0000","last_undegraded":"2024-08-31T06:04:16.431745+0000","last_fullsized":"2024-08-31T06:04:16.431745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:57:12.658937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826465+0000","last_change":"2024-08-31T06:02:30.603593+0000","last_active":"2024-08-31T06:04:16.826465+0000","last_peered":"2024-08-31T06:04:16.826465+0000","last_clean":"2024-08-31T06:04:16.826465+0000","last_became_active":"2024-08-31T06:02:30.603274+0000","last_became_peered":"2024-08-31T06:02:30.603274+0000","last_unstale":"2024-08-31T06:04:16.826465+0000","last_undegraded":"2024-08-31T06:04:16.826465+0000","last_fullsized":"2024-08-31T06:04:16.826465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:07.720406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"70'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825979+0000","last_change":"2024-08-31T06:02:28.586920+0000","last_active":"2024-08-31T06:04:16.825979+0000","last_peered":"2024-08-31T06:04:16.825979+0000","last_clean":"2024-08-31T06:04:16.825979+0000","last_became_active":"2024-08-31T06:02:28.586362+0000","last_became_peered":"2024-08-31T06:02:28.586362+0000","last_unstale":"2024-08-31T06:04:16.825979+0000","last_undegraded":"2024-08-31T06:04:16.825979+0000","last_fullsized":"2024-08-31T06:04:16.825979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:52.065879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826269+0000","last_change":"2024-08-31T06:02:30.603800+0000","last_active":"2024-08-31T06:04:16.826269+0000","last_peered":"2024-08-31T06:04:16.826269+0000","last_clean":"2024-08-31T06:04:16.826269+0000","last_became_active":"2024-08-31T06:02:30.603439+0000","last_became_peered":"2024-08-31T06:02:30.603439+0000","last_unstale":"2024-08-31T06:04:16.826269+0000","last_undegraded":"2024-08-31T06:04:16.826269+0000","last_fullsized":"2024-08-31T06:04:16.826269+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:39.992719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":139,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:23.836719+0000","last_change":"2024-08-31T06:02:28.936404+0000","last_active":"2024-08-31T06:04:23.836719+0000","last_peered":"2024-08-31T06:04:23.836719+0000","last_clean":"2024-08-31T06:04:23.836719+0000","last_became_active":"2024-08-31T06:02:28.935898+0000","last_became_peered":"2024-08-31T06:02:28.935898+0000","last_unstale":"2024-08-31T06:04:23.836719+0000","last_undegraded":"2024-08-31T06:04:23.836719+0000","last_fullsized":"2024-08-31T06:04:23.836719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:35.004510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826610+0000","last_change":"2024-08-31T06:02:30.608258+0000","last_active":"2024-08-31T06:04:16.826610+0000","last_peered":"2024-08-31T06:04:16.826610+0000","last_clean":"2024-08-31T06:04:16.826610+0000","last_became_active":"2024-08-31T06:02:30.607067+0000","last_became_peered":"2024-08-31T06:02:30.607067+0000","last_unstale":"2024-08-31T06:04:16.826610+0000","last_undegraded":"2024-08-31T06:04:16.826610+0000","last_fullsized":"2024-08-31T06:04:16.826610+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:03:09.362812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":97,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826255+0000","last_change":"2024-08-31T06:01:19.125033+0000","last_active":"2024-08-31T06:04:16.826255+0000","last_peered":"2024-08-31T06:04:16.826255+0000","last_clean":"2024-08-31T06:04:16.826255+0000","last_became_active":"2024-08-31T06:01:19.118469+0000","last_became_peered":"2024-08-31T06:01:19.118469+0000","last_unstale":"2024-08-31T06:04:16.826255+0000","last_undegraded":"2024-08-31T06:04:16.826255+0000","last_fullsized":"2024-08-31T06:04:16.826255+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_clean_scrub_stamp":"2024-08-31T05:58:05.259854+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:33.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"70'6","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826883+0000","last_change":"2024-08-31T06:02:28.588276+0000","last_active":"2024-08-31T06:04:16.826883+0000","last_peered":"2024-08-31T06:04:16.826883+0000","last_clean":"2024-08-31T06:04:16.826883+0000","last_became_active":"2024-08-31T06:02:28.587184+0000","last_became_peered":"2024-08-31T06:02:28.587184+0000","last_unstale":"2024-08-31T06:04:16.826883+0000","last_undegraded":"2024-08-31T06:04:16.826883+0000","last_fullsized":"2024-08-31T06:04:16.826883+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:12.762919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437980+0000","last_change":"2024-08-31T06:02:30.610801+0000","last_active":"2024-08-31T06:04:16.437980+0000","last_peered":"2024-08-31T06:04:16.437980+0000","last_clean":"2024-08-31T06:04:16.437980+0000","last_became_active":"2024-08-31T06:02:30.610446+0000","last_became_peered":"2024-08-31T06:02:30.610446+0000","last_unstale":"2024-08-31T06:04:16.437980+0000","last_undegraded":"2024-08-31T06:04:16.437980+0000","last_fullsized":"2024-08-31T06:04:16.437980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:17.891734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"70'4","reported_seq":42,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826001+0000","last_change":"2024-08-31T06:03:15.777123+0000","last_active":"2024-08-31T06:04:16.826001+0000","last_peered":"2024-08-31T06:04:16.826001+0000","last_clean":"2024-08-31T06:04:16.826001+0000","last_became_active":"2024-08-31T06:03:15.773099+0000","last_became_peered":"2024-08-31T06:03:15.773099+0000","last_unstale":"2024-08-31T06:04:16.826001+0000","last_undegraded":"2024-08-31T06:04:16.826001+0000","last_fullsized":"2024-08-31T06:04:16.826001+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:56:51.706692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"72'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431436+0000","last_change":"2024-08-31T06:03:15.776402+0000","last_active":"2024-08-31T06:04:16.431436+0000","last_peered":"2024-08-31T06:04:16.431436+0000","last_clean":"2024-08-31T06:04:16.431436+0000","last_became_active":"2024-08-31T06:03:15.775949+0000","last_became_peered":"2024-08-31T06:03:15.775949+0000","last_unstale":"2024-08-31T06:04:16.431436+0000","last_undegraded":"2024-08-31T06:04:16.431436+0000","last_fullsized":"2024-08-31T06:04:16.431436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:51:34.646125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'6","reported_seq":138,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:24.837463+0000","last_change":"2024-08-31T06:02:28.780419+0000","last_active":"2024-08-31T06:04:24.837463+0000","last_peered":"2024-08-31T06:04:24.837463+0000","last_clean":"2024-08-31T06:04:24.837463+0000","last_became_active":"2024-08-31T06:02:28.779814+0000","last_became_peered":"2024-08-31T06:02:28.779814+0000","last_unstale":"2024-08-31T06:04:24.837463+0000","last_undegraded":"2024-08-31T06:04:24.837463+0000","last_fullsized":"2024-08-31T06:04:24.837463+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:36.183841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"72'8","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825581+0000","last_change":"2024-08-31T06:03:15.776468+0000","last_active":"2024-08-31T06:04:16.825581+0000","last_peered":"2024-08-31T06:04:16.825581+0000","last_clean":"2024-08-31T06:04:16.825581+0000","last_became_active":"2024-08-31T06:03:15.776005+0000","last_became_peered":"2024-08-31T06:03:15.776005+0000","last_unstale":"2024-08-31T06:04:16.825581+0000","last_undegraded":"2024-08-31T06:04:16.825581+0000","last_fullsized":"2024-08-31T06:04:16.825581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:47:36.420584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'6","reported_seq":138,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:23.836084+0000","last_change":"2024-08-31T06:02:28.594220+0000","last_active":"2024-08-31T06:04:23.836084+0000","last_peered":"2024-08-31T06:04:23.836084+0000","last_clean":"2024-08-31T06:04:23.836084+0000","last_became_active":"2024-08-31T06:02:28.593729+0000","last_became_peered":"2024-08-31T06:02:28.593729+0000","last_unstale":"2024-08-31T06:04:23.836084+0000","last_undegraded":"2024-08-31T06:04:23.836084+0000","last_fullsized":"2024-08-31T06:04:23.836084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:37:03.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433754+0000","last_change":"2024-08-31T06:02:30.600008+0000","last_active":"2024-08-31T06:04:16.433754+0000","last_peered":"2024-08-31T06:04:16.433754+0000","last_clean":"2024-08-31T06:04:16.433754+0000","last_became_active":"2024-08-31T06:02:30.599677+0000","last_became_peered":"2024-08-31T06:02:30.599677+0000","last_unstale":"2024-08-31T06:04:16.433754+0000","last_undegraded":"2024-08-31T06:04:16.433754+0000","last_fullsized":"2024-08-31T06:04:16.433754+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:59.520544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"70'1","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823590+0000","last_change":"2024-08-31T06:02:28.780554+0000","last_active":"2024-08-31T06:04:16.823590+0000","last_peered":"2024-08-31T06:04:16.823590+0000","last_clean":"2024-08-31T06:04:16.823590+0000","last_became_active":"2024-08-31T06:02:28.780137+0000","last_became_peered":"2024-08-31T06:02:28.780137+0000","last_unstale":"2024-08-31T06:04:16.823590+0000","last_undegraded":"2024-08-31T06:04:16.823590+0000","last_fullsized":"2024-08-31T06:04:16.823590+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:57.523667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433847+0000","last_change":"2024-08-31T06:02:30.597438+0000","last_active":"2024-08-31T06:04:16.433847+0000","last_peered":"2024-08-31T06:04:16.433847+0000","last_clean":"2024-08-31T06:04:16.433847+0000","last_became_active":"2024-08-31T06:02:30.597108+0000","last_became_peered":"2024-08-31T06:02:30.597108+0000","last_unstale":"2024-08-31T06:04:16.433847+0000","last_undegraded":"2024-08-31T06:04:16.433847+0000","last_fullsized":"2024-08-31T06:04:16.433847+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:05.238708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"70'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998028+0000","last_change":"2024-08-31T06:02:28.781006+0000","last_active":"2024-08-31T06:04:16.998028+0000","last_peered":"2024-08-31T06:04:16.998028+0000","last_clean":"2024-08-31T06:04:16.998028+0000","last_became_active":"2024-08-31T06:02:28.780468+0000","last_became_peered":"2024-08-31T06:02:28.780468+0000","last_unstale":"2024-08-31T06:04:16.998028+0000","last_undegraded":"2024-08-31T06:04:16.998028+0000","last_fullsized":"2024-08-31T06:04:16.998028+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:20.206251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431841+0000","last_change":"2024-08-31T06:02:30.600826+0000","last_active":"2024-08-31T06:04:16.431841+0000","last_peered":"2024-08-31T06:04:16.431841+0000","last_clean":"2024-08-31T06:04:16.431841+0000","last_became_active":"2024-08-31T06:02:30.600474+0000","last_became_peered":"2024-08-31T06:02:30.600474+0000","last_unstale":"2024-08-31T06:04:16.431841+0000","last_undegraded":"2024-08-31T06:04:16.431841+0000","last_fullsized":"2024-08-31T06:04:16.431841+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:07.456576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'17","reported_seq":44,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823881+0000","last_change":"2024-08-31T06:02:28.588026+0000","last_active":"2024-08-31T06:04:16.823881+0000","last_peered":"2024-08-31T06:04:16.823881+0000","last_clean":"2024-08-31T06:04:16.823881+0000","last_became_active":"2024-08-31T06:02:28.587759+0000","last_became_peered":"2024-08-31T06:02:28.587759+0000","last_unstale":"2024-08-31T06:04:16.823881+0000","last_undegraded":"2024-08-31T06:04:16.823881+0000","last_fullsized":"2024-08-31T06:04:16.823881+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:44.323111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438064+0000","last_change":"2024-08-31T06:02:30.604375+0000","last_active":"2024-08-31T06:04:16.438064+0000","last_peered":"2024-08-31T06:04:16.438064+0000","last_clean":"2024-08-31T06:04:16.438064+0000","last_became_active":"2024-08-31T06:02:30.604008+0000","last_became_peered":"2024-08-31T06:02:30.604008+0000","last_unstale":"2024-08-31T06:04:16.438064+0000","last_undegraded":"2024-08-31T06:04:16.438064+0000","last_fullsized":"2024-08-31T06:04:16.438064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:37.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"70'7","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827216+0000","last_change":"2024-08-31T06:02:28.936568+0000","last_active":"2024-08-31T06:04:16.827216+0000","last_peered":"2024-08-31T06:04:16.827216+0000","last_clean":"2024-08-31T06:04:16.827216+0000","last_became_active":"2024-08-31T06:02:28.936185+0000","last_became_peered":"2024-08-31T06:02:28.936185+0000","last_unstale":"2024-08-31T06:04:16.827216+0000","last_undegraded":"2024-08-31T06:04:16.827216+0000","last_fullsized":"2024-08-31T06:04:16.827216+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:34.080300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"72'7","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996996+0000","last_change":"2024-08-31T06:03:15.771653+0000","last_active":"2024-08-31T06:04:16.996996+0000","last_peered":"2024-08-31T06:04:16.996996+0000","last_clean":"2024-08-31T06:04:16.996996+0000","last_became_active":"2024-08-31T06:03:15.770903+0000","last_became_peered":"2024-08-31T06:03:15.770903+0000","last_unstale":"2024-08-31T06:04:16.996996+0000","last_undegraded":"2024-08-31T06:04:16.996996+0000","last_fullsized":"2024-08-31T06:04:16.996996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:50.547558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"70'2","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433650+0000","last_change":"2024-08-31T06:03:15.777577+0000","last_active":"2024-08-31T06:04:16.433650+0000","last_peered":"2024-08-31T06:04:16.433650+0000","last_clean":"2024-08-31T06:04:16.433650+0000","last_became_active":"2024-08-31T06:03:15.773006+0000","last_became_peered":"2024-08-31T06:03:15.773006+0000","last_unstale":"2024-08-31T06:04:16.433650+0000","last_undegraded":"2024-08-31T06:04:16.433650+0000","last_fullsized":"2024-08-31T06:04:16.433650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:31.531741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997519+0000","last_change":"2024-08-31T06:02:30.604018+0000","last_active":"2024-08-31T06:04:16.997519+0000","last_peered":"2024-08-31T06:04:16.997519+0000","last_clean":"2024-08-31T06:04:16.997519+0000","last_became_active":"2024-08-31T06:02:30.603411+0000","last_became_peered":"2024-08-31T06:02:30.603411+0000","last_unstale":"2024-08-31T06:04:16.997519+0000","last_undegraded":"2024-08-31T06:04:16.997519+0000","last_fullsized":"2024-08-31T06:04:16.997519+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:34:30.732954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437921+0000","last_change":"2024-08-31T06:02:28.586348+0000","last_active":"2024-08-31T06:04:16.437921+0000","last_peered":"2024-08-31T06:04:16.437921+0000","last_clean":"2024-08-31T06:04:16.437921+0000","last_became_active":"2024-08-31T06:02:28.586046+0000","last_became_peered":"2024-08-31T06:02:28.586046+0000","last_unstale":"2024-08-31T06:04:16.437921+0000","last_undegraded":"2024-08-31T06:04:16.437921+0000","last_fullsized":"2024-08-31T06:04:16.437921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:30.987232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435839+0000","last_change":"2024-08-31T06:02:30.616402+0000","last_active":"2024-08-31T06:04:16.435839+0000","last_peered":"2024-08-31T06:04:16.435839+0000","last_clean":"2024-08-31T06:04:16.435839+0000","last_became_active":"2024-08-31T06:02:30.616014+0000","last_became_peered":"2024-08-31T06:02:30.616014+0000","last_unstale":"2024-08-31T06:04:16.435839+0000","last_undegraded":"2024-08-31T06:04:16.435839+0000","last_fullsized":"2024-08-31T06:04:16.435839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:42.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438077+0000","last_change":"2024-08-31T06:02:28.590184+0000","last_active":"2024-08-31T06:04:16.438077+0000","last_peered":"2024-08-31T06:04:16.438077+0000","last_clean":"2024-08-31T06:04:16.438077+0000","last_became_active":"2024-08-31T06:02:28.588830+0000","last_became_peered":"2024-08-31T06:02:28.588830+0000","last_unstale":"2024-08-31T06:04:16.438077+0000","last_undegraded":"2024-08-31T06:04:16.438077+0000","last_fullsized":"2024-08-31T06:04:16.438077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:03.072197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438070+0000","last_change":"2024-08-31T06:02:30.597262+0000","last_active":"2024-08-31T06:04:16.438070+0000","last_peered":"2024-08-31T06:04:16.438070+0000","last_clean":"2024-08-31T06:04:16.438070+0000","last_became_active":"2024-08-31T06:02:30.596862+0000","last_became_peered":"2024-08-31T06:02:30.596862+0000","last_unstale":"2024-08-31T06:04:16.438070+0000","last_undegraded":"2024-08-31T06:04:16.438070+0000","last_fullsized":"2024-08-31T06:04:16.438070+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:46:29.378532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"70'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997626+0000","last_change":"2024-08-31T06:02:28.594161+0000","last_active":"2024-08-31T06:04:16.997626+0000","last_peered":"2024-08-31T06:04:16.997626+0000","last_clean":"2024-08-31T06:04:16.997626+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.997626+0000","last_undegraded":"2024-08-31T06:04:16.997626+0000","last_fullsized":"2024-08-31T06:04:16.997626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:31:17.941172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826133+0000","last_change":"2024-08-31T06:02:30.595194+0000","last_active":"2024-08-31T06:04:16.826133+0000","last_peered":"2024-08-31T06:04:16.826133+0000","last_clean":"2024-08-31T06:04:16.826133+0000","last_became_active":"2024-08-31T06:02:30.594812+0000","last_became_peered":"2024-08-31T06:02:30.594812+0000","last_unstale":"2024-08-31T06:04:16.826133+0000","last_undegraded":"2024-08-31T06:04:16.826133+0000","last_fullsized":"2024-08-31T06:04:16.826133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:03.224924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825830+0000","last_change":"2024-08-31T06:02:30.615776+0000","last_active":"2024-08-31T06:04:16.825830+0000","last_peered":"2024-08-31T06:04:16.825830+0000","last_clean":"2024-08-31T06:04:16.825830+0000","last_became_active":"2024-08-31T06:02:30.615385+0000","last_became_peered":"2024-08-31T06:02:30.615385+0000","last_unstale":"2024-08-31T06:04:16.825830+0000","last_undegraded":"2024-08-31T06:04:16.825830+0000","last_fullsized":"2024-08-31T06:04:16.825830+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:49.685443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997930+0000","last_change":"2024-08-31T06:02:28.591064+0000","last_active":"2024-08-31T06:04:16.997930+0000","last_peered":"2024-08-31T06:04:16.997930+0000","last_clean":"2024-08-31T06:04:16.997930+0000","last_became_active":"2024-08-31T06:02:28.590643+0000","last_became_peered":"2024-08-31T06:02:28.590643+0000","last_unstale":"2024-08-31T06:04:16.997930+0000","last_undegraded":"2024-08-31T06:04:16.997930+0000","last_fullsized":"2024-08-31T06:04:16.997930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:01.953317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433533+0000","last_change":"2024-08-31T06:02:30.600532+0000","last_active":"2024-08-31T06:04:16.433533+0000","last_peered":"2024-08-31T06:04:16.433533+0000","last_clean":"2024-08-31T06:04:16.433533+0000","last_became_active":"2024-08-31T06:02:30.600013+0000","last_became_peered":"2024-08-31T06:02:30.600013+0000","last_unstale":"2024-08-31T06:04:16.433533+0000","last_undegraded":"2024-08-31T06:04:16.433533+0000","last_fullsized":"2024-08-31T06:04:16.433533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:38.753206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"70'12","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998027+0000","last_change":"2024-08-31T06:02:28.593921+0000","last_active":"2024-08-31T06:04:16.998027+0000","last_peered":"2024-08-31T06:04:16.998027+0000","last_clean":"2024-08-31T06:04:16.998027+0000","last_became_active":"2024-08-31T06:02:28.593102+0000","last_became_peered":"2024-08-31T06:02:28.593102+0000","last_unstale":"2024-08-31T06:04:16.998027+0000","last_undegraded":"2024-08-31T06:04:16.998027+0000","last_fullsized":"2024-08-31T06:04:16.998027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:30:35.791686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997199+0000","last_change":"2024-08-31T06:02:30.606524+0000","last_active":"2024-08-31T06:04:16.997199+0000","last_peered":"2024-08-31T06:04:16.997199+0000","last_clean":"2024-08-31T06:04:16.997199+0000","last_became_active":"2024-08-31T06:02:30.606132+0000","last_became_peered":"2024-08-31T06:02:30.606132+0000","last_unstale":"2024-08-31T06:04:16.997199+0000","last_undegraded":"2024-08-31T06:04:16.997199+0000","last_fullsized":"2024-08-31T06:04:16.997199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:46.566811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"70'2","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438110+0000","last_change":"2024-08-31T06:02:28.780596+0000","last_active":"2024-08-31T06:04:16.438110+0000","last_peered":"2024-08-31T06:04:16.438110+0000","last_clean":"2024-08-31T06:04:16.438110+0000","last_became_active":"2024-08-31T06:02:28.779908+0000","last_became_peered":"2024-08-31T06:02:28.779908+0000","last_unstale":"2024-08-31T06:04:16.438110+0000","last_undegraded":"2024-08-31T06:04:16.438110+0000","last_fullsized":"2024-08-31T06:04:16.438110+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:01.254340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"72'5","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823599+0000","last_change":"2024-08-31T06:03:15.776271+0000","last_active":"2024-08-31T06:04:16.823599+0000","last_peered":"2024-08-31T06:04:16.823599+0000","last_clean":"2024-08-31T06:04:16.823599+0000","last_became_active":"2024-08-31T06:03:15.775821+0000","last_became_peered":"2024-08-31T06:03:15.775821+0000","last_unstale":"2024-08-31T06:04:16.823599+0000","last_undegraded":"2024-08-31T06:04:16.823599+0000","last_fullsized":"2024-08-31T06:04:16.823599+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:52:34.076554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"74'14","reported_seq":143,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:21.832185+0000","last_change":"2024-08-31T06:02:28.593773+0000","last_active":"2024-08-31T06:04:21.832185+0000","last_peered":"2024-08-31T06:04:21.832185+0000","last_clean":"2024-08-31T06:04:21.832185+0000","last_became_active":"2024-08-31T06:02:28.593511+0000","last_became_peered":"2024-08-31T06:02:28.593511+0000","last_unstale":"2024-08-31T06:04:21.832185+0000","last_undegraded":"2024-08-31T06:04:21.832185+0000","last_fullsized":"2024-08-31T06:04:21.832185+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:01:50.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69962,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1067,"num_read_kb":610,"num_write":265,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":209886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906980,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070506,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1067609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928234030,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40344,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704808,"statfs":{"total":95995035648,"available":95953723392,"internally_reserved":0,"allocated":860160,"data_stored":414981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397556,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":415359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593784,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1454080,"data_stored":1010029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757309,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953537,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28456,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716696,"statfs":{"total":95995035648,"available":95965896704,"internally_reserved":0,"allocated":1466368,"data_stored":1008189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084358,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":415584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":414523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":477785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":905216,"data_stored":476115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":864256,"data_stored":416037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:04:27.218 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-31T06:04:27.218 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T06:04:27.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.363+0000 7fd46c532640 1 -- 172.21.15.53:0/3055938662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd464108090 msgr2=0x7fd4641084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:27.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.363+0000 7fd46c532640 1 --2- 172.21.15.53:0/3055938662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd464108090 0x7fd4641084a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd458009900 tx=0x7fd45802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:27.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.363+0000 7fd46c532640 1 -- 172.21.15.53:0/3055938662 shutdown_connections 2024-08-31T06:04:27.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.363+0000 7fd46c532640 1 --2- 172.21.15.53:0/3055938662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4641089e0 0x7fd46410f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.363+0000 7fd46c532640 1 --2- 172.21.15.53:0/3055938662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd464108090 0x7fd4641084a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.363+0000 7fd46c532640 1 --2- 172.21.15.53:0/3055938662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd464102760 0x7fd464102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.363+0000 7fd46c532640 1 -- 172.21.15.53:0/3055938662 >> 172.21.15.53:0/3055938662 conn(0x7fd4640fe160 msgr2=0x7fd4641005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:27.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.363+0000 7fd46c532640 1 -- 172.21.15.53:0/3055938662 shutdown_connections 2024-08-31T06:04:27.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.363+0000 7fd46c532640 1 -- 172.21.15.53:0/3055938662 wait complete. 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.363+0000 7fd46c532640 1 Processor -- start 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.363+0000 7fd46c532640 1 -- start start 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd46c532640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd464102760 0x7fd46419a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd46c532640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd464108090 0x7fd46419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd46c532640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4641089e0 0x7fd46419f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd46c532640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd464113670 con 0x7fd464108090 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd46c532640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd4641134f0 con 0x7fd4641089e0 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd46c532640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd4641137f0 con 0x7fd464102760 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd469acd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd464108090 0x7fd46419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd469acd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd464108090 0x7fd46419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35950/0 (socket says 172.21.15.53:35950) 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd469acd640 1 -- 172.21.15.53:0/1705834613 learned_addr learned my addr 172.21.15.53:0/1705834613 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd46aacf640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4641089e0 0x7fd46419f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd46a2ce640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd464102760 0x7fd46419a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd469acd640 1 -- 172.21.15.53:0/1705834613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd464102760 msgr2=0x7fd46419a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd469acd640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd464102760 0x7fd46419a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd469acd640 1 -- 172.21.15.53:0/1705834613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4641089e0 msgr2=0x7fd46419f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd469acd640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4641089e0 0x7fd46419f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd469acd640 1 -- 172.21.15.53:0/1705834613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4641a0000 con 0x7fd464108090 2024-08-31T06:04:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd469acd640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd464108090 0x7fd46419a670 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd458005940 tx=0x7fd4580040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd4637fe640 1 -- 172.21.15.53:0/1705834613 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45803f030 con 0x7fd464108090 2024-08-31T06:04:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd4637fe640 1 -- 172.21.15.53:0/1705834613 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd458003a80 con 0x7fd464108090 2024-08-31T06:04:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.364+0000 7fd46c532640 1 -- 172.21.15.53:0/1705834613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4641a0290 con 0x7fd464108090 2024-08-31T06:04:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.365+0000 7fd4637fe640 1 -- 172.21.15.53:0/1705834613 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458035070 con 0x7fd464108090 2024-08-31T06:04:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.365+0000 7fd46c532640 1 -- 172.21.15.53:0/1705834613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4641a6a80 con 0x7fd464108090 2024-08-31T06:04:27.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.365+0000 7fd46c532640 1 -- 172.21.15.53:0/1705834613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4641039d0 con 0x7fd464108090 2024-08-31T06:04:27.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.367+0000 7fd4637fe640 1 -- 172.21.15.53:0/1705834613 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fd458042030 con 0x7fd464108090 2024-08-31T06:04:27.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.368+0000 7fd4637fe640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd44c0b4c00 0x7fd44c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:27.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.368+0000 7fd46a2ce640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd44c0b4c00 0x7fd44c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:27.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.368+0000 7fd4637fe640 1 -- 172.21.15.53:0/1705834613 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd458105b40 con 0x7fd464108090 2024-08-31T06:04:27.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.368+0000 7fd46a2ce640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd44c0b4c00 0x7fd44c0b7110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd454005fd0 tx=0x7fd454009870 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:27.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.371+0000 7fd4637fe640 1 -- 172.21.15.53:0/1705834613 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd4580ccb50 con 0x7fd464108090 2024-08-31T06:04:27.471 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:27 smithi053 ceph-mon[18924]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s; 6 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T06:04:27.471 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:27 smithi053 ceph-mon[18924]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:27.472 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:27 smithi053 ceph-mon[18924]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:27.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.554+0000 7fd46c532640 1 -- 172.21.15.53:0/1705834613 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd46410a7e0 con 0x7fd44c0b4c00 2024-08-31T06:04:27.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.558+0000 7fd4637fe640 1 -- 172.21.15.53:0/1705834613 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258872 (secure 0 0 0) 0x7fd46410a7e0 con 0x7fd44c0b4c00 2024-08-31T06:04:27.563 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:27.564 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-08-31T06:04:27.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.561+0000 7fd46c532640 1 -- 172.21.15.53:0/1705834613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd44c0b4c00 msgr2=0x7fd44c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:27.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.561+0000 7fd46c532640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd44c0b4c00 0x7fd44c0b7110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd454005fd0 tx=0x7fd454009870 comp rx=0 tx=0).stop 2024-08-31T06:04:27.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.561+0000 7fd46c532640 1 -- 172.21.15.53:0/1705834613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd464108090 msgr2=0x7fd46419a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:27.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.561+0000 7fd46c532640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd464108090 0x7fd46419a670 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd458005940 tx=0x7fd4580040e0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.562+0000 7fd46c532640 1 -- 172.21.15.53:0/1705834613 shutdown_connections 2024-08-31T06:04:27.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.562+0000 7fd46c532640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd44c0b4c00 0x7fd44c0b7110 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.562+0000 7fd46c532640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4641089e0 0x7fd46419f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.562+0000 7fd46c532640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd464108090 0x7fd46419a670 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.562+0000 7fd46c532640 1 --2- 172.21.15.53:0/1705834613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd464102760 0x7fd46419a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:27.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.562+0000 7fd46c532640 1 -- 172.21.15.53:0/1705834613 >> 172.21.15.53:0/1705834613 conn(0x7fd4640fe160 msgr2=0x7fd464100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:27.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.562+0000 7fd46c532640 1 -- 172.21.15.53:0/1705834613 shutdown_connections 2024-08-31T06:04:27.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:27.562+0000 7fd46c532640 1 -- 172.21.15.53:0/1705834613 wait complete. 2024-08-31T06:04:27.575 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-08-31T06:04:26.365842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660564,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1148,"num_read_kb":679,"num_write":390,"num_write_kb":2303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2951908,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":821,"ondisk_log_size":821,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390364,"kb_used_data":11964,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551460,"statfs":{"total":1151940427776,"available":1151540695040,"internally_reserved":0,"allocated":12251136,"data_stored":6947014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2855,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":57,"num_write":20,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002544"},"pg_stats":[{"pgid":"3.3f","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436194+0000","last_change":"2024-08-31T06:02:30.611733+0000","last_active":"2024-08-31T06:04:16.436194+0000","last_peered":"2024-08-31T06:04:16.436194+0000","last_clean":"2024-08-31T06:04:16.436194+0000","last_became_active":"2024-08-31T06:02:30.610339+0000","last_became_peered":"2024-08-31T06:02:30.610339+0000","last_unstale":"2024-08-31T06:04:16.436194+0000","last_undegraded":"2024-08-31T06:04:16.436194+0000","last_fullsized":"2024-08-31T06:04:16.436194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:20.628524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996993+0000","last_change":"2024-08-31T06:02:30.604550+0000","last_active":"2024-08-31T06:04:16.996993+0000","last_peered":"2024-08-31T06:04:16.996993+0000","last_clean":"2024-08-31T06:04:16.996993+0000","last_became_active":"2024-08-31T06:02:30.604200+0000","last_became_peered":"2024-08-31T06:02:30.604200+0000","last_unstale":"2024-08-31T06:04:16.996993+0000","last_undegraded":"2024-08-31T06:04:16.996993+0000","last_fullsized":"2024-08-31T06:04:16.996993+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:31.191972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997029+0000","last_change":"2024-08-31T06:02:30.606102+0000","last_active":"2024-08-31T06:04:16.997029+0000","last_peered":"2024-08-31T06:04:16.997029+0000","last_clean":"2024-08-31T06:04:16.997029+0000","last_became_active":"2024-08-31T06:02:30.605738+0000","last_became_peered":"2024-08-31T06:02:30.605738+0000","last_unstale":"2024-08-31T06:04:16.997029+0000","last_undegraded":"2024-08-31T06:04:16.997029+0000","last_fullsized":"2024-08-31T06:04:16.997029+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:50:34.993218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827090+0000","last_change":"2024-08-31T06:02:30.603207+0000","last_active":"2024-08-31T06:04:16.827090+0000","last_peered":"2024-08-31T06:04:16.827090+0000","last_clean":"2024-08-31T06:04:16.827090+0000","last_became_active":"2024-08-31T06:02:30.602829+0000","last_became_peered":"2024-08-31T06:02:30.602829+0000","last_unstale":"2024-08-31T06:04:16.827090+0000","last_undegraded":"2024-08-31T06:04:16.827090+0000","last_fullsized":"2024-08-31T06:04:16.827090+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:02.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997618+0000","last_change":"2024-08-31T06:02:30.590760+0000","last_active":"2024-08-31T06:04:16.997618+0000","last_peered":"2024-08-31T06:04:16.997618+0000","last_clean":"2024-08-31T06:04:16.997618+0000","last_became_active":"2024-08-31T06:02:30.590198+0000","last_became_peered":"2024-08-31T06:02:30.590198+0000","last_unstale":"2024-08-31T06:04:16.997618+0000","last_undegraded":"2024-08-31T06:04:16.997618+0000","last_fullsized":"2024-08-31T06:04:16.997618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:50.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433579+0000","last_change":"2024-08-31T06:02:30.599924+0000","last_active":"2024-08-31T06:04:16.433579+0000","last_peered":"2024-08-31T06:04:16.433579+0000","last_clean":"2024-08-31T06:04:16.433579+0000","last_became_active":"2024-08-31T06:02:30.599566+0000","last_became_peered":"2024-08-31T06:02:30.599566+0000","last_unstale":"2024-08-31T06:04:16.433579+0000","last_undegraded":"2024-08-31T06:04:16.433579+0000","last_fullsized":"2024-08-31T06:04:16.433579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:58.265673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"72'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826124+0000","last_change":"2024-08-31T06:03:15.771521+0000","last_active":"2024-08-31T06:04:16.826124+0000","last_peered":"2024-08-31T06:04:16.826124+0000","last_clean":"2024-08-31T06:04:16.826124+0000","last_became_active":"2024-08-31T06:03:15.770969+0000","last_became_peered":"2024-08-31T06:03:15.770969+0000","last_unstale":"2024-08-31T06:04:16.826124+0000","last_undegraded":"2024-08-31T06:04:16.826124+0000","last_fullsized":"2024-08-31T06:04:16.826124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:31.724213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437763+0000","last_change":"2024-08-31T06:02:30.610057+0000","last_active":"2024-08-31T06:04:16.437763+0000","last_peered":"2024-08-31T06:04:16.437763+0000","last_clean":"2024-08-31T06:04:16.437763+0000","last_became_active":"2024-08-31T06:02:30.609654+0000","last_became_peered":"2024-08-31T06:02:30.609654+0000","last_unstale":"2024-08-31T06:04:16.437763+0000","last_undegraded":"2024-08-31T06:04:16.437763+0000","last_fullsized":"2024-08-31T06:04:16.437763+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:32:14.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435055+0000","last_change":"2024-08-31T06:02:30.606437+0000","last_active":"2024-08-31T06:04:16.435055+0000","last_peered":"2024-08-31T06:04:16.435055+0000","last_clean":"2024-08-31T06:04:16.435055+0000","last_became_active":"2024-08-31T06:02:30.605632+0000","last_became_peered":"2024-08-31T06:02:30.605632+0000","last_unstale":"2024-08-31T06:04:16.435055+0000","last_undegraded":"2024-08-31T06:04:16.435055+0000","last_fullsized":"2024-08-31T06:04:16.435055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:47.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"72'16","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434609+0000","last_change":"2024-08-31T06:02:30.605456+0000","last_active":"2024-08-31T06:04:16.434609+0000","last_peered":"2024-08-31T06:04:16.434609+0000","last_clean":"2024-08-31T06:04:16.434609+0000","last_became_active":"2024-08-31T06:02:30.604927+0000","last_became_peered":"2024-08-31T06:02:30.604927+0000","last_unstale":"2024-08-31T06:04:16.434609+0000","last_undegraded":"2024-08-31T06:04:16.434609+0000","last_fullsized":"2024-08-31T06:04:16.434609+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:30.340609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826434+0000","last_change":"2024-08-31T06:02:30.608595+0000","last_active":"2024-08-31T06:04:16.826434+0000","last_peered":"2024-08-31T06:04:16.826434+0000","last_clean":"2024-08-31T06:04:16.826434+0000","last_became_active":"2024-08-31T06:02:30.607695+0000","last_became_peered":"2024-08-31T06:02:30.607695+0000","last_unstale":"2024-08-31T06:04:16.826434+0000","last_undegraded":"2024-08-31T06:04:16.826434+0000","last_fullsized":"2024-08-31T06:04:16.826434+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:44:53.655598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827095+0000","last_change":"2024-08-31T06:02:30.595775+0000","last_active":"2024-08-31T06:04:16.827095+0000","last_peered":"2024-08-31T06:04:16.827095+0000","last_clean":"2024-08-31T06:04:16.827095+0000","last_became_active":"2024-08-31T06:02:30.595424+0000","last_became_peered":"2024-08-31T06:02:30.595424+0000","last_unstale":"2024-08-31T06:04:16.827095+0000","last_undegraded":"2024-08-31T06:04:16.827095+0000","last_fullsized":"2024-08-31T06:04:16.827095+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:56.382633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431879+0000","last_change":"2024-08-31T06:02:30.603465+0000","last_active":"2024-08-31T06:04:16.431879+0000","last_peered":"2024-08-31T06:04:16.431879+0000","last_clean":"2024-08-31T06:04:16.431879+0000","last_became_active":"2024-08-31T06:02:30.603041+0000","last_became_peered":"2024-08-31T06:02:30.603041+0000","last_unstale":"2024-08-31T06:04:16.431879+0000","last_undegraded":"2024-08-31T06:04:16.431879+0000","last_fullsized":"2024-08-31T06:04:16.431879+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:19:00.139973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996811+0000","last_change":"2024-08-31T06:02:30.593807+0000","last_active":"2024-08-31T06:04:16.996811+0000","last_peered":"2024-08-31T06:04:16.996811+0000","last_clean":"2024-08-31T06:04:16.996811+0000","last_became_active":"2024-08-31T06:02:30.593389+0000","last_became_peered":"2024-08-31T06:02:30.593389+0000","last_unstale":"2024-08-31T06:04:16.996811+0000","last_undegraded":"2024-08-31T06:04:16.996811+0000","last_fullsized":"2024-08-31T06:04:16.996811+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:01:04.398867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996779+0000","last_change":"2024-08-31T06:02:30.605207+0000","last_active":"2024-08-31T06:04:16.996779+0000","last_peered":"2024-08-31T06:04:16.996779+0000","last_clean":"2024-08-31T06:04:16.996779+0000","last_became_active":"2024-08-31T06:02:30.604866+0000","last_became_peered":"2024-08-31T06:02:30.604866+0000","last_unstale":"2024-08-31T06:04:16.996779+0000","last_undegraded":"2024-08-31T06:04:16.996779+0000","last_fullsized":"2024-08-31T06:04:16.996779+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:56.305638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433428+0000","last_change":"2024-08-31T06:02:30.601457+0000","last_active":"2024-08-31T06:04:16.433428+0000","last_peered":"2024-08-31T06:04:16.433428+0000","last_clean":"2024-08-31T06:04:16.433428+0000","last_became_active":"2024-08-31T06:02:30.601077+0000","last_became_peered":"2024-08-31T06:02:30.601077+0000","last_unstale":"2024-08-31T06:04:16.433428+0000","last_undegraded":"2024-08-31T06:04:16.433428+0000","last_fullsized":"2024-08-31T06:04:16.433428+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:51:42.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436274+0000","last_change":"2024-08-31T06:02:30.612475+0000","last_active":"2024-08-31T06:04:16.436274+0000","last_peered":"2024-08-31T06:04:16.436274+0000","last_clean":"2024-08-31T06:04:16.436274+0000","last_became_active":"2024-08-31T06:02:30.612088+0000","last_became_peered":"2024-08-31T06:02:30.612088+0000","last_unstale":"2024-08-31T06:04:16.436274+0000","last_undegraded":"2024-08-31T06:04:16.436274+0000","last_fullsized":"2024-08-31T06:04:16.436274+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:34.348645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823774+0000","last_change":"2024-08-31T06:02:30.605612+0000","last_active":"2024-08-31T06:04:16.823774+0000","last_peered":"2024-08-31T06:04:16.823774+0000","last_clean":"2024-08-31T06:04:16.823774+0000","last_became_active":"2024-08-31T06:02:30.605271+0000","last_became_peered":"2024-08-31T06:02:30.605271+0000","last_unstale":"2024-08-31T06:04:16.823774+0000","last_undegraded":"2024-08-31T06:04:16.823774+0000","last_fullsized":"2024-08-31T06:04:16.823774+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:38.003500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438194+0000","last_change":"2024-08-31T06:02:30.610328+0000","last_active":"2024-08-31T06:04:16.438194+0000","last_peered":"2024-08-31T06:04:16.438194+0000","last_clean":"2024-08-31T06:04:16.438194+0000","last_became_active":"2024-08-31T06:02:30.609935+0000","last_became_peered":"2024-08-31T06:02:30.609935+0000","last_unstale":"2024-08-31T06:04:16.438194+0000","last_undegraded":"2024-08-31T06:04:16.438194+0000","last_fullsized":"2024-08-31T06:04:16.438194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:22.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435885+0000","last_change":"2024-08-31T06:02:30.609207+0000","last_active":"2024-08-31T06:04:16.435885+0000","last_peered":"2024-08-31T06:04:16.435885+0000","last_clean":"2024-08-31T06:04:16.435885+0000","last_became_active":"2024-08-31T06:02:30.608635+0000","last_became_peered":"2024-08-31T06:02:30.608635+0000","last_unstale":"2024-08-31T06:04:16.435885+0000","last_undegraded":"2024-08-31T06:04:16.435885+0000","last_fullsized":"2024-08-31T06:04:16.435885+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:43.898073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431972+0000","last_change":"2024-08-31T06:02:30.595829+0000","last_active":"2024-08-31T06:04:16.431972+0000","last_peered":"2024-08-31T06:04:16.431972+0000","last_clean":"2024-08-31T06:04:16.431972+0000","last_became_active":"2024-08-31T06:02:30.595427+0000","last_became_peered":"2024-08-31T06:02:30.595427+0000","last_unstale":"2024-08-31T06:04:16.431972+0000","last_undegraded":"2024-08-31T06:04:16.431972+0000","last_fullsized":"2024-08-31T06:04:16.431972+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:09:39.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433777+0000","last_change":"2024-08-31T06:02:30.599513+0000","last_active":"2024-08-31T06:04:16.433777+0000","last_peered":"2024-08-31T06:04:16.433777+0000","last_clean":"2024-08-31T06:04:16.433777+0000","last_became_active":"2024-08-31T06:02:30.599195+0000","last_became_peered":"2024-08-31T06:02:30.599195+0000","last_unstale":"2024-08-31T06:04:16.433777+0000","last_undegraded":"2024-08-31T06:04:16.433777+0000","last_fullsized":"2024-08-31T06:04:16.433777+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:26.669658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437790+0000","last_change":"2024-08-31T06:02:30.609229+0000","last_active":"2024-08-31T06:04:16.437790+0000","last_peered":"2024-08-31T06:04:16.437790+0000","last_clean":"2024-08-31T06:04:16.437790+0000","last_became_active":"2024-08-31T06:02:30.608536+0000","last_became_peered":"2024-08-31T06:02:30.608536+0000","last_unstale":"2024-08-31T06:04:16.437790+0000","last_undegraded":"2024-08-31T06:04:16.437790+0000","last_fullsized":"2024-08-31T06:04:16.437790+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:08.917901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825521+0000","last_change":"2024-08-31T06:02:30.603663+0000","last_active":"2024-08-31T06:04:16.825521+0000","last_peered":"2024-08-31T06:04:16.825521+0000","last_clean":"2024-08-31T06:04:16.825521+0000","last_became_active":"2024-08-31T06:02:30.603220+0000","last_became_peered":"2024-08-31T06:02:30.603220+0000","last_unstale":"2024-08-31T06:04:16.825521+0000","last_undegraded":"2024-08-31T06:04:16.825521+0000","last_fullsized":"2024-08-31T06:04:16.825521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:09.433078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438040+0000","last_change":"2024-08-31T06:02:30.608474+0000","last_active":"2024-08-31T06:04:16.438040+0000","last_peered":"2024-08-31T06:04:16.438040+0000","last_clean":"2024-08-31T06:04:16.438040+0000","last_became_active":"2024-08-31T06:02:30.608118+0000","last_became_peered":"2024-08-31T06:02:30.608118+0000","last_unstale":"2024-08-31T06:04:16.438040+0000","last_undegraded":"2024-08-31T06:04:16.438040+0000","last_fullsized":"2024-08-31T06:04:16.438040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:55.124001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438523+0000","last_change":"2024-08-31T06:02:30.614255+0000","last_active":"2024-08-31T06:04:16.438523+0000","last_peered":"2024-08-31T06:04:16.438523+0000","last_clean":"2024-08-31T06:04:16.438523+0000","last_became_active":"2024-08-31T06:02:30.613805+0000","last_became_peered":"2024-08-31T06:02:30.613805+0000","last_unstale":"2024-08-31T06:04:16.438523+0000","last_undegraded":"2024-08-31T06:04:16.438523+0000","last_fullsized":"2024-08-31T06:04:16.438523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.892997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436018+0000","last_change":"2024-08-31T06:02:30.609877+0000","last_active":"2024-08-31T06:04:16.436018+0000","last_peered":"2024-08-31T06:04:16.436018+0000","last_clean":"2024-08-31T06:04:16.436018+0000","last_became_active":"2024-08-31T06:02:30.608805+0000","last_became_peered":"2024-08-31T06:02:30.608805+0000","last_unstale":"2024-08-31T06:04:16.436018+0000","last_undegraded":"2024-08-31T06:04:16.436018+0000","last_fullsized":"2024-08-31T06:04:16.436018+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:52.172745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431812+0000","last_change":"2024-08-31T06:02:30.594684+0000","last_active":"2024-08-31T06:04:16.431812+0000","last_peered":"2024-08-31T06:04:16.431812+0000","last_clean":"2024-08-31T06:04:16.431812+0000","last_became_active":"2024-08-31T06:02:30.594293+0000","last_became_peered":"2024-08-31T06:02:30.594293+0000","last_unstale":"2024-08-31T06:04:16.431812+0000","last_undegraded":"2024-08-31T06:04:16.431812+0000","last_fullsized":"2024-08-31T06:04:16.431812+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:58:39.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997035+0000","last_change":"2024-08-31T06:02:30.602765+0000","last_active":"2024-08-31T06:04:16.997035+0000","last_peered":"2024-08-31T06:04:16.997035+0000","last_clean":"2024-08-31T06:04:16.997035+0000","last_became_active":"2024-08-31T06:02:30.602410+0000","last_became_peered":"2024-08-31T06:02:30.602410+0000","last_unstale":"2024-08-31T06:04:16.997035+0000","last_undegraded":"2024-08-31T06:04:16.997035+0000","last_fullsized":"2024-08-31T06:04:16.997035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:12.370967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437952+0000","last_change":"2024-08-31T06:02:30.611818+0000","last_active":"2024-08-31T06:04:16.437952+0000","last_peered":"2024-08-31T06:04:16.437952+0000","last_clean":"2024-08-31T06:04:16.437952+0000","last_became_active":"2024-08-31T06:02:30.610917+0000","last_became_peered":"2024-08-31T06:02:30.610917+0000","last_unstale":"2024-08-31T06:04:16.437952+0000","last_undegraded":"2024-08-31T06:04:16.437952+0000","last_fullsized":"2024-08-31T06:04:16.437952+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:00.895825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"72'12","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438263+0000","last_change":"2024-08-31T06:02:30.612186+0000","last_active":"2024-08-31T06:04:16.438263+0000","last_peered":"2024-08-31T06:04:16.438263+0000","last_clean":"2024-08-31T06:04:16.438263+0000","last_became_active":"2024-08-31T06:02:30.610496+0000","last_became_peered":"2024-08-31T06:02:30.610496+0000","last_unstale":"2024-08-31T06:04:16.438263+0000","last_undegraded":"2024-08-31T06:04:16.438263+0000","last_fullsized":"2024-08-31T06:04:16.438263+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:48:19.954998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"72'9","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435716+0000","last_change":"2024-08-31T06:03:15.776507+0000","last_active":"2024-08-31T06:04:16.435716+0000","last_peered":"2024-08-31T06:04:16.435716+0000","last_clean":"2024-08-31T06:04:16.435716+0000","last_became_active":"2024-08-31T06:03:15.776039+0000","last_became_peered":"2024-08-31T06:03:15.776039+0000","last_unstale":"2024-08-31T06:04:16.435716+0000","last_undegraded":"2024-08-31T06:04:16.435716+0000","last_fullsized":"2024-08-31T06:04:16.435716+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:41.616112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997530+0000","last_change":"2024-08-31T06:02:30.607864+0000","last_active":"2024-08-31T06:04:16.997530+0000","last_peered":"2024-08-31T06:04:16.997530+0000","last_clean":"2024-08-31T06:04:16.997530+0000","last_became_active":"2024-08-31T06:02:30.607299+0000","last_became_peered":"2024-08-31T06:02:30.607299+0000","last_unstale":"2024-08-31T06:04:16.997530+0000","last_undegraded":"2024-08-31T06:04:16.997530+0000","last_fullsized":"2024-08-31T06:04:16.997530+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:19.302279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'8","reported_seq":143,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:23.836827+0000","last_change":"2024-08-31T06:02:28.594973+0000","last_active":"2024-08-31T06:04:23.836827+0000","last_peered":"2024-08-31T06:04:23.836827+0000","last_clean":"2024-08-31T06:04:23.836827+0000","last_became_active":"2024-08-31T06:02:28.594588+0000","last_became_peered":"2024-08-31T06:02:28.594588+0000","last_unstale":"2024-08-31T06:04:23.836827+0000","last_undegraded":"2024-08-31T06:04:23.836827+0000","last_fullsized":"2024-08-31T06:04:23.836827+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:29:48.016888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"72'8","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825760+0000","last_change":"2024-08-31T06:03:15.974504+0000","last_active":"2024-08-31T06:04:16.825760+0000","last_peered":"2024-08-31T06:04:16.825760+0000","last_clean":"2024-08-31T06:04:16.825760+0000","last_became_active":"2024-08-31T06:03:15.974139+0000","last_became_peered":"2024-08-31T06:03:15.974139+0000","last_unstale":"2024-08-31T06:04:16.825760+0000","last_undegraded":"2024-08-31T06:04:16.825760+0000","last_fullsized":"2024-08-31T06:04:16.825760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:22.742884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433751+0000","last_change":"2024-08-31T06:02:28.589152+0000","last_active":"2024-08-31T06:04:16.433751+0000","last_peered":"2024-08-31T06:04:16.433751+0000","last_clean":"2024-08-31T06:04:16.433751+0000","last_became_active":"2024-08-31T06:02:28.588758+0000","last_became_peered":"2024-08-31T06:02:28.588758+0000","last_unstale":"2024-08-31T06:04:16.433751+0000","last_undegraded":"2024-08-31T06:04:16.433751+0000","last_fullsized":"2024-08-31T06:04:16.433751+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:31.814105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"70'3","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431439+0000","last_change":"2024-08-31T06:02:28.585410+0000","last_active":"2024-08-31T06:04:16.431439+0000","last_peered":"2024-08-31T06:04:16.431439+0000","last_clean":"2024-08-31T06:04:16.431439+0000","last_became_active":"2024-08-31T06:02:28.584998+0000","last_became_peered":"2024-08-31T06:02:28.584998+0000","last_unstale":"2024-08-31T06:04:16.431439+0000","last_undegraded":"2024-08-31T06:04:16.431439+0000","last_fullsized":"2024-08-31T06:04:16.431439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:30.705460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437844+0000","last_change":"2024-08-31T06:02:30.597295+0000","last_active":"2024-08-31T06:04:16.437844+0000","last_peered":"2024-08-31T06:04:16.437844+0000","last_clean":"2024-08-31T06:04:16.437844+0000","last_became_active":"2024-08-31T06:02:30.596968+0000","last_became_peered":"2024-08-31T06:02:30.596968+0000","last_unstale":"2024-08-31T06:04:16.437844+0000","last_undegraded":"2024-08-31T06:04:16.437844+0000","last_fullsized":"2024-08-31T06:04:16.437844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:38.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"70'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825895+0000","last_change":"2024-08-31T06:02:28.594164+0000","last_active":"2024-08-31T06:04:16.825895+0000","last_peered":"2024-08-31T06:04:16.825895+0000","last_clean":"2024-08-31T06:04:16.825895+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.825895+0000","last_undegraded":"2024-08-31T06:04:16.825895+0000","last_fullsized":"2024-08-31T06:04:16.825895+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:21.780202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823573+0000","last_change":"2024-08-31T06:02:30.597500+0000","last_active":"2024-08-31T06:04:16.823573+0000","last_peered":"2024-08-31T06:04:16.823573+0000","last_clean":"2024-08-31T06:04:16.823573+0000","last_became_active":"2024-08-31T06:02:30.597147+0000","last_became_peered":"2024-08-31T06:02:30.597147+0000","last_unstale":"2024-08-31T06:04:16.823573+0000","last_undegraded":"2024-08-31T06:04:16.823573+0000","last_fullsized":"2024-08-31T06:04:16.823573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:34.111288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'6","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:22.834474+0000","last_change":"2024-08-31T06:02:28.585769+0000","last_active":"2024-08-31T06:04:22.834474+0000","last_peered":"2024-08-31T06:04:22.834474+0000","last_clean":"2024-08-31T06:04:22.834474+0000","last_became_active":"2024-08-31T06:02:28.585310+0000","last_became_peered":"2024-08-31T06:02:28.585310+0000","last_unstale":"2024-08-31T06:04:22.834474+0000","last_undegraded":"2024-08-31T06:04:22.834474+0000","last_fullsized":"2024-08-31T06:04:22.834474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:40.595986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434873+0000","last_change":"2024-08-31T06:02:30.601434+0000","last_active":"2024-08-31T06:04:16.434873+0000","last_peered":"2024-08-31T06:04:16.434873+0000","last_clean":"2024-08-31T06:04:16.434873+0000","last_became_active":"2024-08-31T06:02:30.601060+0000","last_became_peered":"2024-08-31T06:02:30.601060+0000","last_unstale":"2024-08-31T06:04:16.434873+0000","last_undegraded":"2024-08-31T06:04:16.434873+0000","last_fullsized":"2024-08-31T06:04:16.434873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:32.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"70'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826424+0000","last_change":"2024-08-31T06:02:28.593217+0000","last_active":"2024-08-31T06:04:16.826424+0000","last_peered":"2024-08-31T06:04:16.826424+0000","last_clean":"2024-08-31T06:04:16.826424+0000","last_became_active":"2024-08-31T06:02:28.592801+0000","last_became_peered":"2024-08-31T06:02:28.592801+0000","last_unstale":"2024-08-31T06:04:16.826424+0000","last_undegraded":"2024-08-31T06:04:16.826424+0000","last_fullsized":"2024-08-31T06:04:16.826424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:21.561089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"72'9","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997237+0000","last_change":"2024-08-31T06:03:15.770625+0000","last_active":"2024-08-31T06:04:16.997237+0000","last_peered":"2024-08-31T06:04:16.997237+0000","last_clean":"2024-08-31T06:04:16.997237+0000","last_became_active":"2024-08-31T06:03:15.770194+0000","last_became_peered":"2024-08-31T06:03:15.770194+0000","last_unstale":"2024-08-31T06:04:16.997237+0000","last_undegraded":"2024-08-31T06:04:16.997237+0000","last_fullsized":"2024-08-31T06:04:16.997237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:33:57.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825884+0000","last_change":"2024-08-31T06:02:28.781606+0000","last_active":"2024-08-31T06:04:16.825884+0000","last_peered":"2024-08-31T06:04:16.825884+0000","last_clean":"2024-08-31T06:04:16.825884+0000","last_became_active":"2024-08-31T06:02:28.780886+0000","last_became_peered":"2024-08-31T06:02:28.780886+0000","last_unstale":"2024-08-31T06:04:16.825884+0000","last_undegraded":"2024-08-31T06:04:16.825884+0000","last_fullsized":"2024-08-31T06:04:16.825884+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:07.540461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433810+0000","last_change":"2024-08-31T06:02:30.604358+0000","last_active":"2024-08-31T06:04:16.433810+0000","last_peered":"2024-08-31T06:04:16.433810+0000","last_clean":"2024-08-31T06:04:16.433810+0000","last_became_active":"2024-08-31T06:02:30.603980+0000","last_became_peered":"2024-08-31T06:02:30.603980+0000","last_unstale":"2024-08-31T06:04:16.433810+0000","last_undegraded":"2024-08-31T06:04:16.433810+0000","last_fullsized":"2024-08-31T06:04:16.433810+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:43:03.062141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'34","reported_seq":274,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:22.834521+0000","last_change":"2024-08-31T06:02:28.590795+0000","last_active":"2024-08-31T06:04:22.834521+0000","last_peered":"2024-08-31T06:04:22.834521+0000","last_clean":"2024-08-31T06:04:22.834521+0000","last_became_active":"2024-08-31T06:02:28.590397+0000","last_became_peered":"2024-08-31T06:02:28.590397+0000","last_unstale":"2024-08-31T06:04:22.834521+0000","last_undegraded":"2024-08-31T06:04:22.834521+0000","last_fullsized":"2024-08-31T06:04:22.834521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:30.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60504,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":165,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997865+0000","last_change":"2024-08-31T06:02:30.603110+0000","last_active":"2024-08-31T06:04:16.997865+0000","last_peered":"2024-08-31T06:04:16.997865+0000","last_clean":"2024-08-31T06:04:16.997865+0000","last_became_active":"2024-08-31T06:02:30.602691+0000","last_became_peered":"2024-08-31T06:02:30.602691+0000","last_unstale":"2024-08-31T06:04:16.997865+0000","last_undegraded":"2024-08-31T06:04:16.997865+0000","last_fullsized":"2024-08-31T06:04:16.997865+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:20.009202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"70'9","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.449977+0000","last_change":"2024-08-31T06:04:16.449444+0000","last_active":"2024-08-31T06:04:16.449977+0000","last_peered":"2024-08-31T06:04:16.449977+0000","last_clean":"2024-08-31T06:04:16.449977+0000","last_became_active":"2024-08-31T06:04:16.439087+0000","last_became_peered":"2024-08-31T06:04:16.439087+0000","last_unstale":"2024-08-31T06:04:16.449977+0000","last_undegraded":"2024-08-31T06:04:16.449977+0000","last_fullsized":"2024-08-31T06:04:16.449977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:38.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431600+0000","last_change":"2024-08-31T06:02:30.599843+0000","last_active":"2024-08-31T06:04:16.431600+0000","last_peered":"2024-08-31T06:04:16.431600+0000","last_clean":"2024-08-31T06:04:16.431600+0000","last_became_active":"2024-08-31T06:02:30.599440+0000","last_became_peered":"2024-08-31T06:02:30.599440+0000","last_unstale":"2024-08-31T06:04:16.431600+0000","last_undegraded":"2024-08-31T06:04:16.431600+0000","last_fullsized":"2024-08-31T06:04:16.431600+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:01.029482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825714+0000","last_change":"2024-08-31T06:02:28.594178+0000","last_active":"2024-08-31T06:04:16.825714+0000","last_peered":"2024-08-31T06:04:16.825714+0000","last_clean":"2024-08-31T06:04:16.825714+0000","last_became_active":"2024-08-31T06:02:28.593802+0000","last_became_peered":"2024-08-31T06:02:28.593802+0000","last_unstale":"2024-08-31T06:04:16.825714+0000","last_undegraded":"2024-08-31T06:04:16.825714+0000","last_fullsized":"2024-08-31T06:04:16.825714+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:52.561582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826106+0000","last_change":"2024-08-31T06:02:30.595979+0000","last_active":"2024-08-31T06:04:16.826106+0000","last_peered":"2024-08-31T06:04:16.826106+0000","last_clean":"2024-08-31T06:04:16.826106+0000","last_became_active":"2024-08-31T06:02:30.595665+0000","last_became_peered":"2024-08-31T06:02:30.595665+0000","last_unstale":"2024-08-31T06:04:16.826106+0000","last_undegraded":"2024-08-31T06:04:16.826106+0000","last_fullsized":"2024-08-31T06:04:16.826106+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:40.347954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'8","reported_seq":140,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:21.833268+0000","last_change":"2024-08-31T06:02:28.594117+0000","last_active":"2024-08-31T06:04:21.833268+0000","last_peered":"2024-08-31T06:04:21.833268+0000","last_clean":"2024-08-31T06:04:21.833268+0000","last_became_active":"2024-08-31T06:02:28.593721+0000","last_became_peered":"2024-08-31T06:02:28.593721+0000","last_unstale":"2024-08-31T06:04:21.833268+0000","last_undegraded":"2024-08-31T06:04:21.833268+0000","last_fullsized":"2024-08-31T06:04:21.833268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:48:49.400841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825844+0000","last_change":"2024-08-31T06:02:30.606967+0000","last_active":"2024-08-31T06:04:16.825844+0000","last_peered":"2024-08-31T06:04:16.825844+0000","last_clean":"2024-08-31T06:04:16.825844+0000","last_became_active":"2024-08-31T06:02:30.605730+0000","last_became_peered":"2024-08-31T06:02:30.605730+0000","last_unstale":"2024-08-31T06:04:16.825844+0000","last_undegraded":"2024-08-31T06:04:16.825844+0000","last_fullsized":"2024-08-31T06:04:16.825844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:30.656071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"70'17","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997489+0000","last_change":"2024-08-31T06:02:28.780911+0000","last_active":"2024-08-31T06:04:16.997489+0000","last_peered":"2024-08-31T06:04:16.997489+0000","last_clean":"2024-08-31T06:04:16.997489+0000","last_became_active":"2024-08-31T06:02:28.780375+0000","last_became_peered":"2024-08-31T06:02:28.780375+0000","last_unstale":"2024-08-31T06:04:16.997489+0000","last_undegraded":"2024-08-31T06:04:16.997489+0000","last_fullsized":"2024-08-31T06:04:16.997489+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:46.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825581+0000","last_change":"2024-08-31T06:02:30.606871+0000","last_active":"2024-08-31T06:04:16.825581+0000","last_peered":"2024-08-31T06:04:16.825581+0000","last_clean":"2024-08-31T06:04:16.825581+0000","last_became_active":"2024-08-31T06:02:30.606507+0000","last_became_peered":"2024-08-31T06:02:30.606507+0000","last_unstale":"2024-08-31T06:04:16.825581+0000","last_undegraded":"2024-08-31T06:04:16.825581+0000","last_fullsized":"2024-08-31T06:04:16.825581+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:16:31.502034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998046+0000","last_change":"2024-08-31T06:02:28.588078+0000","last_active":"2024-08-31T06:04:16.998046+0000","last_peered":"2024-08-31T06:04:16.998046+0000","last_clean":"2024-08-31T06:04:16.998046+0000","last_became_active":"2024-08-31T06:02:28.587642+0000","last_became_peered":"2024-08-31T06:02:28.587642+0000","last_unstale":"2024-08-31T06:04:16.998046+0000","last_undegraded":"2024-08-31T06:04:16.998046+0000","last_fullsized":"2024-08-31T06:04:16.998046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:59.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436127+0000","last_change":"2024-08-31T06:02:30.605647+0000","last_active":"2024-08-31T06:04:16.436127+0000","last_peered":"2024-08-31T06:04:16.436127+0000","last_clean":"2024-08-31T06:04:16.436127+0000","last_became_active":"2024-08-31T06:02:30.605267+0000","last_became_peered":"2024-08-31T06:02:30.605267+0000","last_unstale":"2024-08-31T06:04:16.436127+0000","last_undegraded":"2024-08-31T06:04:16.436127+0000","last_fullsized":"2024-08-31T06:04:16.436127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:08:34.741030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"70'5","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431745+0000","last_change":"2024-08-31T06:02:28.585295+0000","last_active":"2024-08-31T06:04:16.431745+0000","last_peered":"2024-08-31T06:04:16.431745+0000","last_clean":"2024-08-31T06:04:16.431745+0000","last_became_active":"2024-08-31T06:02:28.584895+0000","last_became_peered":"2024-08-31T06:02:28.584895+0000","last_unstale":"2024-08-31T06:04:16.431745+0000","last_undegraded":"2024-08-31T06:04:16.431745+0000","last_fullsized":"2024-08-31T06:04:16.431745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:57:12.658937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826465+0000","last_change":"2024-08-31T06:02:30.603593+0000","last_active":"2024-08-31T06:04:16.826465+0000","last_peered":"2024-08-31T06:04:16.826465+0000","last_clean":"2024-08-31T06:04:16.826465+0000","last_became_active":"2024-08-31T06:02:30.603274+0000","last_became_peered":"2024-08-31T06:02:30.603274+0000","last_unstale":"2024-08-31T06:04:16.826465+0000","last_undegraded":"2024-08-31T06:04:16.826465+0000","last_fullsized":"2024-08-31T06:04:16.826465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:07.720406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"70'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825979+0000","last_change":"2024-08-31T06:02:28.586920+0000","last_active":"2024-08-31T06:04:16.825979+0000","last_peered":"2024-08-31T06:04:16.825979+0000","last_clean":"2024-08-31T06:04:16.825979+0000","last_became_active":"2024-08-31T06:02:28.586362+0000","last_became_peered":"2024-08-31T06:02:28.586362+0000","last_unstale":"2024-08-31T06:04:16.825979+0000","last_undegraded":"2024-08-31T06:04:16.825979+0000","last_fullsized":"2024-08-31T06:04:16.825979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:52.065879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826269+0000","last_change":"2024-08-31T06:02:30.603800+0000","last_active":"2024-08-31T06:04:16.826269+0000","last_peered":"2024-08-31T06:04:16.826269+0000","last_clean":"2024-08-31T06:04:16.826269+0000","last_became_active":"2024-08-31T06:02:30.603439+0000","last_became_peered":"2024-08-31T06:02:30.603439+0000","last_unstale":"2024-08-31T06:04:16.826269+0000","last_undegraded":"2024-08-31T06:04:16.826269+0000","last_fullsized":"2024-08-31T06:04:16.826269+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:39.992719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":139,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:23.836719+0000","last_change":"2024-08-31T06:02:28.936404+0000","last_active":"2024-08-31T06:04:23.836719+0000","last_peered":"2024-08-31T06:04:23.836719+0000","last_clean":"2024-08-31T06:04:23.836719+0000","last_became_active":"2024-08-31T06:02:28.935898+0000","last_became_peered":"2024-08-31T06:02:28.935898+0000","last_unstale":"2024-08-31T06:04:23.836719+0000","last_undegraded":"2024-08-31T06:04:23.836719+0000","last_fullsized":"2024-08-31T06:04:23.836719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:35.004510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826610+0000","last_change":"2024-08-31T06:02:30.608258+0000","last_active":"2024-08-31T06:04:16.826610+0000","last_peered":"2024-08-31T06:04:16.826610+0000","last_clean":"2024-08-31T06:04:16.826610+0000","last_became_active":"2024-08-31T06:02:30.607067+0000","last_became_peered":"2024-08-31T06:02:30.607067+0000","last_unstale":"2024-08-31T06:04:16.826610+0000","last_undegraded":"2024-08-31T06:04:16.826610+0000","last_fullsized":"2024-08-31T06:04:16.826610+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:03:09.362812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":97,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826255+0000","last_change":"2024-08-31T06:01:19.125033+0000","last_active":"2024-08-31T06:04:16.826255+0000","last_peered":"2024-08-31T06:04:16.826255+0000","last_clean":"2024-08-31T06:04:16.826255+0000","last_became_active":"2024-08-31T06:01:19.118469+0000","last_became_peered":"2024-08-31T06:01:19.118469+0000","last_unstale":"2024-08-31T06:04:16.826255+0000","last_undegraded":"2024-08-31T06:04:16.826255+0000","last_fullsized":"2024-08-31T06:04:16.826255+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_clean_scrub_stamp":"2024-08-31T05:58:05.259854+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:33.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"70'6","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826883+0000","last_change":"2024-08-31T06:02:28.588276+0000","last_active":"2024-08-31T06:04:16.826883+0000","last_peered":"2024-08-31T06:04:16.826883+0000","last_clean":"2024-08-31T06:04:16.826883+0000","last_became_active":"2024-08-31T06:02:28.587184+0000","last_became_peered":"2024-08-31T06:02:28.587184+0000","last_unstale":"2024-08-31T06:04:16.826883+0000","last_undegraded":"2024-08-31T06:04:16.826883+0000","last_fullsized":"2024-08-31T06:04:16.826883+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:12.762919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437980+0000","last_change":"2024-08-31T06:02:30.610801+0000","last_active":"2024-08-31T06:04:16.437980+0000","last_peered":"2024-08-31T06:04:16.437980+0000","last_clean":"2024-08-31T06:04:16.437980+0000","last_became_active":"2024-08-31T06:02:30.610446+0000","last_became_peered":"2024-08-31T06:02:30.610446+0000","last_unstale":"2024-08-31T06:04:16.437980+0000","last_undegraded":"2024-08-31T06:04:16.437980+0000","last_fullsized":"2024-08-31T06:04:16.437980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:17.891734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"70'4","reported_seq":42,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826001+0000","last_change":"2024-08-31T06:03:15.777123+0000","last_active":"2024-08-31T06:04:16.826001+0000","last_peered":"2024-08-31T06:04:16.826001+0000","last_clean":"2024-08-31T06:04:16.826001+0000","last_became_active":"2024-08-31T06:03:15.773099+0000","last_became_peered":"2024-08-31T06:03:15.773099+0000","last_unstale":"2024-08-31T06:04:16.826001+0000","last_undegraded":"2024-08-31T06:04:16.826001+0000","last_fullsized":"2024-08-31T06:04:16.826001+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:56:51.706692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"72'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431436+0000","last_change":"2024-08-31T06:03:15.776402+0000","last_active":"2024-08-31T06:04:16.431436+0000","last_peered":"2024-08-31T06:04:16.431436+0000","last_clean":"2024-08-31T06:04:16.431436+0000","last_became_active":"2024-08-31T06:03:15.775949+0000","last_became_peered":"2024-08-31T06:03:15.775949+0000","last_unstale":"2024-08-31T06:04:16.431436+0000","last_undegraded":"2024-08-31T06:04:16.431436+0000","last_fullsized":"2024-08-31T06:04:16.431436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:51:34.646125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'6","reported_seq":138,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:24.837463+0000","last_change":"2024-08-31T06:02:28.780419+0000","last_active":"2024-08-31T06:04:24.837463+0000","last_peered":"2024-08-31T06:04:24.837463+0000","last_clean":"2024-08-31T06:04:24.837463+0000","last_became_active":"2024-08-31T06:02:28.779814+0000","last_became_peered":"2024-08-31T06:02:28.779814+0000","last_unstale":"2024-08-31T06:04:24.837463+0000","last_undegraded":"2024-08-31T06:04:24.837463+0000","last_fullsized":"2024-08-31T06:04:24.837463+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:36.183841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"72'8","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825581+0000","last_change":"2024-08-31T06:03:15.776468+0000","last_active":"2024-08-31T06:04:16.825581+0000","last_peered":"2024-08-31T06:04:16.825581+0000","last_clean":"2024-08-31T06:04:16.825581+0000","last_became_active":"2024-08-31T06:03:15.776005+0000","last_became_peered":"2024-08-31T06:03:15.776005+0000","last_unstale":"2024-08-31T06:04:16.825581+0000","last_undegraded":"2024-08-31T06:04:16.825581+0000","last_fullsized":"2024-08-31T06:04:16.825581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:47:36.420584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'6","reported_seq":138,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:23.836084+0000","last_change":"2024-08-31T06:02:28.594220+0000","last_active":"2024-08-31T06:04:23.836084+0000","last_peered":"2024-08-31T06:04:23.836084+0000","last_clean":"2024-08-31T06:04:23.836084+0000","last_became_active":"2024-08-31T06:02:28.593729+0000","last_became_peered":"2024-08-31T06:02:28.593729+0000","last_unstale":"2024-08-31T06:04:23.836084+0000","last_undegraded":"2024-08-31T06:04:23.836084+0000","last_fullsized":"2024-08-31T06:04:23.836084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:37:03.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433754+0000","last_change":"2024-08-31T06:02:30.600008+0000","last_active":"2024-08-31T06:04:16.433754+0000","last_peered":"2024-08-31T06:04:16.433754+0000","last_clean":"2024-08-31T06:04:16.433754+0000","last_became_active":"2024-08-31T06:02:30.599677+0000","last_became_peered":"2024-08-31T06:02:30.599677+0000","last_unstale":"2024-08-31T06:04:16.433754+0000","last_undegraded":"2024-08-31T06:04:16.433754+0000","last_fullsized":"2024-08-31T06:04:16.433754+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:59.520544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"70'1","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823590+0000","last_change":"2024-08-31T06:02:28.780554+0000","last_active":"2024-08-31T06:04:16.823590+0000","last_peered":"2024-08-31T06:04:16.823590+0000","last_clean":"2024-08-31T06:04:16.823590+0000","last_became_active":"2024-08-31T06:02:28.780137+0000","last_became_peered":"2024-08-31T06:02:28.780137+0000","last_unstale":"2024-08-31T06:04:16.823590+0000","last_undegraded":"2024-08-31T06:04:16.823590+0000","last_fullsized":"2024-08-31T06:04:16.823590+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:57.523667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433847+0000","last_change":"2024-08-31T06:02:30.597438+0000","last_active":"2024-08-31T06:04:16.433847+0000","last_peered":"2024-08-31T06:04:16.433847+0000","last_clean":"2024-08-31T06:04:16.433847+0000","last_became_active":"2024-08-31T06:02:30.597108+0000","last_became_peered":"2024-08-31T06:02:30.597108+0000","last_unstale":"2024-08-31T06:04:16.433847+0000","last_undegraded":"2024-08-31T06:04:16.433847+0000","last_fullsized":"2024-08-31T06:04:16.433847+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:05.238708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"70'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998028+0000","last_change":"2024-08-31T06:02:28.781006+0000","last_active":"2024-08-31T06:04:16.998028+0000","last_peered":"2024-08-31T06:04:16.998028+0000","last_clean":"2024-08-31T06:04:16.998028+0000","last_became_active":"2024-08-31T06:02:28.780468+0000","last_became_peered":"2024-08-31T06:02:28.780468+0000","last_unstale":"2024-08-31T06:04:16.998028+0000","last_undegraded":"2024-08-31T06:04:16.998028+0000","last_fullsized":"2024-08-31T06:04:16.998028+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:20.206251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431841+0000","last_change":"2024-08-31T06:02:30.600826+0000","last_active":"2024-08-31T06:04:16.431841+0000","last_peered":"2024-08-31T06:04:16.431841+0000","last_clean":"2024-08-31T06:04:16.431841+0000","last_became_active":"2024-08-31T06:02:30.600474+0000","last_became_peered":"2024-08-31T06:02:30.600474+0000","last_unstale":"2024-08-31T06:04:16.431841+0000","last_undegraded":"2024-08-31T06:04:16.431841+0000","last_fullsized":"2024-08-31T06:04:16.431841+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:07.456576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'17","reported_seq":44,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823881+0000","last_change":"2024-08-31T06:02:28.588026+0000","last_active":"2024-08-31T06:04:16.823881+0000","last_peered":"2024-08-31T06:04:16.823881+0000","last_clean":"2024-08-31T06:04:16.823881+0000","last_became_active":"2024-08-31T06:02:28.587759+0000","last_became_peered":"2024-08-31T06:02:28.587759+0000","last_unstale":"2024-08-31T06:04:16.823881+0000","last_undegraded":"2024-08-31T06:04:16.823881+0000","last_fullsized":"2024-08-31T06:04:16.823881+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:44.323111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438064+0000","last_change":"2024-08-31T06:02:30.604375+0000","last_active":"2024-08-31T06:04:16.438064+0000","last_peered":"2024-08-31T06:04:16.438064+0000","last_clean":"2024-08-31T06:04:16.438064+0000","last_became_active":"2024-08-31T06:02:30.604008+0000","last_became_peered":"2024-08-31T06:02:30.604008+0000","last_unstale":"2024-08-31T06:04:16.438064+0000","last_undegraded":"2024-08-31T06:04:16.438064+0000","last_fullsized":"2024-08-31T06:04:16.438064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:37.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"70'7","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827216+0000","last_change":"2024-08-31T06:02:28.936568+0000","last_active":"2024-08-31T06:04:16.827216+0000","last_peered":"2024-08-31T06:04:16.827216+0000","last_clean":"2024-08-31T06:04:16.827216+0000","last_became_active":"2024-08-31T06:02:28.936185+0000","last_became_peered":"2024-08-31T06:02:28.936185+0000","last_unstale":"2024-08-31T06:04:16.827216+0000","last_undegraded":"2024-08-31T06:04:16.827216+0000","last_fullsized":"2024-08-31T06:04:16.827216+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:34.080300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"72'7","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996996+0000","last_change":"2024-08-31T06:03:15.771653+0000","last_active":"2024-08-31T06:04:16.996996+0000","last_peered":"2024-08-31T06:04:16.996996+0000","last_clean":"2024-08-31T06:04:16.996996+0000","last_became_active":"2024-08-31T06:03:15.770903+0000","last_became_peered":"2024-08-31T06:03:15.770903+0000","last_unstale":"2024-08-31T06:04:16.996996+0000","last_undegraded":"2024-08-31T06:04:16.996996+0000","last_fullsized":"2024-08-31T06:04:16.996996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:50.547558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"70'2","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433650+0000","last_change":"2024-08-31T06:03:15.777577+0000","last_active":"2024-08-31T06:04:16.433650+0000","last_peered":"2024-08-31T06:04:16.433650+0000","last_clean":"2024-08-31T06:04:16.433650+0000","last_became_active":"2024-08-31T06:03:15.773006+0000","last_became_peered":"2024-08-31T06:03:15.773006+0000","last_unstale":"2024-08-31T06:04:16.433650+0000","last_undegraded":"2024-08-31T06:04:16.433650+0000","last_fullsized":"2024-08-31T06:04:16.433650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:31.531741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997519+0000","last_change":"2024-08-31T06:02:30.604018+0000","last_active":"2024-08-31T06:04:16.997519+0000","last_peered":"2024-08-31T06:04:16.997519+0000","last_clean":"2024-08-31T06:04:16.997519+0000","last_became_active":"2024-08-31T06:02:30.603411+0000","last_became_peered":"2024-08-31T06:02:30.603411+0000","last_unstale":"2024-08-31T06:04:16.997519+0000","last_undegraded":"2024-08-31T06:04:16.997519+0000","last_fullsized":"2024-08-31T06:04:16.997519+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:34:30.732954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437921+0000","last_change":"2024-08-31T06:02:28.586348+0000","last_active":"2024-08-31T06:04:16.437921+0000","last_peered":"2024-08-31T06:04:16.437921+0000","last_clean":"2024-08-31T06:04:16.437921+0000","last_became_active":"2024-08-31T06:02:28.586046+0000","last_became_peered":"2024-08-31T06:02:28.586046+0000","last_unstale":"2024-08-31T06:04:16.437921+0000","last_undegraded":"2024-08-31T06:04:16.437921+0000","last_fullsized":"2024-08-31T06:04:16.437921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:30.987232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435839+0000","last_change":"2024-08-31T06:02:30.616402+0000","last_active":"2024-08-31T06:04:16.435839+0000","last_peered":"2024-08-31T06:04:16.435839+0000","last_clean":"2024-08-31T06:04:16.435839+0000","last_became_active":"2024-08-31T06:02:30.616014+0000","last_became_peered":"2024-08-31T06:02:30.616014+0000","last_unstale":"2024-08-31T06:04:16.435839+0000","last_undegraded":"2024-08-31T06:04:16.435839+0000","last_fullsized":"2024-08-31T06:04:16.435839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:42.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438077+0000","last_change":"2024-08-31T06:02:28.590184+0000","last_active":"2024-08-31T06:04:16.438077+0000","last_peered":"2024-08-31T06:04:16.438077+0000","last_clean":"2024-08-31T06:04:16.438077+0000","last_became_active":"2024-08-31T06:02:28.588830+0000","last_became_peered":"2024-08-31T06:02:28.588830+0000","last_unstale":"2024-08-31T06:04:16.438077+0000","last_undegraded":"2024-08-31T06:04:16.438077+0000","last_fullsized":"2024-08-31T06:04:16.438077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:03.072197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438070+0000","last_change":"2024-08-31T06:02:30.597262+0000","last_active":"2024-08-31T06:04:16.438070+0000","last_peered":"2024-08-31T06:04:16.438070+0000","last_clean":"2024-08-31T06:04:16.438070+0000","last_became_active":"2024-08-31T06:02:30.596862+0000","last_became_peered":"2024-08-31T06:02:30.596862+0000","last_unstale":"2024-08-31T06:04:16.438070+0000","last_undegraded":"2024-08-31T06:04:16.438070+0000","last_fullsized":"2024-08-31T06:04:16.438070+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:46:29.378532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"70'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997626+0000","last_change":"2024-08-31T06:02:28.594161+0000","last_active":"2024-08-31T06:04:16.997626+0000","last_peered":"2024-08-31T06:04:16.997626+0000","last_clean":"2024-08-31T06:04:16.997626+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.997626+0000","last_undegraded":"2024-08-31T06:04:16.997626+0000","last_fullsized":"2024-08-31T06:04:16.997626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:31:17.941172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826133+0000","last_change":"2024-08-31T06:02:30.595194+0000","last_active":"2024-08-31T06:04:16.826133+0000","last_peered":"2024-08-31T06:04:16.826133+0000","last_clean":"2024-08-31T06:04:16.826133+0000","last_became_active":"2024-08-31T06:02:30.594812+0000","last_became_peered":"2024-08-31T06:02:30.594812+0000","last_unstale":"2024-08-31T06:04:16.826133+0000","last_undegraded":"2024-08-31T06:04:16.826133+0000","last_fullsized":"2024-08-31T06:04:16.826133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:03.224924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825830+0000","last_change":"2024-08-31T06:02:30.615776+0000","last_active":"2024-08-31T06:04:16.825830+0000","last_peered":"2024-08-31T06:04:16.825830+0000","last_clean":"2024-08-31T06:04:16.825830+0000","last_became_active":"2024-08-31T06:02:30.615385+0000","last_became_peered":"2024-08-31T06:02:30.615385+0000","last_unstale":"2024-08-31T06:04:16.825830+0000","last_undegraded":"2024-08-31T06:04:16.825830+0000","last_fullsized":"2024-08-31T06:04:16.825830+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:49.685443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997930+0000","last_change":"2024-08-31T06:02:28.591064+0000","last_active":"2024-08-31T06:04:16.997930+0000","last_peered":"2024-08-31T06:04:16.997930+0000","last_clean":"2024-08-31T06:04:16.997930+0000","last_became_active":"2024-08-31T06:02:28.590643+0000","last_became_peered":"2024-08-31T06:02:28.590643+0000","last_unstale":"2024-08-31T06:04:16.997930+0000","last_undegraded":"2024-08-31T06:04:16.997930+0000","last_fullsized":"2024-08-31T06:04:16.997930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:01.953317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433533+0000","last_change":"2024-08-31T06:02:30.600532+0000","last_active":"2024-08-31T06:04:16.433533+0000","last_peered":"2024-08-31T06:04:16.433533+0000","last_clean":"2024-08-31T06:04:16.433533+0000","last_became_active":"2024-08-31T06:02:30.600013+0000","last_became_peered":"2024-08-31T06:02:30.600013+0000","last_unstale":"2024-08-31T06:04:16.433533+0000","last_undegraded":"2024-08-31T06:04:16.433533+0000","last_fullsized":"2024-08-31T06:04:16.433533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:38.753206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"70'12","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998027+0000","last_change":"2024-08-31T06:02:28.593921+0000","last_active":"2024-08-31T06:04:16.998027+0000","last_peered":"2024-08-31T06:04:16.998027+0000","last_clean":"2024-08-31T06:04:16.998027+0000","last_became_active":"2024-08-31T06:02:28.593102+0000","last_became_peered":"2024-08-31T06:02:28.593102+0000","last_unstale":"2024-08-31T06:04:16.998027+0000","last_undegraded":"2024-08-31T06:04:16.998027+0000","last_fullsized":"2024-08-31T06:04:16.998027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:30:35.791686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997199+0000","last_change":"2024-08-31T06:02:30.606524+0000","last_active":"2024-08-31T06:04:16.997199+0000","last_peered":"2024-08-31T06:04:16.997199+0000","last_clean":"2024-08-31T06:04:16.997199+0000","last_became_active":"2024-08-31T06:02:30.606132+0000","last_became_peered":"2024-08-31T06:02:30.606132+0000","last_unstale":"2024-08-31T06:04:16.997199+0000","last_undegraded":"2024-08-31T06:04:16.997199+0000","last_fullsized":"2024-08-31T06:04:16.997199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:46.566811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"70'2","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438110+0000","last_change":"2024-08-31T06:02:28.780596+0000","last_active":"2024-08-31T06:04:16.438110+0000","last_peered":"2024-08-31T06:04:16.438110+0000","last_clean":"2024-08-31T06:04:16.438110+0000","last_became_active":"2024-08-31T06:02:28.779908+0000","last_became_peered":"2024-08-31T06:02:28.779908+0000","last_unstale":"2024-08-31T06:04:16.438110+0000","last_undegraded":"2024-08-31T06:04:16.438110+0000","last_fullsized":"2024-08-31T06:04:16.438110+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:01.254340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"72'5","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823599+0000","last_change":"2024-08-31T06:03:15.776271+0000","last_active":"2024-08-31T06:04:16.823599+0000","last_peered":"2024-08-31T06:04:16.823599+0000","last_clean":"2024-08-31T06:04:16.823599+0000","last_became_active":"2024-08-31T06:03:15.775821+0000","last_became_peered":"2024-08-31T06:03:15.775821+0000","last_unstale":"2024-08-31T06:04:16.823599+0000","last_undegraded":"2024-08-31T06:04:16.823599+0000","last_fullsized":"2024-08-31T06:04:16.823599+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:52:34.076554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"74'14","reported_seq":143,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:21.832185+0000","last_change":"2024-08-31T06:02:28.593773+0000","last_active":"2024-08-31T06:04:21.832185+0000","last_peered":"2024-08-31T06:04:21.832185+0000","last_clean":"2024-08-31T06:04:21.832185+0000","last_became_active":"2024-08-31T06:02:28.593511+0000","last_became_peered":"2024-08-31T06:02:28.593511+0000","last_unstale":"2024-08-31T06:04:21.832185+0000","last_undegraded":"2024-08-31T06:04:21.832185+0000","last_fullsized":"2024-08-31T06:04:21.832185+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:01:50.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69962,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1067,"num_read_kb":610,"num_write":265,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":209886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906980,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070506,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1067609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928234030,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40344,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704808,"statfs":{"total":95995035648,"available":95953723392,"internally_reserved":0,"allocated":860160,"data_stored":414981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397556,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":415359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593784,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1454080,"data_stored":1010029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757309,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953537,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28456,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716696,"statfs":{"total":95995035648,"available":95965896704,"internally_reserved":0,"allocated":1466368,"data_stored":1008189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084358,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":415584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":414523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":477785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":905216,"data_stored":476115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":864256,"data_stored":416037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:04:27.579 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:04:27.868 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:27 smithi130 ceph-mon[22266]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s; 6 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T06:04:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:27 smithi130 ceph-mon[22266]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:27 smithi130 ceph-mon[22266]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:27 smithi153 ceph-mon[22320]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s; 6 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T06:04:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:27 smithi153 ceph-mon[22320]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:27 smithi153 ceph-mon[22320]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.328+0000 7fd8706bd640 1 -- 172.21.15.53:0/2025781071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd868108ac0 msgr2=0x7fd86810f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.328+0000 7fd8706bd640 1 --2- 172.21.15.53:0/2025781071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd868108ac0 0x7fd86810f2f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd860009ca0 tx=0x7fd86002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:04:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.328+0000 7fd8706bd640 1 -- 172.21.15.53:0/2025781071 shutdown_connections 2024-08-31T06:04:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.328+0000 7fd8706bd640 1 --2- 172.21.15.53:0/2025781071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd868108ac0 0x7fd86810f2f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.328+0000 7fd8706bd640 1 --2- 172.21.15.53:0/2025781071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd868108170 0x7fd868108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.328+0000 7fd8706bd640 1 --2- 172.21.15.53:0/2025781071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd868102880 0x7fd868102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.328+0000 7fd8706bd640 1 -- 172.21.15.53:0/2025781071 >> 172.21.15.53:0/2025781071 conn(0x7fd868079500 msgr2=0x7fd868079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.328+0000 7fd8706bd640 1 -- 172.21.15.53:0/2025781071 shutdown_connections 2024-08-31T06:04:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.328+0000 7fd8706bd640 1 -- 172.21.15.53:0/2025781071 wait complete. 2024-08-31T06:04:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.329+0000 7fd8706bd640 1 Processor -- start 2024-08-31T06:04:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.329+0000 7fd8706bd640 1 -- start start 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.329+0000 7fd8706bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd868102880 0x7fd868198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.329+0000 7fd8706bd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd868108170 0x7fd868199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.329+0000 7fd8706bd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd868108ac0 0x7fd868199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.329+0000 7fd8706bd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd868112640 con 0x7fd868102880 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.329+0000 7fd8706bd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd8681124c0 con 0x7fd868108ac0 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.329+0000 7fd8706bd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd8681127c0 con 0x7fd868108170 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.329+0000 7fd86e459640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd868102880 0x7fd868198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.329+0000 7fd86e459640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd868102880 0x7fd868198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35974/0 (socket says 172.21.15.53:35974) 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.329+0000 7fd86e459640 1 -- 172.21.15.53:0/57306241 learned_addr learned my addr 172.21.15.53:0/57306241 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd86ec5a640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd868108ac0 0x7fd868199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd86dc58640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd868108170 0x7fd868199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd86e459640 1 -- 172.21.15.53:0/57306241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd868108170 msgr2=0x7fd868199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd86e459640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd868108170 0x7fd868199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd86e459640 1 -- 172.21.15.53:0/57306241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd868108ac0 msgr2=0x7fd868199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd86e459640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd868108ac0 0x7fd868199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd86e459640 1 -- 172.21.15.53:0/57306241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8681a8360 con 0x7fd868102880 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd86dc58640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd868108170 0x7fd868199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd86e459640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd868102880 0x7fd868198ce0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c970 tx=0x7fd85800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd8677fe640 1 -- 172.21.15.53:0/57306241 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858007bb0 con 0x7fd868102880 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd8706bd640 1 -- 172.21.15.53:0/57306241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8681a85f0 con 0x7fd868102880 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd8677fe640 1 -- 172.21.15.53:0/57306241 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd858007d50 con 0x7fd868102880 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd8677fe640 1 -- 172.21.15.53:0/57306241 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858004e40 con 0x7fd868102880 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.330+0000 7fd8706bd640 1 -- 172.21.15.53:0/57306241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8681a8ae0 con 0x7fd868102880 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.331+0000 7fd8706bd640 1 -- 172.21.15.53:0/57306241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd868103ab0 con 0x7fd868102880 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.333+0000 7fd8677fe640 1 -- 172.21.15.53:0/57306241 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fd858005000 con 0x7fd868102880 2024-08-31T06:04:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.334+0000 7fd8677fe640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8500b4b80 0x7fd8500b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:28.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.334+0000 7fd86dc58640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8500b4b80 0x7fd8500b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:28.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.334+0000 7fd8677fe640 1 -- 172.21.15.53:0/57306241 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd8580e54e0 con 0x7fd868102880 2024-08-31T06:04:28.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.334+0000 7fd86dc58640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8500b4b80 0x7fd8500b7090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd868105c80 tx=0x7fd85c005d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:28.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.337+0000 7fd8677fe640 1 -- 172.21.15.53:0/57306241 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd858014030 con 0x7fd868102880 2024-08-31T06:04:28.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.560+0000 7fd8706bd640 1 -- 172.21.15.53:0/57306241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd868102c90 con 0x7fd868102880 2024-08-31T06:04:28.563 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:28 smithi053 ceph-mon[18924]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:28.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.561+0000 7fd8677fe640 1 -- 172.21.15.53:0/57306241 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11985 (secure 0 0 0) 0x7fd868102c90 con 0x7fd868102880 2024-08-31T06:04:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:28.564 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-08-31T06:04:23:449285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:04:23.359453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:04:28.564 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-08-31T06:04:28.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.563+0000 7fd8706bd640 1 -- 172.21.15.53:0/57306241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8500b4b80 msgr2=0x7fd8500b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:28.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.563+0000 7fd8706bd640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8500b4b80 0x7fd8500b7090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd868105c80 tx=0x7fd85c005d90 comp rx=0 tx=0).stop 2024-08-31T06:04:28.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.563+0000 7fd8706bd640 1 -- 172.21.15.53:0/57306241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd868102880 msgr2=0x7fd868198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:28.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.563+0000 7fd8706bd640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd868102880 0x7fd868198ce0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd85800c970 tx=0x7fd85800ce30 comp rx=0 tx=0).stop 2024-08-31T06:04:28.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.564+0000 7fd8706bd640 1 -- 172.21.15.53:0/57306241 shutdown_connections 2024-08-31T06:04:28.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.564+0000 7fd8706bd640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8500b4b80 0x7fd8500b7090 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:28.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.564+0000 7fd8706bd640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd868108ac0 0x7fd868199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:28.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.564+0000 7fd8706bd640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd868108170 0x7fd868199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:28.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.564+0000 7fd8706bd640 1 --2- 172.21.15.53:0/57306241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd868102880 0x7fd868198ce0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:28.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.564+0000 7fd8706bd640 1 -- 172.21.15.53:0/57306241 >> 172.21.15.53:0/57306241 conn(0x7fd868079500 msgr2=0x7fd8681041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:28.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.564+0000 7fd8706bd640 1 -- 172.21.15.53:0/57306241 shutdown_connections 2024-08-31T06:04:28.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:28.564+0000 7fd8706bd640 1 -- 172.21.15.53:0/57306241 wait complete. 2024-08-31T06:04:28.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:28 smithi130 ceph-mon[22266]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:28.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:28 smithi153 ceph-mon[22320]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:29.351 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:04:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:29.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:29 smithi053 ceph-mon[18924]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 13 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T06:04:29.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:29 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/57306241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:29.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:29 smithi130 ceph-mon[22266]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 13 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T06:04:29.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:29 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/57306241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:29 smithi153 ceph-mon[22320]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 13 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T06:04:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:29 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/57306241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.135+0000 7f009da2c640 1 -- 172.21.15.53:0/2621826699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0098101ea0 msgr2=0x7f00981022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.135+0000 7f009da2c640 1 --2- 172.21.15.53:0/2621826699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0098101ea0 0x7f00981022b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0088009900 tx=0x7f008802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.135+0000 7f009da2c640 1 -- 172.21.15.53:0/2621826699 shutdown_connections 2024-08-31T06:04:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.135+0000 7f009da2c640 1 --2- 172.21.15.53:0/2621826699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0098106a40 0x7f00981104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.135+0000 7f009da2c640 1 --2- 172.21.15.53:0/2621826699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00981060f0 0x7f0098106500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.135+0000 7f009da2c640 1 --2- 172.21.15.53:0/2621826699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0098101ea0 0x7f00981022b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.135+0000 7f009da2c640 1 -- 172.21.15.53:0/2621826699 >> 172.21.15.53:0/2621826699 conn(0x7f0098079c60 msgr2=0x7f009807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.135+0000 7f009da2c640 1 -- 172.21.15.53:0/2621826699 shutdown_connections 2024-08-31T06:04:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.135+0000 7f009da2c640 1 -- 172.21.15.53:0/2621826699 wait complete. 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f009da2c640 1 Processor -- start 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f009da2c640 1 -- start start 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f009da2c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0098101ea0 0x7f009819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f009da2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00981060f0 0x7f009819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f009da2c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0098106a40 0x7f009819faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f009da2c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f00981137c0 con 0x7f00981060f0 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f009da2c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0098113640 con 0x7f0098106a40 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f009da2c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0098113940 con 0x7f0098101ea0 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f00967fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00981060f0 0x7f009819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f00967fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00981060f0 0x7f009819a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35996/0 (socket says 172.21.15.53:35996) 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f00967fc640 1 -- 172.21.15.53:0/795899175 learned_addr learned my addr 172.21.15.53:0/795899175 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.136+0000 7f0096ffd640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0098101ea0 0x7f009819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f00977fe640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0098106a40 0x7f009819faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f00967fc640 1 -- 172.21.15.53:0/795899175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0098101ea0 msgr2=0x7f009819a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f00967fc640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0098101ea0 0x7f009819a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f00967fc640 1 -- 172.21.15.53:0/795899175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0098106a40 msgr2=0x7f009819faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f00967fc640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0098106a40 0x7f009819faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f00967fc640 1 -- 172.21.15.53:0/795899175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00981a0160 con 0x7f00981060f0 2024-08-31T06:04:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f00977fe640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0098106a40 0x7f009819faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f00967fc640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00981060f0 0x7f009819a850 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c8c0 tx=0x7f008c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f009ca2a640 1 -- 172.21.15.53:0/795899175 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c007bb0 con 0x7f00981060f0 2024-08-31T06:04:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f009da2c640 1 -- 172.21.15.53:0/795899175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00981a0450 con 0x7f00981060f0 2024-08-31T06:04:30.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f009ca2a640 1 -- 172.21.15.53:0/795899175 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f008c007d50 con 0x7f00981060f0 2024-08-31T06:04:30.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f009ca2a640 1 -- 172.21.15.53:0/795899175 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c018660 con 0x7f00981060f0 2024-08-31T06:04:30.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.137+0000 7f009da2c640 1 -- 172.21.15.53:0/795899175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0098102d20 con 0x7f00981060f0 2024-08-31T06:04:30.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.138+0000 7f009da2c640 1 -- 172.21.15.53:0/795899175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f009806b610 con 0x7f00981060f0 2024-08-31T06:04:30.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.140+0000 7f009ca2a640 1 -- 172.21.15.53:0/795899175 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f008c00fa00 con 0x7f00981060f0 2024-08-31T06:04:30.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.141+0000 7f009ca2a640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4bb0 0x7f00800b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:30.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.141+0000 7f0096ffd640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4bb0 0x7f00800b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:30.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.141+0000 7f009ca2a640 1 -- 172.21.15.53:0/795899175 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f008c0e55f0 con 0x7f00981060f0 2024-08-31T06:04:30.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.142+0000 7f0096ffd640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4bb0 0x7f00800b70c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0088004770 tx=0x7f00880058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:30.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.145+0000 7f009ca2a640 1 -- 172.21.15.53:0/795899175 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f008c014030 con 0x7f00981060f0 2024-08-31T06:04:30.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.333+0000 7f009da2c640 1 -- 172.21.15.53:0/795899175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00981022b0 con 0x7f00981060f0 2024-08-31T06:04:30.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.334+0000 7f009ca2a640 1 -- 172.21.15.53:0/795899175 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+23101 (secure 0 0 0) 0x7f008c0ac690 con 0x7f00981060f0 2024-08-31T06:04:30.337 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:30.337 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":74,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:04:16.424259+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:04:30.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 -- 172.21.15.53:0/795899175 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4bb0 msgr2=0x7f00800b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:30.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4bb0 0x7f00800b70c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0088004770 tx=0x7f00880058d0 comp rx=0 tx=0).stop 2024-08-31T06:04:30.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 -- 172.21.15.53:0/795899175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00981060f0 msgr2=0x7f009819a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:30.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00981060f0 0x7f009819a850 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c8c0 tx=0x7f008c00cd80 comp rx=0 tx=0).stop 2024-08-31T06:04:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 -- 172.21.15.53:0/795899175 shutdown_connections 2024-08-31T06:04:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4bb0 0x7f00800b70c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0098106a40 0x7f009819faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00981060f0 0x7f009819a850 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 --2- 172.21.15.53:0/795899175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0098101ea0 0x7f009819a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 -- 172.21.15.53:0/795899175 >> 172.21.15.53:0/795899175 conn(0x7f0098079c60 msgr2=0x7f0098107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 -- 172.21.15.53:0/795899175 shutdown_connections 2024-08-31T06:04:30.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:30.337+0000 7f009da2c640 1 -- 172.21.15.53:0/795899175 wait complete. 2024-08-31T06:04:30.632 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:30 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/795899175' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:30.779 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:30 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/795899175' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:30.827 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:30 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/795899175' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:30.987 DEBUG:tasks.fwd_scrub:Yielding 2024-08-31T06:04:30.987 INFO:teuthology.run_tasks:Running task exec... 2024-08-31T06:04:30.996 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T06:04:30.996 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi053.front.sepia.ceph.com 2024-08-31T06:04:30.996 DEBUG:teuthology.orchestra.run.smithi053:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-08-31T06:04:30.997 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-31T06:04:30.997 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:04:30.997 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:04:31.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.110+0000 7f160f7ad640 1 -- 172.21.15.53:0/629237631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1608102f40 msgr2=0x7f1608103350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.110+0000 7f160f7ad640 1 --2- 172.21.15.53:0/629237631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1608102f40 0x7f1608103350 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1604009900 tx=0x7f160402a410 comp rx=0 tx=0).stop 2024-08-31T06:04:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.110+0000 7f160f7ad640 1 -- 172.21.15.53:0/629237631 shutdown_connections 2024-08-31T06:04:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.110+0000 7f160f7ad640 1 --2- 172.21.15.53:0/629237631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16081057c0 0x7f160810f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.110+0000 7f160f7ad640 1 --2- 172.21.15.53:0/629237631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1608104e70 0x7f1608105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.110+0000 7f160f7ad640 1 --2- 172.21.15.53:0/629237631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1608102f40 0x7f1608103350 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.110+0000 7f160f7ad640 1 -- 172.21.15.53:0/629237631 >> 172.21.15.53:0/629237631 conn(0x7f1608079c60 msgr2=0x7f160807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.110+0000 7f160f7ad640 1 -- 172.21.15.53:0/629237631 shutdown_connections 2024-08-31T06:04:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.110+0000 7f160f7ad640 1 -- 172.21.15.53:0/629237631 wait complete. 2024-08-31T06:04:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160f7ad640 1 Processor -- start 2024-08-31T06:04:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160f7ad640 1 -- start start 2024-08-31T06:04:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160f7ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1608102f40 0x7f1608199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160f7ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1608104e70 0x7f1608199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160f7ad640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16081057c0 0x7f160819e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160f7ad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f16081125b0 con 0x7f1608102f40 2024-08-31T06:04:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160f7ad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1608112430 con 0x7f1608104e70 2024-08-31T06:04:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160f7ad640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1608112730 con 0x7f16081057c0 2024-08-31T06:04:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160d549640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1608102f40 0x7f1608199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160d549640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1608102f40 0x7f1608199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36006/0 (socket says 172.21.15.53:36006) 2024-08-31T06:04:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160d549640 1 -- 172.21.15.53:0/2476884258 learned_addr learned my addr 172.21.15.53:0/2476884258 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160cd48640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1608104e70 0x7f1608199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160dd4a640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16081057c0 0x7f160819e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160d549640 1 -- 172.21.15.53:0/2476884258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16081057c0 msgr2=0x7f160819e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160d549640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16081057c0 0x7f160819e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160d549640 1 -- 172.21.15.53:0/2476884258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1608104e70 msgr2=0x7f1608199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160d549640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1608104e70 0x7f1608199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.111+0000 7f160d549640 1 -- 172.21.15.53:0/2476884258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160819efc0 con 0x7f1608102f40 2024-08-31T06:04:31.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.112+0000 7f160d549640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1608102f40 0x7f1608199090 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f160402a930 tx=0x7f1604003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:31.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.112+0000 7f15fe7fc640 1 -- 172.21.15.53:0/2476884258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160403f070 con 0x7f1608102f40 2024-08-31T06:04:31.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.112+0000 7f15fe7fc640 1 -- 172.21.15.53:0/2476884258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1604003e40 con 0x7f1608102f40 2024-08-31T06:04:31.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.112+0000 7f160f7ad640 1 -- 172.21.15.53:0/2476884258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160819f250 con 0x7f1608102f40 2024-08-31T06:04:31.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.112+0000 7f15fe7fc640 1 -- 172.21.15.53:0/2476884258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1604035030 con 0x7f1608102f40 2024-08-31T06:04:31.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.112+0000 7f160f7ad640 1 -- 172.21.15.53:0/2476884258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16081a5a40 con 0x7f1608102f40 2024-08-31T06:04:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.113+0000 7f160f7ad640 1 -- 172.21.15.53:0/2476884258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1608103350 con 0x7f1608102f40 2024-08-31T06:04:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.115+0000 7f15fe7fc640 1 -- 172.21.15.53:0/2476884258 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f1604042070 con 0x7f1608102f40 2024-08-31T06:04:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.115+0000 7f15fe7fc640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15f40b4b80 0x7f15f40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.115+0000 7f160cd48640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15f40b4b80 0x7f15f40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.115+0000 7f15fe7fc640 1 -- 172.21.15.53:0/2476884258 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1604105fd0 con 0x7f1608102f40 2024-08-31T06:04:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.116+0000 7f160cd48640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15f40b4b80 0x7f15f40b7090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f15f8005fd0 tx=0x7f15f8005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:31.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.119+0000 7f15fe7fc640 1 -- 172.21.15.53:0/2476884258 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f16040ccfe0 con 0x7f1608102f40 2024-08-31T06:04:31.256 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:31.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.333+0000 7f160f7ad640 1 -- 172.21.15.53:0/2476884258 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f16080635a0 con 0x7f15f40b4b80 2024-08-31T06:04:31.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.498+0000 7f15fe7fc640 1 -- 172.21.15.53:0/2476884258 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f16080635a0 con 0x7f15f40b4b80 2024-08-31T06:04:31.500 INFO:teuthology.orchestra.run.smithi053.stdout:Schedule set for path / 2024-08-31T06:04:31.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.500+0000 7f160f7ad640 1 -- 172.21.15.53:0/2476884258 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15f40b4b80 msgr2=0x7f15f40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.500+0000 7f160f7ad640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15f40b4b80 0x7f15f40b7090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f15f8005fd0 tx=0x7f15f8005850 comp rx=0 tx=0).stop 2024-08-31T06:04:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.500+0000 7f160f7ad640 1 -- 172.21.15.53:0/2476884258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1608102f40 msgr2=0x7f1608199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.500+0000 7f160f7ad640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1608102f40 0x7f1608199090 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f160402a930 tx=0x7f1604003c20 comp rx=0 tx=0).stop 2024-08-31T06:04:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.500+0000 7f160f7ad640 1 -- 172.21.15.53:0/2476884258 shutdown_connections 2024-08-31T06:04:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.500+0000 7f160f7ad640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15f40b4b80 0x7f15f40b7090 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.500+0000 7f160f7ad640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16081057c0 0x7f160819e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.500+0000 7f160f7ad640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1608104e70 0x7f1608199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.500+0000 7f160f7ad640 1 --2- 172.21.15.53:0/2476884258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1608102f40 0x7f1608199090 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.500+0000 7f160f7ad640 1 -- 172.21.15.53:0/2476884258 >> 172.21.15.53:0/2476884258 conn(0x7f1608079c60 msgr2=0x7f16081070e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.501+0000 7f160f7ad640 1 -- 172.21.15.53:0/2476884258 shutdown_connections 2024-08-31T06:04:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.501+0000 7f160f7ad640 1 -- 172.21.15.53:0/2476884258 wait complete. 2024-08-31T06:04:31.514 DEBUG:teuthology.orchestra.run.smithi053:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-08-31T06:04:31.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.630+0000 7f20233da640 1 -- 172.21.15.53:0/41348330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201c101f10 msgr2=0x7f201c102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.630+0000 7f20233da640 1 --2- 172.21.15.53:0/41348330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201c101f10 0x7f201c102320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f200c009900 tx=0x7f200c02a410 comp rx=0 tx=0).stop 2024-08-31T06:04:31.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.630+0000 7f20233da640 1 -- 172.21.15.53:0/41348330 shutdown_connections 2024-08-31T06:04:31.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.630+0000 7f20233da640 1 --2- 172.21.15.53:0/41348330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f201c108190 0x7f201c10e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.630+0000 7f20233da640 1 --2- 172.21.15.53:0/41348330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f201c107840 0x7f201c107c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.630+0000 7f20233da640 1 --2- 172.21.15.53:0/41348330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201c101f10 0x7f201c102320 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.630+0000 7f20233da640 1 -- 172.21.15.53:0/41348330 >> 172.21.15.53:0/41348330 conn(0x7f201c079c20 msgr2=0x7f201c07a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:31.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.630+0000 7f20233da640 1 -- 172.21.15.53:0/41348330 shutdown_connections 2024-08-31T06:04:31.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.630+0000 7f20233da640 1 -- 172.21.15.53:0/41348330 wait complete. 2024-08-31T06:04:31.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.630+0000 7f20233da640 1 Processor -- start 2024-08-31T06:04:31.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.630+0000 7f20233da640 1 -- start start 2024-08-31T06:04:31.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f20233da640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f201c101f10 0x7f201c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f20233da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201c107840 0x7f201c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f20233da640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f201c108190 0x7f201c19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f20233da640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f201c111480 con 0x7f201c107840 2024-08-31T06:04:31.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f20233da640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f201c111300 con 0x7f201c108190 2024-08-31T06:04:31.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f20233da640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f201c111600 con 0x7f201c101f10 2024-08-31T06:04:31.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f2020975640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201c107840 0x7f201c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f2020975640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201c107840 0x7f201c198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36044/0 (socket says 172.21.15.53:36044) 2024-08-31T06:04:31.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f2020975640 1 -- 172.21.15.53:0/3507704194 learned_addr learned my addr 172.21.15.53:0/3507704194 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:31.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f2021176640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f201c101f10 0x7f201c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f2020975640 1 -- 172.21.15.53:0/3507704194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f201c101f10 msgr2=0x7f201c197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f2020975640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f201c101f10 0x7f201c197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f2020975640 1 -- 172.21.15.53:0/3507704194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f201c108190 msgr2=0x7f201c19d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f2020975640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f201c108190 0x7f201c19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f2020975640 1 -- 172.21.15.53:0/3507704194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c19de90 con 0x7f201c107840 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f2020975640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201c107840 0x7f201c198500 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f201800ea90 tx=0x7f201800ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f20127fc640 1 -- 172.21.15.53:0/3507704194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201801b070 con 0x7f201c107840 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.631+0000 7f20127fc640 1 -- 172.21.15.53:0/3507704194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f201800cce0 con 0x7f201c107840 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.632+0000 7f20233da640 1 -- 172.21.15.53:0/3507704194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201c19e180 con 0x7f201c107840 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.632+0000 7f20127fc640 1 -- 172.21.15.53:0/3507704194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201800b5c0 con 0x7f201c107840 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.632+0000 7f20233da640 1 -- 172.21.15.53:0/3507704194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201c1a6b20 con 0x7f201c107840 2024-08-31T06:04:31.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.633+0000 7f20233da640 1 -- 172.21.15.53:0/3507704194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f201c102320 con 0x7f201c107840 2024-08-31T06:04:31.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.634+0000 7f20127fc640 1 -- 172.21.15.53:0/3507704194 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f201801e070 con 0x7f201c107840 2024-08-31T06:04:31.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.635+0000 7f20127fc640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4c00 0x7f20080b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.635+0000 7f2021176640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4c00 0x7f20080b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.636+0000 7f20127fc640 1 -- 172.21.15.53:0/3507704194 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f20180e5000 con 0x7f201c107840 2024-08-31T06:04:31.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.636+0000 7f2021176640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4c00 0x7f20080b7110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f200c000c00 tx=0x7f200c009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:31.640 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:31 smithi053 ceph-mon[18924]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 11 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T06:04:31.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.639+0000 7f20127fc640 1 -- 172.21.15.53:0/3507704194 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f20180ac090 con 0x7f201c107840 2024-08-31T06:04:31.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.735+0000 7fa492121640 1 -- 172.21.15.53:0/2645984390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa48c109270 msgr2=0x7fa48c109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.735+0000 7fa492121640 1 --2- 172.21.15.53:0/2645984390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa48c109270 0x7fa48c109680 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009900 tx=0x7fa47c02a410 comp rx=0 tx=0).stop 2024-08-31T06:04:31.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.735+0000 7fa492121640 1 -- 172.21.15.53:0/2645984390 shutdown_connections 2024-08-31T06:04:31.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.735+0000 7fa492121640 1 --2- 172.21.15.53:0/2645984390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48c109bc0 0x7fa48c1103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.735+0000 7fa492121640 1 --2- 172.21.15.53:0/2645984390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa48c109270 0x7fa48c109680 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.735+0000 7fa492121640 1 --2- 172.21.15.53:0/2645984390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa48c103930 0x7fa48c103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.735+0000 7fa492121640 1 -- 172.21.15.53:0/2645984390 >> 172.21.15.53:0/2645984390 conn(0x7fa48c0ff3a0 msgr2=0x7fa48c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:31.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.735+0000 7fa492121640 1 -- 172.21.15.53:0/2645984390 shutdown_connections 2024-08-31T06:04:31.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.735+0000 7fa492121640 1 -- 172.21.15.53:0/2645984390 wait complete. 2024-08-31T06:04:31.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.735+0000 7fa492121640 1 Processor -- start 2024-08-31T06:04:31.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa492121640 1 -- start start 2024-08-31T06:04:31.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa492121640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa48c103930 0x7fa48c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa492121640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa48c109270 0x7fa48c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa492121640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48c109bc0 0x7fa48c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa492121640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c113730 con 0x7fa48c103930 2024-08-31T06:04:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa492121640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c1135b0 con 0x7fa48c109bc0 2024-08-31T06:04:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa492121640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c1138b0 con 0x7fa48c109270 2024-08-31T06:04:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa48b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa48c103930 0x7fa48c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa48b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa48c103930 0x7fa48c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36064/0 (socket says 172.21.15.53:36064) 2024-08-31T06:04:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa48b7fe640 1 -- 172.21.15.53:0/4188675331 learned_addr learned my addr 172.21.15.53:0/4188675331 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa48affd640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa48c109270 0x7fa48c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa48b7fe640 1 -- 172.21.15.53:0/4188675331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa48c109270 msgr2=0x7fa48c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa48b7fe640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa48c109270 0x7fa48c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa48b7fe640 1 -- 172.21.15.53:0/4188675331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48c109bc0 msgr2=0x7fa48c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.736+0000 7fa48bfff640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48c109bc0 0x7fa48c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.737+0000 7fa48b7fe640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48c109bc0 0x7fa48c075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.737+0000 7fa48b7fe640 1 -- 172.21.15.53:0/4188675331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48c1a8420 con 0x7fa48c103930 2024-08-31T06:04:31.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.737+0000 7fa48b7fe640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa48c103930 0x7fa48c0754b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa48000d950 tx=0x7fa48000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:31.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.737+0000 7fa488ff9640 1 -- 172.21.15.53:0/4188675331 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa480017070 con 0x7fa48c103930 2024-08-31T06:04:31.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.737+0000 7fa488ff9640 1 -- 172.21.15.53:0/4188675331 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa480009c30 con 0x7fa48c103930 2024-08-31T06:04:31.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.737+0000 7fa492121640 1 -- 172.21.15.53:0/4188675331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48c1a8710 con 0x7fa48c103930 2024-08-31T06:04:31.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.737+0000 7fa488ff9640 1 -- 172.21.15.53:0/4188675331 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48000f620 con 0x7fa48c103930 2024-08-31T06:04:31.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.737+0000 7fa492121640 1 -- 172.21.15.53:0/4188675331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa48c1a8c20 con 0x7fa48c103930 2024-08-31T06:04:31.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.740+0000 7fa498696740 1 Processor -- start 2024-08-31T06:04:31.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.740+0000 7fa498696740 1 -- start start 2024-08-31T06:04:31.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.740+0000 7fa498696740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3d027350 0x55dc3d3cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.740+0000 7fa498696740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3cffe490 0x55dc3d3cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.740+0000 7fa498696740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.740+0000 7fa498696740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dc3d3435f0 con 0x55dc3d027350 2024-08-31T06:04:31.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.740+0000 7fa498696740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dc3d332b80 con 0x55dc3d006670 2024-08-31T06:04:31.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.740+0000 7fa498696740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55dc3d336b30 con 0x55dc3cffe490 2024-08-31T06:04:31.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.740+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3d027350 0x55dc3d3cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.740+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3d027350 0x55dc3d3cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36076/0 (socket says 172.21.15.53:36076) 2024-08-31T06:04:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa48bfff640 1 -- 172.21.15.53:0/444821201 learned_addr learned my addr 172.21.15.53:0/444821201 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa48affd640 1 --2- 172.21.15.53:0/444821201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa48bfff640 1 -- 172.21.15.53:0/444821201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3cffe490 msgr2=0x55dc3d3cdcc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:04:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa48bfff640 1 --2- 172.21.15.53:0/444821201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3cffe490 0x55dc3d3cdcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa48bfff640 1 -- 172.21.15.53:0/444821201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 msgr2=0x55dc3d3ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa48bfff640 1 --2- 172.21.15.53:0/444821201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa48bfff640 1 -- 172.21.15.53:0/444821201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3d092930 con 0x55dc3d027350 2024-08-31T06:04:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa48bfff640 1 --2- 172.21.15.53:0/444821201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3d027350 0x55dc3d3cd780 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa484008d00 tx=0x7fa48400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c97c9c390200e0d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa471ffb640 1 -- 172.21.15.53:0/444821201 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484018680 con 0x55dc3d027350 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa488ff9640 1 -- 172.21.15.53:0/4188675331 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fa480010460 con 0x7fa48c103930 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa471ffb640 1 -- 172.21.15.53:0/444821201 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa484018cb0 con 0x55dc3d027350 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.741+0000 7fa471ffb640 1 -- 172.21.15.53:0/444821201 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48400fd40 con 0x55dc3d027350 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa488ff9640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4740b4b80 0x7fa4740b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa498696740 1 -- 172.21.15.53:0/444821201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3d027350 msgr2=0x55dc3d3cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa498696740 1 --2- 172.21.15.53:0/444821201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3d027350 0x55dc3d3cd780 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa484008d00 tx=0x7fa48400d710 comp rx=0 tx=0).stop 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa48b7fe640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4740b4b80 0x7fa4740b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa498696740 1 -- 172.21.15.53:0/444821201 shutdown_connections 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa488ff9640 1 -- 172.21.15.53:0/4188675331 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa4800e4f20 con 0x7fa48c103930 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa498696740 1 --2- 172.21.15.53:0/444821201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa498696740 1 --2- 172.21.15.53:0/444821201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3cffe490 0x55dc3d3cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa498696740 1 --2- 172.21.15.53:0/444821201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3d027350 0x55dc3d3cd780 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa498696740 1 -- 172.21.15.53:0/444821201 >> 172.21.15.53:0/444821201 conn(0x55dc3d01b740 msgr2=0x55dc3d3cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:31.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa498696740 1 -- 172.21.15.53:0/444821201 shutdown_connections 2024-08-31T06:04:31.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.742+0000 7fa498696740 1 -- 172.21.15.53:0/444821201 wait complete. 2024-08-31T06:04:31.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.743+0000 7fa48b7fe640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4740b4b80 0x7fa4740b7090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa4800e2950 tx=0x7fa4800a76f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:31.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.743+0000 7fa498696740 1 -- start start 2024-08-31T06:04:31.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.743+0000 7fa498696740 1 Processor -- start 2024-08-31T06:04:31.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.743+0000 7fa498696740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3d8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.743+0000 7fa498696740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3d9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.743+0000 7fa498696740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d027350 0x55dc3d3e5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.743+0000 7fa498696740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dc3d195890 con 0x55dc3cffe490 2024-08-31T06:04:31.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.743+0000 7fa498696740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dc3d2b9790 con 0x55dc3d006670 2024-08-31T06:04:31.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.743+0000 7fa498696740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55dc3d3dbf60 con 0x55dc3d027350 2024-08-31T06:04:31.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.744+0000 7fa498696740 10 client.0 _ll_register_callbacks cb 0x55dc3d03eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:31.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.744+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d027350 0x55dc3d3e5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.744+0000 7fa48affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3d9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.744+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3d8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.744+0000 7fa48affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3d9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:40728/0 (socket says 172.21.15.53:40728) 2024-08-31T06:04:31.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.744+0000 7fa48affd640 1 -- 172.21.15.53:0/1361441661 learned_addr learned my addr 172.21.15.53:0/1361441661 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:31.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.744+0000 7fa48bfff640 1 -- 172.21.15.53:0/1361441661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d027350 msgr2=0x55dc3d3e5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:31.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.744+0000 7fa48bfff640 1 --2- 172.21.15.53:0/1361441661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d027350 0x55dc3d3e5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.744+0000 7fa48bfff640 1 -- 172.21.15.53:0/1361441661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 msgr2=0x55dc3d3d9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:31.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.744+0000 7fa48bfff640 1 --2- 172.21.15.53:0/1361441661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3d9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.744+0000 7fa48bfff640 1 -- 172.21.15.53:0/1361441661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc3d2f0f30 con 0x55dc3cffe490 2024-08-31T06:04:31.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.745+0000 7fa48bfff640 1 --2- 172.21.15.53:0/1361441661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3d8fa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa48400fa20 tx=0x7fa484000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac58df9d4c35bf9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:31.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.745+0000 7fa46affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:31.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.745+0000 7fa46affd640 1 -- 172.21.15.53:0/1361441661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48402c060 con 0x55dc3cffe490 2024-08-31T06:04:31.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.745+0000 7fa46affd640 1 -- 172.21.15.53:0/1361441661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa484018480 con 0x55dc3cffe490 2024-08-31T06:04:31.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.745+0000 7fa498696740 1 -- 172.21.15.53:0/1361441661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa484018cb0 con 0x55dc3cffe490 2024-08-31T06:04:31.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.745+0000 7fa46affd640 1 -- 172.21.15.53:0/1361441661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa48400fe50 con 0x55dc3cffe490 2024-08-31T06:04:31.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.745+0000 7fa498696740 10 client.15537 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:31.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.745+0000 7fa498696740 1 -- 172.21.15.53:0/1361441661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dc3d3e7df0 con 0x55dc3cffe490 2024-08-31T06:04:31.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.745+0000 7fa46affd640 1 -- 172.21.15.53:0/1361441661 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa484018cb0 con 0x55dc3cffe490 2024-08-31T06:04:31.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.745+0000 7fa46affd640 1 -- 172.21.15.53:0/1361441661 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa48400b8a0 con 0x55dc3cffe490 2024-08-31T06:04:31.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.746+0000 7fa498696740 10 client.15537 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.746+0000 7fa498696740 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.746+0000 7fa498696740 20 client.15537 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.746+0000 7fa498696740 1 --2- 172.21.15.53:0/1361441661 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dc3cfe5cd0 0x55dc3d3eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.746+0000 7fa498696740 4 client.15537 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.746+0000 7fa498696740 1 -- 172.21.15.53:0/1361441661 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc3d345540 con 0x55dc3cfe5cd0 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.746+0000 7fa48affd640 1 --2- 172.21.15.53:0/1361441661 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dc3cfe5cd0 0x55dc3d3eb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.747+0000 7fa48affd640 1 --2- 172.21.15.53:0/1361441661 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dc3cfe5cd0 0x55dc3d3eb1b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cc0068292d8509b server_cookie=aed9012f16582520 in_seq=0 out_seq=0 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.747+0000 7fa46affd640 10 client.15537 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa46affd640 1 -- 172.21.15.53:0/1361441661 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dc3d345540 con 0x55dc3cfe5cd0 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa46affd640 10 client.15537 handle_command_reply: tid=0 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 1 client.15537 shutdown 2024-08-31T06:04:31.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 1 -- 172.21.15.53:0/1361441661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 msgr2=0x55dc3d3d8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 1 --2- 172.21.15.53:0/1361441661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3d8fa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa48400fa20 tx=0x7fa484000f40 comp rx=0 tx=0).stop 2024-08-31T06:04:31.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 1 -- 172.21.15.53:0/1361441661 shutdown_connections 2024-08-31T06:04:31.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 1 --2- 172.21.15.53:0/1361441661 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dc3cfe5cd0 0x55dc3d3eb1b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 1 --2- 172.21.15.53:0/1361441661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d027350 0x55dc3d3e5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 1 --2- 172.21.15.53:0/1361441661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3d9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 1 --2- 172.21.15.53:0/1361441661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3d8fa0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 1 -- 172.21.15.53:0/1361441661 >> 172.21.15.53:0/1361441661 conn(0x55dc3d01b740 msgr2=0x55dc3d3d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:31.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa46affd640 0 client.15537 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:31.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 1 -- 172.21.15.53:0/1361441661 shutdown_connections 2024-08-31T06:04:31.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 1 -- 172.21.15.53:0/1361441661 wait complete. 2024-08-31T06:04:31.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.749+0000 7fa498696740 20 client.15537 trim_cache size 0 max 16384 2024-08-31T06:04:31.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa498696740 1 Processor -- start 2024-08-31T06:04:31.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa498696740 1 -- start start 2024-08-31T06:04:31.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa498696740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3d1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa498696740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d006670 0x55dc3d3dabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa498696740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d027350 0x55dc3d3e51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa498696740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c1b1720 con 0x55dc3cffe490 2024-08-31T06:04:31.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa498696740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c1b3260 con 0x55dc3d027350 2024-08-31T06:04:31.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa498696740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c1b1df0 con 0x55dc3d006670 2024-08-31T06:04:31.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3d1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36092/0 (socket says 172.21.15.53:36092) 2024-08-31T06:04:31.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa48bfff640 1 -- 172.21.15.53:0/1368583694 learned_addr learned my addr 172.21.15.53:0/1368583694 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:31.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.767+0000 7fa48affd640 1 --2- 172.21.15.53:0/1368583694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d006670 0x55dc3d3dabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.768+0000 7fa48bfff640 1 -- 172.21.15.53:0/1368583694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d006670 msgr2=0x55dc3d3dabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:31.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.768+0000 7fa48bfff640 1 --2- 172.21.15.53:0/1368583694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d006670 0x55dc3d3dabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.768+0000 7fa48bfff640 1 -- 172.21.15.53:0/1368583694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d027350 msgr2=0x55dc3d3e51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:31.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.768+0000 7fa48bfff640 1 --2- 172.21.15.53:0/1368583694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d027350 0x55dc3d3e51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.768+0000 7fa48bfff640 1 -- 172.21.15.53:0/1368583694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3d3d05e0 con 0x55dc3cffe490 2024-08-31T06:04:31.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.768+0000 7fa48affd640 1 --2- 172.21.15.53:0/1368583694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d006670 0x55dc3d3dabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:31.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.768+0000 7fa48bfff640 1 --2- 172.21.15.53:0/1368583694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3d1240 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa48400bc10 tx=0x7fa484019fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d07985347272f41 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:31.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.768+0000 7fa4717fa640 1 -- 172.21.15.53:0/1368583694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48400dc10 con 0x55dc3cffe490 2024-08-31T06:04:31.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.768+0000 7fa4717fa640 1 -- 172.21.15.53:0/1368583694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa48400fe50 con 0x55dc3cffe490 2024-08-31T06:04:31.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.768+0000 7fa4717fa640 1 -- 172.21.15.53:0/1368583694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48400b830 con 0x55dc3cffe490 2024-08-31T06:04:31.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.769+0000 7fa498696740 1 -- 172.21.15.53:0/1368583694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 msgr2=0x55dc3d3d1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.769+0000 7fa498696740 1 --2- 172.21.15.53:0/1368583694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3d1240 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa48400bc10 tx=0x7fa484019fd0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.769+0000 7fa498696740 1 -- 172.21.15.53:0/1368583694 shutdown_connections 2024-08-31T06:04:31.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.769+0000 7fa498696740 1 --2- 172.21.15.53:0/1368583694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d027350 0x55dc3d3e51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.769+0000 7fa498696740 1 --2- 172.21.15.53:0/1368583694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d006670 0x55dc3d3dabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.769+0000 7fa498696740 1 --2- 172.21.15.53:0/1368583694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3d1240 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.769+0000 7fa498696740 1 -- 172.21.15.53:0/1368583694 >> 172.21.15.53:0/1368583694 conn(0x55dc3d01b740 msgr2=0x55dc3d3da4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:31.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.769+0000 7fa498696740 1 -- 172.21.15.53:0/1368583694 shutdown_connections 2024-08-31T06:04:31.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.769+0000 7fa498696740 1 -- 172.21.15.53:0/1368583694 wait complete. 2024-08-31T06:04:31.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.769+0000 7fa498696740 1 -- start start 2024-08-31T06:04:31.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa498696740 1 Processor -- start 2024-08-31T06:04:31.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa498696740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3ec210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa498696740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3ec750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa498696740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d027350 0x55dc3d3ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa498696740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c1b2b90 con 0x55dc3cffe490 2024-08-31T06:04:31.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa498696740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c1b24c0 con 0x55dc3d006670 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa498696740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c1af700 con 0x55dc3d027350 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa498696740 10 client.0 _ll_register_callbacks cb 0x7fa484008b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3ec210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36106/0 (socket says 172.21.15.53:36106) 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa48bfff640 1 -- 172.21.15.53:0/3316848888 learned_addr learned my addr 172.21.15.53:0/3316848888 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.770+0000 7fa48affd640 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3ec750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa48bfff640 1 -- 172.21.15.53:0/3316848888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d027350 msgr2=0x55dc3d3ecc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa48bfff640 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d027350 0x55dc3d3ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa48bfff640 1 -- 172.21.15.53:0/3316848888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 msgr2=0x55dc3d3ec750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa48bfff640 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3ec750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa48bfff640 1 -- 172.21.15.53:0/3316848888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc3d454960 con 0x55dc3cffe490 2024-08-31T06:04:31.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa48affd640 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3ec750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:31.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa48bfff640 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3ec210 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa48401a040 tx=0x7fa484005fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e152c0c07a93ffa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:31.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa46affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:31.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa46affd640 1 -- 172.21.15.53:0/3316848888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48400b3a0 con 0x55dc3cffe490 2024-08-31T06:04:31.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa46affd640 1 -- 172.21.15.53:0/3316848888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa48403d070 con 0x55dc3cffe490 2024-08-31T06:04:31.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa498696740 1 -- 172.21.15.53:0/3316848888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa48400fe50 con 0x55dc3cffe490 2024-08-31T06:04:31.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa46affd640 1 -- 172.21.15.53:0/3316848888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa48404e050 con 0x55dc3cffe490 2024-08-31T06:04:31.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa498696740 10 client.15543 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:31.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.771+0000 7fa498696740 1 -- 172.21.15.53:0/3316848888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dc3d455c20 con 0x55dc3cffe490 2024-08-31T06:04:31.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.772+0000 7fa46affd640 1 -- 172.21.15.53:0/3316848888 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa48400fe50 con 0x55dc3cffe490 2024-08-31T06:04:31.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.772+0000 7fa46affd640 1 -- 172.21.15.53:0/3316848888 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa484025aa0 con 0x55dc3cffe490 2024-08-31T06:04:31.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.772+0000 7fa498696740 10 client.15543 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:31.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.772+0000 7fa498696740 10 client.15543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:04:31.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.772+0000 7fa498696740 20 client.15543 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:31.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.772+0000 7fa498696740 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dc3cfbb080 0x55dc3d458310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:31.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.772+0000 7fa498696740 4 client.15543 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:04:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.772+0000 7fa498696740 1 -- 172.21.15.53:0/3316848888 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dc3d340fe0 con 0x55dc3cfbb080 2024-08-31T06:04:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.772+0000 7fa48affd640 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dc3cfbb080 0x55dc3d458310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.773+0000 7fa46affd640 10 client.15543 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.773+0000 7fa48affd640 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dc3cfbb080 0x55dc3d458310 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b24eff64778904a4 server_cookie=252ef7d9c86b6d0 in_seq=0 out_seq=0 2024-08-31T06:04:31.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.774+0000 7fa46affd640 1 -- 172.21.15.53:0/3316848888 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dc3d340fe0 con 0x55dc3cfbb080 2024-08-31T06:04:31.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.774+0000 7fa46affd640 10 client.15543 handle_command_reply: tid=0 2024-08-31T06:04:31.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 1 client.15543 shutdown 2024-08-31T06:04:31.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 1 -- 172.21.15.53:0/3316848888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 msgr2=0x55dc3d3ec210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3ec210 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa48401a040 tx=0x7fa484005fc0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 1 -- 172.21.15.53:0/3316848888 shutdown_connections 2024-08-31T06:04:31.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dc3cfbb080 0x55dc3d458310 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc3d027350 0x55dc3d3ecc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc3d006670 0x55dc3d3ec750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 1 --2- 172.21.15.53:0/3316848888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc3cffe490 0x55dc3d3ec210 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa46affd640 0 client.15543 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 1 -- 172.21.15.53:0/3316848888 >> 172.21.15.53:0/3316848888 conn(0x55dc3d01b740 msgr2=0x55dc3d3d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 1 -- 172.21.15.53:0/3316848888 shutdown_connections 2024-08-31T06:04:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 1 -- 172.21.15.53:0/3316848888 wait complete. 2024-08-31T06:04:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.775+0000 7fa498696740 20 client.15543 trim_cache size 0 max 16384 2024-08-31T06:04:31.783 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:31.784 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:04:31.784 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "0450956f-5b94-476e-9a3a-8abca9e5b7df", 2024-08-31T06:04:31.784 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:04:31.784 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 -- 172.21.15.53:0/4188675331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4740b4b80 msgr2=0x7fa4740b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4740b4b80 0x7fa4740b7090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa4800e2950 tx=0x7fa4800a76f0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 -- 172.21.15.53:0/4188675331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa48c103930 msgr2=0x7fa48c0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa48c103930 0x7fa48c0754b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa48000d950 tx=0x7fa48000de10 comp rx=0 tx=0).stop 2024-08-31T06:04:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 -- 172.21.15.53:0/4188675331 shutdown_connections 2024-08-31T06:04:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4740b4b80 0x7fa4740b7090 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa48c109bc0 0x7fa48c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa48c109270 0x7fa48c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 --2- 172.21.15.53:0/4188675331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa48c103930 0x7fa48c0754b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 -- 172.21.15.53:0/4188675331 >> 172.21.15.53:0/4188675331 conn(0x7fa48c0ff3a0 msgr2=0x7fa48c1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 -- 172.21.15.53:0/4188675331 shutdown_connections 2024-08-31T06:04:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.776+0000 7fa492121640 1 -- 172.21.15.53:0/4188675331 wait complete. 2024-08-31T06:04:31.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.859+0000 7f20233da640 1 -- 172.21.15.53:0/3507704194 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f201c0635a0 con 0x7f20080b4c00 2024-08-31T06:04:31.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:31 smithi130 ceph-mon[22266]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 11 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T06:04:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:31 smithi153 ceph-mon[22320]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 11 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T06:04:31.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.924+0000 7f20127fc640 1 -- 172.21.15.53:0/3507704194 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f201c0635a0 con 0x7f20080b4c00 2024-08-31T06:04:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:Retention added to path / 2024-08-31T06:04:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.926+0000 7f20233da640 1 -- 172.21.15.53:0/3507704194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4c00 msgr2=0x7f20080b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.926+0000 7f20233da640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4c00 0x7f20080b7110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f200c000c00 tx=0x7f200c009680 comp rx=0 tx=0).stop 2024-08-31T06:04:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.926+0000 7f20233da640 1 -- 172.21.15.53:0/3507704194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201c107840 msgr2=0x7f201c198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.926+0000 7f20233da640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201c107840 0x7f201c198500 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f201800ea90 tx=0x7f201800ef50 comp rx=0 tx=0).stop 2024-08-31T06:04:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.926+0000 7f20233da640 1 -- 172.21.15.53:0/3507704194 shutdown_connections 2024-08-31T06:04:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.926+0000 7f20233da640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4c00 0x7f20080b7110 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.926+0000 7f20233da640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f201c108190 0x7f201c19d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.926+0000 7f20233da640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f201c107840 0x7f201c198500 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.926+0000 7f20233da640 1 --2- 172.21.15.53:0/3507704194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f201c101f10 0x7f201c197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.926+0000 7f20233da640 1 -- 172.21.15.53:0/3507704194 >> 172.21.15.53:0/3507704194 conn(0x7f201c079c20 msgr2=0x7f201c105980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:31.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.926+0000 7f20233da640 1 -- 172.21.15.53:0/3507704194 shutdown_connections 2024-08-31T06:04:31.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:31.927+0000 7f20233da640 1 -- 172.21.15.53:0/3507704194 wait complete. 2024-08-31T06:04:31.939 DEBUG:teuthology.orchestra.run.smithi053:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-31T06:04:32.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.057+0000 7f79c53c3640 1 -- 172.21.15.53:0/3208895262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79c0102e40 msgr2=0x7f79c0103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:32.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.057+0000 7f79c53c3640 1 --2- 172.21.15.53:0/3208895262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79c0102e40 0x7f79c0103250 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009900 tx=0x7f79b002a410 comp rx=0 tx=0).stop 2024-08-31T06:04:32.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.057+0000 7f79c53c3640 1 -- 172.21.15.53:0/3208895262 shutdown_connections 2024-08-31T06:04:32.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.057+0000 7f79c53c3640 1 --2- 172.21.15.53:0/3208895262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c0105800 0x7f79c010f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.057+0000 7f79c53c3640 1 --2- 172.21.15.53:0/3208895262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79c0104eb0 0x7f79c01052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.057+0000 7f79c53c3640 1 --2- 172.21.15.53:0/3208895262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79c0102e40 0x7f79c0103250 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.057+0000 7f79c53c3640 1 -- 172.21.15.53:0/3208895262 >> 172.21.15.53:0/3208895262 conn(0x7f79c0079aa0 msgr2=0x7f79c0079ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:32.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.057+0000 7f79c53c3640 1 -- 172.21.15.53:0/3208895262 shutdown_connections 2024-08-31T06:04:32.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.057+0000 7f79c53c3640 1 -- 172.21.15.53:0/3208895262 wait complete. 2024-08-31T06:04:32.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79c53c3640 1 Processor -- start 2024-08-31T06:04:32.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79c53c3640 1 -- start start 2024-08-31T06:04:32.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79c53c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79c0102e40 0x7f79c0199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:32.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79c53c3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79c0104eb0 0x7f79c0199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:32.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79c53c3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c0105800 0x7f79c019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:32.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79c53c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f79c01125b0 con 0x7f79c0102e40 2024-08-31T06:04:32.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79c53c3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f79c0112430 con 0x7f79c0105800 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79c53c3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f79c0112730 con 0x7f79c0104eb0 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79beffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79c0102e40 0x7f79c0199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79beffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79c0102e40 0x7f79c0199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36126/0 (socket says 172.21.15.53:36126) 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79beffd640 1 -- 172.21.15.53:0/765498808 learned_addr learned my addr 172.21.15.53:0/765498808 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79bf7fe640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c0105800 0x7f79c019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.058+0000 7f79be7fc640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79c0104eb0 0x7f79c0199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79beffd640 1 -- 172.21.15.53:0/765498808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79c0104eb0 msgr2=0x7f79c0199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79beffd640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79c0104eb0 0x7f79c0199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79beffd640 1 -- 172.21.15.53:0/765498808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c0105800 msgr2=0x7f79c019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79beffd640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c0105800 0x7f79c019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79beffd640 1 -- 172.21.15.53:0/765498808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c019efc0 con 0x7f79c0102e40 2024-08-31T06:04:32.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79be7fc640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79c0104eb0 0x7f79c0199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:32.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79beffd640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79c0102e40 0x7f79c0199090 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f79b0005940 tx=0x7f79b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:32.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79a7fff640 1 -- 172.21.15.53:0/765498808 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b003f030 con 0x7f79c0102e40 2024-08-31T06:04:32.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79c53c3640 1 -- 172.21.15.53:0/765498808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c019f250 con 0x7f79c0102e40 2024-08-31T06:04:32.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79a7fff640 1 -- 172.21.15.53:0/765498808 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79b0003c90 con 0x7f79c0102e40 2024-08-31T06:04:32.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79a7fff640 1 -- 172.21.15.53:0/765498808 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0035070 con 0x7f79c0102e40 2024-08-31T06:04:32.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.059+0000 7f79c53c3640 1 -- 172.21.15.53:0/765498808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c01a5a40 con 0x7f79c0102e40 2024-08-31T06:04:32.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.060+0000 7f79c53c3640 1 -- 172.21.15.53:0/765498808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c0103250 con 0x7f79c0102e40 2024-08-31T06:04:32.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.062+0000 7f79a7fff640 1 -- 172.21.15.53:0/765498808 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f79b0042030 con 0x7f79c0102e40 2024-08-31T06:04:32.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.062+0000 7f79a7fff640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79a80b4b80 0x7f79a80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:32.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.063+0000 7f79a7fff640 1 -- 172.21.15.53:0/765498808 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f79b0105b90 con 0x7f79c0102e40 2024-08-31T06:04:32.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.063+0000 7f79be7fc640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79a80b4b80 0x7f79a80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:32.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.063+0000 7f79be7fc640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79a80b4b80 0x7f79a80b7090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f79c0108330 tx=0x7f79b4005d30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:32.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.066+0000 7f79a7fff640 1 -- 172.21.15.53:0/765498808 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f79b00ccba0 con 0x7f79c0102e40 2024-08-31T06:04:32.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.275+0000 7f79c53c3640 1 -- 172.21.15.53:0/765498808 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f79c010a920 con 0x7f79a80b4b80 2024-08-31T06:04:32.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.283+0000 7f79a7fff640 1 -- 172.21.15.53:0/765498808 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f79c010a920 con 0x7f79a80b4b80 2024-08-31T06:04:32.285 INFO:teuthology.orchestra.run.smithi053.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-31T00:00:00", "created": "2024-08-31T06:04:31", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-08-31T06:04:32.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 -- 172.21.15.53:0/765498808 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79a80b4b80 msgr2=0x7f79a80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:32.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79a80b4b80 0x7f79a80b7090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f79c0108330 tx=0x7f79b4005d30 comp rx=0 tx=0).stop 2024-08-31T06:04:32.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 -- 172.21.15.53:0/765498808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79c0102e40 msgr2=0x7f79c0199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:32.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79c0102e40 0x7f79c0199090 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f79b0005940 tx=0x7f79b00042f0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 -- 172.21.15.53:0/765498808 shutdown_connections 2024-08-31T06:04:32.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79a80b4b80 0x7f79a80b7090 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79c0105800 0x7f79c019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79c0104eb0 0x7f79c0199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 --2- 172.21.15.53:0/765498808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79c0102e40 0x7f79c0199090 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 -- 172.21.15.53:0/765498808 >> 172.21.15.53:0/765498808 conn(0x7f79c0079aa0 msgr2=0x7f79c0106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:32.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 -- 172.21.15.53:0/765498808 shutdown_connections 2024-08-31T06:04:32.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.285+0000 7f79c53c3640 1 -- 172.21.15.53:0/765498808 wait complete. 2024-08-31T06:04:32.298 DEBUG:teuthology.orchestra.run.smithi053:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-31T06:04:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.410+0000 7f2047557640 1 -- 172.21.15.53:0/2737499555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20401057c0 msgr2=0x7f204010f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.410+0000 7f2047557640 1 --2- 172.21.15.53:0/2737499555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20401057c0 0x7f204010f230 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2038009ca0 tx=0x7f203802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.411+0000 7f2047557640 1 -- 172.21.15.53:0/2737499555 shutdown_connections 2024-08-31T06:04:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.411+0000 7f2047557640 1 --2- 172.21.15.53:0/2737499555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20401057c0 0x7f204010f230 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.411+0000 7f2047557640 1 --2- 172.21.15.53:0/2737499555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2040104e70 0x7f2040105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.411+0000 7f2047557640 1 --2- 172.21.15.53:0/2737499555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2040102f10 0x7f2040103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.411+0000 7f2047557640 1 -- 172.21.15.53:0/2737499555 >> 172.21.15.53:0/2737499555 conn(0x7f2040079c30 msgr2=0x7f204007a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.411+0000 7f2047557640 1 -- 172.21.15.53:0/2737499555 shutdown_connections 2024-08-31T06:04:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.411+0000 7f2047557640 1 -- 172.21.15.53:0/2737499555 wait complete. 2024-08-31T06:04:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.411+0000 7f2047557640 1 Processor -- start 2024-08-31T06:04:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.411+0000 7f2047557640 1 -- start start 2024-08-31T06:04:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2047557640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2040102f10 0x7f204019af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2047557640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2040104e70 0x7f204019b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2047557640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20401057c0 0x7f204019ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2047557640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f20401125d0 con 0x7f20401057c0 2024-08-31T06:04:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2047557640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2040112450 con 0x7f2040104e70 2024-08-31T06:04:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2047557640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2040112750 con 0x7f2040102f10 2024-08-31T06:04:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2045af4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20401057c0 0x7f204019ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2045af4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20401057c0 0x7f204019ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36150/0 (socket says 172.21.15.53:36150) 2024-08-31T06:04:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2045af4640 1 -- 172.21.15.53:0/519935427 learned_addr learned my addr 172.21.15.53:0/519935427 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f20452f3640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2040102f10 0x7f204019af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2044af2640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2040104e70 0x7f204019b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2045af4640 1 -- 172.21.15.53:0/519935427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2040102f10 msgr2=0x7f204019af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2045af4640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2040102f10 0x7f204019af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2045af4640 1 -- 172.21.15.53:0/519935427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2040104e70 msgr2=0x7f204019b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2045af4640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2040104e70 0x7f204019b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2045af4640 1 -- 172.21.15.53:0/519935427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20401a6210 con 0x7f20401057c0 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2045af4640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20401057c0 0x7f204019ba00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2038005cc0 tx=0x7f2038032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f20367fc640 1 -- 172.21.15.53:0/519935427 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2038032e00 con 0x7f20401057c0 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f20367fc640 1 -- 172.21.15.53:0/519935427 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20380044d0 con 0x7f20401057c0 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.412+0000 7f2047557640 1 -- 172.21.15.53:0/519935427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20401a64a0 con 0x7f20401057c0 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.413+0000 7f20367fc640 1 -- 172.21.15.53:0/519935427 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2038030b70 con 0x7f20401057c0 2024-08-31T06:04:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.413+0000 7f2047557640 1 -- 172.21.15.53:0/519935427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20401a6a40 con 0x7f20401057c0 2024-08-31T06:04:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.414+0000 7f2047557640 1 -- 172.21.15.53:0/519935427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2040103320 con 0x7f20401057c0 2024-08-31T06:04:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.415+0000 7f20367fc640 1 -- 172.21.15.53:0/519935427 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f2038030d10 con 0x7f20401057c0 2024-08-31T06:04:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.416+0000 7f20367fc640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f202c0b4c00 0x7f202c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.416+0000 7f20452f3640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f202c0b4c00 0x7f202c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.416+0000 7f20367fc640 1 -- 172.21.15.53:0/519935427 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2038106730 con 0x7f20401057c0 2024-08-31T06:04:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.417+0000 7f20452f3640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f202c0b4c00 0x7f202c0b7110 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20401026c0 tx=0x7f203c00b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.419+0000 7f20367fc640 1 -- 172.21.15.53:0/519935427 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f20380cd6e0 con 0x7f20401057c0 2024-08-31T06:04:32.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.506+0000 7f20367fc640 1 -- 172.21.15.53:0/519935427 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f20380c9270 con 0x7f20401057c0 2024-08-31T06:04:32.564 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:32 smithi053 ceph-mon[18924]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:32.564 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:32 smithi053 ceph-mon[18924]: from='client.15525 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:32.566 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:04:32.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.635+0000 7f2047557640 1 -- 172.21.15.53:0/519935427 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f20400635a0 con 0x7f202c0b4c00 2024-08-31T06:04:32.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.643+0000 7f20367fc640 1 -- 172.21.15.53:0/519935427 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f20400635a0 con 0x7f202c0b4c00 2024-08-31T06:04:32.645 INFO:teuthology.orchestra.run.smithi053.stdout:/ 1m 6m3h 2024-08-31T06:04:32.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.645+0000 7f2047557640 1 -- 172.21.15.53:0/519935427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f202c0b4c00 msgr2=0x7f202c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.645+0000 7f2047557640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f202c0b4c00 0x7f202c0b7110 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20401026c0 tx=0x7f203c00b410 comp rx=0 tx=0).stop 2024-08-31T06:04:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.645+0000 7f2047557640 1 -- 172.21.15.53:0/519935427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20401057c0 msgr2=0x7f204019ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.645+0000 7f2047557640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20401057c0 0x7f204019ba00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2038005cc0 tx=0x7f2038032a10 comp rx=0 tx=0).stop 2024-08-31T06:04:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.645+0000 7f2047557640 1 -- 172.21.15.53:0/519935427 shutdown_connections 2024-08-31T06:04:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.645+0000 7f2047557640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f202c0b4c00 0x7f202c0b7110 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.645+0000 7f2047557640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20401057c0 0x7f204019ba00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.645+0000 7f2047557640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2040104e70 0x7f204019b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.645+0000 7f2047557640 1 --2- 172.21.15.53:0/519935427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2040102f10 0x7f204019af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.645+0000 7f2047557640 1 -- 172.21.15.53:0/519935427 >> 172.21.15.53:0/519935427 conn(0x7f2040079c30 msgr2=0x7f2040106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.645+0000 7f2047557640 1 -- 172.21.15.53:0/519935427 shutdown_connections 2024-08-31T06:04:32.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:32.646+0000 7f2047557640 1 -- 172.21.15.53:0/519935427 wait complete. 2024-08-31T06:04:32.659 DEBUG:teuthology.orchestra.run.smithi053:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-08-31T06:04:32.685 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-08-31T06:04:32.699 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-31T06:04:32.708 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi053.front.sepia.ceph.com 2024-08-31T06:04:32.708 DEBUG:teuthology.orchestra.run.smithi053:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-31T06:04:32.727 INFO:teuthology.run_tasks:Running task quiescer... 2024-08-31T06:04:32.740 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T06:04:32.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:04:32.837 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:32.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:32 smithi130 ceph-mon[22266]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:32.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:32 smithi130 ceph-mon[22266]: from='client.15525 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:32.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:32 smithi153 ceph-mon[22320]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:32.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:32 smithi153 ceph-mon[22320]: from='client.15525 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.309+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3316290100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40a8103900 msgr2=0x7f40a8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.309+0000 7f40ae6e7640 1 --2- 172.21.15.53:0/3316290100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40a8103900 0x7f40a8103d10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4098009900 tx=0x7f409802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.309+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3316290100 shutdown_connections 2024-08-31T06:04:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.309+0000 7f40ae6e7640 1 --2- 172.21.15.53:0/3316290100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40a8109b90 0x7f40a81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.309+0000 7f40ae6e7640 1 --2- 172.21.15.53:0/3316290100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a8109240 0x7f40a8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.309+0000 7f40ae6e7640 1 --2- 172.21.15.53:0/3316290100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40a8103900 0x7f40a8103d10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.309+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3316290100 >> 172.21.15.53:0/3316290100 conn(0x7f40a807b5f0 msgr2=0x7f40a807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.309+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3316290100 shutdown_connections 2024-08-31T06:04:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.309+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3316290100 wait complete. 2024-08-31T06:04:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.310+0000 7f40ae6e7640 1 Processor -- start 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.310+0000 7f40ae6e7640 1 -- start start 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.310+0000 7f40ae6e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40a8103900 0x7f40a819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.310+0000 7f40ae6e7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a8109240 0x7f40a819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.310+0000 7f40ae6e7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40a8109b90 0x7f40a819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.310+0000 7f40ae6e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40a8113700 con 0x7f40a8103900 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.310+0000 7f40ae6e7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40a8113580 con 0x7f40a8109240 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.310+0000 7f40ae6e7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40a8113880 con 0x7f40a8109b90 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40a8103900 0x7f40a819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40a8103900 0x7f40a819a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40472/0 (socket says 172.21.15.53:40472) 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a7fff640 1 -- 172.21.15.53:0/3082573401 learned_addr learned my addr 172.21.15.53:0/3082573401 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a7fff640 1 -- 172.21.15.53:0/3082573401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40a8109b90 msgr2=0x7f40a819f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a7fff640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40a8109b90 0x7f40a819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a7fff640 1 -- 172.21.15.53:0/3082573401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a8109240 msgr2=0x7f40a819a730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a7fff640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a8109240 0x7f40a819a730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a7fff640 1 -- 172.21.15.53:0/3082573401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a81a0040 con 0x7f40a8103900 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a7fff640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40a8103900 0x7f40a819a190 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4098009230 tx=0x7f4098004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a57fa640 1 -- 172.21.15.53:0/3082573401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409803f030 con 0x7f40a8103900 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a57fa640 1 -- 172.21.15.53:0/3082573401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4098003a80 con 0x7f40a8103900 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3082573401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a81a02d0 con 0x7f40a8103900 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40a57fa640 1 -- 172.21.15.53:0/3082573401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098035070 con 0x7f40a8103900 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.311+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3082573401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a81a0800 con 0x7f40a8103900 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40b4c5c740 1 Processor -- start 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40b4c5c740 1 -- start start 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40a57fa640 1 -- 172.21.15.53:0/3082573401 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f4098042030 con 0x7f40a8103900 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b3947b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390ad1b0 0x564b3947b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390b5390 0x564b3947bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564b393f2630 con 0x564b390d6070 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564b393e1bc0 con 0x564b390ad1b0 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564b393e5b70 con 0x564b390b5390 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40acc84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b3947b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40acc84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b3947b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40482/0 (socket says 172.21.15.53:40482) 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40acc84640 1 -- 172.21.15.53:0/334631468 learned_addr learned my addr 172.21.15.53:0/334631468 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40acc84640 1 -- 172.21.15.53:0/334631468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390b5390 msgr2=0x564b3947bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.314+0000 7f40acc84640 1 --2- 172.21.15.53:0/334631468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390b5390 0x564b3947bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.315+0000 7f40acc84640 1 -- 172.21.15.53:0/334631468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390ad1b0 msgr2=0x564b3947b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.315+0000 7f40acc84640 1 --2- 172.21.15.53:0/334631468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390ad1b0 0x564b3947b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.315+0000 7f40acc84640 1 -- 172.21.15.53:0/334631468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b39141650 con 0x564b390d6070 2024-08-31T06:04:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.315+0000 7f40a57fa640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40900b4cc0 0x7f40900b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.315+0000 7f40acc84640 1 --2- 172.21.15.53:0/334631468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b3947b2c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009de0 tx=0x7f40a000d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9172336f7c1ed0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.315+0000 7f40a7fff640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40900b4cc0 0x7f40900b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.315+0000 7f408e7fc640 1 -- 172.21.15.53:0/334631468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0003970 con 0x564b390d6070 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.315+0000 7f40a57fa640 1 -- 172.21.15.53:0/3082573401 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f4098105c10 con 0x7f40a8103900 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.315+0000 7f408e7fc640 1 -- 172.21.15.53:0/334631468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40a0004020 con 0x564b390d6070 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.315+0000 7f408e7fc640 1 -- 172.21.15.53:0/334631468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a00107d0 con 0x564b390d6070 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.316+0000 7f40b4c5c740 1 -- 172.21.15.53:0/334631468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 msgr2=0x564b3947b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.316+0000 7f40a7fff640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40900b4cc0 0x7f40900b71d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x564b39479f40 tx=0x7f40980d5040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.316+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/334631468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b3947b2c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009de0 tx=0x7f40a000d6b0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.316+0000 7f40b4c5c740 1 -- 172.21.15.53:0/334631468 shutdown_connections 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.316+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/334631468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390b5390 0x564b3947bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.316+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/334631468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390ad1b0 0x564b3947b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.316+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/334631468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b3947b2c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.316+0000 7f40b4c5c740 1 -- 172.21.15.53:0/334631468 >> 172.21.15.53:0/334631468 conn(0x564b390ca460 msgr2=0x564b394791b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.316+0000 7f40b4c5c740 1 -- 172.21.15.53:0/334631468 shutdown_connections 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.316+0000 7f40b4c5c740 1 -- 172.21.15.53:0/334631468 wait complete. 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40b4c5c740 1 -- start start 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40b4c5c740 1 Processor -- start 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b39486ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390b5390 0x564b39487000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390d6070 0x564b39492d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564b39244700 con 0x564b390b5390 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564b39368700 con 0x564b390d6070 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564b39489aa0 con 0x564b390ad1b0 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390b5390 0x564b39487000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390b5390 0x564b39487000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40494/0 (socket says 172.21.15.53:40494) 2024-08-31T06:04:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40b4c5c740 10 client.0 _ll_register_callbacks cb 0x564b39397dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:33.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.317+0000 7f40a77fe640 1 -- 172.21.15.53:0/1323413523 learned_addr learned my addr 172.21.15.53:0/1323413523 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:33.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40acc84640 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b39486ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40acc84640 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390d6070 0x564b39492d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40a77fe640 1 -- 172.21.15.53:0/1323413523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 msgr2=0x564b39486ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:33.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40a77fe640 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b39486ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40a77fe640 1 -- 172.21.15.53:0/1323413523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390d6070 msgr2=0x564b39492d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:33.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40a77fe640 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390d6070 0x564b39492d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40a77fe640 1 -- 172.21.15.53:0/1323413523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b393a18b0 con 0x564b390b5390 2024-08-31T06:04:33.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40acc84640 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390d6070 0x564b39492d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:33.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40a77fe640 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390b5390 0x564b39487000 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f409c00af80 tx=0x7f409c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cc05d1e9f47bb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:33.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40877fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:33.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40877fe640 1 -- 172.21.15.53:0/1323413523 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c00f860 con 0x564b390b5390 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40877fe640 1 -- 172.21.15.53:0/1323413523 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f409c00fa00 con 0x564b390b5390 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.318+0000 7f40b4c5c740 1 -- 172.21.15.53:0/1323413523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40a0004020 con 0x564b390b5390 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.319+0000 7f40877fe640 1 -- 172.21.15.53:0/1323413523 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f409c00fc40 con 0x564b390b5390 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.319+0000 7f40b4c5c740 10 client.15567 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.319+0000 7f40b4c5c740 1 -- 172.21.15.53:0/1323413523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b39495900 con 0x564b390b5390 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.319+0000 7f40877fe640 1 -- 172.21.15.53:0/1323413523 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40a0004020 con 0x564b390b5390 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.319+0000 7f40877fe640 1 -- 172.21.15.53:0/1323413523 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f409c0203b0 con 0x564b390b5390 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.319+0000 7f40b4c5c740 10 client.15567 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.319+0000 7f40b4c5c740 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.319+0000 7f40b4c5c740 20 client.15567 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.319+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564b390949f0 0x564b39498e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.319+0000 7f40b4c5c740 4 client.15567 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.319+0000 7f40b4c5c740 1 -- 172.21.15.53:0/1323413523 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b393f4580 con 0x564b390949f0 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.320+0000 7f40acc84640 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564b390949f0 0x564b39498e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.323+0000 7f40877fe640 10 client.15567 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.323+0000 7f40acc84640 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564b390949f0 0x564b39498e50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e55ffd4fec62e68b server_cookie=6609331f33d354de in_seq=0 out_seq=0 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40877fe640 1 -- 172.21.15.53:0/1323413523 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b393f4580 con 0x564b390949f0 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40877fe640 10 client.15567 handle_command_reply: tid=0 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 1 client.15567 shutdown 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 1 -- 172.21.15.53:0/1323413523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390b5390 msgr2=0x564b39487000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390b5390 0x564b39487000 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f409c00af80 tx=0x7f409c00c760 comp rx=0 tx=0).stop 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 1 -- 172.21.15.53:0/1323413523 shutdown_connections 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564b390949f0 0x564b39498e50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390d6070 0x564b39492d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390b5390 0x564b39487000 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/1323413523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b39486ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 1 -- 172.21.15.53:0/1323413523 >> 172.21.15.53:0/1323413523 conn(0x564b390ca460 msgr2=0x564b3947e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:33.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40877fe640 0 client.15567 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:33.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 1 -- 172.21.15.53:0/1323413523 shutdown_connections 2024-08-31T06:04:33.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 1 -- 172.21.15.53:0/1323413523 wait complete. 2024-08-31T06:04:33.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.324+0000 7f40b4c5c740 20 client.15567 trim_cache size 0 max 16384 2024-08-31T06:04:33.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40b4c5c740 1 Processor -- start 2024-08-31T06:04:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40b4c5c740 1 -- start start 2024-08-31T06:04:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b3947e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390b5390 0x564b3947e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b39483cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40a81af3b0 con 0x564b390d6070 2024-08-31T06:04:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40a81b0ef0 con 0x564b390b5390 2024-08-31T06:04:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40a81afa80 con 0x564b390ad1b0 2024-08-31T06:04:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40acc84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b39483cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40acc84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b39483cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40508/0 (socket says 172.21.15.53:40508) 2024-08-31T06:04:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40acc84640 1 -- 172.21.15.53:0/4053645528 learned_addr learned my addr 172.21.15.53:0/4053645528 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.343+0000 7f40acc84640 1 --2- 172.21.15.53:0/4053645528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b3947e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.344+0000 7f40a77fe640 1 --2- 172.21.15.53:0/4053645528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390b5390 0x564b3947e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.344+0000 7f40acc84640 1 -- 172.21.15.53:0/4053645528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 msgr2=0x564b3947e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.344+0000 7f40acc84640 1 --2- 172.21.15.53:0/4053645528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b3947e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.344+0000 7f40acc84640 1 -- 172.21.15.53:0/4053645528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390b5390 msgr2=0x564b3947e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.344+0000 7f40acc84640 1 --2- 172.21.15.53:0/4053645528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390b5390 0x564b3947e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.344+0000 7f40acc84640 1 -- 172.21.15.53:0/4053645528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b39479b20 con 0x564b390d6070 2024-08-31T06:04:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.344+0000 7f40acc84640 1 --2- 172.21.15.53:0/4053645528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b39483cb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009d30 tx=0x7f40a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49ac6fbe89445e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.344+0000 7f408dffb640 1 -- 172.21.15.53:0/4053645528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0004b20 con 0x564b390d6070 2024-08-31T06:04:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.344+0000 7f408dffb640 1 -- 172.21.15.53:0/4053645528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40a0004cc0 con 0x564b390d6070 2024-08-31T06:04:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.344+0000 7f408dffb640 1 -- 172.21.15.53:0/4053645528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0005180 con 0x564b390d6070 2024-08-31T06:04:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.345+0000 7f40b4c5c740 1 -- 172.21.15.53:0/4053645528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 msgr2=0x564b39483cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.345+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/4053645528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b39483cb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009d30 tx=0x7f40a0004a40 comp rx=0 tx=0).stop 2024-08-31T06:04:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.345+0000 7f40b4c5c740 1 -- 172.21.15.53:0/4053645528 shutdown_connections 2024-08-31T06:04:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.345+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/4053645528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b39483cb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.345+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/4053645528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390b5390 0x564b3947e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.345+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/4053645528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b3947e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.345+0000 7f40b4c5c740 1 -- 172.21.15.53:0/4053645528 >> 172.21.15.53:0/4053645528 conn(0x564b390ca460 msgr2=0x564b39485340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.345+0000 7f40b4c5c740 1 -- 172.21.15.53:0/4053645528 shutdown_connections 2024-08-31T06:04:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.345+0000 7f40b4c5c740 1 -- 172.21.15.53:0/4053645528 wait complete. 2024-08-31T06:04:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.346+0000 7f40b4c5c740 1 -- start start 2024-08-31T06:04:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.346+0000 7f40b4c5c740 1 Processor -- start 2024-08-31T06:04:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.346+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b3948b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.346+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390b5390 0x564b3948b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.346+0000 7f40b4c5c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b395027b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.346+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40a81b0820 con 0x564b390d6070 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.346+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40a81b0150 con 0x564b390b5390 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.346+0000 7f40b4c5c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40a81ad390 con 0x564b390ad1b0 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.346+0000 7f40b4c5c740 10 client.0 _ll_register_callbacks cb 0x7f409c005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40acc84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b395027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40acc84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b395027b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40522/0 (socket says 172.21.15.53:40522) 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40acc84640 1 -- 172.21.15.53:0/3870736935 learned_addr learned my addr 172.21.15.53:0/3870736935 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40a77fe640 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390b5390 0x564b3948b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40acc84640 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b3948b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40acc84640 1 -- 172.21.15.53:0/3870736935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 msgr2=0x564b3948b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40acc84640 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b3948b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40acc84640 1 -- 172.21.15.53:0/3870736935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390b5390 msgr2=0x564b3948b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40acc84640 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390b5390 0x564b3948b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40acc84640 1 -- 172.21.15.53:0/3870736935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b39502cf0 con 0x564b390d6070 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40acc84640 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b395027b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f40a00047e0 tx=0x7f40a0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca091bdb1002301 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40877fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40877fe640 1 -- 172.21.15.53:0/3870736935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0003970 con 0x564b390d6070 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40877fe640 1 -- 172.21.15.53:0/3870736935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f40a0003b10 con 0x564b390d6070 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.347+0000 7f40b4c5c740 1 -- 172.21.15.53:0/3870736935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40a0004cc0 con 0x564b390d6070 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40877fe640 1 -- 172.21.15.53:0/3870736935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f40a0003d10 con 0x564b390d6070 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40b4c5c740 10 client.15573 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40b4c5c740 1 -- 172.21.15.53:0/3870736935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b39503f30 con 0x564b390d6070 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40877fe640 1 -- 172.21.15.53:0/3870736935 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40a0004cc0 con 0x564b390d6070 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40877fe640 1 -- 172.21.15.53:0/3870736935 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f40a0031070 con 0x564b390d6070 2024-08-31T06:04:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40b4c5c740 10 client.15573 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40b4c5c740 10 client.15573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:04:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40b4c5c740 20 client.15573 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564b39069da0 0x564b39506440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40b4c5c740 4 client.15573 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:04:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40b4c5c740 1 -- 172.21.15.53:0/3870736935 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564b393f0020 con 0x564b39069da0 2024-08-31T06:04:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.348+0000 7f40a77fe640 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564b39069da0 0x564b39506440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.349+0000 7f40877fe640 10 client.15573 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.349+0000 7f40a77fe640 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564b39069da0 0x564b39506440 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f29370ff918726c server_cookie=1632aaaed7fd3c02 in_seq=0 out_seq=0 2024-08-31T06:04:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40877fe640 1 -- 172.21.15.53:0/3870736935 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x564b393f0020 con 0x564b39069da0 2024-08-31T06:04:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40877fe640 10 client.15573 handle_command_reply: tid=0 2024-08-31T06:04:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 1 client.15573 shutdown 2024-08-31T06:04:33.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 1 -- 172.21.15.53:0/3870736935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 msgr2=0x564b395027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:33.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b395027b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f40a00047e0 tx=0x7f40a0005020 comp rx=0 tx=0).stop 2024-08-31T06:04:33.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 1 -- 172.21.15.53:0/3870736935 shutdown_connections 2024-08-31T06:04:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564b39069da0 0x564b39506440 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b390d6070 0x564b395027b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564b390b5390 0x564b3948b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 1 --2- 172.21.15.53:0/3870736935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564b390ad1b0 0x564b3948b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 1 -- 172.21.15.53:0/3870736935 >> 172.21.15.53:0/3870736935 conn(0x564b390ca460 msgr2=0x564b3947e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40877fe640 0 client.15573 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 1 -- 172.21.15.53:0/3870736935 shutdown_connections 2024-08-31T06:04:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 1 -- 172.21.15.53:0/3870736935 wait complete. 2024-08-31T06:04:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.350+0000 7f40b4c5c740 20 client.15573 trim_cache size 0 max 16384 2024-08-31T06:04:33.357 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "0450956f-5b94-476e-9a3a-8abca9e5b7df", 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:04:33.358 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:04:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:04:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:04:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:04:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:04:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:04:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:04:33.359 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3082573401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40900b4cc0 msgr2=0x7f40900b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40900b4cc0 0x7f40900b71d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x564b39479f40 tx=0x7f40980d5040 comp rx=0 tx=0).stop 2024-08-31T06:04:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3082573401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40a8103900 msgr2=0x7f40a819a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40a8103900 0x7f40a819a190 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4098009230 tx=0x7f4098004270 comp rx=0 tx=0).stop 2024-08-31T06:04:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3082573401 shutdown_connections 2024-08-31T06:04:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40900b4cc0 0x7f40900b71d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40a8109b90 0x7f40a819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40a8109240 0x7f40a819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 --2- 172.21.15.53:0/3082573401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40a8103900 0x7f40a819a190 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:33.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3082573401 >> 172.21.15.53:0/3082573401 conn(0x7f40a807b5f0 msgr2=0x7f40a8107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:33.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3082573401 shutdown_connections 2024-08-31T06:04:33.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:33.351+0000 7f40ae6e7640 1 -- 172.21.15.53:0/3082573401 wait complete. 2024-08-31T06:04:33.361 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:33.812 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:33 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:04:33.812 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:33 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:04:33.812 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:33 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:04:33.812 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:33 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:04:33.812 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:33 smithi053 ceph-mon[18924]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:33.812 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:33 smithi053 ceph-mon[18924]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-31T06:04:33.812 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:33 smithi053 ceph-mon[18924]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-08-31T06:04:33.813 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:33 smithi053 ceph-mon[18924]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:33 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:04:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:33 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:04:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:33 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:04:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:33 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:04:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:33 smithi130 ceph-mon[22266]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:33 smithi130 ceph-mon[22266]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-31T06:04:33.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:33 smithi130 ceph-mon[22266]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-08-31T06:04:33.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:33 smithi130 ceph-mon[22266]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:33 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:04:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:33 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:04:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:33 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:04:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:33 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:04:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:33 smithi153 ceph-mon[22320]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:33.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:33 smithi153 ceph-mon[22320]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-31T06:04:33.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:33 smithi153 ceph-mon[22320]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-08-31T06:04:33.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:33 smithi153 ceph-mon[22320]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:34.506 INFO:tasks.cephfs.filesystem:scrub status for tag:0450956f-5b94-476e-9a3a-8abca9e5b7df - {'path': '/', 'tag': '0450956f-5b94-476e-9a3a-8abca9e5b7df', 'options': 'recursive,force'} 2024-08-31T06:04:34.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.701+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/4199353831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e28109240 msgr2=0x7f7e28109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:34.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.701+0000 7f7e2e7d2640 1 --2- 172.21.15.53:0/4199353831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e28109240 0x7f7e28109650 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009900 tx=0x7f7e1c02a410 comp rx=0 tx=0).stop 2024-08-31T06:04:34.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.701+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/4199353831 shutdown_connections 2024-08-31T06:04:34.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.701+0000 7f7e2e7d2640 1 --2- 172.21.15.53:0/4199353831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e28109b90 0x7f7e281103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:34.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.701+0000 7f7e2e7d2640 1 --2- 172.21.15.53:0/4199353831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e28109240 0x7f7e28109650 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:34.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.701+0000 7f7e2e7d2640 1 --2- 172.21.15.53:0/4199353831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e28103900 0x7f7e28103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:34.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.701+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/4199353831 >> 172.21.15.53:0/4199353831 conn(0x7f7e2807b5f0 msgr2=0x7f7e2807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:34.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.702+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/4199353831 shutdown_connections 2024-08-31T06:04:34.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.702+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/4199353831 wait complete. 2024-08-31T06:04:34.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.702+0000 7f7e2e7d2640 1 Processor -- start 2024-08-31T06:04:34.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.702+0000 7f7e2e7d2640 1 -- start start 2024-08-31T06:04:34.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e2e7d2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e28103900 0x7f7e2819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:34.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e2e7d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e28109240 0x7f7e2819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:34.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e2e7d2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e28109b90 0x7f7e2819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e2e7d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28113700 con 0x7f7e28109240 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e2e7d2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28113580 con 0x7f7e28109b90 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e2e7d2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28113880 con 0x7f7e28103900 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e28109240 0x7f7e2819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e28109240 0x7f7e2819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40538/0 (socket says 172.21.15.53:40538) 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e277fe640 1 -- 172.21.15.53:0/369460762 learned_addr learned my addr 172.21.15.53:0/369460762 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e2cd6f640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e28109b90 0x7f7e2819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e27fff640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e28103900 0x7f7e2819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e277fe640 1 -- 172.21.15.53:0/369460762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e28103900 msgr2=0x7f7e2819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e277fe640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e28103900 0x7f7e2819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e277fe640 1 -- 172.21.15.53:0/369460762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e28109b90 msgr2=0x7f7e2819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e277fe640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e28109b90 0x7f7e2819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:34.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e277fe640 1 -- 172.21.15.53:0/369460762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e281a0060 con 0x7f7e28109240 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.703+0000 7f7e277fe640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e28109240 0x7f7e2819a750 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c005940 tx=0x7f7e1c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.704+0000 7f7e257fa640 1 -- 172.21.15.53:0/369460762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c03f030 con 0x7f7e28109240 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.704+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/369460762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e281a02f0 con 0x7f7e28109240 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.704+0000 7f7e257fa640 1 -- 172.21.15.53:0/369460762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e1c003a80 con 0x7f7e28109240 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.704+0000 7f7e257fa640 1 -- 172.21.15.53:0/369460762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c035070 con 0x7f7e28109240 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.704+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/369460762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e281a07d0 con 0x7f7e28109240 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.705+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/369460762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e28103d10 con 0x7f7e28109240 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.706+0000 7f7e257fa640 1 -- 172.21.15.53:0/369460762 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f7e1c042030 con 0x7f7e28109240 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.707+0000 7f7e257fa640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e100b4c40 0x7f7e100b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.708+0000 7f7e27fff640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e100b4c40 0x7f7e100b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.708+0000 7f7e257fa640 1 -- 172.21.15.53:0/369460762 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7e1c105cf0 con 0x7f7e28109240 2024-08-31T06:04:34.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.708+0000 7f7e27fff640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e100b4c40 0x7f7e100b7150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800abe0 tx=0x7f7e1800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:34.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.711+0000 7f7e257fa640 1 -- 172.21.15.53:0/369460762 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7e1c0ccb40 con 0x7f7e28109240 2024-08-31T06:04:34.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.891+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/369460762 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e280635a0 con 0x7f7e100b4c40 2024-08-31T06:04:34.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.896+0000 7f7e257fa640 1 -- 172.21.15.53:0/369460762 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258922 (secure 0 0 0) 0x7f7e280635a0 con 0x7f7e100b4c40 2024-08-31T06:04:34.900 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-08-31T06:04:34.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/369460762 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e100b4c40 msgr2=0x7f7e100b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:34.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e100b4c40 0x7f7e100b7150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800abe0 tx=0x7f7e1800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:04:34.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/369460762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e28109240 msgr2=0x7f7e2819a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:34.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e28109240 0x7f7e2819a750 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c005940 tx=0x7f7e1c0040e0 comp rx=0 tx=0).stop 2024-08-31T06:04:34.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/369460762 shutdown_connections 2024-08-31T06:04:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e100b4c40 0x7f7e100b7150 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e28109b90 0x7f7e2819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e28109240 0x7f7e2819a750 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 --2- 172.21.15.53:0/369460762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e28103900 0x7f7e2819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/369460762 >> 172.21.15.53:0/369460762 conn(0x7f7e2807b5f0 msgr2=0x7f7e28107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/369460762 shutdown_connections 2024-08-31T06:04:34.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:34.899+0000 7f7e2e7d2640 1 -- 172.21.15.53:0/369460762 wait complete. 2024-08-31T06:04:35.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:35 smithi130 ceph-mon[22266]: pgmap v312: 97 pgs: 97 active+clean; 1.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 102 KiB/s wr, 50 op/s 2024-08-31T06:04:35.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:35 smithi130 ceph-mon[22266]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:35.667 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:35 smithi053 ceph-mon[18924]: pgmap v312: 97 pgs: 97 active+clean; 1.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 102 KiB/s wr, 50 op/s 2024-08-31T06:04:35.667 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:35 smithi053 ceph-mon[18924]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:35.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:35 smithi153 ceph-mon[22320]: pgmap v312: 97 pgs: 97 active+clean; 1.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 102 KiB/s wr, 50 op/s 2024-08-31T06:04:35.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:35 smithi153 ceph-mon[22320]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:35.694 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-08-31T06:04:34.367977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1058094,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":1533,"num_read_kb":999,"num_write":545,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2951908,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":906,"ondisk_log_size":906,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396576,"kb_used_data":13904,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124545248,"statfs":{"total":1151940427776,"available":1151534333952,"internally_reserved":0,"allocated":14237696,"data_stored":8928142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":391492922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":399502,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":434,"num_read_kb":349,"num_write":167,"num_write_kb":1230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003167"},"pg_stats":[{"pgid":"3.3f","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436194+0000","last_change":"2024-08-31T06:02:30.611733+0000","last_active":"2024-08-31T06:04:16.436194+0000","last_peered":"2024-08-31T06:04:16.436194+0000","last_clean":"2024-08-31T06:04:16.436194+0000","last_became_active":"2024-08-31T06:02:30.610339+0000","last_became_peered":"2024-08-31T06:02:30.610339+0000","last_unstale":"2024-08-31T06:04:16.436194+0000","last_undegraded":"2024-08-31T06:04:16.436194+0000","last_fullsized":"2024-08-31T06:04:16.436194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:20.628524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996993+0000","last_change":"2024-08-31T06:02:30.604550+0000","last_active":"2024-08-31T06:04:16.996993+0000","last_peered":"2024-08-31T06:04:16.996993+0000","last_clean":"2024-08-31T06:04:16.996993+0000","last_became_active":"2024-08-31T06:02:30.604200+0000","last_became_peered":"2024-08-31T06:02:30.604200+0000","last_unstale":"2024-08-31T06:04:16.996993+0000","last_undegraded":"2024-08-31T06:04:16.996993+0000","last_fullsized":"2024-08-31T06:04:16.996993+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:31.191972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997029+0000","last_change":"2024-08-31T06:02:30.606102+0000","last_active":"2024-08-31T06:04:16.997029+0000","last_peered":"2024-08-31T06:04:16.997029+0000","last_clean":"2024-08-31T06:04:16.997029+0000","last_became_active":"2024-08-31T06:02:30.605738+0000","last_became_peered":"2024-08-31T06:02:30.605738+0000","last_unstale":"2024-08-31T06:04:16.997029+0000","last_undegraded":"2024-08-31T06:04:16.997029+0000","last_fullsized":"2024-08-31T06:04:16.997029+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:50:34.993218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"72'8","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827148+0000","last_change":"2024-08-31T06:02:30.603207+0000","last_active":"2024-08-31T06:04:16.827148+0000","last_peered":"2024-08-31T06:04:16.827148+0000","last_clean":"2024-08-31T06:04:16.827148+0000","last_became_active":"2024-08-31T06:02:30.602829+0000","last_became_peered":"2024-08-31T06:02:30.602829+0000","last_unstale":"2024-08-31T06:04:16.827148+0000","last_undegraded":"2024-08-31T06:04:16.827148+0000","last_fullsized":"2024-08-31T06:04:16.827148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:02.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997618+0000","last_change":"2024-08-31T06:02:30.590760+0000","last_active":"2024-08-31T06:04:16.997618+0000","last_peered":"2024-08-31T06:04:16.997618+0000","last_clean":"2024-08-31T06:04:16.997618+0000","last_became_active":"2024-08-31T06:02:30.590198+0000","last_became_peered":"2024-08-31T06:02:30.590198+0000","last_unstale":"2024-08-31T06:04:16.997618+0000","last_undegraded":"2024-08-31T06:04:16.997618+0000","last_fullsized":"2024-08-31T06:04:16.997618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:50.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433579+0000","last_change":"2024-08-31T06:02:30.599924+0000","last_active":"2024-08-31T06:04:16.433579+0000","last_peered":"2024-08-31T06:04:16.433579+0000","last_clean":"2024-08-31T06:04:16.433579+0000","last_became_active":"2024-08-31T06:02:30.599566+0000","last_became_peered":"2024-08-31T06:02:30.599566+0000","last_unstale":"2024-08-31T06:04:16.433579+0000","last_undegraded":"2024-08-31T06:04:16.433579+0000","last_fullsized":"2024-08-31T06:04:16.433579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:58.265673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"72'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826124+0000","last_change":"2024-08-31T06:03:15.771521+0000","last_active":"2024-08-31T06:04:16.826124+0000","last_peered":"2024-08-31T06:04:16.826124+0000","last_clean":"2024-08-31T06:04:16.826124+0000","last_became_active":"2024-08-31T06:03:15.770969+0000","last_became_peered":"2024-08-31T06:03:15.770969+0000","last_unstale":"2024-08-31T06:04:16.826124+0000","last_undegraded":"2024-08-31T06:04:16.826124+0000","last_fullsized":"2024-08-31T06:04:16.826124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:31.724213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437763+0000","last_change":"2024-08-31T06:02:30.610057+0000","last_active":"2024-08-31T06:04:16.437763+0000","last_peered":"2024-08-31T06:04:16.437763+0000","last_clean":"2024-08-31T06:04:16.437763+0000","last_became_active":"2024-08-31T06:02:30.609654+0000","last_became_peered":"2024-08-31T06:02:30.609654+0000","last_unstale":"2024-08-31T06:04:16.437763+0000","last_undegraded":"2024-08-31T06:04:16.437763+0000","last_fullsized":"2024-08-31T06:04:16.437763+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:32:14.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435055+0000","last_change":"2024-08-31T06:02:30.606437+0000","last_active":"2024-08-31T06:04:16.435055+0000","last_peered":"2024-08-31T06:04:16.435055+0000","last_clean":"2024-08-31T06:04:16.435055+0000","last_became_active":"2024-08-31T06:02:30.605632+0000","last_became_peered":"2024-08-31T06:02:30.605632+0000","last_unstale":"2024-08-31T06:04:16.435055+0000","last_undegraded":"2024-08-31T06:04:16.435055+0000","last_fullsized":"2024-08-31T06:04:16.435055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:47.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"72'16","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434609+0000","last_change":"2024-08-31T06:02:30.605456+0000","last_active":"2024-08-31T06:04:16.434609+0000","last_peered":"2024-08-31T06:04:16.434609+0000","last_clean":"2024-08-31T06:04:16.434609+0000","last_became_active":"2024-08-31T06:02:30.604927+0000","last_became_peered":"2024-08-31T06:02:30.604927+0000","last_unstale":"2024-08-31T06:04:16.434609+0000","last_undegraded":"2024-08-31T06:04:16.434609+0000","last_fullsized":"2024-08-31T06:04:16.434609+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:30.340609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826434+0000","last_change":"2024-08-31T06:02:30.608595+0000","last_active":"2024-08-31T06:04:16.826434+0000","last_peered":"2024-08-31T06:04:16.826434+0000","last_clean":"2024-08-31T06:04:16.826434+0000","last_became_active":"2024-08-31T06:02:30.607695+0000","last_became_peered":"2024-08-31T06:02:30.607695+0000","last_unstale":"2024-08-31T06:04:16.826434+0000","last_undegraded":"2024-08-31T06:04:16.826434+0000","last_fullsized":"2024-08-31T06:04:16.826434+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:44:53.655598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827095+0000","last_change":"2024-08-31T06:02:30.595775+0000","last_active":"2024-08-31T06:04:16.827095+0000","last_peered":"2024-08-31T06:04:16.827095+0000","last_clean":"2024-08-31T06:04:16.827095+0000","last_became_active":"2024-08-31T06:02:30.595424+0000","last_became_peered":"2024-08-31T06:02:30.595424+0000","last_unstale":"2024-08-31T06:04:16.827095+0000","last_undegraded":"2024-08-31T06:04:16.827095+0000","last_fullsized":"2024-08-31T06:04:16.827095+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:56.382633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431879+0000","last_change":"2024-08-31T06:02:30.603465+0000","last_active":"2024-08-31T06:04:16.431879+0000","last_peered":"2024-08-31T06:04:16.431879+0000","last_clean":"2024-08-31T06:04:16.431879+0000","last_became_active":"2024-08-31T06:02:30.603041+0000","last_became_peered":"2024-08-31T06:02:30.603041+0000","last_unstale":"2024-08-31T06:04:16.431879+0000","last_undegraded":"2024-08-31T06:04:16.431879+0000","last_fullsized":"2024-08-31T06:04:16.431879+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:19:00.139973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996811+0000","last_change":"2024-08-31T06:02:30.593807+0000","last_active":"2024-08-31T06:04:16.996811+0000","last_peered":"2024-08-31T06:04:16.996811+0000","last_clean":"2024-08-31T06:04:16.996811+0000","last_became_active":"2024-08-31T06:02:30.593389+0000","last_became_peered":"2024-08-31T06:02:30.593389+0000","last_unstale":"2024-08-31T06:04:16.996811+0000","last_undegraded":"2024-08-31T06:04:16.996811+0000","last_fullsized":"2024-08-31T06:04:16.996811+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:01:04.398867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996779+0000","last_change":"2024-08-31T06:02:30.605207+0000","last_active":"2024-08-31T06:04:16.996779+0000","last_peered":"2024-08-31T06:04:16.996779+0000","last_clean":"2024-08-31T06:04:16.996779+0000","last_became_active":"2024-08-31T06:02:30.604866+0000","last_became_peered":"2024-08-31T06:02:30.604866+0000","last_unstale":"2024-08-31T06:04:16.996779+0000","last_undegraded":"2024-08-31T06:04:16.996779+0000","last_fullsized":"2024-08-31T06:04:16.996779+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:56.305638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433428+0000","last_change":"2024-08-31T06:02:30.601457+0000","last_active":"2024-08-31T06:04:16.433428+0000","last_peered":"2024-08-31T06:04:16.433428+0000","last_clean":"2024-08-31T06:04:16.433428+0000","last_became_active":"2024-08-31T06:02:30.601077+0000","last_became_peered":"2024-08-31T06:02:30.601077+0000","last_unstale":"2024-08-31T06:04:16.433428+0000","last_undegraded":"2024-08-31T06:04:16.433428+0000","last_fullsized":"2024-08-31T06:04:16.433428+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:51:42.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436274+0000","last_change":"2024-08-31T06:02:30.612475+0000","last_active":"2024-08-31T06:04:16.436274+0000","last_peered":"2024-08-31T06:04:16.436274+0000","last_clean":"2024-08-31T06:04:16.436274+0000","last_became_active":"2024-08-31T06:02:30.612088+0000","last_became_peered":"2024-08-31T06:02:30.612088+0000","last_unstale":"2024-08-31T06:04:16.436274+0000","last_undegraded":"2024-08-31T06:04:16.436274+0000","last_fullsized":"2024-08-31T06:04:16.436274+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:34.348645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823774+0000","last_change":"2024-08-31T06:02:30.605612+0000","last_active":"2024-08-31T06:04:16.823774+0000","last_peered":"2024-08-31T06:04:16.823774+0000","last_clean":"2024-08-31T06:04:16.823774+0000","last_became_active":"2024-08-31T06:02:30.605271+0000","last_became_peered":"2024-08-31T06:02:30.605271+0000","last_unstale":"2024-08-31T06:04:16.823774+0000","last_undegraded":"2024-08-31T06:04:16.823774+0000","last_fullsized":"2024-08-31T06:04:16.823774+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:38.003500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438194+0000","last_change":"2024-08-31T06:02:30.610328+0000","last_active":"2024-08-31T06:04:16.438194+0000","last_peered":"2024-08-31T06:04:16.438194+0000","last_clean":"2024-08-31T06:04:16.438194+0000","last_became_active":"2024-08-31T06:02:30.609935+0000","last_became_peered":"2024-08-31T06:02:30.609935+0000","last_unstale":"2024-08-31T06:04:16.438194+0000","last_undegraded":"2024-08-31T06:04:16.438194+0000","last_fullsized":"2024-08-31T06:04:16.438194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:22.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435885+0000","last_change":"2024-08-31T06:02:30.609207+0000","last_active":"2024-08-31T06:04:16.435885+0000","last_peered":"2024-08-31T06:04:16.435885+0000","last_clean":"2024-08-31T06:04:16.435885+0000","last_became_active":"2024-08-31T06:02:30.608635+0000","last_became_peered":"2024-08-31T06:02:30.608635+0000","last_unstale":"2024-08-31T06:04:16.435885+0000","last_undegraded":"2024-08-31T06:04:16.435885+0000","last_fullsized":"2024-08-31T06:04:16.435885+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:43.898073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431972+0000","last_change":"2024-08-31T06:02:30.595829+0000","last_active":"2024-08-31T06:04:16.431972+0000","last_peered":"2024-08-31T06:04:16.431972+0000","last_clean":"2024-08-31T06:04:16.431972+0000","last_became_active":"2024-08-31T06:02:30.595427+0000","last_became_peered":"2024-08-31T06:02:30.595427+0000","last_unstale":"2024-08-31T06:04:16.431972+0000","last_undegraded":"2024-08-31T06:04:16.431972+0000","last_fullsized":"2024-08-31T06:04:16.431972+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:09:39.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433777+0000","last_change":"2024-08-31T06:02:30.599513+0000","last_active":"2024-08-31T06:04:16.433777+0000","last_peered":"2024-08-31T06:04:16.433777+0000","last_clean":"2024-08-31T06:04:16.433777+0000","last_became_active":"2024-08-31T06:02:30.599195+0000","last_became_peered":"2024-08-31T06:02:30.599195+0000","last_unstale":"2024-08-31T06:04:16.433777+0000","last_undegraded":"2024-08-31T06:04:16.433777+0000","last_fullsized":"2024-08-31T06:04:16.433777+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:26.669658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437790+0000","last_change":"2024-08-31T06:02:30.609229+0000","last_active":"2024-08-31T06:04:16.437790+0000","last_peered":"2024-08-31T06:04:16.437790+0000","last_clean":"2024-08-31T06:04:16.437790+0000","last_became_active":"2024-08-31T06:02:30.608536+0000","last_became_peered":"2024-08-31T06:02:30.608536+0000","last_unstale":"2024-08-31T06:04:16.437790+0000","last_undegraded":"2024-08-31T06:04:16.437790+0000","last_fullsized":"2024-08-31T06:04:16.437790+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:08.917901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825521+0000","last_change":"2024-08-31T06:02:30.603663+0000","last_active":"2024-08-31T06:04:16.825521+0000","last_peered":"2024-08-31T06:04:16.825521+0000","last_clean":"2024-08-31T06:04:16.825521+0000","last_became_active":"2024-08-31T06:02:30.603220+0000","last_became_peered":"2024-08-31T06:02:30.603220+0000","last_unstale":"2024-08-31T06:04:16.825521+0000","last_undegraded":"2024-08-31T06:04:16.825521+0000","last_fullsized":"2024-08-31T06:04:16.825521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:09.433078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438040+0000","last_change":"2024-08-31T06:02:30.608474+0000","last_active":"2024-08-31T06:04:16.438040+0000","last_peered":"2024-08-31T06:04:16.438040+0000","last_clean":"2024-08-31T06:04:16.438040+0000","last_became_active":"2024-08-31T06:02:30.608118+0000","last_became_peered":"2024-08-31T06:02:30.608118+0000","last_unstale":"2024-08-31T06:04:16.438040+0000","last_undegraded":"2024-08-31T06:04:16.438040+0000","last_fullsized":"2024-08-31T06:04:16.438040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:55.124001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438523+0000","last_change":"2024-08-31T06:02:30.614255+0000","last_active":"2024-08-31T06:04:16.438523+0000","last_peered":"2024-08-31T06:04:16.438523+0000","last_clean":"2024-08-31T06:04:16.438523+0000","last_became_active":"2024-08-31T06:02:30.613805+0000","last_became_peered":"2024-08-31T06:02:30.613805+0000","last_unstale":"2024-08-31T06:04:16.438523+0000","last_undegraded":"2024-08-31T06:04:16.438523+0000","last_fullsized":"2024-08-31T06:04:16.438523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.892997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436018+0000","last_change":"2024-08-31T06:02:30.609877+0000","last_active":"2024-08-31T06:04:16.436018+0000","last_peered":"2024-08-31T06:04:16.436018+0000","last_clean":"2024-08-31T06:04:16.436018+0000","last_became_active":"2024-08-31T06:02:30.608805+0000","last_became_peered":"2024-08-31T06:02:30.608805+0000","last_unstale":"2024-08-31T06:04:16.436018+0000","last_undegraded":"2024-08-31T06:04:16.436018+0000","last_fullsized":"2024-08-31T06:04:16.436018+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:52.172745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431812+0000","last_change":"2024-08-31T06:02:30.594684+0000","last_active":"2024-08-31T06:04:16.431812+0000","last_peered":"2024-08-31T06:04:16.431812+0000","last_clean":"2024-08-31T06:04:16.431812+0000","last_became_active":"2024-08-31T06:02:30.594293+0000","last_became_peered":"2024-08-31T06:02:30.594293+0000","last_unstale":"2024-08-31T06:04:16.431812+0000","last_undegraded":"2024-08-31T06:04:16.431812+0000","last_fullsized":"2024-08-31T06:04:16.431812+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:58:39.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997035+0000","last_change":"2024-08-31T06:02:30.602765+0000","last_active":"2024-08-31T06:04:16.997035+0000","last_peered":"2024-08-31T06:04:16.997035+0000","last_clean":"2024-08-31T06:04:16.997035+0000","last_became_active":"2024-08-31T06:02:30.602410+0000","last_became_peered":"2024-08-31T06:02:30.602410+0000","last_unstale":"2024-08-31T06:04:16.997035+0000","last_undegraded":"2024-08-31T06:04:16.997035+0000","last_fullsized":"2024-08-31T06:04:16.997035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:12.370967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437952+0000","last_change":"2024-08-31T06:02:30.611818+0000","last_active":"2024-08-31T06:04:16.437952+0000","last_peered":"2024-08-31T06:04:16.437952+0000","last_clean":"2024-08-31T06:04:16.437952+0000","last_became_active":"2024-08-31T06:02:30.610917+0000","last_became_peered":"2024-08-31T06:02:30.610917+0000","last_unstale":"2024-08-31T06:04:16.437952+0000","last_undegraded":"2024-08-31T06:04:16.437952+0000","last_fullsized":"2024-08-31T06:04:16.437952+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:00.895825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"72'12","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438263+0000","last_change":"2024-08-31T06:02:30.612186+0000","last_active":"2024-08-31T06:04:16.438263+0000","last_peered":"2024-08-31T06:04:16.438263+0000","last_clean":"2024-08-31T06:04:16.438263+0000","last_became_active":"2024-08-31T06:02:30.610496+0000","last_became_peered":"2024-08-31T06:02:30.610496+0000","last_unstale":"2024-08-31T06:04:16.438263+0000","last_undegraded":"2024-08-31T06:04:16.438263+0000","last_fullsized":"2024-08-31T06:04:16.438263+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:48:19.954998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"72'9","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435716+0000","last_change":"2024-08-31T06:03:15.776507+0000","last_active":"2024-08-31T06:04:16.435716+0000","last_peered":"2024-08-31T06:04:16.435716+0000","last_clean":"2024-08-31T06:04:16.435716+0000","last_became_active":"2024-08-31T06:03:15.776039+0000","last_became_peered":"2024-08-31T06:03:15.776039+0000","last_unstale":"2024-08-31T06:04:16.435716+0000","last_undegraded":"2024-08-31T06:04:16.435716+0000","last_fullsized":"2024-08-31T06:04:16.435716+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:41.616112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997530+0000","last_change":"2024-08-31T06:02:30.607864+0000","last_active":"2024-08-31T06:04:16.997530+0000","last_peered":"2024-08-31T06:04:16.997530+0000","last_clean":"2024-08-31T06:04:16.997530+0000","last_became_active":"2024-08-31T06:02:30.607299+0000","last_became_peered":"2024-08-31T06:02:30.607299+0000","last_unstale":"2024-08-31T06:04:16.997530+0000","last_undegraded":"2024-08-31T06:04:16.997530+0000","last_fullsized":"2024-08-31T06:04:16.997530+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:19.302279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'8","reported_seq":148,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:28.844014+0000","last_change":"2024-08-31T06:02:28.594973+0000","last_active":"2024-08-31T06:04:28.844014+0000","last_peered":"2024-08-31T06:04:28.844014+0000","last_clean":"2024-08-31T06:04:28.844014+0000","last_became_active":"2024-08-31T06:02:28.594588+0000","last_became_peered":"2024-08-31T06:02:28.594588+0000","last_unstale":"2024-08-31T06:04:28.844014+0000","last_undegraded":"2024-08-31T06:04:28.844014+0000","last_fullsized":"2024-08-31T06:04:28.844014+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:29:48.016888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"72'8","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825760+0000","last_change":"2024-08-31T06:03:15.974504+0000","last_active":"2024-08-31T06:04:16.825760+0000","last_peered":"2024-08-31T06:04:16.825760+0000","last_clean":"2024-08-31T06:04:16.825760+0000","last_became_active":"2024-08-31T06:03:15.974139+0000","last_became_peered":"2024-08-31T06:03:15.974139+0000","last_unstale":"2024-08-31T06:04:16.825760+0000","last_undegraded":"2024-08-31T06:04:16.825760+0000","last_fullsized":"2024-08-31T06:04:16.825760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:22.742884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433751+0000","last_change":"2024-08-31T06:02:28.589152+0000","last_active":"2024-08-31T06:04:16.433751+0000","last_peered":"2024-08-31T06:04:16.433751+0000","last_clean":"2024-08-31T06:04:16.433751+0000","last_became_active":"2024-08-31T06:02:28.588758+0000","last_became_peered":"2024-08-31T06:02:28.588758+0000","last_unstale":"2024-08-31T06:04:16.433751+0000","last_undegraded":"2024-08-31T06:04:16.433751+0000","last_fullsized":"2024-08-31T06:04:16.433751+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:31.814105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"70'3","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431439+0000","last_change":"2024-08-31T06:02:28.585410+0000","last_active":"2024-08-31T06:04:16.431439+0000","last_peered":"2024-08-31T06:04:16.431439+0000","last_clean":"2024-08-31T06:04:16.431439+0000","last_became_active":"2024-08-31T06:02:28.584998+0000","last_became_peered":"2024-08-31T06:02:28.584998+0000","last_unstale":"2024-08-31T06:04:16.431439+0000","last_undegraded":"2024-08-31T06:04:16.431439+0000","last_fullsized":"2024-08-31T06:04:16.431439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:30.705460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437844+0000","last_change":"2024-08-31T06:02:30.597295+0000","last_active":"2024-08-31T06:04:16.437844+0000","last_peered":"2024-08-31T06:04:16.437844+0000","last_clean":"2024-08-31T06:04:16.437844+0000","last_became_active":"2024-08-31T06:02:30.596968+0000","last_became_peered":"2024-08-31T06:02:30.596968+0000","last_unstale":"2024-08-31T06:04:16.437844+0000","last_undegraded":"2024-08-31T06:04:16.437844+0000","last_fullsized":"2024-08-31T06:04:16.437844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:38.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"70'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825895+0000","last_change":"2024-08-31T06:02:28.594164+0000","last_active":"2024-08-31T06:04:16.825895+0000","last_peered":"2024-08-31T06:04:16.825895+0000","last_clean":"2024-08-31T06:04:16.825895+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.825895+0000","last_undegraded":"2024-08-31T06:04:16.825895+0000","last_fullsized":"2024-08-31T06:04:16.825895+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:21.780202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823573+0000","last_change":"2024-08-31T06:02:30.597500+0000","last_active":"2024-08-31T06:04:16.823573+0000","last_peered":"2024-08-31T06:04:16.823573+0000","last_clean":"2024-08-31T06:04:16.823573+0000","last_became_active":"2024-08-31T06:02:30.597147+0000","last_became_peered":"2024-08-31T06:02:30.597147+0000","last_unstale":"2024-08-31T06:04:16.823573+0000","last_undegraded":"2024-08-31T06:04:16.823573+0000","last_fullsized":"2024-08-31T06:04:16.823573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:34.111288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'6","reported_seq":255,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:32.848833+0000","last_change":"2024-08-31T06:02:28.585769+0000","last_active":"2024-08-31T06:04:32.848833+0000","last_peered":"2024-08-31T06:04:32.848833+0000","last_clean":"2024-08-31T06:04:32.848833+0000","last_became_active":"2024-08-31T06:02:28.585310+0000","last_became_peered":"2024-08-31T06:02:28.585310+0000","last_unstale":"2024-08-31T06:04:32.848833+0000","last_undegraded":"2024-08-31T06:04:32.848833+0000","last_fullsized":"2024-08-31T06:04:32.848833+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:40.595986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":222,"num_read_kb":222,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434873+0000","last_change":"2024-08-31T06:02:30.601434+0000","last_active":"2024-08-31T06:04:16.434873+0000","last_peered":"2024-08-31T06:04:16.434873+0000","last_clean":"2024-08-31T06:04:16.434873+0000","last_became_active":"2024-08-31T06:02:30.601060+0000","last_became_peered":"2024-08-31T06:02:30.601060+0000","last_unstale":"2024-08-31T06:04:16.434873+0000","last_undegraded":"2024-08-31T06:04:16.434873+0000","last_fullsized":"2024-08-31T06:04:16.434873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:32.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"70'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826424+0000","last_change":"2024-08-31T06:02:28.593217+0000","last_active":"2024-08-31T06:04:16.826424+0000","last_peered":"2024-08-31T06:04:16.826424+0000","last_clean":"2024-08-31T06:04:16.826424+0000","last_became_active":"2024-08-31T06:02:28.592801+0000","last_became_peered":"2024-08-31T06:02:28.592801+0000","last_unstale":"2024-08-31T06:04:16.826424+0000","last_undegraded":"2024-08-31T06:04:16.826424+0000","last_fullsized":"2024-08-31T06:04:16.826424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:21.561089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"72'9","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997237+0000","last_change":"2024-08-31T06:03:15.770625+0000","last_active":"2024-08-31T06:04:16.997237+0000","last_peered":"2024-08-31T06:04:16.997237+0000","last_clean":"2024-08-31T06:04:16.997237+0000","last_became_active":"2024-08-31T06:03:15.770194+0000","last_became_peered":"2024-08-31T06:03:15.770194+0000","last_unstale":"2024-08-31T06:04:16.997237+0000","last_undegraded":"2024-08-31T06:04:16.997237+0000","last_fullsized":"2024-08-31T06:04:16.997237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:33:57.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825884+0000","last_change":"2024-08-31T06:02:28.781606+0000","last_active":"2024-08-31T06:04:16.825884+0000","last_peered":"2024-08-31T06:04:16.825884+0000","last_clean":"2024-08-31T06:04:16.825884+0000","last_became_active":"2024-08-31T06:02:28.780886+0000","last_became_peered":"2024-08-31T06:02:28.780886+0000","last_unstale":"2024-08-31T06:04:16.825884+0000","last_undegraded":"2024-08-31T06:04:16.825884+0000","last_fullsized":"2024-08-31T06:04:16.825884+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:07.540461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433810+0000","last_change":"2024-08-31T06:02:30.604358+0000","last_active":"2024-08-31T06:04:16.433810+0000","last_peered":"2024-08-31T06:04:16.433810+0000","last_clean":"2024-08-31T06:04:16.433810+0000","last_became_active":"2024-08-31T06:02:30.603980+0000","last_became_peered":"2024-08-31T06:02:30.603980+0000","last_unstale":"2024-08-31T06:04:16.433810+0000","last_undegraded":"2024-08-31T06:04:16.433810+0000","last_fullsized":"2024-08-31T06:04:16.433810+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:43:03.062141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'35","reported_seq":297,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:32.848781+0000","last_change":"2024-08-31T06:02:28.590795+0000","last_active":"2024-08-31T06:04:32.848781+0000","last_peered":"2024-08-31T06:04:32.848781+0000","last_clean":"2024-08-31T06:04:32.848781+0000","last_became_active":"2024-08-31T06:02:28.590397+0000","last_became_peered":"2024-08-31T06:02:28.590397+0000","last_unstale":"2024-08-31T06:04:32.848781+0000","last_undegraded":"2024-08-31T06:04:32.848781+0000","last_fullsized":"2024-08-31T06:04:32.848781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:30.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64818,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":181,"num_write":37,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997865+0000","last_change":"2024-08-31T06:02:30.603110+0000","last_active":"2024-08-31T06:04:16.997865+0000","last_peered":"2024-08-31T06:04:16.997865+0000","last_clean":"2024-08-31T06:04:16.997865+0000","last_became_active":"2024-08-31T06:02:30.602691+0000","last_became_peered":"2024-08-31T06:02:30.602691+0000","last_unstale":"2024-08-31T06:04:16.997865+0000","last_undegraded":"2024-08-31T06:04:16.997865+0000","last_fullsized":"2024-08-31T06:04:16.997865+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:20.009202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"70'9","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.449977+0000","last_change":"2024-08-31T06:04:16.449444+0000","last_active":"2024-08-31T06:04:16.449977+0000","last_peered":"2024-08-31T06:04:16.449977+0000","last_clean":"2024-08-31T06:04:16.449977+0000","last_became_active":"2024-08-31T06:04:16.439087+0000","last_became_peered":"2024-08-31T06:04:16.439087+0000","last_unstale":"2024-08-31T06:04:16.449977+0000","last_undegraded":"2024-08-31T06:04:16.449977+0000","last_fullsized":"2024-08-31T06:04:16.449977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:38.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431600+0000","last_change":"2024-08-31T06:02:30.599843+0000","last_active":"2024-08-31T06:04:16.431600+0000","last_peered":"2024-08-31T06:04:16.431600+0000","last_clean":"2024-08-31T06:04:16.431600+0000","last_became_active":"2024-08-31T06:02:30.599440+0000","last_became_peered":"2024-08-31T06:02:30.599440+0000","last_unstale":"2024-08-31T06:04:16.431600+0000","last_undegraded":"2024-08-31T06:04:16.431600+0000","last_fullsized":"2024-08-31T06:04:16.431600+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:01.029482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825714+0000","last_change":"2024-08-31T06:02:28.594178+0000","last_active":"2024-08-31T06:04:16.825714+0000","last_peered":"2024-08-31T06:04:16.825714+0000","last_clean":"2024-08-31T06:04:16.825714+0000","last_became_active":"2024-08-31T06:02:28.593802+0000","last_became_peered":"2024-08-31T06:02:28.593802+0000","last_unstale":"2024-08-31T06:04:16.825714+0000","last_undegraded":"2024-08-31T06:04:16.825714+0000","last_fullsized":"2024-08-31T06:04:16.825714+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:52.561582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826106+0000","last_change":"2024-08-31T06:02:30.595979+0000","last_active":"2024-08-31T06:04:16.826106+0000","last_peered":"2024-08-31T06:04:16.826106+0000","last_clean":"2024-08-31T06:04:16.826106+0000","last_became_active":"2024-08-31T06:02:30.595665+0000","last_became_peered":"2024-08-31T06:02:30.595665+0000","last_unstale":"2024-08-31T06:04:16.826106+0000","last_undegraded":"2024-08-31T06:04:16.826106+0000","last_fullsized":"2024-08-31T06:04:16.826106+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:40.347954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'8","reported_seq":150,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:30.846481+0000","last_change":"2024-08-31T06:02:28.594117+0000","last_active":"2024-08-31T06:04:30.846481+0000","last_peered":"2024-08-31T06:04:30.846481+0000","last_clean":"2024-08-31T06:04:30.846481+0000","last_became_active":"2024-08-31T06:02:28.593721+0000","last_became_peered":"2024-08-31T06:02:28.593721+0000","last_unstale":"2024-08-31T06:04:30.846481+0000","last_undegraded":"2024-08-31T06:04:30.846481+0000","last_fullsized":"2024-08-31T06:04:30.846481+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:48:49.400841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825844+0000","last_change":"2024-08-31T06:02:30.606967+0000","last_active":"2024-08-31T06:04:16.825844+0000","last_peered":"2024-08-31T06:04:16.825844+0000","last_clean":"2024-08-31T06:04:16.825844+0000","last_became_active":"2024-08-31T06:02:30.605730+0000","last_became_peered":"2024-08-31T06:02:30.605730+0000","last_unstale":"2024-08-31T06:04:16.825844+0000","last_undegraded":"2024-08-31T06:04:16.825844+0000","last_fullsized":"2024-08-31T06:04:16.825844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:30.656071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"70'17","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997489+0000","last_change":"2024-08-31T06:02:28.780911+0000","last_active":"2024-08-31T06:04:16.997489+0000","last_peered":"2024-08-31T06:04:16.997489+0000","last_clean":"2024-08-31T06:04:16.997489+0000","last_became_active":"2024-08-31T06:02:28.780375+0000","last_became_peered":"2024-08-31T06:02:28.780375+0000","last_unstale":"2024-08-31T06:04:16.997489+0000","last_undegraded":"2024-08-31T06:04:16.997489+0000","last_fullsized":"2024-08-31T06:04:16.997489+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:46.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825581+0000","last_change":"2024-08-31T06:02:30.606871+0000","last_active":"2024-08-31T06:04:16.825581+0000","last_peered":"2024-08-31T06:04:16.825581+0000","last_clean":"2024-08-31T06:04:16.825581+0000","last_became_active":"2024-08-31T06:02:30.606507+0000","last_became_peered":"2024-08-31T06:02:30.606507+0000","last_unstale":"2024-08-31T06:04:16.825581+0000","last_undegraded":"2024-08-31T06:04:16.825581+0000","last_fullsized":"2024-08-31T06:04:16.825581+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:16:31.502034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998046+0000","last_change":"2024-08-31T06:02:28.588078+0000","last_active":"2024-08-31T06:04:16.998046+0000","last_peered":"2024-08-31T06:04:16.998046+0000","last_clean":"2024-08-31T06:04:16.998046+0000","last_became_active":"2024-08-31T06:02:28.587642+0000","last_became_peered":"2024-08-31T06:02:28.587642+0000","last_unstale":"2024-08-31T06:04:16.998046+0000","last_undegraded":"2024-08-31T06:04:16.998046+0000","last_fullsized":"2024-08-31T06:04:16.998046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:59.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436127+0000","last_change":"2024-08-31T06:02:30.605647+0000","last_active":"2024-08-31T06:04:16.436127+0000","last_peered":"2024-08-31T06:04:16.436127+0000","last_clean":"2024-08-31T06:04:16.436127+0000","last_became_active":"2024-08-31T06:02:30.605267+0000","last_became_peered":"2024-08-31T06:02:30.605267+0000","last_unstale":"2024-08-31T06:04:16.436127+0000","last_undegraded":"2024-08-31T06:04:16.436127+0000","last_fullsized":"2024-08-31T06:04:16.436127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:08:34.741030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"70'5","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431745+0000","last_change":"2024-08-31T06:02:28.585295+0000","last_active":"2024-08-31T06:04:16.431745+0000","last_peered":"2024-08-31T06:04:16.431745+0000","last_clean":"2024-08-31T06:04:16.431745+0000","last_became_active":"2024-08-31T06:02:28.584895+0000","last_became_peered":"2024-08-31T06:02:28.584895+0000","last_unstale":"2024-08-31T06:04:16.431745+0000","last_undegraded":"2024-08-31T06:04:16.431745+0000","last_fullsized":"2024-08-31T06:04:16.431745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:57:12.658937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826465+0000","last_change":"2024-08-31T06:02:30.603593+0000","last_active":"2024-08-31T06:04:16.826465+0000","last_peered":"2024-08-31T06:04:16.826465+0000","last_clean":"2024-08-31T06:04:16.826465+0000","last_became_active":"2024-08-31T06:02:30.603274+0000","last_became_peered":"2024-08-31T06:02:30.603274+0000","last_unstale":"2024-08-31T06:04:16.826465+0000","last_undegraded":"2024-08-31T06:04:16.826465+0000","last_fullsized":"2024-08-31T06:04:16.826465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:07.720406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"70'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825979+0000","last_change":"2024-08-31T06:02:28.586920+0000","last_active":"2024-08-31T06:04:16.825979+0000","last_peered":"2024-08-31T06:04:16.825979+0000","last_clean":"2024-08-31T06:04:16.825979+0000","last_became_active":"2024-08-31T06:02:28.586362+0000","last_became_peered":"2024-08-31T06:02:28.586362+0000","last_unstale":"2024-08-31T06:04:16.825979+0000","last_undegraded":"2024-08-31T06:04:16.825979+0000","last_fullsized":"2024-08-31T06:04:16.825979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:52.065879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826269+0000","last_change":"2024-08-31T06:02:30.603800+0000","last_active":"2024-08-31T06:04:16.826269+0000","last_peered":"2024-08-31T06:04:16.826269+0000","last_clean":"2024-08-31T06:04:16.826269+0000","last_became_active":"2024-08-31T06:02:30.603439+0000","last_became_peered":"2024-08-31T06:02:30.603439+0000","last_unstale":"2024-08-31T06:04:16.826269+0000","last_undegraded":"2024-08-31T06:04:16.826269+0000","last_fullsized":"2024-08-31T06:04:16.826269+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:39.992719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":144,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:28.843608+0000","last_change":"2024-08-31T06:02:28.936404+0000","last_active":"2024-08-31T06:04:28.843608+0000","last_peered":"2024-08-31T06:04:28.843608+0000","last_clean":"2024-08-31T06:04:28.843608+0000","last_became_active":"2024-08-31T06:02:28.935898+0000","last_became_peered":"2024-08-31T06:02:28.935898+0000","last_unstale":"2024-08-31T06:04:28.843608+0000","last_undegraded":"2024-08-31T06:04:28.843608+0000","last_fullsized":"2024-08-31T06:04:28.843608+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:35.004510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826610+0000","last_change":"2024-08-31T06:02:30.608258+0000","last_active":"2024-08-31T06:04:16.826610+0000","last_peered":"2024-08-31T06:04:16.826610+0000","last_clean":"2024-08-31T06:04:16.826610+0000","last_became_active":"2024-08-31T06:02:30.607067+0000","last_became_peered":"2024-08-31T06:02:30.607067+0000","last_unstale":"2024-08-31T06:04:16.826610+0000","last_undegraded":"2024-08-31T06:04:16.826610+0000","last_fullsized":"2024-08-31T06:04:16.826610+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:03:09.362812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":97,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826255+0000","last_change":"2024-08-31T06:01:19.125033+0000","last_active":"2024-08-31T06:04:16.826255+0000","last_peered":"2024-08-31T06:04:16.826255+0000","last_clean":"2024-08-31T06:04:16.826255+0000","last_became_active":"2024-08-31T06:01:19.118469+0000","last_became_peered":"2024-08-31T06:01:19.118469+0000","last_unstale":"2024-08-31T06:04:16.826255+0000","last_undegraded":"2024-08-31T06:04:16.826255+0000","last_fullsized":"2024-08-31T06:04:16.826255+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_clean_scrub_stamp":"2024-08-31T05:58:05.259854+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:33.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"70'6","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826883+0000","last_change":"2024-08-31T06:02:28.588276+0000","last_active":"2024-08-31T06:04:16.826883+0000","last_peered":"2024-08-31T06:04:16.826883+0000","last_clean":"2024-08-31T06:04:16.826883+0000","last_became_active":"2024-08-31T06:02:28.587184+0000","last_became_peered":"2024-08-31T06:02:28.587184+0000","last_unstale":"2024-08-31T06:04:16.826883+0000","last_undegraded":"2024-08-31T06:04:16.826883+0000","last_fullsized":"2024-08-31T06:04:16.826883+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:12.762919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437980+0000","last_change":"2024-08-31T06:02:30.610801+0000","last_active":"2024-08-31T06:04:16.437980+0000","last_peered":"2024-08-31T06:04:16.437980+0000","last_clean":"2024-08-31T06:04:16.437980+0000","last_became_active":"2024-08-31T06:02:30.610446+0000","last_became_peered":"2024-08-31T06:02:30.610446+0000","last_unstale":"2024-08-31T06:04:16.437980+0000","last_undegraded":"2024-08-31T06:04:16.437980+0000","last_fullsized":"2024-08-31T06:04:16.437980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:17.891734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"70'4","reported_seq":43,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826060+0000","last_change":"2024-08-31T06:03:15.777123+0000","last_active":"2024-08-31T06:04:16.826060+0000","last_peered":"2024-08-31T06:04:16.826060+0000","last_clean":"2024-08-31T06:04:16.826060+0000","last_became_active":"2024-08-31T06:03:15.773099+0000","last_became_peered":"2024-08-31T06:03:15.773099+0000","last_unstale":"2024-08-31T06:04:16.826060+0000","last_undegraded":"2024-08-31T06:04:16.826060+0000","last_fullsized":"2024-08-31T06:04:16.826060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:56:51.706692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"72'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431436+0000","last_change":"2024-08-31T06:03:15.776402+0000","last_active":"2024-08-31T06:04:16.431436+0000","last_peered":"2024-08-31T06:04:16.431436+0000","last_clean":"2024-08-31T06:04:16.431436+0000","last_became_active":"2024-08-31T06:03:15.775949+0000","last_became_peered":"2024-08-31T06:03:15.775949+0000","last_unstale":"2024-08-31T06:04:16.431436+0000","last_undegraded":"2024-08-31T06:04:16.431436+0000","last_fullsized":"2024-08-31T06:04:16.431436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:51:34.646125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'6","reported_seq":143,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:29.844395+0000","last_change":"2024-08-31T06:02:28.780419+0000","last_active":"2024-08-31T06:04:29.844395+0000","last_peered":"2024-08-31T06:04:29.844395+0000","last_clean":"2024-08-31T06:04:29.844395+0000","last_became_active":"2024-08-31T06:02:28.779814+0000","last_became_peered":"2024-08-31T06:02:28.779814+0000","last_unstale":"2024-08-31T06:04:29.844395+0000","last_undegraded":"2024-08-31T06:04:29.844395+0000","last_fullsized":"2024-08-31T06:04:29.844395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:36.183841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"72'8","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825689+0000","last_change":"2024-08-31T06:03:15.776468+0000","last_active":"2024-08-31T06:04:16.825689+0000","last_peered":"2024-08-31T06:04:16.825689+0000","last_clean":"2024-08-31T06:04:16.825689+0000","last_became_active":"2024-08-31T06:03:15.776005+0000","last_became_peered":"2024-08-31T06:03:15.776005+0000","last_unstale":"2024-08-31T06:04:16.825689+0000","last_undegraded":"2024-08-31T06:04:16.825689+0000","last_fullsized":"2024-08-31T06:04:16.825689+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:47:36.420584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'6","reported_seq":143,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:28.843052+0000","last_change":"2024-08-31T06:02:28.594220+0000","last_active":"2024-08-31T06:04:28.843052+0000","last_peered":"2024-08-31T06:04:28.843052+0000","last_clean":"2024-08-31T06:04:28.843052+0000","last_became_active":"2024-08-31T06:02:28.593729+0000","last_became_peered":"2024-08-31T06:02:28.593729+0000","last_unstale":"2024-08-31T06:04:28.843052+0000","last_undegraded":"2024-08-31T06:04:28.843052+0000","last_fullsized":"2024-08-31T06:04:28.843052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:37:03.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433754+0000","last_change":"2024-08-31T06:02:30.600008+0000","last_active":"2024-08-31T06:04:16.433754+0000","last_peered":"2024-08-31T06:04:16.433754+0000","last_clean":"2024-08-31T06:04:16.433754+0000","last_became_active":"2024-08-31T06:02:30.599677+0000","last_became_peered":"2024-08-31T06:02:30.599677+0000","last_unstale":"2024-08-31T06:04:16.433754+0000","last_undegraded":"2024-08-31T06:04:16.433754+0000","last_fullsized":"2024-08-31T06:04:16.433754+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:59.520544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"70'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823656+0000","last_change":"2024-08-31T06:02:28.780554+0000","last_active":"2024-08-31T06:04:16.823656+0000","last_peered":"2024-08-31T06:04:16.823656+0000","last_clean":"2024-08-31T06:04:16.823656+0000","last_became_active":"2024-08-31T06:02:28.780137+0000","last_became_peered":"2024-08-31T06:02:28.780137+0000","last_unstale":"2024-08-31T06:04:16.823656+0000","last_undegraded":"2024-08-31T06:04:16.823656+0000","last_fullsized":"2024-08-31T06:04:16.823656+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:57.523667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433847+0000","last_change":"2024-08-31T06:02:30.597438+0000","last_active":"2024-08-31T06:04:16.433847+0000","last_peered":"2024-08-31T06:04:16.433847+0000","last_clean":"2024-08-31T06:04:16.433847+0000","last_became_active":"2024-08-31T06:02:30.597108+0000","last_became_peered":"2024-08-31T06:02:30.597108+0000","last_unstale":"2024-08-31T06:04:16.433847+0000","last_undegraded":"2024-08-31T06:04:16.433847+0000","last_fullsized":"2024-08-31T06:04:16.433847+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:05.238708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"70'4","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998101+0000","last_change":"2024-08-31T06:02:28.781006+0000","last_active":"2024-08-31T06:04:16.998101+0000","last_peered":"2024-08-31T06:04:16.998101+0000","last_clean":"2024-08-31T06:04:16.998101+0000","last_became_active":"2024-08-31T06:02:28.780468+0000","last_became_peered":"2024-08-31T06:02:28.780468+0000","last_unstale":"2024-08-31T06:04:16.998101+0000","last_undegraded":"2024-08-31T06:04:16.998101+0000","last_fullsized":"2024-08-31T06:04:16.998101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:20.206251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431841+0000","last_change":"2024-08-31T06:02:30.600826+0000","last_active":"2024-08-31T06:04:16.431841+0000","last_peered":"2024-08-31T06:04:16.431841+0000","last_clean":"2024-08-31T06:04:16.431841+0000","last_became_active":"2024-08-31T06:02:30.600474+0000","last_became_peered":"2024-08-31T06:02:30.600474+0000","last_unstale":"2024-08-31T06:04:16.431841+0000","last_undegraded":"2024-08-31T06:04:16.431841+0000","last_fullsized":"2024-08-31T06:04:16.431841+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:07.456576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'101","reported_seq":217,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:32.641638+0000","last_change":"2024-08-31T06:02:28.588026+0000","last_active":"2024-08-31T06:04:32.641638+0000","last_peered":"2024-08-31T06:04:32.641638+0000","last_clean":"2024-08-31T06:04:32.641638+0000","last_became_active":"2024-08-31T06:02:28.587759+0000","last_became_peered":"2024-08-31T06:02:28.587759+0000","last_unstale":"2024-08-31T06:04:32.641638+0000","last_undegraded":"2024-08-31T06:04:32.641638+0000","last_fullsized":"2024-08-31T06:04:32.641638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:44.323111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":184,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438064+0000","last_change":"2024-08-31T06:02:30.604375+0000","last_active":"2024-08-31T06:04:16.438064+0000","last_peered":"2024-08-31T06:04:16.438064+0000","last_clean":"2024-08-31T06:04:16.438064+0000","last_became_active":"2024-08-31T06:02:30.604008+0000","last_became_peered":"2024-08-31T06:02:30.604008+0000","last_unstale":"2024-08-31T06:04:16.438064+0000","last_undegraded":"2024-08-31T06:04:16.438064+0000","last_fullsized":"2024-08-31T06:04:16.438064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:37.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"70'7","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827216+0000","last_change":"2024-08-31T06:02:28.936568+0000","last_active":"2024-08-31T06:04:16.827216+0000","last_peered":"2024-08-31T06:04:16.827216+0000","last_clean":"2024-08-31T06:04:16.827216+0000","last_became_active":"2024-08-31T06:02:28.936185+0000","last_became_peered":"2024-08-31T06:02:28.936185+0000","last_unstale":"2024-08-31T06:04:16.827216+0000","last_undegraded":"2024-08-31T06:04:16.827216+0000","last_fullsized":"2024-08-31T06:04:16.827216+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:34.080300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"72'7","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996996+0000","last_change":"2024-08-31T06:03:15.771653+0000","last_active":"2024-08-31T06:04:16.996996+0000","last_peered":"2024-08-31T06:04:16.996996+0000","last_clean":"2024-08-31T06:04:16.996996+0000","last_became_active":"2024-08-31T06:03:15.770903+0000","last_became_peered":"2024-08-31T06:03:15.770903+0000","last_unstale":"2024-08-31T06:04:16.996996+0000","last_undegraded":"2024-08-31T06:04:16.996996+0000","last_fullsized":"2024-08-31T06:04:16.996996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:50.547558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"70'2","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433650+0000","last_change":"2024-08-31T06:03:15.777577+0000","last_active":"2024-08-31T06:04:16.433650+0000","last_peered":"2024-08-31T06:04:16.433650+0000","last_clean":"2024-08-31T06:04:16.433650+0000","last_became_active":"2024-08-31T06:03:15.773006+0000","last_became_peered":"2024-08-31T06:03:15.773006+0000","last_unstale":"2024-08-31T06:04:16.433650+0000","last_undegraded":"2024-08-31T06:04:16.433650+0000","last_fullsized":"2024-08-31T06:04:16.433650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:31.531741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997519+0000","last_change":"2024-08-31T06:02:30.604018+0000","last_active":"2024-08-31T06:04:16.997519+0000","last_peered":"2024-08-31T06:04:16.997519+0000","last_clean":"2024-08-31T06:04:16.997519+0000","last_became_active":"2024-08-31T06:02:30.603411+0000","last_became_peered":"2024-08-31T06:02:30.603411+0000","last_unstale":"2024-08-31T06:04:16.997519+0000","last_undegraded":"2024-08-31T06:04:16.997519+0000","last_fullsized":"2024-08-31T06:04:16.997519+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:34:30.732954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437921+0000","last_change":"2024-08-31T06:02:28.586348+0000","last_active":"2024-08-31T06:04:16.437921+0000","last_peered":"2024-08-31T06:04:16.437921+0000","last_clean":"2024-08-31T06:04:16.437921+0000","last_became_active":"2024-08-31T06:02:28.586046+0000","last_became_peered":"2024-08-31T06:02:28.586046+0000","last_unstale":"2024-08-31T06:04:16.437921+0000","last_undegraded":"2024-08-31T06:04:16.437921+0000","last_fullsized":"2024-08-31T06:04:16.437921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:30.987232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435839+0000","last_change":"2024-08-31T06:02:30.616402+0000","last_active":"2024-08-31T06:04:16.435839+0000","last_peered":"2024-08-31T06:04:16.435839+0000","last_clean":"2024-08-31T06:04:16.435839+0000","last_became_active":"2024-08-31T06:02:30.616014+0000","last_became_peered":"2024-08-31T06:02:30.616014+0000","last_unstale":"2024-08-31T06:04:16.435839+0000","last_undegraded":"2024-08-31T06:04:16.435839+0000","last_fullsized":"2024-08-31T06:04:16.435839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:42.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438077+0000","last_change":"2024-08-31T06:02:28.590184+0000","last_active":"2024-08-31T06:04:16.438077+0000","last_peered":"2024-08-31T06:04:16.438077+0000","last_clean":"2024-08-31T06:04:16.438077+0000","last_became_active":"2024-08-31T06:02:28.588830+0000","last_became_peered":"2024-08-31T06:02:28.588830+0000","last_unstale":"2024-08-31T06:04:16.438077+0000","last_undegraded":"2024-08-31T06:04:16.438077+0000","last_fullsized":"2024-08-31T06:04:16.438077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:03.072197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438070+0000","last_change":"2024-08-31T06:02:30.597262+0000","last_active":"2024-08-31T06:04:16.438070+0000","last_peered":"2024-08-31T06:04:16.438070+0000","last_clean":"2024-08-31T06:04:16.438070+0000","last_became_active":"2024-08-31T06:02:30.596862+0000","last_became_peered":"2024-08-31T06:02:30.596862+0000","last_unstale":"2024-08-31T06:04:16.438070+0000","last_undegraded":"2024-08-31T06:04:16.438070+0000","last_fullsized":"2024-08-31T06:04:16.438070+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:46:29.378532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"70'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997626+0000","last_change":"2024-08-31T06:02:28.594161+0000","last_active":"2024-08-31T06:04:16.997626+0000","last_peered":"2024-08-31T06:04:16.997626+0000","last_clean":"2024-08-31T06:04:16.997626+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.997626+0000","last_undegraded":"2024-08-31T06:04:16.997626+0000","last_fullsized":"2024-08-31T06:04:16.997626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:31:17.941172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826133+0000","last_change":"2024-08-31T06:02:30.595194+0000","last_active":"2024-08-31T06:04:16.826133+0000","last_peered":"2024-08-31T06:04:16.826133+0000","last_clean":"2024-08-31T06:04:16.826133+0000","last_became_active":"2024-08-31T06:02:30.594812+0000","last_became_peered":"2024-08-31T06:02:30.594812+0000","last_unstale":"2024-08-31T06:04:16.826133+0000","last_undegraded":"2024-08-31T06:04:16.826133+0000","last_fullsized":"2024-08-31T06:04:16.826133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:03.224924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825830+0000","last_change":"2024-08-31T06:02:30.615776+0000","last_active":"2024-08-31T06:04:16.825830+0000","last_peered":"2024-08-31T06:04:16.825830+0000","last_clean":"2024-08-31T06:04:16.825830+0000","last_became_active":"2024-08-31T06:02:30.615385+0000","last_became_peered":"2024-08-31T06:02:30.615385+0000","last_unstale":"2024-08-31T06:04:16.825830+0000","last_undegraded":"2024-08-31T06:04:16.825830+0000","last_fullsized":"2024-08-31T06:04:16.825830+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:49.685443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997930+0000","last_change":"2024-08-31T06:02:28.591064+0000","last_active":"2024-08-31T06:04:16.997930+0000","last_peered":"2024-08-31T06:04:16.997930+0000","last_clean":"2024-08-31T06:04:16.997930+0000","last_became_active":"2024-08-31T06:02:28.590643+0000","last_became_peered":"2024-08-31T06:02:28.590643+0000","last_unstale":"2024-08-31T06:04:16.997930+0000","last_undegraded":"2024-08-31T06:04:16.997930+0000","last_fullsized":"2024-08-31T06:04:16.997930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:01.953317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433533+0000","last_change":"2024-08-31T06:02:30.600532+0000","last_active":"2024-08-31T06:04:16.433533+0000","last_peered":"2024-08-31T06:04:16.433533+0000","last_clean":"2024-08-31T06:04:16.433533+0000","last_became_active":"2024-08-31T06:02:30.600013+0000","last_became_peered":"2024-08-31T06:02:30.600013+0000","last_unstale":"2024-08-31T06:04:16.433533+0000","last_undegraded":"2024-08-31T06:04:16.433533+0000","last_fullsized":"2024-08-31T06:04:16.433533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:38.753206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"70'12","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998027+0000","last_change":"2024-08-31T06:02:28.593921+0000","last_active":"2024-08-31T06:04:16.998027+0000","last_peered":"2024-08-31T06:04:16.998027+0000","last_clean":"2024-08-31T06:04:16.998027+0000","last_became_active":"2024-08-31T06:02:28.593102+0000","last_became_peered":"2024-08-31T06:02:28.593102+0000","last_unstale":"2024-08-31T06:04:16.998027+0000","last_undegraded":"2024-08-31T06:04:16.998027+0000","last_fullsized":"2024-08-31T06:04:16.998027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:30:35.791686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997199+0000","last_change":"2024-08-31T06:02:30.606524+0000","last_active":"2024-08-31T06:04:16.997199+0000","last_peered":"2024-08-31T06:04:16.997199+0000","last_clean":"2024-08-31T06:04:16.997199+0000","last_became_active":"2024-08-31T06:02:30.606132+0000","last_became_peered":"2024-08-31T06:02:30.606132+0000","last_unstale":"2024-08-31T06:04:16.997199+0000","last_undegraded":"2024-08-31T06:04:16.997199+0000","last_fullsized":"2024-08-31T06:04:16.997199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:46.566811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"70'2","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438165+0000","last_change":"2024-08-31T06:02:28.780596+0000","last_active":"2024-08-31T06:04:16.438165+0000","last_peered":"2024-08-31T06:04:16.438165+0000","last_clean":"2024-08-31T06:04:16.438165+0000","last_became_active":"2024-08-31T06:02:28.779908+0000","last_became_peered":"2024-08-31T06:02:28.779908+0000","last_unstale":"2024-08-31T06:04:16.438165+0000","last_undegraded":"2024-08-31T06:04:16.438165+0000","last_fullsized":"2024-08-31T06:04:16.438165+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:01.254340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"72'5","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823599+0000","last_change":"2024-08-31T06:03:15.776271+0000","last_active":"2024-08-31T06:04:16.823599+0000","last_peered":"2024-08-31T06:04:16.823599+0000","last_clean":"2024-08-31T06:04:16.823599+0000","last_became_active":"2024-08-31T06:03:15.775821+0000","last_became_peered":"2024-08-31T06:03:15.775821+0000","last_unstale":"2024-08-31T06:04:16.823599+0000","last_undegraded":"2024-08-31T06:04:16.823599+0000","last_fullsized":"2024-08-31T06:04:16.823599+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:52:34.076554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"74'14","reported_seq":155,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:32.848756+0000","last_change":"2024-08-31T06:02:28.593773+0000","last_active":"2024-08-31T06:04:32.848756+0000","last_peered":"2024-08-31T06:04:32.848756+0000","last_clean":"2024-08-31T06:04:32.848756+0000","last_became_active":"2024-08-31T06:02:28.593511+0000","last_became_peered":"2024-08-31T06:02:28.593511+0000","last_unstale":"2024-08-31T06:04:32.848756+0000","last_undegraded":"2024-08-31T06:04:32.848756+0000","last_fullsized":"2024-08-31T06:04:32.848756+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:01:50.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":467492,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":1452,"num_read_kb":930,"num_write":420,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2551808,"data_stored":2190028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906981,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070508,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37296,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707856,"statfs":{"total":95995035648,"available":95956844544,"internally_reserved":0,"allocated":1937408,"data_stored":1465699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928234032,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40728,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704424,"statfs":{"total":95995035648,"available":95953330176,"internally_reserved":0,"allocated":1253376,"data_stored":808197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397558,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36564,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708588,"statfs":{"total":95995035648,"available":95957594112,"internally_reserved":0,"allocated":1249280,"data_stored":808575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593785,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1454080,"data_stored":1010029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757310,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953538,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28456,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716696,"statfs":{"total":95995035648,"available":95965896704,"internally_reserved":0,"allocated":1466368,"data_stored":1008189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084360,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":415584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28696,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716456,"statfs":{"total":95995035648,"available":95965650944,"internally_reserved":0,"allocated":1650688,"data_stored":1201515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":482099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":480922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":864256,"data_stored":416530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":787422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":461355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:04:35.749 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:04:36.004 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:36.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.484+0000 7f6be35f7640 1 -- 172.21.15.53:0/1572602795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc108140 msgr2=0x7f6bdc108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:36.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.484+0000 7f6be35f7640 1 --2- 172.21.15.53:0/1572602795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc108140 0x7f6bdc108550 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009900 tx=0x7f6bcc02a410 comp rx=0 tx=0).stop 2024-08-31T06:04:36.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.484+0000 7f6be35f7640 1 -- 172.21.15.53:0/1572602795 shutdown_connections 2024-08-31T06:04:36.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.484+0000 7f6be35f7640 1 --2- 172.21.15.53:0/1572602795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bdc108a90 0x7f6bdc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:36.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.484+0000 7f6be35f7640 1 --2- 172.21.15.53:0/1572602795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc108140 0x7f6bdc108550 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:36.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.484+0000 7f6be35f7640 1 --2- 172.21.15.53:0/1572602795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bdc102800 0x7f6bdc102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:36.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.484+0000 7f6be35f7640 1 -- 172.21.15.53:0/1572602795 >> 172.21.15.53:0/1572602795 conn(0x7f6bdc0794d0 msgr2=0x7f6bdc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:36.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.484+0000 7f6be35f7640 1 -- 172.21.15.53:0/1572602795 shutdown_connections 2024-08-31T06:04:36.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.484+0000 7f6be35f7640 1 -- 172.21.15.53:0/1572602795 wait complete. 2024-08-31T06:04:36.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be35f7640 1 Processor -- start 2024-08-31T06:04:36.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be35f7640 1 -- start start 2024-08-31T06:04:36.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be35f7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bdc102800 0x7f6bdc19afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:36.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be35f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc108140 0x7f6bdc19b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:36.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be35f7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bdc108a90 0x7f6bdc19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:36.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be35f7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc112590 con 0x7f6bdc108140 2024-08-31T06:04:36.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be35f7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc112410 con 0x7f6bdc108a90 2024-08-31T06:04:36.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be35f7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc112710 con 0x7f6bdc102800 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be0b92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc108140 0x7f6bdc19b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be0b92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc108140 0x7f6bdc19b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40566/0 (socket says 172.21.15.53:40566) 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be0b92640 1 -- 172.21.15.53:0/47910965 learned_addr learned my addr 172.21.15.53:0/47910965 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be1393640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bdc102800 0x7f6bdc19afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.485+0000 7f6be1b94640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bdc108a90 0x7f6bdc19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.486+0000 7f6be0b92640 1 -- 172.21.15.53:0/47910965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bdc102800 msgr2=0x7f6bdc19afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.486+0000 7f6be0b92640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bdc102800 0x7f6bdc19afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.486+0000 7f6be0b92640 1 -- 172.21.15.53:0/47910965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bdc108a90 msgr2=0x7f6bdc19ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.486+0000 7f6be0b92640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bdc108a90 0x7f6bdc19ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.486+0000 7f6be0b92640 1 -- 172.21.15.53:0/47910965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bdc1a6250 con 0x7f6bdc108140 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.486+0000 7f6be0b92640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc108140 0x7f6bdc19b500 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc005940 tx=0x7f6bcc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.486+0000 7f6bd27fc640 1 -- 172.21.15.53:0/47910965 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc03f030 con 0x7f6bdc108140 2024-08-31T06:04:36.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.486+0000 7f6bd27fc640 1 -- 172.21.15.53:0/47910965 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bcc004440 con 0x7f6bdc108140 2024-08-31T06:04:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.486+0000 7f6be35f7640 1 -- 172.21.15.53:0/47910965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bdc1a64e0 con 0x7f6bdc108140 2024-08-31T06:04:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.486+0000 7f6bd27fc640 1 -- 172.21.15.53:0/47910965 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc035070 con 0x7f6bdc108140 2024-08-31T06:04:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.486+0000 7f6be35f7640 1 -- 172.21.15.53:0/47910965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bdc1a69c0 con 0x7f6bdc108140 2024-08-31T06:04:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.487+0000 7f6be35f7640 1 -- 172.21.15.53:0/47910965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bdc102c10 con 0x7f6bdc108140 2024-08-31T06:04:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.489+0000 7f6bd27fc640 1 -- 172.21.15.53:0/47910965 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f6bcc042030 con 0x7f6bdc108140 2024-08-31T06:04:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.490+0000 7f6bd27fc640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6bc80b4c40 0x7f6bc80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.491+0000 7f6be1393640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6bc80b4c40 0x7f6bc80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:36.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.491+0000 7f6bd27fc640 1 -- 172.21.15.53:0/47910965 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f6bcc105d30 con 0x7f6bdc108140 2024-08-31T06:04:36.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.491+0000 7f6be1393640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6bc80b4c40 0x7f6bc80b7150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc06b760 tx=0x7f6bd800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:36.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.493+0000 7f6bd27fc640 1 -- 172.21.15.53:0/47910965 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6bcc0ccb80 con 0x7f6bdc108140 2024-08-31T06:04:36.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.677+0000 7f6be35f7640 1 -- 172.21.15.53:0/47910965 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6bdc10a8e0 con 0x7f6bc80b4c40 2024-08-31T06:04:36.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.682+0000 7f6bd27fc640 1 -- 172.21.15.53:0/47910965 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258941 (secure 0 0 0) 0x7f6bdc10a8e0 con 0x7f6bc80b4c40 2024-08-31T06:04:36.686 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:36.687 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-08-31T06:04:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 -- 172.21.15.53:0/47910965 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6bc80b4c40 msgr2=0x7f6bc80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6bc80b4c40 0x7f6bc80b7150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc06b760 tx=0x7f6bd800b390 comp rx=0 tx=0).stop 2024-08-31T06:04:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 -- 172.21.15.53:0/47910965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc108140 msgr2=0x7f6bdc19b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc108140 0x7f6bdc19b500 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc005940 tx=0x7f6bcc004040 comp rx=0 tx=0).stop 2024-08-31T06:04:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 -- 172.21.15.53:0/47910965 shutdown_connections 2024-08-31T06:04:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6bc80b4c40 0x7f6bc80b7150 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bdc108a90 0x7f6bdc19ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc108140 0x7f6bdc19b500 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 --2- 172.21.15.53:0/47910965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bdc102800 0x7f6bdc19afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 -- 172.21.15.53:0/47910965 >> 172.21.15.53:0/47910965 conn(0x7f6bdc0794d0 msgr2=0x7f6bdc105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:36.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 -- 172.21.15.53:0/47910965 shutdown_connections 2024-08-31T06:04:36.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:36.685+0000 7f6be35f7640 1 -- 172.21.15.53:0/47910965 wait complete. 2024-08-31T06:04:37.506 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-08-31T06:04:36.368484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1451870,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1585,"num_read_kb":1035,"num_write":615,"num_write_kb":4396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2951908,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":965,"ondisk_log_size":965,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":397024,"kb_used_data":14292,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544800,"statfs":{"total":1151940427776,"available":1151533875200,"internally_reserved":0,"allocated":14635008,"data_stored":9321918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":391492922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":792785,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":460,"num_read_kb":364,"num_write":230,"num_write_kb":2097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003142"},"pg_stats":[{"pgid":"3.3f","version":"72'8","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436231+0000","last_change":"2024-08-31T06:02:30.611733+0000","last_active":"2024-08-31T06:04:16.436231+0000","last_peered":"2024-08-31T06:04:16.436231+0000","last_clean":"2024-08-31T06:04:16.436231+0000","last_became_active":"2024-08-31T06:02:30.610339+0000","last_became_peered":"2024-08-31T06:02:30.610339+0000","last_unstale":"2024-08-31T06:04:16.436231+0000","last_undegraded":"2024-08-31T06:04:16.436231+0000","last_fullsized":"2024-08-31T06:04:16.436231+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:20.628524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996993+0000","last_change":"2024-08-31T06:02:30.604550+0000","last_active":"2024-08-31T06:04:16.996993+0000","last_peered":"2024-08-31T06:04:16.996993+0000","last_clean":"2024-08-31T06:04:16.996993+0000","last_became_active":"2024-08-31T06:02:30.604200+0000","last_became_peered":"2024-08-31T06:02:30.604200+0000","last_unstale":"2024-08-31T06:04:16.996993+0000","last_undegraded":"2024-08-31T06:04:16.996993+0000","last_fullsized":"2024-08-31T06:04:16.996993+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:31.191972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997029+0000","last_change":"2024-08-31T06:02:30.606102+0000","last_active":"2024-08-31T06:04:16.997029+0000","last_peered":"2024-08-31T06:04:16.997029+0000","last_clean":"2024-08-31T06:04:16.997029+0000","last_became_active":"2024-08-31T06:02:30.605738+0000","last_became_peered":"2024-08-31T06:02:30.605738+0000","last_unstale":"2024-08-31T06:04:16.997029+0000","last_undegraded":"2024-08-31T06:04:16.997029+0000","last_fullsized":"2024-08-31T06:04:16.997029+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:50:34.993218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"72'8","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827148+0000","last_change":"2024-08-31T06:02:30.603207+0000","last_active":"2024-08-31T06:04:16.827148+0000","last_peered":"2024-08-31T06:04:16.827148+0000","last_clean":"2024-08-31T06:04:16.827148+0000","last_became_active":"2024-08-31T06:02:30.602829+0000","last_became_peered":"2024-08-31T06:02:30.602829+0000","last_unstale":"2024-08-31T06:04:16.827148+0000","last_undegraded":"2024-08-31T06:04:16.827148+0000","last_fullsized":"2024-08-31T06:04:16.827148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:02.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997618+0000","last_change":"2024-08-31T06:02:30.590760+0000","last_active":"2024-08-31T06:04:16.997618+0000","last_peered":"2024-08-31T06:04:16.997618+0000","last_clean":"2024-08-31T06:04:16.997618+0000","last_became_active":"2024-08-31T06:02:30.590198+0000","last_became_peered":"2024-08-31T06:02:30.590198+0000","last_unstale":"2024-08-31T06:04:16.997618+0000","last_undegraded":"2024-08-31T06:04:16.997618+0000","last_fullsized":"2024-08-31T06:04:16.997618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:50.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433579+0000","last_change":"2024-08-31T06:02:30.599924+0000","last_active":"2024-08-31T06:04:16.433579+0000","last_peered":"2024-08-31T06:04:16.433579+0000","last_clean":"2024-08-31T06:04:16.433579+0000","last_became_active":"2024-08-31T06:02:30.599566+0000","last_became_peered":"2024-08-31T06:02:30.599566+0000","last_unstale":"2024-08-31T06:04:16.433579+0000","last_undegraded":"2024-08-31T06:04:16.433579+0000","last_fullsized":"2024-08-31T06:04:16.433579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:58.265673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"72'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826124+0000","last_change":"2024-08-31T06:03:15.771521+0000","last_active":"2024-08-31T06:04:16.826124+0000","last_peered":"2024-08-31T06:04:16.826124+0000","last_clean":"2024-08-31T06:04:16.826124+0000","last_became_active":"2024-08-31T06:03:15.770969+0000","last_became_peered":"2024-08-31T06:03:15.770969+0000","last_unstale":"2024-08-31T06:04:16.826124+0000","last_undegraded":"2024-08-31T06:04:16.826124+0000","last_fullsized":"2024-08-31T06:04:16.826124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:31.724213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437763+0000","last_change":"2024-08-31T06:02:30.610057+0000","last_active":"2024-08-31T06:04:16.437763+0000","last_peered":"2024-08-31T06:04:16.437763+0000","last_clean":"2024-08-31T06:04:16.437763+0000","last_became_active":"2024-08-31T06:02:30.609654+0000","last_became_peered":"2024-08-31T06:02:30.609654+0000","last_unstale":"2024-08-31T06:04:16.437763+0000","last_undegraded":"2024-08-31T06:04:16.437763+0000","last_fullsized":"2024-08-31T06:04:16.437763+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:32:14.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435055+0000","last_change":"2024-08-31T06:02:30.606437+0000","last_active":"2024-08-31T06:04:16.435055+0000","last_peered":"2024-08-31T06:04:16.435055+0000","last_clean":"2024-08-31T06:04:16.435055+0000","last_became_active":"2024-08-31T06:02:30.605632+0000","last_became_peered":"2024-08-31T06:02:30.605632+0000","last_unstale":"2024-08-31T06:04:16.435055+0000","last_undegraded":"2024-08-31T06:04:16.435055+0000","last_fullsized":"2024-08-31T06:04:16.435055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:47.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"72'16","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434609+0000","last_change":"2024-08-31T06:02:30.605456+0000","last_active":"2024-08-31T06:04:16.434609+0000","last_peered":"2024-08-31T06:04:16.434609+0000","last_clean":"2024-08-31T06:04:16.434609+0000","last_became_active":"2024-08-31T06:02:30.604927+0000","last_became_peered":"2024-08-31T06:02:30.604927+0000","last_unstale":"2024-08-31T06:04:16.434609+0000","last_undegraded":"2024-08-31T06:04:16.434609+0000","last_fullsized":"2024-08-31T06:04:16.434609+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:30.340609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826434+0000","last_change":"2024-08-31T06:02:30.608595+0000","last_active":"2024-08-31T06:04:16.826434+0000","last_peered":"2024-08-31T06:04:16.826434+0000","last_clean":"2024-08-31T06:04:16.826434+0000","last_became_active":"2024-08-31T06:02:30.607695+0000","last_became_peered":"2024-08-31T06:02:30.607695+0000","last_unstale":"2024-08-31T06:04:16.826434+0000","last_undegraded":"2024-08-31T06:04:16.826434+0000","last_fullsized":"2024-08-31T06:04:16.826434+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:44:53.655598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827095+0000","last_change":"2024-08-31T06:02:30.595775+0000","last_active":"2024-08-31T06:04:16.827095+0000","last_peered":"2024-08-31T06:04:16.827095+0000","last_clean":"2024-08-31T06:04:16.827095+0000","last_became_active":"2024-08-31T06:02:30.595424+0000","last_became_peered":"2024-08-31T06:02:30.595424+0000","last_unstale":"2024-08-31T06:04:16.827095+0000","last_undegraded":"2024-08-31T06:04:16.827095+0000","last_fullsized":"2024-08-31T06:04:16.827095+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:56.382633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431879+0000","last_change":"2024-08-31T06:02:30.603465+0000","last_active":"2024-08-31T06:04:16.431879+0000","last_peered":"2024-08-31T06:04:16.431879+0000","last_clean":"2024-08-31T06:04:16.431879+0000","last_became_active":"2024-08-31T06:02:30.603041+0000","last_became_peered":"2024-08-31T06:02:30.603041+0000","last_unstale":"2024-08-31T06:04:16.431879+0000","last_undegraded":"2024-08-31T06:04:16.431879+0000","last_fullsized":"2024-08-31T06:04:16.431879+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:19:00.139973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996811+0000","last_change":"2024-08-31T06:02:30.593807+0000","last_active":"2024-08-31T06:04:16.996811+0000","last_peered":"2024-08-31T06:04:16.996811+0000","last_clean":"2024-08-31T06:04:16.996811+0000","last_became_active":"2024-08-31T06:02:30.593389+0000","last_became_peered":"2024-08-31T06:02:30.593389+0000","last_unstale":"2024-08-31T06:04:16.996811+0000","last_undegraded":"2024-08-31T06:04:16.996811+0000","last_fullsized":"2024-08-31T06:04:16.996811+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:01:04.398867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996779+0000","last_change":"2024-08-31T06:02:30.605207+0000","last_active":"2024-08-31T06:04:16.996779+0000","last_peered":"2024-08-31T06:04:16.996779+0000","last_clean":"2024-08-31T06:04:16.996779+0000","last_became_active":"2024-08-31T06:02:30.604866+0000","last_became_peered":"2024-08-31T06:02:30.604866+0000","last_unstale":"2024-08-31T06:04:16.996779+0000","last_undegraded":"2024-08-31T06:04:16.996779+0000","last_fullsized":"2024-08-31T06:04:16.996779+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:56.305638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433428+0000","last_change":"2024-08-31T06:02:30.601457+0000","last_active":"2024-08-31T06:04:16.433428+0000","last_peered":"2024-08-31T06:04:16.433428+0000","last_clean":"2024-08-31T06:04:16.433428+0000","last_became_active":"2024-08-31T06:02:30.601077+0000","last_became_peered":"2024-08-31T06:02:30.601077+0000","last_unstale":"2024-08-31T06:04:16.433428+0000","last_undegraded":"2024-08-31T06:04:16.433428+0000","last_fullsized":"2024-08-31T06:04:16.433428+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:51:42.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436274+0000","last_change":"2024-08-31T06:02:30.612475+0000","last_active":"2024-08-31T06:04:16.436274+0000","last_peered":"2024-08-31T06:04:16.436274+0000","last_clean":"2024-08-31T06:04:16.436274+0000","last_became_active":"2024-08-31T06:02:30.612088+0000","last_became_peered":"2024-08-31T06:02:30.612088+0000","last_unstale":"2024-08-31T06:04:16.436274+0000","last_undegraded":"2024-08-31T06:04:16.436274+0000","last_fullsized":"2024-08-31T06:04:16.436274+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:34.348645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823774+0000","last_change":"2024-08-31T06:02:30.605612+0000","last_active":"2024-08-31T06:04:16.823774+0000","last_peered":"2024-08-31T06:04:16.823774+0000","last_clean":"2024-08-31T06:04:16.823774+0000","last_became_active":"2024-08-31T06:02:30.605271+0000","last_became_peered":"2024-08-31T06:02:30.605271+0000","last_unstale":"2024-08-31T06:04:16.823774+0000","last_undegraded":"2024-08-31T06:04:16.823774+0000","last_fullsized":"2024-08-31T06:04:16.823774+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:38.003500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438194+0000","last_change":"2024-08-31T06:02:30.610328+0000","last_active":"2024-08-31T06:04:16.438194+0000","last_peered":"2024-08-31T06:04:16.438194+0000","last_clean":"2024-08-31T06:04:16.438194+0000","last_became_active":"2024-08-31T06:02:30.609935+0000","last_became_peered":"2024-08-31T06:02:30.609935+0000","last_unstale":"2024-08-31T06:04:16.438194+0000","last_undegraded":"2024-08-31T06:04:16.438194+0000","last_fullsized":"2024-08-31T06:04:16.438194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:22.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435885+0000","last_change":"2024-08-31T06:02:30.609207+0000","last_active":"2024-08-31T06:04:16.435885+0000","last_peered":"2024-08-31T06:04:16.435885+0000","last_clean":"2024-08-31T06:04:16.435885+0000","last_became_active":"2024-08-31T06:02:30.608635+0000","last_became_peered":"2024-08-31T06:02:30.608635+0000","last_unstale":"2024-08-31T06:04:16.435885+0000","last_undegraded":"2024-08-31T06:04:16.435885+0000","last_fullsized":"2024-08-31T06:04:16.435885+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:43.898073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431972+0000","last_change":"2024-08-31T06:02:30.595829+0000","last_active":"2024-08-31T06:04:16.431972+0000","last_peered":"2024-08-31T06:04:16.431972+0000","last_clean":"2024-08-31T06:04:16.431972+0000","last_became_active":"2024-08-31T06:02:30.595427+0000","last_became_peered":"2024-08-31T06:02:30.595427+0000","last_unstale":"2024-08-31T06:04:16.431972+0000","last_undegraded":"2024-08-31T06:04:16.431972+0000","last_fullsized":"2024-08-31T06:04:16.431972+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:09:39.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433777+0000","last_change":"2024-08-31T06:02:30.599513+0000","last_active":"2024-08-31T06:04:16.433777+0000","last_peered":"2024-08-31T06:04:16.433777+0000","last_clean":"2024-08-31T06:04:16.433777+0000","last_became_active":"2024-08-31T06:02:30.599195+0000","last_became_peered":"2024-08-31T06:02:30.599195+0000","last_unstale":"2024-08-31T06:04:16.433777+0000","last_undegraded":"2024-08-31T06:04:16.433777+0000","last_fullsized":"2024-08-31T06:04:16.433777+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:26.669658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437790+0000","last_change":"2024-08-31T06:02:30.609229+0000","last_active":"2024-08-31T06:04:16.437790+0000","last_peered":"2024-08-31T06:04:16.437790+0000","last_clean":"2024-08-31T06:04:16.437790+0000","last_became_active":"2024-08-31T06:02:30.608536+0000","last_became_peered":"2024-08-31T06:02:30.608536+0000","last_unstale":"2024-08-31T06:04:16.437790+0000","last_undegraded":"2024-08-31T06:04:16.437790+0000","last_fullsized":"2024-08-31T06:04:16.437790+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:08.917901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825521+0000","last_change":"2024-08-31T06:02:30.603663+0000","last_active":"2024-08-31T06:04:16.825521+0000","last_peered":"2024-08-31T06:04:16.825521+0000","last_clean":"2024-08-31T06:04:16.825521+0000","last_became_active":"2024-08-31T06:02:30.603220+0000","last_became_peered":"2024-08-31T06:02:30.603220+0000","last_unstale":"2024-08-31T06:04:16.825521+0000","last_undegraded":"2024-08-31T06:04:16.825521+0000","last_fullsized":"2024-08-31T06:04:16.825521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:09.433078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438040+0000","last_change":"2024-08-31T06:02:30.608474+0000","last_active":"2024-08-31T06:04:16.438040+0000","last_peered":"2024-08-31T06:04:16.438040+0000","last_clean":"2024-08-31T06:04:16.438040+0000","last_became_active":"2024-08-31T06:02:30.608118+0000","last_became_peered":"2024-08-31T06:02:30.608118+0000","last_unstale":"2024-08-31T06:04:16.438040+0000","last_undegraded":"2024-08-31T06:04:16.438040+0000","last_fullsized":"2024-08-31T06:04:16.438040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:55.124001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438523+0000","last_change":"2024-08-31T06:02:30.614255+0000","last_active":"2024-08-31T06:04:16.438523+0000","last_peered":"2024-08-31T06:04:16.438523+0000","last_clean":"2024-08-31T06:04:16.438523+0000","last_became_active":"2024-08-31T06:02:30.613805+0000","last_became_peered":"2024-08-31T06:02:30.613805+0000","last_unstale":"2024-08-31T06:04:16.438523+0000","last_undegraded":"2024-08-31T06:04:16.438523+0000","last_fullsized":"2024-08-31T06:04:16.438523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.892997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436018+0000","last_change":"2024-08-31T06:02:30.609877+0000","last_active":"2024-08-31T06:04:16.436018+0000","last_peered":"2024-08-31T06:04:16.436018+0000","last_clean":"2024-08-31T06:04:16.436018+0000","last_became_active":"2024-08-31T06:02:30.608805+0000","last_became_peered":"2024-08-31T06:02:30.608805+0000","last_unstale":"2024-08-31T06:04:16.436018+0000","last_undegraded":"2024-08-31T06:04:16.436018+0000","last_fullsized":"2024-08-31T06:04:16.436018+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:52.172745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431812+0000","last_change":"2024-08-31T06:02:30.594684+0000","last_active":"2024-08-31T06:04:16.431812+0000","last_peered":"2024-08-31T06:04:16.431812+0000","last_clean":"2024-08-31T06:04:16.431812+0000","last_became_active":"2024-08-31T06:02:30.594293+0000","last_became_peered":"2024-08-31T06:02:30.594293+0000","last_unstale":"2024-08-31T06:04:16.431812+0000","last_undegraded":"2024-08-31T06:04:16.431812+0000","last_fullsized":"2024-08-31T06:04:16.431812+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:58:39.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997035+0000","last_change":"2024-08-31T06:02:30.602765+0000","last_active":"2024-08-31T06:04:16.997035+0000","last_peered":"2024-08-31T06:04:16.997035+0000","last_clean":"2024-08-31T06:04:16.997035+0000","last_became_active":"2024-08-31T06:02:30.602410+0000","last_became_peered":"2024-08-31T06:02:30.602410+0000","last_unstale":"2024-08-31T06:04:16.997035+0000","last_undegraded":"2024-08-31T06:04:16.997035+0000","last_fullsized":"2024-08-31T06:04:16.997035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:12.370967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"72'8","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438071+0000","last_change":"2024-08-31T06:02:30.611818+0000","last_active":"2024-08-31T06:04:16.438071+0000","last_peered":"2024-08-31T06:04:16.438071+0000","last_clean":"2024-08-31T06:04:16.438071+0000","last_became_active":"2024-08-31T06:02:30.610917+0000","last_became_peered":"2024-08-31T06:02:30.610917+0000","last_unstale":"2024-08-31T06:04:16.438071+0000","last_undegraded":"2024-08-31T06:04:16.438071+0000","last_fullsized":"2024-08-31T06:04:16.438071+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:00.895825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"72'12","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438398+0000","last_change":"2024-08-31T06:02:30.612186+0000","last_active":"2024-08-31T06:04:16.438398+0000","last_peered":"2024-08-31T06:04:16.438398+0000","last_clean":"2024-08-31T06:04:16.438398+0000","last_became_active":"2024-08-31T06:02:30.610496+0000","last_became_peered":"2024-08-31T06:02:30.610496+0000","last_unstale":"2024-08-31T06:04:16.438398+0000","last_undegraded":"2024-08-31T06:04:16.438398+0000","last_fullsized":"2024-08-31T06:04:16.438398+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:48:19.954998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"72'9","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435818+0000","last_change":"2024-08-31T06:03:15.776507+0000","last_active":"2024-08-31T06:04:16.435818+0000","last_peered":"2024-08-31T06:04:16.435818+0000","last_clean":"2024-08-31T06:04:16.435818+0000","last_became_active":"2024-08-31T06:03:15.776039+0000","last_became_peered":"2024-08-31T06:03:15.776039+0000","last_unstale":"2024-08-31T06:04:16.435818+0000","last_undegraded":"2024-08-31T06:04:16.435818+0000","last_fullsized":"2024-08-31T06:04:16.435818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:41.616112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997530+0000","last_change":"2024-08-31T06:02:30.607864+0000","last_active":"2024-08-31T06:04:16.997530+0000","last_peered":"2024-08-31T06:04:16.997530+0000","last_clean":"2024-08-31T06:04:16.997530+0000","last_became_active":"2024-08-31T06:02:30.607299+0000","last_became_peered":"2024-08-31T06:02:30.607299+0000","last_unstale":"2024-08-31T06:04:16.997530+0000","last_undegraded":"2024-08-31T06:04:16.997530+0000","last_fullsized":"2024-08-31T06:04:16.997530+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:19.302279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'8","reported_seq":153,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:33.851304+0000","last_change":"2024-08-31T06:02:28.594973+0000","last_active":"2024-08-31T06:04:33.851304+0000","last_peered":"2024-08-31T06:04:33.851304+0000","last_clean":"2024-08-31T06:04:33.851304+0000","last_became_active":"2024-08-31T06:02:28.594588+0000","last_became_peered":"2024-08-31T06:02:28.594588+0000","last_unstale":"2024-08-31T06:04:33.851304+0000","last_undegraded":"2024-08-31T06:04:33.851304+0000","last_fullsized":"2024-08-31T06:04:33.851304+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:29:48.016888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"72'8","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825760+0000","last_change":"2024-08-31T06:03:15.974504+0000","last_active":"2024-08-31T06:04:16.825760+0000","last_peered":"2024-08-31T06:04:16.825760+0000","last_clean":"2024-08-31T06:04:16.825760+0000","last_became_active":"2024-08-31T06:03:15.974139+0000","last_became_peered":"2024-08-31T06:03:15.974139+0000","last_unstale":"2024-08-31T06:04:16.825760+0000","last_undegraded":"2024-08-31T06:04:16.825760+0000","last_fullsized":"2024-08-31T06:04:16.825760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:22.742884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433751+0000","last_change":"2024-08-31T06:02:28.589152+0000","last_active":"2024-08-31T06:04:16.433751+0000","last_peered":"2024-08-31T06:04:16.433751+0000","last_clean":"2024-08-31T06:04:16.433751+0000","last_became_active":"2024-08-31T06:02:28.588758+0000","last_became_peered":"2024-08-31T06:02:28.588758+0000","last_unstale":"2024-08-31T06:04:16.433751+0000","last_undegraded":"2024-08-31T06:04:16.433751+0000","last_fullsized":"2024-08-31T06:04:16.433751+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:31.814105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"70'3","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431439+0000","last_change":"2024-08-31T06:02:28.585410+0000","last_active":"2024-08-31T06:04:16.431439+0000","last_peered":"2024-08-31T06:04:16.431439+0000","last_clean":"2024-08-31T06:04:16.431439+0000","last_became_active":"2024-08-31T06:02:28.584998+0000","last_became_peered":"2024-08-31T06:02:28.584998+0000","last_unstale":"2024-08-31T06:04:16.431439+0000","last_undegraded":"2024-08-31T06:04:16.431439+0000","last_fullsized":"2024-08-31T06:04:16.431439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:30.705460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437844+0000","last_change":"2024-08-31T06:02:30.597295+0000","last_active":"2024-08-31T06:04:16.437844+0000","last_peered":"2024-08-31T06:04:16.437844+0000","last_clean":"2024-08-31T06:04:16.437844+0000","last_became_active":"2024-08-31T06:02:30.596968+0000","last_became_peered":"2024-08-31T06:02:30.596968+0000","last_unstale":"2024-08-31T06:04:16.437844+0000","last_undegraded":"2024-08-31T06:04:16.437844+0000","last_fullsized":"2024-08-31T06:04:16.437844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:38.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"70'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825895+0000","last_change":"2024-08-31T06:02:28.594164+0000","last_active":"2024-08-31T06:04:16.825895+0000","last_peered":"2024-08-31T06:04:16.825895+0000","last_clean":"2024-08-31T06:04:16.825895+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.825895+0000","last_undegraded":"2024-08-31T06:04:16.825895+0000","last_fullsized":"2024-08-31T06:04:16.825895+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:21.780202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823573+0000","last_change":"2024-08-31T06:02:30.597500+0000","last_active":"2024-08-31T06:04:16.823573+0000","last_peered":"2024-08-31T06:04:16.823573+0000","last_clean":"2024-08-31T06:04:16.823573+0000","last_became_active":"2024-08-31T06:02:30.597147+0000","last_became_peered":"2024-08-31T06:02:30.597147+0000","last_unstale":"2024-08-31T06:04:16.823573+0000","last_undegraded":"2024-08-31T06:04:16.823573+0000","last_fullsized":"2024-08-31T06:04:16.823573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:34.111288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'6","reported_seq":255,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:32.848833+0000","last_change":"2024-08-31T06:02:28.585769+0000","last_active":"2024-08-31T06:04:32.848833+0000","last_peered":"2024-08-31T06:04:32.848833+0000","last_clean":"2024-08-31T06:04:32.848833+0000","last_became_active":"2024-08-31T06:02:28.585310+0000","last_became_peered":"2024-08-31T06:02:28.585310+0000","last_unstale":"2024-08-31T06:04:32.848833+0000","last_undegraded":"2024-08-31T06:04:32.848833+0000","last_fullsized":"2024-08-31T06:04:32.848833+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:40.595986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":222,"num_read_kb":222,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434873+0000","last_change":"2024-08-31T06:02:30.601434+0000","last_active":"2024-08-31T06:04:16.434873+0000","last_peered":"2024-08-31T06:04:16.434873+0000","last_clean":"2024-08-31T06:04:16.434873+0000","last_became_active":"2024-08-31T06:02:30.601060+0000","last_became_peered":"2024-08-31T06:02:30.601060+0000","last_unstale":"2024-08-31T06:04:16.434873+0000","last_undegraded":"2024-08-31T06:04:16.434873+0000","last_fullsized":"2024-08-31T06:04:16.434873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:32.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"70'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826424+0000","last_change":"2024-08-31T06:02:28.593217+0000","last_active":"2024-08-31T06:04:16.826424+0000","last_peered":"2024-08-31T06:04:16.826424+0000","last_clean":"2024-08-31T06:04:16.826424+0000","last_became_active":"2024-08-31T06:02:28.592801+0000","last_became_peered":"2024-08-31T06:02:28.592801+0000","last_unstale":"2024-08-31T06:04:16.826424+0000","last_undegraded":"2024-08-31T06:04:16.826424+0000","last_fullsized":"2024-08-31T06:04:16.826424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:21.561089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"72'9","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997237+0000","last_change":"2024-08-31T06:03:15.770625+0000","last_active":"2024-08-31T06:04:16.997237+0000","last_peered":"2024-08-31T06:04:16.997237+0000","last_clean":"2024-08-31T06:04:16.997237+0000","last_became_active":"2024-08-31T06:03:15.770194+0000","last_became_peered":"2024-08-31T06:03:15.770194+0000","last_unstale":"2024-08-31T06:04:16.997237+0000","last_undegraded":"2024-08-31T06:04:16.997237+0000","last_fullsized":"2024-08-31T06:04:16.997237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:33:57.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825884+0000","last_change":"2024-08-31T06:02:28.781606+0000","last_active":"2024-08-31T06:04:16.825884+0000","last_peered":"2024-08-31T06:04:16.825884+0000","last_clean":"2024-08-31T06:04:16.825884+0000","last_became_active":"2024-08-31T06:02:28.780886+0000","last_became_peered":"2024-08-31T06:02:28.780886+0000","last_unstale":"2024-08-31T06:04:16.825884+0000","last_undegraded":"2024-08-31T06:04:16.825884+0000","last_fullsized":"2024-08-31T06:04:16.825884+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:07.540461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433810+0000","last_change":"2024-08-31T06:02:30.604358+0000","last_active":"2024-08-31T06:04:16.433810+0000","last_peered":"2024-08-31T06:04:16.433810+0000","last_clean":"2024-08-31T06:04:16.433810+0000","last_became_active":"2024-08-31T06:02:30.603980+0000","last_became_peered":"2024-08-31T06:02:30.603980+0000","last_unstale":"2024-08-31T06:04:16.433810+0000","last_undegraded":"2024-08-31T06:04:16.433810+0000","last_fullsized":"2024-08-31T06:04:16.433810+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:43:03.062141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'35","reported_seq":297,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:32.848781+0000","last_change":"2024-08-31T06:02:28.590795+0000","last_active":"2024-08-31T06:04:32.848781+0000","last_peered":"2024-08-31T06:04:32.848781+0000","last_clean":"2024-08-31T06:04:32.848781+0000","last_became_active":"2024-08-31T06:02:28.590397+0000","last_became_peered":"2024-08-31T06:02:28.590397+0000","last_unstale":"2024-08-31T06:04:32.848781+0000","last_undegraded":"2024-08-31T06:04:32.848781+0000","last_fullsized":"2024-08-31T06:04:32.848781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:30.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64818,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":181,"num_write":37,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997865+0000","last_change":"2024-08-31T06:02:30.603110+0000","last_active":"2024-08-31T06:04:16.997865+0000","last_peered":"2024-08-31T06:04:16.997865+0000","last_clean":"2024-08-31T06:04:16.997865+0000","last_became_active":"2024-08-31T06:02:30.602691+0000","last_became_peered":"2024-08-31T06:02:30.602691+0000","last_unstale":"2024-08-31T06:04:16.997865+0000","last_undegraded":"2024-08-31T06:04:16.997865+0000","last_fullsized":"2024-08-31T06:04:16.997865+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:20.009202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"70'9","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.449977+0000","last_change":"2024-08-31T06:04:16.449444+0000","last_active":"2024-08-31T06:04:16.449977+0000","last_peered":"2024-08-31T06:04:16.449977+0000","last_clean":"2024-08-31T06:04:16.449977+0000","last_became_active":"2024-08-31T06:04:16.439087+0000","last_became_peered":"2024-08-31T06:04:16.439087+0000","last_unstale":"2024-08-31T06:04:16.449977+0000","last_undegraded":"2024-08-31T06:04:16.449977+0000","last_fullsized":"2024-08-31T06:04:16.449977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:38.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431600+0000","last_change":"2024-08-31T06:02:30.599843+0000","last_active":"2024-08-31T06:04:16.431600+0000","last_peered":"2024-08-31T06:04:16.431600+0000","last_clean":"2024-08-31T06:04:16.431600+0000","last_became_active":"2024-08-31T06:02:30.599440+0000","last_became_peered":"2024-08-31T06:02:30.599440+0000","last_unstale":"2024-08-31T06:04:16.431600+0000","last_undegraded":"2024-08-31T06:04:16.431600+0000","last_fullsized":"2024-08-31T06:04:16.431600+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:01.029482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825714+0000","last_change":"2024-08-31T06:02:28.594178+0000","last_active":"2024-08-31T06:04:16.825714+0000","last_peered":"2024-08-31T06:04:16.825714+0000","last_clean":"2024-08-31T06:04:16.825714+0000","last_became_active":"2024-08-31T06:02:28.593802+0000","last_became_peered":"2024-08-31T06:02:28.593802+0000","last_unstale":"2024-08-31T06:04:16.825714+0000","last_undegraded":"2024-08-31T06:04:16.825714+0000","last_fullsized":"2024-08-31T06:04:16.825714+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:52.561582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826106+0000","last_change":"2024-08-31T06:02:30.595979+0000","last_active":"2024-08-31T06:04:16.826106+0000","last_peered":"2024-08-31T06:04:16.826106+0000","last_clean":"2024-08-31T06:04:16.826106+0000","last_became_active":"2024-08-31T06:02:30.595665+0000","last_became_peered":"2024-08-31T06:02:30.595665+0000","last_unstale":"2024-08-31T06:04:16.826106+0000","last_undegraded":"2024-08-31T06:04:16.826106+0000","last_fullsized":"2024-08-31T06:04:16.826106+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:40.347954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'8","reported_seq":150,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:30.846481+0000","last_change":"2024-08-31T06:02:28.594117+0000","last_active":"2024-08-31T06:04:30.846481+0000","last_peered":"2024-08-31T06:04:30.846481+0000","last_clean":"2024-08-31T06:04:30.846481+0000","last_became_active":"2024-08-31T06:02:28.593721+0000","last_became_peered":"2024-08-31T06:02:28.593721+0000","last_unstale":"2024-08-31T06:04:30.846481+0000","last_undegraded":"2024-08-31T06:04:30.846481+0000","last_fullsized":"2024-08-31T06:04:30.846481+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:48:49.400841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825844+0000","last_change":"2024-08-31T06:02:30.606967+0000","last_active":"2024-08-31T06:04:16.825844+0000","last_peered":"2024-08-31T06:04:16.825844+0000","last_clean":"2024-08-31T06:04:16.825844+0000","last_became_active":"2024-08-31T06:02:30.605730+0000","last_became_peered":"2024-08-31T06:02:30.605730+0000","last_unstale":"2024-08-31T06:04:16.825844+0000","last_undegraded":"2024-08-31T06:04:16.825844+0000","last_fullsized":"2024-08-31T06:04:16.825844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:30.656071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"70'17","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997489+0000","last_change":"2024-08-31T06:02:28.780911+0000","last_active":"2024-08-31T06:04:16.997489+0000","last_peered":"2024-08-31T06:04:16.997489+0000","last_clean":"2024-08-31T06:04:16.997489+0000","last_became_active":"2024-08-31T06:02:28.780375+0000","last_became_peered":"2024-08-31T06:02:28.780375+0000","last_unstale":"2024-08-31T06:04:16.997489+0000","last_undegraded":"2024-08-31T06:04:16.997489+0000","last_fullsized":"2024-08-31T06:04:16.997489+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:46.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825581+0000","last_change":"2024-08-31T06:02:30.606871+0000","last_active":"2024-08-31T06:04:16.825581+0000","last_peered":"2024-08-31T06:04:16.825581+0000","last_clean":"2024-08-31T06:04:16.825581+0000","last_became_active":"2024-08-31T06:02:30.606507+0000","last_became_peered":"2024-08-31T06:02:30.606507+0000","last_unstale":"2024-08-31T06:04:16.825581+0000","last_undegraded":"2024-08-31T06:04:16.825581+0000","last_fullsized":"2024-08-31T06:04:16.825581+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:16:31.502034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998046+0000","last_change":"2024-08-31T06:02:28.588078+0000","last_active":"2024-08-31T06:04:16.998046+0000","last_peered":"2024-08-31T06:04:16.998046+0000","last_clean":"2024-08-31T06:04:16.998046+0000","last_became_active":"2024-08-31T06:02:28.587642+0000","last_became_peered":"2024-08-31T06:02:28.587642+0000","last_unstale":"2024-08-31T06:04:16.998046+0000","last_undegraded":"2024-08-31T06:04:16.998046+0000","last_fullsized":"2024-08-31T06:04:16.998046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:59.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436127+0000","last_change":"2024-08-31T06:02:30.605647+0000","last_active":"2024-08-31T06:04:16.436127+0000","last_peered":"2024-08-31T06:04:16.436127+0000","last_clean":"2024-08-31T06:04:16.436127+0000","last_became_active":"2024-08-31T06:02:30.605267+0000","last_became_peered":"2024-08-31T06:02:30.605267+0000","last_unstale":"2024-08-31T06:04:16.436127+0000","last_undegraded":"2024-08-31T06:04:16.436127+0000","last_fullsized":"2024-08-31T06:04:16.436127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:08:34.741030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"70'5","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431745+0000","last_change":"2024-08-31T06:02:28.585295+0000","last_active":"2024-08-31T06:04:16.431745+0000","last_peered":"2024-08-31T06:04:16.431745+0000","last_clean":"2024-08-31T06:04:16.431745+0000","last_became_active":"2024-08-31T06:02:28.584895+0000","last_became_peered":"2024-08-31T06:02:28.584895+0000","last_unstale":"2024-08-31T06:04:16.431745+0000","last_undegraded":"2024-08-31T06:04:16.431745+0000","last_fullsized":"2024-08-31T06:04:16.431745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:57:12.658937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826465+0000","last_change":"2024-08-31T06:02:30.603593+0000","last_active":"2024-08-31T06:04:16.826465+0000","last_peered":"2024-08-31T06:04:16.826465+0000","last_clean":"2024-08-31T06:04:16.826465+0000","last_became_active":"2024-08-31T06:02:30.603274+0000","last_became_peered":"2024-08-31T06:02:30.603274+0000","last_unstale":"2024-08-31T06:04:16.826465+0000","last_undegraded":"2024-08-31T06:04:16.826465+0000","last_fullsized":"2024-08-31T06:04:16.826465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:07.720406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'62","reported_seq":119,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:32.280744+0000","last_change":"2024-08-31T06:02:28.586920+0000","last_active":"2024-08-31T06:04:32.280744+0000","last_peered":"2024-08-31T06:04:32.280744+0000","last_clean":"2024-08-31T06:04:32.280744+0000","last_became_active":"2024-08-31T06:02:28.586362+0000","last_became_peered":"2024-08-31T06:02:28.586362+0000","last_unstale":"2024-08-31T06:04:32.280744+0000","last_undegraded":"2024-08-31T06:04:32.280744+0000","last_fullsized":"2024-08-31T06:04:32.280744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:52.065879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826269+0000","last_change":"2024-08-31T06:02:30.603800+0000","last_active":"2024-08-31T06:04:16.826269+0000","last_peered":"2024-08-31T06:04:16.826269+0000","last_clean":"2024-08-31T06:04:16.826269+0000","last_became_active":"2024-08-31T06:02:30.603439+0000","last_became_peered":"2024-08-31T06:02:30.603439+0000","last_unstale":"2024-08-31T06:04:16.826269+0000","last_undegraded":"2024-08-31T06:04:16.826269+0000","last_fullsized":"2024-08-31T06:04:16.826269+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:39.992719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":149,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:33.851078+0000","last_change":"2024-08-31T06:02:28.936404+0000","last_active":"2024-08-31T06:04:33.851078+0000","last_peered":"2024-08-31T06:04:33.851078+0000","last_clean":"2024-08-31T06:04:33.851078+0000","last_became_active":"2024-08-31T06:02:28.935898+0000","last_became_peered":"2024-08-31T06:02:28.935898+0000","last_unstale":"2024-08-31T06:04:33.851078+0000","last_undegraded":"2024-08-31T06:04:33.851078+0000","last_fullsized":"2024-08-31T06:04:33.851078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:35.004510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826610+0000","last_change":"2024-08-31T06:02:30.608258+0000","last_active":"2024-08-31T06:04:16.826610+0000","last_peered":"2024-08-31T06:04:16.826610+0000","last_clean":"2024-08-31T06:04:16.826610+0000","last_became_active":"2024-08-31T06:02:30.607067+0000","last_became_peered":"2024-08-31T06:02:30.607067+0000","last_unstale":"2024-08-31T06:04:16.826610+0000","last_undegraded":"2024-08-31T06:04:16.826610+0000","last_fullsized":"2024-08-31T06:04:16.826610+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:03:09.362812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":97,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826255+0000","last_change":"2024-08-31T06:01:19.125033+0000","last_active":"2024-08-31T06:04:16.826255+0000","last_peered":"2024-08-31T06:04:16.826255+0000","last_clean":"2024-08-31T06:04:16.826255+0000","last_became_active":"2024-08-31T06:01:19.118469+0000","last_became_peered":"2024-08-31T06:01:19.118469+0000","last_unstale":"2024-08-31T06:04:16.826255+0000","last_undegraded":"2024-08-31T06:04:16.826255+0000","last_fullsized":"2024-08-31T06:04:16.826255+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_clean_scrub_stamp":"2024-08-31T05:58:05.259854+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:33.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"70'6","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826883+0000","last_change":"2024-08-31T06:02:28.588276+0000","last_active":"2024-08-31T06:04:16.826883+0000","last_peered":"2024-08-31T06:04:16.826883+0000","last_clean":"2024-08-31T06:04:16.826883+0000","last_became_active":"2024-08-31T06:02:28.587184+0000","last_became_peered":"2024-08-31T06:02:28.587184+0000","last_unstale":"2024-08-31T06:04:16.826883+0000","last_undegraded":"2024-08-31T06:04:16.826883+0000","last_fullsized":"2024-08-31T06:04:16.826883+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:12.762919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437980+0000","last_change":"2024-08-31T06:02:30.610801+0000","last_active":"2024-08-31T06:04:16.437980+0000","last_peered":"2024-08-31T06:04:16.437980+0000","last_clean":"2024-08-31T06:04:16.437980+0000","last_became_active":"2024-08-31T06:02:30.610446+0000","last_became_peered":"2024-08-31T06:02:30.610446+0000","last_unstale":"2024-08-31T06:04:16.437980+0000","last_undegraded":"2024-08-31T06:04:16.437980+0000","last_fullsized":"2024-08-31T06:04:16.437980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:17.891734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"70'4","reported_seq":43,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826060+0000","last_change":"2024-08-31T06:03:15.777123+0000","last_active":"2024-08-31T06:04:16.826060+0000","last_peered":"2024-08-31T06:04:16.826060+0000","last_clean":"2024-08-31T06:04:16.826060+0000","last_became_active":"2024-08-31T06:03:15.773099+0000","last_became_peered":"2024-08-31T06:03:15.773099+0000","last_unstale":"2024-08-31T06:04:16.826060+0000","last_undegraded":"2024-08-31T06:04:16.826060+0000","last_fullsized":"2024-08-31T06:04:16.826060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:56:51.706692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"72'5","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431502+0000","last_change":"2024-08-31T06:03:15.776402+0000","last_active":"2024-08-31T06:04:16.431502+0000","last_peered":"2024-08-31T06:04:16.431502+0000","last_clean":"2024-08-31T06:04:16.431502+0000","last_became_active":"2024-08-31T06:03:15.775949+0000","last_became_peered":"2024-08-31T06:03:15.775949+0000","last_unstale":"2024-08-31T06:04:16.431502+0000","last_undegraded":"2024-08-31T06:04:16.431502+0000","last_fullsized":"2024-08-31T06:04:16.431502+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:51:34.646125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'6","reported_seq":149,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:35.853338+0000","last_change":"2024-08-31T06:02:28.780419+0000","last_active":"2024-08-31T06:04:35.853338+0000","last_peered":"2024-08-31T06:04:35.853338+0000","last_clean":"2024-08-31T06:04:35.853338+0000","last_became_active":"2024-08-31T06:02:28.779814+0000","last_became_peered":"2024-08-31T06:02:28.779814+0000","last_unstale":"2024-08-31T06:04:35.853338+0000","last_undegraded":"2024-08-31T06:04:35.853338+0000","last_fullsized":"2024-08-31T06:04:35.853338+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:36.183841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"72'8","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825689+0000","last_change":"2024-08-31T06:03:15.776468+0000","last_active":"2024-08-31T06:04:16.825689+0000","last_peered":"2024-08-31T06:04:16.825689+0000","last_clean":"2024-08-31T06:04:16.825689+0000","last_became_active":"2024-08-31T06:03:15.776005+0000","last_became_peered":"2024-08-31T06:03:15.776005+0000","last_unstale":"2024-08-31T06:04:16.825689+0000","last_undegraded":"2024-08-31T06:04:16.825689+0000","last_fullsized":"2024-08-31T06:04:16.825689+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:47:36.420584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'6","reported_seq":149,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:34.851997+0000","last_change":"2024-08-31T06:02:28.594220+0000","last_active":"2024-08-31T06:04:34.851997+0000","last_peered":"2024-08-31T06:04:34.851997+0000","last_clean":"2024-08-31T06:04:34.851997+0000","last_became_active":"2024-08-31T06:02:28.593729+0000","last_became_peered":"2024-08-31T06:02:28.593729+0000","last_unstale":"2024-08-31T06:04:34.851997+0000","last_undegraded":"2024-08-31T06:04:34.851997+0000","last_fullsized":"2024-08-31T06:04:34.851997+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:37:03.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433754+0000","last_change":"2024-08-31T06:02:30.600008+0000","last_active":"2024-08-31T06:04:16.433754+0000","last_peered":"2024-08-31T06:04:16.433754+0000","last_clean":"2024-08-31T06:04:16.433754+0000","last_became_active":"2024-08-31T06:02:30.599677+0000","last_became_peered":"2024-08-31T06:02:30.599677+0000","last_unstale":"2024-08-31T06:04:16.433754+0000","last_undegraded":"2024-08-31T06:04:16.433754+0000","last_fullsized":"2024-08-31T06:04:16.433754+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:59.520544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"70'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823656+0000","last_change":"2024-08-31T06:02:28.780554+0000","last_active":"2024-08-31T06:04:16.823656+0000","last_peered":"2024-08-31T06:04:16.823656+0000","last_clean":"2024-08-31T06:04:16.823656+0000","last_became_active":"2024-08-31T06:02:28.780137+0000","last_became_peered":"2024-08-31T06:02:28.780137+0000","last_unstale":"2024-08-31T06:04:16.823656+0000","last_undegraded":"2024-08-31T06:04:16.823656+0000","last_fullsized":"2024-08-31T06:04:16.823656+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:57.523667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433847+0000","last_change":"2024-08-31T06:02:30.597438+0000","last_active":"2024-08-31T06:04:16.433847+0000","last_peered":"2024-08-31T06:04:16.433847+0000","last_clean":"2024-08-31T06:04:16.433847+0000","last_became_active":"2024-08-31T06:02:30.597108+0000","last_became_peered":"2024-08-31T06:02:30.597108+0000","last_unstale":"2024-08-31T06:04:16.433847+0000","last_undegraded":"2024-08-31T06:04:16.433847+0000","last_fullsized":"2024-08-31T06:04:16.433847+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:05.238708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"70'4","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998101+0000","last_change":"2024-08-31T06:02:28.781006+0000","last_active":"2024-08-31T06:04:16.998101+0000","last_peered":"2024-08-31T06:04:16.998101+0000","last_clean":"2024-08-31T06:04:16.998101+0000","last_became_active":"2024-08-31T06:02:28.780468+0000","last_became_peered":"2024-08-31T06:02:28.780468+0000","last_unstale":"2024-08-31T06:04:16.998101+0000","last_undegraded":"2024-08-31T06:04:16.998101+0000","last_fullsized":"2024-08-31T06:04:16.998101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:20.206251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"72'9","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431889+0000","last_change":"2024-08-31T06:02:30.600826+0000","last_active":"2024-08-31T06:04:16.431889+0000","last_peered":"2024-08-31T06:04:16.431889+0000","last_clean":"2024-08-31T06:04:16.431889+0000","last_became_active":"2024-08-31T06:02:30.600474+0000","last_became_peered":"2024-08-31T06:02:30.600474+0000","last_unstale":"2024-08-31T06:04:16.431889+0000","last_undegraded":"2024-08-31T06:04:16.431889+0000","last_fullsized":"2024-08-31T06:04:16.431889+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:07.456576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'101","reported_seq":217,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:32.641638+0000","last_change":"2024-08-31T06:02:28.588026+0000","last_active":"2024-08-31T06:04:32.641638+0000","last_peered":"2024-08-31T06:04:32.641638+0000","last_clean":"2024-08-31T06:04:32.641638+0000","last_became_active":"2024-08-31T06:02:28.587759+0000","last_became_peered":"2024-08-31T06:02:28.587759+0000","last_unstale":"2024-08-31T06:04:32.641638+0000","last_undegraded":"2024-08-31T06:04:32.641638+0000","last_fullsized":"2024-08-31T06:04:32.641638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:44.323111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":184,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438064+0000","last_change":"2024-08-31T06:02:30.604375+0000","last_active":"2024-08-31T06:04:16.438064+0000","last_peered":"2024-08-31T06:04:16.438064+0000","last_clean":"2024-08-31T06:04:16.438064+0000","last_became_active":"2024-08-31T06:02:30.604008+0000","last_became_peered":"2024-08-31T06:02:30.604008+0000","last_unstale":"2024-08-31T06:04:16.438064+0000","last_undegraded":"2024-08-31T06:04:16.438064+0000","last_fullsized":"2024-08-31T06:04:16.438064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:37.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"70'7","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827216+0000","last_change":"2024-08-31T06:02:28.936568+0000","last_active":"2024-08-31T06:04:16.827216+0000","last_peered":"2024-08-31T06:04:16.827216+0000","last_clean":"2024-08-31T06:04:16.827216+0000","last_became_active":"2024-08-31T06:02:28.936185+0000","last_became_peered":"2024-08-31T06:02:28.936185+0000","last_unstale":"2024-08-31T06:04:16.827216+0000","last_undegraded":"2024-08-31T06:04:16.827216+0000","last_fullsized":"2024-08-31T06:04:16.827216+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:34.080300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"72'7","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996996+0000","last_change":"2024-08-31T06:03:15.771653+0000","last_active":"2024-08-31T06:04:16.996996+0000","last_peered":"2024-08-31T06:04:16.996996+0000","last_clean":"2024-08-31T06:04:16.996996+0000","last_became_active":"2024-08-31T06:03:15.770903+0000","last_became_peered":"2024-08-31T06:03:15.770903+0000","last_unstale":"2024-08-31T06:04:16.996996+0000","last_undegraded":"2024-08-31T06:04:16.996996+0000","last_fullsized":"2024-08-31T06:04:16.996996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:50.547558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"70'2","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433650+0000","last_change":"2024-08-31T06:03:15.777577+0000","last_active":"2024-08-31T06:04:16.433650+0000","last_peered":"2024-08-31T06:04:16.433650+0000","last_clean":"2024-08-31T06:04:16.433650+0000","last_became_active":"2024-08-31T06:03:15.773006+0000","last_became_peered":"2024-08-31T06:03:15.773006+0000","last_unstale":"2024-08-31T06:04:16.433650+0000","last_undegraded":"2024-08-31T06:04:16.433650+0000","last_fullsized":"2024-08-31T06:04:16.433650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:31.531741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997519+0000","last_change":"2024-08-31T06:02:30.604018+0000","last_active":"2024-08-31T06:04:16.997519+0000","last_peered":"2024-08-31T06:04:16.997519+0000","last_clean":"2024-08-31T06:04:16.997519+0000","last_became_active":"2024-08-31T06:02:30.603411+0000","last_became_peered":"2024-08-31T06:02:30.603411+0000","last_unstale":"2024-08-31T06:04:16.997519+0000","last_undegraded":"2024-08-31T06:04:16.997519+0000","last_fullsized":"2024-08-31T06:04:16.997519+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:34:30.732954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437921+0000","last_change":"2024-08-31T06:02:28.586348+0000","last_active":"2024-08-31T06:04:16.437921+0000","last_peered":"2024-08-31T06:04:16.437921+0000","last_clean":"2024-08-31T06:04:16.437921+0000","last_became_active":"2024-08-31T06:02:28.586046+0000","last_became_peered":"2024-08-31T06:02:28.586046+0000","last_unstale":"2024-08-31T06:04:16.437921+0000","last_undegraded":"2024-08-31T06:04:16.437921+0000","last_fullsized":"2024-08-31T06:04:16.437921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:30.987232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435839+0000","last_change":"2024-08-31T06:02:30.616402+0000","last_active":"2024-08-31T06:04:16.435839+0000","last_peered":"2024-08-31T06:04:16.435839+0000","last_clean":"2024-08-31T06:04:16.435839+0000","last_became_active":"2024-08-31T06:02:30.616014+0000","last_became_peered":"2024-08-31T06:02:30.616014+0000","last_unstale":"2024-08-31T06:04:16.435839+0000","last_undegraded":"2024-08-31T06:04:16.435839+0000","last_fullsized":"2024-08-31T06:04:16.435839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:42.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438077+0000","last_change":"2024-08-31T06:02:28.590184+0000","last_active":"2024-08-31T06:04:16.438077+0000","last_peered":"2024-08-31T06:04:16.438077+0000","last_clean":"2024-08-31T06:04:16.438077+0000","last_became_active":"2024-08-31T06:02:28.588830+0000","last_became_peered":"2024-08-31T06:02:28.588830+0000","last_unstale":"2024-08-31T06:04:16.438077+0000","last_undegraded":"2024-08-31T06:04:16.438077+0000","last_fullsized":"2024-08-31T06:04:16.438077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:03.072197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438070+0000","last_change":"2024-08-31T06:02:30.597262+0000","last_active":"2024-08-31T06:04:16.438070+0000","last_peered":"2024-08-31T06:04:16.438070+0000","last_clean":"2024-08-31T06:04:16.438070+0000","last_became_active":"2024-08-31T06:02:30.596862+0000","last_became_peered":"2024-08-31T06:02:30.596862+0000","last_unstale":"2024-08-31T06:04:16.438070+0000","last_undegraded":"2024-08-31T06:04:16.438070+0000","last_fullsized":"2024-08-31T06:04:16.438070+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:46:29.378532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"70'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997626+0000","last_change":"2024-08-31T06:02:28.594161+0000","last_active":"2024-08-31T06:04:16.997626+0000","last_peered":"2024-08-31T06:04:16.997626+0000","last_clean":"2024-08-31T06:04:16.997626+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.997626+0000","last_undegraded":"2024-08-31T06:04:16.997626+0000","last_fullsized":"2024-08-31T06:04:16.997626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:31:17.941172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826133+0000","last_change":"2024-08-31T06:02:30.595194+0000","last_active":"2024-08-31T06:04:16.826133+0000","last_peered":"2024-08-31T06:04:16.826133+0000","last_clean":"2024-08-31T06:04:16.826133+0000","last_became_active":"2024-08-31T06:02:30.594812+0000","last_became_peered":"2024-08-31T06:02:30.594812+0000","last_unstale":"2024-08-31T06:04:16.826133+0000","last_undegraded":"2024-08-31T06:04:16.826133+0000","last_fullsized":"2024-08-31T06:04:16.826133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:03.224924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825830+0000","last_change":"2024-08-31T06:02:30.615776+0000","last_active":"2024-08-31T06:04:16.825830+0000","last_peered":"2024-08-31T06:04:16.825830+0000","last_clean":"2024-08-31T06:04:16.825830+0000","last_became_active":"2024-08-31T06:02:30.615385+0000","last_became_peered":"2024-08-31T06:02:30.615385+0000","last_unstale":"2024-08-31T06:04:16.825830+0000","last_undegraded":"2024-08-31T06:04:16.825830+0000","last_fullsized":"2024-08-31T06:04:16.825830+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:49.685443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997930+0000","last_change":"2024-08-31T06:02:28.591064+0000","last_active":"2024-08-31T06:04:16.997930+0000","last_peered":"2024-08-31T06:04:16.997930+0000","last_clean":"2024-08-31T06:04:16.997930+0000","last_became_active":"2024-08-31T06:02:28.590643+0000","last_became_peered":"2024-08-31T06:02:28.590643+0000","last_unstale":"2024-08-31T06:04:16.997930+0000","last_undegraded":"2024-08-31T06:04:16.997930+0000","last_fullsized":"2024-08-31T06:04:16.997930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:01.953317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433533+0000","last_change":"2024-08-31T06:02:30.600532+0000","last_active":"2024-08-31T06:04:16.433533+0000","last_peered":"2024-08-31T06:04:16.433533+0000","last_clean":"2024-08-31T06:04:16.433533+0000","last_became_active":"2024-08-31T06:02:30.600013+0000","last_became_peered":"2024-08-31T06:02:30.600013+0000","last_unstale":"2024-08-31T06:04:16.433533+0000","last_undegraded":"2024-08-31T06:04:16.433533+0000","last_fullsized":"2024-08-31T06:04:16.433533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:38.753206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"70'12","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998027+0000","last_change":"2024-08-31T06:02:28.593921+0000","last_active":"2024-08-31T06:04:16.998027+0000","last_peered":"2024-08-31T06:04:16.998027+0000","last_clean":"2024-08-31T06:04:16.998027+0000","last_became_active":"2024-08-31T06:02:28.593102+0000","last_became_peered":"2024-08-31T06:02:28.593102+0000","last_unstale":"2024-08-31T06:04:16.998027+0000","last_undegraded":"2024-08-31T06:04:16.998027+0000","last_fullsized":"2024-08-31T06:04:16.998027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:30:35.791686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997199+0000","last_change":"2024-08-31T06:02:30.606524+0000","last_active":"2024-08-31T06:04:16.997199+0000","last_peered":"2024-08-31T06:04:16.997199+0000","last_clean":"2024-08-31T06:04:16.997199+0000","last_became_active":"2024-08-31T06:02:30.606132+0000","last_became_peered":"2024-08-31T06:02:30.606132+0000","last_unstale":"2024-08-31T06:04:16.997199+0000","last_undegraded":"2024-08-31T06:04:16.997199+0000","last_fullsized":"2024-08-31T06:04:16.997199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:46.566811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"70'2","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438165+0000","last_change":"2024-08-31T06:02:28.780596+0000","last_active":"2024-08-31T06:04:16.438165+0000","last_peered":"2024-08-31T06:04:16.438165+0000","last_clean":"2024-08-31T06:04:16.438165+0000","last_became_active":"2024-08-31T06:02:28.779908+0000","last_became_peered":"2024-08-31T06:02:28.779908+0000","last_unstale":"2024-08-31T06:04:16.438165+0000","last_undegraded":"2024-08-31T06:04:16.438165+0000","last_fullsized":"2024-08-31T06:04:16.438165+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:01.254340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"72'5","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823599+0000","last_change":"2024-08-31T06:03:15.776271+0000","last_active":"2024-08-31T06:04:16.823599+0000","last_peered":"2024-08-31T06:04:16.823599+0000","last_clean":"2024-08-31T06:04:16.823599+0000","last_became_active":"2024-08-31T06:03:15.775821+0000","last_became_peered":"2024-08-31T06:03:15.775821+0000","last_unstale":"2024-08-31T06:04:16.823599+0000","last_undegraded":"2024-08-31T06:04:16.823599+0000","last_fullsized":"2024-08-31T06:04:16.823599+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:52:34.076554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"74'14","reported_seq":155,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:32.848756+0000","last_change":"2024-08-31T06:02:28.593773+0000","last_active":"2024-08-31T06:04:32.848756+0000","last_peered":"2024-08-31T06:04:32.848756+0000","last_clean":"2024-08-31T06:04:32.848756+0000","last_became_active":"2024-08-31T06:02:28.593511+0000","last_became_peered":"2024-08-31T06:02:28.593511+0000","last_unstale":"2024-08-31T06:04:32.848756+0000","last_undegraded":"2024-08-31T06:04:32.848756+0000","last_fullsized":"2024-08-31T06:04:32.848756+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:01:50.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":861268,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1504,"num_read_kb":966,"num_write":490,"num_write_kb":2244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2949120,"data_stored":2583804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906982,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070508,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37296,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707856,"statfs":{"total":95995035648,"available":95956844544,"internally_reserved":0,"allocated":1937408,"data_stored":1465699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928234032,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40728,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704424,"statfs":{"total":95995035648,"available":95953330176,"internally_reserved":0,"allocated":1253376,"data_stored":808197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397558,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36564,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708588,"statfs":{"total":95995035648,"available":95957594112,"internally_reserved":0,"allocated":1249280,"data_stored":808575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593786,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1454080,"data_stored":1010029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757311,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953539,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28904,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716248,"statfs":{"total":95995035648,"available":95965437952,"internally_reserved":0,"allocated":1863680,"data_stored":1401965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084360,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":415584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28696,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716456,"statfs":{"total":95995035648,"available":95965650944,"internally_reserved":0,"allocated":1650688,"data_stored":1201515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444114,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":482099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":480922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":864256,"data_stored":416530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":787422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":397621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":461355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:04:37.510 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T06:04:37.510 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:04:37.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:37 smithi130 ceph-mon[22266]: pgmap v313: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 57 op/s 2024-08-31T06:04:37.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:37 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:04:37.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:37 smithi130 ceph-mon[22266]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:37.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:37 smithi153 ceph-mon[22320]: pgmap v313: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 57 op/s 2024-08-31T06:04:37.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:37 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:04:37.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:37 smithi153 ceph-mon[22320]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:37.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:37 smithi053 ceph-mon[18924]: pgmap v313: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 57 op/s 2024-08-31T06:04:37.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:37 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:04:37.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:37 smithi053 ceph-mon[18924]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:38.252 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:38.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.748+0000 7f5d08bbf640 1 -- 172.21.15.53:0/2720444059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d04102800 msgr2=0x7f5d04102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:38.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.748+0000 7f5d08bbf640 1 --2- 172.21.15.53:0/2720444059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d04102800 0x7f5d04102c10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009900 tx=0x7f5cf402a410 comp rx=0 tx=0).stop 2024-08-31T06:04:38.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.748+0000 7f5d08bbf640 1 -- 172.21.15.53:0/2720444059 shutdown_connections 2024-08-31T06:04:38.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.748+0000 7f5d08bbf640 1 --2- 172.21.15.53:0/2720444059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d04108a90 0x7f5d0410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:38.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.748+0000 7f5d08bbf640 1 --2- 172.21.15.53:0/2720444059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d04108140 0x7f5d04108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:38.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.748+0000 7f5d08bbf640 1 --2- 172.21.15.53:0/2720444059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d04102800 0x7f5d04102c10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:38.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.748+0000 7f5d08bbf640 1 -- 172.21.15.53:0/2720444059 >> 172.21.15.53:0/2720444059 conn(0x7f5d040794d0 msgr2=0x7f5d040798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:38.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.748+0000 7f5d08bbf640 1 -- 172.21.15.53:0/2720444059 shutdown_connections 2024-08-31T06:04:38.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.748+0000 7f5d08bbf640 1 -- 172.21.15.53:0/2720444059 wait complete. 2024-08-31T06:04:38.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.749+0000 7f5d08bbf640 1 Processor -- start 2024-08-31T06:04:38.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.749+0000 7f5d08bbf640 1 -- start start 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d08bbf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d04102800 0x7f5d0419afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d08bbf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d04108140 0x7f5d0419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d08bbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d04108a90 0x7f5d0419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d08bbf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5d041125a0 con 0x7f5d04108a90 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d08bbf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5d04112420 con 0x7f5d04108140 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d08bbf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5d04112720 con 0x7f5d04102800 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d02d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d04108a90 0x7f5d0419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d0259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d04102800 0x7f5d0419afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d02d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d04108a90 0x7f5d0419ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40582/0 (socket says 172.21.15.53:40582) 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d0259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d04102800 0x7f5d0419afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:40174/0 (socket says 172.21.15.53:40174) 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d02d9d640 1 -- 172.21.15.53:0/864577868 learned_addr learned my addr 172.21.15.53:0/864577868 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d01d9b640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d04108140 0x7f5d0419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d0259c640 1 -- 172.21.15.53:0/864577868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d04108140 msgr2=0x7f5d0419b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d0259c640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d04108140 0x7f5d0419b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d0259c640 1 -- 172.21.15.53:0/864577868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d04108a90 msgr2=0x7f5d0419ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d0259c640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d04108a90 0x7f5d0419ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.750+0000 7f5d0259c640 1 -- 172.21.15.53:0/864577868 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d041a6240 con 0x7f5d04102800 2024-08-31T06:04:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.751+0000 7f5d0259c640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d04102800 0x7f5d0419afb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4005940 tx=0x7f5cf40040e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.751+0000 7f5cfb7fe640 1 -- 172.21.15.53:0/864577868 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf403f070 con 0x7f5d04102800 2024-08-31T06:04:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.751+0000 7f5d08bbf640 1 -- 172.21.15.53:0/864577868 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d04198da0 con 0x7f5d04102800 2024-08-31T06:04:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.751+0000 7f5cfb7fe640 1 -- 172.21.15.53:0/864577868 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cf4003c80 con 0x7f5d04102800 2024-08-31T06:04:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.751+0000 7f5cfb7fe640 1 -- 172.21.15.53:0/864577868 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4035070 con 0x7f5d04102800 2024-08-31T06:04:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.751+0000 7f5d08bbf640 1 -- 172.21.15.53:0/864577868 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d041992d0 con 0x7f5d04102800 2024-08-31T06:04:38.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.752+0000 7f5d08bbf640 1 -- 172.21.15.53:0/864577868 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d04102c10 con 0x7f5d04102800 2024-08-31T06:04:38.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.753+0000 7f5cfb7fe640 1 -- 172.21.15.53:0/864577868 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f5cf40037f0 con 0x7f5d04102800 2024-08-31T06:04:38.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.754+0000 7f5cfb7fe640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5cf00b4c40 0x7f5cf00b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:38.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.754+0000 7f5d01d9b640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5cf00b4c40 0x7f5cf00b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.754+0000 7f5cfb7fe640 1 -- 172.21.15.53:0/864577868 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5cf4105720 con 0x7f5d04102800 2024-08-31T06:04:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.755+0000 7f5d01d9b640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5cf00b4c40 0x7f5cf00b7150 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5d04100b30 tx=0x7f5cec010040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:38.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.759+0000 7f5cfb7fe640 1 -- 172.21.15.53:0/864577868 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5cf40cbf20 con 0x7f5d04102800 2024-08-31T06:04:38.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.957+0000 7f5d08bbf640 1 -- 172.21.15.53:0/864577868 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d040635a0 con 0x7f5cf00b4c40 2024-08-31T06:04:38.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.965+0000 7f5cfb7fe640 1 -- 172.21.15.53:0/864577868 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258935 (secure 0 0 0) 0x7f5d040635a0 con 0x7f5cf00b4c40 2024-08-31T06:04:38.969 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-08-31T06:04:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.969+0000 7f5d08bbf640 1 -- 172.21.15.53:0/864577868 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5cf00b4c40 msgr2=0x7f5cf00b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.969+0000 7f5d08bbf640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5cf00b4c40 0x7f5cf00b7150 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5d04100b30 tx=0x7f5cec010040 comp rx=0 tx=0).stop 2024-08-31T06:04:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.969+0000 7f5d08bbf640 1 -- 172.21.15.53:0/864577868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d04102800 msgr2=0x7f5d0419afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.969+0000 7f5d08bbf640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d04102800 0x7f5d0419afb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4005940 tx=0x7f5cf40040e0 comp rx=0 tx=0).stop 2024-08-31T06:04:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.969+0000 7f5d08bbf640 1 -- 172.21.15.53:0/864577868 shutdown_connections 2024-08-31T06:04:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.969+0000 7f5d08bbf640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5cf00b4c40 0x7f5cf00b7150 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.969+0000 7f5d08bbf640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d04108a90 0x7f5d0419ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.969+0000 7f5d08bbf640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d04108140 0x7f5d0419b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.969+0000 7f5d08bbf640 1 --2- 172.21.15.53:0/864577868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d04102800 0x7f5d0419afb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.969+0000 7f5d08bbf640 1 -- 172.21.15.53:0/864577868 >> 172.21.15.53:0/864577868 conn(0x7f5d040794d0 msgr2=0x7f5d04101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.970+0000 7f5d08bbf640 1 -- 172.21.15.53:0/864577868 shutdown_connections 2024-08-31T06:04:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:38.970+0000 7f5d08bbf640 1 -- 172.21.15.53:0/864577868 wait complete. 2024-08-31T06:04:39.354 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.354 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.355 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.355 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:39 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:39 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:39 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:39.827 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-08-31T06:04:38.368978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1451870,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1615,"num_read_kb":1055,"num_write":615,"num_write_kb":4396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2951908,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":965,"ondisk_log_size":965,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":397024,"kb_used_data":14292,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544800,"statfs":{"total":1151940427776,"available":1151533875200,"internally_reserved":0,"allocated":14635008,"data_stored":9321918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":391492922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":791306,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":376,"num_write":225,"num_write_kb":2093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003136"},"pg_stats":[{"pgid":"3.3f","version":"72'8","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436231+0000","last_change":"2024-08-31T06:02:30.611733+0000","last_active":"2024-08-31T06:04:16.436231+0000","last_peered":"2024-08-31T06:04:16.436231+0000","last_clean":"2024-08-31T06:04:16.436231+0000","last_became_active":"2024-08-31T06:02:30.610339+0000","last_became_peered":"2024-08-31T06:02:30.610339+0000","last_unstale":"2024-08-31T06:04:16.436231+0000","last_undegraded":"2024-08-31T06:04:16.436231+0000","last_fullsized":"2024-08-31T06:04:16.436231+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:20.628524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"72'4","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997065+0000","last_change":"2024-08-31T06:02:30.604550+0000","last_active":"2024-08-31T06:04:16.997065+0000","last_peered":"2024-08-31T06:04:16.997065+0000","last_clean":"2024-08-31T06:04:16.997065+0000","last_became_active":"2024-08-31T06:02:30.604200+0000","last_became_peered":"2024-08-31T06:02:30.604200+0000","last_unstale":"2024-08-31T06:04:16.997065+0000","last_undegraded":"2024-08-31T06:04:16.997065+0000","last_fullsized":"2024-08-31T06:04:16.997065+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:46:31.191972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997072+0000","last_change":"2024-08-31T06:02:30.606102+0000","last_active":"2024-08-31T06:04:16.997072+0000","last_peered":"2024-08-31T06:04:16.997072+0000","last_clean":"2024-08-31T06:04:16.997072+0000","last_became_active":"2024-08-31T06:02:30.605738+0000","last_became_peered":"2024-08-31T06:02:30.605738+0000","last_unstale":"2024-08-31T06:04:16.997072+0000","last_undegraded":"2024-08-31T06:04:16.997072+0000","last_fullsized":"2024-08-31T06:04:16.997072+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:50:34.993218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"72'8","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827148+0000","last_change":"2024-08-31T06:02:30.603207+0000","last_active":"2024-08-31T06:04:16.827148+0000","last_peered":"2024-08-31T06:04:16.827148+0000","last_clean":"2024-08-31T06:04:16.827148+0000","last_became_active":"2024-08-31T06:02:30.602829+0000","last_became_peered":"2024-08-31T06:02:30.602829+0000","last_unstale":"2024-08-31T06:04:16.827148+0000","last_undegraded":"2024-08-31T06:04:16.827148+0000","last_fullsized":"2024-08-31T06:04:16.827148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:02.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997618+0000","last_change":"2024-08-31T06:02:30.590760+0000","last_active":"2024-08-31T06:04:16.997618+0000","last_peered":"2024-08-31T06:04:16.997618+0000","last_clean":"2024-08-31T06:04:16.997618+0000","last_became_active":"2024-08-31T06:02:30.590198+0000","last_became_peered":"2024-08-31T06:02:30.590198+0000","last_unstale":"2024-08-31T06:04:16.997618+0000","last_undegraded":"2024-08-31T06:04:16.997618+0000","last_fullsized":"2024-08-31T06:04:16.997618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:50.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433579+0000","last_change":"2024-08-31T06:02:30.599924+0000","last_active":"2024-08-31T06:04:16.433579+0000","last_peered":"2024-08-31T06:04:16.433579+0000","last_clean":"2024-08-31T06:04:16.433579+0000","last_became_active":"2024-08-31T06:02:30.599566+0000","last_became_peered":"2024-08-31T06:02:30.599566+0000","last_unstale":"2024-08-31T06:04:16.433579+0000","last_undegraded":"2024-08-31T06:04:16.433579+0000","last_fullsized":"2024-08-31T06:04:16.433579+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:31:58.265673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"72'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826124+0000","last_change":"2024-08-31T06:03:15.771521+0000","last_active":"2024-08-31T06:04:16.826124+0000","last_peered":"2024-08-31T06:04:16.826124+0000","last_clean":"2024-08-31T06:04:16.826124+0000","last_became_active":"2024-08-31T06:03:15.770969+0000","last_became_peered":"2024-08-31T06:03:15.770969+0000","last_unstale":"2024-08-31T06:04:16.826124+0000","last_undegraded":"2024-08-31T06:04:16.826124+0000","last_fullsized":"2024-08-31T06:04:16.826124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:31.724213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437763+0000","last_change":"2024-08-31T06:02:30.610057+0000","last_active":"2024-08-31T06:04:16.437763+0000","last_peered":"2024-08-31T06:04:16.437763+0000","last_clean":"2024-08-31T06:04:16.437763+0000","last_became_active":"2024-08-31T06:02:30.609654+0000","last_became_peered":"2024-08-31T06:02:30.609654+0000","last_unstale":"2024-08-31T06:04:16.437763+0000","last_undegraded":"2024-08-31T06:04:16.437763+0000","last_fullsized":"2024-08-31T06:04:16.437763+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:32:14.477108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435055+0000","last_change":"2024-08-31T06:02:30.606437+0000","last_active":"2024-08-31T06:04:16.435055+0000","last_peered":"2024-08-31T06:04:16.435055+0000","last_clean":"2024-08-31T06:04:16.435055+0000","last_became_active":"2024-08-31T06:02:30.605632+0000","last_became_peered":"2024-08-31T06:02:30.605632+0000","last_unstale":"2024-08-31T06:04:16.435055+0000","last_undegraded":"2024-08-31T06:04:16.435055+0000","last_fullsized":"2024-08-31T06:04:16.435055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:47.891874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"72'16","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434609+0000","last_change":"2024-08-31T06:02:30.605456+0000","last_active":"2024-08-31T06:04:16.434609+0000","last_peered":"2024-08-31T06:04:16.434609+0000","last_clean":"2024-08-31T06:04:16.434609+0000","last_became_active":"2024-08-31T06:02:30.604927+0000","last_became_peered":"2024-08-31T06:02:30.604927+0000","last_unstale":"2024-08-31T06:04:16.434609+0000","last_undegraded":"2024-08-31T06:04:16.434609+0000","last_fullsized":"2024-08-31T06:04:16.434609+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:30.340609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826434+0000","last_change":"2024-08-31T06:02:30.608595+0000","last_active":"2024-08-31T06:04:16.826434+0000","last_peered":"2024-08-31T06:04:16.826434+0000","last_clean":"2024-08-31T06:04:16.826434+0000","last_became_active":"2024-08-31T06:02:30.607695+0000","last_became_peered":"2024-08-31T06:02:30.607695+0000","last_unstale":"2024-08-31T06:04:16.826434+0000","last_undegraded":"2024-08-31T06:04:16.826434+0000","last_fullsized":"2024-08-31T06:04:16.826434+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:44:53.655598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827095+0000","last_change":"2024-08-31T06:02:30.595775+0000","last_active":"2024-08-31T06:04:16.827095+0000","last_peered":"2024-08-31T06:04:16.827095+0000","last_clean":"2024-08-31T06:04:16.827095+0000","last_became_active":"2024-08-31T06:02:30.595424+0000","last_became_peered":"2024-08-31T06:02:30.595424+0000","last_unstale":"2024-08-31T06:04:16.827095+0000","last_undegraded":"2024-08-31T06:04:16.827095+0000","last_fullsized":"2024-08-31T06:04:16.827095+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:56.382633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431879+0000","last_change":"2024-08-31T06:02:30.603465+0000","last_active":"2024-08-31T06:04:16.431879+0000","last_peered":"2024-08-31T06:04:16.431879+0000","last_clean":"2024-08-31T06:04:16.431879+0000","last_became_active":"2024-08-31T06:02:30.603041+0000","last_became_peered":"2024-08-31T06:02:30.603041+0000","last_unstale":"2024-08-31T06:04:16.431879+0000","last_undegraded":"2024-08-31T06:04:16.431879+0000","last_fullsized":"2024-08-31T06:04:16.431879+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:19:00.139973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996811+0000","last_change":"2024-08-31T06:02:30.593807+0000","last_active":"2024-08-31T06:04:16.996811+0000","last_peered":"2024-08-31T06:04:16.996811+0000","last_clean":"2024-08-31T06:04:16.996811+0000","last_became_active":"2024-08-31T06:02:30.593389+0000","last_became_peered":"2024-08-31T06:02:30.593389+0000","last_unstale":"2024-08-31T06:04:16.996811+0000","last_undegraded":"2024-08-31T06:04:16.996811+0000","last_fullsized":"2024-08-31T06:04:16.996811+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:01:04.398867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996779+0000","last_change":"2024-08-31T06:02:30.605207+0000","last_active":"2024-08-31T06:04:16.996779+0000","last_peered":"2024-08-31T06:04:16.996779+0000","last_clean":"2024-08-31T06:04:16.996779+0000","last_became_active":"2024-08-31T06:02:30.604866+0000","last_became_peered":"2024-08-31T06:02:30.604866+0000","last_unstale":"2024-08-31T06:04:16.996779+0000","last_undegraded":"2024-08-31T06:04:16.996779+0000","last_fullsized":"2024-08-31T06:04:16.996779+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:00:56.305638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433428+0000","last_change":"2024-08-31T06:02:30.601457+0000","last_active":"2024-08-31T06:04:16.433428+0000","last_peered":"2024-08-31T06:04:16.433428+0000","last_clean":"2024-08-31T06:04:16.433428+0000","last_became_active":"2024-08-31T06:02:30.601077+0000","last_became_peered":"2024-08-31T06:02:30.601077+0000","last_unstale":"2024-08-31T06:04:16.433428+0000","last_undegraded":"2024-08-31T06:04:16.433428+0000","last_fullsized":"2024-08-31T06:04:16.433428+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:51:42.364801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436274+0000","last_change":"2024-08-31T06:02:30.612475+0000","last_active":"2024-08-31T06:04:16.436274+0000","last_peered":"2024-08-31T06:04:16.436274+0000","last_clean":"2024-08-31T06:04:16.436274+0000","last_became_active":"2024-08-31T06:02:30.612088+0000","last_became_peered":"2024-08-31T06:02:30.612088+0000","last_unstale":"2024-08-31T06:04:16.436274+0000","last_undegraded":"2024-08-31T06:04:16.436274+0000","last_fullsized":"2024-08-31T06:04:16.436274+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:40:34.348645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823774+0000","last_change":"2024-08-31T06:02:30.605612+0000","last_active":"2024-08-31T06:04:16.823774+0000","last_peered":"2024-08-31T06:04:16.823774+0000","last_clean":"2024-08-31T06:04:16.823774+0000","last_became_active":"2024-08-31T06:02:30.605271+0000","last_became_peered":"2024-08-31T06:02:30.605271+0000","last_unstale":"2024-08-31T06:04:16.823774+0000","last_undegraded":"2024-08-31T06:04:16.823774+0000","last_fullsized":"2024-08-31T06:04:16.823774+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:38.003500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438194+0000","last_change":"2024-08-31T06:02:30.610328+0000","last_active":"2024-08-31T06:04:16.438194+0000","last_peered":"2024-08-31T06:04:16.438194+0000","last_clean":"2024-08-31T06:04:16.438194+0000","last_became_active":"2024-08-31T06:02:30.609935+0000","last_became_peered":"2024-08-31T06:02:30.609935+0000","last_unstale":"2024-08-31T06:04:16.438194+0000","last_undegraded":"2024-08-31T06:04:16.438194+0000","last_fullsized":"2024-08-31T06:04:16.438194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:22.147068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435885+0000","last_change":"2024-08-31T06:02:30.609207+0000","last_active":"2024-08-31T06:04:16.435885+0000","last_peered":"2024-08-31T06:04:16.435885+0000","last_clean":"2024-08-31T06:04:16.435885+0000","last_became_active":"2024-08-31T06:02:30.608635+0000","last_became_peered":"2024-08-31T06:02:30.608635+0000","last_unstale":"2024-08-31T06:04:16.435885+0000","last_undegraded":"2024-08-31T06:04:16.435885+0000","last_fullsized":"2024-08-31T06:04:16.435885+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:43.898073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431972+0000","last_change":"2024-08-31T06:02:30.595829+0000","last_active":"2024-08-31T06:04:16.431972+0000","last_peered":"2024-08-31T06:04:16.431972+0000","last_clean":"2024-08-31T06:04:16.431972+0000","last_became_active":"2024-08-31T06:02:30.595427+0000","last_became_peered":"2024-08-31T06:02:30.595427+0000","last_unstale":"2024-08-31T06:04:16.431972+0000","last_undegraded":"2024-08-31T06:04:16.431972+0000","last_fullsized":"2024-08-31T06:04:16.431972+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:09:39.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433777+0000","last_change":"2024-08-31T06:02:30.599513+0000","last_active":"2024-08-31T06:04:16.433777+0000","last_peered":"2024-08-31T06:04:16.433777+0000","last_clean":"2024-08-31T06:04:16.433777+0000","last_became_active":"2024-08-31T06:02:30.599195+0000","last_became_peered":"2024-08-31T06:02:30.599195+0000","last_unstale":"2024-08-31T06:04:16.433777+0000","last_undegraded":"2024-08-31T06:04:16.433777+0000","last_fullsized":"2024-08-31T06:04:16.433777+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:26.669658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437790+0000","last_change":"2024-08-31T06:02:30.609229+0000","last_active":"2024-08-31T06:04:16.437790+0000","last_peered":"2024-08-31T06:04:16.437790+0000","last_clean":"2024-08-31T06:04:16.437790+0000","last_became_active":"2024-08-31T06:02:30.608536+0000","last_became_peered":"2024-08-31T06:02:30.608536+0000","last_unstale":"2024-08-31T06:04:16.437790+0000","last_undegraded":"2024-08-31T06:04:16.437790+0000","last_fullsized":"2024-08-31T06:04:16.437790+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:08.917901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825521+0000","last_change":"2024-08-31T06:02:30.603663+0000","last_active":"2024-08-31T06:04:16.825521+0000","last_peered":"2024-08-31T06:04:16.825521+0000","last_clean":"2024-08-31T06:04:16.825521+0000","last_became_active":"2024-08-31T06:02:30.603220+0000","last_became_peered":"2024-08-31T06:02:30.603220+0000","last_unstale":"2024-08-31T06:04:16.825521+0000","last_undegraded":"2024-08-31T06:04:16.825521+0000","last_fullsized":"2024-08-31T06:04:16.825521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:09.433078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438040+0000","last_change":"2024-08-31T06:02:30.608474+0000","last_active":"2024-08-31T06:04:16.438040+0000","last_peered":"2024-08-31T06:04:16.438040+0000","last_clean":"2024-08-31T06:04:16.438040+0000","last_became_active":"2024-08-31T06:02:30.608118+0000","last_became_peered":"2024-08-31T06:02:30.608118+0000","last_unstale":"2024-08-31T06:04:16.438040+0000","last_undegraded":"2024-08-31T06:04:16.438040+0000","last_fullsized":"2024-08-31T06:04:16.438040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:55.124001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438523+0000","last_change":"2024-08-31T06:02:30.614255+0000","last_active":"2024-08-31T06:04:16.438523+0000","last_peered":"2024-08-31T06:04:16.438523+0000","last_clean":"2024-08-31T06:04:16.438523+0000","last_became_active":"2024-08-31T06:02:30.613805+0000","last_became_peered":"2024-08-31T06:02:30.613805+0000","last_unstale":"2024-08-31T06:04:16.438523+0000","last_undegraded":"2024-08-31T06:04:16.438523+0000","last_fullsized":"2024-08-31T06:04:16.438523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.892997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436018+0000","last_change":"2024-08-31T06:02:30.609877+0000","last_active":"2024-08-31T06:04:16.436018+0000","last_peered":"2024-08-31T06:04:16.436018+0000","last_clean":"2024-08-31T06:04:16.436018+0000","last_became_active":"2024-08-31T06:02:30.608805+0000","last_became_peered":"2024-08-31T06:02:30.608805+0000","last_unstale":"2024-08-31T06:04:16.436018+0000","last_undegraded":"2024-08-31T06:04:16.436018+0000","last_fullsized":"2024-08-31T06:04:16.436018+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:52.172745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"72'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431812+0000","last_change":"2024-08-31T06:02:30.594684+0000","last_active":"2024-08-31T06:04:16.431812+0000","last_peered":"2024-08-31T06:04:16.431812+0000","last_clean":"2024-08-31T06:04:16.431812+0000","last_became_active":"2024-08-31T06:02:30.594293+0000","last_became_peered":"2024-08-31T06:02:30.594293+0000","last_unstale":"2024-08-31T06:04:16.431812+0000","last_undegraded":"2024-08-31T06:04:16.431812+0000","last_fullsized":"2024-08-31T06:04:16.431812+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:58:39.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997091+0000","last_change":"2024-08-31T06:02:30.602765+0000","last_active":"2024-08-31T06:04:16.997091+0000","last_peered":"2024-08-31T06:04:16.997091+0000","last_clean":"2024-08-31T06:04:16.997091+0000","last_became_active":"2024-08-31T06:02:30.602410+0000","last_became_peered":"2024-08-31T06:02:30.602410+0000","last_unstale":"2024-08-31T06:04:16.997091+0000","last_undegraded":"2024-08-31T06:04:16.997091+0000","last_fullsized":"2024-08-31T06:04:16.997091+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:12.370967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"72'8","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438071+0000","last_change":"2024-08-31T06:02:30.611818+0000","last_active":"2024-08-31T06:04:16.438071+0000","last_peered":"2024-08-31T06:04:16.438071+0000","last_clean":"2024-08-31T06:04:16.438071+0000","last_became_active":"2024-08-31T06:02:30.610917+0000","last_became_peered":"2024-08-31T06:02:30.610917+0000","last_unstale":"2024-08-31T06:04:16.438071+0000","last_undegraded":"2024-08-31T06:04:16.438071+0000","last_fullsized":"2024-08-31T06:04:16.438071+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:06:00.895825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"72'12","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438398+0000","last_change":"2024-08-31T06:02:30.612186+0000","last_active":"2024-08-31T06:04:16.438398+0000","last_peered":"2024-08-31T06:04:16.438398+0000","last_clean":"2024-08-31T06:04:16.438398+0000","last_became_active":"2024-08-31T06:02:30.610496+0000","last_became_peered":"2024-08-31T06:02:30.610496+0000","last_unstale":"2024-08-31T06:04:16.438398+0000","last_undegraded":"2024-08-31T06:04:16.438398+0000","last_fullsized":"2024-08-31T06:04:16.438398+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:48:19.954998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"72'9","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435818+0000","last_change":"2024-08-31T06:03:15.776507+0000","last_active":"2024-08-31T06:04:16.435818+0000","last_peered":"2024-08-31T06:04:16.435818+0000","last_clean":"2024-08-31T06:04:16.435818+0000","last_became_active":"2024-08-31T06:03:15.776039+0000","last_became_peered":"2024-08-31T06:03:15.776039+0000","last_unstale":"2024-08-31T06:04:16.435818+0000","last_undegraded":"2024-08-31T06:04:16.435818+0000","last_fullsized":"2024-08-31T06:04:16.435818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:41.616112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997530+0000","last_change":"2024-08-31T06:02:30.607864+0000","last_active":"2024-08-31T06:04:16.997530+0000","last_peered":"2024-08-31T06:04:16.997530+0000","last_clean":"2024-08-31T06:04:16.997530+0000","last_became_active":"2024-08-31T06:02:30.607299+0000","last_became_peered":"2024-08-31T06:02:30.607299+0000","last_unstale":"2024-08-31T06:04:16.997530+0000","last_undegraded":"2024-08-31T06:04:16.997530+0000","last_fullsized":"2024-08-31T06:04:16.997530+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:19.302279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'8","reported_seq":153,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:33.851304+0000","last_change":"2024-08-31T06:02:28.594973+0000","last_active":"2024-08-31T06:04:33.851304+0000","last_peered":"2024-08-31T06:04:33.851304+0000","last_clean":"2024-08-31T06:04:33.851304+0000","last_became_active":"2024-08-31T06:02:28.594588+0000","last_became_peered":"2024-08-31T06:02:28.594588+0000","last_unstale":"2024-08-31T06:04:33.851304+0000","last_undegraded":"2024-08-31T06:04:33.851304+0000","last_fullsized":"2024-08-31T06:04:33.851304+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:29:48.016888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"72'8","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825760+0000","last_change":"2024-08-31T06:03:15.974504+0000","last_active":"2024-08-31T06:04:16.825760+0000","last_peered":"2024-08-31T06:04:16.825760+0000","last_clean":"2024-08-31T06:04:16.825760+0000","last_became_active":"2024-08-31T06:03:15.974139+0000","last_became_peered":"2024-08-31T06:03:15.974139+0000","last_unstale":"2024-08-31T06:04:16.825760+0000","last_undegraded":"2024-08-31T06:04:16.825760+0000","last_fullsized":"2024-08-31T06:04:16.825760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:37:22.742884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433751+0000","last_change":"2024-08-31T06:02:28.589152+0000","last_active":"2024-08-31T06:04:16.433751+0000","last_peered":"2024-08-31T06:04:16.433751+0000","last_clean":"2024-08-31T06:04:16.433751+0000","last_became_active":"2024-08-31T06:02:28.588758+0000","last_became_peered":"2024-08-31T06:02:28.588758+0000","last_unstale":"2024-08-31T06:04:16.433751+0000","last_undegraded":"2024-08-31T06:04:16.433751+0000","last_fullsized":"2024-08-31T06:04:16.433751+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:02:31.814105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"70'3","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431439+0000","last_change":"2024-08-31T06:02:28.585410+0000","last_active":"2024-08-31T06:04:16.431439+0000","last_peered":"2024-08-31T06:04:16.431439+0000","last_clean":"2024-08-31T06:04:16.431439+0000","last_became_active":"2024-08-31T06:02:28.584998+0000","last_became_peered":"2024-08-31T06:02:28.584998+0000","last_unstale":"2024-08-31T06:04:16.431439+0000","last_undegraded":"2024-08-31T06:04:16.431439+0000","last_fullsized":"2024-08-31T06:04:16.431439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:30.705460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437844+0000","last_change":"2024-08-31T06:02:30.597295+0000","last_active":"2024-08-31T06:04:16.437844+0000","last_peered":"2024-08-31T06:04:16.437844+0000","last_clean":"2024-08-31T06:04:16.437844+0000","last_became_active":"2024-08-31T06:02:30.596968+0000","last_became_peered":"2024-08-31T06:02:30.596968+0000","last_unstale":"2024-08-31T06:04:16.437844+0000","last_undegraded":"2024-08-31T06:04:16.437844+0000","last_fullsized":"2024-08-31T06:04:16.437844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:38.781048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"70'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825895+0000","last_change":"2024-08-31T06:02:28.594164+0000","last_active":"2024-08-31T06:04:16.825895+0000","last_peered":"2024-08-31T06:04:16.825895+0000","last_clean":"2024-08-31T06:04:16.825895+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.825895+0000","last_undegraded":"2024-08-31T06:04:16.825895+0000","last_fullsized":"2024-08-31T06:04:16.825895+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:54:21.780202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823573+0000","last_change":"2024-08-31T06:02:30.597500+0000","last_active":"2024-08-31T06:04:16.823573+0000","last_peered":"2024-08-31T06:04:16.823573+0000","last_clean":"2024-08-31T06:04:16.823573+0000","last_became_active":"2024-08-31T06:02:30.597147+0000","last_became_peered":"2024-08-31T06:02:30.597147+0000","last_unstale":"2024-08-31T06:04:16.823573+0000","last_undegraded":"2024-08-31T06:04:16.823573+0000","last_fullsized":"2024-08-31T06:04:16.823573+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:34.111288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'6","reported_seq":265,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:37.856008+0000","last_change":"2024-08-31T06:02:28.585769+0000","last_active":"2024-08-31T06:04:37.856008+0000","last_peered":"2024-08-31T06:04:37.856008+0000","last_clean":"2024-08-31T06:04:37.856008+0000","last_became_active":"2024-08-31T06:02:28.585310+0000","last_became_peered":"2024-08-31T06:02:28.585310+0000","last_unstale":"2024-08-31T06:04:37.856008+0000","last_undegraded":"2024-08-31T06:04:37.856008+0000","last_fullsized":"2024-08-31T06:04:37.856008+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:40.595986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"72'10","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.434873+0000","last_change":"2024-08-31T06:02:30.601434+0000","last_active":"2024-08-31T06:04:16.434873+0000","last_peered":"2024-08-31T06:04:16.434873+0000","last_clean":"2024-08-31T06:04:16.434873+0000","last_became_active":"2024-08-31T06:02:30.601060+0000","last_became_peered":"2024-08-31T06:02:30.601060+0000","last_unstale":"2024-08-31T06:04:16.434873+0000","last_undegraded":"2024-08-31T06:04:16.434873+0000","last_fullsized":"2024-08-31T06:04:16.434873+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:32.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"70'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826424+0000","last_change":"2024-08-31T06:02:28.593217+0000","last_active":"2024-08-31T06:04:16.826424+0000","last_peered":"2024-08-31T06:04:16.826424+0000","last_clean":"2024-08-31T06:04:16.826424+0000","last_became_active":"2024-08-31T06:02:28.592801+0000","last_became_peered":"2024-08-31T06:02:28.592801+0000","last_unstale":"2024-08-31T06:04:16.826424+0000","last_undegraded":"2024-08-31T06:04:16.826424+0000","last_fullsized":"2024-08-31T06:04:16.826424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:21.561089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"72'9","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997237+0000","last_change":"2024-08-31T06:03:15.770625+0000","last_active":"2024-08-31T06:04:16.997237+0000","last_peered":"2024-08-31T06:04:16.997237+0000","last_clean":"2024-08-31T06:04:16.997237+0000","last_became_active":"2024-08-31T06:03:15.770194+0000","last_became_peered":"2024-08-31T06:03:15.770194+0000","last_unstale":"2024-08-31T06:04:16.997237+0000","last_undegraded":"2024-08-31T06:04:16.997237+0000","last_fullsized":"2024-08-31T06:04:16.997237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:33:57.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825884+0000","last_change":"2024-08-31T06:02:28.781606+0000","last_active":"2024-08-31T06:04:16.825884+0000","last_peered":"2024-08-31T06:04:16.825884+0000","last_clean":"2024-08-31T06:04:16.825884+0000","last_became_active":"2024-08-31T06:02:28.780886+0000","last_became_peered":"2024-08-31T06:02:28.780886+0000","last_unstale":"2024-08-31T06:04:16.825884+0000","last_undegraded":"2024-08-31T06:04:16.825884+0000","last_fullsized":"2024-08-31T06:04:16.825884+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:15:07.540461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"72'11","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433810+0000","last_change":"2024-08-31T06:02:30.604358+0000","last_active":"2024-08-31T06:04:16.433810+0000","last_peered":"2024-08-31T06:04:16.433810+0000","last_clean":"2024-08-31T06:04:16.433810+0000","last_became_active":"2024-08-31T06:02:30.603980+0000","last_became_peered":"2024-08-31T06:02:30.603980+0000","last_unstale":"2024-08-31T06:04:16.433810+0000","last_undegraded":"2024-08-31T06:04:16.433810+0000","last_fullsized":"2024-08-31T06:04:16.433810+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:43:03.062141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'35","reported_seq":307,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:37.856009+0000","last_change":"2024-08-31T06:02:28.590795+0000","last_active":"2024-08-31T06:04:37.856009+0000","last_peered":"2024-08-31T06:04:37.856009+0000","last_clean":"2024-08-31T06:04:37.856009+0000","last_became_active":"2024-08-31T06:02:28.590397+0000","last_became_peered":"2024-08-31T06:02:28.590397+0000","last_unstale":"2024-08-31T06:04:37.856009+0000","last_undegraded":"2024-08-31T06:04:37.856009+0000","last_fullsized":"2024-08-31T06:04:37.856009+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:04:30.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64818,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":245,"num_read_kb":186,"num_write":37,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997865+0000","last_change":"2024-08-31T06:02:30.603110+0000","last_active":"2024-08-31T06:04:16.997865+0000","last_peered":"2024-08-31T06:04:16.997865+0000","last_clean":"2024-08-31T06:04:16.997865+0000","last_became_active":"2024-08-31T06:02:30.602691+0000","last_became_peered":"2024-08-31T06:02:30.602691+0000","last_unstale":"2024-08-31T06:04:16.997865+0000","last_undegraded":"2024-08-31T06:04:16.997865+0000","last_fullsized":"2024-08-31T06:04:16.997865+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:20.009202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"70'9","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.449977+0000","last_change":"2024-08-31T06:04:16.449444+0000","last_active":"2024-08-31T06:04:16.449977+0000","last_peered":"2024-08-31T06:04:16.449977+0000","last_clean":"2024-08-31T06:04:16.449977+0000","last_became_active":"2024-08-31T06:04:16.439087+0000","last_became_peered":"2024-08-31T06:04:16.439087+0000","last_unstale":"2024-08-31T06:04:16.449977+0000","last_undegraded":"2024-08-31T06:04:16.449977+0000","last_fullsized":"2024-08-31T06:04:16.449977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:50:38.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431600+0000","last_change":"2024-08-31T06:02:30.599843+0000","last_active":"2024-08-31T06:04:16.431600+0000","last_peered":"2024-08-31T06:04:16.431600+0000","last_clean":"2024-08-31T06:04:16.431600+0000","last_became_active":"2024-08-31T06:02:30.599440+0000","last_became_peered":"2024-08-31T06:02:30.599440+0000","last_unstale":"2024-08-31T06:04:16.431600+0000","last_undegraded":"2024-08-31T06:04:16.431600+0000","last_fullsized":"2024-08-31T06:04:16.431600+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:01.029482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825714+0000","last_change":"2024-08-31T06:02:28.594178+0000","last_active":"2024-08-31T06:04:16.825714+0000","last_peered":"2024-08-31T06:04:16.825714+0000","last_clean":"2024-08-31T06:04:16.825714+0000","last_became_active":"2024-08-31T06:02:28.593802+0000","last_became_peered":"2024-08-31T06:02:28.593802+0000","last_unstale":"2024-08-31T06:04:16.825714+0000","last_undegraded":"2024-08-31T06:04:16.825714+0000","last_fullsized":"2024-08-31T06:04:16.825714+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:52.561582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826106+0000","last_change":"2024-08-31T06:02:30.595979+0000","last_active":"2024-08-31T06:04:16.826106+0000","last_peered":"2024-08-31T06:04:16.826106+0000","last_clean":"2024-08-31T06:04:16.826106+0000","last_became_active":"2024-08-31T06:02:30.595665+0000","last_became_peered":"2024-08-31T06:02:30.595665+0000","last_unstale":"2024-08-31T06:04:16.826106+0000","last_undegraded":"2024-08-31T06:04:16.826106+0000","last_fullsized":"2024-08-31T06:04:16.826106+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:40.347954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'8","reported_seq":155,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:35.853944+0000","last_change":"2024-08-31T06:02:28.594117+0000","last_active":"2024-08-31T06:04:35.853944+0000","last_peered":"2024-08-31T06:04:35.853944+0000","last_clean":"2024-08-31T06:04:35.853944+0000","last_became_active":"2024-08-31T06:02:28.593721+0000","last_became_peered":"2024-08-31T06:02:28.593721+0000","last_unstale":"2024-08-31T06:04:35.853944+0000","last_undegraded":"2024-08-31T06:04:35.853944+0000","last_fullsized":"2024-08-31T06:04:35.853944+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:48:49.400841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825844+0000","last_change":"2024-08-31T06:02:30.606967+0000","last_active":"2024-08-31T06:04:16.825844+0000","last_peered":"2024-08-31T06:04:16.825844+0000","last_clean":"2024-08-31T06:04:16.825844+0000","last_became_active":"2024-08-31T06:02:30.605730+0000","last_became_peered":"2024-08-31T06:02:30.605730+0000","last_unstale":"2024-08-31T06:04:16.825844+0000","last_undegraded":"2024-08-31T06:04:16.825844+0000","last_fullsized":"2024-08-31T06:04:16.825844+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:30.656071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"70'17","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997489+0000","last_change":"2024-08-31T06:02:28.780911+0000","last_active":"2024-08-31T06:04:16.997489+0000","last_peered":"2024-08-31T06:04:16.997489+0000","last_clean":"2024-08-31T06:04:16.997489+0000","last_became_active":"2024-08-31T06:02:28.780375+0000","last_became_peered":"2024-08-31T06:02:28.780375+0000","last_unstale":"2024-08-31T06:04:16.997489+0000","last_undegraded":"2024-08-31T06:04:16.997489+0000","last_fullsized":"2024-08-31T06:04:16.997489+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:33:46.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"72'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825581+0000","last_change":"2024-08-31T06:02:30.606871+0000","last_active":"2024-08-31T06:04:16.825581+0000","last_peered":"2024-08-31T06:04:16.825581+0000","last_clean":"2024-08-31T06:04:16.825581+0000","last_became_active":"2024-08-31T06:02:30.606507+0000","last_became_peered":"2024-08-31T06:02:30.606507+0000","last_unstale":"2024-08-31T06:04:16.825581+0000","last_undegraded":"2024-08-31T06:04:16.825581+0000","last_fullsized":"2024-08-31T06:04:16.825581+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:16:31.502034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998046+0000","last_change":"2024-08-31T06:02:28.588078+0000","last_active":"2024-08-31T06:04:16.998046+0000","last_peered":"2024-08-31T06:04:16.998046+0000","last_clean":"2024-08-31T06:04:16.998046+0000","last_became_active":"2024-08-31T06:02:28.587642+0000","last_became_peered":"2024-08-31T06:02:28.587642+0000","last_unstale":"2024-08-31T06:04:16.998046+0000","last_undegraded":"2024-08-31T06:04:16.998046+0000","last_fullsized":"2024-08-31T06:04:16.998046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:59.479987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.436127+0000","last_change":"2024-08-31T06:02:30.605647+0000","last_active":"2024-08-31T06:04:16.436127+0000","last_peered":"2024-08-31T06:04:16.436127+0000","last_clean":"2024-08-31T06:04:16.436127+0000","last_became_active":"2024-08-31T06:02:30.605267+0000","last_became_peered":"2024-08-31T06:02:30.605267+0000","last_unstale":"2024-08-31T06:04:16.436127+0000","last_undegraded":"2024-08-31T06:04:16.436127+0000","last_fullsized":"2024-08-31T06:04:16.436127+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:08:34.741030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"70'5","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431745+0000","last_change":"2024-08-31T06:02:28.585295+0000","last_active":"2024-08-31T06:04:16.431745+0000","last_peered":"2024-08-31T06:04:16.431745+0000","last_clean":"2024-08-31T06:04:16.431745+0000","last_became_active":"2024-08-31T06:02:28.584895+0000","last_became_peered":"2024-08-31T06:02:28.584895+0000","last_unstale":"2024-08-31T06:04:16.431745+0000","last_undegraded":"2024-08-31T06:04:16.431745+0000","last_fullsized":"2024-08-31T06:04:16.431745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:57:12.658937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826465+0000","last_change":"2024-08-31T06:02:30.603593+0000","last_active":"2024-08-31T06:04:16.826465+0000","last_peered":"2024-08-31T06:04:16.826465+0000","last_clean":"2024-08-31T06:04:16.826465+0000","last_became_active":"2024-08-31T06:02:30.603274+0000","last_became_peered":"2024-08-31T06:02:30.603274+0000","last_unstale":"2024-08-31T06:04:16.826465+0000","last_undegraded":"2024-08-31T06:04:16.826465+0000","last_fullsized":"2024-08-31T06:04:16.826465+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:42:07.720406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'62","reported_seq":119,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:32.280744+0000","last_change":"2024-08-31T06:02:28.586920+0000","last_active":"2024-08-31T06:04:32.280744+0000","last_peered":"2024-08-31T06:04:32.280744+0000","last_clean":"2024-08-31T06:04:32.280744+0000","last_became_active":"2024-08-31T06:02:28.586362+0000","last_became_peered":"2024-08-31T06:02:28.586362+0000","last_unstale":"2024-08-31T06:04:32.280744+0000","last_undegraded":"2024-08-31T06:04:32.280744+0000","last_fullsized":"2024-08-31T06:04:32.280744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:52.065879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826269+0000","last_change":"2024-08-31T06:02:30.603800+0000","last_active":"2024-08-31T06:04:16.826269+0000","last_peered":"2024-08-31T06:04:16.826269+0000","last_clean":"2024-08-31T06:04:16.826269+0000","last_became_active":"2024-08-31T06:02:30.603439+0000","last_became_peered":"2024-08-31T06:02:30.603439+0000","last_unstale":"2024-08-31T06:04:16.826269+0000","last_undegraded":"2024-08-31T06:04:16.826269+0000","last_fullsized":"2024-08-31T06:04:16.826269+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:38:39.992719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":149,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:33.851078+0000","last_change":"2024-08-31T06:02:28.936404+0000","last_active":"2024-08-31T06:04:33.851078+0000","last_peered":"2024-08-31T06:04:33.851078+0000","last_clean":"2024-08-31T06:04:33.851078+0000","last_became_active":"2024-08-31T06:02:28.935898+0000","last_became_peered":"2024-08-31T06:02:28.935898+0000","last_unstale":"2024-08-31T06:04:33.851078+0000","last_undegraded":"2024-08-31T06:04:33.851078+0000","last_fullsized":"2024-08-31T06:04:33.851078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:01:35.004510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1663,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"72'7","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826610+0000","last_change":"2024-08-31T06:02:30.608258+0000","last_active":"2024-08-31T06:04:16.826610+0000","last_peered":"2024-08-31T06:04:16.826610+0000","last_clean":"2024-08-31T06:04:16.826610+0000","last_became_active":"2024-08-31T06:02:30.607067+0000","last_became_peered":"2024-08-31T06:02:30.607067+0000","last_unstale":"2024-08-31T06:04:16.826610+0000","last_undegraded":"2024-08-31T06:04:16.826610+0000","last_fullsized":"2024-08-31T06:04:16.826610+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:03:09.362812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":97,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826255+0000","last_change":"2024-08-31T06:01:19.125033+0000","last_active":"2024-08-31T06:04:16.826255+0000","last_peered":"2024-08-31T06:04:16.826255+0000","last_clean":"2024-08-31T06:04:16.826255+0000","last_became_active":"2024-08-31T06:01:19.118469+0000","last_became_peered":"2024-08-31T06:01:19.118469+0000","last_unstale":"2024-08-31T06:04:16.826255+0000","last_undegraded":"2024-08-31T06:04:16.826255+0000","last_fullsized":"2024-08-31T06:04:16.826255+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:58:05.259854+0000","last_clean_scrub_stamp":"2024-08-31T05:58:05.259854+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:33.848382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"70'6","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826960+0000","last_change":"2024-08-31T06:02:28.588276+0000","last_active":"2024-08-31T06:04:16.826960+0000","last_peered":"2024-08-31T06:04:16.826960+0000","last_clean":"2024-08-31T06:04:16.826960+0000","last_became_active":"2024-08-31T06:02:28.587184+0000","last_became_peered":"2024-08-31T06:02:28.587184+0000","last_unstale":"2024-08-31T06:04:16.826960+0000","last_undegraded":"2024-08-31T06:04:16.826960+0000","last_fullsized":"2024-08-31T06:04:16.826960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:55:12.762919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437980+0000","last_change":"2024-08-31T06:02:30.610801+0000","last_active":"2024-08-31T06:04:16.437980+0000","last_peered":"2024-08-31T06:04:16.437980+0000","last_clean":"2024-08-31T06:04:16.437980+0000","last_became_active":"2024-08-31T06:02:30.610446+0000","last_became_peered":"2024-08-31T06:02:30.610446+0000","last_unstale":"2024-08-31T06:04:16.437980+0000","last_undegraded":"2024-08-31T06:04:16.437980+0000","last_fullsized":"2024-08-31T06:04:16.437980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:17.891734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"70'4","reported_seq":43,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826060+0000","last_change":"2024-08-31T06:03:15.777123+0000","last_active":"2024-08-31T06:04:16.826060+0000","last_peered":"2024-08-31T06:04:16.826060+0000","last_clean":"2024-08-31T06:04:16.826060+0000","last_became_active":"2024-08-31T06:03:15.773099+0000","last_became_peered":"2024-08-31T06:03:15.773099+0000","last_unstale":"2024-08-31T06:04:16.826060+0000","last_undegraded":"2024-08-31T06:04:16.826060+0000","last_fullsized":"2024-08-31T06:04:16.826060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:56:51.706692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"72'5","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431502+0000","last_change":"2024-08-31T06:03:15.776402+0000","last_active":"2024-08-31T06:04:16.431502+0000","last_peered":"2024-08-31T06:04:16.431502+0000","last_clean":"2024-08-31T06:04:16.431502+0000","last_became_active":"2024-08-31T06:03:15.775949+0000","last_became_peered":"2024-08-31T06:03:15.775949+0000","last_unstale":"2024-08-31T06:04:16.431502+0000","last_undegraded":"2024-08-31T06:04:16.431502+0000","last_fullsized":"2024-08-31T06:04:16.431502+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:51:34.646125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"72'6","reported_seq":149,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:35.853338+0000","last_change":"2024-08-31T06:02:28.780419+0000","last_active":"2024-08-31T06:04:35.853338+0000","last_peered":"2024-08-31T06:04:35.853338+0000","last_clean":"2024-08-31T06:04:35.853338+0000","last_became_active":"2024-08-31T06:02:28.779814+0000","last_became_peered":"2024-08-31T06:02:28.779814+0000","last_unstale":"2024-08-31T06:04:35.853338+0000","last_undegraded":"2024-08-31T06:04:35.853338+0000","last_fullsized":"2024-08-31T06:04:35.853338+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:36.183841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"72'8","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825689+0000","last_change":"2024-08-31T06:03:15.776468+0000","last_active":"2024-08-31T06:04:16.825689+0000","last_peered":"2024-08-31T06:04:16.825689+0000","last_clean":"2024-08-31T06:04:16.825689+0000","last_became_active":"2024-08-31T06:03:15.776005+0000","last_became_peered":"2024-08-31T06:03:15.776005+0000","last_unstale":"2024-08-31T06:04:16.825689+0000","last_undegraded":"2024-08-31T06:04:16.825689+0000","last_fullsized":"2024-08-31T06:04:16.825689+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:47:36.420584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'6","reported_seq":149,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:34.851997+0000","last_change":"2024-08-31T06:02:28.594220+0000","last_active":"2024-08-31T06:04:34.851997+0000","last_peered":"2024-08-31T06:04:34.851997+0000","last_clean":"2024-08-31T06:04:34.851997+0000","last_became_active":"2024-08-31T06:02:28.593729+0000","last_became_peered":"2024-08-31T06:02:28.593729+0000","last_unstale":"2024-08-31T06:04:34.851997+0000","last_undegraded":"2024-08-31T06:04:34.851997+0000","last_fullsized":"2024-08-31T06:04:34.851997+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:37:03.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"72'7","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433838+0000","last_change":"2024-08-31T06:02:30.600008+0000","last_active":"2024-08-31T06:04:16.433838+0000","last_peered":"2024-08-31T06:04:16.433838+0000","last_clean":"2024-08-31T06:04:16.433838+0000","last_became_active":"2024-08-31T06:02:30.599677+0000","last_became_peered":"2024-08-31T06:02:30.599677+0000","last_unstale":"2024-08-31T06:04:16.433838+0000","last_undegraded":"2024-08-31T06:04:16.433838+0000","last_fullsized":"2024-08-31T06:04:16.433838+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:59.520544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"70'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823656+0000","last_change":"2024-08-31T06:02:28.780554+0000","last_active":"2024-08-31T06:04:16.823656+0000","last_peered":"2024-08-31T06:04:16.823656+0000","last_clean":"2024-08-31T06:04:16.823656+0000","last_became_active":"2024-08-31T06:02:28.780137+0000","last_became_peered":"2024-08-31T06:02:28.780137+0000","last_unstale":"2024-08-31T06:04:16.823656+0000","last_undegraded":"2024-08-31T06:04:16.823656+0000","last_fullsized":"2024-08-31T06:04:16.823656+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:16:57.523667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"72'5","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433939+0000","last_change":"2024-08-31T06:02:30.597438+0000","last_active":"2024-08-31T06:04:16.433939+0000","last_peered":"2024-08-31T06:04:16.433939+0000","last_clean":"2024-08-31T06:04:16.433939+0000","last_became_active":"2024-08-31T06:02:30.597108+0000","last_became_peered":"2024-08-31T06:02:30.597108+0000","last_unstale":"2024-08-31T06:04:16.433939+0000","last_undegraded":"2024-08-31T06:04:16.433939+0000","last_fullsized":"2024-08-31T06:04:16.433939+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:05.238708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"70'4","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998101+0000","last_change":"2024-08-31T06:02:28.781006+0000","last_active":"2024-08-31T06:04:16.998101+0000","last_peered":"2024-08-31T06:04:16.998101+0000","last_clean":"2024-08-31T06:04:16.998101+0000","last_became_active":"2024-08-31T06:02:28.780468+0000","last_became_peered":"2024-08-31T06:02:28.780468+0000","last_unstale":"2024-08-31T06:04:16.998101+0000","last_undegraded":"2024-08-31T06:04:16.998101+0000","last_fullsized":"2024-08-31T06:04:16.998101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:20.206251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"72'9","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.431889+0000","last_change":"2024-08-31T06:02:30.600826+0000","last_active":"2024-08-31T06:04:16.431889+0000","last_peered":"2024-08-31T06:04:16.431889+0000","last_clean":"2024-08-31T06:04:16.431889+0000","last_became_active":"2024-08-31T06:02:30.600474+0000","last_became_peered":"2024-08-31T06:02:30.600474+0000","last_unstale":"2024-08-31T06:04:16.431889+0000","last_undegraded":"2024-08-31T06:04:16.431889+0000","last_fullsized":"2024-08-31T06:04:16.431889+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:07.456576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'101","reported_seq":218,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:32.644003+0000","last_change":"2024-08-31T06:02:28.588026+0000","last_active":"2024-08-31T06:04:32.644003+0000","last_peered":"2024-08-31T06:04:32.644003+0000","last_clean":"2024-08-31T06:04:32.644003+0000","last_became_active":"2024-08-31T06:02:28.587759+0000","last_became_peered":"2024-08-31T06:02:28.587759+0000","last_unstale":"2024-08-31T06:04:32.644003+0000","last_undegraded":"2024-08-31T06:04:32.644003+0000","last_fullsized":"2024-08-31T06:04:32.644003+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:44.323111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":184,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438064+0000","last_change":"2024-08-31T06:02:30.604375+0000","last_active":"2024-08-31T06:04:16.438064+0000","last_peered":"2024-08-31T06:04:16.438064+0000","last_clean":"2024-08-31T06:04:16.438064+0000","last_became_active":"2024-08-31T06:02:30.604008+0000","last_became_peered":"2024-08-31T06:02:30.604008+0000","last_unstale":"2024-08-31T06:04:16.438064+0000","last_undegraded":"2024-08-31T06:04:16.438064+0000","last_fullsized":"2024-08-31T06:04:16.438064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:37.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"70'7","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.827216+0000","last_change":"2024-08-31T06:02:28.936568+0000","last_active":"2024-08-31T06:04:16.827216+0000","last_peered":"2024-08-31T06:04:16.827216+0000","last_clean":"2024-08-31T06:04:16.827216+0000","last_became_active":"2024-08-31T06:02:28.936185+0000","last_became_peered":"2024-08-31T06:02:28.936185+0000","last_unstale":"2024-08-31T06:04:16.827216+0000","last_undegraded":"2024-08-31T06:04:16.827216+0000","last_fullsized":"2024-08-31T06:04:16.827216+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:45:34.080300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"72'7","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.996996+0000","last_change":"2024-08-31T06:03:15.771653+0000","last_active":"2024-08-31T06:04:16.996996+0000","last_peered":"2024-08-31T06:04:16.996996+0000","last_clean":"2024-08-31T06:04:16.996996+0000","last_became_active":"2024-08-31T06:03:15.770903+0000","last_became_peered":"2024-08-31T06:03:15.770903+0000","last_unstale":"2024-08-31T06:04:16.996996+0000","last_undegraded":"2024-08-31T06:04:16.996996+0000","last_fullsized":"2024-08-31T06:04:16.996996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:50.547558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"70'2","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433650+0000","last_change":"2024-08-31T06:03:15.777577+0000","last_active":"2024-08-31T06:04:16.433650+0000","last_peered":"2024-08-31T06:04:16.433650+0000","last_clean":"2024-08-31T06:04:16.433650+0000","last_became_active":"2024-08-31T06:03:15.773006+0000","last_became_peered":"2024-08-31T06:03:15.773006+0000","last_unstale":"2024-08-31T06:04:16.433650+0000","last_undegraded":"2024-08-31T06:04:16.433650+0000","last_fullsized":"2024-08-31T06:04:16.433650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:31.531741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"72'2","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997519+0000","last_change":"2024-08-31T06:02:30.604018+0000","last_active":"2024-08-31T06:04:16.997519+0000","last_peered":"2024-08-31T06:04:16.997519+0000","last_clean":"2024-08-31T06:04:16.997519+0000","last_became_active":"2024-08-31T06:02:30.603411+0000","last_became_peered":"2024-08-31T06:02:30.603411+0000","last_unstale":"2024-08-31T06:04:16.997519+0000","last_undegraded":"2024-08-31T06:04:16.997519+0000","last_fullsized":"2024-08-31T06:04:16.997519+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:34:30.732954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"70'7","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.437921+0000","last_change":"2024-08-31T06:02:28.586348+0000","last_active":"2024-08-31T06:04:16.437921+0000","last_peered":"2024-08-31T06:04:16.437921+0000","last_clean":"2024-08-31T06:04:16.437921+0000","last_became_active":"2024-08-31T06:02:28.586046+0000","last_became_peered":"2024-08-31T06:02:28.586046+0000","last_unstale":"2024-08-31T06:04:16.437921+0000","last_undegraded":"2024-08-31T06:04:16.437921+0000","last_fullsized":"2024-08-31T06:04:16.437921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:30.987232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.435839+0000","last_change":"2024-08-31T06:02:30.616402+0000","last_active":"2024-08-31T06:04:16.435839+0000","last_peered":"2024-08-31T06:04:16.435839+0000","last_clean":"2024-08-31T06:04:16.435839+0000","last_became_active":"2024-08-31T06:02:30.616014+0000","last_became_peered":"2024-08-31T06:02:30.616014+0000","last_unstale":"2024-08-31T06:04:16.435839+0000","last_undegraded":"2024-08-31T06:04:16.435839+0000","last_fullsized":"2024-08-31T06:04:16.435839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:42.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'4","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438077+0000","last_change":"2024-08-31T06:02:28.590184+0000","last_active":"2024-08-31T06:04:16.438077+0000","last_peered":"2024-08-31T06:04:16.438077+0000","last_clean":"2024-08-31T06:04:16.438077+0000","last_became_active":"2024-08-31T06:02:28.588830+0000","last_became_peered":"2024-08-31T06:02:28.588830+0000","last_unstale":"2024-08-31T06:04:16.438077+0000","last_undegraded":"2024-08-31T06:04:16.438077+0000","last_fullsized":"2024-08-31T06:04:16.438077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:03.072197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"72'8","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438070+0000","last_change":"2024-08-31T06:02:30.597262+0000","last_active":"2024-08-31T06:04:16.438070+0000","last_peered":"2024-08-31T06:04:16.438070+0000","last_clean":"2024-08-31T06:04:16.438070+0000","last_became_active":"2024-08-31T06:02:30.596862+0000","last_became_peered":"2024-08-31T06:02:30.596862+0000","last_unstale":"2024-08-31T06:04:16.438070+0000","last_undegraded":"2024-08-31T06:04:16.438070+0000","last_fullsized":"2024-08-31T06:04:16.438070+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:46:29.378532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"70'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997626+0000","last_change":"2024-08-31T06:02:28.594161+0000","last_active":"2024-08-31T06:04:16.997626+0000","last_peered":"2024-08-31T06:04:16.997626+0000","last_clean":"2024-08-31T06:04:16.997626+0000","last_became_active":"2024-08-31T06:02:28.593758+0000","last_became_peered":"2024-08-31T06:02:28.593758+0000","last_unstale":"2024-08-31T06:04:16.997626+0000","last_undegraded":"2024-08-31T06:04:16.997626+0000","last_fullsized":"2024-08-31T06:04:16.997626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:31:17.941172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"72'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.826133+0000","last_change":"2024-08-31T06:02:30.595194+0000","last_active":"2024-08-31T06:04:16.826133+0000","last_peered":"2024-08-31T06:04:16.826133+0000","last_clean":"2024-08-31T06:04:16.826133+0000","last_became_active":"2024-08-31T06:02:30.594812+0000","last_became_peered":"2024-08-31T06:02:30.594812+0000","last_unstale":"2024-08-31T06:04:16.826133+0000","last_undegraded":"2024-08-31T06:04:16.826133+0000","last_fullsized":"2024-08-31T06:04:16.826133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:03.224924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"72'15","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.825830+0000","last_change":"2024-08-31T06:02:30.615776+0000","last_active":"2024-08-31T06:04:16.825830+0000","last_peered":"2024-08-31T06:04:16.825830+0000","last_clean":"2024-08-31T06:04:16.825830+0000","last_became_active":"2024-08-31T06:02:30.615385+0000","last_became_peered":"2024-08-31T06:02:30.615385+0000","last_unstale":"2024-08-31T06:04:16.825830+0000","last_undegraded":"2024-08-31T06:04:16.825830+0000","last_fullsized":"2024-08-31T06:04:16.825830+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:49.685443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"70'5","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997930+0000","last_change":"2024-08-31T06:02:28.591064+0000","last_active":"2024-08-31T06:04:16.997930+0000","last_peered":"2024-08-31T06:04:16.997930+0000","last_clean":"2024-08-31T06:04:16.997930+0000","last_became_active":"2024-08-31T06:02:28.590643+0000","last_became_peered":"2024-08-31T06:02:28.590643+0000","last_unstale":"2024-08-31T06:04:16.997930+0000","last_undegraded":"2024-08-31T06:04:16.997930+0000","last_fullsized":"2024-08-31T06:04:16.997930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:01.953317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"72'9","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.433533+0000","last_change":"2024-08-31T06:02:30.600532+0000","last_active":"2024-08-31T06:04:16.433533+0000","last_peered":"2024-08-31T06:04:16.433533+0000","last_clean":"2024-08-31T06:04:16.433533+0000","last_became_active":"2024-08-31T06:02:30.600013+0000","last_became_peered":"2024-08-31T06:02:30.600013+0000","last_unstale":"2024-08-31T06:04:16.433533+0000","last_undegraded":"2024-08-31T06:04:16.433533+0000","last_fullsized":"2024-08-31T06:04:16.433533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:38.753206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"70'12","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.998027+0000","last_change":"2024-08-31T06:02:28.593921+0000","last_active":"2024-08-31T06:04:16.998027+0000","last_peered":"2024-08-31T06:04:16.998027+0000","last_clean":"2024-08-31T06:04:16.998027+0000","last_became_active":"2024-08-31T06:02:28.593102+0000","last_became_peered":"2024-08-31T06:02:28.593102+0000","last_unstale":"2024-08-31T06:04:16.998027+0000","last_undegraded":"2024-08-31T06:04:16.998027+0000","last_fullsized":"2024-08-31T06:04:16.998027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:30:35.791686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"72'6","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.997230+0000","last_change":"2024-08-31T06:02:30.606524+0000","last_active":"2024-08-31T06:04:16.997230+0000","last_peered":"2024-08-31T06:04:16.997230+0000","last_clean":"2024-08-31T06:04:16.997230+0000","last_became_active":"2024-08-31T06:02:30.606132+0000","last_became_peered":"2024-08-31T06:02:30.606132+0000","last_unstale":"2024-08-31T06:04:16.997230+0000","last_undegraded":"2024-08-31T06:04:16.997230+0000","last_fullsized":"2024-08-31T06:04:16.997230+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:46.566811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"70'2","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.438165+0000","last_change":"2024-08-31T06:02:28.780596+0000","last_active":"2024-08-31T06:04:16.438165+0000","last_peered":"2024-08-31T06:04:16.438165+0000","last_clean":"2024-08-31T06:04:16.438165+0000","last_became_active":"2024-08-31T06:02:28.779908+0000","last_became_peered":"2024-08-31T06:02:28.779908+0000","last_unstale":"2024-08-31T06:04:16.438165+0000","last_undegraded":"2024-08-31T06:04:16.438165+0000","last_fullsized":"2024-08-31T06:04:16.438165+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:49:01.254340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"72'5","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:16.823599+0000","last_change":"2024-08-31T06:03:15.776271+0000","last_active":"2024-08-31T06:04:16.823599+0000","last_peered":"2024-08-31T06:04:16.823599+0000","last_clean":"2024-08-31T06:04:16.823599+0000","last_became_active":"2024-08-31T06:03:15.775821+0000","last_became_peered":"2024-08-31T06:03:15.775821+0000","last_unstale":"2024-08-31T06:04:16.823599+0000","last_undegraded":"2024-08-31T06:04:16.823599+0000","last_fullsized":"2024-08-31T06:04:16.823599+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:29.576514+0000","last_clean_scrub_stamp":"2024-08-31T06:02:29.576514+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:52:34.076554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"74'14","reported_seq":160,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:04:36.854122+0000","last_change":"2024-08-31T06:02:28.593773+0000","last_active":"2024-08-31T06:04:36.854122+0000","last_peered":"2024-08-31T06:04:36.854122+0000","last_clean":"2024-08-31T06:04:36.854122+0000","last_became_active":"2024-08-31T06:02:28.593511+0000","last_became_peered":"2024-08-31T06:02:28.593511+0000","last_unstale":"2024-08-31T06:04:36.854122+0000","last_undegraded":"2024-08-31T06:04:36.854122+0000","last_fullsized":"2024-08-31T06:04:36.854122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:02:27.560284+0000","last_clean_scrub_stamp":"2024-08-31T06:02:27.560284+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:01:50.826115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":861268,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1534,"num_read_kb":986,"num_write":490,"num_write_kb":2244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2949120,"data_stored":2583804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":64,"seq":274877906982,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070509,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37296,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707856,"statfs":{"total":95995035648,"available":95956844544,"internally_reserved":0,"allocated":1937408,"data_stored":1465699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928234033,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40728,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704424,"statfs":{"total":95995035648,"available":95953330176,"internally_reserved":0,"allocated":1253376,"data_stored":808197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397558,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36564,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708588,"statfs":{"total":95995035648,"available":95957594112,"internally_reserved":0,"allocated":1249280,"data_stored":808575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593786,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28444,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716708,"statfs":{"total":95995035648,"available":95965908992,"internally_reserved":0,"allocated":1454080,"data_stored":1010029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":38,"seq":163208757311,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":415191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953539,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28904,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716248,"statfs":{"total":95995035648,"available":95965437952,"internally_reserved":0,"allocated":1863680,"data_stored":1401965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084361,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":415584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28696,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716456,"statfs":{"total":95995035648,"available":95965650944,"internally_reserved":0,"allocated":1650688,"data_stored":1201515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444114,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":482099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":480922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":864256,"data_stored":416530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":787422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":397621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":461355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:04:39.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:04:40.096 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:40.343 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:40 smithi053 ceph-mon[18924]: pgmap v314: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-08-31T06:04:40.343 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:40 smithi053 ceph-mon[18924]: from='client.25189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:40.343 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:40.343 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:40 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:40.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:40 smithi130 ceph-mon[22266]: pgmap v314: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-08-31T06:04:40.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:40 smithi130 ceph-mon[22266]: from='client.25189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:40.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:40.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:40 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:40.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:40 smithi153 ceph-mon[22320]: pgmap v314: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 57 op/s 2024-08-31T06:04:40.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:40 smithi153 ceph-mon[22320]: from='client.25189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:04:40.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:40.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:40 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:40.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.600+0000 7f4761c38640 1 -- 172.21.15.53:0/2517488688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f475c10dbd0 msgr2=0x7f475c1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.600+0000 7f4761c38640 1 --2- 172.21.15.53:0/2517488688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f475c10dbd0 0x7f475c1100c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4754009ca0 tx=0x7f475402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.600+0000 7f4761c38640 1 -- 172.21.15.53:0/2517488688 shutdown_connections 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.600+0000 7f4761c38640 1 --2- 172.21.15.53:0/2517488688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f475c10dbd0 0x7f475c1100c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.600+0000 7f4761c38640 1 --2- 172.21.15.53:0/2517488688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f475c1050c0 0x7f475c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.600+0000 7f4761c38640 1 --2- 172.21.15.53:0/2517488688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f475c104770 0x7f475c104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.600+0000 7f4761c38640 1 -- 172.21.15.53:0/2517488688 >> 172.21.15.53:0/2517488688 conn(0x7f475c0794e0 msgr2=0x7f475c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.601+0000 7f4761c38640 1 -- 172.21.15.53:0/2517488688 shutdown_connections 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.601+0000 7f4761c38640 1 -- 172.21.15.53:0/2517488688 wait complete. 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.601+0000 7f4761c38640 1 Processor -- start 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.601+0000 7f4761c38640 1 -- start start 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f4761c38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f475c104770 0x7f475c19a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:40.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f4761c38640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f475c1050c0 0x7f475c19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f4761c38640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f475c10dbd0 0x7f475c19f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f4761c38640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f475c113750 con 0x7f475c104770 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f4761c38640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f475c1135d0 con 0x7f475c1050c0 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f4761c38640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f475c1138d0 con 0x7f475c10dbd0 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f475b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f475c104770 0x7f475c19a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f475b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f475c104770 0x7f475c19a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40604/0 (socket says 172.21.15.53:40604) 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f475b7fe640 1 -- 172.21.15.53:0/1702472953 learned_addr learned my addr 172.21.15.53:0/1702472953 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f475bfff640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f475c10dbd0 0x7f475c19f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f475affd640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f475c1050c0 0x7f475c19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f475b7fe640 1 -- 172.21.15.53:0/1702472953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f475c10dbd0 msgr2=0x7f475c19f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f475b7fe640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f475c10dbd0 0x7f475c19f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f475b7fe640 1 -- 172.21.15.53:0/1702472953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f475c1050c0 msgr2=0x7f475c19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f475b7fe640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f475c1050c0 0x7f475c19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.602+0000 7f475b7fe640 1 -- 172.21.15.53:0/1702472953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c1a00f0 con 0x7f475c104770 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.603+0000 7f475b7fe640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f475c104770 0x7f475c19a180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f474c00d770 tx=0x7f474c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.603+0000 7f4758ff9640 1 -- 172.21.15.53:0/1702472953 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c017070 con 0x7f475c104770 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.603+0000 7f4758ff9640 1 -- 172.21.15.53:0/1702472953 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f474c009c30 con 0x7f475c104770 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.603+0000 7f4761c38640 1 -- 172.21.15.53:0/1702472953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475c1a03e0 con 0x7f475c104770 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.603+0000 7f4758ff9640 1 -- 172.21.15.53:0/1702472953 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c003c50 con 0x7f475c104770 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.603+0000 7f4761c38640 1 -- 172.21.15.53:0/1702472953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475c1a6b40 con 0x7f475c104770 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.604+0000 7f4761c38640 1 -- 172.21.15.53:0/1702472953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475c104b80 con 0x7f475c104770 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.605+0000 7f4758ff9640 1 -- 172.21.15.53:0/1702472953 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f474c003df0 con 0x7f475c104770 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.606+0000 7f4758ff9640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47440b4c10 0x7f47440b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.606+0000 7f475affd640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47440b4c10 0x7f47440b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.606+0000 7f4758ff9640 1 -- 172.21.15.53:0/1702472953 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f474c0e4db0 con 0x7f475c104770 2024-08-31T06:04:40.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.607+0000 7f475affd640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47440b4c10 0x7f47440b7120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f475c10f850 tx=0x7f475000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:40.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.611+0000 7f4758ff9640 1 -- 172.21.15.53:0/1702472953 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f474c009de0 con 0x7f475c104770 2024-08-31T06:04:40.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.833+0000 7f4761c38640 1 -- 172.21.15.53:0/1702472953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f475c1a6e30 con 0x7f475c104770 2024-08-31T06:04:40.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.833+0000 7f4758ff9640 1 -- 172.21.15.53:0/1702472953 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11985 (secure 0 0 0) 0x7f474c0ab610 con 0x7f475c104770 2024-08-31T06:04:40.836 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:40.837 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-08-31T06:04:23:449285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:04:23.359453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:04:40.837 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-08-31T06:04:40.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 -- 172.21.15.53:0/1702472953 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47440b4c10 msgr2=0x7f47440b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:40.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47440b4c10 0x7f47440b7120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f475c10f850 tx=0x7f475000b390 comp rx=0 tx=0).stop 2024-08-31T06:04:40.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 -- 172.21.15.53:0/1702472953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f475c104770 msgr2=0x7f475c19a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:40.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f475c104770 0x7f475c19a180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f474c00d770 tx=0x7f474c00dc30 comp rx=0 tx=0).stop 2024-08-31T06:04:40.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 -- 172.21.15.53:0/1702472953 shutdown_connections 2024-08-31T06:04:40.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47440b4c10 0x7f47440b7120 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:40.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f475c10dbd0 0x7f475c19f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:40.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f475c1050c0 0x7f475c19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:40.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 --2- 172.21.15.53:0/1702472953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f475c104770 0x7f475c19a180 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:40.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 -- 172.21.15.53:0/1702472953 >> 172.21.15.53:0/1702472953 conn(0x7f475c0794e0 msgr2=0x7f475c1065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 -- 172.21.15.53:0/1702472953 shutdown_connections 2024-08-31T06:04:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:40.836+0000 7f4761c38640 1 -- 172.21.15.53:0/1702472953 wait complete. 2024-08-31T06:04:41.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:04:41.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:04:41.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:41.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:41 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1702472953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:41.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:04:41.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:04:41.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:41.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:41 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1702472953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:41.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:04:41.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:04:41.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:04:41.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:41 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1702472953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:41.664 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:04:41.923 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:42.326 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:42 smithi053 ceph-mon[18924]: pgmap v315: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-08-31T06:04:42.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:42 smithi130 ceph-mon[22266]: pgmap v315: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-08-31T06:04:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.414+0000 7f9a16ca3640 1 -- 172.21.15.53:0/189740287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a10108150 msgr2=0x7f9a10108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.414+0000 7f9a16ca3640 1 --2- 172.21.15.53:0/189740287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a10108150 0x7f9a10108560 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009900 tx=0x7f99fc02a410 comp rx=0 tx=0).stop 2024-08-31T06:04:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.414+0000 7f9a16ca3640 1 -- 172.21.15.53:0/189740287 shutdown_connections 2024-08-31T06:04:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.414+0000 7f9a16ca3640 1 --2- 172.21.15.53:0/189740287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a10108aa0 0x7f9a1010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.414+0000 7f9a16ca3640 1 --2- 172.21.15.53:0/189740287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a10108150 0x7f9a10108560 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.414+0000 7f9a16ca3640 1 --2- 172.21.15.53:0/189740287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a10102810 0x7f9a10102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.414+0000 7f9a16ca3640 1 -- 172.21.15.53:0/189740287 >> 172.21.15.53:0/189740287 conn(0x7f9a100794b0 msgr2=0x7f9a100798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.415+0000 7f9a16ca3640 1 -- 172.21.15.53:0/189740287 shutdown_connections 2024-08-31T06:04:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.415+0000 7f9a16ca3640 1 -- 172.21.15.53:0/189740287 wait complete. 2024-08-31T06:04:42.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.415+0000 7f9a16ca3640 1 Processor -- start 2024-08-31T06:04:42.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.415+0000 7f9a16ca3640 1 -- start start 2024-08-31T06:04:42.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a16ca3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a10102810 0x7f9a1019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:42.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a16ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a10108150 0x7f9a1019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:42.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a16ca3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a10108aa0 0x7f9a1019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:42.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a16ca3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10112630 con 0x7f9a10108150 2024-08-31T06:04:42.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a16ca3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101124b0 con 0x7f9a10102810 2024-08-31T06:04:42.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a16ca3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101127b0 con 0x7f9a10108aa0 2024-08-31T06:04:42.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a0ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a10108150 0x7f9a1019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a0ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a10108150 0x7f9a1019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40626/0 (socket says 172.21.15.53:40626) 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a0ffff640 1 -- 172.21.15.53:0/2439455214 learned_addr learned my addr 172.21.15.53:0/2439455214 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a15240640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a10108aa0 0x7f9a1019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a14a3f640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a10102810 0x7f9a1019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a0ffff640 1 -- 172.21.15.53:0/2439455214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a10108aa0 msgr2=0x7f9a1019fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a0ffff640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a10108aa0 0x7f9a1019fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a0ffff640 1 -- 172.21.15.53:0/2439455214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a10102810 msgr2=0x7f9a1019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a0ffff640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a10102810 0x7f9a1019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a0ffff640 1 -- 172.21.15.53:0/2439455214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a101a0160 con 0x7f9a10108150 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a15240640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a10108aa0 0x7f9a1019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.416+0000 7f9a0ffff640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a10108150 0x7f9a1019a790 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f99fc005940 tx=0x7f99fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.417+0000 7f9a0dffb640 1 -- 172.21.15.53:0/2439455214 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc03f030 con 0x7f9a10108150 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.417+0000 7f9a0dffb640 1 -- 172.21.15.53:0/2439455214 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99fc003c90 con 0x7f9a10108150 2024-08-31T06:04:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.417+0000 7f9a16ca3640 1 -- 172.21.15.53:0/2439455214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a101a03f0 con 0x7f9a10108150 2024-08-31T06:04:42.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.417+0000 7f9a0dffb640 1 -- 172.21.15.53:0/2439455214 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc035070 con 0x7f9a10108150 2024-08-31T06:04:42.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.417+0000 7f9a16ca3640 1 -- 172.21.15.53:0/2439455214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a101a6bb0 con 0x7f9a10108150 2024-08-31T06:04:42.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.418+0000 7f9a16ca3640 1 -- 172.21.15.53:0/2439455214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a10103a90 con 0x7f9a10108150 2024-08-31T06:04:42.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.420+0000 7f9a0dffb640 1 -- 172.21.15.53:0/2439455214 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f99fc042030 con 0x7f9a10108150 2024-08-31T06:04:42.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.421+0000 7f9a0dffb640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a000b4c90 0x7f9a000b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:42.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.421+0000 7f9a14a3f640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a000b4c90 0x7f9a000b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:42.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.421+0000 7f9a0dffb640 1 -- 172.21.15.53:0/2439455214 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f99fc105f90 con 0x7f9a10108150 2024-08-31T06:04:42.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.422+0000 7f9a14a3f640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a000b4c90 0x7f9a000b71a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009890 tx=0x7f9a04008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:42 smithi153 ceph-mon[22320]: pgmap v315: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-08-31T06:04:42.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.424+0000 7f9a0dffb640 1 -- 172.21.15.53:0/2439455214 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f99fc0ccde0 con 0x7f9a10108150 2024-08-31T06:04:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.646+0000 7f9a16ca3640 1 -- 172.21.15.53:0/2439455214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a1019b320 con 0x7f9a10108150 2024-08-31T06:04:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.646+0000 7f9a0dffb640 1 -- 172.21.15.53:0/2439455214 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11985 (secure 0 0 0) 0x7f9a1019b320 con 0x7f9a10108150 2024-08-31T06:04:42.649 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:42.650 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-08-31T06:04:23:449285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:04:23.359453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:04:42.650 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-08-31T06:04:42.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.648+0000 7f9a16ca3640 1 -- 172.21.15.53:0/2439455214 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a000b4c90 msgr2=0x7f9a000b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:42.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.649+0000 7f9a16ca3640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a000b4c90 0x7f9a000b71a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009890 tx=0x7f9a04008040 comp rx=0 tx=0).stop 2024-08-31T06:04:42.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.649+0000 7f9a16ca3640 1 -- 172.21.15.53:0/2439455214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a10108150 msgr2=0x7f9a1019a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:42.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.649+0000 7f9a16ca3640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a10108150 0x7f9a1019a790 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f99fc005940 tx=0x7f99fc0042f0 comp rx=0 tx=0).stop 2024-08-31T06:04:42.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.649+0000 7f9a16ca3640 1 -- 172.21.15.53:0/2439455214 shutdown_connections 2024-08-31T06:04:42.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.649+0000 7f9a16ca3640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9a000b4c90 0x7f9a000b71a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:42.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.649+0000 7f9a16ca3640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a10108aa0 0x7f9a1019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:42.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.649+0000 7f9a16ca3640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a10108150 0x7f9a1019a790 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:42.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.649+0000 7f9a16ca3640 1 --2- 172.21.15.53:0/2439455214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a10102810 0x7f9a1019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:42.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.649+0000 7f9a16ca3640 1 -- 172.21.15.53:0/2439455214 >> 172.21.15.53:0/2439455214 conn(0x7f9a100794b0 msgr2=0x7f9a101018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:42.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.649+0000 7f9a16ca3640 1 -- 172.21.15.53:0/2439455214 shutdown_connections 2024-08-31T06:04:42.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:42.649+0000 7f9a16ca3640 1 -- 172.21.15.53:0/2439455214 wait complete. 2024-08-31T06:04:43.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:43 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2439455214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:43.389 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2439455214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:43.421 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:04:43.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:43 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2439455214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:44.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.182+0000 7fbcaab88640 1 -- 172.21.15.53:0/4110798238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4108160 msgr2=0x7fbca4108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:44.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.182+0000 7fbcaab88640 1 --2- 172.21.15.53:0/4110798238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4108160 0x7fbca4108570 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009900 tx=0x7fbc9002a410 comp rx=0 tx=0).stop 2024-08-31T06:04:44.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.183+0000 7fbcaab88640 1 -- 172.21.15.53:0/4110798238 shutdown_connections 2024-08-31T06:04:44.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.183+0000 7fbcaab88640 1 --2- 172.21.15.53:0/4110798238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca4108ab0 0x7fbca410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:44.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.183+0000 7fbcaab88640 1 --2- 172.21.15.53:0/4110798238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4108160 0x7fbca4108570 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:44.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.183+0000 7fbcaab88640 1 --2- 172.21.15.53:0/4110798238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca4102820 0x7fbca4102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:44.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.183+0000 7fbcaab88640 1 -- 172.21.15.53:0/4110798238 >> 172.21.15.53:0/4110798238 conn(0x7fbca40794e0 msgr2=0x7fbca40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:44.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.183+0000 7fbcaab88640 1 -- 172.21.15.53:0/4110798238 shutdown_connections 2024-08-31T06:04:44.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.183+0000 7fbcaab88640 1 -- 172.21.15.53:0/4110798238 wait complete. 2024-08-31T06:04:44.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbcaab88640 1 Processor -- start 2024-08-31T06:04:44.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbcaab88640 1 -- start start 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbcaab88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca4102820 0x7fbca41990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbcaab88640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca4108160 0x7fbca4199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbcaab88640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4108ab0 0x7fbca419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbcaab88640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4112590 con 0x7fbca4108ab0 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbcaab88640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4112410 con 0x7fbca4102820 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbcaab88640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4112710 con 0x7fbca4108160 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbca9125640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4108ab0 0x7fbca419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbca9125640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4108ab0 0x7fbca419e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60356/0 (socket says 172.21.15.53:60356) 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbca9125640 1 -- 172.21.15.53:0/1125905009 learned_addr learned my addr 172.21.15.53:0/1125905009 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbca3fff640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca4108160 0x7fbca4199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbca8924640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca4102820 0x7fbca41990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbca9125640 1 -- 172.21.15.53:0/1125905009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca4108160 msgr2=0x7fbca4199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:44.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbca9125640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca4108160 0x7fbca4199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:44.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbca9125640 1 -- 172.21.15.53:0/1125905009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca4102820 msgr2=0x7fbca41990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:44.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbca9125640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca4102820 0x7fbca41990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:44.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbca9125640 1 -- 172.21.15.53:0/1125905009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca419f030 con 0x7fbca4108ab0 2024-08-31T06:04:44.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.184+0000 7fbca8924640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca4102820 0x7fbca41990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:44.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.185+0000 7fbca9125640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4108ab0 0x7fbca419e900 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00eaa0 tx=0x7fbc9c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:44.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.185+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1125905009 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c00cdb0 con 0x7fbca4108ab0 2024-08-31T06:04:44.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.185+0000 7fbcaab88640 1 -- 172.21.15.53:0/1125905009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca419f320 con 0x7fbca4108ab0 2024-08-31T06:04:44.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.185+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1125905009 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc9c005020 con 0x7fbca4108ab0 2024-08-31T06:04:44.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.185+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1125905009 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0116d0 con 0x7fbca4108ab0 2024-08-31T06:04:44.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.185+0000 7fbcaab88640 1 -- 172.21.15.53:0/1125905009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca406b8e0 con 0x7fbca4108ab0 2024-08-31T06:04:44.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.186+0000 7fbcaab88640 1 -- 172.21.15.53:0/1125905009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca4103aa0 con 0x7fbca4108ab0 2024-08-31T06:04:44.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.189+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1125905009 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7fbc9c0051d0 con 0x7fbca4108ab0 2024-08-31T06:04:44.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.189+0000 7fbca1ffb640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc940b4c10 0x7fbc940b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:44.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.189+0000 7fbca8924640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc940b4c10 0x7fbc940b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:44.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.189+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1125905009 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fbc9c0e59b0 con 0x7fbca4108ab0 2024-08-31T06:04:44.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.190+0000 7fbca8924640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc940b4c10 0x7fbc940b7120 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbc980058c0 tx=0x7fbc98005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:44.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.192+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1125905009 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbc9c016030 con 0x7fbca4108ab0 2024-08-31T06:04:44.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:44 smithi130 ceph-mon[22266]: pgmap v316: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-08-31T06:04:44.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.380+0000 7fbcaab88640 1 -- 172.21.15.53:0/1125905009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbca4102c30 con 0x7fbca4108ab0 2024-08-31T06:04:44.383 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:44 smithi053 ceph-mon[18924]: pgmap v316: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-08-31T06:04:44.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.381+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1125905009 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+23101 (secure 0 0 0) 0x7fbca4102c30 con 0x7fbca4108ab0 2024-08-31T06:04:44.385 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:44.385 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":74,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:04:16.424259+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:04:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 -- 172.21.15.53:0/1125905009 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc940b4c10 msgr2=0x7fbc940b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc940b4c10 0x7fbc940b7120 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbc980058c0 tx=0x7fbc98005850 comp rx=0 tx=0).stop 2024-08-31T06:04:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 -- 172.21.15.53:0/1125905009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4108ab0 msgr2=0x7fbca419e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4108ab0 0x7fbca419e900 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00eaa0 tx=0x7fbc9c00ef60 comp rx=0 tx=0).stop 2024-08-31T06:04:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 -- 172.21.15.53:0/1125905009 shutdown_connections 2024-08-31T06:04:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc940b4c10 0x7fbc940b7120 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4108ab0 0x7fbca419e900 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca4108160 0x7fbca4199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 --2- 172.21.15.53:0/1125905009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca4102820 0x7fbca41990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 -- 172.21.15.53:0/1125905009 >> 172.21.15.53:0/1125905009 conn(0x7fbca40794e0 msgr2=0x7fbca4104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 -- 172.21.15.53:0/1125905009 shutdown_connections 2024-08-31T06:04:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:44.384+0000 7fbcaab88640 1 -- 172.21.15.53:0/1125905009 wait complete. 2024-08-31T06:04:44.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:44 smithi153 ceph-mon[22320]: pgmap v316: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-08-31T06:04:45.045 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-08-31T06:04:45.301 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:45.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:45 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1125905009' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:45.422 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:45 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1125905009' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:45.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:45 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1125905009' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:04:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.868+0000 7f13aef58640 1 -- 172.21.15.53:0/554043476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a81080b0 msgr2=0x7f13a81084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.868+0000 7f13aef58640 1 --2- 172.21.15.53:0/554043476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a81080b0 0x7f13a81084c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1398009900 tx=0x7f139802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.868+0000 7f13aef58640 1 -- 172.21.15.53:0/554043476 shutdown_connections 2024-08-31T06:04:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.868+0000 7f13aef58640 1 --2- 172.21.15.53:0/554043476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a8108a00 0x7f13a810f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.868+0000 7f13aef58640 1 --2- 172.21.15.53:0/554043476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a81080b0 0x7f13a81084c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.868+0000 7f13aef58640 1 --2- 172.21.15.53:0/554043476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a8102780 0x7f13a8102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.868+0000 7f13aef58640 1 -- 172.21.15.53:0/554043476 >> 172.21.15.53:0/554043476 conn(0x7f13a80fe160 msgr2=0x7f13a81005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.868+0000 7f13aef58640 1 -- 172.21.15.53:0/554043476 shutdown_connections 2024-08-31T06:04:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.868+0000 7f13aef58640 1 -- 172.21.15.53:0/554043476 wait complete. 2024-08-31T06:04:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f13aef58640 1 Processor -- start 2024-08-31T06:04:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f13aef58640 1 -- start start 2024-08-31T06:04:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f13aef58640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a8102780 0x7f13a80fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f13aef58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a81080b0 0x7f13a80febd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f13aef58640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a8108a00 0x7f13a80ff110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f13aef58640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8112520 con 0x7f13a81080b0 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f13aef58640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81123a0 con 0x7f13a8108a00 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f13aef58640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81126a0 con 0x7f13a8102780 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f139ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a81080b0 0x7f13a80febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f139ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a81080b0 0x7f13a80febd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60378/0 (socket says 172.21.15.53:60378) 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f139ffff640 1 -- 172.21.15.53:0/891226231 learned_addr learned my addr 172.21.15.53:0/891226231 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f13ad4f5640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a8108a00 0x7f13a80ff110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f13accf4640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a8102780 0x7f13a80fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.869+0000 7f139ffff640 1 -- 172.21.15.53:0/891226231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a8102780 msgr2=0x7f13a80fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.870+0000 7f139ffff640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a8102780 0x7f13a80fe690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.870+0000 7f139ffff640 1 -- 172.21.15.53:0/891226231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a8108a00 msgr2=0x7f13a80ff110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.870+0000 7f139ffff640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a8108a00 0x7f13a80ff110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.870+0000 7f139ffff640 1 -- 172.21.15.53:0/891226231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a81a83a0 con 0x7f13a81080b0 2024-08-31T06:04:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.870+0000 7f139ffff640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a81080b0 0x7f13a80febd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1398005940 tx=0x7f1398005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.870+0000 7f139dffb640 1 -- 172.21.15.53:0/891226231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139803f030 con 0x7f13a81080b0 2024-08-31T06:04:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.870+0000 7f139dffb640 1 -- 172.21.15.53:0/891226231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13980043d0 con 0x7f13a81080b0 2024-08-31T06:04:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.870+0000 7f13aef58640 1 -- 172.21.15.53:0/891226231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a81a8630 con 0x7f13a81080b0 2024-08-31T06:04:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.870+0000 7f139dffb640 1 -- 172.21.15.53:0/891226231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1398035070 con 0x7f13a81080b0 2024-08-31T06:04:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.870+0000 7f13aef58640 1 -- 172.21.15.53:0/891226231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a81a8b20 con 0x7f13a81080b0 2024-08-31T06:04:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13b5ec2740 1 Processor -- start 2024-08-31T06:04:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13b5ec2740 1 -- start start 2024-08-31T06:04:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f139dffb640 1 -- 172.21.15.53:0/891226231 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f1398042030 con 0x7f13a81080b0 2024-08-31T06:04:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690af41b0 0x562690e97ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690e98000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690ad34d0 0x562690e98540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562690e0d000 con 0x562690acb2f0 2024-08-31T06:04:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562690dfc590 con 0x562690ad34d0 2024-08-31T06:04:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562690e00540 con 0x562690af41b0 2024-08-31T06:04:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13accf4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690e98000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13accf4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690e98000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60382/0 (socket says 172.21.15.53:60382) 2024-08-31T06:04:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13accf4640 1 -- 172.21.15.53:0/4090362046 learned_addr learned my addr 172.21.15.53:0/4090362046 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13ad4f5640 1 --2- 172.21.15.53:0/4090362046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690af41b0 0x562690e97ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f139ffff640 1 --2- 172.21.15.53:0/4090362046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690ad34d0 0x562690e98540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13accf4640 1 -- 172.21.15.53:0/4090362046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690af41b0 msgr2=0x562690e97ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13accf4640 1 --2- 172.21.15.53:0/4090362046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690af41b0 0x562690e97ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13accf4640 1 -- 172.21.15.53:0/4090362046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690ad34d0 msgr2=0x562690e98540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13accf4640 1 --2- 172.21.15.53:0/4090362046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690ad34d0 0x562690e98540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f13accf4640 1 -- 172.21.15.53:0/4090362046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562690b5f790 con 0x562690acb2f0 2024-08-31T06:04:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.873+0000 7f139ffff640 1 --2- 172.21.15.53:0/4090362046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690ad34d0 0x562690e98540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.874+0000 7f139dffb640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13900b4c40 0x7f13900b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.874+0000 7f13accf4640 1 --2- 172.21.15.53:0/4090362046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690e98000 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009c90 tx=0x7f13a4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1334842f6e11dd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.874+0000 7f13ad4f5640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13900b4c40 0x7f13900b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.874+0000 7f138effd640 1 -- 172.21.15.53:0/4090362046 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4005220 con 0x562690acb2f0 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.874+0000 7f139dffb640 1 -- 172.21.15.53:0/891226231 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1398105780 con 0x7f13a81080b0 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.874+0000 7f138effd640 1 -- 172.21.15.53:0/4090362046 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13a4004c30 con 0x562690acb2f0 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.874+0000 7f138effd640 1 -- 172.21.15.53:0/4090362046 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4019630 con 0x562690acb2f0 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13b5ec2740 1 -- 172.21.15.53:0/4090362046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 msgr2=0x562690e98000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13ad4f5640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13900b4c40 0x7f13900b7150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f13a0005fd0 tx=0x7f13a0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/4090362046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690e98000 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009c90 tx=0x7f13a4011810 comp rx=0 tx=0).stop 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13b5ec2740 1 -- 172.21.15.53:0/4090362046 shutdown_connections 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/4090362046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690ad34d0 0x562690e98540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/4090362046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690e98000 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/4090362046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690af41b0 0x562690e97ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13b5ec2740 1 -- 172.21.15.53:0/4090362046 >> 172.21.15.53:0/4090362046 conn(0x562690ae8300 msgr2=0x562690e959b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13b5ec2740 1 -- 172.21.15.53:0/4090362046 shutdown_connections 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13b5ec2740 1 -- 172.21.15.53:0/4090362046 wait complete. 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13b5ec2740 1 -- start start 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.875+0000 7f13b5ec2740 1 Processor -- start 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690ea3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ad34d0 0x562690ea3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690af41b0 0x562690eaf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562690d35ab0 con 0x562690acb2f0 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562690d83680 con 0x562690af41b0 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562690ea6240 con 0x562690ad34d0 2024-08-31T06:04:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13b5ec2740 10 client.0 _ll_register_callbacks cb 0x562690b0ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13accf4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690ea3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13accf4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690ea3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60398/0 (socket says 172.21.15.53:60398) 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13accf4640 1 -- 172.21.15.53:0/2852041880 learned_addr learned my addr 172.21.15.53:0/2852041880 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13ad4f5640 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690af41b0 0x562690eaf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f139ffff640 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ad34d0 0x562690ea3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13accf4640 1 -- 172.21.15.53:0/2852041880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ad34d0 msgr2=0x562690ea3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13accf4640 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ad34d0 0x562690ea3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13accf4640 1 -- 172.21.15.53:0/2852041880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690af41b0 msgr2=0x562690eaf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13accf4640 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690af41b0 0x562690eaf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13accf4640 1 -- 172.21.15.53:0/2852041880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562690bd8620 con 0x562690acb2f0 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.876+0000 7f13ad4f5640 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690af41b0 0x562690eaf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f13accf4640 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690ea3610 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f13a4000c00 tx=0x7f13a4005090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62f9435429ba428 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f1387fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f1387fff640 1 -- 172.21.15.53:0/2852041880 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4029070 con 0x562690acb2f0 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f1387fff640 1 -- 172.21.15.53:0/2852041880 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f13a4023630 con 0x562690acb2f0 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2852041880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13a4004c30 con 0x562690acb2f0 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f1387fff640 1 -- 172.21.15.53:0/2852041880 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f13a4035050 con 0x562690acb2f0 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f13b5ec2740 10 client.15621 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2852041880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562690eb2180 con 0x562690acb2f0 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f1387fff640 1 -- 172.21.15.53:0/2852041880 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13a4004c30 con 0x562690acb2f0 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f1387fff640 1 -- 172.21.15.53:0/2852041880 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f13a40194c0 con 0x562690acb2f0 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f13b5ec2740 10 client.15621 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f13b5ec2740 10 client.15621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f13b5ec2740 20 client.15621 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562690ab2d80 0x562690eb5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f13b5ec2740 4 client.15621 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.877+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2852041880 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562690e0ef50 con 0x562690ab2d80 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.878+0000 7f139ffff640 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562690ab2d80 0x562690eb5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.878+0000 7f1387fff640 10 client.15621 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.878+0000 7f139ffff640 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562690ab2d80 0x562690eb5540 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbedf0ad14f42f35 server_cookie=3fdaf32f7fbc5f07 in_seq=0 out_seq=0 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f1387fff640 1 -- 172.21.15.53:0/2852041880 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562690e0ef50 con 0x562690ab2d80 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f1387fff640 10 client.15621 handle_command_reply: tid=0 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f13b5ec2740 1 client.15621 shutdown 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2852041880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 msgr2=0x562690ea3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690ea3610 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f13a4000c00 tx=0x7f13a4005090 comp rx=0 tx=0).stop 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2852041880 shutdown_connections 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562690ab2d80 0x562690eb5540 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690af41b0 0x562690eaf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ad34d0 0x562690ea3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f1387fff640 0 client.15621 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/2852041880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690ea3610 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2852041880 >> 172.21.15.53:0/2852041880 conn(0x562690ae8300 msgr2=0x562690e98af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.879+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2852041880 shutdown_connections 2024-08-31T06:04:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.880+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2852041880 wait complete. 2024-08-31T06:04:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.880+0000 7f13b5ec2740 20 client.15621 trim_cache size 0 max 16384 2024-08-31T06:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13b5ec2740 1 Processor -- start 2024-08-31T06:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13b5ec2740 1 -- start start 2024-08-31T06:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ab2d80 0x562690ea5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690acb2f0 0x562690ea05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690ad34d0 0x562690ea0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81b1650 con 0x562690ad34d0 2024-08-31T06:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81b3190 con 0x562690acb2f0 2024-08-31T06:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81b1d20 con 0x562690ab2d80 2024-08-31T06:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13ad4f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690ad34d0 0x562690ea0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13ad4f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690ad34d0 0x562690ea0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60410/0 (socket says 172.21.15.53:60410) 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13ad4f5640 1 -- 172.21.15.53:0/2351655815 learned_addr learned my addr 172.21.15.53:0/2351655815 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f139ffff640 1 --2- 172.21.15.53:0/2351655815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690acb2f0 0x562690ea05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.894+0000 7f13accf4640 1 --2- 172.21.15.53:0/2351655815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ab2d80 0x562690ea5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.895+0000 7f13ad4f5640 1 -- 172.21.15.53:0/2351655815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ab2d80 msgr2=0x562690ea5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.895+0000 7f13ad4f5640 1 --2- 172.21.15.53:0/2351655815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ab2d80 0x562690ea5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.895+0000 7f13ad4f5640 1 -- 172.21.15.53:0/2351655815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690acb2f0 msgr2=0x562690ea05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.895+0000 7f13ad4f5640 1 --2- 172.21.15.53:0/2351655815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690acb2f0 0x562690ea05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.895+0000 7f13ad4f5640 1 -- 172.21.15.53:0/2351655815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562690ea18e0 con 0x562690ad34d0 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.895+0000 7f139ffff640 1 --2- 172.21.15.53:0/2351655815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690acb2f0 0x562690ea05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.895+0000 7f13ad4f5640 1 --2- 172.21.15.53:0/2351655815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690ad34d0 0x562690ea0b10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f13a0003e40 tx=0x7f13a0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e16a08426e18c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.895+0000 7f138e7fc640 1 -- 172.21.15.53:0/2351655815 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a000f5a0 con 0x562690ad34d0 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.895+0000 7f138e7fc640 1 -- 172.21.15.53:0/2351655815 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13a000fbd0 con 0x562690ad34d0 2024-08-31T06:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.895+0000 7f138e7fc640 1 -- 172.21.15.53:0/2351655815 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a001e9f0 con 0x562690ad34d0 2024-08-31T06:04:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.896+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2351655815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690ad34d0 msgr2=0x562690ea0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.896+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/2351655815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690ad34d0 0x562690ea0b10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f13a0003e40 tx=0x7f13a0009f90 comp rx=0 tx=0).stop 2024-08-31T06:04:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.896+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2351655815 shutdown_connections 2024-08-31T06:04:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.896+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/2351655815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690ad34d0 0x562690ea0b10 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.896+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/2351655815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690acb2f0 0x562690ea05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.896+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/2351655815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ab2d80 0x562690ea5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.896+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2351655815 >> 172.21.15.53:0/2351655815 conn(0x562690ae8300 msgr2=0x562690ea4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.896+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2351655815 shutdown_connections 2024-08-31T06:04:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.896+0000 7f13b5ec2740 1 -- 172.21.15.53:0/2351655815 wait complete. 2024-08-31T06:04:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.896+0000 7f13b5ec2740 1 -- start start 2024-08-31T06:04:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.896+0000 7f13b5ec2740 1 Processor -- start 2024-08-31T06:04:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ab2d80 0x562690ea9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690eaa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13b5ec2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690ad34d0 0x562690f1ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81b2ac0 con 0x562690acb2f0 2024-08-31T06:04:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81b23f0 con 0x562690ad34d0 2024-08-31T06:04:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13b5ec2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81af630 con 0x562690ab2d80 2024-08-31T06:04:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13b5ec2740 10 client.0 _ll_register_callbacks cb 0x7f13a4009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f139ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690eaa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f139ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690eaa1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60414/0 (socket says 172.21.15.53:60414) 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f139ffff640 1 -- 172.21.15.53:0/217550632 learned_addr learned my addr 172.21.15.53:0/217550632 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13accf4640 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ab2d80 0x562690ea9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13ad4f5640 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690ad34d0 0x562690f1ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f139ffff640 1 -- 172.21.15.53:0/217550632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ab2d80 msgr2=0x562690ea9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f139ffff640 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ab2d80 0x562690ea9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f139ffff640 1 -- 172.21.15.53:0/217550632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690ad34d0 msgr2=0x562690f1ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f139ffff640 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690ad34d0 0x562690f1ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f139ffff640 1 -- 172.21.15.53:0/217550632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562690f1f420 con 0x562690acb2f0 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f139ffff640 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690eaa1e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f13980c91f0 tx=0x7f1398009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e038043afa5ee089 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f1387fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f1387fff640 1 -- 172.21.15.53:0/217550632 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1398049040 con 0x562690acb2f0 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f1387fff640 1 -- 172.21.15.53:0/217550632 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f13980b71b0 con 0x562690acb2f0 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13b5ec2740 1 -- 172.21.15.53:0/217550632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13a000fbd0 con 0x562690acb2f0 2024-08-31T06:04:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f1387fff640 1 -- 172.21.15.53:0/217550632 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f13980d0740 con 0x562690acb2f0 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13b5ec2740 10 client.15627 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.897+0000 7f13b5ec2740 1 -- 172.21.15.53:0/217550632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562690f206b0 con 0x562690acb2f0 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.898+0000 7f1387fff640 1 -- 172.21.15.53:0/217550632 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13a000fbd0 con 0x562690acb2f0 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.898+0000 7f1387fff640 1 -- 172.21.15.53:0/217550632 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f13980cc1e0 con 0x562690acb2f0 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.898+0000 7f13b5ec2740 10 client.15627 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.898+0000 7f13b5ec2740 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.898+0000 7f13b5ec2740 20 client.15627 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.898+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562690af41b0 0x562690f22de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.898+0000 7f13b5ec2740 4 client.15627 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.898+0000 7f13b5ec2740 1 -- 172.21.15.53:0/217550632 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562690e0a9f0 con 0x562690af41b0 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.898+0000 7f13accf4640 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562690af41b0 0x562690f22de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.898+0000 7f13accf4640 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562690af41b0 0x562690f22de0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7aa7f6eb6811a9d server_cookie=73e811bfc22c20a3 in_seq=0 out_seq=0 2024-08-31T06:04:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.898+0000 7f1387fff640 10 client.15627 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f1387fff640 1 -- 172.21.15.53:0/217550632 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562690e0a9f0 con 0x562690af41b0 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f1387fff640 10 client.15627 handle_command_reply: tid=0 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f13b5ec2740 1 client.15627 shutdown 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f13b5ec2740 1 -- 172.21.15.53:0/217550632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 msgr2=0x562690eaa1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690eaa1e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f13980c91f0 tx=0x7f1398009260 comp rx=0 tx=0).stop 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f13b5ec2740 1 -- 172.21.15.53:0/217550632 shutdown_connections 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562690af41b0 0x562690f22de0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562690ad34d0 0x562690f1ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f1387fff640 0 client.15627 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562690acb2f0 0x562690eaa1e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f13b5ec2740 1 --2- 172.21.15.53:0/217550632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562690ab2d80 0x562690ea9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.911+0000 7f13b5ec2740 1 -- 172.21.15.53:0/217550632 >> 172.21.15.53:0/217550632 conn(0x562690ae8300 msgr2=0x562690ea48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13b5ec2740 1 -- 172.21.15.53:0/217550632 shutdown_connections 2024-08-31T06:04:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13b5ec2740 1 -- 172.21.15.53:0/217550632 wait complete. 2024-08-31T06:04:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13b5ec2740 20 client.15627 trim_cache size 0 max 16384 2024-08-31T06:04:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:04:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:04:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:04:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:04:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 -- 172.21.15.53:0/891226231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13900b4c40 msgr2=0x7f13900b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13900b4c40 0x7f13900b7150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f13a0005fd0 tx=0x7f13a0009500 comp rx=0 tx=0).stop 2024-08-31T06:04:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 -- 172.21.15.53:0/891226231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a81080b0 msgr2=0x7f13a80febd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a81080b0 0x7f13a80febd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1398005940 tx=0x7f1398005e10 comp rx=0 tx=0).stop 2024-08-31T06:04:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 -- 172.21.15.53:0/891226231 shutdown_connections 2024-08-31T06:04:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13900b4c40 0x7f13900b7150 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13a8108a00 0x7f13a80ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a81080b0 0x7f13a80febd0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 --2- 172.21.15.53:0/891226231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a8102780 0x7f13a80fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 -- 172.21.15.53:0/891226231 >> 172.21.15.53:0/891226231 conn(0x7f13a80fe160 msgr2=0x7f13a806bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 -- 172.21.15.53:0/891226231 shutdown_connections 2024-08-31T06:04:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:45.912+0000 7f13aef58640 1 -- 172.21.15.53:0/891226231 wait complete. 2024-08-31T06:04:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:46 smithi130 ceph-mon[22266]: pgmap v317: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-08-31T06:04:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:46 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:04:46.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:46 smithi153 ceph-mon[22320]: pgmap v317: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-08-31T06:04:46.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:46 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:04:46.439 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:46 smithi053 ceph-mon[18924]: pgmap v317: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-08-31T06:04:46.439 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:46 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:04:46.469 INFO:teuthology.orchestra.run.smithi053.stdout:{"run_dir":"/var/run/ceph"} 2024-08-31T06:04:46.469 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-08-31T06:04:46.470 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 5413 2024-08-31T06:04:46.470 DEBUG:tasks.quiescer:Yielding 2024-08-31T06:04:46.470 INFO:teuthology.run_tasks:Running task workunit... 2024-08-31T06:04:46.486 INFO:tasks.workunit:Pulling workunits from ref d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:04:46.486 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-31T06:04:46.486 INFO:tasks.workunit:timeout=3h 2024-08-31T06:04:46.486 INFO:tasks.workunit:cleanup=True 2024-08-31T06:04:46.487 DEBUG:teuthology.orchestra.run.smithi053:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-31T06:04:46.487 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:04:46.504 INFO:teuthology.orchestra.run.smithi053.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-31T06:04:46.505 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-31T06:04:46.505 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 79h/121d Inode: 1 Links: 2 2024-08-31T06:04:46.505 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:04:46.505 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-31T06:04:46.505 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-08-31 06:02:45.904019693 +0000 2024-08-31T06:04:46.505 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-08-31 06:02:45.904019693 +0000 2024-08-31T06:04:46.505 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-08-31 06:04:22.972162857 +0000 2024-08-31T06:04:46.505 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-08-31T06:04:46.505 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-31T06:04:46.506 DEBUG:teuthology.orchestra.run.smithi053:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-31T06:04:46.577 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:04:46.632 INFO:tasks.workunit.client.0.smithi053.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-31T06:04:46.755 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.265+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1721925061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c00102880 msgr2=0x7f4c00102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.265+0000 7f4c05dc1640 1 --2- 172.21.15.53:0/1721925061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c00102880 0x7f4c00102c90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009900 tx=0x7f4bf002a410 comp rx=0 tx=0).stop 2024-08-31T06:04:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.265+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1721925061 shutdown_connections 2024-08-31T06:04:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.265+0000 7f4c05dc1640 1 --2- 172.21.15.53:0/1721925061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c00108ac0 0x7f4c0010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.265+0000 7f4c05dc1640 1 --2- 172.21.15.53:0/1721925061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c00108170 0x7f4c00108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.265+0000 7f4c05dc1640 1 --2- 172.21.15.53:0/1721925061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c00102880 0x7f4c00102c90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.265+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1721925061 >> 172.21.15.53:0/1721925061 conn(0x7f4c00079550 msgr2=0x7f4c00079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.265+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1721925061 shutdown_connections 2024-08-31T06:04:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.265+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1721925061 wait complete. 2024-08-31T06:04:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.266+0000 7f4c05dc1640 1 Processor -- start 2024-08-31T06:04:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.266+0000 7f4c05dc1640 1 -- start start 2024-08-31T06:04:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4c05dc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c00102880 0x7f4c0019a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4c05dc1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c00108170 0x7f4c0019a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4c05dc1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c00108ac0 0x7f4c0019faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4c05dc1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4c001137a0 con 0x7f4c00102880 2024-08-31T06:04:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4c05dc1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c00113620 con 0x7f4c00108170 2024-08-31T06:04:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4c05dc1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c00113920 con 0x7f4c00108ac0 2024-08-31T06:04:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c00102880 0x7f4c0019a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c00102880 0x7f4c0019a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60440/0 (socket says 172.21.15.53:60440) 2024-08-31T06:04:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bff7fe640 1 -- 172.21.15.53:0/1577499903 learned_addr learned my addr 172.21.15.53:0/1577499903 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bfeffd640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c00108170 0x7f4c0019a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bfffff640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c00108ac0 0x7f4c0019faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bff7fe640 1 -- 172.21.15.53:0/1577499903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c00108ac0 msgr2=0x7f4c0019faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bff7fe640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c00108ac0 0x7f4c0019faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bff7fe640 1 -- 172.21.15.53:0/1577499903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c00108170 msgr2=0x7f4c0019a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bff7fe640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c00108170 0x7f4c0019a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bff7fe640 1 -- 172.21.15.53:0/1577499903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c001a0220 con 0x7f4c00102880 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bff7fe640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c00102880 0x7f4c0019a2b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009a20 tx=0x7f4bf0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.267+0000 7f4bfcff9640 1 -- 172.21.15.53:0/1577499903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf003f030 con 0x7f4c00102880 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.268+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1577499903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c001a04b0 con 0x7f4c00102880 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.268+0000 7f4bfcff9640 1 -- 172.21.15.53:0/1577499903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bf00035f0 con 0x7f4c00102880 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.268+0000 7f4bfcff9640 1 -- 172.21.15.53:0/1577499903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0035070 con 0x7f4c00102880 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.268+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1577499903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c001a6c70 con 0x7f4c00102880 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.269+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1577499903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c00102c90 con 0x7f4c00102880 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.270+0000 7f4bfcff9640 1 -- 172.21.15.53:0/1577499903 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f4bf0003aa0 con 0x7f4c00102880 2024-08-31T06:04:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.271+0000 7f4bfcff9640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4be80b4c10 0x7f4be80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.271+0000 7f4bfeffd640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4be80b4c10 0x7f4be80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.271+0000 7f4bfcff9640 1 -- 172.21.15.53:0/1577499903 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f4bf01063b0 con 0x7f4c00102880 2024-08-31T06:04:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.271+0000 7f4bfeffd640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4be80b4c10 0x7f4be80b7120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4c000799a0 tx=0x7f4bf400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.274+0000 7f4bfcff9640 1 -- 172.21.15.53:0/1577499903 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4bf00cd260 con 0x7f4c00102880 2024-08-31T06:04:47.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.500+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1577499903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c0019b3e0 con 0x7f4c00102880 2024-08-31T06:04:47.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.500+0000 7f4bfcff9640 1 -- 172.21.15.53:0/1577499903 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11985 (secure 0 0 0) 0x7f4bf00ccb60 con 0x7f4c00102880 2024-08-31T06:04:47.503 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:04:47.503 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-08-31T06:04:23:449285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:04:23.359453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:04:47.504 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-08-31T06:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1577499903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4be80b4c10 msgr2=0x7f4be80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4be80b4c10 0x7f4be80b7120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4c000799a0 tx=0x7f4bf400a2d0 comp rx=0 tx=0).stop 2024-08-31T06:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1577499903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c00102880 msgr2=0x7f4c0019a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c00102880 0x7f4c0019a2b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009a20 tx=0x7f4bf0004270 comp rx=0 tx=0).stop 2024-08-31T06:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1577499903 shutdown_connections 2024-08-31T06:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4be80b4c10 0x7f4be80b7120 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c00108ac0 0x7f4c0019faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c00108170 0x7f4c0019a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 --2- 172.21.15.53:0/1577499903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c00102880 0x7f4c0019a2b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1577499903 >> 172.21.15.53:0/1577499903 conn(0x7f4c00079550 msgr2=0x7f4c00106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1577499903 shutdown_connections 2024-08-31T06:04:47.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:47.503+0000 7f4c05dc1640 1 -- 172.21.15.53:0/1577499903 wait complete. 2024-08-31T06:04:48.182 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:48 smithi053 ceph-mon[18924]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 73 KiB/s wr, 18 op/s 2024-08-31T06:04:48.182 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:48 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1577499903' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:48.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T06:02:31.233616+0000', 'modified': '2024-08-31T06:04:23.359453+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24668, 'mds_1': 24640, 'mds_2': 24632, 'mds_3': 24619, 'mds_4': 24613}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14829': {'gid': 14829, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.53:6839/1079311184', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6838', 'nonce': 1079311184}, {'type': 'v1', 'addr': '172.21.15.53:6839', 'nonce': 1079311184}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14841': {'gid': 14841, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.53:6841/2812306532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6840', 'nonce': 2812306532}, {'type': 'v1', 'addr': '172.21.15.53:6841', 'nonce': 2812306532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24577': {'gid': 24577, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6833/4101202303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 4101202303}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 4101202303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6833/4017894222', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6832', 'nonce': 4017894222}, {'type': 'v1', 'addr': '172.21.15.130:6833', 'nonce': 4017894222}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6835/3456535570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 3456535570}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 3456535570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.153:6835/1480674420', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 1480674420}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 1480674420}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24619': {'gid': 24619, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.153:6837/3972541540', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 3972541540}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 3972541540}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24632': {'gid': 24632, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.130:6837/1323127878', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 1323127878}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 1323127878}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24640': {'gid': 24640, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.153:6839/268646865', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6838', 'nonce': 268646865}, {'type': 'v1', 'addr': '172.21.15.153:6839', 'nonce': 268646865}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24668': {'gid': 24668, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.130:6839/3403731647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 3403731647}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 3403731647}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24668, 'qdb_cluster': [24613, 24619, 24632, 24640, 24668]} 2024-08-31T06:04:48.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-31T06:04:48.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.f status 2024-08-31T06:04:48.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:48 smithi130 ceph-mon[22266]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 73 KiB/s wr, 18 op/s 2024-08-31T06:04:48.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:48 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1577499903' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:48.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:48 smithi153 ceph-mon[22320]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 73 KiB/s wr, 18 op/s 2024-08-31T06:04:48.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:48 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1577499903' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:04:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:49.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.992+0000 7f1a6ac67640 1 -- 172.21.15.53:0/1473096662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64108170 msgr2=0x7f1a64108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:49.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.992+0000 7f1a6ac67640 1 --2- 172.21.15.53:0/1473096662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64108170 0x7f1a64108580 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009900 tx=0x7f1a5402a410 comp rx=0 tx=0).stop 2024-08-31T06:04:49.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.992+0000 7f1a6ac67640 1 -- 172.21.15.53:0/1473096662 shutdown_connections 2024-08-31T06:04:49.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.992+0000 7f1a6ac67640 1 --2- 172.21.15.53:0/1473096662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108ac0 0x7f1a6410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.992+0000 7f1a6ac67640 1 --2- 172.21.15.53:0/1473096662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64108170 0x7f1a64108580 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.992+0000 7f1a6ac67640 1 --2- 172.21.15.53:0/1473096662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64102880 0x7f1a64102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.992+0000 7f1a6ac67640 1 -- 172.21.15.53:0/1473096662 >> 172.21.15.53:0/1473096662 conn(0x7f1a64079500 msgr2=0x7f1a64079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:49.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.992+0000 7f1a6ac67640 1 -- 172.21.15.53:0/1473096662 shutdown_connections 2024-08-31T06:04:49.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.992+0000 7f1a6ac67640 1 -- 172.21.15.53:0/1473096662 wait complete. 2024-08-31T06:04:49.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.992+0000 7f1a6ac67640 1 Processor -- start 2024-08-31T06:04:49.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.992+0000 7f1a6ac67640 1 -- start start 2024-08-31T06:04:49.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a6ac67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64102880 0x7f1a6419af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a6ac67640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108170 0x7f1a6419b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a6ac67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64108ac0 0x7f1a6419b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a6ac67640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1a641125a0 con 0x7f1a64102880 2024-08-31T06:04:49.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a6ac67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64112420 con 0x7f1a64108ac0 2024-08-31T06:04:49.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a6ac67640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64112720 con 0x7f1a64108170 2024-08-31T06:04:49.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a68a03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64102880 0x7f1a6419af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a68a03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64102880 0x7f1a6419af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60456/0 (socket says 172.21.15.53:60456) 2024-08-31T06:04:49.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a68a03640 1 -- 172.21.15.53:0/722549766 learned_addr learned my addr 172.21.15.53:0/722549766 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:49.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a69204640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64108ac0 0x7f1a6419b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a5bfff640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108170 0x7f1a6419b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a68a03640 1 -- 172.21.15.53:0/722549766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108170 msgr2=0x7f1a6419b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:49.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a68a03640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108170 0x7f1a6419b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a68a03640 1 -- 172.21.15.53:0/722549766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64108ac0 msgr2=0x7f1a6419b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:49.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a68a03640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64108ac0 0x7f1a6419b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a68a03640 1 -- 172.21.15.53:0/722549766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a641a6260 con 0x7f1a64102880 2024-08-31T06:04:49.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.993+0000 7f1a68a03640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64102880 0x7f1a6419af50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000d950 tx=0x7f1a6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:49.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.994+0000 7f1a59ffb640 1 -- 172.21.15.53:0/722549766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60017070 con 0x7f1a64102880 2024-08-31T06:04:49.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.994+0000 7f1a59ffb640 1 -- 172.21.15.53:0/722549766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a60009c30 con 0x7f1a64102880 2024-08-31T06:04:49.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.994+0000 7f1a6ac67640 1 -- 172.21.15.53:0/722549766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a641a6550 con 0x7f1a64102880 2024-08-31T06:04:49.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.994+0000 7f1a59ffb640 1 -- 172.21.15.53:0/722549766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6000f620 con 0x7f1a64102880 2024-08-31T06:04:49.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.994+0000 7f1a6ac67640 1 -- 172.21.15.53:0/722549766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a641a6ab0 con 0x7f1a64102880 2024-08-31T06:04:49.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.996+0000 7f1a59ffb640 1 -- 172.21.15.53:0/722549766 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f1a60010460 con 0x7f1a64102880 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.996+0000 7f1a711dc740 1 Processor -- start 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a711dc740 1 -- start start 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465847b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461b60a0 0x55b146584cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461be280 0x55b146585230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a711dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b1464fb3f0 con 0x55b1461def60 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a711dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b1464ea980 con 0x55b1461be280 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a711dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b1464ee930 con 0x55b1461b60a0 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a69204640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465847b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a59ffb640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a4c0b4c90 0x7f1a4c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a69204640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465847b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60462/0 (socket says 172.21.15.53:60462) 2024-08-31T06:04:49.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a69204640 1 -- 172.21.15.53:0/989367836 learned_addr learned my addr 172.21.15.53:0/989367836 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a68a03640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461b60a0 0x55b146584cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a5bfff640 1 --2- 172.21.15.53:0/989367836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461be280 0x55b146585230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a69204640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a4c0b4c90 0x7f1a4c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.997+0000 7f1a59ffb640 1 -- 172.21.15.53:0/722549766 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1a600e5030 con 0x7f1a64102880 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.998+0000 7f1a69204640 1 -- 172.21.15.53:0/989367836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461b60a0 msgr2=0x55b146584cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.998+0000 7f1a69204640 1 --2- 172.21.15.53:0/989367836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461b60a0 0x55b146584cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.998+0000 7f1a69204640 1 -- 172.21.15.53:0/989367836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461be280 msgr2=0x55b146585230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.998+0000 7f1a69204640 1 --2- 172.21.15.53:0/989367836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461be280 0x55b146585230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.998+0000 7f1a69204640 1 -- 172.21.15.53:0/989367836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b14624a540 con 0x55b1461def60 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.998+0000 7f1a5bfff640 1 --2- 172.21.15.53:0/989367836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461be280 0x55b146585230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.998+0000 7f1a69204640 1 --2- 172.21.15.53:0/989367836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465847b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c014e80 tx=0x7f1a5c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fe0d25d22bff3c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.998+0000 7f1a69204640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a4c0b4c90 0x7f1a4c0b71a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c011cb0 tx=0x7f1a5c01c000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.998+0000 7f1a4affd640 1 -- 172.21.15.53:0/989367836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c022070 con 0x55b1461def60 2024-08-31T06:04:49.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.998+0000 7f1a4affd640 1 -- 172.21.15.53:0/989367836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a5c00ac30 con 0x55b1461def60 2024-08-31T06:04:49.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.998+0000 7f1a4affd640 1 -- 172.21.15.53:0/989367836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c003cc0 con 0x55b1461def60 2024-08-31T06:04:49.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.999+0000 7f1a711dc740 1 -- 172.21.15.53:0/989367836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 msgr2=0x55b1465847b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:49.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.999+0000 7f1a711dc740 1 --2- 172.21.15.53:0/989367836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465847b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c014e80 tx=0x7f1a5c0117b0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.999+0000 7f1a711dc740 1 -- 172.21.15.53:0/989367836 shutdown_connections 2024-08-31T06:04:49.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.999+0000 7f1a711dc740 1 --2- 172.21.15.53:0/989367836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461be280 0x55b146585230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.999+0000 7f1a711dc740 1 --2- 172.21.15.53:0/989367836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461b60a0 0x55b146584cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.999+0000 7f1a711dc740 1 --2- 172.21.15.53:0/989367836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465847b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.999+0000 7f1a711dc740 1 -- 172.21.15.53:0/989367836 >> 172.21.15.53:0/989367836 conn(0x55b1461d3350 msgr2=0x55b1465826a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:49.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.999+0000 7f1a711dc740 1 -- 172.21.15.53:0/989367836 shutdown_connections 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.999+0000 7f1a711dc740 1 -- 172.21.15.53:0/989367836 wait complete. 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.999+0000 7f1a711dc740 1 -- start start 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:48.999+0000 7f1a711dc740 1 Processor -- start 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461b60a0 0x55b14658ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461be280 0x55b146590450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461def60 0x55b1465a0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a711dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b14634d5f0 con 0x55b1461b60a0 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a711dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b146471600 con 0x55b1461def60 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a711dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b146597340 con 0x55b1461be280 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a711dc740 10 client.0 _ll_register_callbacks cb 0x55b146497af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a68a03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461b60a0 0x55b14658ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a68a03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461b60a0 0x55b14658ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60468/0 (socket says 172.21.15.53:60468) 2024-08-31T06:04:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a68a03640 1 -- 172.21.15.53:0/479676623 learned_addr learned my addr 172.21.15.53:0/479676623 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a68a03640 1 -- 172.21.15.53:0/479676623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461be280 msgr2=0x55b146590450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a68a03640 1 --2- 172.21.15.53:0/479676623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461be280 0x55b146590450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a68a03640 1 -- 172.21.15.53:0/479676623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461def60 msgr2=0x55b1465a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a68a03640 1 --2- 172.21.15.53:0/479676623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461def60 0x55b1465a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a68a03640 1 -- 172.21.15.53:0/479676623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1464aa7b0 con 0x55b1461b60a0 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a68a03640 1 --2- 172.21.15.53:0/479676623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461b60a0 0x55b14658ff10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1a60000c00 tx=0x7f1a60074950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90dd29c78c518a4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.000+0000 7f1a43fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a43fff640 1 -- 172.21.15.53:0/479676623 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60020040 con 0x55b1461b60a0 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a43fff640 1 -- 172.21.15.53:0/479676623 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1a600aaa40 con 0x55b1461b60a0 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a711dc740 1 -- 172.21.15.53:0/479676623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a5c00ac30 con 0x55b1461b60a0 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a43fff640 1 -- 172.21.15.53:0/479676623 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a600b4440 con 0x55b1461b60a0 2024-08-31T06:04:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a711dc740 10 client.15645 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a711dc740 1 -- 172.21.15.53:0/479676623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1465a3150 con 0x55b1461b60a0 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a43fff640 1 -- 172.21.15.53:0/479676623 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a5c00ac30 con 0x55b1461b60a0 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a43fff640 1 -- 172.21.15.53:0/479676623 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1a600d21a0 con 0x55b1461b60a0 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a711dc740 10 client.15645 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a711dc740 10 client.15645 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a711dc740 20 client.15645 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a711dc740 1 --2- 172.21.15.53:0/479676623 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b14619d8e0 0x55b1465a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a711dc740 4 client.15645 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.001+0000 7f1a711dc740 1 -- 172.21.15.53:0/479676623 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1464fd340 con 0x55b14619d8e0 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.002+0000 7f1a5bfff640 1 --2- 172.21.15.53:0/479676623 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b14619d8e0 0x55b1465a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.002+0000 7f1a5bfff640 1 --2- 172.21.15.53:0/479676623 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b14619d8e0 0x55b1465a6c00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=55abc88a2b483603 server_cookie=cab9c9fd2c143a91 in_seq=0 out_seq=0 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.002+0000 7f1a43fff640 10 client.15645 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a43fff640 1 -- 172.21.15.53:0/479676623 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1464fd340 con 0x55b14619d8e0 2024-08-31T06:04:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a43fff640 10 client.15645 handle_command_reply: tid=0 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 1 client.15645 shutdown 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 1 -- 172.21.15.53:0/479676623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461b60a0 msgr2=0x55b14658ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 1 --2- 172.21.15.53:0/479676623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461b60a0 0x55b14658ff10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1a60000c00 tx=0x7f1a60074950 comp rx=0 tx=0).stop 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 1 -- 172.21.15.53:0/479676623 shutdown_connections 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 1 --2- 172.21.15.53:0/479676623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461def60 0x55b1465a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 1 --2- 172.21.15.53:0/479676623 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b14619d8e0 0x55b1465a6c00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 1 --2- 172.21.15.53:0/479676623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461be280 0x55b146590450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 1 --2- 172.21.15.53:0/479676623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461b60a0 0x55b14658ff10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a43fff640 0 client.15645 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 1 -- 172.21.15.53:0/479676623 >> 172.21.15.53:0/479676623 conn(0x55b1461d3350 msgr2=0x55b146587990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 1 -- 172.21.15.53:0/479676623 shutdown_connections 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 1 -- 172.21.15.53:0/479676623 wait complete. 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.003+0000 7f1a711dc740 20 client.15645 trim_cache size 0 max 16384 2024-08-31T06:04:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.021+0000 7f1a711dc740 1 Processor -- start 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.021+0000 7f1a711dc740 1 -- start start 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461b60a0 0x55b14658fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461be280 0x55b146590200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a711dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b1465a4f40 con 0x55b1461def60 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a711dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b1465a5610 con 0x55b1461be280 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a711dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b1465a5ce0 con 0x55b1461b60a0 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a69204640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a69204640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465878b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60482/0 (socket says 172.21.15.53:60482) 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a69204640 1 -- 172.21.15.53:0/3635402008 learned_addr learned my addr 172.21.15.53:0/3635402008 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a68a03640 1 --2- 172.21.15.53:0/3635402008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461b60a0 0x55b14658fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a5bfff640 1 --2- 172.21.15.53:0/3635402008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461be280 0x55b146590200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a69204640 1 -- 172.21.15.53:0/3635402008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461b60a0 msgr2=0x55b14658fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a69204640 1 --2- 172.21.15.53:0/3635402008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461b60a0 0x55b14658fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a69204640 1 -- 172.21.15.53:0/3635402008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461be280 msgr2=0x55b146590200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a69204640 1 --2- 172.21.15.53:0/3635402008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461be280 0x55b146590200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a69204640 1 -- 172.21.15.53:0/3635402008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b146587610 con 0x55b1461def60 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a68a03640 1 --2- 172.21.15.53:0/3635402008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461b60a0 0x55b14658fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a69204640 1 --2- 172.21.15.53:0/3635402008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465878b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00a900 tx=0x7f1a5c00a930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143f9b6466e7aef9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a4a7fc640 1 -- 172.21.15.53:0/3635402008 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c02a030 con 0x55b1461def60 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a4a7fc640 1 -- 172.21.15.53:0/3635402008 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a5c00ce50 con 0x55b1461def60 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.022+0000 7f1a4a7fc640 1 -- 172.21.15.53:0/3635402008 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c022070 con 0x55b1461def60 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.023+0000 7f1a711dc740 1 -- 172.21.15.53:0/3635402008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 msgr2=0x55b1465878b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.023+0000 7f1a711dc740 1 --2- 172.21.15.53:0/3635402008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465878b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00a900 tx=0x7f1a5c00a930 comp rx=0 tx=0).stop 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.023+0000 7f1a711dc740 1 -- 172.21.15.53:0/3635402008 shutdown_connections 2024-08-31T06:04:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.023+0000 7f1a711dc740 1 --2- 172.21.15.53:0/3635402008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465878b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.023+0000 7f1a711dc740 1 --2- 172.21.15.53:0/3635402008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461be280 0x55b146590200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.023+0000 7f1a711dc740 1 --2- 172.21.15.53:0/3635402008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461b60a0 0x55b14658fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.023+0000 7f1a711dc740 1 -- 172.21.15.53:0/3635402008 >> 172.21.15.53:0/3635402008 conn(0x55b1461d3350 msgr2=0x55b14658e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.023+0000 7f1a711dc740 1 -- 172.21.15.53:0/3635402008 shutdown_connections 2024-08-31T06:04:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.023+0000 7f1a711dc740 1 -- 172.21.15.53:0/3635402008 wait complete. 2024-08-31T06:04:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a711dc740 1 -- start start 2024-08-31T06:04:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a711dc740 1 Processor -- start 2024-08-31T06:04:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461b60a0 0x55b1465aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461be280 0x55b1465ab460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.052 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:49.052 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:04:49.052 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 4, 2024-08-31T06:04:49.052 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24613, 2024-08-31T06:04:49.052 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:04:49.052 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:04:49.052 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:04:49.053 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 127.367659202, 2024-08-31T06:04:49.053 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 28, 2024-08-31T06:04:49.053 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 74, 2024-08-31T06:04:49.053 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 74, 2024-08-31T06:04:49.053 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 165.308995036 2024-08-31T06:04:49.053 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a711dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a711dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b1465a6a80 con 0x55b1461def60 2024-08-31T06:04:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a711dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b1465a63b0 con 0x55b1461b60a0 2024-08-31T06:04:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a711dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b1465a7150 con 0x55b1461be280 2024-08-31T06:04:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a711dc740 10 client.0 _ll_register_callbacks cb 0x7f1a60010ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a69204640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a69204640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60494/0 (socket says 172.21.15.53:60494) 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a69204640 1 -- 172.21.15.53:0/15585461 learned_addr learned my addr 172.21.15.53:0/15585461 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a68a03640 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461b60a0 0x55b1465aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.024+0000 7f1a5bfff640 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461be280 0x55b1465ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a69204640 1 -- 172.21.15.53:0/15585461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461be280 msgr2=0x55b1465ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a69204640 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461be280 0x55b1465ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a69204640 1 -- 172.21.15.53:0/15585461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461b60a0 msgr2=0x55b1465aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a69204640 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461b60a0 0x55b1465aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a69204640 1 -- 172.21.15.53:0/15585461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b146611150 con 0x55b1461def60 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a5bfff640 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461be280 0x55b1465ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a69204640 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465ab9a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00a8d0 tx=0x7f1a5c014a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d26877c84a5d41 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a43fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a43fff640 1 -- 172.21.15.53:0/15585461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c02a030 con 0x55b1461def60 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a43fff640 1 -- 172.21.15.53:0/15585461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1a5c014250 con 0x55b1461def60 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a711dc740 1 -- 172.21.15.53:0/15585461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a5c00ce50 con 0x55b1461def60 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a43fff640 1 -- 172.21.15.53:0/15585461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a5c022040 con 0x55b1461def60 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a711dc740 10 client.15651 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.025+0000 7f1a711dc740 1 -- 172.21.15.53:0/15585461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1466123d0 con 0x55b1461def60 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.026+0000 7f1a43fff640 1 -- 172.21.15.53:0/15585461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a5c00ce50 con 0x55b1461def60 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.026+0000 7f1a43fff640 1 -- 172.21.15.53:0/15585461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1a5c01d070 con 0x55b1461def60 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.026+0000 7f1a711dc740 10 client.15651 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.026+0000 7f1a711dc740 10 client.15651 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.026+0000 7f1a711dc740 20 client.15651 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.026+0000 7f1a711dc740 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b146172c90 0x55b146615570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.026+0000 7f1a711dc740 4 client.15651 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.026+0000 7f1a711dc740 1 -- 172.21.15.53:0/15585461 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "status"}) -- 0x55b1464f8de0 con 0x55b146172c90 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.026+0000 7f1a68a03640 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b146172c90 0x55b146615570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.026+0000 7f1a43fff640 10 client.15651 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.026+0000 7f1a68a03640 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b146172c90 0x55b146615570 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=90d9a7b0bfbc6c4a server_cookie=2bd1d29389690962 in_seq=0 out_seq=0 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a43fff640 1 -- 172.21.15.53:0/15585461 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55b1464f8de0 con 0x55b146172c90 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a43fff640 10 client.15651 handle_command_reply: tid=0 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 1 client.15651 shutdown 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 1 -- 172.21.15.53:0/15585461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 msgr2=0x55b1465ab9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465ab9a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00a8d0 tx=0x7f1a5c014a30 comp rx=0 tx=0).stop 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 1 -- 172.21.15.53:0/15585461 shutdown_connections 2024-08-31T06:04:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1461def60 0x55b1465ab9a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b146172c90 0x55b146615570 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1461be280 0x55b1465ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a43fff640 0 client.15651 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 1 --2- 172.21.15.53:0/15585461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1461b60a0 0x55b1465aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 1 -- 172.21.15.53:0/15585461 >> 172.21.15.53:0/15585461 conn(0x55b1461d3350 msgr2=0x55b1465878b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 1 -- 172.21.15.53:0/15585461 shutdown_connections 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 1 -- 172.21.15.53:0/15585461 wait complete. 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.027+0000 7f1a711dc740 20 client.15651 trim_cache size 0 max 16384 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 -- 172.21.15.53:0/722549766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a4c0b4c90 msgr2=0x7f1a4c0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a4c0b4c90 0x7f1a4c0b71a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c011cb0 tx=0x7f1a5c01c000 comp rx=0 tx=0).stop 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 -- 172.21.15.53:0/722549766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64102880 msgr2=0x7f1a6419af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64102880 0x7f1a6419af50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000d950 tx=0x7f1a6000de10 comp rx=0 tx=0).stop 2024-08-31T06:04:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 -- 172.21.15.53:0/722549766 shutdown_connections 2024-08-31T06:04:49.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a4c0b4c90 0x7f1a4c0b71a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64108ac0 0x7f1a6419b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108170 0x7f1a6419b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 --2- 172.21.15.53:0/722549766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64102880 0x7f1a6419af50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:49.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 -- 172.21.15.53:0/722549766 >> 172.21.15.53:0/722549766 conn(0x7f1a64079500 msgr2=0x7f1a641042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:49.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 -- 172.21.15.53:0/722549766 shutdown_connections 2024-08-31T06:04:49.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:49.028+0000 7f1a6ac67640 1 -- 172.21.15.53:0/722549766 wait complete. 2024-08-31T06:04:49.719 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.c status 2024-08-31T06:04:49.974 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:50.352 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:50 smithi053 ceph-mon[18924]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-31T06:04:50.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:50 smithi130 ceph-mon[22266]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-31T06:04:50.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:50 smithi153 ceph-mon[22320]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-31T06:04:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.439+0000 7f304ead6640 1 -- 172.21.15.53:0/3129947119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3048109b90 msgr2=0x7f30481103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.439+0000 7f304ead6640 1 --2- 172.21.15.53:0/3129947119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3048109b90 0x7f30481103c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3040009ca0 tx=0x7f304002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.439+0000 7f304ead6640 1 -- 172.21.15.53:0/3129947119 shutdown_connections 2024-08-31T06:04:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.439+0000 7f304ead6640 1 --2- 172.21.15.53:0/3129947119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3048109b90 0x7f30481103c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.439+0000 7f304ead6640 1 --2- 172.21.15.53:0/3129947119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3048109240 0x7f3048109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.439+0000 7f304ead6640 1 --2- 172.21.15.53:0/3129947119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3048103900 0x7f3048103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.439+0000 7f304ead6640 1 -- 172.21.15.53:0/3129947119 >> 172.21.15.53:0/3129947119 conn(0x7f304807b5f0 msgr2=0x7f304807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.439+0000 7f304ead6640 1 -- 172.21.15.53:0/3129947119 shutdown_connections 2024-08-31T06:04:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.439+0000 7f304ead6640 1 -- 172.21.15.53:0/3129947119 wait complete. 2024-08-31T06:04:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f304ead6640 1 Processor -- start 2024-08-31T06:04:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f304ead6640 1 -- start start 2024-08-31T06:04:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f304ead6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3048103900 0x7f304819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f304ead6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3048109240 0x7f304819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f304ead6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3048109b90 0x7f304819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f304ead6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3048113750 con 0x7f3048103900 2024-08-31T06:04:50.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f304ead6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f30481135d0 con 0x7f3048109240 2024-08-31T06:04:50.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f304ead6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30481138d0 con 0x7f3048109b90 2024-08-31T06:04:50.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f304c872640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3048103900 0x7f304819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f304c872640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3048103900 0x7f304819a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60504/0 (socket says 172.21.15.53:60504) 2024-08-31T06:04:50.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f304c872640 1 -- 172.21.15.53:0/4233401459 learned_addr learned my addr 172.21.15.53:0/4233401459 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:50.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.440+0000 7f3047fff640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3048109240 0x7f304819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.441+0000 7f304d073640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3048109b90 0x7f304819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.441+0000 7f304c872640 1 -- 172.21.15.53:0/4233401459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3048109b90 msgr2=0x7f304819faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:50.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.441+0000 7f304c872640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3048109b90 0x7f304819faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.441+0000 7f304c872640 1 -- 172.21.15.53:0/4233401459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3048109240 msgr2=0x7f304819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:50.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.441+0000 7f304c872640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3048109240 0x7f304819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.441+0000 7f304c872640 1 -- 172.21.15.53:0/4233401459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30481a01d0 con 0x7f3048103900 2024-08-31T06:04:50.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.441+0000 7f304c872640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3048103900 0x7f304819a260 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f303c00d770 tx=0x7f303c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:50.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.442+0000 7f3045ffb640 1 -- 172.21.15.53:0/4233401459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c017070 con 0x7f3048103900 2024-08-31T06:04:50.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.442+0000 7f304ead6640 1 -- 172.21.15.53:0/4233401459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30481a04c0 con 0x7f3048103900 2024-08-31T06:04:50.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.442+0000 7f3045ffb640 1 -- 172.21.15.53:0/4233401459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f303c0054b0 con 0x7f3048103900 2024-08-31T06:04:50.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.442+0000 7f3045ffb640 1 -- 172.21.15.53:0/4233401459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c004c60 con 0x7f3048103900 2024-08-31T06:04:50.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.442+0000 7f304ead6640 1 -- 172.21.15.53:0/4233401459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30481a6c20 con 0x7f3048103900 2024-08-31T06:04:50.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.444+0000 7f305504b740 1 Processor -- start 2024-08-31T06:04:50.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.444+0000 7f305504b740 1 -- start start 2024-08-31T06:04:50.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.444+0000 7f3045ffb640 1 -- 172.21.15.53:0/4233401459 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f303c004e00 con 0x7f3048103900 2024-08-31T06:04:50.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f305504b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671fa5f60 0x56267234b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f305504b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671f7d0a0 0x56267234bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f305504b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267234c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f305504b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626722c23f0 con 0x562671f85280 2024-08-31T06:04:50.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f305504b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5626722b1980 con 0x562671f7d0a0 2024-08-31T06:04:50.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f305504b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5626722b5930 con 0x562671fa5f60 2024-08-31T06:04:50.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f3047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267234c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f3047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267234c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60518/0 (socket says 172.21.15.53:60518) 2024-08-31T06:04:50.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f3047fff640 1 -- 172.21.15.53:0/2454334176 learned_addr learned my addr 172.21.15.53:0/2454334176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:50.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f304c872640 1 --2- 172.21.15.53:0/2454334176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671f7d0a0 0x56267234bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f304d073640 1 --2- 172.21.15.53:0/2454334176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671fa5f60 0x56267234b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f3047fff640 1 -- 172.21.15.53:0/2454334176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671fa5f60 msgr2=0x56267234b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:50.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f3047fff640 1 --2- 172.21.15.53:0/2454334176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671fa5f60 0x56267234b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f3047fff640 1 -- 172.21.15.53:0/2454334176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671f7d0a0 msgr2=0x56267234bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:50.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f3047fff640 1 --2- 172.21.15.53:0/2454334176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671f7d0a0 0x56267234bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f3047fff640 1 -- 172.21.15.53:0/2454334176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562672011540 con 0x562671f85280 2024-08-31T06:04:50.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.445+0000 7f3045ffb640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30380b4c10 0x7f30380b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.446+0000 7f3047fff640 1 --2- 172.21.15.53:0/2454334176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267234c230 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f303400bbb0 tx=0x7f30340107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ca08f53affb19c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:50.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.446+0000 7f304d073640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30380b4c10 0x7f30380b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.446+0000 7f3045ffb640 1 -- 172.21.15.53:0/4233401459 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f303c0e4ec0 con 0x7f3048103900 2024-08-31T06:04:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.446+0000 7f3032ffd640 1 -- 172.21.15.53:0/2454334176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3034004030 con 0x562671f85280 2024-08-31T06:04:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.446+0000 7f3032ffd640 1 -- 172.21.15.53:0/2454334176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3034005020 con 0x562671f85280 2024-08-31T06:04:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.446+0000 7f3032ffd640 1 -- 172.21.15.53:0/2454334176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3034004b10 con 0x562671f85280 2024-08-31T06:04:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f305504b740 1 -- 172.21.15.53:0/2454334176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 msgr2=0x56267234c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f304d073640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30380b4c10 0x7f30380b7120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3040005e30 tx=0x7f3040005c50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f305504b740 1 --2- 172.21.15.53:0/2454334176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267234c230 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f303400bbb0 tx=0x7f30340107a0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f305504b740 1 -- 172.21.15.53:0/2454334176 shutdown_connections 2024-08-31T06:04:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f305504b740 1 --2- 172.21.15.53:0/2454334176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267234c230 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f305504b740 1 --2- 172.21.15.53:0/2454334176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671f7d0a0 0x56267234bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f305504b740 1 --2- 172.21.15.53:0/2454334176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671fa5f60 0x56267234b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f305504b740 1 -- 172.21.15.53:0/2454334176 >> 172.21.15.53:0/2454334176 conn(0x562671f9a350 msgr2=0x5626723496a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f305504b740 1 -- 172.21.15.53:0/2454334176 shutdown_connections 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f305504b740 1 -- 172.21.15.53:0/2454334176 wait complete. 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f305504b740 1 -- start start 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.447+0000 7f305504b740 1 Processor -- start 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f305504b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671f7d0a0 0x56267235b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f305504b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267235b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f305504b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671fa5f60 0x56267235bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f305504b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626721145f0 con 0x562671f85280 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f305504b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562672238600 con 0x562671fa5f60 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f305504b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56267235e2f0 con 0x562671f7d0a0 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f305504b740 10 client.0 _ll_register_callbacks cb 0x56267225eaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f3047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267235b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f3047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267235b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60532/0 (socket says 172.21.15.53:60532) 2024-08-31T06:04:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f3047fff640 1 -- 172.21.15.53:0/638080652 learned_addr learned my addr 172.21.15.53:0/638080652 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f304d073640 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671fa5f60 0x56267235bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f304c872640 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671f7d0a0 0x56267235b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f3047fff640 1 -- 172.21.15.53:0/638080652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671f7d0a0 msgr2=0x56267235b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f3047fff640 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671f7d0a0 0x56267235b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f3047fff640 1 -- 172.21.15.53:0/638080652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671fa5f60 msgr2=0x56267235bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f3047fff640 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671fa5f60 0x56267235bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f3047fff640 1 -- 172.21.15.53:0/638080652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626722717b0 con 0x562671f85280 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f3047fff640 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267235b750 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f303400bed0 tx=0x7f303400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67d8e4be01e7c4a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.448+0000 7f3027fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f3027fff640 1 -- 172.21.15.53:0/638080652 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303402a060 con 0x562671f85280 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f3027fff640 1 -- 172.21.15.53:0/638080652 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f30340054a0 con 0x562671f85280 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f305504b740 1 -- 172.21.15.53:0/638080652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3034005020 con 0x562671f85280 2024-08-31T06:04:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f3027fff640 1 -- 172.21.15.53:0/638080652 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3034004040 con 0x562671f85280 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f305504b740 10 client.15663 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f305504b740 1 -- 172.21.15.53:0/638080652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562672369fe0 con 0x562671f85280 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f3027fff640 1 -- 172.21.15.53:0/638080652 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3034005020 con 0x562671f85280 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f3027fff640 1 -- 172.21.15.53:0/638080652 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3034003680 con 0x562671f85280 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f305504b740 10 client.15663 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f305504b740 10 client.15663 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f305504b740 20 client.15663 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f305504b740 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x562671f648e0 0x56267236d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f305504b740 4 client.15663 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.449+0000 7f305504b740 1 -- 172.21.15.53:0/638080652 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626722c4340 con 0x562671f648e0 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.450+0000 7f304c872640 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x562671f648e0 0x56267236d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.450+0000 7f304c872640 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x562671f648e0 0x56267236d6a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5b8d4f344662272f server_cookie=5894a3d3aace38be in_seq=0 out_seq=0 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.450+0000 7f3027fff640 10 client.15663 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:04:50.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f3027fff640 1 -- 172.21.15.53:0/638080652 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5626722c4340 con 0x562671f648e0 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f3027fff640 10 client.15663 handle_command_reply: tid=0 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 1 client.15663 shutdown 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 1 -- 172.21.15.53:0/638080652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 msgr2=0x56267235b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267235b750 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f303400bed0 tx=0x7f303400bf00 comp rx=0 tx=0).stop 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 1 -- 172.21.15.53:0/638080652 shutdown_connections 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671fa5f60 0x56267235bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x562671f648e0 0x56267236d6a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x56267235b750 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f3027fff640 0 client.15663 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 1 --2- 172.21.15.53:0/638080652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671f7d0a0 0x56267235b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 1 -- 172.21.15.53:0/638080652 >> 172.21.15.53:0/638080652 conn(0x562671f9a350 msgr2=0x562672347ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 1 -- 172.21.15.53:0/638080652 shutdown_connections 2024-08-31T06:04:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 1 -- 172.21.15.53:0/638080652 wait complete. 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.451+0000 7f305504b740 20 client.15663 trim_cache size 0 max 16384 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.470+0000 7f305504b740 1 Processor -- start 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.470+0000 7f305504b740 1 -- start start 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f305504b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671f7d0a0 0x56267235a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f305504b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672359a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f305504b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671fa5f60 0x562672359fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f305504b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56267236b9e0 con 0x562671f85280 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f305504b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56267236c0b0 con 0x562671f7d0a0 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f305504b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56267236c780 con 0x562671fa5f60 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f3047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672359a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f3047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672359a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60548/0 (socket says 172.21.15.53:60548) 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f3047fff640 1 -- 172.21.15.53:0/3952291139 learned_addr learned my addr 172.21.15.53:0/3952291139 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f304d073640 1 --2- 172.21.15.53:0/3952291139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671fa5f60 0x562672359fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f304c872640 1 --2- 172.21.15.53:0/3952291139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671f7d0a0 0x56267235a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f3047fff640 1 -- 172.21.15.53:0/3952291139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671fa5f60 msgr2=0x562672359fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f3047fff640 1 --2- 172.21.15.53:0/3952291139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671fa5f60 0x562672359fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f3047fff640 1 -- 172.21.15.53:0/3952291139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671f7d0a0 msgr2=0x56267235a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f3047fff640 1 --2- 172.21.15.53:0/3952291139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671f7d0a0 0x56267235a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f3047fff640 1 -- 172.21.15.53:0/3952291139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562672359710 con 0x562671f85280 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f304c872640 1 --2- 172.21.15.53:0/3952291139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671f7d0a0 0x56267235a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f3047fff640 1 --2- 172.21.15.53:0/3952291139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672359a90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f303400b940 tx=0x7f3034005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299842b0f0248821 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.471+0000 7f30327fc640 1 -- 172.21.15.53:0/3952291139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303402a070 con 0x562671f85280 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.472+0000 7f30327fc640 1 -- 172.21.15.53:0/3952291139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3034003ce0 con 0x562671f85280 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.472+0000 7f30327fc640 1 -- 172.21.15.53:0/3952291139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3034011c70 con 0x562671f85280 2024-08-31T06:04:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.472+0000 7f305504b740 1 -- 172.21.15.53:0/3952291139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 msgr2=0x562672359a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.472+0000 7f305504b740 1 --2- 172.21.15.53:0/3952291139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672359a90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f303400b940 tx=0x7f3034005650 comp rx=0 tx=0).stop 2024-08-31T06:04:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.472+0000 7f305504b740 1 -- 172.21.15.53:0/3952291139 shutdown_connections 2024-08-31T06:04:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.472+0000 7f305504b740 1 --2- 172.21.15.53:0/3952291139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671fa5f60 0x562672359fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.472+0000 7f305504b740 1 --2- 172.21.15.53:0/3952291139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672359a90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.472+0000 7f305504b740 1 --2- 172.21.15.53:0/3952291139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671f7d0a0 0x56267235a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.472+0000 7f305504b740 1 -- 172.21.15.53:0/3952291139 >> 172.21.15.53:0/3952291139 conn(0x562671f9a350 msgr2=0x562672344400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.473+0000 7f305504b740 1 -- 172.21.15.53:0/3952291139 shutdown_connections 2024-08-31T06:04:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.473+0000 7f305504b740 1 -- 172.21.15.53:0/3952291139 wait complete. 2024-08-31T06:04:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.473+0000 7f305504b740 1 -- start start 2024-08-31T06:04:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.473+0000 7f305504b740 1 Processor -- start 2024-08-31T06:04:50.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.473+0000 7f305504b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671f7d0a0 0x562672371250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.473+0000 7f305504b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672371830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.473+0000 7f305504b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671fa5f60 0x5626723d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.473+0000 7f305504b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56267236d520 con 0x562671f85280 2024-08-31T06:04:50.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.473+0000 7f305504b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56267236ce50 con 0x562671fa5f60 2024-08-31T06:04:50.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f305504b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56267236dbf0 con 0x562671f7d0a0 2024-08-31T06:04:50.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672371830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f305504b740 10 client.0 _ll_register_callbacks cb 0x7f303400ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:50.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672371830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60562/0 (socket says 172.21.15.53:60562) 2024-08-31T06:04:50.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3047fff640 1 -- 172.21.15.53:0/3012886700 learned_addr learned my addr 172.21.15.53:0/3012886700 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:50.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f304d073640 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671fa5f60 0x5626723d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f304c872640 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671f7d0a0 0x562672371250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3047fff640 1 -- 172.21.15.53:0/3012886700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671f7d0a0 msgr2=0x562672371250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:50.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3047fff640 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671f7d0a0 0x562672371250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3047fff640 1 -- 172.21.15.53:0/3012886700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671fa5f60 msgr2=0x5626723d6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:50.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3047fff640 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671fa5f60 0x5626723d6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3047fff640 1 -- 172.21.15.53:0/3012886700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626723d71d0 con 0x562671f85280 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f304d073640 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671fa5f60 0x5626723d6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3047fff640 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672371830 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f30340038b0 tx=0x7f3034011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790737deadaf07da server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3027fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3027fff640 1 -- 172.21.15.53:0/3012886700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303403b070 con 0x562671f85280 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f305504b740 1 -- 172.21.15.53:0/3012886700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3034003ce0 con 0x562671f85280 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3027fff640 1 -- 172.21.15.53:0/3012886700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f3034011e00 con 0x562671f85280 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.474+0000 7f3027fff640 1 -- 172.21.15.53:0/3012886700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3034047050 con 0x562671f85280 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.475+0000 7f305504b740 10 client.15669 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.475+0000 7f305504b740 1 -- 172.21.15.53:0/3012886700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5626723d8450 con 0x562671f85280 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.475+0000 7f3027fff640 1 -- 172.21.15.53:0/3012886700 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3034003ce0 con 0x562671f85280 2024-08-31T06:04:50.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.475+0000 7f3027fff640 1 -- 172.21.15.53:0/3012886700 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3034037c40 con 0x562671f85280 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.475+0000 7f305504b740 10 client.15669 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.475+0000 7f305504b740 10 client.15669 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.475+0000 7f305504b740 20 client.15669 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.475+0000 7f305504b740 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x562671f39c90 0x5626723db950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.475+0000 7f305504b740 4 client.15669 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.475+0000 7f305504b740 1 -- 172.21.15.53:0/3012886700 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "status"}) -- 0x5626722bfde0 con 0x562671f39c90 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.475+0000 7f304c872640 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x562671f39c90 0x5626723db950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f304c872640 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x562671f39c90 0x5626723db950 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a1239e3f4e48adb0 server_cookie=d4fb3f60a2121e59 in_seq=0 out_seq=0 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f3027fff640 10 client.15669 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f3027fff640 1 -- 172.21.15.53:0/3012886700 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5626722bfde0 con 0x562671f39c90 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f3027fff640 10 client.15669 handle_command_reply: tid=0 2024-08-31T06:04:50.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 1 client.15669 shutdown 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 1 -- 172.21.15.53:0/3012886700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 msgr2=0x562672371830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672371830 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f30340038b0 tx=0x7f3034011c10 comp rx=0 tx=0).stop 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 1 -- 172.21.15.53:0/3012886700 shutdown_connections 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562671fa5f60 0x5626723d6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x562671f39c90 0x5626723db950 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562671f85280 0x562672371830 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 1 --2- 172.21.15.53:0/3012886700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562671f7d0a0 0x562672371250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f3027fff640 0 client.15669 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 1 -- 172.21.15.53:0/3012886700 >> 172.21.15.53:0/3012886700 conn(0x562671f9a350 msgr2=0x562672344400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 1 -- 172.21.15.53:0/3012886700 shutdown_connections 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 1 -- 172.21.15.53:0/3012886700 wait complete. 2024-08-31T06:04:50.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.476+0000 7f305504b740 20 client.15669 trim_cache size 0 max 16384 2024-08-31T06:04:50.501 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:04:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 3, 2024-08-31T06:04:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24619, 2024-08-31T06:04:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:04:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:04:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:04:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 129.824083199, 2024-08-31T06:04:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 28, 2024-08-31T06:04:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 74, 2024-08-31T06:04:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 74, 2024-08-31T06:04:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 164.26344919799999 2024-08-31T06:04:50.502 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 -- 172.21.15.53:0/4233401459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30380b4c10 msgr2=0x7f30380b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30380b4c10 0x7f30380b7120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3040005e30 tx=0x7f3040005c50 comp rx=0 tx=0).stop 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 -- 172.21.15.53:0/4233401459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3048103900 msgr2=0x7f304819a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3048103900 0x7f304819a260 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f303c00d770 tx=0x7f303c00dc30 comp rx=0 tx=0).stop 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 -- 172.21.15.53:0/4233401459 shutdown_connections 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30380b4c10 0x7f30380b7120 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3048109b90 0x7f304819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3048109240 0x7f304819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 --2- 172.21.15.53:0/4233401459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3048103900 0x7f304819a260 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 -- 172.21.15.53:0/4233401459 >> 172.21.15.53:0/4233401459 conn(0x7f304807b5f0 msgr2=0x7f30481053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 -- 172.21.15.53:0/4233401459 shutdown_connections 2024-08-31T06:04:50.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:50.477+0000 7f304ead6640 1 -- 172.21.15.53:0/4233401459 wait complete. 2024-08-31T06:04:51.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T06:04:51.451 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:51.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 -- 172.21.15.53:0/631164482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f076010dbf0 msgr2=0x7f07601100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:51.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 --2- 172.21.15.53:0/631164482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f076010dbf0 0x7f07601100e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0758009900 tx=0x7f075802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:51.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 -- 172.21.15.53:0/631164482 shutdown_connections 2024-08-31T06:04:51.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 --2- 172.21.15.53:0/631164482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f076010dbf0 0x7f07601100e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 --2- 172.21.15.53:0/631164482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07601050e0 0x7f076010d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 --2- 172.21.15.53:0/631164482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0760104790 0x7f0760104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 -- 172.21.15.53:0/631164482 >> 172.21.15.53:0/631164482 conn(0x7f07600794f0 msgr2=0x7f0760079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 -- 172.21.15.53:0/631164482 shutdown_connections 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 -- 172.21.15.53:0/631164482 wait complete. 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 Processor -- start 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 -- start start 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0760104790 0x7f076019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07601050e0 0x7f076019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f076010dbf0 0x7f076019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0760113700 con 0x7f07601050e0 2024-08-31T06:04:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0760113580 con 0x7f076010dbf0 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0767fec640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0760113880 con 0x7f0760104790 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0765587640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07601050e0 0x7f076019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0765587640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07601050e0 0x7f076019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60578/0 (socket says 172.21.15.53:60578) 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0765587640 1 -- 172.21.15.53:0/528365423 learned_addr learned my addr 172.21.15.53:0/528365423 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0766589640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f076010dbf0 0x7f076019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0765587640 1 -- 172.21.15.53:0/528365423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0760104790 msgr2=0x7f076019a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0765587640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0760104790 0x7f076019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0765587640 1 -- 172.21.15.53:0/528365423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f076010dbf0 msgr2=0x7f076019f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0765587640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f076010dbf0 0x7f076019f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0765587640 1 -- 172.21.15.53:0/528365423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076019ff00 con 0x7f07601050e0 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.917+0000 7f0766589640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f076010dbf0 0x7f076019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.918+0000 7f0765587640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07601050e0 0x7f076019a5f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f075000c8c0 tx=0x7f075000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.918+0000 7f0756ffd640 1 -- 172.21.15.53:0/528365423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0750007bb0 con 0x7f07601050e0 2024-08-31T06:04:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.918+0000 7f0756ffd640 1 -- 172.21.15.53:0/528365423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0750007d50 con 0x7f07601050e0 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.918+0000 7f0767fec640 1 -- 172.21.15.53:0/528365423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07601a01f0 con 0x7f07601050e0 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.918+0000 7f0756ffd640 1 -- 172.21.15.53:0/528365423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07500186a0 con 0x7f07601050e0 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.918+0000 7f0767fec640 1 -- 172.21.15.53:0/528365423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07601a6a10 con 0x7f07601050e0 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.921+0000 7f076e561740 1 Processor -- start 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.921+0000 7f076e561740 1 -- start start 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.921+0000 7f076e561740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddecf60 0x55bfce1927b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.921+0000 7f076e561740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce192cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.921+0000 7f076e561740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddcc280 0x55bfce193230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.921+0000 7f076e561740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bfce1093f0 con 0x55bfcddcc280 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.921+0000 7f0756ffd640 1 -- 172.21.15.53:0/528365423 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f075000fa00 con 0x7f07601050e0 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.921+0000 7f076e561740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bfce0f8980 con 0x55bfcddc40a0 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.921+0000 7f076e561740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bfce0fc930 con 0x55bfcddecf60 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0765587640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddcc280 0x55bfce193230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0765587640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddcc280 0x55bfce193230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60594/0 (socket says 172.21.15.53:60594) 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0765587640 1 -- 172.21.15.53:0/3642484255 learned_addr learned my addr 172.21.15.53:0/3642484255 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0766589640 1 --2- 172.21.15.53:0/3642484255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddecf60 0x55bfce1927b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0765d88640 1 --2- 172.21.15.53:0/3642484255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce192cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0765587640 1 -- 172.21.15.53:0/3642484255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddecf60 msgr2=0x55bfce1927b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0765587640 1 --2- 172.21.15.53:0/3642484255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddecf60 0x55bfce1927b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0765587640 1 -- 172.21.15.53:0/3642484255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 msgr2=0x55bfce192cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0765587640 1 --2- 172.21.15.53:0/3642484255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce192cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0765587640 1 -- 172.21.15.53:0/3642484255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfcde58540 con 0x55bfcddcc280 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0765d88640 1 --2- 172.21.15.53:0/3642484255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce192cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f0765587640 1 --2- 172.21.15.53:0/3642484255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddcc280 0x55bfce193230 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f07500e2d70 tx=0x7f07500ebd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59b65d4c40ada2b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.922+0000 7f074bfff640 1 -- 172.21.15.53:0/3642484255 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07500e5e20 con 0x55bfcddcc280 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f074bfff640 1 -- 172.21.15.53:0/3642484255 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07500f2070 con 0x55bfcddcc280 2024-08-31T06:04:51.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f074bfff640 1 -- 172.21.15.53:0/3642484255 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07500e78a0 con 0x55bfcddcc280 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f0756ffd640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f074c0b4c40 0x7f074c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f0766589640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f074c0b4c40 0x7f074c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f0756ffd640 1 -- 172.21.15.53:0/528365423 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f07500e55a0 con 0x7f07601050e0 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f076e561740 1 -- 172.21.15.53:0/3642484255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddcc280 msgr2=0x55bfce193230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f076e561740 1 --2- 172.21.15.53:0/3642484255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddcc280 0x55bfce193230 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f07500e2d70 tx=0x7f07500ebd90 comp rx=0 tx=0).stop 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f0766589640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f074c0b4c40 0x7f074c0b7150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0758006010 tx=0x7f0758009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f076e561740 1 -- 172.21.15.53:0/3642484255 shutdown_connections 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f076e561740 1 --2- 172.21.15.53:0/3642484255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddcc280 0x55bfce193230 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f076e561740 1 --2- 172.21.15.53:0/3642484255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce192cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f076e561740 1 --2- 172.21.15.53:0/3642484255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddecf60 0x55bfce1927b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.923+0000 7f076e561740 1 -- 172.21.15.53:0/3642484255 >> 172.21.15.53:0/3642484255 conn(0x55bfcdde1350 msgr2=0x55bfce1906a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.924+0000 7f076e561740 1 -- 172.21.15.53:0/3642484255 shutdown_connections 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.924+0000 7f076e561740 1 -- 172.21.15.53:0/3642484255 wait complete. 2024-08-31T06:04:51.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.924+0000 7f076e561740 1 -- start start 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.924+0000 7f076e561740 1 Processor -- start 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.924+0000 7f076e561740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce19de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.924+0000 7f076e561740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce19e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f076e561740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f076e561740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bfcdf5b5f0 con 0x55bfcddecf60 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f076e561740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bfce07f600 con 0x55bfcddc40a0 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f076e561740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bfce1a0f90 con 0x55bfcddcc280 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f076e561740 10 client.0 _ll_register_callbacks cb 0x55bfce0a5af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0766589640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0766589640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1aa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60596/0 (socket says 172.21.15.53:60596) 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0766589640 1 -- 172.21.15.53:0/1766937960 learned_addr learned my addr 172.21.15.53:0/1766937960 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0765d88640 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce19de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0765587640 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce19e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0766589640 1 -- 172.21.15.53:0/1766937960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 msgr2=0x55bfce19e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0766589640 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce19e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0766589640 1 -- 172.21.15.53:0/1766937960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 msgr2=0x55bfce19de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0766589640 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce19de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0766589640 1 -- 172.21.15.53:0/1766937960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfce0b87b0 con 0x55bfcddecf60 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0765587640 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce19e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0765d88640 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce19de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f0766589640 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1aa2b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0758005760 tx=0x7f075802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8207a5d5805082e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f07497fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f07497fa640 1 -- 172.21.15.53:0/1766937960 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075804c070 con 0x55bfcddecf60 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f07497fa640 1 -- 172.21.15.53:0/1766937960 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0758004450 con 0x55bfcddecf60 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.925+0000 7f076e561740 1 -- 172.21.15.53:0/1766937960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07500f2070 con 0x55bfcddecf60 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f07497fa640 1 -- 172.21.15.53:0/1766937960 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0758058050 con 0x55bfcddecf60 2024-08-31T06:04:51.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f076e561740 10 client.15681 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f076e561740 1 -- 172.21.15.53:0/1766937960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bfce1acc90 con 0x55bfcddecf60 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f07497fa640 1 -- 172.21.15.53:0/1766937960 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07500f2070 con 0x55bfcddecf60 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f07497fa640 1 -- 172.21.15.53:0/1766937960 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f075803c640 con 0x55bfcddecf60 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f076e561740 10 client.15681 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f076e561740 10 client.15681 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f076e561740 20 client.15681 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f076e561740 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bfcddab8e0 0x55bfce1b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f076e561740 4 client.15681 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f076e561740 1 -- 172.21.15.53:0/1766937960 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfce10b340 con 0x55bfcddab8e0 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.926+0000 7f0765d88640 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bfcddab8e0 0x55bfce1b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.927+0000 7f07497fa640 10 client.15681 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.927+0000 7f0765d88640 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bfcddab8e0 0x55bfce1b0750 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10756f05d9c27c45 server_cookie=8559ae82f03bcf32 in_seq=0 out_seq=0 2024-08-31T06:04:51.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f07497fa640 1 -- 172.21.15.53:0/1766937960 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bfce10b340 con 0x55bfcddab8e0 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f07497fa640 10 client.15681 handle_command_reply: tid=0 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 1 client.15681 shutdown 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 1 -- 172.21.15.53:0/1766937960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 msgr2=0x55bfce1aa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1aa2b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0758005760 tx=0x7f075802a410 comp rx=0 tx=0).stop 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 1 -- 172.21.15.53:0/1766937960 shutdown_connections 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bfcddab8e0 0x55bfce1b0750 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1aa2b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce19e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 1 --2- 172.21.15.53:0/1766937960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce19de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f07497fa640 0 client.15681 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 1 -- 172.21.15.53:0/1766937960 >> 172.21.15.53:0/1766937960 conn(0x55bfcdde1350 msgr2=0x55bfce195940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 1 -- 172.21.15.53:0/1766937960 shutdown_connections 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 1 -- 172.21.15.53:0/1766937960 wait complete. 2024-08-31T06:04:51.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.928+0000 7f076e561740 20 client.15681 trim_cache size 0 max 16384 2024-08-31T06:04:51.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.946+0000 7f076e561740 1 Processor -- start 2024-08-31T06:04:51.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.946+0000 7f076e561740 1 -- start start 2024-08-31T06:04:51.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f076e561740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce1aa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f076e561740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce18fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f076e561740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce190230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f076e561740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bfce1aea90 con 0x55bfcddecf60 2024-08-31T06:04:51.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f076e561740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bfce1af160 con 0x55bfcddc40a0 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f076e561740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bfce1af830 con 0x55bfcddcc280 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f0766589640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce190230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f0766589640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce190230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60600/0 (socket says 172.21.15.53:60600) 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f0766589640 1 -- 172.21.15.53:0/2213632170 learned_addr learned my addr 172.21.15.53:0/2213632170 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f0765d88640 1 --2- 172.21.15.53:0/2213632170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce1aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f0766589640 1 -- 172.21.15.53:0/2213632170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 msgr2=0x55bfce18fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f0766589640 1 --2- 172.21.15.53:0/2213632170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce18fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f0766589640 1 -- 172.21.15.53:0/2213632170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 msgr2=0x55bfce1aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f0766589640 1 --2- 172.21.15.53:0/2213632170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce1aa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f0766589640 1 -- 172.21.15.53:0/2213632170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfce19e750 con 0x55bfcddecf60 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f0765d88640 1 --2- 172.21.15.53:0/2213632170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce1aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f0766589640 1 --2- 172.21.15.53:0/2213632170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce190230 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f075802a930 tx=0x7f0758005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b987b8ea14ddfd23 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f074b7fe640 1 -- 172.21.15.53:0/2213632170 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075804c040 con 0x55bfcddecf60 2024-08-31T06:04:51.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f074b7fe640 1 -- 172.21.15.53:0/2213632170 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0758061070 con 0x55bfcddecf60 2024-08-31T06:04:51.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.947+0000 7f074b7fe640 1 -- 172.21.15.53:0/2213632170 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0758035040 con 0x55bfcddecf60 2024-08-31T06:04:51.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.948+0000 7f076e561740 1 -- 172.21.15.53:0/2213632170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 msgr2=0x55bfce190230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:51.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.948+0000 7f076e561740 1 --2- 172.21.15.53:0/2213632170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce190230 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f075802a930 tx=0x7f0758005dd0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.948+0000 7f076e561740 1 -- 172.21.15.53:0/2213632170 shutdown_connections 2024-08-31T06:04:51.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.948+0000 7f076e561740 1 --2- 172.21.15.53:0/2213632170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce190230 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.948+0000 7f076e561740 1 --2- 172.21.15.53:0/2213632170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce18fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.948+0000 7f076e561740 1 --2- 172.21.15.53:0/2213632170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce1aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.948+0000 7f076e561740 1 -- 172.21.15.53:0/2213632170 >> 172.21.15.53:0/2213632170 conn(0x55bfcdde1350 msgr2=0x55bfce19c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.948+0000 7f076e561740 1 -- 172.21.15.53:0/2213632170 shutdown_connections 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.948+0000 7f076e561740 1 -- 172.21.15.53:0/2213632170 wait complete. 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f076e561740 1 -- start start 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f076e561740 1 Processor -- start 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f076e561740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce1b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f076e561740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce1b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f076e561740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f076e561740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bfce1b05d0 con 0x55bfcddecf60 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f076e561740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bfce1aff00 con 0x55bfcddc40a0 2024-08-31T06:04:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f076e561740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bfce1b0ca0 con 0x55bfcddcc280 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f076e561740 10 client.0 _ll_register_callbacks cb 0x7f0758031480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f0766589640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f0766589640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60610/0 (socket says 172.21.15.53:60610) 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.949+0000 7f0766589640 1 -- 172.21.15.53:0/1503368978 learned_addr learned my addr 172.21.15.53:0/1503368978 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f0765587640 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce1b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f0766589640 1 -- 172.21.15.53:0/1503368978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 msgr2=0x55bfce1b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f0766589640 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce1b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f0766589640 1 -- 172.21.15.53:0/1503368978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 msgr2=0x55bfce1b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f0766589640 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce1b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f0766589640 1 -- 172.21.15.53:0/1503368978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfce1b81b0 con 0x55bfcddecf60 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f0765587640 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce1b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f07497fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f0766589640 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1b34c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0758009900 tx=0x7f0758003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390305b006c972a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:51.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f07497fa640 1 -- 172.21.15.53:0/1503368978 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0758035040 con 0x55bfcddecf60 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f07497fa640 1 -- 172.21.15.53:0/1503368978 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f075803c640 con 0x55bfcddecf60 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f076e561740 1 -- 172.21.15.53:0/1503368978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0758061070 con 0x55bfcddecf60 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f07497fa640 1 -- 172.21.15.53:0/1503368978 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0758072050 con 0x55bfcddecf60 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f076e561740 10 client.15687 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.950+0000 7f076e561740 1 -- 172.21.15.53:0/1503368978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bfce21be30 con 0x55bfcddecf60 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.951+0000 7f07497fa640 1 -- 172.21.15.53:0/1503368978 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0758061070 con 0x55bfcddecf60 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.951+0000 7f07497fa640 1 -- 172.21.15.53:0/1503368978 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f075806d030 con 0x55bfcddecf60 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.951+0000 7f076e561740 10 client.15687 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.951+0000 7f076e561740 10 client.15687 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.951+0000 7f076e561740 20 client.15687 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.951+0000 7f076e561740 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bfcdd80c90 0x55bfce21f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.951+0000 7f076e561740 4 client.15687 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.951+0000 7f076e561740 1 -- 172.21.15.53:0/1503368978 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "status"}) -- 0x55bfce106de0 con 0x55bfcdd80c90 2024-08-31T06:04:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.951+0000 7f0765d88640 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bfcdd80c90 0x55bfce21f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f07497fa640 10 client.15687 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f0765d88640 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bfcdd80c90 0x55bfce21f5a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7438abe29858566e server_cookie=fc16b5fffdb670b7 in_seq=0 out_seq=0 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f07497fa640 1 -- 172.21.15.53:0/1503368978 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bfce106de0 con 0x55bfcdd80c90 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f07497fa640 10 client.15687 handle_command_reply: tid=0 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 1 client.15687 shutdown 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 1 -- 172.21.15.53:0/1503368978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 msgr2=0x55bfce1b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1b34c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0758009900 tx=0x7f0758003820 comp rx=0 tx=0).stop 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 1 -- 172.21.15.53:0/1503368978 shutdown_connections 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bfcdd80c90 0x55bfce21f5a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bfcddecf60 0x55bfce1b34c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bfcddcc280 0x55bfce1b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f07497fa640 0 client.15687 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 1 --2- 172.21.15.53:0/1503368978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bfcddc40a0 0x55bfce1b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 1 -- 172.21.15.53:0/1503368978 >> 172.21.15.53:0/1503368978 conn(0x55bfcdde1350 msgr2=0x55bfce19c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 1 -- 172.21.15.53:0/1503368978 shutdown_connections 2024-08-31T06:04:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 1 -- 172.21.15.53:0/1503368978 wait complete. 2024-08-31T06:04:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.952+0000 7f076e561740 20 client.15687 trim_cache size 0 max 16384 2024-08-31T06:04:51.960 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:04:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 2, 2024-08-31T06:04:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24632, 2024-08-31T06:04:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:04:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:04:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:04:51.960 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 132.316208776, 2024-08-31T06:04:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 28, 2024-08-31T06:04:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 74, 2024-08-31T06:04:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 74, 2024-08-31T06:04:51.961 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 163.17311680700001 2024-08-31T06:04:51.961 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:51.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 -- 172.21.15.53:0/528365423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f074c0b4c40 msgr2=0x7f074c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:51.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f074c0b4c40 0x7f074c0b7150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0758006010 tx=0x7f0758009680 comp rx=0 tx=0).stop 2024-08-31T06:04:51.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 -- 172.21.15.53:0/528365423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07601050e0 msgr2=0x7f076019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:51.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07601050e0 0x7f076019a5f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f075000c8c0 tx=0x7f075000cd80 comp rx=0 tx=0).stop 2024-08-31T06:04:51.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 -- 172.21.15.53:0/528365423 shutdown_connections 2024-08-31T06:04:51.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f074c0b4c40 0x7f074c0b7150 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f076010dbf0 0x7f076019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07601050e0 0x7f076019a5f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 --2- 172.21.15.53:0/528365423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0760104790 0x7f076019a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:51.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 -- 172.21.15.53:0/528365423 >> 172.21.15.53:0/528365423 conn(0x7f07600794f0 msgr2=0x7f07600ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:51.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 -- 172.21.15.53:0/528365423 shutdown_connections 2024-08-31T06:04:51.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:51.953+0000 7f0767fec640 1 -- 172.21.15.53:0/528365423 wait complete. 2024-08-31T06:04:52.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:52 smithi130 ceph-mon[22266]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-08-31T06:04:52.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:52 smithi153 ceph-mon[22320]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-08-31T06:04:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:52 smithi053 ceph-mon[18924]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-08-31T06:04:52.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T06:04:52.991 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.451+0000 7f48ebdb1640 1 -- 172.21.15.53:0/355036819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e410dbb0 msgr2=0x7f48e41100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.451+0000 7f48ebdb1640 1 --2- 172.21.15.53:0/355036819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e410dbb0 0x7f48e41100a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009ca0 tx=0x7f48dc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.451+0000 7f48ebdb1640 1 -- 172.21.15.53:0/355036819 shutdown_connections 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.451+0000 7f48ebdb1640 1 --2- 172.21.15.53:0/355036819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e410dbb0 0x7f48e41100a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.451+0000 7f48ebdb1640 1 --2- 172.21.15.53:0/355036819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48e41050a0 0x7f48e410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.451+0000 7f48ebdb1640 1 --2- 172.21.15.53:0/355036819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e4104750 0x7f48e4104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.451+0000 7f48ebdb1640 1 -- 172.21.15.53:0/355036819 >> 172.21.15.53:0/355036819 conn(0x7f48e40794a0 msgr2=0x7f48e40798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.451+0000 7f48ebdb1640 1 -- 172.21.15.53:0/355036819 shutdown_connections 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.451+0000 7f48ebdb1640 1 -- 172.21.15.53:0/355036819 wait complete. 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48ebdb1640 1 Processor -- start 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48ebdb1640 1 -- start start 2024-08-31T06:04:53.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48ebdb1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48e4104750 0x7f48e4102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48ebdb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e41050a0 0x7f48e41029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48ebdb1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e410dbb0 0x7f48e4102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48ebdb1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f48e4113720 con 0x7f48e41050a0 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48ebdb1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f48e41135a0 con 0x7f48e4104750 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48ebdb1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f48e41138a0 con 0x7f48e410dbb0 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48e934c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e41050a0 0x7f48e41029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48e934c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e41050a0 0x7f48e41029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51954/0 (socket says 172.21.15.53:51954) 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48e934c640 1 -- 172.21.15.53:0/3222050219 learned_addr learned my addr 172.21.15.53:0/3222050219 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48e4104750 0x7f48e4102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.452+0000 7f48ea34e640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e410dbb0 0x7f48e4102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.453+0000 7f48e934c640 1 -- 172.21.15.53:0/3222050219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e410dbb0 msgr2=0x7f48e4102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.453+0000 7f48e934c640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e410dbb0 0x7f48e4102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.453+0000 7f48e934c640 1 -- 172.21.15.53:0/3222050219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48e4104750 msgr2=0x7f48e4102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.453+0000 7f48e934c640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48e4104750 0x7f48e4102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.453+0000 7f48e934c640 1 -- 172.21.15.53:0/3222050219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e41a83c0 con 0x7f48e41050a0 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.453+0000 7f48e934c640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e41050a0 0x7f48e41029d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f48d400d740 tx=0x7f48d400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.453+0000 7f48daffd640 1 -- 172.21.15.53:0/3222050219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4017070 con 0x7f48e41050a0 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.453+0000 7f48daffd640 1 -- 172.21.15.53:0/3222050219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48d4010460 con 0x7f48e41050a0 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.453+0000 7f48daffd640 1 -- 172.21.15.53:0/3222050219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d400f620 con 0x7f48e41050a0 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.453+0000 7f48ebdb1640 1 -- 172.21.15.53:0/3222050219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e41a86b0 con 0x7f48e41050a0 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.453+0000 7f48ebdb1640 1 -- 172.21.15.53:0/3222050219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e41a8c40 con 0x7f48e41050a0 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.455+0000 7f48f2326740 1 Processor -- start 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.455+0000 7f48daffd640 1 -- 172.21.15.53:0/3222050219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f48d401a070 con 0x7f48e41050a0 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48f2326740 1 -- start start 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48f2326740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 0x55b49cb8c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48f2326740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cb8ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48f2326740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7c6280 0x55b49cb8d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48f2326740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b49cb033f0 con 0x55b49c7be0a0 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48f2326740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b49caf2980 con 0x55b49c7c6280 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48f2326740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b49caf6930 con 0x55b49c7e6f60 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48e9b4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cb8ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48e9b4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cb8ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51968/0 (socket says 172.21.15.53:51968) 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48e9b4d640 1 -- 172.21.15.53:0/1412541314 learned_addr learned my addr 172.21.15.53:0/1412541314 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48ea34e640 1 --2- 172.21.15.53:0/1412541314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 0x55b49cb8c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48e934c640 1 --2- 172.21.15.53:0/1412541314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7c6280 0x55b49cb8d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48e9b4d640 1 -- 172.21.15.53:0/1412541314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 msgr2=0x55b49cb8c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/1412541314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 0x55b49cb8c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.456+0000 7f48e9b4d640 1 -- 172.21.15.53:0/1412541314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7c6280 msgr2=0x55b49cb8d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.457+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/1412541314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7c6280 0x55b49cb8d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.457+0000 7f48daffd640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d00b4c90 0x7f48d00b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.457+0000 7f48e9b4d640 1 -- 172.21.15.53:0/1412541314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b49c852540 con 0x55b49c7be0a0 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.457+0000 7f48e934c640 1 --2- 172.21.15.53:0/1412541314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7c6280 0x55b49cb8d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.457+0000 7f48ea34e640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d00b4c90 0x7f48d00b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.457+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/1412541314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cb8ccf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f48e000ac80 tx=0x7f48e000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b7d49f6ef46ee1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.457+0000 7f48daffd640 1 -- 172.21.15.53:0/3222050219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f48d40e4d70 con 0x7f48e41050a0 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.457+0000 7f48cffff640 1 -- 172.21.15.53:0/1412541314 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e001d070 con 0x55b49c7be0a0 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.457+0000 7f48cffff640 1 -- 172.21.15.53:0/1412541314 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48e0018ad0 con 0x55b49c7be0a0 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.457+0000 7f48cffff640 1 -- 172.21.15.53:0/1412541314 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0010aa0 con 0x55b49c7be0a0 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.458+0000 7f48f2326740 1 -- 172.21.15.53:0/1412541314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 msgr2=0x55b49cb8ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.458+0000 7f48ea34e640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d00b4c90 0x7f48d00b71a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009a60 tx=0x7f48dc005c50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.458+0000 7f48f2326740 1 --2- 172.21.15.53:0/1412541314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cb8ccf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f48e000ac80 tx=0x7f48e000f790 comp rx=0 tx=0).stop 2024-08-31T06:04:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.458+0000 7f48f2326740 1 -- 172.21.15.53:0/1412541314 shutdown_connections 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.458+0000 7f48f2326740 1 --2- 172.21.15.53:0/1412541314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7c6280 0x55b49cb8d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.458+0000 7f48f2326740 1 --2- 172.21.15.53:0/1412541314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cb8ccf0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.458+0000 7f48f2326740 1 --2- 172.21.15.53:0/1412541314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 0x55b49cb8c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.458+0000 7f48f2326740 1 -- 172.21.15.53:0/1412541314 >> 172.21.15.53:0/1412541314 conn(0x55b49c7db350 msgr2=0x55b49cb8a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.458+0000 7f48f2326740 1 -- 172.21.15.53:0/1412541314 shutdown_connections 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.458+0000 7f48f2326740 1 -- 172.21.15.53:0/1412541314 wait complete. 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.458+0000 7f48f2326740 1 -- start start 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48f2326740 1 Processor -- start 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48f2326740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7be0a0 0x55b49cb97e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48f2326740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7c6280 0x55b49cb98390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48f2326740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 0x55b49cba4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48f2326740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b49c9555f0 con 0x55b49c7c6280 2024-08-31T06:04:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48f2326740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b49ca79600 con 0x55b49c7be0a0 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48f2326740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b49cb9af90 con 0x55b49c7e6f60 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48f2326740 10 client.0 _ll_register_callbacks cb 0x55b49ca9faf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48e934c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7c6280 0x55b49cb98390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48e934c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7c6280 0x55b49cb98390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51976/0 (socket says 172.21.15.53:51976) 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48e934c640 1 -- 172.21.15.53:0/564064711 learned_addr learned my addr 172.21.15.53:0/564064711 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7be0a0 0x55b49cb97e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48e934c640 1 -- 172.21.15.53:0/564064711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 msgr2=0x55b49cba4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48e934c640 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 0x55b49cba4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48e934c640 1 -- 172.21.15.53:0/564064711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7be0a0 msgr2=0x55b49cb97e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48e934c640 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7be0a0 0x55b49cb97e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48e934c640 1 -- 172.21.15.53:0/564064711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b49cab27b0 con 0x55b49c7c6280 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.459+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7be0a0 0x55b49cb97e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48e934c640 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7c6280 0x55b49cb98390 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f48d40a75a0 tx=0x7f48d40e2a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd038ef49531d2f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:53.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48cd7fa640 1 -- 172.21.15.53:0/564064711 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4021070 con 0x55b49c7c6280 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48cd7fa640 1 -- 172.21.15.53:0/564064711 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f48d40a77b0 con 0x55b49c7c6280 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48f2326740 1 -- 172.21.15.53:0/564064711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e0018ad0 con 0x55b49c7c6280 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48cd7fa640 1 -- 172.21.15.53:0/564064711 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f48d40ab030 con 0x55b49c7c6280 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48f2326740 10 client.15699 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48f2326740 1 -- 172.21.15.53:0/564064711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b49cba6c80 con 0x55b49c7c6280 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48cd7fa640 1 -- 172.21.15.53:0/564064711 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48e0018ad0 con 0x55b49c7c6280 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48cd7fa640 1 -- 172.21.15.53:0/564064711 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f48d40ce0e0 con 0x55b49c7c6280 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48f2326740 10 client.15699 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48f2326740 10 client.15699 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48f2326740 20 client.15699 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48f2326740 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b49c7a58e0 0x55b49cbaa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48f2326740 4 client.15699 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.460+0000 7f48f2326740 1 -- 172.21.15.53:0/564064711 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b49cb05340 con 0x55b49c7a58e0 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.461+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b49c7a58e0 0x55b49cbaa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.461+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b49c7a58e0 0x55b49cbaa760 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ca624624ca75833 server_cookie=a04255c0c510fcb8 in_seq=0 out_seq=0 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.461+0000 7f48cd7fa640 10 client.15699 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48cd7fa640 1 -- 172.21.15.53:0/564064711 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b49cb05340 con 0x55b49c7a58e0 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48cd7fa640 10 client.15699 handle_command_reply: tid=0 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 1 client.15699 shutdown 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 1 -- 172.21.15.53:0/564064711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7c6280 msgr2=0x55b49cb98390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7c6280 0x55b49cb98390 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f48d40a75a0 tx=0x7f48d40e2a80 comp rx=0 tx=0).stop 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 1 -- 172.21.15.53:0/564064711 shutdown_connections 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b49c7a58e0 0x55b49cbaa760 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 0x55b49cba4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48cd7fa640 0 client.15699 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:04:53.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7c6280 0x55b49cb98390 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 1 --2- 172.21.15.53:0/564064711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7be0a0 0x55b49cb97e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 1 -- 172.21.15.53:0/564064711 >> 172.21.15.53:0/564064711 conn(0x55b49c7db350 msgr2=0x55b49cb8f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:53.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 1 -- 172.21.15.53:0/564064711 shutdown_connections 2024-08-31T06:04:53.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 1 -- 172.21.15.53:0/564064711 wait complete. 2024-08-31T06:04:53.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.462+0000 7f48f2326740 20 client.15699 trim_cache size 0 max 16384 2024-08-31T06:04:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48f2326740 1 Processor -- start 2024-08-31T06:04:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48f2326740 1 -- start start 2024-08-31T06:04:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48f2326740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7be0a0 0x55b49cba41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48f2326740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7c6280 0x55b49cb93030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48f2326740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7e6f60 0x55b49cb93570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48f2326740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b49cba8aa0 con 0x55b49c7e6f60 2024-08-31T06:04:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48f2326740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b49cba9170 con 0x55b49c7be0a0 2024-08-31T06:04:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48f2326740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b49cba9840 con 0x55b49c7c6280 2024-08-31T06:04:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48ea34e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7e6f60 0x55b49cb93570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48ea34e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7e6f60 0x55b49cb93570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51978/0 (socket says 172.21.15.53:51978) 2024-08-31T06:04:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48ea34e640 1 -- 172.21.15.53:0/1766740471 learned_addr learned my addr 172.21.15.53:0/1766740471 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/1766740471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7be0a0 0x55b49cba41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48ea34e640 1 -- 172.21.15.53:0/1766740471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7c6280 msgr2=0x55b49cb93030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48ea34e640 1 --2- 172.21.15.53:0/1766740471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7c6280 0x55b49cb93030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48ea34e640 1 -- 172.21.15.53:0/1766740471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7be0a0 msgr2=0x55b49cba41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.481+0000 7f48ea34e640 1 --2- 172.21.15.53:0/1766740471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7be0a0 0x55b49cba41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.482+0000 7f48ea34e640 1 -- 172.21.15.53:0/1766740471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b49cb85a70 con 0x55b49c7e6f60 2024-08-31T06:04:53.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.482+0000 7f48ea34e640 1 --2- 172.21.15.53:0/1766740471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7e6f60 0x55b49cb93570 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009ca0 tx=0x7f48dc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf97df7a99455c46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:53.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.482+0000 7f48cf7fe640 1 -- 172.21.15.53:0/1766740471 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc031a40 con 0x55b49c7e6f60 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.482+0000 7f48cf7fe640 1 -- 172.21.15.53:0/1766740471 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48dc036040 con 0x55b49c7e6f60 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.482+0000 7f48cf7fe640 1 -- 172.21.15.53:0/1766740471 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc030820 con 0x55b49c7e6f60 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.483+0000 7f48f2326740 1 -- 172.21.15.53:0/1766740471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7e6f60 msgr2=0x55b49cb93570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.483+0000 7f48f2326740 1 --2- 172.21.15.53:0/1766740471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7e6f60 0x55b49cb93570 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009ca0 tx=0x7f48dc0095c0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.483+0000 7f48f2326740 1 -- 172.21.15.53:0/1766740471 shutdown_connections 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.483+0000 7f48f2326740 1 --2- 172.21.15.53:0/1766740471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7e6f60 0x55b49cb93570 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.483+0000 7f48f2326740 1 --2- 172.21.15.53:0/1766740471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7c6280 0x55b49cb93030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.483+0000 7f48f2326740 1 --2- 172.21.15.53:0/1766740471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7be0a0 0x55b49cba41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.483+0000 7f48f2326740 1 -- 172.21.15.53:0/1766740471 >> 172.21.15.53:0/1766740471 conn(0x55b49c7db350 msgr2=0x55b49cba8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.483+0000 7f48f2326740 1 -- 172.21.15.53:0/1766740471 shutdown_connections 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.483+0000 7f48f2326740 1 -- 172.21.15.53:0/1766740471 wait complete. 2024-08-31T06:04:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.483+0000 7f48f2326740 1 -- start start 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.483+0000 7f48f2326740 1 Processor -- start 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48f2326740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cbb2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48f2326740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7c6280 0x55b49cbb3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48f2326740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 0x55b49cbac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48f2326740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b49cbaa5e0 con 0x55b49c7be0a0 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48f2326740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b49cba9f10 con 0x55b49c7c6280 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48e9b4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cbb2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48f2326740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b49cbaacb0 con 0x55b49c7e6f60 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48e9b4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cbb2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51988/0 (socket says 172.21.15.53:51988) 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48e9b4d640 1 -- 172.21.15.53:0/625621745 learned_addr learned my addr 172.21.15.53:0/625621745 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48e934c640 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7c6280 0x55b49cbb3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48ea34e640 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 0x55b49cbac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48f2326740 10 client.0 _ll_register_callbacks cb 0x7f48d4005ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:53.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48e9b4d640 1 -- 172.21.15.53:0/625621745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 msgr2=0x55b49cbac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 0x55b49cbac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48e9b4d640 1 -- 172.21.15.53:0/625621745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7c6280 msgr2=0x55b49cbb3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7c6280 0x55b49cbb3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.484+0000 7f48e9b4d640 1 -- 172.21.15.53:0/625621745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b49cbac940 con 0x55b49c7be0a0 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48e9b4d640 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cbb2c60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f48e000fc90 tx=0x7f48e000a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3277b36ad76a54ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48cd7fa640 1 -- 172.21.15.53:0/625621745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e001d040 con 0x55b49c7be0a0 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48cd7fa640 1 -- 172.21.15.53:0/625621745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f48e0005230 con 0x55b49c7be0a0 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48f2326740 1 -- 172.21.15.53:0/625621745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48dc036040 con 0x55b49c7be0a0 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48cd7fa640 1 -- 172.21.15.53:0/625621745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f48e0039050 con 0x55b49c7be0a0 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48f2326740 10 client.15705 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48f2326740 1 -- 172.21.15.53:0/625621745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b49cbb22b0 con 0x55b49c7be0a0 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48cd7fa640 1 -- 172.21.15.53:0/625621745 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48dc036040 con 0x55b49c7be0a0 2024-08-31T06:04:53.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48cd7fa640 1 -- 172.21.15.53:0/625621745 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f48e0004660 con 0x55b49c7be0a0 2024-08-31T06:04:53.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48f2326740 10 client.15705 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:53.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48f2326740 10 client.15705 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:04:53.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48f2326740 20 client.15705 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:53.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.485+0000 7f48f2326740 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b49c77ac90 0x55b49cc18c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:53.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.486+0000 7f48f2326740 4 client.15705 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:04:53.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.486+0000 7f48f2326740 1 -- 172.21.15.53:0/625621745 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "status"}) -- 0x55b49cb00de0 con 0x55b49c77ac90 2024-08-31T06:04:53.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.486+0000 7f48e934c640 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b49c77ac90 0x55b49cc18c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:53.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.486+0000 7f48e934c640 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b49c77ac90 0x55b49cc18c50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8aeb5d7818dfc6ba server_cookie=7efd01fcad28d4a3 in_seq=0 out_seq=0 2024-08-31T06:04:53.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.486+0000 7f48cd7fa640 10 client.15705 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:04:53.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.486+0000 7f48cd7fa640 1 -- 172.21.15.53:0/625621745 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b49cb00de0 con 0x55b49c77ac90 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.486+0000 7f48cd7fa640 10 client.15705 handle_command_reply: tid=0 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.486+0000 7f48f2326740 1 client.15705 shutdown 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48f2326740 1 -- 172.21.15.53:0/625621745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 msgr2=0x55b49cbb2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48f2326740 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cbb2c60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f48e000fc90 tx=0x7f48e000a6a0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48f2326740 1 -- 172.21.15.53:0/625621745 shutdown_connections 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48f2326740 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b49c77ac90 0x55b49cc18c50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48f2326740 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b49c7e6f60 0x55b49cbac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48f2326740 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b49c7c6280 0x55b49cbb3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48cd7fa640 0 client.15705 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48f2326740 1 --2- 172.21.15.53:0/625621745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b49c7be0a0 0x55b49cbb2c60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48f2326740 1 -- 172.21.15.53:0/625621745 >> 172.21.15.53:0/625621745 conn(0x55b49c7db350 msgr2=0x55b49cb93030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48f2326740 1 -- 172.21.15.53:0/625621745 shutdown_connections 2024-08-31T06:04:53.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48f2326740 1 -- 172.21.15.53:0/625621745 wait complete. 2024-08-31T06:04:53.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48f2326740 20 client.15705 trim_cache size 0 max 16384 2024-08-31T06:04:53.494 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:53.494 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:04:53.494 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 1, 2024-08-31T06:04:53.494 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24640, 2024-08-31T06:04:53.494 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:04:53.494 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:04:53.494 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:04:53.494 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 134.85495180800001, 2024-08-31T06:04:53.494 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 28, 2024-08-31T06:04:53.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 74, 2024-08-31T06:04:53.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 74, 2024-08-31T06:04:53.495 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 162.13772723100001 2024-08-31T06:04:53.495 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:53.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48ebdb1640 1 -- 172.21.15.53:0/3222050219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d00b4c90 msgr2=0x7f48d00b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:53.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48ebdb1640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d00b4c90 0x7f48d00b71a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009a60 tx=0x7f48dc005c50 comp rx=0 tx=0).stop 2024-08-31T06:04:53.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48ebdb1640 1 -- 172.21.15.53:0/3222050219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e41050a0 msgr2=0x7f48e41029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:53.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.487+0000 7f48ebdb1640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e41050a0 0x7f48e41029d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f48d400d740 tx=0x7f48d400db40 comp rx=0 tx=0).stop 2024-08-31T06:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.488+0000 7f48ebdb1640 1 -- 172.21.15.53:0/3222050219 shutdown_connections 2024-08-31T06:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.488+0000 7f48ebdb1640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d00b4c90 0x7f48d00b71a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.488+0000 7f48ebdb1640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e410dbb0 0x7f48e4102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.488+0000 7f48ebdb1640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e41050a0 0x7f48e41029d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.488+0000 7f48ebdb1640 1 --2- 172.21.15.53:0/3222050219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48e4104750 0x7f48e4102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.488+0000 7f48ebdb1640 1 -- 172.21.15.53:0/3222050219 >> 172.21.15.53:0/3222050219 conn(0x7f48e40794a0 msgr2=0x7f48e41076d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.488+0000 7f48ebdb1640 1 -- 172.21.15.53:0/3222050219 shutdown_connections 2024-08-31T06:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:53.488+0000 7f48ebdb1640 1 -- 172.21.15.53:0/3222050219 wait complete. 2024-08-31T06:04:54.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:54 smithi053 ceph-mon[18924]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-08-31T06:04:54.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T06:04:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:54 smithi130 ceph-mon[22266]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-08-31T06:04:54.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:54 smithi153 ceph-mon[22320]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-08-31T06:04:54.508 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:04:55.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.992+0000 7f5ef4d22640 1 -- 172.21.15.53:0/3783063266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef0103900 msgr2=0x7f5ef0103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.992+0000 7f5ef4d22640 1 --2- 172.21.15.53:0/3783063266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef0103900 0x7f5ef0103d10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009900 tx=0x7f5ee002a410 comp rx=0 tx=0).stop 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.992+0000 7f5ef4d22640 1 -- 172.21.15.53:0/3783063266 shutdown_connections 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.992+0000 7f5ef4d22640 1 --2- 172.21.15.53:0/3783063266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ef0109b90 0x7f5ef01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.992+0000 7f5ef4d22640 1 --2- 172.21.15.53:0/3783063266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef0109240 0x7f5ef0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.992+0000 7f5ef4d22640 1 --2- 172.21.15.53:0/3783063266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef0103900 0x7f5ef0103d10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.992+0000 7f5ef4d22640 1 -- 172.21.15.53:0/3783063266 >> 172.21.15.53:0/3783063266 conn(0x7f5ef007b5f0 msgr2=0x7f5ef007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.992+0000 7f5ef4d22640 1 -- 172.21.15.53:0/3783063266 shutdown_connections 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.992+0000 7f5ef4d22640 1 -- 172.21.15.53:0/3783063266 wait complete. 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.993+0000 7f5ef4d22640 1 Processor -- start 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.993+0000 7f5ef4d22640 1 -- start start 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5ef4d22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef0103900 0x7f5ef019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5ef4d22640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef0109240 0x7f5ef019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5ef4d22640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ef0109b90 0x7f5ef019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5ef4d22640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0113700 con 0x7f5ef0103900 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5ef4d22640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0113580 con 0x7f5ef0109240 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5ef4d22640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0113880 con 0x7f5ef0109b90 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5eee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef0103900 0x7f5ef019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5eee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef0103900 0x7f5ef019a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52016/0 (socket says 172.21.15.53:52016) 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5eee59c640 1 -- 172.21.15.53:0/980310739 learned_addr learned my addr 172.21.15.53:0/980310739 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ef0109b90 0x7f5ef019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef0109240 0x7f5ef019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5eee59c640 1 -- 172.21.15.53:0/980310739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ef0109b90 msgr2=0x7f5ef019fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5eee59c640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ef0109b90 0x7f5ef019fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5eee59c640 1 -- 172.21.15.53:0/980310739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef0109240 msgr2=0x7f5ef019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5eee59c640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef0109240 0x7f5ef019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5eee59c640 1 -- 172.21.15.53:0/980310739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef01a0140 con 0x7f5ef0103900 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5eee59c640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef0103900 0x7f5ef019a1d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009230 tx=0x7f5ee0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.994+0000 7f5edf7fe640 1 -- 172.21.15.53:0/980310739 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee003f030 con 0x7f5ef0103900 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.995+0000 7f5edf7fe640 1 -- 172.21.15.53:0/980310739 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ee0003a80 con 0x7f5ef0103900 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.995+0000 7f5ef4d22640 1 -- 172.21.15.53:0/980310739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef01a03d0 con 0x7f5ef0103900 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.995+0000 7f5edf7fe640 1 -- 172.21.15.53:0/980310739 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0035070 con 0x7f5ef0103900 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.995+0000 7f5ef4d22640 1 -- 172.21.15.53:0/980310739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef01a6b90 con 0x7f5ef0103900 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.997+0000 7f5efb297740 1 Processor -- start 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.997+0000 7f5efb297740 1 -- start start 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5efb297740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562446941f60 0x562446ce77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5efb297740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624469190a0 0x562446ce7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5efb297740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446ce8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5efb297740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562446c5e3f0 con 0x562446921280 2024-08-31T06:04:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5efb297740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562446c4d980 con 0x562446941f60 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5efb297740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562446c51930 con 0x5624469190a0 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5edf7fe640 1 -- 172.21.15.53:0/980310739 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f5ee0042030 con 0x7f5ef0103900 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eedd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446ce8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eeed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562446941f60 0x562446ce77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eedd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446ce8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52020/0 (socket says 172.21.15.53:52020) 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eedd9b640 1 -- 172.21.15.53:0/4058131766 learned_addr learned my addr 172.21.15.53:0/4058131766 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eee59c640 1 --2- 172.21.15.53:0/4058131766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624469190a0 0x562446ce7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eedd9b640 1 -- 172.21.15.53:0/4058131766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624469190a0 msgr2=0x562446ce7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/4058131766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624469190a0 0x562446ce7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eedd9b640 1 -- 172.21.15.53:0/4058131766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562446941f60 msgr2=0x562446ce77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/4058131766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562446941f60 0x562446ce77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eedd9b640 1 -- 172.21.15.53:0/4058131766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624469ad540 con 0x562446921280 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eee59c640 1 --2- 172.21.15.53:0/4058131766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624469190a0 0x562446ce7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.998+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/4058131766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446ce8230 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400bc30 tx=0x7f5ee40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d18e1b464b2643d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.999+0000 7f5edcff9640 1 -- 172.21.15.53:0/4058131766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee401c480 con 0x562446921280 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.999+0000 7f5edcff9640 1 -- 172.21.15.53:0/4058131766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ee401cab0 con 0x562446921280 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.999+0000 7f5edcff9640 1 -- 172.21.15.53:0/4058131766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4011a10 con 0x562446921280 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.999+0000 7f5edf7fe640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed80b4c10 0x7f5ed80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.999+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed80b4c10 0x7f5ed80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:54.999+0000 7f5edf7fe640 1 -- 172.21.15.53:0/980310739 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5ee0105b40 con 0x7f5ef0103900 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 -- 172.21.15.53:0/4058131766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 msgr2=0x562446ce8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed80b4c10 0x7f5ed80b7120 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800ae90 tx=0x7f5ee800a4d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 --2- 172.21.15.53:0/4058131766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446ce8230 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400bc30 tx=0x7f5ee40107a0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 -- 172.21.15.53:0/4058131766 shutdown_connections 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 --2- 172.21.15.53:0/4058131766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446ce8230 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 --2- 172.21.15.53:0/4058131766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624469190a0 0x562446ce7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 --2- 172.21.15.53:0/4058131766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562446941f60 0x562446ce77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 -- 172.21.15.53:0/4058131766 >> 172.21.15.53:0/4058131766 conn(0x562446936350 msgr2=0x562446ce56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 -- 172.21.15.53:0/4058131766 shutdown_connections 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 -- 172.21.15.53:0/4058131766 wait complete. 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 -- start start 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 Processor -- start 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624469190a0 0x562446cf2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446941f60 0x562446cf3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562446ab05f0 con 0x562446921280 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.000+0000 7f5efb297740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562446bd4600 con 0x5624469190a0 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5efb297740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562446cf5f90 con 0x562446941f60 2024-08-31T06:04:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5efb297740 10 client.0 _ll_register_callbacks cb 0x562446bfaaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5eedd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5eedd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52024/0 (socket says 172.21.15.53:52024) 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5eedd9b640 1 -- 172.21.15.53:0/577870524 learned_addr learned my addr 172.21.15.53:0/577870524 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446941f60 0x562446cf3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5eee59c640 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624469190a0 0x562446cf2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5eedd9b640 1 -- 172.21.15.53:0/577870524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446941f60 msgr2=0x562446cf3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446941f60 0x562446cf3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5eedd9b640 1 -- 172.21.15.53:0/577870524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624469190a0 msgr2=0x562446cf2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624469190a0 0x562446cf2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5eedd9b640 1 -- 172.21.15.53:0/577870524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562446c0d7b0 con 0x562446921280 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf3310 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40116b0 tx=0x7f5ee40114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9554514fcffdd5d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5ed5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/577870524 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee402b060 con 0x562446921280 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/577870524 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5ee401c750 con 0x562446921280 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5efb297740 1 -- 172.21.15.53:0/577870524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ee401cab0 con 0x562446921280 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.001+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/577870524 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5ee4005040 con 0x562446921280 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.002+0000 7f5efb297740 10 client.15717 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.002+0000 7f5efb297740 1 -- 172.21.15.53:0/577870524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562446d01bb0 con 0x562446921280 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.002+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/577870524 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ee401cab0 con 0x562446921280 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.002+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/577870524 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5ee4011ce0 con 0x562446921280 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.002+0000 7f5efb297740 10 client.15717 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.002+0000 7f5efb297740 10 client.15717 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.002+0000 7f5efb297740 20 client.15717 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.002+0000 7f5efb297740 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624469008e0 0x562446d05190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.002+0000 7f5efb297740 4 client.15717 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.002+0000 7f5efb297740 1 -- 172.21.15.53:0/577870524 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562446c60340 con 0x5624469008e0 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.002+0000 7f5eee59c640 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624469008e0 0x562446d05190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.003+0000 7f5ed5ffb640 10 client.15717 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.003+0000 7f5eee59c640 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624469008e0 0x562446d05190 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=911ed17d381de588 server_cookie=25439b7dde1cd44c in_seq=0 out_seq=0 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.003+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/577870524 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562446c60340 con 0x5624469008e0 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.003+0000 7f5ed5ffb640 10 client.15717 handle_command_reply: tid=0 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 1 client.15717 shutdown 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 1 -- 172.21.15.53:0/577870524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 msgr2=0x562446cf3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf3310 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40116b0 tx=0x7f5ee40114b0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 1 -- 172.21.15.53:0/577870524 shutdown_connections 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624469008e0 0x562446d05190 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446941f60 0x562446cf3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf3310 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5ed5ffb640 0 client.15717 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 1 --2- 172.21.15.53:0/577870524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624469190a0 0x562446cf2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 1 -- 172.21.15.53:0/577870524 >> 172.21.15.53:0/577870524 conn(0x562446936350 msgr2=0x562446cea940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:55.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 1 -- 172.21.15.53:0/577870524 shutdown_connections 2024-08-31T06:04:55.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 1 -- 172.21.15.53:0/577870524 wait complete. 2024-08-31T06:04:55.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.004+0000 7f5efb297740 20 client.15717 trim_cache size 0 max 16384 2024-08-31T06:04:55.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.022+0000 7f5efb297740 1 Processor -- start 2024-08-31T06:04:55.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.022+0000 7f5efb297740 1 -- start start 2024-08-31T06:04:55.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5efb297740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624469190a0 0x562446d05190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5efb297740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5efb297740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446941f60 0x562446cf1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5efb297740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562446d034d0 con 0x562446921280 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5efb297740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562446d03ba0 con 0x5624469190a0 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5efb297740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562446d04270 con 0x562446941f60 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5eedd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5eedd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52030/0 (socket says 172.21.15.53:52030) 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5eedd9b640 1 -- 172.21.15.53:0/4215128237 learned_addr learned my addr 172.21.15.53:0/4215128237 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/4215128237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446941f60 0x562446cf1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5eedd9b640 1 -- 172.21.15.53:0/4215128237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446941f60 msgr2=0x562446cf1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/4215128237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446941f60 0x562446cf1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5eedd9b640 1 -- 172.21.15.53:0/4215128237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624469190a0 msgr2=0x562446d05190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/4215128237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624469190a0 0x562446d05190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5eedd9b640 1 -- 172.21.15.53:0/4215128237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562446ce0eb0 con 0x562446921280 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/4215128237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446941f60 0x562446cf1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/4215128237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf1650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400bac0 tx=0x7f5ee40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5295fb7d1f0d0471 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5ed7fff640 1 -- 172.21.15.53:0/4215128237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee402b070 con 0x562446921280 2024-08-31T06:04:55.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5ed7fff640 1 -- 172.21.15.53:0/4215128237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ee4004e80 con 0x562446921280 2024-08-31T06:04:55.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.023+0000 7f5ed7fff640 1 -- 172.21.15.53:0/4215128237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4005440 con 0x562446921280 2024-08-31T06:04:55.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.024+0000 7f5efb297740 1 -- 172.21.15.53:0/4215128237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 msgr2=0x562446cf1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:55.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.024+0000 7f5efb297740 1 --2- 172.21.15.53:0/4215128237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf1650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400bac0 tx=0x7f5ee40107a0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.024+0000 7f5efb297740 1 -- 172.21.15.53:0/4215128237 shutdown_connections 2024-08-31T06:04:55.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.024+0000 7f5efb297740 1 --2- 172.21.15.53:0/4215128237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446941f60 0x562446cf1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.024+0000 7f5efb297740 1 --2- 172.21.15.53:0/4215128237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562446921280 0x562446cf1650 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.024+0000 7f5efb297740 1 --2- 172.21.15.53:0/4215128237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624469190a0 0x562446d05190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.024+0000 7f5efb297740 1 -- 172.21.15.53:0/4215128237 >> 172.21.15.53:0/4215128237 conn(0x562446936350 msgr2=0x562446ce0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.024+0000 7f5efb297740 1 -- 172.21.15.53:0/4215128237 shutdown_connections 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.024+0000 7f5efb297740 1 -- 172.21.15.53:0/4215128237 wait complete. 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5efb297740 1 -- start start 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5efb297740 1 Processor -- start 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5efb297740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624469190a0 0x562446d0da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5efb297740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446921280 0x562446d06f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5efb297740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562446941f60 0x562446d07470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5efb297740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562446d05010 con 0x5624469190a0 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5efb297740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562446d04940 con 0x562446941f60 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5efb297740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562446d056e0 con 0x562446921280 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5efb297740 10 client.0 _ll_register_callbacks cb 0x7f5ee400b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5eee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624469190a0 0x562446d0da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5eee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624469190a0 0x562446d0da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52034/0 (socket says 172.21.15.53:52034) 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5eee59c640 1 -- 172.21.15.53:0/2791962474 learned_addr learned my addr 172.21.15.53:0/2791962474 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.025+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446921280 0x562446d06f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5eee59c640 1 -- 172.21.15.53:0/2791962474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446921280 msgr2=0x562446d06f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5eee59c640 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446921280 0x562446d06f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5eee59c640 1 -- 172.21.15.53:0/2791962474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562446941f60 msgr2=0x562446d07470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5eee59c640 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562446941f60 0x562446d07470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5eee59c640 1 -- 172.21.15.53:0/2791962474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562446d07a60 con 0x5624469190a0 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5eee59c640 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624469190a0 0x562446d0da80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00c9610 tx=0x7f5ee0108030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35449cb4020621f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5ed5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/2791962474 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0049040 con 0x5624469190a0 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/2791962474 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5ee00ef0b0 con 0x5624469190a0 2024-08-31T06:04:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5efb297740 1 -- 172.21.15.53:0/2791962474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562446c5bde0 con 0x5624469190a0 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/2791962474 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5ee00cc3a0 con 0x5624469190a0 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5efb297740 10 client.15723 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5efb297740 1 -- 172.21.15.53:0/2791962474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562446d0d460 con 0x5624469190a0 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/2791962474 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562446c5bde0 con 0x5624469190a0 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.026+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/2791962474 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5ee003bc30 con 0x5624469190a0 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.027+0000 7f5efb297740 10 client.15723 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.027+0000 7f5efb297740 10 client.15723 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.027+0000 7f5efb297740 20 client.15723 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.027+0000 7f5efb297740 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624468d5c90 0x562446d73de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.027+0000 7f5efb297740 4 client.15723 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.027+0000 7f5efb297740 1 -- 172.21.15.53:0/2791962474 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "status"}) -- 0x562446c59520 con 0x5624468d5c90 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.027+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624468d5c90 0x562446d73de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.027+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624468d5c90 0x562446d73de0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d865dc652d3d144d server_cookie=765d79d08c5ca96d in_seq=0 out_seq=0 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.027+0000 7f5ed5ffb640 10 client.15723 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5ed5ffb640 1 -- 172.21.15.53:0/2791962474 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562446c59520 con 0x5624468d5c90 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5ed5ffb640 10 client.15723 handle_command_reply: tid=0 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 1 client.15723 shutdown 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 1 -- 172.21.15.53:0/2791962474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624469190a0 msgr2=0x562446d0da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624469190a0 0x562446d0da80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00c9610 tx=0x7f5ee0108030 comp rx=0 tx=0).stop 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 1 -- 172.21.15.53:0/2791962474 shutdown_connections 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624468d5c90 0x562446d73de0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562446941f60 0x562446d07470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562446921280 0x562446d06f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 1 --2- 172.21.15.53:0/2791962474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624469190a0 0x562446d0da80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 1 -- 172.21.15.53:0/2791962474 >> 172.21.15.53:0/2791962474 conn(0x562446936350 msgr2=0x562446cf15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5ed5ffb640 0 client.15723 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 1 -- 172.21.15.53:0/2791962474 shutdown_connections 2024-08-31T06:04:55.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 1 -- 172.21.15.53:0/2791962474 wait complete. 2024-08-31T06:04:55.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5efb297740 20 client.15723 trim_cache size 0 max 16384 2024-08-31T06:04:55.035 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:04:55.035 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "580e8a36-675d-11ef-bcd4-c7b262605968", 2024-08-31T06:04:55.035 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-08-31T06:04:55.035 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 24668, 2024-08-31T06:04:55.035 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-08-31T06:04:55.035 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-08-31T06:04:55.035 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-08-31T06:04:55.036 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 143.43313872600001, 2024-08-31T06:04:55.036 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 28, 2024-08-31T06:04:55.036 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 74, 2024-08-31T06:04:55.036 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 74, 2024-08-31T06:04:55.036 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 154.51228823700001 2024-08-31T06:04:55.036 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5ef4d22640 1 -- 172.21.15.53:0/980310739 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed80b4c10 msgr2=0x7f5ed80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5ef4d22640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed80b4c10 0x7f5ed80b7120 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800ae90 tx=0x7f5ee800a4d0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5ef4d22640 1 -- 172.21.15.53:0/980310739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef0103900 msgr2=0x7f5ef019a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.028+0000 7f5ef4d22640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef0103900 0x7f5ef019a1d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009230 tx=0x7f5ee0004270 comp rx=0 tx=0).stop 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.029+0000 7f5ef4d22640 1 -- 172.21.15.53:0/980310739 shutdown_connections 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.029+0000 7f5ef4d22640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed80b4c10 0x7f5ed80b7120 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.029+0000 7f5ef4d22640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ef0109b90 0x7f5ef019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.029+0000 7f5ef4d22640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ef0109240 0x7f5ef019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.029+0000 7f5ef4d22640 1 --2- 172.21.15.53:0/980310739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef0103900 0x7f5ef019a1d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.029+0000 7f5ef4d22640 1 -- 172.21.15.53:0/980310739 >> 172.21.15.53:0/980310739 conn(0x7f5ef007b5f0 msgr2=0x7f5ef01073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.029+0000 7f5ef4d22640 1 -- 172.21.15.53:0/980310739 shutdown_connections 2024-08-31T06:04:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:04:55.029+0000 7f5ef4d22640 1 -- 172.21.15.53:0/980310739 wait complete. 2024-08-31T06:04:55.715 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-08-31T06:04:56.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:56 smithi130 ceph-mon[22266]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-31T06:04:56.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:56 smithi153 ceph-mon[22320]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-31T06:04:56.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:56 smithi053 ceph-mon[18924]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-31T06:04:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:04:58 smithi130 ceph-mon[22266]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-31T06:04:58.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:04:58 smithi153 ceph-mon[22320]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-31T06:04:58.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:04:58 smithi053 ceph-mon[18924]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-31T06:04:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.025+0000 7fb871ad6640 1 -- 172.21.15.53:0/774379171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c102780 msgr2=0x7fb86c102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.025+0000 7fb871ad6640 1 --2- 172.21.15.53:0/774379171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c102780 0x7fb86c102b90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009900 tx=0x7fb85c02a410 comp rx=0 tx=0).stop 2024-08-31T06:04:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.025+0000 7fb871ad6640 1 -- 172.21.15.53:0/774379171 shutdown_connections 2024-08-31T06:04:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.025+0000 7fb871ad6640 1 --2- 172.21.15.53:0/774379171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c108a00 0x7fb86c10f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.025+0000 7fb871ad6640 1 --2- 172.21.15.53:0/774379171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c1080b0 0x7fb86c1084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.025+0000 7fb871ad6640 1 --2- 172.21.15.53:0/774379171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c102780 0x7fb86c102b90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.025+0000 7fb871ad6640 1 -- 172.21.15.53:0/774379171 >> 172.21.15.53:0/774379171 conn(0x7fb86c0fe160 msgr2=0x7fb86c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.025+0000 7fb871ad6640 1 -- 172.21.15.53:0/774379171 shutdown_connections 2024-08-31T06:04:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.025+0000 7fb871ad6640 1 -- 172.21.15.53:0/774379171 wait complete. 2024-08-31T06:04:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb871ad6640 1 Processor -- start 2024-08-31T06:04:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb871ad6640 1 -- start start 2024-08-31T06:04:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb871ad6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c102780 0x7fb86c19af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb871ad6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c1080b0 0x7fb86c19b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb871ad6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c108a00 0x7fb86c19b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb871ad6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c112580 con 0x7fb86c102780 2024-08-31T06:04:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb871ad6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c112400 con 0x7fb86c108a00 2024-08-31T06:04:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb871ad6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c112700 con 0x7fb86c1080b0 2024-08-31T06:04:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c102780 0x7fb86c19af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c102780 0x7fb86c19af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52058/0 (socket says 172.21.15.53:52058) 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb86b7fe640 1 -- 172.21.15.53:0/3587366921 learned_addr learned my addr 172.21.15.53:0/3587366921 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.026+0000 7fb86bfff640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c108a00 0x7fb86c19b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb86affd640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c1080b0 0x7fb86c19b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb86b7fe640 1 -- 172.21.15.53:0/3587366921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c1080b0 msgr2=0x7fb86c19b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c1080b0 0x7fb86c19b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb86b7fe640 1 -- 172.21.15.53:0/3587366921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c108a00 msgr2=0x7fb86c19b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c108a00 0x7fb86c19b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb86b7fe640 1 -- 172.21.15.53:0/3587366921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86c1a61a0 con 0x7fb86c102780 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb86bfff640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c108a00 0x7fb86c19b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb86affd640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c1080b0 0x7fb86c19b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c102780 0x7fb86c19af70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009230 tx=0x7fb85c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb868ff9640 1 -- 172.21.15.53:0/3587366921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c03f030 con 0x7fb86c102780 2024-08-31T06:04:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb871ad6640 1 -- 172.21.15.53:0/3587366921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86c1a6430 con 0x7fb86c102780 2024-08-31T06:04:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb868ff9640 1 -- 172.21.15.53:0/3587366921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb85c003a80 con 0x7fb86c102780 2024-08-31T06:04:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb868ff9640 1 -- 172.21.15.53:0/3587366921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c035070 con 0x7fb86c102780 2024-08-31T06:04:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.027+0000 7fb871ad6640 1 -- 172.21.15.53:0/3587366921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86c1a6920 con 0x7fb86c102780 2024-08-31T06:04:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb878a37740 1 Processor -- start 2024-08-31T06:04:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb868ff9640 1 -- 172.21.15.53:0/3587366921 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7fb85c042030 con 0x7fb86c102780 2024-08-31T06:04:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb878a37740 1 -- start start 2024-08-31T06:04:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb878a37740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf591d1b0 0x559bf5cc0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb878a37740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58f42f0 0x559bf5cc1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb878a37740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58fc4d0 0x559bf5cc1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb878a37740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559bf5c36000 con 0x559bf58fc4d0 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb878a37740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559bf5c25590 con 0x559bf58f42f0 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb878a37740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559bf5c29540 con 0x559bf591d1b0 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb86affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58fc4d0 0x559bf5cc1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb86affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58fc4d0 0x559bf5cc1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52066/0 (socket says 172.21.15.53:52066) 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.030+0000 7fb86affd640 1 -- 172.21.15.53:0/3750169159 learned_addr learned my addr 172.21.15.53:0/3750169159 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb86bfff640 1 --2- 172.21.15.53:0/3750169159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf591d1b0 0x559bf5cc0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/3750169159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58f42f0 0x559bf5cc1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb86affd640 1 -- 172.21.15.53:0/3750169159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf591d1b0 msgr2=0x559bf5cc0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb86affd640 1 --2- 172.21.15.53:0/3750169159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf591d1b0 0x559bf5cc0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb86affd640 1 -- 172.21.15.53:0/3750169159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58f42f0 msgr2=0x559bf5cc1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb86affd640 1 --2- 172.21.15.53:0/3750169159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58f42f0 0x559bf5cc1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb86affd640 1 -- 172.21.15.53:0/3750169159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf5988790 con 0x559bf58fc4d0 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/3750169159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58f42f0 0x559bf5cc1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb868ff9640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4c10 0x7fb8540b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb86bfff640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4c10 0x7fb8540b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb86affd640 1 --2- 172.21.15.53:0/3750169159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58fc4d0 0x559bf5cc1760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb860009bc0 tx=0x7fb86000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85dbf3843f700bb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb868ff9640 1 -- 172.21.15.53:0/3587366921 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb85c105c90 con 0x7fb86c102780 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb851ffb640 1 -- 172.21.15.53:0/3750169159 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860016070 con 0x559bf58fc4d0 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb851ffb640 1 -- 172.21.15.53:0/3750169159 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb860011900 con 0x559bf58fc4d0 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.031+0000 7fb851ffb640 1 -- 172.21.15.53:0/3750169159 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8600107f0 con 0x559bf58fc4d0 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.032+0000 7fb878a37740 1 -- 172.21.15.53:0/3750169159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58fc4d0 msgr2=0x559bf5cc1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.032+0000 7fb878a37740 1 --2- 172.21.15.53:0/3750169159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58fc4d0 0x559bf5cc1760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb860009bc0 tx=0x7fb86000e6c0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.032+0000 7fb86bfff640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4c10 0x7fb8540b7120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb864007f90 tx=0x7fb864007720 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.032+0000 7fb878a37740 1 -- 172.21.15.53:0/3750169159 shutdown_connections 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.032+0000 7fb878a37740 1 --2- 172.21.15.53:0/3750169159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58fc4d0 0x559bf5cc1760 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.032+0000 7fb878a37740 1 --2- 172.21.15.53:0/3750169159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58f42f0 0x559bf5cc1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.032+0000 7fb878a37740 1 --2- 172.21.15.53:0/3750169159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf591d1b0 0x559bf5cc0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.032+0000 7fb878a37740 1 -- 172.21.15.53:0/3750169159 >> 172.21.15.53:0/3750169159 conn(0x559bf5911300 msgr2=0x559bf5cbebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.032+0000 7fb878a37740 1 -- 172.21.15.53:0/3750169159 shutdown_connections 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.032+0000 7fb878a37740 1 -- 172.21.15.53:0/3750169159 wait complete. 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb878a37740 1 -- start start 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb878a37740 1 Processor -- start 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb878a37740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58f42f0 0x559bf5ccc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb878a37740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58fc4d0 0x559bf5cccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb878a37740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf591d1b0 0x559bf5cd8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb878a37740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559bf5b5eab0 con 0x559bf58f42f0 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb878a37740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559bf5bac680 con 0x559bf591d1b0 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb878a37740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559bf5ccf460 con 0x559bf58fc4d0 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb878a37740 10 client.0 _ll_register_callbacks cb 0x559bf5934a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58f42f0 0x559bf5ccc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58f42f0 0x559bf5ccc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52070/0 (socket says 172.21.15.53:52070) 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.033+0000 7fb86b7fe640 1 -- 172.21.15.53:0/2921465216 learned_addr learned my addr 172.21.15.53:0/2921465216 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb86affd640 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58fc4d0 0x559bf5cccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb86bfff640 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf591d1b0 0x559bf5cd8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb86b7fe640 1 -- 172.21.15.53:0/2921465216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58fc4d0 msgr2=0x559bf5cccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58fc4d0 0x559bf5cccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb86b7fe640 1 -- 172.21.15.53:0/2921465216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf591d1b0 msgr2=0x559bf5cd8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf591d1b0 0x559bf5cd8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb86b7fe640 1 -- 172.21.15.53:0/2921465216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf5a01620 con 0x559bf58f42f0 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58f42f0 0x559bf5ccc880 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb85c103550 tx=0x7fb85c0cbe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b97db112f34378 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb84affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb84affd640 1 -- 172.21.15.53:0/2921465216 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c049050 con 0x559bf58f42f0 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb84affd640 1 -- 172.21.15.53:0/2921465216 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb85c0c86d0 con 0x559bf58f42f0 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb878a37740 1 -- 172.21.15.53:0/2921465216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb860011900 con 0x559bf58f42f0 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb84affd640 1 -- 172.21.15.53:0/2921465216 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb85c0ccb40 con 0x559bf58f42f0 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb878a37740 10 client.15735 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.034+0000 7fb878a37740 1 -- 172.21.15.53:0/2921465216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559bf5cdb450 con 0x559bf58f42f0 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.035+0000 7fb84affd640 1 -- 172.21.15.53:0/2921465216 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb860011900 con 0x559bf58f42f0 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.035+0000 7fb84affd640 1 -- 172.21.15.53:0/2921465216 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb85c0ef0b0 con 0x559bf58f42f0 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.035+0000 7fb878a37740 10 client.15735 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.035+0000 7fb878a37740 10 client.15735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:04:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.035+0000 7fb878a37740 20 client.15735 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.035+0000 7fb878a37740 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bf58dbd80 0x559bf5cdea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.035+0000 7fb878a37740 4 client.15735 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:04:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.035+0000 7fb878a37740 1 -- 172.21.15.53:0/2921465216 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bf5c37f50 con 0x559bf58dbd80 2024-08-31T06:04:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.035+0000 7fb86affd640 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bf58dbd80 0x559bf5cdea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.036+0000 7fb86affd640 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bf58dbd80 0x559bf5cdea40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4f17860de6a3c6d server_cookie=f25afcad1d9d5bbd in_seq=0 out_seq=0 2024-08-31T06:04:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.036+0000 7fb84affd640 10 client.15735 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.036+0000 7fb84affd640 1 -- 172.21.15.53:0/2921465216 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559bf5c37f50 con 0x559bf58dbd80 2024-08-31T06:04:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.036+0000 7fb84affd640 10 client.15735 handle_command_reply: tid=0 2024-08-31T06:04:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.036+0000 7fb878a37740 1 client.15735 shutdown 2024-08-31T06:04:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb878a37740 1 -- 172.21.15.53:0/2921465216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58f42f0 msgr2=0x559bf5ccc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb878a37740 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58f42f0 0x559bf5ccc880 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb85c103550 tx=0x7fb85c0cbe50 comp rx=0 tx=0).stop 2024-08-31T06:04:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb878a37740 1 -- 172.21.15.53:0/2921465216 shutdown_connections 2024-08-31T06:04:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb878a37740 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bf58dbd80 0x559bf5cdea40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb878a37740 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf591d1b0 0x559bf5cd8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb878a37740 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58fc4d0 0x559bf5cccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb878a37740 1 --2- 172.21.15.53:0/2921465216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf58f42f0 0x559bf5ccc880 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb84affd640 0 client.15735 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb878a37740 1 -- 172.21.15.53:0/2921465216 >> 172.21.15.53:0/2921465216 conn(0x559bf5911300 msgr2=0x559bf5cc1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb878a37740 1 -- 172.21.15.53:0/2921465216 shutdown_connections 2024-08-31T06:04:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb878a37740 1 -- 172.21.15.53:0/2921465216 wait complete. 2024-08-31T06:04:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.037+0000 7fb878a37740 20 client.15735 trim_cache size 0 max 16384 2024-08-31T06:04:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb878a37740 1 Processor -- start 2024-08-31T06:04:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb878a37740 1 -- start start 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb878a37740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58f42f0 0x559bf5cc26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb878a37740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58fc4d0 0x559bf5cc6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb878a37740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb878a37740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c1af280 con 0x559bf591d1b0 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb878a37740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c1b0dc0 con 0x559bf58fc4d0 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb878a37740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c1af950 con 0x559bf58f42f0 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb86bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb86bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52080/0 (socket says 172.21.15.53:52080) 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb86bfff640 1 -- 172.21.15.53:0/512792972 learned_addr learned my addr 172.21.15.53:0/512792972 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb86affd640 1 --2- 172.21.15.53:0/512792972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58fc4d0 0x559bf5cc6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/512792972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58f42f0 0x559bf5cc26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.052+0000 7fb86bfff640 1 -- 172.21.15.53:0/512792972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58f42f0 msgr2=0x559bf5cc26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.053+0000 7fb86bfff640 1 --2- 172.21.15.53:0/512792972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58f42f0 0x559bf5cc26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.053+0000 7fb86bfff640 1 -- 172.21.15.53:0/512792972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58fc4d0 msgr2=0x559bf5cc6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.053+0000 7fb86bfff640 1 --2- 172.21.15.53:0/512792972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58fc4d0 0x559bf5cc6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.053+0000 7fb86bfff640 1 -- 172.21.15.53:0/512792972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf5ccab50 con 0x559bf591d1b0 2024-08-31T06:04:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.053+0000 7fb86bfff640 1 --2- 172.21.15.53:0/512792972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cce2a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb86400f7f0 tx=0x7fb864014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9149af42b3fe114b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.053+0000 7fb8517fa640 1 -- 172.21.15.53:0/512792972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86401db90 con 0x559bf591d1b0 2024-08-31T06:04:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.053+0000 7fb8517fa640 1 -- 172.21.15.53:0/512792972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb864003e00 con 0x559bf591d1b0 2024-08-31T06:04:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.053+0000 7fb8517fa640 1 -- 172.21.15.53:0/512792972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb864004810 con 0x559bf591d1b0 2024-08-31T06:04:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.054+0000 7fb878a37740 1 -- 172.21.15.53:0/512792972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 msgr2=0x559bf5cce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.054+0000 7fb878a37740 1 --2- 172.21.15.53:0/512792972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cce2a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb86400f7f0 tx=0x7fb864014000 comp rx=0 tx=0).stop 2024-08-31T06:04:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.054+0000 7fb878a37740 1 -- 172.21.15.53:0/512792972 shutdown_connections 2024-08-31T06:04:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.054+0000 7fb878a37740 1 --2- 172.21.15.53:0/512792972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cce2a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.054+0000 7fb878a37740 1 --2- 172.21.15.53:0/512792972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58fc4d0 0x559bf5cc6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.054+0000 7fb878a37740 1 --2- 172.21.15.53:0/512792972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58f42f0 0x559bf5cc26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.054+0000 7fb878a37740 1 -- 172.21.15.53:0/512792972 >> 172.21.15.53:0/512792972 conn(0x559bf5911300 msgr2=0x559bf5ccdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.054+0000 7fb878a37740 1 -- 172.21.15.53:0/512792972 shutdown_connections 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.054+0000 7fb878a37740 1 -- 172.21.15.53:0/512792972 wait complete. 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.054+0000 7fb878a37740 1 -- start start 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.054+0000 7fb878a37740 1 Processor -- start 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb878a37740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58f42f0 0x559bf5cd4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb878a37740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58fc4d0 0x559bf5cd02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb878a37740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cd07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb878a37740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c1b06f0 con 0x559bf591d1b0 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb878a37740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c1b0020 con 0x559bf58fc4d0 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb878a37740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c1ad260 con 0x559bf58f42f0 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb878a37740 10 client.0 _ll_register_callbacks cb 0x7fb85c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb86bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cd07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb86bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cd07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52096/0 (socket says 172.21.15.53:52096) 2024-08-31T06:04:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb86bfff640 1 -- 172.21.15.53:0/3255048584 learned_addr learned my addr 172.21.15.53:0/3255048584 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb86affd640 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58fc4d0 0x559bf5cd02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58f42f0 0x559bf5cd4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb86bfff640 1 -- 172.21.15.53:0/3255048584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58f42f0 msgr2=0x559bf5cd4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb86bfff640 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58f42f0 0x559bf5cd4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb86bfff640 1 -- 172.21.15.53:0/3255048584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58fc4d0 msgr2=0x559bf5cd02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb86bfff640 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58fc4d0 0x559bf5cd02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb86bfff640 1 -- 172.21.15.53:0/3255048584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf5cd0f30 con 0x559bf591d1b0 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb86bfff640 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cd07f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb8640043f0 tx=0x7fb8640044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44670cb08173160 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.055+0000 7fb84affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb84affd640 1 -- 172.21.15.53:0/3255048584 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb864004c40 con 0x559bf591d1b0 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb84affd640 1 -- 172.21.15.53:0/3255048584 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb864004de0 con 0x559bf591d1b0 2024-08-31T06:04:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb878a37740 1 -- 172.21.15.53:0/3255048584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb864003e00 con 0x559bf591d1b0 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb84affd640 1 -- 172.21.15.53:0/3255048584 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb86401d990 con 0x559bf591d1b0 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb878a37740 10 client.15741 fetch_fsmap learned FSMap version 28 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb878a37740 1 -- 172.21.15.53:0/3255048584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559bf5d49300 con 0x559bf591d1b0 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb84affd640 1 -- 172.21.15.53:0/3255048584 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb864003e00 con 0x559bf591d1b0 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb84affd640 1 -- 172.21.15.53:0/3255048584 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb864024030 con 0x559bf591d1b0 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb878a37740 10 client.15741 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb878a37740 10 client.15741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb878a37740 20 client.15741 populate_metadata read hostname 'smithi053' 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb878a37740 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bf58b11c0 0x559bf5d4ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb878a37740 4 client.15741 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb878a37740 1 -- 172.21.15.53:0/3255048584 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559bf5c339f0 con 0x559bf58b11c0 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.056+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bf58b11c0 0x559bf5d4ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.057+0000 7fb86b7fe640 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bf58b11c0 0x559bf5d4ba10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=923c47ab1e1b99f9 server_cookie=1ba1a42f33be223a in_seq=0 out_seq=0 2024-08-31T06:04:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.057+0000 7fb84affd640 10 client.15741 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.065+0000 7fb84affd640 1 -- 172.21.15.53:0/3255048584 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559bf5c339f0 con 0x559bf58b11c0 2024-08-31T06:04:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.065+0000 7fb84affd640 10 client.15741 handle_command_reply: tid=0 2024-08-31T06:04:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.065+0000 7fb878a37740 1 client.15741 shutdown 2024-08-31T06:04:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.065+0000 7fb878a37740 1 -- 172.21.15.53:0/3255048584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 msgr2=0x559bf5cd07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb878a37740 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cd07f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb8640043f0 tx=0x7fb8640044d0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb878a37740 1 -- 172.21.15.53:0/3255048584 shutdown_connections 2024-08-31T06:04:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb878a37740 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bf58b11c0 0x559bf5d4ba10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb878a37740 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bf591d1b0 0x559bf5cd07f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb878a37740 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bf58fc4d0 0x559bf5cd02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb84affd640 0 client.15741 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:04:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb878a37740 1 --2- 172.21.15.53:0/3255048584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bf58f42f0 0x559bf5cd4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb878a37740 1 -- 172.21.15.53:0/3255048584 >> 172.21.15.53:0/3255048584 conn(0x559bf5911300 msgr2=0x559bf5cce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb878a37740 1 -- 172.21.15.53:0/3255048584 shutdown_connections 2024-08-31T06:04:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb878a37740 1 -- 172.21.15.53:0/3255048584 wait complete. 2024-08-31T06:04:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb878a37740 20 client.15741 trim_cache size 0 max 16384 2024-08-31T06:04:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:04:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:04:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:04:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb871ad6640 1 -- 172.21.15.53:0/3587366921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4c10 msgr2=0x7fb8540b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb871ad6640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4c10 0x7fb8540b7120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb864007f90 tx=0x7fb864007720 comp rx=0 tx=0).stop 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb871ad6640 1 -- 172.21.15.53:0/3587366921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c102780 msgr2=0x7fb86c19af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb871ad6640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c102780 0x7fb86c19af70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009230 tx=0x7fb85c004270 comp rx=0 tx=0).stop 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb871ad6640 1 -- 172.21.15.53:0/3587366921 shutdown_connections 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb871ad6640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8540b4c10 0x7fb8540b7120 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb871ad6640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb86c108a00 0x7fb86c19b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb871ad6640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb86c1080b0 0x7fb86c19b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb871ad6640 1 --2- 172.21.15.53:0/3587366921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb86c102780 0x7fb86c19af70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.066+0000 7fb871ad6640 1 -- 172.21.15.53:0/3587366921 >> 172.21.15.53:0/3587366921 conn(0x7fb86c0fe160 msgr2=0x7fb86c106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.067+0000 7fb871ad6640 1 -- 172.21.15.53:0/3587366921 shutdown_connections 2024-08-31T06:04:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:04:59.067+0000 7fb871ad6640 1 -- 172.21.15.53:0/3587366921 wait complete. 2024-08-31T06:05:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:00 smithi130 ceph-mon[22266]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.8 KiB/s wr, 15 op/s 2024-08-31T06:05:00.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:00 smithi153 ceph-mon[22320]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.8 KiB/s wr, 15 op/s 2024-08-31T06:05:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:00 smithi053 ceph-mon[18924]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.8 KiB/s wr, 15 op/s 2024-08-31T06:05:01.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:05:00 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T06:05:00.937+0000 7ff3c4513640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:05:01.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:05:00 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T06:05:00.937+0000 7ff3c4513640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:05:01.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:05:00 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T06:05:00.937+0000 7ff3c4513640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:05:01.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:05:00 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T06:05:00.937+0000 7ff3c4513640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:05:01.226 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:05:00 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T06:05:00.937+0000 7ff3c4513640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:05:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:02 smithi130 ceph-mon[22266]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-08-31T06:05:02.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:02 smithi153 ceph-mon[22320]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-08-31T06:05:02.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:02 smithi053 ceph-mon[18924]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-08-31T06:05:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:04 smithi130 ceph-mon[22266]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-08-31T06:05:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:04 smithi130 ceph-mon[22266]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-08-31T06:05:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:04 smithi153 ceph-mon[22320]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-08-31T06:05:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:04 smithi153 ceph-mon[22320]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-08-31T06:05:04.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:04 smithi053 ceph-mon[18924]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-08-31T06:05:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:04 smithi053 ceph-mon[18924]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-08-31T06:05:04.506 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:05:04.768 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.262+0000 7f018cd72640 1 -- 172.21.15.53:0/171295004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0188102800 msgr2=0x7f0188102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.262+0000 7f018cd72640 1 --2- 172.21.15.53:0/171295004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0188102800 0x7f0188102c10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0178009900 tx=0x7f017802a410 comp rx=0 tx=0).stop 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.262+0000 7f018cd72640 1 -- 172.21.15.53:0/171295004 shutdown_connections 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.262+0000 7f018cd72640 1 --2- 172.21.15.53:0/171295004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0188108a90 0x7f018810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.262+0000 7f018cd72640 1 --2- 172.21.15.53:0/171295004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0188108140 0x7f0188108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.262+0000 7f018cd72640 1 --2- 172.21.15.53:0/171295004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0188102800 0x7f0188102c10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.262+0000 7f018cd72640 1 -- 172.21.15.53:0/171295004 >> 172.21.15.53:0/171295004 conn(0x7f01880794d0 msgr2=0x7f01880798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.262+0000 7f018cd72640 1 -- 172.21.15.53:0/171295004 shutdown_connections 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.262+0000 7f018cd72640 1 -- 172.21.15.53:0/171295004 wait complete. 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f018cd72640 1 Processor -- start 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f018cd72640 1 -- start start 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f018cd72640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0188102800 0x7f018819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f018cd72640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0188108140 0x7f018819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f018cd72640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0188108a90 0x7f018819f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f018cd72640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01881125c0 con 0x7f0188102800 2024-08-31T06:05:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f018cd72640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0188112440 con 0x7f0188108a90 2024-08-31T06:05:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f018cd72640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0188112740 con 0x7f0188108140 2024-08-31T06:05:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f018659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0188102800 0x7f018819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f018659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0188102800 0x7f018819a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38852/0 (socket says 172.21.15.53:38852) 2024-08-31T06:05:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f018659c640 1 -- 172.21.15.53:0/1905616018 learned_addr learned my addr 172.21.15.53:0/1905616018 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.263+0000 7f0185d9b640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0188108140 0x7f018819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f0186d9d640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0188108a90 0x7f018819f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f018659c640 1 -- 172.21.15.53:0/1905616018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0188108140 msgr2=0x7f018819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f018659c640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0188108140 0x7f018819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f018659c640 1 -- 172.21.15.53:0/1905616018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0188108a90 msgr2=0x7f018819f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f018659c640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0188108a90 0x7f018819f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f018659c640 1 -- 172.21.15.53:0/1905616018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01881a00d0 con 0x7f0188102800 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f0186d9d640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0188108a90 0x7f018819f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f018659c640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0188102800 0x7f018819a160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0178009230 tx=0x7f0178004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f01777fe640 1 -- 172.21.15.53:0/1905616018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017803f030 con 0x7f0188102800 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f01777fe640 1 -- 172.21.15.53:0/1905616018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0178003a80 con 0x7f0188102800 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f018cd72640 1 -- 172.21.15.53:0/1905616018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01881a0360 con 0x7f0188102800 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f01777fe640 1 -- 172.21.15.53:0/1905616018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178035070 con 0x7f0188102800 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.264+0000 7f018cd72640 1 -- 172.21.15.53:0/1905616018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01881a6b20 con 0x7f0188102800 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.267+0000 7f01932e7740 1 Processor -- start 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.267+0000 7f01932e7740 1 -- start start 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f01932e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 0x55dd890c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f01932e7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88cf21b0 0x55dd890c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f01932e7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f01932e7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dd89037630 con 0x55dd88cfa390 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f01932e7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dd89026bc0 con 0x55dd88d1b070 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f01932e7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55dd8902ab70 con 0x55dd88cf21b0 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f0185d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f0185d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890c0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38858/0 (socket says 172.21.15.53:38858) 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f0185d9b640 1 -- 172.21.15.53:0/977745322 learned_addr learned my addr 172.21.15.53:0/977745322 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f0186d9d640 1 --2- 172.21.15.53:0/977745322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 0x55dd890c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f0185d9b640 1 -- 172.21.15.53:0/977745322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88cf21b0 msgr2=0x55dd890c0800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f0185d9b640 1 --2- 172.21.15.53:0/977745322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88cf21b0 0x55dd890c0800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f0185d9b640 1 -- 172.21.15.53:0/977745322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 msgr2=0x55dd890c02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f0185d9b640 1 --2- 172.21.15.53:0/977745322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 0x55dd890c02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f0185d9b640 1 -- 172.21.15.53:0/977745322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd88d86650 con 0x55dd88cfa390 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f0186d9d640 1 --2- 172.21.15.53:0/977745322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 0x55dd890c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f0185d9b640 1 --2- 172.21.15.53:0/977745322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890c0d40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f017c00b6c0 tx=0x7f017c00bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb733e92c8586f06 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.268+0000 7f01777fe640 1 -- 172.21.15.53:0/1905616018 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0178042030 con 0x7f0188102800 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.269+0000 7f0174ff9640 1 -- 172.21.15.53:0/977745322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c003b70 con 0x55dd88cfa390 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.269+0000 7f0174ff9640 1 -- 172.21.15.53:0/977745322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f017c015070 con 0x55dd88cfa390 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.269+0000 7f0174ff9640 1 -- 172.21.15.53:0/977745322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c004c30 con 0x55dd88cfa390 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.269+0000 7f01777fe640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01700b4d20 0x7f01700b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.269+0000 7f0186d9d640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01700b4d20 0x7f01700b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.269+0000 7f01777fe640 1 -- 172.21.15.53:0/1905616018 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0178105a80 con 0x7f0188102800 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f01932e7740 1 -- 172.21.15.53:0/977745322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 msgr2=0x55dd890c0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f01932e7740 1 --2- 172.21.15.53:0/977745322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890c0d40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f017c00b6c0 tx=0x7f017c00bb80 comp rx=0 tx=0).stop 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f01932e7740 1 -- 172.21.15.53:0/977745322 shutdown_connections 2024-08-31T06:05:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f01932e7740 1 --2- 172.21.15.53:0/977745322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890c0d40 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f01932e7740 1 --2- 172.21.15.53:0/977745322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88cf21b0 0x55dd890c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f01932e7740 1 --2- 172.21.15.53:0/977745322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 0x55dd890c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f01932e7740 1 -- 172.21.15.53:0/977745322 >> 172.21.15.53:0/977745322 conn(0x55dd88d0f460 msgr2=0x55dd890be1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f0186d9d640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01700b4d20 0x7f01700b7230 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0180005fd0 tx=0x7f0180009740 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f01932e7740 1 -- 172.21.15.53:0/977745322 shutdown_connections 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f01932e7740 1 -- 172.21.15.53:0/977745322 wait complete. 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f01932e7740 1 -- start start 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.270+0000 7f01932e7740 1 Processor -- start 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f01932e7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f01932e7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88cfa390 0x55dd890d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f01932e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 0x55dd890dc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f01932e7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dd88e89700 con 0x55dd88cf21b0 2024-08-31T06:05:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f01932e7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dd88fad700 con 0x55dd88d1b070 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f01932e7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55dd890d2e00 con 0x55dd88cfa390 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f018659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f018659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38860/0 (socket says 172.21.15.53:38860) 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f018659c640 1 -- 172.21.15.53:0/1166697516 learned_addr learned my addr 172.21.15.53:0/1166697516 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f01932e7740 10 client.0 _ll_register_callbacks cb 0x55dd88fdcdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f0186d9d640 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 0x55dd890dc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f0185d9b640 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88cfa390 0x55dd890d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f018659c640 1 -- 172.21.15.53:0/1166697516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88cfa390 msgr2=0x55dd890d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f018659c640 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88cfa390 0x55dd890d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f018659c640 1 -- 172.21.15.53:0/1166697516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 msgr2=0x55dd890dc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f018659c640 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 0x55dd890dc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f018659c640 1 -- 172.21.15.53:0/1166697516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd88fe68b0 con 0x55dd88cf21b0 2024-08-31T06:05:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f0186d9d640 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 0x55dd890dc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.271+0000 7f0185d9b640 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88cfa390 0x55dd890d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f018659c640 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890cff10 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f01781037d0 tx=0x7f01780c8140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5aab6835f0612 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f016dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f016dffb640 1 -- 172.21.15.53:0/1166697516 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178049070 con 0x55dd88cf21b0 2024-08-31T06:05:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f016dffb640 1 -- 172.21.15.53:0/1166697516 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f01780cc3d0 con 0x55dd88cf21b0 2024-08-31T06:05:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f01932e7740 1 -- 172.21.15.53:0/1166697516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f017c015070 con 0x55dd88cf21b0 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f016dffb640 1 -- 172.21.15.53:0/1166697516 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f01780cc170 con 0x55dd88cf21b0 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f01932e7740 10 client.15759 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f01932e7740 1 -- 172.21.15.53:0/1166697516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd890ded00 con 0x55dd88cf21b0 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f016dffb640 1 -- 172.21.15.53:0/1166697516 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f017c015070 con 0x55dd88cf21b0 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f016dffb640 1 -- 172.21.15.53:0/1166697516 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f01780cb3d0 con 0x55dd88cf21b0 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f01932e7740 10 client.15759 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f01932e7740 10 client.15759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f01932e7740 20 client.15759 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f01932e7740 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dd88cd99f0 0x55dd890e2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f01932e7740 4 client.15759 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.272+0000 7f01932e7740 1 -- 172.21.15.53:0/1166697516 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd89039580 con 0x55dd88cd99f0 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.273+0000 7f0185d9b640 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dd88cd99f0 0x55dd890e2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.273+0000 7f016dffb640 10 client.15759 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.273+0000 7f0185d9b640 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dd88cd99f0 0x55dd890e2130 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac4b8dd4776d394 server_cookie=8f94dd742e5cbe5a in_seq=0 out_seq=0 2024-08-31T06:05:05.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f016dffb640 1 -- 172.21.15.53:0/1166697516 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dd89039580 con 0x55dd88cd99f0 2024-08-31T06:05:05.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f016dffb640 10 client.15759 handle_command_reply: tid=0 2024-08-31T06:05:05.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f01932e7740 1 client.15759 shutdown 2024-08-31T06:05:05.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f01932e7740 1 -- 172.21.15.53:0/1166697516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 msgr2=0x55dd890cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:05.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f01932e7740 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890cff10 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f01781037d0 tx=0x7f01780c8140 comp rx=0 tx=0).stop 2024-08-31T06:05:05.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f01932e7740 1 -- 172.21.15.53:0/1166697516 shutdown_connections 2024-08-31T06:05:05.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f01932e7740 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dd88cd99f0 0x55dd890e2130 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f01932e7740 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88d1b070 0x55dd890dc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f01932e7740 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88cfa390 0x55dd890d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f01932e7740 1 --2- 172.21.15.53:0/1166697516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890cff10 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f01932e7740 1 -- 172.21.15.53:0/1166697516 >> 172.21.15.53:0/1166697516 conn(0x55dd88d0f460 msgr2=0x55dd890bc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:05.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.274+0000 7f016dffb640 0 client.15759 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:05.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.275+0000 7f01932e7740 1 -- 172.21.15.53:0/1166697516 shutdown_connections 2024-08-31T06:05:05.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.275+0000 7f01932e7740 1 -- 172.21.15.53:0/1166697516 wait complete. 2024-08-31T06:05:05.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.275+0000 7f01932e7740 20 client.15759 trim_cache size 0 max 16384 2024-08-31T06:05:05.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.292+0000 7f01932e7740 1 Processor -- start 2024-08-31T06:05:05.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.292+0000 7f01932e7740 1 -- start start 2024-08-31T06:05:05.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.292+0000 7f01932e7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f01932e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88cfa390 0x55dd890c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f01932e7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88d1b070 0x55dd890cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f01932e7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01881ad0a0 con 0x55dd88cf21b0 2024-08-31T06:05:05.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f01932e7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01881aebe0 con 0x55dd88cfa390 2024-08-31T06:05:05.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f01932e7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01881ad770 con 0x55dd88d1b070 2024-08-31T06:05:05.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f018659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f018659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890c5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38866/0 (socket says 172.21.15.53:38866) 2024-08-31T06:05:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f018659c640 1 -- 172.21.15.53:0/1510321661 learned_addr learned my addr 172.21.15.53:0/1510321661 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f0186d9d640 1 --2- 172.21.15.53:0/1510321661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88d1b070 0x55dd890cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f0185d9b640 1 --2- 172.21.15.53:0/1510321661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88cfa390 0x55dd890c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f018659c640 1 -- 172.21.15.53:0/1510321661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88d1b070 msgr2=0x55dd890cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f018659c640 1 --2- 172.21.15.53:0/1510321661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88d1b070 0x55dd890cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f018659c640 1 -- 172.21.15.53:0/1510321661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88cfa390 msgr2=0x55dd890c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f018659c640 1 --2- 172.21.15.53:0/1510321661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88cfa390 0x55dd890c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f018659c640 1 -- 172.21.15.53:0/1510321661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd890c27e0 con 0x55dd88cf21b0 2024-08-31T06:05:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f0185d9b640 1 --2- 172.21.15.53:0/1510321661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88cfa390 0x55dd890c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f018659c640 1 --2- 172.21.15.53:0/1510321661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890c5e20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0178103280 tx=0x7f017802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdda1d61fe187442 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.293+0000 7f016ffff640 1 -- 172.21.15.53:0/1510321661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178049030 con 0x55dd88cf21b0 2024-08-31T06:05:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.294+0000 7f016ffff640 1 -- 172.21.15.53:0/1510321661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01780d09e0 con 0x55dd88cf21b0 2024-08-31T06:05:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.294+0000 7f016ffff640 1 -- 172.21.15.53:0/1510321661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01780c7cc0 con 0x55dd88cf21b0 2024-08-31T06:05:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.294+0000 7f01932e7740 1 -- 172.21.15.53:0/1510321661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 msgr2=0x55dd890c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.294+0000 7f01932e7740 1 --2- 172.21.15.53:0/1510321661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890c5e20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0178103280 tx=0x7f017802a410 comp rx=0 tx=0).stop 2024-08-31T06:05:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.294+0000 7f01932e7740 1 -- 172.21.15.53:0/1510321661 shutdown_connections 2024-08-31T06:05:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.294+0000 7f01932e7740 1 --2- 172.21.15.53:0/1510321661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88d1b070 0x55dd890cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.294+0000 7f01932e7740 1 --2- 172.21.15.53:0/1510321661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88cfa390 0x55dd890c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.294+0000 7f01932e7740 1 --2- 172.21.15.53:0/1510321661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cf21b0 0x55dd890c5e20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.294+0000 7f01932e7740 1 -- 172.21.15.53:0/1510321661 >> 172.21.15.53:0/1510321661 conn(0x55dd88d0f460 msgr2=0x55dd890c12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:05.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f01932e7740 1 -- 172.21.15.53:0/1510321661 shutdown_connections 2024-08-31T06:05:05.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f01932e7740 1 -- 172.21.15.53:0/1510321661 wait complete. 2024-08-31T06:05:05.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f01932e7740 1 -- start start 2024-08-31T06:05:05.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f01932e7740 1 Processor -- start 2024-08-31T06:05:05.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f01932e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88cf21b0 0x55dd890d89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f01932e7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890d5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f01932e7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88d1b070 0x55dd890d64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f01932e7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01881ae510 con 0x55dd88cfa390 2024-08-31T06:05:05.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f01932e7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01881ade40 con 0x55dd88cf21b0 2024-08-31T06:05:05.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f01932e7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01881ab080 con 0x55dd88d1b070 2024-08-31T06:05:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f01932e7740 10 client.0 _ll_register_callbacks cb 0x7f0178003ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.295+0000 7f0185d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890d5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f0185d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890d5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38874/0 (socket says 172.21.15.53:38874) 2024-08-31T06:05:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f0185d9b640 1 -- 172.21.15.53:0/3649795002 learned_addr learned my addr 172.21.15.53:0/3649795002 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f018659c640 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88cf21b0 0x55dd890d89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f0185d9b640 1 -- 172.21.15.53:0/3649795002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88d1b070 msgr2=0x55dd890d64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f0186d9d640 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88d1b070 0x55dd890d64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f0185d9b640 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88d1b070 0x55dd890d64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f0185d9b640 1 -- 172.21.15.53:0/3649795002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88cf21b0 msgr2=0x55dd890d89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f0185d9b640 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88cf21b0 0x55dd890d89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f0185d9b640 1 -- 172.21.15.53:0/3649795002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd890d6c40 con 0x55dd88cfa390 2024-08-31T06:05:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f0186d9d640 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88d1b070 0x55dd890d64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f0185d9b640 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890d5e80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f017c004860 tx=0x7f017c00b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a9a81a82117016 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f016dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f016dffb640 1 -- 172.21.15.53:0/3649795002 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c004290 con 0x55dd88cfa390 2024-08-31T06:05:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f016dffb640 1 -- 172.21.15.53:0/3649795002 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f017c003d80 con 0x55dd88cfa390 2024-08-31T06:05:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.296+0000 7f01932e7740 1 -- 172.21.15.53:0/3649795002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01780d09e0 con 0x55dd88cfa390 2024-08-31T06:05:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f016dffb640 1 -- 172.21.15.53:0/3649795002 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f017c039050 con 0x55dd88cfa390 2024-08-31T06:05:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f01932e7740 10 client.15765 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f01932e7740 1 -- 172.21.15.53:0/3649795002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd8914cb10 con 0x55dd88cfa390 2024-08-31T06:05:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f016dffb640 1 -- 172.21.15.53:0/3649795002 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01780d09e0 con 0x55dd88cfa390 2024-08-31T06:05:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f016dffb640 1 -- 172.21.15.53:0/3649795002 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f017c034030 con 0x55dd88cfa390 2024-08-31T06:05:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f01932e7740 10 client.15765 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:05.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f01932e7740 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:05.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f01932e7740 20 client.15765 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:05.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f01932e7740 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dd88caeda0 0x55dd8914f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:05.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f01932e7740 4 client.15765 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:05:05.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f01932e7740 1 -- 172.21.15.53:0/3649795002 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dd89035020 con 0x55dd88caeda0 2024-08-31T06:05:05.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.297+0000 7f018659c640 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dd88caeda0 0x55dd8914f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f016dffb640 10 client.15765 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f018659c640 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dd88caeda0 0x55dd8914f1e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d165b4d192f0e056 server_cookie=46e6331bcab327c5 in_seq=0 out_seq=0 2024-08-31T06:05:05.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f016dffb640 1 -- 172.21.15.53:0/3649795002 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55dd89035020 con 0x55dd88caeda0 2024-08-31T06:05:05.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f016dffb640 10 client.15765 handle_command_reply: tid=0 2024-08-31T06:05:05.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f01932e7740 1 client.15765 shutdown 2024-08-31T06:05:05.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f01932e7740 1 -- 172.21.15.53:0/3649795002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 msgr2=0x55dd890d5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:05.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f01932e7740 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890d5e80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f017c004860 tx=0x7f017c00b3e0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f01932e7740 1 -- 172.21.15.53:0/3649795002 shutdown_connections 2024-08-31T06:05:05.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f01932e7740 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dd88caeda0 0x55dd8914f1e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f01932e7740 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dd88d1b070 0x55dd890d64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f01932e7740 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd88cfa390 0x55dd890d5e80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f01932e7740 1 --2- 172.21.15.53:0/3649795002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dd88cf21b0 0x55dd890d89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f01932e7740 1 -- 172.21.15.53:0/3649795002 >> 172.21.15.53:0/3649795002 conn(0x55dd88d0f460 msgr2=0x55dd890c1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:05.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.298+0000 7f016dffb640 0 client.15765 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:05.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f01932e7740 1 -- 172.21.15.53:0/3649795002 shutdown_connections 2024-08-31T06:05:05.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f01932e7740 1 -- 172.21.15.53:0/3649795002 wait complete. 2024-08-31T06:05:05.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f01932e7740 20 client.15765 trim_cache size 0 max 16384 2024-08-31T06:05:05.315 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:05:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:05:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:05:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:05:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:05:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:05:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:05:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:05:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:05:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:05:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:05:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:05.317 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:05:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f018cd72640 1 -- 172.21.15.53:0/1905616018 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01700b4d20 msgr2=0x7f01700b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f018cd72640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01700b4d20 0x7f01700b7230 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0180005fd0 tx=0x7f0180009740 comp rx=0 tx=0).stop 2024-08-31T06:05:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f018cd72640 1 -- 172.21.15.53:0/1905616018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0188102800 msgr2=0x7f018819a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f018cd72640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0188102800 0x7f018819a160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0178009230 tx=0x7f0178004270 comp rx=0 tx=0).stop 2024-08-31T06:05:05.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f018cd72640 1 -- 172.21.15.53:0/1905616018 shutdown_connections 2024-08-31T06:05:05.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f018cd72640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01700b4d20 0x7f01700b7230 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f018cd72640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0188108a90 0x7f018819f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f018cd72640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0188108140 0x7f018819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f018cd72640 1 --2- 172.21.15.53:0/1905616018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0188102800 0x7f018819a160 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:05.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f018cd72640 1 -- 172.21.15.53:0/1905616018 >> 172.21.15.53:0/1905616018 conn(0x7f01880794d0 msgr2=0x7f01881018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:05.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.299+0000 7f018cd72640 1 -- 172.21.15.53:0/1905616018 shutdown_connections 2024-08-31T06:05:05.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:05.300+0000 7f018cd72640 1 -- 172.21.15.53:0/1905616018 wait complete. 2024-08-31T06:05:06.028 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:05:06.028 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:05:06.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:06 smithi053 ceph-mon[18924]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 26 op/s 2024-08-31T06:05:06.316 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:06 smithi130 ceph-mon[22266]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 26 op/s 2024-08-31T06:05:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:06 smithi153 ceph-mon[22320]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 26 op/s 2024-08-31T06:05:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.836+0000 7f89c9ef0640 1 -- 172.21.15.53:0/3382973463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c4109250 msgr2=0x7f89c4109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.836+0000 7f89c9ef0640 1 --2- 172.21.15.53:0/3382973463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c4109250 0x7f89c4109660 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f89ac009900 tx=0x7f89ac02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:05:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.836+0000 7f89c9ef0640 1 -- 172.21.15.53:0/3382973463 shutdown_connections 2024-08-31T06:05:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.836+0000 7f89c9ef0640 1 --2- 172.21.15.53:0/3382973463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89c4109ba0 0x7f89c41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.836+0000 7f89c9ef0640 1 --2- 172.21.15.53:0/3382973463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c4109250 0x7f89c4109660 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.836+0000 7f89c9ef0640 1 --2- 172.21.15.53:0/3382973463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89c4101d10 0x7f89c4102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.836+0000 7f89c9ef0640 1 -- 172.21.15.53:0/3382973463 >> 172.21.15.53:0/3382973463 conn(0x7f89c4077a00 msgr2=0x7f89c4077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.836+0000 7f89c9ef0640 1 -- 172.21.15.53:0/3382973463 shutdown_connections 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.836+0000 7f89c9ef0640 1 -- 172.21.15.53:0/3382973463 wait complete. 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.837+0000 7f89c9ef0640 1 Processor -- start 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.837+0000 7f89c9ef0640 1 -- start start 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.837+0000 7f89c9ef0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c4101d10 0x7f89c419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.837+0000 7f89c9ef0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89c4109250 0x7f89c419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.837+0000 7f89c9ef0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89c4109ba0 0x7f89c419f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.837+0000 7f89c9ef0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f89c4113710 con 0x7f89c4101d10 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.837+0000 7f89c9ef0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f89c4113590 con 0x7f89c4109ba0 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.837+0000 7f89c9ef0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f89c4113890 con 0x7f89c4109250 2024-08-31T06:05:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.837+0000 7f89c37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c4101d10 0x7f89c419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.837+0000 7f89c37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c4101d10 0x7f89c419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38886/0 (socket says 172.21.15.53:38886) 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c37fe640 1 -- 172.21.15.53:0/1632473944 learned_addr learned my addr 172.21.15.53:0/1632473944 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89bbfff640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89c4109250 0x7f89c419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c37fe640 1 -- 172.21.15.53:0/1632473944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89c4109250 msgr2=0x7f89c419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c37fe640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89c4109250 0x7f89c419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c37fe640 1 -- 172.21.15.53:0/1632473944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89c4109ba0 msgr2=0x7f89c419f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c3fff640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89c4109ba0 0x7f89c419f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c37fe640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89c4109ba0 0x7f89c419f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c37fe640 1 -- 172.21.15.53:0/1632473944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c419ffd0 con 0x7f89c4101d10 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89bbfff640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89c4109250 0x7f89c419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c3fff640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89c4109ba0 0x7f89c419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c37fe640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c4101d10 0x7f89c419a120 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f89b400c920 tx=0x7f89b400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c17fa640 1 -- 172.21.15.53:0/1632473944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4007c70 con 0x7f89c4101d10 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c17fa640 1 -- 172.21.15.53:0/1632473944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89b4007e10 con 0x7f89c4101d10 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c9ef0640 1 -- 172.21.15.53:0/1632473944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c41a02c0 con 0x7f89c4101d10 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c17fa640 1 -- 172.21.15.53:0/1632473944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4018710 con 0x7f89c4101d10 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.838+0000 7f89c9ef0640 1 -- 172.21.15.53:0/1632473944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c41a6ae0 con 0x7f89c4101d10 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.840+0000 7f89c9ef0640 1 -- 172.21.15.53:0/1632473944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c4102120 con 0x7f89c4101d10 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.841+0000 7f89c17fa640 1 -- 172.21.15.53:0/1632473944 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f89b400f450 con 0x7f89c4101d10 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.842+0000 7f89c17fa640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89b00b4cd0 0x7f89b00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.842+0000 7f89bbfff640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89b00b4cd0 0x7f89b00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.842+0000 7f89c17fa640 1 -- 172.21.15.53:0/1632473944 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f89b40e5790 con 0x7f89c4101d10 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.842+0000 7f89bbfff640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89b00b4cd0 0x7f89b00b71e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f89ac006010 tx=0x7f89ac000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:06.846+0000 7f89c17fa640 1 -- 172.21.15.53:0/1632473944 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f89b4014030 con 0x7f89c4101d10 2024-08-31T06:05:07.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.072+0000 7f89c9ef0640 1 -- 172.21.15.53:0/1632473944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89c410b9c0 con 0x7f89c4101d10 2024-08-31T06:05:07.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.073+0000 7f89c17fa640 1 -- 172.21.15.53:0/1632473944 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11985 (secure 0 0 0) 0x7f89b40ac580 con 0x7f89c4101d10 2024-08-31T06:05:07.075 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:05:07.075 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-08-31T06:04:23:449285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:04:23.359453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:05:07.075 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-08-31T06:05:07.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 -- 172.21.15.53:0/1632473944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89b00b4cd0 msgr2=0x7f89b00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:07.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89b00b4cd0 0x7f89b00b71e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f89ac006010 tx=0x7f89ac000bc0 comp rx=0 tx=0).stop 2024-08-31T06:05:07.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 -- 172.21.15.53:0/1632473944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c4101d10 msgr2=0x7f89c419a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:07.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c4101d10 0x7f89c419a120 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f89b400c920 tx=0x7f89b400cde0 comp rx=0 tx=0).stop 2024-08-31T06:05:07.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 -- 172.21.15.53:0/1632473944 shutdown_connections 2024-08-31T06:05:07.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89b00b4cd0 0x7f89b00b71e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:07.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89c4109ba0 0x7f89c419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:07.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89c4109250 0x7f89c419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:07.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 --2- 172.21.15.53:0/1632473944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c4101d10 0x7f89c419a120 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:07.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 -- 172.21.15.53:0/1632473944 >> 172.21.15.53:0/1632473944 conn(0x7f89c4077a00 msgr2=0x7f89c4107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:07.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 -- 172.21.15.53:0/1632473944 shutdown_connections 2024-08-31T06:05:07.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:07.076+0000 7f89c9ef0640 1 -- 172.21.15.53:0/1632473944 wait complete. 2024-08-31T06:05:07.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:07 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1632473944' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:07.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:07 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1632473944' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:07.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:07 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1632473944' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:07.987 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:05:08.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:08 smithi053 ceph-mon[18924]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-08-31T06:05:08.252 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:08 smithi153 ceph-mon[22320]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-08-31T06:05:08.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:08 smithi130 ceph-mon[22266]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-08-31T06:05:08.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.748+0000 7f99f8ef8640 1 -- 172.21.15.53:0/3688587795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99f4102800 msgr2=0x7f99f4102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:08.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.748+0000 7f99f8ef8640 1 --2- 172.21.15.53:0/3688587795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99f4102800 0x7f99f4102c10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f99e4009900 tx=0x7f99e402a410 comp rx=0 tx=0).stop 2024-08-31T06:05:08.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.748+0000 7f99f8ef8640 1 -- 172.21.15.53:0/3688587795 shutdown_connections 2024-08-31T06:05:08.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.748+0000 7f99f8ef8640 1 --2- 172.21.15.53:0/3688587795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f4108a90 0x7f99f410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.748+0000 7f99f8ef8640 1 --2- 172.21.15.53:0/3688587795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f4108140 0x7f99f4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.748+0000 7f99f8ef8640 1 --2- 172.21.15.53:0/3688587795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99f4102800 0x7f99f4102c10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.748+0000 7f99f8ef8640 1 -- 172.21.15.53:0/3688587795 >> 172.21.15.53:0/3688587795 conn(0x7f99f40794d0 msgr2=0x7f99f40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:08.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.748+0000 7f99f8ef8640 1 -- 172.21.15.53:0/3688587795 shutdown_connections 2024-08-31T06:05:08.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.749+0000 7f99f8ef8640 1 -- 172.21.15.53:0/3688587795 wait complete. 2024-08-31T06:05:08.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.749+0000 7f99f8ef8640 1 Processor -- start 2024-08-31T06:05:08.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.749+0000 7f99f8ef8640 1 -- start start 2024-08-31T06:05:08.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f8ef8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99f4102800 0x7f99f419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f8ef8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f4108140 0x7f99f419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f8ef8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f4108a90 0x7f99f419f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f8ef8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99f41125a0 con 0x7f99f4102800 2024-08-31T06:05:08.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f8ef8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99f4112420 con 0x7f99f4108140 2024-08-31T06:05:08.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f8ef8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99f4112720 con 0x7f99f4108a90 2024-08-31T06:05:08.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99f4102800 0x7f99f419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99f4102800 0x7f99f419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38898/0 (socket says 172.21.15.53:38898) 2024-08-31T06:05:08.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f259c640 1 -- 172.21.15.53:0/4287246926 learned_addr learned my addr 172.21.15.53:0/4287246926 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:08.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f4108140 0x7f99f419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f2d9d640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f4108a90 0x7f99f419f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f259c640 1 -- 172.21.15.53:0/4287246926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f4108a90 msgr2=0x7f99f419f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:08.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f259c640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f4108a90 0x7f99f419f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f259c640 1 -- 172.21.15.53:0/4287246926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f4108140 msgr2=0x7f99f419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:08.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f259c640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f4108140 0x7f99f419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.750+0000 7f99f259c640 1 -- 172.21.15.53:0/4287246926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f41a0090 con 0x7f99f4102800 2024-08-31T06:05:08.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.751+0000 7f99f259c640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99f4102800 0x7f99f419a120 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f99e4009230 tx=0x7f99e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:08.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.751+0000 7f99e37fe640 1 -- 172.21.15.53:0/4287246926 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e403f030 con 0x7f99f4102800 2024-08-31T06:05:08.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.751+0000 7f99f8ef8640 1 -- 172.21.15.53:0/4287246926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f41a0320 con 0x7f99f4102800 2024-08-31T06:05:08.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.751+0000 7f99e37fe640 1 -- 172.21.15.53:0/4287246926 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99e4003a80 con 0x7f99f4102800 2024-08-31T06:05:08.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.751+0000 7f99f8ef8640 1 -- 172.21.15.53:0/4287246926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f41a6ae0 con 0x7f99f4102800 2024-08-31T06:05:08.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.751+0000 7f99e37fe640 1 -- 172.21.15.53:0/4287246926 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e4035070 con 0x7f99f4102800 2024-08-31T06:05:08.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.754+0000 7f99ff46d740 1 Processor -- start 2024-08-31T06:05:08.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.754+0000 7f99ff46d740 1 -- start start 2024-08-31T06:05:08.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.754+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee8015d070 0x55ee80502350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.754+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee801341b0 0x55ee80502890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.754+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 0x55ee80502dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.754+0000 7f99ff46d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ee80479680 con 0x55ee8013c390 2024-08-31T06:05:08.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.754+0000 7f99ff46d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee80468c10 con 0x55ee8015d070 2024-08-31T06:05:08.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.754+0000 7f99ff46d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ee8046cbc0 con 0x55ee801341b0 2024-08-31T06:05:08.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.755+0000 7f99f1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 0x55ee80502dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.755+0000 7f99f1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 0x55ee80502dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38906/0 (socket says 172.21.15.53:38906) 2024-08-31T06:05:08.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.755+0000 7f99f1d9b640 1 -- 172.21.15.53:0/1267443440 learned_addr learned my addr 172.21.15.53:0/1267443440 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:08.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.755+0000 7f99f2d9d640 1 --2- 172.21.15.53:0/1267443440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee8015d070 0x55ee80502350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.755+0000 7f99e37fe640 1 -- 172.21.15.53:0/4287246926 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f99e4042030 con 0x7f99f4102800 2024-08-31T06:05:08.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.755+0000 7f99f1d9b640 1 -- 172.21.15.53:0/1267443440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee801341b0 msgr2=0x55ee80502890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:05:08.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.755+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/1267443440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee801341b0 0x55ee80502890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.755+0000 7f99f1d9b640 1 -- 172.21.15.53:0/1267443440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee8015d070 msgr2=0x55ee80502350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:08.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.755+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/1267443440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee8015d070 0x55ee80502350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.755+0000 7f99f1d9b640 1 -- 172.21.15.53:0/1267443440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee801c8650 con 0x55ee8013c390 2024-08-31T06:05:08.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.756+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/1267443440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 0x55ee80502dd0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f99e800abb0 tx=0x7f99e800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28b5730c9e7b970 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:08.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.756+0000 7f99e0ff9640 1 -- 172.21.15.53:0/1267443440 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e801d070 con 0x55ee8013c390 2024-08-31T06:05:08.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.756+0000 7f99e0ff9640 1 -- 172.21.15.53:0/1267443440 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99e8018ad0 con 0x55ee8013c390 2024-08-31T06:05:08.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.756+0000 7f99e37fe640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99dc0b4d20 0x7f99dc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.756+0000 7f99f2d9d640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99dc0b4d20 0x7f99dc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99e0ff9640 1 -- 172.21.15.53:0/1267443440 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e80109f0 con 0x55ee8013c390 2024-08-31T06:05:08.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99e37fe640 1 -- 172.21.15.53:0/4287246926 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f99e4105ae0 con 0x7f99f4102800 2024-08-31T06:05:08.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99ff46d740 1 -- 172.21.15.53:0/1267443440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 msgr2=0x55ee80502dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:08.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99f2d9d640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99dc0b4d20 0x7f99dc0b7230 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f99ec005fd0 tx=0x7f99ec009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:08.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99ff46d740 1 --2- 172.21.15.53:0/1267443440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 0x55ee80502dd0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f99e800abb0 tx=0x7f99e800f790 comp rx=0 tx=0).stop 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99ff46d740 1 -- 172.21.15.53:0/1267443440 shutdown_connections 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99ff46d740 1 --2- 172.21.15.53:0/1267443440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 0x55ee80502dd0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99ff46d740 1 --2- 172.21.15.53:0/1267443440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee801341b0 0x55ee80502890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99ff46d740 1 --2- 172.21.15.53:0/1267443440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee8015d070 0x55ee80502350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99ff46d740 1 -- 172.21.15.53:0/1267443440 >> 172.21.15.53:0/1267443440 conn(0x55ee80151460 msgr2=0x55ee80500240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99ff46d740 1 -- 172.21.15.53:0/1267443440 shutdown_connections 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.757+0000 7f99ff46d740 1 -- 172.21.15.53:0/1267443440 wait complete. 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.758+0000 7f99ff46d740 1 -- start start 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.758+0000 7f99ff46d740 1 Processor -- start 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.758+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 0x55ee80512800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.758+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 0x55ee80512de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.758+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8015d070 0x55ee80517e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.758+0000 7f99ff46d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ee802cb700 con 0x55ee8013c390 2024-08-31T06:05:08.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.758+0000 7f99ff46d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee803ef750 con 0x55ee801341b0 2024-08-31T06:05:08.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.758+0000 7f99ff46d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ee80510bd0 con 0x55ee8015d070 2024-08-31T06:05:08.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.758+0000 7f99ff46d740 10 client.0 _ll_register_callbacks cb 0x55ee8041ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:08.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.758+0000 7f99f1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 0x55ee80512de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99f259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 0x55ee80512800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99f259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 0x55ee80512800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:44400/0 (socket says 172.21.15.53:44400) 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99f259c640 1 -- 172.21.15.53:0/2720232053 learned_addr learned my addr 172.21.15.53:0/2720232053 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99f2d9d640 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8015d070 0x55ee80517e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99f1d9b640 1 -- 172.21.15.53:0/2720232053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8015d070 msgr2=0x55ee80517e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8015d070 0x55ee80517e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99f1d9b640 1 -- 172.21.15.53:0/2720232053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 msgr2=0x55ee80512800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 0x55ee80512800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99f1d9b640 1 -- 172.21.15.53:0/2720232053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee80428900 con 0x55ee8013c390 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99f259c640 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 0x55ee80512800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 0x55ee80512de0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f99e8010610 tx=0x7f99e8018650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f1056e85757eaf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.759+0000 7f99d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.760+0000 7f99d9ffb640 1 -- 172.21.15.53:0/2720232053 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8027020 con 0x55ee8013c390 2024-08-31T06:05:08.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.760+0000 7f99d9ffb640 1 -- 172.21.15.53:0/2720232053 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f99e8005040 con 0x55ee8013c390 2024-08-31T06:05:08.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.760+0000 7f99ff46d740 1 -- 172.21.15.53:0/2720232053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99e8018ad0 con 0x55ee8013c390 2024-08-31T06:05:08.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.760+0000 7f99d9ffb640 1 -- 172.21.15.53:0/2720232053 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99e8032050 con 0x55ee8013c390 2024-08-31T06:05:08.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.760+0000 7f99ff46d740 10 client.15783 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:08.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.760+0000 7f99ff46d740 1 -- 172.21.15.53:0/2720232053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ee80520d50 con 0x55ee8013c390 2024-08-31T06:05:08.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.761+0000 7f99d9ffb640 1 -- 172.21.15.53:0/2720232053 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99e8018ad0 con 0x55ee8013c390 2024-08-31T06:05:08.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.761+0000 7f99d9ffb640 1 -- 172.21.15.53:0/2720232053 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f99e8010af0 con 0x55ee8013c390 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.761+0000 7f99ff46d740 10 client.15783 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.761+0000 7f99ff46d740 10 client.15783 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.761+0000 7f99ff46d740 20 client.15783 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.761+0000 7f99ff46d740 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ee8011b9f0 0x55ee805240b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.761+0000 7f99ff46d740 4 client.15783 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.761+0000 7f99ff46d740 1 -- 172.21.15.53:0/2720232053 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee8047b5d0 con 0x55ee8011b9f0 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.761+0000 7f99f259c640 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ee8011b9f0 0x55ee805240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.762+0000 7f99d9ffb640 10 client.15783 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.762+0000 7f99f259c640 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ee8011b9f0 0x55ee805240b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=63b550741a964c0d server_cookie=b79b04f1e65a0d7a in_seq=0 out_seq=0 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.762+0000 7f99d9ffb640 1 -- 172.21.15.53:0/2720232053 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee8047b5d0 con 0x55ee8011b9f0 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.762+0000 7f99d9ffb640 10 client.15783 handle_command_reply: tid=0 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.762+0000 7f99ff46d740 1 client.15783 shutdown 2024-08-31T06:05:08.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99ff46d740 1 -- 172.21.15.53:0/2720232053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 msgr2=0x55ee80512de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99ff46d740 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 0x55ee80512de0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f99e8010610 tx=0x7f99e8018650 comp rx=0 tx=0).stop 2024-08-31T06:05:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99ff46d740 1 -- 172.21.15.53:0/2720232053 shutdown_connections 2024-08-31T06:05:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99ff46d740 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ee8011b9f0 0x55ee805240b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99ff46d740 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8015d070 0x55ee80517e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99d9ffb640 0 client.15783 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:05:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99ff46d740 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee8013c390 0x55ee80512de0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99ff46d740 1 --2- 172.21.15.53:0/2720232053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 0x55ee80512800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99ff46d740 1 -- 172.21.15.53:0/2720232053 >> 172.21.15.53:0/2720232053 conn(0x55ee80151460 msgr2=0x55ee805054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99ff46d740 1 -- 172.21.15.53:0/2720232053 shutdown_connections 2024-08-31T06:05:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99ff46d740 1 -- 172.21.15.53:0/2720232053 wait complete. 2024-08-31T06:05:08.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.763+0000 7f99ff46d740 20 client.15783 trim_cache size 0 max 16384 2024-08-31T06:05:08.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99ff46d740 1 Processor -- start 2024-08-31T06:05:08.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99ff46d740 1 -- start start 2024-08-31T06:05:08.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee80151460 0x55ee80503a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8011b9f0 0x55ee80505450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee801341b0 0x55ee80505990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99ff46d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99d400e820 con 0x55ee801341b0 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99ff46d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99d4010360 con 0x55ee80151460 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99ff46d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99d400eef0 con 0x55ee8011b9f0 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99f2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee801341b0 0x55ee80505990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99f2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee801341b0 0x55ee80505990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38914/0 (socket says 172.21.15.53:38914) 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99f2d9d640 1 -- 172.21.15.53:0/588082370 learned_addr learned my addr 172.21.15.53:0/588082370 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/588082370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8011b9f0 0x55ee80505450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99f259c640 1 --2- 172.21.15.53:0/588082370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee80151460 0x55ee80503a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99f1d9b640 1 -- 172.21.15.53:0/588082370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee80151460 msgr2=0x55ee80503a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/588082370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee80151460 0x55ee80503a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99f1d9b640 1 -- 172.21.15.53:0/588082370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee801341b0 msgr2=0x55ee80505990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/588082370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee801341b0 0x55ee80505990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.780+0000 7f99f1d9b640 1 -- 172.21.15.53:0/588082370 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee80510a10 con 0x55ee8011b9f0 2024-08-31T06:05:08.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.781+0000 7f99f2d9d640 1 --2- 172.21.15.53:0/588082370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee801341b0 0x55ee80505990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:08.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.781+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/588082370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8011b9f0 0x55ee80505450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99e8010680 tx=0x7f99e80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94617d58c7552a79 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:08.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.781+0000 7f99dbfff640 1 -- 172.21.15.53:0/588082370 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8027040 con 0x55ee8011b9f0 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.781+0000 7f99dbfff640 1 -- 172.21.15.53:0/588082370 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99e800a740 con 0x55ee8011b9f0 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.781+0000 7f99dbfff640 1 -- 172.21.15.53:0/588082370 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e801d040 con 0x55ee8011b9f0 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.782+0000 7f99ff46d740 1 -- 172.21.15.53:0/588082370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8011b9f0 msgr2=0x55ee80505450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.782+0000 7f99ff46d740 1 --2- 172.21.15.53:0/588082370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8011b9f0 0x55ee80505450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99e8010680 tx=0x7f99e80058a0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.782+0000 7f99ff46d740 1 -- 172.21.15.53:0/588082370 shutdown_connections 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.782+0000 7f99ff46d740 1 --2- 172.21.15.53:0/588082370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee801341b0 0x55ee80505990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.782+0000 7f99ff46d740 1 --2- 172.21.15.53:0/588082370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8011b9f0 0x55ee80505450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.782+0000 7f99ff46d740 1 --2- 172.21.15.53:0/588082370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee80151460 0x55ee80503a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.782+0000 7f99ff46d740 1 -- 172.21.15.53:0/588082370 >> 172.21.15.53:0/588082370 conn(0x55ee80512fd0 msgr2=0x55ee80503380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.782+0000 7f99ff46d740 1 -- 172.21.15.53:0/588082370 shutdown_connections 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.782+0000 7f99ff46d740 1 -- 172.21.15.53:0/588082370 wait complete. 2024-08-31T06:05:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.782+0000 7f99ff46d740 1 -- start start 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.782+0000 7f99ff46d740 1 Processor -- start 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8011b9f0 0x55ee8051aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 0x55ee8051af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99ff46d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee80151460 0x55ee8058d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99ff46d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99d400fc90 con 0x55ee80151460 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99ff46d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99d400f5c0 con 0x55ee801341b0 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99ff46d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99d400c800 con 0x55ee8011b9f0 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99f2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee80151460 0x55ee8058d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99f2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee80151460 0x55ee8058d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38918/0 (socket says 172.21.15.53:38918) 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99f2d9d640 1 -- 172.21.15.53:0/4043802195 learned_addr learned my addr 172.21.15.53:0/4043802195 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99ff46d740 10 client.0 _ll_register_callbacks cb 0x7f99e801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 0x55ee8051af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99f259c640 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8011b9f0 0x55ee8051aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99f2d9d640 1 -- 172.21.15.53:0/4043802195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8011b9f0 msgr2=0x55ee8051aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99f2d9d640 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8011b9f0 0x55ee8051aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99f2d9d640 1 -- 172.21.15.53:0/4043802195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 msgr2=0x55ee8051af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99f2d9d640 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 0x55ee8051af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99f2d9d640 1 -- 172.21.15.53:0/4043802195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee8058dd90 con 0x55ee80151460 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.783+0000 7f99f1d9b640 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 0x55ee8051af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99f2d9d640 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee80151460 0x55ee8058d820 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f99ec011ec0 tx=0x7f99ec015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91efc6b8e2027db7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99d9ffb640 1 -- 172.21.15.53:0/4043802195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec01fe60 con 0x55ee80151460 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99d9ffb640 1 -- 172.21.15.53:0/4043802195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f99ec004b20 con 0x55ee80151460 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99ff46d740 1 -- 172.21.15.53:0/4043802195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99e800a740 con 0x55ee80151460 2024-08-31T06:05:08.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99d9ffb640 1 -- 172.21.15.53:0/4043802195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99ec004d20 con 0x55ee80151460 2024-08-31T06:05:08.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99ff46d740 10 client.15789 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:08.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99ff46d740 1 -- 172.21.15.53:0/4043802195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ee8058f010 con 0x55ee80151460 2024-08-31T06:05:08.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99d9ffb640 1 -- 172.21.15.53:0/4043802195 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99e800a740 con 0x55ee80151460 2024-08-31T06:05:08.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99d9ffb640 1 -- 172.21.15.53:0/4043802195 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f99ec00f040 con 0x55ee80151460 2024-08-31T06:05:08.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99ff46d740 10 client.15789 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:08.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.784+0000 7f99ff46d740 10 client.15789 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:05:08.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.785+0000 7f99ff46d740 20 client.15789 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:08.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.785+0000 7f99ff46d740 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ee8013c390 0x55ee805918d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:08.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.785+0000 7f99ff46d740 4 client.15789 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:05:08.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.785+0000 7f99ff46d740 1 -- 172.21.15.53:0/4043802195 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee80477070 con 0x55ee8013c390 2024-08-31T06:05:08.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.785+0000 7f99f259c640 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ee8013c390 0x55ee805918d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:08.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.786+0000 7f99d9ffb640 10 client.15789 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:05:08.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.786+0000 7f99f259c640 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ee8013c390 0x55ee805918d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=957091964d0c7dd6 server_cookie=605237cd6a53b34d in_seq=0 out_seq=0 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.786+0000 7f99d9ffb640 1 -- 172.21.15.53:0/4043802195 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee80477070 con 0x55ee8013c390 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.786+0000 7f99d9ffb640 10 client.15789 handle_command_reply: tid=0 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.786+0000 7f99ff46d740 1 client.15789 shutdown 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.786+0000 7f99ff46d740 1 -- 172.21.15.53:0/4043802195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee80151460 msgr2=0x55ee8058d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99ff46d740 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee80151460 0x55ee8058d820 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f99ec011ec0 tx=0x7f99ec015040 comp rx=0 tx=0).stop 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99ff46d740 1 -- 172.21.15.53:0/4043802195 shutdown_connections 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99ff46d740 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee80151460 0x55ee8058d820 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99ff46d740 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee801341b0 0x55ee8051af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99ff46d740 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ee8013c390 0x55ee805918d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99ff46d740 1 --2- 172.21.15.53:0/4043802195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee8011b9f0 0x55ee8051aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99d9ffb640 0 client.15789 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:05:08.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99ff46d740 1 -- 172.21.15.53:0/4043802195 >> 172.21.15.53:0/4043802195 conn(0x55ee80512fd0 msgr2=0x55ee80514ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:08.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99ff46d740 1 -- 172.21.15.53:0/4043802195 shutdown_connections 2024-08-31T06:05:08.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99ff46d740 1 -- 172.21.15.53:0/4043802195 wait complete. 2024-08-31T06:05:08.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99ff46d740 20 client.15789 trim_cache size 0 max 16384 2024-08-31T06:05:08.793 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99f8ef8640 1 -- 172.21.15.53:0/4287246926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99dc0b4d20 msgr2=0x7f99dc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99f8ef8640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99dc0b4d20 0x7f99dc0b7230 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f99ec005fd0 tx=0x7f99ec009600 comp rx=0 tx=0).stop 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99f8ef8640 1 -- 172.21.15.53:0/4287246926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99f4102800 msgr2=0x7f99f419a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.787+0000 7f99f8ef8640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99f4102800 0x7f99f419a120 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f99e4009230 tx=0x7f99e4004270 comp rx=0 tx=0).stop 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.788+0000 7f99f8ef8640 1 -- 172.21.15.53:0/4287246926 shutdown_connections 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.788+0000 7f99f8ef8640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99dc0b4d20 0x7f99dc0b7230 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.788+0000 7f99f8ef8640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99f4108a90 0x7f99f419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.788+0000 7f99f8ef8640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f4108140 0x7f99f419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.788+0000 7f99f8ef8640 1 --2- 172.21.15.53:0/4287246926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99f4102800 0x7f99f419a120 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.788+0000 7f99f8ef8640 1 -- 172.21.15.53:0/4287246926 >> 172.21.15.53:0/4287246926 conn(0x7f99f40794d0 msgr2=0x7f99f41018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.788+0000 7f99f8ef8640 1 -- 172.21.15.53:0/4287246926 shutdown_connections 2024-08-31T06:05:08.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:08.788+0000 7f99f8ef8640 1 -- 172.21.15.53:0/4287246926 wait complete. 2024-08-31T06:05:09.571 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:05:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.373+0000 7f3457dad640 1 -- 172.21.15.53:0/3083304567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3450104780 msgr2=0x7f3450104b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.373+0000 7f3457dad640 1 --2- 172.21.15.53:0/3083304567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3450104780 0x7f3450104b90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f344c009900 tx=0x7f344c02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.373+0000 7f3457dad640 1 -- 172.21.15.53:0/3083304567 shutdown_connections 2024-08-31T06:05:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.373+0000 7f3457dad640 1 --2- 172.21.15.53:0/3083304567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f345010dbe0 0x7f34501100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.373+0000 7f3457dad640 1 --2- 172.21.15.53:0/3083304567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34501050d0 0x7f345010d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.373+0000 7f3457dad640 1 --2- 172.21.15.53:0/3083304567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3450104780 0x7f3450104b90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.373+0000 7f3457dad640 1 -- 172.21.15.53:0/3083304567 >> 172.21.15.53:0/3083304567 conn(0x7f34500794d0 msgr2=0x7f34500798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.374+0000 7f3457dad640 1 -- 172.21.15.53:0/3083304567 shutdown_connections 2024-08-31T06:05:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.374+0000 7f3457dad640 1 -- 172.21.15.53:0/3083304567 wait complete. 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.374+0000 7f3457dad640 1 Processor -- start 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.374+0000 7f3457dad640 1 -- start start 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3457dad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3450104780 0x7f345019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3457dad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34501050d0 0x7f345019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3457dad640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f345010dbe0 0x7f345019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3457dad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f34501136f0 con 0x7f34501050d0 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3457dad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3450113570 con 0x7f3450104780 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3457dad640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3450113870 con 0x7f345010dbe0 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3455348640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34501050d0 0x7f345019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3455348640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34501050d0 0x7f345019a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38938/0 (socket says 172.21.15.53:38938) 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3455348640 1 -- 172.21.15.53:0/3139178434 learned_addr learned my addr 172.21.15.53:0/3139178434 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3455b49640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3450104780 0x7f345019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f345634a640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f345010dbe0 0x7f345019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3455348640 1 -- 172.21.15.53:0/3139178434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f345010dbe0 msgr2=0x7f345019fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3455348640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f345010dbe0 0x7f345019fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3455348640 1 -- 172.21.15.53:0/3139178434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3450104780 msgr2=0x7f345019a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3455348640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3450104780 0x7f345019a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3455348640 1 -- 172.21.15.53:0/3139178434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34501a0070 con 0x7f34501050d0 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f345634a640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f345010dbe0 0x7f345019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.375+0000 7f3455348640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34501050d0 0x7f345019a760 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f344000d740 tx=0x7f344000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.376+0000 7f3446ffd640 1 -- 172.21.15.53:0/3139178434 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440017070 con 0x7f34501050d0 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.376+0000 7f3446ffd640 1 -- 172.21.15.53:0/3139178434 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f344000de50 con 0x7f34501050d0 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.376+0000 7f3457dad640 1 -- 172.21.15.53:0/3139178434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34501a0360 con 0x7f34501050d0 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.376+0000 7f3446ffd640 1 -- 172.21.15.53:0/3139178434 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344000f620 con 0x7f34501050d0 2024-08-31T06:05:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.376+0000 7f3457dad640 1 -- 172.21.15.53:0/3139178434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34501a6b80 con 0x7f34501050d0 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.379+0000 7f345e322740 1 Processor -- start 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.379+0000 7f345e322740 1 -- start start 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.379+0000 7f345e322740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bcf89310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.379+0000 7f345e322740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcf89850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.379+0000 7f345e322740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf89d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.379+0000 7f345e322740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576bcf00680 con 0x5576bcbc3390 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.379+0000 7f345e322740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5576bceefc10 con 0x5576bcbe4070 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.379+0000 7f345e322740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5576bcef3bc0 con 0x5576bcbbb1b0 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.380+0000 7f3455b49640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcf89850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.380+0000 7f3455b49640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcf89850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:41784/0 (socket says 172.21.15.53:41784) 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.380+0000 7f3455b49640 1 -- 172.21.15.53:0/3135965330 learned_addr learned my addr 172.21.15.53:0/3135965330 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.380+0000 7f345634a640 1 --2- 172.21.15.53:0/3135965330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bcf89310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.380+0000 7f3455b49640 1 -- 172.21.15.53:0/3135965330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 msgr2=0x5576bcf89310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.380+0000 7f3455b49640 1 --2- 172.21.15.53:0/3135965330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bcf89310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.380+0000 7f3455b49640 1 -- 172.21.15.53:0/3135965330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 msgr2=0x5576bcf89d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:05:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.380+0000 7f3455b49640 1 --2- 172.21.15.53:0/3135965330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf89d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.380+0000 7f3455b49640 1 -- 172.21.15.53:0/3135965330 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576bcc4f650 con 0x5576bcbbb1b0 2024-08-31T06:05:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.380+0000 7f3446ffd640 1 -- 172.21.15.53:0/3139178434 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f344001a070 con 0x7f34501050d0 2024-08-31T06:05:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.380+0000 7f3455b49640 1 --2- 172.21.15.53:0/3135965330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcf89850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f344c02a910 tx=0x7f344c031dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c99b12bfa16ec924 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.381+0000 7f343bfff640 1 -- 172.21.15.53:0/3135965330 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c035030 con 0x5576bcbbb1b0 2024-08-31T06:05:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.381+0000 7f343bfff640 1 -- 172.21.15.53:0/3135965330 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f344c040070 con 0x5576bcbbb1b0 2024-08-31T06:05:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.381+0000 7f343bfff640 1 -- 172.21.15.53:0/3135965330 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c0039e0 con 0x5576bcbbb1b0 2024-08-31T06:05:10.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.381+0000 7f3446ffd640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f343c0b4cd0 0x7f343c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f345e322740 1 -- 172.21.15.53:0/3135965330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 msgr2=0x5576bcf89850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f345e322740 1 --2- 172.21.15.53:0/3135965330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcf89850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f344c02a910 tx=0x7f344c031dc0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f345634a640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f343c0b4cd0 0x7f343c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f3446ffd640 1 -- 172.21.15.53:0/3139178434 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f34400e4f40 con 0x7f34501050d0 2024-08-31T06:05:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f345e322740 1 -- 172.21.15.53:0/3135965330 shutdown_connections 2024-08-31T06:05:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f345e322740 1 --2- 172.21.15.53:0/3135965330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf89d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f345e322740 1 --2- 172.21.15.53:0/3135965330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcf89850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f345e322740 1 --2- 172.21.15.53:0/3135965330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bcf89310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f345e322740 1 -- 172.21.15.53:0/3135965330 >> 172.21.15.53:0/3135965330 conn(0x5576bcbd8460 msgr2=0x5576bcf87200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f345e322740 1 -- 172.21.15.53:0/3135965330 shutdown_connections 2024-08-31T06:05:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f345e322740 1 -- 172.21.15.53:0/3135965330 wait complete. 2024-08-31T06:05:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.382+0000 7f345634a640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f343c0b4cd0 0x7f343c0b71e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3448007e50 tx=0x7f34480076a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:10.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:10 smithi053 ceph-mon[18924]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-08-31T06:05:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.383+0000 7f345e322740 1 -- start start 2024-08-31T06:05:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.383+0000 7f345e322740 1 Processor -- start 2024-08-31T06:05:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.383+0000 7f345e322740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbbb1b0 0x5576bcf9dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.383+0000 7f345e322740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.383+0000 7f345e322740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbe4070 0x5576bcfa3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.383+0000 7f345e322740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576bcd52700 con 0x5576bcbc3390 2024-08-31T06:05:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.383+0000 7f345e322740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5576bce76750 con 0x5576bcbbb1b0 2024-08-31T06:05:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.383+0000 7f345e322740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5576bcf9bf40 con 0x5576bcbe4070 2024-08-31T06:05:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.383+0000 7f345e322740 10 client.0 _ll_register_callbacks cb 0x5576bcea5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f3455348640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f3455348640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38948/0 (socket says 172.21.15.53:38948) 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f3455348640 1 -- 172.21.15.53:0/548564294 learned_addr learned my addr 172.21.15.53:0/548564294 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f3455b49640 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbbb1b0 0x5576bcf9dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f3455348640 1 -- 172.21.15.53:0/548564294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbe4070 msgr2=0x5576bcfa3250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f3455348640 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbe4070 0x5576bcfa3250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f3455348640 1 -- 172.21.15.53:0/548564294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbbb1b0 msgr2=0x5576bcf9dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f3455348640 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbbb1b0 0x5576bcf9dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f3455348640 1 -- 172.21.15.53:0/548564294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576bceaf900 con 0x5576bcbc3390 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f3455348640 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9e230 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f34400e26f0 tx=0x7f34400ab200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be3ff74fba1778d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f34397fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.384+0000 7f34397fa640 1 -- 172.21.15.53:0/548564294 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440021050 con 0x5576bcbc3390 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.385+0000 7f34397fa640 1 -- 172.21.15.53:0/548564294 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f34400a78c0 con 0x5576bcbc3390 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.385+0000 7f345e322740 1 -- 172.21.15.53:0/548564294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f344c040070 con 0x5576bcbc3390 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.385+0000 7f34397fa640 1 -- 172.21.15.53:0/548564294 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34400afea0 con 0x5576bcbc3390 2024-08-31T06:05:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.385+0000 7f345e322740 10 client.15798 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.385+0000 7f345e322740 1 -- 172.21.15.53:0/548564294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5576bcfac1a0 con 0x5576bcbc3390 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.385+0000 7f34397fa640 1 -- 172.21.15.53:0/548564294 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34400b4950 con 0x5576bcbc3390 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.385+0000 7f34397fa640 1 -- 172.21.15.53:0/548564294 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f34400ce0b0 con 0x5576bcbc3390 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.386+0000 7f345e322740 10 client.15798 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.386+0000 7f345e322740 10 client.15798 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.386+0000 7f345e322740 20 client.15798 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.386+0000 7f345e322740 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5576bcba29f0 0x5576bcfaf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.386+0000 7f345e322740 4 client.15798 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.386+0000 7f345e322740 1 -- 172.21.15.53:0/548564294 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f344c040070 con 0x5576bcba29f0 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.386+0000 7f3455b49640 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5576bcba29f0 0x5576bcfaf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.387+0000 7f3455b49640 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5576bcba29f0 0x5576bcfaf610 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e9e1b6741b9fdb92 server_cookie=cab5a9280e15bdfb in_seq=0 out_seq=0 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.387+0000 7f34397fa640 10 client.15798 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.387+0000 7f34397fa640 1 -- 172.21.15.53:0/548564294 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f344c040070 con 0x5576bcba29f0 2024-08-31T06:05:10.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.387+0000 7f34397fa640 10 client.15798 handle_command_reply: tid=0 2024-08-31T06:05:10.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.387+0000 7f345e322740 1 client.15798 shutdown 2024-08-31T06:05:10.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f345e322740 1 -- 172.21.15.53:0/548564294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 msgr2=0x5576bcf9e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:10.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f345e322740 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9e230 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f34400e26f0 tx=0x7f34400ab200 comp rx=0 tx=0).stop 2024-08-31T06:05:10.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f345e322740 1 -- 172.21.15.53:0/548564294 shutdown_connections 2024-08-31T06:05:10.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f345e322740 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbe4070 0x5576bcfa3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f345e322740 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5576bcba29f0 0x5576bcfaf610 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f345e322740 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9e230 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f345e322740 1 --2- 172.21.15.53:0/548564294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbbb1b0 0x5576bcf9dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f345e322740 1 -- 172.21.15.53:0/548564294 >> 172.21.15.53:0/548564294 conn(0x5576bcbd8460 msgr2=0x5576bcf8ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:10.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f34397fa640 0 client.15798 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:05:10.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f345e322740 1 -- 172.21.15.53:0/548564294 shutdown_connections 2024-08-31T06:05:10.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f345e322740 1 -- 172.21.15.53:0/548564294 wait complete. 2024-08-31T06:05:10.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.388+0000 7f345e322740 20 client.15798 trim_cache size 0 max 16384 2024-08-31T06:05:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.415+0000 7f345e322740 1 Processor -- start 2024-08-31T06:05:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.415+0000 7f345e322740 1 -- start start 2024-08-31T06:05:10.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.415+0000 7f345e322740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcf9a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.415+0000 7f345e322740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f345e322740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bcfb4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f345e322740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f34501ad1a0 con 0x5576bcbc3390 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f345e322740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34501aece0 con 0x5576bcbe4070 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f345e322740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34501ad870 con 0x5576bcbbb1b0 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f3455348640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f3455348640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38956/0 (socket says 172.21.15.53:38956) 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f3455348640 1 -- 172.21.15.53:0/1291389913 learned_addr learned my addr 172.21.15.53:0/1291389913 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f3455b49640 1 --2- 172.21.15.53:0/1291389913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcf9a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f345634a640 1 --2- 172.21.15.53:0/1291389913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bcfb4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f3455348640 1 -- 172.21.15.53:0/1291389913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 msgr2=0x5576bcf9a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f3455348640 1 --2- 172.21.15.53:0/1291389913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcf9a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f3455348640 1 -- 172.21.15.53:0/1291389913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 msgr2=0x5576bcfb4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f3455348640 1 --2- 172.21.15.53:0/1291389913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bcfb4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f3455348640 1 -- 172.21.15.53:0/1291389913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576bcf8d420 con 0x5576bcbc3390 2024-08-31T06:05:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f345634a640 1 --2- 172.21.15.53:0/1291389913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bcfb4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f3455b49640 1 --2- 172.21.15.53:0/1291389913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcf9a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.416+0000 7f3455348640 1 --2- 172.21.15.53:0/1291389913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9aa50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f34400a76b0 tx=0x7f3440005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d24641debc1a066 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.417+0000 7f343b7fe640 1 -- 172.21.15.53:0/1291389913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440021070 con 0x5576bcbc3390 2024-08-31T06:05:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.417+0000 7f343b7fe640 1 -- 172.21.15.53:0/1291389913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34400b4950 con 0x5576bcbc3390 2024-08-31T06:05:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.417+0000 7f343b7fe640 1 -- 172.21.15.53:0/1291389913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344005b130 con 0x5576bcbc3390 2024-08-31T06:05:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.418+0000 7f345e322740 1 -- 172.21.15.53:0/1291389913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 msgr2=0x5576bcf9aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.418+0000 7f345e322740 1 --2- 172.21.15.53:0/1291389913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9aa50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f34400a76b0 tx=0x7f3440005cc0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.418+0000 7f345e322740 1 -- 172.21.15.53:0/1291389913 shutdown_connections 2024-08-31T06:05:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.418+0000 7f345e322740 1 --2- 172.21.15.53:0/1291389913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bcfb4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.418+0000 7f345e322740 1 --2- 172.21.15.53:0/1291389913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcf9aa50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.418+0000 7f345e322740 1 --2- 172.21.15.53:0/1291389913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcf9a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.418+0000 7f345e322740 1 -- 172.21.15.53:0/1291389913 >> 172.21.15.53:0/1291389913 conn(0x5576bcbd8460 msgr2=0x5576bcf8acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.418+0000 7f345e322740 1 -- 172.21.15.53:0/1291389913 shutdown_connections 2024-08-31T06:05:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.418+0000 7f345e322740 1 -- 172.21.15.53:0/1291389913 wait complete. 2024-08-31T06:05:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.418+0000 7f345e322740 1 -- start start 2024-08-31T06:05:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.419+0000 7f345e322740 1 Processor -- start 2024-08-31T06:05:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.419+0000 7f345e322740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcfa7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.419+0000 7f345e322740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcfa7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f3455348640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcfa7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f3455348640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcfa7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38958/0 (socket says 172.21.15.53:38958) 2024-08-31T06:05:10.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f345e322740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bd018f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f3455348640 1 -- 172.21.15.53:0/3806736553 learned_addr learned my addr 172.21.15.53:0/3806736553 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:10.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f3455b49640 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcfa7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f345e322740 1 -- 172.21.15.53:0/3806736553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f34501ae610 con 0x5576bcbc3390 2024-08-31T06:05:10.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f345e322740 1 -- 172.21.15.53:0/3806736553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34501adf40 con 0x5576bcbe4070 2024-08-31T06:05:10.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f345e322740 1 -- 172.21.15.53:0/3806736553 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34501ab180 con 0x5576bcbbb1b0 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f345634a640 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bd018f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f3455348640 1 -- 172.21.15.53:0/3806736553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 msgr2=0x5576bcfa7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f3455348640 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcfa7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f3455348640 1 -- 172.21.15.53:0/3806736553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 msgr2=0x5576bd018f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f3455348640 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bd018f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.420+0000 7f3455348640 1 -- 172.21.15.53:0/3806736553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576bcfa8710 con 0x5576bcbc3390 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.421+0000 7f3455348640 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcfa7e90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f34400ce5c0 tx=0x7f34400ce340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5590754fa85091 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.421+0000 7f34397fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.421+0000 7f345e322740 10 client.0 _ll_register_callbacks cb 0x7f3440010b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.421+0000 7f345e322740 1 -- 172.21.15.53:0/3806736553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34400b4950 con 0x5576bcbc3390 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.421+0000 7f34397fa640 1 -- 172.21.15.53:0/3806736553 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440021070 con 0x5576bcbc3390 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.421+0000 7f34397fa640 1 -- 172.21.15.53:0/3806736553 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f344005b340 con 0x5576bcbc3390 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.421+0000 7f34397fa640 1 -- 172.21.15.53:0/3806736553 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34400aada0 con 0x5576bcbc3390 2024-08-31T06:05:10.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.421+0000 7f345e322740 10 client.15804 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:10.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.421+0000 7f345e322740 1 -- 172.21.15.53:0/3806736553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5576bd01a230 con 0x5576bcbc3390 2024-08-31T06:05:10.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.422+0000 7f34397fa640 1 -- 172.21.15.53:0/3806736553 <== mon.0 v2:172.21.15.53:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f34400aa890 con 0x5576bcbc3390 2024-08-31T06:05:10.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.422+0000 7f345e322740 10 client.15804 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:10.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.422+0000 7f345e322740 10 client.15804 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:05:10.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.422+0000 7f345e322740 20 client.15804 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:10.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.422+0000 7f345e322740 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5576bcb77da0 0x5576bd01c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:10.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.422+0000 7f345e322740 4 client.15804 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:05:10.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.422+0000 7f345e322740 1 -- 172.21.15.53:0/3806736553 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576bcf025d0 con 0x5576bcb77da0 2024-08-31T06:05:10.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.422+0000 7f3455b49640 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5576bcb77da0 0x5576bd01c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:10.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:10 smithi153 ceph-mon[22320]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-08-31T06:05:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f34397fa640 10 client.15804 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:05:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f3455b49640 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5576bcb77da0 0x5576bd01c780 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cbc78fbc86406381 server_cookie=49fcc3793b18be77 in_seq=0 out_seq=0 2024-08-31T06:05:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f34397fa640 1 -- 172.21.15.53:0/3806736553 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576bcf025d0 con 0x5576bcb77da0 2024-08-31T06:05:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f34397fa640 10 client.15804 handle_command_reply: tid=0 2024-08-31T06:05:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f345e322740 1 client.15804 shutdown 2024-08-31T06:05:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f345e322740 1 -- 172.21.15.53:0/3806736553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 msgr2=0x5576bcfa7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f345e322740 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcfa7e90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f34400ce5c0 tx=0x7f34400ce340 comp rx=0 tx=0).stop 2024-08-31T06:05:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f345e322740 1 -- 172.21.15.53:0/3806736553 shutdown_connections 2024-08-31T06:05:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f345e322740 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5576bcbe4070 0x5576bd018f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f345e322740 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5576bcb77da0 0x5576bd01c780 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f345e322740 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576bcbc3390 0x5576bcfa7e90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f34397fa640 0 client.15804 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:05:10.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.423+0000 7f345e322740 1 --2- 172.21.15.53:0/3806736553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576bcbbb1b0 0x5576bcfa7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.424+0000 7f345e322740 1 -- 172.21.15.53:0/3806736553 >> 172.21.15.53:0/3806736553 conn(0x5576bcbd8460 msgr2=0x5576bcf8acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:10.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.424+0000 7f345e322740 1 -- 172.21.15.53:0/3806736553 shutdown_connections 2024-08-31T06:05:10.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.424+0000 7f345e322740 1 -- 172.21.15.53:0/3806736553 wait complete. 2024-08-31T06:05:10.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.424+0000 7f345e322740 20 client.15804 trim_cache size 0 max 16384 2024-08-31T06:05:10.429 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:05:10.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 -- 172.21.15.53:0/3139178434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f343c0b4cd0 msgr2=0x7f343c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:10.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f343c0b4cd0 0x7f343c0b71e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3448007e50 tx=0x7f34480076a0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 -- 172.21.15.53:0/3139178434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34501050d0 msgr2=0x7f345019a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:10.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34501050d0 0x7f345019a760 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f344000d740 tx=0x7f344000dc00 comp rx=0 tx=0).stop 2024-08-31T06:05:10.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 -- 172.21.15.53:0/3139178434 shutdown_connections 2024-08-31T06:05:10.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f343c0b4cd0 0x7f343c0b71e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f345010dbe0 0x7f345019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34501050d0 0x7f345019a760 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 --2- 172.21.15.53:0/3139178434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3450104780 0x7f345019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:10.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 -- 172.21.15.53:0/3139178434 >> 172.21.15.53:0/3139178434 conn(0x7f34500794d0 msgr2=0x7f34501005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:10.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 -- 172.21.15.53:0/3139178434 shutdown_connections 2024-08-31T06:05:10.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:10.425+0000 7f3457dad640 1 -- 172.21.15.53:0/3139178434 wait complete. 2024-08-31T06:05:10.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:10 smithi130 ceph-mon[22266]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-08-31T06:05:10.716 INFO:tasks.quiescer.fs.[cephfs]:Total duration (52.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T06:05:10.716 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.4 2024-08-31T06:05:10.716 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:05:11.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:05:11.339 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:11.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.880+0000 7fc10797d640 1 -- 172.21.15.53:0/1390355071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc100108140 msgr2=0x7fc100108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:11.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.880+0000 7fc10797d640 1 --2- 172.21.15.53:0/1390355071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc100108140 0x7fc100108550 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009900 tx=0x7fc0f002a410 comp rx=0 tx=0).stop 2024-08-31T06:05:11.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.880+0000 7fc10797d640 1 -- 172.21.15.53:0/1390355071 shutdown_connections 2024-08-31T06:05:11.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.880+0000 7fc10797d640 1 --2- 172.21.15.53:0/1390355071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc100108a90 0x7fc10010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.880+0000 7fc10797d640 1 --2- 172.21.15.53:0/1390355071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc100108140 0x7fc100108550 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.880+0000 7fc10797d640 1 --2- 172.21.15.53:0/1390355071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc100102800 0x7fc100102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.880+0000 7fc10797d640 1 -- 172.21.15.53:0/1390355071 >> 172.21.15.53:0/1390355071 conn(0x7fc1000794d0 msgr2=0x7fc1000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.880+0000 7fc10797d640 1 -- 172.21.15.53:0/1390355071 shutdown_connections 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.880+0000 7fc10797d640 1 -- 172.21.15.53:0/1390355071 wait complete. 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.881+0000 7fc10797d640 1 Processor -- start 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.881+0000 7fc10797d640 1 -- start start 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.881+0000 7fc10797d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc100102800 0x7fc10019afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.881+0000 7fc10797d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc100108140 0x7fc10019b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.881+0000 7fc10797d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc100108a90 0x7fc10019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.881+0000 7fc10797d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc100112570 con 0x7fc100108140 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.881+0000 7fc10797d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc1001123f0 con 0x7fc100102800 2024-08-31T06:05:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.881+0000 7fc10797d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc1001126f0 con 0x7fc100108a90 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc104f18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc100108140 0x7fc10019b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc104f18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc100108140 0x7fc10019b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38974/0 (socket says 172.21.15.53:38974) 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc104f18640 1 -- 172.21.15.53:0/3736469231 learned_addr learned my addr 172.21.15.53:0/3736469231 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc105719640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc100102800 0x7fc10019afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc105f1a640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc100108a90 0x7fc10019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc104f18640 1 -- 172.21.15.53:0/3736469231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc100108a90 msgr2=0x7fc10019ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc104f18640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc100108a90 0x7fc10019ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc104f18640 1 -- 172.21.15.53:0/3736469231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc100102800 msgr2=0x7fc10019afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc104f18640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc100102800 0x7fc10019afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc104f18640 1 -- 172.21.15.53:0/3736469231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1001a6250 con 0x7fc100108140 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc104f18640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc100108140 0x7fc10019b500 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0005940 tx=0x7fc0f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc0f67fc640 1 -- 172.21.15.53:0/3736469231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f003f030 con 0x7fc100108140 2024-08-31T06:05:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc10797d640 1 -- 172.21.15.53:0/3736469231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1001a64e0 con 0x7fc100108140 2024-08-31T06:05:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc0f67fc640 1 -- 172.21.15.53:0/3736469231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0f0003c90 con 0x7fc100108140 2024-08-31T06:05:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.882+0000 7fc0f67fc640 1 -- 172.21.15.53:0/3736469231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0035070 con 0x7fc100108140 2024-08-31T06:05:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.883+0000 7fc10797d640 1 -- 172.21.15.53:0/3736469231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1001a6a10 con 0x7fc100108140 2024-08-31T06:05:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.883+0000 7fc10797d640 1 -- 172.21.15.53:0/3736469231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc100102c10 con 0x7fc100108140 2024-08-31T06:05:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.885+0000 7fc0f67fc640 1 -- 172.21.15.53:0/3736469231 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc0f0042030 con 0x7fc100108140 2024-08-31T06:05:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.886+0000 7fc0f67fc640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0ec0b4cd0 0x7fc0ec0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.886+0000 7fc105719640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0ec0b4cd0 0x7fc0ec0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.886+0000 7fc0f67fc640 1 -- 172.21.15.53:0/3736469231 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fc0f0105d70 con 0x7fc100108140 2024-08-31T06:05:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.887+0000 7fc105719640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0ec0b4cd0 0x7fc0ec0b71e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc10006b760 tx=0x7fc0fc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:11.893+0000 7fc0f67fc640 1 -- 172.21.15.53:0/3736469231 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc0f00cc510 con 0x7fc100108140 2024-08-31T06:05:11.939 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:12.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.153+0000 7fc10797d640 1 -- 172.21.15.53:0/3736469231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc10006b010 con 0x7fc100108140 2024-08-31T06:05:12.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.154+0000 7fc0f67fc640 1 -- 172.21.15.53:0/3736469231 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11985 (secure 0 0 0) 0x7fc0f00d0cd0 con 0x7fc100108140 2024-08-31T06:05:12.156 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:05:12.157 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-08-31T06:04:23:449285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:04:23.359453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:05:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-08-31T06:05:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 -- 172.21.15.53:0/3736469231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0ec0b4cd0 msgr2=0x7fc0ec0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0ec0b4cd0 0x7fc0ec0b71e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc10006b760 tx=0x7fc0fc00b390 comp rx=0 tx=0).stop 2024-08-31T06:05:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 -- 172.21.15.53:0/3736469231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc100108140 msgr2=0x7fc10019b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc100108140 0x7fc10019b500 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0005940 tx=0x7fc0f00042f0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 -- 172.21.15.53:0/3736469231 shutdown_connections 2024-08-31T06:05:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0ec0b4cd0 0x7fc0ec0b71e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc100108a90 0x7fc10019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc100108140 0x7fc10019b500 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 --2- 172.21.15.53:0/3736469231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc100102800 0x7fc10019afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 -- 172.21.15.53:0/3736469231 >> 172.21.15.53:0/3736469231 conn(0x7fc1000794d0 msgr2=0x7fc1001042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 -- 172.21.15.53:0/3736469231 shutdown_connections 2024-08-31T06:05:12.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.157+0000 7fc10797d640 1 -- 172.21.15.53:0/3736469231 wait complete. 2024-08-31T06:05:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.172+0000 7f0495e8b640 1 -- 172.21.15.53:0/666003931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0490107850 msgr2=0x7f0490107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.172+0000 7f0495e8b640 1 --2- 172.21.15.53:0/666003931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0490107850 0x7f0490107c60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0484009900 tx=0x7f048402a410 comp rx=0 tx=0).stop 2024-08-31T06:05:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.173+0000 7f0495e8b640 1 -- 172.21.15.53:0/666003931 shutdown_connections 2024-08-31T06:05:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.173+0000 7f0495e8b640 1 --2- 172.21.15.53:0/666003931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04901081a0 0x7f049010e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.173+0000 7f0495e8b640 1 --2- 172.21.15.53:0/666003931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0490107850 0x7f0490107c60 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.173+0000 7f0495e8b640 1 --2- 172.21.15.53:0/666003931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490101f20 0x7f0490102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.173+0000 7f0495e8b640 1 -- 172.21.15.53:0/666003931 >> 172.21.15.53:0/666003931 conn(0x7f0490079c30 msgr2=0x7f049007a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.173+0000 7f0495e8b640 1 -- 172.21.15.53:0/666003931 shutdown_connections 2024-08-31T06:05:12.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.173+0000 7f0495e8b640 1 -- 172.21.15.53:0/666003931 wait complete. 2024-08-31T06:05:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.173+0000 7f0495e8b640 1 Processor -- start 2024-08-31T06:05:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f0495e8b640 1 -- start start 2024-08-31T06:05:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f0495e8b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490101f20 0x7f0490199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f0495e8b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0490107850 0x7f04901997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f0495e8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04901081a0 0x7f049019ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f0495e8b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0490111db0 con 0x7f04901081a0 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f0495e8b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0490111c30 con 0x7f0490107850 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f0495e8b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0490111f30 con 0x7f0490101f20 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f048ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04901081a0 0x7f049019ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f048ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04901081a0 0x7f049019ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39000/0 (socket says 172.21.15.53:39000) 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f048ffff640 1 -- 172.21.15.53:0/3290661889 learned_addr learned my addr 172.21.15.53:0/3290661889 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f048effd640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0490107850 0x7f04901997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.174+0000 7f048f7fe640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490101f20 0x7f0490199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.175+0000 7f048ffff640 1 -- 172.21.15.53:0/3290661889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490101f20 msgr2=0x7f0490199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.175+0000 7f048ffff640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490101f20 0x7f0490199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.175+0000 7f048ffff640 1 -- 172.21.15.53:0/3290661889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0490107850 msgr2=0x7f04901997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.175+0000 7f048ffff640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0490107850 0x7f04901997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.175+0000 7f048ffff640 1 -- 172.21.15.53:0/3290661889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049019f130 con 0x7f04901081a0 2024-08-31T06:05:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.175+0000 7f048ffff640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04901081a0 0x7f049019ea30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f048800b970 tx=0x7f048800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.175+0000 7f048cff9640 1 -- 172.21.15.53:0/3290661889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488019070 con 0x7f04901081a0 2024-08-31T06:05:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.175+0000 7f048cff9640 1 -- 172.21.15.53:0/3290661889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0488014440 con 0x7f04901081a0 2024-08-31T06:05:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.175+0000 7f0495e8b640 1 -- 172.21.15.53:0/3290661889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049019f420 con 0x7f04901081a0 2024-08-31T06:05:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.175+0000 7f048cff9640 1 -- 172.21.15.53:0/3290661889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04880075d0 con 0x7f04901081a0 2024-08-31T06:05:12.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.175+0000 7f0495e8b640 1 -- 172.21.15.53:0/3290661889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04901a5bb0 con 0x7f04901081a0 2024-08-31T06:05:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.178+0000 7f049cdf5740 1 Processor -- start 2024-08-31T06:05:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.178+0000 7f048cff9640 1 -- 172.21.15.53:0/3290661889 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f048801c070 con 0x7f04901081a0 2024-08-31T06:05:12.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.178+0000 7f049cdf5740 1 -- start start 2024-08-31T06:05:12.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573f11b0 0x556e57797600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573c82f0 0x556e57797b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e577ab020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f049cdf5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e5770a000 con 0x556e573c82f0 2024-08-31T06:05:12.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f049cdf5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556e576f9590 con 0x556e573d04d0 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f049cdf5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556e576fd540 con 0x556e573f11b0 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f048f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573c82f0 0x556e57797b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f048f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573c82f0 0x556e57797b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39002/0 (socket says 172.21.15.53:39002) 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f048f7fe640 1 -- 172.21.15.53:0/2647054073 learned_addr learned my addr 172.21.15.53:0/2647054073 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f048effd640 1 --2- 172.21.15.53:0/2647054073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573f11b0 0x556e57797600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f048effd640 1 --2- 172.21.15.53:0/2647054073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e577ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f048f7fe640 1 -- 172.21.15.53:0/2647054073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573f11b0 msgr2=0x556e57797600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f048f7fe640 1 --2- 172.21.15.53:0/2647054073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573f11b0 0x556e57797600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f048f7fe640 1 -- 172.21.15.53:0/2647054073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 msgr2=0x556e577ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f048f7fe640 1 --2- 172.21.15.53:0/2647054073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e577ab020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f048f7fe640 1 -- 172.21.15.53:0/2647054073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e5745c790 con 0x556e573c82f0 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.179+0000 7f048effd640 1 --2- 172.21.15.53:0/2647054073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e577ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.180+0000 7f048cff9640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04780b4da0 0x7f04780b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.180+0000 7f048f7fe640 1 --2- 172.21.15.53:0/2647054073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573c82f0 0x556e57797b40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0480009a70 tx=0x7f0480009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7589dd4c8619de6c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.180+0000 7f048effd640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04780b4da0 0x7f04780b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.180+0000 7f048cff9640 1 -- 172.21.15.53:0/3290661889 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f04880e4950 con 0x7f04901081a0 2024-08-31T06:05:12.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.180+0000 7f0475ffb640 1 -- 172.21.15.53:0/2647054073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480017070 con 0x556e573c82f0 2024-08-31T06:05:12.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.180+0000 7f0475ffb640 1 -- 172.21.15.53:0/2647054073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0480013470 con 0x556e573c82f0 2024-08-31T06:05:12.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.180+0000 7f0475ffb640 1 -- 172.21.15.53:0/2647054073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480012630 con 0x556e573c82f0 2024-08-31T06:05:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.181+0000 7f049cdf5740 1 -- 172.21.15.53:0/2647054073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573c82f0 msgr2=0x556e57797b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.181+0000 7f048effd640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04780b4da0 0x7f04780b72b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0484005940 tx=0x7f04840058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.181+0000 7f049cdf5740 1 --2- 172.21.15.53:0/2647054073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573c82f0 0x556e57797b40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0480009a70 tx=0x7f0480009f30 comp rx=0 tx=0).stop 2024-08-31T06:05:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.181+0000 7f049cdf5740 1 -- 172.21.15.53:0/2647054073 shutdown_connections 2024-08-31T06:05:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.181+0000 7f049cdf5740 1 --2- 172.21.15.53:0/2647054073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e577ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.181+0000 7f049cdf5740 1 --2- 172.21.15.53:0/2647054073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573c82f0 0x556e57797b40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.181+0000 7f049cdf5740 1 --2- 172.21.15.53:0/2647054073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573f11b0 0x556e57797600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.181+0000 7f049cdf5740 1 -- 172.21.15.53:0/2647054073 >> 172.21.15.53:0/2647054073 conn(0x556e573e5300 msgr2=0x556e577922a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.181+0000 7f049cdf5740 1 -- 172.21.15.53:0/2647054073 shutdown_connections 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.181+0000 7f049cdf5740 1 -- 172.21.15.53:0/2647054073 wait complete. 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.182+0000 7f049cdf5740 1 -- start start 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.182+0000 7f049cdf5740 1 Processor -- start 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.182+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.182+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573d04d0 0x556e577a9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.182+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573f11b0 0x556e577b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.182+0000 7f049cdf5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e57632ab0 con 0x556e573d04d0 2024-08-31T06:05:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.182+0000 7f049cdf5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556e57680680 con 0x556e573f11b0 2024-08-31T06:05:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.182+0000 7f049cdf5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556e577aba50 con 0x556e573c82f0 2024-08-31T06:05:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.182+0000 7f048effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573d04d0 0x556e577a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.182+0000 7f049cdf5740 10 client.0 _ll_register_callbacks cb 0x556e57408a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f048f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f048effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573d04d0 0x556e577a9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39010/0 (socket says 172.21.15.53:39010) 2024-08-31T06:05:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f048effd640 1 -- 172.21.15.53:0/779021539 learned_addr learned my addr 172.21.15.53:0/779021539 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f048ffff640 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573f11b0 0x556e577b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f048effd640 1 -- 172.21.15.53:0/779021539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 msgr2=0x556e577a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f048effd640 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577a8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f048effd640 1 -- 172.21.15.53:0/779021539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573f11b0 msgr2=0x556e577b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f048effd640 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573f11b0 0x556e577b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f048effd640 1 -- 172.21.15.53:0/779021539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e574d5620 con 0x556e573d04d0 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f048f7fe640 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f048effd640 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573d04d0 0x556e577a9280 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0484033000 tx=0x7f0484009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb04d452082b1d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.183+0000 7f046effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f046effd640 1 -- 172.21.15.53:0/779021539 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484035040 con 0x556e573d04d0 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f049cdf5740 1 -- 172.21.15.53:0/779021539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0480013470 con 0x556e573d04d0 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f046effd640 1 -- 172.21.15.53:0/779021539 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f048403d9e0 con 0x556e573d04d0 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f046effd640 1 -- 172.21.15.53:0/779021539 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f048403dbe0 con 0x556e573d04d0 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f049cdf5740 10 client.15822 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f049cdf5740 1 -- 172.21.15.53:0/779021539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556e577b7a40 con 0x556e573d04d0 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f046effd640 1 -- 172.21.15.53:0/779021539 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0480013470 con 0x556e573d04d0 2024-08-31T06:05:12.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f046effd640 1 -- 172.21.15.53:0/779021539 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0484054470 con 0x556e573d04d0 2024-08-31T06:05:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f049cdf5740 10 client.15822 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f049cdf5740 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f049cdf5740 20 client.15822 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f049cdf5740 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556e573afd80 0x556e577baf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f049cdf5740 4 client.15822 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.184+0000 7f049cdf5740 1 -- 172.21.15.53:0/779021539 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e5770bf50 con 0x556e573afd80 2024-08-31T06:05:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.185+0000 7f048f7fe640 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556e573afd80 0x556e577baf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.185+0000 7f046effd640 10 client.15822 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.185+0000 7f048f7fe640 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556e573afd80 0x556e577baf50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67c09f7b0f4bbd39 server_cookie=13220931f28b93bb in_seq=0 out_seq=0 2024-08-31T06:05:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.186+0000 7f046effd640 1 -- 172.21.15.53:0/779021539 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556e5770bf50 con 0x556e573afd80 2024-08-31T06:05:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.186+0000 7f046effd640 10 client.15822 handle_command_reply: tid=0 2024-08-31T06:05:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.186+0000 7f049cdf5740 1 client.15822 shutdown 2024-08-31T06:05:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f049cdf5740 1 -- 172.21.15.53:0/779021539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573d04d0 msgr2=0x556e577a9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f049cdf5740 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573d04d0 0x556e577a9280 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0484033000 tx=0x7f0484009260 comp rx=0 tx=0).stop 2024-08-31T06:05:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f049cdf5740 1 -- 172.21.15.53:0/779021539 shutdown_connections 2024-08-31T06:05:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f049cdf5740 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556e573afd80 0x556e577baf50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f046effd640 0 client.15822 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f049cdf5740 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573f11b0 0x556e577b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f049cdf5740 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573d04d0 0x556e577a9280 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f049cdf5740 1 --2- 172.21.15.53:0/779021539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f049cdf5740 1 -- 172.21.15.53:0/779021539 >> 172.21.15.53:0/779021539 conn(0x556e573e5300 msgr2=0x556e57792270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f049cdf5740 1 -- 172.21.15.53:0/779021539 shutdown_connections 2024-08-31T06:05:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f049cdf5740 1 -- 172.21.15.53:0/779021539 wait complete. 2024-08-31T06:05:12.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.187+0000 7f049cdf5740 20 client.15822 trim_cache size 0 max 16384 2024-08-31T06:05:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.202+0000 7f049cdf5740 1 Processor -- start 2024-08-31T06:05:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.202+0000 7f049cdf5740 1 -- start start 2024-08-31T06:05:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.202+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577a8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.202+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e577a8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.202+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e577a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.202+0000 7f049cdf5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f04901ad320 con 0x556e573f11b0 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.202+0000 7f049cdf5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f04901aee60 con 0x556e573d04d0 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.202+0000 7f049cdf5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04901ad9f0 con 0x556e573c82f0 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f048ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e577a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f048ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e577a1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39018/0 (socket says 172.21.15.53:39018) 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f048ffff640 1 -- 172.21.15.53:0/3663928545 learned_addr learned my addr 172.21.15.53:0/3663928545 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f048effd640 1 --2- 172.21.15.53:0/3663928545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e577a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f048f7fe640 1 --2- 172.21.15.53:0/3663928545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f048ffff640 1 -- 172.21.15.53:0/3663928545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 msgr2=0x556e577a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f048ffff640 1 --2- 172.21.15.53:0/3663928545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577a8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f048ffff640 1 -- 172.21.15.53:0/3663928545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 msgr2=0x556e577a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f048ffff640 1 --2- 172.21.15.53:0/3663928545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e577a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f048ffff640 1 -- 172.21.15.53:0/3663928545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e577b5d60 con 0x556e573f11b0 2024-08-31T06:05:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f048ffff640 1 --2- 172.21.15.53:0/3663928545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e577a1fc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f04880e20a0 tx=0x7f0488004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd2ba5c284ababa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f04757fa640 1 -- 172.21.15.53:0/3663928545 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04880a7320 con 0x556e573f11b0 2024-08-31T06:05:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f04757fa640 1 -- 172.21.15.53:0/3663928545 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0488014930 con 0x556e573f11b0 2024-08-31T06:05:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.203+0000 7f04757fa640 1 -- 172.21.15.53:0/3663928545 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04880b2e30 con 0x556e573f11b0 2024-08-31T06:05:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.204+0000 7f049cdf5740 1 -- 172.21.15.53:0/3663928545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 msgr2=0x556e577a1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.204+0000 7f049cdf5740 1 --2- 172.21.15.53:0/3663928545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e577a1fc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f04880e20a0 tx=0x7f0488004b50 comp rx=0 tx=0).stop 2024-08-31T06:05:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.204+0000 7f049cdf5740 1 -- 172.21.15.53:0/3663928545 shutdown_connections 2024-08-31T06:05:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.204+0000 7f049cdf5740 1 --2- 172.21.15.53:0/3663928545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e577a1fc0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.204+0000 7f049cdf5740 1 --2- 172.21.15.53:0/3663928545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e577a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.204+0000 7f049cdf5740 1 --2- 172.21.15.53:0/3663928545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577a8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.204+0000 7f049cdf5740 1 -- 172.21.15.53:0/3663928545 >> 172.21.15.53:0/3663928545 conn(0x556e573e5300 msgr2=0x556e577a7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.204+0000 7f049cdf5740 1 -- 172.21.15.53:0/3663928545 shutdown_connections 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.204+0000 7f049cdf5740 1 -- 172.21.15.53:0/3663928545 wait complete. 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.205+0000 7f049cdf5740 1 -- start start 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.205+0000 7f049cdf5740 1 Processor -- start 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.205+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.205+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e57796bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.205+0000 7f049cdf5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e57797100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.205+0000 7f049cdf5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f04901ae790 con 0x556e573f11b0 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.205+0000 7f049cdf5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f04901ae0c0 con 0x556e573d04d0 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.205+0000 7f049cdf5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04901ab300 con 0x556e573c82f0 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f049cdf5740 10 client.0 _ll_register_callbacks cb 0x7f0484009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f048ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e57797100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f048ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e57797100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39030/0 (socket says 172.21.15.53:39030) 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f048ffff640 1 -- 172.21.15.53:0/3553267564 learned_addr learned my addr 172.21.15.53:0/3553267564 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f048effd640 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e57796bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f048f7fe640 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f048ffff640 1 -- 172.21.15.53:0/3553267564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 msgr2=0x556e577b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f048ffff640 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f048ffff640 1 -- 172.21.15.53:0/3553267564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 msgr2=0x556e57796bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f048ffff640 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e57796bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f048ffff640 1 -- 172.21.15.53:0/3553267564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e577976c0 con 0x556e573f11b0 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f048ffff640 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e57797100 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f04880a7110 tx=0x7f0488009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66acca90199ec16 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f046effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f046effd640 1 -- 172.21.15.53:0/3553267564 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488096020 con 0x556e573f11b0 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f046effd640 1 -- 172.21.15.53:0/3553267564 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f04880961c0 con 0x556e573f11b0 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f049cdf5740 1 -- 172.21.15.53:0/3553267564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0488014930 con 0x556e573f11b0 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f046effd640 1 -- 172.21.15.53:0/3553267564 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f04880963e0 con 0x556e573f11b0 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f049cdf5740 10 client.15828 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.206+0000 7f049cdf5740 1 -- 172.21.15.53:0/3553267564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556e577ada50 con 0x556e573f11b0 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.207+0000 7f046effd640 1 -- 172.21.15.53:0/3553267564 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0488014930 con 0x556e573f11b0 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.207+0000 7f046effd640 1 -- 172.21.15.53:0/3553267564 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f04880af3a0 con 0x556e573f11b0 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.207+0000 7f049cdf5740 10 client.15828 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.207+0000 7f049cdf5740 10 client.15828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.207+0000 7f049cdf5740 20 client.15828 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.207+0000 7f049cdf5740 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556e573851c0 0x556e57827e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.207+0000 7f049cdf5740 4 client.15828 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.207+0000 7f049cdf5740 1 -- 172.21.15.53:0/3553267564 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556e577079f0 con 0x556e573851c0 2024-08-31T06:05:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.207+0000 7f048f7fe640 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556e573851c0 0x556e57827e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.208+0000 7f046effd640 10 client.15828 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.208+0000 7f048f7fe640 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556e573851c0 0x556e57827e10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e8b5c7d649db83b server_cookie=67963530cea4e404 in_seq=0 out_seq=0 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f046effd640 1 -- 172.21.15.53:0/3553267564 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556e577079f0 con 0x556e573851c0 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f046effd640 10 client.15828 handle_command_reply: tid=0 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f049cdf5740 1 client.15828 shutdown 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f049cdf5740 1 -- 172.21.15.53:0/3553267564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 msgr2=0x556e57797100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f049cdf5740 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e57797100 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f04880a7110 tx=0x7f0488009920 comp rx=0 tx=0).stop 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f049cdf5740 1 -- 172.21.15.53:0/3553267564 shutdown_connections 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f049cdf5740 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556e573851c0 0x556e57827e10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f049cdf5740 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e573f11b0 0x556e57797100 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f049cdf5740 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556e573d04d0 0x556e57796bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f049cdf5740 1 --2- 172.21.15.53:0/3553267564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e573c82f0 0x556e577b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f046effd640 0 client.15828 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.214+0000 7f049cdf5740 1 -- 172.21.15.53:0/3553267564 >> 172.21.15.53:0/3553267564 conn(0x556e573e5300 msgr2=0x556e577a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f049cdf5740 1 -- 172.21.15.53:0/3553267564 shutdown_connections 2024-08-31T06:05:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f049cdf5740 1 -- 172.21.15.53:0/3553267564 wait complete. 2024-08-31T06:05:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f049cdf5740 20 client.15828 trim_cache size 0 max 16384 2024-08-31T06:05:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:05:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:05:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:05:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:05:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f0495e8b640 1 -- 172.21.15.53:0/3290661889 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04780b4da0 msgr2=0x7f04780b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f0495e8b640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04780b4da0 0x7f04780b72b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0484005940 tx=0x7f04840058d0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f0495e8b640 1 -- 172.21.15.53:0/3290661889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04901081a0 msgr2=0x7f049019ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f0495e8b640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04901081a0 0x7f049019ea30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f048800b970 tx=0x7f048800bd70 comp rx=0 tx=0).stop 2024-08-31T06:05:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f0495e8b640 1 -- 172.21.15.53:0/3290661889 shutdown_connections 2024-08-31T06:05:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f0495e8b640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04780b4da0 0x7f04780b72b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f0495e8b640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04901081a0 0x7f049019ea30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f0495e8b640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0490107850 0x7f04901997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f0495e8b640 1 --2- 172.21.15.53:0/3290661889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490101f20 0x7f0490199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f0495e8b640 1 -- 172.21.15.53:0/3290661889 >> 172.21.15.53:0/3290661889 conn(0x7f0490079c30 msgr2=0x7f0490100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.215+0000 7f0495e8b640 1 -- 172.21.15.53:0/3290661889 shutdown_connections 2024-08-31T06:05:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:12.216+0000 7f0495e8b640 1 -- 172.21.15.53:0/3290661889 wait complete. 2024-08-31T06:05:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:12 smithi130 ceph-mon[22266]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-08-31T06:05:12.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:12 smithi153 ceph-mon[22320]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-08-31T06:05:12.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:12 smithi053 ceph-mon[18924]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-08-31T06:05:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.666+0000 7fe11eb27640 1 -- 172.21.15.53:0/4087175812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe118104750 msgr2=0x7fe118104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.666+0000 7fe11eb27640 1 --2- 172.21.15.53:0/4087175812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe118104750 0x7fe118104b60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009900 tx=0x7fe10c02a410 comp rx=0 tx=0).stop 2024-08-31T06:05:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.666+0000 7fe11eb27640 1 -- 172.21.15.53:0/4087175812 shutdown_connections 2024-08-31T06:05:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.666+0000 7fe11eb27640 1 --2- 172.21.15.53:0/4087175812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe11810dbb0 0x7fe1181100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.666+0000 7fe11eb27640 1 --2- 172.21.15.53:0/4087175812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1181050a0 0x7fe11810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.666+0000 7fe11eb27640 1 --2- 172.21.15.53:0/4087175812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe118104750 0x7fe118104b60 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.666+0000 7fe11eb27640 1 -- 172.21.15.53:0/4087175812 >> 172.21.15.53:0/4087175812 conn(0x7fe1180794d0 msgr2=0x7fe1180798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.666+0000 7fe11eb27640 1 -- 172.21.15.53:0/4087175812 shutdown_connections 2024-08-31T06:05:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.666+0000 7fe11eb27640 1 -- 172.21.15.53:0/4087175812 wait complete. 2024-08-31T06:05:12.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.667+0000 7fe11eb27640 1 Processor -- start 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.667+0000 7fe11eb27640 1 -- start start 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11eb27640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe118104750 0x7fe11819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11eb27640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1181050a0 0x7fe11819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11eb27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11810dbb0 0x7fe11819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11eb27640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe1181136c0 con 0x7fe11810dbb0 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11eb27640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe118113540 con 0x7fe1181050a0 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11eb27640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe118113840 con 0x7fe118104750 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11c8c3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe118104750 0x7fe11819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11d0c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11810dbb0 0x7fe11819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11c8c3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe118104750 0x7fe11819a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:41880/0 (socket says 172.21.15.53:41880) 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11c8c3640 1 -- 172.21.15.53:0/10241994 learned_addr learned my addr 172.21.15.53:0/10241994 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11d0c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11810dbb0 0x7fe11819f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39060/0 (socket says 172.21.15.53:39060) 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe117fff640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1181050a0 0x7fe11819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11d0c4640 1 -- 172.21.15.53:0/10241994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe118104750 msgr2=0x7fe11819a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11d0c4640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe118104750 0x7fe11819a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11d0c4640 1 -- 172.21.15.53:0/10241994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1181050a0 msgr2=0x7fe11819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11d0c4640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1181050a0 0x7fe11819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11d0c4640 1 -- 172.21.15.53:0/10241994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1181a0020 con 0x7fe11810dbb0 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe117fff640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1181050a0 0x7fe11819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe118104750 0x7fe11819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.668+0000 7fe11d0c4640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11810dbb0 0x7fe11819f9b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe11000cab0 tx=0x7fe11000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.669+0000 7fe115ffb640 1 -- 172.21.15.53:0/10241994 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11000ae20 con 0x7fe11810dbb0 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.669+0000 7fe115ffb640 1 -- 172.21.15.53:0/10241994 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe11000f8e0 con 0x7fe11810dbb0 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.669+0000 7fe115ffb640 1 -- 172.21.15.53:0/10241994 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1100189a0 con 0x7fe11810dbb0 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.669+0000 7fe11eb27640 1 -- 172.21.15.53:0/10241994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1181a0310 con 0x7fe11810dbb0 2024-08-31T06:05:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.669+0000 7fe11eb27640 1 -- 172.21.15.53:0/10241994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1181a6b30 con 0x7fe11810dbb0 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.672+0000 7fe12509c740 1 Processor -- start 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.673+0000 7fe115ffb640 1 -- 172.21.15.53:0/10241994 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe11000f450 con 0x7fe11810dbb0 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.673+0000 7fe12509c740 1 -- start start 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.673+0000 7fe12509c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a523070 0x55a63a8c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.673+0000 7fe12509c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8c8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.673+0000 7fe12509c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a8c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.673+0000 7fe12509c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a63a83f680 con 0x55a63a4fa1b0 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.673+0000 7fe12509c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a63a82ec10 con 0x55a63a523070 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.673+0000 7fe12509c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a63a832bc0 con 0x55a63a502390 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.673+0000 7fe11c8c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.673+0000 7fe11c8c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39074/0 (socket says 172.21.15.53:39074) 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.673+0000 7fe11c8c3640 1 -- 172.21.15.53:0/3997866883 learned_addr learned my addr 172.21.15.53:0/3997866883 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.674+0000 7fe117fff640 1 --2- 172.21.15.53:0/3997866883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a8c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.674+0000 7fe115ffb640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe1080b4cd0 0x7fe1080b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.674+0000 7fe117fff640 1 --2- 172.21.15.53:0/3997866883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a523070 0x55a63a8c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.674+0000 7fe11c8c3640 1 -- 172.21.15.53:0/3997866883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 msgr2=0x55a63a8c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.674+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/3997866883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a8c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.674+0000 7fe11c8c3640 1 -- 172.21.15.53:0/3997866883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a523070 msgr2=0x55a63a8c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.674+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/3997866883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a523070 0x55a63a8c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.674+0000 7fe11c8c3640 1 -- 172.21.15.53:0/3997866883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63a58e650 con 0x55a63a4fa1b0 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.674+0000 7fe115ffb640 1 -- 172.21.15.53:0/10241994 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fe1100e5910 con 0x7fe11810dbb0 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.674+0000 7fe11d0c4640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe1080b4cd0 0x7fe1080b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.674+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/3997866883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8c8850 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe10c006010 tx=0x7fe10c0316a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6b40ff59475d69 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.675+0000 7fe11d0c4640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe1080b4cd0 0x7fe1080b71e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe1100abd00 tx=0x7fe11000a890 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.675+0000 7fe102ffd640 1 -- 172.21.15.53:0/3997866883 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c035070 con 0x55a63a4fa1b0 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.675+0000 7fe102ffd640 1 -- 172.21.15.53:0/3997866883 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe10c031840 con 0x55a63a4fa1b0 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.675+0000 7fe102ffd640 1 -- 172.21.15.53:0/3997866883 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c045470 con 0x55a63a4fa1b0 2024-08-31T06:05:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.676+0000 7fe12509c740 1 -- 172.21.15.53:0/3997866883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 msgr2=0x55a63a8c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.676+0000 7fe12509c740 1 --2- 172.21.15.53:0/3997866883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8c8850 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe10c006010 tx=0x7fe10c0316a0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.676+0000 7fe12509c740 1 -- 172.21.15.53:0/3997866883 shutdown_connections 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.676+0000 7fe12509c740 1 --2- 172.21.15.53:0/3997866883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a8c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.676+0000 7fe12509c740 1 --2- 172.21.15.53:0/3997866883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8c8850 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.676+0000 7fe12509c740 1 --2- 172.21.15.53:0/3997866883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a523070 0x55a63a8c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.676+0000 7fe12509c740 1 -- 172.21.15.53:0/3997866883 >> 172.21.15.53:0/3997866883 conn(0x55a63a517460 msgr2=0x55a63a8c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.676+0000 7fe12509c740 1 -- 172.21.15.53:0/3997866883 shutdown_connections 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.676+0000 7fe12509c740 1 -- 172.21.15.53:0/3997866883 wait complete. 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.676+0000 7fe12509c740 1 -- start start 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.676+0000 7fe12509c740 1 Processor -- start 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe12509c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a4fa1b0 0x55a63a8d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe12509c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a8d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe12509c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a523070 0x55a63a8dfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe12509c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a63a691700 con 0x55a63a523070 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe12509c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a63a7b5750 con 0x55a63a4fa1b0 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe12509c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a63a8d6a90 con 0x55a63a502390 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe12509c740 10 client.0 _ll_register_callbacks cb 0x55a63a7e4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe117fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a523070 0x55a63a8dfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe117fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a523070 0x55a63a8dfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39084/0 (socket says 172.21.15.53:39084) 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe117fff640 1 -- 172.21.15.53:0/1955089871 learned_addr learned my addr 172.21.15.53:0/1955089871 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe117fff640 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a4fa1b0 0x55a63a8d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a8d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe117fff640 1 -- 172.21.15.53:0/1955089871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 msgr2=0x55a63a8d3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe117fff640 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a8d3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe117fff640 1 -- 172.21.15.53:0/1955089871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a4fa1b0 msgr2=0x55a63a8d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe117fff640 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a4fa1b0 0x55a63a8d3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe117fff640 1 -- 172.21.15.53:0/1955089871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a63a7ee900 con 0x55a63a523070 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.677+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a8d3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.678+0000 7fe117fff640 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a523070 0x55a63a8dfd80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe104014c90 tx=0x7fe104004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ca3b0b28af0d8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.678+0000 7fe0f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.678+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1955089871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104004030 con 0x55a63a523070 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.678+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1955089871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fe1040041d0 con 0x55a63a523070 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.678+0000 7fe12509c740 1 -- 172.21.15.53:0/1955089871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe10c031840 con 0x55a63a523070 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.678+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1955089871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe1040043d0 con 0x55a63a523070 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.678+0000 7fe12509c740 10 client.15840 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.678+0000 7fe12509c740 1 -- 172.21.15.53:0/1955089871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a63a8e28a0 con 0x55a63a523070 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.678+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1955089871 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe10c031840 con 0x55a63a523070 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.679+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1955089871 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe1040035f0 con 0x55a63a523070 2024-08-31T06:05:12.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.679+0000 7fe12509c740 10 client.15840 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.679+0000 7fe12509c740 10 client.15840 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.679+0000 7fe12509c740 20 client.15840 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.679+0000 7fe12509c740 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a63a4e19f0 0x55a63a8e5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.679+0000 7fe12509c740 4 client.15840 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.679+0000 7fe12509c740 1 -- 172.21.15.53:0/1955089871 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a63a8415d0 con 0x55a63a4e19f0 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.679+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a63a4e19f0 0x55a63a8e5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.679+0000 7fe0f7fff640 10 client.15840 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.679+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a63a4e19f0 0x55a63a8e5de0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67889f22d6ee59ea server_cookie=b1cae043b56a2192 in_seq=0 out_seq=0 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.680+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1955089871 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a63a8415d0 con 0x55a63a4e19f0 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.680+0000 7fe0f7fff640 10 client.15840 handle_command_reply: tid=0 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.680+0000 7fe12509c740 1 client.15840 shutdown 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.680+0000 7fe12509c740 1 -- 172.21.15.53:0/1955089871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a523070 msgr2=0x55a63a8dfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.680+0000 7fe12509c740 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a523070 0x55a63a8dfd80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe104014c90 tx=0x7fe104004730 comp rx=0 tx=0).stop 2024-08-31T06:05:12.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.680+0000 7fe12509c740 1 -- 172.21.15.53:0/1955089871 shutdown_connections 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.680+0000 7fe12509c740 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a63a4e19f0 0x55a63a8e5de0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.680+0000 7fe0f7fff640 0 client.15840 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.680+0000 7fe12509c740 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a523070 0x55a63a8dfd80 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.680+0000 7fe12509c740 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a8d3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.680+0000 7fe12509c740 1 --2- 172.21.15.53:0/1955089871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a4fa1b0 0x55a63a8d3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.681+0000 7fe12509c740 1 -- 172.21.15.53:0/1955089871 >> 172.21.15.53:0/1955089871 conn(0x55a63a517460 msgr2=0x55a63a8cb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.681+0000 7fe12509c740 1 -- 172.21.15.53:0/1955089871 shutdown_connections 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.681+0000 7fe12509c740 1 -- 172.21.15.53:0/1955089871 wait complete. 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.681+0000 7fe12509c740 20 client.15840 trim_cache size 0 max 16384 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.698+0000 7fe12509c740 1 Processor -- start 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.698+0000 7fe12509c740 1 -- start start 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.698+0000 7fe12509c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4e19f0 0x55a63a8d5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.698+0000 7fe12509c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a4fa1b0 0x55a63a8c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.698+0000 7fe12509c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a502390 0x55a63a8dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.698+0000 7fe12509c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe1181af3d0 con 0x55a63a4e19f0 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.698+0000 7fe12509c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe1181b0f10 con 0x55a63a502390 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.698+0000 7fe12509c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe1181afaa0 con 0x55a63a4fa1b0 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.698+0000 7fe117fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4e19f0 0x55a63a8d5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe117fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4e19f0 0x55a63a8d5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39094/0 (socket says 172.21.15.53:39094) 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe117fff640 1 -- 172.21.15.53:0/3575349152 learned_addr learned my addr 172.21.15.53:0/3575349152 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/3575349152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a4fa1b0 0x55a63a8c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe117fff640 1 --2- 172.21.15.53:0/3575349152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a502390 0x55a63a8dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe117fff640 1 -- 172.21.15.53:0/3575349152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a4fa1b0 msgr2=0x55a63a8c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe117fff640 1 --2- 172.21.15.53:0/3575349152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a4fa1b0 0x55a63a8c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe117fff640 1 -- 172.21.15.53:0/3575349152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a502390 msgr2=0x55a63a8dfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe117fff640 1 --2- 172.21.15.53:0/3575349152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a502390 0x55a63a8dfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe117fff640 1 -- 172.21.15.53:0/3575349152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63a8ce6d0 con 0x55a63a4e19f0 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe117fff640 1 --2- 172.21.15.53:0/3575349152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4e19f0 0x55a63a8d5980 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe104014600 tx=0x7fe10400bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964ff4c95d624479 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe1027fc640 1 -- 172.21.15.53:0/3575349152 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10402f070 con 0x55a63a4e19f0 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe1027fc640 1 -- 172.21.15.53:0/3575349152 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1040054b0 con 0x55a63a4e19f0 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.699+0000 7fe1027fc640 1 -- 172.21.15.53:0/3575349152 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104003f90 con 0x55a63a4e19f0 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.700+0000 7fe12509c740 1 -- 172.21.15.53:0/3575349152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4e19f0 msgr2=0x55a63a8d5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.700+0000 7fe12509c740 1 --2- 172.21.15.53:0/3575349152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4e19f0 0x55a63a8d5980 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe104014600 tx=0x7fe10400bbd0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.700+0000 7fe12509c740 1 -- 172.21.15.53:0/3575349152 shutdown_connections 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.700+0000 7fe12509c740 1 --2- 172.21.15.53:0/3575349152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a502390 0x55a63a8dfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.700+0000 7fe12509c740 1 --2- 172.21.15.53:0/3575349152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a4fa1b0 0x55a63a8c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.700+0000 7fe12509c740 1 --2- 172.21.15.53:0/3575349152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4e19f0 0x55a63a8d5980 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.700+0000 7fe12509c740 1 -- 172.21.15.53:0/3575349152 >> 172.21.15.53:0/3575349152 conn(0x55a63a517460 msgr2=0x55a63a8c9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.700+0000 7fe12509c740 1 -- 172.21.15.53:0/3575349152 shutdown_connections 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.700+0000 7fe12509c740 1 -- 172.21.15.53:0/3575349152 wait complete. 2024-08-31T06:05:12.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.701+0000 7fe12509c740 1 -- start start 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.701+0000 7fe12509c740 1 Processor -- start 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.701+0000 7fe12509c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a4e19f0 0x55a63a8d9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.701+0000 7fe12509c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8da4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.701+0000 7fe12509c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a94f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.701+0000 7fe12509c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe1181b0840 con 0x55a63a4fa1b0 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.701+0000 7fe12509c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe1181b0170 con 0x55a63a4e19f0 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.701+0000 7fe12509c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe1181ad3b0 con 0x55a63a502390 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.701+0000 7fe12509c740 10 client.0 _ll_register_callbacks cb 0x7fe1040148d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe11c8c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8da4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe11c8c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8da4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39096/0 (socket says 172.21.15.53:39096) 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe11c8c3640 1 -- 172.21.15.53:0/1433362821 learned_addr learned my addr 172.21.15.53:0/1433362821 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe117fff640 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a94f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe117fff640 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a4e19f0 0x55a63a8d9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe11c8c3640 1 -- 172.21.15.53:0/1433362821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 msgr2=0x55a63a94f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a94f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe11c8c3640 1 -- 172.21.15.53:0/1433362821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a4e19f0 msgr2=0x55a63a8d9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:12.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a4e19f0 0x55a63a8d9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe11c8c3640 1 -- 172.21.15.53:0/1433362821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a63a8dacf0 con 0x55a63a4fa1b0 2024-08-31T06:05:12.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe117fff640 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a4e19f0 0x55a63a8d9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:12.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe11c8c3640 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8da4c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe10c02a450 tx=0x7fe10c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417f09caf0bcbdd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:12.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe0f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:12.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1433362821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c05b020 con 0x55a63a4fa1b0 2024-08-31T06:05:12.745 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:05:12.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1433362821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fe10c004200 con 0x55a63a4fa1b0 2024-08-31T06:05:12.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.702+0000 7fe12509c740 1 -- 172.21.15.53:0/1433362821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1040054b0 con 0x55a63a4fa1b0 2024-08-31T06:05:12.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1433362821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe10c066050 con 0x55a63a4fa1b0 2024-08-31T06:05:12.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe12509c740 10 client.15846 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:12.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe12509c740 1 -- 172.21.15.53:0/1433362821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a63a950d10 con 0x55a63a4fa1b0 2024-08-31T06:05:12.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1433362821 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1040054b0 con 0x55a63a4fa1b0 2024-08-31T06:05:12.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1433362821 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe10c057590 con 0x55a63a4fa1b0 2024-08-31T06:05:12.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe12509c740 10 client.15846 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe12509c740 10 client.15846 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe12509c740 20 client.15846 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe12509c740 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a63a523070 0x55a63a952fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe12509c740 4 client.15846 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe12509c740 1 -- 172.21.15.53:0/1433362821 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a63a83d070 con 0x55a63a523070 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.703+0000 7fe117fff640 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a63a523070 0x55a63a952fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe0f7fff640 10 client.15846 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe117fff640 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a63a523070 0x55a63a952fc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b25ee6a49f779d34 server_cookie=ad1beeef555a5e7d in_seq=0 out_seq=0 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe0f7fff640 1 -- 172.21.15.53:0/1433362821 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a63a83d070 con 0x55a63a523070 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe0f7fff640 10 client.15846 handle_command_reply: tid=0 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe12509c740 1 client.15846 shutdown 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe12509c740 1 -- 172.21.15.53:0/1433362821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 msgr2=0x55a63a8da4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe12509c740 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8da4c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe10c02a450 tx=0x7fe10c005850 comp rx=0 tx=0).stop 2024-08-31T06:05:12.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe12509c740 1 -- 172.21.15.53:0/1433362821 shutdown_connections 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe12509c740 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a63a523070 0x55a63a952fc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe12509c740 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a63a502390 0x55a63a94f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe12509c740 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a63a4fa1b0 0x55a63a8da4c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe0f7fff640 0 client.15846 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe12509c740 1 --2- 172.21.15.53:0/1433362821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a63a4e19f0 0x55a63a8d9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.704+0000 7fe12509c740 1 -- 172.21.15.53:0/1433362821 >> 172.21.15.53:0/1433362821 conn(0x55a63a517460 msgr2=0x55a63a8d5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe12509c740 1 -- 172.21.15.53:0/1433362821 shutdown_connections 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe12509c740 1 -- 172.21.15.53:0/1433362821 wait complete. 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe12509c740 20 client.15846 trim_cache size 0 max 16384 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe11eb27640 1 -- 172.21.15.53:0/10241994 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe1080b4cd0 msgr2=0x7fe1080b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe11eb27640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe1080b4cd0 0x7fe1080b71e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe1100abd00 tx=0x7fe11000a890 comp rx=0 tx=0).stop 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe11eb27640 1 -- 172.21.15.53:0/10241994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11810dbb0 msgr2=0x7fe11819f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe11eb27640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11810dbb0 0x7fe11819f9b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe11000cab0 tx=0x7fe11000cf70 comp rx=0 tx=0).stop 2024-08-31T06:05:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe11eb27640 1 -- 172.21.15.53:0/10241994 shutdown_connections 2024-08-31T06:05:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe11eb27640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe1080b4cd0 0x7fe1080b71e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe11eb27640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11810dbb0 0x7fe11819f9b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe11eb27640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1181050a0 0x7fe11819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe11eb27640 1 --2- 172.21.15.53:0/10241994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe118104750 0x7fe11819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.705+0000 7fe11eb27640 1 -- 172.21.15.53:0/10241994 >> 172.21.15.53:0/10241994 conn(0x7fe1180794d0 msgr2=0x7fe118100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.706+0000 7fe11eb27640 1 -- 172.21.15.53:0/10241994 shutdown_connections 2024-08-31T06:05:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:12.706+0000 7fe11eb27640 1 -- 172.21.15.53:0/10241994 wait complete. 2024-08-31T06:05:13.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:13 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3736469231' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:13.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:13 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3736469231' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:13.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:13 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3736469231' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:14.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:14 smithi153 ceph-mon[22320]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-08-31T06:05:14.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:14 smithi053 ceph-mon[18924]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-08-31T06:05:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:14 smithi130 ceph-mon[22266]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-08-31T06:05:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:16 smithi153 ceph-mon[22320]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-08-31T06:05:16.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:16 smithi053 ceph-mon[18924]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-08-31T06:05:16.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:16 smithi130 ceph-mon[22266]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-08-31T06:05:16.634 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0' 2024-08-31T06:05:16.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0 2024-08-31T06:05:17.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:05:17.258 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.757+0000 7f129e974640 1 -- 172.21.15.53:0/3935044034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1298109bc0 msgr2=0x7f12981103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.757+0000 7f129e974640 1 --2- 172.21.15.53:0/3935044034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1298109bc0 0x7f12981103f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1290009ca0 tx=0x7f129002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.757+0000 7f129e974640 1 -- 172.21.15.53:0/3935044034 shutdown_connections 2024-08-31T06:05:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.757+0000 7f129e974640 1 --2- 172.21.15.53:0/3935044034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1298109bc0 0x7f12981103f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.757+0000 7f129e974640 1 --2- 172.21.15.53:0/3935044034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1298109270 0x7f1298109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.757+0000 7f129e974640 1 --2- 172.21.15.53:0/3935044034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1298103930 0x7f1298103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.757+0000 7f129e974640 1 -- 172.21.15.53:0/3935044034 >> 172.21.15.53:0/3935044034 conn(0x7f12980ff380 msgr2=0x7f12981017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.758+0000 7f129e974640 1 -- 172.21.15.53:0/3935044034 shutdown_connections 2024-08-31T06:05:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.758+0000 7f129e974640 1 -- 172.21.15.53:0/3935044034 wait complete. 2024-08-31T06:05:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.759+0000 7f129e974640 1 Processor -- start 2024-08-31T06:05:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.759+0000 7f129e974640 1 -- start start 2024-08-31T06:05:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.759+0000 7f129e974640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1298103930 0x7f129819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.759+0000 7f129e974640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1298109270 0x7f129819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.759+0000 7f129e974640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1298109bc0 0x7f129819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.759+0000 7f129e974640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1298113780 con 0x7f1298109bc0 2024-08-31T06:05:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.759+0000 7f129e974640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1298113600 con 0x7f1298103930 2024-08-31T06:05:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.759+0000 7f129e974640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1298113900 con 0x7f1298109270 2024-08-31T06:05:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.760+0000 7f1297fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1298103930 0x7f129819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.760+0000 7f12977fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1298109270 0x7f129819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.760+0000 7f1297fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1298103930 0x7f129819a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53084/0 (socket says 172.21.15.53:53084) 2024-08-31T06:05:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.760+0000 7f1297fff640 1 -- 172.21.15.53:0/1922851106 learned_addr learned my addr 172.21.15.53:0/1922851106 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.760+0000 7f129cf11640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1298109bc0 0x7f129819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.760+0000 7f12977fe640 1 -- 172.21.15.53:0/1922851106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1298103930 msgr2=0x7f129819a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.760+0000 7f12977fe640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1298103930 0x7f129819a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.760+0000 7f12977fe640 1 -- 172.21.15.53:0/1922851106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1298109bc0 msgr2=0x7f129819f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.760+0000 7f12977fe640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1298109bc0 0x7f129819f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.760+0000 7f12977fe640 1 -- 172.21.15.53:0/1922851106 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12981a0040 con 0x7f1298109270 2024-08-31T06:05:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.760+0000 7f12977fe640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1298109270 0x7f129819a670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f129806b870 tx=0x7f128c00db30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.761+0000 7f12957fa640 1 -- 172.21.15.53:0/1922851106 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128c017070 con 0x7f1298109270 2024-08-31T06:05:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.761+0000 7f12957fa640 1 -- 172.21.15.53:0/1922851106 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f128c009820 con 0x7f1298109270 2024-08-31T06:05:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.761+0000 7f129e974640 1 -- 172.21.15.53:0/1922851106 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12981a0330 con 0x7f1298109270 2024-08-31T06:05:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.761+0000 7f12957fa640 1 -- 172.21.15.53:0/1922851106 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128c004b20 con 0x7f1298109270 2024-08-31T06:05:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.761+0000 7f129e974640 1 -- 172.21.15.53:0/1922851106 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12981a6a90 con 0x7f1298109270 2024-08-31T06:05:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.765+0000 7f12957fa640 1 -- 172.21.15.53:0/1922851106 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f128c004cc0 con 0x7f1298109270 2024-08-31T06:05:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.765+0000 7f12a4ee9740 1 Processor -- start 2024-08-31T06:05:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.765+0000 7f12a4ee9740 1 -- start start 2024-08-31T06:05:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.766+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc31f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.766+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 0x558fc31f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.766+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e2db60 0x558fc31f6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.766+0000 7f12a4ee9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558fc316a330 con 0x558fc2e4e840 2024-08-31T06:05:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.766+0000 7f12a4ee9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558fc31598c0 con 0x558fc2e2db60 2024-08-31T06:05:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.766+0000 7f12a4ee9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558fc315d870 con 0x558fc2e25980 2024-08-31T06:05:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.766+0000 7f129cf11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc31f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.766+0000 7f129cf11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc31f5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54834/0 (socket says 172.21.15.53:54834) 2024-08-31T06:05:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.766+0000 7f129cf11640 1 -- 172.21.15.53:0/837136500 learned_addr learned my addr 172.21.15.53:0/837136500 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.767+0000 7f1297fff640 1 --2- 172.21.15.53:0/837136500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 0x558fc31f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.767+0000 7f12977fe640 1 --2- 172.21.15.53:0/837136500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e2db60 0x558fc31f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.767+0000 7f12957fa640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f12800b4d20 0x7f12800b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.767+0000 7f129cf11640 1 -- 172.21.15.53:0/837136500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 msgr2=0x558fc31f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.767+0000 7f129cf11640 1 --2- 172.21.15.53:0/837136500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 0x558fc31f61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.767+0000 7f129cf11640 1 -- 172.21.15.53:0/837136500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e2db60 msgr2=0x558fc31f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.767+0000 7f129cf11640 1 --2- 172.21.15.53:0/837136500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e2db60 0x558fc31f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.767+0000 7f129cf11640 1 -- 172.21.15.53:0/837136500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fc3111df0 con 0x558fc2e4e840 2024-08-31T06:05:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.767+0000 7f1297fff640 1 --2- 172.21.15.53:0/837136500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 0x558fc31f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.767+0000 7f129cf11640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f12800b4d20 0x7f12800b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.767+0000 7f129cf11640 1 --2- 172.21.15.53:0/837136500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc31f5c90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1290009ca0 tx=0x7f1290031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993645c80f67ec83 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.768+0000 7f127e7fc640 1 -- 172.21.15.53:0/837136500 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129004d070 con 0x558fc2e4e840 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.768+0000 7f127e7fc640 1 -- 172.21.15.53:0/837136500 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1290036070 con 0x558fc2e4e840 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.768+0000 7f12957fa640 1 -- 172.21.15.53:0/1922851106 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f128c0e4d90 con 0x7f1298109270 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.768+0000 7f127e7fc640 1 -- 172.21.15.53:0/837136500 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12900047b0 con 0x558fc2e4e840 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.768+0000 7f129cf11640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f12800b4d20 0x7f12800b7230 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f129004a000 tx=0x7f129004b000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.769+0000 7f12a4ee9740 1 -- 172.21.15.53:0/837136500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 msgr2=0x558fc31f5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.769+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/837136500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc31f5c90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1290009ca0 tx=0x7f1290031450 comp rx=0 tx=0).stop 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.769+0000 7f12a4ee9740 1 -- 172.21.15.53:0/837136500 shutdown_connections 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.769+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/837136500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e2db60 0x558fc31f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.769+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/837136500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 0x558fc31f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.769+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/837136500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc31f5c90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.769+0000 7f12a4ee9740 1 -- 172.21.15.53:0/837136500 >> 172.21.15.53:0/837136500 conn(0x558fc2e42990 msgr2=0x558fc31f3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.769+0000 7f12a4ee9740 1 -- 172.21.15.53:0/837136500 shutdown_connections 2024-08-31T06:05:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.769+0000 7f12a4ee9740 1 -- 172.21.15.53:0/837136500 wait complete. 2024-08-31T06:05:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.770+0000 7f12a4ee9740 1 -- start start 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.770+0000 7f12a4ee9740 1 Processor -- start 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e25980 0x558fc3201790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e2db60 0x558fc3201cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc3206f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f12a4ee9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558fc2fbc7a0 con 0x558fc2e4e840 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f12a4ee9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558fc30e0240 con 0x558fc2e25980 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f12a4ee9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558fc31fc080 con 0x558fc2e2db60 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f12a4ee9740 10 client.0 _ll_register_callbacks cb 0x558fc2e66090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f129cf11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc3206f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f1297fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e25980 0x558fc3201790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f129cf11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc3206f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54844/0 (socket says 172.21.15.53:54844) 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f129cf11640 1 -- 172.21.15.53:0/483716240 learned_addr learned my addr 172.21.15.53:0/483716240 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f129cf11640 1 -- 172.21.15.53:0/483716240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e2db60 msgr2=0x558fc3201cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f129cf11640 1 --2- 172.21.15.53:0/483716240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e2db60 0x558fc3201cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f129cf11640 1 -- 172.21.15.53:0/483716240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e25980 msgr2=0x558fc3201790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f129cf11640 1 --2- 172.21.15.53:0/483716240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e25980 0x558fc3201790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.771+0000 7f129cf11640 1 -- 172.21.15.53:0/483716240 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fc31162b0 con 0x558fc2e4e840 2024-08-31T06:05:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.772+0000 7f129cf11640 1 --2- 172.21.15.53:0/483716240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc3206f20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1290006010 tx=0x7f1290031bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7026e5a852c5577e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.772+0000 7f12777fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.772+0000 7f12777fe640 1 -- 172.21.15.53:0/483716240 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290057070 con 0x558fc2e4e840 2024-08-31T06:05:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.772+0000 7f12a4ee9740 1 -- 172.21.15.53:0/483716240 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1290036070 con 0x558fc2e4e840 2024-08-31T06:05:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.772+0000 7f12777fe640 1 -- 172.21.15.53:0/483716240 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1290003f00 con 0x558fc2e4e840 2024-08-31T06:05:17.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.772+0000 7f12777fe640 1 -- 172.21.15.53:0/483716240 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1290063050 con 0x558fc2e4e840 2024-08-31T06:05:17.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.772+0000 7f12a4ee9740 10 client.15858 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:17.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.772+0000 7f12a4ee9740 1 -- 172.21.15.53:0/483716240 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558fc2ec8b90 con 0x558fc2e4e840 2024-08-31T06:05:17.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.772+0000 7f12777fe640 1 -- 172.21.15.53:0/483716240 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1290036070 con 0x558fc2e4e840 2024-08-31T06:05:17.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.773+0000 7f12777fe640 1 -- 172.21.15.53:0/483716240 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f129003c410 con 0x558fc2e4e840 2024-08-31T06:05:17.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.773+0000 7f12a4ee9740 10 client.15858 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:17.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.773+0000 7f12a4ee9740 10 client.15858 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:05:17.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.773+0000 7f12a4ee9740 20 client.15858 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:17.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.773+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/483716240 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558fc2e0d1c0 0x558fc321bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.773+0000 7f12a4ee9740 4 client.15858 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:17.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.773+0000 7f12a4ee9740 1 -- 172.21.15.53:0/483716240 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fc316c280 con 0x558fc2e0d1c0 2024-08-31T06:05:17.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.773+0000 7f1297fff640 1 --2- 172.21.15.53:0/483716240 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558fc2e0d1c0 0x558fc321bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.774+0000 7f12777fe640 10 client.15858 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:17.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.774+0000 7f1297fff640 1 --2- 172.21.15.53:0/483716240 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558fc2e0d1c0 0x558fc321bac0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=111d79430792a993 server_cookie=2fcba8c2083ac267 in_seq=0 out_seq=0 2024-08-31T06:05:17.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.775+0000 7f12777fe640 1 -- 172.21.15.53:0/483716240 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558fc316c280 con 0x558fc2e0d1c0 2024-08-31T06:05:17.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.775+0000 7f12777fe640 10 client.15858 handle_command_reply: tid=0 2024-08-31T06:05:17.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.775+0000 7f12a4ee9740 1 client.15858 shutdown 2024-08-31T06:05:17.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.775+0000 7f12a4ee9740 1 -- 172.21.15.53:0/483716240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 msgr2=0x558fc3206f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:17.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.775+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/483716240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc3206f20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1290006010 tx=0x7f1290031bd0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.775+0000 7f12a4ee9740 1 -- 172.21.15.53:0/483716240 shutdown_connections 2024-08-31T06:05:17.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.775+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/483716240 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558fc2e0d1c0 0x558fc321bac0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.776+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/483716240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e4e840 0x558fc3206f20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.776+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/483716240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e2db60 0x558fc3201cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.776+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/483716240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e25980 0x558fc3201790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.776+0000 7f12a4ee9740 1 -- 172.21.15.53:0/483716240 >> 172.21.15.53:0/483716240 conn(0x558fc2e42990 msgr2=0x558fc31f2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:17.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.776+0000 7f12777fe640 0 client.15858 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:17.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.776+0000 7f12a4ee9740 1 -- 172.21.15.53:0/483716240 shutdown_connections 2024-08-31T06:05:17.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.776+0000 7f12a4ee9740 1 -- 172.21.15.53:0/483716240 wait complete. 2024-08-31T06:05:17.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.776+0000 7f12a4ee9740 20 client.15858 trim_cache size 0 max 16384 2024-08-31T06:05:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.794+0000 7f12a4ee9740 1 Processor -- start 2024-08-31T06:05:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.794+0000 7f12a4ee9740 1 -- start start 2024-08-31T06:05:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.794+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e25980 0x558fc31feb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.794+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e2db60 0x558fc31ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.794+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e4e840 0x558fc31f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.794+0000 7f12a4ee9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f12981ad1a0 con 0x558fc2e25980 2024-08-31T06:05:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f1297fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e25980 0x558fc31feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f1297fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e25980 0x558fc31feb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54860/0 (socket says 172.21.15.53:54860) 2024-08-31T06:05:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f1297fff640 1 -- 172.21.15.53:0/3325441681 learned_addr learned my addr 172.21.15.53:0/3325441681 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3325441681 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12981aece0 con 0x558fc2e2db60 2024-08-31T06:05:17.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3325441681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f12981ad870 con 0x558fc2e4e840 2024-08-31T06:05:17.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f12977fe640 1 --2- 172.21.15.53:0/3325441681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e2db60 0x558fc31ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f129cf11640 1 --2- 172.21.15.53:0/3325441681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e4e840 0x558fc31f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f1297fff640 1 -- 172.21.15.53:0/3325441681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e4e840 msgr2=0x558fc31f8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f1297fff640 1 --2- 172.21.15.53:0/3325441681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e4e840 0x558fc31f8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f1297fff640 1 -- 172.21.15.53:0/3325441681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e2db60 msgr2=0x558fc31ff0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f1297fff640 1 --2- 172.21.15.53:0/3325441681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e2db60 0x558fc31ff0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f1297fff640 1 -- 172.21.15.53:0/3325441681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fc3129d90 con 0x558fc2e25980 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.795+0000 7f1297fff640 1 --2- 172.21.15.53:0/3325441681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e25980 0x558fc31feb90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x558fc321c1f0 tx=0x7f1288005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59e94de26087040 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.796+0000 7f127dffb640 1 -- 172.21.15.53:0/3325441681 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288005220 con 0x558fc2e25980 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.796+0000 7f127dffb640 1 -- 172.21.15.53:0/3325441681 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1288004c30 con 0x558fc2e25980 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.796+0000 7f127dffb640 1 -- 172.21.15.53:0/3325441681 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128801d860 con 0x558fc2e25980 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.796+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3325441681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e25980 msgr2=0x558fc31feb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.796+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/3325441681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e25980 0x558fc31feb90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x558fc321c1f0 tx=0x7f1288005f90 comp rx=0 tx=0).stop 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.797+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3325441681 shutdown_connections 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.797+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/3325441681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e4e840 0x558fc31f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.797+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/3325441681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e2db60 0x558fc31ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.797+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/3325441681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e25980 0x558fc31feb90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.797+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3325441681 >> 172.21.15.53:0/3325441681 conn(0x558fc2e42990 msgr2=0x558fc3200010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.797+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3325441681 shutdown_connections 2024-08-31T06:05:17.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.797+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3325441681 wait complete. 2024-08-31T06:05:17.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.798+0000 7f12a4ee9740 1 -- start start 2024-08-31T06:05:17.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.798+0000 7f12a4ee9740 1 Processor -- start 2024-08-31T06:05:17.801 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.798+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 0x558fc31fa170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.798+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e2db60 0x558fc31fa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12a4ee9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e4e840 0x558fc3215db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12a4ee9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f12981ae610 con 0x558fc2e2db60 2024-08-31T06:05:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12a4ee9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12981adf40 con 0x558fc2e4e840 2024-08-31T06:05:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12a4ee9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f12981ab180 con 0x558fc2e25980 2024-08-31T06:05:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12a4ee9740 10 client.0 _ll_register_callbacks cb 0x7f129004b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e2db60 0x558fc31fa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f1297fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 0x558fc31fa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e2db60 0x558fc31fa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54876/0 (socket says 172.21.15.53:54876) 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f1297fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 0x558fc31fa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34286/0 (socket says 172.21.15.53:34286) 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12977fe640 1 -- 172.21.15.53:0/3271821588 learned_addr learned my addr 172.21.15.53:0/3271821588 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12977fe640 1 -- 172.21.15.53:0/3271821588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 msgr2=0x558fc31fa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12977fe640 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 0x558fc31fa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12977fe640 1 -- 172.21.15.53:0/3271821588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e4e840 msgr2=0x558fc3215db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12977fe640 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e4e840 0x558fc3215db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12977fe640 1 -- 172.21.15.53:0/3271821588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fc32162f0 con 0x558fc2e2db60 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f1297fff640 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 0x558fc31fa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12977fe640 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e2db60 0x558fc31fa6b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f128c009610 tx=0x7f128c009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5b44d8249ecd07 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.799+0000 7f12777fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.800+0000 7f12777fe640 1 -- 172.21.15.53:0/3271821588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128c020040 con 0x558fc2e2db60 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.800+0000 7f12777fe640 1 -- 172.21.15.53:0/3271821588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f128c0ce070 con 0x558fc2e2db60 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.800+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3271821588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1288004c30 con 0x558fc2e2db60 2024-08-31T06:05:17.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.800+0000 7f12777fe640 1 -- 172.21.15.53:0/3271821588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f128c0b4080 con 0x558fc2e2db60 2024-08-31T06:05:17.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.800+0000 7f12a4ee9740 10 client.15864 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:17.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.800+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3271821588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558fc3286b70 con 0x558fc2e2db60 2024-08-31T06:05:17.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.801+0000 7f12777fe640 1 -- 172.21.15.53:0/3271821588 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f128c0aafe0 con 0x558fc2e2db60 2024-08-31T06:05:17.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.801+0000 7f12777fe640 1 -- 172.21.15.53:0/3271821588 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f128c0e9040 con 0x558fc2e2db60 2024-08-31T06:05:17.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.801+0000 7f12a4ee9740 10 client.15864 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:17.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.801+0000 7f12a4ee9740 10 client.15864 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:05:17.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.801+0000 7f12a4ee9740 20 client.15864 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:17.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.801+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558fc2de2570 0x558fc3289380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:17.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.802+0000 7f12a4ee9740 4 client.15864 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}] 2024-08-31T06:05:17.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.802+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3271821588 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}) -- 0x7f1288004c30 con 0x558fc2de2570 2024-08-31T06:05:17.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.802+0000 7f1297fff640 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558fc2de2570 0x558fc3289380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:17.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.802+0000 7f12777fe640 10 client.15864 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:17.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.802+0000 7f1297fff640 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558fc2de2570 0x558fc3289380 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d636a391e18e364 server_cookie=c087658d701dd7bb in_seq=0 out_seq=0 2024-08-31T06:05:17.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.815+0000 7f12777fe640 1 -- 172.21.15.53:0/3271821588 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f1288004c30 con 0x558fc2de2570 2024-08-31T06:05:17.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.815+0000 7f12777fe640 10 client.15864 handle_command_reply: tid=0 2024-08-31T06:05:17.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.815+0000 7f12a4ee9740 1 client.15864 shutdown 2024-08-31T06:05:17.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3271821588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e2db60 msgr2=0x558fc31fa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:17.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e2db60 0x558fc31fa6b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f128c009610 tx=0x7f128c009e70 comp rx=0 tx=0).stop 2024-08-31T06:05:17.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3271821588 shutdown_connections 2024-08-31T06:05:17.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558fc2de2570 0x558fc3289380 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558fc2e4e840 0x558fc3215db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fc2e2db60 0x558fc31fa6b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12777fe640 0 client.15864 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:17.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12a4ee9740 1 --2- 172.21.15.53:0/3271821588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fc2e25980 0x558fc31fa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3271821588 >> 172.21.15.53:0/3271821588 conn(0x558fc2e42990 msgr2=0x558fc31feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:17.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3271821588 shutdown_connections 2024-08-31T06:05:17.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12a4ee9740 1 -- 172.21.15.53:0/3271821588 wait complete. 2024-08-31T06:05:17.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.816+0000 7f12a4ee9740 20 client.15864 trim_cache size 0 max 16384 2024-08-31T06:05:17.819 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:05:17.819 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 28, 2024-08-31T06:05:17.819 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 2, 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "b99c59cc": { 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 2, 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 146.4, 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:05:17.820 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:05:17.821 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:05:17.821 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:05:17.821 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:05:17.821 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:05:17.821 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:17.821 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:17.821 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:17.821 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:17.821 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:17.821 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:05:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.817+0000 7f129e974640 1 -- 172.21.15.53:0/1922851106 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f12800b4d20 msgr2=0x7f12800b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.817+0000 7f129e974640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f12800b4d20 0x7f12800b7230 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f129004a000 tx=0x7f129004b000 comp rx=0 tx=0).stop 2024-08-31T06:05:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.817+0000 7f129e974640 1 -- 172.21.15.53:0/1922851106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1298109270 msgr2=0x7f129819a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.817+0000 7f129e974640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1298109270 0x7f129819a670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f129806b870 tx=0x7f128c00db30 comp rx=0 tx=0).stop 2024-08-31T06:05:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.817+0000 7f129e974640 1 -- 172.21.15.53:0/1922851106 shutdown_connections 2024-08-31T06:05:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.817+0000 7f129e974640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f12800b4d20 0x7f12800b7230 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.817+0000 7f129e974640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1298109bc0 0x7f129819f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.817+0000 7f129e974640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1298109270 0x7f129819a670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.817+0000 7f129e974640 1 --2- 172.21.15.53:0/1922851106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1298103930 0x7f129819a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.817+0000 7f129e974640 1 -- 172.21.15.53:0/1922851106 >> 172.21.15.53:0/1922851106 conn(0x7f12980ff380 msgr2=0x7f1298106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.818+0000 7f129e974640 1 -- 172.21.15.53:0/1922851106 shutdown_connections 2024-08-31T06:05:17.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:17.818+0000 7f129e974640 1 -- 172.21.15.53:0/1922851106 wait complete. 2024-08-31T06:05:18.187 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:18 smithi053 ceph-mon[18924]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-08-31T06:05:18.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:18 smithi153 ceph-mon[22320]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-08-31T06:05:18.531 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b99c59cc', quiesce took 7.8 seconds. Will release after: 18.599999999999998 2024-08-31T06:05:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:18 smithi130 ceph-mon[22266]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-08-31T06:05:19.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.053+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/3856263568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc8109bf0 msgr2=0x7f7cc8110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:19.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.053+0000 7f7ccd6cd640 1 --2- 172.21.15.53:0/3856263568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc8109bf0 0x7f7cc8110420 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009ca0 tx=0x7f7cc002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.053+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/3856263568 shutdown_connections 2024-08-31T06:05:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.053+0000 7f7ccd6cd640 1 --2- 172.21.15.53:0/3856263568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc8109bf0 0x7f7cc8110420 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.053+0000 7f7ccd6cd640 1 --2- 172.21.15.53:0/3856263568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cc81092a0 0x7f7cc81096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.053+0000 7f7ccd6cd640 1 --2- 172.21.15.53:0/3856263568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc8101d60 0x7f7cc8102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.054+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/3856263568 >> 172.21.15.53:0/3856263568 conn(0x7f7cc8079d30 msgr2=0x7f7cc807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.054+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/3856263568 shutdown_connections 2024-08-31T06:05:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.054+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/3856263568 wait complete. 2024-08-31T06:05:19.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.055+0000 7f7ccd6cd640 1 Processor -- start 2024-08-31T06:05:19.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.055+0000 7f7ccd6cd640 1 -- start start 2024-08-31T06:05:19.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.056+0000 7f7ccd6cd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cc8101d60 0x7f7cc819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.056+0000 7f7ccd6cd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc81092a0 0x7f7cc819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.056+0000 7f7ccd6cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc8109bf0 0x7f7cc819f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.056+0000 7f7cc6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cc8101d60 0x7f7cc819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.056+0000 7f7cc6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cc8101d60 0x7f7cc819a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34304/0 (socket says 172.21.15.53:34304) 2024-08-31T06:05:19.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.056+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/979144925 learned_addr learned my addr 172.21.15.53:0/979144925 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:19.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.056+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc81092a0 0x7f7cc819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.056+0000 7f7cc77fe640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc8109bf0 0x7f7cc819f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.056+0000 7f7ccd6cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81137b0 con 0x7f7cc8109bf0 2024-08-31T06:05:19.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.056+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/979144925 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc8113630 con 0x7f7cc81092a0 2024-08-31T06:05:19.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.056+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/979144925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc8113930 con 0x7f7cc8101d60 2024-08-31T06:05:19.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.057+0000 7f7cc77fe640 1 -- 172.21.15.53:0/979144925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cc8101d60 msgr2=0x7f7cc819a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:19.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.057+0000 7f7cc77fe640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cc8101d60 0x7f7cc819a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.057+0000 7f7cc77fe640 1 -- 172.21.15.53:0/979144925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc81092a0 msgr2=0x7f7cc819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:19.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.057+0000 7f7cc77fe640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc81092a0 0x7f7cc819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.057+0000 7f7cc77fe640 1 -- 172.21.15.53:0/979144925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc81a0030 con 0x7f7cc8109bf0 2024-08-31T06:05:19.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.057+0000 7f7cc77fe640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc8109bf0 0x7f7cc819f9c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0031040 tx=0x7f7cc0030790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:19.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.058+0000 7f7caffff640 1 -- 172.21.15.53:0/979144925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0031d90 con 0x7f7cc8109bf0 2024-08-31T06:05:19.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.058+0000 7f7caffff640 1 -- 172.21.15.53:0/979144925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cc0040070 con 0x7f7cc8109bf0 2024-08-31T06:05:19.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.058+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/979144925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc81a02c0 con 0x7f7cc8109bf0 2024-08-31T06:05:19.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.058+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/979144925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc81a6b40 con 0x7f7cc8109bf0 2024-08-31T06:05:19.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.058+0000 7f7caffff640 1 -- 172.21.15.53:0/979144925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00047b0 con 0x7f7cc8109bf0 2024-08-31T06:05:19.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.061+0000 7f7cd3c42740 1 Processor -- start 2024-08-31T06:05:19.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.061+0000 7f7caffff640 1 -- 172.21.15.53:0/979144925 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7cc0004040 con 0x7f7cc8109bf0 2024-08-31T06:05:19.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.061+0000 7f7cd3c42740 1 -- start start 2024-08-31T06:05:19.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae20c070 0x55c7ae5b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 0x55c7ae5b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cd3c42740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c7ae528680 con 0x55c7ae1eb390 2024-08-31T06:05:19.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cd3c42740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c7ae517c10 con 0x55c7ae20c070 2024-08-31T06:05:19.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cd3c42740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c7ae51bbc0 con 0x55c7ae1e31b0 2024-08-31T06:05:19.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cc6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cc6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34316/0 (socket says 172.21.15.53:34316) 2024-08-31T06:05:19.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/1470731486 learned_addr learned my addr 172.21.15.53:0/1470731486 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:19.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/1470731486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 0x55c7ae5b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/1470731486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae20c070 msgr2=0x55c7ae5b1350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:05:19.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cc6ffd640 1 --2- 172.21.15.53:0/1470731486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae20c070 0x55c7ae5b1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/1470731486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 msgr2=0x55c7ae5b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:19.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cc6ffd640 1 --2- 172.21.15.53:0/1470731486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 0x55c7ae5b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/1470731486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7ae277650 con 0x55c7ae1e31b0 2024-08-31T06:05:19.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.062+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/1470731486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 0x55c7ae5b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:19.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.063+0000 7f7cc6ffd640 1 --2- 172.21.15.53:0/1470731486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5b1890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800b890 tx=0x7f7cb800bd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d728123632ea9471 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:19.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.063+0000 7f7caffff640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cb00b4d50 0x7f7cb00b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.063+0000 7f7cad7fa640 1 -- 172.21.15.53:0/1470731486 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8003dd0 con 0x55c7ae1e31b0 2024-08-31T06:05:19.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.063+0000 7f7caffff640 1 -- 172.21.15.53:0/979144925 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7cc01065b0 con 0x7f7cc8109bf0 2024-08-31T06:05:19.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.063+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cb00b4d50 0x7f7cb00b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.063+0000 7f7cad7fa640 1 -- 172.21.15.53:0/1470731486 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cb8015070 con 0x55c7ae1e31b0 2024-08-31T06:05:19.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.064+0000 7f7cd3c42740 1 -- 172.21.15.53:0/1470731486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1e31b0 msgr2=0x55c7ae5b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:19.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.064+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/1470731486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5b1890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800b890 tx=0x7f7cb800bd50 comp rx=0 tx=0).stop 2024-08-31T06:05:19.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.065+0000 7f7cd3c42740 1 -- 172.21.15.53:0/1470731486 shutdown_connections 2024-08-31T06:05:19.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.065+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/1470731486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 0x55c7ae5b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.065+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/1470731486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5b1890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.065+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/1470731486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae20c070 0x55c7ae5b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.065+0000 7f7cd3c42740 1 -- 172.21.15.53:0/1470731486 >> 172.21.15.53:0/1470731486 conn(0x55c7ae200460 msgr2=0x55c7ae5af240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:19.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.065+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cb00b4d50 0x7f7cb00b7260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7cc807a6d0 tx=0x7f7cbc00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:19.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.065+0000 7f7cd3c42740 1 -- 172.21.15.53:0/1470731486 shutdown_connections 2024-08-31T06:05:19.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.065+0000 7f7cd3c42740 1 -- 172.21.15.53:0/1470731486 wait complete. 2024-08-31T06:05:19.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.066+0000 7f7cd3c42740 1 -- start start 2024-08-31T06:05:19.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.066+0000 7f7cd3c42740 1 Processor -- start 2024-08-31T06:05:19.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.066+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5bd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.066+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae1eb390 0x55c7ae5c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.066+0000 7f7cc6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5bd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.066+0000 7f7cc6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5bd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54908/0 (socket says 172.21.15.53:54908) 2024-08-31T06:05:19.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.066+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae20c070 0x55c7ae5bd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.066+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/2659759850 learned_addr learned my addr 172.21.15.53:0/2659759850 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.066+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2659759850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c7ae37a700 con 0x55c7ae1e31b0 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.066+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2659759850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c7ae49e750 con 0x55c7ae1eb390 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.066+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2659759850 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c7ae5bbb50 con 0x55c7ae20c070 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.067+0000 7f7cd3c42740 10 client.0 _ll_register_callbacks cb 0x55c7ae4cde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.067+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/2659759850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae20c070 msgr2=0x55c7ae5bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.067+0000 7f7cc6ffd640 1 --2- 172.21.15.53:0/2659759850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae20c070 0x55c7ae5bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.067+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/2659759850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae1eb390 msgr2=0x55c7ae5c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.067+0000 7f7cc6ffd640 1 --2- 172.21.15.53:0/2659759850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae1eb390 0x55c7ae5c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.067+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/2659759850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7ae4d7900 con 0x55c7ae1e31b0 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.067+0000 7f7cc6ffd640 1 --2- 172.21.15.53:0/2659759850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5bd350 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8000c00 tx=0x7f7cb8003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95563315c7116b16 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.067+0000 7f7caaff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.067+0000 7f7caaff5640 1 -- 172.21.15.53:0/2659759850 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb802a060 con 0x55c7ae1e31b0 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.067+0000 7f7caaff5640 1 -- 172.21.15.53:0/2659759850 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7cb8011bd0 con 0x55c7ae1e31b0 2024-08-31T06:05:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.068+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2659759850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cb8015070 con 0x55c7ae1e31b0 2024-08-31T06:05:19.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.068+0000 7f7caaff5640 1 -- 172.21.15.53:0/2659759850 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7cb8011dd0 con 0x55c7ae1e31b0 2024-08-31T06:05:19.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.068+0000 7f7cd3c42740 10 client.15873 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:19.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.068+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2659759850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c7ae5dc930 con 0x55c7ae1e31b0 2024-08-31T06:05:19.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.068+0000 7f7caaff5640 1 -- 172.21.15.53:0/2659759850 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cb801a900 con 0x55c7ae1e31b0 2024-08-31T06:05:19.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.068+0000 7f7caaff5640 1 -- 172.21.15.53:0/2659759850 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7cb8025650 con 0x55c7ae1e31b0 2024-08-31T06:05:19.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.068+0000 7f7cd3c42740 10 client.15873 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:19.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.068+0000 7f7cd3c42740 10 client.15873 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:05:19.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.068+0000 7f7cd3c42740 20 client.15873 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:19.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.068+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/2659759850 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c7ae1ca9f0 0x55c7ae5dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.069+0000 7f7cd3c42740 4 client.15873 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.069+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2659759850 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7cb8015070 con 0x55c7ae1ca9f0 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.069+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/2659759850 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c7ae1ca9f0 0x55c7ae5dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.069+0000 7f7caaff5640 10 client.15873 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.070+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/2659759850 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c7ae1ca9f0 0x55c7ae5dfc90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6884b7a0a055e959 server_cookie=cdf72cab0551ce30 in_seq=0 out_seq=0 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.070+0000 7f7caaff5640 1 -- 172.21.15.53:0/2659759850 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f7cb8015070 con 0x55c7ae1ca9f0 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.070+0000 7f7caaff5640 10 client.15873 handle_command_reply: tid=0 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.070+0000 7f7cd3c42740 1 client.15873 shutdown 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2659759850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 msgr2=0x55c7ae5bd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/2659759850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5bd350 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8000c00 tx=0x7f7cb8003e00 comp rx=0 tx=0).stop 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2659759850 shutdown_connections 2024-08-31T06:05:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/2659759850 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c7ae1ca9f0 0x55c7ae5dfc90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/2659759850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae20c070 0x55c7ae5bd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/2659759850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae1eb390 0x55c7ae5c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/2659759850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5bd350 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2659759850 >> 172.21.15.53:0/2659759850 conn(0x55c7ae200460 msgr2=0x55c7ae5b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:19.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7caaff5640 0 client.15873 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:05:19.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2659759850 shutdown_connections 2024-08-31T06:05:19.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2659759850 wait complete. 2024-08-31T06:05:19.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.071+0000 7f7cd3c42740 20 client.15873 trim_cache size 0 max 16384 2024-08-31T06:05:19.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.096+0000 7f7cd3c42740 1 Processor -- start 2024-08-31T06:05:19.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.096+0000 7f7cd3c42740 1 -- start start 2024-08-31T06:05:19.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5aa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 0x55c7ae5ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae20c070 0x55c7ae5bbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cc67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 0x55c7ae5ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cc67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 0x55c7ae5ba4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54922/0 (socket says 172.21.15.53:54922) 2024-08-31T06:05:19.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cc67fc640 1 -- 172.21.15.53:0/2477868174 learned_addr learned my addr 172.21.15.53:0/2477868174 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:19.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2477868174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81ad110 con 0x55c7ae1eb390 2024-08-31T06:05:19.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2477868174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81aec50 con 0x55c7ae1e31b0 2024-08-31T06:05:19.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2477868174 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81ad7e0 con 0x55c7ae20c070 2024-08-31T06:05:19.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cc6ffd640 1 --2- 172.21.15.53:0/2477868174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cc67fc640 1 -- 172.21.15.53:0/2477868174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae20c070 msgr2=0x55c7ae5bbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:19.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/2477868174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae20c070 0x55c7ae5bbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cc67fc640 1 -- 172.21.15.53:0/2477868174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae1e31b0 msgr2=0x55c7ae5aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:19.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/2477868174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5aa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.097+0000 7f7cc67fc640 1 -- 172.21.15.53:0/2477868174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7ae5bb820 con 0x55c7ae1eb390 2024-08-31T06:05:19.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.098+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/2477868174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 0x55c7ae5ba4d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc00b010 tx=0x7f7cbc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de7184d463dc3c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:19.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.098+0000 7f7cacff9640 1 -- 172.21.15.53:0/2477868174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc01f620 con 0x55c7ae1eb390 2024-08-31T06:05:19.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.098+0000 7f7cacff9640 1 -- 172.21.15.53:0/2477868174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cbc01fc50 con 0x55c7ae1eb390 2024-08-31T06:05:19.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.098+0000 7f7cacff9640 1 -- 172.21.15.53:0/2477868174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc01eb50 con 0x55c7ae1eb390 2024-08-31T06:05:19.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.099+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2477868174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 msgr2=0x55c7ae5ba4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:19.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.099+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/2477868174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 0x55c7ae5ba4d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc00b010 tx=0x7f7cbc014000 comp rx=0 tx=0).stop 2024-08-31T06:05:19.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.099+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2477868174 shutdown_connections 2024-08-31T06:05:19.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.099+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/2477868174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae20c070 0x55c7ae5bbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.099+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/2477868174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1eb390 0x55c7ae5ba4d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.099+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/2477868174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.099+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2477868174 >> 172.21.15.53:0/2477868174 conn(0x55c7ae200460 msgr2=0x55c7ae5b9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:19.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.099+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2477868174 shutdown_connections 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.099+0000 7f7cd3c42740 1 -- 172.21.15.53:0/2477868174 wait complete. 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cd3c42740 1 -- start start 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cd3c42740 1 Processor -- start 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5e10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1eb390 0x55c7ae5e1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cd3c42740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae20c070 0x55c7ae649410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cd3c42740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81ae580 con 0x55c7ae1e31b0 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cd3c42740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81adeb0 con 0x55c7ae20c070 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cd3c42740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81ab0f0 con 0x55c7ae1eb390 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cd3c42740 10 client.0 _ll_register_callbacks cb 0x7f7cb8004530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cc6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5e10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cc6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5e10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54928/0 (socket says 172.21.15.53:54928) 2024-08-31T06:05:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/4138729449 learned_addr learned my addr 172.21.15.53:0/4138729449 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:19.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.100+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1eb390 0x55c7ae5e1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/4138729449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1eb390 msgr2=0x55c7ae5e1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:19.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7cc6ffd640 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1eb390 0x55c7ae5e1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/4138729449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae20c070 msgr2=0x55c7ae649410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:19.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7cc6ffd640 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae20c070 0x55c7ae649410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/4138729449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7ae649950 con 0x55c7ae1e31b0 2024-08-31T06:05:19.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7cc6ffd640 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5e10c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8000c00 tx=0x7f7cb8025610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a097314649edc226 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:19.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7caaff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:19.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7caaff5640 1 -- 172.21.15.53:0/4138729449 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb802a030 con 0x55c7ae1e31b0 2024-08-31T06:05:19.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7caaff5640 1 -- 172.21.15.53:0/4138729449 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7cb8011bd0 con 0x55c7ae1e31b0 2024-08-31T06:05:19.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7cd3c42740 1 -- 172.21.15.53:0/4138729449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cbc01fc50 con 0x55c7ae1e31b0 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7caaff5640 1 -- 172.21.15.53:0/4138729449 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7cb8005070 con 0x55c7ae1e31b0 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7cd3c42740 10 client.15879 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.101+0000 7f7cd3c42740 1 -- 172.21.15.53:0/4138729449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c7ae64aad0 con 0x55c7ae1e31b0 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.102+0000 7f7caaff5640 1 -- 172.21.15.53:0/4138729449 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cbc01fc50 con 0x55c7ae1e31b0 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.102+0000 7f7caaff5640 1 -- 172.21.15.53:0/4138729449 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7cb8004b10 con 0x55c7ae1e31b0 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.102+0000 7f7cd3c42740 10 client.15879 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.102+0000 7f7cd3c42740 10 client.15879 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.102+0000 7f7cd3c42740 20 client.15879 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.102+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c7ae19fda0 0x55c7ae64d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.102+0000 7f7cd3c42740 4 client.15879 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.102+0000 7f7cd3c42740 1 -- 172.21.15.53:0/4138729449 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c7ae52a5d0 con 0x55c7ae19fda0 2024-08-31T06:05:19.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.102+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c7ae19fda0 0x55c7ae64d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.103+0000 7f7caaff5640 10 client.15879 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.103+0000 7f7cc67fc640 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c7ae19fda0 0x55c7ae64d220 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e5ad82ca2e29955 server_cookie=b5fc103317298f9a in_seq=0 out_seq=0 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.103+0000 7f7caaff5640 1 -- 172.21.15.53:0/4138729449 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c7ae52a5d0 con 0x55c7ae19fda0 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.103+0000 7f7caaff5640 10 client.15879 handle_command_reply: tid=0 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.103+0000 7f7cd3c42740 1 client.15879 shutdown 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.103+0000 7f7cd3c42740 1 -- 172.21.15.53:0/4138729449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 msgr2=0x55c7ae5e10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.103+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5e10c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8000c00 tx=0x7f7cb8025610 comp rx=0 tx=0).stop 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.104+0000 7f7cd3c42740 1 -- 172.21.15.53:0/4138729449 shutdown_connections 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.104+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c7ae19fda0 0x55c7ae64d220 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.104+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7ae20c070 0x55c7ae649410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.104+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7ae1eb390 0x55c7ae5e1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.104+0000 7f7caaff5640 0 client.15879 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:05:19.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.104+0000 7f7cd3c42740 1 --2- 172.21.15.53:0/4138729449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7ae1e31b0 0x55c7ae5e10c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.104+0000 7f7cd3c42740 1 -- 172.21.15.53:0/4138729449 >> 172.21.15.53:0/4138729449 conn(0x55c7ae200460 msgr2=0x55c7ae5bbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:19.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.104+0000 7f7cd3c42740 1 -- 172.21.15.53:0/4138729449 shutdown_connections 2024-08-31T06:05:19.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.104+0000 7f7cd3c42740 1 -- 172.21.15.53:0/4138729449 wait complete. 2024-08-31T06:05:19.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.104+0000 7f7cd3c42740 20 client.15879 trim_cache size 0 max 16384 2024-08-31T06:05:19.109 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:05:19.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/979144925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cb00b4d50 msgr2=0x7f7cb00b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:19.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cb00b4d50 0x7f7cb00b7260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7cc807a6d0 tx=0x7f7cbc00a2d0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/979144925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc8109bf0 msgr2=0x7f7cc819f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:19.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc8109bf0 0x7f7cc819f9c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0031040 tx=0x7f7cc0030790 comp rx=0 tx=0).stop 2024-08-31T06:05:19.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/979144925 shutdown_connections 2024-08-31T06:05:19.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cb00b4d50 0x7f7cb00b7260 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc8109bf0 0x7f7cc819f9c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc81092a0 0x7f7cc819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 --2- 172.21.15.53:0/979144925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cc8101d60 0x7f7cc819a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:19.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/979144925 >> 172.21.15.53:0/979144925 conn(0x7f7cc8079d30 msgr2=0x7f7cc8107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:19.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/979144925 shutdown_connections 2024-08-31T06:05:19.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:19.105+0000 7f7ccd6cd640 1 -- 172.21.15.53:0/979144925 wait complete. 2024-08-31T06:05:19.864 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:05:20.178 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:20 smithi153 ceph-mon[22320]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-08-31T06:05:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:20 smithi053 ceph-mon[18924]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-08-31T06:05:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:20 smithi130 ceph-mon[22266]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-08-31T06:05:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.774+0000 7f2509329640 1 -- 172.21.15.53:0/2488957563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25041050a0 msgr2=0x7f250410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.774+0000 7f2509329640 1 --2- 172.21.15.53:0/2488957563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25041050a0 0x7f250410d5f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009900 tx=0x7f24f802a410 comp rx=0 tx=0).stop 2024-08-31T06:05:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.774+0000 7f2509329640 1 -- 172.21.15.53:0/2488957563 shutdown_connections 2024-08-31T06:05:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.774+0000 7f2509329640 1 --2- 172.21.15.53:0/2488957563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f250410dbb0 0x7f25041100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.774+0000 7f2509329640 1 --2- 172.21.15.53:0/2488957563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25041050a0 0x7f250410d5f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.774+0000 7f2509329640 1 --2- 172.21.15.53:0/2488957563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2504104750 0x7f2504104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.774+0000 7f2509329640 1 -- 172.21.15.53:0/2488957563 >> 172.21.15.53:0/2488957563 conn(0x7f25040794d0 msgr2=0x7f25040798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.774+0000 7f2509329640 1 -- 172.21.15.53:0/2488957563 shutdown_connections 2024-08-31T06:05:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.774+0000 7f2509329640 1 -- 172.21.15.53:0/2488957563 wait complete. 2024-08-31T06:05:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.775+0000 7f2509329640 1 Processor -- start 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.775+0000 7f2509329640 1 -- start start 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2509329640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2504104750 0x7f250419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2509329640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25041050a0 0x7f250419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2509329640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f250410dbb0 0x7f250419f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2509329640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2504113680 con 0x7f2504104750 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2509329640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2504113500 con 0x7f25041050a0 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2502ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2504104750 0x7f250419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2509329640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2504113800 con 0x7f250410dbb0 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2502ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2504104750 0x7f250419a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54948/0 (socket says 172.21.15.53:54948) 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2502ffd640 1 -- 172.21.15.53:0/1739677915 learned_addr learned my addr 172.21.15.53:0/1739677915 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f25027fc640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25041050a0 0x7f250419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2502ffd640 1 -- 172.21.15.53:0/1739677915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f250410dbb0 msgr2=0x7f250419f9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T06:05:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2502ffd640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f250410dbb0 0x7f250419f9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2502ffd640 1 -- 172.21.15.53:0/1739677915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25041050a0 msgr2=0x7f250419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.776+0000 7f2502ffd640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25041050a0 0x7f250419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.777+0000 7f2502ffd640 1 -- 172.21.15.53:0/1739677915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25041a0100 con 0x7f2504104750 2024-08-31T06:05:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.777+0000 7f25027fc640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25041050a0 0x7f250419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.777+0000 7f2502ffd640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2504104750 0x7f250419a190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009ae0 tx=0x7f24f400ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.777+0000 7f24ebfff640 1 -- 172.21.15.53:0/1739677915 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4004020 con 0x7f2504104750 2024-08-31T06:05:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.777+0000 7f24ebfff640 1 -- 172.21.15.53:0/1739677915 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24f4007db0 con 0x7f2504104750 2024-08-31T06:05:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.778+0000 7f24ebfff640 1 -- 172.21.15.53:0/1739677915 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4003c00 con 0x7f2504104750 2024-08-31T06:05:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.778+0000 7f2509329640 1 -- 172.21.15.53:0/1739677915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25041a03f0 con 0x7f2504104750 2024-08-31T06:05:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.778+0000 7f2509329640 1 -- 172.21.15.53:0/1739677915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25041a07f0 con 0x7f2504104750 2024-08-31T06:05:20.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.781+0000 7f250f89e740 1 Processor -- start 2024-08-31T06:05:20.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.781+0000 7f250f89e740 1 -- start start 2024-08-31T06:05:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.782+0000 7f250f89e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef90070 0x563c4f335310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.782+0000 7f250f89e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 0x563c4f335850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.782+0000 7f250f89e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef6f390 0x563c4f335d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.782+0000 7f250f89e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c4f2ac680 con 0x563c4ef671b0 2024-08-31T06:05:20.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.782+0000 7f250f89e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563c4f29bc10 con 0x563c4ef6f390 2024-08-31T06:05:20.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.782+0000 7f250f89e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c4f29fbc0 con 0x563c4ef90070 2024-08-31T06:05:20.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.782+0000 7f25027fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef6f390 0x563c4f335d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.782+0000 7f25037fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef90070 0x563c4f335310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.782+0000 7f25027fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef6f390 0x563c4f335d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53190/0 (socket says 172.21.15.53:53190) 2024-08-31T06:05:20.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.782+0000 7f25027fc640 1 -- 172.21.15.53:0/1830544527 learned_addr learned my addr 172.21.15.53:0/1830544527 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:20.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.783+0000 7f24ebfff640 1 -- 172.21.15.53:0/1739677915 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f24f4007920 con 0x7f2504104750 2024-08-31T06:05:20.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.783+0000 7f2502ffd640 1 --2- 172.21.15.53:0/1830544527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 0x563c4f335850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.783+0000 7f25027fc640 1 -- 172.21.15.53:0/1830544527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef90070 msgr2=0x563c4f335310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:20.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.783+0000 7f25027fc640 1 --2- 172.21.15.53:0/1830544527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef90070 0x563c4f335310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.783+0000 7f25027fc640 1 -- 172.21.15.53:0/1830544527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 msgr2=0x563c4f335850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:20.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.783+0000 7f25027fc640 1 --2- 172.21.15.53:0/1830544527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 0x563c4f335850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.783+0000 7f25027fc640 1 -- 172.21.15.53:0/1830544527 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c4effb650 con 0x563c4ef6f390 2024-08-31T06:05:20.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.783+0000 7f2502ffd640 1 --2- 172.21.15.53:0/1830544527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 0x563c4f335850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:20.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.783+0000 7f25027fc640 1 --2- 172.21.15.53:0/1830544527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef6f390 0x563c4f335d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24f8000c00 tx=0x7f24f8032f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efeb3a3338cab3f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:20.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.783+0000 7f24e97fa640 1 -- 172.21.15.53:0/1830544527 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8035040 con 0x563c4ef6f390 2024-08-31T06:05:20.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.784+0000 7f24e97fa640 1 -- 172.21.15.53:0/1830544527 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24f80044c0 con 0x563c4ef6f390 2024-08-31T06:05:20.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.784+0000 7f24e97fa640 1 -- 172.21.15.53:0/1830544527 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8003de0 con 0x563c4ef6f390 2024-08-31T06:05:20.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.784+0000 7f24ebfff640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24ec0b4da0 0x7f24ec0b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.784+0000 7f25037fe640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24ec0b4da0 0x7f24ec0b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.784+0000 7f24ebfff640 1 -- 172.21.15.53:0/1739677915 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f24f40e8b90 con 0x7f2504104750 2024-08-31T06:05:20.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.785+0000 7f250f89e740 1 -- 172.21.15.53:0/1830544527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef6f390 msgr2=0x563c4f335d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:20.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.785+0000 7f250f89e740 1 --2- 172.21.15.53:0/1830544527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef6f390 0x563c4f335d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24f8000c00 tx=0x7f24f8032f70 comp rx=0 tx=0).stop 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.785+0000 7f250f89e740 1 -- 172.21.15.53:0/1830544527 shutdown_connections 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.785+0000 7f250f89e740 1 --2- 172.21.15.53:0/1830544527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef6f390 0x563c4f335d90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.785+0000 7f250f89e740 1 --2- 172.21.15.53:0/1830544527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 0x563c4f335850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.785+0000 7f250f89e740 1 --2- 172.21.15.53:0/1830544527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef90070 0x563c4f335310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.785+0000 7f250f89e740 1 -- 172.21.15.53:0/1830544527 >> 172.21.15.53:0/1830544527 conn(0x563c4ef84460 msgr2=0x563c4f333200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.785+0000 7f250f89e740 1 -- 172.21.15.53:0/1830544527 shutdown_connections 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.785+0000 7f25037fe640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24ec0b4da0 0x7f24ec0b72b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f24fc005fd0 tx=0x7f24fc009520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.785+0000 7f250f89e740 1 -- 172.21.15.53:0/1830544527 wait complete. 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f250f89e740 1 -- start start 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f250f89e740 1 Processor -- start 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f250f89e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 0x563c4f340af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f250f89e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef6f390 0x563c4f341030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f250f89e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef90070 0x563c4f34cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f250f89e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c4f0fe700 con 0x563c4ef671b0 2024-08-31T06:05:20.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f250f89e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563c4f222750 con 0x563c4ef90070 2024-08-31T06:05:20.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f250f89e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c4f343a90 con 0x563c4ef6f390 2024-08-31T06:05:20.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f250f89e740 10 client.0 _ll_register_callbacks cb 0x563c4f251e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:20.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f2502ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 0x563c4f340af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f2502ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 0x563c4f340af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54964/0 (socket says 172.21.15.53:54964) 2024-08-31T06:05:20.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.786+0000 7f2502ffd640 1 -- 172.21.15.53:0/3398516934 learned_addr learned my addr 172.21.15.53:0/3398516934 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:20.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.787+0000 7f25027fc640 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef6f390 0x563c4f341030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.787+0000 7f25037fe640 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef90070 0x563c4f34cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.787+0000 7f2502ffd640 1 -- 172.21.15.53:0/3398516934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef6f390 msgr2=0x563c4f341030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:20.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.787+0000 7f2502ffd640 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef6f390 0x563c4f341030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.787+0000 7f2502ffd640 1 -- 172.21.15.53:0/3398516934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef90070 msgr2=0x563c4f34cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:20.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.787+0000 7f2502ffd640 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef90070 0x563c4f34cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.787+0000 7f2502ffd640 1 -- 172.21.15.53:0/3398516934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c4f25b900 con 0x563c4ef671b0 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.787+0000 7f2502ffd640 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 0x563c4f340af0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f24f40aef20 tx=0x7f24f40aea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954f94c8e22641cd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.787+0000 7f24e6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.788+0000 7f24e6ff5640 1 -- 172.21.15.53:0/3398516934 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f40af220 con 0x563c4ef671b0 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.788+0000 7f250f89e740 1 -- 172.21.15.53:0/3398516934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c4f2ae5d0 con 0x563c4ef671b0 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.788+0000 7f24e6ff5640 1 -- 172.21.15.53:0/3398516934 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f24f40041c0 con 0x563c4ef671b0 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.788+0000 7f24e6ff5640 1 -- 172.21.15.53:0/3398516934 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24f40b3a90 con 0x563c4ef671b0 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.789+0000 7f250f89e740 10 client.15888 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.789+0000 7f250f89e740 1 -- 172.21.15.53:0/3398516934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c4f34f7d0 con 0x563c4ef671b0 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.789+0000 7f24e6ff5640 1 -- 172.21.15.53:0/3398516934 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563c4f2ae5d0 con 0x563c4ef671b0 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.789+0000 7f24e6ff5640 1 -- 172.21.15.53:0/3398516934 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f24f40adef0 con 0x563c4ef671b0 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.789+0000 7f250f89e740 10 client.15888 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.789+0000 7f250f89e740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:20.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.789+0000 7f250f89e740 20 client.15888 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:20.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.790+0000 7f250f89e740 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563c4ef4e9f0 0x563c4f353190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.790+0000 7f250f89e740 4 client.15888 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:20.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.790+0000 7f250f89e740 1 -- 172.21.15.53:0/3398516934 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c4f2aa070 con 0x563c4ef4e9f0 2024-08-31T06:05:20.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.790+0000 7f25027fc640 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563c4ef4e9f0 0x563c4f353190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.790+0000 7f24e6ff5640 10 client.15888 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:20.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.790+0000 7f25027fc640 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563c4ef4e9f0 0x563c4f353190 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d99938ac518c30 server_cookie=57db027d7796517e in_seq=0 out_seq=0 2024-08-31T06:05:20.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.791+0000 7f24e6ff5640 1 -- 172.21.15.53:0/3398516934 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c4f2aa070 con 0x563c4ef4e9f0 2024-08-31T06:05:20.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.791+0000 7f24e6ff5640 10 client.15888 handle_command_reply: tid=0 2024-08-31T06:05:20.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.791+0000 7f250f89e740 1 client.15888 shutdown 2024-08-31T06:05:20.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f250f89e740 1 -- 172.21.15.53:0/3398516934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 msgr2=0x563c4f340af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:20.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f250f89e740 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 0x563c4f340af0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f24f40aef20 tx=0x7f24f40aea50 comp rx=0 tx=0).stop 2024-08-31T06:05:20.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f250f89e740 1 -- 172.21.15.53:0/3398516934 shutdown_connections 2024-08-31T06:05:20.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f250f89e740 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563c4ef4e9f0 0x563c4f353190 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f250f89e740 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef90070 0x563c4f34cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f250f89e740 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef6f390 0x563c4f341030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f24e6ff5640 0 client.15888 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:20.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f250f89e740 1 --2- 172.21.15.53:0/3398516934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef671b0 0x563c4f340af0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f250f89e740 1 -- 172.21.15.53:0/3398516934 >> 172.21.15.53:0/3398516934 conn(0x563c4ef84460 msgr2=0x563c4f3384a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:20.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f250f89e740 1 -- 172.21.15.53:0/3398516934 shutdown_connections 2024-08-31T06:05:20.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f250f89e740 1 -- 172.21.15.53:0/3398516934 wait complete. 2024-08-31T06:05:20.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.792+0000 7f250f89e740 20 client.15888 trim_cache size 0 max 16384 2024-08-31T06:05:20.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.805+0000 7f250f89e740 1 Processor -- start 2024-08-31T06:05:20.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f250f89e740 1 -- start start 2024-08-31T06:05:20.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f250f89e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef4e9f0 0x563c4f338b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f250f89e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef671b0 0x563c4f34cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f250f89e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef6f390 0x563c4f332b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f250f89e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f25041ad320 con 0x563c4ef4e9f0 2024-08-31T06:05:20.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f250f89e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25041aee60 con 0x563c4ef671b0 2024-08-31T06:05:20.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f250f89e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25041ad9f0 con 0x563c4ef6f390 2024-08-31T06:05:20.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f2502ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef4e9f0 0x563c4f338b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f2502ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef4e9f0 0x563c4f338b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54972/0 (socket says 172.21.15.53:54972) 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f25027fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef671b0 0x563c4f34cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f2502ffd640 1 -- 172.21.15.53:0/1837180636 learned_addr learned my addr 172.21.15.53:0/1837180636 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.806+0000 7f25037fe640 1 --2- 172.21.15.53:0/1837180636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef6f390 0x563c4f332b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.807+0000 7f25027fc640 1 -- 172.21.15.53:0/1837180636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef6f390 msgr2=0x563c4f332b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.807+0000 7f25027fc640 1 --2- 172.21.15.53:0/1837180636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef6f390 0x563c4f332b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.807+0000 7f25027fc640 1 -- 172.21.15.53:0/1837180636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef4e9f0 msgr2=0x563c4f338b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.807+0000 7f25027fc640 1 --2- 172.21.15.53:0/1837180636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef4e9f0 0x563c4f338b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.807+0000 7f25027fc640 1 -- 172.21.15.53:0/1837180636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c4f341db0 con 0x563c4ef671b0 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.807+0000 7f2502ffd640 1 --2- 172.21.15.53:0/1837180636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef4e9f0 0x563c4f338b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.807+0000 7f25027fc640 1 --2- 172.21.15.53:0/1837180636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef671b0 0x563c4f34cce0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x563c4f353900 tx=0x7f24f8005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42991fcd9b8aa4d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.807+0000 7f24e8ff9640 1 -- 172.21.15.53:0/1837180636 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8035040 con 0x563c4ef671b0 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.807+0000 7f24e8ff9640 1 -- 172.21.15.53:0/1837180636 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24f8031ca0 con 0x563c4ef671b0 2024-08-31T06:05:20.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.807+0000 7f24e8ff9640 1 -- 172.21.15.53:0/1837180636 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f803c730 con 0x563c4ef671b0 2024-08-31T06:05:20.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.808+0000 7f250f89e740 1 -- 172.21.15.53:0/1837180636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef671b0 msgr2=0x563c4f34cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:20.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.808+0000 7f250f89e740 1 --2- 172.21.15.53:0/1837180636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef671b0 0x563c4f34cce0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x563c4f353900 tx=0x7f24f8005d50 comp rx=0 tx=0).stop 2024-08-31T06:05:20.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.808+0000 7f250f89e740 1 -- 172.21.15.53:0/1837180636 shutdown_connections 2024-08-31T06:05:20.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.808+0000 7f250f89e740 1 --2- 172.21.15.53:0/1837180636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef6f390 0x563c4f332b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.808+0000 7f250f89e740 1 --2- 172.21.15.53:0/1837180636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef671b0 0x563c4f34cce0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.808+0000 7f250f89e740 1 --2- 172.21.15.53:0/1837180636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef4e9f0 0x563c4f338b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.808+0000 7f250f89e740 1 -- 172.21.15.53:0/1837180636 >> 172.21.15.53:0/1837180636 conn(0x563c4ef84460 msgr2=0x563c4f338410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.809+0000 7f250f89e740 1 -- 172.21.15.53:0/1837180636 shutdown_connections 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.809+0000 7f250f89e740 1 -- 172.21.15.53:0/1837180636 wait complete. 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.809+0000 7f250f89e740 1 -- start start 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.809+0000 7f250f89e740 1 Processor -- start 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.809+0000 7f250f89e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef4e9f0 0x563c4f3450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f250f89e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef671b0 0x563c4f3455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f250f89e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef6f390 0x563c4f3bcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f250f89e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f25041ae790 con 0x563c4ef6f390 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f250f89e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25041ae0c0 con 0x563c4ef671b0 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f250f89e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25041ab300 con 0x563c4ef4e9f0 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f25037fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef6f390 0x563c4f3bcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f25037fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef6f390 0x563c4f3bcb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54976/0 (socket says 172.21.15.53:54976) 2024-08-31T06:05:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f250f89e740 10 client.0 _ll_register_callbacks cb 0x7f24f4007780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f25037fe640 1 -- 172.21.15.53:0/1802174374 learned_addr learned my addr 172.21.15.53:0/1802174374 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f2502ffd640 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef4e9f0 0x563c4f3450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f25027fc640 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef671b0 0x563c4f3455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f25037fe640 1 -- 172.21.15.53:0/1802174374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef4e9f0 msgr2=0x563c4f3450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f25037fe640 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef4e9f0 0x563c4f3450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f25037fe640 1 -- 172.21.15.53:0/1802174374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef671b0 msgr2=0x563c4f3455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f25037fe640 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef671b0 0x563c4f3455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.810+0000 7f25037fe640 1 -- 172.21.15.53:0/1802174374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c4f3bd0d0 con 0x563c4ef6f390 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.811+0000 7f25037fe640 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef6f390 0x563c4f3bcb90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f24fc020810 tx=0x7f24fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfc325304a85988 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.811+0000 7f24e6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.811+0000 7f24e6ff5640 1 -- 172.21.15.53:0/1802174374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc011dd0 con 0x563c4ef6f390 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.811+0000 7f24e6ff5640 1 -- 172.21.15.53:0/1802174374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f24fc01e450 con 0x563c4ef6f390 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.811+0000 7f250f89e740 1 -- 172.21.15.53:0/1802174374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24f8031ca0 con 0x563c4ef6f390 2024-08-31T06:05:20.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.811+0000 7f24e6ff5640 1 -- 172.21.15.53:0/1802174374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24fc01e650 con 0x563c4ef6f390 2024-08-31T06:05:20.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.811+0000 7f250f89e740 10 client.15894 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:20.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.811+0000 7f250f89e740 1 -- 172.21.15.53:0/1802174374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c4f3be200 con 0x563c4ef6f390 2024-08-31T06:05:20.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.812+0000 7f24e6ff5640 1 -- 172.21.15.53:0/1802174374 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24fc01ec80 con 0x563c4ef6f390 2024-08-31T06:05:20.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.812+0000 7f24e6ff5640 1 -- 172.21.15.53:0/1802174374 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f24fc027070 con 0x563c4ef6f390 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.812+0000 7f250f89e740 10 client.15894 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.812+0000 7f250f89e740 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.812+0000 7f250f89e740 20 client.15894 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.812+0000 7f250f89e740 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563c4ef90070 0x563c4f3c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.812+0000 7f250f89e740 4 client.15894 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.812+0000 7f250f89e740 1 -- 172.21.15.53:0/1802174374 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f24f8031ca0 con 0x563c4ef90070 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.812+0000 7f2502ffd640 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563c4ef90070 0x563c4f3c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.813+0000 7f24e6ff5640 10 client.15894 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.813+0000 7f2502ffd640 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563c4ef90070 0x563c4f3c0a70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=665ecc3d99ec3387 server_cookie=f9d99bad1394596d in_seq=0 out_seq=0 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.813+0000 7f24e6ff5640 1 -- 172.21.15.53:0/1802174374 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f24f8031ca0 con 0x563c4ef90070 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.813+0000 7f24e6ff5640 10 client.15894 handle_command_reply: tid=0 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.813+0000 7f250f89e740 1 client.15894 shutdown 2024-08-31T06:05:20.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.813+0000 7f250f89e740 1 -- 172.21.15.53:0/1802174374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef6f390 msgr2=0x563c4f3bcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.814+0000 7f250f89e740 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef6f390 0x563c4f3bcb90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f24fc020810 tx=0x7f24fc004a40 comp rx=0 tx=0).stop 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.814+0000 7f250f89e740 1 -- 172.21.15.53:0/1802174374 shutdown_connections 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.814+0000 7f250f89e740 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563c4ef90070 0x563c4f3c0a70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.814+0000 7f250f89e740 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c4ef6f390 0x563c4f3bcb90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.814+0000 7f24e6ff5640 0 client.15894 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.814+0000 7f250f89e740 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c4ef671b0 0x563c4f3455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.814+0000 7f250f89e740 1 --2- 172.21.15.53:0/1802174374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c4ef4e9f0 0x563c4f3450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.814+0000 7f250f89e740 1 -- 172.21.15.53:0/1802174374 >> 172.21.15.53:0/1802174374 conn(0x563c4ef84460 msgr2=0x563c4f332b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.814+0000 7f250f89e740 1 -- 172.21.15.53:0/1802174374 shutdown_connections 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.814+0000 7f250f89e740 1 -- 172.21.15.53:0/1802174374 wait complete. 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.814+0000 7f250f89e740 20 client.15894 trim_cache size 0 max 16384 2024-08-31T06:05:20.819 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:05:20.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.815+0000 7f2509329640 1 -- 172.21.15.53:0/1739677915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24ec0b4da0 msgr2=0x7f24ec0b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:20.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.815+0000 7f2509329640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24ec0b4da0 0x7f24ec0b72b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f24fc005fd0 tx=0x7f24fc009520 comp rx=0 tx=0).stop 2024-08-31T06:05:20.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.815+0000 7f2509329640 1 -- 172.21.15.53:0/1739677915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2504104750 msgr2=0x7f250419a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:20.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.815+0000 7f2509329640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2504104750 0x7f250419a190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009ae0 tx=0x7f24f400ff80 comp rx=0 tx=0).stop 2024-08-31T06:05:20.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.815+0000 7f2509329640 1 -- 172.21.15.53:0/1739677915 shutdown_connections 2024-08-31T06:05:20.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.815+0000 7f2509329640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f24ec0b4da0 0x7f24ec0b72b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.815+0000 7f2509329640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f250410dbb0 0x7f250419f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.815+0000 7f2509329640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25041050a0 0x7f250419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.815+0000 7f2509329640 1 --2- 172.21.15.53:0/1739677915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2504104750 0x7f250419a190 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:20.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.815+0000 7f2509329640 1 -- 172.21.15.53:0/1739677915 >> 172.21.15.53:0/1739677915 conn(0x7f25040794d0 msgr2=0x7f25040ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:20.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.816+0000 7f2509329640 1 -- 172.21.15.53:0/1739677915 shutdown_connections 2024-08-31T06:05:20.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:20.816+0000 7f2509329640 1 -- 172.21.15.53:0/1739677915 wait complete. 2024-08-31T06:05:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:22 smithi153 ceph-mon[22320]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:22 smithi053 ceph-mon[18924]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T06:05:22.534 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:05:22.535 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:05:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:22 smithi130 ceph-mon[22266]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T06:05:22.916 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:23.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.475+0000 7f2735aee640 1 -- 172.21.15.53:0/3099684178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730102010 msgr2=0x7f2730102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:23.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.475+0000 7f2735aee640 1 --2- 172.21.15.53:0/3099684178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730102010 0x7f2730102420 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2720009900 tx=0x7f272002a410 comp rx=0 tx=0).stop 2024-08-31T06:05:23.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.476+0000 7f2735aee640 1 -- 172.21.15.53:0/3099684178 shutdown_connections 2024-08-31T06:05:23.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.476+0000 7f2735aee640 1 --2- 172.21.15.53:0/3099684178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2730108250 0x7f273010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.476+0000 7f2735aee640 1 --2- 172.21.15.53:0/3099684178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2730107900 0x7f2730107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.476+0000 7f2735aee640 1 --2- 172.21.15.53:0/3099684178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730102010 0x7f2730102420 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.476+0000 7f2735aee640 1 -- 172.21.15.53:0/3099684178 >> 172.21.15.53:0/3099684178 conn(0x7f2730077a60 msgr2=0x7f2730077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:23.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.476+0000 7f2735aee640 1 -- 172.21.15.53:0/3099684178 shutdown_connections 2024-08-31T06:05:23.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.476+0000 7f2735aee640 1 -- 172.21.15.53:0/3099684178 wait complete. 2024-08-31T06:05:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.477+0000 7f2735aee640 1 Processor -- start 2024-08-31T06:05:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.477+0000 7f2735aee640 1 -- start start 2024-08-31T06:05:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.477+0000 7f2735aee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730102010 0x7f2730108b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.477+0000 7f2735aee640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2730107900 0x7f27301090b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.477+0000 7f272f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730102010 0x7f2730108b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.477+0000 7f272f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730102010 0x7f2730108b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45750/0 (socket says 172.21.15.53:45750) 2024-08-31T06:05:23.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f272f7fe640 1 -- 172.21.15.53:0/2047137881 learned_addr learned my addr 172.21.15.53:0/2047137881 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:23.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f2735aee640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2730108250 0x7f27301095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f2735aee640 1 -- 172.21.15.53:0/2047137881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2730111590 con 0x7f2730102010 2024-08-31T06:05:23.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f2735aee640 1 -- 172.21.15.53:0/2047137881 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2730111410 con 0x7f2730107900 2024-08-31T06:05:23.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f2735aee640 1 -- 172.21.15.53:0/2047137881 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2730111710 con 0x7f2730108250 2024-08-31T06:05:23.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f272effd640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2730107900 0x7f27301090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f272ffff640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2730108250 0x7f27301095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f272f7fe640 1 -- 172.21.15.53:0/2047137881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2730108250 msgr2=0x7f27301095f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:23.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f272f7fe640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2730108250 0x7f27301095f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f272f7fe640 1 -- 172.21.15.53:0/2047137881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2730107900 msgr2=0x7f27301090b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:23.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f272f7fe640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2730107900 0x7f27301090b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f272f7fe640 1 -- 172.21.15.53:0/2047137881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27301a8540 con 0x7f2730102010 2024-08-31T06:05:23.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.478+0000 7f272effd640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2730107900 0x7f27301090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:23.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.479+0000 7f272f7fe640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730102010 0x7f2730108b70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f272002a930 tx=0x7f2720003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:23.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.479+0000 7f272cff9640 1 -- 172.21.15.53:0/2047137881 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272003f070 con 0x7f2730102010 2024-08-31T06:05:23.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.479+0000 7f272cff9640 1 -- 172.21.15.53:0/2047137881 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2720003e40 con 0x7f2730102010 2024-08-31T06:05:23.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.479+0000 7f2735aee640 1 -- 172.21.15.53:0/2047137881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27301a87d0 con 0x7f2730102010 2024-08-31T06:05:23.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.479+0000 7f272cff9640 1 -- 172.21.15.53:0/2047137881 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720035030 con 0x7f2730102010 2024-08-31T06:05:23.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.480+0000 7f2735aee640 1 -- 172.21.15.53:0/2047137881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27301a8d00 con 0x7f2730102010 2024-08-31T06:05:23.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.482+0000 7f272cff9640 1 -- 172.21.15.53:0/2047137881 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2720042070 con 0x7f2730102010 2024-08-31T06:05:23.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.483+0000 7f273c063740 1 Processor -- start 2024-08-31T06:05:23.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.483+0000 7f273c063740 1 -- start start 2024-08-31T06:05:23.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.483+0000 7f272cff9640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27180b4d20 0x7f27180b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f273c063740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980d13350 0x5599810b9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f273c063740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cea490 0x5599810b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f273c063740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 0x5599810ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f272ffff640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27180b4d20 0x7f27180b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f273c063740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55998102f5f0 con 0x559980cf2670 2024-08-31T06:05:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f273c063740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55998101eb80 con 0x559980d13350 2024-08-31T06:05:23.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f273c063740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559981022b30 con 0x559980cea490 2024-08-31T06:05:23.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f272cff9640 1 -- 172.21.15.53:0/2047137881 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2720105ee0 con 0x7f2730102010 2024-08-31T06:05:23.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f272ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 0x5599810ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f272ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 0x5599810ba200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45764/0 (socket says 172.21.15.53:45764) 2024-08-31T06:05:23.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f272ffff640 1 -- 172.21.15.53:0/171200313 learned_addr learned my addr 172.21.15.53:0/171200313 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:23.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f272f7fe640 1 --2- 172.21.15.53:0/171200313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980d13350 0x5599810b9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f272effd640 1 --2- 172.21.15.53:0/171200313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cea490 0x5599810b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f272effd640 1 -- 172.21.15.53:0/171200313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980d13350 msgr2=0x5599810b9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f272effd640 1 --2- 172.21.15.53:0/171200313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980d13350 0x5599810b9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f272effd640 1 -- 172.21.15.53:0/171200313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 msgr2=0x5599810ba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.484+0000 7f272effd640 1 --2- 172.21.15.53:0/171200313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 0x5599810ba200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.485+0000 7f272effd640 1 -- 172.21.15.53:0/171200313 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559980d7e930 con 0x559980cea490 2024-08-31T06:05:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.485+0000 7f272ffff640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27180b4d20 0x7f27180b7230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f272800aa60 tx=0x7f272800ac50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.485+0000 7f272effd640 1 --2- 172.21.15.53:0/171200313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cea490 0x5599810b9cc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2724005fd0 tx=0x7f2724010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dd80d466f40b335 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.485+0000 7f2715ffb640 1 -- 172.21.15.53:0/171200313 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272401c680 con 0x559980cea490 2024-08-31T06:05:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.485+0000 7f2715ffb640 1 -- 172.21.15.53:0/171200313 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27240118d0 con 0x559980cea490 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.485+0000 7f2715ffb640 1 -- 172.21.15.53:0/171200313 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272401a880 con 0x559980cea490 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.486+0000 7f273c063740 1 -- 172.21.15.53:0/171200313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cea490 msgr2=0x5599810b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.486+0000 7f273c063740 1 --2- 172.21.15.53:0/171200313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cea490 0x5599810b9cc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2724005fd0 tx=0x7f2724010860 comp rx=0 tx=0).stop 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.486+0000 7f273c063740 1 -- 172.21.15.53:0/171200313 shutdown_connections 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.486+0000 7f273c063740 1 --2- 172.21.15.53:0/171200313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 0x5599810ba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.486+0000 7f273c063740 1 --2- 172.21.15.53:0/171200313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cea490 0x5599810b9cc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.486+0000 7f273c063740 1 --2- 172.21.15.53:0/171200313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980d13350 0x5599810b9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.486+0000 7f273c063740 1 -- 172.21.15.53:0/171200313 >> 172.21.15.53:0/171200313 conn(0x559980d07740 msgr2=0x5599810b7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.486+0000 7f273c063740 1 -- 172.21.15.53:0/171200313 shutdown_connections 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.487+0000 7f273c063740 1 -- 172.21.15.53:0/171200313 wait complete. 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.487+0000 7f273c063740 1 -- start start 2024-08-31T06:05:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.487+0000 7f273c063740 1 Processor -- start 2024-08-31T06:05:23.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f273c063740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980cea490 0x5599810c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f273c063740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cf2670 0x5599810c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f273c063740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980d13350 0x5599810d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f273c063740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559980e81890 con 0x559980d13350 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f273c063740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559980fa5790 con 0x559980cea490 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f273c063740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5599810c7f60 con 0x559980cf2670 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f273c063740 10 client.0 _ll_register_callbacks cb 0x559980d2aba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f272effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cf2670 0x5599810c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f272ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980d13350 0x5599810d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f272ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980d13350 0x5599810d1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45774/0 (socket says 172.21.15.53:45774) 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f272ffff640 1 -- 172.21.15.53:0/280512055 learned_addr learned my addr 172.21.15.53:0/280512055 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f272f7fe640 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980cea490 0x5599810c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f272ffff640 1 -- 172.21.15.53:0/280512055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cf2670 msgr2=0x5599810c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f272ffff640 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cf2670 0x5599810c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f272ffff640 1 -- 172.21.15.53:0/280512055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980cea490 msgr2=0x5599810c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f272ffff640 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980cea490 0x5599810c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f272ffff640 1 -- 172.21.15.53:0/280512055 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559980fdcf30 con 0x559980d13350 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.488+0000 7f272f7fe640 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980cea490 0x5599810c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.489+0000 7f272ffff640 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980d13350 0x5599810d1280 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f272800aa30 tx=0x7f2728004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1064576215edd01 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.489+0000 7f270effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.489+0000 7f270effd640 1 -- 172.21.15.53:0/280512055 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728017040 con 0x559980d13350 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.489+0000 7f270effd640 1 -- 172.21.15.53:0/280512055 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2728027610 con 0x559980d13350 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.489+0000 7f273c063740 1 -- 172.21.15.53:0/280512055 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27240118d0 con 0x559980d13350 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.489+0000 7f270effd640 1 -- 172.21.15.53:0/280512055 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2728027810 con 0x559980d13350 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.489+0000 7f273c063740 10 client.15906 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.489+0000 7f273c063740 1 -- 172.21.15.53:0/280512055 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5599810d3d00 con 0x559980d13350 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.490+0000 7f270effd640 1 -- 172.21.15.53:0/280512055 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27240118d0 con 0x559980d13350 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.490+0000 7f270effd640 1 -- 172.21.15.53:0/280512055 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f272800b040 con 0x559980d13350 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.490+0000 7f273c063740 10 client.15906 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.490+0000 7f273c063740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.490+0000 7f273c063740 20 client.15906 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.490+0000 7f273c063740 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559980cd1cd0 0x5599810d72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.490+0000 7f273c063740 4 client.15906 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.490+0000 7f273c063740 1 -- 172.21.15.53:0/280512055 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559981031540 con 0x559980cd1cd0 2024-08-31T06:05:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.490+0000 7f272f7fe640 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559980cd1cd0 0x5599810d72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.491+0000 7f270effd640 10 client.15906 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.491+0000 7f272f7fe640 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559980cd1cd0 0x5599810d72b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b6fa5738ff15246 server_cookie=eb14d0561aa3fe21 in_seq=0 out_seq=0 2024-08-31T06:05:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f270effd640 1 -- 172.21.15.53:0/280512055 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559981031540 con 0x559980cd1cd0 2024-08-31T06:05:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f270effd640 10 client.15906 handle_command_reply: tid=0 2024-08-31T06:05:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f273c063740 1 client.15906 shutdown 2024-08-31T06:05:23.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f273c063740 1 -- 172.21.15.53:0/280512055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980d13350 msgr2=0x5599810d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:23.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f273c063740 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980d13350 0x5599810d1280 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f272800aa30 tx=0x7f2728004ab0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f273c063740 1 -- 172.21.15.53:0/280512055 shutdown_connections 2024-08-31T06:05:23.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f273c063740 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559980cd1cd0 0x5599810d72b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f270effd640 0 client.15906 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:23.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f273c063740 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980d13350 0x5599810d1280 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f273c063740 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cf2670 0x5599810c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f273c063740 1 --2- 172.21.15.53:0/280512055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980cea490 0x5599810c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f273c063740 1 -- 172.21.15.53:0/280512055 >> 172.21.15.53:0/280512055 conn(0x559980d07740 msgr2=0x5599810bc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:23.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f273c063740 1 -- 172.21.15.53:0/280512055 shutdown_connections 2024-08-31T06:05:23.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.492+0000 7f273c063740 1 -- 172.21.15.53:0/280512055 wait complete. 2024-08-31T06:05:23.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.493+0000 7f273c063740 20 client.15906 trim_cache size 0 max 16384 2024-08-31T06:05:23.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.510+0000 7f273c063740 1 Processor -- start 2024-08-31T06:05:23.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.510+0000 7f273c063740 1 -- start start 2024-08-31T06:05:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.511+0000 7f273c063740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cea490 0x5599810c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.511+0000 7f273c063740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980cf2670 0x5599810d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.511+0000 7f272f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cea490 0x5599810c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.511+0000 7f272f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cea490 0x5599810c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45784/0 (socket says 172.21.15.53:45784) 2024-08-31T06:05:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.511+0000 7f272f7fe640 1 -- 172.21.15.53:0/1975339805 learned_addr learned my addr 172.21.15.53:0/1975339805 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.511+0000 7f273c063740 1 --2- 172.21.15.53:0/1975339805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980d13350 0x5599810c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.511+0000 7f273c063740 1 -- 172.21.15.53:0/1975339805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f27301b16e0 con 0x559980cea490 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.511+0000 7f273c063740 1 -- 172.21.15.53:0/1975339805 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27301b3220 con 0x559980cf2670 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.511+0000 7f273c063740 1 -- 172.21.15.53:0/1975339805 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f27301b1db0 con 0x559980d13350 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.511+0000 7f272effd640 1 --2- 172.21.15.53:0/1975339805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980cf2670 0x5599810d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.511+0000 7f272ffff640 1 --2- 172.21.15.53:0/1975339805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980d13350 0x5599810c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.512+0000 7f272f7fe640 1 -- 172.21.15.53:0/1975339805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980d13350 msgr2=0x5599810c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.512+0000 7f272f7fe640 1 --2- 172.21.15.53:0/1975339805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980d13350 0x5599810c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.512+0000 7f272f7fe640 1 -- 172.21.15.53:0/1975339805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980cf2670 msgr2=0x5599810d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.512+0000 7f272f7fe640 1 --2- 172.21.15.53:0/1975339805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980cf2670 0x5599810d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.512+0000 7f272f7fe640 1 -- 172.21.15.53:0/1975339805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599810b7f60 con 0x559980cea490 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.512+0000 7f272f7fe640 1 --2- 172.21.15.53:0/1975339805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cea490 0x5599810c6ac0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2720103690 tx=0x7f2720009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e5a47fe5906694 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.512+0000 7f27157fa640 1 -- 172.21.15.53:0/1975339805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720049040 con 0x559980cea490 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.512+0000 7f27157fa640 1 -- 172.21.15.53:0/1975339805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27200d58f0 con 0x559980cea490 2024-08-31T06:05:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.512+0000 7f27157fa640 1 -- 172.21.15.53:0/1975339805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27200cc8e0 con 0x559980cea490 2024-08-31T06:05:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.513+0000 7f273c063740 1 -- 172.21.15.53:0/1975339805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cea490 msgr2=0x5599810c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.513+0000 7f273c063740 1 --2- 172.21.15.53:0/1975339805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cea490 0x5599810c6ac0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2720103690 tx=0x7f2720009260 comp rx=0 tx=0).stop 2024-08-31T06:05:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.513+0000 7f273c063740 1 -- 172.21.15.53:0/1975339805 shutdown_connections 2024-08-31T06:05:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.513+0000 7f273c063740 1 --2- 172.21.15.53:0/1975339805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980d13350 0x5599810c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.513+0000 7f273c063740 1 --2- 172.21.15.53:0/1975339805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980cf2670 0x5599810d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.513+0000 7f273c063740 1 --2- 172.21.15.53:0/1975339805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cea490 0x5599810c6ac0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.513+0000 7f273c063740 1 -- 172.21.15.53:0/1975339805 >> 172.21.15.53:0/1975339805 conn(0x559980d07740 msgr2=0x5599810c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.514+0000 7f273c063740 1 -- 172.21.15.53:0/1975339805 shutdown_connections 2024-08-31T06:05:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.514+0000 7f273c063740 1 -- 172.21.15.53:0/1975339805 wait complete. 2024-08-31T06:05:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.514+0000 7f273c063740 1 -- start start 2024-08-31T06:05:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.514+0000 7f273c063740 1 Processor -- start 2024-08-31T06:05:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f273c063740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cea490 0x5599810c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f273c063740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 0x5599810ca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f273c063740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980d13350 0x559981149480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f273c063740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f27301b2b50 con 0x559980cf2670 2024-08-31T06:05:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f273c063740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27301b2480 con 0x559980d13350 2024-08-31T06:05:23.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f273c063740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f27301af6c0 con 0x559980cea490 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f273c063740 10 client.0 _ll_register_callbacks cb 0x7f272800e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f272effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 0x5599810ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f272effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 0x5599810ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45786/0 (socket says 172.21.15.53:45786) 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f272effd640 1 -- 172.21.15.53:0/479371176 learned_addr learned my addr 172.21.15.53:0/479371176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f272ffff640 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980d13350 0x559981149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.515+0000 7f272f7fe640 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cea490 0x5599810c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.516+0000 7f272ffff640 1 -- 172.21.15.53:0/479371176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cea490 msgr2=0x5599810c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.516+0000 7f272ffff640 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cea490 0x5599810c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.516+0000 7f272ffff640 1 -- 172.21.15.53:0/479371176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 msgr2=0x5599810ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.516+0000 7f272ffff640 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 0x5599810ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.516+0000 7f272ffff640 1 -- 172.21.15.53:0/479371176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559981149af0 con 0x559980d13350 2024-08-31T06:05:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.516+0000 7f272effd640 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 0x5599810ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.516+0000 7f272ffff640 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980d13350 0x559981149480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2728030ab0 tx=0x7f2728030690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af2419f119b89381 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.516+0000 7f270effd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.516+0000 7f270effd640 1 -- 172.21.15.53:0/479371176 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272803e030 con 0x559980d13350 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.516+0000 7f273c063740 1 -- 172.21.15.53:0/479371176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27200d58f0 con 0x559980d13350 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.516+0000 7f270effd640 1 -- 172.21.15.53:0/479371176 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2728027bc0 con 0x559980d13350 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.517+0000 7f270effd640 1 -- 172.21.15.53:0/479371176 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2728048050 con 0x559980d13350 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.517+0000 7f273c063740 10 client.25415 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.517+0000 7f273c063740 1 -- 172.21.15.53:0/479371176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559981139c30 con 0x559980d13350 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.517+0000 7f270effd640 1 -- 172.21.15.53:0/479371176 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27200d58f0 con 0x559980d13350 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.517+0000 7f270effd640 1 -- 172.21.15.53:0/479371176 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2728039050 con 0x559980d13350 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.517+0000 7f273c063740 10 client.25415 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.517+0000 7f273c063740 10 client.25415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.517+0000 7f273c063740 20 client.25415 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:23.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.517+0000 7f273c063740 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559980ca7080 0x55998113c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:23.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.517+0000 7f273c063740 4 client.25415 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:05:23.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.517+0000 7f273c063740 1 -- 172.21.15.53:0/479371176 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55998102cfe0 con 0x559980ca7080 2024-08-31T06:05:23.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.518+0000 7f272f7fe640 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559980ca7080 0x55998113c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:23.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.518+0000 7f270effd640 10 client.25415 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.518+0000 7f272f7fe640 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559980ca7080 0x55998113c470 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e641ca8eb9af3703 server_cookie=33ab890836b5ae42 in_seq=0 out_seq=0 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f270effd640 1 -- 172.21.15.53:0/479371176 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55998102cfe0 con 0x559980ca7080 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f270effd640 10 client.25415 handle_command_reply: tid=0 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 1 client.25415 shutdown 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 1 -- 172.21.15.53:0/479371176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980d13350 msgr2=0x559981149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980d13350 0x559981149480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2728030ab0 tx=0x7f2728030690 comp rx=0 tx=0).stop 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 1 -- 172.21.15.53:0/479371176 shutdown_connections 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559980ca7080 0x55998113c470 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f270effd640 0 client.25415 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559980d13350 0x559981149480 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559980cf2670 0x5599810ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 1 --2- 172.21.15.53:0/479371176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559980cea490 0x5599810c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 1 -- 172.21.15.53:0/479371176 >> 172.21.15.53:0/479371176 conn(0x559980d07740 msgr2=0x5599810c6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:23.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 1 -- 172.21.15.53:0/479371176 shutdown_connections 2024-08-31T06:05:23.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 1 -- 172.21.15.53:0/479371176 wait complete. 2024-08-31T06:05:23.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.520+0000 7f273c063740 20 client.25415 trim_cache size 0 max 16384 2024-08-31T06:05:23.524 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:05:23.524 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:05:23.524 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "0a265333-0ba8-49b6-b77e-feff777f1223", 2024-08-31T06:05:23.524 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:05:23.524 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:05:23.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.521+0000 7f2735aee640 1 -- 172.21.15.53:0/2047137881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27180b4d20 msgr2=0x7f27180b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:23.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.521+0000 7f2735aee640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27180b4d20 0x7f27180b7230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f272800aa60 tx=0x7f272800ac50 comp rx=0 tx=0).stop 2024-08-31T06:05:23.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.521+0000 7f2735aee640 1 -- 172.21.15.53:0/2047137881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730102010 msgr2=0x7f2730108b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:23.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.521+0000 7f2735aee640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730102010 0x7f2730108b70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f272002a930 tx=0x7f2720003b90 comp rx=0 tx=0).stop 2024-08-31T06:05:23.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.521+0000 7f2735aee640 1 -- 172.21.15.53:0/2047137881 shutdown_connections 2024-08-31T06:05:23.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.521+0000 7f2735aee640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27180b4d20 0x7f27180b7230 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.521+0000 7f2735aee640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2730108250 0x7f27301095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.521+0000 7f2735aee640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2730107900 0x7f27301090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.521+0000 7f2735aee640 1 --2- 172.21.15.53:0/2047137881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730102010 0x7f2730108b70 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:23.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.521+0000 7f2735aee640 1 -- 172.21.15.53:0/2047137881 >> 172.21.15.53:0/2047137881 conn(0x7f2730077a60 msgr2=0x7f27301058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:23.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.522+0000 7f2735aee640 1 -- 172.21.15.53:0/2047137881 shutdown_connections 2024-08-31T06:05:23.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:23.522+0000 7f2735aee640 1 -- 172.21.15.53:0/2047137881 wait complete. 2024-08-31T06:05:24.356 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:24 smithi053 ceph-mon[18924]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T06:05:24.356 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:24 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:05:24.356 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:24 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:05:24.356 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:24 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:05:24.356 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:24 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:05:24.357 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:05:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:24 smithi153 ceph-mon[22320]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T06:05:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:24 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:05:24.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:24 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:05:24.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:24 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:05:24.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:24 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:05:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:24 smithi130 ceph-mon[22266]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T06:05:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:24 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:05:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:24 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:05:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:24 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:05:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:24 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:05:24.630 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:25.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.169+0000 7f139ccea640 1 -- 172.21.15.53:0/2346289432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1398102800 msgr2=0x7f1398102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.169+0000 7f139ccea640 1 --2- 172.21.15.53:0/2346289432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1398102800 0x7f1398102c10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1388009900 tx=0x7f138802a410 comp rx=0 tx=0).stop 2024-08-31T06:05:25.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.169+0000 7f139ccea640 1 -- 172.21.15.53:0/2346289432 shutdown_connections 2024-08-31T06:05:25.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.169+0000 7f139ccea640 1 --2- 172.21.15.53:0/2346289432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1398108a90 0x7f139810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.169+0000 7f139ccea640 1 --2- 172.21.15.53:0/2346289432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1398108140 0x7f1398108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.169+0000 7f139ccea640 1 --2- 172.21.15.53:0/2346289432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1398102800 0x7f1398102c10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.169+0000 7f139ccea640 1 -- 172.21.15.53:0/2346289432 >> 172.21.15.53:0/2346289432 conn(0x7f13980794d0 msgr2=0x7f13980798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.169+0000 7f139ccea640 1 -- 172.21.15.53:0/2346289432 shutdown_connections 2024-08-31T06:05:25.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.169+0000 7f139ccea640 1 -- 172.21.15.53:0/2346289432 wait complete. 2024-08-31T06:05:25.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.170+0000 7f139ccea640 1 Processor -- start 2024-08-31T06:05:25.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.170+0000 7f139ccea640 1 -- start start 2024-08-31T06:05:25.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.171+0000 7f139ccea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1398102800 0x7f13981990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.171+0000 7f139ccea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1398108140 0x7f1398199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.171+0000 7f139ccea640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1398108a90 0x7f139819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.171+0000 7f139ccea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13981125a0 con 0x7f1398108140 2024-08-31T06:05:25.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.171+0000 7f139ccea640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1398112420 con 0x7f1398102800 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.171+0000 7f139ccea640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1398112720 con 0x7f1398108a90 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.171+0000 7f1395d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1398108140 0x7f1398199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.171+0000 7f1395d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1398108140 0x7f1398199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45796/0 (socket says 172.21.15.53:45796) 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.171+0000 7f1395d9b640 1 -- 172.21.15.53:0/3544823332 learned_addr learned my addr 172.21.15.53:0/3544823332 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.171+0000 7f139659c640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1398102800 0x7f13981990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.171+0000 7f1396d9d640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1398108a90 0x7f139819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.172+0000 7f1395d9b640 1 -- 172.21.15.53:0/3544823332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1398108a90 msgr2=0x7f139819e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.172+0000 7f1395d9b640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1398108a90 0x7f139819e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.172+0000 7f1395d9b640 1 -- 172.21.15.53:0/3544823332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1398102800 msgr2=0x7f13981990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.172+0000 7f1395d9b640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1398102800 0x7f13981990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.172+0000 7f1395d9b640 1 -- 172.21.15.53:0/3544823332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139819ef80 con 0x7f1398108140 2024-08-31T06:05:25.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.172+0000 7f1395d9b640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1398108140 0x7f1398199670 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f138c007b50 tx=0x7f138c00e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.172+0000 7f13877fe640 1 -- 172.21.15.53:0/3544823332 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c007e40 con 0x7f1398108140 2024-08-31T06:05:25.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.172+0000 7f139ccea640 1 -- 172.21.15.53:0/3544823332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139819f270 con 0x7f1398108140 2024-08-31T06:05:25.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.172+0000 7f13877fe640 1 -- 172.21.15.53:0/3544823332 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f138c004030 con 0x7f1398108140 2024-08-31T06:05:25.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.172+0000 7f13877fe640 1 -- 172.21.15.53:0/3544823332 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c003930 con 0x7f1398108140 2024-08-31T06:05:25.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.173+0000 7f139ccea640 1 -- 172.21.15.53:0/3544823332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139806ac00 con 0x7f1398108140 2024-08-31T06:05:25.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.175+0000 7f13a325f740 1 Processor -- start 2024-08-31T06:05:25.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.176+0000 7f13a325f740 1 -- start start 2024-08-31T06:05:25.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.176+0000 7f13a325f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331919300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.176+0000 7f13a325f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x559331919840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.176+0000 7f13a325f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x559331919d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.176+0000 7f13a325f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559331890630 con 0x559331553390 2024-08-31T06:05:25.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.176+0000 7f13a325f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55933187fbc0 con 0x55933154b1b0 2024-08-31T06:05:25.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.176+0000 7f13a325f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559331883b70 con 0x559331574070 2024-08-31T06:05:25.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.176+0000 7f139659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x559331919840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.176+0000 7f1396d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331919300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.176+0000 7f1396d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331919300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:53564/0 (socket says 172.21.15.53:53564) 2024-08-31T06:05:25.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.176+0000 7f1396d9d640 1 -- 172.21.15.53:0/2682406017 learned_addr learned my addr 172.21.15.53:0/2682406017 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:25.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.177+0000 7f13877fe640 1 -- 172.21.15.53:0/3544823332 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f138c0041e0 con 0x7f1398108140 2024-08-31T06:05:25.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.177+0000 7f1396d9d640 1 -- 172.21.15.53:0/2682406017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 msgr2=0x559331919840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.177+0000 7f1396d9d640 1 --2- 172.21.15.53:0/2682406017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x559331919840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.177+0000 7f1396d9d640 1 -- 172.21.15.53:0/2682406017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 msgr2=0x559331919d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:05:25.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.178+0000 7f13877fe640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13800b4cd0 0x7f13800b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.178+0000 7f1395d9b640 1 --2- 172.21.15.53:0/2682406017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x559331919d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.178+0000 7f1396d9d640 1 --2- 172.21.15.53:0/2682406017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x559331919d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.178+0000 7f1396d9d640 1 -- 172.21.15.53:0/2682406017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593315df650 con 0x559331574070 2024-08-31T06:05:25.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.178+0000 7f1395d9b640 1 --2- 172.21.15.53:0/2682406017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x559331919d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:25.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.178+0000 7f139659c640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13800b4cd0 0x7f13800b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.178+0000 7f13877fe640 1 -- 172.21.15.53:0/3544823332 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f138c0e4e30 con 0x7f1398108140 2024-08-31T06:05:25.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.178+0000 7f1396d9d640 1 --2- 172.21.15.53:0/2682406017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331919300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1390005f40 tx=0x7f1390003eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aff2c5c417633853 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.179+0000 7f139659c640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13800b4cd0 0x7f13800b71e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f13880057c0 tx=0x7f13880058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.179+0000 7f1384ff9640 1 -- 172.21.15.53:0/2682406017 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390009520 con 0x559331574070 2024-08-31T06:05:25.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.179+0000 7f1384ff9640 1 -- 172.21.15.53:0/2682406017 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f139001e070 con 0x559331574070 2024-08-31T06:05:25.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.180+0000 7f1384ff9640 1 -- 172.21.15.53:0/2682406017 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390019ae0 con 0x559331574070 2024-08-31T06:05:25.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.180+0000 7f13a325f740 1 -- 172.21.15.53:0/2682406017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 msgr2=0x559331919300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.180+0000 7f13a325f740 1 --2- 172.21.15.53:0/2682406017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331919300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1390005f40 tx=0x7f1390003eb0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.180+0000 7f13a325f740 1 -- 172.21.15.53:0/2682406017 shutdown_connections 2024-08-31T06:05:25.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.180+0000 7f13a325f740 1 --2- 172.21.15.53:0/2682406017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x559331919d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.180+0000 7f13a325f740 1 --2- 172.21.15.53:0/2682406017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x559331919840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.180+0000 7f13a325f740 1 --2- 172.21.15.53:0/2682406017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331919300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.180+0000 7f13a325f740 1 -- 172.21.15.53:0/2682406017 >> 172.21.15.53:0/2682406017 conn(0x559331568460 msgr2=0x5593319171f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.180+0000 7f13a325f740 1 -- 172.21.15.53:0/2682406017 shutdown_connections 2024-08-31T06:05:25.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.180+0000 7f13a325f740 1 -- 172.21.15.53:0/2682406017 wait complete. 2024-08-31T06:05:25.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.181+0000 7f13a325f740 1 -- start start 2024-08-31T06:05:25.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.181+0000 7f13a325f740 1 Processor -- start 2024-08-31T06:05:25.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.181+0000 7f13a325f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x559331924a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.181+0000 7f13a325f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x559331924fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.181+0000 7f13a325f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331930e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f13a325f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5593316e2700 con 0x559331553390 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f13a325f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559331806700 con 0x55933154b1b0 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f13a325f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559331927b30 con 0x559331574070 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f13a325f740 10 client.0 _ll_register_callbacks cb 0x559331835dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f139659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x559331924a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f139659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x559331924a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:59786/0 (socket says 172.21.15.53:59786) 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f1395d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x559331924fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f139659c640 1 -- 172.21.15.53:0/2576011535 learned_addr learned my addr 172.21.15.53:0/2576011535 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f1396d9d640 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331930e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f139659c640 1 -- 172.21.15.53:0/2576011535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 msgr2=0x559331930e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f139659c640 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331930e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f139659c640 1 -- 172.21.15.53:0/2576011535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 msgr2=0x559331924fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f139659c640 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x559331924fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f139659c640 1 -- 172.21.15.53:0/2576011535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55933183f8b0 con 0x55933154b1b0 2024-08-31T06:05:25.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f1395d9b640 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x559331924fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:25.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f139659c640 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x559331924a80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1388033000 tx=0x7f1388009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd6a5b5c2d818db9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.182+0000 7f137dffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:05:25.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.183+0000 7f137dffb640 1 -- 172.21.15.53:0/2576011535 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388035040 con 0x55933154b1b0 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.183+0000 7f13a325f740 1 -- 172.21.15.53:0/2576011535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f139001e070 con 0x55933154b1b0 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.183+0000 7f137dffb640 1 -- 172.21.15.53:0/2576011535 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f138803d7d0 con 0x55933154b1b0 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.183+0000 7f137dffb640 1 -- 172.21.15.53:0/2576011535 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f138803d9d0 con 0x55933154b1b0 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.183+0000 7f13a325f740 10 client.25427 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.183+0000 7f13a325f740 1 -- 172.21.15.53:0/2576011535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559331933900 con 0x55933154b1b0 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.183+0000 7f137dffb640 1 -- 172.21.15.53:0/2576011535 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f139001e070 con 0x55933154b1b0 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.184+0000 7f137dffb640 1 -- 172.21.15.53:0/2576011535 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1388044070 con 0x55933154b1b0 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.184+0000 7f13a325f740 10 client.25427 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.184+0000 7f13a325f740 10 client.25427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.184+0000 7f13a325f740 20 client.25427 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.184+0000 7f13a325f740 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5593315329f0 0x5593319371c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.184+0000 7f13a325f740 4 client.25427 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.184+0000 7f13a325f740 1 -- 172.21.15.53:0/2576011535 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559331892580 con 0x5593315329f0 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.185+0000 7f1395d9b640 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5593315329f0 0x5593319371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.185+0000 7f137dffb640 10 client.25427 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.185+0000 7f1395d9b640 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5593315329f0 0x5593319371c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88235f6d7410f557 server_cookie=f94ed6d168bb1eec in_seq=0 out_seq=0 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f137dffb640 1 -- 172.21.15.53:0/2576011535 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559331892580 con 0x5593315329f0 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f137dffb640 10 client.25427 handle_command_reply: tid=0 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f13a325f740 1 client.25427 shutdown 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f13a325f740 1 -- 172.21.15.53:0/2576011535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 msgr2=0x559331924a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f13a325f740 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x559331924a80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1388033000 tx=0x7f1388009260 comp rx=0 tx=0).stop 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f13a325f740 1 -- 172.21.15.53:0/2576011535 shutdown_connections 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f13a325f740 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5593315329f0 0x5593319371c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f13a325f740 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331930e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f13a325f740 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x559331924fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f13a325f740 1 --2- 172.21.15.53:0/2576011535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x559331924a80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f13a325f740 1 -- 172.21.15.53:0/2576011535 >> 172.21.15.53:0/2576011535 conn(0x559331568460 msgr2=0x55933191c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.186+0000 7f137dffb640 0 client.25427 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.187+0000 7f13a325f740 1 -- 172.21.15.53:0/2576011535 shutdown_connections 2024-08-31T06:05:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.187+0000 7f13a325f740 1 -- 172.21.15.53:0/2576011535 wait complete. 2024-08-31T06:05:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.187+0000 7f13a325f740 20 client.25427 trim_cache size 0 max 16384 2024-08-31T06:05:25.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f13a325f740 1 Processor -- start 2024-08-31T06:05:25.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f13a325f740 1 -- start start 2024-08-31T06:05:25.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f13a325f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55933154b1b0 0x559331917260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f13a325f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331553390 0x559331930d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f13a325f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559331574070 0x5593319312b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f13a325f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13981ad170 con 0x55933154b1b0 2024-08-31T06:05:25.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f13a325f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13981aecb0 con 0x559331574070 2024-08-31T06:05:25.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f139659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55933154b1b0 0x559331917260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f139659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55933154b1b0 0x559331917260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45810/0 (socket says 172.21.15.53:45810) 2024-08-31T06:05:25.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f139659c640 1 -- 172.21.15.53:0/1224363255 learned_addr learned my addr 172.21.15.53:0/1224363255 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:25.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f13a325f740 1 -- 172.21.15.53:0/1224363255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13981ad840 con 0x559331553390 2024-08-31T06:05:25.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.222+0000 7f1395d9b640 1 --2- 172.21.15.53:0/1224363255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331553390 0x559331930d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.223+0000 7f139659c640 1 -- 172.21.15.53:0/1224363255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331553390 msgr2=0x559331930d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.223+0000 7f139659c640 1 --2- 172.21.15.53:0/1224363255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331553390 0x559331930d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.223+0000 7f139659c640 1 -- 172.21.15.53:0/1224363255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559331574070 msgr2=0x5593319312b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.223+0000 7f1396d9d640 1 --2- 172.21.15.53:0/1224363255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559331574070 0x5593319312b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.223+0000 7f139659c640 1 --2- 172.21.15.53:0/1224363255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559331574070 0x5593319312b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.223+0000 7f139659c640 1 -- 172.21.15.53:0/1224363255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55933191b5f0 con 0x55933154b1b0 2024-08-31T06:05:25.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.223+0000 7f1395d9b640 1 --2- 172.21.15.53:0/1224363255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331553390 0x559331930d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:25.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.223+0000 7f139659c640 1 --2- 172.21.15.53:0/1224363255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55933154b1b0 0x559331917260 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1388009900 tx=0x7f1388031820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a5f2b0ad2b1f36 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.223+0000 7f137ffff640 1 -- 172.21.15.53:0/1224363255 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388035070 con 0x55933154b1b0 2024-08-31T06:05:25.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.224+0000 7f137ffff640 1 -- 172.21.15.53:0/1224363255 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f138805d020 con 0x55933154b1b0 2024-08-31T06:05:25.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.224+0000 7f137ffff640 1 -- 172.21.15.53:0/1224363255 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13880588f0 con 0x55933154b1b0 2024-08-31T06:05:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.225+0000 7f13a325f740 1 -- 172.21.15.53:0/1224363255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55933154b1b0 msgr2=0x559331917260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.225+0000 7f13a325f740 1 --2- 172.21.15.53:0/1224363255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55933154b1b0 0x559331917260 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1388009900 tx=0x7f1388031820 comp rx=0 tx=0).stop 2024-08-31T06:05:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.225+0000 7f13a325f740 1 -- 172.21.15.53:0/1224363255 shutdown_connections 2024-08-31T06:05:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.225+0000 7f13a325f740 1 --2- 172.21.15.53:0/1224363255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559331574070 0x5593319312b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.225+0000 7f13a325f740 1 --2- 172.21.15.53:0/1224363255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331553390 0x559331930d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.225+0000 7f13a325f740 1 --2- 172.21.15.53:0/1224363255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55933154b1b0 0x559331917260 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.225+0000 7f13a325f740 1 -- 172.21.15.53:0/1224363255 >> 172.21.15.53:0/1224363255 conn(0x559331568460 msgr2=0x559331916b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.225+0000 7f13a325f740 1 -- 172.21.15.53:0/1224363255 shutdown_connections 2024-08-31T06:05:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.225+0000 7f13a325f740 1 -- 172.21.15.53:0/1224363255 wait complete. 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.225+0000 7f13a325f740 1 -- start start 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.226+0000 7f13a325f740 1 Processor -- start 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.226+0000 7f13a325f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x55933192d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.226+0000 7f13a325f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x5593319289a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.226+0000 7f13a325f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331928ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.226+0000 7f13a325f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13981ae5e0 con 0x559331553390 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.226+0000 7f13a325f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13981adf10 con 0x55933154b1b0 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.226+0000 7f13a325f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13981ab150 con 0x559331574070 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.226+0000 7f1395d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x5593319289a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.226+0000 7f1395d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x5593319289a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45824/0 (socket says 172.21.15.53:45824) 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.226+0000 7f1395d9b640 1 -- 172.21.15.53:0/573000140 learned_addr learned my addr 172.21.15.53:0/573000140 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.226+0000 7f13a325f740 10 client.0 _ll_register_callbacks cb 0x7f1388009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:25.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f139659c640 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x55933192d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f1395d9b640 1 -- 172.21.15.53:0/573000140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 msgr2=0x559331928ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f1395d9b640 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331928ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f1395d9b640 1 -- 172.21.15.53:0/573000140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 msgr2=0x55933192d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f1395d9b640 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x55933192d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f1395d9b640 1 -- 172.21.15.53:0/573000140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593319295a0 con 0x559331553390 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f139659c640 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x55933192d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f1395d9b640 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x5593319289a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f138c0ab4b0 tx=0x7f138c00c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9755fac8c1c05e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f137dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f137dffb640 1 -- 172.21.15.53:0/573000140 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c0afd90 con 0x559331553390 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f137dffb640 1 -- 172.21.15.53:0/573000140 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f138c0a77b0 con 0x559331553390 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f13a325f740 1 -- 172.21.15.53:0/573000140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f138805d020 con 0x559331553390 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f137dffb640 1 -- 172.21.15.53:0/573000140 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f138c0b4840 con 0x559331553390 2024-08-31T06:05:25.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f13a325f740 10 client.15927 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:25.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.227+0000 7f13a325f740 1 -- 172.21.15.53:0/573000140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5593319bb240 con 0x559331553390 2024-08-31T06:05:25.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.228+0000 7f137dffb640 1 -- 172.21.15.53:0/573000140 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f138c0d2070 con 0x559331553390 2024-08-31T06:05:25.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.228+0000 7f137dffb640 1 -- 172.21.15.53:0/573000140 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f138c0b43b0 con 0x559331553390 2024-08-31T06:05:25.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.228+0000 7f13a325f740 10 client.15927 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:25.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.228+0000 7f13a325f740 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:25.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.228+0000 7f13a325f740 20 client.15927 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:25.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.228+0000 7f13a325f740 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559331507da0 0x5593319bda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.238 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:05:25.238 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:05:25.238 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:05:25.238 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:05:25.238 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:05:25.238 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "0a265333-0ba8-49b6-b77e-feff777f1223", 2024-08-31T06:05:25.238 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:05:25.238 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:25.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:05:25.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:05:25.240 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:05:25.240 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:05:25.240 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:05:25.240 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:25.240 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:25.240 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.228+0000 7f13a325f740 4 client.15927 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.228+0000 7f13a325f740 1 -- 172.21.15.53:0/573000140 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f138805d020 con 0x559331507da0 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.228+0000 7f139659c640 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559331507da0 0x5593319bda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.229+0000 7f139659c640 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559331507da0 0x5593319bda00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=550b1028be7904af server_cookie=f59681e401fd05f4 in_seq=0 out_seq=0 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.229+0000 7f137dffb640 10 client.15927 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.229+0000 7f137dffb640 1 -- 172.21.15.53:0/573000140 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x7f138805d020 con 0x559331507da0 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.229+0000 7f137dffb640 10 client.15927 handle_command_reply: tid=0 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.229+0000 7f13a325f740 1 client.15927 shutdown 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.229+0000 7f13a325f740 1 -- 172.21.15.53:0/573000140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 msgr2=0x5593319289a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.229+0000 7f13a325f740 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x5593319289a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f138c0ab4b0 tx=0x7f138c00c3c0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.230+0000 7f13a325f740 1 -- 172.21.15.53:0/573000140 shutdown_connections 2024-08-31T06:05:25.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.230+0000 7f13a325f740 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559331507da0 0x5593319bda00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.230+0000 7f137dffb640 0 client.15927 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.230+0000 7f13a325f740 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559331574070 0x559331928ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.230+0000 7f13a325f740 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559331553390 0x5593319289a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.230+0000 7f13a325f740 1 --2- 172.21.15.53:0/573000140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55933154b1b0 0x55933192d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.230+0000 7f13a325f740 1 -- 172.21.15.53:0/573000140 >> 172.21.15.53:0/573000140 conn(0x559331568460 msgr2=0x55933191c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.230+0000 7f13a325f740 1 -- 172.21.15.53:0/573000140 shutdown_connections 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.230+0000 7f13a325f740 1 -- 172.21.15.53:0/573000140 wait complete. 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.231+0000 7f13a325f740 20 client.15927 trim_cache size 0 max 16384 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.232+0000 7f139ccea640 1 -- 172.21.15.53:0/3544823332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13800b4cd0 msgr2=0x7f13800b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.232+0000 7f139ccea640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13800b4cd0 0x7f13800b71e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f13880057c0 tx=0x7f13880058d0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.232+0000 7f139ccea640 1 -- 172.21.15.53:0/3544823332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1398108140 msgr2=0x7f1398199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.232+0000 7f139ccea640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1398108140 0x7f1398199670 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f138c007b50 tx=0x7f138c00e420 comp rx=0 tx=0).stop 2024-08-31T06:05:25.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.232+0000 7f139ccea640 1 -- 172.21.15.53:0/3544823332 shutdown_connections 2024-08-31T06:05:25.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.232+0000 7f139ccea640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13800b4cd0 0x7f13800b71e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.232+0000 7f139ccea640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1398108a90 0x7f139819e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.232+0000 7f139ccea640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1398108140 0x7f1398199670 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.232+0000 7f139ccea640 1 --2- 172.21.15.53:0/3544823332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1398102800 0x7f13981990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.232+0000 7f139ccea640 1 -- 172.21.15.53:0/3544823332 >> 172.21.15.53:0/3544823332 conn(0x7f13980794d0 msgr2=0x7f13981013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.234+0000 7f139ccea640 1 -- 172.21.15.53:0/3544823332 shutdown_connections 2024-08-31T06:05:25.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:25.234+0000 7f139ccea640 1 -- 172.21.15.53:0/3544823332 wait complete. 2024-08-31T06:05:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.327+0000 7fd28e700640 1 -- 172.21.15.53:0/2512967204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2881046c0 msgr2=0x7fd288104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.327+0000 7fd28e700640 1 --2- 172.21.15.53:0/2512967204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2881046c0 0x7fd288104ad0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd278009900 tx=0x7fd27802a410 comp rx=0 tx=0).stop 2024-08-31T06:05:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.327+0000 7fd28e700640 1 -- 172.21.15.53:0/2512967204 shutdown_connections 2024-08-31T06:05:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.327+0000 7fd28e700640 1 --2- 172.21.15.53:0/2512967204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd28810db20 0x7fd288110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.327+0000 7fd28e700640 1 --2- 172.21.15.53:0/2512967204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd288105010 0x7fd28810d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.327+0000 7fd28e700640 1 --2- 172.21.15.53:0/2512967204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2881046c0 0x7fd288104ad0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.327+0000 7fd28e700640 1 -- 172.21.15.53:0/2512967204 >> 172.21.15.53:0/2512967204 conn(0x7fd2880fe190 msgr2=0x7fd2881005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.327+0000 7fd28e700640 1 -- 172.21.15.53:0/2512967204 shutdown_connections 2024-08-31T06:05:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.327+0000 7fd28e700640 1 -- 172.21.15.53:0/2512967204 wait complete. 2024-08-31T06:05:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.328+0000 7fd28e700640 1 Processor -- start 2024-08-31T06:05:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.328+0000 7fd28e700640 1 -- start start 2024-08-31T06:05:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.328+0000 7fd28e700640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2881046c0 0x7fd28819a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.328+0000 7fd28e700640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd288105010 0x7fd28819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.328+0000 7fd28e700640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28810db20 0x7fd28819f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28e700640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd288113640 con 0x7fd28810db20 2024-08-31T06:05:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28cc9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28810db20 0x7fd28819f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28cc9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28810db20 0x7fd28819f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45850/0 (socket says 172.21.15.53:45850) 2024-08-31T06:05:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd288105010 0x7fd28819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28cc9d640 1 -- 172.21.15.53:0/1687620774 learned_addr learned my addr 172.21.15.53:0/1687620774 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28e700640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881134c0 con 0x7fd288105010 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28e700640 1 -- 172.21.15.53:0/1687620774 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881137c0 con 0x7fd2881046c0 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd287fff640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2881046c0 0x7fd28819a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28cc9d640 1 -- 172.21.15.53:0/1687620774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2881046c0 msgr2=0x7fd28819a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2881046c0 0x7fd28819a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28cc9d640 1 -- 172.21.15.53:0/1687620774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd288105010 msgr2=0x7fd28819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd288105010 0x7fd28819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28cc9d640 1 -- 172.21.15.53:0/1687620774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2881a0030 con 0x7fd28810db20 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd2877fe640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd288105010 0x7fd28819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.329+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28810db20 0x7fd28819f930 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd28000eb10 tx=0x7fd28000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.330+0000 7fd2857fa640 1 -- 172.21.15.53:0/1687620774 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd280004b20 con 0x7fd28810db20 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.330+0000 7fd2857fa640 1 -- 172.21.15.53:0/1687620774 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd280004cc0 con 0x7fd28810db20 2024-08-31T06:05:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.330+0000 7fd28e700640 1 -- 172.21.15.53:0/1687620774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2881a0320 con 0x7fd28810db20 2024-08-31T06:05:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.330+0000 7fd2857fa640 1 -- 172.21.15.53:0/1687620774 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd280010690 con 0x7fd28810db20 2024-08-31T06:05:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.330+0000 7fd28e700640 1 -- 172.21.15.53:0/1687620774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2881022d0 con 0x7fd28810db20 2024-08-31T06:05:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.333+0000 7fd29566c740 1 Processor -- start 2024-08-31T06:05:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.334+0000 7fd2857fa640 1 -- 172.21.15.53:0/1687620774 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd280005020 con 0x7fd28810db20 2024-08-31T06:05:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.334+0000 7fd29566c740 1 -- start start 2024-08-31T06:05:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.334+0000 7fd29566c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a7f1b0 0x557186e22d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.334+0000 7fd29566c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e23270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.334+0000 7fd29566c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 0x557186e237b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.334+0000 7fd29566c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557186d98000 con 0x557186a5e4d0 2024-08-31T06:05:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.334+0000 7fd29566c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557186d87590 con 0x557186a562f0 2024-08-31T06:05:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.334+0000 7fd29566c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557186d8b540 con 0x557186a7f1b0 2024-08-31T06:05:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a7f1b0 0x557186e22d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 0x557186e237b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd287fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e23270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd287fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e23270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:59810/0 (socket says 172.21.15.53:59810) 2024-08-31T06:05:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd287fff640 1 -- 172.21.15.53:0/22404721 learned_addr learned my addr 172.21.15.53:0/22404721 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd287fff640 1 -- 172.21.15.53:0/22404721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a7f1b0 msgr2=0x557186e22d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd287fff640 1 --2- 172.21.15.53:0/22404721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a7f1b0 0x557186e22d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd287fff640 1 -- 172.21.15.53:0/22404721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 msgr2=0x557186e237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd287fff640 1 --2- 172.21.15.53:0/22404721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 0x557186e237b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd287fff640 1 -- 172.21.15.53:0/22404721 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557186aea790 con 0x557186a562f0 2024-08-31T06:05:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd2877fe640 1 --2- 172.21.15.53:0/22404721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 0x557186e237b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.335+0000 7fd2857fa640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2700b4d20 0x7fd2700b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.336+0000 7fd287fff640 1 --2- 172.21.15.53:0/22404721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e23270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd278033000 tx=0x7fd278005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eca7ad7c365d4bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.336+0000 7fd2857fa640 1 -- 172.21.15.53:0/1687620774 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd2800e5ad0 con 0x7fd28810db20 2024-08-31T06:05:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.336+0000 7fd2877fe640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2700b4d20 0x7fd2700b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.336+0000 7fd26e7fc640 1 -- 172.21.15.53:0/22404721 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278035040 con 0x557186a562f0 2024-08-31T06:05:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.336+0000 7fd26e7fc640 1 -- 172.21.15.53:0/22404721 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd278004030 con 0x557186a562f0 2024-08-31T06:05:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.336+0000 7fd26e7fc640 1 -- 172.21.15.53:0/22404721 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278031800 con 0x557186a562f0 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.337+0000 7fd29566c740 1 -- 172.21.15.53:0/22404721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 msgr2=0x557186e23270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.337+0000 7fd29566c740 1 --2- 172.21.15.53:0/22404721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e23270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd278033000 tx=0x7fd278005d50 comp rx=0 tx=0).stop 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.337+0000 7fd2877fe640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2700b4d20 0x7fd2700b7230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd27c010fd0 tx=0x7fd27c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.337+0000 7fd29566c740 1 -- 172.21.15.53:0/22404721 shutdown_connections 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.337+0000 7fd29566c740 1 --2- 172.21.15.53:0/22404721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 0x557186e237b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.337+0000 7fd29566c740 1 --2- 172.21.15.53:0/22404721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e23270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.337+0000 7fd29566c740 1 --2- 172.21.15.53:0/22404721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a7f1b0 0x557186e22d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.337+0000 7fd29566c740 1 -- 172.21.15.53:0/22404721 >> 172.21.15.53:0/22404721 conn(0x557186a73300 msgr2=0x557186e20c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.337+0000 7fd29566c740 1 -- 172.21.15.53:0/22404721 shutdown_connections 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.338+0000 7fd29566c740 1 -- 172.21.15.53:0/22404721 wait complete. 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.338+0000 7fd29566c740 1 -- start start 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.338+0000 7fd29566c740 1 Processor -- start 2024-08-31T06:05:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd29566c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e2e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd29566c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a5e4d0 0x557186e2ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd29566c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 0x557186e3a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd29566c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557186cc0ab0 con 0x557186a7f1b0 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd29566c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557186d0e680 con 0x557186a562f0 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd287fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e2e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd287fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e2e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:59822/0 (socket says 172.21.15.53:59822) 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd287fff640 1 -- 172.21.15.53:0/1448025699 learned_addr learned my addr 172.21.15.53:0/1448025699 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 0x557186e3a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd2877fe640 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a5e4d0 0x557186e2ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd29566c740 1 -- 172.21.15.53:0/1448025699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557186e31450 con 0x557186a5e4d0 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.339+0000 7fd29566c740 10 client.0 _ll_register_callbacks cb 0x557186a96a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd28cc9d640 1 -- 172.21.15.53:0/1448025699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a5e4d0 msgr2=0x557186e2ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a5e4d0 0x557186e2ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd28cc9d640 1 -- 172.21.15.53:0/1448025699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 msgr2=0x557186e2e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e2e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd28cc9d640 1 -- 172.21.15.53:0/1448025699 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557186b63620 con 0x557186a7f1b0 2024-08-31T06:05:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 0x557186e3a770 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd2800e31f0 tx=0x7fd2800a8700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3493cdded544954 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd2677fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd2677fe640 1 -- 172.21.15.53:0/1448025699 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2800ac8c0 con 0x557186a7f1b0 2024-08-31T06:05:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd2677fe640 1 -- 172.21.15.53:0/1448025699 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd2800ac630 con 0x557186a7f1b0 2024-08-31T06:05:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd29566c740 1 -- 172.21.15.53:0/1448025699 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd278004030 con 0x557186a7f1b0 2024-08-31T06:05:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd2677fe640 1 -- 172.21.15.53:0/1448025699 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2800ac1c0 con 0x557186a7f1b0 2024-08-31T06:05:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd29566c740 10 client.15939 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.340+0000 7fd29566c740 1 -- 172.21.15.53:0/1448025699 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557186e3d540 con 0x557186a7f1b0 2024-08-31T06:05:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.341+0000 7fd2677fe640 1 -- 172.21.15.53:0/1448025699 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2800b0a30 con 0x557186a7f1b0 2024-08-31T06:05:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.341+0000 7fd2677fe640 1 -- 172.21.15.53:0/1448025699 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd2800972a0 con 0x557186a7f1b0 2024-08-31T06:05:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.341+0000 7fd29566c740 10 client.15939 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.341+0000 7fd29566c740 10 client.15939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.341+0000 7fd29566c740 20 client.15939 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.341+0000 7fd29566c740 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557186a3dd80 0x557186e40f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.341+0000 7fd29566c740 4 client.15939 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.341+0000 7fd29566c740 1 -- 172.21.15.53:0/1448025699 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd278004030 con 0x557186a3dd80 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.341+0000 7fd287fff640 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557186a3dd80 0x557186e40f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.342+0000 7fd2677fe640 10 client.15939 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.342+0000 7fd287fff640 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557186a3dd80 0x557186e40f00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddb020c1b5b031f7 server_cookie=b358cb28c7a37a02 in_seq=0 out_seq=0 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd2677fe640 1 -- 172.21.15.53:0/1448025699 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd278004030 con 0x557186a3dd80 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd2677fe640 10 client.15939 handle_command_reply: tid=0 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 1 client.15939 shutdown 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 1 -- 172.21.15.53:0/1448025699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 msgr2=0x557186e3a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 0x557186e3a770 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd2800e31f0 tx=0x7fd2800a8700 comp rx=0 tx=0).stop 2024-08-31T06:05:25.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 1 -- 172.21.15.53:0/1448025699 shutdown_connections 2024-08-31T06:05:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557186a3dd80 0x557186e40f00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 0x557186e3a770 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a5e4d0 0x557186e2ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 1 --2- 172.21.15.53:0/1448025699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e2e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd2677fe640 0 client.15939 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 1 -- 172.21.15.53:0/1448025699 >> 172.21.15.53:0/1448025699 conn(0x557186a73300 msgr2=0x557186e1f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 1 -- 172.21.15.53:0/1448025699 shutdown_connections 2024-08-31T06:05:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 1 -- 172.21.15.53:0/1448025699 wait complete. 2024-08-31T06:05:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.343+0000 7fd29566c740 20 client.15939 trim_cache size 0 max 16384 2024-08-31T06:05:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.372+0000 7fd29566c740 1 Processor -- start 2024-08-31T06:05:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.372+0000 7fd29566c740 1 -- start start 2024-08-31T06:05:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.373+0000 7fd29566c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a562f0 0x557186e28570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.373+0000 7fd29566c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 0x557186e3a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.373+0000 7fd29566c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a7f1b0 0x557186e1f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.373+0000 7fd29566c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881ad240 con 0x557186a5e4d0 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.373+0000 7fd29566c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881aed80 con 0x557186a7f1b0 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.373+0000 7fd29566c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881ad910 con 0x557186a562f0 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.373+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 0x557186e3a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.373+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 0x557186e3a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45874/0 (socket says 172.21.15.53:45874) 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.373+0000 7fd2877fe640 1 -- 172.21.15.53:0/2708210308 learned_addr learned my addr 172.21.15.53:0/2708210308 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.373+0000 7fd287fff640 1 --2- 172.21.15.53:0/2708210308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a562f0 0x557186e28570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.373+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/2708210308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a7f1b0 0x557186e1f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.374+0000 7fd2877fe640 1 -- 172.21.15.53:0/2708210308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a562f0 msgr2=0x557186e28570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.374+0000 7fd2877fe640 1 --2- 172.21.15.53:0/2708210308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a562f0 0x557186e28570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.374+0000 7fd2877fe640 1 -- 172.21.15.53:0/2708210308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a7f1b0 msgr2=0x557186e1f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.374+0000 7fd2877fe640 1 --2- 172.21.15.53:0/2708210308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a7f1b0 0x557186e1f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.374+0000 7fd2877fe640 1 -- 172.21.15.53:0/2708210308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557186a3dfb0 con 0x557186a5e4d0 2024-08-31T06:05:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.374+0000 7fd287fff640 1 --2- 172.21.15.53:0/2708210308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a562f0 0x557186e28570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.374+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/2708210308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a7f1b0 0x557186e1f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.374+0000 7fd2877fe640 1 --2- 172.21.15.53:0/2708210308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 0x557186e3a670 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd28806b270 tx=0x7fd27c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6cf6d563d25fe4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.374+0000 7fd26dffb640 1 -- 172.21.15.53:0/2708210308 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c021a00 con 0x557186a5e4d0 2024-08-31T06:05:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.374+0000 7fd26dffb640 1 -- 172.21.15.53:0/2708210308 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd27c021ba0 con 0x557186a5e4d0 2024-08-31T06:05:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.374+0000 7fd26dffb640 1 -- 172.21.15.53:0/2708210308 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0055e0 con 0x557186a5e4d0 2024-08-31T06:05:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.375+0000 7fd29566c740 1 -- 172.21.15.53:0/2708210308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 msgr2=0x557186e3a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.375+0000 7fd29566c740 1 --2- 172.21.15.53:0/2708210308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 0x557186e3a670 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd28806b270 tx=0x7fd27c0046c0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.376+0000 7fd29566c740 1 -- 172.21.15.53:0/2708210308 shutdown_connections 2024-08-31T06:05:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.376+0000 7fd29566c740 1 --2- 172.21.15.53:0/2708210308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a7f1b0 0x557186e1f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.376+0000 7fd29566c740 1 --2- 172.21.15.53:0/2708210308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a5e4d0 0x557186e3a670 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.376+0000 7fd29566c740 1 --2- 172.21.15.53:0/2708210308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a562f0 0x557186e28570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.376+0000 7fd29566c740 1 -- 172.21.15.53:0/2708210308 >> 172.21.15.53:0/2708210308 conn(0x557186a73300 msgr2=0x557186e27e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.376+0000 7fd29566c740 1 -- 172.21.15.53:0/2708210308 shutdown_connections 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.376+0000 7fd29566c740 1 -- 172.21.15.53:0/2708210308 wait complete. 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.376+0000 7fd29566c740 1 -- start start 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.376+0000 7fd29566c740 1 Processor -- start 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd29566c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e31ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd29566c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a5e4d0 0x557186e32410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd29566c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 0x557186ea98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd29566c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881ae6b0 con 0x557186a7f1b0 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd29566c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881adfe0 con 0x557186a562f0 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd29566c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881ab220 con 0x557186a5e4d0 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd29566c740 10 client.0 _ll_register_callbacks cb 0x7fd280005710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd28cc9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 0x557186ea98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd28cc9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 0x557186ea98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45880/0 (socket says 172.21.15.53:45880) 2024-08-31T06:05:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd28cc9d640 1 -- 172.21.15.53:0/3800564304 learned_addr learned my addr 172.21.15.53:0/3800564304 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd287fff640 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e31ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd2877fe640 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a5e4d0 0x557186e32410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd28cc9d640 1 -- 172.21.15.53:0/3800564304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a5e4d0 msgr2=0x557186e32410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a5e4d0 0x557186e32410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd28cc9d640 1 -- 172.21.15.53:0/3800564304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 msgr2=0x557186e31ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e31ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd28cc9d640 1 -- 172.21.15.53:0/3800564304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557186ea9e30 con 0x557186a7f1b0 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.377+0000 7fd2877fe640 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a5e4d0 0x557186e32410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.378+0000 7fd28cc9d640 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 0x557186ea98f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd2800a9430 tx=0x7fd2800e3220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907e252bd17ea27a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.378+0000 7fd2677fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.378+0000 7fd2677fe640 1 -- 172.21.15.53:0/3800564304 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2800ab930 con 0x557186a7f1b0 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.378+0000 7fd2677fe640 1 -- 172.21.15.53:0/3800564304 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd2800b5050 con 0x557186a7f1b0 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.378+0000 7fd29566c740 1 -- 172.21.15.53:0/3800564304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd27c021ba0 con 0x557186a7f1b0 2024-08-31T06:05:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.378+0000 7fd2677fe640 1 -- 172.21.15.53:0/3800564304 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2800ac8c0 con 0x557186a7f1b0 2024-08-31T06:05:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.378+0000 7fd29566c740 10 client.15945 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.378+0000 7fd29566c740 1 -- 172.21.15.53:0/3800564304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557186eab020 con 0x557186a7f1b0 2024-08-31T06:05:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.378+0000 7fd2677fe640 1 -- 172.21.15.53:0/3800564304 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd27c021ba0 con 0x557186a7f1b0 2024-08-31T06:05:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.379+0000 7fd2677fe640 1 -- 172.21.15.53:0/3800564304 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd2800c1bb0 con 0x557186a7f1b0 2024-08-31T06:05:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.379+0000 7fd29566c740 10 client.15945 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.379+0000 7fd29566c740 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.379+0000 7fd29566c740 20 client.15945 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.379+0000 7fd29566c740 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557186a131c0 0x557186ead6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.379+0000 7fd29566c740 4 client.15945 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:05:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.379+0000 7fd29566c740 1 -- 172.21.15.53:0/3800564304 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557186d99f50 con 0x557186a131c0 2024-08-31T06:05:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.379+0000 7fd287fff640 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557186a131c0 0x557186ead6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.380+0000 7fd2677fe640 10 client.15945 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.380+0000 7fd287fff640 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557186a131c0 0x557186ead6d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e899a14dd9f709a0 server_cookie=37e2ce713737502 in_seq=0 out_seq=0 2024-08-31T06:05:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.384+0000 7fd2677fe640 1 -- 172.21.15.53:0/3800564304 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557186d99f50 con 0x557186a131c0 2024-08-31T06:05:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.384+0000 7fd2677fe640 10 client.15945 handle_command_reply: tid=0 2024-08-31T06:05:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.384+0000 7fd29566c740 1 client.15945 shutdown 2024-08-31T06:05:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.384+0000 7fd29566c740 1 -- 172.21.15.53:0/3800564304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 msgr2=0x557186ea98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.384+0000 7fd29566c740 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 0x557186ea98f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd2800a9430 tx=0x7fd2800e3220 comp rx=0 tx=0).stop 2024-08-31T06:05:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.384+0000 7fd29566c740 1 -- 172.21.15.53:0/3800564304 shutdown_connections 2024-08-31T06:05:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.384+0000 7fd29566c740 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557186a131c0 0x557186ead6d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.384+0000 7fd2677fe640 0 client.15945 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.385+0000 7fd29566c740 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557186a7f1b0 0x557186ea98f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.385+0000 7fd29566c740 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557186a5e4d0 0x557186e32410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.385+0000 7fd29566c740 1 --2- 172.21.15.53:0/3800564304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557186a562f0 0x557186e31ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.385+0000 7fd29566c740 1 -- 172.21.15.53:0/3800564304 >> 172.21.15.53:0/3800564304 conn(0x557186a73300 msgr2=0x557186e27e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.385+0000 7fd29566c740 1 -- 172.21.15.53:0/3800564304 shutdown_connections 2024-08-31T06:05:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.385+0000 7fd29566c740 1 -- 172.21.15.53:0/3800564304 wait complete. 2024-08-31T06:05:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.385+0000 7fd29566c740 20 client.15945 trim_cache size 0 max 16384 2024-08-31T06:05:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:05:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:05:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:05:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:05:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 -- 172.21.15.53:0/1687620774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2700b4d20 msgr2=0x7fd2700b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2700b4d20 0x7fd2700b7230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd27c010fd0 tx=0x7fd27c005f90 comp rx=0 tx=0).stop 2024-08-31T06:05:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 -- 172.21.15.53:0/1687620774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28810db20 msgr2=0x7fd28819f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28810db20 0x7fd28819f930 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd28000eb10 tx=0x7fd28000c2d0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 -- 172.21.15.53:0/1687620774 shutdown_connections 2024-08-31T06:05:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2700b4d20 0x7fd2700b7230 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28810db20 0x7fd28819f930 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd288105010 0x7fd28819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 --2- 172.21.15.53:0/1687620774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2881046c0 0x7fd28819a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 -- 172.21.15.53:0/1687620774 >> 172.21.15.53:0/1687620774 conn(0x7fd2880fe190 msgr2=0x7fd288106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 -- 172.21.15.53:0/1687620774 shutdown_connections 2024-08-31T06:05:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:25.386+0000 7fd28e700640 1 -- 172.21.15.53:0/1687620774 wait complete. 2024-08-31T06:05:26.044 INFO:tasks.cephfs.filesystem:scrub status for tag:0a265333-0ba8-49b6-b77e-feff777f1223 - {'path': '/', 'tag': '0a265333-0ba8-49b6-b77e-feff777f1223', 'options': 'recursive,force'} 2024-08-31T06:05:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:26 smithi153 ceph-mon[22320]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T06:05:26.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:26 smithi053 ceph-mon[18924]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T06:05:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:26 smithi130 ceph-mon[22266]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T06:05:28.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:28 smithi153 ceph-mon[22320]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T06:05:28.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:28 smithi053 ceph-mon[18924]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T06:05:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:28 smithi130 ceph-mon[22266]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T06:05:30.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:30 smithi153 ceph-mon[22320]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-31T06:05:30.430 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:30 smithi130 ceph-mon[22266]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-31T06:05:30.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:30 smithi053 ceph-mon[18924]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-31T06:05:32.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:32 smithi153 ceph-mon[22320]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:32.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:32 smithi053 ceph-mon[18924]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:32.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:32 smithi130 ceph-mon[22266]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:34.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:34 smithi153 ceph-mon[22320]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T06:05:34.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:34 smithi053 ceph-mon[18924]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T06:05:34.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:34 smithi130 ceph-mon[22266]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T06:05:36.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:36 smithi153 ceph-mon[22320]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-31T06:05:36.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:36 smithi053 ceph-mon[18924]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-31T06:05:36.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:36 smithi130 ceph-mon[22266]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-31T06:05:37.132 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:05:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:38.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.085+0000 7f4c64f4f640 1 -- 172.21.15.53:0/2110781598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c601078d0 msgr2=0x7f4c60107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.085+0000 7f4c64f4f640 1 --2- 172.21.15.53:0/2110781598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c601078d0 0x7f4c60107ce0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800aa10 tx=0x7f4c4802b750 comp rx=0 tx=0).stop 2024-08-31T06:05:38.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.085+0000 7f4c64f4f640 1 -- 172.21.15.53:0/2110781598 shutdown_connections 2024-08-31T06:05:38.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.085+0000 7f4c64f4f640 1 --2- 172.21.15.53:0/2110781598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c60108220 0x7f4c6010ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.085+0000 7f4c64f4f640 1 --2- 172.21.15.53:0/2110781598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c601078d0 0x7f4c60107ce0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.085+0000 7f4c64f4f640 1 --2- 172.21.15.53:0/2110781598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c60101f90 0x7f4c601023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.085+0000 7f4c64f4f640 1 -- 172.21.15.53:0/2110781598 >> 172.21.15.53:0/2110781598 conn(0x7f4c60077a00 msgr2=0x7f4c60077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:38.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.085+0000 7f4c64f4f640 1 -- 172.21.15.53:0/2110781598 shutdown_connections 2024-08-31T06:05:38.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.085+0000 7f4c64f4f640 1 -- 172.21.15.53:0/2110781598 wait complete. 2024-08-31T06:05:38.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.086+0000 7f4c64f4f640 1 Processor -- start 2024-08-31T06:05:38.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.086+0000 7f4c64f4f640 1 -- start start 2024-08-31T06:05:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.087+0000 7f4c64f4f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c60101f90 0x7f4c6019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.087+0000 7f4c64f4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c601078d0 0x7f4c60197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.087+0000 7f4c64f4f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c60108220 0x7f4c60198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.087+0000 7f4c64f4f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4c60111510 con 0x7f4c601078d0 2024-08-31T06:05:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.087+0000 7f4c64f4f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c60111390 con 0x7f4c60101f90 2024-08-31T06:05:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.087+0000 7f4c64f4f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c60111690 con 0x7f4c60108220 2024-08-31T06:05:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.087+0000 7f4c55d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c601078d0 0x7f4c60197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c5ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c60108220 0x7f4c60198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c5ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c60108220 0x7f4c60198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44500/0 (socket says 172.21.15.53:44500) 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c5ed9d640 1 -- 172.21.15.53:0/1946705037 learned_addr learned my addr 172.21.15.53:0/1946705037 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c5e59c640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c60101f90 0x7f4c6019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c5ed9d640 1 -- 172.21.15.53:0/1946705037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c60101f90 msgr2=0x7f4c6019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c5ed9d640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c60101f90 0x7f4c6019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c5ed9d640 1 -- 172.21.15.53:0/1946705037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c601078d0 msgr2=0x7f4c60197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c5ed9d640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c601078d0 0x7f4c60197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c5ed9d640 1 -- 172.21.15.53:0/1946705037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c60198ba0 con 0x7f4c60108220 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c5e59c640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c60101f90 0x7f4c6019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c55d9b640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c601078d0 0x7f4c60197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.088+0000 7f4c5ed9d640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c60108220 0x7f4c60198430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800eaa0 tx=0x7f4c5800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.089+0000 7f4c57fff640 1 -- 172.21.15.53:0/1946705037 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5800cdb0 con 0x7f4c60108220 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.089+0000 7f4c57fff640 1 -- 172.21.15.53:0/1946705037 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c58005020 con 0x7f4c60108220 2024-08-31T06:05:38.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.089+0000 7f4c64f4f640 1 -- 172.21.15.53:0/1946705037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6019d870 con 0x7f4c60108220 2024-08-31T06:05:38.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.089+0000 7f4c64f4f640 1 -- 172.21.15.53:0/1946705037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6019dd30 con 0x7f4c60108220 2024-08-31T06:05:38.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.089+0000 7f4c57fff640 1 -- 172.21.15.53:0/1946705037 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c580116d0 con 0x7f4c60108220 2024-08-31T06:05:38.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.090+0000 7f4c64f4f640 1 -- 172.21.15.53:0/1946705037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c40005290 con 0x7f4c60108220 2024-08-31T06:05:38.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.093+0000 7f4c57fff640 1 -- 172.21.15.53:0/1946705037 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4c58004a40 con 0x7f4c60108220 2024-08-31T06:05:38.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.094+0000 7f4c57fff640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c4c0b4ca0 0x7f4c4c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.094+0000 7f4c5e59c640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c4c0b4ca0 0x7f4c4c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.094+0000 7f4c57fff640 1 -- 172.21.15.53:0/1946705037 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f4c580e5b50 con 0x7f4c60108220 2024-08-31T06:05:38.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.095+0000 7f4c5e59c640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c4c0b4ca0 0x7f4c4c0b71b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c50005fd0 tx=0x7f4c5000a400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.096+0000 7f4c57fff640 1 -- 172.21.15.53:0/1946705037 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4c58016030 con 0x7f4c60108220 2024-08-31T06:05:38.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:38 smithi053 ceph-mon[18924]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.534+0000 7fcd4962e640 1 -- 172.21.15.53:0/3257305762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd44107850 msgr2=0x7fcd44107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.534+0000 7fcd4962e640 1 --2- 172.21.15.53:0/3257305762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd44107850 0x7fcd44107c60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009900 tx=0x7fcd3802a410 comp rx=0 tx=0).stop 2024-08-31T06:05:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.534+0000 7fcd4962e640 1 -- 172.21.15.53:0/3257305762 shutdown_connections 2024-08-31T06:05:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.534+0000 7fcd4962e640 1 --2- 172.21.15.53:0/3257305762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd441081a0 0x7fcd4410e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.534+0000 7fcd4962e640 1 --2- 172.21.15.53:0/3257305762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd44107850 0x7fcd44107c60 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.534+0000 7fcd4962e640 1 --2- 172.21.15.53:0/3257305762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd44101f20 0x7fcd44102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.534+0000 7fcd4962e640 1 -- 172.21.15.53:0/3257305762 >> 172.21.15.53:0/3257305762 conn(0x7fcd44079c30 msgr2=0x7fcd4407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.535+0000 7fcd4962e640 1 -- 172.21.15.53:0/3257305762 shutdown_connections 2024-08-31T06:05:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.535+0000 7fcd4962e640 1 -- 172.21.15.53:0/3257305762 wait complete. 2024-08-31T06:05:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.535+0000 7fcd4962e640 1 Processor -- start 2024-08-31T06:05:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.536+0000 7fcd4962e640 1 -- start start 2024-08-31T06:05:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.536+0000 7fcd4962e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd44101f20 0x7fcd4419a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.536+0000 7fcd4962e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd44107850 0x7fcd4419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.536+0000 7fcd4962e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd441081a0 0x7fcd4419f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.536+0000 7fcd4962e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcd441136d0 con 0x7fcd44101f20 2024-08-31T06:05:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.536+0000 7fcd4962e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44113550 con 0x7fcd441081a0 2024-08-31T06:05:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.536+0000 7fcd4962e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44113850 con 0x7fcd44107850 2024-08-31T06:05:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.536+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd44101f20 0x7fcd4419a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.536+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd44101f20 0x7fcd4419a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36258/0 (socket says 172.21.15.53:36258) 2024-08-31T06:05:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.536+0000 7fcd42ffd640 1 -- 172.21.15.53:0/1538638436 learned_addr learned my addr 172.21.15.53:0/1538638436 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.536+0000 7fcd437fe640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd441081a0 0x7fcd4419f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.537+0000 7fcd42ffd640 1 -- 172.21.15.53:0/1538638436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd44107850 msgr2=0x7fcd4419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.537+0000 7fcd42ffd640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd44107850 0x7fcd4419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.537+0000 7fcd42ffd640 1 -- 172.21.15.53:0/1538638436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd441081a0 msgr2=0x7fcd4419f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.537+0000 7fcd42ffd640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd441081a0 0x7fcd4419f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.537+0000 7fcd42ffd640 1 -- 172.21.15.53:0/1538638436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd441a0080 con 0x7fcd44101f20 2024-08-31T06:05:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.537+0000 7fcd42ffd640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd44101f20 0x7fcd4419a150 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400bea0 tx=0x7fcd3400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.537+0000 7fcd2bfff640 1 -- 172.21.15.53:0/1538638436 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34018070 con 0x7fcd44101f20 2024-08-31T06:05:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.537+0000 7fcd2bfff640 1 -- 172.21.15.53:0/1538638436 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd34009c30 con 0x7fcd44101f20 2024-08-31T06:05:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.537+0000 7fcd2bfff640 1 -- 172.21.15.53:0/1538638436 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3401b7a0 con 0x7fcd44101f20 2024-08-31T06:05:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.537+0000 7fcd4962e640 1 -- 172.21.15.53:0/1538638436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd441a0370 con 0x7fcd44101f20 2024-08-31T06:05:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.537+0000 7fcd4962e640 1 -- 172.21.15.53:0/1538638436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd441101a0 con 0x7fcd44101f20 2024-08-31T06:05:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.541+0000 7fcd50675740 1 Processor -- start 2024-08-31T06:05:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.541+0000 7fcd50675740 1 -- start start 2024-08-31T06:05:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.541+0000 7fcd50675740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 0x55d412fffce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.541+0000 7fcd50675740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c332f0 0x55d413000220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.541+0000 7fcd50675740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d413000760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.541+0000 7fcd50675740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d412f75000 con 0x55d412c3b4d0 2024-08-31T06:05:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.541+0000 7fcd50675740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d412f64590 con 0x55d412c5c1b0 2024-08-31T06:05:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.541+0000 7fcd50675740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d412f68540 con 0x55d412c332f0 2024-08-31T06:05:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.542+0000 7fcd427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d413000760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.542+0000 7fcd427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d413000760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36268/0 (socket says 172.21.15.53:36268) 2024-08-31T06:05:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.542+0000 7fcd427fc640 1 -- 172.21.15.53:0/698990554 learned_addr learned my addr 172.21.15.53:0/698990554 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.542+0000 7fcd427fc640 1 -- 172.21.15.53:0/698990554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c332f0 msgr2=0x55d413000220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:05:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.542+0000 7fcd427fc640 1 --2- 172.21.15.53:0/698990554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c332f0 0x55d413000220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.542+0000 7fcd427fc640 1 -- 172.21.15.53:0/698990554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 msgr2=0x55d412fffce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.542+0000 7fcd427fc640 1 --2- 172.21.15.53:0/698990554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 0x55d412fffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.542+0000 7fcd427fc640 1 -- 172.21.15.53:0/698990554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d412cc7790 con 0x55d412c3b4d0 2024-08-31T06:05:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.542+0000 7fcd2bfff640 1 -- 172.21.15.53:0/1538638436 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcd3401b940 con 0x7fcd44101f20 2024-08-31T06:05:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.542+0000 7fcd427fc640 1 --2- 172.21.15.53:0/698990554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d413000760 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcd3802a930 tx=0x7fcd38004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c70bd6729847e4f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.543+0000 7fcd297fa640 1 -- 172.21.15.53:0/698990554 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3803e030 con 0x55d412c3b4d0 2024-08-31T06:05:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.543+0000 7fcd297fa640 1 -- 172.21.15.53:0/698990554 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd380054b0 con 0x55d412c3b4d0 2024-08-31T06:05:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.543+0000 7fcd297fa640 1 -- 172.21.15.53:0/698990554 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38035040 con 0x55d412c3b4d0 2024-08-31T06:05:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.544+0000 7fcd2bfff640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd2c0b4e70 0x7fcd2c0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.544+0000 7fcd2bfff640 1 -- 172.21.15.53:0/1538638436 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fcd340e92a0 con 0x7fcd44101f20 2024-08-31T06:05:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.544+0000 7fcd50675740 1 -- 172.21.15.53:0/698990554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 msgr2=0x55d413000760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.544+0000 7fcd50675740 1 --2- 172.21.15.53:0/698990554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d413000760 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcd3802a930 tx=0x7fcd38004040 comp rx=0 tx=0).stop 2024-08-31T06:05:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.544+0000 7fcd437fe640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd2c0b4e70 0x7fcd2c0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.544+0000 7fcd50675740 1 -- 172.21.15.53:0/698990554 shutdown_connections 2024-08-31T06:05:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.544+0000 7fcd50675740 1 --2- 172.21.15.53:0/698990554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d413000760 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.544+0000 7fcd50675740 1 --2- 172.21.15.53:0/698990554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c332f0 0x55d413000220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.544+0000 7fcd50675740 1 --2- 172.21.15.53:0/698990554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 0x55d412fffce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.544+0000 7fcd50675740 1 -- 172.21.15.53:0/698990554 >> 172.21.15.53:0/698990554 conn(0x55d412c50300 msgr2=0x55d412ffdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.545+0000 7fcd50675740 1 -- 172.21.15.53:0/698990554 shutdown_connections 2024-08-31T06:05:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.545+0000 7fcd50675740 1 -- 172.21.15.53:0/698990554 wait complete. 2024-08-31T06:05:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.545+0000 7fcd437fe640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd2c0b4e70 0x7fcd2c0b7380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c005fd0 tx=0x7fcd3c004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.545+0000 7fcd50675740 1 -- start start 2024-08-31T06:05:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.546+0000 7fcd50675740 1 Processor -- start 2024-08-31T06:05:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.546+0000 7fcd50675740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c332f0 0x55d41300b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.546+0000 7fcd50675740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d41300bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d41300bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d41300bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36280/0 (socket says 172.21.15.53:36280) 2024-08-31T06:05:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd427fc640 1 -- 172.21.15.53:0/2371056707 learned_addr learned my addr 172.21.15.53:0/2371056707 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd50675740 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 0x55d413028700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd42ffd640 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c332f0 0x55d41300b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd50675740 1 -- 172.21.15.53:0/2371056707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d412e9dab0 con 0x55d412c3b4d0 2024-08-31T06:05:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd50675740 1 -- 172.21.15.53:0/2371056707 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d412eeb680 con 0x55d412c5c1b0 2024-08-31T06:05:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd50675740 1 -- 172.21.15.53:0/2371056707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d41301f410 con 0x55d412c332f0 2024-08-31T06:05:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd437fe640 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 0x55d413028700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd427fc640 1 -- 172.21.15.53:0/2371056707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c332f0 msgr2=0x55d41300b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd427fc640 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c332f0 0x55d41300b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd427fc640 1 -- 172.21.15.53:0/2371056707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 msgr2=0x55d413028700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd427fc640 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 0x55d413028700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.547+0000 7fcd427fc640 1 -- 172.21.15.53:0/2371056707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d412d40620 con 0x55d412c3b4d0 2024-08-31T06:05:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.548+0000 7fcd427fc640 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d41300bf40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcd38005940 tx=0x7fcd38004960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316e59c1c1d77ea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.548+0000 7fcd26ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.548+0000 7fcd50675740 10 client.0 _ll_register_callbacks cb 0x55d412c73a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.548+0000 7fcd26ff5640 1 -- 172.21.15.53:0/2371056707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3804a070 con 0x55d412c3b4d0 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.548+0000 7fcd26ff5640 1 -- 172.21.15.53:0/2371056707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fcd38004c80 con 0x55d412c3b4d0 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.548+0000 7fcd50675740 1 -- 172.21.15.53:0/2371056707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd380054b0 con 0x55d412c3b4d0 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.548+0000 7fcd26ff5640 1 -- 172.21.15.53:0/2371056707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcd38056050 con 0x55d412c3b4d0 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.548+0000 7fcd50675740 10 client.15963 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.548+0000 7fcd50675740 1 -- 172.21.15.53:0/2371056707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d41302b210 con 0x55d412c3b4d0 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.549+0000 7fcd26ff5640 1 -- 172.21.15.53:0/2371056707 <== mon.0 v2:172.21.15.53:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcd38004e80 con 0x55d412c3b4d0 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.549+0000 7fcd50675740 10 client.15963 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.549+0000 7fcd50675740 10 client.15963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.549+0000 7fcd50675740 20 client.15963 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.549+0000 7fcd50675740 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d412c1ad80 0x55d41302e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.549+0000 7fcd50675740 4 client.15963 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.549+0000 7fcd50675740 1 -- 172.21.15.53:0/2371056707 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcd380054b0 con 0x55d412c1ad80 2024-08-31T06:05:38.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.549+0000 7f4c64f4f640 1 -- 172.21.15.53:0/1946705037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c40005580 con 0x7f4c60108220 2024-08-31T06:05:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.550+0000 7fcd42ffd640 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d412c1ad80 0x55d41302e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.550+0000 7f4c57fff640 1 -- 172.21.15.53:0/1946705037 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11985 (secure 0 0 0) 0x7f4c580ac8e0 con 0x7f4c60108220 2024-08-31T06:05:38.556 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:05:38.556 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-08-31T06:04:23:449285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:04:23.359453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:05:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-08-31T06:05:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.550+0000 7fcd26ff5640 10 client.15963 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.550+0000 7fcd42ffd640 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d412c1ad80 0x55d41302e950 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75684809cd03b191 server_cookie=a83fbeffc12cae20 in_seq=0 out_seq=0 2024-08-31T06:05:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd26ff5640 1 -- 172.21.15.53:0/2371056707 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fcd380054b0 con 0x55d412c1ad80 2024-08-31T06:05:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd26ff5640 10 client.15963 handle_command_reply: tid=0 2024-08-31T06:05:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd50675740 1 client.15963 shutdown 2024-08-31T06:05:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd50675740 1 -- 172.21.15.53:0/2371056707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 msgr2=0x55d41300bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd50675740 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d41300bf40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcd38005940 tx=0x7fcd38004960 comp rx=0 tx=0).stop 2024-08-31T06:05:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd50675740 1 -- 172.21.15.53:0/2371056707 shutdown_connections 2024-08-31T06:05:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd50675740 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d412c1ad80 0x55d41302e950 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd50675740 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 0x55d413028700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd50675740 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c3b4d0 0x55d41300bf40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd50675740 1 --2- 172.21.15.53:0/2371056707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c332f0 0x55d41300b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd50675740 1 -- 172.21.15.53:0/2371056707 >> 172.21.15.53:0/2371056707 conn(0x55d412c50300 msgr2=0x55d413002f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.551+0000 7fcd26ff5640 0 client.15963 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.552+0000 7fcd50675740 1 -- 172.21.15.53:0/2371056707 shutdown_connections 2024-08-31T06:05:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.552+0000 7fcd50675740 1 -- 172.21.15.53:0/2371056707 wait complete. 2024-08-31T06:05:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.552+0000 7fcd50675740 20 client.15963 trim_cache size 0 max 16384 2024-08-31T06:05:38.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.553+0000 7f4c64f4f640 1 -- 172.21.15.53:0/1946705037 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c4c0b4ca0 msgr2=0x7f4c4c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.553+0000 7f4c64f4f640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c4c0b4ca0 0x7f4c4c0b71b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c50005fd0 tx=0x7f4c5000a400 comp rx=0 tx=0).stop 2024-08-31T06:05:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.553+0000 7f4c64f4f640 1 -- 172.21.15.53:0/1946705037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c60108220 msgr2=0x7f4c60198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.553+0000 7f4c64f4f640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c60108220 0x7f4c60198430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800eaa0 tx=0x7f4c5800ef60 comp rx=0 tx=0).stop 2024-08-31T06:05:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.553+0000 7f4c64f4f640 1 -- 172.21.15.53:0/1946705037 shutdown_connections 2024-08-31T06:05:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.553+0000 7f4c64f4f640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c4c0b4ca0 0x7f4c4c0b71b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.553+0000 7f4c64f4f640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c60108220 0x7f4c60198430 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.553+0000 7f4c64f4f640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c601078d0 0x7f4c60197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.553+0000 7f4c64f4f640 1 --2- 172.21.15.53:0/1946705037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c60101f90 0x7f4c6019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.553+0000 7f4c64f4f640 1 -- 172.21.15.53:0/1946705037 >> 172.21.15.53:0/1946705037 conn(0x7f4c60077a00 msgr2=0x7f4c60105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.554+0000 7f4c64f4f640 1 -- 172.21.15.53:0/1946705037 shutdown_connections 2024-08-31T06:05:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:38.554+0000 7f4c64f4f640 1 -- 172.21.15.53:0/1946705037 wait complete. 2024-08-31T06:05:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.581+0000 7fcd50675740 1 Processor -- start 2024-08-31T06:05:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.581+0000 7fcd50675740 1 -- start start 2024-08-31T06:05:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.582+0000 7fcd50675740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c50300 0x55d413028600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.582+0000 7fcd50675740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.582+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c50300 0x55d413028600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.582+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c50300 0x55d413028600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44528/0 (socket says 172.21.15.53:44528) 2024-08-31T06:05:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.583+0000 7fcd427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.583+0000 7fcd427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413006ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36288/0 (socket says 172.21.15.53:36288) 2024-08-31T06:05:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.583+0000 7fcd42ffd640 1 -- 172.21.15.53:0/1602435639 learned_addr learned my addr 172.21.15.53:0/1602435639 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.583+0000 7fcd50675740 1 --2- 172.21.15.53:0/1602435639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 0x55d413002d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.583+0000 7fcd50675740 1 -- 172.21.15.53:0/1602435639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcd440731c0 con 0x55d412c332f0 2024-08-31T06:05:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.583+0000 7fcd50675740 1 -- 172.21.15.53:0/1602435639 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44074d00 con 0x55d412c5c1b0 2024-08-31T06:05:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.583+0000 7fcd50675740 1 -- 172.21.15.53:0/1602435639 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44073890 con 0x55d412c50300 2024-08-31T06:05:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.584+0000 7fcd437fe640 1 --2- 172.21.15.53:0/1602435639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 0x55d413002d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.584+0000 7fcd427fc640 1 -- 172.21.15.53:0/1602435639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c50300 msgr2=0x55d413028600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.584+0000 7fcd427fc640 1 --2- 172.21.15.53:0/1602435639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c50300 0x55d413028600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.584+0000 7fcd427fc640 1 -- 172.21.15.53:0/1602435639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 msgr2=0x55d413002d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.584+0000 7fcd427fc640 1 --2- 172.21.15.53:0/1602435639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 0x55d413002d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.584+0000 7fcd427fc640 1 -- 172.21.15.53:0/1602435639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d413002b20 con 0x55d412c332f0 2024-08-31T06:05:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.584+0000 7fcd427fc640 1 --2- 172.21.15.53:0/1602435639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413006ea0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcd3802aa00 tx=0x7fcd38046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241ec0f9ada41cf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.584+0000 7fcd28ff9640 1 -- 172.21.15.53:0/1602435639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3803e070 con 0x55d412c332f0 2024-08-31T06:05:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.584+0000 7fcd28ff9640 1 -- 172.21.15.53:0/1602435639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd38004fd0 con 0x55d412c332f0 2024-08-31T06:05:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.585+0000 7fcd28ff9640 1 -- 172.21.15.53:0/1602435639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3804a040 con 0x55d412c332f0 2024-08-31T06:05:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.586+0000 7fcd50675740 1 -- 172.21.15.53:0/1602435639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 msgr2=0x55d413006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.586+0000 7fcd50675740 1 --2- 172.21.15.53:0/1602435639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413006ea0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcd3802aa00 tx=0x7fcd38046000 comp rx=0 tx=0).stop 2024-08-31T06:05:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.586+0000 7fcd50675740 1 -- 172.21.15.53:0/1602435639 shutdown_connections 2024-08-31T06:05:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.586+0000 7fcd50675740 1 --2- 172.21.15.53:0/1602435639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c5c1b0 0x55d413002d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.586+0000 7fcd50675740 1 --2- 172.21.15.53:0/1602435639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413006ea0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.586+0000 7fcd50675740 1 --2- 172.21.15.53:0/1602435639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c50300 0x55d413028600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.586+0000 7fcd50675740 1 -- 172.21.15.53:0/1602435639 >> 172.21.15.53:0/1602435639 conn(0x55d412ffcf80 msgr2=0x55d413009fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.586+0000 7fcd50675740 1 -- 172.21.15.53:0/1602435639 shutdown_connections 2024-08-31T06:05:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.586+0000 7fcd50675740 1 -- 172.21.15.53:0/1602435639 wait complete. 2024-08-31T06:05:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.586+0000 7fcd50675740 1 -- start start 2024-08-31T06:05:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.587+0000 7fcd50675740 1 Processor -- start 2024-08-31T06:05:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.587+0000 7fcd50675740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.587+0000 7fcd50675740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c50300 0x55d4130089a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.587+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.587+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413034aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36290/0 (socket says 172.21.15.53:36290) 2024-08-31T06:05:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.588+0000 7fcd42ffd640 1 -- 172.21.15.53:0/696280070 learned_addr learned my addr 172.21.15.53:0/696280070 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.588+0000 7fcd50675740 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c5c1b0 0x55d4130090b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.588+0000 7fcd50675740 1 -- 172.21.15.53:0/696280070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44074630 con 0x55d412c332f0 2024-08-31T06:05:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.588+0000 7fcd427fc640 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c50300 0x55d4130089a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.588+0000 7fcd50675740 1 -- 172.21.15.53:0/696280070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44073f60 con 0x55d412c50300 2024-08-31T06:05:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.588+0000 7fcd437fe640 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c5c1b0 0x55d4130090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.588+0000 7fcd50675740 1 -- 172.21.15.53:0/696280070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd440711a0 con 0x55d412c5c1b0 2024-08-31T06:05:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.588+0000 7fcd50675740 10 client.0 _ll_register_callbacks cb 0x7fcd38009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.588+0000 7fcd437fe640 1 -- 172.21.15.53:0/696280070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c50300 msgr2=0x55d4130089a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.588+0000 7fcd437fe640 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c50300 0x55d4130089a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.588+0000 7fcd437fe640 1 -- 172.21.15.53:0/696280070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 msgr2=0x55d413034aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.589+0000 7fcd437fe640 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413034aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.589+0000 7fcd437fe640 1 -- 172.21.15.53:0/696280070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d413027a30 con 0x55d412c5c1b0 2024-08-31T06:05:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.589+0000 7fcd42ffd640 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413034aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.589+0000 7fcd437fe640 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c5c1b0 0x55d4130090b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009420 tx=0x7fcd3c009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c76fb44fcf93f62 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.589+0000 7fcd26ff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:05:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.590+0000 7fcd26ff5640 1 -- 172.21.15.53:0/696280070 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c01fb80 con 0x55d412c5c1b0 2024-08-31T06:05:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.590+0000 7fcd50675740 1 -- 172.21.15.53:0/696280070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd38004fd0 con 0x55d412c5c1b0 2024-08-31T06:05:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.590+0000 7fcd26ff5640 1 -- 172.21.15.53:0/696280070 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fcd3c01fd20 con 0x55d412c5c1b0 2024-08-31T06:05:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.590+0000 7fcd26ff5640 1 -- 172.21.15.53:0/696280070 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcd3c004b20 con 0x55d412c5c1b0 2024-08-31T06:05:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.590+0000 7fcd50675740 10 client.25459 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.590+0000 7fcd50675740 1 -- 172.21.15.53:0/696280070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d413023820 con 0x55d412c5c1b0 2024-08-31T06:05:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.591+0000 7fcd26ff5640 1 -- 172.21.15.53:0/696280070 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd38004fd0 con 0x55d412c5c1b0 2024-08-31T06:05:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.591+0000 7fcd26ff5640 1 -- 172.21.15.53:0/696280070 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcd3c026070 con 0x55d412c5c1b0 2024-08-31T06:05:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.591+0000 7fcd50675740 10 client.25459 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.591+0000 7fcd50675740 10 client.25459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.591+0000 7fcd50675740 20 client.25459 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.591+0000 7fcd50675740 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d412bf01c0 0x55d413023fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.591+0000 7fcd50675740 4 client.25459 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:05:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.591+0000 7fcd50675740 1 -- 172.21.15.53:0/696280070 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d412f76f50 con 0x55d412bf01c0 2024-08-31T06:05:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.591+0000 7fcd42ffd640 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d412bf01c0 0x55d413023fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.592+0000 7fcd42ffd640 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d412bf01c0 0x55d413023fa0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9de2930614bd40e0 server_cookie=4d01018ec617b446 in_seq=0 out_seq=0 2024-08-31T06:05:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.592+0000 7fcd26ff5640 10 client.25459 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.596+0000 7fcd26ff5640 1 -- 172.21.15.53:0/696280070 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d412f76f50 con 0x55d412bf01c0 2024-08-31T06:05:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.596+0000 7fcd26ff5640 10 client.25459 handle_command_reply: tid=0 2024-08-31T06:05:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.596+0000 7fcd50675740 1 client.25459 shutdown 2024-08-31T06:05:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.597+0000 7fcd50675740 1 -- 172.21.15.53:0/696280070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c5c1b0 msgr2=0x55d4130090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.597+0000 7fcd50675740 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c5c1b0 0x55d4130090b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009420 tx=0x7fcd3c009500 comp rx=0 tx=0).stop 2024-08-31T06:05:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.597+0000 7fcd50675740 1 -- 172.21.15.53:0/696280070 shutdown_connections 2024-08-31T06:05:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.597+0000 7fcd50675740 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d412bf01c0 0x55d413023fa0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.597+0000 7fcd26ff5640 0 client.25459 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.597+0000 7fcd50675740 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d412c5c1b0 0x55d4130090b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.597+0000 7fcd50675740 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d412c50300 0x55d4130089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.597+0000 7fcd50675740 1 --2- 172.21.15.53:0/696280070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d412c332f0 0x55d413034aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.597+0000 7fcd50675740 1 -- 172.21.15.53:0/696280070 >> 172.21.15.53:0/696280070 conn(0x55d412ffcf80 msgr2=0x55d413002d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.598+0000 7fcd50675740 1 -- 172.21.15.53:0/696280070 shutdown_connections 2024-08-31T06:05:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.598+0000 7fcd50675740 1 -- 172.21.15.53:0/696280070 wait complete. 2024-08-31T06:05:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.598+0000 7fcd50675740 20 client.25459 trim_cache size 0 max 16384 2024-08-31T06:05:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:05:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:05:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:05:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:05:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.598+0000 7fcd4962e640 1 -- 172.21.15.53:0/1538638436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd2c0b4e70 msgr2=0x7fcd2c0b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.598+0000 7fcd4962e640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd2c0b4e70 0x7fcd2c0b7380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c005fd0 tx=0x7fcd3c004a40 comp rx=0 tx=0).stop 2024-08-31T06:05:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.599+0000 7fcd4962e640 1 -- 172.21.15.53:0/1538638436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd44101f20 msgr2=0x7fcd4419a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.599+0000 7fcd4962e640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd44101f20 0x7fcd4419a150 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400bea0 tx=0x7fcd3400bf90 comp rx=0 tx=0).stop 2024-08-31T06:05:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.599+0000 7fcd4962e640 1 -- 172.21.15.53:0/1538638436 shutdown_connections 2024-08-31T06:05:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.599+0000 7fcd4962e640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd2c0b4e70 0x7fcd2c0b7380 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.599+0000 7fcd4962e640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd441081a0 0x7fcd4419f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.599+0000 7fcd4962e640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd44107850 0x7fcd4419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.599+0000 7fcd4962e640 1 --2- 172.21.15.53:0/1538638436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd44101f20 0x7fcd4419a150 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.599+0000 7fcd4962e640 1 -- 172.21.15.53:0/1538638436 >> 172.21.15.53:0/1538638436 conn(0x7fcd44079c30 msgr2=0x7fcd44105950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.599+0000 7fcd4962e640 1 -- 172.21.15.53:0/1538638436 shutdown_connections 2024-08-31T06:05:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:38.599+0000 7fcd4962e640 1 -- 172.21.15.53:0/1538638436 wait complete. 2024-08-31T06:05:38.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:38 smithi130 ceph-mon[22266]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:38.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:38 smithi153 ceph-mon[22320]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:39.188 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:39 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1946705037' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:39.354 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id b99c59cc --release --await' 2024-08-31T06:05:39.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id b99c59cc --release --await 2024-08-31T06:05:39.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:39 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1946705037' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:39.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:39 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1946705037' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:39.782 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:40.196 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:40 smithi053 ceph-mon[18924]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:40.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.320+0000 7f99da449640 1 -- 172.21.15.53:0/2250468873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d4102f60 msgr2=0x7f99d4103370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.320+0000 7f99da449640 1 --2- 172.21.15.53:0/2250468873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d4102f60 0x7f99d4103370 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009900 tx=0x7f99c402a410 comp rx=0 tx=0).stop 2024-08-31T06:05:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.321+0000 7f99da449640 1 -- 172.21.15.53:0/2250468873 shutdown_connections 2024-08-31T06:05:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.321+0000 7f99da449640 1 --2- 172.21.15.53:0/2250468873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d4105880 0x7f99d410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.321+0000 7f99da449640 1 --2- 172.21.15.53:0/2250468873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d4104f30 0x7f99d4105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.321+0000 7f99da449640 1 --2- 172.21.15.53:0/2250468873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d4102f60 0x7f99d4103370 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.321+0000 7f99da449640 1 -- 172.21.15.53:0/2250468873 >> 172.21.15.53:0/2250468873 conn(0x7f99d4077a00 msgr2=0x7f99d4077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.321+0000 7f99da449640 1 -- 172.21.15.53:0/2250468873 shutdown_connections 2024-08-31T06:05:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.321+0000 7f99da449640 1 -- 172.21.15.53:0/2250468873 wait complete. 2024-08-31T06:05:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.322+0000 7f99da449640 1 Processor -- start 2024-08-31T06:05:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.322+0000 7f99da449640 1 -- start start 2024-08-31T06:05:40.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.323+0000 7f99da449640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d4102f60 0x7f99d419a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.323+0000 7f99da449640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d4104f30 0x7f99d419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.323+0000 7f99da449640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d4105880 0x7f99d419f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.323+0000 7f99da449640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99d41136f0 con 0x7f99d4104f30 2024-08-31T06:05:40.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.323+0000 7f99da449640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99d4113570 con 0x7f99d4102f60 2024-08-31T06:05:40.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.323+0000 7f99da449640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99d4113870 con 0x7f99d4105880 2024-08-31T06:05:40.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.323+0000 7f99d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d4102f60 0x7f99d419a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.323+0000 7f99d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d4102f60 0x7f99d419a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:40858/0 (socket says 172.21.15.53:40858) 2024-08-31T06:05:40.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.323+0000 7f99d3fff640 1 -- 172.21.15.53:0/632613909 learned_addr learned my addr 172.21.15.53:0/632613909 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:40.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.323+0000 7f99d89e6640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d4105880 0x7f99d419f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99d37fe640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d4104f30 0x7f99d419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99d3fff640 1 -- 172.21.15.53:0/632613909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d4105880 msgr2=0x7f99d419f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:40.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99d3fff640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d4105880 0x7f99d419f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99d3fff640 1 -- 172.21.15.53:0/632613909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d4104f30 msgr2=0x7f99d419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:40.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99d3fff640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d4104f30 0x7f99d419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99d3fff640 1 -- 172.21.15.53:0/632613909 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d41a00f0 con 0x7f99d4102f60 2024-08-31T06:05:40.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99d37fe640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d4104f30 0x7f99d419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:40.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99d3fff640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d4102f60 0x7f99d419a180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009230 tx=0x7f99c4004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:40.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99d17fa640 1 -- 172.21.15.53:0/632613909 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c403f030 con 0x7f99d4102f60 2024-08-31T06:05:40.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99da449640 1 -- 172.21.15.53:0/632613909 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d41a0380 con 0x7f99d4102f60 2024-08-31T06:05:40.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99d17fa640 1 -- 172.21.15.53:0/632613909 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c4003a80 con 0x7f99d4102f60 2024-08-31T06:05:40.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99d17fa640 1 -- 172.21.15.53:0/632613909 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4035070 con 0x7f99d4102f60 2024-08-31T06:05:40.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.324+0000 7f99da449640 1 -- 172.21.15.53:0/632613909 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d41a6b40 con 0x7f99d4102f60 2024-08-31T06:05:40.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.328+0000 7f99e09be740 1 Processor -- start 2024-08-31T06:05:40.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.328+0000 7f99e09be740 1 -- start start 2024-08-31T06:05:40.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.328+0000 7f99d17fa640 1 -- 172.21.15.53:0/632613909 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f99c4042030 con 0x7f99d4102f60 2024-08-31T06:05:40.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.328+0000 7f99e09be740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 0x56204eb6b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.328+0000 7f99e09be740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb6bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.328+0000 7f99e09be740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 0x56204eb7e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.328+0000 7f99e09be740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56204eae4a70 con 0x56204e79f660 2024-08-31T06:05:40.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.328+0000 7f99e09be740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56204ead4000 con 0x56204e7a7840 2024-08-31T06:05:40.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.328+0000 7f99e09be740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56204ead7fb0 con 0x56204e7c8520 2024-08-31T06:05:40.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.329+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 0x56204eb7e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.329+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 0x56204eb7e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:40864/0 (socket says 172.21.15.53:40864) 2024-08-31T06:05:40.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.329+0000 7f99d37fe640 1 -- 172.21.15.53:0/1671276153 learned_addr learned my addr 172.21.15.53:0/1671276153 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:40.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.329+0000 7f99d89e6640 1 --2- 172.21.15.53:0/1671276153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 0x56204eb6b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.329+0000 7f99d37fe640 1 -- 172.21.15.53:0/1671276153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 msgr2=0x56204eb6b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:40.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.329+0000 7f99d37fe640 1 --2- 172.21.15.53:0/1671276153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 0x56204eb6b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.329+0000 7f99d37fe640 1 -- 172.21.15.53:0/1671276153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 msgr2=0x56204eb6bc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:05:40.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.329+0000 7f99d37fe640 1 --2- 172.21.15.53:0/1671276153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb6bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.329+0000 7f99d37fe640 1 -- 172.21.15.53:0/1671276153 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56204e833b00 con 0x56204e7a7840 2024-08-31T06:05:40.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.329+0000 7f99d17fa640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d20 0x7f99bc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.330+0000 7f99d37fe640 1 --2- 172.21.15.53:0/1671276153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 0x56204eb7e030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99c8005bc0 tx=0x7f99c800e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4136c1c65efd9eb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.330+0000 7f99d89e6640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d20 0x7f99bc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.330+0000 7f99d17fa640 1 -- 172.21.15.53:0/632613909 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f99c4105a20 con 0x7f99d4102f60 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.330+0000 7f99ba7fc640 1 -- 172.21.15.53:0/1671276153 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8016070 con 0x56204e7a7840 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.330+0000 7f99ba7fc640 1 -- 172.21.15.53:0/1671276153 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c80054b0 con 0x56204e7a7840 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.330+0000 7f99d89e6640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d20 0x7f99bc0b7230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f99cc005fd0 tx=0x7f99cc0096a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.331+0000 7f99e09be740 1 -- 172.21.15.53:0/1671276153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 msgr2=0x56204eb7e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.331+0000 7f99e09be740 1 --2- 172.21.15.53:0/1671276153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 0x56204eb7e030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99c8005bc0 tx=0x7f99c800e6c0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.331+0000 7f99e09be740 1 -- 172.21.15.53:0/1671276153 shutdown_connections 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.331+0000 7f99e09be740 1 --2- 172.21.15.53:0/1671276153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 0x56204eb7e030 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.332+0000 7f99e09be740 1 --2- 172.21.15.53:0/1671276153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb6bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.332+0000 7f99e09be740 1 --2- 172.21.15.53:0/1671276153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 0x56204eb6b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.332+0000 7f99e09be740 1 -- 172.21.15.53:0/1671276153 >> 172.21.15.53:0/1671276153 conn(0x56204e7bc910 msgr2=0x56204eb6dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:40.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.332+0000 7f99e09be740 1 -- 172.21.15.53:0/1671276153 shutdown_connections 2024-08-31T06:05:40.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.332+0000 7f99e09be740 1 -- 172.21.15.53:0/1671276153 wait complete. 2024-08-31T06:05:40.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.332+0000 7f99e09be740 1 -- start start 2024-08-31T06:05:40.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.333+0000 7f99e09be740 1 Processor -- start 2024-08-31T06:05:40.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.333+0000 7f99e09be740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb7bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.333+0000 7f99e09be740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 0x56204eb7c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.333+0000 7f99e09be740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 0x56204eb8e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.333+0000 7f99e09be740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56204eb7ebd0 con 0x56204e79f660 2024-08-31T06:05:40.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.333+0000 7f99e09be740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56204ea95520 con 0x56204e7a7840 2024-08-31T06:05:40.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.333+0000 7f99e09be740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56204eb7ed50 con 0x56204e7c8520 2024-08-31T06:05:40.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.333+0000 7f99e09be740 10 client.0 _ll_register_callbacks cb 0x56204eacdc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.334+0000 7f99d89e6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 0x56204eb8e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.334+0000 7f99d3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb7bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.334+0000 7f99d89e6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 0x56204eb8e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44572/0 (socket says 172.21.15.53:44572) 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.334+0000 7f99d89e6640 1 -- 172.21.15.53:0/3239237345 learned_addr learned my addr 172.21.15.53:0/3239237345 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.334+0000 7f99d37fe640 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 0x56204eb7c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.334+0000 7f99d89e6640 1 -- 172.21.15.53:0/3239237345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 msgr2=0x56204eb7c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.334+0000 7f99d89e6640 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 0x56204eb7c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.334+0000 7f99d89e6640 1 -- 172.21.15.53:0/3239237345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 msgr2=0x56204eb7bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.335+0000 7f99d89e6640 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb7bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.335+0000 7f99d89e6640 1 -- 172.21.15.53:0/3239237345 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56204e8aa960 con 0x56204e7c8520 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.335+0000 7f99d3fff640 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb7bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:40.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.335+0000 7f99d89e6640 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 0x56204eb8e1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0107c0 tx=0x7f99cc004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbb3bedf5ca4ec8b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:40.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.335+0000 7f99b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:05:40.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.335+0000 7f99b37fe640 1 -- 172.21.15.53:0/3239237345 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc004b20 con 0x56204e7c8520 2024-08-31T06:05:40.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.335+0000 7f99b37fe640 1 -- 172.21.15.53:0/3239237345 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f99cc017030 con 0x56204e7c8520 2024-08-31T06:05:40.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.335+0000 7f99e09be740 1 -- 172.21.15.53:0/3239237345 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56204ea739a0 con 0x56204e7c8520 2024-08-31T06:05:40.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.336+0000 7f99b37fe640 1 -- 172.21.15.53:0/3239237345 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99cc004cc0 con 0x56204e7c8520 2024-08-31T06:05:40.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.336+0000 7f99e09be740 10 client.25471 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:40.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.336+0000 7f99e09be740 1 -- 172.21.15.53:0/3239237345 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56204eb90e90 con 0x56204e7c8520 2024-08-31T06:05:40.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.336+0000 7f99b37fe640 1 -- 172.21.15.53:0/3239237345 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99cc01fe40 con 0x56204e7c8520 2024-08-31T06:05:40.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.336+0000 7f99b37fe640 1 -- 172.21.15.53:0/3239237345 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f99cc030b40 con 0x56204e7c8520 2024-08-31T06:05:40.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.336+0000 7f99e09be740 10 client.25471 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.336+0000 7f99e09be740 10 client.25471 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.336+0000 7f99e09be740 20 client.25471 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.337+0000 7f99e09be740 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56204e786ea0 0x56204eb943f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.337+0000 7f99e09be740 4 client.25471 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.337+0000 7f99e09be740 1 -- 172.21.15.53:0/3239237345 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56204ea739a0 con 0x56204e786ea0 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.337+0000 7f99d3fff640 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56204e786ea0 0x56204eb943f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.338+0000 7f99d3fff640 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56204e786ea0 0x56204eb943f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=194be4e5a6123816 server_cookie=7b622a11e5e92602 in_seq=0 out_seq=0 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.338+0000 7f99b37fe640 10 client.25471 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99b37fe640 1 -- 172.21.15.53:0/3239237345 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56204ea739a0 con 0x56204e786ea0 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99b37fe640 10 client.25471 handle_command_reply: tid=0 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99e09be740 1 client.25471 shutdown 2024-08-31T06:05:40.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99e09be740 1 -- 172.21.15.53:0/3239237345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 msgr2=0x56204eb8e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99e09be740 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 0x56204eb8e1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0107c0 tx=0x7f99cc004ab0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99e09be740 1 -- 172.21.15.53:0/3239237345 shutdown_connections 2024-08-31T06:05:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99e09be740 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56204e786ea0 0x56204eb943f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99e09be740 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7c8520 0x56204eb8e1c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99e09be740 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7a7840 0x56204eb7c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99e09be740 1 --2- 172.21.15.53:0/3239237345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb7bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99e09be740 1 -- 172.21.15.53:0/3239237345 >> 172.21.15.53:0/3239237345 conn(0x56204e7bc910 msgr2=0x56204eb6cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.339+0000 7f99b37fe640 0 client.25471 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.340+0000 7f99e09be740 1 -- 172.21.15.53:0/3239237345 shutdown_connections 2024-08-31T06:05:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.340+0000 7f99e09be740 1 -- 172.21.15.53:0/3239237345 wait complete. 2024-08-31T06:05:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.340+0000 7f99e09be740 20 client.25471 trim_cache size 0 max 16384 2024-08-31T06:05:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.357+0000 7f99e09be740 1 Processor -- start 2024-08-31T06:05:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.357+0000 7f99e09be740 1 -- start start 2024-08-31T06:05:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99e09be740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb78ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99e09be740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb79530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99e09be740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7c8520 0x56204eb8de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99e09be740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99c000e920 con 0x56204e79f660 2024-08-31T06:05:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99e09be740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0010460 con 0x56204e7c8520 2024-08-31T06:05:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99e09be740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99c000eff0 con 0x56204e7a7840 2024-08-31T06:05:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb79530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb79530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44588/0 (socket says 172.21.15.53:44588) 2024-08-31T06:05:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99d37fe640 1 -- 172.21.15.53:0/860774098 learned_addr learned my addr 172.21.15.53:0/860774098 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99d89e6640 1 --2- 172.21.15.53:0/860774098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7c8520 0x56204eb8de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99d37fe640 1 -- 172.21.15.53:0/860774098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7c8520 msgr2=0x56204eb8de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99d37fe640 1 --2- 172.21.15.53:0/860774098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7c8520 0x56204eb8de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.358+0000 7f99d37fe640 1 -- 172.21.15.53:0/860774098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 msgr2=0x56204eb78ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:05:40.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.359+0000 7f99d3fff640 1 --2- 172.21.15.53:0/860774098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb78ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.359+0000 7f99d37fe640 1 --2- 172.21.15.53:0/860774098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb78ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.359+0000 7f99d37fe640 1 -- 172.21.15.53:0/860774098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56204eb84550 con 0x56204e7a7840 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.359+0000 7f99d3fff640 1 --2- 172.21.15.53:0/860774098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb78ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.359+0000 7f99d37fe640 1 --2- 172.21.15.53:0/860774098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb79530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009bf0 tx=0x7f99c80092a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cc32ca79046fad9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.359+0000 7f99b9ffb640 1 -- 172.21.15.53:0/860774098 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8029070 con 0x56204e7a7840 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.359+0000 7f99b9ffb640 1 -- 172.21.15.53:0/860774098 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c8004b10 con 0x56204e7a7840 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.359+0000 7f99b9ffb640 1 -- 172.21.15.53:0/860774098 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8016040 con 0x56204e7a7840 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.360+0000 7f99e09be740 1 -- 172.21.15.53:0/860774098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 msgr2=0x56204eb79530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.360+0000 7f99e09be740 1 --2- 172.21.15.53:0/860774098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb79530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009bf0 tx=0x7f99c80092a0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.360+0000 7f99e09be740 1 -- 172.21.15.53:0/860774098 shutdown_connections 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.360+0000 7f99e09be740 1 --2- 172.21.15.53:0/860774098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e7c8520 0x56204eb8de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.360+0000 7f99e09be740 1 --2- 172.21.15.53:0/860774098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb79530 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.360+0000 7f99e09be740 1 --2- 172.21.15.53:0/860774098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e79f660 0x56204eb78ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.360+0000 7f99e09be740 1 -- 172.21.15.53:0/860774098 >> 172.21.15.53:0/860774098 conn(0x56204e7bc910 msgr2=0x56204eb7a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:40.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.361+0000 7f99e09be740 1 -- 172.21.15.53:0/860774098 shutdown_connections 2024-08-31T06:05:40.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.361+0000 7f99e09be740 1 -- 172.21.15.53:0/860774098 wait complete. 2024-08-31T06:05:40.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.361+0000 7f99e09be740 1 -- start start 2024-08-31T06:05:40.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.361+0000 7f99e09be740 1 Processor -- start 2024-08-31T06:05:40.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99e09be740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e79f660 0x56204eb8a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99e09be740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb8a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99e09be740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e7c8520 0x56204eb86ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99e09be740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99c000fd90 con 0x56204e7c8520 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99e09be740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99c000f6c0 con 0x56204e79f660 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99e09be740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99c000c900 con 0x56204e7a7840 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99e09be740 10 client.0 _ll_register_callbacks cb 0x7f99cc010650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb8a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb8a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44592/0 (socket says 172.21.15.53:44592) 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99d37fe640 1 -- 172.21.15.53:0/215555580 learned_addr learned my addr 172.21.15.53:0/215555580 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99d89e6640 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e7c8520 0x56204eb86ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99d37fe640 1 -- 172.21.15.53:0/215555580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e79f660 msgr2=0x56204eb8a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99d37fe640 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e79f660 0x56204eb8a2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99d37fe640 1 -- 172.21.15.53:0/215555580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e7c8520 msgr2=0x56204eb86ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:40.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99d37fe640 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e7c8520 0x56204eb86ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.362+0000 7f99d37fe640 1 -- 172.21.15.53:0/215555580 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56204eb87780 con 0x56204e7a7840 2024-08-31T06:05:40.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.363+0000 7f99d37fe640 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb8a890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99c8004960 tx=0x7f99c8004990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b58bf1bb1729dbd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:40.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.363+0000 7f99b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:05:40.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.363+0000 7f99b37fe640 1 -- 172.21.15.53:0/215555580 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8029020 con 0x56204e7a7840 2024-08-31T06:05:40.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.363+0000 7f99b37fe640 1 -- 172.21.15.53:0/215555580 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f99c80054e0 con 0x56204e7a7840 2024-08-31T06:05:40.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.363+0000 7f99e09be740 1 -- 172.21.15.53:0/215555580 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c8004b10 con 0x56204e7a7840 2024-08-31T06:05:40.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.364+0000 7f99b37fe640 1 -- 172.21.15.53:0/215555580 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99c8016070 con 0x56204e7a7840 2024-08-31T06:05:40.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.364+0000 7f99e09be740 10 client.25477 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:40.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.364+0000 7f99e09be740 1 -- 172.21.15.53:0/215555580 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56204ebff8f0 con 0x56204e7a7840 2024-08-31T06:05:40.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.364+0000 7f99b37fe640 1 -- 172.21.15.53:0/215555580 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c8004b10 con 0x56204e7a7840 2024-08-31T06:05:40.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.364+0000 7f99b37fe640 1 -- 172.21.15.53:0/215555580 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f99c800f040 con 0x56204e7a7840 2024-08-31T06:05:40.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.364+0000 7f99e09be740 10 client.25477 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:40.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.364+0000 7f99e09be740 10 client.25477 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:05:40.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.364+0000 7f99e09be740 20 client.25477 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:40.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.364+0000 7f99e09be740 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56204e75c250 0x56204ec01d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:40.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.364+0000 7f99e09be740 4 client.25477 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b99c59cc", "release": true, "await": true}] 2024-08-31T06:05:40.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.364+0000 7f99e09be740 1 -- 172.21.15.53:0/215555580 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b99c59cc", "release": true, "await": true}) -- 0x56204eae69c0 con 0x56204e75c250 2024-08-31T06:05:40.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.365+0000 7f99d3fff640 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56204e75c250 0x56204ec01d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:40.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.365+0000 7f99b37fe640 10 client.25477 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:40.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.366+0000 7f99d3fff640 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56204e75c250 0x56204ec01d90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13029db8d57797a1 server_cookie=ec5d9ddebadc4267 in_seq=0 out_seq=0 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99b37fe640 1 -- 172.21.15.53:0/215555580 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56204eae69c0 con 0x56204e75c250 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99b37fe640 10 client.25477 handle_command_reply: tid=0 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99e09be740 1 client.25477 shutdown 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99e09be740 1 -- 172.21.15.53:0/215555580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 msgr2=0x56204eb8a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99e09be740 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb8a890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99c8004960 tx=0x7f99c8004990 comp rx=0 tx=0).stop 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99e09be740 1 -- 172.21.15.53:0/215555580 shutdown_connections 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99e09be740 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56204e75c250 0x56204ec01d90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99b37fe640 0 client.25477 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99e09be740 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56204e7c8520 0x56204eb86ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99e09be740 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56204e7a7840 0x56204eb8a890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99e09be740 1 --2- 172.21.15.53:0/215555580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56204e79f660 0x56204eb8a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.369+0000 7f99e09be740 1 -- 172.21.15.53:0/215555580 >> 172.21.15.53:0/215555580 conn(0x56204e7bc910 msgr2=0x56204eb7d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:40.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.370+0000 7f99e09be740 1 -- 172.21.15.53:0/215555580 shutdown_connections 2024-08-31T06:05:40.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.370+0000 7f99e09be740 1 -- 172.21.15.53:0/215555580 wait complete. 2024-08-31T06:05:40.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.370+0000 7f99e09be740 20 client.25477 trim_cache size 0 max 16384 2024-08-31T06:05:40.373 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:05:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 28, 2024-08-31T06:05:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:05:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 4, 2024-08-31T06:05:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:05:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "b99c59cc": { 2024-08-31T06:05:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 4, 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 146.4, 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:05:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:40.375 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:05:40.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.371+0000 7f99da449640 1 -- 172.21.15.53:0/632613909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d20 msgr2=0x7f99bc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:40.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.371+0000 7f99da449640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d20 0x7f99bc0b7230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f99cc005fd0 tx=0x7f99cc0096a0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.371+0000 7f99da449640 1 -- 172.21.15.53:0/632613909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d4102f60 msgr2=0x7f99d419a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:40.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.371+0000 7f99da449640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d4102f60 0x7f99d419a180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009230 tx=0x7f99c4004270 comp rx=0 tx=0).stop 2024-08-31T06:05:40.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.372+0000 7f99da449640 1 -- 172.21.15.53:0/632613909 shutdown_connections 2024-08-31T06:05:40.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.372+0000 7f99da449640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d20 0x7f99bc0b7230 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.372+0000 7f99da449640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d4105880 0x7f99d419f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.372+0000 7f99da449640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d4104f30 0x7f99d419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.372+0000 7f99da449640 1 --2- 172.21.15.53:0/632613909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d4102f60 0x7f99d419a180 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:40.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.372+0000 7f99da449640 1 -- 172.21.15.53:0/632613909 >> 172.21.15.53:0/632613909 conn(0x7f99d4077a00 msgr2=0x7f99d4106ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:40.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.372+0000 7f99da449640 1 -- 172.21.15.53:0/632613909 shutdown_connections 2024-08-31T06:05:40.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:40.372+0000 7f99da449640 1 -- 172.21.15.53:0/632613909 wait complete. 2024-08-31T06:05:40.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:40 smithi130 ceph-mon[22266]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:40.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:40 smithi153 ceph-mon[22320]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:41.191 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b99c59cc', total seconds elapsed: 30.5 2024-08-31T06:05:41.191 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.4 2024-08-31T06:05:41.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:05:41.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:41 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:05:41.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:05:41.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:41.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:41.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:41.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:41 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:41.493 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:41.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:41 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:05:41.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:05:41.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:41.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:41.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:41.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:41 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:41.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:41 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:05:41.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:05:41.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:41.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:41.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:41.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:41 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:42.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.149+0000 7fcd06544640 1 -- 172.21.15.53:0/202859578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00109250 msgr2=0x7fcd00109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.149+0000 7fcd06544640 1 --2- 172.21.15.53:0/202859578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00109250 0x7fcd00109660 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009900 tx=0x7fccf402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.149+0000 7fcd06544640 1 -- 172.21.15.53:0/202859578 shutdown_connections 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.149+0000 7fcd06544640 1 --2- 172.21.15.53:0/202859578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00109ba0 0x7fcd001103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.149+0000 7fcd06544640 1 --2- 172.21.15.53:0/202859578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00109250 0x7fcd00109660 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.149+0000 7fcd06544640 1 --2- 172.21.15.53:0/202859578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd00101d10 0x7fcd00102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.149+0000 7fcd06544640 1 -- 172.21.15.53:0/202859578 >> 172.21.15.53:0/202859578 conn(0x7fcd00077a00 msgr2=0x7fcd00077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.150+0000 7fcd06544640 1 -- 172.21.15.53:0/202859578 shutdown_connections 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.150+0000 7fcd06544640 1 -- 172.21.15.53:0/202859578 wait complete. 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.151+0000 7fcd06544640 1 Processor -- start 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.151+0000 7fcd06544640 1 -- start start 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.151+0000 7fcd06544640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd00101d10 0x7fcd0019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.151+0000 7fcd06544640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00109250 0x7fcd0019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:42.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.151+0000 7fcd06544640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00109ba0 0x7fcd0019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.151+0000 7fcd06544640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcd00113750 con 0x7fcd00109ba0 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.151+0000 7fcd06544640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcd001135d0 con 0x7fcd00101d10 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.151+0000 7fcd06544640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd001138d0 con 0x7fcd00109250 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.151+0000 7fcd04ae1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00109ba0 0x7fcd0019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.151+0000 7fcd04ae1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00109ba0 0x7fcd0019fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36356/0 (socket says 172.21.15.53:36356) 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.151+0000 7fcd04ae1640 1 -- 172.21.15.53:0/2660700582 learned_addr learned my addr 172.21.15.53:0/2660700582 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.152+0000 7fccfffff640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd00101d10 0x7fcd0019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.152+0000 7fccff7fe640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00109250 0x7fcd0019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.152+0000 7fcd04ae1640 1 -- 172.21.15.53:0/2660700582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00109250 msgr2=0x7fcd0019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.152+0000 7fcd04ae1640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00109250 0x7fcd0019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.152+0000 7fcd04ae1640 1 -- 172.21.15.53:0/2660700582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd00101d10 msgr2=0x7fcd0019a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.152+0000 7fcd04ae1640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd00101d10 0x7fcd0019a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:42.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.152+0000 7fcd04ae1640 1 -- 172.21.15.53:0/2660700582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd001a0130 con 0x7fcd00109ba0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.152+0000 7fcd04ae1640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00109ba0 0x7fcd0019fa00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fccf800eb10 tx=0x7fccf800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.152+0000 7fccfd7fa640 1 -- 172.21.15.53:0/2660700582 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf8004b20 con 0x7fcd00109ba0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.152+0000 7fcd06544640 1 -- 172.21.15.53:0/2660700582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd001a0420 con 0x7fcd00109ba0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.153+0000 7fccfd7fa640 1 -- 172.21.15.53:0/2660700582 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccf8004cc0 con 0x7fcd00109ba0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.153+0000 7fcd06544640 1 -- 172.21.15.53:0/2660700582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd001a6b80 con 0x7fcd00109ba0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.154+0000 7fccfd7fa640 1 -- 172.21.15.53:0/2660700582 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf8018630 con 0x7fcd00109ba0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.154+0000 7fcd06544640 1 -- 172.21.15.53:0/2660700582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd00102120 con 0x7fcd00109ba0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.157+0000 7fccfd7fa640 1 -- 172.21.15.53:0/2660700582 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fccf8005000 con 0x7fcd00109ba0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.158+0000 7fccfd7fa640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcce80b4ca0 0x7fcce80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.158+0000 7fccfd7fa640 1 -- 172.21.15.53:0/2660700582 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fccf80e6280 con 0x7fcd00109ba0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.158+0000 7fccfffff640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcce80b4ca0 0x7fcce80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.159+0000 7fccfffff640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcce80b4ca0 0x7fcce80b71b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fccf00098e0 tx=0x7fccf0008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:42.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.160+0000 7fccfd7fa640 1 -- 172.21.15.53:0/2660700582 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fccf80ad070 con 0x7fcd00109ba0 2024-08-31T06:05:42.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.385+0000 7fcd06544640 1 -- 172.21.15.53:0/2660700582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd0019b2f0 con 0x7fcd00109ba0 2024-08-31T06:05:42.388 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:42 smithi053 ceph-mon[18924]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:05:42.388 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:42.388 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:42.388 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:05:42.388 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:05:42.388 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:42.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.386+0000 7fccfd7fa640 1 -- 172.21.15.53:0/2660700582 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11985 (secure 0 0 0) 0x7fcd0019b2f0 con 0x7fcd00109ba0 2024-08-31T06:05:42.389 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:05:42.389 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-08-31T06:04:23:449285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:04:23.359453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:05:42.390 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-08-31T06:05:42.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.389+0000 7fcd06544640 1 -- 172.21.15.53:0/2660700582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcce80b4ca0 msgr2=0x7fcce80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:42.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.389+0000 7fcd06544640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcce80b4ca0 0x7fcce80b71b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fccf00098e0 tx=0x7fccf0008040 comp rx=0 tx=0).stop 2024-08-31T06:05:42.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.389+0000 7fcd06544640 1 -- 172.21.15.53:0/2660700582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00109ba0 msgr2=0x7fcd0019fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:42.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.389+0000 7fcd06544640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00109ba0 0x7fcd0019fa00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fccf800eb10 tx=0x7fccf800c2d0 comp rx=0 tx=0).stop 2024-08-31T06:05:42.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.390+0000 7fcd06544640 1 -- 172.21.15.53:0/2660700582 shutdown_connections 2024-08-31T06:05:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.390+0000 7fcd06544640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcce80b4ca0 0x7fcce80b71b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.390+0000 7fcd06544640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd00109ba0 0x7fcd0019fa00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.390+0000 7fcd06544640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00109250 0x7fcd0019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.390+0000 7fcd06544640 1 --2- 172.21.15.53:0/2660700582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd00101d10 0x7fcd0019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.390+0000 7fcd06544640 1 -- 172.21.15.53:0/2660700582 >> 172.21.15.53:0/2660700582 conn(0x7fcd00077a00 msgr2=0x7fcd00107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.390+0000 7fcd06544640 1 -- 172.21.15.53:0/2660700582 shutdown_connections 2024-08-31T06:05:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:42.390+0000 7fcd06544640 1 -- 172.21.15.53:0/2660700582 wait complete. 2024-08-31T06:05:42.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:42 smithi130 ceph-mon[22266]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:05:42.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:42.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:42.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:05:42.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:05:42.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:42 smithi153 ceph-mon[22320]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:05:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:42.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:42.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:05:42.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:05:42.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:05:43.141 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0' 2024-08-31T06:05:43.142 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0 2024-08-31T06:05:43.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2660700582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:43.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:43 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2660700582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:43.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:43 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2660700582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:44.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.029+0000 7fe39772a640 1 -- 172.21.15.53:0/1354012161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3901050c0 msgr2=0x7fe39010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:44.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.029+0000 7fe39772a640 1 --2- 172.21.15.53:0/1354012161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3901050c0 0x7fe39010d610 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe380009900 tx=0x7fe38002a410 comp rx=0 tx=0).stop 2024-08-31T06:05:44.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.029+0000 7fe39772a640 1 -- 172.21.15.53:0/1354012161 shutdown_connections 2024-08-31T06:05:44.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.029+0000 7fe39772a640 1 --2- 172.21.15.53:0/1354012161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe39010dbd0 0x7fe3901100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.029+0000 7fe39772a640 1 --2- 172.21.15.53:0/1354012161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3901050c0 0x7fe39010d610 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.029+0000 7fe39772a640 1 --2- 172.21.15.53:0/1354012161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe390104770 0x7fe390104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.029+0000 7fe39772a640 1 -- 172.21.15.53:0/1354012161 >> 172.21.15.53:0/1354012161 conn(0x7fe390079500 msgr2=0x7fe390079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:44.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.029+0000 7fe39772a640 1 -- 172.21.15.53:0/1354012161 shutdown_connections 2024-08-31T06:05:44.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.029+0000 7fe39772a640 1 -- 172.21.15.53:0/1354012161 wait complete. 2024-08-31T06:05:44.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.030+0000 7fe39772a640 1 Processor -- start 2024-08-31T06:05:44.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.030+0000 7fe39772a640 1 -- start start 2024-08-31T06:05:44.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe39772a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe390104770 0x7fe39019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe39772a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3901050c0 0x7fe39019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe39772a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe39010dbd0 0x7fe39019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe39772a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe3901136a0 con 0x7fe390104770 2024-08-31T06:05:44.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe39772a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe390113520 con 0x7fe39010dbd0 2024-08-31T06:05:44.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe39772a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe390113820 con 0x7fe3901050c0 2024-08-31T06:05:44.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe3954c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe390104770 0x7fe39019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe3954c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe390104770 0x7fe39019a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55184/0 (socket says 172.21.15.53:55184) 2024-08-31T06:05:44.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe3954c6640 1 -- 172.21.15.53:0/2103911142 learned_addr learned my addr 172.21.15.53:0/2103911142 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:44.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe395cc7640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe39010dbd0 0x7fe39019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe394cc5640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3901050c0 0x7fe39019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe3954c6640 1 -- 172.21.15.53:0/2103911142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3901050c0 msgr2=0x7fe39019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:44.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe3954c6640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3901050c0 0x7fe39019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe3954c6640 1 -- 172.21.15.53:0/2103911142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe39010dbd0 msgr2=0x7fe39019f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:44.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.031+0000 7fe3954c6640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe39010dbd0 0x7fe39019f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.032+0000 7fe3954c6640 1 -- 172.21.15.53:0/2103911142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3901a00c0 con 0x7fe390104770 2024-08-31T06:05:44.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.032+0000 7fe394cc5640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3901050c0 0x7fe39019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:44.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.032+0000 7fe3954c6640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe390104770 0x7fe39019a150 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00d770 tx=0x7fe38c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.032+0000 7fe3867fc640 1 -- 172.21.15.53:0/2103911142 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c017070 con 0x7fe390104770 2024-08-31T06:05:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.032+0000 7fe39772a640 1 -- 172.21.15.53:0/2103911142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3901a03b0 con 0x7fe390104770 2024-08-31T06:05:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.032+0000 7fe39772a640 1 -- 172.21.15.53:0/2103911142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3901a6b10 con 0x7fe390104770 2024-08-31T06:05:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.033+0000 7fe3867fc640 1 -- 172.21.15.53:0/2103911142 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe38c009c30 con 0x7fe390104770 2024-08-31T06:05:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.033+0000 7fe3867fc640 1 -- 172.21.15.53:0/2103911142 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c020060 con 0x7fe390104770 2024-08-31T06:05:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.037+0000 7fe3867fc640 1 -- 172.21.15.53:0/2103911142 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe38c010460 con 0x7fe390104770 2024-08-31T06:05:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.038+0000 7fe3867fc640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe37c0b50a0 0x7fe37c0b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.039+0000 7fe3867fc640 1 -- 172.21.15.53:0/2103911142 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fe38c009a30 con 0x7fe390104770 2024-08-31T06:05:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.039+0000 7fe394cc5640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe37c0b50a0 0x7fe37c0b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.039+0000 7fe39dc9f740 1 Processor -- start 2024-08-31T06:05:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.039+0000 7fe394cc5640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe37c0b50a0 0x7fe37c0b75b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe380006010 tx=0x7fe380000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.040+0000 7fe39dc9f740 1 -- start start 2024-08-31T06:05:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.040+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f5050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.040+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f130980 0x55894f5055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.040+0000 7fe3954c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f5050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.040+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f138b60 0x55894f505b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.040+0000 7fe3954c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f5050a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55188/0 (socket says 172.21.15.53:55188) 2024-08-31T06:05:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.040+0000 7fe394cc5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f130980 0x55894f5055e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.041+0000 7fe39dc9f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55894f475330 con 0x55894f159840 2024-08-31T06:05:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.041+0000 7fe39dc9f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55894f4648c0 con 0x55894f130980 2024-08-31T06:05:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.041+0000 7fe39dc9f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55894f468870 con 0x55894f138b60 2024-08-31T06:05:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.041+0000 7fe394cc5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f130980 0x55894f5055e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:44036/0 (socket says 172.21.15.53:44036) 2024-08-31T06:05:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.041+0000 7fe395cc7640 1 --2- 172.21.15.53:0/2843058744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f138b60 0x55894f505b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.041+0000 7fe3954c6640 1 -- 172.21.15.53:0/2843058744 learned_addr learned my addr 172.21.15.53:0/2843058744 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.041+0000 7fe395cc7640 1 -- 172.21.15.53:0/2843058744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f130980 msgr2=0x55894f5055e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.041+0000 7fe395cc7640 1 --2- 172.21.15.53:0/2843058744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f130980 0x55894f5055e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.041+0000 7fe395cc7640 1 -- 172.21.15.53:0/2843058744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 msgr2=0x55894f5050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.041+0000 7fe395cc7640 1 --2- 172.21.15.53:0/2843058744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f5050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.041+0000 7fe395cc7640 1 -- 172.21.15.53:0/2843058744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894f41cdf0 con 0x55894f138b60 2024-08-31T06:05:44.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.042+0000 7fe395cc7640 1 --2- 172.21.15.53:0/2843058744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f138b60 0x55894f505b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe388009f30 tx=0x7fe388010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8944a26dccf6d14 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:44.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.042+0000 7fe37b7fe640 1 -- 172.21.15.53:0/2843058744 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388016070 con 0x55894f138b60 2024-08-31T06:05:44.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.042+0000 7fe37b7fe640 1 -- 172.21.15.53:0/2843058744 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe388004d20 con 0x55894f138b60 2024-08-31T06:05:44.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.042+0000 7fe37b7fe640 1 -- 172.21.15.53:0/2843058744 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3880126b0 con 0x55894f138b60 2024-08-31T06:05:44.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.043+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2843058744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f138b60 msgr2=0x55894f505b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:44.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.043+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2843058744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f138b60 0x55894f505b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe388009f30 tx=0x7fe388010800 comp rx=0 tx=0).stop 2024-08-31T06:05:44.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.043+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2843058744 shutdown_connections 2024-08-31T06:05:44.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.043+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2843058744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f138b60 0x55894f505b20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.043+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2843058744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f130980 0x55894f5055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.043+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2843058744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f5050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.043+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2843058744 >> 172.21.15.53:0/2843058744 conn(0x55894f14d990 msgr2=0x55894f502f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:44.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.044+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2843058744 shutdown_connections 2024-08-31T06:05:44.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.044+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2843058744 wait complete. 2024-08-31T06:05:44.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.044+0000 7fe39dc9f740 1 -- start start 2024-08-31T06:05:44.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.045+0000 7fe39dc9f740 1 Processor -- start 2024-08-31T06:05:44.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.045+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f130980 0x55894f510820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 0x55894f510d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f51cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe39dc9f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55894f2c77a0 con 0x55894f159840 2024-08-31T06:05:44.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe395cc7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f51cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe394cc5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 0x55894f510d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe394cc5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 0x55894f510d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:44050/0 (socket says 172.21.15.53:44050) 2024-08-31T06:05:44.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe394cc5640 1 -- 172.21.15.53:0/2030331241 learned_addr learned my addr 172.21.15.53:0/2030331241 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:44.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe395cc7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f51cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55200/0 (socket says 172.21.15.53:55200) 2024-08-31T06:05:44.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2030331241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55894f3eb240 con 0x55894f138b60 2024-08-31T06:05:44.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2030331241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55894f513880 con 0x55894f130980 2024-08-31T06:05:44.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe3954c6640 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f130980 0x55894f510820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.046+0000 7fe39dc9f740 10 client.0 _ll_register_callbacks cb 0x55894f171090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.047+0000 7fe395cc7640 1 -- 172.21.15.53:0/2030331241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f130980 msgr2=0x55894f510820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.047+0000 7fe395cc7640 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f130980 0x55894f510820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.047+0000 7fe395cc7640 1 -- 172.21.15.53:0/2030331241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 msgr2=0x55894f510d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.047+0000 7fe395cc7640 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 0x55894f510d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.047+0000 7fe395cc7640 1 -- 172.21.15.53:0/2030331241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55894f4212b0 con 0x55894f159840 2024-08-31T06:05:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.047+0000 7fe3954c6640 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f130980 0x55894f510820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:05:44.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.047+0000 7fe395cc7640 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f51cbd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe388005b40 tx=0x7fe388004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdca0a463face257 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:44.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.047+0000 7fe378ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:44.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.047+0000 7fe378ff9640 1 -- 172.21.15.53:0/2030331241 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388016070 con 0x55894f159840 2024-08-31T06:05:44.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.047+0000 7fe378ff9640 1 -- 172.21.15.53:0/2030331241 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fe3880053e0 con 0x55894f159840 2024-08-31T06:05:44.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.047+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2030331241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe388004d20 con 0x55894f159840 2024-08-31T06:05:44.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.048+0000 7fe378ff9640 1 -- 172.21.15.53:0/2030331241 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe3880055e0 con 0x55894f159840 2024-08-31T06:05:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.048+0000 7fe39dc9f740 10 client.15996 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.048+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2030331241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55894f1d3b90 con 0x55894f159840 2024-08-31T06:05:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.048+0000 7fe378ff9640 1 -- 172.21.15.53:0/2030331241 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe388004d20 con 0x55894f159840 2024-08-31T06:05:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.048+0000 7fe378ff9640 1 -- 172.21.15.53:0/2030331241 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe38800f040 con 0x55894f159840 2024-08-31T06:05:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.048+0000 7fe39dc9f740 10 client.15996 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.048+0000 7fe39dc9f740 10 client.15996 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:05:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.048+0000 7fe39dc9f740 20 client.15996 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.048+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894f1181c0 0x55894f522d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.048+0000 7fe39dc9f740 4 client.15996 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.048+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2030331241 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55894f477280 con 0x55894f1181c0 2024-08-31T06:05:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.049+0000 7fe3954c6640 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894f1181c0 0x55894f522d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.049+0000 7fe378ff9640 10 client.15996 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.049+0000 7fe3954c6640 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894f1181c0 0x55894f522d10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad8b95cb98032e87 server_cookie=520569b3faa904c3 in_seq=0 out_seq=0 2024-08-31T06:05:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe378ff9640 1 -- 172.21.15.53:0/2030331241 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55894f477280 con 0x55894f1181c0 2024-08-31T06:05:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe378ff9640 10 client.15996 handle_command_reply: tid=0 2024-08-31T06:05:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe39dc9f740 1 client.15996 shutdown 2024-08-31T06:05:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2030331241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 msgr2=0x55894f51cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f51cbd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe388005b40 tx=0x7fe388004c70 comp rx=0 tx=0).stop 2024-08-31T06:05:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2030331241 shutdown_connections 2024-08-31T06:05:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894f1181c0 0x55894f522d10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f51cbd0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 0x55894f510d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2030331241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f130980 0x55894f510820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2030331241 >> 172.21.15.53:0/2030331241 conn(0x55894f14d990 msgr2=0x55894f5060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe378ff9640 0 client.15996 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2030331241 shutdown_connections 2024-08-31T06:05:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.050+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2030331241 wait complete. 2024-08-31T06:05:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.051+0000 7fe39dc9f740 20 client.15996 trim_cache size 0 max 16384 2024-08-31T06:05:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.085+0000 7fe39dc9f740 1 Processor -- start 2024-08-31T06:05:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.085+0000 7fe39dc9f740 1 -- start start 2024-08-31T06:05:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.085+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f130980 0x55894f510c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.085+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f138b60 0x55894f50f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.085+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f4fdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.085+0000 7fe39dc9f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe37400e820 con 0x55894f159840 2024-08-31T06:05:44.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.085+0000 7fe39dc9f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe374010360 con 0x55894f130980 2024-08-31T06:05:44.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.085+0000 7fe39dc9f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe37400eef0 con 0x55894f138b60 2024-08-31T06:05:44.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.085+0000 7fe395cc7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f4fdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.085+0000 7fe395cc7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f4fdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55204/0 (socket says 172.21.15.53:55204) 2024-08-31T06:05:44.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.085+0000 7fe395cc7640 1 -- 172.21.15.53:0/2367789150 learned_addr learned my addr 172.21.15.53:0/2367789150 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:44.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.086+0000 7fe394cc5640 1 --2- 172.21.15.53:0/2367789150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f138b60 0x55894f50f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.086+0000 7fe3954c6640 1 --2- 172.21.15.53:0/2367789150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f130980 0x55894f510c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.086+0000 7fe395cc7640 1 -- 172.21.15.53:0/2367789150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f138b60 msgr2=0x55894f50f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:44.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.086+0000 7fe395cc7640 1 --2- 172.21.15.53:0/2367789150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f138b60 0x55894f50f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.086+0000 7fe395cc7640 1 -- 172.21.15.53:0/2367789150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f130980 msgr2=0x55894f510c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:44.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.086+0000 7fe395cc7640 1 --2- 172.21.15.53:0/2367789150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f130980 0x55894f510c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.086+0000 7fe395cc7640 1 -- 172.21.15.53:0/2367789150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894f5232e0 con 0x55894f159840 2024-08-31T06:05:44.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.086+0000 7fe395cc7640 1 --2- 172.21.15.53:0/2367789150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f4fdd00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe388009e50 tx=0x7fe388009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340241d9305a0e05 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:44.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.086+0000 7fe37affd640 1 -- 172.21.15.53:0/2367789150 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388038070 con 0x55894f159840 2024-08-31T06:05:44.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.087+0000 7fe37affd640 1 -- 172.21.15.53:0/2367789150 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe388004ce0 con 0x55894f159840 2024-08-31T06:05:44.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.087+0000 7fe37affd640 1 -- 172.21.15.53:0/2367789150 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38802f070 con 0x55894f159840 2024-08-31T06:05:44.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.088+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2367789150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 msgr2=0x55894f4fdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:44.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.088+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2367789150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f4fdd00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe388009e50 tx=0x7fe388009600 comp rx=0 tx=0).stop 2024-08-31T06:05:44.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.088+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2367789150 shutdown_connections 2024-08-31T06:05:44.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.088+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2367789150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f159840 0x55894f4fdd00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.088+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2367789150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f138b60 0x55894f50f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.088+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/2367789150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f130980 0x55894f510c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.088+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2367789150 >> 172.21.15.53:0/2367789150 conn(0x55894f14d990 msgr2=0x55894f511d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:44.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.088+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2367789150 shutdown_connections 2024-08-31T06:05:44.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.088+0000 7fe39dc9f740 1 -- 172.21.15.53:0/2367789150 wait complete. 2024-08-31T06:05:44.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.088+0000 7fe39dc9f740 1 -- start start 2024-08-31T06:05:44.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.089+0000 7fe39dc9f740 1 Processor -- start 2024-08-31T06:05:44.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.089+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f130980 0x55894f4fe390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.089+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 0x55894f4fe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.089+0000 7fe39dc9f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f159840 0x55894f4fee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.089+0000 7fe39dc9f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe37400fc90 con 0x55894f130980 2024-08-31T06:05:44.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.089+0000 7fe39dc9f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe37400f5c0 con 0x55894f138b60 2024-08-31T06:05:44.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.089+0000 7fe39dc9f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe37400c800 con 0x55894f159840 2024-08-31T06:05:44.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.089+0000 7fe39dc9f740 10 client.0 _ll_register_callbacks cb 0x7fe38c00de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:44.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.089+0000 7fe3954c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f130980 0x55894f4fe390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.089+0000 7fe3954c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f130980 0x55894f4fe390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55212/0 (socket says 172.21.15.53:55212) 2024-08-31T06:05:44.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.089+0000 7fe3954c6640 1 -- 172.21.15.53:0/4288910006 learned_addr learned my addr 172.21.15.53:0/4288910006 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:44.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.090+0000 7fe394cc5640 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 0x55894f4fe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.090+0000 7fe395cc7640 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f159840 0x55894f4fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.090+0000 7fe394cc5640 1 -- 172.21.15.53:0/4288910006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f159840 msgr2=0x55894f4fee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:44.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.090+0000 7fe394cc5640 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f159840 0x55894f4fee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.090+0000 7fe394cc5640 1 -- 172.21.15.53:0/4288910006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f130980 msgr2=0x55894f4fe390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:44.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.090+0000 7fe394cc5640 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f130980 0x55894f4fe390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.090+0000 7fe394cc5640 1 -- 172.21.15.53:0/4288910006 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55894f434d90 con 0x55894f138b60 2024-08-31T06:05:44.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.090+0000 7fe3954c6640 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f130980 0x55894f4fe390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:44.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.091+0000 7fe394cc5640 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 0x55894f4fe8d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe3800096c0 tx=0x7fe38002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c507d44df5eaa324 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:44.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.091+0000 7fe378ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:05:44.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.091+0000 7fe378ff9640 1 -- 172.21.15.53:0/4288910006 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38005b060 con 0x55894f138b60 2024-08-31T06:05:44.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.091+0000 7fe378ff9640 1 -- 172.21.15.53:0/4288910006 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fe380004040 con 0x55894f138b60 2024-08-31T06:05:44.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.091+0000 7fe39dc9f740 1 -- 172.21.15.53:0/4288910006 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe388004ce0 con 0x55894f138b60 2024-08-31T06:05:44.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.091+0000 7fe378ff9640 1 -- 172.21.15.53:0/4288910006 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe380035050 con 0x55894f138b60 2024-08-31T06:05:44.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.091+0000 7fe39dc9f740 10 client.25493 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:44.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.091+0000 7fe39dc9f740 1 -- 172.21.15.53:0/4288910006 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55894f589750 con 0x55894f138b60 2024-08-31T06:05:44.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.092+0000 7fe378ff9640 1 -- 172.21.15.53:0/4288910006 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe380041040 con 0x55894f138b60 2024-08-31T06:05:44.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.092+0000 7fe378ff9640 1 -- 172.21.15.53:0/4288910006 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe3800048c0 con 0x55894f138b60 2024-08-31T06:05:44.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.092+0000 7fe39dc9f740 10 client.25493 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:44.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.092+0000 7fe39dc9f740 10 client.25493 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:05:44.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.092+0000 7fe39dc9f740 20 client.25493 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:44.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.092+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894f0ed570 0x55894f58bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:44.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.093+0000 7fe39dc9f740 4 client.25493 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}] 2024-08-31T06:05:44.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.093+0000 7fe39dc9f740 1 -- 172.21.15.53:0/4288910006 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}) -- 0x7fe388004ce0 con 0x55894f0ed570 2024-08-31T06:05:44.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.093+0000 7fe3954c6640 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894f0ed570 0x55894f58bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:44.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.093+0000 7fe378ff9640 10 client.25493 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:44.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.093+0000 7fe3954c6640 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894f0ed570 0x55894f58bf80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6f9f294ab68ef5 server_cookie=44d9843c358c3a90 in_seq=0 out_seq=0 2024-08-31T06:05:44.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.101+0000 7fe378ff9640 1 -- 172.21.15.53:0/4288910006 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fe388004ce0 con 0x55894f0ed570 2024-08-31T06:05:44.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.101+0000 7fe378ff9640 10 client.25493 handle_command_reply: tid=0 2024-08-31T06:05:44.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.101+0000 7fe39dc9f740 1 client.25493 shutdown 2024-08-31T06:05:44.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.103+0000 7fe39dc9f740 1 -- 172.21.15.53:0/4288910006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 msgr2=0x55894f4fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:44.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.103+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 0x55894f4fe8d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe3800096c0 tx=0x7fe38002a410 comp rx=0 tx=0).stop 2024-08-31T06:05:44.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.103+0000 7fe39dc9f740 1 -- 172.21.15.53:0/4288910006 shutdown_connections 2024-08-31T06:05:44.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.103+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894f0ed570 0x55894f58bf80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.103+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894f159840 0x55894f4fee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.103+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894f138b60 0x55894f4fe8d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.103+0000 7fe39dc9f740 1 --2- 172.21.15.53:0/4288910006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894f130980 0x55894f4fe390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.103+0000 7fe39dc9f740 1 -- 172.21.15.53:0/4288910006 >> 172.21.15.53:0/4288910006 conn(0x55894f14d990 msgr2=0x55894f4fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:44.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.103+0000 7fe378ff9640 0 client.25493 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:44.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.104+0000 7fe39dc9f740 1 -- 172.21.15.53:0/4288910006 shutdown_connections 2024-08-31T06:05:44.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.104+0000 7fe39dc9f740 1 -- 172.21.15.53:0/4288910006 wait complete. 2024-08-31T06:05:44.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.104+0000 7fe39dc9f740 20 client.25493 trim_cache size 0 max 16384 2024-08-31T06:05:44.115 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:05:44.115 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 28, 2024-08-31T06:05:44.115 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:05:44.115 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 6, 2024-08-31T06:05:44.115 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:05:44.116 INFO:teuthology.orchestra.run.smithi053.stdout: "c58aada1": { 2024-08-31T06:05:44.116 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 6, 2024-08-31T06:05:44.116 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:05:44.116 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:05:44.116 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:05:44.117 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:05:44.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:05:44.117 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:05:44.117 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 146.4, 2024-08-31T06:05:44.117 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:05:44.117 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:05:44.118 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:05:44.118 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:05:44.118 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:05:44.118 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:05:44.118 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:44.118 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:44.119 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:44.119 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:44.119 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:44.119 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:05:44.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 -- 172.21.15.53:0/2103911142 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe37c0b50a0 msgr2=0x7fe37c0b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:44.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe37c0b50a0 0x7fe37c0b75b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe380006010 tx=0x7fe380000bc0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 -- 172.21.15.53:0/2103911142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe390104770 msgr2=0x7fe39019a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:44.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe390104770 0x7fe39019a150 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00d770 tx=0x7fe38c00dc30 comp rx=0 tx=0).stop 2024-08-31T06:05:44.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 -- 172.21.15.53:0/2103911142 shutdown_connections 2024-08-31T06:05:44.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe37c0b50a0 0x7fe37c0b75b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe39010dbd0 0x7fe39019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3901050c0 0x7fe39019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 --2- 172.21.15.53:0/2103911142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe390104770 0x7fe39019a150 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 -- 172.21.15.53:0/2103911142 >> 172.21.15.53:0/2103911142 conn(0x7fe390079500 msgr2=0x7fe3901006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 -- 172.21.15.53:0/2103911142 shutdown_connections 2024-08-31T06:05:44.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:44.106+0000 7fe39772a640 1 -- 172.21.15.53:0/2103911142 wait complete. 2024-08-31T06:05:44.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:44 smithi053 ceph-mon[18924]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:05:44.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:44 smithi130 ceph-mon[22266]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:05:44.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:44 smithi153 ceph-mon[22320]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T06:05:44.950 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c58aada1', quiesce took 3.8 seconds. Will release after: 22.599999999999998 2024-08-31T06:05:46.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:46 smithi053 ceph-mon[18924]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T06:05:46.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:46 smithi130 ceph-mon[22266]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T06:05:46.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:46 smithi153 ceph-mon[22320]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T06:05:48.137 INFO:tasks.workunit.client.0.smithi053.stderr:Updating files: 94% (11963/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-31T06:05:48.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:48 smithi053 ceph-mon[18924]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T06:05:48.509 INFO:tasks.workunit.client.0.smithi053.stderr:Note: switching to 'd19e6118f7015f0047264006cb0c873528eb3ae6'. 2024-08-31T06:05:48.509 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-08-31T06:05:48.509 INFO:tasks.workunit.client.0.smithi053.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-31T06:05:48.509 INFO:tasks.workunit.client.0.smithi053.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr:state without impacting any branches by switching back to a branch. 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr: git switch -c 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr:Or undo this operation with: 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr: git switch - 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-31T06:05:48.510 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-08-31T06:05:48.511 INFO:tasks.workunit.client.0.smithi053.stderr:HEAD is now at d19e6118f70 Merge PR #44359 into wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T06:05:48.514 DEBUG:teuthology.orchestra.run.smithi053:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-31T06:05:48.566 INFO:tasks.workunit.client.0.smithi053.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-31T06:05:48.568 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T06:05:48.568 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-31T06:05:48.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:48 smithi130 ceph-mon[22266]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T06:05:48.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:48 smithi153 ceph-mon[22320]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T06:05:49.211 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-31T06:05:49.281 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-31T06:05:49.320 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T06:05:49.322 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T06:05:49.322 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-31T06:05:49.360 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T06:05:49.364 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T06:05:49.364 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-31T06:05:49.380 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-08-31T06:05:49.381 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-08-31T06:05:49.381 DEBUG:teuthology.orchestra.run.smithi053:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-08-31T06:05:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:50 smithi053 ceph-mon[18924]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:50.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:50 smithi130 ceph-mon[22266]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:50.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:50 smithi153 ceph-mon[22320]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T06:05:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.717+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/538150703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b04102780 msgr2=0x7f0b04102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.717+0000 7f0b0b7cc640 1 --2- 172.21.15.53:0/538150703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b04102780 0x7f0b04102b90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009900 tx=0x7f0b0002a410 comp rx=0 tx=0).stop 2024-08-31T06:05:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.717+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/538150703 shutdown_connections 2024-08-31T06:05:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.717+0000 7f0b0b7cc640 1 --2- 172.21.15.53:0/538150703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b04108a00 0x7f0b0410f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.717+0000 7f0b0b7cc640 1 --2- 172.21.15.53:0/538150703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b041080b0 0x7f0b041084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.717+0000 7f0b0b7cc640 1 --2- 172.21.15.53:0/538150703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b04102780 0x7f0b04102b90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.717+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/538150703 >> 172.21.15.53:0/538150703 conn(0x7f0b040fe160 msgr2=0x7f0b041005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.717+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/538150703 shutdown_connections 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.717+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/538150703 wait complete. 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b0b7cc640 1 Processor -- start 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b0b7cc640 1 -- start start 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b0b7cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b04102780 0x7f0b0419a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b0b7cc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b041080b0 0x7f0b0419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b0b7cc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b04108a00 0x7f0b0419f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b0b7cc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0b04112560 con 0x7f0b04102780 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b0b7cc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041123e0 con 0x7f0b04108a00 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b0b7cc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041126e0 con 0x7f0b041080b0 2024-08-31T06:05:51.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b09568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b04102780 0x7f0b0419a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b09568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b04102780 0x7f0b0419a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55236/0 (socket says 172.21.15.53:55236) 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b09568640 1 -- 172.21.15.53:0/1136772052 learned_addr learned my addr 172.21.15.53:0/1136772052 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b09d69640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b04108a00 0x7f0b0419f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.718+0000 7f0b08d67640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b041080b0 0x7f0b0419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.719+0000 7f0b09568640 1 -- 172.21.15.53:0/1136772052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b041080b0 msgr2=0x7f0b0419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.719+0000 7f0b09568640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b041080b0 0x7f0b0419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.719+0000 7f0b09568640 1 -- 172.21.15.53:0/1136772052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b04108a00 msgr2=0x7f0b0419f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.719+0000 7f0b09568640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b04108a00 0x7f0b0419f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.719+0000 7f0b09568640 1 -- 172.21.15.53:0/1136772052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b041a0080 con 0x7f0b04102780 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.719+0000 7f0b09568640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b04102780 0x7f0b0419a150 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009230 tx=0x7f0b00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.719+0000 7f0afa7fc640 1 -- 172.21.15.53:0/1136772052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0003f030 con 0x7f0b04102780 2024-08-31T06:05:51.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.719+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/1136772052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b041a0310 con 0x7f0b04102780 2024-08-31T06:05:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.719+0000 7f0afa7fc640 1 -- 172.21.15.53:0/1136772052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b00003a80 con 0x7f0b04102780 2024-08-31T06:05:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.719+0000 7f0afa7fc640 1 -- 172.21.15.53:0/1136772052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b00035070 con 0x7f0b04102780 2024-08-31T06:05:51.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.719+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/1136772052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b041a6b00 con 0x7f0b04102780 2024-08-31T06:05:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.722+0000 7f0b12813740 1 Processor -- start 2024-08-31T06:05:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.722+0000 7f0afa7fc640 1 -- 172.21.15.53:0/1136772052 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0b00042030 con 0x7f0b04102780 2024-08-31T06:05:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.722+0000 7f0b12813740 1 -- start start 2024-08-31T06:05:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.722+0000 7f0b12813740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73ac1b0 0x55d1e774fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.722+0000 7f0b12813740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e73832f0 0x55d1e7750000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.722+0000 7f0b12813740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e738b4d0 0x55d1e7750540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.722+0000 7f0b12813740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d1e76c5000 con 0x55d1e738b4d0 2024-08-31T06:05:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.722+0000 7f0b12813740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d1e76b4590 con 0x55d1e73832f0 2024-08-31T06:05:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.722+0000 7f0b12813740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d1e76b8540 con 0x55d1e73ac1b0 2024-08-31T06:05:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.722+0000 7f0b08d67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e738b4d0 0x55d1e7750540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b08d67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e738b4d0 0x55d1e7750540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55238/0 (socket says 172.21.15.53:55238) 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b08d67640 1 -- 172.21.15.53:0/2783279008 learned_addr learned my addr 172.21.15.53:0/2783279008 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b09568640 1 --2- 172.21.15.53:0/2783279008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e73832f0 0x55d1e7750000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b09d69640 1 --2- 172.21.15.53:0/2783279008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73ac1b0 0x55d1e774fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b08d67640 1 -- 172.21.15.53:0/2783279008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73ac1b0 msgr2=0x55d1e774fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b08d67640 1 --2- 172.21.15.53:0/2783279008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73ac1b0 0x55d1e774fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b08d67640 1 -- 172.21.15.53:0/2783279008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e73832f0 msgr2=0x55d1e7750000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b08d67640 1 --2- 172.21.15.53:0/2783279008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e73832f0 0x55d1e7750000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b08d67640 1 -- 172.21.15.53:0/2783279008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1e7417790 con 0x55d1e738b4d0 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b09568640 1 --2- 172.21.15.53:0/2783279008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e73832f0 0x55d1e7750000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0afa7fc640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0af00b4ca0 0x7f0af00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b08d67640 1 --2- 172.21.15.53:0/2783279008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e738b4d0 0x55d1e7750540 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0af400bc10 tx=0x7f0af400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d854e8c27baa3e1d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0b09d69640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0af00b4ca0 0x7f0af00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0afa7fc640 1 -- 172.21.15.53:0/1136772052 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0b00105b30 con 0x7f0b04102780 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0aef7fe640 1 -- 172.21.15.53:0/2783279008 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4015070 con 0x55d1e738b4d0 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0aef7fe640 1 -- 172.21.15.53:0/2783279008 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0af401a8f0 con 0x55d1e738b4d0 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.723+0000 7f0aef7fe640 1 -- 172.21.15.53:0/2783279008 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4011760 con 0x55d1e738b4d0 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.724+0000 7f0b09d69640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0af00b4ca0 0x7f0af00b71b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0afc005fd0 tx=0x7f0afc009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.724+0000 7f0b12813740 1 -- 172.21.15.53:0/2783279008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e738b4d0 msgr2=0x55d1e7750540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.724+0000 7f0b12813740 1 --2- 172.21.15.53:0/2783279008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e738b4d0 0x55d1e7750540 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0af400bc10 tx=0x7f0af400f730 comp rx=0 tx=0).stop 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.724+0000 7f0b12813740 1 -- 172.21.15.53:0/2783279008 shutdown_connections 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.724+0000 7f0b12813740 1 --2- 172.21.15.53:0/2783279008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e738b4d0 0x55d1e7750540 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.724+0000 7f0b12813740 1 --2- 172.21.15.53:0/2783279008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e73832f0 0x55d1e7750000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.724+0000 7f0b12813740 1 --2- 172.21.15.53:0/2783279008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73ac1b0 0x55d1e774fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.732 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.724+0000 7f0b12813740 1 -- 172.21.15.53:0/2783279008 >> 172.21.15.53:0/2783279008 conn(0x55d1e73a0300 msgr2=0x55d1e774d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.724+0000 7f0b12813740 1 -- 172.21.15.53:0/2783279008 shutdown_connections 2024-08-31T06:05:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.724+0000 7f0b12813740 1 -- 172.21.15.53:0/2783279008 wait complete. 2024-08-31T06:05:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.725+0000 7f0b12813740 1 -- start start 2024-08-31T06:05:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.725+0000 7f0b12813740 1 Processor -- start 2024-08-31T06:05:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.725+0000 7f0b12813740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73832f0 0x55d1e775b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.725+0000 7f0b12813740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e738b4d0 0x55d1e775bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.725+0000 7f0b12813740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e7767560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.725+0000 7f0b12813740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d1e75edab0 con 0x55d1e73ac1b0 2024-08-31T06:05:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.725+0000 7f0b12813740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d1e763b680 con 0x55d1e738b4d0 2024-08-31T06:05:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.725+0000 7f0b12813740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d1e775e240 con 0x55d1e73832f0 2024-08-31T06:05:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b12813740 10 client.0 _ll_register_callbacks cb 0x55d1e73c3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b09d69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e7767560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b09d69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e7767560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55248/0 (socket says 172.21.15.53:55248) 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b09d69640 1 -- 172.21.15.53:0/567864759 learned_addr learned my addr 172.21.15.53:0/567864759 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b09568640 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73832f0 0x55d1e775b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b08d67640 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e738b4d0 0x55d1e775bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b09d69640 1 -- 172.21.15.53:0/567864759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73832f0 msgr2=0x55d1e775b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b09d69640 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73832f0 0x55d1e775b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b09d69640 1 -- 172.21.15.53:0/567864759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e738b4d0 msgr2=0x55d1e775bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b09d69640 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e738b4d0 0x55d1e775bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b09d69640 1 -- 172.21.15.53:0/567864759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1e7490620 con 0x55d1e73ac1b0 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b09d69640 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e7767560 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0afc01d710 tx=0x7f0afc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9310092cb7571067 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0aecff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0aecff9640 1 -- 172.21.15.53:0/567864759 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc010870 con 0x55d1e73ac1b0 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0aecff9640 1 -- 172.21.15.53:0/567864759 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0afc010a10 con 0x55d1e73ac1b0 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.726+0000 7f0b12813740 1 -- 172.21.15.53:0/567864759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0af401a8f0 con 0x55d1e73ac1b0 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0aecff9640 1 -- 172.21.15.53:0/567864759 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0afc010c10 con 0x55d1e73ac1b0 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0b12813740 10 client.16014 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0b12813740 1 -- 172.21.15.53:0/567864759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d1e776a330 con 0x55d1e73ac1b0 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0aecff9640 1 -- 172.21.15.53:0/567864759 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0af401a8f0 con 0x55d1e73ac1b0 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0aecff9640 1 -- 172.21.15.53:0/567864759 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0afc00f040 con 0x55d1e73ac1b0 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0b12813740 10 client.16014 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0b12813740 10 client.16014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0b12813740 20 client.16014 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0b12813740 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1e736ad80 0x55d1e776d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0b12813740 4 client.16014 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:51.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0b12813740 1 -- 172.21.15.53:0/567864759 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1e76c6f50 con 0x55d1e736ad80 2024-08-31T06:05:51.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.727+0000 7f0b09568640 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1e736ad80 0x55d1e776d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.728+0000 7f0aecff9640 10 client.16014 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:51.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.728+0000 7f0b09568640 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1e736ad80 0x55d1e776d850 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e8dd6fbaa04e2e7 server_cookie=7d92afad5c4e59b4 in_seq=0 out_seq=0 2024-08-31T06:05:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0aecff9640 1 -- 172.21.15.53:0/567864759 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1e76c6f50 con 0x55d1e736ad80 2024-08-31T06:05:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0aecff9640 10 client.16014 handle_command_reply: tid=0 2024-08-31T06:05:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 1 client.16014 shutdown 2024-08-31T06:05:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 1 -- 172.21.15.53:0/567864759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 msgr2=0x55d1e7767560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e7767560 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0afc01d710 tx=0x7f0afc004a40 comp rx=0 tx=0).stop 2024-08-31T06:05:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 1 -- 172.21.15.53:0/567864759 shutdown_connections 2024-08-31T06:05:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1e736ad80 0x55d1e776d850 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e7767560 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e738b4d0 0x55d1e775bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 1 --2- 172.21.15.53:0/567864759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73832f0 0x55d1e775b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0aecff9640 0 client.16014 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 1 -- 172.21.15.53:0/567864759 >> 172.21.15.53:0/567864759 conn(0x55d1e73a0300 msgr2=0x55d1e7750af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 1 -- 172.21.15.53:0/567864759 shutdown_connections 2024-08-31T06:05:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 1 -- 172.21.15.53:0/567864759 wait complete. 2024-08-31T06:05:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.729+0000 7f0b12813740 20 client.16014 trim_cache size 0 max 16384 2024-08-31T06:05:51.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b12813740 1 Processor -- start 2024-08-31T06:05:51.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b12813740 1 -- start start 2024-08-31T06:05:51.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b12813740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73832f0 0x55d1e7759d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b12813740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e738b4d0 0x55d1e775a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b12813740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73ac1b0 0x55d1e7767460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b12813740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041af3e0 con 0x55d1e73832f0 2024-08-31T06:05:51.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b12813740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041b0f20 con 0x55d1e738b4d0 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b12813740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041afab0 con 0x55d1e73ac1b0 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b09568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73832f0 0x55d1e7759d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b09568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73832f0 0x55d1e7759d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55254/0 (socket says 172.21.15.53:55254) 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b09568640 1 -- 172.21.15.53:0/3503290310 learned_addr learned my addr 172.21.15.53:0/3503290310 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.744+0000 7f0b08d67640 1 --2- 172.21.15.53:0/3503290310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e738b4d0 0x55d1e775a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.745+0000 7f0b09568640 1 -- 172.21.15.53:0/3503290310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73ac1b0 msgr2=0x55d1e7767460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.745+0000 7f0b09568640 1 --2- 172.21.15.53:0/3503290310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73ac1b0 0x55d1e7767460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.745+0000 7f0b09568640 1 -- 172.21.15.53:0/3503290310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e738b4d0 msgr2=0x55d1e775a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.745+0000 7f0b09568640 1 --2- 172.21.15.53:0/3503290310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e738b4d0 0x55d1e775a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.745+0000 7f0b09568640 1 -- 172.21.15.53:0/3503290310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1e775ba20 con 0x55d1e73832f0 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.745+0000 7f0b08d67640 1 --2- 172.21.15.53:0/3503290310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e738b4d0 0x55d1e775a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.745+0000 7f0b09568640 1 --2- 172.21.15.53:0/3503290310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73832f0 0x55d1e7759d00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0b000cc150 tx=0x7f0b000ef040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dc8314d4d468c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.745+0000 7f0aeeffd640 1 -- 172.21.15.53:0/3503290310 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b00049040 con 0x55d1e73832f0 2024-08-31T06:05:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.745+0000 7f0aeeffd640 1 -- 172.21.15.53:0/3503290310 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b000cc8c0 con 0x55d1e73832f0 2024-08-31T06:05:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.745+0000 7f0aeeffd640 1 -- 172.21.15.53:0/3503290310 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b001034a0 con 0x55d1e73832f0 2024-08-31T06:05:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.746+0000 7f0b12813740 1 -- 172.21.15.53:0/3503290310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73832f0 msgr2=0x55d1e7759d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.746+0000 7f0b12813740 1 --2- 172.21.15.53:0/3503290310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73832f0 0x55d1e7759d00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0b000cc150 tx=0x7f0b000ef040 comp rx=0 tx=0).stop 2024-08-31T06:05:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.746+0000 7f0b12813740 1 -- 172.21.15.53:0/3503290310 shutdown_connections 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.746+0000 7f0b12813740 1 --2- 172.21.15.53:0/3503290310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e73ac1b0 0x55d1e7767460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.746+0000 7f0b12813740 1 --2- 172.21.15.53:0/3503290310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e738b4d0 0x55d1e775a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.746+0000 7f0b12813740 1 --2- 172.21.15.53:0/3503290310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73832f0 0x55d1e7759d00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.746+0000 7f0b12813740 1 -- 172.21.15.53:0/3503290310 >> 172.21.15.53:0/3503290310 conn(0x55d1e73a0300 msgr2=0x55d1e77565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.746+0000 7f0b12813740 1 -- 172.21.15.53:0/3503290310 shutdown_connections 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.746+0000 7f0b12813740 1 -- 172.21.15.53:0/3503290310 wait complete. 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.746+0000 7f0b12813740 1 -- start start 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.746+0000 7f0b12813740 1 Processor -- start 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b12813740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e73832f0 0x55d1e7763cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b12813740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e738b4d0 0x55d1e775f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b12813740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e775f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b12813740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041b0850 con 0x55d1e73ac1b0 2024-08-31T06:05:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b12813740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041b0180 con 0x55d1e73832f0 2024-08-31T06:05:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b12813740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0b041ad3c0 con 0x55d1e738b4d0 2024-08-31T06:05:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b12813740 10 client.0 _ll_register_callbacks cb 0x7f0afc009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b09d69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e775f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b09d69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e775f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55266/0 (socket says 172.21.15.53:55266) 2024-08-31T06:05:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b09d69640 1 -- 172.21.15.53:0/827737397 learned_addr learned my addr 172.21.15.53:0/827737397 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b08d67640 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e738b4d0 0x55d1e775f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b09568640 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e73832f0 0x55d1e7763cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b09d69640 1 -- 172.21.15.53:0/827737397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e738b4d0 msgr2=0x55d1e775f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b09d69640 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e738b4d0 0x55d1e775f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b09d69640 1 -- 172.21.15.53:0/827737397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e73832f0 msgr2=0x55d1e7763cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b09d69640 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e73832f0 0x55d1e7763cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b09d69640 1 -- 172.21.15.53:0/827737397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1e775fe20 con 0x55d1e73ac1b0 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0b09d69640 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e775f690 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009e10 tx=0x7f0afc01d510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b0dd00de392227 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0aecff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.747+0000 7f0aecff9640 1 -- 172.21.15.53:0/827737397 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc004ba0 con 0x55d1e73ac1b0 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0aecff9640 1 -- 172.21.15.53:0/827737397 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0afc004d40 con 0x55d1e73ac1b0 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0b12813740 1 -- 172.21.15.53:0/827737397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b000cc8c0 con 0x55d1e73ac1b0 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0aecff9640 1 -- 172.21.15.53:0/827737397 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0afc010a40 con 0x55d1e73ac1b0 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0b12813740 10 client.16020 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0b12813740 1 -- 172.21.15.53:0/827737397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d1e77d8120 con 0x55d1e73ac1b0 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0aecff9640 1 -- 172.21.15.53:0/827737397 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b000cc8c0 con 0x55d1e73ac1b0 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0aecff9640 1 -- 172.21.15.53:0/827737397 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0afc005240 con 0x55d1e73ac1b0 2024-08-31T06:05:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0b12813740 10 client.16020 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:51.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0b12813740 10 client.16020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:51.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0b12813740 20 client.16020 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:51.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0b12813740 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1e73401c0 0x55d1e77da8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:51.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0b12813740 4 client.16020 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:05:51.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0b12813740 1 -- 172.21.15.53:0/827737397 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d1e76c29f0 con 0x55d1e73401c0 2024-08-31T06:05:51.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.748+0000 7f0b09568640 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1e73401c0 0x55d1e77da8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:51.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.749+0000 7f0aecff9640 10 client.16020 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:51.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.749+0000 7f0b09568640 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1e73401c0 0x55d1e77da8d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cc666a797e26634 server_cookie=b5136138425ccac3 in_seq=0 out_seq=0 2024-08-31T06:05:51.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0aecff9640 1 -- 172.21.15.53:0/827737397 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d1e76c29f0 con 0x55d1e73401c0 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0aecff9640 10 client.16020 handle_command_reply: tid=0 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0b12813740 1 client.16020 shutdown 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0b12813740 1 -- 172.21.15.53:0/827737397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 msgr2=0x55d1e775f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0b12813740 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e775f690 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009e10 tx=0x7f0afc01d510 comp rx=0 tx=0).stop 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0b12813740 1 -- 172.21.15.53:0/827737397 shutdown_connections 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0b12813740 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1e73401c0 0x55d1e77da8d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0b12813740 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1e73ac1b0 0x55d1e775f690 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0b12813740 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1e738b4d0 0x55d1e775f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0b12813740 1 --2- 172.21.15.53:0/827737397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1e73832f0 0x55d1e7763cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0aecff9640 0 client.16020 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.755+0000 7f0b12813740 1 -- 172.21.15.53:0/827737397 >> 172.21.15.53:0/827737397 conn(0x55d1e73a0300 msgr2=0x55d1e775a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b12813740 1 -- 172.21.15.53:0/827737397 shutdown_connections 2024-08-31T06:05:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b12813740 1 -- 172.21.15.53:0/827737397 wait complete. 2024-08-31T06:05:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b12813740 20 client.16020 trim_cache size 0 max 16384 2024-08-31T06:05:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:05:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:05:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:05:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:05:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/1136772052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0af00b4ca0 msgr2=0x7f0af00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0af00b4ca0 0x7f0af00b71b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0afc005fd0 tx=0x7f0afc009600 comp rx=0 tx=0).stop 2024-08-31T06:05:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/1136772052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b04102780 msgr2=0x7f0b0419a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b04102780 0x7f0b0419a150 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009230 tx=0x7f0b00004270 comp rx=0 tx=0).stop 2024-08-31T06:05:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/1136772052 shutdown_connections 2024-08-31T06:05:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0af00b4ca0 0x7f0af00b71b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b04108a00 0x7f0b0419f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b041080b0 0x7f0b0419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 --2- 172.21.15.53:0/1136772052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b04102780 0x7f0b0419a150 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/1136772052 >> 172.21.15.53:0/1136772052 conn(0x7f0b040fe160 msgr2=0x7f0b0406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/1136772052 shutdown_connections 2024-08-31T06:05:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:05:51.756+0000 7f0b0b7cc640 1 -- 172.21.15.53:0/1136772052 wait complete. 2024-08-31T06:05:52.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:52 smithi130 ceph-mon[22266]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T06:05:53.553 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:52 smithi053 ceph-mon[18924]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T06:05:53.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:52 smithi153 ceph-mon[22320]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T06:05:54.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:54 smithi130 ceph-mon[22266]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T06:05:54.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:54 smithi153 ceph-mon[22320]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T06:05:54.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:54 smithi053 ceph-mon[18924]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T06:05:56.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:05:56.314 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:56.435 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:56 smithi053 ceph-mon[18924]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T06:05:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:56 smithi130 ceph-mon[22266]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T06:05:56.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:56 smithi153 ceph-mon[22320]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T06:05:56.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.792+0000 7f71770f3640 1 -- 172.21.15.53:0/2145184772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7170102880 msgr2=0x7f7170102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:56.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.792+0000 7f71770f3640 1 --2- 172.21.15.53:0/2145184772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7170102880 0x7f7170102c90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7164009900 tx=0x7f716402a410 comp rx=0 tx=0).stop 2024-08-31T06:05:56.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.792+0000 7f71770f3640 1 -- 172.21.15.53:0/2145184772 shutdown_connections 2024-08-31T06:05:56.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.792+0000 7f71770f3640 1 --2- 172.21.15.53:0/2145184772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7170108ac0 0x7f717010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.792+0000 7f71770f3640 1 --2- 172.21.15.53:0/2145184772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7170108170 0x7f7170108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.792+0000 7f71770f3640 1 --2- 172.21.15.53:0/2145184772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7170102880 0x7f7170102c90 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.792+0000 7f71770f3640 1 -- 172.21.15.53:0/2145184772 >> 172.21.15.53:0/2145184772 conn(0x7f7170079500 msgr2=0x7f7170079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:56.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.793+0000 7f71770f3640 1 -- 172.21.15.53:0/2145184772 shutdown_connections 2024-08-31T06:05:56.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.793+0000 7f71770f3640 1 -- 172.21.15.53:0/2145184772 wait complete. 2024-08-31T06:05:56.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.793+0000 7f71770f3640 1 Processor -- start 2024-08-31T06:05:56.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.793+0000 7f71770f3640 1 -- start start 2024-08-31T06:05:56.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f71770f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7170102880 0x7f7170199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f71770f3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7170108170 0x7f71701995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f71770f3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7170108ac0 0x7f717019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f71770f3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7170112640 con 0x7f7170102880 2024-08-31T06:05:56.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f71770f3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71701124c0 con 0x7f7170108ac0 2024-08-31T06:05:56.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f71770f3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71701127c0 con 0x7f7170108170 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f7174e8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7170102880 0x7f7170199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f7174e8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7170102880 0x7f7170199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47022/0 (socket says 172.21.15.53:47022) 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f7174e8f640 1 -- 172.21.15.53:0/2703436396 learned_addr learned my addr 172.21.15.53:0/2703436396 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f7175690640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7170108ac0 0x7f717019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f716ffff640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7170108170 0x7f71701995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f7174e8f640 1 -- 172.21.15.53:0/2703436396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7170108170 msgr2=0x7f71701995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f7174e8f640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7170108170 0x7f71701995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f7174e8f640 1 -- 172.21.15.53:0/2703436396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7170108ac0 msgr2=0x7f717019e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f7174e8f640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7170108ac0 0x7f717019e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f7174e8f640 1 -- 172.21.15.53:0/2703436396 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717019efa0 con 0x7f7170102880 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.794+0000 7f7174e8f640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7170102880 0x7f7170199030 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f716402a930 tx=0x7f7164003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.795+0000 7f716dffb640 1 -- 172.21.15.53:0/2703436396 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716403f070 con 0x7f7170102880 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.795+0000 7f716dffb640 1 -- 172.21.15.53:0/2703436396 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f716403baf0 con 0x7f7170102880 2024-08-31T06:05:56.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.795+0000 7f71770f3640 1 -- 172.21.15.53:0/2703436396 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717019f230 con 0x7f7170102880 2024-08-31T06:05:56.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.795+0000 7f716dffb640 1 -- 172.21.15.53:0/2703436396 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164035030 con 0x7f7170102880 2024-08-31T06:05:56.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.795+0000 7f71770f3640 1 -- 172.21.15.53:0/2703436396 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717006b880 con 0x7f7170102880 2024-08-31T06:05:56.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f717d668740 1 Processor -- start 2024-08-31T06:05:56.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f717d668740 1 -- start start 2024-08-31T06:05:56.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f717d668740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f981070 0x560b8fd262c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f717d668740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f9581b0 0x560b8fd26800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f717d668740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f960390 0x560b8fd26d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f717d668740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560b8fc9d630 con 0x560b8f981070 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f717d668740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560b8fc8cbc0 con 0x560b8f960390 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f717d668740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560b8fc90b70 con 0x560b8f9581b0 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f716dffb640 1 -- 172.21.15.53:0/2703436396 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7164042070 con 0x7f7170102880 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f7175690640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f981070 0x560b8fd262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f7175690640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f981070 0x560b8fd262c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47030/0 (socket says 172.21.15.53:47030) 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.798+0000 7f7175690640 1 -- 172.21.15.53:0/67068607 learned_addr learned my addr 172.21.15.53:0/67068607 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f716ffff640 1 --2- 172.21.15.53:0/67068607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f960390 0x560b8fd26d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f7174e8f640 1 --2- 172.21.15.53:0/67068607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f9581b0 0x560b8fd26800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f7175690640 1 -- 172.21.15.53:0/67068607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f9581b0 msgr2=0x560b8fd26800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f7175690640 1 --2- 172.21.15.53:0/67068607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f9581b0 0x560b8fd26800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f7175690640 1 -- 172.21.15.53:0/67068607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f960390 msgr2=0x560b8fd26d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f7175690640 1 --2- 172.21.15.53:0/67068607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f960390 0x560b8fd26d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f7175690640 1 -- 172.21.15.53:0/67068607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b8f9ec650 con 0x560b8f981070 2024-08-31T06:05:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f7175690640 1 --2- 172.21.15.53:0/67068607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f981070 0x560b8fd262c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7168009fd0 tx=0x7f71680118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d565dff8d112945c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f715affd640 1 -- 172.21.15.53:0/67068607 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168004d20 con 0x560b8f981070 2024-08-31T06:05:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f715affd640 1 -- 172.21.15.53:0/67068607 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7168004050 con 0x560b8f981070 2024-08-31T06:05:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f715affd640 1 -- 172.21.15.53:0/67068607 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168005240 con 0x560b8f981070 2024-08-31T06:05:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.799+0000 7f716dffb640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71600b4d20 0x7f71600b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f7174e8f640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71600b4d20 0x7f71600b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f716dffb640 1 -- 172.21.15.53:0/2703436396 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7164105c60 con 0x7f7170102880 2024-08-31T06:05:56.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f717d668740 1 -- 172.21.15.53:0/67068607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f981070 msgr2=0x560b8fd262c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:56.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f7174e8f640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71600b4d20 0x7f71600b7230 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x560b8fd24f40 tx=0x7f7164099790 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:56.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f717d668740 1 --2- 172.21.15.53:0/67068607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f981070 0x560b8fd262c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7168009fd0 tx=0x7f71680118d0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f717d668740 1 -- 172.21.15.53:0/67068607 shutdown_connections 2024-08-31T06:05:56.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f717d668740 1 --2- 172.21.15.53:0/67068607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f960390 0x560b8fd26d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f717d668740 1 --2- 172.21.15.53:0/67068607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f9581b0 0x560b8fd26800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f717d668740 1 --2- 172.21.15.53:0/67068607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f981070 0x560b8fd262c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f717d668740 1 -- 172.21.15.53:0/67068607 >> 172.21.15.53:0/67068607 conn(0x560b8f975460 msgr2=0x560b8fd241b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f717d668740 1 -- 172.21.15.53:0/67068607 shutdown_connections 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.800+0000 7f717d668740 1 -- 172.21.15.53:0/67068607 wait complete. 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.801+0000 7f717d668740 1 -- start start 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.801+0000 7f717d668740 1 Processor -- start 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.801+0000 7f717d668740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f9581b0 0x560b8fd31990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.801+0000 7f717d668740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd31ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.801+0000 7f717d668740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f981070 0x560b8fd3ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.801+0000 7f717d668740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560b8faef700 con 0x560b8f960390 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.801+0000 7f717d668740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560b8fc13700 con 0x560b8f9581b0 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.801+0000 7f717d668740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560b8fd34aa0 con 0x560b8f981070 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.801+0000 7f717d668740 10 client.0 _ll_register_callbacks cb 0x560b8fc42dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.801+0000 7f716ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd31ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f716ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd31ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47044/0 (socket says 172.21.15.53:47044) 2024-08-31T06:05:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f716ffff640 1 -- 172.21.15.53:0/3534332335 learned_addr learned my addr 172.21.15.53:0/3534332335 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f7175690640 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f981070 0x560b8fd3ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f7175690640 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f9581b0 0x560b8fd31990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f716ffff640 1 -- 172.21.15.53:0/3534332335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f981070 msgr2=0x560b8fd3ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f716ffff640 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f981070 0x560b8fd3ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f716ffff640 1 -- 172.21.15.53:0/3534332335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f9581b0 msgr2=0x560b8fd31990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f716ffff640 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f9581b0 0x560b8fd31990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f716ffff640 1 -- 172.21.15.53:0/3534332335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b8fc4c8b0 con 0x560b8f960390 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f7175690640 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f981070 0x560b8fd3ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f716ffff640 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd31ed0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f715c012700 tx=0x7f715c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72605dae5fcd1d82 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f714ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f714ffff640 1 -- 172.21.15.53:0/3534332335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c004320 con 0x560b8f960390 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f714ffff640 1 -- 172.21.15.53:0/3534332335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f715c0119a0 con 0x560b8f960390 2024-08-31T06:05:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f717d668740 1 -- 172.21.15.53:0/3534332335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7168004050 con 0x560b8f960390 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f714ffff640 1 -- 172.21.15.53:0/3534332335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f715c0044c0 con 0x560b8f960390 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f717d668740 10 client.16032 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.802+0000 7f717d668740 1 -- 172.21.15.53:0/3534332335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560b8fd40830 con 0x560b8f960390 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.803+0000 7f714ffff640 1 -- 172.21.15.53:0/3534332335 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7168004050 con 0x560b8f960390 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.803+0000 7f714ffff640 1 -- 172.21.15.53:0/3534332335 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f715c025480 con 0x560b8f960390 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.803+0000 7f717d668740 10 client.16032 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.803+0000 7f717d668740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.803+0000 7f717d668740 20 client.16032 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.803+0000 7f717d668740 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b8f93f9f0 0x560b8fd43cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.803+0000 7f717d668740 4 client.16032 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.803+0000 7f717d668740 1 -- 172.21.15.53:0/3534332335 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b8fc9f580 con 0x560b8f93f9f0 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.803+0000 7f7175690640 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b8f93f9f0 0x560b8fd43cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.804+0000 7f7175690640 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b8f93f9f0 0x560b8fd43cc0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a2952e87560b642 server_cookie=3dd3f16f53d09b73 in_seq=0 out_seq=0 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.804+0000 7f714ffff640 10 client.16032 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.804+0000 7f714ffff640 1 -- 172.21.15.53:0/3534332335 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b8fc9f580 con 0x560b8f93f9f0 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.804+0000 7f714ffff640 10 client.16032 handle_command_reply: tid=0 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.804+0000 7f717d668740 1 client.16032 shutdown 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f717d668740 1 -- 172.21.15.53:0/3534332335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 msgr2=0x560b8fd31ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f717d668740 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd31ed0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f715c012700 tx=0x7f715c012bc0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f717d668740 1 -- 172.21.15.53:0/3534332335 shutdown_connections 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f717d668740 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b8f93f9f0 0x560b8fd43cc0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f717d668740 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f981070 0x560b8fd3ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f717d668740 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd31ed0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f717d668740 1 --2- 172.21.15.53:0/3534332335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f9581b0 0x560b8fd31990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f714ffff640 0 client.16032 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f717d668740 1 -- 172.21.15.53:0/3534332335 >> 172.21.15.53:0/3534332335 conn(0x560b8f975460 msgr2=0x560b8fd294a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f717d668740 1 -- 172.21.15.53:0/3534332335 shutdown_connections 2024-08-31T06:05:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f717d668740 1 -- 172.21.15.53:0/3534332335 wait complete. 2024-08-31T06:05:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.805+0000 7f717d668740 20 client.16032 trim_cache size 0 max 16384 2024-08-31T06:05:56.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f717d668740 1 Processor -- start 2024-08-31T06:05:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f717d668740 1 -- start start 2024-08-31T06:05:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f717d668740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f9581b0 0x560b8fd2eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f717d668740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd2f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f717d668740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f981070 0x560b8fd49480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f717d668740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f71701af3e0 con 0x560b8f960390 2024-08-31T06:05:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f717d668740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71701b0f20 con 0x560b8f9581b0 2024-08-31T06:05:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f717d668740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71701afab0 con 0x560b8f981070 2024-08-31T06:05:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f716ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd2f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f716ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd2f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47056/0 (socket says 172.21.15.53:47056) 2024-08-31T06:05:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f716ffff640 1 -- 172.21.15.53:0/854525156 learned_addr learned my addr 172.21.15.53:0/854525156 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f7175690640 1 --2- 172.21.15.53:0/854525156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f981070 0x560b8fd49480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f716ffff640 1 -- 172.21.15.53:0/854525156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f981070 msgr2=0x560b8fd49480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f716ffff640 1 --2- 172.21.15.53:0/854525156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f981070 0x560b8fd49480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f716ffff640 1 -- 172.21.15.53:0/854525156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f9581b0 msgr2=0x560b8fd2eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f716ffff640 1 --2- 172.21.15.53:0/854525156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f9581b0 0x560b8fd2eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f716ffff640 1 -- 172.21.15.53:0/854525156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b8fd29120 con 0x560b8f960390 2024-08-31T06:05:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.823+0000 7f716ffff640 1 --2- 172.21.15.53:0/854525156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd2f0c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f715c000c00 tx=0x7f715c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24320c3a12eeb2d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.824+0000 7f715a7fc640 1 -- 172.21.15.53:0/854525156 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c02b070 con 0x560b8f960390 2024-08-31T06:05:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.824+0000 7f715a7fc640 1 -- 172.21.15.53:0/854525156 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f715c011e30 con 0x560b8f960390 2024-08-31T06:05:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.824+0000 7f715a7fc640 1 -- 172.21.15.53:0/854525156 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c005410 con 0x560b8f960390 2024-08-31T06:05:56.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.824+0000 7f717d668740 1 -- 172.21.15.53:0/854525156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 msgr2=0x560b8fd2f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:56.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.824+0000 7f717d668740 1 --2- 172.21.15.53:0/854525156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd2f0c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f715c000c00 tx=0x7f715c011890 comp rx=0 tx=0).stop 2024-08-31T06:05:56.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.824+0000 7f717d668740 1 -- 172.21.15.53:0/854525156 shutdown_connections 2024-08-31T06:05:56.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.824+0000 7f717d668740 1 --2- 172.21.15.53:0/854525156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f981070 0x560b8fd49480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.824+0000 7f717d668740 1 --2- 172.21.15.53:0/854525156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd2f0c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.824+0000 7f717d668740 1 --2- 172.21.15.53:0/854525156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f9581b0 0x560b8fd2eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.824+0000 7f717d668740 1 -- 172.21.15.53:0/854525156 >> 172.21.15.53:0/854525156 conn(0x560b8f975460 msgr2=0x560b8fd30210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.825+0000 7f717d668740 1 -- 172.21.15.53:0/854525156 shutdown_connections 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.825+0000 7f717d668740 1 -- 172.21.15.53:0/854525156 wait complete. 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.825+0000 7f717d668740 1 -- start start 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.825+0000 7f717d668740 1 Processor -- start 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.825+0000 7f717d668740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f9581b0 0x560b8fd3a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.825+0000 7f717d668740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd36900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.825+0000 7f717d668740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f981070 0x560b8fd36e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.825+0000 7f717d668740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f71701b0850 con 0x560b8f960390 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.825+0000 7f717d668740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71701b0180 con 0x560b8f981070 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.825+0000 7f717d668740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71701ad3c0 con 0x560b8f9581b0 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.825+0000 7f717d668740 10 client.0 _ll_register_callbacks cb 0x7f715c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f716ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd36900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f716ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd36900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47064/0 (socket says 172.21.15.53:47064) 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f716ffff640 1 -- 172.21.15.53:0/1579149650 learned_addr learned my addr 172.21.15.53:0/1579149650 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f7175690640 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f9581b0 0x560b8fd3a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f7175690640 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f981070 0x560b8fd36e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f716ffff640 1 -- 172.21.15.53:0/1579149650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f9581b0 msgr2=0x560b8fd3a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f716ffff640 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f9581b0 0x560b8fd3a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f716ffff640 1 -- 172.21.15.53:0/1579149650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f981070 msgr2=0x560b8fd36e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f716ffff640 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f981070 0x560b8fd36e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f716ffff640 1 -- 172.21.15.53:0/1579149650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b8fd37480 con 0x560b8f960390 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f7175690640 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f981070 0x560b8fd36e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f716ffff640 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd36900 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f715c025db0 tx=0x7f715c025de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d969f7e6134646 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f714ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:05:56.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f714ffff640 1 -- 172.21.15.53:0/1579149650 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c02b040 con 0x560b8f960390 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f714ffff640 1 -- 172.21.15.53:0/1579149650 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f715c011c30 con 0x560b8f960390 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.826+0000 7f717d668740 1 -- 172.21.15.53:0/1579149650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f715c011e30 con 0x560b8f960390 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f714ffff640 1 -- 172.21.15.53:0/1579149650 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f715c040050 con 0x560b8f960390 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f717d668740 10 client.16038 fetch_fsmap learned FSMap version 28 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f717d668740 1 -- 172.21.15.53:0/1579149650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560b8fdaf490 con 0x560b8f960390 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f714ffff640 1 -- 172.21.15.53:0/1579149650 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f715c011e30 con 0x560b8f960390 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f714ffff640 1 -- 172.21.15.53:0/1579149650 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f715c030600 con 0x560b8f960390 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f717d668740 10 client.16038 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f717d668740 10 client.16038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f717d668740 20 client.16038 populate_metadata read hostname 'smithi053' 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f717d668740 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b8f914da0 0x560b8fdb1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f717d668740 4 client.16038 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:05:56.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f717d668740 1 -- 172.21.15.53:0/1579149650 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560b8fd29fe0 con 0x560b8f914da0 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.827+0000 7f7175690640 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b8f914da0 0x560b8fdb1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f714ffff640 10 client.16038 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f7175690640 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b8f914da0 0x560b8fdb1a90 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1267a73c5cb3260 server_cookie=85026bedaff00f21 in_seq=0 out_seq=0 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f714ffff640 1 -- 172.21.15.53:0/1579149650 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x560b8fd29fe0 con 0x560b8f914da0 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f714ffff640 10 client.16038 handle_command_reply: tid=0 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f717d668740 1 client.16038 shutdown 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f717d668740 1 -- 172.21.15.53:0/1579149650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 msgr2=0x560b8fd36900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f717d668740 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd36900 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f715c025db0 tx=0x7f715c025de0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f717d668740 1 -- 172.21.15.53:0/1579149650 shutdown_connections 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f717d668740 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b8f914da0 0x560b8fdb1a90 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f717d668740 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b8f981070 0x560b8fd36e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f714ffff640 0 client.16038 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f717d668740 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b8f960390 0x560b8fd36900 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f717d668740 1 --2- 172.21.15.53:0/1579149650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b8f9581b0 0x560b8fd3a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.828+0000 7f717d668740 1 -- 172.21.15.53:0/1579149650 >> 172.21.15.53:0/1579149650 conn(0x560b8f975460 msgr2=0x560b8fd272f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:56.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f717d668740 1 -- 172.21.15.53:0/1579149650 shutdown_connections 2024-08-31T06:05:56.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f717d668740 1 -- 172.21.15.53:0/1579149650 wait complete. 2024-08-31T06:05:56.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f717d668740 20 client.16038 trim_cache size 0 max 16384 2024-08-31T06:05:56.836 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:05:56.836 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:05:56.836 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:05:56.836 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:05:56.836 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:05:56.837 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:05:56.838 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:05:56.838 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:56.838 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:05:56.838 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:05:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 -- 172.21.15.53:0/2703436396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71600b4d20 msgr2=0x7f71600b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71600b4d20 0x7f71600b7230 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x560b8fd24f40 tx=0x7f7164099790 comp rx=0 tx=0).stop 2024-08-31T06:05:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 -- 172.21.15.53:0/2703436396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7170102880 msgr2=0x7f7170199030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7170102880 0x7f7170199030 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f716402a930 tx=0x7f7164003b90 comp rx=0 tx=0).stop 2024-08-31T06:05:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 -- 172.21.15.53:0/2703436396 shutdown_connections 2024-08-31T06:05:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71600b4d20 0x7f71600b7230 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7170108ac0 0x7f717019e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7170108170 0x7f71701995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 --2- 172.21.15.53:0/2703436396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7170102880 0x7f7170199030 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 -- 172.21.15.53:0/2703436396 >> 172.21.15.53:0/2703436396 conn(0x7f7170079500 msgr2=0x7f7170101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 -- 172.21.15.53:0/2703436396 shutdown_connections 2024-08-31T06:05:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:56.829+0000 7f71770f3640 1 -- 172.21.15.53:0/2703436396 wait complete. 2024-08-31T06:05:57.636 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:05:57.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:05:57.891 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:58.294 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:58 smithi053 ceph-mon[18924]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T06:05:58.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.382+0000 7ff89d5e2640 1 -- 172.21.15.53:0/1825667138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898103900 msgr2=0x7ff898103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:58.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.382+0000 7ff89d5e2640 1 --2- 172.21.15.53:0/1825667138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898103900 0x7ff898103d10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff888009900 tx=0x7ff88802a410 comp rx=0 tx=0).stop 2024-08-31T06:05:58.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.382+0000 7ff89d5e2640 1 -- 172.21.15.53:0/1825667138 shutdown_connections 2024-08-31T06:05:58.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.382+0000 7ff89d5e2640 1 --2- 172.21.15.53:0/1825667138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff898109b90 0x7ff8981103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:58.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.382+0000 7ff89d5e2640 1 --2- 172.21.15.53:0/1825667138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff898109240 0x7ff898109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:58.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.382+0000 7ff89d5e2640 1 --2- 172.21.15.53:0/1825667138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898103900 0x7ff898103d10 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.382+0000 7ff89d5e2640 1 -- 172.21.15.53:0/1825667138 >> 172.21.15.53:0/1825667138 conn(0x7ff89807b5f0 msgr2=0x7ff89807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.382+0000 7ff89d5e2640 1 -- 172.21.15.53:0/1825667138 shutdown_connections 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.382+0000 7ff89d5e2640 1 -- 172.21.15.53:0/1825667138 wait complete. 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.383+0000 7ff89d5e2640 1 Processor -- start 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.383+0000 7ff89d5e2640 1 -- start start 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.383+0000 7ff89d5e2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff898103900 0x7ff89819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.383+0000 7ff89d5e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898109240 0x7ff89819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.383+0000 7ff89d5e2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff898109b90 0x7ff89819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.383+0000 7ff89d5e2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff898113700 con 0x7ff898109240 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.383+0000 7ff89d5e2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff898113580 con 0x7ff898103900 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.383+0000 7ff89d5e2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff898113880 con 0x7ff898109b90 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff8967fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898109240 0x7ff89819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff8967fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898109240 0x7ff89819a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47076/0 (socket says 172.21.15.53:47076) 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff8967fc640 1 -- 172.21.15.53:0/968299697 learned_addr learned my addr 172.21.15.53:0/968299697 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:05:58.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff896ffd640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff898103900 0x7ff89819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff8977fe640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff898109b90 0x7ff89819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff8967fc640 1 -- 172.21.15.53:0/968299697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff898109b90 msgr2=0x7ff89819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff8967fc640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff898109b90 0x7ff89819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff8967fc640 1 -- 172.21.15.53:0/968299697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff898103900 msgr2=0x7ff89819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff8967fc640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff898103900 0x7ff89819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff8967fc640 1 -- 172.21.15.53:0/968299697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8981a0140 con 0x7ff898109240 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff8977fe640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff898109b90 0x7ff89819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff8967fc640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898109240 0x7ff89819a770 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00d750 tx=0x7ff88c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff87ffff640 1 -- 172.21.15.53:0/968299697 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c017070 con 0x7ff898109240 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff87ffff640 1 -- 172.21.15.53:0/968299697 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff88c0054b0 con 0x7ff898109240 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff89d5e2640 1 -- 172.21.15.53:0/968299697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8981a0430 con 0x7ff898109240 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff87ffff640 1 -- 172.21.15.53:0/968299697 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c004bc0 con 0x7ff898109240 2024-08-31T06:05:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.384+0000 7ff89d5e2640 1 -- 172.21.15.53:0/968299697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8981a6b90 con 0x7ff898109240 2024-08-31T06:05:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.385+0000 7ff89d5e2640 1 -- 172.21.15.53:0/968299697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff898103d10 con 0x7ff898109240 2024-08-31T06:05:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.388+0000 7ff87ffff640 1 -- 172.21.15.53:0/968299697 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff88c009c30 con 0x7ff898109240 2024-08-31T06:05:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.389+0000 7ff87ffff640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff8800b4ca0 0x7ff8800b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:05:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.389+0000 7ff896ffd640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff8800b4ca0 0x7ff8800b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:05:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.389+0000 7ff87ffff640 1 -- 172.21.15.53:0/968299697 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7ff88c0e5470 con 0x7ff898109240 2024-08-31T06:05:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.389+0000 7ff896ffd640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff8800b4ca0 0x7ff8800b71b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff888000c00 tx=0x7ff888009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:05:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.392+0000 7ff87ffff640 1 -- 172.21.15.53:0/968299697 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff88c0ac200 con 0x7ff898109240 2024-08-31T06:05:58.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.618+0000 7ff89d5e2640 1 -- 172.21.15.53:0/968299697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff89819b300 con 0x7ff898109240 2024-08-31T06:05:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.619+0000 7ff87ffff640 1 -- 172.21.15.53:0/968299697 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11985 (secure 0 0 0) 0x7ff88c0abb00 con 0x7ff898109240 2024-08-31T06:05:58.621 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:05:58.621 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-08-31T06:04:23:449285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:04:23.359453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:05:58.622 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-08-31T06:05:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 -- 172.21.15.53:0/968299697 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff8800b4ca0 msgr2=0x7ff8800b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff8800b4ca0 0x7ff8800b71b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff888000c00 tx=0x7ff888009680 comp rx=0 tx=0).stop 2024-08-31T06:05:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 -- 172.21.15.53:0/968299697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898109240 msgr2=0x7ff89819a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:05:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898109240 0x7ff89819a770 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00d750 tx=0x7ff88c00dc10 comp rx=0 tx=0).stop 2024-08-31T06:05:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 -- 172.21.15.53:0/968299697 shutdown_connections 2024-08-31T06:05:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff8800b4ca0 0x7ff8800b71b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff898109b90 0x7ff89819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898109240 0x7ff89819a770 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 --2- 172.21.15.53:0/968299697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff898103900 0x7ff89819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:05:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 -- 172.21.15.53:0/968299697 >> 172.21.15.53:0/968299697 conn(0x7ff89807b5f0 msgr2=0x7ff8981073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:05:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 -- 172.21.15.53:0/968299697 shutdown_connections 2024-08-31T06:05:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:05:58.621+0000 7ff89d5e2640 1 -- 172.21.15.53:0/968299697 wait complete. 2024-08-31T06:05:58.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:58 smithi130 ceph-mon[22266]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T06:05:58.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:58 smithi153 ceph-mon[22320]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T06:05:59.266 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:05:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:05:59.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:05:59 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/968299697' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:59.637 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:05:59 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/968299697' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:05:59.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:05:59 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/968299697' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:06:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.002+0000 7f2025583640 1 -- 172.21.15.53:0/3967472612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2020109b90 msgr2=0x7f20201103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.002+0000 7f2025583640 1 --2- 172.21.15.53:0/3967472612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2020109b90 0x7f20201103c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2018009ca0 tx=0x7f201802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.002+0000 7f2025583640 1 -- 172.21.15.53:0/3967472612 shutdown_connections 2024-08-31T06:06:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.002+0000 7f2025583640 1 --2- 172.21.15.53:0/3967472612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2020109b90 0x7f20201103c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.002+0000 7f2025583640 1 --2- 172.21.15.53:0/3967472612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2020109240 0x7f2020109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.002+0000 7f2025583640 1 --2- 172.21.15.53:0/3967472612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2020103900 0x7f2020103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.002+0000 7f2025583640 1 -- 172.21.15.53:0/3967472612 >> 172.21.15.53:0/3967472612 conn(0x7f202007b5f0 msgr2=0x7f202007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.002+0000 7f2025583640 1 -- 172.21.15.53:0/3967472612 shutdown_connections 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.002+0000 7f2025583640 1 -- 172.21.15.53:0/3967472612 wait complete. 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f2025583640 1 Processor -- start 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f2025583640 1 -- start start 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f2025583640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2020103900 0x7f202019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f2025583640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2020109240 0x7f202019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f2025583640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2020109b90 0x7f202019f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f2025583640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2020113750 con 0x7f2020109b90 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f2025583640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20201135d0 con 0x7f2020109240 2024-08-31T06:06:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f2025583640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20201138d0 con 0x7f2020103900 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f201f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2020109b90 0x7f202019f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f201f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2020109b90 0x7f202019f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47100/0 (socket says 172.21.15.53:47100) 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f201f7fe640 1 -- 172.21.15.53:0/430666888 learned_addr learned my addr 172.21.15.53:0/430666888 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f201effd640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2020103900 0x7f202019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.003+0000 7f201e7fc640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2020109240 0x7f202019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.004+0000 7f201f7fe640 1 -- 172.21.15.53:0/430666888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2020103900 msgr2=0x7f202019a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.004+0000 7f201f7fe640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2020103900 0x7f202019a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.004+0000 7f201f7fe640 1 -- 172.21.15.53:0/430666888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2020109240 msgr2=0x7f202019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.004+0000 7f201f7fe640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2020109240 0x7f202019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.004+0000 7f201f7fe640 1 -- 172.21.15.53:0/430666888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20201a0050 con 0x7f2020109b90 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.004+0000 7f201f7fe640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2020109b90 0x7f202019f9e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2018005cc0 tx=0x7f2018032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.004+0000 7f2007fff640 1 -- 172.21.15.53:0/430666888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018032e00 con 0x7f2020109b90 2024-08-31T06:06:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.004+0000 7f2025583640 1 -- 172.21.15.53:0/430666888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20201a02e0 con 0x7f2020109b90 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.004+0000 7f2007fff640 1 -- 172.21.15.53:0/430666888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20180044d0 con 0x7f2020109b90 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.004+0000 7f2007fff640 1 -- 172.21.15.53:0/430666888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018030b70 con 0x7f2020109b90 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.004+0000 7f2025583640 1 -- 172.21.15.53:0/430666888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20201a6b60 con 0x7f2020109b90 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.006+0000 7f202baf8740 1 Processor -- start 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.007+0000 7f2007fff640 1 -- 172.21.15.53:0/430666888 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2018030d10 con 0x7f2020109b90 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.007+0000 7f202baf8740 1 -- start start 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.007+0000 7f202baf8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e3e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.007+0000 7f202baf8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a701b0 0x55ca66e3e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.007+0000 7f202baf8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a78390 0x55ca66e3ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.007+0000 7f202baf8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ca66db5680 con 0x55ca66a99070 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.007+0000 7f202baf8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ca66da4c10 con 0x55ca66a701b0 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.007+0000 7f202baf8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ca66da8bc0 con 0x55ca66a78390 2024-08-31T06:06:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.007+0000 7f201e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e3e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.007+0000 7f201e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e3e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47108/0 (socket says 172.21.15.53:47108) 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.007+0000 7f201e7fc640 1 -- 172.21.15.53:0/428063642 learned_addr learned my addr 172.21.15.53:0/428063642 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f201effd640 1 --2- 172.21.15.53:0/428063642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a701b0 0x55ca66e3e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f201e7fc640 1 -- 172.21.15.53:0/428063642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a78390 msgr2=0x55ca66e3ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f201e7fc640 1 --2- 172.21.15.53:0/428063642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a78390 0x55ca66e3ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f201e7fc640 1 -- 172.21.15.53:0/428063642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a701b0 msgr2=0x55ca66e3e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f201e7fc640 1 --2- 172.21.15.53:0/428063642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a701b0 0x55ca66e3e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f201e7fc640 1 -- 172.21.15.53:0/428063642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca66b04650 con 0x55ca66a99070 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f2007fff640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4cd0 0x7f20080b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f201effd640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4cd0 0x7f20080b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f201e7fc640 1 --2- 172.21.15.53:0/428063642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e3e310 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f201400bc50 tx=0x7f2014011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3b230a8a078657 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f2007fff640 1 -- 172.21.15.53:0/430666888 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2018106900 con 0x7f2020109b90 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f20057fa640 1 -- 172.21.15.53:0/428063642 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201401a400 con 0x55ca66a99070 2024-08-31T06:06:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f20057fa640 1 -- 172.21.15.53:0/428063642 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2014012880 con 0x55ca66a99070 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.008+0000 7f20057fa640 1 -- 172.21.15.53:0/428063642 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201400f740 con 0x55ca66a99070 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.009+0000 7f202baf8740 1 -- 172.21.15.53:0/428063642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 msgr2=0x55ca66e3e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.009+0000 7f202baf8740 1 --2- 172.21.15.53:0/428063642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e3e310 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f201400bc50 tx=0x7f2014011750 comp rx=0 tx=0).stop 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.009+0000 7f201effd640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4cd0 0x7f20080b71e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55ca66e3cf90 tx=0x7f201000c4b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.009+0000 7f202baf8740 1 -- 172.21.15.53:0/428063642 shutdown_connections 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.009+0000 7f202baf8740 1 --2- 172.21.15.53:0/428063642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a78390 0x55ca66e3ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.009+0000 7f202baf8740 1 --2- 172.21.15.53:0/428063642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a701b0 0x55ca66e3e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.009+0000 7f202baf8740 1 --2- 172.21.15.53:0/428063642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e3e310 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.009+0000 7f202baf8740 1 -- 172.21.15.53:0/428063642 >> 172.21.15.53:0/428063642 conn(0x55ca66a8d460 msgr2=0x55ca66e3c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.009+0000 7f202baf8740 1 -- 172.21.15.53:0/428063642 shutdown_connections 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.009+0000 7f202baf8740 1 -- 172.21.15.53:0/428063642 wait complete. 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f202baf8740 1 -- start start 2024-08-31T06:06:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f202baf8740 1 Processor -- start 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f202baf8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a701b0 0x55ca66e49aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f202baf8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a78390 0x55ca66e49fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f202baf8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a99070 0x55ca66e55de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f202baf8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ca66c07700 con 0x55ca66a78390 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f202baf8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ca66d2b750 con 0x55ca66a99070 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f202baf8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ca66e4caf0 con 0x55ca66a701b0 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f202baf8740 10 client.0 _ll_register_callbacks cb 0x55ca66d5ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f201e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a78390 0x55ca66e49fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f201e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a78390 0x55ca66e49fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47124/0 (socket says 172.21.15.53:47124) 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.010+0000 7f201e7fc640 1 -- 172.21.15.53:0/2555562840 learned_addr learned my addr 172.21.15.53:0/2555562840 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f201effd640 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a701b0 0x55ca66e49aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f201e7fc640 1 -- 172.21.15.53:0/2555562840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a701b0 msgr2=0x55ca66e49aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:00.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f201e7fc640 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a701b0 0x55ca66e49aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f201f7fe640 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a99070 0x55ca66e55de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f201e7fc640 1 -- 172.21.15.53:0/2555562840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a99070 msgr2=0x55ca66e55de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f201e7fc640 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a99070 0x55ca66e55de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f201e7fc640 1 -- 172.21.15.53:0/2555562840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca66d64900 con 0x55ca66a78390 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f201effd640 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a701b0 0x55ca66e49aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f201e7fc640 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a78390 0x55ca66e49fe0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f201400ba30 tx=0x7f20140123f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22bebdc7a67cdc8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f2002ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f2002ff5640 1 -- 172.21.15.53:0/2555562840 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20140126a0 con 0x55ca66a78390 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f2002ff5640 1 -- 172.21.15.53:0/2555562840 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2014012c40 con 0x55ca66a78390 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f202baf8740 1 -- 172.21.15.53:0/2555562840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2014012880 con 0x55ca66a78390 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f2002ff5640 1 -- 172.21.15.53:0/2555562840 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2014004020 con 0x55ca66a78390 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f202baf8740 10 client.16056 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:00.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f202baf8740 1 -- 172.21.15.53:0/2555562840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca66e588a0 con 0x55ca66a78390 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f2002ff5640 1 -- 172.21.15.53:0/2555562840 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2014012880 con 0x55ca66a78390 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.011+0000 7f2002ff5640 1 -- 172.21.15.53:0/2555562840 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f20140046c0 con 0x55ca66a78390 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.012+0000 7f202baf8740 10 client.16056 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.012+0000 7f202baf8740 10 client.16056 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.012+0000 7f202baf8740 20 client.16056 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.012+0000 7f202baf8740 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ca66a579f0 0x55ca66e5bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.012+0000 7f202baf8740 4 client.16056 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.012+0000 7f202baf8740 1 -- 172.21.15.53:0/2555562840 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca66db75d0 con 0x55ca66a579f0 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.012+0000 7f201effd640 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ca66a579f0 0x55ca66e5bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.012+0000 7f201effd640 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ca66a579f0 0x55ca66e5bc60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=28b761431bc8136e server_cookie=6fae4312f4b3d74b in_seq=0 out_seq=0 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.012+0000 7f2002ff5640 10 client.16056 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:06:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.013+0000 7f2002ff5640 1 -- 172.21.15.53:0/2555562840 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ca66db75d0 con 0x55ca66a579f0 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.013+0000 7f2002ff5640 10 client.16056 handle_command_reply: tid=0 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.013+0000 7f202baf8740 1 client.16056 shutdown 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f202baf8740 1 -- 172.21.15.53:0/2555562840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a78390 msgr2=0x55ca66e49fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f202baf8740 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a78390 0x55ca66e49fe0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f201400ba30 tx=0x7f20140123f0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f202baf8740 1 -- 172.21.15.53:0/2555562840 shutdown_connections 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f202baf8740 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a99070 0x55ca66e55de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f202baf8740 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a78390 0x55ca66e49fe0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f202baf8740 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ca66a579f0 0x55ca66e5bc60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f202baf8740 1 --2- 172.21.15.53:0/2555562840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a701b0 0x55ca66e49aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f2002ff5640 0 client.16056 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f202baf8740 1 -- 172.21.15.53:0/2555562840 >> 172.21.15.53:0/2555562840 conn(0x55ca66a8d460 msgr2=0x55ca66e414f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f202baf8740 1 -- 172.21.15.53:0/2555562840 shutdown_connections 2024-08-31T06:06:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f202baf8740 1 -- 172.21.15.53:0/2555562840 wait complete. 2024-08-31T06:06:00.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.014+0000 7f202baf8740 20 client.16056 trim_cache size 0 max 16384 2024-08-31T06:06:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f202baf8740 1 Processor -- start 2024-08-31T06:06:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f202baf8740 1 -- start start 2024-08-31T06:06:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f202baf8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a701b0 0x55ca66e3fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f202baf8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a78390 0x55ca66e4b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f202baf8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e55d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f202baf8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f20201af3b0 con 0x55ca66a99070 2024-08-31T06:06:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f202baf8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20201b0ef0 con 0x55ca66a701b0 2024-08-31T06:06:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f202baf8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20201afa80 con 0x55ca66a78390 2024-08-31T06:06:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f201f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e55d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f201e7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a78390 0x55ca66e4b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f201f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e55d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47140/0 (socket says 172.21.15.53:47140) 2024-08-31T06:06:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f201f7fe640 1 -- 172.21.15.53:0/39017616 learned_addr learned my addr 172.21.15.53:0/39017616 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.028+0000 7f201effd640 1 --2- 172.21.15.53:0/39017616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a701b0 0x55ca66e3fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.029+0000 7f201f7fe640 1 -- 172.21.15.53:0/39017616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a78390 msgr2=0x55ca66e4b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:00.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.029+0000 7f201f7fe640 1 --2- 172.21.15.53:0/39017616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a78390 0x55ca66e4b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.029+0000 7f201f7fe640 1 -- 172.21.15.53:0/39017616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a701b0 msgr2=0x55ca66e3fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.029+0000 7f201f7fe640 1 --2- 172.21.15.53:0/39017616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a701b0 0x55ca66e3fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.029+0000 7f201f7fe640 1 -- 172.21.15.53:0/39017616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca66e41170 con 0x55ca66a99070 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.029+0000 7f201f7fe640 1 --2- 172.21.15.53:0/39017616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e55d50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f20180c9010 tx=0x7f20180cce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2be1da4b42327b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.029+0000 7f2004ff9640 1 -- 172.21.15.53:0/39017616 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20180cd690 con 0x55ca66a99070 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.029+0000 7f2004ff9640 1 -- 172.21.15.53:0/39017616 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2018036040 con 0x55ca66a99070 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.029+0000 7f2004ff9640 1 -- 172.21.15.53:0/39017616 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018004680 con 0x55ca66a99070 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.030+0000 7f202baf8740 1 -- 172.21.15.53:0/39017616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 msgr2=0x55ca66e55d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.030+0000 7f202baf8740 1 --2- 172.21.15.53:0/39017616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e55d50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f20180c9010 tx=0x7f20180cce30 comp rx=0 tx=0).stop 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.030+0000 7f202baf8740 1 -- 172.21.15.53:0/39017616 shutdown_connections 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.030+0000 7f202baf8740 1 --2- 172.21.15.53:0/39017616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a99070 0x55ca66e55d50 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.030+0000 7f202baf8740 1 --2- 172.21.15.53:0/39017616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a78390 0x55ca66e4b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.030+0000 7f202baf8740 1 --2- 172.21.15.53:0/39017616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a701b0 0x55ca66e3fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.030+0000 7f202baf8740 1 -- 172.21.15.53:0/39017616 >> 172.21.15.53:0/39017616 conn(0x55ca66a8d460 msgr2=0x55ca66e4afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:00.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.030+0000 7f202baf8740 1 -- 172.21.15.53:0/39017616 shutdown_connections 2024-08-31T06:06:00.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.030+0000 7f202baf8740 1 -- 172.21.15.53:0/39017616 wait complete. 2024-08-31T06:06:00.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.030+0000 7f202baf8740 1 -- start start 2024-08-31T06:06:00.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f202baf8740 1 Processor -- start 2024-08-31T06:06:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f202baf8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a701b0 0x55ca66eba570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f202baf8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a78390 0x55ca66ebaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f202baf8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a99070 0x55ca66ec53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f202baf8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f20201b0820 con 0x55ca66a701b0 2024-08-31T06:06:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f202baf8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20201b0150 con 0x55ca66a78390 2024-08-31T06:06:00.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f202baf8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20201ad390 con 0x55ca66a99070 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f202baf8740 10 client.0 _ll_register_callbacks cb 0x7f201000c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f201effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a701b0 0x55ca66eba570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f201f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a99070 0x55ca66ec53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f201effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a701b0 0x55ca66eba570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47144/0 (socket says 172.21.15.53:47144) 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f201f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a99070 0x55ca66ec53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48466/0 (socket says 172.21.15.53:48466) 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f201effd640 1 -- 172.21.15.53:0/3335808258 learned_addr learned my addr 172.21.15.53:0/3335808258 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.031+0000 7f201e7fc640 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a78390 0x55ca66ebaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f201effd640 1 -- 172.21.15.53:0/3335808258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a99070 msgr2=0x55ca66ec53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f201effd640 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a99070 0x55ca66ec53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f201effd640 1 -- 172.21.15.53:0/3335808258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a78390 msgr2=0x55ca66ebaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f201effd640 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a78390 0x55ca66ebaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f201effd640 1 -- 172.21.15.53:0/3335808258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca66ec5a00 con 0x55ca66a701b0 2024-08-31T06:06:00.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f201effd640 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a701b0 0x55ca66eba570 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x55ca66c077f0 tx=0x7f2010004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1783a37b2c8e88 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f2002ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f2002ff5640 1 -- 172.21.15.53:0/3335808258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2010031060 con 0x55ca66a701b0 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f2002ff5640 1 -- 172.21.15.53:0/3335808258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2010005050 con 0x55ca66a701b0 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f202baf8740 1 -- 172.21.15.53:0/3335808258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2018036040 con 0x55ca66a701b0 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f2002ff5640 1 -- 172.21.15.53:0/3335808258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2010005250 con 0x55ca66a701b0 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f202baf8740 10 client.16062 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.032+0000 7f202baf8740 1 -- 172.21.15.53:0/3335808258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca66ec6d10 con 0x55ca66a701b0 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.033+0000 7f2002ff5640 1 -- 172.21.15.53:0/3335808258 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2018036040 con 0x55ca66a701b0 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.033+0000 7f2002ff5640 1 -- 172.21.15.53:0/3335808258 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2010018040 con 0x55ca66a701b0 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.033+0000 7f202baf8740 10 client.16062 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.033+0000 7f202baf8740 10 client.16062 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.033+0000 7f202baf8740 20 client.16062 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:00.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.033+0000 7f202baf8740 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ca66a2cda0 0x55ca66ec94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.033+0000 7f202baf8740 4 client.16062 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.033+0000 7f202baf8740 1 -- 172.21.15.53:0/3335808258 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ca66db3070 con 0x55ca66a2cda0 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.033+0000 7f201e7fc640 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ca66a2cda0 0x55ca66ec94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f2002ff5640 10 client.16062 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f201e7fc640 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ca66a2cda0 0x55ca66ec94b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a9d4d56a80bdebae server_cookie=588ac37b1a25d3f9 in_seq=0 out_seq=0 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f2002ff5640 1 -- 172.21.15.53:0/3335808258 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ca66db3070 con 0x55ca66a2cda0 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f2002ff5640 10 client.16062 handle_command_reply: tid=0 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 1 client.16062 shutdown 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 1 -- 172.21.15.53:0/3335808258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a701b0 msgr2=0x55ca66eba570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a701b0 0x55ca66eba570 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x55ca66c077f0 tx=0x7f2010004730 comp rx=0 tx=0).stop 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 1 -- 172.21.15.53:0/3335808258 shutdown_connections 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ca66a2cda0 0x55ca66ec94b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ca66a99070 0x55ca66ec53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f2002ff5640 0 client.16062 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:06:00.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ca66a78390 0x55ca66ebaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 1 --2- 172.21.15.53:0/3335808258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca66a701b0 0x55ca66eba570 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 1 -- 172.21.15.53:0/3335808258 >> 172.21.15.53:0/3335808258 conn(0x55ca66a8d460 msgr2=0x55ca66e4b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:00.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 1 -- 172.21.15.53:0/3335808258 shutdown_connections 2024-08-31T06:06:00.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 1 -- 172.21.15.53:0/3335808258 wait complete. 2024-08-31T06:06:00.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.034+0000 7f202baf8740 20 client.16062 trim_cache size 0 max 16384 2024-08-31T06:06:00.041 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:06:00.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 -- 172.21.15.53:0/430666888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4cd0 msgr2=0x7f20080b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:00.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4cd0 0x7f20080b71e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55ca66e3cf90 tx=0x7f201000c4b0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 -- 172.21.15.53:0/430666888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2020109b90 msgr2=0x7f202019f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:00.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2020109b90 0x7f202019f9e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2018005cc0 tx=0x7f2018032a10 comp rx=0 tx=0).stop 2024-08-31T06:06:00.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 -- 172.21.15.53:0/430666888 shutdown_connections 2024-08-31T06:06:00.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20080b4cd0 0x7f20080b71e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2020109b90 0x7f202019f9e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2020109240 0x7f202019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 --2- 172.21.15.53:0/430666888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2020103900 0x7f202019a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:00.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 -- 172.21.15.53:0/430666888 >> 172.21.15.53:0/430666888 conn(0x7f202007b5f0 msgr2=0x7f2020107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:00.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 -- 172.21.15.53:0/430666888 shutdown_connections 2024-08-31T06:06:00.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:00.035+0000 7f2025583640 1 -- 172.21.15.53:0/430666888 wait complete. 2024-08-31T06:06:00.529 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:00 smithi130 ceph-mon[22266]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-08-31T06:06:00.577 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:00 smithi153 ceph-mon[22320]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-08-31T06:06:00.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:00 smithi053 ceph-mon[18924]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-08-31T06:06:00.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:06:00.969 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:01.353 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:01 smithi053 ceph-mon[18924]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-08-31T06:06:01.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.443+0000 7fa108df5640 1 -- 172.21.15.53:0/1503943378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa104102880 msgr2=0x7fa104102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.443+0000 7fa108df5640 1 --2- 172.21.15.53:0/1503943378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa104102880 0x7fa104102c90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009900 tx=0x7fa0f402a410 comp rx=0 tx=0).stop 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.443+0000 7fa108df5640 1 -- 172.21.15.53:0/1503943378 shutdown_connections 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.443+0000 7fa108df5640 1 --2- 172.21.15.53:0/1503943378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa104108b10 0x7fa10410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.443+0000 7fa108df5640 1 --2- 172.21.15.53:0/1503943378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1041081c0 0x7fa1041085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.443+0000 7fa108df5640 1 --2- 172.21.15.53:0/1503943378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa104102880 0x7fa104102c90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.443+0000 7fa108df5640 1 -- 172.21.15.53:0/1503943378 >> 172.21.15.53:0/1503943378 conn(0x7fa104079510 msgr2=0x7fa104079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.443+0000 7fa108df5640 1 -- 172.21.15.53:0/1503943378 shutdown_connections 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.443+0000 7fa108df5640 1 -- 172.21.15.53:0/1503943378 wait complete. 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.444+0000 7fa108df5640 1 Processor -- start 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa108df5640 1 -- start start 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa108df5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa104102880 0x7fa10419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa108df5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1041081c0 0x7fa10419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa108df5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa104108b10 0x7fa10419fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa108df5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa104113850 con 0x7fa1041081c0 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa108df5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041136d0 con 0x7fa104108b10 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa108df5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041139d0 con 0x7fa104102880 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa101d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1041081c0 0x7fa10419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa101d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1041081c0 0x7fa10419a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47152/0 (socket says 172.21.15.53:47152) 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa101d9b640 1 -- 172.21.15.53:0/2545983612 learned_addr learned my addr 172.21.15.53:0/2545983612 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa10259c640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa104102880 0x7fa10419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa102d9d640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa104108b10 0x7fa10419fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa101d9b640 1 -- 172.21.15.53:0/2545983612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa104102880 msgr2=0x7fa10419a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa101d9b640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa104102880 0x7fa10419a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa101d9b640 1 -- 172.21.15.53:0/2545983612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa104108b10 msgr2=0x7fa10419fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa101d9b640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa104108b10 0x7fa10419fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.445+0000 7fa101d9b640 1 -- 172.21.15.53:0/2545983612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1041a0210 con 0x7fa1041081c0 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.446+0000 7fa101d9b640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1041081c0 0x7fa10419a840 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8006fd0 tx=0x7fa0f800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.446+0000 7fa0f37fe640 1 -- 172.21.15.53:0/2545983612 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8011830 con 0x7fa1041081c0 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.446+0000 7fa0f37fe640 1 -- 172.21.15.53:0/2545983612 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f8016070 con 0x7fa1041081c0 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.446+0000 7fa108df5640 1 -- 172.21.15.53:0/2545983612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1041a0500 con 0x7fa1041081c0 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.446+0000 7fa0f37fe640 1 -- 172.21.15.53:0/2545983612 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8010d30 con 0x7fa1041081c0 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.446+0000 7fa108df5640 1 -- 172.21.15.53:0/2545983612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1041a6c60 con 0x7fa1041081c0 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.448+0000 7fa0f37fe640 1 -- 172.21.15.53:0/2545983612 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa0f80119d0 con 0x7fa1041081c0 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa10f36a740 1 Processor -- start 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa10f36a740 1 -- start start 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9eef6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9eef6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9eef71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa10f36a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bf9ee69680 con 0x55bf9eb241b0 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa10f36a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bf9ee58c10 con 0x55bf9eb2c390 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa10f36a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bf9ee5cbc0 con 0x55bf9eb4d070 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa10259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9eef6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa10259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9eef6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47156/0 (socket says 172.21.15.53:47156) 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa10259c640 1 -- 172.21.15.53:0/2244556101 learned_addr learned my addr 172.21.15.53:0/2244556101 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa0f37fe640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0ec0b4ca0 0x7fa0ec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa101d9b640 1 --2- 172.21.15.53:0/2244556101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9eef71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.449+0000 7fa102d9d640 1 --2- 172.21.15.53:0/2244556101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9eef6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa102d9d640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0ec0b4ca0 0x7fa0ec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa10259c640 1 -- 172.21.15.53:0/2244556101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 msgr2=0x55bf9eef6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa10259c640 1 --2- 172.21.15.53:0/2244556101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9eef6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa10259c640 1 -- 172.21.15.53:0/2244556101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 msgr2=0x55bf9eef71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa10259c640 1 --2- 172.21.15.53:0/2244556101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9eef71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa10259c640 1 -- 172.21.15.53:0/2244556101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf9ebb8650 con 0x55bf9eb241b0 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa101d9b640 1 --2- 172.21.15.53:0/2244556101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9eef71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa0f37fe640 1 -- 172.21.15.53:0/2545983612 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa0f80e4b00 con 0x7fa1041081c0 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa10259c640 1 --2- 172.21.15.53:0/2244556101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9eef6c60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa0f402a930 tx=0x7fa0f4031d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a09a00353ab1c68 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa102d9d640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0ec0b4ca0 0x7fa0ec0b71b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0070b0 tx=0x7fa0fc00c040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa0f0ff9640 1 -- 172.21.15.53:0/2244556101 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4035030 con 0x55bf9eb241b0 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa0f0ff9640 1 -- 172.21.15.53:0/2244556101 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f4040070 con 0x55bf9eb241b0 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.450+0000 7fa0f0ff9640 1 -- 172.21.15.53:0/2244556101 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4003af0 con 0x55bf9eb241b0 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.451+0000 7fa10f36a740 1 -- 172.21.15.53:0/2244556101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 msgr2=0x55bf9eef6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.451+0000 7fa10f36a740 1 --2- 172.21.15.53:0/2244556101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9eef6c60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa0f402a930 tx=0x7fa0f4031d10 comp rx=0 tx=0).stop 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.451+0000 7fa10f36a740 1 -- 172.21.15.53:0/2244556101 shutdown_connections 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.451+0000 7fa10f36a740 1 --2- 172.21.15.53:0/2244556101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9eef71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.451+0000 7fa10f36a740 1 --2- 172.21.15.53:0/2244556101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9eef6c60 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.451+0000 7fa10f36a740 1 --2- 172.21.15.53:0/2244556101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9eef6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.451+0000 7fa10f36a740 1 -- 172.21.15.53:0/2244556101 >> 172.21.15.53:0/2244556101 conn(0x55bf9eb41460 msgr2=0x55bf9eef4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.451+0000 7fa10f36a740 1 -- 172.21.15.53:0/2244556101 shutdown_connections 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.451+0000 7fa10f36a740 1 -- 172.21.15.53:0/2244556101 wait complete. 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10f36a740 1 -- start start 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10f36a740 1 Processor -- start 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef01ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9ef02410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9ef0e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10f36a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bf9ecbb700 con 0x55bf9eb241b0 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10f36a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bf9eddf750 con 0x55bf9eb2c390 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10f36a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bf9ef04ea0 con 0x55bf9eb4d070 2024-08-31T06:06:01.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10f36a740 10 client.0 _ll_register_callbacks cb 0x55bf9ee0ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef01ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef01ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47162/0 (socket says 172.21.15.53:47162) 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10259c640 1 -- 172.21.15.53:0/649523682 learned_addr learned my addr 172.21.15.53:0/649523682 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa101d9b640 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9ef02410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa102d9d640 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9ef0e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10259c640 1 -- 172.21.15.53:0/649523682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 msgr2=0x55bf9ef0e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10259c640 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9ef0e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10259c640 1 -- 172.21.15.53:0/649523682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 msgr2=0x55bf9ef02410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10259c640 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9ef02410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.452+0000 7fa10259c640 1 -- 172.21.15.53:0/649523682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf9ee18900 con 0x55bf9eb241b0 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa10259c640 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef01ed0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4005ec0 tx=0x7fa0f4031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e8e477103c48fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa0e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:01.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/649523682 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4035070 con 0x55bf9eb241b0 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/649523682 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa0f403c640 con 0x55bf9eb241b0 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa10f36a740 1 -- 172.21.15.53:0/649523682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0f4040070 con 0x55bf9eb241b0 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/649523682 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa0f403c840 con 0x55bf9eb241b0 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa10f36a740 10 client.16074 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa10f36a740 1 -- 172.21.15.53:0/649523682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bf9ef10ce0 con 0x55bf9eb241b0 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/649523682 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f4040070 con 0x55bf9eb241b0 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/649523682 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa0f404d9c0 con 0x55bf9eb241b0 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa10f36a740 10 client.16074 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa10f36a740 10 client.16074 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa10f36a740 20 client.16074 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa10f36a740 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55bf9eb0b9f0 0x55bf9ef14040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa10f36a740 4 client.16074 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.453+0000 7fa10f36a740 1 -- 172.21.15.53:0/649523682 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf9ee6b5d0 con 0x55bf9eb0b9f0 2024-08-31T06:06:01.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.454+0000 7fa101d9b640 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55bf9eb0b9f0 0x55bf9ef14040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.454+0000 7fa101d9b640 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55bf9eb0b9f0 0x55bf9ef14040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=25300f07d795d81c server_cookie=5f6d1525675bb5d2 in_seq=0 out_seq=0 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.454+0000 7fa0e9ffb640 10 client.16074 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/649523682 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa0f808bf90 con 0x55bf9eb0b9f0 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa0e9ffb640 10 client.16074 handle_command_reply: tid=0 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 1 client.16074 shutdown 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 1 -- 172.21.15.53:0/649523682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 msgr2=0x55bf9ef01ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef01ed0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4005ec0 tx=0x7fa0f4031480 comp rx=0 tx=0).stop 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 1 -- 172.21.15.53:0/649523682 shutdown_connections 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9ef0e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9ef02410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55bf9eb0b9f0 0x55bf9ef14040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 1 --2- 172.21.15.53:0/649523682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef01ed0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 1 -- 172.21.15.53:0/649523682 >> 172.21.15.53:0/649523682 conn(0x55bf9eb41460 msgr2=0x55bf9eeee7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:01.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa0e9ffb640 0 client.16074 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:06:01.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 1 -- 172.21.15.53:0/649523682 shutdown_connections 2024-08-31T06:06:01.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 1 -- 172.21.15.53:0/649523682 wait complete. 2024-08-31T06:06:01.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.455+0000 7fa10f36a740 20 client.16074 trim_cache size 0 max 16384 2024-08-31T06:06:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10f36a740 1 Processor -- start 2024-08-31T06:06:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10f36a740 1 -- start start 2024-08-31T06:06:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef0e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9eeff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9eeff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10f36a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041ad300 con 0x55bf9eb241b0 2024-08-31T06:06:01.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10f36a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041aee40 con 0x55bf9eb2c390 2024-08-31T06:06:01.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10f36a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041ad9d0 con 0x55bf9eb4d070 2024-08-31T06:06:01.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef0e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef0e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47164/0 (socket says 172.21.15.53:47164) 2024-08-31T06:06:01.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10259c640 1 -- 172.21.15.53:0/1024956096 learned_addr learned my addr 172.21.15.53:0/1024956096 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:01.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10259c640 1 -- 172.21.15.53:0/1024956096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 msgr2=0x55bf9eeff600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:01.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10259c640 1 --2- 172.21.15.53:0/1024956096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9eeff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa101d9b640 1 --2- 172.21.15.53:0/1024956096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9eeff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10259c640 1 -- 172.21.15.53:0/1024956096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 msgr2=0x55bf9eeff0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:01.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10259c640 1 --2- 172.21.15.53:0/1024956096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9eeff0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.469+0000 7fa10259c640 1 -- 172.21.15.53:0/1024956096 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf9eef8a10 con 0x55bf9eb241b0 2024-08-31T06:06:01.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.470+0000 7fa10259c640 1 --2- 172.21.15.53:0/1024956096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef0e160 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa0f404de10 tx=0x7fa0f402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10ecfb2c293658d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.470+0000 7fa0ebfff640 1 -- 172.21.15.53:0/1024956096 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4035070 con 0x55bf9eb241b0 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.470+0000 7fa0ebfff640 1 -- 172.21.15.53:0/1024956096 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f4040040 con 0x55bf9eb241b0 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.470+0000 7fa0ebfff640 1 -- 172.21.15.53:0/1024956096 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f404d9e0 con 0x55bf9eb241b0 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.470+0000 7fa10f36a740 1 -- 172.21.15.53:0/1024956096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 msgr2=0x55bf9ef0e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.470+0000 7fa10f36a740 1 --2- 172.21.15.53:0/1024956096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef0e160 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa0f404de10 tx=0x7fa0f402a410 comp rx=0 tx=0).stop 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.470+0000 7fa10f36a740 1 -- 172.21.15.53:0/1024956096 shutdown_connections 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.470+0000 7fa10f36a740 1 --2- 172.21.15.53:0/1024956096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9eeff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.470+0000 7fa10f36a740 1 --2- 172.21.15.53:0/1024956096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb2c390 0x55bf9eeff0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.470+0000 7fa10f36a740 1 --2- 172.21.15.53:0/1024956096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb241b0 0x55bf9ef0e160 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.471+0000 7fa10f36a740 1 -- 172.21.15.53:0/1024956096 >> 172.21.15.53:0/1024956096 conn(0x55bf9eb41460 msgr2=0x55bf9ef01e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.471+0000 7fa10f36a740 1 -- 172.21.15.53:0/1024956096 shutdown_connections 2024-08-31T06:06:01.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.471+0000 7fa10f36a740 1 -- 172.21.15.53:0/1024956096 wait complete. 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.471+0000 7fa10f36a740 1 -- start start 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.471+0000 7fa10f36a740 1 Processor -- start 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.471+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb241b0 0x55bf9ef17950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.471+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb2c390 0x55bf9ef14e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.471+0000 7fa10f36a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9ef15450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.471+0000 7fa10f36a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041ae770 con 0x55bf9eb2c390 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.471+0000 7fa10f36a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041ae0a0 con 0x55bf9eb241b0 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.471+0000 7fa10f36a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041ab2e0 con 0x55bf9eb4d070 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa10f36a740 10 client.0 _ll_register_callbacks cb 0x7fa0f4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa101d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb2c390 0x55bf9ef14e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa101d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb2c390 0x55bf9ef14e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47178/0 (socket says 172.21.15.53:47178) 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa101d9b640 1 -- 172.21.15.53:0/1283744649 learned_addr learned my addr 172.21.15.53:0/1283744649 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:01.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa102d9d640 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9ef15450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa10259c640 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb241b0 0x55bf9ef17950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa101d9b640 1 -- 172.21.15.53:0/1283744649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 msgr2=0x55bf9ef15450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa101d9b640 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9ef15450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa101d9b640 1 -- 172.21.15.53:0/1283744649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb241b0 msgr2=0x55bf9ef17950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa101d9b640 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb241b0 0x55bf9ef17950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa101d9b640 1 -- 172.21.15.53:0/1283744649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf9ef15be0 con 0x55bf9eb2c390 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa102d9d640 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9ef15450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa101d9b640 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb2c390 0x55bf9ef14e20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa0f801f000 tx=0x7fa0f806f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0f8be91b17afee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa0e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/1283744649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f80aad00 con 0x55bf9eb2c390 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/1283744649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa0f80a7480 con 0x55bf9eb2c390 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa10f36a740 1 -- 172.21.15.53:0/1283744649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0f4040040 con 0x55bf9eb2c390 2024-08-31T06:06:01.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/1283744649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa0f80ab8f0 con 0x55bf9eb2c390 2024-08-31T06:06:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa10f36a740 10 client.16080 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.472+0000 7fa10f36a740 1 -- 172.21.15.53:0/1283744649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bf9ef7e800 con 0x55bf9eb2c390 2024-08-31T06:06:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.473+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/1283744649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f4040040 con 0x55bf9eb2c390 2024-08-31T06:06:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.473+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/1283744649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa0f80b4080 con 0x55bf9eb2c390 2024-08-31T06:06:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.473+0000 7fa10f36a740 10 client.16080 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.473+0000 7fa10f36a740 10 client.16080 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:06:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.473+0000 7fa10f36a740 20 client.16080 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.473+0000 7fa10f36a740 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55bf9eae0da0 0x55bf9ef80f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.473+0000 7fa10f36a740 4 client.16080 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:06:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.473+0000 7fa10f36a740 1 -- 172.21.15.53:0/1283744649 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf9ee67070 con 0x55bf9eae0da0 2024-08-31T06:06:01.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.473+0000 7fa10259c640 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55bf9eae0da0 0x55bf9ef80f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:01.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa0e9ffb640 10 client.16080 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:06:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10259c640 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55bf9eae0da0 0x55bf9ef80f20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bc5cefc50191ec59 server_cookie=2504b7291d17961f in_seq=0 out_seq=0 2024-08-31T06:06:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa0e9ffb640 1 -- 172.21.15.53:0/1283744649 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf9ee67070 con 0x55bf9eae0da0 2024-08-31T06:06:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa0e9ffb640 10 client.16080 handle_command_reply: tid=0 2024-08-31T06:06:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 1 client.16080 shutdown 2024-08-31T06:06:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 1 -- 172.21.15.53:0/1283744649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb2c390 msgr2=0x55bf9ef14e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb2c390 0x55bf9ef14e20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa0f801f000 tx=0x7fa0f806f890 comp rx=0 tx=0).stop 2024-08-31T06:06:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 1 -- 172.21.15.53:0/1283744649 shutdown_connections 2024-08-31T06:06:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf9eb4d070 0x55bf9ef15450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55bf9eae0da0 0x55bf9ef80f20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa0e9ffb640 0 client.16080 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:06:01.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf9eb2c390 0x55bf9ef14e20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 1 --2- 172.21.15.53:0/1283744649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf9eb241b0 0x55bf9ef17950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 1 -- 172.21.15.53:0/1283744649 >> 172.21.15.53:0/1283744649 conn(0x55bf9eb41460 msgr2=0x55bf9eef7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:01.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 1 -- 172.21.15.53:0/1283744649 shutdown_connections 2024-08-31T06:06:01.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 1 -- 172.21.15.53:0/1283744649 wait complete. 2024-08-31T06:06:01.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.474+0000 7fa10f36a740 20 client.16080 trim_cache size 0 max 16384 2024-08-31T06:06:01.483 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:06:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 -- 172.21.15.53:0/2545983612 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0ec0b4ca0 msgr2=0x7fa0ec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0ec0b4ca0 0x7fa0ec0b71b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0070b0 tx=0x7fa0fc00c040 comp rx=0 tx=0).stop 2024-08-31T06:06:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 -- 172.21.15.53:0/2545983612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1041081c0 msgr2=0x7fa10419a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1041081c0 0x7fa10419a840 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8006fd0 tx=0x7fa0f800b8e0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 -- 172.21.15.53:0/2545983612 shutdown_connections 2024-08-31T06:06:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0ec0b4ca0 0x7fa0ec0b71b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa104108b10 0x7fa10419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1041081c0 0x7fa10419a840 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 --2- 172.21.15.53:0/2545983612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa104102880 0x7fa10419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:01.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 -- 172.21.15.53:0/2545983612 >> 172.21.15.53:0/2545983612 conn(0x7fa104079510 msgr2=0x7fa1041062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:01.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 -- 172.21.15.53:0/2545983612 shutdown_connections 2024-08-31T06:06:01.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:01.475+0000 7fa108df5640 1 -- 172.21.15.53:0/2545983612 wait complete. 2024-08-31T06:06:01.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:01 smithi130 ceph-mon[22266]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-08-31T06:06:01.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:01 smithi153 ceph-mon[22320]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-08-31T06:06:02.204 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:06:02.458 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.935+0000 7f2b5847e640 1 -- 172.21.15.53:0/310401445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b50106080 msgr2=0x7f2b50106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.935+0000 7f2b5847e640 1 --2- 172.21.15.53:0/310401445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b50106080 0x7f2b50106490 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009900 tx=0x7f2b4402a410 comp rx=0 tx=0).stop 2024-08-31T06:06:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.935+0000 7f2b5847e640 1 -- 172.21.15.53:0/310401445 shutdown_connections 2024-08-31T06:06:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.935+0000 7f2b5847e640 1 --2- 172.21.15.53:0/310401445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b501069d0 0x7f2b501103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.935+0000 7f2b5847e640 1 --2- 172.21.15.53:0/310401445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b50106080 0x7f2b50106490 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.935+0000 7f2b5847e640 1 --2- 172.21.15.53:0/310401445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b50101e90 0x7f2b501022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.935+0000 7f2b5847e640 1 -- 172.21.15.53:0/310401445 >> 172.21.15.53:0/310401445 conn(0x7f2b50077a60 msgr2=0x7f2b50077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.935+0000 7f2b5847e640 1 -- 172.21.15.53:0/310401445 shutdown_connections 2024-08-31T06:06:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.935+0000 7f2b5847e640 1 -- 172.21.15.53:0/310401445 wait complete. 2024-08-31T06:06:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.936+0000 7f2b5847e640 1 Processor -- start 2024-08-31T06:06:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.936+0000 7f2b5847e640 1 -- start start 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.936+0000 7f2b5847e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b50101e90 0x7f2b5019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.936+0000 7f2b5847e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b50106080 0x7f2b5019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.936+0000 7f2b5847e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b501069d0 0x7f2b5019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.936+0000 7f2b5847e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501136f0 con 0x7f2b50106080 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.936+0000 7f2b5847e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50113570 con 0x7f2b501069d0 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.936+0000 7f2b5847e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50113870 con 0x7f2b50101e90 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.936+0000 7f2b55a19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b50106080 0x7f2b5019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.936+0000 7f2b55a19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b50106080 0x7f2b5019a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47196/0 (socket says 172.21.15.53:47196) 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.936+0000 7f2b55a19640 1 -- 172.21.15.53:0/2321434721 learned_addr learned my addr 172.21.15.53:0/2321434721 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b5621a640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b50101e90 0x7f2b5019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b501069d0 0x7f2b5019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b55a19640 1 -- 172.21.15.53:0/2321434721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b50101e90 msgr2=0x7f2b5019a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b55a19640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b50101e90 0x7f2b5019a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b55a19640 1 -- 172.21.15.53:0/2321434721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b501069d0 msgr2=0x7f2b5019f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b55a19640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b501069d0 0x7f2b5019f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b55a19640 1 -- 172.21.15.53:0/2321434721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b501a00f0 con 0x7f2b50106080 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b5621a640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b50101e90 0x7f2b5019a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b501069d0 0x7f2b5019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b55a19640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b50106080 0x7f2b5019a720 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2b44005940 tx=0x7f2b440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b4f7fe640 1 -- 172.21.15.53:0/2321434721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4403f030 con 0x7f2b50106080 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b4f7fe640 1 -- 172.21.15.53:0/2321434721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b44003c90 con 0x7f2b50106080 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b4f7fe640 1 -- 172.21.15.53:0/2321434721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44035070 con 0x7f2b50106080 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b5847e640 1 -- 172.21.15.53:0/2321434721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b501a0380 con 0x7f2b50106080 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.937+0000 7f2b5847e640 1 -- 172.21.15.53:0/2321434721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b501a6b40 con 0x7f2b50106080 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.940+0000 7f2b5e9f3740 1 Processor -- start 2024-08-31T06:06:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b5e9f3740 1 -- start start 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915cb4070 0x55c916059350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c916059890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c916059dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c915fd0680 con 0x55c915c93390 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c915fbfc10 con 0x55c915c8b1b0 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c915fc3bc0 con 0x55c915cb4070 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b4f7fe640 1 -- 172.21.15.53:0/2321434721 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2b44042030 con 0x7f2b50106080 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b55a19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c916059dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b55a19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c916059dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47206/0 (socket says 172.21.15.53:47206) 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b55a19640 1 -- 172.21.15.53:0/2430056301 learned_addr learned my addr 172.21.15.53:0/2430056301 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b5621a640 1 --2- 172.21.15.53:0/2430056301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c916059890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/2430056301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915cb4070 0x55c916059350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b55a19640 1 -- 172.21.15.53:0/2430056301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915cb4070 msgr2=0x55c916059350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b55a19640 1 --2- 172.21.15.53:0/2430056301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915cb4070 0x55c916059350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b55a19640 1 -- 172.21.15.53:0/2430056301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 msgr2=0x55c916059890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.941+0000 7f2b55a19640 1 --2- 172.21.15.53:0/2430056301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c916059890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.942+0000 7f2b55a19640 1 -- 172.21.15.53:0/2430056301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c915d1f650 con 0x55c915c93390 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.942+0000 7f2b55a19640 1 --2- 172.21.15.53:0/2430056301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c916059dd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2b44103290 tx=0x7f2b44109e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bb57578fddcb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.942+0000 7f2b4f7fe640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b380b4ca0 0x7f2b380b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.942+0000 7f2b4cd9a640 1 -- 172.21.15.53:0/2430056301 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4410ea90 con 0x55c915c93390 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.942+0000 7f2b4cd9a640 1 -- 172.21.15.53:0/2430056301 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b440cbe00 con 0x55c915c93390 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.942+0000 7f2b4cd9a640 1 -- 172.21.15.53:0/2430056301 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b440db050 con 0x55c915c93390 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.942+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b380b4ca0 0x7f2b380b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.942+0000 7f2b4f7fe640 1 -- 172.21.15.53:0/2321434721 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2b44105c60 con 0x7f2b50106080 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.943+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/2430056301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 msgr2=0x55c916059dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.943+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b380b4ca0 0x7f2b380b71b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800cc80 tx=0x7f2b4800c430 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.943+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/2430056301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c916059dd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2b44103290 tx=0x7f2b44109e90 comp rx=0 tx=0).stop 2024-08-31T06:06:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.943+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/2430056301 shutdown_connections 2024-08-31T06:06:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.943+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/2430056301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c916059dd0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.943+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/2430056301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c916059890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.943+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/2430056301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915cb4070 0x55c916059350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.943+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/2430056301 >> 172.21.15.53:0/2430056301 conn(0x55c915ca8460 msgr2=0x55c916057240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.943+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/2430056301 shutdown_connections 2024-08-31T06:06:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.943+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/2430056301 wait complete. 2024-08-31T06:06:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b5e9f3740 1 -- start start 2024-08-31T06:06:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b5e9f3740 1 Processor -- start 2024-08-31T06:06:02.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915c8b1b0 0x55c916064a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c93390 0x55c916064f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c915e22700 con 0x55c915cb4070 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c915f46750 con 0x55c915c93390 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c9160678f0 con 0x55c915c8b1b0 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b56a1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b5e9f3740 10 client.0 _ll_register_callbacks cb 0x55c915f75e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b56a1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47220/0 (socket says 172.21.15.53:47220) 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.944+0000 7f2b56a1b640 1 -- 172.21.15.53:0/385452904 learned_addr learned my addr 172.21.15.53:0/385452904 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b5621a640 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915c8b1b0 0x55c916064a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b55a19640 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c93390 0x55c916064f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b56a1b640 1 -- 172.21.15.53:0/385452904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915c8b1b0 msgr2=0x55c916064a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915c8b1b0 0x55c916064a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b56a1b640 1 -- 172.21.15.53:0/385452904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c93390 msgr2=0x55c916064f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c93390 0x55c916064f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b56a1b640 1 -- 172.21.15.53:0/385452904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c915f7f900 con 0x55c915cb4070 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b55a19640 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c93390 0x55c916064f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070b50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2b48005d50 tx=0x7f2b480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2689056ec163c844 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b35ffb640 1 -- 172.21.15.53:0/385452904 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4801cb20 con 0x55c915cb4070 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b35ffb640 1 -- 172.21.15.53:0/385452904 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2b4801ccc0 con 0x55c915cb4070 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/385452904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b440cbe00 con 0x55c915cb4070 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b35ffb640 1 -- 172.21.15.53:0/385452904 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b48028480 con 0x55c915cb4070 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b5e9f3740 10 client.16092 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.945+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/385452904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c916073600 con 0x55c915cb4070 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.946+0000 7f2b35ffb640 1 -- 172.21.15.53:0/385452904 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b440cbe00 con 0x55c915cb4070 2024-08-31T06:06:02.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.946+0000 7f2b35ffb640 1 -- 172.21.15.53:0/385452904 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2b4801d410 con 0x55c915cb4070 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.946+0000 7f2b5e9f3740 10 client.16092 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.946+0000 7f2b5e9f3740 10 client.16092 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.946+0000 7f2b5e9f3740 20 client.16092 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.946+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55c915c729f0 0x55c916076b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.946+0000 7f2b5e9f3740 4 client.16092 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.946+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/385452904 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c915fd25d0 con 0x55c915c729f0 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.946+0000 7f2b5621a640 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55c915c729f0 0x55c916076b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.947+0000 7f2b5621a640 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55c915c729f0 0x55c916076b40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6136cf04a5c8d0c3 server_cookie=a417014cb4533b1e in_seq=0 out_seq=0 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.947+0000 7f2b35ffb640 10 client.16092 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.947+0000 7f2b35ffb640 1 -- 172.21.15.53:0/385452904 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c915fd25d0 con 0x55c915c729f0 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.947+0000 7f2b35ffb640 10 client.16092 handle_command_reply: tid=0 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.947+0000 7f2b5e9f3740 1 client.16092 shutdown 2024-08-31T06:06:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/385452904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 msgr2=0x55c916070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070b50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2b48005d50 tx=0x7f2b480046c0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/385452904 shutdown_connections 2024-08-31T06:06:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55c915c729f0 0x55c916076b40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070b50 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c93390 0x55c916064f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/385452904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915c8b1b0 0x55c916064a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/385452904 >> 172.21.15.53:0/385452904 conn(0x55c915ca8460 msgr2=0x55c91605c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b35ffb640 0 client.16092 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:06:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/385452904 shutdown_connections 2024-08-31T06:06:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/385452904 wait complete. 2024-08-31T06:06:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.948+0000 7f2b5e9f3740 20 client.16092 trim_cache size 0 max 16384 2024-08-31T06:06:02.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.961+0000 7f2b5e9f3740 1 Processor -- start 2024-08-31T06:06:02.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.961+0000 7f2b5e9f3740 1 -- start start 2024-08-31T06:06:02.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.961+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c91605aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.961+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915c93390 0x55c9160709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.961+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.961+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501af480 con 0x55c915cb4070 2024-08-31T06:06:02.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.961+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501b0fc0 con 0x55c915c8b1b0 2024-08-31T06:06:02.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.961+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501afb50 con 0x55c915c93390 2024-08-31T06:06:02.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.961+0000 7f2b56a1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.961+0000 7f2b56a1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47234/0 (socket says 172.21.15.53:47234) 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.961+0000 7f2b56a1b640 1 -- 172.21.15.53:0/1922131068 learned_addr learned my addr 172.21.15.53:0/1922131068 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.962+0000 7f2b5621a640 1 --2- 172.21.15.53:0/1922131068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c91605aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.962+0000 7f2b55a19640 1 --2- 172.21.15.53:0/1922131068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915c93390 0x55c9160709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.962+0000 7f2b56a1b640 1 -- 172.21.15.53:0/1922131068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915c93390 msgr2=0x55c9160709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.962+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/1922131068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915c93390 0x55c9160709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.962+0000 7f2b56a1b640 1 -- 172.21.15.53:0/1922131068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 msgr2=0x55c91605aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.962+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/1922131068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c91605aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.962+0000 7f2b56a1b640 1 -- 172.21.15.53:0/1922131068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91605b640 con 0x55c915cb4070 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.962+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/1922131068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070f00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2b48011d40 tx=0x7f2b4801da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ba3b956a53210a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.962+0000 7f2b37fff640 1 -- 172.21.15.53:0/1922131068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4801d610 con 0x55c915cb4070 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.962+0000 7f2b37fff640 1 -- 172.21.15.53:0/1922131068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b480054d0 con 0x55c915cb4070 2024-08-31T06:06:02.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.962+0000 7f2b37fff640 1 -- 172.21.15.53:0/1922131068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4801c770 con 0x55c915cb4070 2024-08-31T06:06:02.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.963+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/1922131068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 msgr2=0x55c916070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:02.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.963+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/1922131068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070f00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2b48011d40 tx=0x7f2b4801da00 comp rx=0 tx=0).stop 2024-08-31T06:06:02.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.963+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/1922131068 shutdown_connections 2024-08-31T06:06:02.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.963+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/1922131068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915cb4070 0x55c916070f00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.963+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/1922131068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915c93390 0x55c9160709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.963+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/1922131068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c91605aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.963+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/1922131068 >> 172.21.15.53:0/1922131068 conn(0x55c915ca8460 msgr2=0x55c91605a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.963+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/1922131068 shutdown_connections 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.963+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/1922131068 wait complete. 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.963+0000 7f2b5e9f3740 1 -- start start 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.963+0000 7f2b5e9f3740 1 Processor -- start 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c9160dccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c9160db1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b5e9f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915cb4070 0x55c9160db710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501b08f0 con 0x55c915c93390 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501b0220 con 0x55c915c8b1b0 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b5e9f3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501ad460 con 0x55c915cb4070 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b5e9f3740 10 client.0 _ll_register_callbacks cb 0x7f2b4800c9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:02.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b55a19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c9160db1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b55a19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c9160db1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47246/0 (socket says 172.21.15.53:47246) 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b55a19640 1 -- 172.21.15.53:0/818556561 learned_addr learned my addr 172.21.15.53:0/818556561 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b5621a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c9160dccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b56a1b640 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915cb4070 0x55c9160db710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b55a19640 1 -- 172.21.15.53:0/818556561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915cb4070 msgr2=0x55c9160db710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b55a19640 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915cb4070 0x55c9160db710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b55a19640 1 -- 172.21.15.53:0/818556561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 msgr2=0x55c9160dccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b55a19640 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c9160dccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b55a19640 1 -- 172.21.15.53:0/818556561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9160dbe50 con 0x55c915c93390 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.964+0000 7f2b55a19640 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c9160db1d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2b4410e650 tx=0x7f2b44009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d827e4d6e72749 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b35ffb640 1 -- 172.21.15.53:0/818556561 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b440da190 con 0x55c915c93390 2024-08-31T06:06:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b35ffb640 1 -- 172.21.15.53:0/818556561 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2b441094e0 con 0x55c915c93390 2024-08-31T06:06:02.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/818556561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b480054d0 con 0x55c915c93390 2024-08-31T06:06:02.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b35ffb640 1 -- 172.21.15.53:0/818556561 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b440da3d0 con 0x55c915c93390 2024-08-31T06:06:02.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b5e9f3740 10 client.16098 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:02.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/818556561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c91606c910 con 0x55c915c93390 2024-08-31T06:06:02.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b35ffb640 1 -- 172.21.15.53:0/818556561 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b480054d0 con 0x55c915c93390 2024-08-31T06:06:02.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b35ffb640 1 -- 172.21.15.53:0/818556561 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2b440c8580 con 0x55c915c93390 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b5e9f3740 10 client.16098 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b5e9f3740 10 client.16098 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b5e9f3740 20 client.16098 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55c915c47da0 0x55c91606ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b5e9f3740 4 client.16098 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.965+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/818556561 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c915fce070 con 0x55c915c47da0 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b5621a640 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55c915c47da0 0x55c91606ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b5621a640 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55c915c47da0 0x55c91606ce80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eeea6ea906683f0e server_cookie=e8ea6aabc85c591f in_seq=0 out_seq=0 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b35ffb640 10 client.16098 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b35ffb640 1 -- 172.21.15.53:0/818556561 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c915fce070 con 0x55c915c47da0 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b35ffb640 10 client.16098 handle_command_reply: tid=0 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b5e9f3740 1 client.16098 shutdown 2024-08-31T06:06:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/818556561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 msgr2=0x55c9160db1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c9160db1d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2b4410e650 tx=0x7f2b44009260 comp rx=0 tx=0).stop 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/818556561 shutdown_connections 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55c915c47da0 0x55c91606ce80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c915cb4070 0x55c9160db710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b35ffb640 0 client.16098 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c915c93390 0x55c9160db1d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b5e9f3740 1 --2- 172.21.15.53:0/818556561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c915c8b1b0 0x55c9160dccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.966+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/818556561 >> 172.21.15.53:0/818556561 conn(0x55c915ca8460 msgr2=0x55c91605e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/818556561 shutdown_connections 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5e9f3740 1 -- 172.21.15.53:0/818556561 wait complete. 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5e9f3740 20 client.16098 trim_cache size 0 max 16384 2024-08-31T06:06:02.974 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:06:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 -- 172.21.15.53:0/2321434721 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b380b4ca0 msgr2=0x7f2b380b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b380b4ca0 0x7f2b380b71b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800cc80 tx=0x7f2b4800c430 comp rx=0 tx=0).stop 2024-08-31T06:06:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 -- 172.21.15.53:0/2321434721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b50106080 msgr2=0x7f2b5019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b50106080 0x7f2b5019a720 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2b44005940 tx=0x7f2b440042f0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 -- 172.21.15.53:0/2321434721 shutdown_connections 2024-08-31T06:06:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2b380b4ca0 0x7f2b380b71b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b501069d0 0x7f2b5019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b50106080 0x7f2b5019a720 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 --2- 172.21.15.53:0/2321434721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b50101e90 0x7f2b5019a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:02.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 -- 172.21.15.53:0/2321434721 >> 172.21.15.53:0/2321434721 conn(0x7f2b50077a60 msgr2=0x7f2b501083a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:02.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 -- 172.21.15.53:0/2321434721 shutdown_connections 2024-08-31T06:06:02.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:02.967+0000 7f2b5847e640 1 -- 172.21.15.53:0/2321434721 wait complete. 2024-08-31T06:06:03.659 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:03 smithi053 ceph-mon[18924]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-08-31T06:06:03.688 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:06:03.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:03 smithi130 ceph-mon[22266]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-08-31T06:06:03.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:03 smithi153 ceph-mon[22320]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-08-31T06:06:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.437+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3962631949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c4109260 msgr2=0x7f80c4109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.437+0000 7f80c9c0b640 1 --2- 172.21.15.53:0/3962631949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c4109260 0x7f80c4109670 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009900 tx=0x7f80ac02a410 comp rx=0 tx=0).stop 2024-08-31T06:06:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.438+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3962631949 shutdown_connections 2024-08-31T06:06:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.438+0000 7f80c9c0b640 1 --2- 172.21.15.53:0/3962631949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80c4109bb0 0x7f80c41103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.438+0000 7f80c9c0b640 1 --2- 172.21.15.53:0/3962631949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c4109260 0x7f80c4109670 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.438+0000 7f80c9c0b640 1 --2- 172.21.15.53:0/3962631949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80c4103920 0x7f80c4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.438+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3962631949 >> 172.21.15.53:0/3962631949 conn(0x7f80c40ff370 msgr2=0x7f80c41017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.438+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3962631949 shutdown_connections 2024-08-31T06:06:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.438+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3962631949 wait complete. 2024-08-31T06:06:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.438+0000 7f80c9c0b640 1 Processor -- start 2024-08-31T06:06:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.438+0000 7f80c9c0b640 1 -- start start 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c9c0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80c4103920 0x7f80c419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c9c0b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80c4109260 0x7f80c419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c9c0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c4109bb0 0x7f80c419fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c9c0b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4113770 con 0x7f80c4109bb0 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c9c0b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41135f0 con 0x7f80c4103920 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c9c0b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41138f0 con 0x7f80c4109260 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c4109bb0 0x7f80c419fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c4109bb0 0x7f80c419fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38844/0 (socket says 172.21.15.53:38844) 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c3fff640 1 -- 172.21.15.53:0/3167092401 learned_addr learned my addr 172.21.15.53:0/3167092401 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c37fe640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80c4103920 0x7f80c419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80baffd640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80c4109260 0x7f80c419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c3fff640 1 -- 172.21.15.53:0/3167092401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80c4109260 msgr2=0x7f80c419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c3fff640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80c4109260 0x7f80c419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c3fff640 1 -- 172.21.15.53:0/3167092401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80c4103920 msgr2=0x7f80c419a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c3fff640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80c4103920 0x7f80c419a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80c3fff640 1 -- 172.21.15.53:0/3167092401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c41a0130 con 0x7f80c4109bb0 2024-08-31T06:06:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.439+0000 7f80baffd640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80c4109260 0x7f80c419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.440+0000 7f80c3fff640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c4109bb0 0x7f80c419fa00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00cad0 tx=0x7f80bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.440+0000 7f80c17fa640 1 -- 172.21.15.53:0/3167092401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00ae20 con 0x7f80c4109bb0 2024-08-31T06:06:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.440+0000 7f80c17fa640 1 -- 172.21.15.53:0/3167092401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80bc005020 con 0x7f80c4109bb0 2024-08-31T06:06:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.440+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3167092401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c41a0420 con 0x7f80c4109bb0 2024-08-31T06:06:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.440+0000 7f80c17fa640 1 -- 172.21.15.53:0/3167092401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00f6b0 con 0x7f80c4109bb0 2024-08-31T06:06:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.440+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3167092401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c41a6b80 con 0x7f80c4109bb0 2024-08-31T06:06:04.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.442+0000 7f80d0180740 1 Processor -- start 2024-08-31T06:06:04.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80c17fa640 1 -- 172.21.15.53:0/3167092401 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f80bc00f910 con 0x7f80c4109bb0 2024-08-31T06:06:04.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80d0180740 1 -- start start 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80d0180740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0bbd070 0x55c0c0f62310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80d0180740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f62850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80d0180740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f62d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80d0180740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0c0ed9680 con 0x55c0c0b941b0 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80d0180740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c0c0ec8c10 con 0x55c0c0bbd070 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80d0180740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c0c0eccbc0 con 0x55c0c0b9c390 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80c37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f62850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80c37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f62850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38862/0 (socket says 172.21.15.53:38862) 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80c37fe640 1 -- 172.21.15.53:0/3499133894 learned_addr learned my addr 172.21.15.53:0/3499133894 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80baffd640 1 --2- 172.21.15.53:0/3499133894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0bbd070 0x55c0c0f62310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80baffd640 1 --2- 172.21.15.53:0/3499133894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f62d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.443+0000 7f80c17fa640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80b00b4ca0 0x7f80b00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80c37fe640 1 -- 172.21.15.53:0/3499133894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 msgr2=0x55c0c0f62d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80c37fe640 1 --2- 172.21.15.53:0/3499133894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f62d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80c37fe640 1 -- 172.21.15.53:0/3499133894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0bbd070 msgr2=0x55c0c0f62310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80c37fe640 1 --2- 172.21.15.53:0/3499133894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0bbd070 0x55c0c0f62310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80c37fe640 1 -- 172.21.15.53:0/3499133894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c0c28650 con 0x55c0c0b941b0 2024-08-31T06:06:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80baffd640 1 --2- 172.21.15.53:0/3499133894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f62d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80c3fff640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80b00b4ca0 0x7f80b00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80c37fe640 1 --2- 172.21.15.53:0/3499133894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f62850 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f80b400ac10 tx=0x7f80b400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd6deb460161f41 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80c17fa640 1 -- 172.21.15.53:0/3167092401 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f80bc0e5940 con 0x7f80c4109bb0 2024-08-31T06:06:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80b9ffb640 1 -- 172.21.15.53:0/3499133894 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b401d070 con 0x55c0c0b941b0 2024-08-31T06:06:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80b9ffb640 1 -- 172.21.15.53:0/3499133894 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80b4018ad0 con 0x55c0c0b941b0 2024-08-31T06:06:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.444+0000 7f80b9ffb640 1 -- 172.21.15.53:0/3499133894 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4010980 con 0x55c0c0b941b0 2024-08-31T06:06:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.445+0000 7f80d0180740 1 -- 172.21.15.53:0/3499133894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 msgr2=0x55c0c0f62850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.445+0000 7f80d0180740 1 --2- 172.21.15.53:0/3499133894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f62850 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f80b400ac10 tx=0x7f80b400f790 comp rx=0 tx=0).stop 2024-08-31T06:06:04.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.445+0000 7f80c3fff640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80b00b4ca0 0x7f80b00b71b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0abfc0 tx=0x7f80bc084040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.445+0000 7f80d0180740 1 -- 172.21.15.53:0/3499133894 shutdown_connections 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.445+0000 7f80d0180740 1 --2- 172.21.15.53:0/3499133894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f62d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.445+0000 7f80d0180740 1 --2- 172.21.15.53:0/3499133894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f62850 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.445+0000 7f80d0180740 1 --2- 172.21.15.53:0/3499133894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0bbd070 0x55c0c0f62310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.445+0000 7f80d0180740 1 -- 172.21.15.53:0/3499133894 >> 172.21.15.53:0/3499133894 conn(0x55c0c0bb1460 msgr2=0x55c0c0f60200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.445+0000 7f80d0180740 1 -- 172.21.15.53:0/3499133894 shutdown_connections 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.445+0000 7f80d0180740 1 -- 172.21.15.53:0/3499133894 wait complete. 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80d0180740 1 -- start start 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80d0180740 1 Processor -- start 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80d0180740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0b941b0 0x55c0c0f6daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80d0180740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f6dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80d0180740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0bbd070 0x55c0c0f79e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80d0180740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0c0d2b700 con 0x55c0c0bbd070 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80d0180740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c0c0e4f750 con 0x55c0c0b941b0 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80d0180740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c0c0f70af0 con 0x55c0c0b9c390 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80d0180740 10 client.0 _ll_register_callbacks cb 0x55c0c0e7ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80baffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0bbd070 0x55c0c0f79e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80baffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0bbd070 0x55c0c0f79e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38876/0 (socket says 172.21.15.53:38876) 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80baffd640 1 -- 172.21.15.53:0/193690120 learned_addr learned my addr 172.21.15.53:0/193690120 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80c37fe640 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f6dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.446+0000 7f80baffd640 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0b941b0 0x55c0c0f6daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.447+0000 7f80baffd640 1 -- 172.21.15.53:0/193690120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 msgr2=0x55c0c0f6dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.447+0000 7f80baffd640 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f6dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.447+0000 7f80baffd640 1 -- 172.21.15.53:0/193690120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0b941b0 msgr2=0x55c0c0f6daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.447+0000 7f80baffd640 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0b941b0 0x55c0c0f6daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.447+0000 7f80baffd640 1 -- 172.21.15.53:0/193690120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c0e88900 con 0x55c0c0bbd070 2024-08-31T06:06:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.447+0000 7f80baffd640 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0bbd070 0x55c0c0f79e10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005f70 tx=0x7f80ac02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b619d83ddd47f15 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.447+0000 7f80a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:04.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80a2ffd640 1 -- 172.21.15.53:0/193690120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac035040 con 0x55c0c0bbd070 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80a2ffd640 1 -- 172.21.15.53:0/193690120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f80ac03d450 con 0x55c0c0bbd070 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80d0180740 1 -- 172.21.15.53:0/193690120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80b4018ad0 con 0x55c0c0bbd070 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80a2ffd640 1 -- 172.21.15.53:0/193690120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80ac003f50 con 0x55c0c0bbd070 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80d0180740 10 client.16110 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80d0180740 1 -- 172.21.15.53:0/193690120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c0c0f7c8d0 con 0x55c0c0bbd070 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80a2ffd640 1 -- 172.21.15.53:0/193690120 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80b4018ad0 con 0x55c0c0bbd070 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80a2ffd640 1 -- 172.21.15.53:0/193690120 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f80ac03c6e0 con 0x55c0c0bbd070 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80d0180740 10 client.16110 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80d0180740 10 client.16110 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80d0180740 20 client.16110 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80d0180740 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c0c0b7b9f0 0x55c0c0f7fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80d0180740 4 client.16110 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:04.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.450+0000 7f80d0180740 1 -- 172.21.15.53:0/193690120 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0c0edb5d0 con 0x55c0c0b7b9f0 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.451+0000 7f80c37fe640 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c0c0b7b9f0 0x55c0c0f7fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.451+0000 7f80a2ffd640 10 client.16110 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.451+0000 7f80c37fe640 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c0c0b7b9f0 0x55c0c0f7fda0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e4561d7f920081b5 server_cookie=1e61e2e6df682c97 in_seq=0 out_seq=0 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80a2ffd640 1 -- 172.21.15.53:0/193690120 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c0c0edb5d0 con 0x55c0c0b7b9f0 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80a2ffd640 10 client.16110 handle_command_reply: tid=0 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80d0180740 1 client.16110 shutdown 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80d0180740 1 -- 172.21.15.53:0/193690120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0bbd070 msgr2=0x55c0c0f79e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80d0180740 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0bbd070 0x55c0c0f79e10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005f70 tx=0x7f80ac02a410 comp rx=0 tx=0).stop 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80d0180740 1 -- 172.21.15.53:0/193690120 shutdown_connections 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80d0180740 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c0c0b7b9f0 0x55c0c0f7fda0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80d0180740 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0bbd070 0x55c0c0f79e10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80d0180740 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f6dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80a2ffd640 0 client.16110 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:06:04.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80d0180740 1 --2- 172.21.15.53:0/193690120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0b941b0 0x55c0c0f6daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80d0180740 1 -- 172.21.15.53:0/193690120 >> 172.21.15.53:0/193690120 conn(0x55c0c0bb1460 msgr2=0x55c0c0f654a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80d0180740 1 -- 172.21.15.53:0/193690120 shutdown_connections 2024-08-31T06:06:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.452+0000 7f80d0180740 1 -- 172.21.15.53:0/193690120 wait complete. 2024-08-31T06:06:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.453+0000 7f80d0180740 20 client.16110 trim_cache size 0 max 16384 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80d0180740 1 Processor -- start 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80d0180740 1 -- start start 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80d0180740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0b941b0 0x55c0c0f65b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80d0180740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b9c390 0x55c0c0f6ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80d0180740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0bbd070 0x55c0c0f6b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80d0180740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41af4f0 con 0x55c0c0b9c390 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80d0180740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41b1030 con 0x55c0c0b941b0 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80d0180740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41afbc0 con 0x55c0c0bbd070 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80c37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b9c390 0x55c0c0f6ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80c37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b9c390 0x55c0c0f6ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38888/0 (socket says 172.21.15.53:38888) 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80c37fe640 1 -- 172.21.15.53:0/3183849302 learned_addr learned my addr 172.21.15.53:0/3183849302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80baffd640 1 --2- 172.21.15.53:0/3183849302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0bbd070 0x55c0c0f6b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80baffd640 1 --2- 172.21.15.53:0/3183849302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0b941b0 0x55c0c0f65b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80c37fe640 1 -- 172.21.15.53:0/3183849302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0bbd070 msgr2=0x55c0c0f6b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80c37fe640 1 --2- 172.21.15.53:0/3183849302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0bbd070 0x55c0c0f6b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80c37fe640 1 -- 172.21.15.53:0/3183849302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0b941b0 msgr2=0x55c0c0f65b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80c37fe640 1 --2- 172.21.15.53:0/3183849302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0b941b0 0x55c0c0f65b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80c37fe640 1 -- 172.21.15.53:0/3183849302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c0f6ed60 con 0x55c0c0b9c390 2024-08-31T06:06:04.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.466+0000 7f80baffd640 1 --2- 172.21.15.53:0/3183849302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0bbd070 0x55c0c0f6b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:04.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.467+0000 7f80c37fe640 1 --2- 172.21.15.53:0/3183849302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b9c390 0x55c0c0f6ac90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f80b400a6b0 tx=0x7f80b400a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57666aa2ac6062d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.467+0000 7f80b97fa640 1 -- 172.21.15.53:0/3183849302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b401d040 con 0x55c0c0b9c390 2024-08-31T06:06:04.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.467+0000 7f80b97fa640 1 -- 172.21.15.53:0/3183849302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80b40054d0 con 0x55c0c0b9c390 2024-08-31T06:06:04.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.467+0000 7f80b97fa640 1 -- 172.21.15.53:0/3183849302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b40186a0 con 0x55c0c0b9c390 2024-08-31T06:06:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.468+0000 7f80d0180740 1 -- 172.21.15.53:0/3183849302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b9c390 msgr2=0x55c0c0f6ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.468+0000 7f80d0180740 1 --2- 172.21.15.53:0/3183849302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b9c390 0x55c0c0f6ac90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f80b400a6b0 tx=0x7f80b400a250 comp rx=0 tx=0).stop 2024-08-31T06:06:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.468+0000 7f80d0180740 1 -- 172.21.15.53:0/3183849302 shutdown_connections 2024-08-31T06:06:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.468+0000 7f80d0180740 1 --2- 172.21.15.53:0/3183849302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0bbd070 0x55c0c0f6b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.468+0000 7f80d0180740 1 --2- 172.21.15.53:0/3183849302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b9c390 0x55c0c0f6ac90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.468+0000 7f80d0180740 1 --2- 172.21.15.53:0/3183849302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0b941b0 0x55c0c0f65b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.468+0000 7f80d0180740 1 -- 172.21.15.53:0/3183849302 >> 172.21.15.53:0/3183849302 conn(0x55c0c0bb1460 msgr2=0x55c0c0f65410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.468+0000 7f80d0180740 1 -- 172.21.15.53:0/3183849302 shutdown_connections 2024-08-31T06:06:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.468+0000 7f80d0180740 1 -- 172.21.15.53:0/3183849302 wait complete. 2024-08-31T06:06:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.468+0000 7f80d0180740 1 -- start start 2024-08-31T06:06:04.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.468+0000 7f80d0180740 1 Processor -- start 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80d0180740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f72650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80d0180740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f72c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80d0180740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0bbd070 0x55c0c0fe3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80d0180740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41b0960 con 0x55c0c0b941b0 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80d0180740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41b0290 con 0x55c0c0bbd070 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80d0180740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41ad4d0 con 0x55c0c0b9c390 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80d0180740 10 client.0 _ll_register_callbacks cb 0x7f80ac0039d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80baffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f72650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80baffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f72650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38900/0 (socket says 172.21.15.53:38900) 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80baffd640 1 -- 172.21.15.53:0/171083889 learned_addr learned my addr 172.21.15.53:0/171083889 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80c37fe640 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f72c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80baffd640 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0bbd070 0x55c0c0fe3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80baffd640 1 -- 172.21.15.53:0/171083889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 msgr2=0x55c0c0f72c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80baffd640 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f72c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80baffd640 1 -- 172.21.15.53:0/171083889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0bbd070 msgr2=0x55c0c0fe3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80baffd640 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0bbd070 0x55c0c0fe3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.469+0000 7f80baffd640 1 -- 172.21.15.53:0/171083889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c0fe3d80 con 0x55c0c0b941b0 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.470+0000 7f80baffd640 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f72650 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f80ac02a930 tx=0x7f80ac041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99b2172e8f94600 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.470+0000 7f80a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.470+0000 7f80a2ffd640 1 -- 172.21.15.53:0/171083889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac035070 con 0x55c0c0b941b0 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.470+0000 7f80a2ffd640 1 -- 172.21.15.53:0/171083889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f80ac03d450 con 0x55c0c0b941b0 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.470+0000 7f80d0180740 1 -- 172.21.15.53:0/171083889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80b40054d0 con 0x55c0c0b941b0 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.470+0000 7f80a2ffd640 1 -- 172.21.15.53:0/171083889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80ac066050 con 0x55c0c0b941b0 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.470+0000 7f80d0180740 10 client.16116 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:04.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.470+0000 7f80d0180740 1 -- 172.21.15.53:0/171083889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c0c0feb0c0 con 0x55c0c0b941b0 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.470+0000 7f80a2ffd640 1 -- 172.21.15.53:0/171083889 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80b40054d0 con 0x55c0c0b941b0 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.471+0000 7f80a2ffd640 1 -- 172.21.15.53:0/171083889 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f80ac05d070 con 0x55c0c0b941b0 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.471+0000 7f80d0180740 10 client.16116 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.471+0000 7f80d0180740 10 client.16116 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.471+0000 7f80d0180740 20 client.16116 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.471+0000 7f80d0180740 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c0c0b50da0 0x55c0c0fed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.471+0000 7f80d0180740 4 client.16116 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.471+0000 7f80d0180740 1 -- 172.21.15.53:0/171083889 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c0c0f6e410 con 0x55c0c0b50da0 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.471+0000 7f80c37fe640 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c0c0b50da0 0x55c0c0fed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.471+0000 7f80a2ffd640 10 client.16116 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.471+0000 7f80c37fe640 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c0c0b50da0 0x55c0c0fed7d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ffadead6e775bf8c server_cookie=dfde635b832442b8 in_seq=0 out_seq=0 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80a2ffd640 1 -- 172.21.15.53:0/171083889 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c0c0f6e410 con 0x55c0c0b50da0 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80a2ffd640 10 client.16116 handle_command_reply: tid=0 2024-08-31T06:06:04.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 1 client.16116 shutdown 2024-08-31T06:06:04.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 1 -- 172.21.15.53:0/171083889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 msgr2=0x55c0c0f72650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f72650 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f80ac02a930 tx=0x7f80ac041040 comp rx=0 tx=0).stop 2024-08-31T06:06:04.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 1 -- 172.21.15.53:0/171083889 shutdown_connections 2024-08-31T06:06:04.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c0c0b50da0 0x55c0c0fed7d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0c0bbd070 0x55c0c0fe3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0c0b9c390 0x55c0c0f72c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80a2ffd640 0 client.16116 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:06:04.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 1 --2- 172.21.15.53:0/171083889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c0b941b0 0x55c0c0f72650 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 1 -- 172.21.15.53:0/171083889 >> 172.21.15.53:0/171083889 conn(0x55c0c0bb1460 msgr2=0x55c0c0f63340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 1 -- 172.21.15.53:0/171083889 shutdown_connections 2024-08-31T06:06:04.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 1 -- 172.21.15.53:0/171083889 wait complete. 2024-08-31T06:06:04.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.472+0000 7f80d0180740 20 client.16116 trim_cache size 0 max 16384 2024-08-31T06:06:04.479 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:06:04.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3167092401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80b00b4ca0 msgr2=0x7f80b00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80b00b4ca0 0x7f80b00b71b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0abfc0 tx=0x7f80bc084040 comp rx=0 tx=0).stop 2024-08-31T06:06:04.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3167092401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c4109bb0 msgr2=0x7f80c419fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c4109bb0 0x7f80c419fa00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00cad0 tx=0x7f80bc00cf90 comp rx=0 tx=0).stop 2024-08-31T06:06:04.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3167092401 shutdown_connections 2024-08-31T06:06:04.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80b00b4ca0 0x7f80b00b71b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c4109bb0 0x7f80c419fa00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80c4109260 0x7f80c419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 --2- 172.21.15.53:0/3167092401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80c4103920 0x7f80c419a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3167092401 >> 172.21.15.53:0/3167092401 conn(0x7f80c40ff370 msgr2=0x7f80c4101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3167092401 shutdown_connections 2024-08-31T06:06:04.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:04.473+0000 7f80c9c0b640 1 -- 172.21.15.53:0/3167092401 wait complete. 2024-08-31T06:06:04.862 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.858+0000 7f753a980640 1 -- 172.21.15.53:0/1030933456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7534108080 msgr2=0x7f7534108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.862 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.858+0000 7f753a980640 1 --2- 172.21.15.53:0/1030933456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7534108080 0x7f7534108490 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f7528009900 tx=0x7f752802a410 comp rx=0 tx=0).stop 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.858+0000 7f753a980640 1 -- 172.21.15.53:0/1030933456 shutdown_connections 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.858+0000 7f753a980640 1 --2- 172.21.15.53:0/1030933456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75341089d0 0x7f753410f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.858+0000 7f753a980640 1 --2- 172.21.15.53:0/1030933456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7534108080 0x7f7534108490 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.858+0000 7f753a980640 1 --2- 172.21.15.53:0/1030933456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7534102750 0x7f7534102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.858+0000 7f753a980640 1 -- 172.21.15.53:0/1030933456 >> 172.21.15.53:0/1030933456 conn(0x7f753407a4e0 msgr2=0x7f753407a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.858+0000 7f753a980640 1 -- 172.21.15.53:0/1030933456 shutdown_connections 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.858+0000 7f753a980640 1 -- 172.21.15.53:0/1030933456 wait complete. 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.858+0000 7f753a980640 1 Processor -- start 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f753a980640 1 -- start start 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f753a980640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7534102750 0x7f753419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f753a980640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7534108080 0x7f753419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f753a980640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75341089d0 0x7f753419f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f753a980640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f75341124f0 con 0x7f7534102750 2024-08-31T06:06:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f753a980640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7534112370 con 0x7f7534108080 2024-08-31T06:06:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f753a980640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7534112670 con 0x7f75341089d0 2024-08-31T06:06:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f7533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7534102750 0x7f753419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f7533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7534102750 0x7f753419a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38916/0 (socket says 172.21.15.53:38916) 2024-08-31T06:06:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f7533fff640 1 -- 172.21.15.53:0/868641030 learned_addr learned my addr 172.21.15.53:0/868641030 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f75337fe640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7534108080 0x7f753419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f7538f1d640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75341089d0 0x7f753419f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f7533fff640 1 -- 172.21.15.53:0/868641030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75341089d0 msgr2=0x7f753419f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f7533fff640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75341089d0 0x7f753419f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f7533fff640 1 -- 172.21.15.53:0/868641030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7534108080 msgr2=0x7f753419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f7533fff640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7534108080 0x7f753419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f7533fff640 1 -- 172.21.15.53:0/868641030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75341a0010 con 0x7f7534102750 2024-08-31T06:06:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f7538f1d640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75341089d0 0x7f753419f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:06:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.859+0000 7f75337fe640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7534108080 0x7f753419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:06:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.860+0000 7f7533fff640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7534102750 0x7f753419a0e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f752400d950 tx=0x7f752400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.860+0000 7f75317fa640 1 -- 172.21.15.53:0/868641030 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524017070 con 0x7f7534102750 2024-08-31T06:06:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.860+0000 7f75317fa640 1 -- 172.21.15.53:0/868641030 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7524009c30 con 0x7f7534102750 2024-08-31T06:06:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.860+0000 7f753a980640 1 -- 172.21.15.53:0/868641030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75341a0300 con 0x7f7534102750 2024-08-31T06:06:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.860+0000 7f75317fa640 1 -- 172.21.15.53:0/868641030 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752400f620 con 0x7f7534102750 2024-08-31T06:06:04.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.860+0000 7f753a980640 1 -- 172.21.15.53:0/868641030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75341a6a90 con 0x7f7534102750 2024-08-31T06:06:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.862+0000 7f75317fa640 1 -- 172.21.15.53:0/868641030 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7524010460 con 0x7f7534102750 2024-08-31T06:06:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.862+0000 7f75419ca740 1 Processor -- start 2024-08-31T06:06:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f75419ca740 1 -- start start 2024-08-31T06:06:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f75419ca740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a1fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f75419ca740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a20220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f75419ca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a20760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f75419ca740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b22995000 con 0x559b226532f0 2024-08-31T06:06:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f75419ca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559b22984590 con 0x559b2265b4d0 2024-08-31T06:06:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f75419ca740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559b22988540 con 0x559b2267c1b0 2024-08-31T06:06:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f7533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a20220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f7533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a20220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38926/0 (socket says 172.21.15.53:38926) 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f7533fff640 1 -- 172.21.15.53:0/1423148690 learned_addr learned my addr 172.21.15.53:0/1423148690 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f75337fe640 1 --2- 172.21.15.53:0/1423148690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a20760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f7538f1d640 1 --2- 172.21.15.53:0/1423148690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a1fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f75317fa640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f751c0b4ca0 0x7f751c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f7533fff640 1 -- 172.21.15.53:0/1423148690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 msgr2=0x559b22a1fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f7533fff640 1 --2- 172.21.15.53:0/1423148690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a1fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f7533fff640 1 -- 172.21.15.53:0/1423148690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 msgr2=0x559b22a20760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f7533fff640 1 --2- 172.21.15.53:0/1423148690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a20760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f7533fff640 1 -- 172.21.15.53:0/1423148690 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b226e7790 con 0x559b226532f0 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.863+0000 7f7538f1d640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f751c0b4ca0 0x7f751c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.864+0000 7f75317fa640 1 -- 172.21.15.53:0/868641030 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f75240e5260 con 0x7f7534102750 2024-08-31T06:06:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.864+0000 7f7533fff640 1 --2- 172.21.15.53:0/1423148690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a20220 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f75240e2920 tx=0x7f7524070250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265493905bf9996 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.864+0000 7f751a7fc640 1 -- 172.21.15.53:0/1423148690 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75240ab2a0 con 0x559b226532f0 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.864+0000 7f7538f1d640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f751c0b4ca0 0x7f751c0b71b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f752c005fd0 tx=0x7f752c004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.864+0000 7f751a7fc640 1 -- 172.21.15.53:0/1423148690 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75240ab460 con 0x559b226532f0 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.864+0000 7f751a7fc640 1 -- 172.21.15.53:0/1423148690 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75240e8ac0 con 0x559b226532f0 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.865+0000 7f75419ca740 1 -- 172.21.15.53:0/1423148690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 msgr2=0x559b22a20220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.865+0000 7f75419ca740 1 --2- 172.21.15.53:0/1423148690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a20220 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f75240e2920 tx=0x7f7524070250 comp rx=0 tx=0).stop 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.865+0000 7f75419ca740 1 -- 172.21.15.53:0/1423148690 shutdown_connections 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.865+0000 7f75419ca740 1 --2- 172.21.15.53:0/1423148690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a20760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.865+0000 7f75419ca740 1 --2- 172.21.15.53:0/1423148690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a20220 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.865+0000 7f75419ca740 1 --2- 172.21.15.53:0/1423148690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a1fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.865+0000 7f75419ca740 1 -- 172.21.15.53:0/1423148690 >> 172.21.15.53:0/1423148690 conn(0x559b22670300 msgr2=0x559b22a1dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.865+0000 7f75419ca740 1 -- 172.21.15.53:0/1423148690 shutdown_connections 2024-08-31T06:06:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.865+0000 7f75419ca740 1 -- 172.21.15.53:0/1423148690 wait complete. 2024-08-31T06:06:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.865+0000 7f75419ca740 1 -- start start 2024-08-31T06:06:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f75419ca740 1 Processor -- start 2024-08-31T06:06:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f75419ca740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a2b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f75419ca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a2bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f75419ca740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a37720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f75419ca740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b228bdab0 con 0x559b226532f0 2024-08-31T06:06:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f75419ca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559b2290b680 con 0x559b2265b4d0 2024-08-31T06:06:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f75419ca740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559b22a2e400 con 0x559b2267c1b0 2024-08-31T06:06:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f75419ca740 10 client.0 _ll_register_callbacks cb 0x559b22693a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f7533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a2b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f7533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a2b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38942/0 (socket says 172.21.15.53:38942) 2024-08-31T06:06:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f7533fff640 1 -- 172.21.15.53:0/3995210687 learned_addr learned my addr 172.21.15.53:0/3995210687 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f7538f1d640 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a37720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f75337fe640 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a2bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.866+0000 7f7533fff640 1 -- 172.21.15.53:0/3995210687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 msgr2=0x559b22a37720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f7533fff640 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a37720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f7533fff640 1 -- 172.21.15.53:0/3995210687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 msgr2=0x559b22a2bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f7533fff640 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a2bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f7533fff640 1 -- 172.21.15.53:0/3995210687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b22760620 con 0x559b226532f0 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75337fe640 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a2bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f7533fff640 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a2b810 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f75240058c0 tx=0x7f75240ac050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15b74c171323c15 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75137fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75137fe640 1 -- 172.21.15.53:0/3995210687 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524020040 con 0x559b226532f0 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75137fe640 1 -- 172.21.15.53:0/3995210687 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f75240e2c30 con 0x559b226532f0 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75419ca740 1 -- 172.21.15.53:0/3995210687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75240ab460 con 0x559b226532f0 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75137fe640 1 -- 172.21.15.53:0/3995210687 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f75240a70e0 con 0x559b226532f0 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75419ca740 10 client.16128 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75419ca740 1 -- 172.21.15.53:0/3995210687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b22a3a3b0 con 0x559b226532f0 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75137fe640 1 -- 172.21.15.53:0/3995210687 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75240ab460 con 0x559b226532f0 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75137fe640 1 -- 172.21.15.53:0/3995210687 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f75240a7be0 con 0x559b226532f0 2024-08-31T06:06:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75419ca740 10 client.16128 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75419ca740 10 client.16128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75419ca740 20 client.16128 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75419ca740 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559b2263ad80 0x559b22a3d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75419ca740 4 client.16128 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.867+0000 7f75419ca740 1 -- 172.21.15.53:0/3995210687 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b22996f50 con 0x559b2263ad80 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.868+0000 7f75337fe640 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559b2263ad80 0x559b22a3d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.868+0000 7f75337fe640 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559b2263ad80 0x559b22a3d710 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46050a58d1c19580 server_cookie=8d5b194cfa4a13cc in_seq=0 out_seq=0 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.868+0000 7f75137fe640 10 client.16128 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75137fe640 1 -- 172.21.15.53:0/3995210687 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b22996f50 con 0x559b2263ad80 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75137fe640 10 client.16128 handle_command_reply: tid=0 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75419ca740 1 client.16128 shutdown 2024-08-31T06:06:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75419ca740 1 -- 172.21.15.53:0/3995210687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 msgr2=0x559b22a2b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75419ca740 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a2b810 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f75240058c0 tx=0x7f75240ac050 comp rx=0 tx=0).stop 2024-08-31T06:06:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75419ca740 1 -- 172.21.15.53:0/3995210687 shutdown_connections 2024-08-31T06:06:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75419ca740 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559b2263ad80 0x559b22a3d710 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75419ca740 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a37720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75419ca740 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a2bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75419ca740 1 --2- 172.21.15.53:0/3995210687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a2b810 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75419ca740 1 -- 172.21.15.53:0/3995210687 >> 172.21.15.53:0/3995210687 conn(0x559b22670300 msgr2=0x559b22a20d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75137fe640 0 client.16128 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75419ca740 1 -- 172.21.15.53:0/3995210687 shutdown_connections 2024-08-31T06:06:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.869+0000 7f75419ca740 1 -- 172.21.15.53:0/3995210687 wait complete. 2024-08-31T06:06:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.870+0000 7f75419ca740 20 client.16128 trim_cache size 0 max 16384 2024-08-31T06:06:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.884+0000 7f75419ca740 1 Processor -- start 2024-08-31T06:06:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.884+0000 7f75419ca740 1 -- start start 2024-08-31T06:06:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.884+0000 7f75419ca740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a216d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.884+0000 7f75419ca740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2265b4d0 0x559b22a2bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.884+0000 7f75419ca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2267c1b0 0x559b22a2d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.884+0000 7f75419ca740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f75341af4d0 con 0x559b226532f0 2024-08-31T06:06:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.884+0000 7f75419ca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75341b1010 con 0x559b2267c1b0 2024-08-31T06:06:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.884+0000 7f75419ca740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f75341afba0 con 0x559b2265b4d0 2024-08-31T06:06:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.884+0000 7f7533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.884+0000 7f7533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a216d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38960/0 (socket says 172.21.15.53:38960) 2024-08-31T06:06:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.884+0000 7f7533fff640 1 -- 172.21.15.53:0/259542905 learned_addr learned my addr 172.21.15.53:0/259542905 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.885+0000 7f75337fe640 1 --2- 172.21.15.53:0/259542905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2265b4d0 0x559b22a2bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.885+0000 7f7533fff640 1 -- 172.21.15.53:0/259542905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2265b4d0 msgr2=0x559b22a2bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.885+0000 7f7533fff640 1 --2- 172.21.15.53:0/259542905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2265b4d0 0x559b22a2bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.885+0000 7f7533fff640 1 -- 172.21.15.53:0/259542905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2267c1b0 msgr2=0x559b22a2d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.885+0000 7f7533fff640 1 --2- 172.21.15.53:0/259542905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2267c1b0 0x559b22a2d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.885+0000 7f7533fff640 1 -- 172.21.15.53:0/259542905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b22a1e4d0 con 0x559b226532f0 2024-08-31T06:06:04.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.885+0000 7f7533fff640 1 --2- 172.21.15.53:0/259542905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a216d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f752400bfd0 tx=0x7f75240b01c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e357145f490db1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.885+0000 7f7519ffb640 1 -- 172.21.15.53:0/259542905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524020070 con 0x559b226532f0 2024-08-31T06:06:04.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.885+0000 7f7519ffb640 1 -- 172.21.15.53:0/259542905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75240790e0 con 0x559b226532f0 2024-08-31T06:06:04.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.885+0000 7f7519ffb640 1 -- 172.21.15.53:0/259542905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75240ab0c0 con 0x559b226532f0 2024-08-31T06:06:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.886+0000 7f75419ca740 1 -- 172.21.15.53:0/259542905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 msgr2=0x559b22a216d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.886+0000 7f75419ca740 1 --2- 172.21.15.53:0/259542905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a216d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f752400bfd0 tx=0x7f75240b01c0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.886+0000 7f75419ca740 1 -- 172.21.15.53:0/259542905 shutdown_connections 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.886+0000 7f75419ca740 1 --2- 172.21.15.53:0/259542905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2267c1b0 0x559b22a2d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.886+0000 7f75419ca740 1 --2- 172.21.15.53:0/259542905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2265b4d0 0x559b22a2bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.886+0000 7f75419ca740 1 --2- 172.21.15.53:0/259542905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a216d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.886+0000 7f75419ca740 1 -- 172.21.15.53:0/259542905 >> 172.21.15.53:0/259542905 conn(0x559b22670300 msgr2=0x559b22a2cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.886+0000 7f75419ca740 1 -- 172.21.15.53:0/259542905 shutdown_connections 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.886+0000 7f75419ca740 1 -- 172.21.15.53:0/259542905 wait complete. 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.886+0000 7f75419ca740 1 -- start start 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.886+0000 7f75419ca740 1 Processor -- start 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f75419ca740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a33ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f75419ca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a34070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f75419ca740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a2f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f75419ca740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f75341b0940 con 0x559b226532f0 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f75419ca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75341b0270 con 0x559b2265b4d0 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f75419ca740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f75341ad4b0 con 0x559b2267c1b0 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f75419ca740 10 client.0 _ll_register_callbacks cb 0x7f7528009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f7533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a33ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f7533fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a33ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38964/0 (socket says 172.21.15.53:38964) 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f7533fff640 1 -- 172.21.15.53:0/1241102302 learned_addr learned my addr 172.21.15.53:0/1241102302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f75337fe640 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a34070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f7538f1d640 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a2f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f7533fff640 1 -- 172.21.15.53:0/1241102302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 msgr2=0x559b22a2f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f7533fff640 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a2f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f7533fff640 1 -- 172.21.15.53:0/1241102302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 msgr2=0x559b22a34070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f7533fff640 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a34070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f7533fff640 1 -- 172.21.15.53:0/1241102302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b22a2f870 con 0x559b226532f0 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f7538f1d640 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a2f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f7533fff640 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a33ab0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f752401d040 tx=0x7f75240ab340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152b6aad5623f605 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.887+0000 7f75137fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75137fe640 1 -- 172.21.15.53:0/1241102302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524020070 con 0x559b226532f0 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75137fe640 1 -- 172.21.15.53:0/1241102302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f75240abbb0 con 0x559b226532f0 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75419ca740 1 -- 172.21.15.53:0/1241102302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75240790e0 con 0x559b226532f0 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75137fe640 1 -- 172.21.15.53:0/1241102302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7524079340 con 0x559b226532f0 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75419ca740 10 client.16134 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75419ca740 1 -- 172.21.15.53:0/1241102302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b22a2f870 con 0x559b226532f0 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75137fe640 1 -- 172.21.15.53:0/1241102302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75240790e0 con 0x559b226532f0 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75137fe640 1 -- 172.21.15.53:0/1241102302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f75240c0cb0 con 0x559b226532f0 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75419ca740 10 client.16134 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75419ca740 10 client.16134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75419ca740 20 client.16134 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75419ca740 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559b226101c0 0x559b22aa9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75419ca740 4 client.16134 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:06:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.888+0000 7f75419ca740 1 -- 172.21.15.53:0/1241102302 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559b229929f0 con 0x559b226101c0 2024-08-31T06:06:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.889+0000 7f75337fe640 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559b226101c0 0x559b22aa9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.889+0000 7f75337fe640 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559b226101c0 0x559b22aa9e00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=723501df234964da server_cookie=ad1333565ad4d93a in_seq=0 out_seq=0 2024-08-31T06:06:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.889+0000 7f75137fe640 10 client.16134 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:04.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75137fe640 1 -- 172.21.15.53:0/1241102302 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559b229929f0 con 0x559b226101c0 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75137fe640 10 client.16134 handle_command_reply: tid=0 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 1 client.16134 shutdown 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 1 -- 172.21.15.53:0/1241102302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 msgr2=0x559b22a33ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a33ab0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f752401d040 tx=0x7f75240ab340 comp rx=0 tx=0).stop 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 1 -- 172.21.15.53:0/1241102302 shutdown_connections 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559b226101c0 0x559b22aa9e00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b2267c1b0 0x559b22a2f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559b2265b4d0 0x559b22a34070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75137fe640 0 client.16134 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 1 --2- 172.21.15.53:0/1241102302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b226532f0 0x559b22a33ab0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 1 -- 172.21.15.53:0/1241102302 >> 172.21.15.53:0/1241102302 conn(0x559b22670300 msgr2=0x559b22a2d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 1 -- 172.21.15.53:0/1241102302 shutdown_connections 2024-08-31T06:06:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 1 -- 172.21.15.53:0/1241102302 wait complete. 2024-08-31T06:06:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.896+0000 7f75419ca740 20 client.16134 trim_cache size 0 max 16384 2024-08-31T06:06:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:06:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:06:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:06:04.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:06:04.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 -- 172.21.15.53:0/868641030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f751c0b4ca0 msgr2=0x7f751c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f751c0b4ca0 0x7f751c0b71b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f752c005fd0 tx=0x7f752c004a40 comp rx=0 tx=0).stop 2024-08-31T06:06:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 -- 172.21.15.53:0/868641030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7534102750 msgr2=0x7f753419a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7534102750 0x7f753419a0e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f752400d950 tx=0x7f752400de10 comp rx=0 tx=0).stop 2024-08-31T06:06:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 -- 172.21.15.53:0/868641030 shutdown_connections 2024-08-31T06:06:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f751c0b4ca0 0x7f751c0b71b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75341089d0 0x7f753419f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7534108080 0x7f753419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 --2- 172.21.15.53:0/868641030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7534102750 0x7f753419a0e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 -- 172.21.15.53:0/868641030 >> 172.21.15.53:0/868641030 conn(0x7f753407a4e0 msgr2=0x7f7534101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 -- 172.21.15.53:0/868641030 shutdown_connections 2024-08-31T06:06:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:04.897+0000 7f753a980640 1 -- 172.21.15.53:0/868641030 wait complete. 2024-08-31T06:06:05.205 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:06:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:05.706 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:05 smithi053 ceph-mon[18924]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-31T06:06:05.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:05 smithi130 ceph-mon[22266]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-31T06:06:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.914+0000 7f88ffbcf640 1 -- 172.21.15.53:0/796099608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f8105120 msgr2=0x7f88f810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.914+0000 7f88ffbcf640 1 --2- 172.21.15.53:0/796099608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f8105120 0x7f88f810d670 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009900 tx=0x7f88e802a410 comp rx=0 tx=0).stop 2024-08-31T06:06:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.915+0000 7f88ffbcf640 1 -- 172.21.15.53:0/796099608 shutdown_connections 2024-08-31T06:06:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.915+0000 7f88ffbcf640 1 --2- 172.21.15.53:0/796099608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88f810dc30 0x7f88f8110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.915+0000 7f88ffbcf640 1 --2- 172.21.15.53:0/796099608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f8105120 0x7f88f810d670 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.915+0000 7f88ffbcf640 1 --2- 172.21.15.53:0/796099608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88f81047d0 0x7f88f8104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.915+0000 7f88ffbcf640 1 -- 172.21.15.53:0/796099608 >> 172.21.15.53:0/796099608 conn(0x7f88f8079510 msgr2=0x7f88f8079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.915+0000 7f88ffbcf640 1 -- 172.21.15.53:0/796099608 shutdown_connections 2024-08-31T06:06:05.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.915+0000 7f88ffbcf640 1 -- 172.21.15.53:0/796099608 wait complete. 2024-08-31T06:06:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.915+0000 7f88ffbcf640 1 Processor -- start 2024-08-31T06:06:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.915+0000 7f88ffbcf640 1 -- start start 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88ffbcf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f81047d0 0x7f88f819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88ffbcf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88f8105120 0x7f88f819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88ffbcf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88f810dc30 0x7f88f819faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88ffbcf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f88f8113740 con 0x7f88f81047d0 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88ffbcf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81135c0 con 0x7f88f810dc30 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88ffbcf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81138c0 con 0x7f88f8105120 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88fd96b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f81047d0 0x7f88f819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88fd16a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88f8105120 0x7f88f819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88fd96b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f81047d0 0x7f88f819a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38980/0 (socket says 172.21.15.53:38980) 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88fd96b640 1 -- 172.21.15.53:0/1149684774 learned_addr learned my addr 172.21.15.53:0/1149684774 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88fe16c640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88f810dc30 0x7f88f819faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88fd96b640 1 -- 172.21.15.53:0/1149684774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88f8105120 msgr2=0x7f88f819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88fd96b640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88f8105120 0x7f88f819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88fd96b640 1 -- 172.21.15.53:0/1149684774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88f810dc30 msgr2=0x7f88f819faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88fd96b640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88f810dc30 0x7f88f819faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.916+0000 7f88fd96b640 1 -- 172.21.15.53:0/1149684774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f81a0220 con 0x7f88f81047d0 2024-08-31T06:06:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.917+0000 7f88fd96b640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f81047d0 0x7f88f819a2b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f88f400e9f0 tx=0x7f88f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.917+0000 7f88eeffd640 1 -- 172.21.15.53:0/1149684774 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f400cd80 con 0x7f88f81047d0 2024-08-31T06:06:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.917+0000 7f88eeffd640 1 -- 172.21.15.53:0/1149684774 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88f40108c0 con 0x7f88f81047d0 2024-08-31T06:06:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.917+0000 7f88ffbcf640 1 -- 172.21.15.53:0/1149684774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f81a0510 con 0x7f88f81047d0 2024-08-31T06:06:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.917+0000 7f88eeffd640 1 -- 172.21.15.53:0/1149684774 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40187c0 con 0x7f88f81047d0 2024-08-31T06:06:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.917+0000 7f88ffbcf640 1 -- 172.21.15.53:0/1149684774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f81a6c70 con 0x7f88f81047d0 2024-08-31T06:06:05.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.919+0000 7f8906144740 1 Processor -- start 2024-08-31T06:06:05.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f8906144740 1 -- start start 2024-08-31T06:06:05.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f88eeffd640 1 -- 172.21.15.53:0/1149684774 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f88f40189a0 con 0x7f88f81047d0 2024-08-31T06:06:05.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f8906144740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb580070 0x560ddb925310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f8906144740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb925850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f8906144740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb55f390 0x560ddb925d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f8906144740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560ddb89c680 con 0x560ddb5571b0 2024-08-31T06:06:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f8906144740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560ddb88bc10 con 0x560ddb55f390 2024-08-31T06:06:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f8906144740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560ddb88fbc0 con 0x560ddb580070 2024-08-31T06:06:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f88fd96b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb925850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f88fd96b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb925850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38984/0 (socket says 172.21.15.53:38984) 2024-08-31T06:06:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f88fd96b640 1 -- 172.21.15.53:0/1777619508 learned_addr learned my addr 172.21.15.53:0/1777619508 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f88fd16a640 1 --2- 172.21.15.53:0/1777619508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb55f390 0x560ddb925d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.920+0000 7f88fe16c640 1 --2- 172.21.15.53:0/1777619508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb580070 0x560ddb925310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88fd96b640 1 -- 172.21.15.53:0/1777619508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb580070 msgr2=0x560ddb925310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88fd96b640 1 --2- 172.21.15.53:0/1777619508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb580070 0x560ddb925310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88fd96b640 1 -- 172.21.15.53:0/1777619508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb55f390 msgr2=0x560ddb925d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:05.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88fd96b640 1 --2- 172.21.15.53:0/1777619508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb55f390 0x560ddb925d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88fd96b640 1 -- 172.21.15.53:0/1777619508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ddb5eb650 con 0x560ddb5571b0 2024-08-31T06:06:05.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88fe16c640 1 --2- 172.21.15.53:0/1777619508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb580070 0x560ddb925310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:05.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88fd96b640 1 --2- 172.21.15.53:0/1777619508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb925850 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f88f40e2f30 tx=0x7f88f40ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc3f4fc6d03bd46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:05.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88eeffd640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88e40b4d20 0x7f88e40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88fe16c640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88e40b4d20 0x7f88e40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88e3fff640 1 -- 172.21.15.53:0/1777619508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40f4070 con 0x560ddb5571b0 2024-08-31T06:06:05.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88e3fff640 1 -- 172.21.15.53:0/1777619508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88f40ede30 con 0x560ddb5571b0 2024-08-31T06:06:05.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88e3fff640 1 -- 172.21.15.53:0/1777619508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40ab960 con 0x560ddb5571b0 2024-08-31T06:06:05.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.921+0000 7f88eeffd640 1 -- 172.21.15.53:0/1149684774 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f88f40e5870 con 0x7f88f81047d0 2024-08-31T06:06:05.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:05 smithi153 ceph-mon[22320]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-31T06:06:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.922+0000 7f8906144740 1 -- 172.21.15.53:0/1777619508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 msgr2=0x560ddb925850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.922+0000 7f88fe16c640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88e40b4d20 0x7f88e40b7230 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f88f0005fd0 tx=0x7f88f0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.922+0000 7f8906144740 1 --2- 172.21.15.53:0/1777619508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb925850 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f88f40e2f30 tx=0x7f88f40ed690 comp rx=0 tx=0).stop 2024-08-31T06:06:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.922+0000 7f8906144740 1 -- 172.21.15.53:0/1777619508 shutdown_connections 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.922+0000 7f8906144740 1 --2- 172.21.15.53:0/1777619508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb55f390 0x560ddb925d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.922+0000 7f8906144740 1 --2- 172.21.15.53:0/1777619508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb925850 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.922+0000 7f8906144740 1 --2- 172.21.15.53:0/1777619508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb580070 0x560ddb925310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.922+0000 7f8906144740 1 -- 172.21.15.53:0/1777619508 >> 172.21.15.53:0/1777619508 conn(0x560ddb574460 msgr2=0x560ddb923200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.922+0000 7f8906144740 1 -- 172.21.15.53:0/1777619508 shutdown_connections 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.923+0000 7f8906144740 1 -- 172.21.15.53:0/1777619508 wait complete. 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.923+0000 7f8906144740 1 -- start start 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.923+0000 7f8906144740 1 Processor -- start 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.923+0000 7f8906144740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb5571b0 0x560ddb934e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.923+0000 7f8906144740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb55f390 0x560ddb935350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.923+0000 7f8906144740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb580070 0x560ddb9411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.923+0000 7f8906144740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560ddb6ee700 con 0x560ddb55f390 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.923+0000 7f8906144740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560ddb812750 con 0x560ddb580070 2024-08-31T06:06:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.923+0000 7f8906144740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560ddb937e50 con 0x560ddb5571b0 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f8906144740 10 client.0 _ll_register_callbacks cb 0x560ddb841e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88fd16a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb55f390 0x560ddb935350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88fd16a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb55f390 0x560ddb935350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39004/0 (socket says 172.21.15.53:39004) 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88fd16a640 1 -- 172.21.15.53:0/3851037746 learned_addr learned my addr 172.21.15.53:0/3851037746 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88fd96b640 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb5571b0 0x560ddb934e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88fd16a640 1 -- 172.21.15.53:0/3851037746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb5571b0 msgr2=0x560ddb934e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88fe16c640 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb580070 0x560ddb9411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88fd16a640 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb5571b0 0x560ddb934e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88fd16a640 1 -- 172.21.15.53:0/3851037746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb580070 msgr2=0x560ddb9411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88fd16a640 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb580070 0x560ddb9411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88fd16a640 1 -- 172.21.15.53:0/3851037746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ddb84b900 con 0x560ddb55f390 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88fd16a640 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb55f390 0x560ddb935350 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f88e8000c00 tx=0x7f88e8031e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6741fede9eb7143 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88e17fa640 1 -- 172.21.15.53:0/3851037746 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e8035040 con 0x560ddb55f390 2024-08-31T06:06:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f88e17fa640 1 -- 172.21.15.53:0/3851037746 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f88e8031740 con 0x560ddb55f390 2024-08-31T06:06:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.924+0000 7f8906144740 1 -- 172.21.15.53:0/3851037746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88f40ede30 con 0x560ddb55f390 2024-08-31T06:06:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f88e17fa640 1 -- 172.21.15.53:0/3851037746 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f88e8004040 con 0x560ddb55f390 2024-08-31T06:06:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f8906144740 10 client.16146 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f8906144740 1 -- 172.21.15.53:0/3851037746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560ddb943bd0 con 0x560ddb55f390 2024-08-31T06:06:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f88e17fa640 1 -- 172.21.15.53:0/3851037746 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88f40ede30 con 0x560ddb55f390 2024-08-31T06:06:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f88e17fa640 1 -- 172.21.15.53:0/3851037746 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f88e8003c40 con 0x560ddb55f390 2024-08-31T06:06:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f8906144740 10 client.16146 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f8906144740 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f8906144740 20 client.16146 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f8906144740 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ddb53e9f0 0x560ddb947160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f8906144740 4 client.16146 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f8906144740 1 -- 172.21.15.53:0/3851037746 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ddb89e5d0 con 0x560ddb53e9f0 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.925+0000 7f88fd96b640 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ddb53e9f0 0x560ddb947160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.926+0000 7f88e17fa640 10 client.16146 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.926+0000 7f88fd96b640 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ddb53e9f0 0x560ddb947160 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c94b302b29654c65 server_cookie=d7fdb231c188867f in_seq=0 out_seq=0 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f88e17fa640 1 -- 172.21.15.53:0/3851037746 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560ddb89e5d0 con 0x560ddb53e9f0 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f88e17fa640 10 client.16146 handle_command_reply: tid=0 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 1 client.16146 shutdown 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 1 -- 172.21.15.53:0/3851037746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb55f390 msgr2=0x560ddb935350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb55f390 0x560ddb935350 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f88e8000c00 tx=0x7f88e8031e70 comp rx=0 tx=0).stop 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 1 -- 172.21.15.53:0/3851037746 shutdown_connections 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ddb53e9f0 0x560ddb947160 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb580070 0x560ddb9411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb55f390 0x560ddb935350 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f88e17fa640 0 client.16146 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:05.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 1 --2- 172.21.15.53:0/3851037746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb5571b0 0x560ddb934e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 1 -- 172.21.15.53:0/3851037746 >> 172.21.15.53:0/3851037746 conn(0x560ddb574460 msgr2=0x560ddb926d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:05.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 1 -- 172.21.15.53:0/3851037746 shutdown_connections 2024-08-31T06:06:05.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 1 -- 172.21.15.53:0/3851037746 wait complete. 2024-08-31T06:06:05.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.927+0000 7f8906144740 20 client.16146 trim_cache size 0 max 16384 2024-08-31T06:06:05.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.940+0000 7f8906144740 1 Processor -- start 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f8906144740 1 -- start start 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f8906144740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb53e9f0 0x560ddb9305c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f8906144740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb5571b0 0x560ddb923230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f8906144740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb55f390 0x560ddb9410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f8906144740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81ad270 con 0x560ddb53e9f0 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f8906144740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81aedb0 con 0x560ddb55f390 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f8906144740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81ad940 con 0x560ddb5571b0 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f88fd96b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb53e9f0 0x560ddb9305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f88fd96b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb53e9f0 0x560ddb9305c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39006/0 (socket says 172.21.15.53:39006) 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f88fd96b640 1 -- 172.21.15.53:0/2675694655 learned_addr learned my addr 172.21.15.53:0/2675694655 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f88fd16a640 1 --2- 172.21.15.53:0/2675694655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb5571b0 0x560ddb923230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f88fd96b640 1 -- 172.21.15.53:0/2675694655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb5571b0 msgr2=0x560ddb923230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:05.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f88fd96b640 1 --2- 172.21.15.53:0/2675694655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb5571b0 0x560ddb923230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f88fd96b640 1 -- 172.21.15.53:0/2675694655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb55f390 msgr2=0x560ddb9410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:05.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f88fd96b640 1 --2- 172.21.15.53:0/2675694655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb55f390 0x560ddb9410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f88fd96b640 1 -- 172.21.15.53:0/2675694655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ddb926150 con 0x560ddb53e9f0 2024-08-31T06:06:05.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.941+0000 7f88fd96b640 1 --2- 172.21.15.53:0/2675694655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb53e9f0 0x560ddb9305c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f88f400e9c0 tx=0x7f88f4010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f9bf9af1401a36 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:05.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f88e37fe640 1 -- 172.21.15.53:0/2675694655 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f401a4c0 con 0x560ddb53e9f0 2024-08-31T06:06:05.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f88e37fe640 1 -- 172.21.15.53:0/2675694655 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88f40eb320 con 0x560ddb53e9f0 2024-08-31T06:06:05.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f88e37fe640 1 -- 172.21.15.53:0/2675694655 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f401a6b0 con 0x560ddb53e9f0 2024-08-31T06:06:05.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f8906144740 1 -- 172.21.15.53:0/2675694655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb53e9f0 msgr2=0x560ddb9305c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:05.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f8906144740 1 --2- 172.21.15.53:0/2675694655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb53e9f0 0x560ddb9305c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f88f400e9c0 tx=0x7f88f4010cc0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f8906144740 1 -- 172.21.15.53:0/2675694655 shutdown_connections 2024-08-31T06:06:05.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f8906144740 1 --2- 172.21.15.53:0/2675694655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb55f390 0x560ddb9410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f8906144740 1 --2- 172.21.15.53:0/2675694655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb5571b0 0x560ddb923230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f8906144740 1 --2- 172.21.15.53:0/2675694655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb53e9f0 0x560ddb9305c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f8906144740 1 -- 172.21.15.53:0/2675694655 >> 172.21.15.53:0/2675694655 conn(0x560ddb574460 msgr2=0x560ddb922b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:05.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f8906144740 1 -- 172.21.15.53:0/2675694655 shutdown_connections 2024-08-31T06:06:05.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.942+0000 7f8906144740 1 -- 172.21.15.53:0/2675694655 wait complete. 2024-08-31T06:06:05.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.943+0000 7f8906144740 1 -- start start 2024-08-31T06:06:05.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.943+0000 7f8906144740 1 Processor -- start 2024-08-31T06:06:05.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.943+0000 7f8906144740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb53e9f0 0x560ddb939010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.943+0000 7f8906144740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb939550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.943+0000 7f8906144740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb55f390 0x560ddb939a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.943+0000 7f8906144740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81ae6e0 con 0x560ddb5571b0 2024-08-31T06:06:05.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.943+0000 7f8906144740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81ae010 con 0x560ddb53e9f0 2024-08-31T06:06:05.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.943+0000 7f8906144740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88f81ab250 con 0x560ddb55f390 2024-08-31T06:06:05.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.943+0000 7f8906144740 10 client.0 _ll_register_callbacks cb 0x7f88e8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:05.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fd16a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb939550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fd16a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb939550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39014/0 (socket says 172.21.15.53:39014) 2024-08-31T06:06:05.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fd16a640 1 -- 172.21.15.53:0/1331412618 learned_addr learned my addr 172.21.15.53:0/1331412618 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:05.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fe16c640 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb55f390 0x560ddb939a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fd96b640 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb53e9f0 0x560ddb939010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fd16a640 1 -- 172.21.15.53:0/1331412618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb55f390 msgr2=0x560ddb939a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:05.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fd16a640 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb55f390 0x560ddb939a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fd16a640 1 -- 172.21.15.53:0/1331412618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb53e9f0 msgr2=0x560ddb939010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:05.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fd16a640 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb53e9f0 0x560ddb939010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fd16a640 1 -- 172.21.15.53:0/1331412618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ddb9b0b20 con 0x560ddb5571b0 2024-08-31T06:06:05.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fd96b640 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb53e9f0 0x560ddb939010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:06:05.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88fd16a640 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb939550 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009900 tx=0x7f88e803ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2395b74de8fab1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:05.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:05.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88e17fa640 1 -- 172.21.15.53:0/1331412618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e8035070 con 0x560ddb5571b0 2024-08-31T06:06:05.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88e17fa640 1 -- 172.21.15.53:0/1331412618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f88e80043e0 con 0x560ddb5571b0 2024-08-31T06:06:05.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f8906144740 1 -- 172.21.15.53:0/1331412618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88f40eb320 con 0x560ddb5571b0 2024-08-31T06:06:05.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f88e17fa640 1 -- 172.21.15.53:0/1331412618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f88e803da10 con 0x560ddb5571b0 2024-08-31T06:06:05.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f8906144740 10 client.16152 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:05.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.944+0000 7f8906144740 1 -- 172.21.15.53:0/1331412618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560ddb9b1cc0 con 0x560ddb5571b0 2024-08-31T06:06:05.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.945+0000 7f88e17fa640 1 -- 172.21.15.53:0/1331412618 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88f40eb320 con 0x560ddb5571b0 2024-08-31T06:06:05.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.945+0000 7f88e17fa640 1 -- 172.21.15.53:0/1331412618 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f88e8055070 con 0x560ddb5571b0 2024-08-31T06:06:05.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.945+0000 7f8906144740 10 client.16152 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:05.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.945+0000 7f8906144740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:05.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.945+0000 7f8906144740 20 client.16152 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:05.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.945+0000 7f8906144740 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ddb580070 0x560ddb9b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:05.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.945+0000 7f8906144740 4 client.16152 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:06:05.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.945+0000 7f8906144740 1 -- 172.21.15.53:0/1331412618 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560ddb89a070 con 0x560ddb580070 2024-08-31T06:06:05.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.945+0000 7f88fd96b640 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ddb580070 0x560ddb9b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:05.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f88e17fa640 10 client.16152 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:05.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f88fd96b640 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ddb580070 0x560ddb9b44b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2d35ffcbb3aa8b2 server_cookie=724e3aa612a1a37a in_seq=0 out_seq=0 2024-08-31T06:06:05.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f88e17fa640 1 -- 172.21.15.53:0/1331412618 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560ddb89a070 con 0x560ddb580070 2024-08-31T06:06:05.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f88e17fa640 10 client.16152 handle_command_reply: tid=0 2024-08-31T06:06:05.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f8906144740 1 client.16152 shutdown 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f8906144740 1 -- 172.21.15.53:0/1331412618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 msgr2=0x560ddb939550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f8906144740 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb939550 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009900 tx=0x7f88e803ef40 comp rx=0 tx=0).stop 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f8906144740 1 -- 172.21.15.53:0/1331412618 shutdown_connections 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f8906144740 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ddb580070 0x560ddb9b44b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f8906144740 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ddb55f390 0x560ddb939a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f8906144740 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ddb5571b0 0x560ddb939550 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f8906144740 1 --2- 172.21.15.53:0/1331412618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ddb53e9f0 0x560ddb939010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f88e17fa640 0 client.16152 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f8906144740 1 -- 172.21.15.53:0/1331412618 >> 172.21.15.53:0/1331412618 conn(0x560ddb574460 msgr2=0x560ddb926340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.946+0000 7f8906144740 1 -- 172.21.15.53:0/1331412618 shutdown_connections 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f8906144740 1 -- 172.21.15.53:0/1331412618 wait complete. 2024-08-31T06:06:05.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f8906144740 20 client.16152 trim_cache size 0 max 16384 2024-08-31T06:06:05.956 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:06:05.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 -- 172.21.15.53:0/1149684774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88e40b4d20 msgr2=0x7f88e40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:05.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88e40b4d20 0x7f88e40b7230 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f88f0005fd0 tx=0x7f88f0009500 comp rx=0 tx=0).stop 2024-08-31T06:06:05.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 -- 172.21.15.53:0/1149684774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f81047d0 msgr2=0x7f88f819a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:05.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f81047d0 0x7f88f819a2b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f88f400e9f0 tx=0x7f88f400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 -- 172.21.15.53:0/1149684774 shutdown_connections 2024-08-31T06:06:05.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88e40b4d20 0x7f88e40b7230 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88f810dc30 0x7f88f819faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88f8105120 0x7f88f819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 --2- 172.21.15.53:0/1149684774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f81047d0 0x7f88f819a2b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:05.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 -- 172.21.15.53:0/1149684774 >> 172.21.15.53:0/1149684774 conn(0x7f88f8079510 msgr2=0x7f88f80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:05.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 -- 172.21.15.53:0/1149684774 shutdown_connections 2024-08-31T06:06:05.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:05.947+0000 7f88ffbcf640 1 -- 172.21.15.53:0/1149684774 wait complete. 2024-08-31T06:06:07.550 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:06:07.656 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:06:07.657 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:06:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:07 smithi053 ceph-mon[18924]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-31T06:06:07.824 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:07.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:07 smithi130 ceph-mon[22266]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-31T06:06:07.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:07 smithi153 ceph-mon[22320]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-31T06:06:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.323+0000 7f5abe16a640 1 -- 172.21.15.53:0/1164250846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab810dbb0 msgr2=0x7f5ab81100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.323+0000 7f5abe16a640 1 --2- 172.21.15.53:0/1164250846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab810dbb0 0x7f5ab81100a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009ca0 tx=0x7f5ab002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:06:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.323+0000 7f5abe16a640 1 -- 172.21.15.53:0/1164250846 shutdown_connections 2024-08-31T06:06:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.323+0000 7f5abe16a640 1 --2- 172.21.15.53:0/1164250846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab810dbb0 0x7f5ab81100a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.323+0000 7f5abe16a640 1 --2- 172.21.15.53:0/1164250846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab81050a0 0x7f5ab810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.323+0000 7f5abe16a640 1 --2- 172.21.15.53:0/1164250846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ab8104750 0x7f5ab8104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.323+0000 7f5abe16a640 1 -- 172.21.15.53:0/1164250846 >> 172.21.15.53:0/1164250846 conn(0x7f5ab80794d0 msgr2=0x7f5ab80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.323+0000 7f5abe16a640 1 -- 172.21.15.53:0/1164250846 shutdown_connections 2024-08-31T06:06:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.323+0000 7f5abe16a640 1 -- 172.21.15.53:0/1164250846 wait complete. 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.323+0000 7f5abe16a640 1 Processor -- start 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5abe16a640 1 -- start start 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5abe16a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab8104750 0x7f5ab8102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5abe16a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ab81050a0 0x7f5ab81029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5abe16a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab810dbb0 0x7f5ab8102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5abe16a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab8113710 con 0x7f5ab810dbb0 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5abe16a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab8113590 con 0x7f5ab81050a0 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5abe16a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab8113890 con 0x7f5ab8104750 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5ab7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab810dbb0 0x7f5ab8102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5ab7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab810dbb0 0x7f5ab8102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39042/0 (socket says 172.21.15.53:39042) 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5ab7fff640 1 -- 172.21.15.53:0/2210180515 learned_addr learned my addr 172.21.15.53:0/2210180515 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5ab6ffd640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ab81050a0 0x7f5ab81029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.324+0000 7f5ab77fe640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab8104750 0x7f5ab8102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.325+0000 7f5ab7fff640 1 -- 172.21.15.53:0/2210180515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab8104750 msgr2=0x7f5ab8102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.325+0000 7f5ab7fff640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab8104750 0x7f5ab8102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.325+0000 7f5ab7fff640 1 -- 172.21.15.53:0/2210180515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ab81050a0 msgr2=0x7f5ab81029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.325+0000 7f5ab7fff640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ab81050a0 0x7f5ab81029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.325+0000 7f5ab7fff640 1 -- 172.21.15.53:0/2210180515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab81a83c0 con 0x7f5ab810dbb0 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.325+0000 7f5ab7fff640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab810dbb0 0x7f5ab8102f10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0005cc0 tx=0x7f5ab0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.325+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/2210180515 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0032e00 con 0x7f5ab810dbb0 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.325+0000 7f5abe16a640 1 -- 172.21.15.53:0/2210180515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab81a8650 con 0x7f5ab810dbb0 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.325+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/2210180515 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ab00044d0 con 0x7f5ab810dbb0 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.325+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/2210180515 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0030b70 con 0x7f5ab810dbb0 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.325+0000 7f5abe16a640 1 -- 172.21.15.53:0/2210180515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab81a8b90 con 0x7f5ab810dbb0 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.326+0000 7f5abe16a640 1 -- 172.21.15.53:0/2210180515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab8104b60 con 0x7f5ab810dbb0 2024-08-31T06:06:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.329+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/2210180515 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5ab0030d10 con 0x7f5ab810dbb0 2024-08-31T06:06:08.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.330+0000 7f5ab4ff9640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5aa40b4ca0 0x7f5aa40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:08.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.331+0000 7f5ab77fe640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5aa40b4ca0 0x7f5aa40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:08.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.331+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/2210180515 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5ab0106930 con 0x7f5ab810dbb0 2024-08-31T06:06:08.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.331+0000 7f5ab77fe640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5aa40b4ca0 0x7f5aa40b71b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8103ee0 tx=0x7f5aa000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:08.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.333+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/2210180515 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5ab00cd720 con 0x7f5ab810dbb0 2024-08-31T06:06:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:08.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.567+0000 7f5abe16a640 1 -- 172.21.15.53:0/2210180515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ab802e430 con 0x7f5ab810dbb0 2024-08-31T06:06:08.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.568+0000 7f5ab4ff9640 1 -- 172.21.15.53:0/2210180515 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11985 (secure 0 0 0) 0x7f5ab00cd020 con 0x7f5ab810dbb0 2024-08-31T06:06:08.570 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:06:08.570 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-08-31T06:04:23:449285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:04:23.359453+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:06:08.570 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-08-31T06:06:08.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 -- 172.21.15.53:0/2210180515 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5aa40b4ca0 msgr2=0x7f5aa40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:08.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5aa40b4ca0 0x7f5aa40b71b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8103ee0 tx=0x7f5aa000a2d0 comp rx=0 tx=0).stop 2024-08-31T06:06:08.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 -- 172.21.15.53:0/2210180515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab810dbb0 msgr2=0x7f5ab8102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:08.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab810dbb0 0x7f5ab8102f10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0005cc0 tx=0x7f5ab0032a10 comp rx=0 tx=0).stop 2024-08-31T06:06:08.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 -- 172.21.15.53:0/2210180515 shutdown_connections 2024-08-31T06:06:08.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5aa40b4ca0 0x7f5aa40b71b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:08.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab810dbb0 0x7f5ab8102f10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:08.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ab81050a0 0x7f5ab81029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:08.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 --2- 172.21.15.53:0/2210180515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab8104750 0x7f5ab8102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:08.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 -- 172.21.15.53:0/2210180515 >> 172.21.15.53:0/2210180515 conn(0x7f5ab80794d0 msgr2=0x7f5ab8100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:08.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 -- 172.21.15.53:0/2210180515 shutdown_connections 2024-08-31T06:06:08.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:08.570+0000 7f5abe16a640 1 -- 172.21.15.53:0/2210180515 wait complete. 2024-08-31T06:06:09.369 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id c58aada1 --release --await' 2024-08-31T06:06:09.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id c58aada1 --release --await 2024-08-31T06:06:09.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.556+0000 7fa0db543640 1 -- 172.21.15.53:0/3925842401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d4104790 msgr2=0x7fa0d4104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.556+0000 7fa0db543640 1 --2- 172.21.15.53:0/3925842401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d4104790 0x7fa0d4104ba0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009900 tx=0x7fa0d002a410 comp rx=0 tx=0).stop 2024-08-31T06:06:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.556+0000 7fa0db543640 1 -- 172.21.15.53:0/3925842401 shutdown_connections 2024-08-31T06:06:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.556+0000 7fa0db543640 1 --2- 172.21.15.53:0/3925842401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d410dbf0 0x7fa0d41100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.556+0000 7fa0db543640 1 --2- 172.21.15.53:0/3925842401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d41050e0 0x7fa0d410d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.556+0000 7fa0db543640 1 --2- 172.21.15.53:0/3925842401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d4104790 0x7fa0d4104ba0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.556+0000 7fa0db543640 1 -- 172.21.15.53:0/3925842401 >> 172.21.15.53:0/3925842401 conn(0x7fa0d4079580 msgr2=0x7fa0d4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.556+0000 7fa0db543640 1 -- 172.21.15.53:0/3925842401 shutdown_connections 2024-08-31T06:06:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.556+0000 7fa0db543640 1 -- 172.21.15.53:0/3925842401 wait complete. 2024-08-31T06:06:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.557+0000 7fa0db543640 1 Processor -- start 2024-08-31T06:06:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.557+0000 7fa0db543640 1 -- start start 2024-08-31T06:06:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.557+0000 7fa0db543640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d4104790 0x7fa0d419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.557+0000 7fa0db543640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d41050e0 0x7fa0d419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.557+0000 7fa0db543640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d410dbf0 0x7fa0d419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0db543640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d4113770 con 0x7fa0d4104790 2024-08-31T06:06:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0db543640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d41135f0 con 0x7fa0d410dbf0 2024-08-31T06:06:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0db543640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d41138f0 con 0x7fa0d41050e0 2024-08-31T06:06:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0d92df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d4104790 0x7fa0d419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0d92df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d4104790 0x7fa0d419a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39054/0 (socket says 172.21.15.53:39054) 2024-08-31T06:06:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0d92df640 1 -- 172.21.15.53:0/790129033 learned_addr learned my addr 172.21.15.53:0/790129033 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d41050e0 0x7fa0d419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0d9ae0640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d410dbf0 0x7fa0d419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0d92df640 1 -- 172.21.15.53:0/790129033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d41050e0 msgr2=0x7fa0d419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0d92df640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d41050e0 0x7fa0d419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0d92df640 1 -- 172.21.15.53:0/790129033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d410dbf0 msgr2=0x7fa0d419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0d92df640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d410dbf0 0x7fa0d419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0d92df640 1 -- 172.21.15.53:0/790129033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d41a0150 con 0x7fa0d4104790 2024-08-31T06:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0d92df640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d4104790 0x7fa0d419a1e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa0d002a930 tx=0x7fa0d0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.558+0000 7fa0ca7fc640 1 -- 172.21.15.53:0/790129033 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d003f070 con 0x7fa0d4104790 2024-08-31T06:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.559+0000 7fa0ca7fc640 1 -- 172.21.15.53:0/790129033 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0d0003e10 con 0x7fa0d4104790 2024-08-31T06:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.559+0000 7fa0ca7fc640 1 -- 172.21.15.53:0/790129033 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0035030 con 0x7fa0d4104790 2024-08-31T06:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.559+0000 7fa0db543640 1 -- 172.21.15.53:0/790129033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d41a03e0 con 0x7fa0d4104790 2024-08-31T06:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.559+0000 7fa0db543640 1 -- 172.21.15.53:0/790129033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d41a6ba0 con 0x7fa0d4104790 2024-08-31T06:06:09.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0ca7fc640 1 -- 172.21.15.53:0/790129033 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa0d0042070 con 0x7fa0d4104790 2024-08-31T06:06:09.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0e1ab8740 1 Processor -- start 2024-08-31T06:06:09.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0e1ab8740 1 -- start start 2024-08-31T06:06:09.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b777b7350 0x558b77b5d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b7778e490 0x558b77b5dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b77796670 0x558b77b5e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0e1ab8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b77ad35f0 con 0x558b77796670 2024-08-31T06:06:09.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0e1ab8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558b77ac2b80 con 0x558b7778e490 2024-08-31T06:06:09.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0e1ab8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558b77ac6b30 con 0x558b777b7350 2024-08-31T06:06:09.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0d8ade640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b77796670 0x558b77b5e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0d8ade640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b77796670 0x558b77b5e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39056/0 (socket says 172.21.15.53:39056) 2024-08-31T06:06:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0d8ade640 1 -- 172.21.15.53:0/20640832 learned_addr learned my addr 172.21.15.53:0/20640832 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0d9ae0640 1 --2- 172.21.15.53:0/20640832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b777b7350 0x558b77b5d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.562+0000 7fa0d92df640 1 --2- 172.21.15.53:0/20640832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b7778e490 0x558b77b5dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0d8ade640 1 -- 172.21.15.53:0/20640832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b777b7350 msgr2=0x558b77b5d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/20640832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b777b7350 0x558b77b5d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0d8ade640 1 -- 172.21.15.53:0/20640832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b7778e490 msgr2=0x558b77b5dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/20640832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b7778e490 0x558b77b5dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0d8ade640 1 -- 172.21.15.53:0/20640832 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b77822930 con 0x558b77796670 2024-08-31T06:06:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0ca7fc640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0c00b4d20 0x7fa0c00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0d9ae0640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0c00b4d20 0x7fa0c00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/20640832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b77796670 0x558b77b5e200 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400ab70 tx=0x7fa0c400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d146fb27d3a9c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:09.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0ca7fc640 1 -- 172.21.15.53:0/790129033 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa0d0105d10 con 0x7fa0d4104790 2024-08-31T06:06:09.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0bf7fe640 1 -- 172.21.15.53:0/20640832 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4004220 con 0x558b77796670 2024-08-31T06:06:09.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0bf7fe640 1 -- 172.21.15.53:0/20640832 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c40043c0 con 0x558b77796670 2024-08-31T06:06:09.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.563+0000 7fa0bf7fe640 1 -- 172.21.15.53:0/20640832 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4018660 con 0x558b77796670 2024-08-31T06:06:09.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.564+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/20640832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b77796670 msgr2=0x558b77b5e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:09.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.564+0000 7fa0d9ae0640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0c00b4d20 0x7fa0c00b7230 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc005fd0 tx=0x7fa0cc009740 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.564+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/20640832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b77796670 0x558b77b5e200 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400ab70 tx=0x7fa0c400f790 comp rx=0 tx=0).stop 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.564+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/20640832 shutdown_connections 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.564+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/20640832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b77796670 0x558b77b5e200 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.564+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/20640832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b7778e490 0x558b77b5dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.564+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/20640832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b777b7350 0x558b77b5d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.564+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/20640832 >> 172.21.15.53:0/20640832 conn(0x558b777ab740 msgr2=0x558b77b5b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.564+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/20640832 shutdown_connections 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.564+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/20640832 wait complete. 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.565+0000 7fa0e1ab8740 1 -- start start 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.565+0000 7fa0e1ab8740 1 Processor -- start 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.565+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b7778e490 0x558b77b68e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.565+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b77796670 0x558b77b69380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.565+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b777b7350 0x558b77b752f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0e1ab8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b77925890 con 0x558b7778e490 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0e1ab8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558b77a49790 con 0x558b77796670 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0e1ab8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558b77b6c000 con 0x558b777b7350 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0e1ab8740 10 client.0 _ll_register_callbacks cb 0x558b777ceba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0d92df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b7778e490 0x558b77b68e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0d92df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b7778e490 0x558b77b68e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39062/0 (socket says 172.21.15.53:39062) 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0d92df640 1 -- 172.21.15.53:0/1094704407 learned_addr learned my addr 172.21.15.53:0/1094704407 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b77796670 0x558b77b69380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0d9ae0640 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b777b7350 0x558b77b752f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0d92df640 1 -- 172.21.15.53:0/1094704407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b777b7350 msgr2=0x558b77b752f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0d92df640 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b777b7350 0x558b77b752f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0d92df640 1 -- 172.21.15.53:0/1094704407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b77796670 msgr2=0x558b77b69380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0d92df640 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b77796670 0x558b77b69380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0d92df640 1 -- 172.21.15.53:0/1094704407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b77a80f30 con 0x558b7778e490 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0d92df640 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b7778e490 0x558b77b68e40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa0d01034c0 tx=0x7fa0d00c82e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07eff3e01554427 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.566+0000 7fa0bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0bcff9640 1 -- 172.21.15.53:0/1094704407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0049050 con 0x558b7778e490 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0bcff9640 1 -- 172.21.15.53:0/1094704407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa0d00c8690 con 0x558b7778e490 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/1094704407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0c40043c0 con 0x558b7778e490 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0bcff9640 1 -- 172.21.15.53:0/1094704407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa0d00cbb70 con 0x558b7778e490 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0e1ab8740 10 client.16170 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/1094704407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b77b77d10 con 0x558b7778e490 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0bcff9640 1 -- 172.21.15.53:0/1094704407 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c40043c0 con 0x558b7778e490 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0bcff9640 1 -- 172.21.15.53:0/1094704407 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa0d0031400 con 0x558b7778e490 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0e1ab8740 10 client.16170 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0e1ab8740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0e1ab8740 20 client.16170 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b77775cd0 0x558b77b7b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0e1ab8740 4 client.16170 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.567+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/1094704407 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b77ad5540 con 0x558b77775cd0 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.568+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b77775cd0 0x558b77b7b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.568+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b77775cd0 0x558b77b7b4b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db951cd346de015d server_cookie=30ceb20be0dc50d5 in_seq=0 out_seq=0 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.568+0000 7fa0bcff9640 10 client.16170 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0bcff9640 1 -- 172.21.15.53:0/1094704407 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558b77ad5540 con 0x558b77775cd0 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0bcff9640 10 client.16170 handle_command_reply: tid=0 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0e1ab8740 1 client.16170 shutdown 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/1094704407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b7778e490 msgr2=0x558b77b68e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b7778e490 0x558b77b68e40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa0d01034c0 tx=0x7fa0d00c82e0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/1094704407 shutdown_connections 2024-08-31T06:06:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b77775cd0 0x558b77b7b4b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b777b7350 0x558b77b752f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b77796670 0x558b77b69380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/1094704407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b7778e490 0x558b77b68e40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/1094704407 >> 172.21.15.53:0/1094704407 conn(0x558b777ab740 msgr2=0x558b77b60910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0bcff9640 0 client.16170 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/1094704407 shutdown_connections 2024-08-31T06:06:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.569+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/1094704407 wait complete. 2024-08-31T06:06:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.570+0000 7fa0e1ab8740 20 client.16170 trim_cache size 0 max 16384 2024-08-31T06:06:09.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.598+0000 7fa0e1ab8740 1 Processor -- start 2024-08-31T06:06:09.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.598+0000 7fa0e1ab8740 1 -- start start 2024-08-31T06:06:09.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b7778e490 0x558b77b75260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b77796670 0x558b77b66030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 0x558b77b66570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.602 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:09 smithi053 ceph-mon[18924]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-08-31T06:06:09.602 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:09 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2210180515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:06:09.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0d9ae0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 0x558b77b66570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0d9ae0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 0x558b77b66570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39066/0 (socket says 172.21.15.53:39066) 2024-08-31T06:06:09.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0d9ae0640 1 -- 172.21.15.53:0/4064632120 learned_addr learned my addr 172.21.15.53:0/4064632120 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:09.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0d92df640 1 --2- 172.21.15.53:0/4064632120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b7778e490 0x558b77b75260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/4064632120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d41af3d0 con 0x558b777b7350 2024-08-31T06:06:09.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/4064632120 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d41b0f10 con 0x558b7778e490 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/4064632120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d41afaa0 con 0x558b77796670 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/4064632120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b77796670 0x558b77b66030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.599+0000 7fa0d8ade640 1 -- 172.21.15.53:0/4064632120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b7778e490 msgr2=0x558b77b75260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.600+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/4064632120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b7778e490 0x558b77b75260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.600+0000 7fa0d8ade640 1 -- 172.21.15.53:0/4064632120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 msgr2=0x558b77b66570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.600+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/4064632120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 0x558b77b66570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.600+0000 7fa0d8ade640 1 -- 172.21.15.53:0/4064632120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b77b5fa70 con 0x558b77796670 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.600+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/4064632120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b77796670 0x558b77b66030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40058c0 tx=0x7fa0c400a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=523646bf89e5ccc8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.600+0000 7fa0beffd640 1 -- 172.21.15.53:0/4064632120 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4030070 con 0x558b77796670 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.600+0000 7fa0beffd640 1 -- 172.21.15.53:0/4064632120 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c400a700 con 0x558b77796670 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.600+0000 7fa0beffd640 1 -- 172.21.15.53:0/4064632120 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4004470 con 0x558b77796670 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.601+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/4064632120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b77796670 msgr2=0x558b77b66030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.601+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/4064632120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b77796670 0x558b77b66030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40058c0 tx=0x7fa0c400a2d0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.601+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/4064632120 shutdown_connections 2024-08-31T06:06:09.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.601+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/4064632120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 0x558b77b66570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.601+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/4064632120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b77796670 0x558b77b66030 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.601+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/4064632120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b7778e490 0x558b77b75260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.602+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/4064632120 >> 172.21.15.53:0/4064632120 conn(0x558b777ab740 msgr2=0x558b77b676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:09.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.602+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/4064632120 shutdown_connections 2024-08-31T06:06:09.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.602+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/4064632120 wait complete. 2024-08-31T06:06:09.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.602+0000 7fa0e1ab8740 1 -- start start 2024-08-31T06:06:09.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.602+0000 7fa0e1ab8740 1 Processor -- start 2024-08-31T06:06:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.603+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b7778e490 0x558b77b7e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.603+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b77796670 0x558b77b7e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.603+0000 7fa0e1ab8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 0x558b77b793f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.603+0000 7fa0d92df640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b7778e490 0x558b77b7e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.603+0000 7fa0d92df640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b7778e490 0x558b77b7e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:52464/0 (socket says 172.21.15.53:52464) 2024-08-31T06:06:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.603+0000 7fa0d92df640 1 -- 172.21.15.53:0/3370727043 learned_addr learned my addr 172.21.15.53:0/3370727043 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.603+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/3370727043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d41b0840 con 0x558b777b7350 2024-08-31T06:06:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/3370727043 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d41b0170 con 0x558b77796670 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0d9ae0640 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 0x558b77b793f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0d8ade640 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b77796670 0x558b77b7e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/3370727043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d41ad3b0 con 0x558b7778e490 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0e1ab8740 10 client.0 _ll_register_callbacks cb 0x7fa0d0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0d9ae0640 1 -- 172.21.15.53:0/3370727043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b7778e490 msgr2=0x558b77b7e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0d9ae0640 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b7778e490 0x558b77b7e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0d9ae0640 1 -- 172.21.15.53:0/3370727043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b77796670 msgr2=0x558b77b7e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0d9ae0640 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b77796670 0x558b77b7e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0d9ae0640 1 -- 172.21.15.53:0/3370727043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b77b7f070 con 0x558b777b7350 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0d92df640 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b7778e490 0x558b77b7e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0d9ae0640 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 0x558b77b793f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc01ebc0 tx=0x7fa0cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ec8a4c4328eaee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:09.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.604+0000 7fa0bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.605+0000 7fa0bcff9640 1 -- 172.21.15.53:0/3370727043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc004b20 con 0x558b777b7350 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.605+0000 7fa0bcff9640 1 -- 172.21.15.53:0/3370727043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa0cc004cc0 con 0x558b777b7350 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.605+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/3370727043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0c400a700 con 0x558b777b7350 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.605+0000 7fa0bcff9640 1 -- 172.21.15.53:0/3370727043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa0cc005020 con 0x558b777b7350 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.605+0000 7fa0e1ab8740 10 client.16176 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.605+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/3370727043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b77beede0 con 0x558b777b7350 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.605+0000 7fa0bcff9640 1 -- 172.21.15.53:0/3370727043 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c400a700 con 0x558b777b7350 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.606+0000 7fa0bcff9640 1 -- 172.21.15.53:0/3370727043 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa0cc028070 con 0x558b777b7350 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.606+0000 7fa0e1ab8740 10 client.16176 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.606+0000 7fa0e1ab8740 10 client.16176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.606+0000 7fa0e1ab8740 20 client.16176 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.606+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b7774b080 0x558b77bf1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.606+0000 7fa0e1ab8740 4 client.16176 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:06:09.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.606+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/3370727043 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558b77ad0fe0 con 0x558b7774b080 2024-08-31T06:06:09.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.606+0000 7fa0d92df640 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b7774b080 0x558b77bf1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:09.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.607+0000 7fa0d92df640 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b7774b080 0x558b77bf1600 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a49207904dc97b server_cookie=acbb7944dd421b51 in_seq=0 out_seq=0 2024-08-31T06:06:09.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.607+0000 7fa0bcff9640 10 client.16176 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.608+0000 7fa0bcff9640 1 -- 172.21.15.53:0/3370727043 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558b77ad0fe0 con 0x558b7774b080 2024-08-31T06:06:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.608+0000 7fa0bcff9640 10 client.16176 handle_command_reply: tid=0 2024-08-31T06:06:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.608+0000 7fa0e1ab8740 1 client.16176 shutdown 2024-08-31T06:06:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/3370727043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 msgr2=0x558b77b793f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 0x558b77b793f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc01ebc0 tx=0x7fa0cc004a40 comp rx=0 tx=0).stop 2024-08-31T06:06:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/3370727043 shutdown_connections 2024-08-31T06:06:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b7774b080 0x558b77bf1600 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b777b7350 0x558b77b793f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b77796670 0x558b77b7e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0e1ab8740 1 --2- 172.21.15.53:0/3370727043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b7778e490 0x558b77b7e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/3370727043 >> 172.21.15.53:0/3370727043 conn(0x558b777ab740 msgr2=0x558b77b6a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:09.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0bcff9640 0 client.16176 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:09.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/3370727043 shutdown_connections 2024-08-31T06:06:09.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0e1ab8740 1 -- 172.21.15.53:0/3370727043 wait complete. 2024-08-31T06:06:09.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.609+0000 7fa0e1ab8740 20 client.16176 trim_cache size 0 max 16384 2024-08-31T06:06:09.614 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:06:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:06:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "b0975b60-4943-46fa-8c34-072ffbab94be", 2024-08-31T06:06:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:06:09.614 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:06:09.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.610+0000 7fa0db543640 1 -- 172.21.15.53:0/790129033 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0c00b4d20 msgr2=0x7fa0c00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:09.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.610+0000 7fa0db543640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0c00b4d20 0x7fa0c00b7230 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc005fd0 tx=0x7fa0cc009740 comp rx=0 tx=0).stop 2024-08-31T06:06:09.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.610+0000 7fa0db543640 1 -- 172.21.15.53:0/790129033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d4104790 msgr2=0x7fa0d419a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:09.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.610+0000 7fa0db543640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d4104790 0x7fa0d419a1e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa0d002a930 tx=0x7fa0d0003c20 comp rx=0 tx=0).stop 2024-08-31T06:06:09.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.610+0000 7fa0db543640 1 -- 172.21.15.53:0/790129033 shutdown_connections 2024-08-31T06:06:09.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.610+0000 7fa0db543640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0c00b4d20 0x7fa0c00b7230 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.610+0000 7fa0db543640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d410dbf0 0x7fa0d419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.610+0000 7fa0db543640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d41050e0 0x7fa0d419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.610+0000 7fa0db543640 1 --2- 172.21.15.53:0/790129033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d4104790 0x7fa0d419a1e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:09.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.610+0000 7fa0db543640 1 -- 172.21.15.53:0/790129033 >> 172.21.15.53:0/790129033 conn(0x7fa0d4079580 msgr2=0x7fa0d41005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:09.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.611+0000 7fa0db543640 1 -- 172.21.15.53:0/790129033 shutdown_connections 2024-08-31T06:06:09.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:09.611+0000 7fa0db543640 1 -- 172.21.15.53:0/790129033 wait complete. 2024-08-31T06:06:09.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:09 smithi130 ceph-mon[22266]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-08-31T06:06:09.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:09 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2210180515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:06:09.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:09 smithi153 ceph-mon[22320]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-08-31T06:06:09.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:09 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2210180515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:06:10.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:06:10.282 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:10.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.770+0000 7fb1a124f640 1 -- 172.21.15.53:0/3914920248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c108140 msgr2=0x7fb19c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:10.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.770+0000 7fb1a124f640 1 --2- 172.21.15.53:0/3914920248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c108140 0x7fb19c108550 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb190009900 tx=0x7fb19002a410 comp rx=0 tx=0).stop 2024-08-31T06:06:10.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.770+0000 7fb1a124f640 1 -- 172.21.15.53:0/3914920248 shutdown_connections 2024-08-31T06:06:10.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.770+0000 7fb1a124f640 1 --2- 172.21.15.53:0/3914920248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb19c108a90 0x7fb19c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.770+0000 7fb1a124f640 1 --2- 172.21.15.53:0/3914920248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c108140 0x7fb19c108550 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.770+0000 7fb1a124f640 1 --2- 172.21.15.53:0/3914920248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb19c102800 0x7fb19c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.770+0000 7fb1a124f640 1 -- 172.21.15.53:0/3914920248 >> 172.21.15.53:0/3914920248 conn(0x7fb19c0794d0 msgr2=0x7fb19c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:10.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.770+0000 7fb1a124f640 1 -- 172.21.15.53:0/3914920248 shutdown_connections 2024-08-31T06:06:10.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.770+0000 7fb1a124f640 1 -- 172.21.15.53:0/3914920248 wait complete. 2024-08-31T06:06:10.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.771+0000 7fb1a124f640 1 Processor -- start 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.771+0000 7fb1a124f640 1 -- start start 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.771+0000 7fb1a124f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c102800 0x7fb19c19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.771+0000 7fb1a124f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb19c108140 0x7fb19c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.771+0000 7fb1a124f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb19c108a90 0x7fb19c19f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.771+0000 7fb1a124f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1136d0 con 0x7fb19c102800 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.771+0000 7fb1a124f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c113550 con 0x7fb19c108140 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.771+0000 7fb1a124f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c113850 con 0x7fb19c108a90 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.771+0000 7fb19ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c102800 0x7fb19c19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.771+0000 7fb19ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c102800 0x7fb19c19a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39104/0 (socket says 172.21.15.53:39104) 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.771+0000 7fb19ad9d640 1 -- 172.21.15.53:0/672284391 learned_addr learned my addr 172.21.15.53:0/672284391 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb19a59c640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb19c108140 0x7fb19c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb19b59e640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb19c108a90 0x7fb19c19f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb19ad9d640 1 -- 172.21.15.53:0/672284391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb19c108a90 msgr2=0x7fb19c19f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb19ad9d640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb19c108a90 0x7fb19c19f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb19ad9d640 1 -- 172.21.15.53:0/672284391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb19c108140 msgr2=0x7fb19c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb19ad9d640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb19c108140 0x7fb19c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb19ad9d640 1 -- 172.21.15.53:0/672284391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19c1a00b0 con 0x7fb19c102800 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb19a59c640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb19c108140 0x7fb19c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb19b59e640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb19c108a90 0x7fb19c19f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb19ad9d640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c102800 0x7fb19c19a140 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00d770 tx=0x7fb18c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb183fff640 1 -- 172.21.15.53:0/672284391 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c017070 con 0x7fb19c102800 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb1a124f640 1 -- 172.21.15.53:0/672284391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19c1a03a0 con 0x7fb19c102800 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb183fff640 1 -- 172.21.15.53:0/672284391 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb18c0054b0 con 0x7fb19c102800 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb183fff640 1 -- 172.21.15.53:0/672284391 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c004c60 con 0x7fb19c102800 2024-08-31T06:06:10.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.772+0000 7fb1a124f640 1 -- 172.21.15.53:0/672284391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb19c1a6b00 con 0x7fb19c102800 2024-08-31T06:06:10.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.775+0000 7fb1a77c4740 1 Processor -- start 2024-08-31T06:06:10.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.775+0000 7fb1a77c4740 1 -- start start 2024-08-31T06:06:10.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.775+0000 7fb183fff640 1 -- 172.21.15.53:0/672284391 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb18c004e00 con 0x7fb19c102800 2024-08-31T06:06:10.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.775+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.775+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcee7660 0x5654fd2b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.775+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fceef840 0x5654fd2b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.775+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654fd22ca70 con 0x5654fcf10520 2024-08-31T06:06:10.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.775+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5654fd21c000 con 0x5654fceef840 2024-08-31T06:06:10.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.775+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5654fd21ffb0 con 0x5654fcee7660 2024-08-31T06:06:10.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.775+0000 7fb19b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb19b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39116/0 (socket says 172.21.15.53:39116) 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb19b59e640 1 -- 172.21.15.53:0/3387473812 learned_addr learned my addr 172.21.15.53:0/3387473812 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb19ad9d640 1 --2- 172.21.15.53:0/3387473812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcee7660 0x5654fd2b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb19a59c640 1 --2- 172.21.15.53:0/3387473812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fceef840 0x5654fd2b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb19b59e640 1 -- 172.21.15.53:0/3387473812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcee7660 msgr2=0x5654fd2b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb19b59e640 1 --2- 172.21.15.53:0/3387473812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcee7660 0x5654fd2b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb19b59e640 1 -- 172.21.15.53:0/3387473812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fceef840 msgr2=0x5654fd2b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb19b59e640 1 --2- 172.21.15.53:0/3387473812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fceef840 0x5654fd2b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb19b59e640 1 -- 172.21.15.53:0/3387473812 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654fcf7bb00 con 0x5654fcf10520 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb183fff640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb1840b4ca0 0x7fb1840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb19b59e640 1 --2- 172.21.15.53:0/3387473812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2b5c80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb194009ea0 tx=0x7fb194009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a825147114307554 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.776+0000 7fb19ad9d640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb1840b4ca0 0x7fb1840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.777+0000 7fb183fff640 1 -- 172.21.15.53:0/672284391 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb18c0e5070 con 0x7fb19c102800 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.777+0000 7fb1817fa640 1 -- 172.21.15.53:0/3387473812 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194004d20 con 0x5654fcf10520 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.777+0000 7fb1817fa640 1 -- 172.21.15.53:0/3387473812 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1940054b0 con 0x5654fcf10520 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.777+0000 7fb1817fa640 1 -- 172.21.15.53:0/3387473812 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194011750 con 0x5654fcf10520 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.778+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3387473812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 msgr2=0x5654fd2b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.778+0000 7fb19ad9d640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb1840b4ca0 0x7fb1840b71b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0e2870 tx=0x7fb18c0e8ca0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.778+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/3387473812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2b5c80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb194009ea0 tx=0x7fb194009f90 comp rx=0 tx=0).stop 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.778+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3387473812 shutdown_connections 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.778+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/3387473812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fceef840 0x5654fd2b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.778+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/3387473812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcee7660 0x5654fd2b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.778+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/3387473812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2b5c80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.778+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3387473812 >> 172.21.15.53:0/3387473812 conn(0x5654fcf04910 msgr2=0x5654fd2b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.778+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3387473812 shutdown_connections 2024-08-31T06:06:10.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.778+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3387473812 wait complete. 2024-08-31T06:06:10.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.778+0000 7fb1a77c4740 1 -- start start 2024-08-31T06:06:10.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb1a77c4740 1 Processor -- start 2024-08-31T06:06:10.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcee7660 0x5654fd2c1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fceef840 0x5654fd2c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654fd2c4460 con 0x5654fcf10520 2024-08-31T06:06:10.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5654fd1dd520 con 0x5654fceef840 2024-08-31T06:06:10.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5654fd2c45e0 con 0x5654fcee7660 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb1a77c4740 10 client.0 _ll_register_callbacks cb 0x5654fd215c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb19b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb19b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39132/0 (socket says 172.21.15.53:39132) 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb19b59e640 1 -- 172.21.15.53:0/3457159795 learned_addr learned my addr 172.21.15.53:0/3457159795 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb19b59e640 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcee7660 0x5654fd2c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.779+0000 7fb19a59c640 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fceef840 0x5654fd2c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb19b59e640 1 -- 172.21.15.53:0/3457159795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcee7660 msgr2=0x5654fd2c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb19b59e640 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcee7660 0x5654fd2c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb19b59e640 1 -- 172.21.15.53:0/3457159795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fceef840 msgr2=0x5654fd2c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb19b59e640 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fceef840 0x5654fd2c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb19b59e640 1 -- 172.21.15.53:0/3457159795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654fcff2960 con 0x5654fcf10520 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb19a59c640 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fceef840 0x5654fd2c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb19b59e640 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2cd8d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb194005cc0 tx=0x7fb194005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b37e20576d18a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:10.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb17eff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb17eff5640 1 -- 172.21.15.53:0/3457159795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19401d070 con 0x5654fcf10520 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb17eff5640 1 -- 172.21.15.53:0/3457159795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb194011d00 con 0x5654fcf10520 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3457159795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5654fd1bb9a0 con 0x5654fcf10520 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb17eff5640 1 -- 172.21.15.53:0/3457159795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb194031050 con 0x5654fcf10520 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb1a77c4740 10 client.16188 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.780+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3457159795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5654fd2d0620 con 0x5654fcf10520 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.781+0000 7fb17eff5640 1 -- 172.21.15.53:0/3457159795 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5654fd1bb9a0 con 0x5654fcf10520 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.781+0000 7fb17eff5640 1 -- 172.21.15.53:0/3457159795 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb194019430 con 0x5654fcf10520 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.781+0000 7fb1a77c4740 10 client.16188 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.781+0000 7fb1a77c4740 10 client.16188 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.781+0000 7fb1a77c4740 20 client.16188 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.781+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654fceceea0 0x5654fd2d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.781+0000 7fb1a77c4740 4 client.16188 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:10.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.781+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3457159795 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654fd22e9c0 con 0x5654fceceea0 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.781+0000 7fb19a59c640 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654fceceea0 0x5654fd2d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.782+0000 7fb17eff5640 10 client.16188 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.782+0000 7fb19a59c640 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654fceceea0 0x5654fd2d3a40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83f50e8e0b4b31f2 server_cookie=b61a531b9c25e06e in_seq=0 out_seq=0 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.782+0000 7fb17eff5640 1 -- 172.21.15.53:0/3457159795 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5654fd22e9c0 con 0x5654fceceea0 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.782+0000 7fb17eff5640 10 client.16188 handle_command_reply: tid=0 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.782+0000 7fb1a77c4740 1 client.16188 shutdown 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3457159795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 msgr2=0x5654fd2cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2cd8d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb194005cc0 tx=0x7fb194005bd0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3457159795 shutdown_connections 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654fceceea0 0x5654fd2d3a40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcf10520 0x5654fd2cd8d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fceef840 0x5654fd2c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/3457159795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcee7660 0x5654fd2c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3457159795 >> 172.21.15.53:0/3457159795 conn(0x5654fcf04910 msgr2=0x5654fd2b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:10.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb17eff5640 0 client.16188 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:10.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3457159795 shutdown_connections 2024-08-31T06:06:10.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb1a77c4740 1 -- 172.21.15.53:0/3457159795 wait complete. 2024-08-31T06:06:10.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.783+0000 7fb1a77c4740 20 client.16188 trim_cache size 0 max 16384 2024-08-31T06:06:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.807+0000 7fb1a77c4740 1 Processor -- start 2024-08-31T06:06:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.807+0000 7fb1a77c4740 1 -- start start 2024-08-31T06:06:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.807+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fcee7660 0x5654fd2c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.807+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fceef840 0x5654fd2cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.807+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcf10520 0x5654fd2cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.807+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1ad240 con 0x5654fceef840 2024-08-31T06:06:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.807+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1aed80 con 0x5654fcee7660 2024-08-31T06:06:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.807+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1ad910 con 0x5654fcf10520 2024-08-31T06:06:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.807+0000 7fb19a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fceef840 0x5654fd2cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.807+0000 7fb19a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fceef840 0x5654fd2cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39134/0 (socket says 172.21.15.53:39134) 2024-08-31T06:06:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb19a59c640 1 -- 172.21.15.53:0/578702563 learned_addr learned my addr 172.21.15.53:0/578702563 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb19b59e640 1 --2- 172.21.15.53:0/578702563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcf10520 0x5654fd2cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb19b59e640 1 --2- 172.21.15.53:0/578702563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fcee7660 0x5654fd2c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb19a59c640 1 -- 172.21.15.53:0/578702563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcf10520 msgr2=0x5654fd2cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb19a59c640 1 --2- 172.21.15.53:0/578702563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcf10520 0x5654fd2cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb19a59c640 1 -- 172.21.15.53:0/578702563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fcee7660 msgr2=0x5654fd2c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb19a59c640 1 --2- 172.21.15.53:0/578702563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fcee7660 0x5654fd2c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb19a59c640 1 -- 172.21.15.53:0/578702563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654fd2c2920 con 0x5654fceef840 2024-08-31T06:06:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb19a59c640 1 --2- 172.21.15.53:0/578702563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fceef840 0x5654fd2cd840 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb19c06a840 tx=0x7fb190005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a428f4df69279b09 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb180ff9640 1 -- 172.21.15.53:0/578702563 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190035040 con 0x5654fceef840 2024-08-31T06:06:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb180ff9640 1 -- 172.21.15.53:0/578702563 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1900054d0 con 0x5654fceef840 2024-08-31T06:06:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.808+0000 7fb180ff9640 1 -- 172.21.15.53:0/578702563 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190004c20 con 0x5654fceef840 2024-08-31T06:06:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.809+0000 7fb1a77c4740 1 -- 172.21.15.53:0/578702563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fceef840 msgr2=0x5654fd2cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.809+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/578702563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fceef840 0x5654fd2cd840 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb19c06a840 tx=0x7fb190005a20 comp rx=0 tx=0).stop 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.809+0000 7fb1a77c4740 1 -- 172.21.15.53:0/578702563 shutdown_connections 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.809+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/578702563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fcf10520 0x5654fd2cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.809+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/578702563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fceef840 0x5654fd2cd840 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.809+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/578702563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fcee7660 0x5654fd2c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.809+0000 7fb1a77c4740 1 -- 172.21.15.53:0/578702563 >> 172.21.15.53:0/578702563 conn(0x5654fcf04910 msgr2=0x5654fd2c2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.810+0000 7fb1a77c4740 1 -- 172.21.15.53:0/578702563 shutdown_connections 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.810+0000 7fb1a77c4740 1 -- 172.21.15.53:0/578702563 wait complete. 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.810+0000 7fb1a77c4740 1 -- start start 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.810+0000 7fb1a77c4740 1 Processor -- start 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.810+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcee7660 0x5654fd2d30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.810+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fceef840 0x5654fd2d3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.810+0000 7fb1a77c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fcf10520 0x5654fd33d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.810+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1ae6b0 con 0x5654fcee7660 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.810+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1adfe0 con 0x5654fcf10520 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.810+0000 7fb1a77c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1ab220 con 0x5654fceef840 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.810+0000 7fb1a77c4740 10 client.0 _ll_register_callbacks cb 0x7fb190009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb19b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcee7660 0x5654fd2d30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb19b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcee7660 0x5654fd2d30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39138/0 (socket says 172.21.15.53:39138) 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb19b59e640 1 -- 172.21.15.53:0/604450640 learned_addr learned my addr 172.21.15.53:0/604450640 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb19a59c640 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fceef840 0x5654fd2d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb19b59e640 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fcf10520 0x5654fd33d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb19b59e640 1 -- 172.21.15.53:0/604450640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fceef840 msgr2=0x5654fd2d3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb19b59e640 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fceef840 0x5654fd2d3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb19b59e640 1 -- 172.21.15.53:0/604450640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fcf10520 msgr2=0x5654fd33d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb19b59e640 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fcf10520 0x5654fd33d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb19b59e640 1 -- 172.21.15.53:0/604450640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654fd33d6f0 con 0x5654fcee7660 2024-08-31T06:06:10.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb19b59e640 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcee7660 0x5654fd2d30d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb1940097f0 tx=0x7fb194005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ade7f0f5f5668aa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:10.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb17eff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:10.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb17eff5640 1 -- 172.21.15.53:0/604450640 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19401d040 con 0x5654fcee7660 2024-08-31T06:06:10.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb17eff5640 1 -- 172.21.15.53:0/604450640 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb194019430 con 0x5654fcee7660 2024-08-31T06:06:10.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.811+0000 7fb1a77c4740 1 -- 172.21.15.53:0/604450640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1900054d0 con 0x5654fcee7660 2024-08-31T06:06:10.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb17eff5640 1 -- 172.21.15.53:0/604450640 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb194019650 con 0x5654fcee7660 2024-08-31T06:06:10.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb1a77c4740 10 client.16194 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:10.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb1a77c4740 1 -- 172.21.15.53:0/604450640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5654fd33e860 con 0x5654fcee7660 2024-08-31T06:06:10.818 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:10.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb17eff5640 1 -- 172.21.15.53:0/604450640 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1900054d0 con 0x5654fcee7660 2024-08-31T06:06:10.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb17eff5640 1 -- 172.21.15.53:0/604450640 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb1940407c0 con 0x5654fcee7660 2024-08-31T06:06:10.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb1a77c4740 10 client.16194 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:10.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb1a77c4740 10 client.16194 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:06:10.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb1a77c4740 20 client.16194 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:10.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654fcea4250 0x5654fd340fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:10.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb1a77c4740 4 client.16194 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c58aada1", "release": true, "await": true}] 2024-08-31T06:06:10.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb1a77c4740 1 -- 172.21.15.53:0/604450640 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c58aada1", "release": true, "await": true}) -- 0x5654fd22a460 con 0x5654fcea4250 2024-08-31T06:06:10.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.812+0000 7fb19a59c640 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654fcea4250 0x5654fd340fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:10.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.813+0000 7fb19a59c640 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654fcea4250 0x5654fd340fc0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5cc5f64e1e7adfd server_cookie=d1472d906ae7846d in_seq=0 out_seq=0 2024-08-31T06:06:10.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.813+0000 7fb17eff5640 10 client.16194 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:10.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.818+0000 7fb17eff5640 1 -- 172.21.15.53:0/604450640 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5654fd22a460 con 0x5654fcea4250 2024-08-31T06:06:10.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.818+0000 7fb17eff5640 10 client.16194 handle_command_reply: tid=0 2024-08-31T06:06:10.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 1 client.16194 shutdown 2024-08-31T06:06:10.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 1 -- 172.21.15.53:0/604450640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcee7660 msgr2=0x5654fd2d30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:10.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcee7660 0x5654fd2d30d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb1940097f0 tx=0x7fb194005bd0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 1 -- 172.21.15.53:0/604450640 shutdown_connections 2024-08-31T06:06:10.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654fcea4250 0x5654fd340fc0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654fcf10520 0x5654fd33d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654fceef840 0x5654fd2d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 1 --2- 172.21.15.53:0/604450640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654fcee7660 0x5654fd2d30d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 1 -- 172.21.15.53:0/604450640 >> 172.21.15.53:0/604450640 conn(0x5654fcf04910 msgr2=0x5654fd2c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:10.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb17eff5640 0 client.16194 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:10.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 1 -- 172.21.15.53:0/604450640 shutdown_connections 2024-08-31T06:06:10.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 1 -- 172.21.15.53:0/604450640 wait complete. 2024-08-31T06:06:10.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.819+0000 7fb1a77c4740 20 client.16194 trim_cache size 0 max 16384 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 28, 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 8, 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout: "c58aada1": { 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 8, 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:06:10.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 146.4, 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:06:10.824 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:06:10.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 -- 172.21.15.53:0/672284391 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb1840b4ca0 msgr2=0x7fb1840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:10.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb1840b4ca0 0x7fb1840b71b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0e2870 tx=0x7fb18c0e8ca0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 -- 172.21.15.53:0/672284391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c102800 msgr2=0x7fb19c19a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:10.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c102800 0x7fb19c19a140 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00d770 tx=0x7fb18c00dc30 comp rx=0 tx=0).stop 2024-08-31T06:06:10.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 -- 172.21.15.53:0/672284391 shutdown_connections 2024-08-31T06:06:10.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb1840b4ca0 0x7fb1840b71b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb19c108a90 0x7fb19c19f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb19c108140 0x7fb19c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 --2- 172.21.15.53:0/672284391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c102800 0x7fb19c19a140 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:10.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 -- 172.21.15.53:0/672284391 >> 172.21.15.53:0/672284391 conn(0x7fb19c0794d0 msgr2=0x7fb19c104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:10.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 -- 172.21.15.53:0/672284391 shutdown_connections 2024-08-31T06:06:10.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:10.820+0000 7fb1a124f640 1 -- 172.21.15.53:0/672284391 wait complete. 2024-08-31T06:06:10.833 INFO:tasks.workunit.client.0.smithi053.stderr:+ dbench 1 2024-08-31T06:06:10.859 INFO:tasks.workunit.client.0.smithi053.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-08-31T06:06:10.859 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-08-31T06:06:10.859 INFO:tasks.workunit.client.0.smithi053.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-08-31T06:06:10.859 INFO:tasks.workunit.client.0.smithi053.stdout:0 of 1 processes prepared for launch 0 sec 2024-08-31T06:06:10.959 INFO:tasks.workunit.client.0.smithi053.stdout:1 of 1 processes prepared for launch 0 sec 2024-08-31T06:06:10.959 INFO:tasks.workunit.client.0.smithi053.stdout:releasing clients 2024-08-31T06:06:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.595+0000 7f3b82ae5640 1 -- 172.21.15.53:0/3174330481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b7c109270 msgr2=0x7f3b7c109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.595+0000 7f3b82ae5640 1 --2- 172.21.15.53:0/3174330481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b7c109270 0x7f3b7c109680 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009900 tx=0x7f3b6802a410 comp rx=0 tx=0).stop 2024-08-31T06:06:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.596+0000 7f3b82ae5640 1 -- 172.21.15.53:0/3174330481 shutdown_connections 2024-08-31T06:06:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.596+0000 7f3b82ae5640 1 --2- 172.21.15.53:0/3174330481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b7c109bc0 0x7f3b7c1103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.596+0000 7f3b82ae5640 1 --2- 172.21.15.53:0/3174330481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b7c109270 0x7f3b7c109680 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.596+0000 7f3b82ae5640 1 --2- 172.21.15.53:0/3174330481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b7c103930 0x7f3b7c103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.596+0000 7f3b82ae5640 1 -- 172.21.15.53:0/3174330481 >> 172.21.15.53:0/3174330481 conn(0x7f3b7c0ff3a0 msgr2=0x7f3b7c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:11.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.596+0000 7f3b82ae5640 1 -- 172.21.15.53:0/3174330481 shutdown_connections 2024-08-31T06:06:11.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.596+0000 7f3b82ae5640 1 -- 172.21.15.53:0/3174330481 wait complete. 2024-08-31T06:06:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.596+0000 7f3b82ae5640 1 Processor -- start 2024-08-31T06:06:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.596+0000 7f3b82ae5640 1 -- start start 2024-08-31T06:06:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b82ae5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b7c103930 0x7f3b7c19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b82ae5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b7c109270 0x7f3b7c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b82ae5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b7c109bc0 0x7f3b7c19f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b82ae5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c113730 con 0x7f3b7c109270 2024-08-31T06:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b82ae5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1135b0 con 0x7f3b7c109bc0 2024-08-31T06:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b82ae5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1138b0 con 0x7f3b7c103930 2024-08-31T06:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b7c109270 0x7f3b7c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b7c109270 0x7f3b7c19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39160/0 (socket says 172.21.15.53:39160) 2024-08-31T06:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b7bfff640 1 -- 172.21.15.53:0/1106898909 learned_addr learned my addr 172.21.15.53:0/1106898909 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b80881640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b7c103930 0x7f3b7c19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b81082640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b7c109bc0 0x7f3b7c19f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b80881640 1 -- 172.21.15.53:0/1106898909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b7c109bc0 msgr2=0x7f3b7c19f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b80881640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b7c109bc0 0x7f3b7c19f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b80881640 1 -- 172.21.15.53:0/1106898909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b7c109270 msgr2=0x7f3b7c19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b80881640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b7c109270 0x7f3b7c19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b80881640 1 -- 172.21.15.53:0/1106898909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c1a00d0 con 0x7f3b7c103930 2024-08-31T06:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.597+0000 7f3b7bfff640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b7c109270 0x7f3b7c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.598+0000 7f3b80881640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b7c103930 0x7f3b7c19a160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000e9f0 tx=0x7f3b7000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.598+0000 7f3b79ffb640 1 -- 172.21.15.53:0/1106898909 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000ccc0 con 0x7f3b7c103930 2024-08-31T06:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.598+0000 7f3b82ae5640 1 -- 172.21.15.53:0/1106898909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c1a03c0 con 0x7f3b7c103930 2024-08-31T06:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.598+0000 7f3b79ffb640 1 -- 172.21.15.53:0/1106898909 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b70005020 con 0x7f3b7c103930 2024-08-31T06:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.598+0000 7f3b79ffb640 1 -- 172.21.15.53:0/1106898909 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000ce60 con 0x7f3b7c103930 2024-08-31T06:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.598+0000 7f3b82ae5640 1 -- 172.21.15.53:0/1106898909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c1a6b20 con 0x7f3b7c103930 2024-08-31T06:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.601+0000 7f3b79ffb640 1 -- 172.21.15.53:0/1106898909 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3b70004a60 con 0x7f3b7c103930 2024-08-31T06:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.601+0000 7f3b8905a740 1 Processor -- start 2024-08-31T06:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.601+0000 7f3b8905a740 1 -- start start 2024-08-31T06:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.601+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b23415070 0x558b237ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.601+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237ba800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.601+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233f4390 0x558b237bad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.601+0000 7f3b8905a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b23731630 con 0x558b233ec1b0 2024-08-31T06:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.601+0000 7f3b8905a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558b23720bc0 con 0x558b23415070 2024-08-31T06:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.601+0000 7f3b8905a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558b23724b70 con 0x558b233f4390 2024-08-31T06:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.601+0000 7f3b80881640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237ba800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b80881640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237ba800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39164/0 (socket says 172.21.15.53:39164) 2024-08-31T06:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b80881640 1 -- 172.21.15.53:0/3895284974 learned_addr learned my addr 172.21.15.53:0/3895284974 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b81082640 1 --2- 172.21.15.53:0/3895284974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b23415070 0x558b237ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b7bfff640 1 --2- 172.21.15.53:0/3895284974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233f4390 0x558b237bad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b79ffb640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b6c0b4ca0 0x7f3b6c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b81082640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b6c0b4ca0 0x7f3b6c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b79ffb640 1 -- 172.21.15.53:0/1106898909 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f3b700e54d0 con 0x7f3b7c103930 2024-08-31T06:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b80881640 1 -- 172.21.15.53:0/3895284974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233f4390 msgr2=0x558b237bad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b80881640 1 --2- 172.21.15.53:0/3895284974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233f4390 0x558b237bad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b80881640 1 -- 172.21.15.53:0/3895284974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b23415070 msgr2=0x558b237ba2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b80881640 1 --2- 172.21.15.53:0/3895284974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b23415070 0x558b237ba2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b80881640 1 -- 172.21.15.53:0/3895284974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b23480650 con 0x558b233ec1b0 2024-08-31T06:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b81082640 1 --2- 172.21.15.53:0/3895284974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b23415070 0x558b237ba2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b7bfff640 1 --2- 172.21.15.53:0/3895284974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233f4390 0x558b237bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.602+0000 7f3b80881640 1 --2- 172.21.15.53:0/3895284974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237ba800 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3b700a8e30 tx=0x7f3b70005460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756755d550ccd0e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.603+0000 7f3b81082640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b6c0b4ca0 0x7f3b6c0b71b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3b74005c40 tx=0x7f3b74004ab0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.603+0000 7f3b66ffd640 1 -- 172.21.15.53:0/3895284974 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7001c070 con 0x558b233ec1b0 2024-08-31T06:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.603+0000 7f3b66ffd640 1 -- 172.21.15.53:0/3895284974 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b700ac2c0 con 0x558b233ec1b0 2024-08-31T06:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.603+0000 7f3b66ffd640 1 -- 172.21.15.53:0/3895284974 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70004d50 con 0x558b233ec1b0 2024-08-31T06:06:11.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.604+0000 7f3b8905a740 1 -- 172.21.15.53:0/3895284974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 msgr2=0x558b237ba800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:11.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.604+0000 7f3b8905a740 1 --2- 172.21.15.53:0/3895284974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237ba800 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3b700a8e30 tx=0x7f3b70005460 comp rx=0 tx=0).stop 2024-08-31T06:06:11.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.604+0000 7f3b8905a740 1 -- 172.21.15.53:0/3895284974 shutdown_connections 2024-08-31T06:06:11.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.604+0000 7f3b8905a740 1 --2- 172.21.15.53:0/3895284974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233f4390 0x558b237bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.604+0000 7f3b8905a740 1 --2- 172.21.15.53:0/3895284974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237ba800 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.604+0000 7f3b8905a740 1 --2- 172.21.15.53:0/3895284974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b23415070 0x558b237ba2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.604+0000 7f3b8905a740 1 -- 172.21.15.53:0/3895284974 >> 172.21.15.53:0/3895284974 conn(0x558b23409460 msgr2=0x558b237b81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.604+0000 7f3b8905a740 1 -- 172.21.15.53:0/3895284974 shutdown_connections 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.604+0000 7f3b8905a740 1 -- 172.21.15.53:0/3895284974 wait complete. 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.604+0000 7f3b8905a740 1 -- start start 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.604+0000 7f3b8905a740 1 Processor -- start 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233ec1b0 0x558b237c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 0x558b237c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b23415070 0x558b237d60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b8905a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b23583700 con 0x558b23415070 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b8905a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558b236a7700 con 0x558b233f4390 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b8905a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558b237ccdf0 con 0x558b233ec1b0 2024-08-31T06:06:11.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b8905a740 10 client.0 _ll_register_callbacks cb 0x558b236d6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 0x558b237c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b81082640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b23415070 0x558b237d60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 0x558b237c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:44976/0 (socket says 172.21.15.53:44976) 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b7bfff640 1 -- 172.21.15.53:0/3869213102 learned_addr learned my addr 172.21.15.53:0/3869213102 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b80881640 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233ec1b0 0x558b237c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b7bfff640 1 -- 172.21.15.53:0/3869213102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233ec1b0 msgr2=0x558b237c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b7bfff640 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233ec1b0 0x558b237c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b7bfff640 1 -- 172.21.15.53:0/3869213102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b23415070 msgr2=0x558b237d60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b7bfff640 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b23415070 0x558b237d60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b7bfff640 1 -- 172.21.15.53:0/3869213102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b236e08b0 con 0x558b233f4390 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b81082640 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b23415070 0x558b237d60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.605+0000 7f3b80881640 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233ec1b0 0x558b237c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:06:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.606+0000 7f3b7bfff640 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 0x558b237c5fc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b68005940 tx=0x7f3b68031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89eb499d44b0f765 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.606+0000 7f3b5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.606+0000 7f3b5bfff640 1 -- 172.21.15.53:0/3869213102 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68035040 con 0x558b233f4390 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.606+0000 7f3b5bfff640 1 -- 172.21.15.53:0/3869213102 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f3b68004450 con 0x558b233f4390 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.606+0000 7f3b8905a740 1 -- 172.21.15.53:0/3869213102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b700ac2c0 con 0x558b233f4390 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.606+0000 7f3b5bfff640 1 -- 172.21.15.53:0/3869213102 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b680035f0 con 0x558b233f4390 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.606+0000 7f3b8905a740 10 client.25646 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.606+0000 7f3b8905a740 1 -- 172.21.15.53:0/3869213102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b237d8bd0 con 0x558b233f4390 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.606+0000 7f3b5bfff640 1 -- 172.21.15.53:0/3869213102 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b700ac2c0 con 0x558b233f4390 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.606+0000 7f3b5bfff640 1 -- 172.21.15.53:0/3869213102 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3b68044070 con 0x558b233f4390 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.606+0000 7f3b8905a740 10 client.25646 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.607+0000 7f3b8905a740 10 client.25646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.607+0000 7f3b8905a740 20 client.25646 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.607+0000 7f3b8905a740 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b233d39f0 0x558b237dc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.607+0000 7f3b8905a740 4 client.25646 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.607+0000 7f3b8905a740 1 -- 172.21.15.53:0/3869213102 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b23733580 con 0x558b233d39f0 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.607+0000 7f3b80881640 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b233d39f0 0x558b237dc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.607+0000 7f3b5bfff640 10 client.25646 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.607+0000 7f3b80881640 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b233d39f0 0x558b237dc080 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2862dcc0438abc39 server_cookie=fbf64640db276660 in_seq=0 out_seq=0 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b5bfff640 1 -- 172.21.15.53:0/3869213102 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558b23733580 con 0x558b233d39f0 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b5bfff640 10 client.25646 handle_command_reply: tid=0 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b8905a740 1 client.25646 shutdown 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b8905a740 1 -- 172.21.15.53:0/3869213102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 msgr2=0x558b237c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b8905a740 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 0x558b237c5fc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b68005940 tx=0x7f3b68031630 comp rx=0 tx=0).stop 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b8905a740 1 -- 172.21.15.53:0/3869213102 shutdown_connections 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b8905a740 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b233d39f0 0x558b237dc080 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b8905a740 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b23415070 0x558b237d60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b8905a740 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 0x558b237c5fc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b5bfff640 0 client.25646 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:11.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b8905a740 1 --2- 172.21.15.53:0/3869213102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233ec1b0 0x558b237c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b8905a740 1 -- 172.21.15.53:0/3869213102 >> 172.21.15.53:0/3869213102 conn(0x558b23409460 msgr2=0x558b237bd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:11.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b8905a740 1 -- 172.21.15.53:0/3869213102 shutdown_connections 2024-08-31T06:06:11.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.608+0000 7f3b8905a740 1 -- 172.21.15.53:0/3869213102 wait complete. 2024-08-31T06:06:11.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.609+0000 7f3b8905a740 20 client.25646 trim_cache size 0 max 16384 2024-08-31T06:06:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.627+0000 7f3b8905a740 1 Processor -- start 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.627+0000 7f3b8905a740 1 -- start start 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.627+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.627+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 0x558b237c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b23415070 0x558b237d5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b8905a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1ad1e0 con 0x558b233ec1b0 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b8905a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1aed20 con 0x558b233f4390 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b8905a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1ad8b0 con 0x558b23415070 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b80881640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b80881640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237bbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39180/0 (socket says 172.21.15.53:39180) 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b80881640 1 -- 172.21.15.53:0/2671199366 learned_addr learned my addr 172.21.15.53:0/2671199366 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b7bfff640 1 --2- 172.21.15.53:0/2671199366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 0x558b237c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b81082640 1 --2- 172.21.15.53:0/2671199366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b23415070 0x558b237d5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b80881640 1 -- 172.21.15.53:0/2671199366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b23415070 msgr2=0x558b237d5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b80881640 1 --2- 172.21.15.53:0/2671199366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b23415070 0x558b237d5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b80881640 1 -- 172.21.15.53:0/2671199366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 msgr2=0x558b237c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b80881640 1 --2- 172.21.15.53:0/2671199366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 0x558b237c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b80881640 1 -- 172.21.15.53:0/2671199366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b237c6d40 con 0x558b233ec1b0 2024-08-31T06:06:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b7bfff640 1 --2- 172.21.15.53:0/2671199366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 0x558b237c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b80881640 1 --2- 172.21.15.53:0/2671199366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237bbcb0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000c6a0 tx=0x7f3b700e8d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e969abb48b6fd51 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.628+0000 7f3b667fc640 1 -- 172.21.15.53:0/2671199366 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7001c040 con 0x558b233ec1b0 2024-08-31T06:06:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.629+0000 7f3b667fc640 1 -- 172.21.15.53:0/2671199366 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b700b01e0 con 0x558b233ec1b0 2024-08-31T06:06:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.629+0000 7f3b667fc640 1 -- 172.21.15.53:0/2671199366 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b700e2ea0 con 0x558b233ec1b0 2024-08-31T06:06:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.629+0000 7f3b8905a740 1 -- 172.21.15.53:0/2671199366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 msgr2=0x558b237bbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.629+0000 7f3b8905a740 1 --2- 172.21.15.53:0/2671199366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237bbcb0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000c6a0 tx=0x7f3b700e8d50 comp rx=0 tx=0).stop 2024-08-31T06:06:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.630+0000 7f3b8905a740 1 -- 172.21.15.53:0/2671199366 shutdown_connections 2024-08-31T06:06:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.630+0000 7f3b8905a740 1 --2- 172.21.15.53:0/2671199366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b23415070 0x558b237d5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.630+0000 7f3b8905a740 1 --2- 172.21.15.53:0/2671199366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b233f4390 0x558b237c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.630+0000 7f3b8905a740 1 --2- 172.21.15.53:0/2671199366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237bbcb0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.630+0000 7f3b8905a740 1 -- 172.21.15.53:0/2671199366 >> 172.21.15.53:0/2671199366 conn(0x558b23409460 msgr2=0x558b237c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.630+0000 7f3b8905a740 1 -- 172.21.15.53:0/2671199366 shutdown_connections 2024-08-31T06:06:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.630+0000 7f3b8905a740 1 -- 172.21.15.53:0/2671199366 wait complete. 2024-08-31T06:06:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.630+0000 7f3b8905a740 1 -- start start 2024-08-31T06:06:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.630+0000 7f3b8905a740 1 Processor -- start 2024-08-31T06:06:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233f4390 0x558b237d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b8905a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b23415070 0x558b23845a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b8905a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1ae650 con 0x558b233ec1b0 2024-08-31T06:06:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b8905a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1adf80 con 0x558b23415070 2024-08-31T06:06:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b8905a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c1ab1c0 con 0x558b233f4390 2024-08-31T06:06:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b8905a740 10 client.0 _ll_register_callbacks cb 0x7f3b68009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b80881640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b80881640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39190/0 (socket says 172.21.15.53:39190) 2024-08-31T06:06:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b80881640 1 -- 172.21.15.53:0/2704795718 learned_addr learned my addr 172.21.15.53:0/2704795718 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b81082640 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b23415070 0x558b23845a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.631+0000 7f3b7bfff640 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233f4390 0x558b237d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b80881640 1 -- 172.21.15.53:0/2704795718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233f4390 msgr2=0x558b237d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b80881640 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233f4390 0x558b237d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b80881640 1 -- 172.21.15.53:0/2704795718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b23415070 msgr2=0x558b23845a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b80881640 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b23415070 0x558b23845a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b80881640 1 -- 172.21.15.53:0/2704795718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b23846090 con 0x558b233ec1b0 2024-08-31T06:06:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b80881640 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237d08c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3b700ab680 tx=0x7f3b700b0430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca2fda06eeb4dd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b5bfff640 1 -- 172.21.15.53:0/2704795718 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7001c040 con 0x558b233ec1b0 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b5bfff640 1 -- 172.21.15.53:0/2704795718 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f3b700e2ea0 con 0x558b233ec1b0 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b8905a740 1 -- 172.21.15.53:0/2704795718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b700b01e0 con 0x558b233ec1b0 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b5bfff640 1 -- 172.21.15.53:0/2704795718 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b700ac2c0 con 0x558b233ec1b0 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b8905a740 10 client.16212 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.632+0000 7f3b8905a740 1 -- 172.21.15.53:0/2704795718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b23847320 con 0x558b233ec1b0 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.633+0000 7f3b5bfff640 1 -- 172.21.15.53:0/2704795718 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b700b01e0 con 0x558b233ec1b0 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.633+0000 7f3b5bfff640 1 -- 172.21.15.53:0/2704795718 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3b700a7e50 con 0x558b233ec1b0 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.633+0000 7f3b8905a740 10 client.16212 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.633+0000 7f3b8905a740 10 client.16212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.633+0000 7f3b8905a740 20 client.16212 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.633+0000 7f3b8905a740 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b233a8da0 0x558b238496b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.633+0000 7f3b8905a740 4 client.16212 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:06:11.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.633+0000 7f3b8905a740 1 -- 172.21.15.53:0/2704795718 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558b2372f020 con 0x558b233a8da0 2024-08-31T06:06:11.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.633+0000 7f3b7bfff640 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b233a8da0 0x558b238496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b5bfff640 10 client.16212 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b7bfff640 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b233a8da0 0x558b238496b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d89a6e50a31ac516 server_cookie=35c0b2ce2533d3fb in_seq=0 out_seq=0 2024-08-31T06:06:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b5bfff640 1 -- 172.21.15.53:0/2704795718 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x558b2372f020 con 0x558b233a8da0 2024-08-31T06:06:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b5bfff640 10 client.16212 handle_command_reply: tid=0 2024-08-31T06:06:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b8905a740 1 client.16212 shutdown 2024-08-31T06:06:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b8905a740 1 -- 172.21.15.53:0/2704795718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 msgr2=0x558b237d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b8905a740 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237d08c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3b700ab680 tx=0x7f3b700b0430 comp rx=0 tx=0).stop 2024-08-31T06:06:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b8905a740 1 -- 172.21.15.53:0/2704795718 shutdown_connections 2024-08-31T06:06:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b8905a740 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558b233a8da0 0x558b238496b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b8905a740 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b23415070 0x558b23845a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b8905a740 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b233f4390 0x558b237d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b8905a740 1 --2- 172.21.15.53:0/2704795718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b233ec1b0 0x558b237d08c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b5bfff640 0 client.16212 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.634+0000 7f3b8905a740 1 -- 172.21.15.53:0/2704795718 >> 172.21.15.53:0/2704795718 conn(0x558b23409460 msgr2=0x558b237c78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.635+0000 7f3b8905a740 1 -- 172.21.15.53:0/2704795718 shutdown_connections 2024-08-31T06:06:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.635+0000 7f3b8905a740 1 -- 172.21.15.53:0/2704795718 wait complete. 2024-08-31T06:06:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.635+0000 7f3b8905a740 20 client.16212 trim_cache size 0 max 16384 2024-08-31T06:06:11.641 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:06:11.641 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "b0975b60-4943-46fa-8c34-072ffbab94be", 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:06:11.642 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:06:11.643 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:06:11.643 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:06:11.643 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:06:11.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:06:11.643 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:06:11.643 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:06:11.643 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:06:11.643 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:06:11.643 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:06:11.644 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:06:11.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 -- 172.21.15.53:0/1106898909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b6c0b4ca0 msgr2=0x7f3b6c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:11.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b6c0b4ca0 0x7f3b6c0b71b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3b74005c40 tx=0x7f3b74004ab0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 -- 172.21.15.53:0/1106898909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b7c103930 msgr2=0x7f3b7c19a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:11.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b7c103930 0x7f3b7c19a160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000e9f0 tx=0x7f3b7000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 -- 172.21.15.53:0/1106898909 shutdown_connections 2024-08-31T06:06:11.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b6c0b4ca0 0x7f3b6c0b71b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b7c109bc0 0x7f3b7c19f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b7c109270 0x7f3b7c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 --2- 172.21.15.53:0/1106898909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b7c103930 0x7f3b7c19a160 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:11.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 -- 172.21.15.53:0/1106898909 >> 172.21.15.53:0/1106898909 conn(0x7f3b7c0ff3a0 msgr2=0x7f3b7c1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:11.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 -- 172.21.15.53:0/1106898909 shutdown_connections 2024-08-31T06:06:11.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:11.636+0000 7f3b82ae5640 1 -- 172.21.15.53:0/1106898909 wait complete. 2024-08-31T06:06:11.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:11 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:06:11.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:11 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:06:11.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:11 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:06:11.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:11 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:06:11.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:11 smithi053 ceph-mon[18924]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-08-31T06:06:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:11 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:06:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:11 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:06:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:11 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:06:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:11 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:06:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:11 smithi130 ceph-mon[22266]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-08-31T06:06:11.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:11 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:06:11.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:11 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:06:11.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:11 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:06:11.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:11 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:06:11.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:11 smithi153 ceph-mon[22320]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-08-31T06:06:11.959 INFO:tasks.workunit.client.0.smithi053.stdout: 1 856 21.58 MB/sec warmup 1 sec latency 37.220 ms 2024-08-31T06:06:12.200 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c58aada1', total seconds elapsed: 31.0 2024-08-31T06:06:12.959 INFO:tasks.workunit.client.0.smithi053.stdout: 1 1526 13.05 MB/sec warmup 2 sec latency 14.084 ms 2024-08-31T06:06:13.423 INFO:tasks.cephfs.filesystem:scrub status for tag:b0975b60-4943-46fa-8c34-072ffbab94be - {'path': '/', 'tag': 'b0975b60-4943-46fa-8c34-072ffbab94be', 'options': 'recursive,force'} 2024-08-31T06:06:13.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:13 smithi053 ceph-mon[18924]: pgmap v361: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 339 KiB/s wr, 25 op/s 2024-08-31T06:06:13.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:13 smithi130 ceph-mon[22266]: pgmap v361: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 339 KiB/s wr, 25 op/s 2024-08-31T06:06:13.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:13 smithi153 ceph-mon[22320]: pgmap v361: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 339 KiB/s wr, 25 op/s 2024-08-31T06:06:13.959 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2273 9.07 MB/sec warmup 3 sec latency 38.888 ms 2024-08-31T06:06:14.959 INFO:tasks.workunit.client.0.smithi053.stdout: 1 2994 8.38 MB/sec warmup 4 sec latency 15.461 ms 2024-08-31T06:06:15.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:15 smithi053 ceph-mon[18924]: pgmap v362: 97 pgs: 97 active+clean; 12 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 988 KiB/s wr, 42 op/s 2024-08-31T06:06:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:15 smithi130 ceph-mon[22266]: pgmap v362: 97 pgs: 97 active+clean; 12 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 988 KiB/s wr, 42 op/s 2024-08-31T06:06:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:15 smithi153 ceph-mon[22320]: pgmap v362: 97 pgs: 97 active+clean; 12 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 988 KiB/s wr, 42 op/s 2024-08-31T06:06:15.959 INFO:tasks.workunit.client.0.smithi053.stdout: 1 3627 7.72 MB/sec warmup 5 sec latency 49.597 ms 2024-08-31T06:06:16.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:16 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:06:16.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:16 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:06:16.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:16 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:06:16.959 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4060 6.68 MB/sec warmup 6 sec latency 14.086 ms 2024-08-31T06:06:17.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:17 smithi053 ceph-mon[18924]: pgmap v363: 97 pgs: 97 active+clean; 24 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.0 MiB/s wr, 37 op/s 2024-08-31T06:06:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:17 smithi130 ceph-mon[22266]: pgmap v363: 97 pgs: 97 active+clean; 24 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.0 MiB/s wr, 37 op/s 2024-08-31T06:06:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:17 smithi153 ceph-mon[22320]: pgmap v363: 97 pgs: 97 active+clean; 24 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.0 MiB/s wr, 37 op/s 2024-08-31T06:06:17.959 INFO:tasks.workunit.client.0.smithi053.stdout: 1 4668 6.01 MB/sec warmup 7 sec latency 17.934 ms 2024-08-31T06:06:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.002+0000 7f673e426640 1 -- 172.21.15.53:0/211271251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6738102750 msgr2=0x7f6738102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.002+0000 7f673e426640 1 --2- 172.21.15.53:0/211271251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6738102750 0x7f6738102b60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6728009900 tx=0x7f672802a410 comp rx=0 tx=0).stop 2024-08-31T06:06:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.002+0000 7f673e426640 1 -- 172.21.15.53:0/211271251 shutdown_connections 2024-08-31T06:06:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.003+0000 7f673e426640 1 --2- 172.21.15.53:0/211271251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67381089d0 0x7f673810f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.003+0000 7f673e426640 1 --2- 172.21.15.53:0/211271251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6738108080 0x7f6738108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.003+0000 7f673e426640 1 --2- 172.21.15.53:0/211271251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6738102750 0x7f6738102b60 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.003+0000 7f673e426640 1 -- 172.21.15.53:0/211271251 >> 172.21.15.53:0/211271251 conn(0x7f673807a4e0 msgr2=0x7f673807a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.003+0000 7f673e426640 1 -- 172.21.15.53:0/211271251 shutdown_connections 2024-08-31T06:06:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.003+0000 7f673e426640 1 -- 172.21.15.53:0/211271251 wait complete. 2024-08-31T06:06:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.003+0000 7f673e426640 1 Processor -- start 2024-08-31T06:06:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.003+0000 7f673e426640 1 -- start start 2024-08-31T06:06:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f673e426640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6738102750 0x7f673819af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f673e426640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6738108080 0x7f673819b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f673e426640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67381089d0 0x7f673819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f673e426640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6738112550 con 0x7f6738102750 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f673e426640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67381123d0 con 0x7f6738108080 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f673e426640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67381126d0 con 0x7f67381089d0 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f6737fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6738102750 0x7f673819af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f6737fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6738102750 0x7f673819af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35918/0 (socket says 172.21.15.53:35918) 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f6737fff640 1 -- 172.21.15.53:0/1990282304 learned_addr learned my addr 172.21.15.53:0/1990282304 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f67377fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6738108080 0x7f673819b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f673c9c3640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67381089d0 0x7f673819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f6737fff640 1 -- 172.21.15.53:0/1990282304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67381089d0 msgr2=0x7f673819ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f6737fff640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67381089d0 0x7f673819ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f6737fff640 1 -- 172.21.15.53:0/1990282304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6738108080 msgr2=0x7f673819b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f6737fff640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6738108080 0x7f673819b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f6737fff640 1 -- 172.21.15.53:0/1990282304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67381a6210 con 0x7f6738102750 2024-08-31T06:06:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.004+0000 7f673c9c3640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67381089d0 0x7f673819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:06:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.005+0000 7f6737fff640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6738102750 0x7f673819af80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6728009230 tx=0x7f67280319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.005+0000 7f67357fa640 1 -- 172.21.15.53:0/1990282304 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672803f030 con 0x7f6738102750 2024-08-31T06:06:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.005+0000 7f67357fa640 1 -- 172.21.15.53:0/1990282304 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67280043d0 con 0x7f6738102750 2024-08-31T06:06:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.005+0000 7f673e426640 1 -- 172.21.15.53:0/1990282304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67381a64a0 con 0x7f6738102750 2024-08-31T06:06:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.005+0000 7f67357fa640 1 -- 172.21.15.53:0/1990282304 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728035070 con 0x7f6738102750 2024-08-31T06:06:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.005+0000 7f673e426640 1 -- 172.21.15.53:0/1990282304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67381a6990 con 0x7f6738102750 2024-08-31T06:06:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.008+0000 7f67357fa640 1 -- 172.21.15.53:0/1990282304 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6728042030 con 0x7f6738102750 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.008+0000 7f6745465740 1 Processor -- start 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.008+0000 7f6745465740 1 -- start start 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f6745465740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 0x5609f5793ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f6745465740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f5794000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f6745465740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 0x5609f5794540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f6745465740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5609f5709000 con 0x5609f53c72f0 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f6745465740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5609f56f8590 con 0x5609f53cf4d0 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f6745465740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5609f56fc540 con 0x5609f53f01b0 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f67357fa640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67200b4ca0 0x7f67200b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f6737fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f5794000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f67377fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 0x5609f5794540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f673c9c3640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67200b4ca0 0x7f67200b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f67377fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 0x5609f5794540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:35942/0 (socket says 172.21.15.53:35942) 2024-08-31T06:06:18.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f67377fe640 1 -- 172.21.15.53:0/2965989794 learned_addr learned my addr 172.21.15.53:0/2965989794 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:18.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f673c9c3640 1 --2- 172.21.15.53:0/2965989794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 0x5609f5793ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.009+0000 7f67357fa640 1 -- 172.21.15.53:0/1990282304 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f67281059c0 con 0x7f6738102750 2024-08-31T06:06:18.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.010+0000 7f6737fff640 1 -- 172.21.15.53:0/2965989794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 msgr2=0x5609f5793ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:18.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.010+0000 7f6737fff640 1 --2- 172.21.15.53:0/2965989794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 0x5609f5793ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.010+0000 7f6737fff640 1 -- 172.21.15.53:0/2965989794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 msgr2=0x5609f5794540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:18.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.010+0000 7f6737fff640 1 --2- 172.21.15.53:0/2965989794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 0x5609f5794540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.010+0000 7f6737fff640 1 -- 172.21.15.53:0/2965989794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609f545b790 con 0x5609f53c72f0 2024-08-31T06:06:18.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.010+0000 7f67377fe640 1 --2- 172.21.15.53:0/2965989794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 0x5609f5794540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:18.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.010+0000 7f673c9c3640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67200b4ca0 0x7f67200b71b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6730009810 tx=0x7f6730009e40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:18.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.010+0000 7f6737fff640 1 --2- 172.21.15.53:0/2965989794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f5794000 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6728103110 tx=0x7f6728096150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6e7bdc1f541252 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:18.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.010+0000 7f671e7fc640 1 -- 172.21.15.53:0/2965989794 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67280cbbc0 con 0x5609f53c72f0 2024-08-31T06:06:18.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.010+0000 7f671e7fc640 1 -- 172.21.15.53:0/2965989794 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67280cc7b0 con 0x5609f53c72f0 2024-08-31T06:06:18.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.010+0000 7f671e7fc640 1 -- 172.21.15.53:0/2965989794 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67280c8340 con 0x5609f53c72f0 2024-08-31T06:06:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.011+0000 7f6745465740 1 -- 172.21.15.53:0/2965989794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 msgr2=0x5609f5794000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.011+0000 7f6745465740 1 --2- 172.21.15.53:0/2965989794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f5794000 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6728103110 tx=0x7f6728096150 comp rx=0 tx=0).stop 2024-08-31T06:06:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.011+0000 7f6745465740 1 -- 172.21.15.53:0/2965989794 shutdown_connections 2024-08-31T06:06:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.011+0000 7f6745465740 1 --2- 172.21.15.53:0/2965989794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 0x5609f5794540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.011+0000 7f6745465740 1 --2- 172.21.15.53:0/2965989794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f5794000 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.011+0000 7f6745465740 1 --2- 172.21.15.53:0/2965989794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 0x5609f5793ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.011+0000 7f6745465740 1 -- 172.21.15.53:0/2965989794 >> 172.21.15.53:0/2965989794 conn(0x5609f53e4300 msgr2=0x5609f57919b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.011+0000 7f6745465740 1 -- 172.21.15.53:0/2965989794 shutdown_connections 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.011+0000 7f6745465740 1 -- 172.21.15.53:0/2965989794 wait complete. 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6745465740 1 -- start start 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6745465740 1 Processor -- start 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6745465740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6745465740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 0x5609f57a3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6745465740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 0x5609f57af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6745465740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5609f5631ab0 con 0x5609f53c72f0 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6745465740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5609f567f680 con 0x5609f53cf4d0 2024-08-31T06:06:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6745465740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5609f5709000 con 0x5609f53f01b0 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6745465740 10 client.0 _ll_register_callbacks cb 0x5609f5407a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6737fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6737fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57a3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35938/0 (socket says 172.21.15.53:35938) 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f6737fff640 1 -- 172.21.15.53:0/3030828686 learned_addr learned my addr 172.21.15.53:0/3030828686 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.012+0000 7f67377fe640 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 0x5609f57a3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f673c9c3640 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 0x5609f57af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f6737fff640 1 -- 172.21.15.53:0/3030828686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 msgr2=0x5609f57af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f6737fff640 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 0x5609f57af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f6737fff640 1 -- 172.21.15.53:0/3030828686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 msgr2=0x5609f57a3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f6737fff640 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 0x5609f57a3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f6737fff640 1 -- 172.21.15.53:0/3030828686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609f54d4620 con 0x5609f53c72f0 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f6737fff640 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57a3ab0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6728103710 tx=0x7f67280cb920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d954b9652d62c97 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f67177fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f67177fe640 1 -- 172.21.15.53:0/3030828686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67280cbbc0 con 0x5609f53c72f0 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f67177fe640 1 -- 172.21.15.53:0/3030828686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f672808f1b0 con 0x5609f53c72f0 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f6745465740 1 -- 172.21.15.53:0/3030828686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67280cc7b0 con 0x5609f53c72f0 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f67177fe640 1 -- 172.21.15.53:0/3030828686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f67280cc0b0 con 0x5609f53c72f0 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f6745465740 10 client.16224 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.013+0000 7f6745465740 1 -- 172.21.15.53:0/3030828686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5609f57b22e0 con 0x5609f53c72f0 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.014+0000 7f67177fe640 1 -- 172.21.15.53:0/3030828686 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67280cc7b0 con 0x5609f53c72f0 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.014+0000 7f67177fe640 1 -- 172.21.15.53:0/3030828686 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f67280d4f40 con 0x5609f53c72f0 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.014+0000 7f6745465740 10 client.16224 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.014+0000 7f6745465740 10 client.16224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.014+0000 7f6745465740 20 client.16224 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.014+0000 7f6745465740 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5609f53aed80 0x5609f57b5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.014+0000 7f6745465740 4 client.16224 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.014+0000 7f6745465740 1 -- 172.21.15.53:0/3030828686 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609f570af50 con 0x5609f53aed80 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.014+0000 7f67377fe640 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5609f53aed80 0x5609f57b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.015+0000 7f67177fe640 10 client.16224 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.015+0000 7f67377fe640 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5609f53aed80 0x5609f57b5640 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55b9f0d56dfe3cbf server_cookie=e3114da0fdbd8e97 in_seq=0 out_seq=0 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f67177fe640 1 -- 172.21.15.53:0/3030828686 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609f570af50 con 0x5609f53aed80 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f67177fe640 10 client.16224 handle_command_reply: tid=0 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 1 client.16224 shutdown 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 1 -- 172.21.15.53:0/3030828686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 msgr2=0x5609f57a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57a3ab0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6728103710 tx=0x7f67280cb920 comp rx=0 tx=0).stop 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 1 -- 172.21.15.53:0/3030828686 shutdown_connections 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5609f53aed80 0x5609f57b5640 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 0x5609f57af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53cf4d0 0x5609f57a3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f67177fe640 0 client.16224 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:18.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 1 --2- 172.21.15.53:0/3030828686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57a3ab0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 1 -- 172.21.15.53:0/3030828686 >> 172.21.15.53:0/3030828686 conn(0x5609f53e4300 msgr2=0x5609f578fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:18.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 1 -- 172.21.15.53:0/3030828686 shutdown_connections 2024-08-31T06:06:18.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 1 -- 172.21.15.53:0/3030828686 wait complete. 2024-08-31T06:06:18.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.016+0000 7f6745465740 20 client.16224 trim_cache size 0 max 16384 2024-08-31T06:06:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.033+0000 7f6745465740 1 Processor -- start 2024-08-31T06:06:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.033+0000 7f6745465740 1 -- start start 2024-08-31T06:06:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.033+0000 7f6745465740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.033+0000 7f6745465740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53cf4d0 0x5609f57a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.033+0000 7f6745465740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53f01b0 0x5609f57a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.033+0000 7f6745465740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f67381ad220 con 0x5609f53c72f0 2024-08-31T06:06:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.033+0000 7f6745465740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67381aed60 con 0x5609f53f01b0 2024-08-31T06:06:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.033+0000 7f6745465740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67381ad8f0 con 0x5609f53cf4d0 2024-08-31T06:06:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.033+0000 7f6737fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.033+0000 7f6737fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35950/0 (socket says 172.21.15.53:35950) 2024-08-31T06:06:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.033+0000 7f6737fff640 1 -- 172.21.15.53:0/1103252410 learned_addr learned my addr 172.21.15.53:0/1103252410 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.034+0000 7f673c9c3640 1 --2- 172.21.15.53:0/1103252410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53f01b0 0x5609f57a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.034+0000 7f67377fe640 1 --2- 172.21.15.53:0/1103252410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53cf4d0 0x5609f57a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.034+0000 7f6737fff640 1 -- 172.21.15.53:0/1103252410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53cf4d0 msgr2=0x5609f57a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.034+0000 7f6737fff640 1 --2- 172.21.15.53:0/1103252410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53cf4d0 0x5609f57a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.034+0000 7f6737fff640 1 -- 172.21.15.53:0/1103252410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53f01b0 msgr2=0x5609f57a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.034+0000 7f6737fff640 1 --2- 172.21.15.53:0/1103252410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53f01b0 0x5609f57a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.034+0000 7f6737fff640 1 -- 172.21.15.53:0/1103252410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609f57a6250 con 0x5609f53c72f0 2024-08-31T06:06:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.034+0000 7f6737fff640 1 --2- 172.21.15.53:0/1103252410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57af490 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f67280c8130 tx=0x7f6728004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b14ebc388b18e71 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.034+0000 7f671dffb640 1 -- 172.21.15.53:0/1103252410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672808e020 con 0x5609f53c72f0 2024-08-31T06:06:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.034+0000 7f671dffb640 1 -- 172.21.15.53:0/1103252410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67280cbbc0 con 0x5609f53c72f0 2024-08-31T06:06:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.034+0000 7f671dffb640 1 -- 172.21.15.53:0/1103252410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67280d0920 con 0x5609f53c72f0 2024-08-31T06:06:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.035+0000 7f6745465740 1 -- 172.21.15.53:0/1103252410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 msgr2=0x5609f57af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:18.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.035+0000 7f6745465740 1 --2- 172.21.15.53:0/1103252410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57af490 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f67280c8130 tx=0x7f6728004580 comp rx=0 tx=0).stop 2024-08-31T06:06:18.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.035+0000 7f6745465740 1 -- 172.21.15.53:0/1103252410 shutdown_connections 2024-08-31T06:06:18.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.035+0000 7f6745465740 1 --2- 172.21.15.53:0/1103252410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53f01b0 0x5609f57a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.035+0000 7f6745465740 1 --2- 172.21.15.53:0/1103252410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53cf4d0 0x5609f57a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.035+0000 7f6745465740 1 --2- 172.21.15.53:0/1103252410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53c72f0 0x5609f57af490 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.035+0000 7f6745465740 1 -- 172.21.15.53:0/1103252410 >> 172.21.15.53:0/1103252410 conn(0x5609f53e4300 msgr2=0x5609f57a4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:18.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.035+0000 7f6745465740 1 -- 172.21.15.53:0/1103252410 shutdown_connections 2024-08-31T06:06:18.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.035+0000 7f6745465740 1 -- 172.21.15.53:0/1103252410 wait complete. 2024-08-31T06:06:18.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.035+0000 7f6745465740 1 -- start start 2024-08-31T06:06:18.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f6745465740 1 Processor -- start 2024-08-31T06:06:18.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f6745465740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53c72f0 0x5609f57abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f6745465740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53cf4d0 0x5609f57a7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f6745465740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 0x5609f57a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f6745465740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f67381ae690 con 0x5609f53cf4d0 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f6745465740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67381adfc0 con 0x5609f53c72f0 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f6745465740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67381ab200 con 0x5609f53f01b0 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f6745465740 10 client.0 _ll_register_callbacks cb 0x7f672c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f67377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53cf4d0 0x5609f57a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f67377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53cf4d0 0x5609f57a7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35962/0 (socket says 172.21.15.53:35962) 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f67377fe640 1 -- 172.21.15.53:0/3121756032 learned_addr learned my addr 172.21.15.53:0/3121756032 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f67377fe640 1 -- 172.21.15.53:0/3121756032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 msgr2=0x5609f57a7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.036+0000 7f67377fe640 1 --2- 172.21.15.53:0/3121756032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 0x5609f57a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f67377fe640 1 -- 172.21.15.53:0/3121756032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53c72f0 msgr2=0x5609f57abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f67377fe640 1 --2- 172.21.15.53:0/3121756032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53c72f0 0x5609f57abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f67377fe640 1 -- 172.21.15.53:0/3121756032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609f57948b0 con 0x5609f53cf4d0 2024-08-31T06:06:18.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f67377fe640 1 --2- 172.21.15.53:0/3121756032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53cf4d0 0x5609f57a7420 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f672c009d10 tx=0x7f672c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775f85d4e31a7143 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f67177fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f67177fe640 1 -- 172.21.15.53:0/3121756032 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c029060 con 0x5609f53cf4d0 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f67177fe640 1 -- 172.21.15.53:0/3121756032 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f672c010630 con 0x5609f53cf4d0 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f6745465740 1 -- 172.21.15.53:0/3121756032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67280cbbc0 con 0x5609f53cf4d0 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f67177fe640 1 -- 172.21.15.53:0/3121756032 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f672c005020 con 0x5609f53cf4d0 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f6745465740 10 client.16230 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f6745465740 1 -- 172.21.15.53:0/3121756032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5609f581fee0 con 0x5609f53cf4d0 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.037+0000 7f67177fe640 1 -- 172.21.15.53:0/3121756032 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67280cbbc0 con 0x5609f53cf4d0 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.038+0000 7f67177fe640 1 -- 172.21.15.53:0/3121756032 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f672c023030 con 0x5609f53cf4d0 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.038+0000 7f6745465740 10 client.16230 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.038+0000 7f6745465740 10 client.16230 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.038+0000 7f6745465740 20 client.16230 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.038+0000 7f6745465740 1 --2- 172.21.15.53:0/3121756032 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5609f53841c0 0x5609f5822650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.038+0000 7f6745465740 4 client.16230 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:06:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.038+0000 7f6745465740 1 -- 172.21.15.53:0/3121756032 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5609f57069f0 con 0x5609f53841c0 2024-08-31T06:06:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.038+0000 7f6737fff640 1 --2- 172.21.15.53:0/3121756032 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5609f53841c0 0x5609f5822650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.038+0000 7f67177fe640 10 client.16230 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.038+0000 7f6737fff640 1 --2- 172.21.15.53:0/3121756032 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5609f53841c0 0x5609f5822650 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60b6166f221ef488 server_cookie=b76effb852f41e2e in_seq=0 out_seq=0 2024-08-31T06:06:18.083 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f67177fe640 1 -- 172.21.15.53:0/3121756032 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5609f57069f0 con 0x5609f53841c0 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f67177fe640 10 client.16230 handle_command_reply: tid=0 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f6745465740 1 client.16230 shutdown 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f6745465740 1 -- 172.21.15.53:0/3121756032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53cf4d0 msgr2=0x5609f57a7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f6745465740 1 --2- 172.21.15.53:0/3121756032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53cf4d0 0x5609f57a7420 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f672c009d10 tx=0x7f672c0099e0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f6745465740 1 -- 172.21.15.53:0/3121756032 shutdown_connections 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f6745465740 1 --2- 172.21.15.53:0/3121756032 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5609f53841c0 0x5609f5822650 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f6745465740 1 --2- 172.21.15.53:0/3121756032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5609f53f01b0 0x5609f57a7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f6745465740 1 --2- 172.21.15.53:0/3121756032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5609f53cf4d0 0x5609f57a7420 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f67177fe640 0 client.16230 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f6745465740 1 --2- 172.21.15.53:0/3121756032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5609f53c72f0 0x5609f57abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.080+0000 7f6745465740 1 -- 172.21.15.53:0/3121756032 >> 172.21.15.53:0/3121756032 conn(0x5609f53e4300 msgr2=0x5609f5794a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:18.084 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f6745465740 1 -- 172.21.15.53:0/3121756032 shutdown_connections 2024-08-31T06:06:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f6745465740 1 -- 172.21.15.53:0/3121756032 wait complete. 2024-08-31T06:06:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f6745465740 20 client.16230 trim_cache size 0 max 16384 2024-08-31T06:06:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:06:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:06:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:06:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:06:18.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 -- 172.21.15.53:0/1990282304 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67200b4ca0 msgr2=0x7f67200b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:18.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67200b4ca0 0x7f67200b71b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6730009810 tx=0x7f6730009e40 comp rx=0 tx=0).stop 2024-08-31T06:06:18.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 -- 172.21.15.53:0/1990282304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6738102750 msgr2=0x7f673819af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:18.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6738102750 0x7f673819af80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6728009230 tx=0x7f67280319a0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 -- 172.21.15.53:0/1990282304 shutdown_connections 2024-08-31T06:06:18.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67200b4ca0 0x7f67200b71b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67381089d0 0x7f673819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6738108080 0x7f673819b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 --2- 172.21.15.53:0/1990282304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6738102750 0x7f673819af80 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 -- 172.21.15.53:0/1990282304 >> 172.21.15.53:0/1990282304 conn(0x7f673807a4e0 msgr2=0x7f6738106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 -- 172.21.15.53:0/1990282304 shutdown_connections 2024-08-31T06:06:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:18.081+0000 7f673e426640 1 -- 172.21.15.53:0/1990282304 wait complete. 2024-08-31T06:06:18.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 5371 5.68 MB/sec warmup 8 sec latency 17.420 ms 2024-08-31T06:06:19.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:19 smithi053 ceph-mon[18924]: pgmap v364: 97 pgs: 97 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 2.3 MiB/s wr, 62 op/s 2024-08-31T06:06:19.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:19 smithi130 ceph-mon[22266]: pgmap v364: 97 pgs: 97 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 2.3 MiB/s wr, 62 op/s 2024-08-31T06:06:19.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:19 smithi153 ceph-mon[22320]: pgmap v364: 97 pgs: 97 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 2.3 MiB/s wr, 62 op/s 2024-08-31T06:06:19.959 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6008 5.25 MB/sec warmup 9 sec latency 16.138 ms 2024-08-31T06:06:20.959 INFO:tasks.workunit.client.0.smithi053.stdout: 1 6858 5.45 MB/sec warmup 10 sec latency 14.581 ms 2024-08-31T06:06:21.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:21 smithi053 ceph-mon[18924]: pgmap v365: 97 pgs: 97 active+clean; 25 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 2.6 MiB/s wr, 85 op/s 2024-08-31T06:06:21.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:21 smithi130 ceph-mon[22266]: pgmap v365: 97 pgs: 97 active+clean; 25 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 2.6 MiB/s wr, 85 op/s 2024-08-31T06:06:21.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:21 smithi153 ceph-mon[22320]: pgmap v365: 97 pgs: 97 active+clean; 25 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 2.6 MiB/s wr, 85 op/s 2024-08-31T06:06:21.959 INFO:tasks.workunit.client.0.smithi053.stdout: 1 7384 5.35 MB/sec warmup 11 sec latency 11.905 ms 2024-08-31T06:06:22.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 7818 4.95 MB/sec warmup 12 sec latency 18.665 ms 2024-08-31T06:06:23.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:23 smithi053 ceph-mon[18924]: pgmap v366: 97 pgs: 97 active+clean; 25 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 2.7 MiB/s wr, 100 op/s 2024-08-31T06:06:23.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:23 smithi130 ceph-mon[22266]: pgmap v366: 97 pgs: 97 active+clean; 25 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 2.7 MiB/s wr, 100 op/s 2024-08-31T06:06:23.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:23 smithi153 ceph-mon[22320]: pgmap v366: 97 pgs: 97 active+clean; 25 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 2.7 MiB/s wr, 100 op/s 2024-08-31T06:06:23.959 INFO:tasks.workunit.client.0.smithi053.stdout: 1 8512 4.94 MB/sec warmup 13 sec latency 12.207 ms 2024-08-31T06:06:24.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 9244 4.64 MB/sec warmup 14 sec latency 13.672 ms 2024-08-31T06:06:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:25 smithi130 ceph-mon[22266]: pgmap v367: 97 pgs: 97 active+clean; 27 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 2.7 MiB/s wr, 123 op/s 2024-08-31T06:06:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:25 smithi153 ceph-mon[22320]: pgmap v367: 97 pgs: 97 active+clean; 27 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 2.7 MiB/s wr, 123 op/s 2024-08-31T06:06:25.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 10001 4.74 MB/sec warmup 15 sec latency 14.603 ms 2024-08-31T06:06:25.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:25 smithi053 ceph-mon[18924]: pgmap v367: 97 pgs: 97 active+clean; 27 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 2.7 MiB/s wr, 123 op/s 2024-08-31T06:06:26.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 10604 4.79 MB/sec warmup 16 sec latency 16.141 ms 2024-08-31T06:06:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:27 smithi130 ceph-mon[22266]: pgmap v368: 97 pgs: 97 active+clean; 27 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 2.4 MiB/s wr, 118 op/s 2024-08-31T06:06:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:27 smithi153 ceph-mon[22320]: pgmap v368: 97 pgs: 97 active+clean; 27 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 2.4 MiB/s wr, 118 op/s 2024-08-31T06:06:27.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 11095 4.61 MB/sec warmup 17 sec latency 14.079 ms 2024-08-31T06:06:27.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:27 smithi053 ceph-mon[18924]: pgmap v368: 97 pgs: 97 active+clean; 27 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 2.4 MiB/s wr, 118 op/s 2024-08-31T06:06:28.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 11685 4.46 MB/sec warmup 18 sec latency 19.001 ms 2024-08-31T06:06:29.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:29 smithi130 ceph-mon[22266]: pgmap v369: 97 pgs: 97 active+clean; 29 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 1.6 MiB/s wr, 122 op/s 2024-08-31T06:06:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:29 smithi153 ceph-mon[22320]: pgmap v369: 97 pgs: 97 active+clean; 29 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 1.6 MiB/s wr, 122 op/s 2024-08-31T06:06:29.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 12362 4.40 MB/sec warmup 19 sec latency 18.815 ms 2024-08-31T06:06:29.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:29 smithi053 ceph-mon[18924]: pgmap v369: 97 pgs: 97 active+clean; 29 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 1.6 MiB/s wr, 122 op/s 2024-08-31T06:06:30.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 13082 4.27 MB/sec warmup 20 sec latency 16.832 ms 2024-08-31T06:06:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.184+0000 7f208bc3f640 1 -- 172.21.15.53:0/3250516099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2084109b10 msgr2=0x7f2084110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.184+0000 7f208bc3f640 1 --2- 172.21.15.53:0/3250516099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2084109b10 0x7f2084110340 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f207c009ca0 tx=0x7f207c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.184+0000 7f208bc3f640 1 -- 172.21.15.53:0/3250516099 shutdown_connections 2024-08-31T06:06:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.184+0000 7f208bc3f640 1 --2- 172.21.15.53:0/3250516099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2084109b10 0x7f2084110340 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.184+0000 7f208bc3f640 1 --2- 172.21.15.53:0/3250516099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20841091c0 0x7f20841095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.184+0000 7f208bc3f640 1 --2- 172.21.15.53:0/3250516099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2084103890 0x7f2084103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.184+0000 7f208bc3f640 1 -- 172.21.15.53:0/3250516099 >> 172.21.15.53:0/3250516099 conn(0x7f20840ff310 msgr2=0x7f2084101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.184+0000 7f208bc3f640 1 -- 172.21.15.53:0/3250516099 shutdown_connections 2024-08-31T06:06:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.184+0000 7f208bc3f640 1 -- 172.21.15.53:0/3250516099 wait complete. 2024-08-31T06:06:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.185+0000 7f208bc3f640 1 Processor -- start 2024-08-31T06:06:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.185+0000 7f208bc3f640 1 -- start start 2024-08-31T06:06:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.185+0000 7f208bc3f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2084103890 0x7f208419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.185+0000 7f208bc3f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20841091c0 0x7f208419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.185+0000 7f208bc3f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2084109b10 0x7f208419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.185+0000 7f208bc3f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f20841136c0 con 0x7f2084103890 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.185+0000 7f208bc3f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2084113540 con 0x7f2084109b10 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.185+0000 7f208bc3f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2084113840 con 0x7f20841091c0 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f20899db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2084103890 0x7f208419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f20899db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2084103890 0x7f208419a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39312/0 (socket says 172.21.15.53:39312) 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f20899db640 1 -- 172.21.15.53:0/2186614147 learned_addr learned my addr 172.21.15.53:0/2186614147 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f208a1dc640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2084109b10 0x7f208419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f20891da640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20841091c0 0x7f208419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f20899db640 1 -- 172.21.15.53:0/2186614147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20841091c0 msgr2=0x7f208419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f20899db640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20841091c0 0x7f208419a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f20899db640 1 -- 172.21.15.53:0/2186614147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2084109b10 msgr2=0x7f208419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f20899db640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2084109b10 0x7f208419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f20899db640 1 -- 172.21.15.53:0/2186614147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20841a0130 con 0x7f2084103890 2024-08-31T06:06:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f20899db640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2084103890 0x7f208419a200 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f208000e9f0 tx=0x7f208000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f207affd640 1 -- 172.21.15.53:0/2186614147 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208000cd80 con 0x7f2084103890 2024-08-31T06:06:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f208bc3f640 1 -- 172.21.15.53:0/2186614147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20841a0420 con 0x7f2084103890 2024-08-31T06:06:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f207affd640 1 -- 172.21.15.53:0/2186614147 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20800108c0 con 0x7f2084103890 2024-08-31T06:06:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f207affd640 1 -- 172.21.15.53:0/2186614147 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20800187c0 con 0x7f2084103890 2024-08-31T06:06:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.186+0000 7f208bc3f640 1 -- 172.21.15.53:0/2186614147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20841a6bb0 con 0x7f2084103890 2024-08-31T06:06:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.189+0000 7f2092c84740 1 Processor -- start 2024-08-31T06:06:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f2092c84740 1 -- start start 2024-08-31T06:06:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f207affd640 1 -- 172.21.15.53:0/2186614147 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2080010430 con 0x7f2084103890 2024-08-31T06:06:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f2092c84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6eb81b0 0x55b3a725bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f2092c84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e8f2f0 0x55b3a725c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f2092c84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e974d0 0x55b3a725c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f2092c84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3a71d1000 con 0x55b3a6e974d0 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f2092c84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b3a71c0590 con 0x55b3a6eb81b0 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f2092c84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b3a71c4540 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f20891da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e974d0 0x55b3a725c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f208a1dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6eb81b0 0x55b3a725bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f20899db640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e8f2f0 0x55b3a725c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f208a1dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6eb81b0 0x55b3a725bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54682/0 (socket says 172.21.15.53:54682) 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f20891da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e974d0 0x55b3a725c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39322/0 (socket says 172.21.15.53:39322) 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f208a1dc640 1 -- 172.21.15.53:0/1469469965 learned_addr learned my addr 172.21.15.53:0/1469469965 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f20899db640 1 -- 172.21.15.53:0/1469469965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6eb81b0 msgr2=0x55b3a725bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f20899db640 1 --2- 172.21.15.53:0/1469469965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6eb81b0 0x55b3a725bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f20899db640 1 -- 172.21.15.53:0/1469469965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e974d0 msgr2=0x55b3a725c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f20899db640 1 --2- 172.21.15.53:0/1469469965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e974d0 0x55b3a725c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.190+0000 7f20899db640 1 -- 172.21.15.53:0/1469469965 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a6f23790 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.191+0000 7f20899db640 1 --2- 172.21.15.53:0/1469469965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e8f2f0 0x55b3a725c220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f20800e3020 tx=0x7f20800ed690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b8ae7206a70d8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.191+0000 7f207affd640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20700b4ca0 0x7f20700b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.191+0000 7f206ffff640 1 -- 172.21.15.53:0/1469469965 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20800f4070 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.191+0000 7f208a1dc640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20700b4ca0 0x7f20700b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.191+0000 7f207affd640 1 -- 172.21.15.53:0/2186614147 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f20800e58d0 con 0x7f2084103890 2024-08-31T06:06:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.191+0000 7f206ffff640 1 -- 172.21.15.53:0/1469469965 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20800abb80 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.191+0000 7f206ffff640 1 -- 172.21.15.53:0/1469469965 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20800ab9c0 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.192+0000 7f2092c84740 1 -- 172.21.15.53:0/1469469965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e8f2f0 msgr2=0x55b3a725c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.192+0000 7f2092c84740 1 --2- 172.21.15.53:0/1469469965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e8f2f0 0x55b3a725c220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f20800e3020 tx=0x7f20800ed690 comp rx=0 tx=0).stop 2024-08-31T06:06:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.192+0000 7f208a1dc640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20700b4ca0 0x7f20700b71b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f207c009a60 tx=0x7f207c009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.192+0000 7f2092c84740 1 -- 172.21.15.53:0/1469469965 shutdown_connections 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.192+0000 7f2092c84740 1 --2- 172.21.15.53:0/1469469965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e974d0 0x55b3a725c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.192+0000 7f2092c84740 1 --2- 172.21.15.53:0/1469469965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e8f2f0 0x55b3a725c220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.192+0000 7f2092c84740 1 --2- 172.21.15.53:0/1469469965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6eb81b0 0x55b3a725bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.192+0000 7f2092c84740 1 -- 172.21.15.53:0/1469469965 >> 172.21.15.53:0/1469469965 conn(0x55b3a6eac300 msgr2=0x55b3a7259bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.192+0000 7f2092c84740 1 -- 172.21.15.53:0/1469469965 shutdown_connections 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.192+0000 7f2092c84740 1 -- 172.21.15.53:0/1469469965 wait complete. 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.192+0000 7f2092c84740 1 -- start start 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f2092c84740 1 Processor -- start 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f2092c84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 0x55b3a726bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f2092c84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e974d0 0x55b3a726c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f2092c84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6eb81b0 0x55b3a7277b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f2092c84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3a70f9ab0 con 0x55b3a6eb81b0 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f2092c84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b3a7147680 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f2092c84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b3a726e840 con 0x55b3a6e974d0 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f2092c84740 10 client.0 _ll_register_callbacks cb 0x55b3a6ecfa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f20899db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 0x55b3a726bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f208a1dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6eb81b0 0x55b3a7277b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f20899db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 0x55b3a726bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54690/0 (socket says 172.21.15.53:54690) 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f20899db640 1 -- 172.21.15.53:0/1297389108 learned_addr learned my addr 172.21.15.53:0/1297389108 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.193+0000 7f20891da640 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e974d0 0x55b3a726c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f20899db640 1 -- 172.21.15.53:0/1297389108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e974d0 msgr2=0x55b3a726c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f20899db640 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e974d0 0x55b3a726c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f20899db640 1 -- 172.21.15.53:0/1297389108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6eb81b0 msgr2=0x55b3a7277b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f20899db640 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6eb81b0 0x55b3a7277b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f20899db640 1 -- 172.21.15.53:0/1297389108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a6f9c620 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f208a1dc640 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6eb81b0 0x55b3a7277b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f20899db640 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 0x55b3a726bc60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f20800e30d0 tx=0x7f208000c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=336da82bfac1d8c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f206d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f206d7fa640 1 -- 172.21.15.53:0/1297389108 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20800f4070 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f2092c84740 1 -- 172.21.15.53:0/1297389108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20800abb80 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f206d7fa640 1 -- 172.21.15.53:0/1297389108 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2080010a70 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f206d7fa640 1 -- 172.21.15.53:0/1297389108 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2080091e60 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f2092c84740 10 client.25679 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f2092c84740 1 -- 172.21.15.53:0/1297389108 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3a727a840 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.194+0000 7f206d7fa640 1 -- 172.21.15.53:0/1297389108 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20800abb80 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.195+0000 7f206d7fa640 1 -- 172.21.15.53:0/1297389108 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f20800ae030 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.195+0000 7f2092c84740 10 client.25679 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.195+0000 7f2092c84740 10 client.25679 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.195+0000 7f2092c84740 20 client.25679 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.195+0000 7f2092c84740 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b3a6e76d80 0x55b3a727dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.195+0000 7f2092c84740 4 client.25679 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.195+0000 7f2092c84740 1 -- 172.21.15.53:0/1297389108 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3a71d2f50 con 0x55b3a6e76d80 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.195+0000 7f20891da640 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b3a6e76d80 0x55b3a727dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.195+0000 7f206d7fa640 10 client.25679 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.195+0000 7f20891da640 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b3a6e76d80 0x55b3a727dba0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edb0fcc8c6877167 server_cookie=a5fc54899a3583b2 in_seq=0 out_seq=0 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f206d7fa640 1 -- 172.21.15.53:0/1297389108 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b3a71d2f50 con 0x55b3a6e76d80 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f206d7fa640 10 client.25679 handle_command_reply: tid=0 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 1 client.25679 shutdown 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 1 -- 172.21.15.53:0/1297389108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 msgr2=0x55b3a726bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 0x55b3a726bc60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f20800e30d0 tx=0x7f208000c840 comp rx=0 tx=0).stop 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 1 -- 172.21.15.53:0/1297389108 shutdown_connections 2024-08-31T06:06:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b3a6e76d80 0x55b3a727dba0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6eb81b0 0x55b3a7277b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e974d0 0x55b3a726c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f206d7fa640 0 client.25679 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 1 --2- 172.21.15.53:0/1297389108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 0x55b3a726bc60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 1 -- 172.21.15.53:0/1297389108 >> 172.21.15.53:0/1297389108 conn(0x55b3a6eac300 msgr2=0x55b3a725d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 1 -- 172.21.15.53:0/1297389108 shutdown_connections 2024-08-31T06:06:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 1 -- 172.21.15.53:0/1297389108 wait complete. 2024-08-31T06:06:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.196+0000 7f2092c84740 20 client.25679 trim_cache size 0 max 16384 2024-08-31T06:06:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f2092c84740 1 Processor -- start 2024-08-31T06:06:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f2092c84740 1 -- start start 2024-08-31T06:06:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f2092c84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e76d80 0x55b3a726bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f2092c84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 0x55b3a7277ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f2092c84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e974d0 0x55b3a7278020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f2092c84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f20841ad3d0 con 0x55b3a6e76d80 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f2092c84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20841aef10 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f2092c84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20841adaa0 con 0x55b3a6e974d0 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f20899db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e76d80 0x55b3a726bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f20899db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e76d80 0x55b3a726bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39346/0 (socket says 172.21.15.53:39346) 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f20899db640 1 -- 172.21.15.53:0/1398029509 learned_addr learned my addr 172.21.15.53:0/1398029509 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.214+0000 7f208a1dc640 1 --2- 172.21.15.53:0/1398029509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e974d0 0x55b3a7278020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.215+0000 7f20891da640 1 --2- 172.21.15.53:0/1398029509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 0x55b3a7277ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.215+0000 7f20899db640 1 -- 172.21.15.53:0/1398029509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e974d0 msgr2=0x55b3a7278020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.215+0000 7f20899db640 1 --2- 172.21.15.53:0/1398029509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e974d0 0x55b3a7278020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.215+0000 7f20899db640 1 -- 172.21.15.53:0/1398029509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 msgr2=0x55b3a7277ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.215+0000 7f20899db640 1 --2- 172.21.15.53:0/1398029509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 0x55b3a7277ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.215+0000 7f20899db640 1 -- 172.21.15.53:0/1398029509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a7254aa0 con 0x55b3a6e76d80 2024-08-31T06:06:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.215+0000 7f20899db640 1 --2- 172.21.15.53:0/1398029509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e76d80 0x55b3a726bf30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f20800e3620 tx=0x7f20800ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373272fb456cab1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.215+0000 7f206f7fe640 1 -- 172.21.15.53:0/1398029509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20800f4020 con 0x55b3a6e76d80 2024-08-31T06:06:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.215+0000 7f206f7fe640 1 -- 172.21.15.53:0/1398029509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20800ede90 con 0x55b3a6e76d80 2024-08-31T06:06:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.215+0000 7f206f7fe640 1 -- 172.21.15.53:0/1398029509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2080010720 con 0x55b3a6e76d80 2024-08-31T06:06:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.216+0000 7f2092c84740 1 -- 172.21.15.53:0/1398029509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e76d80 msgr2=0x55b3a726bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.216+0000 7f2092c84740 1 --2- 172.21.15.53:0/1398029509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e76d80 0x55b3a726bf30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f20800e3620 tx=0x7f20800ed690 comp rx=0 tx=0).stop 2024-08-31T06:06:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.216+0000 7f2092c84740 1 -- 172.21.15.53:0/1398029509 shutdown_connections 2024-08-31T06:06:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.216+0000 7f2092c84740 1 --2- 172.21.15.53:0/1398029509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e974d0 0x55b3a7278020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.216+0000 7f2092c84740 1 --2- 172.21.15.53:0/1398029509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e8f2f0 0x55b3a7277ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.216+0000 7f2092c84740 1 --2- 172.21.15.53:0/1398029509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e76d80 0x55b3a726bf30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.216+0000 7f2092c84740 1 -- 172.21.15.53:0/1398029509 >> 172.21.15.53:0/1398029509 conn(0x55b3a6eac300 msgr2=0x55b3a726a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.216+0000 7f2092c84740 1 -- 172.21.15.53:0/1398029509 shutdown_connections 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.216+0000 7f2092c84740 1 -- 172.21.15.53:0/1398029509 wait complete. 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.216+0000 7f2092c84740 1 -- start start 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.216+0000 7f2092c84740 1 Processor -- start 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f2092c84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e76d80 0x55b3a72812f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f2092c84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e8f2f0 0x55b3a727e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f2092c84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e974d0 0x55b3a727ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f2092c84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f20841ae840 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f2092c84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20841ae170 con 0x55b3a6e974d0 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f2092c84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20841ab3b0 con 0x55b3a6e76d80 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f2092c84740 10 client.0 _ll_register_callbacks cb 0x7f20740097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f20891da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e8f2f0 0x55b3a727e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f20891da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e8f2f0 0x55b3a727e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39350/0 (socket says 172.21.15.53:39350) 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f20891da640 1 -- 172.21.15.53:0/2212028178 learned_addr learned my addr 172.21.15.53:0/2212028178 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f20899db640 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e76d80 0x55b3a72812f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f208a1dc640 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e974d0 0x55b3a727ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f20891da640 1 -- 172.21.15.53:0/2212028178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e76d80 msgr2=0x55b3a72812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f20891da640 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e76d80 0x55b3a72812f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f20891da640 1 -- 172.21.15.53:0/2212028178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e974d0 msgr2=0x55b3a727ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f20891da640 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e974d0 0x55b3a727ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f20891da640 1 -- 172.21.15.53:0/2212028178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a727f3b0 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.217+0000 7f20899db640 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e76d80 0x55b3a72812f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f20891da640 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e8f2f0 0x55b3a727e7b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f208406c3c0 tx=0x7f2074009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526c5ecb47d6e478 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f206d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f206d7fa640 1 -- 172.21.15.53:0/2212028178 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074029060 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f206d7fa640 1 -- 172.21.15.53:0/2212028178 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2074010630 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f2092c84740 1 -- 172.21.15.53:0/2212028178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20800ede90 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f206d7fa640 1 -- 172.21.15.53:0/2212028178 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2074010830 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f2092c84740 10 client.16248 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f2092c84740 1 -- 172.21.15.53:0/2212028178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3a72e8230 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f206d7fa640 1 -- 172.21.15.53:0/2212028178 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20800ede90 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f206d7fa640 1 -- 172.21.15.53:0/2212028178 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2074023070 con 0x55b3a6e8f2f0 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f2092c84740 10 client.16248 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f2092c84740 10 client.16248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f2092c84740 20 client.16248 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f2092c84740 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b3a6eb81b0 0x55b3a72eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f2092c84740 4 client.16248 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:06:31.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.218+0000 7f2092c84740 1 -- 172.21.15.53:0/2212028178 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b3a71ce9f0 con 0x55b3a6eb81b0 2024-08-31T06:06:31.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.219+0000 7f20899db640 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b3a6eb81b0 0x55b3a72eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:31.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.219+0000 7f206d7fa640 10 client.16248 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:31.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.219+0000 7f20899db640 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b3a6eb81b0 0x55b3a72eaa20 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b39a8ec201da082 server_cookie=3a44ac407bff8b36 in_seq=0 out_seq=0 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f206d7fa640 1 -- 172.21.15.53:0/2212028178 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b3a71ce9f0 con 0x55b3a6eb81b0 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f206d7fa640 10 client.16248 handle_command_reply: tid=0 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f2092c84740 1 client.16248 shutdown 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f2092c84740 1 -- 172.21.15.53:0/2212028178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e8f2f0 msgr2=0x55b3a727e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f2092c84740 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e8f2f0 0x55b3a727e7b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f208406c3c0 tx=0x7f2074009d60 comp rx=0 tx=0).stop 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f2092c84740 1 -- 172.21.15.53:0/2212028178 shutdown_connections 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f2092c84740 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b3a6eb81b0 0x55b3a72eaa20 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f2092c84740 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6e974d0 0x55b3a727ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f2092c84740 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6e8f2f0 0x55b3a727e7b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f206d7fa640 0 client.16248 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f2092c84740 1 --2- 172.21.15.53:0/2212028178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3a6e76d80 0x55b3a72812f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f2092c84740 1 -- 172.21.15.53:0/2212028178 >> 172.21.15.53:0/2212028178 conn(0x55b3a6eac300 msgr2=0x55b3a726ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:31.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f2092c84740 1 -- 172.21.15.53:0/2212028178 shutdown_connections 2024-08-31T06:06:31.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.257+0000 7f2092c84740 1 -- 172.21.15.53:0/2212028178 wait complete. 2024-08-31T06:06:31.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f2092c84740 20 client.16248 trim_cache size 0 max 16384 2024-08-31T06:06:31.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:06:31.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:06:31.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:06:31.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:06:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 -- 172.21.15.53:0/2186614147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20700b4ca0 msgr2=0x7f20700b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20700b4ca0 0x7f20700b71b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f207c009a60 tx=0x7f207c009360 comp rx=0 tx=0).stop 2024-08-31T06:06:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 -- 172.21.15.53:0/2186614147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2084103890 msgr2=0x7f208419a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2084103890 0x7f208419a200 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f208000e9f0 tx=0x7f208000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 -- 172.21.15.53:0/2186614147 shutdown_connections 2024-08-31T06:06:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20700b4ca0 0x7f20700b71b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2084109b10 0x7f208419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20841091c0 0x7f208419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 --2- 172.21.15.53:0/2186614147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2084103890 0x7f208419a200 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 -- 172.21.15.53:0/2186614147 >> 172.21.15.53:0/2186614147 conn(0x7f20840ff310 msgr2=0x7f2084108830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 -- 172.21.15.53:0/2186614147 shutdown_connections 2024-08-31T06:06:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:31.258+0000 7f208bc3f640 1 -- 172.21.15.53:0/2186614147 wait complete. 2024-08-31T06:06:31.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:31 smithi130 ceph-mon[22266]: pgmap v370: 97 pgs: 97 active+clean; 29 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1.8 MiB/s wr, 120 op/s 2024-08-31T06:06:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:31 smithi153 ceph-mon[22320]: pgmap v370: 97 pgs: 97 active+clean; 29 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1.8 MiB/s wr, 120 op/s 2024-08-31T06:06:31.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 13939 4.41 MB/sec warmup 21 sec latency 31.539 ms 2024-08-31T06:06:31.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:31 smithi053 ceph-mon[18924]: pgmap v370: 97 pgs: 97 active+clean; 29 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1.8 MiB/s wr, 120 op/s 2024-08-31T06:06:32.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 14433 4.41 MB/sec warmup 22 sec latency 14.966 ms 2024-08-31T06:06:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:33 smithi130 ceph-mon[22266]: pgmap v371: 97 pgs: 97 active+clean; 28 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-08-31T06:06:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:33 smithi153 ceph-mon[22320]: pgmap v371: 97 pgs: 97 active+clean; 28 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-08-31T06:06:33.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 14852 4.24 MB/sec warmup 23 sec latency 22.546 ms 2024-08-31T06:06:33.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:33 smithi053 ceph-mon[18924]: pgmap v371: 97 pgs: 97 active+clean; 28 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-08-31T06:06:34.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 15452 4.15 MB/sec warmup 24 sec latency 26.497 ms 2024-08-31T06:06:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:35 smithi130 ceph-mon[22266]: pgmap v372: 97 pgs: 97 active+clean; 24 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.5 MiB/s wr, 104 op/s 2024-08-31T06:06:35.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:35 smithi153 ceph-mon[22320]: pgmap v372: 97 pgs: 97 active+clean; 24 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.5 MiB/s wr, 104 op/s 2024-08-31T06:06:35.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 16131 4.12 MB/sec warmup 25 sec latency 47.804 ms 2024-08-31T06:06:35.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:35 smithi053 ceph-mon[18924]: pgmap v372: 97 pgs: 97 active+clean; 24 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.5 MiB/s wr, 104 op/s 2024-08-31T06:06:36.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 16795 4.06 MB/sec warmup 26 sec latency 15.141 ms 2024-08-31T06:06:37.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:37 smithi130 ceph-mon[22266]: pgmap v373: 97 pgs: 97 active+clean; 27 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.7 MiB/s wr, 111 op/s 2024-08-31T06:06:37.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:37 smithi153 ceph-mon[22320]: pgmap v373: 97 pgs: 97 active+clean; 27 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.7 MiB/s wr, 111 op/s 2024-08-31T06:06:37.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 17528 4.14 MB/sec warmup 27 sec latency 13.191 ms 2024-08-31T06:06:37.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:37 smithi053 ceph-mon[18924]: pgmap v373: 97 pgs: 97 active+clean; 27 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.7 MiB/s wr, 111 op/s 2024-08-31T06:06:38.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 18131 4.16 MB/sec warmup 28 sec latency 11.162 ms 2024-08-31T06:06:39.777 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:39 smithi053 ceph-mon[18924]: pgmap v374: 97 pgs: 97 active+clean; 26 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 1.6 MiB/s wr, 106 op/s 2024-08-31T06:06:39.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:39 smithi130 ceph-mon[22266]: pgmap v374: 97 pgs: 97 active+clean; 26 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 1.6 MiB/s wr, 106 op/s 2024-08-31T06:06:39.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:39 smithi153 ceph-mon[22320]: pgmap v374: 97 pgs: 97 active+clean; 26 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 1.6 MiB/s wr, 106 op/s 2024-08-31T06:06:39.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 18634 4.04 MB/sec warmup 29 sec latency 21.557 ms 2024-08-31T06:06:40.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 19280 4.06 MB/sec warmup 30 sec latency 14.909 ms 2024-08-31T06:06:41.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:41 smithi130 ceph-mon[22266]: pgmap v375: 97 pgs: 97 active+clean; 27 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.6 MiB/s wr, 116 op/s 2024-08-31T06:06:41.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:41 smithi153 ceph-mon[22320]: pgmap v375: 97 pgs: 97 active+clean; 27 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.6 MiB/s wr, 116 op/s 2024-08-31T06:06:41.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 19967 3.95 MB/sec warmup 31 sec latency 16.289 ms 2024-08-31T06:06:41.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:41 smithi053 ceph-mon[18924]: pgmap v375: 97 pgs: 97 active+clean; 27 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.6 MiB/s wr, 116 op/s 2024-08-31T06:06:42.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:42 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:06:42.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:42 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:06:42.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 20698 4.04 MB/sec warmup 32 sec latency 15.239 ms 2024-08-31T06:06:42.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:42 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:06:43.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:06:43.704 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:43.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:43 smithi053 ceph-mon[18924]: pgmap v376: 97 pgs: 97 active+clean; 27 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 1.4 MiB/s wr, 99 op/s 2024-08-31T06:06:43.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:06:43.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:06:43.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:06:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:43 smithi130 ceph-mon[22266]: pgmap v376: 97 pgs: 97 active+clean; 27 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 1.4 MiB/s wr, 99 op/s 2024-08-31T06:06:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:06:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:06:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:06:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:43 smithi153 ceph-mon[22320]: pgmap v376: 97 pgs: 97 active+clean; 27 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 1.4 MiB/s wr, 99 op/s 2024-08-31T06:06:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:06:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:06:43.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:06:43.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 21318 4.06 MB/sec warmup 33 sec latency 14.897 ms 2024-08-31T06:06:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.225+0000 7f370dea9640 1 -- 172.21.15.53:0/3807386545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3708108140 msgr2=0x7f3708108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.225+0000 7f370dea9640 1 --2- 172.21.15.53:0/3807386545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3708108140 0x7f3708108550 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009900 tx=0x7f36fc02a410 comp rx=0 tx=0).stop 2024-08-31T06:06:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.225+0000 7f370dea9640 1 -- 172.21.15.53:0/3807386545 shutdown_connections 2024-08-31T06:06:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.225+0000 7f370dea9640 1 --2- 172.21.15.53:0/3807386545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708108a90 0x7f370810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.225+0000 7f370dea9640 1 --2- 172.21.15.53:0/3807386545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3708108140 0x7f3708108550 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.225+0000 7f370dea9640 1 --2- 172.21.15.53:0/3807386545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3708102800 0x7f3708102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.225+0000 7f370dea9640 1 -- 172.21.15.53:0/3807386545 >> 172.21.15.53:0/3807386545 conn(0x7f37080794d0 msgr2=0x7f37080798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.225+0000 7f370dea9640 1 -- 172.21.15.53:0/3807386545 shutdown_connections 2024-08-31T06:06:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.225+0000 7f370dea9640 1 -- 172.21.15.53:0/3807386545 wait complete. 2024-08-31T06:06:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.226+0000 7f370dea9640 1 Processor -- start 2024-08-31T06:06:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.226+0000 7f370dea9640 1 -- start start 2024-08-31T06:06:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.226+0000 7f370dea9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708102800 0x7f370819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.226+0000 7f370dea9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3708108140 0x7f370819b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f370dea9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3708108a90 0x7f370819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f370dea9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3708112570 con 0x7f3708102800 2024-08-31T06:06:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f370dea9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37081123f0 con 0x7f3708108a90 2024-08-31T06:06:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f370dea9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37081126f0 con 0x7f3708108140 2024-08-31T06:06:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f37077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708102800 0x7f370819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f37077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708102800 0x7f370819af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45398/0 (socket says 172.21.15.53:45398) 2024-08-31T06:06:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f37077fe640 1 -- 172.21.15.53:0/3745428016 learned_addr learned my addr 172.21.15.53:0/3745428016 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f3707fff640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3708108a90 0x7f370819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f3706ffd640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3708108140 0x7f370819b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f37077fe640 1 -- 172.21.15.53:0/3745428016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3708108140 msgr2=0x7f370819b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f37077fe640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3708108140 0x7f370819b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f37077fe640 1 -- 172.21.15.53:0/3745428016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3708108a90 msgr2=0x7f370819b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f37077fe640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3708108a90 0x7f370819b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f37077fe640 1 -- 172.21.15.53:0/3745428016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37081a6250 con 0x7f3708102800 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f37077fe640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708102800 0x7f370819af40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f36f800e9f0 tx=0x7f36f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f3704ff9640 1 -- 172.21.15.53:0/3745428016 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f800cd80 con 0x7f3708102800 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.227+0000 7f370dea9640 1 -- 172.21.15.53:0/3745428016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37081a6540 con 0x7f3708102800 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.228+0000 7f3704ff9640 1 -- 172.21.15.53:0/3745428016 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36f80108c0 con 0x7f3708102800 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.228+0000 7f3704ff9640 1 -- 172.21.15.53:0/3745428016 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f80187c0 con 0x7f3708102800 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.228+0000 7f370dea9640 1 -- 172.21.15.53:0/3745428016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37081a6ad0 con 0x7f3708102800 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.231+0000 7f371441e740 1 Processor -- start 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.231+0000 7f371441e740 1 -- start start 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.231+0000 7f371441e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 0x56275c8072c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.231+0000 7f371441e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 0x56275c807800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.231+0000 7f371441e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c441390 0x56275c807d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.231+0000 7f371441e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56275c77e630 con 0x56275c462070 2024-08-31T06:06:44.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.231+0000 7f371441e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56275c76dbc0 con 0x56275c4391b0 2024-08-31T06:06:44.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.231+0000 7f371441e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56275c771b70 con 0x56275c441390 2024-08-31T06:06:44.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.231+0000 7f3707fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 0x56275c8072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f3707fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 0x56275c8072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45402/0 (socket says 172.21.15.53:45402) 2024-08-31T06:06:44.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f3704ff9640 1 -- 172.21.15.53:0/3745428016 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f36f8010430 con 0x7f3708102800 2024-08-31T06:06:44.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f3707fff640 1 -- 172.21.15.53:0/631763191 learned_addr learned my addr 172.21.15.53:0/631763191 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f3706ffd640 1 --2- 172.21.15.53:0/631763191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c441390 0x56275c807d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f37077fe640 1 --2- 172.21.15.53:0/631763191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 0x56275c807800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f3707fff640 1 -- 172.21.15.53:0/631763191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c441390 msgr2=0x56275c807d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f3707fff640 1 --2- 172.21.15.53:0/631763191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c441390 0x56275c807d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f3707fff640 1 -- 172.21.15.53:0/631763191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 msgr2=0x56275c807800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f3707fff640 1 --2- 172.21.15.53:0/631763191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 0x56275c807800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f3707fff640 1 -- 172.21.15.53:0/631763191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56275c4cd650 con 0x56275c462070 2024-08-31T06:06:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f37077fe640 1 --2- 172.21.15.53:0/631763191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 0x56275c807800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:06:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f3707fff640 1 --2- 172.21.15.53:0/631763191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 0x56275c8072c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3700009f30 tx=0x7f37000118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92416d3141cc4660 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f36edffb640 1 -- 172.21.15.53:0/631763191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3700004d20 con 0x56275c462070 2024-08-31T06:06:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f36edffb640 1 -- 172.21.15.53:0/631763191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3700004050 con 0x56275c462070 2024-08-31T06:06:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f36edffb640 1 -- 172.21.15.53:0/631763191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3700005280 con 0x56275c462070 2024-08-31T06:06:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.232+0000 7f3704ff9640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36f00b4ca0 0x7f36f00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f37077fe640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36f00b4ca0 0x7f36f00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f3704ff9640 1 -- 172.21.15.53:0/3745428016 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f36f80e5980 con 0x7f3708102800 2024-08-31T06:06:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f371441e740 1 -- 172.21.15.53:0/631763191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 msgr2=0x56275c8072c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f37077fe640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36f00b4ca0 0x7f36f00b71b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f36f80e3180 tx=0x7f36f80a7f30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f371441e740 1 --2- 172.21.15.53:0/631763191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 0x56275c8072c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3700009f30 tx=0x7f37000118d0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f371441e740 1 -- 172.21.15.53:0/631763191 shutdown_connections 2024-08-31T06:06:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f371441e740 1 --2- 172.21.15.53:0/631763191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c441390 0x56275c807d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f371441e740 1 --2- 172.21.15.53:0/631763191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 0x56275c807800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f371441e740 1 --2- 172.21.15.53:0/631763191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 0x56275c8072c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f371441e740 1 -- 172.21.15.53:0/631763191 >> 172.21.15.53:0/631763191 conn(0x56275c456460 msgr2=0x56275c8051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f371441e740 1 -- 172.21.15.53:0/631763191 shutdown_connections 2024-08-31T06:06:44.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.233+0000 7f371441e740 1 -- 172.21.15.53:0/631763191 wait complete. 2024-08-31T06:06:44.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.234+0000 7f371441e740 1 -- start start 2024-08-31T06:06:44.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.234+0000 7f371441e740 1 Processor -- start 2024-08-31T06:06:44.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f371441e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 0x56275c812a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f371441e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c441390 0x56275c812fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f371441e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c462070 0x56275c81ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f371441e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56275c5d0700 con 0x56275c441390 2024-08-31T06:06:44.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f371441e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56275c6f4700 con 0x56275c4391b0 2024-08-31T06:06:44.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f371441e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56275c815aa0 con 0x56275c462070 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f371441e740 10 client.0 _ll_register_callbacks cb 0x56275c723dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f3707fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 0x56275c812a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f3707fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 0x56275c812a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50202/0 (socket says 172.21.15.53:50202) 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f3707fff640 1 -- 172.21.15.53:0/3285052515 learned_addr learned my addr 172.21.15.53:0/3285052515 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f3706ffd640 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c441390 0x56275c812fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f3707fff640 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c462070 0x56275c81ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f3707fff640 1 -- 172.21.15.53:0/3285052515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c462070 msgr2=0x56275c81ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f3707fff640 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c462070 0x56275c81ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f3707fff640 1 -- 172.21.15.53:0/3285052515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c441390 msgr2=0x56275c812fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f3707fff640 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c441390 0x56275c812fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.235+0000 7f3707fff640 1 -- 172.21.15.53:0/3285052515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56275c72d8b0 con 0x56275c4391b0 2024-08-31T06:06:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.236+0000 7f3707fff640 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 0x56275c812a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3700005c40 tx=0x7f3700005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=756098555be189dc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.236+0000 7f36e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.236+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3285052515 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370002b020 con 0x56275c4391b0 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.236+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3285052515 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f3700003d40 con 0x56275c4391b0 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.236+0000 7f371441e740 1 -- 172.21.15.53:0/3285052515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3700004050 con 0x56275c4391b0 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.236+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3285052515 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3700036050 con 0x56275c4391b0 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.236+0000 7f371441e740 10 client.25694 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.236+0000 7f371441e740 1 -- 172.21.15.53:0/3285052515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56275c821810 con 0x56275c4391b0 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.236+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3285052515 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3700004050 con 0x56275c4391b0 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.237+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3285052515 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3700004fe0 con 0x56275c4391b0 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.237+0000 7f371441e740 10 client.25694 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.237+0000 7f371441e740 10 client.25694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.237+0000 7f371441e740 20 client.25694 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.237+0000 7f371441e740 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56275c4209f0 0x56275c824ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.237+0000 7f371441e740 4 client.25694 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.237+0000 7f371441e740 1 -- 172.21.15.53:0/3285052515 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56275c780580 con 0x56275c4209f0 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.237+0000 7f3706ffd640 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56275c4209f0 0x56275c824ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.237+0000 7f36e6ffd640 10 client.25694 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.237+0000 7f3706ffd640 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56275c4209f0 0x56275c824ce0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=711f41d531bac2d9 server_cookie=26cba392eb922c96 in_seq=0 out_seq=0 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.238+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3285052515 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56275c780580 con 0x56275c4209f0 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.238+0000 7f36e6ffd640 10 client.25694 handle_command_reply: tid=0 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.238+0000 7f371441e740 1 client.25694 shutdown 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.238+0000 7f371441e740 1 -- 172.21.15.53:0/3285052515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 msgr2=0x56275c812a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.238+0000 7f371441e740 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 0x56275c812a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3700005c40 tx=0x7f3700005bd0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.238+0000 7f371441e740 1 -- 172.21.15.53:0/3285052515 shutdown_connections 2024-08-31T06:06:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.238+0000 7f371441e740 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56275c4209f0 0x56275c824ce0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.238+0000 7f371441e740 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c462070 0x56275c81ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.238+0000 7f371441e740 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c441390 0x56275c812fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.239+0000 7f36e6ffd640 0 client.25694 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.239+0000 7f371441e740 1 --2- 172.21.15.53:0/3285052515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c4391b0 0x56275c812a90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.239+0000 7f371441e740 1 -- 172.21.15.53:0/3285052515 >> 172.21.15.53:0/3285052515 conn(0x56275c456460 msgr2=0x56275c80a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.239+0000 7f371441e740 1 -- 172.21.15.53:0/3285052515 shutdown_connections 2024-08-31T06:06:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.239+0000 7f371441e740 1 -- 172.21.15.53:0/3285052515 wait complete. 2024-08-31T06:06:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.239+0000 7f371441e740 20 client.25694 trim_cache size 0 max 16384 2024-08-31T06:06:44.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.260+0000 7f371441e740 1 Processor -- start 2024-08-31T06:06:44.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.260+0000 7f371441e740 1 -- start start 2024-08-31T06:06:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f371441e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 0x56275c80ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f371441e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c441390 0x56275c808a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f371441e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c462070 0x56275c81ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f371441e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f37081af5c0 con 0x56275c441390 2024-08-31T06:06:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f371441e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37081b1100 con 0x56275c462070 2024-08-31T06:06:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f371441e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37081afc90 con 0x56275c4391b0 2024-08-31T06:06:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f3707fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 0x56275c80ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f3707fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 0x56275c80ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:33358/0 (socket says 172.21.15.53:33358) 2024-08-31T06:06:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f3707fff640 1 -- 172.21.15.53:0/3775145 learned_addr learned my addr 172.21.15.53:0/3775145 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f3706ffd640 1 --2- 172.21.15.53:0/3775145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c441390 0x56275c808a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f3707fff640 1 --2- 172.21.15.53:0/3775145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c462070 0x56275c81ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f3707fff640 1 -- 172.21.15.53:0/3775145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c462070 msgr2=0x56275c81ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f3707fff640 1 --2- 172.21.15.53:0/3775145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c462070 0x56275c81ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f3707fff640 1 -- 172.21.15.53:0/3775145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c441390 msgr2=0x56275c808a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f3707fff640 1 --2- 172.21.15.53:0/3775145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c441390 0x56275c808a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f3707fff640 1 -- 172.21.15.53:0/3775145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56275c8097e0 con 0x56275c4391b0 2024-08-31T06:06:44.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.261+0000 7f3707fff640 1 --2- 172.21.15.53:0/3775145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 0x56275c80ad80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3700002230 tx=0x7f37000045f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f83ee1abefb1732 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.262+0000 7f36ed7fa640 1 -- 172.21.15.53:0/3775145 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370002b040 con 0x56275c4391b0 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.262+0000 7f36ed7fa640 1 -- 172.21.15.53:0/3775145 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37000051e0 con 0x56275c4391b0 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.262+0000 7f36ed7fa640 1 -- 172.21.15.53:0/3775145 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3700027470 con 0x56275c4391b0 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.263+0000 7f371441e740 1 -- 172.21.15.53:0/3775145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 msgr2=0x56275c80ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.263+0000 7f371441e740 1 --2- 172.21.15.53:0/3775145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 0x56275c80ad80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3700002230 tx=0x7f37000045f0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.263+0000 7f371441e740 1 -- 172.21.15.53:0/3775145 shutdown_connections 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.263+0000 7f371441e740 1 --2- 172.21.15.53:0/3775145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c462070 0x56275c81ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.263+0000 7f371441e740 1 --2- 172.21.15.53:0/3775145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c441390 0x56275c808a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.263+0000 7f371441e740 1 --2- 172.21.15.53:0/3775145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 0x56275c80ad80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.263+0000 7f371441e740 1 -- 172.21.15.53:0/3775145 >> 172.21.15.53:0/3775145 conn(0x56275c456460 msgr2=0x56275c8082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.263+0000 7f371441e740 1 -- 172.21.15.53:0/3775145 shutdown_connections 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.263+0000 7f371441e740 1 -- 172.21.15.53:0/3775145 wait complete. 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.263+0000 7f371441e740 1 -- start start 2024-08-31T06:06:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f371441e740 1 Processor -- start 2024-08-31T06:06:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f371441e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 0x56275c81b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f371441e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c441390 0x56275c8169b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f371441e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 0x56275c816f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f371441e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f37081b0a30 con 0x56275c462070 2024-08-31T06:06:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f371441e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37081b0360 con 0x56275c441390 2024-08-31T06:06:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f371441e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37081ad5a0 con 0x56275c4391b0 2024-08-31T06:06:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f371441e740 10 client.0 _ll_register_callbacks cb 0x7f3700009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f3707fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 0x56275c816f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f3706ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c441390 0x56275c8169b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f3707fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 0x56275c816f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45432/0 (socket says 172.21.15.53:45432) 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f3706ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c441390 0x56275c8169b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50222/0 (socket says 172.21.15.53:50222) 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f3707fff640 1 -- 172.21.15.53:0/3980597314 learned_addr learned my addr 172.21.15.53:0/3980597314 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f3707fff640 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 0x56275c81b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f3706ffd640 1 -- 172.21.15.53:0/3980597314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 msgr2=0x56275c81b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f3706ffd640 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 0x56275c81b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f3706ffd640 1 -- 172.21.15.53:0/3980597314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 msgr2=0x56275c816f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f3706ffd640 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 0x56275c816f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.264+0000 7f3706ffd640 1 -- 172.21.15.53:0/3980597314 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56275c8176a0 con 0x56275c441390 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.265+0000 7f3706ffd640 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c441390 0x56275c8169b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3708079920 tx=0x7f36fc032ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9ab3738e8c380d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.265+0000 7f36e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.265+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3980597314 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc035040 con 0x56275c441390 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.265+0000 7f371441e740 1 -- 172.21.15.53:0/3980597314 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37000051e0 con 0x56275c441390 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.265+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3980597314 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f36fc005450 con 0x56275c441390 2024-08-31T06:06:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.265+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3980597314 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f36fc032e50 con 0x56275c441390 2024-08-31T06:06:44.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.265+0000 7f371441e740 10 client.25700 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:44.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.265+0000 7f371441e740 1 -- 172.21.15.53:0/3980597314 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56275c88f510 con 0x56275c441390 2024-08-31T06:06:44.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.265+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3980597314 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37000051e0 con 0x56275c441390 2024-08-31T06:06:44.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.265+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3980597314 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f36fc0322d0 con 0x56275c441390 2024-08-31T06:06:44.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.266+0000 7f371441e740 10 client.25700 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:44.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.266+0000 7f371441e740 10 client.25700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:44.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.266+0000 7f371441e740 20 client.25700 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:44.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.266+0000 7f371441e740 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56275c3f5da0 0x56275c891cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.266+0000 7f371441e740 4 client.25700 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:06:44.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.266+0000 7f371441e740 1 -- 172.21.15.53:0/3980597314 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56275c77c020 con 0x56275c3f5da0 2024-08-31T06:06:44.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.266+0000 7f3707fff640 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56275c3f5da0 0x56275c891cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.266+0000 7f36e6ffd640 10 client.25700 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:44.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.266+0000 7f3707fff640 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56275c3f5da0 0x56275c891cb0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=899fc7aa0b5e0dda server_cookie=c0a17ea4527fdd7c in_seq=0 out_seq=0 2024-08-31T06:06:44.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f36e6ffd640 1 -- 172.21.15.53:0/3980597314 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x56275c77c020 con 0x56275c3f5da0 2024-08-31T06:06:44.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f36e6ffd640 10 client.25700 handle_command_reply: tid=0 2024-08-31T06:06:44.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 1 client.25700 shutdown 2024-08-31T06:06:44.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 1 -- 172.21.15.53:0/3980597314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c441390 msgr2=0x56275c8169b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c441390 0x56275c8169b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3708079920 tx=0x7f36fc032ca0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 1 -- 172.21.15.53:0/3980597314 shutdown_connections 2024-08-31T06:06:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56275c3f5da0 0x56275c891cb0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c462070 0x56275c816f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f36e6ffd640 0 client.25700 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56275c441390 0x56275c8169b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 1 --2- 172.21.15.53:0/3980597314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56275c4391b0 0x56275c81b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 1 -- 172.21.15.53:0/3980597314 >> 172.21.15.53:0/3980597314 conn(0x56275c456460 msgr2=0x56275c80ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 1 -- 172.21.15.53:0/3980597314 shutdown_connections 2024-08-31T06:06:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 1 -- 172.21.15.53:0/3980597314 wait complete. 2024-08-31T06:06:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.267+0000 7f371441e740 20 client.25700 trim_cache size 0 max 16384 2024-08-31T06:06:44.275 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:06:44.275 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:06:44.275 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:06:44.275 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:06:44.275 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:06:44.275 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:06:44.275 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:06:44.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:06:44.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:06:44.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:06:44.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:06:44.276 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:06:44.277 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:06:44.277 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:06:44.277 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:06:44.277 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:06:44.277 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:06:44.277 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:06:44.277 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:06:44.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 -- 172.21.15.53:0/3745428016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36f00b4ca0 msgr2=0x7f36f00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36f00b4ca0 0x7f36f00b71b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f36f80e3180 tx=0x7f36f80a7f30 comp rx=0 tx=0).stop 2024-08-31T06:06:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 -- 172.21.15.53:0/3745428016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708102800 msgr2=0x7f370819af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708102800 0x7f370819af40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f36f800e9f0 tx=0x7f36f800eeb0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 -- 172.21.15.53:0/3745428016 shutdown_connections 2024-08-31T06:06:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36f00b4ca0 0x7f36f00b71b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3708108a90 0x7f370819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3708108140 0x7f370819b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 --2- 172.21.15.53:0/3745428016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708102800 0x7f370819af40 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 -- 172.21.15.53:0/3745428016 >> 172.21.15.53:0/3745428016 conn(0x7f37080794d0 msgr2=0x7f3708104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 -- 172.21.15.53:0/3745428016 shutdown_connections 2024-08-31T06:06:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:44.268+0000 7f370dea9640 1 -- 172.21.15.53:0/3745428016 wait complete. 2024-08-31T06:06:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.366+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2870018139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ac108080 msgr2=0x7f57ac108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.366+0000 7f57b3b6e640 1 --2- 172.21.15.53:0/2870018139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ac108080 0x7f57ac108490 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f579c009900 tx=0x7f579c02a410 comp rx=0 tx=0).stop 2024-08-31T06:06:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.366+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2870018139 shutdown_connections 2024-08-31T06:06:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.366+0000 7f57b3b6e640 1 --2- 172.21.15.53:0/2870018139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57ac1089d0 0x7f57ac10f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.366+0000 7f57b3b6e640 1 --2- 172.21.15.53:0/2870018139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ac108080 0x7f57ac108490 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.366+0000 7f57b3b6e640 1 --2- 172.21.15.53:0/2870018139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57ac102750 0x7f57ac102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.366+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2870018139 >> 172.21.15.53:0/2870018139 conn(0x7f57ac07a4e0 msgr2=0x7f57ac07a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.366+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2870018139 shutdown_connections 2024-08-31T06:06:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.366+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2870018139 wait complete. 2024-08-31T06:06:44.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.367+0000 7f57b3b6e640 1 Processor -- start 2024-08-31T06:06:44.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.367+0000 7f57b3b6e640 1 -- start start 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.367+0000 7f57b3b6e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57ac102750 0x7f57ac198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.367+0000 7f57b3b6e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57ac108080 0x7f57ac199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.367+0000 7f57b3b6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ac1089d0 0x7f57ac19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.367+0000 7f57b3b6e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac1124f0 con 0x7f57ac1089d0 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.367+0000 7f57b3b6e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac112370 con 0x7f57ac108080 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.367+0000 7f57b3b6e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac112670 con 0x7f57ac102750 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b210b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ac1089d0 0x7f57ac19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b1109640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57ac108080 0x7f57ac199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b210b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ac1089d0 0x7f57ac19e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45450/0 (socket says 172.21.15.53:45450) 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b210b640 1 -- 172.21.15.53:0/2771552768 learned_addr learned my addr 172.21.15.53:0/2771552768 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b190a640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57ac102750 0x7f57ac198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b210b640 1 -- 172.21.15.53:0/2771552768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57ac102750 msgr2=0x7f57ac198ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b210b640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57ac102750 0x7f57ac198ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b210b640 1 -- 172.21.15.53:0/2771552768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57ac108080 msgr2=0x7f57ac199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b210b640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57ac108080 0x7f57ac199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b210b640 1 -- 172.21.15.53:0/2771552768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ac19ef20 con 0x7f57ac1089d0 2024-08-31T06:06:44.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b1109640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57ac108080 0x7f57ac199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:44.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b210b640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ac1089d0 0x7f57ac19e820 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f57a400eaa0 tx=0x7f57a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57a2ffd640 1 -- 172.21.15.53:0/2771552768 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a400cdb0 con 0x7f57ac1089d0 2024-08-31T06:06:44.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2771552768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ac19f210 con 0x7f57ac1089d0 2024-08-31T06:06:44.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57a2ffd640 1 -- 172.21.15.53:0/2771552768 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57a4005020 con 0x7f57ac1089d0 2024-08-31T06:06:44.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57a2ffd640 1 -- 172.21.15.53:0/2771552768 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a40116d0 con 0x7f57ac1089d0 2024-08-31T06:06:44.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.368+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2771552768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ac1a59a0 con 0x7f57ac1089d0 2024-08-31T06:06:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.371+0000 7f57babbb740 1 Processor -- start 2024-08-31T06:06:44.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.371+0000 7f57a2ffd640 1 -- 172.21.15.53:0/2771552768 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f57a40051d0 con 0x7f57ac1089d0 2024-08-31T06:06:44.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57babbb740 1 -- start start 2024-08-31T06:06:44.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57babbb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d4eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57babbb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4ef000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57babbb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4ef540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57babbb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b19d464000 con 0x55b19d1222f0 2024-08-31T06:06:44.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57babbb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b19d453590 con 0x55b19d14b1b0 2024-08-31T06:06:44.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57babbb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b19d457540 con 0x55b19d12a4d0 2024-08-31T06:06:44.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57b190a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4ef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57b190a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4ef000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45462/0 (socket says 172.21.15.53:45462) 2024-08-31T06:06:44.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57b1109640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d4eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57b190a640 1 -- 172.21.15.53:0/3650826287 learned_addr learned my addr 172.21.15.53:0/3650826287 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.372+0000 7f57b1109640 1 --2- 172.21.15.53:0/3650826287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4ef540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f57a2ffd640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57980b4ca0 0x7f57980b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f57b190a640 1 -- 172.21.15.53:0/3650826287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 msgr2=0x55b19d4ef540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f57b190a640 1 --2- 172.21.15.53:0/3650826287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4ef540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f57b190a640 1 -- 172.21.15.53:0/3650826287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 msgr2=0x55b19d4eeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f57b190a640 1 --2- 172.21.15.53:0/3650826287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d4eeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f57b190a640 1 -- 172.21.15.53:0/3650826287 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19d1b6790 con 0x55b19d1222f0 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f57b210b640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57980b4ca0 0x7f57980b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f57a2ffd640 1 -- 172.21.15.53:0/2771552768 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f57a40e56f0 con 0x7f57ac1089d0 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f57b190a640 1 --2- 172.21.15.53:0/3650826287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4ef000 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009cf0 tx=0x7f57a8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d153bfdddd677761 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f5797fff640 1 -- 172.21.15.53:0/3650826287 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a801e070 con 0x55b19d1222f0 2024-08-31T06:06:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f5797fff640 1 -- 172.21.15.53:0/3650826287 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57a8009de0 con 0x55b19d1222f0 2024-08-31T06:06:44.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.373+0000 7f5797fff640 1 -- 172.21.15.53:0/3650826287 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8019450 con 0x55b19d1222f0 2024-08-31T06:06:44.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.374+0000 7f57babbb740 1 -- 172.21.15.53:0/3650826287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 msgr2=0x55b19d4ef000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.374+0000 7f57b210b640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57980b4ca0 0x7f57980b71b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f57a40e2ef0 tx=0x7f57a4093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.374+0000 7f57babbb740 1 --2- 172.21.15.53:0/3650826287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4ef000 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009cf0 tx=0x7f57a8011810 comp rx=0 tx=0).stop 2024-08-31T06:06:44.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.374+0000 7f57babbb740 1 -- 172.21.15.53:0/3650826287 shutdown_connections 2024-08-31T06:06:44.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.374+0000 7f57babbb740 1 --2- 172.21.15.53:0/3650826287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4ef540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.374+0000 7f57babbb740 1 --2- 172.21.15.53:0/3650826287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4ef000 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.374+0000 7f57babbb740 1 --2- 172.21.15.53:0/3650826287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d4eeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.374+0000 7f57babbb740 1 -- 172.21.15.53:0/3650826287 >> 172.21.15.53:0/3650826287 conn(0x55b19d13f300 msgr2=0x55b19d4ec9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.374+0000 7f57babbb740 1 -- 172.21.15.53:0/3650826287 shutdown_connections 2024-08-31T06:06:44.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.374+0000 7f57babbb740 1 -- 172.21.15.53:0/3650826287 wait complete. 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.375+0000 7f57babbb740 1 -- start start 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.375+0000 7f57babbb740 1 Processor -- start 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.375+0000 7f57babbb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4fa670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.375+0000 7f57babbb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4fabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.375+0000 7f57babbb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d506530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.375+0000 7f57babbb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b19d38cab0 con 0x55b19d1222f0 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.375+0000 7f57babbb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b19d3da680 con 0x55b19d14b1b0 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.375+0000 7f57babbb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b19d4fd240 con 0x55b19d12a4d0 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.375+0000 7f57babbb740 10 client.0 _ll_register_callbacks cb 0x55b19d162a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.375+0000 7f57b1109640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57b1109640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4fa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45466/0 (socket says 172.21.15.53:45466) 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57b1109640 1 -- 172.21.15.53:0/1288309544 learned_addr learned my addr 172.21.15.53:0/1288309544 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:44.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57b190a640 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4fabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57b1109640 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d506530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57b1109640 1 -- 172.21.15.53:0/1288309544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 msgr2=0x55b19d4fabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57b1109640 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4fabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57b1109640 1 -- 172.21.15.53:0/1288309544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 msgr2=0x55b19d506530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57b1109640 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d506530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57b1109640 1 -- 172.21.15.53:0/1288309544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19d22f620 con 0x55b19d1222f0 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57b190a640 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4fabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57b1109640 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4fa670 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f579c005dc0 tx=0x7f579c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97891ae3f666d8e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57957fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57957fa640 1 -- 172.21.15.53:0/1288309544 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c035050 con 0x55b19d1222f0 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57957fa640 1 -- 172.21.15.53:0/1288309544 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f579c0036b0 con 0x55b19d1222f0 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57babbb740 1 -- 172.21.15.53:0/1288309544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a8009de0 con 0x55b19d1222f0 2024-08-31T06:06:44.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.376+0000 7f57957fa640 1 -- 172.21.15.53:0/1288309544 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f579c0038b0 con 0x55b19d1222f0 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.377+0000 7f57babbb740 10 client.16278 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.377+0000 7f57babbb740 1 -- 172.21.15.53:0/1288309544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b19d509250 con 0x55b19d1222f0 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.377+0000 7f57957fa640 1 -- 172.21.15.53:0/1288309544 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57a8009de0 con 0x55b19d1222f0 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.377+0000 7f57957fa640 1 -- 172.21.15.53:0/1288309544 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f579c056860 con 0x55b19d1222f0 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.377+0000 7f57babbb740 10 client.16278 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.377+0000 7f57babbb740 10 client.16278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.377+0000 7f57babbb740 20 client.16278 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.377+0000 7f57babbb740 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b19d109d80 0x55b19d50c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.377+0000 7f57babbb740 4 client.16278 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.377+0000 7f57babbb740 1 -- 172.21.15.53:0/1288309544 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b19d465f50 con 0x55b19d109d80 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.377+0000 7f57b190a640 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b19d109d80 0x55b19d50c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.378+0000 7f57957fa640 10 client.16278 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:44.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.378+0000 7f57b190a640 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b19d109d80 0x55b19d50c6d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb4459fe1bd20c59 server_cookie=8c86be15123a0cc2 in_seq=0 out_seq=0 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57957fa640 1 -- 172.21.15.53:0/1288309544 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b19d465f50 con 0x55b19d109d80 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57957fa640 10 client.16278 handle_command_reply: tid=0 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 1 client.16278 shutdown 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 1 -- 172.21.15.53:0/1288309544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 msgr2=0x55b19d4fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4fa670 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f579c005dc0 tx=0x7f579c02a410 comp rx=0 tx=0).stop 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 1 -- 172.21.15.53:0/1288309544 shutdown_connections 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b19d109d80 0x55b19d50c6d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d506530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4fabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57957fa640 0 client.16278 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 1 --2- 172.21.15.53:0/1288309544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d1222f0 0x55b19d4fa670 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 1 -- 172.21.15.53:0/1288309544 >> 172.21.15.53:0/1288309544 conn(0x55b19d13f300 msgr2=0x55b19d4efaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 1 -- 172.21.15.53:0/1288309544 shutdown_connections 2024-08-31T06:06:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 1 -- 172.21.15.53:0/1288309544 wait complete. 2024-08-31T06:06:44.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.379+0000 7f57babbb740 20 client.16278 trim_cache size 0 max 16384 2024-08-31T06:06:44.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.395+0000 7f57babbb740 1 Processor -- start 2024-08-31T06:06:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.395+0000 7f57babbb740 1 -- start start 2024-08-31T06:06:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57babbb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d1222f0 0x55b19d4f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57babbb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57babbb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d14b1b0 0x55b19d4f7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57babbb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac1ae320 con 0x55b19d14b1b0 2024-08-31T06:06:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57babbb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac1afe60 con 0x55b19d1222f0 2024-08-31T06:06:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57babbb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac1ae9f0 con 0x55b19d12a4d0 2024-08-31T06:06:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57b1109640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d14b1b0 0x55b19d4f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57b1109640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d14b1b0 0x55b19d4f7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45474/0 (socket says 172.21.15.53:45474) 2024-08-31T06:06:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57b1109640 1 -- 172.21.15.53:0/1223734314 learned_addr learned my addr 172.21.15.53:0/1223734314 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57b1109640 1 --2- 172.21.15.53:0/1223734314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d1222f0 0x55b19d4f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57b190a640 1 --2- 172.21.15.53:0/1223734314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57b1109640 1 -- 172.21.15.53:0/1223734314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 msgr2=0x55b19d4f40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57b1109640 1 --2- 172.21.15.53:0/1223734314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4f40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57b1109640 1 -- 172.21.15.53:0/1223734314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d1222f0 msgr2=0x55b19d4f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57b1109640 1 --2- 172.21.15.53:0/1223734314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d1222f0 0x55b19d4f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57b1109640 1 -- 172.21.15.53:0/1223734314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19d4f5f90 con 0x55b19d14b1b0 2024-08-31T06:06:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57b1109640 1 --2- 172.21.15.53:0/1223734314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d14b1b0 0x55b19d4f7630 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f579c004250 tx=0x7f579c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca810f611430753f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.396+0000 7f57977fe640 1 -- 172.21.15.53:0/1223734314 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c035070 con 0x55b19d14b1b0 2024-08-31T06:06:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.397+0000 7f57977fe640 1 -- 172.21.15.53:0/1223734314 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f579c05d070 con 0x55b19d14b1b0 2024-08-31T06:06:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.397+0000 7f57977fe640 1 -- 172.21.15.53:0/1223734314 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c003cb0 con 0x55b19d14b1b0 2024-08-31T06:06:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.397+0000 7f57babbb740 1 -- 172.21.15.53:0/1223734314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d14b1b0 msgr2=0x55b19d4f7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.397+0000 7f57babbb740 1 --2- 172.21.15.53:0/1223734314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d14b1b0 0x55b19d4f7630 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f579c004250 tx=0x7f579c005d50 comp rx=0 tx=0).stop 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.397+0000 7f57babbb740 1 -- 172.21.15.53:0/1223734314 shutdown_connections 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.397+0000 7f57babbb740 1 --2- 172.21.15.53:0/1223734314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d14b1b0 0x55b19d4f7630 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.397+0000 7f57babbb740 1 --2- 172.21.15.53:0/1223734314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d12a4d0 0x55b19d4f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.397+0000 7f57babbb740 1 --2- 172.21.15.53:0/1223734314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d1222f0 0x55b19d4f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.397+0000 7f57babbb740 1 -- 172.21.15.53:0/1223734314 >> 172.21.15.53:0/1223734314 conn(0x55b19d13f300 msgr2=0x55b19d4f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57babbb740 1 -- 172.21.15.53:0/1223734314 shutdown_connections 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57babbb740 1 -- 172.21.15.53:0/1223734314 wait complete. 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57babbb740 1 -- start start 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57babbb740 1 Processor -- start 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57babbb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d1222f0 0x55b19d5005f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57babbb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d12a4d0 0x55b19d500b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57babbb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d501070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57babbb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac1af790 con 0x55b19d12a4d0 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57babbb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac1af0c0 con 0x55b19d14b1b0 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57babbb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac1ac300 con 0x55b19d1222f0 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57babbb740 10 client.0 _ll_register_callbacks cb 0x7f579c004280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.398+0000 7f57b190a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d12a4d0 0x55b19d500b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57b1109640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d1222f0 0x55b19d5005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57b190a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d12a4d0 0x55b19d500b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45476/0 (socket says 172.21.15.53:45476) 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57b190a640 1 -- 172.21.15.53:0/2265669851 learned_addr learned my addr 172.21.15.53:0/2265669851 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57b1109640 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d501070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57b190a640 1 -- 172.21.15.53:0/2265669851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d1222f0 msgr2=0x55b19d5005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57b190a640 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d1222f0 0x55b19d5005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57b190a640 1 -- 172.21.15.53:0/2265669851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 msgr2=0x55b19d501070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57b190a640 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d501070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57b190a640 1 -- 172.21.15.53:0/2265669851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19d576220 con 0x55b19d12a4d0 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57b190a640 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d12a4d0 0x55b19d500b30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009c40 tx=0x7f57a80096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48f26ea124e57c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57957fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57957fa640 1 -- 172.21.15.53:0/2265669851 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8032060 con 0x55b19d12a4d0 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57957fa640 1 -- 172.21.15.53:0/2265669851 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f57a8003770 con 0x55b19d12a4d0 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57babbb740 1 -- 172.21.15.53:0/2265669851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f579c05d070 con 0x55b19d12a4d0 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57957fa640 1 -- 172.21.15.53:0/2265669851 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57a801e040 con 0x55b19d12a4d0 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57babbb740 10 client.16284 fetch_fsmap learned FSMap version 28 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.399+0000 7f57babbb740 1 -- 172.21.15.53:0/2265669851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b19d5774b0 con 0x55b19d12a4d0 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.400+0000 7f57957fa640 1 -- 172.21.15.53:0/2265669851 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f579c05d070 con 0x55b19d12a4d0 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.400+0000 7f57957fa640 1 -- 172.21.15.53:0/2265669851 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f57a802d7a0 con 0x55b19d12a4d0 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.400+0000 7f57babbb740 10 client.16284 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T06:06:44.406 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.400+0000 7f57babbb740 10 client.16284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:44.407 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.400+0000 7f57babbb740 20 client.16284 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:44.407 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.400+0000 7f57babbb740 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b19d0df1c0 0x55b19d579a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:44.407 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.400+0000 7f57babbb740 4 client.16284 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:06:44.407 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.400+0000 7f57babbb740 1 -- 172.21.15.53:0/2265669851 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b19d4619f0 con 0x55b19d0df1c0 2024-08-31T06:06:44.407 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.400+0000 7f57b1109640 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b19d0df1c0 0x55b19d579a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:44.407 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.400+0000 7f57957fa640 10 client.16284 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:44.407 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.400+0000 7f57b1109640 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b19d0df1c0 0x55b19d579a80 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c432dc07bd4eca68 server_cookie=63a1cdbb990e1924 in_seq=0 out_seq=0 2024-08-31T06:06:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.449+0000 7f57957fa640 1 -- 172.21.15.53:0/2265669851 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b19d4619f0 con 0x55b19d0df1c0 2024-08-31T06:06:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.449+0000 7f57957fa640 10 client.16284 handle_command_reply: tid=0 2024-08-31T06:06:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.449+0000 7f57babbb740 1 client.16284 shutdown 2024-08-31T06:06:44.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.449+0000 7f57babbb740 1 -- 172.21.15.53:0/2265669851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d12a4d0 msgr2=0x55b19d500b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.449+0000 7f57babbb740 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d12a4d0 0x55b19d500b30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009c40 tx=0x7f57a80096d0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57babbb740 1 -- 172.21.15.53:0/2265669851 shutdown_connections 2024-08-31T06:06:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57babbb740 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b19d0df1c0 0x55b19d579a80 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57957fa640 0 client.16284 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57babbb740 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b19d14b1b0 0x55b19d501070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57babbb740 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b19d12a4d0 0x55b19d500b30 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57babbb740 1 --2- 172.21.15.53:0/2265669851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b19d1222f0 0x55b19d5005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57babbb740 1 -- 172.21.15.53:0/2265669851 >> 172.21.15.53:0/2265669851 conn(0x55b19d13f300 msgr2=0x55b19d4f3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57babbb740 1 -- 172.21.15.53:0/2265669851 shutdown_connections 2024-08-31T06:06:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57babbb740 1 -- 172.21.15.53:0/2265669851 wait complete. 2024-08-31T06:06:44.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57babbb740 20 client.16284 trim_cache size 0 max 16384 2024-08-31T06:06:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:06:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:06:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:06:44.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2771552768 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57980b4ca0 msgr2=0x7f57980b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57b3b6e640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57980b4ca0 0x7f57980b71b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f57a40e2ef0 tx=0x7f57a4093040 comp rx=0 tx=0).stop 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2771552768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ac1089d0 msgr2=0x7f57ac19e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.450+0000 7f57b3b6e640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ac1089d0 0x7f57ac19e820 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f57a400eaa0 tx=0x7f57a400ef60 comp rx=0 tx=0).stop 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.451+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2771552768 shutdown_connections 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.451+0000 7f57b3b6e640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57980b4ca0 0x7f57980b71b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.451+0000 7f57b3b6e640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ac1089d0 0x7f57ac19e820 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.451+0000 7f57b3b6e640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57ac108080 0x7f57ac199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.451+0000 7f57b3b6e640 1 --2- 172.21.15.53:0/2771552768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57ac102750 0x7f57ac198ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.451+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2771552768 >> 172.21.15.53:0/2771552768 conn(0x7f57ac07a4e0 msgr2=0x7f57ac106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.451+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2771552768 shutdown_connections 2024-08-31T06:06:44.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:44.451+0000 7f57b3b6e640 1 -- 172.21.15.53:0/2771552768 wait complete. 2024-08-31T06:06:44.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 21774 3.99 MB/sec warmup 34 sec latency 29.567 ms 2024-08-31T06:06:45.084 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:06:45.084 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:06:45.385 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:45.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:45 smithi130 ceph-mon[22266]: pgmap v377: 97 pgs: 97 active+clean; 29 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.6 MiB/s wr, 111 op/s 2024-08-31T06:06:45.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:45 smithi153 ceph-mon[22320]: pgmap v377: 97 pgs: 97 active+clean; 29 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.6 MiB/s wr, 111 op/s 2024-08-31T06:06:45.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 22239 3.90 MB/sec warmup 35 sec latency 29.422 ms 2024-08-31T06:06:45.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:45 smithi053 ceph-mon[18924]: pgmap v377: 97 pgs: 97 active+clean; 29 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.6 MiB/s wr, 111 op/s 2024-08-31T06:06:46.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 22847 3.91 MB/sec warmup 36 sec latency 23.153 ms 2024-08-31T06:06:47.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:47 smithi053 ceph-mon[18924]: pgmap v378: 97 pgs: 97 active+clean; 25 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 1.8 MiB/s wr, 113 op/s 2024-08-31T06:06:47.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:47 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:06:47.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:47 smithi130 ceph-mon[22266]: pgmap v378: 97 pgs: 97 active+clean; 25 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 1.8 MiB/s wr, 113 op/s 2024-08-31T06:06:47.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:47 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:06:47.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:47 smithi153 ceph-mon[22320]: pgmap v378: 97 pgs: 97 active+clean; 25 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 1.8 MiB/s wr, 113 op/s 2024-08-31T06:06:47.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:47 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:06:47.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 23370 3.82 MB/sec warmup 37 sec latency 88.330 ms 2024-08-31T06:06:48.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 23875 3.78 MB/sec warmup 38 sec latency 59.158 ms 2024-08-31T06:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.512+0000 7f2004b18640 1 -- 172.21.15.53:0/666514905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20000754d0 msgr2=0x7f20000758e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.512+0000 7f2004b18640 1 --2- 172.21.15.53:0/666514905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20000754d0 0x7f20000758e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009900 tx=0x7f1ff002a410 comp rx=0 tx=0).stop 2024-08-31T06:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.512+0000 7f2004b18640 1 -- 172.21.15.53:0/666514905 shutdown_connections 2024-08-31T06:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.512+0000 7f2004b18640 1 --2- 172.21.15.53:0/666514905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f200010fee0 0x7f2000112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.512+0000 7f2004b18640 1 --2- 172.21.15.53:0/666514905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2000075e20 0x7f200010f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.512+0000 7f2004b18640 1 --2- 172.21.15.53:0/666514905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20000754d0 0x7f20000758e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.512+0000 7f2004b18640 1 -- 172.21.15.53:0/666514905 >> 172.21.15.53:0/666514905 conn(0x7f200007b5f0 msgr2=0x7f200007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.512+0000 7f2004b18640 1 -- 172.21.15.53:0/666514905 shutdown_connections 2024-08-31T06:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.512+0000 7f2004b18640 1 -- 172.21.15.53:0/666514905 wait complete. 2024-08-31T06:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.513+0000 7f2004b18640 1 Processor -- start 2024-08-31T06:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.513+0000 7f2004b18640 1 -- start start 2024-08-31T06:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f2004b18640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20000754d0 0x7f200019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f2004b18640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2000075e20 0x7f200019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f2004b18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f200010fee0 0x7f20001a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f2004b18640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2000115920 con 0x7f200010fee0 2024-08-31T06:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f2004b18640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20001157a0 con 0x7f2000075e20 2024-08-31T06:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f2004b18640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2000115aa0 con 0x7f20000754d0 2024-08-31T06:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f200010fee0 0x7f20001a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffdd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2000075e20 0x7f200019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffe59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20000754d0 0x7f200019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f200010fee0 0x7f20001a1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45494/0 (socket says 172.21.15.53:45494) 2024-08-31T06:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffdd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2000075e20 0x7f200019c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50286/0 (socket says 172.21.15.53:50286) 2024-08-31T06:06:49.441 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:06:49.441 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":29,"btime":"2024-08-31T06:06:46:503227+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:06:45.525320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:06:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffed9d640 1 -- 172.21.15.53:0/2113690290 learned_addr learned my addr 172.21.15.53:0/2113690290 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffed9d640 1 -- 172.21.15.53:0/2113690290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20000754d0 msgr2=0x7f200019c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffed9d640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20000754d0 0x7f200019c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffed9d640 1 -- 172.21.15.53:0/2113690290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2000075e20 msgr2=0x7f200019c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffed9d640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2000075e20 0x7f200019c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffed9d640 1 -- 172.21.15.53:0/2113690290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20001a2360 con 0x7f200010fee0 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffdd9b640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2000075e20 0x7f200019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1ffed9d640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f200010fee0 0x7f20001a1c30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800cad0 tx=0x7f1ff800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.514+0000 7f1fef7fe640 1 -- 172.21.15.53:0/2113690290 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800ae20 con 0x7f200010fee0 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.515+0000 7f2004b18640 1 -- 172.21.15.53:0/2113690290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20001a2650 con 0x7f200010fee0 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.515+0000 7f1fef7fe640 1 -- 172.21.15.53:0/2113690290 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ff8005020 con 0x7f200010fee0 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.515+0000 7f1fef7fe640 1 -- 172.21.15.53:0/2113690290 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800f6b0 con 0x7f200010fee0 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.515+0000 7f2004b18640 1 -- 172.21.15.53:0/2113690290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20001a8db0 con 0x7f200010fee0 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.516+0000 7f2004b18640 1 -- 172.21.15.53:0/2113690290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20000758e0 con 0x7f200010fee0 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.517+0000 7f1fef7fe640 1 -- 172.21.15.53:0/2113690290 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1ff80051d0 con 0x7f200010fee0 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.518+0000 7f1fef7fe640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1fe80b4ca0 0x7f1fe80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.518+0000 7f1ffe59c640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1fe80b4ca0 0x7f1fe80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.518+0000 7f1fef7fe640 1 -- 172.21.15.53:0/2113690290 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1ff80e5980 con 0x7f200010fee0 2024-08-31T06:06:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.519+0000 7f1ffe59c640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1fe80b4ca0 0x7f1fe80b71b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0006010 tx=0x7f1ff0000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.521+0000 7f1fef7fe640 1 -- 172.21.15.53:0/2113690290 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1ff8014030 con 0x7f200010fee0 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.792+0000 7f2004b18640 1 -- 172.21.15.53:0/2113690290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f200019d520 con 0x7f200010fee0 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.793+0000 7f1fef7fe640 1 -- 172.21.15.53:0/2113690290 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11986 (secure 0 0 0) 0x7f1ff80ac120 con 0x7f200010fee0 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 29 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 -- 172.21.15.53:0/2113690290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1fe80b4ca0 msgr2=0x7f1fe80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1fe80b4ca0 0x7f1fe80b71b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0006010 tx=0x7f1ff0000bc0 comp rx=0 tx=0).stop 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 -- 172.21.15.53:0/2113690290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f200010fee0 msgr2=0x7f20001a1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f200010fee0 0x7f20001a1c30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800cad0 tx=0x7f1ff800cf90 comp rx=0 tx=0).stop 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 -- 172.21.15.53:0/2113690290 shutdown_connections 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1fe80b4ca0 0x7f1fe80b71b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f200010fee0 0x7f20001a1c30 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2000075e20 0x7f200019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 --2- 172.21.15.53:0/2113690290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20000754d0 0x7f200019c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 -- 172.21.15.53:0/2113690290 >> 172.21.15.53:0/2113690290 conn(0x7f200007b5f0 msgr2=0x7f2000100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 -- 172.21.15.53:0/2113690290 shutdown_connections 2024-08-31T06:06:49.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:48.795+0000 7f2004b18640 1 -- 172.21.15.53:0/2113690290 wait complete. 2024-08-31T06:06:49.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:49 smithi053 ceph-mon[18924]: pgmap v379: 97 pgs: 97 active+clean; 24 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 1.4 MiB/s wr, 96 op/s 2024-08-31T06:06:49.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:49 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2113690290' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:06:49.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:49 smithi130 ceph-mon[22266]: pgmap v379: 97 pgs: 97 active+clean; 24 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 1.4 MiB/s wr, 96 op/s 2024-08-31T06:06:49.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:49 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2113690290' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:06:49.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:49 smithi153 ceph-mon[22320]: pgmap v379: 97 pgs: 97 active+clean; 24 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 1.4 MiB/s wr, 96 op/s 2024-08-31T06:06:49.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:49 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2113690290' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:06:49.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 24626 3.85 MB/sec warmup 39 sec latency 89.540 ms 2024-08-31T06:06:50.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 25096 3.86 MB/sec warmup 40 sec latency 14.566 ms 2024-08-31T06:06:51.222 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:06:51.490 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:51.772 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:51 smithi053 ceph-mon[18924]: pgmap v380: 97 pgs: 97 active+clean; 25 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 1.7 MiB/s wr, 124 op/s 2024-08-31T06:06:51.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:51 smithi130 ceph-mon[22266]: pgmap v380: 97 pgs: 97 active+clean; 25 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 1.7 MiB/s wr, 124 op/s 2024-08-31T06:06:51.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:51 smithi153 ceph-mon[22320]: pgmap v380: 97 pgs: 97 active+clean; 25 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 1.7 MiB/s wr, 124 op/s 2024-08-31T06:06:51.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 25358 3.78 MB/sec warmup 41 sec latency 22.457 ms 2024-08-31T06:06:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.001+0000 7f3178d2e640 1 -- 172.21.15.53:0/3726939935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3174108170 msgr2=0x7f3174108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.001+0000 7f3178d2e640 1 --2- 172.21.15.53:0/3726939935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3174108170 0x7f3174108580 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f3168009900 tx=0x7f316802a410 comp rx=0 tx=0).stop 2024-08-31T06:06:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.002+0000 7f3178d2e640 1 -- 172.21.15.53:0/3726939935 shutdown_connections 2024-08-31T06:06:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.002+0000 7f3178d2e640 1 --2- 172.21.15.53:0/3726939935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3174108ac0 0x7f317410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.002+0000 7f3178d2e640 1 --2- 172.21.15.53:0/3726939935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3174108170 0x7f3174108580 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.002+0000 7f3178d2e640 1 --2- 172.21.15.53:0/3726939935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3174102830 0x7f3174102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.002+0000 7f3178d2e640 1 -- 172.21.15.53:0/3726939935 >> 172.21.15.53:0/3726939935 conn(0x7f31740794d0 msgr2=0x7f31740798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.002+0000 7f3178d2e640 1 -- 172.21.15.53:0/3726939935 shutdown_connections 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.002+0000 7f3178d2e640 1 -- 172.21.15.53:0/3726939935 wait complete. 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.002+0000 7f3178d2e640 1 Processor -- start 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f3178d2e640 1 -- start start 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f3178d2e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3174102830 0x7f317419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f3178d2e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3174108170 0x7f317419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f3178d2e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3174108ac0 0x7f317419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f3178d2e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f31741125e0 con 0x7f3174102830 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f3178d2e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3174112460 con 0x7f3174108ac0 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f3178d2e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3174112760 con 0x7f3174108170 2024-08-31T06:06:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f317259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3174102830 0x7f317419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f317259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3174102830 0x7f317419a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45518/0 (socket says 172.21.15.53:45518) 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f317259c640 1 -- 172.21.15.53:0/210397434 learned_addr learned my addr 172.21.15.53:0/210397434 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f3172d9d640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3174108ac0 0x7f317419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f3171d9b640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3174108170 0x7f317419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f317259c640 1 -- 172.21.15.53:0/210397434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3174108170 msgr2=0x7f317419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f317259c640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3174108170 0x7f317419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f317259c640 1 -- 172.21.15.53:0/210397434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3174108ac0 msgr2=0x7f317419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f317259c640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3174108ac0 0x7f317419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.003+0000 7f317259c640 1 -- 172.21.15.53:0/210397434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31741a0150 con 0x7f3174102830 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.004+0000 7f317259c640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3174102830 0x7f317419a1e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f316400d950 tx=0x7f316400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.004+0000 7f31637fe640 1 -- 172.21.15.53:0/210397434 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164017070 con 0x7f3174102830 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.004+0000 7f31637fe640 1 -- 172.21.15.53:0/210397434 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3164009c30 con 0x7f3174102830 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.004+0000 7f3178d2e640 1 -- 172.21.15.53:0/210397434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31741a0440 con 0x7f3174102830 2024-08-31T06:06:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.004+0000 7f31637fe640 1 -- 172.21.15.53:0/210397434 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316400f620 con 0x7f3174102830 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.004+0000 7f3178d2e640 1 -- 172.21.15.53:0/210397434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31741a6ba0 con 0x7f3174102830 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.007+0000 7f31637fe640 1 -- 172.21.15.53:0/210397434 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3164010460 con 0x7f3174102830 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.007+0000 7f317f2a3740 1 Processor -- start 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.007+0000 7f317f2a3740 1 -- start start 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 0x55d244d71310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 0x55d244d71850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d71d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317f2a3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d244ce8680 con 0x55d2449cc070 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317f2a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d244cd7c10 con 0x55d2449a31b0 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317f2a3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d244cdbbc0 con 0x55d2449ab390 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f3172d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 0x55d244d71310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 0x55d244d71850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f3172d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 0x55d244d71310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45522/0 (socket says 172.21.15.53:45522) 2024-08-31T06:06:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f3172d9d640 1 -- 172.21.15.53:0/4046754423 learned_addr learned my addr 172.21.15.53:0/4046754423 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f31637fe640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f315c0b4ca0 0x7f315c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f3171d9b640 1 --2- 172.21.15.53:0/4046754423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d71d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f3172d9d640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f315c0b4ca0 0x7f315c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317259c640 1 -- 172.21.15.53:0/4046754423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 msgr2=0x55d244d71d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317259c640 1 --2- 172.21.15.53:0/4046754423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d71d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317259c640 1 -- 172.21.15.53:0/4046754423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 msgr2=0x55d244d71310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317259c640 1 --2- 172.21.15.53:0/4046754423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 0x55d244d71310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f317259c640 1 -- 172.21.15.53:0/4046754423 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d244a37650 con 0x55d2449a31b0 2024-08-31T06:06:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.008+0000 7f3171d9b640 1 --2- 172.21.15.53:0/4046754423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d71d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.009+0000 7f31637fe640 1 -- 172.21.15.53:0/210397434 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f31640e50f0 con 0x7f3174102830 2024-08-31T06:06:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.009+0000 7f317259c640 1 --2- 172.21.15.53:0/4046754423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 0x55d244d71850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f31640e28e0 tx=0x7f3164005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9518d1c4ccc319d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.009+0000 7f3172d9d640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f315c0b4ca0 0x7f315c0b71b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f316c0139c0 tx=0x7f316c004ab0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.009+0000 7f3160ff9640 1 -- 172.21.15.53:0/4046754423 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164020020 con 0x55d2449a31b0 2024-08-31T06:06:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.009+0000 7f3160ff9640 1 -- 172.21.15.53:0/4046754423 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31640abf80 con 0x55d2449a31b0 2024-08-31T06:06:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.009+0000 7f3160ff9640 1 -- 172.21.15.53:0/4046754423 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640b4ba0 con 0x55d2449a31b0 2024-08-31T06:06:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.010+0000 7f317f2a3740 1 -- 172.21.15.53:0/4046754423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 msgr2=0x55d244d71850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.010+0000 7f317f2a3740 1 --2- 172.21.15.53:0/4046754423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 0x55d244d71850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f31640e28e0 tx=0x7f3164005880 comp rx=0 tx=0).stop 2024-08-31T06:06:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.010+0000 7f317f2a3740 1 -- 172.21.15.53:0/4046754423 shutdown_connections 2024-08-31T06:06:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.010+0000 7f317f2a3740 1 --2- 172.21.15.53:0/4046754423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d71d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.010+0000 7f317f2a3740 1 --2- 172.21.15.53:0/4046754423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 0x55d244d71850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.010+0000 7f317f2a3740 1 --2- 172.21.15.53:0/4046754423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 0x55d244d71310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.010+0000 7f317f2a3740 1 -- 172.21.15.53:0/4046754423 >> 172.21.15.53:0/4046754423 conn(0x55d2449c0460 msgr2=0x55d244d6f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.010+0000 7f317f2a3740 1 -- 172.21.15.53:0/4046754423 shutdown_connections 2024-08-31T06:06:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.010+0000 7f317f2a3740 1 -- 172.21.15.53:0/4046754423 wait complete. 2024-08-31T06:06:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f317f2a3740 1 -- start start 2024-08-31T06:06:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f317f2a3740 1 Processor -- start 2024-08-31T06:06:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 0x55d244d80e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d813a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 0x55d244d8d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f317f2a3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d244b3a700 con 0x55d2449cc070 2024-08-31T06:06:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f317f2a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d244c5e750 con 0x55d2449a31b0 2024-08-31T06:06:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f317f2a3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d244d83d60 con 0x55d2449ab390 2024-08-31T06:06:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f317f2a3740 10 client.0 _ll_register_callbacks cb 0x55d244c8de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f3172d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 0x55d244d8d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f3172d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 0x55d244d8d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45526/0 (socket says 172.21.15.53:45526) 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f3172d9d640 1 -- 172.21.15.53:0/742714804 learned_addr learned my addr 172.21.15.53:0/742714804 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f317259c640 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 0x55d244d80e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.011+0000 7f3171d9b640 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d813a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f317259c640 1 -- 172.21.15.53:0/742714804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 msgr2=0x55d244d813a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f317259c640 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d813a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f317259c640 1 -- 172.21.15.53:0/742714804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 msgr2=0x55d244d8d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f317259c640 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 0x55d244d8d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f317259c640 1 -- 172.21.15.53:0/742714804 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d244c97900 con 0x55d2449a31b0 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f3172d9d640 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 0x55d244d8d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f317259c640 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 0x55d244d80e60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3164000c00 tx=0x7f31640e2d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d18b23e6459abb8f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f3159ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:06:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f3159ffb640 1 -- 172.21.15.53:0/742714804 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164020070 con 0x55d2449a31b0 2024-08-31T06:06:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f3159ffb640 1 -- 172.21.15.53:0/742714804 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f31640aaae0 con 0x55d2449a31b0 2024-08-31T06:06:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f317f2a3740 1 -- 172.21.15.53:0/742714804 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31640abf80 con 0x55d2449a31b0 2024-08-31T06:06:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f3159ffb640 1 -- 172.21.15.53:0/742714804 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f31640b4ba0 con 0x55d2449a31b0 2024-08-31T06:06:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f317f2a3740 10 client.25736 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.012+0000 7f317f2a3740 1 -- 172.21.15.53:0/742714804 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d244d8fb40 con 0x55d2449a31b0 2024-08-31T06:06:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.013+0000 7f3159ffb640 1 -- 172.21.15.53:0/742714804 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31640abf80 con 0x55d2449a31b0 2024-08-31T06:06:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.013+0000 7f3159ffb640 1 -- 172.21.15.53:0/742714804 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f31640a71f0 con 0x55d2449a31b0 2024-08-31T06:06:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.013+0000 7f317f2a3740 10 client.25736 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.013+0000 7f317f2a3740 10 client.25736 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:06:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.013+0000 7f317f2a3740 20 client.25736 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.013+0000 7f317f2a3740 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d24498a9f0 0x55d244d92ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.013+0000 7f317f2a3740 4 client.25736 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.013+0000 7f317f2a3740 1 -- 172.21.15.53:0/742714804 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d244cea5d0 con 0x55d24498a9f0 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.013+0000 7f3171d9b640 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d24498a9f0 0x55d244d92ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.014+0000 7f3159ffb640 10 client.25736 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.014+0000 7f3171d9b640 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d24498a9f0 0x55d244d92ea0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2cfb03fcf39a4f92 server_cookie=6a39d1844aeed15c in_seq=0 out_seq=0 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.014+0000 7f3159ffb640 1 -- 172.21.15.53:0/742714804 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d244cea5d0 con 0x55d24498a9f0 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.014+0000 7f3159ffb640 10 client.25736 handle_command_reply: tid=0 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.014+0000 7f317f2a3740 1 client.25736 shutdown 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.014+0000 7f317f2a3740 1 -- 172.21.15.53:0/742714804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 msgr2=0x55d244d80e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.014+0000 7f317f2a3740 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 0x55d244d80e60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3164000c00 tx=0x7f31640e2d90 comp rx=0 tx=0).stop 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.014+0000 7f317f2a3740 1 -- 172.21.15.53:0/742714804 shutdown_connections 2024-08-31T06:06:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.015+0000 7f317f2a3740 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449cc070 0x55d244d8d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.015+0000 7f317f2a3740 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d24498a9f0 0x55d244d92ea0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.015+0000 7f317f2a3740 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d813a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.015+0000 7f317f2a3740 1 --2- 172.21.15.53:0/742714804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449a31b0 0x55d244d80e60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.015+0000 7f317f2a3740 1 -- 172.21.15.53:0/742714804 >> 172.21.15.53:0/742714804 conn(0x55d2449c0460 msgr2=0x55d244d6d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.015+0000 7f3159ffb640 0 client.25736 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.015+0000 7f317f2a3740 1 -- 172.21.15.53:0/742714804 shutdown_connections 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.015+0000 7f317f2a3740 1 -- 172.21.15.53:0/742714804 wait complete. 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.015+0000 7f317f2a3740 20 client.25736 trim_cache size 0 max 16384 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.030+0000 7f317f2a3740 1 Processor -- start 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.030+0000 7f317f2a3740 1 -- start start 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.030+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d76d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.030+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d72a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.030+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449cc070 0x55d244d7e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.030+0000 7f317f2a3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ad180 con 0x55d2449a31b0 2024-08-31T06:06:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.030+0000 7f317f2a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f31741aed80 con 0x55d2449cc070 2024-08-31T06:06:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f317f2a3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ad850 con 0x55d2449ab390 2024-08-31T06:06:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f317259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d76d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f317259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d76d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45534/0 (socket says 172.21.15.53:45534) 2024-08-31T06:06:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f317259c640 1 -- 172.21.15.53:0/2570465875 learned_addr learned my addr 172.21.15.53:0/2570465875 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f3172d9d640 1 --2- 172.21.15.53:0/2570465875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449cc070 0x55d244d7e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f317259c640 1 -- 172.21.15.53:0/2570465875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 msgr2=0x55d244d72a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f3171d9b640 1 --2- 172.21.15.53:0/2570465875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d72a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f317259c640 1 --2- 172.21.15.53:0/2570465875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d72a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f317259c640 1 -- 172.21.15.53:0/2570465875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449cc070 msgr2=0x55d244d7e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f317259c640 1 --2- 172.21.15.53:0/2570465875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449cc070 0x55d244d7e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f317259c640 1 -- 172.21.15.53:0/2570465875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d244d6fb80 con 0x55d2449a31b0 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f317259c640 1 --2- 172.21.15.53:0/2570465875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d76d90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f31640ab810 tx=0x7f3164005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a35884b9877078 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.031+0000 7f315bfff640 1 -- 172.21.15.53:0/2570465875 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164020030 con 0x55d2449a31b0 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.032+0000 7f315bfff640 1 -- 172.21.15.53:0/2570465875 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31640a71f0 con 0x55d2449a31b0 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.032+0000 7f315bfff640 1 -- 172.21.15.53:0/2570465875 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640aa550 con 0x55d2449a31b0 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.032+0000 7f317f2a3740 1 -- 172.21.15.53:0/2570465875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 msgr2=0x55d244d76d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.032+0000 7f317f2a3740 1 --2- 172.21.15.53:0/2570465875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d76d90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f31640ab810 tx=0x7f3164005bb0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.032+0000 7f317f2a3740 1 -- 172.21.15.53:0/2570465875 shutdown_connections 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.032+0000 7f317f2a3740 1 --2- 172.21.15.53:0/2570465875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449cc070 0x55d244d7e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.032+0000 7f317f2a3740 1 --2- 172.21.15.53:0/2570465875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449ab390 0x55d244d72a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.032+0000 7f317f2a3740 1 --2- 172.21.15.53:0/2570465875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d76d90 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.032+0000 7f317f2a3740 1 -- 172.21.15.53:0/2570465875 >> 172.21.15.53:0/2570465875 conn(0x55d2449c0460 msgr2=0x55d244d72340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.033+0000 7f317f2a3740 1 -- 172.21.15.53:0/2570465875 shutdown_connections 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.033+0000 7f317f2a3740 1 -- 172.21.15.53:0/2570465875 wait complete. 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.033+0000 7f317f2a3740 1 -- start start 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.033+0000 7f317f2a3740 1 Processor -- start 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.033+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d95a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.033+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449ab390 0x55d244d96040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.033+0000 7f317f2a3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449cc070 0x55d244df35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.033+0000 7f317f2a3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ae5f0 con 0x55d2449a31b0 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.033+0000 7f317f2a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f31741adf20 con 0x55d2449ab390 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.033+0000 7f317f2a3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ab160 con 0x55d2449cc070 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f317259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d95a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f317f2a3740 10 client.0 _ll_register_callbacks cb 0x7f316c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f3171d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449ab390 0x55d244d96040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f317259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d95a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45548/0 (socket says 172.21.15.53:45548) 2024-08-31T06:06:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f317259c640 1 -- 172.21.15.53:0/198080669 learned_addr learned my addr 172.21.15.53:0/198080669 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f3172d9d640 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449cc070 0x55d244df35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f317259c640 1 -- 172.21.15.53:0/198080669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449cc070 msgr2=0x55d244df35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f317259c640 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449cc070 0x55d244df35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f317259c640 1 -- 172.21.15.53:0/198080669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449ab390 msgr2=0x55d244d96040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f317259c640 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449ab390 0x55d244d96040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f317259c640 1 -- 172.21.15.53:0/198080669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d244df3c40 con 0x55d2449a31b0 2024-08-31T06:06:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f3171d9b640 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449ab390 0x55d244d96040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f317259c640 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d95a60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3164012040 tx=0x7f31640a7d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcb2291fb6b1f8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.034+0000 7f3159ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f3159ffb640 1 -- 172.21.15.53:0/198080669 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164020070 con 0x55d2449a31b0 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f3159ffb640 1 -- 172.21.15.53:0/198080669 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f31640acbb0 con 0x55d2449a31b0 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f317f2a3740 1 -- 172.21.15.53:0/198080669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31640a71f0 con 0x55d2449a31b0 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f3159ffb640 1 -- 172.21.15.53:0/198080669 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f31640a73a0 con 0x55d2449a31b0 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f317f2a3740 10 client.16308 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f317f2a3740 1 -- 172.21.15.53:0/198080669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d244df3c40 con 0x55d2449a31b0 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f3159ffb640 1 -- 172.21.15.53:0/198080669 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31640a71f0 con 0x55d2449a31b0 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f3159ffb640 1 -- 172.21.15.53:0/198080669 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f31640b1280 con 0x55d2449a31b0 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f317f2a3740 10 client.16308 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f317f2a3740 10 client.16308 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:06:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f317f2a3740 20 client.16308 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f317f2a3740 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d24495fda0 0x55d244dff610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f317f2a3740 4 client.16308 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.035+0000 7f317f2a3740 1 -- 172.21.15.53:0/198080669 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d244ce6070 con 0x55d24495fda0 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f3171d9b640 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d24495fda0 0x55d244dff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f3159ffb640 10 client.16308 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f3171d9b640 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d24495fda0 0x55d244dff610 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7e532c3893adbd4d server_cookie=d37a0583121b0a47 in_seq=0 out_seq=0 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f3159ffb640 1 -- 172.21.15.53:0/198080669 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d244ce6070 con 0x55d24495fda0 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f3159ffb640 10 client.16308 handle_command_reply: tid=0 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f317f2a3740 1 client.16308 shutdown 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f317f2a3740 1 -- 172.21.15.53:0/198080669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 msgr2=0x55d244d95a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f317f2a3740 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d95a60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3164012040 tx=0x7f31640a7d40 comp rx=0 tx=0).stop 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f317f2a3740 1 -- 172.21.15.53:0/198080669 shutdown_connections 2024-08-31T06:06:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f317f2a3740 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d24495fda0 0x55d244dff610 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f317f2a3740 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2449cc070 0x55d244df35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f317f2a3740 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d2449ab390 0x55d244d96040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.036+0000 7f317f2a3740 1 --2- 172.21.15.53:0/198080669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2449a31b0 0x55d244d95a60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.037+0000 7f317f2a3740 1 -- 172.21.15.53:0/198080669 >> 172.21.15.53:0/198080669 conn(0x55d2449c0460 msgr2=0x55d244d72c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.037+0000 7f3159ffb640 0 client.16308 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:06:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.037+0000 7f317f2a3740 1 -- 172.21.15.53:0/198080669 shutdown_connections 2024-08-31T06:06:52.060 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:06:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.037+0000 7f317f2a3740 1 -- 172.21.15.53:0/198080669 wait complete. 2024-08-31T06:06:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.037+0000 7f317f2a3740 20 client.16308 trim_cache size 0 max 16384 2024-08-31T06:06:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.037+0000 7f3178d2e640 1 -- 172.21.15.53:0/210397434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f315c0b4ca0 msgr2=0x7f315c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.037+0000 7f3178d2e640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f315c0b4ca0 0x7f315c0b71b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f316c0139c0 tx=0x7f316c004ab0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.037+0000 7f3178d2e640 1 -- 172.21.15.53:0/210397434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3174102830 msgr2=0x7f317419a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.037+0000 7f3178d2e640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3174102830 0x7f317419a1e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f316400d950 tx=0x7f316400de10 comp rx=0 tx=0).stop 2024-08-31T06:06:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.038+0000 7f3178d2e640 1 -- 172.21.15.53:0/210397434 shutdown_connections 2024-08-31T06:06:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.038+0000 7f3178d2e640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f315c0b4ca0 0x7f315c0b71b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.038+0000 7f3178d2e640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3174108ac0 0x7f317419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.038+0000 7f3178d2e640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3174108170 0x7f317419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.038+0000 7f3178d2e640 1 --2- 172.21.15.53:0/210397434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3174102830 0x7f317419a1e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.038+0000 7f3178d2e640 1 -- 172.21.15.53:0/210397434 >> 172.21.15.53:0/210397434 conn(0x7f31740794d0 msgr2=0x7f3174101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.038+0000 7f3178d2e640 1 -- 172.21.15.53:0/210397434 shutdown_connections 2024-08-31T06:06:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:52.038+0000 7f3178d2e640 1 -- 172.21.15.53:0/210397434 wait complete. 2024-08-31T06:06:52.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:52 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:06:52.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:06:52.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:52 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:06:52.928 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:52 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:06:52.960 INFO:tasks.workunit.client.0.smithi053.stdout: 1 25626 3.70 MB/sec warmup 42 sec latency 302.705 ms 2024-08-31T06:06:53.123 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:53.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.607+0000 7f7a1955a640 1 -- 172.21.15.53:0/345442362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a14108140 msgr2=0x7f7a14108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:53.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.607+0000 7f7a1955a640 1 --2- 172.21.15.53:0/345442362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a14108140 0x7f7a14108550 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009900 tx=0x7f7a0802a410 comp rx=0 tx=0).stop 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.607+0000 7f7a1955a640 1 -- 172.21.15.53:0/345442362 shutdown_connections 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.607+0000 7f7a1955a640 1 --2- 172.21.15.53:0/345442362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a14108a90 0x7f7a1410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.607+0000 7f7a1955a640 1 --2- 172.21.15.53:0/345442362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a14108140 0x7f7a14108550 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.607+0000 7f7a1955a640 1 --2- 172.21.15.53:0/345442362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a14102800 0x7f7a14102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.607+0000 7f7a1955a640 1 -- 172.21.15.53:0/345442362 >> 172.21.15.53:0/345442362 conn(0x7f7a140794d0 msgr2=0x7f7a140798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.607+0000 7f7a1955a640 1 -- 172.21.15.53:0/345442362 shutdown_connections 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.607+0000 7f7a1955a640 1 -- 172.21.15.53:0/345442362 wait complete. 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.608+0000 7f7a1955a640 1 Processor -- start 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.608+0000 7f7a1955a640 1 -- start start 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a1955a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a14102800 0x7f7a14199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a1955a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a14108140 0x7f7a14199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a1955a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a14108a90 0x7f7a1419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a1955a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14112590 con 0x7f7a14108140 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a1955a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14112410 con 0x7f7a14108a90 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a1955a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14112710 con 0x7f7a14102800 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a127fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a14108140 0x7f7a14199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a127fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a14108140 0x7f7a14199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43222/0 (socket says 172.21.15.53:43222) 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a127fc640 1 -- 172.21.15.53:0/3565571890 learned_addr learned my addr 172.21.15.53:0/3565571890 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a12ffd640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a14102800 0x7f7a14199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a137fe640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a14108a90 0x7f7a1419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a127fc640 1 -- 172.21.15.53:0/3565571890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a14102800 msgr2=0x7f7a14199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a127fc640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a14102800 0x7f7a14199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a127fc640 1 -- 172.21.15.53:0/3565571890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a14108a90 msgr2=0x7f7a1419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a127fc640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a14108a90 0x7f7a1419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a127fc640 1 -- 172.21.15.53:0/3565571890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1419efd0 con 0x7f7a14108140 2024-08-31T06:06:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.609+0000 7f7a127fc640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a14108140 0x7f7a14199600 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7a08005940 tx=0x7f7a080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.610+0000 7f79fbfff640 1 -- 172.21.15.53:0/3565571890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0803f030 con 0x7f7a14108140 2024-08-31T06:06:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.610+0000 7f7a1955a640 1 -- 172.21.15.53:0/3565571890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1419f260 con 0x7f7a14108140 2024-08-31T06:06:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.610+0000 7f79fbfff640 1 -- 172.21.15.53:0/3565571890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a08003c90 con 0x7f7a14108140 2024-08-31T06:06:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.610+0000 7f79fbfff640 1 -- 172.21.15.53:0/3565571890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08035070 con 0x7f7a14108140 2024-08-31T06:06:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.610+0000 7f7a1955a640 1 -- 172.21.15.53:0/3565571890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a141a5a20 con 0x7f7a14108140 2024-08-31T06:06:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.612+0000 7f7a1facf740 1 Processor -- start 2024-08-31T06:06:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.612+0000 7f7a1facf740 1 -- start start 2024-08-31T06:06:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.612+0000 7f79fbfff640 1 -- 172.21.15.53:0/3565571890 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7a08042030 con 0x7f7a14108140 2024-08-31T06:06:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.612+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308e4070 0x563430c89350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.612+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c89890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.612+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430c89dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.612+0000 7f7a1facf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563430c00680 con 0x5634308bb1b0 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.612+0000 7f7a1facf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563430befc10 con 0x5634308e4070 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.612+0000 7f7a1facf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563430bf3bc0 con 0x5634308c3390 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a12ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c89890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a12ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c89890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43232/0 (socket says 172.21.15.53:43232) 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a12ffd640 1 -- 172.21.15.53:0/84939555 learned_addr learned my addr 172.21.15.53:0/84939555 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a127fc640 1 --2- 172.21.15.53:0/84939555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430c89dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a137fe640 1 --2- 172.21.15.53:0/84939555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308e4070 0x563430c89350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a12ffd640 1 -- 172.21.15.53:0/84939555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 msgr2=0x563430c89dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a12ffd640 1 --2- 172.21.15.53:0/84939555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430c89dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a12ffd640 1 -- 172.21.15.53:0/84939555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308e4070 msgr2=0x563430c89350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a12ffd640 1 --2- 172.21.15.53:0/84939555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308e4070 0x563430c89350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a12ffd640 1 -- 172.21.15.53:0/84939555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56343094f650 con 0x5634308bb1b0 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a127fc640 1 --2- 172.21.15.53:0/84939555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430c89dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f7a12ffd640 1 --2- 172.21.15.53:0/84939555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c89890 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400bd50 tx=0x7f7a040107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76de7a4934e4b7ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f79f97fa640 1 -- 172.21.15.53:0/84939555 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a04005220 con 0x5634308bb1b0 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f79f97fa640 1 -- 172.21.15.53:0/84939555 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a0400be40 con 0x5634308bb1b0 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f79fbfff640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79fc0b4ca0 0x7f79fc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.613+0000 7f79f97fa640 1 -- 172.21.15.53:0/84939555 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a040116a0 con 0x5634308bb1b0 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.614+0000 7f7a137fe640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79fc0b4ca0 0x7f79fc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.614+0000 7f79fbfff640 1 -- 172.21.15.53:0/3565571890 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7a08105a10 con 0x7f7a14108140 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.614+0000 7f7a1facf740 1 -- 172.21.15.53:0/84939555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 msgr2=0x563430c89890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.614+0000 7f7a137fe640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79fc0b4ca0 0x7f79fc0b71b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00ae90 tx=0x7f7a0c00a4d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.614+0000 7f7a1facf740 1 --2- 172.21.15.53:0/84939555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c89890 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400bd50 tx=0x7f7a040107a0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.614+0000 7f7a1facf740 1 -- 172.21.15.53:0/84939555 shutdown_connections 2024-08-31T06:06:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.614+0000 7f7a1facf740 1 --2- 172.21.15.53:0/84939555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430c89dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.614+0000 7f7a1facf740 1 --2- 172.21.15.53:0/84939555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c89890 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.614+0000 7f7a1facf740 1 --2- 172.21.15.53:0/84939555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308e4070 0x563430c89350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.614+0000 7f7a1facf740 1 -- 172.21.15.53:0/84939555 >> 172.21.15.53:0/84939555 conn(0x5634308d8460 msgr2=0x563430c87240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a1facf740 1 -- 172.21.15.53:0/84939555 shutdown_connections 2024-08-31T06:06:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a1facf740 1 -- 172.21.15.53:0/84939555 wait complete. 2024-08-31T06:06:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a1facf740 1 -- start start 2024-08-31T06:06:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a1facf740 1 Processor -- start 2024-08-31T06:06:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308bb1b0 0x563430c94ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308c3390 0x563430c94ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a1facf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563430a52700 con 0x5634308e4070 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a1facf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563430b76750 con 0x5634308c3390 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a1facf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563430c97b30 con 0x5634308bb1b0 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a1facf740 10 client.0 _ll_register_callbacks cb 0x563430ba5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.615+0000 7f7a137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f7a137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43238/0 (socket says 172.21.15.53:43238) 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f7a137fe640 1 -- 172.21.15.53:0/573001302 learned_addr learned my addr 172.21.15.53:0/573001302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f7a12ffd640 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308bb1b0 0x563430c94ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f7a127fc640 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308c3390 0x563430c94ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f7a137fe640 1 -- 172.21.15.53:0/573001302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308bb1b0 msgr2=0x563430c94ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f7a137fe640 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308bb1b0 0x563430c94ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f7a137fe640 1 -- 172.21.15.53:0/573001302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308c3390 msgr2=0x563430c94ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:53.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f7a137fe640 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308c3390 0x563430c94ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f7a137fe640 1 -- 172.21.15.53:0/573001302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563430baf900 con 0x5634308e4070 2024-08-31T06:06:53.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f7a137fe640 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca0e50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c01ec20 tx=0x7f7a0c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f74c8065a54a9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:53.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f79f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:53.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f79f6ff5640 1 -- 172.21.15.53:0/573001302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c02b060 con 0x5634308e4070 2024-08-31T06:06:53.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f7a1facf740 1 -- 172.21.15.53:0/573001302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563430c025d0 con 0x5634308e4070 2024-08-31T06:06:53.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.616+0000 7f79f6ff5640 1 -- 172.21.15.53:0/573001302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7a0c016030 con 0x5634308e4070 2024-08-31T06:06:53.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f79f6ff5640 1 -- 172.21.15.53:0/573001302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7a0c01ec50 con 0x5634308e4070 2024-08-31T06:06:53.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f7a1facf740 10 client.16320 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:53.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f7a1facf740 1 -- 172.21.15.53:0/573001302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563430ca3950 con 0x5634308e4070 2024-08-31T06:06:53.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f79f6ff5640 1 -- 172.21.15.53:0/573001302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563430c025d0 con 0x5634308e4070 2024-08-31T06:06:53.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f79f6ff5640 1 -- 172.21.15.53:0/573001302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f7a0c01b400 con 0x5634308e4070 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f7a1facf740 10 client.16320 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f7a1facf740 10 client.16320 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f7a1facf740 20 client.16320 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f7a1facf740 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5634308a29f0 0x563430ca6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f7a1facf740 4 client.16320 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f7a1facf740 1 -- 172.21.15.53:0/573001302 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563430bfe070 con 0x5634308a29f0 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.617+0000 7f7a12ffd640 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5634308a29f0 0x563430ca6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.618+0000 7f7a12ffd640 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5634308a29f0 0x563430ca6ef0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=81b830ddc041c921 server_cookie=d70e22ade5d87d61 in_seq=0 out_seq=0 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.618+0000 7f79f6ff5640 10 client.16320 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f79f6ff5640 1 -- 172.21.15.53:0/573001302 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563430bfe070 con 0x5634308a29f0 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f79f6ff5640 10 client.16320 handle_command_reply: tid=0 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 1 client.16320 shutdown 2024-08-31T06:06:53.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 1 -- 172.21.15.53:0/573001302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 msgr2=0x563430ca0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:53.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca0e50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c01ec20 tx=0x7f7a0c004ab0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 1 -- 172.21.15.53:0/573001302 shutdown_connections 2024-08-31T06:06:53.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5634308a29f0 0x563430ca6ef0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca0e50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308c3390 0x563430c94ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f79f6ff5640 0 client.16320 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:06:53.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 1 --2- 172.21.15.53:0/573001302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308bb1b0 0x563430c94ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 1 -- 172.21.15.53:0/573001302 >> 172.21.15.53:0/573001302 conn(0x5634308d8460 msgr2=0x563430c8c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:53.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 1 -- 172.21.15.53:0/573001302 shutdown_connections 2024-08-31T06:06:53.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 1 -- 172.21.15.53:0/573001302 wait complete. 2024-08-31T06:06:53.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.619+0000 7f7a1facf740 20 client.16320 trim_cache size 0 max 16384 2024-08-31T06:06:53.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.632+0000 7f7a1facf740 1 Processor -- start 2024-08-31T06:06:53.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.632+0000 7f7a1facf740 1 -- start start 2024-08-31T06:06:53.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.632+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308bb1b0 0x563430c8cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.632+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430ca0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.632+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.632+0000 7f7a1facf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7a141af420 con 0x5634308e4070 2024-08-31T06:06:53.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.632+0000 7f7a1facf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7a141b1020 con 0x5634308bb1b0 2024-08-31T06:06:53.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.632+0000 7f7a1facf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a141afaf0 con 0x5634308c3390 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43248/0 (socket says 172.21.15.53:43248) 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a137fe640 1 -- 172.21.15.53:0/1417936680 learned_addr learned my addr 172.21.15.53:0/1417936680 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a127fc640 1 --2- 172.21.15.53:0/1417936680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430ca0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a12ffd640 1 --2- 172.21.15.53:0/1417936680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308bb1b0 0x563430c8cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a137fe640 1 -- 172.21.15.53:0/1417936680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 msgr2=0x563430ca0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a137fe640 1 --2- 172.21.15.53:0/1417936680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430ca0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a137fe640 1 -- 172.21.15.53:0/1417936680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308bb1b0 msgr2=0x563430c8cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a137fe640 1 --2- 172.21.15.53:0/1417936680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308bb1b0 0x563430c8cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a137fe640 1 -- 172.21.15.53:0/1417936680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563430c8bbe0 con 0x5634308e4070 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a127fc640 1 --2- 172.21.15.53:0/1417936680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430ca0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f7a137fe640 1 --2- 172.21.15.53:0/1417936680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca1290 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c004a80 tx=0x7f7a0c010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abb227dfcc0dcae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:53.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f79f8ff9640 1 -- 172.21.15.53:0/1417936680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c03d070 con 0x5634308e4070 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f79f8ff9640 1 -- 172.21.15.53:0/1417936680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a0c01b400 con 0x5634308e4070 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.633+0000 7f79f8ff9640 1 -- 172.21.15.53:0/1417936680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c038e40 con 0x5634308e4070 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.634+0000 7f7a1facf740 1 -- 172.21.15.53:0/1417936680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 msgr2=0x563430ca1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.634+0000 7f7a1facf740 1 --2- 172.21.15.53:0/1417936680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca1290 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c004a80 tx=0x7f7a0c010dd0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.634+0000 7f7a1facf740 1 -- 172.21.15.53:0/1417936680 shutdown_connections 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.634+0000 7f7a1facf740 1 --2- 172.21.15.53:0/1417936680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308e4070 0x563430ca1290 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.634+0000 7f7a1facf740 1 --2- 172.21.15.53:0/1417936680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430ca0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.634+0000 7f7a1facf740 1 --2- 172.21.15.53:0/1417936680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308bb1b0 0x563430c8cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.634+0000 7f7a1facf740 1 -- 172.21.15.53:0/1417936680 >> 172.21.15.53:0/1417936680 conn(0x5634308d8460 msgr2=0x563430c8c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.634+0000 7f7a1facf740 1 -- 172.21.15.53:0/1417936680 shutdown_connections 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.634+0000 7f7a1facf740 1 -- 172.21.15.53:0/1417936680 wait complete. 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a1facf740 1 -- start start 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a1facf740 1 Processor -- start 2024-08-31T06:06:53.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c996c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430c99c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a1facf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308e4070 0x563430d0a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a1facf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7a141b0890 con 0x5634308bb1b0 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a1facf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7a141b01c0 con 0x5634308e4070 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a1facf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a141ad400 con 0x5634308c3390 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a1facf740 10 client.0 _ll_register_callbacks cb 0x7f7a0c00a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a12ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a12ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43264/0 (socket says 172.21.15.53:43264) 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a12ffd640 1 -- 172.21.15.53:0/1356988872 learned_addr learned my addr 172.21.15.53:0/1356988872 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a137fe640 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308e4070 0x563430d0a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a127fc640 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430c99c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a12ffd640 1 -- 172.21.15.53:0/1356988872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 msgr2=0x563430c99c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a12ffd640 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430c99c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a12ffd640 1 -- 172.21.15.53:0/1356988872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308e4070 msgr2=0x563430d0a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a12ffd640 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308e4070 0x563430d0a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a12ffd640 1 -- 172.21.15.53:0/1356988872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563430d0af00 con 0x5634308bb1b0 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.635+0000 7f7a137fe640 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308e4070 0x563430d0a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f7a12ffd640 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c996c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7a04011010 tx=0x7f7a0400b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3306cd813e84ed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f79f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f79f6ff5640 1 -- 172.21.15.53:0/1356988872 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0402a030 con 0x5634308bb1b0 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f7a1facf740 1 -- 172.21.15.53:0/1356988872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a0c01b400 con 0x5634308bb1b0 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f79f6ff5640 1 -- 172.21.15.53:0/1356988872 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7a04005310 con 0x5634308bb1b0 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f79f6ff5640 1 -- 172.21.15.53:0/1356988872 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7a04005510 con 0x5634308bb1b0 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f7a1facf740 10 client.16326 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f7a1facf740 1 -- 172.21.15.53:0/1356988872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563430d12230 con 0x5634308bb1b0 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f79f6ff5640 1 -- 172.21.15.53:0/1356988872 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a0c01b400 con 0x5634308bb1b0 2024-08-31T06:06:53.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f79f6ff5640 1 -- 172.21.15.53:0/1356988872 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f7a04012560 con 0x5634308bb1b0 2024-08-31T06:06:53.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f7a1facf740 10 client.16326 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:53.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f7a1facf740 10 client.16326 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:06:53.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.636+0000 7f7a1facf740 20 client.16326 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:53.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.637+0000 7f7a1facf740 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x563430877da0 0x563430d14690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:53.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.637+0000 7f7a1facf740 4 client.16326 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:06:53.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.637+0000 7f7a1facf740 1 -- 172.21.15.53:0/1356988872 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563430c95420 con 0x563430877da0 2024-08-31T06:06:53.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.637+0000 7f7a127fc640 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x563430877da0 0x563430d14690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:53.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.637+0000 7f79f6ff5640 10 client.16326 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:06:53.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.637+0000 7f7a127fc640 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x563430877da0 0x563430d14690 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6269c7d193d5a440 server_cookie=f2d19e087479d32a in_seq=0 out_seq=0 2024-08-31T06:06:53.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.637+0000 7f79f6ff5640 1 -- 172.21.15.53:0/1356988872 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563430c95420 con 0x563430877da0 2024-08-31T06:06:53.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.637+0000 7f79f6ff5640 10 client.16326 handle_command_reply: tid=0 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.637+0000 7f7a1facf740 1 client.16326 shutdown 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.637+0000 7f7a1facf740 1 -- 172.21.15.53:0/1356988872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 msgr2=0x563430c996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.637+0000 7f7a1facf740 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c996c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7a04011010 tx=0x7f7a0400b7a0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1facf740 1 -- 172.21.15.53:0/1356988872 shutdown_connections 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1facf740 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634308e4070 0x563430d0a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1facf740 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634308c3390 0x563430c99c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1facf740 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x563430877da0 0x563430d14690 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1facf740 1 --2- 172.21.15.53:0/1356988872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634308bb1b0 0x563430c996c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1facf740 1 -- 172.21.15.53:0/1356988872 >> 172.21.15.53:0/1356988872 conn(0x5634308d8460 msgr2=0x563430c86b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f79f6ff5640 0 client.16326 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1facf740 1 -- 172.21.15.53:0/1356988872 shutdown_connections 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1facf740 1 -- 172.21.15.53:0/1356988872 wait complete. 2024-08-31T06:06:53.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1facf740 20 client.16326 trim_cache size 0 max 16384 2024-08-31T06:06:53.647 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:06:53.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1955a640 1 -- 172.21.15.53:0/3565571890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79fc0b4ca0 msgr2=0x7f79fc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:53.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1955a640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79fc0b4ca0 0x7f79fc0b71b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00ae90 tx=0x7f7a0c00a4d0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1955a640 1 -- 172.21.15.53:0/3565571890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a14108140 msgr2=0x7f7a14199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:53.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1955a640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a14108140 0x7f7a14199600 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7a08005940 tx=0x7f7a080042f0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1955a640 1 -- 172.21.15.53:0/3565571890 shutdown_connections 2024-08-31T06:06:53.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1955a640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79fc0b4ca0 0x7f79fc0b71b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1955a640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a14108a90 0x7f7a1419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1955a640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a14108140 0x7f7a14199600 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1955a640 1 --2- 172.21.15.53:0/3565571890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a14102800 0x7f7a14199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:53.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.638+0000 7f7a1955a640 1 -- 172.21.15.53:0/3565571890 >> 172.21.15.53:0/3565571890 conn(0x7f7a140794d0 msgr2=0x7f7a141050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:53.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.639+0000 7f7a1955a640 1 -- 172.21.15.53:0/3565571890 shutdown_connections 2024-08-31T06:06:53.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:53.639+0000 7f7a1955a640 1 -- 172.21.15.53:0/3565571890 wait complete. 2024-08-31T06:06:53.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:53 smithi130 ceph-mon[22266]: pgmap v381: 97 pgs: 97 active+clean; 26 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 1.4 MiB/s wr, 110 op/s 2024-08-31T06:06:53.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:53 smithi153 ceph-mon[22320]: pgmap v381: 97 pgs: 97 active+clean; 26 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 1.4 MiB/s wr, 110 op/s 2024-08-31T06:06:53.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 25626 3.61 MB/sec warmup 43 sec latency 1302.807 ms 2024-08-31T06:06:53.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:53 smithi053 ceph-mon[18924]: pgmap v381: 97 pgs: 97 active+clean; 26 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 1.4 MiB/s wr, 110 op/s 2024-08-31T06:06:54.469 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:06:54.728 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:54.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 25626 3.53 MB/sec warmup 44 sec latency 2302.847 ms 2024-08-31T06:06:55.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.232+0000 7fbdcb705640 1 -- 172.21.15.53:0/2288481230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdc4109b90 msgr2=0x7fbdc41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:55.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.232+0000 7fbdcb705640 1 --2- 172.21.15.53:0/2288481230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdc4109b90 0x7fbdc41103c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009ca0 tx=0x7fbdbc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.232+0000 7fbdcb705640 1 -- 172.21.15.53:0/2288481230 shutdown_connections 2024-08-31T06:06:55.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.232+0000 7fbdcb705640 1 --2- 172.21.15.53:0/2288481230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdc4109b90 0x7fbdc41103c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.232+0000 7fbdcb705640 1 --2- 172.21.15.53:0/2288481230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc4109240 0x7fbdc4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.232+0000 7fbdcb705640 1 --2- 172.21.15.53:0/2288481230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdc4103900 0x7fbdc4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.232+0000 7fbdcb705640 1 -- 172.21.15.53:0/2288481230 >> 172.21.15.53:0/2288481230 conn(0x7fbdc407b5f0 msgr2=0x7fbdc407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:55.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.232+0000 7fbdcb705640 1 -- 172.21.15.53:0/2288481230 shutdown_connections 2024-08-31T06:06:55.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.232+0000 7fbdcb705640 1 -- 172.21.15.53:0/2288481230 wait complete. 2024-08-31T06:06:55.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.233+0000 7fbdcb705640 1 Processor -- start 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.233+0000 7fbdcb705640 1 -- start start 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.233+0000 7fbdcb705640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdc4103900 0x7fbdc419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.233+0000 7fbdcb705640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc4109240 0x7fbdc419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.233+0000 7fbdcb705640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdc4109b90 0x7fbdc419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.233+0000 7fbdcb705640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4113750 con 0x7fbdc4103900 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.233+0000 7fbdcb705640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41135d0 con 0x7fbdc4109b90 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.233+0000 7fbdcb705640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41138d0 con 0x7fbdc4109240 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.233+0000 7fbdc94a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdc4103900 0x7fbdc419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.233+0000 7fbdc94a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdc4103900 0x7fbdc419a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43288/0 (socket says 172.21.15.53:43288) 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.233+0000 7fbdc94a1640 1 -- 172.21.15.53:0/1017340131 learned_addr learned my addr 172.21.15.53:0/1017340131 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc4109240 0x7fbdc419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdc94a1640 1 -- 172.21.15.53:0/1017340131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc4109240 msgr2=0x7fbdc419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:55.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdc94a1640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc4109240 0x7fbdc419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdc94a1640 1 -- 172.21.15.53:0/1017340131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdc4109b90 msgr2=0x7fbdc419f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdc4109b90 0x7fbdc419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdc94a1640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdc4109b90 0x7fbdc419f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdc94a1640 1 -- 172.21.15.53:0/1017340131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc41a0110 con 0x7fbdc4103900 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc4109240 0x7fbdc419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdc4109b90 0x7fbdc419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdc94a1640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdc4103900 0x7fbdc419a1a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000d950 tx=0x7fbdc000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdba7fc640 1 -- 172.21.15.53:0/1017340131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0017070 con 0x7fbdc4103900 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdcb705640 1 -- 172.21.15.53:0/1017340131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc41a0400 con 0x7fbdc4103900 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdba7fc640 1 -- 172.21.15.53:0/1017340131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdc0009c30 con 0x7fbdc4103900 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdba7fc640 1 -- 172.21.15.53:0/1017340131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc000f620 con 0x7fbdc4103900 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.234+0000 7fbdcb705640 1 -- 172.21.15.53:0/1017340131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc41a6b60 con 0x7fbdc4103900 2024-08-31T06:06:55.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.237+0000 7fbdd1c7a740 1 Processor -- start 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.237+0000 7fbdd1c7a740 1 -- start start 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.237+0000 7fbdba7fc640 1 -- 172.21.15.53:0/1017340131 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbdc0010460 con 0x7fbdc4103900 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.237+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599236b070 0x555992710310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.237+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923421b0 0x555992710850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599234a390 0x555992710d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555992687680 con 0x55599236b070 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555992676c10 con 0x55599234a390 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55599267abc0 con 0x5559923421b0 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc9ca2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599236b070 0x555992710310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc9ca2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599236b070 0x555992710310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43298/0 (socket says 172.21.15.53:43298) 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc9ca2640 1 -- 172.21.15.53:0/2374093854 learned_addr learned my addr 172.21.15.53:0/2374093854 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:55.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc94a1640 1 --2- 172.21.15.53:0/2374093854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923421b0 0x555992710850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/2374093854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599234a390 0x555992710d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc9ca2640 1 -- 172.21.15.53:0/2374093854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923421b0 msgr2=0x555992710850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/2374093854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923421b0 0x555992710850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc9ca2640 1 -- 172.21.15.53:0/2374093854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599234a390 msgr2=0x555992710d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/2374093854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599234a390 0x555992710d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc9ca2640 1 -- 172.21.15.53:0/2374093854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559923d6650 con 0x55599236b070 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdba7fc640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbdb00b4d20 0x7fbdb00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc94a1640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbdb00b4d20 0x7fbdb00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/2374093854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599236b070 0x555992710310 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc031500 tx=0x7fbdbc031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94909a0770a0c09a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.238+0000 7fbdba7fc640 1 -- 172.21.15.53:0/1017340131 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fbdc00e51d0 con 0x7fbdc4103900 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.239+0000 7fbdaf7fe640 1 -- 172.21.15.53:0/2374093854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc031980 con 0x55599236b070 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.239+0000 7fbdaf7fe640 1 -- 172.21.15.53:0/2374093854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdbc036070 con 0x55599236b070 2024-08-31T06:06:55.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.239+0000 7fbdaf7fe640 1 -- 172.21.15.53:0/2374093854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc004510 con 0x55599236b070 2024-08-31T06:06:55.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.239+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/2374093854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599236b070 msgr2=0x555992710310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.239+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/2374093854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599236b070 0x555992710310 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc031500 tx=0x7fbdbc031530 comp rx=0 tx=0).stop 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.240+0000 7fbdc94a1640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbdb00b4d20 0x7fbdb00b7230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00e29d0 tx=0x7fbdc00a7040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.240+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/2374093854 shutdown_connections 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.240+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/2374093854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599234a390 0x555992710d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.240+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/2374093854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923421b0 0x555992710850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.240+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/2374093854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599236b070 0x555992710310 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.240+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/2374093854 >> 172.21.15.53:0/2374093854 conn(0x55599235f460 msgr2=0x55599270e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.240+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/2374093854 shutdown_connections 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.240+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/2374093854 wait complete. 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.241+0000 7fbdd1c7a740 1 -- start start 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.241+0000 7fbdd1c7a740 1 Processor -- start 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.241+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923421b0 0x55599271bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.241+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599234a390 0x55599271bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.241+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599236b070 0x555992727db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.241+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559924d9700 con 0x55599234a390 2024-08-31T06:06:55.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.241+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5559925fd750 con 0x55599236b070 2024-08-31T06:06:55.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.241+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55599271ea90 con 0x5559923421b0 2024-08-31T06:06:55.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.241+0000 7fbdd1c7a740 10 client.0 _ll_register_callbacks cb 0x55599262ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:55.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdc8ca0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599234a390 0x55599271bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdc8ca0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599234a390 0x55599271bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43300/0 (socket says 172.21.15.53:43300) 2024-08-31T06:06:55.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/3208444705 learned_addr learned my addr 172.21.15.53:0/3208444705 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:55.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599236b070 0x555992727db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923421b0 0x55599271bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/3208444705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923421b0 msgr2=0x55599271bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923421b0 0x55599271bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/3208444705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599236b070 msgr2=0x555992727db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599236b070 0x555992727db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/3208444705 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555992636900 con 0x55599234a390 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599234a390 0x55599271bff0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4005fd0 tx=0x7fbdb4010b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298319d8961feff6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdacff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdacff9640 1 -- 172.21.15.53:0/3208444705 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4012920 con 0x55599234a390 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdacff9640 1 -- 172.21.15.53:0/3208444705 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fbdb4012ac0 con 0x55599234a390 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.242+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3208444705 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdbc036070 con 0x55599234a390 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.243+0000 7fbdacff9640 1 -- 172.21.15.53:0/3208444705 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbdb4012cc0 con 0x55599234a390 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.243+0000 7fbdd1c7a740 10 client.16338 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.243+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3208444705 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55599272a940 con 0x55599234a390 2024-08-31T06:06:55.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.243+0000 7fbdacff9640 1 -- 172.21.15.53:0/3208444705 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdbc036070 con 0x55599234a390 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.243+0000 7fbdacff9640 1 -- 172.21.15.53:0/3208444705 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fbdb400f040 con 0x55599234a390 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.243+0000 7fbdd1c7a740 10 client.16338 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.243+0000 7fbdd1c7a740 10 client.16338 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.243+0000 7fbdd1c7a740 20 client.16338 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.243+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5559923299f0 0x55599272df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.243+0000 7fbdd1c7a740 4 client.16338 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.243+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3208444705 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559926895d0 con 0x5559923299f0 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.244+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5559923299f0 0x55599272df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.244+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5559923299f0 0x55599272df10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24ef4cff219367e5 server_cookie=c546b533352cd496 in_seq=0 out_seq=0 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.244+0000 7fbdacff9640 10 client.16338 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdacff9640 1 -- 172.21.15.53:0/3208444705 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5559926895d0 con 0x5559923299f0 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdacff9640 10 client.16338 handle_command_reply: tid=0 2024-08-31T06:06:55.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 1 client.16338 shutdown 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3208444705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599234a390 msgr2=0x55599271bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599234a390 0x55599271bff0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4005fd0 tx=0x7fbdb4010b00 comp rx=0 tx=0).stop 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3208444705 shutdown_connections 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5559923299f0 0x55599272df10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599236b070 0x555992727db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdacff9640 0 client.16338 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599234a390 0x55599271bff0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3208444705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923421b0 0x55599271bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3208444705 >> 172.21.15.53:0/3208444705 conn(0x55599235f460 msgr2=0x5559927134f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3208444705 shutdown_connections 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3208444705 wait complete. 2024-08-31T06:06:55.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.245+0000 7fbdd1c7a740 20 client.16338 trim_cache size 0 max 16384 2024-08-31T06:06:55.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdd1c7a740 1 Processor -- start 2024-08-31T06:06:55.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdd1c7a740 1 -- start start 2024-08-31T06:06:55.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923299f0 0x55599270e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923421b0 0x555992727cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599234a390 0x5559927281f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41af3c0 con 0x5559923421b0 2024-08-31T06:06:55.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41b0fc0 con 0x55599234a390 2024-08-31T06:06:55.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41afa90 con 0x5559923299f0 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdc8ca0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923421b0 0x555992727cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdc8ca0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923421b0 0x555992727cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43312/0 (socket says 172.21.15.53:43312) 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/1096118859 learned_addr learned my addr 172.21.15.53:0/1096118859 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/1096118859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923299f0 0x55599270e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/1096118859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599234a390 0x5559927281f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/1096118859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923299f0 msgr2=0x55599270e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/1096118859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923299f0 0x55599270e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/1096118859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599234a390 msgr2=0x5559927281f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/1096118859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599234a390 0x5559927281f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.259+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/1096118859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555992712600 con 0x5559923421b0 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.260+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/1096118859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923421b0 0x555992727cb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4005ec0 tx=0x7fbdb40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809f4fa8b3d28faf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.260+0000 7fbdaeffd640 1 -- 172.21.15.53:0/1096118859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4029040 con 0x5559923421b0 2024-08-31T06:06:55.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.260+0000 7fbdaeffd640 1 -- 172.21.15.53:0/1096118859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdb401c780 con 0x5559923421b0 2024-08-31T06:06:55.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.260+0000 7fbdaeffd640 1 -- 172.21.15.53:0/1096118859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40116a0 con 0x5559923421b0 2024-08-31T06:06:55.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.261+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/1096118859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923421b0 msgr2=0x555992727cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:55.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.261+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/1096118859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923421b0 0x555992727cb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4005ec0 tx=0x7fbdb40095c0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.261+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/1096118859 shutdown_connections 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.261+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/1096118859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55599234a390 0x5559927281f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.261+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/1096118859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923421b0 0x555992727cb0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.261+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/1096118859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559923299f0 0x55599270e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.261+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/1096118859 >> 172.21.15.53:0/1096118859 conn(0x55599235f460 msgr2=0x55599270db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.261+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/1096118859 shutdown_connections 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.261+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/1096118859 wait complete. 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.261+0000 7fbdd1c7a740 1 -- start start 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.261+0000 7fbdd1c7a740 1 Processor -- start 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923299f0 0x555992720450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559923421b0 0x555992720990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdd1c7a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55599234a390 0x5559927978d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41b0830 con 0x5559923299f0 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41b0160 con 0x5559923421b0 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdd1c7a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc41ad3a0 con 0x55599234a390 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdd1c7a740 10 client.0 _ll_register_callbacks cb 0x7fbdb4009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc9ca2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923299f0 0x555992720450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc8ca0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559923421b0 0x555992720990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc8ca0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559923421b0 0x555992720990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48282/0 (socket says 172.21.15.53:48282) 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/3856618668 learned_addr learned my addr 172.21.15.53:0/3856618668 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc9ca2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923299f0 0x555992720450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43322/0 (socket says 172.21.15.53:43322) 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55599234a390 0x5559927978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/3856618668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55599234a390 msgr2=0x5559927978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55599234a390 0x5559927978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/3856618668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923299f0 msgr2=0x555992720450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923299f0 0x555992720450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc8ca0640 1 -- 172.21.15.53:0/3856618668 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555992797e10 con 0x5559923421b0 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.262+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923299f0 0x555992720450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdc8ca0640 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559923421b0 0x555992720990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbdb401c510 tx=0x7fbdb4009de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0807316400990d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdacff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdacff9640 1 -- 172.21.15.53:0/3856618668 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4029040 con 0x5559923421b0 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdacff9640 1 -- 172.21.15.53:0/3856618668 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fbdb401cc00 con 0x5559923421b0 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3856618668 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdb401c780 con 0x5559923421b0 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdacff9640 1 -- 172.21.15.53:0/3856618668 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbdb4045050 con 0x5559923421b0 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdd1c7a740 10 client.25772 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3856618668 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555992799060 con 0x5559923421b0 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdacff9640 1 -- 172.21.15.53:0/3856618668 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdb401c780 con 0x5559923421b0 2024-08-31T06:06:55.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdacff9640 1 -- 172.21.15.53:0/3856618668 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fbdb4025430 con 0x5559923421b0 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdd1c7a740 10 client.25772 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdd1c7a740 10 client.25772 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdd1c7a740 20 client.25772 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.263+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55599236b070 0x55599279b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.264+0000 7fbdd1c7a740 4 client.25772 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.264+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3856618668 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555992685070 con 0x55599236b070 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.264+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55599236b070 0x55599279b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.264+0000 7fbdc9ca2640 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55599236b070 0x55599279b780 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b89c7b2b7045a7a1 server_cookie=5ac959dcc731749b in_seq=0 out_seq=0 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.264+0000 7fbdacff9640 10 client.25772 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.264+0000 7fbdacff9640 1 -- 172.21.15.53:0/3856618668 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555992685070 con 0x55599236b070 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.264+0000 7fbdacff9640 10 client.25772 handle_command_reply: tid=0 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.264+0000 7fbdd1c7a740 1 client.25772 shutdown 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3856618668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559923421b0 msgr2=0x555992720990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:55.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559923421b0 0x555992720990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbdb401c510 tx=0x7fbdb4009de0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3856618668 shutdown_connections 2024-08-31T06:06:55.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55599236b070 0x55599279b780 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55599234a390 0x5559927978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559923421b0 0x555992720990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdacff9640 0 client.25772 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:06:55.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdd1c7a740 1 --2- 172.21.15.53:0/3856618668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559923299f0 0x555992720450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3856618668 >> 172.21.15.53:0/3856618668 conn(0x55599235f460 msgr2=0x555992713410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:55.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3856618668 shutdown_connections 2024-08-31T06:06:55.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdd1c7a740 1 -- 172.21.15.53:0/3856618668 wait complete. 2024-08-31T06:06:55.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdd1c7a740 20 client.25772 trim_cache size 0 max 16384 2024-08-31T06:06:55.272 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:06:55.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdcb705640 1 -- 172.21.15.53:0/1017340131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbdb00b4d20 msgr2=0x7fbdb00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:55.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdcb705640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbdb00b4d20 0x7fbdb00b7230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00e29d0 tx=0x7fbdc00a7040 comp rx=0 tx=0).stop 2024-08-31T06:06:55.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdcb705640 1 -- 172.21.15.53:0/1017340131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdc4103900 msgr2=0x7fbdc419a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:55.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdcb705640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdc4103900 0x7fbdc419a1a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000d950 tx=0x7fbdc000de10 comp rx=0 tx=0).stop 2024-08-31T06:06:55.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdcb705640 1 -- 172.21.15.53:0/1017340131 shutdown_connections 2024-08-31T06:06:55.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.265+0000 7fbdcb705640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbdb00b4d20 0x7fbdb00b7230 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.266+0000 7fbdcb705640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdc4109b90 0x7fbdc419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.266+0000 7fbdcb705640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc4109240 0x7fbdc419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.266+0000 7fbdcb705640 1 --2- 172.21.15.53:0/1017340131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdc4103900 0x7fbdc419a1a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:55.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.266+0000 7fbdcb705640 1 -- 172.21.15.53:0/1017340131 >> 172.21.15.53:0/1017340131 conn(0x7fbdc407b5f0 msgr2=0x7fbdc4107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:55.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.266+0000 7fbdcb705640 1 -- 172.21.15.53:0/1017340131 shutdown_connections 2024-08-31T06:06:55.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:55.266+0000 7fbdcb705640 1 -- 172.21.15.53:0/1017340131 wait complete. 2024-08-31T06:06:55.846 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:55 smithi053 ceph-mon[18924]: pgmap v382: 97 pgs: 97 active+clean; 28 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 1.4 MiB/s wr, 124 op/s 2024-08-31T06:06:55.873 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:06:55.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:55 smithi130 ceph-mon[22266]: pgmap v382: 97 pgs: 97 active+clean; 28 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 1.4 MiB/s wr, 124 op/s 2024-08-31T06:06:55.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:55 smithi153 ceph-mon[22320]: pgmap v382: 97 pgs: 97 active+clean; 28 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 1.4 MiB/s wr, 124 op/s 2024-08-31T06:06:55.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 25626 3.45 MB/sec warmup 45 sec latency 3302.895 ms 2024-08-31T06:06:56.125 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.571+0000 7f10f18d2640 1 -- 172.21.15.53:0/3881642968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec108a90 msgr2=0x7f10ec10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.572+0000 7f10f18d2640 1 --2- 172.21.15.53:0/3881642968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec108a90 0x7f10ec10f2c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009ca0 tx=0x7f10e402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.572+0000 7f10f18d2640 1 -- 172.21.15.53:0/3881642968 shutdown_connections 2024-08-31T06:06:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.572+0000 7f10f18d2640 1 --2- 172.21.15.53:0/3881642968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec108a90 0x7f10ec10f2c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.572+0000 7f10f18d2640 1 --2- 172.21.15.53:0/3881642968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10ec108140 0x7f10ec108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.572+0000 7f10f18d2640 1 --2- 172.21.15.53:0/3881642968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ec102800 0x7f10ec102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.572+0000 7f10f18d2640 1 -- 172.21.15.53:0/3881642968 >> 172.21.15.53:0/3881642968 conn(0x7f10ec0794d0 msgr2=0x7f10ec0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:56.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.572+0000 7f10f18d2640 1 -- 172.21.15.53:0/3881642968 shutdown_connections 2024-08-31T06:06:56.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.572+0000 7f10f18d2640 1 -- 172.21.15.53:0/3881642968 wait complete. 2024-08-31T06:06:56.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10f18d2640 1 Processor -- start 2024-08-31T06:06:56.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10f18d2640 1 -- start start 2024-08-31T06:06:56.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10f18d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec102800 0x7f10ec19aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10f18d2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ec108140 0x7f10ec19b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10f18d2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10ec108a90 0x7f10ec19b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10f18d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1125f0 con 0x7f10ec102800 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10f18d2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec112470 con 0x7f10ec108140 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10f18d2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec112770 con 0x7f10ec108a90 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10eaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec102800 0x7f10ec19aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10eaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec102800 0x7f10ec19aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43330/0 (socket says 172.21.15.53:43330) 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10ea7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ec108140 0x7f10ec19b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.573+0000 7f10eaffd640 1 -- 172.21.15.53:0/2512698695 learned_addr learned my addr 172.21.15.53:0/2512698695 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.574+0000 7f10eaffd640 1 -- 172.21.15.53:0/2512698695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10ec108a90 msgr2=0x7f10ec19b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.574+0000 7f10eaffd640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10ec108a90 0x7f10ec19b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.574+0000 7f10eaffd640 1 -- 172.21.15.53:0/2512698695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ec108140 msgr2=0x7f10ec19b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.574+0000 7f10eaffd640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ec108140 0x7f10ec19b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.574+0000 7f10eaffd640 1 -- 172.21.15.53:0/2512698695 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ec1a6110 con 0x7f10ec102800 2024-08-31T06:06:56.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.574+0000 7f10ea7fc640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ec108140 0x7f10ec19b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:56.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.574+0000 7f10eaffd640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec102800 0x7f10ec19aee0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00ea60 tx=0x7f10dc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:56.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.574+0000 7f10f08d0640 1 -- 172.21.15.53:0/2512698695 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc00cd20 con 0x7f10ec102800 2024-08-31T06:06:56.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.574+0000 7f10f18d2640 1 -- 172.21.15.53:0/2512698695 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ec1a6400 con 0x7f10ec102800 2024-08-31T06:06:56.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.574+0000 7f10f08d0640 1 -- 172.21.15.53:0/2512698695 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10dc0035f0 con 0x7f10ec102800 2024-08-31T06:06:56.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.574+0000 7f10f08d0640 1 -- 172.21.15.53:0/2512698695 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc010690 con 0x7f10ec102800 2024-08-31T06:06:56.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.575+0000 7f10f18d2640 1 -- 172.21.15.53:0/2512698695 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ec1a6990 con 0x7f10ec102800 2024-08-31T06:06:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.577+0000 7f10f7e47740 1 Processor -- start 2024-08-31T06:06:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.577+0000 7f10f7e47740 1 -- start start 2024-08-31T06:06:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.577+0000 7f10f08d0640 1 -- 172.21.15.53:0/2512698695 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f10dc010830 con 0x7f10ec102800 2024-08-31T06:06:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 0x55e0eed4b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed4b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed4bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10f7e47740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e0eecc2680 con 0x55e0ee9a6070 2024-08-31T06:06:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10f7e47740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e0eecb1c10 con 0x55e0ee985390 2024-08-31T06:06:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10f7e47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e0eecb5bc0 con 0x55e0ee97d1b0 2024-08-31T06:06:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 0x55e0eed4b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10ea7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed4bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10ea7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed4bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48302/0 (socket says 172.21.15.53:48302) 2024-08-31T06:06:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10ea7fc640 1 -- 172.21.15.53:0/3910398639 learned_addr learned my addr 172.21.15.53:0/3910398639 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 0x55e0eed4b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43334/0 (socket says 172.21.15.53:43334) 2024-08-31T06:06:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10eaffd640 1 --2- 172.21.15.53:0/3910398639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed4b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10eb7fe640 1 -- 172.21.15.53:0/3910398639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 msgr2=0x55e0eed4b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/3910398639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed4b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10eb7fe640 1 -- 172.21.15.53:0/3910398639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 msgr2=0x55e0eed4bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/3910398639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed4bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10eb7fe640 1 -- 172.21.15.53:0/3910398639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0eea11650 con 0x55e0ee9a6070 2024-08-31T06:06:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.578+0000 7f10ea7fc640 1 --2- 172.21.15.53:0/3910398639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed4bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.579+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/3910398639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 0x55e0eed4b310 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f10e4005e30 tx=0x7f10e4009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a11cc2be4d9359 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.579+0000 7f10f08d0640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d40b4d20 0x7f10d40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.579+0000 7f10eaffd640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d40b4d20 0x7f10d40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.579+0000 7f10d1ffb640 1 -- 172.21.15.53:0/3910398639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e40316d0 con 0x55e0ee9a6070 2024-08-31T06:06:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.579+0000 7f10f08d0640 1 -- 172.21.15.53:0/2512698695 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f10dc0e5810 con 0x7f10ec102800 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.579+0000 7f10d1ffb640 1 -- 172.21.15.53:0/3910398639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10e403f070 con 0x55e0ee9a6070 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.579+0000 7f10d1ffb640 1 -- 172.21.15.53:0/3910398639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e40042a0 con 0x55e0ee9a6070 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.580+0000 7f10f7e47740 1 -- 172.21.15.53:0/3910398639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 msgr2=0x55e0eed4b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.580+0000 7f10f7e47740 1 --2- 172.21.15.53:0/3910398639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 0x55e0eed4b310 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f10e4005e30 tx=0x7f10e4009a20 comp rx=0 tx=0).stop 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.580+0000 7f10eaffd640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d40b4d20 0x7f10d40b7230 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0e3010 tx=0x7f10dc0eb550 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.580+0000 7f10f7e47740 1 -- 172.21.15.53:0/3910398639 shutdown_connections 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.580+0000 7f10f7e47740 1 --2- 172.21.15.53:0/3910398639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed4bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.580+0000 7f10f7e47740 1 --2- 172.21.15.53:0/3910398639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed4b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.580+0000 7f10f7e47740 1 --2- 172.21.15.53:0/3910398639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 0x55e0eed4b310 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.580+0000 7f10f7e47740 1 -- 172.21.15.53:0/3910398639 >> 172.21.15.53:0/3910398639 conn(0x55e0ee99a460 msgr2=0x55e0eed49200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.580+0000 7f10f7e47740 1 -- 172.21.15.53:0/3910398639 shutdown_connections 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.580+0000 7f10f7e47740 1 -- 172.21.15.53:0/3910398639 wait complete. 2024-08-31T06:06:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.581+0000 7f10f7e47740 1 -- start start 2024-08-31T06:06:56.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.581+0000 7f10f7e47740 1 Processor -- start 2024-08-31T06:06:56.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.581+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed56b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.581+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.581+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 0x55e0eed62d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.581+0000 7f10f7e47740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e0eeb14700 con 0x55e0ee9a6070 2024-08-31T06:06:56.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.581+0000 7f10f7e47740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e0eec38750 con 0x55e0ee985390 2024-08-31T06:06:56.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.581+0000 7f10f7e47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e0eed59a90 con 0x55e0ee97d1b0 2024-08-31T06:06:56.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.581+0000 7f10f7e47740 10 client.0 _ll_register_callbacks cb 0x55e0eec67e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.581+0000 7f10eb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed56b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.581+0000 7f10eb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed56b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37854/0 (socket says 172.21.15.53:37854) 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10eb7fe640 1 -- 172.21.15.53:0/2670132141 learned_addr learned my addr 172.21.15.53:0/2670132141 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 0x55e0eed62d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10ea7fc640 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10eb7fe640 1 -- 172.21.15.53:0/2670132141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 msgr2=0x55e0eed570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10eb7fe640 1 -- 172.21.15.53:0/2670132141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 msgr2=0x55e0eed62d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 0x55e0eed62d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10eb7fe640 1 -- 172.21.15.53:0/2670132141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0eec71900 con 0x55e0ee97d1b0 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10ea7fc640 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed56b20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10e4003fd0 tx=0x7f10e403d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51f0bd3ee06f4bdc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10caffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:06:56.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10caffd640 1 -- 172.21.15.53:0/2670132141 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4004040 con 0x55e0ee97d1b0 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10f7e47740 1 -- 172.21.15.53:0/2670132141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10e403f070 con 0x55e0ee97d1b0 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.582+0000 7f10caffd640 1 -- 172.21.15.53:0/2670132141 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f10e4031dc0 con 0x55e0ee97d1b0 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.583+0000 7f10caffd640 1 -- 172.21.15.53:0/2670132141 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f10e4060050 con 0x55e0ee97d1b0 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.583+0000 7f10f7e47740 10 client.25786 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.583+0000 7f10f7e47740 1 -- 172.21.15.53:0/2670132141 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e0eed658f0 con 0x55e0ee97d1b0 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.583+0000 7f10caffd640 1 -- 172.21.15.53:0/2670132141 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10e403f070 con 0x55e0ee97d1b0 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.583+0000 7f10caffd640 1 -- 172.21.15.53:0/2670132141 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f10e404f980 con 0x55e0ee97d1b0 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.583+0000 7f10f7e47740 10 client.25786 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.583+0000 7f10f7e47740 10 client.25786 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.583+0000 7f10f7e47740 20 client.25786 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.583+0000 7f10f7e47740 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55e0ee9649f0 0x55e0eed68c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.584+0000 7f10f7e47740 4 client.25786 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.584+0000 7f10f7e47740 1 -- 172.21.15.53:0/2670132141 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0eecc45d0 con 0x55e0ee9649f0 2024-08-31T06:06:56.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.584+0000 7f10ea7fc640 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55e0ee9649f0 0x55e0eed68c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.584+0000 7f10ea7fc640 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55e0ee9649f0 0x55e0eed68c50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0e281272993a09d server_cookie=305adc7b7917a319 in_seq=0 out_seq=0 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.584+0000 7f10caffd640 10 client.25786 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10caffd640 1 -- 172.21.15.53:0/2670132141 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0eecc45d0 con 0x55e0ee9649f0 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10caffd640 10 client.25786 handle_command_reply: tid=0 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10f7e47740 1 client.25786 shutdown 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10f7e47740 1 -- 172.21.15.53:0/2670132141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 msgr2=0x55e0eed56b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10f7e47740 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed56b20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10e4003fd0 tx=0x7f10e403d040 comp rx=0 tx=0).stop 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10f7e47740 1 -- 172.21.15.53:0/2670132141 shutdown_connections 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10f7e47740 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55e0ee9649f0 0x55e0eed68c50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10f7e47740 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9a6070 0x55e0eed62d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10caffd640 0 client.25786 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10f7e47740 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10f7e47740 1 --2- 172.21.15.53:0/2670132141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed56b20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10f7e47740 1 -- 172.21.15.53:0/2670132141 >> 172.21.15.53:0/2670132141 conn(0x55e0ee99a460 msgr2=0x55e0eed4e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:56.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10f7e47740 1 -- 172.21.15.53:0/2670132141 shutdown_connections 2024-08-31T06:06:56.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.585+0000 7f10f7e47740 1 -- 172.21.15.53:0/2670132141 wait complete. 2024-08-31T06:06:56.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.586+0000 7f10f7e47740 20 client.25786 trim_cache size 0 max 16384 2024-08-31T06:06:56.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10f7e47740 1 Processor -- start 2024-08-31T06:06:56.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10f7e47740 1 -- start start 2024-08-31T06:06:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9649f0 0x55e0eed4edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed4ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed53d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10f7e47740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1ad180 con 0x55e0ee9649f0 2024-08-31T06:06:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10f7e47740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1aed80 con 0x55e0ee985390 2024-08-31T06:06:56.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10f7e47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1ad850 con 0x55e0ee97d1b0 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9649f0 0x55e0eed4edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9649f0 0x55e0eed4edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43346/0 (socket says 172.21.15.53:43346) 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10eb7fe640 1 -- 172.21.15.53:0/3610344372 learned_addr learned my addr 172.21.15.53:0/3610344372 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10ea7fc640 1 --2- 172.21.15.53:0/3610344372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed4ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.601+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/3610344372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed53d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.602+0000 7f10eb7fe640 1 -- 172.21.15.53:0/3610344372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 msgr2=0x55e0eed4ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.602+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/3610344372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed4ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.602+0000 7f10eb7fe640 1 -- 172.21.15.53:0/3610344372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 msgr2=0x55e0eed53d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.602+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/3610344372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed53d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.602+0000 7f10eb7fe640 1 -- 172.21.15.53:0/3610344372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0eed4d830 con 0x55e0ee9649f0 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.602+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/3610344372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9649f0 0x55e0eed4edd0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f10e404fd80 tx=0x7f10e4009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc486db73d180ffd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.602+0000 7f10d17fa640 1 -- 172.21.15.53:0/3610344372 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4068070 con 0x55e0ee9649f0 2024-08-31T06:06:56.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.602+0000 7f10d17fa640 1 -- 172.21.15.53:0/3610344372 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10e403f040 con 0x55e0ee9649f0 2024-08-31T06:06:56.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.602+0000 7f10d17fa640 1 -- 172.21.15.53:0/3610344372 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e40309c0 con 0x55e0ee9649f0 2024-08-31T06:06:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.603+0000 7f10f7e47740 1 -- 172.21.15.53:0/3610344372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9649f0 msgr2=0x55e0eed4edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.603+0000 7f10f7e47740 1 --2- 172.21.15.53:0/3610344372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9649f0 0x55e0eed4edd0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f10e404fd80 tx=0x7f10e4009a20 comp rx=0 tx=0).stop 2024-08-31T06:06:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.603+0000 7f10f7e47740 1 -- 172.21.15.53:0/3610344372 shutdown_connections 2024-08-31T06:06:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.603+0000 7f10f7e47740 1 --2- 172.21.15.53:0/3610344372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee985390 0x55e0eed53d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.603+0000 7f10f7e47740 1 --2- 172.21.15.53:0/3610344372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed4ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.603+0000 7f10f7e47740 1 --2- 172.21.15.53:0/3610344372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee9649f0 0x55e0eed4edd0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.603+0000 7f10f7e47740 1 -- 172.21.15.53:0/3610344372 >> 172.21.15.53:0/3610344372 conn(0x55e0ee99a460 msgr2=0x55e0eed4c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.603+0000 7f10f7e47740 1 -- 172.21.15.53:0/3610344372 shutdown_connections 2024-08-31T06:06:56.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.603+0000 7f10f7e47740 1 -- 172.21.15.53:0/3610344372 wait complete. 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.604+0000 7f10f7e47740 1 -- start start 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.604+0000 7f10f7e47740 1 Processor -- start 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.604+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee9649f0 0x55e0eed6bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.604+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed6c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.604+0000 7f10f7e47740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee985390 0x55e0eedcb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.604+0000 7f10f7e47740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1ae5f0 con 0x55e0ee985390 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.604+0000 7f10f7e47740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1adf20 con 0x55e0ee9649f0 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.604+0000 7f10f7e47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec1ab160 con 0x55e0ee97d1b0 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.604+0000 7f10f7e47740 10 client.0 _ll_register_callbacks cb 0x7f10e000aa60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee985390 0x55e0eedcb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10ea7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed6c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee985390 0x55e0eedcb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43354/0 (socket says 172.21.15.53:43354) 2024-08-31T06:06:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10eb7fe640 1 -- 172.21.15.53:0/227644153 learned_addr learned my addr 172.21.15.53:0/227644153 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10ea7fc640 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed6c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37868/0 (socket says 172.21.15.53:37868) 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee9649f0 0x55e0eed6bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10ea7fc640 1 -- 172.21.15.53:0/227644153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee9649f0 msgr2=0x55e0eed6bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10ea7fc640 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee9649f0 0x55e0eed6bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10ea7fc640 1 -- 172.21.15.53:0/227644153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee985390 msgr2=0x55e0eedcb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10ea7fc640 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee985390 0x55e0eedcb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10ea7fc640 1 -- 172.21.15.53:0/227644153 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0eedcbf60 con 0x55e0ee97d1b0 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee985390 0x55e0eedcb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10ea7fc640 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed6c170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f10e0005890 tx=0x7f10e001e890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f9c9cca0781b696 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10caffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.605+0000 7f10caffd640 1 -- 172.21.15.53:0/227644153 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0028070 con 0x55e0ee97d1b0 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10f7e47740 1 -- 172.21.15.53:0/227644153 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10e403f040 con 0x55e0ee97d1b0 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10caffd640 1 -- 172.21.15.53:0/227644153 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f10e00248e0 con 0x55e0ee97d1b0 2024-08-31T06:06:56.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10caffd640 1 -- 172.21.15.53:0/227644153 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f10e0033050 con 0x55e0ee97d1b0 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10f7e47740 10 client.25792 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10f7e47740 1 -- 172.21.15.53:0/227644153 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e0eedd33b0 con 0x55e0ee97d1b0 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10caffd640 1 -- 172.21.15.53:0/227644153 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10e403f040 con 0x55e0ee97d1b0 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10caffd640 1 -- 172.21.15.53:0/227644153 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f10e000fae0 con 0x55e0ee97d1b0 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10f7e47740 10 client.25792 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10f7e47740 10 client.25792 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10f7e47740 20 client.25792 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10f7e47740 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55e0ee9a6070 0x55e0eedd5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10f7e47740 4 client.25792 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10f7e47740 1 -- 172.21.15.53:0/227644153 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e0eecc0070 con 0x55e0ee9a6070 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.606+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55e0ee9a6070 0x55e0eedd5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10caffd640 10 client.25792 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55e0ee9a6070 0x55e0eedd5b20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c5ab006124a31a49 server_cookie=a15883f1ef1d6aff in_seq=0 out_seq=0 2024-08-31T06:06:56.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10caffd640 1 -- 172.21.15.53:0/227644153 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e0eecc0070 con 0x55e0ee9a6070 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10caffd640 10 client.25792 handle_command_reply: tid=0 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10f7e47740 1 client.25792 shutdown 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10f7e47740 1 -- 172.21.15.53:0/227644153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 msgr2=0x55e0eed6c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10f7e47740 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed6c170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f10e0005890 tx=0x7f10e001e890 comp rx=0 tx=0).stop 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10f7e47740 1 -- 172.21.15.53:0/227644153 shutdown_connections 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10f7e47740 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55e0ee9a6070 0x55e0eedd5b20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10f7e47740 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0ee985390 0x55e0eedcb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10f7e47740 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e0ee97d1b0 0x55e0eed6c170 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10caffd640 0 client.25792 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10f7e47740 1 --2- 172.21.15.53:0/227644153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e0ee9649f0 0x55e0eed6bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10f7e47740 1 -- 172.21.15.53:0/227644153 >> 172.21.15.53:0/227644153 conn(0x55e0ee99a460 msgr2=0x55e0eed4eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10f7e47740 1 -- 172.21.15.53:0/227644153 shutdown_connections 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.607+0000 7f10f7e47740 1 -- 172.21.15.53:0/227644153 wait complete. 2024-08-31T06:06:56.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f7e47740 20 client.25792 trim_cache size 0 max 16384 2024-08-31T06:06:56.616 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:06:56.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 -- 172.21.15.53:0/2512698695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d40b4d20 msgr2=0x7f10d40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:56.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d40b4d20 0x7f10d40b7230 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0e3010 tx=0x7f10dc0eb550 comp rx=0 tx=0).stop 2024-08-31T06:06:56.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 -- 172.21.15.53:0/2512698695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec102800 msgr2=0x7f10ec19aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:56.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec102800 0x7f10ec19aee0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00ea60 tx=0x7f10dc00ee60 comp rx=0 tx=0).stop 2024-08-31T06:06:56.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 -- 172.21.15.53:0/2512698695 shutdown_connections 2024-08-31T06:06:56.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d40b4d20 0x7f10d40b7230 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10ec108a90 0x7f10ec19b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10ec108140 0x7f10ec19b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 --2- 172.21.15.53:0/2512698695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec102800 0x7f10ec19aee0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:56.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 -- 172.21.15.53:0/2512698695 >> 172.21.15.53:0/2512698695 conn(0x7f10ec0794d0 msgr2=0x7f10ec105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:56.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 -- 172.21.15.53:0/2512698695 shutdown_connections 2024-08-31T06:06:56.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:56.608+0000 7f10f18d2640 1 -- 172.21.15.53:0/2512698695 wait complete. 2024-08-31T06:06:56.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 25877 3.39 MB/sec warmup 46 sec latency 3708.043 ms 2024-08-31T06:06:57.468 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:06:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.550+0000 7f075f132640 1 -- 172.21.15.53:0/272895306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0758108080 msgr2=0x7f0758108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.550+0000 7f075f132640 1 --2- 172.21.15.53:0/272895306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0758108080 0x7f0758108490 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0744009900 tx=0x7f074402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.550+0000 7f075f132640 1 -- 172.21.15.53:0/272895306 shutdown_connections 2024-08-31T06:06:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.550+0000 7f075f132640 1 --2- 172.21.15.53:0/272895306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07581089d0 0x7f075810f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.550+0000 7f075f132640 1 --2- 172.21.15.53:0/272895306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0758108080 0x7f0758108490 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.550+0000 7f075f132640 1 --2- 172.21.15.53:0/272895306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0758102750 0x7f0758102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.550+0000 7f075f132640 1 -- 172.21.15.53:0/272895306 >> 172.21.15.53:0/272895306 conn(0x7f075807a4e0 msgr2=0x7f075807a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.550+0000 7f075f132640 1 -- 172.21.15.53:0/272895306 shutdown_connections 2024-08-31T06:06:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.550+0000 7f075f132640 1 -- 172.21.15.53:0/272895306 wait complete. 2024-08-31T06:06:57.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.550+0000 7f075f132640 1 Processor -- start 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075f132640 1 -- start start 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075f132640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0758102750 0x7f0758197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075f132640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0758108080 0x7f0758198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075f132640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07581089d0 0x7f075819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075f132640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0758111480 con 0x7f0758102750 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075f132640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0758111300 con 0x7f07581089d0 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075f132640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0758111600 con 0x7f0758108080 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075cece640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0758102750 0x7f0758197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075cece640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0758102750 0x7f0758197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43374/0 (socket says 172.21.15.53:43374) 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075cece640 1 -- 172.21.15.53:0/1798765753 learned_addr learned my addr 172.21.15.53:0/1798765753 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075d6cf640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07581089d0 0x7f075819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f0757fff640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0758108080 0x7f0758198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075cece640 1 -- 172.21.15.53:0/1798765753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0758108080 msgr2=0x7f0758198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075cece640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0758108080 0x7f0758198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075cece640 1 -- 172.21.15.53:0/1798765753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07581089d0 msgr2=0x7f075819d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075cece640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07581089d0 0x7f075819d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075cece640 1 -- 172.21.15.53:0/1798765753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075819de20 con 0x7f0758102750 2024-08-31T06:06:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075d6cf640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07581089d0 0x7f075819d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.551+0000 7f075cece640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0758102750 0x7f0758197f80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f074c00d950 tx=0x7f074c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.552+0000 7f0755ffb640 1 -- 172.21.15.53:0/1798765753 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c017070 con 0x7f0758102750 2024-08-31T06:06:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.552+0000 7f075f132640 1 -- 172.21.15.53:0/1798765753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075819e110 con 0x7f0758102750 2024-08-31T06:06:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.552+0000 7f0755ffb640 1 -- 172.21.15.53:0/1798765753 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f074c009c30 con 0x7f0758102750 2024-08-31T06:06:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.552+0000 7f0755ffb640 1 -- 172.21.15.53:0/1798765753 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c00f620 con 0x7f0758102750 2024-08-31T06:06:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.552+0000 7f075f132640 1 -- 172.21.15.53:0/1798765753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07581a4930 con 0x7f0758102750 2024-08-31T06:06:57.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.554+0000 7f07660a0740 1 Processor -- start 2024-08-31T06:06:57.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.554+0000 7f0755ffb640 1 -- 172.21.15.53:0/1798765753 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f074c010460 con 0x7f0758102750 2024-08-31T06:06:57.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.554+0000 7f07660a0740 1 -- start start 2024-08-31T06:06:57.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f07660a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83cc1b0 0x5606c876fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f07660a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c8770220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f07660a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83ab4d0 0x5606c8770760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f07660a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606c86e5000 con 0x5606c83a32f0 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f07660a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5606c86d4590 con 0x5606c83cc1b0 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f07660a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5606c86d8540 con 0x5606c83ab4d0 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075cece640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c8770220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075d6cf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83cc1b0 0x5606c876fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075cece640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c8770220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43390/0 (socket says 172.21.15.53:43390) 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075cece640 1 -- 172.21.15.53:0/2250322728 learned_addr learned my addr 172.21.15.53:0/2250322728 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f0757fff640 1 --2- 172.21.15.53:0/2250322728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83ab4d0 0x5606c8770760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075cece640 1 -- 172.21.15.53:0/2250322728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83ab4d0 msgr2=0x5606c8770760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075cece640 1 --2- 172.21.15.53:0/2250322728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83ab4d0 0x5606c8770760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075cece640 1 -- 172.21.15.53:0/2250322728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83cc1b0 msgr2=0x5606c876fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075cece640 1 --2- 172.21.15.53:0/2250322728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83cc1b0 0x5606c876fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075cece640 1 -- 172.21.15.53:0/2250322728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c8437790 con 0x5606c83a32f0 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075d6cf640 1 --2- 172.21.15.53:0/2250322728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83cc1b0 0x5606c876fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f0755ffb640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07480b6eb0 0x7f07480b93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075d6cf640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07480b6eb0 0x7f07480b93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f075cece640 1 --2- 172.21.15.53:0/2250322728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c8770220 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f074c0e2900 tx=0x7f074c0ed930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9234b2c73aba25af server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.555+0000 7f0755ffb640 1 -- 172.21.15.53:0/1798765753 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f074c0e5240 con 0x7f0758102750 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.556+0000 7f0742ffd640 1 -- 172.21.15.53:0/2250322728 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c020030 con 0x5606c83a32f0 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.556+0000 7f0742ffd640 1 -- 172.21.15.53:0/2250322728 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f074c0ab440 con 0x5606c83a32f0 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.556+0000 7f0742ffd640 1 -- 172.21.15.53:0/2250322728 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c0ab700 con 0x5606c83a32f0 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f07660a0740 1 -- 172.21.15.53:0/2250322728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 msgr2=0x5606c8770220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f07660a0740 1 --2- 172.21.15.53:0/2250322728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c8770220 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f074c0e2900 tx=0x7f074c0ed930 comp rx=0 tx=0).stop 2024-08-31T06:06:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f075d6cf640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07480b6eb0 0x7f07480b93c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0750007fd0 tx=0x7f07500076a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f07660a0740 1 -- 172.21.15.53:0/2250322728 shutdown_connections 2024-08-31T06:06:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f07660a0740 1 --2- 172.21.15.53:0/2250322728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83ab4d0 0x5606c8770760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f07660a0740 1 --2- 172.21.15.53:0/2250322728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c8770220 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f07660a0740 1 --2- 172.21.15.53:0/2250322728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83cc1b0 0x5606c876fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f07660a0740 1 -- 172.21.15.53:0/2250322728 >> 172.21.15.53:0/2250322728 conn(0x5606c83c0300 msgr2=0x5606c876dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f07660a0740 1 -- 172.21.15.53:0/2250322728 shutdown_connections 2024-08-31T06:06:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f07660a0740 1 -- 172.21.15.53:0/2250322728 wait complete. 2024-08-31T06:06:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f07660a0740 1 -- start start 2024-08-31T06:06:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.557+0000 7f07660a0740 1 Processor -- start 2024-08-31T06:06:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f07660a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83a32f0 0x5606c877b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f07660a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83ab4d0 0x5606c877be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f07660a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83cc1b0 0x5606c8787750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f07660a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606c860dab0 con 0x5606c83ab4d0 2024-08-31T06:06:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f07660a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5606c865b680 con 0x5606c83a32f0 2024-08-31T06:06:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f07660a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5606c877e460 con 0x5606c83cc1b0 2024-08-31T06:06:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f07660a0740 10 client.0 _ll_register_callbacks cb 0x5606c83e3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f0757fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83ab4d0 0x5606c877be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f0757fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83ab4d0 0x5606c877be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43398/0 (socket says 172.21.15.53:43398) 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f075cece640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83a32f0 0x5606c877b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f0757fff640 1 -- 172.21.15.53:0/3482332816 learned_addr learned my addr 172.21.15.53:0/3482332816 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f075d6cf640 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83cc1b0 0x5606c8787750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f0757fff640 1 -- 172.21.15.53:0/3482332816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83cc1b0 msgr2=0x5606c8787750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f0757fff640 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83cc1b0 0x5606c8787750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f0757fff640 1 -- 172.21.15.53:0/3482332816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83a32f0 msgr2=0x5606c877b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f0757fff640 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83a32f0 0x5606c877b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f0757fff640 1 -- 172.21.15.53:0/3482332816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606c84b0620 con 0x5606c83ab4d0 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f075d6cf640 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83cc1b0 0x5606c8787750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.558+0000 7f075cece640 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83a32f0 0x5606c877b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.559+0000 7f0757fff640 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83ab4d0 0x5606c877be60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0744005ab0 tx=0x7f0744004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f909e3940c9f7a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.559+0000 7f0737fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.559+0000 7f0737fff640 1 -- 172.21.15.53:0/3482332816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744035040 con 0x5606c83ab4d0 2024-08-31T06:06:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.559+0000 7f0737fff640 1 -- 172.21.15.53:0/3482332816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0744005590 con 0x5606c83ab4d0 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.559+0000 7f07660a0740 1 -- 172.21.15.53:0/3482332816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f074c0ab440 con 0x5606c83ab4d0 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.559+0000 7f0737fff640 1 -- 172.21.15.53:0/3482332816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f07440046c0 con 0x5606c83ab4d0 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.559+0000 7f07660a0740 10 client.16374 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.559+0000 7f07660a0740 1 -- 172.21.15.53:0/3482332816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5606c878a520 con 0x5606c83ab4d0 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.559+0000 7f0737fff640 1 -- 172.21.15.53:0/3482332816 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f074c0ab440 con 0x5606c83ab4d0 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.559+0000 7f0737fff640 1 -- 172.21.15.53:0/3482332816 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f0744003af0 con 0x5606c83ab4d0 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.560+0000 7f07660a0740 10 client.16374 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.560+0000 7f07660a0740 10 client.16374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.560+0000 7f07660a0740 20 client.16374 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.560+0000 7f07660a0740 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5606c838ad80 0x5606c878daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.560+0000 7f07660a0740 4 client.16374 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.560+0000 7f07660a0740 1 -- 172.21.15.53:0/3482332816 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606c86e6f50 con 0x5606c838ad80 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.560+0000 7f075cece640 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5606c838ad80 0x5606c878daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.560+0000 7f075cece640 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5606c838ad80 0x5606c878daf0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e31e80e442eed81 server_cookie=887d60371c7c4c72 in_seq=0 out_seq=0 2024-08-31T06:06:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.560+0000 7f0737fff640 10 client.16374 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f0737fff640 1 -- 172.21.15.53:0/3482332816 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5606c86e6f50 con 0x5606c838ad80 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f0737fff640 10 client.16374 handle_command_reply: tid=0 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 1 client.16374 shutdown 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 1 -- 172.21.15.53:0/3482332816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83ab4d0 msgr2=0x5606c877be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83ab4d0 0x5606c877be60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0744005ab0 tx=0x7f0744004510 comp rx=0 tx=0).stop 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 1 -- 172.21.15.53:0/3482332816 shutdown_connections 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5606c838ad80 0x5606c878daf0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f0737fff640 0 client.16374 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83cc1b0 0x5606c8787750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83ab4d0 0x5606c877be60 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 1 --2- 172.21.15.53:0/3482332816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c83a32f0 0x5606c877b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 1 -- 172.21.15.53:0/3482332816 >> 172.21.15.53:0/3482332816 conn(0x5606c83c0300 msgr2=0x5606c8770d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 1 -- 172.21.15.53:0/3482332816 shutdown_connections 2024-08-31T06:06:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 1 -- 172.21.15.53:0/3482332816 wait complete. 2024-08-31T06:06:57.570 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.561+0000 7f07660a0740 20 client.16374 trim_cache size 0 max 16384 2024-08-31T06:06:57.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.576+0000 7f07660a0740 1 Processor -- start 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.576+0000 7f07660a0740 1 -- start start 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.576+0000 7f07660a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83c0300 0x5606c8787650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.576+0000 7f07660a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c838ad80 0x5606c8779f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f07660a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c877a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f07660a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f07581ad250 con 0x5606c83a32f0 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f07660a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f07581aee50 con 0x5606c838ad80 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f07660a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f07581ad920 con 0x5606c83c0300 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f075d6cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c877a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f075d6cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c877a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43410/0 (socket says 172.21.15.53:43410) 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f075d6cf640 1 -- 172.21.15.53:0/2340623021 learned_addr learned my addr 172.21.15.53:0/2340623021 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f075cece640 1 --2- 172.21.15.53:0/2340623021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83c0300 0x5606c8787650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f0757fff640 1 --2- 172.21.15.53:0/2340623021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c838ad80 0x5606c8779f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f075d6cf640 1 -- 172.21.15.53:0/2340623021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83c0300 msgr2=0x5606c8787650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f075d6cf640 1 --2- 172.21.15.53:0/2340623021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83c0300 0x5606c8787650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f075d6cf640 1 -- 172.21.15.53:0/2340623021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c838ad80 msgr2=0x5606c8779f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f075d6cf640 1 --2- 172.21.15.53:0/2340623021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c838ad80 0x5606c8779f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f075d6cf640 1 -- 172.21.15.53:0/2340623021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606c87881f0 con 0x5606c83a32f0 2024-08-31T06:06:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f0757fff640 1 --2- 172.21.15.53:0/2340623021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c838ad80 0x5606c8779f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f075d6cf640 1 --2- 172.21.15.53:0/2340623021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c877a470 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0750007670 tx=0x7f0750014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc2b5c3914faf24 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f07427fc640 1 -- 172.21.15.53:0/2340623021 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075001e6f0 con 0x5606c83a32f0 2024-08-31T06:06:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f07427fc640 1 -- 172.21.15.53:0/2340623021 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f075001ed20 con 0x5606c83a32f0 2024-08-31T06:06:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.577+0000 7f07427fc640 1 -- 172.21.15.53:0/2340623021 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075001bd50 con 0x5606c83a32f0 2024-08-31T06:06:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.578+0000 7f07660a0740 1 -- 172.21.15.53:0/2340623021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 msgr2=0x5606c877a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.578+0000 7f07660a0740 1 --2- 172.21.15.53:0/2340623021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c877a470 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0750007670 tx=0x7f0750014000 comp rx=0 tx=0).stop 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.578+0000 7f07660a0740 1 -- 172.21.15.53:0/2340623021 shutdown_connections 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.578+0000 7f07660a0740 1 --2- 172.21.15.53:0/2340623021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83a32f0 0x5606c877a470 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.578+0000 7f07660a0740 1 --2- 172.21.15.53:0/2340623021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c838ad80 0x5606c8779f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.578+0000 7f07660a0740 1 --2- 172.21.15.53:0/2340623021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83c0300 0x5606c8787650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.578+0000 7f07660a0740 1 -- 172.21.15.53:0/2340623021 >> 172.21.15.53:0/2340623021 conn(0x5606c87760f0 msgr2=0x5606c8776840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.578+0000 7f07660a0740 1 -- 172.21.15.53:0/2340623021 shutdown_connections 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.578+0000 7f07660a0740 1 -- 172.21.15.53:0/2340623021 wait complete. 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.579+0000 7f07660a0740 1 -- start start 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.579+0000 7f07660a0740 1 Processor -- start 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.579+0000 7f07660a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c838ad80 0x5606c8783e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.579+0000 7f07660a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83a32f0 0x5606c877f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.579+0000 7f07660a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83c0300 0x5606c877f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.579+0000 7f07660a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f07581ae6c0 con 0x5606c83c0300 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.579+0000 7f07660a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f07581adff0 con 0x5606c838ad80 2024-08-31T06:06:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.579+0000 7f07660a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f07581ab230 con 0x5606c83a32f0 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.579+0000 7f07660a0740 10 client.0 _ll_register_callbacks cb 0x7f07440041a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.579+0000 7f075d6cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83c0300 0x5606c877f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f075d6cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83c0300 0x5606c877f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43424/0 (socket says 172.21.15.53:43424) 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f075d6cf640 1 -- 172.21.15.53:0/3501643395 learned_addr learned my addr 172.21.15.53:0/3501643395 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f0757fff640 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83a32f0 0x5606c877f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f075cece640 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c838ad80 0x5606c8783e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f075d6cf640 1 -- 172.21.15.53:0/3501643395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83a32f0 msgr2=0x5606c877f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f075d6cf640 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83a32f0 0x5606c877f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f075d6cf640 1 -- 172.21.15.53:0/3501643395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c838ad80 msgr2=0x5606c8783e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f075d6cf640 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c838ad80 0x5606c8783e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f075d6cf640 1 -- 172.21.15.53:0/3501643395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606c877ffd0 con 0x5606c83c0300 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f075d6cf640 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83c0300 0x5606c877f860 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f075001b970 tx=0x7f075001be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a4e6712f9a2b4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f0737fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f0737fff640 1 -- 172.21.15.53:0/3501643395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0750036060 con 0x5606c83c0300 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f0737fff640 1 -- 172.21.15.53:0/3501643395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0750024040 con 0x5606c83c0300 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f07660a0740 1 -- 172.21.15.53:0/3501643395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f075001ed20 con 0x5606c83c0300 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f0737fff640 1 -- 172.21.15.53:0/3501643395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0750004c50 con 0x5606c83c0300 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f07660a0740 10 client.16380 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.580+0000 7f07660a0740 1 -- 172.21.15.53:0/3501643395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5606c87f83e0 con 0x5606c83c0300 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.581+0000 7f0737fff640 1 -- 172.21.15.53:0/3501643395 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f075001ed20 con 0x5606c83c0300 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.581+0000 7f0737fff640 1 -- 172.21.15.53:0/3501643395 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f0750003c70 con 0x5606c83c0300 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.581+0000 7f07660a0740 10 client.16380 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.581+0000 7f07660a0740 10 client.16380 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.581+0000 7f07660a0740 20 client.16380 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.581+0000 7f07660a0740 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5606c83ab4d0 0x5606c87fac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.581+0000 7f07660a0740 4 client.16380 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.581+0000 7f07660a0740 1 -- 172.21.15.53:0/3501643395 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5606c86e29f0 con 0x5606c83ab4d0 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.581+0000 7f075cece640 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5606c83ab4d0 0x5606c87fac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.582+0000 7f075cece640 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5606c83ab4d0 0x5606c87fac90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21ac058e4291eae2 server_cookie=4fe1434fdc90bda9 in_seq=0 out_seq=0 2024-08-31T06:06:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.582+0000 7f0737fff640 10 client.16380 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:57.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f0737fff640 1 -- 172.21.15.53:0/3501643395 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5606c86e29f0 con 0x5606c83ab4d0 2024-08-31T06:06:57.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f0737fff640 10 client.16380 handle_command_reply: tid=0 2024-08-31T06:06:57.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f07660a0740 1 client.16380 shutdown 2024-08-31T06:06:57.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f07660a0740 1 -- 172.21.15.53:0/3501643395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83c0300 msgr2=0x5606c877f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:57.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f07660a0740 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83c0300 0x5606c877f860 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f075001b970 tx=0x7f075001be00 comp rx=0 tx=0).stop 2024-08-31T06:06:57.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f07660a0740 1 -- 172.21.15.53:0/3501643395 shutdown_connections 2024-08-31T06:06:57.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f07660a0740 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5606c83ab4d0 0x5606c87fac90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f07660a0740 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606c83c0300 0x5606c877f860 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f0737fff640 0 client.16380 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f07660a0740 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606c83a32f0 0x5606c877f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f07660a0740 1 --2- 172.21.15.53:0/3501643395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606c838ad80 0x5606c8783e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.599+0000 7f07660a0740 1 -- 172.21.15.53:0/3501643395 >> 172.21.15.53:0/3501643395 conn(0x5606c87760f0 msgr2=0x5606c8776840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f07660a0740 1 -- 172.21.15.53:0/3501643395 shutdown_connections 2024-08-31T06:06:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f07660a0740 1 -- 172.21.15.53:0/3501643395 wait complete. 2024-08-31T06:06:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f07660a0740 20 client.16380 trim_cache size 0 max 16384 2024-08-31T06:06:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:06:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:06:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:06:57.604 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:06:57.604 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f075f132640 1 -- 172.21.15.53:0/1798765753 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07480b6eb0 msgr2=0x7f07480b93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:57.604 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f075f132640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07480b6eb0 0x7f07480b93c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0750007fd0 tx=0x7f07500076a0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.604 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f075f132640 1 -- 172.21.15.53:0/1798765753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0758102750 msgr2=0x7f0758197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f075f132640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0758102750 0x7f0758197f80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f074c00d950 tx=0x7f074c00de10 comp rx=0 tx=0).stop 2024-08-31T06:06:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f075f132640 1 -- 172.21.15.53:0/1798765753 shutdown_connections 2024-08-31T06:06:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f075f132640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07480b6eb0 0x7f07480b93c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f075f132640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07581089d0 0x7f075819d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f075f132640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0758108080 0x7f0758198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f075f132640 1 --2- 172.21.15.53:0/1798765753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0758102750 0x7f0758197f80 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.600+0000 7f075f132640 1 -- 172.21.15.53:0/1798765753 >> 172.21.15.53:0/1798765753 conn(0x7f075807a4e0 msgr2=0x7f07581041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.601+0000 7f075f132640 1 -- 172.21.15.53:0/1798765753 shutdown_connections 2024-08-31T06:06:57.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:06:57.601+0000 7f075f132640 1 -- 172.21.15.53:0/1798765753 wait complete. 2024-08-31T06:06:57.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:57 smithi053 ceph-mon[18924]: pgmap v383: 97 pgs: 97 active+clean; 26 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2024-08-31T06:06:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:06:57.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:57 smithi130 ceph-mon[22266]: pgmap v383: 97 pgs: 97 active+clean; 26 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2024-08-31T06:06:57.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:57 smithi153 ceph-mon[22320]: pgmap v383: 97 pgs: 97 active+clean; 26 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2024-08-31T06:06:57.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 26126 3.34 MB/sec warmup 47 sec latency 504.303 ms 2024-08-31T06:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.216+0000 7f01782e3640 1 -- 172.21.15.53:0/2253340458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0170108ac0 msgr2=0x7f017010f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.216+0000 7f01782e3640 1 --2- 172.21.15.53:0/2253340458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0170108ac0 0x7f017010f2f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0168009ca0 tx=0x7f016802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.216+0000 7f01782e3640 1 -- 172.21.15.53:0/2253340458 shutdown_connections 2024-08-31T06:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.216+0000 7f01782e3640 1 --2- 172.21.15.53:0/2253340458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0170108ac0 0x7f017010f2f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.216+0000 7f01782e3640 1 --2- 172.21.15.53:0/2253340458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170108170 0x7f0170108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.216+0000 7f01782e3640 1 --2- 172.21.15.53:0/2253340458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0170102880 0x7f0170102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.216+0000 7f01782e3640 1 -- 172.21.15.53:0/2253340458 >> 172.21.15.53:0/2253340458 conn(0x7f0170079500 msgr2=0x7f0170079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.216+0000 7f01782e3640 1 -- 172.21.15.53:0/2253340458 shutdown_connections 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.216+0000 7f01782e3640 1 -- 172.21.15.53:0/2253340458 wait complete. 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.217+0000 7f01782e3640 1 Processor -- start 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.217+0000 7f01782e3640 1 -- start start 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.217+0000 7f01782e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0170102880 0x7f017019afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.217+0000 7f01782e3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0170108170 0x7f017019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.217+0000 7f01782e3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170108ac0 0x7f017019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.217+0000 7f01782e3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0170112640 con 0x7f0170102880 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.217+0000 7f01782e3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01701124c0 con 0x7f0170108170 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.217+0000 7f01782e3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01701127c0 con 0x7f0170108ac0 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f017607f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0170102880 0x7f017019afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f017607f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0170102880 0x7f017019afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43432/0 (socket says 172.21.15.53:43432) 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f017607f640 1 -- 172.21.15.53:0/2584967357 learned_addr learned my addr 172.21.15.53:0/2584967357 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f017587e640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0170108170 0x7f017019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f0176880640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170108ac0 0x7f017019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f017607f640 1 -- 172.21.15.53:0/2584967357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170108ac0 msgr2=0x7f017019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f017607f640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170108ac0 0x7f017019ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f017607f640 1 -- 172.21.15.53:0/2584967357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0170108170 msgr2=0x7f017019b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f017607f640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0170108170 0x7f017019b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f017607f640 1 -- 172.21.15.53:0/2584967357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01701a6260 con 0x7f0170102880 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f017607f640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0170102880 0x7f017019afd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f016c00d950 tx=0x7f016c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f01677fe640 1 -- 172.21.15.53:0/2584967357 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c017030 con 0x7f0170102880 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f01677fe640 1 -- 172.21.15.53:0/2584967357 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f016c004020 con 0x7f0170102880 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f01782e3640 1 -- 172.21.15.53:0/2584967357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01701a6550 con 0x7f0170102880 2024-08-31T06:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f01677fe640 1 -- 172.21.15.53:0/2584967357 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0055d0 con 0x7f0170102880 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.218+0000 7f01782e3640 1 -- 172.21.15.53:0/2584967357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01701a6ae0 con 0x7f0170102880 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.221+0000 7f017e858740 1 Processor -- start 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.221+0000 7f01677fe640 1 -- 172.21.15.53:0/2584967357 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f016c009a30 con 0x7f0170102880 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.221+0000 7f017e858740 1 -- start start 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.221+0000 7f017e858740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d4a070 0x55bb040ef310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.221+0000 7f017e858740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ef850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017e858740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb040efd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017e858740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb04066680 con 0x55bb03d211b0 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017e858740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bb04055c10 con 0x55bb03d4a070 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017e858740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bb04059bc0 con 0x55bb03d29390 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017607f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017607f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ef850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43446/0 (socket says 172.21.15.53:43446) 2024-08-31T06:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017607f640 1 -- 172.21.15.53:0/2272984178 learned_addr learned my addr 172.21.15.53:0/2272984178 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017587e640 1 --2- 172.21.15.53:0/2272984178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb040efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f0176880640 1 --2- 172.21.15.53:0/2272984178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d4a070 0x55bb040ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017587e640 1 -- 172.21.15.53:0/2272984178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d4a070 msgr2=0x55bb040ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f01677fe640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f015c0b4d50 0x7f015c0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017587e640 1 --2- 172.21.15.53:0/2272984178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d4a070 0x55bb040ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017587e640 1 -- 172.21.15.53:0/2272984178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 msgr2=0x55bb040ef850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017587e640 1 --2- 172.21.15.53:0/2272984178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ef850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017587e640 1 -- 172.21.15.53:0/2272984178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb03db5650 con 0x55bb03d29390 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017607f640 1 --2- 172.21.15.53:0/2272984178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f0176880640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f015c0b4d50 0x7f015c0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f01677fe640 1 -- 172.21.15.53:0/2584967357 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f016c0e4ef0 con 0x7f0170102880 2024-08-31T06:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.222+0000 7f017587e640 1 --2- 172.21.15.53:0/2272984178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb040efd90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f017006b420 tx=0x7f0160011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ece007c11cda3ce server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.223+0000 7f0164d9a640 1 -- 172.21.15.53:0/2272984178 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160009d50 con 0x55bb03d29390 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.223+0000 7f0164d9a640 1 -- 172.21.15.53:0/2272984178 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01600044c0 con 0x55bb03d29390 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.223+0000 7f0176880640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f015c0b4d50 0x7f015c0b7260 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0168005e30 tx=0x7f01680095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.223+0000 7f0164d9a640 1 -- 172.21.15.53:0/2272984178 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160004a00 con 0x55bb03d29390 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 -- 172.21.15.53:0/2272984178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 msgr2=0x55bb040efd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 --2- 172.21.15.53:0/2272984178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb040efd90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f017006b420 tx=0x7f0160011810 comp rx=0 tx=0).stop 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 -- 172.21.15.53:0/2272984178 shutdown_connections 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 --2- 172.21.15.53:0/2272984178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb040efd90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 --2- 172.21.15.53:0/2272984178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 --2- 172.21.15.53:0/2272984178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d4a070 0x55bb040ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 -- 172.21.15.53:0/2272984178 >> 172.21.15.53:0/2272984178 conn(0x55bb03d3e460 msgr2=0x55bb040ed200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 -- 172.21.15.53:0/2272984178 shutdown_connections 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 -- 172.21.15.53:0/2272984178 wait complete. 2024-08-31T06:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 -- start start 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 Processor -- start 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d211b0 0x55bb040faa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb040faf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d4a070 0x55bb04106de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb03eb8700 con 0x55bb03d4a070 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bb03fdc750 con 0x55bb03d211b0 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.224+0000 7f017e858740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bb040fdaf0 con 0x55bb03d29390 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f017e858740 10 client.0 _ll_register_callbacks cb 0x55bb0400be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0176880640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d4a070 0x55bb04106de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0176880640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d4a070 0x55bb04106de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43450/0 (socket says 172.21.15.53:43450) 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0176880640 1 -- 172.21.15.53:0/1874034901 learned_addr learned my addr 172.21.15.53:0/1874034901 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f017587e640 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb040faf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f017607f640 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d211b0 0x55bb040faa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0176880640 1 -- 172.21.15.53:0/1874034901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 msgr2=0x55bb040faf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0176880640 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb040faf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0176880640 1 -- 172.21.15.53:0/1874034901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d211b0 msgr2=0x55bb040faa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0176880640 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d211b0 0x55bb040faa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0176880640 1 -- 172.21.15.53:0/1874034901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb04015900 con 0x55bb03d4a070 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f017587e640 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb040faf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0176880640 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d4a070 0x55bb04106de0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0168035000 tx=0x7f016802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf8a49d521d92f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0159ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0159ffb640 1 -- 172.21.15.53:0/1874034901 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168003e40 con 0x55bb03d4a070 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f0159ffb640 1 -- 172.21.15.53:0/1874034901 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0168004040 con 0x55bb03d4a070 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.225+0000 7f017e858740 1 -- 172.21.15.53:0/1874034901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bb040685d0 con 0x55bb03d4a070 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f0159ffb640 1 -- 172.21.15.53:0/1874034901 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0168004240 con 0x55bb03d4a070 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f017e858740 10 client.16392 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f017e858740 1 -- 172.21.15.53:0/1874034901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bb04109830 con 0x55bb03d4a070 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f0159ffb640 1 -- 172.21.15.53:0/1874034901 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bb040685d0 con 0x55bb03d4a070 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f0159ffb640 1 -- 172.21.15.53:0/1874034901 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f0168030b50 con 0x55bb03d4a070 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f017e858740 10 client.16392 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f017e858740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f017e858740 20 client.16392 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f017e858740 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb03d089f0 0x55bb0410cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f017e858740 4 client.16392 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f017e858740 1 -- 172.21.15.53:0/1874034901 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb04064070 con 0x55bb03d089f0 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.226+0000 7f017607f640 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb03d089f0 0x55bb0410cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.227+0000 7f0159ffb640 10 client.16392 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.227+0000 7f017607f640 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb03d089f0 0x55bb0410cdb0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bdf46b5efba42e9 server_cookie=eb26bae54ad8f889 in_seq=0 out_seq=0 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f0159ffb640 1 -- 172.21.15.53:0/1874034901 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb04064070 con 0x55bb03d089f0 2024-08-31T06:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f0159ffb640 10 client.16392 handle_command_reply: tid=0 2024-08-31T06:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 1 client.16392 shutdown 2024-08-31T06:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 1 -- 172.21.15.53:0/1874034901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d4a070 msgr2=0x55bb04106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d4a070 0x55bb04106de0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0168035000 tx=0x7f016802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 1 -- 172.21.15.53:0/1874034901 shutdown_connections 2024-08-31T06:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb03d089f0 0x55bb0410cdb0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d4a070 0x55bb04106de0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb040faf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f0159ffb640 0 client.16392 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 1 --2- 172.21.15.53:0/1874034901 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d211b0 0x55bb040faa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 1 -- 172.21.15.53:0/1874034901 >> 172.21.15.53:0/1874034901 conn(0x55bb03d3e460 msgr2=0x55bb040f24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 1 -- 172.21.15.53:0/1874034901 shutdown_connections 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 1 -- 172.21.15.53:0/1874034901 wait complete. 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.228+0000 7f017e858740 20 client.16392 trim_cache size 0 max 16384 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.241+0000 7f017e858740 1 Processor -- start 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.241+0000 7f017e858740 1 -- start start 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f017e858740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d089f0 0x55bb04106ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f017e858740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d211b0 0x55bb040f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f017e858740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d29390 0x55bb040f8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f017e858740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01701af530 con 0x55bb03d29390 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f017e858740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01701b1130 con 0x55bb03d211b0 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f017e858740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01701afc00 con 0x55bb03d089f0 2024-08-31T06:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f0176880640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d29390 0x55bb040f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f0176880640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d29390 0x55bb040f8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43462/0 (socket says 172.21.15.53:43462) 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f0176880640 1 -- 172.21.15.53:0/3476322854 learned_addr learned my addr 172.21.15.53:0/3476322854 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f017607f640 1 --2- 172.21.15.53:0/3476322854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d089f0 0x55bb04106ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f017587e640 1 --2- 172.21.15.53:0/3476322854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d211b0 0x55bb040f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f0176880640 1 -- 172.21.15.53:0/3476322854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d089f0 msgr2=0x55bb04106ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f0176880640 1 --2- 172.21.15.53:0/3476322854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d089f0 0x55bb04106ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f0176880640 1 -- 172.21.15.53:0/3476322854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d211b0 msgr2=0x55bb040f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f0176880640 1 --2- 172.21.15.53:0/3476322854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d211b0 0x55bb040f7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f0176880640 1 -- 172.21.15.53:0/3476322854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb040f8f50 con 0x55bb03d29390 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f0176880640 1 --2- 172.21.15.53:0/3476322854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d29390 0x55bb040f8180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0168030fb0 tx=0x7f01680041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3850c07899d60965 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.242+0000 7f015bfff640 1 -- 172.21.15.53:0/3476322854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168003e40 con 0x55bb03d29390 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.243+0000 7f015bfff640 1 -- 172.21.15.53:0/3476322854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f016804d030 con 0x55bb03d29390 2024-08-31T06:06:58.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.243+0000 7f015bfff640 1 -- 172.21.15.53:0/3476322854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168030c40 con 0x55bb03d29390 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.243+0000 7f017e858740 1 -- 172.21.15.53:0/3476322854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d29390 msgr2=0x55bb040f8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.243+0000 7f017e858740 1 --2- 172.21.15.53:0/3476322854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d29390 0x55bb040f8180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0168030fb0 tx=0x7f01680041d0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.243+0000 7f017e858740 1 -- 172.21.15.53:0/3476322854 shutdown_connections 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.243+0000 7f017e858740 1 --2- 172.21.15.53:0/3476322854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d29390 0x55bb040f8180 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.243+0000 7f017e858740 1 --2- 172.21.15.53:0/3476322854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d211b0 0x55bb040f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.243+0000 7f017e858740 1 --2- 172.21.15.53:0/3476322854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d089f0 0x55bb04106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.243+0000 7f017e858740 1 -- 172.21.15.53:0/3476322854 >> 172.21.15.53:0/3476322854 conn(0x55bb03d3e460 msgr2=0x55bb040f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.243+0000 7f017e858740 1 -- 172.21.15.53:0/3476322854 shutdown_connections 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.243+0000 7f017e858740 1 -- 172.21.15.53:0/3476322854 wait complete. 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017e858740 1 -- start start 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017e858740 1 Processor -- start 2024-08-31T06:06:58.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017e858740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d089f0 0x55bb040ff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017e858740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017e858740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb041707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017e858740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01701b09a0 con 0x55bb03d211b0 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017e858740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01701b02d0 con 0x55bb03d089f0 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017e858740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01701ad510 con 0x55bb03d29390 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017e858740 10 client.0 _ll_register_callbacks cb 0x7f0168009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017587e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017587e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ffd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43468/0 (socket says 172.21.15.53:43468) 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017587e640 1 -- 172.21.15.53:0/3607914201 learned_addr learned my addr 172.21.15.53:0/3607914201 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f017607f640 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d089f0 0x55bb040ff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.244+0000 7f0176880640 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb041707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f017587e640 1 -- 172.21.15.53:0/3607914201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 msgr2=0x55bb041707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f017587e640 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb041707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f017587e640 1 -- 172.21.15.53:0/3607914201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d089f0 msgr2=0x55bb040ff7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f017587e640 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d089f0 0x55bb040ff7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f017587e640 1 -- 172.21.15.53:0/3607914201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb04170e40 con 0x55bb03d211b0 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f0176880640 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb041707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f017587e640 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ffd90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f017006b420 tx=0x7f0160019e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e526f2252b2eaae2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f0159ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f0159ffb640 1 -- 172.21.15.53:0/3607914201 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160030060 con 0x55bb03d211b0 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f0159ffb640 1 -- 172.21.15.53:0/3607914201 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0160009d50 con 0x55bb03d211b0 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f017e858740 1 -- 172.21.15.53:0/3607914201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f016804d030 con 0x55bb03d211b0 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f0159ffb640 1 -- 172.21.15.53:0/3607914201 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0160005640 con 0x55bb03d211b0 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f017e858740 10 client.16398 fetch_fsmap learned FSMap version 30 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f017e858740 1 -- 172.21.15.53:0/3607914201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bb04178260 con 0x55bb03d211b0 2024-08-31T06:06:58.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.245+0000 7f0159ffb640 1 -- 172.21.15.53:0/3607914201 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f016804d030 con 0x55bb03d211b0 2024-08-31T06:06:58.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f0159ffb640 1 -- 172.21.15.53:0/3607914201 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f0160023490 con 0x55bb03d211b0 2024-08-31T06:06:58.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f017e858740 10 client.16398 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:06:58.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f017e858740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:06:58.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f017e858740 20 client.16398 populate_metadata read hostname 'smithi053' 2024-08-31T06:06:58.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f017e858740 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb03d4a070 0x55bb0417a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:06:58.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f017e858740 4 client.16398 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:06:58.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f017e858740 1 -- 172.21.15.53:0/3607914201 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bb040617b0 con 0x55bb03d4a070 2024-08-31T06:06:58.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f017607f640 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb03d4a070 0x55bb0417a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:06:58.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f0159ffb640 10 client.16398 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:58.276 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:06:58.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f017607f640 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb03d4a070 0x55bb0417a900 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc0357322e992c35 server_cookie=d8b9f9dad0a0b91a in_seq=0 out_seq=0 2024-08-31T06:06:58.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f0159ffb640 1 -- 172.21.15.53:0/3607914201 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bb040617b0 con 0x55bb03d4a070 2024-08-31T06:06:58.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f0159ffb640 10 client.16398 handle_command_reply: tid=0 2024-08-31T06:06:58.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.246+0000 7f017e858740 1 client.16398 shutdown 2024-08-31T06:06:58.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f017e858740 1 -- 172.21.15.53:0/3607914201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 msgr2=0x55bb040ffd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:58.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f017e858740 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ffd90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f017006b420 tx=0x7f0160019e30 comp rx=0 tx=0).stop 2024-08-31T06:06:58.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f017e858740 1 -- 172.21.15.53:0/3607914201 shutdown_connections 2024-08-31T06:06:58.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f017e858740 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb03d4a070 0x55bb0417a900 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f017e858740 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb03d29390 0x55bb041707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f017e858740 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb03d211b0 0x55bb040ffd90 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f017e858740 1 --2- 172.21.15.53:0/3607914201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb03d089f0 0x55bb040ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f017e858740 1 -- 172.21.15.53:0/3607914201 >> 172.21.15.53:0/3607914201 conn(0x55bb03d3e460 msgr2=0x55bb040f02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:58.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f0159ffb640 0 client.16398 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:06:58.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f017e858740 1 -- 172.21.15.53:0/3607914201 shutdown_connections 2024-08-31T06:06:58.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f017e858740 1 -- 172.21.15.53:0/3607914201 wait complete. 2024-08-31T06:06:58.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f017e858740 20 client.16398 trim_cache size 0 max 16384 2024-08-31T06:06:58.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f01782e3640 1 -- 172.21.15.53:0/2584967357 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f015c0b4d50 msgr2=0x7f015c0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:58.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f01782e3640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f015c0b4d50 0x7f015c0b7260 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0168005e30 tx=0x7f01680095c0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f01782e3640 1 -- 172.21.15.53:0/2584967357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0170102880 msgr2=0x7f017019afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:06:58.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f01782e3640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0170102880 0x7f017019afd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f016c00d950 tx=0x7f016c00de10 comp rx=0 tx=0).stop 2024-08-31T06:06:58.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f01782e3640 1 -- 172.21.15.53:0/2584967357 shutdown_connections 2024-08-31T06:06:58.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f01782e3640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f015c0b4d50 0x7f015c0b7260 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f01782e3640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170108ac0 0x7f017019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f01782e3640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0170108170 0x7f017019b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f01782e3640 1 --2- 172.21.15.53:0/2584967357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0170102880 0x7f017019afd0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:06:58.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.247+0000 7f01782e3640 1 -- 172.21.15.53:0/2584967357 >> 172.21.15.53:0/2584967357 conn(0x7f0170079500 msgr2=0x7f0170105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:06:58.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.248+0000 7f01782e3640 1 -- 172.21.15.53:0/2584967357 shutdown_connections 2024-08-31T06:06:58.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:06:58.248+0000 7f01782e3640 1 -- 172.21.15.53:0/2584967357 wait complete. 2024-08-31T06:06:58.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 26258 3.33 MB/sec warmup 48 sec latency 1340.678 ms 2024-08-31T06:06:59.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:06:59 smithi130 ceph-mon[22266]: pgmap v384: 97 pgs: 97 active+clean; 26 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 1.0 MiB/s wr, 105 op/s 2024-08-31T06:06:59.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:06:59 smithi153 ceph-mon[22320]: pgmap v384: 97 pgs: 97 active+clean; 26 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 1.0 MiB/s wr, 105 op/s 2024-08-31T06:06:59.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 26846 3.27 MB/sec warmup 49 sec latency 14.439 ms 2024-08-31T06:06:59.968 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:06:59.968 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:06:59.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:06:59 smithi053 ceph-mon[18924]: pgmap v384: 97 pgs: 97 active+clean; 26 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 1.0 MiB/s wr, 105 op/s 2024-08-31T06:07:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:00.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.709+0000 7eff42838640 1 -- 172.21.15.53:0/1542346542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff3c108b10 msgr2=0x7eff3c10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.709+0000 7eff42838640 1 --2- 172.21.15.53:0/1542346542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff3c108b10 0x7eff3c10f340 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7eff34009ca0 tx=0x7eff3402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.709+0000 7eff42838640 1 -- 172.21.15.53:0/1542346542 shutdown_connections 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.709+0000 7eff42838640 1 --2- 172.21.15.53:0/1542346542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff3c108b10 0x7eff3c10f340 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.709+0000 7eff42838640 1 --2- 172.21.15.53:0/1542346542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c1081c0 0x7eff3c1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.709+0000 7eff42838640 1 --2- 172.21.15.53:0/1542346542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff3c102880 0x7eff3c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.709+0000 7eff42838640 1 -- 172.21.15.53:0/1542346542 >> 172.21.15.53:0/1542346542 conn(0x7eff3c079510 msgr2=0x7eff3c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.709+0000 7eff42838640 1 -- 172.21.15.53:0/1542346542 shutdown_connections 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.709+0000 7eff42838640 1 -- 172.21.15.53:0/1542346542 wait complete. 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.710+0000 7eff42838640 1 Processor -- start 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.710+0000 7eff42838640 1 -- start start 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.710+0000 7eff42838640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff3c102880 0x7eff3c19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.710+0000 7eff42838640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff3c1081c0 0x7eff3c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.710+0000 7eff42838640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c108b10 0x7eff3c19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.710+0000 7eff42838640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c1137d0 con 0x7eff3c1081c0 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.710+0000 7eff42838640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c113650 con 0x7eff3c102880 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.710+0000 7eff42838640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c113950 con 0x7eff3c108b10 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff3b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff3c1081c0 0x7eff3c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff3b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff3c1081c0 0x7eff3c19a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43482/0 (socket says 172.21.15.53:43482) 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff3b7fe640 1 -- 172.21.15.53:0/3253583966 learned_addr learned my addr 172.21.15.53:0/3253583966 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff3bfff640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff3c102880 0x7eff3c19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff40dd5640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c108b10 0x7eff3c19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff3b7fe640 1 -- 172.21.15.53:0/3253583966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c108b10 msgr2=0x7eff3c19fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c108b10 0x7eff3c19fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff3b7fe640 1 -- 172.21.15.53:0/3253583966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff3c102880 msgr2=0x7eff3c19a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff3c102880 0x7eff3c19a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff3b7fe640 1 -- 172.21.15.53:0/3253583966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3c1a0170 con 0x7eff3c1081c0 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff3c1081c0 0x7eff3c19a7a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7eff3000e9f0 tx=0x7eff3000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff397fa640 1 -- 172.21.15.53:0/3253583966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3000ccc0 con 0x7eff3c1081c0 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff42838640 1 -- 172.21.15.53:0/3253583966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3c1a0460 con 0x7eff3c1081c0 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff397fa640 1 -- 172.21.15.53:0/3253583966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff300108c0 con 0x7eff3c1081c0 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff397fa640 1 -- 172.21.15.53:0/3253583966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30018660 con 0x7eff3c1081c0 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.711+0000 7eff42838640 1 -- 172.21.15.53:0/3253583966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3c1a6bc0 con 0x7eff3c1081c0 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff48dad740 1 Processor -- start 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff48dad740 1 -- start start 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff397fa640 1 -- 172.21.15.53:0/3253583966 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7eff30010430 con 0x7eff3c1081c0 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff48dad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a329350 0x563d1a6cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff48dad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a300490 0x563d1a6cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff48dad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a308670 0x563d1a6d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff48dad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563d1a6455f0 con 0x563d1a300490 2024-08-31T06:07:00.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff48dad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563d1a634b80 con 0x563d1a308670 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff48dad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563d1a638b30 con 0x563d1a329350 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a300490 0x563d1a6cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a300490 0x563d1a6cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43484/0 (socket says 172.21.15.53:43484) 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff3bfff640 1 -- 172.21.15.53:0/4027650391 learned_addr learned my addr 172.21.15.53:0/4027650391 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.714+0000 7eff40dd5640 1 --2- 172.21.15.53:0/4027650391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a329350 0x563d1a6cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/4027650391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a308670 0x563d1a6d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff3bfff640 1 -- 172.21.15.53:0/4027650391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a329350 msgr2=0x563d1a6cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff3bfff640 1 --2- 172.21.15.53:0/4027650391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a329350 0x563d1a6cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff3bfff640 1 -- 172.21.15.53:0/4027650391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a308670 msgr2=0x563d1a6d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff3bfff640 1 --2- 172.21.15.53:0/4027650391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a308670 0x563d1a6d0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff3bfff640 1 -- 172.21.15.53:0/4027650391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d1a394930 con 0x563d1a300490 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff397fa640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff240b4ca0 0x7eff240b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff3bfff640 1 --2- 172.21.15.53:0/4027650391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a300490 0x563d1a6cfcc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00bd00 tx=0x7eff2c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8547875c23c2d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:00.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff40dd5640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff240b4ca0 0x7eff240b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff397fa640 1 -- 172.21.15.53:0/3253583966 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7eff300e5940 con 0x7eff3c1081c0 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff227fc640 1 -- 172.21.15.53:0/4027650391 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c005220 con 0x563d1a300490 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff227fc640 1 -- 172.21.15.53:0/4027650391 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff2c004c30 con 0x563d1a300490 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.715+0000 7eff227fc640 1 -- 172.21.15.53:0/4027650391 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0116a0 con 0x563d1a300490 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.716+0000 7eff48dad740 1 -- 172.21.15.53:0/4027650391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a300490 msgr2=0x563d1a6cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.716+0000 7eff40dd5640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff240b4ca0 0x7eff240b71b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7eff34005e30 tx=0x7eff34005c50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.716+0000 7eff48dad740 1 --2- 172.21.15.53:0/4027650391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a300490 0x563d1a6cfcc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00bd00 tx=0x7eff2c0107a0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.716+0000 7eff48dad740 1 -- 172.21.15.53:0/4027650391 shutdown_connections 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.716+0000 7eff48dad740 1 --2- 172.21.15.53:0/4027650391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a308670 0x563d1a6d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.716+0000 7eff48dad740 1 --2- 172.21.15.53:0/4027650391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a300490 0x563d1a6cfcc0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.716+0000 7eff48dad740 1 --2- 172.21.15.53:0/4027650391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a329350 0x563d1a6cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.716+0000 7eff48dad740 1 -- 172.21.15.53:0/4027650391 >> 172.21.15.53:0/4027650391 conn(0x563d1a31d740 msgr2=0x563d1a6cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:00.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.716+0000 7eff48dad740 1 -- 172.21.15.53:0/4027650391 shutdown_connections 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.716+0000 7eff48dad740 1 -- 172.21.15.53:0/4027650391 wait complete. 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff48dad740 1 -- start start 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff48dad740 1 Processor -- start 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff48dad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a300490 0x563d1a6df320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff48dad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a308670 0x563d1a6df860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff48dad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a329350 0x563d1a6eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff48dad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563d1a497890 con 0x563d1a329350 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff48dad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563d1a5bb790 con 0x563d1a308670 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff48dad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563d1a6e2290 con 0x563d1a300490 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff48dad740 10 client.0 _ll_register_callbacks cb 0x563d1a340ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff40dd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a329350 0x563d1a6eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff40dd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a329350 0x563d1a6eb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43500/0 (socket says 172.21.15.53:43500) 2024-08-31T06:07:00.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.717+0000 7eff40dd5640 1 -- 172.21.15.53:0/4014282415 learned_addr learned my addr 172.21.15.53:0/4014282415 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff3bfff640 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a300490 0x563d1a6df320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a308670 0x563d1a6df860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff40dd5640 1 -- 172.21.15.53:0/4014282415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a300490 msgr2=0x563d1a6df320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff40dd5640 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a300490 0x563d1a6df320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff40dd5640 1 -- 172.21.15.53:0/4014282415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a308670 msgr2=0x563d1a6df860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff40dd5640 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a308670 0x563d1a6df860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff40dd5640 1 -- 172.21.15.53:0/4014282415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d1a5f2f30 con 0x563d1a329350 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a308670 0x563d1a6df860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff40dd5640 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a329350 0x563d1a6eb5f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7eff34035000 tx=0x7eff3402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403a2da3562ce298 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff1b7fe640 1 -- 172.21.15.53:0/4014282415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34032e20 con 0x563d1a329350 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff1b7fe640 1 -- 172.21.15.53:0/4014282415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7eff34004040 con 0x563d1a329350 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff48dad740 1 -- 172.21.15.53:0/4014282415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff2c004c30 con 0x563d1a329350 2024-08-31T06:07:00.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff1b7fe640 1 -- 172.21.15.53:0/4014282415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7eff34004240 con 0x563d1a329350 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff48dad740 10 client.16410 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.718+0000 7eff48dad740 1 -- 172.21.15.53:0/4014282415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563d1a6ee0e0 con 0x563d1a329350 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.719+0000 7eff1b7fe640 1 -- 172.21.15.53:0/4014282415 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff2c004c30 con 0x563d1a329350 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.719+0000 7eff1b7fe640 1 -- 172.21.15.53:0/4014282415 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7eff34051070 con 0x563d1a329350 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.719+0000 7eff48dad740 10 client.16410 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.719+0000 7eff48dad740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.719+0000 7eff48dad740 20 client.16410 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.719+0000 7eff48dad740 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563d1a2e7cd0 0x563d1a6f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.719+0000 7eff48dad740 4 client.16410 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.719+0000 7eff48dad740 1 -- 172.21.15.53:0/4014282415 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d1a647540 con 0x563d1a2e7cd0 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.719+0000 7eff3bfff640 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563d1a2e7cd0 0x563d1a6f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.720+0000 7eff1b7fe640 10 client.16410 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:00.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.720+0000 7eff3bfff640 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563d1a2e7cd0 0x563d1a6f16b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c566df80b426277 server_cookie=ec69c8ce78597bd4 in_seq=0 out_seq=0 2024-08-31T06:07:00.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.720+0000 7eff1b7fe640 1 -- 172.21.15.53:0/4014282415 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d1a647540 con 0x563d1a2e7cd0 2024-08-31T06:07:00.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.720+0000 7eff1b7fe640 10 client.16410 handle_command_reply: tid=0 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 1 client.16410 shutdown 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 1 -- 172.21.15.53:0/4014282415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a329350 msgr2=0x563d1a6eb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a329350 0x563d1a6eb5f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7eff34035000 tx=0x7eff3402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 1 -- 172.21.15.53:0/4014282415 shutdown_connections 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563d1a2e7cd0 0x563d1a6f16b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a329350 0x563d1a6eb5f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a308670 0x563d1a6df860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 1 --2- 172.21.15.53:0/4014282415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a300490 0x563d1a6df320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 1 -- 172.21.15.53:0/4014282415 >> 172.21.15.53:0/4014282415 conn(0x563d1a31d740 msgr2=0x563d1a6d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff1b7fe640 0 client.16410 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 1 -- 172.21.15.53:0/4014282415 shutdown_connections 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 1 -- 172.21.15.53:0/4014282415 wait complete. 2024-08-31T06:07:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.721+0000 7eff48dad740 20 client.16410 trim_cache size 0 max 16384 2024-08-31T06:07:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff48dad740 1 Processor -- start 2024-08-31T06:07:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff48dad740 1 -- start start 2024-08-31T06:07:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff48dad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a300490 0x563d1a6daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff48dad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff48dad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a329350 0x563d1a6eb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff48dad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c1ad320 con 0x563d1a308670 2024-08-31T06:07:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff48dad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c1aef20 con 0x563d1a300490 2024-08-31T06:07:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff48dad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c1ad9f0 con 0x563d1a329350 2024-08-31T06:07:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff3b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff3b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43502/0 (socket says 172.21.15.53:43502) 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff3b7fe640 1 -- 172.21.15.53:0/4272325461 learned_addr learned my addr 172.21.15.53:0/4272325461 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff3bfff640 1 --2- 172.21.15.53:0/4272325461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a300490 0x563d1a6daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.739+0000 7eff40dd5640 1 --2- 172.21.15.53:0/4272325461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a329350 0x563d1a6eb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.740+0000 7eff3b7fe640 1 -- 172.21.15.53:0/4272325461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a329350 msgr2=0x563d1a6eb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.740+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/4272325461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a329350 0x563d1a6eb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.740+0000 7eff3b7fe640 1 -- 172.21.15.53:0/4272325461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a300490 msgr2=0x563d1a6daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.740+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/4272325461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a300490 0x563d1a6daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.740+0000 7eff3b7fe640 1 -- 172.21.15.53:0/4272325461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d1a6f1c00 con 0x563d1a308670 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.740+0000 7eff40dd5640 1 --2- 172.21.15.53:0/4272325461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a329350 0x563d1a6eb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.740+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/4272325461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e0f50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7eff300a92a0 tx=0x7eff300abf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f453f55e16d7d3ed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.740+0000 7eff21ffb640 1 -- 172.21.15.53:0/4272325461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300abb40 con 0x563d1a308670 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.740+0000 7eff21ffb640 1 -- 172.21.15.53:0/4272325461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff300ac730 con 0x563d1a308670 2024-08-31T06:07:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.740+0000 7eff21ffb640 1 -- 172.21.15.53:0/4272325461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300eb080 con 0x563d1a308670 2024-08-31T06:07:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.741+0000 7eff48dad740 1 -- 172.21.15.53:0/4272325461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 msgr2=0x563d1a6e0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.741+0000 7eff48dad740 1 --2- 172.21.15.53:0/4272325461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e0f50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7eff300a92a0 tx=0x7eff300abf20 comp rx=0 tx=0).stop 2024-08-31T06:07:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.741+0000 7eff48dad740 1 -- 172.21.15.53:0/4272325461 shutdown_connections 2024-08-31T06:07:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.741+0000 7eff48dad740 1 --2- 172.21.15.53:0/4272325461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a329350 0x563d1a6eb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.741+0000 7eff48dad740 1 --2- 172.21.15.53:0/4272325461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e0f50 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.741+0000 7eff48dad740 1 --2- 172.21.15.53:0/4272325461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a300490 0x563d1a6daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.741+0000 7eff48dad740 1 -- 172.21.15.53:0/4272325461 >> 172.21.15.53:0/4272325461 conn(0x563d1a31d740 msgr2=0x563d1a6e0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.741+0000 7eff48dad740 1 -- 172.21.15.53:0/4272325461 shutdown_connections 2024-08-31T06:07:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.741+0000 7eff48dad740 1 -- 172.21.15.53:0/4272325461 wait complete. 2024-08-31T06:07:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.741+0000 7eff48dad740 1 -- start start 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.741+0000 7eff48dad740 1 Processor -- start 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff48dad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a300490 0x563d1a6e35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff48dad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff48dad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a329350 0x563d1a6e4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff48dad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c1ae790 con 0x563d1a308670 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff48dad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c1ae0c0 con 0x563d1a329350 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff48dad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c1ab300 con 0x563d1a300490 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff48dad740 10 client.0 _ll_register_callbacks cb 0x7eff34009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff3b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a300490 0x563d1a6e35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff3b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43506/0 (socket says 172.21.15.53:43506) 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff3b7fe640 1 -- 172.21.15.53:0/2607330550 learned_addr learned my addr 172.21.15.53:0/2607330550 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff40dd5640 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a329350 0x563d1a6e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff3b7fe640 1 -- 172.21.15.53:0/2607330550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a300490 msgr2=0x563d1a6e35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a300490 0x563d1a6e35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff3b7fe640 1 -- 172.21.15.53:0/2607330550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a329350 msgr2=0x563d1a6e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a329350 0x563d1a6e4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff3b7fe640 1 -- 172.21.15.53:0/2607330550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d1a75b0a0 con 0x563d1a308670 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff40dd5640 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a329350 0x563d1a6e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff3b7fe640 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e3ae0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7eff300e3140 tx=0x7eff300abb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cd125b69aee692 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.742+0000 7eff1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff1b7fe640 1 -- 172.21.15.53:0/2607330550 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300b08a0 con 0x563d1a308670 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff1b7fe640 1 -- 172.21.15.53:0/2607330550 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7eff30010a70 con 0x563d1a308670 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff48dad740 1 -- 172.21.15.53:0/2607330550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff300ac730 con 0x563d1a308670 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff1b7fe640 1 -- 172.21.15.53:0/2607330550 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7eff300b5350 con 0x563d1a308670 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff48dad740 10 client.16416 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff48dad740 1 -- 172.21.15.53:0/2607330550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563d1a75c360 con 0x563d1a308670 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff1b7fe640 1 -- 172.21.15.53:0/2607330550 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff300ac730 con 0x563d1a308670 2024-08-31T06:07:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff1b7fe640 1 -- 172.21.15.53:0/2607330550 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7eff300a79a0 con 0x563d1a308670 2024-08-31T06:07:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff48dad740 10 client.16416 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff48dad740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff48dad740 20 client.16416 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff48dad740 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563d1a2bd080 0x563d1a75ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff48dad740 4 client.16416 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:07:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff48dad740 1 -- 172.21.15.53:0/2607330550 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563d1a6cd8a0 con 0x563d1a2bd080 2024-08-31T06:07:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.743+0000 7eff3bfff640 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563d1a2bd080 0x563d1a75ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.744+0000 7eff3bfff640 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563d1a2bd080 0x563d1a75ea90 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e048cd7b16350ec0 server_cookie=3ac840cef70d686e in_seq=0 out_seq=0 2024-08-31T06:07:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.744+0000 7eff1b7fe640 10 client.16416 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:00.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff1b7fe640 1 -- 172.21.15.53:0/2607330550 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563d1a6cd8a0 con 0x563d1a2bd080 2024-08-31T06:07:00.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff1b7fe640 10 client.16416 handle_command_reply: tid=0 2024-08-31T06:07:00.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 1 client.16416 shutdown 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 1 -- 172.21.15.53:0/2607330550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 msgr2=0x563d1a6e3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e3ae0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7eff300e3140 tx=0x7eff300abb40 comp rx=0 tx=0).stop 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 1 -- 172.21.15.53:0/2607330550 shutdown_connections 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563d1a2bd080 0x563d1a75ea90 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d1a329350 0x563d1a6e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff1b7fe640 0 client.16416 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d1a308670 0x563d1a6e3ae0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 1 --2- 172.21.15.53:0/2607330550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d1a300490 0x563d1a6e35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 1 -- 172.21.15.53:0/2607330550 >> 172.21.15.53:0/2607330550 conn(0x563d1a31d740 msgr2=0x563d1a6d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 1 -- 172.21.15.53:0/2607330550 shutdown_connections 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 1 -- 172.21.15.53:0/2607330550 wait complete. 2024-08-31T06:07:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.745+0000 7eff48dad740 20 client.16416 trim_cache size 0 max 16384 2024-08-31T06:07:00.753 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:07:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:07:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b", 2024-08-31T06:07:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:07:00.753 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:07:00.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 -- 172.21.15.53:0/3253583966 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff240b4ca0 msgr2=0x7eff240b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff240b4ca0 0x7eff240b71b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7eff34005e30 tx=0x7eff34005c50 comp rx=0 tx=0).stop 2024-08-31T06:07:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 -- 172.21.15.53:0/3253583966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff3c1081c0 msgr2=0x7eff3c19a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff3c1081c0 0x7eff3c19a7a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7eff3000e9f0 tx=0x7eff3000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 -- 172.21.15.53:0/3253583966 shutdown_connections 2024-08-31T06:07:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff240b4ca0 0x7eff240b71b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c108b10 0x7eff3c19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff3c1081c0 0x7eff3c19a7a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 --2- 172.21.15.53:0/3253583966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff3c102880 0x7eff3c19a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 -- 172.21.15.53:0/3253583966 >> 172.21.15.53:0/3253583966 conn(0x7eff3c079510 msgr2=0x7eff3c1062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 -- 172.21.15.53:0/3253583966 shutdown_connections 2024-08-31T06:07:00.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:00.746+0000 7eff42838640 1 -- 172.21.15.53:0/3253583966 wait complete. 2024-08-31T06:07:00.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 27042 3.21 MB/sec warmup 50 sec latency 706.932 ms 2024-08-31T06:07:01.594 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:07:01.656 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:01 smithi053 ceph-mon[18924]: pgmap v385: 97 pgs: 97 active+clean; 26 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1000 KiB/s wr, 114 op/s 2024-08-31T06:07:01.656 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:01 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:01.656 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:01 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:01.656 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:01 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.656 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:01 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.656 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:01 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:01.656 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:01 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:01.656 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:01 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.656 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:01 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:01.656 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:01 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.657 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:01 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:01 smithi130 ceph-mon[22266]: pgmap v385: 97 pgs: 97 active+clean; 26 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1000 KiB/s wr, 114 op/s 2024-08-31T06:07:01.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:01 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:01.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:01 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:01.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:01 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:01 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:01 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:01.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:01 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:01.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:01 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:01 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:01.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:01 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:01 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.907 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:01.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:01 smithi153 ceph-mon[22320]: pgmap v385: 97 pgs: 97 active+clean; 26 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1000 KiB/s wr, 114 op/s 2024-08-31T06:07:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:01 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:01 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:01 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:01 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:01 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:01 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:01 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:01 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:01 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:01 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:01.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 27482 3.19 MB/sec warmup 51 sec latency 15.632 ms 2024-08-31T06:07:02.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.419+0000 7fcf262f5640 1 -- 172.21.15.53:0/3251551129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf201083a0 msgr2=0x7fcf201087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:02.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.419+0000 7fcf262f5640 1 --2- 172.21.15.53:0/3251551129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf201083a0 0x7fcf201087b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009900 tx=0x7fcf1002a410 comp rx=0 tx=0).stop 2024-08-31T06:07:02.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.419+0000 7fcf262f5640 1 -- 172.21.15.53:0/3251551129 shutdown_connections 2024-08-31T06:07:02.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.419+0000 7fcf262f5640 1 --2- 172.21.15.53:0/3251551129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf201079e0 0x7fcf2010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.419+0000 7fcf262f5640 1 --2- 172.21.15.53:0/3251551129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf20107090 0x7fcf201074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.419+0000 7fcf262f5640 1 --2- 172.21.15.53:0/3251551129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf201083a0 0x7fcf201087b0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.419+0000 7fcf262f5640 1 -- 172.21.15.53:0/3251551129 >> 172.21.15.53:0/3251551129 conn(0x7fcf200775a0 msgr2=0x7fcf200779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:02.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.419+0000 7fcf262f5640 1 -- 172.21.15.53:0/3251551129 shutdown_connections 2024-08-31T06:07:02.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.419+0000 7fcf262f5640 1 -- 172.21.15.53:0/3251551129 wait complete. 2024-08-31T06:07:02.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.420+0000 7fcf262f5640 1 Processor -- start 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.420+0000 7fcf262f5640 1 -- start start 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf262f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf20107090 0x7fcf2019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf262f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf201079e0 0x7fcf2019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf262f5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf201083a0 0x7fcf2019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf262f5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcf20112610 con 0x7fcf20107090 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf262f5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcf20112490 con 0x7fcf201079e0 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf262f5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcf20112790 con 0x7fcf201083a0 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf20107090 0x7fcf2019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf20107090 0x7fcf2019a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43518/0 (socket says 172.21.15.53:43518) 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf1ffff640 1 -- 172.21.15.53:0/947706572 learned_addr learned my addr 172.21.15.53:0/947706572 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf1f7fe640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf201079e0 0x7fcf2019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf24892640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf201083a0 0x7fcf2019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf1ffff640 1 -- 172.21.15.53:0/947706572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf201083a0 msgr2=0x7fcf2019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf1ffff640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf201083a0 0x7fcf2019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf1ffff640 1 -- 172.21.15.53:0/947706572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf201079e0 msgr2=0x7fcf2019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf1ffff640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf201079e0 0x7fcf2019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf1ffff640 1 -- 172.21.15.53:0/947706572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf201a01a0 con 0x7fcf20107090 2024-08-31T06:07:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf1f7fe640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf201079e0 0x7fcf2019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.421+0000 7fcf1ffff640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf20107090 0x7fcf2019a230 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009230 tx=0x7fcf100319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.422+0000 7fcf1d7fa640 1 -- 172.21.15.53:0/947706572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1003f030 con 0x7fcf20107090 2024-08-31T06:07:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.422+0000 7fcf262f5640 1 -- 172.21.15.53:0/947706572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf201a0430 con 0x7fcf20107090 2024-08-31T06:07:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.422+0000 7fcf1d7fa640 1 -- 172.21.15.53:0/947706572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf100043d0 con 0x7fcf20107090 2024-08-31T06:07:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.422+0000 7fcf1d7fa640 1 -- 172.21.15.53:0/947706572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10035070 con 0x7fcf20107090 2024-08-31T06:07:02.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.422+0000 7fcf262f5640 1 -- 172.21.15.53:0/947706572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf201a6bf0 con 0x7fcf20107090 2024-08-31T06:07:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.425+0000 7fcf2c86a740 1 Processor -- start 2024-08-31T06:07:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.425+0000 7fcf1d7fa640 1 -- 172.21.15.53:0/947706572 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcf10042030 con 0x7fcf20107090 2024-08-31T06:07:02.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.425+0000 7fcf2c86a740 1 -- start start 2024-08-31T06:07:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f6d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94b9f1b0 0x55ee94f6d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f6dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ee94ee4630 con 0x55ee94bc8070 2024-08-31T06:07:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee94ed3bc0 con 0x55ee94b9f1b0 2024-08-31T06:07:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ee94ed7b70 con 0x55ee94ba7390 2024-08-31T06:07:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf24892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f6d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf24892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f6d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43524/0 (socket says 172.21.15.53:43524) 2024-08-31T06:07:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf24892640 1 -- 172.21.15.53:0/1872640797 learned_addr learned my addr 172.21.15.53:0/1872640797 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf1f7fe640 1 --2- 172.21.15.53:0/1872640797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f6dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf1ffff640 1 --2- 172.21.15.53:0/1872640797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94b9f1b0 0x55ee94f6d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.426+0000 7fcf1d7fa640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf080b4ca0 0x7fcf080b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf24892640 1 -- 172.21.15.53:0/1872640797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 msgr2=0x55ee94f6dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf24892640 1 --2- 172.21.15.53:0/1872640797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f6dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf24892640 1 -- 172.21.15.53:0/1872640797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94b9f1b0 msgr2=0x55ee94f6d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:02.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf24892640 1 --2- 172.21.15.53:0/1872640797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94b9f1b0 0x55ee94f6d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf24892640 1 -- 172.21.15.53:0/1872640797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee94c33650 con 0x55ee94bc8070 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf24892640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf080b4ca0 0x7fcf080b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf1d7fa640 1 -- 172.21.15.53:0/947706572 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fcf101058f0 con 0x7fcf20107090 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf24892640 1 --2- 172.21.15.53:0/1872640797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f6d300 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fcf18011590 tx=0x7fcf18011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215feae93aefc7e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf067fc640 1 -- 172.21.15.53:0/1872640797 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18017050 con 0x55ee94bc8070 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf067fc640 1 -- 172.21.15.53:0/1872640797 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf1801bb90 con 0x55ee94bc8070 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf067fc640 1 -- 172.21.15.53:0/1872640797 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800ebe0 con 0x55ee94bc8070 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.427+0000 7fcf24892640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf080b4ca0 0x7fcf080b71b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcf18022000 tx=0x7fcf18023000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.428+0000 7fcf2c86a740 1 -- 172.21.15.53:0/1872640797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 msgr2=0x55ee94f6d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.428+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/1872640797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f6d300 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fcf18011590 tx=0x7fcf18011a50 comp rx=0 tx=0).stop 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.428+0000 7fcf2c86a740 1 -- 172.21.15.53:0/1872640797 shutdown_connections 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.428+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/1872640797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f6dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.428+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/1872640797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94b9f1b0 0x55ee94f6d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.428+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/1872640797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f6d300 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.428+0000 7fcf2c86a740 1 -- 172.21.15.53:0/1872640797 >> 172.21.15.53:0/1872640797 conn(0x55ee94bbc460 msgr2=0x55ee94f6b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.428+0000 7fcf2c86a740 1 -- 172.21.15.53:0/1872640797 shutdown_connections 2024-08-31T06:07:02.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.428+0000 7fcf2c86a740 1 -- 172.21.15.53:0/1872640797 wait complete. 2024-08-31T06:07:02.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.429+0000 7fcf2c86a740 1 -- start start 2024-08-31T06:07:02.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.429+0000 7fcf2c86a740 1 Processor -- start 2024-08-31T06:07:02.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.429+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94b9f1b0 0x55ee94f7ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.429+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f7d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.429+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f89140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ee94d36700 con 0x55ee94bc8070 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee94e5a700 con 0x55ee94b9f1b0 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ee94f7fde0 con 0x55ee94ba7390 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf2c86a740 10 client.0 _ll_register_callbacks cb 0x55ee94e89dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf24892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f89140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94b9f1b0 0x55ee94f7ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf24892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f89140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43526/0 (socket says 172.21.15.53:43526) 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf24892640 1 -- 172.21.15.53:0/3185816814 learned_addr learned my addr 172.21.15.53:0/3185816814 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94b9f1b0 0x55ee94f7ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48516/0 (socket says 172.21.15.53:48516) 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf1f7fe640 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f7d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf24892640 1 -- 172.21.15.53:0/3185816814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 msgr2=0x55ee94f7d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf24892640 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f7d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf24892640 1 -- 172.21.15.53:0/3185816814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94b9f1b0 msgr2=0x55ee94f7ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf24892640 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94b9f1b0 0x55ee94f7ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf24892640 1 -- 172.21.15.53:0/3185816814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee94e938b0 con 0x55ee94bc8070 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf24892640 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f89140 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800ed10 tx=0x7fcf18009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d267782fc46cb630 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fceff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fceff7fe640 1 -- 172.21.15.53:0/3185816814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf180049c0 con 0x55ee94bc8070 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fceff7fe640 1 -- 172.21.15.53:0/3185816814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fcf18004b60 con 0x55ee94bc8070 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.430+0000 7fcf2c86a740 1 -- 172.21.15.53:0/3185816814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf1801bb90 con 0x55ee94bc8070 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fceff7fe640 1 -- 172.21.15.53:0/3185816814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcf18017020 con 0x55ee94bc8070 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fcf2c86a740 10 client.16428 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fcf2c86a740 1 -- 172.21.15.53:0/3185816814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ee94f8bc00 con 0x55ee94bc8070 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fceff7fe640 1 -- 172.21.15.53:0/3185816814 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf1801bb90 con 0x55ee94bc8070 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fceff7fe640 1 -- 172.21.15.53:0/3185816814 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fcf18035030 con 0x55ee94bc8070 2024-08-31T06:07:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fcf2c86a740 10 client.16428 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fcf2c86a740 10 client.16428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fcf2c86a740 20 client.16428 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee94b869f0 0x55ee94f8f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fcf2c86a740 4 client.16428 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fcf2c86a740 1 -- 172.21.15.53:0/3185816814 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee94ee6580 con 0x55ee94b869f0 2024-08-31T06:07:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.431+0000 7fcf1ffff640 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee94b869f0 0x55ee94f8f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.432+0000 7fcf1ffff640 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee94b869f0 0x55ee94f8f070 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5a03c04bf0b5410 server_cookie=e0653a92aa3f9e28 in_seq=0 out_seq=0 2024-08-31T06:07:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.432+0000 7fceff7fe640 10 client.16428 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.432+0000 7fceff7fe640 1 -- 172.21.15.53:0/3185816814 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee94ee6580 con 0x55ee94b869f0 2024-08-31T06:07:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.432+0000 7fceff7fe640 10 client.16428 handle_command_reply: tid=0 2024-08-31T06:07:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.432+0000 7fcf2c86a740 1 client.16428 shutdown 2024-08-31T06:07:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fcf2c86a740 1 -- 172.21.15.53:0/3185816814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 msgr2=0x55ee94f89140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f89140 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800ed10 tx=0x7fcf18009c50 comp rx=0 tx=0).stop 2024-08-31T06:07:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fcf2c86a740 1 -- 172.21.15.53:0/3185816814 shutdown_connections 2024-08-31T06:07:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee94b869f0 0x55ee94f8f070 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94bc8070 0x55ee94f89140 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f7d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/3185816814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94b9f1b0 0x55ee94f7ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fcf2c86a740 1 -- 172.21.15.53:0/3185816814 >> 172.21.15.53:0/3185816814 conn(0x55ee94bbc460 msgr2=0x55ee94f6ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fceff7fe640 0 client.16428 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:02.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fcf2c86a740 1 -- 172.21.15.53:0/3185816814 shutdown_connections 2024-08-31T06:07:02.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fcf2c86a740 1 -- 172.21.15.53:0/3185816814 wait complete. 2024-08-31T06:07:02.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.433+0000 7fcf2c86a740 20 client.16428 trim_cache size 0 max 16384 2024-08-31T06:07:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf2c86a740 1 Processor -- start 2024-08-31T06:07:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf2c86a740 1 -- start start 2024-08-31T06:07:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 0x55ee94f7a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f7a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94bc8070 0x55ee94f946d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcf201ad2d0 con 0x55ee94b9f1b0 2024-08-31T06:07:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcf201aeed0 con 0x55ee94bc8070 2024-08-31T06:07:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcf201ad9a0 con 0x55ee94ba7390 2024-08-31T06:07:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 0x55ee94f7a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 0x55ee94f7a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43536/0 (socket says 172.21.15.53:43536) 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf1ffff640 1 -- 172.21.15.53:0/1424194654 learned_addr learned my addr 172.21.15.53:0/1424194654 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf1f7fe640 1 --2- 172.21.15.53:0/1424194654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f7a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.452+0000 7fcf24892640 1 --2- 172.21.15.53:0/1424194654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94bc8070 0x55ee94f946d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.453+0000 7fcf1ffff640 1 -- 172.21.15.53:0/1424194654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 msgr2=0x55ee94f7a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.453+0000 7fcf1ffff640 1 --2- 172.21.15.53:0/1424194654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f7a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.453+0000 7fcf1ffff640 1 -- 172.21.15.53:0/1424194654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94bc8070 msgr2=0x55ee94f946d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.453+0000 7fcf1ffff640 1 --2- 172.21.15.53:0/1424194654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94bc8070 0x55ee94f946d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.453+0000 7fcf1ffff640 1 -- 172.21.15.53:0/1424194654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee94f700c0 con 0x55ee94b9f1b0 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.453+0000 7fcf1ffff640 1 --2- 172.21.15.53:0/1424194654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 0x55ee94f7a080 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcf100c93e0 tx=0x7fcf100b3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8751e9938836557c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.453+0000 7fcf05ffb640 1 -- 172.21.15.53:0/1424194654 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10049070 con 0x55ee94b9f1b0 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.453+0000 7fcf05ffb640 1 -- 172.21.15.53:0/1424194654 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf1010c040 con 0x55ee94b9f1b0 2024-08-31T06:07:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.453+0000 7fcf05ffb640 1 -- 172.21.15.53:0/1424194654 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf100cd040 con 0x55ee94b9f1b0 2024-08-31T06:07:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.454+0000 7fcf2c86a740 1 -- 172.21.15.53:0/1424194654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 msgr2=0x55ee94f7a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.454+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/1424194654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 0x55ee94f7a080 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcf100c93e0 tx=0x7fcf100b3040 comp rx=0 tx=0).stop 2024-08-31T06:07:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.454+0000 7fcf2c86a740 1 -- 172.21.15.53:0/1424194654 shutdown_connections 2024-08-31T06:07:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.454+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/1424194654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94bc8070 0x55ee94f946d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.454+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/1424194654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f7a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.454+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/1424194654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 0x55ee94f7a080 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.454+0000 7fcf2c86a740 1 -- 172.21.15.53:0/1424194654 >> 172.21.15.53:0/1424194654 conn(0x55ee94bbc460 msgr2=0x55ee94f7b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.454+0000 7fcf2c86a740 1 -- 172.21.15.53:0/1424194654 shutdown_connections 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.454+0000 7fcf2c86a740 1 -- 172.21.15.53:0/1424194654 wait complete. 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.454+0000 7fcf2c86a740 1 -- start start 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf2c86a740 1 Processor -- start 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 0x55ee94f81af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f820d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf2c86a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94bc8070 0x55ee94ff2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcf201ae740 con 0x55ee94b9f1b0 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcf201ae070 con 0x55ee94bc8070 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf2c86a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcf201ab2b0 con 0x55ee94ba7390 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf2c86a740 10 client.0 _ll_register_callbacks cb 0x7fcf14009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 0x55ee94f81af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf24892640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94bc8070 0x55ee94ff2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 0x55ee94f81af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43552/0 (socket says 172.21.15.53:43552) 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf1ffff640 1 -- 172.21.15.53:0/150396957 learned_addr learned my addr 172.21.15.53:0/150396957 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.455+0000 7fcf1f7fe640 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f820d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.456+0000 7fcf24892640 1 -- 172.21.15.53:0/150396957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 msgr2=0x55ee94f820d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.456+0000 7fcf24892640 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f820d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.456+0000 7fcf24892640 1 -- 172.21.15.53:0/150396957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 msgr2=0x55ee94f81af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.456+0000 7fcf24892640 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 0x55ee94f81af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.456+0000 7fcf24892640 1 -- 172.21.15.53:0/150396957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee94ff2ff0 con 0x55ee94bc8070 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.456+0000 7fcf1f7fe640 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f820d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.456+0000 7fcf24892640 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94bc8070 0x55ee94ff2980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf1801d010 tx=0x7fcf1800e870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76273c183b1c3a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.456+0000 7fceff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.456+0000 7fceff7fe640 1 -- 172.21.15.53:0/150396957 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1801bb90 con 0x55ee94bc8070 2024-08-31T06:07:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.456+0000 7fceff7fe640 1 -- 172.21.15.53:0/150396957 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fcf18025430 con 0x55ee94bc8070 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.456+0000 7fcf2c86a740 1 -- 172.21.15.53:0/150396957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf1010c040 con 0x55ee94bc8070 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fceff7fe640 1 -- 172.21.15.53:0/150396957 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcf1804f050 con 0x55ee94bc8070 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fcf2c86a740 10 client.25862 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fcf2c86a740 1 -- 172.21.15.53:0/150396957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ee94ffa3d0 con 0x55ee94bc8070 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fceff7fe640 1 -- 172.21.15.53:0/150396957 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf1010c040 con 0x55ee94bc8070 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fceff7fe640 1 -- 172.21.15.53:0/150396957 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fcf18035070 con 0x55ee94bc8070 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fcf2c86a740 10 client.25862 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fcf2c86a740 10 client.25862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fcf2c86a740 20 client.25862 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee94b5bda0 0x55ee94ffcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fcf2c86a740 4 client.25862 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fcf2c86a740 1 -- 172.21.15.53:0/150396957 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ee94ee2020 con 0x55ee94b5bda0 2024-08-31T06:07:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.457+0000 7fcf1ffff640 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee94b5bda0 0x55ee94ffcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fceff7fe640 10 client.25862 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf1ffff640 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee94b5bda0 0x55ee94ffcbc0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f812b15146284a0 server_cookie=562b68911f125c7 in_seq=0 out_seq=0 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fceff7fe640 1 -- 172.21.15.53:0/150396957 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x55ee94ee2020 con 0x55ee94b5bda0 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fceff7fe640 10 client.25862 handle_command_reply: tid=0 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 1 client.25862 shutdown 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 1 -- 172.21.15.53:0/150396957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94bc8070 msgr2=0x55ee94ff2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94bc8070 0x55ee94ff2980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf1801d010 tx=0x7fcf1800e870 comp rx=0 tx=0).stop 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 1 -- 172.21.15.53:0/150396957 shutdown_connections 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee94b5bda0 0x55ee94ffcbc0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee94bc8070 0x55ee94ff2980 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee94ba7390 0x55ee94f820d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fceff7fe640 0 client.25862 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 1 --2- 172.21.15.53:0/150396957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee94b9f1b0 0x55ee94f81af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 1 -- 172.21.15.53:0/150396957 >> 172.21.15.53:0/150396957 conn(0x55ee94bbc460 msgr2=0x55ee94f6e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 1 -- 172.21.15.53:0/150396957 shutdown_connections 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 1 -- 172.21.15.53:0/150396957 wait complete. 2024-08-31T06:07:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.458+0000 7fcf2c86a740 20 client.25862 trim_cache size 0 max 16384 2024-08-31T06:07:02.466 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:07:02.466 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:07:02.466 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:07:02.466 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:07:02.466 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:02.466 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b", 2024-08-31T06:07:02.466 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:07:02.466 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:02.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:02.466 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:07:02.466 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:02.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:02.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:02.469 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:02.469 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:02.469 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:02.469 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:07:02.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 -- 172.21.15.53:0/947706572 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf080b4ca0 msgr2=0x7fcf080b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:02.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf080b4ca0 0x7fcf080b71b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcf18022000 tx=0x7fcf18023000 comp rx=0 tx=0).stop 2024-08-31T06:07:02.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 -- 172.21.15.53:0/947706572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf20107090 msgr2=0x7fcf2019a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:02.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf20107090 0x7fcf2019a230 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009230 tx=0x7fcf100319a0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 -- 172.21.15.53:0/947706572 shutdown_connections 2024-08-31T06:07:02.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf080b4ca0 0x7fcf080b71b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf201083a0 0x7fcf2019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf201079e0 0x7fcf2019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 --2- 172.21.15.53:0/947706572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf20107090 0x7fcf2019a230 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:02.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 -- 172.21.15.53:0/947706572 >> 172.21.15.53:0/947706572 conn(0x7fcf200775a0 msgr2=0x7fcf201023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:02.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 -- 172.21.15.53:0/947706572 shutdown_connections 2024-08-31T06:07:02.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:02.459+0000 7fcf262f5640 1 -- 172.21.15.53:0/947706572 wait complete. 2024-08-31T06:07:02.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:02 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:07:02.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:02 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:02.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:02 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:02.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:02 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:02.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:02 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:07:02.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:02 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:02.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:02 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:02.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:02 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:02.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:02 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:07:02.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:02 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:02.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:02 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:02.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:02 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:02.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 28186 3.26 MB/sec warmup 52 sec latency 14.090 ms 2024-08-31T06:07:03.236 INFO:tasks.cephfs.filesystem:scrub status for tag:fa5ace9d-f238-4ef4-9c35-2f21c99cf66b - {'path': '/', 'tag': 'fa5ace9d-f238-4ef4-9c35-2f21c99cf66b', 'options': 'recursive,force'} 2024-08-31T06:07:03.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:03 smithi130 ceph-mon[22266]: pgmap v386: 97 pgs: 97 active+clean; 27 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 699 KiB/s wr, 86 op/s 2024-08-31T06:07:03.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:03 smithi153 ceph-mon[22320]: pgmap v386: 97 pgs: 97 active+clean; 27 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 699 KiB/s wr, 86 op/s 2024-08-31T06:07:03.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 28649 3.28 MB/sec warmup 53 sec latency 14.657 ms 2024-08-31T06:07:03.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:03 smithi053 ceph-mon[18924]: pgmap v386: 97 pgs: 97 active+clean; 27 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 699 KiB/s wr, 86 op/s 2024-08-31T06:07:04.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 28887 3.22 MB/sec warmup 54 sec latency 14.141 ms 2024-08-31T06:07:05.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:05 smithi130 ceph-mon[22266]: pgmap v387: 97 pgs: 97 active+clean; 29 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 807 KiB/s wr, 114 op/s 2024-08-31T06:07:05.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:05 smithi153 ceph-mon[22320]: pgmap v387: 97 pgs: 97 active+clean; 29 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 807 KiB/s wr, 114 op/s 2024-08-31T06:07:05.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 29288 3.17 MB/sec warmup 55 sec latency 18.770 ms 2024-08-31T06:07:05.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:05 smithi053 ceph-mon[18924]: pgmap v387: 97 pgs: 97 active+clean; 29 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 807 KiB/s wr, 114 op/s 2024-08-31T06:07:06.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 29841 3.20 MB/sec warmup 56 sec latency 15.996 ms 2024-08-31T06:07:07.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:07 smithi130 ceph-mon[22266]: pgmap v388: 97 pgs: 97 active+clean; 30 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 886 KiB/s wr, 116 op/s 2024-08-31T06:07:07.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:07 smithi153 ceph-mon[22320]: pgmap v388: 97 pgs: 97 active+clean; 30 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 886 KiB/s wr, 116 op/s 2024-08-31T06:07:07.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 30474 3.15 MB/sec warmup 57 sec latency 14.825 ms 2024-08-31T06:07:07.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:07 smithi053 ceph-mon[18924]: pgmap v388: 97 pgs: 97 active+clean; 30 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 886 KiB/s wr, 116 op/s 2024-08-31T06:07:08.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 30999 3.14 MB/sec warmup 58 sec latency 13.091 ms 2024-08-31T06:07:09.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:09 smithi130 ceph-mon[22266]: pgmap v389: 97 pgs: 97 active+clean; 30 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 878 KiB/s wr, 124 op/s 2024-08-31T06:07:09.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:09 smithi153 ceph-mon[22320]: pgmap v389: 97 pgs: 97 active+clean; 30 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 878 KiB/s wr, 124 op/s 2024-08-31T06:07:09.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 31721 3.19 MB/sec warmup 59 sec latency 14.103 ms 2024-08-31T06:07:09.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:09 smithi053 ceph-mon[18924]: pgmap v389: 97 pgs: 97 active+clean; 30 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 878 KiB/s wr, 124 op/s 2024-08-31T06:07:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.706+0000 7f6b982cc640 1 -- 172.21.15.53:0/3457613461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b90108080 msgr2=0x7f6b90108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.706+0000 7f6b982cc640 1 --2- 172.21.15.53:0/3457613461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b90108080 0x7f6b90108490 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6b80009900 tx=0x7f6b8002a410 comp rx=0 tx=0).stop 2024-08-31T06:07:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.706+0000 7f6b982cc640 1 -- 172.21.15.53:0/3457613461 shutdown_connections 2024-08-31T06:07:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.706+0000 7f6b982cc640 1 --2- 172.21.15.53:0/3457613461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b901089d0 0x7f6b9010f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.706+0000 7f6b982cc640 1 --2- 172.21.15.53:0/3457613461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b90108080 0x7f6b90108490 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.706+0000 7f6b982cc640 1 --2- 172.21.15.53:0/3457613461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b90102750 0x7f6b90102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.706+0000 7f6b982cc640 1 -- 172.21.15.53:0/3457613461 >> 172.21.15.53:0/3457613461 conn(0x7f6b9007a4e0 msgr2=0x7f6b9007a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.706+0000 7f6b982cc640 1 -- 172.21.15.53:0/3457613461 shutdown_connections 2024-08-31T06:07:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.706+0000 7f6b982cc640 1 -- 172.21.15.53:0/3457613461 wait complete. 2024-08-31T06:07:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b982cc640 1 Processor -- start 2024-08-31T06:07:10.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b982cc640 1 -- start start 2024-08-31T06:07:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b982cc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b90102750 0x7f6b9019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b982cc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b90108080 0x7f6b9019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b982cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b901089d0 0x7f6b9019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b982cc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901124f0 con 0x7f6b901089d0 2024-08-31T06:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b982cc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90112370 con 0x7f6b90102750 2024-08-31T06:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b982cc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90112670 con 0x7f6b90108080 2024-08-31T06:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b96869640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b901089d0 0x7f6b9019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b96068640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b90102750 0x7f6b9019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b96869640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b901089d0 0x7f6b9019f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45778/0 (socket says 172.21.15.53:45778) 2024-08-31T06:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b96869640 1 -- 172.21.15.53:0/4156565635 learned_addr learned my addr 172.21.15.53:0/4156565635 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.707+0000 7f6b95867640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b90108080 0x7f6b9019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.708+0000 7f6b96869640 1 -- 172.21.15.53:0/4156565635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b90108080 msgr2=0x7f6b9019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.708+0000 7f6b96869640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b90108080 0x7f6b9019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.708+0000 7f6b96869640 1 -- 172.21.15.53:0/4156565635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b90102750 msgr2=0x7f6b9019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.708+0000 7f6b96869640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b90102750 0x7f6b9019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.708+0000 7f6b96869640 1 -- 172.21.15.53:0/4156565635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b901a0090 con 0x7f6b901089d0 2024-08-31T06:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.708+0000 7f6b96869640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b901089d0 0x7f6b9019f990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800eaa0 tx=0x7f6b8800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.708+0000 7f6b877fe640 1 -- 172.21.15.53:0/4156565635 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8800cdb0 con 0x7f6b901089d0 2024-08-31T06:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.708+0000 7f6b982cc640 1 -- 172.21.15.53:0/4156565635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b901a0380 con 0x7f6b901089d0 2024-08-31T06:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.708+0000 7f6b877fe640 1 -- 172.21.15.53:0/4156565635 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b88005020 con 0x7f6b901089d0 2024-08-31T06:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.708+0000 7f6b877fe640 1 -- 172.21.15.53:0/4156565635 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b880116d0 con 0x7f6b901089d0 2024-08-31T06:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.708+0000 7f6b982cc640 1 -- 172.21.15.53:0/4156565635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b901a6b10 con 0x7f6b901089d0 2024-08-31T06:07:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.711+0000 7f6b9f23a740 1 Processor -- start 2024-08-31T06:07:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b877fe640 1 -- 172.21.15.53:0/4156565635 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6b880051d0 con 0x7f6b901089d0 2024-08-31T06:07:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b9f23a740 1 -- start start 2024-08-31T06:07:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d2d1b0 0x55e0970d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d0c4d0 0x55e0970d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e097046000 con 0x55e096d042f0 2024-08-31T06:07:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e097035590 con 0x55e096d0c4d0 2024-08-31T06:07:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e097039540 con 0x55e096d2d1b0 2024-08-31T06:07:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b96068640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b95867640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d0c4d0 0x55e0970d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b96068640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45780/0 (socket says 172.21.15.53:45780) 2024-08-31T06:07:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b96068640 1 -- 172.21.15.53:0/558038456 learned_addr learned my addr 172.21.15.53:0/558038456 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.712+0000 7f6b95867640 1 --2- 172.21.15.53:0/558038456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d2d1b0 0x55e0970d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b96068640 1 -- 172.21.15.53:0/558038456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d2d1b0 msgr2=0x55e0970d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b96068640 1 --2- 172.21.15.53:0/558038456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d2d1b0 0x55e0970d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b96068640 1 -- 172.21.15.53:0/558038456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d0c4d0 msgr2=0x55e0970d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b96068640 1 --2- 172.21.15.53:0/558038456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d0c4d0 0x55e0970d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b96068640 1 -- 172.21.15.53:0/558038456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e096d98790 con 0x55e096d042f0 2024-08-31T06:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b95867640 1 --2- 172.21.15.53:0/558038456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d2d1b0 0x55e0970d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b877fe640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b7c0b4ca0 0x7f6b7c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b96068640 1 --2- 172.21.15.53:0/558038456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970d1000 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009cf0 tx=0x7f6b8c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a92e471d96638e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b95867640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b7c0b4ca0 0x7f6b7c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b877fe640 1 -- 172.21.15.53:0/4156565635 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f6b880e57a0 con 0x7f6b901089d0 2024-08-31T06:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b84bfe640 1 -- 172.21.15.53:0/558038456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c004230 con 0x55e096d042f0 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b84bfe640 1 -- 172.21.15.53:0/558038456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b8c0043d0 con 0x55e096d042f0 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.713+0000 7f6b84bfe640 1 -- 172.21.15.53:0/558038456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0197a0 con 0x55e096d042f0 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.714+0000 7f6b9f23a740 1 -- 172.21.15.53:0/558038456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 msgr2=0x55e0970d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.714+0000 7f6b95867640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b7c0b4ca0 0x7f6b7c0b71b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b800057c0 tx=0x7f6b80040040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.714+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/558038456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970d1000 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009cf0 tx=0x7f6b8c011810 comp rx=0 tx=0).stop 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.714+0000 7f6b9f23a740 1 -- 172.21.15.53:0/558038456 shutdown_connections 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.714+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/558038456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d0c4d0 0x55e0970d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.714+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/558038456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970d1000 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.714+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/558038456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d2d1b0 0x55e0970d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.714+0000 7f6b9f23a740 1 -- 172.21.15.53:0/558038456 >> 172.21.15.53:0/558038456 conn(0x55e096d21300 msgr2=0x55e0970ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.714+0000 7f6b9f23a740 1 -- 172.21.15.53:0/558038456 shutdown_connections 2024-08-31T06:07:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.714+0000 7f6b9f23a740 1 -- 172.21.15.53:0/558038456 wait complete. 2024-08-31T06:07:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b9f23a740 1 -- start start 2024-08-31T06:07:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b9f23a740 1 Processor -- start 2024-08-31T06:07:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970dc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d0c4d0 0x55e0970dcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d2d1b0 0x55e0970e8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e096f6eab0 con 0x55e096d042f0 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e096fbc680 con 0x55e096d2d1b0 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e0970df240 con 0x55e096d0c4d0 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b96068640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970dc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b9f23a740 10 client.0 _ll_register_callbacks cb 0x55e096d44a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b95867640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d0c4d0 0x55e0970dcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b96068640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970dc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45794/0 (socket says 172.21.15.53:45794) 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b96068640 1 -- 172.21.15.53:0/3933950026 learned_addr learned my addr 172.21.15.53:0/3933950026 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.715+0000 7f6b96869640 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d2d1b0 0x55e0970e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b96068640 1 -- 172.21.15.53:0/3933950026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d0c4d0 msgr2=0x55e0970dcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b96068640 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d0c4d0 0x55e0970dcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b96068640 1 -- 172.21.15.53:0/3933950026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d2d1b0 msgr2=0x55e0970e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b96068640 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d2d1b0 0x55e0970e8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b96068640 1 -- 172.21.15.53:0/3933950026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e096e11620 con 0x55e096d042f0 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b96068640 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970dc610 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009560 tx=0x7f6b8c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc64b57c3dfe9e0c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b79ffb640 1 -- 172.21.15.53:0/3933950026 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c027070 con 0x55e096d042f0 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b9f23a740 1 -- 172.21.15.53:0/3933950026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b8c0043d0 con 0x55e096d042f0 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b79ffb640 1 -- 172.21.15.53:0/3933950026 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f6b8c005450 con 0x55e096d042f0 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b79ffb640 1 -- 172.21.15.53:0/3933950026 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6b8c033050 con 0x55e096d042f0 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b9f23a740 10 client.16446 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b9f23a740 1 -- 172.21.15.53:0/3933950026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e0970eb210 con 0x55e096d042f0 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.716+0000 7f6b79ffb640 1 -- 172.21.15.53:0/3933950026 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b8c0043d0 con 0x55e096d042f0 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.717+0000 7f6b79ffb640 1 -- 172.21.15.53:0/3933950026 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f6b8c004b50 con 0x55e096d042f0 2024-08-31T06:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.717+0000 7f6b9f23a740 10 client.16446 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.717+0000 7f6b9f23a740 10 client.16446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.717+0000 7f6b9f23a740 20 client.16446 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.717+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e096cebd80 0x55e0970eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.717+0000 7f6b9f23a740 4 client.16446 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.717+0000 7f6b9f23a740 1 -- 172.21.15.53:0/3933950026 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e097047f50 con 0x55e096cebd80 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.717+0000 7f6b95867640 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e096cebd80 0x55e0970eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.717+0000 7f6b95867640 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e096cebd80 0x55e0970eeb80 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d41fd0d11910b97d server_cookie=b3ad5fd6282afb5a in_seq=0 out_seq=0 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.717+0000 7f6b79ffb640 10 client.16446 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.718+0000 7f6b79ffb640 1 -- 172.21.15.53:0/3933950026 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e097047f50 con 0x55e096cebd80 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.718+0000 7f6b79ffb640 10 client.16446 handle_command_reply: tid=0 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.718+0000 7f6b9f23a740 1 client.16446 shutdown 2024-08-31T06:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b9f23a740 1 -- 172.21.15.53:0/3933950026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 msgr2=0x55e0970dc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970dc610 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009560 tx=0x7f6b8c0038a0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b9f23a740 1 -- 172.21.15.53:0/3933950026 shutdown_connections 2024-08-31T06:07:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e096cebd80 0x55e0970eeb80 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d2d1b0 0x55e0970e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d0c4d0 0x55e0970dcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b79ffb640 0 client.16446 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/3933950026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970dc610 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b9f23a740 1 -- 172.21.15.53:0/3933950026 >> 172.21.15.53:0/3933950026 conn(0x55e096d21300 msgr2=0x55e0970d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b9f23a740 1 -- 172.21.15.53:0/3933950026 shutdown_connections 2024-08-31T06:07:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b9f23a740 1 -- 172.21.15.53:0/3933950026 wait complete. 2024-08-31T06:07:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.719+0000 7f6b9f23a740 20 client.16446 trim_cache size 0 max 16384 2024-08-31T06:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b9f23a740 1 Processor -- start 2024-08-31T06:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b9f23a740 1 -- start start 2024-08-31T06:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096cebd80 0x55e0970dac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970db1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d0c4d0 0x55e0970d95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901af4c0 con 0x55e096d042f0 2024-08-31T06:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901b10c0 con 0x55e096cebd80 2024-08-31T06:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901afb90 con 0x55e096d0c4d0 2024-08-31T06:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b95867640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970db1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b95867640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970db1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45804/0 (socket says 172.21.15.53:45804) 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b95867640 1 -- 172.21.15.53:0/1777312176 learned_addr learned my addr 172.21.15.53:0/1777312176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b96068640 1 --2- 172.21.15.53:0/1777312176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096cebd80 0x55e0970dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b96869640 1 --2- 172.21.15.53:0/1777312176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d0c4d0 0x55e0970d95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b95867640 1 -- 172.21.15.53:0/1777312176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d0c4d0 msgr2=0x55e0970d95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b95867640 1 --2- 172.21.15.53:0/1777312176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d0c4d0 0x55e0970d95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b95867640 1 -- 172.21.15.53:0/1777312176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096cebd80 msgr2=0x55e0970dac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b95867640 1 --2- 172.21.15.53:0/1777312176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096cebd80 0x55e0970dac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.737+0000 7f6b95867640 1 -- 172.21.15.53:0/1777312176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0970deb40 con 0x55e096d042f0 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.738+0000 7f6b95867640 1 --2- 172.21.15.53:0/1777312176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970db1a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6b9006c760 tx=0x7f6b80000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1957ac1eb06bf99c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.738+0000 7f6b7bfff640 1 -- 172.21.15.53:0/1777312176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80045070 con 0x55e096d042f0 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.738+0000 7f6b7bfff640 1 -- 172.21.15.53:0/1777312176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b80058070 con 0x55e096d042f0 2024-08-31T06:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.738+0000 7f6b7bfff640 1 -- 172.21.15.53:0/1777312176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80035040 con 0x55e096d042f0 2024-08-31T06:07:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 -- 172.21.15.53:0/1777312176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 msgr2=0x55e0970db1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/1777312176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970db1a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6b9006c760 tx=0x7f6b80000bc0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 -- 172.21.15.53:0/1777312176 shutdown_connections 2024-08-31T06:07:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/1777312176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096d0c4d0 0x55e0970d95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/1777312176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970db1a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/1777312176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096cebd80 0x55e0970dac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 -- 172.21.15.53:0/1777312176 >> 172.21.15.53:0/1777312176 conn(0x55e096d21300 msgr2=0x55e0970d7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 -- 172.21.15.53:0/1777312176 shutdown_connections 2024-08-31T06:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 -- 172.21.15.53:0/1777312176 wait complete. 2024-08-31T06:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 -- start start 2024-08-31T06:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 Processor -- start 2024-08-31T06:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.739+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096cebd80 0x55e0970e4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b9f23a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d0c4d0 0x55e0970e25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901b0930 con 0x55e096d042f0 2024-08-31T06:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901b0260 con 0x55e096d0c4d0 2024-08-31T06:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b9f23a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901ad4a0 con 0x55e096cebd80 2024-08-31T06:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b9f23a740 10 client.0 _ll_register_callbacks cb 0x7f6b8c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b95867640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b95867640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970e20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45810/0 (socket says 172.21.15.53:45810) 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b95867640 1 -- 172.21.15.53:0/2406941844 learned_addr learned my addr 172.21.15.53:0/2406941844 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b96068640 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096cebd80 0x55e0970e4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b96869640 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d0c4d0 0x55e0970e25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b95867640 1 -- 172.21.15.53:0/2406941844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096cebd80 msgr2=0x55e0970e4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b95867640 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096cebd80 0x55e0970e4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b95867640 1 -- 172.21.15.53:0/2406941844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d0c4d0 msgr2=0x55e0970e25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b95867640 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d0c4d0 0x55e0970e25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b95867640 1 -- 172.21.15.53:0/2406941844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0970e2ce0 con 0x55e096d042f0 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b95867640 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970e20b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6b800316c0 tx=0x7f6b800319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55ad4a867178004 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b79ffb640 1 -- 172.21.15.53:0/2406941844 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80035070 con 0x55e096d042f0 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b79ffb640 1 -- 172.21.15.53:0/2406941844 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f6b800037f0 con 0x55e096d042f0 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.740+0000 7f6b9f23a740 1 -- 172.21.15.53:0/2406941844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b80058070 con 0x55e096d042f0 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b79ffb640 1 -- 172.21.15.53:0/2406941844 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6b80045050 con 0x55e096d042f0 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b9f23a740 10 client.16452 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b9f23a740 1 -- 172.21.15.53:0/2406941844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e097159430 con 0x55e096d042f0 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b79ffb640 1 -- 172.21.15.53:0/2406941844 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b80058070 con 0x55e096d042f0 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b79ffb640 1 -- 172.21.15.53:0/2406941844 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f6b8003a040 con 0x55e096d042f0 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b9f23a740 10 client.16452 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b9f23a740 10 client.16452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b9f23a740 20 client.16452 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e096d2d1b0 0x55e09715bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b9f23a740 4 client.16452 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:07:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b9f23a740 1 -- 172.21.15.53:0/2406941844 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e0970439f0 con 0x55e096d2d1b0 2024-08-31T06:07:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.741+0000 7f6b96068640 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e096d2d1b0 0x55e09715bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.742+0000 7f6b96068640 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e096d2d1b0 0x55e09715bba0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eb71e6795807069 server_cookie=16f6942e511afa26 in_seq=0 out_seq=0 2024-08-31T06:07:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.742+0000 7f6b79ffb640 10 client.16452 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:10.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b79ffb640 1 -- 172.21.15.53:0/2406941844 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e0970439f0 con 0x55e096d2d1b0 2024-08-31T06:07:10.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b79ffb640 10 client.16452 handle_command_reply: tid=0 2024-08-31T06:07:10.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b9f23a740 1 client.16452 shutdown 2024-08-31T06:07:10.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b9f23a740 1 -- 172.21.15.53:0/2406941844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 msgr2=0x55e0970e20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:10.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970e20b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6b800316c0 tx=0x7f6b800319a0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b9f23a740 1 -- 172.21.15.53:0/2406941844 shutdown_connections 2024-08-31T06:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e096d2d1b0 0x55e09715bba0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e096d0c4d0 0x55e0970e25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e096d042f0 0x55e0970e20b0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b9f23a740 1 --2- 172.21.15.53:0/2406941844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e096cebd80 0x55e0970e4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b9f23a740 1 -- 172.21.15.53:0/2406941844 >> 172.21.15.53:0/2406941844 conn(0x55e096d21300 msgr2=0x55e0970da830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.764+0000 7f6b79ffb640 0 client.16452 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b9f23a740 1 -- 172.21.15.53:0/2406941844 shutdown_connections 2024-08-31T06:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b9f23a740 1 -- 172.21.15.53:0/2406941844 wait complete. 2024-08-31T06:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b9f23a740 20 client.16452 trim_cache size 0 max 16384 2024-08-31T06:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 -- 172.21.15.53:0/4156565635 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b7c0b4ca0 msgr2=0x7f6b7c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b7c0b4ca0 0x7f6b7c0b71b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b800057c0 tx=0x7f6b80040040 comp rx=0 tx=0).stop 2024-08-31T06:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 -- 172.21.15.53:0/4156565635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b901089d0 msgr2=0x7f6b9019f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b901089d0 0x7f6b9019f990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800eaa0 tx=0x7f6b8800ef60 comp rx=0 tx=0).stop 2024-08-31T06:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 -- 172.21.15.53:0/4156565635 shutdown_connections 2024-08-31T06:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b7c0b4ca0 0x7f6b7c0b71b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b901089d0 0x7f6b9019f990 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b90108080 0x7f6b9019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 --2- 172.21.15.53:0/4156565635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b90102750 0x7f6b9019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 -- 172.21.15.53:0/4156565635 >> 172.21.15.53:0/4156565635 conn(0x7f6b9007a4e0 msgr2=0x7f6b90101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 -- 172.21.15.53:0/4156565635 shutdown_connections 2024-08-31T06:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:10.765+0000 7f6b982cc640 1 -- 172.21.15.53:0/4156565635 wait complete. 2024-08-31T06:07:10.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 32121 3.20 MB/sec warmup 60 sec latency 43.221 ms 2024-08-31T06:07:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:11 smithi130 ceph-mon[22266]: pgmap v390: 97 pgs: 97 active+clean; 30 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1.1 MiB/s wr, 157 op/s 2024-08-31T06:07:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:11 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:07:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:11 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:07:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:11 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:07:11.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:11 smithi153 ceph-mon[22320]: pgmap v390: 97 pgs: 97 active+clean; 30 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1.1 MiB/s wr, 157 op/s 2024-08-31T06:07:11.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:11 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:07:11.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:11 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:07:11.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:11 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:07:11.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 32401 3.17 MB/sec warmup 61 sec latency 16.053 ms 2024-08-31T06:07:11.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:11 smithi053 ceph-mon[18924]: pgmap v390: 97 pgs: 97 active+clean; 30 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1.1 MiB/s wr, 157 op/s 2024-08-31T06:07:11.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:11 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:07:11.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:11 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:07:11.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:11 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:07:12.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 32788 3.12 MB/sec warmup 62 sec latency 15.114 ms 2024-08-31T06:07:13.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:13 smithi130 ceph-mon[22266]: pgmap v391: 97 pgs: 97 active+clean; 31 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1.1 MiB/s wr, 148 op/s 2024-08-31T06:07:13.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:13 smithi153 ceph-mon[22320]: pgmap v391: 97 pgs: 97 active+clean; 31 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1.1 MiB/s wr, 148 op/s 2024-08-31T06:07:13.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 33252 3.10 MB/sec warmup 63 sec latency 16.032 ms 2024-08-31T06:07:13.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:13 smithi053 ceph-mon[18924]: pgmap v391: 97 pgs: 97 active+clean; 31 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1.1 MiB/s wr, 148 op/s 2024-08-31T06:07:14.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 33882 3.10 MB/sec warmup 64 sec latency 16.055 ms 2024-08-31T06:07:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:15 smithi130 ceph-mon[22266]: pgmap v392: 97 pgs: 97 active+clean; 29 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-08-31T06:07:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:15 smithi153 ceph-mon[22320]: pgmap v392: 97 pgs: 97 active+clean; 29 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-08-31T06:07:15.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 34420 3.08 MB/sec warmup 65 sec latency 15.835 ms 2024-08-31T06:07:15.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:15 smithi053 ceph-mon[18924]: pgmap v392: 97 pgs: 97 active+clean; 29 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-08-31T06:07:16.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 35208 3.13 MB/sec warmup 66 sec latency 15.037 ms 2024-08-31T06:07:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:17 smithi130 ceph-mon[22266]: pgmap v393: 97 pgs: 97 active+clean; 29 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-31T06:07:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:17 smithi153 ceph-mon[22320]: pgmap v393: 97 pgs: 97 active+clean; 29 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-31T06:07:17.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 35598 3.15 MB/sec warmup 67 sec latency 23.056 ms 2024-08-31T06:07:17.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:17 smithi053 ceph-mon[18924]: pgmap v393: 97 pgs: 97 active+clean; 29 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-31T06:07:18.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 35903 3.12 MB/sec warmup 68 sec latency 15.376 ms 2024-08-31T06:07:19.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:19 smithi130 ceph-mon[22266]: pgmap v394: 97 pgs: 97 active+clean; 30 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.3 MiB/s wr, 158 op/s 2024-08-31T06:07:19.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:19 smithi153 ceph-mon[22320]: pgmap v394: 97 pgs: 97 active+clean; 30 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.3 MiB/s wr, 158 op/s 2024-08-31T06:07:19.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 36225 3.08 MB/sec warmup 69 sec latency 15.161 ms 2024-08-31T06:07:19.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:19 smithi053 ceph-mon[18924]: pgmap v394: 97 pgs: 97 active+clean; 30 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.3 MiB/s wr, 158 op/s 2024-08-31T06:07:20.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 36719 3.06 MB/sec warmup 70 sec latency 15.993 ms 2024-08-31T06:07:21.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:21 smithi130 ceph-mon[22266]: pgmap v395: 97 pgs: 97 active+clean; 30 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 1.4 MiB/s wr, 159 op/s 2024-08-31T06:07:21.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:21 smithi153 ceph-mon[22320]: pgmap v395: 97 pgs: 97 active+clean; 30 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 1.4 MiB/s wr, 159 op/s 2024-08-31T06:07:21.961 INFO:tasks.workunit.client.0.smithi053.stdout: 1 37336 3.06 MB/sec warmup 71 sec latency 27.917 ms 2024-08-31T06:07:21.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:21 smithi053 ceph-mon[18924]: pgmap v395: 97 pgs: 97 active+clean; 30 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 1.4 MiB/s wr, 159 op/s 2024-08-31T06:07:22.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 37915 3.05 MB/sec warmup 72 sec latency 20.052 ms 2024-08-31T06:07:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.875+0000 7f5180f6e640 1 -- 172.21.15.53:0/718278661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f517c1089d0 msgr2=0x7f517c10f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.875+0000 7f5180f6e640 1 --2- 172.21.15.53:0/718278661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f517c1089d0 0x7f517c10f200 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5174009ca0 tx=0x7f517402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.875+0000 7f5180f6e640 1 -- 172.21.15.53:0/718278661 shutdown_connections 2024-08-31T06:07:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.875+0000 7f5180f6e640 1 --2- 172.21.15.53:0/718278661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f517c1089d0 0x7f517c10f200 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.875+0000 7f5180f6e640 1 --2- 172.21.15.53:0/718278661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f517c108080 0x7f517c108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.875+0000 7f5180f6e640 1 --2- 172.21.15.53:0/718278661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517c102750 0x7f517c102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.875+0000 7f5180f6e640 1 -- 172.21.15.53:0/718278661 >> 172.21.15.53:0/718278661 conn(0x7f517c07a4e0 msgr2=0x7f517c07a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.875+0000 7f5180f6e640 1 -- 172.21.15.53:0/718278661 shutdown_connections 2024-08-31T06:07:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.875+0000 7f5180f6e640 1 -- 172.21.15.53:0/718278661 wait complete. 2024-08-31T06:07:23.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:23 smithi130 ceph-mon[22266]: pgmap v396: 97 pgs: 97 active+clean; 31 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-08-31T06:07:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.876+0000 7f5180f6e640 1 Processor -- start 2024-08-31T06:07:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.876+0000 7f5180f6e640 1 -- start start 2024-08-31T06:07:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5180f6e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f517c102750 0x7f517c198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5180f6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f517c108080 0x7f517c199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5180f6e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517c1089d0 0x7f517c19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5180f6e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1125a0 con 0x7f517c108080 2024-08-31T06:07:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5180f6e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f517c112420 con 0x7f517c102750 2024-08-31T06:07:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5180f6e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f517c112720 con 0x7f517c1089d0 2024-08-31T06:07:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5179d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f517c108080 0x7f517c199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5179d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f517c108080 0x7f517c199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46134/0 (socket says 172.21.15.53:46134) 2024-08-31T06:07:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5179d9b640 1 -- 172.21.15.53:0/1201541599 learned_addr learned my addr 172.21.15.53:0/1201541599 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f517a59c640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f517c102750 0x7f517c198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f517ad9d640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517c1089d0 0x7f517c19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5179d9b640 1 -- 172.21.15.53:0/1201541599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517c1089d0 msgr2=0x7f517c19e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5179d9b640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517c1089d0 0x7f517c19e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5179d9b640 1 -- 172.21.15.53:0/1201541599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f517c102750 msgr2=0x7f517c198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5179d9b640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f517c102750 0x7f517c198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5179d9b640 1 -- 172.21.15.53:0/1201541599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f517c19ef10 con 0x7f517c108080 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f517a59c640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f517c102750 0x7f517c198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.877+0000 7f5179d9b640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f517c108080 0x7f517c199580 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f517000e970 tx=0x7f517000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.878+0000 7f516b7fe640 1 -- 172.21.15.53:0/1201541599 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517000cd80 con 0x7f517c108080 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.878+0000 7f5180f6e640 1 -- 172.21.15.53:0/1201541599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f517c19f200 con 0x7f517c108080 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.878+0000 7f516b7fe640 1 -- 172.21.15.53:0/1201541599 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51700035f0 con 0x7f517c108080 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.878+0000 7f516b7fe640 1 -- 172.21.15.53:0/1201541599 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170010690 con 0x7f517c108080 2024-08-31T06:07:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.878+0000 7f5180f6e640 1 -- 172.21.15.53:0/1201541599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f517c1a5990 con 0x7f517c108080 2024-08-31T06:07:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.880+0000 7f5187fbd740 1 Processor -- start 2024-08-31T06:07:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f5187fbd740 1 -- start start 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f516b7fe640 1 -- 172.21.15.53:0/1201541599 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f51700108f0 con 0x7f517c108080 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa33841b0 0x559fa3727ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa335b2f0 0x559fa3728000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa3728540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f5187fbd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559fa369d000 con 0x559fa33634d0 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f5187fbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559fa368c590 con 0x559fa33841b0 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f5187fbd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559fa3690540 con 0x559fa335b2f0 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f517ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa33841b0 0x559fa3727ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f5179d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa3728540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f517ad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa33841b0 0x559fa3727ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:49710/0 (socket says 172.21.15.53:49710) 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f517ad9d640 1 -- 172.21.15.53:0/4003112552 learned_addr learned my addr 172.21.15.53:0/4003112552 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f517a59c640 1 --2- 172.21.15.53:0/4003112552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa335b2f0 0x559fa3728000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f517ad9d640 1 -- 172.21.15.53:0/4003112552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa335b2f0 msgr2=0x559fa3728000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.881+0000 7f517ad9d640 1 --2- 172.21.15.53:0/4003112552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa335b2f0 0x559fa3728000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.882+0000 7f517ad9d640 1 -- 172.21.15.53:0/4003112552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 msgr2=0x559fa3728540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.882+0000 7f517ad9d640 1 --2- 172.21.15.53:0/4003112552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa3728540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.882+0000 7f517ad9d640 1 -- 172.21.15.53:0/4003112552 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa33ef790 con 0x559fa33841b0 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.882+0000 7f517ad9d640 1 --2- 172.21.15.53:0/4003112552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa33841b0 0x559fa3727ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5174009ca0 tx=0x7f5174009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=186044174eac0ff3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.882+0000 7f5168ff9640 1 -- 172.21.15.53:0/4003112552 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5174031790 con 0x559fa33841b0 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.882+0000 7f5168ff9640 1 -- 172.21.15.53:0/4003112552 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5174036030 con 0x559fa33841b0 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.882+0000 7f5168ff9640 1 -- 172.21.15.53:0/4003112552 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5174004330 con 0x559fa33841b0 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.882+0000 7f516b7fe640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51640b4ca0 0x7f51640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.882+0000 7f517a59c640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51640b4ca0 0x7f51640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.882+0000 7f516b7fe640 1 -- 172.21.15.53:0/1201541599 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f51700e57f0 con 0x7f517c108080 2024-08-31T06:07:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.883+0000 7f5187fbd740 1 -- 172.21.15.53:0/4003112552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa33841b0 msgr2=0x559fa3727ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.883+0000 7f5187fbd740 1 --2- 172.21.15.53:0/4003112552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa33841b0 0x559fa3727ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5174009ca0 tx=0x7f5174009a20 comp rx=0 tx=0).stop 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.883+0000 7f517a59c640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51640b4ca0 0x7f51640b71b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x559fa3726740 tx=0x7f516c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.883+0000 7f5187fbd740 1 -- 172.21.15.53:0/4003112552 shutdown_connections 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.883+0000 7f5187fbd740 1 --2- 172.21.15.53:0/4003112552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa3728540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.883+0000 7f5187fbd740 1 --2- 172.21.15.53:0/4003112552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa335b2f0 0x559fa3728000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.883+0000 7f5187fbd740 1 --2- 172.21.15.53:0/4003112552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa33841b0 0x559fa3727ac0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.883+0000 7f5187fbd740 1 -- 172.21.15.53:0/4003112552 >> 172.21.15.53:0/4003112552 conn(0x559fa3378300 msgr2=0x559fa37259b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.883+0000 7f5187fbd740 1 -- 172.21.15.53:0/4003112552 shutdown_connections 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.883+0000 7f5187fbd740 1 -- 172.21.15.53:0/4003112552 wait complete. 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f5187fbd740 1 -- start start 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f5187fbd740 1 Processor -- start 2024-08-31T06:07:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa3735910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33634d0 0x559fa3735eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33841b0 0x559fa3741550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f5187fbd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559fa35c5ab0 con 0x559fa33841b0 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f5187fbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559fa3613680 con 0x559fa335b2f0 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f5187fbd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559fa3738220 con 0x559fa33634d0 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f5187fbd740 10 client.0 _ll_register_callbacks cb 0x559fa339ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f517ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33841b0 0x559fa3741550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f517ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33841b0 0x559fa3741550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46148/0 (socket says 172.21.15.53:46148) 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f517ad9d640 1 -- 172.21.15.53:0/794838975 learned_addr learned my addr 172.21.15.53:0/794838975 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.884+0000 7f5179d9b640 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33634d0 0x559fa3735eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f517a59c640 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa3735910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f517ad9d640 1 -- 172.21.15.53:0/794838975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33634d0 msgr2=0x559fa3735eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f517ad9d640 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33634d0 0x559fa3735eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f517ad9d640 1 -- 172.21.15.53:0/794838975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 msgr2=0x559fa3735910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f517ad9d640 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa3735910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f517ad9d640 1 -- 172.21.15.53:0/794838975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fa3468620 con 0x559fa33841b0 2024-08-31T06:07:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f517a59c640 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa3735910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:07:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f5179d9b640 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33634d0 0x559fa3735eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:07:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f517ad9d640 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33841b0 0x559fa3741550 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f517402aeb0 tx=0x7f51740318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c317ffcc2cd8ad93 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f5161ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f5161ffb640 1 -- 172.21.15.53:0/794838975 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517404a040 con 0x559fa33841b0 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f5161ffb640 1 -- 172.21.15.53:0/794838975 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5174031b80 con 0x559fa33841b0 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f5187fbd740 1 -- 172.21.15.53:0/794838975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5174036030 con 0x559fa33841b0 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f5161ffb640 1 -- 172.21.15.53:0/794838975 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f517405e050 con 0x559fa33841b0 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f5187fbd740 10 client.16464 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f5187fbd740 1 -- 172.21.15.53:0/794838975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559fa37442f0 con 0x559fa33841b0 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.885+0000 7f5161ffb640 1 -- 172.21.15.53:0/794838975 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5174036030 con 0x559fa33841b0 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.886+0000 7f5161ffb640 1 -- 172.21.15.53:0/794838975 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f517404d030 con 0x559fa33841b0 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.886+0000 7f5187fbd740 10 client.16464 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.886+0000 7f5187fbd740 10 client.16464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.886+0000 7f5187fbd740 20 client.16464 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.886+0000 7f5187fbd740 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559fa3342d80 0x559fa3747650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.886+0000 7f5187fbd740 4 client.16464 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.886+0000 7f5187fbd740 1 -- 172.21.15.53:0/794838975 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fa369ef50 con 0x559fa3342d80 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.886+0000 7f517a59c640 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559fa3342d80 0x559fa3747650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.886+0000 7f5161ffb640 10 client.16464 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.886+0000 7f517a59c640 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559fa3342d80 0x559fa3747650 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df523e3f23a3f26b server_cookie=418612820c3b2963 in_seq=0 out_seq=0 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5161ffb640 1 -- 172.21.15.53:0/794838975 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559fa369ef50 con 0x559fa3342d80 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5161ffb640 10 client.16464 handle_command_reply: tid=0 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 1 client.16464 shutdown 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 1 -- 172.21.15.53:0/794838975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33841b0 msgr2=0x559fa3741550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33841b0 0x559fa3741550 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f517402aeb0 tx=0x7f51740318e0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 1 -- 172.21.15.53:0/794838975 shutdown_connections 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559fa3342d80 0x559fa3747650 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33841b0 0x559fa3741550 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33634d0 0x559fa3735eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 1 --2- 172.21.15.53:0/794838975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa3735910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 1 -- 172.21.15.53:0/794838975 >> 172.21.15.53:0/794838975 conn(0x559fa3378300 msgr2=0x559fa3723c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5161ffb640 0 client.16464 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 1 -- 172.21.15.53:0/794838975 shutdown_connections 2024-08-31T06:07:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 1 -- 172.21.15.53:0/794838975 wait complete. 2024-08-31T06:07:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.887+0000 7f5187fbd740 20 client.16464 trim_cache size 0 max 16384 2024-08-31T06:07:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5187fbd740 1 Processor -- start 2024-08-31T06:07:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5187fbd740 1 -- start start 2024-08-31T06:07:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa3741450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa3734bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33841b0 0x559fa3735110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5187fbd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1ad130 con 0x559fa33634d0 2024-08-31T06:07:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5187fbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1aed30 con 0x559fa335b2f0 2024-08-31T06:07:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5187fbd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1ad800 con 0x559fa33841b0 2024-08-31T06:07:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5179d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa3734bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f517a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa3741450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5179d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa3734bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46164/0 (socket says 172.21.15.53:46164) 2024-08-31T06:07:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5179d9b640 1 -- 172.21.15.53:0/1092656229 learned_addr learned my addr 172.21.15.53:0/1092656229 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f517ad9d640 1 --2- 172.21.15.53:0/1092656229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33841b0 0x559fa3735110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5179d9b640 1 -- 172.21.15.53:0/1092656229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33841b0 msgr2=0x559fa3735110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5179d9b640 1 --2- 172.21.15.53:0/1092656229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33841b0 0x559fa3735110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5179d9b640 1 -- 172.21.15.53:0/1092656229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 msgr2=0x559fa3741450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5179d9b640 1 --2- 172.21.15.53:0/1092656229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa3741450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f5179d9b640 1 -- 172.21.15.53:0/1092656229 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa3342fb0 con 0x559fa33634d0 2024-08-31T06:07:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.904+0000 7f517a59c640 1 --2- 172.21.15.53:0/1092656229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa3741450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.905+0000 7f5179d9b640 1 --2- 172.21.15.53:0/1092656229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa3734bd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f51700a7f60 tx=0x7f51700abd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb076c4bfc9392b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:23.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.905+0000 7f5163fff640 1 -- 172.21.15.53:0/1092656229 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700ab9f0 con 0x559fa33634d0 2024-08-31T06:07:23.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.905+0000 7f5163fff640 1 -- 172.21.15.53:0/1092656229 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51700e8e50 con 0x559fa33634d0 2024-08-31T06:07:23.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.905+0000 7f5163fff640 1 -- 172.21.15.53:0/1092656229 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700e31c0 con 0x559fa33634d0 2024-08-31T06:07:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 -- 172.21.15.53:0/1092656229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 msgr2=0x559fa3734bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 --2- 172.21.15.53:0/1092656229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa3734bd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f51700a7f60 tx=0x7f51700abd70 comp rx=0 tx=0).stop 2024-08-31T06:07:23.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 -- 172.21.15.53:0/1092656229 shutdown_connections 2024-08-31T06:07:23.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 --2- 172.21.15.53:0/1092656229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33841b0 0x559fa3735110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 --2- 172.21.15.53:0/1092656229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa3734bd0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 --2- 172.21.15.53:0/1092656229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa3741450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 -- 172.21.15.53:0/1092656229 >> 172.21.15.53:0/1092656229 conn(0x559fa3378300 msgr2=0x559fa3733f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:23.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 -- 172.21.15.53:0/1092656229 shutdown_connections 2024-08-31T06:07:23.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 -- 172.21.15.53:0/1092656229 wait complete. 2024-08-31T06:07:23.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 -- start start 2024-08-31T06:07:23.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 Processor -- start 2024-08-31T06:07:23.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa373d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa373dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33841b0 0x559fa372e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1ae5a0 con 0x559fa33634d0 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1aded0 con 0x559fa335b2f0 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1ab110 con 0x559fa33841b0 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.906+0000 7f5187fbd740 10 client.0 _ll_register_callbacks cb 0x7f51700eb420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5179d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa373dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5179d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa373dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46166/0 (socket says 172.21.15.53:46166) 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5179d9b640 1 -- 172.21.15.53:0/2077103796 learned_addr learned my addr 172.21.15.53:0/2077103796 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f517a59c640 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa373d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f517ad9d640 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33841b0 0x559fa372e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5179d9b640 1 -- 172.21.15.53:0/2077103796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33841b0 msgr2=0x559fa372e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5179d9b640 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33841b0 0x559fa372e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5179d9b640 1 -- 172.21.15.53:0/2077103796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 msgr2=0x559fa373d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5179d9b640 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa373d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5179d9b640 1 -- 172.21.15.53:0/2077103796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fa372eff0 con 0x559fa33634d0 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5179d9b640 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa373dd90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5170003a50 tx=0x7f5170003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42641856e9649733 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5161ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5161ffb640 1 -- 172.21.15.53:0/2077103796 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700ab9f0 con 0x559fa33634d0 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5161ffb640 1 -- 172.21.15.53:0/2077103796 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f51700b0360 con 0x559fa33634d0 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5187fbd740 1 -- 172.21.15.53:0/2077103796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51700e8e50 con 0x559fa33634d0 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5161ffb640 1 -- 172.21.15.53:0/2077103796 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f51700abee0 con 0x559fa33634d0 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5187fbd740 10 client.16470 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.907+0000 7f5187fbd740 1 -- 172.21.15.53:0/2077103796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559fa373cfb0 con 0x559fa33634d0 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.908+0000 7f5161ffb640 1 -- 172.21.15.53:0/2077103796 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51700e8e50 con 0x559fa33634d0 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.908+0000 7f5161ffb640 1 -- 172.21.15.53:0/2077103796 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f51700b4d70 con 0x559fa33634d0 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.908+0000 7f5187fbd740 10 client.16470 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.908+0000 7f5187fbd740 10 client.16470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.908+0000 7f5187fbd740 20 client.16470 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.908+0000 7f5187fbd740 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559fa33181c0 0x559fa37b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.908+0000 7f5187fbd740 4 client.16470 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:07:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.908+0000 7f5187fbd740 1 -- 172.21.15.53:0/2077103796 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559fa369a9f0 con 0x559fa33181c0 2024-08-31T06:07:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.908+0000 7f517a59c640 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559fa33181c0 0x559fa37b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.908+0000 7f5161ffb640 10 client.16470 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.908+0000 7f517a59c640 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559fa33181c0 0x559fa37b22d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ade9db7af12f53 server_cookie=4cf4f5ee98a977fa in_seq=0 out_seq=0 2024-08-31T06:07:23.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:23 smithi153 ceph-mon[22320]: pgmap v396: 97 pgs: 97 active+clean; 31 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-08-31T06:07:23.928 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5161ffb640 1 -- 172.21.15.53:0/2077103796 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559fa369a9f0 con 0x559fa33181c0 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5161ffb640 10 client.16470 handle_command_reply: tid=0 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 1 client.16470 shutdown 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 1 -- 172.21.15.53:0/2077103796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 msgr2=0x559fa373dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa373dd90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5170003a50 tx=0x7f5170003cd0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 1 -- 172.21.15.53:0/2077103796 shutdown_connections 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559fa33181c0 0x559fa37b22d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559fa33841b0 0x559fa372e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5161ffb640 0 client.16470 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fa33634d0 0x559fa373dd90 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 1 --2- 172.21.15.53:0/2077103796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fa335b2f0 0x559fa373d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 1 -- 172.21.15.53:0/2077103796 >> 172.21.15.53:0/2077103796 conn(0x559fa3378300 msgr2=0x559fa3734bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:23.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 1 -- 172.21.15.53:0/2077103796 shutdown_connections 2024-08-31T06:07:23.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 1 -- 172.21.15.53:0/2077103796 wait complete. 2024-08-31T06:07:23.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.926+0000 7f5187fbd740 20 client.16470 trim_cache size 0 max 16384 2024-08-31T06:07:23.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:07:23.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:07:23.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:07:23.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:07:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 -- 172.21.15.53:0/1201541599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51640b4ca0 msgr2=0x7f51640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51640b4ca0 0x7f51640b71b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x559fa3726740 tx=0x7f516c005f90 comp rx=0 tx=0).stop 2024-08-31T06:07:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 -- 172.21.15.53:0/1201541599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f517c108080 msgr2=0x7f517c199580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f517c108080 0x7f517c199580 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f517000e970 tx=0x7f517000ee30 comp rx=0 tx=0).stop 2024-08-31T06:07:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 -- 172.21.15.53:0/1201541599 shutdown_connections 2024-08-31T06:07:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51640b4ca0 0x7f51640b71b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517c1089d0 0x7f517c19e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f517c108080 0x7f517c199580 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 --2- 172.21.15.53:0/1201541599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f517c102750 0x7f517c198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:23.932 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 -- 172.21.15.53:0/1201541599 >> 172.21.15.53:0/1201541599 conn(0x7f517c07a4e0 msgr2=0x7f517c1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:23.932 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 -- 172.21.15.53:0/1201541599 shutdown_connections 2024-08-31T06:07:23.932 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:23.927+0000 7f5180f6e640 1 -- 172.21.15.53:0/1201541599 wait complete. 2024-08-31T06:07:23.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 38517 3.08 MB/sec warmup 73 sec latency 15.140 ms 2024-08-31T06:07:23.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:23 smithi053 ceph-mon[18924]: pgmap v396: 97 pgs: 97 active+clean; 31 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-08-31T06:07:24.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 39052 3.10 MB/sec warmup 74 sec latency 11.777 ms 2024-08-31T06:07:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:25 smithi130 ceph-mon[22266]: pgmap v397: 97 pgs: 97 active+clean; 32 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-08-31T06:07:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:25 smithi153 ceph-mon[22320]: pgmap v397: 97 pgs: 97 active+clean; 32 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-08-31T06:07:25.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 39418 3.08 MB/sec warmup 75 sec latency 13.004 ms 2024-08-31T06:07:25.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:25 smithi053 ceph-mon[18924]: pgmap v397: 97 pgs: 97 active+clean; 32 MiB data, 534 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-08-31T06:07:26.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 39707 3.05 MB/sec warmup 76 sec latency 13.398 ms 2024-08-31T06:07:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:27 smithi130 ceph-mon[22266]: pgmap v398: 97 pgs: 97 active+clean; 32 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.5 MiB/s wr, 149 op/s 2024-08-31T06:07:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:27 smithi153 ceph-mon[22320]: pgmap v398: 97 pgs: 97 active+clean; 32 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.5 MiB/s wr, 149 op/s 2024-08-31T06:07:27.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 40220 3.03 MB/sec warmup 77 sec latency 14.499 ms 2024-08-31T06:07:27.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:27 smithi053 ceph-mon[18924]: pgmap v398: 97 pgs: 97 active+clean; 32 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.5 MiB/s wr, 149 op/s 2024-08-31T06:07:28.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 40769 3.03 MB/sec warmup 78 sec latency 15.954 ms 2024-08-31T06:07:29.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:29 smithi130 ceph-mon[22266]: pgmap v399: 97 pgs: 97 active+clean; 34 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-31T06:07:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:29 smithi153 ceph-mon[22320]: pgmap v399: 97 pgs: 97 active+clean; 34 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-31T06:07:29.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 41420 3.02 MB/sec warmup 79 sec latency 15.188 ms 2024-08-31T06:07:29.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:29 smithi053 ceph-mon[18924]: pgmap v399: 97 pgs: 97 active+clean; 34 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-31T06:07:30.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 41997 3.05 MB/sec warmup 80 sec latency 14.988 ms 2024-08-31T06:07:31.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:31 smithi130 ceph-mon[22266]: pgmap v400: 97 pgs: 97 active+clean; 33 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-31T06:07:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:31 smithi153 ceph-mon[22320]: pgmap v400: 97 pgs: 97 active+clean; 33 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-31T06:07:31.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 42446 3.04 MB/sec warmup 81 sec latency 15.698 ms 2024-08-31T06:07:31.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:31 smithi053 ceph-mon[18924]: pgmap v400: 97 pgs: 97 active+clean; 33 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-31T06:07:32.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 42912 3.05 MB/sec warmup 82 sec latency 14.114 ms 2024-08-31T06:07:33.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:07:33.505 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:33 smithi130 ceph-mon[22266]: pgmap v401: 97 pgs: 97 active+clean; 35 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.3 MiB/s wr, 144 op/s 2024-08-31T06:07:33.911 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:33 smithi053 ceph-mon[18924]: pgmap v401: 97 pgs: 97 active+clean; 35 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.3 MiB/s wr, 144 op/s 2024-08-31T06:07:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:33 smithi153 ceph-mon[22320]: pgmap v401: 97 pgs: 97 active+clean; 35 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.3 MiB/s wr, 144 op/s 2024-08-31T06:07:33.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 43181 3.02 MB/sec warmup 83 sec latency 12.824 ms 2024-08-31T06:07:34.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.012+0000 7f23beb46640 1 -- 172.21.15.53:0/145930563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23b8109ba0 msgr2=0x7f23b81103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.012+0000 7f23beb46640 1 --2- 172.21.15.53:0/145930563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23b8109ba0 0x7f23b81103d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009ca0 tx=0x7f23b002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.012+0000 7f23beb46640 1 -- 172.21.15.53:0/145930563 shutdown_connections 2024-08-31T06:07:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.012+0000 7f23beb46640 1 --2- 172.21.15.53:0/145930563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23b8109ba0 0x7f23b81103d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.012+0000 7f23beb46640 1 --2- 172.21.15.53:0/145930563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23b8109250 0x7f23b8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.012+0000 7f23beb46640 1 --2- 172.21.15.53:0/145930563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b8103910 0x7f23b8103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.012+0000 7f23beb46640 1 -- 172.21.15.53:0/145930563 >> 172.21.15.53:0/145930563 conn(0x7f23b80ff380 msgr2=0x7f23b81017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.012+0000 7f23beb46640 1 -- 172.21.15.53:0/145930563 shutdown_connections 2024-08-31T06:07:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.012+0000 7f23beb46640 1 -- 172.21.15.53:0/145930563 wait complete. 2024-08-31T06:07:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23beb46640 1 Processor -- start 2024-08-31T06:07:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23beb46640 1 -- start start 2024-08-31T06:07:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23beb46640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23b8103910 0x7f23b80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23beb46640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b8109250 0x7f23b80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23beb46640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23b8109ba0 0x7f23b8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23beb46640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23b8113760 con 0x7f23b8109ba0 2024-08-31T06:07:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23beb46640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81135e0 con 0x7f23b8103910 2024-08-31T06:07:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23beb46640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81138e0 con 0x7f23b8109250 2024-08-31T06:07:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23bd0e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23b8109ba0 0x7f23b8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23affff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b8109250 0x7f23b80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23bd0e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23b8109ba0 0x7f23b8075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36582/0 (socket says 172.21.15.53:36582) 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23bd0e3640 1 -- 172.21.15.53:0/2782475213 learned_addr learned my addr 172.21.15.53:0/2782475213 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.013+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23b8103910 0x7f23b80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.014+0000 7f23affff640 1 -- 172.21.15.53:0/2782475213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23b8103910 msgr2=0x7f23b80754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.014+0000 7f23affff640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23b8103910 0x7f23b80754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.014+0000 7f23affff640 1 -- 172.21.15.53:0/2782475213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23b8109ba0 msgr2=0x7f23b8075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.014+0000 7f23affff640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23b8109ba0 0x7f23b8075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.014+0000 7f23affff640 1 -- 172.21.15.53:0/2782475213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b81a8470 con 0x7f23b8109250 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.014+0000 7f23affff640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b8109250 0x7f23b80759f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23b806bae0 tx=0x7f23a800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.014+0000 7f23adffb640 1 -- 172.21.15.53:0/2782475213 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a800cc40 con 0x7f23b8109250 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.014+0000 7f23beb46640 1 -- 172.21.15.53:0/2782475213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b81a8760 con 0x7f23b8109250 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.014+0000 7f23adffb640 1 -- 172.21.15.53:0/2782475213 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23a800cde0 con 0x7f23b8109250 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.014+0000 7f23adffb640 1 -- 172.21.15.53:0/2782475213 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a80186f0 con 0x7f23b8109250 2024-08-31T06:07:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.014+0000 7f23beb46640 1 -- 172.21.15.53:0/2782475213 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b81a8cf0 con 0x7f23b8109250 2024-08-31T06:07:34.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23c50bb740 1 Processor -- start 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23c50bb740 1 -- start start 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23adffb640 1 -- 172.21.15.53:0/2782475213 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f23a8018890 con 0x7f23b8109250 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b69070 0x55cee6f0e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 0x55cee6f0e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 0x55cee6f0ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23c50bb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cee6e85630 con 0x55cee6b401b0 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23c50bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cee6e74bc0 con 0x55cee6b48390 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23c50bb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cee6e78b70 con 0x55cee6b69070 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23bc8e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 0x55cee6f0e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23bc8e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 0x55cee6f0e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36586/0 (socket says 172.21.15.53:36586) 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23bc8e2640 1 -- 172.21.15.53:0/3184158031 learned_addr learned my addr 172.21.15.53:0/3184158031 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23affff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 0x55cee6f0ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.017+0000 7f23bd0e3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b69070 0x55cee6f0e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f23bc8e2640 1 -- 172.21.15.53:0/3184158031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b69070 msgr2=0x55cee6f0e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/3184158031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b69070 0x55cee6f0e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f23bc8e2640 1 -- 172.21.15.53:0/3184158031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 msgr2=0x55cee6f0ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/3184158031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 0x55cee6f0ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f23bc8e2640 1 -- 172.21.15.53:0/3184158031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee6bd4650 con 0x55cee6b401b0 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f23bd0e3640 1 --2- 172.21.15.53:0/3184158031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b69070 0x55cee6f0e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f23affff640 1 --2- 172.21.15.53:0/3184158031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 0x55cee6f0ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/3184158031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 0x55cee6f0e800 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009ca0 tx=0x7f23b4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13cd791bde87723 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f23adffb640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23a00b4ca0 0x7f23a00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f239effd640 1 -- 172.21.15.53:0/3184158031 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4005220 con 0x55cee6b401b0 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f239effd640 1 -- 172.21.15.53:0/3184158031 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23b4004c30 con 0x55cee6b401b0 2024-08-31T06:07:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f239effd640 1 -- 172.21.15.53:0/3184158031 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4019650 con 0x55cee6b401b0 2024-08-31T06:07:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f23bd0e3640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23a00b4ca0 0x7f23a00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.018+0000 7f23adffb640 1 -- 172.21.15.53:0/2782475213 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f23a80e57c0 con 0x7f23b8109250 2024-08-31T06:07:34.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.019+0000 7f23c50bb740 1 -- 172.21.15.53:0/3184158031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 msgr2=0x55cee6f0e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:34.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.019+0000 7f23c50bb740 1 --2- 172.21.15.53:0/3184158031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 0x55cee6f0e800 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009ca0 tx=0x7f23b4011810 comp rx=0 tx=0).stop 2024-08-31T06:07:34.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.019+0000 7f23bd0e3640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23a00b4ca0 0x7f23a00b71b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23b0004af0 tx=0x7f23b0004a80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:34.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.019+0000 7f23c50bb740 1 -- 172.21.15.53:0/3184158031 shutdown_connections 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.019+0000 7f23c50bb740 1 --2- 172.21.15.53:0/3184158031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 0x55cee6f0ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.019+0000 7f23c50bb740 1 --2- 172.21.15.53:0/3184158031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 0x55cee6f0e800 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.019+0000 7f23c50bb740 1 --2- 172.21.15.53:0/3184158031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b69070 0x55cee6f0e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.019+0000 7f23c50bb740 1 -- 172.21.15.53:0/3184158031 >> 172.21.15.53:0/3184158031 conn(0x55cee6b5d460 msgr2=0x55cee6f0c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.020+0000 7f23c50bb740 1 -- 172.21.15.53:0/3184158031 shutdown_connections 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.020+0000 7f23c50bb740 1 -- 172.21.15.53:0/3184158031 wait complete. 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.020+0000 7f23c50bb740 1 -- start start 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.020+0000 7f23c50bb740 1 Processor -- start 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 0x55cee6f19a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 0x55cee6f19f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b69070 0x55cee6f25d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23c50bb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cee6cd7700 con 0x55cee6b401b0 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23c50bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cee6dfb700 con 0x55cee6b69070 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23c50bb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cee6f1caa0 con 0x55cee6b48390 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23c50bb740 10 client.0 _ll_register_callbacks cb 0x55cee6e2adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23bc8e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 0x55cee6f19a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23affff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 0x55cee6f19f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23affff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 0x55cee6f19f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50718/0 (socket says 172.21.15.53:50718) 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23affff640 1 -- 172.21.15.53:0/1812417024 learned_addr learned my addr 172.21.15.53:0/1812417024 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23bd0e3640 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b69070 0x55cee6f25d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23affff640 1 -- 172.21.15.53:0/1812417024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b69070 msgr2=0x55cee6f25d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23affff640 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b69070 0x55cee6f25d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23affff640 1 -- 172.21.15.53:0/1812417024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 msgr2=0x55cee6f19a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23affff640 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 0x55cee6f19a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.021+0000 7f23affff640 1 -- 172.21.15.53:0/1812417024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee6e348b0 con 0x55cee6b48390 2024-08-31T06:07:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f23affff640 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 0x55cee6f19f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23a80a91d0 tx=0x7f23a800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1261f2406f475ca7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f2397fff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f2397fff640 1 -- 172.21.15.53:0/1812417024 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a80ab6d0 con 0x55cee6b48390 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f2397fff640 1 -- 172.21.15.53:0/1812417024 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f23a80b03d0 con 0x55cee6b48390 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f23c50bb740 1 -- 172.21.15.53:0/1812417024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23b4004c30 con 0x55cee6b48390 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f2397fff640 1 -- 172.21.15.53:0/1812417024 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23a80e33a0 con 0x55cee6b48390 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f23c50bb740 10 client.25906 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f23c50bb740 1 -- 172.21.15.53:0/1812417024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cee6f288b0 con 0x55cee6b48390 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f2397fff640 1 -- 172.21.15.53:0/1812417024 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23b4004c30 con 0x55cee6b48390 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f2397fff640 1 -- 172.21.15.53:0/1812417024 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f23a8018b80 con 0x55cee6b48390 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f23c50bb740 10 client.25906 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.022+0000 7f23c50bb740 10 client.25906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.023+0000 7f23c50bb740 20 client.25906 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.023+0000 7f23c50bb740 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cee6b279f0 0x55cee6f2be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.023+0000 7f23c50bb740 4 client.25906 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:34.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.023+0000 7f23c50bb740 1 -- 172.21.15.53:0/1812417024 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cee6e87580 con 0x55cee6b279f0 2024-08-31T06:07:34.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.023+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cee6b279f0 0x55cee6f2be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.023+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cee6b279f0 0x55cee6f2be30 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d230c1d5b54f891 server_cookie=89f3b570164d1b6c in_seq=0 out_seq=0 2024-08-31T06:07:34.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.023+0000 7f2397fff640 10 client.25906 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:34.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f2397fff640 1 -- 172.21.15.53:0/1812417024 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cee6e87580 con 0x55cee6b279f0 2024-08-31T06:07:34.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f2397fff640 10 client.25906 handle_command_reply: tid=0 2024-08-31T06:07:34.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f23c50bb740 1 client.25906 shutdown 2024-08-31T06:07:34.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f23c50bb740 1 -- 172.21.15.53:0/1812417024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 msgr2=0x55cee6f19f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:34.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f23c50bb740 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 0x55cee6f19f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23a80a91d0 tx=0x7f23a800cf90 comp rx=0 tx=0).stop 2024-08-31T06:07:34.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f23c50bb740 1 -- 172.21.15.53:0/1812417024 shutdown_connections 2024-08-31T06:07:34.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f23c50bb740 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cee6b279f0 0x55cee6f2be30 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f23c50bb740 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b69070 0x55cee6f25d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f23c50bb740 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 0x55cee6f19f60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f23c50bb740 1 --2- 172.21.15.53:0/1812417024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b401b0 0x55cee6f19a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f23c50bb740 1 -- 172.21.15.53:0/1812417024 >> 172.21.15.53:0/1812417024 conn(0x55cee6b5d460 msgr2=0x55cee6f11450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:34.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.024+0000 7f2397fff640 0 client.25906 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:34.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.025+0000 7f23c50bb740 1 -- 172.21.15.53:0/1812417024 shutdown_connections 2024-08-31T06:07:34.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.025+0000 7f23c50bb740 1 -- 172.21.15.53:0/1812417024 wait complete. 2024-08-31T06:07:34.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.025+0000 7f23c50bb740 20 client.25906 trim_cache size 0 max 16384 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.043+0000 7f23c50bb740 1 Processor -- start 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.043+0000 7f23c50bb740 1 -- start start 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b401b0 0x55cee6f182a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 0x55cee6f187e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b69070 0x55cee6f113c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23c50bb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81ad280 con 0x55cee6b69070 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23c50bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81aee80 con 0x55cee6b401b0 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23c50bb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81ad950 con 0x55cee6b48390 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23bc8e2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b401b0 0x55cee6f182a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23bd0e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b69070 0x55cee6f113c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23bc8e2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b401b0 0x55cee6f182a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38474/0 (socket says 172.21.15.53:38474) 2024-08-31T06:07:34.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23bc8e2640 1 -- 172.21.15.53:0/224341838 learned_addr learned my addr 172.21.15.53:0/224341838 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:34.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23affff640 1 --2- 172.21.15.53:0/224341838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 0x55cee6f187e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23bc8e2640 1 -- 172.21.15.53:0/224341838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 msgr2=0x55cee6f187e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/224341838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 0x55cee6f187e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23bc8e2640 1 -- 172.21.15.53:0/224341838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b69070 msgr2=0x55cee6f113c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/224341838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b69070 0x55cee6f113c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23bc8e2640 1 -- 172.21.15.53:0/224341838 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee6f1a350 con 0x55cee6b401b0 2024-08-31T06:07:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.044+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/224341838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b401b0 0x55cee6f182a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23b4000c00 tx=0x7f23b4005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2c83d81255e9575 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.045+0000 7f239e7fc640 1 -- 172.21.15.53:0/224341838 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4031070 con 0x55cee6b401b0 2024-08-31T06:07:34.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.045+0000 7f239e7fc640 1 -- 172.21.15.53:0/224341838 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23b40044a0 con 0x55cee6b401b0 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.045+0000 7f239e7fc640 1 -- 172.21.15.53:0/224341838 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4019430 con 0x55cee6b401b0 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.046+0000 7f23c50bb740 1 -- 172.21.15.53:0/224341838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b401b0 msgr2=0x55cee6f182a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.046+0000 7f23c50bb740 1 --2- 172.21.15.53:0/224341838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b401b0 0x55cee6f182a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23b4000c00 tx=0x7f23b4005850 comp rx=0 tx=0).stop 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.046+0000 7f23c50bb740 1 -- 172.21.15.53:0/224341838 shutdown_connections 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.046+0000 7f23c50bb740 1 --2- 172.21.15.53:0/224341838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b69070 0x55cee6f113c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.046+0000 7f23c50bb740 1 --2- 172.21.15.53:0/224341838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b48390 0x55cee6f187e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.046+0000 7f23c50bb740 1 --2- 172.21.15.53:0/224341838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b401b0 0x55cee6f182a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.046+0000 7f23c50bb740 1 -- 172.21.15.53:0/224341838 >> 172.21.15.53:0/224341838 conn(0x55cee6b5d460 msgr2=0x55cee6f14b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.046+0000 7f23c50bb740 1 -- 172.21.15.53:0/224341838 shutdown_connections 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.046+0000 7f23c50bb740 1 -- 172.21.15.53:0/224341838 wait complete. 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.046+0000 7f23c50bb740 1 -- start start 2024-08-31T06:07:34.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.046+0000 7f23c50bb740 1 Processor -- start 2024-08-31T06:07:34.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b401b0 0x55cee6f22350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 0x55cee6f1d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23c50bb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b69070 0x55cee6f1dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23c50bb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81ae6f0 con 0x55cee6b69070 2024-08-31T06:07:34.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23c50bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81ae020 con 0x55cee6b48390 2024-08-31T06:07:34.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23c50bb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23b81ab280 con 0x55cee6b401b0 2024-08-31T06:07:34.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23c50bb740 10 client.0 _ll_register_callbacks cb 0x7f23a80eb240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:34.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23bc8e2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b401b0 0x55cee6f22350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23affff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 0x55cee6f1d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23bc8e2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b401b0 0x55cee6f22350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50736/0 (socket says 172.21.15.53:50736) 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23bc8e2640 1 -- 172.21.15.53:0/440967394 learned_addr learned my addr 172.21.15.53:0/440967394 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23bd0e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b69070 0x55cee6f1dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23affff640 1 -- 172.21.15.53:0/440967394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b401b0 msgr2=0x55cee6f22350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23affff640 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b401b0 0x55cee6f22350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23affff640 1 -- 172.21.15.53:0/440967394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b69070 msgr2=0x55cee6f1dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23affff640 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b69070 0x55cee6f1dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23affff640 1 -- 172.21.15.53:0/440967394 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee6f1e380 con 0x55cee6b48390 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b401b0 0x55cee6f22350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f23affff640 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 0x55cee6f1d800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f23a80a7fe0 tx=0x7f23a80ab350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=214c11810cf2b7be server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.047+0000 7f2397fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.048+0000 7f2397fff640 1 -- 172.21.15.53:0/440967394 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a80a7e20 con 0x55cee6b48390 2024-08-31T06:07:34.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.048+0000 7f2397fff640 1 -- 172.21.15.53:0/440967394 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f23a80930d0 con 0x55cee6b48390 2024-08-31T06:07:34.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.048+0000 7f23c50bb740 1 -- 172.21.15.53:0/440967394 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23b40044a0 con 0x55cee6b48390 2024-08-31T06:07:34.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.048+0000 7f2397fff640 1 -- 172.21.15.53:0/440967394 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23a8018d90 con 0x55cee6b48390 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.048+0000 7f23c50bb740 10 client.25913 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.048+0000 7f23c50bb740 1 -- 172.21.15.53:0/440967394 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cee6f965a0 con 0x55cee6b48390 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.048+0000 7f2397fff640 1 -- 172.21.15.53:0/440967394 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23b40044a0 con 0x55cee6b48390 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.048+0000 7f2397fff640 1 -- 172.21.15.53:0/440967394 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f23a8097080 con 0x55cee6b48390 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.048+0000 7f23c50bb740 10 client.25913 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.049+0000 7f23c50bb740 10 client.25913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.049+0000 7f23c50bb740 20 client.25913 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.049+0000 7f23c50bb740 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cee6afcda0 0x55cee6f98dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.049+0000 7f23c50bb740 4 client.25913 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.049+0000 7f23c50bb740 1 -- 172.21.15.53:0/440967394 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cee6e83020 con 0x55cee6afcda0 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.049+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cee6afcda0 0x55cee6f98dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.049+0000 7f2397fff640 10 client.25913 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.049+0000 7f23bc8e2640 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cee6afcda0 0x55cee6f98dd0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd2467de6db044bb server_cookie=5b4ba5b299a9e2fd in_seq=0 out_seq=0 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.049+0000 7f2397fff640 1 -- 172.21.15.53:0/440967394 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55cee6e83020 con 0x55cee6afcda0 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.049+0000 7f2397fff640 10 client.25913 handle_command_reply: tid=0 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.049+0000 7f23c50bb740 1 client.25913 shutdown 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f23c50bb740 1 -- 172.21.15.53:0/440967394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 msgr2=0x55cee6f1d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f23c50bb740 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 0x55cee6f1d800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f23a80a7fe0 tx=0x7f23a80ab350 comp rx=0 tx=0).stop 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f23c50bb740 1 -- 172.21.15.53:0/440967394 shutdown_connections 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f23c50bb740 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cee6afcda0 0x55cee6f98dd0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f23c50bb740 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cee6b69070 0x55cee6f1dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f23c50bb740 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cee6b48390 0x55cee6f1d800 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f23c50bb740 1 --2- 172.21.15.53:0/440967394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee6b401b0 0x55cee6f22350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f2397fff640 0 client.25913 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f23c50bb740 1 -- 172.21.15.53:0/440967394 >> 172.21.15.53:0/440967394 conn(0x55cee6b5d460 msgr2=0x55cee6f14b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f23c50bb740 1 -- 172.21.15.53:0/440967394 shutdown_connections 2024-08-31T06:07:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f23c50bb740 1 -- 172.21.15.53:0/440967394 wait complete. 2024-08-31T06:07:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.050+0000 7f23c50bb740 20 client.25913 trim_cache size 0 max 16384 2024-08-31T06:07:34.058 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:07:34.058 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:07:34.058 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:07:34.058 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:07:34.058 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:07:34.058 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:34.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:34.060 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:34.061 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:34.061 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:34.061 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:34.061 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:07:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 -- 172.21.15.53:0/2782475213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23a00b4ca0 msgr2=0x7f23a00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23a00b4ca0 0x7f23a00b71b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23b0004af0 tx=0x7f23b0004a80 comp rx=0 tx=0).stop 2024-08-31T06:07:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 -- 172.21.15.53:0/2782475213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b8109250 msgr2=0x7f23b80759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b8109250 0x7f23b80759f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23b806bae0 tx=0x7f23a800ee50 comp rx=0 tx=0).stop 2024-08-31T06:07:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 -- 172.21.15.53:0/2782475213 shutdown_connections 2024-08-31T06:07:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23a00b4ca0 0x7f23a00b71b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23b8109ba0 0x7f23b8075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b8109250 0x7f23b80759f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 --2- 172.21.15.53:0/2782475213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23b8103910 0x7f23b80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 -- 172.21.15.53:0/2782475213 >> 172.21.15.53:0/2782475213 conn(0x7f23b80ff380 msgr2=0x7f23b81017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 -- 172.21.15.53:0/2782475213 shutdown_connections 2024-08-31T06:07:34.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:34.051+0000 7f23beb46640 1 -- 172.21.15.53:0/2782475213 wait complete. 2024-08-31T06:07:34.855 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:07:34.856 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:07:34.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 43659 3.00 MB/sec warmup 84 sec latency 13.953 ms 2024-08-31T06:07:35.137 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:35.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.644+0000 7fa6f7bda640 1 -- 172.21.15.53:0/687707822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f0108270 msgr2=0x7fa6f010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.644+0000 7fa6f7bda640 1 --2- 172.21.15.53:0/687707822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f0108270 0x7fa6f010eaa0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009ca0 tx=0x7fa6e802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.644+0000 7fa6f7bda640 1 -- 172.21.15.53:0/687707822 shutdown_connections 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.644+0000 7fa6f7bda640 1 --2- 172.21.15.53:0/687707822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f0108270 0x7fa6f010eaa0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.644+0000 7fa6f7bda640 1 --2- 172.21.15.53:0/687707822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f0107920 0x7fa6f0107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.644+0000 7fa6f7bda640 1 --2- 172.21.15.53:0/687707822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f0101fe0 0x7fa6f01023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.644+0000 7fa6f7bda640 1 -- 172.21.15.53:0/687707822 >> 172.21.15.53:0/687707822 conn(0x7fa6f0079d30 msgr2=0x7fa6f007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.644+0000 7fa6f7bda640 1 -- 172.21.15.53:0/687707822 shutdown_connections 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.644+0000 7fa6f7bda640 1 -- 172.21.15.53:0/687707822 wait complete. 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.645+0000 7fa6f7bda640 1 Processor -- start 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.645+0000 7fa6f7bda640 1 -- start start 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f7bda640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f0101fe0 0x7fa6f019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:35.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f7bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f0107920 0x7fa6f019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f7bda640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f0108270 0x7fa6f019f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f7bda640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f01115b0 con 0x7fa6f0107920 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f7bda640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f0111430 con 0x7fa6f0101fe0 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f7bda640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f0111730 con 0x7fa6f0108270 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f5175640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f0107920 0x7fa6f019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f5175640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f0107920 0x7fa6f019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36638/0 (socket says 172.21.15.53:36638) 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f5175640 1 -- 172.21.15.53:0/595017011 learned_addr learned my addr 172.21.15.53:0/595017011 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f5976640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f0101fe0 0x7fa6f019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f6177640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f0108270 0x7fa6f019f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f5976640 1 -- 172.21.15.53:0/595017011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f0108270 msgr2=0x7fa6f019f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f5976640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f0108270 0x7fa6f019f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f5976640 1 -- 172.21.15.53:0/595017011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f0107920 msgr2=0x7fa6f019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:35.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f5976640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f0107920 0x7fa6f019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f5976640 1 -- 172.21.15.53:0/595017011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f01a00a0 con 0x7fa6f0101fe0 2024-08-31T06:07:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.646+0000 7fa6f5175640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f0107920 0x7fa6f019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.647+0000 7fa6f5976640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f0101fe0 0x7fa6f019a130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00e9f0 tx=0x7fa6ec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.647+0000 7fa6e6ffd640 1 -- 172.21.15.53:0/595017011 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00ccc0 con 0x7fa6f0101fe0 2024-08-31T06:07:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.647+0000 7fa6f7bda640 1 -- 172.21.15.53:0/595017011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f01a0390 con 0x7fa6f0101fe0 2024-08-31T06:07:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.647+0000 7fa6e6ffd640 1 -- 172.21.15.53:0/595017011 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6ec0108c0 con 0x7fa6f0101fe0 2024-08-31T06:07:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.647+0000 7fa6e6ffd640 1 -- 172.21.15.53:0/595017011 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec0187c0 con 0x7fa6f0101fe0 2024-08-31T06:07:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.647+0000 7fa6f7bda640 1 -- 172.21.15.53:0/595017011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f01a6af0 con 0x7fa6f0101fe0 2024-08-31T06:07:35.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.648+0000 7fa6f7bda640 1 -- 172.21.15.53:0/595017011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f01023f0 con 0x7fa6f0101fe0 2024-08-31T06:07:35.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.650+0000 7fa6e6ffd640 1 -- 172.21.15.53:0/595017011 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa6ec010430 con 0x7fa6f0101fe0 2024-08-31T06:07:35.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.650+0000 7fa6e6ffd640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6dc0b4ca0 0x7fa6dc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:35.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.650+0000 7fa6f5175640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6dc0b4ca0 0x7fa6dc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:35.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.651+0000 7fa6e6ffd640 1 -- 172.21.15.53:0/595017011 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa6ec0e5ca0 con 0x7fa6f0101fe0 2024-08-31T06:07:35.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.651+0000 7fa6f5175640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6dc0b4ca0 0x7fa6dc0b71b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa6f007a3a0 tx=0x7fa6e0010040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:35.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.653+0000 7fa6e6ffd640 1 -- 172.21.15.53:0/595017011 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa6ec0ac440 con 0x7fa6f0101fe0 2024-08-31T06:07:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:35 smithi130 ceph-mon[22266]: pgmap v402: 97 pgs: 97 active+clean; 34 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-08-31T06:07:35.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.905+0000 7fa6f7bda640 1 -- 172.21.15.53:0/595017011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6f019b260 con 0x7fa6f0101fe0 2024-08-31T06:07:35.908 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:35 smithi053 ceph-mon[18924]: pgmap v402: 97 pgs: 97 active+clean; 34 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-08-31T06:07:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.906+0000 7fa6e6ffd640 1 -- 172.21.15.53:0/595017011 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11992 (secure 0 0 0) 0x7fa6ec0b0c00 con 0x7fa6f0101fe0 2024-08-31T06:07:35.908 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:07:35.908 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"btime":"2024-08-31T06:06:51:511613+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:06:50.526609+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:07:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 30 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.908+0000 7fa6f7bda640 1 -- 172.21.15.53:0/595017011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6dc0b4ca0 msgr2=0x7fa6dc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.908+0000 7fa6f7bda640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6dc0b4ca0 0x7fa6dc0b71b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa6f007a3a0 tx=0x7fa6e0010040 comp rx=0 tx=0).stop 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.909+0000 7fa6f7bda640 1 -- 172.21.15.53:0/595017011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f0101fe0 msgr2=0x7fa6f019a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.909+0000 7fa6f7bda640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f0101fe0 0x7fa6f019a130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00e9f0 tx=0x7fa6ec00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.909+0000 7fa6f7bda640 1 -- 172.21.15.53:0/595017011 shutdown_connections 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.909+0000 7fa6f7bda640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6dc0b4ca0 0x7fa6dc0b71b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.909+0000 7fa6f7bda640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f0108270 0x7fa6f019f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.909+0000 7fa6f7bda640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f0107920 0x7fa6f019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.909+0000 7fa6f7bda640 1 --2- 172.21.15.53:0/595017011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f0101fe0 0x7fa6f019a130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.909+0000 7fa6f7bda640 1 -- 172.21.15.53:0/595017011 >> 172.21.15.53:0/595017011 conn(0x7fa6f0079d30 msgr2=0x7fa6f0105910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.909+0000 7fa6f7bda640 1 -- 172.21.15.53:0/595017011 shutdown_connections 2024-08-31T06:07:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:35.909+0000 7fa6f7bda640 1 -- 172.21.15.53:0/595017011 wait complete. 2024-08-31T06:07:35.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:35 smithi153 ceph-mon[22320]: pgmap v402: 97 pgs: 97 active+clean; 34 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-08-31T06:07:35.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 44210 3.01 MB/sec warmup 85 sec latency 14.542 ms 2024-08-31T06:07:36.701 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:07:36.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:36 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/595017011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:07:36.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:36 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/595017011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:07:36.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 44891 2.99 MB/sec warmup 86 sec latency 14.842 ms 2024-08-31T06:07:36.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:36 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/595017011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:07:36.976 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:37.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.039+0000 7fd9f04ac640 1 -- 172.21.15.53:0/1413664117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8103890 msgr2=0x7fd9e8103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.039+0000 7fd9f04ac640 1 --2- 172.21.15.53:0/1413664117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8103890 0x7fd9e8103ca0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009900 tx=0x7fd9e402a410 comp rx=0 tx=0).stop 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.040+0000 7fd9f04ac640 1 -- 172.21.15.53:0/1413664117 shutdown_connections 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.040+0000 7fd9f04ac640 1 --2- 172.21.15.53:0/1413664117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8109b10 0x7fd9e8110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.040+0000 7fd9f04ac640 1 --2- 172.21.15.53:0/1413664117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e81091c0 0x7fd9e81095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.040+0000 7fd9f04ac640 1 --2- 172.21.15.53:0/1413664117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8103890 0x7fd9e8103ca0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.040+0000 7fd9f04ac640 1 -- 172.21.15.53:0/1413664117 >> 172.21.15.53:0/1413664117 conn(0x7fd9e80ff310 msgr2=0x7fd9e8101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.040+0000 7fd9f04ac640 1 -- 172.21.15.53:0/1413664117 shutdown_connections 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.040+0000 7fd9f04ac640 1 -- 172.21.15.53:0/1413664117 wait complete. 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.040+0000 7fd9f04ac640 1 Processor -- start 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.040+0000 7fd9f04ac640 1 -- start start 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9f04ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8103890 0x7fd9e819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9f04ac640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e81091c0 0x7fd9e819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9f04ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8109b10 0x7fd9e819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9f04ac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8113670 con 0x7fd9e8109b10 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9f04ac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e81134f0 con 0x7fd9e8103890 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9f04ac640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e81137f0 con 0x7fd9e81091c0 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9ee248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8103890 0x7fd9e819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9eea49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8109b10 0x7fd9e819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9ee248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8103890 0x7fd9e819a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38528/0 (socket says 172.21.15.53:38528) 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9ee248640 1 -- 172.21.15.53:0/622090817 learned_addr learned my addr 172.21.15.53:0/622090817 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9eda47640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e81091c0 0x7fd9e819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9eea49640 1 -- 172.21.15.53:0/622090817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e81091c0 msgr2=0x7fd9e819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9eea49640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e81091c0 0x7fd9e819a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9eea49640 1 -- 172.21.15.53:0/622090817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8103890 msgr2=0x7fd9e819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9eea49640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8103890 0x7fd9e819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9eea49640 1 -- 172.21.15.53:0/622090817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e81a00e0 con 0x7fd9e8109b10 2024-08-31T06:07:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9eea49640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8109b10 0x7fd9e819f9e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009fd0 tx=0x7fd9e000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.041+0000 7fd9df7fe640 1 -- 172.21.15.53:0/622090817 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000ce20 con 0x7fd9e8109b10 2024-08-31T06:07:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.042+0000 7fd9df7fe640 1 -- 172.21.15.53:0/622090817 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9e0005020 con 0x7fd9e8109b10 2024-08-31T06:07:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.042+0000 7fd9df7fe640 1 -- 172.21.15.53:0/622090817 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0010690 con 0x7fd9e8109b10 2024-08-31T06:07:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.042+0000 7fd9f04ac640 1 -- 172.21.15.53:0/622090817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e81a03d0 con 0x7fd9e8109b10 2024-08-31T06:07:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.042+0000 7fd9f04ac640 1 -- 172.21.15.53:0/622090817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e81a6b60 con 0x7fd9e8109b10 2024-08-31T06:07:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.044+0000 7fd9df7fe640 1 -- 172.21.15.53:0/622090817 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd9e0004a40 con 0x7fd9e8109b10 2024-08-31T06:07:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9f7414740 1 Processor -- start 2024-08-31T06:07:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9f7414740 1 -- start start 2024-08-31T06:07:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 0x5566e9244ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e782f0 0x5566e9245000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8e804d0 0x5566e9245540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9f7414740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5566e91ba000 con 0x5566e8ea11b0 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9f7414740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5566e91a9590 con 0x5566e8e782f0 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9f7414740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5566e91ad540 con 0x5566e8e804d0 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9ee248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e782f0 0x5566e9245000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9eda47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 0x5566e9244ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9ee248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e782f0 0x5566e9245000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38540/0 (socket says 172.21.15.53:38540) 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9ee248640 1 -- 172.21.15.53:0/3476020243 learned_addr learned my addr 172.21.15.53:0/3476020243 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9eda47640 1 --2- 172.21.15.53:0/3476020243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 0x5566e9244ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36660/0 (socket says 172.21.15.53:36660) 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.045+0000 7fd9eda47640 1 --2- 172.21.15.53:0/3476020243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8e804d0 0x5566e9245540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.046+0000 7fd9df7fe640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d40b4ca0 0x7fd9d40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.046+0000 7fd9ee248640 1 -- 172.21.15.53:0/3476020243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8e804d0 msgr2=0x5566e9245540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.046+0000 7fd9ee248640 1 --2- 172.21.15.53:0/3476020243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8e804d0 0x5566e9245540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.046+0000 7fd9ee248640 1 -- 172.21.15.53:0/3476020243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 msgr2=0x5566e9244ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.046+0000 7fd9ee248640 1 --2- 172.21.15.53:0/3476020243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 0x5566e9244ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.046+0000 7fd9ee248640 1 -- 172.21.15.53:0/3476020243 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e8f0c790 con 0x5566e8e782f0 2024-08-31T06:07:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.046+0000 7fd9eea49640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d40b4ca0 0x7fd9d40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.046+0000 7fd9df7fe640 1 -- 172.21.15.53:0/622090817 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd9e00e5ca0 con 0x7fd9e8109b10 2024-08-31T06:07:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.046+0000 7fd9ee248640 1 --2- 172.21.15.53:0/3476020243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e782f0 0x5566e9245000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4006010 tx=0x7fd9e4031bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6cf00ee6553acdc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.046+0000 7fd9eea49640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d40b4ca0 0x7fd9d40b71b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00e34a0 tx=0x7fd9e00a0c10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.046+0000 7fd9dcbfe640 1 -- 172.21.15.53:0/3476020243 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4035070 con 0x5566e8e782f0 2024-08-31T06:07:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.047+0000 7fd9dcbfe640 1 -- 172.21.15.53:0/3476020243 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9e4040070 con 0x5566e8e782f0 2024-08-31T06:07:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.047+0000 7fd9dcbfe640 1 -- 172.21.15.53:0/3476020243 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4003a10 con 0x5566e8e782f0 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 -- 172.21.15.53:0/3476020243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e782f0 msgr2=0x5566e9245000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 --2- 172.21.15.53:0/3476020243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e782f0 0x5566e9245000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4006010 tx=0x7fd9e4031bb0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 -- 172.21.15.53:0/3476020243 shutdown_connections 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 --2- 172.21.15.53:0/3476020243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8e804d0 0x5566e9245540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 --2- 172.21.15.53:0/3476020243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e782f0 0x5566e9245000 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 --2- 172.21.15.53:0/3476020243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 0x5566e9244ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 -- 172.21.15.53:0/3476020243 >> 172.21.15.53:0/3476020243 conn(0x5566e8e95300 msgr2=0x5566e92429b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 -- 172.21.15.53:0/3476020243 shutdown_connections 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 -- 172.21.15.53:0/3476020243 wait complete. 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 -- start start 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 Processor -- start 2024-08-31T06:07:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e92506b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.048+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e9250c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8ea11b0 0x5566e925c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9f7414740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5566e90e2ab0 con 0x5566e8e782f0 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9f7414740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5566e9130680 con 0x5566e8e804d0 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9f7414740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5566e92531e0 con 0x5566e8ea11b0 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9f7414740 10 client.0 _ll_register_callbacks cb 0x5566e8eb8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9eda47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e92506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9eda47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e92506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36666/0 (socket says 172.21.15.53:36666) 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9eda47640 1 -- 172.21.15.53:0/3438569783 learned_addr learned my addr 172.21.15.53:0/3438569783 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9ee248640 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e9250c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9eda47640 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8ea11b0 0x5566e925c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9eda47640 1 -- 172.21.15.53:0/3438569783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8ea11b0 msgr2=0x5566e925c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9eda47640 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8ea11b0 0x5566e925c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9eda47640 1 -- 172.21.15.53:0/3438569783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 msgr2=0x5566e9250c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9eda47640 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e9250c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9eda47640 1 -- 172.21.15.53:0/3438569783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e8f85620 con 0x5566e8e782f0 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9eda47640 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e92506b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800b9f0 tx=0x7fd9d800b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4ebfaf1adbaced server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/3438569783 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d800fbe0 con 0x5566e8e782f0 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9f7414740 1 -- 172.21.15.53:0/3438569783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9e4040070 con 0x5566e8e782f0 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.049+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/3438569783 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd9d800fd80 con 0x5566e8e782f0 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/3438569783 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd9d801f400 con 0x5566e8e782f0 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9f7414740 10 client.16506 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9f7414740 1 -- 172.21.15.53:0/3438569783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5566e925f320 con 0x5566e8e782f0 2024-08-31T06:07:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/3438569783 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9e4040070 con 0x5566e8e782f0 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/3438569783 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd9d8027400 con 0x5566e8e782f0 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9f7414740 10 client.16506 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9f7414740 10 client.16506 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9f7414740 20 client.16506 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9f7414740 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5566e8e5fd80 0x5566e9262910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9f7414740 4 client.16506 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9f7414740 1 -- 172.21.15.53:0/3438569783 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566e91bbf50 con 0x5566e8e5fd80 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.050+0000 7fd9ee248640 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5566e8e5fd80 0x5566e9262910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.051+0000 7fd9d1ffb640 10 client.16506 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.051+0000 7fd9ee248640 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5566e8e5fd80 0x5566e9262910 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7633d396b0433024 server_cookie=ac272ec55045535e in_seq=0 out_seq=0 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/3438569783 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5566e91bbf50 con 0x5566e8e5fd80 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9d1ffb640 10 client.16506 handle_command_reply: tid=0 2024-08-31T06:07:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 1 client.16506 shutdown 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 1 -- 172.21.15.53:0/3438569783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 msgr2=0x5566e92506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e92506b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800b9f0 tx=0x7fd9d800b450 comp rx=0 tx=0).stop 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 1 -- 172.21.15.53:0/3438569783 shutdown_connections 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5566e8e5fd80 0x5566e9262910 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8ea11b0 0x5566e925c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e9250c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 1 --2- 172.21.15.53:0/3438569783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e92506b0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 1 -- 172.21.15.53:0/3438569783 >> 172.21.15.53:0/3438569783 conn(0x5566e8e95300 msgr2=0x5566e9245af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9d1ffb640 0 client.16506 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 1 -- 172.21.15.53:0/3438569783 shutdown_connections 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 1 -- 172.21.15.53:0/3438569783 wait complete. 2024-08-31T06:07:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.052+0000 7fd9f7414740 20 client.16506 trim_cache size 0 max 16384 2024-08-31T06:07:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9f7414740 1 Processor -- start 2024-08-31T06:07:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9f7414740 1 -- start start 2024-08-31T06:07:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e9246670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e924a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8ea11b0 0x5566e924d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9f7414740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e81af430 con 0x5566e8e782f0 2024-08-31T06:07:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9f7414740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e81b1030 con 0x5566e8e804d0 2024-08-31T06:07:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9f7414740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e81afb00 con 0x5566e8ea11b0 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9eda47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e9246670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9eda47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e9246670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36668/0 (socket says 172.21.15.53:36668) 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9eda47640 1 -- 172.21.15.53:0/944335878 learned_addr learned my addr 172.21.15.53:0/944335878 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.069+0000 7fd9ee248640 1 --2- 172.21.15.53:0/944335878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e924a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.070+0000 7fd9eda47640 1 --2- 172.21.15.53:0/944335878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8ea11b0 0x5566e924d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.070+0000 7fd9ee248640 1 -- 172.21.15.53:0/944335878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8ea11b0 msgr2=0x5566e924d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.070+0000 7fd9ee248640 1 --2- 172.21.15.53:0/944335878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8ea11b0 0x5566e924d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.070+0000 7fd9ee248640 1 -- 172.21.15.53:0/944335878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 msgr2=0x5566e9246670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.070+0000 7fd9ee248640 1 --2- 172.21.15.53:0/944335878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e9246670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.070+0000 7fd9ee248640 1 -- 172.21.15.53:0/944335878 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e9262e50 con 0x5566e8e804d0 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.070+0000 7fd9eda47640 1 --2- 172.21.15.53:0/944335878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e9246670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.070+0000 7fd9ee248640 1 --2- 172.21.15.53:0/944335878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e924a300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4005de0 tx=0x7fd9e402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5428b1aa26aeb610 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.070+0000 7fd9d3fff640 1 -- 172.21.15.53:0/944335878 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4035040 con 0x5566e8e804d0 2024-08-31T06:07:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.070+0000 7fd9d3fff640 1 -- 172.21.15.53:0/944335878 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9e4040030 con 0x5566e8e804d0 2024-08-31T06:07:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.070+0000 7fd9d3fff640 1 -- 172.21.15.53:0/944335878 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4045460 con 0x5566e8e804d0 2024-08-31T06:07:37.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.071+0000 7fd9f7414740 1 -- 172.21.15.53:0/944335878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 msgr2=0x5566e924a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.071+0000 7fd9f7414740 1 --2- 172.21.15.53:0/944335878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e924a300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4005de0 tx=0x7fd9e402a410 comp rx=0 tx=0).stop 2024-08-31T06:07:37.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.071+0000 7fd9f7414740 1 -- 172.21.15.53:0/944335878 shutdown_connections 2024-08-31T06:07:37.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.071+0000 7fd9f7414740 1 --2- 172.21.15.53:0/944335878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8ea11b0 0x5566e924d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.071+0000 7fd9f7414740 1 --2- 172.21.15.53:0/944335878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e924a300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.071+0000 7fd9f7414740 1 --2- 172.21.15.53:0/944335878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8e782f0 0x5566e9246670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.071+0000 7fd9f7414740 1 -- 172.21.15.53:0/944335878 >> 172.21.15.53:0/944335878 conn(0x5566e8e95300 msgr2=0x5566e9249bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.071+0000 7fd9f7414740 1 -- 172.21.15.53:0/944335878 shutdown_connections 2024-08-31T06:07:37.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.071+0000 7fd9f7414740 1 -- 172.21.15.53:0/944335878 wait complete. 2024-08-31T06:07:37.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.071+0000 7fd9f7414740 1 -- start start 2024-08-31T06:07:37.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9f7414740 1 Processor -- start 2024-08-31T06:07:37.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8e782f0 0x5566e9258dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e9256290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9f7414740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 0x5566e9256980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9f7414740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e81b08a0 con 0x5566e8ea11b0 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9f7414740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e81b01d0 con 0x5566e8e804d0 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9f7414740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e81ad410 con 0x5566e8e782f0 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9f7414740 10 client.0 _ll_register_callbacks cb 0x7fd9d8014580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9ee248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e9256290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9eda47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 0x5566e9256980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9ee248640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e9256290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38566/0 (socket says 172.21.15.53:38566) 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9ee248640 1 -- 172.21.15.53:0/2115875241 learned_addr learned my addr 172.21.15.53:0/2115875241 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9eda47640 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8e782f0 0x5566e9258dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9ee248640 1 -- 172.21.15.53:0/2115875241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8e782f0 msgr2=0x5566e9258dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9ee248640 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8e782f0 0x5566e9258dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9ee248640 1 -- 172.21.15.53:0/2115875241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 msgr2=0x5566e9256980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9ee248640 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 0x5566e9256980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9ee248640 1 -- 172.21.15.53:0/2115875241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e92cc290 con 0x5566e8e804d0 2024-08-31T06:07:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.072+0000 7fd9eda47640 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 0x5566e9256980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9ee248640 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e9256290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4005db0 tx=0x7fd9e4009810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f38caef764370600 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:07:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/2115875241 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4035040 con 0x5566e8e804d0 2024-08-31T06:07:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/2115875241 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd9e4050620 con 0x5566e8e804d0 2024-08-31T06:07:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9f7414740 1 -- 172.21.15.53:0/2115875241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9e4040030 con 0x5566e8e804d0 2024-08-31T06:07:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/2115875241 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd9e406c050 con 0x5566e8e804d0 2024-08-31T06:07:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9f7414740 10 client.25937 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9f7414740 1 -- 172.21.15.53:0/2115875241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5566e92cd370 con 0x5566e8e804d0 2024-08-31T06:07:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/2115875241 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9e4040030 con 0x5566e8e804d0 2024-08-31T06:07:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/2115875241 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd9e4055030 con 0x5566e8e804d0 2024-08-31T06:07:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9f7414740 10 client.25937 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9f7414740 10 client.25937 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9f7414740 20 client.25937 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9f7414740 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5566e8e351c0 0x5566e92cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9f7414740 4 client.25937 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:07:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.073+0000 7fd9f7414740 1 -- 172.21.15.53:0/2115875241 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5566e91b79f0 con 0x5566e8e351c0 2024-08-31T06:07:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.074+0000 7fd9eda47640 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5566e8e351c0 0x5566e92cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.074+0000 7fd9d1ffb640 10 client.25937 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.074+0000 7fd9eda47640 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5566e8e351c0 0x5566e92cf450 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c04efa1780d1a70b server_cookie=84a0fb793739ef90 in_seq=0 out_seq=0 2024-08-31T06:07:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9d1ffb640 1 -- 172.21.15.53:0/2115875241 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5566e91b79f0 con 0x5566e8e351c0 2024-08-31T06:07:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9d1ffb640 10 client.25937 handle_command_reply: tid=0 2024-08-31T06:07:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 1 client.25937 shutdown 2024-08-31T06:07:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 1 -- 172.21.15.53:0/2115875241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 msgr2=0x5566e9256290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e9256290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4005db0 tx=0x7fd9e4009810 comp rx=0 tx=0).stop 2024-08-31T06:07:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 1 -- 172.21.15.53:0/2115875241 shutdown_connections 2024-08-31T06:07:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5566e8e351c0 0x5566e92cf450 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5566e8ea11b0 0x5566e9256980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566e8e804d0 0x5566e9256290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9d1ffb640 0 client.25937 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 1 --2- 172.21.15.53:0/2115875241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5566e8e782f0 0x5566e9258dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 1 -- 172.21.15.53:0/2115875241 >> 172.21.15.53:0/2115875241 conn(0x5566e8e95300 msgr2=0x5566e9251930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 1 -- 172.21.15.53:0/2115875241 shutdown_connections 2024-08-31T06:07:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 1 -- 172.21.15.53:0/2115875241 wait complete. 2024-08-31T06:07:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.095+0000 7fd9f7414740 20 client.25937 trim_cache size 0 max 16384 2024-08-31T06:07:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:07:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:07:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:07:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:07:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 -- 172.21.15.53:0/622090817 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d40b4ca0 msgr2=0x7fd9d40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d40b4ca0 0x7fd9d40b71b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00e34a0 tx=0x7fd9e00a0c10 comp rx=0 tx=0).stop 2024-08-31T06:07:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 -- 172.21.15.53:0/622090817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8109b10 msgr2=0x7fd9e819f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8109b10 0x7fd9e819f9e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009fd0 tx=0x7fd9e000ef10 comp rx=0 tx=0).stop 2024-08-31T06:07:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 -- 172.21.15.53:0/622090817 shutdown_connections 2024-08-31T06:07:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d40b4ca0 0x7fd9d40b71b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8109b10 0x7fd9e819f9e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e81091c0 0x7fd9e819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 --2- 172.21.15.53:0/622090817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8103890 0x7fd9e819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 -- 172.21.15.53:0/622090817 >> 172.21.15.53:0/622090817 conn(0x7fd9e80ff310 msgr2=0x7fd9e8101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 -- 172.21.15.53:0/622090817 shutdown_connections 2024-08-31T06:07:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:37.096+0000 7fd9f04ac640 1 -- 172.21.15.53:0/622090817 wait complete. 2024-08-31T06:07:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.495+0000 7f9cf8679640 1 -- 172.21.15.53:0/3322388113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cf0108ab0 msgr2=0x7f9cf010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.496+0000 7f9cf8679640 1 --2- 172.21.15.53:0/3322388113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cf0108ab0 0x7f9cf010f2e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009ca0 tx=0x7f9ce802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.496+0000 7f9cf8679640 1 -- 172.21.15.53:0/3322388113 shutdown_connections 2024-08-31T06:07:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.496+0000 7f9cf8679640 1 --2- 172.21.15.53:0/3322388113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cf0108ab0 0x7f9cf010f2e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.496+0000 7f9cf8679640 1 --2- 172.21.15.53:0/3322388113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cf0108160 0x7f9cf0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.496+0000 7f9cf8679640 1 --2- 172.21.15.53:0/3322388113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf0102820 0x7f9cf0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.496+0000 7f9cf8679640 1 -- 172.21.15.53:0/3322388113 >> 172.21.15.53:0/3322388113 conn(0x7f9cf00794e0 msgr2=0x7f9cf00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.496+0000 7f9cf8679640 1 -- 172.21.15.53:0/3322388113 shutdown_connections 2024-08-31T06:07:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.496+0000 7f9cf8679640 1 -- 172.21.15.53:0/3322388113 wait complete. 2024-08-31T06:07:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf8679640 1 Processor -- start 2024-08-31T06:07:37.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf8679640 1 -- start start 2024-08-31T06:07:37.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf8679640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf0102820 0x7f9cf019af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf8679640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cf0108160 0x7f9cf019b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf8679640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cf0108ab0 0x7f9cf019ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf8679640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf0112610 con 0x7f9cf0108ab0 2024-08-31T06:07:37.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf8679640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf0112490 con 0x7f9cf0108160 2024-08-31T06:07:37.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf8679640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf0112790 con 0x7f9cf0102820 2024-08-31T06:07:37.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf6c16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cf0108ab0 0x7f9cf019ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf6c16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cf0108ab0 0x7f9cf019ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36684/0 (socket says 172.21.15.53:36684) 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf6c16640 1 -- 172.21.15.53:0/2772565051 learned_addr learned my addr 172.21.15.53:0/2772565051 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cf0108160 0x7f9cf019b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.497+0000 7f9cf6415640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf0102820 0x7f9cf019af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9cf6c16640 1 -- 172.21.15.53:0/2772565051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf0102820 msgr2=0x7f9cf019af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9cf6c16640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf0102820 0x7f9cf019af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9cf6c16640 1 -- 172.21.15.53:0/2772565051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cf0108160 msgr2=0x7f9cf019b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9cf6c16640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cf0108160 0x7f9cf019b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9cf6c16640 1 -- 172.21.15.53:0/2772565051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf01a6290 con 0x7f9cf0108ab0 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cf0108160 0x7f9cf019b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9cf6c16640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cf0108ab0 0x7f9cf019ba00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8005cc0 tx=0x7f9ce8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9ce77fe640 1 -- 172.21.15.53:0/2772565051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8032c10 con 0x7f9cf0108ab0 2024-08-31T06:07:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9cf8679640 1 -- 172.21.15.53:0/2772565051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf01a6520 con 0x7f9cf0108ab0 2024-08-31T06:07:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9ce77fe640 1 -- 172.21.15.53:0/2772565051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ce8032db0 con 0x7f9cf0108ab0 2024-08-31T06:07:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9ce77fe640 1 -- 172.21.15.53:0/2772565051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8030a60 con 0x7f9cf0108ab0 2024-08-31T06:07:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.498+0000 7f9cf8679640 1 -- 172.21.15.53:0/2772565051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf01a6ab0 con 0x7f9cf0108ab0 2024-08-31T06:07:37.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.501+0000 7f9cfebee740 1 Processor -- start 2024-08-31T06:07:37.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.501+0000 7f9ce77fe640 1 -- 172.21.15.53:0/2772565051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9ce8030c00 con 0x7f9cf0108ab0 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.501+0000 7f9cfebee740 1 -- start start 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e5b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374a8d1b0 0x563374e5b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a95390 0x563374e5bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cfebee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563374dd2680 con 0x563374ab6070 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cfebee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563374dc1c10 con 0x563374a95390 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cfebee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563374dc5bc0 con 0x563374a8d1b0 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cf5c14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e5b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cf5c14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e5b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36696/0 (socket says 172.21.15.53:36696) 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cf5c14640 1 -- 172.21.15.53:0/3594248144 learned_addr learned my addr 172.21.15.53:0/3594248144 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/3594248144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a95390 0x563374e5bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9ce77fe640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9cdc0b4ca0 0x7f9cdc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cf5c14640 1 -- 172.21.15.53:0/3594248144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374a8d1b0 msgr2=0x563374e5b890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:07:37.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/3594248144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374a8d1b0 0x563374e5b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cf5c14640 1 -- 172.21.15.53:0/3594248144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a95390 msgr2=0x563374e5bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/3594248144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a95390 0x563374e5bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.502+0000 7f9cf5c14640 1 -- 172.21.15.53:0/3594248144 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563374b21650 con 0x563374ab6070 2024-08-31T06:07:37.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.503+0000 7f9cf6c16640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9cdc0b4ca0 0x7f9cdc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.503+0000 7f9ce77fe640 1 -- 172.21.15.53:0/2772565051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f9ce8106650 con 0x7f9cf0108ab0 2024-08-31T06:07:37.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.503+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/3594248144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e5b350 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0013b50 tx=0x7f9ce0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecad9bbf40feea5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.503+0000 7f9ce4ff9640 1 -- 172.21.15.53:0/3594248144 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000fd10 con 0x563374ab6070 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.503+0000 7f9ce4ff9640 1 -- 172.21.15.53:0/3594248144 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ce00044c0 con 0x563374ab6070 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.503+0000 7f9ce4ff9640 1 -- 172.21.15.53:0/3594248144 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00035f0 con 0x563374ab6070 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.504+0000 7f9cfebee740 1 -- 172.21.15.53:0/3594248144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 msgr2=0x563374e5b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.504+0000 7f9cf6c16640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9cdc0b4ca0 0x7f9cdc0b71b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8103e50 tx=0x7f9ce8099050 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.504+0000 7f9cfebee740 1 --2- 172.21.15.53:0/3594248144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e5b350 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0013b50 tx=0x7f9ce0005850 comp rx=0 tx=0).stop 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.504+0000 7f9cfebee740 1 -- 172.21.15.53:0/3594248144 shutdown_connections 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.504+0000 7f9cfebee740 1 --2- 172.21.15.53:0/3594248144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a95390 0x563374e5bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.504+0000 7f9cfebee740 1 --2- 172.21.15.53:0/3594248144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374a8d1b0 0x563374e5b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.504+0000 7f9cfebee740 1 --2- 172.21.15.53:0/3594248144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e5b350 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.504+0000 7f9cfebee740 1 -- 172.21.15.53:0/3594248144 >> 172.21.15.53:0/3594248144 conn(0x563374aaa460 msgr2=0x563374e59240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.504+0000 7f9cfebee740 1 -- 172.21.15.53:0/3594248144 shutdown_connections 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.504+0000 7f9cfebee740 1 -- 172.21.15.53:0/3594248144 wait complete. 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cfebee740 1 -- start start 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cfebee740 1 Processor -- start 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 0x563374e66b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a95390 0x563374e67090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374ab6070 0x563374e72dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cfebee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563374c24700 con 0x563374a95390 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cfebee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563374d48750 con 0x563374a8d1b0 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cfebee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563374e69ad0 con 0x563374ab6070 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cf6415640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a95390 0x563374e67090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cfebee740 10 client.0 _ll_register_callbacks cb 0x563374d77e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cf5c14640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 0x563374e66b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cf6415640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a95390 0x563374e67090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36708/0 (socket says 172.21.15.53:36708) 2024-08-31T06:07:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cf5c14640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 0x563374e66b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38586/0 (socket says 172.21.15.53:38586) 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.505+0000 7f9cf6415640 1 -- 172.21.15.53:0/4287705122 learned_addr learned my addr 172.21.15.53:0/4287705122 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374ab6070 0x563374e72dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cf6415640 1 -- 172.21.15.53:0/4287705122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374ab6070 msgr2=0x563374e72dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cf6415640 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374ab6070 0x563374e72dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cf6415640 1 -- 172.21.15.53:0/4287705122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 msgr2=0x563374e66b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cf6415640 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 0x563374e66b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cf6415640 1 -- 172.21.15.53:0/4287705122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563374d81900 con 0x563374a95390 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 0x563374e66b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cf6415640 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a95390 0x563374e67090 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0116f0 tx=0x7f9cec011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2931340095d5f732 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/4287705122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00f920 con 0x563374a95390 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/4287705122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f9cec00fac0 con 0x563374a95390 2024-08-31T06:07:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.506+0000 7f9cfebee740 1 -- 172.21.15.53:0/4287705122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563374dd45d0 con 0x563374a95390 2024-08-31T06:07:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.507+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/4287705122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9cec00fcc0 con 0x563374a95390 2024-08-31T06:07:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.507+0000 7f9cfebee740 10 client.16524 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.507+0000 7f9cfebee740 1 -- 172.21.15.53:0/4287705122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563374e79d80 con 0x563374a95390 2024-08-31T06:07:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.507+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/4287705122 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563374dd45d0 con 0x563374a95390 2024-08-31T06:07:37.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.507+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/4287705122 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f9cec018070 con 0x563374a95390 2024-08-31T06:07:37.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.507+0000 7f9cfebee740 10 client.16524 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:37.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.507+0000 7f9cfebee740 10 client.16524 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.507+0000 7f9cfebee740 20 client.16524 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.507+0000 7f9cfebee740 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563374a749f0 0x563374e7d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.507+0000 7f9cfebee740 4 client.16524 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.507+0000 7f9cfebee740 1 -- 172.21.15.53:0/4287705122 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563374dd0070 con 0x563374a749f0 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.508+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563374a749f0 0x563374e7d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.508+0000 7f9cd9ffb640 10 client.16524 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.508+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563374a749f0 0x563374e7d260 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d8207fa91abbd008 server_cookie=3d9dfde4a89855b3 in_seq=0 out_seq=0 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/4287705122 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563374dd0070 con 0x563374a749f0 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cd9ffb640 10 client.16524 handle_command_reply: tid=0 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cfebee740 1 client.16524 shutdown 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cfebee740 1 -- 172.21.15.53:0/4287705122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a95390 msgr2=0x563374e67090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cfebee740 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a95390 0x563374e67090 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0116f0 tx=0x7f9cec011bb0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cfebee740 1 -- 172.21.15.53:0/4287705122 shutdown_connections 2024-08-31T06:07:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cfebee740 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563374a749f0 0x563374e7d260 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cfebee740 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374ab6070 0x563374e72dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cfebee740 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a95390 0x563374e67090 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cfebee740 1 --2- 172.21.15.53:0/4287705122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 0x563374e66b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cfebee740 1 -- 172.21.15.53:0/4287705122 >> 172.21.15.53:0/4287705122 conn(0x563374aaa460 msgr2=0x563374e5e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cd9ffb640 0 client.16524 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:07:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cfebee740 1 -- 172.21.15.53:0/4287705122 shutdown_connections 2024-08-31T06:07:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.509+0000 7f9cfebee740 1 -- 172.21.15.53:0/4287705122 wait complete. 2024-08-31T06:07:37.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.510+0000 7f9cfebee740 20 client.16524 trim_cache size 0 max 16384 2024-08-31T06:07:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.523+0000 7f9cfebee740 1 Processor -- start 2024-08-31T06:07:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.523+0000 7f9cfebee740 1 -- start start 2024-08-31T06:07:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 0x563374e5cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374a95390 0x563374e68760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e72cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cfebee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf01ad2c0 con 0x563374ab6070 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cfebee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf01aeec0 con 0x563374a8d1b0 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cfebee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf01ad990 con 0x563374a95390 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cf5c14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e72cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cf5c14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e72cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36714/0 (socket says 172.21.15.53:36714) 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cf5c14640 1 -- 172.21.15.53:0/2498990135 learned_addr learned my addr 172.21.15.53:0/2498990135 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/2498990135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 0x563374e5cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cf6415640 1 --2- 172.21.15.53:0/2498990135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374a95390 0x563374e68760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cf5c14640 1 -- 172.21.15.53:0/2498990135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374a95390 msgr2=0x563374e68760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/2498990135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374a95390 0x563374e68760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cf5c14640 1 -- 172.21.15.53:0/2498990135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 msgr2=0x563374e5cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/2498990135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 0x563374e5cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cf5c14640 1 -- 172.21.15.53:0/2498990135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563374e69660 con 0x563374ab6070 2024-08-31T06:07:37.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/2498990135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e72cc0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0005890 tx=0x7f9ce0015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40eccfd172cd4e9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.524+0000 7f9cdbfff640 1 -- 172.21.15.53:0/2498990135 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce002d040 con 0x563374ab6070 2024-08-31T06:07:37.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.525+0000 7f9cdbfff640 1 -- 172.21.15.53:0/2498990135 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ce0033070 con 0x563374ab6070 2024-08-31T06:07:37.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.525+0000 7f9cdbfff640 1 -- 172.21.15.53:0/2498990135 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0004680 con 0x563374ab6070 2024-08-31T06:07:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.525+0000 7f9cfebee740 1 -- 172.21.15.53:0/2498990135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 msgr2=0x563374e72cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.525+0000 7f9cfebee740 1 --2- 172.21.15.53:0/2498990135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e72cc0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0005890 tx=0x7f9ce0015040 comp rx=0 tx=0).stop 2024-08-31T06:07:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.525+0000 7f9cfebee740 1 -- 172.21.15.53:0/2498990135 shutdown_connections 2024-08-31T06:07:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.525+0000 7f9cfebee740 1 --2- 172.21.15.53:0/2498990135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374ab6070 0x563374e72cc0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.525+0000 7f9cfebee740 1 --2- 172.21.15.53:0/2498990135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374a95390 0x563374e68760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.525+0000 7f9cfebee740 1 --2- 172.21.15.53:0/2498990135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a8d1b0 0x563374e5cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.525+0000 7f9cfebee740 1 -- 172.21.15.53:0/2498990135 >> 172.21.15.53:0/2498990135 conn(0x563374aaa460 msgr2=0x563374e68050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.525+0000 7f9cfebee740 1 -- 172.21.15.53:0/2498990135 shutdown_connections 2024-08-31T06:07:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cfebee740 1 -- 172.21.15.53:0/2498990135 wait complete. 2024-08-31T06:07:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cfebee740 1 -- start start 2024-08-31T06:07:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cfebee740 1 Processor -- start 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a8d1b0 0x563374e6f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a95390 0x563374e6c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cfebee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374ab6070 0x563374e6cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cfebee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf01ae730 con 0x563374a8d1b0 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cfebee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf01ae060 con 0x563374a95390 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cfebee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf01ab2a0 con 0x563374ab6070 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cfebee740 10 client.0 _ll_register_callbacks cb 0x7f9cec0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cf5c14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a8d1b0 0x563374e6f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cf5c14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a8d1b0 0x563374e6f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36726/0 (socket says 172.21.15.53:36726) 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cf5c14640 1 -- 172.21.15.53:0/3977287066 learned_addr learned my addr 172.21.15.53:0/3977287066 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.526+0000 7f9cf6415640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a95390 0x563374e6c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.527+0000 7f9cf5c14640 1 -- 172.21.15.53:0/3977287066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374ab6070 msgr2=0x563374e6cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.527+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374ab6070 0x563374e6cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.527+0000 7f9cf5c14640 1 -- 172.21.15.53:0/3977287066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a95390 msgr2=0x563374e6c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.527+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a95390 0x563374e6c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.527+0000 7f9cf5c14640 1 -- 172.21.15.53:0/3977287066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563374e6d2f0 con 0x563374a8d1b0 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.527+0000 7f9cf6415640 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a95390 0x563374e6c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.527+0000 7f9cf5c14640 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a8d1b0 0x563374e6f320 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9ce001d040 tx=0x7f9ce0005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f416e6b1c6af91f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.527+0000 7f9cd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.527+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/3977287066 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce003c060 con 0x563374a8d1b0 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.527+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/3977287066 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f9ce000fd10 con 0x563374a8d1b0 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.527+0000 7f9cfebee740 1 -- 172.21.15.53:0/3977287066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ce0033070 con 0x563374a8d1b0 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/3977287066 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9ce0005070 con 0x563374a8d1b0 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cfebee740 10 client.16530 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cfebee740 1 -- 172.21.15.53:0/3977287066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563374ee79c0 con 0x563374a8d1b0 2024-08-31T06:07:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/3977287066 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ce0033070 con 0x563374a8d1b0 2024-08-31T06:07:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/3977287066 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f9ce0004680 con 0x563374a8d1b0 2024-08-31T06:07:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cfebee740 10 client.16530 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cfebee740 10 client.16530 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:07:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cfebee740 20 client.16530 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cfebee740 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563374a49da0 0x563374ee9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cfebee740 4 client.16530 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:07:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cfebee740 1 -- 172.21.15.53:0/3977287066 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563374dcd7b0 con 0x563374a49da0 2024-08-31T06:07:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.528+0000 7f9cf6415640 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563374a49da0 0x563374ee9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cd9ffb640 10 client.16530 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:07:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cf6415640 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563374a49da0 0x563374ee9f30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3fc7e04137891c28 server_cookie=7c87e2e2886344f4 in_seq=0 out_seq=0 2024-08-31T06:07:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cd9ffb640 1 -- 172.21.15.53:0/3977287066 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563374dcd7b0 con 0x563374a49da0 2024-08-31T06:07:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cd9ffb640 10 client.16530 handle_command_reply: tid=0 2024-08-31T06:07:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 1 client.16530 shutdown 2024-08-31T06:07:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 1 -- 172.21.15.53:0/3977287066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a8d1b0 msgr2=0x563374e6f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a8d1b0 0x563374e6f320 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9ce001d040 tx=0x7f9ce0005c40 comp rx=0 tx=0).stop 2024-08-31T06:07:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 1 -- 172.21.15.53:0/3977287066 shutdown_connections 2024-08-31T06:07:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x563374a49da0 0x563374ee9f30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563374ab6070 0x563374e6cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563374a95390 0x563374e6c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cd9ffb640 0 client.16530 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:07:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 1 --2- 172.21.15.53:0/3977287066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563374a8d1b0 0x563374e6f320 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 1 -- 172.21.15.53:0/3977287066 >> 172.21.15.53:0/3977287066 conn(0x563374aaa460 msgr2=0x563374e5cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 1 -- 172.21.15.53:0/3977287066 shutdown_connections 2024-08-31T06:07:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 1 -- 172.21.15.53:0/3977287066 wait complete. 2024-08-31T06:07:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.529+0000 7f9cfebee740 20 client.16530 trim_cache size 0 max 16384 2024-08-31T06:07:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:07:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 -- 172.21.15.53:0/2772565051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9cdc0b4ca0 msgr2=0x7f9cdc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9cdc0b4ca0 0x7f9cdc0b71b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8103e50 tx=0x7f9ce8099050 comp rx=0 tx=0).stop 2024-08-31T06:07:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 -- 172.21.15.53:0/2772565051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cf0108ab0 msgr2=0x7f9cf019ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cf0108ab0 0x7f9cf019ba00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8005cc0 tx=0x7f9ce8003f90 comp rx=0 tx=0).stop 2024-08-31T06:07:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 -- 172.21.15.53:0/2772565051 shutdown_connections 2024-08-31T06:07:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9cdc0b4ca0 0x7f9cdc0b71b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cf0108ab0 0x7f9cf019ba00 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cf0108160 0x7f9cf019b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 --2- 172.21.15.53:0/2772565051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9cf0102820 0x7f9cf019af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:37.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 -- 172.21.15.53:0/2772565051 >> 172.21.15.53:0/2772565051 conn(0x7f9cf00794e0 msgr2=0x7f9cf01050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:37.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 -- 172.21.15.53:0/2772565051 shutdown_connections 2024-08-31T06:07:37.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:37.530+0000 7f9cf8679640 1 -- 172.21.15.53:0/2772565051 wait complete. 2024-08-31T06:07:37.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:37 smithi053 ceph-mon[18924]: pgmap v403: 97 pgs: 97 active+clean; 35 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-08-31T06:07:37.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:37 smithi130 ceph-mon[22266]: pgmap v403: 97 pgs: 97 active+clean; 35 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-08-31T06:07:37.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:37 smithi153 ceph-mon[22320]: pgmap v403: 97 pgs: 97 active+clean; 35 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-08-31T06:07:37.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 45348 3.01 MB/sec warmup 87 sec latency 68.193 ms 2024-08-31T06:07:38.239 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:07:38.511 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:38.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 45916 3.01 MB/sec warmup 88 sec latency 15.341 ms 2024-08-31T06:07:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.037+0000 7f13ff2c7640 1 -- 172.21.15.53:0/3183975267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13f8102840 msgr2=0x7f13f8102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.037+0000 7f13ff2c7640 1 --2- 172.21.15.53:0/3183975267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13f8102840 0x7f13f8102c50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009900 tx=0x7f13f402a410 comp rx=0 tx=0).stop 2024-08-31T06:07:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.037+0000 7f13ff2c7640 1 -- 172.21.15.53:0/3183975267 shutdown_connections 2024-08-31T06:07:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.037+0000 7f13ff2c7640 1 --2- 172.21.15.53:0/3183975267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13f8108ad0 0x7f13f810f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.037+0000 7f13ff2c7640 1 --2- 172.21.15.53:0/3183975267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13f8108180 0x7f13f8108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.037+0000 7f13ff2c7640 1 --2- 172.21.15.53:0/3183975267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13f8102840 0x7f13f8102c50 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.037+0000 7f13ff2c7640 1 -- 172.21.15.53:0/3183975267 >> 172.21.15.53:0/3183975267 conn(0x7f13f80794f0 msgr2=0x7f13f8079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.037+0000 7f13ff2c7640 1 -- 172.21.15.53:0/3183975267 shutdown_connections 2024-08-31T06:07:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.037+0000 7f13ff2c7640 1 -- 172.21.15.53:0/3183975267 wait complete. 2024-08-31T06:07:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.038+0000 7f13ff2c7640 1 Processor -- start 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.038+0000 7f13ff2c7640 1 -- start start 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13ff2c7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13f8102840 0x7f13f8199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13ff2c7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13f8108180 0x7f13f8199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13ff2c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13f8108ad0 0x7f13f819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13ff2c7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13f8112650 con 0x7f13f8108ad0 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13ff2c7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13f81124d0 con 0x7f13f8108180 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13ff2c7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13f81127d0 con 0x7f13f8102840 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13fd864640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13f8108ad0 0x7f13f819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13fd864640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13f8108ad0 0x7f13f819e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36754/0 (socket says 172.21.15.53:36754) 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13fd864640 1 -- 172.21.15.53:0/274500547 learned_addr learned my addr 172.21.15.53:0/274500547 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13fc862640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13f8108180 0x7f13f8199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13fd063640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13f8102840 0x7f13f8199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13fd864640 1 -- 172.21.15.53:0/274500547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13f8102840 msgr2=0x7f13f8199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13fd864640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13f8102840 0x7f13f8199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13fd864640 1 -- 172.21.15.53:0/274500547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13f8108180 msgr2=0x7f13f8199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13fd864640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13f8108180 0x7f13f8199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.039+0000 7f13fd864640 1 -- 172.21.15.53:0/274500547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f819efd0 con 0x7f13f8108ad0 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.040+0000 7f13fd864640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13f8108ad0 0x7f13f819e8a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f13f000eaa0 tx=0x7f13f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.040+0000 7f13ee7fc640 1 -- 172.21.15.53:0/274500547 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f000cdb0 con 0x7f13f8108ad0 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.040+0000 7f13ee7fc640 1 -- 172.21.15.53:0/274500547 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13f0005020 con 0x7f13f8108ad0 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.040+0000 7f13ee7fc640 1 -- 172.21.15.53:0/274500547 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f00116d0 con 0x7f13f8108ad0 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.040+0000 7f13ff2c7640 1 -- 172.21.15.53:0/274500547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f819f2c0 con 0x7f13f8108ad0 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.040+0000 7f13ff2c7640 1 -- 172.21.15.53:0/274500547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f81a5a20 con 0x7f13f8108ad0 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.043+0000 7f140583c740 1 Processor -- start 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.043+0000 7f13ee7fc640 1 -- 172.21.15.53:0/274500547 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f13f00051d0 con 0x7f13f8108ad0 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.043+0000 7f140583c740 1 -- start start 2024-08-31T06:07:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.043+0000 7f140583c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.043+0000 7f140583c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275eb1b0 0x5611279b9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.043+0000 7f140583c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 0x5611279b9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.043+0000 7f140583c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561127930680 con 0x5611275f3390 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.043+0000 7f140583c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56112791fc10 con 0x561127614070 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.043+0000 7f140583c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561127923bc0 con 0x5611275eb1b0 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fc862640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fc862640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 0x5611279b9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fd063640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275eb1b0 0x5611279b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fc862640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 0x5611279b9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36760/0 (socket says 172.21.15.53:36760) 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fd063640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275eb1b0 0x5611279b9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50872/0 (socket says 172.21.15.53:50872) 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fc862640 1 -- 172.21.15.53:0/3515254853 learned_addr learned my addr 172.21.15.53:0/3515254853 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fc862640 1 -- 172.21.15.53:0/3515254853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275eb1b0 msgr2=0x5611279b9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fc862640 1 --2- 172.21.15.53:0/3515254853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275eb1b0 0x5611279b9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fc862640 1 -- 172.21.15.53:0/3515254853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 msgr2=0x5611279b9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fc862640 1 --2- 172.21.15.53:0/3515254853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279b9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fc862640 1 -- 172.21.15.53:0/3515254853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56112767f650 con 0x5611275f3390 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13ee7fc640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13e40b4ca0 0x7f13e40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fd063640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13e40b4ca0 0x7f13e40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13fc862640 1 --2- 172.21.15.53:0/3515254853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 0x5611279b9dd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f13e8010900 tx=0x7f13e8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e9893e64bf07c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.044+0000 7f13ee7fc640 1 -- 172.21.15.53:0/274500547 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f13f00e5680 con 0x7f13f8108ad0 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.045+0000 7f13e37fe640 1 -- 172.21.15.53:0/3515254853 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8016030 con 0x5611275f3390 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.045+0000 7f13e37fe640 1 -- 172.21.15.53:0/3515254853 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13e800fe50 con 0x5611275f3390 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.045+0000 7f13e37fe640 1 -- 172.21.15.53:0/3515254853 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8019040 con 0x5611275f3390 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f140583c740 1 -- 172.21.15.53:0/3515254853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 msgr2=0x5611279b9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f13fd063640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13e40b4ca0 0x7f13e40b71b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f13f40057c0 tx=0x7f13f40058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f140583c740 1 --2- 172.21.15.53:0/3515254853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 0x5611279b9dd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f13e8010900 tx=0x7f13e8005f90 comp rx=0 tx=0).stop 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f140583c740 1 -- 172.21.15.53:0/3515254853 shutdown_connections 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f140583c740 1 --2- 172.21.15.53:0/3515254853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 0x5611279b9dd0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f140583c740 1 --2- 172.21.15.53:0/3515254853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275eb1b0 0x5611279b9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f140583c740 1 --2- 172.21.15.53:0/3515254853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279b9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f140583c740 1 -- 172.21.15.53:0/3515254853 >> 172.21.15.53:0/3515254853 conn(0x561127608460 msgr2=0x5611279b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f140583c740 1 -- 172.21.15.53:0/3515254853 shutdown_connections 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f140583c740 1 -- 172.21.15.53:0/3515254853 wait complete. 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f140583c740 1 -- start start 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.046+0000 7f140583c740 1 Processor -- start 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f140583c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f140583c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275f3390 0x5611279c8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f140583c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f140583c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561127782700 con 0x5611275eb1b0 2024-08-31T06:07:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f140583c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5611278a6750 con 0x561127614070 2024-08-31T06:07:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f140583c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5611279c7b30 con 0x5611275f3390 2024-08-31T06:07:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f140583c740 10 client.0 _ll_register_callbacks cb 0x5611278d5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13fd063640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13fd063640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36770/0 (socket says 172.21.15.53:36770) 2024-08-31T06:07:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13fd063640 1 -- 172.21.15.53:0/2650487256 learned_addr learned my addr 172.21.15.53:0/2650487256 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13fd864640 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13fc862640 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275f3390 0x5611279c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13fd063640 1 -- 172.21.15.53:0/2650487256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275f3390 msgr2=0x5611279c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13fd063640 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275f3390 0x5611279c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13fd063640 1 -- 172.21.15.53:0/2650487256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 msgr2=0x5611279d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13fd063640 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279d2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13fd063640 1 -- 172.21.15.53:0/2650487256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611278df900 con 0x5611275eb1b0 2024-08-31T06:07:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13fd063640 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c7fc0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f13f4006010 tx=0x7f13f4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3be0b5eb4c4b29e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.047+0000 7f13e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2650487256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4035040 con 0x5611275eb1b0 2024-08-31T06:07:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2650487256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f13f40043d0 con 0x5611275eb1b0 2024-08-31T06:07:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f140583c740 1 -- 172.21.15.53:0/2650487256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13e800fe50 con 0x5611275eb1b0 2024-08-31T06:07:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2650487256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f13f40035f0 con 0x5611275eb1b0 2024-08-31T06:07:39.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f140583c740 10 client.16542 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:39.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f140583c740 1 -- 172.21.15.53:0/2650487256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5611279d5b70 con 0x5611275eb1b0 2024-08-31T06:07:39.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2650487256 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13e800fe50 con 0x5611275eb1b0 2024-08-31T06:07:39.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2650487256 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f13f4044030 con 0x5611275eb1b0 2024-08-31T06:07:39.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f140583c740 10 client.16542 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:39.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f140583c740 10 client.16542 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:07:39.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f140583c740 20 client.16542 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:39.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f140583c740 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5611275d29f0 0x5611279d9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f140583c740 4 client.16542 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:39.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.048+0000 7f140583c740 1 -- 172.21.15.53:0/2650487256 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611279325d0 con 0x5611275d29f0 2024-08-31T06:07:39.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.049+0000 7f13fc862640 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5611275d29f0 0x5611279d9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.049+0000 7f13fc862640 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5611275d29f0 0x5611279d9080 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a49c48340e223112 server_cookie=2079f17049ccbefc in_seq=0 out_seq=0 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.049+0000 7f13e0ff9640 10 client.16542 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2650487256 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5611279325d0 con 0x5611275d29f0 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f13e0ff9640 10 client.16542 handle_command_reply: tid=0 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 1 client.16542 shutdown 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 1 -- 172.21.15.53:0/2650487256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 msgr2=0x5611279c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c7fc0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f13f4006010 tx=0x7f13f4009260 comp rx=0 tx=0).stop 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 1 -- 172.21.15.53:0/2650487256 shutdown_connections 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279d2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275f3390 0x5611279c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5611275d29f0 0x5611279d9080 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 1 --2- 172.21.15.53:0/2650487256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c7fc0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f13e0ff9640 0 client.16542 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:07:39.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 1 -- 172.21.15.53:0/2650487256 >> 172.21.15.53:0/2650487256 conn(0x561127608460 msgr2=0x5611279bc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:39.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 1 -- 172.21.15.53:0/2650487256 shutdown_connections 2024-08-31T06:07:39.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 1 -- 172.21.15.53:0/2650487256 wait complete. 2024-08-31T06:07:39.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.050+0000 7f140583c740 20 client.16542 trim_cache size 0 max 16384 2024-08-31T06:07:39.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.064+0000 7f140583c740 1 Processor -- start 2024-08-31T06:07:39.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.064+0000 7f140583c740 1 -- start start 2024-08-31T06:07:39.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.064+0000 7f140583c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.064+0000 7f140583c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275f3390 0x5611279bc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.064+0000 7f140583c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279bc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.064+0000 7f140583c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13f81ad1c0 con 0x5611275eb1b0 2024-08-31T06:07:39.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.064+0000 7f140583c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13f81aedc0 con 0x561127614070 2024-08-31T06:07:39.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.064+0000 7f140583c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13f81ad890 con 0x5611275f3390 2024-08-31T06:07:39.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13fd063640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13fd063640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36786/0 (socket says 172.21.15.53:36786) 2024-08-31T06:07:39.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13fd063640 1 -- 172.21.15.53:0/3146568221 learned_addr learned my addr 172.21.15.53:0/3146568221 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:39.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13fd864640 1 --2- 172.21.15.53:0/3146568221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13fc862640 1 --2- 172.21.15.53:0/3146568221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275f3390 0x5611279bc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13fd063640 1 -- 172.21.15.53:0/3146568221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275f3390 msgr2=0x5611279bc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:39.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13fd063640 1 --2- 172.21.15.53:0/3146568221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275f3390 0x5611279bc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13fd063640 1 -- 172.21.15.53:0/3146568221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 msgr2=0x5611279bc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:39.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13fd063640 1 --2- 172.21.15.53:0/3146568221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279bc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13fd063640 1 -- 172.21.15.53:0/3146568221 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611279bb640 con 0x5611275eb1b0 2024-08-31T06:07:39.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13fd063640 1 --2- 172.21.15.53:0/3146568221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c2640 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f13f40509d0 tx=0x7f13f402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e61b85fc9a456c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:39.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13e2ffd640 1 -- 172.21.15.53:0/3146568221 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4035040 con 0x5611275eb1b0 2024-08-31T06:07:39.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13e2ffd640 1 -- 172.21.15.53:0/3146568221 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13f404b070 con 0x5611275eb1b0 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.065+0000 7f13e2ffd640 1 -- 172.21.15.53:0/3146568221 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4003d10 con 0x5611275eb1b0 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.066+0000 7f140583c740 1 -- 172.21.15.53:0/3146568221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 msgr2=0x5611279c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.066+0000 7f140583c740 1 --2- 172.21.15.53:0/3146568221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c2640 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f13f40509d0 tx=0x7f13f402a410 comp rx=0 tx=0).stop 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.066+0000 7f140583c740 1 -- 172.21.15.53:0/3146568221 shutdown_connections 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.066+0000 7f140583c740 1 --2- 172.21.15.53:0/3146568221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561127614070 0x5611279bc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.066+0000 7f140583c740 1 --2- 172.21.15.53:0/3146568221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611275f3390 0x5611279bc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.066+0000 7f140583c740 1 --2- 172.21.15.53:0/3146568221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275eb1b0 0x5611279c2640 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.066+0000 7f140583c740 1 -- 172.21.15.53:0/3146568221 >> 172.21.15.53:0/3146568221 conn(0x561127608460 msgr2=0x5611279c1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.066+0000 7f140583c740 1 -- 172.21.15.53:0/3146568221 shutdown_connections 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.066+0000 7f140583c740 1 -- 172.21.15.53:0/3146568221 wait complete. 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.067+0000 7f140583c740 1 -- start start 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.067+0000 7f140583c740 1 Processor -- start 2024-08-31T06:07:39.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.067+0000 7f140583c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611275eb1b0 0x5611279ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.067+0000 7f140583c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 0x5611279ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.067+0000 7f140583c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561127614070 0x561127a3ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.067+0000 7f140583c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13f81ae630 con 0x5611275f3390 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.067+0000 7f140583c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13f81adf60 con 0x5611275eb1b0 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.067+0000 7f140583c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13f81ab1a0 con 0x561127614070 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.067+0000 7f140583c740 10 client.0 _ll_register_callbacks cb 0x7f13f4031440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fd864640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561127614070 0x561127a3ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fc862640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 0x5611279ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fd063640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611275eb1b0 0x5611279ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fd864640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561127614070 0x561127a3ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50900/0 (socket says 172.21.15.53:50900) 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fd864640 1 -- 172.21.15.53:0/2369579796 learned_addr learned my addr 172.21.15.53:0/2369579796 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fd063640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611275eb1b0 0x5611279ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38636/0 (socket says 172.21.15.53:38636) 2024-08-31T06:07:39.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fd864640 1 -- 172.21.15.53:0/2369579796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611275eb1b0 msgr2=0x5611279ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fd864640 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611275eb1b0 0x5611279ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fd864640 1 -- 172.21.15.53:0/2369579796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 msgr2=0x5611279ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fd864640 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 0x5611279ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fd864640 1 -- 172.21.15.53:0/2369579796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561127a3ef60 con 0x561127614070 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fc862640 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 0x5611279ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13fd864640 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561127614070 0x561127a3ea20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13f00abac0 tx=0x7f13f00e54e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7cc62bc179e7e3f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.068+0000 7f13e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2369579796 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0097070 con 0x561127614070 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f140583c740 1 -- 172.21.15.53:0/2369579796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13f404b070 con 0x561127614070 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2369579796 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f13f00e2ff0 con 0x561127614070 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2369579796 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f13f001f040 con 0x561127614070 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f140583c740 10 client.25963 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:39.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f140583c740 1 -- 172.21.15.53:0/2369579796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561127a464e0 con 0x561127614070 2024-08-31T06:07:39.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2369579796 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13f404b070 con 0x561127614070 2024-08-31T06:07:39.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2369579796 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f13f000f040 con 0x561127614070 2024-08-31T06:07:39.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f140583c740 10 client.25963 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:39.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f140583c740 10 client.25963 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:07:39.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f140583c740 20 client.25963 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:39.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f140583c740 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5611275a7da0 0x561127a48ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:39.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f140583c740 4 client.25963 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:07:39.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f140583c740 1 -- 172.21.15.53:0/2369579796 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56112792e070 con 0x5611275a7da0 2024-08-31T06:07:39.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.069+0000 7f13fd063640 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5611275a7da0 0x561127a48ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:39.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.070+0000 7f13fd063640 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5611275a7da0 0x561127a48ca0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a50de738535934ae server_cookie=85e6a40bba9fa2b7 in_seq=0 out_seq=0 2024-08-31T06:07:39.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.070+0000 7f13e0ff9640 10 client.25963 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:07:39.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f13e0ff9640 1 -- 172.21.15.53:0/2369579796 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56112792e070 con 0x5611275a7da0 2024-08-31T06:07:39.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f13e0ff9640 10 client.25963 handle_command_reply: tid=0 2024-08-31T06:07:39.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 1 client.25963 shutdown 2024-08-31T06:07:39.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 1 -- 172.21.15.53:0/2369579796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561127614070 msgr2=0x561127a3ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561127614070 0x561127a3ea20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13f00abac0 tx=0x7f13f00e54e0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 1 -- 172.21.15.53:0/2369579796 shutdown_connections 2024-08-31T06:07:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561127614070 0x561127a3ea20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5611275a7da0 0x561127a48ca0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611275f3390 0x5611279ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 1 --2- 172.21.15.53:0/2369579796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611275eb1b0 0x5611279ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f13e0ff9640 0 client.25963 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:07:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 1 -- 172.21.15.53:0/2369579796 >> 172.21.15.53:0/2369579796 conn(0x561127608460 msgr2=0x5611279bc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 1 -- 172.21.15.53:0/2369579796 shutdown_connections 2024-08-31T06:07:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 1 -- 172.21.15.53:0/2369579796 wait complete. 2024-08-31T06:07:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.071+0000 7f140583c740 20 client.25963 trim_cache size 0 max 16384 2024-08-31T06:07:39.081 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:07:39.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 -- 172.21.15.53:0/274500547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13e40b4ca0 msgr2=0x7f13e40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:39.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13e40b4ca0 0x7f13e40b71b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f13f40057c0 tx=0x7f13f40058d0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 -- 172.21.15.53:0/274500547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13f8108ad0 msgr2=0x7f13f819e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:39.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13f8108ad0 0x7f13f819e8a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f13f000eaa0 tx=0x7f13f000ef60 comp rx=0 tx=0).stop 2024-08-31T06:07:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 -- 172.21.15.53:0/274500547 shutdown_connections 2024-08-31T06:07:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13e40b4ca0 0x7f13e40b71b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13f8108ad0 0x7f13f819e8a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13f8108180 0x7f13f8199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 --2- 172.21.15.53:0/274500547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13f8102840 0x7f13f8199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 -- 172.21.15.53:0/274500547 >> 172.21.15.53:0/274500547 conn(0x7f13f80794f0 msgr2=0x7f13f8106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 -- 172.21.15.53:0/274500547 shutdown_connections 2024-08-31T06:07:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:39.072+0000 7f13ff2c7640 1 -- 172.21.15.53:0/274500547 wait complete. 2024-08-31T06:07:39.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:39 smithi130 ceph-mon[22266]: pgmap v404: 97 pgs: 97 active+clean; 35 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.2 MiB/s wr, 155 op/s 2024-08-31T06:07:39.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:39 smithi153 ceph-mon[22320]: pgmap v404: 97 pgs: 97 active+clean; 35 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.2 MiB/s wr, 155 op/s 2024-08-31T06:07:39.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 46380 3.03 MB/sec warmup 89 sec latency 14.732 ms 2024-08-31T06:07:39.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:39 smithi053 ceph-mon[18924]: pgmap v404: 97 pgs: 97 active+clean; 35 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.2 MiB/s wr, 155 op/s 2024-08-31T06:07:40.084 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:07:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:40.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.888+0000 7f59523a3640 1 -- 172.21.15.53:0/2093375804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f594c10dbb0 msgr2=0x7f594c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:40.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.888+0000 7f59523a3640 1 --2- 172.21.15.53:0/2093375804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f594c10dbb0 0x7f594c1100a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5944009ca0 tx=0x7f594402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.888+0000 7f59523a3640 1 -- 172.21.15.53:0/2093375804 shutdown_connections 2024-08-31T06:07:40.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.888+0000 7f59523a3640 1 --2- 172.21.15.53:0/2093375804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f594c10dbb0 0x7f594c1100a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.888+0000 7f59523a3640 1 --2- 172.21.15.53:0/2093375804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f594c1050a0 0x7f594c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.888+0000 7f59523a3640 1 --2- 172.21.15.53:0/2093375804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f594c104750 0x7f594c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.888+0000 7f59523a3640 1 -- 172.21.15.53:0/2093375804 >> 172.21.15.53:0/2093375804 conn(0x7f594c0794d0 msgr2=0x7f594c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:40.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.888+0000 7f59523a3640 1 -- 172.21.15.53:0/2093375804 shutdown_connections 2024-08-31T06:07:40.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.888+0000 7f59523a3640 1 -- 172.21.15.53:0/2093375804 wait complete. 2024-08-31T06:07:40.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.888+0000 7f59523a3640 1 Processor -- start 2024-08-31T06:07:40.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f59523a3640 1 -- start start 2024-08-31T06:07:40.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f59523a3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f594c104750 0x7f594c19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f59523a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f594c1050a0 0x7f594c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f59523a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f594c10dbb0 0x7f594c19f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f59523a3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f594c113710 con 0x7f594c10dbb0 2024-08-31T06:07:40.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f59523a3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f594c113590 con 0x7f594c1050a0 2024-08-31T06:07:40.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f59523a3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f594c113890 con 0x7f594c104750 2024-08-31T06:07:40.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f5950940640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f594c10dbb0 0x7f594c19f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f5950940640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f594c10dbb0 0x7f594c19f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36814/0 (socket says 172.21.15.53:36814) 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f5950940640 1 -- 172.21.15.53:0/645648488 learned_addr learned my addr 172.21.15.53:0/645648488 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f5943fff640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f594c1050a0 0x7f594c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.889+0000 7f594bfff640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f594c104750 0x7f594c19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f5943fff640 1 -- 172.21.15.53:0/645648488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f594c104750 msgr2=0x7f594c19a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f5943fff640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f594c104750 0x7f594c19a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f5943fff640 1 -- 172.21.15.53:0/645648488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f594c10dbb0 msgr2=0x7f594c19f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f5943fff640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f594c10dbb0 0x7f594c19f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f5943fff640 1 -- 172.21.15.53:0/645648488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594c19ffb0 con 0x7f594c1050a0 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f5950940640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f594c10dbb0 0x7f594c19f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f5943fff640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f594c1050a0 0x7f594c19a6a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f594c06aad0 tx=0x7f593400cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f5949ffb640 1 -- 172.21.15.53:0/645648488 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934007bb0 con 0x7f594c1050a0 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f59523a3640 1 -- 172.21.15.53:0/645648488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594c1a02a0 con 0x7f594c1050a0 2024-08-31T06:07:40.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f5949ffb640 1 -- 172.21.15.53:0/645648488 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5934007d50 con 0x7f594c1050a0 2024-08-31T06:07:40.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f5949ffb640 1 -- 172.21.15.53:0/645648488 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934018660 con 0x7f594c1050a0 2024-08-31T06:07:40.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.890+0000 7f59523a3640 1 -- 172.21.15.53:0/645648488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594c1a6ac0 con 0x7f594c1050a0 2024-08-31T06:07:40.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.893+0000 7f5949ffb640 1 -- 172.21.15.53:0/645648488 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f593400f450 con 0x7f594c1050a0 2024-08-31T06:07:40.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.893+0000 7f5958918740 1 Processor -- start 2024-08-31T06:07:40.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.893+0000 7f5958918740 1 -- start start 2024-08-31T06:07:40.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.893+0000 7f5958918740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 0x560359489310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.893+0000 7f5958918740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590bb1b0 0x560359489850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.893+0000 7f5958918740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590c3390 0x560359489d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.893+0000 7f5958918740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560359400680 con 0x5603590bb1b0 2024-08-31T06:07:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.893+0000 7f5958918740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5603593efc10 con 0x5603590e4070 2024-08-31T06:07:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.893+0000 7f5958918740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5603593f3bc0 con 0x5603590c3390 2024-08-31T06:07:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5949ffb640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f59380b4cd0 0x7f59380b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5950940640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 0x560359489310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5950940640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 0x560359489310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38672/0 (socket says 172.21.15.53:38672) 2024-08-31T06:07:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5950940640 1 -- 172.21.15.53:0/4254772297 learned_addr learned my addr 172.21.15.53:0/4254772297 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f594bfff640 1 --2- 172.21.15.53:0/4254772297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590bb1b0 0x560359489850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5943fff640 1 --2- 172.21.15.53:0/4254772297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590c3390 0x560359489d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5950940640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f59380b4cd0 0x7f59380b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5949ffb640 1 -- 172.21.15.53:0/645648488 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f59340e5500 con 0x7f594c1050a0 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5950940640 1 -- 172.21.15.53:0/4254772297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590c3390 msgr2=0x560359489d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5950940640 1 --2- 172.21.15.53:0/4254772297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590c3390 0x560359489d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5950940640 1 -- 172.21.15.53:0/4254772297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590bb1b0 msgr2=0x560359489850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5950940640 1 --2- 172.21.15.53:0/4254772297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590bb1b0 0x560359489850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5950940640 1 -- 172.21.15.53:0/4254772297 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56035914f650 con 0x5603590e4070 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5943fff640 1 --2- 172.21.15.53:0/4254772297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590c3390 0x560359489d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.894+0000 7f5950940640 1 --2- 172.21.15.53:0/4254772297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 0x560359489310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5944004af0 tx=0x7f5944031ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3110e9fc56a08e1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.895+0000 7f59427fc640 1 -- 172.21.15.53:0/4254772297 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944004d40 con 0x5603590e4070 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.895+0000 7f5950940640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f59380b4cd0 0x7f59380b71e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f594404e000 tx=0x7f594404b030 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:40.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.895+0000 7f59427fc640 1 -- 172.21.15.53:0/4254772297 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5944036070 con 0x5603590e4070 2024-08-31T06:07:40.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.895+0000 7f59427fc640 1 -- 172.21.15.53:0/4254772297 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59440308e0 con 0x5603590e4070 2024-08-31T06:07:40.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.896+0000 7f5958918740 1 -- 172.21.15.53:0/4254772297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 msgr2=0x560359489310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:40.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.896+0000 7f5958918740 1 --2- 172.21.15.53:0/4254772297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 0x560359489310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5944004af0 tx=0x7f5944031ef0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.896+0000 7f5958918740 1 -- 172.21.15.53:0/4254772297 shutdown_connections 2024-08-31T06:07:40.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.896+0000 7f5958918740 1 --2- 172.21.15.53:0/4254772297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590c3390 0x560359489d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.896+0000 7f5958918740 1 --2- 172.21.15.53:0/4254772297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590bb1b0 0x560359489850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.896+0000 7f5958918740 1 --2- 172.21.15.53:0/4254772297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 0x560359489310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.896+0000 7f5958918740 1 -- 172.21.15.53:0/4254772297 >> 172.21.15.53:0/4254772297 conn(0x5603590d8460 msgr2=0x560359487200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:40.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.896+0000 7f5958918740 1 -- 172.21.15.53:0/4254772297 shutdown_connections 2024-08-31T06:07:40.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.896+0000 7f5958918740 1 -- 172.21.15.53:0/4254772297 wait complete. 2024-08-31T06:07:40.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.896+0000 7f5958918740 1 -- start start 2024-08-31T06:07:40.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.896+0000 7f5958918740 1 Processor -- start 2024-08-31T06:07:40.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5958918740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590bb1b0 0x560359498eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5958918740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5958918740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 0x5603594a5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5958918740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560359252700 con 0x5603590c3390 2024-08-31T06:07:40.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5958918740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560359376750 con 0x5603590bb1b0 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5958918740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56035949bcd0 con 0x5603590e4070 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5958918740 10 client.0 _ll_register_callbacks cb 0x5603593a5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5950940640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 0x5603594a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f594bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590bb1b0 0x560359498eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5943fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5950940640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 0x5603594a5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50918/0 (socket says 172.21.15.53:50918) 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5950940640 1 -- 172.21.15.53:0/540095263 learned_addr learned my addr 172.21.15.53:0/540095263 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f594bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590bb1b0 0x560359498eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38680/0 (socket says 172.21.15.53:38680) 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5950940640 1 -- 172.21.15.53:0/540095263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590bb1b0 msgr2=0x560359498eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5950940640 1 --2- 172.21.15.53:0/540095263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590bb1b0 0x560359498eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5950940640 1 -- 172.21.15.53:0/540095263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 msgr2=0x5603594993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5950940640 1 --2- 172.21.15.53:0/540095263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.897+0000 7f5950940640 1 -- 172.21.15.53:0/540095263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603593af900 con 0x5603590e4070 2024-08-31T06:07:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f5950940640 1 --2- 172.21.15.53:0/540095263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 0x5603594a5000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5944009620 tx=0x7f5944030e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6114bc4fac5cc94e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f592b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:07:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f592b7fe640 1 -- 172.21.15.53:0/540095263 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944009360 con 0x5603590e4070 2024-08-31T06:07:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f5958918740 1 -- 172.21.15.53:0/540095263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5944036070 con 0x5603590e4070 2024-08-31T06:07:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f592b7fe640 1 -- 172.21.15.53:0/540095263 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f59440308b0 con 0x5603590e4070 2024-08-31T06:07:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f592b7fe640 1 -- 172.21.15.53:0/540095263 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5944004b40 con 0x5603590e4070 2024-08-31T06:07:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f5958918740 10 client.25972 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f5958918740 1 -- 172.21.15.53:0/540095263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5603594a7af0 con 0x5603590e4070 2024-08-31T06:07:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f592b7fe640 1 -- 172.21.15.53:0/540095263 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5944036070 con 0x5603590e4070 2024-08-31T06:07:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f592b7fe640 1 -- 172.21.15.53:0/540095263 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f5944005050 con 0x5603590e4070 2024-08-31T06:07:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f5958918740 10 client.25972 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f5958918740 10 client.25972 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:07:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f5958918740 20 client.25972 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f5958918740 1 --2- 172.21.15.53:0/540095263 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5603590a29f0 0x5603594aae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.898+0000 7f5958918740 4 client.25972 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.899+0000 7f5958918740 1 -- 172.21.15.53:0/540095263 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603594025d0 con 0x5603590a29f0 2024-08-31T06:07:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.899+0000 7f594bfff640 1 --2- 172.21.15.53:0/540095263 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5603590a29f0 0x5603594aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.899+0000 7f594bfff640 1 --2- 172.21.15.53:0/540095263 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5603590a29f0 0x5603594aae50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8b6e64e84b8e3da0 server_cookie=d5910dd8f6077748 in_seq=0 out_seq=0 2024-08-31T06:07:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.899+0000 7f592b7fe640 10 client.25972 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:07:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.900+0000 7f592b7fe640 1 -- 172.21.15.53:0/540095263 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603594025d0 con 0x5603590a29f0 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.900+0000 7f592b7fe640 10 client.25972 handle_command_reply: tid=0 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.900+0000 7f5958918740 1 client.25972 shutdown 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.900+0000 7f5958918740 1 -- 172.21.15.53:0/540095263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 msgr2=0x5603594a5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.900+0000 7f5958918740 1 --2- 172.21.15.53:0/540095263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 0x5603594a5000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5944009620 tx=0x7f5944030e60 comp rx=0 tx=0).stop 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.900+0000 7f5958918740 1 -- 172.21.15.53:0/540095263 shutdown_connections 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.900+0000 7f5958918740 1 --2- 172.21.15.53:0/540095263 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5603590a29f0 0x5603594aae50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.900+0000 7f5958918740 1 --2- 172.21.15.53:0/540095263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 0x5603594a5000 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.900+0000 7f5958918740 1 --2- 172.21.15.53:0/540095263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.900+0000 7f592b7fe640 0 client.25972 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.900+0000 7f5958918740 1 --2- 172.21.15.53:0/540095263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590bb1b0 0x560359498eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.901+0000 7f5958918740 1 -- 172.21.15.53:0/540095263 >> 172.21.15.53:0/540095263 conn(0x5603590d8460 msgr2=0x56035948ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.901+0000 7f5958918740 1 -- 172.21.15.53:0/540095263 shutdown_connections 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.901+0000 7f5958918740 1 -- 172.21.15.53:0/540095263 wait complete. 2024-08-31T06:07:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.901+0000 7f5958918740 20 client.25972 trim_cache size 0 max 16384 2024-08-31T06:07:40.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.915+0000 7f5958918740 1 Processor -- start 2024-08-31T06:07:40.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.915+0000 7f5958918740 1 -- start start 2024-08-31T06:07:40.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.915+0000 7f5958918740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590bb1b0 0x560359499370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.915+0000 7f5958918740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.915+0000 7f5958918740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 0x560359486b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.915+0000 7f5958918740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1ad200 con 0x5603590c3390 2024-08-31T06:07:40.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.915+0000 7f5958918740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1aee00 con 0x5603590bb1b0 2024-08-31T06:07:40.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.915+0000 7f5958918740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1ad8d0 con 0x5603590e4070 2024-08-31T06:07:40.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.915+0000 7f5943fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.915+0000 7f5943fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594a4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36846/0 (socket says 172.21.15.53:36846) 2024-08-31T06:07:40.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.915+0000 7f5943fff640 1 -- 172.21.15.53:0/1890293712 learned_addr learned my addr 172.21.15.53:0/1890293712 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:40.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.916+0000 7f594bfff640 1 --2- 172.21.15.53:0/1890293712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590bb1b0 0x560359499370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.916+0000 7f5950940640 1 --2- 172.21.15.53:0/1890293712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 0x560359486b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.916+0000 7f5943fff640 1 -- 172.21.15.53:0/1890293712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 msgr2=0x560359486b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:40.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.916+0000 7f5943fff640 1 --2- 172.21.15.53:0/1890293712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 0x560359486b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.916+0000 7f5943fff640 1 -- 172.21.15.53:0/1890293712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590bb1b0 msgr2=0x560359499370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.916+0000 7f5943fff640 1 --2- 172.21.15.53:0/1890293712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590bb1b0 0x560359499370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.916+0000 7f5943fff640 1 -- 172.21.15.53:0/1890293712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56035948a100 con 0x5603590c3390 2024-08-31T06:07:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.916+0000 7f5943fff640 1 --2- 172.21.15.53:0/1890293712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594a4f70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f593401b000 tx=0x7f5934007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bf79872c8c4364 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:40.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.916+0000 7f5941ffb640 1 -- 172.21.15.53:0/1890293712 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59340ab700 con 0x5603590c3390 2024-08-31T06:07:40.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.916+0000 7f5941ffb640 1 -- 172.21.15.53:0/1890293712 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59340ac2f0 con 0x5603590c3390 2024-08-31T06:07:40.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.916+0000 7f5941ffb640 1 -- 172.21.15.53:0/1890293712 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59340a7e80 con 0x5603590c3390 2024-08-31T06:07:40.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.917+0000 7f5958918740 1 -- 172.21.15.53:0/1890293712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 msgr2=0x5603594a4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:40.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.917+0000 7f5958918740 1 --2- 172.21.15.53:0/1890293712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594a4f70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f593401b000 tx=0x7f5934007f00 comp rx=0 tx=0).stop 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.917+0000 7f5958918740 1 -- 172.21.15.53:0/1890293712 shutdown_connections 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.917+0000 7f5958918740 1 --2- 172.21.15.53:0/1890293712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590e4070 0x560359486b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.917+0000 7f5958918740 1 --2- 172.21.15.53:0/1890293712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594a4f70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.917+0000 7f5958918740 1 --2- 172.21.15.53:0/1890293712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590bb1b0 0x560359499370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.917+0000 7f5958918740 1 -- 172.21.15.53:0/1890293712 >> 172.21.15.53:0/1890293712 conn(0x5603590d8460 msgr2=0x560359498c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.917+0000 7f5958918740 1 -- 172.21.15.53:0/1890293712 shutdown_connections 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.917+0000 7f5958918740 1 -- 172.21.15.53:0/1890293712 wait complete. 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.918+0000 7f5958918740 1 -- start start 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.918+0000 7f5958918740 1 Processor -- start 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.918+0000 7f5958918740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590bb1b0 0x5603594ac330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.918+0000 7f5958918740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594ac910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.918+0000 7f5958918740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 0x5603595145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.918+0000 7f5958918740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1ae670 con 0x5603590c3390 2024-08-31T06:07:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.918+0000 7f5958918740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1adfa0 con 0x5603590e4070 2024-08-31T06:07:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5958918740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1ab1e0 con 0x5603590bb1b0 2024-08-31T06:07:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5958918740 10 client.0 _ll_register_callbacks cb 0x7f593c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5943fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5943fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594ac910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36850/0 (socket says 172.21.15.53:36850) 2024-08-31T06:07:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5943fff640 1 -- 172.21.15.53:0/20976830 learned_addr learned my addr 172.21.15.53:0/20976830 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5950940640 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 0x5603595145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f594bfff640 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590bb1b0 0x5603594ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5943fff640 1 -- 172.21.15.53:0/20976830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590bb1b0 msgr2=0x5603594ac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5943fff640 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590bb1b0 0x5603594ac330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5943fff640 1 -- 172.21.15.53:0/20976830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 msgr2=0x5603595145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5943fff640 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 0x5603595145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5943fff640 1 -- 172.21.15.53:0/20976830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560359514b10 con 0x5603590c3390 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5943fff640 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594ac910 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f59340a7c70 tx=0x7f59340a7af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0895017cbe9e42 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f592b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f592b7fe640 1 -- 172.21.15.53:0/20976830 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59340c6060 con 0x5603590c3390 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f592b7fe640 1 -- 172.21.15.53:0/20976830 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f59340b0050 con 0x5603590c3390 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.919+0000 7f5958918740 1 -- 172.21.15.53:0/20976830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59340ac2f0 con 0x5603590c3390 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f592b7fe640 1 -- 172.21.15.53:0/20976830 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f59340cd050 con 0x5603590c3390 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f5958918740 10 client.16566 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f5958918740 1 -- 172.21.15.53:0/20976830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560359515cc0 con 0x5603590c3390 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f592b7fe640 1 -- 172.21.15.53:0/20976830 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59340ac2f0 con 0x5603590c3390 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f592b7fe640 1 -- 172.21.15.53:0/20976830 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f59340b4a80 con 0x5603590c3390 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f5958918740 10 client.16566 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f5958918740 10 client.16566 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:07:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f5958918740 20 client.16566 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f5958918740 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x560359077da0 0x5603595183e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f5958918740 4 client.16566 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:07:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f5958918740 1 -- 172.21.15.53:0/20976830 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5603593fe070 con 0x560359077da0 2024-08-31T06:07:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.920+0000 7f594bfff640 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x560359077da0 0x5603595183e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.921+0000 7f594bfff640 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x560359077da0 0x5603595183e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae3c008911a10283 server_cookie=75d8bfccfacf1962 in_seq=0 out_seq=0 2024-08-31T06:07:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.921+0000 7f592b7fe640 10 client.16566 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:07:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.921+0000 7f592b7fe640 1 -- 172.21.15.53:0/20976830 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5603593fe070 con 0x560359077da0 2024-08-31T06:07:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.921+0000 7f592b7fe640 10 client.16566 handle_command_reply: tid=0 2024-08-31T06:07:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.921+0000 7f5958918740 1 client.16566 shutdown 2024-08-31T06:07:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f5958918740 1 -- 172.21.15.53:0/20976830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 msgr2=0x5603594ac910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f5958918740 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594ac910 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f59340a7c70 tx=0x7f59340a7af0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f5958918740 1 -- 172.21.15.53:0/20976830 shutdown_connections 2024-08-31T06:07:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f5958918740 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x560359077da0 0x5603595183e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f592b7fe640 0 client.16566 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:07:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f5958918740 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5603590e4070 0x5603595145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f5958918740 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5603590c3390 0x5603594ac910 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f5958918740 1 --2- 172.21.15.53:0/20976830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5603590bb1b0 0x5603594ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f5958918740 1 -- 172.21.15.53:0/20976830 >> 172.21.15.53:0/20976830 conn(0x5603590d8460 msgr2=0x560359497330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f5958918740 1 -- 172.21.15.53:0/20976830 shutdown_connections 2024-08-31T06:07:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f5958918740 1 -- 172.21.15.53:0/20976830 wait complete. 2024-08-31T06:07:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f5958918740 20 client.16566 trim_cache size 0 max 16384 2024-08-31T06:07:40.930 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:07:40.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f59523a3640 1 -- 172.21.15.53:0/645648488 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f59380b4cd0 msgr2=0x7f59380b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:40.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f59523a3640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f59380b4cd0 0x7f59380b71e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f594404e000 tx=0x7f594404b030 comp rx=0 tx=0).stop 2024-08-31T06:07:40.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f59523a3640 1 -- 172.21.15.53:0/645648488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f594c1050a0 msgr2=0x7f594c19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:40.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.922+0000 7f59523a3640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f594c1050a0 0x7f594c19a6a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f594c06aad0 tx=0x7f593400cdd0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.923+0000 7f59523a3640 1 -- 172.21.15.53:0/645648488 shutdown_connections 2024-08-31T06:07:40.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.923+0000 7f59523a3640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f59380b4cd0 0x7f59380b71e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.923+0000 7f59523a3640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f594c10dbb0 0x7f594c19f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.923+0000 7f59523a3640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f594c1050a0 0x7f594c19a6a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.923+0000 7f59523a3640 1 --2- 172.21.15.53:0/645648488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f594c104750 0x7f594c19a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:40.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.923+0000 7f59523a3640 1 -- 172.21.15.53:0/645648488 >> 172.21.15.53:0/645648488 conn(0x7f594c0794d0 msgr2=0x7f594c100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:40.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.923+0000 7f59523a3640 1 -- 172.21.15.53:0/645648488 shutdown_connections 2024-08-31T06:07:40.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:40.923+0000 7f59523a3640 1 -- 172.21.15.53:0/645648488 wait complete. 2024-08-31T06:07:40.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 46613 3.00 MB/sec warmup 90 sec latency 63.656 ms 2024-08-31T06:07:41.775 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:41 smithi053 ceph-mon[18924]: pgmap v405: 97 pgs: 97 active+clean; 36 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 1.4 MiB/s wr, 146 op/s 2024-08-31T06:07:41.808 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:07:41.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:41 smithi130 ceph-mon[22266]: pgmap v405: 97 pgs: 97 active+clean; 36 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 1.4 MiB/s wr, 146 op/s 2024-08-31T06:07:41.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:41 smithi153 ceph-mon[22320]: pgmap v405: 97 pgs: 97 active+clean; 36 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 1.4 MiB/s wr, 146 op/s 2024-08-31T06:07:41.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 47019 2.97 MB/sec warmup 91 sec latency 14.608 ms 2024-08-31T06:07:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:42.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.603+0000 7f3a151fa640 1 -- 172.21.15.53:0/4189229801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a10108140 msgr2=0x7f3a10108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.603+0000 7f3a151fa640 1 --2- 172.21.15.53:0/4189229801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a10108140 0x7f3a10108550 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009900 tx=0x7f3a0402a410 comp rx=0 tx=0).stop 2024-08-31T06:07:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.603+0000 7f3a151fa640 1 -- 172.21.15.53:0/4189229801 shutdown_connections 2024-08-31T06:07:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.603+0000 7f3a151fa640 1 --2- 172.21.15.53:0/4189229801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a10108a90 0x7f3a1010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.603+0000 7f3a151fa640 1 --2- 172.21.15.53:0/4189229801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a10108140 0x7f3a10108550 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.603+0000 7f3a151fa640 1 --2- 172.21.15.53:0/4189229801 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a10102800 0x7f3a10102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.603+0000 7f3a151fa640 1 -- 172.21.15.53:0/4189229801 >> 172.21.15.53:0/4189229801 conn(0x7f3a100794d0 msgr2=0x7f3a100798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.603+0000 7f3a151fa640 1 -- 172.21.15.53:0/4189229801 shutdown_connections 2024-08-31T06:07:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.603+0000 7f3a151fa640 1 -- 172.21.15.53:0/4189229801 wait complete. 2024-08-31T06:07:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.604+0000 7f3a151fa640 1 Processor -- start 2024-08-31T06:07:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.604+0000 7f3a151fa640 1 -- start start 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.604+0000 7f3a151fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a10102800 0x7f3a10198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a151fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a10108140 0x7f3a10199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a151fa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a10108a90 0x7f3a101997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a151fa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3a10112570 con 0x7f3a10108140 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a151fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a101123f0 con 0x7f3a10102800 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a151fa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a101126f0 con 0x7f3a10108a90 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a10108140 0x7f3a10199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a0ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a10102800 0x7f3a10198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a10108140 0x7f3a10199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36858/0 (socket says 172.21.15.53:36858) 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a0ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a10102800 0x7f3a10198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38718/0 (socket says 172.21.15.53:38718) 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a0e59c640 1 -- 172.21.15.53:0/524850747 learned_addr learned my addr 172.21.15.53:0/524850747 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a10108a90 0x7f3a101997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a0ed9d640 1 -- 172.21.15.53:0/524850747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a10108a90 msgr2=0x7f3a101997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a10108a90 0x7f3a101997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a0ed9d640 1 -- 172.21.15.53:0/524850747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a10108140 msgr2=0x7f3a10199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a10108140 0x7f3a10199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.605+0000 7f3a0ed9d640 1 -- 172.21.15.53:0/524850747 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a101a8400 con 0x7f3a10102800 2024-08-31T06:07:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.606+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a10102800 0x7f3a10198d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000e9f0 tx=0x7f3a0000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.606+0000 7f39f7fff640 1 -- 172.21.15.53:0/524850747 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000ccc0 con 0x7f3a10102800 2024-08-31T06:07:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.606+0000 7f39f7fff640 1 -- 172.21.15.53:0/524850747 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a000108c0 con 0x7f3a10102800 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.606+0000 7f3a151fa640 1 -- 172.21.15.53:0/524850747 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a101a86f0 con 0x7f3a10102800 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.606+0000 7f39f7fff640 1 -- 172.21.15.53:0/524850747 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a000187c0 con 0x7f3a10102800 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.606+0000 7f3a151fa640 1 -- 172.21.15.53:0/524850747 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a101a8c30 con 0x7f3a10102800 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a1b76f740 1 Processor -- start 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a1b76f740 1 -- start start 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 0x5654cc604310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc2361b0 0x5654cc604850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 0x5654cc604d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654cc57b680 con 0x5654cc23e390 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5654cc56ac10 con 0x5654cc2361b0 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5654cc56ebc0 con 0x5654cc25f070 2024-08-31T06:07:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a0f59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 0x5654cc604310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 0x5654cc604d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a0f59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 0x5654cc604310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50960/0 (socket says 172.21.15.53:50960) 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.609+0000 7f3a0f59e640 1 -- 172.21.15.53:0/3808382413 learned_addr learned my addr 172.21.15.53:0/3808382413 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.610+0000 7f3a0f59e640 1 -- 172.21.15.53:0/3808382413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc2361b0 msgr2=0x5654cc604850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.610+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/3808382413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc2361b0 0x5654cc604850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.610+0000 7f3a0f59e640 1 -- 172.21.15.53:0/3808382413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 msgr2=0x5654cc604d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.610+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/3808382413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 0x5654cc604d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.610+0000 7f3a0f59e640 1 -- 172.21.15.53:0/3808382413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654cc2ca650 con 0x5654cc25f070 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.610+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/3808382413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 0x5654cc604d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.610+0000 7f39f7fff640 1 -- 172.21.15.53:0/524850747 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3a00010430 con 0x7f3a10102800 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.611+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/3808382413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 0x5654cc604310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3a08010370 tx=0x7f3a08010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=929524c430ef4e8e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.611+0000 7f39f57fa640 1 -- 172.21.15.53:0/3808382413 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a08016070 con 0x5654cc25f070 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.611+0000 7f39f57fa640 1 -- 172.21.15.53:0/3808382413 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a08004d20 con 0x5654cc25f070 2024-08-31T06:07:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.611+0000 7f39f7fff640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f80b4ca0 0x7f39f80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.611+0000 7f39f57fa640 1 -- 172.21.15.53:0/3808382413 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a080052c0 con 0x5654cc25f070 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.612+0000 7f39f7fff640 1 -- 172.21.15.53:0/524850747 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f3a000e5830 con 0x7f3a10102800 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.612+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f80b4ca0 0x7f39f80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a1b76f740 1 -- 172.21.15.53:0/3808382413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 msgr2=0x5654cc604310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/3808382413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 0x5654cc604310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3a08010370 tx=0x7f3a08010830 comp rx=0 tx=0).stop 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f80b4ca0 0x7f39f80b71b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x5654cc602f90 tx=0x7f3a0000ce60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a1b76f740 1 -- 172.21.15.53:0/3808382413 shutdown_connections 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/3808382413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 0x5654cc604d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/3808382413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc2361b0 0x5654cc604850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/3808382413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 0x5654cc604310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a1b76f740 1 -- 172.21.15.53:0/3808382413 >> 172.21.15.53:0/3808382413 conn(0x5654cc253460 msgr2=0x5654cc602200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a1b76f740 1 -- 172.21.15.53:0/3808382413 shutdown_connections 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a1b76f740 1 -- 172.21.15.53:0/3808382413 wait complete. 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a1b76f740 1 -- start start 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.613+0000 7f3a1b76f740 1 Processor -- start 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc2361b0 0x5654cc60fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc23e390 0x5654cc610010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 0x5654cc61bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654cc3cd700 con 0x5654cc2361b0 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5654cc4f1750 con 0x5654cc23e390 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5654cc612af0 con 0x5654cc25f070 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a1b76f740 10 client.0 _ll_register_callbacks cb 0x5654cc520e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc23e390 0x5654cc610010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc23e390 0x5654cc610010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38724/0 (socket says 172.21.15.53:38724) 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a0e59c640 1 -- 172.21.15.53:0/1943697235 learned_addr learned my addr 172.21.15.53:0/1943697235 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc2361b0 0x5654cc60fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.614+0000 7f3a0e59c640 1 -- 172.21.15.53:0/1943697235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 msgr2=0x5654cc61bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.615+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 0x5654cc61bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.615+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 0x5654cc61bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.615+0000 7f3a0e59c640 1 -- 172.21.15.53:0/1943697235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc2361b0 msgr2=0x5654cc60fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.615+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc2361b0 0x5654cc60fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.615+0000 7f3a0e59c640 1 -- 172.21.15.53:0/1943697235 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654cc52a900 con 0x5654cc23e390 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.615+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 0x5654cc61bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.615+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc23e390 0x5654cc610010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009230 tx=0x7f3a04031e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca14ba8385729449 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.615+0000 7f39f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.615+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1943697235 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04035040 con 0x5654cc23e390 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.615+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1943697235 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f3a04004040 con 0x5654cc23e390 2024-08-31T06:07:42.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.615+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1943697235 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a08004d20 con 0x5654cc23e390 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.616+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1943697235 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3a04004240 con 0x5654cc23e390 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.616+0000 7f3a1b76f740 10 client.26000 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.616+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1943697235 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5654cc61e920 con 0x5654cc23e390 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.616+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1943697235 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a040043e0 con 0x5654cc23e390 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.616+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1943697235 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f3a04044020 con 0x5654cc23e390 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.616+0000 7f3a1b76f740 10 client.26000 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.616+0000 7f3a1b76f740 10 client.26000 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.616+0000 7f3a1b76f740 20 client.26000 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.617+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5654cc21d9f0 0x5654cc621d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.617+0000 7f3a1b76f740 4 client.26000 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.617+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1943697235 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3a08004d20 con 0x5654cc21d9f0 2024-08-31T06:07:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.617+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5654cc21d9f0 0x5654cc621d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.617+0000 7f39f2ff5640 10 client.26000 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:07:42.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.617+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5654cc21d9f0 0x5654cc621d80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7e80e9d988eff106 server_cookie=db193678bc2d1b35 in_seq=0 out_seq=0 2024-08-31T06:07:42.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1943697235 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f3a08004d20 con 0x5654cc21d9f0 2024-08-31T06:07:42.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f39f2ff5640 10 client.26000 handle_command_reply: tid=0 2024-08-31T06:07:42.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 1 client.26000 shutdown 2024-08-31T06:07:42.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1943697235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc23e390 msgr2=0x5654cc610010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:42.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc23e390 0x5654cc610010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009230 tx=0x7f3a04031e60 comp rx=0 tx=0).stop 2024-08-31T06:07:42.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1943697235 shutdown_connections 2024-08-31T06:07:42.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5654cc21d9f0 0x5654cc621d80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc25f070 0x5654cc61bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc23e390 0x5654cc610010 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f39f2ff5640 0 client.26000 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:07:42.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1943697235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc2361b0 0x5654cc60fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1943697235 >> 172.21.15.53:0/1943697235 conn(0x5654cc253460 msgr2=0x5654cc6074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:42.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1943697235 shutdown_connections 2024-08-31T06:07:42.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1943697235 wait complete. 2024-08-31T06:07:42.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.618+0000 7f3a1b76f740 20 client.26000 trim_cache size 0 max 16384 2024-08-31T06:07:42.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.633+0000 7f3a1b76f740 1 Processor -- start 2024-08-31T06:07:42.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.633+0000 7f3a1b76f740 1 -- start start 2024-08-31T06:07:42.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc2361b0 0x5654cc6119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 0x5654cc605a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc25f070 0x5654cc61bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3a101b1740 con 0x5654cc23e390 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a101b3340 con 0x5654cc25f070 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a101b1e10 con 0x5654cc2361b0 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 0x5654cc605a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0f59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc2361b0 0x5654cc6119b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 0x5654cc605a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36888/0 (socket says 172.21.15.53:36888) 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0f59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc2361b0 0x5654cc6119b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50978/0 (socket says 172.21.15.53:50978) 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0e59c640 1 -- 172.21.15.53:0/2079061130 learned_addr learned my addr 172.21.15.53:0/2079061130 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/2079061130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc25f070 0x5654cc61bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0e59c640 1 -- 172.21.15.53:0/2079061130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc2361b0 msgr2=0x5654cc6119b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:42.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/2079061130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc2361b0 0x5654cc6119b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0e59c640 1 -- 172.21.15.53:0/2079061130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc25f070 msgr2=0x5654cc61bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:42.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/2079061130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc25f070 0x5654cc61bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0e59c640 1 -- 172.21.15.53:0/2079061130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654cc606ba0 con 0x5654cc23e390 2024-08-31T06:07:42.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.634+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/2079061130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc2361b0 0x5654cc6119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:42.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.635+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/2079061130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 0x5654cc605a50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009850 tx=0x7f3a0402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407c52cfc2516739 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:42.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.635+0000 7f39f4ff9640 1 -- 172.21.15.53:0/2079061130 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04035040 con 0x5654cc23e390 2024-08-31T06:07:42.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.635+0000 7f39f4ff9640 1 -- 172.21.15.53:0/2079061130 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a04054070 con 0x5654cc23e390 2024-08-31T06:07:42.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.635+0000 7f39f4ff9640 1 -- 172.21.15.53:0/2079061130 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04046da0 con 0x5654cc23e390 2024-08-31T06:07:42.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.636+0000 7f3a1b76f740 1 -- 172.21.15.53:0/2079061130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 msgr2=0x5654cc605a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:42.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.636+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/2079061130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 0x5654cc605a50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009850 tx=0x7f3a0402a410 comp rx=0 tx=0).stop 2024-08-31T06:07:42.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.636+0000 7f3a1b76f740 1 -- 172.21.15.53:0/2079061130 shutdown_connections 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.636+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/2079061130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc25f070 0x5654cc61bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.636+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/2079061130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc23e390 0x5654cc605a50 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.636+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/2079061130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc2361b0 0x5654cc6119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.636+0000 7f3a1b76f740 1 -- 172.21.15.53:0/2079061130 >> 172.21.15.53:0/2079061130 conn(0x5654cc253460 msgr2=0x5654cc605340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.636+0000 7f3a1b76f740 1 -- 172.21.15.53:0/2079061130 shutdown_connections 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.636+0000 7f3a1b76f740 1 -- 172.21.15.53:0/2079061130 wait complete. 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.636+0000 7f3a1b76f740 1 -- start start 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.636+0000 7f3a1b76f740 1 Processor -- start 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc2361b0 0x5654cc6161f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc23e390 0x5654cc6167d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a1b76f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc25f070 0x5654cc68b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3a101b2bb0 con 0x5654cc2361b0 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a101b24e0 con 0x5654cc25f070 2024-08-31T06:07:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a1b76f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a101af720 con 0x5654cc23e390 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a1b76f740 10 client.0 _ll_register_callbacks cb 0x7f3a04009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a0f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc2361b0 0x5654cc6161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a0f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc2361b0 0x5654cc6161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36900/0 (socket says 172.21.15.53:36900) 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a0f59e640 1 -- 172.21.15.53:0/1567671441 learned_addr learned my addr 172.21.15.53:0/1567671441 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc23e390 0x5654cc6167d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc25f070 0x5654cc68b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a0e59c640 1 -- 172.21.15.53:0/1567671441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc25f070 msgr2=0x5654cc68b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc25f070 0x5654cc68b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a0e59c640 1 -- 172.21.15.53:0/1567671441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc2361b0 msgr2=0x5654cc6161f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc2361b0 0x5654cc6161f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a0e59c640 1 -- 172.21.15.53:0/1567671441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654cc68bc90 con 0x5654cc23e390 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.637+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc25f070 0x5654cc68b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.638+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc23e390 0x5654cc6167d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3a04005760 tx=0x7f3a0404f6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc71f46f49098bd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:42.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.638+0000 7f39f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.638+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1567671441 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04035040 con 0x5654cc23e390 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.638+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1567671441 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f3a04046be0 con 0x5654cc23e390 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.638+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1567671441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a04054070 con 0x5654cc23e390 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.638+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1567671441 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3a0406a050 con 0x5654cc23e390 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.638+0000 7f3a1b76f740 10 client.25993 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.638+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1567671441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5654cc68ce40 con 0x5654cc23e390 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.638+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1567671441 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a04054070 con 0x5654cc23e390 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.639+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1567671441 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f3a04059a60 con 0x5654cc23e390 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.639+0000 7f3a1b76f740 10 client.25993 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.639+0000 7f3a1b76f740 10 client.25993 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.639+0000 7f3a1b76f740 20 client.25993 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.639+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5654cc1f2da0 0x5654cc68f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.639+0000 7f3a1b76f740 4 client.25993 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.639+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1567671441 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654cc57d5d0 con 0x5654cc1f2da0 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.639+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5654cc1f2da0 0x5654cc68f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.639+0000 7f39f2ff5640 10 client.25993 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.639+0000 7f3a0f59e640 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5654cc1f2da0 0x5654cc68f560 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d543b3864a7323a0 server_cookie=29b2796a61bb954 in_seq=0 out_seq=0 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.639+0000 7f39f2ff5640 1 -- 172.21.15.53:0/1567671441 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654cc57d5d0 con 0x5654cc1f2da0 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f39f2ff5640 10 client.25993 handle_command_reply: tid=0 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 1 client.25993 shutdown 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1567671441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc23e390 msgr2=0x5654cc6167d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc23e390 0x5654cc6167d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3a04005760 tx=0x7f3a0404f6b0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1567671441 shutdown_connections 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5654cc1f2da0 0x5654cc68f560 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654cc25f070 0x5654cc68b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654cc23e390 0x5654cc6167d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f39f2ff5640 0 client.25993 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:07:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 1 --2- 172.21.15.53:0/1567671441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654cc2361b0 0x5654cc6161f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1567671441 >> 172.21.15.53:0/1567671441 conn(0x5654cc253460 msgr2=0x5654cc611710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1567671441 shutdown_connections 2024-08-31T06:07:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 1 -- 172.21.15.53:0/1567671441 wait complete. 2024-08-31T06:07:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.640+0000 7f3a1b76f740 20 client.25993 trim_cache size 0 max 16384 2024-08-31T06:07:42.647 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:07:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 -- 172.21.15.53:0/524850747 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f80b4ca0 msgr2=0x7f39f80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f80b4ca0 0x7f39f80b71b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x5654cc602f90 tx=0x7f3a0000ce60 comp rx=0 tx=0).stop 2024-08-31T06:07:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 -- 172.21.15.53:0/524850747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a10102800 msgr2=0x7f3a10198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a10102800 0x7f3a10198d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000e9f0 tx=0x7f3a0000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 -- 172.21.15.53:0/524850747 shutdown_connections 2024-08-31T06:07:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f39f80b4ca0 0x7f39f80b71b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a10108a90 0x7f3a101997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a10108140 0x7f3a10199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 --2- 172.21.15.53:0/524850747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a10102800 0x7f3a10198d50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 -- 172.21.15.53:0/524850747 >> 172.21.15.53:0/524850747 conn(0x7f3a100794d0 msgr2=0x7f3a10104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 -- 172.21.15.53:0/524850747 shutdown_connections 2024-08-31T06:07:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:42.641+0000 7f3a151fa640 1 -- 172.21.15.53:0/524850747 wait complete. 2024-08-31T06:07:42.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 47536 2.98 MB/sec warmup 92 sec latency 17.862 ms 2024-08-31T06:07:43.531 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:07:43.827 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:43 smithi130 ceph-mon[22266]: pgmap v406: 97 pgs: 97 active+clean; 37 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-08-31T06:07:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:43 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:07:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:43 smithi153 ceph-mon[22320]: pgmap v406: 97 pgs: 97 active+clean; 37 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-08-31T06:07:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:43 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:07:43.952 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:43 smithi053 ceph-mon[18924]: pgmap v406: 97 pgs: 97 active+clean; 37 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-08-31T06:07:43.952 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:43 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:07:43.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 48104 2.96 MB/sec warmup 93 sec latency 18.072 ms 2024-08-31T06:07:44.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.369+0000 7fcdfda4f640 1 -- 172.21.15.53:0/1580243323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdf810dc00 msgr2=0x7fcdf81100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:44.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.369+0000 7fcdfda4f640 1 --2- 172.21.15.53:0/1580243323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdf810dc00 0x7fcdf81100d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0009ca0 tx=0x7fcdf002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.370+0000 7fcdfda4f640 1 -- 172.21.15.53:0/1580243323 shutdown_connections 2024-08-31T06:07:44.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.370+0000 7fcdfda4f640 1 --2- 172.21.15.53:0/1580243323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdf810dc00 0x7fcdf81100d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.370+0000 7fcdfda4f640 1 --2- 172.21.15.53:0/1580243323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdf8105120 0x7fcdf810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.370+0000 7fcdfda4f640 1 --2- 172.21.15.53:0/1580243323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdf81047d0 0x7fcdf8104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.370+0000 7fcdfda4f640 1 -- 172.21.15.53:0/1580243323 >> 172.21.15.53:0/1580243323 conn(0x7fcdf8079530 msgr2=0x7fcdf8079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.370+0000 7fcdfda4f640 1 -- 172.21.15.53:0/1580243323 shutdown_connections 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.370+0000 7fcdfda4f640 1 -- 172.21.15.53:0/1580243323 wait complete. 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.370+0000 7fcdfda4f640 1 Processor -- start 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdfda4f640 1 -- start start 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdfda4f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdf81047d0 0x7fcdf819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdfda4f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdf8105120 0x7fcdf819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdfda4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdf810dc00 0x7fcdf819f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdfda4f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf8113760 con 0x7fcdf810dc00 2024-08-31T06:07:44.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdfda4f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf81135e0 con 0x7fcdf81047d0 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdfda4f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf81138e0 con 0x7fcdf8105120 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdf810dc00 0x7fcdf819f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdf81047d0 0x7fcdf819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdf81047d0 0x7fcdf819a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33118/0 (socket says 172.21.15.53:33118) 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdf810dc00 0x7fcdf819f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38342/0 (socket says 172.21.15.53:38342) 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf6ffd640 1 -- 172.21.15.53:0/938735514 learned_addr learned my addr 172.21.15.53:0/938735514 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdf8105120 0x7fcdf819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf77fe640 1 -- 172.21.15.53:0/938735514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdf8105120 msgr2=0x7fcdf819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf77fe640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdf8105120 0x7fcdf819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf77fe640 1 -- 172.21.15.53:0/938735514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdf81047d0 msgr2=0x7fcdf819a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf77fe640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdf81047d0 0x7fcdf819a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf77fe640 1 -- 172.21.15.53:0/938735514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf81a0080 con 0x7fcdf810dc00 2024-08-31T06:07:44.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.371+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdf81047d0 0x7fcdf819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.372+0000 7fcdf77fe640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdf810dc00 0x7fcdf819f950 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0031040 tx=0x7fcdf0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.372+0000 7fcdfca4d640 1 -- 172.21.15.53:0/938735514 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf004c070 con 0x7fcdf810dc00 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.372+0000 7fcdfca4d640 1 -- 172.21.15.53:0/938735514 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdf003cbb0 con 0x7fcdf810dc00 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.372+0000 7fcdfda4f640 1 -- 172.21.15.53:0/938735514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf81a0310 con 0x7fcdf810dc00 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.372+0000 7fcdfca4d640 1 -- 172.21.15.53:0/938735514 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00043c0 con 0x7fcdf810dc00 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.372+0000 7fcdfda4f640 1 -- 172.21.15.53:0/938735514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf81023f0 con 0x7fcdf810dc00 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fcdfca4d640 1 -- 172.21.15.53:0/938735514 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcdf004f070 con 0x7fcdf810dc00 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fce03fc4740 1 Processor -- start 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fce03fc4740 1 -- start start 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e06390 0x5564541ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fce03fc4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556454143680 con 0x556453dfe1b0 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fce03fc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556454132c10 con 0x556453e06390 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fce03fc4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556454136bc0 con 0x556453e27070 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fcdf6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fcdf6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38354/0 (socket says 172.21.15.53:38354) 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fcdf6ffd640 1 -- 172.21.15.53:0/3461088448 learned_addr learned my addr 172.21.15.53:0/3461088448 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fcdfca4d640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcde00b4ca0 0x7fcde00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.375+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/3461088448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/3461088448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e06390 0x5564541ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdf77fe640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcde00b4ca0 0x7fcde00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdf6ffd640 1 -- 172.21.15.53:0/3461088448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 msgr2=0x5564541cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:44.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/3461088448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdf6ffd640 1 -- 172.21.15.53:0/3461088448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e06390 msgr2=0x5564541ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/3461088448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e06390 0x5564541ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdf6ffd640 1 -- 172.21.15.53:0/3461088448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556453e92650 con 0x556453dfe1b0 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/3461088448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdfca4d640 1 -- 172.21.15.53:0/938735514 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fcdf0109b90 con 0x7fcdf810dc00 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/3461088448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541cc850 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fcde8011650 tx=0x7fcde8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa52adccab142d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdf77fe640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcde00b4ca0 0x7fcde00b71b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00d02a0 tx=0x7fcdf00bd040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdddffb640 1 -- 172.21.15.53:0/3461088448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde801e070 con 0x556453dfe1b0 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdddffb640 1 -- 172.21.15.53:0/3461088448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcde800fb50 con 0x556453dfe1b0 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.376+0000 7fcdddffb640 1 -- 172.21.15.53:0/3461088448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8019b90 con 0x556453dfe1b0 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.377+0000 7fce03fc4740 1 -- 172.21.15.53:0/3461088448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 msgr2=0x5564541cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.377+0000 7fce03fc4740 1 --2- 172.21.15.53:0/3461088448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541cc850 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fcde8011650 tx=0x7fcde8009f90 comp rx=0 tx=0).stop 2024-08-31T06:07:44.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.377+0000 7fce03fc4740 1 -- 172.21.15.53:0/3461088448 shutdown_connections 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.377+0000 7fce03fc4740 1 --2- 172.21.15.53:0/3461088448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e06390 0x5564541ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.377+0000 7fce03fc4740 1 --2- 172.21.15.53:0/3461088448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541cc850 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.377+0000 7fce03fc4740 1 --2- 172.21.15.53:0/3461088448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.377+0000 7fce03fc4740 1 -- 172.21.15.53:0/3461088448 >> 172.21.15.53:0/3461088448 conn(0x556453e1b460 msgr2=0x5564541ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.377+0000 7fce03fc4740 1 -- 172.21.15.53:0/3461088448 shutdown_connections 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.377+0000 7fce03fc4740 1 -- 172.21.15.53:0/3461088448 wait complete. 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.378+0000 7fce03fc4740 1 -- start start 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.378+0000 7fce03fc4740 1 Processor -- start 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.378+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541d7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.378+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e06390 0x5564541d7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.378+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.378+0000 7fce03fc4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556453f95700 con 0x556453dfe1b0 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.378+0000 7fce03fc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5564540b9750 con 0x556453e06390 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.378+0000 7fce03fc4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5564541daaf0 con 0x556453e27070 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.378+0000 7fce03fc4740 10 client.0 _ll_register_callbacks cb 0x5564540e8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541d7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541d7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38368/0 (socket says 172.21.15.53:38368) 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf67fc640 1 -- 172.21.15.53:0/3355373788 learned_addr learned my addr 172.21.15.53:0/3355373788 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e06390 0x5564541d7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf67fc640 1 -- 172.21.15.53:0/3355373788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 msgr2=0x5564541e3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541e3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf67fc640 1 -- 172.21.15.53:0/3355373788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e06390 msgr2=0x5564541d7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e06390 0x5564541d7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf67fc640 1 -- 172.21.15.53:0/3355373788 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564540f2900 con 0x556453dfe1b0 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e06390 0x5564541d7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541d7aa0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fcdec013ea0 tx=0x7fcdec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0cfaaf4008a3a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/3355373788 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec004230 con 0x556453dfe1b0 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fce03fc4740 1 -- 172.21.15.53:0/3355373788 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcde800fb50 con 0x556453dfe1b0 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.379+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/3355373788 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fcdec0043d0 con 0x556453dfe1b0 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.380+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/3355373788 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcdec0047a0 con 0x556453dfe1b0 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.380+0000 7fce03fc4740 10 client.16596 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.380+0000 7fce03fc4740 1 -- 172.21.15.53:0/3355373788 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5564541e6980 con 0x556453dfe1b0 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.380+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/3355373788 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcde800fb50 con 0x556453dfe1b0 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.380+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/3355373788 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fcdec021590 con 0x556453dfe1b0 2024-08-31T06:07:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.380+0000 7fce03fc4740 10 client.16596 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.380+0000 7fce03fc4740 10 client.16596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.380+0000 7fce03fc4740 20 client.16596 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.381+0000 7fce03fc4740 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556453de59f0 0x5564541e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.381+0000 7fce03fc4740 4 client.16596 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.381+0000 7fce03fc4740 1 -- 172.21.15.53:0/3355373788 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564541455d0 con 0x556453de59f0 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.381+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556453de59f0 0x5564541e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.381+0000 7fcdd6ffd640 10 client.16596 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.381+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556453de59f0 0x5564541e9eb0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b5658aa96578d50 server_cookie=efa3605fdf8ec3b2 in_seq=0 out_seq=0 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.382+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/3355373788 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564541455d0 con 0x556453de59f0 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.382+0000 7fcdd6ffd640 10 client.16596 handle_command_reply: tid=0 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.382+0000 7fce03fc4740 1 client.16596 shutdown 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fce03fc4740 1 -- 172.21.15.53:0/3355373788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 msgr2=0x5564541d7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fce03fc4740 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541d7aa0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fcdec013ea0 tx=0x7fcdec0046c0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fce03fc4740 1 -- 172.21.15.53:0/3355373788 shutdown_connections 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fce03fc4740 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556453de59f0 0x5564541e9eb0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fce03fc4740 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fce03fc4740 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e06390 0x5564541d7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fce03fc4740 1 --2- 172.21.15.53:0/3355373788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453dfe1b0 0x5564541d7aa0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fcdd6ffd640 0 client.16596 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fce03fc4740 1 -- 172.21.15.53:0/3355373788 >> 172.21.15.53:0/3355373788 conn(0x556453e1b460 msgr2=0x5564541cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fce03fc4740 1 -- 172.21.15.53:0/3355373788 shutdown_connections 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fce03fc4740 1 -- 172.21.15.53:0/3355373788 wait complete. 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.383+0000 7fce03fc4740 20 client.16596 trim_cache size 0 max 16384 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.398+0000 7fce03fc4740 1 Processor -- start 2024-08-31T06:07:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.398+0000 7fce03fc4740 1 -- start start 2024-08-31T06:07:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453de59f0 0x5564541cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e27070 0x5564541d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fce03fc4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf81ad200 con 0x556453e06390 2024-08-31T06:07:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fce03fc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf81aee00 con 0x556453e27070 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fce03fc4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf81ad8d0 con 0x556453de59f0 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fcdf6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fcdf6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541d4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38370/0 (socket says 172.21.15.53:38370) 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fcdf6ffd640 1 -- 172.21.15.53:0/213127548 learned_addr learned my addr 172.21.15.53:0/213127548 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/213127548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e27070 0x5564541d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/213127548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453de59f0 0x5564541cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fcdf6ffd640 1 -- 172.21.15.53:0/213127548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453de59f0 msgr2=0x5564541cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/213127548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453de59f0 0x5564541cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fcdf6ffd640 1 -- 172.21.15.53:0/213127548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e27070 msgr2=0x5564541d51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/213127548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e27070 0x5564541d51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fcdf6ffd640 1 -- 172.21.15.53:0/213127548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564541e6790 con 0x556453e06390 2024-08-31T06:07:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.399+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/213127548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541d4c90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcde8011fa0 tx=0x7fcde8009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f141646e335791d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.400+0000 7fcddd7fa640 1 -- 172.21.15.53:0/213127548 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde801e040 con 0x556453e06390 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.400+0000 7fcddd7fa640 1 -- 172.21.15.53:0/213127548 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcde8029030 con 0x556453e06390 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.400+0000 7fcddd7fa640 1 -- 172.21.15.53:0/213127548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde80052a0 con 0x556453e06390 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.401+0000 7fce03fc4740 1 -- 172.21.15.53:0/213127548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 msgr2=0x5564541d4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.401+0000 7fce03fc4740 1 --2- 172.21.15.53:0/213127548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541d4c90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcde8011fa0 tx=0x7fcde8009dc0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.401+0000 7fce03fc4740 1 -- 172.21.15.53:0/213127548 shutdown_connections 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.401+0000 7fce03fc4740 1 --2- 172.21.15.53:0/213127548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453e27070 0x5564541d51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.401+0000 7fce03fc4740 1 --2- 172.21.15.53:0/213127548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541d4c90 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.401+0000 7fce03fc4740 1 --2- 172.21.15.53:0/213127548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453de59f0 0x5564541cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.401+0000 7fce03fc4740 1 -- 172.21.15.53:0/213127548 >> 172.21.15.53:0/213127548 conn(0x556453e1b460 msgr2=0x5564541cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.401+0000 7fce03fc4740 1 -- 172.21.15.53:0/213127548 shutdown_connections 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.401+0000 7fce03fc4740 1 -- 172.21.15.53:0/213127548 wait complete. 2024-08-31T06:07:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.401+0000 7fce03fc4740 1 -- start start 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fce03fc4740 1 Processor -- start 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453de59f0 0x5564541dbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541dc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fce03fc4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541dc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fce03fc4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf81ae670 con 0x556453e06390 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fce03fc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf81adfa0 con 0x556453de59f0 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fce03fc4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf81ab200 con 0x556453e27070 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fce03fc4740 10 client.0 _ll_register_callbacks cb 0x7fcdec009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fcdf6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541dc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fcdf6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541dc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38382/0 (socket says 172.21.15.53:38382) 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fcdf6ffd640 1 -- 172.21.15.53:0/1760017662 learned_addr learned my addr 172.21.15.53:0/1760017662 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fcdf67fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541dc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453de59f0 0x5564541dbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.402+0000 7fcdf67fc640 1 -- 172.21.15.53:0/1760017662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453de59f0 msgr2=0x5564541dbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453de59f0 0x5564541dbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fcdf67fc640 1 -- 172.21.15.53:0/1760017662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 msgr2=0x5564541dc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541dc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fcdf67fc640 1 -- 172.21.15.53:0/1760017662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564542538b0 con 0x556453e27070 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541dc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fcdf67fc640 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541dc7d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcdec008000 tx=0x7fcdec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db4f384b6eb859c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fcdd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/1760017662 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec02e040 con 0x556453e27070 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/1760017662 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fcdec004450 con 0x556453e27070 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fce03fc4740 1 -- 172.21.15.53:0/1760017662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcde8029030 con 0x556453e27070 2024-08-31T06:07:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/1760017662 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcdec004940 con 0x556453e27070 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fce03fc4740 10 client.26011 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fce03fc4740 1 -- 172.21.15.53:0/1760017662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556454254b30 con 0x556453e27070 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.403+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/1760017662 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdec02f040 con 0x556453e27070 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.404+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/1760017662 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fcdec034040 con 0x556453e27070 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.404+0000 7fce03fc4740 10 client.26011 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.404+0000 7fce03fc4740 10 client.26011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.404+0000 7fce03fc4740 20 client.26011 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.404+0000 7fce03fc4740 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556453dbada0 0x556454257210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.404+0000 7fce03fc4740 4 client.26011 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.404+0000 7fce03fc4740 1 -- 172.21.15.53:0/1760017662 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcde8029030 con 0x556453dbada0 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.404+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556453dbada0 0x556454257210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.404+0000 7fcdf6ffd640 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556453dbada0 0x556454257210 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12a9a2883334e81b server_cookie=d3e1cf7dcc76de40 in_seq=0 out_seq=0 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.404+0000 7fcdd6ffd640 10 client.26011 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fcdd6ffd640 1 -- 172.21.15.53:0/1760017662 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcde8029030 con 0x556453dbada0 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fcdd6ffd640 10 client.26011 handle_command_reply: tid=0 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 1 client.26011 shutdown 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 1 -- 172.21.15.53:0/1760017662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 msgr2=0x5564541dc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541dc7d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcdec008000 tx=0x7fcdec0046c0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 1 -- 172.21.15.53:0/1760017662 shutdown_connections 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556453dbada0 0x556454257210 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556453e27070 0x5564541dc7d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556453e06390 0x5564541dc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 1 --2- 172.21.15.53:0/1760017662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556453de59f0 0x5564541dbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fcdd6ffd640 0 client.26011 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:44.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 1 -- 172.21.15.53:0/1760017662 >> 172.21.15.53:0/1760017662 conn(0x556453e1b460 msgr2=0x5564541d6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:44.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 1 -- 172.21.15.53:0/1760017662 shutdown_connections 2024-08-31T06:07:44.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 1 -- 172.21.15.53:0/1760017662 wait complete. 2024-08-31T06:07:44.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.405+0000 7fce03fc4740 20 client.26011 trim_cache size 0 max 16384 2024-08-31T06:07:44.422 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:07:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 -- 172.21.15.53:0/938735514 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcde00b4ca0 msgr2=0x7fcde00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcde00b4ca0 0x7fcde00b71b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00d02a0 tx=0x7fcdf00bd040 comp rx=0 tx=0).stop 2024-08-31T06:07:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 -- 172.21.15.53:0/938735514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdf810dc00 msgr2=0x7fcdf819f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdf810dc00 0x7fcdf819f950 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0031040 tx=0x7fcdf0003f10 comp rx=0 tx=0).stop 2024-08-31T06:07:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 -- 172.21.15.53:0/938735514 shutdown_connections 2024-08-31T06:07:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcde00b4ca0 0x7fcde00b71b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcdf810dc00 0x7fcdf819f950 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdf8105120 0x7fcdf819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 --2- 172.21.15.53:0/938735514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdf81047d0 0x7fcdf819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 -- 172.21.15.53:0/938735514 >> 172.21.15.53:0/938735514 conn(0x7fcdf8079530 msgr2=0x7fcdf8107700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 -- 172.21.15.53:0/938735514 shutdown_connections 2024-08-31T06:07:44.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:44.406+0000 7fcdfda4f640 1 -- 172.21.15.53:0/938735514 wait complete. 2024-08-31T06:07:44.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:07:44.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:07:44.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:07:44.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:07:44.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:07:44.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:07:44.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 48637 2.95 MB/sec warmup 94 sec latency 13.611 ms 2024-08-31T06:07:44.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:07:44.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:07:44.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:07:45.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 49422 2.99 MB/sec warmup 95 sec latency 14.913 ms 2024-08-31T06:07:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:45 smithi130 ceph-mon[22266]: pgmap v407: 97 pgs: 97 active+clean; 38 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.3 MiB/s wr, 152 op/s 2024-08-31T06:07:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:45 smithi153 ceph-mon[22320]: pgmap v407: 97 pgs: 97 active+clean; 38 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.3 MiB/s wr, 152 op/s 2024-08-31T06:07:46.193 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:07:46.193 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:07:46.217 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:45 smithi053 ceph-mon[18924]: pgmap v407: 97 pgs: 97 active+clean; 38 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.3 MiB/s wr, 152 op/s 2024-08-31T06:07:46.463 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:46.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 49786 2.99 MB/sec warmup 96 sec latency 15.338 ms 2024-08-31T06:07:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.971+0000 7fb43a98c640 1 -- 172.21.15.53:0/3285688500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43410dc00 msgr2=0x7fb4341100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.971+0000 7fb43a98c640 1 --2- 172.21.15.53:0/3285688500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43410dc00 0x7fb4341100d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009900 tx=0x7fb42c02a410 comp rx=0 tx=0).stop 2024-08-31T06:07:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.971+0000 7fb43a98c640 1 -- 172.21.15.53:0/3285688500 shutdown_connections 2024-08-31T06:07:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.971+0000 7fb43a98c640 1 --2- 172.21.15.53:0/3285688500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43410dc00 0x7fb4341100d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.971+0000 7fb43a98c640 1 --2- 172.21.15.53:0/3285688500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb434105120 0x7fb43410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.971+0000 7fb43a98c640 1 --2- 172.21.15.53:0/3285688500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4341047d0 0x7fb434104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.971+0000 7fb43a98c640 1 -- 172.21.15.53:0/3285688500 >> 172.21.15.53:0/3285688500 conn(0x7fb434079500 msgr2=0x7fb434079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.972+0000 7fb43a98c640 1 -- 172.21.15.53:0/3285688500 shutdown_connections 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.972+0000 7fb43a98c640 1 -- 172.21.15.53:0/3285688500 wait complete. 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.972+0000 7fb43a98c640 1 Processor -- start 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.972+0000 7fb43a98c640 1 -- start start 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb43a98c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4341047d0 0x7fb4341a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb43a98c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb434105120 0x7fb4341a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb43a98c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43410dc00 0x7fb4341ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb43a98c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb434113750 con 0x7fb434105120 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb43a98c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4341135d0 con 0x7fb4341047d0 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb43a98c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4341138d0 con 0x7fb43410dc00 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb42b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb434105120 0x7fb4341a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb42b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb434105120 0x7fb4341a1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38390/0 (socket says 172.21.15.53:38390) 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb42b7fe640 1 -- 172.21.15.53:0/1256987203 learned_addr learned my addr 172.21.15.53:0/1256987203 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb433fff640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4341047d0 0x7fb4341a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb42b7fe640 1 -- 172.21.15.53:0/1256987203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43410dc00 msgr2=0x7fb4341ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43410dc00 0x7fb4341ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb42b7fe640 1 -- 172.21.15.53:0/1256987203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4341047d0 msgr2=0x7fb4341a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4341047d0 0x7fb4341a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.973+0000 7fb42b7fe640 1 -- 172.21.15.53:0/1256987203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4341a2240 con 0x7fb434105120 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.974+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb434105120 0x7fb4341a1970 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb41c006fd0 tx=0x7fb41c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.974+0000 7fb431ffb640 1 -- 172.21.15.53:0/1256987203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c011830 con 0x7fb434105120 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.974+0000 7fb431ffb640 1 -- 172.21.15.53:0/1256987203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb41c016070 con 0x7fb434105120 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.974+0000 7fb43a98c640 1 -- 172.21.15.53:0/1256987203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4341acb10 con 0x7fb434105120 2024-08-31T06:07:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.974+0000 7fb431ffb640 1 -- 172.21.15.53:0/1256987203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c010d30 con 0x7fb434105120 2024-08-31T06:07:46.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.974+0000 7fb43a98c640 1 -- 172.21.15.53:0/1256987203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4341acfd0 con 0x7fb434105120 2024-08-31T06:07:46.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb431ffb640 1 -- 172.21.15.53:0/1256987203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb41c0119d0 con 0x7fb434105120 2024-08-31T06:07:46.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb440f01740 1 Processor -- start 2024-08-31T06:07:46.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb440f01740 1 -- start start 2024-08-31T06:07:46.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb440f01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5ee350 0x5585ec994780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:46.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb440f01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec994cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:46.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb440f01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 0x5585ec995200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:46.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb440f01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5585ec90a5f0 con 0x5585ec5ee350 2024-08-31T06:07:46.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb440f01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585ec8f9b80 con 0x5585ec5c5490 2024-08-31T06:07:46.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb440f01740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5585ec8fdb30 con 0x5585ec5cd670 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb433fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec994cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb433fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec994cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33184/0 (socket says 172.21.15.53:33184) 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb433fff640 1 -- 172.21.15.53:0/2569589159 learned_addr learned my addr 172.21.15.53:0/2569589159 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/2569589159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 0x5585ec995200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.977+0000 7fb438f29640 1 --2- 172.21.15.53:0/2569589159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5ee350 0x5585ec994780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb433fff640 1 -- 172.21.15.53:0/2569589159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 msgr2=0x5585ec995200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb433fff640 1 --2- 172.21.15.53:0/2569589159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 0x5585ec995200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb433fff640 1 -- 172.21.15.53:0/2569589159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5ee350 msgr2=0x5585ec994780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb433fff640 1 --2- 172.21.15.53:0/2569589159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5ee350 0x5585ec994780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb433fff640 1 -- 172.21.15.53:0/2569589159 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585ec659930 con 0x5585ec5c5490 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb431ffb640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4200b4ca0 0x7fb4200b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:46.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/2569589159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 0x5585ec995200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:07:46.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb438f29640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4200b4ca0 0x7fb4200b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:46.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb433fff640 1 --2- 172.21.15.53:0/2569589159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec994cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb424003a70 tx=0x7fb424003f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1784661d8cc4827 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:46.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb431ffb640 1 -- 172.21.15.53:0/1256987203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb41c0e4b50 con 0x7fb434105120 2024-08-31T06:07:46.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb42a7fc640 1 -- 172.21.15.53:0/2569589159 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424012450 con 0x5585ec5c5490 2024-08-31T06:07:46.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb42a7fc640 1 -- 172.21.15.53:0/2569589159 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb424012a80 con 0x5585ec5c5490 2024-08-31T06:07:46.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.978+0000 7fb42a7fc640 1 -- 172.21.15.53:0/2569589159 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424011b60 con 0x5585ec5c5490 2024-08-31T06:07:46.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.979+0000 7fb440f01740 1 -- 172.21.15.53:0/2569589159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 msgr2=0x5585ec994cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:46.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.979+0000 7fb438f29640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4200b4ca0 0x7fb4200b71b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb42c005ab0 tx=0x7fb42c0056d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:46.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.979+0000 7fb440f01740 1 --2- 172.21.15.53:0/2569589159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec994cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb424003a70 tx=0x7fb424003f30 comp rx=0 tx=0).stop 2024-08-31T06:07:46.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.979+0000 7fb440f01740 1 -- 172.21.15.53:0/2569589159 shutdown_connections 2024-08-31T06:07:46.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.979+0000 7fb440f01740 1 --2- 172.21.15.53:0/2569589159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 0x5585ec995200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.979+0000 7fb440f01740 1 --2- 172.21.15.53:0/2569589159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec994cc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.979+0000 7fb440f01740 1 --2- 172.21.15.53:0/2569589159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5ee350 0x5585ec994780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.979+0000 7fb440f01740 1 -- 172.21.15.53:0/2569589159 >> 172.21.15.53:0/2569589159 conn(0x5585ec5e2740 msgr2=0x5585ec992670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.979+0000 7fb440f01740 1 -- 172.21.15.53:0/2569589159 shutdown_connections 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.979+0000 7fb440f01740 1 -- 172.21.15.53:0/2569589159 wait complete. 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb440f01740 1 -- start start 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb440f01740 1 Processor -- start 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb440f01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5c5490 0x5585ec99ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb440f01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5cd670 0x5585ec9a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb440f01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5ee350 0x5585ec9ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb440f01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5585ec75c890 con 0x5585ec5c5490 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb440f01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585ec880790 con 0x5585ec5cd670 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb440f01740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5585ec9a2f60 con 0x5585ec5ee350 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb440f01740 10 client.0 _ll_register_callbacks cb 0x5585ec605ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb433fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5c5490 0x5585ec99ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:46.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb42b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5cd670 0x5585ec9a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.980+0000 7fb433fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5c5490 0x5585ec99ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38404/0 (socket says 172.21.15.53:38404) 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb42b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5cd670 0x5585ec9a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33194/0 (socket says 172.21.15.53:33194) 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb433fff640 1 -- 172.21.15.53:0/1801752191 learned_addr learned my addr 172.21.15.53:0/1801752191 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb438f29640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5ee350 0x5585ec9ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb42b7fe640 1 -- 172.21.15.53:0/1801752191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5ee350 msgr2=0x5585ec9ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/1801752191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5ee350 0x5585ec9ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb42b7fe640 1 -- 172.21.15.53:0/1801752191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5c5490 msgr2=0x5585ec99ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/1801752191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5c5490 0x5585ec99ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb42b7fe640 1 -- 172.21.15.53:0/1801752191 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585ec8b7f30 con 0x5585ec5cd670 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/1801752191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5cd670 0x5585ec9a04e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0e22a0 tx=0x7fb41c0a7230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee1f91037c587be7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb4137fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb4137fe640 1 -- 172.21.15.53:0/1801752191 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0ab940 con 0x5585ec5cd670 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb4137fe640 1 -- 172.21.15.53:0/1801752191 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb41c0e2520 con 0x5585ec5cd670 2024-08-31T06:07:46.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb440f01740 1 -- 172.21.15.53:0/1801752191 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb424012a80 con 0x5585ec5cd670 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb4137fe640 1 -- 172.21.15.53:0/1801752191 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb41c0ab240 con 0x5585ec5cd670 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb440f01740 10 client.26033 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.981+0000 7fb440f01740 1 -- 172.21.15.53:0/1801752191 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5585ec9aedc0 con 0x5585ec5cd670 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.982+0000 7fb4137fe640 1 -- 172.21.15.53:0/1801752191 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb424012a80 con 0x5585ec5cd670 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.982+0000 7fb4137fe640 1 -- 172.21.15.53:0/1801752191 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb41c0a74d0 con 0x5585ec5cd670 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.982+0000 7fb440f01740 10 client.26033 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.982+0000 7fb440f01740 10 client.26033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.982+0000 7fb440f01740 20 client.26033 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.982+0000 7fb440f01740 1 --2- 172.21.15.53:0/1801752191 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585ec5accd0 0x5585ec9b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.982+0000 7fb440f01740 4 client.26033 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.982+0000 7fb440f01740 1 -- 172.21.15.53:0/1801752191 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585ec90c540 con 0x5585ec5accd0 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.982+0000 7fb433fff640 1 --2- 172.21.15.53:0/1801752191 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585ec5accd0 0x5585ec9b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.983+0000 7fb4137fe640 10 client.26033 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.983+0000 7fb433fff640 1 --2- 172.21.15.53:0/1801752191 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585ec5accd0 0x5585ec9b23b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f37619c9cf7591f server_cookie=a893509e9cd9236c in_seq=0 out_seq=0 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.983+0000 7fb4137fe640 1 -- 172.21.15.53:0/1801752191 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585ec90c540 con 0x5585ec5accd0 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.983+0000 7fb4137fe640 10 client.26033 handle_command_reply: tid=0 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.983+0000 7fb440f01740 1 client.26033 shutdown 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb440f01740 1 -- 172.21.15.53:0/1801752191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5cd670 msgr2=0x5585ec9a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb440f01740 1 --2- 172.21.15.53:0/1801752191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5cd670 0x5585ec9a04e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0e22a0 tx=0x7fb41c0a7230 comp rx=0 tx=0).stop 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb440f01740 1 -- 172.21.15.53:0/1801752191 shutdown_connections 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb440f01740 1 --2- 172.21.15.53:0/1801752191 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585ec5accd0 0x5585ec9b23b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb440f01740 1 --2- 172.21.15.53:0/1801752191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5ee350 0x5585ec9ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb440f01740 1 --2- 172.21.15.53:0/1801752191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5cd670 0x5585ec9a04e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb440f01740 1 --2- 172.21.15.53:0/1801752191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5c5490 0x5585ec99ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb4137fe640 0 client.26033 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb440f01740 1 -- 172.21.15.53:0/1801752191 >> 172.21.15.53:0/1801752191 conn(0x5585ec5e2740 msgr2=0x5585ec997960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb440f01740 1 -- 172.21.15.53:0/1801752191 shutdown_connections 2024-08-31T06:07:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb440f01740 1 -- 172.21.15.53:0/1801752191 wait complete. 2024-08-31T06:07:46.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:46.984+0000 7fb440f01740 20 client.26033 trim_cache size 0 max 16384 2024-08-31T06:07:47.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.004+0000 7fb440f01740 1 Processor -- start 2024-08-31T06:07:47.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.004+0000 7fb440f01740 1 -- start start 2024-08-31T06:07:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb440f01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5c5490 0x5585ec9a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb440f01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5cd670 0x5585ec997f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb440f01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5ee350 0x5585ec9ac180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb440f01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb4341b5a70 con 0x5585ec5cd670 2024-08-31T06:07:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb440f01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4341b7670 con 0x5585ec5ee350 2024-08-31T06:07:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb440f01740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4341b6140 con 0x5585ec5c5490 2024-08-31T06:07:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb42b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5cd670 0x5585ec997f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb42b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5cd670 0x5585ec997f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38412/0 (socket says 172.21.15.53:38412) 2024-08-31T06:07:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb42b7fe640 1 -- 172.21.15.53:0/563779127 learned_addr learned my addr 172.21.15.53:0/563779127 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb438f29640 1 --2- 172.21.15.53:0/563779127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5ee350 0x5585ec9ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb433fff640 1 --2- 172.21.15.53:0/563779127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5c5490 0x5585ec9a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb42b7fe640 1 -- 172.21.15.53:0/563779127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5c5490 msgr2=0x5585ec9a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/563779127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5c5490 0x5585ec9a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb42b7fe640 1 -- 172.21.15.53:0/563779127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5ee350 msgr2=0x5585ec9ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/563779127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5ee350 0x5585ec9ac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb42b7fe640 1 -- 172.21.15.53:0/563779127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585ec9a1260 con 0x5585ec5cd670 2024-08-31T06:07:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb433fff640 1 --2- 172.21.15.53:0/563779127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5c5490 0x5585ec9a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb438f29640 1 --2- 172.21.15.53:0/563779127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5ee350 0x5585ec9ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.005+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/563779127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5cd670 0x5585ec997f90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0a84b0 tx=0x7fb41c0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f847151e2618b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.006+0000 7fb429ffb640 1 -- 172.21.15.53:0/563779127 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0aa9b0 con 0x5585ec5cd670 2024-08-31T06:07:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.006+0000 7fb429ffb640 1 -- 172.21.15.53:0/563779127 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb41c0ab940 con 0x5585ec5cd670 2024-08-31T06:07:47.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.006+0000 7fb429ffb640 1 -- 172.21.15.53:0/563779127 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0a74d0 con 0x5585ec5cd670 2024-08-31T06:07:47.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.006+0000 7fb440f01740 1 -- 172.21.15.53:0/563779127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5cd670 msgr2=0x5585ec997f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.006+0000 7fb440f01740 1 --2- 172.21.15.53:0/563779127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5cd670 0x5585ec997f90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0a84b0 tx=0x7fb41c0092c0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.007+0000 7fb440f01740 1 -- 172.21.15.53:0/563779127 shutdown_connections 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.007+0000 7fb440f01740 1 --2- 172.21.15.53:0/563779127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5ee350 0x5585ec9ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.007+0000 7fb440f01740 1 --2- 172.21.15.53:0/563779127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5cd670 0x5585ec997f90 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.007+0000 7fb440f01740 1 --2- 172.21.15.53:0/563779127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5c5490 0x5585ec9a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.007+0000 7fb440f01740 1 -- 172.21.15.53:0/563779127 >> 172.21.15.53:0/563779127 conn(0x5585ec5e2740 msgr2=0x5585ec997880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.007+0000 7fb440f01740 1 -- 172.21.15.53:0/563779127 shutdown_connections 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.007+0000 7fb440f01740 1 -- 172.21.15.53:0/563779127 wait complete. 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.007+0000 7fb440f01740 1 -- start start 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.007+0000 7fb440f01740 1 Processor -- start 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb440f01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec9a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb440f01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 0x5585ec9a5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb440f01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5ee350 0x5585eca15e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb440f01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb4341b6ee0 con 0x5585ec5ee350 2024-08-31T06:07:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb440f01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4341b6810 con 0x5585ec5c5490 2024-08-31T06:07:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb440f01740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4341b3a50 con 0x5585ec5cd670 2024-08-31T06:07:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb440f01740 10 client.0 _ll_register_callbacks cb 0x7fb41c0a7100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb433fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec9a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb433fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec9a4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33214/0 (socket says 172.21.15.53:33214) 2024-08-31T06:07:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb433fff640 1 -- 172.21.15.53:0/842799105 learned_addr learned my addr 172.21.15.53:0/842799105 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 0x5585ec9a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb438f29640 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5ee350 0x5585eca15e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb433fff640 1 -- 172.21.15.53:0/842799105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 msgr2=0x5585ec9a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb433fff640 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 0x5585ec9a5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb433fff640 1 -- 172.21.15.53:0/842799105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5ee350 msgr2=0x5585eca15e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb433fff640 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5ee350 0x5585eca15e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb433fff640 1 -- 172.21.15.53:0/842799105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585eca16500 con 0x5585ec5c5490 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 0x5585ec9a5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.008+0000 7fb438f29640 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5ee350 0x5585eca15e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb433fff640 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec9a4d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb4240099d0 tx=0x7fb424011610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2ce77b9b6f53c4f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb4137fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb4137fe640 1 -- 172.21.15.53:0/842799105 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424004c10 con 0x5585ec5c5490 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb440f01740 1 -- 172.21.15.53:0/842799105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb41c0ab940 con 0x5585ec5c5490 2024-08-31T06:07:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb4137fe640 1 -- 172.21.15.53:0/842799105 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb424004db0 con 0x5585ec5c5490 2024-08-31T06:07:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb4137fe640 1 -- 172.21.15.53:0/842799105 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb42403b050 con 0x5585ec5c5490 2024-08-31T06:07:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb440f01740 10 client.26039 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb440f01740 1 -- 172.21.15.53:0/842799105 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5585eca1d960 con 0x5585ec5c5490 2024-08-31T06:07:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb4137fe640 1 -- 172.21.15.53:0/842799105 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb41c0ab940 con 0x5585ec5c5490 2024-08-31T06:07:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb4137fe640 1 -- 172.21.15.53:0/842799105 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb424036030 con 0x5585ec5c5490 2024-08-31T06:07:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb440f01740 10 client.26039 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb440f01740 10 client.26039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.009+0000 7fb440f01740 20 client.26039 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.010+0000 7fb440f01740 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585ec582080 0x5585eca200b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.010+0000 7fb440f01740 4 client.26039 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:07:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.010+0000 7fb440f01740 1 -- 172.21.15.53:0/842799105 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5585ec907fe0 con 0x5585ec582080 2024-08-31T06:07:47.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.010+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585ec582080 0x5585eca200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:47.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.010+0000 7fb4137fe640 10 client.26039 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:47.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.010+0000 7fb42b7fe640 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585ec582080 0x5585eca200b0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f83d26970ec4fa server_cookie=dc5d58e7f77ddd97 in_seq=0 out_seq=0 2024-08-31T06:07:47.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb4137fe640 1 -- 172.21.15.53:0/842799105 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5585ec907fe0 con 0x5585ec582080 2024-08-31T06:07:47.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb4137fe640 10 client.26039 handle_command_reply: tid=0 2024-08-31T06:07:47.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb440f01740 1 client.26039 shutdown 2024-08-31T06:07:47.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb440f01740 1 -- 172.21.15.53:0/842799105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 msgr2=0x5585ec9a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:47.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb440f01740 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec9a4d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb4240099d0 tx=0x7fb424011610 comp rx=0 tx=0).stop 2024-08-31T06:07:47.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb440f01740 1 -- 172.21.15.53:0/842799105 shutdown_connections 2024-08-31T06:07:47.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb440f01740 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585ec582080 0x5585eca200b0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb440f01740 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585ec5ee350 0x5585eca15e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb440f01740 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585ec5cd670 0x5585ec9a5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb4137fe640 0 client.26039 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:47.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb440f01740 1 --2- 172.21.15.53:0/842799105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585ec5c5490 0x5585ec9a4d60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb440f01740 1 -- 172.21.15.53:0/842799105 >> 172.21.15.53:0/842799105 conn(0x5585ec5e2740 msgr2=0x5585ec9957b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:47.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb440f01740 1 -- 172.21.15.53:0/842799105 shutdown_connections 2024-08-31T06:07:47.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.012+0000 7fb440f01740 1 -- 172.21.15.53:0/842799105 wait complete. 2024-08-31T06:07:47.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb440f01740 20 client.26039 trim_cache size 0 max 16384 2024-08-31T06:07:47.020 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:07:47.021 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:07:47.021 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "37b8d261-d715-40ef-b11a-10da2f3a9885", 2024-08-31T06:07:47.021 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:07:47.021 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:07:47.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb43a98c640 1 -- 172.21.15.53:0/1256987203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4200b4ca0 msgr2=0x7fb4200b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb43a98c640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4200b4ca0 0x7fb4200b71b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb42c005ab0 tx=0x7fb42c0056d0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb43a98c640 1 -- 172.21.15.53:0/1256987203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb434105120 msgr2=0x7fb4341a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb43a98c640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb434105120 0x7fb4341a1970 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb41c006fd0 tx=0x7fb41c00b8e0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb43a98c640 1 -- 172.21.15.53:0/1256987203 shutdown_connections 2024-08-31T06:07:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb43a98c640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4200b4ca0 0x7fb4200b71b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb43a98c640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb43410dc00 0x7fb4341ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb43a98c640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb434105120 0x7fb4341a1970 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb43a98c640 1 --2- 172.21.15.53:0/1256987203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4341047d0 0x7fb4341a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb43a98c640 1 -- 172.21.15.53:0/1256987203 >> 172.21.15.53:0/1256987203 conn(0x7fb434079500 msgr2=0x7fb4341009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.013+0000 7fb43a98c640 1 -- 172.21.15.53:0/1256987203 shutdown_connections 2024-08-31T06:07:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:47.014+0000 7fb43a98c640 1 -- 172.21.15.53:0/1256987203 wait complete. 2024-08-31T06:07:47.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:07:47.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:47 smithi053 ceph-mon[18924]: pgmap v408: 97 pgs: 97 active+clean; 38 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-08-31T06:07:47.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:47 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:07:47.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:47 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:47.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:47 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:47.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:47 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:47.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:47 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:47.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:47 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:47.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:47 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:47.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:47 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:47.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 50062 2.98 MB/sec warmup 97 sec latency 69.583 ms 2024-08-31T06:07:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:47 smithi130 ceph-mon[22266]: pgmap v408: 97 pgs: 97 active+clean; 38 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-08-31T06:07:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:47 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:07:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:47 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:47 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:47 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:48.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:47 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:47 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:48.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:47 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:47 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.164 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:47 smithi153 ceph-mon[22320]: pgmap v408: 97 pgs: 97 active+clean; 38 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-08-31T06:07:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:47 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:07:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:47 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:47 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:47 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:47 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:47 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:47 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:47 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.667+0000 7fa502e3e640 1 -- 172.21.15.53:0/3880484180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc10dba0 msgr2=0x7fa4fc1100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:48.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.667+0000 7fa502e3e640 1 --2- 172.21.15.53:0/3880484180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc10dba0 0x7fa4fc1100b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009ca0 tx=0x7fa4f402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.667+0000 7fa502e3e640 1 -- 172.21.15.53:0/3880484180 shutdown_connections 2024-08-31T06:07:48.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.667+0000 7fa502e3e640 1 --2- 172.21.15.53:0/3880484180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc10dba0 0x7fa4fc1100b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.667+0000 7fa502e3e640 1 --2- 172.21.15.53:0/3880484180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4fc105020 0x7fa4fc10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.667+0000 7fa502e3e640 1 --2- 172.21.15.53:0/3880484180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4fc1045f0 0x7fa4fc104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.667+0000 7fa502e3e640 1 -- 172.21.15.53:0/3880484180 >> 172.21.15.53:0/3880484180 conn(0x7fa4fc0794d0 msgr2=0x7fa4fc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.667+0000 7fa502e3e640 1 -- 172.21.15.53:0/3880484180 shutdown_connections 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.667+0000 7fa502e3e640 1 -- 172.21.15.53:0/3880484180 wait complete. 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.668+0000 7fa502e3e640 1 Processor -- start 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.668+0000 7fa502e3e640 1 -- start start 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.668+0000 7fa502e3e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4fc1045f0 0x7fa4fc102500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.668+0000 7fa502e3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc105020 0x7fa4fc102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.668+0000 7fa502e3e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4fc10dba0 0x7fa4fc102f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.668+0000 7fa502e3e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc113740 con 0x7fa4fc105020 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.668+0000 7fa502e3e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc1135c0 con 0x7fa4fc10dba0 2024-08-31T06:07:48.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.668+0000 7fa502e3e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc1138c0 con 0x7fa4fc1045f0 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa500bda640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4fc1045f0 0x7fa4fc102500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa4fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc105020 0x7fa4fc102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa500bda640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4fc1045f0 0x7fa4fc102500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:33290/0 (socket says 172.21.15.53:33290) 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa500bda640 1 -- 172.21.15.53:0/2317581593 learned_addr learned my addr 172.21.15.53:0/2317581593 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa5013db640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4fc10dba0 0x7fa4fc102f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa4fbfff640 1 -- 172.21.15.53:0/2317581593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4fc1045f0 msgr2=0x7fa4fc102500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4fc1045f0 0x7fa4fc102500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa4fbfff640 1 -- 172.21.15.53:0/2317581593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4fc10dba0 msgr2=0x7fa4fc102f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4fc10dba0 0x7fa4fc102f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa4fbfff640 1 -- 172.21.15.53:0/2317581593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc1a8450 con 0x7fa4fc105020 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa500bda640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4fc1045f0 0x7fa4fc102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc105020 0x7fa4fc102a40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc06b690 tx=0x7fa4e800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa4f9ffb640 1 -- 172.21.15.53:0/2317581593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800cc40 con 0x7fa4fc105020 2024-08-31T06:07:48.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa4f9ffb640 1 -- 172.21.15.53:0/2317581593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4e800cde0 con 0x7fa4fc105020 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.669+0000 7fa502e3e640 1 -- 172.21.15.53:0/2317581593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4fc1a8740 con 0x7fa4fc105020 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.670+0000 7fa4f9ffb640 1 -- 172.21.15.53:0/2317581593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80186f0 con 0x7fa4fc105020 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.670+0000 7fa502e3e640 1 -- 172.21.15.53:0/2317581593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4fc1a8c80 con 0x7fa4fc105020 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa4f9ffb640 1 -- 172.21.15.53:0/2317581593 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa4e8018890 con 0x7fa4fc105020 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa5093b3740 1 Processor -- start 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa5093b3740 1 -- start start 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 0x562bacfd62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 0x562bacfd6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc10390 0x562bacfd6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa5093b3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562bacf4d630 con 0x562bacc081b0 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa5093b3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562bacf3cbc0 con 0x562bacc31070 2024-08-31T06:07:48.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa5093b3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562bacf40b70 con 0x562bacc10390 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa5013db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 0x562bacfd62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa5013db640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 0x562bacfd62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33246/0 (socket says 172.21.15.53:33246) 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa5013db640 1 -- 172.21.15.53:0/746959318 learned_addr learned my addr 172.21.15.53:0/746959318 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa500bda640 1 --2- 172.21.15.53:0/746959318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 0x562bacfd6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.673+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/746959318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc10390 0x562bacfd6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa5013db640 1 -- 172.21.15.53:0/746959318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc10390 msgr2=0x562bacfd6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa5013db640 1 --2- 172.21.15.53:0/746959318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc10390 0x562bacfd6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa5013db640 1 -- 172.21.15.53:0/746959318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 msgr2=0x562bacfd6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa5013db640 1 --2- 172.21.15.53:0/746959318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 0x562bacfd6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa5013db640 1 -- 172.21.15.53:0/746959318 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bacc9c650 con 0x562bacc31070 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/746959318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc10390 0x562bacfd6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa4f9ffb640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4ec0b4ca0 0x7fa4ec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa500bda640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4ec0b4ca0 0x7fa4ec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa5013db640 1 --2- 172.21.15.53:0/746959318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 0x562bacfd62c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009ca0 tx=0x7fa4f4009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee08a0cf38cc2f22 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa4f9ffb640 1 -- 172.21.15.53:0/2317581593 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa4e80e5800 con 0x7fa4fc105020 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa4e6ffd640 1 -- 172.21.15.53:0/746959318 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4031790 con 0x562bacc31070 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa4e6ffd640 1 -- 172.21.15.53:0/746959318 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4f4036030 con 0x562bacc31070 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.674+0000 7fa4e6ffd640 1 -- 172.21.15.53:0/746959318 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40042d0 con 0x562bacc31070 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.675+0000 7fa5093b3740 1 -- 172.21.15.53:0/746959318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 msgr2=0x562bacfd62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.675+0000 7fa500bda640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4ec0b4ca0 0x7fa4ec0b71b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x562bacfd4f40 tx=0x7fa4f0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.675+0000 7fa5093b3740 1 --2- 172.21.15.53:0/746959318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 0x562bacfd62c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009ca0 tx=0x7fa4f4009a20 comp rx=0 tx=0).stop 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.675+0000 7fa5093b3740 1 -- 172.21.15.53:0/746959318 shutdown_connections 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.675+0000 7fa5093b3740 1 --2- 172.21.15.53:0/746959318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc10390 0x562bacfd6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.675+0000 7fa5093b3740 1 --2- 172.21.15.53:0/746959318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 0x562bacfd6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.675+0000 7fa5093b3740 1 --2- 172.21.15.53:0/746959318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 0x562bacfd62c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.675+0000 7fa5093b3740 1 -- 172.21.15.53:0/746959318 >> 172.21.15.53:0/746959318 conn(0x562bacc25460 msgr2=0x562bacfd41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:48.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.675+0000 7fa5093b3740 1 -- 172.21.15.53:0/746959318 shutdown_connections 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.675+0000 7fa5093b3740 1 -- 172.21.15.53:0/746959318 wait complete. 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.676+0000 7fa5093b3740 1 -- start start 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.676+0000 7fa5093b3740 1 Processor -- start 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.676+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 0x562bacfe1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.676+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc10390 0x562bacfe2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.676+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc31070 0x562bacfedbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.676+0000 7fa5093b3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562bacd9f700 con 0x562bacc081b0 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.676+0000 7fa5093b3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562bacec3700 con 0x562bacc10390 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.676+0000 7fa5093b3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562bacfe48c0 con 0x562bacc31070 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa500bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 0x562bacfe1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.676+0000 7fa5093b3740 10 client.0 _ll_register_callbacks cb 0x562bacef2dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa500bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 0x562bacfe1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38462/0 (socket says 172.21.15.53:38462) 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa500bda640 1 -- 172.21.15.53:0/1310695922 learned_addr learned my addr 172.21.15.53:0/1310695922 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:48.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc10390 0x562bacfe2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa5013db640 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc31070 0x562bacfedbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa4fbfff640 1 -- 172.21.15.53:0/1310695922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc31070 msgr2=0x562bacfedbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc31070 0x562bacfedbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa4fbfff640 1 -- 172.21.15.53:0/1310695922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 msgr2=0x562bacfe1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 0x562bacfe1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa4fbfff640 1 -- 172.21.15.53:0/1310695922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bacefc8b0 con 0x562bacc10390 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa500bda640 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 0x562bacfe1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc10390 0x562bacfe2020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80e2f50 tx=0x7fa4e80a7f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbe11d58a11a26b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa4dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa4dbfff640 1 -- 172.21.15.53:0/1310695922 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80e8e60 con 0x562bacc10390 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa4dbfff640 1 -- 172.21.15.53:0/1310695922 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa4e80ab410 con 0x562bacc10390 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.677+0000 7fa5093b3740 1 -- 172.21.15.53:0/1310695922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4f4036030 con 0x562bacc10390 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa4dbfff640 1 -- 172.21.15.53:0/1310695922 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa4e80abab0 con 0x562bacc10390 2024-08-31T06:07:48.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa5093b3740 10 client.26051 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa5093b3740 1 -- 172.21.15.53:0/1310695922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562bacff06f0 con 0x562bacc10390 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa4dbfff640 1 -- 172.21.15.53:0/1310695922 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4f4036030 con 0x562bacc10390 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa4dbfff640 1 -- 172.21.15.53:0/1310695922 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa4e8018b80 con 0x562bacc10390 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa5093b3740 10 client.26051 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa5093b3740 10 client.26051 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa5093b3740 20 client.26051 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa5093b3740 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562bacbef9f0 0x562bacff3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa5093b3740 4 client.26051 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa5093b3740 1 -- 172.21.15.53:0/1310695922 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bacf4f580 con 0x562bacbef9f0 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.678+0000 7fa500bda640 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562bacbef9f0 0x562bacff3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.679+0000 7fa4dbfff640 10 client.26051 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.679+0000 7fa500bda640 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562bacbef9f0 0x562bacff3c10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80c4a47f5906d956 server_cookie=9accd69b910a05c7 in_seq=0 out_seq=0 2024-08-31T06:07:48.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.679+0000 7fa4dbfff640 1 -- 172.21.15.53:0/1310695922 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562bacf4f580 con 0x562bacbef9f0 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.679+0000 7fa4dbfff640 10 client.26051 handle_command_reply: tid=0 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 1 client.26051 shutdown 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 1 -- 172.21.15.53:0/1310695922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc10390 msgr2=0x562bacfe2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc10390 0x562bacfe2020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80e2f50 tx=0x7fa4e80a7f30 comp rx=0 tx=0).stop 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 1 -- 172.21.15.53:0/1310695922 shutdown_connections 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562bacbef9f0 0x562bacff3c10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc31070 0x562bacfedbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc10390 0x562bacfe2020 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 1 --2- 172.21.15.53:0/1310695922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc081b0 0x562bacfe1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 1 -- 172.21.15.53:0/1310695922 >> 172.21.15.53:0/1310695922 conn(0x562bacc25460 msgr2=0x562bacfd94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa4dbfff640 0 client.26051 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 1 -- 172.21.15.53:0/1310695922 shutdown_connections 2024-08-31T06:07:48.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 1 -- 172.21.15.53:0/1310695922 wait complete. 2024-08-31T06:07:48.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.680+0000 7fa5093b3740 20 client.26051 trim_cache size 0 max 16384 2024-08-31T06:07:48.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.699+0000 7fa5093b3740 1 Processor -- start 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.699+0000 7fa5093b3740 1 -- start start 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.699+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc081b0 0x562bacfd93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.699+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 0x562bacfd9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 0x562bacfdecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa5093b3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc1b16d0 con 0x562bacc10390 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa5093b3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc1b32d0 con 0x562bacc31070 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa5093b3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc1b1da0 con 0x562bacc081b0 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 0x562bacfd9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 0x562bacfd9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38466/0 (socket says 172.21.15.53:38466) 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa500bda640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc081b0 0x562bacfd93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4fbfff640 1 -- 172.21.15.53:0/3979360904 learned_addr learned my addr 172.21.15.53:0/3979360904 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa5013db640 1 --2- 172.21.15.53:0/3979360904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 0x562bacfdecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4fbfff640 1 -- 172.21.15.53:0/3979360904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc081b0 msgr2=0x562bacfd93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/3979360904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc081b0 0x562bacfd93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4fbfff640 1 -- 172.21.15.53:0/3979360904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 msgr2=0x562bacfdecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/3979360904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 0x562bacfdecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4fbfff640 1 -- 172.21.15.53:0/3979360904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bacfe2da0 con 0x562bacc10390 2024-08-31T06:07:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/3979360904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 0x562bacfd9900 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8000c00 tx=0x7fa4e80abe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b5b97d9c743130 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4e67fc640 1 -- 172.21.15.53:0/3979360904 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80e8e60 con 0x562bacc10390 2024-08-31T06:07:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4e67fc640 1 -- 172.21.15.53:0/3979360904 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4e80b0760 con 0x562bacc10390 2024-08-31T06:07:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.700+0000 7fa4e67fc640 1 -- 172.21.15.53:0/3979360904 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80930e0 con 0x562bacc10390 2024-08-31T06:07:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.701+0000 7fa5093b3740 1 -- 172.21.15.53:0/3979360904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 msgr2=0x562bacfd9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.701+0000 7fa5093b3740 1 --2- 172.21.15.53:0/3979360904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 0x562bacfd9900 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8000c00 tx=0x7fa4e80abe30 comp rx=0 tx=0).stop 2024-08-31T06:07:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.701+0000 7fa5093b3740 1 -- 172.21.15.53:0/3979360904 shutdown_connections 2024-08-31T06:07:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.701+0000 7fa5093b3740 1 --2- 172.21.15.53:0/3979360904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc31070 0x562bacfdecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.701+0000 7fa5093b3740 1 --2- 172.21.15.53:0/3979360904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 0x562bacfd9900 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.701+0000 7fa5093b3740 1 --2- 172.21.15.53:0/3979360904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc081b0 0x562bacfd93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.701+0000 7fa5093b3740 1 -- 172.21.15.53:0/3979360904 >> 172.21.15.53:0/3979360904 conn(0x562bacc25460 msgr2=0x562bacfe1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.701+0000 7fa5093b3740 1 -- 172.21.15.53:0/3979360904 shutdown_connections 2024-08-31T06:07:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.701+0000 7fa5093b3740 1 -- 172.21.15.53:0/3979360904 wait complete. 2024-08-31T06:07:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.702+0000 7fa5093b3740 1 -- start start 2024-08-31T06:07:48.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.702+0000 7fa5093b3740 1 Processor -- start 2024-08-31T06:07:48.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.702+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc081b0 0x562bacfe5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.702+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 0x562bacfe6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.702+0000 7fa5093b3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc31070 0x562bad05d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.702+0000 7fa5093b3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc1b2b40 con 0x562bacc10390 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.702+0000 7fa5093b3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc1b2470 con 0x562bacc081b0 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.702+0000 7fa5093b3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc1af6b0 con 0x562bacc31070 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa5093b3740 10 client.0 _ll_register_callbacks cb 0x7fa4e80eb260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa500bda640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc081b0 0x562bacfe5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa5013db640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc31070 0x562bad05d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa500bda640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc081b0 0x562bacfe5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33268/0 (socket says 172.21.15.53:33268) 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa500bda640 1 -- 172.21.15.53:0/4192738725 learned_addr learned my addr 172.21.15.53:0/4192738725 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 0x562bacfe6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa500bda640 1 -- 172.21.15.53:0/4192738725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc31070 msgr2=0x562bad05d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa500bda640 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc31070 0x562bad05d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa500bda640 1 -- 172.21.15.53:0/4192738725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 msgr2=0x562bacfe6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa500bda640 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 0x562bacfe6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa500bda640 1 -- 172.21.15.53:0/4192738725 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bad05db50 con 0x562bacc081b0 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 0x562bacfe6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa500bda640 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc081b0 0x562bacfe5f40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009600 tx=0x7fa4f00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2403470a964d90c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.703+0000 7fa4dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa4dbfff640 1 -- 172.21.15.53:0/4192738725 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00119c0 con 0x562bacc081b0 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa4dbfff640 1 -- 172.21.15.53:0/4192738725 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa4f0018070 con 0x562bacc081b0 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa5093b3740 1 -- 172.21.15.53:0/4192738725 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4e80b0760 con 0x562bacc081b0 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa4dbfff640 1 -- 172.21.15.53:0/4192738725 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa4f0011b60 con 0x562bacc081b0 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa5093b3740 10 client.26057 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa5093b3740 1 -- 172.21.15.53:0/4192738725 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562bad05ed60 con 0x562bacc081b0 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa4dbfff640 1 -- 172.21.15.53:0/4192738725 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4e80b0760 con 0x562bacc081b0 2024-08-31T06:07:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa4dbfff640 1 -- 172.21.15.53:0/4192738725 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa4f0004810 con 0x562bacc081b0 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa5093b3740 10 client.26057 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa5093b3740 10 client.26057 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa5093b3740 20 client.26057 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa5093b3740 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562bacbc4da0 0x562bad061640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa5093b3740 4 client.26057 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.704+0000 7fa5093b3740 1 -- 172.21.15.53:0/4192738725 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562bacf4b020 con 0x562bacbc4da0 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562bacbc4da0 0x562bad061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa4dbfff640 10 client.26057 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa4fbfff640 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562bacbc4da0 0x562bad061640 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c38df2532a0bde12 server_cookie=587583a0b454d0e0 in_seq=0 out_seq=0 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa4dbfff640 1 -- 172.21.15.53:0/4192738725 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x562bacf4b020 con 0x562bacbc4da0 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa4dbfff640 10 client.26057 handle_command_reply: tid=0 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa5093b3740 1 client.26057 shutdown 2024-08-31T06:07:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa5093b3740 1 -- 172.21.15.53:0/4192738725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc081b0 msgr2=0x562bacfe5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa5093b3740 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc081b0 0x562bacfe5f40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009600 tx=0x7fa4f00046c0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa5093b3740 1 -- 172.21.15.53:0/4192738725 shutdown_connections 2024-08-31T06:07:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa5093b3740 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562bacbc4da0 0x562bad061640 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa5093b3740 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562bacc31070 0x562bad05d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa5093b3740 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bacc10390 0x562bacfe6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa5093b3740 1 --2- 172.21.15.53:0/4192738725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562bacc081b0 0x562bacfe5f40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.705+0000 7fa5093b3740 1 -- 172.21.15.53:0/4192738725 >> 172.21.15.53:0/4192738725 conn(0x562bacc25460 msgr2=0x562bacfd93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.706+0000 7fa4dbfff640 0 client.26057 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.706+0000 7fa5093b3740 1 -- 172.21.15.53:0/4192738725 shutdown_connections 2024-08-31T06:07:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.706+0000 7fa5093b3740 1 -- 172.21.15.53:0/4192738725 wait complete. 2024-08-31T06:07:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.706+0000 7fa5093b3740 20 client.26057 trim_cache size 0 max 16384 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "37b8d261-d715-40ef-b11a-10da2f3a9885", 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:48.714 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:48.715 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:48.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:48.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:48.717 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:07:48.717 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:07:48.717 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:07:48.717 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:07:48.717 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:07:48.717 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:07:48.717 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:07:48.717 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:48.717 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:48.717 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:07:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.706+0000 7fa502e3e640 1 -- 172.21.15.53:0/2317581593 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4ec0b4ca0 msgr2=0x7fa4ec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.706+0000 7fa502e3e640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4ec0b4ca0 0x7fa4ec0b71b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x562bacfd4f40 tx=0x7fa4f0005f90 comp rx=0 tx=0).stop 2024-08-31T06:07:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.706+0000 7fa502e3e640 1 -- 172.21.15.53:0/2317581593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc105020 msgr2=0x7fa4fc102a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.706+0000 7fa502e3e640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc105020 0x7fa4fc102a40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc06b690 tx=0x7fa4e800ee50 comp rx=0 tx=0).stop 2024-08-31T06:07:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.707+0000 7fa502e3e640 1 -- 172.21.15.53:0/2317581593 shutdown_connections 2024-08-31T06:07:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.707+0000 7fa502e3e640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4ec0b4ca0 0x7fa4ec0b71b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.707+0000 7fa502e3e640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4fc10dba0 0x7fa4fc102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.707+0000 7fa502e3e640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc105020 0x7fa4fc102a40 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.707+0000 7fa502e3e640 1 --2- 172.21.15.53:0/2317581593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4fc1045f0 0x7fa4fc102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:48.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.707+0000 7fa502e3e640 1 -- 172.21.15.53:0/2317581593 >> 172.21.15.53:0/2317581593 conn(0x7fa4fc0794d0 msgr2=0x7fa4fc0ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:48.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.707+0000 7fa502e3e640 1 -- 172.21.15.53:0/2317581593 shutdown_connections 2024-08-31T06:07:48.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:48.707+0000 7fa502e3e640 1 -- 172.21.15.53:0/2317581593 wait complete. 2024-08-31T06:07:48.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 50350 2.95 MB/sec warmup 98 sec latency 29.980 ms 2024-08-31T06:07:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:48 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:48 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:48 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:48 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:48 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:48 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:48 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:48 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:48 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:07:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:48 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:49.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:48 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:49.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:48 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:49.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:48 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:49.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:48 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:49.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:48 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:49.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:48 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:49.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:48 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:49.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:48 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:49.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:48 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:07:49.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:48 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:49.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:48 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:49.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:48 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:49.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:48 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:49.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:48 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:49.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:48 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:49.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:48 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:49.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:48 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:49.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:48 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:49.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:48 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:07:49.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:48 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:07:49.696 INFO:tasks.cephfs.filesystem:scrub status for tag:37b8d261-d715-40ef-b11a-10da2f3a9885 - {'path': '/', 'tag': '37b8d261-d715-40ef-b11a-10da2f3a9885', 'options': 'recursive,force'} 2024-08-31T06:07:49.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 50844 2.94 MB/sec warmup 99 sec latency 15.597 ms 2024-08-31T06:07:49.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:49 smithi053 ceph-mon[18924]: pgmap v409: 97 pgs: 97 active+clean; 38 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 1.4 MiB/s wr, 162 op/s 2024-08-31T06:07:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:49 smithi130 ceph-mon[22266]: pgmap v409: 97 pgs: 97 active+clean; 38 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 1.4 MiB/s wr, 162 op/s 2024-08-31T06:07:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:49 smithi153 ceph-mon[22320]: pgmap v409: 97 pgs: 97 active+clean; 38 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 1.4 MiB/s wr, 162 op/s 2024-08-31T06:07:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.198+0000 7fac3a069640 1 -- 172.21.15.53:0/1249093997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac34101f20 msgr2=0x7fac34102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.198+0000 7fac3a069640 1 --2- 172.21.15.53:0/1249093997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac34101f20 0x7fac34102330 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fac24009900 tx=0x7fac2402a410 comp rx=0 tx=0).stop 2024-08-31T06:07:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.198+0000 7fac3a069640 1 -- 172.21.15.53:0/1249093997 shutdown_connections 2024-08-31T06:07:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.198+0000 7fac3a069640 1 --2- 172.21.15.53:0/1249093997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac341081a0 0x7fac3410e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.198+0000 7fac3a069640 1 --2- 172.21.15.53:0/1249093997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac34107850 0x7fac34107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.198+0000 7fac3a069640 1 --2- 172.21.15.53:0/1249093997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac34101f20 0x7fac34102330 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.198+0000 7fac3a069640 1 -- 172.21.15.53:0/1249093997 >> 172.21.15.53:0/1249093997 conn(0x7fac34079c30 msgr2=0x7fac3407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.199+0000 7fac3a069640 1 -- 172.21.15.53:0/1249093997 shutdown_connections 2024-08-31T06:07:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.199+0000 7fac3a069640 1 -- 172.21.15.53:0/1249093997 wait complete. 2024-08-31T06:07:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.199+0000 7fac3a069640 1 Processor -- start 2024-08-31T06:07:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac3a069640 1 -- start start 2024-08-31T06:07:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac3a069640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac34101f20 0x7fac3419af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac3a069640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac34107850 0x7fac3419b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac3a069640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac341081a0 0x7fac3419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac3a069640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fac34112590 con 0x7fac34107850 2024-08-31T06:07:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac3a069640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac34112410 con 0x7fac341081a0 2024-08-31T06:07:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac3a069640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac34112710 con 0x7fac34101f20 2024-08-31T06:07:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac32ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac34107850 0x7fac3419b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac32ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac34107850 0x7fac3419b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38484/0 (socket says 172.21.15.53:38484) 2024-08-31T06:07:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac32ffd640 1 -- 172.21.15.53:0/3840239569 learned_addr learned my addr 172.21.15.53:0/3840239569 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac33fff640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac341081a0 0x7fac3419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac337fe640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac34101f20 0x7fac3419af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac32ffd640 1 -- 172.21.15.53:0/3840239569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac34101f20 msgr2=0x7fac3419af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac32ffd640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac34101f20 0x7fac3419af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac32ffd640 1 -- 172.21.15.53:0/3840239569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac341081a0 msgr2=0x7fac3419b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac32ffd640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac341081a0 0x7fac3419b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.200+0000 7fac32ffd640 1 -- 172.21.15.53:0/3840239569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac341a61f0 con 0x7fac34107850 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.201+0000 7fac32ffd640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac34107850 0x7fac3419b4a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fac2800e9f0 tx=0x7fac2800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.201+0000 7fac30ff9640 1 -- 172.21.15.53:0/3840239569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2800ccc0 con 0x7fac34107850 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.201+0000 7fac3a069640 1 -- 172.21.15.53:0/3840239569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac341a64e0 con 0x7fac34107850 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.201+0000 7fac30ff9640 1 -- 172.21.15.53:0/3840239569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac280108c0 con 0x7fac34107850 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.201+0000 7fac30ff9640 1 -- 172.21.15.53:0/3840239569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28018660 con 0x7fac34107850 2024-08-31T06:07:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.201+0000 7fac3a069640 1 -- 172.21.15.53:0/3840239569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac341a6a80 con 0x7fac34107850 2024-08-31T06:07:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac40fd8740 1 Processor -- start 2024-08-31T06:07:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac40fd8740 1 -- start start 2024-08-31T06:07:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac30ff9640 1 -- 172.21.15.53:0/3840239569 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fac28018840 con 0x7fac34107850 2024-08-31T06:07:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac40fd8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ae6f835000 con 0x55ae6f51c1b0 2024-08-31T06:07:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac40fd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ae6f824590 con 0x55ae6f4f32f0 2024-08-31T06:07:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac40fd8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ae6f828540 con 0x55ae6f4fb4d0 2024-08-31T06:07:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac33fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac33fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38496/0 (socket says 172.21.15.53:38496) 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac33fff640 1 -- 172.21.15.53:0/505911219 learned_addr learned my addr 172.21.15.53:0/505911219 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.204+0000 7fac32ffd640 1 --2- 172.21.15.53:0/505911219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac33fff640 1 -- 172.21.15.53:0/505911219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f4fb4d0 msgr2=0x55ae6f8c0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac33fff640 1 --2- 172.21.15.53:0/505911219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8c0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac33fff640 1 -- 172.21.15.53:0/505911219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4f32f0 msgr2=0x55ae6f8c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac33fff640 1 --2- 172.21.15.53:0/505911219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8c0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac33fff640 1 -- 172.21.15.53:0/505911219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae6f587790 con 0x55ae6f51c1b0 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac30ff9640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac1c0b4ca0 0x7fac1c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac33fff640 1 --2- 172.21.15.53:0/505911219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8bfce0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009fd0 tx=0x7fac2c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee35b792588b37e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac337fe640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac1c0b4ca0 0x7fac1c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac19ffb640 1 -- 172.21.15.53:0/505911219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c004d20 con 0x55ae6f51c1b0 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac30ff9640 1 -- 172.21.15.53:0/3840239569 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fac280e5950 con 0x7fac34107850 2024-08-31T06:07:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac19ffb640 1 -- 172.21.15.53:0/505911219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac2c004050 con 0x55ae6f51c1b0 2024-08-31T06:07:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.205+0000 7fac19ffb640 1 -- 172.21.15.53:0/505911219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c005240 con 0x55ae6f51c1b0 2024-08-31T06:07:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.206+0000 7fac40fd8740 1 -- 172.21.15.53:0/505911219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f51c1b0 msgr2=0x55ae6f8bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.206+0000 7fac40fd8740 1 --2- 172.21.15.53:0/505911219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8bfce0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009fd0 tx=0x7fac2c0118d0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.206+0000 7fac337fe640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac1c0b4ca0 0x7fac1c0b71b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fac3410fef0 tx=0x7fac240058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.206+0000 7fac40fd8740 1 -- 172.21.15.53:0/505911219 shutdown_connections 2024-08-31T06:07:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.206+0000 7fac40fd8740 1 --2- 172.21.15.53:0/505911219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.206+0000 7fac40fd8740 1 --2- 172.21.15.53:0/505911219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.206+0000 7fac40fd8740 1 --2- 172.21.15.53:0/505911219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8bfce0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.206+0000 7fac40fd8740 1 -- 172.21.15.53:0/505911219 >> 172.21.15.53:0/505911219 conn(0x55ae6f510300 msgr2=0x55ae6f8bdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.206+0000 7fac40fd8740 1 -- 172.21.15.53:0/505911219 shutdown_connections 2024-08-31T06:07:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.206+0000 7fac40fd8740 1 -- 172.21.15.53:0/505911219 wait complete. 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac40fd8740 1 -- start start 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac40fd8740 1 Processor -- start 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8dbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac40fd8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ae6f75dab0 con 0x55ae6f4f32f0 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac40fd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ae6f7ab680 con 0x55ae6f4fb4d0 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac40fd8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ae6f8d2840 con 0x55ae6f51c1b0 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac40fd8740 10 client.0 _ll_register_callbacks cb 0x55ae6f533a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38502/0 (socket says 172.21.15.53:38502) 2024-08-31T06:07:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac337fe640 1 -- 172.21.15.53:0/1743129295 learned_addr learned my addr 172.21.15.53:0/1743129295 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.207+0000 7fac33fff640 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8dbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac32ffd640 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac337fe640 1 -- 172.21.15.53:0/1743129295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 msgr2=0x55ae6f8dbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac337fe640 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8dbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac337fe640 1 -- 172.21.15.53:0/1743129295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 msgr2=0x55ae6f8d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac337fe640 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac337fe640 1 -- 172.21.15.53:0/1743129295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae6f600620 con 0x55ae6f4f32f0 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac33fff640 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8dbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac337fe640 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cfcb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fac24009900 tx=0x7fac24009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4d1e8044e701bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac12ffd640 1 -- 172.21.15.53:0/1743129295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24035040 con 0x55ae6f4f32f0 2024-08-31T06:07:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac40fd8740 1 -- 172.21.15.53:0/1743129295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac2c004050 con 0x55ae6f4f32f0 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac12ffd640 1 -- 172.21.15.53:0/1743129295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fac24004240 con 0x55ae6f4f32f0 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac12ffd640 1 -- 172.21.15.53:0/1743129295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fac24004440 con 0x55ae6f4f32f0 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac40fd8740 10 client.16650 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.208+0000 7fac40fd8740 1 -- 172.21.15.53:0/1743129295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ae6f8de8e0 con 0x55ae6f4f32f0 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.209+0000 7fac12ffd640 1 -- 172.21.15.53:0/1743129295 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac2c004050 con 0x55ae6f4f32f0 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.209+0000 7fac12ffd640 1 -- 172.21.15.53:0/1743129295 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fac24044070 con 0x55ae6f4f32f0 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.209+0000 7fac40fd8740 10 client.16650 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.209+0000 7fac40fd8740 10 client.16650 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.209+0000 7fac40fd8740 20 client.16650 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.209+0000 7fac40fd8740 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae6f4dad80 0x55ae6f8e1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.209+0000 7fac40fd8740 4 client.16650 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.209+0000 7fac40fd8740 1 -- 172.21.15.53:0/1743129295 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae6f836f50 con 0x55ae6f4dad80 2024-08-31T06:07:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.209+0000 7fac32ffd640 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae6f4dad80 0x55ae6f8e1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.209+0000 7fac12ffd640 10 client.16650 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.209+0000 7fac32ffd640 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae6f4dad80 0x55ae6f8e1f00 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46a70d02e7f39af0 server_cookie=ec6a2b54aae08890 in_seq=0 out_seq=0 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac12ffd640 1 -- 172.21.15.53:0/1743129295 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae6f836f50 con 0x55ae6f4dad80 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac12ffd640 10 client.16650 handle_command_reply: tid=0 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac40fd8740 1 client.16650 shutdown 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac40fd8740 1 -- 172.21.15.53:0/1743129295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 msgr2=0x55ae6f8cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac40fd8740 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cfcb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fac24009900 tx=0x7fac24009260 comp rx=0 tx=0).stop 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac40fd8740 1 -- 172.21.15.53:0/1743129295 shutdown_connections 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac40fd8740 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae6f4dad80 0x55ae6f8e1f00 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac40fd8740 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8dbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac40fd8740 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac12ffd640 0 client.16650 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac40fd8740 1 --2- 172.21.15.53:0/1743129295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cfcb0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.210+0000 7fac40fd8740 1 -- 172.21.15.53:0/1743129295 >> 172.21.15.53:0/1743129295 conn(0x55ae6f510300 msgr2=0x55ae6f8c16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.211+0000 7fac40fd8740 1 -- 172.21.15.53:0/1743129295 shutdown_connections 2024-08-31T06:07:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.211+0000 7fac40fd8740 1 -- 172.21.15.53:0/1743129295 wait complete. 2024-08-31T06:07:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.211+0000 7fac40fd8740 20 client.16650 trim_cache size 0 max 16384 2024-08-31T06:07:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.226+0000 7fac40fd8740 1 Processor -- start 2024-08-31T06:07:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.226+0000 7fac40fd8740 1 -- start start 2024-08-31T06:07:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8bd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8bd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac40fd8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fac341ad1f0 con 0x55ae6f4f32f0 2024-08-31T06:07:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac40fd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac341aedf0 con 0x55ae6f4fb4d0 2024-08-31T06:07:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac40fd8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac341ad8c0 con 0x55ae6f51c1b0 2024-08-31T06:07:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38518/0 (socket says 172.21.15.53:38518) 2024-08-31T06:07:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac337fe640 1 -- 172.21.15.53:0/42998864 learned_addr learned my addr 172.21.15.53:0/42998864 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:50.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac32ffd640 1 --2- 172.21.15.53:0/42998864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac33fff640 1 --2- 172.21.15.53:0/42998864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8bd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac337fe640 1 -- 172.21.15.53:0/42998864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 msgr2=0x55ae6f8bd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:50.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac337fe640 1 --2- 172.21.15.53:0/42998864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8bd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac337fe640 1 -- 172.21.15.53:0/42998864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 msgr2=0x55ae6f8bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:50.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac337fe640 1 --2- 172.21.15.53:0/42998864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8bd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac337fe640 1 -- 172.21.15.53:0/42998864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae6f8c5d40 con 0x55ae6f4f32f0 2024-08-31T06:07:50.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.227+0000 7fac337fe640 1 --2- 172.21.15.53:0/42998864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cff80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fac2402a930 tx=0x7fac2402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f2ecc6fd63f651 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:50.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.228+0000 7fac197fa640 1 -- 172.21.15.53:0/42998864 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24035040 con 0x55ae6f4f32f0 2024-08-31T06:07:50.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.228+0000 7fac197fa640 1 -- 172.21.15.53:0/42998864 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac240508c0 con 0x55ae6f4f32f0 2024-08-31T06:07:50.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.228+0000 7fac197fa640 1 -- 172.21.15.53:0/42998864 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24058780 con 0x55ae6f4f32f0 2024-08-31T06:07:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.229+0000 7fac40fd8740 1 -- 172.21.15.53:0/42998864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 msgr2=0x55ae6f8cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.229+0000 7fac40fd8740 1 --2- 172.21.15.53:0/42998864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cff80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fac2402a930 tx=0x7fac2402a410 comp rx=0 tx=0).stop 2024-08-31T06:07:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.229+0000 7fac40fd8740 1 -- 172.21.15.53:0/42998864 shutdown_connections 2024-08-31T06:07:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.229+0000 7fac40fd8740 1 --2- 172.21.15.53:0/42998864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8bd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.229+0000 7fac40fd8740 1 --2- 172.21.15.53:0/42998864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8bd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.229+0000 7fac40fd8740 1 --2- 172.21.15.53:0/42998864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8cff80 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.229+0000 7fac40fd8740 1 -- 172.21.15.53:0/42998864 >> 172.21.15.53:0/42998864 conn(0x55ae6f510300 msgr2=0x55ae6f8ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.229+0000 7fac40fd8740 1 -- 172.21.15.53:0/42998864 shutdown_connections 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.229+0000 7fac40fd8740 1 -- 172.21.15.53:0/42998864 wait complete. 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.229+0000 7fac40fd8740 1 -- start start 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.229+0000 7fac40fd8740 1 Processor -- start 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8d3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8d4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac40fd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8d4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac40fd8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fac341ae660 con 0x55ae6f4f32f0 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac40fd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac341adf90 con 0x55ae6f4fb4d0 2024-08-31T06:07:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac40fd8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac341ab1d0 con 0x55ae6f51c1b0 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac40fd8740 10 client.0 _ll_register_callbacks cb 0x7fac24009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8d3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8d3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38520/0 (socket says 172.21.15.53:38520) 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac337fe640 1 -- 172.21.15.53:0/2997703045 learned_addr learned my addr 172.21.15.53:0/2997703045 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac32ffd640 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8d4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac33fff640 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8d4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac337fe640 1 -- 172.21.15.53:0/2997703045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 msgr2=0x55ae6f8d4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac337fe640 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8d4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac337fe640 1 -- 172.21.15.53:0/2997703045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 msgr2=0x55ae6f8d4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac337fe640 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8d4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac337fe640 1 -- 172.21.15.53:0/2997703045 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae6f94bac0 con 0x55ae6f4f32f0 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.230+0000 7fac32ffd640 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8d4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac337fe640 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8d3cf0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fac24031ca0 tx=0x7fac240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39215f009743758b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac12ffd640 1 -- 172.21.15.53:0/2997703045 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24068020 con 0x55ae6f4f32f0 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac12ffd640 1 -- 172.21.15.53:0/2997703045 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fac24050c70 con 0x55ae6f4f32f0 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac40fd8740 1 -- 172.21.15.53:0/2997703045 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac240508c0 con 0x55ae6f4f32f0 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac12ffd640 1 -- 172.21.15.53:0/2997703045 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fac24073050 con 0x55ae6f4f32f0 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac40fd8740 10 client.16656 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac40fd8740 1 -- 172.21.15.53:0/2997703045 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ae6f94cd50 con 0x55ae6f4f32f0 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac12ffd640 1 -- 172.21.15.53:0/2997703045 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac240508c0 con 0x55ae6f4f32f0 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac12ffd640 1 -- 172.21.15.53:0/2997703045 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fac2405f020 con 0x55ae6f4f32f0 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac40fd8740 10 client.16656 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac40fd8740 10 client.16656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac40fd8740 20 client.16656 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac40fd8740 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae6f4b01c0 0x55ae6f94f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac40fd8740 4 client.16656 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:07:50.240 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.231+0000 7fac40fd8740 1 -- 172.21.15.53:0/2997703045 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae6f8329f0 con 0x55ae6f4b01c0 2024-08-31T06:07:50.240 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.232+0000 7fac32ffd640 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae6f4b01c0 0x55ae6f94f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:50.240 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.232+0000 7fac32ffd640 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae6f4b01c0 0x55ae6f94f5a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11711ee3ed81ed73 server_cookie=ab1816d348a74eae in_seq=0 out_seq=0 2024-08-31T06:07:50.240 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.232+0000 7fac12ffd640 10 client.16656 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac12ffd640 1 -- 172.21.15.53:0/2997703045 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae6f8329f0 con 0x55ae6f4b01c0 2024-08-31T06:07:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac12ffd640 10 client.16656 handle_command_reply: tid=0 2024-08-31T06:07:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac40fd8740 1 client.16656 shutdown 2024-08-31T06:07:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac40fd8740 1 -- 172.21.15.53:0/2997703045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 msgr2=0x55ae6f8d3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac40fd8740 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8d3cf0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fac24031ca0 tx=0x7fac240046c0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac40fd8740 1 -- 172.21.15.53:0/2997703045 shutdown_connections 2024-08-31T06:07:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac40fd8740 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae6f4b01c0 0x55ae6f94f5a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac12ffd640 0 client.16656 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac40fd8740 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae6f51c1b0 0x55ae6f8d4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac40fd8740 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae6f4fb4d0 0x55ae6f8d4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac40fd8740 1 --2- 172.21.15.53:0/2997703045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae6f4f32f0 0x55ae6f8d3cf0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac40fd8740 1 -- 172.21.15.53:0/2997703045 >> 172.21.15.53:0/2997703045 conn(0x55ae6f510300 msgr2=0x55ae6f8c0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.251+0000 7fac40fd8740 1 -- 172.21.15.53:0/2997703045 shutdown_connections 2024-08-31T06:07:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac40fd8740 1 -- 172.21.15.53:0/2997703045 wait complete. 2024-08-31T06:07:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac40fd8740 20 client.16656 trim_cache size 0 max 16384 2024-08-31T06:07:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:07:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:07:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:07:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:07:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac3a069640 1 -- 172.21.15.53:0/3840239569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac1c0b4ca0 msgr2=0x7fac1c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac3a069640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac1c0b4ca0 0x7fac1c0b71b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fac3410fef0 tx=0x7fac240058d0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac3a069640 1 -- 172.21.15.53:0/3840239569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac34107850 msgr2=0x7fac3419b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac3a069640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac34107850 0x7fac3419b4a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fac2800e9f0 tx=0x7fac2800eeb0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac3a069640 1 -- 172.21.15.53:0/3840239569 shutdown_connections 2024-08-31T06:07:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac3a069640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac1c0b4ca0 0x7fac1c0b71b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac3a069640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac341081a0 0x7fac3419b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac3a069640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac34107850 0x7fac3419b4a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac3a069640 1 --2- 172.21.15.53:0/3840239569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac34101f20 0x7fac3419af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac3a069640 1 -- 172.21.15.53:0/3840239569 >> 172.21.15.53:0/3840239569 conn(0x7fac34079c30 msgr2=0x7fac34105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.252+0000 7fac3a069640 1 -- 172.21.15.53:0/3840239569 shutdown_connections 2024-08-31T06:07:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:07:50.253+0000 7fac3a069640 1 -- 172.21.15.53:0/3840239569 wait complete. 2024-08-31T06:07:50.259 INFO:tasks.quiescer.fs.[cephfs]:Total duration (43.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T06:07:50.259 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.8 2024-08-31T06:07:50.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:07:50.527 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:50.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 51382 2.94 MB/sec warmup 100 sec latency 16.096 ms 2024-08-31T06:07:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.103+0000 7ff858b1e640 1 -- 172.21.15.53:0/1589607604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff854108aa0 msgr2=0x7ff85410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.103+0000 7ff858b1e640 1 --2- 172.21.15.53:0/1589607604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff854108aa0 0x7ff85410f2d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009ca0 tx=0x7ff84c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.103+0000 7ff858b1e640 1 -- 172.21.15.53:0/1589607604 shutdown_connections 2024-08-31T06:07:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.103+0000 7ff858b1e640 1 --2- 172.21.15.53:0/1589607604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff854108aa0 0x7ff85410f2d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.103+0000 7ff858b1e640 1 --2- 172.21.15.53:0/1589607604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff854108150 0x7ff854108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.103+0000 7ff858b1e640 1 --2- 172.21.15.53:0/1589607604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff854102810 0x7ff854102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.103+0000 7ff858b1e640 1 -- 172.21.15.53:0/1589607604 >> 172.21.15.53:0/1589607604 conn(0x7ff8540794d0 msgr2=0x7ff8540798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.104+0000 7ff858b1e640 1 -- 172.21.15.53:0/1589607604 shutdown_connections 2024-08-31T06:07:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.104+0000 7ff858b1e640 1 -- 172.21.15.53:0/1589607604 wait complete. 2024-08-31T06:07:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff858b1e640 1 Processor -- start 2024-08-31T06:07:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff858b1e640 1 -- start start 2024-08-31T06:07:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff858b1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff854102810 0x7ff85419a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff858b1e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff854108150 0x7ff85419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff858b1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff854108aa0 0x7ff85419f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff858b1e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff854112600 con 0x7ff854108aa0 2024-08-31T06:07:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff858b1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff854112480 con 0x7ff854102810 2024-08-31T06:07:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff858b1e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff854112780 con 0x7ff854108150 2024-08-31T06:07:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff852d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff854108aa0 0x7ff85419f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff852d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff854108aa0 0x7ff85419f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38540/0 (socket says 172.21.15.53:38540) 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff852d9d640 1 -- 172.21.15.53:0/441566191 learned_addr learned my addr 172.21.15.53:0/441566191 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff851d9b640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff854108150 0x7ff85419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.105+0000 7ff85259c640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff854102810 0x7ff85419a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff852d9d640 1 -- 172.21.15.53:0/441566191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff854108150 msgr2=0x7ff85419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff852d9d640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff854108150 0x7ff85419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff852d9d640 1 -- 172.21.15.53:0/441566191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff854102810 msgr2=0x7ff85419a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff852d9d640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff854102810 0x7ff85419a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff852d9d640 1 -- 172.21.15.53:0/441566191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8541a00f0 con 0x7ff854108aa0 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff851d9b640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff854108150 0x7ff85419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff852d9d640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff854108aa0 0x7ff85419f9c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff84c005e30 tx=0x7ff84c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff8437fe640 1 -- 172.21.15.53:0/441566191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c032d10 con 0x7ff854108aa0 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff858b1e640 1 -- 172.21.15.53:0/441566191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8541a0380 con 0x7ff854108aa0 2024-08-31T06:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff8437fe640 1 -- 172.21.15.53:0/441566191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff84c032eb0 con 0x7ff854108aa0 2024-08-31T06:07:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff8437fe640 1 -- 172.21.15.53:0/441566191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c030b20 con 0x7ff854108aa0 2024-08-31T06:07:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.106+0000 7ff858b1e640 1 -- 172.21.15.53:0/441566191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8541a6b40 con 0x7ff854108aa0 2024-08-31T06:07:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.108+0000 7ff858b1e640 1 -- 172.21.15.53:0/441566191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff854103a90 con 0x7ff854108aa0 2024-08-31T06:07:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.109+0000 7ff8437fe640 1 -- 172.21.15.53:0/441566191 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff84c030cc0 con 0x7ff854108aa0 2024-08-31T06:07:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.110+0000 7ff8437fe640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff83c0b4ca0 0x7ff83c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.110+0000 7ff85259c640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff83c0b4ca0 0x7ff83c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.110+0000 7ff8437fe640 1 -- 172.21.15.53:0/441566191 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7ff84c1068d0 con 0x7ff854108aa0 2024-08-31T06:07:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.111+0000 7ff85259c640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff83c0b4ca0 0x7ff83c0b71b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff844009bd0 tx=0x7ff844005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.115+0000 7ff8437fe640 1 -- 172.21.15.53:0/441566191 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff84c0cd750 con 0x7ff854108aa0 2024-08-31T06:07:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.372+0000 7ff858b1e640 1 -- 172.21.15.53:0/441566191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff854102c20 con 0x7ff854108aa0 2024-08-31T06:07:51.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.373+0000 7ff8437fe640 1 -- 172.21.15.53:0/441566191 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11992 (secure 0 0 0) 0x7ff854102c20 con 0x7ff854108aa0 2024-08-31T06:07:51.376 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:07:51.377 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"btime":"2024-08-31T06:06:51:511613+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:06:50.526609+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:07:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 30 2024-08-31T06:07:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.375+0000 7ff858b1e640 1 -- 172.21.15.53:0/441566191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff83c0b4ca0 msgr2=0x7ff83c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.375+0000 7ff858b1e640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff83c0b4ca0 0x7ff83c0b71b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff844009bd0 tx=0x7ff844005f90 comp rx=0 tx=0).stop 2024-08-31T06:07:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.375+0000 7ff858b1e640 1 -- 172.21.15.53:0/441566191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff854108aa0 msgr2=0x7ff85419f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.375+0000 7ff858b1e640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff854108aa0 0x7ff85419f9c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff84c005e30 tx=0x7ff84c0093d0 comp rx=0 tx=0).stop 2024-08-31T06:07:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.376+0000 7ff858b1e640 1 -- 172.21.15.53:0/441566191 shutdown_connections 2024-08-31T06:07:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.376+0000 7ff858b1e640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff83c0b4ca0 0x7ff83c0b71b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.376+0000 7ff858b1e640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff854108aa0 0x7ff85419f9c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.376+0000 7ff858b1e640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff854108150 0x7ff85419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.376+0000 7ff858b1e640 1 --2- 172.21.15.53:0/441566191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff854102810 0x7ff85419a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.376+0000 7ff858b1e640 1 -- 172.21.15.53:0/441566191 >> 172.21.15.53:0/441566191 conn(0x7ff8540794d0 msgr2=0x7ff8541018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.376+0000 7ff858b1e640 1 -- 172.21.15.53:0/441566191 shutdown_connections 2024-08-31T06:07:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:51.376+0000 7ff858b1e640 1 -- 172.21.15.53:0/441566191 wait complete. 2024-08-31T06:07:51.962 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52016 2.93 MB/sec warmup 101 sec latency 16.591 ms 2024-08-31T06:07:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:51 smithi130 ceph-mon[22266]: pgmap v410: 97 pgs: 97 active+clean; 40 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2024-08-31T06:07:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:51 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/441566191' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:07:52.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:51 smithi053 ceph-mon[18924]: pgmap v410: 97 pgs: 97 active+clean; 40 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2024-08-31T06:07:52.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:51 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/441566191' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:07:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:51 smithi153 ceph-mon[22320]: pgmap v410: 97 pgs: 97 active+clean; 40 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2024-08-31T06:07:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:51 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/441566191' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:07:52.181 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0' 2024-08-31T06:07:52.181 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0 2024-08-31T06:07:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:07:52.963 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52567 2.94 MB/sec warmup 102 sec latency 33.091 ms 2024-08-31T06:07:52.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.965+0000 7fbb1c941640 1 -- 172.21.15.53:0/1796097433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb181079f0 msgr2=0x7fbb18107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:52.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.965+0000 7fbb1c941640 1 --2- 172.21.15.53:0/1796097433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb181079f0 0x7fbb18107eb0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009ca0 tx=0x7fbb1002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.965+0000 7fbb1c941640 1 -- 172.21.15.53:0/1796097433 shutdown_connections 2024-08-31T06:07:52.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.965+0000 7fbb1c941640 1 --2- 172.21.15.53:0/1796097433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb181079f0 0x7fbb18107eb0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.965+0000 7fbb1c941640 1 --2- 172.21.15.53:0/1796097433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb18102f30 0x7fbb18107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.965+0000 7fbb1c941640 1 --2- 172.21.15.53:0/1796097433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb181025e0 0x7fbb181029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.965+0000 7fbb1c941640 1 -- 172.21.15.53:0/1796097433 >> 172.21.15.53:0/1796097433 conn(0x7fbb18079470 msgr2=0x7fbb18079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:52.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.965+0000 7fbb1c941640 1 -- 172.21.15.53:0/1796097433 shutdown_connections 2024-08-31T06:07:52.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.965+0000 7fbb1c941640 1 -- 172.21.15.53:0/1796097433 wait complete. 2024-08-31T06:07:52.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb1c941640 1 Processor -- start 2024-08-31T06:07:52.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb1c941640 1 -- start start 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb1c941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb181025e0 0x7fbb181a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb1c941640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb18102f30 0x7fbb181a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb1c941640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb181079f0 0x7fbb181a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb1c941640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbb18119d80 con 0x7fbb181025e0 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb1c941640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbb18119c00 con 0x7fbb18102f30 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb1c941640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbb18119f00 con 0x7fbb181079f0 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb1659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb181025e0 0x7fbb181a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb15d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb18102f30 0x7fbb181a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb1659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb181025e0 0x7fbb181a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38556/0 (socket says 172.21.15.53:38556) 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb1659c640 1 -- 172.21.15.53:0/4245924345 learned_addr learned my addr 172.21.15.53:0/4245924345 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.966+0000 7fbb16d9d640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb181079f0 0x7fbb181a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb15d9b640 1 -- 172.21.15.53:0/4245924345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb181079f0 msgr2=0x7fbb181a5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb15d9b640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb181079f0 0x7fbb181a5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb15d9b640 1 -- 172.21.15.53:0/4245924345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb181025e0 msgr2=0x7fbb181a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb15d9b640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb181025e0 0x7fbb181a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb15d9b640 1 -- 172.21.15.53:0/4245924345 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb181a6680 con 0x7fbb18102f30 2024-08-31T06:07:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb1659c640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb181025e0 0x7fbb181a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb15d9b640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb18102f30 0x7fbb181a0cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbb1806b520 tx=0x7fbb0c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb077fe640 1 -- 172.21.15.53:0/4245924345 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00cc40 con 0x7fbb18102f30 2024-08-31T06:07:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb1c941640 1 -- 172.21.15.53:0/4245924345 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb181a6970 con 0x7fbb18102f30 2024-08-31T06:07:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb077fe640 1 -- 172.21.15.53:0/4245924345 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb0c00cde0 con 0x7fbb18102f30 2024-08-31T06:07:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb077fe640 1 -- 172.21.15.53:0/4245924345 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c0186f0 con 0x7fbb18102f30 2024-08-31T06:07:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.967+0000 7fbb1c941640 1 -- 172.21.15.53:0/4245924345 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb181ad0d0 con 0x7fbb18102f30 2024-08-31T06:07:52.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.970+0000 7fbb077fe640 1 -- 172.21.15.53:0/4245924345 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbb0c010a70 con 0x7fbb18102f30 2024-08-31T06:07:52.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.971+0000 7fbb22eb6740 1 Processor -- start 2024-08-31T06:07:52.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.971+0000 7fbb22eb6740 1 -- start start 2024-08-31T06:07:52.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea7ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:52.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea7f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:52.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea7f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:52.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bc5e9f3330 con 0x55bc5e6d7840 2024-08-31T06:07:52.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bc5e9e28c0 con 0x55bc5e6ae980 2024-08-31T06:07:52.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bc5e9e6870 con 0x55bc5e6b6b60 2024-08-31T06:07:52.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb1659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea7f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:52.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb16d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea7ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:52.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb1659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea7f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33386/0 (socket says 172.21.15.53:33386) 2024-08-31T06:07:52.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb1659c640 1 -- 172.21.15.53:0/286316510 learned_addr learned my addr 172.21.15.53:0/286316510 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:52.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb15d9b640 1 --2- 172.21.15.53:0/286316510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea7f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:52.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb1659c640 1 -- 172.21.15.53:0/286316510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 msgr2=0x55bc5ea7f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:52.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb1659c640 1 --2- 172.21.15.53:0/286316510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea7f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb1659c640 1 -- 172.21.15.53:0/286316510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 msgr2=0x55bc5ea7ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.972+0000 7fbb077fe640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbb000b4ca0 0x7fbb000b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.973+0000 7fbb1659c640 1 --2- 172.21.15.53:0/286316510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea7ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.973+0000 7fbb1659c640 1 -- 172.21.15.53:0/286316510 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc5e99adf0 con 0x55bc5e6ae980 2024-08-31T06:07:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.973+0000 7fbb16d9d640 1 --2- 172.21.15.53:0/286316510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea7ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.973+0000 7fbb077fe640 1 -- 172.21.15.53:0/4245924345 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fbb0c0e58c0 con 0x7fbb18102f30 2024-08-31T06:07:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.973+0000 7fbb1659c640 1 --2- 172.21.15.53:0/286316510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea7f1d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb08010500 tx=0x7fbb080109c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=529a548e59e2b805 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.973+0000 7fbb16d9d640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbb000b4ca0 0x7fbb000b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.973+0000 7fbb04ff9640 1 -- 172.21.15.53:0/286316510 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08011760 con 0x55bc5e6ae980 2024-08-31T06:07:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.973+0000 7fbb04ff9640 1 -- 172.21.15.53:0/286316510 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb08011d90 con 0x55bc5e6ae980 2024-08-31T06:07:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.973+0000 7fbb04ff9640 1 -- 172.21.15.53:0/286316510 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0800e430 con 0x55bc5e6ae980 2024-08-31T06:07:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.974+0000 7fbb22eb6740 1 -- 172.21.15.53:0/286316510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 msgr2=0x55bc5ea7f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.974+0000 7fbb16d9d640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbb000b4ca0 0x7fbb000b71b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb10005e30 tx=0x7fbb100095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.974+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/286316510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea7f1d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb08010500 tx=0x7fbb080109c0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.974+0000 7fbb22eb6740 1 -- 172.21.15.53:0/286316510 shutdown_connections 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.974+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/286316510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea7f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.974+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/286316510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea7f1d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.974+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/286316510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea7ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.974+0000 7fbb22eb6740 1 -- 172.21.15.53:0/286316510 >> 172.21.15.53:0/286316510 conn(0x55bc5e6cb990 msgr2=0x55bc5ea7cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.974+0000 7fbb22eb6740 1 -- 172.21.15.53:0/286316510 shutdown_connections 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.974+0000 7fbb22eb6740 1 -- 172.21.15.53:0/286316510 wait complete. 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb22eb6740 1 -- start start 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb22eb6740 1 Processor -- start 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea8a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea8aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:52.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:52.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bc5e8457a0 con 0x55bc5e6d7840 2024-08-31T06:07:52.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bc5e969240 con 0x55bc5e6ae980 2024-08-31T06:07:52.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bc5ea8d470 con 0x55bc5e6b6b60 2024-08-31T06:07:52.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb22eb6740 10 client.0 _ll_register_callbacks cb 0x55bc5e6ef090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:52.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb16d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:52.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb1659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea8a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:52.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.975+0000 7fbb15d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea8aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbb16d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38582/0 (socket says 172.21.15.53:38582) 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbb1659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea8a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33388/0 (socket says 172.21.15.53:33388) 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbb15d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea8aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:33412/0 (socket says 172.21.15.53:33412) 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbb16d9d640 1 -- 172.21.15.53:0/2598096463 learned_addr learned my addr 172.21.15.53:0/2598096463 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbb16d9d640 1 -- 172.21.15.53:0/2598096463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 msgr2=0x55bc5ea8aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbb16d9d640 1 --2- 172.21.15.53:0/2598096463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea8aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbb16d9d640 1 -- 172.21.15.53:0/2598096463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 msgr2=0x55bc5ea8a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbb16d9d640 1 --2- 172.21.15.53:0/2598096463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea8a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbb16d9d640 1 -- 172.21.15.53:0/2598096463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc5e99f2b0 con 0x55bc5e6d7840 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbb16d9d640 1 --2- 172.21.15.53:0/2598096463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96760 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fbb10035000 tx=0x7fbb1002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74fa9c400e948c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbafdffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbafdffb640 1 -- 172.21.15.53:0/2598096463 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10003e60 con 0x55bc5e6d7840 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbafdffb640 1 -- 172.21.15.53:0/2598096463 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fbb10004450 con 0x55bc5e6d7840 2024-08-31T06:07:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbb22eb6740 1 -- 172.21.15.53:0/2598096463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb08011d90 con 0x55bc5e6d7840 2024-08-31T06:07:52.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.976+0000 7fbafdffb640 1 -- 172.21.15.53:0/2598096463 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbb10009800 con 0x55bc5e6d7840 2024-08-31T06:07:52.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.977+0000 7fbb22eb6740 10 client.16674 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:52.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.977+0000 7fbb22eb6740 1 -- 172.21.15.53:0/2598096463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bc5e751b90 con 0x55bc5e6d7840 2024-08-31T06:07:52.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.977+0000 7fbafdffb640 1 -- 172.21.15.53:0/2598096463 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb08011d90 con 0x55bc5e6d7840 2024-08-31T06:07:52.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.977+0000 7fbafdffb640 1 -- 172.21.15.53:0/2598096463 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fbb10030d50 con 0x55bc5e6d7840 2024-08-31T06:07:52.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.977+0000 7fbb22eb6740 10 client.16674 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:52.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.977+0000 7fbb22eb6740 10 client.16674 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:07:52.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.977+0000 7fbb22eb6740 20 client.16674 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:52.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.977+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/2598096463 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc5e6961c0 0x55bc5ea9c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:52.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.977+0000 7fbb22eb6740 4 client.16674 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:07:52.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.977+0000 7fbb22eb6740 1 -- 172.21.15.53:0/2598096463 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc5e9f5280 con 0x55bc5e6961c0 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.977+0000 7fbb1659c640 1 --2- 172.21.15.53:0/2598096463 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc5e6961c0 0x55bc5ea9c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.978+0000 7fbafdffb640 10 client.16674 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.978+0000 7fbb1659c640 1 --2- 172.21.15.53:0/2598096463 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc5e6961c0 0x55bc5ea9c650 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=646757cfe7d03fb6 server_cookie=abbc64d70c11e87f in_seq=0 out_seq=0 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbafdffb640 1 -- 172.21.15.53:0/2598096463 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc5e9f5280 con 0x55bc5e6961c0 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbafdffb640 10 client.16674 handle_command_reply: tid=0 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 1 client.16674 shutdown 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 1 -- 172.21.15.53:0/2598096463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 msgr2=0x55bc5ea96760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/2598096463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96760 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fbb10035000 tx=0x7fbb1002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 1 -- 172.21.15.53:0/2598096463 shutdown_connections 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/2598096463 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc5e6961c0 0x55bc5ea9c650 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/2598096463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96760 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/2598096463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea8aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/2598096463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea8a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbafdffb640 0 client.16674 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:52.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 1 -- 172.21.15.53:0/2598096463 >> 172.21.15.53:0/2598096463 conn(0x55bc5e6cb990 msgr2=0x55bc5ea81e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:52.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 1 -- 172.21.15.53:0/2598096463 shutdown_connections 2024-08-31T06:07:52.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 1 -- 172.21.15.53:0/2598096463 wait complete. 2024-08-31T06:07:52.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.979+0000 7fbb22eb6740 20 client.16674 trim_cache size 0 max 16384 2024-08-31T06:07:53.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb22eb6740 1 Processor -- start 2024-08-31T06:07:53.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb22eb6740 1 -- start start 2024-08-31T06:07:53.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6ae980 0x55bc5ea8ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:53.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea96660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:53.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:53.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181b5ad0 con 0x55bc5e6d7840 2024-08-31T06:07:53.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181b76d0 con 0x55bc5e6b6b60 2024-08-31T06:07:53.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181b61a0 con 0x55bc5e6ae980 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb1659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6ae980 0x55bc5ea8ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb16d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb1659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6ae980 0x55bc5ea8ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:33420/0 (socket says 172.21.15.53:33420) 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb16d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38586/0 (socket says 172.21.15.53:38586) 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb1659c640 1 -- 172.21.15.53:0/4277291745 learned_addr learned my addr 172.21.15.53:0/4277291745 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb15d9b640 1 --2- 172.21.15.53:0/4277291745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea96660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb1659c640 1 -- 172.21.15.53:0/4277291745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6b6b60 msgr2=0x55bc5ea96660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb1659c640 1 --2- 172.21.15.53:0/4277291745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea96660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb1659c640 1 -- 172.21.15.53:0/4277291745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 msgr2=0x55bc5ea96ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb1659c640 1 --2- 172.21.15.53:0/4277291745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb1659c640 1 -- 172.21.15.53:0/4277291745 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc5e9b2d90 con 0x55bc5e6ae980 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.998+0000 7fbb16d9d640 1 --2- 172.21.15.53:0/4277291745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.999+0000 7fbb1659c640 1 --2- 172.21.15.53:0/4277291745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6ae980 0x55bc5ea8ba00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb08010ec0 tx=0x7fbb0801dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce6d6bb4a9c1e3e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:53.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.999+0000 7fbafffff640 1 -- 172.21.15.53:0/4277291745 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0801c500 con 0x55bc5e6ae980 2024-08-31T06:07:53.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.999+0000 7fbafffff640 1 -- 172.21.15.53:0/4277291745 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb080054d0 con 0x55bc5e6ae980 2024-08-31T06:07:53.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:52.999+0000 7fbafffff640 1 -- 172.21.15.53:0/4277291745 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0801c920 con 0x55bc5e6ae980 2024-08-31T06:07:53.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.000+0000 7fbb22eb6740 1 -- 172.21.15.53:0/4277291745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6ae980 msgr2=0x55bc5ea8ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:53.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.000+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/4277291745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6ae980 0x55bc5ea8ba00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb08010ec0 tx=0x7fbb0801dc90 comp rx=0 tx=0).stop 2024-08-31T06:07:53.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.000+0000 7fbb22eb6740 1 -- 172.21.15.53:0/4277291745 shutdown_connections 2024-08-31T06:07:53.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.000+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/4277291745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea96ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.000+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/4277291745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea96660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.000+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/4277291745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6ae980 0x55bc5ea8ba00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.000+0000 7fbb22eb6740 1 -- 172.21.15.53:0/4277291745 >> 172.21.15.53:0/4277291745 conn(0x55bc5e6cb990 msgr2=0x55bc5ea80680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:53.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.000+0000 7fbb22eb6740 1 -- 172.21.15.53:0/4277291745 shutdown_connections 2024-08-31T06:07:53.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.000+0000 7fbb22eb6740 1 -- 172.21.15.53:0/4277291745 wait complete. 2024-08-31T06:07:53.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.000+0000 7fbb22eb6740 1 -- start start 2024-08-31T06:07:53.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.000+0000 7fbb22eb6740 1 Processor -- start 2024-08-31T06:07:53.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea92bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea8f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb22eb6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea8f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181b6f40 con 0x55bc5e6d7840 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181b6870 con 0x55bc5e6ae980 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb22eb6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181b3ab0 con 0x55bc5e6b6b60 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb22eb6740 10 client.0 _ll_register_callbacks cb 0x7fbb10009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb16d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea8f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb1659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea92bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb16d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea8f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38588/0 (socket says 172.21.15.53:38588) 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb16d9d640 1 -- 172.21.15.53:0/76487004 learned_addr learned my addr 172.21.15.53:0/76487004 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb1659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea92bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33418/0 (socket says 172.21.15.53:33418) 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb15d9b640 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea8f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb16d9d640 1 -- 172.21.15.53:0/76487004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 msgr2=0x55bc5ea8f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb16d9d640 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea8f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb16d9d640 1 -- 172.21.15.53:0/76487004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 msgr2=0x55bc5ea92bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb16d9d640 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea92bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb16d9d640 1 -- 172.21.15.53:0/76487004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc5ea8fb50 con 0x55bc5e6d7840 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb1659c640 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea92bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbb16d9d640 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea8f610 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbb10006010 tx=0x7fbb10031e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a1370b5dc79666 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.001+0000 7fbafdffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbafdffb640 1 -- 172.21.15.53:0/76487004 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10060070 con 0x55bc5e6d7840 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbb22eb6740 1 -- 172.21.15.53:0/76487004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb080054d0 con 0x55bc5e6d7840 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbafdffb640 1 -- 172.21.15.53:0/76487004 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fbb1005aad0 con 0x55bc5e6d7840 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbafdffb640 1 -- 172.21.15.53:0/76487004 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbb1005acd0 con 0x55bc5e6d7840 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbb22eb6740 10 client.16680 fetch_fsmap learned FSMap version 30 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbb22eb6740 1 -- 172.21.15.53:0/76487004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bc5eb07c90 con 0x55bc5e6d7840 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbafdffb640 1 -- 172.21.15.53:0/76487004 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb080054d0 con 0x55bc5e6d7840 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbafdffb640 1 -- 172.21.15.53:0/76487004 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fbb10030850 con 0x55bc5e6d7840 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbb22eb6740 10 client.16680 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:07:53.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbb22eb6740 10 client.16680 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:07:53.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbb22eb6740 20 client.16680 populate_metadata read hostname 'smithi053' 2024-08-31T06:07:53.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc5e66b570 0x55bc5eb0a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:07:53.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbb22eb6740 4 client.16680 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}] 2024-08-31T06:07:53.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.002+0000 7fbb22eb6740 1 -- 172.21.15.53:0/76487004 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}) -- 0x55bc5e9f0d20 con 0x55bc5e66b570 2024-08-31T06:07:53.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.003+0000 7fbb1659c640 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc5e66b570 0x55bc5eb0a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:07:53.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.003+0000 7fbafdffb640 10 client.16680 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:53.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.003+0000 7fbb1659c640 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc5e66b570 0x55bc5eb0a500 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c41d6d73c24ca9 server_cookie=e0c55c81f766baa0 in_seq=0 out_seq=0 2024-08-31T06:07:53.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbafdffb640 1 -- 172.21.15.53:0/76487004 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55bc5e9f0d20 con 0x55bc5e66b570 2024-08-31T06:07:53.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbafdffb640 10 client.16680 handle_command_reply: tid=0 2024-08-31T06:07:53.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 1 client.16680 shutdown 2024-08-31T06:07:53.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 1 -- 172.21.15.53:0/76487004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 msgr2=0x55bc5ea8f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:53.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea8f610 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbb10006010 tx=0x7fbb10031e30 comp rx=0 tx=0).stop 2024-08-31T06:07:53.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 1 -- 172.21.15.53:0/76487004 shutdown_connections 2024-08-31T06:07:53.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc5e66b570 0x55bc5eb0a500 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc5e6d7840 0x55bc5ea8f610 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc5e6b6b60 0x55bc5ea8f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbafdffb640 0 client.16680 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:07:53.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 1 --2- 172.21.15.53:0/76487004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc5e6ae980 0x55bc5ea92bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 1 -- 172.21.15.53:0/76487004 >> 172.21.15.53:0/76487004 conn(0x55bc5e6cb990 msgr2=0x55bc5ea80630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:53.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 1 -- 172.21.15.53:0/76487004 shutdown_connections 2024-08-31T06:07:53.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 1 -- 172.21.15.53:0/76487004 wait complete. 2024-08-31T06:07:53.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb22eb6740 20 client.16680 trim_cache size 0 max 16384 2024-08-31T06:07:53.088 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:07:53.088 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 30, 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 10, 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "f6ab1b68": { 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 10, 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 141.8, 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:07:53.089 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:07:53.090 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:07:53.090 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:07:53.090 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:07:53.090 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:53.090 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:53.090 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:53.090 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:53.090 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:07:53.090 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:07:53.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb1c941640 1 -- 172.21.15.53:0/4245924345 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbb000b4ca0 msgr2=0x7fbb000b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:53.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb1c941640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbb000b4ca0 0x7fbb000b71b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb10005e30 tx=0x7fbb100095c0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb1c941640 1 -- 172.21.15.53:0/4245924345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb18102f30 msgr2=0x7fbb181a0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:07:53.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb1c941640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb18102f30 0x7fbb181a0cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbb1806b520 tx=0x7fbb0c00ee50 comp rx=0 tx=0).stop 2024-08-31T06:07:53.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb1c941640 1 -- 172.21.15.53:0/4245924345 shutdown_connections 2024-08-31T06:07:53.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb1c941640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbb000b4ca0 0x7fbb000b71b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb1c941640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb181079f0 0x7fbb181a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb1c941640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb18102f30 0x7fbb181a0cb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb1c941640 1 --2- 172.21.15.53:0/4245924345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb181025e0 0x7fbb181a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:07:53.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.084+0000 7fbb1c941640 1 -- 172.21.15.53:0/4245924345 >> 172.21.15.53:0/4245924345 conn(0x7fbb18079470 msgr2=0x7fbb18105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:07:53.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.085+0000 7fbb1c941640 1 -- 172.21.15.53:0/4245924345 shutdown_connections 2024-08-31T06:07:53.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:07:53.085+0000 7fbb1c941640 1 -- 172.21.15.53:0/4245924345 wait complete. 2024-08-31T06:07:53.874 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f6ab1b68', quiesce took 3.6 seconds. Will release after: 18.2 2024-08-31T06:07:53.963 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.92 MB/sec warmup 103 sec latency 939.415 ms 2024-08-31T06:07:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:53 smithi130 ceph-mon[22266]: pgmap v411: 97 pgs: 97 active+clean; 40 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-08-31T06:07:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:53 smithi153 ceph-mon[22320]: pgmap v411: 97 pgs: 97 active+clean; 40 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-08-31T06:07:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:53 smithi053 ceph-mon[18924]: pgmap v411: 97 pgs: 97 active+clean; 40 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-08-31T06:07:54.963 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.89 MB/sec warmup 104 sec latency 1939.513 ms 2024-08-31T06:07:55.963 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.86 MB/sec warmup 105 sec latency 2939.611 ms 2024-08-31T06:07:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:55 smithi130 ceph-mon[22266]: pgmap v412: 97 pgs: 97 active+clean; 37 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 1.3 MiB/s wr, 159 op/s 2024-08-31T06:07:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:55 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:07:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:55 smithi153 ceph-mon[22320]: pgmap v412: 97 pgs: 97 active+clean; 37 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 1.3 MiB/s wr, 159 op/s 2024-08-31T06:07:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:55 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:07:56.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:55 smithi053 ceph-mon[18924]: pgmap v412: 97 pgs: 97 active+clean; 37 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 1.3 MiB/s wr, 159 op/s 2024-08-31T06:07:56.265 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:55 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:07:56.963 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.84 MB/sec warmup 106 sec latency 3939.733 ms 2024-08-31T06:07:57.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:56 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:07:57.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:56 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:07:57.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:56 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:07:57.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:56 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:07:57.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:56 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:07:57.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:56 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:07:57.963 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.81 MB/sec warmup 107 sec latency 4939.773 ms 2024-08-31T06:07:58.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:57 smithi130 ceph-mon[22266]: pgmap v413: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 1.3 MiB/s wr, 154 op/s 2024-08-31T06:07:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:57 smithi153 ceph-mon[22320]: pgmap v413: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 1.3 MiB/s wr, 154 op/s 2024-08-31T06:07:58.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:57 smithi053 ceph-mon[18924]: pgmap v413: 97 pgs: 97 active+clean; 36 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 1.3 MiB/s wr, 154 op/s 2024-08-31T06:07:58.963 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.78 MB/sec warmup 108 sec latency 5939.901 ms 2024-08-31T06:07:59.963 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.76 MB/sec warmup 109 sec latency 6940.017 ms 2024-08-31T06:08:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:07:59 smithi130 ceph-mon[22266]: pgmap v414: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 1000 KiB/s wr, 134 op/s 2024-08-31T06:08:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:07:59 smithi153 ceph-mon[22320]: pgmap v414: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 1000 KiB/s wr, 134 op/s 2024-08-31T06:08:00.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:07:59 smithi053 ceph-mon[18924]: pgmap v414: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 1000 KiB/s wr, 134 op/s 2024-08-31T06:08:00.963 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.73 MB/sec warmup 110 sec latency 7940.097 ms 2024-08-31T06:08:01.963 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.71 MB/sec warmup 111 sec latency 8940.163 ms 2024-08-31T06:08:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:01 smithi130 ceph-mon[22266]: pgmap v415: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 767 KiB/s wr, 104 op/s 2024-08-31T06:08:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:01 smithi153 ceph-mon[22320]: pgmap v415: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 767 KiB/s wr, 104 op/s 2024-08-31T06:08:02.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:01 smithi053 ceph-mon[18924]: pgmap v415: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 767 KiB/s wr, 104 op/s 2024-08-31T06:08:02.963 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.68 MB/sec warmup 112 sec latency 9940.265 ms 2024-08-31T06:08:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.366+0000 7f32fa578640 1 -- 172.21.15.53:0/3287974551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f41089d0 msgr2=0x7f32f410f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.366+0000 7f32fa578640 1 --2- 172.21.15.53:0/3287974551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f41089d0 0x7f32f410f200 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009ca0 tx=0x7f32ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.366+0000 7f32fa578640 1 -- 172.21.15.53:0/3287974551 shutdown_connections 2024-08-31T06:08:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.366+0000 7f32fa578640 1 --2- 172.21.15.53:0/3287974551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f41089d0 0x7f32f410f200 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.366+0000 7f32fa578640 1 --2- 172.21.15.53:0/3287974551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32f4108080 0x7f32f4108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.366+0000 7f32fa578640 1 --2- 172.21.15.53:0/3287974551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32f4102750 0x7f32f4102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.366+0000 7f32fa578640 1 -- 172.21.15.53:0/3287974551 >> 172.21.15.53:0/3287974551 conn(0x7f32f407a4e0 msgr2=0x7f32f407a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.366+0000 7f32fa578640 1 -- 172.21.15.53:0/3287974551 shutdown_connections 2024-08-31T06:08:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.366+0000 7f32fa578640 1 -- 172.21.15.53:0/3287974551 wait complete. 2024-08-31T06:08:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.367+0000 7f32fa578640 1 Processor -- start 2024-08-31T06:08:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.367+0000 7f32fa578640 1 -- start start 2024-08-31T06:08:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.367+0000 7f32fa578640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32f4102750 0x7f32f419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.367+0000 7f32fa578640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32f4108080 0x7f32f419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.367+0000 7f32fa578640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f41089d0 0x7f32f419f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.367+0000 7f32fa578640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41125a0 con 0x7f32f41089d0 2024-08-31T06:08:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.367+0000 7f32fa578640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4112420 con 0x7f32f4108080 2024-08-31T06:08:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.367+0000 7f32fa578640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4112720 con 0x7f32f4102750 2024-08-31T06:08:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.367+0000 7f32f8b15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f41089d0 0x7f32f419f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.367+0000 7f32f8b15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f41089d0 0x7f32f419f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46604/0 (socket says 172.21.15.53:46604) 2024-08-31T06:08:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.367+0000 7f32f8b15640 1 -- 172.21.15.53:0/3529056264 learned_addr learned my addr 172.21.15.53:0/3529056264 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32f3fff640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32f4102750 0x7f32f419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32f37fe640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32f4108080 0x7f32f419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32f8b15640 1 -- 172.21.15.53:0/3529056264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32f4102750 msgr2=0x7f32f419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32f8b15640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32f4102750 0x7f32f419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32f8b15640 1 -- 172.21.15.53:0/3529056264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32f4108080 msgr2=0x7f32f419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32f8b15640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32f4108080 0x7f32f419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32f8b15640 1 -- 172.21.15.53:0/3529056264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f41a0020 con 0x7f32f41089d0 2024-08-31T06:08:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32f8b15640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f41089d0 0x7f32f419f920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f32ec005e30 tx=0x7f32ec0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32f17fa640 1 -- 172.21.15.53:0/3529056264 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec032d10 con 0x7f32f41089d0 2024-08-31T06:08:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32fa578640 1 -- 172.21.15.53:0/3529056264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f41a02b0 con 0x7f32f41089d0 2024-08-31T06:08:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32f17fa640 1 -- 172.21.15.53:0/3529056264 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32ec032eb0 con 0x7f32f41089d0 2024-08-31T06:08:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32f17fa640 1 -- 172.21.15.53:0/3529056264 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec030b20 con 0x7f32f41089d0 2024-08-31T06:08:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.368+0000 7f32fa578640 1 -- 172.21.15.53:0/3529056264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f41a6aa0 con 0x7f32f41089d0 2024-08-31T06:08:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.371+0000 7f3301122740 1 Processor -- start 2024-08-31T06:08:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.371+0000 7f32f17fa640 1 -- 172.21.15.53:0/3529056264 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f32ec030cc0 con 0x7f32f41089d0 2024-08-31T06:08:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f3301122740 1 -- start start 2024-08-31T06:08:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f3301122740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730451b0 0x5636733e8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f3301122740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733e9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f3301122740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5636730244d0 0x5636733e9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f3301122740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56367335e000 con 0x56367301c2f0 2024-08-31T06:08:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f3301122740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56367334d590 con 0x5636730244d0 2024-08-31T06:08:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f3301122740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563673351540 con 0x5636730451b0 2024-08-31T06:08:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733e9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733e9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46610/0 (socket says 172.21.15.53:46610) 2024-08-31T06:08:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f3fff640 1 -- 172.21.15.53:0/3592868234 learned_addr learned my addr 172.21.15.53:0/3592868234 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f17fa640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32dc0b4ca0 0x7f32dc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f37fe640 1 --2- 172.21.15.53:0/3592868234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730451b0 0x5636733e8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f37fe640 1 --2- 172.21.15.53:0/3592868234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5636730244d0 0x5636733e9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f3fff640 1 -- 172.21.15.53:0/3592868234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730451b0 msgr2=0x5636733e8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f3fff640 1 --2- 172.21.15.53:0/3592868234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730451b0 0x5636733e8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f3fff640 1 -- 172.21.15.53:0/3592868234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5636730244d0 msgr2=0x5636733e9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f3fff640 1 --2- 172.21.15.53:0/3592868234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5636730244d0 0x5636733e9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f3fff640 1 -- 172.21.15.53:0/3592868234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636730b0790 con 0x56367301c2f0 2024-08-31T06:08:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f8b15640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32dc0b4ca0 0x7f32dc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.372+0000 7f32f37fe640 1 --2- 172.21.15.53:0/3592868234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730451b0 0x5636733e8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.373+0000 7f32f17fa640 1 -- 172.21.15.53:0/3529056264 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f32ec1067a0 con 0x7f32f41089d0 2024-08-31T06:08:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.373+0000 7f32f3fff640 1 --2- 172.21.15.53:0/3592868234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733e9000 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f32e400b760 tx=0x7f32e400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbedfb25ba54fd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.373+0000 7f32da7fc640 1 -- 172.21.15.53:0/3592868234 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4003dd0 con 0x56367301c2f0 2024-08-31T06:08:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.373+0000 7f32da7fc640 1 -- 172.21.15.53:0/3592868234 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32e4015070 con 0x56367301c2f0 2024-08-31T06:08:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.373+0000 7f32da7fc640 1 -- 172.21.15.53:0/3592868234 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4004d60 con 0x56367301c2f0 2024-08-31T06:08:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.374+0000 7f3301122740 1 -- 172.21.15.53:0/3592868234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 msgr2=0x5636733e9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.374+0000 7f3301122740 1 --2- 172.21.15.53:0/3592868234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733e9000 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f32e400b760 tx=0x7f32e400bc20 comp rx=0 tx=0).stop 2024-08-31T06:08:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.374+0000 7f32f8b15640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32dc0b4ca0 0x7f32dc0b71b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0ca100 tx=0x7f32ec0c8e30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.374+0000 7f3301122740 1 -- 172.21.15.53:0/3592868234 shutdown_connections 2024-08-31T06:08:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.374+0000 7f3301122740 1 --2- 172.21.15.53:0/3592868234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5636730244d0 0x5636733e9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.374+0000 7f3301122740 1 --2- 172.21.15.53:0/3592868234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733e9000 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.374+0000 7f3301122740 1 --2- 172.21.15.53:0/3592868234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730451b0 0x5636733e8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.374+0000 7f3301122740 1 -- 172.21.15.53:0/3592868234 >> 172.21.15.53:0/3592868234 conn(0x563673039300 msgr2=0x5636733e69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.374+0000 7f3301122740 1 -- 172.21.15.53:0/3592868234 shutdown_connections 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.374+0000 7f3301122740 1 -- 172.21.15.53:0/3592868234 wait complete. 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.374+0000 7f3301122740 1 -- start start 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f3301122740 1 Processor -- start 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f3301122740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f3301122740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5636730244d0 0x5636733f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f3301122740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730451b0 0x563673400530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f3301122740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563673286ab0 con 0x56367301c2f0 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f3301122740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5636732d4680 con 0x5636730244d0 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f3301122740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5636733f7240 con 0x5636730451b0 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f3301122740 10 client.0 _ll_register_callbacks cb 0x56367305ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f32f37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f32f37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46620/0 (socket says 172.21.15.53:46620) 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f32f37fe640 1 -- 172.21.15.53:0/476290844 learned_addr learned my addr 172.21.15.53:0/476290844 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f32f37fe640 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730451b0 0x563673400530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f32f3fff640 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5636730244d0 0x5636733f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f32f37fe640 1 -- 172.21.15.53:0/476290844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730451b0 msgr2=0x563673400530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f32f37fe640 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730451b0 0x563673400530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f32f37fe640 1 -- 172.21.15.53:0/476290844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5636730244d0 msgr2=0x5636733f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f32f37fe640 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5636730244d0 0x5636733f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f32f37fe640 1 -- 172.21.15.53:0/476290844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563673129620 con 0x56367301c2f0 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.375+0000 7f32f3fff640 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5636730244d0 0x5636733f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f32f37fe640 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f46c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009e10 tx=0x7f32e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e056c9bbc254faf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f32d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f32d37fe640 1 -- 172.21.15.53:0/476290844 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8010e20 con 0x56367301c2f0 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f32d37fe640 1 -- 172.21.15.53:0/476290844 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f32e8020440 con 0x56367301c2f0 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f3301122740 1 -- 172.21.15.53:0/476290844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32e4015070 con 0x56367301c2f0 2024-08-31T06:08:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f32d37fe640 1 -- 172.21.15.53:0/476290844 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f32e8020640 con 0x56367301c2f0 2024-08-31T06:08:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f3301122740 10 client.16692 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f3301122740 1 -- 172.21.15.53:0/476290844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563673403310 con 0x56367301c2f0 2024-08-31T06:08:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f32d37fe640 1 -- 172.21.15.53:0/476290844 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32e4015070 con 0x56367301c2f0 2024-08-31T06:08:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f32d37fe640 1 -- 172.21.15.53:0/476290844 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f32e801e020 con 0x56367301c2f0 2024-08-31T06:08:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f3301122740 10 client.16692 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f3301122740 10 client.16692 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f3301122740 20 client.16692 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f3301122740 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563673003d80 0x563673406920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f3301122740 4 client.16692 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.376+0000 7f3301122740 1 -- 172.21.15.53:0/476290844 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56367335ff50 con 0x563673003d80 2024-08-31T06:08:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.377+0000 7f32f3fff640 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563673003d80 0x563673406920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.377+0000 7f32d37fe640 10 client.16692 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.377+0000 7f32f3fff640 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563673003d80 0x563673406920 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deae549413afe555 server_cookie=2f4a4820ae65843 in_seq=0 out_seq=0 2024-08-31T06:08:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.378+0000 7f32d37fe640 1 -- 172.21.15.53:0/476290844 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56367335ff50 con 0x563673003d80 2024-08-31T06:08:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.378+0000 7f32d37fe640 10 client.16692 handle_command_reply: tid=0 2024-08-31T06:08:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.378+0000 7f3301122740 1 client.16692 shutdown 2024-08-31T06:08:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f3301122740 1 -- 172.21.15.53:0/476290844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 msgr2=0x5636733f46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f3301122740 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f46c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009e10 tx=0x7f32e80046c0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f3301122740 1 -- 172.21.15.53:0/476290844 shutdown_connections 2024-08-31T06:08:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f3301122740 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563673003d80 0x563673406920 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f3301122740 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730451b0 0x563673400530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f3301122740 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5636730244d0 0x5636733f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f32d37fe640 0 client.16692 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f3301122740 1 --2- 172.21.15.53:0/476290844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f46c0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f3301122740 1 -- 172.21.15.53:0/476290844 >> 172.21.15.53:0/476290844 conn(0x563673039300 msgr2=0x5636733e9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f3301122740 1 -- 172.21.15.53:0/476290844 shutdown_connections 2024-08-31T06:08:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f3301122740 1 -- 172.21.15.53:0/476290844 wait complete. 2024-08-31T06:08:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.379+0000 7f3301122740 20 client.16692 trim_cache size 0 max 16384 2024-08-31T06:08:03.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f3301122740 1 Processor -- start 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f3301122740 1 -- start start 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f3301122740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563673003d80 0x5636733f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f3301122740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f3301122740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730244d0 0x5636733f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f3301122740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41af460 con 0x56367301c2f0 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f3301122740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41b1060 con 0x563673003d80 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f3301122740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41afb30 con 0x5636730244d0 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46626/0 (socket says 172.21.15.53:46626) 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f32f3fff640 1 -- 172.21.15.53:0/3900464084 learned_addr learned my addr 172.21.15.53:0/3900464084 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f32f37fe640 1 --2- 172.21.15.53:0/3900464084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730244d0 0x5636733f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f32f3fff640 1 -- 172.21.15.53:0/3900464084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730244d0 msgr2=0x5636733f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f32f3fff640 1 --2- 172.21.15.53:0/3900464084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730244d0 0x5636733f1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f32f3fff640 1 -- 172.21.15.53:0/3900464084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563673003d80 msgr2=0x5636733f4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f32f3fff640 1 --2- 172.21.15.53:0/3900464084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563673003d80 0x5636733f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f32f3fff640 1 -- 172.21.15.53:0/3900464084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636733f5470 con 0x56367301c2f0 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.394+0000 7f32f3fff640 1 --2- 172.21.15.53:0/3900464084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f16a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f32e4000c00 tx=0x7f32e400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a297de31b69c42c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f32d9ffb640 1 -- 172.21.15.53:0/3900464084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4003dd0 con 0x56367301c2f0 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f32d9ffb640 1 -- 172.21.15.53:0/3900464084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32e4015040 con 0x56367301c2f0 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f32d9ffb640 1 -- 172.21.15.53:0/3900464084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e40116c0 con 0x56367301c2f0 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f3301122740 1 -- 172.21.15.53:0/3900464084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 msgr2=0x5636733f16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f3301122740 1 --2- 172.21.15.53:0/3900464084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f16a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f32e4000c00 tx=0x7f32e400b670 comp rx=0 tx=0).stop 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f3301122740 1 -- 172.21.15.53:0/3900464084 shutdown_connections 2024-08-31T06:08:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f3301122740 1 --2- 172.21.15.53:0/3900464084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730244d0 0x5636733f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f3301122740 1 --2- 172.21.15.53:0/3900464084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733f16a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f3301122740 1 --2- 172.21.15.53:0/3900464084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563673003d80 0x5636733f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f3301122740 1 -- 172.21.15.53:0/3900464084 >> 172.21.15.53:0/3900464084 conn(0x563673039300 msgr2=0x5636733f4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f3301122740 1 -- 172.21.15.53:0/3900464084 shutdown_connections 2024-08-31T06:08:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.395+0000 7f3301122740 1 -- 172.21.15.53:0/3900464084 wait complete. 2024-08-31T06:08:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f3301122740 1 -- start start 2024-08-31T06:08:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f3301122740 1 Processor -- start 2024-08-31T06:08:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f3301122740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563673003d80 0x5636733fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f3301122740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733fa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f3301122740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730244d0 0x5636733fa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f3301122740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41b08d0 con 0x56367301c2f0 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f3301122740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41b0200 con 0x563673003d80 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f3301122740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41ad440 con 0x5636730244d0 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f3301122740 10 client.0 _ll_register_callbacks cb 0x7f32e80098d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733fa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46630/0 (socket says 172.21.15.53:46630) 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.396+0000 7f32f3fff640 1 -- 172.21.15.53:0/3889715643 learned_addr learned my addr 172.21.15.53:0/3889715643 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32f37fe640 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730244d0 0x5636733fa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32f37fe640 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563673003d80 0x5636733fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32f3fff640 1 -- 172.21.15.53:0/3889715643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730244d0 msgr2=0x5636733fa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32f3fff640 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730244d0 0x5636733fa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32f3fff640 1 -- 172.21.15.53:0/3889715643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563673003d80 msgr2=0x5636733fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32f3fff640 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563673003d80 0x5636733fcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32f3fff640 1 -- 172.21.15.53:0/3889715643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636733fb030 con 0x56367301c2f0 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32f37fe640 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730244d0 0x5636733fa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32f3fff640 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733fa2a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f32e4004900 tx=0x7f32e4026de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56bad443aca18738 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32d37fe640 1 -- 172.21.15.53:0/3889715643 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e403a020 con 0x56367301c2f0 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32d37fe640 1 -- 172.21.15.53:0/3889715643 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f32e4003d70 con 0x56367301c2f0 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f3301122740 1 -- 172.21.15.53:0/3889715643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32e4015040 con 0x56367301c2f0 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f32d37fe640 1 -- 172.21.15.53:0/3889715643 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f32e4031040 con 0x56367301c2f0 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f3301122740 10 client.16698 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.397+0000 7f3301122740 1 -- 172.21.15.53:0/3889715643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563673471310 con 0x56367301c2f0 2024-08-31T06:08:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.398+0000 7f32d37fe640 1 -- 172.21.15.53:0/3889715643 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32e4015040 con 0x56367301c2f0 2024-08-31T06:08:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.398+0000 7f32d37fe640 1 -- 172.21.15.53:0/3889715643 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f32e402a070 con 0x56367301c2f0 2024-08-31T06:08:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.398+0000 7f3301122740 10 client.16698 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.398+0000 7f3301122740 10 client.16698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.398+0000 7f3301122740 20 client.16698 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.398+0000 7f3301122740 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5636730451b0 0x563673473900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.398+0000 7f3301122740 4 client.16698 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:08:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.398+0000 7f3301122740 1 -- 172.21.15.53:0/3889715643 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56367335b9f0 con 0x5636730451b0 2024-08-31T06:08:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.398+0000 7f32f37fe640 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5636730451b0 0x563673473900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.399+0000 7f32d37fe640 10 client.16698 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.399+0000 7f32f37fe640 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5636730451b0 0x563673473900 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb98b2e8ddb4c690 server_cookie=ab6c59bbff3fe15f in_seq=0 out_seq=0 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f32d37fe640 1 -- 172.21.15.53:0/3889715643 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56367335b9f0 con 0x5636730451b0 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f32d37fe640 10 client.16698 handle_command_reply: tid=0 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f3301122740 1 client.16698 shutdown 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f3301122740 1 -- 172.21.15.53:0/3889715643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 msgr2=0x5636733fa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f3301122740 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733fa2a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f32e4004900 tx=0x7f32e4026de0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f3301122740 1 -- 172.21.15.53:0/3889715643 shutdown_connections 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f3301122740 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5636730451b0 0x563673473900 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f3301122740 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636730244d0 0x5636733fa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f3301122740 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56367301c2f0 0x5636733fa2a0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f32d37fe640 0 client.16698 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f3301122740 1 --2- 172.21.15.53:0/3889715643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563673003d80 0x5636733fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.420+0000 7f3301122740 1 -- 172.21.15.53:0/3889715643 >> 172.21.15.53:0/3889715643 conn(0x563673039300 msgr2=0x5636733f6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f3301122740 1 -- 172.21.15.53:0/3889715643 shutdown_connections 2024-08-31T06:08:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f3301122740 1 -- 172.21.15.53:0/3889715643 wait complete. 2024-08-31T06:08:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f3301122740 20 client.16698 trim_cache size 0 max 16384 2024-08-31T06:08:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:08:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:08:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:08:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:08:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 -- 172.21.15.53:0/3529056264 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32dc0b4ca0 msgr2=0x7f32dc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32dc0b4ca0 0x7f32dc0b71b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0ca100 tx=0x7f32ec0c8e30 comp rx=0 tx=0).stop 2024-08-31T06:08:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 -- 172.21.15.53:0/3529056264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f41089d0 msgr2=0x7f32f419f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f41089d0 0x7f32f419f920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f32ec005e30 tx=0x7f32ec0093d0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 -- 172.21.15.53:0/3529056264 shutdown_connections 2024-08-31T06:08:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32dc0b4ca0 0x7f32dc0b71b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f41089d0 0x7f32f419f920 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32f4108080 0x7f32f419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 --2- 172.21.15.53:0/3529056264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32f4102750 0x7f32f419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 -- 172.21.15.53:0/3529056264 >> 172.21.15.53:0/3529056264 conn(0x7f32f407a4e0 msgr2=0x7f32f41015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 -- 172.21.15.53:0/3529056264 shutdown_connections 2024-08-31T06:08:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:03.421+0000 7f32fa578640 1 -- 172.21.15.53:0/3529056264 wait complete. 2024-08-31T06:08:03.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.66 MB/sec warmup 113 sec latency 10940.395 ms 2024-08-31T06:08:04.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:03 smithi130 ceph-mon[22266]: pgmap v416: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 421 KiB/s wr, 73 op/s 2024-08-31T06:08:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:03 smithi153 ceph-mon[22320]: pgmap v416: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 421 KiB/s wr, 73 op/s 2024-08-31T06:08:04.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:03 smithi053 ceph-mon[18924]: pgmap v416: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 421 KiB/s wr, 73 op/s 2024-08-31T06:08:04.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.64 MB/sec warmup 114 sec latency 11940.495 ms 2024-08-31T06:08:05.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.61 MB/sec warmup 115 sec latency 12940.609 ms 2024-08-31T06:08:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:05 smithi130 ceph-mon[22266]: pgmap v417: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 372 KiB/s wr, 72 op/s 2024-08-31T06:08:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:05 smithi153 ceph-mon[22320]: pgmap v417: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 372 KiB/s wr, 72 op/s 2024-08-31T06:08:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:05 smithi053 ceph-mon[18924]: pgmap v417: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 372 KiB/s wr, 72 op/s 2024-08-31T06:08:06.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.59 MB/sec warmup 116 sec latency 13940.698 ms 2024-08-31T06:08:07.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.57 MB/sec warmup 117 sec latency 14940.801 ms 2024-08-31T06:08:08.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:07 smithi130 ceph-mon[22266]: pgmap v418: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 216 KiB/s wr, 53 op/s 2024-08-31T06:08:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:07 smithi153 ceph-mon[22320]: pgmap v418: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 216 KiB/s wr, 53 op/s 2024-08-31T06:08:08.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:07 smithi053 ceph-mon[18924]: pgmap v418: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 216 KiB/s wr, 53 op/s 2024-08-31T06:08:08.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.55 MB/sec warmup 118 sec latency 15940.909 ms 2024-08-31T06:08:09.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 2.53 MB/sec warmup 119 sec latency 16940.980 ms 2024-08-31T06:08:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:09 smithi130 ceph-mon[22266]: pgmap v419: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 56 KiB/s wr, 34 op/s 2024-08-31T06:08:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:09 smithi153 ceph-mon[22320]: pgmap v419: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 56 KiB/s wr, 34 op/s 2024-08-31T06:08:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:09 smithi053 ceph-mon[18924]: pgmap v419: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 56 KiB/s wr, 34 op/s 2024-08-31T06:08:11.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 0.00 MB/sec execute 1 sec latency 18941.165 ms 2024-08-31T06:08:12.075 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:08:12.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:11 smithi053 ceph-mon[18924]: pgmap v420: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 KiB/s wr, 29 op/s 2024-08-31T06:08:12.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:11 smithi130 ceph-mon[22266]: pgmap v420: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 KiB/s wr, 29 op/s 2024-08-31T06:08:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:11 smithi153 ceph-mon[22320]: pgmap v420: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 KiB/s wr, 29 op/s 2024-08-31T06:08:12.342 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:12.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.847+0000 7fef7b2ea640 1 -- 172.21.15.53:0/2521691244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74109240 msgr2=0x7fef74109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.847+0000 7fef7b2ea640 1 --2- 172.21.15.53:0/2521691244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74109240 0x7fef74109650 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fef64009900 tx=0x7fef6402a410 comp rx=0 tx=0).stop 2024-08-31T06:08:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.847+0000 7fef7b2ea640 1 -- 172.21.15.53:0/2521691244 shutdown_connections 2024-08-31T06:08:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.847+0000 7fef7b2ea640 1 --2- 172.21.15.53:0/2521691244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef74109b90 0x7fef741103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.847+0000 7fef7b2ea640 1 --2- 172.21.15.53:0/2521691244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74109240 0x7fef74109650 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.847+0000 7fef7b2ea640 1 --2- 172.21.15.53:0/2521691244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef74103900 0x7fef74103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.847+0000 7fef7b2ea640 1 -- 172.21.15.53:0/2521691244 >> 172.21.15.53:0/2521691244 conn(0x7fef7407b5f0 msgr2=0x7fef7407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.848+0000 7fef7b2ea640 1 -- 172.21.15.53:0/2521691244 shutdown_connections 2024-08-31T06:08:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.848+0000 7fef7b2ea640 1 -- 172.21.15.53:0/2521691244 wait complete. 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.849+0000 7fef7b2ea640 1 Processor -- start 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.849+0000 7fef7b2ea640 1 -- start start 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.849+0000 7fef7b2ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74103900 0x7fef7419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.849+0000 7fef7b2ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef74109240 0x7fef7419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.849+0000 7fef7b2ea640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef74109b90 0x7fef7419fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.849+0000 7fef7b2ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fef74113720 con 0x7fef74103900 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.849+0000 7fef7b2ea640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fef741135a0 con 0x7fef74109240 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.849+0000 7fef7b2ea640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef741138a0 con 0x7fef74109b90 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.849+0000 7fef79086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74103900 0x7fef7419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef79086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74103900 0x7fef7419a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46656/0 (socket says 172.21.15.53:46656) 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef79086640 1 -- 172.21.15.53:0/736502993 learned_addr learned my addr 172.21.15.53:0/736502993 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef79887640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef74109b90 0x7fef7419fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef78885640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef74109240 0x7fef7419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef79086640 1 -- 172.21.15.53:0/736502993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef74109b90 msgr2=0x7fef7419fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef79086640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef74109b90 0x7fef7419fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef79086640 1 -- 172.21.15.53:0/736502993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef74109240 msgr2=0x7fef7419a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef79086640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef74109240 0x7fef7419a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef79086640 1 -- 172.21.15.53:0/736502993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef741a0200 con 0x7fef74103900 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef78885640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef74109240 0x7fef7419a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef79086640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74103900 0x7fef7419a290 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fef7000c890 tx=0x7fef7000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef6a7fc640 1 -- 172.21.15.53:0/736502993 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70004220 con 0x7fef74103900 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef6a7fc640 1 -- 172.21.15.53:0/736502993 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef70007e40 con 0x7fef74103900 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef7b2ea640 1 -- 172.21.15.53:0/736502993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef741a04f0 con 0x7fef74103900 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef6a7fc640 1 -- 172.21.15.53:0/736502993 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70004a00 con 0x7fef74103900 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.850+0000 7fef7b2ea640 1 -- 172.21.15.53:0/736502993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef741a6c50 con 0x7fef74103900 2024-08-31T06:08:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.852+0000 7fef7b2ea640 1 -- 172.21.15.53:0/736502993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef74103d10 con 0x7fef74103900 2024-08-31T06:08:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.853+0000 7fef6a7fc640 1 -- 172.21.15.53:0/736502993 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fef700079b0 con 0x7fef74103900 2024-08-31T06:08:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.854+0000 7fef6a7fc640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef600b4ca0 0x7fef600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.854+0000 7fef78885640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef600b4ca0 0x7fef600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.854+0000 7fef6a7fc640 1 -- 172.21.15.53:0/736502993 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fef700e5290 con 0x7fef74103900 2024-08-31T06:08:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.855+0000 7fef78885640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef600b4ca0 0x7fef600b71b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fef640057c0 tx=0x7fef64009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:12.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:12.858+0000 7fef6a7fc640 1 -- 172.21.15.53:0/736502993 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fef70014030 con 0x7fef74103900 2024-08-31T06:08:12.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 0.00 MB/sec execute 2 sec latency 19941.217 ms 2024-08-31T06:08:13.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.084+0000 7fef7b2ea640 1 -- 172.21.15.53:0/736502993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef7402e430 con 0x7fef74103900 2024-08-31T06:08:13.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.084+0000 7fef6a7fc640 1 -- 172.21.15.53:0/736502993 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11992 (secure 0 0 0) 0x7fef700ac080 con 0x7fef74103900 2024-08-31T06:08:13.087 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:08:13.087 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"btime":"2024-08-31T06:06:51:511613+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:06:50.526609+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:08:13.087 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 30 2024-08-31T06:08:13.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.086+0000 7fef7b2ea640 1 -- 172.21.15.53:0/736502993 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef600b4ca0 msgr2=0x7fef600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:13.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.086+0000 7fef7b2ea640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef600b4ca0 0x7fef600b71b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fef640057c0 tx=0x7fef64009680 comp rx=0 tx=0).stop 2024-08-31T06:08:13.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.086+0000 7fef7b2ea640 1 -- 172.21.15.53:0/736502993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74103900 msgr2=0x7fef7419a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:13.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.086+0000 7fef7b2ea640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74103900 0x7fef7419a290 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fef7000c890 tx=0x7fef7000cd50 comp rx=0 tx=0).stop 2024-08-31T06:08:13.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.087+0000 7fef7b2ea640 1 -- 172.21.15.53:0/736502993 shutdown_connections 2024-08-31T06:08:13.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.087+0000 7fef7b2ea640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef600b4ca0 0x7fef600b71b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:13.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.087+0000 7fef7b2ea640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef74109b90 0x7fef7419fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:13.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.087+0000 7fef7b2ea640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef74109240 0x7fef7419a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:13.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.087+0000 7fef7b2ea640 1 --2- 172.21.15.53:0/736502993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74103900 0x7fef7419a290 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:13.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.087+0000 7fef7b2ea640 1 -- 172.21.15.53:0/736502993 >> 172.21.15.53:0/736502993 conn(0x7fef7407b5f0 msgr2=0x7fef74107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:13.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.087+0000 7fef7b2ea640 1 -- 172.21.15.53:0/736502993 shutdown_connections 2024-08-31T06:08:13.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:13.087+0000 7fef7b2ea640 1 -- 172.21.15.53:0/736502993 wait complete. 2024-08-31T06:08:13.825 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id f6ab1b68 --release --await' 2024-08-31T06:08:13.826 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id f6ab1b68 --release --await 2024-08-31T06:08:13.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52590 0.00 MB/sec execute 3 sec latency 20941.266 ms 2024-08-31T06:08:14.121 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:13 smithi130 ceph-mon[22266]: pgmap v421: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 32 KiB/s wr, 28 op/s 2024-08-31T06:08:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:13 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/736502993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:13 smithi153 ceph-mon[22320]: pgmap v421: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 32 KiB/s wr, 28 op/s 2024-08-31T06:08:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:13 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/736502993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:14.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:13 smithi053 ceph-mon[18924]: pgmap v421: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 32 KiB/s wr, 28 op/s 2024-08-31T06:08:14.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:13 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/736502993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:14.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.610+0000 7f31cfe62640 1 -- 172.21.15.53:0/3121712051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31c81145a0 msgr2=0x7f31c811add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:14.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.610+0000 7f31cfe62640 1 --2- 172.21.15.53:0/3121712051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31c81145a0 0x7f31c811add0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009ca0 tx=0x7f31c002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.611+0000 7f31cfe62640 1 -- 172.21.15.53:0/3121712051 shutdown_connections 2024-08-31T06:08:14.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.611+0000 7f31cfe62640 1 --2- 172.21.15.53:0/3121712051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31c81145a0 0x7f31c811add0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.611+0000 7f31cfe62640 1 --2- 172.21.15.53:0/3121712051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8113c50 0x7f31c8114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.611+0000 7f31cfe62640 1 --2- 172.21.15.53:0/3121712051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31c810e360 0x7f31c810e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.611+0000 7f31cfe62640 1 -- 172.21.15.53:0/3121712051 >> 172.21.15.53:0/3121712051 conn(0x7f31c810a160 msgr2=0x7f31c810c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.611+0000 7f31cfe62640 1 -- 172.21.15.53:0/3121712051 shutdown_connections 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.611+0000 7f31cfe62640 1 -- 172.21.15.53:0/3121712051 wait complete. 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31cfe62640 1 Processor -- start 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31cfe62640 1 -- start start 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31cfe62640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c810e360 0x7f31c81a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31cfe62640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31c8113c50 0x7f31c81a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31cfe62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31c81145a0 0x7f31c81aa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31cfe62640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f31c811e170 con 0x7f31c81145a0 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31cfe62640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f31c811dff0 con 0x7f31c8113c50 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31cfe62640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f31c811e2f0 con 0x7f31c810e360 2024-08-31T06:08:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31ce3ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31c81145a0 0x7f31c81aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31ce3ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31c81145a0 0x7f31c81aa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46624/0 (socket says 172.21.15.53:46624) 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31ce3ff640 1 -- 172.21.15.53:0/3403251241 learned_addr learned my addr 172.21.15.53:0/3403251241 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c810e360 0x7f31c81a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.612+0000 7f31cd3fd640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31c8113c50 0x7f31c81a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.613+0000 7f31ce3ff640 1 -- 172.21.15.53:0/3403251241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c810e360 msgr2=0x7f31c81a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.613+0000 7f31ce3ff640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c810e360 0x7f31c81a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.613+0000 7f31ce3ff640 1 -- 172.21.15.53:0/3403251241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31c8113c50 msgr2=0x7f31c81a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.613+0000 7f31ce3ff640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31c8113c50 0x7f31c81a50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.613+0000 7f31ce3ff640 1 -- 172.21.15.53:0/3403251241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c81aaa90 con 0x7f31c81145a0 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.613+0000 7f31ce3ff640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31c81145a0 0x7f31c81aa360 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f31c0031040 tx=0x7f31c0032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.613+0000 7f31beffd640 1 -- 172.21.15.53:0/3403251241 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0004040 con 0x7f31c81145a0 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.613+0000 7f31beffd640 1 -- 172.21.15.53:0/3403251241 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31c0004670 con 0x7f31c81145a0 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.613+0000 7f31cfe62640 1 -- 172.21.15.53:0/3403251241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c81aad20 con 0x7f31c81145a0 2024-08-31T06:08:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.613+0000 7f31beffd640 1 -- 172.21.15.53:0/3403251241 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0030bb0 con 0x7f31c81145a0 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.613+0000 7f31cfe62640 1 -- 172.21.15.53:0/3403251241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c81b14e0 con 0x7f31c81145a0 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.616+0000 7f31d63d7740 1 Processor -- start 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.616+0000 7f31beffd640 1 -- 172.21.15.53:0/3403251241 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f31c00041e0 con 0x7f31c81145a0 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.616+0000 7f31d63d7740 1 -- start start 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa29520 0x55b67adcec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa00660 0x55b67adcf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 0x55b67adcf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31d63d7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b67ad45a70 con 0x55b67aa08840 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31d63d7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b67ad35000 con 0x55b67aa29520 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31d63d7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b67ad38fb0 con 0x55b67aa00660 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31cd3fd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa29520 0x55b67adcec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31cdbfe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa00660 0x55b67adcf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31cd3fd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa29520 0x55b67adcec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54908/0 (socket says 172.21.15.53:54908) 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31cd3fd640 1 -- 172.21.15.53:0/2784884904 learned_addr learned my addr 172.21.15.53:0/2784884904 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31cdbfe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa00660 0x55b67adcf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44926/0 (socket says 172.21.15.53:44926) 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31cd3fd640 1 --2- 172.21.15.53:0/2784884904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 0x55b67adcf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31cdbfe640 1 -- 172.21.15.53:0/2784884904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa29520 msgr2=0x55b67adcec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/2784884904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa29520 0x55b67adcec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31cdbfe640 1 -- 172.21.15.53:0/2784884904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 msgr2=0x55b67adcf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/2784884904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 0x55b67adcf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31cdbfe640 1 -- 172.21.15.53:0/2784884904 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67aa94b00 con 0x55b67aa00660 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.617+0000 7f31beffd640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31b40b4ca0 0x7f31b40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.618+0000 7f31cd3fd640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31b40b4ca0 0x7f31b40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.618+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/2784884904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa00660 0x55b67adcf1c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f31c4005fd0 tx=0x7f31c40107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b01cbbf39c7eb0b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.618+0000 7f31beffd640 1 -- 172.21.15.53:0/3403251241 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f31c0106720 con 0x7f31c81145a0 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.618+0000 7f31b3fff640 1 -- 172.21.15.53:0/2784884904 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c401c480 con 0x55b67aa00660 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.618+0000 7f31b3fff640 1 -- 172.21.15.53:0/2784884904 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31c401cab0 con 0x55b67aa00660 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.618+0000 7f31b3fff640 1 -- 172.21.15.53:0/2784884904 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4011a10 con 0x55b67aa00660 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31d63d7740 1 -- 172.21.15.53:0/2784884904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa00660 msgr2=0x55b67adcf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31d63d7740 1 --2- 172.21.15.53:0/2784884904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa00660 0x55b67adcf1c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f31c4005fd0 tx=0x7f31c40107a0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31cd3fd640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31b40b4ca0 0x7f31b40b71b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f31b800bfd0 tx=0x7f31b800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31d63d7740 1 -- 172.21.15.53:0/2784884904 shutdown_connections 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31d63d7740 1 --2- 172.21.15.53:0/2784884904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 0x55b67adcf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31d63d7740 1 --2- 172.21.15.53:0/2784884904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa00660 0x55b67adcf1c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31d63d7740 1 --2- 172.21.15.53:0/2784884904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa29520 0x55b67adcec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31d63d7740 1 -- 172.21.15.53:0/2784884904 >> 172.21.15.53:0/2784884904 conn(0x55b67aa1d910 msgr2=0x55b67adccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31d63d7740 1 -- 172.21.15.53:0/2784884904 shutdown_connections 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31d63d7740 1 -- 172.21.15.53:0/2784884904 wait complete. 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31d63d7740 1 -- start start 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.619+0000 7f31d63d7740 1 Processor -- start 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa00660 0x55b67adda7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 0x55b67addace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa29520 0x55b67ade6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31d63d7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b67addd460 con 0x55b67aa08840 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31d63d7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b67acf6520 con 0x55b67aa00660 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31d63d7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b67addd5e0 con 0x55b67aa29520 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31d63d7740 10 client.0 _ll_register_callbacks cb 0x55b67ad2ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31cd3fd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 0x55b67addace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31cd3fd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 0x55b67addace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46640/0 (socket says 172.21.15.53:46640) 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31cd3fd640 1 -- 172.21.15.53:0/1780101482 learned_addr learned my addr 172.21.15.53:0/1780101482 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa00660 0x55b67adda7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31ce3ff640 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa29520 0x55b67ade6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31cd3fd640 1 -- 172.21.15.53:0/1780101482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa29520 msgr2=0x55b67ade6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31cd3fd640 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa29520 0x55b67ade6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31cd3fd640 1 -- 172.21.15.53:0/1780101482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa00660 msgr2=0x55b67adda7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.620+0000 7f31cd3fd640 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa00660 0x55b67adda7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.621+0000 7f31cd3fd640 1 -- 172.21.15.53:0/1780101482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67ab0b960 con 0x55b67aa08840 2024-08-31T06:08:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.621+0000 7f31cd3fd640 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 0x55b67addace0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f31b80044a0 tx=0x7f31b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc693e1771355b75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.621+0000 7f31b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.621+0000 7f31b17fa640 1 -- 172.21.15.53:0/1780101482 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8012660 con 0x55b67aa08840 2024-08-31T06:08:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.621+0000 7f31b17fa640 1 -- 172.21.15.53:0/1780101482 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f31b8012800 con 0x55b67aa08840 2024-08-31T06:08:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.621+0000 7f31d63d7740 1 -- 172.21.15.53:0/1780101482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b67acd49a0 con 0x55b67aa08840 2024-08-31T06:08:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.621+0000 7f31b17fa640 1 -- 172.21.15.53:0/1780101482 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f31b8012a00 con 0x55b67aa08840 2024-08-31T06:08:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.621+0000 7f31d63d7740 10 client.16716 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.621+0000 7f31d63d7740 1 -- 172.21.15.53:0/1780101482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b67ade95e0 con 0x55b67aa08840 2024-08-31T06:08:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.621+0000 7f31b17fa640 1 -- 172.21.15.53:0/1780101482 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b67acd49a0 con 0x55b67aa08840 2024-08-31T06:08:14.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.622+0000 7f31b17fa640 1 -- 172.21.15.53:0/1780101482 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f31b8028070 con 0x55b67aa08840 2024-08-31T06:08:14.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.622+0000 7f31d63d7740 10 client.16716 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.622+0000 7f31d63d7740 10 client.16716 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.622+0000 7f31d63d7740 20 client.16716 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.622+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b67a9e7ea0 0x55b67aded070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.622+0000 7f31d63d7740 4 client.16716 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.622+0000 7f31d63d7740 1 -- 172.21.15.53:0/1780101482 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b67ad479c0 con 0x55b67a9e7ea0 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.622+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b67a9e7ea0 0x55b67aded070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.622+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b67a9e7ea0 0x55b67aded070 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=122283cce7863c server_cookie=4ec53755b054585 in_seq=0 out_seq=0 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.622+0000 7f31b17fa640 10 client.16716 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.623+0000 7f31b17fa640 1 -- 172.21.15.53:0/1780101482 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b67ad479c0 con 0x55b67a9e7ea0 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.623+0000 7f31b17fa640 10 client.16716 handle_command_reply: tid=0 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.623+0000 7f31d63d7740 1 client.16716 shutdown 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.623+0000 7f31d63d7740 1 -- 172.21.15.53:0/1780101482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 msgr2=0x55b67addace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:14.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.623+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 0x55b67addace0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f31b80044a0 tx=0x7f31b8004730 comp rx=0 tx=0).stop 2024-08-31T06:08:14.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.623+0000 7f31d63d7740 1 -- 172.21.15.53:0/1780101482 shutdown_connections 2024-08-31T06:08:14.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.623+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b67a9e7ea0 0x55b67aded070 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.623+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa29520 0x55b67ade6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.624+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa08840 0x55b67addace0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.624+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1780101482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa00660 0x55b67adda7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.624+0000 7f31d63d7740 1 -- 172.21.15.53:0/1780101482 >> 172.21.15.53:0/1780101482 conn(0x55b67aa1d910 msgr2=0x55b67add1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:14.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.624+0000 7f31b17fa640 0 client.16716 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:14.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.624+0000 7f31d63d7740 1 -- 172.21.15.53:0/1780101482 shutdown_connections 2024-08-31T06:08:14.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.624+0000 7f31d63d7740 1 -- 172.21.15.53:0/1780101482 wait complete. 2024-08-31T06:08:14.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.624+0000 7f31d63d7740 20 client.16716 trim_cache size 0 max 16384 2024-08-31T06:08:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.641+0000 7f31d63d7740 1 Processor -- start 2024-08-31T06:08:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.641+0000 7f31d63d7740 1 -- start start 2024-08-31T06:08:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.641+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa00660 0x55b67add7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.641+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa08840 0x55b67add7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.641+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa29520 0x55b67adf2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.641+0000 7f31d63d7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81b9e30 con 0x55b67aa29520 2024-08-31T06:08:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.641+0000 7f31d63d7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81bba30 con 0x55b67aa00660 2024-08-31T06:08:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.641+0000 7f31d63d7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81ba500 con 0x55b67aa08840 2024-08-31T06:08:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.641+0000 7f31ce3ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa29520 0x55b67adf2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.641+0000 7f31ce3ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa29520 0x55b67adf2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46648/0 (socket says 172.21.15.53:46648) 2024-08-31T06:08:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.641+0000 7f31ce3ff640 1 -- 172.21.15.53:0/2819290003 learned_addr learned my addr 172.21.15.53:0/2819290003 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/2819290003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa00660 0x55b67add7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31cd3fd640 1 --2- 172.21.15.53:0/2819290003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa08840 0x55b67add7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31ce3ff640 1 -- 172.21.15.53:0/2819290003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa08840 msgr2=0x55b67add7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31ce3ff640 1 --2- 172.21.15.53:0/2819290003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa08840 0x55b67add7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31ce3ff640 1 -- 172.21.15.53:0/2819290003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa00660 msgr2=0x55b67add7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31ce3ff640 1 --2- 172.21.15.53:0/2819290003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa00660 0x55b67add7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31ce3ff640 1 -- 172.21.15.53:0/2819290003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67adccfc0 con 0x55b67aa29520 2024-08-31T06:08:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/2819290003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa00660 0x55b67add7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31ce3ff640 1 --2- 172.21.15.53:0/2819290003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa29520 0x55b67adf2870 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f31c0104470 tx=0x7f31c0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7d09c97829bf47 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:14.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31b37fe640 1 -- 172.21.15.53:0/2819290003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c00044d0 con 0x55b67aa29520 2024-08-31T06:08:14.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31b37fe640 1 -- 172.21.15.53:0/2819290003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31c0036040 con 0x55b67aa29520 2024-08-31T06:08:14.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.642+0000 7f31b37fe640 1 -- 172.21.15.53:0/2819290003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c00d6130 con 0x55b67aa29520 2024-08-31T06:08:14.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.643+0000 7f31d63d7740 1 -- 172.21.15.53:0/2819290003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa29520 msgr2=0x55b67adf2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:14.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.643+0000 7f31d63d7740 1 --2- 172.21.15.53:0/2819290003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa29520 0x55b67adf2870 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f31c0104470 tx=0x7f31c0009a20 comp rx=0 tx=0).stop 2024-08-31T06:08:14.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.643+0000 7f31d63d7740 1 -- 172.21.15.53:0/2819290003 shutdown_connections 2024-08-31T06:08:14.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.643+0000 7f31d63d7740 1 --2- 172.21.15.53:0/2819290003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa29520 0x55b67adf2870 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.643+0000 7f31d63d7740 1 --2- 172.21.15.53:0/2819290003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa08840 0x55b67add7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.643+0000 7f31d63d7740 1 --2- 172.21.15.53:0/2819290003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa00660 0x55b67add7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.643+0000 7f31d63d7740 1 -- 172.21.15.53:0/2819290003 >> 172.21.15.53:0/2819290003 conn(0x55b67aa1d910 msgr2=0x55b67adcc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:14.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.643+0000 7f31d63d7740 1 -- 172.21.15.53:0/2819290003 shutdown_connections 2024-08-31T06:08:14.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.643+0000 7f31d63d7740 1 -- 172.21.15.53:0/2819290003 wait complete. 2024-08-31T06:08:14.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.643+0000 7f31d63d7740 1 -- start start 2024-08-31T06:08:14.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.643+0000 7f31d63d7740 1 Processor -- start 2024-08-31T06:08:14.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa00660 0x55b67ade2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa08840 0x55b67ade2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31d63d7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa29520 0x55b67addd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31d63d7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81bb2a0 con 0x55b67aa00660 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31d63d7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81babd0 con 0x55b67aa29520 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31d63d7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81b7e10 con 0x55b67aa08840 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31d63d7740 10 client.0 _ll_register_callbacks cb 0x7f31b800d460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31cdbfe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa00660 0x55b67ade2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31cdbfe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa00660 0x55b67ade2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46654/0 (socket says 172.21.15.53:46654) 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31cdbfe640 1 -- 172.21.15.53:0/1645815688 learned_addr learned my addr 172.21.15.53:0/1645815688 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31cd3fd640 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa08840 0x55b67ade2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31ce3ff640 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa29520 0x55b67addd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31cdbfe640 1 -- 172.21.15.53:0/1645815688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa08840 msgr2=0x55b67ade2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:14.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa08840 0x55b67ade2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31cdbfe640 1 -- 172.21.15.53:0/1645815688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa29520 msgr2=0x55b67addd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa29520 0x55b67addd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.644+0000 7f31cdbfe640 1 -- 172.21.15.53:0/1645815688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67add5e30 con 0x55b67aa00660 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31cdbfe640 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa00660 0x55b67ade2870 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f31c4005fd0 tx=0x7f31c4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feab579dcb610509 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31b17fa640 1 -- 172.21.15.53:0/1645815688 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4005240 con 0x55b67aa00660 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31b17fa640 1 -- 172.21.15.53:0/1645815688 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f31c40053e0 con 0x55b67aa00660 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31d63d7740 1 -- 172.21.15.53:0/1645815688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31c0036040 con 0x55b67aa00660 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31b17fa640 1 -- 172.21.15.53:0/1645815688 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f31c4004660 con 0x55b67aa00660 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31d63d7740 10 client.16722 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31d63d7740 1 -- 172.21.15.53:0/1645815688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b67ae57da0 con 0x55b67aa00660 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31b17fa640 1 -- 172.21.15.53:0/1645815688 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31c0036040 con 0x55b67aa00660 2024-08-31T06:08:14.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31b17fa640 1 -- 172.21.15.53:0/1645815688 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f31c401c610 con 0x55b67aa00660 2024-08-31T06:08:14.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31d63d7740 10 client.16722 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:14.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31d63d7740 10 client.16722 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:08:14.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31d63d7740 20 client.16722 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:14.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b67a9bd250 0x55b67ae5a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:14.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31d63d7740 4 client.16722 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f6ab1b68", "release": true, "await": true}] 2024-08-31T06:08:14.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.645+0000 7f31d63d7740 1 -- 172.21.15.53:0/1645815688 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f6ab1b68", "release": true, "await": true}) -- 0x55b67ad43460 con 0x55b67a9bd250 2024-08-31T06:08:14.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.646+0000 7f31cd3fd640 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b67a9bd250 0x55b67ae5a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:14.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.646+0000 7f31b17fa640 10 client.16722 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:14.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.646+0000 7f31cd3fd640 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b67a9bd250 0x55b67ae5a3b0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d089c32546b1ffbd server_cookie=311c7fb5479780a4 in_seq=0 out_seq=0 2024-08-31T06:08:14.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31b17fa640 1 -- 172.21.15.53:0/1645815688 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b67ad43460 con 0x55b67a9bd250 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31b17fa640 10 client.16722 handle_command_reply: tid=0 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31d63d7740 1 client.16722 shutdown 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31d63d7740 1 -- 172.21.15.53:0/1645815688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa00660 msgr2=0x55b67ade2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa00660 0x55b67ade2870 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f31c4005fd0 tx=0x7f31c4005850 comp rx=0 tx=0).stop 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31d63d7740 1 -- 172.21.15.53:0/1645815688 shutdown_connections 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b67a9bd250 0x55b67ae5a3b0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b67aa29520 0x55b67addd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b67aa08840 0x55b67ade2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31b17fa640 0 client.16722 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31d63d7740 1 --2- 172.21.15.53:0/1645815688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b67aa00660 0x55b67ade2870 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31d63d7740 1 -- 172.21.15.53:0/1645815688 >> 172.21.15.53:0/1645815688 conn(0x55b67aa1d910 msgr2=0x55b67add1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.654+0000 7f31d63d7740 1 -- 172.21.15.53:0/1645815688 shutdown_connections 2024-08-31T06:08:14.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31d63d7740 1 -- 172.21.15.53:0/1645815688 wait complete. 2024-08-31T06:08:14.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31d63d7740 20 client.16722 trim_cache size 0 max 16384 2024-08-31T06:08:14.658 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:08:14.658 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 30, 2024-08-31T06:08:14.658 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:08:14.658 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 12, 2024-08-31T06:08:14.658 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:08:14.658 INFO:teuthology.orchestra.run.smithi053.stdout: "f6ab1b68": { 2024-08-31T06:08:14.658 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 12, 2024-08-31T06:08:14.658 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:08:14.658 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 141.8, 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:14.659 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:14.660 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:14.660 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:08:14.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 -- 172.21.15.53:0/3403251241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31b40b4ca0 msgr2=0x7f31b40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:14.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31b40b4ca0 0x7f31b40b71b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f31b800bfd0 tx=0x7f31b800b390 comp rx=0 tx=0).stop 2024-08-31T06:08:14.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 -- 172.21.15.53:0/3403251241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31c81145a0 msgr2=0x7f31c81aa360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:14.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31c81145a0 0x7f31c81aa360 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f31c0031040 tx=0x7f31c0032bc0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 -- 172.21.15.53:0/3403251241 shutdown_connections 2024-08-31T06:08:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31b40b4ca0 0x7f31b40b71b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31c81145a0 0x7f31c81aa360 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31c8113c50 0x7f31c81a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 --2- 172.21.15.53:0/3403251241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c810e360 0x7f31c81a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 -- 172.21.15.53:0/3403251241 >> 172.21.15.53:0/3403251241 conn(0x7f31c810a160 msgr2=0x7f31c81131f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 -- 172.21.15.53:0/3403251241 shutdown_connections 2024-08-31T06:08:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:14.655+0000 7f31cfe62640 1 -- 172.21.15.53:0/3403251241 wait complete. 2024-08-31T06:08:14.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 52854 0.32 MB/sec execute 4 sec latency 21634.276 ms 2024-08-31T06:08:15.574 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f6ab1b68', total seconds elapsed: 25.3 2024-08-31T06:08:15.575 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.8 2024-08-31T06:08:15.575 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:08:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:15.964 INFO:tasks.workunit.client.0.smithi053.stdout: 1 53245 1.12 MB/sec execute 5 sec latency 15.070 ms 2024-08-31T06:08:16.126 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:15 smithi053 ceph-mon[18924]: pgmap v422: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 30 op/s 2024-08-31T06:08:16.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:15 smithi130 ceph-mon[22266]: pgmap v422: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 30 op/s 2024-08-31T06:08:16.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:15 smithi153 ceph-mon[22320]: pgmap v422: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 30 op/s 2024-08-31T06:08:16.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.378+0000 7fc16393a640 1 -- 172.21.15.53:0/1759507427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c102800 msgr2=0x7fc15c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.379+0000 7fc16393a640 1 --2- 172.21.15.53:0/1759507427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c102800 0x7fc15c102c10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc158009900 tx=0x7fc15802a410 comp rx=0 tx=0).stop 2024-08-31T06:08:16.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.379+0000 7fc16393a640 1 -- 172.21.15.53:0/1759507427 shutdown_connections 2024-08-31T06:08:16.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.379+0000 7fc16393a640 1 --2- 172.21.15.53:0/1759507427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc15c108a90 0x7fc15c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.379+0000 7fc16393a640 1 --2- 172.21.15.53:0/1759507427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc15c108140 0x7fc15c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.379+0000 7fc16393a640 1 --2- 172.21.15.53:0/1759507427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c102800 0x7fc15c102c10 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.379+0000 7fc16393a640 1 -- 172.21.15.53:0/1759507427 >> 172.21.15.53:0/1759507427 conn(0x7fc15c0794d0 msgr2=0x7fc15c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.379+0000 7fc16393a640 1 -- 172.21.15.53:0/1759507427 shutdown_connections 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.379+0000 7fc16393a640 1 -- 172.21.15.53:0/1759507427 wait complete. 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc16393a640 1 Processor -- start 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc16393a640 1 -- start start 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc16393a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc15c102800 0x7fc15c19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc16393a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc15c108140 0x7fc15c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc16393a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c108a90 0x7fc15c19f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc16393a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c112610 con 0x7fc15c108a90 2024-08-31T06:08:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc16393a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c112490 con 0x7fc15c102800 2024-08-31T06:08:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc16393a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c112790 con 0x7fc15c108140 2024-08-31T06:08:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc161ed7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c108a90 0x7fc15c19f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc1616d6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc15c102800 0x7fc15c19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc161ed7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c108a90 0x7fc15c19f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46666/0 (socket says 172.21.15.53:46666) 2024-08-31T06:08:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc161ed7640 1 -- 172.21.15.53:0/2037551975 learned_addr learned my addr 172.21.15.53:0/2037551975 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc160ed5640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc15c108140 0x7fc15c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc161ed7640 1 -- 172.21.15.53:0/2037551975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc15c108140 msgr2=0x7fc15c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc161ed7640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc15c108140 0x7fc15c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc161ed7640 1 -- 172.21.15.53:0/2037551975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc15c102800 msgr2=0x7fc15c19a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc161ed7640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc15c102800 0x7fc15c19a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc161ed7640 1 -- 172.21.15.53:0/2037551975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c1a0080 con 0x7fc15c108a90 2024-08-31T06:08:16.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.380+0000 7fc1616d6640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc15c102800 0x7fc15c19a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:16.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.381+0000 7fc160ed5640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc15c108140 0x7fc15c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:16.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.381+0000 7fc161ed7640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c108a90 0x7fc15c19f950 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc15400eb10 tx=0x7fc15400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:16.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.381+0000 7fc1527fc640 1 -- 172.21.15.53:0/2037551975 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154004b20 con 0x7fc15c108a90 2024-08-31T06:08:16.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.381+0000 7fc1527fc640 1 -- 172.21.15.53:0/2037551975 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc154004cc0 con 0x7fc15c108a90 2024-08-31T06:08:16.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.381+0000 7fc1527fc640 1 -- 172.21.15.53:0/2037551975 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154010690 con 0x7fc15c108a90 2024-08-31T06:08:16.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.381+0000 7fc16393a640 1 -- 172.21.15.53:0/2037551975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15c1a0370 con 0x7fc15c108a90 2024-08-31T06:08:16.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.381+0000 7fc16393a640 1 -- 172.21.15.53:0/2037551975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15c1a6ad0 con 0x7fc15c108a90 2024-08-31T06:08:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.383+0000 7fc16393a640 1 -- 172.21.15.53:0/2037551975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15c102c10 con 0x7fc15c108a90 2024-08-31T06:08:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.384+0000 7fc1527fc640 1 -- 172.21.15.53:0/2037551975 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc154005020 con 0x7fc15c108a90 2024-08-31T06:08:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.385+0000 7fc1527fc640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc1480b4d20 0x7fc1480b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.385+0000 7fc1616d6640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc1480b4d20 0x7fc1480b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.385+0000 7fc1527fc640 1 -- 172.21.15.53:0/2037551975 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fc1540e5a40 con 0x7fc15c108a90 2024-08-31T06:08:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.385+0000 7fc1616d6640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc1480b4d20 0x7fc1480b7230 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc158006010 tx=0x7fc158000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:16.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.389+0000 7fc1527fc640 1 -- 172.21.15.53:0/2037551975 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc1540ac830 con 0x7fc15c108a90 2024-08-31T06:08:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.526+0000 7fedab853640 1 -- 172.21.15.53:0/2923696115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda41081a0 msgr2=0x7feda410e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.526+0000 7fedab853640 1 --2- 172.21.15.53:0/2923696115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda41081a0 0x7feda410e9d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009ca0 tx=0x7fed9c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.526+0000 7fedab853640 1 -- 172.21.15.53:0/2923696115 shutdown_connections 2024-08-31T06:08:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.526+0000 7fedab853640 1 --2- 172.21.15.53:0/2923696115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda41081a0 0x7feda410e9d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.526+0000 7fedab853640 1 --2- 172.21.15.53:0/2923696115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feda4107850 0x7feda4107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.526+0000 7fedab853640 1 --2- 172.21.15.53:0/2923696115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feda4101f20 0x7feda4102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.526+0000 7fedab853640 1 -- 172.21.15.53:0/2923696115 >> 172.21.15.53:0/2923696115 conn(0x7feda4079c30 msgr2=0x7feda407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.526+0000 7fedab853640 1 -- 172.21.15.53:0/2923696115 shutdown_connections 2024-08-31T06:08:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.526+0000 7fedab853640 1 -- 172.21.15.53:0/2923696115 wait complete. 2024-08-31T06:08:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.527+0000 7fedab853640 1 Processor -- start 2024-08-31T06:08:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.527+0000 7fedab853640 1 -- start start 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.527+0000 7fedab853640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda4101f20 0x7feda419a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.527+0000 7fedab853640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feda4107850 0x7feda419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.527+0000 7fedab853640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feda41081a0 0x7feda419f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.527+0000 7fedab853640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feda41114e0 con 0x7feda4101f20 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.527+0000 7fedab853640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feda4111360 con 0x7feda41081a0 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.527+0000 7fedab853640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feda4111660 con 0x7feda4107850 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda95ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda4101f20 0x7feda419a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda95ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda4101f20 0x7feda419a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46680/0 (socket says 172.21.15.53:46680) 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda95ef640 1 -- 172.21.15.53:0/2998890925 learned_addr learned my addr 172.21.15.53:0/2998890925 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda9df0640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feda41081a0 0x7feda419f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda8dee640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feda4107850 0x7feda419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda95ef640 1 -- 172.21.15.53:0/2998890925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feda4107850 msgr2=0x7feda419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda95ef640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feda4107850 0x7feda419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda95ef640 1 -- 172.21.15.53:0/2998890925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feda41081a0 msgr2=0x7feda419f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda95ef640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feda41081a0 0x7feda419f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda95ef640 1 -- 172.21.15.53:0/2998890925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda41a0060 con 0x7feda4101f20 2024-08-31T06:08:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda8dee640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feda4107850 0x7feda419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7feda95ef640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda4101f20 0x7feda419a130 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7feda000ea20 tx=0x7feda000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7fed9a7fc640 1 -- 172.21.15.53:0/2998890925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda000cd40 con 0x7feda4101f20 2024-08-31T06:08:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7fed9a7fc640 1 -- 172.21.15.53:0/2998890925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feda00168a0 con 0x7feda4101f20 2024-08-31T06:08:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7fedab853640 1 -- 172.21.15.53:0/2998890925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda41a0350 con 0x7feda4101f20 2024-08-31T06:08:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7fed9a7fc640 1 -- 172.21.15.53:0/2998890925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda000b770 con 0x7feda4101f20 2024-08-31T06:08:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.528+0000 7fedab853640 1 -- 172.21.15.53:0/2998890925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda41a6ae0 con 0x7feda4101f20 2024-08-31T06:08:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.531+0000 7fedb27c4740 1 Processor -- start 2024-08-31T06:08:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7fed9a7fc640 1 -- 172.21.15.53:0/2998890925 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7feda0016a50 con 0x7feda4101f20 2024-08-31T06:08:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7fedb27c4740 1 -- start start 2024-08-31T06:08:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be381b0 0x55eb1c1dbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1dc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 0x55eb1c1dc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7fedb27c4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eb1c151000 con 0x55eb1be174d0 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7fedb27c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55eb1c140590 con 0x55eb1be381b0 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7fedb27c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55eb1c144540 con 0x55eb1be0f2f0 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7feda9df0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be381b0 0x55eb1c1dbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7feda8dee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 0x55eb1c1dc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7feda95ef640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1dc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7feda9df0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be381b0 0x55eb1c1dbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54996/0 (socket says 172.21.15.53:54996) 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7feda9df0640 1 -- 172.21.15.53:0/2952522195 learned_addr learned my addr 172.21.15.53:0/2952522195 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7feda95ef640 1 -- 172.21.15.53:0/2952522195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be381b0 msgr2=0x55eb1c1dbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7feda95ef640 1 --2- 172.21.15.53:0/2952522195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be381b0 0x55eb1c1dbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7feda95ef640 1 -- 172.21.15.53:0/2952522195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 msgr2=0x55eb1c1dc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7feda95ef640 1 --2- 172.21.15.53:0/2952522195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 0x55eb1c1dc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7fed9a7fc640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed900b4ca0 0x7fed900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.532+0000 7feda95ef640 1 -- 172.21.15.53:0/2952522195 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1bea3790 con 0x55eb1be0f2f0 2024-08-31T06:08:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.533+0000 7feda9df0640 1 --2- 172.21.15.53:0/2952522195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be381b0 0x55eb1c1dbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.533+0000 7feda9df0640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed900b4ca0 0x7fed900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.533+0000 7fed9a7fc640 1 -- 172.21.15.53:0/2998890925 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7feda00e5410 con 0x7feda4101f20 2024-08-31T06:08:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.533+0000 7feda95ef640 1 --2- 172.21.15.53:0/2952522195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1dc000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feda00e2ad0 tx=0x7feda0070450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58aa3b5e3d97e65d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.533+0000 7fed8f7fe640 1 -- 172.21.15.53:0/2952522195 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda00ab870 con 0x55eb1be0f2f0 2024-08-31T06:08:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.533+0000 7feda9df0640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed900b4ca0 0x7fed900b71b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fed9c02ade0 tx=0x7fed9c009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.533+0000 7fed8f7fe640 1 -- 172.21.15.53:0/2952522195 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feda0024050 con 0x55eb1be0f2f0 2024-08-31T06:08:16.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.533+0000 7fed8f7fe640 1 -- 172.21.15.53:0/2952522195 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda00a7230 con 0x55eb1be0f2f0 2024-08-31T06:08:16.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.534+0000 7fedb27c4740 1 -- 172.21.15.53:0/2952522195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be0f2f0 msgr2=0x55eb1c1dc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.534+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2952522195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1dc000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feda00e2ad0 tx=0x7feda0070450 comp rx=0 tx=0).stop 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.534+0000 7fedb27c4740 1 -- 172.21.15.53:0/2952522195 shutdown_connections 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.534+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2952522195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 0x55eb1c1dc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.534+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2952522195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1dc000 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.534+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2952522195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be381b0 0x55eb1c1dbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.534+0000 7fedb27c4740 1 -- 172.21.15.53:0/2952522195 >> 172.21.15.53:0/2952522195 conn(0x55eb1be2c300 msgr2=0x55eb1c1d99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.534+0000 7fedb27c4740 1 -- 172.21.15.53:0/2952522195 shutdown_connections 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.534+0000 7fedb27c4740 1 -- 172.21.15.53:0/2952522195 wait complete. 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7fedb27c4740 1 -- start start 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7fedb27c4740 1 Processor -- start 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1e7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be174d0 0x55eb1c1e7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be381b0 0x55eb1c1f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7fedb27c4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eb1c079ab0 con 0x55eb1be0f2f0 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7fedb27c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55eb1c0c7680 con 0x55eb1be174d0 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7fedb27c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55eb1c1ea1e0 con 0x55eb1be381b0 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7fedb27c4740 10 client.0 _ll_register_callbacks cb 0x55eb1be4fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7feda95ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1e7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7feda95ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1e7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46702/0 (socket says 172.21.15.53:46702) 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.535+0000 7feda95ef640 1 -- 172.21.15.53:0/2979404478 learned_addr learned my addr 172.21.15.53:0/2979404478 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7feda8dee640 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be174d0 0x55eb1c1e7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7feda9df0640 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be381b0 0x55eb1c1f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7feda95ef640 1 -- 172.21.15.53:0/2979404478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be381b0 msgr2=0x55eb1c1f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7feda95ef640 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be381b0 0x55eb1c1f34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7feda95ef640 1 -- 172.21.15.53:0/2979404478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be174d0 msgr2=0x55eb1c1e7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7feda95ef640 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be174d0 0x55eb1c1e7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7feda95ef640 1 -- 172.21.15.53:0/2979404478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb1bf1c620 con 0x55eb1be0f2f0 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7feda95ef640 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1e7660 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7feda0000c00 tx=0x7feda000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813b8ce45451b602 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7fed8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7fed8cff9640 1 -- 172.21.15.53:0/2979404478 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda00ab210 con 0x55eb1be0f2f0 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7fed8cff9640 1 -- 172.21.15.53:0/2979404478 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7feda00b4930 con 0x55eb1be0f2f0 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7fedb27c4740 1 -- 172.21.15.53:0/2979404478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feda0024050 con 0x55eb1be0f2f0 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7fed8cff9640 1 -- 172.21.15.53:0/2979404478 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7feda00ab3f0 con 0x55eb1be0f2f0 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7fedb27c4740 10 client.16740 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.536+0000 7fedb27c4740 1 -- 172.21.15.53:0/2979404478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55eb1c1f61d0 con 0x55eb1be0f2f0 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.537+0000 7fed8cff9640 1 -- 172.21.15.53:0/2979404478 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feda0024050 con 0x55eb1be0f2f0 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.537+0000 7fed8cff9640 1 -- 172.21.15.53:0/2979404478 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7feda00e5070 con 0x55eb1be0f2f0 2024-08-31T06:08:16.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.537+0000 7fedb27c4740 10 client.16740 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.537+0000 7fedb27c4740 10 client.16740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.537+0000 7fedb27c4740 20 client.16740 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.537+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb1bdf6d80 0x55eb1c1f9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.537+0000 7fedb27c4740 4 client.16740 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.537+0000 7fedb27c4740 1 -- 172.21.15.53:0/2979404478 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb1c152f50 con 0x55eb1bdf6d80 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.537+0000 7feda8dee640 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb1bdf6d80 0x55eb1c1f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.537+0000 7feda8dee640 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb1bdf6d80 0x55eb1c1f9530 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a44a915c25f2ce4e server_cookie=a7883886a24fe36a in_seq=0 out_seq=0 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.537+0000 7fed8cff9640 10 client.16740 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.538+0000 7fed8cff9640 1 -- 172.21.15.53:0/2979404478 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb1c152f50 con 0x55eb1bdf6d80 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.538+0000 7fed8cff9640 10 client.16740 handle_command_reply: tid=0 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.538+0000 7fedb27c4740 1 client.16740 shutdown 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.538+0000 7fedb27c4740 1 -- 172.21.15.53:0/2979404478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be0f2f0 msgr2=0x55eb1c1e7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.538+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1e7660 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7feda0000c00 tx=0x7feda000cee0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.539+0000 7fedb27c4740 1 -- 172.21.15.53:0/2979404478 shutdown_connections 2024-08-31T06:08:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.539+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb1bdf6d80 0x55eb1c1f9530 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.539+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be381b0 0x55eb1c1f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.539+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be174d0 0x55eb1c1e7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.539+0000 7fed8cff9640 0 client.16740 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.539+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2979404478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1e7660 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.539+0000 7fedb27c4740 1 -- 172.21.15.53:0/2979404478 >> 172.21.15.53:0/2979404478 conn(0x55eb1be2c300 msgr2=0x55eb1c1dcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.539+0000 7fedb27c4740 1 -- 172.21.15.53:0/2979404478 shutdown_connections 2024-08-31T06:08:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.539+0000 7fedb27c4740 1 -- 172.21.15.53:0/2979404478 wait complete. 2024-08-31T06:08:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.539+0000 7fedb27c4740 20 client.16740 trim_cache size 0 max 16384 2024-08-31T06:08:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.555+0000 7fedb27c4740 1 Processor -- start 2024-08-31T06:08:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.555+0000 7fedb27c4740 1 -- start start 2024-08-31T06:08:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.555+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1bdf6d80 0x55eb1c1e0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.555+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1e10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.555+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be174d0 0x55eb1c1e4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7fedb27c4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feda41af450 con 0x55eb1bdf6d80 2024-08-31T06:08:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7fedb27c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feda41b1050 con 0x55eb1be0f2f0 2024-08-31T06:08:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7fedb27c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feda41afb20 con 0x55eb1be174d0 2024-08-31T06:08:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7feda95ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1bdf6d80 0x55eb1c1e0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7feda95ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1bdf6d80 0x55eb1c1e0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46716/0 (socket says 172.21.15.53:46716) 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7feda95ef640 1 -- 172.21.15.53:0/2083145639 learned_addr learned my addr 172.21.15.53:0/2083145639 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7feda8dee640 1 --2- 172.21.15.53:0/2083145639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1e10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7feda9df0640 1 --2- 172.21.15.53:0/2083145639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be174d0 0x55eb1c1e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7feda95ef640 1 -- 172.21.15.53:0/2083145639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be174d0 msgr2=0x55eb1c1e4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7feda95ef640 1 --2- 172.21.15.53:0/2083145639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be174d0 0x55eb1c1e4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7feda95ef640 1 -- 172.21.15.53:0/2083145639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be0f2f0 msgr2=0x55eb1c1e10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7feda95ef640 1 --2- 172.21.15.53:0/2083145639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1e10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7feda95ef640 1 -- 172.21.15.53:0/2083145639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1c1e9e00 con 0x55eb1bdf6d80 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7feda95ef640 1 --2- 172.21.15.53:0/2083145639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1bdf6d80 0x55eb1c1e0b80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7feda00ab7a0 tx=0x7feda00ed400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dab27c588e0b1b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.556+0000 7fed8effd640 1 -- 172.21.15.53:0/2083145639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda00a7230 con 0x55eb1bdf6d80 2024-08-31T06:08:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.557+0000 7fed8effd640 1 -- 172.21.15.53:0/2083145639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feda00ab5b0 con 0x55eb1bdf6d80 2024-08-31T06:08:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.557+0000 7fed8effd640 1 -- 172.21.15.53:0/2083145639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda00ab870 con 0x55eb1bdf6d80 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.557+0000 7fedb27c4740 1 -- 172.21.15.53:0/2083145639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1bdf6d80 msgr2=0x55eb1c1e0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.557+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2083145639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1bdf6d80 0x55eb1c1e0b80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7feda00ab7a0 tx=0x7feda00ed400 comp rx=0 tx=0).stop 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.558+0000 7fedb27c4740 1 -- 172.21.15.53:0/2083145639 shutdown_connections 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.558+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2083145639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1be174d0 0x55eb1c1e4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.558+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2083145639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1e10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.558+0000 7fedb27c4740 1 --2- 172.21.15.53:0/2083145639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1bdf6d80 0x55eb1c1e0b80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.558+0000 7fedb27c4740 1 -- 172.21.15.53:0/2083145639 >> 172.21.15.53:0/2083145639 conn(0x55eb1be2c300 msgr2=0x55eb1c1e25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.558+0000 7fedb27c4740 1 -- 172.21.15.53:0/2083145639 shutdown_connections 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.558+0000 7fedb27c4740 1 -- 172.21.15.53:0/2083145639 wait complete. 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.558+0000 7fedb27c4740 1 -- start start 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.558+0000 7fedb27c4740 1 Processor -- start 2024-08-31T06:08:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1bdf6d80 0x55eb1c1efd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1ed240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7fedb27c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 0x55eb1c1ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7fedb27c4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feda41b08c0 con 0x55eb1be174d0 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7fedb27c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feda41b01f0 con 0x55eb1be0f2f0 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7fedb27c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feda41ad430 con 0x55eb1bdf6d80 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7fedb27c4740 10 client.0 _ll_register_callbacks cb 0x7fed9400b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7feda9df0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 0x55eb1c1ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7feda9df0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 0x55eb1c1ed8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46732/0 (socket says 172.21.15.53:46732) 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7feda9df0640 1 -- 172.21.15.53:0/1910327546 learned_addr learned my addr 172.21.15.53:0/1910327546 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7feda95ef640 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1bdf6d80 0x55eb1c1efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7feda8dee640 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7feda9df0640 1 -- 172.21.15.53:0/1910327546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1bdf6d80 msgr2=0x55eb1c1efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7feda9df0640 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1bdf6d80 0x55eb1c1efd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7feda9df0640 1 -- 172.21.15.53:0/1910327546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be0f2f0 msgr2=0x55eb1c1ed240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7feda9df0640 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1ed240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7feda9df0640 1 -- 172.21.15.53:0/1910327546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb1c1ee070 con 0x55eb1be174d0 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7feda9df0640 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 0x55eb1c1ed8e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fed9c031f10 tx=0x7fed9c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d1aa1edaac831c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7fed8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7fed8cff9640 1 -- 172.21.15.53:0/1910327546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c003c40 con 0x55eb1be174d0 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.559+0000 7fed8cff9640 1 -- 172.21.15.53:0/1910327546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fed9c003de0 con 0x55eb1be174d0 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fedb27c4740 1 -- 172.21.15.53:0/1910327546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feda00ab5b0 con 0x55eb1be174d0 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fed8cff9640 1 -- 172.21.15.53:0/1910327546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fed9c004050 con 0x55eb1be174d0 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fedb27c4740 10 client.16746 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fedb27c4740 1 -- 172.21.15.53:0/1910327546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55eb1c263da0 con 0x55eb1be174d0 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fed8cff9640 1 -- 172.21.15.53:0/1910327546 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feda00ab5b0 con 0x55eb1be174d0 2024-08-31T06:08:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fed8cff9640 1 -- 172.21.15.53:0/1910327546 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fed9c030b80 con 0x55eb1be174d0 2024-08-31T06:08:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fedb27c4740 10 client.16746 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fedb27c4740 10 client.16746 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fedb27c4740 20 client.16746 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fedb27c4740 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb1be381b0 0x55eb1c2666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fedb27c4740 4 client.16746 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:08:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7fedb27c4740 1 -- 172.21.15.53:0/1910327546 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eb1c14e9f0 con 0x55eb1be381b0 2024-08-31T06:08:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.560+0000 7feda95ef640 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb1be381b0 0x55eb1c2666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.561+0000 7fed8cff9640 10 client.16746 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.561+0000 7feda95ef640 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb1be381b0 0x55eb1c2666d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c3e33827e581070 server_cookie=620d0cc80551b6a2 in_seq=0 out_seq=0 2024-08-31T06:08:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.578+0000 7fed8cff9640 1 -- 172.21.15.53:0/1910327546 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eb1c14e9f0 con 0x55eb1be381b0 2024-08-31T06:08:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.578+0000 7fed8cff9640 10 client.16746 handle_command_reply: tid=0 2024-08-31T06:08:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 1 client.16746 shutdown 2024-08-31T06:08:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 1 -- 172.21.15.53:0/1910327546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 msgr2=0x55eb1c1ed8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 0x55eb1c1ed8e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fed9c031f10 tx=0x7fed9c041000 comp rx=0 tx=0).stop 2024-08-31T06:08:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 1 -- 172.21.15.53:0/1910327546 shutdown_connections 2024-08-31T06:08:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb1be381b0 0x55eb1c2666d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fed8cff9640 0 client.16746 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb1be174d0 0x55eb1c1ed8e0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb1be0f2f0 0x55eb1c1ed240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 1 --2- 172.21.15.53:0/1910327546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb1bdf6d80 0x55eb1c1efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 1 -- 172.21.15.53:0/1910327546 >> 172.21.15.53:0/1910327546 conn(0x55eb1be2c300 msgr2=0x55eb1c1e5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 1 -- 172.21.15.53:0/1910327546 shutdown_connections 2024-08-31T06:08:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 1 -- 172.21.15.53:0/1910327546 wait complete. 2024-08-31T06:08:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.579+0000 7fedb27c4740 20 client.16746 trim_cache size 0 max 16384 2024-08-31T06:08:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:08:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:08:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:08:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:08:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 -- 172.21.15.53:0/2998890925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed900b4ca0 msgr2=0x7fed900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed900b4ca0 0x7fed900b71b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fed9c02ade0 tx=0x7fed9c009360 comp rx=0 tx=0).stop 2024-08-31T06:08:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 -- 172.21.15.53:0/2998890925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda4101f20 msgr2=0x7feda419a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda4101f20 0x7feda419a130 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7feda000ea20 tx=0x7feda000eee0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 -- 172.21.15.53:0/2998890925 shutdown_connections 2024-08-31T06:08:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed900b4ca0 0x7fed900b71b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feda41081a0 0x7feda419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feda4107850 0x7feda419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 --2- 172.21.15.53:0/2998890925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda4101f20 0x7feda419a130 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 -- 172.21.15.53:0/2998890925 >> 172.21.15.53:0/2998890925 conn(0x7feda4079c30 msgr2=0x7feda41058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 -- 172.21.15.53:0/2998890925 shutdown_connections 2024-08-31T06:08:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:16.580+0000 7fedab853640 1 -- 172.21.15.53:0/2998890925 wait complete. 2024-08-31T06:08:16.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.645+0000 7fc16393a640 1 -- 172.21.15.53:0/2037551975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc15c1a6ca0 con 0x7fc15c108a90 2024-08-31T06:08:16.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.645+0000 7fc1527fc640 1 -- 172.21.15.53:0/2037551975 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11992 (secure 0 0 0) 0x7fc1540ac130 con 0x7fc15c108a90 2024-08-31T06:08:16.648 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:08:16.648 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"btime":"2024-08-31T06:06:51:511613+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:06:50.526609+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:08:16.648 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 30 2024-08-31T06:08:16.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 -- 172.21.15.53:0/2037551975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc1480b4d20 msgr2=0x7fc1480b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc1480b4d20 0x7fc1480b7230 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc158006010 tx=0x7fc158000bc0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 -- 172.21.15.53:0/2037551975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c108a90 msgr2=0x7fc15c19f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:16.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c108a90 0x7fc15c19f950 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc15400eb10 tx=0x7fc15400c2d0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 -- 172.21.15.53:0/2037551975 shutdown_connections 2024-08-31T06:08:16.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc1480b4d20 0x7fc1480b7230 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c108a90 0x7fc15c19f950 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc15c108140 0x7fc15c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 --2- 172.21.15.53:0/2037551975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc15c102800 0x7fc15c19a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:16.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 -- 172.21.15.53:0/2037551975 >> 172.21.15.53:0/2037551975 conn(0x7fc15c0794d0 msgr2=0x7fc15c1018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:16.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 -- 172.21.15.53:0/2037551975 shutdown_connections 2024-08-31T06:08:16.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:16.648+0000 7fc16393a640 1 -- 172.21.15.53:0/2037551975 wait complete. 2024-08-31T06:08:16.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 53600 1.21 MB/sec execute 6 sec latency 15.313 ms 2024-08-31T06:08:16.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:16 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2037551975' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:17.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:16 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2037551975' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:17.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:16 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2037551975' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:17.460 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0' 2024-08-31T06:08:17.460 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0 2024-08-31T06:08:17.731 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:17.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 53863 1.04 MB/sec execute 7 sec latency 14.362 ms 2024-08-31T06:08:18.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:17 smithi130 ceph-mon[22266]: pgmap v423: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-08-31T06:08:18.129 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:17 smithi053 ceph-mon[18924]: pgmap v423: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-08-31T06:08:18.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:17 smithi153 ceph-mon[22320]: pgmap v423: 97 pgs: 97 active+clean; 36 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-08-31T06:08:18.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.238+0000 7febfbdfe640 1 -- 172.21.15.53:0/199021214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf410dc10 msgr2=0x7febf41100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:18.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.238+0000 7febfbdfe640 1 --2- 172.21.15.53:0/199021214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf410dc10 0x7febf41100b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7febec009ca0 tx=0x7febec02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.238+0000 7febfbdfe640 1 -- 172.21.15.53:0/199021214 shutdown_connections 2024-08-31T06:08:18.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.238+0000 7febfbdfe640 1 --2- 172.21.15.53:0/199021214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf410dc10 0x7febf41100b0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.238+0000 7febfbdfe640 1 --2- 172.21.15.53:0/199021214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf4105090 0x7febf410d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.238+0000 7febfbdfe640 1 --2- 172.21.15.53:0/199021214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf4104660 0x7febf4104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.238+0000 7febfbdfe640 1 -- 172.21.15.53:0/199021214 >> 172.21.15.53:0/199021214 conn(0x7febf40794d0 msgr2=0x7febf40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:18.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.238+0000 7febfbdfe640 1 -- 172.21.15.53:0/199021214 shutdown_connections 2024-08-31T06:08:18.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.238+0000 7febfbdfe640 1 -- 172.21.15.53:0/199021214 wait complete. 2024-08-31T06:08:18.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.239+0000 7febfbdfe640 1 Processor -- start 2024-08-31T06:08:18.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.239+0000 7febfbdfe640 1 -- start start 2024-08-31T06:08:18.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfbdfe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf4104660 0x7febf419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfbdfe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf4105090 0x7febf419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfbdfe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf410dc10 0x7febf419f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfbdfe640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7febf4113720 con 0x7febf410dc10 2024-08-31T06:08:18.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfbdfe640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febf41135a0 con 0x7febf4104660 2024-08-31T06:08:18.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfbdfe640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febf41138a0 con 0x7febf4105090 2024-08-31T06:08:18.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfa39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf410dc10 0x7febf419f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfa39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf410dc10 0x7febf419f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46756/0 (socket says 172.21.15.53:46756) 2024-08-31T06:08:18.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfa39b640 1 -- 172.21.15.53:0/1610806123 learned_addr learned my addr 172.21.15.53:0/1610806123 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febf9b9a640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf4104660 0x7febf419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febf9399640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf4105090 0x7febf419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfa39b640 1 -- 172.21.15.53:0/1610806123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf4105090 msgr2=0x7febf419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfa39b640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf4105090 0x7febf419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfa39b640 1 -- 172.21.15.53:0/1610806123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf4104660 msgr2=0x7febf419a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfa39b640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf4104660 0x7febf419a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfa39b640 1 -- 172.21.15.53:0/1610806123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf41a0020 con 0x7febf410dc10 2024-08-31T06:08:18.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febf9b9a640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf4104660 0x7febf419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:18.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.240+0000 7febfa39b640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf410dc10 0x7febf419f8f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7febec005e30 tx=0x7febec003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:18.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.241+0000 7febeaffd640 1 -- 172.21.15.53:0/1610806123 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec032c10 con 0x7febf410dc10 2024-08-31T06:08:18.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.241+0000 7febeaffd640 1 -- 172.21.15.53:0/1610806123 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febec032db0 con 0x7febf410dc10 2024-08-31T06:08:18.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.241+0000 7febfbdfe640 1 -- 172.21.15.53:0/1610806123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf41a02b0 con 0x7febf410dc10 2024-08-31T06:08:18.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.241+0000 7febeaffd640 1 -- 172.21.15.53:0/1610806123 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec030ab0 con 0x7febf410dc10 2024-08-31T06:08:18.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.241+0000 7febfbdfe640 1 -- 172.21.15.53:0/1610806123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf41a6a70 con 0x7febf410dc10 2024-08-31T06:08:18.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.243+0000 7fec02373740 1 Processor -- start 2024-08-31T06:08:18.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.244+0000 7febeaffd640 1 -- 172.21.15.53:0/1610806123 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7febec030c50 con 0x7febf410dc10 2024-08-31T06:08:18.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.244+0000 7fec02373740 1 -- start start 2024-08-31T06:08:18.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.244+0000 7fec02373740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82d3840 0x561bb867ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7fec02373740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82aa980 0x561bb867b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7fec02373740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb867b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7fec02373740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561bb85ef330 con 0x561bb82b2b60 2024-08-31T06:08:18.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7fec02373740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561bb85de8c0 con 0x561bb82aa980 2024-08-31T06:08:18.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7fec02373740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561bb85e2870 con 0x561bb82d3840 2024-08-31T06:08:18.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9399640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82d3840 0x561bb867ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9b9a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82aa980 0x561bb867b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9b9a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82aa980 0x561bb867b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:55052/0 (socket says 172.21.15.53:55052) 2024-08-31T06:08:18.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9399640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82d3840 0x561bb867ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:45070/0 (socket says 172.21.15.53:45070) 2024-08-31T06:08:18.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9b9a640 1 -- 172.21.15.53:0/696373302 learned_addr learned my addr 172.21.15.53:0/696373302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:18.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9399640 1 --2- 172.21.15.53:0/696373302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb867b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febeaffd640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe00b4d20 0x7febe00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9b9a640 1 -- 172.21.15.53:0/696373302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82d3840 msgr2=0x561bb867ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:18.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9b9a640 1 --2- 172.21.15.53:0/696373302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82d3840 0x561bb867ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9b9a640 1 -- 172.21.15.53:0/696373302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 msgr2=0x561bb867b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:18.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9b9a640 1 --2- 172.21.15.53:0/696373302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb867b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9b9a640 1 -- 172.21.15.53:0/696373302 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb8596df0 con 0x561bb82aa980 2024-08-31T06:08:18.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febfa39b640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe00b4d20 0x7febe00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febf9b9a640 1 --2- 172.21.15.53:0/696373302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82aa980 0x561bb867b1d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febf00115f0 tx=0x7febf0011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83982fd76a7b2bac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:18.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.245+0000 7febeaffd640 1 -- 172.21.15.53:0/1610806123 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7febec106570 con 0x7febf410dc10 2024-08-31T06:08:18.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.246+0000 7febdffff640 1 -- 172.21.15.53:0/696373302 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf001e070 con 0x561bb82aa980 2024-08-31T06:08:18.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.246+0000 7febdffff640 1 -- 172.21.15.53:0/696373302 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febf000fa50 con 0x561bb82aa980 2024-08-31T06:08:18.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.246+0000 7febdffff640 1 -- 172.21.15.53:0/696373302 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0019a40 con 0x561bb82aa980 2024-08-31T06:08:18.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.246+0000 7fec02373740 1 -- 172.21.15.53:0/696373302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82aa980 msgr2=0x561bb867b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:18.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.246+0000 7febfa39b640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe00b4d20 0x7febe00b7230 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7febec103d70 tx=0x7febec0305c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:18.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.247+0000 7fec02373740 1 --2- 172.21.15.53:0/696373302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82aa980 0x561bb867b1d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febf00115f0 tx=0x7febf0011ab0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.247+0000 7fec02373740 1 -- 172.21.15.53:0/696373302 shutdown_connections 2024-08-31T06:08:18.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.247+0000 7fec02373740 1 --2- 172.21.15.53:0/696373302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb867b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.247+0000 7fec02373740 1 --2- 172.21.15.53:0/696373302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82aa980 0x561bb867b1d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.247+0000 7fec02373740 1 --2- 172.21.15.53:0/696373302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82d3840 0x561bb867ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.247+0000 7fec02373740 1 -- 172.21.15.53:0/696373302 >> 172.21.15.53:0/696373302 conn(0x561bb82c7990 msgr2=0x561bb8678b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:18.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.247+0000 7fec02373740 1 -- 172.21.15.53:0/696373302 shutdown_connections 2024-08-31T06:08:18.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.247+0000 7fec02373740 1 -- 172.21.15.53:0/696373302 wait complete. 2024-08-31T06:08:18.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.247+0000 7fec02373740 1 -- start start 2024-08-31T06:08:18.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.247+0000 7fec02373740 1 Processor -- start 2024-08-31T06:08:18.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7fec02373740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb8686430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7fec02373740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8686970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7fec02373740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82d3840 0x561bb86927f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7fec02373740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561bb84417a0 con 0x561bb82b2b60 2024-08-31T06:08:18.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7fec02373740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561bb8565240 con 0x561bb82d3840 2024-08-31T06:08:18.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7fec02373740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561bb8689470 con 0x561bb82aa980 2024-08-31T06:08:18.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7fec02373740 10 client.0 _ll_register_callbacks cb 0x561bb82eb090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:18.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7febf9b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8686970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7febf9b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8686970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46762/0 (socket says 172.21.15.53:46762) 2024-08-31T06:08:18.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7febf9b9a640 1 -- 172.21.15.53:0/2118402087 learned_addr learned my addr 172.21.15.53:0/2118402087 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:18.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7febf9399640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb8686430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7febf9399640 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82d3840 0x561bb86927f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7febf9b9a640 1 -- 172.21.15.53:0/2118402087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 msgr2=0x561bb8686430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:18.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7febf9b9a640 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb8686430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7febf9b9a640 1 -- 172.21.15.53:0/2118402087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82d3840 msgr2=0x561bb86927f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:18.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7febf9b9a640 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82d3840 0x561bb86927f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.248+0000 7febf9b9a640 1 -- 172.21.15.53:0/2118402087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bb859b2b0 con 0x561bb82b2b60 2024-08-31T06:08:18.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.249+0000 7febf9b9a640 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8686970 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7febf0019410 tx=0x7febf0019440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4994ca38687eafe8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:18.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.249+0000 7febdd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:18.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.249+0000 7febdd7fa640 1 -- 172.21.15.53:0/2118402087 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0027060 con 0x561bb82b2b60 2024-08-31T06:08:18.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.249+0000 7febdd7fa640 1 -- 172.21.15.53:0/2118402087 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7febf000f640 con 0x561bb82b2b60 2024-08-31T06:08:18.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.249+0000 7fec02373740 1 -- 172.21.15.53:0/2118402087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf000fa50 con 0x561bb82b2b60 2024-08-31T06:08:18.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.249+0000 7febdd7fa640 1 -- 172.21.15.53:0/2118402087 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7febf001e040 con 0x561bb82b2b60 2024-08-31T06:08:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.249+0000 7fec02373740 10 client.16758 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.249+0000 7fec02373740 1 -- 172.21.15.53:0/2118402087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561bb834db90 con 0x561bb82b2b60 2024-08-31T06:08:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.249+0000 7febdd7fa640 1 -- 172.21.15.53:0/2118402087 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febf000fa50 con 0x561bb82b2b60 2024-08-31T06:08:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.249+0000 7febdd7fa640 1 -- 172.21.15.53:0/2118402087 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7febf0021070 con 0x561bb82b2b60 2024-08-31T06:08:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.250+0000 7fec02373740 10 client.16758 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.250+0000 7fec02373740 10 client.16758 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:08:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.250+0000 7fec02373740 20 client.16758 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:18.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.250+0000 7fec02373740 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561bb82921c0 0x561bb8698420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.250+0000 7fec02373740 4 client.16758 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:18.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.250+0000 7fec02373740 1 -- 172.21.15.53:0/2118402087 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bb85f1280 con 0x561bb82921c0 2024-08-31T06:08:18.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.250+0000 7febf9399640 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561bb82921c0 0x561bb8698420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.250+0000 7febdd7fa640 10 client.16758 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:18.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.250+0000 7febf9399640 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561bb82921c0 0x561bb8698420 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71e47821d585dce6 server_cookie=c07fe24895c5d867 in_seq=0 out_seq=0 2024-08-31T06:08:18.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.251+0000 7febdd7fa640 1 -- 172.21.15.53:0/2118402087 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561bb85f1280 con 0x561bb82921c0 2024-08-31T06:08:18.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.251+0000 7febdd7fa640 10 client.16758 handle_command_reply: tid=0 2024-08-31T06:08:18.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 1 client.16758 shutdown 2024-08-31T06:08:18.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 1 -- 172.21.15.53:0/2118402087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 msgr2=0x561bb8686970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:18.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8686970 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7febf0019410 tx=0x7febf0019440 comp rx=0 tx=0).stop 2024-08-31T06:08:18.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 1 -- 172.21.15.53:0/2118402087 shutdown_connections 2024-08-31T06:08:18.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561bb82921c0 0x561bb8698420 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7febdd7fa640 0 client.16758 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82d3840 0x561bb86927f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8686970 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 1 --2- 172.21.15.53:0/2118402087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb8686430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 1 -- 172.21.15.53:0/2118402087 >> 172.21.15.53:0/2118402087 conn(0x561bb82c7990 msgr2=0x561bb8677340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 1 -- 172.21.15.53:0/2118402087 shutdown_connections 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 1 -- 172.21.15.53:0/2118402087 wait complete. 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.252+0000 7fec02373740 20 client.16758 trim_cache size 0 max 16384 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7fec02373740 1 Processor -- start 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7fec02373740 1 -- start start 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7fec02373740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82921c0 0x561bb8688310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7fec02373740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb867c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7fec02373740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb86926f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7fec02373740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7febf41af3d0 con 0x561bb82b2b60 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7fec02373740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febf41b0fd0 con 0x561bb82921c0 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7fec02373740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febf41afaa0 con 0x561bb82aa980 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7febf9399640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb86926f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7febf9399640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb86926f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46766/0 (socket says 172.21.15.53:46766) 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7febf9399640 1 -- 172.21.15.53:0/1520932102 learned_addr learned my addr 172.21.15.53:0/1520932102 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7febf9b9a640 1 --2- 172.21.15.53:0/1520932102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb867c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.272+0000 7febf9399640 1 --2- 172.21.15.53:0/1520932102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82921c0 0x561bb8688310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.273+0000 7febf9399640 1 -- 172.21.15.53:0/1520932102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 msgr2=0x561bb867c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.273+0000 7febf9399640 1 --2- 172.21.15.53:0/1520932102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb867c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.273+0000 7febf9399640 1 -- 172.21.15.53:0/1520932102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82921c0 msgr2=0x561bb8688310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.273+0000 7febf9399640 1 --2- 172.21.15.53:0/1520932102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82921c0 0x561bb8688310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.273+0000 7febf9399640 1 -- 172.21.15.53:0/1520932102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb85aed90 con 0x561bb82b2b60 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.273+0000 7febf9b9a640 1 --2- 172.21.15.53:0/1520932102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb867c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.273+0000 7febf9399640 1 --2- 172.21.15.53:0/1520932102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb86926f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7febe4004200 tx=0x7febe4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdd878d6a67fc3b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.273+0000 7febdf7fe640 1 -- 172.21.15.53:0/1520932102 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe40117c0 con 0x561bb82b2b60 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.273+0000 7febdf7fe640 1 -- 172.21.15.53:0/1520932102 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febe4011df0 con 0x561bb82b2b60 2024-08-31T06:08:18.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.273+0000 7febdf7fe640 1 -- 172.21.15.53:0/1520932102 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe40036b0 con 0x561bb82b2b60 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.274+0000 7fec02373740 1 -- 172.21.15.53:0/1520932102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 msgr2=0x561bb86926f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.274+0000 7fec02373740 1 --2- 172.21.15.53:0/1520932102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb86926f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7febe4004200 tx=0x7febe4005f90 comp rx=0 tx=0).stop 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.274+0000 7fec02373740 1 -- 172.21.15.53:0/1520932102 shutdown_connections 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.274+0000 7fec02373740 1 --2- 172.21.15.53:0/1520932102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb86926f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.274+0000 7fec02373740 1 --2- 172.21.15.53:0/1520932102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb867c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.274+0000 7fec02373740 1 --2- 172.21.15.53:0/1520932102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82921c0 0x561bb8688310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.274+0000 7fec02373740 1 -- 172.21.15.53:0/1520932102 >> 172.21.15.53:0/1520932102 conn(0x561bb82c7990 msgr2=0x561bb867bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.274+0000 7fec02373740 1 -- 172.21.15.53:0/1520932102 shutdown_connections 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.274+0000 7fec02373740 1 -- 172.21.15.53:0/1520932102 wait complete. 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7fec02373740 1 -- start start 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7fec02373740 1 Processor -- start 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7fec02373740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82921c0 0x561bb868e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7fec02373740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb868eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7fec02373740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8689710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7fec02373740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7febf41b0840 con 0x561bb82b2b60 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7fec02373740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febf41b0170 con 0x561bb82921c0 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7fec02373740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febf41ad3b0 con 0x561bb82aa980 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7fec02373740 10 client.0 _ll_register_callbacks cb 0x7febf001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7febf9399640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8689710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7febf9399640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8689710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46780/0 (socket says 172.21.15.53:46780) 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7febf9399640 1 -- 172.21.15.53:0/1310367434 learned_addr learned my addr 172.21.15.53:0/1310367434 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7febf9b9a640 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb868eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.275+0000 7febf9399640 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82921c0 0x561bb868e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7febf9399640 1 -- 172.21.15.53:0/1310367434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 msgr2=0x561bb868eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7febf9399640 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb868eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7febf9399640 1 -- 172.21.15.53:0/1310367434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82921c0 msgr2=0x561bb868e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7febf9399640 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82921c0 0x561bb868e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7febf9399640 1 -- 172.21.15.53:0/1310367434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bb868f450 con 0x561bb82b2b60 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7febf9b9a640 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb868eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7febf9399640 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8689710 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7febe40122d0 tx=0x7febe4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977bb299962893cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7febdd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7febdd7fa640 1 -- 172.21.15.53:0/1310367434 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4011ba0 con 0x561bb82b2b60 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7febdd7fa640 1 -- 172.21.15.53:0/1310367434 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7febe4012300 con 0x561bb82b2b60 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7fec02373740 1 -- 172.21.15.53:0/1310367434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febe4011df0 con 0x561bb82b2b60 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7febdd7fa640 1 -- 172.21.15.53:0/1310367434 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7febe4011020 con 0x561bb82b2b60 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7fec02373740 10 client.16764 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.276+0000 7fec02373740 1 -- 172.21.15.53:0/1310367434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561bb8703280 con 0x561bb82b2b60 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.277+0000 7febdd7fa640 1 -- 172.21.15.53:0/1310367434 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febe4011df0 con 0x561bb82b2b60 2024-08-31T06:08:18.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.277+0000 7febdd7fa640 1 -- 172.21.15.53:0/1310367434 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7febe40046c0 con 0x561bb82b2b60 2024-08-31T06:08:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.277+0000 7fec02373740 10 client.16764 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.277+0000 7fec02373740 10 client.16764 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:08:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.277+0000 7fec02373740 20 client.16764 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.277+0000 7fec02373740 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561bb82d3840 0x561bb8705b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.277+0000 7fec02373740 4 client.16764 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}] 2024-08-31T06:08:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.277+0000 7fec02373740 1 -- 172.21.15.53:0/1310367434 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}) -- 0x561bb85ecd20 con 0x561bb82d3840 2024-08-31T06:08:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.277+0000 7febf9b9a640 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561bb82d3840 0x561bb8705b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.278+0000 7febdd7fa640 10 client.16764 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.278+0000 7febf9b9a640 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561bb82d3840 0x561bb8705b40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=204b7e8bf7949b3f server_cookie=7f4d8a30fa22cffd in_seq=0 out_seq=0 2024-08-31T06:08:18.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7febdd7fa640 1 -- 172.21.15.53:0/1310367434 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561bb85ecd20 con 0x561bb82d3840 2024-08-31T06:08:18.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7febdd7fa640 10 client.16764 handle_command_reply: tid=0 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 1 client.16764 shutdown 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 1 -- 172.21.15.53:0/1310367434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 msgr2=0x561bb8689710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8689710 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7febe40122d0 tx=0x7febe4005850 comp rx=0 tx=0).stop 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 1 -- 172.21.15.53:0/1310367434 shutdown_connections 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561bb82d3840 0x561bb8705b40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561bb82b2b60 0x561bb8689710 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561bb82aa980 0x561bb868eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7febdd7fa640 0 client.16764 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 1 --2- 172.21.15.53:0/1310367434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561bb82921c0 0x561bb868e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 1 -- 172.21.15.53:0/1310367434 >> 172.21.15.53:0/1310367434 conn(0x561bb82c7990 msgr2=0x561bb8677ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 1 -- 172.21.15.53:0/1310367434 shutdown_connections 2024-08-31T06:08:18.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 1 -- 172.21.15.53:0/1310367434 wait complete. 2024-08-31T06:08:18.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.331+0000 7fec02373740 20 client.16764 trim_cache size 0 max 16384 2024-08-31T06:08:18.335 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:08:18.335 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 30, 2024-08-31T06:08:18.335 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:08:18.335 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 14, 2024-08-31T06:08:18.335 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:08:18.335 INFO:teuthology.orchestra.run.smithi053.stdout: "315fa883": { 2024-08-31T06:08:18.335 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 14, 2024-08-31T06:08:18.335 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 141.8, 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:08:18.336 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:18.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:18.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:18.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:18.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:18.337 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:08:18.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 -- 172.21.15.53:0/1610806123 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe00b4d20 msgr2=0x7febe00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:18.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe00b4d20 0x7febe00b7230 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7febec103d70 tx=0x7febec0305c0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 -- 172.21.15.53:0/1610806123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf410dc10 msgr2=0x7febf419f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:18.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf410dc10 0x7febf419f8f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7febec005e30 tx=0x7febec003f30 comp rx=0 tx=0).stop 2024-08-31T06:08:18.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 -- 172.21.15.53:0/1610806123 shutdown_connections 2024-08-31T06:08:18.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe00b4d20 0x7febe00b7230 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf410dc10 0x7febf419f8f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf4105090 0x7febf419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 --2- 172.21.15.53:0/1610806123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf4104660 0x7febf419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:18.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 -- 172.21.15.53:0/1610806123 >> 172.21.15.53:0/1610806123 conn(0x7febf40794d0 msgr2=0x7febf4107740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:18.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 -- 172.21.15.53:0/1610806123 shutdown_connections 2024-08-31T06:08:18.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:18.332+0000 7febfbdfe640 1 -- 172.21.15.53:0/1610806123 wait complete. 2024-08-31T06:08:18.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.96 MB/sec execute 8 sec latency 624.064 ms 2024-08-31T06:08:19.144 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '315fa883', quiesce took 3.6 seconds. Will release after: 18.2 2024-08-31T06:08:19.696 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:08:19.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.85 MB/sec execute 9 sec latency 1624.090 ms 2024-08-31T06:08:19.967 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:19.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:19 smithi053 ceph-mon[18924]: pgmap v424: 97 pgs: 97 active+clean; 38 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 223 KiB/s wr, 39 op/s 2024-08-31T06:08:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:19 smithi130 ceph-mon[22266]: pgmap v424: 97 pgs: 97 active+clean; 38 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 223 KiB/s wr, 39 op/s 2024-08-31T06:08:20.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:19 smithi153 ceph-mon[22320]: pgmap v424: 97 pgs: 97 active+clean; 38 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 223 KiB/s wr, 39 op/s 2024-08-31T06:08:20.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.445+0000 7f5a762f2640 1 -- 172.21.15.53:0/741366125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a701069c0 msgr2=0x7f5a70110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:20.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.445+0000 7f5a762f2640 1 --2- 172.21.15.53:0/741366125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a701069c0 0x7f5a70110410 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009ca0 tx=0x7f5a6802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.445+0000 7f5a762f2640 1 -- 172.21.15.53:0/741366125 shutdown_connections 2024-08-31T06:08:20.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.445+0000 7f5a762f2640 1 --2- 172.21.15.53:0/741366125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a701069c0 0x7f5a70110410 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.445+0000 7f5a762f2640 1 --2- 172.21.15.53:0/741366125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a70106070 0x7f5a70106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.445+0000 7f5a762f2640 1 --2- 172.21.15.53:0/741366125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70101d90 0x7f5a701021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.445+0000 7f5a762f2640 1 -- 172.21.15.53:0/741366125 >> 172.21.15.53:0/741366125 conn(0x7f5a70077a60 msgr2=0x7f5a70077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.445+0000 7f5a762f2640 1 -- 172.21.15.53:0/741366125 shutdown_connections 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.445+0000 7f5a762f2640 1 -- 172.21.15.53:0/741366125 wait complete. 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.445+0000 7f5a762f2640 1 Processor -- start 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.445+0000 7f5a762f2640 1 -- start start 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a762f2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70101d90 0x7f5a7019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a762f2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a70106070 0x7f5a7019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a762f2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a701069c0 0x7f5a7019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a762f2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5a70113780 con 0x7f5a701069c0 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a762f2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a70113600 con 0x7f5a70101d90 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a762f2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a70113900 con 0x7f5a70106070 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a7488f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a701069c0 0x7f5a7019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a7488f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a701069c0 0x7f5a7019f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46804/0 (socket says 172.21.15.53:46804) 2024-08-31T06:08:20.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a7488f640 1 -- 172.21.15.53:0/2601625654 learned_addr learned my addr 172.21.15.53:0/2601625654 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:20.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a67fff640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a70106070 0x7f5a7019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70101d90 0x7f5a7019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a7488f640 1 -- 172.21.15.53:0/2601625654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a70106070 msgr2=0x7f5a7019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:20.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a7488f640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a70106070 0x7f5a7019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a7488f640 1 -- 172.21.15.53:0/2601625654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70101d90 msgr2=0x7f5a7019a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:20.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a7488f640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70101d90 0x7f5a7019a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.446+0000 7f5a7488f640 1 -- 172.21.15.53:0/2601625654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a701a00e0 con 0x7f5a701069c0 2024-08-31T06:08:20.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.447+0000 7f5a7488f640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a701069c0 0x7f5a7019f9b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a68005cc0 tx=0x7f5a68032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:20.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.447+0000 7f5a6dffb640 1 -- 172.21.15.53:0/2601625654 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68032e00 con 0x7f5a701069c0 2024-08-31T06:08:20.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.447+0000 7f5a6dffb640 1 -- 172.21.15.53:0/2601625654 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a680044d0 con 0x7f5a701069c0 2024-08-31T06:08:20.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.447+0000 7f5a762f2640 1 -- 172.21.15.53:0/2601625654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a701a0370 con 0x7f5a701069c0 2024-08-31T06:08:20.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.447+0000 7f5a6dffb640 1 -- 172.21.15.53:0/2601625654 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68030b70 con 0x7f5a701069c0 2024-08-31T06:08:20.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.447+0000 7f5a762f2640 1 -- 172.21.15.53:0/2601625654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a701a6b30 con 0x7f5a701069c0 2024-08-31T06:08:20.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.450+0000 7f5a7c867740 1 Processor -- start 2024-08-31T06:08:20.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.450+0000 7f5a6dffb640 1 -- 172.21.15.53:0/2601625654 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5a68004680 con 0x7f5a701069c0 2024-08-31T06:08:20.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.450+0000 7f5a7c867740 1 -- start start 2024-08-31T06:08:20.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.450+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d39a5070 0x5596d3d4a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 0x5596d3d4a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d4ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a7c867740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5596d3cc1630 con 0x5596d3984390 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a7c867740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5596d3cb0bc0 con 0x5596d397c1b0 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a7c867740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5596d3cb4b70 con 0x5596d39a5070 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d4ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d4ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46816/0 (socket says 172.21.15.53:46816) 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a67fff640 1 -- 172.21.15.53:0/439469140 learned_addr learned my addr 172.21.15.53:0/439469140 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a67fff640 1 --2- 172.21.15.53:0/439469140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d39a5070 0x5596d3d4a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/439469140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 0x5596d3d4a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a6dffb640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a5c0b4d20 0x7f5a5c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a67fff640 1 -- 172.21.15.53:0/439469140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d39a5070 msgr2=0x5596d3d4a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a67fff640 1 --2- 172.21.15.53:0/439469140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d39a5070 0x5596d3d4a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a67fff640 1 -- 172.21.15.53:0/439469140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 msgr2=0x5596d3d4a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:20.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a67fff640 1 --2- 172.21.15.53:0/439469140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 0x5596d3d4a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a67fff640 1 -- 172.21.15.53:0/439469140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d3a10650 con 0x5596d3984390 2024-08-31T06:08:20.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/439469140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 0x5596d3d4a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:20.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a7488f640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a5c0b4d20 0x7f5a5c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a6dffb640 1 -- 172.21.15.53:0/2601625654 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5a681066f0 con 0x7f5a701069c0 2024-08-31T06:08:20.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.451+0000 7f5a67fff640 1 --2- 172.21.15.53:0/439469140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d4ad40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800bf80 tx=0x7f5a58005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ccef4dd5b3241f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:20.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.452+0000 7f5a667fc640 1 -- 172.21.15.53:0/439469140 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58004220 con 0x5596d3984390 2024-08-31T06:08:20.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.452+0000 7f5a667fc640 1 -- 172.21.15.53:0/439469140 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a580043c0 con 0x5596d3984390 2024-08-31T06:08:20.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.452+0000 7f5a667fc640 1 -- 172.21.15.53:0/439469140 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58004ca0 con 0x5596d3984390 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.452+0000 7f5a7488f640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a5c0b4d20 0x7f5a5c0b7230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5a680ccd70 tx=0x7f5a6809a390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.452+0000 7f5a7c867740 1 -- 172.21.15.53:0/439469140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 msgr2=0x5596d3d4ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.453+0000 7f5a7c867740 1 --2- 172.21.15.53:0/439469140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d4ad40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800bf80 tx=0x7f5a58005c90 comp rx=0 tx=0).stop 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.453+0000 7f5a7c867740 1 -- 172.21.15.53:0/439469140 shutdown_connections 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.453+0000 7f5a7c867740 1 --2- 172.21.15.53:0/439469140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d4ad40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.453+0000 7f5a7c867740 1 --2- 172.21.15.53:0/439469140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 0x5596d3d4a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.453+0000 7f5a7c867740 1 --2- 172.21.15.53:0/439469140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d39a5070 0x5596d3d4a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.453+0000 7f5a7c867740 1 -- 172.21.15.53:0/439469140 >> 172.21.15.53:0/439469140 conn(0x5596d3999460 msgr2=0x5596d3d481b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.453+0000 7f5a7c867740 1 -- 172.21.15.53:0/439469140 shutdown_connections 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.453+0000 7f5a7c867740 1 -- 172.21.15.53:0/439469140 wait complete. 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.453+0000 7f5a7c867740 1 -- start start 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.453+0000 7f5a7c867740 1 Processor -- start 2024-08-31T06:08:20.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d397c1b0 0x5596d3d59e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d39a5070 0x5596d3d66160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a7c867740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5596d3b13700 con 0x5596d3984390 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a7c867740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5596d3c37700 con 0x5596d39a5070 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a7c867740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5596d3d5ce00 con 0x5596d397c1b0 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46820/0 (socket says 172.21.15.53:46820) 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a6ffff640 1 -- 172.21.15.53:0/3189320048 learned_addr learned my addr 172.21.15.53:0/3189320048 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a7c867740 10 client.0 _ll_register_callbacks cb 0x5596d3c66dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a67fff640 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d397c1b0 0x5596d3d59e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a67fff640 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d39a5070 0x5596d3d66160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a6ffff640 1 -- 172.21.15.53:0/3189320048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d397c1b0 msgr2=0x5596d3d59e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:20.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d397c1b0 0x5596d3d59e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a6ffff640 1 -- 172.21.15.53:0/3189320048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d39a5070 msgr2=0x5596d3d66160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d39a5070 0x5596d3d66160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a6ffff640 1 -- 172.21.15.53:0/3189320048 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596d3c708b0 con 0x5596d3984390 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a67fff640 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d39a5070 0x5596d3d66160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.454+0000 7f5a7c867740 1 -- 172.21.15.53:0/3189320048 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a580043c0 con 0x5596d3984390 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5a370 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5a600127f0 tx=0x7f5a60012cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e35daa36ab222b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a4f7fe640 10 client.16776 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a4f7fe640 1 -- 172.21.15.53:0/3189320048 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6001f060 con 0x5596d3984390 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a4f7fe640 1 -- 172.21.15.53:0/3189320048 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5a60010d60 con 0x5596d3984390 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a4f7fe640 1 -- 172.21.15.53:0/3189320048 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5a6001a430 con 0x5596d3984390 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a7c867740 10 client.16776 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a7c867740 1 -- 172.21.15.53:0/3189320048 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5596d3d68b60 con 0x5596d3984390 2024-08-31T06:08:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a4f7fe640 1 -- 172.21.15.53:0/3189320048 <== mon.0 v2:172.21.15.53:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f5a600233d0 con 0x5596d3984390 2024-08-31T06:08:20.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a7c867740 10 client.16776 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:20.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a7c867740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:20.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a7c867740 20 client.16776 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:20.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a7c867740 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596d39639f0 0x5596d3d6bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a7c867740 4 client.16776 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:20.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.455+0000 7f5a7c867740 1 -- 172.21.15.53:0/3189320048 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596d3cc3580 con 0x5596d39639f0 2024-08-31T06:08:20.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.456+0000 7f5a67fff640 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596d39639f0 0x5596d3d6bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.456+0000 7f5a67fff640 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596d39639f0 0x5596d3d6bf90 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31424813280b4451 server_cookie=b8d9223e8b4cac5d in_seq=0 out_seq=0 2024-08-31T06:08:20.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.456+0000 7f5a4f7fe640 10 client.16776 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:20.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a4f7fe640 1 -- 172.21.15.53:0/3189320048 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596d3cc3580 con 0x5596d39639f0 2024-08-31T06:08:20.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a4f7fe640 10 client.16776 handle_command_reply: tid=0 2024-08-31T06:08:20.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 1 client.16776 shutdown 2024-08-31T06:08:20.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 1 -- 172.21.15.53:0/3189320048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 msgr2=0x5596d3d5a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:20.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5a370 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5a600127f0 tx=0x7f5a60012cb0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 1 -- 172.21.15.53:0/3189320048 shutdown_connections 2024-08-31T06:08:20.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596d39639f0 0x5596d3d6bf90 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a4f7fe640 0 client.16776 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:20.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d39a5070 0x5596d3d66160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5a370 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 1 --2- 172.21.15.53:0/3189320048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d397c1b0 0x5596d3d59e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 1 -- 172.21.15.53:0/3189320048 >> 172.21.15.53:0/3189320048 conn(0x5596d3999460 msgr2=0x5596d3d46770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:20.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 1 -- 172.21.15.53:0/3189320048 shutdown_connections 2024-08-31T06:08:20.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 1 -- 172.21.15.53:0/3189320048 wait complete. 2024-08-31T06:08:20.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.457+0000 7f5a7c867740 20 client.16776 trim_cache size 0 max 16384 2024-08-31T06:08:20.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.475+0000 7f5a7c867740 1 Processor -- start 2024-08-31T06:08:20.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.475+0000 7f5a7c867740 1 -- start start 2024-08-31T06:08:20.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.475+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d39639f0 0x5596d3d4fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.475+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d397c1b0 0x5596d3d5ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.475+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d3984390 0x5596d3d66060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.475+0000 7f5a7c867740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701ad220 con 0x5596d397c1b0 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.475+0000 7f5a7c867740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701aee20 con 0x5596d39639f0 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.475+0000 7f5a7c867740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701ad8f0 con 0x5596d3984390 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.475+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d397c1b0 0x5596d3d5ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.475+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d397c1b0 0x5596d3d5ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46830/0 (socket says 172.21.15.53:46830) 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.475+0000 7f5a6ffff640 1 -- 172.21.15.53:0/301636192 learned_addr learned my addr 172.21.15.53:0/301636192 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.476+0000 7f5a67fff640 1 --2- 172.21.15.53:0/301636192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d39639f0 0x5596d3d4fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.476+0000 7f5a67fff640 1 --2- 172.21.15.53:0/301636192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d3984390 0x5596d3d66060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.476+0000 7f5a6ffff640 1 -- 172.21.15.53:0/301636192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d3984390 msgr2=0x5596d3d66060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.476+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/301636192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d3984390 0x5596d3d66060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.476+0000 7f5a6ffff640 1 -- 172.21.15.53:0/301636192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d39639f0 msgr2=0x5596d3d4fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.476+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/301636192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d39639f0 0x5596d3d4fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.476+0000 7f5a6ffff640 1 -- 172.21.15.53:0/301636192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d3d58330 con 0x5596d397c1b0 2024-08-31T06:08:20.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.476+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/301636192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d397c1b0 0x5596d3d5ba60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5a60023eb0 tx=0x7f5a60015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a798069f3d58000f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:20.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.476+0000 7f5a65ffb640 1 -- 172.21.15.53:0/301636192 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6001f070 con 0x5596d397c1b0 2024-08-31T06:08:20.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.476+0000 7f5a65ffb640 1 -- 172.21.15.53:0/301636192 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a580043c0 con 0x5596d397c1b0 2024-08-31T06:08:20.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.476+0000 7f5a65ffb640 1 -- 172.21.15.53:0/301636192 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60012280 con 0x5596d397c1b0 2024-08-31T06:08:20.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.477+0000 7f5a7c867740 1 -- 172.21.15.53:0/301636192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d397c1b0 msgr2=0x5596d3d5ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:20.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.477+0000 7f5a7c867740 1 --2- 172.21.15.53:0/301636192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d397c1b0 0x5596d3d5ba60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5a60023eb0 tx=0x7f5a60015000 comp rx=0 tx=0).stop 2024-08-31T06:08:20.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.477+0000 7f5a7c867740 1 -- 172.21.15.53:0/301636192 shutdown_connections 2024-08-31T06:08:20.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.477+0000 7f5a7c867740 1 --2- 172.21.15.53:0/301636192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d3984390 0x5596d3d66060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.477+0000 7f5a7c867740 1 --2- 172.21.15.53:0/301636192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d397c1b0 0x5596d3d5ba60 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.477+0000 7f5a7c867740 1 --2- 172.21.15.53:0/301636192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d39639f0 0x5596d3d4fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.477+0000 7f5a7c867740 1 -- 172.21.15.53:0/301636192 >> 172.21.15.53:0/301636192 conn(0x5596d3999460 msgr2=0x5596d3d5b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.477+0000 7f5a7c867740 1 -- 172.21.15.53:0/301636192 shutdown_connections 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.477+0000 7f5a7c867740 1 -- 172.21.15.53:0/301636192 wait complete. 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a7c867740 1 -- start start 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a7c867740 1 Processor -- start 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d39639f0 0x5596d3d625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 0x5596d3d5eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a7c867740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a7c867740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701ae690 con 0x5596d3984390 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a7c867740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701adfc0 con 0x5596d397c1b0 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a7c867740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701ab200 con 0x5596d39639f0 2024-08-31T06:08:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a7c867740 10 client.0 _ll_register_callbacks cb 0x7f5a6000a670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46838/0 (socket says 172.21.15.53:46838) 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.478+0000 7f5a67fff640 1 -- 172.21.15.53:0/518391838 learned_addr learned my addr 172.21.15.53:0/518391838 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a67fff640 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d39639f0 0x5596d3d625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 0x5596d3d5eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a67fff640 1 -- 172.21.15.53:0/518391838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d39639f0 msgr2=0x5596d3d625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a67fff640 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d39639f0 0x5596d3d625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a67fff640 1 -- 172.21.15.53:0/518391838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 msgr2=0x5596d3d5eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a67fff640 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 0x5596d3d5eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a67fff640 1 -- 172.21.15.53:0/518391838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596d3d5f570 con 0x5596d3984390 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 0x5596d3d5eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a67fff640 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5f030 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5a58012ee0 tx=0x7f5a5800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986a7aad0b9064e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:20.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a4f7fe640 1 -- 172.21.15.53:0/518391838 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5803d060 con 0x5596d3984390 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a4f7fe640 1 -- 172.21.15.53:0/518391838 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5a580051c0 con 0x5596d3984390 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a7c867740 1 -- 172.21.15.53:0/518391838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a580043c0 con 0x5596d3984390 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a4f7fe640 1 -- 172.21.15.53:0/518391838 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5a580053c0 con 0x5596d3984390 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a7c867740 10 client.16782 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.479+0000 7f5a7c867740 1 -- 172.21.15.53:0/518391838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5596d3dd7620 con 0x5596d3984390 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.480+0000 7f5a4f7fe640 1 -- 172.21.15.53:0/518391838 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a580043c0 con 0x5596d3984390 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.480+0000 7f5a4f7fe640 1 -- 172.21.15.53:0/518391838 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f5a58031070 con 0x5596d3984390 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.480+0000 7f5a7c867740 10 client.16782 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.480+0000 7f5a7c867740 10 client.16782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.480+0000 7f5a7c867740 20 client.16782 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.480+0000 7f5a7c867740 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596d39a5070 0x5596d3dd9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.480+0000 7f5a7c867740 4 client.16782 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:08:20.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.480+0000 7f5a7c867740 1 -- 172.21.15.53:0/518391838 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5596d3cbf020 con 0x5596d39a5070 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.480+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596d39a5070 0x5596d3dd9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.480+0000 7f5a6ffff640 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596d39a5070 0x5596d3dd9b00 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=117aa6cf50d0ba10 server_cookie=8c4852190eece1aa in_seq=0 out_seq=0 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.480+0000 7f5a4f7fe640 10 client.16782 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a4f7fe640 1 -- 172.21.15.53:0/518391838 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x5596d3cbf020 con 0x5596d39a5070 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a4f7fe640 10 client.16782 handle_command_reply: tid=0 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 1 client.16782 shutdown 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 1 -- 172.21.15.53:0/518391838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 msgr2=0x5596d3d5f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5f030 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5a58012ee0 tx=0x7f5a5800b8b0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 1 -- 172.21.15.53:0/518391838 shutdown_connections 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596d39a5070 0x5596d3dd9b00 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596d3984390 0x5596d3d5f030 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596d397c1b0 0x5596d3d5eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 1 --2- 172.21.15.53:0/518391838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596d39639f0 0x5596d3d625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 1 -- 172.21.15.53:0/518391838 >> 172.21.15.53:0/518391838 conn(0x5596d3999460 msgr2=0x5596d3d5bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:20.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a4f7fe640 0 client.16782 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:20.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 1 -- 172.21.15.53:0/518391838 shutdown_connections 2024-08-31T06:08:20.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 1 -- 172.21.15.53:0/518391838 wait complete. 2024-08-31T06:08:20.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.481+0000 7f5a7c867740 20 client.16782 trim_cache size 0 max 16384 2024-08-31T06:08:20.489 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:08:20.490 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:08:20.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:20.492 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:08:20.492 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:08:20.492 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:20.492 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:08:20.492 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:08:20.492 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:08:20.492 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:08:20.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:20.492 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:08:20.492 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:08:20.493 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:20.493 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:08:20.493 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:08:20.493 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:08:20.493 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:08:20.493 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:20.493 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:20.493 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:08:20.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 -- 172.21.15.53:0/2601625654 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a5c0b4d20 msgr2=0x7f5a5c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:20.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a5c0b4d20 0x7f5a5c0b7230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5a680ccd70 tx=0x7f5a6809a390 comp rx=0 tx=0).stop 2024-08-31T06:08:20.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 -- 172.21.15.53:0/2601625654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a701069c0 msgr2=0x7f5a7019f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:20.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a701069c0 0x7f5a7019f9b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a68005cc0 tx=0x7f5a68032a10 comp rx=0 tx=0).stop 2024-08-31T06:08:20.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 -- 172.21.15.53:0/2601625654 shutdown_connections 2024-08-31T06:08:20.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a5c0b4d20 0x7f5a5c0b7230 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a701069c0 0x7f5a7019f9b0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a70106070 0x7f5a7019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 --2- 172.21.15.53:0/2601625654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a70101d90 0x7f5a7019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:20.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 -- 172.21.15.53:0/2601625654 >> 172.21.15.53:0/2601625654 conn(0x7f5a70077a60 msgr2=0x7f5a70107320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:20.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 -- 172.21.15.53:0/2601625654 shutdown_connections 2024-08-31T06:08:20.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:20.482+0000 7f5a762f2640 1 -- 172.21.15.53:0/2601625654 wait complete. 2024-08-31T06:08:20.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.77 MB/sec execute 10 sec latency 2624.125 ms 2024-08-31T06:08:21.170 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:08:21.171 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:08:21.425 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:21.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.70 MB/sec execute 11 sec latency 3624.166 ms 2024-08-31T06:08:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.966+0000 7fd7c884d640 1 -- 172.21.15.53:0/2421394140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7c4108ad0 msgr2=0x7fd7c410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.966+0000 7fd7c884d640 1 --2- 172.21.15.53:0/2421394140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7c4108ad0 0x7fd7c410f300 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009ca0 tx=0x7fd7bc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:08:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.966+0000 7fd7c884d640 1 -- 172.21.15.53:0/2421394140 shutdown_connections 2024-08-31T06:08:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.966+0000 7fd7c884d640 1 --2- 172.21.15.53:0/2421394140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7c4108ad0 0x7fd7c410f300 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.966+0000 7fd7c884d640 1 --2- 172.21.15.53:0/2421394140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7c4108180 0x7fd7c4108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.966+0000 7fd7c884d640 1 --2- 172.21.15.53:0/2421394140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c4102840 0x7fd7c4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.966+0000 7fd7c884d640 1 -- 172.21.15.53:0/2421394140 >> 172.21.15.53:0/2421394140 conn(0x7fd7c40794f0 msgr2=0x7fd7c4079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.966+0000 7fd7c884d640 1 -- 172.21.15.53:0/2421394140 shutdown_connections 2024-08-31T06:08:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.966+0000 7fd7c884d640 1 -- 172.21.15.53:0/2421394140 wait complete. 2024-08-31T06:08:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c884d640 1 Processor -- start 2024-08-31T06:08:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c884d640 1 -- start start 2024-08-31T06:08:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c884d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7c4102840 0x7fd7c419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c884d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c4108180 0x7fd7c419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c884d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7c4108ad0 0x7fd7c419f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c884d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c41137a0 con 0x7fd7c4102840 2024-08-31T06:08:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c884d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c4113620 con 0x7fd7c4108ad0 2024-08-31T06:08:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c884d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c4113920 con 0x7fd7c4108180 2024-08-31T06:08:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7c4102840 0x7fd7c419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:21.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7c4102840 0x7fd7c419a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46850/0 (socket says 172.21.15.53:46850) 2024-08-31T06:08:21.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c259c640 1 -- 172.21.15.53:0/841120855 learned_addr learned my addr 172.21.15.53:0/841120855 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:21.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c1d9b640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c4108180 0x7fd7c419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:21.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c2d9d640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7c4108ad0 0x7fd7c419f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:21.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c259c640 1 -- 172.21.15.53:0/841120855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c4108180 msgr2=0x7fd7c419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:21.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c259c640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c4108180 0x7fd7c419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:21.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c259c640 1 -- 172.21.15.53:0/841120855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7c4108ad0 msgr2=0x7fd7c419f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:21.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c259c640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7c4108ad0 0x7fd7c419f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:21.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.967+0000 7fd7c259c640 1 -- 172.21.15.53:0/841120855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c41a0100 con 0x7fd7c4102840 2024-08-31T06:08:21.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.968+0000 7fd7c2d9d640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7c4108ad0 0x7fd7c419f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:21.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.968+0000 7fd7c259c640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7c4102840 0x7fd7c419a190 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400c970 tx=0x7fd7b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:21.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.968+0000 7fd7b37fe640 1 -- 172.21.15.53:0/841120855 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4007bb0 con 0x7fd7c4102840 2024-08-31T06:08:21.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.968+0000 7fd7b37fe640 1 -- 172.21.15.53:0/841120855 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7b4007d50 con 0x7fd7c4102840 2024-08-31T06:08:21.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.968+0000 7fd7c884d640 1 -- 172.21.15.53:0/841120855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c41a03f0 con 0x7fd7c4102840 2024-08-31T06:08:21.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.968+0000 7fd7b37fe640 1 -- 172.21.15.53:0/841120855 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4004e40 con 0x7fd7c4102840 2024-08-31T06:08:21.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.968+0000 7fd7c884d640 1 -- 172.21.15.53:0/841120855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c41a6b50 con 0x7fd7c4102840 2024-08-31T06:08:21.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.969+0000 7fd7c884d640 1 -- 172.21.15.53:0/841120855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c4102c50 con 0x7fd7c4102840 2024-08-31T06:08:21.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.971+0000 7fd7b37fe640 1 -- 172.21.15.53:0/841120855 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd7b4005000 con 0x7fd7c4102840 2024-08-31T06:08:21.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.971+0000 7fd7b37fe640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd7ac0b4ca0 0x7fd7ac0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:21.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.972+0000 7fd7c1d9b640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd7ac0b4ca0 0x7fd7ac0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:21.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.972+0000 7fd7b37fe640 1 -- 172.21.15.53:0/841120855 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd7b40e56e0 con 0x7fd7c4102840 2024-08-31T06:08:21.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.972+0000 7fd7c1d9b640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd7ac0b4ca0 0x7fd7ac0b71b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8005d90 tx=0x7fd7b8005d20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:21.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:21.975+0000 7fd7b37fe640 1 -- 172.21.15.53:0/841120855 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd7b4014030 con 0x7fd7c4102840 2024-08-31T06:08:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:21 smithi130 ceph-mon[22266]: pgmap v425: 97 pgs: 97 active+clean; 39 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 380 KiB/s wr, 51 op/s 2024-08-31T06:08:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:21 smithi153 ceph-mon[22320]: pgmap v425: 97 pgs: 97 active+clean; 39 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 380 KiB/s wr, 51 op/s 2024-08-31T06:08:22.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.198+0000 7fd7c884d640 1 -- 172.21.15.53:0/841120855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7c419b2c0 con 0x7fd7c4102840 2024-08-31T06:08:22.201 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:21 smithi053 ceph-mon[18924]: pgmap v425: 97 pgs: 97 active+clean; 39 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 380 KiB/s wr, 51 op/s 2024-08-31T06:08:22.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.199+0000 7fd7b37fe640 1 -- 172.21.15.53:0/841120855 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11992 (secure 0 0 0) 0x7fd7b40ac4d0 con 0x7fd7c4102840 2024-08-31T06:08:22.202 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:08:22.202 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"btime":"2024-08-31T06:06:51:511613+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:06:50.526609+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:08:22.202 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 30 2024-08-31T06:08:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.201+0000 7fd7c884d640 1 -- 172.21.15.53:0/841120855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd7ac0b4ca0 msgr2=0x7fd7ac0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.201+0000 7fd7c884d640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd7ac0b4ca0 0x7fd7ac0b71b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8005d90 tx=0x7fd7b8005d20 comp rx=0 tx=0).stop 2024-08-31T06:08:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.201+0000 7fd7c884d640 1 -- 172.21.15.53:0/841120855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7c4102840 msgr2=0x7fd7c419a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.201+0000 7fd7c884d640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7c4102840 0x7fd7c419a190 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400c970 tx=0x7fd7b400ce30 comp rx=0 tx=0).stop 2024-08-31T06:08:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.201+0000 7fd7c884d640 1 -- 172.21.15.53:0/841120855 shutdown_connections 2024-08-31T06:08:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.201+0000 7fd7c884d640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd7ac0b4ca0 0x7fd7ac0b71b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.202+0000 7fd7c884d640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7c4108ad0 0x7fd7c419f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.202+0000 7fd7c884d640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7c4108180 0x7fd7c419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.202+0000 7fd7c884d640 1 --2- 172.21.15.53:0/841120855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7c4102840 0x7fd7c419a190 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:22.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.202+0000 7fd7c884d640 1 -- 172.21.15.53:0/841120855 >> 172.21.15.53:0/841120855 conn(0x7fd7c40794f0 msgr2=0x7fd7c4104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:22.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.202+0000 7fd7c884d640 1 -- 172.21.15.53:0/841120855 shutdown_connections 2024-08-31T06:08:22.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:22.202+0000 7fd7c884d640 1 -- 172.21.15.53:0/841120855 wait complete. 2024-08-31T06:08:22.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.64 MB/sec execute 12 sec latency 4624.195 ms 2024-08-31T06:08:23.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:22 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/841120855' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:23.104 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:08:23.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:22 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/841120855' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:23.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:22 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/841120855' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:23.358 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.769+0000 7fbe7c834640 1 -- 172.21.15.53:0/1265157050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe78109b90 msgr2=0x7fbe781103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.769+0000 7fbe7c834640 1 --2- 172.21.15.53:0/1265157050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe78109b90 0x7fbe781103c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009ca0 tx=0x7fbe7002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.769+0000 7fbe7c834640 1 -- 172.21.15.53:0/1265157050 shutdown_connections 2024-08-31T06:08:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.769+0000 7fbe7c834640 1 --2- 172.21.15.53:0/1265157050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe78109b90 0x7fbe781103c0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.769+0000 7fbe7c834640 1 --2- 172.21.15.53:0/1265157050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe78109240 0x7fbe78109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.769+0000 7fbe7c834640 1 --2- 172.21.15.53:0/1265157050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe78103900 0x7fbe78103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.769+0000 7fbe7c834640 1 -- 172.21.15.53:0/1265157050 >> 172.21.15.53:0/1265157050 conn(0x7fbe7807b5f0 msgr2=0x7fbe7807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.769+0000 7fbe7c834640 1 -- 172.21.15.53:0/1265157050 shutdown_connections 2024-08-31T06:08:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.769+0000 7fbe7c834640 1 -- 172.21.15.53:0/1265157050 wait complete. 2024-08-31T06:08:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe7c834640 1 Processor -- start 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe7c834640 1 -- start start 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe7c834640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe78103900 0x7fbe7819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe7c834640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe78109240 0x7fbe7819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe7c834640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe78109b90 0x7fbe7819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe7c834640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbe78113750 con 0x7fbe78109240 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe7c834640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781135d0 con 0x7fbe78109b90 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe7c834640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781138d0 con 0x7fbe78103900 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe78109240 0x7fbe7819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe78109240 0x7fbe7819a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35258/0 (socket says 172.21.15.53:35258) 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe75d9b640 1 -- 172.21.15.53:0/221900587 learned_addr learned my addr 172.21.15.53:0/221900587 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe7659c640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe78103900 0x7fbe7819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe76d9d640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe78109b90 0x7fbe7819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe75d9b640 1 -- 172.21.15.53:0/221900587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe78103900 msgr2=0x7fbe7819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.770+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe78103900 0x7fbe7819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.771+0000 7fbe75d9b640 1 -- 172.21.15.53:0/221900587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe78109b90 msgr2=0x7fbe7819faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.771+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe78109b90 0x7fbe7819faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.771+0000 7fbe75d9b640 1 -- 172.21.15.53:0/221900587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe781a01d0 con 0x7fbe78109240 2024-08-31T06:08:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.771+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe78109240 0x7fbe7819a800 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00d750 tx=0x7fbe6c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.771+0000 7fbe677fe640 1 -- 172.21.15.53:0/221900587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c017070 con 0x7fbe78109240 2024-08-31T06:08:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.771+0000 7fbe7c834640 1 -- 172.21.15.53:0/221900587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe781a04c0 con 0x7fbe78109240 2024-08-31T06:08:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.771+0000 7fbe677fe640 1 -- 172.21.15.53:0/221900587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe6c0054b0 con 0x7fbe78109240 2024-08-31T06:08:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.771+0000 7fbe677fe640 1 -- 172.21.15.53:0/221900587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c004bc0 con 0x7fbe78109240 2024-08-31T06:08:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.771+0000 7fbe7c834640 1 -- 172.21.15.53:0/221900587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe781a6c20 con 0x7fbe78109240 2024-08-31T06:08:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe677fe640 1 -- 172.21.15.53:0/221900587 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbe6c009c30 con 0x7fbe78109240 2024-08-31T06:08:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe82da9740 1 Processor -- start 2024-08-31T06:08:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe82da9740 1 -- start start 2024-08-31T06:08:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a33070 0x561845dd8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561845a0a1b0 0x561845dd8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845dd8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe82da9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561845d4f680 con 0x561845a33070 2024-08-31T06:08:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe82da9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561845d3ec10 con 0x561845a12390 2024-08-31T06:08:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe82da9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561845d42bc0 con 0x561845a0a1b0 2024-08-31T06:08:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe76d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a33070 0x561845dd8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe76d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a33070 0x561845dd8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35268/0 (socket says 172.21.15.53:35268) 2024-08-31T06:08:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.774+0000 7fbe76d9d640 1 -- 172.21.15.53:0/3002110269 learned_addr learned my addr 172.21.15.53:0/3002110269 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe7659c640 1 --2- 172.21.15.53:0/3002110269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561845a0a1b0 0x561845dd8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/3002110269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845dd8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe76d9d640 1 -- 172.21.15.53:0/3002110269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561845a0a1b0 msgr2=0x561845dd8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe76d9d640 1 --2- 172.21.15.53:0/3002110269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561845a0a1b0 0x561845dd8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe76d9d640 1 -- 172.21.15.53:0/3002110269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 msgr2=0x561845dd8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe76d9d640 1 --2- 172.21.15.53:0/3002110269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845dd8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe677fe640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe600b4ca0 0x7fbe600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe76d9d640 1 -- 172.21.15.53:0/3002110269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561845a9e650 con 0x561845a33070 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/3002110269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845dd8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe677fe640 1 -- 172.21.15.53:0/221900587 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fbe6c0e4fa0 con 0x7fbe78109240 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe7659c640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe600b4ca0 0x7fbe600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe76d9d640 1 --2- 172.21.15.53:0/3002110269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a33070 0x561845dd8310 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbe70005cc0 tx=0x7fbe70009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68975dcfb0c40002 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe64ff9640 1 -- 172.21.15.53:0/3002110269 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70031980 con 0x561845a33070 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe64ff9640 1 -- 172.21.15.53:0/3002110269 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe70036040 con 0x561845a33070 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.775+0000 7fbe64ff9640 1 -- 172.21.15.53:0/3002110269 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70004310 con 0x561845a33070 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.776+0000 7fbe82da9740 1 -- 172.21.15.53:0/3002110269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a33070 msgr2=0x561845dd8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.776+0000 7fbe7659c640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe600b4ca0 0x7fbe600b71b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x561845dd6f90 tx=0x7fbe6800d340 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.776+0000 7fbe82da9740 1 --2- 172.21.15.53:0/3002110269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a33070 0x561845dd8310 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbe70005cc0 tx=0x7fbe70009a20 comp rx=0 tx=0).stop 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.776+0000 7fbe82da9740 1 -- 172.21.15.53:0/3002110269 shutdown_connections 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.776+0000 7fbe82da9740 1 --2- 172.21.15.53:0/3002110269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845dd8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.776+0000 7fbe82da9740 1 --2- 172.21.15.53:0/3002110269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561845a0a1b0 0x561845dd8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.776+0000 7fbe82da9740 1 --2- 172.21.15.53:0/3002110269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a33070 0x561845dd8310 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.776+0000 7fbe82da9740 1 -- 172.21.15.53:0/3002110269 >> 172.21.15.53:0/3002110269 conn(0x561845a27460 msgr2=0x561845dd6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.776+0000 7fbe82da9740 1 -- 172.21.15.53:0/3002110269 shutdown_connections 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe82da9740 1 -- 172.21.15.53:0/3002110269 wait complete. 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe82da9740 1 -- start start 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe82da9740 1 Processor -- start 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561845a0a1b0 0x561845de3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a12390 0x561845de4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a33070 0x561845defdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe82da9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561845ba1700 con 0x561845a12390 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe82da9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561845cc5750 con 0x561845a33070 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe82da9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561845de6a90 con 0x561845a0a1b0 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe82da9740 10 client.0 _ll_register_callbacks cb 0x561845cf4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a12390 0x561845de4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a12390 0x561845de4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35276/0 (socket says 172.21.15.53:35276) 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.777+0000 7fbe75d9b640 1 -- 172.21.15.53:0/1730757802 learned_addr learned my addr 172.21.15.53:0/1730757802 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe76d9d640 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a33070 0x561845defdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe7659c640 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561845a0a1b0 0x561845de3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe75d9b640 1 -- 172.21.15.53:0/1730757802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561845a0a1b0 msgr2=0x561845de3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561845a0a1b0 0x561845de3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe75d9b640 1 -- 172.21.15.53:0/1730757802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a33070 msgr2=0x561845defdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a33070 0x561845defdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe75d9b640 1 -- 172.21.15.53:0/1730757802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561845cfe900 con 0x561845a12390 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe7659c640 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561845a0a1b0 0x561845de3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a12390 0x561845de4010 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0e2750 tx=0x7fbe6c0ab520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c49077c0c03734 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe5dffb640 1 -- 172.21.15.53:0/1730757802 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c020050 con 0x561845a12390 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe5dffb640 1 -- 172.21.15.53:0/1730757802 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fbe6c0a7c80 con 0x561845a12390 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe82da9740 1 -- 172.21.15.53:0/1730757802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe70036040 con 0x561845a12390 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe5dffb640 1 -- 172.21.15.53:0/1730757802 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbe6c0ab1a0 con 0x561845a12390 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe82da9740 10 client.16800 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.778+0000 7fbe82da9740 1 -- 172.21.15.53:0/1730757802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561845df2810 con 0x561845a12390 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.779+0000 7fbe5dffb640 1 -- 172.21.15.53:0/1730757802 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe70036040 con 0x561845a12390 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.779+0000 7fbe5dffb640 1 -- 172.21.15.53:0/1730757802 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fbe6c0a7000 con 0x561845a12390 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.779+0000 7fbe82da9740 10 client.16800 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.779+0000 7fbe82da9740 10 client.16800 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:08:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.779+0000 7fbe82da9740 20 client.16800 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.779+0000 7fbe82da9740 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5618459f19f0 0x561845df5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.779+0000 7fbe82da9740 4 client.16800 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.779+0000 7fbe82da9740 1 -- 172.21.15.53:0/1730757802 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561845d515d0 con 0x5618459f19f0 2024-08-31T06:08:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.779+0000 7fbe7659c640 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5618459f19f0 0x561845df5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.780+0000 7fbe5dffb640 10 client.16800 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:08:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.780+0000 7fbe7659c640 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5618459f19f0 0x561845df5c90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f1d678aba7c26e46 server_cookie=4b6cccb6fa3625dd in_seq=0 out_seq=0 2024-08-31T06:08:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.780+0000 7fbe5dffb640 1 -- 172.21.15.53:0/1730757802 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561845d515d0 con 0x5618459f19f0 2024-08-31T06:08:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.780+0000 7fbe5dffb640 10 client.16800 handle_command_reply: tid=0 2024-08-31T06:08:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 1 client.16800 shutdown 2024-08-31T06:08:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 1 -- 172.21.15.53:0/1730757802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a12390 msgr2=0x561845de4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a12390 0x561845de4010 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0e2750 tx=0x7fbe6c0ab520 comp rx=0 tx=0).stop 2024-08-31T06:08:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 1 -- 172.21.15.53:0/1730757802 shutdown_connections 2024-08-31T06:08:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a33070 0x561845defdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a12390 0x561845de4010 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5618459f19f0 0x561845df5c90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe5dffb640 0 client.16800 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:08:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 1 --2- 172.21.15.53:0/1730757802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561845a0a1b0 0x561845de3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 1 -- 172.21.15.53:0/1730757802 >> 172.21.15.53:0/1730757802 conn(0x561845a27460 msgr2=0x561845ddb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 1 -- 172.21.15.53:0/1730757802 shutdown_connections 2024-08-31T06:08:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 1 -- 172.21.15.53:0/1730757802 wait complete. 2024-08-31T06:08:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.781+0000 7fbe82da9740 20 client.16800 trim_cache size 0 max 16384 2024-08-31T06:08:23.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.794+0000 7fbe82da9740 1 Processor -- start 2024-08-31T06:08:23.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.794+0000 7fbe82da9740 1 -- start start 2024-08-31T06:08:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618459f19f0 0x561845dd9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845defcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845df01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe82da9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781af5b0 con 0x561845a0a1b0 2024-08-31T06:08:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe82da9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781b11b0 con 0x561845a12390 2024-08-31T06:08:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe82da9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781afc80 con 0x5618459f19f0 2024-08-31T06:08:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845defcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845defcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35282/0 (socket says 172.21.15.53:35282) 2024-08-31T06:08:23.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe75d9b640 1 -- 172.21.15.53:0/3727094666 learned_addr learned my addr 172.21.15.53:0/3727094666 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe7659c640 1 --2- 172.21.15.53:0/3727094666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618459f19f0 0x561845dd9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe76d9d640 1 --2- 172.21.15.53:0/3727094666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845df01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe75d9b640 1 -- 172.21.15.53:0/3727094666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618459f19f0 msgr2=0x561845dd9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/3727094666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618459f19f0 0x561845dd9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe75d9b640 1 -- 172.21.15.53:0/3727094666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 msgr2=0x561845df01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/3727094666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845df01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe75d9b640 1 -- 172.21.15.53:0/3727094666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561845de1fd0 con 0x561845a0a1b0 2024-08-31T06:08:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/3727094666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845defcb0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0ab340 tx=0x7fbe6c00def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b811fc2669cbb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.795+0000 7fbe5ffff640 1 -- 172.21.15.53:0/3727094666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c020070 con 0x561845a0a1b0 2024-08-31T06:08:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.796+0000 7fbe5ffff640 1 -- 172.21.15.53:0/3727094666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe6c0abd90 con 0x561845a0a1b0 2024-08-31T06:08:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.796+0000 7fbe5ffff640 1 -- 172.21.15.53:0/3727094666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0e8390 con 0x561845a0a1b0 2024-08-31T06:08:23.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.796+0000 7fbe82da9740 1 -- 172.21.15.53:0/3727094666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 msgr2=0x561845defcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:23.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.796+0000 7fbe82da9740 1 --2- 172.21.15.53:0/3727094666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845defcb0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0ab340 tx=0x7fbe6c00def0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.796+0000 7fbe82da9740 1 -- 172.21.15.53:0/3727094666 shutdown_connections 2024-08-31T06:08:23.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.796+0000 7fbe82da9740 1 --2- 172.21.15.53:0/3727094666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845df01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.796+0000 7fbe82da9740 1 --2- 172.21.15.53:0/3727094666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845defcb0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.796+0000 7fbe82da9740 1 --2- 172.21.15.53:0/3727094666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618459f19f0 0x561845dd9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.796+0000 7fbe82da9740 1 -- 172.21.15.53:0/3727094666 >> 172.21.15.53:0/3727094666 conn(0x561845a27460 msgr2=0x561845dd9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:23.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.797+0000 7fbe82da9740 1 -- 172.21.15.53:0/3727094666 shutdown_connections 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.797+0000 7fbe82da9740 1 -- 172.21.15.53:0/3727094666 wait complete. 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.797+0000 7fbe82da9740 1 -- start start 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.797+0000 7fbe82da9740 1 Processor -- start 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.797+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618459f19f0 0x561845dec3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.797+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845de88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.797+0000 7fbe82da9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845de8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.797+0000 7fbe82da9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781b0a20 con 0x561845a0a1b0 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.797+0000 7fbe82da9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781b0350 con 0x561845a12390 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.797+0000 7fbe82da9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781ad590 con 0x5618459f19f0 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe82da9740 10 client.0 _ll_register_callbacks cb 0x7fbe6c0057f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845de88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe7659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618459f19f0 0x561845dec3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845de88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35292/0 (socket says 172.21.15.53:35292) 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe75d9b640 1 -- 172.21.15.53:0/4004272313 learned_addr learned my addr 172.21.15.53:0/4004272313 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe76d9d640 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845de8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe75d9b640 1 -- 172.21.15.53:0/4004272313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618459f19f0 msgr2=0x561845dec3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618459f19f0 0x561845dec3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe75d9b640 1 -- 172.21.15.53:0/4004272313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 msgr2=0x561845de8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845de8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe75d9b640 1 -- 172.21.15.53:0/4004272313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561845de9450 con 0x561845a0a1b0 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe75d9b640 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845de88a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0e27a0 tx=0x7fbe6c0aff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee37841dc4ab0f83 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe5dffb640 1 -- 172.21.15.53:0/4004272313 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c020050 con 0x561845a0a1b0 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe5dffb640 1 -- 172.21.15.53:0/4004272313 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fbe6c0cce00 con 0x561845a0a1b0 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.798+0000 7fbe82da9740 1 -- 172.21.15.53:0/4004272313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe6c0abd90 con 0x561845a0a1b0 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe5dffb640 1 -- 172.21.15.53:0/4004272313 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbe6c0aae00 con 0x561845a0a1b0 2024-08-31T06:08:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe82da9740 10 client.16806 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe82da9740 1 -- 172.21.15.53:0/4004272313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561845e61460 con 0x561845a0a1b0 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe5dffb640 1 -- 172.21.15.53:0/4004272313 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe6c0abd90 con 0x561845a0a1b0 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe5dffb640 1 -- 172.21.15.53:0/4004272313 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fbe6c0b1090 con 0x561845a0a1b0 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe82da9740 10 client.16806 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe82da9740 10 client.16806 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe82da9740 20 client.16806 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe82da9740 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x561845a33070 0x561845e639f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe82da9740 4 client.16806 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe82da9740 1 -- 172.21.15.53:0/4004272313 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561845d4d070 con 0x561845a33070 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.799+0000 7fbe7659c640 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x561845a33070 0x561845e639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe7659c640 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x561845a33070 0x561845e639f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4bf58c749bdb8bb0 server_cookie=ba02a9bd21a3d545 in_seq=0 out_seq=0 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe5dffb640 10 client.16806 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:08:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe5dffb640 1 -- 172.21.15.53:0/4004272313 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561845d4d070 con 0x561845a33070 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe5dffb640 10 client.16806 handle_command_reply: tid=0 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 1 client.16806 shutdown 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 1 -- 172.21.15.53:0/4004272313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 msgr2=0x561845de88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845de88a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0e27a0 tx=0x7fbe6c0aff00 comp rx=0 tx=0).stop 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 1 -- 172.21.15.53:0/4004272313 shutdown_connections 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561845a12390 0x561845de8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561845a0a1b0 0x561845de88a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x561845a33070 0x561845e639f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 1 --2- 172.21.15.53:0/4004272313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618459f19f0 0x561845dec3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe5dffb640 0 client.16806 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 1 -- 172.21.15.53:0/4004272313 >> 172.21.15.53:0/4004272313 conn(0x561845a27460 msgr2=0x561845ddbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 1 -- 172.21.15.53:0/4004272313 shutdown_connections 2024-08-31T06:08:23.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 1 -- 172.21.15.53:0/4004272313 wait complete. 2024-08-31T06:08:23.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.800+0000 7fbe82da9740 20 client.16806 trim_cache size 0 max 16384 2024-08-31T06:08:23.809 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:08:23.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 -- 172.21.15.53:0/221900587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe600b4ca0 msgr2=0x7fbe600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:23.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe600b4ca0 0x7fbe600b71b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x561845dd6f90 tx=0x7fbe6800d340 comp rx=0 tx=0).stop 2024-08-31T06:08:23.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 -- 172.21.15.53:0/221900587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe78109240 msgr2=0x7fbe7819a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:23.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe78109240 0x7fbe7819a800 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00d750 tx=0x7fbe6c00dc10 comp rx=0 tx=0).stop 2024-08-31T06:08:23.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 -- 172.21.15.53:0/221900587 shutdown_connections 2024-08-31T06:08:23.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe600b4ca0 0x7fbe600b71b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe78109b90 0x7fbe7819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe78109240 0x7fbe7819a800 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 --2- 172.21.15.53:0/221900587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe78103900 0x7fbe7819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:23.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 -- 172.21.15.53:0/221900587 >> 172.21.15.53:0/221900587 conn(0x7fbe7807b5f0 msgr2=0x7fbe78107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:23.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 -- 172.21.15.53:0/221900587 shutdown_connections 2024-08-31T06:08:23.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:23.801+0000 7fbe7c834640 1 -- 172.21.15.53:0/221900587 wait complete. 2024-08-31T06:08:23.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.59 MB/sec execute 13 sec latency 5624.275 ms 2024-08-31T06:08:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:23 smithi130 ceph-mon[22266]: pgmap v426: 97 pgs: 97 active+clean; 38 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 423 KiB/s wr, 56 op/s 2024-08-31T06:08:24.174 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:23 smithi053 ceph-mon[18924]: pgmap v426: 97 pgs: 97 active+clean; 38 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 423 KiB/s wr, 56 op/s 2024-08-31T06:08:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:23 smithi153 ceph-mon[22320]: pgmap v426: 97 pgs: 97 active+clean; 38 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 423 KiB/s wr, 56 op/s 2024-08-31T06:08:24.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:08:24.956 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:24.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.55 MB/sec execute 14 sec latency 6624.309 ms 2024-08-31T06:08:25.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.420+0000 7fd6968e4640 1 -- 172.21.15.53:0/1284798905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690102880 msgr2=0x7fd690102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:25.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.420+0000 7fd6968e4640 1 --2- 172.21.15.53:0/1284798905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690102880 0x7fd690102c90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd680009900 tx=0x7fd68002a410 comp rx=0 tx=0).stop 2024-08-31T06:08:25.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.420+0000 7fd6968e4640 1 -- 172.21.15.53:0/1284798905 shutdown_connections 2024-08-31T06:08:25.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.420+0000 7fd6968e4640 1 --2- 172.21.15.53:0/1284798905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd690108b10 0x7fd69010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.420+0000 7fd6968e4640 1 --2- 172.21.15.53:0/1284798905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6901081c0 0x7fd6901085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.420+0000 7fd6968e4640 1 --2- 172.21.15.53:0/1284798905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690102880 0x7fd690102c90 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.420+0000 7fd6968e4640 1 -- 172.21.15.53:0/1284798905 >> 172.21.15.53:0/1284798905 conn(0x7fd690079510 msgr2=0x7fd690079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:25.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.420+0000 7fd6968e4640 1 -- 172.21.15.53:0/1284798905 shutdown_connections 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.420+0000 7fd6968e4640 1 -- 172.21.15.53:0/1284798905 wait complete. 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.420+0000 7fd6968e4640 1 Processor -- start 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd6968e4640 1 -- start start 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd6968e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690102880 0x7fd69019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd6968e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6901081c0 0x7fd69019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd6968e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd690108b10 0x7fd69019fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd6968e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd690112690 con 0x7fd690102880 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd6968e4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd690112510 con 0x7fd6901081c0 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd6968e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd690112810 con 0x7fd690108b10 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd68ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690102880 0x7fd69019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd68ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690102880 0x7fd69019a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35318/0 (socket says 172.21.15.53:35318) 2024-08-31T06:08:25.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd68ffff640 1 -- 172.21.15.53:0/2270191397 learned_addr learned my addr 172.21.15.53:0/2270191397 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6901081c0 0x7fd69019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd694e81640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd690108b10 0x7fd69019fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd68ffff640 1 -- 172.21.15.53:0/2270191397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd690108b10 msgr2=0x7fd69019fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd68ffff640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd690108b10 0x7fd69019fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd68ffff640 1 -- 172.21.15.53:0/2270191397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6901081c0 msgr2=0x7fd69019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd68ffff640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6901081c0 0x7fd69019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.421+0000 7fd68ffff640 1 -- 172.21.15.53:0/2270191397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6901a0200 con 0x7fd690102880 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.422+0000 7fd68ffff640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690102880 0x7fd69019a290 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd680009230 tx=0x7fd680004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.422+0000 7fd68d7fa640 1 -- 172.21.15.53:0/2270191397 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68003f030 con 0x7fd690102880 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.422+0000 7fd6968e4640 1 -- 172.21.15.53:0/2270191397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6901a0490 con 0x7fd690102880 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.422+0000 7fd68d7fa640 1 -- 172.21.15.53:0/2270191397 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd680003a80 con 0x7fd690102880 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.422+0000 7fd68d7fa640 1 -- 172.21.15.53:0/2270191397 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680035070 con 0x7fd690102880 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.422+0000 7fd6968e4640 1 -- 172.21.15.53:0/2270191397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6901a6c50 con 0x7fd690102880 2024-08-31T06:08:25.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.424+0000 7fd69ce59740 1 Processor -- start 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.424+0000 7fd69ce59740 1 -- start start 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd68d7fa640 1 -- 172.21.15.53:0/2270191397 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd680042030 con 0x7fd690102880 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f29622310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29622850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2925c390 0x564f29622d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd69ce59740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564f29599680 con 0x564f292541b0 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd69ce59740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564f29588c10 con 0x564f2927d070 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd69ce59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564f2958cbc0 con 0x564f2925c390 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd68ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29622850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd68ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29622850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35322/0 (socket says 172.21.15.53:35322) 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd68ffff640 1 -- 172.21.15.53:0/2257120957 learned_addr learned my addr 172.21.15.53:0/2257120957 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/2257120957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2925c390 0x564f29622d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd694e81640 1 --2- 172.21.15.53:0/2257120957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f29622310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd68ffff640 1 -- 172.21.15.53:0/2257120957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2925c390 msgr2=0x564f29622d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd68ffff640 1 --2- 172.21.15.53:0/2257120957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2925c390 0x564f29622d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd68ffff640 1 -- 172.21.15.53:0/2257120957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 msgr2=0x564f29622310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd68ffff640 1 --2- 172.21.15.53:0/2257120957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f29622310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.425+0000 7fd68ffff640 1 -- 172.21.15.53:0/2257120957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f292e8650 con 0x564f292541b0 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.426+0000 7fd68ffff640 1 --2- 172.21.15.53:0/2257120957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29622850 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd680103460 tx=0x7fd68010e1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9c748448dbd9a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.426+0000 7fd68d7fa640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6780b4ca0 0x7fd6780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.426+0000 7fd694e81640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6780b4ca0 0x7fd6780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.426+0000 7fd68d7fa640 1 -- 172.21.15.53:0/2270191397 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd680105dd0 con 0x7fd690102880 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.426+0000 7fd6767fc640 1 -- 172.21.15.53:0/2257120957 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6800c8380 con 0x564f292541b0 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.426+0000 7fd6767fc640 1 -- 172.21.15.53:0/2257120957 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd680113070 con 0x564f292541b0 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.426+0000 7fd6767fc640 1 -- 172.21.15.53:0/2257120957 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6800cbc30 con 0x564f292541b0 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.427+0000 7fd69ce59740 1 -- 172.21.15.53:0/2257120957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 msgr2=0x564f29622850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.427+0000 7fd694e81640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6780b4ca0 0x7fd6780b71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd688005fd0 tx=0x7fd6880095a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:25.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.427+0000 7fd69ce59740 1 --2- 172.21.15.53:0/2257120957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29622850 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd680103460 tx=0x7fd68010e1a0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.427+0000 7fd69ce59740 1 -- 172.21.15.53:0/2257120957 shutdown_connections 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.427+0000 7fd69ce59740 1 --2- 172.21.15.53:0/2257120957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2925c390 0x564f29622d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.427+0000 7fd69ce59740 1 --2- 172.21.15.53:0/2257120957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29622850 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.427+0000 7fd69ce59740 1 --2- 172.21.15.53:0/2257120957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f29622310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.427+0000 7fd69ce59740 1 -- 172.21.15.53:0/2257120957 >> 172.21.15.53:0/2257120957 conn(0x564f29271460 msgr2=0x564f29620200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.427+0000 7fd69ce59740 1 -- 172.21.15.53:0/2257120957 shutdown_connections 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.427+0000 7fd69ce59740 1 -- 172.21.15.53:0/2257120957 wait complete. 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd69ce59740 1 -- start start 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd69ce59740 1 Processor -- start 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29631e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2925c390 0x564f29632350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2927d070 0x564f2963ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd69ce59740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564f293eb700 con 0x564f292541b0 2024-08-31T06:08:25.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd69ce59740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564f2950f750 con 0x564f2925c390 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd69ce59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564f29634be0 con 0x564f2927d070 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd69ce59740 10 client.0 _ll_register_callbacks cb 0x564f2953ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd68ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29631e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd68ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29631e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35338/0 (socket says 172.21.15.53:35338) 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd68ffff640 1 -- 172.21.15.53:0/888016284 learned_addr learned my addr 172.21.15.53:0/888016284 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.428+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2925c390 0x564f29632350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd694e81640 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2927d070 0x564f2963ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd68ffff640 1 -- 172.21.15.53:0/888016284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2927d070 msgr2=0x564f2963ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd68ffff640 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2927d070 0x564f2963ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd68ffff640 1 -- 172.21.15.53:0/888016284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2925c390 msgr2=0x564f29632350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd68ffff640 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2925c390 0x564f29632350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd68ffff640 1 -- 172.21.15.53:0/888016284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f29548900 con 0x564f292541b0 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd694e81640 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2927d070 0x564f2963ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:25.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2925c390 0x564f29632350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd68ffff640 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29631e10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd6801035d0 tx=0x7fd680009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dccb4423d6c3e12 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd66f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd66f7fe640 1 -- 172.21.15.53:0/888016284 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680049030 con 0x564f292541b0 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd66f7fe640 1 -- 172.21.15.53:0/888016284 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd6801037a0 con 0x564f292541b0 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd69ce59740 1 -- 172.21.15.53:0/888016284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd680113070 con 0x564f292541b0 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd66f7fe640 1 -- 172.21.15.53:0/888016284 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd6800cbe10 con 0x564f292541b0 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd69ce59740 10 client.16818 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.429+0000 7fd69ce59740 1 -- 172.21.15.53:0/888016284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564f29640920 con 0x564f292541b0 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.430+0000 7fd66f7fe640 1 -- 172.21.15.53:0/888016284 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd680113070 con 0x564f292541b0 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.430+0000 7fd66f7fe640 1 -- 172.21.15.53:0/888016284 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd6800c8750 con 0x564f292541b0 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.430+0000 7fd69ce59740 10 client.16818 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.430+0000 7fd69ce59740 10 client.16818 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.430+0000 7fd69ce59740 20 client.16818 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:25.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.430+0000 7fd69ce59740 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564f2923b9f0 0x564f29643c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.430+0000 7fd69ce59740 4 client.16818 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:25.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.430+0000 7fd69ce59740 1 -- 172.21.15.53:0/888016284 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f2959b5d0 con 0x564f2923b9f0 2024-08-31T06:08:25.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.430+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564f2923b9f0 0x564f29643c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.431+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564f2923b9f0 0x564f29643c80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7a73516c6801d4b6 server_cookie=c89b920298b2da7c in_seq=0 out_seq=0 2024-08-31T06:08:25.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.431+0000 7fd66f7fe640 10 client.16818 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:08:25.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.431+0000 7fd66f7fe640 1 -- 172.21.15.53:0/888016284 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f2959b5d0 con 0x564f2923b9f0 2024-08-31T06:08:25.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.431+0000 7fd66f7fe640 10 client.16818 handle_command_reply: tid=0 2024-08-31T06:08:25.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 1 client.16818 shutdown 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 1 -- 172.21.15.53:0/888016284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 msgr2=0x564f29631e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29631e10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd6801035d0 tx=0x7fd680009260 comp rx=0 tx=0).stop 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 1 -- 172.21.15.53:0/888016284 shutdown_connections 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2927d070 0x564f2963ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2925c390 0x564f29632350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564f2923b9f0 0x564f29643c80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 1 --2- 172.21.15.53:0/888016284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29631e10 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd66f7fe640 0 client.16818 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 1 -- 172.21.15.53:0/888016284 >> 172.21.15.53:0/888016284 conn(0x564f29271460 msgr2=0x564f29625460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 1 -- 172.21.15.53:0/888016284 shutdown_connections 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 1 -- 172.21.15.53:0/888016284 wait complete. 2024-08-31T06:08:25.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.432+0000 7fd69ce59740 20 client.16818 trim_cache size 0 max 16384 2024-08-31T06:08:25.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.445+0000 7fd69ce59740 1 Processor -- start 2024-08-31T06:08:25.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.445+0000 7fd69ce59740 1 -- start start 2024-08-31T06:08:25.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f292541b0 0x564f296253b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f2925c390 0x564f296258f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f2962f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd69ce59740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901ad2d0 con 0x564f2925c390 2024-08-31T06:08:25.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd69ce59740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901aeed0 con 0x564f2927d070 2024-08-31T06:08:25.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd69ce59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901ad9a0 con 0x564f292541b0 2024-08-31T06:08:25.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd68f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f2925c390 0x564f296258f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd68f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f2925c390 0x564f296258f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35342/0 (socket says 172.21.15.53:35342) 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd68f7fe640 1 -- 172.21.15.53:0/1879145873 learned_addr learned my addr 172.21.15.53:0/1879145873 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd68ffff640 1 --2- 172.21.15.53:0/1879145873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f292541b0 0x564f296253b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd694e81640 1 --2- 172.21.15.53:0/1879145873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f2962f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd68f7fe640 1 -- 172.21.15.53:0/1879145873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f292541b0 msgr2=0x564f296253b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/1879145873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f292541b0 0x564f296253b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd68f7fe640 1 -- 172.21.15.53:0/1879145873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 msgr2=0x564f2962f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/1879145873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f2962f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd68f7fe640 1 -- 172.21.15.53:0/1879145873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f2961b5a0 con 0x564f2925c390 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd694e81640 1 --2- 172.21.15.53:0/1879145873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f2962f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.446+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/1879145873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f2925c390 0x564f296258f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x564f296441c0 tx=0x7fd684013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988557f1d28ea9f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.447+0000 7fd675ffb640 1 -- 172.21.15.53:0/1879145873 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840130d0 con 0x564f2925c390 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.447+0000 7fd675ffb640 1 -- 172.21.15.53:0/1879145873 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd684013270 con 0x564f2925c390 2024-08-31T06:08:25.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.447+0000 7fd675ffb640 1 -- 172.21.15.53:0/1879145873 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684003d10 con 0x564f2925c390 2024-08-31T06:08:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.447+0000 7fd69ce59740 1 -- 172.21.15.53:0/1879145873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f2925c390 msgr2=0x564f296258f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.447+0000 7fd69ce59740 1 --2- 172.21.15.53:0/1879145873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f2925c390 0x564f296258f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x564f296441c0 tx=0x7fd684013830 comp rx=0 tx=0).stop 2024-08-31T06:08:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.447+0000 7fd69ce59740 1 -- 172.21.15.53:0/1879145873 shutdown_connections 2024-08-31T06:08:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.447+0000 7fd69ce59740 1 --2- 172.21.15.53:0/1879145873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f2962f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.447+0000 7fd69ce59740 1 --2- 172.21.15.53:0/1879145873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f2925c390 0x564f296258f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.447+0000 7fd69ce59740 1 --2- 172.21.15.53:0/1879145873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f292541b0 0x564f296253b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.447+0000 7fd69ce59740 1 -- 172.21.15.53:0/1879145873 >> 172.21.15.53:0/1879145873 conn(0x564f29271460 msgr2=0x564f29630690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:25.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.448+0000 7fd69ce59740 1 -- 172.21.15.53:0/1879145873 shutdown_connections 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.448+0000 7fd69ce59740 1 -- 172.21.15.53:0/1879145873 wait complete. 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.448+0000 7fd69ce59740 1 -- start start 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.448+0000 7fd69ce59740 1 Processor -- start 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.448+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29636100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.448+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2925c390 0x564f29636640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.448+0000 7fd69ce59740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f296ad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.448+0000 7fd69ce59740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901ae740 con 0x564f292541b0 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.448+0000 7fd69ce59740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901ae070 con 0x564f2927d070 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.448+0000 7fd69ce59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901ab2b0 con 0x564f2925c390 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd69ce59740 10 client.0 _ll_register_callbacks cb 0x7fd688009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd68ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29636100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd68ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29636100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35350/0 (socket says 172.21.15.53:35350) 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd68ffff640 1 -- 172.21.15.53:0/3982266359 learned_addr learned my addr 172.21.15.53:0/3982266359 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2925c390 0x564f29636640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd68ffff640 1 -- 172.21.15.53:0/3982266359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2925c390 msgr2=0x564f29636640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd694e81640 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f296ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd68ffff640 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2925c390 0x564f29636640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd68ffff640 1 -- 172.21.15.53:0/3982266359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 msgr2=0x564f296ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd68ffff640 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f296ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd68ffff640 1 -- 172.21.15.53:0/3982266359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f29636ec0 con 0x564f292541b0 2024-08-31T06:08:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd694e81640 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f296ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd68ffff640 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29636100 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd6800c8540 tx=0x7fd6801039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6eb279b157dc63 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd66f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd66f7fe640 1 -- 172.21.15.53:0/3982266359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680049030 con 0x564f292541b0 2024-08-31T06:08:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd66f7fe640 1 -- 172.21.15.53:0/3982266359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd680109430 con 0x564f292541b0 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd69ce59740 1 -- 172.21.15.53:0/3982266359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd684013270 con 0x564f292541b0 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd66f7fe640 1 -- 172.21.15.53:0/3982266359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd6800f3040 con 0x564f292541b0 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd69ce59740 10 client.16824 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.449+0000 7fd69ce59740 1 -- 172.21.15.53:0/3982266359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564f296ae910 con 0x564f292541b0 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.450+0000 7fd66f7fe640 1 -- 172.21.15.53:0/3982266359 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd684013270 con 0x564f292541b0 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.450+0000 7fd66f7fe640 1 -- 172.21.15.53:0/3982266359 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd6801096f0 con 0x564f292541b0 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.450+0000 7fd69ce59740 10 client.16824 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.450+0000 7fd69ce59740 10 client.16824 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.450+0000 7fd69ce59740 20 client.16824 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.450+0000 7fd69ce59740 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564f29210da0 0x564f296b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.450+0000 7fd69ce59740 4 client.16824 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.450+0000 7fd69ce59740 1 -- 172.21.15.53:0/3982266359 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f29597070 con 0x564f29210da0 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.450+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564f29210da0 0x564f296b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd66f7fe640 10 client.16824 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:08:25.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd68f7fe640 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564f29210da0 0x564f296b0d70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d38ae89f3b344616 server_cookie=30b3950a792e29ca in_seq=0 out_seq=0 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd66f7fe640 1 -- 172.21.15.53:0/3982266359 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564f29597070 con 0x564f29210da0 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd66f7fe640 10 client.16824 handle_command_reply: tid=0 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 1 client.16824 shutdown 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 1 -- 172.21.15.53:0/3982266359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 msgr2=0x564f29636100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29636100 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd6800c8540 tx=0x7fd6801039d0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 1 -- 172.21.15.53:0/3982266359 shutdown_connections 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f2927d070 0x564f296ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f2925c390 0x564f29636640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564f29210da0 0x564f296b0d70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 1 --2- 172.21.15.53:0/3982266359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f292541b0 0x564f29636100 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd66f7fe640 0 client.16824 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 1 -- 172.21.15.53:0/3982266359 >> 172.21.15.53:0/3982266359 conn(0x564f29271460 msgr2=0x564f29630290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 1 -- 172.21.15.53:0/3982266359 shutdown_connections 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 1 -- 172.21.15.53:0/3982266359 wait complete. 2024-08-31T06:08:25.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.451+0000 7fd69ce59740 20 client.16824 trim_cache size 0 max 16384 2024-08-31T06:08:25.459 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:08:25.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 -- 172.21.15.53:0/2270191397 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6780b4ca0 msgr2=0x7fd6780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:25.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6780b4ca0 0x7fd6780b71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd688005fd0 tx=0x7fd6880095a0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 -- 172.21.15.53:0/2270191397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690102880 msgr2=0x7fd69019a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:25.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690102880 0x7fd69019a290 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd680009230 tx=0x7fd680004270 comp rx=0 tx=0).stop 2024-08-31T06:08:25.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 -- 172.21.15.53:0/2270191397 shutdown_connections 2024-08-31T06:08:25.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6780b4ca0 0x7fd6780b71b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd690108b10 0x7fd69019fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6901081c0 0x7fd69019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 --2- 172.21.15.53:0/2270191397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd690102880 0x7fd69019a290 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:25.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 -- 172.21.15.53:0/2270191397 >> 172.21.15.53:0/2270191397 conn(0x7fd690079510 msgr2=0x7fd6901019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:25.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 -- 172.21.15.53:0/2270191397 shutdown_connections 2024-08-31T06:08:25.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:25.452+0000 7fd6968e4640 1 -- 172.21.15.53:0/2270191397 wait complete. 2024-08-31T06:08:25.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.51 MB/sec execute 15 sec latency 7624.343 ms 2024-08-31T06:08:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:25 smithi130 ceph-mon[22266]: pgmap v427: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 428 KiB/s wr, 60 op/s 2024-08-31T06:08:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:25 smithi153 ceph-mon[22320]: pgmap v427: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 428 KiB/s wr, 60 op/s 2024-08-31T06:08:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:25 smithi053 ceph-mon[18924]: pgmap v427: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 428 KiB/s wr, 60 op/s 2024-08-31T06:08:26.264 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:08:26.517 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:26.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.48 MB/sec execute 16 sec latency 8624.378 ms 2024-08-31T06:08:27.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.011+0000 7fa663972640 1 -- 172.21.15.53:0/2034093928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa65c109b90 msgr2=0x7fa65c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:27.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.011+0000 7fa663972640 1 --2- 172.21.15.53:0/2034093928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa65c109b90 0x7fa65c1103c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa654009ca0 tx=0x7fa65402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.011+0000 7fa663972640 1 -- 172.21.15.53:0/2034093928 shutdown_connections 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.011+0000 7fa663972640 1 --2- 172.21.15.53:0/2034093928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa65c109b90 0x7fa65c1103c0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.011+0000 7fa663972640 1 --2- 172.21.15.53:0/2034093928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c109240 0x7fa65c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.011+0000 7fa663972640 1 --2- 172.21.15.53:0/2034093928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa65c103900 0x7fa65c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.011+0000 7fa663972640 1 -- 172.21.15.53:0/2034093928 >> 172.21.15.53:0/2034093928 conn(0x7fa65c07b5f0 msgr2=0x7fa65c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.012+0000 7fa663972640 1 -- 172.21.15.53:0/2034093928 shutdown_connections 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.012+0000 7fa663972640 1 -- 172.21.15.53:0/2034093928 wait complete. 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.012+0000 7fa663972640 1 Processor -- start 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.012+0000 7fa663972640 1 -- start start 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.012+0000 7fa663972640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa65c103900 0x7fa65c19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.012+0000 7fa663972640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c109240 0x7fa65c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa663972640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa65c109b90 0x7fa65c19f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa663972640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c113750 con 0x7fa65c103900 2024-08-31T06:08:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa663972640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c1135d0 con 0x7fa65c109b90 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa663972640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c1138d0 con 0x7fa65c109240 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa66170e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa65c103900 0x7fa65c19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa66170e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa65c103900 0x7fa65c19a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35378/0 (socket says 172.21.15.53:35378) 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa66170e640 1 -- 172.21.15.53:0/136094870 learned_addr learned my addr 172.21.15.53:0/136094870 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa660f0d640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c109240 0x7fa65c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa661f0f640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa65c109b90 0x7fa65c19f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa66170e640 1 -- 172.21.15.53:0/136094870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c109240 msgr2=0x7fa65c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa66170e640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c109240 0x7fa65c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa66170e640 1 -- 172.21.15.53:0/136094870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa65c109b90 msgr2=0x7fa65c19f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa66170e640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa65c109b90 0x7fa65c19f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa66170e640 1 -- 172.21.15.53:0/136094870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65c1a00b0 con 0x7fa65c103900 2024-08-31T06:08:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa661f0f640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa65c109b90 0x7fa65c19f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa66170e640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa65c103900 0x7fa65c19a140 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa65800d950 tx=0x7fa65800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa6527fc640 1 -- 172.21.15.53:0/136094870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658017070 con 0x7fa65c103900 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa6527fc640 1 -- 172.21.15.53:0/136094870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa658009c30 con 0x7fa65c103900 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa6527fc640 1 -- 172.21.15.53:0/136094870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65800f620 con 0x7fa65c103900 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa663972640 1 -- 172.21.15.53:0/136094870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65c1a03a0 con 0x7fa65c103900 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.013+0000 7fa663972640 1 -- 172.21.15.53:0/136094870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa65c1a6b00 con 0x7fa65c103900 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.016+0000 7fa6527fc640 1 -- 172.21.15.53:0/136094870 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa658010460 con 0x7fa65c103900 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.016+0000 7fa669ee7740 1 Processor -- start 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.016+0000 7fa669ee7740 1 -- start start 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.016+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df38c6070 0x557df3c6b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.016+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 0x557df3c6b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.016+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c6bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa669ee7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557df3be2680 con 0x557df38a5390 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa669ee7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557df3bd1c10 con 0x557df389d1b0 2024-08-31T06:08:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa669ee7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557df3bd5bc0 con 0x557df38c6070 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa660f0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c6bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa660f0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c6bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35384/0 (socket says 172.21.15.53:35384) 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa661f0f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df38c6070 0x557df3c6b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa660f0d640 1 -- 172.21.15.53:0/2098572097 learned_addr learned my addr 172.21.15.53:0/2098572097 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa66170e640 1 --2- 172.21.15.53:0/2098572097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 0x557df3c6b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa6527fc640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6480b4ca0 0x7fa6480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa660f0d640 1 -- 172.21.15.53:0/2098572097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df38c6070 msgr2=0x557df3c6b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa660f0d640 1 --2- 172.21.15.53:0/2098572097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df38c6070 0x557df3c6b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa660f0d640 1 -- 172.21.15.53:0/2098572097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 msgr2=0x557df3c6b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa660f0d640 1 --2- 172.21.15.53:0/2098572097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 0x557df3c6b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa660f0d640 1 -- 172.21.15.53:0/2098572097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557df3931650 con 0x557df38a5390 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa66170e640 1 --2- 172.21.15.53:0/2098572097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 0x557df3c6b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa661f0f640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6480b4ca0 0x7fa6480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa6527fc640 1 -- 172.21.15.53:0/136094870 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa6580e52a0 con 0x7fa65c103900 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.017+0000 7fa660f0d640 1 --2- 172.21.15.53:0/2098572097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c6bd90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00dba0 tx=0x7fa64c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f296a1e734c6f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.018+0000 7fa6477fe640 1 -- 172.21.15.53:0/2098572097 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c00de90 con 0x557df38a5390 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.018+0000 7fa6477fe640 1 -- 172.21.15.53:0/2098572097 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa64c0054b0 con 0x557df38a5390 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.018+0000 7fa6477fe640 1 -- 172.21.15.53:0/2098572097 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c011440 con 0x557df38a5390 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.018+0000 7fa669ee7740 1 -- 172.21.15.53:0/2098572097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 msgr2=0x557df3c6bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.018+0000 7fa661f0f640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6480b4ca0 0x7fa6480b71b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa654004af0 tx=0x7fa6540095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.018+0000 7fa669ee7740 1 --2- 172.21.15.53:0/2098572097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c6bd90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00dba0 tx=0x7fa64c00f730 comp rx=0 tx=0).stop 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.019+0000 7fa669ee7740 1 -- 172.21.15.53:0/2098572097 shutdown_connections 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.019+0000 7fa669ee7740 1 --2- 172.21.15.53:0/2098572097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c6bd90 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.019+0000 7fa669ee7740 1 --2- 172.21.15.53:0/2098572097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 0x557df3c6b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.019+0000 7fa669ee7740 1 --2- 172.21.15.53:0/2098572097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df38c6070 0x557df3c6b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.019+0000 7fa669ee7740 1 -- 172.21.15.53:0/2098572097 >> 172.21.15.53:0/2098572097 conn(0x557df38ba460 msgr2=0x557df3c69200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.019+0000 7fa669ee7740 1 -- 172.21.15.53:0/2098572097 shutdown_connections 2024-08-31T06:08:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.019+0000 7fa669ee7740 1 -- 172.21.15.53:0/2098572097 wait complete. 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.019+0000 7fa669ee7740 1 -- start start 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.019+0000 7fa669ee7740 1 Processor -- start 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df389d1b0 0x557df3c76a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df38a5390 0x557df3c76f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c82e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa669ee7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557df3a34700 con 0x557df38c6070 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa669ee7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557df3b58750 con 0x557df38a5390 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa669ee7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557df3c79af0 con 0x557df389d1b0 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa669ee7740 10 client.0 _ll_register_callbacks cb 0x557df3b87e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa661f0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c82e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa661f0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c82e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35398/0 (socket says 172.21.15.53:35398) 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa661f0f640 1 -- 172.21.15.53:0/1209931673 learned_addr learned my addr 172.21.15.53:0/1209931673 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa66170e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df389d1b0 0x557df3c76a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa660f0d640 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df38a5390 0x557df3c76f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa661f0f640 1 -- 172.21.15.53:0/1209931673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df389d1b0 msgr2=0x557df3c76a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa661f0f640 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df389d1b0 0x557df3c76a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa661f0f640 1 -- 172.21.15.53:0/1209931673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df38a5390 msgr2=0x557df3c76f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa661f0f640 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df38a5390 0x557df3c76f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa661f0f640 1 -- 172.21.15.53:0/1209931673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557df3b91900 con 0x557df38c6070 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa661f0f640 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c82e10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa654009ca0 tx=0x7fa65402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177ff96f47a2827d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa644ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa644ff9640 1 -- 172.21.15.53:0/1209931673 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6540305c0 con 0x557df38c6070 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa644ff9640 1 -- 172.21.15.53:0/1209931673 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa654030760 con 0x557df38c6070 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.020+0000 7fa669ee7740 1 -- 172.21.15.53:0/1209931673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa64c0054b0 con 0x557df38c6070 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa644ff9640 1 -- 172.21.15.53:0/1209931673 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa654030960 con 0x557df38c6070 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa669ee7740 10 client.16836 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa669ee7740 1 -- 172.21.15.53:0/1209931673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557df3c858b0 con 0x557df38c6070 2024-08-31T06:08:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa644ff9640 1 -- 172.21.15.53:0/1209931673 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa64c0054b0 con 0x557df38c6070 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa644ff9640 1 -- 172.21.15.53:0/1209931673 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa65405ba30 con 0x557df38c6070 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa669ee7740 10 client.16836 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa669ee7740 10 client.16836 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa669ee7740 20 client.16836 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa669ee7740 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x557df38849f0 0x557df3c88da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa669ee7740 4 client.16836 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa669ee7740 1 -- 172.21.15.53:0/1209931673 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557df3be45d0 con 0x557df38849f0 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.021+0000 7fa66170e640 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x557df38849f0 0x557df3c88da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.022+0000 7fa66170e640 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x557df38849f0 0x557df3c88da0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5416868d555eaa41 server_cookie=cbfa2bbe7ab68249 in_seq=0 out_seq=0 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.022+0000 7fa644ff9640 10 client.16836 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa644ff9640 1 -- 172.21.15.53:0/1209931673 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557df3be45d0 con 0x557df38849f0 2024-08-31T06:08:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa644ff9640 10 client.16836 handle_command_reply: tid=0 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 1 client.16836 shutdown 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 1 -- 172.21.15.53:0/1209931673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 msgr2=0x557df3c82e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c82e10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa654009ca0 tx=0x7fa65402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 1 -- 172.21.15.53:0/1209931673 shutdown_connections 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x557df38849f0 0x557df3c88da0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c82e10 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df38a5390 0x557df3c76f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 1 --2- 172.21.15.53:0/1209931673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df389d1b0 0x557df3c76a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 1 -- 172.21.15.53:0/1209931673 >> 172.21.15.53:0/1209931673 conn(0x557df38ba460 msgr2=0x557df3c6e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa644ff9640 0 client.16836 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 1 -- 172.21.15.53:0/1209931673 shutdown_connections 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 1 -- 172.21.15.53:0/1209931673 wait complete. 2024-08-31T06:08:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.023+0000 7fa669ee7740 20 client.16836 trim_cache size 0 max 16384 2024-08-31T06:08:27.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.037+0000 7fa669ee7740 1 Processor -- start 2024-08-31T06:08:27.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.037+0000 7fa669ee7740 1 -- start start 2024-08-31T06:08:27.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 0x557df3c69230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c82d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df38c6070 0x557df3c73c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa669ee7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c1af420 con 0x557df38a5390 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa669ee7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c1b1020 con 0x557df389d1b0 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa669ee7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c1afaf0 con 0x557df38c6070 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa660f0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c82d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa660f0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c82d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35410/0 (socket says 172.21.15.53:35410) 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa660f0d640 1 -- 172.21.15.53:0/214597918 learned_addr learned my addr 172.21.15.53:0/214597918 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa66170e640 1 --2- 172.21.15.53:0/214597918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 0x557df3c69230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa661f0f640 1 --2- 172.21.15.53:0/214597918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df38c6070 0x557df3c73c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa660f0d640 1 -- 172.21.15.53:0/214597918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df38c6070 msgr2=0x557df3c73c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:27.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa660f0d640 1 --2- 172.21.15.53:0/214597918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df38c6070 0x557df3c73c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa660f0d640 1 -- 172.21.15.53:0/214597918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 msgr2=0x557df3c69230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa660f0d640 1 --2- 172.21.15.53:0/214597918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 0x557df3c69230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa660f0d640 1 -- 172.21.15.53:0/214597918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557df3c74f50 con 0x557df38a5390 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa661f0f640 1 --2- 172.21.15.53:0/214597918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df38c6070 0x557df3c73c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa66170e640 1 --2- 172.21.15.53:0/214597918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 0x557df3c69230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.038+0000 7fa660f0d640 1 --2- 172.21.15.53:0/214597918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c82d10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00dac0 tx=0x7fa64c00d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf9325b5acf285c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.039+0000 7fa646ffd640 1 -- 172.21.15.53:0/214597918 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c02b070 con 0x557df38a5390 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.039+0000 7fa646ffd640 1 -- 172.21.15.53:0/214597918 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa64c011440 con 0x557df38a5390 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.039+0000 7fa646ffd640 1 -- 172.21.15.53:0/214597918 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c004e70 con 0x557df38a5390 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.040+0000 7fa669ee7740 1 -- 172.21.15.53:0/214597918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 msgr2=0x557df3c82d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.040+0000 7fa669ee7740 1 --2- 172.21.15.53:0/214597918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c82d10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00dac0 tx=0x7fa64c00d880 comp rx=0 tx=0).stop 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.040+0000 7fa669ee7740 1 -- 172.21.15.53:0/214597918 shutdown_connections 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.040+0000 7fa669ee7740 1 --2- 172.21.15.53:0/214597918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df38c6070 0x557df3c73c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.040+0000 7fa669ee7740 1 --2- 172.21.15.53:0/214597918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38a5390 0x557df3c82d10 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.040+0000 7fa669ee7740 1 --2- 172.21.15.53:0/214597918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df389d1b0 0x557df3c69230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.040+0000 7fa669ee7740 1 -- 172.21.15.53:0/214597918 >> 172.21.15.53:0/214597918 conn(0x557df38ba460 msgr2=0x557df3c68b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.040+0000 7fa669ee7740 1 -- 172.21.15.53:0/214597918 shutdown_connections 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.040+0000 7fa669ee7740 1 -- 172.21.15.53:0/214597918 wait complete. 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.040+0000 7fa669ee7740 1 -- start start 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.040+0000 7fa669ee7740 1 Processor -- start 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df389d1b0 0x557df3c7adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df38a5390 0x557df3c7b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa669ee7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c7b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa669ee7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c1b0890 con 0x557df38c6070 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa669ee7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c1b01c0 con 0x557df38a5390 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa669ee7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c1ad400 con 0x557df389d1b0 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa669ee7740 10 client.0 _ll_register_callbacks cb 0x7fa654031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:27.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa661f0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c7b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa661f0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c7b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35424/0 (socket says 172.21.15.53:35424) 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa661f0f640 1 -- 172.21.15.53:0/418215380 learned_addr learned my addr 172.21.15.53:0/418215380 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa66170e640 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df389d1b0 0x557df3c7adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa660f0d640 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df38a5390 0x557df3c7b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa661f0f640 1 -- 172.21.15.53:0/418215380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df389d1b0 msgr2=0x557df3c7adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa661f0f640 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df389d1b0 0x557df3c7adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa661f0f640 1 -- 172.21.15.53:0/418215380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df38a5390 msgr2=0x557df3c7b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa661f0f640 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df38a5390 0x557df3c7b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa661f0f640 1 -- 172.21.15.53:0/418215380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557df3cf2850 con 0x557df38c6070 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa661f0f640 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c7b870 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa654009bf0 tx=0x7fa654031da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e2757e2d971d12 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa644ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.041+0000 7fa644ff9640 1 -- 172.21.15.53:0/418215380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654030b00 con 0x557df38c6070 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa644ff9640 1 -- 172.21.15.53:0/418215380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa654030ca0 con 0x557df38c6070 2024-08-31T06:08:27.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa669ee7740 1 -- 172.21.15.53:0/418215380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa64c011440 con 0x557df38c6070 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa644ff9640 1 -- 172.21.15.53:0/418215380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa654068050 con 0x557df38c6070 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa669ee7740 10 client.16842 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa669ee7740 1 -- 172.21.15.53:0/418215380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557df3cf3ad0 con 0x557df38c6070 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa644ff9640 1 -- 172.21.15.53:0/418215380 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa64c011440 con 0x557df38c6070 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa644ff9640 1 -- 172.21.15.53:0/418215380 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa654048730 con 0x557df38c6070 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa669ee7740 10 client.16842 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa669ee7740 10 client.16842 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa669ee7740 20 client.16842 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa669ee7740 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x557df3859da0 0x557df3cf6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa669ee7740 4 client.16842 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.042+0000 7fa669ee7740 1 -- 172.21.15.53:0/418215380 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557df3be0070 con 0x557df3859da0 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa66170e640 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x557df3859da0 0x557df3cf6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa644ff9640 10 client.16842 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:08:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa66170e640 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x557df3859da0 0x557df3cf6300 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8bf5c14f36f7a8f1 server_cookie=af5746a258625385 in_seq=0 out_seq=0 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa644ff9640 1 -- 172.21.15.53:0/418215380 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557df3be0070 con 0x557df3859da0 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa644ff9640 10 client.16842 handle_command_reply: tid=0 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa669ee7740 1 client.16842 shutdown 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa669ee7740 1 -- 172.21.15.53:0/418215380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 msgr2=0x557df3c7b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa669ee7740 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c7b870 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa654009bf0 tx=0x7fa654031da0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa669ee7740 1 -- 172.21.15.53:0/418215380 shutdown_connections 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa669ee7740 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x557df3859da0 0x557df3cf6300 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa669ee7740 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557df38c6070 0x557df3c7b870 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa669ee7740 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557df38a5390 0x557df3c7b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa669ee7740 1 --2- 172.21.15.53:0/418215380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557df389d1b0 0x557df3c7adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa669ee7740 1 -- 172.21.15.53:0/418215380 >> 172.21.15.53:0/418215380 conn(0x557df38ba460 msgr2=0x557df3c77e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.043+0000 7fa644ff9640 0 client.16842 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa669ee7740 1 -- 172.21.15.53:0/418215380 shutdown_connections 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa669ee7740 1 -- 172.21.15.53:0/418215380 wait complete. 2024-08-31T06:08:27.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa669ee7740 20 client.16842 trim_cache size 0 max 16384 2024-08-31T06:08:27.053 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:08:27.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa663972640 1 -- 172.21.15.53:0/136094870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6480b4ca0 msgr2=0x7fa6480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:27.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa663972640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6480b4ca0 0x7fa6480b71b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa654004af0 tx=0x7fa6540095c0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa663972640 1 -- 172.21.15.53:0/136094870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa65c103900 msgr2=0x7fa65c19a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:27.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa663972640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa65c103900 0x7fa65c19a140 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa65800d950 tx=0x7fa65800de10 comp rx=0 tx=0).stop 2024-08-31T06:08:27.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa663972640 1 -- 172.21.15.53:0/136094870 shutdown_connections 2024-08-31T06:08:27.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa663972640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6480b4ca0 0x7fa6480b71b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa663972640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa65c109b90 0x7fa65c19f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa663972640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa65c109240 0x7fa65c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa663972640 1 --2- 172.21.15.53:0/136094870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa65c103900 0x7fa65c19a140 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:27.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.044+0000 7fa663972640 1 -- 172.21.15.53:0/136094870 >> 172.21.15.53:0/136094870 conn(0x7fa65c07b5f0 msgr2=0x7fa65c105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:27.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.045+0000 7fa663972640 1 -- 172.21.15.53:0/136094870 shutdown_connections 2024-08-31T06:08:27.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:27.045+0000 7fa663972640 1 -- 172.21.15.53:0/136094870 wait complete. 2024-08-31T06:08:27.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.45 MB/sec execute 17 sec latency 9624.465 ms 2024-08-31T06:08:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:27 smithi130 ceph-mon[22266]: pgmap v428: 97 pgs: 97 active+clean; 38 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 428 KiB/s wr, 59 op/s 2024-08-31T06:08:28.142 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:27 smithi053 ceph-mon[18924]: pgmap v428: 97 pgs: 97 active+clean; 38 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 428 KiB/s wr, 59 op/s 2024-08-31T06:08:28.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:27 smithi153 ceph-mon[22320]: pgmap v428: 97 pgs: 97 active+clean; 38 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 428 KiB/s wr, 59 op/s 2024-08-31T06:08:28.178 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:08:28.440 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:28.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.887+0000 7f32e01a7640 1 -- 172.21.15.53:0/3246238924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32d8109c60 msgr2=0x7f32d8110490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:28.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.887+0000 7f32e01a7640 1 --2- 172.21.15.53:0/3246238924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32d8109c60 0x7f32d8110490 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009ca0 tx=0x7f32d002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.887+0000 7f32e01a7640 1 -- 172.21.15.53:0/3246238924 shutdown_connections 2024-08-31T06:08:28.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.887+0000 7f32e01a7640 1 --2- 172.21.15.53:0/3246238924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32d8109c60 0x7f32d8110490 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.887+0000 7f32e01a7640 1 --2- 172.21.15.53:0/3246238924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32d8109310 0x7f32d8109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.887+0000 7f32e01a7640 1 --2- 172.21.15.53:0/3246238924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d81039d0 0x7f32d8103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.887+0000 7f32e01a7640 1 -- 172.21.15.53:0/3246238924 >> 172.21.15.53:0/3246238924 conn(0x7f32d807b670 msgr2=0x7f32d807ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.887+0000 7f32e01a7640 1 -- 172.21.15.53:0/3246238924 shutdown_connections 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.887+0000 7f32e01a7640 1 -- 172.21.15.53:0/3246238924 wait complete. 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.888+0000 7f32e01a7640 1 Processor -- start 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.888+0000 7f32e01a7640 1 -- start start 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.888+0000 7f32e01a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32d81039d0 0x7f32d819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.888+0000 7f32e01a7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d8109310 0x7f32d819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.888+0000 7f32e01a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32d8109c60 0x7f32d819f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.888+0000 7f32e01a7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32d8113780 con 0x7f32d8109c60 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.888+0000 7f32e01a7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32d8113600 con 0x7f32d81039d0 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.888+0000 7f32e01a7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32d8113900 con 0x7f32d8109310 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32de744640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32d8109c60 0x7f32d819f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32de744640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32d8109c60 0x7f32d819f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35442/0 (socket says 172.21.15.53:35442) 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32de744640 1 -- 172.21.15.53:0/3773124799 learned_addr learned my addr 172.21.15.53:0/3773124799 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32ddf43640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32d81039d0 0x7f32d819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32dd742640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d8109310 0x7f32d819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32de744640 1 -- 172.21.15.53:0/3773124799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d8109310 msgr2=0x7f32d819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32de744640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d8109310 0x7f32d819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32de744640 1 -- 172.21.15.53:0/3773124799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32d81039d0 msgr2=0x7f32d819a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32de744640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32d81039d0 0x7f32d819a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32de744640 1 -- 172.21.15.53:0/3773124799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d81a00a0 con 0x7f32d8109c60 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32de744640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32d8109c60 0x7f32d819f970 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f32d0005cc0 tx=0x7f32d0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32ceffd640 1 -- 172.21.15.53:0/3773124799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0032c10 con 0x7f32d8109c60 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32e01a7640 1 -- 172.21.15.53:0/3773124799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d81a0330 con 0x7f32d8109c60 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32ceffd640 1 -- 172.21.15.53:0/3773124799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32d0032db0 con 0x7f32d8109c60 2024-08-31T06:08:28.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32ceffd640 1 -- 172.21.15.53:0/3773124799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0030a60 con 0x7f32d8109c60 2024-08-31T06:08:28.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.889+0000 7f32e01a7640 1 -- 172.21.15.53:0/3773124799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d81a6af0 con 0x7f32d8109c60 2024-08-31T06:08:28.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.892+0000 7f32e671c740 1 Processor -- start 2024-08-31T06:08:28.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.892+0000 7f32ceffd640 1 -- 172.21.15.53:0/3773124799 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f32d0030c00 con 0x7f32d8109c60 2024-08-31T06:08:28.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.892+0000 7f32e671c740 1 -- start start 2024-08-31T06:08:28.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.892+0000 7f32e671c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078e008070 0x56078e3ad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.892+0000 7f32e671c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078dfdf1b0 0x56078e3ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.892+0000 7f32e671c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3add90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.892+0000 7f32e671c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56078e324680 con 0x56078dfe7390 2024-08-31T06:08:28.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.892+0000 7f32e671c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56078e313c10 con 0x56078e008070 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.892+0000 7f32e671c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56078e317bc0 con 0x56078dfdf1b0 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32dd742640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32dd742640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35444/0 (socket says 172.21.15.53:35444) 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32dd742640 1 -- 172.21.15.53:0/784842683 learned_addr learned my addr 172.21.15.53:0/784842683 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32ddf43640 1 --2- 172.21.15.53:0/784842683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078dfdf1b0 0x56078e3ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32dd742640 1 --2- 172.21.15.53:0/784842683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078e008070 0x56078e3ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32dd742640 1 -- 172.21.15.53:0/784842683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078dfdf1b0 msgr2=0x56078e3ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32dd742640 1 --2- 172.21.15.53:0/784842683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078dfdf1b0 0x56078e3ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32dd742640 1 -- 172.21.15.53:0/784842683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078e008070 msgr2=0x56078e3ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32dd742640 1 --2- 172.21.15.53:0/784842683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078e008070 0x56078e3ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32dd742640 1 -- 172.21.15.53:0/784842683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078e073650 con 0x56078dfe7390 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32ceffd640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32c40b4ca0 0x7f32c40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32ddf43640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32c40b4ca0 0x7f32c40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32dd742640 1 --2- 172.21.15.53:0/784842683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3add90 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009fb0 tx=0x7f32c8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fac0e4033098f79 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32ceffd640 1 -- 172.21.15.53:0/3773124799 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f32d01067e0 con 0x7f32d8109c60 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32c3fff640 1 -- 172.21.15.53:0/784842683 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8004050 con 0x56078dfe7390 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32c3fff640 1 -- 172.21.15.53:0/784842683 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32c80035f0 con 0x56078dfe7390 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.893+0000 7f32c3fff640 1 -- 172.21.15.53:0/784842683 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c801d620 con 0x56078dfe7390 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.894+0000 7f32e671c740 1 -- 172.21.15.53:0/784842683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 msgr2=0x56078e3add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.894+0000 7f32e671c740 1 --2- 172.21.15.53:0/784842683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3add90 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009fb0 tx=0x7f32c8005850 comp rx=0 tx=0).stop 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.894+0000 7f32ddf43640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32c40b4ca0 0x7f32c40b71b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x56078e3abf90 tx=0x7f32d4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.894+0000 7f32e671c740 1 -- 172.21.15.53:0/784842683 shutdown_connections 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.894+0000 7f32e671c740 1 --2- 172.21.15.53:0/784842683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3add90 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.894+0000 7f32e671c740 1 --2- 172.21.15.53:0/784842683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078dfdf1b0 0x56078e3ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.894+0000 7f32e671c740 1 --2- 172.21.15.53:0/784842683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078e008070 0x56078e3ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.894+0000 7f32e671c740 1 -- 172.21.15.53:0/784842683 >> 172.21.15.53:0/784842683 conn(0x56078dffc460 msgr2=0x56078e3ab200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.895+0000 7f32e671c740 1 -- 172.21.15.53:0/784842683 shutdown_connections 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.895+0000 7f32e671c740 1 -- 172.21.15.53:0/784842683 wait complete. 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.895+0000 7f32e671c740 1 -- start start 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.895+0000 7f32e671c740 1 Processor -- start 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32e671c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 0x56078e3b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32e671c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32e671c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078e008070 0x56078e3c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32e671c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56078e176700 con 0x56078dfe7390 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32e671c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56078e29a750 con 0x56078dfdf1b0 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32e671c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56078e3bbaf0 con 0x56078e008070 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32e671c740 10 client.0 _ll_register_callbacks cb 0x56078e2c9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32dd742640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3b8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32dd742640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3b8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35450/0 (socket says 172.21.15.53:35450) 2024-08-31T06:08:28.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32dd742640 1 -- 172.21.15.53:0/1251129815 learned_addr learned my addr 172.21.15.53:0/1251129815 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32de744640 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078e008070 0x56078e3c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32ddf43640 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 0x56078e3b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32dd742640 1 -- 172.21.15.53:0/1251129815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078e008070 msgr2=0x56078e3c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32dd742640 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078e008070 0x56078e3c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32dd742640 1 -- 172.21.15.53:0/1251129815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 msgr2=0x56078e3b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32dd742640 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 0x56078e3b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32dd742640 1 -- 172.21.15.53:0/1251129815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56078e2d3900 con 0x56078dfe7390 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32ddf43640 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 0x56078e3b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32dd742640 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3b8fb0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f32c8005bc0 tx=0x7f32c8003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406fdb54dd92ec9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.896+0000 7f32c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32c17fa640 1 -- 172.21.15.53:0/1251129815 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8004400 con 0x56078dfe7390 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32e671c740 1 -- 172.21.15.53:0/1251129815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32c80035f0 con 0x56078dfe7390 2024-08-31T06:08:28.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32c17fa640 1 -- 172.21.15.53:0/1251129815 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f32c8005050 con 0x56078dfe7390 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32c17fa640 1 -- 172.21.15.53:0/1251129815 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f32c802f050 con 0x56078dfe7390 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32e671c740 10 client.16854 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32e671c740 1 -- 172.21.15.53:0/1251129815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56078e3c7900 con 0x56078dfe7390 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32c17fa640 1 -- 172.21.15.53:0/1251129815 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32c80035f0 con 0x56078dfe7390 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32c17fa640 1 -- 172.21.15.53:0/1251129815 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f32c801e410 con 0x56078dfe7390 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32e671c740 10 client.16854 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32e671c740 10 client.16854 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32e671c740 20 client.16854 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32e671c740 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56078dfc69f0 0x56078e3cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32e671c740 4 client.16854 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.897+0000 7f32e671c740 1 -- 172.21.15.53:0/1251129815 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56078e3265d0 con 0x56078dfc69f0 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.898+0000 7f32ddf43640 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56078dfc69f0 0x56078e3cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.898+0000 7f32c17fa640 10 client.16854 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.898+0000 7f32ddf43640 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56078dfc69f0 0x56078e3cac60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7545d42ea1fabbb server_cookie=a3071e02c46ca8a3 in_seq=0 out_seq=0 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32c17fa640 1 -- 172.21.15.53:0/1251129815 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56078e3265d0 con 0x56078dfc69f0 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32c17fa640 10 client.16854 handle_command_reply: tid=0 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 1 client.16854 shutdown 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 1 -- 172.21.15.53:0/1251129815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 msgr2=0x56078e3b8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3b8fb0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f32c8005bc0 tx=0x7f32c8003c70 comp rx=0 tx=0).stop 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 1 -- 172.21.15.53:0/1251129815 shutdown_connections 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56078dfc69f0 0x56078e3cac60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078e008070 0x56078e3c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfe7390 0x56078e3b8fb0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32c17fa640 0 client.16854 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 1 --2- 172.21.15.53:0/1251129815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 0x56078e3b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 1 -- 172.21.15.53:0/1251129815 >> 172.21.15.53:0/1251129815 conn(0x56078dffc460 msgr2=0x56078e3b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 1 -- 172.21.15.53:0/1251129815 shutdown_connections 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 1 -- 172.21.15.53:0/1251129815 wait complete. 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.899+0000 7f32e671c740 20 client.16854 trim_cache size 0 max 16384 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32e671c740 1 Processor -- start 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32e671c740 1 -- start start 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32e671c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfdf1b0 0x56078e3aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32e671c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfe7390 0x56078e3ba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32e671c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078e008070 0x56078e3c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32e671c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81af410 con 0x56078dfdf1b0 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32e671c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81b1010 con 0x56078dfe7390 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32e671c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81afae0 con 0x56078e008070 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32ddf43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfdf1b0 0x56078e3aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32ddf43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfdf1b0 0x56078e3aed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35466/0 (socket says 172.21.15.53:35466) 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32ddf43640 1 -- 172.21.15.53:0/3115693541 learned_addr learned my addr 172.21.15.53:0/3115693541 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32de744640 1 --2- 172.21.15.53:0/3115693541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078e008070 0x56078e3c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32ddf43640 1 -- 172.21.15.53:0/3115693541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078e008070 msgr2=0x56078e3c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32dd742640 1 --2- 172.21.15.53:0/3115693541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfe7390 0x56078e3ba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32ddf43640 1 --2- 172.21.15.53:0/3115693541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078e008070 0x56078e3c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32ddf43640 1 -- 172.21.15.53:0/3115693541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfe7390 msgr2=0x56078e3ba6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32ddf43640 1 --2- 172.21.15.53:0/3115693541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfe7390 0x56078e3ba6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32ddf43640 1 -- 172.21.15.53:0/3115693541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078e3bb5a0 con 0x56078dfdf1b0 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.913+0000 7f32de744640 1 --2- 172.21.15.53:0/3115693541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078e008070 0x56078e3c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.914+0000 7f32ddf43640 1 --2- 172.21.15.53:0/3115693541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfdf1b0 0x56078e3aed00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x56078e3cb260 tx=0x7f32d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502e2ca5ce3332d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.914+0000 7f32c37fe640 1 -- 172.21.15.53:0/3115693541 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4003ac0 con 0x56078dfdf1b0 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.914+0000 7f32c37fe640 1 -- 172.21.15.53:0/3115693541 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32d40054b0 con 0x56078dfdf1b0 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.914+0000 7f32c37fe640 1 -- 172.21.15.53:0/3115693541 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4004c20 con 0x56078dfdf1b0 2024-08-31T06:08:28.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.915+0000 7f32e671c740 1 -- 172.21.15.53:0/3115693541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfdf1b0 msgr2=0x56078e3aed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.915+0000 7f32e671c740 1 --2- 172.21.15.53:0/3115693541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfdf1b0 0x56078e3aed00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x56078e3cb260 tx=0x7f32d4017000 comp rx=0 tx=0).stop 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.915+0000 7f32e671c740 1 -- 172.21.15.53:0/3115693541 shutdown_connections 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.915+0000 7f32e671c740 1 --2- 172.21.15.53:0/3115693541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078e008070 0x56078e3c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.915+0000 7f32e671c740 1 --2- 172.21.15.53:0/3115693541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfe7390 0x56078e3ba6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.915+0000 7f32e671c740 1 --2- 172.21.15.53:0/3115693541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078dfdf1b0 0x56078e3aed00 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.915+0000 7f32e671c740 1 -- 172.21.15.53:0/3115693541 >> 172.21.15.53:0/3115693541 conn(0x56078dffc460 msgr2=0x56078e3b9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.915+0000 7f32e671c740 1 -- 172.21.15.53:0/3115693541 shutdown_connections 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.915+0000 7f32e671c740 1 -- 172.21.15.53:0/3115693541 wait complete. 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.915+0000 7f32e671c740 1 -- start start 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.915+0000 7f32e671c740 1 Processor -- start 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32e671c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 0x56078e3bf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32e671c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078dfe7390 0x56078e3bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32e671c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078e008070 0x56078e42d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32e671c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81b0880 con 0x56078e008070 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32e671c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81b01b0 con 0x56078dfdf1b0 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32e671c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32d81ad3f0 con 0x56078dfe7390 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32e671c740 10 client.0 _ll_register_callbacks cb 0x7f32c8011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32de744640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078e008070 0x56078e42d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32ddf43640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 0x56078e3bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32ddf43640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 0x56078e3bf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52474/0 (socket says 172.21.15.53:52474) 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32ddf43640 1 -- 172.21.15.53:0/269690519 learned_addr learned my addr 172.21.15.53:0/269690519 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32dd742640 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078dfe7390 0x56078e3bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32dd742640 1 -- 172.21.15.53:0/269690519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 msgr2=0x56078e3bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32dd742640 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 0x56078e3bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32dd742640 1 -- 172.21.15.53:0/269690519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078e008070 msgr2=0x56078e42d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32dd742640 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078e008070 0x56078e42d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32dd742640 1 -- 172.21.15.53:0/269690519 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56078e42db00 con 0x56078dfe7390 2024-08-31T06:08:28.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.916+0000 7f32de744640 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078e008070 0x56078e42d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:28.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32dd742640 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078dfe7390 0x56078e3bfe50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32c80058c0 tx=0x7f32c8009fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4deff0784f6d56 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:28.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:08:28.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32c17fa640 1 -- 172.21.15.53:0/269690519 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c801e610 con 0x56078dfe7390 2024-08-31T06:08:28.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32c17fa640 1 -- 172.21.15.53:0/269690519 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f32c801ea00 con 0x56078dfe7390 2024-08-31T06:08:28.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32e671c740 1 -- 172.21.15.53:0/269690519 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32d40054b0 con 0x56078dfe7390 2024-08-31T06:08:28.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32c17fa640 1 -- 172.21.15.53:0/269690519 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f32c8041050 con 0x56078dfe7390 2024-08-31T06:08:28.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32e671c740 10 client.26242 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:28.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32e671c740 1 -- 172.21.15.53:0/269690519 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56078e436020 con 0x56078dfe7390 2024-08-31T06:08:28.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32c17fa640 1 -- 172.21.15.53:0/269690519 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32d40054b0 con 0x56078dfe7390 2024-08-31T06:08:28.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32c17fa640 1 -- 172.21.15.53:0/269690519 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f32c8033680 con 0x56078dfe7390 2024-08-31T06:08:28.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32e671c740 10 client.26242 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:28.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32e671c740 10 client.26242 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:08:28.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32e671c740 20 client.26242 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:28.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32e671c740 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56078df9bda0 0x56078e438800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:28.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32e671c740 4 client.26242 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.917+0000 7f32e671c740 1 -- 172.21.15.53:0/269690519 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56078e322070 con 0x56078df9bda0 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.918+0000 7f32ddf43640 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56078df9bda0 0x56078e438800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.918+0000 7f32ddf43640 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56078df9bda0 0x56078e438800 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=739858375f2fa55c server_cookie=db09985439bcb718 in_seq=0 out_seq=0 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.918+0000 7f32c17fa640 10 client.26242 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.918+0000 7f32c17fa640 1 -- 172.21.15.53:0/269690519 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56078e322070 con 0x56078df9bda0 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.918+0000 7f32c17fa640 10 client.26242 handle_command_reply: tid=0 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.918+0000 7f32e671c740 1 client.26242 shutdown 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.918+0000 7f32e671c740 1 -- 172.21.15.53:0/269690519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078dfe7390 msgr2=0x56078e3bfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.918+0000 7f32e671c740 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078dfe7390 0x56078e3bfe50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32c80058c0 tx=0x7f32c8009fb0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e671c740 1 -- 172.21.15.53:0/269690519 shutdown_connections 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e671c740 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56078df9bda0 0x56078e438800 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e671c740 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078e008070 0x56078e42d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e671c740 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56078dfe7390 0x56078e3bfe50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e671c740 1 --2- 172.21.15.53:0/269690519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56078dfdf1b0 0x56078e3bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32c17fa640 0 client.26242 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:08:28.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e671c740 1 -- 172.21.15.53:0/269690519 >> 172.21.15.53:0/269690519 conn(0x56078dffc460 msgr2=0x56078e3aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:28.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e671c740 1 -- 172.21.15.53:0/269690519 shutdown_connections 2024-08-31T06:08:28.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e671c740 1 -- 172.21.15.53:0/269690519 wait complete. 2024-08-31T06:08:28.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e671c740 20 client.26242 trim_cache size 0 max 16384 2024-08-31T06:08:28.938 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e01a7640 1 -- 172.21.15.53:0/3773124799 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32c40b4ca0 msgr2=0x7f32c40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e01a7640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32c40b4ca0 0x7f32c40b71b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x56078e3abf90 tx=0x7f32d4005f90 comp rx=0 tx=0).stop 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e01a7640 1 -- 172.21.15.53:0/3773124799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32d8109c60 msgr2=0x7f32d819f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e01a7640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32d8109c60 0x7f32d819f970 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f32d0005cc0 tx=0x7f32d0003f90 comp rx=0 tx=0).stop 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e01a7640 1 -- 172.21.15.53:0/3773124799 shutdown_connections 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e01a7640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32c40b4ca0 0x7f32c40b71b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e01a7640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32d8109c60 0x7f32d819f970 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e01a7640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d8109310 0x7f32d819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e01a7640 1 --2- 172.21.15.53:0/3773124799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32d81039d0 0x7f32d819a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.919+0000 7f32e01a7640 1 -- 172.21.15.53:0/3773124799 >> 172.21.15.53:0/3773124799 conn(0x7f32d807b670 msgr2=0x7f32d8107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.920+0000 7f32e01a7640 1 -- 172.21.15.53:0/3773124799 shutdown_connections 2024-08-31T06:08:28.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:28.920+0000 7f32e01a7640 1 -- 172.21.15.53:0/3773124799 wait complete. 2024-08-31T06:08:28.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.43 MB/sec execute 18 sec latency 10624.561 ms 2024-08-31T06:08:29.676 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:08:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.688+0000 7f2850e06640 1 -- 172.21.15.53:0/2161395920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c108080 msgr2=0x7f284c108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.688+0000 7f2850e06640 1 --2- 172.21.15.53:0/2161395920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c108080 0x7f284c108490 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2840009900 tx=0x7f284002a410 comp rx=0 tx=0).stop 2024-08-31T06:08:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.689+0000 7f2850e06640 1 -- 172.21.15.53:0/2161395920 shutdown_connections 2024-08-31T06:08:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.689+0000 7f2850e06640 1 --2- 172.21.15.53:0/2161395920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f284c1089d0 0x7f284c10f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.689+0000 7f2850e06640 1 --2- 172.21.15.53:0/2161395920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c108080 0x7f284c108490 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.689+0000 7f2850e06640 1 --2- 172.21.15.53:0/2161395920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f284c102750 0x7f284c102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.689+0000 7f2850e06640 1 -- 172.21.15.53:0/2161395920 >> 172.21.15.53:0/2161395920 conn(0x7f284c07a4e0 msgr2=0x7f284c07a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.689+0000 7f2850e06640 1 -- 172.21.15.53:0/2161395920 shutdown_connections 2024-08-31T06:08:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.689+0000 7f2850e06640 1 -- 172.21.15.53:0/2161395920 wait complete. 2024-08-31T06:08:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.689+0000 7f2850e06640 1 Processor -- start 2024-08-31T06:08:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2850e06640 1 -- start start 2024-08-31T06:08:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2850e06640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f284c102750 0x7f284c19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2850e06640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c108080 0x7f284c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2850e06640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f284c1089d0 0x7f284c1a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2850e06640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1124f0 con 0x7f284c108080 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2850e06640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f284c112370 con 0x7f284c102750 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2850e06640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f284c112670 con 0x7f284c1089d0 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2849d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c108080 0x7f284c19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2849d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c108080 0x7f284c19c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35490/0 (socket says 172.21.15.53:35490) 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2849d9b640 1 -- 172.21.15.53:0/404908972 learned_addr learned my addr 172.21.15.53:0/404908972 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f284a59c640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f284c102750 0x7f284c19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f284ad9d640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f284c1089d0 0x7f284c1a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2849d9b640 1 -- 172.21.15.53:0/404908972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f284c1089d0 msgr2=0x7f284c1a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2849d9b640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f284c1089d0 0x7f284c1a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2849d9b640 1 -- 172.21.15.53:0/404908972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f284c102750 msgr2=0x7f284c19c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2849d9b640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f284c102750 0x7f284c19c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.690+0000 7f2849d9b640 1 -- 172.21.15.53:0/404908972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284c1a2260 con 0x7f284c108080 2024-08-31T06:08:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.691+0000 7f2849d9b640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c108080 0x7f284c19c8d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2840005940 tx=0x7f28400040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.691+0000 7f283b7fe640 1 -- 172.21.15.53:0/404908972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284003f030 con 0x7f284c108080 2024-08-31T06:08:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.691+0000 7f2850e06640 1 -- 172.21.15.53:0/404908972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284c1a24f0 con 0x7f284c108080 2024-08-31T06:08:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.691+0000 7f283b7fe640 1 -- 172.21.15.53:0/404908972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2840003a80 con 0x7f284c108080 2024-08-31T06:08:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.691+0000 7f283b7fe640 1 -- 172.21.15.53:0/404908972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840035070 con 0x7f284c108080 2024-08-31T06:08:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.691+0000 7f2850e06640 1 -- 172.21.15.53:0/404908972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f284c1a8ce0 con 0x7f284c108080 2024-08-31T06:08:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.694+0000 7f2857e4a740 1 Processor -- start 2024-08-31T06:08:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.694+0000 7f2857e4a740 1 -- start start 2024-08-31T06:08:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.694+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be751b0 0x55d47c218ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.694+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c219220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.694+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be544d0 0x55d47c219760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.694+0000 7f2857e4a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d47c18e000 con 0x55d47be544d0 2024-08-31T06:08:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.694+0000 7f2857e4a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d47c17d590 con 0x55d47be751b0 2024-08-31T06:08:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.694+0000 7f2857e4a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d47c181540 con 0x55d47be4c2f0 2024-08-31T06:08:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f284a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c219220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f284a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c219220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:43044/0 (socket says 172.21.15.53:43044) 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f284a59c640 1 -- 172.21.15.53:0/2361065855 learned_addr learned my addr 172.21.15.53:0/2361065855 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f284ad9d640 1 --2- 172.21.15.53:0/2361065855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be751b0 0x55d47c218ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f283b7fe640 1 -- 172.21.15.53:0/404908972 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2840042030 con 0x7f284c108080 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f284a59c640 1 -- 172.21.15.53:0/2361065855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be751b0 msgr2=0x55d47c218ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f284a59c640 1 --2- 172.21.15.53:0/2361065855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be751b0 0x55d47c218ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f284a59c640 1 -- 172.21.15.53:0/2361065855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be544d0 msgr2=0x55d47c219760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f284a59c640 1 --2- 172.21.15.53:0/2361065855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be544d0 0x55d47c219760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f284a59c640 1 -- 172.21.15.53:0/2361065855 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47bee0790 con 0x55d47be4c2f0 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f284ad9d640 1 --2- 172.21.15.53:0/2361065855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be751b0 0x55d47c218ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.695+0000 7f284a59c640 1 --2- 172.21.15.53:0/2361065855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c219220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f283c00bd80 tx=0x7f283c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cee310827f18f1ed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.696+0000 7f2838ff9640 1 -- 172.21.15.53:0/2361065855 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c005220 con 0x55d47be4c2f0 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.696+0000 7f2838ff9640 1 -- 172.21.15.53:0/2361065855 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f283c004c30 con 0x55d47be4c2f0 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.696+0000 7f2838ff9640 1 -- 172.21.15.53:0/2361065855 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c011730 con 0x55d47be4c2f0 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.696+0000 7f283b7fe640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28340b4ca0 0x7f28340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.696+0000 7f284ad9d640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28340b4ca0 0x7f28340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.696+0000 7f283b7fe640 1 -- 172.21.15.53:0/404908972 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2840105ab0 con 0x7f284c108080 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f2857e4a740 1 -- 172.21.15.53:0/2361065855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 msgr2=0x55d47c219220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f2857e4a740 1 --2- 172.21.15.53:0/2361065855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c219220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f283c00bd80 tx=0x7f283c0107a0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f284ad9d640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28340b4ca0 0x7f28340b71b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2844005fd0 tx=0x7f28440096e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f2857e4a740 1 -- 172.21.15.53:0/2361065855 shutdown_connections 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f2857e4a740 1 --2- 172.21.15.53:0/2361065855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be544d0 0x55d47c219760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f2857e4a740 1 --2- 172.21.15.53:0/2361065855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c219220 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f2857e4a740 1 --2- 172.21.15.53:0/2361065855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be751b0 0x55d47c218ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f2857e4a740 1 -- 172.21.15.53:0/2361065855 >> 172.21.15.53:0/2361065855 conn(0x55d47be69300 msgr2=0x55d47c216bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f2857e4a740 1 -- 172.21.15.53:0/2361065855 shutdown_connections 2024-08-31T06:08:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f2857e4a740 1 -- 172.21.15.53:0/2361065855 wait complete. 2024-08-31T06:08:29.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f2857e4a740 1 -- start start 2024-08-31T06:08:29.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.697+0000 7f2857e4a740 1 Processor -- start 2024-08-31T06:08:29.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be4c2f0 0x55d47c224970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be544d0 0x55d47c224f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be751b0 0x55d47c2307b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2857e4a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d47c0b6ab0 con 0x55d47be751b0 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2857e4a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d47c104680 con 0x55d47be4c2f0 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2857e4a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d47c227460 con 0x55d47be544d0 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2857e4a740 10 client.0 _ll_register_callbacks cb 0x55d47be8ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f284ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be751b0 0x55d47c2307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f284ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be751b0 0x55d47c2307b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35500/0 (socket says 172.21.15.53:35500) 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f284ad9d640 1 -- 172.21.15.53:0/3392500091 learned_addr learned my addr 172.21.15.53:0/3392500091 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2849d9b640 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be544d0 0x55d47c224f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f284a59c640 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be4c2f0 0x55d47c224970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2849d9b640 1 -- 172.21.15.53:0/3392500091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be4c2f0 msgr2=0x55d47c224970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2849d9b640 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be4c2f0 0x55d47c224970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2849d9b640 1 -- 172.21.15.53:0/3392500091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be751b0 msgr2=0x55d47c2307b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2849d9b640 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be751b0 0x55d47c2307b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f2849d9b640 1 -- 172.21.15.53:0/3392500091 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d47bf59620 con 0x55d47be544d0 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.698+0000 7f284ad9d640 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be751b0 0x55d47c2307b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.699+0000 7f2849d9b640 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be544d0 0x55d47c224f50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2840103200 tx=0x7f28400c8190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5775844beaac8247 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.699+0000 7f2831ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.699+0000 7f2831ffb640 1 -- 172.21.15.53:0/3392500091 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840049070 con 0x55d47be544d0 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.699+0000 7f2831ffb640 1 -- 172.21.15.53:0/3392500091 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f28400c8430 con 0x55d47be544d0 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.699+0000 7f2857e4a740 1 -- 172.21.15.53:0/3392500091 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f283c004c30 con 0x55d47be544d0 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.699+0000 7f2831ffb640 1 -- 172.21.15.53:0/3392500091 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f28400044e0 con 0x55d47be544d0 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.699+0000 7f2857e4a740 10 client.26254 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.699+0000 7f2857e4a740 1 -- 172.21.15.53:0/3392500091 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d47c233590 con 0x55d47be544d0 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.699+0000 7f2831ffb640 1 -- 172.21.15.53:0/3392500091 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f283c004c30 con 0x55d47be544d0 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.699+0000 7f2831ffb640 1 -- 172.21.15.53:0/3392500091 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f28400cc400 con 0x55d47be544d0 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.700+0000 7f2857e4a740 10 client.26254 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.700+0000 7f2857e4a740 10 client.26254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.700+0000 7f2857e4a740 20 client.26254 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.700+0000 7f2857e4a740 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d47be33d80 0x55d47c236bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.700+0000 7f2857e4a740 4 client.26254 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.700+0000 7f2857e4a740 1 -- 172.21.15.53:0/3392500091 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d47c18ff50 con 0x55d47be33d80 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.700+0000 7f284a59c640 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d47be33d80 0x55d47c236bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.700+0000 7f284a59c640 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d47be33d80 0x55d47c236bb0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aac3b93e846143eb server_cookie=ccd7ca8ca309d4b8 in_seq=0 out_seq=0 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.700+0000 7f2831ffb640 10 client.26254 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2831ffb640 1 -- 172.21.15.53:0/3392500091 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d47c18ff50 con 0x55d47be33d80 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2831ffb640 10 client.26254 handle_command_reply: tid=0 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2857e4a740 1 client.26254 shutdown 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2857e4a740 1 -- 172.21.15.53:0/3392500091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be544d0 msgr2=0x55d47c224f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2857e4a740 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be544d0 0x55d47c224f50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2840103200 tx=0x7f28400c8190 comp rx=0 tx=0).stop 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2857e4a740 1 -- 172.21.15.53:0/3392500091 shutdown_connections 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2857e4a740 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d47be33d80 0x55d47c236bb0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2857e4a740 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be751b0 0x55d47c2307b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2857e4a740 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be544d0 0x55d47c224f50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2831ffb640 0 client.26254 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2857e4a740 1 --2- 172.21.15.53:0/3392500091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be4c2f0 0x55d47c224970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2857e4a740 1 -- 172.21.15.53:0/3392500091 >> 172.21.15.53:0/3392500091 conn(0x55d47be69300 msgr2=0x55d47c219d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2857e4a740 1 -- 172.21.15.53:0/3392500091 shutdown_connections 2024-08-31T06:08:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.701+0000 7f2857e4a740 1 -- 172.21.15.53:0/3392500091 wait complete. 2024-08-31T06:08:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.702+0000 7f2857e4a740 20 client.26254 trim_cache size 0 max 16384 2024-08-31T06:08:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.716+0000 7f2857e4a740 1 Processor -- start 2024-08-31T06:08:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.716+0000 7f2857e4a740 1 -- start start 2024-08-31T06:08:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be33d80 0x55d47c223630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c21e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be544d0 0x55d47c2306b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f2857e4a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1b15e0 con 0x55d47be544d0 2024-08-31T06:08:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f2857e4a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1b31e0 con 0x55d47be33d80 2024-08-31T06:08:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f2857e4a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1b1cb0 con 0x55d47be4c2f0 2024-08-31T06:08:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f284ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be544d0 0x55d47c2306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f284ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be544d0 0x55d47c2306b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35504/0 (socket says 172.21.15.53:35504) 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f284ad9d640 1 -- 172.21.15.53:0/85724500 learned_addr learned my addr 172.21.15.53:0/85724500 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f284a59c640 1 --2- 172.21.15.53:0/85724500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be33d80 0x55d47c223630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f2849d9b640 1 --2- 172.21.15.53:0/85724500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c21e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f284ad9d640 1 -- 172.21.15.53:0/85724500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 msgr2=0x55d47c21e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f284ad9d640 1 --2- 172.21.15.53:0/85724500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c21e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f284ad9d640 1 -- 172.21.15.53:0/85724500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be33d80 msgr2=0x55d47c223630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f284ad9d640 1 --2- 172.21.15.53:0/85724500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be33d80 0x55d47c223630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f284ad9d640 1 -- 172.21.15.53:0/85724500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47c210980 con 0x55d47be544d0 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.717+0000 7f284a59c640 1 --2- 172.21.15.53:0/85724500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be33d80 0x55d47c223630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.718+0000 7f284ad9d640 1 --2- 172.21.15.53:0/85724500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be544d0 0x55d47c2306b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2844009fb0 tx=0x7f2844015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04250a96274cf7c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.718+0000 7f2833fff640 1 -- 172.21.15.53:0/85724500 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2844010d60 con 0x55d47be544d0 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.718+0000 7f2833fff640 1 -- 172.21.15.53:0/85724500 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f284401c8c0 con 0x55d47be544d0 2024-08-31T06:08:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.718+0000 7f2833fff640 1 -- 172.21.15.53:0/85724500 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284401f880 con 0x55d47be544d0 2024-08-31T06:08:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.719+0000 7f2857e4a740 1 -- 172.21.15.53:0/85724500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be544d0 msgr2=0x55d47c2306b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.719+0000 7f2857e4a740 1 --2- 172.21.15.53:0/85724500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be544d0 0x55d47c2306b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2844009fb0 tx=0x7f2844015000 comp rx=0 tx=0).stop 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.719+0000 7f2857e4a740 1 -- 172.21.15.53:0/85724500 shutdown_connections 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.719+0000 7f2857e4a740 1 --2- 172.21.15.53:0/85724500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be544d0 0x55d47c2306b0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.719+0000 7f2857e4a740 1 --2- 172.21.15.53:0/85724500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c21e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.719+0000 7f2857e4a740 1 --2- 172.21.15.53:0/85724500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be33d80 0x55d47c223630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.719+0000 7f2857e4a740 1 -- 172.21.15.53:0/85724500 >> 172.21.15.53:0/85724500 conn(0x55d47be69300 msgr2=0x55d47c21de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.719+0000 7f2857e4a740 1 -- 172.21.15.53:0/85724500 shutdown_connections 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.719+0000 7f2857e4a740 1 -- 172.21.15.53:0/85724500 wait complete. 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.719+0000 7f2857e4a740 1 -- start start 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.719+0000 7f2857e4a740 1 Processor -- start 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be33d80 0x55d47c22f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c22fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2857e4a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be544d0 0x55d47c22b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2857e4a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1b2a50 con 0x55d47be33d80 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2857e4a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1b2380 con 0x55d47be544d0 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2857e4a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f284c1af5c0 con 0x55d47be4c2f0 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2857e4a740 10 client.0 _ll_register_callbacks cb 0x7f2840005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f284a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be33d80 0x55d47c22f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f284a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be33d80 0x55d47c22f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35514/0 (socket says 172.21.15.53:35514) 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f284a59c640 1 -- 172.21.15.53:0/1537312961 learned_addr learned my addr 172.21.15.53:0/1537312961 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2849d9b640 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c22fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f284ad9d640 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be544d0 0x55d47c22b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f284a59c640 1 -- 172.21.15.53:0/1537312961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 msgr2=0x55d47c22fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f284a59c640 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c22fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f284a59c640 1 -- 172.21.15.53:0/1537312961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be544d0 msgr2=0x55d47c22b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f284a59c640 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be544d0 0x55d47c22b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f284a59c640 1 -- 172.21.15.53:0/1537312961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d47c22bcd0 con 0x55d47be33d80 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2849d9b640 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c22fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f284ad9d640 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be544d0 0x55d47c22b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f284a59c640 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be33d80 0x55d47c22f8b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f283c0056e0 tx=0x7f283c0116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e98d9a90fb4ef6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2831ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2831ffb640 1 -- 172.21.15.53:0/1537312961 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c004220 con 0x55d47be33d80 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2857e4a740 1 -- 172.21.15.53:0/1537312961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f284401c8c0 con 0x55d47be33d80 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.720+0000 7f2831ffb640 1 -- 172.21.15.53:0/1537312961 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f283c0043c0 con 0x55d47be33d80 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2831ffb640 1 -- 172.21.15.53:0/1537312961 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f283c0117b0 con 0x55d47be33d80 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2857e4a740 10 client.16875 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2857e4a740 1 -- 172.21.15.53:0/1537312961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d47c22cf40 con 0x55d47be33d80 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2831ffb640 1 -- 172.21.15.53:0/1537312961 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f284401c8c0 con 0x55d47be33d80 2024-08-31T06:08:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2831ffb640 1 -- 172.21.15.53:0/1537312961 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f283c003b20 con 0x55d47be33d80 2024-08-31T06:08:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2857e4a740 10 client.16875 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2857e4a740 10 client.16875 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2857e4a740 20 client.16875 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2857e4a740 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d47be751b0 0x55d47c2a3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2857e4a740 4 client.16875 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:08:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2857e4a740 1 -- 172.21.15.53:0/1537312961 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d47c18b9f0 con 0x55d47be751b0 2024-08-31T06:08:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.721+0000 7f2849d9b640 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d47be751b0 0x55d47c2a3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.722+0000 7f2831ffb640 10 client.16875 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:29.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.722+0000 7f2849d9b640 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d47be751b0 0x55d47c2a3520 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b43cb12aa836bbda server_cookie=17cec063ae3722fb in_seq=0 out_seq=0 2024-08-31T06:08:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2831ffb640 1 -- 172.21.15.53:0/1537312961 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d47c18b9f0 con 0x55d47be751b0 2024-08-31T06:08:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2831ffb640 10 client.16875 handle_command_reply: tid=0 2024-08-31T06:08:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 1 client.16875 shutdown 2024-08-31T06:08:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 1 -- 172.21.15.53:0/1537312961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be33d80 msgr2=0x55d47c22f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be33d80 0x55d47c22f8b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f283c0056e0 tx=0x7f283c0116c0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 1 -- 172.21.15.53:0/1537312961 shutdown_connections 2024-08-31T06:08:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d47be751b0 0x55d47c2a3520 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d47be544d0 0x55d47c22b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2831ffb640 0 client.16875 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d47be4c2f0 0x55d47c22fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 1 --2- 172.21.15.53:0/1537312961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d47be33d80 0x55d47c22f8b0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 1 -- 172.21.15.53:0/1537312961 >> 172.21.15.53:0/1537312961 conn(0x55d47be69300 msgr2=0x55d47c230cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 1 -- 172.21.15.53:0/1537312961 shutdown_connections 2024-08-31T06:08:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 1 -- 172.21.15.53:0/1537312961 wait complete. 2024-08-31T06:08:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.743+0000 7f2857e4a740 20 client.16875 trim_cache size 0 max 16384 2024-08-31T06:08:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:08:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:08:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:08:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:08:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 -- 172.21.15.53:0/404908972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28340b4ca0 msgr2=0x7f28340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28340b4ca0 0x7f28340b71b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2844005fd0 tx=0x7f28440096e0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 -- 172.21.15.53:0/404908972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c108080 msgr2=0x7f284c19c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c108080 0x7f284c19c8d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2840005940 tx=0x7f28400040e0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 -- 172.21.15.53:0/404908972 shutdown_connections 2024-08-31T06:08:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28340b4ca0 0x7f28340b71b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f284c1089d0 0x7f284c1a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c108080 0x7f284c19c8d0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 --2- 172.21.15.53:0/404908972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f284c102750 0x7f284c19c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 -- 172.21.15.53:0/404908972 >> 172.21.15.53:0/404908972 conn(0x7f284c07a4e0 msgr2=0x7f284c1063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 -- 172.21.15.53:0/404908972 shutdown_connections 2024-08-31T06:08:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:29.744+0000 7f2850e06640 1 -- 172.21.15.53:0/404908972 wait complete. 2024-08-31T06:08:29.935 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:29.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.40 MB/sec execute 19 sec latency 11624.617 ms 2024-08-31T06:08:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:29 smithi130 ceph-mon[22266]: pgmap v429: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 425 KiB/s wr, 59 op/s 2024-08-31T06:08:30.171 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:29 smithi053 ceph-mon[18924]: pgmap v429: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 425 KiB/s wr, 59 op/s 2024-08-31T06:08:30.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:29 smithi153 ceph-mon[22320]: pgmap v429: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 425 KiB/s wr, 59 op/s 2024-08-31T06:08:30.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.429+0000 7f1df9b66640 1 -- 172.21.15.53:0/1439292727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df4102810 msgr2=0x7f1df4102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:30.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.429+0000 7f1df9b66640 1 --2- 172.21.15.53:0/1439292727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df4102810 0x7f1df4102c20 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009900 tx=0x7f1de402a410 comp rx=0 tx=0).stop 2024-08-31T06:08:30.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.429+0000 7f1df9b66640 1 -- 172.21.15.53:0/1439292727 shutdown_connections 2024-08-31T06:08:30.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.429+0000 7f1df9b66640 1 --2- 172.21.15.53:0/1439292727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1df4108aa0 0x7f1df410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.429+0000 7f1df9b66640 1 --2- 172.21.15.53:0/1439292727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1df4108150 0x7f1df4108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.429+0000 7f1df9b66640 1 --2- 172.21.15.53:0/1439292727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df4102810 0x7f1df4102c20 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.429+0000 7f1df9b66640 1 -- 172.21.15.53:0/1439292727 >> 172.21.15.53:0/1439292727 conn(0x7f1df40794d0 msgr2=0x7f1df40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:30.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.429+0000 7f1df9b66640 1 -- 172.21.15.53:0/1439292727 shutdown_connections 2024-08-31T06:08:30.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.429+0000 7f1df9b66640 1 -- 172.21.15.53:0/1439292727 wait complete. 2024-08-31T06:08:30.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df9b66640 1 Processor -- start 2024-08-31T06:08:30.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df9b66640 1 -- start start 2024-08-31T06:08:30.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df9b66640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df4102810 0x7f1df419a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df9b66640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1df4108150 0x7f1df419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df9b66640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1df4108aa0 0x7f1df419f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df9b66640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1df41125d0 con 0x7f1df4102810 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df9b66640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1df4112450 con 0x7f1df4108aa0 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df9b66640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1df4112750 con 0x7f1df4108150 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df4102810 0x7f1df419a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df4102810 0x7f1df419a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35540/0 (socket says 172.21.15.53:35540) 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df37fe640 1 -- 172.21.15.53:0/395504366 learned_addr learned my addr 172.21.15.53:0/395504366 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.430+0000 7f1df3fff640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1df4108aa0 0x7f1df419f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1deaffd640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1df4108150 0x7f1df419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1df37fe640 1 -- 172.21.15.53:0/395504366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1df4108150 msgr2=0x7f1df419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1df37fe640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1df4108150 0x7f1df419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1df37fe640 1 -- 172.21.15.53:0/395504366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1df4108aa0 msgr2=0x7f1df419f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:30.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1df37fe640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1df4108aa0 0x7f1df419f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1df37fe640 1 -- 172.21.15.53:0/395504366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df41a00c0 con 0x7f1df4102810 2024-08-31T06:08:30.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1df37fe640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df4102810 0x7f1df419a150 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009230 tx=0x7f1de4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:30.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1df17fa640 1 -- 172.21.15.53:0/395504366 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de403f030 con 0x7f1df4102810 2024-08-31T06:08:30.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1df17fa640 1 -- 172.21.15.53:0/395504366 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1de4003a80 con 0x7f1df4102810 2024-08-31T06:08:30.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1df9b66640 1 -- 172.21.15.53:0/395504366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df41a0350 con 0x7f1df4102810 2024-08-31T06:08:30.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1df17fa640 1 -- 172.21.15.53:0/395504366 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4035070 con 0x7f1df4102810 2024-08-31T06:08:30.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.431+0000 7f1df9b66640 1 -- 172.21.15.53:0/395504366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df41a6b10 con 0x7f1df4102810 2024-08-31T06:08:30.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1e000db740 1 Processor -- start 2024-08-31T06:08:30.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1e000db740 1 -- start start 2024-08-31T06:08:30.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1df17fa640 1 -- 172.21.15.53:0/395504366 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1de4042030 con 0x7f1df4102810 2024-08-31T06:08:30.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1e000db740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a3138c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1e000db740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a3138c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1e000db740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a3138cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1e000db740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561a31303680 con 0x561a30fe7070 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1e000db740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561a312f2c10 con 0x561a30fc6390 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1e000db740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a312f6bc0 con 0x561a30fbe1b0 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1df3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a3138c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1df3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a3138c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35548/0 (socket says 172.21.15.53:35548) 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1df3fff640 1 -- 172.21.15.53:0/1206981581 learned_addr learned my addr 172.21.15.53:0/1206981581 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1df37fe640 1 --2- 172.21.15.53:0/1206981581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a3138c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.434+0000 7f1deaffd640 1 --2- 172.21.15.53:0/1206981581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a3138cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1df3fff640 1 -- 172.21.15.53:0/1206981581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 msgr2=0x561a3138c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:30.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1df3fff640 1 --2- 172.21.15.53:0/1206981581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a3138c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1df3fff640 1 -- 172.21.15.53:0/1206981581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 msgr2=0x561a3138cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:30.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1df3fff640 1 --2- 172.21.15.53:0/1206981581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a3138cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1df3fff640 1 -- 172.21.15.53:0/1206981581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a31052650 con 0x561a30fe7070 2024-08-31T06:08:30.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1deaffd640 1 --2- 172.21.15.53:0/1206981581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a3138cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:30.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1df3fff640 1 --2- 172.21.15.53:0/1206981581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a3138c310 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00ae90 tx=0x7f1dec00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559933a923b9c840 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:30.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1df17fa640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1de00b4ca0 0x7f1de00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1de9ffb640 1 -- 172.21.15.53:0/1206981581 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec003b70 con 0x561a30fe7070 2024-08-31T06:08:30.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1de9ffb640 1 -- 172.21.15.53:0/1206981581 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dec003d10 con 0x561a30fe7070 2024-08-31T06:08:30.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1de9ffb640 1 -- 172.21.15.53:0/1206981581 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0109e0 con 0x561a30fe7070 2024-08-31T06:08:30.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1df37fe640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1de00b4ca0 0x7f1de00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.435+0000 7f1df17fa640 1 -- 172.21.15.53:0/395504366 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1de4105ab0 con 0x7f1df4102810 2024-08-31T06:08:30.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.436+0000 7f1e000db740 1 -- 172.21.15.53:0/1206981581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 msgr2=0x561a3138c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:30.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.436+0000 7f1e000db740 1 --2- 172.21.15.53:0/1206981581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a3138c310 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00ae90 tx=0x7f1dec00f790 comp rx=0 tx=0).stop 2024-08-31T06:08:30.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.436+0000 7f1df37fe640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1de00b4ca0 0x7f1de00b71b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1de41032b0 tx=0x7f1de40ef040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:30.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.436+0000 7f1e000db740 1 -- 172.21.15.53:0/1206981581 shutdown_connections 2024-08-31T06:08:30.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.436+0000 7f1e000db740 1 --2- 172.21.15.53:0/1206981581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a3138cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.436+0000 7f1e000db740 1 --2- 172.21.15.53:0/1206981581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a3138c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.436+0000 7f1e000db740 1 --2- 172.21.15.53:0/1206981581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a3138c310 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.436+0000 7f1e000db740 1 -- 172.21.15.53:0/1206981581 >> 172.21.15.53:0/1206981581 conn(0x561a30fdb460 msgr2=0x561a3138a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.436+0000 7f1e000db740 1 -- 172.21.15.53:0/1206981581 shutdown_connections 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.436+0000 7f1e000db740 1 -- 172.21.15.53:0/1206981581 wait complete. 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.437+0000 7f1e000db740 1 -- start start 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.437+0000 7f1e000db740 1 Processor -- start 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.437+0000 7f1e000db740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a3139be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.437+0000 7f1e000db740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a3139c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.437+0000 7f1e000db740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.437+0000 7f1e000db740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561a31155700 con 0x561a30fe7070 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.437+0000 7f1e000db740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561a31279750 con 0x561a30fc6390 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.437+0000 7f1e000db740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a3139ee50 con 0x561a30fbe1b0 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.437+0000 7f1e000db740 10 client.0 _ll_register_callbacks cb 0x561a312a8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:30.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.437+0000 7f1df3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.437+0000 7f1df3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35556/0 (socket says 172.21.15.53:35556) 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1df3fff640 1 -- 172.21.15.53:0/1753422741 learned_addr learned my addr 172.21.15.53:0/1753422741 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1deaffd640 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a3139c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1df3fff640 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a3139be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1df3fff640 1 -- 172.21.15.53:0/1753422741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 msgr2=0x561a3139be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1df3fff640 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a3139be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1df3fff640 1 -- 172.21.15.53:0/1753422741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 msgr2=0x561a3139c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1df3fff640 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a3139c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1df3fff640 1 -- 172.21.15.53:0/1753422741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a312b2900 con 0x561a30fe7070 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1deaffd640 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a3139c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1df3fff640 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a8180 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x561a3139e6d0 tx=0x7f1dec010640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a419408a5b55fb67 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1dd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:30.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/1753422741 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec010a00 con 0x561a30fe7070 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/1753422741 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1dec004c50 con 0x561a30fe7070 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1e000db740 1 -- 172.21.15.53:0/1753422741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dec003d10 con 0x561a30fe7070 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/1753422741 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1dec004e50 con 0x561a30fe7070 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1e000db740 10 client.16887 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.438+0000 7f1e000db740 1 -- 172.21.15.53:0/1753422741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561a313aac20 con 0x561a30fe7070 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.439+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/1753422741 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dec003d10 con 0x561a30fe7070 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.439+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/1753422741 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1dec005430 con 0x561a30fe7070 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.439+0000 7f1e000db740 10 client.16887 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.439+0000 7f1e000db740 10 client.16887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.439+0000 7f1e000db740 20 client.16887 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.439+0000 7f1e000db740 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a30fa59f0 0x561a313ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.439+0000 7f1e000db740 4 client.16887 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.439+0000 7f1e000db740 1 -- 172.21.15.53:0/1753422741 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a313055d0 con 0x561a30fa59f0 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.439+0000 7f1deaffd640 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a30fa59f0 0x561a313ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.440+0000 7f1deaffd640 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a30fa59f0 0x561a313ae090 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=366bc127defe08af server_cookie=a15955345a6eefb9 in_seq=0 out_seq=0 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.440+0000 7f1dd2ffd640 10 client.16887 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/1753422741 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a313055d0 con 0x561a30fa59f0 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1dd2ffd640 10 client.16887 handle_command_reply: tid=0 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 1 client.16887 shutdown 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 1 -- 172.21.15.53:0/1753422741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 msgr2=0x561a313a8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a8180 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x561a3139e6d0 tx=0x7f1dec010640 comp rx=0 tx=0).stop 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 1 -- 172.21.15.53:0/1753422741 shutdown_connections 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a30fa59f0 0x561a313ae090 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a8180 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a3139c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 1 --2- 172.21.15.53:0/1753422741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a3139be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 1 -- 172.21.15.53:0/1753422741 >> 172.21.15.53:0/1753422741 conn(0x561a30fdb460 msgr2=0x561a3138dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:30.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1dd2ffd640 0 client.16887 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:30.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 1 -- 172.21.15.53:0/1753422741 shutdown_connections 2024-08-31T06:08:30.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 1 -- 172.21.15.53:0/1753422741 wait complete. 2024-08-31T06:08:30.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.441+0000 7f1e000db740 20 client.16887 trim_cache size 0 max 16384 2024-08-31T06:08:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.454+0000 7f1e000db740 1 Processor -- start 2024-08-31T06:08:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.454+0000 7f1e000db740 1 -- start start 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1e000db740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fbe1b0 0x561a3139a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1e000db740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fc6390 0x561a3139ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1e000db740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fe7070 0x561a31399070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1e000db740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1df41ad230 con 0x561a30fbe1b0 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1e000db740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1df41aee30 con 0x561a30fe7070 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1e000db740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1df41ad900 con 0x561a30fc6390 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1df3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fbe1b0 0x561a3139a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1df3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fbe1b0 0x561a3139a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35570/0 (socket says 172.21.15.53:35570) 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1df3fff640 1 -- 172.21.15.53:0/3915557334 learned_addr learned my addr 172.21.15.53:0/3915557334 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1deaffd640 1 --2- 172.21.15.53:0/3915557334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fc6390 0x561a3139ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1df3fff640 1 -- 172.21.15.53:0/3915557334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fc6390 msgr2=0x561a3139ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1df3fff640 1 --2- 172.21.15.53:0/3915557334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fc6390 0x561a3139ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1df3fff640 1 -- 172.21.15.53:0/3915557334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fe7070 msgr2=0x561a31399070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:30.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1df3fff640 1 --2- 172.21.15.53:0/3915557334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fe7070 0x561a31399070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1df3fff640 1 -- 172.21.15.53:0/3915557334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a313a8920 con 0x561a30fbe1b0 2024-08-31T06:08:30.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1df3fff640 1 --2- 172.21.15.53:0/3915557334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fbe1b0 0x561a3139a700 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1dec000f80 tx=0x7f1dec005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f5aab89b606b04 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:30.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1de97fa640 1 -- 172.21.15.53:0/3915557334 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec003970 con 0x561a30fbe1b0 2024-08-31T06:08:30.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1de97fa640 1 -- 172.21.15.53:0/3915557334 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dec00a5c0 con 0x561a30fbe1b0 2024-08-31T06:08:30.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.455+0000 7f1de97fa640 1 -- 172.21.15.53:0/3915557334 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0186a0 con 0x561a30fbe1b0 2024-08-31T06:08:30.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.456+0000 7f1e000db740 1 -- 172.21.15.53:0/3915557334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fbe1b0 msgr2=0x561a3139a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:30.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.456+0000 7f1e000db740 1 --2- 172.21.15.53:0/3915557334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fbe1b0 0x561a3139a700 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1dec000f80 tx=0x7f1dec005f60 comp rx=0 tx=0).stop 2024-08-31T06:08:30.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.456+0000 7f1e000db740 1 -- 172.21.15.53:0/3915557334 shutdown_connections 2024-08-31T06:08:30.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.456+0000 7f1e000db740 1 --2- 172.21.15.53:0/3915557334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fe7070 0x561a31399070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.456+0000 7f1e000db740 1 --2- 172.21.15.53:0/3915557334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fc6390 0x561a3139ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.456+0000 7f1e000db740 1 --2- 172.21.15.53:0/3915557334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fbe1b0 0x561a3139a700 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.456+0000 7f1e000db740 1 -- 172.21.15.53:0/3915557334 >> 172.21.15.53:0/3915557334 conn(0x561a30fdb460 msgr2=0x561a31396ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:30.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.456+0000 7f1e000db740 1 -- 172.21.15.53:0/3915557334 shutdown_connections 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.456+0000 7f1e000db740 1 -- 172.21.15.53:0/3915557334 wait complete. 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1e000db740 1 -- start start 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1e000db740 1 Processor -- start 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1e000db740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a313a0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1e000db740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a313a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1e000db740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1e000db740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1df41ae6a0 con 0x561a30fe7070 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1e000db740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1df41adfd0 con 0x561a30fc6390 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1e000db740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1df41ab210 con 0x561a30fbe1b0 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1e000db740 10 client.0 _ll_register_callbacks cb 0x7f1de41096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1df3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1df3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35584/0 (socket says 172.21.15.53:35584) 2024-08-31T06:08:30.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.457+0000 7f1df3fff640 1 -- 172.21.15.53:0/803464071 learned_addr learned my addr 172.21.15.53:0/803464071 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:30.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1df3fff640 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a313a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1deaffd640 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a313a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1df3fff640 1 -- 172.21.15.53:0/803464071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 msgr2=0x561a313a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:30.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1df3fff640 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a313a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1df3fff640 1 -- 172.21.15.53:0/803464071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 msgr2=0x561a313a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:30.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1df3fff640 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a313a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1df3fff640 1 -- 172.21.15.53:0/803464071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a31417b10 con 0x561a30fe7070 2024-08-31T06:08:30.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1deaffd640 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a313a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:30.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1df3fff640 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a0d00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1dec005680 tx=0x7f1dec010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb259d62d86cfb5e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:30.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1dd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/803464071 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec03f040 con 0x561a30fe7070 2024-08-31T06:08:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/803464071 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1dec018bb0 con 0x561a30fe7070 2024-08-31T06:08:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1e000db740 1 -- 172.21.15.53:0/803464071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dec00a5c0 con 0x561a30fe7070 2024-08-31T06:08:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/803464071 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1dec004c50 con 0x561a30fe7070 2024-08-31T06:08:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1e000db740 10 client.16893 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.458+0000 7f1e000db740 1 -- 172.21.15.53:0/803464071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561a31418d90 con 0x561a30fe7070 2024-08-31T06:08:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.459+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/803464071 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dec00a5c0 con 0x561a30fe7070 2024-08-31T06:08:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.459+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/803464071 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f1dec02e730 con 0x561a30fe7070 2024-08-31T06:08:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.459+0000 7f1e000db740 10 client.16893 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.459+0000 7f1e000db740 10 client.16893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.459+0000 7f1e000db740 20 client.16893 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.459+0000 7f1e000db740 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a30f7ada0 0x561a3141b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.459+0000 7f1e000db740 4 client.16893 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.459+0000 7f1e000db740 1 -- 172.21.15.53:0/803464071 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a31301070 con 0x561a30f7ada0 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.459+0000 7f1deaffd640 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a30f7ada0 0x561a3141b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.459+0000 7f1dd2ffd640 10 client.16893 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.459+0000 7f1deaffd640 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a30f7ada0 0x561a3141b3c0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a3c7ae1c897def server_cookie=90f66f36022727d9 in_seq=0 out_seq=0 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1dd2ffd640 1 -- 172.21.15.53:0/803464071 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a31301070 con 0x561a30f7ada0 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1dd2ffd640 10 client.16893 handle_command_reply: tid=0 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 1 client.16893 shutdown 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 1 -- 172.21.15.53:0/803464071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 msgr2=0x561a313a0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a0d00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1dec005680 tx=0x7f1dec010990 comp rx=0 tx=0).stop 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 1 -- 172.21.15.53:0/803464071 shutdown_connections 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a30f7ada0 0x561a3141b3c0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a30fe7070 0x561a313a0d00 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a30fc6390 0x561a313a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 1 --2- 172.21.15.53:0/803464071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a30fbe1b0 0x561a313a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 1 -- 172.21.15.53:0/803464071 >> 172.21.15.53:0/803464071 conn(0x561a30fdb460 msgr2=0x561a3139a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:30.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1dd2ffd640 0 client.16893 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:30.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 1 -- 172.21.15.53:0/803464071 shutdown_connections 2024-08-31T06:08:30.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 1 -- 172.21.15.53:0/803464071 wait complete. 2024-08-31T06:08:30.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.460+0000 7f1e000db740 20 client.16893 trim_cache size 0 max 16384 2024-08-31T06:08:30.468 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:08:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 -- 172.21.15.53:0/395504366 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1de00b4ca0 msgr2=0x7f1de00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1de00b4ca0 0x7f1de00b71b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1de41032b0 tx=0x7f1de40ef040 comp rx=0 tx=0).stop 2024-08-31T06:08:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 -- 172.21.15.53:0/395504366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df4102810 msgr2=0x7f1df419a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df4102810 0x7f1df419a150 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009230 tx=0x7f1de4004270 comp rx=0 tx=0).stop 2024-08-31T06:08:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 -- 172.21.15.53:0/395504366 shutdown_connections 2024-08-31T06:08:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1de00b4ca0 0x7f1de00b71b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1df4108aa0 0x7f1df419f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1df4108150 0x7f1df419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 --2- 172.21.15.53:0/395504366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1df4102810 0x7f1df419a150 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:30.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 -- 172.21.15.53:0/395504366 >> 172.21.15.53:0/395504366 conn(0x7f1df40794d0 msgr2=0x7f1df4101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:30.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 -- 172.21.15.53:0/395504366 shutdown_connections 2024-08-31T06:08:30.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:30.461+0000 7f1df9b66640 1 -- 172.21.15.53:0/395504366 wait complete. 2024-08-31T06:08:30.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.38 MB/sec execute 20 sec latency 12624.712 ms 2024-08-31T06:08:31.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.36 MB/sec execute 21 sec latency 13624.827 ms 2024-08-31T06:08:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:31 smithi130 ceph-mon[22266]: pgmap v430: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 223 KiB/s wr, 35 op/s 2024-08-31T06:08:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:31 smithi153 ceph-mon[22320]: pgmap v430: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 223 KiB/s wr, 35 op/s 2024-08-31T06:08:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:31 smithi053 ceph-mon[18924]: pgmap v430: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 223 KiB/s wr, 35 op/s 2024-08-31T06:08:32.239 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:08:32.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:08:32.505 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:32.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.35 MB/sec execute 22 sec latency 14624.874 ms 2024-08-31T06:08:32.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.965+0000 7f5b1e49d640 1 -- 172.21.15.53:0/2023460280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b18105050 msgr2=0x7f5b1810d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:32.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.965+0000 7f5b1e49d640 1 --2- 172.21.15.53:0/2023460280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b18105050 0x7f5b1810d690 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009900 tx=0x7f5b0c02a410 comp rx=0 tx=0).stop 2024-08-31T06:08:32.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.965+0000 7f5b1e49d640 1 -- 172.21.15.53:0/2023460280 shutdown_connections 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.965+0000 7f5b1e49d640 1 --2- 172.21.15.53:0/2023460280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b1810dbd0 0x7f5b181100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.965+0000 7f5b1e49d640 1 --2- 172.21.15.53:0/2023460280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b18105050 0x7f5b1810d690 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.965+0000 7f5b1e49d640 1 --2- 172.21.15.53:0/2023460280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b18104620 0x7f5b18104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.965+0000 7f5b1e49d640 1 -- 172.21.15.53:0/2023460280 >> 172.21.15.53:0/2023460280 conn(0x7f5b180794e0 msgr2=0x7f5b180798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.965+0000 7f5b1e49d640 1 -- 172.21.15.53:0/2023460280 shutdown_connections 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.965+0000 7f5b1e49d640 1 -- 172.21.15.53:0/2023460280 wait complete. 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.966+0000 7f5b1e49d640 1 Processor -- start 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.966+0000 7f5b1e49d640 1 -- start start 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.966+0000 7f5b1e49d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b18104620 0x7f5b1819c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.966+0000 7f5b1e49d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b18105050 0x7f5b1819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.966+0000 7f5b1e49d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b1810dbd0 0x7f5b181a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:32.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.966+0000 7f5b1e49d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181136b0 con 0x7f5b1810dbd0 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.966+0000 7f5b1e49d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b18113530 con 0x7f5b18104620 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.966+0000 7f5b1e49d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b18113830 con 0x7f5b18105050 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b1ca3a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b1810dbd0 0x7f5b181a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b1ca3a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b1810dbd0 0x7f5b181a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35606/0 (socket says 172.21.15.53:35606) 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b1ca3a640 1 -- 172.21.15.53:0/1134762145 learned_addr learned my addr 172.21.15.53:0/1134762145 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b177fe640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b18105050 0x7f5b1819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b17fff640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b18104620 0x7f5b1819c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b1ca3a640 1 -- 172.21.15.53:0/1134762145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b18105050 msgr2=0x7f5b1819c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b1ca3a640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b18105050 0x7f5b1819c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b1ca3a640 1 -- 172.21.15.53:0/1134762145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b18104620 msgr2=0x7f5b1819c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b1ca3a640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b18104620 0x7f5b1819c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b1ca3a640 1 -- 172.21.15.53:0/1134762145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b181a2330 con 0x7f5b1810dbd0 2024-08-31T06:08:32.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b17fff640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b18104620 0x7f5b1819c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b1ca3a640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b1810dbd0 0x7f5b181a1c00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000cad0 tx=0x7f5b1000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b157fa640 1 -- 172.21.15.53:0/1134762145 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000ae20 con 0x7f5b1810dbd0 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b157fa640 1 -- 172.21.15.53:0/1134762145 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b10005020 con 0x7f5b1810dbd0 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b1e49d640 1 -- 172.21.15.53:0/1134762145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b181a2620 con 0x7f5b1810dbd0 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b157fa640 1 -- 172.21.15.53:0/1134762145 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000f6b0 con 0x7f5b1810dbd0 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.967+0000 7f5b1e49d640 1 -- 172.21.15.53:0/1134762145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b181a8d80 con 0x7f5b1810dbd0 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.970+0000 7f5b24a12740 1 Processor -- start 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.970+0000 7f5b157fa640 1 -- 172.21.15.53:0/1134762145 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5b100051d0 con 0x7f5b1810dbd0 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.970+0000 7f5b24a12740 1 -- start start 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.970+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c0a13350 0x5595c0db9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.970+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09ea490 0x5595c0db9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.970+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:32.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.970+0000 7f5b24a12740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5595c0d2f5f0 con 0x5595c09f2670 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.970+0000 7f5b24a12740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5595c0d1eb80 con 0x5595c09ea490 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.970+0000 7f5b24a12740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5595c0d22b30 con 0x5595c0a13350 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.970+0000 7f5b177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dba200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35608/0 (socket says 172.21.15.53:35608) 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b177fe640 1 -- 172.21.15.53:0/653467483 learned_addr learned my addr 172.21.15.53:0/653467483 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b17fff640 1 --2- 172.21.15.53:0/653467483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09ea490 0x5595c0db9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b177fe640 1 --2- 172.21.15.53:0/653467483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c0a13350 0x5595c0db9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b157fa640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b000b4d20 0x7f5b000b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b177fe640 1 -- 172.21.15.53:0/653467483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c0a13350 msgr2=0x5595c0db9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b177fe640 1 --2- 172.21.15.53:0/653467483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c0a13350 0x5595c0db9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b177fe640 1 -- 172.21.15.53:0/653467483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09ea490 msgr2=0x5595c0db9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b177fe640 1 --2- 172.21.15.53:0/653467483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09ea490 0x5595c0db9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b1ca3a640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b000b4d20 0x7f5b000b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b177fe640 1 -- 172.21.15.53:0/653467483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c0a7e930 con 0x5595c09f2670 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b157fa640 1 -- 172.21.15.53:0/1134762145 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5b100e57f0 con 0x7f5b1810dbd0 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b177fe640 1 --2- 172.21.15.53:0/653467483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dba200 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0057c0 tx=0x7f5b0c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5931f1d65ab877 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5afe7fc640 1 -- 172.21.15.53:0/653467483 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c035040 con 0x5595c09f2670 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.971+0000 7f5b1ca3a640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b000b4d20 0x7f5b000b7230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5b100e2ff0 tx=0x7f5b10070040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.972+0000 7f5afe7fc640 1 -- 172.21.15.53:0/653467483 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b0c0044c0 con 0x5595c09f2670 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.972+0000 7f5afe7fc640 1 -- 172.21.15.53:0/653467483 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c03d450 con 0x5595c09f2670 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.972+0000 7f5b24a12740 1 -- 172.21.15.53:0/653467483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 msgr2=0x5595c0dba200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.972+0000 7f5b24a12740 1 --2- 172.21.15.53:0/653467483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dba200 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0057c0 tx=0x7f5b0c005fd0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.972+0000 7f5b24a12740 1 -- 172.21.15.53:0/653467483 shutdown_connections 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.972+0000 7f5b24a12740 1 --2- 172.21.15.53:0/653467483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dba200 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.972+0000 7f5b24a12740 1 --2- 172.21.15.53:0/653467483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09ea490 0x5595c0db9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.972+0000 7f5b24a12740 1 --2- 172.21.15.53:0/653467483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c0a13350 0x5595c0db9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.972+0000 7f5b24a12740 1 -- 172.21.15.53:0/653467483 >> 172.21.15.53:0/653467483 conn(0x5595c0a07740 msgr2=0x5595c0db7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.973+0000 7f5b24a12740 1 -- 172.21.15.53:0/653467483 shutdown_connections 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.973+0000 7f5b24a12740 1 -- 172.21.15.53:0/653467483 wait complete. 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.973+0000 7f5b24a12740 1 -- start start 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.973+0000 7f5b24a12740 1 Processor -- start 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09ea490 0x5595c0dc4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09f2670 0x5595c0dc5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c0a13350 0x5595c0dd1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b24a12740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5595c0b81890 con 0x5595c09ea490 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b24a12740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5595c0ca5790 con 0x5595c0a13350 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b24a12740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5595c0dc7f00 con 0x5595c09f2670 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b24a12740 10 client.0 _ll_register_callbacks cb 0x5595c0a2aba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09ea490 0x5595c0dc4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09ea490 0x5595c0dc4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35616/0 (socket says 172.21.15.53:35616) 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b177fe640 1 -- 172.21.15.53:0/2572368295 learned_addr learned my addr 172.21.15.53:0/2572368295 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b17fff640 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09f2670 0x5595c0dc5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b177fe640 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c0a13350 0x5595c0dd1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b177fe640 1 -- 172.21.15.53:0/2572368295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09f2670 msgr2=0x5595c0dc5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b177fe640 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09f2670 0x5595c0dc5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b177fe640 1 -- 172.21.15.53:0/2572368295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c0a13350 msgr2=0x5595c0dd1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b177fe640 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c0a13350 0x5595c0dd1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b177fe640 1 -- 172.21.15.53:0/2572368295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c0cdcf30 con 0x5595c09ea490 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b177fe640 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09ea490 0x5595c0dc4f30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c001eb0 tx=0x7f5b0c032e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ca78657e261830 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5af77fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5af77fe640 1 -- 172.21.15.53:0/2572368295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c035070 con 0x5595c09ea490 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5af77fe640 1 -- 172.21.15.53:0/2572368295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5b0c003e00 con 0x5595c09ea490 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.974+0000 7f5b24a12740 1 -- 172.21.15.53:0/2572368295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5595c0d31540 con 0x5595c09ea490 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5af77fe640 1 -- 172.21.15.53:0/2572368295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5b0c004000 con 0x5595c09ea490 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5b24a12740 10 client.16905 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5b24a12740 1 -- 172.21.15.53:0/2572368295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5595c0dd3d30 con 0x5595c09ea490 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5af77fe640 1 -- 172.21.15.53:0/2572368295 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5595c0d31540 con 0x5595c09ea490 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5af77fe640 1 -- 172.21.15.53:0/2572368295 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f5b0c03db10 con 0x5595c09ea490 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5b24a12740 10 client.16905 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5b24a12740 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5b24a12740 20 client.16905 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595c09d1cd0 0x5595c0dd7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5b24a12740 4 client.16905 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5b24a12740 1 -- 172.21.15.53:0/2572368295 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595c0d2cfe0 con 0x5595c09d1cd0 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.975+0000 7f5b17fff640 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595c09d1cd0 0x5595c0dd7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.976+0000 7f5b17fff640 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595c09d1cd0 0x5595c0dd7090 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=352899aba45fe7e6 server_cookie=f3424135b8894745 in_seq=0 out_seq=0 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.976+0000 7f5af77fe640 10 client.16905 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5af77fe640 1 -- 172.21.15.53:0/2572368295 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595c0d2cfe0 con 0x5595c09d1cd0 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5af77fe640 10 client.16905 handle_command_reply: tid=0 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 1 client.16905 shutdown 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 1 -- 172.21.15.53:0/2572368295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09ea490 msgr2=0x5595c0dc4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09ea490 0x5595c0dc4f30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c001eb0 tx=0x7f5b0c032e50 comp rx=0 tx=0).stop 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 1 -- 172.21.15.53:0/2572368295 shutdown_connections 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595c09d1cd0 0x5595c0dd7090 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c0a13350 0x5595c0dd1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5af77fe640 0 client.16905 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:32.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09f2670 0x5595c0dc5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2572368295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09ea490 0x5595c0dc4f30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:32.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 1 -- 172.21.15.53:0/2572368295 >> 172.21.15.53:0/2572368295 conn(0x5595c0a07740 msgr2=0x5595c0dbc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:32.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 1 -- 172.21.15.53:0/2572368295 shutdown_connections 2024-08-31T06:08:32.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 1 -- 172.21.15.53:0/2572368295 wait complete. 2024-08-31T06:08:32.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.977+0000 7f5b24a12740 20 client.16905 trim_cache size 0 max 16384 2024-08-31T06:08:33.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.995+0000 7f5b24a12740 1 Processor -- start 2024-08-31T06:08:33.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b24a12740 1 -- start start 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09d1cd0 0x5595c0dc5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09ea490 0x5595c0dc6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dbae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b24a12740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181b1670 con 0x5595c09f2670 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b24a12740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181b3270 con 0x5595c09d1cd0 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b24a12740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181b1d40 con 0x5595c09ea490 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dbae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dbae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35624/0 (socket says 172.21.15.53:35624) 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b177fe640 1 -- 172.21.15.53:0/698666615 learned_addr learned my addr 172.21.15.53:0/698666615 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b177fe640 1 --2- 172.21.15.53:0/698666615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09d1cd0 0x5595c0dc5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b17fff640 1 --2- 172.21.15.53:0/698666615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09ea490 0x5595c0dc6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b177fe640 1 -- 172.21.15.53:0/698666615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09ea490 msgr2=0x5595c0dc6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b177fe640 1 --2- 172.21.15.53:0/698666615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09ea490 0x5595c0dc6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b177fe640 1 -- 172.21.15.53:0/698666615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09d1cd0 msgr2=0x5595c0dc5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b177fe640 1 --2- 172.21.15.53:0/698666615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09d1cd0 0x5595c0dc5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.996+0000 7f5b177fe640 1 -- 172.21.15.53:0/698666615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c0dc3e90 con 0x5595c09f2670 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.997+0000 7f5b177fe640 1 --2- 172.21.15.53:0/698666615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dbae70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c02a930 tx=0x7f5b0c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4e985f46b40a84 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.997+0000 7f5afdffb640 1 -- 172.21.15.53:0/698666615 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c05b070 con 0x5595c09f2670 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.997+0000 7f5afdffb640 1 -- 172.21.15.53:0/698666615 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b0c05c040 con 0x5595c09f2670 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.997+0000 7f5afdffb640 1 -- 172.21.15.53:0/698666615 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c035040 con 0x5595c09f2670 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.998+0000 7f5b24a12740 1 -- 172.21.15.53:0/698666615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 msgr2=0x5595c0dbae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.998+0000 7f5b24a12740 1 --2- 172.21.15.53:0/698666615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dbae70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c02a930 tx=0x7f5b0c005fd0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.998+0000 7f5b24a12740 1 -- 172.21.15.53:0/698666615 shutdown_connections 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.998+0000 7f5b24a12740 1 --2- 172.21.15.53:0/698666615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09f2670 0x5595c0dbae70 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.998+0000 7f5b24a12740 1 --2- 172.21.15.53:0/698666615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09ea490 0x5595c0dc6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.998+0000 7f5b24a12740 1 --2- 172.21.15.53:0/698666615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09d1cd0 0x5595c0dc5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.998+0000 7f5b24a12740 1 -- 172.21.15.53:0/698666615 >> 172.21.15.53:0/698666615 conn(0x5595c0a07740 msgr2=0x5595c0dba760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.998+0000 7f5b24a12740 1 -- 172.21.15.53:0/698666615 shutdown_connections 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.998+0000 7f5b24a12740 1 -- 172.21.15.53:0/698666615 wait complete. 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.998+0000 7f5b24a12740 1 -- start start 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.998+0000 7f5b24a12740 1 Processor -- start 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09d1cd0 0x5595c0dd8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09ea490 0x5595c0dd8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b24a12740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09f2670 0x5595c0e40810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b24a12740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181b2ae0 con 0x5595c09d1cd0 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b24a12740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181b2410 con 0x5595c09ea490 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b24a12740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181af650 con 0x5595c09f2670 2024-08-31T06:08:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b24a12740 10 client.0 _ll_register_callbacks cb 0x7f5b0800c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09d1cd0 0x5595c0dd8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09d1cd0 0x5595c0dd8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35634/0 (socket says 172.21.15.53:35634) 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b177fe640 1 -- 172.21.15.53:0/2004762609 learned_addr learned my addr 172.21.15.53:0/2004762609 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b17fff640 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09ea490 0x5595c0dd8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b177fe640 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09f2670 0x5595c0e40810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b177fe640 1 -- 172.21.15.53:0/2004762609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09f2670 msgr2=0x5595c0e40810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b177fe640 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09f2670 0x5595c0e40810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b177fe640 1 -- 172.21.15.53:0/2004762609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09ea490 msgr2=0x5595c0dd8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b177fe640 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09ea490 0x5595c0dd8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b177fe640 1 -- 172.21.15.53:0/2004762609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c0e40d50 con 0x5595c09d1cd0 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5b177fe640 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09d1cd0 0x5595c0dd8450 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0495c0 tx=0x7f5b0c049550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a405856c3cfd3cb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:32.999+0000 7f5af77fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5af77fe640 1 -- 172.21.15.53:0/2004762609 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c05b070 con 0x5595c09d1cd0 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5af77fe640 1 -- 172.21.15.53:0/2004762609 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5b0c003ab0 con 0x5595c09d1cd0 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5b24a12740 1 -- 172.21.15.53:0/2004762609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b0c05c040 con 0x5595c09d1cd0 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5af77fe640 1 -- 172.21.15.53:0/2004762609 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5b0c035040 con 0x5595c09d1cd0 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5b24a12740 10 client.16911 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5b24a12740 1 -- 172.21.15.53:0/2004762609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5595c0e41e60 con 0x5595c09d1cd0 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5af77fe640 1 -- 172.21.15.53:0/2004762609 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b0c05c040 con 0x5595c09d1cd0 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5af77fe640 1 -- 172.21.15.53:0/2004762609 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f5b0c06b420 con 0x5595c09d1cd0 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5b24a12740 10 client.16911 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5b24a12740 10 client.16911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5b24a12740 20 client.16911 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595c0a13350 0x5595c0e44650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5b24a12740 4 client.16911 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.000+0000 7f5b24a12740 1 -- 172.21.15.53:0/2004762609 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5595c0d2a720 con 0x5595c0a13350 2024-08-31T06:08:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.001+0000 7f5b17fff640 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595c0a13350 0x5595c0e44650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:33.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.001+0000 7f5b17fff640 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595c0a13350 0x5595c0e44650 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e43ae2061ad64c7 server_cookie=a054878f19d00dfc in_seq=0 out_seq=0 2024-08-31T06:08:33.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.001+0000 7f5af77fe640 10 client.16911 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:33.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5af77fe640 1 -- 172.21.15.53:0/2004762609 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5595c0d2a720 con 0x5595c0a13350 2024-08-31T06:08:33.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5af77fe640 10 client.16911 handle_command_reply: tid=0 2024-08-31T06:08:33.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 1 client.16911 shutdown 2024-08-31T06:08:33.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 1 -- 172.21.15.53:0/2004762609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09d1cd0 msgr2=0x5595c0dd8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:33.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09d1cd0 0x5595c0dd8450 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0495c0 tx=0x7f5b0c049550 comp rx=0 tx=0).stop 2024-08-31T06:08:33.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 1 -- 172.21.15.53:0/2004762609 shutdown_connections 2024-08-31T06:08:33.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595c0a13350 0x5595c0e44650 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595c09f2670 0x5595c0e40810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5af77fe640 0 client.16911 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:33.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595c09ea490 0x5595c0dd8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 1 --2- 172.21.15.53:0/2004762609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595c09d1cd0 0x5595c0dd8450 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 1 -- 172.21.15.53:0/2004762609 >> 172.21.15.53:0/2004762609 conn(0x5595c0a07740 msgr2=0x5595c0dc61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:33.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 1 -- 172.21.15.53:0/2004762609 shutdown_connections 2024-08-31T06:08:33.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 1 -- 172.21.15.53:0/2004762609 wait complete. 2024-08-31T06:08:33.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.003+0000 7f5b24a12740 20 client.16911 trim_cache size 0 max 16384 2024-08-31T06:08:33.011 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:08:33.011 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:08:33.011 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "b8913bba-c1e2-47fb-86e0-4a4609bf2808", 2024-08-31T06:08:33.011 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:08:33.012 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:08:33.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 -- 172.21.15.53:0/1134762145 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b000b4d20 msgr2=0x7f5b000b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:33.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b000b4d20 0x7f5b000b7230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5b100e2ff0 tx=0x7f5b10070040 comp rx=0 tx=0).stop 2024-08-31T06:08:33.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 -- 172.21.15.53:0/1134762145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b1810dbd0 msgr2=0x7f5b181a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:33.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b1810dbd0 0x7f5b181a1c00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000cad0 tx=0x7f5b1000cf90 comp rx=0 tx=0).stop 2024-08-31T06:08:33.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 -- 172.21.15.53:0/1134762145 shutdown_connections 2024-08-31T06:08:33.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b000b4d20 0x7f5b000b7230 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b1810dbd0 0x7f5b181a1c00 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b18105050 0x7f5b1819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 --2- 172.21.15.53:0/1134762145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b18104620 0x7f5b1819c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:33.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 -- 172.21.15.53:0/1134762145 >> 172.21.15.53:0/1134762145 conn(0x7f5b180794e0 msgr2=0x7f5b18109c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:33.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 -- 172.21.15.53:0/1134762145 shutdown_connections 2024-08-31T06:08:33.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:33.004+0000 7f5b1e49d640 1 -- 172.21.15.53:0/1134762145 wait complete. 2024-08-31T06:08:33.379 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:08:33.017+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000215 [...6,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL/ auth{1=1,2=1,3=1,4=1} v12146 ap=3 f(v234 m2024-08-31T06:08:17.742882+0000 11=11+0) n(v9 rc2024-08-31T06:08:17.742882+0000 b2861056 12=11+1) old_inodes=2 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:145 nref=3)) caps={15441=pAsLsXs/-@8011} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e69a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000215:[<0x10000000009/COREL v1154>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000215:[<0x10000000009/COREL v12146>,<0x10000000008/~dmtmp v4899>,<0x10000000007/client0 v291>,<0x10000000006/clients v271>,<0x10000000005/tmp v269>,<0x10000000003/client.0 v268>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v273>,<0x10000000001/sv_0 v287>,<0x10000000000/qa v274>,<0x1/volumes v274>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:08:17.731044+0000 12=12+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:08:17.742882+0000 b2861056 12=11+1)","memory_value.dirstat":"f(v234 m2024-08-31T06:08:17.742882+0000 11=11+0)","memory_value.rstat":"n(v9 rc2024-08-31T06:08:17.742882+0000 b2861056 12=11+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:08:33.379 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:08:33.017+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000208 [...6,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORD/ auth{1=1,2=1,3=1,4=1} v12154 ap=3 f(v194 m2024-08-31T06:08:17.601916+0000 3=3+0) n(v9 rc2024-08-31T06:08:17.601916+0000 b780288 4=3+1) old_inodes=2 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:147 nref=3)) caps={15441=pAsLsXs/-@7836} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5613e676b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000208:[<0x10000000009/WORD v1430>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000208:[<0x10000000009/WORD v12154>,<0x10000000008/~dmtmp v4899>,<0x10000000007/client0 v291>,<0x10000000006/clients v271>,<0x10000000005/tmp v269>,<0x10000000003/client.0 v268>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v273>,<0x10000000001/sv_0 v287>,<0x10000000000/qa v274>,<0x1/volumes v274>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:08:17.589883+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:08:17.601916+0000 b780288 4=3+1)","memory_value.dirstat":"f(v194 m2024-08-31T06:08:17.601916+0000 3=3+0)","memory_value.rstat":"n(v9 rc2024-08-31T06:08:17.601916+0000 b780288 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:08:33.379 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:08:33.019+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020c [...6,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL/ auth{1=1,2=1,3=1,4=1} v12156 ap=3 f(v310 m2024-08-31T06:08:17.667993+0000 2=2+0) n(v8 rc2024-08-31T06:08:17.667993+0000 b520192 3=2+1) old_inodes=2 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:146 nref=3)) caps={15441=pAsLsXs/-@8575} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e67e1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000020c:[<0x10000000009/EXCEL v1138>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x1000000020c:[<0x10000000009/EXCEL v12156>,<0x10000000008/~dmtmp v4899>,<0x10000000007/client0 v291>,<0x10000000006/clients v271>,<0x10000000005/tmp v269>,<0x10000000003/client.0 v268>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v273>,<0x10000000001/sv_0 v287>,<0x10000000000/qa v274>,<0x1/volumes v274>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:08:17.655917+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:08:17.667993+0000 b520192 3=2+1)","memory_value.dirstat":"f(v310 m2024-08-31T06:08:17.667993+0000 2=2+0)","memory_value.rstat":"n(v8 rc2024-08-31T06:08:17.667993+0000 b520192 3=2+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:08:33.379 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:08:33.020+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000221 [...6,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORDPRO/ auth{1=1,2=1,3=1,4=1} v12144 ap=3 f(v286 m2024-08-31T06:08:17.810902+0000 3=3+0) n(v8 rc2024-08-31T06:08:17.810902+0000 b780288 4=3+1) old_inodes=2 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:149 nref=3)) caps={15441=pAsLsXs/-@8433} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e6960c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000221:[<0x10000000009/WORDPRO v1168>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000221:[<0x10000000009/WORDPRO v12144>,<0x10000000008/~dmtmp v4899>,<0x10000000007/client0 v291>,<0x10000000006/clients v271>,<0x10000000005/tmp v269>,<0x10000000003/client.0 v268>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v273>,<0x10000000001/sv_0 v287>,<0x10000000000/qa v274>,<0x1/volumes v274>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:08:17.797211+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:08:17.810902+0000 b780288 4=3+1)","memory_value.dirstat":"f(v286 m2024-08-31T06:08:17.810902+0000 3=3+0)","memory_value.rstat":"n(v8 rc2024-08-31T06:08:17.810902+0000 b780288 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:08:33.379 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:08:33.029+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000225 [...6,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM/ auth{1=1,2=1,3=1,4=1} v12152 ap=3 f(v615 m2024-08-31T06:08:17.818923+0000 3=3+0) n(v8 rc2024-08-31T06:08:17.818923+0000 b780288 4=3+1) old_inodes=2 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:151 nref=3)) caps={15441=pAsLsXs/-@10742} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e69bc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000225:[<0x10000000009/PM v1172>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000225:[<0x10000000009/PM v12152>,<0x10000000008/~dmtmp v4899>,<0x10000000007/client0 v291>,<0x10000000006/clients v271>,<0x10000000005/tmp v269>,<0x10000000003/client.0 v268>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v273>,<0x10000000001/sv_0 v287>,<0x10000000000/qa v274>,<0x1/volumes v274>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:08:17.434553+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:08:17.818923+0000 b780288 4=3+1)","memory_value.dirstat":"f(v615 m2024-08-31T06:08:17.818923+0000 3=3+0)","memory_value.rstat":"n(v8 rc2024-08-31T06:08:17.818923+0000 b780288 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:08:33.379 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:08:33.029+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023e [...6,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/ACCESS/ auth{1=1,2=1,3=1,4=1} v12150 ap=3 f(v115 m2024-08-31T06:08:17.901930+0000 1=1+0) n(v8 rc2024-08-31T06:08:17.901930+0000 b260096 2=1+1) old_inodes=2 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:153 nref=3)) caps={15441=pAsLsXs/-@7144} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e69d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000023e:[<0x10000000009/ACCESS v1188>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x1000000023e:[<0x10000000009/ACCESS v12150>,<0x10000000008/~dmtmp v4899>,<0x10000000007/client0 v291>,<0x10000000006/clients v271>,<0x10000000005/tmp v269>,<0x10000000003/client.0 v268>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v273>,<0x10000000001/sv_0 v287>,<0x10000000000/qa v274>,<0x1/volumes v274>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:08:17.891163+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:08:17.901930+0000 b260096 2=1+1)","memory_value.dirstat":"f(v115 m2024-08-31T06:08:17.901930+0000 1=1+0)","memory_value.rstat":"n(v8 rc2024-08-31T06:08:17.901930+0000 b260096 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:08:33.379 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:08:33.030+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000229 [...6,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX/ auth{1=1,2=1,3=1,4=1} v12160 ap=3 f(v315 m2024-08-31T06:08:17.863734+0000 20=20+0) n(v10 rc2024-08-31T06:08:17.863734+0000 b5201920 21=20+1) old_inodes=2 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:150 nref=3)) caps={15441=pAsLsXs/-@9400} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5613e69bdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000229:[<0x10000000009/PARADOX v1182>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000229:[<0x10000000009/PARADOX v12160>,<0x10000000008/~dmtmp v4899>,<0x10000000007/client0 v291>,<0x10000000006/clients v271>,<0x10000000005/tmp v269>,<0x10000000003/client.0 v268>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v273>,<0x10000000001/sv_0 v287>,<0x10000000000/qa v274>,<0x1/volumes v274>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:08:17.853753+0000 21=21+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:08:17.863734+0000 b5201920 21=20+1)","memory_value.dirstat":"f(v315 m2024-08-31T06:08:17.863734+0000 20=20+0)","memory_value.rstat":"n(v10 rc2024-08-31T06:08:17.863734+0000 b5201920 21=20+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:08:33.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:08:33.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.33 MB/sec execute 23 sec latency 15624.946 ms 2024-08-31T06:08:33.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: pgmap v431: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 60 KiB/s wr, 20 op/s 2024-08-31T06:08:33.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:08:33.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:33.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:08:33.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORD) see mds.b log and `damage ls` output for details 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL) see mds.b log and `damage ls` output for details 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORDPRO) see mds.b log and `damage ls` output for details 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:08:33.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/ACCESS) see mds.b log and `damage ls` output for details 2024-08-31T06:08:33.978 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2024-08-31T06:08:33.978 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:33.978 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:33 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.119 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: pgmap v431: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 60 KiB/s wr, 20 op/s 2024-08-31T06:08:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:08:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORD) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORDPRO) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:08:34.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/ACCESS) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:33 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: pgmap v431: 97 pgs: 97 active+clean; 38 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 60 KiB/s wr, 20 op/s 2024-08-31T06:08:34.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:08:34.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:08:34.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:08:34.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:08:34.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:08:34.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORD) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORDPRO) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/ACCESS) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:33 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:08:34.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.611+0000 7f13cb579640 1 -- 172.21.15.53:0/3157002880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13c4108160 msgr2=0x7f13c4108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:34.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.611+0000 7f13cb579640 1 --2- 172.21.15.53:0/3157002880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13c4108160 0x7f13c4108570 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009900 tx=0x7f13b402a410 comp rx=0 tx=0).stop 2024-08-31T06:08:34.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.612+0000 7f13cb579640 1 -- 172.21.15.53:0/3157002880 shutdown_connections 2024-08-31T06:08:34.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.612+0000 7f13cb579640 1 --2- 172.21.15.53:0/3157002880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13c4108ab0 0x7f13c410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.612+0000 7f13cb579640 1 --2- 172.21.15.53:0/3157002880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13c4108160 0x7f13c4108570 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.612+0000 7f13cb579640 1 --2- 172.21.15.53:0/3157002880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13c4102820 0x7f13c4102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.612+0000 7f13cb579640 1 -- 172.21.15.53:0/3157002880 >> 172.21.15.53:0/3157002880 conn(0x7f13c40794e0 msgr2=0x7f13c40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:34.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.612+0000 7f13cb579640 1 -- 172.21.15.53:0/3157002880 shutdown_connections 2024-08-31T06:08:34.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.612+0000 7f13cb579640 1 -- 172.21.15.53:0/3157002880 wait complete. 2024-08-31T06:08:34.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.612+0000 7f13cb579640 1 Processor -- start 2024-08-31T06:08:34.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.612+0000 7f13cb579640 1 -- start start 2024-08-31T06:08:34.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13cb579640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13c4102820 0x7f13c419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13cb579640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13c4108160 0x7f13c419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13cb579640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13c4108ab0 0x7f13c419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13cb579640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13c4112590 con 0x7f13c4102820 2024-08-31T06:08:34.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13cb579640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13c4112410 con 0x7f13c4108160 2024-08-31T06:08:34.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13cb579640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13c4112710 con 0x7f13c4108ab0 2024-08-31T06:08:34.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13c9315640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13c4102820 0x7f13c419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13c9315640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13c4102820 0x7f13c419a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58848/0 (socket says 172.21.15.53:58848) 2024-08-31T06:08:34.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13c9315640 1 -- 172.21.15.53:0/2627151319 learned_addr learned my addr 172.21.15.53:0/2627151319 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13c9b16640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13c4108ab0 0x7f13c419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13c8b14640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13c4108160 0x7f13c419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13c9315640 1 -- 172.21.15.53:0/2627151319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13c4108ab0 msgr2=0x7f13c419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13c9315640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13c4108ab0 0x7f13c419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13c9315640 1 -- 172.21.15.53:0/2627151319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13c4108160 msgr2=0x7f13c419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13c9315640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13c4108160 0x7f13c419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13c9315640 1 -- 172.21.15.53:0/2627151319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c41a0160 con 0x7f13c4102820 2024-08-31T06:08:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13c9315640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13c4102820 0x7f13c419a1f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f13c000d950 tx=0x7f13c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13ba7fc640 1 -- 172.21.15.53:0/2627151319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0017070 con 0x7f13c4102820 2024-08-31T06:08:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13ba7fc640 1 -- 172.21.15.53:0/2627151319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13c0009c30 con 0x7f13c4102820 2024-08-31T06:08:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.613+0000 7f13ba7fc640 1 -- 172.21.15.53:0/2627151319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c000f620 con 0x7f13c4102820 2024-08-31T06:08:34.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.614+0000 7f13cb579640 1 -- 172.21.15.53:0/2627151319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c41a0450 con 0x7f13c4102820 2024-08-31T06:08:34.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.614+0000 7f13cb579640 1 -- 172.21.15.53:0/2627151319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c41a6bb0 con 0x7f13c4102820 2024-08-31T06:08:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.616+0000 7f13d1aee740 1 Processor -- start 2024-08-31T06:08:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.616+0000 7f13ba7fc640 1 -- 172.21.15.53:0/2627151319 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f13c0010460 con 0x7f13c4102820 2024-08-31T06:08:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.616+0000 7f13d1aee740 1 -- start start 2024-08-31T06:08:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e76303c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c6e1b0 0x55e76303c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c76390 0x55e76303cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13d1aee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e762fb3630 con 0x55e762c97070 2024-08-31T06:08:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13d1aee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e762fa2bc0 con 0x55e762c76390 2024-08-31T06:08:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13d1aee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e762fa6b70 con 0x55e762c6e1b0 2024-08-31T06:08:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13c9b16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e76303c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13c9b16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e76303c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58852/0 (socket says 172.21.15.53:58852) 2024-08-31T06:08:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13c9b16640 1 -- 172.21.15.53:0/3225243946 learned_addr learned my addr 172.21.15.53:0/3225243946 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13c9315640 1 --2- 172.21.15.53:0/3225243946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c6e1b0 0x55e76303c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13c8b14640 1 --2- 172.21.15.53:0/3225243946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c76390 0x55e76303cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13c9b16640 1 -- 172.21.15.53:0/3225243946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c6e1b0 msgr2=0x55e76303c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13c9b16640 1 --2- 172.21.15.53:0/3225243946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c6e1b0 0x55e76303c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13c9b16640 1 -- 172.21.15.53:0/3225243946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c76390 msgr2=0x55e76303cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13c9b16640 1 --2- 172.21.15.53:0/3225243946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c76390 0x55e76303cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13c9b16640 1 -- 172.21.15.53:0/3225243946 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e762d02650 con 0x55e762c97070 2024-08-31T06:08:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.617+0000 7f13ba7fc640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13b00b4ca0 0x7f13b00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.618+0000 7f13c9b16640 1 --2- 172.21.15.53:0/3225243946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e76303c2c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009fa0 tx=0x7f13bc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e587176f7a0e924e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.618+0000 7f13c9315640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13b00b4ca0 0x7f13b00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.618+0000 7f13ba7fc640 1 -- 172.21.15.53:0/2627151319 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f13c00e50f0 con 0x7f13c4102820 2024-08-31T06:08:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.618+0000 7f13af7fe640 1 -- 172.21.15.53:0/3225243946 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc016070 con 0x55e762c97070 2024-08-31T06:08:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.618+0000 7f13af7fe640 1 -- 172.21.15.53:0/3225243946 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13bc004d20 con 0x55e762c97070 2024-08-31T06:08:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.618+0000 7f13af7fe640 1 -- 172.21.15.53:0/3225243946 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc012770 con 0x55e762c97070 2024-08-31T06:08:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.619+0000 7f13d1aee740 1 -- 172.21.15.53:0/3225243946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 msgr2=0x55e76303c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.619+0000 7f13d1aee740 1 --2- 172.21.15.53:0/3225243946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e76303c2c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009fa0 tx=0x7f13bc010800 comp rx=0 tx=0).stop 2024-08-31T06:08:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.619+0000 7f13c9315640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13b00b4ca0 0x7f13b00b71b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f13c00e2990 tx=0x7f13c00a7800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.619+0000 7f13d1aee740 1 -- 172.21.15.53:0/3225243946 shutdown_connections 2024-08-31T06:08:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.619+0000 7f13d1aee740 1 --2- 172.21.15.53:0/3225243946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c76390 0x55e76303cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.619+0000 7f13d1aee740 1 --2- 172.21.15.53:0/3225243946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c6e1b0 0x55e76303c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.619+0000 7f13d1aee740 1 --2- 172.21.15.53:0/3225243946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e76303c2c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.619+0000 7f13d1aee740 1 -- 172.21.15.53:0/3225243946 >> 172.21.15.53:0/3225243946 conn(0x55e762c8b460 msgr2=0x55e76303a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:34.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.619+0000 7f13d1aee740 1 -- 172.21.15.53:0/3225243946 shutdown_connections 2024-08-31T06:08:34.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.619+0000 7f13d1aee740 1 -- 172.21.15.53:0/3225243946 wait complete. 2024-08-31T06:08:34.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.619+0000 7f13d1aee740 1 -- start start 2024-08-31T06:08:34.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13d1aee740 1 Processor -- start 2024-08-31T06:08:34.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c6e1b0 0x55e76304be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c97070 0x55e763058100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13d1aee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e762e05700 con 0x55e762c76390 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13d1aee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e762f29700 con 0x55e762c6e1b0 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13d1aee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e76304edd0 con 0x55e762c97070 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13d1aee740 10 client.0 _ll_register_callbacks cb 0x55e762f58dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13c8b14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13c8b14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58866/0 (socket says 172.21.15.53:58866) 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13c8b14640 1 -- 172.21.15.53:0/4192938332 learned_addr learned my addr 172.21.15.53:0/4192938332 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13c9b16640 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c6e1b0 0x55e76304be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.620+0000 7f13c9b16640 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c97070 0x55e763058100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13c8b14640 1 -- 172.21.15.53:0/4192938332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c97070 msgr2=0x55e763058100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13c8b14640 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c97070 0x55e763058100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13c8b14640 1 -- 172.21.15.53:0/4192938332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c6e1b0 msgr2=0x55e76304be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13c8b14640 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c6e1b0 0x55e76304be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13c8b14640 1 -- 172.21.15.53:0/4192938332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e762f628b0 con 0x55e762c76390 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13c9b16640 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c97070 0x55e763058100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13c8b14640 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304c360 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f13b4000c00 tx=0x7f13b4031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d759aa682221e772 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13acff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13acff9640 1 -- 172.21.15.53:0/4192938332 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4035070 con 0x55e762c76390 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13d1aee740 1 -- 172.21.15.53:0/4192938332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13bc004d20 con 0x55e762c76390 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13acff9640 1 -- 172.21.15.53:0/4192938332 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f13b4004040 con 0x55e762c76390 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13acff9640 1 -- 172.21.15.53:0/4192938332 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f13b4004240 con 0x55e762c76390 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13d1aee740 10 client.16923 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13d1aee740 1 -- 172.21.15.53:0/4192938332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e76305ac10 con 0x55e762c76390 2024-08-31T06:08:34.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.621+0000 7f13acff9640 1 -- 172.21.15.53:0/4192938332 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13bc004d20 con 0x55e762c76390 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.622+0000 7f13acff9640 1 -- 172.21.15.53:0/4192938332 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f13b4004930 con 0x55e762c76390 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.622+0000 7f13d1aee740 10 client.16923 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.622+0000 7f13d1aee740 10 client.16923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.622+0000 7f13d1aee740 20 client.16923 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.622+0000 7f13d1aee740 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e762c559f0 0x55e76305e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.622+0000 7f13d1aee740 4 client.16923 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.622+0000 7f13d1aee740 1 -- 172.21.15.53:0/4192938332 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e762fb5580 con 0x55e762c559f0 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.622+0000 7f13c9b16640 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e762c559f0 0x55e76305e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.622+0000 7f13acff9640 10 client.16923 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.622+0000 7f13c9b16640 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e762c559f0 0x55e76305e180 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d713fd36e65dc401 server_cookie=f5f8269e1581d21c in_seq=0 out_seq=0 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13acff9640 1 -- 172.21.15.53:0/4192938332 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e762fb5580 con 0x55e762c559f0 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13acff9640 10 client.16923 handle_command_reply: tid=0 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13d1aee740 1 client.16923 shutdown 2024-08-31T06:08:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13d1aee740 1 -- 172.21.15.53:0/4192938332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 msgr2=0x55e76304c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13d1aee740 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304c360 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f13b4000c00 tx=0x7f13b4031630 comp rx=0 tx=0).stop 2024-08-31T06:08:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13d1aee740 1 -- 172.21.15.53:0/4192938332 shutdown_connections 2024-08-31T06:08:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13d1aee740 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e762c559f0 0x55e76305e180 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13d1aee740 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c97070 0x55e763058100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13d1aee740 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304c360 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13d1aee740 1 --2- 172.21.15.53:0/4192938332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c6e1b0 0x55e76304be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13d1aee740 1 -- 172.21.15.53:0/4192938332 >> 172.21.15.53:0/4192938332 conn(0x55e762c8b460 msgr2=0x55e76303f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.623+0000 7f13acff9640 0 client.16923 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.624+0000 7f13d1aee740 1 -- 172.21.15.53:0/4192938332 shutdown_connections 2024-08-31T06:08:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.624+0000 7f13d1aee740 1 -- 172.21.15.53:0/4192938332 wait complete. 2024-08-31T06:08:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.624+0000 7f13d1aee740 20 client.16923 trim_cache size 0 max 16384 2024-08-31T06:08:34.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.641+0000 7f13d1aee740 1 Processor -- start 2024-08-31T06:08:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.641+0000 7f13d1aee740 1 -- start start 2024-08-31T06:08:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c6e1b0 0x55e7630475d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c76390 0x55e76303a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e763058000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13d1aee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13c41ad350 con 0x55e762c97070 2024-08-31T06:08:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13d1aee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13c41aef50 con 0x55e762c76390 2024-08-31T06:08:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13d1aee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13c41ada20 con 0x55e762c6e1b0 2024-08-31T06:08:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c9b16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e763058000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c9b16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e763058000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58872/0 (socket says 172.21.15.53:58872) 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c9b16640 1 -- 172.21.15.53:0/2684188395 learned_addr learned my addr 172.21.15.53:0/2684188395 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c9b16640 1 --2- 172.21.15.53:0/2684188395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c6e1b0 0x55e7630475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c8b14640 1 --2- 172.21.15.53:0/2684188395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c76390 0x55e76303a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c9b16640 1 -- 172.21.15.53:0/2684188395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c6e1b0 msgr2=0x55e7630475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c9b16640 1 --2- 172.21.15.53:0/2684188395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c6e1b0 0x55e7630475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c9b16640 1 -- 172.21.15.53:0/2684188395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c76390 msgr2=0x55e76303a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c9b16640 1 --2- 172.21.15.53:0/2684188395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c76390 0x55e76303a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c9b16640 1 -- 172.21.15.53:0/2684188395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e76303aaa0 con 0x55e762c97070 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c8b14640 1 --2- 172.21.15.53:0/2684188395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c76390 0x55e76303a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13c9b16640 1 --2- 172.21.15.53:0/2684188395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e763058000 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f13bc005a80 tx=0x7f13bc009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc2d2cdf8332755 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.642+0000 7f13aeffd640 1 -- 172.21.15.53:0/2684188395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc016070 con 0x55e762c97070 2024-08-31T06:08:34.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.643+0000 7f13aeffd640 1 -- 172.21.15.53:0/2684188395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13bc029030 con 0x55e762c97070 2024-08-31T06:08:34.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.643+0000 7f13aeffd640 1 -- 172.21.15.53:0/2684188395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc004ee0 con 0x55e762c97070 2024-08-31T06:08:34.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.643+0000 7f13d1aee740 1 -- 172.21.15.53:0/2684188395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 msgr2=0x55e763058000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:34.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.643+0000 7f13d1aee740 1 --2- 172.21.15.53:0/2684188395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e763058000 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f13bc005a80 tx=0x7f13bc009600 comp rx=0 tx=0).stop 2024-08-31T06:08:34.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.643+0000 7f13d1aee740 1 -- 172.21.15.53:0/2684188395 shutdown_connections 2024-08-31T06:08:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.643+0000 7f13d1aee740 1 --2- 172.21.15.53:0/2684188395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c97070 0x55e763058000 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.643+0000 7f13d1aee740 1 --2- 172.21.15.53:0/2684188395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c76390 0x55e76303a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.643+0000 7f13d1aee740 1 --2- 172.21.15.53:0/2684188395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c6e1b0 0x55e7630475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.643+0000 7f13d1aee740 1 -- 172.21.15.53:0/2684188395 >> 172.21.15.53:0/2684188395 conn(0x55e762c8b460 msgr2=0x55e763039af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.643+0000 7f13d1aee740 1 -- 172.21.15.53:0/2684188395 shutdown_connections 2024-08-31T06:08:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.643+0000 7f13d1aee740 1 -- 172.21.15.53:0/2684188395 wait complete. 2024-08-31T06:08:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.644+0000 7f13d1aee740 1 -- start start 2024-08-31T06:08:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.644+0000 7f13d1aee740 1 Processor -- start 2024-08-31T06:08:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.644+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c6e1b0 0x55e7630549b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.644+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.644+0000 7f13d1aee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c97070 0x55e763050500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.644+0000 7f13d1aee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13c41ae7c0 con 0x55e762c76390 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.644+0000 7f13d1aee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13c41ae0f0 con 0x55e762c6e1b0 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.644+0000 7f13d1aee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13c41ab330 con 0x55e762c97070 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.644+0000 7f13d1aee740 10 client.0 _ll_register_callbacks cb 0x7f13b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.644+0000 7f13c8b14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13c8b14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58878/0 (socket says 172.21.15.53:58878) 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13c8b14640 1 -- 172.21.15.53:0/3751453930 learned_addr learned my addr 172.21.15.53:0/3751453930 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13c9b16640 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c6e1b0 0x55e7630549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13c8b14640 1 -- 172.21.15.53:0/3751453930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c97070 msgr2=0x55e763050500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13c8b14640 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c97070 0x55e763050500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13c8b14640 1 -- 172.21.15.53:0/3751453930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c6e1b0 msgr2=0x55e7630549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13c8b14640 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c6e1b0 0x55e7630549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13c8b14640 1 -- 172.21.15.53:0/3751453930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e763050c90 con 0x55e762c76390 2024-08-31T06:08:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13c9b16640 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c6e1b0 0x55e7630549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:08:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13c8b14640 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304fe60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f13b40057c0 tx=0x7f13b4005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a782dd3a65f40d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13acff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13acff9640 1 -- 172.21.15.53:0/3751453930 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4051070 con 0x55e762c76390 2024-08-31T06:08:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13d1aee740 1 -- 172.21.15.53:0/3751453930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13bc029030 con 0x55e762c76390 2024-08-31T06:08:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13acff9640 1 -- 172.21.15.53:0/3751453930 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f13b4005140 con 0x55e762c76390 2024-08-31T06:08:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13acff9640 1 -- 172.21.15.53:0/3751453930 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f13b4035040 con 0x55e762c76390 2024-08-31T06:08:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13d1aee740 10 client.16929 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.645+0000 7f13d1aee740 1 -- 172.21.15.53:0/3751453930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e7630c8c00 con 0x55e762c76390 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.646+0000 7f13acff9640 1 -- 172.21.15.53:0/3751453930 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13bc029030 con 0x55e762c76390 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.646+0000 7f13acff9640 1 -- 172.21.15.53:0/3751453930 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f13b40316a0 con 0x55e762c76390 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.646+0000 7f13d1aee740 10 client.16929 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.646+0000 7f13d1aee740 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.646+0000 7f13d1aee740 20 client.16929 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.646+0000 7f13d1aee740 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e762c2ada0 0x55e7630cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.646+0000 7f13d1aee740 4 client.16929 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.646+0000 7f13d1aee740 1 -- 172.21.15.53:0/3751453930 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e762fb1020 con 0x55e762c2ada0 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.646+0000 7f13c9b16640 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e762c2ada0 0x55e7630cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13acff9640 10 client.16929 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13c9b16640 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e762c2ada0 0x55e7630cb4f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fc7583191c331d5 server_cookie=e20a2c7a0bb70343 in_seq=0 out_seq=0 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13acff9640 1 -- 172.21.15.53:0/3751453930 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55e762fb1020 con 0x55e762c2ada0 2024-08-31T06:08:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13acff9640 10 client.16929 handle_command_reply: tid=0 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 1 client.16929 shutdown 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 1 -- 172.21.15.53:0/3751453930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 msgr2=0x55e76304fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304fe60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f13b40057c0 tx=0x7f13b4005d50 comp rx=0 tx=0).stop 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 1 -- 172.21.15.53:0/3751453930 shutdown_connections 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e762c2ada0 0x55e7630cb4f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e762c97070 0x55e763050500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e762c76390 0x55e76304fe60 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 1 --2- 172.21.15.53:0/3751453930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e762c6e1b0 0x55e7630549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13acff9640 0 client.16929 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 1 -- 172.21.15.53:0/3751453930 >> 172.21.15.53:0/3751453930 conn(0x55e762c8b460 msgr2=0x55e76303dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 1 -- 172.21.15.53:0/3751453930 shutdown_connections 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 1 -- 172.21.15.53:0/3751453930 wait complete. 2024-08-31T06:08:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.647+0000 7f13d1aee740 20 client.16929 trim_cache size 0 max 16384 2024-08-31T06:08:34.657 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:08:34.657 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:08:34.657 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:08:34.657 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:08:34.657 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:34.657 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "b8913bba-c1e2-47fb-86e0-4a4609bf2808", 2024-08-31T06:08:34.657 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:08:34.657 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:34.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:34.657 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:34.658 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:08:34.659 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:08:34.660 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:08:34.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:34.661 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:08:34.661 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:08:34.661 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:08:34.661 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:08:34.661 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:08:34.661 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:08:34.661 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:08:34.661 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:34.661 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:34.661 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:08:34.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 -- 172.21.15.53:0/2627151319 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13b00b4ca0 msgr2=0x7f13b00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:34.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13b00b4ca0 0x7f13b00b71b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f13c00e2990 tx=0x7f13c00a7800 comp rx=0 tx=0).stop 2024-08-31T06:08:34.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 -- 172.21.15.53:0/2627151319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13c4102820 msgr2=0x7f13c419a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:34.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13c4102820 0x7f13c419a1f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f13c000d950 tx=0x7f13c000de10 comp rx=0 tx=0).stop 2024-08-31T06:08:34.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 -- 172.21.15.53:0/2627151319 shutdown_connections 2024-08-31T06:08:34.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f13b00b4ca0 0x7f13b00b71b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13c4108ab0 0x7f13c419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13c4108160 0x7f13c419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 --2- 172.21.15.53:0/2627151319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13c4102820 0x7f13c419a1f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:34.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 -- 172.21.15.53:0/2627151319 >> 172.21.15.53:0/2627151319 conn(0x7f13c40794e0 msgr2=0x7f13c406bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:34.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 -- 172.21.15.53:0/2627151319 shutdown_connections 2024-08-31T06:08:34.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:34.648+0000 7f13cb579640 1 -- 172.21.15.53:0/2627151319 wait complete. 2024-08-31T06:08:34.965 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.32 MB/sec execute 24 sec latency 16624.975 ms 2024-08-31T06:08:35.457 INFO:tasks.cephfs.filesystem:scrub status for tag:b8913bba-c1e2-47fb-86e0-4a4609bf2808 - {'path': '/', 'tag': 'b8913bba-c1e2-47fb-86e0-4a4609bf2808', 'options': 'recursive,force'} 2024-08-31T06:08:35.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.31 MB/sec execute 25 sec latency 17625.031 ms 2024-08-31T06:08:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:35 smithi130 ceph-mon[22266]: pgmap v432: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-08-31T06:08:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:35 smithi153 ceph-mon[22320]: pgmap v432: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-08-31T06:08:36.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:35 smithi053 ceph-mon[18924]: pgmap v432: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-08-31T06:08:36.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.29 MB/sec execute 26 sec latency 18625.137 ms 2024-08-31T06:08:37.345 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:08:37.611 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:37.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.28 MB/sec execute 27 sec latency 19625.182 ms 2024-08-31T06:08:38.009 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:37 smithi053 ceph-mon[18924]: pgmap v433: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:08:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.096+0000 7fc723994640 1 -- 172.21.15.53:0/2355754054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71c108160 msgr2=0x7fc71c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.096+0000 7fc723994640 1 --2- 172.21.15.53:0/2355754054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71c108160 0x7fc71c108570 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009900 tx=0x7fc70c02a410 comp rx=0 tx=0).stop 2024-08-31T06:08:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.096+0000 7fc723994640 1 -- 172.21.15.53:0/2355754054 shutdown_connections 2024-08-31T06:08:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.096+0000 7fc723994640 1 --2- 172.21.15.53:0/2355754054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c108ab0 0x7fc71c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.096+0000 7fc723994640 1 --2- 172.21.15.53:0/2355754054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71c108160 0x7fc71c108570 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.096+0000 7fc723994640 1 --2- 172.21.15.53:0/2355754054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc71c102820 0x7fc71c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.096+0000 7fc723994640 1 -- 172.21.15.53:0/2355754054 >> 172.21.15.53:0/2355754054 conn(0x7fc71c0794e0 msgr2=0x7fc71c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.097+0000 7fc723994640 1 -- 172.21.15.53:0/2355754054 shutdown_connections 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.097+0000 7fc723994640 1 -- 172.21.15.53:0/2355754054 wait complete. 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.097+0000 7fc723994640 1 Processor -- start 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.097+0000 7fc723994640 1 -- start start 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.097+0000 7fc723994640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc71c102820 0x7fc71c19b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.097+0000 7fc723994640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c108160 0x7fc71c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc723994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71c108ab0 0x7fc71c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc723994640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c112630 con 0x7fc71c108ab0 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc723994640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c1124b0 con 0x7fc71c102820 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc723994640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c1127b0 con 0x7fc71c108160 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc721f31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71c108ab0 0x7fc71c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc721f31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71c108ab0 0x7fc71c19bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58892/0 (socket says 172.21.15.53:58892) 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc721f31640 1 -- 172.21.15.53:0/2964793494 learned_addr learned my addr 172.21.15.53:0/2964793494 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc720f2f640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c108160 0x7fc71c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc721730640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc71c102820 0x7fc71c19b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc721f31640 1 -- 172.21.15.53:0/2964793494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c108160 msgr2=0x7fc71c19b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc721f31640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c108160 0x7fc71c19b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc721f31640 1 -- 172.21.15.53:0/2964793494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc71c102820 msgr2=0x7fc71c19b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc721f31640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc71c102820 0x7fc71c19b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc721f31640 1 -- 172.21.15.53:0/2964793494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c1a6310 con 0x7fc71c108ab0 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc721f31640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71c108ab0 0x7fc71c19bb00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc71400eaa0 tx=0x7fc71400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc7127fc640 1 -- 172.21.15.53:0/2964793494 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71400cdb0 con 0x7fc71c108ab0 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc7127fc640 1 -- 172.21.15.53:0/2964793494 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc714005020 con 0x7fc71c108ab0 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc723994640 1 -- 172.21.15.53:0/2964793494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c1a6600 con 0x7fc71c108ab0 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc7127fc640 1 -- 172.21.15.53:0/2964793494 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7140116d0 con 0x7fc71c108ab0 2024-08-31T06:08:38.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.098+0000 7fc723994640 1 -- 172.21.15.53:0/2964793494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c1a6b10 con 0x7fc71c108ab0 2024-08-31T06:08:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.099+0000 7fc723994640 1 -- 172.21.15.53:0/2964793494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71c103aa0 con 0x7fc71c108ab0 2024-08-31T06:08:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.101+0000 7fc7127fc640 1 -- 172.21.15.53:0/2964793494 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc7140051d0 con 0x7fc71c108ab0 2024-08-31T06:08:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.102+0000 7fc7127fc640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc7080b4cd0 0x7fc7080b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.102+0000 7fc721730640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc7080b4cd0 0x7fc7080b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.102+0000 7fc7127fc640 1 -- 172.21.15.53:0/2964793494 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fc7140e5ab0 con 0x7fc71c108ab0 2024-08-31T06:08:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.102+0000 7fc721730640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc7080b4cd0 0x7fc7080b71e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc71c06c440 tx=0x7fc718008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:38.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.105+0000 7fc7127fc640 1 -- 172.21.15.53:0/2964793494 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc714016030 con 0x7fc71c108ab0 2024-08-31T06:08:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:37 smithi130 ceph-mon[22266]: pgmap v433: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:08:38.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:37 smithi153 ceph-mon[22320]: pgmap v433: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:08:38.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.329+0000 7fc723994640 1 -- 172.21.15.53:0/2964793494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc71c102c30 con 0x7fc71c108ab0 2024-08-31T06:08:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.330+0000 7fc7127fc640 1 -- 172.21.15.53:0/2964793494 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11992 (secure 0 0 0) 0x7fc71c102c30 con 0x7fc71c108ab0 2024-08-31T06:08:38.336 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:08:38.337 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"btime":"2024-08-31T06:06:51:511613+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:06:50.526609+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:08:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 30 2024-08-31T06:08:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.332+0000 7fc723994640 1 -- 172.21.15.53:0/2964793494 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc7080b4cd0 msgr2=0x7fc7080b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.332+0000 7fc723994640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc7080b4cd0 0x7fc7080b71e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc71c06c440 tx=0x7fc718008040 comp rx=0 tx=0).stop 2024-08-31T06:08:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.332+0000 7fc723994640 1 -- 172.21.15.53:0/2964793494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71c108ab0 msgr2=0x7fc71c19bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.332+0000 7fc723994640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71c108ab0 0x7fc71c19bb00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc71400eaa0 tx=0x7fc71400ef60 comp rx=0 tx=0).stop 2024-08-31T06:08:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.332+0000 7fc723994640 1 -- 172.21.15.53:0/2964793494 shutdown_connections 2024-08-31T06:08:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.332+0000 7fc723994640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc7080b4cd0 0x7fc7080b71e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.332+0000 7fc723994640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71c108ab0 0x7fc71c19bb00 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.332+0000 7fc723994640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c108160 0x7fc71c19b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.332+0000 7fc723994640 1 --2- 172.21.15.53:0/2964793494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc71c102820 0x7fc71c19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.332+0000 7fc723994640 1 -- 172.21.15.53:0/2964793494 >> 172.21.15.53:0/2964793494 conn(0x7fc71c0794e0 msgr2=0x7fc71c1050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.333+0000 7fc723994640 1 -- 172.21.15.53:0/2964793494 shutdown_connections 2024-08-31T06:08:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:38.333+0000 7fc723994640 1 -- 172.21.15.53:0/2964793494 wait complete. 2024-08-31T06:08:38.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54015 0.27 MB/sec execute 28 sec latency 20625.259 ms 2024-08-31T06:08:39.087 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:38 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2964793494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:39.118 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id 315fa883 --release --await' 2024-08-31T06:08:39.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id 315fa883 --release --await 2024-08-31T06:08:39.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:38 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2964793494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:39.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:38 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2964793494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:08:39.374 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:08:39.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.878+0000 7f4a799e4640 1 -- 172.21.15.53:0/422631232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a74102800 msgr2=0x7f4a74102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:39.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.878+0000 7f4a799e4640 1 --2- 172.21.15.53:0/422631232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a74102800 0x7f4a74102c10 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009900 tx=0x7f4a6402a410 comp rx=0 tx=0).stop 2024-08-31T06:08:39.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.878+0000 7f4a799e4640 1 -- 172.21.15.53:0/422631232 shutdown_connections 2024-08-31T06:08:39.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.878+0000 7f4a799e4640 1 --2- 172.21.15.53:0/422631232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a74108a90 0x7f4a7410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.878+0000 7f4a799e4640 1 --2- 172.21.15.53:0/422631232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74108140 0x7f4a74108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.878+0000 7f4a799e4640 1 --2- 172.21.15.53:0/422631232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a74102800 0x7f4a74102c10 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.878+0000 7f4a799e4640 1 -- 172.21.15.53:0/422631232 >> 172.21.15.53:0/422631232 conn(0x7f4a740794d0 msgr2=0x7f4a740798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:39.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.878+0000 7f4a799e4640 1 -- 172.21.15.53:0/422631232 shutdown_connections 2024-08-31T06:08:39.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.879+0000 7f4a799e4640 1 -- 172.21.15.53:0/422631232 wait complete. 2024-08-31T06:08:39.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.879+0000 7f4a799e4640 1 Processor -- start 2024-08-31T06:08:39.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.879+0000 7f4a799e4640 1 -- start start 2024-08-31T06:08:39.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a799e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74102800 0x7f4a7419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a799e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a74108140 0x7f4a7419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a799e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a74108a90 0x7f4a7419f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a799e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741136d0 con 0x7f4a74108a90 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a799e4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74113550 con 0x7f4a74108140 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a799e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74113850 con 0x7f4a74102800 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a74108a90 0x7f4a7419f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a74108a90 0x7f4a7419f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58920/0 (socket says 172.21.15.53:58920) 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a737fe640 1 -- 172.21.15.53:0/3632279411 learned_addr learned my addr 172.21.15.53:0/3632279411 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a6a7fc640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a74108140 0x7f4a7419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a72ffd640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74102800 0x7f4a7419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a737fe640 1 -- 172.21.15.53:0/3632279411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74102800 msgr2=0x7f4a7419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a737fe640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74102800 0x7f4a7419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a737fe640 1 -- 172.21.15.53:0/3632279411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a74108140 msgr2=0x7f4a7419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a737fe640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a74108140 0x7f4a7419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a737fe640 1 -- 172.21.15.53:0/3632279411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a741a0070 con 0x7f4a74108a90 2024-08-31T06:08:39.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.880+0000 7f4a737fe640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a74108a90 0x7f4a7419f940 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00eb10 tx=0x7f4a6c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:39.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.881+0000 7f4a789e2640 1 -- 172.21.15.53:0/3632279411 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c004b20 con 0x7f4a74108a90 2024-08-31T06:08:39.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.881+0000 7f4a789e2640 1 -- 172.21.15.53:0/3632279411 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a6c004cc0 con 0x7f4a74108a90 2024-08-31T06:08:39.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.881+0000 7f4a799e4640 1 -- 172.21.15.53:0/3632279411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a741a0360 con 0x7f4a74108a90 2024-08-31T06:08:39.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.881+0000 7f4a789e2640 1 -- 172.21.15.53:0/3632279411 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c010690 con 0x7f4a74108a90 2024-08-31T06:08:39.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.881+0000 7f4a799e4640 1 -- 172.21.15.53:0/3632279411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a741a6ac0 con 0x7f4a74108a90 2024-08-31T06:08:39.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.883+0000 7f4a7ff59740 1 Processor -- start 2024-08-31T06:08:39.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a789e2640 1 -- 172.21.15.53:0/3632279411 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4a6c005020 con 0x7f4a74108a90 2024-08-31T06:08:39.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a7ff59740 1 -- start start 2024-08-31T06:08:39.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f8320b520 0x564f835b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831ea840 0x564f835b1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564f83527a70 con 0x564f831e2660 2024-08-31T06:08:39.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564f83517000 con 0x564f8320b520 2024-08-31T06:08:39.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564f8351afb0 con 0x564f831ea840 2024-08-31T06:08:39.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a72ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a72ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835b11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58930/0 (socket says 172.21.15.53:58930) 2024-08-31T06:08:39.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a72ffd640 1 -- 172.21.15.53:0/1277916878 learned_addr learned my addr 172.21.15.53:0/1277916878 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a6a7fc640 1 --2- 172.21.15.53:0/1277916878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f8320b520 0x564f835b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a6a7fc640 1 --2- 172.21.15.53:0/1277916878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831ea840 0x564f835b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a72ffd640 1 -- 172.21.15.53:0/1277916878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831ea840 msgr2=0x564f835b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a72ffd640 1 --2- 172.21.15.53:0/1277916878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831ea840 0x564f835b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a72ffd640 1 -- 172.21.15.53:0/1277916878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f8320b520 msgr2=0x564f835b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.884+0000 7f4a72ffd640 1 --2- 172.21.15.53:0/1277916878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f8320b520 0x564f835b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.885+0000 7f4a72ffd640 1 -- 172.21.15.53:0/1277916878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f83276b00 con 0x564f831e2660 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.885+0000 7f4a789e2640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a600b4ca0 0x7f4a600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.885+0000 7f4a6a7fc640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a600b4ca0 0x7f4a600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.885+0000 7f4a72ffd640 1 --2- 172.21.15.53:0/1277916878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835b11c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4a6402a930 tx=0x7f4a64031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab41ac721c493af server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.885+0000 7f4a789e2640 1 -- 172.21.15.53:0/3632279411 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f4a6c0e5b10 con 0x7f4a74108a90 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.885+0000 7f4a69ffb640 1 -- 172.21.15.53:0/1277916878 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64035030 con 0x564f831e2660 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.885+0000 7f4a69ffb640 1 -- 172.21.15.53:0/1277916878 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a64040070 con 0x564f831e2660 2024-08-31T06:08:39.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.885+0000 7f4a69ffb640 1 -- 172.21.15.53:0/1277916878 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64003850 con 0x564f831e2660 2024-08-31T06:08:39.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.886+0000 7f4a7ff59740 1 -- 172.21.15.53:0/1277916878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 msgr2=0x564f835b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:39.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.886+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/1277916878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835b11c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4a6402a930 tx=0x7f4a64031a70 comp rx=0 tx=0).stop 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.886+0000 7f4a6a7fc640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a600b4ca0 0x7f4a600b71b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009730 tx=0x7f4a5c0096c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.886+0000 7f4a7ff59740 1 -- 172.21.15.53:0/1277916878 shutdown_connections 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.886+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/1277916878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831ea840 0x564f835b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.886+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/1277916878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835b11c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.886+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/1277916878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f8320b520 0x564f835b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.886+0000 7f4a7ff59740 1 -- 172.21.15.53:0/1277916878 >> 172.21.15.53:0/1277916878 conn(0x564f831ff910 msgr2=0x564f835aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.886+0000 7f4a7ff59740 1 -- 172.21.15.53:0/1277916878 shutdown_connections 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.886+0000 7f4a7ff59740 1 -- 172.21.15.53:0/1277916878 wait complete. 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.886+0000 7f4a7ff59740 1 -- start start 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a7ff59740 1 Processor -- start 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835bc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831ea840 0x564f835bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f8320b520 0x564f835c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564f835bf400 con 0x564f831e2660 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564f834d8520 con 0x564f8320b520 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564f835bf580 con 0x564f831ea840 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a7ff59740 10 client.0 _ll_register_callbacks cb 0x564f83510c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a72ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835bc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a72ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835bc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58932/0 (socket says 172.21.15.53:58932) 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a72ffd640 1 -- 172.21.15.53:0/60134750 learned_addr learned my addr 172.21.15.53:0/60134750 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a737fe640 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f8320b520 0x564f835c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.887+0000 7f4a6a7fc640 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831ea840 0x564f835bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a72ffd640 1 -- 172.21.15.53:0/60134750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831ea840 msgr2=0x564f835bcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a72ffd640 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831ea840 0x564f835bcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a72ffd640 1 -- 172.21.15.53:0/60134750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f8320b520 msgr2=0x564f835c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a72ffd640 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f8320b520 0x564f835c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a72ffd640 1 -- 172.21.15.53:0/60134750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f832ed960 con 0x564f831e2660 2024-08-31T06:08:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a72ffd640 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835bc800 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4a64004540 tx=0x7f4a64032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57113444f8b9cada server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a52ffd640 1 -- 172.21.15.53:0/60134750 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64051060 con 0x564f831e2660 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a52ffd640 1 -- 172.21.15.53:0/60134750 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f4a64031610 con 0x564f831e2660 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a7ff59740 1 -- 172.21.15.53:0/60134750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f834b69a0 con 0x564f831e2660 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a52ffd640 1 -- 172.21.15.53:0/60134750 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4a64035070 con 0x564f831e2660 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a7ff59740 10 client.16947 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.888+0000 7f4a7ff59740 1 -- 172.21.15.53:0/60134750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564f835cb570 con 0x564f831e2660 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.889+0000 7f4a52ffd640 1 -- 172.21.15.53:0/60134750 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564f834b69a0 con 0x564f831e2660 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.889+0000 7f4a52ffd640 1 -- 172.21.15.53:0/60134750 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f4a6404c410 con 0x564f831e2660 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.889+0000 7f4a7ff59740 10 client.16947 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.889+0000 7f4a7ff59740 10 client.16947 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.889+0000 7f4a7ff59740 20 client.16947 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.889+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f831c9ea0 0x564f835ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.889+0000 7f4a7ff59740 4 client.16947 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.889+0000 7f4a7ff59740 1 -- 172.21.15.53:0/60134750 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f835299c0 con 0x564f831c9ea0 2024-08-31T06:08:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.889+0000 7f4a6a7fc640 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f831c9ea0 0x564f835ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.890+0000 7f4a52ffd640 10 client.16947 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:39.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.890+0000 7f4a6a7fc640 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f831c9ea0 0x564f835ce8d0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50cc516a68ba61c3 server_cookie=ba75df37374eb8ff in_seq=0 out_seq=0 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.890+0000 7f4a52ffd640 1 -- 172.21.15.53:0/60134750 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f835299c0 con 0x564f831c9ea0 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.890+0000 7f4a52ffd640 10 client.16947 handle_command_reply: tid=0 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.890+0000 7f4a7ff59740 1 client.16947 shutdown 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a7ff59740 1 -- 172.21.15.53:0/60134750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 msgr2=0x564f835bc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835bc800 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4a64004540 tx=0x7f4a64032f60 comp rx=0 tx=0).stop 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a7ff59740 1 -- 172.21.15.53:0/60134750 shutdown_connections 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f831c9ea0 0x564f835ce8d0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a52ffd640 0 client.16947 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f8320b520 0x564f835c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831ea840 0x564f835bcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/60134750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831e2660 0x564f835bc800 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a7ff59740 1 -- 172.21.15.53:0/60134750 >> 172.21.15.53:0/60134750 conn(0x564f831ff910 msgr2=0x564f835b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:39.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a7ff59740 1 -- 172.21.15.53:0/60134750 shutdown_connections 2024-08-31T06:08:39.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a7ff59740 1 -- 172.21.15.53:0/60134750 wait complete. 2024-08-31T06:08:39.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.891+0000 7f4a7ff59740 20 client.16947 trim_cache size 0 max 16384 2024-08-31T06:08:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.908+0000 7f4a7ff59740 1 Processor -- start 2024-08-31T06:08:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.908+0000 7f4a7ff59740 1 -- start start 2024-08-31T06:08:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.908+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831c9ea0 0x564f835b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.908+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f831e2660 0x564f835ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.908+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f835ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.908+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741af400 con 0x564f831ea840 2024-08-31T06:08:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.908+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741b1000 con 0x564f831e2660 2024-08-31T06:08:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.908+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741afad0 con 0x564f831c9ea0 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.908+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f835ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.908+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f835ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58944/0 (socket says 172.21.15.53:58944) 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.908+0000 7f4a737fe640 1 -- 172.21.15.53:0/844524699 learned_addr learned my addr 172.21.15.53:0/844524699 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.909+0000 7f4a737fe640 1 -- 172.21.15.53:0/844524699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831c9ea0 msgr2=0x564f835b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.909+0000 7f4a72ffd640 1 --2- 172.21.15.53:0/844524699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831c9ea0 0x564f835b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.909+0000 7f4a737fe640 1 --2- 172.21.15.53:0/844524699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831c9ea0 0x564f835b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.909+0000 7f4a6a7fc640 1 --2- 172.21.15.53:0/844524699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f831e2660 0x564f835ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.909+0000 7f4a737fe640 1 -- 172.21.15.53:0/844524699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f831e2660 msgr2=0x564f835ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.909+0000 7f4a737fe640 1 --2- 172.21.15.53:0/844524699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f831e2660 0x564f835ae3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.909+0000 7f4a737fe640 1 -- 172.21.15.53:0/844524699 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f835bd8c0 con 0x564f831ea840 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.909+0000 7f4a737fe640 1 --2- 172.21.15.53:0/844524699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f835ae8e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0abf00 tx=0x7f4a6c005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa439cbb70c3138b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.909+0000 7f4a697fa640 1 -- 172.21.15.53:0/844524699 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0ac900 con 0x564f831ea840 2024-08-31T06:08:39.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.909+0000 7f4a697fa640 1 -- 172.21.15.53:0/844524699 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a6c0ac200 con 0x564f831ea840 2024-08-31T06:08:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.909+0000 7f4a697fa640 1 -- 172.21.15.53:0/844524699 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0ac460 con 0x564f831ea840 2024-08-31T06:08:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.910+0000 7f4a7ff59740 1 -- 172.21.15.53:0/844524699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 msgr2=0x564f835ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.910+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/844524699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f835ae8e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0abf00 tx=0x7f4a6c005ab0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.910+0000 7f4a7ff59740 1 -- 172.21.15.53:0/844524699 shutdown_connections 2024-08-31T06:08:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.910+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/844524699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f835ae8e0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.910+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/844524699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f831e2660 0x564f835ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.910+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/844524699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831c9ea0 0x564f835b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.910+0000 7f4a7ff59740 1 -- 172.21.15.53:0/844524699 >> 172.21.15.53:0/844524699 conn(0x564f831ff910 msgr2=0x564f835b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.910+0000 7f4a7ff59740 1 -- 172.21.15.53:0/844524699 shutdown_connections 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.910+0000 7f4a7ff59740 1 -- 172.21.15.53:0/844524699 wait complete. 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.910+0000 7f4a7ff59740 1 -- start start 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a7ff59740 1 Processor -- start 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f831c9ea0 0x564f835ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831e2660 0x564f835ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a7ff59740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f83632010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741b0870 con 0x564f831ea840 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741b01a0 con 0x564f831c9ea0 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a7ff59740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741ad3e0 con 0x564f831e2660 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a7ff59740 10 client.0 _ll_register_callbacks cb 0x7f4a5c0097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f83632010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f83632010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58960/0 (socket says 172.21.15.53:58960) 2024-08-31T06:08:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a737fe640 1 -- 172.21.15.53:0/759849358 learned_addr learned my addr 172.21.15.53:0/759849358 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a72ffd640 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f831c9ea0 0x564f835ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.911+0000 7f4a6a7fc640 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831e2660 0x564f835ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a737fe640 1 -- 172.21.15.53:0/759849358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831e2660 msgr2=0x564f835ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a737fe640 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831e2660 0x564f835ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a737fe640 1 -- 172.21.15.53:0/759849358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f831c9ea0 msgr2=0x564f835ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a737fe640 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f831c9ea0 0x564f835ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a737fe640 1 -- 172.21.15.53:0/759849358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f83632680 con 0x564f831ea840 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a737fe640 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f83632010 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0049d0 tx=0x7f4a6c0a8740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28228e4fc8d07df2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a52ffd640 1 -- 172.21.15.53:0/759849358 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c097070 con 0x564f831ea840 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a52ffd640 1 -- 172.21.15.53:0/759849358 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f4a6c0ac670 con 0x564f831ea840 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a7ff59740 1 -- 172.21.15.53:0/759849358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a6c0ac200 con 0x564f831ea840 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a52ffd640 1 -- 172.21.15.53:0/759849358 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4a6c0b5520 con 0x564f831ea840 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a7ff59740 10 client.16953 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a7ff59740 1 -- 172.21.15.53:0/759849358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564f836399e0 con 0x564f831ea840 2024-08-31T06:08:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a52ffd640 1 -- 172.21.15.53:0/759849358 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a6c0ac200 con 0x564f831ea840 2024-08-31T06:08:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.912+0000 7f4a52ffd640 1 -- 172.21.15.53:0/759849358 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f4a6c0c1b10 con 0x564f831ea840 2024-08-31T06:08:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.913+0000 7f4a7ff59740 10 client.16953 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.913+0000 7f4a7ff59740 10 client.16953 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:08:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.913+0000 7f4a7ff59740 20 client.16953 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.913+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f8320b520 0x564f8363c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.913+0000 7f4a7ff59740 4 client.16953 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "315fa883", "release": true, "await": true}] 2024-08-31T06:08:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.913+0000 7f4a7ff59740 1 -- 172.21.15.53:0/759849358 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "315fa883", "release": true, "await": true}) -- 0x564f83525460 con 0x564f8320b520 2024-08-31T06:08:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.913+0000 7f4a72ffd640 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f8320b520 0x564f8363c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.913+0000 7f4a72ffd640 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f8320b520 0x564f8363c1b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cafba83f73f3e4c server_cookie=f052ab25457d71fd in_seq=0 out_seq=0 2024-08-31T06:08:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.913+0000 7f4a52ffd640 10 client.16953 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:39.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.932+0000 7f4a52ffd640 1 -- 172.21.15.53:0/759849358 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564f83525460 con 0x564f8320b520 2024-08-31T06:08:39.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.932+0000 7f4a52ffd640 10 client.16953 handle_command_reply: tid=0 2024-08-31T06:08:39.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.932+0000 7f4a7ff59740 1 client.16953 shutdown 2024-08-31T06:08:39.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.932+0000 7f4a7ff59740 1 -- 172.21.15.53:0/759849358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 msgr2=0x564f83632010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:39.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.932+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f83632010 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0049d0 tx=0x7f4a6c0a8740 comp rx=0 tx=0).stop 2024-08-31T06:08:39.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a7ff59740 1 -- 172.21.15.53:0/759849358 shutdown_connections 2024-08-31T06:08:39.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f8320b520 0x564f8363c1b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f831ea840 0x564f83632010 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f831e2660 0x564f835ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a7ff59740 1 --2- 172.21.15.53:0/759849358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f831c9ea0 0x564f835ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a7ff59740 1 -- 172.21.15.53:0/759849358 >> 172.21.15.53:0/759849358 conn(0x564f831ff910 msgr2=0x564f835ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a52ffd640 0 client.16953 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a7ff59740 1 -- 172.21.15.53:0/759849358 shutdown_connections 2024-08-31T06:08:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a7ff59740 1 -- 172.21.15.53:0/759849358 wait complete. 2024-08-31T06:08:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a7ff59740 20 client.16953 trim_cache size 0 max 16384 2024-08-31T06:08:39.937 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:08:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 30, 2024-08-31T06:08:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:08:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 16, 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "315fa883": { 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 16, 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 141.8, 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:08:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:08:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:08:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:08:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:08:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:08:39.939 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:08:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a799e4640 1 -- 172.21.15.53:0/3632279411 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a600b4ca0 msgr2=0x7f4a600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a799e4640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a600b4ca0 0x7f4a600b71b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009730 tx=0x7f4a5c0096c0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a799e4640 1 -- 172.21.15.53:0/3632279411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a74108a90 msgr2=0x7f4a7419f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a799e4640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a74108a90 0x7f4a7419f940 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00eb10 tx=0x7f4a6c00c2d0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a799e4640 1 -- 172.21.15.53:0/3632279411 shutdown_connections 2024-08-31T06:08:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a799e4640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a600b4ca0 0x7f4a600b71b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a799e4640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a74108a90 0x7f4a7419f940 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a799e4640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a74108140 0x7f4a7419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.933+0000 7f4a799e4640 1 --2- 172.21.15.53:0/3632279411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74102800 0x7f4a7419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.934+0000 7f4a799e4640 1 -- 172.21.15.53:0/3632279411 >> 172.21.15.53:0/3632279411 conn(0x7f4a740794d0 msgr2=0x7f4a741012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.934+0000 7f4a799e4640 1 -- 172.21.15.53:0/3632279411 shutdown_connections 2024-08-31T06:08:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:08:39.934+0000 7f4a799e4640 1 -- 172.21.15.53:0/3632279411 wait complete. 2024-08-31T06:08:39.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54016 0.26 MB/sec execute 29 sec latency 21593.769 ms 2024-08-31T06:08:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:39 smithi130 ceph-mon[22266]: pgmap v434: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-31T06:08:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:39 smithi153 ceph-mon[22320]: pgmap v434: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-31T06:08:40.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:39 smithi053 ceph-mon[18924]: pgmap v434: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-31T06:08:40.784 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '315fa883', total seconds elapsed: 25.2 2024-08-31T06:08:40.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 54489 0.31 MB/sec execute 30 sec latency 32.775 ms 2024-08-31T06:08:41.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 55081 0.41 MB/sec execute 31 sec latency 15.665 ms 2024-08-31T06:08:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:41 smithi130 ceph-mon[22266]: pgmap v435: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 23 op/s 2024-08-31T06:08:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:41 smithi153 ceph-mon[22320]: pgmap v435: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 23 op/s 2024-08-31T06:08:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:41 smithi053 ceph-mon[18924]: pgmap v435: 97 pgs: 97 active+clean; 39 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 23 op/s 2024-08-31T06:08:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.848+0000 7f248791a640 1 -- 172.21.15.53:0/4154146620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24801089d0 msgr2=0x7f248010f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.848+0000 7f248791a640 1 --2- 172.21.15.53:0/4154146620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24801089d0 0x7f248010f200 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f2478009ca0 tx=0x7f247802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.848+0000 7f248791a640 1 -- 172.21.15.53:0/4154146620 shutdown_connections 2024-08-31T06:08:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.848+0000 7f248791a640 1 --2- 172.21.15.53:0/4154146620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24801089d0 0x7f248010f200 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.848+0000 7f248791a640 1 --2- 172.21.15.53:0/4154146620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2480108080 0x7f2480108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.848+0000 7f248791a640 1 --2- 172.21.15.53:0/4154146620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2480102750 0x7f2480102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.848+0000 7f248791a640 1 -- 172.21.15.53:0/4154146620 >> 172.21.15.53:0/4154146620 conn(0x7f248007a4e0 msgr2=0x7f248007a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.848+0000 7f248791a640 1 -- 172.21.15.53:0/4154146620 shutdown_connections 2024-08-31T06:08:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.849+0000 7f248791a640 1 -- 172.21.15.53:0/4154146620 wait complete. 2024-08-31T06:08:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.849+0000 7f248791a640 1 Processor -- start 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.849+0000 7f248791a640 1 -- start start 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f248791a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2480102750 0x7f248019aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f248791a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2480108080 0x7f248019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f248791a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24801089d0 0x7f248019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f248791a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2480112580 con 0x7f24801089d0 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f248791a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2480112400 con 0x7f2480108080 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f248791a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2480112700 con 0x7f2480102750 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f2485eb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24801089d0 0x7f248019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f2484eb5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2480108080 0x7f248019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f24856b6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2480102750 0x7f248019aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f2485eb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24801089d0 0x7f248019b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58990/0 (socket says 172.21.15.53:58990) 2024-08-31T06:08:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f2485eb7640 1 -- 172.21.15.53:0/393514348 learned_addr learned my addr 172.21.15.53:0/393514348 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f2485eb7640 1 -- 172.21.15.53:0/393514348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2480102750 msgr2=0x7f248019aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f2485eb7640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2480102750 0x7f248019aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f2485eb7640 1 -- 172.21.15.53:0/393514348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2480108080 msgr2=0x7f248019b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f2485eb7640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2480108080 0x7f248019b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f2485eb7640 1 -- 172.21.15.53:0/393514348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24801a6170 con 0x7f24801089d0 2024-08-31T06:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f2484eb5640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2480108080 0x7f248019b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.850+0000 7f2485eb7640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24801089d0 0x7f248019b930 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2478005cc0 tx=0x7f2478003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.851+0000 7f24767fc640 1 -- 172.21.15.53:0/393514348 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478032c10 con 0x7f24801089d0 2024-08-31T06:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.851+0000 7f24767fc640 1 -- 172.21.15.53:0/393514348 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2478032db0 con 0x7f24801089d0 2024-08-31T06:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.851+0000 7f248791a640 1 -- 172.21.15.53:0/393514348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24801a6400 con 0x7f24801089d0 2024-08-31T06:08:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.851+0000 7f24767fc640 1 -- 172.21.15.53:0/393514348 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478030a60 con 0x7f24801089d0 2024-08-31T06:08:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.851+0000 7f248791a640 1 -- 172.21.15.53:0/393514348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24801a69a0 con 0x7f24801089d0 2024-08-31T06:08:42.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.853+0000 7f248e880740 1 Processor -- start 2024-08-31T06:08:42.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f24767fc640 1 -- 172.21.15.53:0/393514348 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2478030c20 con 0x7f24801089d0 2024-08-31T06:08:42.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f248e880740 1 -- start start 2024-08-31T06:08:42.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f248e880740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a43c1b0 0x561e7a7dfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f248e880740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7e0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f248e880740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7e0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f248e880740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561e7a755000 con 0x561e7a4132f0 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f248e880740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561e7a744590 con 0x561e7a41b4d0 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f248e880740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561e7a748540 con 0x561e7a43c1b0 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f24856b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f24856b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7e0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58996/0 (socket says 172.21.15.53:58996) 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f24856b6640 1 -- 172.21.15.53:0/3320257769 learned_addr learned my addr 172.21.15.53:0/3320257769 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f2484eb5640 1 --2- 172.21.15.53:0/3320257769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a43c1b0 0x561e7a7dfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.854+0000 7f2484eb5640 1 --2- 172.21.15.53:0/3320257769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f24767fc640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f246c0b4d20 0x7f246c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f24856b6640 1 -- 172.21.15.53:0/3320257769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a43c1b0 msgr2=0x561e7a7dfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f24856b6640 1 --2- 172.21.15.53:0/3320257769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a43c1b0 0x561e7a7dfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f24856b6640 1 -- 172.21.15.53:0/3320257769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 msgr2=0x561e7a7e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f24856b6640 1 --2- 172.21.15.53:0/3320257769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7e0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f24856b6640 1 -- 172.21.15.53:0/3320257769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e7a4a7790 con 0x561e7a4132f0 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f24767fc640 1 -- 172.21.15.53:0/393514348 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f24781065b0 con 0x7f24801089d0 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f2485eb7640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f246c0b4d20 0x7f246c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f24856b6640 1 --2- 172.21.15.53:0/3320257769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7e0220 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f247c009c90 tx=0x7f247c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a003c3f6ae607a14 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f246b7fe640 1 -- 172.21.15.53:0/3320257769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c005220 con 0x561e7a4132f0 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f246b7fe640 1 -- 172.21.15.53:0/3320257769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f247c004c30 con 0x561e7a4132f0 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.855+0000 7f246b7fe640 1 -- 172.21.15.53:0/3320257769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c019690 con 0x561e7a4132f0 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.856+0000 7f248e880740 1 -- 172.21.15.53:0/3320257769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 msgr2=0x561e7a7e0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.856+0000 7f2485eb7640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f246c0b4d20 0x7f246c0b7230 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f24780cc9a0 tx=0x7f2478009460 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.856+0000 7f248e880740 1 --2- 172.21.15.53:0/3320257769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7e0220 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f247c009c90 tx=0x7f247c011810 comp rx=0 tx=0).stop 2024-08-31T06:08:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.856+0000 7f248e880740 1 -- 172.21.15.53:0/3320257769 shutdown_connections 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.856+0000 7f248e880740 1 --2- 172.21.15.53:0/3320257769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.856+0000 7f248e880740 1 --2- 172.21.15.53:0/3320257769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7e0220 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.856+0000 7f248e880740 1 --2- 172.21.15.53:0/3320257769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a43c1b0 0x561e7a7dfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.856+0000 7f248e880740 1 -- 172.21.15.53:0/3320257769 >> 172.21.15.53:0/3320257769 conn(0x561e7a430300 msgr2=0x561e7a7ddbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.856+0000 7f248e880740 1 -- 172.21.15.53:0/3320257769 shutdown_connections 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.856+0000 7f248e880740 1 -- 172.21.15.53:0/3320257769 wait complete. 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.856+0000 7f248e880740 1 -- start start 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f248e880740 1 Processor -- start 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f248e880740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a4132f0 0x561e7a7eb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f248e880740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a41b4d0 0x561e7a7ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f248e880740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a43c1b0 0x561e7a7f7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f248e880740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561e7a67dab0 con 0x561e7a43c1b0 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f248e880740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561e7a6cb680 con 0x561e7a4132f0 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f248e880740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561e7a7ee460 con 0x561e7a41b4d0 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f248e880740 10 client.0 _ll_register_callbacks cb 0x561e7a453a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f2484eb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a43c1b0 0x561e7a7f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f24856b6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a41b4d0 0x561e7a7ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f2484eb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a43c1b0 0x561e7a7f7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58998/0 (socket says 172.21.15.53:58998) 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f2484eb5640 1 -- 172.21.15.53:0/57058547 learned_addr learned my addr 172.21.15.53:0/57058547 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.857+0000 7f2484eb5640 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a4132f0 0x561e7a7eb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f24856b6640 1 -- 172.21.15.53:0/57058547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a4132f0 msgr2=0x561e7a7eb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f24856b6640 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a4132f0 0x561e7a7eb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f24856b6640 1 -- 172.21.15.53:0/57058547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a43c1b0 msgr2=0x561e7a7f7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f24856b6640 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a43c1b0 0x561e7a7f7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f24856b6640 1 -- 172.21.15.53:0/57058547 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e7a520620 con 0x561e7a41b4d0 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f2484eb5640 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a43c1b0 0x561e7a7f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f24856b6640 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a41b4d0 0x561e7a7ebd10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f247c01b040 tx=0x7f247c005090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58bcd13dc5a8978b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f2468ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f2468ff9640 1 -- 172.21.15.53:0/57058547 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c029070 con 0x561e7a41b4d0 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f248e880740 1 -- 172.21.15.53:0/57058547 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f247c004c30 con 0x561e7a41b4d0 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f2468ff9640 1 -- 172.21.15.53:0/57058547 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f247c023630 con 0x561e7a41b4d0 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f2468ff9640 1 -- 172.21.15.53:0/57058547 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f247c035050 con 0x561e7a41b4d0 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f248e880740 10 client.26332 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.858+0000 7f248e880740 1 -- 172.21.15.53:0/57058547 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561e7a7fa3c0 con 0x561e7a41b4d0 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.859+0000 7f2468ff9640 1 -- 172.21.15.53:0/57058547 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f247c004c30 con 0x561e7a41b4d0 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.859+0000 7f2468ff9640 1 -- 172.21.15.53:0/57058547 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f247c019550 con 0x561e7a41b4d0 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.859+0000 7f248e880740 10 client.26332 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.859+0000 7f248e880740 10 client.26332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.859+0000 7f248e880740 20 client.26332 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.859+0000 7f248e880740 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561e7a3fad80 0x561e7a7fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.859+0000 7f248e880740 4 client.26332 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.859+0000 7f248e880740 1 -- 172.21.15.53:0/57058547 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e7a756f50 con 0x561e7a3fad80 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.859+0000 7f2484eb5640 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561e7a3fad80 0x561e7a7fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.859+0000 7f2468ff9640 10 client.26332 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.859+0000 7f2484eb5640 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561e7a3fad80 0x561e7a7fd7e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9eaaa1592e19abb server_cookie=b267d686b4cd9a91 in_seq=0 out_seq=0 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f2468ff9640 1 -- 172.21.15.53:0/57058547 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e7a756f50 con 0x561e7a3fad80 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f2468ff9640 10 client.26332 handle_command_reply: tid=0 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f248e880740 1 client.26332 shutdown 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f248e880740 1 -- 172.21.15.53:0/57058547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a41b4d0 msgr2=0x561e7a7ebd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f248e880740 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a41b4d0 0x561e7a7ebd10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f247c01b040 tx=0x7f247c005090 comp rx=0 tx=0).stop 2024-08-31T06:08:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f248e880740 1 -- 172.21.15.53:0/57058547 shutdown_connections 2024-08-31T06:08:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f248e880740 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561e7a3fad80 0x561e7a7fd7e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f248e880740 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a43c1b0 0x561e7a7f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f248e880740 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a41b4d0 0x561e7a7ebd10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f2468ff9640 0 client.26332 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f248e880740 1 --2- 172.21.15.53:0/57058547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a4132f0 0x561e7a7eb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f248e880740 1 -- 172.21.15.53:0/57058547 >> 172.21.15.53:0/57058547 conn(0x561e7a430300 msgr2=0x561e7a7e0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f248e880740 1 -- 172.21.15.53:0/57058547 shutdown_connections 2024-08-31T06:08:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.860+0000 7f248e880740 1 -- 172.21.15.53:0/57058547 wait complete. 2024-08-31T06:08:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.861+0000 7f248e880740 20 client.26332 trim_cache size 0 max 16384 2024-08-31T06:08:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f248e880740 1 Processor -- start 2024-08-31T06:08:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f248e880740 1 -- start start 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f248e880740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a3fad80 0x561e7a7e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f248e880740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f248e880740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7f7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f248e880740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f24801af400 con 0x561e7a4132f0 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f248e880740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24801b1000 con 0x561e7a41b4d0 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f248e880740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f24801afad0 con 0x561e7a3fad80 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f24856b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f24856b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7ed4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59010/0 (socket says 172.21.15.53:59010) 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f24856b6640 1 -- 172.21.15.53:0/2076716032 learned_addr learned my addr 172.21.15.53:0/2076716032 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.878+0000 7f2484eb5640 1 --2- 172.21.15.53:0/2076716032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.879+0000 7f2484eb5640 1 --2- 172.21.15.53:0/2076716032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a3fad80 0x561e7a7e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.879+0000 7f24856b6640 1 -- 172.21.15.53:0/2076716032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a3fad80 msgr2=0x561e7a7e5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.879+0000 7f24856b6640 1 --2- 172.21.15.53:0/2076716032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a3fad80 0x561e7a7e5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.879+0000 7f24856b6640 1 -- 172.21.15.53:0/2076716032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 msgr2=0x561e7a7f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.879+0000 7f24856b6640 1 --2- 172.21.15.53:0/2076716032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.879+0000 7f24856b6640 1 -- 172.21.15.53:0/2076716032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e7a7dbf60 con 0x561e7a4132f0 2024-08-31T06:08:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.879+0000 7f24856b6640 1 --2- 172.21.15.53:0/2076716032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7ed4a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f247c005060 tx=0x7f247c009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a2084b8915633e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.879+0000 7f246affd640 1 -- 172.21.15.53:0/2076716032 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c029040 con 0x561e7a4132f0 2024-08-31T06:08:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.879+0000 7f246affd640 1 -- 172.21.15.53:0/2076716032 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f247c0097a0 con 0x561e7a4132f0 2024-08-31T06:08:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.879+0000 7f246affd640 1 -- 172.21.15.53:0/2076716032 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c023a40 con 0x561e7a4132f0 2024-08-31T06:08:42.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.880+0000 7f248e880740 1 -- 172.21.15.53:0/2076716032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 msgr2=0x561e7a7ed4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.880+0000 7f248e880740 1 --2- 172.21.15.53:0/2076716032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7ed4a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f247c005060 tx=0x7f247c009640 comp rx=0 tx=0).stop 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.880+0000 7f248e880740 1 -- 172.21.15.53:0/2076716032 shutdown_connections 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.880+0000 7f248e880740 1 --2- 172.21.15.53:0/2076716032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.880+0000 7f248e880740 1 --2- 172.21.15.53:0/2076716032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a4132f0 0x561e7a7ed4a0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.880+0000 7f248e880740 1 --2- 172.21.15.53:0/2076716032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a3fad80 0x561e7a7e5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.880+0000 7f248e880740 1 -- 172.21.15.53:0/2076716032 >> 172.21.15.53:0/2076716032 conn(0x561e7a430300 msgr2=0x561e7a7e1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.880+0000 7f248e880740 1 -- 172.21.15.53:0/2076716032 shutdown_connections 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.880+0000 7f248e880740 1 -- 172.21.15.53:0/2076716032 wait complete. 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.880+0000 7f248e880740 1 -- start start 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f248e880740 1 Processor -- start 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f248e880740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a3fad80 0x561e7a7ef600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f248e880740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a4132f0 0x561e7a7efb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f248e880740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7f0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f248e880740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f24801b0870 con 0x561e7a3fad80 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f248e880740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24801b01a0 con 0x561e7a41b4d0 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f248e880740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f24801ad3e0 con 0x561e7a4132f0 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f248e880740 10 client.0 _ll_register_callbacks cb 0x7f2470009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f2484eb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a3fad80 0x561e7a7ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f2484eb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a3fad80 0x561e7a7ef600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59020/0 (socket says 172.21.15.53:59020) 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f2484eb5640 1 -- 172.21.15.53:0/2529120868 learned_addr learned my addr 172.21.15.53:0/2529120868 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f24856b6640 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a4132f0 0x561e7a7efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.881+0000 7f2484eb5640 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f2484eb5640 1 -- 172.21.15.53:0/2529120868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a4132f0 msgr2=0x561e7a7efb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f2484eb5640 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a4132f0 0x561e7a7efb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f2484eb5640 1 -- 172.21.15.53:0/2529120868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 msgr2=0x561e7a7f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f2484eb5640 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7f0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f2484eb5640 1 -- 172.21.15.53:0/2529120868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e7a8670e0 con 0x561e7a3fad80 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f24856b6640 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a4132f0 0x561e7a7efb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f2484eb5640 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a3fad80 0x561e7a7ef600 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f24700115c0 tx=0x7f2470005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95658089201fa763 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f2468ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f2468ff9640 1 -- 172.21.15.53:0/2529120868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24700110f0 con 0x561e7a3fad80 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f248e880740 1 -- 172.21.15.53:0/2529120868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f247c0097a0 con 0x561e7a3fad80 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f2468ff9640 1 -- 172.21.15.53:0/2529120868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f2470009040 con 0x561e7a3fad80 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f2468ff9640 1 -- 172.21.15.53:0/2529120868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2470011290 con 0x561e7a3fad80 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f248e880740 10 client.16971 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f248e880740 1 -- 172.21.15.53:0/2529120868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561e7a868380 con 0x561e7a3fad80 2024-08-31T06:08:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.882+0000 7f2468ff9640 1 -- 172.21.15.53:0/2529120868 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f247c0097a0 con 0x561e7a3fad80 2024-08-31T06:08:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.883+0000 7f2468ff9640 1 -- 172.21.15.53:0/2529120868 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f2470020040 con 0x561e7a3fad80 2024-08-31T06:08:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.883+0000 7f248e880740 10 client.16971 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.883+0000 7f248e880740 10 client.16971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.883+0000 7f248e880740 20 client.16971 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.883+0000 7f248e880740 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561e7a43c1b0 0x561e7a86ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.883+0000 7f248e880740 4 client.16971 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:08:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.883+0000 7f248e880740 1 -- 172.21.15.53:0/2529120868 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e7a7529f0 con 0x561e7a43c1b0 2024-08-31T06:08:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.883+0000 7f24856b6640 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561e7a43c1b0 0x561e7a86ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.883+0000 7f2468ff9640 10 client.16971 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.883+0000 7f24856b6640 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561e7a43c1b0 0x561e7a86ac10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fdcf78c888e8129 server_cookie=51f94bab43c9fcc2 in_seq=0 out_seq=0 2024-08-31T06:08:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f2468ff9640 1 -- 172.21.15.53:0/2529120868 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561e7a7529f0 con 0x561e7a43c1b0 2024-08-31T06:08:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f2468ff9640 10 client.16971 handle_command_reply: tid=0 2024-08-31T06:08:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f248e880740 1 client.16971 shutdown 2024-08-31T06:08:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f248e880740 1 -- 172.21.15.53:0/2529120868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a3fad80 msgr2=0x561e7a7ef600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f248e880740 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a3fad80 0x561e7a7ef600 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f24700115c0 tx=0x7f2470005850 comp rx=0 tx=0).stop 2024-08-31T06:08:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f248e880740 1 -- 172.21.15.53:0/2529120868 shutdown_connections 2024-08-31T06:08:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f248e880740 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561e7a43c1b0 0x561e7a86ac10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f248e880740 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e7a41b4d0 0x561e7a7f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f248e880740 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561e7a4132f0 0x561e7a7efb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f248e880740 1 --2- 172.21.15.53:0/2529120868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e7a3fad80 0x561e7a7ef600 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f2468ff9640 0 client.16971 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.899+0000 7f248e880740 1 -- 172.21.15.53:0/2529120868 >> 172.21.15.53:0/2529120868 conn(0x561e7a430300 msgr2=0x561e7a7e1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248e880740 1 -- 172.21.15.53:0/2529120868 shutdown_connections 2024-08-31T06:08:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248e880740 1 -- 172.21.15.53:0/2529120868 wait complete. 2024-08-31T06:08:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248e880740 20 client.16971 trim_cache size 0 max 16384 2024-08-31T06:08:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:08:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:08:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:08:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:08:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 -- 172.21.15.53:0/393514348 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f246c0b4d20 msgr2=0x7f246c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f246c0b4d20 0x7f246c0b7230 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f24780cc9a0 tx=0x7f2478009460 comp rx=0 tx=0).stop 2024-08-31T06:08:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 -- 172.21.15.53:0/393514348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24801089d0 msgr2=0x7f248019b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24801089d0 0x7f248019b930 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2478005cc0 tx=0x7f2478003f90 comp rx=0 tx=0).stop 2024-08-31T06:08:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 -- 172.21.15.53:0/393514348 shutdown_connections 2024-08-31T06:08:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f246c0b4d20 0x7f246c0b7230 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24801089d0 0x7f248019b930 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2480108080 0x7f248019b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 --2- 172.21.15.53:0/393514348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2480102750 0x7f248019aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 -- 172.21.15.53:0/393514348 >> 172.21.15.53:0/393514348 conn(0x7f248007a4e0 msgr2=0x7f2480106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 -- 172.21.15.53:0/393514348 shutdown_connections 2024-08-31T06:08:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:42.900+0000 7f248791a640 1 -- 172.21.15.53:0/393514348 wait complete. 2024-08-31T06:08:42.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 55662 0.45 MB/sec execute 32 sec latency 16.302 ms 2024-08-31T06:08:43.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 56260 0.60 MB/sec execute 33 sec latency 11.707 ms 2024-08-31T06:08:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:43 smithi130 ceph-mon[22266]: pgmap v436: 97 pgs: 97 active+clean; 39 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 58 KiB/s wr, 26 op/s 2024-08-31T06:08:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:43 smithi153 ceph-mon[22320]: pgmap v436: 97 pgs: 97 active+clean; 39 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 58 KiB/s wr, 26 op/s 2024-08-31T06:08:44.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:43 smithi053 ceph-mon[18924]: pgmap v436: 97 pgs: 97 active+clean; 39 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 58 KiB/s wr, 26 op/s 2024-08-31T06:08:44.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 56782 0.73 MB/sec execute 34 sec latency 15.753 ms 2024-08-31T06:08:45.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:08:45.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:08:45.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:08:45.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:08:45.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:08:45.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:08:45.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:08:45.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:08:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:08:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:08:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:08:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:08:45.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 57147 0.75 MB/sec execute 35 sec latency 14.864 ms 2024-08-31T06:08:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:45 smithi130 ceph-mon[22266]: pgmap v437: 97 pgs: 97 active+clean; 40 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 207 KiB/s wr, 40 op/s 2024-08-31T06:08:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:45 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:08:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:45 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:08:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:45 smithi153 ceph-mon[22320]: pgmap v437: 97 pgs: 97 active+clean; 40 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 207 KiB/s wr, 40 op/s 2024-08-31T06:08:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:45 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:08:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:45 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:08:46.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:45 smithi053 ceph-mon[18924]: pgmap v437: 97 pgs: 97 active+clean; 40 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 207 KiB/s wr, 40 op/s 2024-08-31T06:08:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:45 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:08:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:45 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:08:46.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 57433 0.74 MB/sec execute 36 sec latency 12.735 ms 2024-08-31T06:08:47.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:46 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:08:47.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:46 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:08:47.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:46 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:08:47.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 57935 0.77 MB/sec execute 37 sec latency 14.633 ms 2024-08-31T06:08:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:47 smithi153 ceph-mon[22320]: pgmap v438: 97 pgs: 97 active+clean; 41 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 519 KiB/s wr, 60 op/s 2024-08-31T06:08:48.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:47 smithi053 ceph-mon[18924]: pgmap v438: 97 pgs: 97 active+clean; 41 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 519 KiB/s wr, 60 op/s 2024-08-31T06:08:48.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:47 smithi130 ceph-mon[22266]: pgmap v438: 97 pgs: 97 active+clean; 41 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 519 KiB/s wr, 60 op/s 2024-08-31T06:08:48.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 58475 0.83 MB/sec execute 38 sec latency 34.886 ms 2024-08-31T06:08:49.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 59121 0.85 MB/sec execute 39 sec latency 14.727 ms 2024-08-31T06:08:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:49 smithi153 ceph-mon[22320]: pgmap v439: 97 pgs: 97 active+clean; 43 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 768 KiB/s wr, 82 op/s 2024-08-31T06:08:50.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:49 smithi053 ceph-mon[18924]: pgmap v439: 97 pgs: 97 active+clean; 43 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 768 KiB/s wr, 82 op/s 2024-08-31T06:08:50.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:49 smithi130 ceph-mon[22266]: pgmap v439: 97 pgs: 97 active+clean; 43 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 768 KiB/s wr, 82 op/s 2024-08-31T06:08:50.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 59707 0.97 MB/sec execute 40 sec latency 15.229 ms 2024-08-31T06:08:51.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 60155 1.00 MB/sec execute 41 sec latency 14.939 ms 2024-08-31T06:08:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:51 smithi153 ceph-mon[22320]: pgmap v440: 97 pgs: 97 active+clean; 44 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.0 MiB/s wr, 113 op/s 2024-08-31T06:08:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:51 smithi053 ceph-mon[18924]: pgmap v440: 97 pgs: 97 active+clean; 44 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.0 MiB/s wr, 113 op/s 2024-08-31T06:08:52.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:51 smithi130 ceph-mon[22266]: pgmap v440: 97 pgs: 97 active+clean; 44 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.0 MiB/s wr, 113 op/s 2024-08-31T06:08:52.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 60635 1.08 MB/sec execute 42 sec latency 15.465 ms 2024-08-31T06:08:53.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 60915 1.06 MB/sec execute 43 sec latency 12.467 ms 2024-08-31T06:08:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:53 smithi153 ceph-mon[22320]: pgmap v441: 97 pgs: 97 active+clean; 44 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-08-31T06:08:54.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:53 smithi053 ceph-mon[18924]: pgmap v441: 97 pgs: 97 active+clean; 44 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-08-31T06:08:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:53 smithi130 ceph-mon[22266]: pgmap v441: 97 pgs: 97 active+clean; 44 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2024-08-31T06:08:54.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 61425 1.08 MB/sec execute 44 sec latency 14.416 ms 2024-08-31T06:08:55.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 61981 1.13 MB/sec execute 45 sec latency 14.788 ms 2024-08-31T06:08:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.009+0000 7fcedf76e640 1 -- 172.21.15.53:0/346314235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced81080d0 msgr2=0x7fced81084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.009+0000 7fcedf76e640 1 --2- 172.21.15.53:0/346314235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced81080d0 0x7fced81084e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009900 tx=0x7fcec802a410 comp rx=0 tx=0).stop 2024-08-31T06:08:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.009+0000 7fcedf76e640 1 -- 172.21.15.53:0/346314235 shutdown_connections 2024-08-31T06:08:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.009+0000 7fcedf76e640 1 --2- 172.21.15.53:0/346314235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced8108a20 0x7fced810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.009+0000 7fcedf76e640 1 --2- 172.21.15.53:0/346314235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced81080d0 0x7fced81084e0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.009+0000 7fcedf76e640 1 --2- 172.21.15.53:0/346314235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fced81027a0 0x7fced8102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.009+0000 7fcedf76e640 1 -- 172.21.15.53:0/346314235 >> 172.21.15.53:0/346314235 conn(0x7fced80fe1c0 msgr2=0x7fced8100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.010+0000 7fcedf76e640 1 -- 172.21.15.53:0/346314235 shutdown_connections 2024-08-31T06:08:56.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.010+0000 7fcedf76e640 1 -- 172.21.15.53:0/346314235 wait complete. 2024-08-31T06:08:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.010+0000 7fcedf76e640 1 Processor -- start 2024-08-31T06:08:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.010+0000 7fcedf76e640 1 -- start start 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedf76e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced81027a0 0x7fced8199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedf76e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fced81080d0 0x7fced81995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedf76e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced8108a20 0x7fced819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedf76e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fced8112560 con 0x7fced81027a0 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedf76e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fced81123e0 con 0x7fced81080d0 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedf76e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fced81126e0 con 0x7fced8108a20 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedd50a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced81027a0 0x7fced8199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedd50a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced81027a0 0x7fced8199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59346/0 (socket says 172.21.15.53:59346) 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedd50a640 1 -- 172.21.15.53:0/3402192900 learned_addr learned my addr 172.21.15.53:0/3402192900 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fceddd0b640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced8108a20 0x7fced819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedd50a640 1 -- 172.21.15.53:0/3402192900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced8108a20 msgr2=0x7fced819e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedd50a640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced8108a20 0x7fced819e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedd50a640 1 -- 172.21.15.53:0/3402192900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fced81080d0 msgr2=0x7fced81995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedd50a640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fced81080d0 0x7fced81995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedd50a640 1 -- 172.21.15.53:0/3402192900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced819ef70 con 0x7fced81027a0 2024-08-31T06:08:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.011+0000 7fcedd50a640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced81027a0 0x7fced8199040 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fced400e9f0 tx=0x7fced400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.012+0000 7fcece7fc640 1 -- 172.21.15.53:0/3402192900 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced400cd80 con 0x7fced81027a0 2024-08-31T06:08:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.012+0000 7fcedf76e640 1 -- 172.21.15.53:0/3402192900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced819f260 con 0x7fced81027a0 2024-08-31T06:08:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.012+0000 7fcece7fc640 1 -- 172.21.15.53:0/3402192900 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fced40108c0 con 0x7fced81027a0 2024-08-31T06:08:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.012+0000 7fcece7fc640 1 -- 172.21.15.53:0/3402192900 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced40187c0 con 0x7fced81027a0 2024-08-31T06:08:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.012+0000 7fcedf76e640 1 -- 172.21.15.53:0/3402192900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced81a59f0 con 0x7fced81027a0 2024-08-31T06:08:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.014+0000 7fcee67bd740 1 Processor -- start 2024-08-31T06:08:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.014+0000 7fcee67bd740 1 -- start start 2024-08-31T06:08:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6cd1b0 0x562e0aa735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa70ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa71200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcece7fc640 1 -- 172.21.15.53:0/3402192900 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fced4018960 con 0x7fced81027a0 2024-08-31T06:08:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcee67bd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562e0a9e6000 con 0x562e0a6ac4d0 2024-08-31T06:08:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcee67bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562e0a9d5590 con 0x562e0a6a42f0 2024-08-31T06:08:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcee67bd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562e0a9d9540 con 0x562e0a6cd1b0 2024-08-31T06:08:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcedcd09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa71200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcedd50a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa70ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcedcd09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa71200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59360/0 (socket says 172.21.15.53:59360) 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcedcd09640 1 -- 172.21.15.53:0/3909996976 learned_addr learned my addr 172.21.15.53:0/3909996976 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fceddd0b640 1 --2- 172.21.15.53:0/3909996976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6cd1b0 0x562e0aa735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcedcd09640 1 -- 172.21.15.53:0/3909996976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6cd1b0 msgr2=0x562e0aa735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcedcd09640 1 --2- 172.21.15.53:0/3909996976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6cd1b0 0x562e0aa735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcedcd09640 1 -- 172.21.15.53:0/3909996976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 msgr2=0x562e0aa70ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcedcd09640 1 --2- 172.21.15.53:0/3909996976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa70ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcedcd09640 1 -- 172.21.15.53:0/3909996976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e0a738790 con 0x562e0a6ac4d0 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.015+0000 7fcedd50a640 1 --2- 172.21.15.53:0/3909996976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa70ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.016+0000 7fcedcd09640 1 --2- 172.21.15.53:0/3909996976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa71200 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009230 tx=0x7fcec8009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bae527414ae1d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:56.024 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.016+0000 7fcece7fc640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcec40b4ca0 0x7fcec40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.016+0000 7fceddd0b640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcec40b4ca0 0x7fcec40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.016+0000 7fcece7fc640 1 -- 172.21.15.53:0/3402192900 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fced40e5a80 con 0x7fced81027a0 2024-08-31T06:08:56.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.016+0000 7fcec37fe640 1 -- 172.21.15.53:0/3909996976 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8040070 con 0x562e0a6ac4d0 2024-08-31T06:08:56.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.016+0000 7fcec37fe640 1 -- 172.21.15.53:0/3909996976 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcec8032e00 con 0x562e0a6ac4d0 2024-08-31T06:08:56.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.016+0000 7fcec37fe640 1 -- 172.21.15.53:0/3909996976 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8035040 con 0x562e0a6ac4d0 2024-08-31T06:08:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.017+0000 7fcee67bd740 1 -- 172.21.15.53:0/3909996976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 msgr2=0x562e0aa71200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.017+0000 7fceddd0b640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcec40b4ca0 0x7fcec40b71b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fced0005fd0 tx=0x7fced0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.017+0000 7fcee67bd740 1 --2- 172.21.15.53:0/3909996976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa71200 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009230 tx=0x7fcec8009660 comp rx=0 tx=0).stop 2024-08-31T06:08:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.017+0000 7fcee67bd740 1 -- 172.21.15.53:0/3909996976 shutdown_connections 2024-08-31T06:08:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.017+0000 7fcee67bd740 1 --2- 172.21.15.53:0/3909996976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa71200 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.017+0000 7fcee67bd740 1 --2- 172.21.15.53:0/3909996976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa70ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.017+0000 7fcee67bd740 1 --2- 172.21.15.53:0/3909996976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6cd1b0 0x562e0aa735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.017+0000 7fcee67bd740 1 -- 172.21.15.53:0/3909996976 >> 172.21.15.53:0/3909996976 conn(0x562e0a6c1300 msgr2=0x562e0aa6e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.017+0000 7fcee67bd740 1 -- 172.21.15.53:0/3909996976 shutdown_connections 2024-08-31T06:08:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.017+0000 7fcee67bd740 1 -- 172.21.15.53:0/3909996976 wait complete. 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.017+0000 7fcee67bd740 1 -- start start 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcee67bd740 1 Processor -- start 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa80ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa811e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6cd1b0 0x562e0aa8c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcee67bd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562e0a90eab0 con 0x562e0a6ac4d0 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcee67bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562e0a95c680 con 0x562e0a6a42f0 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcee67bd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562e0aa83620 con 0x562e0a6cd1b0 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcee67bd740 10 client.0 _ll_register_callbacks cb 0x562e0a6e4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcedcd09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa811e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcedcd09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa811e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59364/0 (socket says 172.21.15.53:59364) 2024-08-31T06:08:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcedcd09640 1 -- 172.21.15.53:0/3425567148 learned_addr learned my addr 172.21.15.53:0/3425567148 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fceddd0b640 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6cd1b0 0x562e0aa8c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcedd50a640 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa80ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcedcd09640 1 -- 172.21.15.53:0/3425567148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6cd1b0 msgr2=0x562e0aa8c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcedcd09640 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6cd1b0 0x562e0aa8c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcedcd09640 1 -- 172.21.15.53:0/3425567148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 msgr2=0x562e0aa80ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcedcd09640 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa80ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.018+0000 7fcedcd09640 1 -- 172.21.15.53:0/3425567148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e0a7b1620 con 0x562e0a6ac4d0 2024-08-31T06:08:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.019+0000 7fcedcd09640 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa811e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fcec8032fd0 tx=0x7fcec8031610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582fa678dff76b08 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.019+0000 7fcec0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:08:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.019+0000 7fcec0ff9640 1 -- 172.21.15.53:0/3425567148 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8035040 con 0x562e0a6ac4d0 2024-08-31T06:08:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.019+0000 7fcec0ff9640 1 -- 172.21.15.53:0/3425567148 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fcec8045450 con 0x562e0a6ac4d0 2024-08-31T06:08:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.019+0000 7fcee67bd740 1 -- 172.21.15.53:0/3425567148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec8032e00 con 0x562e0a6ac4d0 2024-08-31T06:08:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.019+0000 7fcec0ff9640 1 -- 172.21.15.53:0/3425567148 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcec8040040 con 0x562e0a6ac4d0 2024-08-31T06:08:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.019+0000 7fcee67bd740 10 client.16983 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.019+0000 7fcee67bd740 1 -- 172.21.15.53:0/3425567148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562e0aa8f660 con 0x562e0a6ac4d0 2024-08-31T06:08:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.019+0000 7fcec0ff9640 1 -- 172.21.15.53:0/3425567148 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcec8032e00 con 0x562e0a6ac4d0 2024-08-31T06:08:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.019+0000 7fcec0ff9640 1 -- 172.21.15.53:0/3425567148 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fcec804f860 con 0x562e0a6ac4d0 2024-08-31T06:08:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.020+0000 7fcee67bd740 10 client.16983 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.020+0000 7fcee67bd740 10 client.16983 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.020+0000 7fcee67bd740 20 client.16983 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.020+0000 7fcee67bd740 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562e0a68bd80 0x562e0aa929c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.020+0000 7fcee67bd740 4 client.16983 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:08:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.020+0000 7fcee67bd740 1 -- 172.21.15.53:0/3425567148 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e0a9e7f50 con 0x562e0a68bd80 2024-08-31T06:08:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.020+0000 7fcedd50a640 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562e0a68bd80 0x562e0aa929c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.020+0000 7fcec0ff9640 10 client.16983 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.020+0000 7fcedd50a640 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562e0a68bd80 0x562e0aa929c0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=723d447e5fc7dca server_cookie=2220d1ef28eaa264 in_seq=0 out_seq=0 2024-08-31T06:08:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcec0ff9640 1 -- 172.21.15.53:0/3425567148 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e0a9e7f50 con 0x562e0a68bd80 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcec0ff9640 10 client.16983 handle_command_reply: tid=0 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 1 client.16983 shutdown 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 1 -- 172.21.15.53:0/3425567148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 msgr2=0x562e0aa811e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa811e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fcec8032fd0 tx=0x7fcec8031610 comp rx=0 tx=0).stop 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 1 -- 172.21.15.53:0/3425567148 shutdown_connections 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562e0a68bd80 0x562e0aa929c0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6cd1b0 0x562e0aa8c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa811e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 1 --2- 172.21.15.53:0/3425567148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa80ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 1 -- 172.21.15.53:0/3425567148 >> 172.21.15.53:0/3425567148 conn(0x562e0a6c1300 msgr2=0x562e0aa724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcec0ff9640 0 client.16983 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 1 -- 172.21.15.53:0/3425567148 shutdown_connections 2024-08-31T06:08:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 1 -- 172.21.15.53:0/3425567148 wait complete. 2024-08-31T06:08:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.022+0000 7fcee67bd740 20 client.16983 trim_cache size 0 max 16384 2024-08-31T06:08:56.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcee67bd740 1 Processor -- start 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcee67bd740 1 -- start start 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6a42f0 0x562e0aa73200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa6db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6cd1b0 0x562e0aa7e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcee67bd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fced81ad180 con 0x562e0a6ac4d0 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcee67bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fced81aed80 con 0x562e0a6cd1b0 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcee67bd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fced81ad850 con 0x562e0a6a42f0 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcedcd09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa6db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcedd50a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6a42f0 0x562e0aa73200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcedd50a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6a42f0 0x562e0aa73200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:43762/0 (socket says 172.21.15.53:43762) 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcedcd09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa6db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59366/0 (socket says 172.21.15.53:59366) 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcedd50a640 1 -- 172.21.15.53:0/2215406719 learned_addr learned my addr 172.21.15.53:0/2215406719 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:56.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fceddd0b640 1 --2- 172.21.15.53:0/2215406719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6cd1b0 0x562e0aa7e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcedcd09640 1 -- 172.21.15.53:0/2215406719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6a42f0 msgr2=0x562e0aa73200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcedcd09640 1 --2- 172.21.15.53:0/2215406719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6a42f0 0x562e0aa73200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcedcd09640 1 -- 172.21.15.53:0/2215406719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6cd1b0 msgr2=0x562e0aa7e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcedcd09640 1 --2- 172.21.15.53:0/2215406719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6cd1b0 0x562e0aa7e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.039+0000 7fcedcd09640 1 -- 172.21.15.53:0/2215406719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e0aa739d0 con 0x562e0a6ac4d0 2024-08-31T06:08:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.040+0000 7fcedd50a640 1 --2- 172.21.15.53:0/2215406719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6a42f0 0x562e0aa73200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.040+0000 7fcedcd09640 1 --2- 172.21.15.53:0/2215406719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa6db70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fcec8033000 tx=0x7fcec8032a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb284bc2986e3112 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.040+0000 7fcec2ffd640 1 -- 172.21.15.53:0/2215406719 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec805c030 con 0x562e0a6ac4d0 2024-08-31T06:08:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.040+0000 7fcec2ffd640 1 -- 172.21.15.53:0/2215406719 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcec8045450 con 0x562e0a6ac4d0 2024-08-31T06:08:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.040+0000 7fcec2ffd640 1 -- 172.21.15.53:0/2215406719 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec804f670 con 0x562e0a6ac4d0 2024-08-31T06:08:56.047 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.041+0000 7fcee67bd740 1 -- 172.21.15.53:0/2215406719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 msgr2=0x562e0aa6db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.041+0000 7fcee67bd740 1 --2- 172.21.15.53:0/2215406719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa6db70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fcec8033000 tx=0x7fcec8032a30 comp rx=0 tx=0).stop 2024-08-31T06:08:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.041+0000 7fcee67bd740 1 -- 172.21.15.53:0/2215406719 shutdown_connections 2024-08-31T06:08:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.041+0000 7fcee67bd740 1 --2- 172.21.15.53:0/2215406719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6cd1b0 0x562e0aa7e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.041+0000 7fcee67bd740 1 --2- 172.21.15.53:0/2215406719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6ac4d0 0x562e0aa6db70 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.041+0000 7fcee67bd740 1 --2- 172.21.15.53:0/2215406719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6a42f0 0x562e0aa73200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.041+0000 7fcee67bd740 1 -- 172.21.15.53:0/2215406719 >> 172.21.15.53:0/2215406719 conn(0x562e0a6c1300 msgr2=0x562e0aa77600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.041+0000 7fcee67bd740 1 -- 172.21.15.53:0/2215406719 shutdown_connections 2024-08-31T06:08:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.041+0000 7fcee67bd740 1 -- 172.21.15.53:0/2215406719 wait complete. 2024-08-31T06:08:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.041+0000 7fcee67bd740 1 -- start start 2024-08-31T06:08:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcee67bd740 1 Processor -- start 2024-08-31T06:08:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa911f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6ac4d0 0x562e0aa91730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcee67bd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6cd1b0 0x562e0aafb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcee67bd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fced81ae5f0 con 0x562e0a6cd1b0 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcee67bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fced81adf20 con 0x562e0a6a42f0 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcee67bd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fced81ab160 con 0x562e0a6ac4d0 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcee67bd740 10 client.0 _ll_register_callbacks cb 0x7fced40e94a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fceddd0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6cd1b0 0x562e0aafb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fceddd0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6cd1b0 0x562e0aafb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59380/0 (socket says 172.21.15.53:59380) 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcedcd09640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6ac4d0 0x562e0aa91730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fceddd0b640 1 -- 172.21.15.53:0/267494717 learned_addr learned my addr 172.21.15.53:0/267494717 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcedd50a640 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa911f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcedcd09640 1 -- 172.21.15.53:0/267494717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 msgr2=0x562e0aa911f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.042+0000 7fcedcd09640 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa911f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcedcd09640 1 -- 172.21.15.53:0/267494717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6cd1b0 msgr2=0x562e0aafb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcedcd09640 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6cd1b0 0x562e0aafb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcedcd09640 1 -- 172.21.15.53:0/267494717 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e0aafb6e0 con 0x562e0a6ac4d0 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fceddd0b640 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6cd1b0 0x562e0aafb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcedcd09640 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6ac4d0 0x562e0aa91730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcec803b000 tx=0x7fcec8045e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc3ab51df3aa8988 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcec0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcec0ff9640 1 -- 172.21.15.53:0/267494717 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8035030 con 0x562e0a6ac4d0 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcec0ff9640 1 -- 172.21.15.53:0/267494717 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fcec8005030 con 0x562e0a6ac4d0 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcee67bd740 1 -- 172.21.15.53:0/267494717 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec8045450 con 0x562e0a6ac4d0 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcec0ff9640 1 -- 172.21.15.53:0/267494717 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcec806e050 con 0x562e0a6ac4d0 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcee67bd740 10 client.26356 fetch_fsmap learned FSMap version 30 2024-08-31T06:08:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcee67bd740 1 -- 172.21.15.53:0/267494717 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562e0aafc930 con 0x562e0a6ac4d0 2024-08-31T06:08:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.043+0000 7fcec0ff9640 1 -- 172.21.15.53:0/267494717 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcec8045450 con 0x562e0a6ac4d0 2024-08-31T06:08:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.044+0000 7fcec0ff9640 1 -- 172.21.15.53:0/267494717 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fcec80046c0 con 0x562e0a6ac4d0 2024-08-31T06:08:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.044+0000 7fcee67bd740 10 client.26356 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:08:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.044+0000 7fcee67bd740 10 client.26356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:08:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.044+0000 7fcee67bd740 20 client.26356 populate_metadata read hostname 'smithi053' 2024-08-31T06:08:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.044+0000 7fcee67bd740 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562e0a6611c0 0x562e0aaff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:08:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.044+0000 7fcee67bd740 4 client.26356 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:08:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.044+0000 7fcee67bd740 1 -- 172.21.15.53:0/267494717 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562e0a9e39f0 con 0x562e0a6611c0 2024-08-31T06:08:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.044+0000 7fcedd50a640 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562e0a6611c0 0x562e0aaff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:08:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.044+0000 7fcec0ff9640 10 client.26356 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.045+0000 7fcedd50a640 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562e0a6611c0 0x562e0aaff0a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=930501bd8f58dba0 server_cookie=6738cae2e63e80be in_seq=0 out_seq=0 2024-08-31T06:08:56.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcec0ff9640 1 -- 172.21.15.53:0/267494717 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562e0a9e39f0 con 0x562e0a6611c0 2024-08-31T06:08:56.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcec0ff9640 10 client.26356 handle_command_reply: tid=0 2024-08-31T06:08:56.062 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 1 client.26356 shutdown 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 1 -- 172.21.15.53:0/267494717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6ac4d0 msgr2=0x562e0aa91730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6ac4d0 0x562e0aa91730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcec803b000 tx=0x7fcec8045e60 comp rx=0 tx=0).stop 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 1 -- 172.21.15.53:0/267494717 shutdown_connections 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562e0a6611c0 0x562e0aaff0a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e0a6cd1b0 0x562e0aafb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e0a6ac4d0 0x562e0aa91730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcec0ff9640 0 client.26356 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 1 --2- 172.21.15.53:0/267494717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e0a6a42f0 0x562e0aa911f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 1 -- 172.21.15.53:0/267494717 >> 172.21.15.53:0/267494717 conn(0x562e0a6c1300 msgr2=0x562e0aa73060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 1 -- 172.21.15.53:0/267494717 shutdown_connections 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 1 -- 172.21.15.53:0/267494717 wait complete. 2024-08-31T06:08:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.060+0000 7fcee67bd740 20 client.26356 trim_cache size 0 max 16384 2024-08-31T06:08:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:08:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:08:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:08:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:08:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 -- 172.21.15.53:0/3402192900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcec40b4ca0 msgr2=0x7fcec40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcec40b4ca0 0x7fcec40b71b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fced0005fd0 tx=0x7fced0009500 comp rx=0 tx=0).stop 2024-08-31T06:08:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 -- 172.21.15.53:0/3402192900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced81027a0 msgr2=0x7fced8199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:08:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced81027a0 0x7fced8199040 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fced400e9f0 tx=0x7fced400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 -- 172.21.15.53:0/3402192900 shutdown_connections 2024-08-31T06:08:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcec40b4ca0 0x7fcec40b71b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fced8108a20 0x7fced819e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fced81080d0 0x7fced81995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 --2- 172.21.15.53:0/3402192900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced81027a0 0x7fced8199040 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:08:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 -- 172.21.15.53:0/3402192900 >> 172.21.15.53:0/3402192900 conn(0x7fced80fe1c0 msgr2=0x7fced81005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:08:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 -- 172.21.15.53:0/3402192900 shutdown_connections 2024-08-31T06:08:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:08:56.061+0000 7fcedf76e640 1 -- 172.21.15.53:0/3402192900 wait complete. 2024-08-31T06:08:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:55 smithi153 ceph-mon[22320]: pgmap v442: 97 pgs: 97 active+clean; 45 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-08-31T06:08:56.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:55 smithi053 ceph-mon[18924]: pgmap v442: 97 pgs: 97 active+clean; 45 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-08-31T06:08:56.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:55 smithi130 ceph-mon[22266]: pgmap v442: 97 pgs: 97 active+clean; 45 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-08-31T06:08:56.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 62660 1.14 MB/sec execute 46 sec latency 15.153 ms 2024-08-31T06:08:57.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 63223 1.22 MB/sec execute 47 sec latency 16.761 ms 2024-08-31T06:08:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:57 smithi153 ceph-mon[22320]: pgmap v443: 97 pgs: 97 active+clean; 46 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-08-31T06:08:58.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:57 smithi053 ceph-mon[18924]: pgmap v443: 97 pgs: 97 active+clean; 46 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-08-31T06:08:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:57 smithi130 ceph-mon[22266]: pgmap v443: 97 pgs: 97 active+clean; 46 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-08-31T06:08:58.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 63685 1.25 MB/sec execute 48 sec latency 13.040 ms 2024-08-31T06:08:59.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 64165 1.31 MB/sec execute 49 sec latency 11.907 ms 2024-08-31T06:09:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:08:59 smithi153 ceph-mon[22320]: pgmap v444: 97 pgs: 97 active+clean; 41 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.3 MiB/s wr, 137 op/s 2024-08-31T06:09:00.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:08:59 smithi053 ceph-mon[18924]: pgmap v444: 97 pgs: 97 active+clean; 41 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.3 MiB/s wr, 137 op/s 2024-08-31T06:09:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:08:59 smithi130 ceph-mon[22266]: pgmap v444: 97 pgs: 97 active+clean; 41 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.3 MiB/s wr, 137 op/s 2024-08-31T06:09:00.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 64432 1.29 MB/sec execute 50 sec latency 12.427 ms 2024-08-31T06:09:01.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 64924 1.30 MB/sec execute 51 sec latency 11.278 ms 2024-08-31T06:09:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:01 smithi153 ceph-mon[22320]: pgmap v445: 97 pgs: 97 active+clean; 43 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2024-08-31T06:09:02.180 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:01 smithi130 ceph-mon[22266]: pgmap v445: 97 pgs: 97 active+clean; 43 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2024-08-31T06:09:02.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:01 smithi053 ceph-mon[18924]: pgmap v445: 97 pgs: 97 active+clean; 43 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2024-08-31T06:09:02.966 INFO:tasks.workunit.client.0.smithi053.stdout: 1 65458 1.34 MB/sec execute 52 sec latency 14.946 ms 2024-08-31T06:09:03.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 66093 1.33 MB/sec execute 53 sec latency 16.958 ms 2024-08-31T06:09:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:03 smithi153 ceph-mon[22320]: pgmap v446: 97 pgs: 97 active+clean; 44 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-08-31T06:09:04.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:03 smithi053 ceph-mon[18924]: pgmap v446: 97 pgs: 97 active+clean; 44 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-08-31T06:09:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:03 smithi130 ceph-mon[22266]: pgmap v446: 97 pgs: 97 active+clean; 44 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-08-31T06:09:04.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 66589 1.40 MB/sec execute 54 sec latency 58.801 ms 2024-08-31T06:09:05.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:09:05.737 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:05.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 67188 1.44 MB/sec execute 55 sec latency 14.429 ms 2024-08-31T06:09:06.134 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:05 smithi053 ceph-mon[18924]: pgmap v447: 97 pgs: 97 active+clean; 45 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 1.4 MiB/s wr, 171 op/s 2024-08-31T06:09:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:05 smithi153 ceph-mon[22320]: pgmap v447: 97 pgs: 97 active+clean; 45 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 1.4 MiB/s wr, 171 op/s 2024-08-31T06:09:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.235+0000 7f7f83fc6640 1 -- 172.21.15.53:0/2496324649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f7c108a90 msgr2=0x7f7f7c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.235+0000 7f7f83fc6640 1 --2- 172.21.15.53:0/2496324649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f7c108a90 0x7f7f7c10f2c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009ca0 tx=0x7f7f7402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.235+0000 7f7f83fc6640 1 -- 172.21.15.53:0/2496324649 shutdown_connections 2024-08-31T06:09:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.235+0000 7f7f83fc6640 1 --2- 172.21.15.53:0/2496324649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f7c108a90 0x7f7f7c10f2c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.235+0000 7f7f83fc6640 1 --2- 172.21.15.53:0/2496324649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f7c108140 0x7f7f7c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.235+0000 7f7f83fc6640 1 --2- 172.21.15.53:0/2496324649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7c102800 0x7f7f7c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.235+0000 7f7f83fc6640 1 -- 172.21.15.53:0/2496324649 >> 172.21.15.53:0/2496324649 conn(0x7f7f7c0794d0 msgr2=0x7f7f7c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.235+0000 7f7f83fc6640 1 -- 172.21.15.53:0/2496324649 shutdown_connections 2024-08-31T06:09:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.235+0000 7f7f83fc6640 1 -- 172.21.15.53:0/2496324649 wait complete. 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f83fc6640 1 Processor -- start 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f83fc6640 1 -- start start 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f83fc6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f7c102800 0x7f7f7c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f83fc6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7c108140 0x7f7f7c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f83fc6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f7c108a90 0x7f7f7c199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f83fc6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c112610 con 0x7f7f7c108a90 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f83fc6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c112490 con 0x7f7f7c108140 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f83fc6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c112790 con 0x7f7f7c102800 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f81561640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7c108140 0x7f7f7c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f81561640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7c108140 0x7f7f7c199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33556/0 (socket says 172.21.15.53:33556) 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f81561640 1 -- 172.21.15.53:0/380998611 learned_addr learned my addr 172.21.15.53:0/380998611 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.236+0000 7f7f82563640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f7c108a90 0x7f7f7c199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f81561640 1 -- 172.21.15.53:0/380998611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f7c102800 msgr2=0x7f7f7c198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f81d62640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f7c102800 0x7f7f7c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f81561640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f7c102800 0x7f7f7c198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f81561640 1 -- 172.21.15.53:0/380998611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f7c108a90 msgr2=0x7f7f7c199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f81561640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f7c108a90 0x7f7f7c199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f81561640 1 -- 172.21.15.53:0/380998611 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c1a83c0 con 0x7f7f7c108140 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f81d62640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f7c102800 0x7f7f7c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f81561640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7c108140 0x7f7f7c199250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00e9f0 tx=0x7f7f6c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f72ffd640 1 -- 172.21.15.53:0/380998611 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00ccc0 con 0x7f7f7c108140 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f72ffd640 1 -- 172.21.15.53:0/380998611 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f6c0054b0 con 0x7f7f7c108140 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f83fc6640 1 -- 172.21.15.53:0/380998611 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7c1a86b0 con 0x7f7f7c108140 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f72ffd640 1 -- 172.21.15.53:0/380998611 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c010430 con 0x7f7f7c108140 2024-08-31T06:09:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.237+0000 7f7f83fc6640 1 -- 172.21.15.53:0/380998611 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7c1a8ba0 con 0x7f7f7c108140 2024-08-31T06:09:06.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.240+0000 7f7f8a53b740 1 Processor -- start 2024-08-31T06:09:06.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f8a53b740 1 -- start start 2024-08-31T06:09:06.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 0x563fb8efa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b2c1b0 0x563fb8efa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b34390 0x563fb8efad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563fb8e71630 con 0x563fb8b2c1b0 2024-08-31T06:09:06.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563fb8e60bc0 con 0x563fb8b34390 2024-08-31T06:09:06.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563fb8e64b70 con 0x563fb8b55070 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f82563640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 0x563fb8efa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f82563640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 0x563fb8efa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:38436/0 (socket says 172.21.15.53:38436) 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f81d62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b2c1b0 0x563fb8efa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f82563640 1 -- 172.21.15.53:0/3051822272 learned_addr learned my addr 172.21.15.53:0/3051822272 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f72ffd640 1 -- 172.21.15.53:0/380998611 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7f6c0105d0 con 0x7f7f7c108140 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f81561640 1 --2- 172.21.15.53:0/3051822272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b34390 0x563fb8efad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f82563640 1 -- 172.21.15.53:0/3051822272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b34390 msgr2=0x563fb8efad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.241+0000 7f7f82563640 1 --2- 172.21.15.53:0/3051822272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b34390 0x563fb8efad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.242+0000 7f7f82563640 1 -- 172.21.15.53:0/3051822272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b2c1b0 msgr2=0x563fb8efa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.242+0000 7f7f82563640 1 --2- 172.21.15.53:0/3051822272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b2c1b0 0x563fb8efa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.242+0000 7f7f82563640 1 -- 172.21.15.53:0/3051822272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb8bc0650 con 0x563fb8b55070 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.242+0000 7f7f81561640 1 --2- 172.21.15.53:0/3051822272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b34390 0x563fb8efad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:09:06.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.242+0000 7f7f82563640 1 --2- 172.21.15.53:0/3051822272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 0x563fb8efa2c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009ca0 tx=0x7f7f74009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5726b5b2002e08b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.242+0000 7f7f67fff640 1 -- 172.21.15.53:0/3051822272 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74031790 con 0x563fb8b55070 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.242+0000 7f7f67fff640 1 -- 172.21.15.53:0/3051822272 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f74036030 con 0x563fb8b55070 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.242+0000 7f7f67fff640 1 -- 172.21.15.53:0/3051822272 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f740042d0 con 0x563fb8b55070 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.242+0000 7f7f72ffd640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f680b4ca0 0x7f7f680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f81d62640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f680b4ca0 0x7f7f680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f72ffd640 1 -- 172.21.15.53:0/380998611 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7f6c0e59c0 con 0x7f7f7c108140 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f8a53b740 1 -- 172.21.15.53:0/3051822272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 msgr2=0x563fb8efa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f81d62640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f680b4ca0 0x7f7f680b71b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x563fb8ef8f40 tx=0x7f7f78005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/3051822272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 0x563fb8efa2c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009ca0 tx=0x7f7f74009a20 comp rx=0 tx=0).stop 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f8a53b740 1 -- 172.21.15.53:0/3051822272 shutdown_connections 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/3051822272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b34390 0x563fb8efad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/3051822272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b2c1b0 0x563fb8efa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/3051822272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 0x563fb8efa2c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f8a53b740 1 -- 172.21.15.53:0/3051822272 >> 172.21.15.53:0/3051822272 conn(0x563fb8b49460 msgr2=0x563fb8ef81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f8a53b740 1 -- 172.21.15.53:0/3051822272 shutdown_connections 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.243+0000 7f7f8a53b740 1 -- 172.21.15.53:0/3051822272 wait complete. 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.244+0000 7f7f8a53b740 1 -- start start 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.244+0000 7f7f8a53b740 1 Processor -- start 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.244+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b2c1b0 0x563fb8f05a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.244+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f05f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.244+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b55070 0x563fb8f11be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.244+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563fb8cc3700 con 0x563fb8b34390 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.244+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563fb8de7700 con 0x563fb8b55070 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.244+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563fb8f088c0 con 0x563fb8b2c1b0 2024-08-31T06:09:06.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f81561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f05f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f81d62640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b2c1b0 0x563fb8f05a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f82563640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b55070 0x563fb8f11be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f8a53b740 10 client.0 _ll_register_callbacks cb 0x563fb8e16dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f81561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f05f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50694/0 (socket says 172.21.15.53:50694) 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f81561640 1 -- 172.21.15.53:0/2301449106 learned_addr learned my addr 172.21.15.53:0/2301449106 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f81d62640 1 -- 172.21.15.53:0/2301449106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b55070 msgr2=0x563fb8f11be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f81d62640 1 --2- 172.21.15.53:0/2301449106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b55070 0x563fb8f11be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f81d62640 1 -- 172.21.15.53:0/2301449106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 msgr2=0x563fb8f05f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f81d62640 1 --2- 172.21.15.53:0/2301449106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f05f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f81d62640 1 -- 172.21.15.53:0/2301449106 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fb8e208b0 con 0x563fb8b2c1b0 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f81d62640 1 --2- 172.21.15.53:0/2301449106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b2c1b0 0x563fb8f05a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7f78011610 tx=0x7f7f780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bce68674917931 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f657fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:09:06.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.245+0000 7f7f657fa640 1 -- 172.21.15.53:0/2301449106 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f780208c0 con 0x563fb8b2c1b0 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f657fa640 1 -- 172.21.15.53:0/2301449106 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7f78020a60 con 0x563fb8b2c1b0 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2301449106 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f74036030 con 0x563fb8b2c1b0 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f657fa640 1 -- 172.21.15.53:0/2301449106 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7f78020c60 con 0x563fb8b2c1b0 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f8a53b740 10 client.26365 fetch_fsmap learned FSMap version 30 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2301449106 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563fb8f14680 con 0x563fb8b2c1b0 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f657fa640 1 -- 172.21.15.53:0/2301449106 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f78020e00 con 0x563fb8b2c1b0 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f657fa640 1 -- 172.21.15.53:0/2301449106 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f7f7800f040 con 0x563fb8b2c1b0 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f8a53b740 10 client.26365 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f8a53b740 10 client.26365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f8a53b740 20 client.26365 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/2301449106 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fb8b139f0 0x563fb8f17bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f8a53b740 4 client.26365 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:06.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2301449106 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7f74036030 con 0x563fb8b139f0 2024-08-31T06:09:06.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.246+0000 7f7f81561640 1 --2- 172.21.15.53:0/2301449106 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fb8b139f0 0x563fb8f17bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.247+0000 7f7f657fa640 10 client.26365 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:06.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.247+0000 7f7f81561640 1 --2- 172.21.15.53:0/2301449106 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fb8b139f0 0x563fb8f17bd0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e80de1422e6cb7f server_cookie=f83654b38d0fa3e in_seq=0 out_seq=0 2024-08-31T06:09:06.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f657fa640 1 -- 172.21.15.53:0/2301449106 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f7f74036030 con 0x563fb8b139f0 2024-08-31T06:09:06.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f657fa640 10 client.26365 handle_command_reply: tid=0 2024-08-31T06:09:06.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 1 client.26365 shutdown 2024-08-31T06:09:06.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2301449106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b2c1b0 msgr2=0x563fb8f05a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:06.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/2301449106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b2c1b0 0x563fb8f05a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7f78011610 tx=0x7f7f780046c0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2301449106 shutdown_connections 2024-08-31T06:09:06.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/2301449106 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fb8b139f0 0x563fb8f17bd0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/2301449106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b55070 0x563fb8f11be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/2301449106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f05f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f657fa640 0 client.26365 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:06.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/2301449106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b2c1b0 0x563fb8f05a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2301449106 >> 172.21.15.53:0/2301449106 conn(0x563fb8b49460 msgr2=0x563fb8efd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:06.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2301449106 shutdown_connections 2024-08-31T06:09:06.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2301449106 wait complete. 2024-08-31T06:09:06.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.248+0000 7f7f8a53b740 20 client.26365 trim_cache size 0 max 16384 2024-08-31T06:09:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.270+0000 7f7f8a53b740 1 Processor -- start 2024-08-31T06:09:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.270+0000 7f7f8a53b740 1 -- start start 2024-08-31T06:09:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.270+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b2c1b0 0x563fb8efdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.270+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f02c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.270+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 0x563fb8f03160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.270+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c1b1500 con 0x563fb8b34390 2024-08-31T06:09:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.270+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c1b3100 con 0x563fb8b2c1b0 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.270+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c1b1bd0 con 0x563fb8b55070 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f81561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f02c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f81561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f02c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50706/0 (socket says 172.21.15.53:50706) 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f81561640 1 -- 172.21.15.53:0/2540026774 learned_addr learned my addr 172.21.15.53:0/2540026774 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f81d62640 1 --2- 172.21.15.53:0/2540026774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b2c1b0 0x563fb8efdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f82563640 1 --2- 172.21.15.53:0/2540026774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 0x563fb8f03160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f81d62640 1 -- 172.21.15.53:0/2540026774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 msgr2=0x563fb8f03160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f81d62640 1 --2- 172.21.15.53:0/2540026774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 0x563fb8f03160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f81d62640 1 -- 172.21.15.53:0/2540026774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 msgr2=0x563fb8f02c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f81d62640 1 --2- 172.21.15.53:0/2540026774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f02c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f81d62640 1 -- 172.21.15.53:0/2540026774 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb8efcb50 con 0x563fb8b2c1b0 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f81561640 1 --2- 172.21.15.53:0/2540026774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f02c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f81d62640 1 --2- 172.21.15.53:0/2540026774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b2c1b0 0x563fb8efdad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f78028510 tx=0x7f7f78013d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fca490dcbdb6cc2b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.271+0000 7f7f677fe640 1 -- 172.21.15.53:0/2540026774 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f78037070 con 0x563fb8b2c1b0 2024-08-31T06:09:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.272+0000 7f7f677fe640 1 -- 172.21.15.53:0/2540026774 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f78004030 con 0x563fb8b2c1b0 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.272+0000 7f7f677fe640 1 -- 172.21.15.53:0/2540026774 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f780054d0 con 0x563fb8b2c1b0 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.272+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2540026774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b2c1b0 msgr2=0x563fb8efdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.272+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/2540026774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b2c1b0 0x563fb8efdad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f78028510 tx=0x7f7f78013d90 comp rx=0 tx=0).stop 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.273+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2540026774 shutdown_connections 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.273+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/2540026774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b55070 0x563fb8f03160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.273+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/2540026774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f02c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.273+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/2540026774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b2c1b0 0x563fb8efdad0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.273+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2540026774 >> 172.21.15.53:0/2540026774 conn(0x563fb8b49460 msgr2=0x563fb8efd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.273+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2540026774 shutdown_connections 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.273+0000 7f7f8a53b740 1 -- 172.21.15.53:0/2540026774 wait complete. 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.273+0000 7f7f8a53b740 1 -- start start 2024-08-31T06:09:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.273+0000 7f7f8a53b740 1 Processor -- start 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b2c1b0 0x563fb8f0e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f0a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f8a53b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b55070 0x563fb8f0ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c1b2970 con 0x563fb8b34390 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c1b22a0 con 0x563fb8b55070 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f8a53b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c1af4e0 con 0x563fb8b2c1b0 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f8a53b740 10 client.0 _ll_register_callbacks cb 0x7f7f78009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f81561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f0a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f81561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f0a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50720/0 (socket says 172.21.15.53:50720) 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f81561640 1 -- 172.21.15.53:0/802742997 learned_addr learned my addr 172.21.15.53:0/802742997 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f82563640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b55070 0x563fb8f0ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f81d62640 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b2c1b0 0x563fb8f0e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f81561640 1 -- 172.21.15.53:0/802742997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b2c1b0 msgr2=0x563fb8f0e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f81561640 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b2c1b0 0x563fb8f0e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f81561640 1 -- 172.21.15.53:0/802742997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b55070 msgr2=0x563fb8f0ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f81561640 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b55070 0x563fb8f0ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f81561640 1 -- 172.21.15.53:0/802742997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fb8f0b0e0 con 0x563fb8b34390 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f82563640 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b55070 0x563fb8f0ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f81561640 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f0a5e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0abfe0 tx=0x7f7f6c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9c431e07861a65 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.274+0000 7f7f657fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f657fa640 1 -- 172.21.15.53:0/802742997 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0ac050 con 0x563fb8b34390 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f657fa640 1 -- 172.21.15.53:0/802742997 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7f6c0a8640 con 0x563fb8b34390 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f8a53b740 1 -- 172.21.15.53:0/802742997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f78004030 con 0x563fb8b34390 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f657fa640 1 -- 172.21.15.53:0/802742997 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7f6c0b08c0 con 0x563fb8b34390 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f8a53b740 10 client.17007 fetch_fsmap learned FSMap version 30 2024-08-31T06:09:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f8a53b740 1 -- 172.21.15.53:0/802742997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563fb8f83360 con 0x563fb8b34390 2024-08-31T06:09:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f657fa640 1 -- 172.21.15.53:0/802742997 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f78004030 con 0x563fb8b34390 2024-08-31T06:09:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f657fa640 1 -- 172.21.15.53:0/802742997 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f7f6c0b4ee0 con 0x563fb8b34390 2024-08-31T06:09:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f8a53b740 10 client.17007 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T06:09:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f8a53b740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f8a53b740 20 client.17007 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fb8ae8da0 0x563fb8f85b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f8a53b740 4 client.17007 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:09:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.275+0000 7f7f8a53b740 1 -- 172.21.15.53:0/802742997 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563fb8e73580 con 0x563fb8ae8da0 2024-08-31T06:09:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.276+0000 7f7f81d62640 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fb8ae8da0 0x563fb8f85b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.276+0000 7f7f81d62640 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fb8ae8da0 0x563fb8f85b60 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a692992aaac3bdd6 server_cookie=3320e5c49d16b00b in_seq=0 out_seq=0 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.276+0000 7f7f657fa640 10 client.17007 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.277+0000 7f7f657fa640 1 -- 172.21.15.53:0/802742997 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x563fb8e73580 con 0x563fb8ae8da0 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.277+0000 7f7f657fa640 10 client.17007 handle_command_reply: tid=0 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.277+0000 7f7f8a53b740 1 client.17007 shutdown 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.277+0000 7f7f8a53b740 1 -- 172.21.15.53:0/802742997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 msgr2=0x563fb8f0a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.277+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f0a5e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0abfe0 tx=0x7f7f6c00ce60 comp rx=0 tx=0).stop 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f8a53b740 1 -- 172.21.15.53:0/802742997 shutdown_connections 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fb8ae8da0 0x563fb8f85b60 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fb8b55070 0x563fb8f0ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fb8b34390 0x563fb8f0a5e0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f8a53b740 1 --2- 172.21.15.53:0/802742997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fb8b2c1b0 0x563fb8f0e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f657fa640 0 client.17007 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:06.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f8a53b740 1 -- 172.21.15.53:0/802742997 >> 172.21.15.53:0/802742997 conn(0x563fb8b49460 msgr2=0x563fb8efb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:06.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f8a53b740 1 -- 172.21.15.53:0/802742997 shutdown_connections 2024-08-31T06:09:06.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f8a53b740 1 -- 172.21.15.53:0/802742997 wait complete. 2024-08-31T06:09:06.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f8a53b740 20 client.17007 trim_cache size 0 max 16384 2024-08-31T06:09:06.284 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:09:06.284 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:09:06.284 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:09:06.284 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:09:06.284 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:09:06.284 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:06.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:06.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:09:06.287 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:09:06.288 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:06.288 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:06.288 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:06.288 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:06.288 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:06.288 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:09:06.288 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:09:06.288 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:09:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f83fc6640 1 -- 172.21.15.53:0/380998611 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f680b4ca0 msgr2=0x7f7f680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.278+0000 7f7f83fc6640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f680b4ca0 0x7f7f680b71b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x563fb8ef8f40 tx=0x7f7f78005f90 comp rx=0 tx=0).stop 2024-08-31T06:09:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.279+0000 7f7f83fc6640 1 -- 172.21.15.53:0/380998611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7c108140 msgr2=0x7f7f7c199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.279+0000 7f7f83fc6640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7c108140 0x7f7f7c199250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00e9f0 tx=0x7f7f6c00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.279+0000 7f7f83fc6640 1 -- 172.21.15.53:0/380998611 shutdown_connections 2024-08-31T06:09:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.279+0000 7f7f83fc6640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f680b4ca0 0x7f7f680b71b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.279+0000 7f7f83fc6640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f7c108a90 0x7f7f7c199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.279+0000 7f7f83fc6640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f7c108140 0x7f7f7c199250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.279+0000 7f7f83fc6640 1 --2- 172.21.15.53:0/380998611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f7c102800 0x7f7f7c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.279+0000 7f7f83fc6640 1 -- 172.21.15.53:0/380998611 >> 172.21.15.53:0/380998611 conn(0x7f7f7c0794d0 msgr2=0x7f7f7c104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.279+0000 7f7f83fc6640 1 -- 172.21.15.53:0/380998611 shutdown_connections 2024-08-31T06:09:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:06.279+0000 7f7f83fc6640 1 -- 172.21.15.53:0/380998611 wait complete. 2024-08-31T06:09:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:05 smithi130 ceph-mon[22266]: pgmap v447: 97 pgs: 97 active+clean; 45 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 1.4 MiB/s wr, 171 op/s 2024-08-31T06:09:06.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 67652 1.49 MB/sec execute 56 sec latency 15.189 ms 2024-08-31T06:09:07.161 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:09:07.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:09:07.436 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:07.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 67883 1.47 MB/sec execute 57 sec latency 28.843 ms 2024-08-31T06:09:07.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.966+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3749599371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4b4109bc0 msgr2=0x7fd4b41103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:07.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.966+0000 7fd4bc2f6640 1 --2- 172.21.15.53:0/3749599371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4b4109bc0 0x7fd4b41103f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009ca0 tx=0x7fd4ac02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:09:07.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.966+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3749599371 shutdown_connections 2024-08-31T06:09:07.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.966+0000 7fd4bc2f6640 1 --2- 172.21.15.53:0/3749599371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4b4109bc0 0x7fd4b41103f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.966+0000 7fd4bc2f6640 1 --2- 172.21.15.53:0/3749599371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b4109270 0x7fd4b4109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.966+0000 7fd4bc2f6640 1 --2- 172.21.15.53:0/3749599371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4103930 0x7fd4b4103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.966+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3749599371 >> 172.21.15.53:0/3749599371 conn(0x7fd4b40ff3c0 msgr2=0x7fd4b4101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.966+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3749599371 shutdown_connections 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.966+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3749599371 wait complete. 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.966+0000 7fd4bc2f6640 1 Processor -- start 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4bc2f6640 1 -- start start 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4bc2f6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4103930 0x7fd4b419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4bc2f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4b4109270 0x7fd4b419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4bc2f6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b4109bc0 0x7fd4b419f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4bc2f6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4113780 con 0x7fd4b4109270 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4bc2f6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4113600 con 0x7fd4b4109bc0 2024-08-31T06:09:07.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4bc2f6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4113900 con 0x7fd4b4103930 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4ba092640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4103930 0x7fd4b419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4b9891640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4b4109270 0x7fd4b419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4b9891640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4b4109270 0x7fd4b419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50730/0 (socket says 172.21.15.53:50730) 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4ba092640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4103930 0x7fd4b419a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:38476/0 (socket says 172.21.15.53:38476) 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4b9891640 1 -- 172.21.15.53:0/3874764114 learned_addr learned my addr 172.21.15.53:0/3874764114 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.967+0000 7fd4ba893640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b4109bc0 0x7fd4b419f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4b9891640 1 -- 172.21.15.53:0/3874764114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4103930 msgr2=0x7fd4b419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4b9891640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4103930 0x7fd4b419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4b9891640 1 -- 172.21.15.53:0/3874764114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b4109bc0 msgr2=0x7fd4b419f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4b9891640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b4109bc0 0x7fd4b419f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4b9891640 1 -- 172.21.15.53:0/3874764114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b41a0080 con 0x7fd4b4109270 2024-08-31T06:09:07.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4ba893640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b4109bc0 0x7fd4b419f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4ba092640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4103930 0x7fd4b419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4b9891640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4b4109270 0x7fd4b419a6b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400e970 tx=0x7fd4a400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4ab7fe640 1 -- 172.21.15.53:0/3874764114 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400cd80 con 0x7fd4b4109270 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4ab7fe640 1 -- 172.21.15.53:0/3874764114 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4a40035f0 con 0x7fd4b4109270 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3874764114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b41a0370 con 0x7fd4b4109270 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4ab7fe640 1 -- 172.21.15.53:0/3874764114 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4010690 con 0x7fd4b4109270 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.968+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3874764114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b41a6ad0 con 0x7fd4b4109270 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.969+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3874764114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b4103d40 con 0x7fd4b4109270 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.971+0000 7fd4ab7fe640 1 -- 172.21.15.53:0/3874764114 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd4a4004000 con 0x7fd4b4109270 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.972+0000 7fd4ab7fe640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4a00b4d20 0x7fd4a00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.973+0000 7fd4ba092640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4a00b4d20 0x7fd4a00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.973+0000 7fd4ab7fe640 1 -- 172.21.15.53:0/3874764114 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fd4a40e5810 con 0x7fd4b4109270 2024-08-31T06:09:07.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.973+0000 7fd4ba092640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4a00b4d20 0x7fd4a00b7230 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009fc0 tx=0x7fd4b0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:07.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:07.976+0000 7fd4ab7fe640 1 -- 172.21.15.53:0/3874764114 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd4a40ac600 con 0x7fd4b4109270 2024-08-31T06:09:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:07 smithi153 ceph-mon[22320]: pgmap v448: 97 pgs: 97 active+clean; 46 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.5 MiB/s wr, 165 op/s 2024-08-31T06:09:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:07 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:08.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:07 smithi053 ceph-mon[18924]: pgmap v448: 97 pgs: 97 active+clean; 46 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.5 MiB/s wr, 165 op/s 2024-08-31T06:09:08.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:07 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:08.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.243+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3874764114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4b419b240 con 0x7fd4b4109270 2024-08-31T06:09:08.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.244+0000 7fd4ab7fe640 1 -- 172.21.15.53:0/3874764114 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11993 (secure 0 0 0) 0x7fd4b419b240 con 0x7fd4b4109270 2024-08-31T06:09:08.246 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:09:08.246 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":31,"btime":"2024-08-31T06:09:06:898956+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:09:06.361591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:09:08.247 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 31 2024-08-31T06:09:08.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.246+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3874764114 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4a00b4d20 msgr2=0x7fd4a00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:08.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.246+0000 7fd4bc2f6640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4a00b4d20 0x7fd4a00b7230 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009fc0 tx=0x7fd4b0005f90 comp rx=0 tx=0).stop 2024-08-31T06:09:08.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.246+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3874764114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4b4109270 msgr2=0x7fd4b419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:08.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.246+0000 7fd4bc2f6640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4b4109270 0x7fd4b419a6b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400e970 tx=0x7fd4a400ee30 comp rx=0 tx=0).stop 2024-08-31T06:09:08.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.247+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3874764114 shutdown_connections 2024-08-31T06:09:08.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.247+0000 7fd4bc2f6640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4a00b4d20 0x7fd4a00b7230 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:08.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.247+0000 7fd4bc2f6640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4b4109bc0 0x7fd4b419f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:08.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.247+0000 7fd4bc2f6640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4b4109270 0x7fd4b419a6b0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:08.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.247+0000 7fd4bc2f6640 1 --2- 172.21.15.53:0/3874764114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4103930 0x7fd4b419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:08.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.247+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3874764114 >> 172.21.15.53:0/3874764114 conn(0x7fd4b40ff3c0 msgr2=0x7fd4b4106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:08.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.247+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3874764114 shutdown_connections 2024-08-31T06:09:08.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:08.247+0000 7fd4bc2f6640 1 -- 172.21.15.53:0/3874764114 wait complete. 2024-08-31T06:09:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:07 smithi130 ceph-mon[22266]: pgmap v448: 97 pgs: 97 active+clean; 46 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.5 MiB/s wr, 165 op/s 2024-08-31T06:09:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:07 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:08.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 68292 1.45 MB/sec execute 58 sec latency 14.324 ms 2024-08-31T06:09:09.090 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:09:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.170+0000 7fa00dba8640 1 -- 172.21.15.53:0/766237717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa008108a00 msgr2=0x7fa00810f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.170+0000 7fa00dba8640 1 --2- 172.21.15.53:0/766237717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa008108a00 0x7fa00810f230 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa000009ca0 tx=0x7fa00002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.170+0000 7fa00dba8640 1 -- 172.21.15.53:0/766237717 shutdown_connections 2024-08-31T06:09:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.170+0000 7fa00dba8640 1 --2- 172.21.15.53:0/766237717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa008108a00 0x7fa00810f230 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.170+0000 7fa00dba8640 1 --2- 172.21.15.53:0/766237717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0081080b0 0x7fa0081084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.170+0000 7fa00dba8640 1 --2- 172.21.15.53:0/766237717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa008102780 0x7fa008102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.170+0000 7fa00dba8640 1 -- 172.21.15.53:0/766237717 >> 172.21.15.53:0/766237717 conn(0x7fa00807a480 msgr2=0x7fa00807a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.170+0000 7fa00dba8640 1 -- 172.21.15.53:0/766237717 shutdown_connections 2024-08-31T06:09:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.170+0000 7fa00dba8640 1 -- 172.21.15.53:0/766237717 wait complete. 2024-08-31T06:09:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa00dba8640 1 Processor -- start 2024-08-31T06:09:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa00dba8640 1 -- start start 2024-08-31T06:09:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa00dba8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa008102780 0x7fa00819a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa00dba8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0081080b0 0x7fa00819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa00dba8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa008108a00 0x7fa00819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa00dba8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081125b0 con 0x7fa0081080b0 2024-08-31T06:09:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa00dba8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa008112430 con 0x7fa008102780 2024-08-31T06:09:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa00dba8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa008112730 con 0x7fa008108a00 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7f9ffffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0081080b0 0x7fa00819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa0077fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa008102780 0x7fa00819a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa0077fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa008102780 0x7fa00819a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33626/0 (socket says 172.21.15.53:33626) 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa0077fe640 1 -- 172.21.15.53:0/3265379980 learned_addr learned my addr 172.21.15.53:0/3265379980 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa007fff640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa008108a00 0x7fa00819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa0077fe640 1 -- 172.21.15.53:0/3265379980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa008108a00 msgr2=0x7fa00819f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa0077fe640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa008108a00 0x7fa00819f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa0077fe640 1 -- 172.21.15.53:0/3265379980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0081080b0 msgr2=0x7fa00819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa0077fe640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0081080b0 0x7fa00819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa0077fe640 1 -- 172.21.15.53:0/3265379980 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00819ffb0 con 0x7fa008102780 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.171+0000 7fa007fff640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa008108a00 0x7fa00819f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.172+0000 7fa0077fe640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa008102780 0x7fa00819a080 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800ea60 tx=0x7f9ff800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.172+0000 7fa0057fa640 1 -- 172.21.15.53:0/3265379980 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800cde0 con 0x7fa008102780 2024-08-31T06:09:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.172+0000 7fa00dba8640 1 -- 172.21.15.53:0/3265379980 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0081a02a0 con 0x7fa008102780 2024-08-31T06:09:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.172+0000 7fa0057fa640 1 -- 172.21.15.53:0/3265379980 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ff80035f0 con 0x7fa008102780 2024-08-31T06:09:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.172+0000 7fa0057fa640 1 -- 172.21.15.53:0/3265379980 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8010690 con 0x7fa008102780 2024-08-31T06:09:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.172+0000 7fa00dba8640 1 -- 172.21.15.53:0/3265379980 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0081a6a30 con 0x7fa008102780 2024-08-31T06:09:09.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:08 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3874764114' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:09:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa014bef740 1 Processor -- start 2024-08-31T06:09:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa014bef740 1 -- start start 2024-08-31T06:09:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa0057fa640 1 -- 172.21.15.53:0/3265379980 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9ff8004000 con 0x7fa008102780 2024-08-31T06:09:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa014bef740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a29088cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa014bef740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a29088d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa014bef740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a29088d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa014bef740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a290802000 con 0x55a2904c02f0 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa014bef740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a2907f1590 con 0x55a2904c84d0 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa014bef740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a2907f5540 con 0x55a2904e91b0 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa0077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a29088d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa007fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a29088cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7f9ffffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a29088d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa0077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a29088d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50758/0 (socket says 172.21.15.53:50758) 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa0077fe640 1 -- 172.21.15.53:0/3172291145 learned_addr learned my addr 172.21.15.53:0/3172291145 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.175+0000 7fa007fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a29088cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:38508/0 (socket says 172.21.15.53:38508) 2024-08-31T06:09:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.176+0000 7fa007fff640 1 -- 172.21.15.53:0/3172291145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 msgr2=0x55a29088d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.176+0000 7fa007fff640 1 --2- 172.21.15.53:0/3172291145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a29088d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.176+0000 7fa007fff640 1 -- 172.21.15.53:0/3172291145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 msgr2=0x55a29088d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.176+0000 7fa007fff640 1 --2- 172.21.15.53:0/3172291145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a29088d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.176+0000 7fa007fff640 1 -- 172.21.15.53:0/3172291145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a290554790 con 0x55a2904e91b0 2024-08-31T06:09:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.176+0000 7fa007fff640 1 --2- 172.21.15.53:0/3172291145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a29088cce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa000009ca0 tx=0x7fa000009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a6dcdd0d411db5d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.176+0000 7fa0057fa640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ff40b4ca0 0x7f9ff40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.176+0000 7fa0077fe640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ff40b4ca0 0x7f9ff40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.176+0000 7f9ffdffb640 1 -- 172.21.15.53:0/3172291145 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000031980 con 0x55a2904e91b0 2024-08-31T06:09:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.177+0000 7f9ffdffb640 1 -- 172.21.15.53:0/3172291145 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa000036070 con 0x55a2904e91b0 2024-08-31T06:09:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.177+0000 7f9ffdffb640 1 -- 172.21.15.53:0/3172291145 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000004310 con 0x55a2904e91b0 2024-08-31T06:09:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.177+0000 7fa0057fa640 1 -- 172.21.15.53:0/3265379980 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f9ff80e58a0 con 0x7fa008102780 2024-08-31T06:09:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.178+0000 7fa0077fe640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ff40b4ca0 0x7f9ff40b71b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80a9200 tx=0x7f9ff80eb550 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.178+0000 7fa014bef740 1 -- 172.21.15.53:0/3172291145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 msgr2=0x55a29088cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.178+0000 7fa014bef740 1 --2- 172.21.15.53:0/3172291145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a29088cce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa000009ca0 tx=0x7fa000009a20 comp rx=0 tx=0).stop 2024-08-31T06:09:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.178+0000 7fa014bef740 1 -- 172.21.15.53:0/3172291145 shutdown_connections 2024-08-31T06:09:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.178+0000 7fa014bef740 1 --2- 172.21.15.53:0/3172291145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a29088d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.178+0000 7fa014bef740 1 --2- 172.21.15.53:0/3172291145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a29088d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.178+0000 7fa014bef740 1 --2- 172.21.15.53:0/3172291145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a29088cce0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.178+0000 7fa014bef740 1 -- 172.21.15.53:0/3172291145 >> 172.21.15.53:0/3172291145 conn(0x55a2904dd300 msgr2=0x55a29088abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.178+0000 7fa014bef740 1 -- 172.21.15.53:0/3172291145 shutdown_connections 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.178+0000 7fa014bef740 1 -- 172.21.15.53:0/3172291145 wait complete. 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.179+0000 7fa014bef740 1 -- start start 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.179+0000 7fa014bef740 1 Processor -- start 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.179+0000 7fa014bef740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a2908988d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.179+0000 7fa014bef740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a290898e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.179+0000 7fa014bef740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a2908a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.179+0000 7fa014bef740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a29072aab0 con 0x55a2904c02f0 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.179+0000 7fa014bef740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a290778680 con 0x55a2904c84d0 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.179+0000 7fa014bef740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a29089b400 con 0x55a2904e91b0 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.179+0000 7fa014bef740 10 client.0 _ll_register_callbacks cb 0x55a290500a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.179+0000 7fa007fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a2908988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.179+0000 7fa007fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a2908988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50768/0 (socket says 172.21.15.53:50768) 2024-08-31T06:09:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7fa007fff640 1 -- 172.21.15.53:0/2963733674 learned_addr learned my addr 172.21.15.53:0/2963733674 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7f9ffffff640 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a290898e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7fa007fff640 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a2908a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7f9ffffff640 1 -- 172.21.15.53:0/2963733674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 msgr2=0x55a2908a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7f9ffffff640 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a2908a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7f9ffffff640 1 -- 172.21.15.53:0/2963733674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 msgr2=0x55a2908988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7f9ffffff640 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a2908988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7f9ffffff640 1 -- 172.21.15.53:0/2963733674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2905cd620 con 0x55a2904c84d0 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7fa007fff640 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a2908988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7f9ffffff640 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a290898e30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa00806c490 tx=0x7f9ff0012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c276441e3b0e62a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7f9fe6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/2963733674 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000f890 con 0x55a2904c84d0 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/2963733674 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f9ff000fa30 con 0x55a2904c84d0 2024-08-31T06:09:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7fa014bef740 1 -- 172.21.15.53:0/2963733674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa000036070 con 0x55a2904c84d0 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.180+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/2963733674 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9ff000fc30 con 0x55a2904c84d0 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.181+0000 7fa014bef740 10 client.26381 fetch_fsmap learned FSMap version 31 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.181+0000 7fa014bef740 1 -- 172.21.15.53:0/2963733674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a2908a7510 con 0x55a2904c84d0 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.181+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/2963733674 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa000036070 con 0x55a2904c84d0 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.181+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/2963733674 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f9ff001c420 con 0x55a2904c84d0 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.181+0000 7fa014bef740 10 client.26381 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.181+0000 7fa014bef740 10 client.26381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.181+0000 7fa014bef740 20 client.26381 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.181+0000 7fa014bef740 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2904a7d80 0x55a2908aab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.181+0000 7fa014bef740 4 client.26381 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.181+0000 7fa014bef740 1 -- 172.21.15.53:0/2963733674 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a290803f50 con 0x55a2904a7d80 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.181+0000 7fa007fff640 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2904a7d80 0x55a2908aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.182+0000 7f9fe6ffd640 10 client.26381 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.182+0000 7fa007fff640 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2904a7d80 0x55a2908aab50 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=238de2bbe22cc4 server_cookie=281400d052335888 in_seq=0 out_seq=0 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/2963733674 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a290803f50 con 0x55a2904a7d80 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7f9fe6ffd640 10 client.26381 handle_command_reply: tid=0 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 1 client.26381 shutdown 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 1 -- 172.21.15.53:0/2963733674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 msgr2=0x55a290898e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a290898e30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa00806c490 tx=0x7f9ff0012b60 comp rx=0 tx=0).stop 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 1 -- 172.21.15.53:0/2963733674 shutdown_connections 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2904a7d80 0x55a2908aab50 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a2908a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a290898e30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7f9fe6ffd640 0 client.26381 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 1 --2- 172.21.15.53:0/2963733674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a2908988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 1 -- 172.21.15.53:0/2963733674 >> 172.21.15.53:0/2963733674 conn(0x55a2904dd300 msgr2=0x55a29088dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 1 -- 172.21.15.53:0/2963733674 shutdown_connections 2024-08-31T06:09:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 1 -- 172.21.15.53:0/2963733674 wait complete. 2024-08-31T06:09:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.183+0000 7fa014bef740 20 client.26381 trim_cache size 0 max 16384 2024-08-31T06:09:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa014bef740 1 Processor -- start 2024-08-31T06:09:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa014bef740 1 -- start start 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa014bef740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a290897b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa014bef740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a2908980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa014bef740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a29088a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa014bef740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081af340 con 0x55a2904c02f0 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa014bef740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081b0f70 con 0x55a2904c84d0 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa014bef740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081afa10 con 0x55a2904e91b0 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa007fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a290897b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa007fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a290897b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50784/0 (socket says 172.21.15.53:50784) 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa007fff640 1 -- 172.21.15.53:0/1332767625 learned_addr learned my addr 172.21.15.53:0/1332767625 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7fa007fff640 1 --2- 172.21.15.53:0/1332767625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a29088a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.202+0000 7f9ffffff640 1 --2- 172.21.15.53:0/1332767625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a2908980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.203+0000 7fa007fff640 1 -- 172.21.15.53:0/1332767625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 msgr2=0x55a29088a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.203+0000 7fa007fff640 1 --2- 172.21.15.53:0/1332767625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a29088a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.203+0000 7fa007fff640 1 -- 172.21.15.53:0/1332767625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 msgr2=0x55a2908980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.203+0000 7fa007fff640 1 --2- 172.21.15.53:0/1332767625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a2908980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.203+0000 7fa007fff640 1 -- 172.21.15.53:0/1332767625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a290894180 con 0x55a2904c02f0 2024-08-31T06:09:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.203+0000 7fa007fff640 1 --2- 172.21.15.53:0/1332767625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a290897b90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fa000006010 tx=0x7fa00003d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15eaa95eea80ea98 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.203+0000 7f9ffd7fa640 1 -- 172.21.15.53:0/1332767625 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000031b80 con 0x55a2904c02f0 2024-08-31T06:09:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.203+0000 7f9ffd7fa640 1 -- 172.21.15.53:0/1332767625 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa000036040 con 0x55a2904c02f0 2024-08-31T06:09:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.203+0000 7f9ffd7fa640 1 -- 172.21.15.53:0/1332767625 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0000305c0 con 0x55a2904c02f0 2024-08-31T06:09:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.204+0000 7fa014bef740 1 -- 172.21.15.53:0/1332767625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 msgr2=0x55a290897b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.204+0000 7fa014bef740 1 --2- 172.21.15.53:0/1332767625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a290897b90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fa000006010 tx=0x7fa00003d040 comp rx=0 tx=0).stop 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.204+0000 7fa014bef740 1 -- 172.21.15.53:0/1332767625 shutdown_connections 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.204+0000 7fa014bef740 1 --2- 172.21.15.53:0/1332767625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904e91b0 0x55a29088a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.204+0000 7fa014bef740 1 --2- 172.21.15.53:0/1332767625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904c84d0 0x55a2908980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.204+0000 7fa014bef740 1 --2- 172.21.15.53:0/1332767625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a290897b90 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.204+0000 7fa014bef740 1 -- 172.21.15.53:0/1332767625 >> 172.21.15.53:0/1332767625 conn(0x55a2904dd300 msgr2=0x55a290896f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.204+0000 7fa014bef740 1 -- 172.21.15.53:0/1332767625 shutdown_connections 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.204+0000 7fa014bef740 1 -- 172.21.15.53:0/1332767625 wait complete. 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.205+0000 7fa014bef740 1 -- start start 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.205+0000 7fa014bef740 1 Processor -- start 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.205+0000 7fa014bef740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a29089be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.205+0000 7fa014bef740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904c84d0 0x55a29089c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.205+0000 7fa014bef740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904e91b0 0x55a290913540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.205+0000 7fa014bef740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081b07e0 con 0x55a2904c02f0 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.205+0000 7fa014bef740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081b00e0 con 0x55a2904e91b0 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.205+0000 7fa014bef740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081ad320 con 0x55a2904c84d0 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.205+0000 7fa014bef740 10 client.0 _ll_register_callbacks cb 0x7f9ff0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7fa007fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a29089be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7f9ffffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904c84d0 0x55a29089c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7fa007fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a29089be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50792/0 (socket says 172.21.15.53:50792) 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7fa007fff640 1 -- 172.21.15.53:0/4029463235 learned_addr learned my addr 172.21.15.53:0/4029463235 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7fa007fff640 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904e91b0 0x55a290913540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7fa007fff640 1 -- 172.21.15.53:0/4029463235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904c84d0 msgr2=0x55a29089c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7fa007fff640 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904c84d0 0x55a29089c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7fa007fff640 1 -- 172.21.15.53:0/4029463235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904e91b0 msgr2=0x55a290913540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7fa007fff640 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904e91b0 0x55a290913540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7fa007fff640 1 -- 172.21.15.53:0/4029463235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a290913a80 con 0x55a2904c02f0 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7f9ffffff640 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904c84d0 0x55a29089c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7fa007fff640 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a29089be50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa00002ae80 tx=0x7fa000003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1a31ba9d0729a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7f9fe6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/4029463235 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000004d40 con 0x55a2904c02f0 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/4029463235 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa000031980 con 0x55a2904c02f0 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.206+0000 7fa014bef740 1 -- 172.21.15.53:0/4029463235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa000036040 con 0x55a2904c02f0 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/4029463235 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa000004820 con 0x55a2904c02f0 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7fa014bef740 10 client.17031 fetch_fsmap learned FSMap version 31 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7fa014bef740 1 -- 172.21.15.53:0/4029463235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a290914c90 con 0x55a2904c02f0 2024-08-31T06:09:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/4029463235 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa000036040 con 0x55a2904c02f0 2024-08-31T06:09:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/4029463235 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fa00004f040 con 0x55a2904c02f0 2024-08-31T06:09:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7fa014bef740 10 client.17031 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T06:09:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7fa014bef740 10 client.17031 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7fa014bef740 20 client.17031 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7fa014bef740 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a29047d1c0 0x55a290916f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7fa014bef740 4 client.17031 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:09:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7fa014bef740 1 -- 172.21.15.53:0/4029463235 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a2907ff9f0 con 0x55a29047d1c0 2024-08-31T06:09:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.207+0000 7f9ffffff640 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a29047d1c0 0x55a290916f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.208+0000 7f9fe6ffd640 10 client.17031 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.208+0000 7f9ffffff640 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a29047d1c0 0x55a290916f50 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ec82c41b483a6d7 server_cookie=3d30a07c122edb8e in_seq=0 out_seq=0 2024-08-31T06:09:09.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:08 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3874764114' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:09:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7f9fe6ffd640 1 -- 172.21.15.53:0/4029463235 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a2907ff9f0 con 0x55a29047d1c0 2024-08-31T06:09:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7f9fe6ffd640 10 client.17031 handle_command_reply: tid=0 2024-08-31T06:09:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7fa014bef740 1 client.17031 shutdown 2024-08-31T06:09:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7fa014bef740 1 -- 172.21.15.53:0/4029463235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 msgr2=0x55a29089be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7fa014bef740 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a29089be50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa00002ae80 tx=0x7fa000003970 comp rx=0 tx=0).stop 2024-08-31T06:09:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7fa014bef740 1 -- 172.21.15.53:0/4029463235 shutdown_connections 2024-08-31T06:09:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7fa014bef740 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a29047d1c0 0x55a290916f50 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7fa014bef740 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2904e91b0 0x55a290913540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7fa014bef740 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2904c84d0 0x55a29089c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7f9fe6ffd640 0 client.17031 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7fa014bef740 1 --2- 172.21.15.53:0/4029463235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2904c02f0 0x55a29089be50 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.228+0000 7fa014bef740 1 -- 172.21.15.53:0/4029463235 >> 172.21.15.53:0/4029463235 conn(0x55a2904dd300 msgr2=0x55a290896e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.229+0000 7fa014bef740 1 -- 172.21.15.53:0/4029463235 shutdown_connections 2024-08-31T06:09:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.229+0000 7fa014bef740 1 -- 172.21.15.53:0/4029463235 wait complete. 2024-08-31T06:09:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.229+0000 7fa014bef740 20 client.17031 trim_cache size 0 max 16384 2024-08-31T06:09:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:09:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:09:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:09:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:09:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.229+0000 7fa00dba8640 1 -- 172.21.15.53:0/3265379980 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ff40b4ca0 msgr2=0x7f9ff40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.229+0000 7fa00dba8640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ff40b4ca0 0x7f9ff40b71b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80a9200 tx=0x7f9ff80eb550 comp rx=0 tx=0).stop 2024-08-31T06:09:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.229+0000 7fa00dba8640 1 -- 172.21.15.53:0/3265379980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa008102780 msgr2=0x7fa00819a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.229+0000 7fa00dba8640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa008102780 0x7fa00819a080 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800ea60 tx=0x7f9ff800ef20 comp rx=0 tx=0).stop 2024-08-31T06:09:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.229+0000 7fa00dba8640 1 -- 172.21.15.53:0/3265379980 shutdown_connections 2024-08-31T06:09:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.230+0000 7fa00dba8640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ff40b4ca0 0x7f9ff40b71b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.230+0000 7fa00dba8640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa008108a00 0x7fa00819f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.230+0000 7fa00dba8640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0081080b0 0x7fa00819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.230+0000 7fa00dba8640 1 --2- 172.21.15.53:0/3265379980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa008102780 0x7fa00819a080 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.230+0000 7fa00dba8640 1 -- 172.21.15.53:0/3265379980 >> 172.21.15.53:0/3265379980 conn(0x7fa00807a480 msgr2=0x7fa0081016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.230+0000 7fa00dba8640 1 -- 172.21.15.53:0/3265379980 shutdown_connections 2024-08-31T06:09:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:09.230+0000 7fa00dba8640 1 -- 172.21.15.53:0/3265379980 wait complete. 2024-08-31T06:09:09.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:08 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3874764114' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:09:09.386 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:09.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.915+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/2496425943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b4102800 msgr2=0x7ff1b4102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.915+0000 7ff1b9ae8640 1 --2- 172.21.15.53:0/2496425943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b4102800 0x7ff1b4102c10 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009900 tx=0x7ff1a402a410 comp rx=0 tx=0).stop 2024-08-31T06:09:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.915+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/2496425943 shutdown_connections 2024-08-31T06:09:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.915+0000 7ff1b9ae8640 1 --2- 172.21.15.53:0/2496425943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b4108a90 0x7ff1b410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.915+0000 7ff1b9ae8640 1 --2- 172.21.15.53:0/2496425943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b4108140 0x7ff1b4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.915+0000 7ff1b9ae8640 1 --2- 172.21.15.53:0/2496425943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b4102800 0x7ff1b4102c10 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.915+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/2496425943 >> 172.21.15.53:0/2496425943 conn(0x7ff1b40794d0 msgr2=0x7ff1b40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.915+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/2496425943 shutdown_connections 2024-08-31T06:09:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.915+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/2496425943 wait complete. 2024-08-31T06:09:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.915+0000 7ff1b9ae8640 1 Processor -- start 2024-08-31T06:09:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b9ae8640 1 -- start start 2024-08-31T06:09:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b9ae8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b4102800 0x7ff1b4199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b9ae8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b4108140 0x7ff1b41995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b9ae8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b4108a90 0x7ff1b419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b9ae8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b41125f0 con 0x7ff1b4108a90 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b9ae8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b4112470 con 0x7ff1b4108140 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b9ae8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b4112770 con 0x7ff1b4102800 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b4108a90 0x7ff1b419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b4108a90 0x7ff1b419e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50808/0 (socket says 172.21.15.53:50808) 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b4102800 0x7ff1b4199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b3fff640 1 -- 172.21.15.53:0/945969637 learned_addr learned my addr 172.21.15.53:0/945969637 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.916+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b4108140 0x7ff1b41995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.917+0000 7ff1b3fff640 1 -- 172.21.15.53:0/945969637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b4102800 msgr2=0x7ff1b4199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.917+0000 7ff1b3fff640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b4102800 0x7ff1b4199040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.917+0000 7ff1b3fff640 1 -- 172.21.15.53:0/945969637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b4108140 msgr2=0x7ff1b41995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.917+0000 7ff1b3fff640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b4108140 0x7ff1b41995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.917+0000 7ff1b3fff640 1 -- 172.21.15.53:0/945969637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b419efb0 con 0x7ff1b4108a90 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.917+0000 7ff1b3fff640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b4108a90 0x7ff1b419e880 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00eb10 tx=0x7ff1ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.917+0000 7ff1b0ff9640 1 -- 172.21.15.53:0/945969637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac004b20 con 0x7ff1b4108a90 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.917+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/945969637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b419f2a0 con 0x7ff1b4108a90 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.917+0000 7ff1b0ff9640 1 -- 172.21.15.53:0/945969637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1ac004cc0 con 0x7ff1b4108a90 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.917+0000 7ff1b0ff9640 1 -- 172.21.15.53:0/945969637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac010690 con 0x7ff1b4108a90 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.917+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/945969637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b406ac00 con 0x7ff1b4108a90 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.920+0000 7ff1b0ff9640 1 -- 172.21.15.53:0/945969637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff1ac005020 con 0x7ff1b4108a90 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.920+0000 7ff1c005d740 1 Processor -- start 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.920+0000 7ff1c005d740 1 -- start start 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.920+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643cecf9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.920+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643cecf9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.920+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecf9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.920+0000 7ff1c005d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5643cec70680 con 0x5643ce92b1b0 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.920+0000 7ff1c005d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5643cec5fc10 con 0x5643ce933390 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.920+0000 7ff1c005d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5643cec63bc0 con 0x5643ce954070 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecf9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643cecf9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecf9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33680/0 (socket says 172.21.15.53:33680) 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b2ffd640 1 -- 172.21.15.53:0/3047880605 learned_addr learned my addr 172.21.15.53:0/3047880605 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b37fe640 1 --2- 172.21.15.53:0/3047880605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643cecf9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50824/0 (socket says 172.21.15.53:50824) 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/3047880605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643cecf9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b0ff9640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff19c0b4d20 0x7ff19c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b2ffd640 1 -- 172.21.15.53:0/3047880605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 msgr2=0x5643cecf9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/3047880605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643cecf9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b2ffd640 1 -- 172.21.15.53:0/3047880605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 msgr2=0x5643cecf9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/3047880605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643cecf9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b2ffd640 1 -- 172.21.15.53:0/3047880605 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643ce9bf650 con 0x5643ce933390 2024-08-31T06:09:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b0ff9640 1 -- 172.21.15.53:0/945969637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7ff1ac0e5ab0 con 0x7ff1b4108a90 2024-08-31T06:09:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b3fff640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff19c0b4d20 0x7ff19c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.921+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/3047880605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecf9d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80058c0 tx=0x7ff1a8005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52a23c98e7ebbb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.922+0000 7ff199ffb640 1 -- 172.21.15.53:0/3047880605 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8005020 con 0x5643ce933390 2024-08-31T06:09:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.922+0000 7ff199ffb640 1 -- 172.21.15.53:0/3047880605 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1a80047a0 con 0x5643ce933390 2024-08-31T06:09:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.922+0000 7ff199ffb640 1 -- 172.21.15.53:0/3047880605 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8005650 con 0x5643ce933390 2024-08-31T06:09:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.922+0000 7ff1c005d740 1 -- 172.21.15.53:0/3047880605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 msgr2=0x5643cecf9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.922+0000 7ff1c005d740 1 --2- 172.21.15.53:0/3047880605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecf9d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80058c0 tx=0x7ff1a8005850 comp rx=0 tx=0).stop 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.922+0000 7ff1b3fff640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff19c0b4d20 0x7ff19c0b7230 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0049d0 tx=0x7ff1ac091f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.923+0000 7ff1c005d740 1 -- 172.21.15.53:0/3047880605 shutdown_connections 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.923+0000 7ff1c005d740 1 --2- 172.21.15.53:0/3047880605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecf9d90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.923+0000 7ff1c005d740 1 --2- 172.21.15.53:0/3047880605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643cecf9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.923+0000 7ff1c005d740 1 --2- 172.21.15.53:0/3047880605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643cecf9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.923+0000 7ff1c005d740 1 -- 172.21.15.53:0/3047880605 >> 172.21.15.53:0/3047880605 conn(0x5643ce948460 msgr2=0x5643cecf7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.923+0000 7ff1c005d740 1 -- 172.21.15.53:0/3047880605 shutdown_connections 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.923+0000 7ff1c005d740 1 -- 172.21.15.53:0/3047880605 wait complete. 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.923+0000 7ff1c005d740 1 -- start start 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.923+0000 7ff1c005d740 1 Processor -- start 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643ced04b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce933390 0x5643ced05090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce954070 0x5643ced10de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1c005d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5643ceac2700 con 0x5643ce92b1b0 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1c005d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5643cebe6750 con 0x5643ce954070 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1c005d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5643ced07af0 con 0x5643ce933390 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1c005d740 10 client.0 _ll_register_callbacks cb 0x5643cec15e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1b2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643ced04b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1b2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643ced04b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50834/0 (socket says 172.21.15.53:50834) 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1b2ffd640 1 -- 172.21.15.53:0/2092815789 learned_addr learned my addr 172.21.15.53:0/2092815789 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce954070 0x5643ced10de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1b37fe640 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce933390 0x5643ced05090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1b2ffd640 1 -- 172.21.15.53:0/2092815789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce933390 msgr2=0x5643ced05090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce933390 0x5643ced05090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1b2ffd640 1 -- 172.21.15.53:0/2092815789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce954070 msgr2=0x5643ced10de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce954070 0x5643ced10de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1b2ffd640 1 -- 172.21.15.53:0/2092815789 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643cec1f900 con 0x5643ce92b1b0 2024-08-31T06:09:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.924+0000 7ff1b37fe640 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce933390 0x5643ced05090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643ced04b10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8004770 tx=0x7ff1a8009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559c3b06b15f0370 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff192ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff192ffd640 1 -- 172.21.15.53:0/2092815789 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8005520 con 0x5643ce92b1b0 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff192ffd640 1 -- 172.21.15.53:0/2092815789 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7ff1a8026040 con 0x5643ce92b1b0 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff1c005d740 1 -- 172.21.15.53:0/2092815789 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1a80047a0 con 0x5643ce92b1b0 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff192ffd640 1 -- 172.21.15.53:0/2092815789 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff1a800f790 con 0x5643ce92b1b0 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff1c005d740 10 client.17043 fetch_fsmap learned FSMap version 31 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff1c005d740 1 -- 172.21.15.53:0/2092815789 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5643ced13950 con 0x5643ce92b1b0 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff192ffd640 1 -- 172.21.15.53:0/2092815789 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1a80047a0 con 0x5643ce92b1b0 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff192ffd640 1 -- 172.21.15.53:0/2092815789 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7ff1a801d030 con 0x5643ce92b1b0 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff1c005d740 10 client.17043 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff1c005d740 10 client.17043 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff1c005d740 20 client.17043 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.925+0000 7ff1c005d740 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5643ce9129f0 0x5643ced16cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.926+0000 7ff1c005d740 4 client.17043 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.926+0000 7ff1c005d740 1 -- 172.21.15.53:0/2092815789 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643cec725d0 con 0x5643ce9129f0 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.926+0000 7ff1b37fe640 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5643ce9129f0 0x5643ced16cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.926+0000 7ff192ffd640 10 client.17043 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.926+0000 7ff1b37fe640 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5643ce9129f0 0x5643ced16cb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=282a27112e30be4 server_cookie=6c2f5151fc4c2eeb in_seq=0 out_seq=0 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff192ffd640 1 -- 172.21.15.53:0/2092815789 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643cec725d0 con 0x5643ce9129f0 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff192ffd640 10 client.17043 handle_command_reply: tid=0 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff1c005d740 1 client.17043 shutdown 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff1c005d740 1 -- 172.21.15.53:0/2092815789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 msgr2=0x5643ced04b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff1c005d740 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643ced04b10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8004770 tx=0x7ff1a8009cd0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff1c005d740 1 -- 172.21.15.53:0/2092815789 shutdown_connections 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff1c005d740 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce954070 0x5643ced10de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff1c005d740 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5643ce9129f0 0x5643ced16cb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff1c005d740 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce933390 0x5643ced05090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff1c005d740 1 --2- 172.21.15.53:0/2092815789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643ced04b10 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff192ffd640 0 client.17043 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:09:09.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.927+0000 7ff1c005d740 1 -- 172.21.15.53:0/2092815789 >> 172.21.15.53:0/2092815789 conn(0x5643ce948460 msgr2=0x5643cecfc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.928+0000 7ff1c005d740 1 -- 172.21.15.53:0/2092815789 shutdown_connections 2024-08-31T06:09:09.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.928+0000 7ff1c005d740 1 -- 172.21.15.53:0/2092815789 wait complete. 2024-08-31T06:09:09.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.928+0000 7ff1c005d740 20 client.17043 trim_cache size 0 max 16384 2024-08-31T06:09:09.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1c005d740 1 Processor -- start 2024-08-31T06:09:09.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1c005d740 1 -- start start 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643ced069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecfaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643ced10ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1c005d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b41ad210 con 0x5643ce92b1b0 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1c005d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b41aee40 con 0x5643ce933390 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1c005d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b41ad8e0 con 0x5643ce954070 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1b37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecfaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1b2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643ced069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1b37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecfaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33702/0 (socket says 172.21.15.53:33702) 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1b2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643ced069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50842/0 (socket says 172.21.15.53:50842) 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.944+0000 7ff1b37fe640 1 -- 172.21.15.53:0/2642562672 learned_addr learned my addr 172.21.15.53:0/2642562672 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:09.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.945+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/2642562672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643ced10ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.945+0000 7ff1b37fe640 1 -- 172.21.15.53:0/2642562672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 msgr2=0x5643ced10ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.945+0000 7ff1b37fe640 1 --2- 172.21.15.53:0/2642562672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643ced10ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.945+0000 7ff1b37fe640 1 -- 172.21.15.53:0/2642562672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 msgr2=0x5643ced069f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.945+0000 7ff1b37fe640 1 --2- 172.21.15.53:0/2642562672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643ced069f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.945+0000 7ff1b37fe640 1 -- 172.21.15.53:0/2642562672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643ced05dd0 con 0x5643ce933390 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.945+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/2642562672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643ced10ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.945+0000 7ff1b37fe640 1 --2- 172.21.15.53:0/2642562672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecfaa00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009900 tx=0x7ff1a4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed9945979cee6a25 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.945+0000 7ff1997fa640 1 -- 172.21.15.53:0/2642562672 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a404b070 con 0x5643ce933390 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.945+0000 7ff1997fa640 1 -- 172.21.15.53:0/2642562672 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1a403d760 con 0x5643ce933390 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.945+0000 7ff1997fa640 1 -- 172.21.15.53:0/2642562672 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4035040 con 0x5643ce933390 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.946+0000 7ff1c005d740 1 -- 172.21.15.53:0/2642562672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 msgr2=0x5643cecfaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.946+0000 7ff1c005d740 1 --2- 172.21.15.53:0/2642562672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecfaa00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009900 tx=0x7ff1a4000bc0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.946+0000 7ff1c005d740 1 -- 172.21.15.53:0/2642562672 shutdown_connections 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.946+0000 7ff1c005d740 1 --2- 172.21.15.53:0/2642562672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643ced10ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.946+0000 7ff1c005d740 1 --2- 172.21.15.53:0/2642562672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce933390 0x5643cecfaa00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.946+0000 7ff1c005d740 1 --2- 172.21.15.53:0/2642562672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce92b1b0 0x5643ced069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.946+0000 7ff1c005d740 1 -- 172.21.15.53:0/2642562672 >> 172.21.15.53:0/2642562672 conn(0x5643ce948460 msgr2=0x5643cecfa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.946+0000 7ff1c005d740 1 -- 172.21.15.53:0/2642562672 shutdown_connections 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.946+0000 7ff1c005d740 1 -- 172.21.15.53:0/2642562672 wait complete. 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1c005d740 1 -- start start 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1c005d740 1 Processor -- start 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce92b1b0 0x5643ced0b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce933390 0x5643ced0ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1c005d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643ced80490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1c005d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b41ae6b0 con 0x5643ce933390 2024-08-31T06:09:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1c005d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b41adfb0 con 0x5643ce92b1b0 2024-08-31T06:09:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1c005d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b41ab1f0 con 0x5643ce954070 2024-08-31T06:09:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1c005d740 10 client.0 _ll_register_callbacks cb 0x7ff1a8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1b37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce933390 0x5643ced0ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1b2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce92b1b0 0x5643ced0b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1b37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce933390 0x5643ced0ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50852/0 (socket says 172.21.15.53:50852) 2024-08-31T06:09:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1b37fe640 1 -- 172.21.15.53:0/1265985955 learned_addr learned my addr 172.21.15.53:0/1265985955 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.947+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643ced80490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff1b37fe640 1 -- 172.21.15.53:0/1265985955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 msgr2=0x5643ced80490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff1b37fe640 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643ced80490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff1b37fe640 1 -- 172.21.15.53:0/1265985955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce92b1b0 msgr2=0x5643ced0b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff1b37fe640 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce92b1b0 0x5643ced0b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff1b37fe640 1 -- 172.21.15.53:0/1265985955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643ced80a50 con 0x5643ce933390 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643ced80490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff1b37fe640 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce933390 0x5643ced0ba70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009230 tx=0x7ff1a4005100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4642b84cf399fbed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff192ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff192ffd640 1 -- 172.21.15.53:0/1265985955 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4058060 con 0x5643ce933390 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff192ffd640 1 -- 172.21.15.53:0/1265985955 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7ff1a403d910 con 0x5643ce933390 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff1c005d740 1 -- 172.21.15.53:0/1265985955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1a403d760 con 0x5643ce933390 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff192ffd640 1 -- 172.21.15.53:0/1265985955 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff1a404b070 con 0x5643ce933390 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff1c005d740 10 client.17049 fetch_fsmap learned FSMap version 31 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.948+0000 7ff1c005d740 1 -- 172.21.15.53:0/1265985955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5643ced81cd0 con 0x5643ce933390 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.949+0000 7ff192ffd640 1 -- 172.21.15.53:0/1265985955 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1a403d760 con 0x5643ce933390 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.949+0000 7ff192ffd640 1 -- 172.21.15.53:0/1265985955 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7ff1a40035f0 con 0x5643ce933390 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.949+0000 7ff1c005d740 10 client.17049 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T06:09:09.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.949+0000 7ff1c005d740 10 client.17049 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:09:09.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.949+0000 7ff1c005d740 20 client.17049 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:09.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.949+0000 7ff1c005d740 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5643ce8e7da0 0x5643ced84460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:09.971 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:09:09.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.949+0000 7ff1c005d740 4 client.17049 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:09:09.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.949+0000 7ff1c005d740 1 -- 172.21.15.53:0/1265985955 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643cec6e070 con 0x5643ce8e7da0 2024-08-31T06:09:09.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.949+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5643ce8e7da0 0x5643ced84460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1b2ffd640 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5643ce8e7da0 0x5643ced84460 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=46b50dab16574d8 server_cookie=a3e6f1588e44c265 in_seq=0 out_seq=0 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff192ffd640 10 client.17049 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff192ffd640 1 -- 172.21.15.53:0/1265985955 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643cec6e070 con 0x5643ce8e7da0 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff192ffd640 10 client.17049 handle_command_reply: tid=0 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 1 client.17049 shutdown 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 1 -- 172.21.15.53:0/1265985955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce933390 msgr2=0x5643ced0ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce933390 0x5643ced0ba70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009230 tx=0x7ff1a4005100 comp rx=0 tx=0).stop 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 1 -- 172.21.15.53:0/1265985955 shutdown_connections 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5643ce8e7da0 0x5643ced84460 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643ce954070 0x5643ced80490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643ce933390 0x5643ced0ba70 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff192ffd640 0 client.17049 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 1 --2- 172.21.15.53:0/1265985955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643ce92b1b0 0x5643ced0b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 1 -- 172.21.15.53:0/1265985955 >> 172.21.15.53:0/1265985955 conn(0x5643ce948460 msgr2=0x5643ced06730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 1 -- 172.21.15.53:0/1265985955 shutdown_connections 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 1 -- 172.21.15.53:0/1265985955 wait complete. 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.950+0000 7ff1c005d740 20 client.17049 trim_cache size 0 max 16384 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/945969637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff19c0b4d20 msgr2=0x7ff19c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff19c0b4d20 0x7ff19c0b7230 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0049d0 tx=0x7ff1ac091f90 comp rx=0 tx=0).stop 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/945969637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b4108a90 msgr2=0x7ff1b419e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b4108a90 0x7ff1b419e880 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00eb10 tx=0x7ff1ac00c2d0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/945969637 shutdown_connections 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff19c0b4d20 0x7ff19c0b7230 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b4108a90 0x7ff1b419e880 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b4108140 0x7ff1b41995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 --2- 172.21.15.53:0/945969637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b4102800 0x7ff1b4199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:09.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/945969637 >> 172.21.15.53:0/945969637 conn(0x7ff1b40794d0 msgr2=0x7ff1b4101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:09.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/945969637 shutdown_connections 2024-08-31T06:09:09.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:09.951+0000 7ff1b9ae8640 1 -- 172.21.15.53:0/945969637 wait complete. 2024-08-31T06:09:09.974 INFO:tasks.workunit.client.0.smithi053.stdout: 1 68803 1.50 MB/sec execute 59 sec latency 40.185 ms 2024-08-31T06:09:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:09 smithi153 ceph-mon[22320]: pgmap v449: 97 pgs: 97 active+clean; 47 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-08-31T06:09:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:09 smithi053 ceph-mon[18924]: pgmap v449: 97 pgs: 97 active+clean; 47 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-08-31T06:09:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:09 smithi130 ceph-mon[22266]: pgmap v449: 97 pgs: 97 active+clean; 47 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-08-31T06:09:10.867 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:09:10.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 69346 1.49 MB/sec execute 60 sec latency 15.450 ms 2024-08-31T06:09:11.145 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.653+0000 7f2107b01640 1 -- 172.21.15.53:0/1214866179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f210010dc00 msgr2=0x7f21001100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.653+0000 7f2107b01640 1 --2- 172.21.15.53:0/1214866179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f210010dc00 0x7f21001100d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009ca0 tx=0x7f20f802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.653+0000 7f2107b01640 1 -- 172.21.15.53:0/1214866179 shutdown_connections 2024-08-31T06:09:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.653+0000 7f2107b01640 1 --2- 172.21.15.53:0/1214866179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f210010dc00 0x7f21001100d0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.653+0000 7f2107b01640 1 --2- 172.21.15.53:0/1214866179 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2100105120 0x7f210010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.653+0000 7f2107b01640 1 --2- 172.21.15.53:0/1214866179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21001047d0 0x7f2100104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.653+0000 7f2107b01640 1 -- 172.21.15.53:0/1214866179 >> 172.21.15.53:0/1214866179 conn(0x7f2100079530 msgr2=0x7f2100079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.654+0000 7f2107b01640 1 -- 172.21.15.53:0/1214866179 shutdown_connections 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.654+0000 7f2107b01640 1 -- 172.21.15.53:0/1214866179 wait complete. 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.654+0000 7f2107b01640 1 Processor -- start 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.654+0000 7f2107b01640 1 -- start start 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f2107b01640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21001047d0 0x7f2100102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f2107b01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2100105120 0x7f2100102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f2107b01640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f210010dc00 0x7f2100102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f2107b01640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2100113760 con 0x7f2100105120 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f2107b01640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f21001135e0 con 0x7f210010dc00 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f2107b01640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f21001138e0 con 0x7f21001047d0 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f210509c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2100105120 0x7f2100102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f210509c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2100105120 0x7f2100102a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50858/0 (socket says 172.21.15.53:50858) 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f210509c640 1 -- 172.21.15.53:0/1848439059 learned_addr learned my addr 172.21.15.53:0/1848439059 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f210609e640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f210010dc00 0x7f2100102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f210589d640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21001047d0 0x7f2100102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f210509c640 1 -- 172.21.15.53:0/1848439059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21001047d0 msgr2=0x7f2100102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f210509c640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21001047d0 0x7f2100102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f210509c640 1 -- 172.21.15.53:0/1848439059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f210010dc00 msgr2=0x7f2100102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f210509c640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f210010dc00 0x7f2100102f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f210509c640 1 -- 172.21.15.53:0/1848439059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21001a8450 con 0x7f2100105120 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f210509c640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2100105120 0x7f2100102a50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f20f000e9f0 tx=0x7f20f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f20f6ffd640 1 -- 172.21.15.53:0/1848439059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f000ccc0 con 0x7f2100105120 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.655+0000 7f2107b01640 1 -- 172.21.15.53:0/1848439059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21001a8740 con 0x7f2100105120 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.656+0000 7f20f6ffd640 1 -- 172.21.15.53:0/1848439059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20f00108c0 con 0x7f2100105120 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.656+0000 7f2107b01640 1 -- 172.21.15.53:0/1848439059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21001a8cd0 con 0x7f2100105120 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.656+0000 7f20f6ffd640 1 -- 172.21.15.53:0/1848439059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0018660 con 0x7f2100105120 2024-08-31T06:09:11.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.658+0000 7f20f6ffd640 1 -- 172.21.15.53:0/1848439059 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f20f0010430 con 0x7f2100105120 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.658+0000 7f210e076740 1 Processor -- start 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210e076740 1 -- start start 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210e076740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f424f92310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210e076740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bc41b0 0x55f424f92850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210e076740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bcc390 0x55f424f92d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210e076740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f424f09680 con 0x55f424bcc390 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210e076740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f424ef8c10 con 0x55f424bed070 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210e076740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f424efcbc0 con 0x55f424bc41b0 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210509c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bcc390 0x55f424f92d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210609e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f424f92310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210509c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bcc390 0x55f424f92d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50860/0 (socket says 172.21.15.53:50860) 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210509c640 1 -- 172.21.15.53:0/4201787976 learned_addr learned my addr 172.21.15.53:0/4201787976 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210609e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f424f92310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33742/0 (socket says 172.21.15.53:33742) 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210589d640 1 --2- 172.21.15.53:0/4201787976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bc41b0 0x55f424f92850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210609e640 1 -- 172.21.15.53:0/4201787976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bc41b0 msgr2=0x55f424f92850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:11.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210609e640 1 --2- 172.21.15.53:0/4201787976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bc41b0 0x55f424f92850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210609e640 1 -- 172.21.15.53:0/4201787976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bcc390 msgr2=0x55f424f92d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:11.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210609e640 1 --2- 172.21.15.53:0/4201787976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bcc390 0x55f424f92d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.659+0000 7f210609e640 1 -- 172.21.15.53:0/4201787976 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f424c58650 con 0x55f424bed070 2024-08-31T06:09:11.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.660+0000 7f20f6ffd640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20ec0b4d20 0x7f20ec0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.660+0000 7f210609e640 1 --2- 172.21.15.53:0/4201787976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f424f92310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f20f8031040 tx=0x7f20f8009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d94348a83de252 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:11.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.660+0000 7f210589d640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20ec0b4d20 0x7f20ec0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.660+0000 7f20f6ffd640 1 -- 172.21.15.53:0/1848439059 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f20f00e58a0 con 0x7f2100105120 2024-08-31T06:09:11.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.660+0000 7f20ebfff640 1 -- 172.21.15.53:0/4201787976 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8031790 con 0x55f424bed070 2024-08-31T06:09:11.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.660+0000 7f20ebfff640 1 -- 172.21.15.53:0/4201787976 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20f8036030 con 0x55f424bed070 2024-08-31T06:09:11.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.660+0000 7f20ebfff640 1 -- 172.21.15.53:0/4201787976 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f80042d0 con 0x55f424bed070 2024-08-31T06:09:11.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.661+0000 7f210e076740 1 -- 172.21.15.53:0/4201787976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 msgr2=0x55f424f92310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:11.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.661+0000 7f210589d640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20ec0b4d20 0x7f20ec0b7230 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x55f424f90f90 tx=0x7f20fc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:11.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.661+0000 7f210e076740 1 --2- 172.21.15.53:0/4201787976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f424f92310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f20f8031040 tx=0x7f20f8009a20 comp rx=0 tx=0).stop 2024-08-31T06:09:11.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.661+0000 7f210e076740 1 -- 172.21.15.53:0/4201787976 shutdown_connections 2024-08-31T06:09:11.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.661+0000 7f210e076740 1 --2- 172.21.15.53:0/4201787976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bcc390 0x55f424f92d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.661+0000 7f210e076740 1 --2- 172.21.15.53:0/4201787976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bc41b0 0x55f424f92850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.661+0000 7f210e076740 1 --2- 172.21.15.53:0/4201787976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f424f92310 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.661+0000 7f210e076740 1 -- 172.21.15.53:0/4201787976 >> 172.21.15.53:0/4201787976 conn(0x55f424be1460 msgr2=0x55f424f90200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:11.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.661+0000 7f210e076740 1 -- 172.21.15.53:0/4201787976 shutdown_connections 2024-08-31T06:09:11.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.661+0000 7f210e076740 1 -- 172.21.15.53:0/4201787976 wait complete. 2024-08-31T06:09:11.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210e076740 1 -- start start 2024-08-31T06:09:11.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210e076740 1 Processor -- start 2024-08-31T06:09:11.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210e076740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 0x55f424f9dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210e076740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 0x55f424f9e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210e076740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f424fa9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210e076740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f424d5b700 con 0x55f424bc41b0 2024-08-31T06:09:11.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210e076740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f424e7f750 con 0x55f424bed070 2024-08-31T06:09:11.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210e076740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f424fa0910 con 0x55f424bcc390 2024-08-31T06:09:11.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210589d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 0x55f424f9dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210589d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 0x55f424f9dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50866/0 (socket says 172.21.15.53:50866) 2024-08-31T06:09:11.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210589d640 1 -- 172.21.15.53:0/812339924 learned_addr learned my addr 172.21.15.53:0/812339924 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:11.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210509c640 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 0x55f424f9e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210e076740 10 client.0 _ll_register_callbacks cb 0x55f424eaee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:11.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.662+0000 7f210609e640 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f424fa9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f210509c640 1 -- 172.21.15.53:0/812339924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 msgr2=0x55f424fa9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:11.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f210509c640 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f424fa9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f210509c640 1 -- 172.21.15.53:0/812339924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 msgr2=0x55f424f9dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:11.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f210509c640 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 0x55f424f9dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f210509c640 1 -- 172.21.15.53:0/812339924 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f424eb8900 con 0x55f424bcc390 2024-08-31T06:09:11.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f210609e640 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f424fa9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:09:11.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f210509c640 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 0x55f424f9e010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f20f00a8060 tx=0x7f20f00abdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfb40cf4ccb093c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:11.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f20e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:09:11.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f20e97fa640 1 -- 172.21.15.53:0/812339924 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0010720 con 0x55f424bcc390 2024-08-31T06:09:11.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f210e076740 1 -- 172.21.15.53:0/812339924 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20f8036030 con 0x55f424bcc390 2024-08-31T06:09:11.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f20e97fa640 1 -- 172.21.15.53:0/812339924 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f20f00e3210 con 0x55f424bcc390 2024-08-31T06:09:11.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f20e97fa640 1 -- 172.21.15.53:0/812339924 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f20f00e3410 con 0x55f424bcc390 2024-08-31T06:09:11.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f210e076740 10 client.26422 fetch_fsmap learned FSMap version 31 2024-08-31T06:09:11.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.663+0000 7f210e076740 1 -- 172.21.15.53:0/812339924 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f424fac790 con 0x55f424bcc390 2024-08-31T06:09:11.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.664+0000 7f20e97fa640 1 -- 172.21.15.53:0/812339924 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20f8036030 con 0x55f424bcc390 2024-08-31T06:09:11.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.664+0000 7f20e97fa640 1 -- 172.21.15.53:0/812339924 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f20f00b0410 con 0x55f424bcc390 2024-08-31T06:09:11.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.664+0000 7f210e076740 10 client.26422 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T06:09:11.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.664+0000 7f210e076740 10 client.26422 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:09:11.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.664+0000 7f210e076740 20 client.26422 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:11.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.664+0000 7f210e076740 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f424bab9f0 0x55f424fafc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.664+0000 7f210e076740 4 client.26422 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:11.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.664+0000 7f210e076740 1 -- 172.21.15.53:0/812339924 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f424f0b5d0 con 0x55f424bab9f0 2024-08-31T06:09:11.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.664+0000 7f210589d640 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f424bab9f0 0x55f424fafc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.665+0000 7f210589d640 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f424bab9f0 0x55f424fafc00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=19d3ff8df30de531 server_cookie=b0622306344cf3d9 in_seq=0 out_seq=0 2024-08-31T06:09:11.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.665+0000 7f20e97fa640 10 client.26422 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:09:11.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f20e97fa640 1 -- 172.21.15.53:0/812339924 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f424f0b5d0 con 0x55f424bab9f0 2024-08-31T06:09:11.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f20e97fa640 10 client.26422 handle_command_reply: tid=0 2024-08-31T06:09:11.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 1 client.26422 shutdown 2024-08-31T06:09:11.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 1 -- 172.21.15.53:0/812339924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 msgr2=0x55f424f9e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:11.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 0x55f424f9e010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f20f00a8060 tx=0x7f20f00abdb0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 1 -- 172.21.15.53:0/812339924 shutdown_connections 2024-08-31T06:09:11.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f424fa9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 0x55f424f9e010 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f424bab9f0 0x55f424fafc00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 1 --2- 172.21.15.53:0/812339924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 0x55f424f9dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 1 -- 172.21.15.53:0/812339924 >> 172.21.15.53:0/812339924 conn(0x55f424be1460 msgr2=0x55f424f954f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:11.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f20e97fa640 0 client.26422 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:09:11.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 1 -- 172.21.15.53:0/812339924 shutdown_connections 2024-08-31T06:09:11.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 1 -- 172.21.15.53:0/812339924 wait complete. 2024-08-31T06:09:11.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.666+0000 7f210e076740 20 client.26422 trim_cache size 0 max 16384 2024-08-31T06:09:11.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210e076740 1 Processor -- start 2024-08-31T06:09:11.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210e076740 1 -- start start 2024-08-31T06:09:11.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210e076740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bc41b0 0x55f424f9f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210e076740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bcc390 0x55f424fa9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210e076740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bed070 0x55f424faa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210e076740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f21001b1700 con 0x55f424bed070 2024-08-31T06:09:11.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210e076740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f21001b3330 con 0x55f424bcc390 2024-08-31T06:09:11.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210e076740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f21001b1dd0 con 0x55f424bc41b0 2024-08-31T06:09:11.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210509c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bcc390 0x55f424fa9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210609e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bed070 0x55f424faa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210509c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bcc390 0x55f424fa9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33746/0 (socket says 172.21.15.53:33746) 2024-08-31T06:09:11.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210509c640 1 -- 172.21.15.53:0/1014206872 learned_addr learned my addr 172.21.15.53:0/1014206872 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210609e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bed070 0x55f424faa040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50872/0 (socket says 172.21.15.53:50872) 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.681+0000 7f210589d640 1 --2- 172.21.15.53:0/1014206872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bc41b0 0x55f424f9f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.682+0000 7f210609e640 1 -- 172.21.15.53:0/1014206872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bc41b0 msgr2=0x55f424f9f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.682+0000 7f210609e640 1 --2- 172.21.15.53:0/1014206872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bc41b0 0x55f424f9f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.682+0000 7f210609e640 1 -- 172.21.15.53:0/1014206872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bcc390 msgr2=0x55f424fa9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.682+0000 7f210609e640 1 --2- 172.21.15.53:0/1014206872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bcc390 0x55f424fa9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.682+0000 7f210609e640 1 -- 172.21.15.53:0/1014206872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f424f9ed90 con 0x55f424bed070 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.682+0000 7f210509c640 1 --2- 172.21.15.53:0/1014206872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bcc390 0x55f424fa9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.682+0000 7f210609e640 1 --2- 172.21.15.53:0/1014206872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bed070 0x55f424faa040 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009ca0 tx=0x7f20f8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c575b5d2d014a161 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.682+0000 7f20eb7fe640 1 -- 172.21.15.53:0/1014206872 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8055070 con 0x55f424bed070 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.682+0000 7f20eb7fe640 1 -- 172.21.15.53:0/1014206872 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20f8036040 con 0x55f424bed070 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.682+0000 7f20eb7fe640 1 -- 172.21.15.53:0/1014206872 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f804a040 con 0x55f424bed070 2024-08-31T06:09:11.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.683+0000 7f210e076740 1 -- 172.21.15.53:0/1014206872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bed070 msgr2=0x55f424faa040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.683+0000 7f210e076740 1 --2- 172.21.15.53:0/1014206872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bed070 0x55f424faa040 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009ca0 tx=0x7f20f8000f40 comp rx=0 tx=0).stop 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.683+0000 7f210e076740 1 -- 172.21.15.53:0/1014206872 shutdown_connections 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.683+0000 7f210e076740 1 --2- 172.21.15.53:0/1014206872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bed070 0x55f424faa040 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.683+0000 7f210e076740 1 --2- 172.21.15.53:0/1014206872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bcc390 0x55f424fa9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.683+0000 7f210e076740 1 --2- 172.21.15.53:0/1014206872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bc41b0 0x55f424f9f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.683+0000 7f210e076740 1 -- 172.21.15.53:0/1014206872 >> 172.21.15.53:0/1014206872 conn(0x55f424be1460 msgr2=0x55f424f9eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.683+0000 7f210e076740 1 -- 172.21.15.53:0/1014206872 shutdown_connections 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.683+0000 7f210e076740 1 -- 172.21.15.53:0/1014206872 wait complete. 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.684+0000 7f210e076740 1 -- start start 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.684+0000 7f210e076740 1 Processor -- start 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.684+0000 7f210e076740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 0x55f424fa1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.684+0000 7f210e076740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 0x55f424fa2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.684+0000 7f210e076740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f4250195a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.684+0000 7f210e076740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f21001b2ba0 con 0x55f424bc41b0 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.684+0000 7f210e076740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f21001b24a0 con 0x55f424bed070 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.684+0000 7f210e076740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f21001af6e0 con 0x55f424bcc390 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.684+0000 7f210e076740 10 client.0 _ll_register_callbacks cb 0x7f20f000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210509c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 0x55f424fa2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210609e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f4250195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210589d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 0x55f424fa1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210609e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f4250195a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33760/0 (socket says 172.21.15.53:33760) 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210509c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 0x55f424fa2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:38646/0 (socket says 172.21.15.53:38646) 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210609e640 1 -- 172.21.15.53:0/3150589666 learned_addr learned my addr 172.21.15.53:0/3150589666 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210589d640 1 -- 172.21.15.53:0/3150589666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 msgr2=0x55f424fa2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210589d640 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 0x55f424fa2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210589d640 1 -- 172.21.15.53:0/3150589666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 msgr2=0x55f4250195a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210589d640 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f4250195a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210589d640 1 -- 172.21.15.53:0/3150589666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f424fa2b30 con 0x55f424bc41b0 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210609e640 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f4250195a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210589d640 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 0x55f424fa1dd0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x55f424fb02e0 tx=0x7f20fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9983ecdb625932f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f20e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f20e97fa640 1 -- 172.21.15.53:0/3150589666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc005020 con 0x55f424bc41b0 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f20e97fa640 1 -- 172.21.15.53:0/3150589666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f20fc018070 con 0x55f424bc41b0 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.685+0000 7f210e076740 1 -- 172.21.15.53:0/3150589666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20f8036040 con 0x55f424bc41b0 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f20e97fa640 1 -- 172.21.15.53:0/3150589666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f20fc0051c0 con 0x55f424bc41b0 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f210e076740 10 client.17067 fetch_fsmap learned FSMap version 31 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f210e076740 1 -- 172.21.15.53:0/3150589666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f42501ab40 con 0x55f424bc41b0 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f20e97fa640 1 -- 172.21.15.53:0/3150589666 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20f8036040 con 0x55f424bc41b0 2024-08-31T06:09:11.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f20e97fa640 1 -- 172.21.15.53:0/3150589666 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f20fc039410 con 0x55f424bc41b0 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f210e076740 10 client.17067 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f210e076740 10 client.17067 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f210e076740 20 client.17067 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f210e076740 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f424b80da0 0x55f42501d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f210e076740 4 client.17067 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f210e076740 1 -- 172.21.15.53:0/3150589666 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f424f07070 con 0x55f424b80da0 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.686+0000 7f210509c640 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f424b80da0 0x55f42501d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f210509c640 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f424b80da0 0x55f42501d330 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c7e28f03b6af7f08 server_cookie=427203f38cfd51f in_seq=0 out_seq=0 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f20e97fa640 10 client.17067 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f20e97fa640 1 -- 172.21.15.53:0/3150589666 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f424f07070 con 0x55f424b80da0 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f20e97fa640 10 client.17067 handle_command_reply: tid=0 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f210e076740 1 client.17067 shutdown 2024-08-31T06:09:11.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f210e076740 1 -- 172.21.15.53:0/3150589666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 msgr2=0x55f424fa1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:11.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f210e076740 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 0x55f424fa1dd0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x55f424fb02e0 tx=0x7f20fc0046c0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f210e076740 1 -- 172.21.15.53:0/3150589666 shutdown_connections 2024-08-31T06:09:11.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f210e076740 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f424bed070 0x55f4250195a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f210e076740 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f424bcc390 0x55f424fa2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f210e076740 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f424b80da0 0x55f42501d330 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f210e076740 1 --2- 172.21.15.53:0/3150589666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f424bc41b0 0x55f424fa1dd0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f210e076740 1 -- 172.21.15.53:0/3150589666 >> 172.21.15.53:0/3150589666 conn(0x55f424be1460 msgr2=0x55f424f95b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:11.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.687+0000 7f20e97fa640 0 client.17067 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:09:11.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f210e076740 1 -- 172.21.15.53:0/3150589666 shutdown_connections 2024-08-31T06:09:11.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f210e076740 1 -- 172.21.15.53:0/3150589666 wait complete. 2024-08-31T06:09:11.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f210e076740 20 client.17067 trim_cache size 0 max 16384 2024-08-31T06:09:11.700 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f2107b01640 1 -- 172.21.15.53:0/1848439059 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20ec0b4d20 msgr2=0x7f20ec0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f2107b01640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20ec0b4d20 0x7f20ec0b7230 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x55f424f90f90 tx=0x7f20fc005f90 comp rx=0 tx=0).stop 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f2107b01640 1 -- 172.21.15.53:0/1848439059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2100105120 msgr2=0x7f2100102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f2107b01640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2100105120 0x7f2100102a50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f20f000e9f0 tx=0x7f20f000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f2107b01640 1 -- 172.21.15.53:0/1848439059 shutdown_connections 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f2107b01640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20ec0b4d20 0x7f20ec0b7230 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f2107b01640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f210010dc00 0x7f2100102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f2107b01640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2100105120 0x7f2100102a50 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f2107b01640 1 --2- 172.21.15.53:0/1848439059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21001047d0 0x7f2100102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.688+0000 7f2107b01640 1 -- 172.21.15.53:0/1848439059 >> 172.21.15.53:0/1848439059 conn(0x7f2100079530 msgr2=0x7f2100106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.689+0000 7f2107b01640 1 -- 172.21.15.53:0/1848439059 shutdown_connections 2024-08-31T06:09:11.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:11.689+0000 7f2107b01640 1 -- 172.21.15.53:0/1848439059 wait complete. 2024-08-31T06:09:11.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 69862 1.49 MB/sec execute 61 sec latency 20.723 ms 2024-08-31T06:09:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:11 smithi153 ceph-mon[22320]: pgmap v450: 97 pgs: 97 active+clean; 50 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-08-31T06:09:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:11 smithi053 ceph-mon[18924]: pgmap v450: 97 pgs: 97 active+clean; 50 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-08-31T06:09:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:11 smithi130 ceph-mon[22266]: pgmap v450: 97 pgs: 97 active+clean; 50 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-08-31T06:09:12.526 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:09:12.799 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:12.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 70619 1.57 MB/sec execute 62 sec latency 11.460 ms 2024-08-31T06:09:13.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:12 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:13.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.352+0000 7fefad5b8640 1 -- 172.21.15.53:0/2130100088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefa81069c0 msgr2=0x7fefa8110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:13.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.352+0000 7fefad5b8640 1 --2- 172.21.15.53:0/2130100088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefa81069c0 0x7fefa8110450 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009ca0 tx=0x7fefa002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.352+0000 7fefad5b8640 1 -- 172.21.15.53:0/2130100088 shutdown_connections 2024-08-31T06:09:13.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.352+0000 7fefad5b8640 1 --2- 172.21.15.53:0/2130100088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefa81069c0 0x7fefa8110450 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.352+0000 7fefad5b8640 1 --2- 172.21.15.53:0/2130100088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa8106070 0x7fefa8106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.352+0000 7fefad5b8640 1 --2- 172.21.15.53:0/2130100088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefa8101e20 0x7fefa8102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.352+0000 7fefad5b8640 1 -- 172.21.15.53:0/2130100088 >> 172.21.15.53:0/2130100088 conn(0x7fefa8079d30 msgr2=0x7fefa807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:13.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.353+0000 7fefad5b8640 1 -- 172.21.15.53:0/2130100088 shutdown_connections 2024-08-31T06:09:13.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.353+0000 7fefad5b8640 1 -- 172.21.15.53:0/2130100088 wait complete. 2024-08-31T06:09:13.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.353+0000 7fefad5b8640 1 Processor -- start 2024-08-31T06:09:13.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefad5b8640 1 -- start start 2024-08-31T06:09:13.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefad5b8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefa8101e20 0x7fefa819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefad5b8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa8106070 0x7fefa819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefad5b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefa81069c0 0x7fefa819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefad5b8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fefa8113740 con 0x7fefa81069c0 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefad5b8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fefa81135c0 con 0x7fefa8101e20 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefad5b8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fefa81138c0 con 0x7fefa8106070 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefa6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefa8101e20 0x7fefa819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefa77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefa81069c0 0x7fefa819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefa6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefa8101e20 0x7fefa819a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60732/0 (socket says 172.21.15.53:60732) 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefa6ffd640 1 -- 172.21.15.53:0/1695863517 learned_addr learned my addr 172.21.15.53:0/1695863517 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefa67fc640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa8106070 0x7fefa819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.354+0000 7fefa6ffd640 1 -- 172.21.15.53:0/1695863517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa8106070 msgr2=0x7fefa819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.355+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa8106070 0x7fefa819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.355+0000 7fefa6ffd640 1 -- 172.21.15.53:0/1695863517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefa81069c0 msgr2=0x7fefa819fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.355+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefa81069c0 0x7fefa819fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.355+0000 7fefa6ffd640 1 -- 172.21.15.53:0/1695863517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa81a01a0 con 0x7fefa8101e20 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.355+0000 7fefa77fe640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefa81069c0 0x7fefa819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.355+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefa8101e20 0x7fefa819a230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fef9800e9c0 tx=0x7fef9800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.355+0000 7fef8ffff640 1 -- 172.21.15.53:0/1695863517 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9800cd80 con 0x7fefa8101e20 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.355+0000 7fef8ffff640 1 -- 172.21.15.53:0/1695863517 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef980044b0 con 0x7fefa8101e20 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.355+0000 7fef8ffff640 1 -- 172.21.15.53:0/1695863517 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98010430 con 0x7fefa8101e20 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.355+0000 7fefad5b8640 1 -- 172.21.15.53:0/1695863517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa81a0490 con 0x7fefa8101e20 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.355+0000 7fefad5b8640 1 -- 172.21.15.53:0/1695863517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa81a6bf0 con 0x7fefa8101e20 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.358+0000 7fefb3b2d740 1 Processor -- start 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.358+0000 7fefb3b2d740 1 -- start start 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.358+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849a5070 0x55f884d4e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.358+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f88497c1b0 0x55f884d4eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.358+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d4f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.358+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f884cc1680 con 0x55f884984390 2024-08-31T06:09:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.358+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f884cb0c10 con 0x55f8849a5070 2024-08-31T06:09:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.358+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f884cb4bc0 con 0x55f88497c1b0 2024-08-31T06:09:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fefa77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849a5070 0x55f884d4e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fefa67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d4f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fefa77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849a5070 0x55f884d4e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60742/0 (socket says 172.21.15.53:60742) 2024-08-31T06:09:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fefa77fe640 1 -- 172.21.15.53:0/486523974 learned_addr learned my addr 172.21.15.53:0/486523974 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fefa67fc640 1 -- 172.21.15.53:0/486523974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f88497c1b0 msgr2=0x55f884d4eca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:09:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fefa67fc640 1 --2- 172.21.15.53:0/486523974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f88497c1b0 0x55f884d4eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fefa67fc640 1 -- 172.21.15.53:0/486523974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849a5070 msgr2=0x55f884d4e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fefa67fc640 1 --2- 172.21.15.53:0/486523974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849a5070 0x55f884d4e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fefa67fc640 1 -- 172.21.15.53:0/486523974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f884a10650 con 0x55f884984390 2024-08-31T06:09:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fefa77fe640 1 --2- 172.21.15.53:0/486523974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849a5070 0x55f884d4e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fefa67fc640 1 --2- 172.21.15.53:0/486523974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d4f1e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fefa806a260 tx=0x7fef9c0103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ccb580660f99be server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fef8ffff640 1 -- 172.21.15.53:0/1695863517 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fef98004020 con 0x7fefa8101e20 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fef8d7fa640 1 -- 172.21.15.53:0/486523974 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c010e90 con 0x55f884984390 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fef8d7fa640 1 -- 172.21.15.53:0/486523974 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef9c0044c0 con 0x55f884984390 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.359+0000 7fef8d7fa640 1 -- 172.21.15.53:0/486523974 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c0116a0 con 0x55f884984390 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.360+0000 7fef8ffff640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef900b4d20 0x7fef900b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.360+0000 7fefa77fe640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef900b4d20 0x7fef900b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.360+0000 7fef8ffff640 1 -- 172.21.15.53:0/1695863517 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fef980e58c0 con 0x7fefa8101e20 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.360+0000 7fefb3b2d740 1 -- 172.21.15.53:0/486523974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 msgr2=0x55f884d4f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.360+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/486523974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d4f1e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fefa806a260 tx=0x7fef9c0103d0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.361+0000 7fefb3b2d740 1 -- 172.21.15.53:0/486523974 shutdown_connections 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.361+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/486523974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d4f1e0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.361+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/486523974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f88497c1b0 0x55f884d4eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.361+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/486523974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849a5070 0x55f884d4e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.361+0000 7fefb3b2d740 1 -- 172.21.15.53:0/486523974 >> 172.21.15.53:0/486523974 conn(0x55f884999460 msgr2=0x55f884d4c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.361+0000 7fefb3b2d740 1 -- 172.21.15.53:0/486523974 shutdown_connections 2024-08-31T06:09:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.361+0000 7fefb3b2d740 1 -- 172.21.15.53:0/486523974 wait complete. 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.361+0000 7fefa77fe640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef900b4d20 0x7fef900b7230 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fefa0035000 tx=0x7fefa003d040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.361+0000 7fefb3b2d740 1 -- start start 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.361+0000 7fefb3b2d740 1 Processor -- start 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f88497c1b0 0x55f884d59ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f884984390 0x55f884d5a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849a5070 0x55f884d662c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f884b13700 con 0x55f88497c1b0 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f884c37750 con 0x55f884984390 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f884d5cf40 con 0x55f8849a5070 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefb3b2d740 10 client.0 _ll_register_callbacks cb 0x55f884c66e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefa6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f88497c1b0 0x55f884d59ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefa67fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f884984390 0x55f884d5a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefa67fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f884984390 0x55f884d5a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60752/0 (socket says 172.21.15.53:60752) 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefa67fc640 1 -- 172.21.15.53:0/1328577972 learned_addr learned my addr 172.21.15.53:0/1328577972 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefa77fe640 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849a5070 0x55f884d662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefa67fc640 1 -- 172.21.15.53:0/1328577972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849a5070 msgr2=0x55f884d662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefa67fc640 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849a5070 0x55f884d662c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefa67fc640 1 -- 172.21.15.53:0/1328577972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f88497c1b0 msgr2=0x55f884d59ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefa67fc640 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f88497c1b0 0x55f884d59ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefa67fc640 1 -- 172.21.15.53:0/1328577972 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f884c70900 con 0x55f884984390 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.362+0000 7fefa77fe640 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849a5070 0x55f884d662c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.363+0000 7fefa67fc640 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f884984390 0x55f884d5a410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fef9c003d50 tx=0x7fef9c010ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a3fcca2fc294f2a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.363+0000 7fef8aff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.363+0000 7fef8aff5640 1 -- 172.21.15.53:0/1328577972 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c02a060 con 0x55f884984390 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.363+0000 7fef8aff5640 1 -- 172.21.15.53:0/1328577972 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fef9c003df0 con 0x55f884984390 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.363+0000 7fefb3b2d740 1 -- 172.21.15.53:0/1328577972 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f884cc35d0 con 0x55f884984390 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.363+0000 7fef8aff5640 1 -- 172.21.15.53:0/1328577972 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fef9c003a80 con 0x55f884984390 2024-08-31T06:09:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.363+0000 7fefb3b2d740 10 client.26435 fetch_fsmap learned FSMap version 32 2024-08-31T06:09:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.363+0000 7fefb3b2d740 1 -- 172.21.15.53:0/1328577972 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f884d68d60 con 0x55f884984390 2024-08-31T06:09:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.363+0000 7fef8aff5640 1 -- 172.21.15.53:0/1328577972 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f884cc35d0 con 0x55f884984390 2024-08-31T06:09:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.364+0000 7fef8aff5640 1 -- 172.21.15.53:0/1328577972 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fef9c0047e0 con 0x55f884984390 2024-08-31T06:09:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.364+0000 7fefb3b2d740 10 client.26435 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T06:09:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.364+0000 7fefb3b2d740 10 client.26435 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:09:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.364+0000 7fefb3b2d740 20 client.26435 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.364+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f8849639f0 0x55f884d6c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.364+0000 7fefb3b2d740 4 client.26435 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.364+0000 7fefb3b2d740 1 -- 172.21.15.53:0/1328577972 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f884cbf070 con 0x55f8849639f0 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.364+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f8849639f0 0x55f884d6c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.364+0000 7fef8aff5640 10 client.26435 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.364+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f8849639f0 0x55f884d6c170 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89498dc852d2ac2d server_cookie=b9f551a849b5a025 in_seq=0 out_seq=0 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fef8aff5640 1 -- 172.21.15.53:0/1328577972 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f884cbf070 con 0x55f8849639f0 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fef8aff5640 10 client.26435 handle_command_reply: tid=0 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 1 client.26435 shutdown 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 1 -- 172.21.15.53:0/1328577972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f884984390 msgr2=0x55f884d5a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f884984390 0x55f884d5a410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fef9c003d50 tx=0x7fef9c010ec0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 1 -- 172.21.15.53:0/1328577972 shutdown_connections 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f8849639f0 0x55f884d6c170 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849a5070 0x55f884d662c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f884984390 0x55f884d5a410 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fef8aff5640 0 client.26435 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:09:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/1328577972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f88497c1b0 0x55f884d59ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 1 -- 172.21.15.53:0/1328577972 >> 172.21.15.53:0/1328577972 conn(0x55f884999460 msgr2=0x55f884d518f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 1 -- 172.21.15.53:0/1328577972 shutdown_connections 2024-08-31T06:09:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 1 -- 172.21.15.53:0/1328577972 wait complete. 2024-08-31T06:09:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.365+0000 7fefb3b2d740 20 client.26435 trim_cache size 0 max 16384 2024-08-31T06:09:13.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:12 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefb3b2d740 1 Processor -- start 2024-08-31T06:09:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefb3b2d740 1 -- start start 2024-08-31T06:09:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849639f0 0x55f884d5a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f88497c1b0 0x55f884d66230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fefa81ad310 con 0x55f884984390 2024-08-31T06:09:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fefa81aef70 con 0x55f88497c1b0 2024-08-31T06:09:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fefa81ad9e0 con 0x55f8849639f0 2024-08-31T06:09:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefa77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefa67fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f88497c1b0 0x55f884d66230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefa77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35630/0 (socket says 172.21.15.53:35630) 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefa67fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f88497c1b0 0x55f884d66230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60754/0 (socket says 172.21.15.53:60754) 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefa77fe640 1 -- 172.21.15.53:0/82099618 learned_addr learned my addr 172.21.15.53:0/82099618 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.380+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/82099618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849639f0 0x55f884d5a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.381+0000 7fefa6ffd640 1 -- 172.21.15.53:0/82099618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f88497c1b0 msgr2=0x55f884d66230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.381+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/82099618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f88497c1b0 0x55f884d66230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.381+0000 7fefa6ffd640 1 -- 172.21.15.53:0/82099618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 msgr2=0x55f884d570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.381+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/82099618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.381+0000 7fefa6ffd640 1 -- 172.21.15.53:0/82099618 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f884d5b190 con 0x55f8849639f0 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.381+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/82099618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849639f0 0x55f884d5a390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fef980e3010 tx=0x7fef9800efd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de336af68a9cc4d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.381+0000 7fef8cff9640 1 -- 172.21.15.53:0/82099618 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef980abac0 con 0x55f8849639f0 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.381+0000 7fef8cff9640 1 -- 172.21.15.53:0/82099618 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef980ac6b0 con 0x55f8849639f0 2024-08-31T06:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.381+0000 7fef8cff9640 1 -- 172.21.15.53:0/82099618 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef980e3290 con 0x55f8849639f0 2024-08-31T06:09:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.382+0000 7fefb3b2d740 1 -- 172.21.15.53:0/82099618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849639f0 msgr2=0x55f884d5a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.382+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/82099618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849639f0 0x55f884d5a390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fef980e3010 tx=0x7fef9800efd0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.382+0000 7fefb3b2d740 1 -- 172.21.15.53:0/82099618 shutdown_connections 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.382+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/82099618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.382+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/82099618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f88497c1b0 0x55f884d66230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.382+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/82099618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8849639f0 0x55f884d5a390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.382+0000 7fefb3b2d740 1 -- 172.21.15.53:0/82099618 >> 172.21.15.53:0/82099618 conn(0x55f884999460 msgr2=0x55f884d59c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.382+0000 7fefb3b2d740 1 -- 172.21.15.53:0/82099618 shutdown_connections 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.382+0000 7fefb3b2d740 1 -- 172.21.15.53:0/82099618 wait complete. 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefb3b2d740 1 -- start start 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefb3b2d740 1 Processor -- start 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849639f0 0x55f884d6d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f88497c1b0 0x55f884d6d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefb3b2d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d6dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fefa81ae7e0 con 0x55f884984390 2024-08-31T06:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fefa81ae0b0 con 0x55f8849639f0 2024-08-31T06:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefb3b2d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fefa81ab2f0 con 0x55f88497c1b0 2024-08-31T06:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefb3b2d740 10 client.0 _ll_register_callbacks cb 0x7fefa0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefa77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d6dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefa77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d6dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35632/0 (socket says 172.21.15.53:35632) 2024-08-31T06:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefa77fe640 1 -- 172.21.15.53:0/3291990519 learned_addr learned my addr 172.21.15.53:0/3291990519 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849639f0 0x55f884d6d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.383+0000 7fefa67fc640 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f88497c1b0 0x55f884d6d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fefa77fe640 1 -- 172.21.15.53:0/3291990519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f88497c1b0 msgr2=0x55f884d6d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fefa77fe640 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f88497c1b0 0x55f884d6d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fefa77fe640 1 -- 172.21.15.53:0/3291990519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849639f0 msgr2=0x55f884d6d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fefa77fe640 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849639f0 0x55f884d6d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fefa77fe640 1 -- 172.21.15.53:0/3291990519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f884dd5970 con 0x55f884984390 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849639f0 0x55f884d6d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fefa67fc640 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f88497c1b0 0x55f884d6d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fefa77fe640 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d6dca0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fefa0006010 tx=0x7fefa002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83487db48b4a05e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fef8aff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fef8aff5640 1 -- 172.21.15.53:0/3291990519 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0058060 con 0x55f884984390 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fef8aff5640 1 -- 172.21.15.53:0/3291990519 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fefa0046db0 con 0x55f884984390 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fefb3b2d740 1 -- 172.21.15.53:0/3291990519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef980ac6b0 con 0x55f884984390 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fef8aff5640 1 -- 172.21.15.53:0/3291990519 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fefa0053440 con 0x55f884984390 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.384+0000 7fefb3b2d740 10 client.17085 fetch_fsmap learned FSMap version 32 2024-08-31T06:09:13.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.385+0000 7fefb3b2d740 1 -- 172.21.15.53:0/3291990519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f884dd6bf0 con 0x55f884984390 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.385+0000 7fef8aff5640 1 -- 172.21.15.53:0/3291990519 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef980ac6b0 con 0x55f884984390 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.385+0000 7fef8aff5640 1 -- 172.21.15.53:0/3291990519 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fefa003b7a0 con 0x55f884984390 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.385+0000 7fefb3b2d740 10 client.17085 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.385+0000 7fefb3b2d740 10 client.17085 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.385+0000 7fefb3b2d740 20 client.17085 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.385+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f8849a5070 0x55f884dd9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.385+0000 7fefb3b2d740 4 client.17085 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.385+0000 7fefb3b2d740 1 -- 172.21.15.53:0/3291990519 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f884cbc7b0 con 0x55f8849a5070 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.385+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f8849a5070 0x55f884dd9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefa6ffd640 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f8849a5070 0x55f884dd9390 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=380b273ee84f51ff server_cookie=12a476520c167e7a in_seq=0 out_seq=0 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fef8aff5640 10 client.17085 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fef8aff5640 1 -- 172.21.15.53:0/3291990519 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f884cbc7b0 con 0x55f8849a5070 2024-08-31T06:09:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fef8aff5640 10 client.17085 handle_command_reply: tid=0 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 1 client.17085 shutdown 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 1 -- 172.21.15.53:0/3291990519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 msgr2=0x55f884d6dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d6dca0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fefa0006010 tx=0x7fefa002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 1 -- 172.21.15.53:0/3291990519 shutdown_connections 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f8849a5070 0x55f884dd9390 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f884984390 0x55f884d6dca0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f88497c1b0 0x55f884d6d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 1 --2- 172.21.15.53:0/3291990519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8849639f0 0x55f884d6d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 1 -- 172.21.15.53:0/3291990519 >> 172.21.15.53:0/3291990519 conn(0x55f884999460 msgr2=0x55f884d4f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fef8aff5640 0 client.17085 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 1 -- 172.21.15.53:0/3291990519 shutdown_connections 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 1 -- 172.21.15.53:0/3291990519 wait complete. 2024-08-31T06:09:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.386+0000 7fefb3b2d740 20 client.17085 trim_cache size 0 max 16384 2024-08-31T06:09:13.394 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:09:13.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 -- 172.21.15.53:0/1695863517 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef900b4d20 msgr2=0x7fef900b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:13.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef900b4d20 0x7fef900b7230 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fefa0035000 tx=0x7fefa003d040 comp rx=0 tx=0).stop 2024-08-31T06:09:13.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 -- 172.21.15.53:0/1695863517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefa8101e20 msgr2=0x7fefa819a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:13.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefa8101e20 0x7fefa819a230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fef9800e9c0 tx=0x7fef9800ee80 comp rx=0 tx=0).stop 2024-08-31T06:09:13.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 -- 172.21.15.53:0/1695863517 shutdown_connections 2024-08-31T06:09:13.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef900b4d20 0x7fef900b7230 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefa81069c0 0x7fefa819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefa8106070 0x7fefa819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 --2- 172.21.15.53:0/1695863517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fefa8101e20 0x7fefa819a230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:13.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 -- 172.21.15.53:0/1695863517 >> 172.21.15.53:0/1695863517 conn(0x7fefa8079d30 msgr2=0x7fefa81073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:13.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 -- 172.21.15.53:0/1695863517 shutdown_connections 2024-08-31T06:09:13.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:13.387+0000 7fefad5b8640 1 -- 172.21.15.53:0/1695863517 wait complete. 2024-08-31T06:09:13.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:12 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:13.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 70987 1.61 MB/sec execute 63 sec latency 67.038 ms 2024-08-31T06:09:14.194 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:13 smithi053 ceph-mon[18924]: pgmap v451: 97 pgs: 97 active+clean; 50 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-08-31T06:09:14.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:09:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:13 smithi130 ceph-mon[22266]: pgmap v451: 97 pgs: 97 active+clean; 50 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-08-31T06:09:14.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:13 smithi153 ceph-mon[22320]: pgmap v451: 97 pgs: 97 active+clean; 50 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-08-31T06:09:14.468 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:14.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 71339 1.61 MB/sec execute 64 sec latency 13.375 ms 2024-08-31T06:09:14.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.969+0000 7f754968c640 1 -- 172.21.15.53:0/2712367932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7544102880 msgr2=0x7f7544102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:14.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.969+0000 7f754968c640 1 --2- 172.21.15.53:0/2712367932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7544102880 0x7f7544102c90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7534009900 tx=0x7f753402a410 comp rx=0 tx=0).stop 2024-08-31T06:09:14.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.969+0000 7f754968c640 1 -- 172.21.15.53:0/2712367932 shutdown_connections 2024-08-31T06:09:14.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.969+0000 7f754968c640 1 --2- 172.21.15.53:0/2712367932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7544108ac0 0x7f754410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.969+0000 7f754968c640 1 --2- 172.21.15.53:0/2712367932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7544108170 0x7f7544108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.969+0000 7f754968c640 1 --2- 172.21.15.53:0/2712367932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7544102880 0x7f7544102c90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.969+0000 7f754968c640 1 -- 172.21.15.53:0/2712367932 >> 172.21.15.53:0/2712367932 conn(0x7f7544079530 msgr2=0x7f7544079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:14.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.969+0000 7f754968c640 1 -- 172.21.15.53:0/2712367932 shutdown_connections 2024-08-31T06:09:14.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.969+0000 7f754968c640 1 -- 172.21.15.53:0/2712367932 wait complete. 2024-08-31T06:09:14.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.969+0000 7f754968c640 1 Processor -- start 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f754968c640 1 -- start start 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f754968c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7544102880 0x7f754419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f754968c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7544108170 0x7f754419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f754968c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7544108ac0 0x7f754419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f754968c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7544112640 con 0x7f7544108ac0 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f754968c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75441124c0 con 0x7f7544108170 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f754968c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f75441127c0 con 0x7f7544102880 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f7542ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7544102880 0x7f754419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f75437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7544108ac0 0x7f754419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f7542ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7544102880 0x7f754419a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37436/0 (socket says 172.21.15.53:37436) 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f7542ffd640 1 -- 172.21.15.53:0/3514795177 learned_addr learned my addr 172.21.15.53:0/3514795177 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:14.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f75427fc640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7544108170 0x7f754419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f7542ffd640 1 -- 172.21.15.53:0/3514795177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7544108170 msgr2=0x7f754419a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f7542ffd640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7544108170 0x7f754419a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f7542ffd640 1 -- 172.21.15.53:0/3514795177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7544108ac0 msgr2=0x7f754419fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f7542ffd640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7544108ac0 0x7f754419fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.970+0000 7f7542ffd640 1 -- 172.21.15.53:0/3514795177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75441a01b0 con 0x7f7544102880 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.971+0000 7f75427fc640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7544108170 0x7f754419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.971+0000 7f7542ffd640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7544102880 0x7f754419a240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7534009230 tx=0x7f75340319a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.971+0000 7f752bfff640 1 -- 172.21.15.53:0/3514795177 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753403f030 con 0x7f7544102880 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.971+0000 7f752bfff640 1 -- 172.21.15.53:0/3514795177 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75340043d0 con 0x7f7544102880 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.971+0000 7f754968c640 1 -- 172.21.15.53:0/3514795177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75441a0440 con 0x7f7544102880 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.971+0000 7f752bfff640 1 -- 172.21.15.53:0/3514795177 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534035070 con 0x7f7544102880 2024-08-31T06:09:14.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.971+0000 7f754968c640 1 -- 172.21.15.53:0/3514795177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75440ff2f0 con 0x7f7544102880 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.973+0000 7f754fc01740 1 Processor -- start 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f752bfff640 1 -- 172.21.15.53:0/3514795177 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7534042030 con 0x7f7544102880 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f754fc01740 1 -- start start 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f754fc01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161262c070 0x5616129d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f754fc01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f754fc01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161260b390 0x5616129d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f754fc01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561612948680 con 0x56161260b390 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f754fc01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561612937c10 con 0x5616126031b0 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f754fc01740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56161293bbc0 con 0x56161262c070 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f75437fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161262c070 0x5616129d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f7542ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f75427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161260b390 0x5616129d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:14.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f75437fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161262c070 0x5616129d1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37440/0 (socket says 172.21.15.53:37440) 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f75437fe640 1 -- 172.21.15.53:0/671102268 learned_addr learned my addr 172.21.15.53:0/671102268 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f75437fe640 1 -- 172.21.15.53:0/671102268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 msgr2=0x5616129d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f75437fe640 1 --2- 172.21.15.53:0/671102268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f75437fe640 1 -- 172.21.15.53:0/671102268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161260b390 msgr2=0x5616129d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f75437fe640 1 --2- 172.21.15.53:0/671102268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161260b390 0x5616129d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f75437fe640 1 -- 172.21.15.53:0/671102268 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561612697650 con 0x56161262c070 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.974+0000 7f752bfff640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f752c0b90b0 0x7f752c0bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.975+0000 7f7542ffd640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f752c0b90b0 0x7f752c0bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.975+0000 7f75437fe640 1 --2- 172.21.15.53:0/671102268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161262c070 0x5616129d1310 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f753c009f50 tx=0x7f753c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1597a18e5580f67e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.975+0000 7f752bfff640 1 -- 172.21.15.53:0/3514795177 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7534105930 con 0x7f7544102880 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.975+0000 7f75297fa640 1 -- 172.21.15.53:0/671102268 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c004d20 con 0x56161262c070 2024-08-31T06:09:14.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.975+0000 7f75297fa640 1 -- 172.21.15.53:0/671102268 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f753c004050 con 0x56161262c070 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.975+0000 7f75297fa640 1 -- 172.21.15.53:0/671102268 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c005260 con 0x56161262c070 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.976+0000 7f7542ffd640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f752c0b90b0 0x7f752c0bb5c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7534103130 tx=0x7f75340b3040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.976+0000 7f754fc01740 1 -- 172.21.15.53:0/671102268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161262c070 msgr2=0x5616129d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.976+0000 7f754fc01740 1 --2- 172.21.15.53:0/671102268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161262c070 0x5616129d1310 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f753c009f50 tx=0x7f753c0118d0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.976+0000 7f754fc01740 1 -- 172.21.15.53:0/671102268 shutdown_connections 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.976+0000 7f754fc01740 1 --2- 172.21.15.53:0/671102268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161260b390 0x5616129d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.976+0000 7f754fc01740 1 --2- 172.21.15.53:0/671102268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.976+0000 7f754fc01740 1 --2- 172.21.15.53:0/671102268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161262c070 0x5616129d1310 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.976+0000 7f754fc01740 1 -- 172.21.15.53:0/671102268 >> 172.21.15.53:0/671102268 conn(0x561612620460 msgr2=0x5616129cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.976+0000 7f754fc01740 1 -- 172.21.15.53:0/671102268 shutdown_connections 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.976+0000 7f754fc01740 1 -- 172.21.15.53:0/671102268 wait complete. 2024-08-31T06:09:14.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.976+0000 7f754fc01740 1 -- start start 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f754fc01740 1 Processor -- start 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f754fc01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129dcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f754fc01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 0x5616129dd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f754fc01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161262c070 0x5616129e8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f754fc01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56161279a700 con 0x56161262c070 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f754fc01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5616128be750 con 0x5616126031b0 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f754fc01740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5616129dfaf0 con 0x56161260b390 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f754fc01740 10 client.0 _ll_register_callbacks cb 0x5616128ede10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f75427fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 0x5616129dd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f75437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161262c070 0x5616129e8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f75427fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 0x5616129dd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37454/0 (socket says 172.21.15.53:37454) 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f75427fc640 1 -- 172.21.15.53:0/1417190874 learned_addr learned my addr 172.21.15.53:0/1417190874 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:14.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.977+0000 7f75437fe640 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129dcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:14.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f75427fc640 1 -- 172.21.15.53:0/1417190874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 msgr2=0x5616129dcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:14.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f75427fc640 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129dcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f75427fc640 1 -- 172.21.15.53:0/1417190874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161262c070 msgr2=0x5616129e8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:14.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f75427fc640 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161262c070 0x5616129e8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f75427fc640 1 -- 172.21.15.53:0/1417190874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616128f7900 con 0x56161260b390 2024-08-31T06:09:14.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f75437fe640 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161262c070 0x5616129e8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:14.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f75427fc640 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 0x5616129dd050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f753801ceb0 tx=0x7f7538012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=470ba31e7dd711ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:14.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f7526ff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:09:14.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f7526ff5640 1 -- 172.21.15.53:0/1417190874 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538004310 con 0x56161260b390 2024-08-31T06:09:14.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f754fc01740 1 -- 172.21.15.53:0/1417190874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f753c004050 con 0x56161260b390 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f7526ff5640 1 -- 172.21.15.53:0/1417190874 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f75380047a0 con 0x56161260b390 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f7526ff5640 1 -- 172.21.15.53:0/1417190874 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f75380044b0 con 0x56161260b390 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f754fc01740 10 client.26455 fetch_fsmap learned FSMap version 32 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.978+0000 7f754fc01740 1 -- 172.21.15.53:0/1417190874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5616129eb9e0 con 0x56161260b390 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.979+0000 7f7526ff5640 1 -- 172.21.15.53:0/1417190874 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f753c004050 con 0x56161260b390 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.979+0000 7f7526ff5640 1 -- 172.21.15.53:0/1417190874 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f7538023070 con 0x56161260b390 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.979+0000 7f754fc01740 10 client.26455 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.979+0000 7f754fc01740 10 client.26455 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.979+0000 7f754fc01740 20 client.26455 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.979+0000 7f754fc01740 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5616125ea9f0 0x5616129eef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.979+0000 7f754fc01740 4 client.26455 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:14.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.979+0000 7f754fc01740 1 -- 172.21.15.53:0/1417190874 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56161294a5d0 con 0x5616125ea9f0 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.979+0000 7f75437fe640 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5616125ea9f0 0x5616129eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.979+0000 7f7526ff5640 10 client.26455 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f75437fe640 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5616125ea9f0 0x5616129eef10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b0c06fc990d72f3d server_cookie=fafa479a1f0095bd in_seq=0 out_seq=0 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f7526ff5640 1 -- 172.21.15.53:0/1417190874 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56161294a5d0 con 0x5616125ea9f0 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f7526ff5640 10 client.26455 handle_command_reply: tid=0 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f754fc01740 1 client.26455 shutdown 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f754fc01740 1 -- 172.21.15.53:0/1417190874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 msgr2=0x5616129dd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f754fc01740 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 0x5616129dd050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f753801ceb0 tx=0x7f7538012820 comp rx=0 tx=0).stop 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f754fc01740 1 -- 172.21.15.53:0/1417190874 shutdown_connections 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f754fc01740 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5616125ea9f0 0x5616129eef10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f7526ff5640 0 client.26455 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:09:14.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f754fc01740 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161262c070 0x5616129e8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f754fc01740 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 0x5616129dd050 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f754fc01740 1 --2- 172.21.15.53:0/1417190874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129dcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:14.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.980+0000 7f754fc01740 1 -- 172.21.15.53:0/1417190874 >> 172.21.15.53:0/1417190874 conn(0x561612620460 msgr2=0x5616129d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:14.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.981+0000 7f754fc01740 1 -- 172.21.15.53:0/1417190874 shutdown_connections 2024-08-31T06:09:14.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.981+0000 7f754fc01740 1 -- 172.21.15.53:0/1417190874 wait complete. 2024-08-31T06:09:14.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.981+0000 7f754fc01740 20 client.26455 trim_cache size 0 max 16384 2024-08-31T06:09:15.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f754fc01740 1 Processor -- start 2024-08-31T06:09:15.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f754fc01740 1 -- start start 2024-08-31T06:09:15.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f754fc01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5616125ea9f0 0x5616129dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:15.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f754fc01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129e8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:15.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f754fc01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161260b390 0x5616129e9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:15.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f754fc01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f75441ad2e0 con 0x56161260b390 2024-08-31T06:09:15.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f754fc01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75441aef40 con 0x5616126031b0 2024-08-31T06:09:15.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f754fc01740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f75441ad9b0 con 0x5616125ea9f0 2024-08-31T06:09:15.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f75437fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5616125ea9f0 0x5616129dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:15.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f75427fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129e8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:15.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f75437fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5616125ea9f0 0x5616129dcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37470/0 (socket says 172.21.15.53:37470) 2024-08-31T06:09:15.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.997+0000 7f75437fe640 1 -- 172.21.15.53:0/3112605955 learned_addr learned my addr 172.21.15.53:0/3112605955 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:15.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.998+0000 7f75437fe640 1 --2- 172.21.15.53:0/3112605955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161260b390 0x5616129e9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:15.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.998+0000 7f75437fe640 1 -- 172.21.15.53:0/3112605955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 msgr2=0x5616129e8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:15.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.998+0000 7f75437fe640 1 --2- 172.21.15.53:0/3112605955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129e8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.998+0000 7f75437fe640 1 -- 172.21.15.53:0/3112605955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161260b390 msgr2=0x5616129e9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:15.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.998+0000 7f75437fe640 1 --2- 172.21.15.53:0/3112605955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161260b390 0x5616129e9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.998+0000 7f75437fe640 1 -- 172.21.15.53:0/3112605955 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616129d3600 con 0x5616125ea9f0 2024-08-31T06:09:15.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.998+0000 7f75437fe640 1 --2- 172.21.15.53:0/3112605955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5616125ea9f0 0x5616129dcfb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f753c006010 tx=0x7f753c004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f510e71afd296c51 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:15.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.998+0000 7f7528ff9640 1 -- 172.21.15.53:0/3112605955 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c037070 con 0x5616125ea9f0 2024-08-31T06:09:15.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.998+0000 7f7528ff9640 1 -- 172.21.15.53:0/3112605955 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f753c004050 con 0x5616125ea9f0 2024-08-31T06:09:15.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.998+0000 7f7528ff9640 1 -- 172.21.15.53:0/3112605955 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c0289a0 con 0x5616125ea9f0 2024-08-31T06:09:15.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.999+0000 7f754fc01740 1 -- 172.21.15.53:0/3112605955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5616125ea9f0 msgr2=0x5616129dcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:15.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.999+0000 7f754fc01740 1 --2- 172.21.15.53:0/3112605955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5616125ea9f0 0x5616129dcfb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f753c006010 tx=0x7f753c004950 comp rx=0 tx=0).stop 2024-08-31T06:09:15.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.999+0000 7f754fc01740 1 -- 172.21.15.53:0/3112605955 shutdown_connections 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.999+0000 7f754fc01740 1 --2- 172.21.15.53:0/3112605955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56161260b390 0x5616129e9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.999+0000 7f754fc01740 1 --2- 172.21.15.53:0/3112605955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616126031b0 0x5616129e8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.999+0000 7f754fc01740 1 --2- 172.21.15.53:0/3112605955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5616125ea9f0 0x5616129dcfb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.999+0000 7f754fc01740 1 -- 172.21.15.53:0/3112605955 >> 172.21.15.53:0/3112605955 conn(0x561612620460 msgr2=0x5616129dc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.999+0000 7f754fc01740 1 -- 172.21.15.53:0/3112605955 shutdown_connections 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.999+0000 7f754fc01740 1 -- 172.21.15.53:0/3112605955 wait complete. 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:14.999+0000 7f754fc01740 1 -- start start 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f754fc01740 1 Processor -- start 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f754fc01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616125ea9f0 0x5616129e5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f754fc01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616126031b0 0x5616129e0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f754fc01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 0x5616129e0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f754fc01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f75441ae7b0 con 0x5616126031b0 2024-08-31T06:09:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f75437fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616125ea9f0 0x5616129e5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f75437fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616125ea9f0 0x5616129e5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60808/0 (socket says 172.21.15.53:60808) 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f75427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616126031b0 0x5616129e0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f75437fe640 1 -- 172.21.15.53:0/439626074 learned_addr learned my addr 172.21.15.53:0/439626074 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f754fc01740 1 -- 172.21.15.53:0/439626074 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75441ae080 con 0x5616125ea9f0 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f754fc01740 1 -- 172.21.15.53:0/439626074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f75441ab2c0 con 0x56161260b390 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.000+0000 7f754fc01740 10 client.0 _ll_register_callbacks cb 0x7f7538009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f75437fe640 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 0x5616129e0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f75427fc640 1 -- 172.21.15.53:0/439626074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 msgr2=0x5616129e0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f75427fc640 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 0x5616129e0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f75427fc640 1 -- 172.21.15.53:0/439626074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616125ea9f0 msgr2=0x5616129e5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f75427fc640 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616125ea9f0 0x5616129e5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f75427fc640 1 -- 172.21.15.53:0/439626074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616129e1530 con 0x5616126031b0 2024-08-31T06:09:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f75437fe640 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 0x5616129e0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f75427fc640 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616126031b0 0x5616129e0900 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7538000c00 tx=0x7f75380039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04e26697442dfa0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f7526ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f7526ff5640 1 -- 172.21.15.53:0/439626074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538039060 con 0x5616126031b0 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f7526ff5640 1 -- 172.21.15.53:0/439626074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7538003dd0 con 0x5616126031b0 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.001+0000 7f754fc01740 1 -- 172.21.15.53:0/439626074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f753c004050 con 0x5616126031b0 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f7526ff5640 1 -- 172.21.15.53:0/439626074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7538030040 con 0x5616126031b0 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f754fc01740 10 client.17100 fetch_fsmap learned FSMap version 32 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f754fc01740 1 -- 172.21.15.53:0/439626074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561612a59750 con 0x5616126031b0 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f7526ff5640 1 -- 172.21.15.53:0/439626074 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f753c004050 con 0x5616126031b0 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f7526ff5640 1 -- 172.21.15.53:0/439626074 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f7538033030 con 0x5616126031b0 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f754fc01740 10 client.17100 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f754fc01740 10 client.17100 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f754fc01740 20 client.17100 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f754fc01740 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56161262c070 0x561612a5bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f754fc01740 4 client.17100 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f754fc01740 1 -- 172.21.15.53:0/439626074 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561612946070 con 0x56161262c070 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.002+0000 7f75437fe640 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56161262c070 0x561612a5bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f7526ff5640 10 client.17100 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f75437fe640 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56161262c070 0x561612a5bff0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c8721097cf79b063 server_cookie=48d5d034f75a9fa1 in_seq=0 out_seq=0 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f7526ff5640 1 -- 172.21.15.53:0/439626074 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561612946070 con 0x56161262c070 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f7526ff5640 10 client.17100 handle_command_reply: tid=0 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f754fc01740 1 client.17100 shutdown 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f754fc01740 1 -- 172.21.15.53:0/439626074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616126031b0 msgr2=0x5616129e0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f754fc01740 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616126031b0 0x5616129e0900 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7538000c00 tx=0x7f75380039e0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f754fc01740 1 -- 172.21.15.53:0/439626074 shutdown_connections 2024-08-31T06:09:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f754fc01740 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56161262c070 0x561612a5bff0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f754fc01740 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56161260b390 0x5616129e0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f7526ff5640 0 client.17100 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:09:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f754fc01740 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616126031b0 0x5616129e0900 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.003+0000 7f754fc01740 1 --2- 172.21.15.53:0/439626074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5616125ea9f0 0x5616129e5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754fc01740 1 -- 172.21.15.53:0/439626074 >> 172.21.15.53:0/439626074 conn(0x561612620460 msgr2=0x5616129d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754fc01740 1 -- 172.21.15.53:0/439626074 shutdown_connections 2024-08-31T06:09:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754fc01740 1 -- 172.21.15.53:0/439626074 wait complete. 2024-08-31T06:09:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754fc01740 20 client.17100 trim_cache size 0 max 16384 2024-08-31T06:09:15.012 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:09:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754968c640 1 -- 172.21.15.53:0/3514795177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f752c0b90b0 msgr2=0x7f752c0bb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754968c640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f752c0b90b0 0x7f752c0bb5c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7534103130 tx=0x7f75340b3040 comp rx=0 tx=0).stop 2024-08-31T06:09:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754968c640 1 -- 172.21.15.53:0/3514795177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7544102880 msgr2=0x7f754419a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754968c640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7544102880 0x7f754419a240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7534009230 tx=0x7f75340319a0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754968c640 1 -- 172.21.15.53:0/3514795177 shutdown_connections 2024-08-31T06:09:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754968c640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f752c0b90b0 0x7f752c0bb5c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754968c640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7544108ac0 0x7f754419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754968c640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7544108170 0x7f754419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754968c640 1 --2- 172.21.15.53:0/3514795177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7544102880 0x7f754419a240 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.004+0000 7f754968c640 1 -- 172.21.15.53:0/3514795177 >> 172.21.15.53:0/3514795177 conn(0x7f7544079530 msgr2=0x7f75441019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.005+0000 7f754968c640 1 -- 172.21.15.53:0/3514795177 shutdown_connections 2024-08-31T06:09:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:15.005+0000 7f754968c640 1 -- 172.21.15.53:0/3514795177 wait complete. 2024-08-31T06:09:15.813 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:09:15.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 71624 1.58 MB/sec execute 65 sec latency 15.622 ms 2024-08-31T06:09:16.083 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:16.204 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:15 smithi053 ceph-mon[18924]: pgmap v452: 97 pgs: 97 active+clean; 51 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-08-31T06:09:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:15 smithi130 ceph-mon[22266]: pgmap v452: 97 pgs: 97 active+clean; 51 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-08-31T06:09:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:15 smithi153 ceph-mon[22320]: pgmap v452: 97 pgs: 97 active+clean; 51 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.583+0000 7f7ea6776640 1 -- 172.21.15.53:0/2693930392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0108140 msgr2=0x7f7ea0108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.583+0000 7f7ea6776640 1 --2- 172.21.15.53:0/2693930392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0108140 0x7f7ea0108550 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009900 tx=0x7f7e8802a410 comp rx=0 tx=0).stop 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.583+0000 7f7ea6776640 1 -- 172.21.15.53:0/2693930392 shutdown_connections 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.583+0000 7f7ea6776640 1 --2- 172.21.15.53:0/2693930392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0108a90 0x7f7ea010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.583+0000 7f7ea6776640 1 --2- 172.21.15.53:0/2693930392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0108140 0x7f7ea0108550 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.583+0000 7f7ea6776640 1 --2- 172.21.15.53:0/2693930392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0102800 0x7f7ea0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.583+0000 7f7ea6776640 1 -- 172.21.15.53:0/2693930392 >> 172.21.15.53:0/2693930392 conn(0x7f7ea00794d0 msgr2=0x7f7ea00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.583+0000 7f7ea6776640 1 -- 172.21.15.53:0/2693930392 shutdown_connections 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.583+0000 7f7ea6776640 1 -- 172.21.15.53:0/2693930392 wait complete. 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7ea6776640 1 Processor -- start 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7ea6776640 1 -- start start 2024-08-31T06:09:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7ea6776640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0102800 0x7f7ea019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7ea6776640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0108140 0x7f7ea019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7ea6776640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0108a90 0x7f7ea019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7ea6776640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea0112590 con 0x7f7ea0108140 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7ea6776640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea0112410 con 0x7f7ea0102800 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7ea6776640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea0112710 con 0x7f7ea0108a90 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7e97fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0108140 0x7f7ea019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7e97fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0108140 0x7f7ea019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35712/0 (socket says 172.21.15.53:35712) 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7e97fff640 1 -- 172.21.15.53:0/2806635547 learned_addr learned my addr 172.21.15.53:0/2806635547 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7e9ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0102800 0x7f7ea019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7ea4d13640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0108a90 0x7f7ea019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7e97fff640 1 -- 172.21.15.53:0/2806635547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0108a90 msgr2=0x7f7ea019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7e97fff640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0108a90 0x7f7ea019f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7e97fff640 1 -- 172.21.15.53:0/2806635547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0102800 msgr2=0x7f7ea019a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7e97fff640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0102800 0x7f7ea019a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7e97fff640 1 -- 172.21.15.53:0/2806635547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea01a00e0 con 0x7f7ea0108140 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0102800 0x7f7ea019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.584+0000 7f7ea4d13640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0108a90 0x7f7ea019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.585+0000 7f7e97fff640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0108140 0x7f7ea019a710 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f7e88005940 tx=0x7f7e88005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.585+0000 7f7e9dffb640 1 -- 172.21.15.53:0/2806635547 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8803f030 con 0x7f7ea0108140 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.585+0000 7f7e9dffb640 1 -- 172.21.15.53:0/2806635547 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e880043d0 con 0x7f7ea0108140 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.585+0000 7f7ea6776640 1 -- 172.21.15.53:0/2806635547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea01a0370 con 0x7f7ea0108140 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.585+0000 7f7e9dffb640 1 -- 172.21.15.53:0/2806635547 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88035070 con 0x7f7ea0108140 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.585+0000 7f7ea6776640 1 -- 172.21.15.53:0/2806635547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea0104d60 con 0x7f7ea0108140 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.588+0000 7f7eacceb740 1 Processor -- start 2024-08-31T06:09:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.588+0000 7f7eacceb740 1 -- start start 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d39b070 0x55f03d740350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d3721b0 0x55f03d740890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d37a390 0x55f03d740dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7eacceb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f03d6b7680 con 0x55f03d37a390 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7eacceb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f03d6a6c10 con 0x55f03d3721b0 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7eacceb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f03d6aabc0 con 0x55f03d39b070 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7e9dffb640 1 -- 172.21.15.53:0/2806635547 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7e88042030 con 0x7f7ea0108140 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7ea4d13640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d39b070 0x55f03d740350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7ea4d13640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d39b070 0x55f03d740350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37508/0 (socket says 172.21.15.53:37508) 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7ea4d13640 1 -- 172.21.15.53:0/2175214320 learned_addr learned my addr 172.21.15.53:0/2175214320 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7e97fff640 1 --2- 172.21.15.53:0/2175214320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d37a390 0x55f03d740dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/2175214320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d3721b0 0x55f03d740890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7ea4d13640 1 -- 172.21.15.53:0/2175214320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d3721b0 msgr2=0x55f03d740890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7ea4d13640 1 --2- 172.21.15.53:0/2175214320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d3721b0 0x55f03d740890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7ea4d13640 1 -- 172.21.15.53:0/2175214320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d37a390 msgr2=0x55f03d740dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7ea4d13640 1 --2- 172.21.15.53:0/2175214320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d37a390 0x55f03d740dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.589+0000 7f7ea4d13640 1 -- 172.21.15.53:0/2175214320 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f03d406650 con 0x55f03d39b070 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.590+0000 7f7ea4d13640 1 --2- 172.21.15.53:0/2175214320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d39b070 0x55f03d740350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e980117e0 tx=0x7f7e98011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dce3d741f1067225 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.590+0000 7f7e967fc640 1 -- 172.21.15.53:0/2175214320 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98011310 con 0x55f03d39b070 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.590+0000 7f7e967fc640 1 -- 172.21.15.53:0/2175214320 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e98003e00 con 0x55f03d39b070 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.590+0000 7f7e967fc640 1 -- 172.21.15.53:0/2175214320 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98004430 con 0x55f03d39b070 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.590+0000 7f7e9dffb640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e8c0b90b0 0x7f7e8c0bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.590+0000 7f7e9dffb640 1 -- 172.21.15.53:0/2806635547 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7e88105820 con 0x7f7ea0108140 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.590+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e8c0b90b0 0x7f7e8c0bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.591+0000 7f7eacceb740 1 -- 172.21.15.53:0/2175214320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d39b070 msgr2=0x55f03d740350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.591+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e8c0b90b0 0x7f7e8c0bb5c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55f03d73efd0 tx=0x7f7e90005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.591+0000 7f7eacceb740 1 --2- 172.21.15.53:0/2175214320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d39b070 0x55f03d740350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e980117e0 tx=0x7f7e98011ca0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.591+0000 7f7eacceb740 1 -- 172.21.15.53:0/2175214320 shutdown_connections 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.591+0000 7f7eacceb740 1 --2- 172.21.15.53:0/2175214320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d37a390 0x55f03d740dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.591+0000 7f7eacceb740 1 --2- 172.21.15.53:0/2175214320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d3721b0 0x55f03d740890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.591+0000 7f7eacceb740 1 --2- 172.21.15.53:0/2175214320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d39b070 0x55f03d740350 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.591+0000 7f7eacceb740 1 -- 172.21.15.53:0/2175214320 >> 172.21.15.53:0/2175214320 conn(0x55f03d38f460 msgr2=0x55f03d73e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.591+0000 7f7eacceb740 1 -- 172.21.15.53:0/2175214320 shutdown_connections 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.591+0000 7f7eacceb740 1 -- 172.21.15.53:0/2175214320 wait complete. 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.592+0000 7f7eacceb740 1 -- start start 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.592+0000 7f7eacceb740 1 Processor -- start 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.592+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d74ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.592+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d74bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.592+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d39b070 0x55f03d757e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.592+0000 7f7eacceb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f03d509700 con 0x55f03d39b070 2024-08-31T06:09:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.592+0000 7f7eacceb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f03d62d750 con 0x55f03d37a390 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.592+0000 7f7eacceb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f03d74eb30 con 0x55f03d3721b0 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7eacceb740 10 client.0 _ll_register_callbacks cb 0x55f03d65ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e97fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d74bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7ea4d13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d39b070 0x55f03d757e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e9ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d74ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7ea4d13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d39b070 0x55f03d757e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35732/0 (socket says 172.21.15.53:35732) 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7ea4d13640 1 -- 172.21.15.53:0/3426609668 learned_addr learned my addr 172.21.15.53:0/3426609668 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e97fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d74bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60836/0 (socket says 172.21.15.53:60836) 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e9ffff640 1 -- 172.21.15.53:0/3426609668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 msgr2=0x55f03d74bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d74bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e9ffff640 1 -- 172.21.15.53:0/3426609668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d39b070 msgr2=0x55f03d757e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d39b070 0x55f03d757e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e9ffff640 1 -- 172.21.15.53:0/3426609668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f03d666900 con 0x55f03d3721b0 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e97fff640 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d74bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d74ba90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e90004570 tx=0x7f7e90004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f67281cad588349c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.593+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/3426609668 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9000f830 con 0x55f03d3721b0 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7eacceb740 1 -- 172.21.15.53:0/3426609668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e98003e00 con 0x55f03d3721b0 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/3426609668 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7e9000f9d0 con 0x55f03d3721b0 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/3426609668 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7e9000fbd0 con 0x55f03d3721b0 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7eacceb740 10 client.26470 fetch_fsmap learned FSMap version 33 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7eacceb740 1 -- 172.21.15.53:0/3426609668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f03d75a9a0 con 0x55f03d3721b0 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/3426609668 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e98003e00 con 0x55f03d3721b0 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/3426609668 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f7e90027070 con 0x55f03d3721b0 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7eacceb740 10 client.26470 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T06:09:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7eacceb740 10 client.26470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7eacceb740 20 client.26470 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7eacceb740 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f03d3599f0 0x55f03d75dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7eacceb740 4 client.26470 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7eacceb740 1 -- 172.21.15.53:0/3426609668 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f03d6b95d0 con 0x55f03d3599f0 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.594+0000 7f7e97fff640 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f03d3599f0 0x55f03d75dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.595+0000 7f7e7f7fe640 10 client.26470 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.595+0000 7f7e97fff640 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f03d3599f0 0x55f03d75dec0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1e3d8aaa3bf3828 server_cookie=c1ff22e0229c0c3b in_seq=0 out_seq=0 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/3426609668 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f03d6b95d0 con 0x55f03d3599f0 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7e7f7fe640 10 client.26470 handle_command_reply: tid=0 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7eacceb740 1 client.26470 shutdown 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7eacceb740 1 -- 172.21.15.53:0/3426609668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 msgr2=0x55f03d74ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7eacceb740 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d74ba90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e90004570 tx=0x7f7e90004730 comp rx=0 tx=0).stop 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7eacceb740 1 -- 172.21.15.53:0/3426609668 shutdown_connections 2024-08-31T06:09:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7eacceb740 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f03d3599f0 0x55f03d75dec0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7eacceb740 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d39b070 0x55f03d757e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7eacceb740 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d74bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7e7f7fe640 0 client.26470 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7eacceb740 1 --2- 172.21.15.53:0/3426609668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d74ba90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7eacceb740 1 -- 172.21.15.53:0/3426609668 >> 172.21.15.53:0/3426609668 conn(0x55f03d38f460 msgr2=0x55f03d7434e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.596+0000 7f7eacceb740 1 -- 172.21.15.53:0/3426609668 shutdown_connections 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.597+0000 7f7eacceb740 1 -- 172.21.15.53:0/3426609668 wait complete. 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.597+0000 7f7eacceb740 20 client.26470 trim_cache size 0 max 16384 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.612+0000 7f7eacceb740 1 Processor -- start 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.612+0000 7f7eacceb740 1 -- start start 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.612+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d73e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.612+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d757d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.612+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d748c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7eacceb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01ad250 con 0x55f03d3599f0 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7eacceb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01aee50 con 0x55f03d37a390 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7eacceb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01ad920 con 0x55f03d3721b0 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7e9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d73e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7e9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d73e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35742/0 (socket says 172.21.15.53:35742) 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7e9ffff640 1 -- 172.21.15.53:0/340358918 learned_addr learned my addr 172.21.15.53:0/340358918 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7ea4d13640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d748c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7e97fff640 1 --2- 172.21.15.53:0/340358918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d757d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7e9ffff640 1 -- 172.21.15.53:0/340358918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 msgr2=0x55f03d757d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/340358918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d757d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7e9ffff640 1 -- 172.21.15.53:0/340358918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 msgr2=0x55f03d748c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/340358918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d748c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7e9ffff640 1 -- 172.21.15.53:0/340358918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f03d738410 con 0x55f03d3599f0 2024-08-31T06:09:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7ea4d13640 1 --2- 172.21.15.53:0/340358918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d748c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.613+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/340358918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d73e270 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7e90029490 tx=0x7f7e90003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfd8caaea499ea0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.614+0000 7f7e95ffb640 1 -- 172.21.15.53:0/340358918 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9000f830 con 0x55f03d3599f0 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.614+0000 7f7e95ffb640 1 -- 172.21.15.53:0/340358918 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e9000f9d0 con 0x55f03d3599f0 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.614+0000 7f7e95ffb640 1 -- 172.21.15.53:0/340358918 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e90004d10 con 0x55f03d3599f0 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.614+0000 7f7eacceb740 1 -- 172.21.15.53:0/340358918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 msgr2=0x55f03d73e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.614+0000 7f7eacceb740 1 --2- 172.21.15.53:0/340358918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d73e270 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7e90029490 tx=0x7f7e90003f00 comp rx=0 tx=0).stop 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.615+0000 7f7eacceb740 1 -- 172.21.15.53:0/340358918 shutdown_connections 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.615+0000 7f7eacceb740 1 --2- 172.21.15.53:0/340358918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d748c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.615+0000 7f7eacceb740 1 --2- 172.21.15.53:0/340358918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d757d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.615+0000 7f7eacceb740 1 --2- 172.21.15.53:0/340358918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d73e270 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.615+0000 7f7eacceb740 1 -- 172.21.15.53:0/340358918 >> 172.21.15.53:0/340358918 conn(0x55f03d38f460 msgr2=0x55f03d73db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.615+0000 7f7eacceb740 1 -- 172.21.15.53:0/340358918 shutdown_connections 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.615+0000 7f7eacceb740 1 -- 172.21.15.53:0/340358918 wait complete. 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.615+0000 7f7eacceb740 1 -- start start 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.615+0000 7f7eacceb740 1 Processor -- start 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d74fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d750230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7eacceb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d750770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7eacceb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01ae720 con 0x55f03d3599f0 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7eacceb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01adff0 con 0x55f03d37a390 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7eacceb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01ab230 con 0x55f03d3721b0 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7eacceb740 10 client.0 _ll_register_callbacks cb 0x7f7e90009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7e9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d74fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7e9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d74fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35756/0 (socket says 172.21.15.53:35756) 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7e9ffff640 1 -- 172.21.15.53:0/304379127 learned_addr learned my addr 172.21.15.53:0/304379127 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7e97fff640 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d750230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7ea4d13640 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d750770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7e9ffff640 1 -- 172.21.15.53:0/304379127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 msgr2=0x55f03d750230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d750230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7e9ffff640 1 -- 172.21.15.53:0/304379127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 msgr2=0x55f03d750770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d750770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.616+0000 7f7e9ffff640 1 -- 172.21.15.53:0/304379127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f03d7d00d0 con 0x55f03d3599f0 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.617+0000 7f7e9ffff640 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d74fcf0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000fba0 tx=0x7f7e90005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949f239365372721 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.617+0000 7f7e7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.617+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/304379127 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9000f830 con 0x55f03d3599f0 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.617+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/304379127 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7e90029800 con 0x55f03d3599f0 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.617+0000 7f7eacceb740 1 -- 172.21.15.53:0/304379127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e9000f9d0 con 0x55f03d3599f0 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.617+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/304379127 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7e90029a00 con 0x55f03d3599f0 2024-08-31T06:09:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.617+0000 7f7eacceb740 10 client.17118 fetch_fsmap learned FSMap version 33 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.617+0000 7f7eacceb740 1 -- 172.21.15.53:0/304379127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f03d7d12b0 con 0x55f03d3599f0 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.617+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/304379127 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e9000f9d0 con 0x55f03d3599f0 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.618+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/304379127 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f7e90027030 con 0x55f03d3599f0 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.618+0000 7f7eacceb740 10 client.17118 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.618+0000 7f7eacceb740 10 client.17118 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.618+0000 7f7eacceb740 20 client.17118 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.618+0000 7f7eacceb740 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f03d39b070 0x55f03d7d3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.618+0000 7f7eacceb740 4 client.17118 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.618+0000 7f7eacceb740 1 -- 172.21.15.53:0/304379127 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f03d6b5070 con 0x55f03d39b070 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.618+0000 7f7e97fff640 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f03d39b070 0x55f03d7d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.618+0000 7f7e7f7fe640 10 client.17118 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.618+0000 7f7e97fff640 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f03d39b070 0x55f03d7d3a10 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fab5e2228b4ed8c6 server_cookie=ff2b055cc6411e in_seq=0 out_seq=0 2024-08-31T06:09:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7e7f7fe640 1 -- 172.21.15.53:0/304379127 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f03d6b5070 con 0x55f03d39b070 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7e7f7fe640 10 client.17118 handle_command_reply: tid=0 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 1 client.17118 shutdown 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 1 -- 172.21.15.53:0/304379127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 msgr2=0x55f03d74fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d74fcf0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000fba0 tx=0x7f7e90005720 comp rx=0 tx=0).stop 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 1 -- 172.21.15.53:0/304379127 shutdown_connections 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f03d39b070 0x55f03d7d3a10 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f03d37a390 0x55f03d750770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f03d3721b0 0x55f03d750230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 1 --2- 172.21.15.53:0/304379127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f03d3599f0 0x55f03d74fcf0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 1 -- 172.21.15.53:0/304379127 >> 172.21.15.53:0/304379127 conn(0x55f03d38f460 msgr2=0x55f03d741380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7e7f7fe640 0 client.17118 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 1 -- 172.21.15.53:0/304379127 shutdown_connections 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 1 -- 172.21.15.53:0/304379127 wait complete. 2024-08-31T06:09:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.619+0000 7f7eacceb740 20 client.17118 trim_cache size 0 max 16384 2024-08-31T06:09:16.638 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:09:16.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 -- 172.21.15.53:0/2806635547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e8c0b90b0 msgr2=0x7f7e8c0bb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e8c0b90b0 0x7f7e8c0bb5c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55f03d73efd0 tx=0x7f7e90005f90 comp rx=0 tx=0).stop 2024-08-31T06:09:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 -- 172.21.15.53:0/2806635547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0108140 msgr2=0x7f7ea019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0108140 0x7f7ea019a710 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f7e88005940 tx=0x7f7e88005e30 comp rx=0 tx=0).stop 2024-08-31T06:09:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 -- 172.21.15.53:0/2806635547 shutdown_connections 2024-08-31T06:09:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e8c0b90b0 0x7f7e8c0bb5c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0108a90 0x7f7ea019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0108140 0x7f7ea019a710 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 --2- 172.21.15.53:0/2806635547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0102800 0x7f7ea019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 -- 172.21.15.53:0/2806635547 >> 172.21.15.53:0/2806635547 conn(0x7f7ea00794d0 msgr2=0x7f7ea006b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 -- 172.21.15.53:0/2806635547 shutdown_connections 2024-08-31T06:09:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:16.620+0000 7f7ea6776640 1 -- 172.21.15.53:0/2806635547 wait complete. 2024-08-31T06:09:16.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 72108 1.59 MB/sec execute 66 sec latency 19.287 ms 2024-08-31T06:09:17.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:16 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:17.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:16 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:17.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:16 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:17.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 72700 1.61 MB/sec execute 67 sec latency 16.905 ms 2024-08-31T06:09:18.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:17 smithi053 ceph-mon[18924]: pgmap v453: 97 pgs: 97 active+clean; 51 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-08-31T06:09:18.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:17 smithi130 ceph-mon[22266]: pgmap v453: 97 pgs: 97 active+clean; 51 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-08-31T06:09:18.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:17 smithi153 ceph-mon[22320]: pgmap v453: 97 pgs: 97 active+clean; 51 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-08-31T06:09:18.474 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:09:18.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:09:18.742 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:18.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 73362 1.62 MB/sec execute 68 sec latency 15.298 ms 2024-08-31T06:09:19.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.277+0000 7f73923a2640 1 -- 172.21.15.53:0/1671208791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f738c101f90 msgr2=0x7f738c1023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:19.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.277+0000 7f73923a2640 1 --2- 172.21.15.53:0/1671208791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f738c101f90 0x7f738c1023a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f737c009900 tx=0x7f737c02a410 comp rx=0 tx=0).stop 2024-08-31T06:09:19.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.277+0000 7f73923a2640 1 -- 172.21.15.53:0/1671208791 shutdown_connections 2024-08-31T06:09:19.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.277+0000 7f73923a2640 1 --2- 172.21.15.53:0/1671208791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c108220 0x7f738c10ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.277+0000 7f73923a2640 1 --2- 172.21.15.53:0/1671208791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f738c1078d0 0x7f738c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.277+0000 7f73923a2640 1 --2- 172.21.15.53:0/1671208791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f738c101f90 0x7f738c1023a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.277+0000 7f73923a2640 1 -- 172.21.15.53:0/1671208791 >> 172.21.15.53:0/1671208791 conn(0x7f738c077a00 msgr2=0x7f738c077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:19.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.277+0000 7f73923a2640 1 -- 172.21.15.53:0/1671208791 shutdown_connections 2024-08-31T06:09:19.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.277+0000 7f73923a2640 1 -- 172.21.15.53:0/1671208791 wait complete. 2024-08-31T06:09:19.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f73923a2640 1 Processor -- start 2024-08-31T06:09:19.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f73923a2640 1 -- start start 2024-08-31T06:09:19.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f73923a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f738c101f90 0x7f738c19af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f73923a2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c1078d0 0x7f738c19b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f73923a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f738c108220 0x7f738c19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f73923a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f738c112610 con 0x7f738c101f90 2024-08-31T06:09:19.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f73923a2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f738c112490 con 0x7f738c1078d0 2024-08-31T06:09:19.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f73923a2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f738c112790 con 0x7f738c108220 2024-08-31T06:09:19.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f738bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f738c101f90 0x7f738c19af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f738b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c1078d0 0x7f738c19b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f739093f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f738c108220 0x7f738c19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f738bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f738c101f90 0x7f738c19af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35774/0 (socket says 172.21.15.53:35774) 2024-08-31T06:09:19.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f738b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c1078d0 0x7f738c19b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60858/0 (socket says 172.21.15.53:60858) 2024-08-31T06:09:19.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.278+0000 7f738bfff640 1 -- 172.21.15.53:0/3007019220 learned_addr learned my addr 172.21.15.53:0/3007019220 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:19.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f739093f640 1 -- 172.21.15.53:0/3007019220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c1078d0 msgr2=0x7f738c19b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:19.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f739093f640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c1078d0 0x7f738c19b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f739093f640 1 -- 172.21.15.53:0/3007019220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f738c101f90 msgr2=0x7f738c19af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:19.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f739093f640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f738c101f90 0x7f738c19af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f739093f640 1 -- 172.21.15.53:0/3007019220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c1a6230 con 0x7f738c108220 2024-08-31T06:09:19.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f738bfff640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f738c101f90 0x7f738c19af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:19.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f739093f640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f738c108220 0x7f738c19b9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7384009fd0 tx=0x7f738400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:19.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f73897fa640 1 -- 172.21.15.53:0/3007019220 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738400ce20 con 0x7f738c108220 2024-08-31T06:09:19.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f73897fa640 1 -- 172.21.15.53:0/3007019220 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7384005020 con 0x7f738c108220 2024-08-31T06:09:19.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f73923a2640 1 -- 172.21.15.53:0/3007019220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738c1a6520 con 0x7f738c108220 2024-08-31T06:09:19.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f73897fa640 1 -- 172.21.15.53:0/3007019220 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384010690 con 0x7f738c108220 2024-08-31T06:09:19.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.279+0000 7f73923a2640 1 -- 172.21.15.53:0/3007019220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738c1a6a10 con 0x7f738c108220 2024-08-31T06:09:19.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.282+0000 7f7398917740 1 Processor -- start 2024-08-31T06:09:19.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.282+0000 7f73897fa640 1 -- 172.21.15.53:0/3007019220 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7384004a40 con 0x7f738c108220 2024-08-31T06:09:19.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.282+0000 7f7398917740 1 -- start start 2024-08-31T06:09:19.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f7398917740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fda9350 0x55829014f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f7398917740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 0x55829014fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f7398917740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 0x558290150200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f7398917740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5582900c55f0 con 0x55828fd80490 2024-08-31T06:09:19.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f7398917740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5582900b4b80 con 0x55828fd88670 2024-08-31T06:09:19.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f7398917740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5582900b8b30 con 0x55828fda9350 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f738bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 0x55829014fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f738bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 0x55829014fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35778/0 (socket says 172.21.15.53:35778) 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f738bfff640 1 -- 172.21.15.53:0/3526882719 learned_addr learned my addr 172.21.15.53:0/3526882719 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f738b7fe640 1 --2- 172.21.15.53:0/3526882719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fda9350 0x55829014f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f738b7fe640 1 --2- 172.21.15.53:0/3526882719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 0x558290150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f73897fa640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f73740b4ca0 0x7f73740b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f738bfff640 1 -- 172.21.15.53:0/3526882719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fda9350 msgr2=0x55829014f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f738bfff640 1 --2- 172.21.15.53:0/3526882719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fda9350 0x55829014f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f738bfff640 1 -- 172.21.15.53:0/3526882719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 msgr2=0x558290150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f738bfff640 1 --2- 172.21.15.53:0/3526882719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 0x558290150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f738bfff640 1 -- 172.21.15.53:0/3526882719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828fe14930 con 0x55828fd80490 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.283+0000 7f739093f640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f73740b4ca0 0x7f73740b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.284+0000 7f73897fa640 1 -- 172.21.15.53:0/3007019220 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f73840e5c50 con 0x7f738c108220 2024-08-31T06:09:19.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.284+0000 7f738bfff640 1 --2- 172.21.15.53:0/3526882719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 0x55829014fcc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f737c005e00 tx=0x7f737c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41495920e7d0ae75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:19.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.284+0000 7f739093f640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f73740b4ca0 0x7f73740b71b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f73840e39a0 tx=0x7f73840754b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:19.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.284+0000 7f73727fc640 1 -- 172.21.15.53:0/3526882719 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c035070 con 0x55828fd80490 2024-08-31T06:09:19.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.284+0000 7f73727fc640 1 -- 172.21.15.53:0/3526882719 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f737c0044c0 con 0x55828fd80490 2024-08-31T06:09:19.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.284+0000 7f73727fc640 1 -- 172.21.15.53:0/3526882719 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c003cd0 con 0x55828fd80490 2024-08-31T06:09:19.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.285+0000 7f7398917740 1 -- 172.21.15.53:0/3526882719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 msgr2=0x55829014fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:19.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.285+0000 7f7398917740 1 --2- 172.21.15.53:0/3526882719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 0x55829014fcc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f737c005e00 tx=0x7f737c009610 comp rx=0 tx=0).stop 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.285+0000 7f7398917740 1 -- 172.21.15.53:0/3526882719 shutdown_connections 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.285+0000 7f7398917740 1 --2- 172.21.15.53:0/3526882719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 0x558290150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.285+0000 7f7398917740 1 --2- 172.21.15.53:0/3526882719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 0x55829014fcc0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.285+0000 7f7398917740 1 --2- 172.21.15.53:0/3526882719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fda9350 0x55829014f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.285+0000 7f7398917740 1 -- 172.21.15.53:0/3526882719 >> 172.21.15.53:0/3526882719 conn(0x55828fd9d740 msgr2=0x55829014d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.285+0000 7f7398917740 1 -- 172.21.15.53:0/3526882719 shutdown_connections 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.285+0000 7f7398917740 1 -- 172.21.15.53:0/3526882719 wait complete. 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f7398917740 1 -- start start 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f7398917740 1 Processor -- start 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f7398917740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd80490 0x55829015af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f7398917740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd88670 0x55829015b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f7398917740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fda9350 0x5582901671f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f7398917740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55828ff17890 con 0x55828fd88670 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f7398917740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55829003b790 con 0x55828fda9350 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f7398917740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55829015df00 con 0x55828fd80490 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f738bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd88670 0x55829015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f738b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd80490 0x55829015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f7398917740 10 client.0 _ll_register_callbacks cb 0x55828fdc0ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f738b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd80490 0x55829015af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37564/0 (socket says 172.21.15.53:37564) 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f738b7fe640 1 -- 172.21.15.53:0/2553889053 learned_addr learned my addr 172.21.15.53:0/2553889053 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f738bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd88670 0x55829015b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35790/0 (socket says 172.21.15.53:35790) 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.286+0000 7f738b7fe640 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fda9350 0x5582901671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f738b7fe640 1 -- 172.21.15.53:0/2553889053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fda9350 msgr2=0x5582901671f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f738b7fe640 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fda9350 0x5582901671f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f738b7fe640 1 -- 172.21.15.53:0/2553889053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd88670 msgr2=0x55829015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f738b7fe640 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd88670 0x55829015b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f738b7fe640 1 -- 172.21.15.53:0/2553889053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558290072f30 con 0x55828fd80490 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f738bfff640 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd88670 0x55829015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f738b7fe640 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd80490 0x55829015af50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7380011c60 tx=0x7f73800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e43511811f60fd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f736b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f736b7fe640 1 -- 172.21.15.53:0/2553889053 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738000fe60 con 0x55828fd80490 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f736b7fe640 1 -- 172.21.15.53:0/2553889053 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7380004030 con 0x55828fd80490 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f7398917740 1 -- 172.21.15.53:0/2553889053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5582900c7540 con 0x55828fd80490 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f736b7fe640 1 -- 172.21.15.53:0/2553889053 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7380004230 con 0x55828fd80490 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.287+0000 7f7398917740 10 client.26488 fetch_fsmap learned FSMap version 33 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.288+0000 7f7398917740 1 -- 172.21.15.53:0/2553889053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558290169d30 con 0x55828fd80490 2024-08-31T06:09:19.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.288+0000 7f736b7fe640 1 -- 172.21.15.53:0/2553889053 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5582900c7540 con 0x55828fd80490 2024-08-31T06:09:19.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.288+0000 7f736b7fe640 1 -- 172.21.15.53:0/2553889053 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f7380022420 con 0x55828fd80490 2024-08-31T06:09:19.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.288+0000 7f7398917740 10 client.26488 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T06:09:19.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.288+0000 7f7398917740 10 client.26488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:19.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.288+0000 7f7398917740 20 client.26488 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:19.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.288+0000 7f7398917740 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55828fd67cd0 0x55829016d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.288+0000 7f7398917740 4 client.26488 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:19.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.288+0000 7f7398917740 1 -- 172.21.15.53:0/2553889053 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582900c2fe0 con 0x55828fd67cd0 2024-08-31T06:09:19.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.288+0000 7f738bfff640 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55828fd67cd0 0x55829016d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.289+0000 7f736b7fe640 10 client.26488 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:19.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.289+0000 7f738bfff640 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55828fd67cd0 0x55829016d270 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e24f8e73a0e80229 server_cookie=5ae27812a8e9d251 in_seq=0 out_seq=0 2024-08-31T06:09:19.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.289+0000 7f736b7fe640 1 -- 172.21.15.53:0/2553889053 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582900c2fe0 con 0x55828fd67cd0 2024-08-31T06:09:19.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.289+0000 7f736b7fe640 10 client.26488 handle_command_reply: tid=0 2024-08-31T06:09:19.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.289+0000 7f7398917740 1 client.26488 shutdown 2024-08-31T06:09:19.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f7398917740 1 -- 172.21.15.53:0/2553889053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd80490 msgr2=0x55829015af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:19.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f7398917740 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd80490 0x55829015af50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7380011c60 tx=0x7f73800046c0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f7398917740 1 -- 172.21.15.53:0/2553889053 shutdown_connections 2024-08-31T06:09:19.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f7398917740 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55828fd67cd0 0x55829016d270 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f7398917740 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fda9350 0x5582901671f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f7398917740 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd88670 0x55829015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f7398917740 1 --2- 172.21.15.53:0/2553889053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd80490 0x55829015af50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f736b7fe640 0 client.26488 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:19.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f7398917740 1 -- 172.21.15.53:0/2553889053 >> 172.21.15.53:0/2553889053 conn(0x55828fd9d740 msgr2=0x558290152910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:19.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f7398917740 1 -- 172.21.15.53:0/2553889053 shutdown_connections 2024-08-31T06:09:19.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f7398917740 1 -- 172.21.15.53:0/2553889053 wait complete. 2024-08-31T06:09:19.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.290+0000 7f7398917740 20 client.26488 trim_cache size 0 max 16384 2024-08-31T06:09:19.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.308+0000 7f7398917740 1 Processor -- start 2024-08-31T06:09:19.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.308+0000 7f7398917740 1 -- start start 2024-08-31T06:09:19.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.308+0000 7f7398917740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd80490 0x558290152f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f7398917740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd88670 0x558290158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f7398917740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fda9350 0x558290158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f7398917740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f738c1af400 con 0x55828fda9350 2024-08-31T06:09:19.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f7398917740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f738c1b1000 con 0x55828fd80490 2024-08-31T06:09:19.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f7398917740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f738c1afad0 con 0x55828fd88670 2024-08-31T06:09:19.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f738b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fda9350 0x558290158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f738b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fda9350 0x558290158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35804/0 (socket says 172.21.15.53:35804) 2024-08-31T06:09:19.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f738b7fe640 1 -- 172.21.15.53:0/2213592164 learned_addr learned my addr 172.21.15.53:0/2213592164 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:19.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f738b7fe640 1 --2- 172.21.15.53:0/2213592164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd80490 0x558290152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f738bfff640 1 --2- 172.21.15.53:0/2213592164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd88670 0x558290158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f738b7fe640 1 -- 172.21.15.53:0/2213592164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd88670 msgr2=0x558290158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:19.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f738b7fe640 1 --2- 172.21.15.53:0/2213592164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd88670 0x558290158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f738b7fe640 1 -- 172.21.15.53:0/2213592164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd80490 msgr2=0x558290152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:19.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f738b7fe640 1 --2- 172.21.15.53:0/2213592164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd80490 0x558290152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f738b7fe640 1 -- 172.21.15.53:0/2213592164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558290159eb0 con 0x55828fda9350 2024-08-31T06:09:19.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f738b7fe640 1 --2- 172.21.15.53:0/2213592164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fda9350 0x558290158680 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f73800119f0 tx=0x7f7380005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4207a6d280953aad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:19.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.309+0000 7f7371ffb640 1 -- 172.21.15.53:0/2213592164 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738000fe60 con 0x55828fda9350 2024-08-31T06:09:19.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.310+0000 7f7371ffb640 1 -- 172.21.15.53:0/2213592164 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f73800043d0 con 0x55828fda9350 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.310+0000 7f7371ffb640 1 -- 172.21.15.53:0/2213592164 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380005070 con 0x55828fda9350 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.310+0000 7f7398917740 1 -- 172.21.15.53:0/2213592164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fda9350 msgr2=0x558290158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.310+0000 7f7398917740 1 --2- 172.21.15.53:0/2213592164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fda9350 0x558290158680 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f73800119f0 tx=0x7f7380005f90 comp rx=0 tx=0).stop 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.310+0000 7f7398917740 1 -- 172.21.15.53:0/2213592164 shutdown_connections 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.310+0000 7f7398917740 1 --2- 172.21.15.53:0/2213592164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fda9350 0x558290158680 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.310+0000 7f7398917740 1 --2- 172.21.15.53:0/2213592164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fd88670 0x558290158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.310+0000 7f7398917740 1 --2- 172.21.15.53:0/2213592164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd80490 0x558290152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.310+0000 7f7398917740 1 -- 172.21.15.53:0/2213592164 >> 172.21.15.53:0/2213592164 conn(0x55828fd9d740 msgr2=0x558290152880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.310+0000 7f7398917740 1 -- 172.21.15.53:0/2213592164 shutdown_connections 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.311+0000 7f7398917740 1 -- 172.21.15.53:0/2213592164 wait complete. 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.311+0000 7f7398917740 1 -- start start 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.311+0000 7f7398917740 1 Processor -- start 2024-08-31T06:09:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.311+0000 7f7398917740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 0x55829015f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.311+0000 7f7398917740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 0x55829015fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.311+0000 7f7398917740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fda9350 0x5582901d6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f7398917740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f738c1b08d0 con 0x55828fd80490 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f7398917740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f738c1b01a0 con 0x55828fd88670 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f7398917740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f738c1ad3e0 con 0x55828fda9350 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f7398917740 10 client.0 _ll_register_callbacks cb 0x7f7380011ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 0x55829015fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 0x55829015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 0x55829015fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60886/0 (socket says 172.21.15.53:60886) 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738bfff640 1 -- 172.21.15.53:0/1571029484 learned_addr learned my addr 172.21.15.53:0/1571029484 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738b7fe640 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fda9350 0x5582901d6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738bfff640 1 -- 172.21.15.53:0/1571029484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fda9350 msgr2=0x5582901d6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738bfff640 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fda9350 0x5582901d6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738bfff640 1 -- 172.21.15.53:0/1571029484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 msgr2=0x55829015f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738bfff640 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 0x55829015f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738bfff640 1 -- 172.21.15.53:0/1571029484 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582901d71b0 con 0x55828fd88670 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738b7fe640 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fda9350 0x5582901d6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f738bfff640 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 0x55829015fd70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f737c009850 tx=0x7f737c032f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1290eafd0623b8d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.312+0000 7f736b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f736b7fe640 1 -- 172.21.15.53:0/1571029484 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c035040 con 0x55828fd88670 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f736b7fe640 1 -- 172.21.15.53:0/1571029484 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f737c0317c0 con 0x55828fd88670 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f7398917740 1 -- 172.21.15.53:0/1571029484 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73800043d0 con 0x55828fd88670 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f736b7fe640 1 -- 172.21.15.53:0/1571029484 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f737c05f050 con 0x55828fd88670 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f7398917740 10 client.26495 fetch_fsmap learned FSMap version 33 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f7398917740 1 -- 172.21.15.53:0/1571029484 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5582901d83e0 con 0x55828fd88670 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f736b7fe640 1 -- 172.21.15.53:0/1571029484 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f73800043d0 con 0x55828fd88670 2024-08-31T06:09:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f736b7fe640 1 -- 172.21.15.53:0/1571029484 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f737c05a030 con 0x55828fd88670 2024-08-31T06:09:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f7398917740 10 client.26495 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T06:09:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f7398917740 10 client.26495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f7398917740 20 client.26495 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f7398917740 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55828fd3d080 0x5582901da7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f7398917740 4 client.26495 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:09:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.313+0000 7f7398917740 1 -- 172.21.15.53:0/1571029484 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5582900c0720 con 0x55828fd3d080 2024-08-31T06:09:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.314+0000 7f738b7fe640 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55828fd3d080 0x5582901da7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.314+0000 7f736b7fe640 10 client.26495 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.314+0000 7f738b7fe640 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55828fd3d080 0x5582901da7f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7b80ba2c92b54c server_cookie=ae552a59f94d0c07 in_seq=0 out_seq=0 2024-08-31T06:09:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f736b7fe640 1 -- 172.21.15.53:0/1571029484 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5582900c0720 con 0x55828fd3d080 2024-08-31T06:09:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f736b7fe640 10 client.26495 handle_command_reply: tid=0 2024-08-31T06:09:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f7398917740 1 client.26495 shutdown 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f7398917740 1 -- 172.21.15.53:0/1571029484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 msgr2=0x55829015fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f7398917740 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 0x55829015fd70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f737c009850 tx=0x7f737c032f90 comp rx=0 tx=0).stop 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f7398917740 1 -- 172.21.15.53:0/1571029484 shutdown_connections 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f7398917740 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55828fd3d080 0x5582901da7f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f7398917740 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55828fda9350 0x5582901d6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f7398917740 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55828fd88670 0x55829015fd70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f7398917740 1 --2- 172.21.15.53:0/1571029484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55828fd80490 0x55829015f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f736b7fe640 0 client.26495 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.316+0000 7f7398917740 1 -- 172.21.15.53:0/1571029484 >> 172.21.15.53:0/1571029484 conn(0x55828fd9d740 msgr2=0x558290150740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.317+0000 7f7398917740 1 -- 172.21.15.53:0/1571029484 shutdown_connections 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.317+0000 7f7398917740 1 -- 172.21.15.53:0/1571029484 wait complete. 2024-08-31T06:09:19.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.317+0000 7f7398917740 20 client.26495 trim_cache size 0 max 16384 2024-08-31T06:09:19.322 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:09:19.322 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:09:19.322 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "d594849b-7418-4d8f-b5b0-5c03697b954c", 2024-08-31T06:09:19.322 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:09:19.322 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:09:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.317+0000 7f73923a2640 1 -- 172.21.15.53:0/3007019220 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f73740b4ca0 msgr2=0x7f73740b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.317+0000 7f73923a2640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f73740b4ca0 0x7f73740b71b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f73840e39a0 tx=0x7f73840754b0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.317+0000 7f73923a2640 1 -- 172.21.15.53:0/3007019220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f738c108220 msgr2=0x7f738c19b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.317+0000 7f73923a2640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f738c108220 0x7f738c19b9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7384009fd0 tx=0x7f738400ef10 comp rx=0 tx=0).stop 2024-08-31T06:09:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.318+0000 7f73923a2640 1 -- 172.21.15.53:0/3007019220 shutdown_connections 2024-08-31T06:09:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.318+0000 7f73923a2640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f73740b4ca0 0x7f73740b71b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.318+0000 7f73923a2640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f738c108220 0x7f738c19b9a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.318+0000 7f73923a2640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f738c1078d0 0x7f738c19b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.318+0000 7f73923a2640 1 --2- 172.21.15.53:0/3007019220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f738c101f90 0x7f738c19af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.318+0000 7f73923a2640 1 -- 172.21.15.53:0/3007019220 >> 172.21.15.53:0/3007019220 conn(0x7f738c077a00 msgr2=0x7f738c105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.318+0000 7f73923a2640 1 -- 172.21.15.53:0/3007019220 shutdown_connections 2024-08-31T06:09:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:19.318+0000 7f73923a2640 1 -- 172.21.15.53:0/3007019220 wait complete. 2024-08-31T06:09:19.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 73872 1.65 MB/sec execute 69 sec latency 56.086 ms 2024-08-31T06:09:20.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:09:20.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: pgmap v454: 97 pgs: 97 active+clean; 51 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 1.4 MiB/s wr, 129 op/s 2024-08-31T06:09:20.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:09:20.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:09:20.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:09:20.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:09:20.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:09:20.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:09:20.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:09:20.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:09:20.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:09:20.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.160 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: pgmap v454: 97 pgs: 97 active+clean; 51 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 1.4 MiB/s wr, 129 op/s 2024-08-31T06:09:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:09:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:09:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.408 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: pgmap v454: 97 pgs: 97 active+clean; 51 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 1.4 MiB/s wr, 129 op/s 2024-08-31T06:09:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:09:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:20.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.923+0000 7f1ab675a640 1 -- 172.21.15.53:0/1154546761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ab0108140 msgr2=0x7f1ab0108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:20.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.923+0000 7f1ab675a640 1 --2- 172.21.15.53:0/1154546761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ab0108140 0x7f1ab0108550 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009900 tx=0x7f1a9802a410 comp rx=0 tx=0).stop 2024-08-31T06:09:20.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.923+0000 7f1ab675a640 1 -- 172.21.15.53:0/1154546761 shutdown_connections 2024-08-31T06:09:20.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.923+0000 7f1ab675a640 1 --2- 172.21.15.53:0/1154546761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ab0108a90 0x7f1ab010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.923+0000 7f1ab675a640 1 --2- 172.21.15.53:0/1154546761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ab0108140 0x7f1ab0108550 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.923+0000 7f1ab675a640 1 --2- 172.21.15.53:0/1154546761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab0102800 0x7f1ab0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.923+0000 7f1ab675a640 1 -- 172.21.15.53:0/1154546761 >> 172.21.15.53:0/1154546761 conn(0x7f1ab00794d0 msgr2=0x7f1ab00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:20.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.923+0000 7f1ab675a640 1 -- 172.21.15.53:0/1154546761 shutdown_connections 2024-08-31T06:09:20.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.923+0000 7f1ab675a640 1 -- 172.21.15.53:0/1154546761 wait complete. 2024-08-31T06:09:20.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.924+0000 7f1ab675a640 1 Processor -- start 2024-08-31T06:09:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.924+0000 7f1ab675a640 1 -- start start 2024-08-31T06:09:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.924+0000 7f1ab675a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ab0102800 0x7f1ab019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.924+0000 7f1ab675a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab0108140 0x7f1ab019b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.924+0000 7f1ab675a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ab0108a90 0x7f1ab019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.924+0000 7f1ab675a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab01125c0 con 0x7f1ab0108a90 2024-08-31T06:09:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.924+0000 7f1ab675a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab0112440 con 0x7f1ab0108140 2024-08-31T06:09:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.924+0000 7f1ab675a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab0112740 con 0x7f1ab0102800 2024-08-31T06:09:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1ab4cf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ab0108a90 0x7f1ab019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1ab4cf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ab0108a90 0x7f1ab019bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35838/0 (socket says 172.21.15.53:35838) 2024-08-31T06:09:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1ab4cf7640 1 -- 172.21.15.53:0/2244978920 learned_addr learned my addr 172.21.15.53:0/2244978920 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1aaffff640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ab0102800 0x7f1ab019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab0108140 0x7f1ab019b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1ab4cf7640 1 -- 172.21.15.53:0/2244978920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ab0102800 msgr2=0x7f1ab019b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1ab4cf7640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ab0102800 0x7f1ab019b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1ab4cf7640 1 -- 172.21.15.53:0/2244978920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab0108140 msgr2=0x7f1ab019b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1ab4cf7640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab0108140 0x7f1ab019b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1ab4cf7640 1 -- 172.21.15.53:0/2244978920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab01a6380 con 0x7f1ab0108a90 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab0108140 0x7f1ab019b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1ab4cf7640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ab0108a90 0x7f1ab019bb70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009fd0 tx=0x7f1aa800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1aadffb640 1 -- 172.21.15.53:0/2244978920 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8017070 con 0x7f1ab0108a90 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1ab675a640 1 -- 172.21.15.53:0/2244978920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab01a6670 con 0x7f1ab0108a90 2024-08-31T06:09:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1aadffb640 1 -- 172.21.15.53:0/2244978920 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1aa8003e00 con 0x7f1ab0108a90 2024-08-31T06:09:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1aadffb640 1 -- 172.21.15.53:0/2244978920 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8010460 con 0x7f1ab0108a90 2024-08-31T06:09:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.925+0000 7f1ab675a640 1 -- 172.21.15.53:0/2244978920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab01a6b30 con 0x7f1ab0108a90 2024-08-31T06:09:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.928+0000 7f1abcccf740 1 Processor -- start 2024-08-31T06:09:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.928+0000 7f1aadffb640 1 -- 172.21.15.53:0/2244978920 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1aa8003970 con 0x7f1ab0108a90 2024-08-31T06:09:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.928+0000 7f1abcccf740 1 -- start start 2024-08-31T06:09:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab3342c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 0x563eab334800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf6e390 0x563eab334d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1abcccf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563eab2ab630 con 0x563eaaf6e390 2024-08-31T06:09:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1abcccf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563eab29abc0 con 0x563eaaf8f070 2024-08-31T06:09:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1abcccf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563eab29eb70 con 0x563eaaf661b0 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab3342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab3342c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60902/0 (socket says 172.21.15.53:60902) 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aa7fff640 1 -- 172.21.15.53:0/358863863 learned_addr learned my addr 172.21.15.53:0/358863863 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aaffff640 1 --2- 172.21.15.53:0/358863863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 0x563eab334800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/358863863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf6e390 0x563eab334d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aadffb640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a9c0b4cd0 0x7f1a9c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aa7fff640 1 -- 172.21.15.53:0/358863863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 msgr2=0x563eab334800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/358863863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 0x563eab334800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aa7fff640 1 -- 172.21.15.53:0/358863863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf6e390 msgr2=0x563eab334d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/358863863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf6e390 0x563eab334d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aa7fff640 1 -- 172.21.15.53:0/358863863 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eaaffa650 con 0x563eaaf8f070 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.929+0000 7f1aaffff640 1 --2- 172.21.15.53:0/358863863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 0x563eab334800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.930+0000 7f1aadffb640 1 -- 172.21.15.53:0/2244978920 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1aa80e5300 con 0x7f1ab0108a90 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.930+0000 7f1ab4cf7640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a9c0b4cd0 0x7f1a9c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.930+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/358863863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab3342c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1a980096c0 tx=0x7f1a98009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f98c2fd9df063520 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.930+0000 7f1aa67fc640 1 -- 172.21.15.53:0/358863863 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98035040 con 0x563eaaf8f070 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.930+0000 7f1aa67fc640 1 -- 172.21.15.53:0/358863863 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a980038c0 con 0x563eaaf8f070 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.930+0000 7f1aa67fc640 1 -- 172.21.15.53:0/358863863 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98004920 con 0x563eaaf8f070 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.931+0000 7f1abcccf740 1 -- 172.21.15.53:0/358863863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 msgr2=0x563eab3342c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.931+0000 7f1abcccf740 1 --2- 172.21.15.53:0/358863863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab3342c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1a980096c0 tx=0x7f1a98009560 comp rx=0 tx=0).stop 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.931+0000 7f1ab4cf7640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a9c0b4cd0 0x7f1a9c0b71e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800dfd0 tx=0x7f1aa800b910 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.931+0000 7f1abcccf740 1 -- 172.21.15.53:0/358863863 shutdown_connections 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.931+0000 7f1abcccf740 1 --2- 172.21.15.53:0/358863863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf6e390 0x563eab334d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.931+0000 7f1abcccf740 1 --2- 172.21.15.53:0/358863863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 0x563eab334800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.931+0000 7f1abcccf740 1 --2- 172.21.15.53:0/358863863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab3342c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.931+0000 7f1abcccf740 1 -- 172.21.15.53:0/358863863 >> 172.21.15.53:0/358863863 conn(0x563eaaf83460 msgr2=0x563eab3321b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.931+0000 7f1abcccf740 1 -- 172.21.15.53:0/358863863 shutdown_connections 2024-08-31T06:09:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.931+0000 7f1abcccf740 1 -- 172.21.15.53:0/358863863 wait complete. 2024-08-31T06:09:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.931+0000 7f1abcccf740 1 -- start start 2024-08-31T06:09:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.932+0000 7f1abcccf740 1 Processor -- start 2024-08-31T06:09:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.932+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 0x563eab33fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.932+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf6e390 0x563eab33ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.932+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab34bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.932+0000 7f1abcccf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563eab0fd700 con 0x563eaaf6e390 2024-08-31T06:09:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.932+0000 7f1abcccf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563eab221700 con 0x563eaaf8f070 2024-08-31T06:09:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.932+0000 7f1abcccf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563eab342a40 con 0x563eaaf661b0 2024-08-31T06:09:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.932+0000 7f1abcccf740 10 client.0 _ll_register_callbacks cb 0x563eab250dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.933+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab34bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.933+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab34bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60914/0 (socket says 172.21.15.53:60914) 2024-08-31T06:09:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.933+0000 7f1aa7fff640 1 -- 172.21.15.53:0/1201416821 learned_addr learned my addr 172.21.15.53:0/1201416821 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.933+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 0x563eab33fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.933+0000 7f1aa7fff640 1 -- 172.21.15.53:0/1201416821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 msgr2=0x563eab34bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.933+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab34bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.933+0000 7f1aa7fff640 1 -- 172.21.15.53:0/1201416821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf6e390 msgr2=0x563eab33ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.933+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf6e390 0x563eab33ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.933+0000 7f1aa7fff640 1 -- 172.21.15.53:0/1201416821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eab25a8b0 con 0x563eaaf661b0 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.933+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 0x563eab33fa80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a980057c0 tx=0x7f1a98000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1296f0e39ce660fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.933+0000 7f1a8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/1201416821 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98035070 con 0x563eaaf661b0 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/1201416821 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1a9804f420 con 0x563eaaf661b0 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1abcccf740 1 -- 172.21.15.53:0/1201416821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a980038c0 con 0x563eaaf661b0 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/1201416821 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1a9804f620 con 0x563eaaf661b0 2024-08-31T06:09:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1abcccf740 10 client.26506 fetch_fsmap learned FSMap version 33 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1abcccf740 1 -- 172.21.15.53:0/1201416821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563eab34e870 con 0x563eaaf661b0 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/1201416821 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a980038c0 con 0x563eaaf661b0 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/1201416821 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f1a9803a040 con 0x563eaaf661b0 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1abcccf740 10 client.26506 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1abcccf740 10 client.26506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1abcccf740 20 client.26506 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1abcccf740 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563eaaf4d9f0 0x563eab351bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.934+0000 7f1abcccf740 4 client.26506 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.935+0000 7f1abcccf740 1 -- 172.21.15.53:0/1201416821 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563eab2ad580 con 0x563eaaf4d9f0 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.935+0000 7f1aaffff640 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563eaaf4d9f0 0x563eab351bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.935+0000 7f1a8f7fe640 10 client.26506 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.935+0000 7f1aaffff640 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563eaaf4d9f0 0x563eab351bd0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c32c73b82a13f3e0 server_cookie=b941aa1a270a4b6 in_seq=0 out_seq=0 2024-08-31T06:09:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/1201416821 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563eab2ad580 con 0x563eaaf4d9f0 2024-08-31T06:09:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1a8f7fe640 10 client.26506 handle_command_reply: tid=0 2024-08-31T06:09:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1abcccf740 1 client.26506 shutdown 2024-08-31T06:09:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1abcccf740 1 -- 172.21.15.53:0/1201416821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 msgr2=0x563eab33fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1abcccf740 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 0x563eab33fa80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a980057c0 tx=0x7f1a98000bc0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1abcccf740 1 -- 172.21.15.53:0/1201416821 shutdown_connections 2024-08-31T06:09:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1abcccf740 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563eaaf4d9f0 0x563eab351bd0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1abcccf740 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab34bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1abcccf740 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf6e390 0x563eab33ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1a8f7fe640 0 client.26506 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1abcccf740 1 --2- 172.21.15.53:0/1201416821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf661b0 0x563eab33fa80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.936+0000 7f1abcccf740 1 -- 172.21.15.53:0/1201416821 >> 172.21.15.53:0/1201416821 conn(0x563eaaf83460 msgr2=0x563eab3374a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:20.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.937+0000 7f1abcccf740 1 -- 172.21.15.53:0/1201416821 shutdown_connections 2024-08-31T06:09:20.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.937+0000 7f1abcccf740 1 -- 172.21.15.53:0/1201416821 wait complete. 2024-08-31T06:09:20.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.937+0000 7f1abcccf740 20 client.26506 trim_cache size 0 max 16384 2024-08-31T06:09:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.957+0000 7f1abcccf740 1 Processor -- start 2024-08-31T06:09:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.957+0000 7f1abcccf740 1 -- start start 2024-08-31T06:09:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf661b0 0x563eab341960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf6e390 0x563eab335a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab34bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1abcccf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab01ad260 con 0x563eaaf661b0 2024-08-31T06:09:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1abcccf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab01aee60 con 0x563eaaf8f070 2024-08-31T06:09:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1abcccf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab01ad930 con 0x563eaaf6e390 2024-08-31T06:09:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf661b0 0x563eab341960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf661b0 0x563eab341960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35866/0 (socket says 172.21.15.53:35866) 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1aa7fff640 1 -- 172.21.15.53:0/3840039497 learned_addr learned my addr 172.21.15.53:0/3840039497 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1aaffff640 1 --2- 172.21.15.53:0/3840039497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf6e390 0x563eab335a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/3840039497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab34bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1aa7fff640 1 -- 172.21.15.53:0/3840039497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf6e390 msgr2=0x563eab335a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/3840039497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf6e390 0x563eab335a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1aa7fff640 1 -- 172.21.15.53:0/3840039497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 msgr2=0x563eab34bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/3840039497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab34bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1aa7fff640 1 -- 172.21.15.53:0/3840039497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eab337120 con 0x563eaaf661b0 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.958+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/3840039497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf661b0 0x563eab341960 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f1a98005f70 tx=0x7f1a98009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28785daa4ab9bdf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.959+0000 7f1aa5ffb640 1 -- 172.21.15.53:0/3840039497 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98035040 con 0x563eaaf661b0 2024-08-31T06:09:20.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.959+0000 7f1aa5ffb640 1 -- 172.21.15.53:0/3840039497 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a9804f070 con 0x563eaaf661b0 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.959+0000 7f1aa5ffb640 1 -- 172.21.15.53:0/3840039497 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9804f220 con 0x563eaaf661b0 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.960+0000 7f1abcccf740 1 -- 172.21.15.53:0/3840039497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf661b0 msgr2=0x563eab341960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.960+0000 7f1abcccf740 1 --2- 172.21.15.53:0/3840039497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf661b0 0x563eab341960 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f1a98005f70 tx=0x7f1a98009520 comp rx=0 tx=0).stop 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.960+0000 7f1abcccf740 1 -- 172.21.15.53:0/3840039497 shutdown_connections 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.960+0000 7f1abcccf740 1 --2- 172.21.15.53:0/3840039497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf8f070 0x563eab34bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.960+0000 7f1abcccf740 1 --2- 172.21.15.53:0/3840039497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf6e390 0x563eab335a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.960+0000 7f1abcccf740 1 --2- 172.21.15.53:0/3840039497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf661b0 0x563eab341960 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.960+0000 7f1abcccf740 1 -- 172.21.15.53:0/3840039497 >> 172.21.15.53:0/3840039497 conn(0x563eaaf83460 msgr2=0x563eab3352f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.960+0000 7f1abcccf740 1 -- 172.21.15.53:0/3840039497 shutdown_connections 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.960+0000 7f1abcccf740 1 -- 172.21.15.53:0/3840039497 wait complete. 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.960+0000 7f1abcccf740 1 -- start start 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.960+0000 7f1abcccf740 1 Processor -- start 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf661b0 0x563eab3b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf6e390 0x563eab3b0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1abcccf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf8f070 0x563eab3bb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1abcccf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab01ae730 con 0x563eaaf8f070 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1abcccf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab01ae000 con 0x563eaaf661b0 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1abcccf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab01ab240 con 0x563eaaf6e390 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1abcccf740 10 client.0 _ll_register_callbacks cb 0x7f1aa00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf8f070 0x563eab3bb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1aa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf8f070 0x563eab3bb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35876/0 (socket says 172.21.15.53:35876) 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1aa7fff640 1 -- 172.21.15.53:0/2754476728 learned_addr learned my addr 172.21.15.53:0/2754476728 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf661b0 0x563eab3b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1aaffff640 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf6e390 0x563eab3b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1aa7fff640 1 -- 172.21.15.53:0/2754476728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf6e390 msgr2=0x563eab3b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf6e390 0x563eab3b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1aa7fff640 1 -- 172.21.15.53:0/2754476728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf661b0 msgr2=0x563eab3b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf661b0 0x563eab3b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.961+0000 7f1aa7fff640 1 -- 172.21.15.53:0/2754476728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eab3bb8a0 con 0x563eaaf8f070 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.962+0000 7f1aa7fff640 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf8f070 0x563eab3bb360 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1a98064d60 tx=0x7f1a980649c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64c5e4c06579246 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.962+0000 7f1a8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.962+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/2754476728 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98035040 con 0x563eaaf8f070 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.962+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/2754476728 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1a9805b8e0 con 0x563eaaf8f070 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.962+0000 7f1abcccf740 1 -- 172.21.15.53:0/2754476728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a9804f070 con 0x563eaaf8f070 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.962+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/2754476728 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1a9804f430 con 0x563eaaf8f070 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.962+0000 7f1abcccf740 10 client.17151 fetch_fsmap learned FSMap version 33 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.962+0000 7f1abcccf740 1 -- 172.21.15.53:0/2754476728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563eab3bb8a0 con 0x563eaaf8f070 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.962+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/2754476728 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a9805bae0 con 0x563eaaf8f070 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.962+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/2754476728 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f1a9803daf0 con 0x563eaaf8f070 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.963+0000 7f1abcccf740 10 client.17151 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T06:09:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.963+0000 7f1abcccf740 10 client.17151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.963+0000 7f1abcccf740 20 client.17151 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.963+0000 7f1abcccf740 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563eaaf22da0 0x563eab3beca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.963+0000 7f1abcccf740 4 client.17151 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:09:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.963+0000 7f1abcccf740 1 -- 172.21.15.53:0/2754476728 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1a9804f070 con 0x563eaaf22da0 2024-08-31T06:09:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.963+0000 7f1aaffff640 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563eaaf22da0 0x563eab3beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.963+0000 7f1a8f7fe640 10 client.17151 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.963+0000 7f1aaffff640 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563eaaf22da0 0x563eab3beca0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b13468d20acc85a9 server_cookie=64fd1ca936d673af in_seq=0 out_seq=0 2024-08-31T06:09:20.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.963+0000 7f1a8f7fe640 1 -- 172.21.15.53:0/2754476728 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x7f1a9804f070 con 0x563eaaf22da0 2024-08-31T06:09:20.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1a8f7fe640 10 client.17151 handle_command_reply: tid=0 2024-08-31T06:09:20.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 1 client.17151 shutdown 2024-08-31T06:09:20.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 1 -- 172.21.15.53:0/2754476728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf8f070 msgr2=0x563eab3bb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:20.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf8f070 0x563eab3bb360 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1a98064d60 tx=0x7f1a980649c0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 1 -- 172.21.15.53:0/2754476728 shutdown_connections 2024-08-31T06:09:20.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563eaaf22da0 0x563eab3beca0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563eaaf8f070 0x563eab3bb360 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563eaaf6e390 0x563eab3b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 1 --2- 172.21.15.53:0/2754476728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563eaaf661b0 0x563eab3b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1a8f7fe640 0 client.17151 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:20.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 1 -- 172.21.15.53:0/2754476728 >> 172.21.15.53:0/2754476728 conn(0x563eaaf83460 msgr2=0x563eab341700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:20.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 1 -- 172.21.15.53:0/2754476728 shutdown_connections 2024-08-31T06:09:20.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 1 -- 172.21.15.53:0/2754476728 wait complete. 2024-08-31T06:09:20.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.964+0000 7f1abcccf740 20 client.17151 trim_cache size 0 max 16384 2024-08-31T06:09:20.972 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:09:20.973 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:09:20.973 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:09:20.973 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:09:20.973 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:20.973 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "d594849b-7418-4d8f-b5b0-5c03697b954c", 2024-08-31T06:09:20.973 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:09:20.973 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:09:20.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:20.973 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:09:20.973 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:20.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:09:20.975 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:20.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:09:20.977 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:09:20.978 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:20.978 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:20.978 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:20.978 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:20.978 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:20.978 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:09:20.978 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:09:20.978 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:09:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 -- 172.21.15.53:0/2244978920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a9c0b4cd0 msgr2=0x7f1a9c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a9c0b4cd0 0x7f1a9c0b71e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800dfd0 tx=0x7f1aa800b910 comp rx=0 tx=0).stop 2024-08-31T06:09:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 -- 172.21.15.53:0/2244978920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ab0108a90 msgr2=0x7f1ab019bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ab0108a90 0x7f1ab019bb70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009fd0 tx=0x7f1aa800b260 comp rx=0 tx=0).stop 2024-08-31T06:09:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 -- 172.21.15.53:0/2244978920 shutdown_connections 2024-08-31T06:09:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a9c0b4cd0 0x7f1a9c0b71e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ab0108a90 0x7f1ab019bb70 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab0108140 0x7f1ab019b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 --2- 172.21.15.53:0/2244978920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ab0102800 0x7f1ab019b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:20.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 -- 172.21.15.53:0/2244978920 >> 172.21.15.53:0/2244978920 conn(0x7f1ab00794d0 msgr2=0x7f1ab01051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:20.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 -- 172.21.15.53:0/2244978920 shutdown_connections 2024-08-31T06:09:20.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:20.965+0000 7f1ab675a640 1 -- 172.21.15.53:0/2244978920 wait complete. 2024-08-31T06:09:20.980 INFO:tasks.workunit.client.0.smithi053.stdout: 1 74328 1.68 MB/sec execute 70 sec latency 15.344 ms 2024-08-31T06:09:21.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:20 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:09:21.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:20 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:21.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:20 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:09:21.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:20 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:21.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:20 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:09:21.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:20 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:09:21.686 INFO:tasks.cephfs.filesystem:scrub status for tag:d594849b-7418-4d8f-b5b0-5c03697b954c - {'path': '/', 'tag': 'd594849b-7418-4d8f-b5b0-5c03697b954c', 'options': 'recursive,force'} 2024-08-31T06:09:21.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 74806 1.71 MB/sec execute 71 sec latency 15.712 ms 2024-08-31T06:09:22.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:21 smithi053 ceph-mon[18924]: pgmap v455: 97 pgs: 97 active+clean; 53 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 1.6 MiB/s wr, 188 op/s 2024-08-31T06:09:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.340+0000 7f857231a640 1 -- 172.21.15.53:0/4271104051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c1080d0 msgr2=0x7f856c1084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.340+0000 7f857231a640 1 --2- 172.21.15.53:0/4271104051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c1080d0 0x7f856c1084e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8560009900 tx=0x7f856002a410 comp rx=0 tx=0).stop 2024-08-31T06:09:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.341+0000 7f857231a640 1 -- 172.21.15.53:0/4271104051 shutdown_connections 2024-08-31T06:09:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.341+0000 7f857231a640 1 --2- 172.21.15.53:0/4271104051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f856c108a20 0x7f856c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.341+0000 7f857231a640 1 --2- 172.21.15.53:0/4271104051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c1080d0 0x7f856c1084e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.341+0000 7f857231a640 1 --2- 172.21.15.53:0/4271104051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c102f10 0x7f856c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.341+0000 7f857231a640 1 -- 172.21.15.53:0/4271104051 >> 172.21.15.53:0/4271104051 conn(0x7f856c079c30 msgr2=0x7f856c07a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.341+0000 7f857231a640 1 -- 172.21.15.53:0/4271104051 shutdown_connections 2024-08-31T06:09:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.341+0000 7f857231a640 1 -- 172.21.15.53:0/4271104051 wait complete. 2024-08-31T06:09:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.341+0000 7f857231a640 1 Processor -- start 2024-08-31T06:09:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.341+0000 7f857231a640 1 -- start start 2024-08-31T06:09:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f857231a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c102f10 0x7f856c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f857231a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f856c1080d0 0x7f856c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f857231a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c108a20 0x7f856c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f857231a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f856c112560 con 0x7f856c108a20 2024-08-31T06:09:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f857231a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1123e0 con 0x7f856c1080d0 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f857231a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1126e0 con 0x7f856c102f10 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f85708b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c108a20 0x7f856c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f856c1080d0 0x7f856c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f85708b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c108a20 0x7f856c199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35900/0 (socket says 172.21.15.53:35900) 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f85708b7640 1 -- 172.21.15.53:0/537486814 learned_addr learned my addr 172.21.15.53:0/537486814 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f856bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c102f10 0x7f856c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f85708b7640 1 -- 172.21.15.53:0/537486814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c102f10 msgr2=0x7f856c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f85708b7640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c102f10 0x7f856c198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f85708b7640 1 -- 172.21.15.53:0/537486814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f856c1080d0 msgr2=0x7f856c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f85708b7640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f856c1080d0 0x7f856c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f85708b7640 1 -- 172.21.15.53:0/537486814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c1a8430 con 0x7f856c108a20 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.342+0000 7f856bfff640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c102f10 0x7f856c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.343+0000 7f85708b7640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c108a20 0x7f856c199800 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f856400eb10 tx=0x7f856400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.343+0000 7f85697fa640 1 -- 172.21.15.53:0/537486814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8564004b20 con 0x7f856c108a20 2024-08-31T06:09:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.343+0000 7f857231a640 1 -- 172.21.15.53:0/537486814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856c1a8720 con 0x7f856c108a20 2024-08-31T06:09:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.343+0000 7f85697fa640 1 -- 172.21.15.53:0/537486814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8564004cc0 con 0x7f856c108a20 2024-08-31T06:09:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.343+0000 7f85697fa640 1 -- 172.21.15.53:0/537486814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8564010690 con 0x7f856c108a20 2024-08-31T06:09:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.343+0000 7f857231a640 1 -- 172.21.15.53:0/537486814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856c1a8bf0 con 0x7f856c108a20 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.345+0000 7f857927e740 1 Processor -- start 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.345+0000 7f85697fa640 1 -- 172.21.15.53:0/537486814 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8564010940 con 0x7f856c108a20 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f857927e740 1 -- start start 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f857927e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 0x563f153c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f857927e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f857927e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14fff4d0 0x563f153c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f857927e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563f15339000 con 0x563f14fff4d0 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f857927e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563f15328590 con 0x563f14ff72f0 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f857927e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563f1532c540 con 0x563f150201b0 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f856bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14fff4d0 0x563f153c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f856bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60970/0 (socket says 172.21.15.53:60970) 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 0x563f153c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f856bfff640 1 -- 172.21.15.53:0/1260547853 learned_addr learned my addr 172.21.15.53:0/1260547853 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f856bfff640 1 -- 172.21.15.53:0/1260547853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 msgr2=0x563f153c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f856bfff640 1 --2- 172.21.15.53:0/1260547853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 0x563f153c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f85697fa640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85540b4ca0 0x7f85540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f856bfff640 1 -- 172.21.15.53:0/1260547853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14fff4d0 msgr2=0x563f153c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f856bfff640 1 --2- 172.21.15.53:0/1260547853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14fff4d0 0x563f153c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f856bfff640 1 -- 172.21.15.53:0/1260547853 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f1508b790 con 0x563f14ff72f0 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f856b7fe640 1 --2- 172.21.15.53:0/1260547853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 0x563f153c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.346+0000 7f85708b7640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85540b4ca0 0x7f85540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.347+0000 7f856bfff640 1 --2- 172.21.15.53:0/1260547853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153c4000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f855c011520 tx=0x7f855c0119e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ce85c8fc28ade1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.347+0000 7f85697fa640 1 -- 172.21.15.53:0/537486814 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f85640e5b80 con 0x7f856c108a20 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.347+0000 7f85527fc640 1 -- 172.21.15.53:0/1260547853 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c011250 con 0x563f14ff72f0 2024-08-31T06:09:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.347+0000 7f85527fc640 1 -- 172.21.15.53:0/1260547853 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f855c0035f0 con 0x563f14ff72f0 2024-08-31T06:09:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.347+0000 7f85527fc640 1 -- 172.21.15.53:0/1260547853 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c00f800 con 0x563f14ff72f0 2024-08-31T06:09:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.348+0000 7f857927e740 1 -- 172.21.15.53:0/1260547853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 msgr2=0x563f153c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.348+0000 7f85708b7640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85540b4ca0 0x7f85540b71b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f85640ac200 tx=0x7f85640a89b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.348+0000 7f857927e740 1 --2- 172.21.15.53:0/1260547853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153c4000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f855c011520 tx=0x7f855c0119e0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.348+0000 7f857927e740 1 -- 172.21.15.53:0/1260547853 shutdown_connections 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.348+0000 7f857927e740 1 --2- 172.21.15.53:0/1260547853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14fff4d0 0x563f153c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.348+0000 7f857927e740 1 --2- 172.21.15.53:0/1260547853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153c4000 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.348+0000 7f857927e740 1 --2- 172.21.15.53:0/1260547853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 0x563f153c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.348+0000 7f857927e740 1 -- 172.21.15.53:0/1260547853 >> 172.21.15.53:0/1260547853 conn(0x563f15014300 msgr2=0x563f153c19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.348+0000 7f857927e740 1 -- 172.21.15.53:0/1260547853 shutdown_connections 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.348+0000 7f857927e740 1 -- 172.21.15.53:0/1260547853 wait complete. 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.348+0000 7f857927e740 1 -- start start 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f857927e740 1 Processor -- start 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f857927e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f857927e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14fff4d0 0x563f153cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f857927e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 0x563f153db530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f857927e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563f15261ab0 con 0x563f14fff4d0 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f857927e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563f152af680 con 0x563f14ff72f0 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f857927e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563f153d2240 con 0x563f150201b0 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f857927e740 10 client.0 _ll_register_callbacks cb 0x563f15037a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f856bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14fff4d0 0x563f153cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f856bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14fff4d0 0x563f153cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35924/0 (socket says 172.21.15.53:35924) 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f856bfff640 1 -- 172.21.15.53:0/112247175 learned_addr learned my addr 172.21.15.53:0/112247175 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f856b7fe640 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 0x563f153db530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.349+0000 7f856b7fe640 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f856b7fe640 1 -- 172.21.15.53:0/112247175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 msgr2=0x563f153cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f856b7fe640 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f856b7fe640 1 -- 172.21.15.53:0/112247175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14fff4d0 msgr2=0x563f153cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f856b7fe640 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14fff4d0 0x563f153cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f856b7fe640 1 -- 172.21.15.53:0/112247175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f15104620 con 0x563f150201b0 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f856b7fe640 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 0x563f153db530 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f856002a930 tx=0x7f856002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a43c8b7e74edbd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f854b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f854b7fe640 1 -- 172.21.15.53:0/112247175 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560035030 con 0x563f150201b0 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f854b7fe640 1 -- 172.21.15.53:0/112247175 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f8560031610 con 0x563f150201b0 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f857927e740 1 -- 172.21.15.53:0/112247175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f855c0035f0 con 0x563f150201b0 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f854b7fe640 1 -- 172.21.15.53:0/112247175 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8560031810 con 0x563f150201b0 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f857927e740 10 client.26524 fetch_fsmap learned FSMap version 33 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.350+0000 7f857927e740 1 -- 172.21.15.53:0/112247175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563f153de300 con 0x563f150201b0 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.351+0000 7f854b7fe640 1 -- 172.21.15.53:0/112247175 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f855c0035f0 con 0x563f150201b0 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.351+0000 7f854b7fe640 1 -- 172.21.15.53:0/112247175 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f8560003af0 con 0x563f150201b0 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.351+0000 7f857927e740 10 client.26524 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.351+0000 7f857927e740 10 client.26524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.351+0000 7f857927e740 20 client.26524 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.351+0000 7f857927e740 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563f14fded80 0x563f153e1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.351+0000 7f857927e740 4 client.26524 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.351+0000 7f857927e740 1 -- 172.21.15.53:0/112247175 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f1533af50 con 0x563f14fded80 2024-08-31T06:09:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.351+0000 7f856bfff640 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563f14fded80 0x563f153e1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.351+0000 7f856bfff640 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563f14fded80 0x563f153e1780 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=242e2990949d9dae server_cookie=c4b7c718e80470da in_seq=0 out_seq=0 2024-08-31T06:09:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.351+0000 7f854b7fe640 10 client.26524 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f854b7fe640 1 -- 172.21.15.53:0/112247175 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f1533af50 con 0x563f14fded80 2024-08-31T06:09:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f854b7fe640 10 client.26524 handle_command_reply: tid=0 2024-08-31T06:09:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f857927e740 1 client.26524 shutdown 2024-08-31T06:09:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f857927e740 1 -- 172.21.15.53:0/112247175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 msgr2=0x563f153db530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f857927e740 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 0x563f153db530 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f856002a930 tx=0x7f856002a410 comp rx=0 tx=0).stop 2024-08-31T06:09:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f857927e740 1 -- 172.21.15.53:0/112247175 shutdown_connections 2024-08-31T06:09:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f857927e740 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563f14fded80 0x563f153e1780 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f857927e740 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f150201b0 0x563f153db530 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f857927e740 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14fff4d0 0x563f153cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f857927e740 1 --2- 172.21.15.53:0/112247175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f854b7fe640 0 client.26524 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f857927e740 1 -- 172.21.15.53:0/112247175 >> 172.21.15.53:0/112247175 conn(0x563f15014300 msgr2=0x563f153c4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f857927e740 1 -- 172.21.15.53:0/112247175 shutdown_connections 2024-08-31T06:09:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.352+0000 7f857927e740 1 -- 172.21.15.53:0/112247175 wait complete. 2024-08-31T06:09:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.353+0000 7f857927e740 20 client.26524 trim_cache size 0 max 16384 2024-08-31T06:09:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.368+0000 7f857927e740 1 Processor -- start 2024-08-31T06:09:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.368+0000 7f857927e740 1 -- start start 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f857927e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f857927e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 0x563f153ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f857927e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f150201b0 0x563f153c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f857927e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1b15f0 con 0x563f150201b0 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f857927e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1b31f0 con 0x563f14ff72f0 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f857927e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1b1cc0 con 0x563f14fff4d0 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f856bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 0x563f153ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f150201b0 0x563f153c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f856bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 0x563f153ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37666/0 (socket says 172.21.15.53:37666) 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f856bfff640 1 -- 172.21.15.53:0/1153553429 learned_addr learned my addr 172.21.15.53:0/1153553429 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f856bfff640 1 -- 172.21.15.53:0/1153553429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 msgr2=0x563f153ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f856bfff640 1 --2- 172.21.15.53:0/1153553429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f856bfff640 1 -- 172.21.15.53:0/1153553429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f150201b0 msgr2=0x563f153c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f856bfff640 1 --2- 172.21.15.53:0/1153553429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f150201b0 0x563f153c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f856bfff640 1 -- 172.21.15.53:0/1153553429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f153c22b0 con 0x563f14fff4d0 2024-08-31T06:09:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.369+0000 7f856bfff640 1 --2- 172.21.15.53:0/1153553429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 0x563f153ceec0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f855c009250 tx=0x7f855c011f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ecb69c13dec60bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f8551ffb640 1 -- 172.21.15.53:0/1153553429 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c005270 con 0x563f14fff4d0 2024-08-31T06:09:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f8551ffb640 1 -- 172.21.15.53:0/1153553429 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f855c003a80 con 0x563f14fff4d0 2024-08-31T06:09:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f8551ffb640 1 -- 172.21.15.53:0/1153553429 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c00f840 con 0x563f14fff4d0 2024-08-31T06:09:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f857927e740 1 -- 172.21.15.53:0/1153553429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 msgr2=0x563f153ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f857927e740 1 --2- 172.21.15.53:0/1153553429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 0x563f153ceec0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f855c009250 tx=0x7f855c011f90 comp rx=0 tx=0).stop 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f857927e740 1 -- 172.21.15.53:0/1153553429 shutdown_connections 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f857927e740 1 --2- 172.21.15.53:0/1153553429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f150201b0 0x563f153c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f857927e740 1 --2- 172.21.15.53:0/1153553429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 0x563f153ceec0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f857927e740 1 --2- 172.21.15.53:0/1153553429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f14ff72f0 0x563f153ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f857927e740 1 -- 172.21.15.53:0/1153553429 >> 172.21.15.53:0/1153553429 conn(0x563f15014300 msgr2=0x563f153cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f857927e740 1 -- 172.21.15.53:0/1153553429 shutdown_connections 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.370+0000 7f857927e740 1 -- 172.21.15.53:0/1153553429 wait complete. 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.371+0000 7f857927e740 1 -- start start 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.371+0000 7f857927e740 1 Processor -- start 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.371+0000 7f857927e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14ff72f0 0x563f153d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.371+0000 7f857927e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 0x563f153d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.371+0000 7f857927e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f150201b0 0x563f1544b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.371+0000 7f857927e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1b2ac0 con 0x563f14ff72f0 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.371+0000 7f857927e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1b2390 con 0x563f150201b0 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.371+0000 7f857927e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1af5d0 con 0x563f14fff4d0 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.371+0000 7f857927e740 10 client.0 _ll_register_callbacks cb 0x7f8560005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.371+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14ff72f0 0x563f153d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.371+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14ff72f0 0x563f153d36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35934/0 (socket says 172.21.15.53:35934) 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f856b7fe640 1 -- 172.21.15.53:0/1215177679 learned_addr learned my addr 172.21.15.53:0/1215177679 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f856bfff640 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 0x563f153d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f856b7fe640 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f150201b0 0x563f1544b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f856b7fe640 1 -- 172.21.15.53:0/1215177679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 msgr2=0x563f153d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f856b7fe640 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 0x563f153d3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f856b7fe640 1 -- 172.21.15.53:0/1215177679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f150201b0 msgr2=0x563f1544b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f856b7fe640 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f150201b0 0x563f1544b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f856b7fe640 1 -- 172.21.15.53:0/1215177679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f153d4430 con 0x563f14ff72f0 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f856b7fe640 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14ff72f0 0x563f153d36e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8560009340 tx=0x7f8560005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3ffed51fe95502 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f854b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f854b7fe640 1 -- 172.21.15.53:0/1215177679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560035070 con 0x563f14ff72f0 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f854b7fe640 1 -- 172.21.15.53:0/1215177679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f8560032900 con 0x563f14ff72f0 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f857927e740 1 -- 172.21.15.53:0/1215177679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f855c003a80 con 0x563f14ff72f0 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f854b7fe640 1 -- 172.21.15.53:0/1215177679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f856006a050 con 0x563f14ff72f0 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f857927e740 10 client.17169 fetch_fsmap learned FSMap version 33 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.372+0000 7f857927e740 1 -- 172.21.15.53:0/1215177679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563f1544c600 con 0x563f14ff72f0 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.373+0000 7f854b7fe640 1 -- 172.21.15.53:0/1215177679 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f855c003a80 con 0x563f14ff72f0 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.373+0000 7f854b7fe640 1 -- 172.21.15.53:0/1215177679 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f8560061070 con 0x563f14ff72f0 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.373+0000 7f857927e740 10 client.17169 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.373+0000 7f857927e740 10 client.17169 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.373+0000 7f857927e740 20 client.17169 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.373+0000 7f857927e740 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563f14fb41c0 0x563f1544ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.373+0000 7f857927e740 4 client.17169 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:09:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.373+0000 7f857927e740 1 -- 172.21.15.53:0/1215177679 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563f153369f0 con 0x563f14fb41c0 2024-08-31T06:09:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.373+0000 7f856bfff640 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563f14fb41c0 0x563f1544ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.374+0000 7f854b7fe640 10 client.17169 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.374+0000 7f856bfff640 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563f14fb41c0 0x563f1544ed40 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d56d28048d2b585 server_cookie=e9493e806a2b9413 in_seq=0 out_seq=0 2024-08-31T06:09:22.381 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:21 smithi130 ceph-mon[22266]: pgmap v455: 97 pgs: 97 active+clean; 53 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 1.6 MiB/s wr, 188 op/s 2024-08-31T06:09:22.395 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.391+0000 7f854b7fe640 1 -- 172.21.15.53:0/1215177679 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563f153369f0 con 0x563f14fb41c0 2024-08-31T06:09:22.395 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.391+0000 7f854b7fe640 10 client.17169 handle_command_reply: tid=0 2024-08-31T06:09:22.395 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.391+0000 7f857927e740 1 client.17169 shutdown 2024-08-31T06:09:22.395 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f857927e740 1 -- 172.21.15.53:0/1215177679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14ff72f0 msgr2=0x563f153d36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:22.395 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f857927e740 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14ff72f0 0x563f153d36e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f8560009340 tx=0x7f8560005fd0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.395 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f857927e740 1 -- 172.21.15.53:0/1215177679 shutdown_connections 2024-08-31T06:09:22.395 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f857927e740 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563f14fb41c0 0x563f1544ed40 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.395 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f857927e740 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f150201b0 0x563f1544b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.395 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f857927e740 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563f14fff4d0 0x563f153d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f854b7fe640 0 client.17169 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f857927e740 1 --2- 172.21.15.53:0/1215177679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f14ff72f0 0x563f153d36e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f857927e740 1 -- 172.21.15.53:0/1215177679 >> 172.21.15.53:0/1215177679 conn(0x563f15014300 msgr2=0x563f153c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f857927e740 1 -- 172.21.15.53:0/1215177679 shutdown_connections 2024-08-31T06:09:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f857927e740 1 -- 172.21.15.53:0/1215177679 wait complete. 2024-08-31T06:09:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.392+0000 7f857927e740 20 client.17169 trim_cache size 0 max 16384 2024-08-31T06:09:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:09:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:09:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:09:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:09:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 -- 172.21.15.53:0/537486814 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85540b4ca0 msgr2=0x7f85540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85540b4ca0 0x7f85540b71b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f85640ac200 tx=0x7f85640a89b0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 -- 172.21.15.53:0/537486814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c108a20 msgr2=0x7f856c199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c108a20 0x7f856c199800 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f856400eb10 tx=0x7f856400c2d0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 -- 172.21.15.53:0/537486814 shutdown_connections 2024-08-31T06:09:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f85540b4ca0 0x7f85540b71b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c108a20 0x7f856c199800 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f856c1080d0 0x7f856c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 --2- 172.21.15.53:0/537486814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856c102f10 0x7f856c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 -- 172.21.15.53:0/537486814 >> 172.21.15.53:0/537486814 conn(0x7f856c079c30 msgr2=0x7f856c106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 -- 172.21.15.53:0/537486814 shutdown_connections 2024-08-31T06:09:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:22.393+0000 7f857231a640 1 -- 172.21.15.53:0/537486814 wait complete. 2024-08-31T06:09:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:21 smithi153 ceph-mon[22320]: pgmap v455: 97 pgs: 97 active+clean; 53 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 1.6 MiB/s wr, 188 op/s 2024-08-31T06:09:22.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 75030 1.69 MB/sec execute 72 sec latency 89.862 ms 2024-08-31T06:09:23.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 75456 1.68 MB/sec execute 73 sec latency 56.750 ms 2024-08-31T06:09:24.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:23 smithi053 ceph-mon[18924]: pgmap v456: 97 pgs: 97 active+clean; 52 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-08-31T06:09:24.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:23 smithi130 ceph-mon[22266]: pgmap v456: 97 pgs: 97 active+clean; 52 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-08-31T06:09:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:23 smithi153 ceph-mon[22320]: pgmap v456: 97 pgs: 97 active+clean; 52 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-08-31T06:09:24.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 75991 1.72 MB/sec execute 74 sec latency 34.727 ms 2024-08-31T06:09:25.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 76599 1.70 MB/sec execute 75 sec latency 14.854 ms 2024-08-31T06:09:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:25 smithi053 ceph-mon[18924]: pgmap v457: 97 pgs: 97 active+clean; 52 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-08-31T06:09:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:25 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:09:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:25 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:09:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:25 smithi130 ceph-mon[22266]: pgmap v457: 97 pgs: 97 active+clean; 52 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-08-31T06:09:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:25 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:09:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:25 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:09:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:25 smithi153 ceph-mon[22320]: pgmap v457: 97 pgs: 97 active+clean; 52 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-08-31T06:09:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:25 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:09:26.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:25 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:09:26.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 77103 1.71 MB/sec execute 76 sec latency 16.085 ms 2024-08-31T06:09:27.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:26 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:09:27.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:26 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:09:27.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:26 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:27.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:26 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:09:27.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:26 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:09:27.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:26 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:27.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:26 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:09:27.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:26 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:09:27.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:26 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:09:27.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 77828 1.77 MB/sec execute 77 sec latency 15.453 ms 2024-08-31T06:09:28.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:27 smithi053 ceph-mon[18924]: pgmap v458: 97 pgs: 97 active+clean; 52 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.5 MiB/s wr, 168 op/s 2024-08-31T06:09:28.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:27 smithi130 ceph-mon[22266]: pgmap v458: 97 pgs: 97 active+clean; 52 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.5 MiB/s wr, 168 op/s 2024-08-31T06:09:28.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:27 smithi153 ceph-mon[22320]: pgmap v458: 97 pgs: 97 active+clean; 52 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.5 MiB/s wr, 168 op/s 2024-08-31T06:09:28.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 78203 1.79 MB/sec execute 78 sec latency 15.577 ms 2024-08-31T06:09:29.967 INFO:tasks.workunit.client.0.smithi053.stdout: 1 78497 1.79 MB/sec execute 79 sec latency 14.814 ms 2024-08-31T06:09:30.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:29 smithi053 ceph-mon[18924]: pgmap v459: 97 pgs: 97 active+clean; 51 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-08-31T06:09:30.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:29 smithi130 ceph-mon[22266]: pgmap v459: 97 pgs: 97 active+clean; 51 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-08-31T06:09:30.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:29 smithi153 ceph-mon[22320]: pgmap v459: 97 pgs: 97 active+clean; 51 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-08-31T06:09:30.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 78842 1.77 MB/sec execute 80 sec latency 15.271 ms 2024-08-31T06:09:31.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 79304 1.77 MB/sec execute 81 sec latency 45.378 ms 2024-08-31T06:09:32.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:31 smithi053 ceph-mon[18924]: pgmap v460: 97 pgs: 97 active+clean; 53 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.6 MiB/s wr, 191 op/s 2024-08-31T06:09:32.226 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:31 smithi153 ceph-mon[22320]: pgmap v460: 97 pgs: 97 active+clean; 53 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.6 MiB/s wr, 191 op/s 2024-08-31T06:09:32.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:31 smithi130 ceph-mon[22266]: pgmap v460: 97 pgs: 97 active+clean; 53 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.6 MiB/s wr, 191 op/s 2024-08-31T06:09:32.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 79919 1.79 MB/sec execute 82 sec latency 14.747 ms 2024-08-31T06:09:33.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 80498 1.79 MB/sec execute 83 sec latency 15.203 ms 2024-08-31T06:09:34.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:33 smithi053 ceph-mon[18924]: pgmap v461: 97 pgs: 97 active+clean; 54 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-08-31T06:09:34.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:33 smithi130 ceph-mon[22266]: pgmap v461: 97 pgs: 97 active+clean; 54 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-08-31T06:09:34.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:33 smithi153 ceph-mon[22320]: pgmap v461: 97 pgs: 97 active+clean; 54 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-08-31T06:09:34.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 81114 1.83 MB/sec execute 84 sec latency 12.248 ms 2024-08-31T06:09:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.504+0000 7fdbffbf8640 1 -- 172.21.15.53:0/1710054181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbf8104580 msgr2=0x7fdbf8104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.504+0000 7fdbffbf8640 1 --2- 172.21.15.53:0/1710054181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbf8104580 0x7fdbf8104990 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009900 tx=0x7fdbf402a410 comp rx=0 tx=0).stop 2024-08-31T06:09:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.504+0000 7fdbffbf8640 1 -- 172.21.15.53:0/1710054181 shutdown_connections 2024-08-31T06:09:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.504+0000 7fdbffbf8640 1 --2- 172.21.15.53:0/1710054181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbf810db30 0x7fdbf8110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.504+0000 7fdbffbf8640 1 --2- 172.21.15.53:0/1710054181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf8104f60 0x7fdbf810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.504+0000 7fdbffbf8640 1 --2- 172.21.15.53:0/1710054181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbf8104580 0x7fdbf8104990 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.504+0000 7fdbffbf8640 1 -- 172.21.15.53:0/1710054181 >> 172.21.15.53:0/1710054181 conn(0x7fdbf807a4e0 msgr2=0x7fdbf807a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.504+0000 7fdbffbf8640 1 -- 172.21.15.53:0/1710054181 shutdown_connections 2024-08-31T06:09:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.504+0000 7fdbffbf8640 1 -- 172.21.15.53:0/1710054181 wait complete. 2024-08-31T06:09:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.505+0000 7fdbffbf8640 1 Processor -- start 2024-08-31T06:09:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.505+0000 7fdbffbf8640 1 -- start start 2024-08-31T06:09:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.505+0000 7fdbffbf8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbf8104580 0x7fdbf819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.505+0000 7fdbffbf8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf8104f60 0x7fdbf819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.505+0000 7fdbffbf8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbf810db30 0x7fdbf819f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.505+0000 7fdbffbf8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf8113650 con 0x7fdbf8104580 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.505+0000 7fdbffbf8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81134d0 con 0x7fdbf810db30 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.505+0000 7fdbffbf8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81137d0 con 0x7fdbf8104f60 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbfd994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbf8104580 0x7fdbf819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbfd994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbf8104580 0x7fdbf819a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38636/0 (socket says 172.21.15.53:38636) 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbfd994640 1 -- 172.21.15.53:0/249605071 learned_addr learned my addr 172.21.15.53:0/249605071 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbfd193640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf8104f60 0x7fdbf819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbfe195640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbf810db30 0x7fdbf819f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbfd994640 1 -- 172.21.15.53:0/249605071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf8104f60 msgr2=0x7fdbf819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbfd994640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf8104f60 0x7fdbf819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbfd994640 1 -- 172.21.15.53:0/249605071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbf810db30 msgr2=0x7fdbf819f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbfd994640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbf810db30 0x7fdbf819f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbfd994640 1 -- 172.21.15.53:0/249605071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf81a0060 con 0x7fdbf8104580 2024-08-31T06:09:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbfd994640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbf8104580 0x7fdbf819a130 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009230 tx=0x7fdbf4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbeeffd640 1 -- 172.21.15.53:0/249605071 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf403f030 con 0x7fdbf8104580 2024-08-31T06:09:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbeeffd640 1 -- 172.21.15.53:0/249605071 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbf4003a80 con 0x7fdbf8104580 2024-08-31T06:09:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbffbf8640 1 -- 172.21.15.53:0/249605071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf81a02f0 con 0x7fdbf8104580 2024-08-31T06:09:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbeeffd640 1 -- 172.21.15.53:0/249605071 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4035070 con 0x7fdbf8104580 2024-08-31T06:09:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.506+0000 7fdbffbf8640 1 -- 172.21.15.53:0/249605071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf81a6ae0 con 0x7fdbf8104580 2024-08-31T06:09:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.509+0000 7fdc06c38740 1 Processor -- start 2024-08-31T06:09:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdc06c38740 1 -- start start 2024-08-31T06:09:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbeeffd640 1 -- 172.21.15.53:0/249605071 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdbf4042030 con 0x7fdbf8104580 2024-08-31T06:09:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 0x55fe36e01ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e02000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e02540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdc06c38740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fe36d77000 con 0x55fe36a5e1b0 2024-08-31T06:09:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdc06c38740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fe36d66590 con 0x55fe36a3d4d0 2024-08-31T06:09:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdc06c38740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fe36d6a540 con 0x55fe36a352f0 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbfe195640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 0x55fe36e01ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbfd193640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e02540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbfe195640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 0x55fe36e01ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38650/0 (socket says 172.21.15.53:38650) 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbfd193640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e02540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38600/0 (socket says 172.21.15.53:38600) 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbfe195640 1 -- 172.21.15.53:0/2424391346 learned_addr learned my addr 172.21.15.53:0/2424391346 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbfd994640 1 --2- 172.21.15.53:0/2424391346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e02000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbfd193640 1 -- 172.21.15.53:0/2424391346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 msgr2=0x55fe36e02000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbfd193640 1 --2- 172.21.15.53:0/2424391346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e02000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbfd193640 1 -- 172.21.15.53:0/2424391346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 msgr2=0x55fe36e01ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbfd193640 1 --2- 172.21.15.53:0/2424391346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 0x55fe36e01ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.510+0000 7fdbfd193640 1 -- 172.21.15.53:0/2424391346 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe36ac9790 con 0x55fe36a3d4d0 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.511+0000 7fdbeeffd640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbe40b4ca0 0x7fdbe40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.511+0000 7fdbfd193640 1 --2- 172.21.15.53:0/2424391346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e02540 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8005fd0 tx=0x7fdbe800bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a58912c2fe47b83 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.511+0000 7fdbfe195640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbe40b4ca0 0x7fdbe40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.511+0000 7fdbeeffd640 1 -- 172.21.15.53:0/249605071 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fdbf4105be0 con 0x7fdbf8104580 2024-08-31T06:09:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.511+0000 7fdbe3fff640 1 -- 172.21.15.53:0/2424391346 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8003ba0 con 0x55fe36a3d4d0 2024-08-31T06:09:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.511+0000 7fdbe3fff640 1 -- 172.21.15.53:0/2424391346 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbe8015070 con 0x55fe36a3d4d0 2024-08-31T06:09:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.511+0000 7fdbe3fff640 1 -- 172.21.15.53:0/2424391346 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8004b40 con 0x55fe36a3d4d0 2024-08-31T06:09:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.512+0000 7fdc06c38740 1 -- 172.21.15.53:0/2424391346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 msgr2=0x55fe36e02540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.512+0000 7fdc06c38740 1 --2- 172.21.15.53:0/2424391346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e02540 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8005fd0 tx=0x7fdbe800bb20 comp rx=0 tx=0).stop 2024-08-31T06:09:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.512+0000 7fdbfe195640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbe40b4ca0 0x7fdbe40b71b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00116b0 tx=0x7fdbf0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.512+0000 7fdc06c38740 1 -- 172.21.15.53:0/2424391346 shutdown_connections 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.512+0000 7fdc06c38740 1 --2- 172.21.15.53:0/2424391346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e02540 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.512+0000 7fdc06c38740 1 --2- 172.21.15.53:0/2424391346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e02000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.512+0000 7fdc06c38740 1 --2- 172.21.15.53:0/2424391346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 0x55fe36e01ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.512+0000 7fdc06c38740 1 -- 172.21.15.53:0/2424391346 >> 172.21.15.53:0/2424391346 conn(0x55fe36a52300 msgr2=0x55fe36dff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.512+0000 7fdc06c38740 1 -- 172.21.15.53:0/2424391346 shutdown_connections 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.512+0000 7fdc06c38740 1 -- 172.21.15.53:0/2424391346 wait complete. 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.512+0000 7fdc06c38740 1 -- start start 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdc06c38740 1 Processor -- start 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a352f0 0x55fe36e11aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e11fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a5e1b0 0x55fe36e1d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdc06c38740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fe36c9fab0 con 0x55fe36a352f0 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdc06c38740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fe36ced680 con 0x55fe36a3d4d0 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdc06c38740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fe36e14620 con 0x55fe36a5e1b0 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdc06c38740 10 client.0 _ll_register_callbacks cb 0x55fe36a75a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdbfd994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a352f0 0x55fe36e11aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdbfd994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a352f0 0x55fe36e11aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38664/0 (socket says 172.21.15.53:38664) 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdbfd994640 1 -- 172.21.15.53:0/3837768994 learned_addr learned my addr 172.21.15.53:0/3837768994 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdbfd193640 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e11fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdbfe195640 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a5e1b0 0x55fe36e1d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.513+0000 7fdbfd994640 1 -- 172.21.15.53:0/3837768994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a5e1b0 msgr2=0x55fe36e1d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdbfd994640 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a5e1b0 0x55fe36e1d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdbfd994640 1 -- 172.21.15.53:0/3837768994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 msgr2=0x55fe36e11fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdbfd994640 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e11fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdbfd994640 1 -- 172.21.15.53:0/3837768994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe36b42620 con 0x55fe36a352f0 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdbfe195640 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a5e1b0 0x55fe36e1d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdbfd994640 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a352f0 0x55fe36e11aa0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40c95f0 tx=0x7fdbf4031970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b8866b1c209c15 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdbe17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdbe17fa640 1 -- 172.21.15.53:0/3837768994 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4049070 con 0x55fe36a352f0 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdbe17fa640 1 -- 172.21.15.53:0/3837768994 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fdbf40c8610 con 0x55fe36a352f0 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdc06c38740 1 -- 172.21.15.53:0/3837768994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbe8015070 con 0x55fe36a352f0 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdbe17fa640 1 -- 172.21.15.53:0/3837768994 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdbf40b3050 con 0x55fe36a352f0 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdc06c38740 10 client.17181 fetch_fsmap learned FSMap version 34 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdc06c38740 1 -- 172.21.15.53:0/3837768994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fe36e206a0 con 0x55fe36a352f0 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.514+0000 7fdbe17fa640 1 -- 172.21.15.53:0/3837768994 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbe8015070 con 0x55fe36a352f0 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.515+0000 7fdbe17fa640 1 -- 172.21.15.53:0/3837768994 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fdbf40cc5e0 con 0x55fe36a352f0 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.515+0000 7fdc06c38740 10 client.17181 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.515+0000 7fdc06c38740 10 client.17181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.515+0000 7fdc06c38740 20 client.17181 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.515+0000 7fdc06c38740 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fe36a1cd80 0x55fe36e23c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.515+0000 7fdc06c38740 4 client.17181 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.515+0000 7fdc06c38740 1 -- 172.21.15.53:0/3837768994 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe36d78f50 con 0x55fe36a1cd80 2024-08-31T06:09:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.515+0000 7fdbfd193640 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fe36a1cd80 0x55fe36e23c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.515+0000 7fdbe17fa640 10 client.17181 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.515+0000 7fdbfd193640 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fe36a1cd80 0x55fe36e23c40 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4a0d30d0283480 server_cookie=ded30fbaea12b21b in_seq=0 out_seq=0 2024-08-31T06:09:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdbe17fa640 1 -- 172.21.15.53:0/3837768994 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fe36d78f50 con 0x55fe36a1cd80 2024-08-31T06:09:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdbe17fa640 10 client.17181 handle_command_reply: tid=0 2024-08-31T06:09:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdc06c38740 1 client.17181 shutdown 2024-08-31T06:09:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdc06c38740 1 -- 172.21.15.53:0/3837768994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a352f0 msgr2=0x55fe36e11aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdc06c38740 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a352f0 0x55fe36e11aa0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40c95f0 tx=0x7fdbf4031970 comp rx=0 tx=0).stop 2024-08-31T06:09:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdc06c38740 1 -- 172.21.15.53:0/3837768994 shutdown_connections 2024-08-31T06:09:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdc06c38740 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fe36a1cd80 0x55fe36e23c40 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdc06c38740 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a5e1b0 0x55fe36e1d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdc06c38740 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e11fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdbe17fa640 0 client.17181 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdc06c38740 1 --2- 172.21.15.53:0/3837768994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a352f0 0x55fe36e11aa0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdc06c38740 1 -- 172.21.15.53:0/3837768994 >> 172.21.15.53:0/3837768994 conn(0x55fe36a52300 msgr2=0x55fe36e034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdc06c38740 1 -- 172.21.15.53:0/3837768994 shutdown_connections 2024-08-31T06:09:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.516+0000 7fdc06c38740 1 -- 172.21.15.53:0/3837768994 wait complete. 2024-08-31T06:09:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.517+0000 7fdc06c38740 20 client.17181 trim_cache size 0 max 16384 2024-08-31T06:09:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.534+0000 7fdc06c38740 1 Processor -- start 2024-08-31T06:09:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.534+0000 7fdc06c38740 1 -- start start 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.534+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e11d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.534+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a3d4d0 0x55fe36e05bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.534+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a5e1b0 0x55fe36e06110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.534+0000 7fdc06c38740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81ad1d0 con 0x55fe36a3d4d0 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.534+0000 7fdc06c38740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81aed70 con 0x55fe36a5e1b0 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.534+0000 7fdc06c38740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81ad8a0 con 0x55fe36a352f0 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfd193640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a3d4d0 0x55fe36e05bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfd193640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a3d4d0 0x55fe36e05bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38680/0 (socket says 172.21.15.53:38680) 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfd193640 1 -- 172.21.15.53:0/3215474383 learned_addr learned my addr 172.21.15.53:0/3215474383 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfd994640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e11d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfe195640 1 --2- 172.21.15.53:0/3215474383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a5e1b0 0x55fe36e06110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfd193640 1 -- 172.21.15.53:0/3215474383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 msgr2=0x55fe36e11d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfd193640 1 --2- 172.21.15.53:0/3215474383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e11d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfd193640 1 -- 172.21.15.53:0/3215474383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a5e1b0 msgr2=0x55fe36e06110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfd193640 1 --2- 172.21.15.53:0/3215474383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a5e1b0 0x55fe36e06110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfd193640 1 -- 172.21.15.53:0/3215474383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe36df9800 con 0x55fe36a3d4d0 2024-08-31T06:09:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfd994640 1 --2- 172.21.15.53:0/3215474383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e11d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbfd193640 1 --2- 172.21.15.53:0/3215474383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a3d4d0 0x55fe36e05bd0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800b5f0 tx=0x7fdbe8005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd987a21d4968a17 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbe37fe640 1 -- 172.21.15.53:0/3215474383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8032070 con 0x55fe36a3d4d0 2024-08-31T06:09:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbe37fe640 1 -- 172.21.15.53:0/3215474383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbe8015040 con 0x55fe36a3d4d0 2024-08-31T06:09:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.535+0000 7fdbe37fe640 1 -- 172.21.15.53:0/3215474383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8011440 con 0x55fe36a3d4d0 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.536+0000 7fdc06c38740 1 -- 172.21.15.53:0/3215474383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a3d4d0 msgr2=0x55fe36e05bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.536+0000 7fdc06c38740 1 --2- 172.21.15.53:0/3215474383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a3d4d0 0x55fe36e05bd0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800b5f0 tx=0x7fdbe8005c50 comp rx=0 tx=0).stop 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.536+0000 7fdc06c38740 1 -- 172.21.15.53:0/3215474383 shutdown_connections 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.536+0000 7fdc06c38740 1 --2- 172.21.15.53:0/3215474383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a5e1b0 0x55fe36e06110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.536+0000 7fdc06c38740 1 --2- 172.21.15.53:0/3215474383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a3d4d0 0x55fe36e05bd0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.536+0000 7fdc06c38740 1 --2- 172.21.15.53:0/3215474383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e11d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.536+0000 7fdc06c38740 1 -- 172.21.15.53:0/3215474383 >> 172.21.15.53:0/3215474383 conn(0x55fe36a52300 msgr2=0x55fe36e06a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.536+0000 7fdc06c38740 1 -- 172.21.15.53:0/3215474383 shutdown_connections 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.536+0000 7fdc06c38740 1 -- 172.21.15.53:0/3215474383 wait complete. 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.537+0000 7fdc06c38740 1 -- start start 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.537+0000 7fdc06c38740 1 Processor -- start 2024-08-31T06:09:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.537+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e158f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.537+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e15e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.537+0000 7fdc06c38740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 0x55fe36e16370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.537+0000 7fdc06c38740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81ae6a0 con 0x55fe36a5e1b0 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.537+0000 7fdc06c38740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81adf70 con 0x55fe36a3d4d0 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.537+0000 7fdc06c38740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81ab1b0 con 0x55fe36a352f0 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.537+0000 7fdc06c38740 10 client.0 _ll_register_callbacks cb 0x7fdbf4009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.537+0000 7fdbfe195640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 0x55fe36e16370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbfe195640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 0x55fe36e16370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38690/0 (socket says 172.21.15.53:38690) 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbfe195640 1 -- 172.21.15.53:0/2334111834 learned_addr learned my addr 172.21.15.53:0/2334111834 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbfd193640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e15e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbfd994640 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbfd193640 1 -- 172.21.15.53:0/2334111834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 msgr2=0x55fe36e158f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbfd193640 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e158f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbfd193640 1 -- 172.21.15.53:0/2334111834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 msgr2=0x55fe36e16370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbfd193640 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 0x55fe36e16370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbfd193640 1 -- 172.21.15.53:0/2334111834 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe36e8d670 con 0x55fe36a3d4d0 2024-08-31T06:09:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbfd193640 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e15e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55fe36ceebc0 tx=0x7fdbe8003b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0124f53c3e6b2ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbe17fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:09:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbe17fa640 1 -- 172.21.15.53:0/2334111834 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8032070 con 0x55fe36a3d4d0 2024-08-31T06:09:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdc06c38740 1 -- 172.21.15.53:0/2334111834 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbe8015040 con 0x55fe36a3d4d0 2024-08-31T06:09:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.538+0000 7fdbe17fa640 1 -- 172.21.15.53:0/2334111834 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fdbe802d450 con 0x55fe36a3d4d0 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdbe17fa640 1 -- 172.21.15.53:0/2334111834 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdbe8003f40 con 0x55fe36a3d4d0 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdc06c38740 10 client.26549 fetch_fsmap learned FSMap version 34 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdc06c38740 1 -- 172.21.15.53:0/2334111834 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fe36e8e900 con 0x55fe36a3d4d0 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdbe17fa640 1 -- 172.21.15.53:0/2334111834 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbe8015040 con 0x55fe36a3d4d0 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdbe17fa640 1 -- 172.21.15.53:0/2334111834 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fdbe8011af0 con 0x55fe36a3d4d0 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdc06c38740 10 client.26549 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdc06c38740 10 client.26549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdc06c38740 20 client.26549 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdc06c38740 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fe369f21c0 0x55fe36e90e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdc06c38740 4 client.26549 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdc06c38740 1 -- 172.21.15.53:0/2334111834 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe36d749f0 con 0x55fe369f21c0 2024-08-31T06:09:35.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.539+0000 7fdbfd994640 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fe369f21c0 0x55fe36e90e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.540+0000 7fdbe17fa640 10 client.26549 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.540+0000 7fdbfd994640 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fe369f21c0 0x55fe36e90e00 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af2c3dd0466e50a5 server_cookie=9a1b6432903337b7 in_seq=0 out_seq=0 2024-08-31T06:09:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdbe17fa640 1 -- 172.21.15.53:0/2334111834 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe36d749f0 con 0x55fe369f21c0 2024-08-31T06:09:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdbe17fa640 10 client.26549 handle_command_reply: tid=0 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 1 client.26549 shutdown 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 1 -- 172.21.15.53:0/2334111834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 msgr2=0x55fe36e15e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e15e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55fe36ceebc0 tx=0x7fdbe8003b30 comp rx=0 tx=0).stop 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 1 -- 172.21.15.53:0/2334111834 shutdown_connections 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fe369f21c0 0x55fe36e90e00 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fe36a5e1b0 0x55fe36e16370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdbe17fa640 0 client.26549 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fe36a3d4d0 0x55fe36e15e30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 1 --2- 172.21.15.53:0/2334111834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe36a352f0 0x55fe36e158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 1 -- 172.21.15.53:0/2334111834 >> 172.21.15.53:0/2334111834 conn(0x55fe36a52300 msgr2=0x55fe36e02af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 1 -- 172.21.15.53:0/2334111834 shutdown_connections 2024-08-31T06:09:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 1 -- 172.21.15.53:0/2334111834 wait complete. 2024-08-31T06:09:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.561+0000 7fdc06c38740 20 client.26549 trim_cache size 0 max 16384 2024-08-31T06:09:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:09:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:09:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:09:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:09:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 -- 172.21.15.53:0/249605071 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbe40b4ca0 msgr2=0x7fdbe40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbe40b4ca0 0x7fdbe40b71b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00116b0 tx=0x7fdbf0009500 comp rx=0 tx=0).stop 2024-08-31T06:09:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 -- 172.21.15.53:0/249605071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbf8104580 msgr2=0x7fdbf819a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbf8104580 0x7fdbf819a130 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009230 tx=0x7fdbf4004270 comp rx=0 tx=0).stop 2024-08-31T06:09:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 -- 172.21.15.53:0/249605071 shutdown_connections 2024-08-31T06:09:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbe40b4ca0 0x7fdbe40b71b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbf810db30 0x7fdbf819f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf8104f60 0x7fdbf819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 --2- 172.21.15.53:0/249605071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbf8104580 0x7fdbf819a130 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 -- 172.21.15.53:0/249605071 >> 172.21.15.53:0/249605071 conn(0x7fdbf807a4e0 msgr2=0x7fdbf80ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 -- 172.21.15.53:0/249605071 shutdown_connections 2024-08-31T06:09:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:35.562+0000 7fdbffbf8640 1 -- 172.21.15.53:0/249605071 wait complete. 2024-08-31T06:09:35.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 81613 1.87 MB/sec execute 85 sec latency 28.456 ms 2024-08-31T06:09:36.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:35 smithi130 ceph-mon[22266]: pgmap v462: 97 pgs: 97 active+clean; 55 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2024-08-31T06:09:36.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:35 smithi153 ceph-mon[22320]: pgmap v462: 97 pgs: 97 active+clean; 55 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2024-08-31T06:09:36.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:35 smithi053 ceph-mon[18924]: pgmap v462: 97 pgs: 97 active+clean; 55 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2024-08-31T06:09:36.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 81977 1.86 MB/sec execute 86 sec latency 13.700 ms 2024-08-31T06:09:37.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 82249 1.84 MB/sec execute 87 sec latency 13.502 ms 2024-08-31T06:09:38.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:37 smithi130 ceph-mon[22266]: pgmap v463: 97 pgs: 97 active+clean; 55 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 1.4 MiB/s wr, 150 op/s 2024-08-31T06:09:38.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:37 smithi153 ceph-mon[22320]: pgmap v463: 97 pgs: 97 active+clean; 55 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 1.4 MiB/s wr, 150 op/s 2024-08-31T06:09:38.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:37 smithi053 ceph-mon[18924]: pgmap v463: 97 pgs: 97 active+clean; 55 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 1.4 MiB/s wr, 150 op/s 2024-08-31T06:09:38.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 82771 1.84 MB/sec execute 88 sec latency 18.469 ms 2024-08-31T06:09:39.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 83327 1.86 MB/sec execute 89 sec latency 15.434 ms 2024-08-31T06:09:40.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:39 smithi130 ceph-mon[22266]: pgmap v464: 97 pgs: 97 active+clean; 55 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-08-31T06:09:40.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:39 smithi153 ceph-mon[22320]: pgmap v464: 97 pgs: 97 active+clean; 55 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-08-31T06:09:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:39 smithi053 ceph-mon[18924]: pgmap v464: 97 pgs: 97 active+clean; 55 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-08-31T06:09:40.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 83982 1.86 MB/sec execute 90 sec latency 14.751 ms 2024-08-31T06:09:41.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 84566 1.90 MB/sec execute 91 sec latency 14.527 ms 2024-08-31T06:09:42.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:41 smithi130 ceph-mon[22266]: pgmap v465: 97 pgs: 97 active+clean; 52 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2024-08-31T06:09:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:41 smithi153 ceph-mon[22320]: pgmap v465: 97 pgs: 97 active+clean; 52 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2024-08-31T06:09:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:41 smithi053 ceph-mon[18924]: pgmap v465: 97 pgs: 97 active+clean; 52 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2024-08-31T06:09:42.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 85010 1.90 MB/sec execute 92 sec latency 15.248 ms 2024-08-31T06:09:43.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 85482 1.93 MB/sec execute 93 sec latency 12.593 ms 2024-08-31T06:09:44.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:43 smithi130 ceph-mon[22266]: pgmap v466: 97 pgs: 97 active+clean; 53 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-08-31T06:09:44.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:43 smithi153 ceph-mon[22320]: pgmap v466: 97 pgs: 97 active+clean; 53 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-08-31T06:09:44.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:43 smithi053 ceph-mon[18924]: pgmap v466: 97 pgs: 97 active+clean; 53 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-08-31T06:09:44.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 85739 1.91 MB/sec execute 94 sec latency 15.422 ms 2024-08-31T06:09:45.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:09:45.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:09:45.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:09:45.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:44 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:09:45.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:09:45.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:09:45.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:09:45.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:44 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:09:45.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:09:45.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:09:45.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:09:45.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:44 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:09:45.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 86218 1.91 MB/sec execute 95 sec latency 14.005 ms 2024-08-31T06:09:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:45 smithi130 ceph-mon[22266]: pgmap v467: 97 pgs: 97 active+clean; 53 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.3 MiB/s wr, 165 op/s 2024-08-31T06:09:46.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:45 smithi153 ceph-mon[22320]: pgmap v467: 97 pgs: 97 active+clean; 53 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.3 MiB/s wr, 165 op/s 2024-08-31T06:09:46.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:45 smithi053 ceph-mon[18924]: pgmap v467: 97 pgs: 97 active+clean; 53 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.3 MiB/s wr, 165 op/s 2024-08-31T06:09:46.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 86756 1.92 MB/sec execute 96 sec latency 22.566 ms 2024-08-31T06:09:47.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 87389 1.91 MB/sec execute 97 sec latency 15.031 ms 2024-08-31T06:09:48.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:47 smithi130 ceph-mon[22266]: pgmap v468: 97 pgs: 97 active+clean; 55 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.5 MiB/s wr, 154 op/s 2024-08-31T06:09:48.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:47 smithi153 ceph-mon[22320]: pgmap v468: 97 pgs: 97 active+clean; 55 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.5 MiB/s wr, 154 op/s 2024-08-31T06:09:48.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:47 smithi053 ceph-mon[18924]: pgmap v468: 97 pgs: 97 active+clean; 55 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.5 MiB/s wr, 154 op/s 2024-08-31T06:09:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.667+0000 7f6520532640 1 -- 172.21.15.53:0/2603436843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6518103880 msgr2=0x7f6518103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.667+0000 7f6520532640 1 --2- 172.21.15.53:0/2603436843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6518103880 0x7f6518103c90 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6514009900 tx=0x7f651402a410 comp rx=0 tx=0).stop 2024-08-31T06:09:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.667+0000 7f6520532640 1 -- 172.21.15.53:0/2603436843 shutdown_connections 2024-08-31T06:09:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.667+0000 7f6520532640 1 --2- 172.21.15.53:0/2603436843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6518109b00 0x7f6518110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.667+0000 7f6520532640 1 --2- 172.21.15.53:0/2603436843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65181091b0 0x7f65181095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.667+0000 7f6520532640 1 --2- 172.21.15.53:0/2603436843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6518103880 0x7f6518103c90 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.667+0000 7f6520532640 1 -- 172.21.15.53:0/2603436843 >> 172.21.15.53:0/2603436843 conn(0x7f65180ff2c0 msgr2=0x7f6518101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.667+0000 7f6520532640 1 -- 172.21.15.53:0/2603436843 shutdown_connections 2024-08-31T06:09:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.667+0000 7f6520532640 1 -- 172.21.15.53:0/2603436843 wait complete. 2024-08-31T06:09:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.668+0000 7f6520532640 1 Processor -- start 2024-08-31T06:09:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.668+0000 7f6520532640 1 -- start start 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.668+0000 7f6520532640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6518103880 0x7f651819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.668+0000 7f6520532640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65181091b0 0x7f651819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.668+0000 7f6520532640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6518109b00 0x7f651819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.668+0000 7f6520532640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6518113680 con 0x7f65181091b0 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.668+0000 7f6520532640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6518113500 con 0x7f6518103880 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.668+0000 7f6520532640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6518113800 con 0x7f6518109b00 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f651dacd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65181091b0 0x7f651819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f651dacd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65181091b0 0x7f651819a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57990/0 (socket says 172.21.15.53:57990) 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f651dacd640 1 -- 172.21.15.53:0/2498442618 learned_addr learned my addr 172.21.15.53:0/2498442618 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f651e2ce640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6518103880 0x7f651819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f651eacf640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6518109b00 0x7f651819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f651dacd640 1 -- 172.21.15.53:0/2498442618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6518109b00 msgr2=0x7f651819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f651dacd640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6518109b00 0x7f651819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f651dacd640 1 -- 172.21.15.53:0/2498442618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6518103880 msgr2=0x7f651819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f651dacd640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6518103880 0x7f651819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f651dacd640 1 -- 172.21.15.53:0/2498442618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65181a00f0 con 0x7f65181091b0 2024-08-31T06:09:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f651dacd640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65181091b0 0x7f651819a760 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f650800e9c0 tx=0x7f650800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f650f7fe640 1 -- 172.21.15.53:0/2498442618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650800ccc0 con 0x7f65181091b0 2024-08-31T06:09:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f650f7fe640 1 -- 172.21.15.53:0/2498442618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65080054b0 con 0x7f65181091b0 2024-08-31T06:09:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f6520532640 1 -- 172.21.15.53:0/2498442618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65181a03e0 con 0x7f65181091b0 2024-08-31T06:09:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f650f7fe640 1 -- 172.21.15.53:0/2498442618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508010430 con 0x7f65181091b0 2024-08-31T06:09:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.669+0000 7f6520532640 1 -- 172.21.15.53:0/2498442618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65181a6b70 con 0x7f65181091b0 2024-08-31T06:09:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.672+0000 7f652749f740 1 Processor -- start 2024-08-31T06:09:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.672+0000 7f652749f740 1 -- start start 2024-08-31T06:09:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f650f7fe640 1 -- 172.21.15.53:0/2498442618 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6508004f20 con 0x7f65181091b0 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f652749f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 0x561b65012ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f652749f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65013000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f652749f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b65013540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f652749f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561b64f88000 con 0x561b64c6f1b0 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f652749f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561b64f77590 con 0x561b64c462f0 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f652749f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561b64f7b540 con 0x561b64c4e4d0 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f651eacf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 0x561b65012ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f651eacf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 0x561b65012ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57996/0 (socket says 172.21.15.53:57996) 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f651e2ce640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65013000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f651eacf640 1 -- 172.21.15.53:0/2104468156 learned_addr learned my addr 172.21.15.53:0/2104468156 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f651dacd640 1 --2- 172.21.15.53:0/2104468156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b65013540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f651e2ce640 1 -- 172.21.15.53:0/2104468156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 msgr2=0x561b65013540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f651e2ce640 1 --2- 172.21.15.53:0/2104468156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b65013540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f651e2ce640 1 -- 172.21.15.53:0/2104468156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 msgr2=0x561b65012ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.673+0000 7f651e2ce640 1 --2- 172.21.15.53:0/2104468156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 0x561b65012ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.674+0000 7f651e2ce640 1 -- 172.21.15.53:0/2104468156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b64cda790 con 0x561b64c462f0 2024-08-31T06:09:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.674+0000 7f651dacd640 1 --2- 172.21.15.53:0/2104468156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b65013540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.674+0000 7f651e2ce640 1 --2- 172.21.15.53:0/2104468156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65013000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6514005940 tx=0x7f6514031a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b43852f8eac02d07 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.674+0000 7f650f7fe640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f65040b4ca0 0x7f65040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.674+0000 7f651eacf640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f65040b4ca0 0x7f65040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.674+0000 7f650f7fe640 1 -- 172.21.15.53:0/2498442618 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f65080e5940 con 0x7f65181091b0 2024-08-31T06:09:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.674+0000 7f650cbfe640 1 -- 172.21.15.53:0/2104468156 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514035030 con 0x561b64c462f0 2024-08-31T06:09:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.674+0000 7f650cbfe640 1 -- 172.21.15.53:0/2104468156 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6514040070 con 0x561b64c462f0 2024-08-31T06:09:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.674+0000 7f650cbfe640 1 -- 172.21.15.53:0/2104468156 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514003850 con 0x561b64c462f0 2024-08-31T06:09:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.675+0000 7f652749f740 1 -- 172.21.15.53:0/2104468156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 msgr2=0x561b65013000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.675+0000 7f651eacf640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f65040b4ca0 0x7f65040b71b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6510009fd0 tx=0x7f6510009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.675+0000 7f652749f740 1 --2- 172.21.15.53:0/2104468156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65013000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6514005940 tx=0x7f6514031a70 comp rx=0 tx=0).stop 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.675+0000 7f652749f740 1 -- 172.21.15.53:0/2104468156 shutdown_connections 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.675+0000 7f652749f740 1 --2- 172.21.15.53:0/2104468156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b65013540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.675+0000 7f652749f740 1 --2- 172.21.15.53:0/2104468156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65013000 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.675+0000 7f652749f740 1 --2- 172.21.15.53:0/2104468156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 0x561b65012ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.675+0000 7f652749f740 1 -- 172.21.15.53:0/2104468156 >> 172.21.15.53:0/2104468156 conn(0x561b64c63300 msgr2=0x561b650109b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.675+0000 7f652749f740 1 -- 172.21.15.53:0/2104468156 shutdown_connections 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.675+0000 7f652749f740 1 -- 172.21.15.53:0/2104468156 wait complete. 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f652749f740 1 -- start start 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f652749f740 1 Processor -- start 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f652749f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65022a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f652749f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b65022f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f652749f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 0x561b6502e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f652749f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561b64eb0ab0 con 0x561b64c6f1b0 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f652749f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561b64efe680 con 0x561b64c462f0 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f652749f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561b650255c0 con 0x561b64c4e4d0 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f652749f740 10 client.0 _ll_register_callbacks cb 0x561b64c86a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f651eacf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 0x561b6502e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f651e2ce640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65022a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f651eacf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 0x561b6502e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58004/0 (socket says 172.21.15.53:58004) 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.676+0000 7f651eacf640 1 -- 172.21.15.53:0/1614712081 learned_addr learned my addr 172.21.15.53:0/1614712081 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f651dacd640 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b65022f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f651eacf640 1 -- 172.21.15.53:0/1614712081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 msgr2=0x561b65022f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f651eacf640 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b65022f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f651eacf640 1 -- 172.21.15.53:0/1614712081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 msgr2=0x561b65022a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f651eacf640 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65022a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f651eacf640 1 -- 172.21.15.53:0/1614712081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b64d53620 con 0x561b64c6f1b0 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f651e2ce640 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65022a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f651eacf640 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 0x561b6502e8f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f651001f6d0 tx=0x7f6510004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dce9fae197136a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f6501ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f6501ffb640 1 -- 172.21.15.53:0/1614712081 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510004b20 con 0x561b64c6f1b0 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f6501ffb640 1 -- 172.21.15.53:0/1614712081 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f6510017030 con 0x561b64c6f1b0 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f652749f740 1 -- 172.21.15.53:0/1614712081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6514040070 con 0x561b64c6f1b0 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f6501ffb640 1 -- 172.21.15.53:0/1614712081 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6510004cc0 con 0x561b64c6f1b0 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f652749f740 10 client.17199 fetch_fsmap learned FSMap version 34 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.677+0000 7f652749f740 1 -- 172.21.15.53:0/1614712081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561b65031620 con 0x561b64c6f1b0 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.678+0000 7f6501ffb640 1 -- 172.21.15.53:0/1614712081 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6514040070 con 0x561b64c6f1b0 2024-08-31T06:09:48.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.678+0000 7f6501ffb640 1 -- 172.21.15.53:0/1614712081 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6510005320 con 0x561b64c6f1b0 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.678+0000 7f652749f740 10 client.17199 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.678+0000 7f652749f740 10 client.17199 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.678+0000 7f652749f740 20 client.17199 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.678+0000 7f652749f740 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561b64c2dd80 0x561b65034bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.678+0000 7f652749f740 4 client.17199 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.678+0000 7f652749f740 1 -- 172.21.15.53:0/1614712081 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b64f89f50 con 0x561b64c2dd80 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.678+0000 7f651e2ce640 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561b64c2dd80 0x561b65034bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.678+0000 7f6501ffb640 10 client.17199 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.678+0000 7f651e2ce640 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561b64c2dd80 0x561b65034bf0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf768e9903409675 server_cookie=1f97e831ddbb1683 in_seq=0 out_seq=0 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f6501ffb640 1 -- 172.21.15.53:0/1614712081 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b64f89f50 con 0x561b64c2dd80 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f6501ffb640 10 client.17199 handle_command_reply: tid=0 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f652749f740 1 client.17199 shutdown 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f652749f740 1 -- 172.21.15.53:0/1614712081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 msgr2=0x561b6502e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:48.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f652749f740 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 0x561b6502e8f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f651001f6d0 tx=0x7f6510004ab0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f652749f740 1 -- 172.21.15.53:0/1614712081 shutdown_connections 2024-08-31T06:09:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f652749f740 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561b64c2dd80 0x561b65034bf0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f652749f740 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c6f1b0 0x561b6502e8f0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f652749f740 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b65022f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f6501ffb640 0 client.17199 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f652749f740 1 --2- 172.21.15.53:0/1614712081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65022a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f652749f740 1 -- 172.21.15.53:0/1614712081 >> 172.21.15.53:0/1614712081 conn(0x561b64c63300 msgr2=0x561b650144b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f652749f740 1 -- 172.21.15.53:0/1614712081 shutdown_connections 2024-08-31T06:09:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.679+0000 7f652749f740 1 -- 172.21.15.53:0/1614712081 wait complete. 2024-08-31T06:09:48.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.680+0000 7f652749f740 20 client.17199 trim_cache size 0 max 16384 2024-08-31T06:09:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f652749f740 1 Processor -- start 2024-08-31T06:09:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f652749f740 1 -- start start 2024-08-31T06:09:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f652749f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c2dd80 0x561b65016bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f652749f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65017110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f652749f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b6502e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f652749f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f65181ad290 con 0x561b64c2dd80 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f652749f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f65181aee30 con 0x561b64c462f0 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f652749f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f65181ad960 con 0x561b64c4e4d0 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f651e2ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c2dd80 0x561b65016bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f651e2ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c2dd80 0x561b65016bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58012/0 (socket says 172.21.15.53:58012) 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f651e2ce640 1 -- 172.21.15.53:0/2165690355 learned_addr learned my addr 172.21.15.53:0/2165690355 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f651eacf640 1 --2- 172.21.15.53:0/2165690355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b6502e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f651dacd640 1 --2- 172.21.15.53:0/2165690355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65017110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f651e2ce640 1 -- 172.21.15.53:0/2165690355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 msgr2=0x561b6502e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f651e2ce640 1 --2- 172.21.15.53:0/2165690355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b6502e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f651e2ce640 1 -- 172.21.15.53:0/2165690355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 msgr2=0x561b65017110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f651e2ce640 1 --2- 172.21.15.53:0/2165690355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65017110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f651e2ce640 1 -- 172.21.15.53:0/2165690355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6500a800 con 0x561b64c2dd80 2024-08-31T06:09:48.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.695+0000 7f651dacd640 1 --2- 172.21.15.53:0/2165690355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65017110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:09:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.696+0000 7f651e2ce640 1 --2- 172.21.15.53:0/2165690355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c2dd80 0x561b65016bd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f651402a930 tx=0x7f6514000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aeba0e0db73987 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.696+0000 7f6503fff640 1 -- 172.21.15.53:0/2165690355 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514035040 con 0x561b64c2dd80 2024-08-31T06:09:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.696+0000 7f6503fff640 1 -- 172.21.15.53:0/2165690355 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6514040040 con 0x561b64c2dd80 2024-08-31T06:09:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.696+0000 7f6503fff640 1 -- 172.21.15.53:0/2165690355 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514003cb0 con 0x561b64c2dd80 2024-08-31T06:09:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.697+0000 7f652749f740 1 -- 172.21.15.53:0/2165690355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c2dd80 msgr2=0x561b65016bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.697+0000 7f652749f740 1 --2- 172.21.15.53:0/2165690355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c2dd80 0x561b65016bd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f651402a930 tx=0x7f6514000bc0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.697+0000 7f652749f740 1 -- 172.21.15.53:0/2165690355 shutdown_connections 2024-08-31T06:09:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.697+0000 7f652749f740 1 --2- 172.21.15.53:0/2165690355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c4e4d0 0x561b6502e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.697+0000 7f652749f740 1 --2- 172.21.15.53:0/2165690355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b65017110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.697+0000 7f652749f740 1 --2- 172.21.15.53:0/2165690355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c2dd80 0x561b65016bd0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.697+0000 7f652749f740 1 -- 172.21.15.53:0/2165690355 >> 172.21.15.53:0/2165690355 conn(0x561b64c63300 msgr2=0x561b65021090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.697+0000 7f652749f740 1 -- 172.21.15.53:0/2165690355 shutdown_connections 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.697+0000 7f652749f740 1 -- 172.21.15.53:0/2165690355 wait complete. 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.697+0000 7f652749f740 1 -- start start 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.697+0000 7f652749f740 1 Processor -- start 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f652749f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c2dd80 0x561b6502aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f652749f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b6502aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f652749f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c4e4d0 0x561b65025810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f652749f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f65181ae760 con 0x561b64c4e4d0 2024-08-31T06:09:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f652749f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f65181ae030 con 0x561b64c462f0 2024-08-31T06:09:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f652749f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f65181ab270 con 0x561b64c2dd80 2024-08-31T06:09:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f652749f740 10 client.0 _ll_register_callbacks cb 0x7f651001f590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651eacf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c4e4d0 0x561b65025810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651e2ce640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c2dd80 0x561b6502aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651dacd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b6502aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651dacd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b6502aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:40244/0 (socket says 172.21.15.53:40244) 2024-08-31T06:09:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651e2ce640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c2dd80 0x561b6502aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:39994/0 (socket says 172.21.15.53:39994) 2024-08-31T06:09:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651dacd640 1 -- 172.21.15.53:0/2849553217 learned_addr learned my addr 172.21.15.53:0/2849553217 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651dacd640 1 -- 172.21.15.53:0/2849553217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c2dd80 msgr2=0x561b6502aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651dacd640 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c2dd80 0x561b6502aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651dacd640 1 -- 172.21.15.53:0/2849553217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c4e4d0 msgr2=0x561b65025810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651dacd640 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c4e4d0 0x561b65025810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651dacd640 1 -- 172.21.15.53:0/2849553217 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b650138b0 con 0x561b64c462f0 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651eacf640 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c4e4d0 0x561b65025810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f651dacd640 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b6502aff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6508004650 tx=0x7f65080abec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=880a5f5721cb6b3c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.698+0000 7f6501ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f6501ffb640 1 -- 172.21.15.53:0/2849553217 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650800ce60 con 0x561b64c462f0 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f652749f740 1 -- 172.21.15.53:0/2849553217 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6514040040 con 0x561b64c462f0 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f6501ffb640 1 -- 172.21.15.53:0/2849553217 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f6508005210 con 0x561b64c462f0 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f6501ffb640 1 -- 172.21.15.53:0/2849553217 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f65080abb40 con 0x561b64c462f0 2024-08-31T06:09:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f652749f740 10 client.26567 fetch_fsmap learned FSMap version 34 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f652749f740 1 -- 172.21.15.53:0/2849553217 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561b65015920 con 0x561b64c462f0 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f6501ffb640 1 -- 172.21.15.53:0/2849553217 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6514040040 con 0x561b64c462f0 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f6501ffb640 1 -- 172.21.15.53:0/2849553217 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f65080a82c0 con 0x561b64c462f0 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f652749f740 10 client.26567 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f652749f740 10 client.26567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f652749f740 20 client.26567 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f652749f740 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561b64c6f1b0 0x561b650a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f652749f740 4 client.26567 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.699+0000 7f652749f740 1 -- 172.21.15.53:0/2849553217 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b64f859f0 con 0x561b64c6f1b0 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.700+0000 7f651e2ce640 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561b64c6f1b0 0x561b650a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.700+0000 7f6501ffb640 10 client.26567 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.700+0000 7f651e2ce640 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561b64c6f1b0 0x561b650a23b0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e873aed263f0288 server_cookie=dbbe84c58306e37b in_seq=0 out_seq=0 2024-08-31T06:09:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.720+0000 7f6501ffb640 1 -- 172.21.15.53:0/2849553217 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b64f859f0 con 0x561b64c6f1b0 2024-08-31T06:09:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.720+0000 7f6501ffb640 10 client.26567 handle_command_reply: tid=0 2024-08-31T06:09:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.720+0000 7f652749f740 1 client.26567 shutdown 2024-08-31T06:09:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.720+0000 7f652749f740 1 -- 172.21.15.53:0/2849553217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 msgr2=0x561b6502aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.720+0000 7f652749f740 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b6502aff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6508004650 tx=0x7f65080abec0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.720+0000 7f652749f740 1 -- 172.21.15.53:0/2849553217 shutdown_connections 2024-08-31T06:09:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.720+0000 7f652749f740 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561b64c6f1b0 0x561b650a23b0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.720+0000 7f652749f740 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b64c4e4d0 0x561b65025810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.720+0000 7f6501ffb640 0 client.26567 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.720+0000 7f652749f740 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b64c462f0 0x561b6502aff0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.720+0000 7f652749f740 1 --2- 172.21.15.53:0/2849553217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b64c2dd80 0x561b6502aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f652749f740 1 -- 172.21.15.53:0/2849553217 >> 172.21.15.53:0/2849553217 conn(0x561b64c63300 msgr2=0x561b65021d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f652749f740 1 -- 172.21.15.53:0/2849553217 shutdown_connections 2024-08-31T06:09:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f652749f740 1 -- 172.21.15.53:0/2849553217 wait complete. 2024-08-31T06:09:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f652749f740 20 client.26567 trim_cache size 0 max 16384 2024-08-31T06:09:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:09:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:09:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:09:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:09:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f6520532640 1 -- 172.21.15.53:0/2498442618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f65040b4ca0 msgr2=0x7f65040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f6520532640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f65040b4ca0 0x7f65040b71b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6510009fd0 tx=0x7f6510009500 comp rx=0 tx=0).stop 2024-08-31T06:09:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f6520532640 1 -- 172.21.15.53:0/2498442618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65181091b0 msgr2=0x7f651819a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f6520532640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65181091b0 0x7f651819a760 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f650800e9c0 tx=0x7f650800ee80 comp rx=0 tx=0).stop 2024-08-31T06:09:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f6520532640 1 -- 172.21.15.53:0/2498442618 shutdown_connections 2024-08-31T06:09:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f6520532640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f65040b4ca0 0x7f65040b71b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f6520532640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6518109b00 0x7f651819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f6520532640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65181091b0 0x7f651819a760 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f6520532640 1 --2- 172.21.15.53:0/2498442618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6518103880 0x7f651819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.721+0000 7f6520532640 1 -- 172.21.15.53:0/2498442618 >> 172.21.15.53:0/2498442618 conn(0x7f65180ff2c0 msgr2=0x7f65181016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.722+0000 7f6520532640 1 -- 172.21.15.53:0/2498442618 shutdown_connections 2024-08-31T06:09:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:09:48.722+0000 7f6520532640 1 -- 172.21.15.53:0/2498442618 wait complete. 2024-08-31T06:09:48.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 87937 1.94 MB/sec execute 98 sec latency 16.468 ms 2024-08-31T06:09:49.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 88505 1.96 MB/sec execute 99 sec latency 13.907 ms 2024-08-31T06:09:50.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:49 smithi130 ceph-mon[22266]: pgmap v469: 97 pgs: 97 active+clean; 55 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-08-31T06:09:50.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:49 smithi153 ceph-mon[22320]: pgmap v469: 97 pgs: 97 active+clean; 55 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-08-31T06:09:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:49 smithi053 ceph-mon[18924]: pgmap v469: 97 pgs: 97 active+clean; 55 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2024-08-31T06:09:50.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 88977 1.98 MB/sec execute 100 sec latency 14.268 ms 2024-08-31T06:09:51.687 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:09:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:51.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 89237 1.97 MB/sec execute 101 sec latency 12.341 ms 2024-08-31T06:09:52.261 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:51 smithi053 ceph-mon[18924]: pgmap v470: 97 pgs: 97 active+clean; 56 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 1.5 MiB/s wr, 167 op/s 2024-08-31T06:09:52.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:51 smithi130 ceph-mon[22266]: pgmap v470: 97 pgs: 97 active+clean; 56 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 1.5 MiB/s wr, 167 op/s 2024-08-31T06:09:52.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:51 smithi153 ceph-mon[22320]: pgmap v470: 97 pgs: 97 active+clean; 56 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 1.5 MiB/s wr, 167 op/s 2024-08-31T06:09:52.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.603+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1550103215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c4103920 msgr2=0x7fb8c4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:52.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.603+0000 7fb8ca11a640 1 --2- 172.21.15.53:0/1550103215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c4103920 0x7fb8c4103d30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009900 tx=0x7fb8b402a410 comp rx=0 tx=0).stop 2024-08-31T06:09:52.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.603+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1550103215 shutdown_connections 2024-08-31T06:09:52.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.603+0000 7fb8ca11a640 1 --2- 172.21.15.53:0/1550103215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c4109bb0 0x7fb8c41103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.603+0000 7fb8ca11a640 1 --2- 172.21.15.53:0/1550103215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c4109260 0x7fb8c4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.603+0000 7fb8ca11a640 1 --2- 172.21.15.53:0/1550103215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c4103920 0x7fb8c4103d30 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.603+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1550103215 >> 172.21.15.53:0/1550103215 conn(0x7fb8c40ff3b0 msgr2=0x7fb8c4101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:52.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.603+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1550103215 shutdown_connections 2024-08-31T06:09:52.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.603+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1550103215 wait complete. 2024-08-31T06:09:52.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.603+0000 7fb8ca11a640 1 Processor -- start 2024-08-31T06:09:52.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8ca11a640 1 -- start start 2024-08-31T06:09:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8ca11a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c4103920 0x7fb8c40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8ca11a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c4109260 0x7fb8c40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8ca11a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c4109bb0 0x7fb8c4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8ca11a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c4113720 con 0x7fb8c4109bb0 2024-08-31T06:09:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8ca11a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c41135a0 con 0x7fb8c4103920 2024-08-31T06:09:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8ca11a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c41138a0 con 0x7fb8c4109260 2024-08-31T06:09:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c4109bb0 0x7fb8c4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8c37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c4103920 0x7fb8c40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c4109bb0 0x7fb8c4075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58032/0 (socket says 172.21.15.53:58032) 2024-08-31T06:09:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1919793096 learned_addr learned my addr 172.21.15.53:0/1919793096 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8c2ffd640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c4109260 0x7fb8c40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8c37fe640 1 -- 172.21.15.53:0/1919793096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c4109260 msgr2=0x7fb8c40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8c37fe640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c4109260 0x7fb8c40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.604+0000 7fb8c37fe640 1 -- 172.21.15.53:0/1919793096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c4109bb0 msgr2=0x7fb8c4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.605+0000 7fb8c37fe640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c4109bb0 0x7fb8c4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.605+0000 7fb8c37fe640 1 -- 172.21.15.53:0/1919793096 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c41a8450 con 0x7fb8c4103920 2024-08-31T06:09:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.605+0000 7fb8c2ffd640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c4109260 0x7fb8c40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.605+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c4109bb0 0x7fb8c4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.605+0000 7fb8c37fe640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c4103920 0x7fb8c40754b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4005940 tx=0x7fb8b4005e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.605+0000 7fb8c0ff9640 1 -- 172.21.15.53:0/1919793096 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b403f070 con 0x7fb8c4103920 2024-08-31T06:09:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.605+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1919793096 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c41a86e0 con 0x7fb8c4103920 2024-08-31T06:09:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.605+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1919793096 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c41a8c10 con 0x7fb8c4103920 2024-08-31T06:09:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.605+0000 7fb8c0ff9640 1 -- 172.21.15.53:0/1919793096 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8b4003a80 con 0x7fb8c4103920 2024-08-31T06:09:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.605+0000 7fb8c0ff9640 1 -- 172.21.15.53:0/1919793096 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4035070 con 0x7fb8c4103920 2024-08-31T06:09:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8d068f740 1 Processor -- start 2024-08-31T06:09:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8d068f740 1 -- start start 2024-08-31T06:09:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8c0ff9640 1 -- 172.21.15.53:0/1919793096 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb8b4043400 con 0x7fb8c4103920 2024-08-31T06:09:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 0x55d1953c4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ff61b0 0x55d1953c4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ffe390 0x55d1953c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8d068f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d19533b630 con 0x55d19501f070 2024-08-31T06:09:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8d068f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d19532abc0 con 0x55d194ffe390 2024-08-31T06:09:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8d068f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d19532eb70 con 0x55d194ff61b0 2024-08-31T06:09:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 0x55d1953c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8c37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ff61b0 0x55d1953c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 0x55d1953c4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58040/0 (socket says 172.21.15.53:58040) 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1192824939 learned_addr learned my addr 172.21.15.53:0/1192824939 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.608+0000 7fb8c2ffd640 1 --2- 172.21.15.53:0/1192824939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ffe390 0x55d1953c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1192824939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ff61b0 msgr2=0x55d1953c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/1192824939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ff61b0 0x55d1953c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1192824939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ffe390 msgr2=0x55d1953c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/1192824939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ffe390 0x55d1953c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1192824939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19508a650 con 0x55d19501f070 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/1192824939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 0x55d1953c4300 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0118b0 tx=0x7fb8bc011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c272a3d75efdb917 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8c0ff9640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8ac0b4d20 0x7fb8ac0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8a9ffb640 1 -- 172.21.15.53:0/1192824939 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc01e070 con 0x55d19501f070 2024-08-31T06:09:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8a9ffb640 1 -- 172.21.15.53:0/1192824939 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8bc00fe50 con 0x55d19501f070 2024-08-31T06:09:52.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8a9ffb640 1 -- 172.21.15.53:0/1192824939 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc019d20 con 0x55d19501f070 2024-08-31T06:09:52.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8c37fe640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8ac0b4d20 0x7fb8ac0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.609+0000 7fb8c0ff9640 1 -- 172.21.15.53:0/1919793096 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb8b4105300 con 0x7fb8c4103920 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.610+0000 7fb8d068f740 1 -- 172.21.15.53:0/1192824939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 msgr2=0x55d1953c4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.610+0000 7fb8c37fe640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8ac0b4d20 0x7fb8ac0b7230 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4102b00 tx=0x7fb8b41077e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.610+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1192824939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 0x55d1953c4300 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0118b0 tx=0x7fb8bc011d70 comp rx=0 tx=0).stop 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.610+0000 7fb8d068f740 1 -- 172.21.15.53:0/1192824939 shutdown_connections 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.610+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1192824939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ffe390 0x55d1953c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.610+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1192824939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ff61b0 0x55d1953c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.610+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1192824939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 0x55d1953c4300 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.610+0000 7fb8d068f740 1 -- 172.21.15.53:0/1192824939 >> 172.21.15.53:0/1192824939 conn(0x55d195013460 msgr2=0x55d1953c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.610+0000 7fb8d068f740 1 -- 172.21.15.53:0/1192824939 shutdown_connections 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.610+0000 7fb8d068f740 1 -- 172.21.15.53:0/1192824939 wait complete. 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.611+0000 7fb8d068f740 1 -- start start 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.611+0000 7fb8d068f740 1 Processor -- start 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.611+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ff61b0 0x55d1953cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.611+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ffe390 0x55d1953cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.611+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19501f070 0x55d1953dbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.611+0000 7fb8d068f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d19518d700 con 0x55d194ff61b0 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.611+0000 7fb8d068f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d1952b1700 con 0x55d19501f070 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.611+0000 7fb8d068f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d1953d2ae0 con 0x55d194ffe390 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8d068f740 10 client.0 _ll_register_callbacks cb 0x55d1952e0dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ff61b0 0x55d1953cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ff61b0 0x55d1953cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58056/0 (socket says 172.21.15.53:58056) 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1287975940 learned_addr learned my addr 172.21.15.53:0/1287975940 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c2ffd640 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ffe390 0x55d1953cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19501f070 0x55d1953dbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1287975940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ffe390 msgr2=0x55d1953cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ffe390 0x55d1953cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1287975940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19501f070 msgr2=0x55d1953dbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19501f070 0x55d1953dbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1287975940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1952ea8b0 con 0x55d194ff61b0 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c2ffd640 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ffe390 0x55d1953cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ff61b0 0x55d1953cf9b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc000f80 tx=0x7fb8bc0199c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad4d96e2ccccfce server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/1287975940 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc01e040 con 0x55d194ff61b0 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/1287975940 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb8bc004a40 con 0x55d194ff61b0 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.612+0000 7fb8d068f740 1 -- 172.21.15.53:0/1287975940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8bc00fe50 con 0x55d194ff61b0 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/1287975940 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb8bc035050 con 0x55d194ff61b0 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8d068f740 10 client.17217 fetch_fsmap learned FSMap version 34 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8d068f740 1 -- 172.21.15.53:0/1287975940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d1953de810 con 0x55d194ff61b0 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/1287975940 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8bc00fe50 con 0x55d194ff61b0 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/1287975940 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb8bc030030 con 0x55d194ff61b0 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8d068f740 10 client.17217 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8d068f740 10 client.17217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8d068f740 20 client.17217 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d194fdd9f0 0x55d1953e1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8d068f740 4 client.17217 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8d068f740 1 -- 172.21.15.53:0/1287975940 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d19533d580 con 0x55d194fdd9f0 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.613+0000 7fb8c2ffd640 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d194fdd9f0 0x55d1953e1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.614+0000 7fb8a2ffd640 10 client.17217 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.614+0000 7fb8c2ffd640 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d194fdd9f0 0x55d1953e1b70 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b29b51ff1be7b3c server_cookie=4882545ba6d885ec in_seq=0 out_seq=0 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/1287975940 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d19533d580 con 0x55d194fdd9f0 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8a2ffd640 10 client.17217 handle_command_reply: tid=0 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 1 client.17217 shutdown 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 1 -- 172.21.15.53:0/1287975940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ff61b0 msgr2=0x55d1953cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ff61b0 0x55d1953cf9b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc000f80 tx=0x7fb8bc0199c0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 1 -- 172.21.15.53:0/1287975940 shutdown_connections 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d194fdd9f0 0x55d1953e1b70 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d19501f070 0x55d1953dbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ffe390 0x55d1953cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1287975940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ff61b0 0x55d1953cf9b0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 1 -- 172.21.15.53:0/1287975940 >> 172.21.15.53:0/1287975940 conn(0x55d195013460 msgr2=0x55d1953c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8a2ffd640 0 client.17217 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 1 -- 172.21.15.53:0/1287975940 shutdown_connections 2024-08-31T06:09:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 1 -- 172.21.15.53:0/1287975940 wait complete. 2024-08-31T06:09:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.615+0000 7fb8d068f740 20 client.17217 trim_cache size 0 max 16384 2024-08-31T06:09:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8d068f740 1 Processor -- start 2024-08-31T06:09:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8d068f740 1 -- start start 2024-08-31T06:09:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ffe390 0x55d1953d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 0x55d1953c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8d068f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b000e820 con 0x55d19501f070 2024-08-31T06:09:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8d068f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b00103c0 con 0x55d194ff61b0 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8d068f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b000eef0 con 0x55d194ffe390 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 0x55d1953c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:40268/0 (socket says 172.21.15.53:40268) 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.633+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1838965024 learned_addr learned my addr 172.21.15.53:0/1838965024 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.634+0000 7fb8c2ffd640 1 --2- 172.21.15.53:0/1838965024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ffe390 0x55d1953d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.634+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1838965024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ffe390 msgr2=0x55d1953d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.634+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/1838965024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ffe390 0x55d1953d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.634+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1838965024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 msgr2=0x55d1953c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.634+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/1838965024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 0x55d1953c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.634+0000 7fb8c3fff640 1 -- 172.21.15.53:0/1838965024 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1953d04b0 con 0x55d194ff61b0 2024-08-31T06:09:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.634+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/1838965024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953ce8a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009560 tx=0x7fb8bc011d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59eb7fb3006ce593 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.634+0000 7fb8a97fa640 1 -- 172.21.15.53:0/1838965024 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc01e070 con 0x55d194ff61b0 2024-08-31T06:09:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.634+0000 7fb8a97fa640 1 -- 172.21.15.53:0/1838965024 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8bc026ca0 con 0x55d194ff61b0 2024-08-31T06:09:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.634+0000 7fb8a97fa640 1 -- 172.21.15.53:0/1838965024 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc0112a0 con 0x55d194ff61b0 2024-08-31T06:09:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.635+0000 7fb8d068f740 1 -- 172.21.15.53:0/1838965024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 msgr2=0x55d1953ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.635+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1838965024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953ce8a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009560 tx=0x7fb8bc011d70 comp rx=0 tx=0).stop 2024-08-31T06:09:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.635+0000 7fb8d068f740 1 -- 172.21.15.53:0/1838965024 shutdown_connections 2024-08-31T06:09:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.635+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1838965024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d19501f070 0x55d1953c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.635+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1838965024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d194ffe390 0x55d1953d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.635+0000 7fb8d068f740 1 --2- 172.21.15.53:0/1838965024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953ce8a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.635+0000 7fb8d068f740 1 -- 172.21.15.53:0/1838965024 >> 172.21.15.53:0/1838965024 conn(0x55d195013460 msgr2=0x55d1953d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.635+0000 7fb8d068f740 1 -- 172.21.15.53:0/1838965024 shutdown_connections 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.636+0000 7fb8d068f740 1 -- 172.21.15.53:0/1838965024 wait complete. 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.636+0000 7fb8d068f740 1 -- start start 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.636+0000 7fb8d068f740 1 Processor -- start 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ffe390 0x55d1953d5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8d068f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d19501f070 0x55d19544a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8d068f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b000fcf0 con 0x55d194ffe390 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8d068f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b000f5c0 con 0x55d194ff61b0 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8d068f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b000c800 con 0x55d19501f070 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8d068f740 10 client.0 _ll_register_callbacks cb 0x7fb8b4108d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ffe390 0x55d1953d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953d4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:40280/0 (socket says 172.21.15.53:40280) 2024-08-31T06:09:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ffe390 0x55d1953d5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58082/0 (socket says 172.21.15.53:58082) 2024-08-31T06:09:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c3fff640 1 -- 172.21.15.53:0/2524753062 learned_addr learned my addr 172.21.15.53:0/2524753062 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d19501f070 0x55d19544a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c3fff640 1 -- 172.21.15.53:0/2524753062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d19501f070 msgr2=0x55d19544a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d19501f070 0x55d19544a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c3fff640 1 -- 172.21.15.53:0/2524753062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ffe390 msgr2=0x55d1953d5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ffe390 0x55d1953d5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c3fff640 1 -- 172.21.15.53:0/2524753062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19544aa50 con 0x55d194ff61b0 2024-08-31T06:09:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c2ffd640 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ffe390 0x55d1953d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8c3fff640 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953d4ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc026ba0 tx=0x7fb8bc019740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38b15206203bc6d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.637+0000 7fb8a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/2524753062 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc01e070 con 0x55d194ff61b0 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/2524753062 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fb8bc011030 con 0x55d194ff61b0 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8d068f740 1 -- 172.21.15.53:0/2524753062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8bc026ca0 con 0x55d194ff61b0 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/2524753062 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb8bc04d050 con 0x55d194ff61b0 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8d068f740 10 client.26585 fetch_fsmap learned FSMap version 34 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8d068f740 1 -- 172.21.15.53:0/2524753062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d19544bcc0 con 0x55d194ff61b0 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/2524753062 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8bc026ca0 con 0x55d194ff61b0 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/2524753062 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb8bc030040 con 0x55d194ff61b0 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8d068f740 10 client.26585 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8d068f740 10 client.26585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8d068f740 20 client.26585 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8d068f740 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d194fb2da0 0x55d19544e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8d068f740 4 client.26585 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:09:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.638+0000 7fb8d068f740 1 -- 172.21.15.53:0/2524753062 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d195339020 con 0x55d194fb2da0 2024-08-31T06:09:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.639+0000 7fb8c2ffd640 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d194fb2da0 0x55d19544e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.639+0000 7fb8a2ffd640 10 client.26585 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:52.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.639+0000 7fb8c2ffd640 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d194fb2da0 0x55d19544e3f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e48de6742df5b61b server_cookie=dcc8a0bffc442a75 in_seq=0 out_seq=0 2024-08-31T06:09:52.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8a2ffd640 1 -- 172.21.15.53:0/2524753062 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x55d195339020 con 0x55d194fb2da0 2024-08-31T06:09:52.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8a2ffd640 10 client.26585 handle_command_reply: tid=0 2024-08-31T06:09:52.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 1 client.26585 shutdown 2024-08-31T06:09:52.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 1 -- 172.21.15.53:0/2524753062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 msgr2=0x55d1953d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:52.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953d4ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc026ba0 tx=0x7fb8bc019740 comp rx=0 tx=0).stop 2024-08-31T06:09:52.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 1 -- 172.21.15.53:0/2524753062 shutdown_connections 2024-08-31T06:09:52.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d194fb2da0 0x55d19544e3f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d19501f070 0x55d19544a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d194ffe390 0x55d1953d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 1 --2- 172.21.15.53:0/2524753062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d194ff61b0 0x55d1953d4ac0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 1 -- 172.21.15.53:0/2524753062 >> 172.21.15.53:0/2524753062 conn(0x55d195013460 msgr2=0x55d1953d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8a2ffd640 0 client.26585 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:09:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 1 -- 172.21.15.53:0/2524753062 shutdown_connections 2024-08-31T06:09:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 1 -- 172.21.15.53:0/2524753062 wait complete. 2024-08-31T06:09:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.640+0000 7fb8d068f740 20 client.26585 trim_cache size 0 max 16384 2024-08-31T06:09:52.647 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:09:52.647 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:09:52.647 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:09:52.647 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:09:52.647 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:09:52.648 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:09:52.648 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:52.648 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:52.648 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:52.648 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:52.648 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:52.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:52.648 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:09:52.648 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:09:52.648 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:52.648 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:09:52.649 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:52.650 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:09:52.651 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:09:52.652 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:09:52.652 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:09:52.652 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:09:52.652 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:09:52.652 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:09:52.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1919793096 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8ac0b4d20 msgr2=0x7fb8ac0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:52.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8ac0b4d20 0x7fb8ac0b7230 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4102b00 tx=0x7fb8b41077e0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1919793096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c4103920 msgr2=0x7fb8c40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:52.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c4103920 0x7fb8c40754b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4005940 tx=0x7fb8b4005e10 comp rx=0 tx=0).stop 2024-08-31T06:09:52.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1919793096 shutdown_connections 2024-08-31T06:09:52.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8ac0b4d20 0x7fb8ac0b7230 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c4109bb0 0x7fb8c4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c4109260 0x7fb8c40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 --2- 172.21.15.53:0/1919793096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c4103920 0x7fb8c40754b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:52.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1919793096 >> 172.21.15.53:0/1919793096 conn(0x7fb8c40ff3b0 msgr2=0x7fb8c41017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:52.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1919793096 shutdown_connections 2024-08-31T06:09:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:52.641+0000 7fb8ca11a640 1 -- 172.21.15.53:0/1919793096 wait complete. 2024-08-31T06:09:52.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 89664 1.95 MB/sec execute 102 sec latency 15.484 ms 2024-08-31T06:09:53.555 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:09:53.556 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:09:53.829 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:53.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 90211 1.98 MB/sec execute 103 sec latency 15.578 ms 2024-08-31T06:09:54.228 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:53 smithi053 ceph-mon[18924]: pgmap v471: 97 pgs: 97 active+clean; 57 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.3 MiB/s wr, 141 op/s 2024-08-31T06:09:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:53 smithi130 ceph-mon[22266]: pgmap v471: 97 pgs: 97 active+clean; 57 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.3 MiB/s wr, 141 op/s 2024-08-31T06:09:54.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:53 smithi153 ceph-mon[22320]: pgmap v471: 97 pgs: 97 active+clean; 57 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.3 MiB/s wr, 141 op/s 2024-08-31T06:09:54.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.485+0000 7fa658bf1640 1 -- 172.21.15.53:0/303723658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa654102880 msgr2=0x7fa654102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:54.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.485+0000 7fa658bf1640 1 --2- 172.21.15.53:0/303723658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa654102880 0x7fa654102c90 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa644009900 tx=0x7fa64402a410 comp rx=0 tx=0).stop 2024-08-31T06:09:54.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.485+0000 7fa658bf1640 1 -- 172.21.15.53:0/303723658 shutdown_connections 2024-08-31T06:09:54.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.485+0000 7fa658bf1640 1 --2- 172.21.15.53:0/303723658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa654108ac0 0x7fa65410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:54.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.485+0000 7fa658bf1640 1 --2- 172.21.15.53:0/303723658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa654108170 0x7fa654108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:54.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.485+0000 7fa658bf1640 1 --2- 172.21.15.53:0/303723658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa654102880 0x7fa654102c90 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:54.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.485+0000 7fa658bf1640 1 -- 172.21.15.53:0/303723658 >> 172.21.15.53:0/303723658 conn(0x7fa654079530 msgr2=0x7fa654079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:54.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.485+0000 7fa658bf1640 1 -- 172.21.15.53:0/303723658 shutdown_connections 2024-08-31T06:09:54.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.485+0000 7fa658bf1640 1 -- 172.21.15.53:0/303723658 wait complete. 2024-08-31T06:09:54.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.486+0000 7fa658bf1640 1 Processor -- start 2024-08-31T06:09:54.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.486+0000 7fa658bf1640 1 -- start start 2024-08-31T06:09:54.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa658bf1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa654108170 0x7fa65419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:54.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa658bf1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa654108ac0 0x7fa65419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:54.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa658bf1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6541a1c50 0x7fa6541a2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa658bf1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa654112640 con 0x7fa654108ac0 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa658bf1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa6541124c0 con 0x7fa6541a1c50 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa658bf1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6541127c0 con 0x7fa654108170 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa651d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa654108ac0 0x7fa65419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa65259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa654108170 0x7fa65419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa651d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa654108ac0 0x7fa65419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60864/0 (socket says 172.21.15.53:60864) 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa651d9b640 1 -- 172.21.15.53:0/4187879680 learned_addr learned my addr 172.21.15.53:0/4187879680 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa652d9d640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6541a1c50 0x7fa6541a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa65259c640 1 -- 172.21.15.53:0/4187879680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6541a1c50 msgr2=0x7fa6541a2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa65259c640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6541a1c50 0x7fa6541a2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa65259c640 1 -- 172.21.15.53:0/4187879680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa654108ac0 msgr2=0x7fa65419ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:54.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa65259c640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa654108ac0 0x7fa65419ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa65259c640 1 -- 172.21.15.53:0/4187879680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6541a2830 con 0x7fa654108170 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.487+0000 7fa651d9b640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa654108ac0 0x7fa65419ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.488+0000 7fa65259c640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa654108170 0x7fa65419c4d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa644008000 tx=0x7fa644004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.488+0000 7fa6437fe640 1 -- 172.21.15.53:0/4187879680 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64403f030 con 0x7fa654108170 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.488+0000 7fa658bf1640 1 -- 172.21.15.53:0/4187879680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6541a8dd0 con 0x7fa654108170 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.488+0000 7fa6437fe640 1 -- 172.21.15.53:0/4187879680 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa644004440 con 0x7fa654108170 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.488+0000 7fa6437fe640 1 -- 172.21.15.53:0/4187879680 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa644035070 con 0x7fa654108170 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.488+0000 7fa658bf1640 1 -- 172.21.15.53:0/4187879680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6541a9170 con 0x7fa654108170 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.489+0000 7fa658bf1640 1 -- 172.21.15.53:0/4187879680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa654102c90 con 0x7fa654108170 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.490+0000 7fa6437fe640 1 -- 172.21.15.53:0/4187879680 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa644042030 con 0x7fa654108170 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.491+0000 7fa6437fe640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa63c0b4ca0 0x7fa63c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.492+0000 7fa651d9b640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa63c0b4ca0 0x7fa63c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:54.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.492+0000 7fa6437fe640 1 -- 172.21.15.53:0/4187879680 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa6441058a0 con 0x7fa654108170 2024-08-31T06:09:54.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.492+0000 7fa651d9b640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa63c0b4ca0 0x7fa63c0b71b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa654107f40 tx=0x7fa648005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:54.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.496+0000 7fa6437fe640 1 -- 172.21.15.53:0/4187879680 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa6440cbfe0 con 0x7fa654108170 2024-08-31T06:09:54.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.731+0000 7fa658bf1640 1 -- 172.21.15.53:0/4187879680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa65402e430 con 0x7fa654108170 2024-08-31T06:09:54.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.731+0000 7fa6437fe640 1 -- 172.21.15.53:0/4187879680 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11988 (secure 0 0 0) 0x7fa6440d07a0 con 0x7fa654108170 2024-08-31T06:09:54.734 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:09:54.734 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"btime":"2024-08-31T06:09:25:953687+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:09:25.529444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:09:54.734 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 34 2024-08-31T06:09:54.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 -- 172.21.15.53:0/4187879680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa63c0b4ca0 msgr2=0x7fa63c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:54.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa63c0b4ca0 0x7fa63c0b71b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa654107f40 tx=0x7fa648005f90 comp rx=0 tx=0).stop 2024-08-31T06:09:54.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 -- 172.21.15.53:0/4187879680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa654108170 msgr2=0x7fa65419c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:54.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa654108170 0x7fa65419c4d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa644008000 tx=0x7fa644004040 comp rx=0 tx=0).stop 2024-08-31T06:09:54.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 -- 172.21.15.53:0/4187879680 shutdown_connections 2024-08-31T06:09:54.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa63c0b4ca0 0x7fa63c0b71b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:54.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6541a1c50 0x7fa6541a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:54.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa654108ac0 0x7fa65419ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:54.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 --2- 172.21.15.53:0/4187879680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa654108170 0x7fa65419c4d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:54.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 -- 172.21.15.53:0/4187879680 >> 172.21.15.53:0/4187879680 conn(0x7fa654079530 msgr2=0x7fa65406b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:54.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 -- 172.21.15.53:0/4187879680 shutdown_connections 2024-08-31T06:09:54.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:54.734+0000 7fa658bf1640 1 -- 172.21.15.53:0/4187879680 wait complete. 2024-08-31T06:09:54.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 90788 1.96 MB/sec execute 104 sec latency 19.221 ms 2024-08-31T06:09:55.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:55 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4187879680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:09:55.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:55 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4187879680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:09:55.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:55 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4187879680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:09:55.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:09:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:55.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 91299 1.97 MB/sec execute 105 sec latency 19.254 ms 2024-08-31T06:09:56.333 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:56 smithi053 ceph-mon[18924]: pgmap v472: 97 pgs: 97 active+clean; 58 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.4 MiB/s wr, 140 op/s 2024-08-31T06:09:56.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:56 smithi130 ceph-mon[22266]: pgmap v472: 97 pgs: 97 active+clean; 58 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.4 MiB/s wr, 140 op/s 2024-08-31T06:09:56.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:56 smithi153 ceph-mon[22320]: pgmap v472: 97 pgs: 97 active+clean; 58 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.4 MiB/s wr, 140 op/s 2024-08-31T06:09:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.436+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/218076568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa44102800 msgr2=0x7ffa44102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.436+0000 7ffa4bd1c640 1 --2- 172.21.15.53:0/218076568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa44102800 0x7ffa44102c10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009860 tx=0x7ffa4002a340 comp rx=0 tx=0).stop 2024-08-31T06:09:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.436+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/218076568 shutdown_connections 2024-08-31T06:09:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.436+0000 7ffa4bd1c640 1 --2- 172.21.15.53:0/218076568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa44108a90 0x7ffa4410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.436+0000 7ffa4bd1c640 1 --2- 172.21.15.53:0/218076568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa44108140 0x7ffa44108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.436+0000 7ffa4bd1c640 1 --2- 172.21.15.53:0/218076568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa44102800 0x7ffa44102c10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.436+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/218076568 >> 172.21.15.53:0/218076568 conn(0x7ffa440794a0 msgr2=0x7ffa440798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.436+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/218076568 shutdown_connections 2024-08-31T06:09:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.436+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/218076568 wait complete. 2024-08-31T06:09:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa4bd1c640 1 Processor -- start 2024-08-31T06:09:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa4bd1c640 1 -- start start 2024-08-31T06:09:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa4bd1c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa44102800 0x7ffa441990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa4bd1c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa44108140 0x7ffa44199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa4bd1c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa44108a90 0x7ffa4419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa4bd1c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffa44112610 con 0x7ffa44108a90 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa4bd1c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffa44112490 con 0x7ffa44102800 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa4bd1c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffa44112790 con 0x7ffa44108140 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa4a2b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa44108a90 0x7ffa4419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa4a2b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa44108a90 0x7ffa4419e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60892/0 (socket says 172.21.15.53:60892) 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa492b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa44108140 0x7ffa44199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa4a2b9640 1 -- 172.21.15.53:0/3462071326 learned_addr learned my addr 172.21.15.53:0/3462071326 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.437+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa44102800 0x7ffa441990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa492b7640 1 -- 172.21.15.53:0/3462071326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa44102800 msgr2=0x7ffa441990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa492b7640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa44102800 0x7ffa441990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa492b7640 1 -- 172.21.15.53:0/3462071326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa44108a90 msgr2=0x7ffa4419e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa492b7640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa44108a90 0x7ffa4419e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa492b7640 1 -- 172.21.15.53:0/3462071326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4419f010 con 0x7ffa44108140 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa4a2b9640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa44108a90 0x7ffa4419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa492b7640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa44108140 0x7ffa44199640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa4406b6b0 tx=0x7ffa3400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa3affd640 1 -- 172.21.15.53:0/3462071326 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3400cc40 con 0x7ffa44108140 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa3affd640 1 -- 172.21.15.53:0/3462071326 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa3400cde0 con 0x7ffa44108140 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa3affd640 1 -- 172.21.15.53:0/3462071326 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34004800 con 0x7ffa44108140 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/3462071326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4419f300 con 0x7ffa44108140 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.438+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/3462071326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4406b920 con 0x7ffa44108140 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.441+0000 7ffa52291740 1 Processor -- start 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.441+0000 7ffa3affd640 1 -- 172.21.15.53:0/3462071326 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ffa34004a20 con 0x7ffa44108140 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.441+0000 7ffa52291740 1 -- start start 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa52291740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16ba070 0x55b2d1a5f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa52291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a5f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa52291740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d1699390 0x55b2d1a5fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa52291740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b2d19d6680 con 0x55b2d16ba070 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa52291740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b2d19c5c10 con 0x55b2d16911b0 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa52291740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b2d19c9bc0 con 0x55b2d1699390 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa4a2b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16ba070 0x55b2d1a5f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa4a2b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16ba070 0x55b2d1a5f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60908/0 (socket says 172.21.15.53:60908) 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa4a2b9640 1 -- 172.21.15.53:0/1452902748 learned_addr learned my addr 172.21.15.53:0/1452902748 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/1452902748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a5f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa492b7640 1 --2- 172.21.15.53:0/1452902748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d1699390 0x55b2d1a5fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa4a2b9640 1 -- 172.21.15.53:0/1452902748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d1699390 msgr2=0x55b2d1a5fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa4a2b9640 1 --2- 172.21.15.53:0/1452902748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d1699390 0x55b2d1a5fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa4a2b9640 1 -- 172.21.15.53:0/1452902748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 msgr2=0x55b2d1a5f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa4a2b9640 1 --2- 172.21.15.53:0/1452902748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a5f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa4a2b9640 1 -- 172.21.15.53:0/1452902748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2d1725650 con 0x55b2d16ba070 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/1452902748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a5f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa3affd640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa300b4d20 0x7ffa300b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa4a2b9640 1 --2- 172.21.15.53:0/1452902748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16ba070 0x55b2d1a5f350 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00ea30 tx=0x7ffa3c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12974356c72f50df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.442+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa300b4d20 0x7ffa300b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.443+0000 7ffa3affd640 1 -- 172.21.15.53:0/3462071326 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7ffa340e5470 con 0x7ffa44108140 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.443+0000 7ffa2ffff640 1 -- 172.21.15.53:0/1452902748 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c01c030 con 0x55b2d16ba070 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.443+0000 7ffa2ffff640 1 -- 172.21.15.53:0/1452902748 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa3c00bbf0 con 0x55b2d16ba070 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.443+0000 7ffa2ffff640 1 -- 172.21.15.53:0/1452902748 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0175c0 con 0x55b2d16ba070 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa52291740 1 -- 172.21.15.53:0/1452902748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16ba070 msgr2=0x55b2d1a5f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa300b4d20 0x7ffa300b7230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffa400057c0 tx=0x7ffa400058b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa52291740 1 --2- 172.21.15.53:0/1452902748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16ba070 0x55b2d1a5f350 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00ea30 tx=0x7ffa3c0095c0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa52291740 1 -- 172.21.15.53:0/1452902748 shutdown_connections 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa52291740 1 --2- 172.21.15.53:0/1452902748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d1699390 0x55b2d1a5fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa52291740 1 --2- 172.21.15.53:0/1452902748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a5f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa52291740 1 --2- 172.21.15.53:0/1452902748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16ba070 0x55b2d1a5f350 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa52291740 1 -- 172.21.15.53:0/1452902748 >> 172.21.15.53:0/1452902748 conn(0x55b2d16ae460 msgr2=0x55b2d1a5d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa52291740 1 -- 172.21.15.53:0/1452902748 shutdown_connections 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa52291740 1 -- 172.21.15.53:0/1452902748 wait complete. 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa52291740 1 -- start start 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.444+0000 7ffa52291740 1 Processor -- start 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.445+0000 7ffa52291740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16911b0 0x55b2d1a6aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.445+0000 7ffa52291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d1699390 0x55b2d1a6aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.445+0000 7ffa49ab8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16911b0 0x55b2d1a6aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.445+0000 7ffa52291740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a76e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.445+0000 7ffa52291740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b2d1828700 con 0x55b2d16911b0 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.445+0000 7ffa52291740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b2d194c750 con 0x55b2d1699390 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.445+0000 7ffa52291740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b2d1a6db30 con 0x55b2d16ba070 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.445+0000 7ffa49ab8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16911b0 0x55b2d1a6aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60914/0 (socket says 172.21.15.53:60914) 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.445+0000 7ffa49ab8640 1 -- 172.21.15.53:0/1093882059 learned_addr learned my addr 172.21.15.53:0/1093882059 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.445+0000 7ffa492b7640 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d1699390 0x55b2d1a6aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.445+0000 7ffa4a2b9640 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a76e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.446+0000 7ffa52291740 10 client.0 _ll_register_callbacks cb 0x55b2d197be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.446+0000 7ffa4a2b9640 1 -- 172.21.15.53:0/1093882059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d1699390 msgr2=0x55b2d1a6aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.446+0000 7ffa4a2b9640 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d1699390 0x55b2d1a6aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.446+0000 7ffa4a2b9640 1 -- 172.21.15.53:0/1093882059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16911b0 msgr2=0x55b2d1a6aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.446+0000 7ffa4a2b9640 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16911b0 0x55b2d1a6aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.446+0000 7ffa4a2b9640 1 -- 172.21.15.53:0/1093882059 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2d1985900 con 0x55b2d16ba070 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.446+0000 7ffa52291740 1 -- 172.21.15.53:0/1093882059 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa3c00bbf0 con 0x55b2d16ba070 2024-08-31T06:09:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.446+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16911b0 0x55b2d1a6aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.446+0000 7ffa4a2b9640 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a76e20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c018cb0 tx=0x7ffa3c018b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=167b125a79f7f65f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.446+0000 7ffa2d7fa640 10 client.26596 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa2d7fa640 1 -- 172.21.15.53:0/1093882059 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c018600 con 0x55b2d16ba070 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa2d7fa640 1 -- 172.21.15.53:0/1093882059 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7ffa3c0187a0 con 0x55b2d16ba070 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa2d7fa640 1 -- 172.21.15.53:0/1093882059 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffa3c005040 con 0x55b2d16ba070 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa52291740 10 client.26596 fetch_fsmap learned FSMap version 34 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa52291740 1 -- 172.21.15.53:0/1093882059 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55b2d1a79810 con 0x55b2d16ba070 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa2d7fa640 1 -- 172.21.15.53:0/1093882059 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ffa3c00b040 con 0x55b2d16ba070 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa52291740 10 client.26596 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa52291740 10 client.26596 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa52291740 20 client.26596 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa52291740 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b2d16789f0 0x55b2d1a7cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa52291740 4 client.26596 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa52291740 1 -- 172.21.15.53:0/1093882059 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2d19d85d0 con 0x55b2d16789f0 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.447+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b2d16789f0 0x55b2d1a7cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.448+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b2d16789f0 0x55b2d1a7cb70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=83e4bb71ac0b9624 server_cookie=add68a1088ad19c6 in_seq=0 out_seq=0 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.448+0000 7ffa2d7fa640 10 client.26596 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa2d7fa640 1 -- 172.21.15.53:0/1093882059 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b2d19d85d0 con 0x55b2d16789f0 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa2d7fa640 10 client.26596 handle_command_reply: tid=0 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 1 client.26596 shutdown 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 1 -- 172.21.15.53:0/1093882059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 msgr2=0x55b2d1a76e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a76e20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c018cb0 tx=0x7ffa3c018b10 comp rx=0 tx=0).stop 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 1 -- 172.21.15.53:0/1093882059 shutdown_connections 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b2d16789f0 0x55b2d1a7cb70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a76e20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d1699390 0x55b2d1a6aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 1 --2- 172.21.15.53:0/1093882059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d16911b0 0x55b2d1a6aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa2d7fa640 0 client.26596 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 1 -- 172.21.15.53:0/1093882059 >> 172.21.15.53:0/1093882059 conn(0x55b2d16ae460 msgr2=0x55b2d1a62530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 1 -- 172.21.15.53:0/1093882059 shutdown_connections 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 1 -- 172.21.15.53:0/1093882059 wait complete. 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.449+0000 7ffa52291740 20 client.26596 trim_cache size 0 max 16384 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.465+0000 7ffa52291740 1 Processor -- start 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.465+0000 7ffa52291740 1 -- start start 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.465+0000 7ffa52291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a6af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.465+0000 7ffa52291740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a76d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.465+0000 7ffa52291740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a67ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.465+0000 7ffa52291740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441ad1d0 con 0x55b2d1699390 2024-08-31T06:09:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.465+0000 7ffa52291740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441aed70 con 0x55b2d16911b0 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.465+0000 7ffa52291740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441ad8a0 con 0x55b2d16ba070 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa492b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a76d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa492b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a76d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60928/0 (socket says 172.21.15.53:60928) 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa492b7640 1 -- 172.21.15.53:0/2792787720 learned_addr learned my addr 172.21.15.53:0/2792787720 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/2792787720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a6af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa4a2b9640 1 --2- 172.21.15.53:0/2792787720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a67ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa492b7640 1 -- 172.21.15.53:0/2792787720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 msgr2=0x55b2d1a67ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa492b7640 1 --2- 172.21.15.53:0/2792787720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a67ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa492b7640 1 -- 172.21.15.53:0/2792787720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 msgr2=0x55b2d1a6af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa492b7640 1 --2- 172.21.15.53:0/2792787720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a6af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa492b7640 1 -- 172.21.15.53:0/2792787720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2d1a5db30 con 0x55b2d1699390 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa492b7640 1 --2- 172.21.15.53:0/2792787720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a76d90 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ffa34005330 tx=0x7ffa340045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2968122b3961ef33 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa2f7fe640 1 -- 172.21.15.53:0/2792787720 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3401c040 con 0x55b2d1699390 2024-08-31T06:09:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.466+0000 7ffa2f7fe640 1 -- 172.21.15.53:0/2792787720 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa340ab610 con 0x55b2d1699390 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.467+0000 7ffa2f7fe640 1 -- 172.21.15.53:0/2792787720 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa340b4e20 con 0x55b2d1699390 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.467+0000 7ffa52291740 1 -- 172.21.15.53:0/2792787720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 msgr2=0x55b2d1a76d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.467+0000 7ffa52291740 1 --2- 172.21.15.53:0/2792787720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a76d90 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ffa34005330 tx=0x7ffa340045d0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.467+0000 7ffa52291740 1 -- 172.21.15.53:0/2792787720 shutdown_connections 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.467+0000 7ffa52291740 1 --2- 172.21.15.53:0/2792787720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a67ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.468+0000 7ffa52291740 1 --2- 172.21.15.53:0/2792787720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a76d90 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.468+0000 7ffa52291740 1 --2- 172.21.15.53:0/2792787720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a6af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.468+0000 7ffa52291740 1 -- 172.21.15.53:0/2792787720 >> 172.21.15.53:0/2792787720 conn(0x55b2d16ae460 msgr2=0x55b2d1a6a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.468+0000 7ffa52291740 1 -- 172.21.15.53:0/2792787720 shutdown_connections 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.468+0000 7ffa52291740 1 -- 172.21.15.53:0/2792787720 wait complete. 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.468+0000 7ffa52291740 1 -- start start 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.468+0000 7ffa52291740 1 Processor -- start 2024-08-31T06:09:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa52291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa52291740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a7db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa52291740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a7e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa52291740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441ae6a0 con 0x55b2d1699390 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa52291740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441adf70 con 0x55b2d16911b0 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa52291740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441ab1b0 con 0x55b2d16ba070 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa52291740 10 client.0 _ll_register_callbacks cb 0x7ffa3c009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa492b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a7db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa49ab8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa49ab8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a805d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:49928/0 (socket says 172.21.15.53:49928) 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa492b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a7db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60940/0 (socket says 172.21.15.53:60940) 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa49ab8640 1 -- 172.21.15.53:0/3181972910 learned_addr learned my addr 172.21.15.53:0/3181972910 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa4a2b9640 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a7e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa49ab8640 1 -- 172.21.15.53:0/3181972910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 msgr2=0x55b2d1a7e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:56.493 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:09:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a7e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa49ab8640 1 -- 172.21.15.53:0/3181972910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 msgr2=0x55b2d1a7db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a7db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa49ab8640 1 -- 172.21.15.53:0/3181972910 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2d1ae62f0 con 0x55b2d16911b0 2024-08-31T06:09:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa492b7640 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a7db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa4a2b9640 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a7e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa49ab8640 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a805d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009860 tx=0x7ffa4002a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af5f1080d6ef895e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.469+0000 7ffa2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:09:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa2d7fa640 1 -- 172.21.15.53:0/3181972910 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40037040 con 0x55b2d16911b0 2024-08-31T06:09:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa52291740 1 -- 172.21.15.53:0/3181972910 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa340ab610 con 0x55b2d16911b0 2024-08-31T06:09:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa2d7fa640 1 -- 172.21.15.53:0/3181972910 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7ffa400037f0 con 0x55b2d16911b0 2024-08-31T06:09:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa2d7fa640 1 -- 172.21.15.53:0/3181972910 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffa400039f0 con 0x55b2d16911b0 2024-08-31T06:09:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa52291740 10 client.26609 fetch_fsmap learned FSMap version 34 2024-08-31T06:09:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa52291740 1 -- 172.21.15.53:0/3181972910 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b2d1ae7480 con 0x55b2d16911b0 2024-08-31T06:09:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa2d7fa640 1 -- 172.21.15.53:0/3181972910 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa340ab610 con 0x55b2d16911b0 2024-08-31T06:09:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa2d7fa640 1 -- 172.21.15.53:0/3181972910 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ffa4004b040 con 0x55b2d16911b0 2024-08-31T06:09:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa52291740 10 client.26609 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:09:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa52291740 10 client.26609 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:09:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa52291740 20 client.26609 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa52291740 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b2d164dda0 0x55b2d1ae9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa52291740 4 client.26609 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.470+0000 7ffa52291740 1 -- 172.21.15.53:0/3181972910 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b2d19d4070 con 0x55b2d164dda0 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.471+0000 7ffa492b7640 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b2d164dda0 0x55b2d1ae9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.471+0000 7ffa492b7640 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b2d164dda0 0x55b2d1ae9b10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fee0a5f8a1e23c8e server_cookie=67a2ac66333fba08 in_seq=0 out_seq=0 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.471+0000 7ffa2d7fa640 10 client.26609 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.471+0000 7ffa2d7fa640 1 -- 172.21.15.53:0/3181972910 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b2d19d4070 con 0x55b2d164dda0 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.471+0000 7ffa2d7fa640 10 client.26609 handle_command_reply: tid=0 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.471+0000 7ffa52291740 1 client.26609 shutdown 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.471+0000 7ffa52291740 1 -- 172.21.15.53:0/3181972910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 msgr2=0x55b2d1a805d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.471+0000 7ffa52291740 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a805d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009860 tx=0x7ffa4002a340 comp rx=0 tx=0).stop 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa52291740 1 -- 172.21.15.53:0/3181972910 shutdown_connections 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa52291740 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b2d164dda0 0x55b2d1ae9b10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa52291740 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2d16ba070 0x55b2d1a7e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa52291740 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2d1699390 0x55b2d1a7db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa2d7fa640 0 client.26609 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa52291740 1 --2- 172.21.15.53:0/3181972910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2d16911b0 0x55b2d1a805d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa52291740 1 -- 172.21.15.53:0/3181972910 >> 172.21.15.53:0/3181972910 conn(0x55b2d16ae460 msgr2=0x55b2d1a6bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa52291740 1 -- 172.21.15.53:0/3181972910 shutdown_connections 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa52291740 1 -- 172.21.15.53:0/3181972910 wait complete. 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa52291740 20 client.26609 trim_cache size 0 max 16384 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/3462071326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa300b4d20 msgr2=0x7ffa300b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa4bd1c640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa300b4d20 0x7ffa300b7230 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffa400057c0 tx=0x7ffa400058b0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/3462071326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa44108140 msgr2=0x7ffa44199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa4bd1c640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa44108140 0x7ffa44199640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa4406b6b0 tx=0x7ffa3400ee50 comp rx=0 tx=0).stop 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/3462071326 shutdown_connections 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa4bd1c640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa300b4d20 0x7ffa300b7230 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa4bd1c640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa44108a90 0x7ffa4419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa4bd1c640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa44108140 0x7ffa44199640 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa4bd1c640 1 --2- 172.21.15.53:0/3462071326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa44102800 0x7ffa441990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.472+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/3462071326 >> 172.21.15.53:0/3462071326 conn(0x7ffa440794a0 msgr2=0x7ffa44106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.473+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/3462071326 shutdown_connections 2024-08-31T06:09:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:56.473+0000 7ffa4bd1c640 1 -- 172.21.15.53:0/3462071326 wait complete. 2024-08-31T06:09:56.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 92012 2.01 MB/sec execute 106 sec latency 15.227 ms 2024-08-31T06:09:57.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:09:57.546 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:57.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 92395 2.02 MB/sec execute 107 sec latency 15.294 ms 2024-08-31T06:09:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.078+0000 7f5eee2a4640 1 -- 172.21.15.53:0/3574481913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ee8104750 msgr2=0x7f5ee8104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.078+0000 7f5eee2a4640 1 --2- 172.21.15.53:0/3574481913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ee8104750 0x7f5ee8104b60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009900 tx=0x7f5ed802a410 comp rx=0 tx=0).stop 2024-08-31T06:09:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.078+0000 7f5eee2a4640 1 -- 172.21.15.53:0/3574481913 shutdown_connections 2024-08-31T06:09:58.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.078+0000 7f5eee2a4640 1 --2- 172.21.15.53:0/3574481913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ee810dbb0 0x7f5ee81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.078+0000 7f5eee2a4640 1 --2- 172.21.15.53:0/3574481913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee81050a0 0x7f5ee810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.078+0000 7f5eee2a4640 1 --2- 172.21.15.53:0/3574481913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ee8104750 0x7f5ee8104b60 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.078+0000 7f5eee2a4640 1 -- 172.21.15.53:0/3574481913 >> 172.21.15.53:0/3574481913 conn(0x7f5ee80794d0 msgr2=0x7f5ee80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.078+0000 7f5eee2a4640 1 -- 172.21.15.53:0/3574481913 shutdown_connections 2024-08-31T06:09:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.078+0000 7f5eee2a4640 1 -- 172.21.15.53:0/3574481913 wait complete. 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5eee2a4640 1 Processor -- start 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5eee2a4640 1 -- start start 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5eee2a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ee8104750 0x7f5ee819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5eee2a4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee81050a0 0x7f5ee819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5eee2a4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ee810dbb0 0x7f5ee819fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5eee2a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8113710 con 0x7f5ee8104750 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5eee2a4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8113590 con 0x7f5ee810dbb0 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5eee2a4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8113890 con 0x7f5ee81050a0 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5ee7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ee8104750 0x7f5ee819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5ee7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ee8104750 0x7f5ee819a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60952/0 (socket says 172.21.15.53:60952) 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5ee7fff640 1 -- 172.21.15.53:0/2713230643 learned_addr learned my addr 172.21.15.53:0/2713230643 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5eec841640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ee810dbb0 0x7f5ee819fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.079+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee81050a0 0x7f5ee819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.080+0000 7f5ee7fff640 1 -- 172.21.15.53:0/2713230643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee81050a0 msgr2=0x7f5ee819a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.080+0000 7f5ee7fff640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee81050a0 0x7f5ee819a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.080+0000 7f5ee7fff640 1 -- 172.21.15.53:0/2713230643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ee810dbb0 msgr2=0x7f5ee819fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.080+0000 7f5ee7fff640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ee810dbb0 0x7f5ee819fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.080+0000 7f5ee7fff640 1 -- 172.21.15.53:0/2713230643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee81a0070 con 0x7f5ee8104750 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.080+0000 7f5ee7fff640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ee8104750 0x7f5ee819a1c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5ed802a930 tx=0x7f5ed8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.080+0000 7f5ee57fa640 1 -- 172.21.15.53:0/2713230643 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed803f070 con 0x7f5ee8104750 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.080+0000 7f5eee2a4640 1 -- 172.21.15.53:0/2713230643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee81a0300 con 0x7f5ee8104750 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.080+0000 7f5ee57fa640 1 -- 172.21.15.53:0/2713230643 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ed8003e10 con 0x7f5ee8104750 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.080+0000 7f5ee57fa640 1 -- 172.21.15.53:0/2713230643 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8035030 con 0x7f5ee8104750 2024-08-31T06:09:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.080+0000 7f5eee2a4640 1 -- 172.21.15.53:0/2713230643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee81a0830 con 0x7f5ee8104750 2024-08-31T06:09:58.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.083+0000 7f5ee57fa640 1 -- 172.21.15.53:0/2713230643 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5ed8042070 con 0x7f5ee8104750 2024-08-31T06:09:58.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ef4819740 1 Processor -- start 2024-08-31T06:09:58.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ef4819740 1 -- start start 2024-08-31T06:09:58.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 0x55900e562350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 0x55900e562890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e562dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ef4819740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55900e4d9680 con 0x55900e19c390 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ef4819740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55900e4c8c10 con 0x55900e1941b0 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ef4819740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55900e4ccbc0 con 0x55900e1bd070 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ee77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e562dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ee77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e562dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60960/0 (socket says 172.21.15.53:60960) 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ee7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 0x55900e562890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ee77fe640 1 -- 172.21.15.53:0/3444814661 learned_addr learned my addr 172.21.15.53:0/3444814661 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5ee57fa640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed00b4cd0 0x7f5ed00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.084+0000 7f5eec841640 1 --2- 172.21.15.53:0/3444814661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 0x55900e562350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5ee77fe640 1 -- 172.21.15.53:0/3444814661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 msgr2=0x55900e562350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/3444814661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 0x55900e562350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5ee77fe640 1 -- 172.21.15.53:0/3444814661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 msgr2=0x55900e562890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/3444814661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 0x55900e562890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5ee77fe640 1 -- 172.21.15.53:0/3444814661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55900e228650 con 0x55900e19c390 2024-08-31T06:09:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5eec841640 1 --2- 172.21.15.53:0/3444814661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 0x55900e562350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:09:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5ee57fa640 1 -- 172.21.15.53:0/2713230643 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5ed8105c60 con 0x7f5ee8104750 2024-08-31T06:09:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5eec841640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed00b4cd0 0x7f5ed00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5ee7fff640 1 --2- 172.21.15.53:0/3444814661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 0x55900e562890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/3444814661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e562dd0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00ac30 tx=0x7f5edc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f507e0bfdc557b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5ece7fc640 1 -- 172.21.15.53:0/3444814661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc01d070 con 0x55900e19c390 2024-08-31T06:09:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5ece7fc640 1 -- 172.21.15.53:0/3444814661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5edc018ad0 con 0x55900e19c390 2024-08-31T06:09:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.085+0000 7f5ece7fc640 1 -- 172.21.15.53:0/3444814661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc010a70 con 0x55900e19c390 2024-08-31T06:09:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.086+0000 7f5ef4819740 1 -- 172.21.15.53:0/3444814661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 msgr2=0x55900e562dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.086+0000 7f5ef4819740 1 --2- 172.21.15.53:0/3444814661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e562dd0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00ac30 tx=0x7f5edc00f790 comp rx=0 tx=0).stop 2024-08-31T06:09:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.086+0000 7f5eec841640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed00b4cd0 0x7f5ed00b71e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009370 tx=0x7f5ee0004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.086+0000 7f5ef4819740 1 -- 172.21.15.53:0/3444814661 shutdown_connections 2024-08-31T06:09:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.086+0000 7f5ef4819740 1 --2- 172.21.15.53:0/3444814661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e562dd0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.086+0000 7f5ef4819740 1 --2- 172.21.15.53:0/3444814661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 0x55900e562890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.086+0000 7f5ef4819740 1 --2- 172.21.15.53:0/3444814661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 0x55900e562350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.086+0000 7f5ef4819740 1 -- 172.21.15.53:0/3444814661 >> 172.21.15.53:0/3444814661 conn(0x55900e1b1460 msgr2=0x55900e560240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.086+0000 7f5ef4819740 1 -- 172.21.15.53:0/3444814661 shutdown_connections 2024-08-31T06:09:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.086+0000 7f5ef4819740 1 -- 172.21.15.53:0/3444814661 wait complete. 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.087+0000 7f5ef4819740 1 -- start start 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.087+0000 7f5ef4819740 1 Processor -- start 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 0x55900e571e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e572380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 0x55900e57e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ef4819740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55900e32b700 con 0x55900e19c390 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ef4819740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55900e44f750 con 0x55900e1941b0 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ef4819740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55900e574e90 con 0x55900e1bd070 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ef4819740 10 client.0 _ll_register_callbacks cb 0x55900e47ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ee77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e572380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ee7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 0x55900e571e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ee77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e572380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60964/0 (socket says 172.21.15.53:60964) 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ee77fe640 1 -- 172.21.15.53:0/1155006709 learned_addr learned my addr 172.21.15.53:0/1155006709 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5eec841640 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 0x55900e57e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ee77fe640 1 -- 172.21.15.53:0/1155006709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 msgr2=0x55900e57e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 0x55900e57e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ee77fe640 1 -- 172.21.15.53:0/1155006709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 msgr2=0x55900e571e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 0x55900e571e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ee77fe640 1 -- 172.21.15.53:0/1155006709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55900e488900 con 0x55900e19c390 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5eec841640 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 0x55900e57e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ee7fff640 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 0x55900e571e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ec77fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.088+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e572380 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00a5c0 tx=0x7f5edc018650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0648bb1708ffe87 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.089+0000 7f5ec77fe640 1 -- 172.21.15.53:0/1155006709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc027020 con 0x55900e19c390 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.089+0000 7f5ec77fe640 1 -- 172.21.15.53:0/1155006709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5edc018840 con 0x55900e19c390 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.089+0000 7f5ef4819740 1 -- 172.21.15.53:0/1155006709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5edc018ad0 con 0x55900e19c390 2024-08-31T06:09:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.089+0000 7f5ec77fe640 1 -- 172.21.15.53:0/1155006709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5edc027020 con 0x55900e19c390 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.089+0000 7f5ef4819740 10 client.17259 fetch_fsmap learned FSMap version 34 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.089+0000 7f5ef4819740 1 -- 172.21.15.53:0/1155006709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55900e580be0 con 0x55900e19c390 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.089+0000 7f5ec77fe640 1 -- 172.21.15.53:0/1155006709 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5edc018ad0 con 0x55900e19c390 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.089+0000 7f5ec77fe640 1 -- 172.21.15.53:0/1155006709 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5edc010800 con 0x55900e19c390 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.090+0000 7f5ef4819740 10 client.17259 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.090+0000 7f5ef4819740 10 client.17259 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.090+0000 7f5ef4819740 20 client.17259 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.090+0000 7f5ef4819740 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55900e17b9f0 0x55900e583f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.090+0000 7f5ef4819740 4 client.17259 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.090+0000 7f5ef4819740 1 -- 172.21.15.53:0/1155006709 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55900e4db5d0 con 0x55900e17b9f0 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.090+0000 7f5ee7fff640 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55900e17b9f0 0x55900e583f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.090+0000 7f5ee7fff640 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55900e17b9f0 0x55900e583f40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e50db7053aa23388 server_cookie=1d4953f97d2b5250 in_seq=0 out_seq=0 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.090+0000 7f5ec77fe640 10 client.17259 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:09:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.091+0000 7f5ec77fe640 1 -- 172.21.15.53:0/1155006709 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55900e4db5d0 con 0x55900e17b9f0 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.091+0000 7f5ec77fe640 10 client.17259 handle_command_reply: tid=0 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.091+0000 7f5ef4819740 1 client.17259 shutdown 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.091+0000 7f5ef4819740 1 -- 172.21.15.53:0/1155006709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 msgr2=0x55900e572380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.091+0000 7f5ef4819740 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e572380 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00a5c0 tx=0x7f5edc018650 comp rx=0 tx=0).stop 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.091+0000 7f5ef4819740 1 -- 172.21.15.53:0/1155006709 shutdown_connections 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.092+0000 7f5ef4819740 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e1bd070 0x55900e57e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.092+0000 7f5ef4819740 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55900e17b9f0 0x55900e583f40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.092+0000 7f5ec77fe640 0 client.17259 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.092+0000 7f5ef4819740 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e19c390 0x55900e572380 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.092+0000 7f5ef4819740 1 --2- 172.21.15.53:0/1155006709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e1941b0 0x55900e571e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.092+0000 7f5ef4819740 1 -- 172.21.15.53:0/1155006709 >> 172.21.15.53:0/1155006709 conn(0x55900e1b1460 msgr2=0x55900e55e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.092+0000 7f5ef4819740 1 -- 172.21.15.53:0/1155006709 shutdown_connections 2024-08-31T06:09:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.092+0000 7f5ef4819740 1 -- 172.21.15.53:0/1155006709 wait complete. 2024-08-31T06:09:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.092+0000 7f5ef4819740 20 client.17259 trim_cache size 0 max 16384 2024-08-31T06:09:58.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.106+0000 7f5ef4819740 1 Processor -- start 2024-08-31T06:09:58.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.106+0000 7f5ef4819740 1 -- start start 2024-08-31T06:09:58.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.106+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e17b9f0 0x55900e56d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.106+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.106+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e19c390 0x55900e567df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.106+0000 7f5ef4819740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81ad450 con 0x55900e1941b0 2024-08-31T06:09:58.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.106+0000 7f5ef4819740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81aeff0 con 0x55900e17b9f0 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.106+0000 7f5ef4819740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81adb20 con 0x55900e19c390 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.107+0000 7f5ee77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.107+0000 7f5ee77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60968/0 (socket says 172.21.15.53:60968) 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.107+0000 7f5ee77fe640 1 -- 172.21.15.53:0/1613932994 learned_addr learned my addr 172.21.15.53:0/1613932994 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.107+0000 7f5ee7fff640 1 --2- 172.21.15.53:0/1613932994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e17b9f0 0x55900e56d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.107+0000 7f5eec841640 1 --2- 172.21.15.53:0/1613932994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e19c390 0x55900e567df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.107+0000 7f5ee77fe640 1 -- 172.21.15.53:0/1613932994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e19c390 msgr2=0x55900e567df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.107+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/1613932994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e19c390 0x55900e567df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.107+0000 7f5ee77fe640 1 -- 172.21.15.53:0/1613932994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e17b9f0 msgr2=0x55900e56d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.107+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/1613932994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e17b9f0 0x55900e56d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.107+0000 7f5ee77fe640 1 -- 172.21.15.53:0/1613932994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55900e563140 con 0x55900e1941b0 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.108+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/1613932994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56c6a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f5edc02af20 tx=0x7f5edc00afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c73db1ea29fa9ce server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:58.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.108+0000 7f5ecdffb640 1 -- 172.21.15.53:0/1613932994 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc027020 con 0x55900e1941b0 2024-08-31T06:09:58.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.108+0000 7f5ecdffb640 1 -- 172.21.15.53:0/1613932994 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5edc02a310 con 0x55900e1941b0 2024-08-31T06:09:58.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.108+0000 7f5ecdffb640 1 -- 172.21.15.53:0/1613932994 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc01d040 con 0x55900e1941b0 2024-08-31T06:09:58.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.109+0000 7f5ef4819740 1 -- 172.21.15.53:0/1613932994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 msgr2=0x55900e56c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.109+0000 7f5ef4819740 1 --2- 172.21.15.53:0/1613932994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56c6a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f5edc02af20 tx=0x7f5edc00afa0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.109+0000 7f5ef4819740 1 -- 172.21.15.53:0/1613932994 shutdown_connections 2024-08-31T06:09:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.109+0000 7f5ef4819740 1 --2- 172.21.15.53:0/1613932994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e19c390 0x55900e567df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.109+0000 7f5ef4819740 1 --2- 172.21.15.53:0/1613932994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56c6a0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.109+0000 7f5ef4819740 1 --2- 172.21.15.53:0/1613932994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e17b9f0 0x55900e56d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.109+0000 7f5ef4819740 1 -- 172.21.15.53:0/1613932994 >> 172.21.15.53:0/1613932994 conn(0x55900e1b1460 msgr2=0x55900e563380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.109+0000 7f5ef4819740 1 -- 172.21.15.53:0/1613932994 shutdown_connections 2024-08-31T06:09:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.109+0000 7f5ef4819740 1 -- 172.21.15.53:0/1613932994 wait complete. 2024-08-31T06:09:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.109+0000 7f5ef4819740 1 -- start start 2024-08-31T06:09:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ef4819740 1 Processor -- start 2024-08-31T06:09:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e17b9f0 0x55900e5878a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ef4819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e19c390 0x55900e56c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ef4819740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81ae920 con 0x55900e1941b0 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ef4819740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81ae1f0 con 0x55900e19c390 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ef4819740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81ab3d0 con 0x55900e17b9f0 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ef4819740 10 client.0 _ll_register_callbacks cb 0x7f5edc01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ee77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ee7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e17b9f0 0x55900e5878a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ee77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60984/0 (socket says 172.21.15.53:60984) 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5eec841640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e19c390 0x55900e56c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.110+0000 7f5ee77fe640 1 -- 172.21.15.53:0/2693070580 learned_addr learned my addr 172.21.15.53:0/2693070580 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ee77fe640 1 -- 172.21.15.53:0/2693070580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e17b9f0 msgr2=0x55900e5878a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e17b9f0 0x55900e5878a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ee77fe640 1 -- 172.21.15.53:0/2693070580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e19c390 msgr2=0x55900e56c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e19c390 0x55900e56c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ee77fe640 1 -- 172.21.15.53:0/2693070580 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55900e56c830 con 0x55900e1941b0 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ee7fff640 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e17b9f0 0x55900e5878a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ee77fe640 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56ba00 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f5edc016500 tx=0x7f5edc018650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a27280c98ee14d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ec77fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ec77fe640 1 -- 172.21.15.53:0/2693070580 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc01d040 con 0x55900e1941b0 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ec77fe640 1 -- 172.21.15.53:0/2693070580 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f5edc02a790 con 0x55900e1941b0 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ef4819740 1 -- 172.21.15.53:0/2693070580 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55900e4d7070 con 0x55900e1941b0 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ec77fe640 1 -- 172.21.15.53:0/2693070580 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5edc027040 con 0x55900e1941b0 2024-08-31T06:09:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ef4819740 10 client.17265 fetch_fsmap learned FSMap version 34 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.111+0000 7f5ef4819740 1 -- 172.21.15.53:0/2693070580 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55900e5ea750 con 0x55900e1941b0 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.112+0000 7f5ec77fe640 1 -- 172.21.15.53:0/2693070580 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55900e4d7070 con 0x55900e1941b0 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.112+0000 7f5ec77fe640 1 -- 172.21.15.53:0/2693070580 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5edc010800 con 0x55900e1941b0 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.112+0000 7f5ef4819740 10 client.17265 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.112+0000 7f5ef4819740 10 client.17265 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.112+0000 7f5ef4819740 20 client.17265 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.112+0000 7f5ef4819740 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55900e1bd070 0x55900e5ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.112+0000 7f5ef4819740 4 client.17265 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.112+0000 7f5ef4819740 1 -- 172.21.15.53:0/2693070580 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55900e4d47b0 con 0x55900e1bd070 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.112+0000 7f5ee7fff640 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55900e1bd070 0x55900e5ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ec77fe640 10 client.17265 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ee7fff640 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55900e1bd070 0x55900e5ecdf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=98c1b8d349960fdf server_cookie=356b2c4648a399f9 in_seq=0 out_seq=0 2024-08-31T06:09:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ec77fe640 1 -- 172.21.15.53:0/2693070580 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55900e4d47b0 con 0x55900e1bd070 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ec77fe640 10 client.17265 handle_command_reply: tid=0 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ef4819740 1 client.17265 shutdown 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ef4819740 1 -- 172.21.15.53:0/2693070580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 msgr2=0x55900e56ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ef4819740 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56ba00 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f5edc016500 tx=0x7f5edc018650 comp rx=0 tx=0).stop 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ef4819740 1 -- 172.21.15.53:0/2693070580 shutdown_connections 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ef4819740 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55900e19c390 0x55900e56c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ef4819740 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55900e1bd070 0x55900e5ecdf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ef4819740 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55900e1941b0 0x55900e56ba00 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ef4819740 1 --2- 172.21.15.53:0/2693070580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55900e17b9f0 0x55900e5878a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ef4819740 1 -- 172.21.15.53:0/2693070580 >> 172.21.15.53:0/2693070580 conn(0x55900e1b1460 msgr2=0x55900e563d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ec77fe640 0 client.17265 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:09:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.113+0000 7f5ef4819740 1 -- 172.21.15.53:0/2693070580 shutdown_connections 2024-08-31T06:09:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5ef4819740 1 -- 172.21.15.53:0/2693070580 wait complete. 2024-08-31T06:09:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5ef4819740 20 client.17265 trim_cache size 0 max 16384 2024-08-31T06:09:58.123 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:09:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5eee2a4640 1 -- 172.21.15.53:0/2713230643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed00b4cd0 msgr2=0x7f5ed00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5eee2a4640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed00b4cd0 0x7f5ed00b71e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009370 tx=0x7f5ee0004a40 comp rx=0 tx=0).stop 2024-08-31T06:09:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5eee2a4640 1 -- 172.21.15.53:0/2713230643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ee8104750 msgr2=0x7f5ee819a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5eee2a4640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ee8104750 0x7f5ee819a1c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5ed802a930 tx=0x7f5ed8003c20 comp rx=0 tx=0).stop 2024-08-31T06:09:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5eee2a4640 1 -- 172.21.15.53:0/2713230643 shutdown_connections 2024-08-31T06:09:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5eee2a4640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ed00b4cd0 0x7f5ed00b71e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5eee2a4640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ee810dbb0 0x7f5ee819fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5eee2a4640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ee81050a0 0x7f5ee819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5eee2a4640 1 --2- 172.21.15.53:0/2713230643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ee8104750 0x7f5ee819a1c0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:58.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.114+0000 7f5eee2a4640 1 -- 172.21.15.53:0/2713230643 >> 172.21.15.53:0/2713230643 conn(0x7f5ee80794d0 msgr2=0x7f5ee8100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:58.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.115+0000 7f5eee2a4640 1 -- 172.21.15.53:0/2713230643 shutdown_connections 2024-08-31T06:09:58.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:58.115+0000 7f5eee2a4640 1 -- 172.21.15.53:0/2713230643 wait complete. 2024-08-31T06:09:58.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:09:58 smithi053 ceph-mon[18924]: pgmap v473: 97 pgs: 97 active+clean; 59 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-08-31T06:09:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:09:58 smithi130 ceph-mon[22266]: pgmap v473: 97 pgs: 97 active+clean; 59 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-08-31T06:09:58.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:09:58 smithi153 ceph-mon[22320]: pgmap v473: 97 pgs: 97 active+clean; 59 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-08-31T06:09:58.942 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:09:58.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 92684 2.02 MB/sec execute 108 sec latency 18.404 ms 2024-08-31T06:09:59.214 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:09:59.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 93019 2.00 MB/sec execute 109 sec latency 14.963 ms 2024-08-31T06:09:59.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.959+0000 7f9baed9a640 1 -- 172.21.15.53:0/1587059854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ba81045e0 msgr2=0x7f9ba81049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:59.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.959+0000 7f9baed9a640 1 --2- 172.21.15.53:0/1587059854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ba81045e0 0x7f9ba81049f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009900 tx=0x7f9b9c02a400 comp rx=0 tx=0).stop 2024-08-31T06:09:59.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.959+0000 7f9baed9a640 1 -- 172.21.15.53:0/1587059854 shutdown_connections 2024-08-31T06:09:59.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.959+0000 7f9baed9a640 1 --2- 172.21.15.53:0/1587059854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba810db90 0x7f9ba81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.959+0000 7f9baed9a640 1 --2- 172.21.15.53:0/1587059854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ba8105010 0x7f9ba810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.959+0000 7f9baed9a640 1 --2- 172.21.15.53:0/1587059854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ba81045e0 0x7f9ba81049f0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.959+0000 7f9baed9a640 1 -- 172.21.15.53:0/1587059854 >> 172.21.15.53:0/1587059854 conn(0x7f9ba80794d0 msgr2=0x7f9ba80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.959+0000 7f9baed9a640 1 -- 172.21.15.53:0/1587059854 shutdown_connections 2024-08-31T06:09:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.959+0000 7f9baed9a640 1 -- 172.21.15.53:0/1587059854 wait complete. 2024-08-31T06:09:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.960+0000 7f9baed9a640 1 Processor -- start 2024-08-31T06:09:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.960+0000 7f9baed9a640 1 -- start start 2024-08-31T06:09:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.960+0000 7f9baed9a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba81045e0 0x7f9ba8103f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.960+0000 7f9baed9a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ba8105010 0x7f9ba81024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.960+0000 7f9baed9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ba810db90 0x7f9ba8102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.960+0000 7f9baed9a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8113710 con 0x7f9ba810db90 2024-08-31T06:09:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.960+0000 7f9baed9a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8113590 con 0x7f9ba8105010 2024-08-31T06:09:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.960+0000 7f9baed9a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8113890 con 0x7f9ba81045e0 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.961+0000 7f9bad337640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ba810db90 0x7f9ba8102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.961+0000 7f9bad337640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ba810db90 0x7f9ba8102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32768/0 (socket says 172.21.15.53:32768) 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.961+0000 7f9bad337640 1 -- 172.21.15.53:0/2215842486 learned_addr learned my addr 172.21.15.53:0/2215842486 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.961+0000 7f9bad337640 1 -- 172.21.15.53:0/2215842486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba81045e0 msgr2=0x7f9ba8103f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.961+0000 7f9bad337640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba81045e0 0x7f9ba8103f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.961+0000 7f9bad337640 1 -- 172.21.15.53:0/2215842486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ba8105010 msgr2=0x7f9ba81024f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.961+0000 7f9bad337640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ba8105010 0x7f9ba81024f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.961+0000 7f9bad337640 1 -- 172.21.15.53:0/2215842486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba8103250 con 0x7f9ba810db90 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.962+0000 7f9bad337640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ba810db90 0x7f9ba8102a30 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000eb10 tx=0x7f9ba000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.962+0000 7f9ba5ffb640 1 -- 172.21.15.53:0/2215842486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0004b20 con 0x7f9ba810db90 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.962+0000 7f9ba5ffb640 1 -- 172.21.15.53:0/2215842486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ba0004cc0 con 0x7f9ba810db90 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.962+0000 7f9ba5ffb640 1 -- 172.21.15.53:0/2215842486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0010690 con 0x7f9ba810db90 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.962+0000 7f9baed9a640 1 -- 172.21.15.53:0/2215842486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba81acb40 con 0x7f9ba810db90 2024-08-31T06:09:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.962+0000 7f9baed9a640 1 -- 172.21.15.53:0/2215842486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba81ad030 con 0x7f9ba810db90 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.965+0000 7f9bb530f740 1 Processor -- start 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9ba5ffb640 1 -- 172.21.15.53:0/2215842486 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9ba0005020 con 0x7f9ba810db90 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9bb530f740 1 -- start start 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555efff05070 0x555f002aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 0x555f002aa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 0x555f002aad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9bb530f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555f00221680 con 0x555effee4390 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9bb530f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555f00210c10 con 0x555effedc1b0 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9bb530f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555f00214bc0 con 0x555efff05070 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9ba7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 0x555f002aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9ba7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 0x555f002aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32782/0 (socket says 172.21.15.53:32782) 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9bacb36640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 0x555f002aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9ba7fff640 1 -- 172.21.15.53:0/703057482 learned_addr learned my addr 172.21.15.53:0/703057482 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.966+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/703057482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555efff05070 0x555f002aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9ba5ffb640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b980b4d20 0x7f9b980b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9bacb36640 1 -- 172.21.15.53:0/703057482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555efff05070 msgr2=0x555f002aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9bad337640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b980b4d20 0x7f9b980b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9ba5ffb640 1 -- 172.21.15.53:0/2215842486 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f9ba00e5be0 con 0x7f9ba810db90 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9bacb36640 1 --2- 172.21.15.53:0/703057482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555efff05070 0x555f002aa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9bacb36640 1 -- 172.21.15.53:0/703057482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 msgr2=0x555f002aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9bacb36640 1 --2- 172.21.15.53:0/703057482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 0x555f002aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9bacb36640 1 -- 172.21.15.53:0/703057482 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555efff70650 con 0x555effedc1b0 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/703057482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555efff05070 0x555f002aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9bacb36640 1 --2- 172.21.15.53:0/703057482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 0x555f002aa850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c02a9f0 tx=0x7f9b9c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=893af0e8d455024 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9bad337640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b980b4d20 0x7f9b980b7230 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00e33e0 tx=0x7f9ba0075440 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.967+0000 7f9b92ffd640 1 -- 172.21.15.53:0/703057482 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c03e070 con 0x555effedc1b0 2024-08-31T06:09:59.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.968+0000 7f9b92ffd640 1 -- 172.21.15.53:0/703057482 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b9c004430 con 0x555effedc1b0 2024-08-31T06:09:59.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.968+0000 7f9b92ffd640 1 -- 172.21.15.53:0/703057482 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c035040 con 0x555effedc1b0 2024-08-31T06:09:59.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.968+0000 7f9bb530f740 1 -- 172.21.15.53:0/703057482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 msgr2=0x555f002aa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:59.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.968+0000 7f9bb530f740 1 --2- 172.21.15.53:0/703057482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 0x555f002aa850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c02a9f0 tx=0x7f9b9c004040 comp rx=0 tx=0).stop 2024-08-31T06:09:59.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.969+0000 7f9bb530f740 1 -- 172.21.15.53:0/703057482 shutdown_connections 2024-08-31T06:09:59.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.969+0000 7f9bb530f740 1 --2- 172.21.15.53:0/703057482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 0x555f002aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.969+0000 7f9bb530f740 1 --2- 172.21.15.53:0/703057482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 0x555f002aa850 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.969+0000 7f9bb530f740 1 --2- 172.21.15.53:0/703057482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555efff05070 0x555f002aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.969+0000 7f9bb530f740 1 -- 172.21.15.53:0/703057482 >> 172.21.15.53:0/703057482 conn(0x555effef9460 msgr2=0x555f002a8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:59.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.969+0000 7f9bb530f740 1 -- 172.21.15.53:0/703057482 shutdown_connections 2024-08-31T06:09:59.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.969+0000 7f9bb530f740 1 -- 172.21.15.53:0/703057482 wait complete. 2024-08-31T06:09:59.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.969+0000 7f9bb530f740 1 -- start start 2024-08-31T06:09:59.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.969+0000 7f9bb530f740 1 Processor -- start 2024-08-31T06:09:59.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effedc1b0 0x555f002b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 0x555f002b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555efff05070 0x555f002c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bb530f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555f00073700 con 0x555efff05070 2024-08-31T06:09:59.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bb530f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555f00197750 con 0x555effee4390 2024-08-31T06:09:59.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bb530f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555f002b8a90 con 0x555effedc1b0 2024-08-31T06:09:59.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bb530f740 10 client.0 _ll_register_callbacks cb 0x555f001c6e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:09:59.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9ba7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555efff05070 0x555f002c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bacb36640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 0x555f002b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bacb36640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 0x555f002b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50004/0 (socket says 172.21.15.53:50004) 2024-08-31T06:09:59.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bacb36640 1 -- 172.21.15.53:0/3499892118 learned_addr learned my addr 172.21.15.53:0/3499892118 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:59.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555efff05070 0x555f002c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32792/0 (socket says 172.21.15.53:32792) 2024-08-31T06:09:59.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effedc1b0 0x555f002b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bacb36640 1 -- 172.21.15.53:0/3499892118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effedc1b0 msgr2=0x555f002b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:59.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bacb36640 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effedc1b0 0x555f002b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bacb36640 1 -- 172.21.15.53:0/3499892118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555efff05070 msgr2=0x555f002c1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:59.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bacb36640 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555efff05070 0x555f002c1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.970+0000 7f9bacb36640 1 -- 172.21.15.53:0/3499892118 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f001d0900 con 0x555effee4390 2024-08-31T06:09:59.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.971+0000 7f9bacb36640 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 0x555f002b5f30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c02abf0 tx=0x7f9b9c004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6ae4d9100176e15 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:59.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.971+0000 7f9b87fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:09:59.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.971+0000 7f9b87fff640 1 -- 172.21.15.53:0/3499892118 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c04b020 con 0x555effee4390 2024-08-31T06:09:59.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.971+0000 7f9b87fff640 1 -- 172.21.15.53:0/3499892118 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f9b9c005250 con 0x555effee4390 2024-08-31T06:09:59.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.971+0000 7f9bb530f740 1 -- 172.21.15.53:0/3499892118 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b9c004430 con 0x555effee4390 2024-08-31T06:09:59.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.971+0000 7f9b87fff640 1 -- 172.21.15.53:0/3499892118 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9b9c056050 con 0x555effee4390 2024-08-31T06:09:59.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.971+0000 7f9bb530f740 10 client.26636 fetch_fsmap learned FSMap version 34 2024-08-31T06:09:59.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.971+0000 7f9bb530f740 1 -- 172.21.15.53:0/3499892118 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555f002c4800 con 0x555effee4390 2024-08-31T06:09:59.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.972+0000 7f9b87fff640 1 -- 172.21.15.53:0/3499892118 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b9c004430 con 0x555effee4390 2024-08-31T06:09:59.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.972+0000 7f9b87fff640 1 -- 172.21.15.53:0/3499892118 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9b9c003ba0 con 0x555effee4390 2024-08-31T06:09:59.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.972+0000 7f9bb530f740 10 client.26636 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:09:59.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.972+0000 7f9bb530f740 10 client.26636 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:09:59.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.972+0000 7f9bb530f740 20 client.26636 populate_metadata read hostname 'smithi053' 2024-08-31T06:09:59.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.972+0000 7f9bb530f740 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x555effec39f0 0x555f002c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.972+0000 7f9bb530f740 4 client.26636 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:09:59.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.972+0000 7f9bb530f740 1 -- 172.21.15.53:0/3499892118 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f002235d0 con 0x555effec39f0 2024-08-31T06:09:59.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.972+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x555effec39f0 0x555f002c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.972+0000 7f9b87fff640 10 client.26636 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.972+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x555effec39f0 0x555f002c7b60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=213768c0f4a2c40 server_cookie=9ff752f54cf40b18 in_seq=0 out_seq=0 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.973+0000 7f9b87fff640 1 -- 172.21.15.53:0/3499892118 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555f002235d0 con 0x555effec39f0 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.973+0000 7f9b87fff640 10 client.26636 handle_command_reply: tid=0 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.973+0000 7f9bb530f740 1 client.26636 shutdown 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.973+0000 7f9bb530f740 1 -- 172.21.15.53:0/3499892118 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 msgr2=0x555f002b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.973+0000 7f9bb530f740 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 0x555f002b5f30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c02abf0 tx=0x7f9b9c004970 comp rx=0 tx=0).stop 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.973+0000 7f9bb530f740 1 -- 172.21.15.53:0/3499892118 shutdown_connections 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.973+0000 7f9bb530f740 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x555effec39f0 0x555f002c7b60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.973+0000 7f9bb530f740 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555efff05070 0x555f002c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.973+0000 7f9b87fff640 0 client.26636 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.973+0000 7f9bb530f740 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 0x555f002b5f30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.973+0000 7f9bb530f740 1 --2- 172.21.15.53:0/3499892118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effedc1b0 0x555f002b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.974+0000 7f9bb530f740 1 -- 172.21.15.53:0/3499892118 >> 172.21.15.53:0/3499892118 conn(0x555effef9460 msgr2=0x555f002ad4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:09:59.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.974+0000 7f9bb530f740 1 -- 172.21.15.53:0/3499892118 shutdown_connections 2024-08-31T06:09:59.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.974+0000 7f9bb530f740 1 -- 172.21.15.53:0/3499892118 wait complete. 2024-08-31T06:09:59.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.974+0000 7f9bb530f740 20 client.26636 trim_cache size 0 max 16384 2024-08-31T06:09:59.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.988+0000 7f9bb530f740 1 Processor -- start 2024-08-31T06:09:59.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.988+0000 7f9bb530f740 1 -- start start 2024-08-31T06:09:59.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effec39f0 0x555f002abd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 0x555f002b7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 0x555f002c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bb530f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81b5950 con 0x555effee4390 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bb530f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81b74f0 con 0x555effedc1b0 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bb530f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81b6020 con 0x555effec39f0 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9ba7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 0x555f002c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bacb36640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 0x555f002b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9ba7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 0x555f002c1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32808/0 (socket says 172.21.15.53:32808) 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9ba7fff640 1 -- 172.21.15.53:0/2437753480 learned_addr learned my addr 172.21.15.53:0/2437753480 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/2437753480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effec39f0 0x555f002abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bacb36640 1 -- 172.21.15.53:0/2437753480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effec39f0 msgr2=0x555f002abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bacb36640 1 --2- 172.21.15.53:0/2437753480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effec39f0 0x555f002abd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bacb36640 1 -- 172.21.15.53:0/2437753480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 msgr2=0x555f002c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bacb36640 1 --2- 172.21.15.53:0/2437753480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 0x555f002c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bacb36640 1 -- 172.21.15.53:0/2437753480 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f002ac600 con 0x555effedc1b0 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/2437753480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 0x555f002c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.989+0000 7f9bacb36640 1 --2- 172.21.15.53:0/2437753480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 0x555f002b7620 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0092a0 tx=0x7f9b9c005d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffc24906598b47dc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.990+0000 7f9b927fc640 1 -- 172.21.15.53:0/2437753480 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c04b040 con 0x555effedc1b0 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.990+0000 7f9b927fc640 1 -- 172.21.15.53:0/2437753480 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b9c004430 con 0x555effedc1b0 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.990+0000 7f9b927fc640 1 -- 172.21.15.53:0/2437753480 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c03e070 con 0x555effedc1b0 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.991+0000 7f9bb530f740 1 -- 172.21.15.53:0/2437753480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 msgr2=0x555f002b7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.991+0000 7f9bb530f740 1 --2- 172.21.15.53:0/2437753480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 0x555f002b7620 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0092a0 tx=0x7f9b9c005d70 comp rx=0 tx=0).stop 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.991+0000 7f9bb530f740 1 -- 172.21.15.53:0/2437753480 shutdown_connections 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.991+0000 7f9bb530f740 1 --2- 172.21.15.53:0/2437753480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effee4390 0x555f002c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.991+0000 7f9bb530f740 1 --2- 172.21.15.53:0/2437753480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effedc1b0 0x555f002b7620 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.991+0000 7f9bb530f740 1 --2- 172.21.15.53:0/2437753480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effec39f0 0x555f002abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:09:59.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.991+0000 7f9bb530f740 1 -- 172.21.15.53:0/2437753480 >> 172.21.15.53:0/2437753480 conn(0x555effef9460 msgr2=0x555f002b6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.991+0000 7f9bb530f740 1 -- 172.21.15.53:0/2437753480 shutdown_connections 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.991+0000 7f9bb530f740 1 -- 172.21.15.53:0/2437753480 wait complete. 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.991+0000 7f9bb530f740 1 -- start start 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.991+0000 7f9bb530f740 1 Processor -- start 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effec39f0 0x555f002c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effedc1b0 0x555f002c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9bb530f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 0x555f003312e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9bb530f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81b6e20 con 0x555effedc1b0 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9bb530f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81b66f0 con 0x555effee4390 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9bb530f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81b3930 con 0x555effec39f0 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9bb530f740 10 client.0 _ll_register_callbacks cb 0x7f9b94009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9bacb36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effedc1b0 0x555f002c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:00.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9bacb36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effedc1b0 0x555f002c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32812/0 (socket says 172.21.15.53:32812) 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9bacb36640 1 -- 172.21.15.53:0/2381535708 learned_addr learned my addr 172.21.15.53:0/2381535708 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effec39f0 0x555f002c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 0x555f003312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9ba7fff640 1 -- 172.21.15.53:0/2381535708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 msgr2=0x555f003312e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 0x555f003312e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9ba7fff640 1 -- 172.21.15.53:0/2381535708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effedc1b0 msgr2=0x555f002c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effedc1b0 0x555f002c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9ba7fff640 1 -- 172.21.15.53:0/2381535708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f00331820 con 0x555effec39f0 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.992+0000 7f9bacb36640 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effedc1b0 0x555f002c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.993+0000 7f9ba7fff640 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effec39f0 0x555f002c9260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9b94011820 tx=0x7f9b94005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30f1393916036afa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.993+0000 7f9b87fff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.993+0000 7f9b87fff640 1 -- 172.21.15.53:0/2381535708 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94003800 con 0x555effec39f0 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.993+0000 7f9bb530f740 1 -- 172.21.15.53:0/2381535708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b9c004430 con 0x555effec39f0 2024-08-31T06:10:00.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.993+0000 7f9b87fff640 1 -- 172.21.15.53:0/2381535708 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f9b940039a0 con 0x555effec39f0 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.993+0000 7f9b87fff640 1 -- 172.21.15.53:0/2381535708 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9b94003ba0 con 0x555effec39f0 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.993+0000 7f9bb530f740 10 client.26629 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.993+0000 7f9bb530f740 1 -- 172.21.15.53:0/2381535708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555f00332a60 con 0x555effec39f0 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.993+0000 7f9b87fff640 1 -- 172.21.15.53:0/2381535708 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b9c004430 con 0x555effec39f0 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.994+0000 7f9b87fff640 1 -- 172.21.15.53:0/2381535708 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9b94022ad0 con 0x555effec39f0 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.994+0000 7f9bb530f740 10 client.26629 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.994+0000 7f9bb530f740 10 client.26629 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.994+0000 7f9bb530f740 20 client.26629 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.994+0000 7f9bb530f740 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x555efff05070 0x555f00335280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.994+0000 7f9bb530f740 4 client.26629 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.994+0000 7f9bb530f740 1 -- 172.21.15.53:0/2381535708 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555f0021f070 con 0x555efff05070 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.994+0000 7f9bacb36640 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x555efff05070 0x555f00335280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.994+0000 7f9b87fff640 10 client.26629 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:10:00.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.994+0000 7f9bacb36640 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x555efff05070 0x555f00335280 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=64b214883bfd36d8 server_cookie=ad42aae3b2ba8f2c in_seq=0 out_seq=0 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9b87fff640 1 -- 172.21.15.53:0/2381535708 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555f0021f070 con 0x555efff05070 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9b87fff640 10 client.26629 handle_command_reply: tid=0 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 1 client.26629 shutdown 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 1 -- 172.21.15.53:0/2381535708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effec39f0 msgr2=0x555f002c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effec39f0 0x555f002c9260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9b94011820 tx=0x7f9b94005f90 comp rx=0 tx=0).stop 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 1 -- 172.21.15.53:0/2381535708 shutdown_connections 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x555efff05070 0x555f00335280 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555effee4390 0x555f003312e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9b87fff640 0 client.26629 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555effedc1b0 0x555f002c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 1 --2- 172.21.15.53:0/2381535708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555effec39f0 0x555f002c9260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 1 -- 172.21.15.53:0/2381535708 >> 172.21.15.53:0/2381535708 conn(0x555effef9460 msgr2=0x555f002abad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 1 -- 172.21.15.53:0/2381535708 shutdown_connections 2024-08-31T06:10:00.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 1 -- 172.21.15.53:0/2381535708 wait complete. 2024-08-31T06:10:00.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.995+0000 7f9bb530f740 20 client.26629 trim_cache size 0 max 16384 2024-08-31T06:10:00.004 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 -- 172.21.15.53:0/2215842486 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b980b4d20 msgr2=0x7f9b980b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b980b4d20 0x7f9b980b7230 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00e33e0 tx=0x7f9ba0075440 comp rx=0 tx=0).stop 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 -- 172.21.15.53:0/2215842486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ba810db90 msgr2=0x7f9ba8102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ba810db90 0x7f9ba8102a30 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000eb10 tx=0x7f9ba000c2d0 comp rx=0 tx=0).stop 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 -- 172.21.15.53:0/2215842486 shutdown_connections 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b980b4d20 0x7f9b980b7230 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ba810db90 0x7f9ba8102a30 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ba8105010 0x7f9ba81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 --2- 172.21.15.53:0/2215842486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ba81045e0 0x7f9ba8103f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 -- 172.21.15.53:0/2215842486 >> 172.21.15.53:0/2215842486 conn(0x7f9ba80794d0 msgr2=0x7f9ba81005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 -- 172.21.15.53:0/2215842486 shutdown_connections 2024-08-31T06:10:00.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:09:59.996+0000 7f9baed9a640 1 -- 172.21.15.53:0/2215842486 wait complete. 2024-08-31T06:10:00.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:00 smithi053 ceph-mon[18924]: pgmap v474: 97 pgs: 97 active+clean; 58 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-08-31T06:10:00.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:00 smithi053 ceph-mon[18924]: overall HEALTH_OK 2024-08-31T06:10:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:00 smithi130 ceph-mon[22266]: pgmap v474: 97 pgs: 97 active+clean; 58 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-08-31T06:10:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:00 smithi130 ceph-mon[22266]: overall HEALTH_OK 2024-08-31T06:10:00.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:00 smithi153 ceph-mon[22320]: pgmap v474: 97 pgs: 97 active+clean; 58 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-08-31T06:10:00.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:00 smithi153 ceph-mon[22320]: overall HEALTH_OK 2024-08-31T06:10:00.749 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:10:00.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 93507 2.00 MB/sec execute 110 sec latency 17.185 ms 2024-08-31T06:10:01.066 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:10:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.561+0000 7ff318a7d640 1 -- 172.21.15.53:0/32818752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff314108140 msgr2=0x7ff314108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.561+0000 7ff318a7d640 1 --2- 172.21.15.53:0/32818752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff314108140 0x7ff314108550 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009860 tx=0x7ff2fc02a340 comp rx=0 tx=0).stop 2024-08-31T06:10:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.561+0000 7ff318a7d640 1 -- 172.21.15.53:0/32818752 shutdown_connections 2024-08-31T06:10:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.561+0000 7ff318a7d640 1 --2- 172.21.15.53:0/32818752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff314108a90 0x7ff31410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.561+0000 7ff318a7d640 1 --2- 172.21.15.53:0/32818752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff314108140 0x7ff314108550 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.561+0000 7ff318a7d640 1 --2- 172.21.15.53:0/32818752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff314102800 0x7ff314102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.561+0000 7ff318a7d640 1 -- 172.21.15.53:0/32818752 >> 172.21.15.53:0/32818752 conn(0x7ff3140794d0 msgr2=0x7ff3140798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.561+0000 7ff318a7d640 1 -- 172.21.15.53:0/32818752 shutdown_connections 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.562+0000 7ff318a7d640 1 -- 172.21.15.53:0/32818752 wait complete. 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.562+0000 7ff318a7d640 1 Processor -- start 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff318a7d640 1 -- start start 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff318a7d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff314102800 0x7ff31410fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff318a7d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff314108140 0x7ff314110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff318a7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff314108a90 0x7ff3141105d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff318a7d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff3141136c0 con 0x7ff314108a90 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff318a7d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff314113540 con 0x7ff314102800 2024-08-31T06:10:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff318a7d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff314113840 con 0x7ff314108140 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff312d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff314108a90 0x7ff3141105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff309d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff314108140 0x7ff314110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff312d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff314108a90 0x7ff3141105d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32836/0 (socket says 172.21.15.53:32836) 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff309d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff314108140 0x7ff314110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:33524/0 (socket says 172.21.15.53:33524) 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.563+0000 7ff312d9d640 1 -- 172.21.15.53:0/1096682812 learned_addr learned my addr 172.21.15.53:0/1096682812 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff31259c640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff314102800 0x7ff31410fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff309d9b640 1 -- 172.21.15.53:0/1096682812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff314102800 msgr2=0x7ff31410fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff309d9b640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff314102800 0x7ff31410fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff309d9b640 1 -- 172.21.15.53:0/1096682812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff314108a90 msgr2=0x7ff3141105d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff309d9b640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff314108a90 0x7ff3141105d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff309d9b640 1 -- 172.21.15.53:0/1096682812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3141a8490 con 0x7ff314108140 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff312d9d640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff314108a90 0x7ff3141105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff309d9b640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff314108140 0x7ff314110090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc02a860 tx=0x7ff2fc02ae40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff30bfff640 1 -- 172.21.15.53:0/1096682812 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc040020 con 0x7ff314108140 2024-08-31T06:10:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff30bfff640 1 -- 172.21.15.53:0/1096682812 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2fc0044d0 con 0x7ff314108140 2024-08-31T06:10:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff30bfff640 1 -- 172.21.15.53:0/1096682812 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc037040 con 0x7ff314108140 2024-08-31T06:10:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.564+0000 7ff318a7d640 1 -- 172.21.15.53:0/1096682812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff314199ee0 con 0x7ff314108140 2024-08-31T06:10:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.565+0000 7ff318a7d640 1 -- 172.21.15.53:0/1096682812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff31419a340 con 0x7ff314108140 2024-08-31T06:10:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.568+0000 7ff31eff2740 1 Processor -- start 2024-08-31T06:10:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.568+0000 7ff31eff2740 1 -- start start 2024-08-31T06:10:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65c5070 0x5561a696a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a659c1b0 0x5561a696a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65a4390 0x5561a696ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff31eff2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5561a68e1680 con 0x5561a65c5070 2024-08-31T06:10:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff31eff2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5561a68d0c10 con 0x5561a659c1b0 2024-08-31T06:10:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff31eff2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5561a68d4bc0 con 0x5561a65a4390 2024-08-31T06:10:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff30bfff640 1 -- 172.21.15.53:0/1096682812 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff2fc043020 con 0x7ff314108140 2024-08-31T06:10:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff312d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65c5070 0x5561a696a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff31259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a659c1b0 0x5561a696a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff31259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a659c1b0 0x5561a696a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50052/0 (socket says 172.21.15.53:50052) 2024-08-31T06:10:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff31259c640 1 -- 172.21.15.53:0/438148046 learned_addr learned my addr 172.21.15.53:0/438148046 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.569+0000 7ff309d9b640 1 --2- 172.21.15.53:0/438148046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65a4390 0x5561a696ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.570+0000 7ff312d9d640 1 -- 172.21.15.53:0/438148046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65a4390 msgr2=0x5561a696ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.570+0000 7ff312d9d640 1 --2- 172.21.15.53:0/438148046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65a4390 0x5561a696ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.570+0000 7ff312d9d640 1 -- 172.21.15.53:0/438148046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a659c1b0 msgr2=0x5561a696a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.570+0000 7ff312d9d640 1 --2- 172.21.15.53:0/438148046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a659c1b0 0x5561a696a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.570+0000 7ff312d9d640 1 -- 172.21.15.53:0/438148046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561a6630650 con 0x5561a65c5070 2024-08-31T06:10:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.570+0000 7ff31259c640 1 --2- 172.21.15.53:0/438148046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a659c1b0 0x5561a696a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.571+0000 7ff312d9d640 1 --2- 172.21.15.53:0/438148046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65c5070 0x5561a696a310 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009ad0 tx=0x7ff30c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a9cfffa68ae77 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.571+0000 7ff30bfff640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff3000b4ca0 0x7ff3000b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.571+0000 7ff31259c640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff3000b4ca0 0x7ff3000b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.571+0000 7ff308d99640 1 -- 172.21.15.53:0/438148046 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30c022020 con 0x5561a65c5070 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.571+0000 7ff308d99640 1 -- 172.21.15.53:0/438148046 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff30c00bc60 con 0x5561a65c5070 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.571+0000 7ff308d99640 1 -- 172.21.15.53:0/438148046 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30c01d5c0 con 0x5561a65c5070 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.572+0000 7ff30bfff640 1 -- 172.21.15.53:0/1096682812 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7ff2fc105460 con 0x7ff314108140 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.572+0000 7ff31eff2740 1 -- 172.21.15.53:0/438148046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65c5070 msgr2=0x5561a696a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.572+0000 7ff31259c640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff3000b4ca0 0x7ff3000b71b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5561a6968f90 tx=0x7ff304011040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.572+0000 7ff31eff2740 1 --2- 172.21.15.53:0/438148046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65c5070 0x5561a696a310 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009ad0 tx=0x7ff30c005f90 comp rx=0 tx=0).stop 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.573+0000 7ff31eff2740 1 -- 172.21.15.53:0/438148046 shutdown_connections 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.573+0000 7ff31eff2740 1 --2- 172.21.15.53:0/438148046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65a4390 0x5561a696ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.573+0000 7ff31eff2740 1 --2- 172.21.15.53:0/438148046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a659c1b0 0x5561a696a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.573+0000 7ff31eff2740 1 --2- 172.21.15.53:0/438148046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65c5070 0x5561a696a310 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.573+0000 7ff31eff2740 1 -- 172.21.15.53:0/438148046 >> 172.21.15.53:0/438148046 conn(0x5561a65b9460 msgr2=0x5561a6968200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.573+0000 7ff31eff2740 1 -- 172.21.15.53:0/438148046 shutdown_connections 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.573+0000 7ff31eff2740 1 -- 172.21.15.53:0/438148046 wait complete. 2024-08-31T06:10:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.574+0000 7ff31eff2740 1 -- start start 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.574+0000 7ff31eff2740 1 Processor -- start 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.574+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a659c1b0 0x5561a6975ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.574+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65a4390 0x5561a6976010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.574+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 0x5561a6981e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.574+0000 7ff31eff2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5561a6733700 con 0x5561a659c1b0 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.574+0000 7ff31eff2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5561a6857750 con 0x5561a65c5070 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.574+0000 7ff31eff2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5561a6978af0 con 0x5561a65a4390 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.575+0000 7ff312d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 0x5561a6981e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.575+0000 7ff312d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 0x5561a6981e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50058/0 (socket says 172.21.15.53:50058) 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.575+0000 7ff312d9d640 1 -- 172.21.15.53:0/1527610170 learned_addr learned my addr 172.21.15.53:0/1527610170 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.575+0000 7ff309d9b640 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65a4390 0x5561a6976010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.575+0000 7ff31259c640 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a659c1b0 0x5561a6975ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.574+0000 7ff31eff2740 10 client.0 _ll_register_callbacks cb 0x5561a6886e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.575+0000 7ff309d9b640 1 -- 172.21.15.53:0/1527610170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 msgr2=0x5561a6981e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.575+0000 7ff309d9b640 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 0x5561a6981e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.575+0000 7ff309d9b640 1 -- 172.21.15.53:0/1527610170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a659c1b0 msgr2=0x5561a6975ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.575+0000 7ff309d9b640 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a659c1b0 0x5561a6975ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.575+0000 7ff309d9b640 1 -- 172.21.15.53:0/1527610170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561a6890900 con 0x5561a65a4390 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.575+0000 7ff309d9b640 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65a4390 0x5561a6976010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc102bb0 tx=0x7ff2fc02a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48ba0027b3d9931d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff2f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/1527610170 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0cb4a0 con 0x5561a65a4390 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/1527610170 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7ff2fc0d49e0 con 0x5561a65a4390 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff31eff2740 1 -- 172.21.15.53:0/1527610170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff30c00bc60 con 0x5561a65a4390 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/1527610170 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff2fc0c72e0 con 0x5561a65a4390 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff31eff2740 10 client.26641 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff31eff2740 1 -- 172.21.15.53:0/1527610170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5561a6984900 con 0x5561a65a4390 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/1527610170 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff30c00bc60 con 0x5561a65a4390 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/1527610170 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff2fc0cadb0 con 0x5561a65a4390 2024-08-31T06:10:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff31eff2740 10 client.26641 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff31eff2740 10 client.26641 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.576+0000 7ff31eff2740 20 client.26641 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.577+0000 7ff31eff2740 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5561a65839f0 0x5561a6987d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.577+0000 7ff31eff2740 4 client.26641 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.577+0000 7ff31eff2740 1 -- 172.21.15.53:0/1527610170 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561a68e35d0 con 0x5561a65839f0 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.577+0000 7ff31259c640 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5561a65839f0 0x5561a6987d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.577+0000 7ff2f9ffb640 10 client.26641 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.577+0000 7ff31259c640 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5561a65839f0 0x5561a6987d50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b77e37d4a110aa55 server_cookie=137c52d24051fdfd in_seq=0 out_seq=0 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.578+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/1527610170 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561a68e35d0 con 0x5561a65839f0 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.578+0000 7ff2f9ffb640 10 client.26641 handle_command_reply: tid=0 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.578+0000 7ff31eff2740 1 client.26641 shutdown 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff31eff2740 1 -- 172.21.15.53:0/1527610170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65a4390 msgr2=0x5561a6976010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff31eff2740 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65a4390 0x5561a6976010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc102bb0 tx=0x7ff2fc02a340 comp rx=0 tx=0).stop 2024-08-31T06:10:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff31eff2740 1 -- 172.21.15.53:0/1527610170 shutdown_connections 2024-08-31T06:10:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff31eff2740 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5561a65839f0 0x5561a6987d50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff31eff2740 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 0x5561a6981e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff31eff2740 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65a4390 0x5561a6976010 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff31eff2740 1 --2- 172.21.15.53:0/1527610170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a659c1b0 0x5561a6975ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff31eff2740 1 -- 172.21.15.53:0/1527610170 >> 172.21.15.53:0/1527610170 conn(0x5561a65b9460 msgr2=0x5561a696d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff2f9ffb640 0 client.26641 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:10:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff31eff2740 1 -- 172.21.15.53:0/1527610170 shutdown_connections 2024-08-31T06:10:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff31eff2740 1 -- 172.21.15.53:0/1527610170 wait complete. 2024-08-31T06:10:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.579+0000 7ff31eff2740 20 client.26641 trim_cache size 0 max 16384 2024-08-31T06:10:01.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff31eff2740 1 Processor -- start 2024-08-31T06:10:01.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff31eff2740 1 -- start start 2024-08-31T06:10:01.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a659c1b0 0x5561a6975f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65a4390 0x5561a696d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65c5070 0x5561a696d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff31eff2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff3141ad1f0 con 0x5561a659c1b0 2024-08-31T06:10:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff31eff2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff3141aed90 con 0x5561a65a4390 2024-08-31T06:10:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff31eff2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff3141ad8c0 con 0x5561a65c5070 2024-08-31T06:10:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff31259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a659c1b0 0x5561a6975f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff312d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65c5070 0x5561a696d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff31259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a659c1b0 0x5561a6975f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32874/0 (socket says 172.21.15.53:32874) 2024-08-31T06:10:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff312d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65c5070 0x5561a696d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:33550/0 (socket says 172.21.15.53:33550) 2024-08-31T06:10:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff31259c640 1 -- 172.21.15.53:0/3058969170 learned_addr learned my addr 172.21.15.53:0/3058969170 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:01.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.597+0000 7ff309d9b640 1 --2- 172.21.15.53:0/3058969170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65a4390 0x5561a696d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.598+0000 7ff312d9d640 1 -- 172.21.15.53:0/3058969170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65a4390 msgr2=0x5561a696d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.598+0000 7ff312d9d640 1 --2- 172.21.15.53:0/3058969170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65a4390 0x5561a696d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.598+0000 7ff312d9d640 1 -- 172.21.15.53:0/3058969170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a659c1b0 msgr2=0x5561a6975f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.598+0000 7ff312d9d640 1 --2- 172.21.15.53:0/3058969170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a659c1b0 0x5561a6975f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.598+0000 7ff312d9d640 1 -- 172.21.15.53:0/3058969170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561a696c630 con 0x5561a65c5070 2024-08-31T06:10:01.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.598+0000 7ff309d9b640 1 --2- 172.21.15.53:0/3058969170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65a4390 0x5561a696d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:01.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.598+0000 7ff312d9d640 1 --2- 172.21.15.53:0/3058969170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65c5070 0x5561a696d950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff30c005b90 tx=0x7ff30c01ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea1b70c336a623a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.598+0000 7ff2fbfff640 1 -- 172.21.15.53:0/3058969170 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30c022070 con 0x5561a65c5070 2024-08-31T06:10:01.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.598+0000 7ff2fbfff640 1 -- 172.21.15.53:0/3058969170 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff30c0054c0 con 0x5561a65c5070 2024-08-31T06:10:01.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.598+0000 7ff2fbfff640 1 -- 172.21.15.53:0/3058969170 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30c01e7e0 con 0x5561a65c5070 2024-08-31T06:10:01.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.599+0000 7ff31eff2740 1 -- 172.21.15.53:0/3058969170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65c5070 msgr2=0x5561a696d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.599+0000 7ff31eff2740 1 --2- 172.21.15.53:0/3058969170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65c5070 0x5561a696d950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff30c005b90 tx=0x7ff30c01ec40 comp rx=0 tx=0).stop 2024-08-31T06:10:01.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.599+0000 7ff31eff2740 1 -- 172.21.15.53:0/3058969170 shutdown_connections 2024-08-31T06:10:01.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.599+0000 7ff31eff2740 1 --2- 172.21.15.53:0/3058969170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a65c5070 0x5561a696d950 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.599+0000 7ff31eff2740 1 --2- 172.21.15.53:0/3058969170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65a4390 0x5561a696d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.599+0000 7ff31eff2740 1 --2- 172.21.15.53:0/3058969170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a659c1b0 0x5561a6975f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.599+0000 7ff31eff2740 1 -- 172.21.15.53:0/3058969170 >> 172.21.15.53:0/3058969170 conn(0x5561a65b9460 msgr2=0x5561a6975880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.599+0000 7ff31eff2740 1 -- 172.21.15.53:0/3058969170 shutdown_connections 2024-08-31T06:10:01.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.599+0000 7ff31eff2740 1 -- 172.21.15.53:0/3058969170 wait complete. 2024-08-31T06:10:01.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff31eff2740 1 -- start start 2024-08-31T06:10:01.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff31eff2740 1 Processor -- start 2024-08-31T06:10:01.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a659c1b0 0x5561a697a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65a4390 0x5561a697a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff31eff2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 0x5561a69f1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff31eff2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff3141ae6c0 con 0x5561a65a4390 2024-08-31T06:10:01.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff31eff2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff3141adf90 con 0x5561a65c5070 2024-08-31T06:10:01.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff31eff2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff3141ab1d0 con 0x5561a659c1b0 2024-08-31T06:10:01.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff31eff2740 10 client.0 _ll_register_callbacks cb 0x7ff2fc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:01.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff309d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65a4390 0x5561a697a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff309d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65a4390 0x5561a697a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32888/0 (socket says 172.21.15.53:32888) 2024-08-31T06:10:01.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.600+0000 7ff309d9b640 1 -- 172.21.15.53:0/3998359667 learned_addr learned my addr 172.21.15.53:0/3998359667 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:01.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff312d9d640 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 0x5561a69f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff31259c640 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a659c1b0 0x5561a697a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff309d9b640 1 -- 172.21.15.53:0/3998359667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a659c1b0 msgr2=0x5561a697a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff309d9b640 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a659c1b0 0x5561a697a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff309d9b640 1 -- 172.21.15.53:0/3998359667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 msgr2=0x5561a69f1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff309d9b640 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 0x5561a69f1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff309d9b640 1 -- 172.21.15.53:0/3998359667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561a69f1c90 con 0x5561a65a4390 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff312d9d640 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 0x5561a69f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff309d9b640 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65a4390 0x5561a697a700 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0c8dc0 tx=0x7ff2fc0d4c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7dc75817616f3b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff2f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/3998359667 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0cb2c0 con 0x5561a65a4390 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/3998359667 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7ff2fc004250 con 0x5561a65a4390 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff31eff2740 1 -- 172.21.15.53:0/3998359667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff30c0054c0 con 0x5561a65a4390 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/3998359667 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff2fc0cb4a0 con 0x5561a65a4390 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff31eff2740 10 client.17301 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.601+0000 7ff31eff2740 1 -- 172.21.15.53:0/3998359667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5561a69f2de0 con 0x5561a65a4390 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.602+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/3998359667 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff30c0054c0 con 0x5561a65a4390 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.602+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/3998359667 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff2fc0ca820 con 0x5561a65a4390 2024-08-31T06:10:01.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.602+0000 7ff31eff2740 10 client.17301 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.602+0000 7ff31eff2740 10 client.17301 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.602+0000 7ff31eff2740 20 client.17301 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.602+0000 7ff31eff2740 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5561a6558da0 0x5561a69f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.602+0000 7ff31eff2740 4 client.17301 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.602+0000 7ff31eff2740 1 -- 172.21.15.53:0/3998359667 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561a68df070 con 0x5561a6558da0 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.602+0000 7ff31259c640 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5561a6558da0 0x5561a69f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31259c640 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5561a6558da0 0x5561a69f53e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d72327e42d96e2b8 server_cookie=ef962d009a740b89 in_seq=0 out_seq=0 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff2f9ffb640 10 client.17301 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/3998359667 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561a68df070 con 0x5561a6558da0 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff2f9ffb640 10 client.17301 handle_command_reply: tid=0 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 1 client.17301 shutdown 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 1 -- 172.21.15.53:0/3998359667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65a4390 msgr2=0x5561a697a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65a4390 0x5561a697a700 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0c8dc0 tx=0x7ff2fc0d4c90 comp rx=0 tx=0).stop 2024-08-31T06:10:01.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 1 -- 172.21.15.53:0/3998359667 shutdown_connections 2024-08-31T06:10:01.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5561a6558da0 0x5561a69f53e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561a65c5070 0x5561a69f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561a65a4390 0x5561a697a700 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 1 --2- 172.21.15.53:0/3998359667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561a659c1b0 0x5561a697a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff2f9ffb640 0 client.17301 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:10:01.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 1 -- 172.21.15.53:0/3998359667 >> 172.21.15.53:0/3998359667 conn(0x5561a65b9460 msgr2=0x5561a696d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 1 -- 172.21.15.53:0/3998359667 shutdown_connections 2024-08-31T06:10:01.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 1 -- 172.21.15.53:0/3998359667 wait complete. 2024-08-31T06:10:01.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.603+0000 7ff31eff2740 20 client.17301 trim_cache size 0 max 16384 2024-08-31T06:10:01.612 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:10:01.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 -- 172.21.15.53:0/1096682812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff3000b4ca0 msgr2=0x7ff3000b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff3000b4ca0 0x7ff3000b71b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5561a6968f90 tx=0x7ff304011040 comp rx=0 tx=0).stop 2024-08-31T06:10:01.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 -- 172.21.15.53:0/1096682812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff314108140 msgr2=0x7ff314110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff314108140 0x7ff314110090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc02a860 tx=0x7ff2fc02ae40 comp rx=0 tx=0).stop 2024-08-31T06:10:01.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 -- 172.21.15.53:0/1096682812 shutdown_connections 2024-08-31T06:10:01.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff3000b4ca0 0x7ff3000b71b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff314108a90 0x7ff3141105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff314108140 0x7ff314110090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 --2- 172.21.15.53:0/1096682812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff314102800 0x7ff31410fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 -- 172.21.15.53:0/1096682812 >> 172.21.15.53:0/1096682812 conn(0x7ff3140794d0 msgr2=0x7ff3141042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 -- 172.21.15.53:0/1096682812 shutdown_connections 2024-08-31T06:10:01.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:01.604+0000 7ff318a7d640 1 -- 172.21.15.53:0/1096682812 wait complete. 2024-08-31T06:10:01.756 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.7 2024-08-31T06:10:01.756 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:10:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.833+0000 7fe953a8b640 1 -- 172.21.15.53:0/2327113213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe94c102770 msgr2=0x7fe94c102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.834+0000 7fe953a8b640 1 --2- 172.21.15.53:0/2327113213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe94c102770 0x7fe94c102b80 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe948009900 tx=0x7fe94802a410 comp rx=0 tx=0).stop 2024-08-31T06:10:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.834+0000 7fe953a8b640 1 -- 172.21.15.53:0/2327113213 shutdown_connections 2024-08-31T06:10:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.834+0000 7fe953a8b640 1 --2- 172.21.15.53:0/2327113213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe94c1089f0 0x7fe94c10f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.834+0000 7fe953a8b640 1 --2- 172.21.15.53:0/2327113213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe94c1080a0 0x7fe94c1084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.834+0000 7fe953a8b640 1 --2- 172.21.15.53:0/2327113213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe94c102770 0x7fe94c102b80 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.834+0000 7fe953a8b640 1 -- 172.21.15.53:0/2327113213 >> 172.21.15.53:0/2327113213 conn(0x7fe94c07a490 msgr2=0x7fe94c07a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.834+0000 7fe953a8b640 1 -- 172.21.15.53:0/2327113213 shutdown_connections 2024-08-31T06:10:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.834+0000 7fe953a8b640 1 -- 172.21.15.53:0/2327113213 wait complete. 2024-08-31T06:10:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.834+0000 7fe953a8b640 1 Processor -- start 2024-08-31T06:10:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe953a8b640 1 -- start start 2024-08-31T06:10:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe953a8b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe94c102770 0x7fe94c06b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe953a8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe94c1080a0 0x7fe94c06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe953a8b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe94c1089f0 0x7fe94c19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe953a8b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c112570 con 0x7fe94c1080a0 2024-08-31T06:10:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe953a8b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c1123f0 con 0x7fe94c1089f0 2024-08-31T06:10:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe953a8b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c1126f0 con 0x7fe94c102770 2024-08-31T06:10:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe951026640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe94c1080a0 0x7fe94c06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe951026640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe94c1080a0 0x7fe94c06bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32910/0 (socket says 172.21.15.53:32910) 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe951026640 1 -- 172.21.15.53:0/3300963183 learned_addr learned my addr 172.21.15.53:0/3300963183 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe951827640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe94c102770 0x7fe94c06b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe952028640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe94c1089f0 0x7fe94c19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe951026640 1 -- 172.21.15.53:0/3300963183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe94c102770 msgr2=0x7fe94c06b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe951026640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe94c102770 0x7fe94c06b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe951026640 1 -- 172.21.15.53:0/3300963183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe94c1089f0 msgr2=0x7fe94c19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe951026640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe94c1089f0 0x7fe94c19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe951026640 1 -- 172.21.15.53:0/3300963183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94c19cec0 con 0x7fe94c1080a0 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe951827640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe94c102770 0x7fe94c06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.835+0000 7fe952028640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe94c1089f0 0x7fe94c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.836+0000 7fe951026640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe94c1080a0 0x7fe94c06bba0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00d750 tx=0x7fe93c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.836+0000 7fe942ffd640 1 -- 172.21.15.53:0/3300963183 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c017070 con 0x7fe94c1080a0 2024-08-31T06:10:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.836+0000 7fe953a8b640 1 -- 172.21.15.53:0/3300963183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe94c19d1b0 con 0x7fe94c1080a0 2024-08-31T06:10:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.836+0000 7fe942ffd640 1 -- 172.21.15.53:0/3300963183 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe93c0054b0 con 0x7fe94c1080a0 2024-08-31T06:10:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.836+0000 7fe942ffd640 1 -- 172.21.15.53:0/3300963183 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c004bc0 con 0x7fe94c1080a0 2024-08-31T06:10:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.836+0000 7fe953a8b640 1 -- 172.21.15.53:0/3300963183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe94c1a6b80 con 0x7fe94c1080a0 2024-08-31T06:10:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.839+0000 7fe95a9f7740 1 Processor -- start 2024-08-31T06:10:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.839+0000 7fe95a9f7740 1 -- start start 2024-08-31T06:10:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.839+0000 7fe95a9f7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a74714ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.839+0000 7fe95a9f7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74715220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.839+0000 7fe95a9f7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a74715760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.839+0000 7fe95a9f7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564a7468a000 con 0x564a743504d0 2024-08-31T06:10:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.839+0000 7fe95a9f7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564a74679590 con 0x564a743482f0 2024-08-31T06:10:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.839+0000 7fe95a9f7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564a7467d540 con 0x564a743711b0 2024-08-31T06:10:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe951827640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74715220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe952028640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a74714ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe952028640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a74714ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:33576/0 (socket says 172.21.15.53:33576) 2024-08-31T06:10:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe942ffd640 1 -- 172.21.15.53:0/3300963183 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe93c010460 con 0x7fe94c1080a0 2024-08-31T06:10:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe951827640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74715220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50106/0 (socket says 172.21.15.53:50106) 2024-08-31T06:10:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe952028640 1 -- 172.21.15.53:0/3681319948 learned_addr learned my addr 172.21.15.53:0/3681319948 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe951026640 1 --2- 172.21.15.53:0/3681319948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a74715760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe952028640 1 -- 172.21.15.53:0/3681319948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 msgr2=0x564a74715220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe952028640 1 --2- 172.21.15.53:0/3681319948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74715220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe952028640 1 -- 172.21.15.53:0/3681319948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 msgr2=0x564a74715760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe952028640 1 --2- 172.21.15.53:0/3681319948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a74715760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe952028640 1 -- 172.21.15.53:0/3681319948 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a743dc790 con 0x564a743711b0 2024-08-31T06:10:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe951026640 1 --2- 172.21.15.53:0/3681319948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a74715760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe952028640 1 --2- 172.21.15.53:0/3681319948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a74714ce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9440117c0 tx=0x7fe944011c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6157209d38e17079 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe937fff640 1 -- 172.21.15.53:0/3681319948 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944003c30 con 0x564a743711b0 2024-08-31T06:10:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe937fff640 1 -- 172.21.15.53:0/3681319948 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe94400fe30 con 0x564a743711b0 2024-08-31T06:10:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.840+0000 7fe937fff640 1 -- 172.21.15.53:0/3681319948 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944004830 con 0x564a743711b0 2024-08-31T06:10:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.841+0000 7fe942ffd640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9380b4d20 0x7fe9380b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.841+0000 7fe951827640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9380b4d20 0x7fe9380b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.841+0000 7fe942ffd640 1 -- 172.21.15.53:0/3300963183 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fe93c0e4e40 con 0x7fe94c1080a0 2024-08-31T06:10:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3681319948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 msgr2=0x564a74714ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/3681319948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a74714ce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9440117c0 tx=0x7fe944011c80 comp rx=0 tx=0).stop 2024-08-31T06:10:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe951827640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9380b4d20 0x7fe9380b7230 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe9480057c0 tx=0x7fe9480058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3681319948 shutdown_connections 2024-08-31T06:10:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/3681319948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a74715760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/3681319948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74715220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/3681319948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a74714ce0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3681319948 >> 172.21.15.53:0/3681319948 conn(0x564a74365300 msgr2=0x564a74712bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3681319948 shutdown_connections 2024-08-31T06:10:01.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3681319948 wait complete. 2024-08-31T06:10:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe95a9f7740 1 -- start start 2024-08-31T06:10:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.842+0000 7fe95a9f7740 1 Processor -- start 2024-08-31T06:10:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe95a9f7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743482f0 0x564a74720840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe95a9f7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743504d0 0x564a74720d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe95a9f7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7472c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe95a9f7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564a745b2ab0 con 0x564a743482f0 2024-08-31T06:10:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe95a9f7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564a74600680 con 0x564a743504d0 2024-08-31T06:10:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe95a9f7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564a74723460 con 0x564a743711b0 2024-08-31T06:10:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe95a9f7740 10 client.0 _ll_register_callbacks cb 0x564a74388a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe951827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743482f0 0x564a74720840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe952028640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7472c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe952028640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7472c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:33590/0 (socket says 172.21.15.53:33590) 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe952028640 1 -- 172.21.15.53:0/2458282526 learned_addr learned my addr 172.21.15.53:0/2458282526 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe951827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743482f0 0x564a74720840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32928/0 (socket says 172.21.15.53:32928) 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe951026640 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743504d0 0x564a74720d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe952028640 1 -- 172.21.15.53:0/2458282526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743504d0 msgr2=0x564a74720d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe952028640 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743504d0 0x564a74720d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe952028640 1 -- 172.21.15.53:0/2458282526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743482f0 msgr2=0x564a74720840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe952028640 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743482f0 0x564a74720840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.843+0000 7fe952028640 1 -- 172.21.15.53:0/2458282526 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a74455620 con 0x564a743711b0 2024-08-31T06:10:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.844+0000 7fe952028640 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7472c7b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe944014040 tx=0x7fe944004990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e6953491014975 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.844+0000 7fe9357fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.844+0000 7fe9357fa640 1 -- 172.21.15.53:0/2458282526 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944027030 con 0x564a743711b0 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.844+0000 7fe95a9f7740 1 -- 172.21.15.53:0/2458282526 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe94400fe30 con 0x564a743711b0 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.844+0000 7fe9357fa640 1 -- 172.21.15.53:0/2458282526 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fe94401f050 con 0x564a743711b0 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.844+0000 7fe9357fa640 1 -- 172.21.15.53:0/2458282526 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe944031050 con 0x564a743711b0 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.844+0000 7fe95a9f7740 10 client.26659 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.844+0000 7fe95a9f7740 1 -- 172.21.15.53:0/2458282526 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564a7472f480 con 0x564a743711b0 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.845+0000 7fe9357fa640 1 -- 172.21.15.53:0/2458282526 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe94400fe30 con 0x564a743711b0 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.845+0000 7fe9357fa640 1 -- 172.21.15.53:0/2458282526 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe944018070 con 0x564a743711b0 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.845+0000 7fe95a9f7740 10 client.26659 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.845+0000 7fe95a9f7740 10 client.26659 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.845+0000 7fe95a9f7740 20 client.26659 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.845+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a7432fd80 0x564a747328a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.845+0000 7fe95a9f7740 4 client.26659 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.845+0000 7fe95a9f7740 1 -- 172.21.15.53:0/2458282526 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a7468bf50 con 0x564a7432fd80 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.845+0000 7fe951827640 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a7432fd80 0x564a747328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.846+0000 7fe9357fa640 10 client.26659 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.846+0000 7fe951827640 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a7432fd80 0x564a747328a0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62948e06039fcd19 server_cookie=a5baec868f13e991 in_seq=0 out_seq=0 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe9357fa640 1 -- 172.21.15.53:0/2458282526 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a7468bf50 con 0x564a7432fd80 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe9357fa640 10 client.26659 handle_command_reply: tid=0 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 1 client.26659 shutdown 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 1 -- 172.21.15.53:0/2458282526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 msgr2=0x564a7472c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7472c7b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe944014040 tx=0x7fe944004990 comp rx=0 tx=0).stop 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 1 -- 172.21.15.53:0/2458282526 shutdown_connections 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a7432fd80 0x564a747328a0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7472c7b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743504d0 0x564a74720d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/2458282526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743482f0 0x564a74720840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 1 -- 172.21.15.53:0/2458282526 >> 172.21.15.53:0/2458282526 conn(0x564a74365300 msgr2=0x564a74715d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe9357fa640 0 client.26659 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 1 -- 172.21.15.53:0/2458282526 shutdown_connections 2024-08-31T06:10:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 1 -- 172.21.15.53:0/2458282526 wait complete. 2024-08-31T06:10:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.847+0000 7fe95a9f7740 20 client.26659 trim_cache size 0 max 16384 2024-08-31T06:10:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.866+0000 7fe95a9f7740 1 Processor -- start 2024-08-31T06:10:01.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.866+0000 7fe95a9f7740 1 -- start start 2024-08-31T06:10:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.867+0000 7fe95a9f7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74716420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.867+0000 7fe95a9f7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a7471fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.868+0000 7fe951026640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a7471fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.868+0000 7fe951026640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a7471fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32942/0 (socket says 172.21.15.53:32942) 2024-08-31T06:10:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.868+0000 7fe951827640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74716420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.868+0000 7fe951827640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74716420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50122/0 (socket says 172.21.15.53:50122) 2024-08-31T06:10:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.868+0000 7fe951026640 1 -- 172.21.15.53:0/3802270797 learned_addr learned my addr 172.21.15.53:0/3802270797 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.868+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/3802270797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7472c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.868+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3802270797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c1af430 con 0x564a743504d0 2024-08-31T06:10:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.868+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3802270797 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c1b0fd0 con 0x564a743482f0 2024-08-31T06:10:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.868+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3802270797 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c1afb00 con 0x564a743711b0 2024-08-31T06:10:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.869+0000 7fe952028640 1 --2- 172.21.15.53:0/3802270797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7472c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.870+0000 7fe952028640 1 -- 172.21.15.53:0/3802270797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 msgr2=0x564a74716420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.870+0000 7fe952028640 1 --2- 172.21.15.53:0/3802270797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74716420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.870+0000 7fe952028640 1 -- 172.21.15.53:0/3802270797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 msgr2=0x564a7471fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.870+0000 7fe952028640 1 --2- 172.21.15.53:0/3802270797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a7471fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.870+0000 7fe952028640 1 -- 172.21.15.53:0/3802270797 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a74732d00 con 0x564a743711b0 2024-08-31T06:10:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.870+0000 7fe951827640 1 --2- 172.21.15.53:0/3802270797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74716420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:10:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.870+0000 7fe951026640 1 --2- 172.21.15.53:0/3802270797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a7471fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.870+0000 7fe952028640 1 --2- 172.21.15.53:0/3802270797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7472c6b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe944011cc0 tx=0x7fe94400f7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c649e1031f8810c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.871+0000 7fe9377fe640 1 -- 172.21.15.53:0/3802270797 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944027030 con 0x564a743711b0 2024-08-31T06:10:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.871+0000 7fe9377fe640 1 -- 172.21.15.53:0/3802270797 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe94400fde0 con 0x564a743711b0 2024-08-31T06:10:01.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.871+0000 7fe9377fe640 1 -- 172.21.15.53:0/3802270797 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94401aa40 con 0x564a743711b0 2024-08-31T06:10:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.872+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3802270797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 msgr2=0x564a7472c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.872+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/3802270797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7472c6b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe944011cc0 tx=0x7fe94400f7b0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.872+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3802270797 shutdown_connections 2024-08-31T06:10:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.872+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/3802270797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7472c6b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.872+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/3802270797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a7471fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.872+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/3802270797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74716420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.872+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3802270797 >> 172.21.15.53:0/3802270797 conn(0x564a74365300 msgr2=0x564a74715d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.872+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3802270797 shutdown_connections 2024-08-31T06:10:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.872+0000 7fe95a9f7740 1 -- 172.21.15.53:0/3802270797 wait complete. 2024-08-31T06:10:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.873+0000 7fe95a9f7740 1 -- start start 2024-08-31T06:10:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.873+0000 7fe95a9f7740 1 Processor -- start 2024-08-31T06:10:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.873+0000 7fe95a9f7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74723b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe95a9f7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a74724050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe95a9f7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7479b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe95a9f7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c1b0900 con 0x564a743504d0 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe95a9f7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c1b01d0 con 0x564a743482f0 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe95a9f7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c1ad410 con 0x564a743711b0 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe95a9f7740 10 client.0 _ll_register_callbacks cb 0x7fe948009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe951026640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a74724050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe951827640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74723b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe951827640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74723b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50128/0 (socket says 172.21.15.53:50128) 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe951827640 1 -- 172.21.15.53:0/801300908 learned_addr learned my addr 172.21.15.53:0/801300908 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe952028640 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7479b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe951026640 1 -- 172.21.15.53:0/801300908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 msgr2=0x564a7479b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe951026640 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7479b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe951026640 1 -- 172.21.15.53:0/801300908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 msgr2=0x564a74723b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe951026640 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74723b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe951026640 1 -- 172.21.15.53:0/801300908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a7479b680 con 0x564a743504d0 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe951827640 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74723b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe951026640 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a74724050 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0a8850 tx=0x7fe93c0e2a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea5c5436fdf60c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.874+0000 7fe9357fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.875+0000 7fe9357fa640 1 -- 172.21.15.53:0/801300908 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c020040 con 0x564a743504d0 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.875+0000 7fe9357fa640 1 -- 172.21.15.53:0/801300908 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fe93c0ce0b0 con 0x564a743504d0 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.875+0000 7fe95a9f7740 1 -- 172.21.15.53:0/801300908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe94400fde0 con 0x564a743504d0 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.875+0000 7fe9357fa640 1 -- 172.21.15.53:0/801300908 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe93c0b4190 con 0x564a743504d0 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.875+0000 7fe95a9f7740 10 client.17319 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.875+0000 7fe95a9f7740 1 -- 172.21.15.53:0/801300908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564a7479c6d0 con 0x564a743504d0 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.875+0000 7fe9357fa640 1 -- 172.21.15.53:0/801300908 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe94400fde0 con 0x564a743504d0 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.876+0000 7fe9357fa640 1 -- 172.21.15.53:0/801300908 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe93c0e2ce0 con 0x564a743504d0 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.876+0000 7fe95a9f7740 10 client.17319 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.876+0000 7fe95a9f7740 10 client.17319 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.876+0000 7fe95a9f7740 20 client.17319 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.876+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a743051c0 0x564a7479efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.876+0000 7fe95a9f7740 4 client.17319 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:10:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.876+0000 7fe95a9f7740 1 -- 172.21.15.53:0/801300908 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a746879f0 con 0x564a743051c0 2024-08-31T06:10:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.876+0000 7fe951827640 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a743051c0 0x564a7479efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.876+0000 7fe9357fa640 10 client.17319 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.877+0000 7fe951827640 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a743051c0 0x564a7479efb0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dccafa24b0b0b0aa server_cookie=569b11d6e2f58c95 in_seq=0 out_seq=0 2024-08-31T06:10:01.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe9357fa640 1 -- 172.21.15.53:0/801300908 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a746879f0 con 0x564a743051c0 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe9357fa640 10 client.17319 handle_command_reply: tid=0 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe95a9f7740 1 client.17319 shutdown 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe95a9f7740 1 -- 172.21.15.53:0/801300908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 msgr2=0x564a74724050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a74724050 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0a8850 tx=0x7fe93c0e2a90 comp rx=0 tx=0).stop 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe95a9f7740 1 -- 172.21.15.53:0/801300908 shutdown_connections 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a743051c0 0x564a7479efb0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a743711b0 0x564a7479b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a743504d0 0x564a74724050 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe95a9f7740 1 --2- 172.21.15.53:0/801300908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a743482f0 0x564a74723b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe9357fa640 0 client.17319 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe95a9f7740 1 -- 172.21.15.53:0/801300908 >> 172.21.15.53:0/801300908 conn(0x564a74365300 msgr2=0x564a747165a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.896+0000 7fe95a9f7740 1 -- 172.21.15.53:0/801300908 shutdown_connections 2024-08-31T06:10:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.897+0000 7fe95a9f7740 1 -- 172.21.15.53:0/801300908 wait complete. 2024-08-31T06:10:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.897+0000 7fe95a9f7740 20 client.17319 trim_cache size 0 max 16384 2024-08-31T06:10:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:10:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:10:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:10:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:10:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.897+0000 7fe953a8b640 1 -- 172.21.15.53:0/3300963183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9380b4d20 msgr2=0x7fe9380b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.897+0000 7fe953a8b640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9380b4d20 0x7fe9380b7230 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe9480057c0 tx=0x7fe9480058d0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.897+0000 7fe953a8b640 1 -- 172.21.15.53:0/3300963183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe94c1080a0 msgr2=0x7fe94c06bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.897+0000 7fe953a8b640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe94c1080a0 0x7fe94c06bba0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00d750 tx=0x7fe93c00dc10 comp rx=0 tx=0).stop 2024-08-31T06:10:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.897+0000 7fe953a8b640 1 -- 172.21.15.53:0/3300963183 shutdown_connections 2024-08-31T06:10:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.898+0000 7fe953a8b640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe9380b4d20 0x7fe9380b7230 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.898+0000 7fe953a8b640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe94c1089f0 0x7fe94c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.898+0000 7fe953a8b640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe94c1080a0 0x7fe94c06bba0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.898+0000 7fe953a8b640 1 --2- 172.21.15.53:0/3300963183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe94c102770 0x7fe94c06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.898+0000 7fe953a8b640 1 -- 172.21.15.53:0/3300963183 >> 172.21.15.53:0/3300963183 conn(0x7fe94c07a490 msgr2=0x7fe94c106330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.898+0000 7fe953a8b640 1 -- 172.21.15.53:0/3300963183 shutdown_connections 2024-08-31T06:10:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:01.898+0000 7fe953a8b640 1 -- 172.21.15.53:0/3300963183 wait complete. 2024-08-31T06:10:01.968 INFO:tasks.workunit.client.0.smithi053.stdout: 1 94047 2.01 MB/sec execute 111 sec latency 44.436 ms 2024-08-31T06:10:02.215 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:02 smithi053 ceph-mon[18924]: pgmap v475: 97 pgs: 97 active+clean; 61 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.7 MiB/s wr, 183 op/s 2024-08-31T06:10:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:02 smithi130 ceph-mon[22266]: pgmap v475: 97 pgs: 97 active+clean; 61 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.7 MiB/s wr, 183 op/s 2024-08-31T06:10:02.413 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:10:02.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:02 smithi153 ceph-mon[22320]: pgmap v475: 97 pgs: 97 active+clean; 61 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.7 MiB/s wr, 183 op/s 2024-08-31T06:10:02.493 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:10:02.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 94634 2.01 MB/sec execute 112 sec latency 35.934 ms 2024-08-31T06:10:03.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.045+0000 7f529c0f9640 1 -- 172.21.15.53:0/2402869205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5294101d10 msgr2=0x7f5294102120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:03.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.045+0000 7f529c0f9640 1 --2- 172.21.15.53:0/2402869205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5294101d10 0x7f5294102120 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5290009900 tx=0x7f529002a410 comp rx=0 tx=0).stop 2024-08-31T06:10:03.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.045+0000 7f529c0f9640 1 -- 172.21.15.53:0/2402869205 shutdown_connections 2024-08-31T06:10:03.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.045+0000 7f529c0f9640 1 --2- 172.21.15.53:0/2402869205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5294109ba0 0x7f52941103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:03.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.045+0000 7f529c0f9640 1 --2- 172.21.15.53:0/2402869205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5294109250 0x7f5294109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.045+0000 7f529c0f9640 1 --2- 172.21.15.53:0/2402869205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5294101d10 0x7f5294102120 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.045+0000 7f529c0f9640 1 -- 172.21.15.53:0/2402869205 >> 172.21.15.53:0/2402869205 conn(0x7f5294077a00 msgr2=0x7f5294077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.045+0000 7f529c0f9640 1 -- 172.21.15.53:0/2402869205 shutdown_connections 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.045+0000 7f529c0f9640 1 -- 172.21.15.53:0/2402869205 wait complete. 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.046+0000 7f529c0f9640 1 Processor -- start 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.046+0000 7f529c0f9640 1 -- start start 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.046+0000 7f529c0f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5294101d10 0x7f529419a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f529c0f9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5294109250 0x7f529419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f529c0f9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5294109ba0 0x7f529419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f529c0f9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5294113710 con 0x7f5294101d10 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f529c0f9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5294113590 con 0x7f5294109250 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f529c0f9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5294113890 con 0x7f5294109ba0 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f5299e95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5294101d10 0x7f529419a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f5299e95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5294101d10 0x7f529419a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32980/0 (socket says 172.21.15.53:32980) 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f5299e95640 1 -- 172.21.15.53:0/3322825279 learned_addr learned my addr 172.21.15.53:0/3322825279 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f5299694640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5294109250 0x7f529419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f529a696640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5294109ba0 0x7f529419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f5299694640 1 -- 172.21.15.53:0/3322825279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5294109ba0 msgr2=0x7f529419f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f5299694640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5294109ba0 0x7f529419f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f5299694640 1 -- 172.21.15.53:0/3322825279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5294101d10 msgr2=0x7f529419a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f5299694640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5294101d10 0x7f529419a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f5299694640 1 -- 172.21.15.53:0/3322825279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52941a00d0 con 0x7f5294109250 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f5299e95640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5294101d10 0x7f529419a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f529a696640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5294109ba0 0x7f529419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.047+0000 7f5299694640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5294109250 0x7f529419a700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5294075850 tx=0x7f528400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.048+0000 7f528affd640 1 -- 172.21.15.53:0/3322825279 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528400cc40 con 0x7f5294109250 2024-08-31T06:10:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.048+0000 7f529c0f9640 1 -- 172.21.15.53:0/3322825279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52941a03c0 con 0x7f5294109250 2024-08-31T06:10:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.048+0000 7f528affd640 1 -- 172.21.15.53:0/3322825279 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f528400cde0 con 0x7f5294109250 2024-08-31T06:10:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.048+0000 7f528affd640 1 -- 172.21.15.53:0/3322825279 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284004800 con 0x7f5294109250 2024-08-31T06:10:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.048+0000 7f529c0f9640 1 -- 172.21.15.53:0/3322825279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52941a6b20 con 0x7f5294109250 2024-08-31T06:10:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.049+0000 7f529c0f9640 1 -- 172.21.15.53:0/3322825279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5294102120 con 0x7f5294109250 2024-08-31T06:10:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.050+0000 7f528affd640 1 -- 172.21.15.53:0/3322825279 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5284004a20 con 0x7f5294109250 2024-08-31T06:10:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.051+0000 7f528affd640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52800b4ca0 0x7f52800b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.051+0000 7f5299e95640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52800b4ca0 0x7f52800b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.051+0000 7f528affd640 1 -- 172.21.15.53:0/3322825279 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f52840e5470 con 0x7f5294109250 2024-08-31T06:10:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.052+0000 7f5299e95640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52800b4ca0 0x7f52800b71b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5290032fd0 tx=0x7f52900095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.054+0000 7f528affd640 1 -- 172.21.15.53:0/3322825279 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f52840ac260 con 0x7f5294109250 2024-08-31T06:10:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.318+0000 7f529c0f9640 1 -- 172.21.15.53:0/3322825279 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f529419b290 con 0x7f5294109250 2024-08-31T06:10:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:10:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.319+0000 7f528affd640 1 -- 172.21.15.53:0/3322825279 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11988 (secure 0 0 0) 0x7f52840abb60 con 0x7f5294109250 2024-08-31T06:10:03.322 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:10:03.322 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"btime":"2024-08-31T06:09:25:953687+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:09:25.529444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:10:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 34 2024-08-31T06:10:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 -- 172.21.15.53:0/3322825279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52800b4ca0 msgr2=0x7f52800b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52800b4ca0 0x7f52800b71b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5290032fd0 tx=0x7f52900095c0 comp rx=0 tx=0).stop 2024-08-31T06:10:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 -- 172.21.15.53:0/3322825279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5294109250 msgr2=0x7f529419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5294109250 0x7f529419a700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5294075850 tx=0x7f528400ee50 comp rx=0 tx=0).stop 2024-08-31T06:10:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 -- 172.21.15.53:0/3322825279 shutdown_connections 2024-08-31T06:10:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52800b4ca0 0x7f52800b71b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5294109ba0 0x7f529419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5294109250 0x7f529419a700 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 --2- 172.21.15.53:0/3322825279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5294101d10 0x7f529419a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 -- 172.21.15.53:0/3322825279 >> 172.21.15.53:0/3322825279 conn(0x7f5294077a00 msgr2=0x7f5294107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 -- 172.21.15.53:0/3322825279 shutdown_connections 2024-08-31T06:10:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:03.322+0000 7f529c0f9640 1 -- 172.21.15.53:0/3322825279 wait complete. 2024-08-31T06:10:03.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 95185 2.04 MB/sec execute 113 sec latency 59.979 ms 2024-08-31T06:10:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.077+0000 7f0f017d8640 1 -- 172.21.15.53:0/3423529192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0efc102e20 msgr2=0x7f0efc103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.077+0000 7f0f017d8640 1 --2- 172.21.15.53:0/3423529192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0efc102e20 0x7f0efc103230 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009900 tx=0x7f0eec02a410 comp rx=0 tx=0).stop 2024-08-31T06:10:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.077+0000 7f0f017d8640 1 -- 172.21.15.53:0/3423529192 shutdown_connections 2024-08-31T06:10:04.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.077+0000 7f0f017d8640 1 --2- 172.21.15.53:0/3423529192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0efc105860 0x7f0efc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.077+0000 7f0f017d8640 1 --2- 172.21.15.53:0/3423529192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0efc104f10 0x7f0efc105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.077+0000 7f0f017d8640 1 --2- 172.21.15.53:0/3423529192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0efc102e20 0x7f0efc103230 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.077+0000 7f0f017d8640 1 -- 172.21.15.53:0/3423529192 >> 172.21.15.53:0/3423529192 conn(0x7f0efc077a00 msgr2=0x7f0efc077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:04.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.077+0000 7f0f017d8640 1 -- 172.21.15.53:0/3423529192 shutdown_connections 2024-08-31T06:10:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.077+0000 7f0f017d8640 1 -- 172.21.15.53:0/3423529192 wait complete. 2024-08-31T06:10:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.078+0000 7f0f017d8640 1 Processor -- start 2024-08-31T06:10:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.078+0000 7f0f017d8640 1 -- start start 2024-08-31T06:10:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0f017d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0efc102e20 0x7f0efc19afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0f017d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0efc104f10 0x7f0efc19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0f017d8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0efc105860 0x7f0efc19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0f017d8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc112600 con 0x7f0efc102e20 2024-08-31T06:10:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0f017d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc112480 con 0x7f0efc104f10 2024-08-31T06:10:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0f017d8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc112780 con 0x7f0efc105860 2024-08-31T06:10:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0efaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0efc102e20 0x7f0efc19afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0efaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0efc102e20 0x7f0efc19afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55578/0 (socket says 172.21.15.53:55578) 2024-08-31T06:10:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0efaffd640 1 -- 172.21.15.53:0/210448907 learned_addr learned my addr 172.21.15.53:0/210448907 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0efc104f10 0x7f0efc19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0efb7fe640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0efc105860 0x7f0efc19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0efaffd640 1 -- 172.21.15.53:0/210448907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0efc105860 msgr2=0x7f0efc19ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0efaffd640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0efc105860 0x7f0efc19ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0efaffd640 1 -- 172.21.15.53:0/210448907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0efc104f10 msgr2=0x7f0efc19b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0efaffd640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0efc104f10 0x7f0efc19b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0efaffd640 1 -- 172.21.15.53:0/210448907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0efc198ef0 con 0x7f0efc102e20 2024-08-31T06:10:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.079+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0efc104f10 0x7f0efc19b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.080+0000 7f0efaffd640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0efc102e20 0x7f0efc19afd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009230 tx=0x7f0eec031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.080+0000 7f0ee3fff640 1 -- 172.21.15.53:0/210448907 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec04c070 con 0x7f0efc102e20 2024-08-31T06:10:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.080+0000 7f0f017d8640 1 -- 172.21.15.53:0/210448907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0efc199180 con 0x7f0efc102e20 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.080+0000 7f0f017d8640 1 -- 172.21.15.53:0/210448907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0efc1996b0 con 0x7f0efc102e20 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.080+0000 7f0ee3fff640 1 -- 172.21.15.53:0/210448907 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0eec0044d0 con 0x7f0efc102e20 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.080+0000 7f0ee3fff640 1 -- 172.21.15.53:0/210448907 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec035050 con 0x7f0efc102e20 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.083+0000 7f0f07d4d740 1 Processor -- start 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.083+0000 7f0ee3fff640 1 -- 172.21.15.53:0/210448907 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0eec04f070 con 0x7f0efc102e20 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.083+0000 7f0f07d4d740 1 -- start start 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.083+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b866310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.083+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b866850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.083+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b866d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56536b7dd680 con 0x56536b4981b0 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56536b7ccc10 con 0x56536b4a0390 2024-08-31T06:10:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56536b7d0bc0 con 0x56536b4c1070 2024-08-31T06:10:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b866310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b866850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efa7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b866d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b866310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44164/0 (socket says 172.21.15.53:44164) 2024-08-31T06:10:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efb7fe640 1 -- 172.21.15.53:0/1730183741 learned_addr learned my addr 172.21.15.53:0/1730183741 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0ee3fff640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0ee40b4d20 0x7f0ee40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efb7fe640 1 -- 172.21.15.53:0/1730183741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 msgr2=0x56536b866d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efb7fe640 1 --2- 172.21.15.53:0/1730183741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b866d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efb7fe640 1 -- 172.21.15.53:0/1730183741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 msgr2=0x56536b866850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efb7fe640 1 --2- 172.21.15.53:0/1730183741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b866850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efb7fe640 1 -- 172.21.15.53:0/1730183741 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536b52c650 con 0x56536b4c1070 2024-08-31T06:10:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/1730183741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b866d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0ee3fff640 1 -- 172.21.15.53:0/210448907 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0eec10d400 con 0x7f0efc102e20 2024-08-31T06:10:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efb7fe640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0ee40b4d20 0x7f0ee40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.084+0000 7f0efb7fe640 1 --2- 172.21.15.53:0/1730183741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b866310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009f30 tx=0x7f0ef40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea6016c86b72f201 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.085+0000 7f0ee17fa640 1 -- 172.21.15.53:0/1730183741 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4004250 con 0x56536b4c1070 2024-08-31T06:10:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.085+0000 7f0ee17fa640 1 -- 172.21.15.53:0/1730183741 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ef4003e10 con 0x56536b4c1070 2024-08-31T06:10:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.085+0000 7f0ee17fa640 1 -- 172.21.15.53:0/1730183741 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef401b430 con 0x56536b4c1070 2024-08-31T06:10:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1730183741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 msgr2=0x56536b866310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0efb7fe640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0ee40b4d20 0x7f0ee40b7230 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4020000 tx=0x7f0ef401bb30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/1730183741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b866310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009f30 tx=0x7f0ef40118d0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1730183741 shutdown_connections 2024-08-31T06:10:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/1730183741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b866d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/1730183741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b866850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/1730183741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b866310 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1730183741 >> 172.21.15.53:0/1730183741 conn(0x56536b4b5460 msgr2=0x56536b864200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1730183741 shutdown_connections 2024-08-31T06:10:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1730183741 wait complete. 2024-08-31T06:10:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0f07d4d740 1 -- start start 2024-08-31T06:10:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.086+0000 7f0f07d4d740 1 Processor -- start 2024-08-31T06:10:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b871a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b871f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b87de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56536b62f700 con 0x56536b4981b0 2024-08-31T06:10:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56536b753750 con 0x56536b4a0390 2024-08-31T06:10:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56536b874af0 con 0x56536b4c1070 2024-08-31T06:10:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b871a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efa7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b871f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b871a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55598/0 (socket says 172.21.15.53:55598) 2024-08-31T06:10:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efaffd640 1 -- 172.21.15.53:0/1639076293 learned_addr learned my addr 172.21.15.53:0/1639076293 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:04.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0f07d4d740 10 client.0 _ll_register_callbacks cb 0x56536b782e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:04.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efa7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b871f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36542/0 (socket says 172.21.15.53:36542) 2024-08-31T06:10:04.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efb7fe640 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b87de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efaffd640 1 -- 172.21.15.53:0/1639076293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 msgr2=0x56536b87de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:04.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efaffd640 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b87de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efaffd640 1 -- 172.21.15.53:0/1639076293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 msgr2=0x56536b871f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:04.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efaffd640 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b871f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efaffd640 1 -- 172.21.15.53:0/1639076293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56536b78c900 con 0x56536b4981b0 2024-08-31T06:10:04.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.087+0000 7f0efb7fe640 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b87de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.088+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b871f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.088+0000 7f0efaffd640 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b871a50 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f0eec10abb0 tx=0x7f0eec0d4140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f7789b3243158 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.088+0000 7f0edeff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.088+0000 7f0edeff5640 1 -- 172.21.15.53:0/1639076293 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0cfa60 con 0x56536b4981b0 2024-08-31T06:10:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.088+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1639076293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ef4003e10 con 0x56536b4981b0 2024-08-31T06:10:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.088+0000 7f0edeff5640 1 -- 172.21.15.53:0/1639076293 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0eec0dcb90 con 0x56536b4981b0 2024-08-31T06:10:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.088+0000 7f0edeff5640 1 -- 172.21.15.53:0/1639076293 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0eec0cf330 con 0x56536b4981b0 2024-08-31T06:10:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.088+0000 7f0f07d4d740 10 client.17337 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.088+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1639076293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56536b880890 con 0x56536b4981b0 2024-08-31T06:10:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.088+0000 7f0edeff5640 1 -- 172.21.15.53:0/1639076293 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ef4003e10 con 0x56536b4981b0 2024-08-31T06:10:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.089+0000 7f0edeff5640 1 -- 172.21.15.53:0/1639076293 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f0eec0d2e00 con 0x56536b4981b0 2024-08-31T06:10:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.089+0000 7f0f07d4d740 10 client.17337 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.089+0000 7f0f07d4d740 10 client.17337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.089+0000 7f0f07d4d740 20 client.17337 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.089+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56536b47f9f0 0x56536b883dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.089+0000 7f0f07d4d740 4 client.17337 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.089+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1639076293 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56536b7df5d0 con 0x56536b47f9f0 2024-08-31T06:10:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.089+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56536b47f9f0 0x56536b883dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.090+0000 7f0edeff5640 10 client.17337 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.090+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56536b47f9f0 0x56536b883dd0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d80be6550a5181ab server_cookie=fcff80f360dbb689 in_seq=0 out_seq=0 2024-08-31T06:10:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0edeff5640 1 -- 172.21.15.53:0/1639076293 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56536b7df5d0 con 0x56536b47f9f0 2024-08-31T06:10:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0edeff5640 10 client.17337 handle_command_reply: tid=0 2024-08-31T06:10:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 1 client.17337 shutdown 2024-08-31T06:10:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1639076293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 msgr2=0x56536b871a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b871a50 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f0eec10abb0 tx=0x7f0eec0d4140 comp rx=0 tx=0).stop 2024-08-31T06:10:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1639076293 shutdown_connections 2024-08-31T06:10:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56536b47f9f0 0x56536b883dd0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b87de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b871f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/1639076293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b871a50 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0edeff5640 0 client.17337 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1639076293 >> 172.21.15.53:0/1639076293 conn(0x56536b4b5460 msgr2=0x56536b8694a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1639076293 shutdown_connections 2024-08-31T06:10:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 1 -- 172.21.15.53:0/1639076293 wait complete. 2024-08-31T06:10:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.091+0000 7f0f07d4d740 20 client.17337 trim_cache size 0 max 16384 2024-08-31T06:10:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0f07d4d740 1 Processor -- start 2024-08-31T06:10:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0f07d4d740 1 -- start start 2024-08-31T06:10:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b869b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b86ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b86f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee800e7d0 con 0x56536b4981b0 2024-08-31T06:10:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee8010370 con 0x56536b4a0390 2024-08-31T06:10:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee800eea0 con 0x56536b4c1070 2024-08-31T06:10:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0efaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b869b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0efb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b86f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0efa7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b86ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0efb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b86f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44182/0 (socket says 172.21.15.53:44182) 2024-08-31T06:10:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0efaffd640 1 --2- 172.21.15.53:0/3691310422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b869b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55606/0 (socket says 172.21.15.53:55606) 2024-08-31T06:10:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.106+0000 7f0efb7fe640 1 -- 172.21.15.53:0/3691310422 learned_addr learned my addr 172.21.15.53:0/3691310422 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.107+0000 7f0efa7fc640 1 -- 172.21.15.53:0/3691310422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 msgr2=0x56536b86f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.107+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/3691310422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b86f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.107+0000 7f0efa7fc640 1 -- 172.21.15.53:0/3691310422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 msgr2=0x56536b869b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:04.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.107+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/3691310422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b869b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.107+0000 7f0efa7fc640 1 -- 172.21.15.53:0/3691310422 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536b869170 con 0x56536b4a0390 2024-08-31T06:10:04.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.107+0000 7f0efb7fe640 1 --2- 172.21.15.53:0/3691310422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b86f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:04.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.107+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/3691310422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b86ec40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x56536b884510 tx=0x7f0ef000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8dec681affd5686 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:04.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.107+0000 7f0ee0ff9640 1 -- 172.21.15.53:0/3691310422 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0010b20 con 0x56536b4a0390 2024-08-31T06:10:04.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.107+0000 7f0ee0ff9640 1 -- 172.21.15.53:0/3691310422 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ef00054b0 con 0x56536b4a0390 2024-08-31T06:10:04.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.107+0000 7f0ee0ff9640 1 -- 172.21.15.53:0/3691310422 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0004b90 con 0x56536b4a0390 2024-08-31T06:10:04.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.108+0000 7f0f07d4d740 1 -- 172.21.15.53:0/3691310422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 msgr2=0x56536b86ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:04.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.108+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/3691310422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b86ec40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x56536b884510 tx=0x7f0ef000b390 comp rx=0 tx=0).stop 2024-08-31T06:10:04.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.108+0000 7f0f07d4d740 1 -- 172.21.15.53:0/3691310422 shutdown_connections 2024-08-31T06:10:04.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.108+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/3691310422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4c1070 0x56536b86f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.108+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/3691310422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4a0390 0x56536b86ec40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.108+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/3691310422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b869b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.108+0000 7f0f07d4d740 1 -- 172.21.15.53:0/3691310422 >> 172.21.15.53:0/3691310422 conn(0x56536b4b5460 msgr2=0x56536b869410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:04.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.108+0000 7f0f07d4d740 1 -- 172.21.15.53:0/3691310422 shutdown_connections 2024-08-31T06:10:04.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.108+0000 7f0f07d4d740 1 -- 172.21.15.53:0/3691310422 wait complete. 2024-08-31T06:10:04.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0f07d4d740 1 -- start start 2024-08-31T06:10:04.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0f07d4d740 1 Processor -- start 2024-08-31T06:10:04.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b8768e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4a0390 0x56536b876ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0f07d4d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4c1070 0x56536b8e7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee800fca0 con 0x56536b4981b0 2024-08-31T06:10:04.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee800f570 con 0x56536b4c1070 2024-08-31T06:10:04.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0f07d4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee800c7b0 con 0x56536b4a0390 2024-08-31T06:10:04.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0efaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b8768e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0f07d4d740 10 client.0 _ll_register_callbacks cb 0x7f0eec0d0060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:04.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0efaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b8768e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55608/0 (socket says 172.21.15.53:55608) 2024-08-31T06:10:04.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0efaffd640 1 -- 172.21.15.53:0/485295713 learned_addr learned my addr 172.21.15.53:0/485295713 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:04.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4a0390 0x56536b876ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.109+0000 7f0efb7fe640 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4c1070 0x56536b8e7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0efaffd640 1 -- 172.21.15.53:0/485295713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4a0390 msgr2=0x56536b876ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:04.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0efaffd640 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4a0390 0x56536b876ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0efaffd640 1 -- 172.21.15.53:0/485295713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4c1070 msgr2=0x56536b8e7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:04.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0efaffd640 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4c1070 0x56536b8e7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0efaffd640 1 -- 172.21.15.53:0/485295713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56536b8e7fc0 con 0x56536b4981b0 2024-08-31T06:10:04.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4a0390 0x56536b876ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:04.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0efaffd640 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b8768e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f0eec10b150 tx=0x7f0eec009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92581a3ce2e72e4a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:04.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0edeff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:04.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0edeff5640 1 -- 172.21.15.53:0/485295713 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0d3310 con 0x56536b4981b0 2024-08-31T06:10:04.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0edeff5640 1 -- 172.21.15.53:0/485295713 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f0eec0f6bd0 con 0x56536b4981b0 2024-08-31T06:10:04.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0f07d4d740 1 -- 172.21.15.53:0/485295713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ef00054b0 con 0x56536b4981b0 2024-08-31T06:10:04.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0edeff5640 1 -- 172.21.15.53:0/485295713 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0eec0d34f0 con 0x56536b4981b0 2024-08-31T06:10:04.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0f07d4d740 10 client.17343 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:04.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.110+0000 7f0f07d4d740 1 -- 172.21.15.53:0/485295713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56536b8ef3b0 con 0x56536b4981b0 2024-08-31T06:10:04.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.111+0000 7f0edeff5640 1 -- 172.21.15.53:0/485295713 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ef00054b0 con 0x56536b4981b0 2024-08-31T06:10:04.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.111+0000 7f0edeff5640 1 -- 172.21.15.53:0/485295713 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f0eec0d2870 con 0x56536b4981b0 2024-08-31T06:10:04.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.111+0000 7f0f07d4d740 10 client.17343 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:04.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.111+0000 7f0f07d4d740 10 client.17343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:04.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.111+0000 7f0f07d4d740 20 client.17343 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:04.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.111+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56536b454da0 0x56536b8f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:04.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.111+0000 7f0f07d4d740 4 client.17343 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:10:04.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.111+0000 7f0f07d4d740 1 -- 172.21.15.53:0/485295713 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56536b7db070 con 0x56536b454da0 2024-08-31T06:10:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.111+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56536b454da0 0x56536b8f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0efa7fc640 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56536b454da0 0x56536b8f18f0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdc067fdced8dfd8 server_cookie=70654ab85285be5e in_seq=0 out_seq=0 2024-08-31T06:10:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0edeff5640 10 client.17343 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0edeff5640 1 -- 172.21.15.53:0/485295713 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56536b7db070 con 0x56536b454da0 2024-08-31T06:10:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0edeff5640 10 client.17343 handle_command_reply: tid=0 2024-08-31T06:10:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 1 client.17343 shutdown 2024-08-31T06:10:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 1 -- 172.21.15.53:0/485295713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 msgr2=0x56536b8768e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b8768e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f0eec10b150 tx=0x7f0eec009680 comp rx=0 tx=0).stop 2024-08-31T06:10:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 1 -- 172.21.15.53:0/485295713 shutdown_connections 2024-08-31T06:10:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56536b454da0 0x56536b8f18f0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56536b4c1070 0x56536b8e7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56536b4a0390 0x56536b876ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0edeff5640 0 client.17343 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:04.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 1 --2- 172.21.15.53:0/485295713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56536b4981b0 0x56536b8768e0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 1 -- 172.21.15.53:0/485295713 >> 172.21.15.53:0/485295713 conn(0x56536b4b5460 msgr2=0x56536b867340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:04.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 1 -- 172.21.15.53:0/485295713 shutdown_connections 2024-08-31T06:10:04.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 1 -- 172.21.15.53:0/485295713 wait complete. 2024-08-31T06:10:04.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.112+0000 7f0f07d4d740 20 client.17343 trim_cache size 0 max 16384 2024-08-31T06:10:04.172 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:10:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 -- 172.21.15.53:0/210448907 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0ee40b4d20 msgr2=0x7f0ee40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0ee40b4d20 0x7f0ee40b7230 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4020000 tx=0x7f0ef401bb30 comp rx=0 tx=0).stop 2024-08-31T06:10:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 -- 172.21.15.53:0/210448907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0efc102e20 msgr2=0x7f0efc19afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0efc102e20 0x7f0efc19afd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009230 tx=0x7f0eec031630 comp rx=0 tx=0).stop 2024-08-31T06:10:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 -- 172.21.15.53:0/210448907 shutdown_connections 2024-08-31T06:10:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0ee40b4d20 0x7f0ee40b7230 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0efc105860 0x7f0efc19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0efc104f10 0x7f0efc19b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 --2- 172.21.15.53:0/210448907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0efc102e20 0x7f0efc19afd0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:04.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 -- 172.21.15.53:0/210448907 >> 172.21.15.53:0/210448907 conn(0x7f0efc077a00 msgr2=0x7f0efc106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:04.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 -- 172.21.15.53:0/210448907 shutdown_connections 2024-08-31T06:10:04.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:04.113+0000 7f0f017d8640 1 -- 172.21.15.53:0/210448907 wait complete. 2024-08-31T06:10:04.231 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:04 smithi053 ceph-mon[18924]: pgmap v476: 97 pgs: 97 active+clean; 62 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 1.4 MiB/s wr, 155 op/s 2024-08-31T06:10:04.231 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:04 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3322825279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:10:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:04 smithi130 ceph-mon[22266]: pgmap v476: 97 pgs: 97 active+clean; 62 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 1.4 MiB/s wr, 155 op/s 2024-08-31T06:10:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:04 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3322825279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:10:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:04 smithi153 ceph-mon[22320]: pgmap v476: 97 pgs: 97 active+clean; 62 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 1.4 MiB/s wr, 155 op/s 2024-08-31T06:10:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:04 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3322825279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:10:04.894 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 152.7 --await-for 45.0' 2024-08-31T06:10:04.895 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 152.7 --await-for 45.0 2024-08-31T06:10:04.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 95632 2.04 MB/sec execute 114 sec latency 15.386 ms 2024-08-31T06:10:05.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96098 2.06 MB/sec execute 115 sec latency 47.172 ms 2024-08-31T06:10:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:06 smithi130 ceph-mon[22266]: pgmap v477: 97 pgs: 97 active+clean; 57 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 1.3 MiB/s wr, 160 op/s 2024-08-31T06:10:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:06 smithi153 ceph-mon[22320]: pgmap v477: 97 pgs: 97 active+clean; 57 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 1.3 MiB/s wr, 160 op/s 2024-08-31T06:10:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:06 smithi053 ceph-mon[18924]: pgmap v477: 97 pgs: 97 active+clean; 57 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 1.3 MiB/s wr, 160 op/s 2024-08-31T06:10:06.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96372 2.04 MB/sec execute 116 sec latency 19.192 ms 2024-08-31T06:10:07.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96410 2.02 MB/sec execute 117 sec latency 858.000 ms 2024-08-31T06:10:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:08 smithi130 ceph-mon[22266]: pgmap v478: 97 pgs: 97 active+clean; 59 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 1.6 MiB/s wr, 188 op/s 2024-08-31T06:10:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:08 smithi153 ceph-mon[22320]: pgmap v478: 97 pgs: 97 active+clean; 59 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 1.6 MiB/s wr, 188 op/s 2024-08-31T06:10:08.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:08 smithi053 ceph-mon[18924]: pgmap v478: 97 pgs: 97 active+clean; 59 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 1.6 MiB/s wr, 188 op/s 2024-08-31T06:10:08.582 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:10:08.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96410 2.01 MB/sec execute 118 sec latency 1858.071 ms 2024-08-31T06:10:09.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.087+0000 7fa0709ae640 1 -- 172.21.15.53:0/2933065390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa06c106990 msgr2=0x7fa06c110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:09.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.087+0000 7fa0709ae640 1 --2- 172.21.15.53:0/2933065390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa06c106990 0x7fa06c110420 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fa064009ca0 tx=0x7fa06402a8e0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.087+0000 7fa0709ae640 1 -- 172.21.15.53:0/2933065390 shutdown_connections 2024-08-31T06:10:09.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.087+0000 7fa0709ae640 1 --2- 172.21.15.53:0/2933065390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa06c106990 0x7fa06c110420 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.087+0000 7fa0709ae640 1 --2- 172.21.15.53:0/2933065390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa06c106040 0x7fa06c106450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.087+0000 7fa0709ae640 1 --2- 172.21.15.53:0/2933065390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa06c101f30 0x7fa06c102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.087+0000 7fa0709ae640 1 -- 172.21.15.53:0/2933065390 >> 172.21.15.53:0/2933065390 conn(0x7fa06c079d70 msgr2=0x7fa06c07a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:09.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.088+0000 7fa0709ae640 1 -- 172.21.15.53:0/2933065390 shutdown_connections 2024-08-31T06:10:09.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.088+0000 7fa0709ae640 1 -- 172.21.15.53:0/2933065390 wait complete. 2024-08-31T06:10:09.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.088+0000 7fa0709ae640 1 Processor -- start 2024-08-31T06:10:09.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.088+0000 7fa0709ae640 1 -- start start 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa0709ae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa06c101f30 0x7fa06c19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa0709ae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa06c106040 0x7fa06c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa0709ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa06c106990 0x7fa06c19f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa0709ae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c113770 con 0x7fa06c106990 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa0709ae640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1135f0 con 0x7fa06c101f30 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa0709ae640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1138f0 con 0x7fa06c106040 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa06ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa06c106990 0x7fa06c19f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa06ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa06c106990 0x7fa06c19f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55630/0 (socket says 172.21.15.53:55630) 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa06ad9d640 1 -- 172.21.15.53:0/3690219247 learned_addr learned my addr 172.21.15.53:0/3690219247 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa06a59c640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa06c101f30 0x7fa06c19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa069d9b640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa06c106040 0x7fa06c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa06ad9d640 1 -- 172.21.15.53:0/3690219247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa06c106040 msgr2=0x7fa06c19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:09.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa06ad9d640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa06c106040 0x7fa06c19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa06ad9d640 1 -- 172.21.15.53:0/3690219247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa06c101f30 msgr2=0x7fa06c19a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:09.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa06ad9d640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa06c101f30 0x7fa06c19a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.089+0000 7fa06ad9d640 1 -- 172.21.15.53:0/3690219247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c1a0010 con 0x7fa06c106990 2024-08-31T06:10:09.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.090+0000 7fa06ad9d640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa06c106990 0x7fa06c19f9a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fa0640097b0 tx=0x7fa064031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:09.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.090+0000 7fa05b7fe640 1 -- 172.21.15.53:0/3690219247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064004040 con 0x7fa06c106990 2024-08-31T06:10:09.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.090+0000 7fa0709ae640 1 -- 172.21.15.53:0/3690219247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06c1a02a0 con 0x7fa06c106990 2024-08-31T06:10:09.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.090+0000 7fa0709ae640 1 -- 172.21.15.53:0/3690219247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06c1a6b20 con 0x7fa06c106990 2024-08-31T06:10:09.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.090+0000 7fa05b7fe640 1 -- 172.21.15.53:0/3690219247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa064004670 con 0x7fa06c106990 2024-08-31T06:10:09.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.090+0000 7fa05b7fe640 1 -- 172.21.15.53:0/3690219247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064030cf0 con 0x7fa06c106990 2024-08-31T06:10:09.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.092+0000 7fa076f23740 1 Processor -- start 2024-08-31T06:10:09.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.093+0000 7fa05b7fe640 1 -- 172.21.15.53:0/3690219247 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa06404d440 con 0x7fa06c106990 2024-08-31T06:10:09.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.093+0000 7fa076f23740 1 -- start start 2024-08-31T06:10:09.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.093+0000 7fa076f23740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc248840 0x5582bc5efc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.093+0000 7fa076f23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc21f980 0x5582bc5f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.093+0000 7fa076f23740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc227b60 0x5582bc5f0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.093+0000 7fa076f23740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5582bc564330 con 0x5582bc248840 2024-08-31T06:10:09.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.093+0000 7fa076f23740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5582bc5538c0 con 0x5582bc21f980 2024-08-31T06:10:09.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.093+0000 7fa076f23740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5582bc557870 con 0x5582bc227b60 2024-08-31T06:10:09.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa069d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc248840 0x5582bc5efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa069d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc248840 0x5582bc5efc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55644/0 (socket says 172.21.15.53:55644) 2024-08-31T06:10:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa069d9b640 1 -- 172.21.15.53:0/2371760284 learned_addr learned my addr 172.21.15.53:0/2371760284 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa06a59c640 1 --2- 172.21.15.53:0/2371760284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc21f980 0x5582bc5f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa069d9b640 1 --2- 172.21.15.53:0/2371760284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc227b60 0x5582bc5f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa05b7fe640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0540b4d50 0x7fa0540b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa069d9b640 1 -- 172.21.15.53:0/2371760284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc227b60 msgr2=0x5582bc5f0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa069d9b640 1 --2- 172.21.15.53:0/2371760284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc227b60 0x5582bc5f0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa069d9b640 1 -- 172.21.15.53:0/2371760284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc21f980 msgr2=0x5582bc5f01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa069d9b640 1 --2- 172.21.15.53:0/2371760284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc21f980 0x5582bc5f01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa069d9b640 1 -- 172.21.15.53:0/2371760284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582bc50bdf0 con 0x5582bc248840 2024-08-31T06:10:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa06ad9d640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0540b4d50 0x7fa0540b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa05b7fe640 1 -- 172.21.15.53:0/3690219247 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa0641067c0 con 0x7fa06c106990 2024-08-31T06:10:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa069d9b640 1 --2- 172.21.15.53:0/2371760284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc248840 0x5582bc5efc90 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa060009f00 tx=0x7fa060009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ea07127745d129 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.094+0000 7fa058ff9640 1 -- 172.21.15.53:0/2371760284 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060017610 con 0x5582bc248840 2024-08-31T06:10:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.095+0000 7fa058ff9640 1 -- 172.21.15.53:0/2371760284 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa06001c070 con 0x5582bc248840 2024-08-31T06:10:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.095+0000 7fa058ff9640 1 -- 172.21.15.53:0/2371760284 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060015740 con 0x5582bc248840 2024-08-31T06:10:09.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.095+0000 7fa076f23740 1 -- 172.21.15.53:0/2371760284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc248840 msgr2=0x5582bc5efc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:09.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.095+0000 7fa076f23740 1 --2- 172.21.15.53:0/2371760284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc248840 0x5582bc5efc90 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa060009f00 tx=0x7fa060009570 comp rx=0 tx=0).stop 2024-08-31T06:10:09.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.095+0000 7fa06ad9d640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0540b4d50 0x7fa0540b7260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa064103fc0 tx=0x7fa06409a350 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:09.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.095+0000 7fa076f23740 1 -- 172.21.15.53:0/2371760284 shutdown_connections 2024-08-31T06:10:09.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.095+0000 7fa076f23740 1 --2- 172.21.15.53:0/2371760284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc227b60 0x5582bc5f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 --2- 172.21.15.53:0/2371760284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc21f980 0x5582bc5f01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 --2- 172.21.15.53:0/2371760284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc248840 0x5582bc5efc90 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 -- 172.21.15.53:0/2371760284 >> 172.21.15.53:0/2371760284 conn(0x5582bc23c990 msgr2=0x5582bc5edb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:09.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 -- 172.21.15.53:0/2371760284 shutdown_connections 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 -- 172.21.15.53:0/2371760284 wait complete. 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 -- start start 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 Processor -- start 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5fb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc227b60 0x5582bc5fb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc248840 0x5582bc607760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5582bc3b67a0 con 0x5582bc21f980 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5582bc4da240 con 0x5582bc248840 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.096+0000 7fa076f23740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5582bc5fe410 con 0x5582bc227b60 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa076f23740 10 client.0 _ll_register_callbacks cb 0x5582bc260090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa069d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5fb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa069d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5fb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55658/0 (socket says 172.21.15.53:55658) 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa069d9b640 1 -- 172.21.15.53:0/107358872 learned_addr learned my addr 172.21.15.53:0/107358872 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa06a59c640 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc227b60 0x5582bc5fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa069d9b640 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc248840 0x5582bc607760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa069d9b640 1 -- 172.21.15.53:0/107358872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc227b60 msgr2=0x5582bc5fb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa069d9b640 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc227b60 0x5582bc5fb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa069d9b640 1 -- 172.21.15.53:0/107358872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc248840 msgr2=0x5582bc607760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa069d9b640 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc248840 0x5582bc607760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa069d9b640 1 -- 172.21.15.53:0/107358872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582bc5102b0 con 0x5582bc21f980 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa06a59c640 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc227b60 0x5582bc5fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa069d9b640 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5fb430 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa060004700 tx=0x7fa0600153e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03f95b89c020685 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa051ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa051ffb640 1 -- 172.21.15.53:0/107358872 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600178b0 con 0x5582bc21f980 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa051ffb640 1 -- 172.21.15.53:0/107358872 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa060017a50 con 0x5582bc21f980 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa076f23740 1 -- 172.21.15.53:0/107358872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa06001c070 con 0x5582bc21f980 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.097+0000 7fa051ffb640 1 -- 172.21.15.53:0/107358872 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa0600154c0 con 0x5582bc21f980 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.098+0000 7fa076f23740 10 client.17355 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.098+0000 7fa076f23740 1 -- 172.21.15.53:0/107358872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5582bc2c2b90 con 0x5582bc21f980 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.098+0000 7fa051ffb640 1 -- 172.21.15.53:0/107358872 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa06001c070 con 0x5582bc21f980 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.098+0000 7fa051ffb640 1 -- 172.21.15.53:0/107358872 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa060020540 con 0x5582bc21f980 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.098+0000 7fa076f23740 10 client.17355 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.098+0000 7fa076f23740 10 client.17355 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.098+0000 7fa076f23740 20 client.17355 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.098+0000 7fa076f23740 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5582bc2071c0 0x5582bc60d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.098+0000 7fa076f23740 4 client.17355 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.098+0000 7fa076f23740 1 -- 172.21.15.53:0/107358872 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582bc566280 con 0x5582bc2071c0 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.098+0000 7fa06a59c640 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5582bc2071c0 0x5582bc60d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.099+0000 7fa06a59c640 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5582bc2071c0 0x5582bc60d3d0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a11aa015319fb783 server_cookie=7188178ff5673c53 in_seq=0 out_seq=0 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.099+0000 7fa051ffb640 10 client.17355 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa051ffb640 1 -- 172.21.15.53:0/107358872 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582bc566280 con 0x5582bc2071c0 2024-08-31T06:10:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa051ffb640 10 client.17355 handle_command_reply: tid=0 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 1 client.17355 shutdown 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 1 -- 172.21.15.53:0/107358872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 msgr2=0x5582bc5fb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5fb430 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa060004700 tx=0x7fa0600153e0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 1 -- 172.21.15.53:0/107358872 shutdown_connections 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5582bc2071c0 0x5582bc60d3d0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc248840 0x5582bc607760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc227b60 0x5582bc5fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 1 --2- 172.21.15.53:0/107358872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5fb430 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 1 -- 172.21.15.53:0/107358872 >> 172.21.15.53:0/107358872 conn(0x5582bc23c990 msgr2=0x5582bc5f2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa051ffb640 0 client.17355 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 1 -- 172.21.15.53:0/107358872 shutdown_connections 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 1 -- 172.21.15.53:0/107358872 wait complete. 2024-08-31T06:10:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.100+0000 7fa076f23740 20 client.17355 trim_cache size 0 max 16384 2024-08-31T06:10:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.117+0000 7fa076f23740 1 Processor -- start 2024-08-31T06:10:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.117+0000 7fa076f23740 1 -- start start 2024-08-31T06:10:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa076f23740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5f1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa076f23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc227b60 0x5582bc5fb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa076f23740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc248840 0x5582bc5fd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa076f23740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1af420 con 0x5582bc21f980 2024-08-31T06:10:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa076f23740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1b0fc0 con 0x5582bc227b60 2024-08-31T06:10:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa076f23740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1afaf0 con 0x5582bc248840 2024-08-31T06:10:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa069d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa069d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5f1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55674/0 (socket says 172.21.15.53:55674) 2024-08-31T06:10:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa069d9b640 1 -- 172.21.15.53:0/3246999814 learned_addr learned my addr 172.21.15.53:0/3246999814 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa06a59c640 1 --2- 172.21.15.53:0/3246999814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc227b60 0x5582bc5fb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa069d9b640 1 --2- 172.21.15.53:0/3246999814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc248840 0x5582bc5fd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa069d9b640 1 -- 172.21.15.53:0/3246999814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc248840 msgr2=0x5582bc5fd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa069d9b640 1 --2- 172.21.15.53:0/3246999814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc248840 0x5582bc5fd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa069d9b640 1 -- 172.21.15.53:0/3246999814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc227b60 msgr2=0x5582bc5fb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa069d9b640 1 --2- 172.21.15.53:0/3246999814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc227b60 0x5582bc5fb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa069d9b640 1 -- 172.21.15.53:0/3246999814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582bc523d90 con 0x5582bc21f980 2024-08-31T06:10:09.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.118+0000 7fa069d9b640 1 --2- 172.21.15.53:0/3246999814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5f1330 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fa060006ad0 tx=0x7fa060015450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996074e031b31344 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:09.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.119+0000 7fa053fff640 1 -- 172.21.15.53:0/3246999814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600093a0 con 0x5582bc21f980 2024-08-31T06:10:09.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.119+0000 7fa053fff640 1 -- 172.21.15.53:0/3246999814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa06001c040 con 0x5582bc21f980 2024-08-31T06:10:09.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.119+0000 7fa053fff640 1 -- 172.21.15.53:0/3246999814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060015660 con 0x5582bc21f980 2024-08-31T06:10:09.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.119+0000 7fa076f23740 1 -- 172.21.15.53:0/3246999814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 msgr2=0x5582bc5f1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:09.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.119+0000 7fa076f23740 1 --2- 172.21.15.53:0/3246999814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5f1330 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fa060006ad0 tx=0x7fa060015450 comp rx=0 tx=0).stop 2024-08-31T06:10:09.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.119+0000 7fa076f23740 1 -- 172.21.15.53:0/3246999814 shutdown_connections 2024-08-31T06:10:09.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.119+0000 7fa076f23740 1 --2- 172.21.15.53:0/3246999814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc248840 0x5582bc5fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.119+0000 7fa076f23740 1 --2- 172.21.15.53:0/3246999814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc227b60 0x5582bc5fb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.119+0000 7fa076f23740 1 --2- 172.21.15.53:0/3246999814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc21f980 0x5582bc5f1330 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 1 -- 172.21.15.53:0/3246999814 >> 172.21.15.53:0/3246999814 conn(0x5582bc23c990 msgr2=0x5582bc5ec340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:09.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 1 -- 172.21.15.53:0/3246999814 shutdown_connections 2024-08-31T06:10:09.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 1 -- 172.21.15.53:0/3246999814 wait complete. 2024-08-31T06:10:09.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 1 -- start start 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 1 Processor -- start 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc21f980 0x5582bc60e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc227b60 0x5582bc60e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc248840 0x5582bc60edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1b08f0 con 0x5582bc227b60 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1b01c0 con 0x5582bc248840 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1ad400 con 0x5582bc21f980 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa076f23740 10 client.0 _ll_register_callbacks cb 0x7fa05c00a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.120+0000 7fa06a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc227b60 0x5582bc60e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa06a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc227b60 0x5582bc60e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55678/0 (socket says 172.21.15.53:55678) 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa06a59c640 1 -- 172.21.15.53:0/976965330 learned_addr learned my addr 172.21.15.53:0/976965330 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa069d9b640 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc248840 0x5582bc60edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa069d9b640 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc21f980 0x5582bc60e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa06a59c640 1 -- 172.21.15.53:0/976965330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc21f980 msgr2=0x5582bc60e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa06a59c640 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc21f980 0x5582bc60e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa06a59c640 1 -- 172.21.15.53:0/976965330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc248840 msgr2=0x5582bc60edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa06a59c640 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc248840 0x5582bc60edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa06a59c640 1 -- 172.21.15.53:0/976965330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582bc676b50 con 0x5582bc227b60 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa069d9b640 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc21f980 0x5582bc60e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa06a59c640 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc227b60 0x5582bc60e880 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x5582bc3b6860 tx=0x7fa05c01fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcc88be9b1c1624 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa051ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa051ffb640 1 -- 172.21.15.53:0/976965330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c004460 con 0x5582bc227b60 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa051ffb640 1 -- 172.21.15.53:0/976965330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fa05c011970 con 0x5582bc227b60 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa076f23740 1 -- 172.21.15.53:0/976965330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa06001c040 con 0x5582bc227b60 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa051ffb640 1 -- 172.21.15.53:0/976965330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa05c031050 con 0x5582bc227b60 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa076f23740 10 client.17361 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.121+0000 7fa076f23740 1 -- 172.21.15.53:0/976965330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5582bc677d50 con 0x5582bc227b60 2024-08-31T06:10:09.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.122+0000 7fa051ffb640 1 -- 172.21.15.53:0/976965330 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa06001c040 con 0x5582bc227b60 2024-08-31T06:10:09.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.122+0000 7fa051ffb640 1 -- 172.21.15.53:0/976965330 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa05c003bd0 con 0x5582bc227b60 2024-08-31T06:10:09.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.122+0000 7fa076f23740 10 client.17361 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:09.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.122+0000 7fa076f23740 10 client.17361 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:10:09.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.122+0000 7fa076f23740 20 client.17361 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:09.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.122+0000 7fa076f23740 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5582bc1dc570 0x5582bc67a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:09.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.122+0000 7fa076f23740 4 client.17361 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.7, "await_for": 45.0}] 2024-08-31T06:10:09.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.122+0000 7fa076f23740 1 -- 172.21.15.53:0/976965330 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.7, "await_for": 45.0}) -- 0x5582bc561d20 con 0x5582bc1dc570 2024-08-31T06:10:09.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.122+0000 7fa069d9b640 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5582bc1dc570 0x5582bc67a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:09.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.123+0000 7fa069d9b640 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5582bc1dc570 0x5582bc67a600 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=142cb3f3b50236e1 server_cookie=8bb4e4b9735764f8 in_seq=0 out_seq=0 2024-08-31T06:10:09.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.123+0000 7fa051ffb640 10 client.17361 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:09.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa051ffb640 1 -- 172.21.15.53:0/976965330 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5582bc561d20 con 0x5582bc1dc570 2024-08-31T06:10:09.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa051ffb640 10 client.17361 handle_command_reply: tid=0 2024-08-31T06:10:09.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 1 client.17361 shutdown 2024-08-31T06:10:09.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 1 -- 172.21.15.53:0/976965330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc227b60 msgr2=0x5582bc60e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:09.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc227b60 0x5582bc60e880 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x5582bc3b6860 tx=0x7fa05c01fc00 comp rx=0 tx=0).stop 2024-08-31T06:10:09.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 1 -- 172.21.15.53:0/976965330 shutdown_connections 2024-08-31T06:10:09.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5582bc1dc570 0x5582bc67a600 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582bc248840 0x5582bc60edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582bc227b60 0x5582bc60e880 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa051ffb640 0 client.17361 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:09.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 1 --2- 172.21.15.53:0/976965330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582bc21f980 0x5582bc60e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 1 -- 172.21.15.53:0/976965330 >> 172.21.15.53:0/976965330 conn(0x5582bc23c990 msgr2=0x5582bc5fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:09.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 1 -- 172.21.15.53:0/976965330 shutdown_connections 2024-08-31T06:10:09.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 1 -- 172.21.15.53:0/976965330 wait complete. 2024-08-31T06:10:09.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.203+0000 7fa076f23740 20 client.17361 trim_cache size 0 max 16384 2024-08-31T06:10:09.208 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:10:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 34, 2024-08-31T06:10:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:10:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 18, 2024-08-31T06:10:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:10:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "9cc0e807": { 2024-08-31T06:10:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 18, 2024-08-31T06:10:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:10:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:10:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:10:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:10:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:10:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 152.7, 2024-08-31T06:10:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:10:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:10:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:10:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:10:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:10:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:10:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:09.210 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:10:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 -- 172.21.15.53:0/3690219247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0540b4d50 msgr2=0x7fa0540b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0540b4d50 0x7fa0540b7260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa064103fc0 tx=0x7fa06409a350 comp rx=0 tx=0).stop 2024-08-31T06:10:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 -- 172.21.15.53:0/3690219247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa06c106990 msgr2=0x7fa06c19f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa06c106990 0x7fa06c19f9a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fa0640097b0 tx=0x7fa064031ea0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 -- 172.21.15.53:0/3690219247 shutdown_connections 2024-08-31T06:10:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0540b4d50 0x7fa0540b7260 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa06c106990 0x7fa06c19f9a0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa06c106040 0x7fa06c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 --2- 172.21.15.53:0/3690219247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa06c101f30 0x7fa06c19a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:09.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 -- 172.21.15.53:0/3690219247 >> 172.21.15.53:0/3690219247 conn(0x7fa06c079d70 msgr2=0x7fa06c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:09.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 -- 172.21.15.53:0/3690219247 shutdown_connections 2024-08-31T06:10:09.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:09.204+0000 7fa0709ae640 1 -- 172.21.15.53:0/3690219247 wait complete. 2024-08-31T06:10:09.511 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:10:09.512 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:10:09.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.99 MB/sec execute 119 sec latency 2043.732 ms 2024-08-31T06:10:09.971 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9cc0e807', quiesce took 8.2 seconds. Will release after: 24.500000000000004 2024-08-31T06:10:10.095 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:10:10.216 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:10 smithi053 ceph-mon[18924]: pgmap v479: 97 pgs: 97 active+clean; 59 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 1.3 MiB/s wr, 143 op/s 2024-08-31T06:10:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:10 smithi130 ceph-mon[22266]: pgmap v479: 97 pgs: 97 active+clean; 59 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 1.3 MiB/s wr, 143 op/s 2024-08-31T06:10:10.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:10 smithi153 ceph-mon[22320]: pgmap v479: 97 pgs: 97 active+clean; 59 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 1.3 MiB/s wr, 143 op/s 2024-08-31T06:10:10.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.697+0000 7f23a615f640 1 -- 172.21.15.53:0/2553729685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23a010dbb0 msgr2=0x7f23a01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:10.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.697+0000 7f23a615f640 1 --2- 172.21.15.53:0/2553729685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23a010dbb0 0x7f23a01100a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f2398009ca0 tx=0x7f239802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.697+0000 7f23a615f640 1 -- 172.21.15.53:0/2553729685 shutdown_connections 2024-08-31T06:10:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.697+0000 7f23a615f640 1 --2- 172.21.15.53:0/2553729685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23a010dbb0 0x7f23a01100a0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.697+0000 7f23a615f640 1 --2- 172.21.15.53:0/2553729685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a01050a0 0x7f23a010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.697+0000 7f23a615f640 1 --2- 172.21.15.53:0/2553729685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23a0104750 0x7f23a0104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.697+0000 7f23a615f640 1 -- 172.21.15.53:0/2553729685 >> 172.21.15.53:0/2553729685 conn(0x7f23a00794d0 msgr2=0x7f23a00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.697+0000 7f23a615f640 1 -- 172.21.15.53:0/2553729685 shutdown_connections 2024-08-31T06:10:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.697+0000 7f23a615f640 1 -- 172.21.15.53:0/2553729685 wait complete. 2024-08-31T06:10:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.698+0000 7f23a615f640 1 Processor -- start 2024-08-31T06:10:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.698+0000 7f23a615f640 1 -- start start 2024-08-31T06:10:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f23a615f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23a0104750 0x7f23a019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f23a615f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a01050a0 0x7f23a019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f23a615f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23a010dbb0 0x7f23a019f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f23a615f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23a0113730 con 0x7f23a0104750 2024-08-31T06:10:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f23a615f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f23a01135b0 con 0x7f23a01050a0 2024-08-31T06:10:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f23a615f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23a01138b0 con 0x7f23a010dbb0 2024-08-31T06:10:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f239f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23a0104750 0x7f23a019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f239f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23a0104750 0x7f23a019a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55700/0 (socket says 172.21.15.53:55700) 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f239f7fe640 1 -- 172.21.15.53:0/1884186030 learned_addr learned my addr 172.21.15.53:0/1884186030 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f239effd640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a01050a0 0x7f23a019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f239ffff640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23a010dbb0 0x7f23a019f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f239f7fe640 1 -- 172.21.15.53:0/1884186030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23a010dbb0 msgr2=0x7f23a019f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f239f7fe640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23a010dbb0 0x7f23a019f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f239f7fe640 1 -- 172.21.15.53:0/1884186030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a01050a0 msgr2=0x7f23a019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f239f7fe640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a01050a0 0x7f23a019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f239f7fe640 1 -- 172.21.15.53:0/1884186030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a01a00d0 con 0x7f23a0104750 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.699+0000 7f239f7fe640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23a0104750 0x7f23a019a160 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f239000c970 tx=0x7f239000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.700+0000 7f239cff9640 1 -- 172.21.15.53:0/1884186030 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390004220 con 0x7f23a0104750 2024-08-31T06:10:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.700+0000 7f23a615f640 1 -- 172.21.15.53:0/1884186030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a01a03c0 con 0x7f23a0104750 2024-08-31T06:10:10.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.700+0000 7f239cff9640 1 -- 172.21.15.53:0/1884186030 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2390007e40 con 0x7f23a0104750 2024-08-31T06:10:10.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.700+0000 7f239cff9640 1 -- 172.21.15.53:0/1884186030 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23900047c0 con 0x7f23a0104750 2024-08-31T06:10:10.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.700+0000 7f23a615f640 1 -- 172.21.15.53:0/1884186030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a01a6b20 con 0x7f23a0104750 2024-08-31T06:10:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.703+0000 7f23ac6d4740 1 Processor -- start 2024-08-31T06:10:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.703+0000 7f23ac6d4740 1 -- start start 2024-08-31T06:10:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.703+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eab0f350 0x5640eaeb5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.703+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 0x5640eaeb5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.703+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaeb6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.703+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640eae2b5f0 con 0x5640eaaee670 2024-08-31T06:10:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.703+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5640eae1ab80 con 0x5640eab0f350 2024-08-31T06:10:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.703+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5640eae1eb30 con 0x5640eaae6490 2024-08-31T06:10:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.703+0000 7f239effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaeb6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.703+0000 7f239effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaeb6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55712/0 (socket says 172.21.15.53:55712) 2024-08-31T06:10:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.703+0000 7f239effd640 1 -- 172.21.15.53:0/143792665 learned_addr learned my addr 172.21.15.53:0/143792665 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f239cff9640 1 -- 172.21.15.53:0/1884186030 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f23900079b0 con 0x7f23a0104750 2024-08-31T06:10:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f239ffff640 1 --2- 172.21.15.53:0/143792665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eab0f350 0x5640eaeb5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f239effd640 1 -- 172.21.15.53:0/143792665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 msgr2=0x5640eaeb5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f239effd640 1 --2- 172.21.15.53:0/143792665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 0x5640eaeb5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f239effd640 1 -- 172.21.15.53:0/143792665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eab0f350 msgr2=0x5640eaeb5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f239effd640 1 --2- 172.21.15.53:0/143792665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eab0f350 0x5640eaeb5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f239effd640 1 -- 172.21.15.53:0/143792665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640eab7a930 con 0x5640eaaee670 2024-08-31T06:10:10.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f239ffff640 1 --2- 172.21.15.53:0/143792665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eab0f350 0x5640eaeb5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:10.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f239effd640 1 --2- 172.21.15.53:0/143792665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaeb6200 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f239400bc30 tx=0x7f23940107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57144a628e23569 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:10.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f2385ffb640 1 -- 172.21.15.53:0/143792665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239401c480 con 0x5640eaaee670 2024-08-31T06:10:10.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f2385ffb640 1 -- 172.21.15.53:0/143792665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f239401cab0 con 0x5640eaaee670 2024-08-31T06:10:10.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f2385ffb640 1 -- 172.21.15.53:0/143792665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23940119d0 con 0x5640eaaee670 2024-08-31T06:10:10.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.704+0000 7f239cff9640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4ca0 0x7f23880b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f239ffff640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4ca0 0x7f23880b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f239cff9640 1 -- 172.21.15.53:0/1884186030 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f23900e5270 con 0x7f23a0104750 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f23ac6d4740 1 -- 172.21.15.53:0/143792665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 msgr2=0x5640eaeb6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f239ffff640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4ca0 0x7f23880b71b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2398006010 tx=0x7f23980098e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/143792665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaeb6200 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f239400bc30 tx=0x7f23940107a0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f23ac6d4740 1 -- 172.21.15.53:0/143792665 shutdown_connections 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/143792665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaeb6200 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/143792665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 0x5640eaeb5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/143792665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eab0f350 0x5640eaeb5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f23ac6d4740 1 -- 172.21.15.53:0/143792665 >> 172.21.15.53:0/143792665 conn(0x5640eab03740 msgr2=0x5640eaeb3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f23ac6d4740 1 -- 172.21.15.53:0/143792665 shutdown_connections 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.705+0000 7f23ac6d4740 1 -- 172.21.15.53:0/143792665 wait complete. 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.706+0000 7f23ac6d4740 1 -- start start 2024-08-31T06:10:10.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.706+0000 7f23ac6d4740 1 Processor -- start 2024-08-31T06:10:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.706+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 0x5640eaec0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.706+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 0x5640eaec1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.706+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 0x5640eaecd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.706+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640eac7d890 con 0x5640eab0f350 2024-08-31T06:10:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.706+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5640eada1790 con 0x5640eaaee670 2024-08-31T06:10:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.706+0000 7f239ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 0x5640eaecd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.706+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5640eaec3f60 con 0x5640eaae6490 2024-08-31T06:10:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.706+0000 7f239effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 0x5640eaec1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f239effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 0x5640eaec1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36640/0 (socket says 172.21.15.53:36640) 2024-08-31T06:10:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f239f7fe640 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 0x5640eaec0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f239effd640 1 -- 172.21.15.53:0/2980992857 learned_addr learned my addr 172.21.15.53:0/2980992857 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f239ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 0x5640eaecd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55728/0 (socket says 172.21.15.53:55728) 2024-08-31T06:10:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f23ac6d4740 10 client.0 _ll_register_callbacks cb 0x5640eab26ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f239effd640 1 -- 172.21.15.53:0/2980992857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 msgr2=0x5640eaec0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f239effd640 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 0x5640eaec0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f239effd640 1 -- 172.21.15.53:0/2980992857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 msgr2=0x5640eaecd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f239effd640 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 0x5640eaecd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f239effd640 1 -- 172.21.15.53:0/2980992857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640eadd8f30 con 0x5640eaaee670 2024-08-31T06:10:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f239effd640 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 0x5640eaec1470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f239400c010 tx=0x7f2394011580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3b578b9cf3ed94b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f237effd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:10:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.707+0000 7f237effd640 1 -- 172.21.15.53:0/2980992857 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239402b060 con 0x5640eaaee670 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f23ac6d4740 1 -- 172.21.15.53:0/2980992857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f239401cab0 con 0x5640eaaee670 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f237effd640 1 -- 172.21.15.53:0/2980992857 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f239401c810 con 0x5640eaaee670 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f237effd640 1 -- 172.21.15.53:0/2980992857 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2394005040 con 0x5640eaaee670 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f23ac6d4740 10 client.26726 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f23ac6d4740 1 -- 172.21.15.53:0/2980992857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5640eaecfd70 con 0x5640eaaee670 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f237effd640 1 -- 172.21.15.53:0/2980992857 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f239401cab0 con 0x5640eaaee670 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f237effd640 1 -- 172.21.15.53:0/2980992857 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f23940046c0 con 0x5640eaaee670 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f23ac6d4740 10 client.26726 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f23ac6d4740 10 client.26726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f23ac6d4740 20 client.26726 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640eaacdcd0 0x5640eaed3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f23ac6d4740 4 client.26726 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.708+0000 7f23ac6d4740 1 -- 172.21.15.53:0/2980992857 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640eae2d540 con 0x5640eaacdcd0 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.709+0000 7f239f7fe640 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640eaacdcd0 0x5640eaed3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.709+0000 7f237effd640 10 client.26726 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.709+0000 7f239f7fe640 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640eaacdcd0 0x5640eaed3130 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2023e9682ad25454 server_cookie=42b005085975d750 in_seq=0 out_seq=0 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f237effd640 1 -- 172.21.15.53:0/2980992857 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640eae2d540 con 0x5640eaacdcd0 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f237effd640 10 client.26726 handle_command_reply: tid=0 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 1 client.26726 shutdown 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 1 -- 172.21.15.53:0/2980992857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 msgr2=0x5640eaec1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 0x5640eaec1470 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f239400c010 tx=0x7f2394011580 comp rx=0 tx=0).stop 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 1 -- 172.21.15.53:0/2980992857 shutdown_connections 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640eaacdcd0 0x5640eaed3130 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 0x5640eaecd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 0x5640eaec1470 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/2980992857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 0x5640eaec0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f237effd640 0 client.26726 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 1 -- 172.21.15.53:0/2980992857 >> 172.21.15.53:0/2980992857 conn(0x5640eab03740 msgr2=0x5640eaeb8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 1 -- 172.21.15.53:0/2980992857 shutdown_connections 2024-08-31T06:10:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 1 -- 172.21.15.53:0/2980992857 wait complete. 2024-08-31T06:10:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.710+0000 7f23ac6d4740 20 client.26726 trim_cache size 0 max 16384 2024-08-31T06:10:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f23ac6d4740 1 Processor -- start 2024-08-31T06:10:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f23ac6d4740 1 -- start start 2024-08-31T06:10:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 0x5640eaec2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 0x5640eaecd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 0x5640eaebaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23a01af420 con 0x5640eab0f350 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f23a01b0fc0 con 0x5640eaaee670 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23a01afaf0 con 0x5640eaae6490 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f239ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 0x5640eaebaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f239ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 0x5640eaebaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55742/0 (socket says 172.21.15.53:55742) 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f239ffff640 1 -- 172.21.15.53:0/1853104591 learned_addr learned my addr 172.21.15.53:0/1853104591 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f239effd640 1 --2- 172.21.15.53:0/1853104591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 0x5640eaecd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.728+0000 7f239f7fe640 1 --2- 172.21.15.53:0/1853104591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 0x5640eaec2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.729+0000 7f239ffff640 1 -- 172.21.15.53:0/1853104591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 msgr2=0x5640eaec2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.729+0000 7f239ffff640 1 --2- 172.21.15.53:0/1853104591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 0x5640eaec2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.729+0000 7f239ffff640 1 -- 172.21.15.53:0/1853104591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 msgr2=0x5640eaecd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.729+0000 7f239ffff640 1 --2- 172.21.15.53:0/1853104591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 0x5640eaecd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.729+0000 7f239ffff640 1 -- 172.21.15.53:0/1853104591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640eaec21f0 con 0x5640eab0f350 2024-08-31T06:10:10.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.729+0000 7f239ffff640 1 --2- 172.21.15.53:0/1853104591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 0x5640eaebaf60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f2398035000 tx=0x7f2398044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bf647a99bf090d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:10.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.729+0000 7f23857fa640 1 -- 172.21.15.53:0/1853104591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398003d50 con 0x5640eab0f350 2024-08-31T06:10:10.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.729+0000 7f23857fa640 1 -- 172.21.15.53:0/1853104591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2398036050 con 0x5640eab0f350 2024-08-31T06:10:10.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.729+0000 7f23857fa640 1 -- 172.21.15.53:0/1853104591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398030980 con 0x5640eab0f350 2024-08-31T06:10:10.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.730+0000 7f23ac6d4740 1 -- 172.21.15.53:0/1853104591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 msgr2=0x5640eaebaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:10.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.730+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/1853104591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 0x5640eaebaf60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f2398035000 tx=0x7f2398044000 comp rx=0 tx=0).stop 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.730+0000 7f23ac6d4740 1 -- 172.21.15.53:0/1853104591 shutdown_connections 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.730+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/1853104591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eab0f350 0x5640eaebaf60 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.730+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/1853104591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaaee670 0x5640eaecd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.730+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/1853104591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eaae6490 0x5640eaec2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.730+0000 7f23ac6d4740 1 -- 172.21.15.53:0/1853104591 >> 172.21.15.53:0/1853104591 conn(0x5640eab03740 msgr2=0x5640eaeba850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.730+0000 7f23ac6d4740 1 -- 172.21.15.53:0/1853104591 shutdown_connections 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.730+0000 7f23ac6d4740 1 -- 172.21.15.53:0/1853104591 wait complete. 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.730+0000 7f23ac6d4740 1 -- start start 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f23ac6d4740 1 Processor -- start 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaae6490 0x5640eaed6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaed4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f23ac6d4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eab0f350 0x5640eaed5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23a01b08f0 con 0x5640eaaee670 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f23a01b01c0 con 0x5640eaae6490 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f23ac6d4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23a01ad400 con 0x5640eab0f350 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f23ac6d4740 10 client.0 _ll_register_callbacks cb 0x7f239400ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f239effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaed4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f239effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaed4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55758/0 (socket says 172.21.15.53:55758) 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f239effd640 1 -- 172.21.15.53:0/21514230 learned_addr learned my addr 172.21.15.53:0/21514230 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f239ffff640 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eab0f350 0x5640eaed5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f239f7fe640 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaae6490 0x5640eaed6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f239effd640 1 -- 172.21.15.53:0/21514230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eab0f350 msgr2=0x5640eaed5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f239effd640 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eab0f350 0x5640eaed5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f239effd640 1 -- 172.21.15.53:0/21514230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaae6490 msgr2=0x5640eaed6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:10.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f239effd640 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaae6490 0x5640eaed6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.731+0000 7f239effd640 1 -- 172.21.15.53:0/21514230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640eaed5900 con 0x5640eaaee670 2024-08-31T06:10:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f239effd640 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaed4d20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2394004c50 tx=0x7f23940107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281657c90561e785 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f237effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f237effd640 1 -- 172.21.15.53:0/21514230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239403d060 con 0x5640eaaee670 2024-08-31T06:10:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f237effd640 1 -- 172.21.15.53:0/21514230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f239401ca20 con 0x5640eaaee670 2024-08-31T06:10:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f23ac6d4740 1 -- 172.21.15.53:0/21514230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2398036050 con 0x5640eaaee670 2024-08-31T06:10:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f237effd640 1 -- 172.21.15.53:0/21514230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f239402b070 con 0x5640eaaee670 2024-08-31T06:10:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f23ac6d4740 10 client.17379 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f23ac6d4740 1 -- 172.21.15.53:0/21514230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5640eaf38700 con 0x5640eaaee670 2024-08-31T06:10:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f237effd640 1 -- 172.21.15.53:0/21514230 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2398036050 con 0x5640eaaee670 2024-08-31T06:10:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f237effd640 1 -- 172.21.15.53:0/21514230 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f2394011ba0 con 0x5640eaaee670 2024-08-31T06:10:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f23ac6d4740 10 client.17379 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.732+0000 7f23ac6d4740 10 client.17379 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.733+0000 7f23ac6d4740 20 client.17379 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.733+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640eaaa3080 0x5640eaf38ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.733+0000 7f23ac6d4740 4 client.17379 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:10:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.733+0000 7f23ac6d4740 1 -- 172.21.15.53:0/21514230 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5640eae28fe0 con 0x5640eaaa3080 2024-08-31T06:10:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.733+0000 7f239f7fe640 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640eaaa3080 0x5640eaf38ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.733+0000 7f239f7fe640 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640eaaa3080 0x5640eaf38ee0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac5157afef6526d2 server_cookie=1720b2f5eb07f67c in_seq=0 out_seq=0 2024-08-31T06:10:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.733+0000 7f237effd640 10 client.17379 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f237effd640 1 -- 172.21.15.53:0/21514230 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5640eae28fe0 con 0x5640eaaa3080 2024-08-31T06:10:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f237effd640 10 client.17379 handle_command_reply: tid=0 2024-08-31T06:10:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 1 client.17379 shutdown 2024-08-31T06:10:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 1 -- 172.21.15.53:0/21514230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 msgr2=0x5640eaed4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaed4d20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2394004c50 tx=0x7f23940107a0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 1 -- 172.21.15.53:0/21514230 shutdown_connections 2024-08-31T06:10:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640eaaa3080 0x5640eaf38ee0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640eab0f350 0x5640eaed5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640eaaee670 0x5640eaed4d20 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 1 --2- 172.21.15.53:0/21514230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640eaae6490 0x5640eaed6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 1 -- 172.21.15.53:0/21514230 >> 172.21.15.53:0/21514230 conn(0x5640eab03740 msgr2=0x5640eaec2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:10.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f237effd640 0 client.17379 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:10.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 1 -- 172.21.15.53:0/21514230 shutdown_connections 2024-08-31T06:10:10.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 1 -- 172.21.15.53:0/21514230 wait complete. 2024-08-31T06:10:10.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.735+0000 7f23ac6d4740 20 client.17379 trim_cache size 0 max 16384 2024-08-31T06:10:10.743 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:10:10.743 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:10:10.743 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "3e7cb90c-5b9b-4a75-b575-b69641d835a2", 2024-08-31T06:10:10.743 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:10:10.743 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:10:10.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 -- 172.21.15.53:0/1884186030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4ca0 msgr2=0x7f23880b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:10.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4ca0 0x7f23880b71b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2398006010 tx=0x7f23980098e0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 -- 172.21.15.53:0/1884186030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23a0104750 msgr2=0x7f23a019a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:10.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23a0104750 0x7f23a019a160 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f239000c970 tx=0x7f239000ce30 comp rx=0 tx=0).stop 2024-08-31T06:10:10.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 -- 172.21.15.53:0/1884186030 shutdown_connections 2024-08-31T06:10:10.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4ca0 0x7f23880b71b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23a010dbb0 0x7f23a019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23a01050a0 0x7f23a019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 --2- 172.21.15.53:0/1884186030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23a0104750 0x7f23a019a160 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 -- 172.21.15.53:0/1884186030 >> 172.21.15.53:0/1884186030 conn(0x7f23a00794d0 msgr2=0x7f23a0100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 -- 172.21.15.53:0/1884186030 shutdown_connections 2024-08-31T06:10:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:10.736+0000 7f23a615f640 1 -- 172.21.15.53:0/1884186030 wait complete. 2024-08-31T06:10:10.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.97 MB/sec execute 120 sec latency 1759.708 ms 2024-08-31T06:10:11.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:11 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:10:11.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:11 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:11 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:10:11.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:11 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:11 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:10:11.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:11 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:11 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:10:11.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:11 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:11 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:10:11.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:11 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:11 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:10:11.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:11 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:11 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:10:11.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:11 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:11 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:10:11.391 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:11 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:11 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:10:11.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:11 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:11 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:10:11.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:11 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:11 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:10:11.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:11 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:11 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:10:11.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:11 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:11.617 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:10:11.872 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:10:11.970 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.96 MB/sec execute 121 sec latency 2759.799 ms 2024-08-31T06:10:12.308 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:12 smithi053 ceph-mon[18924]: pgmap v480: 97 pgs: 97 active+clean; 60 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.4 MiB/s wr, 165 op/s 2024-08-31T06:10:12.308 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:12 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:10:12.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:12 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:12 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:10:12.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:12 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:10:12.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:12 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:10:12.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:12 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:12 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:10:12.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:12 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:12 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:12 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:12 smithi130 ceph-mon[22266]: pgmap v480: 97 pgs: 97 active+clean; 60 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.4 MiB/s wr, 165 op/s 2024-08-31T06:10:12.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:12 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:10:12.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:12 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:12 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:10:12.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:12 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:10:12.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:12 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:10:12.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:12 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:12 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:10:12.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:12 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:12 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:12 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.399+0000 7f7a4338d640 1 -- 172.21.15.53:0/3623495943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a3c109b90 msgr2=0x7f7a3c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.399+0000 7f7a4338d640 1 --2- 172.21.15.53:0/3623495943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a3c109b90 0x7f7a3c1103c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009ca0 tx=0x7f7a3402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.399+0000 7f7a4338d640 1 -- 172.21.15.53:0/3623495943 shutdown_connections 2024-08-31T06:10:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.399+0000 7f7a4338d640 1 --2- 172.21.15.53:0/3623495943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a3c109b90 0x7f7a3c1103c0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.399+0000 7f7a4338d640 1 --2- 172.21.15.53:0/3623495943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a3c109240 0x7f7a3c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.399+0000 7f7a4338d640 1 --2- 172.21.15.53:0/3623495943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a3c103900 0x7f7a3c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.399+0000 7f7a4338d640 1 -- 172.21.15.53:0/3623495943 >> 172.21.15.53:0/3623495943 conn(0x7f7a3c07b5f0 msgr2=0x7f7a3c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.399+0000 7f7a4338d640 1 -- 172.21.15.53:0/3623495943 shutdown_connections 2024-08-31T06:10:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.399+0000 7f7a4338d640 1 -- 172.21.15.53:0/3623495943 wait complete. 2024-08-31T06:10:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.399+0000 7f7a4338d640 1 Processor -- start 2024-08-31T06:10:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a4338d640 1 -- start start 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a4338d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a3c103900 0x7f7a3c19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a4338d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a3c109240 0x7f7a3c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a4338d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a3c109b90 0x7f7a3c19f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a4338d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c113750 con 0x7f7a3c109240 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a4338d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1135d0 con 0x7f7a3c103900 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a4338d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1138d0 con 0x7f7a3c109b90 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a40928640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a3c109240 0x7f7a3c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a40928640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a3c109240 0x7f7a3c19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55780/0 (socket says 172.21.15.53:55780) 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a40928640 1 -- 172.21.15.53:0/2991929203 learned_addr learned my addr 172.21.15.53:0/2991929203 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a41129640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a3c103900 0x7f7a3c19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a4192a640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a3c109b90 0x7f7a3c19f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a40928640 1 -- 172.21.15.53:0/2991929203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a3c109b90 msgr2=0x7f7a3c19f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:12.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a40928640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a3c109b90 0x7f7a3c19f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a40928640 1 -- 172.21.15.53:0/2991929203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a3c103900 msgr2=0x7f7a3c19a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a40928640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a3c103900 0x7f7a3c19a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.400+0000 7f7a40928640 1 -- 172.21.15.53:0/2991929203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3c1a0110 con 0x7f7a3c109240 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.401+0000 7f7a40928640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a3c109240 0x7f7a3c19a740 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00d740 tx=0x7f7a2c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.401+0000 7f7a327fc640 1 -- 172.21.15.53:0/2991929203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c017070 con 0x7f7a3c109240 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.401+0000 7f7a327fc640 1 -- 172.21.15.53:0/2991929203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a2c00de50 con 0x7f7a3c109240 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.401+0000 7f7a327fc640 1 -- 172.21.15.53:0/2991929203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00f620 con 0x7f7a3c109240 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.401+0000 7f7a4338d640 1 -- 172.21.15.53:0/2991929203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3c1a0400 con 0x7f7a3c109240 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.401+0000 7f7a4338d640 1 -- 172.21.15.53:0/2991929203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3c1a6b60 con 0x7f7a3c109240 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a49902740 1 Processor -- start 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a49902740 1 -- start start 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a327fc640 1 -- 172.21.15.53:0/2991929203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7a2c01a070 con 0x7f7a3c109240 2024-08-31T06:10:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a49902740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561567374070 0x5615677192c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a49902740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567719800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a49902740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567719d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a49902740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561567690630 con 0x56156734b1b0 2024-08-31T06:10:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a49902740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56156767fbc0 con 0x561567374070 2024-08-31T06:10:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a49902740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561567683b70 con 0x561567353390 2024-08-31T06:10:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a41129640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567719800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a41129640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567719800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55796/0 (socket says 172.21.15.53:55796) 2024-08-31T06:10:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a41129640 1 -- 172.21.15.53:0/3338798061 learned_addr learned my addr 172.21.15.53:0/3338798061 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:12.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a4192a640 1 --2- 172.21.15.53:0/3338798061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561567374070 0x5615677192c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.404+0000 7f7a40928640 1 --2- 172.21.15.53:0/3338798061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567719d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a41129640 1 -- 172.21.15.53:0/3338798061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 msgr2=0x561567719d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a41129640 1 --2- 172.21.15.53:0/3338798061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567719d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a41129640 1 -- 172.21.15.53:0/3338798061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561567374070 msgr2=0x5615677192c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a41129640 1 --2- 172.21.15.53:0/3338798061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561567374070 0x5615677192c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a41129640 1 -- 172.21.15.53:0/3338798061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615673df650 con 0x56156734b1b0 2024-08-31T06:10:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a4192a640 1 --2- 172.21.15.53:0/3338798061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561567374070 0x5615677192c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a41129640 1 --2- 172.21.15.53:0/3338798061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567719800 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800bcd0 tx=0x7f7a380107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a2b91ab1c61eda server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a327fc640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a280b4d20 0x7f7a280b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a277fe640 1 -- 172.21.15.53:0/3338798061 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a38005220 con 0x56156734b1b0 2024-08-31T06:10:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a277fe640 1 -- 172.21.15.53:0/3338798061 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a38004c30 con 0x56156734b1b0 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a277fe640 1 -- 172.21.15.53:0/3338798061 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a380116a0 con 0x56156734b1b0 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a327fc640 1 -- 172.21.15.53:0/2991929203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7a2c0e4df0 con 0x7f7a3c109240 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.405+0000 7f7a4192a640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a280b4d20 0x7f7a280b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.406+0000 7f7a49902740 1 -- 172.21.15.53:0/3338798061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 msgr2=0x561567719800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.406+0000 7f7a4192a640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a280b4d20 0x7f7a280b7230 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7a34006010 tx=0x7f7a34009800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.406+0000 7f7a49902740 1 --2- 172.21.15.53:0/3338798061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567719800 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800bcd0 tx=0x7f7a380107a0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.406+0000 7f7a49902740 1 -- 172.21.15.53:0/3338798061 shutdown_connections 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.406+0000 7f7a49902740 1 --2- 172.21.15.53:0/3338798061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567719d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.406+0000 7f7a49902740 1 --2- 172.21.15.53:0/3338798061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567719800 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.406+0000 7f7a49902740 1 --2- 172.21.15.53:0/3338798061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561567374070 0x5615677192c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.406+0000 7f7a49902740 1 -- 172.21.15.53:0/3338798061 >> 172.21.15.53:0/3338798061 conn(0x561567368460 msgr2=0x5615677171b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.406+0000 7f7a49902740 1 -- 172.21.15.53:0/3338798061 shutdown_connections 2024-08-31T06:10:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.406+0000 7f7a49902740 1 -- 172.21.15.53:0/3338798061 wait complete. 2024-08-31T06:10:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a49902740 1 -- start start 2024-08-31T06:10:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a49902740 1 Processor -- start 2024-08-31T06:10:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a49902740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56156734b1b0 0x561567724a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a49902740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561567353390 0x561567724f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a49902740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561567374070 0x561567730dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a49902740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5615674e2700 con 0x561567353390 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a49902740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561567606700 con 0x561567374070 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a49902740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561567727aa0 con 0x56156734b1b0 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a49902740 10 client.0 _ll_register_callbacks cb 0x561567635dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a40928640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561567353390 0x561567724f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a40928640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561567353390 0x561567724f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55812/0 (socket says 172.21.15.53:55812) 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a40928640 1 -- 172.21.15.53:0/2345965410 learned_addr learned my addr 172.21.15.53:0/2345965410 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.407+0000 7f7a41129640 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56156734b1b0 0x561567724a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a4192a640 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561567374070 0x561567730dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a40928640 1 -- 172.21.15.53:0/2345965410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56156734b1b0 msgr2=0x561567724a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a40928640 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56156734b1b0 0x561567724a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a40928640 1 -- 172.21.15.53:0/2345965410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561567374070 msgr2=0x561567730dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a40928640 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561567374070 0x561567730dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a40928640 1 -- 172.21.15.53:0/2345965410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56156763f8b0 con 0x561567353390 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a40928640 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561567353390 0x561567724f80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0e25a0 tx=0x7f7a2c0a7450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882cdbe1517e0943 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a24ff9640 1 -- 172.21.15.53:0/2345965410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c021070 con 0x561567353390 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a24ff9640 1 -- 172.21.15.53:0/2345965410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7a2c0ce0e0 con 0x561567353390 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a49902740 1 -- 172.21.15.53:0/2345965410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a38004c30 con 0x561567353390 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a24ff9640 1 -- 172.21.15.53:0/2345965410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7a2c0aad00 con 0x561567353390 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a49902740 10 client.17391 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a49902740 1 -- 172.21.15.53:0/2345965410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561567733880 con 0x561567353390 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.408+0000 7f7a24ff9640 1 -- 172.21.15.53:0/2345965410 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a38004c30 con 0x561567353390 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.409+0000 7f7a24ff9640 1 -- 172.21.15.53:0/2345965410 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f7a2c0a6f00 con 0x561567353390 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.409+0000 7f7a49902740 10 client.17391 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.409+0000 7f7a49902740 10 client.17391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.409+0000 7f7a49902740 20 client.17391 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.409+0000 7f7a49902740 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5615673329f0 0x561567736dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.409+0000 7f7a49902740 4 client.17391 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.409+0000 7f7a49902740 1 -- 172.21.15.53:0/2345965410 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561567692580 con 0x5615673329f0 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.409+0000 7f7a41129640 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5615673329f0 0x561567736dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.409+0000 7f7a24ff9640 10 client.17391 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.409+0000 7f7a41129640 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5615673329f0 0x561567736dc0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82e1f2ed74a212f3 server_cookie=6dc2c47264d5196e in_seq=0 out_seq=0 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.410+0000 7f7a24ff9640 1 -- 172.21.15.53:0/2345965410 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561567692580 con 0x5615673329f0 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.410+0000 7f7a24ff9640 10 client.17391 handle_command_reply: tid=0 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.410+0000 7f7a49902740 1 client.17391 shutdown 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.410+0000 7f7a49902740 1 -- 172.21.15.53:0/2345965410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561567353390 msgr2=0x561567724f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.410+0000 7f7a49902740 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561567353390 0x561567724f80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0e25a0 tx=0x7f7a2c0a7450 comp rx=0 tx=0).stop 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.410+0000 7f7a49902740 1 -- 172.21.15.53:0/2345965410 shutdown_connections 2024-08-31T06:10:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.410+0000 7f7a49902740 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5615673329f0 0x561567736dc0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.410+0000 7f7a24ff9640 0 client.17391 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:12.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.410+0000 7f7a49902740 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561567374070 0x561567730dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.411+0000 7f7a49902740 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561567353390 0x561567724f80 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.411+0000 7f7a49902740 1 --2- 172.21.15.53:0/2345965410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56156734b1b0 0x561567724a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.411+0000 7f7a49902740 1 -- 172.21.15.53:0/2345965410 >> 172.21.15.53:0/2345965410 conn(0x561567368460 msgr2=0x56156771c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:12.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.411+0000 7f7a49902740 1 -- 172.21.15.53:0/2345965410 shutdown_connections 2024-08-31T06:10:12.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.411+0000 7f7a49902740 1 -- 172.21.15.53:0/2345965410 wait complete. 2024-08-31T06:10:12.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.411+0000 7f7a49902740 20 client.17391 trim_cache size 0 max 16384 2024-08-31T06:10:12.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:12 smithi153 ceph-mon[22320]: pgmap v480: 97 pgs: 97 active+clean; 60 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.4 MiB/s wr, 165 op/s 2024-08-31T06:10:12.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:12 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:10:12.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:12 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:12 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:10:12.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:12 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:10:12.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:12 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:10:12.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:12 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:12 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:10:12.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:12 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:12 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:12 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:10:12.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.428+0000 7f7a49902740 1 Processor -- start 2024-08-31T06:10:12.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.428+0000 7f7a49902740 1 -- start start 2024-08-31T06:10:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a49902740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 0x56156771aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a49902740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567730cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a49902740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567721c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a49902740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1af4f0 con 0x56156734b1b0 2024-08-31T06:10:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a49902740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1b1090 con 0x5615673329f0 2024-08-31T06:10:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a49902740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1afbc0 con 0x561567353390 2024-08-31T06:10:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a40928640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567730cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a40928640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567730cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55828/0 (socket says 172.21.15.53:55828) 2024-08-31T06:10:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a40928640 1 -- 172.21.15.53:0/3085097884 learned_addr learned my addr 172.21.15.53:0/3085097884 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a4192a640 1 --2- 172.21.15.53:0/3085097884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567721c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a41129640 1 --2- 172.21.15.53:0/3085097884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 0x56156771aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a40928640 1 -- 172.21.15.53:0/3085097884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 msgr2=0x561567721c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a40928640 1 --2- 172.21.15.53:0/3085097884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567721c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a40928640 1 -- 172.21.15.53:0/3085097884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 msgr2=0x56156771aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a40928640 1 --2- 172.21.15.53:0/3085097884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 0x56156771aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a40928640 1 -- 172.21.15.53:0/3085097884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615677176f0 con 0x56156734b1b0 2024-08-31T06:10:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a41129640 1 --2- 172.21.15.53:0/3085097884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 0x56156771aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:10:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a40928640 1 --2- 172.21.15.53:0/3085097884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567730cc0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0ab520 tx=0x7f7a2c010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19787a79037fadc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.429+0000 7f7a26ffd640 1 -- 172.21.15.53:0/3085097884 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c021070 con 0x56156734b1b0 2024-08-31T06:10:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.430+0000 7f7a26ffd640 1 -- 172.21.15.53:0/3085097884 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a2c0b4140 con 0x56156734b1b0 2024-08-31T06:10:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.430+0000 7f7a26ffd640 1 -- 172.21.15.53:0/3085097884 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0ce0b0 con 0x56156734b1b0 2024-08-31T06:10:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.430+0000 7f7a49902740 1 -- 172.21.15.53:0/3085097884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 msgr2=0x561567730cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.430+0000 7f7a49902740 1 --2- 172.21.15.53:0/3085097884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567730cc0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0ab520 tx=0x7f7a2c010b50 comp rx=0 tx=0).stop 2024-08-31T06:10:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.430+0000 7f7a49902740 1 -- 172.21.15.53:0/3085097884 shutdown_connections 2024-08-31T06:10:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.430+0000 7f7a49902740 1 --2- 172.21.15.53:0/3085097884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567721c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.430+0000 7f7a49902740 1 --2- 172.21.15.53:0/3085097884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567730cc0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.430+0000 7f7a49902740 1 --2- 172.21.15.53:0/3085097884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 0x56156771aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.430+0000 7f7a49902740 1 -- 172.21.15.53:0/3085097884 >> 172.21.15.53:0/3085097884 conn(0x561567368460 msgr2=0x56156771a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.431+0000 7f7a49902740 1 -- 172.21.15.53:0/3085097884 shutdown_connections 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.431+0000 7f7a49902740 1 -- 172.21.15.53:0/3085097884 wait complete. 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.431+0000 7f7a49902740 1 -- start start 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.431+0000 7f7a49902740 1 Processor -- start 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a49902740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 0x56156772d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a49902740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567729920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a49902740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567729e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a49902740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1b09c0 con 0x56156734b1b0 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a49902740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1b0290 con 0x5615673329f0 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a49902740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c1ad4d0 con 0x561567353390 2024-08-31T06:10:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a49902740 10 client.0 _ll_register_callbacks cb 0x7f7a2c009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a40928640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567729920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a40928640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567729920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55838/0 (socket says 172.21.15.53:55838) 2024-08-31T06:10:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a40928640 1 -- 172.21.15.53:0/3031392319 learned_addr learned my addr 172.21.15.53:0/3031392319 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a41129640 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 0x56156772d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a4192a640 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567729e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a40928640 1 -- 172.21.15.53:0/3031392319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 msgr2=0x561567729e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a40928640 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567729e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a40928640 1 -- 172.21.15.53:0/3031392319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 msgr2=0x56156772d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a40928640 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 0x56156772d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a40928640 1 -- 172.21.15.53:0/3031392319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56156772a550 con 0x56156734b1b0 2024-08-31T06:10:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a4192a640 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567729e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a41129640 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 0x56156772d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a40928640 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567729920 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0d2340 tx=0x7f7a2c010bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd7dde1ecf28138 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a24ff9640 1 -- 172.21.15.53:0/3031392319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c021070 con 0x56156734b1b0 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.432+0000 7f7a24ff9640 1 -- 172.21.15.53:0/3031392319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7a2c05b170 con 0x56156734b1b0 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a49902740 1 -- 172.21.15.53:0/3031392319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56156768e020 con 0x56156734b1b0 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a24ff9640 1 -- 172.21.15.53:0/3031392319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7a2c0c5050 con 0x56156734b1b0 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a49902740 10 client.17397 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a49902740 1 -- 172.21.15.53:0/3031392319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5615677a25b0 con 0x56156734b1b0 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a24ff9640 1 -- 172.21.15.53:0/3031392319 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56156768e020 con 0x56156734b1b0 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a24ff9640 1 -- 172.21.15.53:0/3031392319 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f7a2c0aa260 con 0x56156734b1b0 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a49902740 10 client.17397 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a49902740 10 client.17397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a49902740 20 client.17397 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a49902740 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561567374070 0x5615677a4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a49902740 4 client.17397 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.433+0000 7f7a49902740 1 -- 172.21.15.53:0/3031392319 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56156768b760 con 0x561567374070 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.434+0000 7f7a41129640 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561567374070 0x5615677a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.434+0000 7f7a24ff9640 10 client.17397 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.434+0000 7f7a41129640 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561567374070 0x5615677a4980 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aded20401e0ed218 server_cookie=48a9b72fd9cd935c in_seq=0 out_seq=0 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.434+0000 7f7a24ff9640 1 -- 172.21.15.53:0/3031392319 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x56156768b760 con 0x561567374070 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.434+0000 7f7a24ff9640 10 client.17397 handle_command_reply: tid=0 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.434+0000 7f7a49902740 1 client.17397 shutdown 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a49902740 1 -- 172.21.15.53:0/3031392319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 msgr2=0x561567729920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a49902740 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567729920 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0d2340 tx=0x7f7a2c010bc0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a49902740 1 -- 172.21.15.53:0/3031392319 shutdown_connections 2024-08-31T06:10:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a49902740 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561567374070 0x5615677a4980 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a49902740 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561567353390 0x561567729e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a49902740 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56156734b1b0 0x561567729920 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a49902740 1 --2- 172.21.15.53:0/3031392319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5615673329f0 0x56156772d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a24ff9640 0 client.17397 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a49902740 1 -- 172.21.15.53:0/3031392319 >> 172.21.15.53:0/3031392319 conn(0x561567368460 msgr2=0x5615677232c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a49902740 1 -- 172.21.15.53:0/3031392319 shutdown_connections 2024-08-31T06:10:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a49902740 1 -- 172.21.15.53:0/3031392319 wait complete. 2024-08-31T06:10:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a49902740 20 client.17397 trim_cache size 0 max 16384 2024-08-31T06:10:12.443 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:10:12.443 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:10:12.444 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:10:12.444 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:10:12.444 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:12.444 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "3e7cb90c-5b9b-4a75-b575-b69641d835a2", 2024-08-31T06:10:12.444 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:10:12.444 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:12.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:12.444 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:10:12.444 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:10:12.444 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:12.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:12.446 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:10:12.447 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:12.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:10:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:10:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:12.449 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:10:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a4338d640 1 -- 172.21.15.53:0/2991929203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a280b4d20 msgr2=0x7f7a280b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a4338d640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a280b4d20 0x7f7a280b7230 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7a34006010 tx=0x7f7a34009800 comp rx=0 tx=0).stop 2024-08-31T06:10:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a4338d640 1 -- 172.21.15.53:0/2991929203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a3c109240 msgr2=0x7f7a3c19a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.435+0000 7f7a4338d640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a3c109240 0x7f7a3c19a740 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00d740 tx=0x7f7a2c00dc00 comp rx=0 tx=0).stop 2024-08-31T06:10:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.436+0000 7f7a4338d640 1 -- 172.21.15.53:0/2991929203 shutdown_connections 2024-08-31T06:10:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.436+0000 7f7a4338d640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a280b4d20 0x7f7a280b7230 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.436+0000 7f7a4338d640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a3c109b90 0x7f7a3c19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.436+0000 7f7a4338d640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a3c109240 0x7f7a3c19a740 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.436+0000 7f7a4338d640 1 --2- 172.21.15.53:0/2991929203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a3c103900 0x7f7a3c19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.436+0000 7f7a4338d640 1 -- 172.21.15.53:0/2991929203 >> 172.21.15.53:0/2991929203 conn(0x7f7a3c07b5f0 msgr2=0x7f7a3c107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:12.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.436+0000 7f7a4338d640 1 -- 172.21.15.53:0/2991929203 shutdown_connections 2024-08-31T06:10:12.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:12.436+0000 7f7a4338d640 1 -- 172.21.15.53:0/2991929203 wait complete. 2024-08-31T06:10:12.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.94 MB/sec execute 122 sec latency 3759.895 ms 2024-08-31T06:10:13.244 INFO:tasks.cephfs.filesystem:scrub status for tag:3e7cb90c-5b9b-4a75-b575-b69641d835a2 - {'path': '/', 'tag': '3e7cb90c-5b9b-4a75-b575-b69641d835a2', 'options': 'recursive,force'} 2024-08-31T06:10:13.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.93 MB/sec execute 123 sec latency 4759.929 ms 2024-08-31T06:10:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:14 smithi130 ceph-mon[22266]: pgmap v481: 97 pgs: 97 active+clean; 60 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 1001 KiB/s wr, 126 op/s 2024-08-31T06:10:14.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:14 smithi153 ceph-mon[22320]: pgmap v481: 97 pgs: 97 active+clean; 60 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 1001 KiB/s wr, 126 op/s 2024-08-31T06:10:14.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:14 smithi053 ceph-mon[18924]: pgmap v481: 97 pgs: 97 active+clean; 60 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 1001 KiB/s wr, 126 op/s 2024-08-31T06:10:14.969 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.91 MB/sec execute 124 sec latency 5759.990 ms 2024-08-31T06:10:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.011+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3609602734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2ec10db20 msgr2=0x7fc2ec110010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.011+0000 7fc2f1ed6640 1 --2- 172.21.15.53:0/3609602734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2ec10db20 0x7fc2ec110010 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009900 tx=0x7fc2e402a410 comp rx=0 tx=0).stop 2024-08-31T06:10:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.011+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3609602734 shutdown_connections 2024-08-31T06:10:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.011+0000 7fc2f1ed6640 1 --2- 172.21.15.53:0/3609602734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2ec10db20 0x7fc2ec110010 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.011+0000 7fc2f1ed6640 1 --2- 172.21.15.53:0/3609602734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2ec105020 0x7fc2ec10d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.011+0000 7fc2f1ed6640 1 --2- 172.21.15.53:0/3609602734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2ec1046d0 0x7fc2ec104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.011+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3609602734 >> 172.21.15.53:0/3609602734 conn(0x7fc2ec07a480 msgr2=0x7fc2ec07a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.011+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3609602734 shutdown_connections 2024-08-31T06:10:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.011+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3609602734 wait complete. 2024-08-31T06:10:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.012+0000 7fc2f1ed6640 1 Processor -- start 2024-08-31T06:10:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.012+0000 7fc2f1ed6640 1 -- start start 2024-08-31T06:10:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.012+0000 7fc2f1ed6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2ec1046d0 0x7fc2ec19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2f1ed6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2ec105020 0x7fc2ec19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2f1ed6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2ec10db20 0x7fc2ec19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2f1ed6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec113640 con 0x7fc2ec10db20 2024-08-31T06:10:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2f1ed6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec1134c0 con 0x7fc2ec105020 2024-08-31T06:10:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2f1ed6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec1137c0 con 0x7fc2ec1046d0 2024-08-31T06:10:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2ec10db20 0x7fc2ec19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2ec10db20 0x7fc2ec19f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58546/0 (socket says 172.21.15.53:58546) 2024-08-31T06:10:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2ebfff640 1 -- 172.21.15.53:0/3716129549 learned_addr learned my addr 172.21.15.53:0/3716129549 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2eb7fe640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2ec1046d0 0x7fc2ec19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2ec105020 0x7fc2ec19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2ebfff640 1 -- 172.21.15.53:0/3716129549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2ec1046d0 msgr2=0x7fc2ec19a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2ebfff640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2ec1046d0 0x7fc2ec19a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2ebfff640 1 -- 172.21.15.53:0/3716129549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2ec105020 msgr2=0x7fc2ec19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2ebfff640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2ec105020 0x7fc2ec19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2ebfff640 1 -- 172.21.15.53:0/3716129549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec19ffb0 con 0x7fc2ec10db20 2024-08-31T06:10:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2ebfff640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2ec10db20 0x7fc2ec19f8b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4005ab0 tx=0x7fc2e40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.013+0000 7fc2e8ff9640 1 -- 172.21.15.53:0/3716129549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e403f030 con 0x7fc2ec10db20 2024-08-31T06:10:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.014+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3716129549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ec1a0240 con 0x7fc2ec10db20 2024-08-31T06:10:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.014+0000 7fc2e8ff9640 1 -- 172.21.15.53:0/3716129549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2e4003a80 con 0x7fc2ec10db20 2024-08-31T06:10:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.014+0000 7fc2e8ff9640 1 -- 172.21.15.53:0/3716129549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4035070 con 0x7fc2ec10db20 2024-08-31T06:10:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.014+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3716129549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ec1a6a30 con 0x7fc2ec10db20 2024-08-31T06:10:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.017+0000 7fc2f8e36740 1 Processor -- start 2024-08-31T06:10:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.017+0000 7fc2e8ff9640 1 -- 172.21.15.53:0/3716129549 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc2e4042030 con 0x7fc2ec10db20 2024-08-31T06:10:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.017+0000 7fc2f8e36740 1 -- start start 2024-08-31T06:10:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.017+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 0x564126054ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.017+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c882f0 0x564126055000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.017+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126055540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.017+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564125fca000 con 0x564125c904d0 2024-08-31T06:10:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.017+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564125fb9590 con 0x564125c882f0 2024-08-31T06:10:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.017+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564125fbd540 con 0x564125cb11b0 2024-08-31T06:10:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2eaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126055540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2eaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126055540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58556/0 (socket says 172.21.15.53:58556) 2024-08-31T06:10:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2eaffd640 1 -- 172.21.15.53:0/3766643591 learned_addr learned my addr 172.21.15.53:0/3766643591 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2eb7fe640 1 --2- 172.21.15.53:0/3766643591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c882f0 0x564126055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/3766643591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 0x564126054ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2e8ff9640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2d80b4ca0 0x7fc2d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2eaffd640 1 -- 172.21.15.53:0/3766643591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 msgr2=0x564126054ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/3766643591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 0x564126054ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2eaffd640 1 -- 172.21.15.53:0/3766643591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c882f0 msgr2=0x564126055000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/3766643591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c882f0 0x564126055000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2eaffd640 1 -- 172.21.15.53:0/3766643591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564125d1c790 con 0x564125c904d0 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2ebfff640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2d80b4ca0 0x7fc2d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2e8ff9640 1 -- 172.21.15.53:0/3716129549 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fc2e4105a40 con 0x7fc2ec10db20 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/3766643591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126055540 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4012580 tx=0x7fc2d400b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef57e9bf2c2cb47 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2e1ffb640 1 -- 172.21.15.53:0/3766643591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d401e640 con 0x564125c904d0 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2e1ffb640 1 -- 172.21.15.53:0/3766643591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2d40108c0 con 0x564125c904d0 2024-08-31T06:10:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.018+0000 7fc2e1ffb640 1 -- 172.21.15.53:0/3766643591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d401d880 con 0x564125c904d0 2024-08-31T06:10:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.019+0000 7fc2f8e36740 1 -- 172.21.15.53:0/3766643591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 msgr2=0x564126055540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.019+0000 7fc2ebfff640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2d80b4ca0 0x7fc2d80b71b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4103190 tx=0x7fc2e40c2040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.019+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/3766643591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126055540 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4012580 tx=0x7fc2d400b9d0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.019+0000 7fc2f8e36740 1 -- 172.21.15.53:0/3766643591 shutdown_connections 2024-08-31T06:10:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.019+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/3766643591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126055540 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.019+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/3766643591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c882f0 0x564126055000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.019+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/3766643591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 0x564126054ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.019+0000 7fc2f8e36740 1 -- 172.21.15.53:0/3766643591 >> 172.21.15.53:0/3766643591 conn(0x564125ca5300 msgr2=0x5641260529b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.019+0000 7fc2f8e36740 1 -- 172.21.15.53:0/3766643591 shutdown_connections 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.019+0000 7fc2f8e36740 1 -- 172.21.15.53:0/3766643591 wait complete. 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.020+0000 7fc2f8e36740 1 -- start start 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.020+0000 7fc2f8e36740 1 Processor -- start 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.020+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c882f0 0x5641260606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.020+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126060c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.020+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 0x56412606c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.020+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564125ef2ab0 con 0x564125c904d0 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.020+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564125f40680 con 0x564125c882f0 2024-08-31T06:10:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.020+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564126063240 con 0x564125cb11b0 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2f8e36740 10 client.0 _ll_register_callbacks cb 0x564125cc8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126060c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126060c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58572/0 (socket says 172.21.15.53:58572) 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eaffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c882f0 0x5641260606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eb7fe640 1 -- 172.21.15.53:0/2467438678 learned_addr learned my addr 172.21.15.53:0/2467438678 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 0x56412606c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eb7fe640 1 -- 172.21.15.53:0/2467438678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 msgr2=0x56412606c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eb7fe640 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 0x56412606c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eb7fe640 1 -- 172.21.15.53:0/2467438678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c882f0 msgr2=0x5641260606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eb7fe640 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c882f0 0x5641260606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eb7fe640 1 -- 172.21.15.53:0/2467438678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564125d95620 con 0x564125c904d0 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c882f0 0x5641260606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2eb7fe640 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126060c50 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc013d30 tx=0x7fc2dc0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d23e4a04a5e9770 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2caffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2caffd640 1 -- 172.21.15.53:0/2467438678 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc003b70 con 0x564125c904d0 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2caffd640 1 -- 172.21.15.53:0/2467438678 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fc2dc003d10 con 0x564125c904d0 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.021+0000 7fc2f8e36740 1 -- 172.21.15.53:0/2467438678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2d40108c0 con 0x564125c904d0 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2caffd640 1 -- 172.21.15.53:0/2467438678 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc2dc004050 con 0x564125c904d0 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2f8e36740 10 client.17409 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2f8e36740 1 -- 172.21.15.53:0/2467438678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56412606f2f0 con 0x564125c904d0 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2caffd640 1 -- 172.21.15.53:0/2467438678 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2d40108c0 con 0x564125c904d0 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2caffd640 1 -- 172.21.15.53:0/2467438678 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc2dc01a020 con 0x564125c904d0 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2f8e36740 10 client.17409 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2f8e36740 10 client.17409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2f8e36740 20 client.17409 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564125c6fd80 0x564126072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2f8e36740 4 client.17409 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2f8e36740 1 -- 172.21.15.53:0/2467438678 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564125fcbf50 con 0x564125c6fd80 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.022+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564125c6fd80 0x564126072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.023+0000 7fc2caffd640 10 client.17409 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.023+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564125c6fd80 0x564126072840 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33c17d30f8fefb8d server_cookie=9a3b99199494b79e in_seq=0 out_seq=0 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2caffd640 1 -- 172.21.15.53:0/2467438678 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564125fcbf50 con 0x564125c6fd80 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2caffd640 10 client.17409 handle_command_reply: tid=0 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 1 client.17409 shutdown 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 1 -- 172.21.15.53:0/2467438678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 msgr2=0x564126060c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126060c50 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc013d30 tx=0x7fc2dc0117b0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 1 -- 172.21.15.53:0/2467438678 shutdown_connections 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564125c6fd80 0x564126072840 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 0x56412606c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c904d0 0x564126060c50 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/2467438678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c882f0 0x5641260606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2caffd640 0 client.17409 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 1 -- 172.21.15.53:0/2467438678 >> 172.21.15.53:0/2467438678 conn(0x564125ca5300 msgr2=0x564126055af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 1 -- 172.21.15.53:0/2467438678 shutdown_connections 2024-08-31T06:10:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 1 -- 172.21.15.53:0/2467438678 wait complete. 2024-08-31T06:10:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.024+0000 7fc2f8e36740 20 client.17409 trim_cache size 0 max 16384 2024-08-31T06:10:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.039+0000 7fc2f8e36740 1 Processor -- start 2024-08-31T06:10:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.039+0000 7fc2f8e36740 1 -- start start 2024-08-31T06:10:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c882f0 0x56412605b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c904d0 0x56412605bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 0x56412605ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec1af390 con 0x564125c882f0 2024-08-31T06:10:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec1b0f30 con 0x564125c904d0 2024-08-31T06:10:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec1afa60 con 0x564125cb11b0 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2eaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c882f0 0x56412605b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2eaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c882f0 0x56412605b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58586/0 (socket says 172.21.15.53:58586) 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2eaffd640 1 -- 172.21.15.53:0/4289468857 learned_addr learned my addr 172.21.15.53:0/4289468857 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2eb7fe640 1 --2- 172.21.15.53:0/4289468857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c904d0 0x56412605bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2eaffd640 1 -- 172.21.15.53:0/4289468857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 msgr2=0x56412605ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/4289468857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 0x56412605ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2eaffd640 1 -- 172.21.15.53:0/4289468857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c904d0 msgr2=0x56412605bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/4289468857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c904d0 0x56412605bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2eaffd640 1 -- 172.21.15.53:0/4289468857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564126053350 con 0x564125c882f0 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2eb7fe640 1 --2- 172.21.15.53:0/4289468857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c904d0 0x56412605bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/4289468857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c882f0 0x56412605b5c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fc2d401d4f0 tx=0x7fc2d40123f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6477bf4251b6ee0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.040+0000 7fc2e17fa640 1 -- 172.21.15.53:0/4289468857 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40050c0 con 0x564125c882f0 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.041+0000 7fc2e17fa640 1 -- 172.21.15.53:0/4289468857 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2d4024040 con 0x564125c882f0 2024-08-31T06:10:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.041+0000 7fc2e17fa640 1 -- 172.21.15.53:0/4289468857 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40035f0 con 0x564125c882f0 2024-08-31T06:10:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.041+0000 7fc2f8e36740 1 -- 172.21.15.53:0/4289468857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c882f0 msgr2=0x56412605b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.041+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/4289468857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c882f0 0x56412605b5c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fc2d401d4f0 tx=0x7fc2d40123f0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.041+0000 7fc2f8e36740 1 -- 172.21.15.53:0/4289468857 shutdown_connections 2024-08-31T06:10:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.041+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/4289468857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125cb11b0 0x56412605ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.041+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/4289468857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c904d0 0x56412605bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.041+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/4289468857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125c882f0 0x56412605b5c0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.041+0000 7fc2f8e36740 1 -- 172.21.15.53:0/4289468857 >> 172.21.15.53:0/4289468857 conn(0x564125ca5300 msgr2=0x56412606c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.041+0000 7fc2f8e36740 1 -- 172.21.15.53:0/4289468857 shutdown_connections 2024-08-31T06:10:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.041+0000 7fc2f8e36740 1 -- 172.21.15.53:0/4289468857 wait complete. 2024-08-31T06:10:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.042+0000 7fc2f8e36740 1 -- start start 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.042+0000 7fc2f8e36740 1 Processor -- start 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.042+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125c882f0 0x5641260645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.042+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c904d0 0x564126064b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.042+0000 7fc2f8e36740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125cb11b0 0x564126065040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.042+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec1b0860 con 0x564125cb11b0 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.042+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec1b0130 con 0x564125c904d0 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.042+0000 7fc2f8e36740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec1ad370 con 0x564125c882f0 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.042+0000 7fc2f8e36740 10 client.0 _ll_register_callbacks cb 0x7fc2dc009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2eaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125cb11b0 0x564126065040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2eaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125cb11b0 0x564126065040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58596/0 (socket says 172.21.15.53:58596) 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2eaffd640 1 -- 172.21.15.53:0/1538939653 learned_addr learned my addr 172.21.15.53:0/1538939653 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125c882f0 0x5641260645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2eb7fe640 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c904d0 0x564126064b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2eaffd640 1 -- 172.21.15.53:0/1538939653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125c882f0 msgr2=0x5641260645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125c882f0 0x5641260645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2eaffd640 1 -- 172.21.15.53:0/1538939653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c904d0 msgr2=0x564126064b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c904d0 0x564126064b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2eaffd640 1 -- 172.21.15.53:0/1538939653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564126056ff0 con 0x564125cb11b0 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2eaffd640 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125cb11b0 0x564126065040 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4005d00 tx=0x7fc2d400bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fba48d1bf1e4df7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2caffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2caffd640 1 -- 172.21.15.53:0/1538939653 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4005300 con 0x564125cb11b0 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2caffd640 1 -- 172.21.15.53:0/1538939653 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7fc2d40054a0 con 0x564125cb11b0 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2f8e36740 1 -- 172.21.15.53:0/1538939653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2d4024040 con 0x564125cb11b0 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2caffd640 1 -- 172.21.15.53:0/1538939653 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc2d401d5b0 con 0x564125cb11b0 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2f8e36740 10 client.17415 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.043+0000 7fc2f8e36740 1 -- 172.21.15.53:0/1538939653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5641260dd470 con 0x564125cb11b0 2024-08-31T06:10:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.044+0000 7fc2caffd640 1 -- 172.21.15.53:0/1538939653 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2d4024040 con 0x564125cb11b0 2024-08-31T06:10:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.044+0000 7fc2caffd640 1 -- 172.21.15.53:0/1538939653 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc2d4029040 con 0x564125cb11b0 2024-08-31T06:10:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.044+0000 7fc2f8e36740 10 client.17415 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.044+0000 7fc2f8e36740 10 client.17415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.044+0000 7fc2f8e36740 20 client.17415 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.044+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564125c451c0 0x5641260df8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.044+0000 7fc2f8e36740 4 client.17415 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:10:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.044+0000 7fc2f8e36740 1 -- 172.21.15.53:0/1538939653 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564125fc79f0 con 0x564125c451c0 2024-08-31T06:10:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.044+0000 7fc2eb7fe640 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564125c451c0 0x5641260df8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.045+0000 7fc2caffd640 10 client.17415 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.045+0000 7fc2eb7fe640 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564125c451c0 0x5641260df8f0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3624b49aef0840a4 server_cookie=4fa949e3a7c01e92 in_seq=0 out_seq=0 2024-08-31T06:10:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2caffd640 1 -- 172.21.15.53:0/1538939653 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564125fc79f0 con 0x564125c451c0 2024-08-31T06:10:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2caffd640 10 client.17415 handle_command_reply: tid=0 2024-08-31T06:10:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 1 client.17415 shutdown 2024-08-31T06:10:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 1 -- 172.21.15.53:0/1538939653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125cb11b0 msgr2=0x564126065040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125cb11b0 0x564126065040 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4005d00 tx=0x7fc2d400bfb0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 1 -- 172.21.15.53:0/1538939653 shutdown_connections 2024-08-31T06:10:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564125c451c0 0x5641260df8f0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564125cb11b0 0x564126065040 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564125c904d0 0x564126064b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2caffd640 0 client.17415 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 1 --2- 172.21.15.53:0/1538939653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564125c882f0 0x5641260645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 1 -- 172.21.15.53:0/1538939653 >> 172.21.15.53:0/1538939653 conn(0x564125ca5300 msgr2=0x56412605ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 1 -- 172.21.15.53:0/1538939653 shutdown_connections 2024-08-31T06:10:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 1 -- 172.21.15.53:0/1538939653 wait complete. 2024-08-31T06:10:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f8e36740 20 client.17415 trim_cache size 0 max 16384 2024-08-31T06:10:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:10:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:10:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:10:15.070 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:10:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3716129549 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2d80b4ca0 msgr2=0x7fc2d80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f1ed6640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2d80b4ca0 0x7fc2d80b71b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4103190 tx=0x7fc2e40c2040 comp rx=0 tx=0).stop 2024-08-31T06:10:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3716129549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2ec10db20 msgr2=0x7fc2ec19f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.065+0000 7fc2f1ed6640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2ec10db20 0x7fc2ec19f8b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4005ab0 tx=0x7fc2e40040e0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.066+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3716129549 shutdown_connections 2024-08-31T06:10:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.066+0000 7fc2f1ed6640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2d80b4ca0 0x7fc2d80b71b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.066+0000 7fc2f1ed6640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2ec10db20 0x7fc2ec19f8b0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.066+0000 7fc2f1ed6640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2ec105020 0x7fc2ec19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.066+0000 7fc2f1ed6640 1 --2- 172.21.15.53:0/3716129549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2ec1046d0 0x7fc2ec19a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.066+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3716129549 >> 172.21.15.53:0/3716129549 conn(0x7fc2ec07a480 msgr2=0x7fc2ec100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.066+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3716129549 shutdown_connections 2024-08-31T06:10:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:15.066+0000 7fc2f1ed6640 1 -- 172.21.15.53:0/3716129549 wait complete. 2024-08-31T06:10:15.970 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.89 MB/sec execute 125 sec latency 6760.042 ms 2024-08-31T06:10:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:16 smithi130 ceph-mon[22266]: pgmap v482: 97 pgs: 97 active+clean; 59 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 933 KiB/s wr, 118 op/s 2024-08-31T06:10:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:16 smithi153 ceph-mon[22320]: pgmap v482: 97 pgs: 97 active+clean; 59 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 933 KiB/s wr, 118 op/s 2024-08-31T06:10:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:16 smithi053 ceph-mon[18924]: pgmap v482: 97 pgs: 97 active+clean; 59 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 933 KiB/s wr, 118 op/s 2024-08-31T06:10:16.970 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.88 MB/sec execute 126 sec latency 7760.110 ms 2024-08-31T06:10:17.970 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.86 MB/sec execute 127 sec latency 8760.201 ms 2024-08-31T06:10:18.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:18 smithi130 ceph-mon[22266]: pgmap v483: 97 pgs: 97 active+clean; 55 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 848 KiB/s wr, 103 op/s 2024-08-31T06:10:18.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:18 smithi153 ceph-mon[22320]: pgmap v483: 97 pgs: 97 active+clean; 55 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 848 KiB/s wr, 103 op/s 2024-08-31T06:10:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:18 smithi053 ceph-mon[18924]: pgmap v483: 97 pgs: 97 active+clean; 55 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 848 KiB/s wr, 103 op/s 2024-08-31T06:10:18.970 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.85 MB/sec execute 128 sec latency 9760.272 ms 2024-08-31T06:10:19.970 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.84 MB/sec execute 129 sec latency 10760.387 ms 2024-08-31T06:10:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:20 smithi130 ceph-mon[22266]: pgmap v484: 97 pgs: 97 active+clean; 55 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 450 KiB/s wr, 60 op/s 2024-08-31T06:10:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:20 smithi153 ceph-mon[22320]: pgmap v484: 97 pgs: 97 active+clean; 55 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 450 KiB/s wr, 60 op/s 2024-08-31T06:10:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:20 smithi053 ceph-mon[18924]: pgmap v484: 97 pgs: 97 active+clean; 55 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 450 KiB/s wr, 60 op/s 2024-08-31T06:10:20.970 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.82 MB/sec execute 130 sec latency 11760.496 ms 2024-08-31T06:10:21.970 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.81 MB/sec execute 131 sec latency 12760.577 ms 2024-08-31T06:10:22.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:22 smithi130 ceph-mon[22266]: pgmap v485: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 337 KiB/s wr, 58 op/s 2024-08-31T06:10:22.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:22 smithi153 ceph-mon[22320]: pgmap v485: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 337 KiB/s wr, 58 op/s 2024-08-31T06:10:22.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:22 smithi053 ceph-mon[18924]: pgmap v485: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 337 KiB/s wr, 58 op/s 2024-08-31T06:10:22.970 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.79 MB/sec execute 132 sec latency 13760.683 ms 2024-08-31T06:10:23.970 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.78 MB/sec execute 133 sec latency 14760.782 ms 2024-08-31T06:10:24.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:24 smithi130 ceph-mon[22266]: pgmap v486: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 KiB/s wr, 29 op/s 2024-08-31T06:10:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:24 smithi153 ceph-mon[22320]: pgmap v486: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 KiB/s wr, 29 op/s 2024-08-31T06:10:24.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:24 smithi053 ceph-mon[18924]: pgmap v486: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 KiB/s wr, 29 op/s 2024-08-31T06:10:24.970 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.77 MB/sec execute 134 sec latency 15760.888 ms 2024-08-31T06:10:25.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.75 MB/sec execute 135 sec latency 16761.000 ms 2024-08-31T06:10:26.300 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:26 smithi053 ceph-mon[18924]: pgmap v487: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-08-31T06:10:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:26 smithi130 ceph-mon[22266]: pgmap v487: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-08-31T06:10:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:26 smithi153 ceph-mon[22320]: pgmap v487: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-08-31T06:10:26.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.74 MB/sec execute 136 sec latency 17761.066 ms 2024-08-31T06:10:27.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.73 MB/sec execute 137 sec latency 18761.150 ms 2024-08-31T06:10:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.167+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/1367464168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d94108a00 msgr2=0x7f6d9410f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.167+0000 7f6d9b8ec640 1 --2- 172.21.15.53:0/1367464168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d94108a00 0x7f6d9410f230 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009ca0 tx=0x7f6d8c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.167+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/1367464168 shutdown_connections 2024-08-31T06:10:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.167+0000 7f6d9b8ec640 1 --2- 172.21.15.53:0/1367464168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d94108a00 0x7f6d9410f230 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.167+0000 7f6d9b8ec640 1 --2- 172.21.15.53:0/1367464168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d941080b0 0x7f6d941084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.167+0000 7f6d9b8ec640 1 --2- 172.21.15.53:0/1367464168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d94102780 0x7f6d94102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.167+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/1367464168 >> 172.21.15.53:0/1367464168 conn(0x7f6d9407a430 msgr2=0x7f6d9407a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.167+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/1367464168 shutdown_connections 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.167+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/1367464168 wait complete. 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.168+0000 7f6d9b8ec640 1 Processor -- start 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.168+0000 7f6d9b8ec640 1 -- start start 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.168+0000 7f6d9b8ec640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d94102780 0x7f6d9419af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.168+0000 7f6d9b8ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d941080b0 0x7f6d9419b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.168+0000 7f6d9b8ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d94108a00 0x7f6d9419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.168+0000 7f6d9b8ec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6d94112570 con 0x7f6d941080b0 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.168+0000 7f6d9b8ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941123f0 con 0x7f6d94108a00 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.168+0000 7f6d9b8ec640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941126f0 con 0x7f6d94102780 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d98e87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d941080b0 0x7f6d9419b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d98e87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d941080b0 0x7f6d9419b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42404/0 (socket says 172.21.15.53:42404) 2024-08-31T06:10:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d98e87640 1 -- 172.21.15.53:0/3689744383 learned_addr learned my addr 172.21.15.53:0/3689744383 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d99e89640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d94108a00 0x7f6d9419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d99688640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d94102780 0x7f6d9419af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d98e87640 1 -- 172.21.15.53:0/3689744383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d94102780 msgr2=0x7f6d9419af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d98e87640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d94102780 0x7f6d9419af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d98e87640 1 -- 172.21.15.53:0/3689744383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d94108a00 msgr2=0x7f6d9419b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d98e87640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d94108a00 0x7f6d9419b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d98e87640 1 -- 172.21.15.53:0/3689744383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d941a61c0 con 0x7f6d941080b0 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d99688640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d94102780 0x7f6d9419af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d98e87640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d941080b0 0x7f6d9419b440 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400c970 tx=0x7f6d8400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d8a7fc640 1 -- 172.21.15.53:0/3689744383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84007bb0 con 0x7f6d941080b0 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/3689744383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d941a64b0 con 0x7f6d941080b0 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d8a7fc640 1 -- 172.21.15.53:0/3689744383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d84007d50 con 0x7f6d941080b0 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d8a7fc640 1 -- 172.21.15.53:0/3689744383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84004db0 con 0x7f6d941080b0 2024-08-31T06:10:28.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.169+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/3689744383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d941a6a00 con 0x7f6d941080b0 2024-08-31T06:10:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6da2858740 1 Processor -- start 2024-08-31T06:10:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6da2858740 1 -- start start 2024-08-31T06:10:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6d8a7fc640 1 -- 172.21.15.53:0/3689744383 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6d84004fb0 con 0x7f6d941080b0 2024-08-31T06:10:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6da2858740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6da2858740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd642f0 0x55712c131220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6da2858740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd6c4d0 0x55712c131760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6da2858740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55712c0a6000 con 0x55712bd8d1b0 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6da2858740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55712c095590 con 0x55712bd642f0 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6da2858740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55712c099540 con 0x55712bd6c4d0 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6d99e89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6d99e89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42410/0 (socket says 172.21.15.53:42410) 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.172+0000 7f6d99e89640 1 -- 172.21.15.53:0/222580088 learned_addr learned my addr 172.21.15.53:0/222580088 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d98e87640 1 --2- 172.21.15.53:0/222580088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd6c4d0 0x55712c131760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d99688640 1 --2- 172.21.15.53:0/222580088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd642f0 0x55712c131220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d99e89640 1 -- 172.21.15.53:0/222580088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd6c4d0 msgr2=0x55712c131760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d99e89640 1 --2- 172.21.15.53:0/222580088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd6c4d0 0x55712c131760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d99e89640 1 -- 172.21.15.53:0/222580088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd642f0 msgr2=0x55712c131220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d99e89640 1 --2- 172.21.15.53:0/222580088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd642f0 0x55712c131220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d99e89640 1 -- 172.21.15.53:0/222580088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55712bdf8790 con 0x55712bd8d1b0 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d99688640 1 --2- 172.21.15.53:0/222580088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd642f0 0x55712c131220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d8a7fc640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d800b4ca0 0x7f6d800b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d99e89640 1 --2- 172.21.15.53:0/222580088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c130ce0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009ca0 tx=0x7f6d8c031500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f2bdc9c74a42fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d99688640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d800b4ca0 0x7f6d800b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d8a7fc640 1 -- 172.21.15.53:0/3689744383 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f6d840e50e0 con 0x7f6d941080b0 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d7f7fe640 1 -- 172.21.15.53:0/222580088 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0317b0 con 0x55712bd8d1b0 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d7f7fe640 1 -- 172.21.15.53:0/222580088 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d8c036030 con 0x55712bd8d1b0 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.173+0000 7f6d7f7fe640 1 -- 172.21.15.53:0/222580088 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c004590 con 0x55712bd8d1b0 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.174+0000 7f6da2858740 1 -- 172.21.15.53:0/222580088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 msgr2=0x55712c130ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.174+0000 7f6da2858740 1 --2- 172.21.15.53:0/222580088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c130ce0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009ca0 tx=0x7f6d8c031500 comp rx=0 tx=0).stop 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.174+0000 7f6d99688640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d800b4ca0 0x7f6d800b71b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55712c12f960 tx=0x7f6d9000b2e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.174+0000 7f6da2858740 1 -- 172.21.15.53:0/222580088 shutdown_connections 2024-08-31T06:10:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.174+0000 7f6da2858740 1 --2- 172.21.15.53:0/222580088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd6c4d0 0x55712c131760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.174+0000 7f6da2858740 1 --2- 172.21.15.53:0/222580088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd642f0 0x55712c131220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.174+0000 7f6da2858740 1 --2- 172.21.15.53:0/222580088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c130ce0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.174+0000 7f6da2858740 1 -- 172.21.15.53:0/222580088 >> 172.21.15.53:0/222580088 conn(0x55712bd81300 msgr2=0x55712c12ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.174+0000 7f6da2858740 1 -- 172.21.15.53:0/222580088 shutdown_connections 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.174+0000 7f6da2858740 1 -- 172.21.15.53:0/222580088 wait complete. 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.174+0000 7f6da2858740 1 -- start start 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6da2858740 1 Processor -- start 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6da2858740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd642f0 0x55712c13c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6da2858740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd6c4d0 0x55712c13cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6da2858740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c148570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6da2858740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55712bfceab0 con 0x55712bd8d1b0 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6da2858740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55712c01c680 con 0x55712bd6c4d0 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6da2858740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55712c13f280 con 0x55712bd642f0 2024-08-31T06:10:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6da2858740 10 client.0 _ll_register_callbacks cb 0x55712bda4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6d99e89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6d99e89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42418/0 (socket says 172.21.15.53:42418) 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6d99e89640 1 -- 172.21.15.53:0/4129356219 learned_addr learned my addr 172.21.15.53:0/4129356219 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6d98e87640 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd6c4d0 0x55712c13cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6d99688640 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd642f0 0x55712c13c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6d99e89640 1 -- 172.21.15.53:0/4129356219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd642f0 msgr2=0x55712c13c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6d99e89640 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd642f0 0x55712c13c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6d99e89640 1 -- 172.21.15.53:0/4129356219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd6c4d0 msgr2=0x55712c13cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6d99e89640 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd6c4d0 0x55712c13cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.175+0000 7f6d99e89640 1 -- 172.21.15.53:0/4129356219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55712be71620 con 0x55712bd8d1b0 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6d99688640 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd642f0 0x55712c13c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6d98e87640 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd6c4d0 0x55712c13cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6d99e89640 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c148570 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009bf0 tx=0x7f6d8c0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853105ae961957f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6d7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6d7cff9640 1 -- 172.21.15.53:0/4129356219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c04a040 con 0x55712bd8d1b0 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6d7cff9640 1 -- 172.21.15.53:0/4129356219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f6d8c003970 con 0x55712bd8d1b0 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6da2858740 1 -- 172.21.15.53:0/4129356219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d8c036030 con 0x55712bd8d1b0 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6d7cff9640 1 -- 172.21.15.53:0/4129356219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6d8c0317b0 con 0x55712bd8d1b0 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6da2858740 10 client.17427 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6da2858740 1 -- 172.21.15.53:0/4129356219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55712c14b2c0 con 0x55712bd8d1b0 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6d7cff9640 1 -- 172.21.15.53:0/4129356219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d8c036030 con 0x55712bd8d1b0 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6d7cff9640 1 -- 172.21.15.53:0/4129356219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6d8c04d030 con 0x55712bd8d1b0 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.176+0000 7f6da2858740 10 client.17427 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.177+0000 7f6da2858740 10 client.17427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.177+0000 7f6da2858740 20 client.17427 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.177+0000 7f6da2858740 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55712bd4bd80 0x55712c14e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.177+0000 7f6da2858740 4 client.17427 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.177+0000 7f6da2858740 1 -- 172.21.15.53:0/4129356219 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55712c0a7f50 con 0x55712bd4bd80 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.177+0000 7f6d99688640 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55712bd4bd80 0x55712c14e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.177+0000 7f6d7cff9640 10 client.17427 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.177+0000 7f6d99688640 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55712bd4bd80 0x55712c14e620 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0122a3e70e1977c server_cookie=23659c8f3a7d15f1 in_seq=0 out_seq=0 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6d7cff9640 1 -- 172.21.15.53:0/4129356219 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55712c0a7f50 con 0x55712bd4bd80 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6d7cff9640 10 client.17427 handle_command_reply: tid=0 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6da2858740 1 client.17427 shutdown 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6da2858740 1 -- 172.21.15.53:0/4129356219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 msgr2=0x55712c148570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6da2858740 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c148570 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009bf0 tx=0x7f6d8c0045c0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6da2858740 1 -- 172.21.15.53:0/4129356219 shutdown_connections 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6da2858740 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55712bd4bd80 0x55712c14e620 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6da2858740 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c148570 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6d7cff9640 0 client.17427 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6da2858740 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd6c4d0 0x55712c13cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6da2858740 1 --2- 172.21.15.53:0/4129356219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd642f0 0x55712c13c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6da2858740 1 -- 172.21.15.53:0/4129356219 >> 172.21.15.53:0/4129356219 conn(0x55712bd81300 msgr2=0x55712c131d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6da2858740 1 -- 172.21.15.53:0/4129356219 shutdown_connections 2024-08-31T06:10:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.178+0000 7f6da2858740 1 -- 172.21.15.53:0/4129356219 wait complete. 2024-08-31T06:10:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.179+0000 7f6da2858740 20 client.17427 trim_cache size 0 max 16384 2024-08-31T06:10:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.193+0000 7f6da2858740 1 Processor -- start 2024-08-31T06:10:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.193+0000 7f6da2858740 1 -- start start 2024-08-31T06:10:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.193+0000 7f6da2858740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd642f0 0x55712c148470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.193+0000 7f6da2858740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd6c4d0 0x55712c135da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.193+0000 7f6da2858740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd8d1b0 0x55712c1362e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.193+0000 7f6da2858740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941af410 con 0x55712bd642f0 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.193+0000 7f6da2858740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941b0fb0 con 0x55712bd6c4d0 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.193+0000 7f6da2858740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941afae0 con 0x55712bd8d1b0 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.193+0000 7f6d99688640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd642f0 0x55712c148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.193+0000 7f6d99688640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd642f0 0x55712c148470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42422/0 (socket says 172.21.15.53:42422) 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.193+0000 7f6d99688640 1 -- 172.21.15.53:0/2204009577 learned_addr learned my addr 172.21.15.53:0/2204009577 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.194+0000 7f6d99688640 1 -- 172.21.15.53:0/2204009577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd8d1b0 msgr2=0x55712c1362e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.194+0000 7f6d99688640 1 --2- 172.21.15.53:0/2204009577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd8d1b0 0x55712c1362e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.194+0000 7f6d99688640 1 -- 172.21.15.53:0/2204009577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd6c4d0 msgr2=0x55712c135da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.194+0000 7f6d98e87640 1 --2- 172.21.15.53:0/2204009577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd6c4d0 0x55712c135da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.194+0000 7f6d99688640 1 --2- 172.21.15.53:0/2204009577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd6c4d0 0x55712c135da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.194+0000 7f6d99688640 1 -- 172.21.15.53:0/2204009577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55712c129a90 con 0x55712bd642f0 2024-08-31T06:10:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.194+0000 7f6d99688640 1 --2- 172.21.15.53:0/2204009577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd642f0 0x55712c148470 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x55712c14eb90 tx=0x7f6d90016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53529d765c7683d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.194+0000 7f6d7effd640 1 -- 172.21.15.53:0/2204009577 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9002c070 con 0x55712bd642f0 2024-08-31T06:10:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.194+0000 7f6d7effd640 1 -- 172.21.15.53:0/2204009577 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d9001f8b0 con 0x55712bd642f0 2024-08-31T06:10:28.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.194+0000 7f6d7effd640 1 -- 172.21.15.53:0/2204009577 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d900118b0 con 0x55712bd642f0 2024-08-31T06:10:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.195+0000 7f6da2858740 1 -- 172.21.15.53:0/2204009577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd642f0 msgr2=0x55712c148470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.195+0000 7f6da2858740 1 --2- 172.21.15.53:0/2204009577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd642f0 0x55712c148470 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x55712c14eb90 tx=0x7f6d90016000 comp rx=0 tx=0).stop 2024-08-31T06:10:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.195+0000 7f6da2858740 1 -- 172.21.15.53:0/2204009577 shutdown_connections 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.195+0000 7f6da2858740 1 --2- 172.21.15.53:0/2204009577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd8d1b0 0x55712c1362e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.195+0000 7f6da2858740 1 --2- 172.21.15.53:0/2204009577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd6c4d0 0x55712c135da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.195+0000 7f6da2858740 1 --2- 172.21.15.53:0/2204009577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd642f0 0x55712c148470 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.195+0000 7f6da2858740 1 -- 172.21.15.53:0/2204009577 >> 172.21.15.53:0/2204009577 conn(0x55712bd81300 msgr2=0x55712c13afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.195+0000 7f6da2858740 1 -- 172.21.15.53:0/2204009577 shutdown_connections 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.195+0000 7f6da2858740 1 -- 172.21.15.53:0/2204009577 wait complete. 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.195+0000 7f6da2858740 1 -- start start 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.195+0000 7f6da2858740 1 Processor -- start 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6da2858740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd642f0 0x55712c144a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6da2858740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd6c4d0 0x55712c13fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6da2858740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c1403e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6da2858740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941b08e0 con 0x55712bd8d1b0 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6da2858740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941b01b0 con 0x55712bd642f0 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6da2858740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6d941ad3f0 con 0x55712bd6c4d0 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6da2858740 10 client.0 _ll_register_callbacks cb 0x7f6d8c031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d99e89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c1403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d99e89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c1403e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42438/0 (socket says 172.21.15.53:42438) 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d99e89640 1 -- 172.21.15.53:0/511885706 learned_addr learned my addr 172.21.15.53:0/511885706 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d99688640 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd642f0 0x55712c144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d98e87640 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd6c4d0 0x55712c13fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d99e89640 1 -- 172.21.15.53:0/511885706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd6c4d0 msgr2=0x55712c13fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d99e89640 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd6c4d0 0x55712c13fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d99e89640 1 -- 172.21.15.53:0/511885706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd642f0 msgr2=0x55712c144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d99e89640 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd642f0 0x55712c144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d99e89640 1 -- 172.21.15.53:0/511885706 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55712c140920 con 0x55712bd8d1b0 2024-08-31T06:10:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d99e89640 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c1403e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c050460 tx=0x7f6d8c004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ca502c15835e4c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.196+0000 7f6d7cff9640 1 -- 172.21.15.53:0/511885706 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c031500 con 0x55712bd8d1b0 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6d7cff9640 1 -- 172.21.15.53:0/511885706 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f6d8c0305c0 con 0x55712bd8d1b0 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6da2858740 1 -- 172.21.15.53:0/511885706 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d9001f8b0 con 0x55712bd8d1b0 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6d7cff9640 1 -- 172.21.15.53:0/511885706 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6d8c0307c0 con 0x55712bd8d1b0 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6da2858740 10 client.17433 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6da2858740 1 -- 172.21.15.53:0/511885706 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55712c1b8a90 con 0x55712bd8d1b0 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6d7cff9640 1 -- 172.21.15.53:0/511885706 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d9001f8b0 con 0x55712bd8d1b0 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6d7cff9640 1 -- 172.21.15.53:0/511885706 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6d8c04d070 con 0x55712bd8d1b0 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6da2858740 10 client.17433 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6da2858740 10 client.17433 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6da2858740 20 client.17433 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6da2858740 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55712bd211c0 0x55712c1bb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6da2858740 4 client.17433 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:10:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6da2858740 1 -- 172.21.15.53:0/511885706 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55712c0a39f0 con 0x55712bd211c0 2024-08-31T06:10:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.197+0000 7f6d99688640 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55712bd211c0 0x55712c1bb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.198+0000 7f6d7cff9640 10 client.17433 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.198+0000 7f6d99688640 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55712bd211c0 0x55712c1bb270 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ed77db9cfcac43 server_cookie=ab0e464a401aec0a in_seq=0 out_seq=0 2024-08-31T06:10:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.215+0000 7f6d7cff9640 1 -- 172.21.15.53:0/511885706 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55712c0a39f0 con 0x55712bd211c0 2024-08-31T06:10:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.215+0000 7f6d7cff9640 10 client.17433 handle_command_reply: tid=0 2024-08-31T06:10:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.215+0000 7f6da2858740 1 client.17433 shutdown 2024-08-31T06:10:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6da2858740 1 -- 172.21.15.53:0/511885706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 msgr2=0x55712c1403e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6da2858740 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c1403e0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c050460 tx=0x7f6d8c004870 comp rx=0 tx=0).stop 2024-08-31T06:10:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6da2858740 1 -- 172.21.15.53:0/511885706 shutdown_connections 2024-08-31T06:10:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6da2858740 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55712bd211c0 0x55712c1bb270 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6da2858740 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55712bd8d1b0 0x55712c1403e0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6d7cff9640 0 client.17433 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6da2858740 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55712bd6c4d0 0x55712c13fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6da2858740 1 --2- 172.21.15.53:0/511885706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55712bd642f0 0x55712c144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6da2858740 1 -- 172.21.15.53:0/511885706 >> 172.21.15.53:0/511885706 conn(0x55712bd81300 msgr2=0x55712c135da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6da2858740 1 -- 172.21.15.53:0/511885706 shutdown_connections 2024-08-31T06:10:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6da2858740 1 -- 172.21.15.53:0/511885706 wait complete. 2024-08-31T06:10:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6da2858740 20 client.17433 trim_cache size 0 max 16384 2024-08-31T06:10:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:10:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:10:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:10:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:10:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/3689744383 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d800b4ca0 msgr2=0x7f6d800b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6d9b8ec640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d800b4ca0 0x7f6d800b71b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55712c12f960 tx=0x7f6d9000b2e0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/3689744383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d941080b0 msgr2=0x7f6d9419b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6d9b8ec640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d941080b0 0x7f6d9419b440 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400c970 tx=0x7f6d8400ce30 comp rx=0 tx=0).stop 2024-08-31T06:10:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/3689744383 shutdown_connections 2024-08-31T06:10:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6d9b8ec640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d800b4ca0 0x7f6d800b71b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6d9b8ec640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d94108a00 0x7f6d9419b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6d9b8ec640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d941080b0 0x7f6d9419b440 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6d9b8ec640 1 --2- 172.21.15.53:0/3689744383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d94102780 0x7f6d9419af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.216+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/3689744383 >> 172.21.15.53:0/3689744383 conn(0x7f6d9407a430 msgr2=0x7f6d94104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.217+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/3689744383 shutdown_connections 2024-08-31T06:10:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:28.217+0000 7f6d9b8ec640 1 -- 172.21.15.53:0/3689744383 wait complete. 2024-08-31T06:10:28.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:28 smithi130 ceph-mon[22266]: pgmap v488: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 21 op/s 2024-08-31T06:10:28.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:28 smithi153 ceph-mon[22320]: pgmap v488: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 21 op/s 2024-08-31T06:10:28.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:28 smithi053 ceph-mon[18924]: pgmap v488: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 21 op/s 2024-08-31T06:10:28.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.72 MB/sec execute 138 sec latency 19761.259 ms 2024-08-31T06:10:29.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.70 MB/sec execute 139 sec latency 20761.358 ms 2024-08-31T06:10:30.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:30 smithi130 ceph-mon[22266]: pgmap v489: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-08-31T06:10:30.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:30 smithi153 ceph-mon[22320]: pgmap v489: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-08-31T06:10:30.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:30 smithi053 ceph-mon[18924]: pgmap v489: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-08-31T06:10:30.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.69 MB/sec execute 140 sec latency 21761.464 ms 2024-08-31T06:10:31.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.68 MB/sec execute 141 sec latency 22761.584 ms 2024-08-31T06:10:32.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:32 smithi130 ceph-mon[22266]: pgmap v490: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-31T06:10:32.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:32 smithi153 ceph-mon[22320]: pgmap v490: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-31T06:10:32.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:32 smithi053 ceph-mon[18924]: pgmap v490: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-31T06:10:32.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.67 MB/sec execute 142 sec latency 23761.669 ms 2024-08-31T06:10:33.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.66 MB/sec execute 143 sec latency 24761.764 ms 2024-08-31T06:10:34.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:34 smithi130 ceph-mon[22266]: pgmap v491: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-08-31T06:10:34.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:34 smithi153 ceph-mon[22320]: pgmap v491: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-08-31T06:10:34.472 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:10:34.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:34 smithi053 ceph-mon[18924]: pgmap v491: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-08-31T06:10:34.976 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.64 MB/sec execute 144 sec latency 25761.858 ms 2024-08-31T06:10:35.243 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:10:35.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.675+0000 7f3156459640 1 -- 172.21.15.53:0/1706152690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3150108140 msgr2=0x7f3150108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.675+0000 7f3156459640 1 --2- 172.21.15.53:0/1706152690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3150108140 0x7f3150108550 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3144009900 tx=0x7f314402a410 comp rx=0 tx=0).stop 2024-08-31T06:10:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.676+0000 7f3156459640 1 -- 172.21.15.53:0/1706152690 shutdown_connections 2024-08-31T06:10:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.676+0000 7f3156459640 1 --2- 172.21.15.53:0/1706152690 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3150108a90 0x7f315010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.676+0000 7f3156459640 1 --2- 172.21.15.53:0/1706152690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3150108140 0x7f3150108550 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.676+0000 7f3156459640 1 --2- 172.21.15.53:0/1706152690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3150102800 0x7f3150102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.676+0000 7f3156459640 1 -- 172.21.15.53:0/1706152690 >> 172.21.15.53:0/1706152690 conn(0x7f31500794d0 msgr2=0x7f31500798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.676+0000 7f3156459640 1 -- 172.21.15.53:0/1706152690 shutdown_connections 2024-08-31T06:10:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.676+0000 7f3156459640 1 -- 172.21.15.53:0/1706152690 wait complete. 2024-08-31T06:10:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.676+0000 7f3156459640 1 Processor -- start 2024-08-31T06:10:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.676+0000 7f3156459640 1 -- start start 2024-08-31T06:10:35.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f3156459640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3150102800 0x7f315010fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:35.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f3156459640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3150108140 0x7f3150110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:35.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f3156459640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3150108a90 0x7f31501107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:35.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f3156459640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f31501136d0 con 0x7f3150108a90 2024-08-31T06:10:35.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f3156459640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3150113550 con 0x7f3150102800 2024-08-31T06:10:35.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f3156459640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3150113850 con 0x7f3150108140 2024-08-31T06:10:35.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f31549f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3150108a90 0x7f31501107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f31549f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3150108a90 0x7f31501107d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48598/0 (socket says 172.21.15.53:48598) 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f31549f6640 1 -- 172.21.15.53:0/1090364881 learned_addr learned my addr 172.21.15.53:0/1090364881 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f314f7fe640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3150108140 0x7f3150110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f314ffff640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3150102800 0x7f315010fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f31549f6640 1 -- 172.21.15.53:0/1090364881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3150108140 msgr2=0x7f3150110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f31549f6640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3150108140 0x7f3150110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f31549f6640 1 -- 172.21.15.53:0/1090364881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3150102800 msgr2=0x7f315010fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f31549f6640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3150102800 0x7f315010fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.677+0000 7f31549f6640 1 -- 172.21.15.53:0/1090364881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31501a8440 con 0x7f3150108a90 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.678+0000 7f31549f6640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3150108a90 0x7f31501107d0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f314800cad0 tx=0x7f314800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.678+0000 7f314d7fa640 1 -- 172.21.15.53:0/1090364881 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314800ae20 con 0x7f3150108a90 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.678+0000 7f3156459640 1 -- 172.21.15.53:0/1090364881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31501a8730 con 0x7f3150108a90 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.678+0000 7f314d7fa640 1 -- 172.21.15.53:0/1090364881 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3148005020 con 0x7f3150108a90 2024-08-31T06:10:35.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.678+0000 7f314d7fa640 1 -- 172.21.15.53:0/1090364881 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314800f6b0 con 0x7f3150108a90 2024-08-31T06:10:35.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.678+0000 7f3156459640 1 -- 172.21.15.53:0/1090364881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31501a8c40 con 0x7f3150108a90 2024-08-31T06:10:35.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.679+0000 7f3156459640 1 -- 172.21.15.53:0/1090364881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3150102c10 con 0x7f3150108a90 2024-08-31T06:10:35.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.681+0000 7f314d7fa640 1 -- 172.21.15.53:0/1090364881 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f31480051d0 con 0x7f3150108a90 2024-08-31T06:10:35.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.682+0000 7f314d7fa640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31380b4ca0 0x7f31380b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:35.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.682+0000 7f314ffff640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31380b4ca0 0x7f31380b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:35.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.682+0000 7f314d7fa640 1 -- 172.21.15.53:0/1090364881 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f31480e58e0 con 0x7f3150108a90 2024-08-31T06:10:35.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.682+0000 7f314ffff640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31380b4ca0 0x7f31380b71b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f31501117a0 tx=0x7f314000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:35.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.685+0000 7f314d7fa640 1 -- 172.21.15.53:0/1090364881 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3148014030 con 0x7f3150108a90 2024-08-31T06:10:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.906+0000 7f3156459640 1 -- 172.21.15.53:0/1090364881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3150111050 con 0x7f3150108a90 2024-08-31T06:10:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.906+0000 7f314d7fa640 1 -- 172.21.15.53:0/1090364881 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11988 (secure 0 0 0) 0x7f3150111050 con 0x7f3150108a90 2024-08-31T06:10:35.909 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:10:35.909 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"btime":"2024-08-31T06:09:25:953687+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:09:25.529444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:10:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 34 2024-08-31T06:10:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 -- 172.21.15.53:0/1090364881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31380b4ca0 msgr2=0x7f31380b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31380b4ca0 0x7f31380b71b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f31501117a0 tx=0x7f314000b390 comp rx=0 tx=0).stop 2024-08-31T06:10:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 -- 172.21.15.53:0/1090364881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3150108a90 msgr2=0x7f31501107d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3150108a90 0x7f31501107d0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f314800cad0 tx=0x7f314800cf90 comp rx=0 tx=0).stop 2024-08-31T06:10:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 -- 172.21.15.53:0/1090364881 shutdown_connections 2024-08-31T06:10:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31380b4ca0 0x7f31380b71b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3150108a90 0x7f31501107d0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3150108140 0x7f3150110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 --2- 172.21.15.53:0/1090364881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3150102800 0x7f315010fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 -- 172.21.15.53:0/1090364881 >> 172.21.15.53:0/1090364881 conn(0x7f31500794d0 msgr2=0x7f3150105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 -- 172.21.15.53:0/1090364881 shutdown_connections 2024-08-31T06:10:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:35.909+0000 7f3156459640 1 -- 172.21.15.53:0/1090364881 wait complete. 2024-08-31T06:10:35.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.63 MB/sec execute 145 sec latency 26761.967 ms 2024-08-31T06:10:36.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:36 smithi053 ceph-mon[18924]: pgmap v492: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-08-31T06:10:36.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:36 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1090364881' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:10:36.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:36 smithi130 ceph-mon[22266]: pgmap v492: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-08-31T06:10:36.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:36 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1090364881' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:10:36.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:36 smithi153 ceph-mon[22320]: pgmap v492: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-08-31T06:10:36.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:36 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1090364881' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:10:36.740 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id 9cc0e807 --release --await' 2024-08-31T06:10:36.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id 9cc0e807 --release --await 2024-08-31T06:10:36.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96412 1.62 MB/sec execute 146 sec latency 27762.011 ms 2024-08-31T06:10:36.998 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:10:37.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.492+0000 7f80e8687640 1 -- 172.21.15.53:0/1177298713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80e0103900 msgr2=0x7f80e0103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:37.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.492+0000 7f80e8687640 1 --2- 172.21.15.53:0/1177298713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80e0103900 0x7f80e0103d10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009900 tx=0x7f80dc02a410 comp rx=0 tx=0).stop 2024-08-31T06:10:37.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.492+0000 7f80e8687640 1 -- 172.21.15.53:0/1177298713 shutdown_connections 2024-08-31T06:10:37.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.492+0000 7f80e8687640 1 --2- 172.21.15.53:0/1177298713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80e0109b90 0x7f80e01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.492+0000 7f80e8687640 1 --2- 172.21.15.53:0/1177298713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e0109240 0x7f80e0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.492+0000 7f80e8687640 1 --2- 172.21.15.53:0/1177298713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80e0103900 0x7f80e0103d10 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.493+0000 7f80e8687640 1 -- 172.21.15.53:0/1177298713 >> 172.21.15.53:0/1177298713 conn(0x7f80e007b5f0 msgr2=0x7f80e007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:37.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.493+0000 7f80e8687640 1 -- 172.21.15.53:0/1177298713 shutdown_connections 2024-08-31T06:10:37.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.493+0000 7f80e8687640 1 -- 172.21.15.53:0/1177298713 wait complete. 2024-08-31T06:10:37.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.493+0000 7f80e8687640 1 Processor -- start 2024-08-31T06:10:37.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.493+0000 7f80e8687640 1 -- start start 2024-08-31T06:10:37.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e8687640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80e0103900 0x7f80e019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e8687640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e0109240 0x7f80e019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e8687640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80e0109b90 0x7f80e019f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e8687640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0113700 con 0x7f80e0109b90 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e8687640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0113580 con 0x7f80e0109240 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e8687640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0113880 con 0x7f80e0103900 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e6c24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80e0109b90 0x7f80e019f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e6c24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80e0109b90 0x7f80e019f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48622/0 (socket says 172.21.15.53:48622) 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e6c24640 1 -- 172.21.15.53:0/1583358707 learned_addr learned my addr 172.21.15.53:0/1583358707 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e5c22640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e0109240 0x7f80e019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e6423640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80e0103900 0x7f80e019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e6c24640 1 -- 172.21.15.53:0/1583358707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80e0103900 msgr2=0x7f80e019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e6c24640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80e0103900 0x7f80e019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e6c24640 1 -- 172.21.15.53:0/1583358707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e0109240 msgr2=0x7f80e019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e6c24640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e0109240 0x7f80e019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e6c24640 1 -- 172.21.15.53:0/1583358707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e01a00a0 con 0x7f80e0109b90 2024-08-31T06:10:37.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e5c22640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e0109240 0x7f80e019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e6423640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80e0103900 0x7f80e019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80e6c24640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80e0109b90 0x7f80e019f970 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f80d800eaa0 tx=0x7f80d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.494+0000 7f80d77fe640 1 -- 172.21.15.53:0/1583358707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d800cdb0 con 0x7f80e0109b90 2024-08-31T06:10:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.495+0000 7f80d77fe640 1 -- 172.21.15.53:0/1583358707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80d8005020 con 0x7f80e0109b90 2024-08-31T06:10:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.495+0000 7f80e8687640 1 -- 172.21.15.53:0/1583358707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e01a0390 con 0x7f80e0109b90 2024-08-31T06:10:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.495+0000 7f80d77fe640 1 -- 172.21.15.53:0/1583358707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80116d0 con 0x7f80e0109b90 2024-08-31T06:10:37.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.495+0000 7f80e8687640 1 -- 172.21.15.53:0/1583358707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e01a6af0 con 0x7f80e0109b90 2024-08-31T06:10:37.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.497+0000 7f80eebfc740 1 Processor -- start 2024-08-31T06:10:37.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.497+0000 7f80d77fe640 1 -- 172.21.15.53:0/1583358707 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f80d80051d0 con 0x7f80e0109b90 2024-08-31T06:10:37.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80eebfc740 1 -- start start 2024-08-31T06:10:37.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80eebfc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d3b072ca70 con 0x55d3b03ef840 2024-08-31T06:10:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80eebfc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d3b071c000 con 0x55d3b0410520 2024-08-31T06:10:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80eebfc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d3b071ffb0 con 0x55d3b03e7660 2024-08-31T06:10:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80e5c22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80e5c22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48630/0 (socket says 172.21.15.53:48630) 2024-08-31T06:10:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80e5c22640 1 -- 172.21.15.53:0/106543084 learned_addr learned my addr 172.21.15.53:0/106543084 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80e6423640 1 --2- 172.21.15.53:0/106543084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.498+0000 7f80e5c22640 1 --2- 172.21.15.53:0/106543084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80d77fe640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80cc0b4ca0 0x7f80cc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80e5c22640 1 -- 172.21.15.53:0/106543084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 msgr2=0x55d3b07b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80e5c22640 1 --2- 172.21.15.53:0/106543084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80e5c22640 1 -- 172.21.15.53:0/106543084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 msgr2=0x55d3b07b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80e5c22640 1 --2- 172.21.15.53:0/106543084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80e5c22640 1 -- 172.21.15.53:0/106543084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b047bb00 con 0x55d3b03ef840 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80e6c24640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80cc0b4ca0 0x7f80cc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80e5c22640 1 --2- 172.21.15.53:0/106543084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07b6700 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f80d00117c0 tx=0x7f80d0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ec6ccf7e08683a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80d77fe640 1 -- 172.21.15.53:0/1583358707 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f80d80e5a60 con 0x7f80e0109b90 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80d4ff9640 1 -- 172.21.15.53:0/106543084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0011050 con 0x55d3b03ef840 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80d4ff9640 1 -- 172.21.15.53:0/106543084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80d00111f0 con 0x55d3b03ef840 2024-08-31T06:10:37.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.499+0000 7f80d4ff9640 1 -- 172.21.15.53:0/106543084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d00035f0 con 0x55d3b03ef840 2024-08-31T06:10:37.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.500+0000 7f80eebfc740 1 -- 172.21.15.53:0/106543084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 msgr2=0x55d3b07b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.500+0000 7f80e6c24640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80cc0b4ca0 0x7f80cc0b71b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f80d80ac0e0 tx=0x7f80d80a88a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.500+0000 7f80eebfc740 1 --2- 172.21.15.53:0/106543084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07b6700 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f80d00117c0 tx=0x7f80d0005850 comp rx=0 tx=0).stop 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.500+0000 7f80eebfc740 1 -- 172.21.15.53:0/106543084 shutdown_connections 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.500+0000 7f80eebfc740 1 --2- 172.21.15.53:0/106543084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07b6700 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.500+0000 7f80eebfc740 1 --2- 172.21.15.53:0/106543084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.500+0000 7f80eebfc740 1 --2- 172.21.15.53:0/106543084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.500+0000 7f80eebfc740 1 -- 172.21.15.53:0/106543084 >> 172.21.15.53:0/106543084 conn(0x55d3b0404910 msgr2=0x55d3b07b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.500+0000 7f80eebfc740 1 -- 172.21.15.53:0/106543084 shutdown_connections 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.500+0000 7f80eebfc740 1 -- 172.21.15.53:0/106543084 wait complete. 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80eebfc740 1 -- start start 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80eebfc740 1 Processor -- start 2024-08-31T06:10:37.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80eebfc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d3b07c4460 con 0x55d3b03ef840 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80eebfc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d3b06dd520 con 0x55d3b0410520 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80eebfc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d3b07c45e0 con 0x55d3b03e7660 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80eebfc740 10 client.0 _ll_register_callbacks cb 0x55d3b0715c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80e6423640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80e6423640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07c1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48644/0 (socket says 172.21.15.53:48644) 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80e6423640 1 -- 172.21.15.53:0/3201046223 learned_addr learned my addr 172.21.15.53:0/3201046223 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.501+0000 7f80e5c22640 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80e5c22640 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80e6423640 1 -- 172.21.15.53:0/3201046223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 msgr2=0x55d3b07c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:37.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80e6423640 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80e6423640 1 -- 172.21.15.53:0/3201046223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 msgr2=0x55d3b07cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80e6423640 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80e6423640 1 -- 172.21.15.53:0/3201046223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b04f2960 con 0x55d3b03ef840 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80e5c22640 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80e6423640 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07c1e50 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f80dc02a930 tx=0x7f80dc031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e10ef6b5bb59 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80c9ffb640 1 -- 172.21.15.53:0/3201046223 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc035040 con 0x55d3b03ef840 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80c9ffb640 1 -- 172.21.15.53:0/3201046223 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f80dc004040 con 0x55d3b03ef840 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80eebfc740 1 -- 172.21.15.53:0/3201046223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d3b06bb9a0 con 0x55d3b03ef840 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80c9ffb640 1 -- 172.21.15.53:0/3201046223 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f80dc004240 con 0x55d3b03ef840 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80eebfc740 10 client.17451 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80eebfc740 1 -- 172.21.15.53:0/3201046223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d3b07d0670 con 0x55d3b03ef840 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.502+0000 7f80c9ffb640 1 -- 172.21.15.53:0/3201046223 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d3b06bb9a0 con 0x55d3b03ef840 2024-08-31T06:10:37.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.503+0000 7f80c9ffb640 1 -- 172.21.15.53:0/3201046223 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f80dc0049c0 con 0x55d3b03ef840 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.503+0000 7f80eebfc740 10 client.17451 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.503+0000 7f80eebfc740 10 client.17451 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.503+0000 7f80eebfc740 20 client.17451 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.503+0000 7f80eebfc740 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d3b03ceea0 0x55d3b07d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.503+0000 7f80eebfc740 4 client.17451 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.503+0000 7f80eebfc740 1 -- 172.21.15.53:0/3201046223 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3b072e9c0 con 0x55d3b03ceea0 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.503+0000 7f80e5c22640 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d3b03ceea0 0x55d3b07d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.503+0000 7f80c9ffb640 10 client.17451 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.503+0000 7f80e5c22640 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d3b03ceea0 0x55d3b07d3b10 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=231702c6eb1349e server_cookie=19582a3e711a8d37 in_seq=0 out_seq=0 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.504+0000 7f80c9ffb640 1 -- 172.21.15.53:0/3201046223 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3b072e9c0 con 0x55d3b03ceea0 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.504+0000 7f80c9ffb640 10 client.17451 handle_command_reply: tid=0 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.504+0000 7f80eebfc740 1 client.17451 shutdown 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.504+0000 7f80eebfc740 1 -- 172.21.15.53:0/3201046223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 msgr2=0x55d3b07c1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:37.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.504+0000 7f80eebfc740 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07c1e50 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f80dc02a930 tx=0x7f80dc031630 comp rx=0 tx=0).stop 2024-08-31T06:10:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.504+0000 7f80eebfc740 1 -- 172.21.15.53:0/3201046223 shutdown_connections 2024-08-31T06:10:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.504+0000 7f80eebfc740 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d3b03ceea0 0x55d3b07d3b10 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.504+0000 7f80eebfc740 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.504+0000 7f80eebfc740 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07c1e50 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.504+0000 7f80eebfc740 1 --2- 172.21.15.53:0/3201046223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.504+0000 7f80eebfc740 1 -- 172.21.15.53:0/3201046223 >> 172.21.15.53:0/3201046223 conn(0x55d3b0404910 msgr2=0x55d3b07b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.505+0000 7f80c9ffb640 0 client.17451 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.505+0000 7f80eebfc740 1 -- 172.21.15.53:0/3201046223 shutdown_connections 2024-08-31T06:10:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.505+0000 7f80eebfc740 1 -- 172.21.15.53:0/3201046223 wait complete. 2024-08-31T06:10:37.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.505+0000 7f80eebfc740 20 client.17451 trim_cache size 0 max 16384 2024-08-31T06:10:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80eebfc740 1 Processor -- start 2024-08-31T06:10:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80eebfc740 1 -- start start 2024-08-31T06:10:37.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07bff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80eebfc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01af440 con 0x55d3b03ef840 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80eebfc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01b0fe0 con 0x55d3b0410520 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80eebfc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01afb10 con 0x55d3b03e7660 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80e6423640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80e6423640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48658/0 (socket says 172.21.15.53:48658) 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80e6423640 1 -- 172.21.15.53:0/290030478 learned_addr learned my addr 172.21.15.53:0/290030478 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80e5c22640 1 --2- 172.21.15.53:0/290030478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80e6423640 1 -- 172.21.15.53:0/290030478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 msgr2=0x55d3b07bff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80e6423640 1 --2- 172.21.15.53:0/290030478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07bff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80e5c22640 1 --2- 172.21.15.53:0/290030478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80e6423640 1 -- 172.21.15.53:0/290030478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 msgr2=0x55d3b07cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.522+0000 7f80e6423640 1 --2- 172.21.15.53:0/290030478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.523+0000 7f80e6423640 1 -- 172.21.15.53:0/290030478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b07c1f90 con 0x55d3b03ef840 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.523+0000 7f80e5c22640 1 --2- 172.21.15.53:0/290030478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:10:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.523+0000 7f80e6423640 1 --2- 172.21.15.53:0/290030478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07cd7d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f80dc000c00 tx=0x7f80dc005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5790306818a8e6d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.523+0000 7f80cbfff640 1 -- 172.21.15.53:0/290030478 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc035070 con 0x55d3b03ef840 2024-08-31T06:10:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.523+0000 7f80cbfff640 1 -- 172.21.15.53:0/290030478 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80dc004b50 con 0x55d3b03ef840 2024-08-31T06:10:37.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.523+0000 7f80cbfff640 1 -- 172.21.15.53:0/290030478 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc005540 con 0x55d3b03ef840 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.524+0000 7f80eebfc740 1 -- 172.21.15.53:0/290030478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 msgr2=0x55d3b07cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.524+0000 7f80eebfc740 1 --2- 172.21.15.53:0/290030478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07cd7d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f80dc000c00 tx=0x7f80dc005ec0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.524+0000 7f80eebfc740 1 -- 172.21.15.53:0/290030478 shutdown_connections 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.524+0000 7f80eebfc740 1 --2- 172.21.15.53:0/290030478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b0410520 0x55d3b07cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.524+0000 7f80eebfc740 1 --2- 172.21.15.53:0/290030478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03ef840 0x55d3b07cd7d0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.524+0000 7f80eebfc740 1 --2- 172.21.15.53:0/290030478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b03e7660 0x55d3b07bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.524+0000 7f80eebfc740 1 -- 172.21.15.53:0/290030478 >> 172.21.15.53:0/290030478 conn(0x55d3b0404910 msgr2=0x55d3b07bc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.524+0000 7f80eebfc740 1 -- 172.21.15.53:0/290030478 shutdown_connections 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.524+0000 7f80eebfc740 1 -- 172.21.15.53:0/290030478 wait complete. 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.524+0000 7f80eebfc740 1 -- start start 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.524+0000 7f80eebfc740 1 Processor -- start 2024-08-31T06:10:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03e7660 0x55d3b0837780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b03ef840 0x55d3b0837d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80eebfc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b0410520 0x55d3b07c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80eebfc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01b0910 con 0x55d3b03e7660 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80eebfc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01b01e0 con 0x55d3b03ef840 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80eebfc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01ad420 con 0x55d3b0410520 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80eebfc740 10 client.0 _ll_register_callbacks cb 0x7f80dc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e5c22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03e7660 0x55d3b0837780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e5c22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03e7660 0x55d3b0837780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48666/0 (socket says 172.21.15.53:48666) 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e5c22640 1 -- 172.21.15.53:0/2570741921 learned_addr learned my addr 172.21.15.53:0/2570741921 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e6423640 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b03ef840 0x55d3b0837d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e5c22640 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b0410520 0x55d3b07c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e5c22640 1 -- 172.21.15.53:0/2570741921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b0410520 msgr2=0x55d3b07c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e5c22640 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b0410520 0x55d3b07c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e5c22640 1 -- 172.21.15.53:0/2570741921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b03ef840 msgr2=0x55d3b0837d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e5c22640 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b03ef840 0x55d3b0837d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e5c22640 1 -- 172.21.15.53:0/2570741921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b07c6810 con 0x55d3b03e7660 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e6423640 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b03ef840 0x55d3b0837d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80e5c22640 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03e7660 0x55d3b0837780 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f80d000fe00 tx=0x7f80dc032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364a80a1d15ccfd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.525+0000 7f80c9ffb640 1 -- 172.21.15.53:0/2570741921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d002d070 con 0x55d3b03e7660 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80c9ffb640 1 -- 172.21.15.53:0/2570741921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f80d0011e00 con 0x55d3b03e7660 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80eebfc740 1 -- 172.21.15.53:0/2570741921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80dc004b50 con 0x55d3b03e7660 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80c9ffb640 1 -- 172.21.15.53:0/2570741921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f80d000f8d0 con 0x55d3b03e7660 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80eebfc740 10 client.17457 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80eebfc740 1 -- 172.21.15.53:0/2570741921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d3b083eee0 con 0x55d3b03e7660 2024-08-31T06:10:37.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80c9ffb640 1 -- 172.21.15.53:0/2570741921 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80dc004b50 con 0x55d3b03e7660 2024-08-31T06:10:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80c9ffb640 1 -- 172.21.15.53:0/2570741921 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f80d0003880 con 0x55d3b03e7660 2024-08-31T06:10:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80eebfc740 10 client.17457 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80eebfc740 10 client.17457 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:10:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80eebfc740 20 client.17457 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80eebfc740 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d3b03a4250 0x55d3b08414d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80eebfc740 4 client.17457 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9cc0e807", "release": true, "await": true}] 2024-08-31T06:10:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80eebfc740 1 -- 172.21.15.53:0/2570741921 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9cc0e807", "release": true, "await": true}) -- 0x55d3b072a460 con 0x55d3b03a4250 2024-08-31T06:10:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.526+0000 7f80e6423640 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d3b03a4250 0x55d3b08414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.527+0000 7f80c9ffb640 10 client.17457 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.527+0000 7f80e6423640 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d3b03a4250 0x55d3b08414d0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c40deeaecd2da388 server_cookie=5e4da1597c02d7b3 in_seq=0 out_seq=0 2024-08-31T06:10:37.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80c9ffb640 1 -- 172.21.15.53:0/2570741921 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d3b072a460 con 0x55d3b03a4250 2024-08-31T06:10:37.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80c9ffb640 10 client.17457 handle_command_reply: tid=0 2024-08-31T06:10:37.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 1 client.17457 shutdown 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 1 -- 172.21.15.53:0/2570741921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03e7660 msgr2=0x55d3b0837780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03e7660 0x55d3b0837780 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f80d000fe00 tx=0x7f80dc032ed0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 1 -- 172.21.15.53:0/2570741921 shutdown_connections 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d3b03a4250 0x55d3b08414d0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d3b0410520 0x55d3b07c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3b03ef840 0x55d3b0837d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 1 --2- 172.21.15.53:0/2570741921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d3b03e7660 0x55d3b0837780 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 1 -- 172.21.15.53:0/2570741921 >> 172.21.15.53:0/2570741921 conn(0x55d3b0404910 msgr2=0x55d3b07bfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80c9ffb640 0 client.17457 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 1 -- 172.21.15.53:0/2570741921 shutdown_connections 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 1 -- 172.21.15.53:0/2570741921 wait complete. 2024-08-31T06:10:37.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.551+0000 7f80eebfc740 20 client.17457 trim_cache size 0 max 16384 2024-08-31T06:10:37.555 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:10:37.555 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 34, 2024-08-31T06:10:37.555 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:10:37.555 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 20, 2024-08-31T06:10:37.555 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:10:37.555 INFO:teuthology.orchestra.run.smithi053.stdout: "9cc0e807": { 2024-08-31T06:10:37.555 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 20, 2024-08-31T06:10:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:10:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:10:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:10:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:10:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:10:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 152.7, 2024-08-31T06:10:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:10:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:10:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:10:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:10:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:10:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:10:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:37.557 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:10:37.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 -- 172.21.15.53:0/1583358707 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80cc0b4ca0 msgr2=0x7f80cc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:37.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80cc0b4ca0 0x7f80cc0b71b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f80d80ac0e0 tx=0x7f80d80a88a0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 -- 172.21.15.53:0/1583358707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80e0109b90 msgr2=0x7f80e019f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:37.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80e0109b90 0x7f80e019f970 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f80d800eaa0 tx=0x7f80d800ef60 comp rx=0 tx=0).stop 2024-08-31T06:10:37.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 -- 172.21.15.53:0/1583358707 shutdown_connections 2024-08-31T06:10:37.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f80cc0b4ca0 0x7f80cc0b71b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80e0109b90 0x7f80e019f970 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e0109240 0x7f80e019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 --2- 172.21.15.53:0/1583358707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80e0103900 0x7f80e019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:37.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 -- 172.21.15.53:0/1583358707 >> 172.21.15.53:0/1583358707 conn(0x7f80e007b5f0 msgr2=0x7f80e0107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:37.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 -- 172.21.15.53:0/1583358707 shutdown_connections 2024-08-31T06:10:37.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:37.552+0000 7f80e8687640 1 -- 172.21.15.53:0/1583358707 wait complete. 2024-08-31T06:10:37.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 96606 1.61 MB/sec execute 147 sec latency 28358.221 ms 2024-08-31T06:10:38.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:38 smithi130 ceph-mon[22266]: pgmap v493: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-31T06:10:38.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:38 smithi153 ceph-mon[22320]: pgmap v493: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-31T06:10:38.435 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:38 smithi053 ceph-mon[18924]: pgmap v493: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-08-31T06:10:38.467 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9cc0e807', total seconds elapsed: 36.7 2024-08-31T06:10:38.971 INFO:tasks.workunit.client.0.smithi053.stdout: 1 97080 1.61 MB/sec execute 148 sec latency 15.082 ms 2024-08-31T06:10:39.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 97684 1.63 MB/sec execute 149 sec latency 31.911 ms 2024-08-31T06:10:40.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:40 smithi130 ceph-mon[22266]: pgmap v494: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-31T06:10:40.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:40 smithi153 ceph-mon[22320]: pgmap v494: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-31T06:10:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:40 smithi053 ceph-mon[18924]: pgmap v494: 97 pgs: 97 active+clean; 55 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-08-31T06:10:40.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 98258 1.63 MB/sec execute 150 sec latency 12.435 ms 2024-08-31T06:10:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.322+0000 7f60aa99f640 1 -- 172.21.15.53:0/850354566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a41089d0 msgr2=0x7f60a410f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.322+0000 7f60aa99f640 1 --2- 172.21.15.53:0/850354566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a41089d0 0x7f60a410f200 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f609c009ca0 tx=0x7f609c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.322+0000 7f60aa99f640 1 -- 172.21.15.53:0/850354566 shutdown_connections 2024-08-31T06:10:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.322+0000 7f60aa99f640 1 --2- 172.21.15.53:0/850354566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a41089d0 0x7f60a410f200 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.322+0000 7f60aa99f640 1 --2- 172.21.15.53:0/850354566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a4108080 0x7f60a4108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.322+0000 7f60aa99f640 1 --2- 172.21.15.53:0/850354566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a4102750 0x7f60a4102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.322+0000 7f60aa99f640 1 -- 172.21.15.53:0/850354566 >> 172.21.15.53:0/850354566 conn(0x7f60a407a4e0 msgr2=0x7f60a407a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.322+0000 7f60aa99f640 1 -- 172.21.15.53:0/850354566 shutdown_connections 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.322+0000 7f60aa99f640 1 -- 172.21.15.53:0/850354566 wait complete. 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60aa99f640 1 Processor -- start 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60aa99f640 1 -- start start 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60aa99f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a4102750 0x7f60a4198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60aa99f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a4108080 0x7f60a4199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60aa99f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a41089d0 0x7f60a419e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60aa99f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f60a41125a0 con 0x7f60a41089d0 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60aa99f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f60a4112420 con 0x7f60a4108080 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60aa99f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60a4112720 con 0x7f60a4102750 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60a8f3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a41089d0 0x7f60a419e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60a8f3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a41089d0 0x7f60a419e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48684/0 (socket says 172.21.15.53:48684) 2024-08-31T06:10:41.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60a8f3c640 1 -- 172.21.15.53:0/2767710682 learned_addr learned my addr 172.21.15.53:0/2767710682 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.323+0000 7f60a3fff640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a4102750 0x7f60a4198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a4108080 0x7f60a4199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60a8f3c640 1 -- 172.21.15.53:0/2767710682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a4102750 msgr2=0x7f60a4198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60a8f3c640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a4102750 0x7f60a4198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60a8f3c640 1 -- 172.21.15.53:0/2767710682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a4108080 msgr2=0x7f60a4199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60a8f3c640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a4108080 0x7f60a4199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60a8f3c640 1 -- 172.21.15.53:0/2767710682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a419eed0 con 0x7f60a41089d0 2024-08-31T06:10:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a4108080 0x7f60a4199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60a8f3c640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a41089d0 0x7f60a419e7d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f609c005cc0 tx=0x7f609c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60a17fa640 1 -- 172.21.15.53:0/2767710682 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c032c10 con 0x7f60a41089d0 2024-08-31T06:10:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60a17fa640 1 -- 172.21.15.53:0/2767710682 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f609c032db0 con 0x7f60a41089d0 2024-08-31T06:10:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60aa99f640 1 -- 172.21.15.53:0/2767710682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a419f160 con 0x7f60a41089d0 2024-08-31T06:10:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60a17fa640 1 -- 172.21.15.53:0/2767710682 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c030a60 con 0x7f60a41089d0 2024-08-31T06:10:41.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.324+0000 7f60aa99f640 1 -- 172.21.15.53:0/2767710682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a41a5950 con 0x7f60a41089d0 2024-08-31T06:10:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.327+0000 7f60a17fa640 1 -- 172.21.15.53:0/2767710682 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f609c030c00 con 0x7f60a41089d0 2024-08-31T06:10:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.327+0000 7f60b19e8740 1 Processor -- start 2024-08-31T06:10:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.327+0000 7f60b19e8740 1 -- start start 2024-08-31T06:10:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.327+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae541b0 0x55cf4b1f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.327+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1f8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.327+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae334d0 0x55cf4b1f8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.327+0000 7f60b19e8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cf4b16d000 con 0x55cf4ae334d0 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.327+0000 7f60b19e8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cf4b15c590 con 0x55cf4ae541b0 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.327+0000 7f60b19e8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cf4b160540 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a17fa640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f608c0b4ca0 0x7f608c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae334d0 0x55cf4b1f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1f8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34244/0 (socket says 172.21.15.53:34244) 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a3fff640 1 -- 172.21.15.53:0/2492150100 learned_addr learned my addr 172.21.15.53:0/2492150100 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a8f3c640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f608c0b4ca0 0x7f608c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2492150100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae541b0 0x55cf4b1f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a3fff640 1 -- 172.21.15.53:0/2492150100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae541b0 msgr2=0x55cf4b1f7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a3fff640 1 --2- 172.21.15.53:0/2492150100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae541b0 0x55cf4b1f7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a3fff640 1 -- 172.21.15.53:0/2492150100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae334d0 msgr2=0x55cf4b1f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a3fff640 1 --2- 172.21.15.53:0/2492150100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae334d0 0x55cf4b1f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a3fff640 1 -- 172.21.15.53:0/2492150100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf4aebf790 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2492150100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae541b0 0x55cf4b1f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:10:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a17fa640 1 -- 172.21.15.53:0/2767710682 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f609c1068c0 con 0x7f60a41089d0 2024-08-31T06:10:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a3fff640 1 --2- 172.21.15.53:0/2492150100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1f8000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6094009cf0 tx=0x7f6094011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f136d74cca0a6cd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f60a8f3c640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f608c0b4ca0 0x7f608c0b71b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f609c0cccb0 tx=0x7f609c0c8f50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f608a7fc640 1 -- 172.21.15.53:0/2492150100 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094004230 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f608a7fc640 1 -- 172.21.15.53:0/2492150100 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60940043d0 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.328+0000 7f608a7fc640 1 -- 172.21.15.53:0/2492150100 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094019750 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.329+0000 7f60b19e8740 1 -- 172.21.15.53:0/2492150100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 msgr2=0x55cf4b1f8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.329+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2492150100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1f8000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6094009cf0 tx=0x7f6094011810 comp rx=0 tx=0).stop 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.329+0000 7f60b19e8740 1 -- 172.21.15.53:0/2492150100 shutdown_connections 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.329+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2492150100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae334d0 0x55cf4b1f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.329+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2492150100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1f8000 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.329+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2492150100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae541b0 0x55cf4b1f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.329+0000 7f60b19e8740 1 -- 172.21.15.53:0/2492150100 >> 172.21.15.53:0/2492150100 conn(0x55cf4ae48300 msgr2=0x55cf4b1f59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.329+0000 7f60b19e8740 1 -- 172.21.15.53:0/2492150100 shutdown_connections 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.329+0000 7f60b19e8740 1 -- 172.21.15.53:0/2492150100 wait complete. 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.330+0000 7f60b19e8740 1 -- start start 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.330+0000 7f60b19e8740 1 Processor -- start 2024-08-31T06:10:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.330+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.330+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae334d0 0x55cf4b1ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.330+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b1fdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.330+0000 7f60b19e8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cf4b095ab0 con 0x55cf4ae541b0 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.330+0000 7f60b19e8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cf4b0e3680 con 0x55cf4ae334d0 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.330+0000 7f60b19e8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cf4b208420 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.330+0000 7f60b19e8740 10 client.0 _ll_register_callbacks cb 0x55cf4ae6ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60a37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60a3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae334d0 0x55cf4b1ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60a37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1ff4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34252/0 (socket says 172.21.15.53:34252) 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60a37fe640 1 -- 172.21.15.53:0/2055626610 learned_addr learned my addr 172.21.15.53:0/2055626610 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b1fdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60a37fe640 1 -- 172.21.15.53:0/2055626610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae334d0 msgr2=0x55cf4b1ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae334d0 0x55cf4b1ffa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60a37fe640 1 -- 172.21.15.53:0/2055626610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 msgr2=0x55cf4b1fdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b1fdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60a37fe640 1 -- 172.21.15.53:0/2055626610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf4af38620 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1ff4d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f60980104d0 tx=0x7f6098004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3464f0594c2bff6a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60837fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60837fe640 1 -- 172.21.15.53:0/2055626610 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609801b040 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60837fe640 1 -- 172.21.15.53:0/2055626610 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f6098005220 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.331+0000 7f60b19e8740 1 -- 172.21.15.53:0/2055626610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60940043d0 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60837fe640 1 -- 172.21.15.53:0/2055626610 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6098010e50 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60b19e8740 10 client.26791 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60b19e8740 1 -- 172.21.15.53:0/2055626610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cf4b216770 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60837fe640 1 -- 172.21.15.53:0/2055626610 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60940043d0 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60837fe640 1 -- 172.21.15.53:0/2055626610 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6098022440 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60b19e8740 10 client.26791 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60b19e8740 10 client.26791 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60b19e8740 20 client.26791 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf4ae12d80 0x55cf4b219cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60b19e8740 4 client.26791 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60b19e8740 1 -- 172.21.15.53:0/2055626610 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf4b16ef50 con 0x55cf4ae12d80 2024-08-31T06:10:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.332+0000 7f60a3fff640 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf4ae12d80 0x55cf4b219cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.333+0000 7f60837fe640 10 client.26791 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.333+0000 7f60a3fff640 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf4ae12d80 0x55cf4b219cd0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cf463678d846a6c server_cookie=7e14be910f87616 in_seq=0 out_seq=0 2024-08-31T06:10:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60837fe640 1 -- 172.21.15.53:0/2055626610 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf4b16ef50 con 0x55cf4ae12d80 2024-08-31T06:10:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60837fe640 10 client.26791 handle_command_reply: tid=0 2024-08-31T06:10:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60b19e8740 1 client.26791 shutdown 2024-08-31T06:10:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60b19e8740 1 -- 172.21.15.53:0/2055626610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 msgr2=0x55cf4b1ff4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1ff4d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f60980104d0 tx=0x7f6098004730 comp rx=0 tx=0).stop 2024-08-31T06:10:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60b19e8740 1 -- 172.21.15.53:0/2055626610 shutdown_connections 2024-08-31T06:10:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf4ae12d80 0x55cf4b219cd0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b1fdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60837fe640 0 client.26791 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae334d0 0x55cf4b1ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2055626610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1ff4d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60b19e8740 1 -- 172.21.15.53:0/2055626610 >> 172.21.15.53:0/2055626610 conn(0x55cf4ae48300 msgr2=0x55cf4b1f3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60b19e8740 1 -- 172.21.15.53:0/2055626610 shutdown_connections 2024-08-31T06:10:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.334+0000 7f60b19e8740 1 -- 172.21.15.53:0/2055626610 wait complete. 2024-08-31T06:10:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.335+0000 7f60b19e8740 20 client.26791 trim_cache size 0 max 16384 2024-08-31T06:10:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.351+0000 7f60b19e8740 1 Processor -- start 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.351+0000 7f60b19e8740 1 -- start start 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 0x55cf4b1fd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b1fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60b19e8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f60a41ad200 con 0x55cf4ae541b0 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60b19e8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f60a41aeda0 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60b19e8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60a41ad8d0 con 0x55cf4ae334d0 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b1fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b1fdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48698/0 (socket says 172.21.15.53:48698) 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60a3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 0x55cf4b1fd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60a37fe640 1 -- 172.21.15.53:0/1492324925 learned_addr learned my addr 172.21.15.53:0/1492324925 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60a37fe640 1 --2- 172.21.15.53:0/1492324925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60a37fe640 1 -- 172.21.15.53:0/1492324925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 msgr2=0x55cf4b1fd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60a37fe640 1 --2- 172.21.15.53:0/1492324925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 0x55cf4b1fd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60a37fe640 1 -- 172.21.15.53:0/1492324925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 msgr2=0x55cf4b1fcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60a37fe640 1 --2- 172.21.15.53:0/1492324925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1fcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60a37fe640 1 -- 172.21.15.53:0/1492324925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf4b200440 con 0x55cf4ae541b0 2024-08-31T06:10:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.352+0000 7f60a37fe640 1 --2- 172.21.15.53:0/1492324925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b1fdb40 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f6098012d50 tx=0x7f6098005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0a61a1e8f7d8f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.353+0000 7f6089ffb640 1 -- 172.21.15.53:0/1492324925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609802e030 con 0x55cf4ae541b0 2024-08-31T06:10:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.353+0000 7f6089ffb640 1 -- 172.21.15.53:0/1492324925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f609802f040 con 0x55cf4ae541b0 2024-08-31T06:10:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.353+0000 7f6089ffb640 1 -- 172.21.15.53:0/1492324925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609802ac20 con 0x55cf4ae541b0 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.353+0000 7f60b19e8740 1 -- 172.21.15.53:0/1492324925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 msgr2=0x55cf4b1fdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.353+0000 7f60b19e8740 1 --2- 172.21.15.53:0/1492324925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b1fdb40 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f6098012d50 tx=0x7f6098005f90 comp rx=0 tx=0).stop 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.353+0000 7f60b19e8740 1 -- 172.21.15.53:0/1492324925 shutdown_connections 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.353+0000 7f60b19e8740 1 --2- 172.21.15.53:0/1492324925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b1fdb40 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.353+0000 7f60b19e8740 1 --2- 172.21.15.53:0/1492324925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 0x55cf4b1fd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 --2- 172.21.15.53:0/1492324925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b1fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 -- 172.21.15.53:0/1492324925 >> 172.21.15.53:0/1492324925 conn(0x55cf4ae48300 msgr2=0x55cf4b1ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 -- 172.21.15.53:0/1492324925 shutdown_connections 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 -- 172.21.15.53:0/1492324925 wait complete. 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 -- start start 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 Processor -- start 2024-08-31T06:10:41.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b2120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 0x55cf4b20f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b20faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f60a41ae6d0 con 0x55cf4ae541b0 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f60a41adfa0 con 0x55cf4ae2b2f0 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.354+0000 7f60b19e8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60a41ab1e0 con 0x55cf4ae334d0 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60b19e8740 10 client.0 _ll_register_callbacks cb 0x7f6098009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b2120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 0x55cf4b20f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 0x55cf4b20f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34270/0 (socket says 172.21.15.53:34270) 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b2120a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38326/0 (socket says 172.21.15.53:38326) 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a3fff640 1 -- 172.21.15.53:0/2712471892 learned_addr learned my addr 172.21.15.53:0/2712471892 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:41.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b20faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a3fff640 1 -- 172.21.15.53:0/2712471892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 msgr2=0x55cf4b2120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a3fff640 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b2120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a3fff640 1 -- 172.21.15.53:0/2712471892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 msgr2=0x55cf4b20faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a3fff640 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b20faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a3fff640 1 -- 172.21.15.53:0/2712471892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf4b20ffe0 con 0x55cf4ae334d0 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b2120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60a3fff640 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 0x55cf4b20f560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6094014040 tx=0x7f6094009ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb06c0dd24a837a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60837fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.355+0000 7f60837fe640 1 -- 172.21.15.53:0/2712471892 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094030070 con 0x55cf4ae334d0 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60837fe640 1 -- 172.21.15.53:0/2712471892 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f6094003a00 con 0x55cf4ae334d0 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60b19e8740 1 -- 172.21.15.53:0/2712471892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f609802f040 con 0x55cf4ae334d0 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60837fe640 1 -- 172.21.15.53:0/2712471892 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f609403c050 con 0x55cf4ae334d0 2024-08-31T06:10:41.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60b19e8740 10 client.26797 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60b19e8740 1 -- 172.21.15.53:0/2712471892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cf4b2843a0 con 0x55cf4ae334d0 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60837fe640 1 -- 172.21.15.53:0/2712471892 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f609802f040 con 0x55cf4ae334d0 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60837fe640 1 -- 172.21.15.53:0/2712471892 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6094019600 con 0x55cf4ae334d0 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60b19e8740 10 client.26797 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60b19e8740 10 client.26797 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60b19e8740 20 client.26797 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf4ade81c0 0x55cf4b2868e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60b19e8740 4 client.26797 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.356+0000 7f60b19e8740 1 -- 172.21.15.53:0/2712471892 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cf4b16a9f0 con 0x55cf4ade81c0 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.357+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf4ade81c0 0x55cf4b2868e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.357+0000 7f60837fe640 10 client.26797 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:41.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.357+0000 7f60a37fe640 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf4ade81c0 0x55cf4b2868e0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f53831d6a3c2f92c server_cookie=26d9029a471039a9 in_seq=0 out_seq=0 2024-08-31T06:10:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60837fe640 1 -- 172.21.15.53:0/2712471892 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cf4b16a9f0 con 0x55cf4ade81c0 2024-08-31T06:10:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60837fe640 10 client.26797 handle_command_reply: tid=0 2024-08-31T06:10:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60b19e8740 1 client.26797 shutdown 2024-08-31T06:10:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60b19e8740 1 -- 172.21.15.53:0/2712471892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 msgr2=0x55cf4b20f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 0x55cf4b20f560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6094014040 tx=0x7f6094009ec0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60b19e8740 1 -- 172.21.15.53:0/2712471892 shutdown_connections 2024-08-31T06:10:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf4ade81c0 0x55cf4b2868e0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf4ae541b0 0x55cf4b20faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60837fe640 0 client.26797 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf4ae334d0 0x55cf4b20f560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60b19e8740 1 --2- 172.21.15.53:0/2712471892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf4ae2b2f0 0x55cf4b2120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60b19e8740 1 -- 172.21.15.53:0/2712471892 >> 172.21.15.53:0/2712471892 conn(0x55cf4ae48300 msgr2=0x55cf4b1fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60b19e8740 1 -- 172.21.15.53:0/2712471892 shutdown_connections 2024-08-31T06:10:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.373+0000 7f60b19e8740 1 -- 172.21.15.53:0/2712471892 wait complete. 2024-08-31T06:10:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60b19e8740 20 client.26797 trim_cache size 0 max 16384 2024-08-31T06:10:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:10:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:10:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:10:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:10:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 -- 172.21.15.53:0/2767710682 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f608c0b4ca0 msgr2=0x7f608c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f608c0b4ca0 0x7f608c0b71b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f609c0cccb0 tx=0x7f609c0c8f50 comp rx=0 tx=0).stop 2024-08-31T06:10:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 -- 172.21.15.53:0/2767710682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a41089d0 msgr2=0x7f60a419e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a41089d0 0x7f60a419e7d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f609c005cc0 tx=0x7f609c003f90 comp rx=0 tx=0).stop 2024-08-31T06:10:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 -- 172.21.15.53:0/2767710682 shutdown_connections 2024-08-31T06:10:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f608c0b4ca0 0x7f608c0b71b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60a41089d0 0x7f60a419e7d0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a4108080 0x7f60a4199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 --2- 172.21.15.53:0/2767710682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60a4102750 0x7f60a4198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 -- 172.21.15.53:0/2767710682 >> 172.21.15.53:0/2767710682 conn(0x7f60a407a4e0 msgr2=0x7f60a4106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 -- 172.21.15.53:0/2767710682 shutdown_connections 2024-08-31T06:10:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:41.374+0000 7f60aa99f640 1 -- 172.21.15.53:0/2767710682 wait complete. 2024-08-31T06:10:41.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 99005 1.66 MB/sec execute 151 sec latency 19.273 ms 2024-08-31T06:10:42.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:42 smithi130 ceph-mon[22266]: pgmap v495: 97 pgs: 97 active+clean; 56 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 161 KiB/s wr, 26 op/s 2024-08-31T06:10:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:42 smithi153 ceph-mon[22320]: pgmap v495: 97 pgs: 97 active+clean; 56 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 161 KiB/s wr, 26 op/s 2024-08-31T06:10:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:42 smithi053 ceph-mon[18924]: pgmap v495: 97 pgs: 97 active+clean; 56 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 161 KiB/s wr, 26 op/s 2024-08-31T06:10:42.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 99441 1.67 MB/sec execute 152 sec latency 14.545 ms 2024-08-31T06:10:43.246 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:10:43.514 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:10:43.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 99751 1.67 MB/sec execute 153 sec latency 14.183 ms 2024-08-31T06:10:44.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.026+0000 7f1a6c514640 1 -- 172.21.15.53:0/1121223043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64102820 msgr2=0x7f1a64102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:44.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.026+0000 7f1a6c514640 1 --2- 172.21.15.53:0/1121223043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64102820 0x7f1a64102c30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009900 tx=0x7f1a6002a410 comp rx=0 tx=0).stop 2024-08-31T06:10:44.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.026+0000 7f1a6c514640 1 -- 172.21.15.53:0/1121223043 shutdown_connections 2024-08-31T06:10:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.026+0000 7f1a6c514640 1 --2- 172.21.15.53:0/1121223043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108ab0 0x7f1a6410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.026+0000 7f1a6c514640 1 --2- 172.21.15.53:0/1121223043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64108160 0x7f1a64108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.026+0000 7f1a6c514640 1 --2- 172.21.15.53:0/1121223043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64102820 0x7f1a64102c30 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.026+0000 7f1a6c514640 1 -- 172.21.15.53:0/1121223043 >> 172.21.15.53:0/1121223043 conn(0x7f1a640794e0 msgr2=0x7f1a640798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.026+0000 7f1a6c514640 1 -- 172.21.15.53:0/1121223043 shutdown_connections 2024-08-31T06:10:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.026+0000 7f1a6c514640 1 -- 172.21.15.53:0/1121223043 wait complete. 2024-08-31T06:10:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6c514640 1 Processor -- start 2024-08-31T06:10:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6c514640 1 -- start start 2024-08-31T06:10:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6c514640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64102820 0x7f1a6419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6c514640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108160 0x7f1a6419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6c514640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64108ab0 0x7f1a6419f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6c514640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1a641136e0 con 0x7f1a64108ab0 2024-08-31T06:10:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6c514640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64113560 con 0x7f1a64102820 2024-08-31T06:10:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6c514640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64113860 con 0x7f1a64108160 2024-08-31T06:10:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6aab1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64108ab0 0x7f1a6419f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6a2b0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64102820 0x7f1a6419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6aab1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64108ab0 0x7f1a6419f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50698/0 (socket says 172.21.15.53:50698) 2024-08-31T06:10:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6aab1640 1 -- 172.21.15.53:0/316324247 learned_addr learned my addr 172.21.15.53:0/316324247 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108160 0x7f1a6419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6aab1640 1 -- 172.21.15.53:0/316324247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108160 msgr2=0x7f1a6419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6aab1640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108160 0x7f1a6419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6aab1640 1 -- 172.21.15.53:0/316324247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64102820 msgr2=0x7f1a6419a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6aab1640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64102820 0x7f1a6419a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.027+0000 7f1a6aab1640 1 -- 172.21.15.53:0/316324247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a641a0100 con 0x7f1a64108ab0 2024-08-31T06:10:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.028+0000 7f1a6aab1640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64108ab0 0x7f1a6419f9d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00eb10 tx=0x7f1a5c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.028+0000 7f1a5b7fe640 1 -- 172.21.15.53:0/316324247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c004b20 con 0x7f1a64108ab0 2024-08-31T06:10:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.028+0000 7f1a6c514640 1 -- 172.21.15.53:0/316324247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a641a03f0 con 0x7f1a64108ab0 2024-08-31T06:10:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.028+0000 7f1a5b7fe640 1 -- 172.21.15.53:0/316324247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a5c004cc0 con 0x7f1a64108ab0 2024-08-31T06:10:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.028+0000 7f1a5b7fe640 1 -- 172.21.15.53:0/316324247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c010690 con 0x7f1a64108ab0 2024-08-31T06:10:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.028+0000 7f1a6c514640 1 -- 172.21.15.53:0/316324247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a641a6b50 con 0x7f1a64108ab0 2024-08-31T06:10:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.031+0000 7f1a72a89740 1 Processor -- start 2024-08-31T06:10:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.031+0000 7f1a5b7fe640 1 -- 172.21.15.53:0/316324247 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1a5c005020 con 0x7f1a64108ab0 2024-08-31T06:10:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.031+0000 7f1a72a89740 1 -- start start 2024-08-31T06:10:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ecb5070 0x564a6f05a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec8c1b0 0x564a6f05a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ec94390 0x564a6f05ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a72a89740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564a6efd1630 con 0x564a6ecb5070 2024-08-31T06:10:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a72a89740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564a6efc0bc0 con 0x564a6ec8c1b0 2024-08-31T06:10:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a72a89740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564a6efc4b70 con 0x564a6ec94390 2024-08-31T06:10:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a69aaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ecb5070 0x564a6f05a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a6a2b0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec8c1b0 0x564a6f05a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a69aaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ecb5070 0x564a6f05a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50706/0 (socket says 172.21.15.53:50706) 2024-08-31T06:10:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a69aaf640 1 -- 172.21.15.53:0/3229380244 learned_addr learned my addr 172.21.15.53:0/3229380244 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a6a2b0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec8c1b0 0x564a6f05a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60746/0 (socket says 172.21.15.53:60746) 2024-08-31T06:10:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/3229380244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ec94390 0x564a6f05ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a5b7fe640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a500b4ca0 0x7f1a500b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a69aaf640 1 -- 172.21.15.53:0/3229380244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ec94390 msgr2=0x564a6f05ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:44.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/3229380244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ec94390 0x564a6f05ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a69aaf640 1 -- 172.21.15.53:0/3229380244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec8c1b0 msgr2=0x564a6f05a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:44.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/3229380244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec8c1b0 0x564a6f05a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a69aaf640 1 -- 172.21.15.53:0/3229380244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a6ed20650 con 0x564a6ecb5070 2024-08-31T06:10:44.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a5b7fe640 1 -- 172.21.15.53:0/316324247 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1a5c0e5a30 con 0x7f1a64108ab0 2024-08-31T06:10:44.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.032+0000 7f1a6aab1640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a500b4ca0 0x7f1a500b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.033+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/3229380244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ecb5070 0x564a6f05a2c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f1a540137c0 tx=0x7f1a540097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e2866a1c4373d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:44.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.033+0000 7f1a58ff9640 1 -- 172.21.15.53:0/3229380244 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54013d40 con 0x564a6ecb5070 2024-08-31T06:10:44.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.033+0000 7f1a58ff9640 1 -- 172.21.15.53:0/3229380244 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a540044c0 con 0x564a6ecb5070 2024-08-31T06:10:44.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.033+0000 7f1a58ff9640 1 -- 172.21.15.53:0/3229380244 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54004a00 con 0x564a6ecb5070 2024-08-31T06:10:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.034+0000 7f1a72a89740 1 -- 172.21.15.53:0/3229380244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ecb5070 msgr2=0x564a6f05a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.034+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3229380244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ecb5070 0x564a6f05a2c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f1a540137c0 tx=0x7f1a540097a0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.034+0000 7f1a6aab1640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a500b4ca0 0x7f1a500b71b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0e31e0 tx=0x7f1a5c00cf70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.034+0000 7f1a72a89740 1 -- 172.21.15.53:0/3229380244 shutdown_connections 2024-08-31T06:10:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.034+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3229380244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ec94390 0x564a6f05ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.034+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3229380244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec8c1b0 0x564a6f05a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.034+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3229380244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ecb5070 0x564a6f05a2c0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.034+0000 7f1a72a89740 1 -- 172.21.15.53:0/3229380244 >> 172.21.15.53:0/3229380244 conn(0x564a6eca9460 msgr2=0x564a6f0581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.034+0000 7f1a72a89740 1 -- 172.21.15.53:0/3229380244 shutdown_connections 2024-08-31T06:10:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.034+0000 7f1a72a89740 1 -- 172.21.15.53:0/3229380244 wait complete. 2024-08-31T06:10:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a72a89740 1 -- start start 2024-08-31T06:10:44.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a72a89740 1 Processor -- start 2024-08-31T06:10:44.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f069d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ec94390 0x564a6f06a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ecb5070 0x564a6f076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a72a89740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564a6ee23700 con 0x564a6ec8c1b0 2024-08-31T06:10:44.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a72a89740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564a6ef47700 con 0x564a6ecb5070 2024-08-31T06:10:44.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a72a89740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564a6f06cda0 con 0x564a6ec94390 2024-08-31T06:10:44.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a72a89740 10 client.0 _ll_register_callbacks cb 0x564a6ef76dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:44.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a69aaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f069d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a6a2b0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ec94390 0x564a6f06a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a69aaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f069d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50716/0 (socket says 172.21.15.53:50716) 2024-08-31T06:10:44.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a69aaf640 1 -- 172.21.15.53:0/3678752120 learned_addr learned my addr 172.21.15.53:0/3678752120 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:44.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.035+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ecb5070 0x564a6f076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a6a2b0640 1 -- 172.21.15.53:0/3678752120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ecb5070 msgr2=0x564a6f076100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:44.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a6a2b0640 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ecb5070 0x564a6f076100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a6a2b0640 1 -- 172.21.15.53:0/3678752120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 msgr2=0x564a6f069d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:44.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a6a2b0640 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f069d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a6a2b0640 1 -- 172.21.15.53:0/3678752120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a6ef808b0 con 0x564a6ec94390 2024-08-31T06:10:44.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a6a2b0640 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ec94390 0x564a6f06a2a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1a60005940 tx=0x7f1a60031de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d14a8ee1a6c56ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:44.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:10:44.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a4dffb640 1 -- 172.21.15.53:0/3678752120 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60035040 con 0x564a6ec94390 2024-08-31T06:10:44.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a72a89740 1 -- 172.21.15.53:0/3678752120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a6efd3580 con 0x564a6ec94390 2024-08-31T06:10:44.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a4dffb640 1 -- 172.21.15.53:0/3678752120 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1a60004040 con 0x564a6ec94390 2024-08-31T06:10:44.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a4dffb640 1 -- 172.21.15.53:0/3678752120 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1a60004240 con 0x564a6ec94390 2024-08-31T06:10:44.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a72a89740 10 client.26809 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:44.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a72a89740 1 -- 172.21.15.53:0/3678752120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564a6f078b10 con 0x564a6ec94390 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.036+0000 7f1a4dffb640 1 -- 172.21.15.53:0/3678752120 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564a6efd3580 con 0x564a6ec94390 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.037+0000 7f1a4dffb640 1 -- 172.21.15.53:0/3678752120 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f1a6004f480 con 0x564a6ec94390 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.037+0000 7f1a72a89740 10 client.26809 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.037+0000 7f1a72a89740 10 client.26809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.037+0000 7f1a72a89740 20 client.26809 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.037+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a6ec739f0 0x564a6f07bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.037+0000 7f1a72a89740 4 client.26809 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.037+0000 7f1a72a89740 1 -- 172.21.15.53:0/3678752120 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a6efcf020 con 0x564a6ec739f0 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.037+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a6ec739f0 0x564a6f07bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.037+0000 7f1a4dffb640 10 client.26809 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.037+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a6ec739f0 0x564a6f07bf80 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a17a42973d6d3779 server_cookie=95dada09ced88a26 in_seq=0 out_seq=0 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.038+0000 7f1a4dffb640 1 -- 172.21.15.53:0/3678752120 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a6efcf020 con 0x564a6ec739f0 2024-08-31T06:10:44.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.038+0000 7f1a4dffb640 10 client.26809 handle_command_reply: tid=0 2024-08-31T06:10:44.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.038+0000 7f1a72a89740 1 client.26809 shutdown 2024-08-31T06:10:44.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a72a89740 1 -- 172.21.15.53:0/3678752120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ec94390 msgr2=0x564a6f06a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:44.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ec94390 0x564a6f06a2a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1a60005940 tx=0x7f1a60031de0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a72a89740 1 -- 172.21.15.53:0/3678752120 shutdown_connections 2024-08-31T06:10:44.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a6ec739f0 0x564a6f07bf80 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ecb5070 0x564a6f076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ec94390 0x564a6f06a2a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a4dffb640 0 client.26809 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:44.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3678752120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f069d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a72a89740 1 -- 172.21.15.53:0/3678752120 >> 172.21.15.53:0/3678752120 conn(0x564a6eca9460 msgr2=0x564a6f056770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:44.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a72a89740 1 -- 172.21.15.53:0/3678752120 shutdown_connections 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a72a89740 1 -- 172.21.15.53:0/3678752120 wait complete. 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.039+0000 7f1a72a89740 20 client.26809 trim_cache size 0 max 16384 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a72a89740 1 Processor -- start 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a72a89740 1 -- start start 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f058200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec94390 0x564a6f066f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ecb5070 0x564a6f067490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a72a89740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1a641ad210 con 0x564a6ec8c1b0 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a72a89740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a641aedb0 con 0x564a6ec94390 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a72a89740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a641ad8e0 con 0x564a6ecb5070 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a69aaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f058200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a69aaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f058200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50724/0 (socket says 172.21.15.53:50724) 2024-08-31T06:10:44.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a69aaf640 1 -- 172.21.15.53:0/3905363050 learned_addr learned my addr 172.21.15.53:0/3905363050 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a6a2b0640 1 --2- 172.21.15.53:0/3905363050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec94390 0x564a6f066f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.059+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/3905363050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ecb5070 0x564a6f067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.060+0000 7f1a69aaf640 1 -- 172.21.15.53:0/3905363050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ecb5070 msgr2=0x564a6f067490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.060+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/3905363050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ecb5070 0x564a6f067490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.060+0000 7f1a69aaf640 1 -- 172.21.15.53:0/3905363050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec94390 msgr2=0x564a6f066f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.060+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/3905363050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec94390 0x564a6f066f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.060+0000 7f1a69aaf640 1 -- 172.21.15.53:0/3905363050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a6f0522f0 con 0x564a6ec8c1b0 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.060+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/3905363050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f058200 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x564a6f07c720 tx=0x7f1a54009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb396b5e608e283c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.060+0000 7f1a4ffff640 1 -- 172.21.15.53:0/3905363050 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54011860 con 0x564a6ec8c1b0 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.060+0000 7f1a4ffff640 1 -- 172.21.15.53:0/3905363050 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a54017040 con 0x564a6ec8c1b0 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.060+0000 7f1a4ffff640 1 -- 172.21.15.53:0/3905363050 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54004cf0 con 0x564a6ec8c1b0 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.061+0000 7f1a72a89740 1 -- 172.21.15.53:0/3905363050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 msgr2=0x564a6f058200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:44.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.061+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3905363050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f058200 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x564a6f07c720 tx=0x7f1a54009bc0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.061+0000 7f1a72a89740 1 -- 172.21.15.53:0/3905363050 shutdown_connections 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.061+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3905363050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ecb5070 0x564a6f067490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.061+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3905363050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec94390 0x564a6f066f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.061+0000 7f1a72a89740 1 --2- 172.21.15.53:0/3905363050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f058200 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.061+0000 7f1a72a89740 1 -- 172.21.15.53:0/3905363050 >> 172.21.15.53:0/3905363050 conn(0x564a6eca9460 msgr2=0x564a6f057af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.061+0000 7f1a72a89740 1 -- 172.21.15.53:0/3905363050 shutdown_connections 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.061+0000 7f1a72a89740 1 -- 172.21.15.53:0/3905363050 wait complete. 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.061+0000 7f1a72a89740 1 -- start start 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a72a89740 1 Processor -- start 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f0724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec94390 0x564a6f072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a72a89740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ecb5070 0x564a6f06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a72a89740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1a641ae6e0 con 0x564a6ec8c1b0 2024-08-31T06:10:44.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a72a89740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a641adfb0 con 0x564a6ec94390 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a72a89740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a641ab1f0 con 0x564a6ecb5070 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a72a89740 10 client.0 _ll_register_callbacks cb 0x7f1a60009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a69aaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f0724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a69aaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f0724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50728/0 (socket says 172.21.15.53:50728) 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a69aaf640 1 -- 172.21.15.53:0/2994860089 learned_addr learned my addr 172.21.15.53:0/2994860089 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a6a2b0640 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec94390 0x564a6f072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ecb5070 0x564a6f06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a69aaf640 1 -- 172.21.15.53:0/2994860089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ecb5070 msgr2=0x564a6f06d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ecb5070 0x564a6f06d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a69aaf640 1 -- 172.21.15.53:0/2994860089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec94390 msgr2=0x564a6f072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec94390 0x564a6f072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a69aaf640 1 -- 172.21.15.53:0/2994860089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a6f06d960 con 0x564a6ec8c1b0 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a69aaf640 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f0724d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009950 tx=0x7f1a54013590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92283657d3711ee7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.062+0000 7f1a4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a4dffb640 1 -- 172.21.15.53:0/2994860089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54046060 con 0x564a6ec8c1b0 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a4dffb640 1 -- 172.21.15.53:0/2994860089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f1a54004b70 con 0x564a6ec8c1b0 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a72a89740 1 -- 172.21.15.53:0/2994860089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a54017040 con 0x564a6ec8c1b0 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a4dffb640 1 -- 172.21.15.53:0/2994860089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1a5403a040 con 0x564a6ec8c1b0 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a72a89740 10 client.17493 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a72a89740 1 -- 172.21.15.53:0/2994860089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564a6f0e7550 con 0x564a6ec8c1b0 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a4dffb640 1 -- 172.21.15.53:0/2994860089 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a54017040 con 0x564a6ec8c1b0 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a4dffb640 1 -- 172.21.15.53:0/2994860089 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f1a54040030 con 0x564a6ec8c1b0 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a72a89740 10 client.17493 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a72a89740 10 client.17493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a72a89740 20 client.17493 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:44.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a72a89740 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a6ec48da0 0x564a6f0e9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a72a89740 4 client.17493 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.063+0000 7f1a72a89740 1 -- 172.21.15.53:0/2994860089 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564a6efcc760 con 0x564a6ec48da0 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.064+0000 7f1a6a2b0640 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a6ec48da0 0x564a6f0e9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.064+0000 7f1a4dffb640 10 client.17493 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.064+0000 7f1a6a2b0640 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a6ec48da0 0x564a6f0e9a30 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8cefd6c77872555 server_cookie=b1e59436e737c091 in_seq=0 out_seq=0 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.064+0000 7f1a4dffb640 1 -- 172.21.15.53:0/2994860089 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x564a6efcc760 con 0x564a6ec48da0 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.064+0000 7f1a4dffb640 10 client.17493 handle_command_reply: tid=0 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.064+0000 7f1a72a89740 1 client.17493 shutdown 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a72a89740 1 -- 172.21.15.53:0/2994860089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 msgr2=0x564a6f0724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a72a89740 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f0724d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009950 tx=0x7f1a54013590 comp rx=0 tx=0).stop 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a72a89740 1 -- 172.21.15.53:0/2994860089 shutdown_connections 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a72a89740 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a6ec48da0 0x564a6f0e9a30 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a72a89740 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a6ecb5070 0x564a6f06d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a72a89740 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a6ec94390 0x564a6f072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a72a89740 1 --2- 172.21.15.53:0/2994860089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a6ec8c1b0 0x564a6f0724d0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a72a89740 1 -- 172.21.15.53:0/2994860089 >> 172.21.15.53:0/2994860089 conn(0x564a6eca9460 msgr2=0x564a6f05b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:44.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a4dffb640 0 client.17493 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:44.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a72a89740 1 -- 172.21.15.53:0/2994860089 shutdown_connections 2024-08-31T06:10:44.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a72a89740 1 -- 172.21.15.53:0/2994860089 wait complete. 2024-08-31T06:10:44.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a72a89740 20 client.17493 trim_cache size 0 max 16384 2024-08-31T06:10:44.086 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "3e7cb90c-5b9b-4a75-b575-b69641d835a2", 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:44.087 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:44.088 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:10:44.089 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:10:44.089 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:44.089 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:44.089 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:44.089 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:44.089 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:44.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:44.089 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:10:44.089 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:10:44.089 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:44.089 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:44.090 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:44.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:44.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:10:44.092 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:10:44.092 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:10:44.092 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:10:44.092 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:10:44.092 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:10:44.092 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:10:44.092 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:10:44.092 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:44.092 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:10:44.092 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:10:44.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.065+0000 7f1a6c514640 1 -- 172.21.15.53:0/316324247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a500b4ca0 msgr2=0x7f1a500b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:44.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.066+0000 7f1a6c514640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a500b4ca0 0x7f1a500b71b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0e31e0 tx=0x7f1a5c00cf70 comp rx=0 tx=0).stop 2024-08-31T06:10:44.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.066+0000 7f1a6c514640 1 -- 172.21.15.53:0/316324247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64108ab0 msgr2=0x7f1a6419f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:44.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.066+0000 7f1a6c514640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64108ab0 0x7f1a6419f9d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00eb10 tx=0x7f1a5c00c2d0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.066+0000 7f1a6c514640 1 -- 172.21.15.53:0/316324247 shutdown_connections 2024-08-31T06:10:44.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.066+0000 7f1a6c514640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1a500b4ca0 0x7f1a500b71b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.066+0000 7f1a6c514640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a64108ab0 0x7f1a6419f9d0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.066+0000 7f1a6c514640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a64108160 0x7f1a6419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.066+0000 7f1a6c514640 1 --2- 172.21.15.53:0/316324247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a64102820 0x7f1a6419a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:44.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.066+0000 7f1a6c514640 1 -- 172.21.15.53:0/316324247 >> 172.21.15.53:0/316324247 conn(0x7f1a640794e0 msgr2=0x7f1a64101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:44.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.066+0000 7f1a6c514640 1 -- 172.21.15.53:0/316324247 shutdown_connections 2024-08-31T06:10:44.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:10:44.066+0000 7f1a6c514640 1 -- 172.21.15.53:0/316324247 wait complete. 2024-08-31T06:10:44.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:44 smithi053 ceph-mon[18924]: pgmap v496: 97 pgs: 97 active+clean; 57 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 282 KiB/s wr, 41 op/s 2024-08-31T06:10:44.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:44 smithi130 ceph-mon[22266]: pgmap v496: 97 pgs: 97 active+clean; 57 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 282 KiB/s wr, 41 op/s 2024-08-31T06:10:44.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:44 smithi153 ceph-mon[22320]: pgmap v496: 97 pgs: 97 active+clean; 57 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 282 KiB/s wr, 41 op/s 2024-08-31T06:10:44.943 INFO:tasks.cephfs.filesystem:scrub status for tag:3e7cb90c-5b9b-4a75-b575-b69641d835a2 - {'path': '/', 'tag': '3e7cb90c-5b9b-4a75-b575-b69641d835a2', 'options': 'recursive,force'} 2024-08-31T06:10:44.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 100056 1.66 MB/sec execute 154 sec latency 17.344 ms 2024-08-31T06:10:45.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:45 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:10:45.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:45 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:10:45.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:45 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:10:45.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 100560 1.66 MB/sec execute 155 sec latency 19.335 ms 2024-08-31T06:10:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:46 smithi130 ceph-mon[22266]: pgmap v497: 97 pgs: 97 active+clean; 58 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 440 KiB/s wr, 50 op/s 2024-08-31T06:10:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:10:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:10:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:10:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:46 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:10:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:46 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:10:46.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:46 smithi153 ceph-mon[22320]: pgmap v497: 97 pgs: 97 active+clean; 58 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 440 KiB/s wr, 50 op/s 2024-08-31T06:10:46.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:10:46.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:10:46.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:10:46.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:46 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:10:46.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:46 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:10:46.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:46 smithi053 ceph-mon[18924]: pgmap v497: 97 pgs: 97 active+clean; 58 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 440 KiB/s wr, 50 op/s 2024-08-31T06:10:46.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:10:46.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:10:46.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:10:46.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:46 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:10:46.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:46 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:10:46.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 101066 1.67 MB/sec execute 156 sec latency 21.281 ms 2024-08-31T06:10:47.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:47 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:10:47.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:47 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:10:47.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:47 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:10:47.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:47 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:10:47.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:47 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:10:47.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:47 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:10:47.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 101695 1.67 MB/sec execute 157 sec latency 21.741 ms 2024-08-31T06:10:48.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:48 smithi130 ceph-mon[22266]: pgmap v498: 97 pgs: 97 active+clean; 60 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 864 KiB/s wr, 97 op/s 2024-08-31T06:10:48.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:48 smithi153 ceph-mon[22320]: pgmap v498: 97 pgs: 97 active+clean; 60 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 864 KiB/s wr, 97 op/s 2024-08-31T06:10:48.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:48 smithi053 ceph-mon[18924]: pgmap v498: 97 pgs: 97 active+clean; 60 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 864 KiB/s wr, 97 op/s 2024-08-31T06:10:48.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 102274 1.70 MB/sec execute 158 sec latency 17.947 ms 2024-08-31T06:10:49.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 102723 1.70 MB/sec execute 159 sec latency 14.688 ms 2024-08-31T06:10:50.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:50 smithi130 ceph-mon[22266]: pgmap v499: 97 pgs: 97 active+clean; 61 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 985 KiB/s wr, 103 op/s 2024-08-31T06:10:50.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:50 smithi153 ceph-mon[22320]: pgmap v499: 97 pgs: 97 active+clean; 61 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 985 KiB/s wr, 103 op/s 2024-08-31T06:10:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:50 smithi053 ceph-mon[18924]: pgmap v499: 97 pgs: 97 active+clean; 61 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 985 KiB/s wr, 103 op/s 2024-08-31T06:10:50.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 103204 1.72 MB/sec execute 160 sec latency 13.059 ms 2024-08-31T06:10:51.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 103487 1.71 MB/sec execute 161 sec latency 14.313 ms 2024-08-31T06:10:52.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:52 smithi130 ceph-mon[22266]: pgmap v500: 97 pgs: 97 active+clean; 63 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.4 MiB/s wr, 150 op/s 2024-08-31T06:10:52.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:52 smithi153 ceph-mon[22320]: pgmap v500: 97 pgs: 97 active+clean; 63 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.4 MiB/s wr, 150 op/s 2024-08-31T06:10:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:52 smithi053 ceph-mon[18924]: pgmap v500: 97 pgs: 97 active+clean; 63 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.4 MiB/s wr, 150 op/s 2024-08-31T06:10:52.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 103978 1.71 MB/sec execute 162 sec latency 18.081 ms 2024-08-31T06:10:53.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 104476 1.72 MB/sec execute 163 sec latency 24.245 ms 2024-08-31T06:10:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:54 smithi130 ceph-mon[22266]: pgmap v501: 97 pgs: 97 active+clean; 63 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.4 MiB/s wr, 139 op/s 2024-08-31T06:10:54.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:54 smithi153 ceph-mon[22320]: pgmap v501: 97 pgs: 97 active+clean; 63 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.4 MiB/s wr, 139 op/s 2024-08-31T06:10:54.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:54 smithi053 ceph-mon[18924]: pgmap v501: 97 pgs: 97 active+clean; 63 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.4 MiB/s wr, 139 op/s 2024-08-31T06:10:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.484+0000 7f7848119640 1 -- 172.21.15.53:0/1549118685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7840108080 msgr2=0x7f7840108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.484+0000 7f7848119640 1 --2- 172.21.15.53:0/1549118685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7840108080 0x7f7840108490 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f7830009900 tx=0x7f783002a410 comp rx=0 tx=0).stop 2024-08-31T06:10:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.484+0000 7f7848119640 1 -- 172.21.15.53:0/1549118685 shutdown_connections 2024-08-31T06:10:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.484+0000 7f7848119640 1 --2- 172.21.15.53:0/1549118685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78401089d0 0x7f784010f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.484+0000 7f7848119640 1 --2- 172.21.15.53:0/1549118685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7840108080 0x7f7840108490 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.484+0000 7f7848119640 1 --2- 172.21.15.53:0/1549118685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7840102750 0x7f7840102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.484+0000 7f7848119640 1 -- 172.21.15.53:0/1549118685 >> 172.21.15.53:0/1549118685 conn(0x7f784007a4e0 msgr2=0x7f784007a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.484+0000 7f7848119640 1 -- 172.21.15.53:0/1549118685 shutdown_connections 2024-08-31T06:10:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.484+0000 7f7848119640 1 -- 172.21.15.53:0/1549118685 wait complete. 2024-08-31T06:10:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.484+0000 7f7848119640 1 Processor -- start 2024-08-31T06:10:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.484+0000 7f7848119640 1 -- start start 2024-08-31T06:10:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f7848119640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7840102750 0x7f7840199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f7848119640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7840108080 0x7f7840199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f7848119640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78401089d0 0x7f784019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f7848119640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f78401124f0 con 0x7f7840108080 2024-08-31T06:10:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f7848119640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7840112370 con 0x7f7840102750 2024-08-31T06:10:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f7848119640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7840112670 con 0x7f78401089d0 2024-08-31T06:10:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f78456b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7840108080 0x7f7840199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f78456b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7840108080 0x7f7840199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40124/0 (socket says 172.21.15.53:40124) 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f78456b4640 1 -- 172.21.15.53:0/1163330484 learned_addr learned my addr 172.21.15.53:0/1163330484 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f7845eb5640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7840102750 0x7f7840199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f78466b6640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78401089d0 0x7f784019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f78456b4640 1 -- 172.21.15.53:0/1163330484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78401089d0 msgr2=0x7f784019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f78456b4640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78401089d0 0x7f784019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f78456b4640 1 -- 172.21.15.53:0/1163330484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7840102750 msgr2=0x7f7840199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f78456b4640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7840102750 0x7f7840199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f78456b4640 1 -- 172.21.15.53:0/1163330484 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784019ef30 con 0x7f7840108080 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f78456b4640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7840108080 0x7f7840199630 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f7830005940 tx=0x7f7830004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.485+0000 7f7836ffd640 1 -- 172.21.15.53:0/1163330484 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830046070 con 0x7f7840108080 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.486+0000 7f7836ffd640 1 -- 172.21.15.53:0/1163330484 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7830004460 con 0x7f7840108080 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.486+0000 7f7836ffd640 1 -- 172.21.15.53:0/1163330484 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830035050 con 0x7f7840108080 2024-08-31T06:10:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.486+0000 7f7848119640 1 -- 172.21.15.53:0/1163330484 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784019f1c0 con 0x7f7840108080 2024-08-31T06:10:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.486+0000 7f7848119640 1 -- 172.21.15.53:0/1163330484 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784019f660 con 0x7f7840108080 2024-08-31T06:10:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.488+0000 7f784f086740 1 Processor -- start 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.488+0000 7f784f086740 1 -- start start 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f784f086740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629118b61b0 0x562911c59ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f784f086740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56291188d2f0 0x562911c5a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f7836ffd640 1 -- 172.21.15.53:0/1163330484 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7830049070 con 0x7f7840108080 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f784f086740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911c5a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f784f086740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562911bcf000 con 0x5629118b61b0 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f784f086740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562911bbe590 con 0x56291188d2f0 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f784f086740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562911bc2540 con 0x5629118954d0 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f78466b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629118b61b0 0x562911c59ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f7845eb5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56291188d2f0 0x562911c5a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f78466b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629118b61b0 0x562911c59ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40136/0 (socket says 172.21.15.53:40136) 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f78466b6640 1 -- 172.21.15.53:0/1665118945 learned_addr learned my addr 172.21.15.53:0/1665118945 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f78456b4640 1 --2- 172.21.15.53:0/1665118945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911c5a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f7845eb5640 1 -- 172.21.15.53:0/1665118945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 msgr2=0x562911c5a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f7845eb5640 1 --2- 172.21.15.53:0/1665118945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911c5a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f7845eb5640 1 -- 172.21.15.53:0/1665118945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629118b61b0 msgr2=0x562911c59ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f7845eb5640 1 --2- 172.21.15.53:0/1665118945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629118b61b0 0x562911c59ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.489+0000 7f7845eb5640 1 -- 172.21.15.53:0/1665118945 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562911921790 con 0x56291188d2f0 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.490+0000 7f7845eb5640 1 --2- 172.21.15.53:0/1665118945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56291188d2f0 0x562911c5a000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f783c00ac20 tx=0x7f783c00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=988bd62527037f5c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.490+0000 7f7836ffd640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f782c0b4ca0 0x7f782c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.490+0000 7f782bfff640 1 -- 172.21.15.53:0/1665118945 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c005220 con 0x56291188d2f0 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.490+0000 7f78466b6640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f782c0b4ca0 0x7f782c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.490+0000 7f782bfff640 1 -- 172.21.15.53:0/1665118945 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f783c0047a0 con 0x56291188d2f0 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.490+0000 7f782bfff640 1 -- 172.21.15.53:0/1665118945 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c0186a0 con 0x56291188d2f0 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.490+0000 7f7836ffd640 1 -- 172.21.15.53:0/1163330484 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7830107000 con 0x7f7840108080 2024-08-31T06:10:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f784f086740 1 -- 172.21.15.53:0/1665118945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56291188d2f0 msgr2=0x562911c5a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f78466b6640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f782c0b4ca0 0x7f782c0b71b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7838005f40 tx=0x7f78380096a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f784f086740 1 --2- 172.21.15.53:0/1665118945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56291188d2f0 0x562911c5a000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f783c00ac20 tx=0x7f783c00f790 comp rx=0 tx=0).stop 2024-08-31T06:10:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f784f086740 1 -- 172.21.15.53:0/1665118945 shutdown_connections 2024-08-31T06:10:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f784f086740 1 --2- 172.21.15.53:0/1665118945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911c5a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f784f086740 1 --2- 172.21.15.53:0/1665118945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56291188d2f0 0x562911c5a000 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f784f086740 1 --2- 172.21.15.53:0/1665118945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629118b61b0 0x562911c59ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f784f086740 1 -- 172.21.15.53:0/1665118945 >> 172.21.15.53:0/1665118945 conn(0x5629118aa300 msgr2=0x562911c579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f784f086740 1 -- 172.21.15.53:0/1665118945 shutdown_connections 2024-08-31T06:10:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f784f086740 1 -- 172.21.15.53:0/1665118945 wait complete. 2024-08-31T06:10:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f784f086740 1 -- start start 2024-08-31T06:10:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.491+0000 7f784f086740 1 Processor -- start 2024-08-31T06:10:54.500 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f784f086740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c65670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.500 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f784f086740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911c65bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.500 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f784f086740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118b61b0 0x562911c71590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.500 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f784f086740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562911af7ab0 con 0x56291188d2f0 2024-08-31T06:10:54.500 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f784f086740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562911b45680 con 0x5629118b61b0 2024-08-31T06:10:54.500 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f784f086740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562911c68240 con 0x5629118954d0 2024-08-31T06:10:54.500 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f784f086740 10 client.0 _ll_register_callbacks cb 0x5629118cda00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f7845eb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c65670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f7845eb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c65670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40150/0 (socket says 172.21.15.53:40150) 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f7845eb5640 1 -- 172.21.15.53:0/2950053250 learned_addr learned my addr 172.21.15.53:0/2950053250 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f78456b4640 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911c65bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.492+0000 7f78466b6640 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118b61b0 0x562911c71590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f7845eb5640 1 -- 172.21.15.53:0/2950053250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 msgr2=0x562911c65bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f7845eb5640 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911c65bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f7845eb5640 1 -- 172.21.15.53:0/2950053250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118b61b0 msgr2=0x562911c71590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f7845eb5640 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118b61b0 0x562911c71590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f7845eb5640 1 -- 172.21.15.53:0/2950053250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56291199a620 con 0x56291188d2f0 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f78456b4640 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911c65bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f7845eb5640 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c65670 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f783c005130 tx=0x7f783c005160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c581d7a188e35444 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f78297fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f78297fa640 1 -- 172.21.15.53:0/2950053250 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c026070 con 0x56291188d2f0 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f78297fa640 1 -- 172.21.15.53:0/2950053250 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f783c018440 con 0x56291188d2f0 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f784f086740 1 -- 172.21.15.53:0/2950053250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f783c0047a0 con 0x56291188d2f0 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f78297fa640 1 -- 172.21.15.53:0/2950053250 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f783c032050 con 0x56291188d2f0 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f784f086740 10 client.17505 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f784f086740 1 -- 172.21.15.53:0/2950053250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562911c74260 con 0x56291188d2f0 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.493+0000 7f78297fa640 1 -- 172.21.15.53:0/2950053250 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f783c0047a0 con 0x56291188d2f0 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.494+0000 7f78297fa640 1 -- 172.21.15.53:0/2950053250 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f783c010430 con 0x56291188d2f0 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.494+0000 7f784f086740 10 client.17505 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.494+0000 7f784f086740 10 client.17505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.494+0000 7f784f086740 20 client.17505 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.494+0000 7f784f086740 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562911874d80 0x562911c77680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.494+0000 7f784f086740 4 client.17505 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:10:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.494+0000 7f784f086740 1 -- 172.21.15.53:0/2950053250 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562911bd0f50 con 0x562911874d80 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.494+0000 7f78456b4640 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562911874d80 0x562911c77680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.494+0000 7f78297fa640 10 client.17505 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.494+0000 7f78456b4640 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562911874d80 0x562911c77680 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c74d5ad031eb071 server_cookie=e7cabf9d40ac7a47 in_seq=0 out_seq=0 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f78297fa640 1 -- 172.21.15.53:0/2950053250 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562911bd0f50 con 0x562911874d80 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f78297fa640 10 client.17505 handle_command_reply: tid=0 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f784f086740 1 client.17505 shutdown 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f784f086740 1 -- 172.21.15.53:0/2950053250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 msgr2=0x562911c65670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f784f086740 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c65670 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f783c005130 tx=0x7f783c005160 comp rx=0 tx=0).stop 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f784f086740 1 -- 172.21.15.53:0/2950053250 shutdown_connections 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f784f086740 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562911874d80 0x562911c77680 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f784f086740 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118b61b0 0x562911c71590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f784f086740 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911c65bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f784f086740 1 --2- 172.21.15.53:0/2950053250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c65670 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f78297fa640 0 client.17505 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f784f086740 1 -- 172.21.15.53:0/2950053250 >> 172.21.15.53:0/2950053250 conn(0x5629118aa300 msgr2=0x562911c5aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f784f086740 1 -- 172.21.15.53:0/2950053250 shutdown_connections 2024-08-31T06:10:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.495+0000 7f784f086740 1 -- 172.21.15.53:0/2950053250 wait complete. 2024-08-31T06:10:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.496+0000 7f784f086740 20 client.17505 trim_cache size 0 max 16384 2024-08-31T06:10:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f784f086740 1 Processor -- start 2024-08-31T06:10:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f784f086740 1 -- start start 2024-08-31T06:10:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f784f086740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c62630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f784f086740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118954d0 0x562911c62b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f784f086740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118b61b0 0x562911c7a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f784f086740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f78401ad160 con 0x56291188d2f0 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f784f086740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f78401aed00 con 0x5629118954d0 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f784f086740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78401ad830 con 0x5629118b61b0 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f7845eb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c62630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f7845eb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c62630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40156/0 (socket says 172.21.15.53:40156) 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f7845eb5640 1 -- 172.21.15.53:0/2463370688 learned_addr learned my addr 172.21.15.53:0/2463370688 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f78466b6640 1 --2- 172.21.15.53:0/2463370688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118b61b0 0x562911c7a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f78456b4640 1 --2- 172.21.15.53:0/2463370688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118954d0 0x562911c62b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f7845eb5640 1 -- 172.21.15.53:0/2463370688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118b61b0 msgr2=0x562911c7a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f7845eb5640 1 --2- 172.21.15.53:0/2463370688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118b61b0 0x562911c7a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f7845eb5640 1 -- 172.21.15.53:0/2463370688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118954d0 msgr2=0x562911c62b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f7845eb5640 1 --2- 172.21.15.53:0/2463370688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118954d0 0x562911c62b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.514+0000 7f7845eb5640 1 -- 172.21.15.53:0/2463370688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562911c58740 con 0x56291188d2f0 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.515+0000 7f7845eb5640 1 --2- 172.21.15.53:0/2463370688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c62630 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f783c00fed0 tx=0x7f783c00a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a3debea85fa77 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:54.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.515+0000 7f782b7fe640 1 -- 172.21.15.53:0/2463370688 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c03b070 con 0x56291188d2f0 2024-08-31T06:10:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.515+0000 7f782b7fe640 1 -- 172.21.15.53:0/2463370688 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f783c0051d0 con 0x56291188d2f0 2024-08-31T06:10:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.515+0000 7f782b7fe640 1 -- 172.21.15.53:0/2463370688 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c026040 con 0x56291188d2f0 2024-08-31T06:10:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.516+0000 7f784f086740 1 -- 172.21.15.53:0/2463370688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 msgr2=0x562911c62630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.516+0000 7f784f086740 1 --2- 172.21.15.53:0/2463370688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c62630 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f783c00fed0 tx=0x7f783c00a400 comp rx=0 tx=0).stop 2024-08-31T06:10:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.516+0000 7f784f086740 1 -- 172.21.15.53:0/2463370688 shutdown_connections 2024-08-31T06:10:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.516+0000 7f784f086740 1 --2- 172.21.15.53:0/2463370688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118b61b0 0x562911c7a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.516+0000 7f784f086740 1 --2- 172.21.15.53:0/2463370688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118954d0 0x562911c62b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.516+0000 7f784f086740 1 --2- 172.21.15.53:0/2463370688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911c62630 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.516+0000 7f784f086740 1 -- 172.21.15.53:0/2463370688 >> 172.21.15.53:0/2463370688 conn(0x5629118aa300 msgr2=0x562911c63cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.516+0000 7f784f086740 1 -- 172.21.15.53:0/2463370688 shutdown_connections 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.516+0000 7f784f086740 1 -- 172.21.15.53:0/2463370688 wait complete. 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.516+0000 7f784f086740 1 -- start start 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.516+0000 7f784f086740 1 Processor -- start 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f784f086740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911cd5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f784f086740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911cd62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f784f086740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118b61b0 0x562911ce0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f784f086740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f78401ae630 con 0x56291188d2f0 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f784f086740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f78401adf00 con 0x5629118b61b0 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f784f086740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f78401ab140 con 0x5629118954d0 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f784f086740 10 client.0 _ll_register_callbacks cb 0x7f7838009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f7845eb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911cd5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f7845eb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911cd5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40172/0 (socket says 172.21.15.53:40172) 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f7845eb5640 1 -- 172.21.15.53:0/1804320612 learned_addr learned my addr 172.21.15.53:0/1804320612 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f78456b4640 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911cd62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f78466b6640 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118b61b0 0x562911ce0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f78456b4640 1 -- 172.21.15.53:0/1804320612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118b61b0 msgr2=0x562911ce0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f78456b4640 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118b61b0 0x562911ce0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f78456b4640 1 -- 172.21.15.53:0/1804320612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 msgr2=0x562911cd5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f78456b4640 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911cd5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f78456b4640 1 -- 172.21.15.53:0/1804320612 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562911cd6b20 con 0x5629118954d0 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.517+0000 7f7845eb5640 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911cd5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f78456b4640 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911cd62d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7830104750 tx=0x7f783010ab50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ba354fdd1b5cf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f78297fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f78297fa640 1 -- 172.21.15.53:0/1804320612 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78300eee60 con 0x5629118954d0 2024-08-31T06:10:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f78297fa640 1 -- 172.21.15.53:0/1804320612 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(74..74 src has 1..74) ==== 8513+0+0 (secure 0 0 0) 0x7f7830003c30 con 0x5629118954d0 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f784f086740 1 -- 172.21.15.53:0/1804320612 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f783c0051d0 con 0x5629118954d0 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f78297fa640 1 -- 172.21.15.53:0/1804320612 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f78300cce60 con 0x5629118954d0 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f784f086740 10 client.26833 fetch_fsmap learned FSMap version 34 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f784f086740 1 -- 172.21.15.53:0/1804320612 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562911ce23d0 con 0x5629118954d0 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f78297fa640 1 -- 172.21.15.53:0/1804320612 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78300b4e50 con 0x5629118954d0 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f78297fa640 1 -- 172.21.15.53:0/1804320612 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f78301090b0 con 0x5629118954d0 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f784f086740 10 client.26833 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f784f086740 10 client.26833 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f784f086740 20 client.26833 populate_metadata read hostname 'smithi053' 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f784f086740 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56291184a1c0 0x562911ce4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f784f086740 4 client.26833 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.518+0000 7f784f086740 1 -- 172.21.15.53:0/1804320612 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562911bcc9f0 con 0x56291184a1c0 2024-08-31T06:10:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.519+0000 7f7845eb5640 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56291184a1c0 0x562911ce4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:10:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.519+0000 7f78297fa640 10 client.26833 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.519+0000 7f7845eb5640 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56291184a1c0 0x562911ce4af0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ae4465975fd75ca server_cookie=8febcb5443376319 in_seq=0 out_seq=0 2024-08-31T06:10:54.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f78297fa640 1 -- 172.21.15.53:0/1804320612 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562911bcc9f0 con 0x56291184a1c0 2024-08-31T06:10:54.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f78297fa640 10 client.26833 handle_command_reply: tid=0 2024-08-31T06:10:54.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 1 client.26833 shutdown 2024-08-31T06:10:54.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 1 -- 172.21.15.53:0/1804320612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 msgr2=0x562911cd62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:54.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911cd62d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7830104750 tx=0x7f783010ab50 comp rx=0 tx=0).stop 2024-08-31T06:10:54.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 1 -- 172.21.15.53:0/1804320612 shutdown_connections 2024-08-31T06:10:54.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56291184a1c0 0x562911ce4af0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629118b61b0 0x562911ce0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f78297fa640 0 client.26833 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:10:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629118954d0 0x562911cd62d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 1 --2- 172.21.15.53:0/1804320612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56291188d2f0 0x562911cd5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 1 -- 172.21.15.53:0/1804320612 >> 172.21.15.53:0/1804320612 conn(0x5629118aa300 msgr2=0x562911c66910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 1 -- 172.21.15.53:0/1804320612 shutdown_connections 2024-08-31T06:10:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 1 -- 172.21.15.53:0/1804320612 wait complete. 2024-08-31T06:10:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.541+0000 7f784f086740 20 client.26833 trim_cache size 0 max 16384 2024-08-31T06:10:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:10:54.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:10:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:10:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:10:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 -- 172.21.15.53:0/1163330484 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f782c0b4ca0 msgr2=0x7f782c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f782c0b4ca0 0x7f782c0b71b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7838005f40 tx=0x7f78380096a0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 -- 172.21.15.53:0/1163330484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7840108080 msgr2=0x7f7840199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:10:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7840108080 0x7f7840199630 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f7830005940 tx=0x7f7830004060 comp rx=0 tx=0).stop 2024-08-31T06:10:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 -- 172.21.15.53:0/1163330484 shutdown_connections 2024-08-31T06:10:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f782c0b4ca0 0x7f782c0b71b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78401089d0 0x7f784019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7840108080 0x7f7840199630 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 --2- 172.21.15.53:0/1163330484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7840102750 0x7f7840199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:10:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 -- 172.21.15.53:0/1163330484 >> 172.21.15.53:0/1163330484 conn(0x7f784007a4e0 msgr2=0x7f78401061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:10:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 -- 172.21.15.53:0/1163330484 shutdown_connections 2024-08-31T06:10:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:10:54.542+0000 7f7848119640 1 -- 172.21.15.53:0/1163330484 wait complete. 2024-08-31T06:10:54.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 105016 1.71 MB/sec execute 164 sec latency 33.398 ms 2024-08-31T06:10:55.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 105510 1.72 MB/sec execute 165 sec latency 21.211 ms 2024-08-31T06:10:56.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:56 smithi130 ceph-mon[22266]: pgmap v502: 97 pgs: 97 active+clean; 62 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-08-31T06:10:56.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:56 smithi153 ceph-mon[22320]: pgmap v502: 97 pgs: 97 active+clean; 62 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-08-31T06:10:56.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:56 smithi053 ceph-mon[18924]: pgmap v502: 97 pgs: 97 active+clean; 62 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-08-31T06:10:56.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 106217 1.74 MB/sec execute 166 sec latency 15.167 ms 2024-08-31T06:10:57.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 106669 1.76 MB/sec execute 167 sec latency 14.626 ms 2024-08-31T06:10:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:10:58 smithi130 ceph-mon[22266]: pgmap v503: 97 pgs: 97 active+clean; 60 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-08-31T06:10:58.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:10:58 smithi153 ceph-mon[22320]: pgmap v503: 97 pgs: 97 active+clean; 60 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-08-31T06:10:58.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:10:58 smithi053 ceph-mon[18924]: pgmap v503: 97 pgs: 97 active+clean; 60 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-08-31T06:10:58.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 106921 1.75 MB/sec execute 168 sec latency 14.371 ms 2024-08-31T06:10:59.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 107324 1.74 MB/sec execute 169 sec latency 17.885 ms 2024-08-31T06:11:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:00 smithi130 ceph-mon[22266]: pgmap v504: 97 pgs: 97 active+clean; 60 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-08-31T06:11:00.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:00 smithi153 ceph-mon[22320]: pgmap v504: 97 pgs: 97 active+clean; 60 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-08-31T06:11:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:00 smithi053 ceph-mon[18924]: pgmap v504: 97 pgs: 97 active+clean; 60 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-08-31T06:11:00.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 107860 1.76 MB/sec execute 170 sec latency 18.118 ms 2024-08-31T06:11:01.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 108325 1.75 MB/sec execute 171 sec latency 21.633 ms 2024-08-31T06:11:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:02 smithi130 ceph-mon[22266]: pgmap v505: 97 pgs: 97 active+clean; 63 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.7 MiB/s wr, 181 op/s 2024-08-31T06:11:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:02 smithi130 ceph-mon[22266]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T06:11:02.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:02 smithi153 ceph-mon[22320]: pgmap v505: 97 pgs: 97 active+clean; 63 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.7 MiB/s wr, 181 op/s 2024-08-31T06:11:02.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:02 smithi153 ceph-mon[22320]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T06:11:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:02 smithi053 ceph-mon[18924]: pgmap v505: 97 pgs: 97 active+clean; 63 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.7 MiB/s wr, 181 op/s 2024-08-31T06:11:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:02 smithi053 ceph-mon[18924]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T06:11:02.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 108874 1.75 MB/sec execute 172 sec latency 24.639 ms 2024-08-31T06:11:03.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:03 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:11:03.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:03 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:11:03.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:03 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:11:03.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 109617 1.78 MB/sec execute 173 sec latency 14.525 ms 2024-08-31T06:11:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:04 smithi130 ceph-mon[22266]: pgmap v507: 97 pgs: 97 active+clean; 63 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-08-31T06:11:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:04 smithi153 ceph-mon[22320]: pgmap v507: 97 pgs: 97 active+clean; 63 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-08-31T06:11:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:04 smithi053 ceph-mon[18924]: pgmap v507: 97 pgs: 97 active+clean; 63 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-08-31T06:11:04.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 110019 1.79 MB/sec execute 174 sec latency 11.658 ms 2024-08-31T06:11:05.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 110371 1.79 MB/sec execute 175 sec latency 14.163 ms 2024-08-31T06:11:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:06 smithi130 ceph-mon[22266]: pgmap v508: 97 pgs: 97 active+clean; 62 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-08-31T06:11:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:06 smithi153 ceph-mon[22320]: pgmap v508: 97 pgs: 97 active+clean; 62 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-08-31T06:11:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:06 smithi053 ceph-mon[18924]: pgmap v508: 97 pgs: 97 active+clean; 62 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-08-31T06:11:06.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 110658 1.78 MB/sec execute 176 sec latency 15.322 ms 2024-08-31T06:11:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.643+0000 7f16f6869640 1 -- 172.21.15.53:0/1478272221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f0102770 msgr2=0x7f16f0102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.644+0000 7f16f6869640 1 --2- 172.21.15.53:0/1478272221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f0102770 0x7f16f0102b80 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009900 tx=0x7f16e002a410 comp rx=0 tx=0).stop 2024-08-31T06:11:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.644+0000 7f16f6869640 1 -- 172.21.15.53:0/1478272221 shutdown_connections 2024-08-31T06:11:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.644+0000 7f16f6869640 1 --2- 172.21.15.53:0/1478272221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16f01089f0 0x7f16f010f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.644+0000 7f16f6869640 1 --2- 172.21.15.53:0/1478272221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16f01080a0 0x7f16f01084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.644+0000 7f16f6869640 1 --2- 172.21.15.53:0/1478272221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f0102770 0x7f16f0102b80 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.644+0000 7f16f6869640 1 -- 172.21.15.53:0/1478272221 >> 172.21.15.53:0/1478272221 conn(0x7f16f00fe190 msgr2=0x7f16f01005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.644+0000 7f16f6869640 1 -- 172.21.15.53:0/1478272221 shutdown_connections 2024-08-31T06:11:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.644+0000 7f16f6869640 1 -- 172.21.15.53:0/1478272221 wait complete. 2024-08-31T06:11:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.644+0000 7f16f6869640 1 Processor -- start 2024-08-31T06:11:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.644+0000 7f16f6869640 1 -- start start 2024-08-31T06:11:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16f6869640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f0102770 0x7f16f019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16f6869640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16f01080a0 0x7f16f019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16f6869640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16f01089f0 0x7f16f019f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16f6869640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0113680 con 0x7f16f0102770 2024-08-31T06:11:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16f6869640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0113500 con 0x7f16f01080a0 2024-08-31T06:11:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16f6869640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0113800 con 0x7f16f01089f0 2024-08-31T06:11:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f0102770 0x7f16f019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f0102770 0x7f16f019a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38512/0 (socket says 172.21.15.53:38512) 2024-08-31T06:11:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16effff640 1 -- 172.21.15.53:0/2710549252 learned_addr learned my addr 172.21.15.53:0/2710549252 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16f4e06640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16f01089f0 0x7f16f019f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16f01080a0 0x7f16f019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16effff640 1 -- 172.21.15.53:0/2710549252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16f01089f0 msgr2=0x7f16f019f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16effff640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16f01089f0 0x7f16f019f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16effff640 1 -- 172.21.15.53:0/2710549252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16f01080a0 msgr2=0x7f16f019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16effff640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16f01080a0 0x7f16f019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16effff640 1 -- 172.21.15.53:0/2710549252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f01a0050 con 0x7f16f0102770 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.645+0000 7f16f4e06640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16f01089f0 0x7f16f019f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.646+0000 7f16effff640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f0102770 0x7f16f019a120 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009230 tx=0x7f16e0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.646+0000 7f16ed7fa640 1 -- 172.21.15.53:0/2710549252 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e003f030 con 0x7f16f0102770 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.646+0000 7f16ed7fa640 1 -- 172.21.15.53:0/2710549252 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16e0003a80 con 0x7f16f0102770 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.646+0000 7f16f6869640 1 -- 172.21.15.53:0/2710549252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f01a02e0 con 0x7f16f0102770 2024-08-31T06:11:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.646+0000 7f16ed7fa640 1 -- 172.21.15.53:0/2710549252 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0035070 con 0x7f16f0102770 2024-08-31T06:11:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.646+0000 7f16f6869640 1 -- 172.21.15.53:0/2710549252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f01a6ad0 con 0x7f16f0102770 2024-08-31T06:11:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.648+0000 7f16fd7d5740 1 Processor -- start 2024-08-31T06:11:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16fd7d5740 1 -- start start 2024-08-31T06:11:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4e32f0 0x55c10b8b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c10b825000 con 0x55c10b4eb4d0 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c10b814590 con 0x55c10b50c1b0 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c10b818540 con 0x55c10b4e32f0 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38524/0 (socket says 172.21.15.53:38524) 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16ef7fe640 1 -- 172.21.15.53:0/3830518133 learned_addr learned my addr 172.21.15.53:0/3830518133 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16f4e06640 1 --2- 172.21.15.53:0/3830518133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16ed7fa640 1 -- 172.21.15.53:0/2710549252 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f16e0042030 con 0x7f16f0102770 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16ef7fe640 1 -- 172.21.15.53:0/3830518133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4e32f0 msgr2=0x55c10b8b0000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/3830518133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4e32f0 0x55c10b8b0000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16ef7fe640 1 -- 172.21.15.53:0/3830518133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 msgr2=0x55c10b8afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/3830518133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16ef7fe640 1 -- 172.21.15.53:0/3830518133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c10b577790 con 0x55c10b4eb4d0 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.649+0000 7f16f4e06640 1 --2- 172.21.15.53:0/3830518133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.650+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/3830518133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b0540 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009c20 tx=0x7f16e4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d90ceb605cf8f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.650+0000 7f16d67fc640 1 -- 172.21.15.53:0/3830518133 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4004230 con 0x55c10b4eb4d0 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.650+0000 7f16d67fc640 1 -- 172.21.15.53:0/3830518133 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16e40043d0 con 0x55c10b4eb4d0 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.650+0000 7f16d67fc640 1 -- 172.21.15.53:0/3830518133 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4004c00 con 0x55c10b4eb4d0 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.650+0000 7f16ed7fa640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f16d80b4ca0 0x7f16d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.650+0000 7f16f4e06640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f16d80b4ca0 0x7f16d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.650+0000 7f16ed7fa640 1 -- 172.21.15.53:0/2710549252 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8601+0+0 (secure 0 0 0) 0x7f16e0105a60 con 0x7f16f0102770 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.651+0000 7f16fd7d5740 1 -- 172.21.15.53:0/3830518133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 msgr2=0x55c10b8b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.651+0000 7f16f4e06640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f16d80b4ca0 0x7f16d80b71b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005fd0 tx=0x7f16e80096a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.651+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/3830518133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b0540 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009c20 tx=0x7f16e4011810 comp rx=0 tx=0).stop 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.651+0000 7f16fd7d5740 1 -- 172.21.15.53:0/3830518133 shutdown_connections 2024-08-31T06:11:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.651+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/3830518133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b0540 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.651+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/3830518133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4e32f0 0x55c10b8b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.651+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/3830518133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.651+0000 7f16fd7d5740 1 -- 172.21.15.53:0/3830518133 >> 172.21.15.53:0/3830518133 conn(0x55c10b500300 msgr2=0x55c10b8ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.651+0000 7f16fd7d5740 1 -- 172.21.15.53:0/3830518133 shutdown_connections 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.651+0000 7f16fd7d5740 1 -- 172.21.15.53:0/3830518133 wait complete. 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.651+0000 7f16fd7d5740 1 -- start start 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16fd7d5740 1 Processor -- start 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4e32f0 0x55c10b8bb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 0x55c10b8bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8c7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c10b74dab0 con 0x55c10b4e32f0 2024-08-31T06:11:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c10b79b680 con 0x55c10b50c1b0 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c10b8be240 con 0x55c10b4eb4d0 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16fd7d5740 10 client.0 _ll_register_callbacks cb 0x55c10b523a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4e32f0 0x55c10b8bb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4e32f0 0x55c10b8bb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38526/0 (socket says 172.21.15.53:38526) 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16effff640 1 -- 172.21.15.53:0/1129039984 learned_addr learned my addr 172.21.15.53:0/1129039984 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16ef7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 0x55c10b8bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16f4e06640 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16effff640 1 -- 172.21.15.53:0/1129039984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 msgr2=0x55c10b8bbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16effff640 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 0x55c10b8bbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16effff640 1 -- 172.21.15.53:0/1129039984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 msgr2=0x55c10b8c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16effff640 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.652+0000 7f16effff640 1 -- 172.21.15.53:0/1129039984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c10b5f0620 con 0x55c10b4e32f0 2024-08-31T06:11:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16effff640 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4e32f0 0x55c10b8bb6f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f16e0103760 tx=0x7f16e00cbb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28744d9eb557381c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1129039984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0049070 con 0x55c10b4e32f0 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1129039984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8601+0+0 (secure 0 0 0) 0x7f16e01033e0 con 0x55c10b4e32f0 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1129039984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16e40043d0 con 0x55c10b4e32f0 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1129039984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f16e00cc1b0 con 0x55c10b4e32f0 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16fd7d5740 10 client.17523 fetch_fsmap learned FSMap version 35 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1129039984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c10b8ca300 con 0x55c10b4e32f0 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1129039984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16e40043d0 con 0x55c10b4e32f0 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1129039984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f16e00cc4a0 con 0x55c10b4e32f0 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16fd7d5740 10 client.17523 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16fd7d5740 10 client.17523 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16fd7d5740 20 client.17523 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c10b4cad80 0x55c10b8cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16fd7d5740 4 client.17523 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.653+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1129039984 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c10b826f50 con 0x55c10b4cad80 2024-08-31T06:11:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.654+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c10b4cad80 0x55c10b8cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.654+0000 7f16cf7fe640 10 client.17523 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.654+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c10b4cad80 0x55c10b8cd7e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22acb75167bc1747 server_cookie=bc9e554b0b6cd758 in_seq=0 out_seq=0 2024-08-31T06:11:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.655+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1129039984 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c10b826f50 con 0x55c10b4cad80 2024-08-31T06:11:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.655+0000 7f16cf7fe640 10 client.17523 handle_command_reply: tid=0 2024-08-31T06:11:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.655+0000 7f16fd7d5740 1 client.17523 shutdown 2024-08-31T06:11:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1129039984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4e32f0 msgr2=0x55c10b8bb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4e32f0 0x55c10b8bb6f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f16e0103760 tx=0x7f16e00cbb70 comp rx=0 tx=0).stop 2024-08-31T06:11:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1129039984 shutdown_connections 2024-08-31T06:11:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c10b4cad80 0x55c10b8cd7e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 0x55c10b8bbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1129039984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4e32f0 0x55c10b8bb6f0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16cf7fe640 0 client.17523 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1129039984 >> 172.21.15.53:0/1129039984 conn(0x55c10b500300 msgr2=0x55c10b8b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1129039984 shutdown_connections 2024-08-31T06:11:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1129039984 wait complete. 2024-08-31T06:11:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.656+0000 7f16fd7d5740 20 client.17523 trim_cache size 0 max 16384 2024-08-31T06:11:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.671+0000 7f16fd7d5740 1 Processor -- start 2024-08-31T06:11:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.671+0000 7f16fd7d5740 1 -- start start 2024-08-31T06:11:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.671+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b4e32f0 0x55c10b8c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b50c1b0 0x55c10b8b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f16f01af440 con 0x55c10b50c1b0 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f16f01b0fb0 con 0x55c10b4e32f0 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f16f01afb10 con 0x55c10b4eb4d0 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16ef7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16f4e06640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b50c1b0 0x55c10b8b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16effff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b4e32f0 0x55c10b8c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16ef7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56262/0 (socket says 172.21.15.53:56262) 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16effff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b4e32f0 0x55c10b8c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47266/0 (socket says 172.21.15.53:47266) 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16ef7fe640 1 -- 172.21.15.53:0/1599485379 learned_addr learned my addr 172.21.15.53:0/1599485379 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16f4e06640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b50c1b0 0x55c10b8b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38532/0 (socket says 172.21.15.53:38532) 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16ef7fe640 1 -- 172.21.15.53:0/1599485379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b4e32f0 msgr2=0x55c10b8c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/1599485379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b4e32f0 0x55c10b8c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16ef7fe640 1 -- 172.21.15.53:0/1599485379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b50c1b0 msgr2=0x55c10b8b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:07.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/1599485379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b50c1b0 0x55c10b8b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16ef7fe640 1 -- 172.21.15.53:0/1599485379 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c10b8ae2b0 con 0x55c10b4eb4d0 2024-08-31T06:11:07.677 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.672+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/1599485379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b4b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009c20 tx=0x7f16e4004840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=368eaf854910c85a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.673+0000 7f16d5ffb640 1 -- 172.21.15.53:0/1599485379 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e401e040 con 0x55c10b4eb4d0 2024-08-31T06:11:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.673+0000 7f16d5ffb640 1 -- 172.21.15.53:0/1599485379 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16e401f040 con 0x55c10b4eb4d0 2024-08-31T06:11:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.673+0000 7f16d5ffb640 1 -- 172.21.15.53:0/1599485379 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4003e20 con 0x55c10b4eb4d0 2024-08-31T06:11:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.674+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1599485379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 msgr2=0x55c10b8b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.674+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1599485379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b4b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009c20 tx=0x7f16e4004840 comp rx=0 tx=0).stop 2024-08-31T06:11:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.674+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1599485379 shutdown_connections 2024-08-31T06:11:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.674+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1599485379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b50c1b0 0x55c10b8b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.674+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1599485379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4eb4d0 0x55c10b8b4b80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.674+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1599485379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b4e32f0 0x55c10b8c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.674+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1599485379 >> 172.21.15.53:0/1599485379 conn(0x55c10b500300 msgr2=0x55c10b8b9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.674+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1599485379 shutdown_connections 2024-08-31T06:11:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.674+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1599485379 wait complete. 2024-08-31T06:11:07.681 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.674+0000 7f16fd7d5740 1 -- start start 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16fd7d5740 1 Processor -- start 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4e32f0 0x55c10b8bf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16fd7d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f16f01b08e0 con 0x55c10b4eb4d0 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f16f01b01e0 con 0x55c10b50c1b0 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16fd7d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f16f01ad440 con 0x55c10b4e32f0 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16fd7d5740 10 client.0 _ll_register_callbacks cb 0x7f16e0009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8bfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38544/0 (socket says 172.21.15.53:38544) 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16effff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4e32f0 0x55c10b8bf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16f4e06640 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.675+0000 7f16ef7fe640 1 -- 172.21.15.53:0/1217763513 learned_addr learned my addr 172.21.15.53:0/1217763513 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16ef7fe640 1 -- 172.21.15.53:0/1217763513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4e32f0 msgr2=0x55c10b8bf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4e32f0 0x55c10b8bf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16ef7fe640 1 -- 172.21.15.53:0/1217763513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 msgr2=0x55c10b8bffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8bffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16ef7fe640 1 -- 172.21.15.53:0/1217763513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c10b9372b0 con 0x55c10b4eb4d0 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16f4e06640 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8bffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16ef7fe640 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8bfaa0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009b40 tx=0x7f16e40097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800acc6589b954b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1217763513 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4003db0 con 0x55c10b4eb4d0 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1217763513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16e401f040 con 0x55c10b4eb4d0 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1217763513 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8601+0+0 (secure 0 0 0) 0x7f16e40035f0 con 0x55c10b4eb4d0 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1217763513 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f16e40037f0 con 0x55c10b4eb4d0 2024-08-31T06:11:07.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16fd7d5740 10 client.17529 fetch_fsmap learned FSMap version 35 2024-08-31T06:11:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.676+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1217763513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c10b938540 con 0x55c10b4eb4d0 2024-08-31T06:11:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.677+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1217763513 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16e401f040 con 0x55c10b4eb4d0 2024-08-31T06:11:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.677+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1217763513 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f16e402e070 con 0x55c10b4eb4d0 2024-08-31T06:11:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.677+0000 7f16fd7d5740 10 client.17529 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T06:11:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.677+0000 7f16fd7d5740 10 client.17529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.677+0000 7f16fd7d5740 20 client.17529 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.677+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c10b4a01c0 0x55c10b93aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.677+0000 7f16fd7d5740 4 client.17529 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:11:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.677+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1217763513 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c10b8229f0 con 0x55c10b4a01c0 2024-08-31T06:11:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.677+0000 7f16effff640 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c10b4a01c0 0x55c10b93aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.678+0000 7f16cf7fe640 10 client.17529 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.678+0000 7f16effff640 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c10b4a01c0 0x55c10b93aa50 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15dd74a224b2f4e8 server_cookie=2d85cd04a09742cb in_seq=0 out_seq=0 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16cf7fe640 1 -- 172.21.15.53:0/1217763513 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c10b8229f0 con 0x55c10b4a01c0 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16cf7fe640 10 client.17529 handle_command_reply: tid=0 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 1 client.17529 shutdown 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1217763513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 msgr2=0x55c10b8bfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8bfaa0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009b40 tx=0x7f16e40097a0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1217763513 shutdown_connections 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c10b4a01c0 0x55c10b93aa50 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c10b50c1b0 0x55c10b8bffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16cf7fe640 0 client.17529 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c10b4eb4d0 0x55c10b8bfaa0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 1 --2- 172.21.15.53:0/1217763513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c10b4e32f0 0x55c10b8bf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1217763513 >> 172.21.15.53:0/1217763513 conn(0x55c10b500300 msgr2=0x55c10b8b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1217763513 shutdown_connections 2024-08-31T06:11:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 1 -- 172.21.15.53:0/1217763513 wait complete. 2024-08-31T06:11:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.701+0000 7f16fd7d5740 20 client.17529 trim_cache size 0 max 16384 2024-08-31T06:11:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:11:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:11:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:11:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:11:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 -- 172.21.15.53:0/2710549252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f16d80b4ca0 msgr2=0x7f16d80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f16d80b4ca0 0x7f16d80b71b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005fd0 tx=0x7f16e80096a0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 -- 172.21.15.53:0/2710549252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f0102770 msgr2=0x7f16f019a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f0102770 0x7f16f019a120 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009230 tx=0x7f16e0004270 comp rx=0 tx=0).stop 2024-08-31T06:11:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 -- 172.21.15.53:0/2710549252 shutdown_connections 2024-08-31T06:11:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f16d80b4ca0 0x7f16d80b71b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16f01089f0 0x7f16f019f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16f01080a0 0x7f16f019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 --2- 172.21.15.53:0/2710549252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f0102770 0x7f16f019a120 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 -- 172.21.15.53:0/2710549252 >> 172.21.15.53:0/2710549252 conn(0x7f16f00fe190 msgr2=0x7f16f01005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 -- 172.21.15.53:0/2710549252 shutdown_connections 2024-08-31T06:11:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:07.702+0000 7f16f6869640 1 -- 172.21.15.53:0/2710549252 wait complete. 2024-08-31T06:11:07.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 111143 1.78 MB/sec execute 177 sec latency 20.626 ms 2024-08-31T06:11:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:08 smithi130 ceph-mon[22266]: pgmap v509: 97 pgs: 97 active+clean; 66 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2024-08-31T06:11:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:08 smithi153 ceph-mon[22320]: pgmap v509: 97 pgs: 97 active+clean; 66 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2024-08-31T06:11:08.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:08 smithi053 ceph-mon[18924]: pgmap v509: 97 pgs: 97 active+clean; 66 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2024-08-31T06:11:08.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 111649 1.79 MB/sec execute 178 sec latency 20.181 ms 2024-08-31T06:11:09.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 112200 1.78 MB/sec execute 179 sec latency 23.569 ms 2024-08-31T06:11:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:10 smithi130 ceph-mon[22266]: pgmap v510: 97 pgs: 97 active+clean; 67 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 1.6 MiB/s wr, 169 op/s 2024-08-31T06:11:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:10 smithi130 ceph-mon[22266]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T06:11:10.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:10 smithi153 ceph-mon[22320]: pgmap v510: 97 pgs: 97 active+clean; 67 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 1.6 MiB/s wr, 169 op/s 2024-08-31T06:11:10.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:10 smithi153 ceph-mon[22320]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T06:11:10.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:10 smithi053 ceph-mon[18924]: pgmap v510: 97 pgs: 97 active+clean; 67 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 1.6 MiB/s wr, 169 op/s 2024-08-31T06:11:10.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:10 smithi053 ceph-mon[18924]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T06:11:10.972 INFO:tasks.workunit.client.0.smithi053.stdout: 1 112616 1.79 MB/sec execute 180 sec latency 86.232 ms 2024-08-31T06:11:11.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 113316 1.81 MB/sec execute 181 sec latency 12.296 ms 2024-08-31T06:11:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:12 smithi130 ceph-mon[22266]: pgmap v512: 97 pgs: 97 active+clean; 68 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.6 MiB/s wr, 175 op/s 2024-08-31T06:11:12.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:12 smithi153 ceph-mon[22320]: pgmap v512: 97 pgs: 97 active+clean; 68 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.6 MiB/s wr, 175 op/s 2024-08-31T06:11:12.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:12 smithi053 ceph-mon[18924]: pgmap v512: 97 pgs: 97 active+clean; 68 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.6 MiB/s wr, 175 op/s 2024-08-31T06:11:12.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 113781 1.82 MB/sec execute 182 sec latency 30.267 ms 2024-08-31T06:11:13.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 114023 1.82 MB/sec execute 183 sec latency 12.263 ms 2024-08-31T06:11:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:14 smithi130 ceph-mon[22266]: pgmap v513: 97 pgs: 97 active+clean; 68 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.6 MiB/s wr, 165 op/s 2024-08-31T06:11:14.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:14 smithi153 ceph-mon[22320]: pgmap v513: 97 pgs: 97 active+clean; 68 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.6 MiB/s wr, 165 op/s 2024-08-31T06:11:14.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:14 smithi053 ceph-mon[18924]: pgmap v513: 97 pgs: 97 active+clean; 68 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.6 MiB/s wr, 165 op/s 2024-08-31T06:11:14.945 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:11:14.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 114457 1.81 MB/sec execute 184 sec latency 18.543 ms 2024-08-31T06:11:15.216 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:11:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.752+0000 7ff474e21640 1 -- 172.21.15.53:0/303571000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff470103940 msgr2=0x7ff470103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.752+0000 7ff474e21640 1 --2- 172.21.15.53:0/303571000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff470103940 0x7ff470103d50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff460009900 tx=0x7ff46002a410 comp rx=0 tx=0).stop 2024-08-31T06:11:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.752+0000 7ff474e21640 1 -- 172.21.15.53:0/303571000 shutdown_connections 2024-08-31T06:11:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.752+0000 7ff474e21640 1 --2- 172.21.15.53:0/303571000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff470109bd0 0x7ff470110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.752+0000 7ff474e21640 1 --2- 172.21.15.53:0/303571000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff470109280 0x7ff470109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.752+0000 7ff474e21640 1 --2- 172.21.15.53:0/303571000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff470103940 0x7ff470103d50 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.752+0000 7ff474e21640 1 -- 172.21.15.53:0/303571000 >> 172.21.15.53:0/303571000 conn(0x7ff4700ff3d0 msgr2=0x7ff470101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.752+0000 7ff474e21640 1 -- 172.21.15.53:0/303571000 shutdown_connections 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.752+0000 7ff474e21640 1 -- 172.21.15.53:0/303571000 wait complete. 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.753+0000 7ff474e21640 1 Processor -- start 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.753+0000 7ff474e21640 1 -- start start 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff474e21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff470103940 0x7ff4700754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff474e21640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff470109280 0x7ff4700759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff474e21640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff470109bd0 0x7ff470075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff474e21640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff470113740 con 0x7ff470103940 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff474e21640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4701135c0 con 0x7ff470109280 2024-08-31T06:11:15.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff474e21640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4701138c0 con 0x7ff470109bd0 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff470103940 0x7ff4700754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff470109bd0 0x7ff470075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff470109280 0x7ff4700759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff470103940 0x7ff4700754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52266/0 (socket says 172.21.15.53:52266) 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46e59c640 1 -- 172.21.15.53:0/1568600437 learned_addr learned my addr 172.21.15.53:0/1568600437 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46e59c640 1 -- 172.21.15.53:0/1568600437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff470109bd0 msgr2=0x7ff470075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46e59c640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff470109bd0 0x7ff470075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46e59c640 1 -- 172.21.15.53:0/1568600437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff470109280 msgr2=0x7ff4700759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46e59c640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff470109280 0x7ff4700759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46e59c640 1 -- 172.21.15.53:0/1568600437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4701a8450 con 0x7ff470103940 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46ed9d640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff470109bd0 0x7ff470075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.754+0000 7ff46e59c640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff470103940 0x7ff4700754b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff460009230 tx=0x7ff460004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:15.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.755+0000 7ff45f7fe640 1 -- 172.21.15.53:0/1568600437 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46003f030 con 0x7ff470103940 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.755+0000 7ff45f7fe640 1 -- 172.21.15.53:0/1568600437 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff460003a80 con 0x7ff470103940 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.755+0000 7ff45f7fe640 1 -- 172.21.15.53:0/1568600437 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460035070 con 0x7ff470103940 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.755+0000 7ff474e21640 1 -- 172.21.15.53:0/1568600437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4701a86e0 con 0x7ff470103940 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.755+0000 7ff474e21640 1 -- 172.21.15.53:0/1568600437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4701a8b70 con 0x7ff470103940 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.758+0000 7ff47b396740 1 Processor -- start 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.758+0000 7ff47b396740 1 -- start start 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.758+0000 7ff47b396740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42015d070 0x55e4205022c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.758+0000 7ff47b396740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e420502800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.758+0000 7ff47b396740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42013c390 0x55e420502d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.758+0000 7ff47b396740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e420479630 con 0x55e4201341b0 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.758+0000 7ff47b396740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e420468bc0 con 0x55e42015d070 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.758+0000 7ff47b396740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e42046cb70 con 0x55e42013c390 2024-08-31T06:11:15.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46dd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42013c390 0x55e420502d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42015d070 0x55e4205022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42015d070 0x55e4205022c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39744/0 (socket says 172.21.15.53:39744) 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46dd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42013c390 0x55e420502d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44564/0 (socket says 172.21.15.53:44564) 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46ed9d640 1 -- 172.21.15.53:0/3881571545 learned_addr learned my addr 172.21.15.53:0/3881571545 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff45f7fe640 1 -- 172.21.15.53:0/1568600437 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff460042030 con 0x7ff470103940 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46e59c640 1 --2- 172.21.15.53:0/3881571545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e420502800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46dd9b640 1 -- 172.21.15.53:0/3881571545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42015d070 msgr2=0x55e4205022c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46dd9b640 1 --2- 172.21.15.53:0/3881571545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42015d070 0x55e4205022c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46dd9b640 1 -- 172.21.15.53:0/3881571545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 msgr2=0x55e420502800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46dd9b640 1 --2- 172.21.15.53:0/3881571545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e420502800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46dd9b640 1 -- 172.21.15.53:0/3881571545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4201c8650 con 0x55e42013c390 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.759+0000 7ff46e59c640 1 --2- 172.21.15.53:0/3881571545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e420502800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.760+0000 7ff46dd9b640 1 --2- 172.21.15.53:0/3881571545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42013c390 0x55e420502d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff47006a530 tx=0x7ff464011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8f33275e921c303 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:15.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.760+0000 7ff45cff9640 1 -- 172.21.15.53:0/3881571545 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464004050 con 0x55e42013c390 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.760+0000 7ff45cff9640 1 -- 172.21.15.53:0/3881571545 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff464005020 con 0x55e42013c390 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.760+0000 7ff45cff9640 1 -- 172.21.15.53:0/3881571545 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464004bc0 con 0x55e42013c390 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.760+0000 7ff45f7fe640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4580b4ca0 0x7ff4580b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.760+0000 7ff46ed9d640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4580b4ca0 0x7ff4580b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.761+0000 7ff45f7fe640 1 -- 172.21.15.53:0/1568600437 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7ff460105c10 con 0x7ff470103940 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.761+0000 7ff47b396740 1 -- 172.21.15.53:0/3881571545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42013c390 msgr2=0x55e420502d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.761+0000 7ff46ed9d640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4580b4ca0 0x7ff4580b71b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff4680098b0 tx=0x7ff468009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.761+0000 7ff47b396740 1 --2- 172.21.15.53:0/3881571545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42013c390 0x55e420502d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff47006a530 tx=0x7ff464011810 comp rx=0 tx=0).stop 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.761+0000 7ff47b396740 1 -- 172.21.15.53:0/3881571545 shutdown_connections 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.761+0000 7ff47b396740 1 --2- 172.21.15.53:0/3881571545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42013c390 0x55e420502d40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.761+0000 7ff47b396740 1 --2- 172.21.15.53:0/3881571545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e420502800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.761+0000 7ff47b396740 1 --2- 172.21.15.53:0/3881571545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42015d070 0x55e4205022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.761+0000 7ff47b396740 1 -- 172.21.15.53:0/3881571545 >> 172.21.15.53:0/3881571545 conn(0x55e420151460 msgr2=0x55e4205001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.761+0000 7ff47b396740 1 -- 172.21.15.53:0/3881571545 shutdown_connections 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.761+0000 7ff47b396740 1 -- 172.21.15.53:0/3881571545 wait complete. 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff47b396740 1 -- start start 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff47b396740 1 Processor -- start 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff47b396740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e42050da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff47b396740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e42050dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff47b396740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 0x55e420519d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff47b396740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e4202cb700 con 0x55e4201341b0 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff46e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e42050da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff47b396740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e4203ef700 con 0x55e42013c390 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff47b396740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e420510aa0 con 0x55e42015d070 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff46e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e42050da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52282/0 (socket says 172.21.15.53:52282) 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff46e59c640 1 -- 172.21.15.53:0/1178363121 learned_addr learned my addr 172.21.15.53:0/1178363121 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:15.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff46dd9b640 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e42050dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff47b396740 10 client.0 _ll_register_callbacks cb 0x55e42041edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.762+0000 7ff46ed9d640 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 0x55e420519d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.763+0000 7ff46dd9b640 1 -- 172.21.15.53:0/1178363121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 msgr2=0x55e420519d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.763+0000 7ff46dd9b640 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 0x55e420519d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.763+0000 7ff46dd9b640 1 -- 172.21.15.53:0/1178363121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 msgr2=0x55e42050da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.763+0000 7ff46dd9b640 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e42050da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.763+0000 7ff46dd9b640 1 -- 172.21.15.53:0/1178363121 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4204288b0 con 0x55e42013c390 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.763+0000 7ff46e59c640 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e42050da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.763+0000 7ff46dd9b640 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e42050dfb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff4640048a0 tx=0x7ff464009fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ec2b67c27abedb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.763+0000 7ff455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.763+0000 7ff455ffb640 1 -- 172.21.15.53:0/1178363121 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46401d040 con 0x55e42013c390 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff47b396740 1 -- 172.21.15.53:0/1178363121 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff464005020 con 0x55e42013c390 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff455ffb640 1 -- 172.21.15.53:0/1178363121 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7ff464025c00 con 0x55e42013c390 2024-08-31T06:11:15.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff455ffb640 1 -- 172.21.15.53:0/1178363121 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff46403b050 con 0x55e42013c390 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff47b396740 10 client.26870 fetch_fsmap learned FSMap version 35 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff47b396740 1 -- 172.21.15.53:0/1178363121 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e42051c810 con 0x55e42013c390 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff455ffb640 1 -- 172.21.15.53:0/1178363121 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff464005020 con 0x55e42013c390 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff455ffb640 1 -- 172.21.15.53:0/1178363121 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7ff464036030 con 0x55e42013c390 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff47b396740 10 client.26870 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff47b396740 10 client.26870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff47b396740 20 client.26870 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff47b396740 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e42011b9f0 0x55e42051ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff47b396740 4 client.26870 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.764+0000 7ff47b396740 1 -- 172.21.15.53:0/1178363121 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e42047b580 con 0x55e42011b9f0 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.765+0000 7ff46e59c640 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e42011b9f0 0x55e42051ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.766+0000 7ff455ffb640 10 client.26870 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.766+0000 7ff46e59c640 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e42011b9f0 0x55e42051ffe0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3507efcb64012d05 server_cookie=fd7ea82a16ae31f2 in_seq=0 out_seq=0 2024-08-31T06:11:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.766+0000 7ff455ffb640 1 -- 172.21.15.53:0/1178363121 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e42047b580 con 0x55e42011b9f0 2024-08-31T06:11:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.766+0000 7ff455ffb640 10 client.26870 handle_command_reply: tid=0 2024-08-31T06:11:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 1 client.26870 shutdown 2024-08-31T06:11:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 1 -- 172.21.15.53:0/1178363121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 msgr2=0x55e42050dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e42050dfb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff4640048a0 tx=0x7ff464009fa0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 1 -- 172.21.15.53:0/1178363121 shutdown_connections 2024-08-31T06:11:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e42011b9f0 0x55e42051ffe0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 0x55e420519d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e42050dfb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 1 --2- 172.21.15.53:0/1178363121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e42050da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 1 -- 172.21.15.53:0/1178363121 >> 172.21.15.53:0/1178363121 conn(0x55e420151460 msgr2=0x55e4205054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff455ffb640 0 client.26870 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 1 -- 172.21.15.53:0/1178363121 shutdown_connections 2024-08-31T06:11:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 1 -- 172.21.15.53:0/1178363121 wait complete. 2024-08-31T06:11:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.767+0000 7ff47b396740 20 client.26870 trim_cache size 0 max 16384 2024-08-31T06:11:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.787+0000 7ff47b396740 1 Processor -- start 2024-08-31T06:11:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.787+0000 7ff47b396740 1 -- start start 2024-08-31T06:11:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff47b396740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4201341b0 0x55e420519d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff47b396740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e4204ffba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff47b396740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e42015d070 0x55e4205000e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff47b396740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff4701ad2e0 con 0x55e42015d070 2024-08-31T06:11:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff47b396740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4701aee50 con 0x55e42013c390 2024-08-31T06:11:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff47b396740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4701ad9b0 con 0x55e4201341b0 2024-08-31T06:11:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff46e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4201341b0 0x55e420519d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff46e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4201341b0 0x55e420519d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44586/0 (socket says 172.21.15.53:44586) 2024-08-31T06:11:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff46e59c640 1 -- 172.21.15.53:0/3688469812 learned_addr learned my addr 172.21.15.53:0/3688469812 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff46ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e42015d070 0x55e4205000e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff46dd9b640 1 --2- 172.21.15.53:0/3688469812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e4204ffba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff46e59c640 1 -- 172.21.15.53:0/3688469812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 msgr2=0x55e4204ffba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff46e59c640 1 --2- 172.21.15.53:0/3688469812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e4204ffba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff46e59c640 1 -- 172.21.15.53:0/3688469812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e42015d070 msgr2=0x55e4205000e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff46e59c640 1 --2- 172.21.15.53:0/3688469812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e42015d070 0x55e4205000e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff46e59c640 1 -- 172.21.15.53:0/3688469812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42050ed30 con 0x55e4201341b0 2024-08-31T06:11:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.788+0000 7ff46dd9b640 1 --2- 172.21.15.53:0/3688469812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e4204ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.789+0000 7ff46e59c640 1 --2- 172.21.15.53:0/3688469812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4201341b0 0x55e420519d00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff460103940 tx=0x7ff4600d5040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be3cd6d59f886c30 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.789+0000 7ff457fff640 1 -- 172.21.15.53:0/3688469812 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460049040 con 0x55e4201341b0 2024-08-31T06:11:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.789+0000 7ff457fff640 1 -- 172.21.15.53:0/3688469812 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4600b3040 con 0x55e4201341b0 2024-08-31T06:11:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.789+0000 7ff457fff640 1 -- 172.21.15.53:0/3688469812 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4601035c0 con 0x55e4201341b0 2024-08-31T06:11:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.790+0000 7ff47b396740 1 -- 172.21.15.53:0/3688469812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4201341b0 msgr2=0x55e420519d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.790+0000 7ff47b396740 1 --2- 172.21.15.53:0/3688469812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4201341b0 0x55e420519d00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff460103940 tx=0x7ff4600d5040 comp rx=0 tx=0).stop 2024-08-31T06:11:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.790+0000 7ff47b396740 1 -- 172.21.15.53:0/3688469812 shutdown_connections 2024-08-31T06:11:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.790+0000 7ff47b396740 1 --2- 172.21.15.53:0/3688469812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e42015d070 0x55e4205000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.790+0000 7ff47b396740 1 --2- 172.21.15.53:0/3688469812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e4204ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.790+0000 7ff47b396740 1 --2- 172.21.15.53:0/3688469812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4201341b0 0x55e420519d00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.790+0000 7ff47b396740 1 -- 172.21.15.53:0/3688469812 >> 172.21.15.53:0/3688469812 conn(0x55e420151460 msgr2=0x55e42050c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.790+0000 7ff47b396740 1 -- 172.21.15.53:0/3688469812 shutdown_connections 2024-08-31T06:11:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.790+0000 7ff47b396740 1 -- 172.21.15.53:0/3688469812 wait complete. 2024-08-31T06:11:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff47b396740 1 -- start start 2024-08-31T06:11:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff47b396740 1 Processor -- start 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff47b396740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e420523730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff47b396740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e420520c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff47b396740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 0x55e420521140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff47b396740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff4701ae780 con 0x55e4201341b0 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff47b396740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4701ae080 con 0x55e42013c390 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff47b396740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4701ab300 con 0x55e42015d070 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff47b396740 10 client.0 _ll_register_callbacks cb 0x7ff468009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff46dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e420520c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff46e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e420523730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff46ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 0x55e420521140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff46ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 0x55e420521140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44590/0 (socket says 172.21.15.53:44590) 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff46dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e420520c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39774/0 (socket says 172.21.15.53:39774) 2024-08-31T06:11:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff46ed9d640 1 -- 172.21.15.53:0/3608829847 learned_addr learned my addr 172.21.15.53:0/3608829847 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.791+0000 7ff46e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e420523730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52304/0 (socket says 172.21.15.53:52304) 2024-08-31T06:11:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff46ed9d640 1 -- 172.21.15.53:0/3608829847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 msgr2=0x55e420520c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff46ed9d640 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e420520c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff46ed9d640 1 -- 172.21.15.53:0/3608829847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 msgr2=0x55e420523730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff46ed9d640 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e420523730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff46ed9d640 1 -- 172.21.15.53:0/3608829847 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4205218b0 con 0x55e42015d070 2024-08-31T06:11:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff46dd9b640 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e420520c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff46e59c640 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e420523730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff46ed9d640 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 0x55e420521140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff468013f90 tx=0x7ff468004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b176b5db0b626587 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff455ffb640 1 -- 172.21.15.53:0/3608829847 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468004d20 con 0x55e42015d070 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff455ffb640 1 -- 172.21.15.53:0/3608829847 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7ff46801c5f0 con 0x55e42015d070 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.792+0000 7ff47b396740 1 -- 172.21.15.53:0/3608829847 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4600b3040 con 0x55e42015d070 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff455ffb640 1 -- 172.21.15.53:0/3608829847 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff46801c7f0 con 0x55e42015d070 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff47b396740 10 client.26866 fetch_fsmap learned FSMap version 35 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff47b396740 1 -- 172.21.15.53:0/3608829847 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e42058a830 con 0x55e42015d070 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff455ffb640 1 -- 172.21.15.53:0/3608829847 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4600b3040 con 0x55e42015d070 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff455ffb640 1 -- 172.21.15.53:0/3608829847 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7ff46801a040 con 0x55e42015d070 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff47b396740 10 client.26866 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff47b396740 10 client.26866 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff47b396740 20 client.26866 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff47b396740 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4200f0da0 0x55e42058d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff47b396740 4 client.26866 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff47b396740 1 -- 172.21.15.53:0/3608829847 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e420477020 con 0x55e4200f0da0 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.793+0000 7ff46e59c640 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4200f0da0 0x55e42058d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.794+0000 7ff455ffb640 10 client.26866 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.794+0000 7ff46e59c640 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4200f0da0 0x55e42058d0a0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54f671c3ab754ac2 server_cookie=733790363cdd51af in_seq=0 out_seq=0 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff455ffb640 1 -- 172.21.15.53:0/3608829847 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55e420477020 con 0x55e4200f0da0 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff455ffb640 10 client.26866 handle_command_reply: tid=0 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 1 client.26866 shutdown 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 1 -- 172.21.15.53:0/3608829847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 msgr2=0x55e420521140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 0x55e420521140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff468013f90 tx=0x7ff468004a40 comp rx=0 tx=0).stop 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 1 -- 172.21.15.53:0/3608829847 shutdown_connections 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4200f0da0 0x55e42058d0a0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff455ffb640 0 client.26866 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:15.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e42015d070 0x55e420521140 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42013c390 0x55e420520c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 1 --2- 172.21.15.53:0/3608829847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4201341b0 0x55e420523730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 1 -- 172.21.15.53:0/3608829847 >> 172.21.15.53:0/3608829847 conn(0x55e420151460 msgr2=0x55e4204ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 1 -- 172.21.15.53:0/3608829847 shutdown_connections 2024-08-31T06:11:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 1 -- 172.21.15.53:0/3608829847 wait complete. 2024-08-31T06:11:15.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.795+0000 7ff47b396740 20 client.26866 trim_cache size 0 max 16384 2024-08-31T06:11:15.803 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:11:15.803 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:11:15.803 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:11:15.803 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:15.804 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:11:15.805 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:15.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:15.807 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:11:15.808 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:11:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 -- 172.21.15.53:0/1568600437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4580b4ca0 msgr2=0x7ff4580b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4580b4ca0 0x7ff4580b71b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff4680098b0 tx=0x7ff468009600 comp rx=0 tx=0).stop 2024-08-31T06:11:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 -- 172.21.15.53:0/1568600437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff470103940 msgr2=0x7ff4700754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff470103940 0x7ff4700754b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff460009230 tx=0x7ff460004270 comp rx=0 tx=0).stop 2024-08-31T06:11:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 -- 172.21.15.53:0/1568600437 shutdown_connections 2024-08-31T06:11:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4580b4ca0 0x7ff4580b71b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff470109bd0 0x7ff470075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff470109280 0x7ff4700759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 --2- 172.21.15.53:0/1568600437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff470103940 0x7ff4700754b0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:15.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 -- 172.21.15.53:0/1568600437 >> 172.21.15.53:0/1568600437 conn(0x7ff4700ff3d0 msgr2=0x7ff4701017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:15.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 -- 172.21.15.53:0/1568600437 shutdown_connections 2024-08-31T06:11:15.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:15.796+0000 7ff474e21640 1 -- 172.21.15.53:0/1568600437 wait complete. 2024-08-31T06:11:15.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 114955 1.82 MB/sec execute 185 sec latency 28.761 ms 2024-08-31T06:11:16.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:16 smithi053 ceph-mon[18924]: pgmap v514: 97 pgs: 97 active+clean; 68 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-08-31T06:11:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:16 smithi153 ceph-mon[22320]: pgmap v514: 97 pgs: 97 active+clean; 68 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-08-31T06:11:16.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:16 smithi130 ceph-mon[22266]: pgmap v514: 97 pgs: 97 active+clean; 68 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-08-31T06:11:16.691 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:11:16.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:11:16.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 115391 1.82 MB/sec execute 186 sec latency 21.352 ms 2024-08-31T06:11:17.019 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:11:17.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.558+0000 7f2965969640 1 -- 172.21.15.53:0/3503716983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2960102e70 msgr2=0x7f2960103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:17.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.558+0000 7f2965969640 1 --2- 172.21.15.53:0/3503716983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2960102e70 0x7f2960103280 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f2950009900 tx=0x7f295002a410 comp rx=0 tx=0).stop 2024-08-31T06:11:17.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.558+0000 7f2965969640 1 -- 172.21.15.53:0/3503716983 shutdown_connections 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.558+0000 7f2965969640 1 --2- 172.21.15.53:0/3503716983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29601058b0 0x7f296010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.558+0000 7f2965969640 1 --2- 172.21.15.53:0/3503716983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2960104f60 0x7f2960105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.558+0000 7f2965969640 1 --2- 172.21.15.53:0/3503716983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2960102e70 0x7f2960103280 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.558+0000 7f2965969640 1 -- 172.21.15.53:0/3503716983 >> 172.21.15.53:0/3503716983 conn(0x7f2960079d30 msgr2=0x7f296007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.558+0000 7f2965969640 1 -- 172.21.15.53:0/3503716983 shutdown_connections 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.559+0000 7f2965969640 1 -- 172.21.15.53:0/3503716983 wait complete. 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.559+0000 7f2965969640 1 Processor -- start 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.559+0000 7f2965969640 1 -- start start 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f2965969640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2960102e70 0x7f296019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f2965969640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2960104f60 0x7f296019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f2965969640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29601058b0 0x7f296019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f2965969640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2960112650 con 0x7f2960102e70 2024-08-31T06:11:17.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f2965969640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f29601124d0 con 0x7f2960104f60 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f2965969640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f29601127d0 con 0x7f29601058b0 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f295effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2960102e70 0x7f296019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f295e7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2960104f60 0x7f296019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f295effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2960102e70 0x7f296019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52320/0 (socket says 172.21.15.53:52320) 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f295effd640 1 -- 172.21.15.53:0/3763810616 learned_addr learned my addr 172.21.15.53:0/3763810616 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f295f7fe640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29601058b0 0x7f296019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f295effd640 1 -- 172.21.15.53:0/3763810616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29601058b0 msgr2=0x7f296019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f295effd640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29601058b0 0x7f296019f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f295effd640 1 -- 172.21.15.53:0/3763810616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2960104f60 msgr2=0x7f296019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f295effd640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2960104f60 0x7f296019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f295effd640 1 -- 172.21.15.53:0/3763810616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29601a0100 con 0x7f2960102e70 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.560+0000 7f295e7fc640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2960104f60 0x7f296019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:17.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.561+0000 7f295effd640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2960102e70 0x7f296019a190 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2950009230 tx=0x7f29500319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.561+0000 7f2964967640 1 -- 172.21.15.53:0/3763810616 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295003f030 con 0x7f2960102e70 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.561+0000 7f2965969640 1 -- 172.21.15.53:0/3763810616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29601a0390 con 0x7f2960102e70 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.561+0000 7f2964967640 1 -- 172.21.15.53:0/3763810616 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29500043d0 con 0x7f2960102e70 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.561+0000 7f2964967640 1 -- 172.21.15.53:0/3763810616 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2950035070 con 0x7f2960102e70 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.561+0000 7f2965969640 1 -- 172.21.15.53:0/3763810616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29601a6b50 con 0x7f2960102e70 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.562+0000 7f2965969640 1 -- 172.21.15.53:0/3763810616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2960103280 con 0x7f2960102e70 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.564+0000 7f2964967640 1 -- 172.21.15.53:0/3763810616 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2950042030 con 0x7f2960102e70 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.564+0000 7f2964967640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29480b4ca0 0x7f29480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.565+0000 7f295e7fc640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29480b4ca0 0x7f29480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.565+0000 7f2964967640 1 -- 172.21.15.53:0/3763810616 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f2950105d10 con 0x7f2960102e70 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.565+0000 7f295e7fc640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29480b4ca0 0x7f29480b71b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2960106220 tx=0x7f2954005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:17.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.568+0000 7f2964967640 1 -- 172.21.15.53:0/3763810616 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f29500cc430 con 0x7f2960102e70 2024-08-31T06:11:17.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.814+0000 7f2965969640 1 -- 172.21.15.53:0/3763810616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f296019b2c0 con 0x7f2960102e70 2024-08-31T06:11:17.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.815+0000 7f2964967640 1 -- 172.21.15.53:0/3763810616 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11986 (secure 0 0 0) 0x7f29500d0bf0 con 0x7f2960102e70 2024-08-31T06:11:17.818 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:11:17.818 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":35,"btime":"2024-08-31T06:11:02:103691+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:11:01.363774+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:11:17.818 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 35 2024-08-31T06:11:17.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 -- 172.21.15.53:0/3763810616 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29480b4ca0 msgr2=0x7f29480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:17.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29480b4ca0 0x7f29480b71b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2960106220 tx=0x7f2954005f90 comp rx=0 tx=0).stop 2024-08-31T06:11:17.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 -- 172.21.15.53:0/3763810616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2960102e70 msgr2=0x7f296019a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:17.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2960102e70 0x7f296019a190 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2950009230 tx=0x7f29500319a0 comp rx=0 tx=0).stop 2024-08-31T06:11:17.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 -- 172.21.15.53:0/3763810616 shutdown_connections 2024-08-31T06:11:17.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29480b4ca0 0x7f29480b71b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:17.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29601058b0 0x7f296019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:17.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2960104f60 0x7f296019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:17.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 --2- 172.21.15.53:0/3763810616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2960102e70 0x7f296019a190 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:17.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 -- 172.21.15.53:0/3763810616 >> 172.21.15.53:0/3763810616 conn(0x7f2960079d30 msgr2=0x7f2960106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:17.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 -- 172.21.15.53:0/3763810616 shutdown_connections 2024-08-31T06:11:17.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:17.818+0000 7f2965969640 1 -- 172.21.15.53:0/3763810616 wait complete. 2024-08-31T06:11:17.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 115911 1.81 MB/sec execute 187 sec latency 67.951 ms 2024-08-31T06:11:18.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:18 smithi153 ceph-mon[22320]: pgmap v515: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.6 MiB/s wr, 154 op/s 2024-08-31T06:11:18.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:18 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3763810616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:11:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:18 smithi053 ceph-mon[18924]: pgmap v515: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.6 MiB/s wr, 154 op/s 2024-08-31T06:11:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:18 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3763810616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:11:18.523 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:11:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:18 smithi130 ceph-mon[22266]: pgmap v515: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.6 MiB/s wr, 154 op/s 2024-08-31T06:11:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:18 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3763810616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:11:18.805 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:11:18.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 116514 1.83 MB/sec execute 188 sec latency 13.054 ms 2024-08-31T06:11:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.313+0000 7f24059e9640 1 -- 172.21.15.53:0/4273232411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2400108a90 msgr2=0x7f240010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.313+0000 7f24059e9640 1 --2- 172.21.15.53:0/4273232411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2400108a90 0x7f240010f2c0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009ca0 tx=0x7f23f802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.313+0000 7f24059e9640 1 -- 172.21.15.53:0/4273232411 shutdown_connections 2024-08-31T06:11:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.313+0000 7f24059e9640 1 --2- 172.21.15.53:0/4273232411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2400108a90 0x7f240010f2c0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.313+0000 7f24059e9640 1 --2- 172.21.15.53:0/4273232411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2400108140 0x7f2400108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.313+0000 7f24059e9640 1 --2- 172.21.15.53:0/4273232411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2400102800 0x7f2400102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.313+0000 7f24059e9640 1 -- 172.21.15.53:0/4273232411 >> 172.21.15.53:0/4273232411 conn(0x7f24000794d0 msgr2=0x7f24000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.313+0000 7f24059e9640 1 -- 172.21.15.53:0/4273232411 shutdown_connections 2024-08-31T06:11:19.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.313+0000 7f24059e9640 1 -- 172.21.15.53:0/4273232411 wait complete. 2024-08-31T06:11:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.314+0000 7f24059e9640 1 Processor -- start 2024-08-31T06:11:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.314+0000 7f24059e9640 1 -- start start 2024-08-31T06:11:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f24059e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2400102800 0x7f240019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f24059e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2400108140 0x7f240019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f24059e9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2400108a90 0x7f240019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f24059e9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2400112610 con 0x7f2400108140 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f24059e9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2400112490 con 0x7f2400102800 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f24059e9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2400112790 con 0x7f2400108a90 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f23fe7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2400108140 0x7f240019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f23feffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2400102800 0x7f240019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f23fe7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2400108140 0x7f240019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52332/0 (socket says 172.21.15.53:52332) 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f23fe7fc640 1 -- 172.21.15.53:0/990199748 learned_addr learned my addr 172.21.15.53:0/990199748 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f23ff7fe640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2400108a90 0x7f240019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f23fe7fc640 1 -- 172.21.15.53:0/990199748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2400108a90 msgr2=0x7f240019f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2400108a90 0x7f240019f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f23fe7fc640 1 -- 172.21.15.53:0/990199748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2400102800 msgr2=0x7f240019a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2400102800 0x7f240019a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f23fe7fc640 1 -- 172.21.15.53:0/990199748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24001a00c0 con 0x7f2400108140 2024-08-31T06:11:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2400108140 0x7f240019a6f0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f23f400e9c0 tx=0x7f23f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.315+0000 7f24049e7640 1 -- 172.21.15.53:0/990199748 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f400cd80 con 0x7f2400108140 2024-08-31T06:11:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.316+0000 7f24049e7640 1 -- 172.21.15.53:0/990199748 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23f40054b0 con 0x7f2400108140 2024-08-31T06:11:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.316+0000 7f24059e9640 1 -- 172.21.15.53:0/990199748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24001a03b0 con 0x7f2400108140 2024-08-31T06:11:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.316+0000 7f24049e7640 1 -- 172.21.15.53:0/990199748 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4010430 con 0x7f2400108140 2024-08-31T06:11:19.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.316+0000 7f24059e9640 1 -- 172.21.15.53:0/990199748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24001a6b10 con 0x7f2400108140 2024-08-31T06:11:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f240bf5e740 1 Processor -- start 2024-08-31T06:11:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f240bf5e740 1 -- start start 2024-08-31T06:11:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f24049e7640 1 -- 172.21.15.53:0/990199748 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f23f4004f20 con 0x7f2400108140 2024-08-31T06:11:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e29070 0x5595581ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 0x5595581ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f240bf5e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559558145680 con 0x559557e001b0 2024-08-31T06:11:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f240bf5e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559558134c10 con 0x559557e29070 2024-08-31T06:11:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f240bf5e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559558138bc0 con 0x559557e08390 2024-08-31T06:11:19.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f23feffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f23feffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52348/0 (socket says 172.21.15.53:52348) 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f23feffd640 1 -- 172.21.15.53:0/4062514127 learned_addr learned my addr 172.21.15.53:0/4062514127 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.319+0000 7f23ff7fe640 1 --2- 172.21.15.53:0/4062514127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e29070 0x5595581ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/4062514127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 0x5595581ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f23ff7fe640 1 -- 172.21.15.53:0/4062514127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 msgr2=0x5595581ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f23ff7fe640 1 --2- 172.21.15.53:0/4062514127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 0x5595581ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f23ff7fe640 1 -- 172.21.15.53:0/4062514127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 msgr2=0x5595581ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f23ff7fe640 1 --2- 172.21.15.53:0/4062514127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f23ff7fe640 1 -- 172.21.15.53:0/4062514127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559557e94650 con 0x559557e29070 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/4062514127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 0x5595581ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f23feffd640 1 --2- 172.21.15.53:0/4062514127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:19.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f24049e7640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23e80b4ca0 0x7f23e80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f23ff7fe640 1 --2- 172.21.15.53:0/4062514127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e29070 0x5595581ce310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f23f8031040 tx=0x7f23f8009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23942aa89aa93600 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:19.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f23feffd640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23e80b4ca0 0x7f23e80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f24049e7640 1 -- 172.21.15.53:0/990199748 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f23f40e5aa0 con 0x7f2400108140 2024-08-31T06:11:19.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.320+0000 7f23e5ffb640 1 -- 172.21.15.53:0/4062514127 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8031790 con 0x559557e29070 2024-08-31T06:11:19.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.321+0000 7f23e5ffb640 1 -- 172.21.15.53:0/4062514127 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23f8036030 con 0x559557e29070 2024-08-31T06:11:19.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.321+0000 7f23e5ffb640 1 -- 172.21.15.53:0/4062514127 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f80042a0 con 0x559557e29070 2024-08-31T06:11:19.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.321+0000 7f240bf5e740 1 -- 172.21.15.53:0/4062514127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e29070 msgr2=0x5595581ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:19.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.321+0000 7f240bf5e740 1 --2- 172.21.15.53:0/4062514127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e29070 0x5595581ce310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f23f8031040 tx=0x7f23f8009a20 comp rx=0 tx=0).stop 2024-08-31T06:11:19.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.321+0000 7f23feffd640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23e80b4ca0 0x7f23e80b71b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x5595581ccf90 tx=0x7f23f0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:19.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.322+0000 7f240bf5e740 1 -- 172.21.15.53:0/4062514127 shutdown_connections 2024-08-31T06:11:19.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.322+0000 7f240bf5e740 1 --2- 172.21.15.53:0/4062514127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 0x5595581ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.322+0000 7f240bf5e740 1 --2- 172.21.15.53:0/4062514127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.322+0000 7f240bf5e740 1 --2- 172.21.15.53:0/4062514127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e29070 0x5595581ce310 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.322+0000 7f240bf5e740 1 -- 172.21.15.53:0/4062514127 >> 172.21.15.53:0/4062514127 conn(0x559557e1d460 msgr2=0x5595581cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:19.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.322+0000 7f240bf5e740 1 -- 172.21.15.53:0/4062514127 shutdown_connections 2024-08-31T06:11:19.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.322+0000 7f240bf5e740 1 -- 172.21.15.53:0/4062514127 wait complete. 2024-08-31T06:11:19.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.322+0000 7f240bf5e740 1 -- start start 2024-08-31T06:11:19.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.322+0000 7f240bf5e740 1 Processor -- start 2024-08-31T06:11:19.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 0x5595581dde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 0x5595581de390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e29070 0x5595581e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f240bf5e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559557f97700 con 0x559557e29070 2024-08-31T06:11:19.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f240bf5e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5595580bb750 con 0x559557e001b0 2024-08-31T06:11:19.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f240bf5e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5595581e0c10 con 0x559557e08390 2024-08-31T06:11:19.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f240bf5e740 10 client.0 _ll_register_callbacks cb 0x5595580eae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:19.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f23feffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 0x5595581dde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f23ff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e29070 0x5595581e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f23feffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 0x5595581dde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39830/0 (socket says 172.21.15.53:39830) 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f23feffd640 1 -- 172.21.15.53:0/1640729009 learned_addr learned my addr 172.21.15.53:0/1640729009 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 0x5595581de390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f23feffd640 1 -- 172.21.15.53:0/1640729009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 msgr2=0x5595581de390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f23feffd640 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 0x5595581de390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f23feffd640 1 -- 172.21.15.53:0/1640729009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e29070 msgr2=0x5595581e9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f23feffd640 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e29070 0x5595581e9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f23feffd640 1 -- 172.21.15.53:0/1640729009 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595580f4900 con 0x559557e001b0 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.323+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 0x5595581de390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f23feffd640 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 0x5595581dde50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f23f000fa60 tx=0x7f23f00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee7bb8803f64272 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f23deffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:11:19.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f23deffd640 1 -- 172.21.15.53:0/1640729009 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0004020 con 0x559557e001b0 2024-08-31T06:11:19.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f240bf5e740 1 -- 172.21.15.53:0/1640729009 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f8036030 con 0x559557e001b0 2024-08-31T06:11:19.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f23deffd640 1 -- 172.21.15.53:0/1640729009 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f23f0018030 con 0x559557e001b0 2024-08-31T06:11:19.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f23deffd640 1 -- 172.21.15.53:0/1640729009 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f23f00041c0 con 0x559557e001b0 2024-08-31T06:11:19.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f240bf5e740 10 client.26894 fetch_fsmap learned FSMap version 35 2024-08-31T06:11:19.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f240bf5e740 1 -- 172.21.15.53:0/1640729009 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5595581ec990 con 0x559557e001b0 2024-08-31T06:11:19.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f23deffd640 1 -- 172.21.15.53:0/1640729009 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23f8036030 con 0x559557e001b0 2024-08-31T06:11:19.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f23deffd640 1 -- 172.21.15.53:0/1640729009 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f23f00035f0 con 0x559557e001b0 2024-08-31T06:11:19.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f240bf5e740 10 client.26894 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T06:11:19.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f240bf5e740 10 client.26894 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:11:19.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f240bf5e740 20 client.26894 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:19.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.324+0000 7f240bf5e740 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x559557de79f0 0x5595581eff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.325+0000 7f240bf5e740 4 client.26894 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:19.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.325+0000 7f240bf5e740 1 -- 172.21.15.53:0/1640729009 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595581475d0 con 0x559557de79f0 2024-08-31T06:11:19.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.325+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x559557de79f0 0x5595581eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.325+0000 7f23deffd640 10 client.26894 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:11:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.325+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x559557de79f0 0x5595581eff40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=beda68356e7850ec server_cookie=a1bc92633f6dacb5 in_seq=0 out_seq=0 2024-08-31T06:11:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.326+0000 7f23deffd640 1 -- 172.21.15.53:0/1640729009 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595581475d0 con 0x559557de79f0 2024-08-31T06:11:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.326+0000 7f23deffd640 10 client.26894 handle_command_reply: tid=0 2024-08-31T06:11:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.326+0000 7f240bf5e740 1 client.26894 shutdown 2024-08-31T06:11:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f240bf5e740 1 -- 172.21.15.53:0/1640729009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 msgr2=0x5595581dde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f240bf5e740 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 0x5595581dde50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f23f000fa60 tx=0x7f23f00046c0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f240bf5e740 1 -- 172.21.15.53:0/1640729009 shutdown_connections 2024-08-31T06:11:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f240bf5e740 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e29070 0x5595581e9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f240bf5e740 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x559557de79f0 0x5595581eff40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f240bf5e740 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e08390 0x5595581de390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f240bf5e740 1 --2- 172.21.15.53:0/1640729009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 0x5595581dde50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f23deffd640 0 client.26894 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:11:19.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f240bf5e740 1 -- 172.21.15.53:0/1640729009 >> 172.21.15.53:0/1640729009 conn(0x559557e1d460 msgr2=0x5595581cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:19.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f240bf5e740 1 -- 172.21.15.53:0/1640729009 shutdown_connections 2024-08-31T06:11:19.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f240bf5e740 1 -- 172.21.15.53:0/1640729009 wait complete. 2024-08-31T06:11:19.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.327+0000 7f240bf5e740 20 client.26894 trim_cache size 0 max 16384 2024-08-31T06:11:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f240bf5e740 1 Processor -- start 2024-08-31T06:11:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f240bf5e740 1 -- start start 2024-08-31T06:11:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581dc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e08390 0x5595581dcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e29070 0x5595581db040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f240bf5e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f24001ad290 con 0x559557e001b0 2024-08-31T06:11:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f240bf5e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24001aee00 con 0x559557e08390 2024-08-31T06:11:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f240bf5e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f24001ad960 con 0x559557e29070 2024-08-31T06:11:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f23feffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581dc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f23feffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581dc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52378/0 (socket says 172.21.15.53:52378) 2024-08-31T06:11:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f23feffd640 1 -- 172.21.15.53:0/2557535593 learned_addr learned my addr 172.21.15.53:0/2557535593 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/2557535593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e08390 0x5595581dcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.341+0000 7f23ff7fe640 1 --2- 172.21.15.53:0/2557535593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e29070 0x5595581db040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.342+0000 7f23feffd640 1 -- 172.21.15.53:0/2557535593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e29070 msgr2=0x5595581db040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.342+0000 7f23feffd640 1 --2- 172.21.15.53:0/2557535593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e29070 0x5595581db040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.342+0000 7f23feffd640 1 -- 172.21.15.53:0/2557535593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e08390 msgr2=0x5595581dcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.342+0000 7f23feffd640 1 --2- 172.21.15.53:0/2557535593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e08390 0x5595581dcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.342+0000 7f23feffd640 1 -- 172.21.15.53:0/2557535593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595581cf150 con 0x559557e001b0 2024-08-31T06:11:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.342+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/2557535593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e08390 0x5595581dcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.342+0000 7f23feffd640 1 --2- 172.21.15.53:0/2557535593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581dc6d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005eb0 tx=0x7f23f000ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdd39034c231b06 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.342+0000 7f23e57fa640 1 -- 172.21.15.53:0/2557535593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0004360 con 0x559557e001b0 2024-08-31T06:11:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.342+0000 7f23e57fa640 1 -- 172.21.15.53:0/2557535593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23f00035f0 con 0x559557e001b0 2024-08-31T06:11:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.342+0000 7f23e57fa640 1 -- 172.21.15.53:0/2557535593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0005600 con 0x559557e001b0 2024-08-31T06:11:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.343+0000 7f240bf5e740 1 -- 172.21.15.53:0/2557535593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 msgr2=0x5595581dc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.343+0000 7f240bf5e740 1 --2- 172.21.15.53:0/2557535593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581dc6d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005eb0 tx=0x7f23f000ff20 comp rx=0 tx=0).stop 2024-08-31T06:11:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.343+0000 7f240bf5e740 1 -- 172.21.15.53:0/2557535593 shutdown_connections 2024-08-31T06:11:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.343+0000 7f240bf5e740 1 --2- 172.21.15.53:0/2557535593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e29070 0x5595581db040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.343+0000 7f240bf5e740 1 --2- 172.21.15.53:0/2557535593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e08390 0x5595581dcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.343+0000 7f240bf5e740 1 --2- 172.21.15.53:0/2557535593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e001b0 0x5595581dc6d0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.343+0000 7f240bf5e740 1 -- 172.21.15.53:0/2557535593 >> 172.21.15.53:0/2557535593 conn(0x559557e1d460 msgr2=0x5595581d8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:19.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.343+0000 7f240bf5e740 1 -- 172.21.15.53:0/2557535593 shutdown_connections 2024-08-31T06:11:19.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.343+0000 7f240bf5e740 1 -- 172.21.15.53:0/2557535593 wait complete. 2024-08-31T06:11:19.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.343+0000 7f240bf5e740 1 -- start start 2024-08-31T06:11:19.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f240bf5e740 1 Processor -- start 2024-08-31T06:11:19.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 0x5595581e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e08390 0x5595581e2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f240bf5e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e29070 0x5595581e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f240bf5e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f24001ae730 con 0x559557e08390 2024-08-31T06:11:19.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f240bf5e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24001ae030 con 0x559557e001b0 2024-08-31T06:11:19.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f240bf5e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f24001ab290 con 0x559557e29070 2024-08-31T06:11:19.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f240bf5e740 10 client.0 _ll_register_callbacks cb 0x7f23f00099f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:19.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f23fe7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e08390 0x5595581e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f23feffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 0x5595581e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f23ff7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e29070 0x5595581e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f23fe7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e08390 0x5595581e2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52386/0 (socket says 172.21.15.53:52386) 2024-08-31T06:11:19.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.344+0000 7f23fe7fc640 1 -- 172.21.15.53:0/564401065 learned_addr learned my addr 172.21.15.53:0/564401065 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f23feffd640 1 -- 172.21.15.53:0/564401065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e29070 msgr2=0x5595581e2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f23feffd640 1 --2- 172.21.15.53:0/564401065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e29070 0x5595581e2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f23feffd640 1 -- 172.21.15.53:0/564401065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e08390 msgr2=0x5595581e2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f23feffd640 1 --2- 172.21.15.53:0/564401065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e08390 0x5595581e2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f23feffd640 1 -- 172.21.15.53:0/564401065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559558259a80 con 0x559557e001b0 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f23feffd640 1 --2- 172.21.15.53:0/564401065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 0x5595581e1ff0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f23f0003b00 tx=0x7f23f0004590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8fa280f7ad24de9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f23deffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f23deffd640 1 -- 172.21.15.53:0/564401065 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00055f0 con 0x559557e001b0 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f23deffd640 1 -- 172.21.15.53:0/564401065 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f23f0003bd0 con 0x559557e001b0 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f240bf5e740 1 -- 172.21.15.53:0/564401065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f00035f0 con 0x559557e001b0 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f23deffd640 1 -- 172.21.15.53:0/564401065 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f23f0003df0 con 0x559557e001b0 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f240bf5e740 10 client.26900 fetch_fsmap learned FSMap version 35 2024-08-31T06:11:19.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.345+0000 7f240bf5e740 1 -- 172.21.15.53:0/564401065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55955825ad00 con 0x559557e001b0 2024-08-31T06:11:19.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.346+0000 7f23deffd640 1 -- 172.21.15.53:0/564401065 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23f00035f0 con 0x559557e001b0 2024-08-31T06:11:19.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.346+0000 7f23deffd640 1 -- 172.21.15.53:0/564401065 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f23f0038070 con 0x559557e001b0 2024-08-31T06:11:19.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.346+0000 7f240bf5e740 10 client.26900 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T06:11:19.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.346+0000 7f240bf5e740 10 client.26900 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:11:19.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.346+0000 7f240bf5e740 20 client.26900 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:19.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.346+0000 7f240bf5e740 1 --2- 172.21.15.53:0/564401065 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x559557dbcda0 0x55955825d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:19.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.346+0000 7f240bf5e740 4 client.26900 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:11:19.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.346+0000 7f240bf5e740 1 -- 172.21.15.53:0/564401065 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559558143070 con 0x559557dbcda0 2024-08-31T06:11:19.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.346+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/564401065 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x559557dbcda0 0x55955825d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:19.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f23deffd640 10 client.26900 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:11:19.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f23fe7fc640 1 --2- 172.21.15.53:0/564401065 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x559557dbcda0 0x55955825d3a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3f3253188512945a server_cookie=8d0bd119516cda18 in_seq=0 out_seq=0 2024-08-31T06:11:19.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f23deffd640 1 -- 172.21.15.53:0/564401065 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559558143070 con 0x559557dbcda0 2024-08-31T06:11:19.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f23deffd640 10 client.26900 handle_command_reply: tid=0 2024-08-31T06:11:19.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f240bf5e740 1 client.26900 shutdown 2024-08-31T06:11:19.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f240bf5e740 1 -- 172.21.15.53:0/564401065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 msgr2=0x5595581e1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:19.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f240bf5e740 1 --2- 172.21.15.53:0/564401065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 0x5595581e1ff0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f23f0003b00 tx=0x7f23f0004590 comp rx=0 tx=0).stop 2024-08-31T06:11:19.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f240bf5e740 1 -- 172.21.15.53:0/564401065 shutdown_connections 2024-08-31T06:11:19.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f240bf5e740 1 --2- 172.21.15.53:0/564401065 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x559557dbcda0 0x55955825d3a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f240bf5e740 1 --2- 172.21.15.53:0/564401065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559557e29070 0x5595581e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f240bf5e740 1 --2- 172.21.15.53:0/564401065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557e08390 0x5595581e2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f240bf5e740 1 --2- 172.21.15.53:0/564401065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559557e001b0 0x5595581e1ff0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f240bf5e740 1 -- 172.21.15.53:0/564401065 >> 172.21.15.53:0/564401065 conn(0x559557e1d460 msgr2=0x5595581dc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:19.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f23deffd640 0 client.26900 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:11:19.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.347+0000 7f240bf5e740 1 -- 172.21.15.53:0/564401065 shutdown_connections 2024-08-31T06:11:19.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f240bf5e740 1 -- 172.21.15.53:0/564401065 wait complete. 2024-08-31T06:11:19.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f240bf5e740 20 client.26900 trim_cache size 0 max 16384 2024-08-31T06:11:19.359 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:11:19.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f24059e9640 1 -- 172.21.15.53:0/990199748 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23e80b4ca0 msgr2=0x7f23e80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:19.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f24059e9640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23e80b4ca0 0x7f23e80b71b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x5595581ccf90 tx=0x7f23f0005f90 comp rx=0 tx=0).stop 2024-08-31T06:11:19.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f24059e9640 1 -- 172.21.15.53:0/990199748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2400108140 msgr2=0x7f240019a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:19.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f24059e9640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2400108140 0x7f240019a6f0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f23f400e9c0 tx=0x7f23f400ee80 comp rx=0 tx=0).stop 2024-08-31T06:11:19.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f24059e9640 1 -- 172.21.15.53:0/990199748 shutdown_connections 2024-08-31T06:11:19.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f24059e9640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23e80b4ca0 0x7f23e80b71b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f24059e9640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2400108a90 0x7f240019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f24059e9640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2400108140 0x7f240019a6f0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f24059e9640 1 --2- 172.21.15.53:0/990199748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2400102800 0x7f240019a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:19.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.348+0000 7f24059e9640 1 -- 172.21.15.53:0/990199748 >> 172.21.15.53:0/990199748 conn(0x7f24000794d0 msgr2=0x7f240006afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:19.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.349+0000 7f24059e9640 1 -- 172.21.15.53:0/990199748 shutdown_connections 2024-08-31T06:11:19.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:19.349+0000 7f24059e9640 1 -- 172.21.15.53:0/990199748 wait complete. 2024-08-31T06:11:19.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 117032 1.85 MB/sec execute 189 sec latency 12.358 ms 2024-08-31T06:11:20.187 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:11:20.209 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:20 smithi053 ceph-mon[18924]: pgmap v516: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-08-31T06:11:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:20 smithi153 ceph-mon[22320]: pgmap v516: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-08-31T06:11:20.461 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:11:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:20 smithi130 ceph-mon[22266]: pgmap v516: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-08-31T06:11:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.810+0000 7fbaca894640 1 -- 172.21.15.53:0/2155584948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac41091d0 msgr2=0x7fbac41095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.810+0000 7fbaca894640 1 --2- 172.21.15.53:0/2155584948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac41091d0 0x7fbac41095e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009900 tx=0x7fbab802a410 comp rx=0 tx=0).stop 2024-08-31T06:11:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.810+0000 7fbaca894640 1 -- 172.21.15.53:0/2155584948 shutdown_connections 2024-08-31T06:11:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.810+0000 7fbaca894640 1 --2- 172.21.15.53:0/2155584948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4109b20 0x7fbac4110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.810+0000 7fbaca894640 1 --2- 172.21.15.53:0/2155584948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac41091d0 0x7fbac41095e0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.810+0000 7fbaca894640 1 --2- 172.21.15.53:0/2155584948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac4101e00 0x7fbac4102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.810+0000 7fbaca894640 1 -- 172.21.15.53:0/2155584948 >> 172.21.15.53:0/2155584948 conn(0x7fbac4079c30 msgr2=0x7fbac407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.810+0000 7fbaca894640 1 -- 172.21.15.53:0/2155584948 shutdown_connections 2024-08-31T06:11:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.810+0000 7fbaca894640 1 -- 172.21.15.53:0/2155584948 wait complete. 2024-08-31T06:11:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbaca894640 1 Processor -- start 2024-08-31T06:11:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbaca894640 1 -- start start 2024-08-31T06:11:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbaca894640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4101e00 0x7fbac419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbaca894640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac41091d0 0x7fbac419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbaca894640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac4109b20 0x7fbac419f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbaca894640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbac4113650 con 0x7fbac4109b20 2024-08-31T06:11:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbaca894640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41134d0 con 0x7fbac41091d0 2024-08-31T06:11:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbaca894640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41137d0 con 0x7fbac4101e00 2024-08-31T06:11:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbac8e31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac4109b20 0x7fbac419f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbac8e31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac4109b20 0x7fbac419f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52404/0 (socket says 172.21.15.53:52404) 2024-08-31T06:11:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbac8e31640 1 -- 172.21.15.53:0/1757122910 learned_addr learned my addr 172.21.15.53:0/1757122910 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.811+0000 7fbac3fff640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4101e00 0x7fbac419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.812+0000 7fbac8e31640 1 -- 172.21.15.53:0/1757122910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4101e00 msgr2=0x7fbac419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.812+0000 7fbac8e31640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4101e00 0x7fbac419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.812+0000 7fbac8e31640 1 -- 172.21.15.53:0/1757122910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac41091d0 msgr2=0x7fbac419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.812+0000 7fbac8e31640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac41091d0 0x7fbac419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.812+0000 7fbac8e31640 1 -- 172.21.15.53:0/1757122910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac41a0040 con 0x7fbac4109b20 2024-08-31T06:11:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.812+0000 7fbac8e31640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac4109b20 0x7fbac419f940 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00eb10 tx=0x7fbabc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.812+0000 7fbac17fa640 1 -- 172.21.15.53:0/1757122910 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc004b20 con 0x7fbac4109b20 2024-08-31T06:11:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.812+0000 7fbaca894640 1 -- 172.21.15.53:0/1757122910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac41a0330 con 0x7fbac4109b20 2024-08-31T06:11:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.812+0000 7fbac17fa640 1 -- 172.21.15.53:0/1757122910 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbabc004cc0 con 0x7fbac4109b20 2024-08-31T06:11:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.812+0000 7fbac17fa640 1 -- 172.21.15.53:0/1757122910 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc010690 con 0x7fbac4109b20 2024-08-31T06:11:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.812+0000 7fbaca894640 1 -- 172.21.15.53:0/1757122910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac41a6ac0 con 0x7fbac4109b20 2024-08-31T06:11:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.815+0000 7fbad1803740 1 Processor -- start 2024-08-31T06:11:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.815+0000 7fbac17fa640 1 -- 172.21.15.53:0/1757122910 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbabc005020 con 0x7fbac4109b20 2024-08-31T06:11:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.815+0000 7fbad1803740 1 -- start start 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.815+0000 7fbad1803740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa63901b0 0x560aa6733ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.815+0000 7fbad1803740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa6734000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.815+0000 7fbad1803740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa6734540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.815+0000 7fbad1803740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560aa66a9000 con 0x560aa636f4d0 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.815+0000 7fbad1803740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560aa6698590 con 0x560aa63672f0 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.815+0000 7fbad1803740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560aa669c540 con 0x560aa63901b0 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa6734000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa63901b0 0x560aa6733ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa6734000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39874/0 (socket says 172.21.15.53:39874) 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac3fff640 1 -- 172.21.15.53:0/2279956835 learned_addr learned my addr 172.21.15.53:0/2279956835 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac37fe640 1 --2- 172.21.15.53:0/2279956835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa6734540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac3fff640 1 -- 172.21.15.53:0/2279956835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa63901b0 msgr2=0x560aa6733ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac3fff640 1 --2- 172.21.15.53:0/2279956835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa63901b0 0x560aa6733ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac3fff640 1 -- 172.21.15.53:0/2279956835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 msgr2=0x560aa6734540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac3fff640 1 --2- 172.21.15.53:0/2279956835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa6734540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac3fff640 1 -- 172.21.15.53:0/2279956835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa63fb790 con 0x560aa63672f0 2024-08-31T06:11:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac17fa640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaac0b4ca0 0x7fbaac0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac3fff640 1 --2- 172.21.15.53:0/2279956835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa6734000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbab400bd80 tx=0x7fbab40107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=258b567f278aa785 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac37fe640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaac0b4ca0 0x7fbaac0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbac17fa640 1 -- 172.21.15.53:0/1757122910 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fbabc0e5b20 con 0x7fbac4109b20 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbaaa7fc640 1 -- 172.21.15.53:0/2279956835 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4005020 con 0x560aa63672f0 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbaaa7fc640 1 -- 172.21.15.53:0/2279956835 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbab40047a0 con 0x560aa63672f0 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.816+0000 7fbaaa7fc640 1 -- 172.21.15.53:0/2279956835 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab40116a0 con 0x560aa63672f0 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.817+0000 7fbad1803740 1 -- 172.21.15.53:0/2279956835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 msgr2=0x560aa6734000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.817+0000 7fbad1803740 1 --2- 172.21.15.53:0/2279956835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa6734000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbab400bd80 tx=0x7fbab40107a0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.817+0000 7fbac37fe640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaac0b4ca0 0x7fbaac0b71b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009230 tx=0x7fbab8005fd0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.817+0000 7fbad1803740 1 -- 172.21.15.53:0/2279956835 shutdown_connections 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.817+0000 7fbad1803740 1 --2- 172.21.15.53:0/2279956835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa6734540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.817+0000 7fbad1803740 1 --2- 172.21.15.53:0/2279956835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa6734000 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.817+0000 7fbad1803740 1 --2- 172.21.15.53:0/2279956835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa63901b0 0x560aa6733ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.817+0000 7fbad1803740 1 -- 172.21.15.53:0/2279956835 >> 172.21.15.53:0/2279956835 conn(0x560aa6384300 msgr2=0x560aa67319b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.818+0000 7fbad1803740 1 -- 172.21.15.53:0/2279956835 shutdown_connections 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.818+0000 7fbad1803740 1 -- 172.21.15.53:0/2279956835 wait complete. 2024-08-31T06:11:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.818+0000 7fbad1803740 1 -- start start 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.818+0000 7fbad1803740 1 Processor -- start 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbad1803740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa673f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbad1803740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa673fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbad1803740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa63901b0 0x560aa674b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbad1803740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560aa65d1ab0 con 0x560aa636f4d0 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbad1803740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560aa661f680 con 0x560aa63672f0 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbad1803740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560aa6742240 con 0x560aa63901b0 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbad1803740 10 client.0 _ll_register_callbacks cb 0x560aa63a7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa673fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa673f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa673fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52408/0 (socket says 172.21.15.53:52408) 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa673f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39888/0 (socket says 172.21.15.53:39888) 2024-08-31T06:11:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac37fe640 1 -- 172.21.15.53:0/2984427969 learned_addr learned my addr 172.21.15.53:0/2984427969 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac8e31640 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa63901b0 0x560aa674b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac3fff640 1 -- 172.21.15.53:0/2984427969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa63901b0 msgr2=0x560aa674b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac3fff640 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa63901b0 0x560aa674b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac3fff640 1 -- 172.21.15.53:0/2984427969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 msgr2=0x560aa673fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac3fff640 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa673fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac3fff640 1 -- 172.21.15.53:0/2984427969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa6474620 con 0x560aa63672f0 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac8e31640 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa63901b0 0x560aa674b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbac3fff640 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa673f650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x560aa6732740 tx=0x7fbab4004f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0471f4e3997aebc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.819+0000 7fbaa37fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2984427969 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4029060 con 0x560aa63672f0 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2984427969 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fbab4004fe0 con 0x560aa63672f0 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbad1803740 1 -- 172.21.15.53:0/2984427969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbab40047a0 con 0x560aa63672f0 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2984427969 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbab40051e0 con 0x560aa63672f0 2024-08-31T06:11:20.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbad1803740 10 client.26909 fetch_fsmap learned FSMap version 35 2024-08-31T06:11:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbad1803740 1 -- 172.21.15.53:0/2984427969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560aa674e260 con 0x560aa63672f0 2024-08-31T06:11:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2984427969 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbab40047a0 con 0x560aa63672f0 2024-08-31T06:11:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2984427969 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fbab4023030 con 0x560aa63672f0 2024-08-31T06:11:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbad1803740 10 client.26909 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T06:11:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbad1803740 10 client.26909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbad1803740 20 client.26909 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbad1803740 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa634ed80 0x560aa6751620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbad1803740 4 client.26909 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.820+0000 7fbad1803740 1 -- 172.21.15.53:0/2984427969 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560aa66aaf50 con 0x560aa634ed80 2024-08-31T06:11:20.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.821+0000 7fbac37fe640 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa634ed80 0x560aa6751620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.821+0000 7fbac37fe640 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa634ed80 0x560aa6751620 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc4ff756dab2d918 server_cookie=769b4100bb260f32 in_seq=0 out_seq=0 2024-08-31T06:11:20.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.821+0000 7fbaa37fe640 10 client.26909 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:20.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2984427969 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560aa66aaf50 con 0x560aa634ed80 2024-08-31T06:11:20.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbaa37fe640 10 client.26909 handle_command_reply: tid=0 2024-08-31T06:11:20.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 1 client.26909 shutdown 2024-08-31T06:11:20.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 1 -- 172.21.15.53:0/2984427969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 msgr2=0x560aa673f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:20.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa673f650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x560aa6732740 tx=0x7fbab4004f40 comp rx=0 tx=0).stop 2024-08-31T06:11:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 1 -- 172.21.15.53:0/2984427969 shutdown_connections 2024-08-31T06:11:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa634ed80 0x560aa6751620 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa63901b0 0x560aa674b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbaa37fe640 0 client.26909 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa673fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 1 --2- 172.21.15.53:0/2984427969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa673f650 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 1 -- 172.21.15.53:0/2984427969 >> 172.21.15.53:0/2984427969 conn(0x560aa6384300 msgr2=0x560aa6734af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 1 -- 172.21.15.53:0/2984427969 shutdown_connections 2024-08-31T06:11:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 1 -- 172.21.15.53:0/2984427969 wait complete. 2024-08-31T06:11:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.822+0000 7fbad1803740 20 client.26909 trim_cache size 0 max 16384 2024-08-31T06:11:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.838+0000 7fbad1803740 1 Processor -- start 2024-08-31T06:11:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.838+0000 7fbad1803740 1 -- start start 2024-08-31T06:11:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.838+0000 7fbad1803740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa634ed80 0x560aa673c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.838+0000 7fbad1803740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa673cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.838+0000 7fbad1803740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa6754650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.838+0000 7fbad1803740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41af560 con 0x560aa636f4d0 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.838+0000 7fbad1803740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41b10d0 con 0x560aa63672f0 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.838+0000 7fbad1803740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41afc30 con 0x560aa634ed80 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbac37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa673cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbac8e31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa6754650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbac3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa634ed80 0x560aa673c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbac37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa673cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39892/0 (socket says 172.21.15.53:39892) 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbac37fe640 1 -- 172.21.15.53:0/36184619 learned_addr learned my addr 172.21.15.53:0/36184619 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbac3fff640 1 -- 172.21.15.53:0/36184619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 msgr2=0x560aa673cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbac3fff640 1 --2- 172.21.15.53:0/36184619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa673cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbac3fff640 1 -- 172.21.15.53:0/36184619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 msgr2=0x560aa6754650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbac3fff640 1 --2- 172.21.15.53:0/36184619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa6754650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbac3fff640 1 -- 172.21.15.53:0/36184619 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa6736260 con 0x560aa634ed80 2024-08-31T06:11:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbac3fff640 1 --2- 172.21.15.53:0/36184619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa634ed80 0x560aa673c610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000c00 tx=0x7fbab400b650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=974e25beb9ea0cf5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbaa9ffb640 1 -- 172.21.15.53:0/36184619 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4029070 con 0x560aa634ed80 2024-08-31T06:11:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbaa9ffb640 1 -- 172.21.15.53:0/36184619 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbab4004fb0 con 0x560aa634ed80 2024-08-31T06:11:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.839+0000 7fbaa9ffb640 1 -- 172.21.15.53:0/36184619 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4005380 con 0x560aa634ed80 2024-08-31T06:11:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.840+0000 7fbad1803740 1 -- 172.21.15.53:0/36184619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa634ed80 msgr2=0x560aa673c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.840+0000 7fbad1803740 1 --2- 172.21.15.53:0/36184619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa634ed80 0x560aa673c610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000c00 tx=0x7fbab400b650 comp rx=0 tx=0).stop 2024-08-31T06:11:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.840+0000 7fbad1803740 1 -- 172.21.15.53:0/36184619 shutdown_connections 2024-08-31T06:11:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.840+0000 7fbad1803740 1 --2- 172.21.15.53:0/36184619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa636f4d0 0x560aa6754650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.840+0000 7fbad1803740 1 --2- 172.21.15.53:0/36184619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa673cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.840+0000 7fbad1803740 1 --2- 172.21.15.53:0/36184619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa634ed80 0x560aa673c610 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.840+0000 7fbad1803740 1 -- 172.21.15.53:0/36184619 >> 172.21.15.53:0/36184619 conn(0x560aa6384300 msgr2=0x560aa673dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.840+0000 7fbad1803740 1 -- 172.21.15.53:0/36184619 shutdown_connections 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.840+0000 7fbad1803740 1 -- 172.21.15.53:0/36184619 wait complete. 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbad1803740 1 -- start start 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbad1803740 1 Processor -- start 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbad1803740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa634ed80 0x560aa67afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbad1803740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa67b0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbad1803740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa636f4d0 0x560aa67b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbad1803740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41b0a00 con 0x560aa634ed80 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbad1803740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41b0300 con 0x560aa63672f0 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbad1803740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbac41ad560 con 0x560aa636f4d0 2024-08-31T06:11:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbad1803740 10 client.0 _ll_register_callbacks cb 0x7fbabc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbac3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa634ed80 0x560aa67afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbac3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa634ed80 0x560aa67afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52426/0 (socket says 172.21.15.53:52426) 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbac3fff640 1 -- 172.21.15.53:0/2404161654 learned_addr learned my addr 172.21.15.53:0/2404161654 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbac37fe640 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa67b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.841+0000 7fbac8e31640 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa636f4d0 0x560aa67b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbac3fff640 1 -- 172.21.15.53:0/2404161654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa636f4d0 msgr2=0x560aa67b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbac3fff640 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa636f4d0 0x560aa67b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbac3fff640 1 -- 172.21.15.53:0/2404161654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 msgr2=0x560aa67b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbac3fff640 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa67b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbac3fff640 1 -- 172.21.15.53:0/2404161654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa67bafb0 con 0x560aa634ed80 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbac37fe640 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa67b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbac3fff640 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa634ed80 0x560aa67afd30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fbab4004f80 tx=0x7fbab4005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae553778003a7a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbaa37fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2404161654 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4029070 con 0x560aa634ed80 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2404161654 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fbab4004660 con 0x560aa634ed80 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbad1803740 1 -- 172.21.15.53:0/2404161654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbab4004fb0 con 0x560aa634ed80 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2404161654 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbab4045050 con 0x560aa634ed80 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbad1803740 10 client.17586 fetch_fsmap learned FSMap version 35 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.842+0000 7fbad1803740 1 -- 172.21.15.53:0/2404161654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560aa67bc200 con 0x560aa634ed80 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.843+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2404161654 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbab4004fb0 con 0x560aa634ed80 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.843+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2404161654 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fbab4023040 con 0x560aa634ed80 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.843+0000 7fbad1803740 10 client.17586 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.843+0000 7fbad1803740 10 client.17586 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.843+0000 7fbad1803740 20 client.17586 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.843+0000 7fbad1803740 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa63901b0 0x560aa67be920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.843+0000 7fbad1803740 4 client.17586 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:11:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.843+0000 7fbad1803740 1 -- 172.21.15.53:0/2404161654 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560aa66a69f0 con 0x560aa63901b0 2024-08-31T06:11:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.843+0000 7fbac37fe640 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa63901b0 0x560aa67be920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.843+0000 7fbaa37fe640 10 client.17586 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:20.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.843+0000 7fbac37fe640 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa63901b0 0x560aa67be920 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=218ff2265c8616b5 server_cookie=90b4b9684f2071af in_seq=0 out_seq=0 2024-08-31T06:11:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2404161654 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560aa66a69f0 con 0x560aa63901b0 2024-08-31T06:11:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbaa37fe640 10 client.17586 handle_command_reply: tid=0 2024-08-31T06:11:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbad1803740 1 client.17586 shutdown 2024-08-31T06:11:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbad1803740 1 -- 172.21.15.53:0/2404161654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa634ed80 msgr2=0x560aa67afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbad1803740 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa634ed80 0x560aa67afd30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fbab4004f80 tx=0x7fbab4005c20 comp rx=0 tx=0).stop 2024-08-31T06:11:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbad1803740 1 -- 172.21.15.53:0/2404161654 shutdown_connections 2024-08-31T06:11:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbad1803740 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa63901b0 0x560aa67be920 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbad1803740 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa636f4d0 0x560aa67b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbad1803740 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa63672f0 0x560aa67b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbaa37fe640 0 client.17586 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbad1803740 1 --2- 172.21.15.53:0/2404161654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa634ed80 0x560aa67afd30 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.865+0000 7fbad1803740 1 -- 172.21.15.53:0/2404161654 >> 172.21.15.53:0/2404161654 conn(0x560aa6384300 msgr2=0x560aa6740700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:20.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbad1803740 1 -- 172.21.15.53:0/2404161654 shutdown_connections 2024-08-31T06:11:20.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbad1803740 1 -- 172.21.15.53:0/2404161654 wait complete. 2024-08-31T06:11:20.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbad1803740 20 client.17586 trim_cache size 0 max 16384 2024-08-31T06:11:20.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:11:20.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:11:20.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:11:20.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:11:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 -- 172.21.15.53:0/1757122910 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaac0b4ca0 msgr2=0x7fbaac0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaac0b4ca0 0x7fbaac0b71b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009230 tx=0x7fbab8005fd0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 -- 172.21.15.53:0/1757122910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac4109b20 msgr2=0x7fbac419f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac4109b20 0x7fbac419f940 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00eb10 tx=0x7fbabc00c2d0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 -- 172.21.15.53:0/1757122910 shutdown_connections 2024-08-31T06:11:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaac0b4ca0 0x7fbaac0b71b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac4109b20 0x7fbac419f940 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac41091d0 0x7fbac419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 --2- 172.21.15.53:0/1757122910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac4101e00 0x7fbac419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:20.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 -- 172.21.15.53:0/1757122910 >> 172.21.15.53:0/1757122910 conn(0x7fbac4079c30 msgr2=0x7fbac41072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:20.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 -- 172.21.15.53:0/1757122910 shutdown_connections 2024-08-31T06:11:20.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:20.866+0000 7fbaca894640 1 -- 172.21.15.53:0/1757122910 wait complete. 2024-08-31T06:11:20.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 117381 1.85 MB/sec execute 190 sec latency 58.525 ms 2024-08-31T06:11:21.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.988+0000 7f6c814a9640 1 -- 172.21.15.53:0/3829835440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c108ac0 msgr2=0x7f6c7c10f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:21.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.988+0000 7f6c814a9640 1 --2- 172.21.15.53:0/3829835440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c108ac0 0x7f6c7c10f2f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009ca0 tx=0x7f6c7402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.988+0000 7f6c814a9640 1 -- 172.21.15.53:0/3829835440 shutdown_connections 2024-08-31T06:11:21.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.988+0000 7f6c814a9640 1 --2- 172.21.15.53:0/3829835440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c108ac0 0x7f6c7c10f2f0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.988+0000 7f6c814a9640 1 --2- 172.21.15.53:0/3829835440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c7c108170 0x7f6c7c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.988+0000 7f6c814a9640 1 --2- 172.21.15.53:0/3829835440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c102880 0x7f6c7c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.988+0000 7f6c814a9640 1 -- 172.21.15.53:0/3829835440 >> 172.21.15.53:0/3829835440 conn(0x7f6c7c079550 msgr2=0x7f6c7c079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:21.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.988+0000 7f6c814a9640 1 -- 172.21.15.53:0/3829835440 shutdown_connections 2024-08-31T06:11:21.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.988+0000 7f6c814a9640 1 -- 172.21.15.53:0/3829835440 wait complete. 2024-08-31T06:11:21.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.989+0000 7f6c814a9640 1 Processor -- start 2024-08-31T06:11:21.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.989+0000 7f6c814a9640 1 -- start start 2024-08-31T06:11:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c814a9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c102880 0x7f6c7c19aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c814a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c108170 0x7f6c7c19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c814a9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c7c108ac0 0x7f6c7c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c814a9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c112670 con 0x7f6c7c108170 2024-08-31T06:11:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c814a9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c1124f0 con 0x7f6c7c108ac0 2024-08-31T06:11:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c814a9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c1127f0 con 0x7f6c7c102880 2024-08-31T06:11:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c7a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c108170 0x7f6c7c19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c7a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c108170 0x7f6c7c19b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52458/0 (socket says 172.21.15.53:52458) 2024-08-31T06:11:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1229940244 learned_addr learned my addr 172.21.15.53:0/1229940244 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c7affd640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c102880 0x7f6c7c19aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c7b7fe640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c7c108ac0 0x7f6c7c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1229940244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c102880 msgr2=0x7f6c7c19aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c102880 0x7f6c7c19aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1229940244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c7c108ac0 msgr2=0x7f6c7c19b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c7c108ac0 0x7f6c7c19b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1229940244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c1a6140 con 0x7f6c7c108170 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c108170 0x7f6c7c19b400 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009d80 tx=0x7f6c7000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.990+0000 7f6c63fff640 1 -- 172.21.15.53:0/1229940244 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7001f070 con 0x7f6c7c108170 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.991+0000 7f6c814a9640 1 -- 172.21.15.53:0/1229940244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7c198d10 con 0x7f6c7c108170 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.991+0000 7f6c63fff640 1 -- 172.21.15.53:0/1229940244 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c70011750 con 0x7f6c7c108170 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.991+0000 7f6c63fff640 1 -- 172.21.15.53:0/1229940244 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7001a690 con 0x7f6c7c108170 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.991+0000 7f6c814a9640 1 -- 172.21.15.53:0/1229940244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7c1992a0 con 0x7f6c7c108170 2024-08-31T06:11:21.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.993+0000 7f6c87a1e740 1 Processor -- start 2024-08-31T06:11:21.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.993+0000 7f6c87a1e740 1 -- start start 2024-08-31T06:11:21.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec072d070 0x561ec0ad2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c63fff640 1 -- 172.21.15.53:0/1229940244 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6c70022070 con 0x7f6c7c108170 2024-08-31T06:11:21.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 0x561ec0ad2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec070c390 0x561ec0ad2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561ec0a49680 con 0x561ec07041b0 2024-08-31T06:11:21.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561ec0a38c10 con 0x561ec072d070 2024-08-31T06:11:21.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561ec0a3cbc0 con 0x561ec070c390 2024-08-31T06:11:21.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c7affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 0x561ec0ad2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c7a7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec070c390 0x561ec0ad2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c7affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 0x561ec0ad2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52464/0 (socket says 172.21.15.53:52464) 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c7affd640 1 -- 172.21.15.53:0/3561545176 learned_addr learned my addr 172.21.15.53:0/3561545176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c7b7fe640 1 --2- 172.21.15.53:0/3561545176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec072d070 0x561ec0ad2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c7affd640 1 -- 172.21.15.53:0/3561545176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec070c390 msgr2=0x561ec0ad2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c7affd640 1 --2- 172.21.15.53:0/3561545176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec070c390 0x561ec0ad2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c7affd640 1 -- 172.21.15.53:0/3561545176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec072d070 msgr2=0x561ec0ad2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c7affd640 1 --2- 172.21.15.53:0/3561545176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec072d070 0x561ec0ad2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c7affd640 1 -- 172.21.15.53:0/3561545176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ec0798650 con 0x561ec07041b0 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.994+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/3561545176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec070c390 0x561ec0ad2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.995+0000 7f6c7affd640 1 --2- 172.21.15.53:0/3561545176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 0x561ec0ad2850 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00ac80 tx=0x7f6c6c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8e17d38344cc96 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.995+0000 7f6c617fa640 1 -- 172.21.15.53:0/3561545176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c01d070 con 0x561ec07041b0 2024-08-31T06:11:21.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.995+0000 7f6c63fff640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c640b4ca0 0x7f6c640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.995+0000 7f6c617fa640 1 -- 172.21.15.53:0/3561545176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c6c018ad0 con 0x561ec07041b0 2024-08-31T06:11:21.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.995+0000 7f6c617fa640 1 -- 172.21.15.53:0/3561545176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c010ae0 con 0x561ec07041b0 2024-08-31T06:11:21.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.995+0000 7f6c7b7fe640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c640b4ca0 0x7f6c640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.995+0000 7f6c63fff640 1 -- 172.21.15.53:0/1229940244 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f6c700e8f10 con 0x7f6c7c108170 2024-08-31T06:11:21.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c87a1e740 1 -- 172.21.15.53:0/3561545176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 msgr2=0x561ec0ad2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c7b7fe640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c640b4ca0 0x7f6c640b71b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c06c6a0 tx=0x7f6c74005fd0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/3561545176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 0x561ec0ad2850 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00ac80 tx=0x7f6c6c00f790 comp rx=0 tx=0).stop 2024-08-31T06:11:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c87a1e740 1 -- 172.21.15.53:0/3561545176 shutdown_connections 2024-08-31T06:11:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/3561545176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec070c390 0x561ec0ad2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/3561545176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 0x561ec0ad2850 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/3561545176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec072d070 0x561ec0ad2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c87a1e740 1 -- 172.21.15.53:0/3561545176 >> 172.21.15.53:0/3561545176 conn(0x561ec0721460 msgr2=0x561ec0ad0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c87a1e740 1 -- 172.21.15.53:0/3561545176 shutdown_connections 2024-08-31T06:11:21.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c87a1e740 1 -- 172.21.15.53:0/3561545176 wait complete. 2024-08-31T06:11:21.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c87a1e740 1 -- start start 2024-08-31T06:11:21.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.996+0000 7f6c87a1e740 1 Processor -- start 2024-08-31T06:11:21.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 0x561ec0adda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec070c390 0x561ec0addf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec072d070 0x561ec0ae9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561ec089b700 con 0x561ec07041b0 2024-08-31T06:11:21.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561ec09bf750 con 0x561ec070c390 2024-08-31T06:11:21.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561ec0ae0af0 con 0x561ec072d070 2024-08-31T06:11:21.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c87a1e740 10 client.0 _ll_register_callbacks cb 0x561ec09eee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:21.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 0x561ec0adda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec070c390 0x561ec0addf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec070c390 0x561ec0addf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39934/0 (socket says 172.21.15.53:39934) 2024-08-31T06:11:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 0x561ec0adda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52480/0 (socket says 172.21.15.53:52480) 2024-08-31T06:11:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1385495920 learned_addr learned my addr 172.21.15.53:0/1385495920 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7b7fe640 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec072d070 0x561ec0ae9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1385495920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec072d070 msgr2=0x561ec0ae9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec072d070 0x561ec0ae9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1385495920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 msgr2=0x561ec0adda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 0x561ec0adda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1385495920 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ec09f8900 con 0x561ec070c390 2024-08-31T06:11:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.997+0000 7f6c7b7fe640 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec072d070 0x561ec0ae9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:11:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec070c390 0x561ec0addf70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6c700ac900 tx=0x7f6c700af460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b907224e22c58cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:11:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1385495920 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700aee00 con 0x561ec070c390 2024-08-31T06:11:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1385495920 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f6c700b8680 con 0x561ec070c390 2024-08-31T06:11:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1385495920 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c6c018ad0 con 0x561ec070c390 2024-08-31T06:11:21.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1385495920 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6c700af1a0 con 0x561ec070c390 2024-08-31T06:11:21.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c87a1e740 10 client.26927 fetch_fsmap learned FSMap version 35 2024-08-31T06:11:21.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1385495920 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561ec0aec8c0 con 0x561ec070c390 2024-08-31T06:11:21.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1385495920 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c6c018ad0 con 0x561ec070c390 2024-08-31T06:11:21.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1385495920 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f6c700ab000 con 0x561ec070c390 2024-08-31T06:11:21.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c87a1e740 10 client.26927 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T06:11:21.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c87a1e740 10 client.26927 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:11:21.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c87a1e740 20 client.26927 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:21.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x561ec06eb9f0 0x561ec0aefde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c87a1e740 4 client.26927 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.998+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1385495920 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ec0a4b5d0 con 0x561ec06eb9f0 2024-08-31T06:11:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.999+0000 7f6c7affd640 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x561ec06eb9f0 0x561ec0aefde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.999+0000 7f6c7affd640 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x561ec06eb9f0 0x561ec0aefde0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=78851e8b751dfab1 server_cookie=69121b2a23240c29 in_seq=0 out_seq=0 2024-08-31T06:11:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:20.999+0000 7f6c5eff5640 10 client.26927 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:11:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1385495920 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ec0a4b5d0 con 0x561ec06eb9f0 2024-08-31T06:11:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c5eff5640 10 client.26927 handle_command_reply: tid=0 2024-08-31T06:11:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 1 client.26927 shutdown 2024-08-31T06:11:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1385495920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec070c390 msgr2=0x561ec0addf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec070c390 0x561ec0addf70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6c700ac900 tx=0x7f6c700af460 comp rx=0 tx=0).stop 2024-08-31T06:11:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1385495920 shutdown_connections 2024-08-31T06:11:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec072d070 0x561ec0ae9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec070c390 0x561ec0addf70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x561ec06eb9f0 0x561ec0aefde0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1385495920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec07041b0 0x561ec0adda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c5eff5640 0 client.26927 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:11:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1385495920 >> 172.21.15.53:0/1385495920 conn(0x561ec0721460 msgr2=0x561ec0ad54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:21.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1385495920 shutdown_connections 2024-08-31T06:11:21.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1385495920 wait complete. 2024-08-31T06:11:21.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.000+0000 7f6c87a1e740 20 client.26927 trim_cache size 0 max 16384 2024-08-31T06:11:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.015+0000 7f6c87a1e740 1 Processor -- start 2024-08-31T06:11:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.015+0000 7f6c87a1e740 1 -- start start 2024-08-31T06:11:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.015+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec07041b0 0x561ec0ad5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.015+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec070c390 0x561ec0ae9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.015+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec072d070 0x561ec0acfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.015+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6800e880 con 0x561ec070c390 2024-08-31T06:11:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.015+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6c680103f0 con 0x561ec072d070 2024-08-31T06:11:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.015+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6800ef50 con 0x561ec07041b0 2024-08-31T06:11:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.015+0000 7f6c7a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec070c390 0x561ec0ae9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.015+0000 7f6c7a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec070c390 0x561ec0ae9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52496/0 (socket says 172.21.15.53:52496) 2024-08-31T06:11:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.015+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1594005665 learned_addr learned my addr 172.21.15.53:0/1594005665 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.016+0000 7f6c7b7fe640 1 --2- 172.21.15.53:0/1594005665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec072d070 0x561ec0acfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.016+0000 7f6c7affd640 1 --2- 172.21.15.53:0/1594005665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec07041b0 0x561ec0ad5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.016+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1594005665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec07041b0 msgr2=0x561ec0ad5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.016+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/1594005665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec07041b0 0x561ec0ad5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.016+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1594005665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec072d070 msgr2=0x561ec0acfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.016+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/1594005665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec072d070 0x561ec0acfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.016+0000 7f6c7a7fc640 1 -- 172.21.15.53:0/1594005665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ec0ad4ba0 con 0x561ec070c390 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.016+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/1594005665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec070c390 0x561ec0ae9d70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f6c700e6c40 tx=0x7f6c700af590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931498990e0cc9a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.016+0000 7f6c60ff9640 1 -- 172.21.15.53:0/1594005665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700ab550 con 0x561ec070c390 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.016+0000 7f6c60ff9640 1 -- 172.21.15.53:0/1594005665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c700af690 con 0x561ec070c390 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.016+0000 7f6c60ff9640 1 -- 172.21.15.53:0/1594005665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700ab170 con 0x561ec070c390 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.017+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1594005665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec070c390 msgr2=0x561ec0ae9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.017+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1594005665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec070c390 0x561ec0ae9d70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f6c700e6c40 tx=0x7f6c700af590 comp rx=0 tx=0).stop 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.017+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1594005665 shutdown_connections 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.017+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1594005665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec072d070 0x561ec0acfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.017+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1594005665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec070c390 0x561ec0ae9d70 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.017+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1594005665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec07041b0 0x561ec0ad5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.017+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1594005665 >> 172.21.15.53:0/1594005665 conn(0x561ec0721460 msgr2=0x561ec0ad5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.017+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1594005665 shutdown_connections 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.017+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1594005665 wait complete. 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c87a1e740 1 -- start start 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c87a1e740 1 Processor -- start 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec07041b0 0x561ec0ae2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec070c390 0x561ec0ae2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c87a1e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec072d070 0x561ec0b597e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6800fd20 con 0x561ec072d070 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6800f620 con 0x561ec07041b0 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c87a1e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6800c880 con 0x561ec070c390 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c87a1e740 10 client.0 _ll_register_callbacks cb 0x7f6c700ec750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c7affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec07041b0 0x561ec0ae2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c7a7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec070c390 0x561ec0ae2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c7b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec072d070 0x561ec0b597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c7affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec07041b0 0x561ec0ae2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39956/0 (socket says 172.21.15.53:39956) 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.018+0000 7f6c7affd640 1 -- 172.21.15.53:0/1505295994 learned_addr learned my addr 172.21.15.53:0/1505295994 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c7affd640 1 -- 172.21.15.53:0/1505295994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec070c390 msgr2=0x561ec0ae2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c7affd640 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec070c390 0x561ec0ae2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c7affd640 1 -- 172.21.15.53:0/1505295994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec072d070 msgr2=0x561ec0b597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c7affd640 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec072d070 0x561ec0b597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c7affd640 1 -- 172.21.15.53:0/1505295994 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ec0b59d70 con 0x561ec07041b0 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c7b7fe640 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec072d070 0x561ec0b597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c7affd640 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec07041b0 0x561ec0ae2540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x561ec0ad0f90 tx=0x7f6c6c00a840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=821b7ae5abd747d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:11:21.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1505295994 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c02f070 con 0x561ec07041b0 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1505295994 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f6c6c018650 con 0x561ec07041b0 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1505295994 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c700af690 con 0x561ec07041b0 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1505295994 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6c6c03b050 con 0x561ec07041b0 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c87a1e740 10 client.26933 fetch_fsmap learned FSMap version 35 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.019+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1505295994 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561ec0b5b020 con 0x561ec07041b0 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.020+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1505295994 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c700af690 con 0x561ec07041b0 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.020+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1505295994 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f6c6c005040 con 0x561ec07041b0 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.020+0000 7f6c87a1e740 10 client.26933 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.020+0000 7f6c87a1e740 10 client.26933 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.020+0000 7f6c87a1e740 20 client.26933 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.020+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x561ec06c0da0 0x561ec0b5d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.020+0000 7f6c87a1e740 4 client.26933 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:11:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.020+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1505295994 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561ec0a47070 con 0x561ec06c0da0 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.020+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x561ec06c0da0 0x561ec0b5d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c7a7fc640 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x561ec06c0da0 0x561ec0b5d4d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e2a4709e292d2249 server_cookie=66cec8dc889096f0 in_seq=0 out_seq=0 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c5eff5640 10 client.26933 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c5eff5640 1 -- 172.21.15.53:0/1505295994 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561ec0a47070 con 0x561ec06c0da0 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c5eff5640 10 client.26933 handle_command_reply: tid=0 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 1 client.26933 shutdown 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1505295994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec07041b0 msgr2=0x561ec0ae2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec07041b0 0x561ec0ae2540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x561ec0ad0f90 tx=0x7f6c6c00a840 comp rx=0 tx=0).stop 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1505295994 shutdown_connections 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x561ec06c0da0 0x561ec0b5d4d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ec072d070 0x561ec0b597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ec070c390 0x561ec0ae2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 1 --2- 172.21.15.53:0/1505295994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ec07041b0 0x561ec0ae2540 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1505295994 >> 172.21.15.53:0/1505295994 conn(0x561ec0721460 msgr2=0x561ec0acfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c5eff5640 0 client.26933 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:11:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1505295994 shutdown_connections 2024-08-31T06:11:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 1 -- 172.21.15.53:0/1505295994 wait complete. 2024-08-31T06:11:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.021+0000 7f6c87a1e740 20 client.26933 trim_cache size 0 max 16384 2024-08-31T06:11:21.038 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:11:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 -- 172.21.15.53:0/1229940244 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c640b4ca0 msgr2=0x7f6c640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c640b4ca0 0x7f6c640b71b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c06c6a0 tx=0x7f6c74005fd0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 -- 172.21.15.53:0/1229940244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c108170 msgr2=0x7f6c7c19b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c108170 0x7f6c7c19b400 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009d80 tx=0x7f6c7000c6a0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 -- 172.21.15.53:0/1229940244 shutdown_connections 2024-08-31T06:11:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c640b4ca0 0x7f6c640b71b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c7c108ac0 0x7f6c7c19b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c108170 0x7f6c7c19b400 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 --2- 172.21.15.53:0/1229940244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c102880 0x7f6c7c19aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 -- 172.21.15.53:0/1229940244 >> 172.21.15.53:0/1229940244 conn(0x7f6c7c079550 msgr2=0x7f6c7c1061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 -- 172.21.15.53:0/1229940244 shutdown_connections 2024-08-31T06:11:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:21.022+0000 7f6c814a9640 1 -- 172.21.15.53:0/1229940244 wait complete. 2024-08-31T06:11:21.712 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:11:21.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 117628 1.84 MB/sec execute 191 sec latency 79.649 ms 2024-08-31T06:11:22.023 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:11:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:22 smithi153 ceph-mon[22320]: pgmap v517: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 1.7 MiB/s wr, 182 op/s 2024-08-31T06:11:22.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:22 smithi053 ceph-mon[18924]: pgmap v517: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 1.7 MiB/s wr, 182 op/s 2024-08-31T06:11:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:22 smithi130 ceph-mon[22266]: pgmap v517: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 1.7 MiB/s wr, 182 op/s 2024-08-31T06:11:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.615+0000 7f989800a640 1 -- 172.21.15.53:0/2575404066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98901050b0 msgr2=0x7f989010d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.615+0000 7f989800a640 1 --2- 172.21.15.53:0/2575404066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98901050b0 0x7f989010d600 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9880009900 tx=0x7f988002a410 comp rx=0 tx=0).stop 2024-08-31T06:11:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.615+0000 7f989800a640 1 -- 172.21.15.53:0/2575404066 shutdown_connections 2024-08-31T06:11:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.615+0000 7f989800a640 1 --2- 172.21.15.53:0/2575404066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f989010dbc0 0x7f98901100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.615+0000 7f989800a640 1 --2- 172.21.15.53:0/2575404066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98901050b0 0x7f989010d600 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.615+0000 7f989800a640 1 --2- 172.21.15.53:0/2575404066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9890104760 0x7f9890104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.615+0000 7f989800a640 1 -- 172.21.15.53:0/2575404066 >> 172.21.15.53:0/2575404066 conn(0x7f98900794d0 msgr2=0x7f98900798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.615+0000 7f989800a640 1 -- 172.21.15.53:0/2575404066 shutdown_connections 2024-08-31T06:11:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.615+0000 7f989800a640 1 -- 172.21.15.53:0/2575404066 wait complete. 2024-08-31T06:11:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f989800a640 1 Processor -- start 2024-08-31T06:11:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f989800a640 1 -- start start 2024-08-31T06:11:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f989800a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9890104760 0x7f989019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f989800a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98901050b0 0x7f989019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f989800a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f989010dbc0 0x7f989019f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f989800a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f98901136b0 con 0x7f98901050b0 2024-08-31T06:11:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f989800a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9890113530 con 0x7f989010dbc0 2024-08-31T06:11:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f989800a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9890113830 con 0x7f9890104760 2024-08-31T06:11:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f98955a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98901050b0 0x7f989019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f98955a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98901050b0 0x7f989019a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52530/0 (socket says 172.21.15.53:52530) 2024-08-31T06:11:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f98955a5640 1 -- 172.21.15.53:0/2206509473 learned_addr learned my addr 172.21.15.53:0/2206509473 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f98965a7640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f989010dbc0 0x7f989019f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.616+0000 7f9895da6640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9890104760 0x7f989019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f98965a7640 1 -- 172.21.15.53:0/2206509473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9890104760 msgr2=0x7f989019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f98965a7640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9890104760 0x7f989019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f98965a7640 1 -- 172.21.15.53:0/2206509473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98901050b0 msgr2=0x7f989019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f98965a7640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98901050b0 0x7f989019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f98965a7640 1 -- 172.21.15.53:0/2206509473 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98901a00d0 con 0x7f989010dbc0 2024-08-31T06:11:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f98955a5640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98901050b0 0x7f989019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f98965a7640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f989010dbc0 0x7f989019f9a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9888009fd0 tx=0x7f988800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f9886ffd640 1 -- 172.21.15.53:0/2206509473 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988800ce20 con 0x7f989010dbc0 2024-08-31T06:11:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f989800a640 1 -- 172.21.15.53:0/2206509473 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98901a03c0 con 0x7f989010dbc0 2024-08-31T06:11:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f989800a640 1 -- 172.21.15.53:0/2206509473 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98901a6b20 con 0x7f989010dbc0 2024-08-31T06:11:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f9886ffd640 1 -- 172.21.15.53:0/2206509473 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9888005020 con 0x7f989010dbc0 2024-08-31T06:11:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.617+0000 7f9886ffd640 1 -- 172.21.15.53:0/2206509473 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888010690 con 0x7f989010dbc0 2024-08-31T06:11:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.620+0000 7f989e57f740 1 Processor -- start 2024-08-31T06:11:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.621+0000 7f9886ffd640 1 -- 172.21.15.53:0/2206509473 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9888004a40 con 0x7f989010dbc0 2024-08-31T06:11:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.621+0000 7f989e57f740 1 -- start start 2024-08-31T06:11:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.621+0000 7f989e57f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fec8070 0x55891026d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.621+0000 7f989e57f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x55891026d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.621+0000 7f989e57f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 0x55891026ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.621+0000 7f989e57f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5589101e4680 con 0x55890fea7390 2024-08-31T06:11:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.621+0000 7f989e57f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5589101d3c10 con 0x55890fe9f1b0 2024-08-31T06:11:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f989e57f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5589101d7bc0 con 0x55890fec8070 2024-08-31T06:11:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f9895da6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x55891026d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f98955a5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fec8070 0x55891026d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f9895da6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x55891026d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39990/0 (socket says 172.21.15.53:39990) 2024-08-31T06:11:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f9895da6640 1 -- 172.21.15.53:0/960537759 learned_addr learned my addr 172.21.15.53:0/960537759 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f98955a5640 1 --2- 172.21.15.53:0/960537759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 0x55891026ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f9895da6640 1 -- 172.21.15.53:0/960537759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fec8070 msgr2=0x55891026d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f9895da6640 1 --2- 172.21.15.53:0/960537759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fec8070 0x55891026d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f9895da6640 1 -- 172.21.15.53:0/960537759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 msgr2=0x55891026ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f9895da6640 1 --2- 172.21.15.53:0/960537759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 0x55891026ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f9895da6640 1 -- 172.21.15.53:0/960537759 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890ff33650 con 0x55890fe9f1b0 2024-08-31T06:11:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f9886ffd640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f987c0b4ca0 0x7f987c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f9895da6640 1 --2- 172.21.15.53:0/960537759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x55891026d890 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f988c009ca0 tx=0x7f988c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b68fc9abd9c6182c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f98955a5640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f987c0b4ca0 0x7f987c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.622+0000 7f9886ffd640 1 -- 172.21.15.53:0/2206509473 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f98880e5a00 con 0x7f989010dbc0 2024-08-31T06:11:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.623+0000 7f987bfff640 1 -- 172.21.15.53:0/960537759 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c009e50 con 0x55890fe9f1b0 2024-08-31T06:11:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.623+0000 7f987bfff640 1 -- 172.21.15.53:0/960537759 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f988c0035f0 con 0x55890fe9f1b0 2024-08-31T06:11:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.623+0000 7f987bfff640 1 -- 172.21.15.53:0/960537759 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c019630 con 0x55890fe9f1b0 2024-08-31T06:11:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f989e57f740 1 -- 172.21.15.53:0/960537759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 msgr2=0x55891026d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f98955a5640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f987c0b4ca0 0x7f987c0b71b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9880000c00 tx=0x7f9880041040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f989e57f740 1 --2- 172.21.15.53:0/960537759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x55891026d890 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f988c009ca0 tx=0x7f988c011810 comp rx=0 tx=0).stop 2024-08-31T06:11:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f989e57f740 1 -- 172.21.15.53:0/960537759 shutdown_connections 2024-08-31T06:11:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f989e57f740 1 --2- 172.21.15.53:0/960537759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 0x55891026ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f989e57f740 1 --2- 172.21.15.53:0/960537759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x55891026d890 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f989e57f740 1 --2- 172.21.15.53:0/960537759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fec8070 0x55891026d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f989e57f740 1 -- 172.21.15.53:0/960537759 >> 172.21.15.53:0/960537759 conn(0x55890febc460 msgr2=0x55891026b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:22.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f989e57f740 1 -- 172.21.15.53:0/960537759 shutdown_connections 2024-08-31T06:11:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f989e57f740 1 -- 172.21.15.53:0/960537759 wait complete. 2024-08-31T06:11:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f989e57f740 1 -- start start 2024-08-31T06:11:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.624+0000 7f989e57f740 1 Processor -- start 2024-08-31T06:11:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f989e57f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe9f1b0 0x558910278ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f989e57f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fea7390 0x558910279010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f989e57f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fec8070 0x558910284eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f989e57f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558910036700 con 0x55890fe9f1b0 2024-08-31T06:11:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f989e57f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55891015a750 con 0x55890fec8070 2024-08-31T06:11:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f989e57f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55891027bb30 con 0x55890fea7390 2024-08-31T06:11:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f9895da6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe9f1b0 0x558910278ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f9895da6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe9f1b0 0x558910278ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52560/0 (socket says 172.21.15.53:52560) 2024-08-31T06:11:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f9895da6640 1 -- 172.21.15.53:0/100547316 learned_addr learned my addr 172.21.15.53:0/100547316 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f98955a5640 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fea7390 0x558910279010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f98965a7640 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fec8070 0x558910284eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f989e57f740 10 client.0 _ll_register_callbacks cb 0x558910189e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f9895da6640 1 -- 172.21.15.53:0/100547316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fea7390 msgr2=0x558910279010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f9895da6640 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fea7390 0x558910279010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f9895da6640 1 -- 172.21.15.53:0/100547316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fec8070 msgr2=0x558910284eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f9895da6640 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fec8070 0x558910284eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f9895da6640 1 -- 172.21.15.53:0/100547316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558910193900 con 0x55890fe9f1b0 2024-08-31T06:11:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.625+0000 7f989e57f740 1 -- 172.21.15.53:0/100547316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f988c0035f0 con 0x55890fe9f1b0 2024-08-31T06:11:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.626+0000 7f9895da6640 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe9f1b0 0x558910278ad0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f988c011d10 tx=0x7f988c004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b720939d1af6cb6a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.626+0000 7f98797fa640 10 client.17616 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.626+0000 7f98797fa640 1 -- 172.21.15.53:0/100547316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c028020 con 0x55890fe9f1b0 2024-08-31T06:11:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.626+0000 7f98797fa640 1 -- 172.21.15.53:0/100547316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f988c016040 con 0x55890fe9f1b0 2024-08-31T06:11:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.626+0000 7f98797fa640 1 -- 172.21.15.53:0/100547316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f988c009e50 con 0x55890fe9f1b0 2024-08-31T06:11:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.626+0000 7f989e57f740 10 client.17616 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.626+0000 7f989e57f740 1 -- 172.21.15.53:0/100547316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({fsmap=36}) -- 0x558910287830 con 0x55890fe9f1b0 2024-08-31T06:11:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.626+0000 7f98797fa640 1 -- 172.21.15.53:0/100547316 <== mon.0 v2:172.21.15.53:3300/0 4 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f988c005040 con 0x55890fe9f1b0 2024-08-31T06:11:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.626+0000 7f989e57f740 10 client.17616 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.626+0000 7f989e57f740 10 client.17616 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.626+0000 7f989e57f740 20 client.17616 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.627+0000 7f989e57f740 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55890fe869f0 0x55891028ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.627+0000 7f989e57f740 4 client.17616 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.627+0000 7f989e57f740 1 -- 172.21.15.53:0/100547316 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589101e65d0 con 0x55890fe869f0 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.627+0000 7f98955a5640 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55890fe869f0 0x55891028ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.627+0000 7f98955a5640 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55890fe869f0 0x55891028ab90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35994451ec446ffb server_cookie=a6bd87acaf393596 in_seq=0 out_seq=0 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.627+0000 7f98797fa640 10 client.17616 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f98797fa640 1 -- 172.21.15.53:0/100547316 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589101e65d0 con 0x55890fe869f0 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f98797fa640 10 client.17616 handle_command_reply: tid=0 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f989e57f740 1 client.17616 shutdown 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f989e57f740 1 -- 172.21.15.53:0/100547316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe9f1b0 msgr2=0x558910278ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f989e57f740 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe9f1b0 0x558910278ad0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f988c011d10 tx=0x7f988c004230 comp rx=0 tx=0).stop 2024-08-31T06:11:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f989e57f740 1 -- 172.21.15.53:0/100547316 shutdown_connections 2024-08-31T06:11:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f989e57f740 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55890fe869f0 0x55891028ab90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f98797fa640 0 client.17616 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:11:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f989e57f740 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fec8070 0x558910284eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f989e57f740 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fea7390 0x558910279010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f989e57f740 1 --2- 172.21.15.53:0/100547316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe9f1b0 0x558910278ad0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.628+0000 7f989e57f740 1 -- 172.21.15.53:0/100547316 >> 172.21.15.53:0/100547316 conn(0x55890febc460 msgr2=0x5589102704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.629+0000 7f989e57f740 1 -- 172.21.15.53:0/100547316 shutdown_connections 2024-08-31T06:11:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.629+0000 7f989e57f740 1 -- 172.21.15.53:0/100547316 wait complete. 2024-08-31T06:11:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.629+0000 7f989e57f740 20 client.17616 trim_cache size 0 max 16384 2024-08-31T06:11:22.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.644+0000 7f989e57f740 1 Processor -- start 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.644+0000 7f989e57f740 1 -- start start 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.644+0000 7f989e57f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe869f0 0x55891026b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.644+0000 7f989e57f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x558910284db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.644+0000 7f989e57f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fea7390 0x558910275cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f989e57f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f987400e7d0 con 0x55890fe869f0 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f989e57f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9874010310 con 0x55890fe9f1b0 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f989e57f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f987400eea0 con 0x55890fea7390 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f9895da6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe869f0 0x55891026b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f98955a5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x558910284db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f9895da6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe869f0 0x55891026b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52570/0 (socket says 172.21.15.53:52570) 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f98965a7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fea7390 0x558910275cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f9895da6640 1 -- 172.21.15.53:0/647633665 learned_addr learned my addr 172.21.15.53:0/647633665 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f98955a5640 1 -- 172.21.15.53:0/647633665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fea7390 msgr2=0x558910275cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f98955a5640 1 --2- 172.21.15.53:0/647633665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fea7390 0x558910275cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f98955a5640 1 -- 172.21.15.53:0/647633665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe869f0 msgr2=0x55891026b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f98955a5640 1 --2- 172.21.15.53:0/647633665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe869f0 0x55891026b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f98955a5640 1 -- 172.21.15.53:0/647633665 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589102701b0 con 0x55890fe9f1b0 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f9895da6640 1 --2- 172.21.15.53:0/647633665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe869f0 0x55891026b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f98965a7640 1 --2- 172.21.15.53:0/647633665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fea7390 0x558910275cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.645+0000 7f98955a5640 1 --2- 172.21.15.53:0/647633665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x558910284db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f98800057c0 tx=0x7f9880005e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d9a7495184e93bc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.646+0000 7f987b7fe640 1 -- 172.21.15.53:0/647633665 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880035040 con 0x55890fe9f1b0 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.646+0000 7f987b7fe640 1 -- 172.21.15.53:0/647633665 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f988003dd70 con 0x55890fe9f1b0 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.646+0000 7f987b7fe640 1 -- 172.21.15.53:0/647633665 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880059ca0 con 0x55890fe9f1b0 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.647+0000 7f989e57f740 1 -- 172.21.15.53:0/647633665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 msgr2=0x558910284db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:22.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.647+0000 7f989e57f740 1 --2- 172.21.15.53:0/647633665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x558910284db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f98800057c0 tx=0x7f9880005e10 comp rx=0 tx=0).stop 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.647+0000 7f989e57f740 1 -- 172.21.15.53:0/647633665 shutdown_connections 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.647+0000 7f989e57f740 1 --2- 172.21.15.53:0/647633665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fea7390 0x558910275cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.647+0000 7f989e57f740 1 --2- 172.21.15.53:0/647633665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x558910284db0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.647+0000 7f989e57f740 1 --2- 172.21.15.53:0/647633665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fe869f0 0x55891026b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.647+0000 7f989e57f740 1 -- 172.21.15.53:0/647633665 >> 172.21.15.53:0/647633665 conn(0x55890febc460 msgr2=0x55891026ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.647+0000 7f989e57f740 1 -- 172.21.15.53:0/647633665 shutdown_connections 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.647+0000 7f989e57f740 1 -- 172.21.15.53:0/647633665 wait complete. 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.647+0000 7f989e57f740 1 -- start start 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f989e57f740 1 Processor -- start 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f989e57f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fe869f0 0x55891027d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f989e57f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x55891027dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f989e57f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 0x5589102ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f989e57f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f987400fc40 con 0x55890fea7390 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f989e57f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f987400f570 con 0x55890fe9f1b0 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f989e57f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f987400c7d0 con 0x55890fe869f0 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f989e57f740 10 client.0 _ll_register_callbacks cb 0x7f9880009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f98965a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 0x5589102ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f98965a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 0x5589102ee4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52586/0 (socket says 172.21.15.53:52586) 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f9895da6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fe869f0 0x55891027d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f98965a7640 1 -- 172.21.15.53:0/1134302386 learned_addr learned my addr 172.21.15.53:0/1134302386 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.648+0000 7f98955a5640 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x55891027dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98965a7640 1 -- 172.21.15.53:0/1134302386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fe869f0 msgr2=0x55891027d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98965a7640 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fe869f0 0x55891027d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98965a7640 1 -- 172.21.15.53:0/1134302386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 msgr2=0x55891027dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98965a7640 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x55891027dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98965a7640 1 -- 172.21.15.53:0/1134302386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589102eeb40 con 0x55890fea7390 2024-08-31T06:11:22.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f9895da6640 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fe869f0 0x55891027d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:22.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98955a5640 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x55891027dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:22.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98965a7640 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 0x5589102ee4d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9888005fd0 tx=0x7f98880abd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f1e6d1df0c86b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:22.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98797fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:22.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98797fa640 1 -- 172.21.15.53:0/1134302386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880b0940 con 0x55890fea7390 2024-08-31T06:11:22.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98797fa640 1 -- 172.21.15.53:0/1134302386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f98880b5170 con 0x55890fea7390 2024-08-31T06:11:22.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f989e57f740 1 -- 172.21.15.53:0/1134302386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f988003dd70 con 0x55890fea7390 2024-08-31T06:11:22.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98797fa640 1 -- 172.21.15.53:0/1134302386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f98880b53f0 con 0x55890fea7390 2024-08-31T06:11:22.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f989e57f740 10 client.17622 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:22.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f989e57f740 1 -- 172.21.15.53:0/1134302386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5589102f5ec0 con 0x55890fea7390 2024-08-31T06:11:22.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.649+0000 7f98797fa640 1 -- 172.21.15.53:0/1134302386 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f988003dd70 con 0x55890fea7390 2024-08-31T06:11:22.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.650+0000 7f98797fa640 1 -- 172.21.15.53:0/1134302386 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f98880aada0 con 0x55890fea7390 2024-08-31T06:11:22.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.650+0000 7f989e57f740 10 client.17622 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:22.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.650+0000 7f989e57f740 10 client.17622 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:11:22.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.650+0000 7f989e57f740 20 client.17622 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:22.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.650+0000 7f989e57f740 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55890fec8070 0x5589102f8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:22.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.650+0000 7f989e57f740 4 client.17622 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:11:22.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.650+0000 7f989e57f740 1 -- 172.21.15.53:0/1134302386 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589101e2070 con 0x55890fec8070 2024-08-31T06:11:22.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.650+0000 7f9895da6640 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55890fec8070 0x5589102f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:22.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.650+0000 7f98797fa640 10 client.17622 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f9895da6640 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55890fec8070 0x5589102f8650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da100bfebeca64e1 server_cookie=227903c263e802bc in_seq=0 out_seq=0 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f98797fa640 1 -- 172.21.15.53:0/1134302386 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589101e2070 con 0x55890fec8070 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f98797fa640 10 client.17622 handle_command_reply: tid=0 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f989e57f740 1 client.17622 shutdown 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f989e57f740 1 -- 172.21.15.53:0/1134302386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 msgr2=0x5589102ee4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f989e57f740 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 0x5589102ee4d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9888005fd0 tx=0x7f98880abd20 comp rx=0 tx=0).stop 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f989e57f740 1 -- 172.21.15.53:0/1134302386 shutdown_connections 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f989e57f740 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55890fec8070 0x5589102f8650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f98797fa640 0 client.17622 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f989e57f740 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55890fea7390 0x5589102ee4d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f989e57f740 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55890fe9f1b0 0x55891027dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f989e57f740 1 --2- 172.21.15.53:0/1134302386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55890fe869f0 0x55891027d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f989e57f740 1 -- 172.21.15.53:0/1134302386 >> 172.21.15.53:0/1134302386 conn(0x55890febc460 msgr2=0x55891026e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:22.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f989e57f740 1 -- 172.21.15.53:0/1134302386 shutdown_connections 2024-08-31T06:11:22.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.651+0000 7f989e57f740 1 -- 172.21.15.53:0/1134302386 wait complete. 2024-08-31T06:11:22.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989e57f740 20 client.17622 trim_cache size 0 max 16384 2024-08-31T06:11:22.674 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:11:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 -- 172.21.15.53:0/2206509473 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f987c0b4ca0 msgr2=0x7f987c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f987c0b4ca0 0x7f987c0b71b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9880000c00 tx=0x7f9880041040 comp rx=0 tx=0).stop 2024-08-31T06:11:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 -- 172.21.15.53:0/2206509473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f989010dbc0 msgr2=0x7f989019f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f989010dbc0 0x7f989019f9a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9888009fd0 tx=0x7f988800ef10 comp rx=0 tx=0).stop 2024-08-31T06:11:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 -- 172.21.15.53:0/2206509473 shutdown_connections 2024-08-31T06:11:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f987c0b4ca0 0x7f987c0b71b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f989010dbc0 0x7f989019f9a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98901050b0 0x7f989019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 --2- 172.21.15.53:0/2206509473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9890104760 0x7f989019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 -- 172.21.15.53:0/2206509473 >> 172.21.15.53:0/2206509473 conn(0x7f98900794d0 msgr2=0x7f98900ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:22.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 -- 172.21.15.53:0/2206509473 shutdown_connections 2024-08-31T06:11:22.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:22.652+0000 7f989800a640 1 -- 172.21.15.53:0/2206509473 wait complete. 2024-08-31T06:11:22.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 118046 1.84 MB/sec execute 192 sec latency 20.943 ms 2024-08-31T06:11:23.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:11:23.421 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:23 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:11:23.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:23 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:11:23.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:23 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:11:23.671 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:11:23.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 118582 1.85 MB/sec execute 193 sec latency 19.876 ms 2024-08-31T06:11:24.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.207+0000 7f51f5655640 1 -- 172.21.15.53:0/1884525200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108140 msgr2=0x7f51f0108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:24.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.207+0000 7f51f5655640 1 --2- 172.21.15.53:0/1884525200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108140 0x7f51f0108550 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009900 tx=0x7f51e402a410 comp rx=0 tx=0).stop 2024-08-31T06:11:24.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.207+0000 7f51f5655640 1 -- 172.21.15.53:0/1884525200 shutdown_connections 2024-08-31T06:11:24.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.207+0000 7f51f5655640 1 --2- 172.21.15.53:0/1884525200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0108a90 0x7f51f010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.207+0000 7f51f5655640 1 --2- 172.21.15.53:0/1884525200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108140 0x7f51f0108550 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.207+0000 7f51f5655640 1 --2- 172.21.15.53:0/1884525200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0102800 0x7f51f0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.208+0000 7f51f5655640 1 -- 172.21.15.53:0/1884525200 >> 172.21.15.53:0/1884525200 conn(0x7f51f00794d0 msgr2=0x7f51f00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:24.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.208+0000 7f51f5655640 1 -- 172.21.15.53:0/1884525200 shutdown_connections 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.208+0000 7f51f5655640 1 -- 172.21.15.53:0/1884525200 wait complete. 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.208+0000 7f51f5655640 1 Processor -- start 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51f5655640 1 -- start start 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51f5655640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0102800 0x7f51f019b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51f5655640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 0x7f51f019b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51f5655640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0108a90 0x7f51f019bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51f5655640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0112590 con 0x7f51f0102800 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51f5655640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0112410 con 0x7f51f0108140 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51f5655640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0112710 con 0x7f51f0108a90 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0102800 0x7f51f019b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0102800 0x7f51f019b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33488/0 (socket says 172.21.15.53:33488) 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51eeffd640 1 -- 172.21.15.53:0/1329294289 learned_addr learned my addr 172.21.15.53:0/1329294289 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:24.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51ee7fc640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 0x7f51f019b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0108a90 0x7f51f019bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51eeffd640 1 -- 172.21.15.53:0/1329294289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0108a90 msgr2=0x7f51f019bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51eeffd640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0108a90 0x7f51f019bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51eeffd640 1 -- 172.21.15.53:0/1329294289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 msgr2=0x7f51f019b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51eeffd640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 0x7f51f019b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.209+0000 7f51eeffd640 1 -- 172.21.15.53:0/1329294289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f01a6350 con 0x7f51f0102800 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.210+0000 7f51eeffd640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0102800 0x7f51f019b0c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f51e000e9f0 tx=0x7f51e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.210+0000 7f51d7fff640 1 -- 172.21.15.53:0/1329294289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e000cd80 con 0x7f51f0102800 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.210+0000 7f51f5655640 1 -- 172.21.15.53:0/1329294289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f01a6640 con 0x7f51f0102800 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.210+0000 7f51d7fff640 1 -- 172.21.15.53:0/1329294289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51e00108c0 con 0x7f51f0102800 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.210+0000 7f51d7fff640 1 -- 172.21.15.53:0/1329294289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e00187c0 con 0x7f51f0102800 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.210+0000 7f51f5655640 1 -- 172.21.15.53:0/1329294289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f01a6ba0 con 0x7f51f0102800 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.213+0000 7f51fbbca740 1 Processor -- start 2024-08-31T06:11:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.213+0000 7f51fbbca740 1 -- start start 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.213+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0455f070 0x563d04904310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.213+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d045361b0 0x563d04904850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.213+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 0x563d04904d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51fbbca740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563d0487b680 con 0x563d045361b0 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51d7fff640 1 -- 172.21.15.53:0/1329294289 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f51e0018960 con 0x7f51f0102800 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51fbbca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563d0486ac10 con 0x563d0453e390 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51fbbca740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563d0486ebc0 con 0x563d0455f070 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51ef7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0455f070 0x563d04904310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d045361b0 0x563d04904850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51ee7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 0x563d04904d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51ee7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 0x563d04904d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60746/0 (socket says 172.21.15.53:60746) 2024-08-31T06:11:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51ee7fc640 1 -- 172.21.15.53:0/3404202997 learned_addr learned my addr 172.21.15.53:0/3404202997 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:24.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51ef7fe640 1 -- 172.21.15.53:0/3404202997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 msgr2=0x563d04904d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:24.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3404202997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 0x563d04904d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51ef7fe640 1 -- 172.21.15.53:0/3404202997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d045361b0 msgr2=0x563d04904850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:24.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3404202997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d045361b0 0x563d04904850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.214+0000 7f51ef7fe640 1 -- 172.21.15.53:0/3404202997 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d045ca650 con 0x563d0455f070 2024-08-31T06:11:24.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.215+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3404202997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0455f070 0x563d04904310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009e50 tx=0x7f51e80107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=115fe1e71650d53f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:24.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.215+0000 7f51d7fff640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4d50 0x7f51d80b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.215+0000 7f51d57fa640 1 -- 172.21.15.53:0/3404202997 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8003b70 con 0x563d0455f070 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.215+0000 7f51d57fa640 1 -- 172.21.15.53:0/3404202997 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51e8015070 con 0x563d0455f070 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.215+0000 7f51d57fa640 1 -- 172.21.15.53:0/3404202997 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8011680 con 0x563d0455f070 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.215+0000 7f51d7fff640 1 -- 172.21.15.53:0/1329294289 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f51e00e59e0 con 0x7f51f0102800 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.215+0000 7f51eeffd640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4d50 0x7f51d80b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.216+0000 7f51fbbca740 1 -- 172.21.15.53:0/3404202997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0455f070 msgr2=0x563d04904310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.216+0000 7f51fbbca740 1 --2- 172.21.15.53:0/3404202997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0455f070 0x563d04904310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009e50 tx=0x7f51e80107a0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.216+0000 7f51eeffd640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4d50 0x7f51d80b7260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f51e00e31c0 tx=0x7f51e00ea040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.216+0000 7f51fbbca740 1 -- 172.21.15.53:0/3404202997 shutdown_connections 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.216+0000 7f51fbbca740 1 --2- 172.21.15.53:0/3404202997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 0x563d04904d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.216+0000 7f51fbbca740 1 --2- 172.21.15.53:0/3404202997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d045361b0 0x563d04904850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.216+0000 7f51fbbca740 1 --2- 172.21.15.53:0/3404202997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0455f070 0x563d04904310 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.216+0000 7f51fbbca740 1 -- 172.21.15.53:0/3404202997 >> 172.21.15.53:0/3404202997 conn(0x563d04553460 msgr2=0x563d04902200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:24.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.216+0000 7f51fbbca740 1 -- 172.21.15.53:0/3404202997 shutdown_connections 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.216+0000 7f51fbbca740 1 -- 172.21.15.53:0/3404202997 wait complete. 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51fbbca740 1 -- start start 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51fbbca740 1 Processor -- start 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d045361b0 0x563d0490fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0453e390 0x563d0490ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0455f070 0x563d0491bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51fbbca740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563d046cd700 con 0x563d0453e390 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51fbbca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563d047f1750 con 0x563d0455f070 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51fbbca740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563d04912af0 con 0x563d045361b0 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51ee7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0453e390 0x563d0490ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51fbbca740 10 client.0 _ll_register_callbacks cb 0x563d04820e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51ee7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0453e390 0x563d0490ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33520/0 (socket says 172.21.15.53:33520) 2024-08-31T06:11:24.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51ee7fc640 1 -- 172.21.15.53:0/3837570931 learned_addr learned my addr 172.21.15.53:0/3837570931 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d045361b0 0x563d0490fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.217+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0455f070 0x563d0491bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51ee7fc640 1 -- 172.21.15.53:0/3837570931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d045361b0 msgr2=0x563d0490fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51ee7fc640 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d045361b0 0x563d0490fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51ee7fc640 1 -- 172.21.15.53:0/3837570931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0455f070 msgr2=0x563d0491bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51ee7fc640 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0455f070 0x563d0491bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51ee7fc640 1 -- 172.21.15.53:0/3837570931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d0482a900 con 0x563d0453e390 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d045361b0 0x563d0490fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51ee7fc640 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0453e390 0x563d0490ffb0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f51e40057c0 tx=0x7f51e4031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b7878fbd6e531a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51d2ff5640 1 -- 172.21.15.53:0/3837570931 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4035040 con 0x563d0453e390 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51fbbca740 1 -- 172.21.15.53:0/3837570931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e8015070 con 0x563d0453e390 2024-08-31T06:11:24.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51d2ff5640 1 -- 172.21.15.53:0/3837570931 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f51e4004040 con 0x563d0453e390 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51d2ff5640 1 -- 172.21.15.53:0/3837570931 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f51e4004240 con 0x563d0453e390 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51fbbca740 10 client.17634 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.218+0000 7f51fbbca740 1 -- 172.21.15.53:0/3837570931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x563d0491e8a0 con 0x563d0453e390 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.219+0000 7f51d2ff5640 1 -- 172.21.15.53:0/3837570931 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51e8015070 con 0x563d0453e390 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.219+0000 7f51d2ff5640 1 -- 172.21.15.53:0/3837570931 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f51e4004980 con 0x563d0453e390 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.219+0000 7f51fbbca740 10 client.17634 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.219+0000 7f51fbbca740 10 client.17634 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.219+0000 7f51fbbca740 20 client.17634 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.219+0000 7f51fbbca740 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563d0451d9f0 0x563d04921dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.219+0000 7f51fbbca740 4 client.17634 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.219+0000 7f51fbbca740 1 -- 172.21.15.53:0/3837570931 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d0487d5d0 con 0x563d0451d9f0 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.219+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563d0451d9f0 0x563d04921dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.220+0000 7f51d2ff5640 10 client.17634 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.220+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563d0451d9f0 0x563d04921dc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bfab5f2e99416262 server_cookie=ea03f85c2d40a0c5 in_seq=0 out_seq=0 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.220+0000 7f51d2ff5640 1 -- 172.21.15.53:0/3837570931 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d0487d5d0 con 0x563d0451d9f0 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.220+0000 7f51d2ff5640 10 client.17634 handle_command_reply: tid=0 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.220+0000 7f51fbbca740 1 client.17634 shutdown 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51fbbca740 1 -- 172.21.15.53:0/3837570931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0453e390 msgr2=0x563d0490ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51fbbca740 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0453e390 0x563d0490ffb0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f51e40057c0 tx=0x7f51e4031630 comp rx=0 tx=0).stop 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51fbbca740 1 -- 172.21.15.53:0/3837570931 shutdown_connections 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51fbbca740 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563d0451d9f0 0x563d04921dc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51fbbca740 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0455f070 0x563d0491bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51fbbca740 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0453e390 0x563d0490ffb0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51fbbca740 1 --2- 172.21.15.53:0/3837570931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d045361b0 0x563d0490fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51d2ff5640 0 client.17634 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:11:24.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51fbbca740 1 -- 172.21.15.53:0/3837570931 >> 172.21.15.53:0/3837570931 conn(0x563d04553460 msgr2=0x563d049074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:24.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51fbbca740 1 -- 172.21.15.53:0/3837570931 shutdown_connections 2024-08-31T06:11:24.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51fbbca740 1 -- 172.21.15.53:0/3837570931 wait complete. 2024-08-31T06:11:24.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.221+0000 7f51fbbca740 20 client.17634 trim_cache size 0 max 16384 2024-08-31T06:11:24.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.234+0000 7f51fbbca740 1 Processor -- start 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.234+0000 7f51fbbca740 1 -- start start 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d045361b0 0x563d04902300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 0x563d0491bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 0x563d0490f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51fbbca740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01af590 con 0x563d0455f070 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51fbbca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01b10d0 con 0x563d0453e390 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51fbbca740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01afc60 con 0x563d045361b0 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 0x563d0490f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 0x563d0490f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33532/0 (socket says 172.21.15.53:33532) 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ef7fe640 1 -- 172.21.15.53:0/2691522822 learned_addr learned my addr 172.21.15.53:0/2691522822 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ee7fc640 1 --2- 172.21.15.53:0/2691522822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 0x563d0491bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/2691522822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d045361b0 0x563d04902300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ef7fe640 1 -- 172.21.15.53:0/2691522822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d045361b0 msgr2=0x563d04902300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/2691522822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d045361b0 0x563d04902300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ef7fe640 1 -- 172.21.15.53:0/2691522822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 msgr2=0x563d0491bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/2691522822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 0x563d0491bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ef7fe640 1 -- 172.21.15.53:0/2691522822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d0490df70 con 0x563d0455f070 2024-08-31T06:11:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ee7fc640 1 --2- 172.21.15.53:0/2691522822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 0x563d0491bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/2691522822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 0x563d0490f820 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f51e8004140 tx=0x7f51e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbe057869baa08b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.235+0000 7f51d4ff9640 1 -- 172.21.15.53:0/2691522822 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8025040 con 0x563d0455f070 2024-08-31T06:11:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.236+0000 7f51d4ff9640 1 -- 172.21.15.53:0/2691522822 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51e8015030 con 0x563d0455f070 2024-08-31T06:11:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.236+0000 7f51d4ff9640 1 -- 172.21.15.53:0/2691522822 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8003de0 con 0x563d0455f070 2024-08-31T06:11:24.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.236+0000 7f51fbbca740 1 -- 172.21.15.53:0/2691522822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 msgr2=0x563d0490f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:24.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.236+0000 7f51fbbca740 1 --2- 172.21.15.53:0/2691522822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 0x563d0490f820 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f51e8004140 tx=0x7f51e8004770 comp rx=0 tx=0).stop 2024-08-31T06:11:24.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.236+0000 7f51fbbca740 1 -- 172.21.15.53:0/2691522822 shutdown_connections 2024-08-31T06:11:24.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.236+0000 7f51fbbca740 1 --2- 172.21.15.53:0/2691522822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 0x563d0490f820 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.236+0000 7f51fbbca740 1 --2- 172.21.15.53:0/2691522822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d0453e390 0x563d0491bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.236+0000 7f51fbbca740 1 --2- 172.21.15.53:0/2691522822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d045361b0 0x563d04902300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.236+0000 7f51fbbca740 1 -- 172.21.15.53:0/2691522822 >> 172.21.15.53:0/2691522822 conn(0x563d04553460 msgr2=0x563d04901bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:24.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.236+0000 7f51fbbca740 1 -- 172.21.15.53:0/2691522822 shutdown_connections 2024-08-31T06:11:24.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.236+0000 7f51fbbca740 1 -- 172.21.15.53:0/2691522822 wait complete. 2024-08-31T06:11:24.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51fbbca740 1 -- start start 2024-08-31T06:11:24.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51fbbca740 1 Processor -- start 2024-08-31T06:11:24.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d045361b0 0x563d049140c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0453e390 0x563d04914600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51fbbca740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 0x563d0498b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51fbbca740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01b0a00 con 0x563d0455f070 2024-08-31T06:11:24.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51fbbca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01b0330 con 0x563d045361b0 2024-08-31T06:11:24.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51fbbca740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01ad590 con 0x563d0453e390 2024-08-31T06:11:24.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51fbbca740 10 client.0 _ll_register_callbacks cb 0x7f51e80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:24.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51ef7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d045361b0 0x563d049140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51ee7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0453e390 0x563d04914600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51ef7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d045361b0 0x563d049140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60766/0 (socket says 172.21.15.53:60766) 2024-08-31T06:11:24.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51ee7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0453e390 0x563d04914600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:38936/0 (socket says 172.21.15.53:38936) 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51ef7fe640 1 -- 172.21.15.53:0/1062209952 learned_addr learned my addr 172.21.15.53:0/1062209952 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.237+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 0x563d0498b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51ee7fc640 1 -- 172.21.15.53:0/1062209952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d045361b0 msgr2=0x563d049140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51ee7fc640 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d045361b0 0x563d049140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51ee7fc640 1 -- 172.21.15.53:0/1062209952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 msgr2=0x563d0498b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51ee7fc640 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 0x563d0498b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51ee7fc640 1 -- 172.21.15.53:0/1062209952 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d04914ef0 con 0x563d0453e390 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 0x563d0498b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51ee7fc640 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0453e390 0x563d04914600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f51e4001eb0 tx=0x7f51e40035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8256a09601753eb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51d2ff5640 1 -- 172.21.15.53:0/1062209952 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4000e60 con 0x563d0453e390 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51fbbca740 1 -- 172.21.15.53:0/1062209952 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e8015030 con 0x563d0453e390 2024-08-31T06:11:24.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51d2ff5640 1 -- 172.21.15.53:0/1062209952 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f51e4004ad0 con 0x563d0453e390 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51d2ff5640 1 -- 172.21.15.53:0/1062209952 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f51e4052070 con 0x563d0453e390 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51fbbca740 10 client.26956 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51fbbca740 1 -- 172.21.15.53:0/1062209952 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x563d0498cd60 con 0x563d0453e390 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.238+0000 7f51d2ff5640 1 -- 172.21.15.53:0/1062209952 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51e8015030 con 0x563d0453e390 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.239+0000 7f51d2ff5640 1 -- 172.21.15.53:0/1062209952 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f51e40319f0 con 0x563d0453e390 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.239+0000 7f51fbbca740 10 client.26956 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.239+0000 7f51fbbca740 10 client.26956 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.239+0000 7f51fbbca740 20 client.26956 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.239+0000 7f51fbbca740 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563d044f2da0 0x563d0498f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.239+0000 7f51fbbca740 4 client.26956 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.239+0000 7f51fbbca740 1 -- 172.21.15.53:0/1062209952 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d04879070 con 0x563d044f2da0 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.239+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563d044f2da0 0x563d0498f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:24.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.239+0000 7f51d2ff5640 10 client.26956 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.239+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563d044f2da0 0x563d0498f490 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8d842727083ea2fa server_cookie=16c4549e8c0dea52 in_seq=0 out_seq=0 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51d2ff5640 1 -- 172.21.15.53:0/1062209952 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d04879070 con 0x563d044f2da0 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51d2ff5640 10 client.26956 handle_command_reply: tid=0 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 1 client.26956 shutdown 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 1 -- 172.21.15.53:0/1062209952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0453e390 msgr2=0x563d04914600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0453e390 0x563d04914600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f51e4001eb0 tx=0x7f51e40035f0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 1 -- 172.21.15.53:0/1062209952 shutdown_connections 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563d044f2da0 0x563d0498f490 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563d0455f070 0x563d0498b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563d0453e390 0x563d04914600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51d2ff5640 0 client.26956 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 1 --2- 172.21.15.53:0/1062209952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563d045361b0 0x563d049140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 1 -- 172.21.15.53:0/1062209952 >> 172.21.15.53:0/1062209952 conn(0x563d04553460 msgr2=0x563d0490f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:24.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 1 -- 172.21.15.53:0/1062209952 shutdown_connections 2024-08-31T06:11:24.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 1 -- 172.21.15.53:0/1062209952 wait complete. 2024-08-31T06:11:24.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51fbbca740 20 client.26956 trim_cache size 0 max 16384 2024-08-31T06:11:24.248 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:11:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51f5655640 1 -- 172.21.15.53:0/1329294289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4d50 msgr2=0x7f51d80b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.240+0000 7f51f5655640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4d50 0x7f51d80b7260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f51e00e31c0 tx=0x7f51e00ea040 comp rx=0 tx=0).stop 2024-08-31T06:11:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.241+0000 7f51f5655640 1 -- 172.21.15.53:0/1329294289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0102800 msgr2=0x7f51f019b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.241+0000 7f51f5655640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0102800 0x7f51f019b0c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f51e000e9f0 tx=0x7f51e000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.241+0000 7f51f5655640 1 -- 172.21.15.53:0/1329294289 shutdown_connections 2024-08-31T06:11:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.241+0000 7f51f5655640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4d50 0x7f51d80b7260 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.241+0000 7f51f5655640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0108a90 0x7f51f019bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.241+0000 7f51f5655640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 0x7f51f019b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.241+0000 7f51f5655640 1 --2- 172.21.15.53:0/1329294289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0102800 0x7f51f019b0c0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:24.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.241+0000 7f51f5655640 1 -- 172.21.15.53:0/1329294289 >> 172.21.15.53:0/1329294289 conn(0x7f51f00794d0 msgr2=0x7f51f01051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:24.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.241+0000 7f51f5655640 1 -- 172.21.15.53:0/1329294289 shutdown_connections 2024-08-31T06:11:24.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:24.241+0000 7f51f5655640 1 -- 172.21.15.53:0/1329294289 wait complete. 2024-08-31T06:11:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:24 smithi153 ceph-mon[22320]: pgmap v518: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.3 MiB/s wr, 127 op/s 2024-08-31T06:11:24.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:24 smithi053 ceph-mon[18924]: pgmap v518: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.3 MiB/s wr, 127 op/s 2024-08-31T06:11:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:24 smithi130 ceph-mon[22266]: pgmap v518: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.3 MiB/s wr, 127 op/s 2024-08-31T06:11:24.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 119092 1.84 MB/sec execute 194 sec latency 20.686 ms 2024-08-31T06:11:24.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:11:25.289 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:11:25.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.868+0000 7f07da6d4640 1 -- 172.21.15.53:0/1949725098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07d4109310 msgr2=0x7f07d4109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:25.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.868+0000 7f07da6d4640 1 --2- 172.21.15.53:0/1949725098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07d4109310 0x7f07d4109720 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009900 tx=0x7f07c802a410 comp rx=0 tx=0).stop 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.868+0000 7f07da6d4640 1 -- 172.21.15.53:0/1949725098 shutdown_connections 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.868+0000 7f07da6d4640 1 --2- 172.21.15.53:0/1949725098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07d4109c60 0x7f07d4110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.868+0000 7f07da6d4640 1 --2- 172.21.15.53:0/1949725098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07d4109310 0x7f07d4109720 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.868+0000 7f07da6d4640 1 --2- 172.21.15.53:0/1949725098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07d41039d0 0x7f07d4103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.868+0000 7f07da6d4640 1 -- 172.21.15.53:0/1949725098 >> 172.21.15.53:0/1949725098 conn(0x7f07d407b670 msgr2=0x7f07d407ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.868+0000 7f07da6d4640 1 -- 172.21.15.53:0/1949725098 shutdown_connections 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.868+0000 7f07da6d4640 1 -- 172.21.15.53:0/1949725098 wait complete. 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.869+0000 7f07da6d4640 1 Processor -- start 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.869+0000 7f07da6d4640 1 -- start start 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.869+0000 7f07da6d4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07d41039d0 0x7f07d419a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.869+0000 7f07da6d4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07d4109310 0x7f07d419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.869+0000 7f07da6d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07d4109c60 0x7f07d419f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.869+0000 7f07da6d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f07d4113730 con 0x7f07d4109c60 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.869+0000 7f07da6d4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f07d41135b0 con 0x7f07d4109310 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.869+0000 7f07da6d4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f07d41138b0 con 0x7f07d41039d0 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d8c71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07d4109c60 0x7f07d419f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d8c71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07d4109c60 0x7f07d419f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33556/0 (socket says 172.21.15.53:33556) 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d8c71640 1 -- 172.21.15.53:0/1286808219 learned_addr learned my addr 172.21.15.53:0/1286808219 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d37fe640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07d4109310 0x7f07d419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d3fff640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07d41039d0 0x7f07d419a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d8c71640 1 -- 172.21.15.53:0/1286808219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07d41039d0 msgr2=0x7f07d419a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d8c71640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07d41039d0 0x7f07d419a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d8c71640 1 -- 172.21.15.53:0/1286808219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07d4109310 msgr2=0x7f07d419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d8c71640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07d4109310 0x7f07d419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d8c71640 1 -- 172.21.15.53:0/1286808219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d41a00f0 con 0x7f07d4109c60 2024-08-31T06:11:25.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d37fe640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07d4109310 0x7f07d419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d8c71640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07d4109c60 0x7f07d419f9c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00eb10 tx=0x7f07cc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d17fa640 1 -- 172.21.15.53:0/1286808219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc004b20 con 0x7f07d4109c60 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07da6d4640 1 -- 172.21.15.53:0/1286808219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d41a03e0 con 0x7f07d4109c60 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07d17fa640 1 -- 172.21.15.53:0/1286808219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07cc004cc0 con 0x7f07d4109c60 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.870+0000 7f07da6d4640 1 -- 172.21.15.53:0/1286808219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d41a6b40 con 0x7f07d4109c60 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.871+0000 7f07d17fa640 1 -- 172.21.15.53:0/1286808219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc021640 con 0x7f07d4109c60 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.873+0000 7f07d17fa640 1 -- 172.21.15.53:0/1286808219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f07cc005020 con 0x7f07d4109c60 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07e0c49740 1 Processor -- start 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07e0c49740 1 -- start start 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c28070 0x55fd21fcd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21bff1b0 0x55fd21fcd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c07390 0x55fd21fcdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07e0c49740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd21f44680 con 0x55fd21c28070 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07e0c49740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fd21f33c10 con 0x55fd21bff1b0 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07e0c49740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fd21f37bc0 con 0x55fd21c07390 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07d17fa640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07bc0b4ca0 0x7f07bc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21bff1b0 0x55fd21fcd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c28070 0x55fd21fcd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21bff1b0 0x55fd21fcd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60788/0 (socket says 172.21.15.53:60788) 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07d3fff640 1 -- 172.21.15.53:0/3043775639 learned_addr learned my addr 172.21.15.53:0/3043775639 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c28070 0x55fd21fcd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33568/0 (socket says 172.21.15.53:33568) 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.874+0000 7f07d8c71640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07bc0b4ca0 0x7f07bc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07d37fe640 1 --2- 172.21.15.53:0/3043775639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c07390 0x55fd21fcdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07d17fa640 1 -- 172.21.15.53:0/1286808219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f07cc0e5b30 con 0x7f07d4109c60 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07d37fe640 1 -- 172.21.15.53:0/3043775639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c07390 msgr2=0x55fd21fcdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07d37fe640 1 --2- 172.21.15.53:0/3043775639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c07390 0x55fd21fcdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07d37fe640 1 -- 172.21.15.53:0/3043775639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21bff1b0 msgr2=0x55fd21fcd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:25.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07d37fe640 1 --2- 172.21.15.53:0/3043775639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21bff1b0 0x55fd21fcd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07d37fe640 1 -- 172.21.15.53:0/3043775639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd21c93650 con 0x55fd21c28070 2024-08-31T06:11:25.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07d37fe640 1 --2- 172.21.15.53:0/3043775639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c28070 0x55fd21fcd310 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f07c802a930 tx=0x7f07c8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20564ab9812f2a97 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:25.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07d8c71640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07bc0b4ca0 0x7f07bc0b71b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0abf00 tx=0x7f07cc0a0a80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:25.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07ba7fc640 1 -- 172.21.15.53:0/3043775639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c8035040 con 0x55fd21c28070 2024-08-31T06:11:25.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07ba7fc640 1 -- 172.21.15.53:0/3043775639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07c80044c0 con 0x55fd21c28070 2024-08-31T06:11:25.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.875+0000 7f07ba7fc640 1 -- 172.21.15.53:0/3043775639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c803dc70 con 0x55fd21c28070 2024-08-31T06:11:25.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.876+0000 7f07e0c49740 1 -- 172.21.15.53:0/3043775639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c28070 msgr2=0x55fd21fcd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:25.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.876+0000 7f07e0c49740 1 --2- 172.21.15.53:0/3043775639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c28070 0x55fd21fcd310 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f07c802a930 tx=0x7f07c8005d50 comp rx=0 tx=0).stop 2024-08-31T06:11:25.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.876+0000 7f07e0c49740 1 -- 172.21.15.53:0/3043775639 shutdown_connections 2024-08-31T06:11:25.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.876+0000 7f07e0c49740 1 --2- 172.21.15.53:0/3043775639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c07390 0x55fd21fcdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.876+0000 7f07e0c49740 1 --2- 172.21.15.53:0/3043775639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21bff1b0 0x55fd21fcd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.876+0000 7f07e0c49740 1 --2- 172.21.15.53:0/3043775639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c28070 0x55fd21fcd310 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.876+0000 7f07e0c49740 1 -- 172.21.15.53:0/3043775639 >> 172.21.15.53:0/3043775639 conn(0x55fd21c1c460 msgr2=0x55fd21fcb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:25.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.876+0000 7f07e0c49740 1 -- 172.21.15.53:0/3043775639 shutdown_connections 2024-08-31T06:11:25.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.876+0000 7f07e0c49740 1 -- 172.21.15.53:0/3043775639 wait complete. 2024-08-31T06:11:25.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.877+0000 7f07e0c49740 1 -- start start 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.877+0000 7f07e0c49740 1 Processor -- start 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.877+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21bff1b0 0x55fd21fd8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.877+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c07390 0x55fd21fd9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.877+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c28070 0x55fd21fe4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.877+0000 7f07e0c49740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd21d96700 con 0x55fd21c07390 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.877+0000 7f07e0c49740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fd21eba750 con 0x55fd21c28070 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.877+0000 7f07e0c49740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fd21fdba90 con 0x55fd21bff1b0 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.877+0000 7f07e0c49740 10 client.0 _ll_register_callbacks cb 0x55fd21ee9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c07390 0x55fd21fd9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21bff1b0 0x55fd21fd8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21bff1b0 0x55fd21fd8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:38964/0 (socket says 172.21.15.53:38964) 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c07390 0x55fd21fd9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33574/0 (socket says 172.21.15.53:33574) 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d37fe640 1 -- 172.21.15.53:0/2280430746 learned_addr learned my addr 172.21.15.53:0/2280430746 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:25.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d37fe640 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c28070 0x55fd21fe4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d3fff640 1 -- 172.21.15.53:0/2280430746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21bff1b0 msgr2=0x55fd21fd8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d3fff640 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21bff1b0 0x55fd21fd8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d3fff640 1 -- 172.21.15.53:0/2280430746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c28070 msgr2=0x55fd21fe4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d3fff640 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c28070 0x55fd21fe4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d3fff640 1 -- 172.21.15.53:0/2280430746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd21ef3900 con 0x55fd21c07390 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d37fe640 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21bff1b0 0x55fd21fd8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07d3fff640 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c07390 0x55fd21fd9050 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f07c40126b0 tx=0x7f07c4012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63364b05764e923 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07b37fe640 1 -- 172.21.15.53:0/2280430746 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c4004050 con 0x55fd21c07390 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07b37fe640 1 -- 172.21.15.53:0/2280430746 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f07c40041f0 con 0x55fd21c07390 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.878+0000 7f07e0c49740 1 -- 172.21.15.53:0/2280430746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd21f465d0 con 0x55fd21c07390 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07b37fe640 1 -- 172.21.15.53:0/2280430746 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f07c40043f0 con 0x55fd21c07390 2024-08-31T06:11:25.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07e0c49740 10 client.17652 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07e0c49740 1 -- 172.21.15.53:0/2280430746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55fd21fe78f0 con 0x55fd21c07390 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07b37fe640 1 -- 172.21.15.53:0/2280430746 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07c400fdb0 con 0x55fd21c07390 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07b37fe640 1 -- 172.21.15.53:0/2280430746 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f07c4003ca0 con 0x55fd21c07390 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07e0c49740 10 client.17652 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07e0c49740 10 client.17652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07e0c49740 20 client.17652 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07e0c49740 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fd21be69f0 0x55fd21feaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07e0c49740 4 client.17652 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07e0c49740 1 -- 172.21.15.53:0/2280430746 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd21f465d0 con 0x55fd21be69f0 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.879+0000 7f07d37fe640 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fd21be69f0 0x55fd21feaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.880+0000 7f07b37fe640 10 client.17652 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.880+0000 7f07d37fe640 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fd21be69f0 0x55fd21feaeb0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a88d8b832756bb4 server_cookie=271693fd5a41e986 in_seq=0 out_seq=0 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07b37fe640 1 -- 172.21.15.53:0/2280430746 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd21f465d0 con 0x55fd21be69f0 2024-08-31T06:11:25.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07b37fe640 10 client.17652 handle_command_reply: tid=0 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 1 client.17652 shutdown 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 1 -- 172.21.15.53:0/2280430746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c07390 msgr2=0x55fd21fd9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c07390 0x55fd21fd9050 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f07c40126b0 tx=0x7f07c4012b70 comp rx=0 tx=0).stop 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 1 -- 172.21.15.53:0/2280430746 shutdown_connections 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fd21be69f0 0x55fd21feaeb0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c28070 0x55fd21fe4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21c07390 0x55fd21fd9050 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 1 --2- 172.21.15.53:0/2280430746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21bff1b0 0x55fd21fd8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 1 -- 172.21.15.53:0/2280430746 >> 172.21.15.53:0/2280430746 conn(0x55fd21c1c460 msgr2=0x55fd21fd04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07b37fe640 0 client.17652 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 1 -- 172.21.15.53:0/2280430746 shutdown_connections 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 1 -- 172.21.15.53:0/2280430746 wait complete. 2024-08-31T06:11:25.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.881+0000 7f07e0c49740 20 client.17652 trim_cache size 0 max 16384 2024-08-31T06:11:25.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07e0c49740 1 Processor -- start 2024-08-31T06:11:25.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07e0c49740 1 -- start start 2024-08-31T06:11:25.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 0x55fd21fd88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 0x55fd21fd8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c28070 0x55fd21fd0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07e0c49740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f07d41ad250 con 0x55fd21bff1b0 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07e0c49740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f07d41aed90 con 0x55fd21c07390 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07e0c49740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f07d41ad920 con 0x55fd21c28070 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 0x55fd21fd88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 0x55fd21fd88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33576/0 (socket says 172.21.15.53:33576) 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07d37fe640 1 -- 172.21.15.53:0/4287054831 learned_addr learned my addr 172.21.15.53:0/4287054831 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07d3fff640 1 --2- 172.21.15.53:0/4287054831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 0x55fd21fd8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.895+0000 7f07d37fe640 1 --2- 172.21.15.53:0/4287054831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c28070 0x55fd21fd0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.896+0000 7f07d3fff640 1 -- 172.21.15.53:0/4287054831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c28070 msgr2=0x55fd21fd0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.896+0000 7f07d3fff640 1 --2- 172.21.15.53:0/4287054831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c28070 0x55fd21fd0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.896+0000 7f07d3fff640 1 -- 172.21.15.53:0/4287054831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 msgr2=0x55fd21fd88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:25.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.896+0000 7f07d3fff640 1 --2- 172.21.15.53:0/4287054831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 0x55fd21fd88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.896+0000 7f07d3fff640 1 -- 172.21.15.53:0/4287054831 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd21fd0170 con 0x55fd21c07390 2024-08-31T06:11:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.896+0000 7f07d37fe640 1 --2- 172.21.15.53:0/4287054831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c28070 0x55fd21fd0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:11:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.896+0000 7f07d3fff640 1 --2- 172.21.15.53:0/4287054831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 0x55fd21fd8e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f07c40126b0 tx=0x7f07c40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8491ceaf6eebe0c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.896+0000 7f07b9ffb640 1 -- 172.21.15.53:0/4287054831 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c4028040 con 0x55fd21c07390 2024-08-31T06:11:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.896+0000 7f07b9ffb640 1 -- 172.21.15.53:0/4287054831 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07c4010760 con 0x55fd21c07390 2024-08-31T06:11:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.896+0000 7f07b9ffb640 1 -- 172.21.15.53:0/4287054831 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c4005040 con 0x55fd21c07390 2024-08-31T06:11:25.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.897+0000 7f07e0c49740 1 -- 172.21.15.53:0/4287054831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 msgr2=0x55fd21fd8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:25.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.897+0000 7f07e0c49740 1 --2- 172.21.15.53:0/4287054831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 0x55fd21fd8e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f07c40126b0 tx=0x7f07c40057f0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.897+0000 7f07e0c49740 1 -- 172.21.15.53:0/4287054831 shutdown_connections 2024-08-31T06:11:25.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.897+0000 7f07e0c49740 1 --2- 172.21.15.53:0/4287054831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c28070 0x55fd21fd0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.897+0000 7f07e0c49740 1 --2- 172.21.15.53:0/4287054831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 0x55fd21fd8e00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.897+0000 7f07e0c49740 1 --2- 172.21.15.53:0/4287054831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 0x55fd21fd88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.897+0000 7f07e0c49740 1 -- 172.21.15.53:0/4287054831 >> 172.21.15.53:0/4287054831 conn(0x55fd21c1c460 msgr2=0x55fd21fd7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:25.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.897+0000 7f07e0c49740 1 -- 172.21.15.53:0/4287054831 shutdown_connections 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.897+0000 7f07e0c49740 1 -- 172.21.15.53:0/4287054831 wait complete. 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07e0c49740 1 -- start start 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07e0c49740 1 Processor -- start 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 0x55fd21fe15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 0x55fd21fdca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07e0c49740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c28070 0x55fd21fdd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07e0c49740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f07d41ae6c0 con 0x55fd21bff1b0 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07e0c49740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f07d41adff0 con 0x55fd21c07390 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07e0c49740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f07d41ab250 con 0x55fd21c28070 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07e0c49740 10 client.0 _ll_register_callbacks cb 0x7f07c4009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 0x55fd21fe15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 0x55fd21fdca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 0x55fd21fe15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33586/0 (socket says 172.21.15.53:33586) 2024-08-31T06:11:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.898+0000 7f07d37fe640 1 -- 172.21.15.53:0/465989640 learned_addr learned my addr 172.21.15.53:0/465989640 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07d37fe640 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c28070 0x55fd21fdd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07d3fff640 1 -- 172.21.15.53:0/465989640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c28070 msgr2=0x55fd21fdd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07d3fff640 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c28070 0x55fd21fdd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07d3fff640 1 -- 172.21.15.53:0/465989640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 msgr2=0x55fd21fe15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07d3fff640 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 0x55fd21fe15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07d3fff640 1 -- 172.21.15.53:0/465989640 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd21fdd820 con 0x55fd21c07390 2024-08-31T06:11:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07d37fe640 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 0x55fd21fe15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07d3fff640 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 0x55fd21fdca60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f07c400a010 tx=0x7f07c4009de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c526e8766636eed3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07b37fe640 1 -- 172.21.15.53:0/465989640 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c400fe60 con 0x55fd21c07390 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07e0c49740 1 -- 172.21.15.53:0/465989640 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07c4010760 con 0x55fd21c07390 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07b37fe640 1 -- 172.21.15.53:0/465989640 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f07c4010b20 con 0x55fd21c07390 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07b37fe640 1 -- 172.21.15.53:0/465989640 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f07c403d050 con 0x55fd21c07390 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07e0c49740 10 client.26987 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.899+0000 7f07e0c49740 1 -- 172.21.15.53:0/465989640 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55fd220558f0 con 0x55fd21c07390 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.900+0000 7f07b37fe640 1 -- 172.21.15.53:0/465989640 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07c4010760 con 0x55fd21c07390 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.900+0000 7f07b37fe640 1 -- 172.21.15.53:0/465989640 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f07c401c420 con 0x55fd21c07390 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.900+0000 7f07e0c49740 10 client.26987 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.900+0000 7f07e0c49740 10 client.26987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.900+0000 7f07e0c49740 20 client.26987 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.900+0000 7f07e0c49740 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fd21bbbda0 0x55fd22057f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.900+0000 7f07e0c49740 4 client.26987 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.900+0000 7f07e0c49740 1 -- 172.21.15.53:0/465989640 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd21f42070 con 0x55fd21bbbda0 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.900+0000 7f07d37fe640 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fd21bbbda0 0x55fd22057f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.900+0000 7f07b37fe640 10 client.26987 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07d37fe640 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fd21bbbda0 0x55fd22057f10 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=186da82facc38896 server_cookie=35ad205b9b9ae74e in_seq=0 out_seq=0 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07b37fe640 1 -- 172.21.15.53:0/465989640 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd21f42070 con 0x55fd21bbbda0 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07b37fe640 10 client.26987 handle_command_reply: tid=0 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 1 client.26987 shutdown 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 1 -- 172.21.15.53:0/465989640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 msgr2=0x55fd21fdca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 0x55fd21fdca60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f07c400a010 tx=0x7f07c4009de0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 1 -- 172.21.15.53:0/465989640 shutdown_connections 2024-08-31T06:11:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fd21bbbda0 0x55fd22057f10 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fd21c28070 0x55fd21fdd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd21c07390 0x55fd21fdca60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 1 --2- 172.21.15.53:0/465989640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd21bff1b0 0x55fd21fe15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 1 -- 172.21.15.53:0/465989640 >> 172.21.15.53:0/465989640 conn(0x55fd21c1c460 msgr2=0x55fd21fd88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07b37fe640 0 client.26987 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 1 -- 172.21.15.53:0/465989640 shutdown_connections 2024-08-31T06:11:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 1 -- 172.21.15.53:0/465989640 wait complete. 2024-08-31T06:11:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.901+0000 7f07e0c49740 20 client.26987 trim_cache size 0 max 16384 2024-08-31T06:11:25.909 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:11:25.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 -- 172.21.15.53:0/1286808219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07bc0b4ca0 msgr2=0x7f07bc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:25.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07bc0b4ca0 0x7f07bc0b71b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0abf00 tx=0x7f07cc0a0a80 comp rx=0 tx=0).stop 2024-08-31T06:11:25.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 -- 172.21.15.53:0/1286808219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07d4109c60 msgr2=0x7f07d419f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:25.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07d4109c60 0x7f07d419f9c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00eb10 tx=0x7f07cc00c2d0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 -- 172.21.15.53:0/1286808219 shutdown_connections 2024-08-31T06:11:25.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f07bc0b4ca0 0x7f07bc0b71b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07d4109c60 0x7f07d419f9c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07d4109310 0x7f07d419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 --2- 172.21.15.53:0/1286808219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07d41039d0 0x7f07d419a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:25.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 -- 172.21.15.53:0/1286808219 >> 172.21.15.53:0/1286808219 conn(0x7f07d407b670 msgr2=0x7f07d4107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:25.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 -- 172.21.15.53:0/1286808219 shutdown_connections 2024-08-31T06:11:25.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:25.902+0000 7f07da6d4640 1 -- 172.21.15.53:0/1286808219 wait complete. 2024-08-31T06:11:25.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 119577 1.84 MB/sec execute 195 sec latency 20.557 ms 2024-08-31T06:11:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:26 smithi153 ceph-mon[22320]: pgmap v519: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-08-31T06:11:26.445 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:26 smithi053 ceph-mon[18924]: pgmap v519: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-08-31T06:11:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:26 smithi130 ceph-mon[22266]: pgmap v519: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-08-31T06:11:26.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 120356 1.87 MB/sec execute 196 sec latency 14.340 ms 2024-08-31T06:11:27.661 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:11:27.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:11:27.947 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:11:27.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 120720 1.87 MB/sec execute 197 sec latency 14.086 ms 2024-08-31T06:11:28.395 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:28 smithi053 ceph-mon[18924]: pgmap v520: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-08-31T06:11:28.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:28 smithi153 ceph-mon[22320]: pgmap v520: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-08-31T06:11:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.500+0000 7fa35b6a8640 1 -- 172.21.15.53:0/3589710519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa354102880 msgr2=0x7fa354102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.500+0000 7fa35b6a8640 1 --2- 172.21.15.53:0/3589710519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa354102880 0x7fa354102c90 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa350009900 tx=0x7fa35002a410 comp rx=0 tx=0).stop 2024-08-31T06:11:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.500+0000 7fa35b6a8640 1 -- 172.21.15.53:0/3589710519 shutdown_connections 2024-08-31T06:11:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.500+0000 7fa35b6a8640 1 --2- 172.21.15.53:0/3589710519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa354108ac0 0x7fa35410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.500+0000 7fa35b6a8640 1 --2- 172.21.15.53:0/3589710519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa354108170 0x7fa354108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.500+0000 7fa35b6a8640 1 --2- 172.21.15.53:0/3589710519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa354102880 0x7fa354102c90 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.500+0000 7fa35b6a8640 1 -- 172.21.15.53:0/3589710519 >> 172.21.15.53:0/3589710519 conn(0x7fa354079530 msgr2=0x7fa354079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.500+0000 7fa35b6a8640 1 -- 172.21.15.53:0/3589710519 shutdown_connections 2024-08-31T06:11:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.501+0000 7fa35b6a8640 1 -- 172.21.15.53:0/3589710519 wait complete. 2024-08-31T06:11:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.501+0000 7fa35b6a8640 1 Processor -- start 2024-08-31T06:11:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa35b6a8640 1 -- start start 2024-08-31T06:11:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa35b6a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa354102880 0x7fa3541a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa35b6a8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa354108170 0x7fa3541a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa35b6a8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa354108ac0 0x7fa3541a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa35b6a8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa354112640 con 0x7fa354102880 2024-08-31T06:11:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa35b6a8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa3541124c0 con 0x7fa354108ac0 2024-08-31T06:11:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa35b6a8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3541127c0 con 0x7fa354108170 2024-08-31T06:11:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa359444640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa354102880 0x7fa3541a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa359444640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa354102880 0x7fa3541a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33594/0 (socket says 172.21.15.53:33594) 2024-08-31T06:11:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa359444640 1 -- 172.21.15.53:0/2209930285 learned_addr learned my addr 172.21.15.53:0/2209930285 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa359c45640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa354108ac0 0x7fa3541a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.502+0000 7fa358c43640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa354108170 0x7fa3541a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa359444640 1 -- 172.21.15.53:0/2209930285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa354108170 msgr2=0x7fa3541a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa359444640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa354108170 0x7fa3541a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa359444640 1 -- 172.21.15.53:0/2209930285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa354108ac0 msgr2=0x7fa3541a5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa359444640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa354108ac0 0x7fa3541a5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa359444640 1 -- 172.21.15.53:0/2209930285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3541a66f0 con 0x7fa354102880 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa359c45640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa354108ac0 0x7fa3541a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa359444640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa354102880 0x7fa3541a0790 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa350009230 tx=0x7fa350004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa34a7fc640 1 -- 172.21.15.53:0/2209930285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35003f030 con 0x7fa354102880 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa34a7fc640 1 -- 172.21.15.53:0/2209930285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa350003a80 con 0x7fa354102880 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa35b6a8640 1 -- 172.21.15.53:0/2209930285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3541a6980 con 0x7fa354102880 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa35b6a8640 1 -- 172.21.15.53:0/2209930285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3541ad140 con 0x7fa354102880 2024-08-31T06:11:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.503+0000 7fa34a7fc640 1 -- 172.21.15.53:0/2209930285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350035070 con 0x7fa354102880 2024-08-31T06:11:28.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.506+0000 7fa361c1d740 1 Processor -- start 2024-08-31T06:11:28.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa361c1d740 1 -- start start 2024-08-31T06:11:28.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa34a7fc640 1 -- 172.21.15.53:0/2209930285 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa350042030 con 0x7fa354102880 2024-08-31T06:11:28.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 0x564f9b43f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 0x564f9b43fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b078670 0x564f9b440200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa361c1d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564f9b3b55f0 con 0x564f9b070490 2024-08-31T06:11:28.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa361c1d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564f9b3a4b80 con 0x564f9b099350 2024-08-31T06:11:28.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa361c1d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564f9b3a8b30 con 0x564f9b078670 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa359444640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 0x564f9b43fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa359444640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 0x564f9b43fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33608/0 (socket says 172.21.15.53:33608) 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa359c45640 1 --2- 172.21.15.53:0/2637209872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 0x564f9b43f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa359444640 1 -- 172.21.15.53:0/2637209872 learned_addr learned my addr 172.21.15.53:0/2637209872 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.507+0000 7fa358c43640 1 --2- 172.21.15.53:0/2637209872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b078670 0x564f9b440200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.508+0000 7fa359c45640 1 -- 172.21.15.53:0/2637209872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b078670 msgr2=0x564f9b440200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.508+0000 7fa359c45640 1 --2- 172.21.15.53:0/2637209872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b078670 0x564f9b440200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.508+0000 7fa359c45640 1 -- 172.21.15.53:0/2637209872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 msgr2=0x564f9b43fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.508+0000 7fa359c45640 1 --2- 172.21.15.53:0/2637209872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 0x564f9b43fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.508+0000 7fa359c45640 1 -- 172.21.15.53:0/2637209872 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f9b104930 con 0x564f9b099350 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.508+0000 7fa359c45640 1 --2- 172.21.15.53:0/2637209872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 0x564f9b43f780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa34c005fd0 tx=0x7fa34c011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a76d55dd589d89 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.508+0000 7fa33f7fe640 1 -- 172.21.15.53:0/2637209872 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c004d20 con 0x564f9b099350 2024-08-31T06:11:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.508+0000 7fa34a7fc640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3400b4d20 0x7fa3400b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.508+0000 7fa33f7fe640 1 -- 172.21.15.53:0/2637209872 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa34c00f9a0 con 0x564f9b099350 2024-08-31T06:11:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.508+0000 7fa33f7fe640 1 -- 172.21.15.53:0/2637209872 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0043d0 con 0x564f9b099350 2024-08-31T06:11:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.509+0000 7fa34a7fc640 1 -- 172.21.15.53:0/2209930285 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fa350105b90 con 0x7fa354102880 2024-08-31T06:11:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.509+0000 7fa359444640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3400b4d20 0x7fa3400b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.509+0000 7fa361c1d740 1 -- 172.21.15.53:0/2637209872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 msgr2=0x564f9b43f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.509+0000 7fa359444640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3400b4d20 0x7fa3400b7230 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa350103320 tx=0x7fa3501096e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.509+0000 7fa361c1d740 1 --2- 172.21.15.53:0/2637209872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 0x564f9b43f780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa34c005fd0 tx=0x7fa34c011bf0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.509+0000 7fa361c1d740 1 -- 172.21.15.53:0/2637209872 shutdown_connections 2024-08-31T06:11:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.509+0000 7fa361c1d740 1 --2- 172.21.15.53:0/2637209872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b078670 0x564f9b440200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.509+0000 7fa361c1d740 1 --2- 172.21.15.53:0/2637209872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 0x564f9b43fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.509+0000 7fa361c1d740 1 --2- 172.21.15.53:0/2637209872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 0x564f9b43f780 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.509+0000 7fa361c1d740 1 -- 172.21.15.53:0/2637209872 >> 172.21.15.53:0/2637209872 conn(0x564f9b08d740 msgr2=0x564f9b43d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.510+0000 7fa361c1d740 1 -- 172.21.15.53:0/2637209872 shutdown_connections 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.510+0000 7fa361c1d740 1 -- 172.21.15.53:0/2637209872 wait complete. 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.510+0000 7fa361c1d740 1 -- start start 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.510+0000 7fa361c1d740 1 Processor -- start 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 0x564f9b44aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b078670 0x564f9b44b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b099350 0x564f9b4572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa361c1d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564f9b207890 con 0x564f9b070490 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa361c1d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564f9b32b790 con 0x564f9b078670 2024-08-31T06:11:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa361c1d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564f9b44df60 con 0x564f9b099350 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa361c1d740 10 client.0 _ll_register_callbacks cb 0x564f9b0b0ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa359c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 0x564f9b44aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa358c43640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b078670 0x564f9b44b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa359c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 0x564f9b44aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33614/0 (socket says 172.21.15.53:33614) 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa359c45640 1 -- 172.21.15.53:0/1110832513 learned_addr learned my addr 172.21.15.53:0/1110832513 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa359c45640 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b099350 0x564f9b4572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa358c43640 1 -- 172.21.15.53:0/1110832513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b099350 msgr2=0x564f9b4572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa358c43640 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b099350 0x564f9b4572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa358c43640 1 -- 172.21.15.53:0/1110832513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 msgr2=0x564f9b44aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa358c43640 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 0x564f9b44aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.511+0000 7fa358c43640 1 -- 172.21.15.53:0/1110832513 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f9b362f30 con 0x564f9b078670 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.512+0000 7fa358c43640 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b078670 0x564f9b44b420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa344005fd0 tx=0x7fa34400bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e3bc85fd4d3799a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.512+0000 7fa33cff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.512+0000 7fa33cff9640 1 -- 172.21.15.53:0/1110832513 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa344003df0 con 0x564f9b078670 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.512+0000 7fa33cff9640 1 -- 172.21.15.53:0/1110832513 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fa344005020 con 0x564f9b078670 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.512+0000 7fa361c1d740 1 -- 172.21.15.53:0/1110832513 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa34c00f9a0 con 0x564f9b078670 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.512+0000 7fa33cff9640 1 -- 172.21.15.53:0/1110832513 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa344005240 con 0x564f9b078670 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.512+0000 7fa361c1d740 10 client.26999 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.512+0000 7fa361c1d740 1 -- 172.21.15.53:0/1110832513 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564f9b459dc0 con 0x564f9b078670 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.512+0000 7fa33cff9640 1 -- 172.21.15.53:0/1110832513 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa34c00f9a0 con 0x564f9b078670 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.512+0000 7fa33cff9640 1 -- 172.21.15.53:0/1110832513 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fa34401b470 con 0x564f9b078670 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.513+0000 7fa361c1d740 10 client.26999 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.513+0000 7fa361c1d740 10 client.26999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.513+0000 7fa361c1d740 20 client.26999 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.513+0000 7fa361c1d740 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f9b057cd0 0x564f9b45d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.513+0000 7fa361c1d740 4 client.26999 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.513+0000 7fa361c1d740 1 -- 172.21.15.53:0/1110832513 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f9b3b7540 con 0x564f9b057cd0 2024-08-31T06:11:28.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.513+0000 7fa359c45640 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f9b057cd0 0x564f9b45d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.513+0000 7fa33cff9640 10 client.26999 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.513+0000 7fa359c45640 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f9b057cd0 0x564f9b45d3d0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f830760e8c1700 server_cookie=8c2cf2a9852d3cd3 in_seq=0 out_seq=0 2024-08-31T06:11:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa33cff9640 1 -- 172.21.15.53:0/1110832513 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f9b3b7540 con 0x564f9b057cd0 2024-08-31T06:11:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa33cff9640 10 client.26999 handle_command_reply: tid=0 2024-08-31T06:11:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 1 client.26999 shutdown 2024-08-31T06:11:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 1 -- 172.21.15.53:0/1110832513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b078670 msgr2=0x564f9b44b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b078670 0x564f9b44b420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa344005fd0 tx=0x7fa34400bd80 comp rx=0 tx=0).stop 2024-08-31T06:11:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 1 -- 172.21.15.53:0/1110832513 shutdown_connections 2024-08-31T06:11:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f9b057cd0 0x564f9b45d3d0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b099350 0x564f9b4572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b078670 0x564f9b44b420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 1 --2- 172.21.15.53:0/1110832513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b070490 0x564f9b44aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa33cff9640 0 client.26999 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 1 -- 172.21.15.53:0/1110832513 >> 172.21.15.53:0/1110832513 conn(0x564f9b08d740 msgr2=0x564f9b442910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 1 -- 172.21.15.53:0/1110832513 shutdown_connections 2024-08-31T06:11:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 1 -- 172.21.15.53:0/1110832513 wait complete. 2024-08-31T06:11:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.515+0000 7fa361c1d740 20 client.26999 trim_cache size 0 max 16384 2024-08-31T06:11:28.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.535+0000 7fa361c1d740 1 Processor -- start 2024-08-31T06:11:28.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.535+0000 7fa361c1d740 1 -- start start 2024-08-31T06:11:28.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.535+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b070490 0x564f9b442f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.535+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b078670 0x564f9b4571e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.535+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b099350 0x564f9b43cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.535+0000 7fa361c1d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa3541b5b00 con 0x564f9b099350 2024-08-31T06:11:28.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.535+0000 7fa361c1d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa3541b7640 con 0x564f9b070490 2024-08-31T06:11:28.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.535+0000 7fa361c1d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3541b61d0 con 0x564f9b078670 2024-08-31T06:11:28.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa359c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b099350 0x564f9b43cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa359c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b099350 0x564f9b43cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33626/0 (socket says 172.21.15.53:33626) 2024-08-31T06:11:28.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa359c45640 1 -- 172.21.15.53:0/2816658729 learned_addr learned my addr 172.21.15.53:0/2816658729 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:28.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa359c45640 1 --2- 172.21.15.53:0/2816658729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b070490 0x564f9b442f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa358c43640 1 --2- 172.21.15.53:0/2816658729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b078670 0x564f9b4571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa359c45640 1 -- 172.21.15.53:0/2816658729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b078670 msgr2=0x564f9b4571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:28.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa359c45640 1 --2- 172.21.15.53:0/2816658729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b078670 0x564f9b4571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa359c45640 1 -- 172.21.15.53:0/2816658729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b070490 msgr2=0x564f9b442f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa359c45640 1 --2- 172.21.15.53:0/2816658729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b070490 0x564f9b442f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa359c45640 1 -- 172.21.15.53:0/2816658729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f9b4425e0 con 0x564f9b099350 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa358c43640 1 --2- 172.21.15.53:0/2816658729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b078670 0x564f9b4571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.536+0000 7fa359c45640 1 --2- 172.21.15.53:0/2816658729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b099350 0x564f9b43cf90 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa34c003fd0 tx=0x7fa34c00fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adeb0b178cbae16 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.537+0000 7fa33effd640 1 -- 172.21.15.53:0/2816658729 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c01e040 con 0x564f9b099350 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.537+0000 7fa33effd640 1 -- 172.21.15.53:0/2816658729 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa34c003d50 con 0x564f9b099350 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.537+0000 7fa33effd640 1 -- 172.21.15.53:0/2816658729 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c029670 con 0x564f9b099350 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.538+0000 7fa361c1d740 1 -- 172.21.15.53:0/2816658729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b099350 msgr2=0x564f9b43cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.538+0000 7fa361c1d740 1 --2- 172.21.15.53:0/2816658729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b099350 0x564f9b43cf90 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa34c003fd0 tx=0x7fa34c00fcd0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.538+0000 7fa361c1d740 1 -- 172.21.15.53:0/2816658729 shutdown_connections 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.538+0000 7fa361c1d740 1 --2- 172.21.15.53:0/2816658729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b099350 0x564f9b43cf90 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.538+0000 7fa361c1d740 1 --2- 172.21.15.53:0/2816658729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b078670 0x564f9b4571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.538+0000 7fa361c1d740 1 --2- 172.21.15.53:0/2816658729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b070490 0x564f9b442f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.538+0000 7fa361c1d740 1 -- 172.21.15.53:0/2816658729 >> 172.21.15.53:0/2816658729 conn(0x564f9b08d740 msgr2=0x564f9b442880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:28.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.538+0000 7fa361c1d740 1 -- 172.21.15.53:0/2816658729 shutdown_connections 2024-08-31T06:11:28.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.538+0000 7fa361c1d740 1 -- 172.21.15.53:0/2816658729 wait complete. 2024-08-31T06:11:28.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.538+0000 7fa361c1d740 1 -- start start 2024-08-31T06:11:28.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.538+0000 7fa361c1d740 1 Processor -- start 2024-08-31T06:11:28.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b070490 0x564f9b44f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b078670 0x564f9b44f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa361c1d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 0x564f9b44fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa361c1d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa3541b6f70 con 0x564f9b078670 2024-08-31T06:11:28.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa361c1d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa3541b68a0 con 0x564f9b099350 2024-08-31T06:11:28.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa361c1d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3541b3b00 con 0x564f9b070490 2024-08-31T06:11:28.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa361c1d740 10 client.0 _ll_register_callbacks cb 0x7fa3440042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:28.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa358c43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b078670 0x564f9b44f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa358c43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b078670 0x564f9b44f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33634/0 (socket says 172.21.15.53:33634) 2024-08-31T06:11:28.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa358c43640 1 -- 172.21.15.53:0/274532681 learned_addr learned my addr 172.21.15.53:0/274532681 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:28.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa359c45640 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 0x564f9b44fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.539+0000 7fa359c45640 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b070490 0x564f9b44f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa358c43640 1 -- 172.21.15.53:0/274532681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b070490 msgr2=0x564f9b44f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:28.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa358c43640 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b070490 0x564f9b44f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa358c43640 1 -- 172.21.15.53:0/274532681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 msgr2=0x564f9b44fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:28.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa358c43640 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 0x564f9b44fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa358c43640 1 -- 172.21.15.53:0/274532681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f9b4c6e80 con 0x564f9b078670 2024-08-31T06:11:28.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa359c45640 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 0x564f9b44fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:28.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa358c43640 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b078670 0x564f9b44f900 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fa34401ba80 tx=0x7fa344003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6aa5b6e7a256d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:28.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa33cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:28.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa33cff9640 1 -- 172.21.15.53:0/274532681 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa344028040 con 0x564f9b078670 2024-08-31T06:11:28.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa33cff9640 1 -- 172.21.15.53:0/274532681 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fa34401b470 con 0x564f9b078670 2024-08-31T06:11:28.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa361c1d740 1 -- 172.21.15.53:0/274532681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa34c003d50 con 0x564f9b078670 2024-08-31T06:11:28.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa33cff9640 1 -- 172.21.15.53:0/274532681 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa34401b670 con 0x564f9b078670 2024-08-31T06:11:28.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa361c1d740 10 client.17676 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.540+0000 7fa361c1d740 1 -- 172.21.15.53:0/274532681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564f9b4c8140 con 0x564f9b078670 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.541+0000 7fa33cff9640 1 -- 172.21.15.53:0/274532681 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa34c003d50 con 0x564f9b078670 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.541+0000 7fa33cff9640 1 -- 172.21.15.53:0/274532681 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fa34402ece0 con 0x564f9b078670 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.541+0000 7fa361c1d740 10 client.17676 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.541+0000 7fa361c1d740 10 client.17676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.541+0000 7fa361c1d740 20 client.17676 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.541+0000 7fa361c1d740 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f9b02d080 0x564f9b4ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.541+0000 7fa361c1d740 4 client.17676 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.541+0000 7fa361c1d740 1 -- 172.21.15.53:0/274532681 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564f9b3b2fe0 con 0x564f9b02d080 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.541+0000 7fa359c45640 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f9b02d080 0x564f9b4ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.542+0000 7fa359c45640 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f9b02d080 0x564f9b4ca980 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9997214c3bbc2eb4 server_cookie=88bbcc301fc7edac in_seq=0 out_seq=0 2024-08-31T06:11:28.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.542+0000 7fa33cff9640 10 client.17676 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:28.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa33cff9640 1 -- 172.21.15.53:0/274532681 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564f9b3b2fe0 con 0x564f9b02d080 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa33cff9640 10 client.17676 handle_command_reply: tid=0 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 1 client.17676 shutdown 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 1 -- 172.21.15.53:0/274532681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b078670 msgr2=0x564f9b44f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b078670 0x564f9b44f900 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fa34401ba80 tx=0x7fa344003ee0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 1 -- 172.21.15.53:0/274532681 shutdown_connections 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564f9b02d080 0x564f9b4ca980 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f9b099350 0x564f9b44fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f9b078670 0x564f9b44f900 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 1 --2- 172.21.15.53:0/274532681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f9b070490 0x564f9b44f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 1 -- 172.21.15.53:0/274532681 >> 172.21.15.53:0/274532681 conn(0x564f9b08d740 msgr2=0x564f9b43cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa33cff9640 0 client.17676 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 1 -- 172.21.15.53:0/274532681 shutdown_connections 2024-08-31T06:11:28.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 1 -- 172.21.15.53:0/274532681 wait complete. 2024-08-31T06:11:28.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.544+0000 7fa361c1d740 20 client.17676 trim_cache size 0 max 16384 2024-08-31T06:11:28.551 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:11:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:11:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "6ca348ee-0457-4977-87ef-85a069fa32d3", 2024-08-31T06:11:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:11:28.551 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:11:28.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 -- 172.21.15.53:0/2209930285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3400b4d20 msgr2=0x7fa3400b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:28.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3400b4d20 0x7fa3400b7230 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa350103320 tx=0x7fa3501096e0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 -- 172.21.15.53:0/2209930285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa354102880 msgr2=0x7fa3541a0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:28.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa354102880 0x7fa3541a0790 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa350009230 tx=0x7fa350004270 comp rx=0 tx=0).stop 2024-08-31T06:11:28.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 -- 172.21.15.53:0/2209930285 shutdown_connections 2024-08-31T06:11:28.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3400b4d20 0x7fa3400b7230 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa354108ac0 0x7fa3541a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa354108170 0x7fa3541a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 --2- 172.21.15.53:0/2209930285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa354102880 0x7fa3541a0790 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:28.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 -- 172.21.15.53:0/2209930285 >> 172.21.15.53:0/2209930285 conn(0x7fa354079530 msgr2=0x7fa35406b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:28.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 -- 172.21.15.53:0/2209930285 shutdown_connections 2024-08-31T06:11:28.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:28.545+0000 7fa35b6a8640 1 -- 172.21.15.53:0/2209930285 wait complete. 2024-08-31T06:11:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:28 smithi130 ceph-mon[22266]: pgmap v520: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-08-31T06:11:28.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 121013 1.87 MB/sec execute 198 sec latency 33.053 ms 2024-08-31T06:11:29.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:11:29.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:29 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:11:29.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:29 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:29 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:11:29.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:29 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:11:29.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:29 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:29 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:11:29.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:29 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:29 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:11:29.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:29 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:29 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:11:29.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:29 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:29 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:11:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:29 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:29 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:11:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:29 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:11:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:29 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:29 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:11:29.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:29 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:29 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:11:29.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:29 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:29 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:11:29.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:29 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.607 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:11:29.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:29 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:11:29.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:29 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:29 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:11:29.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:29 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:11:29.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:29 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:29 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:11:29.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:29 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:29 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:11:29.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:29 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:29 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:11:29.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:29 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:29.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 121300 1.86 MB/sec execute 199 sec latency 17.352 ms 2024-08-31T06:11:30.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.160+0000 7f8a761f8640 1 -- 172.21.15.53:0/1668645493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a701050a0 msgr2=0x7f8a7010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.160+0000 7f8a761f8640 1 --2- 172.21.15.53:0/1668645493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a701050a0 0x7f8a7010d5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009860 tx=0x7f8a6402a340 comp rx=0 tx=0).stop 2024-08-31T06:11:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.160+0000 7f8a761f8640 1 -- 172.21.15.53:0/1668645493 shutdown_connections 2024-08-31T06:11:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.160+0000 7f8a761f8640 1 --2- 172.21.15.53:0/1668645493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a7010dbb0 0x7f8a701100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.160+0000 7f8a761f8640 1 --2- 172.21.15.53:0/1668645493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a701050a0 0x7f8a7010d5f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.160+0000 7f8a761f8640 1 --2- 172.21.15.53:0/1668645493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a70104750 0x7f8a70104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.160+0000 7f8a761f8640 1 -- 172.21.15.53:0/1668645493 >> 172.21.15.53:0/1668645493 conn(0x7f8a700794d0 msgr2=0x7f8a700798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.160+0000 7f8a761f8640 1 -- 172.21.15.53:0/1668645493 shutdown_connections 2024-08-31T06:11:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.160+0000 7f8a761f8640 1 -- 172.21.15.53:0/1668645493 wait complete. 2024-08-31T06:11:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.161+0000 7f8a761f8640 1 Processor -- start 2024-08-31T06:11:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.161+0000 7f8a761f8640 1 -- start start 2024-08-31T06:11:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a761f8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a70104750 0x7f8a7019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a761f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701050a0 0x7f8a7019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a761f8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a7010dbb0 0x7f8a7019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a761f8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8a70113680 con 0x7f8a701050a0 2024-08-31T06:11:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a761f8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a70113500 con 0x7f8a7010dbb0 2024-08-31T06:11:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a761f8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a70113800 con 0x7f8a70104750 2024-08-31T06:11:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a6effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701050a0 0x7f8a7019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a6effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701050a0 0x7f8a7019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33652/0 (socket says 172.21.15.53:33652) 2024-08-31T06:11:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a6effd640 1 -- 172.21.15.53:0/2291656757 learned_addr learned my addr 172.21.15.53:0/2291656757 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a6ffff640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a7010dbb0 0x7f8a7019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a6f7fe640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a70104750 0x7f8a7019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a6effd640 1 -- 172.21.15.53:0/2291656757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a70104750 msgr2=0x7f8a7019a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a6effd640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a70104750 0x7f8a7019a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a6effd640 1 -- 172.21.15.53:0/2291656757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a7010dbb0 msgr2=0x7f8a7019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a6effd640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a7010dbb0 0x7f8a7019f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a6effd640 1 -- 172.21.15.53:0/2291656757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a701a00e0 con 0x7f8a701050a0 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.162+0000 7f8a6ffff640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a7010dbb0 0x7f8a7019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.163+0000 7f8a6effd640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701050a0 0x7f8a7019a710 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8a64035040 tx=0x7f8a6402aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.163+0000 7f8a6cff9640 1 -- 172.21.15.53:0/2291656757 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64037040 con 0x7f8a701050a0 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.163+0000 7f8a6cff9640 1 -- 172.21.15.53:0/2291656757 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a64030c30 con 0x7f8a701050a0 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.163+0000 7f8a6cff9640 1 -- 172.21.15.53:0/2291656757 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640035f0 con 0x7f8a701050a0 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.163+0000 7f8a761f8640 1 -- 172.21.15.53:0/2291656757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a701a0370 con 0x7f8a701050a0 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.163+0000 7f8a761f8640 1 -- 172.21.15.53:0/2291656757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a701a6b30 con 0x7f8a701050a0 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.165+0000 7f8a7c76d740 1 Processor -- start 2024-08-31T06:11:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a7c76d740 1 -- start start 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6cff9640 1 -- 172.21.15.53:0/2291656757 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8a64043020 con 0x7f8a701050a0 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 0x55824c1aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 0x55824c1aa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bde4390 0x55824c1aad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55824c121630 con 0x55824bde4390 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55824c110bc0 con 0x55824be05070 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55824c114b70 con 0x55824bddc1b0 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 0x55824c1aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bde4390 0x55824c1aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 0x55824c1aa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60910/0 (socket says 172.21.15.53:60910) 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6ffff640 1 -- 172.21.15.53:0/3926517060 learned_addr learned my addr 172.21.15.53:0/3926517060 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6f7fe640 1 --2- 172.21.15.53:0/3926517060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 0x55824c1aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6ffff640 1 -- 172.21.15.53:0/3926517060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 msgr2=0x55824c1aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6ffff640 1 --2- 172.21.15.53:0/3926517060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 0x55824c1aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6ffff640 1 -- 172.21.15.53:0/3926517060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bde4390 msgr2=0x55824c1aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6ffff640 1 --2- 172.21.15.53:0/3926517060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bde4390 0x55824c1aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6ffff640 1 -- 172.21.15.53:0/3926517060 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55824be70650 con 0x55824be05070 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6f7fe640 1 --2- 172.21.15.53:0/3926517060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 0x55824c1aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6effd640 1 --2- 172.21.15.53:0/3926517060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bde4390 0x55824c1aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.166+0000 7f8a6cff9640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a580b4d20 0x7f8a580b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.167+0000 7f8a6f7fe640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a580b4d20 0x7f8a580b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.167+0000 7f8a6ffff640 1 --2- 172.21.15.53:0/3926517060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 0x55824c1aa2c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a680117e0 tx=0x7f8a68011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dadba4132876d91f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.167+0000 7f8a6cff9640 1 -- 172.21.15.53:0/2291656757 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f8a64104820 con 0x7f8a701050a0 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.167+0000 7f8a55ffb640 1 -- 172.21.15.53:0/3926517060 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68011310 con 0x55824be05070 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.167+0000 7f8a55ffb640 1 -- 172.21.15.53:0/3926517060 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a68003e00 con 0x55824be05070 2024-08-31T06:11:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.167+0000 7f8a55ffb640 1 -- 172.21.15.53:0/3926517060 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a680043d0 con 0x55824be05070 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.168+0000 7f8a7c76d740 1 -- 172.21.15.53:0/3926517060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 msgr2=0x55824c1aa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.168+0000 7f8a6f7fe640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a580b4d20 0x7f8a580b7230 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55824c1a8f40 tx=0x7f8a60009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.168+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/3926517060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 0x55824c1aa2c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a680117e0 tx=0x7f8a68011ca0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.168+0000 7f8a7c76d740 1 -- 172.21.15.53:0/3926517060 shutdown_connections 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.168+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/3926517060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bde4390 0x55824c1aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.168+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/3926517060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 0x55824c1aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.168+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/3926517060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 0x55824c1aa2c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.168+0000 7f8a7c76d740 1 -- 172.21.15.53:0/3926517060 >> 172.21.15.53:0/3926517060 conn(0x55824bdf9460 msgr2=0x55824c1a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.168+0000 7f8a7c76d740 1 -- 172.21.15.53:0/3926517060 shutdown_connections 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.168+0000 7f8a7c76d740 1 -- 172.21.15.53:0/3926517060 wait complete. 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.168+0000 7f8a7c76d740 1 -- start start 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a7c76d740 1 Processor -- start 2024-08-31T06:11:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 0x55824c1b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bde4390 0x55824c1b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55824bf73700 con 0x55824be05070 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55824c097700 con 0x55824bde4390 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55824c1b8aa0 con 0x55824bddc1b0 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a7c76d740 10 client.0 _ll_register_callbacks cb 0x55824c0c6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a6ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a6ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33666/0 (socket says 172.21.15.53:33666) 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a6f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 0x55824c1b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a6ffff640 1 -- 172.21.15.53:0/1485978543 learned_addr learned my addr 172.21.15.53:0/1485978543 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a6effd640 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bde4390 0x55824c1b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a6f7fe640 1 -- 172.21.15.53:0/1485978543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bde4390 msgr2=0x55824c1b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a6f7fe640 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bde4390 0x55824c1b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a6f7fe640 1 -- 172.21.15.53:0/1485978543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 msgr2=0x55824c1c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.169+0000 7f8a6f7fe640 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.170+0000 7f8a6f7fe640 1 -- 172.21.15.53:0/1485978543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55824c0d08b0 con 0x55824bddc1b0 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.170+0000 7f8a6ffff640 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.170+0000 7f8a6effd640 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bde4390 0x55824c1b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.170+0000 7f8a6f7fe640 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 0x55824c1b5ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a7006ba00 tx=0x7f8a60004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79d7438bdfcbefb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.170+0000 7f8a4effd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.170+0000 7f8a4effd640 1 -- 172.21.15.53:0/1485978543 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6002d060 con 0x55824bddc1b0 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.170+0000 7f8a4effd640 1 -- 172.21.15.53:0/1485978543 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f8a60018030 con 0x55824bddc1b0 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.170+0000 7f8a7c76d740 1 -- 172.21.15.53:0/1485978543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a68003e00 con 0x55824bddc1b0 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.170+0000 7f8a4effd640 1 -- 172.21.15.53:0/1485978543 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8a60009df0 con 0x55824bddc1b0 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.170+0000 7f8a7c76d740 10 client.27004 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.170+0000 7f8a7c76d740 1 -- 172.21.15.53:0/1485978543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55824c1c4990 con 0x55824bddc1b0 2024-08-31T06:11:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.171+0000 7f8a4effd640 1 -- 172.21.15.53:0/1485978543 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a68003e00 con 0x55824bddc1b0 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.171+0000 7f8a4effd640 1 -- 172.21.15.53:0/1485978543 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f8a600303d0 con 0x55824bddc1b0 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.171+0000 7f8a7c76d740 10 client.27004 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.171+0000 7f8a7c76d740 10 client.27004 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.171+0000 7f8a7c76d740 20 client.27004 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.171+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55824bdc39f0 0x55824c1c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.171+0000 7f8a7c76d740 4 client.27004 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.171+0000 7f8a7c76d740 1 -- 172.21.15.53:0/1485978543 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55824c123580 con 0x55824bdc39f0 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.171+0000 7f8a6effd640 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55824bdc39f0 0x55824c1c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.171+0000 7f8a6effd640 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55824bdc39f0 0x55824c1c7ed0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37fb34d93aa95018 server_cookie=4843ff07af2d34e in_seq=0 out_seq=0 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.171+0000 7f8a4effd640 10 client.27004 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.172+0000 7f8a4effd640 1 -- 172.21.15.53:0/1485978543 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55824c123580 con 0x55824bdc39f0 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.172+0000 7f8a4effd640 10 client.27004 handle_command_reply: tid=0 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.172+0000 7f8a7c76d740 1 client.27004 shutdown 2024-08-31T06:11:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a7c76d740 1 -- 172.21.15.53:0/1485978543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 msgr2=0x55824c1b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 0x55824c1b5ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a7006ba00 tx=0x7f8a60004730 comp rx=0 tx=0).stop 2024-08-31T06:11:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a7c76d740 1 -- 172.21.15.53:0/1485978543 shutdown_connections 2024-08-31T06:11:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55824bdc39f0 0x55824c1c7ed0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bde4390 0x55824c1b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/1485978543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bddc1b0 0x55824c1b5ab0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a7c76d740 1 -- 172.21.15.53:0/1485978543 >> 172.21.15.53:0/1485978543 conn(0x55824bdf9460 msgr2=0x55824c1ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a4effd640 0 client.27004 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a7c76d740 1 -- 172.21.15.53:0/1485978543 shutdown_connections 2024-08-31T06:11:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a7c76d740 1 -- 172.21.15.53:0/1485978543 wait complete. 2024-08-31T06:11:30.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.173+0000 7f8a7c76d740 20 client.27004 trim_cache size 0 max 16384 2024-08-31T06:11:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a7c76d740 1 Processor -- start 2024-08-31T06:11:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a7c76d740 1 -- start start 2024-08-31T06:11:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bddc1b0 0x55824c1b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bde4390 0x55824c1ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 0x55824c1ad900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8a701af530 con 0x55824bddc1b0 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a701b1070 con 0x55824be05070 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a701afc00 con 0x55824bde4390 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a6f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bddc1b0 0x55824c1b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a6f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bddc1b0 0x55824c1b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33672/0 (socket says 172.21.15.53:33672) 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a6f7fe640 1 -- 172.21.15.53:0/530880282 learned_addr learned my addr 172.21.15.53:0/530880282 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a6effd640 1 --2- 172.21.15.53:0/530880282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bde4390 0x55824c1ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.192+0000 7f8a6ffff640 1 --2- 172.21.15.53:0/530880282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 0x55824c1ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.193+0000 7f8a6effd640 1 -- 172.21.15.53:0/530880282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 msgr2=0x55824c1ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.193+0000 7f8a6effd640 1 --2- 172.21.15.53:0/530880282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 0x55824c1ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.193+0000 7f8a6effd640 1 -- 172.21.15.53:0/530880282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bddc1b0 msgr2=0x55824c1b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.193+0000 7f8a6effd640 1 --2- 172.21.15.53:0/530880282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bddc1b0 0x55824c1b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.193+0000 7f8a6effd640 1 -- 172.21.15.53:0/530880282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55824c1b1340 con 0x55824bde4390 2024-08-31T06:11:30.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.193+0000 7f8a6ffff640 1 --2- 172.21.15.53:0/530880282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 0x55824c1ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:30.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.193+0000 7f8a6effd640 1 --2- 172.21.15.53:0/530880282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bde4390 0x55824c1ad3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8a64101f50 tx=0x7f8a640b2040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42b59f89392483a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:30.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.193+0000 7f8a557fa640 1 -- 172.21.15.53:0/530880282 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640ca840 con 0x55824bde4390 2024-08-31T06:11:30.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.193+0000 7f8a557fa640 1 -- 172.21.15.53:0/530880282 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a6410a030 con 0x55824bde4390 2024-08-31T06:11:30.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.193+0000 7f8a557fa640 1 -- 172.21.15.53:0/530880282 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640ca660 con 0x55824bde4390 2024-08-31T06:11:30.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.194+0000 7f8a7c76d740 1 -- 172.21.15.53:0/530880282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bde4390 msgr2=0x55824c1ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.194+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/530880282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bde4390 0x55824c1ad3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8a64101f50 tx=0x7f8a640b2040 comp rx=0 tx=0).stop 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.194+0000 7f8a7c76d740 1 -- 172.21.15.53:0/530880282 shutdown_connections 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.194+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/530880282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824be05070 0x55824c1ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.194+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/530880282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bde4390 0x55824c1ad3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.194+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/530880282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824bddc1b0 0x55824c1b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.194+0000 7f8a7c76d740 1 -- 172.21.15.53:0/530880282 >> 172.21.15.53:0/530880282 conn(0x55824bdf9460 msgr2=0x55824c1b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.194+0000 7f8a7c76d740 1 -- 172.21.15.53:0/530880282 shutdown_connections 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.194+0000 7f8a7c76d740 1 -- 172.21.15.53:0/530880282 wait complete. 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a7c76d740 1 -- start start 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a7c76d740 1 Processor -- start 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bddc1b0 0x55824c1b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bde4390 0x55824c1ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a7c76d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1ba700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8a701b09a0 con 0x55824be05070 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a701b02d0 con 0x55824bddc1b0 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a7c76d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a701ad530 con 0x55824bde4390 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a7c76d740 10 client.0 _ll_register_callbacks cb 0x7f8a60009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a6ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1ba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a6f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bddc1b0 0x55824c1b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a6ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1ba700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33680/0 (socket says 172.21.15.53:33680) 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a6ffff640 1 -- 172.21.15.53:0/511880310 learned_addr learned my addr 172.21.15.53:0/511880310 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.195+0000 7f8a6effd640 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bde4390 0x55824c1ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a6ffff640 1 -- 172.21.15.53:0/511880310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bde4390 msgr2=0x55824c1ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a6ffff640 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bde4390 0x55824c1ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a6ffff640 1 -- 172.21.15.53:0/511880310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bddc1b0 msgr2=0x55824c1b9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a6ffff640 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bddc1b0 0x55824c1b9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a6ffff640 1 -- 172.21.15.53:0/511880310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55824c231890 con 0x55824be05070 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a6f7fe640 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bddc1b0 0x55824c1b9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a6ffff640 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1ba700 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f8a68006010 tx=0x7f8a68011270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2ed186b8c270ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a4effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a4effd640 1 -- 172.21.15.53:0/511880310 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6802d060 con 0x55824be05070 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a4effd640 1 -- 172.21.15.53:0/511880310 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f8a6800f9a0 con 0x55824be05070 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a7c76d740 1 -- 172.21.15.53:0/511880310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a6410a030 con 0x55824be05070 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a4effd640 1 -- 172.21.15.53:0/511880310 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8a6800fba0 con 0x55824be05070 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a7c76d740 10 client.17694 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.196+0000 7f8a7c76d740 1 -- 172.21.15.53:0/511880310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55824c232a50 con 0x55824be05070 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.197+0000 7f8a4effd640 1 -- 172.21.15.53:0/511880310 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a6410a030 con 0x55824be05070 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.197+0000 7f8a4effd640 1 -- 172.21.15.53:0/511880310 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f8a68018020 con 0x55824be05070 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.197+0000 7f8a7c76d740 10 client.17694 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.197+0000 7f8a7c76d740 10 client.17694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.197+0000 7f8a7c76d740 20 client.17694 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.197+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55824bd98da0 0x55824c235050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.197+0000 7f8a7c76d740 4 client.17694 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.197+0000 7f8a7c76d740 1 -- 172.21.15.53:0/511880310 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55824c11f020 con 0x55824bd98da0 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.197+0000 7f8a6f7fe640 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55824bd98da0 0x55824c235050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.197+0000 7f8a4effd640 10 client.17694 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.197+0000 7f8a6f7fe640 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55824bd98da0 0x55824c235050 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ac574d387ddc5d0 server_cookie=1866c2732335aa92 in_seq=0 out_seq=0 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a4effd640 1 -- 172.21.15.53:0/511880310 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x55824c11f020 con 0x55824bd98da0 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a4effd640 10 client.17694 handle_command_reply: tid=0 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 1 client.17694 shutdown 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 1 -- 172.21.15.53:0/511880310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 msgr2=0x55824c1ba700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1ba700 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f8a68006010 tx=0x7f8a68011270 comp rx=0 tx=0).stop 2024-08-31T06:11:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 1 -- 172.21.15.53:0/511880310 shutdown_connections 2024-08-31T06:11:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55824bd98da0 0x55824c235050 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824be05070 0x55824c1ba700 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55824bde4390 0x55824c1ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 1 --2- 172.21.15.53:0/511880310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55824bddc1b0 0x55824c1b9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 1 -- 172.21.15.53:0/511880310 >> 172.21.15.53:0/511880310 conn(0x55824bdf9460 msgr2=0x55824c1ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a4effd640 0 client.17694 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 1 -- 172.21.15.53:0/511880310 shutdown_connections 2024-08-31T06:11:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 1 -- 172.21.15.53:0/511880310 wait complete. 2024-08-31T06:11:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.198+0000 7f8a7c76d740 20 client.17694 trim_cache size 0 max 16384 2024-08-31T06:11:30.205 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "6ca348ee-0457-4977-87ef-85a069fa32d3", 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:30.206 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:30.207 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:30.208 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:30.209 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:30.210 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:11:30.211 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:11:30.212 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:11:30.212 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:11:30.212 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:11:30.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 -- 172.21.15.53:0/2291656757 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a580b4d20 msgr2=0x7f8a580b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:30.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a580b4d20 0x7f8a580b7230 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55824c1a8f40 tx=0x7f8a60009260 comp rx=0 tx=0).stop 2024-08-31T06:11:30.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 -- 172.21.15.53:0/2291656757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701050a0 msgr2=0x7f8a7019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:30.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701050a0 0x7f8a7019a710 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8a64035040 tx=0x7f8a6402aef0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 -- 172.21.15.53:0/2291656757 shutdown_connections 2024-08-31T06:11:30.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a580b4d20 0x7f8a580b7230 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a7010dbb0 0x7f8a7019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701050a0 0x7f8a7019a710 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 --2- 172.21.15.53:0/2291656757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a70104750 0x7f8a7019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:30.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 -- 172.21.15.53:0/2291656757 >> 172.21.15.53:0/2291656757 conn(0x7f8a700794d0 msgr2=0x7f8a700ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:30.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 -- 172.21.15.53:0/2291656757 shutdown_connections 2024-08-31T06:11:30.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:30.199+0000 7f8a761f8640 1 -- 172.21.15.53:0/2291656757 wait complete. 2024-08-31T06:11:30.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:30 smithi153 ceph-mon[22320]: pgmap v521: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.3 MiB/s wr, 127 op/s 2024-08-31T06:11:30.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:30 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:11:30.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:30 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:11:30.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:30 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:30 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:30 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:11:30.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:30 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:30 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:30 smithi053 ceph-mon[18924]: pgmap v521: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.3 MiB/s wr, 127 op/s 2024-08-31T06:11:30.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:30 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:11:30.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:30 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:11:30.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:30 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:30 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:30 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:11:30.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:30 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:30 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:30 smithi130 ceph-mon[22266]: pgmap v521: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.3 MiB/s wr, 127 op/s 2024-08-31T06:11:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:30 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:11:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:30 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:11:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:30 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:30 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:30 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:11:30.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:30 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:30 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:11:30.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 121803 1.86 MB/sec execute 200 sec latency 17.469 ms 2024-08-31T06:11:30.985 INFO:tasks.cephfs.filesystem:scrub status for tag:6ca348ee-0457-4977-87ef-85a069fa32d3 - {'path': '/', 'tag': '6ca348ee-0457-4977-87ef-85a069fa32d3', 'options': 'recursive,force'} 2024-08-31T06:11:31.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 122292 1.87 MB/sec execute 201 sec latency 22.255 ms 2024-08-31T06:11:32.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:32 smithi153 ceph-mon[22320]: pgmap v522: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.7 MiB/s wr, 180 op/s 2024-08-31T06:11:32.430 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:32 smithi130 ceph-mon[22266]: pgmap v522: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.7 MiB/s wr, 180 op/s 2024-08-31T06:11:32.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:32 smithi053 ceph-mon[18924]: pgmap v522: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.7 MiB/s wr, 180 op/s 2024-08-31T06:11:32.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 122926 1.87 MB/sec execute 202 sec latency 22.870 ms 2024-08-31T06:11:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.971+0000 7fbd20470640 1 -- 172.21.15.53:0/1138201469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18101e00 msgr2=0x7fbd18102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.971+0000 7fbd20470640 1 --2- 172.21.15.53:0/1138201469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18101e00 0x7fbd18102210 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009900 tx=0x7fbd1402a410 comp rx=0 tx=0).stop 2024-08-31T06:11:33.974 INFO:tasks.workunit.client.0.smithi053.stdout: 1 123400 1.88 MB/sec execute 203 sec latency 14.955 ms 2024-08-31T06:11:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.971+0000 7fbd20470640 1 -- 172.21.15.53:0/1138201469 shutdown_connections 2024-08-31T06:11:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.971+0000 7fbd20470640 1 --2- 172.21.15.53:0/1138201469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd18109b20 0x7fbd18110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.971+0000 7fbd20470640 1 --2- 172.21.15.53:0/1138201469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd181091d0 0x7fbd181095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.971+0000 7fbd20470640 1 --2- 172.21.15.53:0/1138201469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18101e00 0x7fbd18102210 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.971+0000 7fbd20470640 1 -- 172.21.15.53:0/1138201469 >> 172.21.15.53:0/1138201469 conn(0x7fbd18079c30 msgr2=0x7fbd1807a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.971+0000 7fbd20470640 1 -- 172.21.15.53:0/1138201469 shutdown_connections 2024-08-31T06:11:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.971+0000 7fbd20470640 1 -- 172.21.15.53:0/1138201469 wait complete. 2024-08-31T06:11:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.972+0000 7fbd20470640 1 Processor -- start 2024-08-31T06:11:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.972+0000 7fbd20470640 1 -- start start 2024-08-31T06:11:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.972+0000 7fbd20470640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd18101e00 0x7fbd1819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.972+0000 7fbd20470640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd181091d0 0x7fbd1819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.972+0000 7fbd20470640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18109b20 0x7fbd1819f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.972+0000 7fbd20470640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbd18113690 con 0x7fbd18109b20 2024-08-31T06:11:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.972+0000 7fbd20470640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbd18113510 con 0x7fbd181091d0 2024-08-31T06:11:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.972+0000 7fbd20470640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbd18113810 con 0x7fbd18101e00 2024-08-31T06:11:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1ea0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18109b20 0x7fbd1819f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1e20c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd18101e00 0x7fbd1819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1e20c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd18101e00 0x7fbd1819a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44128/0 (socket says 172.21.15.53:44128) 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1ea0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18109b20 0x7fbd1819f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35562/0 (socket says 172.21.15.53:35562) 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1da0b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd181091d0 0x7fbd1819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1e20c640 1 -- 172.21.15.53:0/944440030 learned_addr learned my addr 172.21.15.53:0/944440030 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1e20c640 1 -- 172.21.15.53:0/944440030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd181091d0 msgr2=0x7fbd1819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1e20c640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd181091d0 0x7fbd1819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1e20c640 1 -- 172.21.15.53:0/944440030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18109b20 msgr2=0x7fbd1819f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1e20c640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18109b20 0x7fbd1819f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1e20c640 1 -- 172.21.15.53:0/944440030 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd181a0080 con 0x7fbd18101e00 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18109b20 0x7fbd1819f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd1e20c640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd18101e00 0x7fbd1819a150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009230 tx=0x7fbd140319a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd0f7fe640 1 -- 172.21.15.53:0/944440030 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1403f030 con 0x7fbd18101e00 2024-08-31T06:11:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd20470640 1 -- 172.21.15.53:0/944440030 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd181a0310 con 0x7fbd18101e00 2024-08-31T06:11:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd0f7fe640 1 -- 172.21.15.53:0/944440030 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd140043d0 con 0x7fbd18101e00 2024-08-31T06:11:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd0f7fe640 1 -- 172.21.15.53:0/944440030 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14035070 con 0x7fbd18101e00 2024-08-31T06:11:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.973+0000 7fbd20470640 1 -- 172.21.15.53:0/944440030 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd181a6b00 con 0x7fbd18101e00 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.976+0000 7fbd273dc740 1 Processor -- start 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.976+0000 7fbd273dc740 1 -- start start 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8501b0 0x55a2ffbf3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff8272f0 0x55a2ffbf4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff82f4d0 0x55a2ffbf4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd273dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a2ffb69000 con 0x55a2ff8501b0 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd273dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a2ffb58590 con 0x55a2ff8272f0 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd273dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a2ffb5c540 con 0x55a2ff82f4d0 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd1ea0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8501b0 0x55a2ffbf3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd1ea0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8501b0 0x55a2ffbf3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35564/0 (socket says 172.21.15.53:35564) 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd1ea0d640 1 -- 172.21.15.53:0/1317841422 learned_addr learned my addr 172.21.15.53:0/1317841422 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd1da0b640 1 --2- 172.21.15.53:0/1317841422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff82f4d0 0x55a2ffbf4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd1ea0d640 1 -- 172.21.15.53:0/1317841422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff82f4d0 msgr2=0x55a2ffbf4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/1317841422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff82f4d0 0x55a2ffbf4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd1ea0d640 1 -- 172.21.15.53:0/1317841422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff8272f0 msgr2=0x55a2ffbf4220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/1317841422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff8272f0 0x55a2ffbf4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd0f7fe640 1 -- 172.21.15.53:0/944440030 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbd14042030 con 0x7fbd18101e00 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd1ea0d640 1 -- 172.21.15.53:0/1317841422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ff8bb790 con 0x55a2ff8501b0 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd1da0b640 1 --2- 172.21.15.53:0/1317841422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff82f4d0 0x55a2ffbf4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.977+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/1317841422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8501b0 0x55a2ffbf3ce0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fbd100117e0 tx=0x7fbd10011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5107a5b756042742 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.978+0000 7fbd0cbfe640 1 -- 172.21.15.53:0/1317841422 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd10011310 con 0x55a2ff8501b0 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.978+0000 7fbd0cbfe640 1 -- 172.21.15.53:0/1317841422 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd10003e00 con 0x55a2ff8501b0 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.978+0000 7fbd0cbfe640 1 -- 172.21.15.53:0/1317841422 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd100043d0 con 0x55a2ff8501b0 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.978+0000 7fbd0f7fe640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbd040b4ca0 0x7fbd040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.978+0000 7fbd1e20c640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbd040b4ca0 0x7fbd040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.978+0000 7fbd0f7fe640 1 -- 172.21.15.53:0/944440030 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fbd141058e0 con 0x7fbd18101e00 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd273dc740 1 -- 172.21.15.53:0/1317841422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8501b0 msgr2=0x55a2ffbf3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd273dc740 1 --2- 172.21.15.53:0/1317841422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8501b0 0x55a2ffbf3ce0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fbd100117e0 tx=0x7fbd10011ca0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd1e20c640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbd040b4ca0 0x7fbd040b71b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x55a2ffbf2960 tx=0x7fbd14098260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd273dc740 1 -- 172.21.15.53:0/1317841422 shutdown_connections 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd273dc740 1 --2- 172.21.15.53:0/1317841422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff82f4d0 0x55a2ffbf4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd273dc740 1 --2- 172.21.15.53:0/1317841422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff8272f0 0x55a2ffbf4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd273dc740 1 --2- 172.21.15.53:0/1317841422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8501b0 0x55a2ffbf3ce0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd273dc740 1 -- 172.21.15.53:0/1317841422 >> 172.21.15.53:0/1317841422 conn(0x55a2ff844300 msgr2=0x55a2ffbf1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd273dc740 1 -- 172.21.15.53:0/1317841422 shutdown_connections 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd273dc740 1 -- 172.21.15.53:0/1317841422 wait complete. 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd273dc740 1 -- start start 2024-08-31T06:11:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.979+0000 7fbd273dc740 1 Processor -- start 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff8272f0 0x55a2ffc03d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff82f4d0 0x55a2ffc04350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff8501b0 0x55a2ffc0fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd273dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a2ffa91ab0 con 0x55a2ff82f4d0 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd273dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a2ffadf680 con 0x55a2ff8272f0 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd273dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a2ffc06840 con 0x55a2ff8501b0 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd273dc740 10 client.0 _ll_register_callbacks cb 0x55a2ff867a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1da0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff82f4d0 0x55a2ffc04350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1da0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff82f4d0 0x55a2ffc04350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35580/0 (socket says 172.21.15.53:35580) 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1ea0d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff8272f0 0x55a2ffc03d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1da0b640 1 -- 172.21.15.53:0/3685549083 learned_addr learned my addr 172.21.15.53:0/3685549083 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff8501b0 0x55a2ffc0fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1da0b640 1 -- 172.21.15.53:0/3685549083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff8501b0 msgr2=0x55a2ffc0fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1da0b640 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff8501b0 0x55a2ffc0fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1da0b640 1 -- 172.21.15.53:0/3685549083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff8272f0 msgr2=0x55a2ffc03d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1da0b640 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff8272f0 0x55a2ffc03d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1da0b640 1 -- 172.21.15.53:0/3685549083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2ff934620 con 0x55a2ff82f4d0 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff8272f0 0x55a2ffc03d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd1da0b640 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff82f4d0 0x55a2ffc04350 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fbd08012700 tx=0x7fbd08012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c4ce28f6634c47 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.980+0000 7fbd01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd01ffb640 1 -- 172.21.15.53:0/3685549083 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08004050 con 0x55a2ff82f4d0 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd01ffb640 1 -- 172.21.15.53:0/3685549083 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fbd080041f0 con 0x55a2ff82f4d0 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd273dc740 1 -- 172.21.15.53:0/3685549083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd10003e00 con 0x55a2ff82f4d0 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd01ffb640 1 -- 172.21.15.53:0/3685549083 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fbd08004410 con 0x55a2ff82f4d0 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd273dc740 10 client.17706 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd273dc740 1 -- 172.21.15.53:0/3685549083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a2ffc12a00 con 0x55a2ff82f4d0 2024-08-31T06:11:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd01ffb640 1 -- 172.21.15.53:0/3685549083 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd10003e00 con 0x55a2ff82f4d0 2024-08-31T06:11:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd01ffb640 1 -- 172.21.15.53:0/3685549083 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fbd08003bd0 con 0x55a2ff82f4d0 2024-08-31T06:11:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd273dc740 10 client.17706 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd273dc740 10 client.17706 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd273dc740 20 client.17706 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd273dc740 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2ff80ed80 0x55a2ffc15ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd273dc740 4 client.17706 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.981+0000 7fbd273dc740 1 -- 172.21.15.53:0/3685549083 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2ffb6af50 con 0x55a2ff80ed80 2024-08-31T06:11:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.982+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2ff80ed80 0x55a2ffc15ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.982+0000 7fbd01ffb640 10 client.17706 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.982+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2ff80ed80 0x55a2ffc15ed0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f38d03ce0fb94f81 server_cookie=4d1cda060de96d6e in_seq=0 out_seq=0 2024-08-31T06:11:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd01ffb640 1 -- 172.21.15.53:0/3685549083 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2ffb6af50 con 0x55a2ff80ed80 2024-08-31T06:11:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd01ffb640 10 client.17706 handle_command_reply: tid=0 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 1 client.17706 shutdown 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 1 -- 172.21.15.53:0/3685549083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff82f4d0 msgr2=0x55a2ffc04350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff82f4d0 0x55a2ffc04350 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fbd08012700 tx=0x7fbd08012bc0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 1 -- 172.21.15.53:0/3685549083 shutdown_connections 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2ff80ed80 0x55a2ffc15ed0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff8501b0 0x55a2ffc0fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff82f4d0 0x55a2ffc04350 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd01ffb640 0 client.17706 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 1 --2- 172.21.15.53:0/3685549083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff8272f0 0x55a2ffc03d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 1 -- 172.21.15.53:0/3685549083 >> 172.21.15.53:0/3685549083 conn(0x55a2ff844300 msgr2=0x55a2ffbf0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 1 -- 172.21.15.53:0/3685549083 shutdown_connections 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 1 -- 172.21.15.53:0/3685549083 wait complete. 2024-08-31T06:11:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:33.983+0000 7fbd273dc740 20 client.17706 trim_cache size 0 max 16384 2024-08-31T06:11:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd273dc740 1 Processor -- start 2024-08-31T06:11:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd273dc740 1 -- start start 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff80ed80 0x55a2ffc0fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8272f0 0x55a2ffc023c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff82f4d0 0x55a2ffc02900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd273dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbd181ad240 con 0x55a2ff8272f0 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd273dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbd181aed80 con 0x55a2ff82f4d0 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd273dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbd181ad910 con 0x55a2ff80ed80 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd1da0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8272f0 0x55a2ffc023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd1da0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8272f0 0x55a2ffc023c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35594/0 (socket says 172.21.15.53:35594) 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd1da0b640 1 -- 172.21.15.53:0/2750887221 learned_addr learned my addr 172.21.15.53:0/2750887221 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.000+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/2750887221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff82f4d0 0x55a2ffc02900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.001+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/2750887221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff80ed80 0x55a2ffc0fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.001+0000 7fbd1da0b640 1 -- 172.21.15.53:0/2750887221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff80ed80 msgr2=0x55a2ffc0fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.001+0000 7fbd1da0b640 1 --2- 172.21.15.53:0/2750887221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff80ed80 0x55a2ffc0fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.001+0000 7fbd1da0b640 1 -- 172.21.15.53:0/2750887221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff82f4d0 msgr2=0x55a2ffc02900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.001+0000 7fbd1da0b640 1 --2- 172.21.15.53:0/2750887221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff82f4d0 0x55a2ffc02900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.001+0000 7fbd1da0b640 1 -- 172.21.15.53:0/2750887221 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ffbeff60 con 0x55a2ff8272f0 2024-08-31T06:11:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.001+0000 7fbd1da0b640 1 --2- 172.21.15.53:0/2750887221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8272f0 0x55a2ffc023c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800a010 tx=0x7fbd08010780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca5403597a3004e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.001+0000 7fbd03fff640 1 -- 172.21.15.53:0/2750887221 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08029040 con 0x55a2ff8272f0 2024-08-31T06:11:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.001+0000 7fbd03fff640 1 -- 172.21.15.53:0/2750887221 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd08003fc0 con 0x55a2ff8272f0 2024-08-31T06:11:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.001+0000 7fbd03fff640 1 -- 172.21.15.53:0/2750887221 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800fc50 con 0x55a2ff8272f0 2024-08-31T06:11:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.002+0000 7fbd273dc740 1 -- 172.21.15.53:0/2750887221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8272f0 msgr2=0x55a2ffc023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.002+0000 7fbd273dc740 1 --2- 172.21.15.53:0/2750887221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8272f0 0x55a2ffc023c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800a010 tx=0x7fbd08010780 comp rx=0 tx=0).stop 2024-08-31T06:11:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.002+0000 7fbd273dc740 1 -- 172.21.15.53:0/2750887221 shutdown_connections 2024-08-31T06:11:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.002+0000 7fbd273dc740 1 --2- 172.21.15.53:0/2750887221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff82f4d0 0x55a2ffc02900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.002+0000 7fbd273dc740 1 --2- 172.21.15.53:0/2750887221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff8272f0 0x55a2ffc023c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.002+0000 7fbd273dc740 1 --2- 172.21.15.53:0/2750887221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff80ed80 0x55a2ffc0fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.002+0000 7fbd273dc740 1 -- 172.21.15.53:0/2750887221 >> 172.21.15.53:0/2750887221 conn(0x55a2ff844300 msgr2=0x55a2ffbfec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.002+0000 7fbd273dc740 1 -- 172.21.15.53:0/2750887221 shutdown_connections 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.002+0000 7fbd273dc740 1 -- 172.21.15.53:0/2750887221 wait complete. 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.002+0000 7fbd273dc740 1 -- start start 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd273dc740 1 Processor -- start 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff80ed80 0x55a2ffc0c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff8272f0 0x55a2ffbf3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd273dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff82f4d0 0x55a2ffbf3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd273dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbd181ae6b0 con 0x55a2ff80ed80 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd273dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbd181adfe0 con 0x55a2ff82f4d0 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd273dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbd181ab240 con 0x55a2ff8272f0 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd273dc740 10 client.0 _ll_register_callbacks cb 0x7fbd08009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd1ea0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff80ed80 0x55a2ffc0c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd1ea0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff80ed80 0x55a2ffc0c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35604/0 (socket says 172.21.15.53:35604) 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd1ea0d640 1 -- 172.21.15.53:0/1362032989 learned_addr learned my addr 172.21.15.53:0/1362032989 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd1da0b640 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff8272f0 0x55a2ffbf3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff82f4d0 0x55a2ffbf3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd1ea0d640 1 -- 172.21.15.53:0/1362032989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff8272f0 msgr2=0x55a2ffbf3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff8272f0 0x55a2ffbf3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd1ea0d640 1 -- 172.21.15.53:0/1362032989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff82f4d0 msgr2=0x55a2ffbf3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff82f4d0 0x55a2ffbf3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.003+0000 7fbd1ea0d640 1 -- 172.21.15.53:0/1362032989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2ffbf45b0 con 0x55a2ff80ed80 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd1ea0d640 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff80ed80 0x55a2ffc0c250 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fbd10014040 tx=0x7fbd10011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9868d8ad3531d288 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd01ffb640 1 -- 172.21.15.53:0/1362032989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd10025040 con 0x55a2ff80ed80 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd01ffb640 1 -- 172.21.15.53:0/1362032989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fbd100051c0 con 0x55a2ff80ed80 2024-08-31T06:11:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd273dc740 1 -- 172.21.15.53:0/1362032989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd08003fc0 con 0x55a2ff80ed80 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd01ffb640 1 -- 172.21.15.53:0/1362032989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fbd100053c0 con 0x55a2ff80ed80 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd273dc740 10 client.17712 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd273dc740 1 -- 172.21.15.53:0/1362032989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a2ffc80890 con 0x55a2ff80ed80 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd01ffb640 1 -- 172.21.15.53:0/1362032989 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd08003fc0 con 0x55a2ff80ed80 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd01ffb640 1 -- 172.21.15.53:0/1362032989 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fbd10018020 con 0x55a2ff80ed80 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd273dc740 10 client.17712 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd273dc740 10 client.17712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd273dc740 20 client.17712 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd273dc740 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2ff8501b0 0x55a2ffc82d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd273dc740 4 client.17712 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.004+0000 7fbd273dc740 1 -- 172.21.15.53:0/1362032989 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a2ffb669f0 con 0x55a2ff8501b0 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.005+0000 7fbd1da0b640 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2ff8501b0 0x55a2ffc82d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.005+0000 7fbd01ffb640 10 client.17712 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.005+0000 7fbd1da0b640 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2ff8501b0 0x55a2ffc82d80 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c75d18b844953ab server_cookie=d5ee7ba8e03aa5c8 in_seq=0 out_seq=0 2024-08-31T06:11:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd01ffb640 1 -- 172.21.15.53:0/1362032989 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a2ffb669f0 con 0x55a2ff8501b0 2024-08-31T06:11:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd01ffb640 10 client.17712 handle_command_reply: tid=0 2024-08-31T06:11:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 1 client.17712 shutdown 2024-08-31T06:11:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 1 -- 172.21.15.53:0/1362032989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff80ed80 msgr2=0x55a2ffc0c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff80ed80 0x55a2ffc0c250 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fbd10014040 tx=0x7fbd10011ca0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 1 -- 172.21.15.53:0/1362032989 shutdown_connections 2024-08-31T06:11:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a2ff8501b0 0x55a2ffc82d80 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2ff82f4d0 0x55a2ffbf3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a2ff8272f0 0x55a2ffbf3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 1 --2- 172.21.15.53:0/1362032989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2ff80ed80 0x55a2ffc0c250 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 1 -- 172.21.15.53:0/1362032989 >> 172.21.15.53:0/1362032989 conn(0x55a2ff844300 msgr2=0x55a2ffbf0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd01ffb640 0 client.17712 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 1 -- 172.21.15.53:0/1362032989 shutdown_connections 2024-08-31T06:11:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 1 -- 172.21.15.53:0/1362032989 wait complete. 2024-08-31T06:11:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.022+0000 7fbd273dc740 20 client.17712 trim_cache size 0 max 16384 2024-08-31T06:11:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:11:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:11:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:11:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:11:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 -- 172.21.15.53:0/944440030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbd040b4ca0 msgr2=0x7fbd040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbd040b4ca0 0x7fbd040b71b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x55a2ffbf2960 tx=0x7fbd14098260 comp rx=0 tx=0).stop 2024-08-31T06:11:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 -- 172.21.15.53:0/944440030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd18101e00 msgr2=0x7fbd1819a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd18101e00 0x7fbd1819a150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009230 tx=0x7fbd140319a0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 -- 172.21.15.53:0/944440030 shutdown_connections 2024-08-31T06:11:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbd040b4ca0 0x7fbd040b71b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd18109b20 0x7fbd1819f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd181091d0 0x7fbd1819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 --2- 172.21.15.53:0/944440030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd18101e00 0x7fbd1819a150 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 -- 172.21.15.53:0/944440030 >> 172.21.15.53:0/944440030 conn(0x7fbd18079c30 msgr2=0x7fbd18107370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 -- 172.21.15.53:0/944440030 shutdown_connections 2024-08-31T06:11:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:34.023+0000 7fbd20470640 1 -- 172.21.15.53:0/944440030 wait complete. 2024-08-31T06:11:34.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:34 smithi153 ceph-mon[22320]: pgmap v523: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2024-08-31T06:11:34.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:34 smithi053 ceph-mon[18924]: pgmap v523: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2024-08-31T06:11:34.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:34 smithi130 ceph-mon[22266]: pgmap v523: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2024-08-31T06:11:34.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 123947 1.89 MB/sec execute 204 sec latency 58.274 ms 2024-08-31T06:11:35.974 INFO:tasks.workunit.client.0.smithi053.stdout: 1 124413 1.90 MB/sec execute 205 sec latency 14.101 ms 2024-08-31T06:11:36.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:36 smithi153 ceph-mon[22320]: pgmap v524: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-08-31T06:11:36.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:36 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:11:36.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:36 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:11:36.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:36 smithi053 ceph-mon[18924]: pgmap v524: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-08-31T06:11:36.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:36 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:11:36.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:36 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:11:36.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:36 smithi130 ceph-mon[22266]: pgmap v524: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-08-31T06:11:36.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:36 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:11:36.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:36 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:11:36.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 124656 1.89 MB/sec execute 206 sec latency 14.639 ms 2024-08-31T06:11:37.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:37 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:11:37.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:37 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:11:37.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:37 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:11:37.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:37 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:11:37.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:37 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:11:37.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:37 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:11:37.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 125071 1.89 MB/sec execute 207 sec latency 17.667 ms 2024-08-31T06:11:38.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:38 smithi153 ceph-mon[22320]: pgmap v525: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 1.6 MiB/s wr, 186 op/s 2024-08-31T06:11:38.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:38 smithi053 ceph-mon[18924]: pgmap v525: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 1.6 MiB/s wr, 186 op/s 2024-08-31T06:11:38.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:38 smithi130 ceph-mon[22266]: pgmap v525: 97 pgs: 97 active+clean; 71 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 1.6 MiB/s wr, 186 op/s 2024-08-31T06:11:38.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 125592 1.90 MB/sec execute 208 sec latency 36.044 ms 2024-08-31T06:11:39.197 INFO:tasks.quiescer.fs.[cephfs]:Total duration (56.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T06:11:39.197 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.0 2024-08-31T06:11:39.197 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:11:39.474 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:11:39.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 126054 1.89 MB/sec execute 209 sec latency 24.099 ms 2024-08-31T06:11:40.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:40 smithi153 ceph-mon[22320]: pgmap v526: 97 pgs: 97 active+clean; 73 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 1.4 MiB/s wr, 140 op/s 2024-08-31T06:11:40.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:40 smithi053 ceph-mon[18924]: pgmap v526: 97 pgs: 97 active+clean; 73 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 1.4 MiB/s wr, 140 op/s 2024-08-31T06:11:40.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:40 smithi130 ceph-mon[22266]: pgmap v526: 97 pgs: 97 active+clean; 73 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 1.4 MiB/s wr, 140 op/s 2024-08-31T06:11:40.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 126584 1.89 MB/sec execute 210 sec latency 74.989 ms 2024-08-31T06:11:41.973 INFO:tasks.workunit.client.0.smithi053.stdout: 1 127064 1.90 MB/sec execute 211 sec latency 139.018 ms 2024-08-31T06:11:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.389+0000 7fdf34257640 1 -- 172.21.15.53:0/974853368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2c102880 msgr2=0x7fdf2c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.389+0000 7fdf34257640 1 --2- 172.21.15.53:0/974853368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2c102880 0x7fdf2c102c90 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009900 tx=0x7fdf2802a410 comp rx=0 tx=0).stop 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.389+0000 7fdf34257640 1 -- 172.21.15.53:0/974853368 shutdown_connections 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.389+0000 7fdf34257640 1 --2- 172.21.15.53:0/974853368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf2c108ac0 0x7fdf2c10f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.389+0000 7fdf34257640 1 --2- 172.21.15.53:0/974853368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf2c108170 0x7fdf2c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.389+0000 7fdf34257640 1 --2- 172.21.15.53:0/974853368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2c102880 0x7fdf2c102c90 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.389+0000 7fdf34257640 1 -- 172.21.15.53:0/974853368 >> 172.21.15.53:0/974853368 conn(0x7fdf2c079500 msgr2=0x7fdf2c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.389+0000 7fdf34257640 1 -- 172.21.15.53:0/974853368 shutdown_connections 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.389+0000 7fdf34257640 1 -- 172.21.15.53:0/974853368 wait complete. 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf34257640 1 Processor -- start 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf34257640 1 -- start start 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf34257640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2c102880 0x7fdf2c19a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf34257640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf2c108170 0x7fdf2c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf34257640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf2c108ac0 0x7fdf2c19f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf34257640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1125f0 con 0x7fdf2c102880 2024-08-31T06:11:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf34257640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c112470 con 0x7fdf2c108ac0 2024-08-31T06:11:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf34257640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c112770 con 0x7fdf2c108170 2024-08-31T06:11:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf31ff3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2c102880 0x7fdf2c19a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf31ff3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2c102880 0x7fdf2c19a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35618/0 (socket says 172.21.15.53:35618) 2024-08-31T06:11:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf317f2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf2c108170 0x7fdf2c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf31ff3640 1 -- 172.21.15.53:0/2048135317 learned_addr learned my addr 172.21.15.53:0/2048135317 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.390+0000 7fdf327f4640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf2c108ac0 0x7fdf2c19f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf317f2640 1 -- 172.21.15.53:0/2048135317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf2c108ac0 msgr2=0x7fdf2c19f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf317f2640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf2c108ac0 0x7fdf2c19f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf317f2640 1 -- 172.21.15.53:0/2048135317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2c102880 msgr2=0x7fdf2c19a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf317f2640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2c102880 0x7fdf2c19a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf317f2640 1 -- 172.21.15.53:0/2048135317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c1a00a0 con 0x7fdf2c108170 2024-08-31T06:11:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf31ff3640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2c102880 0x7fdf2c19a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf317f2640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf2c108170 0x7fdf2c19a6d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c005fd0 tx=0x7fdf1c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf22ffd640 1 -- 172.21.15.53:0/2048135317 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c009c00 con 0x7fdf2c108170 2024-08-31T06:11:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf22ffd640 1 -- 172.21.15.53:0/2048135317 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf1c0044c0 con 0x7fdf2c108170 2024-08-31T06:11:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf22ffd640 1 -- 172.21.15.53:0/2048135317 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c003d40 con 0x7fdf2c108170 2024-08-31T06:11:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf34257640 1 -- 172.21.15.53:0/2048135317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2c1a0390 con 0x7fdf2c108170 2024-08-31T06:11:42.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.391+0000 7fdf34257640 1 -- 172.21.15.53:0/2048135317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf2c1a6af0 con 0x7fdf2c108170 2024-08-31T06:11:42.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.392+0000 7fdf34257640 1 -- 172.21.15.53:0/2048135317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2c103ab0 con 0x7fdf2c108170 2024-08-31T06:11:42.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.394+0000 7fdf22ffd640 1 -- 172.21.15.53:0/2048135317 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdf1c003ee0 con 0x7fdf2c108170 2024-08-31T06:11:42.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.394+0000 7fdf22ffd640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdf180b4ca0 0x7fdf180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:42.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.395+0000 7fdf31ff3640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdf180b4ca0 0x7fdf180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:42.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.395+0000 7fdf22ffd640 1 -- 172.21.15.53:0/2048135317 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fdf1c0e5150 con 0x7fdf2c108170 2024-08-31T06:11:42.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.395+0000 7fdf31ff3640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdf180b4ca0 0x7fdf180b71b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdf28032fd0 tx=0x7fdf280095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:42.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.400+0000 7fdf22ffd640 1 -- 172.21.15.53:0/2048135317 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdf1c017020 con 0x7fdf2c108170 2024-08-31T06:11:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:42 smithi153 ceph-mon[22320]: pgmap v527: 97 pgs: 97 active+clean; 75 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2024-08-31T06:11:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:42 smithi053 ceph-mon[18924]: pgmap v527: 97 pgs: 97 active+clean; 75 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2024-08-31T06:11:42.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:42 smithi130 ceph-mon[22266]: pgmap v527: 97 pgs: 97 active+clean; 75 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2024-08-31T06:11:42.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.656+0000 7fdf34257640 1 -- 172.21.15.53:0/2048135317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf2c19b260 con 0x7fdf2c108170 2024-08-31T06:11:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.657+0000 7fdf22ffd640 1 -- 172.21.15.53:0/2048135317 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11985 (secure 0 0 0) 0x7fdf1c0b4400 con 0x7fdf2c108170 2024-08-31T06:11:42.659 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:11:42.659 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":36,"btime":"2024-08-31T06:11:22:133856+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:11:21.364258+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:11:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 36 2024-08-31T06:11:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.659+0000 7fdf34257640 1 -- 172.21.15.53:0/2048135317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdf180b4ca0 msgr2=0x7fdf180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.659+0000 7fdf34257640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdf180b4ca0 0x7fdf180b71b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdf28032fd0 tx=0x7fdf280095c0 comp rx=0 tx=0).stop 2024-08-31T06:11:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.659+0000 7fdf34257640 1 -- 172.21.15.53:0/2048135317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf2c108170 msgr2=0x7fdf2c19a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.659+0000 7fdf34257640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf2c108170 0x7fdf2c19a6d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c005fd0 tx=0x7fdf1c00dde0 comp rx=0 tx=0).stop 2024-08-31T06:11:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.659+0000 7fdf34257640 1 -- 172.21.15.53:0/2048135317 shutdown_connections 2024-08-31T06:11:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.659+0000 7fdf34257640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdf180b4ca0 0x7fdf180b71b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.659+0000 7fdf34257640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf2c108ac0 0x7fdf2c19f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.659+0000 7fdf34257640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf2c108170 0x7fdf2c19a6d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.659+0000 7fdf34257640 1 --2- 172.21.15.53:0/2048135317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2c102880 0x7fdf2c19a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.659+0000 7fdf34257640 1 -- 172.21.15.53:0/2048135317 >> 172.21.15.53:0/2048135317 conn(0x7fdf2c079500 msgr2=0x7fdf2c1018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:42.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.660+0000 7fdf34257640 1 -- 172.21.15.53:0/2048135317 shutdown_connections 2024-08-31T06:11:42.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:42.660+0000 7fdf34257640 1 -- 172.21.15.53:0/2048135317 wait complete. 2024-08-31T06:11:42.974 INFO:tasks.workunit.client.0.smithi053.stdout: 1 127519 1.91 MB/sec execute 212 sec latency 18.797 ms 2024-08-31T06:11:43.352 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2048135317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:11:43.384 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0' 2024-08-31T06:11:43.384 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0 2024-08-31T06:11:43.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:43 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2048135317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:11:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:11:43.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:43 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2048135317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:11:43.980 INFO:tasks.workunit.client.0.smithi053.stdout: 1 127989 1.92 MB/sec execute 213 sec latency 34.732 ms 2024-08-31T06:11:44.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.207+0000 7febf5034640 1 -- 172.21.15.53:0/1820787363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf0108180 msgr2=0x7febf0108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:44.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.207+0000 7febf5034640 1 --2- 172.21.15.53:0/1820787363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf0108180 0x7febf0108590 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7febe4009900 tx=0x7febe402a410 comp rx=0 tx=0).stop 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.207+0000 7febf5034640 1 -- 172.21.15.53:0/1820787363 shutdown_connections 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.207+0000 7febf5034640 1 --2- 172.21.15.53:0/1820787363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf0108ad0 0x7febf010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.207+0000 7febf5034640 1 --2- 172.21.15.53:0/1820787363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf0108180 0x7febf0108590 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.208+0000 7febf5034640 1 --2- 172.21.15.53:0/1820787363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf0102890 0x7febf0102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.208+0000 7febf5034640 1 -- 172.21.15.53:0/1820787363 >> 172.21.15.53:0/1820787363 conn(0x7febf00795d0 msgr2=0x7febf00799e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.208+0000 7febf5034640 1 -- 172.21.15.53:0/1820787363 shutdown_connections 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.208+0000 7febf5034640 1 -- 172.21.15.53:0/1820787363 wait complete. 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.208+0000 7febf5034640 1 Processor -- start 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febf5034640 1 -- start start 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febf5034640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf0102890 0x7febf019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febf5034640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf0108180 0x7febf019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febf5034640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf0108ad0 0x7febf019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febf5034640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7febf01125f0 con 0x7febf0108180 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febf5034640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febf0112470 con 0x7febf0102890 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febf5034640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febf0112770 con 0x7febf0108ad0 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf0108180 0x7febf019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf0108180 0x7febf019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47522/0 (socket says 172.21.15.53:47522) 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febee59c640 1 -- 172.21.15.53:0/1624789099 learned_addr learned my addr 172.21.15.53:0/1624789099 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febeed9d640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf0102890 0x7febf019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febef59e640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf0108ad0 0x7febf019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febee59c640 1 -- 172.21.15.53:0/1624789099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf0108ad0 msgr2=0x7febf019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febee59c640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf0108ad0 0x7febf019f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febee59c640 1 -- 172.21.15.53:0/1624789099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf0102890 msgr2=0x7febf019a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.209+0000 7febee59c640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf0102890 0x7febf019a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.210+0000 7febee59c640 1 -- 172.21.15.53:0/1624789099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf01a00e0 con 0x7febf0108180 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.210+0000 7febee59c640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf0108180 0x7febf019a710 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7febe4005940 tx=0x7febe40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.210+0000 7febd7fff640 1 -- 172.21.15.53:0/1624789099 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe403f030 con 0x7febf0108180 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.210+0000 7febf5034640 1 -- 172.21.15.53:0/1624789099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf01a0370 con 0x7febf0108180 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.210+0000 7febd7fff640 1 -- 172.21.15.53:0/1624789099 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febe4003a80 con 0x7febf0108180 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.210+0000 7febd7fff640 1 -- 172.21.15.53:0/1624789099 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4035070 con 0x7febf0108180 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.210+0000 7febf5034640 1 -- 172.21.15.53:0/1624789099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf01a6b30 con 0x7febf0108180 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.213+0000 7febfb5a9740 1 Processor -- start 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.213+0000 7febfb5a9740 1 -- start start 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.213+0000 7febd7fff640 1 -- 172.21.15.53:0/1624789099 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7febe4042030 con 0x7febf0108180 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.213+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 0x55e68214ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.213+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d7e980 0x55e68214f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.213+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d86b60 0x55e68214f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.213+0000 7febfb5a9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e6820c3330 con 0x55e681da7840 2024-08-31T06:11:44.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.213+0000 7febfb5a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e6820b28c0 con 0x55e681d7e980 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.213+0000 7febfb5a9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e6820b6870 con 0x55e681d86b60 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febef59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 0x55e68214ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febef59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 0x55e68214ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47534/0 (socket says 172.21.15.53:47534) 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febeed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d7e980 0x55e68214f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febef59e640 1 -- 172.21.15.53:0/633948776 learned_addr learned my addr 172.21.15.53:0/633948776 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febee59c640 1 --2- 172.21.15.53:0/633948776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d86b60 0x55e68214f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febef59e640 1 -- 172.21.15.53:0/633948776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d86b60 msgr2=0x55e68214f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febef59e640 1 --2- 172.21.15.53:0/633948776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d86b60 0x55e68214f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febef59e640 1 -- 172.21.15.53:0/633948776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d7e980 msgr2=0x55e68214f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febef59e640 1 --2- 172.21.15.53:0/633948776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d7e980 0x55e68214f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febef59e640 1 -- 172.21.15.53:0/633948776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e68206adf0 con 0x55e681da7840 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febeed9d640 1 --2- 172.21.15.53:0/633948776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d7e980 0x55e68214f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:44.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febef59e640 1 --2- 172.21.15.53:0/633948776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 0x55e68214ec90 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7febe8003a20 tx=0x7febe8003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babd559cdd8c5fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.214+0000 7febd7fff640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febd80b4ca0 0x7febd80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.215+0000 7febd57fa640 1 -- 172.21.15.53:0/633948776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe801a470 con 0x55e681da7840 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.215+0000 7febeed9d640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febd80b4ca0 0x7febd80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.215+0000 7febd57fa640 1 -- 172.21.15.53:0/633948776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febe8015070 con 0x55e681da7840 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.215+0000 7febd57fa640 1 -- 172.21.15.53:0/633948776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8011880 con 0x55e681da7840 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.215+0000 7febd7fff640 1 -- 172.21.15.53:0/1624789099 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7febe4105a30 con 0x7febf0108180 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febfb5a9740 1 -- 172.21.15.53:0/633948776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 msgr2=0x55e68214ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febfb5a9740 1 --2- 172.21.15.53:0/633948776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 0x55e68214ec90 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7febe8003a20 tx=0x7febe8003ee0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febeed9d640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febd80b4ca0 0x7febd80b71b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7febe0004650 tx=0x7febe000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febfb5a9740 1 -- 172.21.15.53:0/633948776 shutdown_connections 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febfb5a9740 1 --2- 172.21.15.53:0/633948776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d86b60 0x55e68214f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febfb5a9740 1 --2- 172.21.15.53:0/633948776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d7e980 0x55e68214f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febfb5a9740 1 --2- 172.21.15.53:0/633948776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 0x55e68214ec90 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febfb5a9740 1 -- 172.21.15.53:0/633948776 >> 172.21.15.53:0/633948776 conn(0x55e681d9b990 msgr2=0x55e68214cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febfb5a9740 1 -- 172.21.15.53:0/633948776 shutdown_connections 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febfb5a9740 1 -- 172.21.15.53:0/633948776 wait complete. 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febfb5a9740 1 -- start start 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.216+0000 7febfb5a9740 1 Processor -- start 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d7e980 0x55e68215e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 0x55e68215ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 0x55e68216ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febfb5a9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e681f157a0 con 0x55e681da7840 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febfb5a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e682039240 con 0x55e681d86b60 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febfb5a9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e6821617a0 con 0x55e681d7e980 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febfb5a9740 10 client.0 _ll_register_callbacks cb 0x55e681dbf090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febee59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 0x55e68215ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febee59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 0x55e68215ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43630/0 (socket says 172.21.15.53:43630) 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febee59c640 1 -- 172.21.15.53:0/3363286755 learned_addr learned my addr 172.21.15.53:0/3363286755 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febeed9d640 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d7e980 0x55e68215e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febef59e640 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 0x55e68216ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febee59c640 1 -- 172.21.15.53:0/3363286755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d7e980 msgr2=0x55e68215e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febee59c640 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d7e980 0x55e68215e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febee59c640 1 -- 172.21.15.53:0/3363286755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 msgr2=0x55e68216ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febee59c640 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 0x55e68216ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febee59c640 1 -- 172.21.15.53:0/3363286755 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e68206f2b0 con 0x55e681d86b60 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febef59e640 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 0x55e68216ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febee59c640 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 0x55e68215ed60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7febe40c9420 tx=0x7febe4103640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4916e08bd586e4b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.217+0000 7febd2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febd2ff5640 1 -- 172.21.15.53:0/3363286755 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4049070 con 0x55e681d86b60 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febd2ff5640 1 -- 172.21.15.53:0/3363286755 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7febe40cc410 con 0x55e681d86b60 2024-08-31T06:11:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febfb5a9740 1 -- 172.21.15.53:0/3363286755 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febe8015070 con 0x55e681d86b60 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febd2ff5640 1 -- 172.21.15.53:0/3363286755 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7febe40c8070 con 0x55e681d86b60 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febfb5a9740 10 client.27056 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febfb5a9740 1 -- 172.21.15.53:0/3363286755 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e681e21b90 con 0x55e681d86b60 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febd2ff5640 1 -- 172.21.15.53:0/3363286755 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febe8015070 con 0x55e681d86b60 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febd2ff5640 1 -- 172.21.15.53:0/3363286755 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7febe40d4f90 con 0x55e681d86b60 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febfb5a9740 10 client.27056 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febfb5a9740 10 client.27056 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febfb5a9740 20 client.27056 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febfb5a9740 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e681d661c0 0x55e682170a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febfb5a9740 4 client.27056 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.218+0000 7febfb5a9740 1 -- 172.21.15.53:0/3363286755 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6820c5280 con 0x55e681d661c0 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.219+0000 7febeed9d640 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e681d661c0 0x55e682170a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.219+0000 7febeed9d640 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e681d661c0 0x55e682170a30 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c55bb2c378ff11f1 server_cookie=5d4797169903d7ee in_seq=0 out_seq=0 2024-08-31T06:11:44.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.219+0000 7febd2ff5640 10 client.27056 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febd2ff5640 1 -- 172.21.15.53:0/3363286755 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6820c5280 con 0x55e681d661c0 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febd2ff5640 10 client.27056 handle_command_reply: tid=0 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febfb5a9740 1 client.27056 shutdown 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febfb5a9740 1 -- 172.21.15.53:0/3363286755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 msgr2=0x55e68215ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febfb5a9740 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 0x55e68215ed60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7febe40c9420 tx=0x7febe4103640 comp rx=0 tx=0).stop 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febfb5a9740 1 -- 172.21.15.53:0/3363286755 shutdown_connections 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febfb5a9740 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e681d661c0 0x55e682170a30 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febfb5a9740 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681da7840 0x55e68216ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febfb5a9740 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 0x55e68215ed60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febd2ff5640 0 client.27056 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febfb5a9740 1 --2- 172.21.15.53:0/3363286755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d7e980 0x55e68215e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.220+0000 7febfb5a9740 1 -- 172.21.15.53:0/3363286755 >> 172.21.15.53:0/3363286755 conn(0x55e681d9b990 msgr2=0x55e68214b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.221+0000 7febfb5a9740 1 -- 172.21.15.53:0/3363286755 shutdown_connections 2024-08-31T06:11:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.221+0000 7febfb5a9740 1 -- 172.21.15.53:0/3363286755 wait complete. 2024-08-31T06:11:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.221+0000 7febfb5a9740 20 client.27056 trim_cache size 0 max 16384 2024-08-31T06:11:44.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febfb5a9740 1 Processor -- start 2024-08-31T06:11:44.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febfb5a9740 1 -- start start 2024-08-31T06:11:44.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d7e980 0x55e68215ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 0x55e68215bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681da7840 0x55e682176210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febfb5a9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7febf01ad1f0 con 0x55e681d7e980 2024-08-31T06:11:44.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febfb5a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febf01aed30 con 0x55e681d86b60 2024-08-31T06:11:44.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febfb5a9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febf01ad8c0 con 0x55e681da7840 2024-08-31T06:11:44.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febeed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d7e980 0x55e68215ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febeed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d7e980 0x55e68215ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47558/0 (socket says 172.21.15.53:47558) 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febeed9d640 1 -- 172.21.15.53:0/217368738 learned_addr learned my addr 172.21.15.53:0/217368738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febee59c640 1 --2- 172.21.15.53:0/217368738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 0x55e68215bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febef59e640 1 --2- 172.21.15.53:0/217368738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681da7840 0x55e682176210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febee59c640 1 -- 172.21.15.53:0/217368738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681da7840 msgr2=0x55e682176210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febee59c640 1 --2- 172.21.15.53:0/217368738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681da7840 0x55e682176210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febee59c640 1 -- 172.21.15.53:0/217368738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d7e980 msgr2=0x55e68215ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febee59c640 1 --2- 172.21.15.53:0/217368738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d7e980 0x55e68215ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febee59c640 1 -- 172.21.15.53:0/217368738 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e68215a0b0 con 0x55e681d86b60 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febeed9d640 1 --2- 172.21.15.53:0/217368738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d7e980 0x55e68215ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.239+0000 7febef59e640 1 --2- 172.21.15.53:0/217368738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681da7840 0x55e682176210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.240+0000 7febee59c640 1 --2- 172.21.15.53:0/217368738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 0x55e68215bf50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7febe40c8230 tx=0x7febe4105dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c50606150902c91 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:44.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.240+0000 7febd4ff9640 1 -- 172.21.15.53:0/217368738 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4049070 con 0x55e681d86b60 2024-08-31T06:11:44.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.240+0000 7febd4ff9640 1 -- 172.21.15.53:0/217368738 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febe40d5420 con 0x55e681d86b60 2024-08-31T06:11:44.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.240+0000 7febd4ff9640 1 -- 172.21.15.53:0/217368738 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe40044e0 con 0x55e681d86b60 2024-08-31T06:11:44.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.241+0000 7febfb5a9740 1 -- 172.21.15.53:0/217368738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 msgr2=0x55e68215bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:44.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.241+0000 7febfb5a9740 1 --2- 172.21.15.53:0/217368738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 0x55e68215bf50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7febe40c8230 tx=0x7febe4105dc0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.241+0000 7febfb5a9740 1 -- 172.21.15.53:0/217368738 shutdown_connections 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.241+0000 7febfb5a9740 1 --2- 172.21.15.53:0/217368738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681da7840 0x55e682176210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.241+0000 7febfb5a9740 1 --2- 172.21.15.53:0/217368738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681d86b60 0x55e68215bf50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.241+0000 7febfb5a9740 1 --2- 172.21.15.53:0/217368738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d7e980 0x55e68215ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.241+0000 7febfb5a9740 1 -- 172.21.15.53:0/217368738 >> 172.21.15.53:0/217368738 conn(0x55e681d9b990 msgr2=0x55e68214c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.241+0000 7febfb5a9740 1 -- 172.21.15.53:0/217368738 shutdown_connections 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.241+0000 7febfb5a9740 1 -- 172.21.15.53:0/217368738 wait complete. 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.241+0000 7febfb5a9740 1 -- start start 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febfb5a9740 1 Processor -- start 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d7e980 0x55e682166f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d86b60 0x55e682161a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febfb5a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681da7840 0x55e682161f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febfb5a9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7febf01ae660 con 0x55e681d86b60 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febfb5a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febf01adf90 con 0x55e681da7840 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febfb5a9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febf01ab210 con 0x55e681d7e980 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febfb5a9740 10 client.0 _ll_register_callbacks cb 0x7febe4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d86b60 0x55e682161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d86b60 0x55e682161a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47572/0 (socket says 172.21.15.53:47572) 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febee59c640 1 -- 172.21.15.53:0/1097728922 learned_addr learned my addr 172.21.15.53:0/1097728922 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febef59e640 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681da7840 0x55e682161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febeed9d640 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d7e980 0x55e682166f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febef59e640 1 -- 172.21.15.53:0/1097728922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d7e980 msgr2=0x55e682166f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febef59e640 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d7e980 0x55e682166f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febef59e640 1 -- 172.21.15.53:0/1097728922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d86b60 msgr2=0x55e682161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febef59e640 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d86b60 0x55e682161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febef59e640 1 -- 172.21.15.53:0/1097728922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e682082d90 con 0x55e681da7840 2024-08-31T06:11:44.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.242+0000 7febee59c640 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d86b60 0x55e682161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.243+0000 7febef59e640 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681da7840 0x55e682161f90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7febe8006010 tx=0x7febe80049d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9788fc2ee6db69 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.243+0000 7febd2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.243+0000 7febd2ff5640 1 -- 172.21.15.53:0/1097728922 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8009c50 con 0x55e681da7840 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.243+0000 7febfb5a9740 1 -- 172.21.15.53:0/1097728922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febe40d5420 con 0x55e681da7840 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.243+0000 7febd2ff5640 1 -- 172.21.15.53:0/1097728922 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7febe801a470 con 0x55e681da7840 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.243+0000 7febd2ff5640 1 -- 172.21.15.53:0/1097728922 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7febe8032050 con 0x55e681da7840 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.243+0000 7febfb5a9740 10 client.27062 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.243+0000 7febfb5a9740 1 -- 172.21.15.53:0/1097728922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e6821dbe70 con 0x55e681da7840 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.243+0000 7febd2ff5640 1 -- 172.21.15.53:0/1097728922 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febe40d5420 con 0x55e681da7840 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.244+0000 7febd2ff5640 1 -- 172.21.15.53:0/1097728922 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7febe8005270 con 0x55e681da7840 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.244+0000 7febfb5a9740 10 client.27062 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.244+0000 7febfb5a9740 10 client.27062 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:11:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.244+0000 7febfb5a9740 20 client.27062 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.244+0000 7febfb5a9740 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e681d3b570 0x55e6821de320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.244+0000 7febfb5a9740 4 client.27062 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}] 2024-08-31T06:11:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.244+0000 7febfb5a9740 1 -- 172.21.15.53:0/1097728922 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}) -- 0x55e6820c0d20 con 0x55e681d3b570 2024-08-31T06:11:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.244+0000 7febeed9d640 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e681d3b570 0x55e6821de320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.244+0000 7febd2ff5640 10 client.27062 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.244+0000 7febeed9d640 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e681d3b570 0x55e6821de320 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfcc0a5a7a4ab34c server_cookie=4cd8dd182fd4865c in_seq=0 out_seq=0 2024-08-31T06:11:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febd2ff5640 1 -- 172.21.15.53:0/1097728922 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e6820c0d20 con 0x55e681d3b570 2024-08-31T06:11:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febd2ff5640 10 client.27062 handle_command_reply: tid=0 2024-08-31T06:11:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 1 client.27062 shutdown 2024-08-31T06:11:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 1 -- 172.21.15.53:0/1097728922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681da7840 msgr2=0x55e682161f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681da7840 0x55e682161f90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7febe8006010 tx=0x7febe80049d0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 1 -- 172.21.15.53:0/1097728922 shutdown_connections 2024-08-31T06:11:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e681d3b570 0x55e6821de320 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e681da7840 0x55e682161f90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febd2ff5640 0 client.27062 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e681d86b60 0x55e682161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 1 --2- 172.21.15.53:0/1097728922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e681d7e980 0x55e682166f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 1 -- 172.21.15.53:0/1097728922 >> 172.21.15.53:0/1097728922 conn(0x55e681d9b990 msgr2=0x55e68215cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:44.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 1 -- 172.21.15.53:0/1097728922 shutdown_connections 2024-08-31T06:11:44.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 1 -- 172.21.15.53:0/1097728922 wait complete. 2024-08-31T06:11:44.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.324+0000 7febfb5a9740 20 client.27062 trim_cache size 0 max 16384 2024-08-31T06:11:44.330 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:11:44.330 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 36, 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 22, 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "dbdd68df": { 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 22, 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 148.0, 2024-08-31T06:11:44.331 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:11:44.332 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:11:44.332 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:11:44.332 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:11:44.332 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:11:44.332 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:11:44.332 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:11:44.332 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:11:44.332 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:11:44.332 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:11:44.332 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:11:44.332 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:11:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 -- 172.21.15.53:0/1624789099 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febd80b4ca0 msgr2=0x7febd80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febd80b4ca0 0x7febd80b71b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7febe0004650 tx=0x7febe000b390 comp rx=0 tx=0).stop 2024-08-31T06:11:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 -- 172.21.15.53:0/1624789099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf0108180 msgr2=0x7febf019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf0108180 0x7febf019a710 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7febe4005940 tx=0x7febe40040e0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 -- 172.21.15.53:0/1624789099 shutdown_connections 2024-08-31T06:11:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febd80b4ca0 0x7febd80b71b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febf0108ad0 0x7febf019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf0108180 0x7febf019a710 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 --2- 172.21.15.53:0/1624789099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febf0102890 0x7febf019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 -- 172.21.15.53:0/1624789099 >> 172.21.15.53:0/1624789099 conn(0x7febf00795d0 msgr2=0x7febf006ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:44.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 -- 172.21.15.53:0/1624789099 shutdown_connections 2024-08-31T06:11:44.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:11:44.325+0000 7febf5034640 1 -- 172.21.15.53:0/1624789099 wait complete. 2024-08-31T06:11:44.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:44 smithi053 ceph-mon[18924]: pgmap v528: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.3 MiB/s wr, 134 op/s 2024-08-31T06:11:44.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:44 smithi130 ceph-mon[22266]: pgmap v528: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.3 MiB/s wr, 134 op/s 2024-08-31T06:11:44.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:44 smithi153 ceph-mon[22320]: pgmap v528: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.3 MiB/s wr, 134 op/s 2024-08-31T06:11:44.980 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.91 MB/sec execute 214 sec latency 700.245 ms 2024-08-31T06:11:45.064 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'dbdd68df', quiesce took 5.9 seconds. Will release after: 22.1 2024-08-31T06:11:45.980 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.90 MB/sec execute 215 sec latency 1700.289 ms 2024-08-31T06:11:46.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: pgmap v529: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.3 MiB/s wr, 142 op/s 2024-08-31T06:11:46.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:11:46.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.478 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:11:46.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:11:46.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:11:46.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: pgmap v529: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.3 MiB/s wr, 142 op/s 2024-08-31T06:11:46.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:11:46.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:11:46.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:11:46.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:11:46.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: pgmap v529: 97 pgs: 97 active+clean; 74 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.3 MiB/s wr, 142 op/s 2024-08-31T06:11:46.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:11:46.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:11:46.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:11:46.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:11:46.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:11:46.980 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.89 MB/sec execute 216 sec latency 2700.385 ms 2024-08-31T06:11:47.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.132+0000 7f8cdf92b640 1 -- 172.21.15.53:0/1504463855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8102780 msgr2=0x7f8cd8102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:47.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.132+0000 7f8cdf92b640 1 --2- 172.21.15.53:0/1504463855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8102780 0x7f8cd8102b90 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009ca0 tx=0x7f8cd402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.132+0000 7f8cdf92b640 1 -- 172.21.15.53:0/1504463855 shutdown_connections 2024-08-31T06:11:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.132+0000 7f8cdf92b640 1 --2- 172.21.15.53:0/1504463855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd8108a00 0x7f8cd810f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.132+0000 7f8cdf92b640 1 --2- 172.21.15.53:0/1504463855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd81080b0 0x7f8cd81084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.132+0000 7f8cdf92b640 1 --2- 172.21.15.53:0/1504463855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8102780 0x7f8cd8102b90 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.132+0000 7f8cdf92b640 1 -- 172.21.15.53:0/1504463855 >> 172.21.15.53:0/1504463855 conn(0x7f8cd80fe160 msgr2=0x7f8cd81005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.132+0000 7f8cdf92b640 1 -- 172.21.15.53:0/1504463855 shutdown_connections 2024-08-31T06:11:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.132+0000 7f8cdf92b640 1 -- 172.21.15.53:0/1504463855 wait complete. 2024-08-31T06:11:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cdf92b640 1 Processor -- start 2024-08-31T06:11:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cdf92b640 1 -- start start 2024-08-31T06:11:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cdf92b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8102780 0x7f8cd819a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cdf92b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd81080b0 0x7f8cd819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cdf92b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8108a00 0x7f8cd819f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cdf92b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd81136c0 con 0x7f8cd8108a00 2024-08-31T06:11:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cdf92b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd8113540 con 0x7f8cd81080b0 2024-08-31T06:11:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cdf92b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd8113840 con 0x7f8cd8102780 2024-08-31T06:11:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cddec8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8108a00 0x7f8cd819f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cddec8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8108a00 0x7f8cd819f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47590/0 (socket says 172.21.15.53:47590) 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cddec8640 1 -- 172.21.15.53:0/4212014437 learned_addr learned my addr 172.21.15.53:0/4212014437 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd81080b0 0x7f8cd819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.133+0000 7f8cdd6c7640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8102780 0x7f8cd819a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cddec8640 1 -- 172.21.15.53:0/4212014437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8102780 msgr2=0x7f8cd819a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cddec8640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8102780 0x7f8cd819a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cddec8640 1 -- 172.21.15.53:0/4212014437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd81080b0 msgr2=0x7f8cd819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cddec8640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd81080b0 0x7f8cd819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cddec8640 1 -- 172.21.15.53:0/4212014437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd81a0030 con 0x7f8cd8108a00 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd81080b0 0x7f8cd819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cddec8640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8108a00 0x7f8cd819f930 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000e970 tx=0x7f8cd000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cce7fc640 1 -- 172.21.15.53:0/4212014437 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000ccc0 con 0x7f8cd8108a00 2024-08-31T06:11:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cdf92b640 1 -- 172.21.15.53:0/4212014437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd81a0320 con 0x7f8cd8108a00 2024-08-31T06:11:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cce7fc640 1 -- 172.21.15.53:0/4212014437 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cd000ce60 con 0x7f8cd8108a00 2024-08-31T06:11:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cce7fc640 1 -- 172.21.15.53:0/4212014437 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0010430 con 0x7f8cd8108a00 2024-08-31T06:11:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.134+0000 7f8cdf92b640 1 -- 172.21.15.53:0/4212014437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd81a6ab0 con 0x7f8cd8108a00 2024-08-31T06:11:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.137+0000 7f8ce6899740 1 Processor -- start 2024-08-31T06:11:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.137+0000 7f8cce7fc640 1 -- 172.21.15.53:0/4212014437 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8cd0004f10 con 0x7f8cd8108a00 2024-08-31T06:11:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.137+0000 7f8ce6899740 1 -- start start 2024-08-31T06:11:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.137+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x560113990ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x560113991000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x560113991540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8ce6899740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560113906000 con 0x5601135ed1b0 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8ce6899740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5601138f5590 con 0x5601135cc4d0 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8ce6899740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5601138f9540 con 0x5601135c42f0 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cdcec6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x560113990ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cdcec6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x560113990ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47596/0 (socket says 172.21.15.53:47596) 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cdcec6640 1 -- 172.21.15.53:0/1722393876 learned_addr learned my addr 172.21.15.53:0/1722393876 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cdd6c7640 1 --2- 172.21.15.53:0/1722393876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x560113991000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/1722393876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x560113991540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cce7fc640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4ca0 0x7f8cc40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cdcec6640 1 -- 172.21.15.53:0/1722393876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 msgr2=0x560113991000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/1722393876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x560113991000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cdcec6640 1 -- 172.21.15.53:0/1722393876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 msgr2=0x560113991540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/1722393876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x560113991540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cdcec6640 1 -- 172.21.15.53:0/1722393876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560113658790 con 0x5601135ed1b0 2024-08-31T06:11:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cddec8640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4ca0 0x7f8cc40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/1722393876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x560113990ac0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80135f0 tx=0x7f8cc800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf586add2e41600e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.138+0000 7f8cce7fc640 1 -- 172.21.15.53:0/4212014437 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f8cd00e5a10 con 0x7f8cd8108a00 2024-08-31T06:11:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.139+0000 7f8cc37fe640 1 -- 172.21.15.53:0/1722393876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8019070 con 0x5601135ed1b0 2024-08-31T06:11:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.139+0000 7f8cc37fe640 1 -- 172.21.15.53:0/1722393876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cc8004220 con 0x5601135ed1b0 2024-08-31T06:11:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.139+0000 7f8cc37fe640 1 -- 172.21.15.53:0/1722393876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8011720 con 0x5601135ed1b0 2024-08-31T06:11:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8ce6899740 1 -- 172.21.15.53:0/1722393876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 msgr2=0x560113990ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8cddec8640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4ca0 0x7f8cc40b71b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00abde0 tx=0x7f8cd00782e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8ce6899740 1 --2- 172.21.15.53:0/1722393876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x560113990ac0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80135f0 tx=0x7f8cc800b6d0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8ce6899740 1 -- 172.21.15.53:0/1722393876 shutdown_connections 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8ce6899740 1 --2- 172.21.15.53:0/1722393876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x560113991540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8ce6899740 1 --2- 172.21.15.53:0/1722393876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x560113991000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8ce6899740 1 --2- 172.21.15.53:0/1722393876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x560113990ac0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8ce6899740 1 -- 172.21.15.53:0/1722393876 >> 172.21.15.53:0/1722393876 conn(0x5601135e1300 msgr2=0x56011398e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8ce6899740 1 -- 172.21.15.53:0/1722393876 shutdown_connections 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8ce6899740 1 -- 172.21.15.53:0/1722393876 wait complete. 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8ce6899740 1 -- start start 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.140+0000 7f8ce6899740 1 Processor -- start 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x5601139a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x5601139a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x5601139ac950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8ce6899740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56011382eab0 con 0x5601135ed1b0 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8ce6899740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56011387c680 con 0x5601135cc4d0 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8ce6899740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5601139a3620 con 0x5601135c42f0 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8ce6899740 10 client.0 _ll_register_callbacks cb 0x560113604a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8cdcec6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x5601139ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8cdd6c7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x5601139a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8cdcec6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x5601139ac950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47600/0 (socket says 172.21.15.53:47600) 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8cdcec6640 1 -- 172.21.15.53:0/2288527984 learned_addr learned my addr 172.21.15.53:0/2288527984 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x5601139a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8cdd6c7640 1 -- 172.21.15.53:0/2288527984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 msgr2=0x5601139a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8cdd6c7640 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x5601139a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8cdd6c7640 1 -- 172.21.15.53:0/2288527984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 msgr2=0x5601139ac950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8cdd6c7640 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x5601139ac950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8cdd6c7640 1 -- 172.21.15.53:0/2288527984 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601136d1620 con 0x5601135cc4d0 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.141+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x5601139ac950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8cdd6c7640 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x5601139a0ff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4006010 tx=0x7f8cd4031980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2332954b8f0571ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8cc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/2288527984 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4003970 con 0x5601135cc4d0 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/2288527984 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f8cd4003b10 con 0x5601135cc4d0 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8ce6899740 1 -- 172.21.15.53:0/2288527984 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cc8004220 con 0x5601135cc4d0 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/2288527984 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8cd4003d10 con 0x5601135cc4d0 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8ce6899740 10 client.27074 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8ce6899740 1 -- 172.21.15.53:0/2288527984 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5601139af6a0 con 0x5601135cc4d0 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/2288527984 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cc8004220 con 0x5601135cc4d0 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/2288527984 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f8cd40305c0 con 0x5601135cc4d0 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8ce6899740 10 client.27074 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8ce6899740 10 client.27074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8ce6899740 20 client.27074 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8ce6899740 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5601135abd80 0x5601139b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8ce6899740 4 client.27074 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.142+0000 7f8ce6899740 1 -- 172.21.15.53:0/2288527984 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560113907f50 con 0x5601135abd80 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.143+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5601135abd80 0x5601139b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.143+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5601135abd80 0x5601139b2b80 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeca667618f3c72f server_cookie=af18ebd55de52d03 in_seq=0 out_seq=0 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.143+0000 7f8cc0ff9640 10 client.27074 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/2288527984 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560113907f50 con 0x5601135abd80 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8cc0ff9640 10 client.27074 handle_command_reply: tid=0 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 1 client.27074 shutdown 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 1 -- 172.21.15.53:0/2288527984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 msgr2=0x5601139a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x5601139a0ff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4006010 tx=0x7f8cd4031980 comp rx=0 tx=0).stop 2024-08-31T06:11:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 1 -- 172.21.15.53:0/2288527984 shutdown_connections 2024-08-31T06:11:47.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5601135abd80 0x5601139b2b80 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135ed1b0 0x5601139ac950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x5601139a0ff0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8cc0ff9640 0 client.27074 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:47.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 1 --2- 172.21.15.53:0/2288527984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x5601139a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 1 -- 172.21.15.53:0/2288527984 >> 172.21.15.53:0/2288527984 conn(0x5601135e1300 msgr2=0x56011398cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:47.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 1 -- 172.21.15.53:0/2288527984 shutdown_connections 2024-08-31T06:11:47.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 1 -- 172.21.15.53:0/2288527984 wait complete. 2024-08-31T06:11:47.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.144+0000 7f8ce6899740 20 client.27074 trim_cache size 0 max 16384 2024-08-31T06:11:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.159+0000 7f8ce6899740 1 Processor -- start 2024-08-31T06:11:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.159+0000 7f8ce6899740 1 -- start start 2024-08-31T06:11:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.159+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135c42f0 0x56011399f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.159+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x56011399f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.159+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135ed1b0 0x56011399fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.159+0000 7f8ce6899740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd81ad270 con 0x5601135c42f0 2024-08-31T06:11:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8ce6899740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd81aedb0 con 0x5601135cc4d0 2024-08-31T06:11:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8ce6899740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd81ad940 con 0x5601135ed1b0 2024-08-31T06:11:47.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cdcec6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135c42f0 0x56011399f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cdcec6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135c42f0 0x56011399f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47610/0 (socket says 172.21.15.53:47610) 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cdcec6640 1 -- 172.21.15.53:0/935989089 learned_addr learned my addr 172.21.15.53:0/935989089 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cdd6c7640 1 --2- 172.21.15.53:0/935989089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x56011399f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cdcec6640 1 -- 172.21.15.53:0/935989089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135ed1b0 msgr2=0x56011399fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/935989089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135ed1b0 0x56011399fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cdcec6640 1 -- 172.21.15.53:0/935989089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 msgr2=0x56011399f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/935989089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x56011399f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cdcec6640 1 -- 172.21.15.53:0/935989089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560113993920 con 0x5601135c42f0 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/935989089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135c42f0 0x56011399f100 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8005d00 tx=0x7f8cc800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86934b85c63b7aac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cc2ffd640 1 -- 172.21.15.53:0/935989089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8019070 con 0x5601135c42f0 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cc2ffd640 1 -- 172.21.15.53:0/935989089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cc800b630 con 0x5601135c42f0 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.160+0000 7f8cc2ffd640 1 -- 172.21.15.53:0/935989089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8004120 con 0x5601135c42f0 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.161+0000 7f8ce6899740 1 -- 172.21.15.53:0/935989089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135c42f0 msgr2=0x56011399f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:47.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.161+0000 7f8ce6899740 1 --2- 172.21.15.53:0/935989089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135c42f0 0x56011399f100 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8005d00 tx=0x7f8cc800bf90 comp rx=0 tx=0).stop 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.161+0000 7f8ce6899740 1 -- 172.21.15.53:0/935989089 shutdown_connections 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.161+0000 7f8ce6899740 1 --2- 172.21.15.53:0/935989089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135ed1b0 0x56011399fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.161+0000 7f8ce6899740 1 --2- 172.21.15.53:0/935989089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135cc4d0 0x56011399f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.161+0000 7f8ce6899740 1 --2- 172.21.15.53:0/935989089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135c42f0 0x56011399f100 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.161+0000 7f8ce6899740 1 -- 172.21.15.53:0/935989089 >> 172.21.15.53:0/935989089 conn(0x5601135e1300 msgr2=0x56011399b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.161+0000 7f8ce6899740 1 -- 172.21.15.53:0/935989089 shutdown_connections 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.161+0000 7f8ce6899740 1 -- 172.21.15.53:0/935989089 wait complete. 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8ce6899740 1 -- start start 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8ce6899740 1 Processor -- start 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x5601139a9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135cc4d0 0x56011399d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8ce6899740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135ed1b0 0x56011399e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8ce6899740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd81ae6e0 con 0x5601135cc4d0 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8ce6899740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd81ae010 con 0x5601135ed1b0 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8ce6899740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd81ab270 con 0x5601135c42f0 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8ce6899740 10 client.0 _ll_register_callbacks cb 0x7f8cd4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8cdd6c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135cc4d0 0x56011399d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8cdd6c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135cc4d0 0x56011399d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47618/0 (socket says 172.21.15.53:47618) 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8cdd6c7640 1 -- 172.21.15.53:0/3454930566 learned_addr learned my addr 172.21.15.53:0/3454930566 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.162+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135ed1b0 0x56011399e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x5601139a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cdd6c7640 1 -- 172.21.15.53:0/3454930566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 msgr2=0x5601139a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cdd6c7640 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x5601139a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cdd6c7640 1 -- 172.21.15.53:0/3454930566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135ed1b0 msgr2=0x56011399e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cdd6c7640 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135ed1b0 0x56011399e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cdd6c7640 1 -- 172.21.15.53:0/3454930566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560113991900 con 0x5601135cc4d0 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x5601139a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cdd6c7640 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135cc4d0 0x56011399d960 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4030b70 tx=0x7f8cd40307f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3827bbf390aaabc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/3454930566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4004b40 con 0x5601135cc4d0 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/3454930566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7f8cd4004ce0 con 0x5601135cc4d0 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8ce6899740 1 -- 172.21.15.53:0/3454930566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cc800b630 con 0x5601135cc4d0 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/3454930566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8cd405e050 con 0x5601135cc4d0 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8ce6899740 10 client.17751 fetch_fsmap learned FSMap version 36 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8ce6899740 1 -- 172.21.15.53:0/3454930566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x560113a1d530 con 0x5601135cc4d0 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.163+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/3454930566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cc800b630 con 0x5601135cc4d0 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.164+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/3454930566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f8cd4057460 con 0x5601135cc4d0 2024-08-31T06:11:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.164+0000 7f8ce6899740 10 client.17751 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:11:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.164+0000 7f8ce6899740 10 client.17751 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:11:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.164+0000 7f8ce6899740 20 client.17751 populate_metadata read hostname 'smithi053' 2024-08-31T06:11:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.164+0000 7f8ce6899740 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5601135811c0 0x560113a1fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:11:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.164+0000 7f8ce6899740 4 client.17751 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:11:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.164+0000 7f8ce6899740 1 -- 172.21.15.53:0/3454930566 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5601139039f0 con 0x5601135811c0 2024-08-31T06:11:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.164+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5601135811c0 0x560113a1fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:11:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.164+0000 7f8cc0ff9640 10 client.17751 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:47.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.164+0000 7f8cdcec6640 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5601135811c0 0x560113a1fc40 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e39a8161daf2f32 server_cookie=575e80529cfcaf90 in_seq=0 out_seq=0 2024-08-31T06:11:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8cc0ff9640 1 -- 172.21.15.53:0/3454930566 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5601139039f0 con 0x5601135811c0 2024-08-31T06:11:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8cc0ff9640 10 client.17751 handle_command_reply: tid=0 2024-08-31T06:11:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8ce6899740 1 client.17751 shutdown 2024-08-31T06:11:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8ce6899740 1 -- 172.21.15.53:0/3454930566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135cc4d0 msgr2=0x56011399d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8ce6899740 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135cc4d0 0x56011399d960 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4030b70 tx=0x7f8cd40307f0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8ce6899740 1 -- 172.21.15.53:0/3454930566 shutdown_connections 2024-08-31T06:11:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8ce6899740 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5601135811c0 0x560113a1fc40 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8ce6899740 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5601135ed1b0 0x56011399e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8ce6899740 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601135cc4d0 0x56011399d960 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8ce6899740 1 --2- 172.21.15.53:0/3454930566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5601135c42f0 0x5601139a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8ce6899740 1 -- 172.21.15.53:0/3454930566 >> 172.21.15.53:0/3454930566 conn(0x5601135e1300 msgr2=0x56011399b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8cc0ff9640 0 client.17751 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:11:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8ce6899740 1 -- 172.21.15.53:0/3454930566 shutdown_connections 2024-08-31T06:11:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.185+0000 7f8ce6899740 1 -- 172.21.15.53:0/3454930566 wait complete. 2024-08-31T06:11:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8ce6899740 20 client.17751 trim_cache size 0 max 16384 2024-08-31T06:11:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:11:47.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:11:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:11:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:11:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 -- 172.21.15.53:0/4212014437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4ca0 msgr2=0x7f8cc40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4ca0 0x7f8cc40b71b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00abde0 tx=0x7f8cd00782e0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 -- 172.21.15.53:0/4212014437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8108a00 msgr2=0x7f8cd819f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:11:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8108a00 0x7f8cd819f930 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000e970 tx=0x7f8cd000ed70 comp rx=0 tx=0).stop 2024-08-31T06:11:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 -- 172.21.15.53:0/4212014437 shutdown_connections 2024-08-31T06:11:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4ca0 0x7f8cc40b71b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8108a00 0x7f8cd819f930 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd81080b0 0x7f8cd819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 --2- 172.21.15.53:0/4212014437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8102780 0x7f8cd819a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:11:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 -- 172.21.15.53:0/4212014437 >> 172.21.15.53:0/4212014437 conn(0x7f8cd80fe160 msgr2=0x7f8cd8106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:11:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 -- 172.21.15.53:0/4212014437 shutdown_connections 2024-08-31T06:11:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:11:47.186+0000 7f8cdf92b640 1 -- 172.21.15.53:0/4212014437 wait complete. 2024-08-31T06:11:47.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:47 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-08-31T06:11:47.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:47 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi053 to 177.0M 2024-08-31T06:11:47.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:47 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-31T06:11:47.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:47 smithi053 ceph-mon[18924]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-08-31T06:11:47.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:47 smithi053 ceph-mon[18924]: Unable to set osd_memory_target on smithi053 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T06:11:47.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:47 smithi053 ceph-mon[18924]: Unable to set osd_memory_target on smithi130 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-08-31T06:11:47.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:47 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-08-31T06:11:47.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:47 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi053 to 177.0M 2024-08-31T06:11:47.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:47 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-31T06:11:47.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:47 smithi130 ceph-mon[22266]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-08-31T06:11:47.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:47 smithi130 ceph-mon[22266]: Unable to set osd_memory_target on smithi053 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T06:11:47.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:47 smithi130 ceph-mon[22266]: Unable to set osd_memory_target on smithi130 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-08-31T06:11:47.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:47 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-08-31T06:11:47.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:47 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi053 to 177.0M 2024-08-31T06:11:47.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:47 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-31T06:11:47.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:47 smithi153 ceph-mon[22320]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-08-31T06:11:47.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:47 smithi153 ceph-mon[22320]: Unable to set osd_memory_target on smithi053 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T06:11:47.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:47 smithi153 ceph-mon[22320]: Unable to set osd_memory_target on smithi130 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-08-31T06:11:47.980 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.88 MB/sec execute 217 sec latency 3700.479 ms 2024-08-31T06:11:48.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:48 smithi053 ceph-mon[18924]: pgmap v530: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 1.7 MiB/s wr, 164 op/s 2024-08-31T06:11:48.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:48 smithi130 ceph-mon[22266]: pgmap v530: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 1.7 MiB/s wr, 164 op/s 2024-08-31T06:11:48.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:48 smithi153 ceph-mon[22320]: pgmap v530: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 1.7 MiB/s wr, 164 op/s 2024-08-31T06:11:48.980 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.87 MB/sec execute 218 sec latency 4700.598 ms 2024-08-31T06:11:49.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.87 MB/sec execute 219 sec latency 5700.707 ms 2024-08-31T06:11:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:50 smithi053 ceph-mon[18924]: pgmap v531: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 1.3 MiB/s wr, 125 op/s 2024-08-31T06:11:50.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:50 smithi130 ceph-mon[22266]: pgmap v531: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 1.3 MiB/s wr, 125 op/s 2024-08-31T06:11:50.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:50 smithi153 ceph-mon[22320]: pgmap v531: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 1.3 MiB/s wr, 125 op/s 2024-08-31T06:11:50.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.86 MB/sec execute 220 sec latency 6700.831 ms 2024-08-31T06:11:51.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.85 MB/sec execute 221 sec latency 7700.915 ms 2024-08-31T06:11:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:52 smithi053 ceph-mon[18924]: pgmap v532: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-08-31T06:11:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:52 smithi130 ceph-mon[22266]: pgmap v532: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-08-31T06:11:52.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:52 smithi153 ceph-mon[22320]: pgmap v532: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-08-31T06:11:52.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.84 MB/sec execute 222 sec latency 8700.963 ms 2024-08-31T06:11:53.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.83 MB/sec execute 223 sec latency 9700.999 ms 2024-08-31T06:11:54.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:54 smithi053 ceph-mon[18924]: pgmap v533: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 708 KiB/s wr, 69 op/s 2024-08-31T06:11:54.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:54 smithi130 ceph-mon[22266]: pgmap v533: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 708 KiB/s wr, 69 op/s 2024-08-31T06:11:54.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:54 smithi153 ceph-mon[22320]: pgmap v533: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 708 KiB/s wr, 69 op/s 2024-08-31T06:11:54.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.82 MB/sec execute 224 sec latency 10701.100 ms 2024-08-31T06:11:55.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.82 MB/sec execute 225 sec latency 11701.216 ms 2024-08-31T06:11:56.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:56 smithi053 ceph-mon[18924]: pgmap v534: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 662 KiB/s wr, 65 op/s 2024-08-31T06:11:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:56 smithi130 ceph-mon[22266]: pgmap v534: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 662 KiB/s wr, 65 op/s 2024-08-31T06:11:56.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:56 smithi153 ceph-mon[22320]: pgmap v534: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 662 KiB/s wr, 65 op/s 2024-08-31T06:11:56.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.81 MB/sec execute 226 sec latency 12701.275 ms 2024-08-31T06:11:57.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.80 MB/sec execute 227 sec latency 13701.342 ms 2024-08-31T06:11:58.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:11:58 smithi053 ceph-mon[18924]: pgmap v535: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 582 KiB/s wr, 55 op/s 2024-08-31T06:11:58.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:11:58 smithi130 ceph-mon[22266]: pgmap v535: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 582 KiB/s wr, 55 op/s 2024-08-31T06:11:58.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:11:58 smithi153 ceph-mon[22320]: pgmap v535: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 582 KiB/s wr, 55 op/s 2024-08-31T06:11:58.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.79 MB/sec execute 228 sec latency 14701.475 ms 2024-08-31T06:11:59.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.78 MB/sec execute 229 sec latency 15701.521 ms 2024-08-31T06:12:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.307+0000 7fae48a0a640 1 -- 172.21.15.53:0/1887878734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae44105f70 msgr2=0x7fae44106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.307+0000 7fae48a0a640 1 --2- 172.21.15.53:0/1887878734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae44105f70 0x7fae44106380 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fae38009900 tx=0x7fae3802a410 comp rx=0 tx=0).stop 2024-08-31T06:12:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.307+0000 7fae48a0a640 1 -- 172.21.15.53:0/1887878734 shutdown_connections 2024-08-31T06:12:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.307+0000 7fae48a0a640 1 --2- 172.21.15.53:0/1887878734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae441068c0 0x7fae44110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.307+0000 7fae48a0a640 1 --2- 172.21.15.53:0/1887878734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae44105f70 0x7fae44106380 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.307+0000 7fae48a0a640 1 --2- 172.21.15.53:0/1887878734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae44101e00 0x7fae44102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.307+0000 7fae48a0a640 1 -- 172.21.15.53:0/1887878734 >> 172.21.15.53:0/1887878734 conn(0x7fae44079c30 msgr2=0x7fae4407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.307+0000 7fae48a0a640 1 -- 172.21.15.53:0/1887878734 shutdown_connections 2024-08-31T06:12:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.307+0000 7fae48a0a640 1 -- 172.21.15.53:0/1887878734 wait complete. 2024-08-31T06:12:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae48a0a640 1 Processor -- start 2024-08-31T06:12:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae48a0a640 1 -- start start 2024-08-31T06:12:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae48a0a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae44101e00 0x7fae4419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae48a0a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae44105f70 0x7fae4419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae48a0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae441068c0 0x7fae4419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae48a0a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fae44113640 con 0x7fae441068c0 2024-08-31T06:12:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae48a0a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae441134c0 con 0x7fae44105f70 2024-08-31T06:12:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae48a0a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae441137c0 con 0x7fae44101e00 2024-08-31T06:12:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae42d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae441068c0 0x7fae4419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae42d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae441068c0 0x7fae4419fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35870/0 (socket says 172.21.15.53:35870) 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae42d9d640 1 -- 172.21.15.53:0/1765068040 learned_addr learned my addr 172.21.15.53:0/1765068040 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae4259c640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae44101e00 0x7fae4419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae41d9b640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae44105f70 0x7fae4419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae42d9d640 1 -- 172.21.15.53:0/1765068040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae44101e00 msgr2=0x7fae4419a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae42d9d640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae44101e00 0x7fae4419a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae42d9d640 1 -- 172.21.15.53:0/1765068040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae44105f70 msgr2=0x7fae4419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae42d9d640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae44105f70 0x7fae4419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.308+0000 7fae42d9d640 1 -- 172.21.15.53:0/1765068040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae441a0150 con 0x7fae441068c0 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.309+0000 7fae42d9d640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae441068c0 0x7fae4419fa50 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00eaa0 tx=0x7fae3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.309+0000 7fae337fe640 1 -- 172.21.15.53:0/1765068040 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c00cdb0 con 0x7fae441068c0 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.309+0000 7fae337fe640 1 -- 172.21.15.53:0/1765068040 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae3c005020 con 0x7fae441068c0 2024-08-31T06:12:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.309+0000 7fae48a0a640 1 -- 172.21.15.53:0/1765068040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae441a0440 con 0x7fae441068c0 2024-08-31T06:12:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.309+0000 7fae337fe640 1 -- 172.21.15.53:0/1765068040 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0116d0 con 0x7fae441068c0 2024-08-31T06:12:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.309+0000 7fae48a0a640 1 -- 172.21.15.53:0/1765068040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae441a6bd0 con 0x7fae441068c0 2024-08-31T06:12:00.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.311+0000 7fae4fa4b740 1 Processor -- start 2024-08-31T06:12:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae337fe640 1 -- 172.21.15.53:0/1765068040 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fae3c0051d0 con 0x7fae441068c0 2024-08-31T06:12:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae4fa4b740 1 -- start start 2024-08-31T06:12:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd4241b0 0x5607cd7c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd3fb2f0 0x5607cd7c8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5607cd73d000 con 0x5607cd4034d0 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5607cd72c590 con 0x5607cd4241b0 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5607cd730540 con 0x5607cd3fb2f0 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae41d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae41d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35872/0 (socket says 172.21.15.53:35872) 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae41d9b640 1 -- 172.21.15.53:0/3725696882 learned_addr learned my addr 172.21.15.53:0/3725696882 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae4259c640 1 --2- 172.21.15.53:0/3725696882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd3fb2f0 0x5607cd7c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.312+0000 7fae41d9b640 1 --2- 172.21.15.53:0/3725696882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd4241b0 0x5607cd7c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae337fe640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae2c0b4ca0 0x7fae2c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae4259c640 1 -- 172.21.15.53:0/3725696882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd4241b0 msgr2=0x5607cd7c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae4259c640 1 --2- 172.21.15.53:0/3725696882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd4241b0 0x5607cd7c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae4259c640 1 -- 172.21.15.53:0/3725696882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 msgr2=0x5607cd7c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae4259c640 1 --2- 172.21.15.53:0/3725696882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae4259c640 1 -- 172.21.15.53:0/3725696882 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607cd48f790 con 0x5607cd3fb2f0 2024-08-31T06:12:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae41d9b640 1 --2- 172.21.15.53:0/3725696882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae42d9d640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae2c0b4ca0 0x7fae2c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae337fe640 1 -- 172.21.15.53:0/1765068040 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fae3c0e5600 con 0x7fae441068c0 2024-08-31T06:12:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae4259c640 1 --2- 172.21.15.53:0/3725696882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd3fb2f0 0x5607cd7c8000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fae3400bbf0 tx=0x7fae340107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b631be119ea6ada2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae30ff9640 1 -- 172.21.15.53:0/3725696882 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34004030 con 0x5607cd3fb2f0 2024-08-31T06:12:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae30ff9640 1 -- 172.21.15.53:0/3725696882 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae340035f0 con 0x5607cd3fb2f0 2024-08-31T06:12:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae30ff9640 1 -- 172.21.15.53:0/3725696882 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34011640 con 0x5607cd3fb2f0 2024-08-31T06:12:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.313+0000 7fae42d9d640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae2c0b4ca0 0x7fae2c0b71b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0a8ff0 tx=0x7fae3c0abb50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.314+0000 7fae4fa4b740 1 -- 172.21.15.53:0/3725696882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd3fb2f0 msgr2=0x5607cd7c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.314+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/3725696882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd3fb2f0 0x5607cd7c8000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fae3400bbf0 tx=0x7fae340107a0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.314+0000 7fae4fa4b740 1 -- 172.21.15.53:0/3725696882 shutdown_connections 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.314+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/3725696882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.314+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/3725696882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd3fb2f0 0x5607cd7c8000 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.314+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/3725696882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd4241b0 0x5607cd7c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.314+0000 7fae4fa4b740 1 -- 172.21.15.53:0/3725696882 >> 172.21.15.53:0/3725696882 conn(0x5607cd418300 msgr2=0x5607cd7c59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.314+0000 7fae4fa4b740 1 -- 172.21.15.53:0/3725696882 shutdown_connections 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.314+0000 7fae4fa4b740 1 -- 172.21.15.53:0/3725696882 wait complete. 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae4fa4b740 1 -- start start 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae4fa4b740 1 Processor -- start 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd3fb2f0 0x5607cd7d7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd4034d0 0x5607cd7d7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4241b0 0x5607cd7e3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5607cd665ab0 con 0x5607cd3fb2f0 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5607cd6b3680 con 0x5607cd4034d0 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5607cd7da620 con 0x5607cd4241b0 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae4fa4b740 10 client.0 _ll_register_callbacks cb 0x5607cd43ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae41d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd3fb2f0 0x5607cd7d7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae41d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd3fb2f0 0x5607cd7d7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35882/0 (socket says 172.21.15.53:35882) 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae41d9b640 1 -- 172.21.15.53:0/1364518496 learned_addr learned my addr 172.21.15.53:0/1364518496 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae4259c640 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd4034d0 0x5607cd7d7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.315+0000 7fae41d9b640 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4241b0 0x5607cd7e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae41d9b640 1 -- 172.21.15.53:0/1364518496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4241b0 msgr2=0x5607cd7e3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae41d9b640 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4241b0 0x5607cd7e3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae41d9b640 1 -- 172.21.15.53:0/1364518496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd4034d0 msgr2=0x5607cd7d7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae41d9b640 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd4034d0 0x5607cd7d7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae41d9b640 1 -- 172.21.15.53:0/1364518496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607cd508620 con 0x5607cd3fb2f0 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae41d9b640 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd3fb2f0 0x5607cd7d7a50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fae38005940 tx=0x7fae38041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddee501319e573a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae29ffb640 1 -- 172.21.15.53:0/1364518496 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38035050 con 0x5607cd3fb2f0 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae29ffb640 1 -- 172.21.15.53:0/1364518496 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fae380042d0 con 0x5607cd3fb2f0 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1364518496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae340035f0 con 0x5607cd3fb2f0 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae29ffb640 1 -- 172.21.15.53:0/1364518496 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fae380044d0 con 0x5607cd3fb2f0 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae4fa4b740 10 client.17763 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1364518496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5607cd7e6660 con 0x5607cd3fb2f0 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.316+0000 7fae29ffb640 1 -- 172.21.15.53:0/1364518496 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae340035f0 con 0x5607cd3fb2f0 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.317+0000 7fae29ffb640 1 -- 172.21.15.53:0/1364518496 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fae38055610 con 0x5607cd3fb2f0 2024-08-31T06:12:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.317+0000 7fae4fa4b740 10 client.17763 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.317+0000 7fae4fa4b740 10 client.17763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.317+0000 7fae4fa4b740 20 client.17763 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.317+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5607cd3e2d80 0x5607cd7e9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.317+0000 7fae4fa4b740 4 client.17763 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.317+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1364518496 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607cd73ef50 con 0x5607cd3e2d80 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.317+0000 7fae4259c640 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5607cd3e2d80 0x5607cd7e9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.317+0000 7fae29ffb640 10 client.17763 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.317+0000 7fae4259c640 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5607cd3e2d80 0x5607cd7e9ae0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6920731bfe4a4e2c server_cookie=3bbf4cf529aea00d in_seq=0 out_seq=0 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae29ffb640 1 -- 172.21.15.53:0/1364518496 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5607cd73ef50 con 0x5607cd3e2d80 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae29ffb640 10 client.17763 handle_command_reply: tid=0 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 1 client.17763 shutdown 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1364518496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd3fb2f0 msgr2=0x5607cd7d7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd3fb2f0 0x5607cd7d7a50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fae38005940 tx=0x7fae38041040 comp rx=0 tx=0).stop 2024-08-31T06:12:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1364518496 shutdown_connections 2024-08-31T06:12:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5607cd3e2d80 0x5607cd7e9ae0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4241b0 0x5607cd7e3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd4034d0 0x5607cd7d7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1364518496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd3fb2f0 0x5607cd7d7a50 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae29ffb640 0 client.17763 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1364518496 >> 172.21.15.53:0/1364518496 conn(0x5607cd418300 msgr2=0x5607cd7c3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1364518496 shutdown_connections 2024-08-31T06:12:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1364518496 wait complete. 2024-08-31T06:12:00.331 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.318+0000 7fae4fa4b740 20 client.17763 trim_cache size 0 max 16384 2024-08-31T06:12:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.333+0000 7fae4fa4b740 1 Processor -- start 2024-08-31T06:12:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.333+0000 7fae4fa4b740 1 -- start start 2024-08-31T06:12:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.333+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd3fb2f0 0x5607cd7d9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.333+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.333+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4241b0 0x5607cd7e3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.333+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fae441ad340 con 0x5607cd4034d0 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.333+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae441aee80 con 0x5607cd3fb2f0 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.333+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae441ada10 con 0x5607cd4241b0 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.333+0000 7fae4259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.333+0000 7fae4259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35896/0 (socket says 172.21.15.53:35896) 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.333+0000 7fae4259c640 1 -- 172.21.15.53:0/2542740262 learned_addr learned my addr 172.21.15.53:0/2542740262 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.334+0000 7fae41d9b640 1 --2- 172.21.15.53:0/2542740262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd3fb2f0 0x5607cd7d9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.334+0000 7fae41d9b640 1 --2- 172.21.15.53:0/2542740262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4241b0 0x5607cd7e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.334+0000 7fae4259c640 1 -- 172.21.15.53:0/2542740262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4241b0 msgr2=0x5607cd7e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.334+0000 7fae4259c640 1 --2- 172.21.15.53:0/2542740262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4241b0 0x5607cd7e3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.334+0000 7fae4259c640 1 -- 172.21.15.53:0/2542740262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd3fb2f0 msgr2=0x5607cd7d9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.334+0000 7fae4259c640 1 --2- 172.21.15.53:0/2542740262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd3fb2f0 0x5607cd7d9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.334+0000 7fae4259c640 1 -- 172.21.15.53:0/2542740262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607cd7d5d20 con 0x5607cd4034d0 2024-08-31T06:12:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.334+0000 7fae4259c640 1 --2- 172.21.15.53:0/2542740262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c9200 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fae3400bbc0 tx=0x7fae3400b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31da330d116b89e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.334+0000 7fae2bfff640 1 -- 172.21.15.53:0/2542740262 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34005240 con 0x5607cd4034d0 2024-08-31T06:12:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.334+0000 7fae2bfff640 1 -- 172.21.15.53:0/2542740262 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae340053e0 con 0x5607cd4034d0 2024-08-31T06:12:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.334+0000 7fae2bfff640 1 -- 172.21.15.53:0/2542740262 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34027860 con 0x5607cd4034d0 2024-08-31T06:12:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 -- 172.21.15.53:0/2542740262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 msgr2=0x5607cd7c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/2542740262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c9200 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fae3400bbc0 tx=0x7fae3400b570 comp rx=0 tx=0).stop 2024-08-31T06:12:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 -- 172.21.15.53:0/2542740262 shutdown_connections 2024-08-31T06:12:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/2542740262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4241b0 0x5607cd7e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/2542740262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4034d0 0x5607cd7c9200 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/2542740262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd3fb2f0 0x5607cd7d9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 -- 172.21.15.53:0/2542740262 >> 172.21.15.53:0/2542740262 conn(0x5607cd418300 msgr2=0x5607cd7c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 -- 172.21.15.53:0/2542740262 shutdown_connections 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 -- 172.21.15.53:0/2542740262 wait complete. 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 -- start start 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 Processor -- start 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd3fb2f0 0x5607cd7dfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4034d0 0x5607cd7db330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4241b0 0x5607cd7db870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fae441ae7b0 con 0x5607cd4241b0 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae441ae0e0 con 0x5607cd3fb2f0 2024-08-31T06:12:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae441ab340 con 0x5607cd4034d0 2024-08-31T06:12:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.335+0000 7fae4fa4b740 10 client.0 _ll_register_callbacks cb 0x7fae380315e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae41d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4241b0 0x5607cd7db870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae41d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4241b0 0x5607cd7db870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35898/0 (socket says 172.21.15.53:35898) 2024-08-31T06:12:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae41d9b640 1 -- 172.21.15.53:0/1417290328 learned_addr learned my addr 172.21.15.53:0/1417290328 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae41d9b640 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd3fb2f0 0x5607cd7dfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae4259c640 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4034d0 0x5607cd7db330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae41d9b640 1 -- 172.21.15.53:0/1417290328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4034d0 msgr2=0x5607cd7db330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae41d9b640 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4034d0 0x5607cd7db330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae41d9b640 1 -- 172.21.15.53:0/1417290328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd3fb2f0 msgr2=0x5607cd7dfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae41d9b640 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd3fb2f0 0x5607cd7dfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae41d9b640 1 -- 172.21.15.53:0/1417290328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607cd7dbde0 con 0x5607cd4241b0 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae4259c640 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4034d0 0x5607cd7db330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae41d9b640 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4241b0 0x5607cd7db870 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fae380316f0 tx=0x7fae380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e91cf8ef35d93f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae29ffb640 1 -- 172.21.15.53:0/1417290328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3805b040 con 0x5607cd4241b0 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae29ffb640 1 -- 172.21.15.53:0/1417290328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8557+0+0 (secure 0 0 0) 0x7fae38004410 con 0x5607cd4241b0 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1417290328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae340053e0 con 0x5607cd4241b0 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae29ffb640 1 -- 172.21.15.53:0/1417290328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fae38055450 con 0x5607cd4241b0 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae4fa4b740 10 client.17769 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.336+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1417290328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5607cd8541b0 con 0x5607cd4241b0 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.337+0000 7fae29ffb640 1 -- 172.21.15.53:0/1417290328 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae340053e0 con 0x5607cd4241b0 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.337+0000 7fae29ffb640 1 -- 172.21.15.53:0/1417290328 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fae380035f0 con 0x5607cd4241b0 2024-08-31T06:12:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.337+0000 7fae4fa4b740 10 client.17769 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.337+0000 7fae4fa4b740 10 client.17769 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.337+0000 7fae4fa4b740 20 client.17769 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.337+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5607cd3b81c0 0x5607cd856820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.337+0000 7fae4fa4b740 4 client.17769 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:12:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.337+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1417290328 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5607cd73a9f0 con 0x5607cd3b81c0 2024-08-31T06:12:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.337+0000 7fae4259c640 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5607cd3b81c0 0x5607cd856820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.338+0000 7fae29ffb640 10 client.17769 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.338+0000 7fae4259c640 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5607cd3b81c0 0x5607cd856820 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4fdc239cbc0ebac server_cookie=8e3890d58e797ba4 in_seq=0 out_seq=0 2024-08-31T06:12:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae29ffb640 1 -- 172.21.15.53:0/1417290328 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5607cd73a9f0 con 0x5607cd3b81c0 2024-08-31T06:12:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae29ffb640 10 client.17769 handle_command_reply: tid=0 2024-08-31T06:12:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 1 client.17769 shutdown 2024-08-31T06:12:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1417290328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4241b0 msgr2=0x5607cd7db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4241b0 0x5607cd7db870 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fae380316f0 tx=0x7fae380046c0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1417290328 shutdown_connections 2024-08-31T06:12:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5607cd3b81c0 0x5607cd856820 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607cd4241b0 0x5607cd7db870 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607cd4034d0 0x5607cd7db330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae29ffb640 0 client.17769 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 1 --2- 172.21.15.53:0/1417290328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5607cd3fb2f0 0x5607cd7dfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1417290328 >> 172.21.15.53:0/1417290328 conn(0x5607cd418300 msgr2=0x5607cd7c4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1417290328 shutdown_connections 2024-08-31T06:12:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 1 -- 172.21.15.53:0/1417290328 wait complete. 2024-08-31T06:12:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.357+0000 7fae4fa4b740 20 client.17769 trim_cache size 0 max 16384 2024-08-31T06:12:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:12:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:12:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:12:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:12:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 -- 172.21.15.53:0/1765068040 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae2c0b4ca0 msgr2=0x7fae2c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae2c0b4ca0 0x7fae2c0b71b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0a8ff0 tx=0x7fae3c0abb50 comp rx=0 tx=0).stop 2024-08-31T06:12:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 -- 172.21.15.53:0/1765068040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae441068c0 msgr2=0x7fae4419fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae441068c0 0x7fae4419fa50 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00eaa0 tx=0x7fae3c00ef60 comp rx=0 tx=0).stop 2024-08-31T06:12:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 -- 172.21.15.53:0/1765068040 shutdown_connections 2024-08-31T06:12:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae2c0b4ca0 0x7fae2c0b71b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae441068c0 0x7fae4419fa50 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae44105f70 0x7fae4419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 --2- 172.21.15.53:0/1765068040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae44101e00 0x7fae4419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 -- 172.21.15.53:0/1765068040 >> 172.21.15.53:0/1765068040 conn(0x7fae44079c30 msgr2=0x7fae441073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 -- 172.21.15.53:0/1765068040 shutdown_connections 2024-08-31T06:12:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:00.358+0000 7fae48a0a640 1 -- 172.21.15.53:0/1765068040 wait complete. 2024-08-31T06:12:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:00 smithi053 ceph-mon[18924]: pgmap v536: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 90 KiB/s wr, 18 op/s 2024-08-31T06:12:00.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:00 smithi130 ceph-mon[22266]: pgmap v536: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 90 KiB/s wr, 18 op/s 2024-08-31T06:12:00.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:00 smithi153 ceph-mon[22320]: pgmap v536: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 90 KiB/s wr, 18 op/s 2024-08-31T06:12:00.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.78 MB/sec execute 230 sec latency 16701.639 ms 2024-08-31T06:12:00.986 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:12:01.246 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:01.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.760+0000 7f937625a640 1 -- 172.21.15.53:0/314455367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9370103900 msgr2=0x7f9370103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:01.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.760+0000 7f937625a640 1 --2- 172.21.15.53:0/314455367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9370103900 0x7f9370103d10 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f9360009900 tx=0x7f936002a410 comp rx=0 tx=0).stop 2024-08-31T06:12:01.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.760+0000 7f937625a640 1 -- 172.21.15.53:0/314455367 shutdown_connections 2024-08-31T06:12:01.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.760+0000 7f937625a640 1 --2- 172.21.15.53:0/314455367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9370109b90 0x7f93701103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.760+0000 7f937625a640 1 --2- 172.21.15.53:0/314455367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9370109240 0x7f9370109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.760+0000 7f937625a640 1 --2- 172.21.15.53:0/314455367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9370103900 0x7f9370103d10 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.760+0000 7f937625a640 1 -- 172.21.15.53:0/314455367 >> 172.21.15.53:0/314455367 conn(0x7f937007b5f0 msgr2=0x7f937007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:01.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.760+0000 7f937625a640 1 -- 172.21.15.53:0/314455367 shutdown_connections 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.760+0000 7f937625a640 1 -- 172.21.15.53:0/314455367 wait complete. 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.761+0000 7f937625a640 1 Processor -- start 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.761+0000 7f937625a640 1 -- start start 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.761+0000 7f937625a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9370103900 0x7f93700754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.761+0000 7f937625a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9370109240 0x7f93700759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.761+0000 7f937625a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9370109b90 0x7f9370075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.761+0000 7f937625a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9370113700 con 0x7f9370109b90 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.761+0000 7f937625a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9370113580 con 0x7f9370103900 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.761+0000 7f937625a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9370113880 con 0x7f9370109240 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9370109b90 0x7f9370075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9370109b90 0x7f9370075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35910/0 (socket says 172.21.15.53:35910) 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936ffff640 1 -- 172.21.15.53:0/782458191 learned_addr learned my addr 172.21.15.53:0/782458191 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f9366ffd640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9370109240 0x7f93700759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936f7fe640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9370103900 0x7f93700754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936ffff640 1 -- 172.21.15.53:0/782458191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9370109240 msgr2=0x7f93700759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936ffff640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9370109240 0x7f93700759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936ffff640 1 -- 172.21.15.53:0/782458191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9370103900 msgr2=0x7f93700754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936ffff640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9370103900 0x7f93700754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936ffff640 1 -- 172.21.15.53:0/782458191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93701a8410 con 0x7f9370109b90 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936f7fe640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9370103900 0x7f93700754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936ffff640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9370109b90 0x7f9370075f30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f936800eaa0 tx=0x7f936800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936d7fa640 1 -- 172.21.15.53:0/782458191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936800cdb0 con 0x7f9370109b90 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f937625a640 1 -- 172.21.15.53:0/782458191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93701a8700 con 0x7f9370109b90 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936d7fa640 1 -- 172.21.15.53:0/782458191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9368005020 con 0x7f9370109b90 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f936d7fa640 1 -- 172.21.15.53:0/782458191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93680116d0 con 0x7f9370109b90 2024-08-31T06:12:01.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.762+0000 7f937625a640 1 -- 172.21.15.53:0/782458191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93701a8c40 con 0x7f9370109b90 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f937c7cf740 1 Processor -- start 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f936d7fa640 1 -- 172.21.15.53:0/782458191 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f93680051d0 con 0x7f9370109b90 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f937c7cf740 1 -- start start 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f709300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f33b1b0 0x55775f709840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f343390 0x55775f709d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f937c7cf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55775f680630 con 0x55775f33b1b0 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f937c7cf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55775f66fbc0 con 0x55775f343390 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f937c7cf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55775f673b70 con 0x55775f364070 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f936f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f33b1b0 0x55775f709840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f936f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f33b1b0 0x55775f709840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35924/0 (socket says 172.21.15.53:35924) 2024-08-31T06:12:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.765+0000 7f936f7fe640 1 -- 172.21.15.53:0/2055705774 learned_addr learned my addr 172.21.15.53:0/2055705774 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f9366ffd640 1 --2- 172.21.15.53:0/2055705774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f709300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f9366ffd640 1 --2- 172.21.15.53:0/2055705774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f343390 0x55775f709d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f936f7fe640 1 -- 172.21.15.53:0/2055705774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 msgr2=0x55775f709300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f936f7fe640 1 --2- 172.21.15.53:0/2055705774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f709300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f936f7fe640 1 -- 172.21.15.53:0/2055705774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f343390 msgr2=0x55775f709d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f936f7fe640 1 --2- 172.21.15.53:0/2055705774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f343390 0x55775f709d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f936f7fe640 1 -- 172.21.15.53:0/2055705774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55775f3cf650 con 0x55775f33b1b0 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f9366ffd640 1 --2- 172.21.15.53:0/2055705774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f343390 0x55775f709d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f936d7fa640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f935c0b4ca0 0x7f935c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f936f7fe640 1 --2- 172.21.15.53:0/2055705774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f33b1b0 0x55775f709840 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f9360000c00 tx=0x7f9360032dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e90c9cc0d2037a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f9366ffd640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f935c0b4ca0 0x7f935c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f936d7fa640 1 -- 172.21.15.53:0/782458191 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7f93680e5bc0 con 0x7f9370109b90 2024-08-31T06:12:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f9365ffb640 1 -- 172.21.15.53:0/2055705774 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936003f070 con 0x55775f33b1b0 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f9365ffb640 1 -- 172.21.15.53:0/2055705774 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93600044c0 con 0x55775f33b1b0 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.766+0000 7f9365ffb640 1 -- 172.21.15.53:0/2055705774 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9360035070 con 0x55775f33b1b0 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.767+0000 7f937c7cf740 1 -- 172.21.15.53:0/2055705774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f33b1b0 msgr2=0x55775f709840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.767+0000 7f9366ffd640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f935c0b4ca0 0x7f935c0b71b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f93701062d0 tx=0x7f93580046c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.767+0000 7f937c7cf740 1 --2- 172.21.15.53:0/2055705774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f33b1b0 0x55775f709840 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f9360000c00 tx=0x7f9360032dc0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.767+0000 7f937c7cf740 1 -- 172.21.15.53:0/2055705774 shutdown_connections 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.767+0000 7f937c7cf740 1 --2- 172.21.15.53:0/2055705774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f343390 0x55775f709d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.767+0000 7f937c7cf740 1 --2- 172.21.15.53:0/2055705774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f33b1b0 0x55775f709840 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.767+0000 7f937c7cf740 1 --2- 172.21.15.53:0/2055705774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f709300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.767+0000 7f937c7cf740 1 -- 172.21.15.53:0/2055705774 >> 172.21.15.53:0/2055705774 conn(0x55775f358460 msgr2=0x55775f7071f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.767+0000 7f937c7cf740 1 -- 172.21.15.53:0/2055705774 shutdown_connections 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.767+0000 7f937c7cf740 1 -- 172.21.15.53:0/2055705774 wait complete. 2024-08-31T06:12:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f937c7cf740 1 -- start start 2024-08-31T06:12:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f937c7cf740 1 Processor -- start 2024-08-31T06:12:01.819 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:12:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:12:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:12:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:12:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:12:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:12:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:12:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:01.825 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:01.825 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:01.825 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:01.825 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:12:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f33b1b0 0x55775f714a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f714f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f720da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f937c7cf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55775f4d2700 con 0x55775f343390 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f937c7cf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55775f5f6700 con 0x55775f33b1b0 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f937c7cf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55775f717a80 con 0x55775f364070 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f937c7cf740 10 client.0 _ll_register_callbacks cb 0x55775f625dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f9366ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f714f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f9366ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f714f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35930/0 (socket says 172.21.15.53:35930) 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.768+0000 7f9366ffd640 1 -- 172.21.15.53:0/933391303 learned_addr learned my addr 172.21.15.53:0/933391303 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f936ffff640 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f720da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f936f7fe640 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f33b1b0 0x55775f714a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f9366ffd640 1 -- 172.21.15.53:0/933391303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 msgr2=0x55775f720da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f9366ffd640 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f720da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f9366ffd640 1 -- 172.21.15.53:0/933391303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f33b1b0 msgr2=0x55775f714a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f9366ffd640 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f33b1b0 0x55775f714a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f9366ffd640 1 -- 172.21.15.53:0/933391303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55775f62f8b0 con 0x55775f343390 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f936f7fe640 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f33b1b0 0x55775f714a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f9366ffd640 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f714f90 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9358011ba0 tx=0x7f9358004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7ed7cdd9197e8a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f934effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f934effd640 1 -- 172.21.15.53:0/933391303 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935800fe10 con 0x55775f343390 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f934effd640 1 -- 172.21.15.53:0/933391303 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7f9358027400 con 0x55775f343390 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f937c7cf740 1 -- 172.21.15.53:0/933391303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55775f682580 con 0x55775f343390 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f934effd640 1 -- 172.21.15.53:0/933391303 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9358027600 con 0x55775f343390 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f937c7cf740 10 client.17781 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.769+0000 7f937c7cf740 1 -- 172.21.15.53:0/933391303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55775f723840 con 0x55775f343390 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.770+0000 7f934effd640 1 -- 172.21.15.53:0/933391303 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55775f682580 con 0x55775f343390 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.770+0000 7f934effd640 1 -- 172.21.15.53:0/933391303 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f935801f760 con 0x55775f343390 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.770+0000 7f937c7cf740 10 client.17781 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.770+0000 7f937c7cf740 10 client.17781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.770+0000 7f937c7cf740 20 client.17781 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.770+0000 7f937c7cf740 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55775f3229f0 0x55775f726d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.770+0000 7f937c7cf740 4 client.17781 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.770+0000 7f937c7cf740 1 -- 172.21.15.53:0/933391303 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55775f67e020 con 0x55775f3229f0 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.770+0000 7f936f7fe640 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55775f3229f0 0x55775f726d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.771+0000 7f936f7fe640 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55775f3229f0 0x55775f726d90 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d978e108b81c172a server_cookie=e5da15798a0b1f87 in_seq=0 out_seq=0 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.771+0000 7f934effd640 10 client.17781 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.771+0000 7f934effd640 1 -- 172.21.15.53:0/933391303 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55775f67e020 con 0x55775f3229f0 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.771+0000 7f934effd640 10 client.17781 handle_command_reply: tid=0 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.771+0000 7f937c7cf740 1 client.17781 shutdown 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f937c7cf740 1 -- 172.21.15.53:0/933391303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 msgr2=0x55775f714f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f937c7cf740 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f714f90 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9358011ba0 tx=0x7f9358004730 comp rx=0 tx=0).stop 2024-08-31T06:12:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f937c7cf740 1 -- 172.21.15.53:0/933391303 shutdown_connections 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f937c7cf740 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55775f3229f0 0x55775f726d90 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f937c7cf740 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f720da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f934effd640 0 client.17781 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f937c7cf740 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f714f90 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f937c7cf740 1 --2- 172.21.15.53:0/933391303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f33b1b0 0x55775f714a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f937c7cf740 1 -- 172.21.15.53:0/933391303 >> 172.21.15.53:0/933391303 conn(0x55775f358460 msgr2=0x55775f70c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f937c7cf740 1 -- 172.21.15.53:0/933391303 shutdown_connections 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f937c7cf740 1 -- 172.21.15.53:0/933391303 wait complete. 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.772+0000 7f937c7cf740 20 client.17781 trim_cache size 0 max 16384 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.789+0000 7f937c7cf740 1 Processor -- start 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.789+0000 7f937c7cf740 1 -- start start 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f33b1b0 0x55775f70cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f711c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f364070 0x55775f712180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f937c7cf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f93701b1710 con 0x55775f343390 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f937c7cf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f93701b3250 con 0x55775f364070 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f937c7cf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f93701b1de0 con 0x55775f33b1b0 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f9366ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f711c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f9366ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f711c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35940/0 (socket says 172.21.15.53:35940) 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f9366ffd640 1 -- 172.21.15.53:0/4183555052 learned_addr learned my addr 172.21.15.53:0/4183555052 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f936f7fe640 1 --2- 172.21.15.53:0/4183555052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f33b1b0 0x55775f70cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f936ffff640 1 --2- 172.21.15.53:0/4183555052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f364070 0x55775f712180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f9366ffd640 1 -- 172.21.15.53:0/4183555052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f33b1b0 msgr2=0x55775f70cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f9366ffd640 1 --2- 172.21.15.53:0/4183555052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f33b1b0 0x55775f70cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f9366ffd640 1 -- 172.21.15.53:0/4183555052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f364070 msgr2=0x55775f712180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f9366ffd640 1 --2- 172.21.15.53:0/4183555052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f364070 0x55775f712180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f9366ffd640 1 -- 172.21.15.53:0/4183555052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55775f70bb90 con 0x55775f343390 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f9366ffd640 1 --2- 172.21.15.53:0/4183555052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f711c40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f9358012010 tx=0x7f935800c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e71c51844f4de8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f93657fa640 1 -- 172.21.15.53:0/4183555052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9358033040 con 0x55775f343390 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f93657fa640 1 -- 172.21.15.53:0/4183555052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f935801f880 con 0x55775f343390 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.790+0000 7f93657fa640 1 -- 172.21.15.53:0/4183555052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935802e990 con 0x55775f343390 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.791+0000 7f937c7cf740 1 -- 172.21.15.53:0/4183555052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 msgr2=0x55775f711c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.791+0000 7f937c7cf740 1 --2- 172.21.15.53:0/4183555052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f711c40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f9358012010 tx=0x7f935800c3b0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.791+0000 7f937c7cf740 1 -- 172.21.15.53:0/4183555052 shutdown_connections 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.791+0000 7f937c7cf740 1 --2- 172.21.15.53:0/4183555052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f364070 0x55775f712180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.791+0000 7f937c7cf740 1 --2- 172.21.15.53:0/4183555052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f711c40 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.791+0000 7f937c7cf740 1 --2- 172.21.15.53:0/4183555052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f33b1b0 0x55775f70cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.791+0000 7f937c7cf740 1 -- 172.21.15.53:0/4183555052 >> 172.21.15.53:0/4183555052 conn(0x55775f358460 msgr2=0x55775f70c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.791+0000 7f937c7cf740 1 -- 172.21.15.53:0/4183555052 shutdown_connections 2024-08-31T06:12:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.791+0000 7f937c7cf740 1 -- 172.21.15.53:0/4183555052 wait complete. 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f937c7cf740 1 -- start start 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f937c7cf740 1 Processor -- start 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f33b1b0 0x55775f719660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f719c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f937c7cf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f78a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f937c7cf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f93701b2b80 con 0x55775f343390 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f937c7cf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f93701b24b0 con 0x55775f33b1b0 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f937c7cf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f93701af710 con 0x55775f364070 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f937c7cf740 10 client.0 _ll_register_callbacks cb 0x7f935800ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f9366ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f719c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f9366ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f719c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35956/0 (socket says 172.21.15.53:35956) 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f9366ffd640 1 -- 172.21.15.53:0/1498689608 learned_addr learned my addr 172.21.15.53:0/1498689608 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f936f7fe640 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f33b1b0 0x55775f719660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.792+0000 7f936ffff640 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f78a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f9366ffd640 1 -- 172.21.15.53:0/1498689608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 msgr2=0x55775f78a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f9366ffd640 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f78a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f9366ffd640 1 -- 172.21.15.53:0/1498689608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f33b1b0 msgr2=0x55775f719660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f9366ffd640 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f33b1b0 0x55775f719660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f9366ffd640 1 -- 172.21.15.53:0/1498689608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55775f78ade0 con 0x55775f343390 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f9366ffd640 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f719c40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f935801fb20 tx=0x7f935801fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91cb3c6124e0a7c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f934effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f934effd640 1 -- 172.21.15.53:0/1498689608 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9358033040 con 0x55775f343390 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f934effd640 1 -- 172.21.15.53:0/1498689608 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7f935801f600 con 0x55775f343390 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f937c7cf740 1 -- 172.21.15.53:0/1498689608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f935801f880 con 0x55775f343390 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f934effd640 1 -- 172.21.15.53:0/1498689608 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9358005040 con 0x55775f343390 2024-08-31T06:12:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f937c7cf740 10 client.17787 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f937c7cf740 1 -- 172.21.15.53:0/1498689608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55775f7921c0 con 0x55775f343390 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.793+0000 7f934effd640 1 -- 172.21.15.53:0/1498689608 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f935801f880 con 0x55775f343390 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.794+0000 7f934effd640 1 -- 172.21.15.53:0/1498689608 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f9358036070 con 0x55775f343390 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.794+0000 7f937c7cf740 10 client.17787 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.794+0000 7f937c7cf740 10 client.17787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.794+0000 7f937c7cf740 20 client.17787 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.794+0000 7f937c7cf740 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55775f2f7da0 0x55775f794850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.794+0000 7f937c7cf740 4 client.17787 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.794+0000 7f937c7cf740 1 -- 172.21.15.53:0/1498689608 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55775f67b760 con 0x55775f2f7da0 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.794+0000 7f936f7fe640 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55775f2f7da0 0x55775f794850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.794+0000 7f934effd640 10 client.17787 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.794+0000 7f936f7fe640 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55775f2f7da0 0x55775f794850 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f0124540bed25fa server_cookie=47c3f0f282f10dcf in_seq=0 out_seq=0 2024-08-31T06:12:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f934effd640 1 -- 172.21.15.53:0/1498689608 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55775f67b760 con 0x55775f2f7da0 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f934effd640 10 client.17787 handle_command_reply: tid=0 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 1 client.17787 shutdown 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 1 -- 172.21.15.53:0/1498689608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 msgr2=0x55775f719c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f719c40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f935801fb20 tx=0x7f935801fa30 comp rx=0 tx=0).stop 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 1 -- 172.21.15.53:0/1498689608 shutdown_connections 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55775f2f7da0 0x55775f794850 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55775f364070 0x55775f78a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55775f343390 0x55775f719c40 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f934effd640 0 client.17787 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 1 --2- 172.21.15.53:0/1498689608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55775f33b1b0 0x55775f719660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 1 -- 172.21.15.53:0/1498689608 >> 172.21.15.53:0/1498689608 conn(0x55775f358460 msgr2=0x55775f70a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 1 -- 172.21.15.53:0/1498689608 shutdown_connections 2024-08-31T06:12:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 1 -- 172.21.15.53:0/1498689608 wait complete. 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.795+0000 7f937c7cf740 20 client.17787 trim_cache size 0 max 16384 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 -- 172.21.15.53:0/782458191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f935c0b4ca0 msgr2=0x7f935c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f935c0b4ca0 0x7f935c0b71b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f93701062d0 tx=0x7f93580046c0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 -- 172.21.15.53:0/782458191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9370109b90 msgr2=0x7f9370075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9370109b90 0x7f9370075f30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f936800eaa0 tx=0x7f936800ef60 comp rx=0 tx=0).stop 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 -- 172.21.15.53:0/782458191 shutdown_connections 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f935c0b4ca0 0x7f935c0b71b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9370109b90 0x7f9370075f30 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9370109240 0x7f93700759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 --2- 172.21.15.53:0/782458191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9370103900 0x7f93700754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 -- 172.21.15.53:0/782458191 >> 172.21.15.53:0/782458191 conn(0x7f937007b5f0 msgr2=0x7f9370107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 -- 172.21.15.53:0/782458191 shutdown_connections 2024-08-31T06:12:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:01.796+0000 7f937625a640 1 -- 172.21.15.53:0/782458191 wait complete. 2024-08-31T06:12:01.981 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.77 MB/sec execute 231 sec latency 17701.731 ms 2024-08-31T06:12:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:02 smithi053 ceph-mon[18924]: pgmap v537: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 17 op/s 2024-08-31T06:12:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:02 smithi053 ceph-mon[18924]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T06:12:02.478 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:02 smithi153 ceph-mon[22320]: pgmap v537: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 17 op/s 2024-08-31T06:12:02.478 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:02 smithi153 ceph-mon[22320]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T06:12:02.588 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:12:02.588 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:12:02.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:02 smithi130 ceph-mon[22266]: pgmap v537: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 17 op/s 2024-08-31T06:12:02.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:02 smithi130 ceph-mon[22266]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T06:12:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:02.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.76 MB/sec execute 232 sec latency 18701.818 ms 2024-08-31T06:12:03.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.337+0000 7f7d37cfc640 1 -- 172.21.15.53:0/3458397921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d30102800 msgr2=0x7f7d30102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:03.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.337+0000 7f7d37cfc640 1 --2- 172.21.15.53:0/3458397921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d30102800 0x7f7d30102c10 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009900 tx=0x7f7d2c02a410 comp rx=0 tx=0).stop 2024-08-31T06:12:03.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.337+0000 7f7d37cfc640 1 -- 172.21.15.53:0/3458397921 shutdown_connections 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.337+0000 7f7d37cfc640 1 --2- 172.21.15.53:0/3458397921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d30108a90 0x7f7d3010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.337+0000 7f7d37cfc640 1 --2- 172.21.15.53:0/3458397921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30108140 0x7f7d30108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.337+0000 7f7d37cfc640 1 --2- 172.21.15.53:0/3458397921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d30102800 0x7f7d30102c10 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.337+0000 7f7d37cfc640 1 -- 172.21.15.53:0/3458397921 >> 172.21.15.53:0/3458397921 conn(0x7f7d300794d0 msgr2=0x7f7d300798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.337+0000 7f7d37cfc640 1 -- 172.21.15.53:0/3458397921 shutdown_connections 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.337+0000 7f7d37cfc640 1 -- 172.21.15.53:0/3458397921 wait complete. 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.337+0000 7f7d37cfc640 1 Processor -- start 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.337+0000 7f7d37cfc640 1 -- start start 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d37cfc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d30102800 0x7f7d3019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d37cfc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d30108140 0x7f7d3019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d37cfc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30108a90 0x7f7d3019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d37cfc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7d301125a0 con 0x7f7d30102800 2024-08-31T06:12:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d37cfc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7d30112420 con 0x7f7d30108a90 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d37cfc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d30112720 con 0x7f7d30108140 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d35a98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d30102800 0x7f7d3019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d35a98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d30102800 0x7f7d3019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42612/0 (socket says 172.21.15.53:42612) 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d35a98640 1 -- 172.21.15.53:0/4254211393 learned_addr learned my addr 172.21.15.53:0/4254211393 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d36299640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30108a90 0x7f7d3019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d35297640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d30108140 0x7f7d3019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d35a98640 1 -- 172.21.15.53:0/4254211393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d30108140 msgr2=0x7f7d3019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d35a98640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d30108140 0x7f7d3019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d35a98640 1 -- 172.21.15.53:0/4254211393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30108a90 msgr2=0x7f7d3019fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d35a98640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30108a90 0x7f7d3019fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d35a98640 1 -- 172.21.15.53:0/4254211393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d301a0070 con 0x7f7d30102800 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d35297640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d30108140 0x7f7d3019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.338+0000 7f7d35a98640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d30102800 0x7f7d3019a1c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009230 tx=0x7f7d2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.339+0000 7f7d26ffd640 1 -- 172.21.15.53:0/4254211393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c03f030 con 0x7f7d30102800 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.339+0000 7f7d37cfc640 1 -- 172.21.15.53:0/4254211393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d301a0300 con 0x7f7d30102800 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.339+0000 7f7d26ffd640 1 -- 172.21.15.53:0/4254211393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d2c003a80 con 0x7f7d30102800 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.339+0000 7f7d26ffd640 1 -- 172.21.15.53:0/4254211393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c035070 con 0x7f7d30102800 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.339+0000 7f7d37cfc640 1 -- 172.21.15.53:0/4254211393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d301a07e0 con 0x7f7d30102800 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.340+0000 7f7d37cfc640 1 -- 172.21.15.53:0/4254211393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d30102c10 con 0x7f7d30102800 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.341+0000 7f7d26ffd640 1 -- 172.21.15.53:0/4254211393 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7d2c042030 con 0x7f7d30102800 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.342+0000 7f7d26ffd640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d1c0b4cd0 0x7f7d1c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.342+0000 7f7d35297640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d1c0b4cd0 0x7f7d1c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.342+0000 7f7d26ffd640 1 -- 172.21.15.53:0/4254211393 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7f7d2c106110 con 0x7f7d30102800 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.342+0000 7f7d35297640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d1c0b4cd0 0x7f7d1c0b71e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7d200058c0 tx=0x7f7d20005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:03.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.345+0000 7f7d26ffd640 1 -- 172.21.15.53:0/4254211393 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7d2c0cceb0 con 0x7f7d30102800 2024-08-31T06:12:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.568+0000 7f7d37cfc640 1 -- 172.21.15.53:0/4254211393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d301a6cb0 con 0x7f7d30102800 2024-08-31T06:12:03.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.569+0000 7f7d26ffd640 1 -- 172.21.15.53:0/4254211393 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11985 (secure 0 0 0) 0x7f7d2c0d53f0 con 0x7f7d30102800 2024-08-31T06:12:03.571 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:12:03.572 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":36,"btime":"2024-08-31T06:11:22:133856+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:11:21.364258+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:12:03.572 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 36 2024-08-31T06:12:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 -- 172.21.15.53:0/4254211393 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d1c0b4cd0 msgr2=0x7f7d1c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d1c0b4cd0 0x7f7d1c0b71e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7d200058c0 tx=0x7f7d20005850 comp rx=0 tx=0).stop 2024-08-31T06:12:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 -- 172.21.15.53:0/4254211393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d30102800 msgr2=0x7f7d3019a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d30102800 0x7f7d3019a1c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009230 tx=0x7f7d2c004270 comp rx=0 tx=0).stop 2024-08-31T06:12:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 -- 172.21.15.53:0/4254211393 shutdown_connections 2024-08-31T06:12:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7d1c0b4cd0 0x7f7d1c0b71e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d30108a90 0x7f7d3019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d30108140 0x7f7d3019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 --2- 172.21.15.53:0/4254211393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d30102800 0x7f7d3019a1c0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 -- 172.21.15.53:0/4254211393 >> 172.21.15.53:0/4254211393 conn(0x7f7d300794d0 msgr2=0x7f7d30101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 -- 172.21.15.53:0/4254211393 shutdown_connections 2024-08-31T06:12:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:03.571+0000 7f7d37cfc640 1 -- 172.21.15.53:0/4254211393 wait complete. 2024-08-31T06:12:03.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.75 MB/sec execute 233 sec latency 19701.885 ms 2024-08-31T06:12:04.279 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:12:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:04 smithi053 ceph-mon[18924]: pgmap v539: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-31T06:12:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:04 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4254211393' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:04.536 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:04 smithi130 ceph-mon[22266]: pgmap v539: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-31T06:12:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:04 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4254211393' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:04.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:04 smithi153 ceph-mon[22320]: pgmap v539: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-31T06:12:04.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:04 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4254211393' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:04.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.75 MB/sec execute 234 sec latency 20701.945 ms 2024-08-31T06:12:05.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.043+0000 7fba3478f640 1 -- 172.21.15.53:0/247471782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba2c102820 msgr2=0x7fba2c102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:05.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.043+0000 7fba3478f640 1 --2- 172.21.15.53:0/247471782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba2c102820 0x7fba2c102c30 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fba28009900 tx=0x7fba2802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.043+0000 7fba3478f640 1 -- 172.21.15.53:0/247471782 shutdown_connections 2024-08-31T06:12:05.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.043+0000 7fba3478f640 1 --2- 172.21.15.53:0/247471782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba2c108ab0 0x7fba2c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.043+0000 7fba3478f640 1 --2- 172.21.15.53:0/247471782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba2c108160 0x7fba2c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.044+0000 7fba3478f640 1 --2- 172.21.15.53:0/247471782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba2c102820 0x7fba2c102c30 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.044+0000 7fba3478f640 1 -- 172.21.15.53:0/247471782 >> 172.21.15.53:0/247471782 conn(0x7fba2c0794e0 msgr2=0x7fba2c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:05.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.044+0000 7fba3478f640 1 -- 172.21.15.53:0/247471782 shutdown_connections 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.044+0000 7fba3478f640 1 -- 172.21.15.53:0/247471782 wait complete. 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.044+0000 7fba3478f640 1 Processor -- start 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.044+0000 7fba3478f640 1 -- start start 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba3478f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba2c102820 0x7fba2c19a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba3478f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba2c108160 0x7fba2c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba3478f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba2c108ab0 0x7fba2c19f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba3478f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c1136f0 con 0x7fba2c108160 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba3478f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c113570 con 0x7fba2c108ab0 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba3478f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c113870 con 0x7fba2c102820 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba31d2a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba2c108160 0x7fba2c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba31d2a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba2c108160 0x7fba2c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42634/0 (socket says 172.21.15.53:42634) 2024-08-31T06:12:05.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba31d2a640 1 -- 172.21.15.53:0/1657516204 learned_addr learned my addr 172.21.15.53:0/1657516204 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba3252b640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba2c102820 0x7fba2c19a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba32d2c640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba2c108ab0 0x7fba2c19f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba31d2a640 1 -- 172.21.15.53:0/1657516204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba2c102820 msgr2=0x7fba2c19a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba31d2a640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba2c102820 0x7fba2c19a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba31d2a640 1 -- 172.21.15.53:0/1657516204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba2c108ab0 msgr2=0x7fba2c19f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba31d2a640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba2c108ab0 0x7fba2c19f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba31d2a640 1 -- 172.21.15.53:0/1657516204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2c19ff50 con 0x7fba2c108160 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba3252b640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba2c102820 0x7fba2c19a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba32d2c640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba2c108ab0 0x7fba2c19f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba31d2a640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba2c108160 0x7fba2c19a640 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c970 tx=0x7fba1c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba237fe640 1 -- 172.21.15.53:0/1657516204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c014070 con 0x7fba2c108160 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba237fe640 1 -- 172.21.15.53:0/1657516204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba1c004440 con 0x7fba2c108160 2024-08-31T06:12:05.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba237fe640 1 -- 172.21.15.53:0/1657516204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c003d40 con 0x7fba2c108160 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.045+0000 7fba3478f640 1 -- 172.21.15.53:0/1657516204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba2c1a0240 con 0x7fba2c108160 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.046+0000 7fba3478f640 1 -- 172.21.15.53:0/1657516204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba2c1a6a60 con 0x7fba2c108160 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.048+0000 7fba3ad04740 1 Processor -- start 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.048+0000 7fba3ad04740 1 -- start start 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.048+0000 7fba237fe640 1 -- 172.21.15.53:0/1657516204 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fba1c017070 con 0x7fba2c108160 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.048+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c50c070 0x56197c8b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.048+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4e31b0 0x56197c8b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.048+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4eb390 0x56197c8b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.048+0000 7fba3ad04740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56197c828680 con 0x56197c4eb390 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.048+0000 7fba3ad04740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56197c817c10 con 0x56197c4e31b0 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.048+0000 7fba3ad04740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56197c81bbc0 con 0x56197c50c070 2024-08-31T06:12:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba3252b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4e31b0 0x56197c8b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba3252b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4e31b0 0x56197c8b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:59428/0 (socket says 172.21.15.53:59428) 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba3252b640 1 -- 172.21.15.53:0/3136760241 learned_addr learned my addr 172.21.15.53:0/3136760241 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba32d2c640 1 --2- 172.21.15.53:0/3136760241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c50c070 0x56197c8b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba31d2a640 1 --2- 172.21.15.53:0/3136760241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4eb390 0x56197c8b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba3252b640 1 -- 172.21.15.53:0/3136760241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c50c070 msgr2=0x56197c8b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba3252b640 1 --2- 172.21.15.53:0/3136760241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c50c070 0x56197c8b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba3252b640 1 -- 172.21.15.53:0/3136760241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4eb390 msgr2=0x56197c8b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba3252b640 1 --2- 172.21.15.53:0/3136760241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4eb390 0x56197c8b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba3252b640 1 -- 172.21.15.53:0/3136760241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56197c577650 con 0x56197c4e31b0 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba31d2a640 1 --2- 172.21.15.53:0/3136760241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4eb390 0x56197c8b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.049+0000 7fba237fe640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fba180b4cd0 0x7fba180b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.050+0000 7fba32d2c640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fba180b4cd0 0x7fba180b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.050+0000 7fba3252b640 1 --2- 172.21.15.53:0/3136760241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4e31b0 0x56197c8b1850 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba280096c0 tx=0x7fba28031d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e70f9dcec8480856 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.050+0000 7fba237fe640 1 -- 172.21.15.53:0/1657516204 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7fba1c0e51a0 con 0x7fba2c108160 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.050+0000 7fba20ff9640 1 -- 172.21.15.53:0/3136760241 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28035030 con 0x56197c4e31b0 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.050+0000 7fba20ff9640 1 -- 172.21.15.53:0/3136760241 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba280044c0 con 0x56197c4e31b0 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.050+0000 7fba20ff9640 1 -- 172.21.15.53:0/3136760241 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28003b80 con 0x56197c4e31b0 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.051+0000 7fba3ad04740 1 -- 172.21.15.53:0/3136760241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4e31b0 msgr2=0x56197c8b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.051+0000 7fba3ad04740 1 --2- 172.21.15.53:0/3136760241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4e31b0 0x56197c8b1850 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba280096c0 tx=0x7fba28031d60 comp rx=0 tx=0).stop 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.051+0000 7fba32d2c640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fba180b4cd0 0x7fba180b71e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fba24005fd0 tx=0x7fba240086a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.051+0000 7fba3ad04740 1 -- 172.21.15.53:0/3136760241 shutdown_connections 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.051+0000 7fba3ad04740 1 --2- 172.21.15.53:0/3136760241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4eb390 0x56197c8b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.051+0000 7fba3ad04740 1 --2- 172.21.15.53:0/3136760241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4e31b0 0x56197c8b1850 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.051+0000 7fba3ad04740 1 --2- 172.21.15.53:0/3136760241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c50c070 0x56197c8b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.051+0000 7fba3ad04740 1 -- 172.21.15.53:0/3136760241 >> 172.21.15.53:0/3136760241 conn(0x56197c500460 msgr2=0x56197c8af200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.051+0000 7fba3ad04740 1 -- 172.21.15.53:0/3136760241 shutdown_connections 2024-08-31T06:12:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.051+0000 7fba3ad04740 1 -- 172.21.15.53:0/3136760241 wait complete. 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba3ad04740 1 -- start start 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba3ad04740 1 Processor -- start 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c4e31b0 0x56197c8bcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8bcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c8c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba3ad04740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56197c67a700 con 0x56197c50c070 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba3ad04740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56197c79e750 con 0x56197c4eb390 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba3ad04740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56197c8bfa90 con 0x56197c4e31b0 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba3ad04740 10 client.0 _ll_register_callbacks cb 0x56197c7cde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba32d2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c8c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba32d2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c8c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42652/0 (socket says 172.21.15.53:42652) 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba32d2c640 1 -- 172.21.15.53:0/2609826660 learned_addr learned my addr 172.21.15.53:0/2609826660 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.052+0000 7fba31d2a640 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8bcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba3252b640 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c4e31b0 0x56197c8bcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba32d2c640 1 -- 172.21.15.53:0/2609826660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c4e31b0 msgr2=0x56197c8bcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:05.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba32d2c640 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c4e31b0 0x56197c8bcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba32d2c640 1 -- 172.21.15.53:0/2609826660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 msgr2=0x56197c8bcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:05.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba32d2c640 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8bcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba32d2c640 1 -- 172.21.15.53:0/2609826660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56197c7d7900 con 0x56197c50c070 2024-08-31T06:12:05.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba32d2c640 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c8c8d80 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fba2401cda0 tx=0x7fba24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1960b6b053717c34 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:05.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba15ffb640 1 -- 172.21.15.53:0/2609826660 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2401d620 con 0x56197c50c070 2024-08-31T06:12:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba15ffb640 1 -- 172.21.15.53:0/2609826660 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7fba2401d7c0 con 0x56197c50c070 2024-08-31T06:12:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba3ad04740 1 -- 172.21.15.53:0/2609826660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56197c82a5d0 con 0x56197c50c070 2024-08-31T06:12:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba15ffb640 1 -- 172.21.15.53:0/2609826660 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fba24004b20 con 0x56197c50c070 2024-08-31T06:12:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba3ad04740 10 client.17805 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.053+0000 7fba3ad04740 1 -- 172.21.15.53:0/2609826660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56197c8cb8f0 con 0x56197c50c070 2024-08-31T06:12:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.054+0000 7fba15ffb640 1 -- 172.21.15.53:0/2609826660 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56197c82a5d0 con 0x56197c50c070 2024-08-31T06:12:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.054+0000 7fba15ffb640 1 -- 172.21.15.53:0/2609826660 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fba240051b0 con 0x56197c50c070 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.054+0000 7fba3ad04740 10 client.17805 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.054+0000 7fba3ad04740 10 client.17805 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.054+0000 7fba3ad04740 20 client.17805 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.054+0000 7fba3ad04740 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56197c4ca9f0 0x56197c8ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.054+0000 7fba3ad04740 4 client.17805 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.054+0000 7fba3ad04740 1 -- 172.21.15.53:0/2609826660 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56197c826070 con 0x56197c4ca9f0 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.054+0000 7fba3252b640 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56197c4ca9f0 0x56197c8ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.055+0000 7fba3252b640 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56197c4ca9f0 0x56197c8ceeb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9b6a7f67ebfd7706 server_cookie=85d1ffc324970c2d in_seq=0 out_seq=0 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.055+0000 7fba15ffb640 10 client.17805 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba15ffb640 1 -- 172.21.15.53:0/2609826660 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56197c826070 con 0x56197c4ca9f0 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba15ffb640 10 client.17805 handle_command_reply: tid=0 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 1 client.17805 shutdown 2024-08-31T06:12:05.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 1 -- 172.21.15.53:0/2609826660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 msgr2=0x56197c8c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c8c8d80 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fba2401cda0 tx=0x7fba24004a40 comp rx=0 tx=0).stop 2024-08-31T06:12:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 1 -- 172.21.15.53:0/2609826660 shutdown_connections 2024-08-31T06:12:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c8c8d80 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8bcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56197c4ca9f0 0x56197c8ceeb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 1 --2- 172.21.15.53:0/2609826660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c4e31b0 0x56197c8bcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 1 -- 172.21.15.53:0/2609826660 >> 172.21.15.53:0/2609826660 conn(0x56197c500460 msgr2=0x56197c8b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba15ffb640 0 client.17805 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:12:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 1 -- 172.21.15.53:0/2609826660 shutdown_connections 2024-08-31T06:12:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 1 -- 172.21.15.53:0/2609826660 wait complete. 2024-08-31T06:12:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.056+0000 7fba3ad04740 20 client.17805 trim_cache size 0 max 16384 2024-08-31T06:12:05.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.069+0000 7fba3ad04740 1 Processor -- start 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.069+0000 7fba3ad04740 1 -- start start 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4e31b0 0x56197c8b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c50c070 0x56197c8c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3ad04740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c1af3e0 con 0x56197c4e31b0 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3ad04740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c1b0f20 con 0x56197c4eb390 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3ad04740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c1afab0 con 0x56197c50c070 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3252b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4e31b0 0x56197c8b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3252b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4e31b0 0x56197c8b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42658/0 (socket says 172.21.15.53:42658) 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3252b640 1 -- 172.21.15.53:0/3513234388 learned_addr learned my addr 172.21.15.53:0/3513234388 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba32d2c640 1 --2- 172.21.15.53:0/3513234388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c50c070 0x56197c8c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba31d2a640 1 --2- 172.21.15.53:0/3513234388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3252b640 1 -- 172.21.15.53:0/3513234388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c50c070 msgr2=0x56197c8c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3252b640 1 --2- 172.21.15.53:0/3513234388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c50c070 0x56197c8c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3252b640 1 -- 172.21.15.53:0/3513234388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 msgr2=0x56197c8c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3252b640 1 --2- 172.21.15.53:0/3513234388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3252b640 1 -- 172.21.15.53:0/3513234388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56197c8b4170 con 0x56197c4e31b0 2024-08-31T06:12:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba31d2a640 1 --2- 172.21.15.53:0/3513234388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.070+0000 7fba3252b640 1 --2- 172.21.15.53:0/3513234388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4e31b0 0x56197c8b2a50 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fba28005ef0 tx=0x7fba28005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c41b57a8addec9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.071+0000 7fba17fff640 1 -- 172.21.15.53:0/3513234388 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2805a070 con 0x56197c4e31b0 2024-08-31T06:12:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.071+0000 7fba17fff640 1 -- 172.21.15.53:0/3513234388 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba280317c0 con 0x56197c4e31b0 2024-08-31T06:12:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.071+0000 7fba17fff640 1 -- 172.21.15.53:0/3513234388 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28035040 con 0x56197c4e31b0 2024-08-31T06:12:05.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.071+0000 7fba3ad04740 1 -- 172.21.15.53:0/3513234388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4e31b0 msgr2=0x56197c8b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.071+0000 7fba3ad04740 1 --2- 172.21.15.53:0/3513234388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4e31b0 0x56197c8b2a50 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fba28005ef0 tx=0x7fba28005e80 comp rx=0 tx=0).stop 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.071+0000 7fba3ad04740 1 -- 172.21.15.53:0/3513234388 shutdown_connections 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.071+0000 7fba3ad04740 1 --2- 172.21.15.53:0/3513234388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c50c070 0x56197c8c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.071+0000 7fba3ad04740 1 --2- 172.21.15.53:0/3513234388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.071+0000 7fba3ad04740 1 --2- 172.21.15.53:0/3513234388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c4e31b0 0x56197c8b2a50 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.071+0000 7fba3ad04740 1 -- 172.21.15.53:0/3513234388 >> 172.21.15.53:0/3513234388 conn(0x56197c500460 msgr2=0x56197c8b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.071+0000 7fba3ad04740 1 -- 172.21.15.53:0/3513234388 shutdown_connections 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3ad04740 1 -- 172.21.15.53:0/3513234388 wait complete. 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3ad04740 1 -- start start 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3ad04740 1 Processor -- start 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c4e31b0 0x56197c8c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8c1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3ad04740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c938870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3ad04740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c1b0850 con 0x56197c50c070 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3ad04740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c1b0180 con 0x56197c4eb390 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3ad04740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c1ad3e0 con 0x56197c4e31b0 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3ad04740 10 client.0 _ll_register_callbacks cb 0x7fba24008be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba32d2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c938870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3252b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c4e31b0 0x56197c8c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba32d2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c938870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42670/0 (socket says 172.21.15.53:42670) 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba3252b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c4e31b0 0x56197c8c10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:53318/0 (socket says 172.21.15.53:53318) 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.072+0000 7fba32d2c640 1 -- 172.21.15.53:0/911809566 learned_addr learned my addr 172.21.15.53:0/911809566 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba31d2a640 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba32d2c640 1 -- 172.21.15.53:0/911809566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c4e31b0 msgr2=0x56197c8c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba32d2c640 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c4e31b0 0x56197c8c10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba32d2c640 1 -- 172.21.15.53:0/911809566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 msgr2=0x56197c8c1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba32d2c640 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8c1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba32d2c640 1 -- 172.21.15.53:0/911809566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56197c938db0 con 0x56197c50c070 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba32d2c640 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c938870 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fba24005770 tx=0x7fba24004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171a810abdb24788 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba15ffb640 1 -- 172.21.15.53:0/911809566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2403c020 con 0x56197c50c070 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba3ad04740 1 -- 172.21.15.53:0/911809566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba280317c0 con 0x56197c50c070 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba15ffb640 1 -- 172.21.15.53:0/911809566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7fba24038480 con 0x56197c50c070 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba15ffb640 1 -- 172.21.15.53:0/911809566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fba24047050 con 0x56197c50c070 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba3ad04740 10 client.17811 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.073+0000 7fba3ad04740 1 -- 172.21.15.53:0/911809566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56197c939f30 con 0x56197c50c070 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.074+0000 7fba15ffb640 1 -- 172.21.15.53:0/911809566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba280317c0 con 0x56197c50c070 2024-08-31T06:12:05.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.074+0000 7fba15ffb640 1 -- 172.21.15.53:0/911809566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fba2402d460 con 0x56197c50c070 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.074+0000 7fba3ad04740 10 client.17811 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.074+0000 7fba3ad04740 10 client.17811 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.074+0000 7fba3ad04740 20 client.17811 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.074+0000 7fba3ad04740 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56197c49fda0 0x56197c93c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.074+0000 7fba3ad04740 4 client.17811 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.074+0000 7fba3ad04740 1 -- 172.21.15.53:0/911809566 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56197c8237b0 con 0x56197c49fda0 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.074+0000 7fba3252b640 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56197c49fda0 0x56197c93c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba15ffb640 10 client.17811 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3252b640 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56197c49fda0 0x56197c93c770 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3bef4384c2b85ae server_cookie=72de340568db9829 in_seq=0 out_seq=0 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba15ffb640 1 -- 172.21.15.53:0/911809566 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56197c8237b0 con 0x56197c49fda0 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba15ffb640 10 client.17811 handle_command_reply: tid=0 2024-08-31T06:12:05.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 1 client.17811 shutdown 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 1 -- 172.21.15.53:0/911809566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 msgr2=0x56197c938870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c938870 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fba24005770 tx=0x7fba24004ab0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 1 -- 172.21.15.53:0/911809566 shutdown_connections 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56197c50c070 0x56197c938870 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56197c4eb390 0x56197c8c1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56197c49fda0 0x56197c93c770 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 1 --2- 172.21.15.53:0/911809566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56197c4e31b0 0x56197c8c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 1 -- 172.21.15.53:0/911809566 >> 172.21.15.53:0/911809566 conn(0x56197c500460 msgr2=0x56197c8af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba15ffb640 0 client.17811 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 1 -- 172.21.15.53:0/911809566 shutdown_connections 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 1 -- 172.21.15.53:0/911809566 wait complete. 2024-08-31T06:12:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.075+0000 7fba3ad04740 20 client.17811 trim_cache size 0 max 16384 2024-08-31T06:12:05.083 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:12:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 -- 172.21.15.53:0/1657516204 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fba180b4cd0 msgr2=0x7fba180b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fba180b4cd0 0x7fba180b71e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fba24005fd0 tx=0x7fba240086a0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 -- 172.21.15.53:0/1657516204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba2c108160 msgr2=0x7fba2c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:05.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba2c108160 0x7fba2c19a640 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c970 tx=0x7fba1c00ce30 comp rx=0 tx=0).stop 2024-08-31T06:12:05.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 -- 172.21.15.53:0/1657516204 shutdown_connections 2024-08-31T06:12:05.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fba180b4cd0 0x7fba180b71e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba2c108ab0 0x7fba2c19f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba2c108160 0x7fba2c19a640 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 --2- 172.21.15.53:0/1657516204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba2c102820 0x7fba2c19a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:05.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 -- 172.21.15.53:0/1657516204 >> 172.21.15.53:0/1657516204 conn(0x7fba2c0794e0 msgr2=0x7fba2c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:05.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 -- 172.21.15.53:0/1657516204 shutdown_connections 2024-08-31T06:12:05.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:05.076+0000 7fba3478f640 1 -- 172.21.15.53:0/1657516204 wait complete. 2024-08-31T06:12:05.744 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:12:05.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.74 MB/sec execute 235 sec latency 21701.972 ms 2024-08-31T06:12:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:06.410 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:06 smithi053 ceph-mon[18924]: pgmap v540: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 39 KiB/s wr, 31 op/s 2024-08-31T06:12:06.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.501+0000 7fbfbf319640 1 -- 172.21.15.53:0/3337847088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfb8102d00 msgr2=0x7fbfb810fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:06.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.501+0000 7fbfbf319640 1 --2- 172.21.15.53:0/3337847088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfb8102d00 0x7fbfb810fa20 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009900 tx=0x7fbfa802a480 comp rx=0 tx=0).stop 2024-08-31T06:12:06.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.501+0000 7fbfbf319640 1 -- 172.21.15.53:0/3337847088 shutdown_connections 2024-08-31T06:12:06.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.501+0000 7fbfbf319640 1 --2- 172.21.15.53:0/3337847088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb810ff60 0x7fbfb8112380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.501+0000 7fbfbf319640 1 --2- 172.21.15.53:0/3337847088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfb8102d00 0x7fbfb810fa20 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.501+0000 7fbfbf319640 1 --2- 172.21.15.53:0/3337847088 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfb81023b0 0x7fbfb81027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.501+0000 7fbfbf319640 1 -- 172.21.15.53:0/3337847088 >> 172.21.15.53:0/3337847088 conn(0x7fbfb80794f0 msgr2=0x7fbfb8079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:06.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.502+0000 7fbfbf319640 1 -- 172.21.15.53:0/3337847088 shutdown_connections 2024-08-31T06:12:06.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.502+0000 7fbfbf319640 1 -- 172.21.15.53:0/3337847088 wait complete. 2024-08-31T06:12:06.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.502+0000 7fbfbf319640 1 Processor -- start 2024-08-31T06:12:06.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.502+0000 7fbfbf319640 1 -- start start 2024-08-31T06:12:06.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbf319640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb81023b0 0x7fbfb819c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbf319640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfb8102d00 0x7fbfb819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbf319640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfb810ff60 0x7fbfb81a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbf319640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb8115950 con 0x7fbfb810ff60 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbf319640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81157d0 con 0x7fbfb8102d00 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbf319640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb8115ad0 con 0x7fbfb81023b0 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbd8b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfb810ff60 0x7fbfb81a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbd8b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfb810ff60 0x7fbfb81a1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42678/0 (socket says 172.21.15.53:42678) 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbd8b6640 1 -- 172.21.15.53:0/68533924 learned_addr learned my addr 172.21.15.53:0/68533924 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbd0b5640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb81023b0 0x7fbfb819c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfb8102d00 0x7fbfb819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbd8b6640 1 -- 172.21.15.53:0/68533924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb81023b0 msgr2=0x7fbfb819c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbd8b6640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb81023b0 0x7fbfb819c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbd8b6640 1 -- 172.21.15.53:0/68533924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfb8102d00 msgr2=0x7fbfb819c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbd8b6640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfb8102d00 0x7fbfb819c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbd8b6640 1 -- 172.21.15.53:0/68533924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb81a21d0 con 0x7fbfb810ff60 2024-08-31T06:12:06.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfbd8b6640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfb810ff60 0x7fbfb81a1b60 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000eaa0 tx=0x7fbfb000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:06.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.503+0000 7fbfae7fc640 1 -- 172.21.15.53:0/68533924 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0004d20 con 0x7fbfb810ff60 2024-08-31T06:12:06.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.504+0000 7fbfbf319640 1 -- 172.21.15.53:0/68533924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb81a24c0 con 0x7fbfb810ff60 2024-08-31T06:12:06.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.504+0000 7fbfae7fc640 1 -- 172.21.15.53:0/68533924 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfb0005020 con 0x7fbfb810ff60 2024-08-31T06:12:06.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.504+0000 7fbfae7fc640 1 -- 172.21.15.53:0/68533924 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00116d0 con 0x7fbfb810ff60 2024-08-31T06:12:06.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.504+0000 7fbfbf319640 1 -- 172.21.15.53:0/68533924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb81a8ce0 con 0x7fbfb810ff60 2024-08-31T06:12:06.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.506+0000 7fbfc588e740 1 Processor -- start 2024-08-31T06:12:06.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.506+0000 7fbfae7fc640 1 -- 172.21.15.53:0/68533924 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbfb0011870 con 0x7fbfb810ff60 2024-08-31T06:12:06.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfc588e740 1 -- start start 2024-08-31T06:12:06.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a91070 0x55ba56e36350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a681b0 0x55ba56e36890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e36dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfc588e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ba56dad680 con 0x55ba56a70390 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfc588e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ba56d9cc10 con 0x55ba56a681b0 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfc588e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ba56da0bc0 con 0x55ba56a91070 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfbc8b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e36dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfbc8b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e36dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42692/0 (socket says 172.21.15.53:42692) 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfbc8b4640 1 -- 172.21.15.53:0/1201968372 learned_addr learned my addr 172.21.15.53:0/1201968372 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfbd0b5640 1 --2- 172.21.15.53:0/1201968372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a681b0 0x55ba56e36890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1201968372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a91070 0x55ba56e36350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.507+0000 7fbfae7fc640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfa40b4d50 0x7fbfa40b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfbc8b4640 1 -- 172.21.15.53:0/1201968372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a91070 msgr2=0x55ba56e36350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:06.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1201968372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a91070 0x55ba56e36350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfbc8b4640 1 -- 172.21.15.53:0/1201968372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a681b0 msgr2=0x55ba56e36890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1201968372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a681b0 0x55ba56e36890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfbc8b4640 1 -- 172.21.15.53:0/1201968372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba56afc650 con 0x55ba56a70390 2024-08-31T06:12:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfbd8b6640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfa40b4d50 0x7fbfa40b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfae7fc640 1 -- 172.21.15.53:0/68533924 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7fbfb00e5600 con 0x7fbfb810ff60 2024-08-31T06:12:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1201968372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e36dd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fbfa802aa70 tx=0x7fbfa8009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea33ebc644af911 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfa37fe640 1 -- 172.21.15.53:0/1201968372 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8044020 con 0x55ba56a70390 2024-08-31T06:12:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfa37fe640 1 -- 172.21.15.53:0/1201968372 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfa8003770 con 0x55ba56a70390 2024-08-31T06:12:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfbd8b6640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfa40b4d50 0x7fbfa40b7260 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00ab9a0 tx=0x7fbfb0005b40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.508+0000 7fbfa37fe640 1 -- 172.21.15.53:0/1201968372 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8035070 con 0x55ba56a70390 2024-08-31T06:12:06.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.509+0000 7fbfc588e740 1 -- 172.21.15.53:0/1201968372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 msgr2=0x55ba56e36dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:06.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.509+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1201968372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e36dd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fbfa802aa70 tx=0x7fbfa8009610 comp rx=0 tx=0).stop 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.509+0000 7fbfc588e740 1 -- 172.21.15.53:0/1201968372 shutdown_connections 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.509+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1201968372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e36dd0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.509+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1201968372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a681b0 0x55ba56e36890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.509+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1201968372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a91070 0x55ba56e36350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.509+0000 7fbfc588e740 1 -- 172.21.15.53:0/1201968372 >> 172.21.15.53:0/1201968372 conn(0x55ba56a85460 msgr2=0x55ba56e34240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.509+0000 7fbfc588e740 1 -- 172.21.15.53:0/1201968372 shutdown_connections 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.509+0000 7fbfc588e740 1 -- 172.21.15.53:0/1201968372 wait complete. 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfc588e740 1 -- start start 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfc588e740 1 Processor -- start 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a681b0 0x55ba56e41ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e41ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 0x55ba56e4ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfc588e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ba56bff700 con 0x55ba56a70390 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfc588e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ba56d23750 con 0x55ba56a91070 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfc588e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ba56e44ad0 con 0x55ba56a681b0 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfbd0b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e41ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfc588e740 10 client.0 _ll_register_callbacks cb 0x55ba56d52e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfbd0b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e41ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42702/0 (socket says 172.21.15.53:42702) 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.510+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/1415663574 learned_addr learned my addr 172.21.15.53:0/1415663574 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a681b0 0x55ba56e41ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 0x55ba56e4ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/1415663574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a681b0 msgr2=0x55ba56e41ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfbd0b5640 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a681b0 0x55ba56e41ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/1415663574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 msgr2=0x55ba56e4ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfbd0b5640 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 0x55ba56e4ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/1415663574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba56d5c900 con 0x55ba56a70390 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 0x55ba56e4ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfbd0b5640 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e41ff0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4010a50 tx=0x7fbfb4010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5b7864750d9186 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfa0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1415663574 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb401e060 con 0x55ba56a70390 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1415663574 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7fbfb400fbd0 con 0x55ba56a70390 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfc588e740 1 -- 172.21.15.53:0/1415663574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfa8003770 con 0x55ba56a70390 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1415663574 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fbfb400fdd0 con 0x55ba56a70390 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfc588e740 10 client.17823 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.511+0000 7fbfc588e740 1 -- 172.21.15.53:0/1415663574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ba56e50960 con 0x55ba56a70390 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.512+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1415663574 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfa8003770 con 0x55ba56a70390 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.512+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1415663574 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fbfb400e440 con 0x55ba56a70390 2024-08-31T06:12:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.512+0000 7fbfc588e740 10 client.17823 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.512+0000 7fbfc588e740 10 client.17823 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:12:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.512+0000 7fbfc588e740 20 client.17823 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.512+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba56a4f9f0 0x55ba56e53e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.512+0000 7fbfc588e740 4 client.17823 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.512+0000 7fbfc588e740 1 -- 172.21.15.53:0/1415663574 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba56daf5d0 con 0x55ba56a4f9f0 2024-08-31T06:12:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.512+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba56a4f9f0 0x55ba56e53e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.513+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba56a4f9f0 0x55ba56e53e80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b6c8900077acaa53 server_cookie=1955b6252efc32fb in_seq=0 out_seq=0 2024-08-31T06:12:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.513+0000 7fbfa0ff9640 10 client.17823 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:12:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1415663574 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ba56daf5d0 con 0x55ba56a4f9f0 2024-08-31T06:12:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfa0ff9640 10 client.17823 handle_command_reply: tid=0 2024-08-31T06:12:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 1 client.17823 shutdown 2024-08-31T06:12:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 1 -- 172.21.15.53:0/1415663574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 msgr2=0x55ba56e41ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e41ff0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4010a50 tx=0x7fbfb4010f10 comp rx=0 tx=0).stop 2024-08-31T06:12:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 1 -- 172.21.15.53:0/1415663574 shutdown_connections 2024-08-31T06:12:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 0x55ba56e4ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba56a4f9f0 0x55ba56e53e80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e41ff0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1415663574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a681b0 0x55ba56e41ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 1 -- 172.21.15.53:0/1415663574 >> 172.21.15.53:0/1415663574 conn(0x55ba56a85460 msgr2=0x55ba56e394e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfa0ff9640 0 client.17823 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:12:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 1 -- 172.21.15.53:0/1415663574 shutdown_connections 2024-08-31T06:12:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 1 -- 172.21.15.53:0/1415663574 wait complete. 2024-08-31T06:12:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.514+0000 7fbfc588e740 20 client.17823 trim_cache size 0 max 16384 2024-08-31T06:12:06.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.527+0000 7fbfc588e740 1 Processor -- start 2024-08-31T06:12:06.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.527+0000 7fbfc588e740 1 -- start start 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a681b0 0x55ba56e39b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e4dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a91070 0x55ba56e4e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfc588e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81b15b0 con 0x55ba56a70390 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfc588e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81b30f0 con 0x55ba56a681b0 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfc588e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81b1c80 con 0x55ba56a91070 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbd0b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e4dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbd0b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e4dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42712/0 (socket says 172.21.15.53:42712) 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/946678694 learned_addr learned my addr 172.21.15.53:0/946678694 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/946678694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a681b0 0x55ba56e39b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/946678694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a91070 msgr2=0x55ba56e4e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/946678694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a91070 0x55ba56e4e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbd0b5640 1 --2- 172.21.15.53:0/946678694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a91070 0x55ba56e4e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/946678694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a681b0 msgr2=0x55ba56e39b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbd0b5640 1 --2- 172.21.15.53:0/946678694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a681b0 0x55ba56e39b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/946678694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba56e445e0 con 0x55ba56a70390 2024-08-31T06:12:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/946678694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a681b0 0x55ba56e39b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfbd0b5640 1 --2- 172.21.15.53:0/946678694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e4dcf0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4010a20 tx=0x7fbfb4010640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58c8d9ce71b0dcc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.528+0000 7fbfa2ffd640 1 -- 172.21.15.53:0/946678694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400a340 con 0x55ba56a70390 2024-08-31T06:12:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.529+0000 7fbfa2ffd640 1 -- 172.21.15.53:0/946678694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfb402f070 con 0x55ba56a70390 2024-08-31T06:12:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.529+0000 7fbfa2ffd640 1 -- 172.21.15.53:0/946678694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb402a910 con 0x55ba56a70390 2024-08-31T06:12:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.529+0000 7fbfc588e740 1 -- 172.21.15.53:0/946678694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 msgr2=0x55ba56e4dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.529+0000 7fbfc588e740 1 --2- 172.21.15.53:0/946678694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e4dcf0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4010a20 tx=0x7fbfb4010640 comp rx=0 tx=0).stop 2024-08-31T06:12:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.529+0000 7fbfc588e740 1 -- 172.21.15.53:0/946678694 shutdown_connections 2024-08-31T06:12:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.529+0000 7fbfc588e740 1 --2- 172.21.15.53:0/946678694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a91070 0x55ba56e4e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.529+0000 7fbfc588e740 1 --2- 172.21.15.53:0/946678694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e4dcf0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.529+0000 7fbfc588e740 1 --2- 172.21.15.53:0/946678694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a681b0 0x55ba56e39b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.529+0000 7fbfc588e740 1 -- 172.21.15.53:0/946678694 >> 172.21.15.53:0/946678694 conn(0x55ba56a85460 msgr2=0x55ba56e39450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.529+0000 7fbfc588e740 1 -- 172.21.15.53:0/946678694 shutdown_connections 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.529+0000 7fbfc588e740 1 -- 172.21.15.53:0/946678694 wait complete. 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.530+0000 7fbfc588e740 1 -- start start 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.530+0000 7fbfc588e740 1 Processor -- start 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.530+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a681b0 0x55ba56e46050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.530+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e46590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.530+0000 7fbfc588e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 0x55ba56ebd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.530+0000 7fbfc588e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81b2a20 con 0x55ba56a70390 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.530+0000 7fbfc588e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81b2350 con 0x55ba56a91070 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.530+0000 7fbfc588e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81af5b0 con 0x55ba56a681b0 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbd0b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e46590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfc588e740 10 client.0 _ll_register_callbacks cb 0x7fbfb400a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbd0b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e46590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42722/0 (socket says 172.21.15.53:42722) 2024-08-31T06:12:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/1802679278 learned_addr learned my addr 172.21.15.53:0/1802679278 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a681b0 0x55ba56e46050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 0x55ba56ebd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/1802679278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a681b0 msgr2=0x55ba56e46050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbd0b5640 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a681b0 0x55ba56e46050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/1802679278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 msgr2=0x55ba56ebd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbd0b5640 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 0x55ba56ebd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbd0b5640 1 -- 172.21.15.53:0/1802679278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba56e46e10 con 0x55ba56a70390 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 0x55ba56ebd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfbd0b5640 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e46590 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4005bd0 tx=0x7fbfb400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf037a27febae90 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfa0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1802679278 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4037030 con 0x55ba56a70390 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1802679278 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7fbfb4016040 con 0x55ba56a70390 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.531+0000 7fbfc588e740 1 -- 172.21.15.53:0/1802679278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfb402f070 con 0x55ba56a70390 2024-08-31T06:12:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1802679278 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fbfb402a480 con 0x55ba56a70390 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfc588e740 10 client.17829 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfc588e740 1 -- 172.21.15.53:0/1802679278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ba56ebed90 con 0x55ba56a70390 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1802679278 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfb402f070 con 0x55ba56a70390 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1802679278 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fbfb401a4e0 con 0x55ba56a70390 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfc588e740 10 client.17829 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfc588e740 10 client.17829 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfc588e740 20 client.17829 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba56a24da0 0x55ba56ec1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfc588e740 4 client.17829 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfc588e740 1 -- 172.21.15.53:0/1802679278 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ba56dab070 con 0x55ba56a24da0 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.532+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba56a24da0 0x55ba56ec1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfa0ff9640 10 client.17829 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:12:06.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfbc8b4640 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba56a24da0 0x55ba56ec1410 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5d7501d463c3ab63 server_cookie=d857918c58ce6684 in_seq=0 out_seq=0 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfa0ff9640 1 -- 172.21.15.53:0/1802679278 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ba56dab070 con 0x55ba56a24da0 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfa0ff9640 10 client.17829 handle_command_reply: tid=0 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 1 client.17829 shutdown 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 1 -- 172.21.15.53:0/1802679278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 msgr2=0x55ba56e46590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e46590 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4005bd0 tx=0x7fbfb400fc60 comp rx=0 tx=0).stop 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 1 -- 172.21.15.53:0/1802679278 shutdown_connections 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba56a91070 0x55ba56ebd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba56a24da0 0x55ba56ec1410 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba56a70390 0x55ba56e46590 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 1 --2- 172.21.15.53:0/1802679278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba56a681b0 0x55ba56e46050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 1 -- 172.21.15.53:0/1802679278 >> 172.21.15.53:0/1802679278 conn(0x55ba56a85460 msgr2=0x55ba56e33a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfa0ff9640 0 client.17829 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:12:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 1 -- 172.21.15.53:0/1802679278 shutdown_connections 2024-08-31T06:12:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 1 -- 172.21.15.53:0/1802679278 wait complete. 2024-08-31T06:12:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.533+0000 7fbfc588e740 20 client.17829 trim_cache size 0 max 16384 2024-08-31T06:12:06.541 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 -- 172.21.15.53:0/68533924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfa40b4d50 msgr2=0x7fbfa40b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfa40b4d50 0x7fbfa40b7260 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00ab9a0 tx=0x7fbfb0005b40 comp rx=0 tx=0).stop 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 -- 172.21.15.53:0/68533924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfb810ff60 msgr2=0x7fbfb81a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfb810ff60 0x7fbfb81a1b60 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000eaa0 tx=0x7fbfb000eea0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 -- 172.21.15.53:0/68533924 shutdown_connections 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbfa40b4d50 0x7fbfa40b7260 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfb810ff60 0x7fbfb81a1b60 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbfb8102d00 0x7fbfb819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 --2- 172.21.15.53:0/68533924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb81023b0 0x7fbfb819c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 -- 172.21.15.53:0/68533924 >> 172.21.15.53:0/68533924 conn(0x7fbfb80794f0 msgr2=0x7fbfb81089d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 -- 172.21.15.53:0/68533924 shutdown_connections 2024-08-31T06:12:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:06.534+0000 7fbfbf319640 1 -- 172.21.15.53:0/68533924 wait complete. 2024-08-31T06:12:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:06 smithi130 ceph-mon[22266]: pgmap v540: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 39 KiB/s wr, 31 op/s 2024-08-31T06:12:06.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:06 smithi153 ceph-mon[22320]: pgmap v540: 97 pgs: 97 active+clean; 73 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 39 KiB/s wr, 31 op/s 2024-08-31T06:12:06.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.73 MB/sec execute 236 sec latency 22702.019 ms 2024-08-31T06:12:07.165 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:12:07.180 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:12:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:07.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.908+0000 7f60e37e5640 1 -- 172.21.15.53:0/1156784815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60dc108140 msgr2=0x7f60dc108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:07.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.908+0000 7f60e37e5640 1 --2- 172.21.15.53:0/1156784815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60dc108140 0x7f60dc108550 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009900 tx=0x7f60cc02a410 comp rx=0 tx=0).stop 2024-08-31T06:12:07.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.908+0000 7f60e37e5640 1 -- 172.21.15.53:0/1156784815 shutdown_connections 2024-08-31T06:12:07.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.908+0000 7f60e37e5640 1 --2- 172.21.15.53:0/1156784815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60dc108a90 0x7f60dc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:07.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.908+0000 7f60e37e5640 1 --2- 172.21.15.53:0/1156784815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60dc108140 0x7f60dc108550 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:07.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.908+0000 7f60e37e5640 1 --2- 172.21.15.53:0/1156784815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60dc102800 0x7f60dc102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:07.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.908+0000 7f60e37e5640 1 -- 172.21.15.53:0/1156784815 >> 172.21.15.53:0/1156784815 conn(0x7f60dc0794d0 msgr2=0x7f60dc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:07.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.908+0000 7f60e37e5640 1 -- 172.21.15.53:0/1156784815 shutdown_connections 2024-08-31T06:12:07.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.908+0000 7f60e37e5640 1 -- 172.21.15.53:0/1156784815 wait complete. 2024-08-31T06:12:07.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.909+0000 7f60e37e5640 1 Processor -- start 2024-08-31T06:12:07.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.909+0000 7f60e37e5640 1 -- start start 2024-08-31T06:12:07.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.909+0000 7f60e37e5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60dc102800 0x7f60dc19afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:07.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.909+0000 7f60e37e5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60dc108140 0x7f60dc19b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:07.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.909+0000 7f60e37e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60dc108a90 0x7f60dc19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:07.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.909+0000 7f60e37e5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f60dc1125f0 con 0x7f60dc108a90 2024-08-31T06:12:07.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.909+0000 7f60e37e5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f60dc112470 con 0x7f60dc108140 2024-08-31T06:12:07.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.909+0000 7f60e37e5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60dc112770 con 0x7f60dc102800 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e1d82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60dc108a90 0x7f60dc19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e1d82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60dc108a90 0x7f60dc19ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42736/0 (socket says 172.21.15.53:42736) 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e1d82640 1 -- 172.21.15.53:0/2871585636 learned_addr learned my addr 172.21.15.53:0/2871585636 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e0d80640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60dc108140 0x7f60dc19b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e1581640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60dc102800 0x7f60dc19afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e1d82640 1 -- 172.21.15.53:0/2871585636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60dc102800 msgr2=0x7f60dc19afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e1d82640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60dc102800 0x7f60dc19afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e1d82640 1 -- 172.21.15.53:0/2871585636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60dc108140 msgr2=0x7f60dc19b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e1d82640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60dc108140 0x7f60dc19b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e1d82640 1 -- 172.21.15.53:0/2871585636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60dc1a6250 con 0x7f60dc108a90 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e1d82640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60dc108a90 0x7f60dc19ba40 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f60d400b970 tx=0x7f60d400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60d27fc640 1 -- 172.21.15.53:0/2871585636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d4019070 con 0x7f60dc108a90 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60e37e5640 1 -- 172.21.15.53:0/2871585636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60dc1a6540 con 0x7f60dc108a90 2024-08-31T06:12:07.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60d27fc640 1 -- 172.21.15.53:0/2871585636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60d4014440 con 0x7f60dc108a90 2024-08-31T06:12:07.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.910+0000 7f60d27fc640 1 -- 172.21.15.53:0/2871585636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d40075d0 con 0x7f60dc108a90 2024-08-31T06:12:07.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.911+0000 7f60e37e5640 1 -- 172.21.15.53:0/2871585636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60dc1a6a80 con 0x7f60dc108a90 2024-08-31T06:12:07.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.912+0000 7f60e37e5640 1 -- 172.21.15.53:0/2871585636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60dc102c10 con 0x7f60dc108a90 2024-08-31T06:12:07.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.913+0000 7f60d27fc640 1 -- 172.21.15.53:0/2871585636 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f60d401c070 con 0x7f60dc108a90 2024-08-31T06:12:07.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.914+0000 7f60d27fc640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60c80b4cd0 0x7f60c80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:07.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.914+0000 7f60e1581640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60c80b4cd0 0x7f60c80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:07.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.914+0000 7f60d27fc640 1 -- 172.21.15.53:0/2871585636 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7f60d40e4ec0 con 0x7f60dc108a90 2024-08-31T06:12:07.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.915+0000 7f60e1581640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60c80b4cd0 0x7f60c80b71e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f60d80058c0 tx=0x7f60d800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:07.917+0000 7f60d27fc640 1 -- 172.21.15.53:0/2871585636 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f60d40ab5b0 con 0x7f60dc108a90 2024-08-31T06:12:07.945 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:07.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.72 MB/sec execute 237 sec latency 23702.045 ms 2024-08-31T06:12:08.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.143+0000 7f60e37e5640 1 -- 172.21.15.53:0/2871585636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60dc06b010 con 0x7f60dc108a90 2024-08-31T06:12:08.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.143+0000 7f60d27fc640 1 -- 172.21.15.53:0/2871585636 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11985 (secure 0 0 0) 0x7f60d40b4140 con 0x7f60dc108a90 2024-08-31T06:12:08.146 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:12:08.146 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":36,"btime":"2024-08-31T06:11:22:133856+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:11:21.364258+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:12:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 36 2024-08-31T06:12:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.145+0000 7f60e37e5640 1 -- 172.21.15.53:0/2871585636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60c80b4cd0 msgr2=0x7f60c80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.146+0000 7f60e37e5640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60c80b4cd0 0x7f60c80b71e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f60d80058c0 tx=0x7f60d800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:12:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.146+0000 7f60e37e5640 1 -- 172.21.15.53:0/2871585636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60dc108a90 msgr2=0x7f60dc19ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.146+0000 7f60e37e5640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60dc108a90 0x7f60dc19ba40 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f60d400b970 tx=0x7f60d400be30 comp rx=0 tx=0).stop 2024-08-31T06:12:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.146+0000 7f60e37e5640 1 -- 172.21.15.53:0/2871585636 shutdown_connections 2024-08-31T06:12:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.146+0000 7f60e37e5640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f60c80b4cd0 0x7f60c80b71e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.146+0000 7f60e37e5640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60dc108a90 0x7f60dc19ba40 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.146+0000 7f60e37e5640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60dc108140 0x7f60dc19b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.146+0000 7f60e37e5640 1 --2- 172.21.15.53:0/2871585636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60dc102800 0x7f60dc19afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.146+0000 7f60e37e5640 1 -- 172.21.15.53:0/2871585636 >> 172.21.15.53:0/2871585636 conn(0x7f60dc0794d0 msgr2=0x7f60dc1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.146+0000 7f60e37e5640 1 -- 172.21.15.53:0/2871585636 shutdown_connections 2024-08-31T06:12:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:08.146+0000 7f60e37e5640 1 -- 172.21.15.53:0/2871585636 wait complete. 2024-08-31T06:12:08.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:08 smithi053 ceph-mon[18924]: pgmap v541: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-08-31T06:12:08.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:08 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2871585636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:08.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:08 smithi130 ceph-mon[22266]: pgmap v541: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-08-31T06:12:08.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:08 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2871585636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:08.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:08 smithi153 ceph-mon[22320]: pgmap v541: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-08-31T06:12:08.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:08 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2871585636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:08.915 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id dbdd68df --release --await' 2024-08-31T06:12:08.916 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id dbdd68df --release --await 2024-08-31T06:12:08.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.72 MB/sec execute 238 sec latency 24702.094 ms 2024-08-31T06:12:09.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.104+0000 7feadbfff640 1 -- 172.21.15.53:0/2748708663 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc031d80 con 0x7feae4109bc0 2024-08-31T06:12:09.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.105+0000 7feaeb716640 1 -- 172.21.15.53:0/2748708663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feae4109bc0 msgr2=0x7feae41103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:09.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.105+0000 7feaeb716640 1 --2- 172.21.15.53:0/2748708663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feae4109bc0 0x7feae41103f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7feadc009ca0 tx=0x7feadc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.105+0000 7feaeb716640 1 -- 172.21.15.53:0/2748708663 shutdown_connections 2024-08-31T06:12:09.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.105+0000 7feaeb716640 1 --2- 172.21.15.53:0/2748708663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feae4109bc0 0x7feae41103f0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.105+0000 7feaeb716640 1 --2- 172.21.15.53:0/2748708663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feae4109270 0x7feae4109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.105+0000 7feaeb716640 1 --2- 172.21.15.53:0/2748708663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae4103930 0x7feae4103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.105+0000 7feaeb716640 1 -- 172.21.15.53:0/2748708663 >> 172.21.15.53:0/2748708663 conn(0x7feae40ff380 msgr2=0x7feae41017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:09.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.105+0000 7feaeb716640 1 -- 172.21.15.53:0/2748708663 shutdown_connections 2024-08-31T06:12:09.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.105+0000 7feaeb716640 1 -- 172.21.15.53:0/2748708663 wait complete. 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.106+0000 7feaeb716640 1 Processor -- start 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.106+0000 7feaeb716640 1 -- start start 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.106+0000 7feaeb716640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae4103930 0x7feae419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.106+0000 7feaeb716640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feae4109270 0x7feae419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.106+0000 7feaeb716640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feae4109bc0 0x7feae419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.106+0000 7feaeb716640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feae4113780 con 0x7feae4109270 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.106+0000 7feaeb716640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feae4113600 con 0x7feae4103930 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.106+0000 7feaeb716640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feae4113900 con 0x7feae4109bc0 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.106+0000 7feae8cb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feae4109270 0x7feae419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.106+0000 7feae8cb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feae4109270 0x7feae419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42752/0 (socket says 172.21.15.53:42752) 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.106+0000 7feae8cb1640 1 -- 172.21.15.53:0/2137034922 learned_addr learned my addr 172.21.15.53:0/2137034922 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:09.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feae9cb3640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feae4109bc0 0x7feae419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feae94b2640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae4103930 0x7feae419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feae8cb1640 1 -- 172.21.15.53:0/2137034922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feae4109bc0 msgr2=0x7feae419f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feae8cb1640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feae4109bc0 0x7feae419f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feae8cb1640 1 -- 172.21.15.53:0/2137034922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae4103930 msgr2=0x7feae419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feae8cb1640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae4103930 0x7feae419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feae8cb1640 1 -- 172.21.15.53:0/2137034922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae419ffa0 con 0x7feae4109270 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feae8cb1640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feae4109270 0x7feae419a690 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fead400c8c0 tx=0x7fead400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feada7fc640 1 -- 172.21.15.53:0/2137034922 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4007bb0 con 0x7feae4109270 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feaeb716640 1 -- 172.21.15.53:0/2137034922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae41a0290 con 0x7feae4109270 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feada7fc640 1 -- 172.21.15.53:0/2137034922 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fead4007d50 con 0x7feae4109270 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feada7fc640 1 -- 172.21.15.53:0/2137034922 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead40186a0 con 0x7feae4109270 2024-08-31T06:12:09.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.107+0000 7feaeb716640 1 -- 172.21.15.53:0/2137034922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae41a6ab0 con 0x7feae4109270 2024-08-31T06:12:09.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.110+0000 7feaf1c8b740 1 Processor -- start 2024-08-31T06:12:09.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.110+0000 7feaf1c8b740 1 -- start start 2024-08-31T06:12:09.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.110+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b213e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d701b0 0x55f2b213e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d78390 0x55f2b213ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feada7fc640 1 -- 172.21.15.53:0/2137034922 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fead4018840 con 0x7feae4109270 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f2b20b5680 con 0x55f2b1d78390 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f2b20a4c10 con 0x55f2b1d701b0 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f2b20a8bc0 con 0x55f2b1d99070 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feae9cb3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b213e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feae94b2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d701b0 0x55f2b213e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feae8cb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d78390 0x55f2b213ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feae94b2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d701b0 0x55f2b213e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:59554/0 (socket says 172.21.15.53:59554) 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feae94b2640 1 -- 172.21.15.53:0/982871205 learned_addr learned my addr 172.21.15.53:0/982871205 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feae9cb3640 1 -- 172.21.15.53:0/982871205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d701b0 msgr2=0x55f2b213e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:09.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feae9cb3640 1 --2- 172.21.15.53:0/982871205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d701b0 0x55f2b213e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feae9cb3640 1 -- 172.21.15.53:0/982871205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d78390 msgr2=0x55f2b213ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feae9cb3640 1 --2- 172.21.15.53:0/982871205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d78390 0x55f2b213ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.111+0000 7feae9cb3640 1 -- 172.21.15.53:0/982871205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2b1e04650 con 0x55f2b1d99070 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.112+0000 7feae9cb3640 1 --2- 172.21.15.53:0/982871205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b213e310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feadc031040 tx=0x7feadc031500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96dcd63e9d7a4fdb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.112+0000 7feada7fc640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fead00b4cd0 0x7fead00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.112+0000 7feacf7fe640 1 -- 172.21.15.53:0/982871205 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc0317b0 con 0x55f2b1d99070 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.112+0000 7feacf7fe640 1 -- 172.21.15.53:0/982871205 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feadc036030 con 0x55f2b1d99070 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.112+0000 7feacf7fe640 1 -- 172.21.15.53:0/982871205 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc0044d0 con 0x55f2b1d99070 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.112+0000 7feada7fc640 1 -- 172.21.15.53:0/2137034922 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7fead40e5620 con 0x7feae4109270 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.112+0000 7feae94b2640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fead00b4cd0 0x7fead00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.113+0000 7feaf1c8b740 1 -- 172.21.15.53:0/982871205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 msgr2=0x55f2b213e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:09.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.113+0000 7feae94b2640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fead00b4cd0 0x7fead00b71e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feae0005cc0 tx=0x7feae0005c50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.113+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/982871205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b213e310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feadc031040 tx=0x7feadc031500 comp rx=0 tx=0).stop 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.113+0000 7feaf1c8b740 1 -- 172.21.15.53:0/982871205 shutdown_connections 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.113+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/982871205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d78390 0x55f2b213ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.113+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/982871205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d701b0 0x55f2b213e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.113+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/982871205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b213e310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.113+0000 7feaf1c8b740 1 -- 172.21.15.53:0/982871205 >> 172.21.15.53:0/982871205 conn(0x55f2b1d8d460 msgr2=0x55f2b213c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.113+0000 7feaf1c8b740 1 -- 172.21.15.53:0/982871205 shutdown_connections 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.114+0000 7feaf1c8b740 1 -- 172.21.15.53:0/982871205 wait complete. 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.114+0000 7feaf1c8b740 1 -- start start 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.114+0000 7feaf1c8b740 1 Processor -- start 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d701b0 0x55f2b2149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d78390 0x55f2b2149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d99070 0x55f2b2155c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f2b1f07700 con 0x55f2b1d78390 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f2b202b750 con 0x55f2b1d99070 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f2b214c910 con 0x55f2b1d701b0 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feaf1c8b740 10 client.0 _ll_register_callbacks cb 0x55f2b205ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feae8cb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d78390 0x55f2b2149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feae8cb1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d78390 0x55f2b2149ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42762/0 (socket says 172.21.15.53:42762) 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feae8cb1640 1 -- 172.21.15.53:0/565710735 learned_addr learned my addr 172.21.15.53:0/565710735 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feae94b2640 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d701b0 0x55f2b2149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feae9cb3640 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d99070 0x55f2b2155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feae94b2640 1 -- 172.21.15.53:0/565710735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d99070 msgr2=0x55f2b2155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feae94b2640 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d99070 0x55f2b2155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feae94b2640 1 -- 172.21.15.53:0/565710735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d78390 msgr2=0x55f2b2149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feae94b2640 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d78390 0x55f2b2149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.115+0000 7feae94b2640 1 -- 172.21.15.53:0/565710735 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2b2064900 con 0x55f2b1d701b0 2024-08-31T06:12:09.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.116+0000 7feae94b2640 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d701b0 0x55f2b2149ab0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feae0005fd0 tx=0x7feae00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a90879d932cffe4d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.116+0000 7feaccff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:12:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.116+0000 7feaccff9640 1 -- 172.21.15.53:0/565710735 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0023070 con 0x55f2b1d701b0 2024-08-31T06:12:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.116+0000 7feaccff9640 1 -- 172.21.15.53:0/565710735 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7feae0004440 con 0x55f2b1d701b0 2024-08-31T06:12:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.116+0000 7feaf1c8b740 1 -- 172.21.15.53:0/565710735 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feadc036030 con 0x55f2b1d701b0 2024-08-31T06:12:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.116+0000 7feaccff9640 1 -- 172.21.15.53:0/565710735 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7feae002f050 con 0x55f2b1d701b0 2024-08-31T06:12:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.116+0000 7feaf1c8b740 10 client.27142 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:09.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.116+0000 7feaf1c8b740 1 -- 172.21.15.53:0/565710735 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f2b21587a0 con 0x55f2b1d701b0 2024-08-31T06:12:09.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.117+0000 7feaccff9640 1 -- 172.21.15.53:0/565710735 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feadc036030 con 0x55f2b1d701b0 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.117+0000 7feaccff9640 1 -- 172.21.15.53:0/565710735 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7feae001f750 con 0x55f2b1d701b0 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.117+0000 7feaf1c8b740 10 client.27142 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.117+0000 7feaf1c8b740 10 client.27142 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.117+0000 7feaf1c8b740 20 client.27142 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.117+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2b1d579f0 0x55f2b215bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.117+0000 7feaf1c8b740 4 client.27142 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.117+0000 7feaf1c8b740 1 -- 172.21.15.53:0/565710735 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2b20b75d0 con 0x55f2b1d579f0 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.117+0000 7feae8cb1640 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2b1d579f0 0x55f2b215bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.118+0000 7feaccff9640 10 client.27142 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.118+0000 7feae8cb1640 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2b1d579f0 0x55f2b215bc80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67b4a274695a45cc server_cookie=dc9f81e0e59520d5 in_seq=0 out_seq=0 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaccff9640 1 -- 172.21.15.53:0/565710735 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2b20b75d0 con 0x55f2b1d579f0 2024-08-31T06:12:09.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaccff9640 10 client.27142 handle_command_reply: tid=0 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 1 client.27142 shutdown 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 1 -- 172.21.15.53:0/565710735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d701b0 msgr2=0x55f2b2149ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d701b0 0x55f2b2149ab0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feae0005fd0 tx=0x7feae00046c0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 1 -- 172.21.15.53:0/565710735 shutdown_connections 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2b1d579f0 0x55f2b215bc80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d99070 0x55f2b2155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d78390 0x55f2b2149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/565710735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d701b0 0x55f2b2149ab0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 1 -- 172.21.15.53:0/565710735 >> 172.21.15.53:0/565710735 conn(0x55f2b1d8d460 msgr2=0x55f2b21414a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaccff9640 0 client.27142 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 1 -- 172.21.15.53:0/565710735 shutdown_connections 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 1 -- 172.21.15.53:0/565710735 wait complete. 2024-08-31T06:12:09.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.119+0000 7feaf1c8b740 20 client.27142 trim_cache size 0 max 16384 2024-08-31T06:12:09.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feaf1c8b740 1 Processor -- start 2024-08-31T06:12:09.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feaf1c8b740 1 -- start start 2024-08-31T06:12:09.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b2155b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d78390 0x55f2b2156070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b2141410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feae41ad210 con 0x55f2b1d701b0 2024-08-31T06:12:09.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feae41aed50 con 0x55f2b1d78390 2024-08-31T06:12:09.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feae41ad8e0 con 0x55f2b1d99070 2024-08-31T06:12:09.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feae94b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b2155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feae94b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b2155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42774/0 (socket says 172.21.15.53:42774) 2024-08-31T06:12:09.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feae94b2640 1 -- 172.21.15.53:0/566408098 learned_addr learned my addr 172.21.15.53:0/566408098 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:09.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feae9cb3640 1 --2- 172.21.15.53:0/566408098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b2141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.142+0000 7feae8cb1640 1 --2- 172.21.15.53:0/566408098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d78390 0x55f2b2156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.143+0000 7feae94b2640 1 -- 172.21.15.53:0/566408098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 msgr2=0x55f2b2141410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:09.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.143+0000 7feae94b2640 1 --2- 172.21.15.53:0/566408098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b2141410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.143+0000 7feae94b2640 1 -- 172.21.15.53:0/566408098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d78390 msgr2=0x55f2b2156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:09.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.143+0000 7feae94b2640 1 --2- 172.21.15.53:0/566408098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d78390 0x55f2b2156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.143+0000 7feae94b2640 1 -- 172.21.15.53:0/566408098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2b2147fb0 con 0x55f2b1d701b0 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.143+0000 7feae94b2640 1 --2- 172.21.15.53:0/566408098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b2155b30 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7feae001b450 tx=0x7feae0020fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32964e9f89af0fcb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.143+0000 7feaceffd640 1 -- 172.21.15.53:0/566408098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0023040 con 0x55f2b1d701b0 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.143+0000 7feaceffd640 1 -- 172.21.15.53:0/566408098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feae0004440 con 0x55f2b1d701b0 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.143+0000 7feaceffd640 1 -- 172.21.15.53:0/566408098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0004730 con 0x55f2b1d701b0 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.144+0000 7feaf1c8b740 1 -- 172.21.15.53:0/566408098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 msgr2=0x55f2b2155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.144+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/566408098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b2155b30 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7feae001b450 tx=0x7feae0020fb0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.144+0000 7feaf1c8b740 1 -- 172.21.15.53:0/566408098 shutdown_connections 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.144+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/566408098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b2141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.144+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/566408098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d78390 0x55f2b2156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.144+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/566408098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b2155b30 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.144+0000 7feaf1c8b740 1 -- 172.21.15.53:0/566408098 >> 172.21.15.53:0/566408098 conn(0x55f2b1d8d460 msgr2=0x55f2b2148330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.144+0000 7feaf1c8b740 1 -- 172.21.15.53:0/566408098 shutdown_connections 2024-08-31T06:12:09.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.144+0000 7feaf1c8b740 1 -- 172.21.15.53:0/566408098 wait complete. 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feaf1c8b740 1 -- start start 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feaf1c8b740 1 Processor -- start 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b214de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d78390 0x55f2b214e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feaf1c8b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b21cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feae41ae680 con 0x55f2b1d701b0 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feae41adfb0 con 0x55f2b1d78390 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feaf1c8b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feae41ab210 con 0x55f2b1d99070 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feaf1c8b740 10 client.0 _ll_register_callbacks cb 0x7feae000be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feae94b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b214de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feae94b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b214de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42786/0 (socket says 172.21.15.53:42786) 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.145+0000 7feae94b2640 1 -- 172.21.15.53:0/4019993430 learned_addr learned my addr 172.21.15.53:0/4019993430 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:09.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.146+0000 7feae9cb3640 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b21cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.146+0000 7feae8cb1640 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d78390 0x55f2b214e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.146+0000 7feae94b2640 1 -- 172.21.15.53:0/4019993430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 msgr2=0x55f2b21cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.146+0000 7feae94b2640 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b21cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.146+0000 7feae94b2640 1 -- 172.21.15.53:0/4019993430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d78390 msgr2=0x55f2b214e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.146+0000 7feae94b2640 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d78390 0x55f2b214e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.146+0000 7feae94b2640 1 -- 172.21.15.53:0/4019993430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2b214ebc0 con 0x55f2b1d701b0 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.146+0000 7feae9cb3640 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b21cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.146+0000 7feae94b2640 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b214de30 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7feae0021040 tx=0x7feae00043a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccfa96997baa309 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.146+0000 7feaccff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.147+0000 7feaccff9640 1 -- 172.21.15.53:0/4019993430 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0023070 con 0x55f2b1d701b0 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.147+0000 7feaccff9640 1 -- 172.21.15.53:0/4019993430 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8601+0+0 (secure 0 0 0) 0x7feae001f620 con 0x55f2b1d701b0 2024-08-31T06:12:09.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.147+0000 7feaf1c8b740 1 -- 172.21.15.53:0/4019993430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feae0004440 con 0x55f2b1d701b0 2024-08-31T06:12:09.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.147+0000 7feaccff9640 1 -- 172.21.15.53:0/4019993430 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7feae002c040 con 0x55f2b1d701b0 2024-08-31T06:12:09.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.147+0000 7feaf1c8b740 10 client.17853 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:09.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.147+0000 7feaf1c8b740 1 -- 172.21.15.53:0/4019993430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f2b21be600 con 0x55f2b1d701b0 2024-08-31T06:12:09.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.147+0000 7feaccff9640 1 -- 172.21.15.53:0/4019993430 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feae0004440 con 0x55f2b1d701b0 2024-08-31T06:12:09.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.147+0000 7feaccff9640 1 -- 172.21.15.53:0/4019993430 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7feae0056470 con 0x55f2b1d701b0 2024-08-31T06:12:09.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.148+0000 7feaf1c8b740 10 client.17853 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:09.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.148+0000 7feaf1c8b740 10 client.17853 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:12:09.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.148+0000 7feaf1c8b740 20 client.17853 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:09.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.148+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2b1d2cda0 0x55f2b21c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:09.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.148+0000 7feaf1c8b740 4 client.17853 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:12:09.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.148+0000 7feaf1c8b740 1 -- 172.21.15.53:0/4019993430 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f2b20b3070 con 0x55f2b1d2cda0 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.148+0000 7feae8cb1640 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2b1d2cda0 0x55f2b21c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.149+0000 7feaccff9640 10 client.17853 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.149+0000 7feae8cb1640 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2b1d2cda0 0x55f2b21c0d40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=96b2f4ff231bb4d5 server_cookie=f099db5447b96cdc in_seq=0 out_seq=0 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.149+0000 7feaccff9640 1 -- 172.21.15.53:0/4019993430 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f2b20b3070 con 0x55f2b1d2cda0 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.149+0000 7feaccff9640 10 client.17853 handle_command_reply: tid=0 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.149+0000 7feaf1c8b740 1 client.17853 shutdown 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.150+0000 7feaf1c8b740 1 -- 172.21.15.53:0/4019993430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 msgr2=0x55f2b214de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.150+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b214de30 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7feae0021040 tx=0x7feae00043a0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.150+0000 7feaf1c8b740 1 -- 172.21.15.53:0/4019993430 shutdown_connections 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.150+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2b1d2cda0 0x55f2b21c0d40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.150+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2b1d99070 0x55f2b21cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.150+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2b1d78390 0x55f2b214e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.150+0000 7feaf1c8b740 1 --2- 172.21.15.53:0/4019993430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2b1d701b0 0x55f2b214de30 secure :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7feae0021040 tx=0x7feae00043a0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.150+0000 7feaccff9640 0 client.17853 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:12:09.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.150+0000 7feaf1c8b740 1 -- 172.21.15.53:0/4019993430 >> 172.21.15.53:0/4019993430 conn(0x55f2b1d8d460 msgr2=0x55f2b213bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:09.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.151+0000 7feaf1c8b740 1 -- 172.21.15.53:0/4019993430 shutdown_connections 2024-08-31T06:12:09.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.151+0000 7feaf1c8b740 1 -- 172.21.15.53:0/4019993430 wait complete. 2024-08-31T06:12:09.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.151+0000 7feaf1c8b740 20 client.17853 trim_cache size 0 max 16384 2024-08-31T06:12:09.160 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:12:09.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 -- 172.21.15.53:0/2137034922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fead00b4cd0 msgr2=0x7fead00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:09.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fead00b4cd0 0x7fead00b71e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feae0005cc0 tx=0x7feae0005c50 comp rx=0 tx=0).stop 2024-08-31T06:12:09.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 -- 172.21.15.53:0/2137034922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feae4109270 msgr2=0x7feae419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:09.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feae4109270 0x7feae419a690 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fead400c8c0 tx=0x7fead400cd80 comp rx=0 tx=0).stop 2024-08-31T06:12:09.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 -- 172.21.15.53:0/2137034922 shutdown_connections 2024-08-31T06:12:09.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fead00b4cd0 0x7fead00b71e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feae4109bc0 0x7feae419f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feae4109270 0x7feae419a690 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 --2- 172.21.15.53:0/2137034922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae4103930 0x7feae419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:09.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 -- 172.21.15.53:0/2137034922 >> 172.21.15.53:0/2137034922 conn(0x7feae40ff380 msgr2=0x7feae41017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:09.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 -- 172.21.15.53:0/2137034922 shutdown_connections 2024-08-31T06:12:09.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:09.152+0000 7feaeb716640 1 -- 172.21.15.53:0/2137034922 wait complete. 2024-08-31T06:12:09.422 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:09.819 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:12:09.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128051 1.71 MB/sec execute 239 sec latency 25702.140 ms 2024-08-31T06:12:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.382+0000 7f83df619640 1 -- 172.21.15.53:0/275172839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d8075e40 msgr2=0x7f83d810f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.382+0000 7f83df619640 1 --2- 172.21.15.53:0/275172839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d8075e40 0x7f83d810f980 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009900 tx=0x7f83c802a410 comp rx=0 tx=0).stop 2024-08-31T06:12:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.382+0000 7f83df619640 1 -- 172.21.15.53:0/275172839 shutdown_connections 2024-08-31T06:12:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.382+0000 7f83df619640 1 --2- 172.21.15.53:0/275172839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83d810fec0 0x7f83d81122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.382+0000 7f83df619640 1 --2- 172.21.15.53:0/275172839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d8075e40 0x7f83d810f980 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.382+0000 7f83df619640 1 --2- 172.21.15.53:0/275172839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83d80754f0 0x7f83d8075900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.382+0000 7f83df619640 1 -- 172.21.15.53:0/275172839 >> 172.21.15.53:0/275172839 conn(0x7f83d807b5f0 msgr2=0x7f83d807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.382+0000 7f83df619640 1 -- 172.21.15.53:0/275172839 shutdown_connections 2024-08-31T06:12:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.382+0000 7f83df619640 1 -- 172.21.15.53:0/275172839 wait complete. 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.382+0000 7f83df619640 1 Processor -- start 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.382+0000 7f83df619640 1 -- start start 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83df619640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d80754f0 0x7f83d819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83df619640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83d8075e40 0x7f83d819c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83df619640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83d810fec0 0x7f83d81a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83df619640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f83d81158e0 con 0x7f83d80754f0 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83df619640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8115760 con 0x7f83d8075e40 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83df619640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8115a60 con 0x7f83d810fec0 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83dd3b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d80754f0 0x7f83d819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83dd3b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d80754f0 0x7f83d819c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42798/0 (socket says 172.21.15.53:42798) 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83dd3b5640 1 -- 172.21.15.53:0/4117201279 learned_addr learned my addr 172.21.15.53:0/4117201279 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83d8075e40 0x7f83d819c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83d810fec0 0x7f83d81a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83dd3b5640 1 -- 172.21.15.53:0/4117201279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83d810fec0 msgr2=0x7f83d81a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83dd3b5640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83d810fec0 0x7f83d81a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83dd3b5640 1 -- 172.21.15.53:0/4117201279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83d8075e40 msgr2=0x7f83d819c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83dd3b5640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83d8075e40 0x7f83d819c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83dd3b5640 1 -- 172.21.15.53:0/4117201279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d81a2320 con 0x7f83d80754f0 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.383+0000 7f83dd3b5640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d80754f0 0x7f83d819c3b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f83d400d770 tx=0x7f83d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.384+0000 7f83ce7fc640 1 -- 172.21.15.53:0/4117201279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4017070 con 0x7f83d80754f0 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.384+0000 7f83ce7fc640 1 -- 172.21.15.53:0/4117201279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83d40054b0 con 0x7f83d80754f0 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.384+0000 7f83df619640 1 -- 172.21.15.53:0/4117201279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d81a2610 con 0x7f83d80754f0 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.384+0000 7f83ce7fc640 1 -- 172.21.15.53:0/4117201279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4004c60 con 0x7f83d80754f0 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.384+0000 7f83df619640 1 -- 172.21.15.53:0/4117201279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d81a8d70 con 0x7f83d80754f0 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.387+0000 7f83e5b8e740 1 Processor -- start 2024-08-31T06:12:10.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.387+0000 7f83e5b8e740 1 -- start start 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.387+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f7407520 0x5632f77acc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.387+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73de660 0x5632f77ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.387+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f73e6840 0x5632f77ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.387+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5632f7723a70 con 0x5632f7407520 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.387+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5632f7713000 con 0x5632f73e6840 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.387+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5632f7716fb0 con 0x5632f73de660 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.387+0000 7f83ce7fc640 1 -- 172.21.15.53:0/4117201279 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f83d4004e00 con 0x7f83d80754f0 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.387+0000 7f83ddbb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f7407520 0x5632f77acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.387+0000 7f83ddbb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f7407520 0x5632f77acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42808/0 (socket says 172.21.15.53:42808) 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83ddbb6640 1 -- 172.21.15.53:0/2627215085 learned_addr learned my addr 172.21.15.53:0/2627215085 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/2627215085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f73e6840 0x5632f77ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83dd3b5640 1 --2- 172.21.15.53:0/2627215085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73de660 0x5632f77ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83ddbb6640 1 -- 172.21.15.53:0/2627215085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73de660 msgr2=0x5632f77ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/2627215085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73de660 0x5632f77ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83ddbb6640 1 -- 172.21.15.53:0/2627215085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f73e6840 msgr2=0x5632f77ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/2627215085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f73e6840 0x5632f77ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83ddbb6640 1 -- 172.21.15.53:0/2627215085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632f7472b00 con 0x5632f7407520 2024-08-31T06:12:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/2627215085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f73e6840 0x5632f77ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83dd3b5640 1 --2- 172.21.15.53:0/2627215085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73de660 0x5632f77ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/2627215085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f7407520 0x5632f77acc80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f83d000ae10 tx=0x7f83d000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a47e9bd0565f64d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83c37fe640 1 -- 172.21.15.53:0/2627215085 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0003b70 con 0x5632f7407520 2024-08-31T06:12:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83ce7fc640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83c40b4d20 0x7f83c40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83c37fe640 1 -- 172.21.15.53:0/2627215085 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83d0003d10 con 0x5632f7407520 2024-08-31T06:12:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83c37fe640 1 -- 172.21.15.53:0/2627215085 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0010930 con 0x5632f7407520 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.388+0000 7f83dd3b5640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83c40b4d20 0x7f83c40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.389+0000 7f83ce7fc640 1 -- 172.21.15.53:0/4117201279 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f83d40e4ea0 con 0x7f83d80754f0 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.389+0000 7f83e5b8e740 1 -- 172.21.15.53:0/2627215085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f7407520 msgr2=0x5632f77acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.389+0000 7f83dd3b5640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83c40b4d20 0x7f83c40b7230 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f83d40e2680 tx=0x7f83d40ce040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.389+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/2627215085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f7407520 0x5632f77acc80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f83d000ae10 tx=0x7f83d000f790 comp rx=0 tx=0).stop 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.389+0000 7f83e5b8e740 1 -- 172.21.15.53:0/2627215085 shutdown_connections 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.389+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/2627215085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f73e6840 0x5632f77ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.389+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/2627215085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73de660 0x5632f77ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.389+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/2627215085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f7407520 0x5632f77acc80 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.389+0000 7f83e5b8e740 1 -- 172.21.15.53:0/2627215085 >> 172.21.15.53:0/2627215085 conn(0x5632f73fb910 msgr2=0x5632f77aab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.389+0000 7f83e5b8e740 1 -- 172.21.15.53:0/2627215085 shutdown_connections 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.389+0000 7f83e5b8e740 1 -- 172.21.15.53:0/2627215085 wait complete. 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.390+0000 7f83e5b8e740 1 -- start start 2024-08-31T06:12:10.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.390+0000 7f83e5b8e740 1 Processor -- start 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.390+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77b8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.390+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f73e6840 0x5632f77b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.390+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f7407520 0x5632f77c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.390+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5632f77bb460 con 0x5632f73de660 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.390+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5632f76d4520 con 0x5632f73e6840 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.390+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5632f77bb5e0 con 0x5632f7407520 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.390+0000 7f83e5b8e740 10 client.0 _ll_register_callbacks cb 0x5632f770cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.390+0000 7f83ddbb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83ddbb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77b8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42820/0 (socket says 172.21.15.53:42820) 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83ddbb6640 1 -- 172.21.15.53:0/3146961337 learned_addr learned my addr 172.21.15.53:0/3146961337 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f7407520 0x5632f77c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f73e6840 0x5632f77b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83ddbb6640 1 -- 172.21.15.53:0/3146961337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f7407520 msgr2=0x5632f77c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f7407520 0x5632f77c48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83ddbb6640 1 -- 172.21.15.53:0/3146961337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f73e6840 msgr2=0x5632f77b8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f73e6840 0x5632f77b8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83ddbb6640 1 -- 172.21.15.53:0/3146961337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632f74e9960 con 0x5632f73de660 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77b8820 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f83d000afa0 tx=0x7f83d0005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f0672e6a4e05c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83c0ff9640 1 -- 172.21.15.53:0/3146961337 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d002c060 con 0x5632f73de660 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83e5b8e740 1 -- 172.21.15.53:0/3146961337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5632f76b29a0 con 0x5632f73de660 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.391+0000 7f83c0ff9640 1 -- 172.21.15.53:0/3146961337 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f83d0005040 con 0x5632f73de660 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83c0ff9640 1 -- 172.21.15.53:0/3146961337 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f83d0005240 con 0x5632f73de660 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83e5b8e740 10 client.17865 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83e5b8e740 1 -- 172.21.15.53:0/3146961337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5632f77c7560 con 0x5632f73de660 2024-08-31T06:12:10.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83c0ff9640 1 -- 172.21.15.53:0/3146961337 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5632f76b29a0 con 0x5632f73de660 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83c0ff9640 1 -- 172.21.15.53:0/3146961337 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f83d0024040 con 0x5632f73de660 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83e5b8e740 10 client.17865 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83e5b8e740 10 client.17865 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83e5b8e740 20 client.17865 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632f73c5ea0 0x5632f77ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83e5b8e740 4 client.17865 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83e5b8e740 1 -- 172.21.15.53:0/3146961337 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632f77259c0 con 0x5632f73c5ea0 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.392+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632f73c5ea0 0x5632f77ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.393+0000 7f83c0ff9640 10 client.17865 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.393+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632f73c5ea0 0x5632f77ca9d0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21ff2ec1e8b12e9a server_cookie=dffcf4fcb07fbe61 in_seq=0 out_seq=0 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83c0ff9640 1 -- 172.21.15.53:0/3146961337 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5632f77259c0 con 0x5632f73c5ea0 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83c0ff9640 10 client.17865 handle_command_reply: tid=0 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 1 client.17865 shutdown 2024-08-31T06:12:10.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 1 -- 172.21.15.53:0/3146961337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 msgr2=0x5632f77b8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:10.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77b8820 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f83d000afa0 tx=0x7f83d0005fa0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 1 -- 172.21.15.53:0/3146961337 shutdown_connections 2024-08-31T06:12:10.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632f73c5ea0 0x5632f77ca9d0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f7407520 0x5632f77c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83c0ff9640 0 client.17865 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:10.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f73e6840 0x5632f77b8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/3146961337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77b8820 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 1 -- 172.21.15.53:0/3146961337 >> 172.21.15.53:0/3146961337 conn(0x5632f73fb910 msgr2=0x5632f77afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:10.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 1 -- 172.21.15.53:0/3146961337 shutdown_connections 2024-08-31T06:12:10.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 1 -- 172.21.15.53:0/3146961337 wait complete. 2024-08-31T06:12:10.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.394+0000 7f83e5b8e740 20 client.17865 trim_cache size 0 max 16384 2024-08-31T06:12:10.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.412+0000 7f83e5b8e740 1 Processor -- start 2024-08-31T06:12:10.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.412+0000 7f83e5b8e740 1 -- start start 2024-08-31T06:12:10.414 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:10 smithi053 ceph-mon[18924]: pgmap v542: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-08-31T06:12:10.414 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:10 smithi053 ceph-mon[18924]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T06:12:10.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.412+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.412+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 0x5632f77c4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.412+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f7407520 0x5632f77c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.412+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f83d81b1740 con 0x5632f73de660 2024-08-31T06:12:10.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.412+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f83d81b3280 con 0x5632f7407520 2024-08-31T06:12:10.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.412+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f83d81b1e10 con 0x5632f73e6840 2024-08-31T06:12:10.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83ddbb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83ddbb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42824/0 (socket says 172.21.15.53:42824) 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83ddbb6640 1 -- 172.21.15.53:0/4105846300 learned_addr learned my addr 172.21.15.53:0/4105846300 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/4105846300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 0x5632f77c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/4105846300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f7407520 0x5632f77c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83ddbb6640 1 -- 172.21.15.53:0/4105846300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 msgr2=0x5632f77c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/4105846300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 0x5632f77c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83ddbb6640 1 -- 172.21.15.53:0/4105846300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f7407520 msgr2=0x5632f77c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/4105846300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f7407520 0x5632f77c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83ddbb6640 1 -- 172.21.15.53:0/4105846300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632f77b98e0 con 0x5632f73de660 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/4105846300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 0x5632f77c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.413+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/4105846300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77aaab0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f83d000fd10 tx=0x7f83d0010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea742311339eee9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.414+0000 7f83c2ffd640 1 -- 172.21.15.53:0/4105846300 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d002c070 con 0x5632f73de660 2024-08-31T06:12:10.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.414+0000 7f83c2ffd640 1 -- 172.21.15.53:0/4105846300 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83d0026e80 con 0x5632f73de660 2024-08-31T06:12:10.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.414+0000 7f83c2ffd640 1 -- 172.21.15.53:0/4105846300 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0003bd0 con 0x5632f73de660 2024-08-31T06:12:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.415+0000 7f83e5b8e740 1 -- 172.21.15.53:0/4105846300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 msgr2=0x5632f77aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.415+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/4105846300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77aaab0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f83d000fd10 tx=0x7f83d0010f60 comp rx=0 tx=0).stop 2024-08-31T06:12:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.415+0000 7f83e5b8e740 1 -- 172.21.15.53:0/4105846300 shutdown_connections 2024-08-31T06:12:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.415+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/4105846300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f7407520 0x5632f77c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.415+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/4105846300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 0x5632f77c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.415+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/4105846300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77aaab0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.415+0000 7f83e5b8e740 1 -- 172.21.15.53:0/4105846300 >> 172.21.15.53:0/4105846300 conn(0x5632f73fb910 msgr2=0x5632f77aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:10.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.415+0000 7f83e5b8e740 1 -- 172.21.15.53:0/4105846300 shutdown_connections 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.415+0000 7f83e5b8e740 1 -- 172.21.15.53:0/4105846300 wait complete. 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.415+0000 7f83e5b8e740 1 -- start start 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.415+0000 7f83e5b8e740 1 Processor -- start 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.416+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.416+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 0x5632f77cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.416+0000 7f83e5b8e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f7407520 0x5632f7836a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.416+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f83d81b2bb0 con 0x5632f73de660 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.416+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f83d81b24e0 con 0x5632f7407520 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.416+0000 7f83e5b8e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f83d81af740 con 0x5632f73e6840 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.416+0000 7f83e5b8e740 10 client.0 _ll_register_callbacks cb 0x7f83d000ac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.416+0000 7f83ddbb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.416+0000 7f83ddbb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42840/0 (socket says 172.21.15.53:42840) 2024-08-31T06:12:10.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.416+0000 7f83ddbb6640 1 -- 172.21.15.53:0/274811537 learned_addr learned my addr 172.21.15.53:0/274811537 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.416+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f7407520 0x5632f7836a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 0x5632f77cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83ddbb6640 1 -- 172.21.15.53:0/274811537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 msgr2=0x5632f77cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 0x5632f77cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83ddbb6640 1 -- 172.21.15.53:0/274811537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f7407520 msgr2=0x5632f7836a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f7407520 0x5632f7836a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83ddbb6640 1 -- 172.21.15.53:0/274811537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632f7837070 con 0x5632f73de660 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 0x5632f77cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83ddbb6640 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77cb450 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f83d000afe0 tx=0x7f83d0004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687b16ad3030c86c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83c0ff9640 1 -- 172.21.15.53:0/274811537 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d002c030 con 0x5632f73de660 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83c0ff9640 1 -- 172.21.15.53:0/274811537 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f83d0026c00 con 0x5632f73de660 2024-08-31T06:12:10.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83e5b8e740 1 -- 172.21.15.53:0/274811537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5632f7721460 con 0x5632f73de660 2024-08-31T06:12:10.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83c0ff9640 1 -- 172.21.15.53:0/274811537 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f83d0003970 con 0x5632f73de660 2024-08-31T06:12:10.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83e5b8e740 10 client.17871 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:10.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.417+0000 7f83e5b8e740 1 -- 172.21.15.53:0/274811537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5632f783e3f0 con 0x5632f73de660 2024-08-31T06:12:10.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.418+0000 7f83c0ff9640 1 -- 172.21.15.53:0/274811537 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83d00053e0 con 0x5632f73de660 2024-08-31T06:12:10.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.418+0000 7f83c0ff9640 1 -- 172.21.15.53:0/274811537 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f83d0004020 con 0x5632f73de660 2024-08-31T06:12:10.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.418+0000 7f83e5b8e740 10 client.17871 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:10.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.418+0000 7f83e5b8e740 10 client.17871 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:12:10.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.418+0000 7f83e5b8e740 20 client.17871 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:10.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.418+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632f739b250 0x5632f78409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:10.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.418+0000 7f83e5b8e740 4 client.17871 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "dbdd68df", "release": true, "await": true}] 2024-08-31T06:12:10.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.418+0000 7f83e5b8e740 1 -- 172.21.15.53:0/274811537 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "dbdd68df", "release": true, "await": true}) -- 0x5632f7721460 con 0x5632f739b250 2024-08-31T06:12:10.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.418+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632f739b250 0x5632f78409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:10.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.419+0000 7f83dcbb4640 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632f739b250 0x5632f78409b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b72fcaa868a0fa8 server_cookie=f6503b1b4173f73e in_seq=0 out_seq=0 2024-08-31T06:12:10.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.419+0000 7f83c0ff9640 10 client.17871 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:10.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83c0ff9640 1 -- 172.21.15.53:0/274811537 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5632f7721460 con 0x5632f739b250 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83c0ff9640 10 client.17871 handle_command_reply: tid=0 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 1 client.17871 shutdown 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 1 -- 172.21.15.53:0/274811537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 msgr2=0x5632f77cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77cb450 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f83d000afe0 tx=0x7f83d0004a00 comp rx=0 tx=0).stop 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 1 -- 172.21.15.53:0/274811537 shutdown_connections 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632f739b250 0x5632f78409b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632f7407520 0x5632f7836a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632f73e6840 0x5632f77cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 1 --2- 172.21.15.53:0/274811537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632f73de660 0x5632f77cb450 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83c0ff9640 0 client.17871 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 1 -- 172.21.15.53:0/274811537 >> 172.21.15.53:0/274811537 conn(0x5632f73fb910 msgr2=0x5632f77b9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:10.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 1 -- 172.21.15.53:0/274811537 shutdown_connections 2024-08-31T06:12:10.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 1 -- 172.21.15.53:0/274811537 wait complete. 2024-08-31T06:12:10.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.425+0000 7f83e5b8e740 20 client.17871 trim_cache size 0 max 16384 2024-08-31T06:12:10.429 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:12:10.429 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 36, 2024-08-31T06:12:10.429 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:12:10.429 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 24, 2024-08-31T06:12:10.429 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:12:10.429 INFO:teuthology.orchestra.run.smithi053.stdout: "dbdd68df": { 2024-08-31T06:12:10.429 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 24, 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 148.0, 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:12:10.430 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:12:10.431 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:10.431 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:10.431 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:10.431 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:10.431 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:10.431 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:12:10.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 -- 172.21.15.53:0/4117201279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83c40b4d20 msgr2=0x7f83c40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:10.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83c40b4d20 0x7f83c40b7230 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f83d40e2680 tx=0x7f83d40ce040 comp rx=0 tx=0).stop 2024-08-31T06:12:10.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 -- 172.21.15.53:0/4117201279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d80754f0 msgr2=0x7f83d819c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:10.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d80754f0 0x7f83d819c3b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f83d400d770 tx=0x7f83d400dc30 comp rx=0 tx=0).stop 2024-08-31T06:12:10.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 -- 172.21.15.53:0/4117201279 shutdown_connections 2024-08-31T06:12:10.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83c40b4d20 0x7f83c40b7230 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83d810fec0 0x7f83d81a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83d8075e40 0x7f83d819c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 --2- 172.21.15.53:0/4117201279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d80754f0 0x7f83d819c3b0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:10.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 -- 172.21.15.53:0/4117201279 >> 172.21.15.53:0/4117201279 conn(0x7f83d807b5f0 msgr2=0x7f83d81006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:10.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 -- 172.21.15.53:0/4117201279 shutdown_connections 2024-08-31T06:12:10.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:10.427+0000 7f83df619640 1 -- 172.21.15.53:0/4117201279 wait complete. 2024-08-31T06:12:10.443 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:10.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:10 smithi130 ceph-mon[22266]: pgmap v542: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-08-31T06:12:10.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:10 smithi130 ceph-mon[22266]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T06:12:10.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:10 smithi153 ceph-mon[22320]: pgmap v542: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-08-31T06:12:10.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:10 smithi153 ceph-mon[22320]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T06:12:10.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128189 1.70 MB/sec execute 240 sec latency 26149.358 ms 2024-08-31T06:12:11.130 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'dbdd68df', total seconds elapsed: 31.9 2024-08-31T06:12:11.130 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.0 2024-08-31T06:12:11.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:12:11.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.613+0000 7fd42d811640 1 -- 172.21.15.53:0/63816239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd428106970 msgr2=0x7fd428110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:11.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.613+0000 7fd42d811640 1 --2- 172.21.15.53:0/63816239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd428106970 0x7fd428110400 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd420009ca0 tx=0x7fd42002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.613+0000 7fd42d811640 1 -- 172.21.15.53:0/63816239 shutdown_connections 2024-08-31T06:12:11.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.613+0000 7fd42d811640 1 --2- 172.21.15.53:0/63816239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd428106970 0x7fd428110400 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.613+0000 7fd42d811640 1 --2- 172.21.15.53:0/63816239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd428106020 0x7fd428106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.613+0000 7fd42d811640 1 --2- 172.21.15.53:0/63816239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd428101dd0 0x7fd4281021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.613+0000 7fd42d811640 1 -- 172.21.15.53:0/63816239 >> 172.21.15.53:0/63816239 conn(0x7fd428077a00 msgr2=0x7fd428077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.613+0000 7fd42d811640 1 -- 172.21.15.53:0/63816239 shutdown_connections 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.613+0000 7fd42d811640 1 -- 172.21.15.53:0/63816239 wait complete. 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.614+0000 7fd42d811640 1 Processor -- start 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.614+0000 7fd42d811640 1 -- start start 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.614+0000 7fd42d811640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd428101dd0 0x7fd42819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.614+0000 7fd42d811640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd428106020 0x7fd42819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.614+0000 7fd42d811640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd428106970 0x7fd42819f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.614+0000 7fd42d811640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281136f0 con 0x7fd428106970 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.614+0000 7fd42d811640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd428113570 con 0x7fd428101dd0 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.614+0000 7fd42d811640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd428113870 con 0x7fd428106020 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd4277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd428106970 0x7fd42819f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd4277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd428106970 0x7fd42819f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42856/0 (socket says 172.21.15.53:42856) 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd4277fe640 1 -- 172.21.15.53:0/919317677 learned_addr learned my addr 172.21.15.53:0/919317677 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd426ffd640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd428101dd0 0x7fd42819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd4267fc640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd428106020 0x7fd42819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd4277fe640 1 -- 172.21.15.53:0/919317677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd428106020 msgr2=0x7fd42819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd4277fe640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd428106020 0x7fd42819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd4277fe640 1 -- 172.21.15.53:0/919317677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd428101dd0 msgr2=0x7fd42819a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd4277fe640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd428101dd0 0x7fd42819a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd4277fe640 1 -- 172.21.15.53:0/919317677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4281a00d0 con 0x7fd428106970 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd426ffd640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd428101dd0 0x7fd42819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd4277fe640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd428106970 0x7fd42819f9a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd4200098d0 tx=0x7fd420031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.615+0000 7fd42c80f640 1 -- 172.21.15.53:0/919317677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420003c30 con 0x7fd428106970 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.616+0000 7fd42d811640 1 -- 172.21.15.53:0/919317677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4281a0360 con 0x7fd428106970 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.616+0000 7fd42c80f640 1 -- 172.21.15.53:0/919317677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd420003dd0 con 0x7fd428106970 2024-08-31T06:12:11.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.616+0000 7fd42c80f640 1 -- 172.21.15.53:0/919317677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420004710 con 0x7fd428106970 2024-08-31T06:12:11.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.616+0000 7fd42d811640 1 -- 172.21.15.53:0/919317677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4281a6b20 con 0x7fd428106970 2024-08-31T06:12:11.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.619+0000 7fd42c80f640 1 -- 172.21.15.53:0/919317677 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd4200306f0 con 0x7fd428106970 2024-08-31T06:12:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.619+0000 7fd433d86740 1 Processor -- start 2024-08-31T06:12:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.619+0000 7fd433d86740 1 -- start start 2024-08-31T06:12:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd42c80f640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4100b4ca0 0x7fd4100b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd4267fc640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4100b4ca0 0x7fd4100b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd433d86740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ef0070 0x558992295310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd42c80f640 1 -- 172.21.15.53:0/919317677 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fd420106410 con 0x7fd428106970 2024-08-31T06:12:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd433d86740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x558992295850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd433d86740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x558992295d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd433d86740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55899220c680 con 0x558991ec71b0 2024-08-31T06:12:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd433d86740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5589921fbc10 con 0x558991ecf390 2024-08-31T06:12:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd433d86740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5589921ffbc0 con 0x558991ef0070 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd4277fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x558992295d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd4277fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x558992295d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:59660/0 (socket says 172.21.15.53:59660) 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd4277fe640 1 -- 172.21.15.53:0/976032760 learned_addr learned my addr 172.21.15.53:0/976032760 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.620+0000 7fd426ffd640 1 --2- 172.21.15.53:0/976032760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ef0070 0x558992295310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd4277fe640 1 -- 172.21.15.53:0/976032760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ef0070 msgr2=0x558992295310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd4277fe640 1 --2- 172.21.15.53:0/976032760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ef0070 0x558992295310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd4277fe640 1 -- 172.21.15.53:0/976032760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 msgr2=0x558992295850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd4267fc640 1 --2- 172.21.15.53:0/976032760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x558992295850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd4277fe640 1 --2- 172.21.15.53:0/976032760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x558992295850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd4277fe640 1 -- 172.21.15.53:0/976032760 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558991f5b650 con 0x558991ecf390 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd4267fc640 1 --2- 172.21.15.53:0/976032760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x558992295850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd4277fe640 1 --2- 172.21.15.53:0/976032760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x558992295d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd4200cc870 tx=0x7fd4200cc580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4091bfb33f795a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd4267fc640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4100b4ca0 0x7fd4100b71b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd42810a130 tx=0x7fd41c014840 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd40dffb640 1 -- 172.21.15.53:0/976032760 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4200b4110 con 0x558991ecf390 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd40dffb640 1 -- 172.21.15.53:0/976032760 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd420036040 con 0x558991ecf390 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.621+0000 7fd40dffb640 1 -- 172.21.15.53:0/976032760 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4200d5e00 con 0x558991ecf390 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.622+0000 7fd433d86740 1 -- 172.21.15.53:0/976032760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 msgr2=0x558992295d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.622+0000 7fd433d86740 1 --2- 172.21.15.53:0/976032760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x558992295d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd4200cc870 tx=0x7fd4200cc580 comp rx=0 tx=0).stop 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.622+0000 7fd433d86740 1 -- 172.21.15.53:0/976032760 shutdown_connections 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.622+0000 7fd433d86740 1 --2- 172.21.15.53:0/976032760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x558992295d90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.622+0000 7fd433d86740 1 --2- 172.21.15.53:0/976032760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x558992295850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.622+0000 7fd433d86740 1 --2- 172.21.15.53:0/976032760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ef0070 0x558992295310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.622+0000 7fd433d86740 1 -- 172.21.15.53:0/976032760 >> 172.21.15.53:0/976032760 conn(0x558991ee4460 msgr2=0x558992293200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.623+0000 7fd433d86740 1 -- 172.21.15.53:0/976032760 shutdown_connections 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.623+0000 7fd433d86740 1 -- 172.21.15.53:0/976032760 wait complete. 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.623+0000 7fd433d86740 1 -- start start 2024-08-31T06:12:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.623+0000 7fd433d86740 1 Processor -- start 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd433d86740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ec71b0 0x5589922a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd433d86740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x5589922a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd433d86740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ef0070 0x5589922aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd433d86740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55899205e700 con 0x558991ef0070 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd433d86740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558992182750 con 0x558991ecf390 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd433d86740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5589921fbc10 con 0x558991ec71b0 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd4267fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x5589922a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd433d86740 10 client.0 _ll_register_callbacks cb 0x5589921b1e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd426ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ec71b0 0x5589922a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd4277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ef0070 0x5589922aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd426ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ec71b0 0x5589922a9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:53510/0 (socket says 172.21.15.53:53510) 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd426ffd640 1 -- 172.21.15.53:0/1677289946 learned_addr learned my addr 172.21.15.53:0/1677289946 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd426ffd640 1 -- 172.21.15.53:0/1677289946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 msgr2=0x5589922a9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd426ffd640 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x5589922a9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.624+0000 7fd426ffd640 1 -- 172.21.15.53:0/1677289946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ef0070 msgr2=0x5589922aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.625+0000 7fd426ffd640 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ef0070 0x5589922aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.625+0000 7fd426ffd640 1 -- 172.21.15.53:0/1677289946 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589921bb900 con 0x558991ec71b0 2024-08-31T06:12:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.625+0000 7fd4277fe640 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ef0070 0x5589922aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.625+0000 7fd426ffd640 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ec71b0 0x5589922a9610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd418012d20 tx=0x7fd41800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfc9e7d64202996c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.625+0000 7fd406ffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:12:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.625+0000 7fd406ffd640 1 -- 172.21.15.53:0/1677289946 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4180120d0 con 0x558991ec71b0 2024-08-31T06:12:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.625+0000 7fd406ffd640 1 -- 172.21.15.53:0/1677289946 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fd418010430 con 0x558991ec71b0 2024-08-31T06:12:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.625+0000 7fd433d86740 1 -- 172.21.15.53:0/1677289946 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd420036040 con 0x558991ec71b0 2024-08-31T06:12:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.626+0000 7fd406ffd640 1 -- 172.21.15.53:0/1677289946 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd418012270 con 0x558991ec71b0 2024-08-31T06:12:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.626+0000 7fd433d86740 10 client.27172 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.626+0000 7fd433d86740 1 -- 172.21.15.53:0/1677289946 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5589922b7b30 con 0x558991ec71b0 2024-08-31T06:12:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.626+0000 7fd406ffd640 1 -- 172.21.15.53:0/1677289946 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd420036040 con 0x558991ec71b0 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.626+0000 7fd406ffd640 1 -- 172.21.15.53:0/1677289946 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fd418024620 con 0x558991ec71b0 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.626+0000 7fd433d86740 10 client.27172 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.626+0000 7fd433d86740 10 client.27172 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.626+0000 7fd433d86740 20 client.27172 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.626+0000 7fd433d86740 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x558991eae9f0 0x5589922bb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.626+0000 7fd433d86740 4 client.27172 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.626+0000 7fd433d86740 1 -- 172.21.15.53:0/1677289946 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55899220e5d0 con 0x558991eae9f0 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.627+0000 7fd4267fc640 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x558991eae9f0 0x5589922bb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.627+0000 7fd4267fc640 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x558991eae9f0 0x5589922bb180 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dca89b7f9052e5d5 server_cookie=a42379a8998519c3 in_seq=0 out_seq=0 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.627+0000 7fd406ffd640 10 client.27172 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd406ffd640 1 -- 172.21.15.53:0/1677289946 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55899220e5d0 con 0x558991eae9f0 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd406ffd640 10 client.27172 handle_command_reply: tid=0 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd433d86740 1 client.27172 shutdown 2024-08-31T06:12:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd433d86740 1 -- 172.21.15.53:0/1677289946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ec71b0 msgr2=0x5589922a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd433d86740 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ec71b0 0x5589922a9610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd418012d20 tx=0x7fd41800f790 comp rx=0 tx=0).stop 2024-08-31T06:12:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd433d86740 1 -- 172.21.15.53:0/1677289946 shutdown_connections 2024-08-31T06:12:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd433d86740 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x558991eae9f0 0x5589922bb180 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd433d86740 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ef0070 0x5589922aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd433d86740 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x5589922a9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd406ffd640 0 client.27172 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:12:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd433d86740 1 --2- 172.21.15.53:0/1677289946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991ec71b0 0x5589922a9610 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd433d86740 1 -- 172.21.15.53:0/1677289946 >> 172.21.15.53:0/1677289946 conn(0x558991ee4460 msgr2=0x558992296d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.628+0000 7fd433d86740 1 -- 172.21.15.53:0/1677289946 shutdown_connections 2024-08-31T06:12:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.629+0000 7fd433d86740 1 -- 172.21.15.53:0/1677289946 wait complete. 2024-08-31T06:12:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.629+0000 7fd433d86740 20 client.27172 trim_cache size 0 max 16384 2024-08-31T06:12:11.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd433d86740 1 Processor -- start 2024-08-31T06:12:11.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd433d86740 1 -- start start 2024-08-31T06:12:11.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd433d86740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991eae9f0 0x5589922b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd433d86740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x5589922aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd433d86740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x5589922af150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd426ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991eae9f0 0x5589922b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd4267fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x5589922aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd433d86740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281ad330 con 0x558991ec71b0 2024-08-31T06:12:11.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd426ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991eae9f0 0x5589922b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:53520/0 (socket says 172.21.15.53:53520) 2024-08-31T06:12:11.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd433d86740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281aee70 con 0x558991ecf390 2024-08-31T06:12:11.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd433d86740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281ada00 con 0x558991eae9f0 2024-08-31T06:12:11.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.644+0000 7fd426ffd640 1 -- 172.21.15.53:0/1182424343 learned_addr learned my addr 172.21.15.53:0/1182424343 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:11.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.645+0000 7fd4277fe640 1 --2- 172.21.15.53:0/1182424343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x5589922af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.645+0000 7fd4267fc640 1 -- 172.21.15.53:0/1182424343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991eae9f0 msgr2=0x5589922b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:11.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.645+0000 7fd4267fc640 1 --2- 172.21.15.53:0/1182424343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991eae9f0 0x5589922b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.645+0000 7fd4267fc640 1 -- 172.21.15.53:0/1182424343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 msgr2=0x5589922af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:11.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.645+0000 7fd4267fc640 1 --2- 172.21.15.53:0/1182424343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x5589922af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.645+0000 7fd4267fc640 1 -- 172.21.15.53:0/1182424343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589922a86c0 con 0x558991ec71b0 2024-08-31T06:12:11.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.645+0000 7fd4267fc640 1 --2- 172.21.15.53:0/1182424343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x5589922aec10 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x558992293f90 tx=0x7fd41c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999774f7e6a520c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:11.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.645+0000 7fd40d7fa640 1 -- 172.21.15.53:0/1182424343 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c021e30 con 0x558991ec71b0 2024-08-31T06:12:11.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.645+0000 7fd40d7fa640 1 -- 172.21.15.53:0/1182424343 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd41c0118d0 con 0x558991ec71b0 2024-08-31T06:12:11.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.645+0000 7fd40d7fa640 1 -- 172.21.15.53:0/1182424343 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c020690 con 0x558991ec71b0 2024-08-31T06:12:11.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.646+0000 7fd433d86740 1 -- 172.21.15.53:0/1182424343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 msgr2=0x5589922aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:11.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.647+0000 7fd433d86740 1 --2- 172.21.15.53:0/1182424343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x5589922aec10 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x558992293f90 tx=0x7fd41c01a000 comp rx=0 tx=0).stop 2024-08-31T06:12:11.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.647+0000 7fd433d86740 1 -- 172.21.15.53:0/1182424343 shutdown_connections 2024-08-31T06:12:11.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.647+0000 7fd433d86740 1 --2- 172.21.15.53:0/1182424343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x5589922af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.647+0000 7fd433d86740 1 --2- 172.21.15.53:0/1182424343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x5589922aec10 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.647+0000 7fd433d86740 1 --2- 172.21.15.53:0/1182424343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991eae9f0 0x5589922b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.647+0000 7fd433d86740 1 -- 172.21.15.53:0/1182424343 >> 172.21.15.53:0/1182424343 conn(0x558991ee4460 msgr2=0x55899229b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:11.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.647+0000 7fd433d86740 1 -- 172.21.15.53:0/1182424343 shutdown_connections 2024-08-31T06:12:11.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.647+0000 7fd433d86740 1 -- 172.21.15.53:0/1182424343 wait complete. 2024-08-31T06:12:11.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.648+0000 7fd433d86740 1 -- start start 2024-08-31T06:12:11.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.648+0000 7fd433d86740 1 Processor -- start 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.648+0000 7fd433d86740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991eae9f0 0x5589922b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.648+0000 7fd433d86740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x5589922b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.648+0000 7fd433d86740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x5589922b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.648+0000 7fd433d86740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281ae7a0 con 0x558991ec71b0 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.648+0000 7fd433d86740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281ae0d0 con 0x558991ecf390 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.648+0000 7fd433d86740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd4281ab330 con 0x558991eae9f0 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.649+0000 7fd433d86740 10 client.0 _ll_register_callbacks cb 0x7fd418009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.649+0000 7fd4267fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x5589922b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.649+0000 7fd4267fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x5589922b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42894/0 (socket says 172.21.15.53:42894) 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.649+0000 7fd4267fc640 1 -- 172.21.15.53:0/804293251 learned_addr learned my addr 172.21.15.53:0/804293251 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.649+0000 7fd4267fc640 1 -- 172.21.15.53:0/804293251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991eae9f0 msgr2=0x5589922b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:11.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.649+0000 7fd4267fc640 1 --2- 172.21.15.53:0/804293251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991eae9f0 0x5589922b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.649+0000 7fd4267fc640 1 -- 172.21.15.53:0/804293251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 msgr2=0x5589922b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:11.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.649+0000 7fd4267fc640 1 --2- 172.21.15.53:0/804293251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x5589922b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.649+0000 7fd4267fc640 1 -- 172.21.15.53:0/804293251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558992324b50 con 0x558991ec71b0 2024-08-31T06:12:11.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.650+0000 7fd4267fc640 1 --2- 172.21.15.53:0/804293251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x5589922b2e70 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd41c004770 tx=0x7fd41c005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a100955bd7b3fc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:11.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.650+0000 7fd406ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:11.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.650+0000 7fd406ffd640 1 -- 172.21.15.53:0/804293251 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c011710 con 0x558991ec71b0 2024-08-31T06:12:11.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.650+0000 7fd406ffd640 1 -- 172.21.15.53:0/804293251 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fd41c011a80 con 0x558991ec71b0 2024-08-31T06:12:11.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.650+0000 7fd433d86740 1 -- 172.21.15.53:0/804293251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd41c0118d0 con 0x558991ec71b0 2024-08-31T06:12:11.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.650+0000 7fd406ffd640 1 -- 172.21.15.53:0/804293251 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd41c039410 con 0x558991ec71b0 2024-08-31T06:12:11.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.650+0000 7fd433d86740 10 client.17886 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:11.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.650+0000 7fd433d86740 1 -- 172.21.15.53:0/804293251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558992325c70 con 0x558991ec71b0 2024-08-31T06:12:11.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.651+0000 7fd406ffd640 1 -- 172.21.15.53:0/804293251 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd41c0118d0 con 0x558991ec71b0 2024-08-31T06:12:11.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.651+0000 7fd406ffd640 1 -- 172.21.15.53:0/804293251 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fd41c01e070 con 0x558991ec71b0 2024-08-31T06:12:11.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.651+0000 7fd433d86740 10 client.17886 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:11.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.651+0000 7fd433d86740 10 client.17886 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:12:11.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.651+0000 7fd433d86740 20 client.17886 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:11.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.651+0000 7fd433d86740 1 --2- 172.21.15.53:0/804293251 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x558991ef0070 0x558992328340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:11.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.652+0000 7fd433d86740 4 client.17886 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:12:11.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.652+0000 7fd433d86740 1 -- 172.21.15.53:0/804293251 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55899220a070 con 0x558991ef0070 2024-08-31T06:12:11.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.652+0000 7fd426ffd640 1 --2- 172.21.15.53:0/804293251 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x558991ef0070 0x558992328340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.652+0000 7fd406ffd640 10 client.17886 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.652+0000 7fd426ffd640 1 --2- 172.21.15.53:0/804293251 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x558991ef0070 0x558992328340 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=44aa3b1ef57ad82 server_cookie=9e27acd404eadf0d in_seq=0 out_seq=0 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd406ffd640 1 -- 172.21.15.53:0/804293251 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55899220a070 con 0x558991ef0070 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd406ffd640 10 client.17886 handle_command_reply: tid=0 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 1 client.17886 shutdown 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 1 -- 172.21.15.53:0/804293251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 msgr2=0x5589922b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 1 --2- 172.21.15.53:0/804293251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x5589922b2e70 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd41c004770 tx=0x7fd41c005c60 comp rx=0 tx=0).stop 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 1 -- 172.21.15.53:0/804293251 shutdown_connections 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 1 --2- 172.21.15.53:0/804293251 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x558991ef0070 0x558992328340 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 1 --2- 172.21.15.53:0/804293251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558991ecf390 0x5589922b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 1 --2- 172.21.15.53:0/804293251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558991ec71b0 0x5589922b2e70 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 1 --2- 172.21.15.53:0/804293251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558991eae9f0 0x5589922b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 1 -- 172.21.15.53:0/804293251 >> 172.21.15.53:0/804293251 conn(0x558991ee4460 msgr2=0x55899229dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:11.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd406ffd640 0 client.17886 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:12:11.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 1 -- 172.21.15.53:0/804293251 shutdown_connections 2024-08-31T06:12:11.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 1 -- 172.21.15.53:0/804293251 wait complete. 2024-08-31T06:12:11.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.653+0000 7fd433d86740 20 client.17886 trim_cache size 0 max 16384 2024-08-31T06:12:11.658 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.654+0000 7fd42d811640 1 -- 172.21.15.53:0/919317677 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4100b4ca0 msgr2=0x7fd4100b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.654+0000 7fd42d811640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4100b4ca0 0x7fd4100b71b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd42810a130 tx=0x7fd41c014840 comp rx=0 tx=0).stop 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.654+0000 7fd42d811640 1 -- 172.21.15.53:0/919317677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd428106970 msgr2=0x7fd42819f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.654+0000 7fd42d811640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd428106970 0x7fd42819f9a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd4200098d0 tx=0x7fd420031f10 comp rx=0 tx=0).stop 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.654+0000 7fd42d811640 1 -- 172.21.15.53:0/919317677 shutdown_connections 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.654+0000 7fd42d811640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd4100b4ca0 0x7fd4100b71b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.654+0000 7fd42d811640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd428106970 0x7fd42819f9a0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.654+0000 7fd42d811640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd428106020 0x7fd42819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.654+0000 7fd42d811640 1 --2- 172.21.15.53:0/919317677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd428101dd0 0x7fd42819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.654+0000 7fd42d811640 1 -- 172.21.15.53:0/919317677 >> 172.21.15.53:0/919317677 conn(0x7fd428077a00 msgr2=0x7fd428107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.655+0000 7fd42d811640 1 -- 172.21.15.53:0/919317677 shutdown_connections 2024-08-31T06:12:11.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:11.655+0000 7fd42d811640 1 -- 172.21.15.53:0/919317677 wait complete. 2024-08-31T06:12:11.664 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:11.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 128554 1.70 MB/sec execute 241 sec latency 20.147 ms 2024-08-31T06:12:12.327 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:12 smithi053 ceph-mon[18924]: pgmap v544: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 81 KiB/s wr, 37 op/s 2024-08-31T06:12:12.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.429+0000 7f0b94acf640 1 -- 172.21.15.53:0/1554318127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b90105120 msgr2=0x7f0b9010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:12.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.429+0000 7f0b94acf640 1 --2- 172.21.15.53:0/1554318127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b90105120 0x7f0b9010d670 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f0b84009900 tx=0x7f0b8402a410 comp rx=0 tx=0).stop 2024-08-31T06:12:12.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.429+0000 7f0b94acf640 1 -- 172.21.15.53:0/1554318127 shutdown_connections 2024-08-31T06:12:12.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.429+0000 7f0b94acf640 1 --2- 172.21.15.53:0/1554318127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9010dc00 0x7f0b901100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:12.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.429+0000 7f0b94acf640 1 --2- 172.21.15.53:0/1554318127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b90105120 0x7f0b9010d670 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:12.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.429+0000 7f0b94acf640 1 --2- 172.21.15.53:0/1554318127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b901047d0 0x7f0b90104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:12.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.429+0000 7f0b94acf640 1 -- 172.21.15.53:0/1554318127 >> 172.21.15.53:0/1554318127 conn(0x7f0b90079530 msgr2=0x7f0b90079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:12.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.429+0000 7f0b94acf640 1 -- 172.21.15.53:0/1554318127 shutdown_connections 2024-08-31T06:12:12.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.429+0000 7f0b94acf640 1 -- 172.21.15.53:0/1554318127 wait complete. 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.430+0000 7f0b94acf640 1 Processor -- start 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.430+0000 7f0b94acf640 1 -- start start 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.430+0000 7f0b94acf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b901047d0 0x7f0b9019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.430+0000 7f0b94acf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b90105120 0x7f0b9019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.430+0000 7f0b94acf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b9010dc00 0x7f0b9019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.430+0000 7f0b94acf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0b901136b0 con 0x7f0b901047d0 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.430+0000 7f0b94acf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b90113530 con 0x7f0b9010dc00 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.430+0000 7f0b94acf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0b90113830 con 0x7f0b90105120 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b901047d0 0x7f0b9019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b901047d0 0x7f0b9019a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42918/0 (socket says 172.21.15.53:42918) 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8e59c640 1 -- 172.21.15.53:0/3461279023 learned_addr learned my addr 172.21.15.53:0/3461279023 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8dd9b640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b90105120 0x7f0b9019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8ed9d640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b9010dc00 0x7f0b9019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8e59c640 1 -- 172.21.15.53:0/3461279023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b90105120 msgr2=0x7f0b9019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8e59c640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b90105120 0x7f0b9019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8e59c640 1 -- 172.21.15.53:0/3461279023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b9010dc00 msgr2=0x7f0b9019f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8e59c640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b9010dc00 0x7f0b9019f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8e59c640 1 -- 172.21.15.53:0/3461279023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b901a00f0 con 0x7f0b901047d0 2024-08-31T06:12:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8ed9d640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b9010dc00 0x7f0b9019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b8e59c640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b901047d0 0x7f0b9019a180 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000e9f0 tx=0x7f0b8000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b7f7fe640 1 -- 172.21.15.53:0/3461279023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000cd80 con 0x7f0b901047d0 2024-08-31T06:12:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b7f7fe640 1 -- 172.21.15.53:0/3461279023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b800108c0 con 0x7f0b901047d0 2024-08-31T06:12:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b94acf640 1 -- 172.21.15.53:0/3461279023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b901a03e0 con 0x7f0b901047d0 2024-08-31T06:12:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.431+0000 7f0b7f7fe640 1 -- 172.21.15.53:0/3461279023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b800187c0 con 0x7f0b901047d0 2024-08-31T06:12:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.432+0000 7f0b94acf640 1 -- 172.21.15.53:0/3461279023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b901a6b40 con 0x7f0b901047d0 2024-08-31T06:12:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.433+0000 7f0b94acf640 1 -- 172.21.15.53:0/3461279023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b90104be0 con 0x7f0b901047d0 2024-08-31T06:12:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.435+0000 7f0b7f7fe640 1 -- 172.21.15.53:0/3461279023 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0b80010430 con 0x7f0b901047d0 2024-08-31T06:12:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.436+0000 7f0b7f7fe640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 0x7f0b780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.436+0000 7f0b8dd9b640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 0x7f0b780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.436+0000 7f0b7f7fe640 1 -- 172.21.15.53:0/3461279023 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f0b800e5e60 con 0x7f0b901047d0 2024-08-31T06:12:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.437+0000 7f0b8dd9b640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 0x7f0b780b71b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005940 tx=0x7f0b840058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.440+0000 7f0b7f7fe640 1 -- 172.21.15.53:0/3461279023 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0b800acc30 con 0x7f0b901047d0 2024-08-31T06:12:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:12 smithi130 ceph-mon[22266]: pgmap v544: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 81 KiB/s wr, 37 op/s 2024-08-31T06:12:12.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:12 smithi153 ceph-mon[22320]: pgmap v544: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 81 KiB/s wr, 37 op/s 2024-08-31T06:12:12.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.685+0000 7f0b94acf640 1 -- 172.21.15.53:0/3461279023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b9019b2b0 con 0x7f0b901047d0 2024-08-31T06:12:12.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.686+0000 7f0b7f7fe640 1 -- 172.21.15.53:0/3461279023 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11985 (secure 0 0 0) 0x7f0b9019b2b0 con 0x7f0b901047d0 2024-08-31T06:12:12.688 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:12:12.688 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":36,"btime":"2024-08-31T06:11:22:133856+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:11:21.364258+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:12:12.689 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 36 2024-08-31T06:12:12.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 -- 172.21.15.53:0/3461279023 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 msgr2=0x7f0b780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:12.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 0x7f0b780b71b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005940 tx=0x7f0b840058d0 comp rx=0 tx=0).stop 2024-08-31T06:12:12.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 -- 172.21.15.53:0/3461279023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b901047d0 msgr2=0x7f0b9019a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:12.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b901047d0 0x7f0b9019a180 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000e9f0 tx=0x7f0b8000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:12:12.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 -- 172.21.15.53:0/3461279023 shutdown_connections 2024-08-31T06:12:12.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 0x7f0b780b71b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:12.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b9010dc00 0x7f0b9019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:12.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b90105120 0x7f0b9019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:12.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 --2- 172.21.15.53:0/3461279023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b901047d0 0x7f0b9019a180 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:12.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 -- 172.21.15.53:0/3461279023 >> 172.21.15.53:0/3461279023 conn(0x7f0b90079530 msgr2=0x7f0b90100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:12.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 -- 172.21.15.53:0/3461279023 shutdown_connections 2024-08-31T06:12:12.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:12.688+0000 7f0b94acf640 1 -- 172.21.15.53:0/3461279023 wait complete. 2024-08-31T06:12:12.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:12:12.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 129012 1.70 MB/sec execute 242 sec latency 19.452 ms 2024-08-31T06:12:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.459+0000 7f38eaaf2640 1 -- 172.21.15.53:0/3765751446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38e4102770 msgr2=0x7f38e4102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.459+0000 7f38eaaf2640 1 --2- 172.21.15.53:0/3765751446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38e4102770 0x7f38e4102b80 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009900 tx=0x7f38d802a410 comp rx=0 tx=0).stop 2024-08-31T06:12:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.459+0000 7f38eaaf2640 1 -- 172.21.15.53:0/3765751446 shutdown_connections 2024-08-31T06:12:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.459+0000 7f38eaaf2640 1 --2- 172.21.15.53:0/3765751446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38e41089f0 0x7f38e410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.459+0000 7f38eaaf2640 1 --2- 172.21.15.53:0/3765751446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38e41080a0 0x7f38e41084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.459+0000 7f38eaaf2640 1 --2- 172.21.15.53:0/3765751446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38e4102770 0x7f38e4102b80 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.459+0000 7f38eaaf2640 1 -- 172.21.15.53:0/3765751446 >> 172.21.15.53:0/3765751446 conn(0x7f38e40fe1b0 msgr2=0x7f38e4100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.459+0000 7f38eaaf2640 1 -- 172.21.15.53:0/3765751446 shutdown_connections 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.459+0000 7f38eaaf2640 1 -- 172.21.15.53:0/3765751446 wait complete. 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.459+0000 7f38eaaf2640 1 Processor -- start 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.459+0000 7f38eaaf2640 1 -- start start 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38eaaf2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38e4102770 0x7f38e40fe6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38eaaf2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38e41080a0 0x7f38e40fec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38eaaf2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38e41089f0 0x7f38e40ff160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38eaaf2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38e4112570 con 0x7f38e4102770 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38eaaf2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38e41123f0 con 0x7f38e41080a0 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38eaaf2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38e41126f0 con 0x7f38e41089f0 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e888e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38e4102770 0x7f38e40fe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e888e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38e4102770 0x7f38e40fe6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38952/0 (socket says 172.21.15.53:38952) 2024-08-31T06:12:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e888e640 1 -- 172.21.15.53:0/750725347 learned_addr learned my addr 172.21.15.53:0/750725347 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e3fff640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38e41080a0 0x7f38e40fec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e908f640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38e41089f0 0x7f38e40ff160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e888e640 1 -- 172.21.15.53:0/750725347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38e41089f0 msgr2=0x7f38e40ff160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e888e640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38e41089f0 0x7f38e40ff160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e888e640 1 -- 172.21.15.53:0/750725347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38e41080a0 msgr2=0x7f38e40fec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e888e640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38e41080a0 0x7f38e40fec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e888e640 1 -- 172.21.15.53:0/750725347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e41a83f0 con 0x7f38e4102770 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e888e640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38e4102770 0x7f38e40fe6e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009230 tx=0x7f38d80319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e1ffb640 1 -- 172.21.15.53:0/750725347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d803f030 con 0x7f38e4102770 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.460+0000 7f38e1ffb640 1 -- 172.21.15.53:0/750725347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38d80043d0 con 0x7f38e4102770 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.461+0000 7f38e1ffb640 1 -- 172.21.15.53:0/750725347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8035070 con 0x7f38e4102770 2024-08-31T06:12:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.461+0000 7f38eaaf2640 1 -- 172.21.15.53:0/750725347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e41a8680 con 0x7f38e4102770 2024-08-31T06:12:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.461+0000 7f38eaaf2640 1 -- 172.21.15.53:0/750725347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e41a8bc0 con 0x7f38e4102770 2024-08-31T06:12:13.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.463+0000 7f38f1a61740 1 Processor -- start 2024-08-31T06:12:13.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.463+0000 7f38f1a61740 1 -- start start 2024-08-31T06:12:13.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.463+0000 7f38e1ffb640 1 -- 172.21.15.53:0/750725347 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f38d8042030 con 0x7f38e4102770 2024-08-31T06:12:13.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.463+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d829ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.463+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 0x55bf1d82a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.463+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d4654d0 0x55bf1d82a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.463+0000 7f38f1a61740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d79f000 con 0x55bf1d45d2f0 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38f1a61740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d78e590 con 0x55bf1d4861b0 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38f1a61740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d792540 con 0x55bf1d4654d0 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e888e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 0x55bf1d82a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e908f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d829ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e888e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 0x55bf1d82a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38958/0 (socket says 172.21.15.53:38958) 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e908f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d829ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60290/0 (socket says 172.21.15.53:60290) 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e888e640 1 -- 172.21.15.53:0/73696722 learned_addr learned my addr 172.21.15.53:0/73696722 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e3fff640 1 --2- 172.21.15.53:0/73696722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d4654d0 0x55bf1d82a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e908f640 1 -- 172.21.15.53:0/73696722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d4654d0 msgr2=0x55bf1d82a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e908f640 1 --2- 172.21.15.53:0/73696722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d4654d0 0x55bf1d82a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e908f640 1 -- 172.21.15.53:0/73696722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 msgr2=0x55bf1d82a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e908f640 1 --2- 172.21.15.53:0/73696722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 0x55bf1d82a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e908f640 1 -- 172.21.15.53:0/73696722 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1d4f1790 con 0x55bf1d4861b0 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38e908f640 1 --2- 172.21.15.53:0/73696722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d829ac0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009f30 tx=0x7f38dc0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8413cf1a50e3e25 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.464+0000 7f38ceffd640 1 -- 172.21.15.53:0/73696722 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc004d20 con 0x55bf1d4861b0 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.465+0000 7f38ceffd640 1 -- 172.21.15.53:0/73696722 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38dc004050 con 0x55bf1d4861b0 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.465+0000 7f38ceffd640 1 -- 172.21.15.53:0/73696722 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc005280 con 0x55bf1d4861b0 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.465+0000 7f38e1ffb640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38d40b4d50 0x7f38d40b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.465+0000 7f38e888e640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38d40b4d50 0x7f38d40b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.465+0000 7f38e1ffb640 1 -- 172.21.15.53:0/750725347 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f38d8105860 con 0x7f38e4102770 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38f1a61740 1 -- 172.21.15.53:0/73696722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 msgr2=0x55bf1d829ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38e888e640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38d40b4d50 0x7f38d40b7260 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f38d80c9250 tx=0x7f38d810b550 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38f1a61740 1 --2- 172.21.15.53:0/73696722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d829ac0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009f30 tx=0x7f38dc0118d0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38f1a61740 1 -- 172.21.15.53:0/73696722 shutdown_connections 2024-08-31T06:12:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38f1a61740 1 --2- 172.21.15.53:0/73696722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d4654d0 0x55bf1d82a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38f1a61740 1 --2- 172.21.15.53:0/73696722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 0x55bf1d82a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38f1a61740 1 --2- 172.21.15.53:0/73696722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d829ac0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38f1a61740 1 -- 172.21.15.53:0/73696722 >> 172.21.15.53:0/73696722 conn(0x55bf1d47a300 msgr2=0x55bf1d8279b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38f1a61740 1 -- 172.21.15.53:0/73696722 shutdown_connections 2024-08-31T06:12:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38f1a61740 1 -- 172.21.15.53:0/73696722 wait complete. 2024-08-31T06:12:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38f1a61740 1 -- start start 2024-08-31T06:12:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.466+0000 7f38f1a61740 1 Processor -- start 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d45d2f0 0x55bf1d8356d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4654d0 0x55bf1d835c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4861b0 0x55bf1d841590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38f1a61740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d6c7ab0 con 0x55bf1d4861b0 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38f1a61740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d715680 con 0x55bf1d4654d0 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38f1a61740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d838240 con 0x55bf1d45d2f0 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38f1a61740 10 client.0 _ll_register_callbacks cb 0x55bf1d49da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38e908f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4861b0 0x55bf1d841590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38e908f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4861b0 0x55bf1d841590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38970/0 (socket says 172.21.15.53:38970) 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38e908f640 1 -- 172.21.15.53:0/3843285369 learned_addr learned my addr 172.21.15.53:0/3843285369 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38e908f640 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d45d2f0 0x55bf1d8356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38e3fff640 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4654d0 0x55bf1d835c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38e908f640 1 -- 172.21.15.53:0/3843285369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d45d2f0 msgr2=0x55bf1d8356d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38e908f640 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d45d2f0 0x55bf1d8356d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38e908f640 1 -- 172.21.15.53:0/3843285369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4654d0 msgr2=0x55bf1d835c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38e908f640 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4654d0 0x55bf1d835c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.467+0000 7f38e908f640 1 -- 172.21.15.53:0/3843285369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf1d56a620 con 0x55bf1d4861b0 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.468+0000 7f38e908f640 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4861b0 0x55bf1d841590 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f38dc004930 tx=0x7f38dc004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f00338c107d000 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.468+0000 7f38c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.468+0000 7f38c3fff640 1 -- 172.21.15.53:0/3843285369 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc02c020 con 0x55bf1d4861b0 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.468+0000 7f38f1a61740 1 -- 172.21.15.53:0/3843285369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38dc004050 con 0x55bf1d4861b0 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.468+0000 7f38c3fff640 1 -- 172.21.15.53:0/3843285369 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f38dc0058e0 con 0x55bf1d4861b0 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.468+0000 7f38c3fff640 1 -- 172.21.15.53:0/3843285369 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f38dc037050 con 0x55bf1d4861b0 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.468+0000 7f38f1a61740 10 client.17904 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.468+0000 7f38f1a61740 1 -- 172.21.15.53:0/3843285369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55bf1d844310 con 0x55bf1d4861b0 2024-08-31T06:12:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.468+0000 7f38c3fff640 1 -- 172.21.15.53:0/3843285369 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38dc004050 con 0x55bf1d4861b0 2024-08-31T06:12:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.468+0000 7f38c3fff640 1 -- 172.21.15.53:0/3843285369 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f38dc028450 con 0x55bf1d4861b0 2024-08-31T06:12:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.469+0000 7f38f1a61740 10 client.17904 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.469+0000 7f38f1a61740 10 client.17904 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.469+0000 7f38f1a61740 20 client.17904 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.469+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bf1d444d80 0x55bf1d847790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.469+0000 7f38f1a61740 4 client.17904 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.469+0000 7f38f1a61740 1 -- 172.21.15.53:0/3843285369 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf1d7a0f50 con 0x55bf1d444d80 2024-08-31T06:12:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.469+0000 7f38e3fff640 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bf1d444d80 0x55bf1d847790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.469+0000 7f38c3fff640 10 client.17904 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.469+0000 7f38e3fff640 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bf1d444d80 0x55bf1d847790 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a6275cec2c0c09e server_cookie=d070ea9e88b6539d in_seq=0 out_seq=0 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38c3fff640 1 -- 172.21.15.53:0/3843285369 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bf1d7a0f50 con 0x55bf1d444d80 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38c3fff640 10 client.17904 handle_command_reply: tid=0 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 1 client.17904 shutdown 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 1 -- 172.21.15.53:0/3843285369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4861b0 msgr2=0x55bf1d841590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4861b0 0x55bf1d841590 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f38dc004930 tx=0x7f38dc004990 comp rx=0 tx=0).stop 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 1 -- 172.21.15.53:0/3843285369 shutdown_connections 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bf1d444d80 0x55bf1d847790 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4861b0 0x55bf1d841590 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4654d0 0x55bf1d835c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38c3fff640 0 client.17904 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3843285369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d45d2f0 0x55bf1d8356d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 1 -- 172.21.15.53:0/3843285369 >> 172.21.15.53:0/3843285369 conn(0x55bf1d47a300 msgr2=0x55bf1d82aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 1 -- 172.21.15.53:0/3843285369 shutdown_connections 2024-08-31T06:12:13.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 1 -- 172.21.15.53:0/3843285369 wait complete. 2024-08-31T06:12:13.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.470+0000 7f38f1a61740 20 client.17904 trim_cache size 0 max 16384 2024-08-31T06:12:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.487+0000 7f38f1a61740 1 Processor -- start 2024-08-31T06:12:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.487+0000 7f38f1a61740 1 -- start start 2024-08-31T06:12:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.487+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 0x55bf1d82eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.487+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d4654d0 0x55bf1d82f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.487+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d834990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.487+0000 7f38f1a61740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38e41b16e0 con 0x55bf1d45d2f0 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.487+0000 7f38f1a61740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38e41b3220 con 0x55bf1d4861b0 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.487+0000 7f38f1a61740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38e41b1db0 con 0x55bf1d4654d0 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.487+0000 7f38e908f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 0x55bf1d82eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.487+0000 7f38e908f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 0x55bf1d82eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38978/0 (socket says 172.21.15.53:38978) 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.487+0000 7f38e908f640 1 -- 172.21.15.53:0/518541958 learned_addr learned my addr 172.21.15.53:0/518541958 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.488+0000 7f38e3fff640 1 --2- 172.21.15.53:0/518541958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d4654d0 0x55bf1d82f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.488+0000 7f38e908f640 1 --2- 172.21.15.53:0/518541958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d834990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.488+0000 7f38e908f640 1 -- 172.21.15.53:0/518541958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d4654d0 msgr2=0x55bf1d82f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.488+0000 7f38e908f640 1 --2- 172.21.15.53:0/518541958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d4654d0 0x55bf1d82f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.488+0000 7f38e908f640 1 -- 172.21.15.53:0/518541958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 msgr2=0x55bf1d834990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.488+0000 7f38e908f640 1 --2- 172.21.15.53:0/518541958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d834990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.488+0000 7f38e908f640 1 -- 172.21.15.53:0/518541958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1d82c8d0 con 0x55bf1d45d2f0 2024-08-31T06:12:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.488+0000 7f38e908f640 1 --2- 172.21.15.53:0/518541958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 0x55bf1d82eb80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009560 tx=0x7f38dc005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1300a04cd21662 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.488+0000 7f38ce7fc640 1 -- 172.21.15.53:0/518541958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc02c070 con 0x55bf1d45d2f0 2024-08-31T06:12:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.488+0000 7f38ce7fc640 1 -- 172.21.15.53:0/518541958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38dc028450 con 0x55bf1d45d2f0 2024-08-31T06:12:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.488+0000 7f38ce7fc640 1 -- 172.21.15.53:0/518541958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc004a00 con 0x55bf1d45d2f0 2024-08-31T06:12:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.489+0000 7f38f1a61740 1 -- 172.21.15.53:0/518541958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 msgr2=0x55bf1d82eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.489+0000 7f38f1a61740 1 --2- 172.21.15.53:0/518541958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 0x55bf1d82eb80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009560 tx=0x7f38dc005cf0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.489+0000 7f38f1a61740 1 -- 172.21.15.53:0/518541958 shutdown_connections 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.489+0000 7f38f1a61740 1 --2- 172.21.15.53:0/518541958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d834990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.489+0000 7f38f1a61740 1 --2- 172.21.15.53:0/518541958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d4654d0 0x55bf1d82f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.489+0000 7f38f1a61740 1 --2- 172.21.15.53:0/518541958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d45d2f0 0x55bf1d82eb80 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.489+0000 7f38f1a61740 1 -- 172.21.15.53:0/518541958 >> 172.21.15.53:0/518541958 conn(0x55bf1d47a300 msgr2=0x55bf1d833d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.489+0000 7f38f1a61740 1 -- 172.21.15.53:0/518541958 shutdown_connections 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.489+0000 7f38f1a61740 1 -- 172.21.15.53:0/518541958 wait complete. 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.489+0000 7f38f1a61740 1 -- start start 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.489+0000 7f38f1a61740 1 Processor -- start 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d45d2f0 0x55bf1d838e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4654d0 0x55bf1d8393d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38f1a61740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d8a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38f1a61740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38e41b2b50 con 0x55bf1d4654d0 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38f1a61740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38e41b2480 con 0x55bf1d4861b0 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38f1a61740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38e41af6e0 con 0x55bf1d45d2f0 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38f1a61740 10 client.0 _ll_register_callbacks cb 0x7f38d810b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38e3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4654d0 0x55bf1d8393d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38e3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4654d0 0x55bf1d8393d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38990/0 (socket says 172.21.15.53:38990) 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38e3fff640 1 -- 172.21.15.53:0/3629634276 learned_addr learned my addr 172.21.15.53:0/3629634276 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38e908f640 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d8a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38e908f640 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d45d2f0 0x55bf1d838e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38e3fff640 1 -- 172.21.15.53:0/3629634276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d45d2f0 msgr2=0x55bf1d838e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38e3fff640 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d45d2f0 0x55bf1d838e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38e3fff640 1 -- 172.21.15.53:0/3629634276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 msgr2=0x55bf1d8a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38e3fff640 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d8a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.490+0000 7f38e3fff640 1 -- 172.21.15.53:0/3629634276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf1d8aa660 con 0x55bf1d4654d0 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38e3fff640 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4654d0 0x55bf1d8393d0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f38d0000c00 tx=0x7f38d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc51e83559834e53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38c3fff640 1 -- 172.21.15.53:0/3629634276 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0029060 con 0x55bf1d4654d0 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38c3fff640 1 -- 172.21.15.53:0/3629634276 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f38d0020410 con 0x55bf1d4654d0 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38f1a61740 1 -- 172.21.15.53:0/3629634276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38dc028450 con 0x55bf1d4654d0 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38c3fff640 1 -- 172.21.15.53:0/3629634276 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f38d0020610 con 0x55bf1d4654d0 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38f1a61740 10 client.17910 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38f1a61740 1 -- 172.21.15.53:0/3629634276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55bf1d8b1a40 con 0x55bf1d4654d0 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38c3fff640 1 -- 172.21.15.53:0/3629634276 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38dc028450 con 0x55bf1d4654d0 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38c3fff640 1 -- 172.21.15.53:0/3629634276 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f38d00107d0 con 0x55bf1d4654d0 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38f1a61740 10 client.17910 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38f1a61740 10 client.17910 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38f1a61740 20 client.17910 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bf1d41a1c0 0x55bf1d8b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38f1a61740 4 client.17910 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:12:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.491+0000 7f38f1a61740 1 -- 172.21.15.53:0/3629634276 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bf1d79c9f0 con 0x55bf1d41a1c0 2024-08-31T06:12:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.492+0000 7f38e908f640 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bf1d41a1c0 0x55bf1d8b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.492+0000 7f38e908f640 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bf1d41a1c0 0x55bf1d8b41e0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1dfbdcf08d12231 server_cookie=35bd097a447f2755 in_seq=0 out_seq=0 2024-08-31T06:12:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.492+0000 7f38c3fff640 10 client.17910 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38c3fff640 1 -- 172.21.15.53:0/3629634276 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bf1d79c9f0 con 0x55bf1d41a1c0 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38c3fff640 10 client.17910 handle_command_reply: tid=0 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 1 client.17910 shutdown 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 1 -- 172.21.15.53:0/3629634276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4654d0 msgr2=0x55bf1d8393d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4654d0 0x55bf1d8393d0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f38d0000c00 tx=0x7f38d00042f0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 1 -- 172.21.15.53:0/3629634276 shutdown_connections 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bf1d41a1c0 0x55bf1d8b41e0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bf1d4861b0 0x55bf1d8a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf1d4654d0 0x55bf1d8393d0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 1 --2- 172.21.15.53:0/3629634276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf1d45d2f0 0x55bf1d838e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38c3fff640 0 client.17910 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 1 -- 172.21.15.53:0/3629634276 >> 172.21.15.53:0/3629634276 conn(0x55bf1d47a300 msgr2=0x55bf1d82eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 1 -- 172.21.15.53:0/3629634276 shutdown_connections 2024-08-31T06:12:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 1 -- 172.21.15.53:0/3629634276 wait complete. 2024-08-31T06:12:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.512+0000 7f38f1a61740 20 client.17910 trim_cache size 0 max 16384 2024-08-31T06:12:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:12:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:12:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:12:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:12:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 -- 172.21.15.53:0/750725347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38d40b4d50 msgr2=0x7f38d40b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38d40b4d50 0x7f38d40b7260 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f38d80c9250 tx=0x7f38d810b550 comp rx=0 tx=0).stop 2024-08-31T06:12:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 -- 172.21.15.53:0/750725347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38e4102770 msgr2=0x7f38e40fe6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38e4102770 0x7f38e40fe6e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009230 tx=0x7f38d80319a0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 -- 172.21.15.53:0/750725347 shutdown_connections 2024-08-31T06:12:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38d40b4d50 0x7f38d40b7260 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38e41089f0 0x7f38e40ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38e41080a0 0x7f38e40fec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 --2- 172.21.15.53:0/750725347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38e4102770 0x7f38e40fe6e0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 -- 172.21.15.53:0/750725347 >> 172.21.15.53:0/750725347 conn(0x7f38e40fe1b0 msgr2=0x7f38e406b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 -- 172.21.15.53:0/750725347 shutdown_connections 2024-08-31T06:12:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:13.513+0000 7f38eaaf2640 1 -- 172.21.15.53:0/750725347 wait complete. 2024-08-31T06:12:13.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:13 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3461279023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:13.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:13 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3461279023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:13.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:13 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3461279023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:13.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 129420 1.70 MB/sec execute 243 sec latency 87.142 ms 2024-08-31T06:12:14.362 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:14 smithi053 ceph-mon[18924]: pgmap v545: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 84 KiB/s wr, 35 op/s 2024-08-31T06:12:14.392 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0' 2024-08-31T06:12:14.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0 2024-08-31T06:12:14.490 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:14 smithi130 ceph-mon[22266]: pgmap v545: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 84 KiB/s wr, 35 op/s 2024-08-31T06:12:14.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:14 smithi153 ceph-mon[22320]: pgmap v545: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 84 KiB/s wr, 35 op/s 2024-08-31T06:12:14.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 129977 1.70 MB/sec execute 244 sec latency 34.640 ms 2024-08-31T06:12:15.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.023+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/711075532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c78108140 msgr2=0x7f0c78108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.023+0000 7f0c7e2d3640 1 --2- 172.21.15.53:0/711075532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c78108140 0x7f0c78108550 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009900 tx=0x7f0c6c02a410 comp rx=0 tx=0).stop 2024-08-31T06:12:15.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.023+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/711075532 shutdown_connections 2024-08-31T06:12:15.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.023+0000 7f0c7e2d3640 1 --2- 172.21.15.53:0/711075532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c78108a90 0x7f0c7810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.023+0000 7f0c7e2d3640 1 --2- 172.21.15.53:0/711075532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c78108140 0x7f0c78108550 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.023+0000 7f0c7e2d3640 1 --2- 172.21.15.53:0/711075532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c78102800 0x7f0c78102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.023+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/711075532 >> 172.21.15.53:0/711075532 conn(0x7f0c780794d0 msgr2=0x7f0c780798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.023+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/711075532 shutdown_connections 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.023+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/711075532 wait complete. 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.024+0000 7f0c7e2d3640 1 Processor -- start 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.024+0000 7f0c7e2d3640 1 -- start start 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7e2d3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c78102800 0x7f0c7819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7e2d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c78108140 0x7f0c7819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7e2d3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c78108a90 0x7f0c7819f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7e2d3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0c78112590 con 0x7f0c78108140 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7e2d3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0c78112410 con 0x7f0c78102800 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7e2d3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c78112710 con 0x7f0c78108a90 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c78108140 0x7f0c7819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7c870640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c78108a90 0x7f0c7819f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c78108140 0x7f0c7819a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39016/0 (socket says 172.21.15.53:39016) 2024-08-31T06:12:15.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c777fe640 1 -- 172.21.15.53:0/1516680381 learned_addr learned my addr 172.21.15.53:0/1516680381 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c77fff640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c78102800 0x7f0c7819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7c870640 1 -- 172.21.15.53:0/1516680381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c78102800 msgr2=0x7f0c7819a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7c870640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c78102800 0x7f0c7819a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7c870640 1 -- 172.21.15.53:0/1516680381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c78108140 msgr2=0x7f0c7819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7c870640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c78108140 0x7f0c7819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c7c870640 1 -- 172.21.15.53:0/1516680381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c781a00a0 con 0x7f0c78108a90 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.025+0000 7f0c777fe640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c78108140 0x7f0c7819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.026+0000 7f0c7c870640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c78108a90 0x7f0c7819f970 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009fd0 tx=0x7f0c7000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.026+0000 7f0c757fa640 1 -- 172.21.15.53:0/1516680381 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000ce20 con 0x7f0c78108a90 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.026+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/1516680381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c781a0390 con 0x7f0c78108a90 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.026+0000 7f0c757fa640 1 -- 172.21.15.53:0/1516680381 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c70005020 con 0x7f0c78108a90 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.026+0000 7f0c757fa640 1 -- 172.21.15.53:0/1516680381 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70010690 con 0x7f0c78108a90 2024-08-31T06:12:15.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.026+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/1516680381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c781a6af0 con 0x7f0c78108a90 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c757fa640 1 -- 172.21.15.53:0/1516680381 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0c70010830 con 0x7f0c78108a90 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c84848740 1 Processor -- start 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c84848740 1 -- start start 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c84848740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290866e070 0x562908a13310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c84848740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 0x562908a13850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c84848740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 0x562908a13d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c84848740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56290898a680 con 0x56290866e070 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c84848740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562908979c10 con 0x56290864d390 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c84848740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56290897dbc0 con 0x5629086451b0 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290866e070 0x562908a13310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290866e070 0x562908a13310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39024/0 (socket says 172.21.15.53:39024) 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c777fe640 1 -- 172.21.15.53:0/303958636 learned_addr learned my addr 172.21.15.53:0/303958636 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:15.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c77fff640 1 --2- 172.21.15.53:0/303958636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 0x562908a13850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.029+0000 7f0c777fe640 1 --2- 172.21.15.53:0/303958636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 0x562908a13d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c77fff640 1 -- 172.21.15.53:0/303958636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 msgr2=0x562908a13d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c77fff640 1 --2- 172.21.15.53:0/303958636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 0x562908a13d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c77fff640 1 -- 172.21.15.53:0/303958636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290866e070 msgr2=0x562908a13310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c77fff640 1 --2- 172.21.15.53:0/303958636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290866e070 0x562908a13310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c77fff640 1 -- 172.21.15.53:0/303958636 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629086d9650 con 0x5629086451b0 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c777fe640 1 --2- 172.21.15.53:0/303958636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 0x562908a13d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c757fa640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0c600b4ca0 0x7f0c600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c777fe640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0c600b4ca0 0x7f0c600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c77fff640 1 --2- 172.21.15.53:0/303958636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 0x562908a13850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009ba0 tx=0x7f0c6800e780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=181ed15e3e0c3b36 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c5e7fc640 1 -- 172.21.15.53:0/303958636 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68010430 con 0x5629086451b0 2024-08-31T06:12:15.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c757fa640 1 -- 172.21.15.53:0/1516680381 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f0c700e5bf0 con 0x7f0c78108a90 2024-08-31T06:12:15.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c5e7fc640 1 -- 172.21.15.53:0/303958636 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c68010a60 con 0x5629086451b0 2024-08-31T06:12:15.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.030+0000 7f0c5e7fc640 1 -- 172.21.15.53:0/303958636 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800f9c0 con 0x5629086451b0 2024-08-31T06:12:15.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.031+0000 7f0c84848740 1 -- 172.21.15.53:0/303958636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 msgr2=0x562908a13850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.031+0000 7f0c84848740 1 --2- 172.21.15.53:0/303958636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 0x562908a13850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009ba0 tx=0x7f0c6800e780 comp rx=0 tx=0).stop 2024-08-31T06:12:15.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.031+0000 7f0c777fe640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0c600b4ca0 0x7f0c600b71b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c005de0 tx=0x7f0c6c04a040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.031+0000 7f0c84848740 1 -- 172.21.15.53:0/303958636 shutdown_connections 2024-08-31T06:12:15.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.031+0000 7f0c84848740 1 --2- 172.21.15.53:0/303958636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 0x562908a13d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.031+0000 7f0c84848740 1 --2- 172.21.15.53:0/303958636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 0x562908a13850 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.031+0000 7f0c84848740 1 --2- 172.21.15.53:0/303958636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290866e070 0x562908a13310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.031+0000 7f0c84848740 1 -- 172.21.15.53:0/303958636 >> 172.21.15.53:0/303958636 conn(0x562908662460 msgr2=0x562908a11200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.032+0000 7f0c84848740 1 -- 172.21.15.53:0/303958636 shutdown_connections 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.032+0000 7f0c84848740 1 -- 172.21.15.53:0/303958636 wait complete. 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.033+0000 7f0c84848740 1 -- start start 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.033+0000 7f0c84848740 1 Processor -- start 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c84848740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 0x562908a1ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c84848740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 0x562908a1ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c84848740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56290866e070 0x562908a2aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c84848740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5629087dc700 con 0x5629086451b0 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c84848740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562908900750 con 0x56290864d390 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c84848740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562908a21b90 con 0x56290866e070 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c84848740 10 client.0 _ll_register_callbacks cb 0x56290892fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c777fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 0x562908a1ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c777fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 0x562908a1ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60356/0 (socket says 172.21.15.53:60356) 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c777fe640 1 -- 172.21.15.53:0/715407355 learned_addr learned my addr 172.21.15.53:0/715407355 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c7c870640 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56290866e070 0x562908a2aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c77fff640 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 0x562908a1ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c777fe640 1 -- 172.21.15.53:0/715407355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56290866e070 msgr2=0x562908a2aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c777fe640 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56290866e070 0x562908a2aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c777fe640 1 -- 172.21.15.53:0/715407355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 msgr2=0x562908a1ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c777fe640 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 0x562908a1ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c777fe640 1 -- 172.21.15.53:0/715407355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562908939900 con 0x56290864d390 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.034+0000 7f0c77fff640 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 0x562908a1ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.035+0000 7f0c777fe640 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 0x562908a1ef90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c004270 tx=0x7f0c6c0058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2422aa842f806c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.035+0000 7f0c577fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.035+0000 7f0c577fe640 1 -- 172.21.15.53:0/715407355 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c057030 con 0x56290864d390 2024-08-31T06:12:15.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.035+0000 7f0c577fe640 1 -- 172.21.15.53:0/715407355 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f0c6c047a70 con 0x56290864d390 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.035+0000 7f0c84848740 1 -- 172.21.15.53:0/715407355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c68010a60 con 0x56290864d390 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.035+0000 7f0c577fe640 1 -- 172.21.15.53:0/715407355 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0c6c035070 con 0x56290864d390 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.035+0000 7f0c84848740 10 client.27221 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.035+0000 7f0c84848740 1 -- 172.21.15.53:0/715407355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562908a2d930 con 0x56290864d390 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.035+0000 7f0c577fe640 1 -- 172.21.15.53:0/715407355 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c68010a60 con 0x56290864d390 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.036+0000 7f0c577fe640 1 -- 172.21.15.53:0/715407355 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f0c6c0646e0 con 0x56290864d390 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.036+0000 7f0c84848740 10 client.27221 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.036+0000 7f0c84848740 10 client.27221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.036+0000 7f0c84848740 20 client.27221 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.036+0000 7f0c84848740 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56290862c9f0 0x562908a30e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.036+0000 7f0c84848740 4 client.27221 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.036+0000 7f0c84848740 1 -- 172.21.15.53:0/715407355 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56290898c5d0 con 0x56290862c9f0 2024-08-31T06:12:15.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.036+0000 7f0c77fff640 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56290862c9f0 0x562908a30e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.037+0000 7f0c577fe640 10 client.27221 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.037+0000 7f0c77fff640 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56290862c9f0 0x562908a30e30 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3ee0729707ba7f6 server_cookie=4f7f679eacdb6775 in_seq=0 out_seq=0 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c577fe640 1 -- 172.21.15.53:0/715407355 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56290898c5d0 con 0x56290862c9f0 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c577fe640 10 client.27221 handle_command_reply: tid=0 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 1 client.27221 shutdown 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 1 -- 172.21.15.53:0/715407355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 msgr2=0x562908a1ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 0x562908a1ef90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c004270 tx=0x7f0c6c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 1 -- 172.21.15.53:0/715407355 shutdown_connections 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56290862c9f0 0x562908a30e30 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56290866e070 0x562908a2aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290864d390 0x562908a1ef90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 1 --2- 172.21.15.53:0/715407355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 0x562908a1ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 1 -- 172.21.15.53:0/715407355 >> 172.21.15.53:0/715407355 conn(0x562908662460 msgr2=0x562908a14340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c577fe640 0 client.27221 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:15.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 1 -- 172.21.15.53:0/715407355 shutdown_connections 2024-08-31T06:12:15.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 1 -- 172.21.15.53:0/715407355 wait complete. 2024-08-31T06:12:15.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.038+0000 7f0c84848740 20 client.27221 trim_cache size 0 max 16384 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.054+0000 7f0c84848740 1 Processor -- start 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.054+0000 7f0c84848740 1 -- start start 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c84848740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 0x562908a20680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c84848740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56290864d390 0x562908a1bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c84848740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290866e070 0x562908a1c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c84848740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0c781ad200 con 0x5629086451b0 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c84848740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0c781aed40 con 0x56290866e070 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c84848740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c781ad8d0 con 0x56290864d390 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c77fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 0x562908a20680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c77fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 0x562908a20680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39038/0 (socket says 172.21.15.53:39038) 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c77fff640 1 -- 172.21.15.53:0/1479521113 learned_addr learned my addr 172.21.15.53:0/1479521113 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c7c870640 1 --2- 172.21.15.53:0/1479521113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290866e070 0x562908a1c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c777fe640 1 --2- 172.21.15.53:0/1479521113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56290864d390 0x562908a1bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c77fff640 1 -- 172.21.15.53:0/1479521113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56290864d390 msgr2=0x562908a1bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c77fff640 1 --2- 172.21.15.53:0/1479521113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56290864d390 0x562908a1bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c77fff640 1 -- 172.21.15.53:0/1479521113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290866e070 msgr2=0x562908a1c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.055+0000 7f0c77fff640 1 --2- 172.21.15.53:0/1479521113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290866e070 0x562908a1c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.056+0000 7f0c77fff640 1 -- 172.21.15.53:0/1479521113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562908a1fd10 con 0x5629086451b0 2024-08-31T06:12:15.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.056+0000 7f0c77fff640 1 --2- 172.21.15.53:0/1479521113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 0x562908a20680 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x562908a11f90 tx=0x7f0c68005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3010c4f0f9a0f544 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.056+0000 7f0c5dffb640 1 -- 172.21.15.53:0/1479521113 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6802d070 con 0x5629086451b0 2024-08-31T06:12:15.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.056+0000 7f0c5dffb640 1 -- 172.21.15.53:0/1479521113 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c680054d0 con 0x5629086451b0 2024-08-31T06:12:15.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.056+0000 7f0c5dffb640 1 -- 172.21.15.53:0/1479521113 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800fc00 con 0x5629086451b0 2024-08-31T06:12:15.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.057+0000 7f0c84848740 1 -- 172.21.15.53:0/1479521113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 msgr2=0x562908a20680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.057+0000 7f0c84848740 1 --2- 172.21.15.53:0/1479521113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 0x562908a20680 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x562908a11f90 tx=0x7f0c68005f90 comp rx=0 tx=0).stop 2024-08-31T06:12:15.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.057+0000 7f0c84848740 1 -- 172.21.15.53:0/1479521113 shutdown_connections 2024-08-31T06:12:15.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.057+0000 7f0c84848740 1 --2- 172.21.15.53:0/1479521113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290866e070 0x562908a1c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.057+0000 7f0c84848740 1 --2- 172.21.15.53:0/1479521113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56290864d390 0x562908a1bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.057+0000 7f0c84848740 1 --2- 172.21.15.53:0/1479521113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629086451b0 0x562908a20680 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.057+0000 7f0c84848740 1 -- 172.21.15.53:0/1479521113 >> 172.21.15.53:0/1479521113 conn(0x562908662460 msgr2=0x562908a1ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.057+0000 7f0c84848740 1 -- 172.21.15.53:0/1479521113 shutdown_connections 2024-08-31T06:12:15.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.057+0000 7f0c84848740 1 -- 172.21.15.53:0/1479521113 wait complete. 2024-08-31T06:12:15.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.058+0000 7f0c84848740 1 -- start start 2024-08-31T06:12:15.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.058+0000 7f0c84848740 1 Processor -- start 2024-08-31T06:12:15.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c84848740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 0x562908a27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c84848740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290864d390 0x562908a24c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c84848740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290866e070 0x562908a252d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c84848740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0c781ae670 con 0x56290864d390 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c84848740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0c781adfa0 con 0x56290866e070 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c84848740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c781ab200 con 0x5629086451b0 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290864d390 0x562908a24c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c77fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 0x562908a27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290864d390 0x562908a24c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39054/0 (socket says 172.21.15.53:39054) 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c777fe640 1 -- 172.21.15.53:0/4280969810 learned_addr learned my addr 172.21.15.53:0/4280969810 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c84848740 10 client.0 _ll_register_callbacks cb 0x7f0c6c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c7c870640 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290866e070 0x562908a252d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c77fff640 1 -- 172.21.15.53:0/4280969810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290866e070 msgr2=0x562908a252d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c77fff640 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290866e070 0x562908a252d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c77fff640 1 -- 172.21.15.53:0/4280969810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290864d390 msgr2=0x562908a24c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c77fff640 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290864d390 0x562908a24c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.059+0000 7f0c77fff640 1 -- 172.21.15.53:0/4280969810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562908a25a40 con 0x5629086451b0 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.060+0000 7f0c77fff640 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 0x562908a27760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x562908a11f90 tx=0x7f0c68005680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0ab302a8b245dc8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.060+0000 7f0c577fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.060+0000 7f0c577fe640 1 -- 172.21.15.53:0/4280969810 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68035030 con 0x5629086451b0 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.060+0000 7f0c577fe640 1 -- 172.21.15.53:0/4280969810 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f0c680052d0 con 0x5629086451b0 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.060+0000 7f0c84848740 1 -- 172.21.15.53:0/4280969810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c680054d0 con 0x5629086451b0 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.060+0000 7f0c577fe640 1 -- 172.21.15.53:0/4280969810 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0c6802d070 con 0x5629086451b0 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.060+0000 7f0c84848740 10 client.27217 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:15.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.060+0000 7f0c84848740 1 -- 172.21.15.53:0/4280969810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562908a9b880 con 0x5629086451b0 2024-08-31T06:12:15.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.060+0000 7f0c577fe640 1 -- 172.21.15.53:0/4280969810 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c680054d0 con 0x5629086451b0 2024-08-31T06:12:15.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.061+0000 7f0c577fe640 1 -- 172.21.15.53:0/4280969810 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f0c680035f0 con 0x5629086451b0 2024-08-31T06:12:15.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.061+0000 7f0c84848740 10 client.27217 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:15.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.061+0000 7f0c84848740 10 client.27217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:15.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.061+0000 7f0c84848740 20 client.27217 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:15.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.061+0000 7f0c84848740 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562908601da0 0x562908a9ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.061+0000 7f0c84848740 4 client.27217 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.061+0000 7f0c84848740 1 -- 172.21.15.53:0/4280969810 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562908988070 con 0x562908601da0 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.061+0000 7f0c777fe640 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562908601da0 0x562908a9ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.061+0000 7f0c577fe640 10 client.27217 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.062+0000 7f0c777fe640 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562908601da0 0x562908a9ddc0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8289d7b9c53e9990 server_cookie=fc6bce3da1b72cfb in_seq=0 out_seq=0 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.062+0000 7f0c577fe640 1 -- 172.21.15.53:0/4280969810 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562908988070 con 0x562908601da0 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.062+0000 7f0c577fe640 10 client.27217 handle_command_reply: tid=0 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.062+0000 7f0c84848740 1 client.27217 shutdown 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c84848740 1 -- 172.21.15.53:0/4280969810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 msgr2=0x562908a27760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c84848740 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 0x562908a27760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x562908a11f90 tx=0x7f0c68005680 comp rx=0 tx=0).stop 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c84848740 1 -- 172.21.15.53:0/4280969810 shutdown_connections 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c84848740 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562908601da0 0x562908a9ddc0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c84848740 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56290866e070 0x562908a252d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c84848740 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56290864d390 0x562908a24c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c84848740 1 --2- 172.21.15.53:0/4280969810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629086451b0 0x562908a27760 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c84848740 1 -- 172.21.15.53:0/4280969810 >> 172.21.15.53:0/4280969810 conn(0x562908662460 msgr2=0x562908a208a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c577fe640 0 client.27217 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:15.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c84848740 1 -- 172.21.15.53:0/4280969810 shutdown_connections 2024-08-31T06:12:15.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c84848740 1 -- 172.21.15.53:0/4280969810 wait complete. 2024-08-31T06:12:15.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.063+0000 7f0c84848740 20 client.27217 trim_cache size 0 max 16384 2024-08-31T06:12:15.068 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:12:15.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/1516680381 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0c600b4ca0 msgr2=0x7f0c600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0c600b4ca0 0x7f0c600b71b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c005de0 tx=0x7f0c6c04a040 comp rx=0 tx=0).stop 2024-08-31T06:12:15.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/1516680381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c78108a90 msgr2=0x7f0c7819f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c78108a90 0x7f0c7819f970 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009fd0 tx=0x7f0c7000ef10 comp rx=0 tx=0).stop 2024-08-31T06:12:15.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/1516680381 shutdown_connections 2024-08-31T06:12:15.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0c600b4ca0 0x7f0c600b71b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c78108a90 0x7f0c7819f970 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c78108140 0x7f0c7819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 --2- 172.21.15.53:0/1516680381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c78102800 0x7f0c7819a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/1516680381 >> 172.21.15.53:0/1516680381 conn(0x7f0c780794d0 msgr2=0x7f0c7806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/1516680381 shutdown_connections 2024-08-31T06:12:15.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.064+0000 7f0c7e2d3640 1 -- 172.21.15.53:0/1516680381 wait complete. 2024-08-31T06:12:15.078 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:15.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.819+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/288058986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2a41050c0 msgr2=0x7fd2a410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.819+0000 7fd2ac4ae640 1 --2- 172.21.15.53:0/288058986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2a41050c0 0x7fd2a410d610 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd294009900 tx=0x7fd29402a410 comp rx=0 tx=0).stop 2024-08-31T06:12:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.820+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/288058986 shutdown_connections 2024-08-31T06:12:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.820+0000 7fd2ac4ae640 1 --2- 172.21.15.53:0/288058986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2a410dbd0 0x7fd2a41100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.820+0000 7fd2ac4ae640 1 --2- 172.21.15.53:0/288058986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2a41050c0 0x7fd2a410d610 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.820+0000 7fd2ac4ae640 1 --2- 172.21.15.53:0/288058986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2a4104770 0x7fd2a4104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.820+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/288058986 >> 172.21.15.53:0/288058986 conn(0x7fd2a40794d0 msgr2=0x7fd2a40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.820+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/288058986 shutdown_connections 2024-08-31T06:12:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.820+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/288058986 wait complete. 2024-08-31T06:12:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.820+0000 7fd2ac4ae640 1 Processor -- start 2024-08-31T06:12:15.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.820+0000 7fd2ac4ae640 1 -- start start 2024-08-31T06:12:15.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2ac4ae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2a4104770 0x7fd2a41024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2ac4ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2a41050c0 0x7fd2a41029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2ac4ae640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2a410dbd0 0x7fd2a4102f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2ac4ae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41136c0 con 0x7fd2a41050c0 2024-08-31T06:12:15.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2ac4ae640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a4113540 con 0x7fd2a410dbd0 2024-08-31T06:12:15.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2ac4ae640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a4113840 con 0x7fd2a4104770 2024-08-31T06:12:15.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2a9a49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2a41050c0 0x7fd2a41029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2aaa4b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2a410dbd0 0x7fd2a4102f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2a9a49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2a41050c0 0x7fd2a41029f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39066/0 (socket says 172.21.15.53:39066) 2024-08-31T06:12:15.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2a9a49640 1 -- 172.21.15.53:0/2897449481 learned_addr learned my addr 172.21.15.53:0/2897449481 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:15.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2aa24a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2a4104770 0x7fd2a41024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2a9a49640 1 -- 172.21.15.53:0/2897449481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2a4104770 msgr2=0x7fd2a41024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2a4104770 0x7fd2a41024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2a9a49640 1 -- 172.21.15.53:0/2897449481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2a410dbd0 msgr2=0x7fd2a4102f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2a410dbd0 0x7fd2a4102f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.821+0000 7fd2a9a49640 1 -- 172.21.15.53:0/2897449481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a41a8430 con 0x7fd2a41050c0 2024-08-31T06:12:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.822+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2a41050c0 0x7fd2a41029f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fd294004770 tx=0x7fd294004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.822+0000 7fd29b7fe640 1 -- 172.21.15.53:0/2897449481 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29403f030 con 0x7fd2a41050c0 2024-08-31T06:12:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.822+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/2897449481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a41a86c0 con 0x7fd2a41050c0 2024-08-31T06:12:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.822+0000 7fd29b7fe640 1 -- 172.21.15.53:0/2897449481 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd294004440 con 0x7fd2a41050c0 2024-08-31T06:12:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.822+0000 7fd29b7fe640 1 -- 172.21.15.53:0/2897449481 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294035070 con 0x7fd2a41050c0 2024-08-31T06:12:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.822+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/2897449481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a41a8ba0 con 0x7fd2a41050c0 2024-08-31T06:12:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.824+0000 7fd2b2a23740 1 Processor -- start 2024-08-31T06:12:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2b2a23740 1 -- start start 2024-08-31T06:12:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baf3b840 0x55a9bb2e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2e31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf1ab60 0x55a9bb2e3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a9bb257330 con 0x55a9baf12980 2024-08-31T06:12:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a9bb2468c0 con 0x55a9baf1ab60 2024-08-31T06:12:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a9bb24a870 con 0x55a9baf3b840 2024-08-31T06:12:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd29b7fe640 1 -- 172.21.15.53:0/2897449481 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd294042030 con 0x7fd2a41050c0 2024-08-31T06:12:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2aa24a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2e31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2a9a49640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf1ab60 0x55a9bb2e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2aa24a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2e31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39072/0 (socket says 172.21.15.53:39072) 2024-08-31T06:12:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2aa24a640 1 -- 172.21.15.53:0/1132817884 learned_addr learned my addr 172.21.15.53:0/1132817884 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.825+0000 7fd2aaa4b640 1 --2- 172.21.15.53:0/1132817884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baf3b840 0x55a9bb2e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.826+0000 7fd2aaa4b640 1 -- 172.21.15.53:0/1132817884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf1ab60 msgr2=0x55a9bb2e3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.826+0000 7fd2aaa4b640 1 --2- 172.21.15.53:0/1132817884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf1ab60 0x55a9bb2e3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.826+0000 7fd2aaa4b640 1 -- 172.21.15.53:0/1132817884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 msgr2=0x55a9bb2e31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.826+0000 7fd2aaa4b640 1 --2- 172.21.15.53:0/1132817884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2e31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.826+0000 7fd2aaa4b640 1 -- 172.21.15.53:0/1132817884 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9bb1fedf0 con 0x55a9baf3b840 2024-08-31T06:12:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.826+0000 7fd2aa24a640 1 --2- 172.21.15.53:0/1132817884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2e31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.826+0000 7fd2aaa4b640 1 --2- 172.21.15.53:0/1132817884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baf3b840 0x55a9bb2e2c90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009f00 tx=0x7fd29c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca6d2e98628cfd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.826+0000 7fd298d9a640 1 -- 172.21.15.53:0/1132817884 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c004d20 con 0x55a9baf3b840 2024-08-31T06:12:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.826+0000 7fd29b7fe640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2900b4d20 0x7fd2900b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.826+0000 7fd298d9a640 1 -- 172.21.15.53:0/1132817884 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd29c004050 con 0x55a9baf3b840 2024-08-31T06:12:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.827+0000 7fd298d9a640 1 -- 172.21.15.53:0/1132817884 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c005220 con 0x55a9baf3b840 2024-08-31T06:12:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.827+0000 7fd2aa24a640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2900b4d20 0x7fd2900b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.827+0000 7fd29b7fe640 1 -- 172.21.15.53:0/2897449481 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fd294105930 con 0x7fd2a41050c0 2024-08-31T06:12:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.828+0000 7fd2b2a23740 1 -- 172.21.15.53:0/1132817884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baf3b840 msgr2=0x55a9bb2e2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.828+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/1132817884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baf3b840 0x55a9bb2e2c90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009f00 tx=0x7fd29c011810 comp rx=0 tx=0).stop 2024-08-31T06:12:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.828+0000 7fd2aa24a640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2900b4d20 0x7fd2900b7230 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55a9bb2e1910 tx=0x7fd2a000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.828+0000 7fd2b2a23740 1 -- 172.21.15.53:0/1132817884 shutdown_connections 2024-08-31T06:12:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.828+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/1132817884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf1ab60 0x55a9bb2e3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.828+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/1132817884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2e31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.828+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/1132817884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baf3b840 0x55a9bb2e2c90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.828+0000 7fd2b2a23740 1 -- 172.21.15.53:0/1132817884 >> 172.21.15.53:0/1132817884 conn(0x55a9baf2f990 msgr2=0x55a9bb2e0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.828+0000 7fd2b2a23740 1 -- 172.21.15.53:0/1132817884 shutdown_connections 2024-08-31T06:12:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.828+0000 7fd2b2a23740 1 -- 172.21.15.53:0/1132817884 wait complete. 2024-08-31T06:12:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.828+0000 7fd2b2a23740 1 -- start start 2024-08-31T06:12:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2b2a23740 1 Processor -- start 2024-08-31T06:12:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2ee410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baf1ab60 0x55a9bb2ee950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf3b840 0x55a9bb2fa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a9bb0a97a0 con 0x55a9baf12980 2024-08-31T06:12:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a9bb1cd240 con 0x55a9baf3b840 2024-08-31T06:12:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a9bb2f1470 con 0x55a9baf1ab60 2024-08-31T06:12:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2aa24a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2ee410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2aa24a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2ee410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39086/0 (socket says 172.21.15.53:39086) 2024-08-31T06:12:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2b2a23740 10 client.0 _ll_register_callbacks cb 0x55a9baf53090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2aa24a640 1 -- 172.21.15.53:0/918409775 learned_addr learned my addr 172.21.15.53:0/918409775 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2aaa4b640 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf3b840 0x55a9bb2fa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.829+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baf1ab60 0x55a9bb2ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd2aa24a640 1 -- 172.21.15.53:0/918409775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baf1ab60 msgr2=0x55a9bb2ee950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd2aa24a640 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baf1ab60 0x55a9bb2ee950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd2aa24a640 1 -- 172.21.15.53:0/918409775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf3b840 msgr2=0x55a9bb2fa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd2aa24a640 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf3b840 0x55a9bb2fa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd2aa24a640 1 -- 172.21.15.53:0/918409775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9bb2032b0 con 0x55a9baf12980 2024-08-31T06:12:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd2aaa4b640 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf3b840 0x55a9bb2fa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd2aa24a640 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2ee410 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0005fd0 tx=0x7fd2a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba56c18a42209ddd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd28dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd28dffb640 1 -- 172.21.15.53:0/918409775 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a002c060 con 0x55a9baf12980 2024-08-31T06:12:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd28dffb640 1 -- 172.21.15.53:0/918409775 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fd2a0017030 con 0x55a9baf12980 2024-08-31T06:12:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd2b2a23740 1 -- 172.21.15.53:0/918409775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd29c004050 con 0x55a9baf12980 2024-08-31T06:12:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd28dffb640 1 -- 172.21.15.53:0/918409775 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd2a0003e90 con 0x55a9baf12980 2024-08-31T06:12:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd2b2a23740 10 client.17940 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.830+0000 7fd2b2a23740 1 -- 172.21.15.53:0/918409775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a9bafb5b90 con 0x55a9baf12980 2024-08-31T06:12:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.831+0000 7fd28dffb640 1 -- 172.21.15.53:0/918409775 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd29c004050 con 0x55a9baf12980 2024-08-31T06:12:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.831+0000 7fd28dffb640 1 -- 172.21.15.53:0/918409775 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fd2a001c480 con 0x55a9baf12980 2024-08-31T06:12:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.831+0000 7fd2b2a23740 10 client.17940 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.831+0000 7fd2b2a23740 10 client.17940 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:12:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.831+0000 7fd2b2a23740 20 client.17940 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.831+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a9baefa1c0 0x55a9bb3005e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.831+0000 7fd2b2a23740 4 client.17940 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.831+0000 7fd2b2a23740 1 -- 172.21.15.53:0/918409775 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9bb259280 con 0x55a9baefa1c0 2024-08-31T06:12:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.831+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a9baefa1c0 0x55a9bb3005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.831+0000 7fd28dffb640 10 client.17940 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.832+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a9baefa1c0 0x55a9bb3005e0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7ad87fa24ee48d server_cookie=66f2c2e5fbe9ba54 in_seq=0 out_seq=0 2024-08-31T06:12:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd28dffb640 1 -- 172.21.15.53:0/918409775 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a9bb259280 con 0x55a9baefa1c0 2024-08-31T06:12:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd28dffb640 10 client.17940 handle_command_reply: tid=0 2024-08-31T06:12:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 1 client.17940 shutdown 2024-08-31T06:12:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 1 -- 172.21.15.53:0/918409775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 msgr2=0x55a9bb2ee410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2ee410 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0005fd0 tx=0x7fd2a0004730 comp rx=0 tx=0).stop 2024-08-31T06:12:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 1 -- 172.21.15.53:0/918409775 shutdown_connections 2024-08-31T06:12:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a9baefa1c0 0x55a9bb3005e0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf3b840 0x55a9bb2fa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baf1ab60 0x55a9bb2ee950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/918409775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf12980 0x55a9bb2ee410 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd28dffb640 0 client.17940 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 1 -- 172.21.15.53:0/918409775 >> 172.21.15.53:0/918409775 conn(0x55a9baf2f990 msgr2=0x55a9bb2e5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 1 -- 172.21.15.53:0/918409775 shutdown_connections 2024-08-31T06:12:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 1 -- 172.21.15.53:0/918409775 wait complete. 2024-08-31T06:12:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.833+0000 7fd2b2a23740 20 client.17940 trim_cache size 0 max 16384 2024-08-31T06:12:15.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.853+0000 7fd2b2a23740 1 Processor -- start 2024-08-31T06:12:15.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.853+0000 7fd2b2a23740 1 -- start start 2024-08-31T06:12:15.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf1ab60 0x55a9bb2e4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf3b840 0x55a9bb2f0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baecf570 0x55a9bb2fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41b1730 con 0x55a9baf3b840 2024-08-31T06:12:15.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41b3270 con 0x55a9baf1ab60 2024-08-31T06:12:15.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41b1e00 con 0x55a9baecf570 2024-08-31T06:12:15.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2a9a49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf3b840 0x55a9bb2f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2a9a49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf3b840 0x55a9bb2f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39098/0 (socket says 172.21.15.53:39098) 2024-08-31T06:12:15.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2a9a49640 1 -- 172.21.15.53:0/2508081289 learned_addr learned my addr 172.21.15.53:0/2508081289 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2aaa4b640 1 --2- 172.21.15.53:0/2508081289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baecf570 0x55a9bb2fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2aa24a640 1 --2- 172.21.15.53:0/2508081289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf1ab60 0x55a9bb2e4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2a9a49640 1 -- 172.21.15.53:0/2508081289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baecf570 msgr2=0x55a9bb2fa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/2508081289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baecf570 0x55a9bb2fa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2a9a49640 1 -- 172.21.15.53:0/2508081289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf1ab60 msgr2=0x55a9bb2e4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/2508081289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf1ab60 0x55a9bb2e4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2a9a49640 1 -- 172.21.15.53:0/2508081289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9bb216d90 con 0x55a9baf3b840 2024-08-31T06:12:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.854+0000 7fd2aaa4b640 1 --2- 172.21.15.53:0/2508081289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baecf570 0x55a9bb2fa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.855+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/2508081289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf3b840 0x55a9bb2f0040 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd294005940 tx=0x7fd29410b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ee9415fac17729 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.855+0000 7fd28ffff640 1 -- 172.21.15.53:0/2508081289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294049040 con 0x55a9baf3b840 2024-08-31T06:12:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.855+0000 7fd28ffff640 1 -- 172.21.15.53:0/2508081289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2940cbb60 con 0x55a9baf3b840 2024-08-31T06:12:15.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.855+0000 7fd28ffff640 1 -- 172.21.15.53:0/2508081289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2940c82e0 con 0x55a9baf3b840 2024-08-31T06:12:15.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.856+0000 7fd2b2a23740 1 -- 172.21.15.53:0/2508081289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf3b840 msgr2=0x55a9bb2f0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.856+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/2508081289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf3b840 0x55a9bb2f0040 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd294005940 tx=0x7fd29410b530 comp rx=0 tx=0).stop 2024-08-31T06:12:15.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.856+0000 7fd2b2a23740 1 -- 172.21.15.53:0/2508081289 shutdown_connections 2024-08-31T06:12:15.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.856+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/2508081289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baecf570 0x55a9bb2fa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.856+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/2508081289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf3b840 0x55a9bb2f0040 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.856+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/2508081289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf1ab60 0x55a9bb2e4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.856+0000 7fd2b2a23740 1 -- 172.21.15.53:0/2508081289 >> 172.21.15.53:0/2508081289 conn(0x55a9baf2f990 msgr2=0x55a9bb2ef930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.856+0000 7fd2b2a23740 1 -- 172.21.15.53:0/2508081289 shutdown_connections 2024-08-31T06:12:15.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.856+0000 7fd2b2a23740 1 -- 172.21.15.53:0/2508081289 wait complete. 2024-08-31T06:12:15.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.856+0000 7fd2b2a23740 1 -- start start 2024-08-31T06:12:15.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.856+0000 7fd2b2a23740 1 Processor -- start 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baecf570 0x55a9bb2f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf1ab60 0x55a9bb2f3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2b2a23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf3b840 0x55a9bb2f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41b2ba0 con 0x55a9baf1ab60 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41b24d0 con 0x55a9baf3b840 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2b2a23740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41af730 con 0x55a9baecf570 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2b2a23740 10 client.0 _ll_register_callbacks cb 0x7fd2a0005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2a9a49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf1ab60 0x55a9bb2f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2a9a49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf1ab60 0x55a9bb2f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39114/0 (socket says 172.21.15.53:39114) 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2a9a49640 1 -- 172.21.15.53:0/3178593481 learned_addr learned my addr 172.21.15.53:0/3178593481 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2aa24a640 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baecf570 0x55a9bb2f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2aaa4b640 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf3b840 0x55a9bb2f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2a9a49640 1 -- 172.21.15.53:0/3178593481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baecf570 msgr2=0x55a9bb2f6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baecf570 0x55a9bb2f6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2a9a49640 1 -- 172.21.15.53:0/3178593481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf3b840 msgr2=0x55a9bb2f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf3b840 0x55a9bb2f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.857+0000 7fd2a9a49640 1 -- 172.21.15.53:0/3178593481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9bb2f3b00 con 0x55a9baf1ab60 2024-08-31T06:12:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd2a9a49640 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf1ab60 0x55a9bb2f3080 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd29402a450 tx=0x7fd294000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee413c6640e1548 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd28dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd28dffb640 1 -- 172.21.15.53:0/3178593481 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2940f2060 con 0x55a9baf1ab60 2024-08-31T06:12:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd28dffb640 1 -- 172.21.15.53:0/3178593481 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fd2940d0440 con 0x55a9baf1ab60 2024-08-31T06:12:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd2b2a23740 1 -- 172.21.15.53:0/3178593481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2940cbb60 con 0x55a9baf1ab60 2024-08-31T06:12:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd28dffb640 1 -- 172.21.15.53:0/3178593481 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd294049070 con 0x55a9baf1ab60 2024-08-31T06:12:15.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd2b2a23740 10 client.17946 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:15.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd2b2a23740 1 -- 172.21.15.53:0/3178593481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a9bb36bbe0 con 0x55a9baf1ab60 2024-08-31T06:12:15.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd28dffb640 1 -- 172.21.15.53:0/3178593481 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2940cbb60 con 0x55a9baf1ab60 2024-08-31T06:12:15.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd28dffb640 1 -- 172.21.15.53:0/3178593481 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fd294105ce0 con 0x55a9baf1ab60 2024-08-31T06:12:15.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd2b2a23740 10 client.17946 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:15.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd2b2a23740 10 client.17946 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:12:15.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd2b2a23740 20 client.17946 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:15.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a9bb36c3a0 0x55a9bb36e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:15.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd2b2a23740 4 client.17946 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}] 2024-08-31T06:12:15.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.858+0000 7fd2b2a23740 1 -- 172.21.15.53:0/3178593481 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}) -- 0x55a9bb254d20 con 0x55a9bb36c3a0 2024-08-31T06:12:15.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.859+0000 7fd2aa24a640 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a9bb36c3a0 0x55a9bb36e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:15.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.859+0000 7fd28dffb640 10 client.17946 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:15.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.859+0000 7fd2aa24a640 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a9bb36c3a0 0x55a9bb36e7c0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca15a1527bd13920 server_cookie=f0b8b9539c3f15b1 in_seq=0 out_seq=0 2024-08-31T06:12:15.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd28dffb640 1 -- 172.21.15.53:0/3178593481 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a9bb254d20 con 0x55a9bb36c3a0 2024-08-31T06:12:15.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd28dffb640 10 client.17946 handle_command_reply: tid=0 2024-08-31T06:12:15.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 1 client.17946 shutdown 2024-08-31T06:12:15.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 1 -- 172.21.15.53:0/3178593481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf1ab60 msgr2=0x55a9bb2f3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf1ab60 0x55a9bb2f3080 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd29402a450 tx=0x7fd294000bc0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 1 -- 172.21.15.53:0/3178593481 shutdown_connections 2024-08-31T06:12:15.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a9bb36c3a0 0x55a9bb36e7c0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9baf3b840 0x55a9bb2f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9baf1ab60 0x55a9bb2f3080 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd28dffb640 0 client.17946 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:15.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 1 --2- 172.21.15.53:0/3178593481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9baecf570 0x55a9bb2f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 1 -- 172.21.15.53:0/3178593481 >> 172.21.15.53:0/3178593481 conn(0x55a9baf2f990 msgr2=0x55a9bb2e4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 1 -- 172.21.15.53:0/3178593481 shutdown_connections 2024-08-31T06:12:15.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 1 -- 172.21.15.53:0/3178593481 wait complete. 2024-08-31T06:12:15.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.932+0000 7fd2b2a23740 20 client.17946 trim_cache size 0 max 16384 2024-08-31T06:12:15.937 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:12:15.937 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 36, 2024-08-31T06:12:15.937 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:12:15.937 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 26, 2024-08-31T06:12:15.937 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:12:15.937 INFO:teuthology.orchestra.run.smithi053.stdout: "73b50ea8": { 2024-08-31T06:12:15.937 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 26, 2024-08-31T06:12:15.937 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:12:15.937 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:12:15.937 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:12:15.938 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:12:15.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:15.938 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:12:15.938 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 148.0, 2024-08-31T06:12:15.938 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:12:15.938 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:12:15.938 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:12:15.938 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:12:15.938 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:12:15.938 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:12:15.938 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:15.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:15.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:15.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:15.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:15.939 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:12:15.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/2897449481 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2900b4d20 msgr2=0x7fd2900b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2900b4d20 0x7fd2900b7230 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55a9bb2e1910 tx=0x7fd2a000b390 comp rx=0 tx=0).stop 2024-08-31T06:12:15.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/2897449481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2a41050c0 msgr2=0x7fd2a41029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:15.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2a41050c0 0x7fd2a41029f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fd294004770 tx=0x7fd294004040 comp rx=0 tx=0).stop 2024-08-31T06:12:15.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/2897449481 shutdown_connections 2024-08-31T06:12:15.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2900b4d20 0x7fd2900b7230 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2a410dbd0 0x7fd2a4102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2a41050c0 0x7fd2a41029f0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 --2- 172.21.15.53:0/2897449481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2a4104770 0x7fd2a41024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:15.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/2897449481 >> 172.21.15.53:0/2897449481 conn(0x7fd2a40794d0 msgr2=0x7fd2a4100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:15.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/2897449481 shutdown_connections 2024-08-31T06:12:15.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:15.933+0000 7fd2ac4ae640 1 -- 172.21.15.53:0/2897449481 wait complete. 2024-08-31T06:12:15.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.70 MB/sec execute 245 sec latency 78.188 ms 2024-08-31T06:12:16.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:16 smithi130 ceph-mon[22266]: pgmap v546: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 126 KiB/s wr, 29 op/s 2024-08-31T06:12:16.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:16 smithi153 ceph-mon[22320]: pgmap v546: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 126 KiB/s wr, 29 op/s 2024-08-31T06:12:16.698 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:16 smithi053 ceph-mon[18924]: pgmap v546: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 126 KiB/s wr, 29 op/s 2024-08-31T06:12:16.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.69 MB/sec execute 246 sec latency 1024.287 ms 2024-08-31T06:12:17.018 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '73b50ea8', quiesce took 5.9 seconds. Will release after: 22.1 2024-08-31T06:12:17.373 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:12:17.373 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:12:17.631 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:17.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.69 MB/sec execute 247 sec latency 2024.348 ms 2024-08-31T06:12:18.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.138+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/1887623530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac0108140 msgr2=0x7f5ac0108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.138+0000 7f5ac6aa2640 1 --2- 172.21.15.53:0/1887623530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac0108140 0x7f5ac0108550 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5aac009900 tx=0x7f5aac02a410 comp rx=0 tx=0).stop 2024-08-31T06:12:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.138+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/1887623530 shutdown_connections 2024-08-31T06:12:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.138+0000 7f5ac6aa2640 1 --2- 172.21.15.53:0/1887623530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ac0108a90 0x7f5ac010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.138+0000 7f5ac6aa2640 1 --2- 172.21.15.53:0/1887623530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac0108140 0x7f5ac0108550 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.138+0000 7f5ac6aa2640 1 --2- 172.21.15.53:0/1887623530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac0102800 0x7f5ac0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.138+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/1887623530 >> 172.21.15.53:0/1887623530 conn(0x7f5ac00794d0 msgr2=0x7f5ac00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.138+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/1887623530 shutdown_connections 2024-08-31T06:12:18.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.138+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/1887623530 wait complete. 2024-08-31T06:12:18.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.139+0000 7f5ac6aa2640 1 Processor -- start 2024-08-31T06:12:18.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.139+0000 7f5ac6aa2640 1 -- start start 2024-08-31T06:12:18.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.139+0000 7f5ac6aa2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac0102800 0x7f5ac019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.139+0000 7f5ac6aa2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ac0108140 0x7f5ac019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.139+0000 7f5ac6aa2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac0108a90 0x7f5ac019f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.139+0000 7f5ac6aa2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0112590 con 0x7f5ac0102800 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.139+0000 7f5ac6aa2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0112410 con 0x7f5ac0108a90 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.139+0000 7f5ac6aa2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0112710 con 0x7f5ac0108140 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.139+0000 7f5ac483e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac0102800 0x7f5ac019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.139+0000 7f5ac483e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac0102800 0x7f5ac019a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39126/0 (socket says 172.21.15.53:39126) 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5ac483e640 1 -- 172.21.15.53:0/3485229109 learned_addr learned my addr 172.21.15.53:0/3485229109 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5abffff640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ac0108140 0x7f5ac019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5ac503f640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac0108a90 0x7f5ac019f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5ac483e640 1 -- 172.21.15.53:0/3485229109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ac0108140 msgr2=0x7f5ac019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5ac483e640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ac0108140 0x7f5ac019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5ac483e640 1 -- 172.21.15.53:0/3485229109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac0108a90 msgr2=0x7f5ac019f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5ac483e640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac0108a90 0x7f5ac019f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5ac483e640 1 -- 172.21.15.53:0/3485229109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac019ffe0 con 0x7f5ac0102800 2024-08-31T06:12:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5ac503f640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac0108a90 0x7f5ac019f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5abffff640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ac0108140 0x7f5ac019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5ac483e640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac0102800 0x7f5ac019a130 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c920 tx=0x7f5ab400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5abdffb640 1 -- 172.21.15.53:0/3485229109 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4007c70 con 0x7f5ac0102800 2024-08-31T06:12:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5abdffb640 1 -- 172.21.15.53:0/3485229109 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ab4007e10 con 0x7f5ac0102800 2024-08-31T06:12:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/3485229109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac01a02d0 con 0x7f5ac0102800 2024-08-31T06:12:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.140+0000 7f5abdffb640 1 -- 172.21.15.53:0/3485229109 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4018710 con 0x7f5ac0102800 2024-08-31T06:12:18.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.141+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/3485229109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac0104d60 con 0x7f5ac0102800 2024-08-31T06:12:18.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.143+0000 7f5abdffb640 1 -- 172.21.15.53:0/3485229109 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5ab400f450 con 0x7f5ac0102800 2024-08-31T06:12:18.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.143+0000 7f5acd017740 1 Processor -- start 2024-08-31T06:12:18.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.143+0000 7f5acd017740 1 -- start start 2024-08-31T06:12:18.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5acd017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a94f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5acd017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a580490 0x55ac7a94fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5acd017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a588670 0x55ac7a950200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5acd017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ac7a8c55f0 con 0x55ac7a5a9350 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5acd017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ac7a8b4b80 con 0x55ac7a580490 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5acd017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ac7a8b8b30 con 0x55ac7a588670 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5ac503f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a94f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5ac503f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a94f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39142/0 (socket says 172.21.15.53:39142) 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5ac503f640 1 -- 172.21.15.53:0/40047119 learned_addr learned my addr 172.21.15.53:0/40047119 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5ac483e640 1 --2- 172.21.15.53:0/40047119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a580490 0x55ac7a94fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5abffff640 1 --2- 172.21.15.53:0/40047119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a588670 0x55ac7a950200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5abdffb640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ab00b4cd0 0x7f5ab00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5ac503f640 1 -- 172.21.15.53:0/40047119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a588670 msgr2=0x55ac7a950200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5ac503f640 1 --2- 172.21.15.53:0/40047119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a588670 0x55ac7a950200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5ac503f640 1 -- 172.21.15.53:0/40047119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a580490 msgr2=0x55ac7a94fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5ac503f640 1 --2- 172.21.15.53:0/40047119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a580490 0x55ac7a94fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.144+0000 7f5ac503f640 1 -- 172.21.15.53:0/40047119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac7a614930 con 0x55ac7a5a9350 2024-08-31T06:12:18.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.145+0000 7f5abdffb640 1 -- 172.21.15.53:0/3485229109 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f5ab40e5810 con 0x7f5ac0102800 2024-08-31T06:12:18.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.145+0000 7f5ac503f640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ab00b4cd0 0x7f5ab00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.145+0000 7f5ac503f640 1 --2- 172.21.15.53:0/40047119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a94f780 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009ea0 tx=0x7f5ab8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424c841f51bb5890 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:18.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.145+0000 7f5aaaffd640 1 -- 172.21.15.53:0/40047119 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8021070 con 0x55ac7a5a9350 2024-08-31T06:12:18.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.145+0000 7f5aaaffd640 1 -- 172.21.15.53:0/40047119 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ab801bd90 con 0x55ac7a5a9350 2024-08-31T06:12:18.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.145+0000 7f5aaaffd640 1 -- 172.21.15.53:0/40047119 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8010a20 con 0x55ac7a5a9350 2024-08-31T06:12:18.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.146+0000 7f5acd017740 1 -- 172.21.15.53:0/40047119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 msgr2=0x55ac7a94f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:18.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.146+0000 7f5acd017740 1 --2- 172.21.15.53:0/40047119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a94f780 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009ea0 tx=0x7f5ab8009f90 comp rx=0 tx=0).stop 2024-08-31T06:12:18.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.146+0000 7f5ac503f640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ab00b4cd0 0x7f5ab00b71e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8010010 tx=0x7f5ab8021000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:18.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.146+0000 7f5acd017740 1 -- 172.21.15.53:0/40047119 shutdown_connections 2024-08-31T06:12:18.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.146+0000 7f5acd017740 1 --2- 172.21.15.53:0/40047119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a588670 0x55ac7a950200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.146+0000 7f5acd017740 1 --2- 172.21.15.53:0/40047119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a580490 0x55ac7a94fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.146+0000 7f5acd017740 1 --2- 172.21.15.53:0/40047119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a94f780 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.146+0000 7f5acd017740 1 -- 172.21.15.53:0/40047119 >> 172.21.15.53:0/40047119 conn(0x55ac7a59d740 msgr2=0x55ac7a94d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:18.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.146+0000 7f5acd017740 1 -- 172.21.15.53:0/40047119 shutdown_connections 2024-08-31T06:12:18.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.146+0000 7f5acd017740 1 -- 172.21.15.53:0/40047119 wait complete. 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5acd017740 1 -- start start 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5acd017740 1 Processor -- start 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5acd017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5acd017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a588670 0x55ac7a95b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5acd017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a5a9350 0x55ac7a967250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5acd017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ac7a717890 con 0x55ac7a580490 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5acd017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ac7a83b790 con 0x55ac7a588670 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5acd017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ac7a95df60 con 0x55ac7a5a9350 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5acd017740 10 client.0 _ll_register_callbacks cb 0x55ac7a5c0ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5ac483e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5ac483e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39150/0 (socket says 172.21.15.53:39150) 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.147+0000 7f5ac483e640 1 -- 172.21.15.53:0/1072394316 learned_addr learned my addr 172.21.15.53:0/1072394316 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5ac503f640 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a5a9350 0x55ac7a967250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5abffff640 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a588670 0x55ac7a95b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5ac483e640 1 -- 172.21.15.53:0/1072394316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a5a9350 msgr2=0x55ac7a967250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5ac483e640 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a5a9350 0x55ac7a967250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5ac483e640 1 -- 172.21.15.53:0/1072394316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a588670 msgr2=0x55ac7a95b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5ac483e640 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a588670 0x55ac7a95b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5ac483e640 1 -- 172.21.15.53:0/1072394316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac7a872f30 con 0x55ac7a580490 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5ac503f640 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a5a9350 0x55ac7a967250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5abffff640 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a588670 0x55ac7a95b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5ac483e640 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95aef0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40a7f00 tx=0x7f5ab400fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e24a713385073e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5a9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5a9ffff640 1 -- 172.21.15.53:0/1072394316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40e3360 con 0x55ac7a580490 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5a9ffff640 1 -- 172.21.15.53:0/1072394316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f5ab40930e0 con 0x55ac7a580490 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5acd017740 1 -- 172.21.15.53:0/1072394316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ab801bd90 con 0x55ac7a580490 2024-08-31T06:12:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5a9ffff640 1 -- 172.21.15.53:0/1072394316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5ab40ac580 con 0x55ac7a580490 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5acd017740 10 client.17958 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5acd017740 1 -- 172.21.15.53:0/1072394316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ac7a969cf0 con 0x55ac7a580490 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.148+0000 7f5a9ffff640 1 -- 172.21.15.53:0/1072394316 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ab801bd90 con 0x55ac7a580490 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.149+0000 7f5a9ffff640 1 -- 172.21.15.53:0/1072394316 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f5ab40ac0e0 con 0x55ac7a580490 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.149+0000 7f5acd017740 10 client.17958 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.149+0000 7f5acd017740 10 client.17958 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.149+0000 7f5acd017740 20 client.17958 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.149+0000 7f5acd017740 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ac7a567cd0 0x55ac7a96d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.149+0000 7f5acd017740 4 client.17958 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.149+0000 7f5acd017740 1 -- 172.21.15.53:0/1072394316 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac7a8c7540 con 0x55ac7a567cd0 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.149+0000 7f5abffff640 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ac7a567cd0 0x55ac7a96d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.149+0000 7f5abffff640 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ac7a567cd0 0x55ac7a96d200 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74d1ad41104866c server_cookie=7d9fe09aa02806e9 in_seq=0 out_seq=0 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.149+0000 7f5a9ffff640 10 client.17958 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.150+0000 7f5a9ffff640 1 -- 172.21.15.53:0/1072394316 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac7a8c7540 con 0x55ac7a567cd0 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.150+0000 7f5a9ffff640 10 client.17958 handle_command_reply: tid=0 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.150+0000 7f5acd017740 1 client.17958 shutdown 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.150+0000 7f5acd017740 1 -- 172.21.15.53:0/1072394316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 msgr2=0x55ac7a95aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.150+0000 7f5acd017740 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95aef0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40a7f00 tx=0x7f5ab400fca0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.151+0000 7f5acd017740 1 -- 172.21.15.53:0/1072394316 shutdown_connections 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.151+0000 7f5acd017740 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ac7a567cd0 0x55ac7a96d200 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.151+0000 7f5acd017740 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a5a9350 0x55ac7a967250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.151+0000 7f5acd017740 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a588670 0x55ac7a95b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.151+0000 7f5acd017740 1 --2- 172.21.15.53:0/1072394316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95aef0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.151+0000 7f5acd017740 1 -- 172.21.15.53:0/1072394316 >> 172.21.15.53:0/1072394316 conn(0x55ac7a59d740 msgr2=0x55ac7a952960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.151+0000 7f5a9ffff640 0 client.17958 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:18.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.151+0000 7f5acd017740 1 -- 172.21.15.53:0/1072394316 shutdown_connections 2024-08-31T06:12:18.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.151+0000 7f5acd017740 1 -- 172.21.15.53:0/1072394316 wait complete. 2024-08-31T06:12:18.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.151+0000 7f5acd017740 20 client.17958 trim_cache size 0 max 16384 2024-08-31T06:12:18.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.168+0000 7f5acd017740 1 Processor -- start 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5acd017740 1 -- start start 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5acd017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a580490 0x55ac7a950ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5acd017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a588670 0x55ac7a967150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5acd017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a967690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5acd017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01b16b0 con 0x55ac7a5a9350 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5acd017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01b31f0 con 0x55ac7a588670 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5acd017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01b1d80 con 0x55ac7a580490 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5ac503f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a967690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5ac503f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a967690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39158/0 (socket says 172.21.15.53:39158) 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5ac503f640 1 -- 172.21.15.53:0/2946487206 learned_addr learned my addr 172.21.15.53:0/2946487206 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5abffff640 1 --2- 172.21.15.53:0/2946487206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a588670 0x55ac7a967150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5ac483e640 1 --2- 172.21.15.53:0/2946487206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a580490 0x55ac7a950ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5ac503f640 1 -- 172.21.15.53:0/2946487206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a580490 msgr2=0x55ac7a950ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5ac503f640 1 --2- 172.21.15.53:0/2946487206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a580490 0x55ac7a950ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5ac503f640 1 -- 172.21.15.53:0/2946487206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a588670 msgr2=0x55ac7a967150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5ac503f640 1 --2- 172.21.15.53:0/2946487206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a588670 0x55ac7a967150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5ac503f640 1 -- 172.21.15.53:0/2946487206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac7a959e50 con 0x55ac7a5a9350 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5ac483e640 1 --2- 172.21.15.53:0/2946487206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a580490 0x55ac7a950ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.169+0000 7f5ac503f640 1 --2- 172.21.15.53:0/2946487206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a967690 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009880 tx=0x7f5ab8026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77959d9420e40bb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.170+0000 7f5aaa7fc640 1 -- 172.21.15.53:0/2946487206 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80115c0 con 0x55ac7a5a9350 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.170+0000 7f5aaa7fc640 1 -- 172.21.15.53:0/2946487206 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ab8011760 con 0x55ac7a5a9350 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.170+0000 7f5aaa7fc640 1 -- 172.21.15.53:0/2946487206 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8010750 con 0x55ac7a5a9350 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.170+0000 7f5acd017740 1 -- 172.21.15.53:0/2946487206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 msgr2=0x55ac7a967690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.170+0000 7f5acd017740 1 --2- 172.21.15.53:0/2946487206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a967690 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009880 tx=0x7f5ab8026000 comp rx=0 tx=0).stop 2024-08-31T06:12:18.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.170+0000 7f5acd017740 1 -- 172.21.15.53:0/2946487206 shutdown_connections 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.170+0000 7f5acd017740 1 --2- 172.21.15.53:0/2946487206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a5a9350 0x55ac7a967690 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.170+0000 7f5acd017740 1 --2- 172.21.15.53:0/2946487206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a588670 0x55ac7a967150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.170+0000 7f5acd017740 1 --2- 172.21.15.53:0/2946487206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a580490 0x55ac7a950ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.170+0000 7f5acd017740 1 -- 172.21.15.53:0/2946487206 >> 172.21.15.53:0/2946487206 conn(0x55ac7a59d740 msgr2=0x55ac7a9507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.171+0000 7f5acd017740 1 -- 172.21.15.53:0/2946487206 shutdown_connections 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.171+0000 7f5acd017740 1 -- 172.21.15.53:0/2946487206 wait complete. 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.171+0000 7f5acd017740 1 -- start start 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.171+0000 7f5acd017740 1 Processor -- start 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.171+0000 7f5acd017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.171+0000 7f5acd017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a588670 0x55ac7a960170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.171+0000 7f5acd017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a5a9350 0x55ac7a9d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5acd017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01b2b20 con 0x55ac7a580490 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5acd017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01b2450 con 0x55ac7a5a9350 2024-08-31T06:12:18.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5acd017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01af6b0 con 0x55ac7a588670 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5acd017740 10 client.0 _ll_register_callbacks cb 0x7f5ab400cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5ac483e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5ac483e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39160/0 (socket says 172.21.15.53:39160) 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5ac483e640 1 -- 172.21.15.53:0/2837931210 learned_addr learned my addr 172.21.15.53:0/2837931210 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5abffff640 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a588670 0x55ac7a960170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5ac503f640 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a5a9350 0x55ac7a9d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5ac483e640 1 -- 172.21.15.53:0/2837931210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a588670 msgr2=0x55ac7a960170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5ac483e640 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a588670 0x55ac7a960170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5ac483e640 1 -- 172.21.15.53:0/2837931210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a5a9350 msgr2=0x55ac7a9d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5ac483e640 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a5a9350 0x55ac7a9d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5ac483e640 1 -- 172.21.15.53:0/2837931210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac7a9d12c0 con 0x55ac7a580490 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5ac483e640 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95fb90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40b08b0 tx=0x7f5ab40a8320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403f2576626d7e9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5a9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:18.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5a9ffff640 1 -- 172.21.15.53:0/2837931210 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40abc50 con 0x55ac7a580490 2024-08-31T06:12:18.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5a9ffff640 1 -- 172.21.15.53:0/2837931210 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f5ab4093110 con 0x55ac7a580490 2024-08-31T06:12:18.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5acd017740 1 -- 172.21.15.53:0/2837931210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ab8011760 con 0x55ac7a580490 2024-08-31T06:12:18.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5a9ffff640 1 -- 172.21.15.53:0/2837931210 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5ab40e3360 con 0x55ac7a580490 2024-08-31T06:12:18.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5acd017740 10 client.17964 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:18.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.172+0000 7f5acd017740 1 -- 172.21.15.53:0/2837931210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ac7a9d8640 con 0x55ac7a580490 2024-08-31T06:12:18.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.173+0000 7f5a9ffff640 1 -- 172.21.15.53:0/2837931210 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ab8011760 con 0x55ac7a580490 2024-08-31T06:12:18.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.173+0000 7f5a9ffff640 1 -- 172.21.15.53:0/2837931210 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f5ab40a77f0 con 0x55ac7a580490 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.173+0000 7f5acd017740 10 client.17964 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.173+0000 7f5acd017740 10 client.17964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.173+0000 7f5acd017740 20 client.17964 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.173+0000 7f5acd017740 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ac7a53d080 0x55ac7a9dad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.173+0000 7f5acd017740 4 client.17964 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.173+0000 7f5acd017740 1 -- 172.21.15.53:0/2837931210 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ac7a8c2fe0 con 0x55ac7a53d080 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.173+0000 7f5abffff640 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ac7a53d080 0x55ac7a9dad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.174+0000 7f5abffff640 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ac7a53d080 0x55ac7a9dad50 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdaa2cf2e8352d93 server_cookie=e6f1e42809b02a97 in_seq=0 out_seq=0 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.174+0000 7f5a9ffff640 10 client.17964 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5a9ffff640 1 -- 172.21.15.53:0/2837931210 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ac7a8c2fe0 con 0x55ac7a53d080 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5a9ffff640 10 client.17964 handle_command_reply: tid=0 2024-08-31T06:12:18.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5acd017740 1 client.17964 shutdown 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5acd017740 1 -- 172.21.15.53:0/2837931210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 msgr2=0x55ac7a95fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5acd017740 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95fb90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40b08b0 tx=0x7f5ab40a8320 comp rx=0 tx=0).stop 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5acd017740 1 -- 172.21.15.53:0/2837931210 shutdown_connections 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5acd017740 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ac7a53d080 0x55ac7a9dad50 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5acd017740 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac7a5a9350 0x55ac7a9d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5acd017740 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac7a588670 0x55ac7a960170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5acd017740 1 --2- 172.21.15.53:0/2837931210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac7a580490 0x55ac7a95fb90 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5acd017740 1 -- 172.21.15.53:0/2837931210 >> 172.21.15.53:0/2837931210 conn(0x55ac7a59d740 msgr2=0x55ac7a951070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5a9ffff640 0 client.17964 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5acd017740 1 -- 172.21.15.53:0/2837931210 shutdown_connections 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.175+0000 7f5acd017740 1 -- 172.21.15.53:0/2837931210 wait complete. 2024-08-31T06:12:18.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5acd017740 20 client.17964 trim_cache size 0 max 16384 2024-08-31T06:12:18.183 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:12:18.183 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:12:18.183 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "447f8d1c-f2e9-441a-9a82-2758f6950c38", 2024-08-31T06:12:18.183 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:12:18.183 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:12:18.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/3485229109 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ab00b4cd0 msgr2=0x7f5ab00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:18.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ab00b4cd0 0x7f5ab00b71e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8010010 tx=0x7f5ab8021000 comp rx=0 tx=0).stop 2024-08-31T06:12:18.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/3485229109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac0102800 msgr2=0x7f5ac019a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:18.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac0102800 0x7f5ac019a130 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c920 tx=0x7f5ab400cde0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/3485229109 shutdown_connections 2024-08-31T06:12:18.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ab00b4cd0 0x7f5ab00b71e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ac0108a90 0x7f5ac019f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ac0108140 0x7f5ac019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 --2- 172.21.15.53:0/3485229109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac0102800 0x7f5ac019a130 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:18.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/3485229109 >> 172.21.15.53:0/3485229109 conn(0x7f5ac00794d0 msgr2=0x7f5ac006b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:18.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/3485229109 shutdown_connections 2024-08-31T06:12:18.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:18.176+0000 7f5ac6aa2640 1 -- 172.21.15.53:0/3485229109 wait complete. 2024-08-31T06:12:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:18 smithi053 ceph-mon[18924]: pgmap v547: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 454 KiB/s wr, 66 op/s 2024-08-31T06:12:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:18 smithi130 ceph-mon[22266]: pgmap v547: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 454 KiB/s wr, 66 op/s 2024-08-31T06:12:18.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:18 smithi153 ceph-mon[22320]: pgmap v547: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 454 KiB/s wr, 66 op/s 2024-08-31T06:12:18.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:12:18.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.68 MB/sec execute 248 sec latency 3024.393 ms 2024-08-31T06:12:19.154 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:19.529 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:12:19.529 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.529 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:12:19.529 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:12:19.529 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.529 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:12:19.529 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:12:19.529 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:12:19.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:12:19.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:12:19.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:12:19.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.619+0000 7fe21f9ec640 1 -- 172.21.15.53:0/4170208952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218108140 msgr2=0x7fe218108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.619+0000 7fe21f9ec640 1 --2- 172.21.15.53:0/4170208952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218108140 0x7fe218108550 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe208009900 tx=0x7fe20802a410 comp rx=0 tx=0).stop 2024-08-31T06:12:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.619+0000 7fe21f9ec640 1 -- 172.21.15.53:0/4170208952 shutdown_connections 2024-08-31T06:12:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.619+0000 7fe21f9ec640 1 --2- 172.21.15.53:0/4170208952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe218108a90 0x7fe21810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.619+0000 7fe21f9ec640 1 --2- 172.21.15.53:0/4170208952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218108140 0x7fe218108550 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.619+0000 7fe21f9ec640 1 --2- 172.21.15.53:0/4170208952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe218102800 0x7fe218102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.619+0000 7fe21f9ec640 1 -- 172.21.15.53:0/4170208952 >> 172.21.15.53:0/4170208952 conn(0x7fe2180794d0 msgr2=0x7fe2180798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.619+0000 7fe21f9ec640 1 -- 172.21.15.53:0/4170208952 shutdown_connections 2024-08-31T06:12:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.619+0000 7fe21f9ec640 1 -- 172.21.15.53:0/4170208952 wait complete. 2024-08-31T06:12:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21f9ec640 1 Processor -- start 2024-08-31T06:12:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21f9ec640 1 -- start start 2024-08-31T06:12:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21f9ec640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe218102800 0x7fe21819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21f9ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218108140 0x7fe21819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21f9ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe218108a90 0x7fe21819f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21f9ec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181136d0 con 0x7fe218108140 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21f9ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe218113550 con 0x7fe218108a90 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21f9ec640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe218113850 con 0x7fe218102800 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21cf87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218108140 0x7fe21819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21cf87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218108140 0x7fe21819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39174/0 (socket says 172.21.15.53:39174) 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21cf87640 1 -- 172.21.15.53:0/3188827053 learned_addr learned my addr 172.21.15.53:0/3188827053 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21df89640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe218108a90 0x7fe21819f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.620+0000 7fe21d788640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe218102800 0x7fe21819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.621+0000 7fe21cf87640 1 -- 172.21.15.53:0/3188827053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe218102800 msgr2=0x7fe21819a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.621+0000 7fe21cf87640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe218102800 0x7fe21819a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.621+0000 7fe21cf87640 1 -- 172.21.15.53:0/3188827053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe218108a90 msgr2=0x7fe21819f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.621+0000 7fe21cf87640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe218108a90 0x7fe21819f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.621+0000 7fe21cf87640 1 -- 172.21.15.53:0/3188827053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2181a0010 con 0x7fe218108140 2024-08-31T06:12:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.621+0000 7fe21cf87640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218108140 0x7fe21819a700 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe208005940 tx=0x7fe2080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.621+0000 7fe20e7fc640 1 -- 172.21.15.53:0/3188827053 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20803f030 con 0x7fe218108140 2024-08-31T06:12:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.621+0000 7fe20e7fc640 1 -- 172.21.15.53:0/3188827053 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe208003c90 con 0x7fe218108140 2024-08-31T06:12:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.621+0000 7fe21f9ec640 1 -- 172.21.15.53:0/3188827053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2181a02a0 con 0x7fe218108140 2024-08-31T06:12:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.621+0000 7fe20e7fc640 1 -- 172.21.15.53:0/3188827053 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208035070 con 0x7fe218108140 2024-08-31T06:12:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.621+0000 7fe21f9ec640 1 -- 172.21.15.53:0/3188827053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2181a0780 con 0x7fe218108140 2024-08-31T06:12:19.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.624+0000 7fe20e7fc640 1 -- 172.21.15.53:0/3188827053 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe208042030 con 0x7fe218108140 2024-08-31T06:12:19.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.624+0000 7fe225f61740 1 Processor -- start 2024-08-31T06:12:19.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.624+0000 7fe225f61740 1 -- start start 2024-08-31T06:12:19.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.624+0000 7fe225f61740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559801930070 0x559801cd52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.624+0000 7fe225f61740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.624+0000 7fe225f61740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801cd5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.624+0000 7fe225f61740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559801c4c630 con 0x5598019071b0 2024-08-31T06:12:19.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.624+0000 7fe225f61740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559801c3bbc0 con 0x55980190f390 2024-08-31T06:12:19.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.624+0000 7fe225f61740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559801c3fb70 con 0x559801930070 2024-08-31T06:12:19.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.624+0000 7fe21d788640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21d788640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39190/0 (socket says 172.21.15.53:39190) 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21d788640 1 -- 172.21.15.53:0/2651138580 learned_addr learned my addr 172.21.15.53:0/2651138580 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe20e7fc640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4cd0 0x7fe2040b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21df89640 1 --2- 172.21.15.53:0/2651138580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559801930070 0x559801cd52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21cf87640 1 --2- 172.21.15.53:0/2651138580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801cd5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21d788640 1 -- 172.21.15.53:0/2651138580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559801930070 msgr2=0x559801cd52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21df89640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4cd0 0x7fe2040b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21d788640 1 --2- 172.21.15.53:0/2651138580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559801930070 0x559801cd52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21d788640 1 -- 172.21.15.53:0/2651138580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 msgr2=0x559801cd5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21d788640 1 --2- 172.21.15.53:0/2651138580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801cd5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21d788640 1 -- 172.21.15.53:0/2651138580 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55980199b650 con 0x5598019071b0 2024-08-31T06:12:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe20e7fc640 1 -- 172.21.15.53:0/3188827053 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fe208105b30 con 0x7fe218108140 2024-08-31T06:12:19.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21d788640 1 --2- 172.21.15.53:0/2651138580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd5800 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe21400bcf0 tx=0x7fe21400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56eef494683c1032 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:19.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe2037fe640 1 -- 172.21.15.53:0/2651138580 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214015070 con 0x5598019071b0 2024-08-31T06:12:19.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe21df89640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4cd0 0x7fe2040b71e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe2100134e0 tx=0x7fe210004ab0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:19.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe2037fe640 1 -- 172.21.15.53:0/2651138580 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2140118d0 con 0x5598019071b0 2024-08-31T06:12:19.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.625+0000 7fe2037fe640 1 -- 172.21.15.53:0/2651138580 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214010750 con 0x5598019071b0 2024-08-31T06:12:19.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:12:19.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:12:19.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:12:19.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:12:19.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:12:19.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:12:19.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:12:19.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:12:19.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:12:19.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.632 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.626+0000 7fe225f61740 1 -- 172.21.15.53:0/2651138580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 msgr2=0x559801cd5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:19.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.626+0000 7fe225f61740 1 --2- 172.21.15.53:0/2651138580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd5800 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe21400bcf0 tx=0x7fe21400f730 comp rx=0 tx=0).stop 2024-08-31T06:12:19.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.626+0000 7fe225f61740 1 -- 172.21.15.53:0/2651138580 shutdown_connections 2024-08-31T06:12:19.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.626+0000 7fe225f61740 1 --2- 172.21.15.53:0/2651138580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801cd5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.626+0000 7fe225f61740 1 --2- 172.21.15.53:0/2651138580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd5800 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.626+0000 7fe225f61740 1 --2- 172.21.15.53:0/2651138580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559801930070 0x559801cd52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.626+0000 7fe225f61740 1 -- 172.21.15.53:0/2651138580 >> 172.21.15.53:0/2651138580 conn(0x559801924460 msgr2=0x559801cd31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:19.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.626+0000 7fe225f61740 1 -- 172.21.15.53:0/2651138580 shutdown_connections 2024-08-31T06:12:19.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.626+0000 7fe225f61740 1 -- 172.21.15.53:0/2651138580 wait complete. 2024-08-31T06:12:19.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.627+0000 7fe225f61740 1 -- start start 2024-08-31T06:12:19.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.627+0000 7fe225f61740 1 Processor -- start 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.627+0000 7fe225f61740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598019071b0 0x559801ce0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.627+0000 7fe225f61740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801ce0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.627+0000 7fe225f61740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559801930070 0x559801cecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.627+0000 7fe225f61740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559801a9e700 con 0x559801930070 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.627+0000 7fe225f61740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559801bc2700 con 0x55980190f390 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.627+0000 7fe225f61740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559801ce3aa0 con 0x5598019071b0 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.627+0000 7fe225f61740 10 client.0 _ll_register_callbacks cb 0x559801bf1dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21df89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559801930070 0x559801cecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21df89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559801930070 0x559801cecdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39194/0 (socket says 172.21.15.53:39194) 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21df89640 1 -- 172.21.15.53:0/1412543685 learned_addr learned my addr 172.21.15.53:0/1412543685 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21d788640 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598019071b0 0x559801ce0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21cf87640 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801ce0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21df89640 1 -- 172.21.15.53:0/1412543685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598019071b0 msgr2=0x559801ce0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21df89640 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598019071b0 0x559801ce0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21df89640 1 -- 172.21.15.53:0/1412543685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 msgr2=0x559801ce0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21df89640 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801ce0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21df89640 1 -- 172.21.15.53:0/1412543685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559801bfb8b0 con 0x559801930070 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21cf87640 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801ce0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe21df89640 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559801930070 0x559801cecdf0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fe21000eea0 tx=0x7fe210004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574dfc60a4b1f731 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe200ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe200ff9640 1 -- 172.21.15.53:0/1412543685 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210021070 con 0x559801930070 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe200ff9640 1 -- 172.21.15.53:0/1412543685 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fe210026660 con 0x559801930070 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe225f61740 1 -- 172.21.15.53:0/1412543685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2140118d0 con 0x559801930070 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.628+0000 7fe200ff9640 1 -- 172.21.15.53:0/1412543685 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe210026860 con 0x559801930070 2024-08-31T06:12:19.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.629+0000 7fe225f61740 10 client.17976 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.629+0000 7fe225f61740 1 -- 172.21.15.53:0/1412543685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559801cef8f0 con 0x559801930070 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.629+0000 7fe200ff9640 1 -- 172.21.15.53:0/1412543685 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2140118d0 con 0x559801930070 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.629+0000 7fe200ff9640 1 -- 172.21.15.53:0/1412543685 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fe21000f040 con 0x559801930070 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.629+0000 7fe225f61740 10 client.17976 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.629+0000 7fe225f61740 10 client.17976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.629+0000 7fe225f61740 20 client.17976 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.629+0000 7fe225f61740 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598018ee9f0 0x559801cf2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.629+0000 7fe225f61740 4 client.17976 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.629+0000 7fe225f61740 1 -- 172.21.15.53:0/1412543685 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559801c4e580 con 0x5598018ee9f0 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.629+0000 7fe21d788640 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598018ee9f0 0x559801cf2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.630+0000 7fe21d788640 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598018ee9f0 0x559801cf2eb0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb872bd84085f82a server_cookie=e3604d5e8171742f in_seq=0 out_seq=0 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.630+0000 7fe200ff9640 10 client.17976 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe200ff9640 1 -- 172.21.15.53:0/1412543685 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559801c4e580 con 0x5598018ee9f0 2024-08-31T06:12:19.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe200ff9640 10 client.17976 handle_command_reply: tid=0 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 1 client.17976 shutdown 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 1 -- 172.21.15.53:0/1412543685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559801930070 msgr2=0x559801cecdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559801930070 0x559801cecdf0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fe21000eea0 tx=0x7fe210004a40 comp rx=0 tx=0).stop 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 1 -- 172.21.15.53:0/1412543685 shutdown_connections 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598018ee9f0 0x559801cf2eb0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559801930070 0x559801cecdf0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801ce0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 1 --2- 172.21.15.53:0/1412543685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598019071b0 0x559801ce0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe200ff9640 0 client.17976 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 1 -- 172.21.15.53:0/1412543685 >> 172.21.15.53:0/1412543685 conn(0x559801924460 msgr2=0x559801cd8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 1 -- 172.21.15.53:0/1412543685 shutdown_connections 2024-08-31T06:12:19.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 1 -- 172.21.15.53:0/1412543685 wait complete. 2024-08-31T06:12:19.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.631+0000 7fe225f61740 20 client.17976 trim_cache size 0 max 16384 2024-08-31T06:12:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe225f61740 1 Processor -- start 2024-08-31T06:12:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe225f61740 1 -- start start 2024-08-31T06:12:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe225f61740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe225f61740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55980190f390 0x559801ceccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe225f61740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559801930070 0x559801ced230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe225f61740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181b15d0 con 0x5598019071b0 2024-08-31T06:12:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe225f61740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181b3110 con 0x559801930070 2024-08-31T06:12:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe225f61740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181b1ca0 con 0x55980190f390 2024-08-31T06:12:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21d788640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21d788640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39200/0 (socket says 172.21.15.53:39200) 2024-08-31T06:12:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21d788640 1 -- 172.21.15.53:0/1423634132 learned_addr learned my addr 172.21.15.53:0/1423634132 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21cf87640 1 --2- 172.21.15.53:0/1423634132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55980190f390 0x559801ceccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21df89640 1 --2- 172.21.15.53:0/1423634132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559801930070 0x559801ced230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21d788640 1 -- 172.21.15.53:0/1423634132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55980190f390 msgr2=0x559801ceccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21d788640 1 --2- 172.21.15.53:0/1423634132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55980190f390 0x559801ceccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21d788640 1 -- 172.21.15.53:0/1423634132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559801930070 msgr2=0x559801ced230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21d788640 1 --2- 172.21.15.53:0/1423634132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559801930070 0x559801ced230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21d788640 1 -- 172.21.15.53:0/1423634132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559801cd7b50 con 0x5598019071b0 2024-08-31T06:12:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21cf87640 1 --2- 172.21.15.53:0/1423634132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55980190f390 0x559801ceccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.649+0000 7fe21df89640 1 --2- 172.21.15.53:0/1423634132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559801930070 0x559801ced230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.650+0000 7fe21d788640 1 --2- 172.21.15.53:0/1423634132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd8ad0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe21400b870 tx=0x7fe21400b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b012f4e8999537 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.650+0000 7fe202ffd640 1 -- 172.21.15.53:0/1423634132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214015070 con 0x5598019071b0 2024-08-31T06:12:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.650+0000 7fe202ffd640 1 -- 172.21.15.53:0/1423634132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe214004640 con 0x5598019071b0 2024-08-31T06:12:19.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.650+0000 7fe202ffd640 1 -- 172.21.15.53:0/1423634132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214011700 con 0x5598019071b0 2024-08-31T06:12:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.651+0000 7fe225f61740 1 -- 172.21.15.53:0/1423634132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 msgr2=0x559801cd8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.651+0000 7fe225f61740 1 --2- 172.21.15.53:0/1423634132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd8ad0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe21400b870 tx=0x7fe21400b5e0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.651+0000 7fe225f61740 1 -- 172.21.15.53:0/1423634132 shutdown_connections 2024-08-31T06:12:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.651+0000 7fe225f61740 1 --2- 172.21.15.53:0/1423634132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559801930070 0x559801ced230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.651+0000 7fe225f61740 1 --2- 172.21.15.53:0/1423634132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55980190f390 0x559801ceccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.651+0000 7fe225f61740 1 --2- 172.21.15.53:0/1423634132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801cd8ad0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.651+0000 7fe225f61740 1 -- 172.21.15.53:0/1423634132 >> 172.21.15.53:0/1423634132 conn(0x559801924460 msgr2=0x559801cd83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.651+0000 7fe225f61740 1 -- 172.21.15.53:0/1423634132 shutdown_connections 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.651+0000 7fe225f61740 1 -- 172.21.15.53:0/1423634132 wait complete. 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.651+0000 7fe225f61740 1 -- start start 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.651+0000 7fe225f61740 1 Processor -- start 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe225f61740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801ce4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe225f61740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801ce53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe225f61740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559801930070 0x559801ce5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe225f61740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181b2a40 con 0x5598019071b0 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe225f61740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181b2370 con 0x55980190f390 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe225f61740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181af5d0 con 0x559801930070 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe225f61740 10 client.0 _ll_register_callbacks cb 0x7fe21000aeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe21d788640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801ce4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe21d788640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801ce4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39216/0 (socket says 172.21.15.53:39216) 2024-08-31T06:12:19.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe21d788640 1 -- 172.21.15.53:0/3717059048 learned_addr learned my addr 172.21.15.53:0/3717059048 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe21df89640 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559801930070 0x559801ce5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe21cf87640 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801ce53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe21d788640 1 -- 172.21.15.53:0/3717059048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559801930070 msgr2=0x559801ce5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe21d788640 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559801930070 0x559801ce5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe21d788640 1 -- 172.21.15.53:0/3717059048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 msgr2=0x559801ce53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe21d788640 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801ce53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe21d788640 1 -- 172.21.15.53:0/3717059048 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559801d5ca10 con 0x5598019071b0 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe21d788640 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801ce4e80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe21400b950 tx=0x7fe21400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f7510687f77d67 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe200ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.652+0000 7fe200ff9640 1 -- 172.21.15.53:0/3717059048 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214015070 con 0x5598019071b0 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe225f61740 1 -- 172.21.15.53:0/3717059048 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe214004640 con 0x5598019071b0 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe200ff9640 1 -- 172.21.15.53:0/3717059048 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fe214005100 con 0x5598019071b0 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe200ff9640 1 -- 172.21.15.53:0/3717059048 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe214005300 con 0x5598019071b0 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe225f61740 10 client.17982 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe225f61740 1 -- 172.21.15.53:0/3717059048 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559801d5dc10 con 0x5598019071b0 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe200ff9640 1 -- 172.21.15.53:0/3717059048 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe214004640 con 0x5598019071b0 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe200ff9640 1 -- 172.21.15.53:0/3717059048 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fe2140115e0 con 0x5598019071b0 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe225f61740 10 client.17982 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe225f61740 10 client.17982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe225f61740 20 client.17982 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe225f61740 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598018c3da0 0x559801d60140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe225f61740 4 client.17982 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.653+0000 7fe225f61740 1 -- 172.21.15.53:0/3717059048 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559801c4a020 con 0x5598018c3da0 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.654+0000 7fe21cf87640 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598018c3da0 0x559801d60140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.654+0000 7fe21cf87640 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598018c3da0 0x559801d60140 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47f32a643b29df7 server_cookie=eeeb4a827728186e in_seq=0 out_seq=0 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.654+0000 7fe200ff9640 10 client.17982 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.654+0000 7fe200ff9640 1 -- 172.21.15.53:0/3717059048 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x559801c4a020 con 0x5598018c3da0 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.654+0000 7fe200ff9640 10 client.17982 handle_command_reply: tid=0 2024-08-31T06:12:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.654+0000 7fe225f61740 1 client.17982 shutdown 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.654+0000 7fe225f61740 1 -- 172.21.15.53:0/3717059048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 msgr2=0x559801ce4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.654+0000 7fe225f61740 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801ce4e80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe21400b950 tx=0x7fe21400bed0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.654+0000 7fe225f61740 1 -- 172.21.15.53:0/3717059048 shutdown_connections 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.654+0000 7fe225f61740 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598018c3da0 0x559801d60140 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.654+0000 7fe225f61740 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559801930070 0x559801ce5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe225f61740 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55980190f390 0x559801ce53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe225f61740 1 --2- 172.21.15.53:0/3717059048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598019071b0 0x559801ce4e80 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe225f61740 1 -- 172.21.15.53:0/3717059048 >> 172.21.15.53:0/3717059048 conn(0x559801924460 msgr2=0x559801cd2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe200ff9640 0 client.17982 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe225f61740 1 -- 172.21.15.53:0/3717059048 shutdown_connections 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe225f61740 1 -- 172.21.15.53:0/3717059048 wait complete. 2024-08-31T06:12:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe225f61740 20 client.17982 trim_cache size 0 max 16384 2024-08-31T06:12:19.663 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:12:19.663 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:12:19.663 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:12:19.663 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:12:19.663 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:19.663 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "447f8d1c-f2e9-441a-9a82-2758f6950c38", 2024-08-31T06:12:19.663 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:12:19.663 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:19.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:19.664 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:12:19.664 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:12:19.664 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:12:19.664 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:19.664 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:19.664 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:19.664 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:19.664 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:19.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:19.664 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:12:19.664 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:12:19.665 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:19.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:19.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:19.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:19.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:19.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:19.665 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:12:19.665 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:12:19.665 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:19.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:12:19.666 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:19.667 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:19.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:19.669 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:19.670 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:19.670 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:19.670 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:19.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:19.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:19.670 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:12:19.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe21f9ec640 1 -- 172.21.15.53:0/3188827053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4cd0 msgr2=0x7fe2040b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:19.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe21f9ec640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4cd0 0x7fe2040b71e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe2100134e0 tx=0x7fe210004ab0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe21f9ec640 1 -- 172.21.15.53:0/3188827053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218108140 msgr2=0x7fe21819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe21f9ec640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218108140 0x7fe21819a700 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe208005940 tx=0x7fe2080042f0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe21f9ec640 1 -- 172.21.15.53:0/3188827053 shutdown_connections 2024-08-31T06:12:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe21f9ec640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4cd0 0x7fe2040b71e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe21f9ec640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe218108a90 0x7fe21819f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe21f9ec640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218108140 0x7fe21819a700 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe21f9ec640 1 --2- 172.21.15.53:0/3188827053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe218102800 0x7fe21819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.655+0000 7fe21f9ec640 1 -- 172.21.15.53:0/3188827053 >> 172.21.15.53:0/3188827053 conn(0x7fe2180794d0 msgr2=0x7fe218104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.656+0000 7fe21f9ec640 1 -- 172.21.15.53:0/3188827053 shutdown_connections 2024-08-31T06:12:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:19.656+0000 7fe21f9ec640 1 -- 172.21.15.53:0/3188827053 wait complete. 2024-08-31T06:12:19.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:12:19.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:12:19.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:12:19.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.67 MB/sec execute 249 sec latency 4024.447 ms 2024-08-31T06:12:20.436 INFO:tasks.cephfs.filesystem:scrub status for tag:447f8d1c-f2e9-441a-9a82-2758f6950c38 - {'path': '/', 'tag': '447f8d1c-f2e9-441a-9a82-2758f6950c38', 'options': 'recursive,force'} 2024-08-31T06:12:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:20 smithi130 ceph-mon[22266]: pgmap v548: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 517 KiB/s wr, 74 op/s 2024-08-31T06:12:20.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:20 smithi153 ceph-mon[22320]: pgmap v548: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 517 KiB/s wr, 74 op/s 2024-08-31T06:12:20.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:20 smithi053 ceph-mon[18924]: pgmap v548: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 517 KiB/s wr, 74 op/s 2024-08-31T06:12:20.982 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.67 MB/sec execute 250 sec latency 5024.497 ms 2024-08-31T06:12:21.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.66 MB/sec execute 251 sec latency 6024.569 ms 2024-08-31T06:12:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:22 smithi130 ceph-mon[22266]: pgmap v549: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 642 KiB/s wr, 89 op/s 2024-08-31T06:12:22.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:22 smithi153 ceph-mon[22320]: pgmap v549: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 642 KiB/s wr, 89 op/s 2024-08-31T06:12:22.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:22 smithi053 ceph-mon[18924]: pgmap v549: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 642 KiB/s wr, 89 op/s 2024-08-31T06:12:22.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.65 MB/sec execute 252 sec latency 7024.663 ms 2024-08-31T06:12:23.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.65 MB/sec execute 253 sec latency 8024.782 ms 2024-08-31T06:12:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:24 smithi130 ceph-mon[22266]: pgmap v550: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 594 KiB/s wr, 84 op/s 2024-08-31T06:12:24.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:24 smithi153 ceph-mon[22320]: pgmap v550: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 594 KiB/s wr, 84 op/s 2024-08-31T06:12:24.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:24 smithi053 ceph-mon[18924]: pgmap v550: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 594 KiB/s wr, 84 op/s 2024-08-31T06:12:24.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.64 MB/sec execute 254 sec latency 9024.832 ms 2024-08-31T06:12:25.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.63 MB/sec execute 255 sec latency 10024.935 ms 2024-08-31T06:12:26.529 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:26 smithi053 ceph-mon[18924]: pgmap v551: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 586 KiB/s wr, 86 op/s 2024-08-31T06:12:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:26 smithi130 ceph-mon[22266]: pgmap v551: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 586 KiB/s wr, 86 op/s 2024-08-31T06:12:26.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.627+0000 7fb89cca4640 1 -- 172.21.15.53:0/3337649535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb898105080 msgr2=0x7fb89810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:26.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.627+0000 7fb89cca4640 1 --2- 172.21.15.53:0/3337649535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb898105080 0x7fb89810d5c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb88c009900 tx=0x7fb88c02a410 comp rx=0 tx=0).stop 2024-08-31T06:12:26.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.627+0000 7fb89cca4640 1 -- 172.21.15.53:0/3337649535 shutdown_connections 2024-08-31T06:12:26.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.627+0000 7fb89cca4640 1 --2- 172.21.15.53:0/3337649535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb89810db50 0x7fb898110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.627+0000 7fb89cca4640 1 --2- 172.21.15.53:0/3337649535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb898105080 0x7fb89810d5c0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.627+0000 7fb89cca4640 1 --2- 172.21.15.53:0/3337649535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb898104730 0x7fb898104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.627+0000 7fb89cca4640 1 -- 172.21.15.53:0/3337649535 >> 172.21.15.53:0/3337649535 conn(0x7fb8980fe180 msgr2=0x7fb8981005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.627+0000 7fb89cca4640 1 -- 172.21.15.53:0/3337649535 shutdown_connections 2024-08-31T06:12:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.627+0000 7fb89cca4640 1 -- 172.21.15.53:0/3337649535 wait complete. 2024-08-31T06:12:26.632 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.628+0000 7fb89cca4640 1 Processor -- start 2024-08-31T06:12:26.632 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.628+0000 7fb89cca4640 1 -- start start 2024-08-31T06:12:26.632 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89cca4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb898104730 0x7fb89819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.632 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89cca4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb898105080 0x7fb89819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.632 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89cca4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb89810db50 0x7fb89819f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89cca4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb898113630 con 0x7fb898104730 2024-08-31T06:12:26.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89cca4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981134b0 con 0x7fb898105080 2024-08-31T06:12:26.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89cca4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981137b0 con 0x7fb89810db50 2024-08-31T06:12:26.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb898104730 0x7fb89819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb898104730 0x7fb89819a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53340/0 (socket says 172.21.15.53:53340) 2024-08-31T06:12:26.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89659c640 1 -- 172.21.15.53:0/2053250537 learned_addr learned my addr 172.21.15.53:0/2053250537 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:26.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb895d9b640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb898105080 0x7fb89819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb896d9d640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb89810db50 0x7fb89819f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89659c640 1 -- 172.21.15.53:0/2053250537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb89810db50 msgr2=0x7fb89819f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:26.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89659c640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb89810db50 0x7fb89819f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89659c640 1 -- 172.21.15.53:0/2053250537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb898105080 msgr2=0x7fb89819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:26.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89659c640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb898105080 0x7fb89819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89659c640 1 -- 172.21.15.53:0/2053250537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8981a0060 con 0x7fb898104730 2024-08-31T06:12:26.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.629+0000 7fb89659c640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb898104730 0x7fb89819a130 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fb88800d770 tx=0x7fb88800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:26.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.630+0000 7fb8877fe640 1 -- 172.21.15.53:0/2053250537 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888017070 con 0x7fb898104730 2024-08-31T06:12:26.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.630+0000 7fb8877fe640 1 -- 172.21.15.53:0/2053250537 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8880054b0 con 0x7fb898104730 2024-08-31T06:12:26.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.630+0000 7fb8877fe640 1 -- 172.21.15.53:0/2053250537 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888004c60 con 0x7fb898104730 2024-08-31T06:12:26.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.630+0000 7fb89cca4640 1 -- 172.21.15.53:0/2053250537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8981a0350 con 0x7fb898104730 2024-08-31T06:12:26.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.630+0000 7fb89cca4640 1 -- 172.21.15.53:0/2053250537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8981a6ae0 con 0x7fb898104730 2024-08-31T06:12:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.632+0000 7fb8a3c0f740 1 Processor -- start 2024-08-31T06:12:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.632+0000 7fb8a3c0f740 1 -- start start 2024-08-31T06:12:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547831b0 0x55ad54b26ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad5475a2f0 0x55ad54b27220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ad54a9c000 con 0x55ad547624d0 2024-08-31T06:12:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ad54a8b590 con 0x55ad5475a2f0 2024-08-31T06:12:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ad54a8f540 con 0x55ad547831b0 2024-08-31T06:12:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb895d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb895d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b27760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53344/0 (socket says 172.21.15.53:53344) 2024-08-31T06:12:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb895d9b640 1 -- 172.21.15.53:0/4074120289 learned_addr learned my addr 172.21.15.53:0/4074120289 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb896d9d640 1 --2- 172.21.15.53:0/4074120289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547831b0 0x55ad54b26ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb895d9b640 1 -- 172.21.15.53:0/4074120289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547831b0 msgr2=0x55ad54b26ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb895d9b640 1 --2- 172.21.15.53:0/4074120289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547831b0 0x55ad54b26ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb895d9b640 1 -- 172.21.15.53:0/4074120289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad5475a2f0 msgr2=0x55ad54b27220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:12:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb895d9b640 1 --2- 172.21.15.53:0/4074120289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad5475a2f0 0x55ad54b27220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb895d9b640 1 -- 172.21.15.53:0/4074120289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad547ee790 con 0x55ad547624d0 2024-08-31T06:12:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.633+0000 7fb8877fe640 1 -- 172.21.15.53:0/2053250537 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb888004e00 con 0x7fb898104730 2024-08-31T06:12:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.634+0000 7fb895d9b640 1 --2- 172.21.15.53:0/4074120289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b27760 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0057c0 tx=0x7fb88c031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ed42e3cbd27599 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.634+0000 7fb884ff9640 1 -- 172.21.15.53:0/4074120289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c040070 con 0x55ad547624d0 2024-08-31T06:12:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.634+0000 7fb884ff9640 1 -- 172.21.15.53:0/4074120289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb88c031e50 con 0x55ad547624d0 2024-08-31T06:12:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.634+0000 7fb884ff9640 1 -- 172.21.15.53:0/4074120289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c035040 con 0x55ad547624d0 2024-08-31T06:12:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8877fe640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8800b4ca0 0x7fb8800b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/4074120289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 msgr2=0x55ad54b27760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/4074120289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b27760 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0057c0 tx=0x7fb88c031ba0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb896d9d640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8800b4ca0 0x7fb8800b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/4074120289 shutdown_connections 2024-08-31T06:12:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/4074120289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b27760 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/4074120289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad5475a2f0 0x55ad54b27220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/4074120289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547831b0 0x55ad54b26ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/4074120289 >> 172.21.15.53:0/4074120289 conn(0x55ad54777300 msgr2=0x55ad54b24bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8877fe640 1 -- 172.21.15.53:0/2053250537 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fb8880e5030 con 0x7fb898104730 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/4074120289 shutdown_connections 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/4074120289 wait complete. 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb896d9d640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8800b4ca0 0x7fb8800b71b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb890005fd0 tx=0x7fb890009740 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.635+0000 7fb8a3c0f740 1 -- start start 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb8a3c0f740 1 Processor -- start 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad5475a2f0 0x55ad54b328b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b32df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547831b0 0x55ad54b3e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ad549c4ab0 con 0x55ad547624d0 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ad54a12680 con 0x55ad5475a2f0 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ad54b35400 con 0x55ad547831b0 2024-08-31T06:12:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb8a3c0f740 10 client.0 _ll_register_callbacks cb 0x55ad5479aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb895d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b32df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb895d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b32df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53354/0 (socket says 172.21.15.53:53354) 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb895d9b640 1 -- 172.21.15.53:0/782437652 learned_addr learned my addr 172.21.15.53:0/782437652 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb89659c640 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad5475a2f0 0x55ad54b328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb896d9d640 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547831b0 0x55ad54b3e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb895d9b640 1 -- 172.21.15.53:0/782437652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547831b0 msgr2=0x55ad54b3e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb895d9b640 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547831b0 0x55ad54b3e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb895d9b640 1 -- 172.21.15.53:0/782437652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad5475a2f0 msgr2=0x55ad54b328b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb895d9b640 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad5475a2f0 0x55ad54b328b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb895d9b640 1 -- 172.21.15.53:0/782437652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad54867620 con 0x55ad547624d0 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb896d9d640 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547831b0 0x55ad54b3e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.636+0000 7fb89659c640 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad5475a2f0 0x55ad54b328b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.637+0000 7fb895d9b640 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b32df0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fb88c02a930 tx=0x7fb88c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca20c164b071b45f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.637+0000 7fb87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.637+0000 7fb87dffb640 1 -- 172.21.15.53:0/782437652 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c052060 con 0x55ad547624d0 2024-08-31T06:12:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.637+0000 7fb87dffb640 1 -- 172.21.15.53:0/782437652 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fb88c03c850 con 0x55ad547624d0 2024-08-31T06:12:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.637+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/782437652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb88c031e50 con 0x55ad547624d0 2024-08-31T06:12:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.637+0000 7fb87dffb640 1 -- 172.21.15.53:0/782437652 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb88c040070 con 0x55ad547624d0 2024-08-31T06:12:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.637+0000 7fb8a3c0f740 10 client.17994 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.637+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/782437652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ad54b41470 con 0x55ad547624d0 2024-08-31T06:12:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.637+0000 7fb87dffb640 1 -- 172.21.15.53:0/782437652 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb88c031e50 con 0x55ad547624d0 2024-08-31T06:12:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.638+0000 7fb87dffb640 1 -- 172.21.15.53:0/782437652 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fb88c04c030 con 0x55ad547624d0 2024-08-31T06:12:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.638+0000 7fb8a3c0f740 10 client.17994 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.638+0000 7fb8a3c0f740 10 client.17994 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.638+0000 7fb8a3c0f740 20 client.17994 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.638+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ad54741d80 0x55ad54b447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.638+0000 7fb8a3c0f740 4 client.17994 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.638+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/782437652 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad54a9df50 con 0x55ad54741d80 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.638+0000 7fb89659c640 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ad54741d80 0x55ad54b447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.638+0000 7fb87dffb640 10 client.17994 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.638+0000 7fb89659c640 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ad54741d80 0x55ad54b447d0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a997290b5fcb472 server_cookie=d744dc2e7696de3e in_seq=0 out_seq=0 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb87dffb640 1 -- 172.21.15.53:0/782437652 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad54a9df50 con 0x55ad54741d80 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb87dffb640 10 client.17994 handle_command_reply: tid=0 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb8a3c0f740 1 client.17994 shutdown 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/782437652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 msgr2=0x55ad54b32df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b32df0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fb88c02a930 tx=0x7fb88c031630 comp rx=0 tx=0).stop 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/782437652 shutdown_connections 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ad54741d80 0x55ad54b447d0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547831b0 0x55ad54b3e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547624d0 0x55ad54b32df0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb87dffb640 0 client.17994 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/782437652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad5475a2f0 0x55ad54b328b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.639+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/782437652 >> 172.21.15.53:0/782437652 conn(0x55ad54777300 msgr2=0x55ad54b27d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.640+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/782437652 shutdown_connections 2024-08-31T06:12:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.640+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/782437652 wait complete. 2024-08-31T06:12:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.640+0000 7fb8a3c0f740 20 client.17994 trim_cache size 0 max 16384 2024-08-31T06:12:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.654+0000 7fb8a3c0f740 1 Processor -- start 2024-08-31T06:12:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.654+0000 7fb8a3c0f740 1 -- start start 2024-08-31T06:12:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad5475a2f0 0x55ad54b2de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547624d0 0x55ad54b2cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad547831b0 0x55ad54b28420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981af440 con 0x55ad5475a2f0 2024-08-31T06:12:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981b0f80 con 0x55ad547831b0 2024-08-31T06:12:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981afb10 con 0x55ad547624d0 2024-08-31T06:12:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb89659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad5475a2f0 0x55ad54b2de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb89659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad5475a2f0 0x55ad54b2de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53360/0 (socket says 172.21.15.53:53360) 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb89659c640 1 -- 172.21.15.53:0/1772375681 learned_addr learned my addr 172.21.15.53:0/1772375681 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb895d9b640 1 --2- 172.21.15.53:0/1772375681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547624d0 0x55ad54b2cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb896d9d640 1 --2- 172.21.15.53:0/1772375681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad547831b0 0x55ad54b28420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb89659c640 1 -- 172.21.15.53:0/1772375681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547624d0 msgr2=0x55ad54b2cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb89659c640 1 --2- 172.21.15.53:0/1772375681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547624d0 0x55ad54b2cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb89659c640 1 -- 172.21.15.53:0/1772375681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad547831b0 msgr2=0x55ad54b28420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb89659c640 1 --2- 172.21.15.53:0/1772375681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad547831b0 0x55ad54b28420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb89659c640 1 -- 172.21.15.53:0/1772375681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad54b28fe0 con 0x55ad5475a2f0 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.655+0000 7fb89659c640 1 --2- 172.21.15.53:0/1772375681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad5475a2f0 0x55ad54b2de10 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fb8880e2810 tx=0x7fb8880ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abb1befd9643d39 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.656+0000 7fb87ffff640 1 -- 172.21.15.53:0/1772375681 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888092e60 con 0x55ad5475a2f0 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.656+0000 7fb87ffff640 1 -- 172.21.15.53:0/1772375681 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8880abe00 con 0x55ad5475a2f0 2024-08-31T06:12:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.656+0000 7fb87ffff640 1 -- 172.21.15.53:0/1772375681 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888020040 con 0x55ad5475a2f0 2024-08-31T06:12:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/1772375681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad5475a2f0 msgr2=0x55ad54b2de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/1772375681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad5475a2f0 0x55ad54b2de10 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fb8880e2810 tx=0x7fb8880ce040 comp rx=0 tx=0).stop 2024-08-31T06:12:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/1772375681 shutdown_connections 2024-08-31T06:12:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/1772375681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad547831b0 0x55ad54b28420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/1772375681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad547624d0 0x55ad54b2cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/1772375681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad5475a2f0 0x55ad54b2de10 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/1772375681 >> 172.21.15.53:0/1772375681 conn(0x55ad54777300 msgr2=0x55ad54b27d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/1772375681 shutdown_connections 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/1772375681 wait complete. 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 -- start start 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 Processor -- start 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad5475a2f0 0x55ad54b45070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad547624d0 0x55ad54b45650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547831b0 0x55ad54bb1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981b08b0 con 0x55ad547831b0 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981b01e0 con 0x55ad547624d0 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981ad440 con 0x55ad5475a2f0 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.657+0000 7fb8a3c0f740 10 client.0 _ll_register_callbacks cb 0x7fb8900095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb896d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547831b0 0x55ad54bb1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb89659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad5475a2f0 0x55ad54b45070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb896d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547831b0 0x55ad54bb1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53366/0 (socket says 172.21.15.53:53366) 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb896d9d640 1 -- 172.21.15.53:0/3488759823 learned_addr learned my addr 172.21.15.53:0/3488759823 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb895d9b640 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad547624d0 0x55ad54b45650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb896d9d640 1 -- 172.21.15.53:0/3488759823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad5475a2f0 msgr2=0x55ad54b45070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb896d9d640 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad5475a2f0 0x55ad54b45070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb896d9d640 1 -- 172.21.15.53:0/3488759823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad547624d0 msgr2=0x55ad54b45650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb896d9d640 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad547624d0 0x55ad54b45650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb896d9d640 1 -- 172.21.15.53:0/3488759823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad54bb19f0 con 0x55ad547831b0 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb89659c640 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad5475a2f0 0x55ad54b45070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb896d9d640 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547831b0 0x55ad54bb1350 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fb89001cb40 tx=0x7fb890004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1425ab771d7bce server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb87dffb640 1 -- 172.21.15.53:0/3488759823 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890010e60 con 0x55ad547831b0 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb87dffb640 1 -- 172.21.15.53:0/3488759823 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fb8900263f0 con 0x55ad547831b0 2024-08-31T06:12:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/3488759823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8880abe00 con 0x55ad547831b0 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.658+0000 7fb87dffb640 1 -- 172.21.15.53:0/3488759823 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb890034050 con 0x55ad547831b0 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.659+0000 7fb8a3c0f740 10 client.18000 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.659+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/3488759823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ad54bb2c90 con 0x55ad547831b0 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.659+0000 7fb87dffb640 1 -- 172.21.15.53:0/3488759823 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8880abe00 con 0x55ad547831b0 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.659+0000 7fb87dffb640 1 -- 172.21.15.53:0/3488759823 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fb890019040 con 0x55ad547831b0 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.659+0000 7fb8a3c0f740 10 client.18000 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.659+0000 7fb8a3c0f740 10 client.18000 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.659+0000 7fb8a3c0f740 20 client.18000 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.659+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ad547171c0 0x55ad54bb5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.659+0000 7fb8a3c0f740 4 client.18000 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.659+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/3488759823 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad54a999f0 con 0x55ad547171c0 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.659+0000 7fb89659c640 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ad547171c0 0x55ad54bb5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.660+0000 7fb87dffb640 10 client.18000 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.660+0000 7fb89659c640 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ad547171c0 0x55ad54bb5500 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20108d3d3d0faed2 server_cookie=d8ca4decb05e3c5f in_seq=0 out_seq=0 2024-08-31T06:12:26.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:26 smithi153 ceph-mon[22320]: pgmap v551: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 586 KiB/s wr, 86 op/s 2024-08-31T06:12:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.680+0000 7fb87dffb640 1 -- 172.21.15.53:0/3488759823 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ad54a999f0 con 0x55ad547171c0 2024-08-31T06:12:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.680+0000 7fb87dffb640 10 client.18000 handle_command_reply: tid=0 2024-08-31T06:12:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.680+0000 7fb8a3c0f740 1 client.18000 shutdown 2024-08-31T06:12:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.680+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/3488759823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547831b0 msgr2=0x55ad54bb1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.680+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547831b0 0x55ad54bb1350 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fb89001cb40 tx=0x7fb890004a40 comp rx=0 tx=0).stop 2024-08-31T06:12:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/3488759823 shutdown_connections 2024-08-31T06:12:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ad547171c0 0x55ad54bb5500 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad547831b0 0x55ad54bb1350 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ad547624d0 0x55ad54b45650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb87dffb640 0 client.18000 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb8a3c0f740 1 --2- 172.21.15.53:0/3488759823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ad5475a2f0 0x55ad54b45070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/3488759823 >> 172.21.15.53:0/3488759823 conn(0x55ad54777300 msgr2=0x55ad54b33a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/3488759823 shutdown_connections 2024-08-31T06:12:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb8a3c0f740 1 -- 172.21.15.53:0/3488759823 wait complete. 2024-08-31T06:12:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb8a3c0f740 20 client.18000 trim_cache size 0 max 16384 2024-08-31T06:12:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:12:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:12:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:12:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:12:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 -- 172.21.15.53:0/2053250537 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8800b4ca0 msgr2=0x7fb8800b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8800b4ca0 0x7fb8800b71b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb890005fd0 tx=0x7fb890009740 comp rx=0 tx=0).stop 2024-08-31T06:12:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 -- 172.21.15.53:0/2053250537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb898104730 msgr2=0x7fb89819a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb898104730 0x7fb89819a130 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fb88800d770 tx=0x7fb88800dc30 comp rx=0 tx=0).stop 2024-08-31T06:12:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 -- 172.21.15.53:0/2053250537 shutdown_connections 2024-08-31T06:12:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8800b4ca0 0x7fb8800b71b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb89810db50 0x7fb89819f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb898105080 0x7fb89819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 --2- 172.21.15.53:0/2053250537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb898104730 0x7fb89819a130 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 -- 172.21.15.53:0/2053250537 >> 172.21.15.53:0/2053250537 conn(0x7fb8980fe180 msgr2=0x7fb8980fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 -- 172.21.15.53:0/2053250537 shutdown_connections 2024-08-31T06:12:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:26.681+0000 7fb89cca4640 1 -- 172.21.15.53:0/2053250537 wait complete. 2024-08-31T06:12:26.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.63 MB/sec execute 256 sec latency 11024.997 ms 2024-08-31T06:12:27.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.62 MB/sec execute 257 sec latency 12025.089 ms 2024-08-31T06:12:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:28 smithi130 ceph-mon[22266]: pgmap v552: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 531 KiB/s wr, 76 op/s 2024-08-31T06:12:28.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:28 smithi153 ceph-mon[22320]: pgmap v552: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 531 KiB/s wr, 76 op/s 2024-08-31T06:12:28.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:28 smithi053 ceph-mon[18924]: pgmap v552: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 531 KiB/s wr, 76 op/s 2024-08-31T06:12:28.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.62 MB/sec execute 258 sec latency 13025.196 ms 2024-08-31T06:12:29.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.61 MB/sec execute 259 sec latency 14025.294 ms 2024-08-31T06:12:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:30 smithi130 ceph-mon[22266]: pgmap v553: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 229 KiB/s wr, 42 op/s 2024-08-31T06:12:30.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:30 smithi153 ceph-mon[22320]: pgmap v553: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 229 KiB/s wr, 42 op/s 2024-08-31T06:12:30.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:30 smithi053 ceph-mon[18924]: pgmap v553: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 229 KiB/s wr, 42 op/s 2024-08-31T06:12:30.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.60 MB/sec execute 260 sec latency 15025.390 ms 2024-08-31T06:12:31.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.60 MB/sec execute 261 sec latency 16025.508 ms 2024-08-31T06:12:32.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:32 smithi130 ceph-mon[22266]: pgmap v554: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 189 KiB/s wr, 38 op/s 2024-08-31T06:12:32.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:32 smithi153 ceph-mon[22320]: pgmap v554: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 189 KiB/s wr, 38 op/s 2024-08-31T06:12:32.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:32 smithi053 ceph-mon[18924]: pgmap v554: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 189 KiB/s wr, 38 op/s 2024-08-31T06:12:32.983 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.59 MB/sec execute 262 sec latency 17025.578 ms 2024-08-31T06:12:33.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.59 MB/sec execute 263 sec latency 18025.670 ms 2024-08-31T06:12:34.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:34 smithi130 ceph-mon[22266]: pgmap v555: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 16 op/s 2024-08-31T06:12:34.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:34 smithi153 ceph-mon[22320]: pgmap v555: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 16 op/s 2024-08-31T06:12:34.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:34 smithi053 ceph-mon[18924]: pgmap v555: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 16 op/s 2024-08-31T06:12:34.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.58 MB/sec execute 264 sec latency 19025.786 ms 2024-08-31T06:12:35.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.57 MB/sec execute 265 sec latency 20025.833 ms 2024-08-31T06:12:36.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:36 smithi130 ceph-mon[22266]: pgmap v556: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-08-31T06:12:36.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:36 smithi153 ceph-mon[22320]: pgmap v556: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-08-31T06:12:36.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:36 smithi053 ceph-mon[18924]: pgmap v556: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-08-31T06:12:36.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.57 MB/sec execute 266 sec latency 21025.940 ms 2024-08-31T06:12:37.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.56 MB/sec execute 267 sec latency 22026.053 ms 2024-08-31T06:12:38.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:38 smithi130 ceph-mon[22266]: pgmap v557: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-08-31T06:12:38.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:38 smithi153 ceph-mon[22320]: pgmap v557: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-08-31T06:12:38.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:38 smithi053 ceph-mon[18924]: pgmap v557: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-08-31T06:12:38.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.56 MB/sec execute 268 sec latency 23026.152 ms 2024-08-31T06:12:39.119 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:12:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.779+0000 7efdad08d640 1 -- 172.21.15.53:0/680558170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda8105020 msgr2=0x7efda810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.779+0000 7efdad08d640 1 --2- 172.21.15.53:0/680558170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda8105020 0x7efda810d560 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7efd90009900 tx=0x7efd9002a410 comp rx=0 tx=0).stop 2024-08-31T06:12:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.779+0000 7efdad08d640 1 -- 172.21.15.53:0/680558170 shutdown_connections 2024-08-31T06:12:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.779+0000 7efdad08d640 1 --2- 172.21.15.53:0/680558170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efda810db30 0x7efda8110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.779+0000 7efdad08d640 1 --2- 172.21.15.53:0/680558170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda8105020 0x7efda810d560 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.779+0000 7efdad08d640 1 --2- 172.21.15.53:0/680558170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda81046d0 0x7efda8104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.779+0000 7efdad08d640 1 -- 172.21.15.53:0/680558170 >> 172.21.15.53:0/680558170 conn(0x7efda80fe180 msgr2=0x7efda81005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.779+0000 7efdad08d640 1 -- 172.21.15.53:0/680558170 shutdown_connections 2024-08-31T06:12:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.779+0000 7efdad08d640 1 -- 172.21.15.53:0/680558170 wait complete. 2024-08-31T06:12:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.780+0000 7efdad08d640 1 Processor -- start 2024-08-31T06:12:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.780+0000 7efdad08d640 1 -- start start 2024-08-31T06:12:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.780+0000 7efdad08d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda81046d0 0x7efda819a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.780+0000 7efdad08d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda8105020 0x7efda819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.780+0000 7efdad08d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efda810db30 0x7efda819f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.780+0000 7efdad08d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efda8113620 con 0x7efda8105020 2024-08-31T06:12:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.780+0000 7efdad08d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efda81134a0 con 0x7efda810db30 2024-08-31T06:12:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.780+0000 7efdad08d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efda81137a0 con 0x7efda81046d0 2024-08-31T06:12:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda8105020 0x7efda819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda8105020 0x7efda819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41762/0 (socket says 172.21.15.53:41762) 2024-08-31T06:12:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda659c640 1 -- 172.21.15.53:0/3204996969 learned_addr learned my addr 172.21.15.53:0/3204996969 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda6d9d640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda81046d0 0x7efda819a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda759e640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efda810db30 0x7efda819f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda659c640 1 -- 172.21.15.53:0/3204996969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda81046d0 msgr2=0x7efda819a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda659c640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda81046d0 0x7efda819a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda659c640 1 -- 172.21.15.53:0/3204996969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efda810db30 msgr2=0x7efda819f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda659c640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efda810db30 0x7efda819f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda659c640 1 -- 172.21.15.53:0/3204996969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda81a0070 con 0x7efda8105020 2024-08-31T06:12:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda759e640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efda810db30 0x7efda819f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efda659c640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda8105020 0x7efda819a6e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7efd90005940 tx=0x7efd900040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efd9ffff640 1 -- 172.21.15.53:0/3204996969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9003f030 con 0x7efda8105020 2024-08-31T06:12:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efdad08d640 1 -- 172.21.15.53:0/3204996969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda81a0300 con 0x7efda8105020 2024-08-31T06:12:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efd9ffff640 1 -- 172.21.15.53:0/3204996969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd90003a80 con 0x7efda8105020 2024-08-31T06:12:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efdad08d640 1 -- 172.21.15.53:0/3204996969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda81a6af0 con 0x7efda8105020 2024-08-31T06:12:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.781+0000 7efd9ffff640 1 -- 172.21.15.53:0/3204996969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90049060 con 0x7efda8105020 2024-08-31T06:12:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efdb3ffb740 1 Processor -- start 2024-08-31T06:12:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efdb3ffb740 1 -- start start 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efd9ffff640 1 -- 172.21.15.53:0/3204996969 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7efd90042030 con 0x7efda8105020 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ee11b0 0x560865284ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x560865285000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864ec04d0 0x560865285540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608651fa000 con 0x560864eb82f0 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5608651e9590 con 0x560864ee11b0 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5608651ed540 con 0x560864ec04d0 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efda6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x560865285000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efda6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x560865285000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41776/0 (socket says 172.21.15.53:41776) 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.784+0000 7efda6d9d640 1 -- 172.21.15.53:0/2306659252 learned_addr learned my addr 172.21.15.53:0/2306659252 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efda659c640 1 --2- 172.21.15.53:0/2306659252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864ec04d0 0x560865285540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efda759e640 1 --2- 172.21.15.53:0/2306659252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ee11b0 0x560865284ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efda6d9d640 1 -- 172.21.15.53:0/2306659252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864ec04d0 msgr2=0x560865285540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efda6d9d640 1 --2- 172.21.15.53:0/2306659252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864ec04d0 0x560865285540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efda6d9d640 1 -- 172.21.15.53:0/2306659252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ee11b0 msgr2=0x560865284ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efda6d9d640 1 --2- 172.21.15.53:0/2306659252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ee11b0 0x560865284ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efda6d9d640 1 -- 172.21.15.53:0/2306659252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560864f4c790 con 0x560864eb82f0 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efda6d9d640 1 --2- 172.21.15.53:0/2306659252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x560865285000 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7efd980103f0 tx=0x7efd980108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1857a71e63db44f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efd9d7fa640 1 -- 172.21.15.53:0/2306659252 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98016070 con 0x560864eb82f0 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efd9d7fa640 1 -- 172.21.15.53:0/2306659252 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd98004d20 con 0x560864eb82f0 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efd9d7fa640 1 -- 172.21.15.53:0/2306659252 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd980052f0 con 0x560864eb82f0 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.785+0000 7efd9ffff640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd940b4ca0 0x7efd940b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efda759e640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd940b4ca0 0x7efd940b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efd9ffff640 1 -- 172.21.15.53:0/3204996969 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7efd90105ac0 con 0x7efda8105020 2024-08-31T06:12:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efdb3ffb740 1 -- 172.21.15.53:0/2306659252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 msgr2=0x560865285000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efda759e640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd940b4ca0 0x7efd940b71b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7efda0005fd0 tx=0x7efda0005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/2306659252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x560865285000 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7efd980103f0 tx=0x7efd980108b0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efdb3ffb740 1 -- 172.21.15.53:0/2306659252 shutdown_connections 2024-08-31T06:12:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/2306659252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864ec04d0 0x560865285540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/2306659252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x560865285000 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/2306659252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ee11b0 0x560865284ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efdb3ffb740 1 -- 172.21.15.53:0/2306659252 >> 172.21.15.53:0/2306659252 conn(0x560864ed5300 msgr2=0x5608652829b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efdb3ffb740 1 -- 172.21.15.53:0/2306659252 shutdown_connections 2024-08-31T06:12:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.786+0000 7efdb3ffb740 1 -- 172.21.15.53:0/2306659252 wait complete. 2024-08-31T06:12:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efdb3ffb740 1 -- start start 2024-08-31T06:12:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efdb3ffb740 1 Processor -- start 2024-08-31T06:12:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864eb82f0 0x560865290610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864ec04d0 0x560865290b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ee11b0 0x56086529c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560865122ab0 con 0x560864ec04d0 2024-08-31T06:12:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560865170680 con 0x560864ee11b0 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560865293240 con 0x560864eb82f0 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efdb3ffb740 10 client.0 _ll_register_callbacks cb 0x560864ef8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efda659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864ec04d0 0x560865290b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efda659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864ec04d0 0x560865290b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41780/0 (socket says 172.21.15.53:41780) 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efda659c640 1 -- 172.21.15.53:0/1028260400 learned_addr learned my addr 172.21.15.53:0/1028260400 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efda6d9d640 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864eb82f0 0x560865290610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efda759e640 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ee11b0 0x56086529c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efda659c640 1 -- 172.21.15.53:0/1028260400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864eb82f0 msgr2=0x560865290610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efda659c640 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864eb82f0 0x560865290610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efda659c640 1 -- 172.21.15.53:0/1028260400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ee11b0 msgr2=0x56086529c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efda659c640 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ee11b0 0x56086529c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.787+0000 7efda659c640 1 -- 172.21.15.53:0/1028260400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560864fc5620 con 0x560864ec04d0 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efda659c640 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864ec04d0 0x560865290b50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7efd90006010 tx=0x7efd90009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568206c38b0d5e58 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efd8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efd8e7fc640 1 -- 172.21.15.53:0/1028260400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90035070 con 0x560864ec04d0 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efd8e7fc640 1 -- 172.21.15.53:0/1028260400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7efd900cc3f0 con 0x560864ec04d0 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efdb3ffb740 1 -- 172.21.15.53:0/1028260400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd98004d20 con 0x560864ec04d0 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efd8e7fc640 1 -- 172.21.15.53:0/1028260400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7efd900cbae0 con 0x560864ec04d0 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efdb3ffb740 10 client.18012 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efdb3ffb740 1 -- 172.21.15.53:0/1028260400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56086529f1e0 con 0x560864ec04d0 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efd8e7fc640 1 -- 172.21.15.53:0/1028260400 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd98004d20 con 0x560864ec04d0 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efd8e7fc640 1 -- 172.21.15.53:0/1028260400 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7efd900d5020 con 0x560864ec04d0 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efdb3ffb740 10 client.18012 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efdb3ffb740 10 client.18012 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efdb3ffb740 20 client.18012 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560864e9fd80 0x5608652a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efdb3ffb740 4 client.18012 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.788+0000 7efdb3ffb740 1 -- 172.21.15.53:0/1028260400 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608651fbf50 con 0x560864e9fd80 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.789+0000 7efda6d9d640 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560864e9fd80 0x5608652a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.789+0000 7efda6d9d640 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560864e9fd80 0x5608652a26c0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f02328c6e80b66fb server_cookie=4ba77a911222f51d in_seq=0 out_seq=0 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.789+0000 7efd8e7fc640 10 client.18012 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efd8e7fc640 1 -- 172.21.15.53:0/1028260400 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5608651fbf50 con 0x560864e9fd80 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efd8e7fc640 10 client.18012 handle_command_reply: tid=0 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 1 client.18012 shutdown 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 1 -- 172.21.15.53:0/1028260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864ec04d0 msgr2=0x560865290b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864ec04d0 0x560865290b50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7efd90006010 tx=0x7efd90009620 comp rx=0 tx=0).stop 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 1 -- 172.21.15.53:0/1028260400 shutdown_connections 2024-08-31T06:12:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560864e9fd80 0x5608652a26c0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ee11b0 0x56086529c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864ec04d0 0x560865290b50 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efd8e7fc640 0 client.18012 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/1028260400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864eb82f0 0x560865290610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 1 -- 172.21.15.53:0/1028260400 >> 172.21.15.53:0/1028260400 conn(0x560864ed5300 msgr2=0x560865285af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 1 -- 172.21.15.53:0/1028260400 shutdown_connections 2024-08-31T06:12:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 1 -- 172.21.15.53:0/1028260400 wait complete. 2024-08-31T06:12:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.790+0000 7efdb3ffb740 20 client.18012 trim_cache size 0 max 16384 2024-08-31T06:12:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.807+0000 7efdb3ffb740 1 Processor -- start 2024-08-31T06:12:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.807+0000 7efdb3ffb740 1 -- start start 2024-08-31T06:12:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864e9fd80 0x56086528ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x56086528f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ec04d0 0x56086528f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efda81af450 con 0x560864eb82f0 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efda81b0f90 con 0x560864ec04d0 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efda81afb20 con 0x560864e9fd80 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efda659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x56086528f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efda659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x56086528f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41784/0 (socket says 172.21.15.53:41784) 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efda659c640 1 -- 172.21.15.53:0/3335378165 learned_addr learned my addr 172.21.15.53:0/3335378165 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efda759e640 1 --2- 172.21.15.53:0/3335378165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ec04d0 0x56086528f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efda6d9d640 1 --2- 172.21.15.53:0/3335378165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864e9fd80 0x56086528ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efda659c640 1 -- 172.21.15.53:0/3335378165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864e9fd80 msgr2=0x56086528ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efda659c640 1 --2- 172.21.15.53:0/3335378165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864e9fd80 0x56086528ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efda659c640 1 -- 172.21.15.53:0/3335378165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ec04d0 msgr2=0x56086528f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efda659c640 1 --2- 172.21.15.53:0/3335378165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ec04d0 0x56086528f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efda659c640 1 -- 172.21.15.53:0/3335378165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560865292bd0 con 0x560864eb82f0 2024-08-31T06:12:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.808+0000 7efda759e640 1 --2- 172.21.15.53:0/3335378165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ec04d0 0x56086528f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.809+0000 7efda659c640 1 --2- 172.21.15.53:0/3335378165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x56086528f1a0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7efd900cc120 tx=0x7efd90003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64eb8cb9351b083d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.809+0000 7efd9cff9640 1 -- 172.21.15.53:0/3335378165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90035070 con 0x560864eb82f0 2024-08-31T06:12:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.809+0000 7efd9cff9640 1 -- 172.21.15.53:0/3335378165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd900d0a00 con 0x560864eb82f0 2024-08-31T06:12:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.809+0000 7efd9cff9640 1 -- 172.21.15.53:0/3335378165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd900044e0 con 0x560864eb82f0 2024-08-31T06:12:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.810+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3335378165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 msgr2=0x56086528f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.810+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/3335378165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x56086528f1a0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7efd900cc120 tx=0x7efd90003e40 comp rx=0 tx=0).stop 2024-08-31T06:12:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.810+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3335378165 shutdown_connections 2024-08-31T06:12:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.810+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/3335378165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ec04d0 0x56086528f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.810+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/3335378165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864eb82f0 0x56086528f1a0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.810+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/3335378165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864e9fd80 0x56086528ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.810+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3335378165 >> 172.21.15.53:0/3335378165 conn(0x560864ed5300 msgr2=0x560865289b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.810+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3335378165 shutdown_connections 2024-08-31T06:12:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.810+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3335378165 wait complete. 2024-08-31T06:12:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.810+0000 7efdb3ffb740 1 -- start start 2024-08-31T06:12:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efdb3ffb740 1 Processor -- start 2024-08-31T06:12:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864e9fd80 0x5608652946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864eb82f0 0x560865294be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efdb3ffb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ec04d0 0x560865295120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efda81b08c0 con 0x560864e9fd80 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efda81b01f0 con 0x560864ec04d0 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efdb3ffb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efda81ad450 con 0x560864eb82f0 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efdb3ffb740 10 client.0 _ll_register_callbacks cb 0x7efd90005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efda6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864e9fd80 0x5608652946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efda6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864e9fd80 0x5608652946a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41792/0 (socket says 172.21.15.53:41792) 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efda6d9d640 1 -- 172.21.15.53:0/3351902817 learned_addr learned my addr 172.21.15.53:0/3351902817 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efda759e640 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ec04d0 0x560865295120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efda659c640 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864eb82f0 0x560865294be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efda6d9d640 1 -- 172.21.15.53:0/3351902817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864eb82f0 msgr2=0x560865294be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efda6d9d640 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864eb82f0 0x560865294be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efda6d9d640 1 -- 172.21.15.53:0/3351902817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ec04d0 msgr2=0x560865295120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efda6d9d640 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ec04d0 0x560865295120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.811+0000 7efda6d9d640 1 -- 172.21.15.53:0/3351902817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56086530c2c0 con 0x560864e9fd80 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efda6d9d640 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864e9fd80 0x5608652946a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x560865283740 tx=0x7efd980099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14457c76eac735d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efd8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efd8e7fc640 1 -- 172.21.15.53:0/3351902817 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98030070 con 0x560864e9fd80 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efd8e7fc640 1 -- 172.21.15.53:0/3351902817 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7efd98012920 con 0x560864e9fd80 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3351902817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd900d0a00 con 0x560864e9fd80 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efd8e7fc640 1 -- 172.21.15.53:0/3351902817 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7efd9803c050 con 0x560864e9fd80 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efdb3ffb740 10 client.18018 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3351902817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56086530d5e0 con 0x560864e9fd80 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efd8e7fc640 1 -- 172.21.15.53:0/3351902817 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd900d0a00 con 0x560864e9fd80 2024-08-31T06:12:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efd8e7fc640 1 -- 172.21.15.53:0/3351902817 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7efd9800f040 con 0x560864e9fd80 2024-08-31T06:12:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efdb3ffb740 10 client.18018 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efdb3ffb740 10 client.18018 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efdb3ffb740 20 client.18018 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560864ee11b0 0x56086530fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efdb3ffb740 4 client.18018 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:12:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.812+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3351902817 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5608651f79f0 con 0x560864ee11b0 2024-08-31T06:12:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.813+0000 7efda659c640 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560864ee11b0 0x56086530fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.813+0000 7efd8e7fc640 10 client.18018 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.813+0000 7efda659c640 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560864ee11b0 0x56086530fc90 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4823f86f428b84d server_cookie=9f90d61f3d7272d3 in_seq=0 out_seq=0 2024-08-31T06:12:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efd8e7fc640 1 -- 172.21.15.53:0/3351902817 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5608651f79f0 con 0x560864ee11b0 2024-08-31T06:12:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efd8e7fc640 10 client.18018 handle_command_reply: tid=0 2024-08-31T06:12:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efdb3ffb740 1 client.18018 shutdown 2024-08-31T06:12:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3351902817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864e9fd80 msgr2=0x5608652946a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864e9fd80 0x5608652946a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x560865283740 tx=0x7efd980099a0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3351902817 shutdown_connections 2024-08-31T06:12:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560864ee11b0 0x56086530fc90 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560864ec04d0 0x560865295120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560864eb82f0 0x560865294be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efd8e7fc640 0 client.18018 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efdb3ffb740 1 --2- 172.21.15.53:0/3351902817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560864e9fd80 0x5608652946a0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3351902817 >> 172.21.15.53:0/3351902817 conn(0x560864ed5300 msgr2=0x5608652918b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3351902817 shutdown_connections 2024-08-31T06:12:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.826+0000 7efdb3ffb740 1 -- 172.21.15.53:0/3351902817 wait complete. 2024-08-31T06:12:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdb3ffb740 20 client.18018 trim_cache size 0 max 16384 2024-08-31T06:12:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:12:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:12:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:12:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:12:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 -- 172.21.15.53:0/3204996969 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd940b4ca0 msgr2=0x7efd940b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd940b4ca0 0x7efd940b71b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7efda0005fd0 tx=0x7efda0005850 comp rx=0 tx=0).stop 2024-08-31T06:12:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 -- 172.21.15.53:0/3204996969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda8105020 msgr2=0x7efda819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda8105020 0x7efda819a6e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7efd90005940 tx=0x7efd900040e0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 -- 172.21.15.53:0/3204996969 shutdown_connections 2024-08-31T06:12:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd940b4ca0 0x7efd940b71b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efda810db30 0x7efda819f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda8105020 0x7efda819a6e0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 --2- 172.21.15.53:0/3204996969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efda81046d0 0x7efda819a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 -- 172.21.15.53:0/3204996969 >> 172.21.15.53:0/3204996969 conn(0x7efda80fe180 msgr2=0x7efda80fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 -- 172.21.15.53:0/3204996969 shutdown_connections 2024-08-31T06:12:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:39.827+0000 7efdad08d640 1 -- 172.21.15.53:0/3204996969 wait complete. 2024-08-31T06:12:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.889+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/4253275480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb24103900 msgr2=0x7ffb24103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.889+0000 7ffb2a4c0640 1 --2- 172.21.15.53:0/4253275480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb24103900 0x7ffb24103d10 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009900 tx=0x7ffb1402a410 comp rx=0 tx=0).stop 2024-08-31T06:12:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.889+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/4253275480 shutdown_connections 2024-08-31T06:12:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.889+0000 7ffb2a4c0640 1 --2- 172.21.15.53:0/4253275480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb24109b90 0x7ffb241103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.889+0000 7ffb2a4c0640 1 --2- 172.21.15.53:0/4253275480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb24109240 0x7ffb24109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.889+0000 7ffb2a4c0640 1 --2- 172.21.15.53:0/4253275480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb24103900 0x7ffb24103d10 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.889+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/4253275480 >> 172.21.15.53:0/4253275480 conn(0x7ffb2407b5f0 msgr2=0x7ffb2407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.889+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/4253275480 shutdown_connections 2024-08-31T06:12:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.889+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/4253275480 wait complete. 2024-08-31T06:12:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb2a4c0640 1 Processor -- start 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb2a4c0640 1 -- start start 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb2a4c0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb24103900 0x7ffb2419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb2a4c0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb24109240 0x7ffb2419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb2a4c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb24109b90 0x7ffb2419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb2a4c0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffb24113700 con 0x7ffb24109b90 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb2a4c0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffb24113580 con 0x7ffb24103900 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb2a4c0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffb24113880 con 0x7ffb24109240 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb28a5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb24109b90 0x7ffb2419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb28a5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb24109b90 0x7ffb2419fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41818/0 (socket says 172.21.15.53:41818) 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb28a5d640 1 -- 172.21.15.53:0/296301332 learned_addr learned my addr 172.21.15.53:0/296301332 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb23fff640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb24103900 0x7ffb2419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.890+0000 7ffb237fe640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb24109240 0x7ffb2419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.891+0000 7ffb28a5d640 1 -- 172.21.15.53:0/296301332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb24109240 msgr2=0x7ffb2419a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.891+0000 7ffb28a5d640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb24109240 0x7ffb2419a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.891+0000 7ffb28a5d640 1 -- 172.21.15.53:0/296301332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb24103900 msgr2=0x7ffb2419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.891+0000 7ffb28a5d640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb24103900 0x7ffb2419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.891+0000 7ffb28a5d640 1 -- 172.21.15.53:0/296301332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb241a0140 con 0x7ffb24109b90 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.891+0000 7ffb28a5d640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb24109b90 0x7ffb2419fa10 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009fd0 tx=0x7ffb1c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.891+0000 7ffb217fa640 1 -- 172.21.15.53:0/296301332 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c017070 con 0x7ffb24109b90 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.891+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/296301332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb241a0430 con 0x7ffb24109b90 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.891+0000 7ffb217fa640 1 -- 172.21.15.53:0/296301332 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb1c003e00 con 0x7ffb24109b90 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.891+0000 7ffb217fa640 1 -- 172.21.15.53:0/296301332 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c010460 con 0x7ffb24109b90 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.891+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/296301332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb241a6b90 con 0x7ffb24109b90 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.892+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/296301332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb24103d10 con 0x7ffb24109b90 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.894+0000 7ffb217fa640 1 -- 172.21.15.53:0/296301332 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ffb1c003970 con 0x7ffb24109b90 2024-08-31T06:12:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.895+0000 7ffb217fa640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb0c0b4ca0 0x7ffb0c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.895+0000 7ffb23fff640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb0c0b4ca0 0x7ffb0c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.895+0000 7ffb217fa640 1 -- 172.21.15.53:0/296301332 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7ffb1c0e56c0 con 0x7ffb24109b90 2024-08-31T06:12:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.895+0000 7ffb23fff640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb0c0b4ca0 0x7ffb0c0b71b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffb140057c0 tx=0x7ffb140058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:39.898+0000 7ffb217fa640 1 -- 172.21.15.53:0/296301332 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffb1c0ac490 con 0x7ffb24109b90 2024-08-31T06:12:39.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.55 MB/sec execute 269 sec latency 24026.226 ms 2024-08-31T06:12:40.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.121+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/296301332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb2419b300 con 0x7ffb24109b90 2024-08-31T06:12:40.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.121+0000 7ffb217fa640 1 -- 172.21.15.53:0/296301332 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11985 (secure 0 0 0) 0x7ffb2419b300 con 0x7ffb24109b90 2024-08-31T06:12:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:12:40.126 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":36,"btime":"2024-08-31T06:11:22:133856+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:11:21.364258+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:12:40.126 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 36 2024-08-31T06:12:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/296301332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb0c0b4ca0 msgr2=0x7ffb0c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb0c0b4ca0 0x7ffb0c0b71b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffb140057c0 tx=0x7ffb140058d0 comp rx=0 tx=0).stop 2024-08-31T06:12:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/296301332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb24109b90 msgr2=0x7ffb2419fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb24109b90 0x7ffb2419fa10 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009fd0 tx=0x7ffb1c00b260 comp rx=0 tx=0).stop 2024-08-31T06:12:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/296301332 shutdown_connections 2024-08-31T06:12:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb0c0b4ca0 0x7ffb0c0b71b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb24109b90 0x7ffb2419fa10 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb24109240 0x7ffb2419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 --2- 172.21.15.53:0/296301332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb24103900 0x7ffb2419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/296301332 >> 172.21.15.53:0/296301332 conn(0x7ffb2407b5f0 msgr2=0x7ffb241073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/296301332 shutdown_connections 2024-08-31T06:12:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:40.124+0000 7ffb2a4c0640 1 -- 172.21.15.53:0/296301332 wait complete. 2024-08-31T06:12:40.419 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:40 smithi053 ceph-mon[18924]: pgmap v558: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-08-31T06:12:40.419 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:40 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/296301332' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:40.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:40 smithi130 ceph-mon[22266]: pgmap v558: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-08-31T06:12:40.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:40 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/296301332' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:40.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:40 smithi153 ceph-mon[22320]: pgmap v558: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-08-31T06:12:40.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:40 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/296301332' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:40.844 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id 73b50ea8 --release --await' 2024-08-31T06:12:40.845 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id 73b50ea8 --release --await 2024-08-31T06:12:40.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130331 1.54 MB/sec execute 270 sec latency 25026.274 ms 2024-08-31T06:12:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.601+0000 7f6434f0c640 1 -- 172.21.15.53:0/2435878126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6430109b90 msgr2=0x7f64301103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.601+0000 7f6434f0c640 1 --2- 172.21.15.53:0/2435878126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6430109b90 0x7f64301103c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f6428009ca0 tx=0x7f642802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.601+0000 7f6434f0c640 1 -- 172.21.15.53:0/2435878126 shutdown_connections 2024-08-31T06:12:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.601+0000 7f6434f0c640 1 --2- 172.21.15.53:0/2435878126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6430109b90 0x7f64301103c0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.601+0000 7f6434f0c640 1 --2- 172.21.15.53:0/2435878126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6430109240 0x7f6430109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.601+0000 7f6434f0c640 1 --2- 172.21.15.53:0/2435878126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6430103900 0x7f6430103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.601+0000 7f6434f0c640 1 -- 172.21.15.53:0/2435878126 >> 172.21.15.53:0/2435878126 conn(0x7f643007b5f0 msgr2=0x7f643007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.601+0000 7f6434f0c640 1 -- 172.21.15.53:0/2435878126 shutdown_connections 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.601+0000 7f6434f0c640 1 -- 172.21.15.53:0/2435878126 wait complete. 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f6434f0c640 1 Processor -- start 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f6434f0c640 1 -- start start 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f6434f0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6430103900 0x7f643019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f6434f0c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6430109240 0x7f643019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f6434f0c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6430109b90 0x7f643019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f6434f0c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6430113750 con 0x7f6430103900 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f6434f0c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64301135d0 con 0x7f6430109240 2024-08-31T06:12:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f6434f0c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64301138d0 con 0x7f6430109b90 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f642e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6430103900 0x7f643019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f642e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6430103900 0x7f643019a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41838/0 (socket says 172.21.15.53:41838) 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f642e59c640 1 -- 172.21.15.53:0/4058709550 learned_addr learned my addr 172.21.15.53:0/4058709550 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f642ed9d640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6430109b90 0x7f643019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f642dd9b640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6430109240 0x7f643019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f642e59c640 1 -- 172.21.15.53:0/4058709550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6430109b90 msgr2=0x7f643019f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.602+0000 7f642e59c640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6430109b90 0x7f643019f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.603+0000 7f642e59c640 1 -- 172.21.15.53:0/4058709550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6430109240 msgr2=0x7f643019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.603+0000 7f642e59c640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6430109240 0x7f643019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.603+0000 7f642e59c640 1 -- 172.21.15.53:0/4058709550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64301a00f0 con 0x7f6430103900 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.603+0000 7f642e59c640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6430103900 0x7f643019a180 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f642000c970 tx=0x7f642000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.603+0000 7f641f7fe640 1 -- 172.21.15.53:0/4058709550 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420007bb0 con 0x7f6430103900 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.603+0000 7f641f7fe640 1 -- 172.21.15.53:0/4058709550 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6420007d50 con 0x7f6430103900 2024-08-31T06:12:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.603+0000 7f6434f0c640 1 -- 172.21.15.53:0/4058709550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64301a03e0 con 0x7f6430103900 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.603+0000 7f641f7fe640 1 -- 172.21.15.53:0/4058709550 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420004e40 con 0x7f6430103900 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.603+0000 7f6434f0c640 1 -- 172.21.15.53:0/4058709550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64301a6b40 con 0x7f6430103900 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.605+0000 7f643b481740 1 Processor -- start 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f643b481740 1 -- start start 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f641f7fe640 1 -- 172.21.15.53:0/4058709550 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6420005020 con 0x7f6430103900 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f643b481740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e3f520 0x5562051e4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f643b481740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 0x5562051e51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f643b481740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e1e840 0x5562051e5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f643b481740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55620515ba70 con 0x556204e3f520 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f643b481740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55620514b000 con 0x556204e16660 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f643b481740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55620514efb0 con 0x556204e1e840 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f642ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e3f520 0x5562051e4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f642ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e3f520 0x5562051e4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41852/0 (socket says 172.21.15.53:41852) 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f642ed9d640 1 -- 172.21.15.53:0/3075163093 learned_addr learned my addr 172.21.15.53:0/3075163093 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f642e59c640 1 --2- 172.21.15.53:0/3075163093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 0x5562051e51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f642dd9b640 1 --2- 172.21.15.53:0/3075163093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e1e840 0x5562051e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f642ed9d640 1 -- 172.21.15.53:0/3075163093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e1e840 msgr2=0x5562051e5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f642ed9d640 1 --2- 172.21.15.53:0/3075163093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e1e840 0x5562051e5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f642ed9d640 1 -- 172.21.15.53:0/3075163093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 msgr2=0x5562051e51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f642ed9d640 1 --2- 172.21.15.53:0/3075163093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 0x5562051e51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f642ed9d640 1 -- 172.21.15.53:0/3075163093 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556204eaab00 con 0x556204e3f520 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.606+0000 7f642e59c640 1 --2- 172.21.15.53:0/3075163093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 0x5562051e51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.607+0000 7f641f7fe640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64180b4ca0 0x7f64180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.607+0000 7f642ed9d640 1 --2- 172.21.15.53:0/3075163093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e3f520 0x5562051e4c80 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6428035000 tx=0x7f6428031580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6492cccc313e0b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.607+0000 7f642e59c640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64180b4ca0 0x7f64180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.607+0000 7f641f7fe640 1 -- 172.21.15.53:0/4058709550 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f64200e5360 con 0x7f6430103900 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.607+0000 7f641cff9640 1 -- 172.21.15.53:0/3075163093 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428031b80 con 0x556204e3f520 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.607+0000 7f641cff9640 1 -- 172.21.15.53:0/3075163093 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6428036040 con 0x556204e3f520 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.607+0000 7f641cff9640 1 -- 172.21.15.53:0/3075163093 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428004500 con 0x556204e3f520 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.608+0000 7f643b481740 1 -- 172.21.15.53:0/3075163093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e3f520 msgr2=0x5562051e4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.608+0000 7f643b481740 1 --2- 172.21.15.53:0/3075163093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e3f520 0x5562051e4c80 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6428035000 tx=0x7f6428031580 comp rx=0 tx=0).stop 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.608+0000 7f642e59c640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64180b4ca0 0x7f64180b71b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f64200e2b40 tx=0x7f6420007f00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.608+0000 7f643b481740 1 -- 172.21.15.53:0/3075163093 shutdown_connections 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.608+0000 7f643b481740 1 --2- 172.21.15.53:0/3075163093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e1e840 0x5562051e5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.608+0000 7f643b481740 1 --2- 172.21.15.53:0/3075163093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 0x5562051e51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.608+0000 7f643b481740 1 --2- 172.21.15.53:0/3075163093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e3f520 0x5562051e4c80 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.608+0000 7f643b481740 1 -- 172.21.15.53:0/3075163093 >> 172.21.15.53:0/3075163093 conn(0x556204e33910 msgr2=0x5562051e2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.608+0000 7f643b481740 1 -- 172.21.15.53:0/3075163093 shutdown_connections 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.608+0000 7f643b481740 1 -- 172.21.15.53:0/3075163093 wait complete. 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f643b481740 1 -- start start 2024-08-31T06:12:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f643b481740 1 Processor -- start 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f643b481740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 0x5562051f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f643b481740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f643b481740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e3f520 0x5562051fc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f643b481740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562051f3400 con 0x556204e1e840 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f643b481740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55620510c520 con 0x556204e16660 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f643b481740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5562051f3580 con 0x556204e3f520 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f643b481740 10 client.0 _ll_register_callbacks cb 0x556205144c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f642dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f642dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051f0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41858/0 (socket says 172.21.15.53:41858) 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f642dd9b640 1 -- 172.21.15.53:0/2431996689 learned_addr learned my addr 172.21.15.53:0/2431996689 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f642ed9d640 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e3f520 0x5562051fc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.609+0000 7f642ed9d640 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 0x5562051f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f642dd9b640 1 -- 172.21.15.53:0/2431996689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e3f520 msgr2=0x5562051fc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f642dd9b640 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e3f520 0x5562051fc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f642dd9b640 1 -- 172.21.15.53:0/2431996689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 msgr2=0x5562051f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f642dd9b640 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 0x5562051f08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f642dd9b640 1 -- 172.21.15.53:0/2431996689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556204f21960 con 0x556204e1e840 2024-08-31T06:12:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f642ed9d640 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 0x5562051f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:12:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f642dd9b640 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051f0e30 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f642400be80 tx=0x7f6424012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e65ae0c91ad5fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f6415ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f6415ffb640 1 -- 172.21.15.53:0/2431996689 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642401f060 con 0x556204e1e840 2024-08-31T06:12:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f6415ffb640 1 -- 172.21.15.53:0/2431996689 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f64240108a0 con 0x556204e1e840 2024-08-31T06:12:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f643b481740 1 -- 172.21.15.53:0/2431996689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5562050ea9a0 con 0x556204e1e840 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f6415ffb640 1 -- 172.21.15.53:0/2431996689 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6424010aa0 con 0x556204e1e840 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f643b481740 10 client.18036 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f643b481740 1 -- 172.21.15.53:0/2431996689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5562051ff640 con 0x556204e1e840 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.610+0000 7f6415ffb640 1 -- 172.21.15.53:0/2431996689 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5562050ea9a0 con 0x556204e1e840 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.611+0000 7f6415ffb640 1 -- 172.21.15.53:0/2431996689 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f6424019030 con 0x556204e1e840 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.611+0000 7f643b481740 10 client.18036 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.611+0000 7f643b481740 10 client.18036 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.611+0000 7f643b481740 20 client.18036 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.611+0000 7f643b481740 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556204dfdea0 0x556205202b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.611+0000 7f643b481740 4 client.18036 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.611+0000 7f643b481740 1 -- 172.21.15.53:0/2431996689 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55620515d9c0 con 0x556204dfdea0 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.611+0000 7f642ed9d640 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556204dfdea0 0x556205202b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.611+0000 7f642ed9d640 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556204dfdea0 0x556205202b70 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=296b9c788a2d921e server_cookie=7d3ba0cdb687ae40 in_seq=0 out_seq=0 2024-08-31T06:12:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.611+0000 7f6415ffb640 10 client.18036 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f6415ffb640 1 -- 172.21.15.53:0/2431996689 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55620515d9c0 con 0x556204dfdea0 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f6415ffb640 10 client.18036 handle_command_reply: tid=0 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f643b481740 1 client.18036 shutdown 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f643b481740 1 -- 172.21.15.53:0/2431996689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 msgr2=0x5562051f0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f643b481740 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051f0e30 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f642400be80 tx=0x7f6424012820 comp rx=0 tx=0).stop 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f643b481740 1 -- 172.21.15.53:0/2431996689 shutdown_connections 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f643b481740 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556204dfdea0 0x556205202b70 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f643b481740 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e3f520 0x5562051fc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f643b481740 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051f0e30 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f6415ffb640 0 client.18036 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f643b481740 1 --2- 172.21.15.53:0/2431996689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e16660 0x5562051f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f643b481740 1 -- 172.21.15.53:0/2431996689 >> 172.21.15.53:0/2431996689 conn(0x556204e33910 msgr2=0x5562051e7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f643b481740 1 -- 172.21.15.53:0/2431996689 shutdown_connections 2024-08-31T06:12:41.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.612+0000 7f643b481740 1 -- 172.21.15.53:0/2431996689 wait complete. 2024-08-31T06:12:41.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.613+0000 7f643b481740 20 client.18036 trim_cache size 0 max 16384 2024-08-31T06:12:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.630+0000 7f643b481740 1 Processor -- start 2024-08-31T06:12:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.630+0000 7f643b481740 1 -- start start 2024-08-31T06:12:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.630+0000 7f643b481740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204dfdea0 0x5562051e8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.630+0000 7f643b481740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e16660 0x5562051fc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.630+0000 7f643b481740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.630+0000 7f643b481740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f64301af530 con 0x556204e1e840 2024-08-31T06:12:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.630+0000 7f643b481740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64301b1070 con 0x556204dfdea0 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.630+0000 7f643b481740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64301afc00 con 0x556204e16660 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.630+0000 7f642ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.630+0000 7f642ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051fccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41866/0 (socket says 172.21.15.53:41866) 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.630+0000 7f642ed9d640 1 -- 172.21.15.53:0/3177978949 learned_addr learned my addr 172.21.15.53:0/3177978949 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.631+0000 7f642ed9d640 1 --2- 172.21.15.53:0/3177978949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204dfdea0 0x5562051e8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.631+0000 7f642ed9d640 1 -- 172.21.15.53:0/3177978949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e16660 msgr2=0x5562051fc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.631+0000 7f642ed9d640 1 --2- 172.21.15.53:0/3177978949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e16660 0x5562051fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.631+0000 7f642ed9d640 1 -- 172.21.15.53:0/3177978949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204dfdea0 msgr2=0x5562051e8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.631+0000 7f642ed9d640 1 --2- 172.21.15.53:0/3177978949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204dfdea0 0x5562051e8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.631+0000 7f642ed9d640 1 -- 172.21.15.53:0/3177978949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562051f1750 con 0x556204e1e840 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.631+0000 7f642ed9d640 1 --2- 172.21.15.53:0/3177978949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051fccb0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f642802aeb0 tx=0x7f6428031580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3c77fc24e1a69a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.631+0000 7f6417fff640 1 -- 172.21.15.53:0/3177978949 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428031b00 con 0x556204e1e840 2024-08-31T06:12:41.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.631+0000 7f6417fff640 1 -- 172.21.15.53:0/3177978949 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6428036040 con 0x556204e1e840 2024-08-31T06:12:41.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.631+0000 7f6417fff640 1 -- 172.21.15.53:0/3177978949 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428004470 con 0x556204e1e840 2024-08-31T06:12:41.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.632+0000 7f643b481740 1 -- 172.21.15.53:0/3177978949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 msgr2=0x5562051fccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:41.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.632+0000 7f643b481740 1 --2- 172.21.15.53:0/3177978949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051fccb0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f642802aeb0 tx=0x7f6428031580 comp rx=0 tx=0).stop 2024-08-31T06:12:41.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.632+0000 7f643b481740 1 -- 172.21.15.53:0/3177978949 shutdown_connections 2024-08-31T06:12:41.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.632+0000 7f643b481740 1 --2- 172.21.15.53:0/3177978949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e1e840 0x5562051fccb0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.632+0000 7f643b481740 1 --2- 172.21.15.53:0/3177978949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204e16660 0x5562051fc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.632+0000 7f643b481740 1 --2- 172.21.15.53:0/3177978949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204dfdea0 0x5562051e8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.632+0000 7f643b481740 1 -- 172.21.15.53:0/3177978949 >> 172.21.15.53:0/3177978949 conn(0x556204e33910 msgr2=0x5562051e7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:41.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.632+0000 7f643b481740 1 -- 172.21.15.53:0/3177978949 shutdown_connections 2024-08-31T06:12:41.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.632+0000 7f643b481740 1 -- 172.21.15.53:0/3177978949 wait complete. 2024-08-31T06:12:41.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.632+0000 7f643b481740 1 -- start start 2024-08-31T06:12:41.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f643b481740 1 Processor -- start 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f643b481740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204dfdea0 0x5562051f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f643b481740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e16660 0x5562051f5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f643b481740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e1e840 0x55620526c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f643b481740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f64301b09a0 con 0x556204e16660 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f643b481740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64301b02d0 con 0x556204e1e840 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f643b481740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64301ad530 con 0x556204dfdea0 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f643b481740 10 client.0 _ll_register_callbacks cb 0x7f642400b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f642dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e16660 0x5562051f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f642dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e16660 0x5562051f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41872/0 (socket says 172.21.15.53:41872) 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f642dd9b640 1 -- 172.21.15.53:0/1381552456 learned_addr learned my addr 172.21.15.53:0/1381552456 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f642ed9d640 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204dfdea0 0x5562051f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f642ed9d640 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e1e840 0x55620526c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f642dd9b640 1 -- 172.21.15.53:0/1381552456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204dfdea0 msgr2=0x5562051f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f642dd9b640 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204dfdea0 0x5562051f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f642dd9b640 1 -- 172.21.15.53:0/1381552456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e1e840 msgr2=0x55620526c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f642dd9b640 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e1e840 0x55620526c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f642dd9b640 1 -- 172.21.15.53:0/1381552456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55620526cab0 con 0x556204e16660 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.633+0000 7f642ed9d640 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204dfdea0 0x5562051f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f642dd9b640 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e16660 0x5562051f5170 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f642401ae30 tx=0x7f6424012e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60f5e3b7dac77a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f6415ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f6415ffb640 1 -- 172.21.15.53:0/1381552456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642401f020 con 0x556204e16660 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f6415ffb640 1 -- 172.21.15.53:0/1381552456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f64240229c0 con 0x556204e16660 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f643b481740 1 -- 172.21.15.53:0/1381552456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6428036040 con 0x556204e16660 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f6415ffb640 1 -- 172.21.15.53:0/1381552456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6424010e80 con 0x556204e16660 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f643b481740 10 client.18042 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f643b481740 1 -- 172.21.15.53:0/1381552456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55620526dc40 con 0x556204e16660 2024-08-31T06:12:41.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f6415ffb640 1 -- 172.21.15.53:0/1381552456 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6428036040 con 0x556204e16660 2024-08-31T06:12:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f6415ffb640 1 -- 172.21.15.53:0/1381552456 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f6424019040 con 0x556204e16660 2024-08-31T06:12:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f643b481740 10 client.18042 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f643b481740 10 client.18042 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:12:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f643b481740 20 client.18042 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f643b481740 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556204e3f520 0x5562052703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f643b481740 4 client.18042 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "73b50ea8", "release": true, "await": true}] 2024-08-31T06:12:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.634+0000 7f643b481740 1 -- 172.21.15.53:0/1381552456 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "73b50ea8", "release": true, "await": true}) -- 0x556205159460 con 0x556204e3f520 2024-08-31T06:12:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.635+0000 7f642ed9d640 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556204e3f520 0x5562052703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.635+0000 7f642ed9d640 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556204e3f520 0x5562052703c0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5bc103d04b2683 server_cookie=fb4353ae154c4fd0 in_seq=0 out_seq=0 2024-08-31T06:12:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.635+0000 7f6415ffb640 10 client.18042 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f6415ffb640 1 -- 172.21.15.53:0/1381552456 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556205159460 con 0x556204e3f520 2024-08-31T06:12:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f6415ffb640 10 client.18042 handle_command_reply: tid=0 2024-08-31T06:12:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 1 client.18042 shutdown 2024-08-31T06:12:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 1 -- 172.21.15.53:0/1381552456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e16660 msgr2=0x5562051f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e16660 0x5562051f5170 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f642401ae30 tx=0x7f6424012e10 comp rx=0 tx=0).stop 2024-08-31T06:12:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 1 -- 172.21.15.53:0/1381552456 shutdown_connections 2024-08-31T06:12:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556204e3f520 0x5562052703c0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556204e1e840 0x55620526c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f6415ffb640 0 client.18042 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556204e16660 0x5562051f5170 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 1 --2- 172.21.15.53:0/1381552456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556204dfdea0 0x5562051f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 1 -- 172.21.15.53:0/1381552456 >> 172.21.15.53:0/1381552456 conn(0x556204e33910 msgr2=0x5562051e6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 1 -- 172.21.15.53:0/1381552456 shutdown_connections 2024-08-31T06:12:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 1 -- 172.21.15.53:0/1381552456 wait complete. 2024-08-31T06:12:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.662+0000 7f643b481740 20 client.18042 trim_cache size 0 max 16384 2024-08-31T06:12:41.667 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:12:41.668 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 36, 2024-08-31T06:12:41.668 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:12:41.668 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 28, 2024-08-31T06:12:41.668 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:12:41.668 INFO:teuthology.orchestra.run.smithi053.stdout: "73b50ea8": { 2024-08-31T06:12:41.668 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 28, 2024-08-31T06:12:41.668 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:12:41.668 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 148.0, 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:12:41.669 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:41.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:41.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:41.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:41.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:41.670 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:12:41.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 -- 172.21.15.53:0/4058709550 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64180b4ca0 msgr2=0x7f64180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:41.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64180b4ca0 0x7f64180b71b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f64200e2b40 tx=0x7f6420007f00 comp rx=0 tx=0).stop 2024-08-31T06:12:41.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 -- 172.21.15.53:0/4058709550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6430103900 msgr2=0x7f643019a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:41.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6430103900 0x7f643019a180 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f642000c970 tx=0x7f642000ce30 comp rx=0 tx=0).stop 2024-08-31T06:12:41.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 -- 172.21.15.53:0/4058709550 shutdown_connections 2024-08-31T06:12:41.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64180b4ca0 0x7f64180b71b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6430109b90 0x7f643019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6430109240 0x7f643019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 --2- 172.21.15.53:0/4058709550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6430103900 0x7f643019a180 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:41.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 -- 172.21.15.53:0/4058709550 >> 172.21.15.53:0/4058709550 conn(0x7f643007b5f0 msgr2=0x7f64301072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:41.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 -- 172.21.15.53:0/4058709550 shutdown_connections 2024-08-31T06:12:41.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:41.663+0000 7f6434f0c640 1 -- 172.21.15.53:0/4058709550 wait complete. 2024-08-31T06:12:41.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 130629 1.55 MB/sec execute 271 sec latency 25714.861 ms 2024-08-31T06:12:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:42 smithi053 ceph-mon[18924]: pgmap v559: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-31T06:12:42.549 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '73b50ea8', total seconds elapsed: 31.4 2024-08-31T06:12:42.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:42 smithi130 ceph-mon[22266]: pgmap v559: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-31T06:12:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:42 smithi153 ceph-mon[22320]: pgmap v559: 97 pgs: 97 active+clean; 74 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-31T06:12:42.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 131103 1.56 MB/sec execute 272 sec latency 14.719 ms 2024-08-31T06:12:43.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 131584 1.57 MB/sec execute 273 sec latency 12.805 ms 2024-08-31T06:12:44.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:44 smithi130 ceph-mon[22266]: pgmap v560: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 KiB/s wr, 12 op/s 2024-08-31T06:12:44.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:44 smithi153 ceph-mon[22320]: pgmap v560: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 KiB/s wr, 12 op/s 2024-08-31T06:12:44.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:44 smithi053 ceph-mon[18924]: pgmap v560: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 38 KiB/s wr, 12 op/s 2024-08-31T06:12:44.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 131859 1.56 MB/sec execute 274 sec latency 14.350 ms 2024-08-31T06:12:45.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 132338 1.56 MB/sec execute 275 sec latency 14.277 ms 2024-08-31T06:12:46.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:46 smithi130 ceph-mon[22266]: pgmap v561: 97 pgs: 97 active+clean; 76 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 117 KiB/s wr, 22 op/s 2024-08-31T06:12:46.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:46 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:12:46.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:46 smithi153 ceph-mon[22320]: pgmap v561: 97 pgs: 97 active+clean; 76 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 117 KiB/s wr, 22 op/s 2024-08-31T06:12:46.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:46 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:12:46.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:46 smithi053 ceph-mon[18924]: pgmap v561: 97 pgs: 97 active+clean; 76 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 117 KiB/s wr, 22 op/s 2024-08-31T06:12:46.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:46 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:12:46.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 132835 1.57 MB/sec execute 276 sec latency 25.980 ms 2024-08-31T06:12:47.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:12:47.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:12:47.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:12:47.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:12:47.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:12:47.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:12:47.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:12:47.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:12:47.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:12:47.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 133394 1.57 MB/sec execute 277 sec latency 38.790 ms 2024-08-31T06:12:48.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:48 smithi130 ceph-mon[22266]: pgmap v562: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 369 KiB/s wr, 34 op/s 2024-08-31T06:12:48.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:48 smithi153 ceph-mon[22320]: pgmap v562: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 369 KiB/s wr, 34 op/s 2024-08-31T06:12:48.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:48 smithi053 ceph-mon[18924]: pgmap v562: 97 pgs: 97 active+clean; 77 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 369 KiB/s wr, 34 op/s 2024-08-31T06:12:48.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 133877 1.57 MB/sec execute 278 sec latency 19.278 ms 2024-08-31T06:12:49.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 134582 1.59 MB/sec execute 279 sec latency 15.607 ms 2024-08-31T06:12:50.436 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:12:50.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:50 smithi130 ceph-mon[22266]: pgmap v563: 97 pgs: 97 active+clean; 79 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 619 KiB/s wr, 60 op/s 2024-08-31T06:12:50.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:50 smithi153 ceph-mon[22320]: pgmap v563: 97 pgs: 97 active+clean; 79 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 619 KiB/s wr, 60 op/s 2024-08-31T06:12:50.717 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:50.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:50 smithi053 ceph-mon[18924]: pgmap v563: 97 pgs: 97 active+clean; 79 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 619 KiB/s wr, 60 op/s 2024-08-31T06:12:50.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 135022 1.60 MB/sec execute 280 sec latency 16.714 ms 2024-08-31T06:12:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.230+0000 7f541ff63640 1 -- 172.21.15.53:0/929817092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54181047d0 msgr2=0x7f5418104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.230+0000 7f541ff63640 1 --2- 172.21.15.53:0/929817092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54181047d0 0x7f5418104be0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f5414009900 tx=0x7f541402a410 comp rx=0 tx=0).stop 2024-08-31T06:12:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.230+0000 7f541ff63640 1 -- 172.21.15.53:0/929817092 shutdown_connections 2024-08-31T06:12:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.230+0000 7f541ff63640 1 --2- 172.21.15.53:0/929817092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f541810dc00 0x7f54181100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.230+0000 7f541ff63640 1 --2- 172.21.15.53:0/929817092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5418105120 0x7f541810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.230+0000 7f541ff63640 1 --2- 172.21.15.53:0/929817092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54181047d0 0x7f5418104be0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.230+0000 7f541ff63640 1 -- 172.21.15.53:0/929817092 >> 172.21.15.53:0/929817092 conn(0x7f5418079530 msgr2=0x7f5418079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.231+0000 7f541ff63640 1 -- 172.21.15.53:0/929817092 shutdown_connections 2024-08-31T06:12:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.231+0000 7f541ff63640 1 -- 172.21.15.53:0/929817092 wait complete. 2024-08-31T06:12:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.231+0000 7f541ff63640 1 Processor -- start 2024-08-31T06:12:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.231+0000 7f541ff63640 1 -- start start 2024-08-31T06:12:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541ff63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54181047d0 0x7f541819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541ff63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5418105120 0x7f541819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541ff63640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f541810dc00 0x7f541819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541ff63640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5418113760 con 0x7f5418105120 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541ff63640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54181135e0 con 0x7f54181047d0 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541ff63640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54181138e0 con 0x7f541810dc00 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541d4fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5418105120 0x7f541819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541d4fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5418105120 0x7f541819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52082/0 (socket says 172.21.15.53:52082) 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541d4fe640 1 -- 172.21.15.53:0/1251254870 learned_addr learned my addr 172.21.15.53:0/1251254870 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541dcff640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54181047d0 0x7f541819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541e500640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f541810dc00 0x7f541819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541d4fe640 1 -- 172.21.15.53:0/1251254870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f541810dc00 msgr2=0x7f541819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541d4fe640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f541810dc00 0x7f541819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541d4fe640 1 -- 172.21.15.53:0/1251254870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54181047d0 msgr2=0x7f541819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541d4fe640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54181047d0 0x7f541819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541d4fe640 1 -- 172.21.15.53:0/1251254870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54181a0120 con 0x7f5418105120 2024-08-31T06:12:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.232+0000 7f541d4fe640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5418105120 0x7f541819a750 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f540800e970 tx=0x7f540800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.233+0000 7f540effd640 1 -- 172.21.15.53:0/1251254870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540800cd80 con 0x7f5418105120 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.233+0000 7f541ff63640 1 -- 172.21.15.53:0/1251254870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54181a0410 con 0x7f5418105120 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.233+0000 7f540effd640 1 -- 172.21.15.53:0/1251254870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54080035f0 con 0x7f5418105120 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.233+0000 7f540effd640 1 -- 172.21.15.53:0/1251254870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408010690 con 0x7f5418105120 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.233+0000 7f541ff63640 1 -- 172.21.15.53:0/1251254870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54181a6b70 con 0x7f5418105120 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.235+0000 7f540effd640 1 -- 172.21.15.53:0/1251254870 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5408004000 con 0x7f5418105120 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.236+0000 7f54264d8740 1 Processor -- start 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.236+0000 7f54264d8740 1 -- start start 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.236+0000 7f540effd640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54040b4ca0 0x7f54040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.236+0000 7f54264d8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a252070 0x55990a5f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.236+0000 7f54264d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 0x55990a5f7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.236+0000 7f54264d8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a231390 0x55990a5f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.236+0000 7f54264d8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55990a56e630 con 0x55990a252070 2024-08-31T06:12:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.236+0000 7f54264d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55990a55dbc0 con 0x55990a2291b0 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.236+0000 7f54264d8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55990a561b70 con 0x55990a231390 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541e500640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54040b4ca0 0x7f54040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541dcff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a252070 0x55990a5f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541dcff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a252070 0x55990a5f72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52092/0 (socket says 172.21.15.53:52092) 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541dcff640 1 -- 172.21.15.53:0/4277547305 learned_addr learned my addr 172.21.15.53:0/4277547305 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541e500640 1 --2- 172.21.15.53:0/4277547305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a231390 0x55990a5f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541d4fe640 1 --2- 172.21.15.53:0/4277547305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 0x55990a5f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f540effd640 1 -- 172.21.15.53:0/1251254870 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f54080e5860 con 0x7f5418105120 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541d4fe640 1 -- 172.21.15.53:0/4277547305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a231390 msgr2=0x55990a5f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541d4fe640 1 --2- 172.21.15.53:0/4277547305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a231390 0x55990a5f7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541d4fe640 1 -- 172.21.15.53:0/4277547305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a252070 msgr2=0x55990a5f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541d4fe640 1 --2- 172.21.15.53:0/4277547305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a252070 0x55990a5f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541d4fe640 1 -- 172.21.15.53:0/4277547305 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990a2bd650 con 0x55990a2291b0 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541e500640 1 --2- 172.21.15.53:0/4277547305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a231390 0x55990a5f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541e500640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54040b4ca0 0x7f54040b71b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5410009fd0 tx=0x7f5410009de0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.237+0000 7f541d4fe640 1 --2- 172.21.15.53:0/4277547305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 0x55990a5f7800 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f54080e2f30 tx=0x7f5408003d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c0ac26f5c9c039e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.238+0000 7f5403fff640 1 -- 172.21.15.53:0/4277547305 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408009460 con 0x55990a2291b0 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.238+0000 7f5403fff640 1 -- 172.21.15.53:0/4277547305 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54080ab9e0 con 0x55990a2291b0 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.238+0000 7f5403fff640 1 -- 172.21.15.53:0/4277547305 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408003aa0 con 0x55990a2291b0 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.239+0000 7f54264d8740 1 -- 172.21.15.53:0/4277547305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 msgr2=0x55990a5f7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.239+0000 7f54264d8740 1 --2- 172.21.15.53:0/4277547305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 0x55990a5f7800 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f54080e2f30 tx=0x7f5408003d70 comp rx=0 tx=0).stop 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.239+0000 7f54264d8740 1 -- 172.21.15.53:0/4277547305 shutdown_connections 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.239+0000 7f54264d8740 1 --2- 172.21.15.53:0/4277547305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a231390 0x55990a5f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.239+0000 7f54264d8740 1 --2- 172.21.15.53:0/4277547305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 0x55990a5f7800 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.239+0000 7f54264d8740 1 --2- 172.21.15.53:0/4277547305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a252070 0x55990a5f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.239+0000 7f54264d8740 1 -- 172.21.15.53:0/4277547305 >> 172.21.15.53:0/4277547305 conn(0x55990a246460 msgr2=0x55990a5f51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.239+0000 7f54264d8740 1 -- 172.21.15.53:0/4277547305 shutdown_connections 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.239+0000 7f54264d8740 1 -- 172.21.15.53:0/4277547305 wait complete. 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.239+0000 7f54264d8740 1 -- start start 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.239+0000 7f54264d8740 1 Processor -- start 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f54264d8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2291b0 0x55990a606e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f54264d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 0x55990a607360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f54264d8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a252070 0x55990a613070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f54264d8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55990a3c0700 con 0x55990a252070 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f54264d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55990a4e4700 con 0x55990a231390 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f54264d8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55990a609d40 con 0x55990a2291b0 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f54264d8740 10 client.0 _ll_register_callbacks cb 0x55990a513dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f541dcff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2291b0 0x55990a606e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f541d4fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 0x55990a607360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f541d4fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 0x55990a607360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:40824/0 (socket says 172.21.15.53:40824) 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f541d4fe640 1 -- 172.21.15.53:0/2764589968 learned_addr learned my addr 172.21.15.53:0/2764589968 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f541e500640 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a252070 0x55990a613070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f541d4fe640 1 -- 172.21.15.53:0/2764589968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2291b0 msgr2=0x55990a606e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f541d4fe640 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2291b0 0x55990a606e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f541d4fe640 1 -- 172.21.15.53:0/2764589968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a252070 msgr2=0x55990a613070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f541d4fe640 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a252070 0x55990a613070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.240+0000 7f541d4fe640 1 -- 172.21.15.53:0/2764589968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990a51d8b0 con 0x55990a231390 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.241+0000 7f541d4fe640 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 0x55990a607360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f54080a7f50 tx=0x7f54080a7d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbc4468636d70ac4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.241+0000 7f54017fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.241+0000 7f54017fa640 1 -- 172.21.15.53:0/2764589968 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54080abed0 con 0x55990a231390 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.241+0000 7f54264d8740 1 -- 172.21.15.53:0/2764589968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54080ab9e0 con 0x55990a231390 2024-08-31T06:12:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.241+0000 7f54017fa640 1 -- 172.21.15.53:0/2764589968 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f5408097160 con 0x55990a231390 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.241+0000 7f54017fa640 1 -- 172.21.15.53:0/2764589968 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f54080b0740 con 0x55990a231390 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.241+0000 7f54264d8740 10 client.27326 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.241+0000 7f54264d8740 1 -- 172.21.15.53:0/2764589968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55990a615b30 con 0x55990a231390 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.241+0000 7f54017fa640 1 -- 172.21.15.53:0/2764589968 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54080ab9e0 con 0x55990a231390 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.242+0000 7f54017fa640 1 -- 172.21.15.53:0/2764589968 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f5408098730 con 0x55990a231390 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.242+0000 7f54264d8740 10 client.27326 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.242+0000 7f54264d8740 10 client.27326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.242+0000 7f54264d8740 20 client.27326 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.242+0000 7f54264d8740 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55990a2109f0 0x55990a618e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.242+0000 7f54264d8740 4 client.27326 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.242+0000 7f54264d8740 1 -- 172.21.15.53:0/2764589968 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55990a570580 con 0x55990a2109f0 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.242+0000 7f541dcff640 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55990a2109f0 0x55990a618e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.242+0000 7f54017fa640 10 client.27326 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.242+0000 7f541dcff640 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55990a2109f0 0x55990a618e90 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=436b714178048d30 server_cookie=8bd5efe5e59c6577 in_seq=0 out_seq=0 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.243+0000 7f54017fa640 1 -- 172.21.15.53:0/2764589968 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55990a570580 con 0x55990a2109f0 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.243+0000 7f54017fa640 10 client.27326 handle_command_reply: tid=0 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.243+0000 7f54264d8740 1 client.27326 shutdown 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.243+0000 7f54264d8740 1 -- 172.21.15.53:0/2764589968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 msgr2=0x55990a607360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.243+0000 7f54264d8740 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 0x55990a607360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f54080a7f50 tx=0x7f54080a7d90 comp rx=0 tx=0).stop 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.243+0000 7f54264d8740 1 -- 172.21.15.53:0/2764589968 shutdown_connections 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.244+0000 7f54264d8740 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55990a2109f0 0x55990a618e90 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.244+0000 7f54264d8740 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a252070 0x55990a613070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.244+0000 7f54264d8740 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 0x55990a607360 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.244+0000 7f54017fa640 0 client.27326 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.244+0000 7f54264d8740 1 --2- 172.21.15.53:0/2764589968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2291b0 0x55990a606e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.244+0000 7f54264d8740 1 -- 172.21.15.53:0/2764589968 >> 172.21.15.53:0/2764589968 conn(0x55990a246460 msgr2=0x55990a5f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.244+0000 7f54264d8740 1 -- 172.21.15.53:0/2764589968 shutdown_connections 2024-08-31T06:12:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.244+0000 7f54264d8740 1 -- 172.21.15.53:0/2764589968 wait complete. 2024-08-31T06:12:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.244+0000 7f54264d8740 20 client.27326 trim_cache size 0 max 16384 2024-08-31T06:12:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f54264d8740 1 Processor -- start 2024-08-31T06:12:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f54264d8740 1 -- start start 2024-08-31T06:12:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f54264d8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2109f0 0x55990a612fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f54264d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 0x55990a606bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f54264d8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a231390 0x55990a607110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f54264d8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f54181ad3a0 con 0x55990a2109f0 2024-08-31T06:12:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f54264d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54181aeee0 con 0x55990a2291b0 2024-08-31T06:12:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f54264d8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54181ada70 con 0x55990a231390 2024-08-31T06:12:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f541dcff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2109f0 0x55990a612fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f541d4fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 0x55990a606bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f541dcff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2109f0 0x55990a612fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52108/0 (socket says 172.21.15.53:52108) 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.264+0000 7f541dcff640 1 -- 172.21.15.53:0/3763917748 learned_addr learned my addr 172.21.15.53:0/3763917748 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.265+0000 7f541e500640 1 --2- 172.21.15.53:0/3763917748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a231390 0x55990a607110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.265+0000 7f541d4fe640 1 -- 172.21.15.53:0/3763917748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a231390 msgr2=0x55990a607110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.265+0000 7f541d4fe640 1 --2- 172.21.15.53:0/3763917748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a231390 0x55990a607110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.265+0000 7f541d4fe640 1 -- 172.21.15.53:0/3763917748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2109f0 msgr2=0x55990a612fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.265+0000 7f541d4fe640 1 --2- 172.21.15.53:0/3763917748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2109f0 0x55990a612fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.265+0000 7f541d4fe640 1 -- 172.21.15.53:0/3763917748 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990a5fa080 con 0x55990a2291b0 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.265+0000 7f541dcff640 1 --2- 172.21.15.53:0/3763917748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2109f0 0x55990a612fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.265+0000 7f541d4fe640 1 --2- 172.21.15.53:0/3763917748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 0x55990a606bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f540800c6a0 tx=0x7f5408003d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83d2c05173579ed2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.265+0000 7f54037fe640 1 -- 172.21.15.53:0/3763917748 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54080ab9e0 con 0x55990a2291b0 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.265+0000 7f54037fe640 1 -- 172.21.15.53:0/3763917748 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54080abed0 con 0x55990a2291b0 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.265+0000 7f54037fe640 1 -- 172.21.15.53:0/3763917748 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54080b0350 con 0x55990a2291b0 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.266+0000 7f54264d8740 1 -- 172.21.15.53:0/3763917748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 msgr2=0x55990a606bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.266+0000 7f54264d8740 1 --2- 172.21.15.53:0/3763917748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 0x55990a606bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f540800c6a0 tx=0x7f5408003d70 comp rx=0 tx=0).stop 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.266+0000 7f54264d8740 1 -- 172.21.15.53:0/3763917748 shutdown_connections 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.266+0000 7f54264d8740 1 --2- 172.21.15.53:0/3763917748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a231390 0x55990a607110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.266+0000 7f54264d8740 1 --2- 172.21.15.53:0/3763917748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a2291b0 0x55990a606bd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.266+0000 7f54264d8740 1 --2- 172.21.15.53:0/3763917748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2109f0 0x55990a612fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.266+0000 7f54264d8740 1 -- 172.21.15.53:0/3763917748 >> 172.21.15.53:0/3763917748 conn(0x55990a246460 msgr2=0x55990a6056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.266+0000 7f54264d8740 1 -- 172.21.15.53:0/3763917748 shutdown_connections 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.266+0000 7f54264d8740 1 -- 172.21.15.53:0/3763917748 wait complete. 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f54264d8740 1 -- start start 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f54264d8740 1 Processor -- start 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f54264d8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2109f0 0x55990a61a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f54264d8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2291b0 0x55990a61ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f54264d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 0x55990a682610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f54264d8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f54181ae810 con 0x55990a2291b0 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f54264d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54181ae140 con 0x55990a231390 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f54264d8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54181ab3a0 con 0x55990a2109f0 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f54264d8740 10 client.0 _ll_register_callbacks cb 0x7f54100093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f541dcff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2109f0 0x55990a61a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f541d4fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2291b0 0x55990a61ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f541dcff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2109f0 0x55990a61a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:42078/0 (socket says 172.21.15.53:42078) 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f541dcff640 1 -- 172.21.15.53:0/1440365813 learned_addr learned my addr 172.21.15.53:0/1440365813 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.267+0000 7f541e500640 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 0x55990a682610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f541dcff640 1 -- 172.21.15.53:0/1440365813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 msgr2=0x55990a682610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f541dcff640 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 0x55990a682610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f541dcff640 1 -- 172.21.15.53:0/1440365813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2291b0 msgr2=0x55990a61ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f541dcff640 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2291b0 0x55990a61ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f541dcff640 1 -- 172.21.15.53:0/1440365813 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990a682b50 con 0x55990a2109f0 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f541dcff640 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2109f0 0x55990a61a620 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f54140057c0 tx=0x7f54140052c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94335c429f111648 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f54017fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f54017fa640 1 -- 172.21.15.53:0/1440365813 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414035040 con 0x55990a2109f0 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f54017fa640 1 -- 172.21.15.53:0/1440365813 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f54140048c0 con 0x55990a2109f0 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f54264d8740 1 -- 172.21.15.53:0/1440365813 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54080abed0 con 0x55990a2109f0 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f54017fa640 1 -- 172.21.15.53:0/1440365813 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5414004ac0 con 0x55990a2109f0 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f54264d8740 10 client.27328 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.268+0000 7f54264d8740 1 -- 172.21.15.53:0/1440365813 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55990a683e40 con 0x55990a2109f0 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.269+0000 7f54017fa640 1 -- 172.21.15.53:0/1440365813 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54080abed0 con 0x55990a2109f0 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.269+0000 7f54017fa640 1 -- 172.21.15.53:0/1440365813 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f541403d450 con 0x55990a2109f0 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.269+0000 7f54264d8740 10 client.27328 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.269+0000 7f54264d8740 10 client.27328 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.269+0000 7f54264d8740 20 client.27328 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.269+0000 7f54264d8740 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55990a252070 0x55990a686680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.269+0000 7f54264d8740 4 client.27328 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.269+0000 7f54264d8740 1 -- 172.21.15.53:0/1440365813 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55990a56c020 con 0x55990a252070 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.269+0000 7f541d4fe640 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55990a252070 0x55990a686680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54017fa640 10 client.27328 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f541d4fe640 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55990a252070 0x55990a686680 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f49cdabcf94d977 server_cookie=7f1cdb8b82b1a374 in_seq=0 out_seq=0 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54017fa640 1 -- 172.21.15.53:0/1440365813 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55990a56c020 con 0x55990a252070 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54017fa640 10 client.27328 handle_command_reply: tid=0 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 1 client.27328 shutdown 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 1 -- 172.21.15.53:0/1440365813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2109f0 msgr2=0x55990a61a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2109f0 0x55990a61a620 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f54140057c0 tx=0x7f54140052c0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 1 -- 172.21.15.53:0/1440365813 shutdown_connections 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55990a252070 0x55990a686680 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55990a231390 0x55990a682610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55990a2291b0 0x55990a61ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 1 --2- 172.21.15.53:0/1440365813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55990a2109f0 0x55990a61a620 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54017fa640 0 client.27328 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:51.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 1 -- 172.21.15.53:0/1440365813 >> 172.21.15.53:0/1440365813 conn(0x55990a246460 msgr2=0x55990a606bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:51.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 1 -- 172.21.15.53:0/1440365813 shutdown_connections 2024-08-31T06:12:51.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 1 -- 172.21.15.53:0/1440365813 wait complete. 2024-08-31T06:12:51.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.270+0000 7f54264d8740 20 client.27328 trim_cache size 0 max 16384 2024-08-31T06:12:51.280 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:12:51.280 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:12:51.281 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:51.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:51.283 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:12:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:51.285 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:12:51.286 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:12:51.287 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:51.287 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:12:51.287 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:12:51.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 -- 172.21.15.53:0/1251254870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54040b4ca0 msgr2=0x7f54040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54040b4ca0 0x7f54040b71b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5410009fd0 tx=0x7f5410009de0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 -- 172.21.15.53:0/1251254870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5418105120 msgr2=0x7f541819a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5418105120 0x7f541819a750 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f540800e970 tx=0x7f540800ee30 comp rx=0 tx=0).stop 2024-08-31T06:12:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 -- 172.21.15.53:0/1251254870 shutdown_connections 2024-08-31T06:12:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54040b4ca0 0x7f54040b71b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f541810dc00 0x7f541819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5418105120 0x7f541819a750 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 --2- 172.21.15.53:0/1251254870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54181047d0 0x7f541819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 -- 172.21.15.53:0/1251254870 >> 172.21.15.53:0/1251254870 conn(0x7f5418079530 msgr2=0x7f5418100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 -- 172.21.15.53:0/1251254870 shutdown_connections 2024-08-31T06:12:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:51.271+0000 7f541ff63640 1 -- 172.21.15.53:0/1251254870 wait complete. 2024-08-31T06:12:51.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:51 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:12:51.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:51 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:12:51.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:51 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:12:51.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:51 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:12:51.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:51 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:12:51.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:51 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:12:51.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 135269 1.59 MB/sec execute 281 sec latency 12.695 ms 2024-08-31T06:12:52.136 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:12:52.136 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:12:52.409 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:52 smithi053 ceph-mon[18924]: pgmap v564: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 899 KiB/s wr, 82 op/s 2024-08-31T06:12:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:52 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:12:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:52 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:12:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:52 smithi130 ceph-mon[22266]: pgmap v564: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 899 KiB/s wr, 82 op/s 2024-08-31T06:12:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:52 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:12:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:52 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:12:52.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:52 smithi153 ceph-mon[22320]: pgmap v564: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 899 KiB/s wr, 82 op/s 2024-08-31T06:12:52.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:52 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:12:52.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:52 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:12:52.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.902+0000 7f42b9809640 1 -- 172.21.15.53:0/2166695428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b4108ad0 msgr2=0x7f42b410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:52.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.902+0000 7f42b9809640 1 --2- 172.21.15.53:0/2166695428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b4108ad0 0x7f42b410f300 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009900 tx=0x7f42ac02a410 comp rx=0 tx=0).stop 2024-08-31T06:12:52.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.903+0000 7f42b9809640 1 -- 172.21.15.53:0/2166695428 shutdown_connections 2024-08-31T06:12:52.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.903+0000 7f42b9809640 1 --2- 172.21.15.53:0/2166695428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b4108ad0 0x7f42b410f300 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.903+0000 7f42b9809640 1 --2- 172.21.15.53:0/2166695428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42b4108180 0x7f42b4108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.903+0000 7f42b9809640 1 --2- 172.21.15.53:0/2166695428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b4102840 0x7f42b4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.903+0000 7f42b9809640 1 -- 172.21.15.53:0/2166695428 >> 172.21.15.53:0/2166695428 conn(0x7f42b4079580 msgr2=0x7f42b4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.903+0000 7f42b9809640 1 -- 172.21.15.53:0/2166695428 shutdown_connections 2024-08-31T06:12:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.903+0000 7f42b9809640 1 -- 172.21.15.53:0/2166695428 wait complete. 2024-08-31T06:12:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.904+0000 7f42b9809640 1 Processor -- start 2024-08-31T06:12:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.904+0000 7f42b9809640 1 -- start start 2024-08-31T06:12:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.904+0000 7f42b9809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b4102840 0x7f42b419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.904+0000 7f42b9809640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42b4108180 0x7f42b419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.904+0000 7f42b9809640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b4108ad0 0x7f42b419f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.904+0000 7f42b9809640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f42b4112630 con 0x7f42b4102840 2024-08-31T06:12:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.904+0000 7f42b9809640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42b41124b0 con 0x7f42b4108180 2024-08-31T06:12:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.904+0000 7f42b9809640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f42b41127b0 con 0x7f42b4108ad0 2024-08-31T06:12:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b4102840 0x7f42b419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b4102840 0x7f42b419a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52148/0 (socket says 172.21.15.53:52148) 2024-08-31T06:12:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b4108ad0 0x7f42b419f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b2ffd640 1 -- 172.21.15.53:0/3662811368 learned_addr learned my addr 172.21.15.53:0/3662811368 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42b4108180 0x7f42b419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b37fe640 1 -- 172.21.15.53:0/3662811368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42b4108180 msgr2=0x7f42b419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b37fe640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42b4108180 0x7f42b419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b37fe640 1 -- 172.21.15.53:0/3662811368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b4102840 msgr2=0x7f42b419a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b37fe640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b4102840 0x7f42b419a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b37fe640 1 -- 172.21.15.53:0/3662811368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b41a00e0 con 0x7f42b4108ad0 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b2ffd640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b4102840 0x7f42b419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.905+0000 7f42b37fe640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b4108ad0 0x7f42b419f9b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f42ac02a930 tx=0x7f42ac003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.906+0000 7f42b8807640 1 -- 172.21.15.53:0/3662811368 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac035030 con 0x7f42b4108ad0 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.906+0000 7f42b9809640 1 -- 172.21.15.53:0/3662811368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b41a0370 con 0x7f42b4108ad0 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.906+0000 7f42b8807640 1 -- 172.21.15.53:0/3662811368 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42ac041070 con 0x7f42b4108ad0 2024-08-31T06:12:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.906+0000 7f42b8807640 1 -- 172.21.15.53:0/3662811368 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac031c00 con 0x7f42b4108ad0 2024-08-31T06:12:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.906+0000 7f42b9809640 1 -- 172.21.15.53:0/3662811368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b40ff2f0 con 0x7f42b4108ad0 2024-08-31T06:12:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.907+0000 7f42b9809640 1 -- 172.21.15.53:0/3662811368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b4103ac0 con 0x7f42b4108ad0 2024-08-31T06:12:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.910+0000 7f42b8807640 1 -- 172.21.15.53:0/3662811368 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f42ac031400 con 0x7f42b4108ad0 2024-08-31T06:12:52.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.910+0000 7f42b8807640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f429c0b4ca0 0x7f429c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.910+0000 7f42b2ffd640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f429c0b4ca0 0x7f429c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.910+0000 7f42b8807640 1 -- 172.21.15.53:0/3662811368 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f42ac109fb0 con 0x7f42b4108ad0 2024-08-31T06:12:52.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.911+0000 7f42b2ffd640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f429c0b4ca0 0x7f429c0b71b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f42a400f7d0 tx=0x7f42a4009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:52.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:52.913+0000 7f42b8807640 1 -- 172.21.15.53:0/3662811368 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f42ac0d0d80 con 0x7f42b4108ad0 2024-08-31T06:12:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.941+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1346766341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc1089d0 msgr2=0x7f2bbc10f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.941+0000 7f2bc0e2f640 1 --2- 172.21.15.53:0/1346766341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc1089d0 0x7f2bbc10f200 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009900 tx=0x7f2bb402a410 comp rx=0 tx=0).stop 2024-08-31T06:12:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.942+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1346766341 shutdown_connections 2024-08-31T06:12:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.942+0000 7f2bc0e2f640 1 --2- 172.21.15.53:0/1346766341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc1089d0 0x7f2bbc10f200 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.942+0000 7f2bc0e2f640 1 --2- 172.21.15.53:0/1346766341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bbc108080 0x7f2bbc108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.942+0000 7f2bc0e2f640 1 --2- 172.21.15.53:0/1346766341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bbc102750 0x7f2bbc102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.942+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1346766341 >> 172.21.15.53:0/1346766341 conn(0x7f2bbc07a4e0 msgr2=0x7f2bbc07a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.942+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1346766341 shutdown_connections 2024-08-31T06:12:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.942+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1346766341 wait complete. 2024-08-31T06:12:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.942+0000 7f2bc0e2f640 1 Processor -- start 2024-08-31T06:12:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bc0e2f640 1 -- start start 2024-08-31T06:12:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bc0e2f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bbc102750 0x7f2bbc19ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bc0e2f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc108080 0x7f2bbc19b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bc0e2f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bbc1089d0 0x7f2bbc19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bc0e2f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc112550 con 0x7f2bbc108080 2024-08-31T06:12:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bc0e2f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1123d0 con 0x7f2bbc102750 2024-08-31T06:12:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bc0e2f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1126d0 con 0x7f2bbc1089d0 2024-08-31T06:12:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bb9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc108080 0x7f2bbc19b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bba59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bbc102750 0x7f2bbc19ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bbad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bbc1089d0 0x7f2bbc19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bba59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bbc102750 0x7f2bbc19ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:40888/0 (socket says 172.21.15.53:40888) 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bb9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc108080 0x7f2bbc19b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52168/0 (socket says 172.21.15.53:52168) 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bba59c640 1 -- 172.21.15.53:0/1457392263 learned_addr learned my addr 172.21.15.53:0/1457392263 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bbad9d640 1 -- 172.21.15.53:0/1457392263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bbc102750 msgr2=0x7f2bbc19ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bbad9d640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bbc102750 0x7f2bbc19ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bbad9d640 1 -- 172.21.15.53:0/1457392263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc108080 msgr2=0x7f2bbc19b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bbad9d640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc108080 0x7f2bbc19b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.943+0000 7f2bbad9d640 1 -- 172.21.15.53:0/1457392263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc1a6120 con 0x7f2bbc1089d0 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.944+0000 7f2bba59c640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bbc102750 0x7f2bbc19ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.944+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc108080 0x7f2bbc19b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.944+0000 7f2bbad9d640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bbc1089d0 0x7f2bbc19b8e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40057c0 tx=0x7f2bb40318f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.944+0000 7f2bab7fe640 1 -- 172.21.15.53:0/1457392263 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb403f030 con 0x7f2bbc1089d0 2024-08-31T06:12:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.944+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1457392263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bbc1a63b0 con 0x7f2bbc1089d0 2024-08-31T06:12:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.944+0000 7f2bab7fe640 1 -- 172.21.15.53:0/1457392263 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2bb4004350 con 0x7f2bbc1089d0 2024-08-31T06:12:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.944+0000 7f2bab7fe640 1 -- 172.21.15.53:0/1457392263 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4035070 con 0x7f2bbc1089d0 2024-08-31T06:12:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.944+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1457392263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bbc1a68a0 con 0x7f2bbc1089d0 2024-08-31T06:12:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.947+0000 7f2bc7e7c740 1 Processor -- start 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.947+0000 7f2bab7fe640 1 -- 172.21.15.53:0/1457392263 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2bb4042030 con 0x7f2bbc1089d0 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.947+0000 7f2bc7e7c740 1 -- start start 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa601b0 0x56222fe03ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa372f0 0x56222fe04220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa3f4d0 0x56222fe04760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56222fd79000 con 0x56222fa372f0 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56222fd68590 con 0x56222fa601b0 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56222fd6c540 con 0x56222fa3f4d0 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bb9d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa601b0 0x56222fe03ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bba59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa372f0 0x56222fe04220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bb9d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa601b0 0x56222fe03ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:40902/0 (socket says 172.21.15.53:40902) 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bb9d9b640 1 -- 172.21.15.53:0/1627768281 learned_addr learned my addr 172.21.15.53:0/1627768281 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/1627768281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa3f4d0 0x56222fe04760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bb9d9b640 1 -- 172.21.15.53:0/1627768281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa3f4d0 msgr2=0x56222fe04760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/1627768281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa3f4d0 0x56222fe04760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bab7fe640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2ba40b4ca0 0x7f2ba40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bb9d9b640 1 -- 172.21.15.53:0/1627768281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa372f0 msgr2=0x56222fe04220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/1627768281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa372f0 0x56222fe04220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bb9d9b640 1 -- 172.21.15.53:0/1627768281 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222facb790 con 0x56222fa601b0 2024-08-31T06:12:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bba59c640 1 --2- 172.21.15.53:0/1627768281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa372f0 0x56222fe04220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.948+0000 7f2bab7fe640 1 -- 172.21.15.53:0/1457392263 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f2bb4105890 con 0x7f2bbc1089d0 2024-08-31T06:12:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.949+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2ba40b4ca0 0x7f2ba40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.949+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/1627768281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa601b0 0x56222fe03ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0011b60 tx=0x7f2bb0005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2683c1f70e582134 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.949+0000 7f2ba8ff9640 1 -- 172.21.15.53:0/1627768281 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0026070 con 0x56222fa601b0 2024-08-31T06:12:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.949+0000 7f2ba8ff9640 1 -- 172.21.15.53:0/1627768281 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2bb0010d90 con 0x56222fa601b0 2024-08-31T06:12:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.949+0000 7f2ba8ff9640 1 -- 172.21.15.53:0/1627768281 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00218b0 con 0x56222fa601b0 2024-08-31T06:12:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.950+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1627768281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa601b0 msgr2=0x56222fe03ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.950+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/1627768281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa601b0 0x56222fe03ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0011b60 tx=0x7f2bb0005850 comp rx=0 tx=0).stop 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.950+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2ba40b4ca0 0x7f2ba40b71b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0023000 tx=0x7f2bb0024000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.950+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1627768281 shutdown_connections 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.950+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/1627768281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa3f4d0 0x56222fe04760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.950+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/1627768281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa372f0 0x56222fe04220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.950+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/1627768281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa601b0 0x56222fe03ce0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.950+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1627768281 >> 172.21.15.53:0/1627768281 conn(0x56222fa54300 msgr2=0x56222fe01bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.951+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1627768281 shutdown_connections 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.951+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1627768281 wait complete. 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.951+0000 7f2bc7e7c740 1 -- start start 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.951+0000 7f2bc7e7c740 1 Processor -- start 2024-08-31T06:12:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.951+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 0x56222fe13d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.951+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa3f4d0 0x56222fe14340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.951+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 0x56222fe19b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.951+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56222fca1ab0 con 0x56222fa1ed80 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.951+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56222fcef680 con 0x56222fa3f4d0 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.951+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56222fe16890 con 0x56222fa372f0 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bc7e7c740 10 client.0 _ll_register_callbacks cb 0x56222fa77a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bba59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 0x56222fe13d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bba59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 0x56222fe13d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:42134/0 (socket says 172.21.15.53:42134) 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bba59c640 1 -- 172.21.15.53:0/1863601701 learned_addr learned my addr 172.21.15.53:0/1863601701 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa3f4d0 0x56222fe14340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bbad9d640 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 0x56222fe19b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bba59c640 1 -- 172.21.15.53:0/1863601701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa3f4d0 msgr2=0x56222fe14340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bba59c640 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa3f4d0 0x56222fe14340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bba59c640 1 -- 172.21.15.53:0/1863601701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 msgr2=0x56222fe19b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bba59c640 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 0x56222fe19b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bba59c640 1 -- 172.21.15.53:0/1863601701 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56222fb44620 con 0x56222fa372f0 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa3f4d0 0x56222fe14340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2bba59c640 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 0x56222fe13d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00fee0 tx=0x7f2bac012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=599dfaf4bf174c58 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.952+0000 7f2ba1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.953+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/1863601701 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac010430 con 0x56222fa372f0 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.953+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1863601701 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bb0010d90 con 0x56222fa372f0 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.953+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/1863601701 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f2bac0105d0 con 0x56222fa372f0 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.953+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/1863601701 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2bac0107d0 con 0x56222fa372f0 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.953+0000 7f2bc7e7c740 10 client.27346 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.953+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1863601701 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56222fe22a10 con 0x56222fa372f0 2024-08-31T06:12:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.954+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/1863601701 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2bb0010d90 con 0x56222fa372f0 2024-08-31T06:12:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.954+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/1863601701 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2bac01c9c0 con 0x56222fa372f0 2024-08-31T06:12:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.954+0000 7f2bc7e7c740 10 client.27346 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.954+0000 7f2bc7e7c740 10 client.27346 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.954+0000 7f2bc7e7c740 20 client.27346 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.954+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56222f9f41c0 0x56222fe25f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.954+0000 7f2bc7e7c740 4 client.27346 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.954+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1863601701 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56222fd7af50 con 0x56222f9f41c0 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.954+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56222f9f41c0 0x56222fe25f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.955+0000 7f2ba1ffb640 10 client.27346 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.955+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56222f9f41c0 0x56222fe25f70 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e5b9c2c6767b438 server_cookie=f5878ee9d754dba1 in_seq=0 out_seq=0 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.955+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/1863601701 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56222fd7af50 con 0x56222f9f41c0 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.955+0000 7f2ba1ffb640 10 client.27346 handle_command_reply: tid=0 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.955+0000 7f2bc7e7c740 1 client.27346 shutdown 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1863601701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 msgr2=0x56222fe13d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 0x56222fe13d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00fee0 tx=0x7f2bac012820 comp rx=0 tx=0).stop 2024-08-31T06:12:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1863601701 shutdown_connections 2024-08-31T06:12:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56222f9f41c0 0x56222fe25f70 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 0x56222fe19b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa3f4d0 0x56222fe14340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/1863601701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 0x56222fe13d60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1863601701 >> 172.21.15.53:0/1863601701 conn(0x56222fa54300 msgr2=0x56222fe00170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2ba1ffb640 0 client.27346 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1863601701 shutdown_connections 2024-08-31T06:12:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/1863601701 wait complete. 2024-08-31T06:12:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.956+0000 7f2bc7e7c740 20 client.27346 trim_cache size 0 max 16384 2024-08-31T06:12:52.984 INFO:tasks.workunit.client.0.smithi053.stdout: 1 135644 1.59 MB/sec execute 282 sec latency 22.157 ms 2024-08-31T06:12:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bc7e7c740 1 Processor -- start 2024-08-31T06:12:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bc7e7c740 1 -- start start 2024-08-31T06:12:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa1ed80 0x56222fe123b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa372f0 0x56222fe128f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa3f4d0 0x56222fe19b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1ad1b0 con 0x56222fa3f4d0 2024-08-31T06:12:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1aecf0 con 0x56222fa372f0 2024-08-31T06:12:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1ad880 con 0x56222fa1ed80 2024-08-31T06:12:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bbad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa3f4d0 0x56222fe19b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bbad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa3f4d0 0x56222fe19b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52210/0 (socket says 172.21.15.53:52210) 2024-08-31T06:12:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bbad9d640 1 -- 172.21.15.53:0/319636761 learned_addr learned my addr 172.21.15.53:0/319636761 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.987+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/319636761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa372f0 0x56222fe128f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.988+0000 7f2bba59c640 1 --2- 172.21.15.53:0/319636761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa1ed80 0x56222fe123b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.988+0000 7f2bbad9d640 1 -- 172.21.15.53:0/319636761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa1ed80 msgr2=0x56222fe123b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.988+0000 7f2bbad9d640 1 --2- 172.21.15.53:0/319636761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa1ed80 0x56222fe123b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.988+0000 7f2bbad9d640 1 -- 172.21.15.53:0/319636761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa372f0 msgr2=0x56222fe128f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.988+0000 7f2bbad9d640 1 --2- 172.21.15.53:0/319636761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa372f0 0x56222fe128f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.988+0000 7f2bbad9d640 1 -- 172.21.15.53:0/319636761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222fdfff60 con 0x56222fa3f4d0 2024-08-31T06:12:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.988+0000 7f2bbad9d640 1 --2- 172.21.15.53:0/319636761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa3f4d0 0x56222fe19b00 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f2bb402a930 tx=0x7f2bb4009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c49969555567392 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.988+0000 7f2ba3fff640 1 -- 172.21.15.53:0/319636761 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4049050 con 0x56222fa3f4d0 2024-08-31T06:12:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.988+0000 7f2ba3fff640 1 -- 172.21.15.53:0/319636761 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2bb40d07d0 con 0x56222fa3f4d0 2024-08-31T06:12:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.988+0000 7f2ba3fff640 1 -- 172.21.15.53:0/319636761 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40cc270 con 0x56222fa3f4d0 2024-08-31T06:12:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.989+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/319636761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa3f4d0 msgr2=0x56222fe19b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.989+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/319636761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa3f4d0 0x56222fe19b00 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f2bb402a930 tx=0x7f2bb4009560 comp rx=0 tx=0).stop 2024-08-31T06:12:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/319636761 shutdown_connections 2024-08-31T06:12:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/319636761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa3f4d0 0x56222fe19b00 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/319636761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa372f0 0x56222fe128f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/319636761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa1ed80 0x56222fe123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/319636761 >> 172.21.15.53:0/319636761 conn(0x56222fa54300 msgr2=0x56222fe08f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/319636761 shutdown_connections 2024-08-31T06:12:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/319636761 wait complete. 2024-08-31T06:12:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 -- start start 2024-08-31T06:12:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 Processor -- start 2024-08-31T06:12:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 0x56222fe206c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 0x56222fe1bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa3f4d0 0x56222fe1c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1ae620 con 0x56222fa1ed80 2024-08-31T06:12:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1adf50 con 0x56222fa3f4d0 2024-08-31T06:12:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1ab1b0 con 0x56222fa372f0 2024-08-31T06:12:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bc7e7c740 10 client.0 _ll_register_callbacks cb 0x7f2bac00f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.990+0000 7f2bba59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 0x56222fe206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2bba59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 0x56222fe206c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52226/0 (socket says 172.21.15.53:52226) 2024-08-31T06:12:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2bba59c640 1 -- 172.21.15.53:0/54066143 learned_addr learned my addr 172.21.15.53:0/54066143 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2bbad9d640 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa3f4d0 0x56222fe1c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 0x56222fe1bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2bba59c640 1 -- 172.21.15.53:0/54066143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 msgr2=0x56222fe1bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2bba59c640 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 0x56222fe1bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2bba59c640 1 -- 172.21.15.53:0/54066143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa3f4d0 msgr2=0x56222fe1c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2bba59c640 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa3f4d0 0x56222fe1c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2bba59c640 1 -- 172.21.15.53:0/54066143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56222fe1c790 con 0x56222fa1ed80 2024-08-31T06:12:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2bba59c640 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 0x56222fe206c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2bac004bb0 tx=0x7f2bac004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c16f3d9bda5d0f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2ba1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/54066143 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac010970 con 0x56222fa1ed80 2024-08-31T06:12:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/54066143 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f2bac018040 con 0x56222fa1ed80 2024-08-31T06:12:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.991+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/54066143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bb40d07d0 con 0x56222fa1ed80 2024-08-31T06:12:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/54066143 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2bac010b10 con 0x56222fa1ed80 2024-08-31T06:12:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2bc7e7c740 10 client.18084 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/54066143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56222fe90810 con 0x56222fa1ed80 2024-08-31T06:12:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/54066143 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2bb40d07d0 con 0x56222fa1ed80 2024-08-31T06:12:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/54066143 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2bac01c420 con 0x56222fa1ed80 2024-08-31T06:12:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2bc7e7c740 10 client.18084 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2bc7e7c740 10 client.18084 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:12:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2bc7e7c740 20 client.18084 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56222fe91010 0x56222fe93430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2bc7e7c740 4 client.18084 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:12:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/54066143 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56222fd769f0 con 0x56222fe91010 2024-08-31T06:12:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.992+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56222fe91010 0x56222fe93430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.993+0000 7f2ba1ffb640 10 client.18084 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:52.993+0000 7f2bb9d9b640 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56222fe91010 0x56222fe93430 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4191ec90a071abd server_cookie=eaab918e21177fe5 in_seq=0 out_seq=0 2024-08-31T06:12:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2ba1ffb640 1 -- 172.21.15.53:0/54066143 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56222fd769f0 con 0x56222fe91010 2024-08-31T06:12:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2ba1ffb640 10 client.18084 handle_command_reply: tid=0 2024-08-31T06:12:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 1 client.18084 shutdown 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/54066143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 msgr2=0x56222fe206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 0x56222fe206c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2bac004bb0 tx=0x7f2bac004be0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/54066143 shutdown_connections 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56222fe91010 0x56222fe93430 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56222fa3f4d0 0x56222fe1c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56222fa372f0 0x56222fe1bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 1 --2- 172.21.15.53:0/54066143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56222fa1ed80 0x56222fe206c0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/54066143 >> 172.21.15.53:0/54066143 conn(0x56222fa54300 msgr2=0x56222fe122f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2ba1ffb640 0 client.18084 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/54066143 shutdown_connections 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 1 -- 172.21.15.53:0/54066143 wait complete. 2024-08-31T06:12:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.010+0000 7f2bc7e7c740 20 client.18084 trim_cache size 0 max 16384 2024-08-31T06:12:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:12:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:12:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:12:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:12:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1457392263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2ba40b4ca0 msgr2=0x7f2ba40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2ba40b4ca0 0x7f2ba40b71b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0023000 tx=0x7f2bb0024000 comp rx=0 tx=0).stop 2024-08-31T06:12:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1457392263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bbc1089d0 msgr2=0x7f2bbc19b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bbc1089d0 0x7f2bbc19b8e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40057c0 tx=0x7f2bb40318f0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1457392263 shutdown_connections 2024-08-31T06:12:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2ba40b4ca0 0x7f2ba40b71b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bbc1089d0 0x7f2bbc19b8e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bbc108080 0x7f2bbc19b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 --2- 172.21.15.53:0/1457392263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2bbc102750 0x7f2bbc19ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1457392263 >> 172.21.15.53:0/1457392263 conn(0x7f2bbc07a4e0 msgr2=0x7f2bbc106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:53.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1457392263 shutdown_connections 2024-08-31T06:12:53.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:12:53.011+0000 7f2bc0e2f640 1 -- 172.21.15.53:0/1457392263 wait complete. 2024-08-31T06:12:53.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.189+0000 7f42b9809640 1 -- 172.21.15.53:0/3662811368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42b410b900 con 0x7f42b4108ad0 2024-08-31T06:12:53.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.190+0000 7f42b8807640 1 -- 172.21.15.53:0/3662811368 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11985 (secure 0 0 0) 0x7f42ac0d0680 con 0x7f42b4108ad0 2024-08-31T06:12:53.193 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:12:53.193 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":36,"btime":"2024-08-31T06:11:22:133856+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:11:21.364258+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:12:53.193 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 36 2024-08-31T06:12:53.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 -- 172.21.15.53:0/3662811368 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f429c0b4ca0 msgr2=0x7f429c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:53.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f429c0b4ca0 0x7f429c0b71b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f42a400f7d0 tx=0x7f42a4009500 comp rx=0 tx=0).stop 2024-08-31T06:12:53.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 -- 172.21.15.53:0/3662811368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b4108ad0 msgr2=0x7f42b419f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:53.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b4108ad0 0x7f42b419f9b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f42ac02a930 tx=0x7f42ac003b90 comp rx=0 tx=0).stop 2024-08-31T06:12:53.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 -- 172.21.15.53:0/3662811368 shutdown_connections 2024-08-31T06:12:53.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f429c0b4ca0 0x7f429c0b71b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42b4108ad0 0x7f42b419f9b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42b4108180 0x7f42b419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 --2- 172.21.15.53:0/3662811368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b4102840 0x7f42b419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:53.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 -- 172.21.15.53:0/3662811368 >> 172.21.15.53:0/3662811368 conn(0x7f42b4079580 msgr2=0x7f42b4101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:53.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 -- 172.21.15.53:0/3662811368 shutdown_connections 2024-08-31T06:12:53.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:53.193+0000 7f42b9809640 1 -- 172.21.15.53:0/3662811368 wait complete. 2024-08-31T06:12:53.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:53 smithi053 ceph-mon[18924]: pgmap v565: 97 pgs: 97 active+clean; 81 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2024-08-31T06:12:53.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:53 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3662811368' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:53.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:53 smithi130 ceph-mon[22266]: pgmap v565: 97 pgs: 97 active+clean; 81 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2024-08-31T06:12:53.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:53 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3662811368' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:53.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:53 smithi153 ceph-mon[22320]: pgmap v565: 97 pgs: 97 active+clean; 81 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2024-08-31T06:12:53.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:53 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3662811368' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:12:53.957 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:12:53.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 136108 1.59 MB/sec execute 283 sec latency 20.035 ms 2024-08-31T06:12:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:54.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.754+0000 7f10e6c4e640 1 -- 172.21.15.53:0/3663728746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e01069c0 msgr2=0x7f10e0110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:54.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.754+0000 7f10e6c4e640 1 --2- 172.21.15.53:0/3663728746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e01069c0 0x7f10e0110410 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009ca0 tx=0x7f10d802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.754+0000 7f10e6c4e640 1 -- 172.21.15.53:0/3663728746 shutdown_connections 2024-08-31T06:12:54.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.754+0000 7f10e6c4e640 1 --2- 172.21.15.53:0/3663728746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e01069c0 0x7f10e0110410 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.754+0000 7f10e6c4e640 1 --2- 172.21.15.53:0/3663728746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10e0106070 0x7f10e0106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.754+0000 7f10e6c4e640 1 --2- 172.21.15.53:0/3663728746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10e0101d90 0x7f10e01021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.754+0000 7f10e6c4e640 1 -- 172.21.15.53:0/3663728746 >> 172.21.15.53:0/3663728746 conn(0x7f10e0077a60 msgr2=0x7f10e0077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:54.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.754+0000 7f10e6c4e640 1 -- 172.21.15.53:0/3663728746 shutdown_connections 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.754+0000 7f10e6c4e640 1 -- 172.21.15.53:0/3663728746 wait complete. 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.755+0000 7f10e6c4e640 1 Processor -- start 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.755+0000 7f10e6c4e640 1 -- start start 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.755+0000 7f10e6c4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0101d90 0x7f10e019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.755+0000 7f10e6c4e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10e0106070 0x7f10e019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.755+0000 7f10e6c4e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10e01069c0 0x7f10e019f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.755+0000 7f10e6c4e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f10e0113760 con 0x7f10e0101d90 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.755+0000 7f10e6c4e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f10e01135e0 con 0x7f10e0106070 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.755+0000 7f10e6c4e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10e01138e0 con 0x7f10e01069c0 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.755+0000 7f10e49ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0101d90 0x7f10e019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.755+0000 7f10e49ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0101d90 0x7f10e019a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42246/0 (socket says 172.21.15.53:42246) 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.755+0000 7f10e49ea640 1 -- 172.21.15.53:0/477718949 learned_addr learned my addr 172.21.15.53:0/477718949 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:54.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10dffff640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10e0106070 0x7f10e019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10e51eb640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10e01069c0 0x7f10e019f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10e49ea640 1 -- 172.21.15.53:0/477718949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10e01069c0 msgr2=0x7f10e019f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10e49ea640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10e01069c0 0x7f10e019f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10e49ea640 1 -- 172.21.15.53:0/477718949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10e0106070 msgr2=0x7f10e019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10e49ea640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10e0106070 0x7f10e019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10e49ea640 1 -- 172.21.15.53:0/477718949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e01a0120 con 0x7f10e0101d90 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10e49ea640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0101d90 0x7f10e019a1b0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f10d400d950 tx=0x7f10d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10ddffb640 1 -- 172.21.15.53:0/477718949 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d4017070 con 0x7f10e0101d90 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10ddffb640 1 -- 172.21.15.53:0/477718949 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10d4009c30 con 0x7f10e0101d90 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10e6c4e640 1 -- 172.21.15.53:0/477718949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e01a0410 con 0x7f10e0101d90 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.756+0000 7f10ddffb640 1 -- 172.21.15.53:0/477718949 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d400f620 con 0x7f10e0101d90 2024-08-31T06:12:54.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.757+0000 7f10e6c4e640 1 -- 172.21.15.53:0/477718949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e01a6b70 con 0x7f10e0101d90 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.759+0000 7f10ddffb640 1 -- 172.21.15.53:0/477718949 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f10d4010460 con 0x7f10e0101d90 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.759+0000 7f10ed1c3740 1 Processor -- start 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.759+0000 7f10ed1c3740 1 -- start start 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 0x558637d57310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d57850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d57d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558637cce680 con 0x5586379891b0 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558637cbdc10 con 0x558637991390 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558637cc1bc0 con 0x5586379b2070 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10e49ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d57850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10e51eb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 0x558637d57310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10dffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d57d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10e51eb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 0x558637d57310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56330/0 (socket says 172.21.15.53:56330) 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10dffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d57d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:58138/0 (socket says 172.21.15.53:58138) 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10e51eb640 1 -- 172.21.15.53:0/1594655169 learned_addr learned my addr 172.21.15.53:0/1594655169 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10e51eb640 1 -- 172.21.15.53:0/1594655169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 msgr2=0x558637d57d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10e51eb640 1 --2- 172.21.15.53:0/1594655169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d57d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10e51eb640 1 -- 172.21.15.53:0/1594655169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 msgr2=0x558637d57850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10e51eb640 1 --2- 172.21.15.53:0/1594655169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d57850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.760+0000 7f10e51eb640 1 -- 172.21.15.53:0/1594655169 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558637a1d650 con 0x5586379b2070 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.761+0000 7f10ddffb640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d00b4ca0 0x7f10d00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.761+0000 7f10dffff640 1 --2- 172.21.15.53:0/1594655169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d57d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.761+0000 7f10e51eb640 1 --2- 172.21.15.53:0/1594655169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 0x558637d57310 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009ca0 tx=0x7f10d8009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de7f143b5819c06a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.761+0000 7f10e49ea640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d00b4ca0 0x7f10d00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.761+0000 7f10ddffb640 1 -- 172.21.15.53:0/477718949 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f10d40e5100 con 0x7f10e0101d90 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.761+0000 7f10caffd640 1 -- 172.21.15.53:0/1594655169 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8031980 con 0x5586379b2070 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.761+0000 7f10caffd640 1 -- 172.21.15.53:0/1594655169 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10d8036030 con 0x5586379b2070 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.761+0000 7f10caffd640 1 -- 172.21.15.53:0/1594655169 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8004460 con 0x5586379b2070 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.762+0000 7f10ed1c3740 1 -- 172.21.15.53:0/1594655169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 msgr2=0x558637d57310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.762+0000 7f10e49ea640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d00b4ca0 0x7f10d00b71b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f10d40e28e0 tx=0x7f10d40e8c50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.762+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/1594655169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 0x558637d57310 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009ca0 tx=0x7f10d8009a20 comp rx=0 tx=0).stop 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.762+0000 7f10ed1c3740 1 -- 172.21.15.53:0/1594655169 shutdown_connections 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.762+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/1594655169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d57d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.762+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/1594655169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d57850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.762+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/1594655169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 0x558637d57310 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.762+0000 7f10ed1c3740 1 -- 172.21.15.53:0/1594655169 >> 172.21.15.53:0/1594655169 conn(0x5586379a6460 msgr2=0x558637d55200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.762+0000 7f10ed1c3740 1 -- 172.21.15.53:0/1594655169 shutdown_connections 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.762+0000 7f10ed1c3740 1 -- 172.21.15.53:0/1594655169 wait complete. 2024-08-31T06:12:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.762+0000 7f10ed1c3740 1 -- start start 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10ed1c3740 1 Processor -- start 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d62a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d62fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 0x558637d73010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558637b20700 con 0x5586379891b0 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558637c44750 con 0x558637991390 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558637d69d20 con 0x5586379b2070 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10ed1c3740 10 client.0 _ll_register_callbacks cb 0x558637c73e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10e51eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d62a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10e51eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d62a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42250/0 (socket says 172.21.15.53:42250) 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10e51eb640 1 -- 172.21.15.53:0/2542074442 learned_addr learned my addr 172.21.15.53:0/2542074442 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10dffff640 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d62fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10e51eb640 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 0x558637d73010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.763+0000 7f10e51eb640 1 -- 172.21.15.53:0/2542074442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 msgr2=0x558637d73010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10e51eb640 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 0x558637d73010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10e51eb640 1 -- 172.21.15.53:0/2542074442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 msgr2=0x558637d62fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10e51eb640 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d62fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10e51eb640 1 -- 172.21.15.53:0/2542074442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558637c7d900 con 0x5586379891b0 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10e51eb640 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d62a90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009620 tx=0x7f10d80094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c176114b581efc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10bffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10bffff640 1 -- 172.21.15.53:0/2542074442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8058060 con 0x5586379891b0 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10bffff640 1 -- 172.21.15.53:0/2542074442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f10d8031d90 con 0x5586379891b0 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10ed1c3740 1 -- 172.21.15.53:0/2542074442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10d8036030 con 0x5586379891b0 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10bffff640 1 -- 172.21.15.53:0/2542074442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f10d804b070 con 0x5586379891b0 2024-08-31T06:12:54.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10ed1c3740 10 client.18096 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10ed1c3740 1 -- 172.21.15.53:0/2542074442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558637d75b00 con 0x5586379891b0 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.764+0000 7f10bffff640 1 -- 172.21.15.53:0/2542074442 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10d8036030 con 0x5586379891b0 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.765+0000 7f10bffff640 1 -- 172.21.15.53:0/2542074442 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f10d8050070 con 0x5586379891b0 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.765+0000 7f10ed1c3740 10 client.18096 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.765+0000 7f10ed1c3740 10 client.18096 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.765+0000 7f10ed1c3740 20 client.18096 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.765+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586379709f0 0x558637d78e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.765+0000 7f10ed1c3740 4 client.18096 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.765+0000 7f10ed1c3740 1 -- 172.21.15.53:0/2542074442 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558637cd05d0 con 0x5586379709f0 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.765+0000 7f10dffff640 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586379709f0 0x558637d78e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.765+0000 7f10dffff640 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586379709f0 0x558637d78e60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=59d874ebbc67f2fa server_cookie=31d2f698db2c49a2 in_seq=0 out_seq=0 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.765+0000 7f10bffff640 10 client.18096 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:12:54.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10bffff640 1 -- 172.21.15.53:0/2542074442 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558637cd05d0 con 0x5586379709f0 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10bffff640 10 client.18096 handle_command_reply: tid=0 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10ed1c3740 1 client.18096 shutdown 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10ed1c3740 1 -- 172.21.15.53:0/2542074442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 msgr2=0x558637d62a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d62a90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009620 tx=0x7f10d80094a0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10ed1c3740 1 -- 172.21.15.53:0/2542074442 shutdown_connections 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586379709f0 0x558637d78e60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379b2070 0x558637d73010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d62fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/2542074442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d62a90 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10bffff640 0 client.18096 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.766+0000 7f10ed1c3740 1 -- 172.21.15.53:0/2542074442 >> 172.21.15.53:0/2542074442 conn(0x5586379a6460 msgr2=0x558637d5a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.767+0000 7f10ed1c3740 1 -- 172.21.15.53:0/2542074442 shutdown_connections 2024-08-31T06:12:54.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.767+0000 7f10ed1c3740 1 -- 172.21.15.53:0/2542074442 wait complete. 2024-08-31T06:12:54.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.767+0000 7f10ed1c3740 20 client.18096 trim_cache size 0 max 16384 2024-08-31T06:12:54.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.782+0000 7f10ed1c3740 1 Processor -- start 2024-08-31T06:12:54.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.782+0000 7f10ed1c3740 1 -- start start 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379709f0 0x558637d646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d5fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f10e01ad270 con 0x5586379891b0 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f10e01aedb0 con 0x558637991390 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10e01ad940 con 0x5586379709f0 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d5fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10e51eb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379709f0 0x558637d646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d5fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42252/0 (socket says 172.21.15.53:42252) 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10dffff640 1 -- 172.21.15.53:0/456758598 learned_addr learned my addr 172.21.15.53:0/456758598 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10e51eb640 1 --2- 172.21.15.53:0/456758598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10dffff640 1 -- 172.21.15.53:0/456758598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379709f0 msgr2=0x558637d646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:54.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10dffff640 1 --2- 172.21.15.53:0/456758598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379709f0 0x558637d646c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10dffff640 1 -- 172.21.15.53:0/456758598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 msgr2=0x558637d601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:54.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10dffff640 1 --2- 172.21.15.53:0/456758598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.783+0000 7f10dffff640 1 -- 172.21.15.53:0/456758598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558637d60f90 con 0x5586379891b0 2024-08-31T06:12:54.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.784+0000 7f10dffff640 1 --2- 172.21.15.53:0/456758598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d5fc80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f10e0075870 tx=0x7f10cc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dee2f358904b527 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:54.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.784+0000 7f10ca7fc640 1 -- 172.21.15.53:0/456758598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc004220 con 0x5586379891b0 2024-08-31T06:12:54.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.784+0000 7f10ca7fc640 1 -- 172.21.15.53:0/456758598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10cc0043c0 con 0x5586379891b0 2024-08-31T06:12:54.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.784+0000 7f10ca7fc640 1 -- 172.21.15.53:0/456758598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0248f0 con 0x5586379891b0 2024-08-31T06:12:54.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.785+0000 7f10ed1c3740 1 -- 172.21.15.53:0/456758598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 msgr2=0x558637d5fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:54.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.785+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/456758598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d5fc80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f10e0075870 tx=0x7f10cc005f90 comp rx=0 tx=0).stop 2024-08-31T06:12:54.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.785+0000 7f10ed1c3740 1 -- 172.21.15.53:0/456758598 shutdown_connections 2024-08-31T06:12:54.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.785+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/456758598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558637991390 0x558637d601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.785+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/456758598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586379891b0 0x558637d5fc80 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.785+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/456758598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379709f0 0x558637d646c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.785+0000 7f10ed1c3740 1 -- 172.21.15.53:0/456758598 >> 172.21.15.53:0/456758598 conn(0x5586379a6460 msgr2=0x558637d63fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:54.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.785+0000 7f10ed1c3740 1 -- 172.21.15.53:0/456758598 shutdown_connections 2024-08-31T06:12:54.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.785+0000 7f10ed1c3740 1 -- 172.21.15.53:0/456758598 wait complete. 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.785+0000 7f10ed1c3740 1 -- start start 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.785+0000 7f10ed1c3740 1 Processor -- start 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586379709f0 0x558637dd7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379891b0 0x558637dd7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10ed1c3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558637991390 0x558637de25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f10e01ae6e0 con 0x558637991390 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f10e01ae010 con 0x5586379709f0 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10ed1c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10e01ab270 con 0x5586379891b0 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10ed1c3740 10 client.0 _ll_register_callbacks cb 0x7f10d40e8b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10e51eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558637991390 0x558637de25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10e51eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558637991390 0x558637de25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42266/0 (socket says 172.21.15.53:42266) 2024-08-31T06:12:54.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10dffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379891b0 0x558637dd7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10e51eb640 1 -- 172.21.15.53:0/3913603954 learned_addr learned my addr 172.21.15.53:0/3913603954 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10e51eb640 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586379709f0 0x558637dd7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10dffff640 1 -- 172.21.15.53:0/3913603954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586379709f0 msgr2=0x558637dd7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10dffff640 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586379709f0 0x558637dd7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10dffff640 1 -- 172.21.15.53:0/3913603954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558637991390 msgr2=0x558637de25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10dffff640 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558637991390 0x558637de25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10dffff640 1 -- 172.21.15.53:0/3913603954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558637de2b30 con 0x5586379891b0 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.786+0000 7f10e51eb640 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558637991390 0x558637de25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10dffff640 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379891b0 0x558637dd7ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x558637d582a0 tx=0x7f10cc005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be396b55de88d92c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10bffff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10bffff640 1 -- 172.21.15.53:0/3913603954 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0037f0 con 0x5586379891b0 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10bffff640 1 -- 172.21.15.53:0/3913603954 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f10cc003990 con 0x5586379891b0 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10ed1c3740 1 -- 172.21.15.53:0/3913603954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10cc0043c0 con 0x5586379891b0 2024-08-31T06:12:54.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10bffff640 1 -- 172.21.15.53:0/3913603954 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f10cc03c050 con 0x5586379891b0 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10ed1c3740 10 client.27370 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10ed1c3740 1 -- 172.21.15.53:0/3913603954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558637de3c20 con 0x5586379891b0 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10bffff640 1 -- 172.21.15.53:0/3913603954 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10cc0043c0 con 0x5586379891b0 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10bffff640 1 -- 172.21.15.53:0/3913603954 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f10cc023070 con 0x5586379891b0 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10ed1c3740 10 client.27370 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10ed1c3740 10 client.27370 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10ed1c3740 20 client.27370 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586379b2070 0x558637de63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.787+0000 7f10ed1c3740 4 client.27370 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10ed1c3740 1 -- 172.21.15.53:0/3913603954 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558637ccc070 con 0x5586379b2070 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10e51eb640 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586379b2070 0x558637de63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10e51eb640 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586379b2070 0x558637de63d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3fcff2335b0d2224 server_cookie=916ebd6234ee450c in_seq=0 out_seq=0 2024-08-31T06:12:54.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10bffff640 10 client.27370 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10bffff640 1 -- 172.21.15.53:0/3913603954 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558637ccc070 con 0x5586379b2070 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10bffff640 10 client.27370 handle_command_reply: tid=0 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10ed1c3740 1 client.27370 shutdown 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10ed1c3740 1 -- 172.21.15.53:0/3913603954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379891b0 msgr2=0x558637dd7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379891b0 0x558637dd7ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x558637d582a0 tx=0x7f10cc005760 comp rx=0 tx=0).stop 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10ed1c3740 1 -- 172.21.15.53:0/3913603954 shutdown_connections 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558637991390 0x558637de25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586379b2070 0x558637de63d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586379891b0 0x558637dd7ab0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10ed1c3740 1 --2- 172.21.15.53:0/3913603954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586379709f0 0x558637dd7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10bffff640 0 client.27370 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.788+0000 7f10ed1c3740 1 -- 172.21.15.53:0/3913603954 >> 172.21.15.53:0/3913603954 conn(0x5586379a6460 msgr2=0x558637d63dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10ed1c3740 1 -- 172.21.15.53:0/3913603954 shutdown_connections 2024-08-31T06:12:54.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10ed1c3740 1 -- 172.21.15.53:0/3913603954 wait complete. 2024-08-31T06:12:54.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10ed1c3740 20 client.27370 trim_cache size 0 max 16384 2024-08-31T06:12:54.796 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:12:54.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10e6c4e640 1 -- 172.21.15.53:0/477718949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d00b4ca0 msgr2=0x7f10d00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:54.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10e6c4e640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d00b4ca0 0x7f10d00b71b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f10d40e28e0 tx=0x7f10d40e8c50 comp rx=0 tx=0).stop 2024-08-31T06:12:54.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10e6c4e640 1 -- 172.21.15.53:0/477718949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0101d90 msgr2=0x7f10e019a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:54.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10e6c4e640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0101d90 0x7f10e019a1b0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f10d400d950 tx=0x7f10d400de10 comp rx=0 tx=0).stop 2024-08-31T06:12:54.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10e6c4e640 1 -- 172.21.15.53:0/477718949 shutdown_connections 2024-08-31T06:12:54.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10e6c4e640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f10d00b4ca0 0x7f10d00b71b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10e6c4e640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10e01069c0 0x7f10e019f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10e6c4e640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10e0106070 0x7f10e019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10e6c4e640 1 --2- 172.21.15.53:0/477718949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0101d90 0x7f10e019a1b0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:54.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.789+0000 7f10e6c4e640 1 -- 172.21.15.53:0/477718949 >> 172.21.15.53:0/477718949 conn(0x7f10e0077a60 msgr2=0x7f10e01072a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:54.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.790+0000 7f10e6c4e640 1 -- 172.21.15.53:0/477718949 shutdown_connections 2024-08-31T06:12:54.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:54.790+0000 7f10e6c4e640 1 -- 172.21.15.53:0/477718949 wait complete. 2024-08-31T06:12:54.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 136634 1.59 MB/sec execute 284 sec latency 22.515 ms 2024-08-31T06:12:55.590 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:12:55.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:55 smithi130 ceph-mon[22266]: pgmap v566: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-08-31T06:12:55.652 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:55 smithi053 ceph-mon[18924]: pgmap v566: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-08-31T06:12:55.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:55 smithi153 ceph-mon[22320]: pgmap v566: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-08-31T06:12:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:55.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 137164 1.59 MB/sec execute 285 sec latency 22.136 ms 2024-08-31T06:12:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.440+0000 7f1fae14b640 1 -- 172.21.15.53:0/1558543707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa8102800 msgr2=0x7f1fa8102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.440+0000 7f1fae14b640 1 --2- 172.21.15.53:0/1558543707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa8102800 0x7f1fa8102c10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009900 tx=0x7f1f9802a410 comp rx=0 tx=0).stop 2024-08-31T06:12:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.440+0000 7f1fae14b640 1 -- 172.21.15.53:0/1558543707 shutdown_connections 2024-08-31T06:12:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.440+0000 7f1fae14b640 1 --2- 172.21.15.53:0/1558543707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa8108a90 0x7f1fa810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.440+0000 7f1fae14b640 1 --2- 172.21.15.53:0/1558543707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fa8108140 0x7f1fa8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.440+0000 7f1fae14b640 1 --2- 172.21.15.53:0/1558543707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa8102800 0x7f1fa8102c10 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.440+0000 7f1fae14b640 1 -- 172.21.15.53:0/1558543707 >> 172.21.15.53:0/1558543707 conn(0x7f1fa80794d0 msgr2=0x7f1fa80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.440+0000 7f1fae14b640 1 -- 172.21.15.53:0/1558543707 shutdown_connections 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.440+0000 7f1fae14b640 1 -- 172.21.15.53:0/1558543707 wait complete. 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.441+0000 7f1fae14b640 1 Processor -- start 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.441+0000 7f1fae14b640 1 -- start start 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.441+0000 7f1fae14b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa8102800 0x7f1fa819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.441+0000 7f1fae14b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa8108140 0x7f1fa819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.441+0000 7f1fae14b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fa8108a90 0x7f1fa819f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fae14b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa81125a0 con 0x7f1fa8108140 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fae14b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa8112420 con 0x7f1fa8108a90 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fae14b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa8112720 con 0x7f1fa8102800 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa8102800 0x7f1fa819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa8102800 0x7f1fa819a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56368/0 (socket says 172.21.15.53:56368) 2024-08-31T06:12:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa8108140 0x7f1fa819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa77fe640 1 -- 172.21.15.53:0/1178317046 learned_addr learned my addr 172.21.15.53:0/1178317046 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa7fff640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fa8108a90 0x7f1fa819f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa77fe640 1 -- 172.21.15.53:0/1178317046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fa8108a90 msgr2=0x7f1fa819f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa77fe640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fa8108a90 0x7f1fa819f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa77fe640 1 -- 172.21.15.53:0/1178317046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa8108140 msgr2=0x7f1fa819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa77fe640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa8108140 0x7f1fa819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa77fe640 1 -- 172.21.15.53:0/1178317046 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa81a00a0 con 0x7f1fa8102800 2024-08-31T06:12:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa6ffd640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa8108140 0x7f1fa819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa77fe640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa8102800 0x7f1fa819a130 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009230 tx=0x7f1f980319a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.442+0000 7f1fa4ff9640 1 -- 172.21.15.53:0/1178317046 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9803f030 con 0x7f1fa8102800 2024-08-31T06:12:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.443+0000 7f1fae14b640 1 -- 172.21.15.53:0/1178317046 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa81a0330 con 0x7f1fa8102800 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.443+0000 7f1fa4ff9640 1 -- 172.21.15.53:0/1178317046 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f980043d0 con 0x7f1fa8102800 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.443+0000 7f1fa4ff9640 1 -- 172.21.15.53:0/1178317046 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f98035070 con 0x7f1fa8102800 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.443+0000 7f1fae14b640 1 -- 172.21.15.53:0/1178317046 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa8112d60 con 0x7f1fa8102800 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.445+0000 7f1fb46c0740 1 Processor -- start 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.445+0000 7f1fa4ff9640 1 -- 172.21.15.53:0/1178317046 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1f98042030 con 0x7f1fa8102800 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.445+0000 7f1fb46c0740 1 -- start start 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1124070 0x55f6a14c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 0x55f6a14c9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 0x55f6a14c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fb46c0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6a1440680 con 0x55f6a1103390 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fb46c0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f6a142fc10 con 0x55f6a1124070 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fb46c0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f6a1433bc0 con 0x55f6a10fb1b0 2024-08-31T06:12:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fa7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1124070 0x55f6a14c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fa6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 0x55f6a14c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fa77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 0x55f6a14c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fa7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1124070 0x55f6a14c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:58198/0 (socket says 172.21.15.53:58198) 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fa7fff640 1 -- 172.21.15.53:0/353433209 learned_addr learned my addr 172.21.15.53:0/353433209 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fa6ffd640 1 -- 172.21.15.53:0/353433209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 msgr2=0x55f6a14c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fa6ffd640 1 --2- 172.21.15.53:0/353433209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 0x55f6a14c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fa6ffd640 1 -- 172.21.15.53:0/353433209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1124070 msgr2=0x55f6a14c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fa6ffd640 1 --2- 172.21.15.53:0/353433209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1124070 0x55f6a14c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fa6ffd640 1 -- 172.21.15.53:0/353433209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6a118f650 con 0x55f6a1103390 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.446+0000 7f1fa4ff9640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f900b4ca0 0x7f1f900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.447+0000 7f1fa7fff640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f900b4ca0 0x7f1f900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.447+0000 7f1fa4ff9640 1 -- 172.21.15.53:0/1178317046 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f1f98105980 con 0x7f1fa8102800 2024-08-31T06:12:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.447+0000 7f1fa6ffd640 1 --2- 172.21.15.53:0/353433209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 0x55f6a14c9d90 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1fa806a840 tx=0x7f1f9c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79b0f5fcbb40fcf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.447+0000 7f1f8dffb640 1 -- 172.21.15.53:0/353433209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c01e030 con 0x55f6a1103390 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.447+0000 7f1f8dffb640 1 -- 172.21.15.53:0/353433209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f9c0054b0 con 0x55f6a1103390 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.447+0000 7f1f8dffb640 1 -- 172.21.15.53:0/353433209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c00b860 con 0x55f6a1103390 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.448+0000 7f1fb46c0740 1 -- 172.21.15.53:0/353433209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 msgr2=0x55f6a14c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.448+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/353433209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 0x55f6a14c9d90 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1fa806a840 tx=0x7f1f9c005f90 comp rx=0 tx=0).stop 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.448+0000 7f1fa7fff640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f900b4ca0 0x7f1f900b71b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00099a0 tx=0x7f1fa0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.448+0000 7f1fb46c0740 1 -- 172.21.15.53:0/353433209 shutdown_connections 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.448+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/353433209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 0x55f6a14c9d90 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.448+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/353433209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 0x55f6a14c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.448+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/353433209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1124070 0x55f6a14c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.448+0000 7f1fb46c0740 1 -- 172.21.15.53:0/353433209 >> 172.21.15.53:0/353433209 conn(0x55f6a1118460 msgr2=0x55f6a14c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.448+0000 7f1fb46c0740 1 -- 172.21.15.53:0/353433209 shutdown_connections 2024-08-31T06:12:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.448+0000 7f1fb46c0740 1 -- 172.21.15.53:0/353433209 wait complete. 2024-08-31T06:12:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.448+0000 7f1fb46c0740 1 -- start start 2024-08-31T06:12:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fb46c0740 1 Processor -- start 2024-08-31T06:12:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 0x55f6a14d4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 0x55f6a14d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1124070 0x55f6a14e0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fb46c0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6a1292700 con 0x55f6a1124070 2024-08-31T06:12:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fb46c0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f6a13b6750 con 0x55f6a1103390 2024-08-31T06:12:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fb46c0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f6a14d7af0 con 0x55f6a10fb1b0 2024-08-31T06:12:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fb46c0740 10 client.0 _ll_register_callbacks cb 0x55f6a13e5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fa77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 0x55f6a14d4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1124070 0x55f6a14e0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fa6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 0x55f6a14d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fa6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 0x55f6a14d4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:58202/0 (socket says 172.21.15.53:58202) 2024-08-31T06:12:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fa77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 0x55f6a14d4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56380/0 (socket says 172.21.15.53:56380) 2024-08-31T06:12:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fa6ffd640 1 -- 172.21.15.53:0/369462540 learned_addr learned my addr 172.21.15.53:0/369462540 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.449+0000 7f1fa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1124070 0x55f6a14e0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42300/0 (socket says 172.21.15.53:42300) 2024-08-31T06:12:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1fa77fe640 1 -- 172.21.15.53:0/369462540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 msgr2=0x55f6a14d4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1fa77fe640 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 0x55f6a14d4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1fa77fe640 1 -- 172.21.15.53:0/369462540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1124070 msgr2=0x55f6a14e0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1fa77fe640 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1124070 0x55f6a14e0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1fa77fe640 1 -- 172.21.15.53:0/369462540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6a13ef900 con 0x55f6a10fb1b0 2024-08-31T06:12:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1fa6ffd640 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 0x55f6a14d4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1fa77fe640 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 0x55f6a14d4a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1f981030b0 tx=0x7f1f98109040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92b5ba5ae6e6d156 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1f86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:12:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1f86ffd640 1 -- 172.21.15.53:0/369462540 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f98049070 con 0x55f6a10fb1b0 2024-08-31T06:12:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1fb46c0740 1 -- 172.21.15.53:0/369462540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f9c0054b0 con 0x55f6a10fb1b0 2024-08-31T06:12:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1f86ffd640 1 -- 172.21.15.53:0/369462540 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f1f980cc4c0 con 0x55f6a10fb1b0 2024-08-31T06:12:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1f86ffd640 1 -- 172.21.15.53:0/369462540 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1f980cbe20 con 0x55f6a10fb1b0 2024-08-31T06:12:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1fb46c0740 10 client.27382 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.450+0000 7f1fb46c0740 1 -- 172.21.15.53:0/369462540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f6a14e3860 con 0x55f6a10fb1b0 2024-08-31T06:12:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.451+0000 7f1f86ffd640 1 -- 172.21.15.53:0/369462540 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f9c0054b0 con 0x55f6a10fb1b0 2024-08-31T06:12:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.451+0000 7f1f86ffd640 1 -- 172.21.15.53:0/369462540 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f1f980d4ee0 con 0x55f6a10fb1b0 2024-08-31T06:12:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.451+0000 7f1fb46c0740 10 client.27382 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.451+0000 7f1fb46c0740 10 client.27382 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:12:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.451+0000 7f1fb46c0740 20 client.27382 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.451+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f6a10e29f0 0x55f6a14e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.451+0000 7f1fb46c0740 4 client.27382 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.451+0000 7f1fb46c0740 1 -- 172.21.15.53:0/369462540 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6a14425d0 con 0x55f6a10e29f0 2024-08-31T06:12:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.451+0000 7f1fa6ffd640 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f6a10e29f0 0x55f6a14e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.451+0000 7f1f86ffd640 10 client.27382 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:12:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.451+0000 7f1fa6ffd640 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f6a10e29f0 0x55f6a14e6e10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8ff76f08bb59d12c server_cookie=ba82c4d4d488b113 in_seq=0 out_seq=0 2024-08-31T06:12:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1f86ffd640 1 -- 172.21.15.53:0/369462540 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f6a14425d0 con 0x55f6a10e29f0 2024-08-31T06:12:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1f86ffd640 10 client.27382 handle_command_reply: tid=0 2024-08-31T06:12:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1fb46c0740 1 client.27382 shutdown 2024-08-31T06:12:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1fb46c0740 1 -- 172.21.15.53:0/369462540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 msgr2=0x55f6a14d4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 0x55f6a14d4a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1f981030b0 tx=0x7f1f98109040 comp rx=0 tx=0).stop 2024-08-31T06:12:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1fb46c0740 1 -- 172.21.15.53:0/369462540 shutdown_connections 2024-08-31T06:12:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f6a10e29f0 0x55f6a14e6e10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1124070 0x55f6a14e0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 0x55f6a14d4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/369462540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a10fb1b0 0x55f6a14d4a30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1f86ffd640 0 client.27382 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:12:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.452+0000 7f1fb46c0740 1 -- 172.21.15.53:0/369462540 >> 172.21.15.53:0/369462540 conn(0x55f6a1118460 msgr2=0x55f6a14cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.453+0000 7f1fb46c0740 1 -- 172.21.15.53:0/369462540 shutdown_connections 2024-08-31T06:12:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.453+0000 7f1fb46c0740 1 -- 172.21.15.53:0/369462540 wait complete. 2024-08-31T06:12:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.453+0000 7f1fb46c0740 20 client.27382 trim_cache size 0 max 16384 2024-08-31T06:12:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fb46c0740 1 Processor -- start 2024-08-31T06:12:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fb46c0740 1 -- start start 2024-08-31T06:12:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a10fb1b0 0x55f6a14e0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 0x55f6a14d1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a1124070 0x55f6a14d2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fb46c0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa81ad190 con 0x55f6a1103390 2024-08-31T06:12:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fb46c0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa81aecd0 con 0x55f6a10fb1b0 2024-08-31T06:12:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fb46c0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa81ad860 con 0x55f6a1124070 2024-08-31T06:12:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fa6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 0x55f6a14d1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fa77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a10fb1b0 0x55f6a14e0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fa6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 0x55f6a14d1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42314/0 (socket says 172.21.15.53:42314) 2024-08-31T06:12:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fa6ffd640 1 -- 172.21.15.53:0/615164087 learned_addr learned my addr 172.21.15.53:0/615164087 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.469+0000 7f1fa7fff640 1 --2- 172.21.15.53:0/615164087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a1124070 0x55f6a14d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.470+0000 7f1fa77fe640 1 -- 172.21.15.53:0/615164087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a1124070 msgr2=0x55f6a14d2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.470+0000 7f1fa77fe640 1 --2- 172.21.15.53:0/615164087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a1124070 0x55f6a14d2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.470+0000 7f1fa77fe640 1 -- 172.21.15.53:0/615164087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 msgr2=0x55f6a14d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.470+0000 7f1fa77fe640 1 --2- 172.21.15.53:0/615164087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 0x55f6a14d1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.470+0000 7f1fa77fe640 1 -- 172.21.15.53:0/615164087 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6a14d5610 con 0x55f6a10fb1b0 2024-08-31T06:12:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.470+0000 7f1fa6ffd640 1 --2- 172.21.15.53:0/615164087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 0x55f6a14d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.470+0000 7f1fa77fe640 1 --2- 172.21.15.53:0/615164087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a10fb1b0 0x55f6a14e0ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1f98000c00 tx=0x7f1f980d52a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52bd79735fec915b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.470+0000 7f1f8d7fa640 1 -- 172.21.15.53:0/615164087 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f98049070 con 0x55f6a10fb1b0 2024-08-31T06:12:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.470+0000 7f1f8d7fa640 1 -- 172.21.15.53:0/615164087 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f980f1070 con 0x55f6a10fb1b0 2024-08-31T06:12:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.470+0000 7f1f8d7fa640 1 -- 172.21.15.53:0/615164087 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9810b020 con 0x55f6a10fb1b0 2024-08-31T06:12:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.471+0000 7f1fb46c0740 1 -- 172.21.15.53:0/615164087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a10fb1b0 msgr2=0x55f6a14e0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.471+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/615164087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a10fb1b0 0x55f6a14e0ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1f98000c00 tx=0x7f1f980d52a0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.471+0000 7f1fb46c0740 1 -- 172.21.15.53:0/615164087 shutdown_connections 2024-08-31T06:12:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.471+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/615164087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a1124070 0x55f6a14d2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.471+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/615164087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a1103390 0x55f6a14d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.471+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/615164087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a10fb1b0 0x55f6a14e0ce0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.471+0000 7f1fb46c0740 1 -- 172.21.15.53:0/615164087 >> 172.21.15.53:0/615164087 conn(0x55f6a1118460 msgr2=0x55f6a14d32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.471+0000 7f1fb46c0740 1 -- 172.21.15.53:0/615164087 shutdown_connections 2024-08-31T06:12:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.471+0000 7f1fb46c0740 1 -- 172.21.15.53:0/615164087 wait complete. 2024-08-31T06:12:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.472+0000 7f1fb46c0740 1 -- start start 2024-08-31T06:12:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.472+0000 7f1fb46c0740 1 Processor -- start 2024-08-31T06:12:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a10fb1b0 0x55f6a14dd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 0x55f6a14d8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fb46c0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a1124070 0x55f6a14d9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fa77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a10fb1b0 0x55f6a14dd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fa77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a10fb1b0 0x55f6a14dd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42320/0 (socket says 172.21.15.53:42320) 2024-08-31T06:12:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fa6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 0x55f6a14d8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fa77fe640 1 -- 172.21.15.53:0/3445412525 learned_addr learned my addr 172.21.15.53:0/3445412525 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fb46c0740 1 -- 172.21.15.53:0/3445412525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa81ae600 con 0x55f6a10fb1b0 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fb46c0740 1 -- 172.21.15.53:0/3445412525 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa81adf30 con 0x55f6a1103390 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fb46c0740 1 -- 172.21.15.53:0/3445412525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa81ab190 con 0x55f6a1124070 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fb46c0740 10 client.0 _ll_register_callbacks cb 0x7f1f98005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.473+0000 7f1fa7fff640 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a1124070 0x55f6a14d9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1fa6ffd640 1 -- 172.21.15.53:0/3445412525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a1124070 msgr2=0x55f6a14d9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1fa6ffd640 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a1124070 0x55f6a14d9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1fa6ffd640 1 -- 172.21.15.53:0/3445412525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a10fb1b0 msgr2=0x55f6a14dd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1fa6ffd640 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a10fb1b0 0x55f6a14dd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1fa6ffd640 1 -- 172.21.15.53:0/3445412525 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6a14d97d0 con 0x55f6a1103390 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1fa7fff640 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a1124070 0x55f6a14d9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1fa6ffd640 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 0x55f6a14d8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0093e0 tx=0x7f1f9c004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64beef6d53b7ac17 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1f86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:12:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1f86ffd640 1 -- 172.21.15.53:0/3445412525 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c01e040 con 0x55f6a1103390 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1f86ffd640 1 -- 172.21.15.53:0/3445412525 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f1f9c005000 con 0x55f6a1103390 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1fb46c0740 1 -- 172.21.15.53:0/3445412525 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f980f1070 con 0x55f6a1103390 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1f86ffd640 1 -- 172.21.15.53:0/3445412525 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1f9c043050 con 0x55f6a1103390 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1fb46c0740 10 client.27392 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.474+0000 7f1fb46c0740 1 -- 172.21.15.53:0/3445412525 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f6a1551710 con 0x55f6a1103390 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.475+0000 7f1f86ffd640 1 -- 172.21.15.53:0/3445412525 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f980f1070 con 0x55f6a1103390 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.475+0000 7f1f86ffd640 1 -- 172.21.15.53:0/3445412525 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f1f9c02d050 con 0x55f6a1103390 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.475+0000 7f1fb46c0740 10 client.27392 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.475+0000 7f1fb46c0740 10 client.27392 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.475+0000 7f1fb46c0740 20 client.27392 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.475+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f6a10b7da0 0x55f6a1553c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.475+0000 7f1fb46c0740 4 client.27392 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:12:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.475+0000 7f1fb46c0740 1 -- 172.21.15.53:0/3445412525 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f6a143e070 con 0x55f6a10b7da0 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.475+0000 7f1fa77fe640 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f6a10b7da0 0x55f6a1553c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.476+0000 7f1fa77fe640 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f6a10b7da0 0x55f6a1553c90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=588a7f1e7716bbbc server_cookie=d9275e5f6aaf9557 in_seq=0 out_seq=0 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.476+0000 7f1f86ffd640 10 client.27392 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.476+0000 7f1f86ffd640 1 -- 172.21.15.53:0/3445412525 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f6a143e070 con 0x55f6a10b7da0 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.476+0000 7f1f86ffd640 10 client.27392 handle_command_reply: tid=0 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.476+0000 7f1fb46c0740 1 client.27392 shutdown 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.476+0000 7f1fb46c0740 1 -- 172.21.15.53:0/3445412525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 msgr2=0x55f6a14d8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.476+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 0x55f6a14d8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0093e0 tx=0x7f1f9c004b50 comp rx=0 tx=0).stop 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.477+0000 7f1fb46c0740 1 -- 172.21.15.53:0/3445412525 shutdown_connections 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.477+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a1124070 0x55f6a14d9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.477+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6a1103390 0x55f6a14d8a70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.477+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55f6a10b7da0 0x55f6a1553c90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.477+0000 7f1fb46c0740 1 --2- 172.21.15.53:0/3445412525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6a10fb1b0 0x55f6a14dd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.477+0000 7f1f86ffd640 0 client.27392 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:12:56.504 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:12:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.477+0000 7f1fb46c0740 1 -- 172.21.15.53:0/3445412525 >> 172.21.15.53:0/3445412525 conn(0x55f6a1118460 msgr2=0x55f6a14d5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.477+0000 7f1fb46c0740 1 -- 172.21.15.53:0/3445412525 shutdown_connections 2024-08-31T06:12:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.477+0000 7f1fb46c0740 1 -- 172.21.15.53:0/3445412525 wait complete. 2024-08-31T06:12:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.477+0000 7f1fb46c0740 20 client.27392 trim_cache size 0 max 16384 2024-08-31T06:12:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 -- 172.21.15.53:0/1178317046 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f900b4ca0 msgr2=0x7f1f900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f900b4ca0 0x7f1f900b71b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00099a0 tx=0x7f1fa0009500 comp rx=0 tx=0).stop 2024-08-31T06:12:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 -- 172.21.15.53:0/1178317046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa8102800 msgr2=0x7f1fa819a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa8102800 0x7f1fa819a130 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009230 tx=0x7f1f980319a0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 -- 172.21.15.53:0/1178317046 shutdown_connections 2024-08-31T06:12:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f900b4ca0 0x7f1f900b71b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fa8108a90 0x7f1fa819f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa8108140 0x7f1fa819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 --2- 172.21.15.53:0/1178317046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fa8102800 0x7f1fa819a130 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 -- 172.21.15.53:0/1178317046 >> 172.21.15.53:0/1178317046 conn(0x7f1fa80794d0 msgr2=0x7f1fa81003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 -- 172.21.15.53:0/1178317046 shutdown_connections 2024-08-31T06:12:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:56.478+0000 7f1fae14b640 1 -- 172.21.15.53:0/1178317046 wait complete. 2024-08-31T06:12:56.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 137690 1.60 MB/sec execute 286 sec latency 44.483 ms 2024-08-31T06:12:57.193 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:12:57.517 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:57.812 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:57 smithi053 ceph-mon[18924]: pgmap v567: 97 pgs: 97 active+clean; 81 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 1.5 MiB/s wr, 137 op/s 2024-08-31T06:12:57.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:57 smithi130 ceph-mon[22266]: pgmap v567: 97 pgs: 97 active+clean; 81 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 1.5 MiB/s wr, 137 op/s 2024-08-31T06:12:57.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:57 smithi153 ceph-mon[22320]: pgmap v567: 97 pgs: 97 active+clean; 81 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 1.5 MiB/s wr, 137 op/s 2024-08-31T06:12:57.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 138149 1.61 MB/sec execute 287 sec latency 14.618 ms 2024-08-31T06:12:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.074+0000 7f7ee56da640 1 -- 172.21.15.53:0/550261641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee0108ac0 msgr2=0x7f7ee010f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.074+0000 7f7ee56da640 1 --2- 172.21.15.53:0/550261641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee0108ac0 0x7f7ee010f2f0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009ca0 tx=0x7f7ed802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.075+0000 7f7ee56da640 1 -- 172.21.15.53:0/550261641 shutdown_connections 2024-08-31T06:12:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.075+0000 7f7ee56da640 1 --2- 172.21.15.53:0/550261641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee0108ac0 0x7f7ee010f2f0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.075+0000 7f7ee56da640 1 --2- 172.21.15.53:0/550261641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee0108170 0x7f7ee0108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.075+0000 7f7ee56da640 1 --2- 172.21.15.53:0/550261641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee0102830 0x7f7ee0102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.075+0000 7f7ee56da640 1 -- 172.21.15.53:0/550261641 >> 172.21.15.53:0/550261641 conn(0x7f7ee00794f0 msgr2=0x7f7ee0079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.075+0000 7f7ee56da640 1 -- 172.21.15.53:0/550261641 shutdown_connections 2024-08-31T06:12:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.075+0000 7f7ee56da640 1 -- 172.21.15.53:0/550261641 wait complete. 2024-08-31T06:12:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.075+0000 7f7ee56da640 1 Processor -- start 2024-08-31T06:12:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.075+0000 7f7ee56da640 1 -- start start 2024-08-31T06:12:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ee56da640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee0102830 0x7f7ee0198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ee56da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee0108170 0x7f7ee0199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ee56da640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee0108ac0 0x7f7ee0199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ee56da640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee0112620 con 0x7f7ee0108170 2024-08-31T06:12:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ee56da640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee01124a0 con 0x7f7ee0108ac0 2024-08-31T06:12:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ee56da640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee01127a0 con 0x7f7ee0102830 2024-08-31T06:12:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ede7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee0108170 0x7f7ee0199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee0102830 0x7f7ee0198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ede7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee0108170 0x7f7ee0199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42342/0 (socket says 172.21.15.53:42342) 2024-08-31T06:12:58.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee0102830 0x7f7ee0198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56422/0 (socket says 172.21.15.53:56422) 2024-08-31T06:12:58.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ede7fc640 1 -- 172.21.15.53:0/3686163236 learned_addr learned my addr 172.21.15.53:0/3686163236 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:58.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7edf7fe640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee0108ac0 0x7f7ee0199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ede7fc640 1 -- 172.21.15.53:0/3686163236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee0102830 msgr2=0x7f7ee0198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:58.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee0102830 0x7f7ee0198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ede7fc640 1 -- 172.21.15.53:0/3686163236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee0108ac0 msgr2=0x7f7ee0199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:58.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee0108ac0 0x7f7ee0199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7ede7fc640 1 -- 172.21.15.53:0/3686163236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee01a83b0 con 0x7f7ee0108170 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.076+0000 7f7edf7fe640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee0108ac0 0x7f7ee0199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.077+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee0108170 0x7f7ee0199240 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400d770 tx=0x7f7ed400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.077+0000 7f7ec7fff640 1 -- 172.21.15.53:0/3686163236 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4017070 con 0x7f7ee0108170 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.077+0000 7f7ee56da640 1 -- 172.21.15.53:0/3686163236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee01a86a0 con 0x7f7ee0108170 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.077+0000 7f7ec7fff640 1 -- 172.21.15.53:0/3686163236 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ed4009c30 con 0x7f7ee0108170 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.077+0000 7f7ec7fff640 1 -- 172.21.15.53:0/3686163236 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400f620 con 0x7f7ee0108170 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.077+0000 7f7ee56da640 1 -- 172.21.15.53:0/3686163236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee01a8c30 con 0x7f7ee0108170 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.080+0000 7f7eebc4f740 1 Processor -- start 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.080+0000 7f7eebc4f740 1 -- start start 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7ec7fff640 1 -- 172.21.15.53:0/3686163236 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7ed401a070 con 0x7f7ee0108170 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74e2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74e2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74e2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a7b7459680 con 0x55a7b71141b0 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a7b7448c10 con 0x55a7b713d070 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a7b744cbc0 con 0x55a7b711c390 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74e2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42352/0 (socket says 172.21.15.53:42352) 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7edeffd640 1 -- 172.21.15.53:0/2877676056 learned_addr learned my addr 172.21.15.53:0/2877676056 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7edf7fe640 1 --2- 172.21.15.53:0/2877676056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74e2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/2877676056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74e2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7edeffd640 1 -- 172.21.15.53:0/2877676056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 msgr2=0x55a7b74e2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7edeffd640 1 --2- 172.21.15.53:0/2877676056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74e2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7edeffd640 1 -- 172.21.15.53:0/2877676056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 msgr2=0x55a7b74e2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7edeffd640 1 --2- 172.21.15.53:0/2877676056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74e2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7edeffd640 1 -- 172.21.15.53:0/2877676056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7b71a8650 con 0x55a7b71141b0 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7edf7fe640 1 --2- 172.21.15.53:0/2877676056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74e2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.081+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/2877676056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74e2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.082+0000 7f7edeffd640 1 --2- 172.21.15.53:0/2877676056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74e2850 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009c90 tx=0x7f7ed0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3dfeda8159529c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.082+0000 7f7ec7fff640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec80b4ca0 0x7f7ec80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.082+0000 7f7edf7fe640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec80b4ca0 0x7f7ec80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.082+0000 7f7ec57fa640 1 -- 172.21.15.53:0/2877676056 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0005220 con 0x55a7b71141b0 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.082+0000 7f7ec7fff640 1 -- 172.21.15.53:0/3686163236 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f7ed40e5090 con 0x7f7ee0108170 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.082+0000 7f7ec57fa640 1 -- 172.21.15.53:0/2877676056 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ed0004c30 con 0x55a7b71141b0 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.082+0000 7f7ec57fa640 1 -- 172.21.15.53:0/2877676056 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0019670 con 0x55a7b71141b0 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.083+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2877676056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 msgr2=0x55a7b74e2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.083+0000 7f7edf7fe640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec80b4ca0 0x7f7ec80b71b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8006010 tx=0x7f7ed8031880 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.083+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2877676056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74e2850 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009c90 tx=0x7f7ed0011810 comp rx=0 tx=0).stop 2024-08-31T06:12:58.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.083+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2877676056 shutdown_connections 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.083+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2877676056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74e2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.083+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2877676056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74e2850 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.083+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2877676056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74e2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.083+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2877676056 >> 172.21.15.53:0/2877676056 conn(0x55a7b7131460 msgr2=0x55a7b74e0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.083+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2877676056 shutdown_connections 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.083+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2877676056 wait complete. 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.083+0000 7f7eebc4f740 1 -- start start 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7eebc4f740 1 Processor -- start 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74eda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74edf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74f9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a7b72ab700 con 0x55a7b71141b0 2024-08-31T06:12:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a7b73cf750 con 0x55a7b713d070 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a7b74f0af0 con 0x55a7b711c390 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74eda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42360/0 (socket says 172.21.15.53:42360) 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7eebc4f740 10 client.0 _ll_register_callbacks cb 0x55a7b73fee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7edeffd640 1 -- 172.21.15.53:0/2528823544 learned_addr learned my addr 172.21.15.53:0/2528823544 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7edf7fe640 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74f9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74edf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7edeffd640 1 -- 172.21.15.53:0/2528823544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 msgr2=0x55a7b74edf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7edeffd640 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74edf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7edeffd640 1 -- 172.21.15.53:0/2528823544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 msgr2=0x55a7b74f9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.084+0000 7f7edeffd640 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74f9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.085+0000 7f7edeffd640 1 -- 172.21.15.53:0/2528823544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7b7408900 con 0x55a7b71141b0 2024-08-31T06:12:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.085+0000 7f7edeffd640 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74eda50 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7ed001b040 tx=0x7f7ed0005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191f2255b1924a48 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.085+0000 7f7ec2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.085+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2528823544 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0029070 con 0x55a7b71141b0 2024-08-31T06:12:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.085+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2528823544 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f7ed00051f0 con 0x55a7b71141b0 2024-08-31T06:12:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.085+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2528823544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ed0004c30 con 0x55a7b71141b0 2024-08-31T06:12:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.085+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2528823544 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7ed0035050 con 0x55a7b71141b0 2024-08-31T06:12:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.085+0000 7f7eebc4f740 10 client.18132 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.085+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2528823544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a7b74fc860 con 0x55a7b71141b0 2024-08-31T06:12:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.085+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2528823544 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ed0004c30 con 0x55a7b71141b0 2024-08-31T06:12:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.086+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2528823544 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f7ed0019430 con 0x55a7b71141b0 2024-08-31T06:12:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.086+0000 7f7eebc4f740 10 client.18132 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.086+0000 7f7eebc4f740 10 client.18132 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:12:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.086+0000 7f7eebc4f740 20 client.18132 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.086+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a7b70fb9f0 0x55a7b74ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.086+0000 7f7eebc4f740 4 client.18132 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.086+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2528823544 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7b745b5d0 con 0x55a7b70fb9f0 2024-08-31T06:12:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.087+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a7b70fb9f0 0x55a7b74ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.087+0000 7f7ec2ff5640 10 client.18132 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:12:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.087+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a7b70fb9f0 0x55a7b74ffbc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3099807e19205392 server_cookie=4e57ea10a231713a in_seq=0 out_seq=0 2024-08-31T06:12:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2528823544 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7b745b5d0 con 0x55a7b70fb9f0 2024-08-31T06:12:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7ec2ff5640 10 client.18132 handle_command_reply: tid=0 2024-08-31T06:12:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7eebc4f740 1 client.18132 shutdown 2024-08-31T06:12:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2528823544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 msgr2=0x55a7b74eda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74eda50 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7ed001b040 tx=0x7f7ed0005d90 comp rx=0 tx=0).stop 2024-08-31T06:12:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2528823544 shutdown_connections 2024-08-31T06:12:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a7b70fb9f0 0x55a7b74ffbc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74f9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74edf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2528823544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74eda50 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2528823544 >> 172.21.15.53:0/2528823544 conn(0x55a7b7131460 msgr2=0x55a7b74e54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.088+0000 7f7ec2ff5640 0 client.18132 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:12:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.089+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2528823544 shutdown_connections 2024-08-31T06:12:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.089+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2528823544 wait complete. 2024-08-31T06:12:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.089+0000 7f7eebc4f740 20 client.18132 trim_cache size 0 max 16384 2024-08-31T06:12:58.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7eebc4f740 1 Processor -- start 2024-08-31T06:12:58.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7eebc4f740 1 -- start start 2024-08-31T06:12:58.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b71141b0 0x55a7b74e0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b711c390 0x55a7b74f9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b713d070 0x55a7b74eac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee01b1730 con 0x55a7b711c390 2024-08-31T06:12:58.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee01b3270 con 0x55a7b71141b0 2024-08-31T06:12:58.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee01b1e00 con 0x55a7b713d070 2024-08-31T06:12:58.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7ede7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b711c390 0x55a7b74f9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b71141b0 0x55a7b74e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b71141b0 0x55a7b74e0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:58284/0 (socket says 172.21.15.53:58284) 2024-08-31T06:12:58.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7edeffd640 1 -- 172.21.15.53:0/2587446904 learned_addr learned my addr 172.21.15.53:0/2587446904 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:58.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.103+0000 7f7edf7fe640 1 --2- 172.21.15.53:0/2587446904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b713d070 0x55a7b74eac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.104+0000 7f7ede7fc640 1 -- 172.21.15.53:0/2587446904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b713d070 msgr2=0x55a7b74eac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:58.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.104+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/2587446904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b713d070 0x55a7b74eac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.104+0000 7f7ede7fc640 1 -- 172.21.15.53:0/2587446904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b71141b0 msgr2=0x55a7b74e0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:58.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.104+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/2587446904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b71141b0 0x55a7b74e0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.104+0000 7f7ede7fc640 1 -- 172.21.15.53:0/2587446904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7b74eeaf0 con 0x55a7b711c390 2024-08-31T06:12:58.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.104+0000 7f7edeffd640 1 --2- 172.21.15.53:0/2587446904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b71141b0 0x55a7b74e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:58.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.104+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/2587446904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b711c390 0x55a7b74f9ce0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40e2760 tx=0x7f7ed400de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f6b7944743787c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:58.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.104+0000 7f7ec4ff9640 1 -- 172.21.15.53:0/2587446904 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4021040 con 0x55a7b711c390 2024-08-31T06:12:58.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.104+0000 7f7ec4ff9640 1 -- 172.21.15.53:0/2587446904 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ed40ab2c0 con 0x55a7b711c390 2024-08-31T06:12:58.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.104+0000 7f7ec4ff9640 1 -- 172.21.15.53:0/2587446904 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed40e29e0 con 0x55a7b711c390 2024-08-31T06:12:58.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.105+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2587446904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b711c390 msgr2=0x55a7b74f9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:58.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.105+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2587446904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b711c390 0x55a7b74f9ce0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40e2760 tx=0x7f7ed400de80 comp rx=0 tx=0).stop 2024-08-31T06:12:58.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.105+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2587446904 shutdown_connections 2024-08-31T06:12:58.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.105+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2587446904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b713d070 0x55a7b74eac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.105+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2587446904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b711c390 0x55a7b74f9ce0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.105+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2587446904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b71141b0 0x55a7b74e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.105+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2587446904 >> 172.21.15.53:0/2587446904 conn(0x55a7b7131460 msgr2=0x55a7b74dfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:58.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.105+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2587446904 shutdown_connections 2024-08-31T06:12:58.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.105+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2587446904 wait complete. 2024-08-31T06:12:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7eebc4f740 1 -- start start 2024-08-31T06:12:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7eebc4f740 1 Processor -- start 2024-08-31T06:12:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7eebc4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74f2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee01b2ba0 con 0x55a7b71141b0 2024-08-31T06:12:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee01b24d0 con 0x55a7b713d070 2024-08-31T06:12:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7eebc4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee01af730 con 0x55a7b711c390 2024-08-31T06:12:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7eebc4f740 10 client.0 _ll_register_callbacks cb 0x7f7ed8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7edf7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7edeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42376/0 (socket says 172.21.15.53:42376) 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7ede7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.106+0000 7f7edeffd640 1 -- 172.21.15.53:0/2435913497 learned_addr learned my addr 172.21.15.53:0/2435913497 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7edeffd640 1 -- 172.21.15.53:0/2435913497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 msgr2=0x55a7b74f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7edeffd640 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7edeffd640 1 -- 172.21.15.53:0/2435913497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 msgr2=0x55a7b74f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7edeffd640 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7edeffd640 1 -- 172.21.15.53:0/2435913497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7b7569550 con 0x55a7b71141b0 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7edf7fe640 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7edeffd640 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74f1eb0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00199a0 tx=0x7f7ed0009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a0039324179306 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7ec2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2435913497 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed003e060 con 0x55a7b71141b0 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2435913497 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f7ed0019430 con 0x55a7b71141b0 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2435913497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ed40ab2c0 con 0x55a7b71141b0 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2435913497 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7ed0029040 con 0x55a7b71141b0 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7eebc4f740 10 client.18138 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.107+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2435913497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a7b756a7d0 con 0x55a7b71141b0 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.108+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2435913497 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ed40ab2c0 con 0x55a7b71141b0 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.108+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2435913497 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f7ed0004ff0 con 0x55a7b71141b0 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.108+0000 7f7eebc4f740 10 client.18138 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.108+0000 7f7eebc4f740 10 client.18138 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.108+0000 7f7eebc4f740 20 client.18138 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.108+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a7b70d0da0 0x55a7b756cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.108+0000 7f7eebc4f740 4 client.18138 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:12:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.108+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2435913497 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a7b7457070 con 0x55a7b70d0da0 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.108+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a7b70d0da0 0x55a7b756cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.108+0000 7f7ec2ff5640 10 client.18138 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.108+0000 7f7ede7fc640 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a7b70d0da0 0x55a7b756cf00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f1d7c001cfa250c9 server_cookie=3835b2b6b9fa0adb in_seq=0 out_seq=0 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7ec2ff5640 1 -- 172.21.15.53:0/2435913497 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a7b7457070 con 0x55a7b70d0da0 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7ec2ff5640 10 client.18138 handle_command_reply: tid=0 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 1 client.18138 shutdown 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2435913497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 msgr2=0x55a7b74f1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74f1eb0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00199a0 tx=0x7f7ed0009640 comp rx=0 tx=0).stop 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2435913497 shutdown_connections 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a7b70d0da0 0x55a7b756cf00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7b713d070 0x55a7b74f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7b711c390 0x55a7b74f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 1 --2- 172.21.15.53:0/2435913497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7b71141b0 0x55a7b74f1eb0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7ec2ff5640 0 client.18138 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:12:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2435913497 >> 172.21.15.53:0/2435913497 conn(0x55a7b7131460 msgr2=0x55a7b74e3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2435913497 shutdown_connections 2024-08-31T06:12:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 1 -- 172.21.15.53:0/2435913497 wait complete. 2024-08-31T06:12:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.109+0000 7f7eebc4f740 20 client.18138 trim_cache size 0 max 16384 2024-08-31T06:12:58.122 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:12:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 -- 172.21.15.53:0/3686163236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec80b4ca0 msgr2=0x7f7ec80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec80b4ca0 0x7f7ec80b71b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8006010 tx=0x7f7ed8031880 comp rx=0 tx=0).stop 2024-08-31T06:12:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 -- 172.21.15.53:0/3686163236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee0108170 msgr2=0x7f7ee0199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee0108170 0x7f7ee0199240 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400d770 tx=0x7f7ed400dc30 comp rx=0 tx=0).stop 2024-08-31T06:12:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 -- 172.21.15.53:0/3686163236 shutdown_connections 2024-08-31T06:12:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec80b4ca0 0x7f7ec80b71b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ee0108ac0 0x7f7ee0199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee0108170 0x7f7ee0199240 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 --2- 172.21.15.53:0/3686163236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee0102830 0x7f7ee0198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 -- 172.21.15.53:0/3686163236 >> 172.21.15.53:0/3686163236 conn(0x7f7ee00794f0 msgr2=0x7f7ee0105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 -- 172.21.15.53:0/3686163236 shutdown_connections 2024-08-31T06:12:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:58.110+0000 7f7ee56da640 1 -- 172.21.15.53:0/3686163236 wait complete. 2024-08-31T06:12:58.828 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:12:58.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 138619 1.62 MB/sec execute 288 sec latency 14.351 ms 2024-08-31T06:12:59.098 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:12:59.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.607+0000 7f889bd42640 1 -- 172.21.15.53:0/2984859505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8894108140 msgr2=0x7f8894108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:59.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.607+0000 7f889bd42640 1 --2- 172.21.15.53:0/2984859505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8894108140 0x7f8894108550 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8890009900 tx=0x7f889002a410 comp rx=0 tx=0).stop 2024-08-31T06:12:59.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.608+0000 7f889bd42640 1 -- 172.21.15.53:0/2984859505 shutdown_connections 2024-08-31T06:12:59.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.608+0000 7f889bd42640 1 --2- 172.21.15.53:0/2984859505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8894108a90 0x7f889410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.608+0000 7f889bd42640 1 --2- 172.21.15.53:0/2984859505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8894108140 0x7f8894108550 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.608+0000 7f889bd42640 1 --2- 172.21.15.53:0/2984859505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8894102800 0x7f8894102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.608+0000 7f889bd42640 1 -- 172.21.15.53:0/2984859505 >> 172.21.15.53:0/2984859505 conn(0x7f88940794d0 msgr2=0x7f88940798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:59.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.608+0000 7f889bd42640 1 -- 172.21.15.53:0/2984859505 shutdown_connections 2024-08-31T06:12:59.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.608+0000 7f889bd42640 1 -- 172.21.15.53:0/2984859505 wait complete. 2024-08-31T06:12:59.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.608+0000 7f889bd42640 1 Processor -- start 2024-08-31T06:12:59.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.608+0000 7f889bd42640 1 -- start start 2024-08-31T06:12:59.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f889bd42640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8894102800 0x7f889419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f889bd42640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8894108140 0x7f889419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f889bd42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8894108a90 0x7f889419bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f889bd42640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8894112570 con 0x7f8894108a90 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f889bd42640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f88941123f0 con 0x7f8894102800 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f889bd42640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88941126f0 con 0x7f8894108140 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f8899ade640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8894102800 0x7f889419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f8899ade640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8894102800 0x7f889419b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:58314/0 (socket says 172.21.15.53:58314) 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f889a2df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8894108a90 0x7f889419bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f8899ade640 1 -- 172.21.15.53:0/1917160107 learned_addr learned my addr 172.21.15.53:0/1917160107 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f88992dd640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8894108140 0x7f889419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f8899ade640 1 -- 172.21.15.53:0/1917160107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8894108140 msgr2=0x7f889419b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f8899ade640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8894108140 0x7f889419b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f8899ade640 1 -- 172.21.15.53:0/1917160107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8894108a90 msgr2=0x7f889419bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f8899ade640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8894108a90 0x7f889419bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f8899ade640 1 -- 172.21.15.53:0/1917160107 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88941a6340 con 0x7f8894102800 2024-08-31T06:12:59.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.609+0000 7f889a2df640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8894108a90 0x7f889419bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:59.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.610+0000 7f8899ade640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8894102800 0x7f889419b0b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f888c00ebc0 tx=0x7f888c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:59.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.610+0000 7f8886ffd640 1 -- 172.21.15.53:0/1917160107 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c010630 con 0x7f8894102800 2024-08-31T06:12:59.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.610+0000 7f889bd42640 1 -- 172.21.15.53:0/1917160107 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88941a6630 con 0x7f8894102800 2024-08-31T06:12:59.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.610+0000 7f8886ffd640 1 -- 172.21.15.53:0/1917160107 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f888c010c60 con 0x7f8894102800 2024-08-31T06:12:59.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.610+0000 7f889bd42640 1 -- 172.21.15.53:0/1917160107 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88941a6b90 con 0x7f8894102800 2024-08-31T06:12:59.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.610+0000 7f8886ffd640 1 -- 172.21.15.53:0/1917160107 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c018b00 con 0x7f8894102800 2024-08-31T06:12:59.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.612+0000 7f8886ffd640 1 -- 172.21.15.53:0/1917160107 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f888c018ca0 con 0x7f8894102800 2024-08-31T06:12:59.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.613+0000 7f88a22b7740 1 Processor -- start 2024-08-31T06:12:59.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.613+0000 7f88a22b7740 1 -- start start 2024-08-31T06:12:59.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.613+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b179310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.613+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 0x55b26b179850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.613+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adb3390 0x55b26b179d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.613+0000 7f88a22b7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b26b0f0680 con 0x55b26add4070 2024-08-31T06:12:59.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.613+0000 7f88a22b7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b26b0dfc10 con 0x55b26adb3390 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.613+0000 7f88a22b7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b26b0e3bc0 con 0x55b26adab1b0 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.613+0000 7f889a2df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b179310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.613+0000 7f8886ffd640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88800b4d50 0x7f88800b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f889a2df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b179310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42408/0 (socket says 172.21.15.53:42408) 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f889a2df640 1 -- 172.21.15.53:0/1365266779 learned_addr learned my addr 172.21.15.53:0/1365266779 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f88992dd640 1 --2- 172.21.15.53:0/1365266779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adb3390 0x55b26b179d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f8899ade640 1 --2- 172.21.15.53:0/1365266779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 0x55b26b179850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f889a2df640 1 -- 172.21.15.53:0/1365266779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 msgr2=0x55b26b179850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f889a2df640 1 --2- 172.21.15.53:0/1365266779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 0x55b26b179850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f889a2df640 1 -- 172.21.15.53:0/1365266779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adb3390 msgr2=0x55b26b179d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f889a2df640 1 --2- 172.21.15.53:0/1365266779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adb3390 0x55b26b179d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f889a2df640 1 -- 172.21.15.53:0/1365266779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b26ae3f650 con 0x55b26add4070 2024-08-31T06:12:59.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f88992dd640 1 --2- 172.21.15.53:0/1365266779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adb3390 0x55b26b179d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:59.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f8886ffd640 1 -- 172.21.15.53:0/1917160107 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f888c0e5870 con 0x7f8894102800 2024-08-31T06:12:59.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f889a2df640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88800b4d50 0x7f88800b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f889a2df640 1 --2- 172.21.15.53:0/1365266779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b179310 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f88880104a0 tx=0x7f8888010960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f672677c480a6e6b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:59.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.614+0000 7f887ffff640 1 -- 172.21.15.53:0/1365266779 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888022070 con 0x55b26add4070 2024-08-31T06:12:59.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.615+0000 7f887ffff640 1 -- 172.21.15.53:0/1365266779 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f888800e3d0 con 0x55b26add4070 2024-08-31T06:12:59.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.615+0000 7f887ffff640 1 -- 172.21.15.53:0/1365266779 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88880255e0 con 0x55b26add4070 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.615+0000 7f88a22b7740 1 -- 172.21.15.53:0/1365266779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 msgr2=0x55b26b179310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.615+0000 7f88a22b7740 1 --2- 172.21.15.53:0/1365266779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b179310 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f88880104a0 tx=0x7f8888010960 comp rx=0 tx=0).stop 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.615+0000 7f889a2df640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88800b4d50 0x7f88800b7260 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f888801f000 tx=0x7f888801b000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.616+0000 7f88a22b7740 1 -- 172.21.15.53:0/1365266779 shutdown_connections 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.616+0000 7f88a22b7740 1 --2- 172.21.15.53:0/1365266779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adb3390 0x55b26b179d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.616+0000 7f88a22b7740 1 --2- 172.21.15.53:0/1365266779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 0x55b26b179850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.616+0000 7f88a22b7740 1 --2- 172.21.15.53:0/1365266779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b179310 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.616+0000 7f88a22b7740 1 -- 172.21.15.53:0/1365266779 >> 172.21.15.53:0/1365266779 conn(0x55b26adc8460 msgr2=0x55b26b177200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.616+0000 7f88a22b7740 1 -- 172.21.15.53:0/1365266779 shutdown_connections 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.616+0000 7f88a22b7740 1 -- 172.21.15.53:0/1365266779 wait complete. 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.616+0000 7f88a22b7740 1 -- start start 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.616+0000 7f88a22b7740 1 Processor -- start 2024-08-31T06:12:59.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 0x55b26b184aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26adb3390 0x55b26b184fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26add4070 0x55b26b190e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f88a22b7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b26af42700 con 0x55b26adb3390 2024-08-31T06:12:59.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f88a22b7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b26b066750 con 0x55b26add4070 2024-08-31T06:12:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f88a22b7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b26b187af0 con 0x55b26adab1b0 2024-08-31T06:12:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f88a22b7740 10 client.0 _ll_register_callbacks cb 0x55b26b095e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f8899ade640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 0x55b26b184aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f889a2df640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26add4070 0x55b26b190e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f8899ade640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 0x55b26b184aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56496/0 (socket says 172.21.15.53:56496) 2024-08-31T06:12:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f8899ade640 1 -- 172.21.15.53:0/3111853928 learned_addr learned my addr 172.21.15.53:0/3111853928 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f88992dd640 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26adb3390 0x55b26b184fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f889a2df640 1 -- 172.21.15.53:0/3111853928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 msgr2=0x55b26b184aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f889a2df640 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 0x55b26b184aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f889a2df640 1 -- 172.21.15.53:0/3111853928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26adb3390 msgr2=0x55b26b184fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f889a2df640 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26adb3390 0x55b26b184fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f889a2df640 1 -- 172.21.15.53:0/3111853928 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b26b09f900 con 0x55b26add4070 2024-08-31T06:12:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.617+0000 7f8899ade640 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 0x55b26b184aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.618+0000 7f889a2df640 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26add4070 0x55b26b190e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8888005d00 tx=0x7f8888013a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35be1e7152899bbc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.618+0000 7f887d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:12:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.618+0000 7f887d7fa640 1 -- 172.21.15.53:0/3111853928 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888033060 con 0x55b26add4070 2024-08-31T06:12:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.618+0000 7f887d7fa640 1 -- 172.21.15.53:0/3111853928 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f888800e780 con 0x55b26add4070 2024-08-31T06:12:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.618+0000 7f88a22b7740 1 -- 172.21.15.53:0/3111853928 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f888800e3d0 con 0x55b26add4070 2024-08-31T06:12:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.618+0000 7f887d7fa640 1 -- 172.21.15.53:0/3111853928 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8888022050 con 0x55b26add4070 2024-08-31T06:12:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.618+0000 7f88a22b7740 10 client.27422 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.618+0000 7f88a22b7740 1 -- 172.21.15.53:0/3111853928 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b26b197cf0 con 0x55b26add4070 2024-08-31T06:12:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.618+0000 7f887d7fa640 1 -- 172.21.15.53:0/3111853928 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f888800e3d0 con 0x55b26add4070 2024-08-31T06:12:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.619+0000 7f887d7fa640 1 -- 172.21.15.53:0/3111853928 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f888802d070 con 0x55b26add4070 2024-08-31T06:12:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.619+0000 7f88a22b7740 10 client.27422 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.619+0000 7f88a22b7740 10 client.27422 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:12:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.619+0000 7f88a22b7740 20 client.27422 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.619+0000 7f88a22b7740 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b26ad929f0 0x55b26b19b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.619+0000 7f88a22b7740 4 client.27422 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:12:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.619+0000 7f88a22b7740 1 -- 172.21.15.53:0/3111853928 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b26b0f25d0 con 0x55b26ad929f0 2024-08-31T06:12:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.619+0000 7f8899ade640 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b26ad929f0 0x55b26b19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.619+0000 7f887d7fa640 10 client.27422 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:12:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.619+0000 7f8899ade640 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b26ad929f0 0x55b26b19b050 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=de54693af6431099 server_cookie=cd4f809207c9434a in_seq=0 out_seq=0 2024-08-31T06:12:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.620+0000 7f887d7fa640 1 -- 172.21.15.53:0/3111853928 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b26b0f25d0 con 0x55b26ad929f0 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.620+0000 7f887d7fa640 10 client.27422 handle_command_reply: tid=0 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.620+0000 7f88a22b7740 1 client.27422 shutdown 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.620+0000 7f88a22b7740 1 -- 172.21.15.53:0/3111853928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26add4070 msgr2=0x55b26b190e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.620+0000 7f88a22b7740 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26add4070 0x55b26b190e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8888005d00 tx=0x7f8888013a90 comp rx=0 tx=0).stop 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.620+0000 7f88a22b7740 1 -- 172.21.15.53:0/3111853928 shutdown_connections 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.620+0000 7f88a22b7740 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b26ad929f0 0x55b26b19b050 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.620+0000 7f88a22b7740 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26add4070 0x55b26b190e40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.620+0000 7f88a22b7740 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26adb3390 0x55b26b184fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.620+0000 7f887d7fa640 0 client.27422 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.620+0000 7f88a22b7740 1 --2- 172.21.15.53:0/3111853928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adab1b0 0x55b26b184aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.621+0000 7f88a22b7740 1 -- 172.21.15.53:0/3111853928 >> 172.21.15.53:0/3111853928 conn(0x55b26adc8460 msgr2=0x55b26b17c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.621+0000 7f88a22b7740 1 -- 172.21.15.53:0/3111853928 shutdown_connections 2024-08-31T06:12:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.621+0000 7f88a22b7740 1 -- 172.21.15.53:0/3111853928 wait complete. 2024-08-31T06:12:59.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.621+0000 7f88a22b7740 20 client.27422 trim_cache size 0 max 16384 2024-08-31T06:12:59.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.635+0000 7f88a22b7740 1 Processor -- start 2024-08-31T06:12:59.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.635+0000 7f88a22b7740 1 -- start start 2024-08-31T06:12:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 0x55b26b186980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adb3390 0x55b26b17aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b190d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f88a22b7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f887800e880 con 0x55b26add4070 2024-08-31T06:12:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f88a22b7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f88780103c0 con 0x55b26adab1b0 2024-08-31T06:12:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f88a22b7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f887800ef50 con 0x55b26adb3390 2024-08-31T06:12:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f889a2df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b190d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f8899ade640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 0x55b26b186980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f889a2df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b190d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42420/0 (socket says 172.21.15.53:42420) 2024-08-31T06:12:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f889a2df640 1 -- 172.21.15.53:0/1338964143 learned_addr learned my addr 172.21.15.53:0/1338964143 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f88992dd640 1 --2- 172.21.15.53:0/1338964143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adb3390 0x55b26b17aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f8899ade640 1 -- 172.21.15.53:0/1338964143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adb3390 msgr2=0x55b26b17aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f8899ade640 1 --2- 172.21.15.53:0/1338964143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adb3390 0x55b26b17aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f8899ade640 1 -- 172.21.15.53:0/1338964143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 msgr2=0x55b26b190d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f8899ade640 1 --2- 172.21.15.53:0/1338964143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b190d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f8899ade640 1 -- 172.21.15.53:0/1338964143 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b26b17b600 con 0x55b26adab1b0 2024-08-31T06:12:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f889a2df640 1 --2- 172.21.15.53:0/1338964143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b190d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.636+0000 7f8899ade640 1 --2- 172.21.15.53:0/1338964143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 0x55b26b186980 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f888c00eb90 tx=0x7f888c018f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc118f8959b70c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.637+0000 7f887f7fe640 1 -- 172.21.15.53:0/1338964143 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c0abb00 con 0x55b26adab1b0 2024-08-31T06:12:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.637+0000 7f887f7fe640 1 -- 172.21.15.53:0/1338964143 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f888c078040 con 0x55b26adab1b0 2024-08-31T06:12:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.637+0000 7f887f7fe640 1 -- 172.21.15.53:0/1338964143 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c0b4dd0 con 0x55b26adab1b0 2024-08-31T06:12:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.638+0000 7f88a22b7740 1 -- 172.21.15.53:0/1338964143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 msgr2=0x55b26b186980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.638+0000 7f88a22b7740 1 --2- 172.21.15.53:0/1338964143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 0x55b26b186980 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f888c00eb90 tx=0x7f888c018f90 comp rx=0 tx=0).stop 2024-08-31T06:12:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.638+0000 7f88a22b7740 1 -- 172.21.15.53:0/1338964143 shutdown_connections 2024-08-31T06:12:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.638+0000 7f88a22b7740 1 --2- 172.21.15.53:0/1338964143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b190d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.638+0000 7f88a22b7740 1 --2- 172.21.15.53:0/1338964143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adb3390 0x55b26b17aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.638+0000 7f88a22b7740 1 --2- 172.21.15.53:0/1338964143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 0x55b26b186980 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.638+0000 7f88a22b7740 1 -- 172.21.15.53:0/1338964143 >> 172.21.15.53:0/1338964143 conn(0x55b26adc8460 msgr2=0x55b26b17a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.638+0000 7f88a22b7740 1 -- 172.21.15.53:0/1338964143 shutdown_connections 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.638+0000 7f88a22b7740 1 -- 172.21.15.53:0/1338964143 wait complete. 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.638+0000 7f88a22b7740 1 -- start start 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.638+0000 7f88a22b7740 1 Processor -- start 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 0x55b26b18af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adb3390 0x55b26b18b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f88a22b7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b18b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f88a22b7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f887800fcf0 con 0x55b26add4070 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f88a22b7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f887800f620 con 0x55b26adab1b0 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f88a22b7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f887800c880 con 0x55b26adb3390 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f88a22b7740 10 client.0 _ll_register_callbacks cb 0x7f8888020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f889a2df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b18b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f8899ade640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 0x55b26b18af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f889a2df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b18b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42426/0 (socket says 172.21.15.53:42426) 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f8899ade640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 0x55b26b18af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:58354/0 (socket says 172.21.15.53:58354) 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f889a2df640 1 -- 172.21.15.53:0/2984732317 learned_addr learned my addr 172.21.15.53:0/2984732317 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f88992dd640 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adb3390 0x55b26b18b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f889a2df640 1 -- 172.21.15.53:0/2984732317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adb3390 msgr2=0x55b26b18b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f889a2df640 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adb3390 0x55b26b18b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f889a2df640 1 -- 172.21.15.53:0/2984732317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 msgr2=0x55b26b18af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f889a2df640 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 0x55b26b18af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f889a2df640 1 -- 172.21.15.53:0/2984732317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b26b204ae0 con 0x55b26add4070 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f8899ade640 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 0x55b26b18af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.639+0000 7f88992dd640 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adb3390 0x55b26b18b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.640+0000 7f889a2df640 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b18b9a0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f888800e9e0 tx=0x7f888801d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8a54acb553cd8b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:12:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.640+0000 7f887d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.640+0000 7f887d7fa640 1 -- 172.21.15.53:0/2984732317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888033040 con 0x55b26add4070 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.640+0000 7f887d7fa640 1 -- 172.21.15.53:0/2984732317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f888800e3d0 con 0x55b26add4070 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.640+0000 7f88a22b7740 1 -- 172.21.15.53:0/2984732317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f888c078040 con 0x55b26add4070 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.640+0000 7f887d7fa640 1 -- 172.21.15.53:0/2984732317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8888048050 con 0x55b26add4070 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.640+0000 7f88a22b7740 10 client.18156 fetch_fsmap learned FSMap version 36 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.640+0000 7f88a22b7740 1 -- 172.21.15.53:0/2984732317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b26b205d60 con 0x55b26add4070 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.640+0000 7f887d7fa640 1 -- 172.21.15.53:0/2984732317 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f888c078040 con 0x55b26add4070 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.641+0000 7f887d7fa640 1 -- 172.21.15.53:0/2984732317 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f888803f070 con 0x55b26add4070 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.641+0000 7f88a22b7740 10 client.18156 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.641+0000 7f88a22b7740 10 client.18156 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.641+0000 7f88a22b7740 20 client.18156 populate_metadata read hostname 'smithi053' 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.641+0000 7f88a22b7740 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b26ad67da0 0x55b26b208430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.641+0000 7f88a22b7740 4 client.18156 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:12:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.641+0000 7f88a22b7740 1 -- 172.21.15.53:0/2984732317 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b26b0ee070 con 0x55b26ad67da0 2024-08-31T06:12:59.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.641+0000 7f8899ade640 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b26ad67da0 0x55b26b208430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:12:59.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.641+0000 7f887d7fa640 10 client.18156 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:12:59.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f8899ade640 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b26ad67da0 0x55b26b208430 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92d4316d06a3311 server_cookie=59dcb157688c6c91 in_seq=0 out_seq=0 2024-08-31T06:12:59.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f887d7fa640 1 -- 172.21.15.53:0/2984732317 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b26b0ee070 con 0x55b26ad67da0 2024-08-31T06:12:59.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f887d7fa640 10 client.18156 handle_command_reply: tid=0 2024-08-31T06:12:59.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f88a22b7740 1 client.18156 shutdown 2024-08-31T06:12:59.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f88a22b7740 1 -- 172.21.15.53:0/2984732317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 msgr2=0x55b26b18b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:59.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f88a22b7740 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b18b9a0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f888800e9e0 tx=0x7f888801d8c0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f88a22b7740 1 -- 172.21.15.53:0/2984732317 shutdown_connections 2024-08-31T06:12:59.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f88a22b7740 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b26ad67da0 0x55b26b208430 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f88a22b7740 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b26add4070 0x55b26b18b9a0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f887d7fa640 0 client.18156 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:12:59.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f88a22b7740 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b26adb3390 0x55b26b18b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f88a22b7740 1 --2- 172.21.15.53:0/2984732317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b26adab1b0 0x55b26b18af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.642+0000 7f88a22b7740 1 -- 172.21.15.53:0/2984732317 >> 172.21.15.53:0/2984732317 conn(0x55b26adc8460 msgr2=0x55b26b186670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:59.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.643+0000 7f88a22b7740 1 -- 172.21.15.53:0/2984732317 shutdown_connections 2024-08-31T06:12:59.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.643+0000 7f88a22b7740 1 -- 172.21.15.53:0/2984732317 wait complete. 2024-08-31T06:12:59.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.643+0000 7f88a22b7740 20 client.18156 trim_cache size 0 max 16384 2024-08-31T06:12:59.649 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:12:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.643+0000 7f889bd42640 1 -- 172.21.15.53:0/1917160107 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88800b4d50 msgr2=0x7f88800b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.643+0000 7f889bd42640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88800b4d50 0x7f88800b7260 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f888801f000 tx=0x7f888801b000 comp rx=0 tx=0).stop 2024-08-31T06:12:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.643+0000 7f889bd42640 1 -- 172.21.15.53:0/1917160107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8894102800 msgr2=0x7f889419b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:12:59.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.643+0000 7f889bd42640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8894102800 0x7f889419b0b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f888c00ebc0 tx=0x7f888c00c6a0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.644+0000 7f889bd42640 1 -- 172.21.15.53:0/1917160107 shutdown_connections 2024-08-31T06:12:59.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.644+0000 7f889bd42640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f88800b4d50 0x7f88800b7260 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.644+0000 7f889bd42640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8894108a90 0x7f889419bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.644+0000 7f889bd42640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8894108140 0x7f889419b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.644+0000 7f889bd42640 1 --2- 172.21.15.53:0/1917160107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8894102800 0x7f889419b0b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:12:59.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.644+0000 7f889bd42640 1 -- 172.21.15.53:0/1917160107 >> 172.21.15.53:0/1917160107 conn(0x7f88940794d0 msgr2=0x7f88941043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:12:59.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.644+0000 7f889bd42640 1 -- 172.21.15.53:0/1917160107 shutdown_connections 2024-08-31T06:12:59.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:12:59.644+0000 7f889bd42640 1 -- 172.21.15.53:0/1917160107 wait complete. 2024-08-31T06:12:59.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:12:59 smithi130 ceph-mon[22266]: pgmap v568: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-08-31T06:12:59.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:12:59 smithi153 ceph-mon[22320]: pgmap v568: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-08-31T06:12:59.964 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:12:59 smithi053 ceph-mon[18924]: pgmap v568: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-08-31T06:12:59.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 138868 1.61 MB/sec execute 289 sec latency 22.010 ms 2024-08-31T06:13:00.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:13:00.653 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:00.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 138957 1.61 MB/sec execute 290 sec latency 721.493 ms 2024-08-31T06:13:01.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.152+0000 7fa38f5fe640 1 -- 172.21.15.53:0/3757517991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3881081c0 msgr2=0x7fa3881085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:01.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.152+0000 7fa38f5fe640 1 --2- 172.21.15.53:0/3757517991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3881081c0 0x7fa3881085d0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fa378009900 tx=0x7fa37802a410 comp rx=0 tx=0).stop 2024-08-31T06:13:01.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.152+0000 7fa38f5fe640 1 -- 172.21.15.53:0/3757517991 shutdown_connections 2024-08-31T06:13:01.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.152+0000 7fa38f5fe640 1 --2- 172.21.15.53:0/3757517991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa388108b10 0x7fa38810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.152+0000 7fa38f5fe640 1 --2- 172.21.15.53:0/3757517991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3881081c0 0x7fa3881085d0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.152+0000 7fa38f5fe640 1 --2- 172.21.15.53:0/3757517991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa388102880 0x7fa388102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.152+0000 7fa38f5fe640 1 -- 172.21.15.53:0/3757517991 >> 172.21.15.53:0/3757517991 conn(0x7fa388079510 msgr2=0x7fa388079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.153+0000 7fa38f5fe640 1 -- 172.21.15.53:0/3757517991 shutdown_connections 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.153+0000 7fa38f5fe640 1 -- 172.21.15.53:0/3757517991 wait complete. 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.153+0000 7fa38f5fe640 1 Processor -- start 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.153+0000 7fa38f5fe640 1 -- start start 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38f5fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa388102880 0x7fa388199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38f5fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3881081c0 0x7fa388199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38f5fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa388108b10 0x7fa38819e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38f5fe640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa388112650 con 0x7fa388108b10 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38f5fe640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa3881124d0 con 0x7fa3881081c0 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38f5fe640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3881127d0 con 0x7fa388102880 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38db9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa388108b10 0x7fa38819e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38db9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa388108b10 0x7fa38819e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42432/0 (socket says 172.21.15.53:42432) 2024-08-31T06:13:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38db9b640 1 -- 172.21.15.53:0/2477130577 learned_addr learned my addr 172.21.15.53:0/2477130577 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38cb99640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3881081c0 0x7fa388199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38d39a640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa388102880 0x7fa388199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38db9b640 1 -- 172.21.15.53:0/2477130577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa388102880 msgr2=0x7fa388199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38db9b640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa388102880 0x7fa388199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38db9b640 1 -- 172.21.15.53:0/2477130577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3881081c0 msgr2=0x7fa388199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38db9b640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3881081c0 0x7fa388199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.154+0000 7fa38db9b640 1 -- 172.21.15.53:0/2477130577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38819f0f0 con 0x7fa388108b10 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.155+0000 7fa38db9b640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa388108b10 0x7fa38819e9c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fa38000cad0 tx=0x7fa38000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.155+0000 7fa37e7fc640 1 -- 172.21.15.53:0/2477130577 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38000ae20 con 0x7fa388108b10 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.155+0000 7fa37e7fc640 1 -- 172.21.15.53:0/2477130577 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa380005020 con 0x7fa388108b10 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.155+0000 7fa38f5fe640 1 -- 172.21.15.53:0/2477130577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38819f3e0 con 0x7fa388108b10 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.155+0000 7fa37e7fc640 1 -- 172.21.15.53:0/2477130577 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38000f6b0 con 0x7fa388108b10 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.155+0000 7fa38f5fe640 1 -- 172.21.15.53:0/2477130577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3881a5b40 con 0x7fa388108b10 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.157+0000 7fa395b73740 1 Processor -- start 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.157+0000 7fa37e7fc640 1 -- 172.21.15.53:0/2477130577 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa3800051d0 con 0x7fa388108b10 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa395b73740 1 -- start start 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa395b73740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b7a17070 0x5637b7dbc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa395b73740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dbc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa395b73740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79f6390 0x5637b7dbcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa395b73740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5637b7d33680 con 0x5637b79ee1b0 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa395b73740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5637b7d22c10 con 0x5637b79f6390 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa395b73740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5637b7d26bc0 con 0x5637b7a17070 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38d39a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dbc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38d39a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dbc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42440/0 (socket says 172.21.15.53:42440) 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38d39a640 1 -- 172.21.15.53:0/2270596509 learned_addr learned my addr 172.21.15.53:0/2270596509 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38cb99640 1 --2- 172.21.15.53:0/2270596509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79f6390 0x5637b7dbcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa37e7fc640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3740b4d20 0x7fa3740b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38cb99640 1 --2- 172.21.15.53:0/2270596509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b7a17070 0x5637b7dbc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38d39a640 1 -- 172.21.15.53:0/2270596509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b7a17070 msgr2=0x5637b7dbc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38d39a640 1 --2- 172.21.15.53:0/2270596509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b7a17070 0x5637b7dbc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38d39a640 1 -- 172.21.15.53:0/2270596509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79f6390 msgr2=0x5637b7dbcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38d39a640 1 --2- 172.21.15.53:0/2270596509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79f6390 0x5637b7dbcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38d39a640 1 -- 172.21.15.53:0/2270596509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b7a82650 con 0x5637b79ee1b0 2024-08-31T06:13:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38cb99640 1 --2- 172.21.15.53:0/2270596509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b7a17070 0x5637b7dbc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:13:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.158+0000 7fa38db9b640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3740b4d20 0x7fa3740b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.159+0000 7fa37e7fc640 1 -- 172.21.15.53:0/2477130577 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fa3800e57f0 con 0x7fa388108b10 2024-08-31T06:13:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.159+0000 7fa38d39a640 1 --2- 172.21.15.53:0/2270596509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dbc850 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa38400cbf0 tx=0x7fa38400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0774ff2f069ebfa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.159+0000 7fa3737fe640 1 -- 172.21.15.53:0/2270596509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384010630 con 0x5637b79ee1b0 2024-08-31T06:13:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.159+0000 7fa3737fe640 1 -- 172.21.15.53:0/2270596509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa384010c60 con 0x5637b79ee1b0 2024-08-31T06:13:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.159+0000 7fa3737fe640 1 -- 172.21.15.53:0/2270596509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38400fad0 con 0x5637b79ee1b0 2024-08-31T06:13:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa395b73740 1 -- 172.21.15.53:0/2270596509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 msgr2=0x5637b7dbc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa395b73740 1 --2- 172.21.15.53:0/2270596509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dbc850 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa38400cbf0 tx=0x7fa38400e720 comp rx=0 tx=0).stop 2024-08-31T06:13:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa38db9b640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3740b4d20 0x7fa3740b7230 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa3800e3520 tx=0x7fa380093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa395b73740 1 -- 172.21.15.53:0/2270596509 shutdown_connections 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa395b73740 1 --2- 172.21.15.53:0/2270596509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79f6390 0x5637b7dbcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa395b73740 1 --2- 172.21.15.53:0/2270596509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dbc850 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa395b73740 1 --2- 172.21.15.53:0/2270596509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b7a17070 0x5637b7dbc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa395b73740 1 -- 172.21.15.53:0/2270596509 >> 172.21.15.53:0/2270596509 conn(0x5637b7a0b460 msgr2=0x5637b7dba200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa395b73740 1 -- 172.21.15.53:0/2270596509 shutdown_connections 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa395b73740 1 -- 172.21.15.53:0/2270596509 wait complete. 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa395b73740 1 -- start start 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.160+0000 7fa395b73740 1 Processor -- start 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa395b73740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dc9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa395b73740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79f6390 0x5637b7dca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa395b73740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b7a17070 0x5637b7dd5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa395b73740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5637b7b85700 con 0x5637b79ee1b0 2024-08-31T06:13:01.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa395b73740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5637b7ca9750 con 0x5637b79f6390 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa395b73740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5637b7dccc50 con 0x5637b7a17070 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa395b73740 10 client.0 _ll_register_callbacks cb 0x5637b7cd8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa38cb99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dc9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa38cb99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dc9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42448/0 (socket says 172.21.15.53:42448) 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa38cb99640 1 -- 172.21.15.53:0/2629015486 learned_addr learned my addr 172.21.15.53:0/2629015486 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa38d39a640 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79f6390 0x5637b7dca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa38cb99640 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b7a17070 0x5637b7dd5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa38cb99640 1 -- 172.21.15.53:0/2629015486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b7a17070 msgr2=0x5637b7dd5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa38cb99640 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b7a17070 0x5637b7dd5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa38cb99640 1 -- 172.21.15.53:0/2629015486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79f6390 msgr2=0x5637b7dca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa38cb99640 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79f6390 0x5637b7dca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa38cb99640 1 -- 172.21.15.53:0/2629015486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b7ce2900 con 0x5637b79ee1b0 2024-08-31T06:13:01.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.161+0000 7fa38d39a640 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79f6390 0x5637b7dca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:01.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa38cb99640 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dc9bf0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa378000c00 tx=0x7fa378009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b677b8a4821a5568 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:01.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa370ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:01.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa370ff9640 1 -- 172.21.15.53:0/2629015486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378046040 con 0x5637b79ee1b0 2024-08-31T06:13:01.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa395b73740 1 -- 172.21.15.53:0/2629015486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa384010c60 con 0x5637b79ee1b0 2024-08-31T06:13:01.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa370ff9640 1 -- 172.21.15.53:0/2629015486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fa378004450 con 0x5637b79ee1b0 2024-08-31T06:13:01.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa370ff9640 1 -- 172.21.15.53:0/2629015486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa378052050 con 0x5637b79ee1b0 2024-08-31T06:13:01.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa395b73740 10 client.18168 fetch_fsmap learned FSMap version 36 2024-08-31T06:13:01.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa395b73740 1 -- 172.21.15.53:0/2629015486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5637b7dd8920 con 0x5637b79ee1b0 2024-08-31T06:13:01.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa370ff9640 1 -- 172.21.15.53:0/2629015486 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa384010c60 con 0x5637b79ee1b0 2024-08-31T06:13:01.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa370ff9640 1 -- 172.21.15.53:0/2629015486 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fa37803d560 con 0x5637b79ee1b0 2024-08-31T06:13:01.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa395b73740 10 client.18168 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:13:01.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa395b73740 10 client.18168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:01.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa395b73740 20 client.18168 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:01.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.162+0000 7fa395b73740 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5637b79d59f0 0x5637b7ddbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.163+0000 7fa395b73740 4 client.18168 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:01.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.163+0000 7fa395b73740 1 -- 172.21.15.53:0/2629015486 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637b7d355d0 con 0x5637b79d59f0 2024-08-31T06:13:01.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.163+0000 7fa38d39a640 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5637b79d59f0 0x5637b7ddbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.163+0000 7fa370ff9640 10 client.18168 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:01.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.163+0000 7fa38d39a640 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5637b79d59f0 0x5637b7ddbda0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42c0fee20e389e66 server_cookie=42ff6b6391ca4095 in_seq=0 out_seq=0 2024-08-31T06:13:01.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa370ff9640 1 -- 172.21.15.53:0/2629015486 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637b7d355d0 con 0x5637b79d59f0 2024-08-31T06:13:01.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa370ff9640 10 client.18168 handle_command_reply: tid=0 2024-08-31T06:13:01.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa395b73740 1 client.18168 shutdown 2024-08-31T06:13:01.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa395b73740 1 -- 172.21.15.53:0/2629015486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 msgr2=0x5637b7dc9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:01.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa395b73740 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dc9bf0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa378000c00 tx=0x7fa378009260 comp rx=0 tx=0).stop 2024-08-31T06:13:01.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa395b73740 1 -- 172.21.15.53:0/2629015486 shutdown_connections 2024-08-31T06:13:01.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa395b73740 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5637b79d59f0 0x5637b7ddbda0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa395b73740 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b7a17070 0x5637b7dd5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa395b73740 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79f6390 0x5637b7dca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa370ff9640 0 client.18168 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:01.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa395b73740 1 --2- 172.21.15.53:0/2629015486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dc9bf0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.164+0000 7fa395b73740 1 -- 172.21.15.53:0/2629015486 >> 172.21.15.53:0/2629015486 conn(0x5637b7a0b460 msgr2=0x5637b7dbdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:01.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.165+0000 7fa395b73740 1 -- 172.21.15.53:0/2629015486 shutdown_connections 2024-08-31T06:13:01.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.165+0000 7fa395b73740 1 -- 172.21.15.53:0/2629015486 wait complete. 2024-08-31T06:13:01.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.165+0000 7fa395b73740 20 client.18168 trim_cache size 0 max 16384 2024-08-31T06:13:01.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.178+0000 7fa395b73740 1 Processor -- start 2024-08-31T06:13:01.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.178+0000 7fa395b73740 1 -- start start 2024-08-31T06:13:01.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.178+0000 7fa395b73740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79d59f0 0x5637b7dba270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.178+0000 7fa395b73740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dd5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.178+0000 7fa395b73740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b79f6390 0x5637b7dc6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.178+0000 7fa395b73740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa3881ad3c0 con 0x5637b79ee1b0 2024-08-31T06:13:01.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.178+0000 7fa395b73740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa3881aef00 con 0x5637b79d59f0 2024-08-31T06:13:01.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.178+0000 7fa395b73740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3881ada90 con 0x5637b79f6390 2024-08-31T06:13:01.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa38d39a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dd5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa38d39a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dd5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42450/0 (socket says 172.21.15.53:42450) 2024-08-31T06:13:01.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa38d39a640 1 -- 172.21.15.53:0/3814548060 learned_addr learned my addr 172.21.15.53:0/3814548060 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:01.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa38cb99640 1 --2- 172.21.15.53:0/3814548060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b79f6390 0x5637b7dc6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa38cb99640 1 --2- 172.21.15.53:0/3814548060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79d59f0 0x5637b7dba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa38d39a640 1 -- 172.21.15.53:0/3814548060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b79f6390 msgr2=0x5637b7dc6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:01.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa38d39a640 1 --2- 172.21.15.53:0/3814548060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b79f6390 0x5637b7dc6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa38d39a640 1 -- 172.21.15.53:0/3814548060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79d59f0 msgr2=0x5637b7dba270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:01.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa38d39a640 1 --2- 172.21.15.53:0/3814548060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79d59f0 0x5637b7dba270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa38d39a640 1 -- 172.21.15.53:0/3814548060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b7dcaa60 con 0x5637b79ee1b0 2024-08-31T06:13:01.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa38d39a640 1 --2- 172.21.15.53:0/3814548060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dd5eb0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa384000c00 tx=0x7fa384010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cb15038c76a0a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:01.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa372ffd640 1 -- 172.21.15.53:0/3814548060 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384028040 con 0x5637b79ee1b0 2024-08-31T06:13:01.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa372ffd640 1 -- 172.21.15.53:0/3814548060 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa384004660 con 0x5637b79ee1b0 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.179+0000 7fa372ffd640 1 -- 172.21.15.53:0/3814548060 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384010690 con 0x5637b79ee1b0 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.180+0000 7fa395b73740 1 -- 172.21.15.53:0/3814548060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 msgr2=0x5637b7dd5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.180+0000 7fa395b73740 1 --2- 172.21.15.53:0/3814548060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dd5eb0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa384000c00 tx=0x7fa384010f30 comp rx=0 tx=0).stop 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.180+0000 7fa395b73740 1 -- 172.21.15.53:0/3814548060 shutdown_connections 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.180+0000 7fa395b73740 1 --2- 172.21.15.53:0/3814548060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b79f6390 0x5637b7dc6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.180+0000 7fa395b73740 1 --2- 172.21.15.53:0/3814548060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dd5eb0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.180+0000 7fa395b73740 1 --2- 172.21.15.53:0/3814548060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79d59f0 0x5637b7dba270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.180+0000 7fa395b73740 1 -- 172.21.15.53:0/3814548060 >> 172.21.15.53:0/3814548060 conn(0x5637b7a0b460 msgr2=0x5637b7db9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.180+0000 7fa395b73740 1 -- 172.21.15.53:0/3814548060 shutdown_connections 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.180+0000 7fa395b73740 1 -- 172.21.15.53:0/3814548060 wait complete. 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.180+0000 7fa395b73740 1 -- start start 2024-08-31T06:13:01.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa395b73740 1 Processor -- start 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa395b73740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79d59f0 0x5637b7dce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa395b73740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa395b73740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b79f6390 0x5637b7e45760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa395b73740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa3881ae830 con 0x5637b79ee1b0 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa395b73740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa3881ae160 con 0x5637b79d59f0 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa395b73740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3881ab3c0 con 0x5637b79f6390 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa395b73740 10 client.0 _ll_register_callbacks cb 0x7fa378009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa38d39a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa38d39a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42456/0 (socket says 172.21.15.53:42456) 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa38d39a640 1 -- 172.21.15.53:0/1273630457 learned_addr learned my addr 172.21.15.53:0/1273630457 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa38cb99640 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79d59f0 0x5637b7dce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa38cb99640 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b79f6390 0x5637b7e45760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.181+0000 7fa38d39a640 1 -- 172.21.15.53:0/1273630457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b79f6390 msgr2=0x5637b7e45760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa38d39a640 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b79f6390 0x5637b7e45760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa38d39a640 1 -- 172.21.15.53:0/1273630457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79d59f0 msgr2=0x5637b7dce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa38d39a640 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79d59f0 0x5637b7dce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa38d39a640 1 -- 172.21.15.53:0/1273630457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b7e45ca0 con 0x5637b79ee1b0 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa38d39a640 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dce900 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa38400e760 tx=0x7fa384004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ee5f8afbce1521 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa370ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa370ff9640 1 -- 172.21.15.53:0/1273630457 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384028040 con 0x5637b79ee1b0 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa370ff9640 1 -- 172.21.15.53:0/1273630457 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7fa384004980 con 0x5637b79ee1b0 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa395b73740 1 -- 172.21.15.53:0/1273630457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa384004660 con 0x5637b79ee1b0 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa370ff9640 1 -- 172.21.15.53:0/1273630457 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa384004ba0 con 0x5637b79ee1b0 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa395b73740 10 client.18174 fetch_fsmap learned FSMap version 36 2024-08-31T06:13:01.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa395b73740 1 -- 172.21.15.53:0/1273630457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5637b7e46e30 con 0x5637b79ee1b0 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa370ff9640 1 -- 172.21.15.53:0/1273630457 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa384004660 con 0x5637b79ee1b0 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.182+0000 7fa370ff9640 1 -- 172.21.15.53:0/1273630457 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fa384010730 con 0x5637b79ee1b0 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.183+0000 7fa395b73740 10 client.18174 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.183+0000 7fa395b73740 10 client.18174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.183+0000 7fa395b73740 20 client.18174 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.183+0000 7fa395b73740 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5637b7a17070 0x5637b7e49370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.183+0000 7fa395b73740 4 client.18174 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.183+0000 7fa395b73740 1 -- 172.21.15.53:0/1273630457 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5637b7d31070 con 0x5637b7a17070 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.183+0000 7fa38cb99640 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5637b7a17070 0x5637b7e49370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.183+0000 7fa38cb99640 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5637b7a17070 0x5637b7e49370 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cf61f6b713acf96 server_cookie=6ed86f36cb7b04d8 in_seq=0 out_seq=0 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.183+0000 7fa370ff9640 10 client.18174 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa370ff9640 1 -- 172.21.15.53:0/1273630457 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5637b7d31070 con 0x5637b7a17070 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa370ff9640 10 client.18174 handle_command_reply: tid=0 2024-08-31T06:13:01.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 1 client.18174 shutdown 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 1 -- 172.21.15.53:0/1273630457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 msgr2=0x5637b7dce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dce900 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa38400e760 tx=0x7fa384004810 comp rx=0 tx=0).stop 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 1 -- 172.21.15.53:0/1273630457 shutdown_connections 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5637b7a17070 0x5637b7e49370 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637b79f6390 0x5637b7e45760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5637b79ee1b0 0x5637b7dce900 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 1 --2- 172.21.15.53:0/1273630457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5637b79d59f0 0x5637b7dce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 1 -- 172.21.15.53:0/1273630457 >> 172.21.15.53:0/1273630457 conn(0x5637b7a0b460 msgr2=0x5637b7dbdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa370ff9640 0 client.18174 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 1 -- 172.21.15.53:0/1273630457 shutdown_connections 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 1 -- 172.21.15.53:0/1273630457 wait complete. 2024-08-31T06:13:01.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.184+0000 7fa395b73740 20 client.18174 trim_cache size 0 max 16384 2024-08-31T06:13:01.196 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:13:01.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 -- 172.21.15.53:0/2477130577 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3740b4d20 msgr2=0x7fa3740b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:01.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3740b4d20 0x7fa3740b7230 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa3800e3520 tx=0x7fa380093040 comp rx=0 tx=0).stop 2024-08-31T06:13:01.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 -- 172.21.15.53:0/2477130577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa388108b10 msgr2=0x7fa38819e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:01.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa388108b10 0x7fa38819e9c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fa38000cad0 tx=0x7fa38000cf90 comp rx=0 tx=0).stop 2024-08-31T06:13:01.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 -- 172.21.15.53:0/2477130577 shutdown_connections 2024-08-31T06:13:01.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3740b4d20 0x7fa3740b7230 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa388108b10 0x7fa38819e9c0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3881081c0 0x7fa388199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 --2- 172.21.15.53:0/2477130577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa388102880 0x7fa388199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:01.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 -- 172.21.15.53:0/2477130577 >> 172.21.15.53:0/2477130577 conn(0x7fa388079510 msgr2=0x7fa388106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:01.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 -- 172.21.15.53:0/2477130577 shutdown_connections 2024-08-31T06:13:01.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:01.185+0000 7fa38f5fe640 1 -- 172.21.15.53:0/2477130577 wait complete. 2024-08-31T06:13:01.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:01 smithi130 ceph-mon[22266]: pgmap v569: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 1.7 MiB/s wr, 161 op/s 2024-08-31T06:13:01.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:01 smithi153 ceph-mon[22320]: pgmap v569: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 1.7 MiB/s wr, 161 op/s 2024-08-31T06:13:01.951 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:01 smithi053 ceph-mon[18924]: pgmap v569: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 1.7 MiB/s wr, 161 op/s 2024-08-31T06:13:01.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 138970 1.60 MB/sec execute 291 sec latency 1123.336 ms 2024-08-31T06:13:02.983 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:13:02.983 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:13:02.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 138970 1.60 MB/sec execute 292 sec latency 1529.131 ms 2024-08-31T06:13:03.245 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:03.616 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:03 smithi053 ceph-mon[18924]: pgmap v570: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 1.5 MiB/s wr, 143 op/s 2024-08-31T06:13:03.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.704+0000 7f424c12c640 1 -- 172.21.15.53:0/3220170423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4244109240 msgr2=0x7f4244109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:03.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.704+0000 7f424c12c640 1 --2- 172.21.15.53:0/3220170423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4244109240 0x7f4244109650 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f4234009900 tx=0x7f423402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.705+0000 7f424c12c640 1 -- 172.21.15.53:0/3220170423 shutdown_connections 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.705+0000 7f424c12c640 1 --2- 172.21.15.53:0/3220170423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4244109b90 0x7f42441103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.705+0000 7f424c12c640 1 --2- 172.21.15.53:0/3220170423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4244109240 0x7f4244109650 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.705+0000 7f424c12c640 1 --2- 172.21.15.53:0/3220170423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4244103900 0x7f4244103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.705+0000 7f424c12c640 1 -- 172.21.15.53:0/3220170423 >> 172.21.15.53:0/3220170423 conn(0x7f424407b5f0 msgr2=0x7f424407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.705+0000 7f424c12c640 1 -- 172.21.15.53:0/3220170423 shutdown_connections 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.705+0000 7f424c12c640 1 -- 172.21.15.53:0/3220170423 wait complete. 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.705+0000 7f424c12c640 1 Processor -- start 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.705+0000 7f424c12c640 1 -- start start 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f424c12c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4244103900 0x7f424419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f424c12c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4244109240 0x7f424419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f424c12c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4244109b90 0x7f424419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f424c12c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4244113700 con 0x7f4244109240 2024-08-31T06:13:03.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f424c12c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4244113580 con 0x7f4244109b90 2024-08-31T06:13:03.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f424c12c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4244113880 con 0x7f4244103900 2024-08-31T06:13:03.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f42496c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4244109240 0x7f424419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f42496c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4244109240 0x7f424419a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58684/0 (socket says 172.21.15.53:58684) 2024-08-31T06:13:03.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f42496c7640 1 -- 172.21.15.53:0/2037938068 learned_addr learned my addr 172.21.15.53:0/2037938068 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:03.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f4249ec8640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4244103900 0x7f424419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f424a6c9640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4244109b90 0x7f424419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f42496c7640 1 -- 172.21.15.53:0/2037938068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4244103900 msgr2=0x7f424419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:03.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f42496c7640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4244103900 0x7f424419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f42496c7640 1 -- 172.21.15.53:0/2037938068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4244109b90 msgr2=0x7f424419fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f42496c7640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4244109b90 0x7f424419fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f42496c7640 1 -- 172.21.15.53:0/2037938068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42441a0080 con 0x7f4244109240 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f424a6c9640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4244109b90 0x7f424419fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.706+0000 7f42496c7640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4244109240 0x7f424419a770 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f4234005940 tx=0x7f42340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.707+0000 7f423affd640 1 -- 172.21.15.53:0/2037938068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423403f030 con 0x7f4244109240 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.707+0000 7f423affd640 1 -- 172.21.15.53:0/2037938068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4234003c90 con 0x7f4244109240 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.707+0000 7f424c12c640 1 -- 172.21.15.53:0/2037938068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42441a0310 con 0x7f4244109240 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.707+0000 7f423affd640 1 -- 172.21.15.53:0/2037938068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234035070 con 0x7f4244109240 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.707+0000 7f424c12c640 1 -- 172.21.15.53:0/2037938068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42441a07f0 con 0x7f4244109240 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.709+0000 7f42526a1740 1 Processor -- start 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f42526a1740 1 -- start start 2024-08-31T06:13:03.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f423affd640 1 -- 172.21.15.53:0/2037938068 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4234042030 con 0x7f4244109240 2024-08-31T06:13:03.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f42526a1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c010780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f42526a1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc41490 0x55977c010cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f42526a1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc49670 0x55977c011200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f42526a1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55977bf865f0 con 0x55977bc6a350 2024-08-31T06:13:03.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f42526a1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55977bf75b80 con 0x55977bc41490 2024-08-31T06:13:03.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f42526a1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55977bf79b30 con 0x55977bc49670 2024-08-31T06:13:03.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f424a6c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c010780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f424a6c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c010780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58690/0 (socket says 172.21.15.53:58690) 2024-08-31T06:13:03.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f424a6c9640 1 -- 172.21.15.53:0/3470642982 learned_addr learned my addr 172.21.15.53:0/3470642982 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:03.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f42496c7640 1 --2- 172.21.15.53:0/3470642982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc49670 0x55977c011200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f4249ec8640 1 --2- 172.21.15.53:0/3470642982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc41490 0x55977c010cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f424a6c9640 1 -- 172.21.15.53:0/3470642982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc49670 msgr2=0x55977c011200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f424a6c9640 1 --2- 172.21.15.53:0/3470642982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc49670 0x55977c011200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f424a6c9640 1 -- 172.21.15.53:0/3470642982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc41490 msgr2=0x55977c010cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f424a6c9640 1 --2- 172.21.15.53:0/3470642982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc41490 0x55977c010cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f423affd640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f42300b4cd0 0x7f42300b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.710+0000 7f424a6c9640 1 -- 172.21.15.53:0/3470642982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55977bcd5930 con 0x55977bc6a350 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.711+0000 7f423affd640 1 -- 172.21.15.53:0/2037938068 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f4234105ae0 con 0x7f4244109240 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.711+0000 7f424a6c9640 1 --2- 172.21.15.53:0/3470642982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c010780 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f423c007f40 tx=0x7f423c00e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e2bc881a06df12 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.711+0000 7f424a6c9640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f42300b4cd0 0x7f42300b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.711+0000 7f422ffff640 1 -- 172.21.15.53:0/3470642982 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c014070 con 0x55977bc6a350 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.711+0000 7f422ffff640 1 -- 172.21.15.53:0/3470642982 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f423c010c40 con 0x55977bc6a350 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.711+0000 7f422ffff640 1 -- 172.21.15.53:0/3470642982 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c018750 con 0x55977bc6a350 2024-08-31T06:13:03.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.712+0000 7f42526a1740 1 -- 172.21.15.53:0/3470642982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 msgr2=0x55977c010780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:03.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.712+0000 7f424a6c9640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f42300b4cd0 0x7f42300b71e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f423c00f010 tx=0x7f423c018e70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:03.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.712+0000 7f42526a1740 1 --2- 172.21.15.53:0/3470642982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c010780 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f423c007f40 tx=0x7f423c00e7e0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.712+0000 7f42526a1740 1 -- 172.21.15.53:0/3470642982 shutdown_connections 2024-08-31T06:13:03.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.712+0000 7f42526a1740 1 --2- 172.21.15.53:0/3470642982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc49670 0x55977c011200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.712+0000 7f42526a1740 1 --2- 172.21.15.53:0/3470642982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc41490 0x55977c010cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.712+0000 7f42526a1740 1 --2- 172.21.15.53:0/3470642982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c010780 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.712+0000 7f42526a1740 1 -- 172.21.15.53:0/3470642982 >> 172.21.15.53:0/3470642982 conn(0x55977bc5e740 msgr2=0x55977c00e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:03.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.712+0000 7f42526a1740 1 -- 172.21.15.53:0/3470642982 shutdown_connections 2024-08-31T06:13:03.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.712+0000 7f42526a1740 1 -- 172.21.15.53:0/3470642982 wait complete. 2024-08-31T06:13:03.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.712+0000 7f42526a1740 1 -- start start 2024-08-31T06:13:03.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f42526a1740 1 Processor -- start 2024-08-31T06:13:03.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f42526a1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c020330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f42526a1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc49670 0x55977c020870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f42526a1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c02c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f42526a1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55977bdd8890 con 0x55977bc6a350 2024-08-31T06:13:03.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f42526a1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55977befc790 con 0x55977bc49670 2024-08-31T06:13:03.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f42526a1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55977c0232c0 con 0x55977bc41490 2024-08-31T06:13:03.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f42526a1740 10 client.0 _ll_register_callbacks cb 0x55977bc81ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:03.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f424a6c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c02c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f424a6c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c02c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58696/0 (socket says 172.21.15.53:58696) 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f424a6c9640 1 -- 172.21.15.53:0/2800235094 learned_addr learned my addr 172.21.15.53:0/2800235094 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f4249ec8640 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c020330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.713+0000 7f42496c7640 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc49670 0x55977c020870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f424a6c9640 1 -- 172.21.15.53:0/2800235094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 msgr2=0x55977c020330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f424a6c9640 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c020330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f424a6c9640 1 -- 172.21.15.53:0/2800235094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc49670 msgr2=0x55977c020870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f424a6c9640 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc49670 0x55977c020870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f424a6c9640 1 -- 172.21.15.53:0/2800235094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55977bf33f30 con 0x55977bc6a350 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f4249ec8640 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c020330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f424a6c9640 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c02c620 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f423c00ffa0 tx=0x7f423c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cddc1db327191a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:03.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f422d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f422d7fa640 1 -- 172.21.15.53:0/2800235094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c033060 con 0x55977bc6a350 2024-08-31T06:13:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f422d7fa640 1 -- 172.21.15.53:0/2800235094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f423c010640 con 0x55977bc6a350 2024-08-31T06:13:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f42526a1740 1 -- 172.21.15.53:0/2800235094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f423c010c40 con 0x55977bc6a350 2024-08-31T06:13:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f422d7fa640 1 -- 172.21.15.53:0/2800235094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f423c014040 con 0x55977bc6a350 2024-08-31T06:13:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f42526a1740 10 client.18186 fetch_fsmap learned FSMap version 36 2024-08-31T06:13:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f42526a1740 1 -- 172.21.15.53:0/2800235094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55977c02f100 con 0x55977bc6a350 2024-08-31T06:13:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.714+0000 7f422d7fa640 1 -- 172.21.15.53:0/2800235094 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f423c010c40 con 0x55977bc6a350 2024-08-31T06:13:03.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.715+0000 7f422d7fa640 1 -- 172.21.15.53:0/2800235094 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f423c019460 con 0x55977bc6a350 2024-08-31T06:13:03.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.715+0000 7f42526a1740 10 client.18186 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:13:03.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.715+0000 7f42526a1740 10 client.18186 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:03.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.715+0000 7f42526a1740 20 client.18186 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:03.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.715+0000 7f42526a1740 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55977bc28cd0 0x55977c032570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.715+0000 7f42526a1740 4 client.18186 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:03.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.715+0000 7f42526a1740 1 -- 172.21.15.53:0/2800235094 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55977bf88540 con 0x55977bc28cd0 2024-08-31T06:13:03.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.715+0000 7f4249ec8640 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55977bc28cd0 0x55977c032570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.715+0000 7f422d7fa640 10 client.18186 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:03.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.715+0000 7f4249ec8640 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55977bc28cd0 0x55977c032570 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d66bf3bd38f1d9b6 server_cookie=60ccc46cc3b67bc in_seq=0 out_seq=0 2024-08-31T06:13:03.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.716+0000 7f422d7fa640 1 -- 172.21.15.53:0/2800235094 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55977bf88540 con 0x55977bc28cd0 2024-08-31T06:13:03.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.716+0000 7f422d7fa640 10 client.18186 handle_command_reply: tid=0 2024-08-31T06:13:03.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.716+0000 7f42526a1740 1 client.18186 shutdown 2024-08-31T06:13:03.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.716+0000 7f42526a1740 1 -- 172.21.15.53:0/2800235094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 msgr2=0x55977c02c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:03.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.716+0000 7f42526a1740 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c02c620 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f423c00ffa0 tx=0x7f423c019000 comp rx=0 tx=0).stop 2024-08-31T06:13:03.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.717+0000 7f42526a1740 1 -- 172.21.15.53:0/2800235094 shutdown_connections 2024-08-31T06:13:03.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.717+0000 7f42526a1740 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55977bc28cd0 0x55977c032570 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.717+0000 7f42526a1740 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc6a350 0x55977c02c620 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.717+0000 7f42526a1740 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc49670 0x55977c020870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.717+0000 7f42526a1740 1 --2- 172.21.15.53:0/2800235094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c020330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.717+0000 7f422d7fa640 0 client.18186 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:03.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.717+0000 7f42526a1740 1 -- 172.21.15.53:0/2800235094 >> 172.21.15.53:0/2800235094 conn(0x55977bc5e740 msgr2=0x55977c00cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:03.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.717+0000 7f42526a1740 1 -- 172.21.15.53:0/2800235094 shutdown_connections 2024-08-31T06:13:03.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.717+0000 7f42526a1740 1 -- 172.21.15.53:0/2800235094 wait complete. 2024-08-31T06:13:03.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.717+0000 7f42526a1740 20 client.18186 trim_cache size 0 max 16384 2024-08-31T06:13:03.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.735+0000 7f42526a1740 1 Processor -- start 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.735+0000 7f42526a1740 1 -- start start 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.735+0000 7f42526a1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c020910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.735+0000 7f42526a1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c011ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.735+0000 7f42526a1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 0x55977c02c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.735+0000 7f42526a1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f42441ad2d0 con 0x55977bc49670 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.735+0000 7f42526a1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42441aee10 con 0x55977bc6a350 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.735+0000 7f42526a1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f42441ad9a0 con 0x55977bc41490 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.735+0000 7f42496c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c011ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f42496c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c011ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58698/0 (socket says 172.21.15.53:58698) 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f42496c7640 1 -- 172.21.15.53:0/2339961157 learned_addr learned my addr 172.21.15.53:0/2339961157 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f4249ec8640 1 --2- 172.21.15.53:0/2339961157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c020910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f424a6c9640 1 --2- 172.21.15.53:0/2339961157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 0x55977c02c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f42496c7640 1 -- 172.21.15.53:0/2339961157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 msgr2=0x55977c020910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f42496c7640 1 --2- 172.21.15.53:0/2339961157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c020910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f42496c7640 1 -- 172.21.15.53:0/2339961157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 msgr2=0x55977c02c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f42496c7640 1 --2- 172.21.15.53:0/2339961157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 0x55977c02c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f42496c7640 1 -- 172.21.15.53:0/2339961157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55977c012a70 con 0x55977bc49670 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f424a6c9640 1 --2- 172.21.15.53:0/2339961157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 0x55977c02c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f42496c7640 1 --2- 172.21.15.53:0/2339961157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c011ec0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f42340cbeb0 tx=0x7f423402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1a5daa5d8f1a54 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f422f7fe640 1 -- 172.21.15.53:0/2339961157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234049040 con 0x55977bc49670 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f422f7fe640 1 -- 172.21.15.53:0/2339961157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4234003e40 con 0x55977bc49670 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.736+0000 7f422f7fe640 1 -- 172.21.15.53:0/2339961157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42340cc1b0 con 0x55977bc49670 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.737+0000 7f42526a1740 1 -- 172.21.15.53:0/2339961157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 msgr2=0x55977c011ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.737+0000 7f42526a1740 1 --2- 172.21.15.53:0/2339961157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c011ec0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f42340cbeb0 tx=0x7f423402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.737+0000 7f42526a1740 1 -- 172.21.15.53:0/2339961157 shutdown_connections 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.737+0000 7f42526a1740 1 --2- 172.21.15.53:0/2339961157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 0x55977c02c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.737+0000 7f42526a1740 1 --2- 172.21.15.53:0/2339961157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c011ec0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.737+0000 7f42526a1740 1 --2- 172.21.15.53:0/2339961157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c020910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.737+0000 7f42526a1740 1 -- 172.21.15.53:0/2339961157 >> 172.21.15.53:0/2339961157 conn(0x55977bc5e740 msgr2=0x55977c0117b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.737+0000 7f42526a1740 1 -- 172.21.15.53:0/2339961157 shutdown_connections 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.737+0000 7f42526a1740 1 -- 172.21.15.53:0/2339961157 wait complete. 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42526a1740 1 -- start start 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42526a1740 1 Processor -- start 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42526a1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c0340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42526a1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c034690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42526a1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 0x55977c094d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42526a1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f42441ae740 con 0x55977bc49670 2024-08-31T06:13:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42526a1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42441ae070 con 0x55977bc6a350 2024-08-31T06:13:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42526a1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f42441ab2d0 con 0x55977bc41490 2024-08-31T06:13:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42526a1740 10 client.0 _ll_register_callbacks cb 0x7f424000a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42496c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c034690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42496c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c034690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58708/0 (socket says 172.21.15.53:58708) 2024-08-31T06:13:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f42496c7640 1 -- 172.21.15.53:0/150473649 learned_addr learned my addr 172.21.15.53:0/150473649 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.738+0000 7f4249ec8640 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c0340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f424a6c9640 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 0x55977c094d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f42496c7640 1 -- 172.21.15.53:0/150473649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 msgr2=0x55977c0340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f42496c7640 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c0340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f42496c7640 1 -- 172.21.15.53:0/150473649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 msgr2=0x55977c094d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f42496c7640 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 0x55977c094d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f42496c7640 1 -- 172.21.15.53:0/150473649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55977c095390 con 0x55977bc49670 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f424a6c9640 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 0x55977c094d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f42496c7640 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c034690 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f4234006010 tx=0x7f42340cc0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df386a0d649705dc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f422d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f422d7fa640 1 -- 172.21.15.53:0/150473649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42340cb920 con 0x55977bc49670 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f422d7fa640 1 -- 172.21.15.53:0/150473649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f42340d5040 con 0x55977bc49670 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f42526a1740 1 -- 172.21.15.53:0/150473649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55977bf83fe0 con 0x55977bc49670 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f422d7fa640 1 -- 172.21.15.53:0/150473649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f42340cbb00 con 0x55977bc49670 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f42526a1740 10 client.18192 fetch_fsmap learned FSMap version 36 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f42526a1740 1 -- 172.21.15.53:0/150473649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55977c09d8f0 con 0x55977bc49670 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.739+0000 7f422d7fa640 1 -- 172.21.15.53:0/150473649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55977bf83fe0 con 0x55977bc49670 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.740+0000 7f422d7fa640 1 -- 172.21.15.53:0/150473649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f423410d030 con 0x55977bc49670 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.740+0000 7f42526a1740 10 client.18192 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:13:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.740+0000 7f42526a1740 10 client.18192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.740+0000 7f42526a1740 20 client.18192 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.740+0000 7f42526a1740 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55977bbfe080 0x55977c09ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.740+0000 7f42526a1740 4 client.18192 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:13:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.740+0000 7f42526a1740 1 -- 172.21.15.53:0/150473649 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55977bf81720 con 0x55977bbfe080 2024-08-31T06:13:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.740+0000 7f4249ec8640 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55977bbfe080 0x55977c09ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.740+0000 7f422d7fa640 10 client.18192 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.741+0000 7f4249ec8640 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55977bbfe080 0x55977c09ff50 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a48e94a28754e1f server_cookie=256c23daa79bd658 in_seq=0 out_seq=0 2024-08-31T06:13:03.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f422d7fa640 1 -- 172.21.15.53:0/150473649 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55977bf81720 con 0x55977bbfe080 2024-08-31T06:13:03.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f422d7fa640 10 client.18192 handle_command_reply: tid=0 2024-08-31T06:13:03.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 1 client.18192 shutdown 2024-08-31T06:13:03.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 1 -- 172.21.15.53:0/150473649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 msgr2=0x55977c034690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:03.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c034690 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f4234006010 tx=0x7f42340cc0b0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 1 -- 172.21.15.53:0/150473649 shutdown_connections 2024-08-31T06:13:03.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55977bbfe080 0x55977c09ff50 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55977bc6a350 0x55977c094d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55977bc49670 0x55977c034690 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f422d7fa640 0 client.18192 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 1 --2- 172.21.15.53:0/150473649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55977bc41490 0x55977c0340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 1 -- 172.21.15.53:0/150473649 >> 172.21.15.53:0/150473649 conn(0x55977bc5e740 msgr2=0x55977c015920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 1 -- 172.21.15.53:0/150473649 shutdown_connections 2024-08-31T06:13:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 1 -- 172.21.15.53:0/150473649 wait complete. 2024-08-31T06:13:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.742+0000 7f42526a1740 20 client.18192 trim_cache size 0 max 16384 2024-08-31T06:13:03.750 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:13:03.750 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:13:03.751 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "414a1081-11c9-4d68-99ae-4d7c02bab716", 2024-08-31T06:13:03.751 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:13:03.751 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:13:03.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 -- 172.21.15.53:0/2037938068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f42300b4cd0 msgr2=0x7f42300b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:03.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f42300b4cd0 0x7f42300b71e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f423c00f010 tx=0x7f423c018e70 comp rx=0 tx=0).stop 2024-08-31T06:13:03.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 -- 172.21.15.53:0/2037938068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4244109240 msgr2=0x7f424419a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:03.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4244109240 0x7f424419a770 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f4234005940 tx=0x7f42340042f0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 -- 172.21.15.53:0/2037938068 shutdown_connections 2024-08-31T06:13:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f42300b4cd0 0x7f42300b71e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4244109b90 0x7f424419fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4244109240 0x7f424419a770 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 --2- 172.21.15.53:0/2037938068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4244103900 0x7f424419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 -- 172.21.15.53:0/2037938068 >> 172.21.15.53:0/2037938068 conn(0x7f424407b5f0 msgr2=0x7f4244105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 -- 172.21.15.53:0/2037938068 shutdown_connections 2024-08-31T06:13:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:03.743+0000 7f424c12c640 1 -- 172.21.15.53:0/2037938068 wait complete. 2024-08-31T06:13:03.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:03 smithi130 ceph-mon[22266]: pgmap v570: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 1.5 MiB/s wr, 143 op/s 2024-08-31T06:13:03.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:03 smithi153 ceph-mon[22320]: pgmap v570: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 1.5 MiB/s wr, 143 op/s 2024-08-31T06:13:03.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 139058 1.59 MB/sec execute 293 sec latency 2351.298 ms 2024-08-31T06:13:04.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:13:04.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:04.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:04.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:04.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:04.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:04.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:04.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:04.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:04 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.749 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:04.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:04.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:04 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:04.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:04.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:04.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:04.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:04.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:04.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:04.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:04 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:04.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 139543 1.59 MB/sec execute 294 sec latency 14.762 ms 2024-08-31T06:13:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.263+0000 7f0abe245640 1 -- 172.21.15.53:0/3318308618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab810bde0 msgr2=0x7f0ab8112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.263+0000 7f0abe245640 1 --2- 172.21.15.53:0/3318308618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab810bde0 0x7f0ab8112610 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009ca0 tx=0x7f0ab002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.263+0000 7f0abe245640 1 -- 172.21.15.53:0/3318308618 shutdown_connections 2024-08-31T06:13:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.263+0000 7f0abe245640 1 --2- 172.21.15.53:0/3318308618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab810bde0 0x7f0ab8112610 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.263+0000 7f0abe245640 1 --2- 172.21.15.53:0/3318308618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ab810b490 0x7f0ab810b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.263+0000 7f0abe245640 1 --2- 172.21.15.53:0/3318308618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ab8105b50 0x7f0ab8105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.263+0000 7f0abe245640 1 -- 172.21.15.53:0/3318308618 >> 172.21.15.53:0/3318308618 conn(0x7f0ab81015a0 msgr2=0x7f0ab81039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.263+0000 7f0abe245640 1 -- 172.21.15.53:0/3318308618 shutdown_connections 2024-08-31T06:13:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.263+0000 7f0abe245640 1 -- 172.21.15.53:0/3318308618 wait complete. 2024-08-31T06:13:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.264+0000 7f0abe245640 1 Processor -- start 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.264+0000 7f0abe245640 1 -- start start 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.264+0000 7f0abe245640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab8105b50 0x7f0ab819c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.264+0000 7f0abe245640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ab810b490 0x7f0ab819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.264+0000 7f0abe245640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ab810bde0 0x7f0ab81a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.264+0000 7f0abe245640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81159a0 con 0x7f0ab8105b50 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.264+0000 7f0abe245640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8115820 con 0x7f0ab810b490 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.264+0000 7f0abe245640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab8115b20 con 0x7f0ab810bde0 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.264+0000 7f0ab77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab8105b50 0x7f0ab819c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.264+0000 7f0ab77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab8105b50 0x7f0ab819c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58720/0 (socket says 172.21.15.53:58720) 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.264+0000 7f0ab77fe640 1 -- 172.21.15.53:0/814286219 learned_addr learned my addr 172.21.15.53:0/814286219 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab6ffd640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ab810b490 0x7f0ab819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ab810bde0 0x7f0ab81a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab77fe640 1 -- 172.21.15.53:0/814286219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ab810bde0 msgr2=0x7f0ab81a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab77fe640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ab810bde0 0x7f0ab81a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab77fe640 1 -- 172.21.15.53:0/814286219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ab810b490 msgr2=0x7f0ab819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab77fe640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ab810b490 0x7f0ab819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab77fe640 1 -- 172.21.15.53:0/814286219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab81a22a0 con 0x7f0ab8105b50 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ab810bde0 0x7f0ab81a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab6ffd640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ab810b490 0x7f0ab819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab77fe640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab8105b50 0x7f0ab819c330 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800d770 tx=0x7f0aa800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab4ff9640 1 -- 172.21.15.53:0/814286219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8017070 con 0x7f0ab8105b50 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0abe245640 1 -- 172.21.15.53:0/814286219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab81a2590 con 0x7f0ab8105b50 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab4ff9640 1 -- 172.21.15.53:0/814286219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0aa80054b0 con 0x7f0ab8105b50 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0ab4ff9640 1 -- 172.21.15.53:0/814286219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8004c60 con 0x7f0ab8105b50 2024-08-31T06:13:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.265+0000 7f0abe245640 1 -- 172.21.15.53:0/814286219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab81a8cf0 con 0x7f0ab8105b50 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.268+0000 7f0ac47ba740 1 Processor -- start 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.268+0000 7f0ac47ba740 1 -- start start 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.268+0000 7f0ab4ff9640 1 -- 172.21.15.53:0/814286219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0aa8010460 con 0x7f0ab8105b50 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 0x55a0ba3d72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba0091b0 0x55a0ba3d7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba3d7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a0ba34e630 con 0x55a0ba0091b0 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a0ba33dbc0 con 0x55a0ba011390 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a0ba341b70 con 0x55a0ba032070 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba0091b0 0x55a0ba3d7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 0x55a0ba3d72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 0x55a0ba3d72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:55782/0 (socket says 172.21.15.53:55782) 2024-08-31T06:13:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba0091b0 0x55a0ba3d7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58736/0 (socket says 172.21.15.53:58736) 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba3d7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab7fff640 1 -- 172.21.15.53:0/326634109 learned_addr learned my addr 172.21.15.53:0/326634109 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab7fff640 1 -- 172.21.15.53:0/326634109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 msgr2=0x55a0ba3d7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/326634109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba3d7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab7fff640 1 -- 172.21.15.53:0/326634109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba0091b0 msgr2=0x55a0ba3d7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/326634109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba0091b0 0x55a0ba3d7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab7fff640 1 -- 172.21.15.53:0/326634109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ba09d650 con 0x55a0ba032070 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab6ffd640 1 --2- 172.21.15.53:0/326634109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba3d7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab4ff9640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0aa00b4ca0 0x7f0aa00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.269+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/326634109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 0x55a0ba3d72c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0031450 tx=0x7f0ab0031480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f8ec0f06c02f10 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.270+0000 7f0ab77fe640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0aa00b4ca0 0x7f0aa00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.270+0000 7f0ab4ff9640 1 -- 172.21.15.53:0/814286219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f0aa80e5100 con 0x7f0ab8105b50 2024-08-31T06:13:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.270+0000 7f0a9dffb640 1 -- 172.21.15.53:0/326634109 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0031980 con 0x55a0ba032070 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.270+0000 7f0a9dffb640 1 -- 172.21.15.53:0/326634109 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ab0036070 con 0x55a0ba032070 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.270+0000 7f0a9dffb640 1 -- 172.21.15.53:0/326634109 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0004460 con 0x55a0ba032070 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.271+0000 7f0ac47ba740 1 -- 172.21.15.53:0/326634109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 msgr2=0x55a0ba3d72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.271+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/326634109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 0x55a0ba3d72c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0031450 tx=0x7f0ab0031480 comp rx=0 tx=0).stop 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.271+0000 7f0ab77fe640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0aa00b4ca0 0x7f0aa00b71b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80e28e0 tx=0x7f0aa80e8c50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.271+0000 7f0ac47ba740 1 -- 172.21.15.53:0/326634109 shutdown_connections 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.271+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/326634109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba3d7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.271+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/326634109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba0091b0 0x55a0ba3d7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.271+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/326634109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 0x55a0ba3d72c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.271+0000 7f0ac47ba740 1 -- 172.21.15.53:0/326634109 >> 172.21.15.53:0/326634109 conn(0x55a0ba026460 msgr2=0x55a0ba3d51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.271+0000 7f0ac47ba740 1 -- 172.21.15.53:0/326634109 shutdown_connections 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.271+0000 7f0ac47ba740 1 -- 172.21.15.53:0/326634109 wait complete. 2024-08-31T06:13:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.271+0000 7f0ac47ba740 1 -- start start 2024-08-31T06:13:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ac47ba740 1 Processor -- start 2024-08-31T06:13:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba0091b0 0x55a0ba3e2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba3e3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 0x55a0ba3eed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a0ba1a0700 con 0x55a0ba0091b0 2024-08-31T06:13:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a0ba2c4700 con 0x55a0ba011390 2024-08-31T06:13:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a0ba3e5a40 con 0x55a0ba032070 2024-08-31T06:13:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ac47ba740 10 client.0 _ll_register_callbacks cb 0x55a0ba2f3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ab6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba3e3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ab6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba3e3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51272/0 (socket says 172.21.15.53:51272) 2024-08-31T06:13:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ab6ffd640 1 -- 172.21.15.53:0/843544446 learned_addr learned my addr 172.21.15.53:0/843544446 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.272+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba0091b0 0x55a0ba3e2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0ab6ffd640 1 -- 172.21.15.53:0/843544446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 msgr2=0x55a0ba3eed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 0x55a0ba3eed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0ab6ffd640 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 0x55a0ba3eed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0ab6ffd640 1 -- 172.21.15.53:0/843544446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba0091b0 msgr2=0x55a0ba3e2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0ab6ffd640 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba0091b0 0x55a0ba3e2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0ab6ffd640 1 -- 172.21.15.53:0/843544446 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ba2fd8b0 con 0x55a0ba011390 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 0x55a0ba3eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0ab6ffd640 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba3e3020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0aac012700 tx=0x7f0aac012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d6119254df02730 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0a96ffd640 1 -- 172.21.15.53:0/843544446 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac011bb0 con 0x55a0ba011390 2024-08-31T06:13:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0a96ffd640 1 -- 172.21.15.53:0/843544446 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f0aac011d50 con 0x55a0ba011390 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0ac47ba740 1 -- 172.21.15.53:0/843544446 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ab0036070 con 0x55a0ba011390 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0a96ffd640 1 -- 172.21.15.53:0/843544446 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0aac005020 con 0x55a0ba011390 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0ac47ba740 10 client.27470 fetch_fsmap learned FSMap version 36 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.273+0000 7f0ac47ba740 1 -- 172.21.15.53:0/843544446 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a0ba3f1900 con 0x55a0ba011390 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.274+0000 7f0a96ffd640 1 -- 172.21.15.53:0/843544446 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0aac0047a0 con 0x55a0ba011390 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.274+0000 7f0a96ffd640 1 -- 172.21.15.53:0/843544446 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f0aac01c470 con 0x55a0ba011390 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.274+0000 7f0ac47ba740 10 client.27470 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.274+0000 7f0ac47ba740 10 client.27470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.274+0000 7f0ac47ba740 20 client.27470 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.274+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a0b9ff09f0 0x55a0ba3f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.274+0000 7f0ac47ba740 4 client.27470 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.274+0000 7f0ac47ba740 1 -- 172.21.15.53:0/843544446 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0ab0036070 con 0x55a0b9ff09f0 2024-08-31T06:13:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.274+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a0b9ff09f0 0x55a0ba3f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.275+0000 7f0a96ffd640 10 client.27470 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.275+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a0b9ff09f0 0x55a0ba3f4e20 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb94934120515c9 server_cookie=eef12d10fbca8125 in_seq=0 out_seq=0 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.275+0000 7f0a96ffd640 1 -- 172.21.15.53:0/843544446 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f0ab0036070 con 0x55a0b9ff09f0 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.275+0000 7f0a96ffd640 10 client.27470 handle_command_reply: tid=0 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.275+0000 7f0ac47ba740 1 client.27470 shutdown 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0ac47ba740 1 -- 172.21.15.53:0/843544446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 msgr2=0x55a0ba3e3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba3e3020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0aac012700 tx=0x7f0aac012bc0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0ac47ba740 1 -- 172.21.15.53:0/843544446 shutdown_connections 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a0b9ff09f0 0x55a0ba3f4e20 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba032070 0x55a0ba3eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba3e3020 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0a96ffd640 0 client.27470 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/843544446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba0091b0 0x55a0ba3e2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0ac47ba740 1 -- 172.21.15.53:0/843544446 >> 172.21.15.53:0/843544446 conn(0x55a0ba026460 msgr2=0x55a0ba3da450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0ac47ba740 1 -- 172.21.15.53:0/843544446 shutdown_connections 2024-08-31T06:13:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0ac47ba740 1 -- 172.21.15.53:0/843544446 wait complete. 2024-08-31T06:13:05.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.276+0000 7f0ac47ba740 20 client.27470 trim_cache size 0 max 16384 2024-08-31T06:13:05.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.295+0000 7f0ac47ba740 1 Processor -- start 2024-08-31T06:13:05.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.295+0000 7f0ac47ba740 1 -- start start 2024-08-31T06:13:05.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0b9ff09f0 0x55a0ba3e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba0091b0 0x55a0ba3daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba011390 0x55a0ba3dfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b16a0 con 0x55a0ba011390 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b31e0 con 0x55a0ba0091b0 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b1d70 con 0x55a0b9ff09f0 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba011390 0x55a0ba3dfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba0091b0 0x55a0ba3daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba011390 0x55a0ba3dfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58754/0 (socket says 172.21.15.53:58754) 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba0091b0 0x55a0ba3daad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51278/0 (socket says 172.21.15.53:51278) 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab7fff640 1 -- 172.21.15.53:0/1371908856 learned_addr learned my addr 172.21.15.53:0/1371908856 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/1371908856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0b9ff09f0 0x55a0ba3e2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab7fff640 1 -- 172.21.15.53:0/1371908856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0b9ff09f0 msgr2=0x55a0ba3e2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/1371908856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0b9ff09f0 0x55a0ba3e2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab7fff640 1 -- 172.21.15.53:0/1371908856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba0091b0 msgr2=0x55a0ba3daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/1371908856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba0091b0 0x55a0ba3daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab7fff640 1 -- 172.21.15.53:0/1371908856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ba3e1a40 con 0x55a0ba011390 2024-08-31T06:13:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.296+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/1371908856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba011390 0x55a0ba3dfcd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0ab002a900 tx=0x7f0ab003d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4c29d3876e307 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.297+0000 7f0a9d7fa640 1 -- 172.21.15.53:0/1371908856 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0049040 con 0x55a0ba011390 2024-08-31T06:13:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.297+0000 7f0a9d7fa640 1 -- 172.21.15.53:0/1371908856 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ab0036030 con 0x55a0ba011390 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.297+0000 7f0a9d7fa640 1 -- 172.21.15.53:0/1371908856 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0004740 con 0x55a0ba011390 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.297+0000 7f0ac47ba740 1 -- 172.21.15.53:0/1371908856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba011390 msgr2=0x55a0ba3dfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.297+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/1371908856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba011390 0x55a0ba3dfcd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0ab002a900 tx=0x7f0ab003d040 comp rx=0 tx=0).stop 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.298+0000 7f0ac47ba740 1 -- 172.21.15.53:0/1371908856 shutdown_connections 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.298+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/1371908856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0ba011390 0x55a0ba3dfcd0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.298+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/1371908856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba0091b0 0x55a0ba3daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.298+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/1371908856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0b9ff09f0 0x55a0ba3e2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.298+0000 7f0ac47ba740 1 -- 172.21.15.53:0/1371908856 >> 172.21.15.53:0/1371908856 conn(0x55a0ba026460 msgr2=0x55a0ba3da3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.298+0000 7f0ac47ba740 1 -- 172.21.15.53:0/1371908856 shutdown_connections 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.298+0000 7f0ac47ba740 1 -- 172.21.15.53:0/1371908856 wait complete. 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.298+0000 7f0ac47ba740 1 -- start start 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.298+0000 7f0ac47ba740 1 Processor -- start 2024-08-31T06:13:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0b9ff09f0 0x55a0ba3e7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba0091b0 0x55a0ba3e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ac47ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba4588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b2b10 con 0x55a0b9ff09f0 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81b2440 con 0x55a0ba011390 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ac47ba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab81af6a0 con 0x55a0ba0091b0 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ac47ba740 10 client.0 _ll_register_callbacks cb 0x7f0aac009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0b9ff09f0 0x55a0ba3e7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0b9ff09f0 0x55a0ba3e7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58768/0 (socket says 172.21.15.53:58768) 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab7fff640 1 -- 172.21.15.53:0/4017645959 learned_addr learned my addr 172.21.15.53:0/4017645959 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab6ffd640 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba0091b0 0x55a0ba3e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba4588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab7fff640 1 -- 172.21.15.53:0/4017645959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba0091b0 msgr2=0x55a0ba3e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:05.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba0091b0 0x55a0ba3e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab7fff640 1 -- 172.21.15.53:0/4017645959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 msgr2=0x55a0ba4588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba4588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab7fff640 1 -- 172.21.15.53:0/4017645959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ba458f40 con 0x55a0b9ff09f0 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab6ffd640 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba0091b0 0x55a0ba3e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0b9ff09f0 0x55a0ba3e7680 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0002230 tx=0x7f0ab0031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac6f044aa773daa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.299+0000 7f0a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0a96ffd640 1 -- 172.21.15.53:0/4017645959 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab00305c0 con 0x55a0b9ff09f0 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0a96ffd640 1 -- 172.21.15.53:0/4017645959 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8557+0+0 (secure 0 0 0) 0x7f0ab0049040 con 0x55a0b9ff09f0 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0ac47ba740 1 -- 172.21.15.53:0/4017645959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ab0036030 con 0x55a0b9ff09f0 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0a96ffd640 1 -- 172.21.15.53:0/4017645959 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0ab0030760 con 0x55a0b9ff09f0 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0ac47ba740 10 client.18210 fetch_fsmap learned FSMap version 36 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0ac47ba740 1 -- 172.21.15.53:0/4017645959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a0ba460290 con 0x55a0b9ff09f0 2024-08-31T06:13:05.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0a96ffd640 1 -- 172.21.15.53:0/4017645959 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ab0036030 con 0x55a0b9ff09f0 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0a96ffd640 1 -- 172.21.15.53:0/4017645959 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f0ab00536f0 con 0x55a0b9ff09f0 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0ac47ba740 10 client.18210 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0ac47ba740 10 client.18210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0ac47ba740 20 client.18210 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a0ba032070 0x55a0ba462570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0ac47ba740 4 client.18210 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.300+0000 7f0ac47ba740 1 -- 172.21.15.53:0/4017645959 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0ba350580 con 0x55a0ba032070 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.301+0000 7f0ab6ffd640 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a0ba032070 0x55a0ba462570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.301+0000 7f0a96ffd640 10 client.18210 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.301+0000 7f0ab6ffd640 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a0ba032070 0x55a0ba462570 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71cbf942c5851357 server_cookie=745b975900ee0a53 in_seq=0 out_seq=0 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0a96ffd640 1 -- 172.21.15.53:0/4017645959 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55a0ba350580 con 0x55a0ba032070 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0a96ffd640 10 client.18210 handle_command_reply: tid=0 2024-08-31T06:13:05.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 1 client.18210 shutdown 2024-08-31T06:13:05.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 1 -- 172.21.15.53:0/4017645959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0b9ff09f0 msgr2=0x55a0ba3e7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0b9ff09f0 0x55a0ba3e7680 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0002230 tx=0x7f0ab0031480 comp rx=0 tx=0).stop 2024-08-31T06:13:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 1 -- 172.21.15.53:0/4017645959 shutdown_connections 2024-08-31T06:13:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a0ba032070 0x55a0ba462570 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0ba011390 0x55a0ba4588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0a96ffd640 0 client.18210 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a0ba0091b0 0x55a0ba3e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 1 --2- 172.21.15.53:0/4017645959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a0b9ff09f0 0x55a0ba3e7680 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 1 -- 172.21.15.53:0/4017645959 >> 172.21.15.53:0/4017645959 conn(0x55a0ba026460 msgr2=0x55a0ba3d82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 1 -- 172.21.15.53:0/4017645959 shutdown_connections 2024-08-31T06:13:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 1 -- 172.21.15.53:0/4017645959 wait complete. 2024-08-31T06:13:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.302+0000 7f0ac47ba740 20 client.18210 trim_cache size 0 max 16384 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "414a1081-11c9-4d68-99ae-4d7c02bab716", 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:13:05.310 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:05.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.312 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:05.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:05.314 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:13:05.315 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:05.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:13:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:13:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:13:05.317 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:13:05.317 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:13:05.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 -- 172.21.15.53:0/814286219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0aa00b4ca0 msgr2=0x7f0aa00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:05.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0aa00b4ca0 0x7f0aa00b71b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80e28e0 tx=0x7f0aa80e8c50 comp rx=0 tx=0).stop 2024-08-31T06:13:05.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 -- 172.21.15.53:0/814286219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab8105b50 msgr2=0x7f0ab819c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:05.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab8105b50 0x7f0ab819c330 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800d770 tx=0x7f0aa800dc30 comp rx=0 tx=0).stop 2024-08-31T06:13:05.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 -- 172.21.15.53:0/814286219 shutdown_connections 2024-08-31T06:13:05.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0aa00b4ca0 0x7f0aa00b71b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ab810bde0 0x7f0ab81a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ab810b490 0x7f0ab819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 --2- 172.21.15.53:0/814286219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab8105b50 0x7f0ab819c330 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 -- 172.21.15.53:0/814286219 >> 172.21.15.53:0/814286219 conn(0x7f0ab81015a0 msgr2=0x7f0ab81039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 -- 172.21.15.53:0/814286219 shutdown_connections 2024-08-31T06:13:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:05.303+0000 7f0abe245640 1 -- 172.21.15.53:0/814286219 wait complete. 2024-08-31T06:13:05.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:05 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:13:05.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:05 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:05.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:05 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:05.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:05 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:05.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:05 smithi130 ceph-mon[22266]: pgmap v571: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-08-31T06:13:05.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:05 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:13:05.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:05 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:05.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:05 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:05.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:05 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:05.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:05 smithi153 ceph-mon[22320]: pgmap v571: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-08-31T06:13:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:05 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:13:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:05 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:05 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:05.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:05 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:05.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:05 smithi053 ceph-mon[18924]: pgmap v571: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-08-31T06:13:05.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 140016 1.60 MB/sec execute 295 sec latency 26.953 ms 2024-08-31T06:13:06.015 INFO:tasks.cephfs.filesystem:scrub status for tag:414a1081-11c9-4d68-99ae-4d7c02bab716 - {'path': '/', 'tag': '414a1081-11c9-4d68-99ae-4d7c02bab716', 'options': 'recursive,force'} 2024-08-31T06:13:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.118+0000 7f010ed9d640 1 -- 172.21.15.53:0/1377703306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01081044f0 msgr2=0x7f0108104900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.118+0000 7f010ed9d640 1 --2- 172.21.15.53:0/1377703306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01081044f0 0x7f0108104900 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f0104009900 tx=0x7f010402a410 comp rx=0 tx=0).stop 2024-08-31T06:13:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.118+0000 7f010ed9d640 1 -- 172.21.15.53:0/1377703306 shutdown_connections 2024-08-31T06:13:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.118+0000 7f010ed9d640 1 --2- 172.21.15.53:0/1377703306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f010810d950 0x7f010810fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.118+0000 7f010ed9d640 1 --2- 172.21.15.53:0/1377703306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0108104e40 0x7f010810d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.118+0000 7f010ed9d640 1 --2- 172.21.15.53:0/1377703306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01081044f0 0x7f0108104900 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.118+0000 7f010ed9d640 1 -- 172.21.15.53:0/1377703306 >> 172.21.15.53:0/1377703306 conn(0x7f01080fdfc0 msgr2=0x7f0108100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.119+0000 7f010ed9d640 1 -- 172.21.15.53:0/1377703306 shutdown_connections 2024-08-31T06:13:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.119+0000 7f010ed9d640 1 -- 172.21.15.53:0/1377703306 wait complete. 2024-08-31T06:13:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.119+0000 7f010ed9d640 1 Processor -- start 2024-08-31T06:13:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.119+0000 7f010ed9d640 1 -- start start 2024-08-31T06:13:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01081044f0 0x7f0108102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0108104e40 0x7f0108102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010810d950 0x7f0108102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010ed9d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0108113490 con 0x7f01081044f0 2024-08-31T06:13:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010ed9d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0108113310 con 0x7f0108104e40 2024-08-31T06:13:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010ed9d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0108113610 con 0x7f010810d950 2024-08-31T06:13:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01081044f0 0x7f0108102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01081044f0 0x7f0108102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58778/0 (socket says 172.21.15.53:58778) 2024-08-31T06:13:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010dd9b640 1 -- 172.21.15.53:0/1425257267 learned_addr learned my addr 172.21.15.53:0/1425257267 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010e59c640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010810d950 0x7f0108102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010d59a640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0108104e40 0x7f0108102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010dd9b640 1 -- 172.21.15.53:0/1425257267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010810d950 msgr2=0x7f0108102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010dd9b640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010810d950 0x7f0108102ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010dd9b640 1 -- 172.21.15.53:0/1425257267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0108104e40 msgr2=0x7f0108102760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010dd9b640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0108104e40 0x7f0108102760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010dd9b640 1 -- 172.21.15.53:0/1425257267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01081a8220 con 0x7f01081044f0 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f010dd9b640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01081044f0 0x7f0108102220 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f0104009230 tx=0x7f0104004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f00feffd640 1 -- 172.21.15.53:0/1425257267 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010403f030 con 0x7f01081044f0 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.120+0000 7f00feffd640 1 -- 172.21.15.53:0/1425257267 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0104003a80 con 0x7f01081044f0 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.121+0000 7f010ed9d640 1 -- 172.21.15.53:0/1425257267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01081a84b0 con 0x7f01081044f0 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.121+0000 7f00feffd640 1 -- 172.21.15.53:0/1425257267 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0104035070 con 0x7f01081044f0 2024-08-31T06:13:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.121+0000 7f010ed9d640 1 -- 172.21.15.53:0/1425257267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01081a89a0 con 0x7f01081044f0 2024-08-31T06:13:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.123+0000 7f0117043740 1 Processor -- start 2024-08-31T06:13:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.123+0000 7f0117043740 1 -- start start 2024-08-31T06:13:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.123+0000 7f0117043740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336251b0 0x5646339c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.123+0000 7f0117043740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.123+0000 7f00feffd640 1 -- 172.21.15.53:0/1425257267 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0104042030 con 0x7f01081044f0 2024-08-31T06:13:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f0117043740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336044d0 0x5646339c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f0117043740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56463393e000 con 0x5646336251b0 2024-08-31T06:13:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f0117043740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56463392d590 con 0x5646335fc2f0 2024-08-31T06:13:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f0117043740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564633931540 con 0x5646336044d0 2024-08-31T06:13:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336251b0 0x5646339c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010d59a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336044d0 0x5646339c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336251b0 0x5646339c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58780/0 (socket says 172.21.15.53:58780) 2024-08-31T06:13:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010e59c640 1 -- 172.21.15.53:0/3606554285 learned_addr learned my addr 172.21.15.53:0/3606554285 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010dd9b640 1 --2- 172.21.15.53:0/3606554285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010d59a640 1 -- 172.21.15.53:0/3606554285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 msgr2=0x5646339c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010d59a640 1 --2- 172.21.15.53:0/3606554285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010d59a640 1 -- 172.21.15.53:0/3606554285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336251b0 msgr2=0x5646339c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010d59a640 1 --2- 172.21.15.53:0/3606554285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336251b0 0x5646339c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010d59a640 1 -- 172.21.15.53:0/3606554285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564633690790 con 0x5646336044d0 2024-08-31T06:13:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010e59c640 1 --2- 172.21.15.53:0/3606554285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336251b0 0x5646339c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010d59a640 1 --2- 172.21.15.53:0/3606554285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336044d0 0x5646339c9960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f010806cb50 tx=0x7f00f800bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=949c5f0d79d9c662 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f00feffd640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00f40b4cd0 0x7f00f40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f00f3fff640 1 -- 172.21.15.53:0/3606554285 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8003ba0 con 0x5646336044d0 2024-08-31T06:13:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.124+0000 7f010e59c640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00f40b4cd0 0x7f00f40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.125+0000 7f00f3fff640 1 -- 172.21.15.53:0/3606554285 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00f8015070 con 0x5646336044d0 2024-08-31T06:13:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.125+0000 7f00f3fff640 1 -- 172.21.15.53:0/3606554285 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8004b20 con 0x5646336044d0 2024-08-31T06:13:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.125+0000 7f00feffd640 1 -- 172.21.15.53:0/1425257267 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8601+0+0 (secure 0 0 0) 0x7f0104105a10 con 0x7f01081044f0 2024-08-31T06:13:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.125+0000 7f0117043740 1 -- 172.21.15.53:0/3606554285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336044d0 msgr2=0x5646339c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.125+0000 7f010e59c640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00f40b4cd0 0x7f00f40b71e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0100011890 tx=0x7f0100009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.125+0000 7f0117043740 1 --2- 172.21.15.53:0/3606554285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336044d0 0x5646339c9960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f010806cb50 tx=0x7f00f800bb20 comp rx=0 tx=0).stop 2024-08-31T06:13:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.125+0000 7f0117043740 1 -- 172.21.15.53:0/3606554285 shutdown_connections 2024-08-31T06:13:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.125+0000 7f0117043740 1 --2- 172.21.15.53:0/3606554285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336044d0 0x5646339c9960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.125+0000 7f0117043740 1 --2- 172.21.15.53:0/3606554285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.125+0000 7f0117043740 1 --2- 172.21.15.53:0/3606554285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336251b0 0x5646339c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.125+0000 7f0117043740 1 -- 172.21.15.53:0/3606554285 >> 172.21.15.53:0/3606554285 conn(0x564633619300 msgr2=0x5646339c6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.126+0000 7f0117043740 1 -- 172.21.15.53:0/3606554285 shutdown_connections 2024-08-31T06:13:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.126+0000 7f0117043740 1 -- 172.21.15.53:0/3606554285 wait complete. 2024-08-31T06:13:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.126+0000 7f0117043740 1 -- start start 2024-08-31T06:13:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.126+0000 7f0117043740 1 Processor -- start 2024-08-31T06:13:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f0117043740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339d4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f0117043740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f0117043740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 0x5646339e0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f0117043740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564633866ab0 con 0x5646336044d0 2024-08-31T06:13:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f0117043740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5646338b4680 con 0x5646335fc2f0 2024-08-31T06:13:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f0117043740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5646339d7660 con 0x5646336251b0 2024-08-31T06:13:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f0117043740 10 client.0 _ll_register_callbacks cb 0x56463363ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010d59a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 0x5646339e0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010d59a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58782/0 (socket says 172.21.15.53:58782) 2024-08-31T06:13:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010d59a640 1 -- 172.21.15.53:0/4241815950 learned_addr learned my addr 172.21.15.53:0/4241815950 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010dd9b640 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339d4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010d59a640 1 -- 172.21.15.53:0/4241815950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 msgr2=0x5646339e0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010d59a640 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 0x5646339e0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010d59a640 1 -- 172.21.15.53:0/4241815950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 msgr2=0x5646339d4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010d59a640 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339d4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010d59a640 1 -- 172.21.15.53:0/4241815950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564633709620 con 0x5646336044d0 2024-08-31T06:13:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010e59c640 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 0x5646339e0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010dd9b640 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339d4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f010d59a640 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d5100 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f00f800bfa0 tx=0x7f00f800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0ee96969c133d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.127+0000 7f00f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f00f17fa640 1 -- 172.21.15.53:0/4241815950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8028060 con 0x5646336044d0 2024-08-31T06:13:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f00f17fa640 1 -- 172.21.15.53:0/4241815950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8601+0+0 (secure 0 0 0) 0x7f00f8003e30 con 0x5646336044d0 2024-08-31T06:13:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f0117043740 1 -- 172.21.15.53:0/4241815950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00f8015070 con 0x5646336044d0 2024-08-31T06:13:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f00f17fa640 1 -- 172.21.15.53:0/4241815950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f00f8011440 con 0x5646336044d0 2024-08-31T06:13:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f0117043740 10 client.18222 fetch_fsmap learned FSMap version 36 2024-08-31T06:13:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f0117043740 1 -- 172.21.15.53:0/4241815950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5646339e3720 con 0x5646336044d0 2024-08-31T06:13:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f00f17fa640 1 -- 172.21.15.53:0/4241815950 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00f8015070 con 0x5646336044d0 2024-08-31T06:13:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f00f17fa640 1 -- 172.21.15.53:0/4241815950 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f00f80196e0 con 0x5646336044d0 2024-08-31T06:13:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f0117043740 10 client.18222 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:13:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f0117043740 10 client.18222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f0117043740 20 client.18222 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f0117043740 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5646335e3d80 0x5646339e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f0117043740 4 client.18222 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:06.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f0117043740 1 -- 172.21.15.53:0/4241815950 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56463393ff50 con 0x5646335e3d80 2024-08-31T06:13:06.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.128+0000 7f010dd9b640 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5646335e3d80 0x5646339e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.129+0000 7f00f17fa640 10 client.18222 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:06.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.129+0000 7f010dd9b640 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5646335e3d80 0x5646339e6ae0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7be27bc6b4fbba7 server_cookie=45a8f02515b9a7bf in_seq=0 out_seq=0 2024-08-31T06:13:06.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f00f17fa640 1 -- 172.21.15.53:0/4241815950 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56463393ff50 con 0x5646335e3d80 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f00f17fa640 10 client.18222 handle_command_reply: tid=0 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 1 client.18222 shutdown 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 1 -- 172.21.15.53:0/4241815950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 msgr2=0x5646339d5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d5100 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f00f800bfa0 tx=0x7f00f800bfd0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 1 -- 172.21.15.53:0/4241815950 shutdown_connections 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5646335e3d80 0x5646339e6ae0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 0x5646339e0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d5100 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 1 --2- 172.21.15.53:0/4241815950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339d4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 1 -- 172.21.15.53:0/4241815950 >> 172.21.15.53:0/4241815950 conn(0x564633619300 msgr2=0x5646339c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f00f17fa640 0 client.18222 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 1 -- 172.21.15.53:0/4241815950 shutdown_connections 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 1 -- 172.21.15.53:0/4241815950 wait complete. 2024-08-31T06:13:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.130+0000 7f0117043740 20 client.18222 trim_cache size 0 max 16384 2024-08-31T06:13:06.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f0117043740 1 Processor -- start 2024-08-31T06:13:06.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f0117043740 1 -- start start 2024-08-31T06:13:06.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f0117043740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646335fc2f0 0x5646339d3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f0117043740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f0117043740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646336251b0 0x5646339ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f0117043740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01081b1590 con 0x5646336044d0 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f0117043740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01081b30d0 con 0x5646336251b0 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f0117043740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01081b1c60 con 0x5646335fc2f0 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f010d59a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f010d59a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58798/0 (socket says 172.21.15.53:58798) 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f010d59a640 1 -- 172.21.15.53:0/3225726166 learned_addr learned my addr 172.21.15.53:0/3225726166 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f010dd9b640 1 --2- 172.21.15.53:0/3225726166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646335fc2f0 0x5646339d3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f010e59c640 1 --2- 172.21.15.53:0/3225726166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646336251b0 0x5646339ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.146+0000 7f010d59a640 1 -- 172.21.15.53:0/3225726166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646335fc2f0 msgr2=0x5646339d3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.147+0000 7f010d59a640 1 --2- 172.21.15.53:0/3225726166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646335fc2f0 0x5646339d3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.147+0000 7f010d59a640 1 -- 172.21.15.53:0/3225726166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646336251b0 msgr2=0x5646339ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.147+0000 7f010d59a640 1 --2- 172.21.15.53:0/3225726166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646336251b0 0x5646339ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.147+0000 7f010d59a640 1 -- 172.21.15.53:0/3225726166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646339c1cf0 con 0x5646336044d0 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.147+0000 7f010e59c640 1 --2- 172.21.15.53:0/3225726166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646336251b0 0x5646339ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.147+0000 7f010d59a640 1 --2- 172.21.15.53:0/3225726166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d36d0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f00f8001eb0 tx=0x7f00f8004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5baebe31ebd7f518 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.147+0000 7f00f37fe640 1 -- 172.21.15.53:0/3225726166 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8028070 con 0x5646336044d0 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.147+0000 7f00f37fe640 1 -- 172.21.15.53:0/3225726166 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00f8015040 con 0x5646336044d0 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.147+0000 7f00f37fe640 1 -- 172.21.15.53:0/3225726166 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011b60 con 0x5646336044d0 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.148+0000 7f0117043740 1 -- 172.21.15.53:0/3225726166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 msgr2=0x5646339d36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.148+0000 7f0117043740 1 --2- 172.21.15.53:0/3225726166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d36d0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f00f8001eb0 tx=0x7f00f8004630 comp rx=0 tx=0).stop 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.148+0000 7f0117043740 1 -- 172.21.15.53:0/3225726166 shutdown_connections 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.148+0000 7f0117043740 1 --2- 172.21.15.53:0/3225726166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646336251b0 0x5646339ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.148+0000 7f0117043740 1 --2- 172.21.15.53:0/3225726166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339d36d0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.148+0000 7f0117043740 1 --2- 172.21.15.53:0/3225726166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646335fc2f0 0x5646339d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.148+0000 7f0117043740 1 -- 172.21.15.53:0/3225726166 >> 172.21.15.53:0/3225726166 conn(0x564633619300 msgr2=0x5646339cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.148+0000 7f0117043740 1 -- 172.21.15.53:0/3225726166 shutdown_connections 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.148+0000 7f0117043740 1 -- 172.21.15.53:0/3225726166 wait complete. 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.148+0000 7f0117043740 1 -- start start 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.148+0000 7f0117043740 1 Processor -- start 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f0117043740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f0117043740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339e6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f0117043740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 0x5646339e7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f0117043740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01081b2a00 con 0x5646336044d0 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f0117043740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01081b2330 con 0x5646335fc2f0 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f0117043740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01081af590 con 0x5646336251b0 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f0117043740 10 client.0 _ll_register_callbacks cb 0x7f0100009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f010d59a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339e6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f010d59a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339e6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58804/0 (socket says 172.21.15.53:58804) 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f010d59a640 1 -- 172.21.15.53:0/91126126 learned_addr learned my addr 172.21.15.53:0/91126126 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f010e59c640 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 0x5646339e7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f010dd9b640 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f010d59a640 1 -- 172.21.15.53:0/91126126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 msgr2=0x5646339e7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f010d59a640 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 0x5646339e7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f010d59a640 1 -- 172.21.15.53:0/91126126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 msgr2=0x5646339e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f010d59a640 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f010d59a640 1 -- 172.21.15.53:0/91126126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564633a4f250 con 0x5646336044d0 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.149+0000 7f010e59c640 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 0x5646339e7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.150+0000 7f010d59a640 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339e6f50 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f00f801c040 tx=0x7f00f800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c8031c596af362 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.150+0000 7f00f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.150+0000 7f00f17fa640 1 -- 172.21.15.53:0/91126126 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8038060 con 0x5646336044d0 2024-08-31T06:13:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.150+0000 7f00f17fa640 1 -- 172.21.15.53:0/91126126 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8601+0+0 (secure 0 0 0) 0x7f00f8005030 con 0x5646336044d0 2024-08-31T06:13:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.150+0000 7f0117043740 1 -- 172.21.15.53:0/91126126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00f8015040 con 0x5646336044d0 2024-08-31T06:13:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.150+0000 7f00f17fa640 1 -- 172.21.15.53:0/91126126 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f00f8028070 con 0x5646336044d0 2024-08-31T06:13:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.150+0000 7f0117043740 10 client.18228 fetch_fsmap learned FSMap version 36 2024-08-31T06:13:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.150+0000 7f0117043740 1 -- 172.21.15.53:0/91126126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564633a50400 con 0x5646336044d0 2024-08-31T06:13:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.150+0000 7f00f17fa640 1 -- 172.21.15.53:0/91126126 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00f8015040 con 0x5646336044d0 2024-08-31T06:13:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.150+0000 7f00f17fa640 1 -- 172.21.15.53:0/91126126 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f00f8032070 con 0x5646336044d0 2024-08-31T06:13:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.151+0000 7f0117043740 10 client.18228 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T06:13:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.151+0000 7f0117043740 10 client.18228 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.151+0000 7f0117043740 20 client.18228 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.151+0000 7f0117043740 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5646335b91c0 0x564633a52850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.151+0000 7f0117043740 4 client.18228 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:13:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.151+0000 7f0117043740 1 -- 172.21.15.53:0/91126126 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56463393b9f0 con 0x5646335b91c0 2024-08-31T06:13:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.151+0000 7f010dd9b640 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5646335b91c0 0x564633a52850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.151+0000 7f00f17fa640 10 client.18228 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.151+0000 7f010dd9b640 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5646335b91c0 0x564633a52850 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a04213a8234e386 server_cookie=4e116ec27cb8e266 in_seq=0 out_seq=0 2024-08-31T06:13:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f00f17fa640 1 -- 172.21.15.53:0/91126126 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56463393b9f0 con 0x5646335b91c0 2024-08-31T06:13:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f00f17fa640 10 client.18228 handle_command_reply: tid=0 2024-08-31T06:13:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f0117043740 1 client.18228 shutdown 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f0117043740 1 -- 172.21.15.53:0/91126126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 msgr2=0x5646339e6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f0117043740 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339e6f50 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f00f801c040 tx=0x7f00f800b4a0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f0117043740 1 -- 172.21.15.53:0/91126126 shutdown_connections 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f0117043740 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5646335b91c0 0x564633a52850 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f0117043740 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5646336251b0 0x5646339e7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f0117043740 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5646336044d0 0x5646339e6f50 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f00f17fa640 0 client.18228 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f0117043740 1 --2- 172.21.15.53:0/91126126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5646335fc2f0 0x5646339e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.170+0000 7f0117043740 1 -- 172.21.15.53:0/91126126 >> 172.21.15.53:0/91126126 conn(0x564633619300 msgr2=0x5646339d2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f0117043740 1 -- 172.21.15.53:0/91126126 shutdown_connections 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f0117043740 1 -- 172.21.15.53:0/91126126 wait complete. 2024-08-31T06:13:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f0117043740 20 client.18228 trim_cache size 0 max 16384 2024-08-31T06:13:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:13:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:13:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:13:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:13:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 -- 172.21.15.53:0/1425257267 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00f40b4cd0 msgr2=0x7f00f40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00f40b4cd0 0x7f00f40b71e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0100011890 tx=0x7f0100009500 comp rx=0 tx=0).stop 2024-08-31T06:13:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 -- 172.21.15.53:0/1425257267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01081044f0 msgr2=0x7f0108102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01081044f0 0x7f0108102220 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f0104009230 tx=0x7f0104004270 comp rx=0 tx=0).stop 2024-08-31T06:13:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 -- 172.21.15.53:0/1425257267 shutdown_connections 2024-08-31T06:13:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00f40b4cd0 0x7f00f40b71e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010810d950 0x7f0108102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0108104e40 0x7f0108102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 --2- 172.21.15.53:0/1425257267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01081044f0 0x7f0108102220 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 -- 172.21.15.53:0/1425257267 >> 172.21.15.53:0/1425257267 conn(0x7f01080fdfc0 msgr2=0x7f01080fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 -- 172.21.15.53:0/1425257267 shutdown_connections 2024-08-31T06:13:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:06.171+0000 7f010ed9d640 1 -- 172.21.15.53:0/1425257267 wait complete. 2024-08-31T06:13:06.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:06 smithi130 ceph-mon[22266]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T06:13:06.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:06 smithi153 ceph-mon[22320]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T06:13:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:06 smithi053 ceph-mon[18924]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T06:13:06.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 140563 1.59 MB/sec execute 296 sec latency 23.558 ms 2024-08-31T06:13:07.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:07 smithi130 ceph-mon[22266]: pgmap v573: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.3 MiB/s wr, 143 op/s 2024-08-31T06:13:07.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:07 smithi153 ceph-mon[22320]: pgmap v573: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.3 MiB/s wr, 143 op/s 2024-08-31T06:13:07.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:07 smithi053 ceph-mon[18924]: pgmap v573: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.3 MiB/s wr, 143 op/s 2024-08-31T06:13:07.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 140989 1.60 MB/sec execute 297 sec latency 18.577 ms 2024-08-31T06:13:08.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 141685 1.61 MB/sec execute 298 sec latency 14.012 ms 2024-08-31T06:13:09.880 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:09 smithi130 ceph-mon[22266]: pgmap v574: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.1 MiB/s wr, 132 op/s 2024-08-31T06:13:09.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:09 smithi153 ceph-mon[22320]: pgmap v574: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.1 MiB/s wr, 132 op/s 2024-08-31T06:13:09.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:09 smithi053 ceph-mon[18924]: pgmap v574: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.1 MiB/s wr, 132 op/s 2024-08-31T06:13:09.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 142146 1.62 MB/sec execute 299 sec latency 15.065 ms 2024-08-31T06:13:10.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 142390 1.62 MB/sec execute 300 sec latency 13.966 ms 2024-08-31T06:13:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:11 smithi130 ceph-mon[22266]: pgmap v575: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 977 KiB/s wr, 132 op/s 2024-08-31T06:13:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:11 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:13:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:11 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:13:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:11 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:13:11.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:11 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:13:11.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:11 smithi153 ceph-mon[22320]: pgmap v575: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 977 KiB/s wr, 132 op/s 2024-08-31T06:13:11.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:11 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:13:11.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:11 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:13:11.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:11 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:13:11.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:11 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:13:11.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:11 smithi053 ceph-mon[18924]: pgmap v575: 97 pgs: 97 active+clean; 84 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 977 KiB/s wr, 132 op/s 2024-08-31T06:13:11.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:11 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:13:11.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:11 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:13:11.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:11 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:13:11.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:11 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:13:11.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 142792 1.61 MB/sec execute 301 sec latency 15.730 ms 2024-08-31T06:13:12.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 143321 1.62 MB/sec execute 302 sec latency 19.518 ms 2024-08-31T06:13:13.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:13 smithi130 ceph-mon[22266]: pgmap v576: 97 pgs: 97 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2024-08-31T06:13:13.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:13 smithi153 ceph-mon[22320]: pgmap v576: 97 pgs: 97 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2024-08-31T06:13:13.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:13 smithi053 ceph-mon[18924]: pgmap v576: 97 pgs: 97 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2024-08-31T06:13:13.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 143779 1.62 MB/sec execute 303 sec latency 21.683 ms 2024-08-31T06:13:14.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 144325 1.62 MB/sec execute 304 sec latency 20.495 ms 2024-08-31T06:13:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:15 smithi130 ceph-mon[22266]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T06:13:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:15 smithi130 ceph-mon[22266]: pgmap v578: 97 pgs: 97 active+clean; 86 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-08-31T06:13:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:15 smithi153 ceph-mon[22320]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T06:13:15.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:15 smithi153 ceph-mon[22320]: pgmap v578: 97 pgs: 97 active+clean; 86 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-08-31T06:13:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:15 smithi053 ceph-mon[18924]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T06:13:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:15 smithi053 ceph-mon[18924]: pgmap v578: 97 pgs: 97 active+clean; 86 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-08-31T06:13:15.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 144924 1.63 MB/sec execute 305 sec latency 18.092 ms 2024-08-31T06:13:16.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 145409 1.64 MB/sec execute 306 sec latency 15.774 ms 2024-08-31T06:13:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:17 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:17 smithi130 ceph-mon[22266]: pgmap v579: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 1.4 MiB/s wr, 144 op/s 2024-08-31T06:13:17.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:17 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:17.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:17 smithi153 ceph-mon[22320]: pgmap v579: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 1.4 MiB/s wr, 144 op/s 2024-08-31T06:13:17.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:17 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:17.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:17 smithi053 ceph-mon[18924]: pgmap v579: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 1.4 MiB/s wr, 144 op/s 2024-08-31T06:13:17.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 145526 1.64 MB/sec execute 307 sec latency 760.966 ms 2024-08-31T06:13:18.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 145526 1.63 MB/sec execute 308 sec latency 1761.003 ms 2024-08-31T06:13:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.284+0000 7ff650579640 1 -- 172.21.15.53:0/1540643036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6481091d0 msgr2=0x7ff6481095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.284+0000 7ff650579640 1 --2- 172.21.15.53:0/1540643036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6481091d0 0x7ff6481095e0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7ff638009900 tx=0x7ff63802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.284+0000 7ff650579640 1 -- 172.21.15.53:0/1540643036 shutdown_connections 2024-08-31T06:13:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.284+0000 7ff650579640 1 --2- 172.21.15.53:0/1540643036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff648109b20 0x7ff648110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.284+0000 7ff650579640 1 --2- 172.21.15.53:0/1540643036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6481091d0 0x7ff6481095e0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.284+0000 7ff650579640 1 --2- 172.21.15.53:0/1540643036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6481038a0 0x7ff648103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.284+0000 7ff650579640 1 -- 172.21.15.53:0/1540643036 >> 172.21.15.53:0/1540643036 conn(0x7ff6480ff2a0 msgr2=0x7ff6481016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.284+0000 7ff650579640 1 -- 172.21.15.53:0/1540643036 shutdown_connections 2024-08-31T06:13:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.284+0000 7ff650579640 1 -- 172.21.15.53:0/1540643036 wait complete. 2024-08-31T06:13:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff650579640 1 Processor -- start 2024-08-31T06:13:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff650579640 1 -- start start 2024-08-31T06:13:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff650579640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6481038a0 0x7ff64819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff650579640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6481091d0 0x7ff64819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff650579640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff648109b20 0x7ff64819f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff650579640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff648113630 con 0x7ff648109b20 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff650579640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481134b0 con 0x7ff6481091d0 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff650579640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481137b0 con 0x7ff6481038a0 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64eb16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff648109b20 0x7ff64819f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64eb16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff648109b20 0x7ff64819f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41340/0 (socket says 172.21.15.53:41340) 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64eb16640 1 -- 172.21.15.53:0/2202973914 learned_addr learned my addr 172.21.15.53:0/2202973914 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64db14640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6481091d0 0x7ff64819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64e315640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6481038a0 0x7ff64819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64eb16640 1 -- 172.21.15.53:0/2202973914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6481038a0 msgr2=0x7ff64819a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64eb16640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6481038a0 0x7ff64819a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64eb16640 1 -- 172.21.15.53:0/2202973914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6481091d0 msgr2=0x7ff64819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64eb16640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6481091d0 0x7ff64819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64eb16640 1 -- 172.21.15.53:0/2202973914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64819ffb0 con 0x7ff648109b20 2024-08-31T06:13:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64db14640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6481091d0 0x7ff64819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.285+0000 7ff64e315640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6481038a0 0x7ff64819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.286+0000 7ff64eb16640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff648109b20 0x7ff64819f940 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ff64000cce0 tx=0x7ff64000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.286+0000 7ff63f7fe640 1 -- 172.21.15.53:0/2202973914 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64000f450 con 0x7ff648109b20 2024-08-31T06:13:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.286+0000 7ff650579640 1 -- 172.21.15.53:0/2202973914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6481a02a0 con 0x7ff648109b20 2024-08-31T06:13:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.286+0000 7ff63f7fe640 1 -- 172.21.15.53:0/2202973914 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff64000fa80 con 0x7ff648109b20 2024-08-31T06:13:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.286+0000 7ff63f7fe640 1 -- 172.21.15.53:0/2202973914 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640018ad0 con 0x7ff648109b20 2024-08-31T06:13:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.286+0000 7ff650579640 1 -- 172.21.15.53:0/2202973914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6481a0770 con 0x7ff648109b20 2024-08-31T06:13:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.289+0000 7ff6575c7740 1 Processor -- start 2024-08-31T06:13:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.289+0000 7ff63f7fe640 1 -- 172.21.15.53:0/2202973914 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff64000f5f0 con 0x7ff648109b20 2024-08-31T06:13:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.289+0000 7ff6575c7740 1 -- start start 2024-08-31T06:13:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71771b0 0x55b1a751aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a751b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71564d0 0x55b1a751b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff6575c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b1a7490000 con 0x55b1a71564d0 2024-08-31T06:13:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff6575c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b1a747f590 con 0x55b1a71771b0 2024-08-31T06:13:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff6575c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b1a7483540 con 0x55b1a714e2f0 2024-08-31T06:13:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff64db14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71564d0 0x55b1a751b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff64db14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71564d0 0x55b1a751b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41350/0 (socket says 172.21.15.53:41350) 2024-08-31T06:13:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff64db14640 1 -- 172.21.15.53:0/2842220676 learned_addr learned my addr 172.21.15.53:0/2842220676 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff64e315640 1 --2- 172.21.15.53:0/2842220676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a751b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff64db14640 1 --2- 172.21.15.53:0/2842220676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71771b0 0x55b1a751aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff63f7fe640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6340b4ca0 0x7ff6340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff64db14640 1 -- 172.21.15.53:0/2842220676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 msgr2=0x55b1a751b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff64db14640 1 --2- 172.21.15.53:0/2842220676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a751b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff64db14640 1 -- 172.21.15.53:0/2842220676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71771b0 msgr2=0x55b1a751aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff64db14640 1 --2- 172.21.15.53:0/2842220676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71771b0 0x55b1a751aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.290+0000 7ff64db14640 1 -- 172.21.15.53:0/2842220676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1a71e2790 con 0x55b1a71564d0 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.291+0000 7ff64eb16640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6340b4ca0 0x7ff6340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.291+0000 7ff64db14640 1 --2- 172.21.15.53:0/2842220676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71564d0 0x55b1a751b540 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ff638005940 tx=0x7ff6380058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959221db839380ea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.291+0000 7ff63f7fe640 1 -- 172.21.15.53:0/2202973914 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7ff6400e5e90 con 0x7ff648109b20 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.291+0000 7ff63cbfe640 1 -- 172.21.15.53:0/2842220676 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638035050 con 0x55b1a71564d0 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.291+0000 7ff63cbfe640 1 -- 172.21.15.53:0/2842220676 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff638004230 con 0x55b1a71564d0 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.291+0000 7ff63cbfe640 1 -- 172.21.15.53:0/2842220676 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63803d450 con 0x55b1a71564d0 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff6575c7740 1 -- 172.21.15.53:0/2842220676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71564d0 msgr2=0x55b1a751b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff6575c7740 1 --2- 172.21.15.53:0/2842220676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71564d0 0x55b1a751b540 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ff638005940 tx=0x7ff6380058b0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff64eb16640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6340b4ca0 0x7ff6340b71b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff6400ac490 tx=0x7ff640078700 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff6575c7740 1 -- 172.21.15.53:0/2842220676 shutdown_connections 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff6575c7740 1 --2- 172.21.15.53:0/2842220676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71564d0 0x55b1a751b540 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff6575c7740 1 --2- 172.21.15.53:0/2842220676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a751b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff6575c7740 1 --2- 172.21.15.53:0/2842220676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71771b0 0x55b1a751aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff6575c7740 1 -- 172.21.15.53:0/2842220676 >> 172.21.15.53:0/2842220676 conn(0x55b1a716b300 msgr2=0x55b1a75189b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff6575c7740 1 -- 172.21.15.53:0/2842220676 shutdown_connections 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff6575c7740 1 -- 172.21.15.53:0/2842220676 wait complete. 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff6575c7740 1 -- start start 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.292+0000 7ff6575c7740 1 Processor -- start 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a714e2f0 0x55b1a7526670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a71564d0 0x55b1a7526bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a75324d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff6575c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b1a73b8ab0 con 0x55b1a71771b0 2024-08-31T06:13:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff6575c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b1a7406680 con 0x55b1a714e2f0 2024-08-31T06:13:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff6575c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b1a75291e0 con 0x55b1a71564d0 2024-08-31T06:13:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff6575c7740 10 client.0 _ll_register_callbacks cb 0x55b1a718ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff64db14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a75324d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff64db14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a75324d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41362/0 (socket says 172.21.15.53:41362) 2024-08-31T06:13:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff64db14640 1 -- 172.21.15.53:0/1178281315 learned_addr learned my addr 172.21.15.53:0/1178281315 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff64db14640 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a714e2f0 0x55b1a7526670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff64e315640 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a71564d0 0x55b1a7526bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff64db14640 1 -- 172.21.15.53:0/1178281315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a71564d0 msgr2=0x55b1a7526bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff64db14640 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a71564d0 0x55b1a7526bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff64db14640 1 -- 172.21.15.53:0/1178281315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a714e2f0 msgr2=0x55b1a7526670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff64db14640 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a714e2f0 0x55b1a7526670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff64db14640 1 -- 172.21.15.53:0/1178281315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1a725b620 con 0x55b1a71771b0 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.293+0000 7ff64e315640 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a71564d0 0x55b1a7526bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.294+0000 7ff64db14640 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a75324d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff638032d70 tx=0x7ff63802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e466dcc5a8b89e02 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.294+0000 7ff631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.294+0000 7ff631ffb640 1 -- 172.21.15.53:0/1178281315 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638035040 con 0x55b1a71771b0 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.294+0000 7ff631ffb640 1 -- 172.21.15.53:0/1178281315 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7ff638003c20 con 0x55b1a71771b0 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.294+0000 7ff6575c7740 1 -- 172.21.15.53:0/1178281315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff638004230 con 0x55b1a71771b0 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.294+0000 7ff631ffb640 1 -- 172.21.15.53:0/1178281315 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff638003e20 con 0x55b1a71771b0 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.294+0000 7ff6575c7740 10 client.18240 fetch_fsmap learned FSMap version 37 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.294+0000 7ff6575c7740 1 -- 172.21.15.53:0/1178281315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b1a75351d0 con 0x55b1a71771b0 2024-08-31T06:13:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.294+0000 7ff631ffb640 1 -- 172.21.15.53:0/1178281315 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff638004230 con 0x55b1a71771b0 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.294+0000 7ff631ffb640 1 -- 172.21.15.53:0/1178281315 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7ff63803dcd0 con 0x55b1a71771b0 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.294+0000 7ff6575c7740 10 client.18240 fetch_fsmap finished waiting for FSMap version 37 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.295+0000 7ff6575c7740 10 client.18240 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.295+0000 7ff6575c7740 20 client.18240 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.295+0000 7ff6575c7740 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b1a7135d80 0x55b1a7538530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.295+0000 7ff6575c7740 4 client.18240 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.295+0000 7ff6575c7740 1 -- 172.21.15.53:0/1178281315 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1a7491f50 con 0x55b1a7135d80 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.295+0000 7ff64e315640 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b1a7135d80 0x55b1a7538530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.295+0000 7ff64e315640 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b1a7135d80 0x55b1a7538530 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d5d1bcb22238b19 server_cookie=bca783f6c0f6591a in_seq=0 out_seq=0 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.295+0000 7ff631ffb640 10 client.18240 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.296+0000 7ff631ffb640 1 -- 172.21.15.53:0/1178281315 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1a7491f50 con 0x55b1a7135d80 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.296+0000 7ff631ffb640 10 client.18240 handle_command_reply: tid=0 2024-08-31T06:13:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.296+0000 7ff6575c7740 1 client.18240 shutdown 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff6575c7740 1 -- 172.21.15.53:0/1178281315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 msgr2=0x55b1a75324d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff6575c7740 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a75324d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff638032d70 tx=0x7ff63802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff6575c7740 1 -- 172.21.15.53:0/1178281315 shutdown_connections 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff6575c7740 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b1a7135d80 0x55b1a7538530 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff6575c7740 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a75324d0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff6575c7740 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a71564d0 0x55b1a7526bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff631ffb640 0 client.18240 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff6575c7740 1 --2- 172.21.15.53:0/1178281315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a714e2f0 0x55b1a7526670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff6575c7740 1 -- 172.21.15.53:0/1178281315 >> 172.21.15.53:0/1178281315 conn(0x55b1a716b300 msgr2=0x55b1a751baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff6575c7740 1 -- 172.21.15.53:0/1178281315 shutdown_connections 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff6575c7740 1 -- 172.21.15.53:0/1178281315 wait complete. 2024-08-31T06:13:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.297+0000 7ff6575c7740 20 client.18240 trim_cache size 0 max 16384 2024-08-31T06:13:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff6575c7740 1 Processor -- start 2024-08-31T06:13:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff6575c7740 1 -- start start 2024-08-31T06:13:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a7524cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71564d0 0x55b1a7525200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7525930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff6575c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481af3c0 con 0x55b1a71771b0 2024-08-31T06:13:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff6575c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481b0f00 con 0x55b1a71564d0 2024-08-31T06:13:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff6575c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481afa90 con 0x55b1a714e2f0 2024-08-31T06:13:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff64db14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7525930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff64db14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7525930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41366/0 (socket says 172.21.15.53:41366) 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff64db14640 1 -- 172.21.15.53:0/168551540 learned_addr learned my addr 172.21.15.53:0/168551540 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff64db14640 1 --2- 172.21.15.53:0/168551540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a7524cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff64db14640 1 -- 172.21.15.53:0/168551540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 msgr2=0x55b1a7524cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff64db14640 1 --2- 172.21.15.53:0/168551540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a7524cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff64db14640 1 -- 172.21.15.53:0/168551540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71564d0 msgr2=0x55b1a7525200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff64db14640 1 --2- 172.21.15.53:0/168551540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71564d0 0x55b1a7525200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.312+0000 7ff64db14640 1 -- 172.21.15.53:0/168551540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1a751cdc0 con 0x55b1a71771b0 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.313+0000 7ff64db14640 1 --2- 172.21.15.53:0/168551540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7525930 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ff63802a910 tx=0x7ff638041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2618145758e4b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.313+0000 7ff633fff640 1 -- 172.21.15.53:0/168551540 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638035020 con 0x55b1a71771b0 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.313+0000 7ff633fff640 1 -- 172.21.15.53:0/168551540 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff63804e030 con 0x55b1a71771b0 2024-08-31T06:13:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.313+0000 7ff633fff640 1 -- 172.21.15.53:0/168551540 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638003fc0 con 0x55b1a71771b0 2024-08-31T06:13:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.313+0000 7ff6575c7740 1 -- 172.21.15.53:0/168551540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 msgr2=0x55b1a7525930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.313+0000 7ff6575c7740 1 --2- 172.21.15.53:0/168551540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7525930 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ff63802a910 tx=0x7ff638041040 comp rx=0 tx=0).stop 2024-08-31T06:13:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.313+0000 7ff6575c7740 1 -- 172.21.15.53:0/168551540 shutdown_connections 2024-08-31T06:13:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.313+0000 7ff6575c7740 1 --2- 172.21.15.53:0/168551540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7525930 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.313+0000 7ff6575c7740 1 --2- 172.21.15.53:0/168551540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71564d0 0x55b1a7525200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.313+0000 7ff6575c7740 1 --2- 172.21.15.53:0/168551540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a7524cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.313+0000 7ff6575c7740 1 -- 172.21.15.53:0/168551540 >> 172.21.15.53:0/168551540 conn(0x55b1a716b300 msgr2=0x55b1a75215d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff6575c7740 1 -- 172.21.15.53:0/168551540 shutdown_connections 2024-08-31T06:13:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff6575c7740 1 -- 172.21.15.53:0/168551540 wait complete. 2024-08-31T06:13:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff6575c7740 1 -- start start 2024-08-31T06:13:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff6575c7740 1 Processor -- start 2024-08-31T06:13:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a7539470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71564d0 0x55b1a75399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff6575c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7539ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff6575c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481b0830 con 0x55b1a71771b0 2024-08-31T06:13:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff6575c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481b0160 con 0x55b1a71564d0 2024-08-31T06:13:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff6575c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481ad3c0 con 0x55b1a714e2f0 2024-08-31T06:13:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff6575c7740 10 client.0 _ll_register_callbacks cb 0x7ff638032f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff64db14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7539ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff64db14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7539ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41380/0 (socket says 172.21.15.53:41380) 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.314+0000 7ff64db14640 1 -- 172.21.15.53:0/4150148973 learned_addr learned my addr 172.21.15.53:0/4150148973 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff64e315640 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71564d0 0x55b1a75399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff64db14640 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a7539470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff64db14640 1 -- 172.21.15.53:0/4150148973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 msgr2=0x55b1a7539470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff64db14640 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a7539470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff64db14640 1 -- 172.21.15.53:0/4150148973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71564d0 msgr2=0x55b1a75399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff64db14640 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71564d0 0x55b1a75399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff64db14640 1 -- 172.21.15.53:0/4150148973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1a75a1cb0 con 0x55b1a71771b0 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff64db14640 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7539ef0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7ff638003af0 tx=0x7ff63803c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dd9c89072c1d36 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff631ffb640 1 -- 172.21.15.53:0/4150148973 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63806c060 con 0x55b1a71771b0 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff6575c7740 1 -- 172.21.15.53:0/4150148973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff63804e030 con 0x55b1a71771b0 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff631ffb640 1 -- 172.21.15.53:0/4150148973 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7ff63803cc30 con 0x55b1a71771b0 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff631ffb640 1 -- 172.21.15.53:0/4150148973 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff638035070 con 0x55b1a71771b0 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff6575c7740 10 client.18246 fetch_fsmap learned FSMap version 37 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.315+0000 7ff6575c7740 1 -- 172.21.15.53:0/4150148973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b1a75a2e60 con 0x55b1a71771b0 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.316+0000 7ff631ffb640 1 -- 172.21.15.53:0/4150148973 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff63804e030 con 0x55b1a71771b0 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.316+0000 7ff631ffb640 1 -- 172.21.15.53:0/4150148973 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7ff638070450 con 0x55b1a71771b0 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.316+0000 7ff6575c7740 10 client.18246 fetch_fsmap finished waiting for FSMap version 37 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.316+0000 7ff6575c7740 10 client.18246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.316+0000 7ff6575c7740 20 client.18246 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.316+0000 7ff6575c7740 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b1a710b1c0 0x55b1a75a5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.316+0000 7ff6575c7740 4 client.18246 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:13:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.316+0000 7ff6575c7740 1 -- 172.21.15.53:0/4150148973 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b1a748d9f0 con 0x55b1a710b1c0 2024-08-31T06:13:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.316+0000 7ff64e315640 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b1a710b1c0 0x55b1a75a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.317+0000 7ff64e315640 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b1a710b1c0 0x55b1a75a5300 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21c6d9f28502bd8b server_cookie=fda4dcf82ebedfa5 in_seq=0 out_seq=0 2024-08-31T06:13:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.317+0000 7ff631ffb640 10 client.18246 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff631ffb640 1 -- 172.21.15.53:0/4150148973 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b1a748d9f0 con 0x55b1a710b1c0 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff631ffb640 10 client.18246 handle_command_reply: tid=0 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 1 client.18246 shutdown 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 1 -- 172.21.15.53:0/4150148973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 msgr2=0x55b1a7539ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7539ef0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7ff638003af0 tx=0x7ff63803c7b0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 1 -- 172.21.15.53:0/4150148973 shutdown_connections 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b1a710b1c0 0x55b1a75a5300 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1a71771b0 0x55b1a7539ef0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1a71564d0 0x55b1a75399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff631ffb640 0 client.18246 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 1 --2- 172.21.15.53:0/4150148973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b1a714e2f0 0x55b1a7539470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 1 -- 172.21.15.53:0/4150148973 >> 172.21.15.53:0/4150148973 conn(0x55b1a716b300 msgr2=0x55b1a7524890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 1 -- 172.21.15.53:0/4150148973 shutdown_connections 2024-08-31T06:13:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 1 -- 172.21.15.53:0/4150148973 wait complete. 2024-08-31T06:13:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.344+0000 7ff6575c7740 20 client.18246 trim_cache size 0 max 16384 2024-08-31T06:13:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:13:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:13:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:13:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:13:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 -- 172.21.15.53:0/2202973914 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6340b4ca0 msgr2=0x7ff6340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6340b4ca0 0x7ff6340b71b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff6400ac490 tx=0x7ff640078700 comp rx=0 tx=0).stop 2024-08-31T06:13:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 -- 172.21.15.53:0/2202973914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff648109b20 msgr2=0x7ff64819f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff648109b20 0x7ff64819f940 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ff64000cce0 tx=0x7ff64000a620 comp rx=0 tx=0).stop 2024-08-31T06:13:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 -- 172.21.15.53:0/2202973914 shutdown_connections 2024-08-31T06:13:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6340b4ca0 0x7ff6340b71b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff648109b20 0x7ff64819f940 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6481091d0 0x7ff64819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 --2- 172.21.15.53:0/2202973914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6481038a0 0x7ff64819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 -- 172.21.15.53:0/2202973914 >> 172.21.15.53:0/2202973914 conn(0x7ff6480ff2a0 msgr2=0x7ff6481016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 -- 172.21.15.53:0/2202973914 shutdown_connections 2024-08-31T06:13:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:19.345+0000 7ff650579640 1 -- 172.21.15.53:0/2202973914 wait complete. 2024-08-31T06:13:19.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:19 smithi130 ceph-mon[22266]: pgmap v580: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.5 MiB/s wr, 142 op/s 2024-08-31T06:13:19.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:19 smithi153 ceph-mon[22320]: pgmap v580: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.5 MiB/s wr, 142 op/s 2024-08-31T06:13:19.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:19 smithi053 ceph-mon[18924]: pgmap v580: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.5 MiB/s wr, 142 op/s 2024-08-31T06:13:19.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 145526 1.63 MB/sec execute 309 sec latency 2761.043 ms 2024-08-31T06:13:20.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 145526 1.62 MB/sec execute 310 sec latency 3761.083 ms 2024-08-31T06:13:21.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:21 smithi130 ceph-mon[22266]: pgmap v581: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.4 MiB/s wr, 127 op/s 2024-08-31T06:13:21.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:21 smithi153 ceph-mon[22320]: pgmap v581: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.4 MiB/s wr, 127 op/s 2024-08-31T06:13:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:21 smithi053 ceph-mon[18924]: pgmap v581: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.4 MiB/s wr, 127 op/s 2024-08-31T06:13:21.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 145593 1.62 MB/sec execute 311 sec latency 4018.189 ms 2024-08-31T06:13:22.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:22 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:22.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:22 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:22.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:22 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:22.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 145593 1.61 MB/sec execute 312 sec latency 1483.986 ms 2024-08-31T06:13:23.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:23 smithi130 ceph-mon[22266]: pgmap v582: 97 pgs: 97 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-08-31T06:13:23.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:23 smithi153 ceph-mon[22320]: pgmap v582: 97 pgs: 97 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-08-31T06:13:23.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:23 smithi053 ceph-mon[18924]: pgmap v582: 97 pgs: 97 active+clean; 85 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-08-31T06:13:23.985 INFO:tasks.workunit.client.0.smithi053.stdout: 1 145593 1.61 MB/sec execute 313 sec latency 2484.029 ms 2024-08-31T06:13:24.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 145593 1.60 MB/sec execute 314 sec latency 3484.081 ms 2024-08-31T06:13:25.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:25 smithi130 ceph-mon[22266]: pgmap v583: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 979 KiB/s wr, 92 op/s 2024-08-31T06:13:25.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:25 smithi153 ceph-mon[22320]: pgmap v583: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 979 KiB/s wr, 92 op/s 2024-08-31T06:13:25.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:25 smithi053 ceph-mon[18924]: pgmap v583: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 979 KiB/s wr, 92 op/s 2024-08-31T06:13:25.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 145593 1.60 MB/sec execute 315 sec latency 4484.162 ms 2024-08-31T06:13:26.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 145803 1.60 MB/sec execute 316 sec latency 4740.368 ms 2024-08-31T06:13:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:27 smithi130 ceph-mon[22266]: pgmap v584: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 858 KiB/s wr, 85 op/s 2024-08-31T06:13:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:27 smithi153 ceph-mon[22320]: pgmap v584: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 858 KiB/s wr, 85 op/s 2024-08-31T06:13:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:27 smithi053 ceph-mon[18924]: pgmap v584: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 858 KiB/s wr, 85 op/s 2024-08-31T06:13:27.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 146070 1.59 MB/sec execute 317 sec latency 15.276 ms 2024-08-31T06:13:28.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 146556 1.59 MB/sec execute 318 sec latency 14.820 ms 2024-08-31T06:13:29.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:29 smithi053 ceph-mon[18924]: pgmap v585: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 537 KiB/s wr, 60 op/s 2024-08-31T06:13:29.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:29 smithi130 ceph-mon[22266]: pgmap v585: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 537 KiB/s wr, 60 op/s 2024-08-31T06:13:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:29 smithi153 ceph-mon[22320]: pgmap v585: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 537 KiB/s wr, 60 op/s 2024-08-31T06:13:29.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 147054 1.60 MB/sec execute 319 sec latency 21.170 ms 2024-08-31T06:13:30.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 147602 1.59 MB/sec execute 320 sec latency 23.126 ms 2024-08-31T06:13:31.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:31 smithi130 ceph-mon[22266]: pgmap v586: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 706 KiB/s wr, 73 op/s 2024-08-31T06:13:31.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:31 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:31 smithi153 ceph-mon[22320]: pgmap v586: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 706 KiB/s wr, 73 op/s 2024-08-31T06:13:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:31 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:31 smithi053 ceph-mon[18924]: pgmap v586: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 706 KiB/s wr, 73 op/s 2024-08-31T06:13:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:31 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:31.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 148052 1.60 MB/sec execute 321 sec latency 32.803 ms 2024-08-31T06:13:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.446+0000 7f69e9053640 1 -- 172.21.15.53:0/1766747767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e4108080 msgr2=0x7f69e4108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.446+0000 7f69e9053640 1 --2- 172.21.15.53:0/1766747767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e4108080 0x7f69e4108490 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009900 tx=0x7f69d802a410 comp rx=0 tx=0).stop 2024-08-31T06:13:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.446+0000 7f69e9053640 1 -- 172.21.15.53:0/1766747767 shutdown_connections 2024-08-31T06:13:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.446+0000 7f69e9053640 1 --2- 172.21.15.53:0/1766747767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e41089d0 0x7f69e410f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.446+0000 7f69e9053640 1 --2- 172.21.15.53:0/1766747767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e4108080 0x7f69e4108490 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.446+0000 7f69e9053640 1 --2- 172.21.15.53:0/1766747767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69e4102750 0x7f69e4102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.446+0000 7f69e9053640 1 -- 172.21.15.53:0/1766747767 >> 172.21.15.53:0/1766747767 conn(0x7f69e407a4e0 msgr2=0x7f69e407a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.447+0000 7f69e9053640 1 -- 172.21.15.53:0/1766747767 shutdown_connections 2024-08-31T06:13:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.447+0000 7f69e9053640 1 -- 172.21.15.53:0/1766747767 wait complete. 2024-08-31T06:13:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.447+0000 7f69e9053640 1 Processor -- start 2024-08-31T06:13:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e9053640 1 -- start start 2024-08-31T06:13:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e9053640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e4102750 0x7f69e419a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e9053640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e4108080 0x7f69e419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e9053640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69e41089d0 0x7f69e419f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e9053640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f69e41124f0 con 0x7f69e4102750 2024-08-31T06:13:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e9053640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69e4112370 con 0x7f69e4108080 2024-08-31T06:13:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e9053640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69e4112670 con 0x7f69e41089d0 2024-08-31T06:13:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e4102750 0x7f69e419a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e4108080 0x7f69e419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e4102750 0x7f69e419a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47122/0 (socket says 172.21.15.53:47122) 2024-08-31T06:13:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e4108080 0x7f69e419a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43454/0 (socket says 172.21.15.53:43454) 2024-08-31T06:13:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e2d9d640 1 -- 172.21.15.53:0/2454393392 learned_addr learned my addr 172.21.15.53:0/2454393392 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e359e640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69e41089d0 0x7f69e419f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e259c640 1 -- 172.21.15.53:0/2454393392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69e41089d0 msgr2=0x7f69e419f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e259c640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69e41089d0 0x7f69e419f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e259c640 1 -- 172.21.15.53:0/2454393392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e4102750 msgr2=0x7f69e419a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e259c640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e4102750 0x7f69e419a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e259c640 1 -- 172.21.15.53:0/2454393392 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e41a0070 con 0x7f69e4108080 2024-08-31T06:13:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.448+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e4102750 0x7f69e419a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.449+0000 7f69e259c640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e4108080 0x7f69e419a6e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f69d802a930 tx=0x7f69d8005e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.449+0000 7f69cbfff640 1 -- 172.21.15.53:0/2454393392 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d803f070 con 0x7f69e4108080 2024-08-31T06:13:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.449+0000 7f69e9053640 1 -- 172.21.15.53:0/2454393392 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e41a0300 con 0x7f69e4108080 2024-08-31T06:13:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.449+0000 7f69e9053640 1 -- 172.21.15.53:0/2454393392 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e41a6af0 con 0x7f69e4108080 2024-08-31T06:13:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.449+0000 7f69cbfff640 1 -- 172.21.15.53:0/2454393392 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69d8003a80 con 0x7f69e4108080 2024-08-31T06:13:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.449+0000 7f69cbfff640 1 -- 172.21.15.53:0/2454393392 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8048060 con 0x7f69e4108080 2024-08-31T06:13:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.451+0000 7f69effc4740 1 Processor -- start 2024-08-31T06:13:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.451+0000 7f69effc4740 1 -- start start 2024-08-31T06:13:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69effc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4fd1b0 0x56134f8a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69effc4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8a1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69effc4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4dc4d0 0x56134f8a1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69effc4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56134f816000 con 0x56134f4d42f0 2024-08-31T06:13:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69effc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56134f805590 con 0x56134f4fd1b0 2024-08-31T06:13:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69effc4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56134f809540 con 0x56134f4dc4d0 2024-08-31T06:13:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69cbfff640 1 -- 172.21.15.53:0/2454393392 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f69d803ba30 con 0x7f69e4108080 2024-08-31T06:13:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8a1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47130/0 (socket says 172.21.15.53:47130) 2024-08-31T06:13:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4fd1b0 0x56134f8a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e2d9d640 1 -- 172.21.15.53:0/155608838 learned_addr learned my addr 172.21.15.53:0/155608838 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e259c640 1 --2- 172.21.15.53:0/155608838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4dc4d0 0x56134f8a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e359e640 1 -- 172.21.15.53:0/155608838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4dc4d0 msgr2=0x56134f8a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e359e640 1 --2- 172.21.15.53:0/155608838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4dc4d0 0x56134f8a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e359e640 1 -- 172.21.15.53:0/155608838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 msgr2=0x56134f8a1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e359e640 1 --2- 172.21.15.53:0/155608838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8a1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e359e640 1 -- 172.21.15.53:0/155608838 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134f568790 con 0x56134f4fd1b0 2024-08-31T06:13:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/155608838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.452+0000 7f69e359e640 1 --2- 172.21.15.53:0/155608838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4fd1b0 0x56134f8a0ac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009f30 tx=0x7f69dc0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19b7ecc88d55677d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.453+0000 7f69c97fa640 1 -- 172.21.15.53:0/155608838 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc004d20 con 0x56134f4fd1b0 2024-08-31T06:13:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.453+0000 7f69c97fa640 1 -- 172.21.15.53:0/155608838 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69dc004050 con 0x56134f4fd1b0 2024-08-31T06:13:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.453+0000 7f69c97fa640 1 -- 172.21.15.53:0/155608838 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc005260 con 0x56134f4fd1b0 2024-08-31T06:13:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.453+0000 7f69cbfff640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69cc0b4ca0 0x7f69cc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.453+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69cc0b4ca0 0x7f69cc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.453+0000 7f69cbfff640 1 -- 172.21.15.53:0/2454393392 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f69d8105680 con 0x7f69e4108080 2024-08-31T06:13:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69effc4740 1 -- 172.21.15.53:0/155608838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4fd1b0 msgr2=0x56134f8a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69cc0b4ca0 0x7f69cc0b71b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009fd0 tx=0x7f69d4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69effc4740 1 --2- 172.21.15.53:0/155608838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4fd1b0 0x56134f8a0ac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009f30 tx=0x7f69dc0118d0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69effc4740 1 -- 172.21.15.53:0/155608838 shutdown_connections 2024-08-31T06:13:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69effc4740 1 --2- 172.21.15.53:0/155608838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4dc4d0 0x56134f8a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69effc4740 1 --2- 172.21.15.53:0/155608838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69effc4740 1 --2- 172.21.15.53:0/155608838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4fd1b0 0x56134f8a0ac0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69effc4740 1 -- 172.21.15.53:0/155608838 >> 172.21.15.53:0/155608838 conn(0x56134f4f1300 msgr2=0x56134f89e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69effc4740 1 -- 172.21.15.53:0/155608838 shutdown_connections 2024-08-31T06:13:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69effc4740 1 -- 172.21.15.53:0/155608838 wait complete. 2024-08-31T06:13:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69effc4740 1 -- start start 2024-08-31T06:13:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.454+0000 7f69effc4740 1 Processor -- start 2024-08-31T06:13:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69effc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4d42f0 0x56134f8ac750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69effc4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4dc4d0 0x56134f8accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69effc4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4fd1b0 0x56134f8b8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69effc4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56134f73eab0 con 0x56134f4fd1b0 2024-08-31T06:13:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69effc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56134f78c680 con 0x56134f4d42f0 2024-08-31T06:13:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69effc4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56134f8af240 con 0x56134f4dc4d0 2024-08-31T06:13:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69effc4740 10 client.0 _ll_register_callbacks cb 0x56134f514a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4d42f0 0x56134f8ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4fd1b0 0x56134f8b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4d42f0 0x56134f8ac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43470/0 (socket says 172.21.15.53:43470) 2024-08-31T06:13:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e2d9d640 1 -- 172.21.15.53:0/2588599430 learned_addr learned my addr 172.21.15.53:0/2588599430 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e259c640 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4dc4d0 0x56134f8accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e2d9d640 1 -- 172.21.15.53:0/2588599430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4dc4d0 msgr2=0x56134f8accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4dc4d0 0x56134f8accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e2d9d640 1 -- 172.21.15.53:0/2588599430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4fd1b0 msgr2=0x56134f8b8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4fd1b0 0x56134f8b8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e2d9d640 1 -- 172.21.15.53:0/2588599430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134f5e1620 con 0x56134f4d42f0 2024-08-31T06:13:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e259c640 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4dc4d0 0x56134f8accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e359e640 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4fd1b0 0x56134f8b8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4d42f0 0x56134f8ac750 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009620 tx=0x7f69d4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac88121580ce917 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.455+0000 7f69c6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:13:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69c6ff5640 1 -- 172.21.15.53:0/2588599430 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4004240 con 0x56134f4d42f0 2024-08-31T06:13:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69c6ff5640 1 -- 172.21.15.53:0/2588599430 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f69d40043e0 con 0x56134f4d42f0 2024-08-31T06:13:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69effc4740 1 -- 172.21.15.53:0/2588599430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69dc004050 con 0x56134f4d42f0 2024-08-31T06:13:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69c6ff5640 1 -- 172.21.15.53:0/2588599430 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f69d4011910 con 0x56134f4d42f0 2024-08-31T06:13:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69effc4740 10 client.27518 fetch_fsmap learned FSMap version 40 2024-08-31T06:13:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69effc4740 1 -- 172.21.15.53:0/2588599430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x56134f8bb360 con 0x56134f4d42f0 2024-08-31T06:13:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69c6ff5640 1 -- 172.21.15.53:0/2588599430 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69dc004050 con 0x56134f4d42f0 2024-08-31T06:13:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69c6ff5640 1 -- 172.21.15.53:0/2588599430 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 40) ==== 8378+0+0 (secure 0 0 0) 0x7f69d4027020 con 0x56134f4d42f0 2024-08-31T06:13:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69effc4740 10 client.27518 fetch_fsmap finished waiting for FSMap version 40 2024-08-31T06:13:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69effc4740 10 client.27518 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69effc4740 20 client.27518 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69effc4740 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56134f4bbd80 0x56134f8be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69effc4740 4 client.27518 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69effc4740 1 -- 172.21.15.53:0/2588599430 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56134f817f50 con 0x56134f4bbd80 2024-08-31T06:13:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.456+0000 7f69e259c640 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56134f4bbd80 0x56134f8be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.457+0000 7f69c6ff5640 10 client.27518 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.457+0000 7f69e259c640 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56134f4bbd80 0x56134f8be8e0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9f94b1f5383a18f server_cookie=be73993fb4d8dd0c in_seq=0 out_seq=0 2024-08-31T06:13:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69c6ff5640 1 -- 172.21.15.53:0/2588599430 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56134f817f50 con 0x56134f4bbd80 2024-08-31T06:13:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69c6ff5640 10 client.27518 handle_command_reply: tid=0 2024-08-31T06:13:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69effc4740 1 client.27518 shutdown 2024-08-31T06:13:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69effc4740 1 -- 172.21.15.53:0/2588599430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4d42f0 msgr2=0x56134f8ac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69effc4740 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4d42f0 0x56134f8ac750 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009620 tx=0x7f69d4004730 comp rx=0 tx=0).stop 2024-08-31T06:13:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69effc4740 1 -- 172.21.15.53:0/2588599430 shutdown_connections 2024-08-31T06:13:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69effc4740 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56134f4bbd80 0x56134f8be8e0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69effc4740 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4fd1b0 0x56134f8b8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69effc4740 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4dc4d0 0x56134f8accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69c6ff5640 0 client.27518 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69effc4740 1 --2- 172.21.15.53:0/2588599430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4d42f0 0x56134f8ac750 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69effc4740 1 -- 172.21.15.53:0/2588599430 >> 172.21.15.53:0/2588599430 conn(0x56134f4f1300 msgr2=0x56134f8a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69effc4740 1 -- 172.21.15.53:0/2588599430 shutdown_connections 2024-08-31T06:13:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.458+0000 7f69effc4740 1 -- 172.21.15.53:0/2588599430 wait complete. 2024-08-31T06:13:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.459+0000 7f69effc4740 20 client.27518 trim_cache size 0 max 16384 2024-08-31T06:13:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69effc4740 1 Processor -- start 2024-08-31T06:13:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69effc4740 1 -- start start 2024-08-31T06:13:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69effc4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4bbd80 0x56134f8a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69effc4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4d42f0 0x56134f8a6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69effc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4dc4d0 0x56134f8a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69effc4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f69e41af480 con 0x56134f4bbd80 2024-08-31T06:13:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69effc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69e41b1020 con 0x56134f4dc4d0 2024-08-31T06:13:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69effc4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69e41afb50 con 0x56134f4d42f0 2024-08-31T06:13:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4bbd80 0x56134f8a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4bbd80 0x56134f8a5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47144/0 (socket says 172.21.15.53:47144) 2024-08-31T06:13:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69e2d9d640 1 -- 172.21.15.53:0/155077089 learned_addr learned my addr 172.21.15.53:0/155077089 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69e359e640 1 --2- 172.21.15.53:0/155077089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4dc4d0 0x56134f8a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69e259c640 1 --2- 172.21.15.53:0/155077089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4d42f0 0x56134f8a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69e2d9d640 1 -- 172.21.15.53:0/155077089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4d42f0 msgr2=0x56134f8a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/155077089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4d42f0 0x56134f8a6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69e2d9d640 1 -- 172.21.15.53:0/155077089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4dc4d0 msgr2=0x56134f8a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/155077089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4dc4d0 0x56134f8a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.475+0000 7f69e2d9d640 1 -- 172.21.15.53:0/155077089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134f8a3670 con 0x56134f4bbd80 2024-08-31T06:13:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.476+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/155077089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4bbd80 0x56134f8a5bf0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009f60 tx=0x7f69d4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576e42ab31fe685b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.476+0000 7f69c8ff9640 1 -- 172.21.15.53:0/155077089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4004240 con 0x56134f4bbd80 2024-08-31T06:13:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.476+0000 7f69c8ff9640 1 -- 172.21.15.53:0/155077089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69d4037070 con 0x56134f4bbd80 2024-08-31T06:13:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.476+0000 7f69c8ff9640 1 -- 172.21.15.53:0/155077089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4005020 con 0x56134f4bbd80 2024-08-31T06:13:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.477+0000 7f69effc4740 1 -- 172.21.15.53:0/155077089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4bbd80 msgr2=0x56134f8a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.477+0000 7f69effc4740 1 --2- 172.21.15.53:0/155077089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4bbd80 0x56134f8a5bf0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009f60 tx=0x7f69d4011810 comp rx=0 tx=0).stop 2024-08-31T06:13:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.477+0000 7f69effc4740 1 -- 172.21.15.53:0/155077089 shutdown_connections 2024-08-31T06:13:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.477+0000 7f69effc4740 1 --2- 172.21.15.53:0/155077089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4dc4d0 0x56134f8a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.477+0000 7f69effc4740 1 --2- 172.21.15.53:0/155077089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4d42f0 0x56134f8a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.477+0000 7f69effc4740 1 --2- 172.21.15.53:0/155077089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4bbd80 0x56134f8a5bf0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.477+0000 7f69effc4740 1 -- 172.21.15.53:0/155077089 >> 172.21.15.53:0/155077089 conn(0x56134f4f1300 msgr2=0x56134f8aada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.477+0000 7f69effc4740 1 -- 172.21.15.53:0/155077089 shutdown_connections 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.477+0000 7f69effc4740 1 -- 172.21.15.53:0/155077089 wait complete. 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.477+0000 7f69effc4740 1 -- start start 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.477+0000 7f69effc4740 1 Processor -- start 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69effc4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4bbd80 0x56134f8b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69effc4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69effc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4dc4d0 0x56134f9212b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69effc4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f69e41b0920 con 0x56134f4d42f0 2024-08-31T06:13:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69effc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69e41b0220 con 0x56134f4dc4d0 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69effc4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69e41ad480 con 0x56134f4bbd80 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69effc4740 10 client.0 _ll_register_callbacks cb 0x7f69d4009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e2d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4bbd80 0x56134f8b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47148/0 (socket says 172.21.15.53:47148) 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4dc4d0 0x56134f9212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e259c640 1 -- 172.21.15.53:0/569686423 learned_addr learned my addr 172.21.15.53:0/569686423 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e259c640 1 -- 172.21.15.53:0/569686423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4bbd80 msgr2=0x56134f8b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e259c640 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4bbd80 0x56134f8b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e259c640 1 -- 172.21.15.53:0/569686423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4dc4d0 msgr2=0x56134f9212b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e259c640 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4dc4d0 0x56134f9212b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e259c640 1 -- 172.21.15.53:0/569686423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134f9218f0 con 0x56134f4d42f0 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4bbd80 0x56134f8b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e359e640 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4dc4d0 0x56134f9212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69e259c640 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8b22f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f69d8006010 tx=0x7f69d803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef11812f902e6d97 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69c6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69c6ff5640 1 -- 172.21.15.53:0/569686423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8035040 con 0x56134f4d42f0 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69c6ff5640 1 -- 172.21.15.53:0/569686423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f69d80d0210 con 0x56134f4d42f0 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.478+0000 7f69effc4740 1 -- 172.21.15.53:0/569686423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69d4037070 con 0x56134f4d42f0 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69c6ff5640 1 -- 172.21.15.53:0/569686423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f69d80cbe00 con 0x56134f4d42f0 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69effc4740 10 client.18264 fetch_fsmap learned FSMap version 40 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69effc4740 1 -- 172.21.15.53:0/569686423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x56134f928c90 con 0x56134f4d42f0 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69c6ff5640 1 -- 172.21.15.53:0/569686423 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69d4037070 con 0x56134f4d42f0 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69c6ff5640 1 -- 172.21.15.53:0/569686423 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 40) ==== 8378+0+0 (secure 0 0 0) 0x7f69d804b060 con 0x56134f4d42f0 2024-08-31T06:13:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69effc4740 10 client.18264 fetch_fsmap finished waiting for FSMap version 40 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69effc4740 10 client.18264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69effc4740 20 client.18264 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69effc4740 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56134f4fd1b0 0x56134f92b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69effc4740 4 client.18264 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69effc4740 1 -- 172.21.15.53:0/569686423 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56134f8139f0 con 0x56134f4fd1b0 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.479+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56134f4fd1b0 0x56134f92b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.480+0000 7f69e2d9d640 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56134f4fd1b0 0x56134f92b430 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=494c4886392ada84 server_cookie=24bed33f4542f633 in_seq=0 out_seq=0 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.480+0000 7f69c6ff5640 10 client.18264 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69c6ff5640 1 -- 172.21.15.53:0/569686423 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56134f8139f0 con 0x56134f4fd1b0 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69c6ff5640 10 client.18264 handle_command_reply: tid=0 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 1 client.18264 shutdown 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 1 -- 172.21.15.53:0/569686423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 msgr2=0x56134f8b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8b22f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f69d8006010 tx=0x7f69d803e000 comp rx=0 tx=0).stop 2024-08-31T06:13:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 1 -- 172.21.15.53:0/569686423 shutdown_connections 2024-08-31T06:13:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56134f4fd1b0 0x56134f92b430 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56134f4dc4d0 0x56134f9212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134f4d42f0 0x56134f8b22f0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69c6ff5640 0 client.18264 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 1 --2- 172.21.15.53:0/569686423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56134f4bbd80 0x56134f8b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 1 -- 172.21.15.53:0/569686423 >> 172.21.15.53:0/569686423 conn(0x56134f4f1300 msgr2=0x56134f8a5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 1 -- 172.21.15.53:0/569686423 shutdown_connections 2024-08-31T06:13:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 1 -- 172.21.15.53:0/569686423 wait complete. 2024-08-31T06:13:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.501+0000 7f69effc4740 20 client.18264 trim_cache size 0 max 16384 2024-08-31T06:13:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:13:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:13:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:13:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 -- 172.21.15.53:0/2454393392 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69cc0b4ca0 msgr2=0x7f69cc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69cc0b4ca0 0x7f69cc0b71b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009fd0 tx=0x7f69d4005f90 comp rx=0 tx=0).stop 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 -- 172.21.15.53:0/2454393392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e4108080 msgr2=0x7f69e419a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e4108080 0x7f69e419a6e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f69d802a930 tx=0x7f69d8005e10 comp rx=0 tx=0).stop 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 -- 172.21.15.53:0/2454393392 shutdown_connections 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69cc0b4ca0 0x7f69cc0b71b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69e41089d0 0x7f69e419f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e4108080 0x7f69e419a6e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 --2- 172.21.15.53:0/2454393392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69e4102750 0x7f69e419a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 -- 172.21.15.53:0/2454393392 >> 172.21.15.53:0/2454393392 conn(0x7f69e407a4e0 msgr2=0x7f69e4106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 -- 172.21.15.53:0/2454393392 shutdown_connections 2024-08-31T06:13:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:32.502+0000 7f69e9053640 1 -- 172.21.15.53:0/2454393392 wait complete. 2024-08-31T06:13:32.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:32 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:32.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:32 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:32.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:32 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:32.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 148746 1.61 MB/sec execute 322 sec latency 105.796 ms 2024-08-31T06:13:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:33 smithi130 ceph-mon[22266]: pgmap v587: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 504 KiB/s wr, 68 op/s 2024-08-31T06:13:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:33 smithi153 ceph-mon[22320]: pgmap v587: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 504 KiB/s wr, 68 op/s 2024-08-31T06:13:33.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:33 smithi053 ceph-mon[18924]: pgmap v587: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 504 KiB/s wr, 68 op/s 2024-08-31T06:13:33.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 149074 1.62 MB/sec execute 323 sec latency 152.230 ms 2024-08-31T06:13:34.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 149074 1.61 MB/sec execute 324 sec latency 1152.294 ms 2024-08-31T06:13:35.881 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:35 smithi130 ceph-mon[22266]: pgmap v588: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 644 KiB/s wr, 84 op/s 2024-08-31T06:13:35.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:35 smithi153 ceph-mon[22320]: pgmap v588: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 644 KiB/s wr, 84 op/s 2024-08-31T06:13:35.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:35 smithi053 ceph-mon[18924]: pgmap v588: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 644 KiB/s wr, 84 op/s 2024-08-31T06:13:35.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 149074 1.61 MB/sec execute 325 sec latency 2152.400 ms 2024-08-31T06:13:36.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:13:36.289 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:36.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:36 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:36.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.784+0000 7f43b30e4640 1 -- 172.21.15.53:0/122985441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac109b90 msgr2=0x7f43ac1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.784+0000 7f43b30e4640 1 --2- 172.21.15.53:0/122985441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac109b90 0x7f43ac1103c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009ca0 tx=0x7f43a402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.785+0000 7f43b30e4640 1 -- 172.21.15.53:0/122985441 shutdown_connections 2024-08-31T06:13:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.785+0000 7f43b30e4640 1 --2- 172.21.15.53:0/122985441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac109b90 0x7f43ac1103c0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.785+0000 7f43b30e4640 1 --2- 172.21.15.53:0/122985441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43ac109240 0x7f43ac109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.785+0000 7f43b30e4640 1 --2- 172.21.15.53:0/122985441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43ac103900 0x7f43ac103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.785+0000 7f43b30e4640 1 -- 172.21.15.53:0/122985441 >> 172.21.15.53:0/122985441 conn(0x7f43ac07b5f0 msgr2=0x7f43ac07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.785+0000 7f43b30e4640 1 -- 172.21.15.53:0/122985441 shutdown_connections 2024-08-31T06:13:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.785+0000 7f43b30e4640 1 -- 172.21.15.53:0/122985441 wait complete. 2024-08-31T06:13:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.785+0000 7f43b30e4640 1 Processor -- start 2024-08-31T06:13:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.785+0000 7f43b30e4640 1 -- start start 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43b30e4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43ac103900 0x7f43ac0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43b30e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac109240 0x7f43ac0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43b30e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43ac109b90 0x7f43ac075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43b30e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac113750 con 0x7f43ac109240 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43b30e4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1135d0 con 0x7f43ac103900 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43b30e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1138d0 con 0x7f43ac109b90 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43abfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac109240 0x7f43ac0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43abfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac109240 0x7f43ac0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40716/0 (socket says 172.21.15.53:40716) 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43abfff640 1 -- 172.21.15.53:0/415814556 learned_addr learned my addr 172.21.15.53:0/415814556 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43b1681640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43ac109b90 0x7f43ac075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43b0e80640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43ac103900 0x7f43ac0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43abfff640 1 -- 172.21.15.53:0/415814556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43ac109b90 msgr2=0x7f43ac075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43abfff640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43ac109b90 0x7f43ac075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43abfff640 1 -- 172.21.15.53:0/415814556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43ac103900 msgr2=0x7f43ac0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43abfff640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43ac103900 0x7f43ac0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43abfff640 1 -- 172.21.15.53:0/415814556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac1a83e0 con 0x7f43ac109240 2024-08-31T06:13:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43abfff640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac109240 0x7f43ac0759f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f439800d740 tx=0x7f439800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43a9ffb640 1 -- 172.21.15.53:0/415814556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4398017070 con 0x7f43ac109240 2024-08-31T06:13:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.786+0000 7f43a9ffb640 1 -- 172.21.15.53:0/415814556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f439800de50 con 0x7f43ac109240 2024-08-31T06:13:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.787+0000 7f43b30e4640 1 -- 172.21.15.53:0/415814556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ac1a86d0 con 0x7f43ac109240 2024-08-31T06:13:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.787+0000 7f43a9ffb640 1 -- 172.21.15.53:0/415814556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439800f620 con 0x7f43ac109240 2024-08-31T06:13:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.787+0000 7f43b30e4640 1 -- 172.21.15.53:0/415814556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ac1a8c60 con 0x7f43ac109240 2024-08-31T06:13:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.789+0000 7f43b9659740 1 Processor -- start 2024-08-31T06:13:36.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.789+0000 7f43b9659740 1 -- start start 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.789+0000 7f43a9ffb640 1 -- 172.21.15.53:0/415814556 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f439801a070 con 0x7f43ac109240 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.789+0000 7f43b9659740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 0x5649962b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b9659740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995ee51b0 0x5649962b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b9659740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 0x5649962b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b9659740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56499622a630 con 0x564995eed390 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b9659740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564996219bc0 con 0x564995ee51b0 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b9659740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56499621db70 con 0x564995f0e070 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b1681640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 0x5649962b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b1681640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 0x5649962b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56656/0 (socket says 172.21.15.53:56656) 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b1681640 1 -- 172.21.15.53:0/1082206336 learned_addr learned my addr 172.21.15.53:0/1082206336 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43abfff640 1 --2- 172.21.15.53:0/1082206336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 0x5649962b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b0e80640 1 --2- 172.21.15.53:0/1082206336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995ee51b0 0x5649962b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b1681640 1 -- 172.21.15.53:0/1082206336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995ee51b0 msgr2=0x5649962b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b1681640 1 --2- 172.21.15.53:0/1082206336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995ee51b0 0x5649962b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b1681640 1 -- 172.21.15.53:0/1082206336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 msgr2=0x5649962b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b1681640 1 --2- 172.21.15.53:0/1082206336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 0x5649962b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b1681640 1 -- 172.21.15.53:0/1082206336 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564995f79650 con 0x564995f0e070 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43abfff640 1 --2- 172.21.15.53:0/1082206336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 0x5649962b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43b1681640 1 --2- 172.21.15.53:0/1082206336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 0x5649962b3300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009ca0 tx=0x7f43a4031500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccc9b3c3694e6390 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f43a9ffb640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f439c0b4d20 0x7f439c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.790+0000 7f4396ffd640 1 -- 172.21.15.53:0/1082206336 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a40317b0 con 0x564995f0e070 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f4396ffd640 1 -- 172.21.15.53:0/1082206336 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43a4036030 con 0x564995f0e070 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f4396ffd640 1 -- 172.21.15.53:0/1082206336 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4004530 con 0x564995f0e070 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f43b0e80640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f439c0b4d20 0x7f439c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f43a9ffb640 1 -- 172.21.15.53:0/415814556 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f43980e4ec0 con 0x7f43ac109240 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f43b9659740 1 -- 172.21.15.53:0/1082206336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 msgr2=0x5649962b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f43b0e80640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f439c0b4d20 0x7f439c0b7230 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x5649962b1f80 tx=0x7f43a000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f43b9659740 1 --2- 172.21.15.53:0/1082206336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 0x5649962b3300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009ca0 tx=0x7f43a4031500 comp rx=0 tx=0).stop 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f43b9659740 1 -- 172.21.15.53:0/1082206336 shutdown_connections 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f43b9659740 1 --2- 172.21.15.53:0/1082206336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 0x5649962b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f43b9659740 1 --2- 172.21.15.53:0/1082206336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995ee51b0 0x5649962b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f43b9659740 1 --2- 172.21.15.53:0/1082206336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 0x5649962b3300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.791+0000 7f43b9659740 1 -- 172.21.15.53:0/1082206336 >> 172.21.15.53:0/1082206336 conn(0x564995f02460 msgr2=0x5649962b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.792+0000 7f43b9659740 1 -- 172.21.15.53:0/1082206336 shutdown_connections 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.792+0000 7f43b9659740 1 -- 172.21.15.53:0/1082206336 wait complete. 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.792+0000 7f43b9659740 1 -- start start 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.792+0000 7f43b9659740 1 Processor -- start 2024-08-31T06:13:36.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.792+0000 7f43b9659740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995ee51b0 0x5649962beaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.792+0000 7f43b9659740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 0x5649962befe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.792+0000 7f43b9659740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 0x5649962cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b9659740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56499607c700 con 0x564995ee51b0 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b9659740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5649961a0700 con 0x564995eed390 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b9659740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5649962c1900 con 0x564995f0e070 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b9659740 10 client.0 _ll_register_callbacks cb 0x5649961cfdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b0e80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995ee51b0 0x5649962beaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b0e80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995ee51b0 0x5649962beaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40730/0 (socket says 172.21.15.53:40730) 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b0e80640 1 -- 172.21.15.53:0/1419818387 learned_addr learned my addr 172.21.15.53:0/1419818387 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b1681640 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 0x5649962cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43abfff640 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 0x5649962befe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b0e80640 1 -- 172.21.15.53:0/1419818387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 msgr2=0x5649962cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:36.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b0e80640 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 0x5649962cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b0e80640 1 -- 172.21.15.53:0/1419818387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 msgr2=0x5649962befe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b0e80640 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 0x5649962befe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b0e80640 1 -- 172.21.15.53:0/1419818387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649961d98b0 con 0x564995ee51b0 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b1681640 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 0x5649962cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43abfff640 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 0x5649962befe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b0e80640 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995ee51b0 0x5649962beaa0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f43a001c8b0 tx=0x7f43a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d832323fae3cb4c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f438bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f438bfff640 1 -- 172.21.15.53:0/1419818387 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0004020 con 0x564995ee51b0 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f438bfff640 1 -- 172.21.15.53:0/1419818387 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f43a0016030 con 0x564995ee51b0 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.793+0000 7f43b9659740 1 -- 172.21.15.53:0/1419818387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43a4036030 con 0x564995ee51b0 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f438bfff640 1 -- 172.21.15.53:0/1419818387 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f43a00041c0 con 0x564995ee51b0 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f43b9659740 10 client.18276 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:36.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f43b9659740 1 -- 172.21.15.53:0/1419818387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5649962cd790 con 0x564995ee51b0 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f438bfff640 1 -- 172.21.15.53:0/1419818387 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43a4036030 con 0x564995ee51b0 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f438bfff640 1 -- 172.21.15.53:0/1419818387 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f43a00049d0 con 0x564995ee51b0 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f43b9659740 10 client.18276 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f43b9659740 10 client.18276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f43b9659740 20 client.18276 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f43b9659740 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564995ecc9f0 0x5649962d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f43b9659740 4 client.18276 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f43b9659740 1 -- 172.21.15.53:0/1419818387 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56499622c580 con 0x564995ecc9f0 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.794+0000 7f43abfff640 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564995ecc9f0 0x5649962d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.795+0000 7f43abfff640 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564995ecc9f0 0x5649962d0d40 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00372d944c7932c server_cookie=fa33ea1963d08aa7 in_seq=0 out_seq=0 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.795+0000 7f438bfff640 10 client.18276 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.795+0000 7f438bfff640 1 -- 172.21.15.53:0/1419818387 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56499622c580 con 0x564995ecc9f0 2024-08-31T06:13:36.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.795+0000 7f438bfff640 10 client.18276 handle_command_reply: tid=0 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 1 client.18276 shutdown 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 1 -- 172.21.15.53:0/1419818387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995ee51b0 msgr2=0x5649962beaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995ee51b0 0x5649962beaa0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f43a001c8b0 tx=0x7f43a0004730 comp rx=0 tx=0).stop 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 1 -- 172.21.15.53:0/1419818387 shutdown_connections 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564995ecc9f0 0x5649962d0d40 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995f0e070 0x5649962cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 0x5649962befe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 1 --2- 172.21.15.53:0/1419818387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995ee51b0 0x5649962beaa0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f438bfff640 0 client.18276 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 1 -- 172.21.15.53:0/1419818387 >> 172.21.15.53:0/1419818387 conn(0x564995f02460 msgr2=0x5649962b6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 1 -- 172.21.15.53:0/1419818387 shutdown_connections 2024-08-31T06:13:36.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 1 -- 172.21.15.53:0/1419818387 wait complete. 2024-08-31T06:13:36.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.796+0000 7f43b9659740 20 client.18276 trim_cache size 0 max 16384 2024-08-31T06:13:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.813+0000 7f43b9659740 1 Processor -- start 2024-08-31T06:13:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.813+0000 7f43b9659740 1 -- start start 2024-08-31T06:13:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b9659740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995ee51b0 0x5649962bef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b9659740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 0x5649962cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b9659740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995f0e070 0x5649962cb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b9659740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1b1740 con 0x564995f0e070 2024-08-31T06:13:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b9659740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1b33a0 con 0x564995eed390 2024-08-31T06:13:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b9659740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1b1e10 con 0x564995ee51b0 2024-08-31T06:13:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b1681640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995f0e070 0x5649962cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b1681640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995f0e070 0x5649962cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40734/0 (socket says 172.21.15.53:40734) 2024-08-31T06:13:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b1681640 1 -- 172.21.15.53:0/3126540419 learned_addr learned my addr 172.21.15.53:0/3126540419 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43abfff640 1 --2- 172.21.15.53:0/3126540419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 0x5649962cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b0e80640 1 --2- 172.21.15.53:0/3126540419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995ee51b0 0x5649962bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b1681640 1 -- 172.21.15.53:0/3126540419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995ee51b0 msgr2=0x5649962bef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b1681640 1 --2- 172.21.15.53:0/3126540419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995ee51b0 0x5649962bef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b1681640 1 -- 172.21.15.53:0/3126540419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 msgr2=0x5649962cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b1681640 1 --2- 172.21.15.53:0/3126540419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 0x5649962cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b1681640 1 -- 172.21.15.53:0/3126540419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649962ac590 con 0x564995f0e070 2024-08-31T06:13:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43abfff640 1 --2- 172.21.15.53:0/3126540419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 0x5649962cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:36.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.814+0000 7f43b1681640 1 --2- 172.21.15.53:0/3126540419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995f0e070 0x5649962cb060 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009ca0 tx=0x7f43a4004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc628a7781845be server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:36.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43967fc640 1 -- 172.21.15.53:0/3126540419 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a404a040 con 0x564995f0e070 2024-08-31T06:13:36.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43967fc640 1 -- 172.21.15.53:0/3126540419 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43a4036040 con 0x564995f0e070 2024-08-31T06:13:36.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43967fc640 1 -- 172.21.15.53:0/3126540419 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4003e70 con 0x564995f0e070 2024-08-31T06:13:36.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43b9659740 1 -- 172.21.15.53:0/3126540419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995f0e070 msgr2=0x5649962cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:36.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43b9659740 1 --2- 172.21.15.53:0/3126540419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995f0e070 0x5649962cb060 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009ca0 tx=0x7f43a4004170 comp rx=0 tx=0).stop 2024-08-31T06:13:36.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43b9659740 1 -- 172.21.15.53:0/3126540419 shutdown_connections 2024-08-31T06:13:36.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43b9659740 1 --2- 172.21.15.53:0/3126540419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995f0e070 0x5649962cb060 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43b9659740 1 --2- 172.21.15.53:0/3126540419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995eed390 0x5649962cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43b9659740 1 --2- 172.21.15.53:0/3126540419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995ee51b0 0x5649962bef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43b9659740 1 -- 172.21.15.53:0/3126540419 >> 172.21.15.53:0/3126540419 conn(0x564995f02460 msgr2=0x5649962be850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:36.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43b9659740 1 -- 172.21.15.53:0/3126540419 shutdown_connections 2024-08-31T06:13:36.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.815+0000 7f43b9659740 1 -- 172.21.15.53:0/3126540419 wait complete. 2024-08-31T06:13:36.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.816+0000 7f43b9659740 1 -- start start 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.816+0000 7f43b9659740 1 Processor -- start 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.816+0000 7f43b9659740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995ee51b0 0x5649962c7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.816+0000 7f43b9659740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 0x5649962c2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.816+0000 7f43b9659740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995f0e070 0x5649962c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.816+0000 7f43b9659740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1b2c10 con 0x564995eed390 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.816+0000 7f43b9659740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1b24e0 con 0x564995f0e070 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.816+0000 7f43b9659740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1af740 con 0x564995ee51b0 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.816+0000 7f43b9659740 10 client.0 _ll_register_callbacks cb 0x7f43a000a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.816+0000 7f43abfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 0x5649962c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43abfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 0x5649962c2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40744/0 (socket says 172.21.15.53:40744) 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43abfff640 1 -- 172.21.15.53:0/2883277353 learned_addr learned my addr 172.21.15.53:0/2883277353 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43b0e80640 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995ee51b0 0x5649962c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43b1681640 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995f0e070 0x5649962c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43abfff640 1 -- 172.21.15.53:0/2883277353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995ee51b0 msgr2=0x5649962c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43abfff640 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995ee51b0 0x5649962c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43abfff640 1 -- 172.21.15.53:0/2883277353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995f0e070 msgr2=0x5649962c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43abfff640 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995f0e070 0x5649962c2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43abfff640 1 -- 172.21.15.53:0/2883277353 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649962c3370 con 0x564995eed390 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43abfff640 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 0x5649962c2740 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f43980e2bf0 tx=0x7f4398005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c1d2e978f5d28f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f438bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f438bfff640 1 -- 172.21.15.53:0/2883277353 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4398021040 con 0x564995eed390 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f438bfff640 1 -- 172.21.15.53:0/2883277353 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f43980a78d0 con 0x564995eed390 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43b9659740 1 -- 172.21.15.53:0/2883277353 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43a4036040 con 0x564995eed390 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f438bfff640 1 -- 172.21.15.53:0/2883277353 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f43980e8520 con 0x564995eed390 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43b9659740 10 client.18282 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.817+0000 7f43b9659740 1 -- 172.21.15.53:0/2883277353 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56499633b5b0 con 0x564995eed390 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.818+0000 7f438bfff640 1 -- 172.21.15.53:0/2883277353 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43a4036040 con 0x564995eed390 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.818+0000 7f438bfff640 1 -- 172.21.15.53:0/2883277353 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f43980d20c0 con 0x564995eed390 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.818+0000 7f43b9659740 10 client.18282 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.818+0000 7f43b9659740 10 client.18282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.818+0000 7f43b9659740 20 client.18282 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.818+0000 7f43b9659740 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564995ea1da0 0x56499633ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.818+0000 7f43b9659740 4 client.18282 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.818+0000 7f43b9659740 1 -- 172.21.15.53:0/2883277353 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564996228020 con 0x564995ea1da0 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.818+0000 7f43b0e80640 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564995ea1da0 0x56499633ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f438bfff640 10 client.18282 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b0e80640 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564995ea1da0 0x56499633ddb0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=857e328faa5c6074 server_cookie=70853ff3363f90e7 in_seq=0 out_seq=0 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f438bfff640 1 -- 172.21.15.53:0/2883277353 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x564996228020 con 0x564995ea1da0 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f438bfff640 10 client.18282 handle_command_reply: tid=0 2024-08-31T06:13:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 1 client.18282 shutdown 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 1 -- 172.21.15.53:0/2883277353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 msgr2=0x5649962c2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 0x5649962c2740 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f43980e2bf0 tx=0x7f4398005cc0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 1 -- 172.21.15.53:0/2883277353 shutdown_connections 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564995ea1da0 0x56499633ddb0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564995f0e070 0x5649962c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564995eed390 0x5649962c2740 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f438bfff640 0 client.18282 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 1 --2- 172.21.15.53:0/2883277353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564995ee51b0 0x5649962c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 1 -- 172.21.15.53:0/2883277353 >> 172.21.15.53:0/2883277353 conn(0x564995f02460 msgr2=0x5649962bff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 1 -- 172.21.15.53:0/2883277353 shutdown_connections 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 1 -- 172.21.15.53:0/2883277353 wait complete. 2024-08-31T06:13:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.819+0000 7f43b9659740 20 client.18282 trim_cache size 0 max 16384 2024-08-31T06:13:36.828 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:13:36.828 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:13:36.828 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:13:36.828 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:13:36.828 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:13:36.828 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:13:36.828 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:36.828 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:36.828 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:36.828 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:13:36.829 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:36.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:36.831 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:36.832 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:36.833 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:36.834 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:36.835 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:36.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:13:36.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:13:36.835 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:13:36.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 -- 172.21.15.53:0/415814556 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f439c0b4d20 msgr2=0x7f439c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:36.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f439c0b4d20 0x7f439c0b7230 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x5649962b1f80 tx=0x7f43a000a2d0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 -- 172.21.15.53:0/415814556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac109240 msgr2=0x7f43ac0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:36.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac109240 0x7f43ac0759f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f439800d740 tx=0x7f439800dc00 comp rx=0 tx=0).stop 2024-08-31T06:13:36.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 -- 172.21.15.53:0/415814556 shutdown_connections 2024-08-31T06:13:36.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f439c0b4d20 0x7f439c0b7230 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43ac109b90 0x7f43ac075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac109240 0x7f43ac0759f0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 --2- 172.21.15.53:0/415814556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43ac103900 0x7f43ac0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:36.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 -- 172.21.15.53:0/415814556 >> 172.21.15.53:0/415814556 conn(0x7f43ac07b5f0 msgr2=0x7f43ac1072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:36.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 -- 172.21.15.53:0/415814556 shutdown_connections 2024-08-31T06:13:36.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:36.820+0000 7f43b30e4640 1 -- 172.21.15.53:0/415814556 wait complete. 2024-08-31T06:13:36.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:36 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:36.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:36 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:36.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 149141 1.60 MB/sec execute 326 sec latency 2410.659 ms 2024-08-31T06:13:37.656 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:13:37.657 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:13:37.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:37 smithi053 ceph-mon[18924]: pgmap v589: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 978 KiB/s wr, 102 op/s 2024-08-31T06:13:37.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:37 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:37.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:37 smithi130 ceph-mon[22266]: pgmap v589: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 978 KiB/s wr, 102 op/s 2024-08-31T06:13:37.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:37 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:37.911 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:37.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:37 smithi153 ceph-mon[22320]: pgmap v589: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 978 KiB/s wr, 102 op/s 2024-08-31T06:13:37.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:37 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:13:37.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 149141 1.60 MB/sec execute 327 sec latency 1501.706 ms 2024-08-31T06:13:38.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.371+0000 7f0141193640 1 -- 172.21.15.53:0/1600238565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f013c1092a0 msgr2=0x7f013c1096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:38.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.371+0000 7f0141193640 1 --2- 172.21.15.53:0/1600238565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f013c1092a0 0x7f013c1096b0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f0130009900 tx=0x7f013002a410 comp rx=0 tx=0).stop 2024-08-31T06:13:38.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.371+0000 7f0141193640 1 -- 172.21.15.53:0/1600238565 shutdown_connections 2024-08-31T06:13:38.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.371+0000 7f0141193640 1 --2- 172.21.15.53:0/1600238565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f013c109bf0 0x7f013c110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:38.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.371+0000 7f0141193640 1 --2- 172.21.15.53:0/1600238565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f013c1092a0 0x7f013c1096b0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:38.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.371+0000 7f0141193640 1 --2- 172.21.15.53:0/1600238565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013c101d60 0x7f013c102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:38.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.371+0000 7f0141193640 1 -- 172.21.15.53:0/1600238565 >> 172.21.15.53:0/1600238565 conn(0x7f013c079d30 msgr2=0x7f013c07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:38.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.371+0000 7f0141193640 1 -- 172.21.15.53:0/1600238565 shutdown_connections 2024-08-31T06:13:38.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.371+0000 7f0141193640 1 -- 172.21.15.53:0/1600238565 wait complete. 2024-08-31T06:13:38.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.372+0000 7f0141193640 1 Processor -- start 2024-08-31T06:13:38.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.372+0000 7f0141193640 1 -- start start 2024-08-31T06:13:38.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.372+0000 7f0141193640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f013c101d60 0x7f013c19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.372+0000 7f0141193640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013c1092a0 0x7f013c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.372+0000 7f0141193640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f013c109bf0 0x7f013c19f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.372+0000 7f0141193640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f013c113760 con 0x7f013c101d60 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.372+0000 7f0141193640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1135e0 con 0x7f013c109bf0 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.372+0000 7f0141193640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1138e0 con 0x7f013c1092a0 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.372+0000 7f013ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f013c101d60 0x7f013c19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f013ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f013c101d60 0x7f013c19a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40760/0 (socket says 172.21.15.53:40760) 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f013ad9d640 1 -- 172.21.15.53:0/4117301919 learned_addr learned my addr 172.21.15.53:0/4117301919 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f013a59c640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013c1092a0 0x7f013c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f013b59e640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f013c109bf0 0x7f013c19f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f013ad9d640 1 -- 172.21.15.53:0/4117301919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013c1092a0 msgr2=0x7f013c19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f013ad9d640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013c1092a0 0x7f013c19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:38.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f013ad9d640 1 -- 172.21.15.53:0/4117301919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f013c109bf0 msgr2=0x7f013c19f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f013ad9d640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f013c109bf0 0x7f013c19f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f013ad9d640 1 -- 172.21.15.53:0/4117301919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c1a0060 con 0x7f013c101d60 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f013b59e640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f013c109bf0 0x7f013c19f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f013ad9d640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f013c101d60 0x7f013c19a1b0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f012c00d770 tx=0x7f012c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f0123fff640 1 -- 172.21.15.53:0/4117301919 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c017070 con 0x7f013c101d60 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f0141193640 1 -- 172.21.15.53:0/4117301919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013c1a0350 con 0x7f013c101d60 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f0141193640 1 -- 172.21.15.53:0/4117301919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013c1a6b70 con 0x7f013c101d60 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f0123fff640 1 -- 172.21.15.53:0/4117301919 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f012c0054b0 con 0x7f013c101d60 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.373+0000 7f0123fff640 1 -- 172.21.15.53:0/4117301919 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c020060 con 0x7f013c101d60 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.374+0000 7f0141193640 1 -- 172.21.15.53:0/4117301919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0128005290 con 0x7f013c101d60 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.376+0000 7f0123fff640 1 -- 172.21.15.53:0/4117301919 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f012c009c30 con 0x7f013c101d60 2024-08-31T06:13:38.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.376+0000 7f0123fff640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4cd0 0x7f01240b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:38.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.377+0000 7f0123fff640 1 -- 172.21.15.53:0/4117301919 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f012c0e5270 con 0x7f013c101d60 2024-08-31T06:13:38.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.377+0000 7f013a59c640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4cd0 0x7f01240b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:38.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.377+0000 7f013a59c640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4cd0 0x7f01240b71e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0130005940 tx=0x7f01300058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:38.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.380+0000 7f0123fff640 1 -- 172.21.15.53:0/4117301919 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f012c0ac040 con 0x7f013c101d60 2024-08-31T06:13:38.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.601+0000 7f0141193640 1 -- 172.21.15.53:0/4117301919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0128005580 con 0x7f013c101d60 2024-08-31T06:13:38.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.604+0000 7f0123fff640 1 -- 172.21.15.53:0/4117301919 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11998 (secure 0 0 0) 0x7f012c0ab940 con 0x7f013c101d60 2024-08-31T06:13:38.607 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:13:38.607 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":42,"btime":"2024-08-31T06:13:36:595057+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:13:36.368421+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:13:38.607 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 42 2024-08-31T06:13:38.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.606+0000 7f0141193640 1 -- 172.21.15.53:0/4117301919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4cd0 msgr2=0x7f01240b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:38.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.607+0000 7f0141193640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4cd0 0x7f01240b71e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0130005940 tx=0x7f01300058d0 comp rx=0 tx=0).stop 2024-08-31T06:13:38.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.607+0000 7f0141193640 1 -- 172.21.15.53:0/4117301919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f013c101d60 msgr2=0x7f013c19a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.607+0000 7f0141193640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f013c101d60 0x7f013c19a1b0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f012c00d770 tx=0x7f012c00dc30 comp rx=0 tx=0).stop 2024-08-31T06:13:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.607+0000 7f0141193640 1 -- 172.21.15.53:0/4117301919 shutdown_connections 2024-08-31T06:13:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.607+0000 7f0141193640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4cd0 0x7f01240b71e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.607+0000 7f0141193640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f013c109bf0 0x7f013c19f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.607+0000 7f0141193640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013c1092a0 0x7f013c19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.607+0000 7f0141193640 1 --2- 172.21.15.53:0/4117301919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f013c101d60 0x7f013c19a1b0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.607+0000 7f0141193640 1 -- 172.21.15.53:0/4117301919 >> 172.21.15.53:0/4117301919 conn(0x7f013c079d30 msgr2=0x7f013c105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.607+0000 7f0141193640 1 -- 172.21.15.53:0/4117301919 shutdown_connections 2024-08-31T06:13:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:38.607+0000 7f0141193640 1 -- 172.21.15.53:0/4117301919 wait complete. 2024-08-31T06:13:38.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 149141 1.59 MB/sec execute 328 sec latency 2501.799 ms 2024-08-31T06:13:39.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:13:39.654 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:39.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:39 smithi053 ceph-mon[18924]: pgmap v590: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 990 KiB/s wr, 102 op/s 2024-08-31T06:13:39.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:39 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4117301919' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:13:39.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:39 smithi130 ceph-mon[22266]: pgmap v590: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 990 KiB/s wr, 102 op/s 2024-08-31T06:13:39.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:39 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4117301919' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:13:39.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:39 smithi153 ceph-mon[22320]: pgmap v590: 97 pgs: 97 active+clean; 85 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 990 KiB/s wr, 102 op/s 2024-08-31T06:13:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:39 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4117301919' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:13:39.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 149141 1.59 MB/sec execute 329 sec latency 3501.890 ms 2024-08-31T06:13:40.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.149+0000 7f9608568640 1 -- 172.21.15.53:0/2841410175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9600109b90 msgr2=0x7f96001103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:40.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.149+0000 7f9608568640 1 --2- 172.21.15.53:0/2841410175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9600109b90 0x7f96001103c0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009ca0 tx=0x7f95f802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.149+0000 7f9608568640 1 -- 172.21.15.53:0/2841410175 shutdown_connections 2024-08-31T06:13:40.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.149+0000 7f9608568640 1 --2- 172.21.15.53:0/2841410175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9600109b90 0x7f96001103c0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.149+0000 7f9608568640 1 --2- 172.21.15.53:0/2841410175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600109240 0x7f9600109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.149+0000 7f9608568640 1 --2- 172.21.15.53:0/2841410175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9600103900 0x7f9600103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.149+0000 7f9608568640 1 -- 172.21.15.53:0/2841410175 >> 172.21.15.53:0/2841410175 conn(0x7f960007b5f0 msgr2=0x7f960007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.149+0000 7f9608568640 1 -- 172.21.15.53:0/2841410175 shutdown_connections 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.149+0000 7f9608568640 1 -- 172.21.15.53:0/2841410175 wait complete. 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.149+0000 7f9608568640 1 Processor -- start 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9608568640 1 -- start start 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9608568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9600103900 0x7f96000754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9608568640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600109240 0x7f96000759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9608568640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9600109b90 0x7f9600075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9608568640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9600113750 con 0x7f9600103900 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9608568640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f96001135d0 con 0x7f9600109b90 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9608568640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96001138d0 con 0x7f9600109240 2024-08-31T06:13:40.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9606304640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9600103900 0x7f96000754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9606304640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9600103900 0x7f96000754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40778/0 (socket says 172.21.15.53:40778) 2024-08-31T06:13:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9606304640 1 -- 172.21.15.53:0/3081726897 learned_addr learned my addr 172.21.15.53:0/3081726897 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9605b03640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600109240 0x7f96000759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9606b05640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9600109b90 0x7f9600075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9606304640 1 -- 172.21.15.53:0/3081726897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600109240 msgr2=0x7f96000759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9606304640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600109240 0x7f96000759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9606304640 1 -- 172.21.15.53:0/3081726897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9600109b90 msgr2=0x7f9600075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9606304640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9600109b90 0x7f9600075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9606304640 1 -- 172.21.15.53:0/3081726897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96001a8330 con 0x7f9600103900 2024-08-31T06:13:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9605b03640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600109240 0x7f96000759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.150+0000 7f9606b05640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9600109b90 0x7f9600075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.151+0000 7f9606304640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9600103900 0x7f96000754b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c920 tx=0x7f95fc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.151+0000 7f95f77fe640 1 -- 172.21.15.53:0/3081726897 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc007c70 con 0x7f9600103900 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.151+0000 7f95f77fe640 1 -- 172.21.15.53:0/3081726897 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95fc007e10 con 0x7f9600103900 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.151+0000 7f9608568640 1 -- 172.21.15.53:0/3081726897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96001a8620 con 0x7f9600103900 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.151+0000 7f95f77fe640 1 -- 172.21.15.53:0/3081726897 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc018710 con 0x7f9600103900 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.151+0000 7f9608568640 1 -- 172.21.15.53:0/3081726897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96001a8bb0 con 0x7f9600103900 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.154+0000 7f95f77fe640 1 -- 172.21.15.53:0/3081726897 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f95fc00f450 con 0x7f9600103900 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.154+0000 7f960eadd740 1 Processor -- start 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.154+0000 7f960eadd740 1 -- start start 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f960eadd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45d3070 0x55b9f4978310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f960eadd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45aa1b0 0x55b9f4978850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f960eadd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f4978d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f960eadd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b9f48ef680 con 0x55b9f45d3070 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f960eadd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b9f48dec10 con 0x55b9f45b2390 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f960eadd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b9f48e2bc0 con 0x55b9f45aa1b0 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f95f77fe640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95ec0b4d20 0x7f95ec0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9606b05640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45d3070 0x55b9f4978310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9606b05640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45d3070 0x55b9f4978310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40794/0 (socket says 172.21.15.53:40794) 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9606b05640 1 -- 172.21.15.53:0/1322373969 learned_addr learned my addr 172.21.15.53:0/1322373969 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9606b05640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95ec0b4d20 0x7f95ec0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9605b03640 1 --2- 172.21.15.53:0/1322373969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f4978d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f95f77fe640 1 -- 172.21.15.53:0/3081726897 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f95fc0e57d0 con 0x7f9600103900 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9606304640 1 --2- 172.21.15.53:0/1322373969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45aa1b0 0x55b9f4978850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9606b05640 1 -- 172.21.15.53:0/1322373969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45aa1b0 msgr2=0x55b9f4978850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9606b05640 1 --2- 172.21.15.53:0/1322373969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45aa1b0 0x55b9f4978850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9606b05640 1 -- 172.21.15.53:0/1322373969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 msgr2=0x55b9f4978d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9606b05640 1 --2- 172.21.15.53:0/1322373969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f4978d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9606b05640 1 -- 172.21.15.53:0/1322373969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9f463e650 con 0x55b9f45d3070 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.155+0000 7f9606304640 1 --2- 172.21.15.53:0/1322373969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45aa1b0 0x55b9f4978850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.156+0000 7f9606b05640 1 --2- 172.21.15.53:0/1322373969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45d3070 0x55b9f4978310 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009590 tx=0x7f95f8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15103e456690ee8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.156+0000 7f9606b05640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95ec0b4d20 0x7f95ec0b7230 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f95f8003f80 tx=0x7f95f8042000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.156+0000 7f95f4ff9640 1 -- 172.21.15.53:0/1322373969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f804e070 con 0x55b9f45d3070 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.156+0000 7f95f4ff9640 1 -- 172.21.15.53:0/1322373969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95f8036050 con 0x55b9f45d3070 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.156+0000 7f95f4ff9640 1 -- 172.21.15.53:0/1322373969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8030a60 con 0x55b9f45d3070 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.157+0000 7f960eadd740 1 -- 172.21.15.53:0/1322373969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45d3070 msgr2=0x55b9f4978310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.157+0000 7f960eadd740 1 --2- 172.21.15.53:0/1322373969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45d3070 0x55b9f4978310 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009590 tx=0x7f95f8003f10 comp rx=0 tx=0).stop 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.157+0000 7f960eadd740 1 -- 172.21.15.53:0/1322373969 shutdown_connections 2024-08-31T06:13:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.157+0000 7f960eadd740 1 --2- 172.21.15.53:0/1322373969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f4978d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.157+0000 7f960eadd740 1 --2- 172.21.15.53:0/1322373969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45aa1b0 0x55b9f4978850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.157+0000 7f960eadd740 1 --2- 172.21.15.53:0/1322373969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45d3070 0x55b9f4978310 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.157+0000 7f960eadd740 1 -- 172.21.15.53:0/1322373969 >> 172.21.15.53:0/1322373969 conn(0x55b9f45c7460 msgr2=0x55b9f4976200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.157+0000 7f960eadd740 1 -- 172.21.15.53:0/1322373969 shutdown_connections 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.157+0000 7f960eadd740 1 -- 172.21.15.53:0/1322373969 wait complete. 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f960eadd740 1 -- start start 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f960eadd740 1 Processor -- start 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f960eadd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4983b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f960eadd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f4984150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f960eadd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45d3070 0x55b9f498fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f960eadd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b9f4741700 con 0x55b9f45aa1b0 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f960eadd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b9f4865750 con 0x55b9f45b2390 2024-08-31T06:13:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f960eadd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b9f4986a90 con 0x55b9f45d3070 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f960eadd740 10 client.0 _ll_register_callbacks cb 0x55b9f4894e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f9606304640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4983b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f9606304640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4983b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40796/0 (socket says 172.21.15.53:40796) 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.158+0000 7f9606304640 1 -- 172.21.15.53:0/2952656768 learned_addr learned my addr 172.21.15.53:0/2952656768 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f9605b03640 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f4984150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f9606b05640 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45d3070 0x55b9f498fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f9606304640 1 -- 172.21.15.53:0/2952656768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45d3070 msgr2=0x55b9f498fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f9606304640 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45d3070 0x55b9f498fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f9606304640 1 -- 172.21.15.53:0/2952656768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 msgr2=0x55b9f4984150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f9606304640 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f4984150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f9606304640 1 -- 172.21.15.53:0/2952656768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9f489e900 con 0x55b9f45aa1b0 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f9606b05640 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45d3070 0x55b9f498fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:13:40.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f9605b03640 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f4984150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f9606304640 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4983b70 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0a7ec0 tx=0x7f95fc0ac540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20d4d0e464a7c1d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f95e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2952656768 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0ae030 con 0x55b9f45aa1b0 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2952656768 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f95fc0a8430 con 0x55b9f45aa1b0 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f960eadd740 1 -- 172.21.15.53:0/2952656768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f8036050 con 0x55b9f45aa1b0 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2952656768 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f95fc0e3330 con 0x55b9f45aa1b0 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f960eadd740 10 client.18300 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f960eadd740 1 -- 172.21.15.53:0/2952656768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b9f49929b0 con 0x55b9f45aa1b0 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.159+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2952656768 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95f8036050 con 0x55b9f45aa1b0 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.160+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2952656768 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f95fc0930c0 con 0x55b9f45aa1b0 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.160+0000 7f960eadd740 10 client.18300 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.160+0000 7f960eadd740 10 client.18300 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:13:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.160+0000 7f960eadd740 20 client.18300 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.160+0000 7f960eadd740 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b9f45919f0 0x55b9f4995f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.160+0000 7f960eadd740 4 client.18300 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.160+0000 7f960eadd740 1 -- 172.21.15.53:0/2952656768 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9f48f15d0 con 0x55b9f45919f0 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.160+0000 7f9605b03640 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b9f45919f0 0x55b9f4995f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.161+0000 7f95e9ffb640 10 client.18300 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.161+0000 7f9605b03640 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b9f45919f0 0x55b9f4995f40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=82c8a22af8fd3320 server_cookie=7d511c20bad8cd54 in_seq=0 out_seq=0 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.161+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2952656768 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b9f48f15d0 con 0x55b9f45919f0 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.161+0000 7f95e9ffb640 10 client.18300 handle_command_reply: tid=0 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.161+0000 7f960eadd740 1 client.18300 shutdown 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.161+0000 7f960eadd740 1 -- 172.21.15.53:0/2952656768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 msgr2=0x55b9f4983b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.161+0000 7f960eadd740 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4983b70 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0a7ec0 tx=0x7f95fc0ac540 comp rx=0 tx=0).stop 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.162+0000 7f960eadd740 1 -- 172.21.15.53:0/2952656768 shutdown_connections 2024-08-31T06:13:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.162+0000 7f960eadd740 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b9f45919f0 0x55b9f4995f40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.162+0000 7f960eadd740 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45d3070 0x55b9f498fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.162+0000 7f960eadd740 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f4984150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.162+0000 7f95e9ffb640 0 client.18300 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.162+0000 7f960eadd740 1 --2- 172.21.15.53:0/2952656768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4983b70 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.162+0000 7f960eadd740 1 -- 172.21.15.53:0/2952656768 >> 172.21.15.53:0/2952656768 conn(0x55b9f45c7460 msgr2=0x55b9f497b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.162+0000 7f960eadd740 1 -- 172.21.15.53:0/2952656768 shutdown_connections 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.162+0000 7f960eadd740 1 -- 172.21.15.53:0/2952656768 wait complete. 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.162+0000 7f960eadd740 20 client.18300 trim_cache size 0 max 16384 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f960eadd740 1 Processor -- start 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f960eadd740 1 -- start start 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f960eadd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45919f0 0x55b9f4979a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f960eadd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f498fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f960eadd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f49901c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f960eadd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f96001b16b0 con 0x55b9f45aa1b0 2024-08-31T06:13:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f960eadd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f96001b3310 con 0x55b9f45b2390 2024-08-31T06:13:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f960eadd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96001b1d80 con 0x55b9f45919f0 2024-08-31T06:13:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f9605b03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f498fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f9605b03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f498fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40802/0 (socket says 172.21.15.53:40802) 2024-08-31T06:13:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f9605b03640 1 -- 172.21.15.53:0/2061438828 learned_addr learned my addr 172.21.15.53:0/2061438828 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f9606304640 1 --2- 172.21.15.53:0/2061438828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45919f0 0x55b9f4979a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.175+0000 7f9606b05640 1 --2- 172.21.15.53:0/2061438828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f49901c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.176+0000 7f9605b03640 1 -- 172.21.15.53:0/2061438828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45919f0 msgr2=0x55b9f4979a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.176+0000 7f9605b03640 1 --2- 172.21.15.53:0/2061438828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45919f0 0x55b9f4979a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.176+0000 7f9605b03640 1 -- 172.21.15.53:0/2061438828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 msgr2=0x55b9f49901c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.176+0000 7f9605b03640 1 --2- 172.21.15.53:0/2061438828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f49901c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.176+0000 7f9605b03640 1 -- 172.21.15.53:0/2061438828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9f497a600 con 0x55b9f45aa1b0 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.176+0000 7f9605b03640 1 --2- 172.21.15.53:0/2061438828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f498fc80 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f960006c790 tx=0x7f95f000c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69431bfbc4ba841 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.176+0000 7f95ebfff640 1 -- 172.21.15.53:0/2061438828 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0005020 con 0x55b9f45aa1b0 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.176+0000 7f95ebfff640 1 -- 172.21.15.53:0/2061438828 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95f001e030 con 0x55b9f45aa1b0 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.176+0000 7f95ebfff640 1 -- 172.21.15.53:0/2061438828 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0011440 con 0x55b9f45aa1b0 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 -- 172.21.15.53:0/2061438828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 msgr2=0x55b9f498fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 --2- 172.21.15.53:0/2061438828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f498fc80 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f960006c790 tx=0x7f95f000c4f0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 -- 172.21.15.53:0/2061438828 shutdown_connections 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 --2- 172.21.15.53:0/2061438828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45b2390 0x55b9f49901c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 --2- 172.21.15.53:0/2061438828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f498fc80 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 --2- 172.21.15.53:0/2061438828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45919f0 0x55b9f4979a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 -- 172.21.15.53:0/2061438828 >> 172.21.15.53:0/2061438828 conn(0x55b9f45c7460 msgr2=0x55b9f4979340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 -- 172.21.15.53:0/2061438828 shutdown_connections 2024-08-31T06:13:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 -- 172.21.15.53:0/2061438828 wait complete. 2024-08-31T06:13:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 -- start start 2024-08-31T06:13:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 Processor -- start 2024-08-31T06:13:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45919f0 0x55b9f498c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4988830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45b2390 0x55b9f4988d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f96001b2b80 con 0x55b9f45aa1b0 2024-08-31T06:13:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f96001b2450 con 0x55b9f45919f0 2024-08-31T06:13:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96001af6b0 con 0x55b9f45b2390 2024-08-31T06:13:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f960eadd740 10 client.0 _ll_register_callbacks cb 0x7f95fc00a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.177+0000 7f9605b03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4988830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f9605b03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4988830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40806/0 (socket says 172.21.15.53:40806) 2024-08-31T06:13:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f9605b03640 1 -- 172.21.15.53:0/2658192138 learned_addr learned my addr 172.21.15.53:0/2658192138 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f9606304640 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45919f0 0x55b9f498c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f9606b05640 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45b2390 0x55b9f4988d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f9605b03640 1 -- 172.21.15.53:0/2658192138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45b2390 msgr2=0x55b9f4988d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f9605b03640 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45b2390 0x55b9f4988d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f9605b03640 1 -- 172.21.15.53:0/2658192138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45919f0 msgr2=0x55b9f498c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f9605b03640 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45919f0 0x55b9f498c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f9605b03640 1 -- 172.21.15.53:0/2658192138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9f49893b0 con 0x55b9f45aa1b0 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f9605b03640 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4988830 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f95f000cc60 tx=0x7f95f00132f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42152310eb0edea6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f95e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2658192138 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0004930 con 0x55b9f45aa1b0 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2658192138 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f95f0004020 con 0x55b9f45aa1b0 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f960eadd740 1 -- 172.21.15.53:0/2658192138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f001e030 con 0x55b9f45aa1b0 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2658192138 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f95f0004ad0 con 0x55b9f45aa1b0 2024-08-31T06:13:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f960eadd740 10 client.18306 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.178+0000 7f960eadd740 1 -- 172.21.15.53:0/2658192138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b9f4a01700 con 0x55b9f45aa1b0 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.179+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2658192138 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95f001e030 con 0x55b9f45aa1b0 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.179+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2658192138 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f95f0003680 con 0x55b9f45aa1b0 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.179+0000 7f960eadd740 10 client.18306 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.179+0000 7f960eadd740 10 client.18306 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.179+0000 7f960eadd740 20 client.18306 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.179+0000 7f960eadd740 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b9f45d3070 0x55b9f4a03ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.179+0000 7f960eadd740 4 client.18306 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.179+0000 7f960eadd740 1 -- 172.21.15.53:0/2658192138 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9f48ed070 con 0x55b9f45d3070 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.179+0000 7f9606304640 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b9f45d3070 0x55b9f4a03ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f95e9ffb640 10 client.18306 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f9606304640 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b9f45d3070 0x55b9f4a03ee0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b01e3c4e619c5c09 server_cookie=c4b9dc5bf98020e0 in_seq=0 out_seq=0 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f95e9ffb640 1 -- 172.21.15.53:0/2658192138 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9f48ed070 con 0x55b9f45d3070 2024-08-31T06:13:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f95e9ffb640 10 client.18306 handle_command_reply: tid=0 2024-08-31T06:13:40.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f960eadd740 1 client.18306 shutdown 2024-08-31T06:13:40.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f960eadd740 1 -- 172.21.15.53:0/2658192138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 msgr2=0x55b9f4988830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:40.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f960eadd740 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4988830 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f95f000cc60 tx=0x7f95f00132f0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f960eadd740 1 -- 172.21.15.53:0/2658192138 shutdown_connections 2024-08-31T06:13:40.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f960eadd740 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55b9f45d3070 0x55b9f4a03ee0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f960eadd740 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f45b2390 0x55b9f4988d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f960eadd740 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9f45aa1b0 0x55b9f4988830 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f95e9ffb640 0 client.18306 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:13:40.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f960eadd740 1 --2- 172.21.15.53:0/2658192138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9f45919f0 0x55b9f498c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f960eadd740 1 -- 172.21.15.53:0/2658192138 >> 172.21.15.53:0/2658192138 conn(0x55b9f45c7460 msgr2=0x55b9f497bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:40.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f960eadd740 1 -- 172.21.15.53:0/2658192138 shutdown_connections 2024-08-31T06:13:40.244 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:13:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.180+0000 7f960eadd740 1 -- 172.21.15.53:0/2658192138 wait complete. 2024-08-31T06:13:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f960eadd740 20 client.18306 trim_cache size 0 max 16384 2024-08-31T06:13:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 -- 172.21.15.53:0/3081726897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95ec0b4d20 msgr2=0x7f95ec0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95ec0b4d20 0x7f95ec0b7230 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f95f8003f80 tx=0x7f95f8042000 comp rx=0 tx=0).stop 2024-08-31T06:13:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 -- 172.21.15.53:0/3081726897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9600103900 msgr2=0x7f96000754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9600103900 0x7f96000754b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c920 tx=0x7f95fc00cde0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 -- 172.21.15.53:0/3081726897 shutdown_connections 2024-08-31T06:13:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95ec0b4d20 0x7f95ec0b7230 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9600109b90 0x7f9600075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9600109240 0x7f96000759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 --2- 172.21.15.53:0/3081726897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9600103900 0x7f96000754b0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 -- 172.21.15.53:0/3081726897 >> 172.21.15.53:0/3081726897 conn(0x7f960007b5f0 msgr2=0x7f96001072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 -- 172.21.15.53:0/3081726897 shutdown_connections 2024-08-31T06:13:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:40.181+0000 7f9608568640 1 -- 172.21.15.53:0/3081726897 wait complete. 2024-08-31T06:13:40.953 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:13:40.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 149141 1.58 MB/sec execute 330 sec latency 4501.947 ms 2024-08-31T06:13:41.206 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:41.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.774+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/407798961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a04104750 msgr2=0x7f1a04104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:41.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.774+0000 7f1a0ad4c640 1 --2- 172.21.15.53:0/407798961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a04104750 0x7f1a04104b60 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009900 tx=0x7f19f802a410 comp rx=0 tx=0).stop 2024-08-31T06:13:41.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.774+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/407798961 shutdown_connections 2024-08-31T06:13:41.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.774+0000 7f1a0ad4c640 1 --2- 172.21.15.53:0/407798961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a0410dbb0 0x7f1a041100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.774+0000 7f1a0ad4c640 1 --2- 172.21.15.53:0/407798961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a041050a0 0x7f1a0410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.774+0000 7f1a0ad4c640 1 --2- 172.21.15.53:0/407798961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a04104750 0x7f1a04104b60 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.774+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/407798961 >> 172.21.15.53:0/407798961 conn(0x7f1a040794d0 msgr2=0x7f1a040798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:41.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.774+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/407798961 shutdown_connections 2024-08-31T06:13:41.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.774+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/407798961 wait complete. 2024-08-31T06:13:41.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a0ad4c640 1 Processor -- start 2024-08-31T06:13:41.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a0ad4c640 1 -- start start 2024-08-31T06:13:41.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a0ad4c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a04104750 0x7f1a0419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a0ad4c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a041050a0 0x7f1a0419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a0ad4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0410dbb0 0x7f1a0419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a0ad4c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1a041136c0 con 0x7f1a0410dbb0 2024-08-31T06:13:41.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a0ad4c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a04113540 con 0x7f1a041050a0 2024-08-31T06:13:41.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a0ad4c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a04113840 con 0x7f1a04104750 2024-08-31T06:13:41.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a092e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0410dbb0 0x7f1a0419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a092e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0410dbb0 0x7f1a0419fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40834/0 (socket says 172.21.15.53:40834) 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a092e9640 1 -- 172.21.15.53:0/3353509326 learned_addr learned my addr 172.21.15.53:0/3353509326 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a04104750 0x7f1a0419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.775+0000 7f1a03fff640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a041050a0 0x7f1a0419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.776+0000 7f1a03fff640 1 -- 172.21.15.53:0/3353509326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a04104750 msgr2=0x7f1a0419a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.776+0000 7f1a03fff640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a04104750 0x7f1a0419a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.776+0000 7f1a03fff640 1 -- 172.21.15.53:0/3353509326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0410dbb0 msgr2=0x7f1a0419fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.776+0000 7f1a03fff640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0410dbb0 0x7f1a0419fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.776+0000 7f1a03fff640 1 -- 172.21.15.53:0/3353509326 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a041a0180 con 0x7f1a041050a0 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.776+0000 7f1a092e9640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0410dbb0 0x7f1a0419fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.776+0000 7f1a03fff640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a041050a0 0x7f1a0419a7b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1a0406aad0 tx=0x7f19f000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.776+0000 7f1a01ffb640 1 -- 172.21.15.53:0/3353509326 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f000cc40 con 0x7f1a041050a0 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.776+0000 7f1a01ffb640 1 -- 172.21.15.53:0/3353509326 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19f000cde0 con 0x7f1a041050a0 2024-08-31T06:13:41.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.776+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/3353509326 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a041a0470 con 0x7f1a041050a0 2024-08-31T06:13:41.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.776+0000 7f1a01ffb640 1 -- 172.21.15.53:0/3353509326 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f00186f0 con 0x7f1a041050a0 2024-08-31T06:13:41.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.777+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/3353509326 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a041a6bd0 con 0x7f1a041050a0 2024-08-31T06:13:41.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.779+0000 7f1a01ffb640 1 -- 172.21.15.53:0/3353509326 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f19f0010a70 con 0x7f1a041050a0 2024-08-31T06:13:41.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.779+0000 7f1a112c1740 1 Processor -- start 2024-08-31T06:13:41.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.779+0000 7f1a112c1740 1 -- start start 2024-08-31T06:13:41.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x558856954310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565861b0 0x558856954850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55885658e390 0x558856954d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a112c1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5588568cb680 con 0x5588565861b0 2024-08-31T06:13:41.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a112c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5588568bac10 con 0x55885658e390 2024-08-31T06:13:41.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a112c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5588568bebc0 con 0x5588565af070 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a092e9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x558856954310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a08ae8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565861b0 0x558856954850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a092e9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x558856954310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56750/0 (socket says 172.21.15.53:56750) 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a092e9640 1 -- 172.21.15.53:0/4038131995 learned_addr learned my addr 172.21.15.53:0/4038131995 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a03fff640 1 --2- 172.21.15.53:0/4038131995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55885658e390 0x558856954d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a08ae8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565861b0 0x558856954850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40848/0 (socket says 172.21.15.53:40848) 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a092e9640 1 -- 172.21.15.53:0/4038131995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55885658e390 msgr2=0x558856954d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a092e9640 1 --2- 172.21.15.53:0/4038131995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55885658e390 0x558856954d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a092e9640 1 -- 172.21.15.53:0/4038131995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565861b0 msgr2=0x558856954850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a092e9640 1 --2- 172.21.15.53:0/4038131995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565861b0 0x558856954850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a092e9640 1 -- 172.21.15.53:0/4038131995 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55885661a650 con 0x5588565af070 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.780+0000 7f1a01ffb640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f40b4ca0 0x7f19f40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.781+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f40b4ca0 0x7f19f40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.781+0000 7f1a092e9640 1 --2- 172.21.15.53:0/4038131995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x558856954310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19fc010810 tx=0x7f19fc010cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ab8e6fc37a70c16 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:41.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.781+0000 7f1a01ffb640 1 -- 172.21.15.53:0/3353509326 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f19f00e5830 con 0x7f1a041050a0 2024-08-31T06:13:41.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.781+0000 7f19eeffd640 1 -- 172.21.15.53:0/4038131995 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00eb30 con 0x5588565af070 2024-08-31T06:13:41.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.781+0000 7f19eeffd640 1 -- 172.21.15.53:0/4038131995 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19fc015070 con 0x5588565af070 2024-08-31T06:13:41.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.781+0000 7f19eeffd640 1 -- 172.21.15.53:0/4038131995 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc011440 con 0x5588565af070 2024-08-31T06:13:41.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.782+0000 7f1a112c1740 1 -- 172.21.15.53:0/4038131995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 msgr2=0x558856954310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:41.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.782+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f40b4ca0 0x7f19f40b71b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f19f8004770 tx=0x7f19f803f040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:41.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.782+0000 7f1a112c1740 1 --2- 172.21.15.53:0/4038131995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x558856954310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19fc010810 tx=0x7f19fc010cd0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.782+0000 7f1a112c1740 1 -- 172.21.15.53:0/4038131995 shutdown_connections 2024-08-31T06:13:41.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.782+0000 7f1a112c1740 1 --2- 172.21.15.53:0/4038131995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55885658e390 0x558856954d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.782+0000 7f1a112c1740 1 --2- 172.21.15.53:0/4038131995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565861b0 0x558856954850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.782+0000 7f1a112c1740 1 --2- 172.21.15.53:0/4038131995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x558856954310 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.782+0000 7f1a112c1740 1 -- 172.21.15.53:0/4038131995 >> 172.21.15.53:0/4038131995 conn(0x5588565a3460 msgr2=0x558856952200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:41.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.782+0000 7f1a112c1740 1 -- 172.21.15.53:0/4038131995 shutdown_connections 2024-08-31T06:13:41.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.782+0000 7f1a112c1740 1 -- 172.21.15.53:0/4038131995 wait complete. 2024-08-31T06:13:41.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.782+0000 7f1a112c1740 1 -- start start 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a112c1740 1 Processor -- start 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 0x55885695fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55885658e390 0x558856960010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x55885696bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a112c1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55885671d700 con 0x55885658e390 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a112c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558856841750 con 0x5588565861b0 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a112c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558856962af0 con 0x5588565af070 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a08ae8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 0x55885695fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a112c1740 10 client.0 _ll_register_callbacks cb 0x558856870e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55885658e390 0x558856960010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a08ae8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 0x55885695fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:41330/0 (socket says 172.21.15.53:41330) 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a08ae8640 1 -- 172.21.15.53:0/2272815415 learned_addr learned my addr 172.21.15.53:0/2272815415 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:41.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.783+0000 7f1a092e9640 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x55885696bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f1a03fff640 1 -- 172.21.15.53:0/2272815415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 msgr2=0x55885696bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:41.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f1a03fff640 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x55885696bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f1a03fff640 1 -- 172.21.15.53:0/2272815415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 msgr2=0x55885695fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:41.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f1a03fff640 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 0x55885695fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f1a03fff640 1 -- 172.21.15.53:0/2272815415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55885687a900 con 0x55885658e390 2024-08-31T06:13:41.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 0x55885695fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:41.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f1a03fff640 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55885658e390 0x558856960010 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f19f00e2f60 tx=0x7f19f00a7f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc3dc74a06eab7d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:41.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f19e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:41.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f19e3fff640 1 -- 172.21.15.53:0/2272815415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f00ab900 con 0x55885658e390 2024-08-31T06:13:41.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f19e3fff640 1 -- 172.21.15.53:0/2272815415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f19f00b3d00 con 0x55885658e390 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f1a112c1740 1 -- 172.21.15.53:0/2272815415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19fc015070 con 0x55885658e390 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f19e3fff640 1 -- 172.21.15.53:0/2272815415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f19f00ab720 con 0x55885658e390 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f1a112c1740 10 client.18318 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f1a112c1740 1 -- 172.21.15.53:0/2272815415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55885696e920 con 0x55885658e390 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.784+0000 7f19e3fff640 1 -- 172.21.15.53:0/2272815415 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19fc015070 con 0x55885658e390 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.785+0000 7f19e3fff640 1 -- 172.21.15.53:0/2272815415 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f19f00e5ce0 con 0x55885658e390 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.785+0000 7f1a112c1740 10 client.18318 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.785+0000 7f1a112c1740 10 client.18318 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.785+0000 7f1a112c1740 20 client.18318 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.785+0000 7f1a112c1740 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55885656d9f0 0x558856971df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.785+0000 7f1a112c1740 4 client.18318 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.785+0000 7f1a112c1740 1 -- 172.21.15.53:0/2272815415 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588568cd5d0 con 0x55885656d9f0 2024-08-31T06:13:41.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.785+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55885656d9f0 0x558856971df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.785+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55885656d9f0 0x558856971df0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4fc08a64147a854f server_cookie=93b72b7e6e36b121 in_seq=0 out_seq=0 2024-08-31T06:13:41.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.785+0000 7f19e3fff640 10 client.18318 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:13:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.786+0000 7f19e3fff640 1 -- 172.21.15.53:0/2272815415 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588568cd5d0 con 0x55885656d9f0 2024-08-31T06:13:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.786+0000 7f19e3fff640 10 client.18318 handle_command_reply: tid=0 2024-08-31T06:13:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.786+0000 7f1a112c1740 1 client.18318 shutdown 2024-08-31T06:13:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.786+0000 7f1a112c1740 1 -- 172.21.15.53:0/2272815415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55885658e390 msgr2=0x558856960010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.786+0000 7f1a112c1740 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55885658e390 0x558856960010 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f19f00e2f60 tx=0x7f19f00a7f40 comp rx=0 tx=0).stop 2024-08-31T06:13:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.786+0000 7f1a112c1740 1 -- 172.21.15.53:0/2272815415 shutdown_connections 2024-08-31T06:13:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.787+0000 7f1a112c1740 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x55885696bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.787+0000 7f1a112c1740 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55885656d9f0 0x558856971df0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.787+0000 7f1a112c1740 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55885658e390 0x558856960010 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.787+0000 7f1a112c1740 1 --2- 172.21.15.53:0/2272815415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 0x55885695fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.787+0000 7f19e3fff640 0 client.18318 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:13:41.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.787+0000 7f1a112c1740 1 -- 172.21.15.53:0/2272815415 >> 172.21.15.53:0/2272815415 conn(0x5588565a3460 msgr2=0x5588569574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:41.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.787+0000 7f1a112c1740 1 -- 172.21.15.53:0/2272815415 shutdown_connections 2024-08-31T06:13:41.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.787+0000 7f1a112c1740 1 -- 172.21.15.53:0/2272815415 wait complete. 2024-08-31T06:13:41.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.787+0000 7f1a112c1740 20 client.18318 trim_cache size 0 max 16384 2024-08-31T06:13:41.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.801+0000 7f1a112c1740 1 Processor -- start 2024-08-31T06:13:41.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.801+0000 7f1a112c1740 1 -- start start 2024-08-31T06:13:41.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.801+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565861b0 0x55885695ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.801+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565af070 0x55885696bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.801+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558856542da0 0x55885696c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.801+0000 7f1a112c1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1a041ad420 con 0x5588565af070 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.801+0000 7f1a112c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a041af080 con 0x558856542da0 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.801+0000 7f1a112c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a041adaf0 con 0x5588565861b0 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565af070 0x55885696bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f1a08ae8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565861b0 0x55885695ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f1a03fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565af070 0x55885696bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40868/0 (socket says 172.21.15.53:40868) 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f1a03fff640 1 -- 172.21.15.53:0/874629775 learned_addr learned my addr 172.21.15.53:0/874629775 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f1a092e9640 1 --2- 172.21.15.53:0/874629775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558856542da0 0x55885696c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f1a08ae8640 1 -- 172.21.15.53:0/874629775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558856542da0 msgr2=0x55885696c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/874629775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558856542da0 0x55885696c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f1a08ae8640 1 -- 172.21.15.53:0/874629775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565af070 msgr2=0x55885696bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:41.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/874629775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565af070 0x55885696bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f1a08ae8640 1 -- 172.21.15.53:0/874629775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558856960d90 con 0x5588565861b0 2024-08-31T06:13:41.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/874629775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565861b0 0x55885695ea60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f19f8006010 tx=0x7f19f8044000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc215f47f56a30fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:41.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f19ee7fc640 1 -- 172.21.15.53:0/874629775 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8035050 con 0x5588565861b0 2024-08-31T06:13:41.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f19ee7fc640 1 -- 172.21.15.53:0/874629775 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19f80043c0 con 0x5588565861b0 2024-08-31T06:13:41.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.802+0000 7f19ee7fc640 1 -- 172.21.15.53:0/874629775 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8003ba0 con 0x5588565861b0 2024-08-31T06:13:41.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.803+0000 7f1a112c1740 1 -- 172.21.15.53:0/874629775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565861b0 msgr2=0x55885695ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:41.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.803+0000 7f1a112c1740 1 --2- 172.21.15.53:0/874629775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565861b0 0x55885695ea60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f19f8006010 tx=0x7f19f8044000 comp rx=0 tx=0).stop 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.803+0000 7f1a112c1740 1 -- 172.21.15.53:0/874629775 shutdown_connections 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.803+0000 7f1a112c1740 1 --2- 172.21.15.53:0/874629775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558856542da0 0x55885696c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.803+0000 7f1a112c1740 1 --2- 172.21.15.53:0/874629775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588565af070 0x55885696bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.803+0000 7f1a112c1740 1 --2- 172.21.15.53:0/874629775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565861b0 0x55885695ea60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.803+0000 7f1a112c1740 1 -- 172.21.15.53:0/874629775 >> 172.21.15.53:0/874629775 conn(0x5588565a3460 msgr2=0x55885695e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.803+0000 7f1a112c1740 1 -- 172.21.15.53:0/874629775 shutdown_connections 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.803+0000 7f1a112c1740 1 -- 172.21.15.53:0/874629775 wait complete. 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.804+0000 7f1a112c1740 1 -- start start 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.804+0000 7f1a112c1740 1 Processor -- start 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.804+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558856542da0 0x558856964040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.804+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 0x558856964580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.804+0000 7f1a112c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x5588569db7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.804+0000 7f1a112c1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1a041ae8f0 con 0x558856542da0 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.804+0000 7f1a112c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a041ae1c0 con 0x5588565861b0 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.804+0000 7f1a112c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a041ab420 con 0x5588565af070 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.804+0000 7f1a112c1740 10 client.0 _ll_register_callbacks cb 0x7f19f00eb240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a08ae8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558856542da0 0x558856964040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a08ae8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558856542da0 0x558856964040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40872/0 (socket says 172.21.15.53:40872) 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a08ae8640 1 -- 172.21.15.53:0/1349877895 learned_addr learned my addr 172.21.15.53:0/1349877895 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a03fff640 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 0x558856964580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a092e9640 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x5588569db7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a08ae8640 1 -- 172.21.15.53:0/1349877895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 msgr2=0x5588569db7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x5588569db7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a08ae8640 1 -- 172.21.15.53:0/1349877895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 msgr2=0x558856964580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 0x558856964580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a08ae8640 1 -- 172.21.15.53:0/1349877895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558856964e50 con 0x558856542da0 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a03fff640 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 0x558856964580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a08ae8640 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558856542da0 0x558856964040 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009900 tx=0x7f19f8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2947cd43b05c39 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f19e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f19e3fff640 1 -- 172.21.15.53:0/1349877895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8064020 con 0x558856542da0 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f1a112c1740 1 -- 172.21.15.53:0/1349877895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19f80043c0 con 0x558856542da0 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.805+0000 7f19e3fff640 1 -- 172.21.15.53:0/1349877895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f19f80035f0 con 0x558856542da0 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.806+0000 7f19e3fff640 1 -- 172.21.15.53:0/1349877895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f19f806f050 con 0x558856542da0 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.806+0000 7f1a112c1740 10 client.18324 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.806+0000 7f1a112c1740 1 -- 172.21.15.53:0/1349877895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5588569dcd50 con 0x558856542da0 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.806+0000 7f19e3fff640 1 -- 172.21.15.53:0/1349877895 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19f80043c0 con 0x558856542da0 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.806+0000 7f19e3fff640 1 -- 172.21.15.53:0/1349877895 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f19f8031ce0 con 0x558856542da0 2024-08-31T06:13:41.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.806+0000 7f1a112c1740 10 client.18324 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.806+0000 7f1a112c1740 10 client.18324 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.806+0000 7f1a112c1740 20 client.18324 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.806+0000 7f1a112c1740 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5588569dd550 0x5588569df970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.806+0000 7f1a112c1740 4 client.18324 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.806+0000 7f1a112c1740 1 -- 172.21.15.53:0/1349877895 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588569603a0 con 0x5588569dd550 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f1a03fff640 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5588569dd550 0x5588569df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f1a03fff640 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5588569dd550 0x5588569df970 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=10af7e71206eb26e server_cookie=910a912855580f87 in_seq=0 out_seq=0 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f19e3fff640 10 client.18324 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f19e3fff640 1 -- 172.21.15.53:0/1349877895 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5588569603a0 con 0x5588569dd550 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f19e3fff640 10 client.18324 handle_command_reply: tid=0 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f1a112c1740 1 client.18324 shutdown 2024-08-31T06:13:41.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f1a112c1740 1 -- 172.21.15.53:0/1349877895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558856542da0 msgr2=0x558856964040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:41.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f1a112c1740 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558856542da0 0x558856964040 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009900 tx=0x7f19f8005850 comp rx=0 tx=0).stop 2024-08-31T06:13:41.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f1a112c1740 1 -- 172.21.15.53:0/1349877895 shutdown_connections 2024-08-31T06:13:41.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f1a112c1740 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588565af070 0x5588569db7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f1a112c1740 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588565861b0 0x558856964580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f1a112c1740 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5588569dd550 0x5588569df970 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f1a112c1740 1 --2- 172.21.15.53:0/1349877895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558856542da0 0x558856964040 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.807+0000 7f1a112c1740 1 -- 172.21.15.53:0/1349877895 >> 172.21.15.53:0/1349877895 conn(0x5588565a3460 msgr2=0x558856960f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:41.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.808+0000 7f19e3fff640 0 client.18324 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:13:41.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.808+0000 7f1a112c1740 1 -- 172.21.15.53:0/1349877895 shutdown_connections 2024-08-31T06:13:41.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.808+0000 7f1a112c1740 1 -- 172.21.15.53:0/1349877895 wait complete. 2024-08-31T06:13:41.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.808+0000 7f1a112c1740 20 client.18324 trim_cache size 0 max 16384 2024-08-31T06:13:41.819 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:13:41.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.808+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/3353509326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f40b4ca0 msgr2=0x7f19f40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:41.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.808+0000 7f1a0ad4c640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f40b4ca0 0x7f19f40b71b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f19f8004770 tx=0x7f19f803f040 comp rx=0 tx=0).stop 2024-08-31T06:13:41.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.808+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/3353509326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a041050a0 msgr2=0x7f1a0419a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:41.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.808+0000 7f1a0ad4c640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a041050a0 0x7f1a0419a7b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1a0406aad0 tx=0x7f19f000ee50 comp rx=0 tx=0).stop 2024-08-31T06:13:41.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.809+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/3353509326 shutdown_connections 2024-08-31T06:13:41.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.809+0000 7f1a0ad4c640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19f40b4ca0 0x7f19f40b71b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.809+0000 7f1a0ad4c640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a0410dbb0 0x7f1a0419fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.809+0000 7f1a0ad4c640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a041050a0 0x7f1a0419a7b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.809+0000 7f1a0ad4c640 1 --2- 172.21.15.53:0/3353509326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a04104750 0x7f1a0419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:41.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.809+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/3353509326 >> 172.21.15.53:0/3353509326 conn(0x7f1a040794d0 msgr2=0x7f1a040ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:41.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.809+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/3353509326 shutdown_connections 2024-08-31T06:13:41.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:41.809+0000 7f1a0ad4c640 1 -- 172.21.15.53:0/3353509326 wait complete. 2024-08-31T06:13:41.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:41 smithi130 ceph-mon[22266]: pgmap v591: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 994 KiB/s wr, 107 op/s 2024-08-31T06:13:41.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:41 smithi153 ceph-mon[22320]: pgmap v591: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 994 KiB/s wr, 107 op/s 2024-08-31T06:13:41.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:41 smithi053 ceph-mon[18924]: pgmap v591: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 994 KiB/s wr, 107 op/s 2024-08-31T06:13:41.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 149343 1.58 MB/sec execute 331 sec latency 4758.192 ms 2024-08-31T06:13:42.529 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:13:42.848 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:42.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 149601 1.58 MB/sec execute 332 sec latency 15.000 ms 2024-08-31T06:13:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.361+0000 7fce325b4640 1 -- 172.21.15.53:0/2481894950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce2c108170 msgr2=0x7fce2c108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.361+0000 7fce325b4640 1 --2- 172.21.15.53:0/2481894950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce2c108170 0x7fce2c108580 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fce14009900 tx=0x7fce1402a410 comp rx=0 tx=0).stop 2024-08-31T06:13:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.361+0000 7fce325b4640 1 -- 172.21.15.53:0/2481894950 shutdown_connections 2024-08-31T06:13:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.362+0000 7fce325b4640 1 --2- 172.21.15.53:0/2481894950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce2c108ac0 0x7fce2c10f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.362+0000 7fce325b4640 1 --2- 172.21.15.53:0/2481894950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce2c108170 0x7fce2c108580 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.362+0000 7fce325b4640 1 --2- 172.21.15.53:0/2481894950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce2c102880 0x7fce2c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.362+0000 7fce325b4640 1 -- 172.21.15.53:0/2481894950 >> 172.21.15.53:0/2481894950 conn(0x7fce2c079550 msgr2=0x7fce2c079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.362+0000 7fce325b4640 1 -- 172.21.15.53:0/2481894950 shutdown_connections 2024-08-31T06:13:43.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.362+0000 7fce325b4640 1 -- 172.21.15.53:0/2481894950 wait complete. 2024-08-31T06:13:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.362+0000 7fce325b4640 1 Processor -- start 2024-08-31T06:13:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.362+0000 7fce325b4640 1 -- start start 2024-08-31T06:13:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce325b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce2c102880 0x7fce2c19af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce325b4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce2c108170 0x7fce2c19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce325b4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce2c108ac0 0x7fce2c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce325b4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c112600 con 0x7fce2c102880 2024-08-31T06:13:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce325b4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c112480 con 0x7fce2c108170 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce325b4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c112780 con 0x7fce2c108ac0 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce2c102880 0x7fce2c19af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce2c102880 0x7fce2c19af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37020/0 (socket says 172.21.15.53:37020) 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce2bfff640 1 -- 172.21.15.53:0/2854742780 learned_addr learned my addr 172.21.15.53:0/2854742780 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce23fff640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce2c108170 0x7fce2c19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce30b51640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce2c108ac0 0x7fce2c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce2bfff640 1 -- 172.21.15.53:0/2854742780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce2c108ac0 msgr2=0x7fce2c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce2bfff640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce2c108ac0 0x7fce2c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce2bfff640 1 -- 172.21.15.53:0/2854742780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce2c108170 msgr2=0x7fce2c19b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce2bfff640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce2c108170 0x7fce2c19b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.363+0000 7fce2bfff640 1 -- 172.21.15.53:0/2854742780 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2c1a6240 con 0x7fce2c102880 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.364+0000 7fce2bfff640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce2c102880 0x7fce2c19af30 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00e9f0 tx=0x7fce1c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.364+0000 7fce29ffb640 1 -- 172.21.15.53:0/2854742780 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c00cd80 con 0x7fce2c102880 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.364+0000 7fce29ffb640 1 -- 172.21.15.53:0/2854742780 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce1c0108c0 con 0x7fce2c102880 2024-08-31T06:13:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.364+0000 7fce29ffb640 1 -- 172.21.15.53:0/2854742780 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0187c0 con 0x7fce2c102880 2024-08-31T06:13:43.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.364+0000 7fce325b4640 1 -- 172.21.15.53:0/2854742780 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2c1a6530 con 0x7fce2c102880 2024-08-31T06:13:43.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.364+0000 7fce325b4640 1 -- 172.21.15.53:0/2854742780 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce2c1a6a90 con 0x7fce2c102880 2024-08-31T06:13:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce38b29740 1 Processor -- start 2024-08-31T06:13:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce38b29740 1 -- start start 2024-08-31T06:13:43.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce38b29740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584f0070 0x562458895310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce38b29740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x562458895850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce38b29740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 0x562458895d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce38b29740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56245880c680 con 0x5624584cf390 2024-08-31T06:13:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce38b29740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5624587fbc10 con 0x5624584f0070 2024-08-31T06:13:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce38b29740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5624587ffbc0 con 0x5624584c71b0 2024-08-31T06:13:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce29ffb640 1 -- 172.21.15.53:0/2854742780 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fce1c010430 con 0x7fce2c102880 2024-08-31T06:13:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce30b51640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584f0070 0x562458895310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce30b51640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584f0070 0x562458895310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36800/0 (socket says 172.21.15.53:36800) 2024-08-31T06:13:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce30b51640 1 -- 172.21.15.53:0/3892175323 learned_addr learned my addr 172.21.15.53:0/3892175323 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce23fff640 1 --2- 172.21.15.53:0/3892175323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 0x562458895d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.367+0000 7fce2bfff640 1 --2- 172.21.15.53:0/3892175323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x562458895850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce30b51640 1 -- 172.21.15.53:0/3892175323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 msgr2=0x562458895850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce30b51640 1 --2- 172.21.15.53:0/3892175323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x562458895850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce30b51640 1 -- 172.21.15.53:0/3892175323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 msgr2=0x562458895d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce30b51640 1 --2- 172.21.15.53:0/3892175323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 0x562458895d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce30b51640 1 -- 172.21.15.53:0/3892175323 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56245855b650 con 0x5624584f0070 2024-08-31T06:13:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce2bfff640 1 --2- 172.21.15.53:0/3892175323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x562458895850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce23fff640 1 --2- 172.21.15.53:0/3892175323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 0x562458895d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce30b51640 1 --2- 172.21.15.53:0/3892175323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584f0070 0x562458895310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce24009f90 tx=0x7fce240118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f839c70b519d01d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce227fc640 1 -- 172.21.15.53:0/3892175323 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24004d20 con 0x5624584f0070 2024-08-31T06:13:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce29ffb640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce180b4d20 0x7fce180b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce227fc640 1 -- 172.21.15.53:0/3892175323 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce24004050 con 0x5624584f0070 2024-08-31T06:13:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce227fc640 1 -- 172.21.15.53:0/3892175323 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24005260 con 0x5624584f0070 2024-08-31T06:13:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce2bfff640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce180b4d20 0x7fce180b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.368+0000 7fce29ffb640 1 -- 172.21.15.53:0/2854742780 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7fce1c0e5830 con 0x7fce2c102880 2024-08-31T06:13:43.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.369+0000 7fce38b29740 1 -- 172.21.15.53:0/3892175323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584f0070 msgr2=0x562458895310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:43.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.369+0000 7fce2bfff640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce180b4d20 0x7fce180b7230 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0e3010 tx=0x7fce1c010cc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:43.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.369+0000 7fce38b29740 1 --2- 172.21.15.53:0/3892175323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584f0070 0x562458895310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce24009f90 tx=0x7fce240118d0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.369+0000 7fce38b29740 1 -- 172.21.15.53:0/3892175323 shutdown_connections 2024-08-31T06:13:43.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.369+0000 7fce38b29740 1 --2- 172.21.15.53:0/3892175323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 0x562458895d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.369+0000 7fce38b29740 1 --2- 172.21.15.53:0/3892175323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x562458895850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.369+0000 7fce38b29740 1 --2- 172.21.15.53:0/3892175323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584f0070 0x562458895310 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.369+0000 7fce38b29740 1 -- 172.21.15.53:0/3892175323 >> 172.21.15.53:0/3892175323 conn(0x5624584e4460 msgr2=0x562458893200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:43.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.369+0000 7fce38b29740 1 -- 172.21.15.53:0/3892175323 shutdown_connections 2024-08-31T06:13:43.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.369+0000 7fce38b29740 1 -- 172.21.15.53:0/3892175323 wait complete. 2024-08-31T06:13:43.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.370+0000 7fce38b29740 1 -- start start 2024-08-31T06:13:43.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.370+0000 7fce38b29740 1 Processor -- start 2024-08-31T06:13:43.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.370+0000 7fce38b29740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584c71b0 0x5624588a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.370+0000 7fce38b29740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 0x5624588a5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.370+0000 7fce38b29740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584f0070 0x5624588b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.370+0000 7fce38b29740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56245865e700 con 0x5624584cf390 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.370+0000 7fce38b29740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562458782750 con 0x5624584c71b0 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.370+0000 7fce38b29740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5624588a7e50 con 0x5624584f0070 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.370+0000 7fce38b29740 10 client.0 _ll_register_callbacks cb 0x5624587b1e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce23fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 0x5624588a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce30b51640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584c71b0 0x5624588a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce30b51640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584c71b0 0x5624588a4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36814/0 (socket says 172.21.15.53:36814) 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce30b51640 1 -- 172.21.15.53:0/3620088925 learned_addr learned my addr 172.21.15.53:0/3620088925 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce30b51640 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584f0070 0x5624588b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce23fff640 1 -- 172.21.15.53:0/3620088925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584f0070 msgr2=0x5624588b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce23fff640 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584f0070 0x5624588b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce23fff640 1 -- 172.21.15.53:0/3620088925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584c71b0 msgr2=0x5624588a4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:43.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce23fff640 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584c71b0 0x5624588a4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce23fff640 1 -- 172.21.15.53:0/3620088925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624587bb900 con 0x5624584cf390 2024-08-31T06:13:43.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce23fff640 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 0x5624588a5330 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fce1402a930 tx=0x7fce14031f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678cc953f9b9e0be server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:43.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:43.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce0b7fe640 1 -- 172.21.15.53:0/3620088925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14035040 con 0x5624584cf390 2024-08-31T06:13:43.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce0b7fe640 1 -- 172.21.15.53:0/3620088925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7fce140317c0 con 0x5624584cf390 2024-08-31T06:13:43.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.371+0000 7fce38b29740 1 -- 172.21.15.53:0/3620088925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce24004050 con 0x5624584cf390 2024-08-31T06:13:43.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce0b7fe640 1 -- 172.21.15.53:0/3620088925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fce14004040 con 0x5624584cf390 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce38b29740 10 client.18336 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce38b29740 1 -- 172.21.15.53:0/3620088925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5624588b3be0 con 0x5624584cf390 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce0b7fe640 1 -- 172.21.15.53:0/3620088925 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce24004050 con 0x5624584cf390 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce0b7fe640 1 -- 172.21.15.53:0/3620088925 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7fce14046480 con 0x5624584cf390 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce38b29740 10 client.18336 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce38b29740 10 client.18336 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce38b29740 20 client.18336 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce38b29740 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5624584ae9f0 0x5624588b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce38b29740 4 client.18336 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce38b29740 1 -- 172.21.15.53:0/3620088925 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56245880e5d0 con 0x5624584ae9f0 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.372+0000 7fce30b51640 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5624584ae9f0 0x5624588b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.373+0000 7fce0b7fe640 10 client.18336 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:13:43.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.373+0000 7fce30b51640 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5624584ae9f0 0x5624588b70f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4085f83f34c347fe server_cookie=25990cae2fbb5e29 in_seq=0 out_seq=0 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.373+0000 7fce0b7fe640 1 -- 172.21.15.53:0/3620088925 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56245880e5d0 con 0x5624584ae9f0 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce0b7fe640 10 client.18336 handle_command_reply: tid=0 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 1 client.18336 shutdown 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 1 -- 172.21.15.53:0/3620088925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 msgr2=0x5624588a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 0x5624588a5330 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fce1402a930 tx=0x7fce14031f40 comp rx=0 tx=0).stop 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 1 -- 172.21.15.53:0/3620088925 shutdown_connections 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5624584ae9f0 0x5624588b70f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584f0070 0x5624588b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584cf390 0x5624588a5330 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 1 --2- 172.21.15.53:0/3620088925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584c71b0 0x5624588a4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 1 -- 172.21.15.53:0/3620088925 >> 172.21.15.53:0/3620088925 conn(0x5624584e4460 msgr2=0x562458896d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce0b7fe640 0 client.18336 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:13:43.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 1 -- 172.21.15.53:0/3620088925 shutdown_connections 2024-08-31T06:13:43.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 1 -- 172.21.15.53:0/3620088925 wait complete. 2024-08-31T06:13:43.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.374+0000 7fce38b29740 20 client.18336 trim_cache size 0 max 16384 2024-08-31T06:13:43.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.388+0000 7fce38b29740 1 Processor -- start 2024-08-31T06:13:43.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.388+0000 7fce38b29740 1 -- start start 2024-08-31T06:13:43.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.388+0000 7fce38b29740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x5624588b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.388+0000 7fce38b29740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 0x5624588a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce38b29740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 0x5624588a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce38b29740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1ad2b0 con 0x5624584f0070 2024-08-31T06:13:43.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce38b29740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1aef10 con 0x5624584cf390 2024-08-31T06:13:43.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce38b29740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1ad980 con 0x5624584c71b0 2024-08-31T06:13:43.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce30b51640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 0x5624588a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce30b51640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 0x5624588a3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37040/0 (socket says 172.21.15.53:37040) 2024-08-31T06:13:43.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce30b51640 1 -- 172.21.15.53:0/2657807230 learned_addr learned my addr 172.21.15.53:0/2657807230 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:43.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce23fff640 1 --2- 172.21.15.53:0/2657807230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 0x5624588a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce30b51640 1 --2- 172.21.15.53:0/2657807230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x5624588b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce30b51640 1 -- 172.21.15.53:0/2657807230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 msgr2=0x5624588b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:43.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce30b51640 1 --2- 172.21.15.53:0/2657807230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x5624588b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce30b51640 1 -- 172.21.15.53:0/2657807230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 msgr2=0x5624588a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:43.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce30b51640 1 --2- 172.21.15.53:0/2657807230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 0x5624588a3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce30b51640 1 -- 172.21.15.53:0/2657807230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562458898130 con 0x5624584f0070 2024-08-31T06:13:43.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce23fff640 1 --2- 172.21.15.53:0/2657807230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 0x5624588a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:43.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce30b51640 1 --2- 172.21.15.53:0/2657807230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 0x5624588a3bb0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fce2401b040 tx=0x7fce24009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b85cd46ecbb1698 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:43.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.389+0000 7fce21ffb640 1 -- 172.21.15.53:0/2657807230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24004880 con 0x5624584f0070 2024-08-31T06:13:43.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.390+0000 7fce21ffb640 1 -- 172.21.15.53:0/2657807230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce2400f4e0 con 0x5624584f0070 2024-08-31T06:13:43.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.390+0000 7fce21ffb640 1 -- 172.21.15.53:0/2657807230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24028450 con 0x5624584f0070 2024-08-31T06:13:43.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.390+0000 7fce38b29740 1 -- 172.21.15.53:0/2657807230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 msgr2=0x5624588a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:43.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.390+0000 7fce38b29740 1 --2- 172.21.15.53:0/2657807230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 0x5624588a3bb0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fce2401b040 tx=0x7fce24009500 comp rx=0 tx=0).stop 2024-08-31T06:13:43.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.391+0000 7fce38b29740 1 -- 172.21.15.53:0/2657807230 shutdown_connections 2024-08-31T06:13:43.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.391+0000 7fce38b29740 1 --2- 172.21.15.53:0/2657807230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 0x5624588a3bb0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.391+0000 7fce38b29740 1 --2- 172.21.15.53:0/2657807230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 0x5624588a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.391+0000 7fce38b29740 1 --2- 172.21.15.53:0/2657807230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x5624588b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.391+0000 7fce38b29740 1 -- 172.21.15.53:0/2657807230 >> 172.21.15.53:0/2657807230 conn(0x5624584e4460 msgr2=0x56245889ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:43.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.391+0000 7fce38b29740 1 -- 172.21.15.53:0/2657807230 shutdown_connections 2024-08-31T06:13:43.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.391+0000 7fce38b29740 1 -- 172.21.15.53:0/2657807230 wait complete. 2024-08-31T06:13:43.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.391+0000 7fce38b29740 1 -- start start 2024-08-31T06:13:43.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.391+0000 7fce38b29740 1 Processor -- start 2024-08-31T06:13:43.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce38b29740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x5624588a9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce38b29740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 0x5624588a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce38b29740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 0x5624588a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce38b29740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1ae780 con 0x5624584f0070 2024-08-31T06:13:43.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce30b51640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x5624588a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce30b51640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x5624588a9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:33982/0 (socket says 172.21.15.53:33982) 2024-08-31T06:13:43.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce30b51640 1 -- 172.21.15.53:0/2243648477 learned_addr learned my addr 172.21.15.53:0/2243648477 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:43.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce23fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 0x5624588a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce38b29740 1 -- 172.21.15.53:0/2243648477 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1ae050 con 0x5624584cf390 2024-08-31T06:13:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce38b29740 1 -- 172.21.15.53:0/2243648477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1ab2b0 con 0x5624584c71b0 2024-08-31T06:13:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce38b29740 10 client.0 _ll_register_callbacks cb 0x7fce14009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce30b51640 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 0x5624588a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce30b51640 1 -- 172.21.15.53:0/2243648477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 msgr2=0x5624588a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce30b51640 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 0x5624588a96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce30b51640 1 -- 172.21.15.53:0/2243648477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 msgr2=0x5624588a9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:43.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce30b51640 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 0x5624588a9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce30b51640 1 -- 172.21.15.53:0/2243648477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562458920bb0 con 0x5624584c71b0 2024-08-31T06:13:43.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce23fff640 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 0x5624588a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:43.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce30b51640 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x5624588a9190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce24010000 tx=0x7fce2400fd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5312475bddce1067 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:43.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.392+0000 7fce0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:13:43.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce0b7fe640 1 -- 172.21.15.53:0/2243648477 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2403a070 con 0x5624584c71b0 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce0b7fe640 1 -- 172.21.15.53:0/2243648477 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7fce24005970 con 0x5624584c71b0 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce38b29740 1 -- 172.21.15.53:0/2243648477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce2400f4e0 con 0x5624584c71b0 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce0b7fe640 1 -- 172.21.15.53:0/2243648477 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fce24003a30 con 0x5624584c71b0 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce38b29740 10 client.27583 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce38b29740 1 -- 172.21.15.53:0/2243648477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562458921e10 con 0x5624584c71b0 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce0b7fe640 1 -- 172.21.15.53:0/2243648477 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce2400f4e0 con 0x5624584c71b0 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce0b7fe640 1 -- 172.21.15.53:0/2243648477 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7fce240284e0 con 0x5624584c71b0 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce38b29740 10 client.27583 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce38b29740 10 client.27583 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce38b29740 20 client.27583 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce38b29740 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562458483da0 0x562458924300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce38b29740 4 client.27583 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.393+0000 7fce38b29740 1 -- 172.21.15.53:0/2243648477 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56245880a070 con 0x562458483da0 2024-08-31T06:13:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.394+0000 7fce23fff640 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562458483da0 0x562458924300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.394+0000 7fce0b7fe640 10 client.27583 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:13:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.394+0000 7fce23fff640 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562458483da0 0x562458924300 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6c8140d781c2134 server_cookie=80c3116b8a4f5b32 in_seq=0 out_seq=0 2024-08-31T06:13:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.394+0000 7fce0b7fe640 1 -- 172.21.15.53:0/2243648477 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56245880a070 con 0x562458483da0 2024-08-31T06:13:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.394+0000 7fce0b7fe640 10 client.27583 handle_command_reply: tid=0 2024-08-31T06:13:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.394+0000 7fce38b29740 1 client.27583 shutdown 2024-08-31T06:13:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.394+0000 7fce38b29740 1 -- 172.21.15.53:0/2243648477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 msgr2=0x5624588a9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.394+0000 7fce38b29740 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x5624588a9190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce24010000 tx=0x7fce2400fd70 comp rx=0 tx=0).stop 2024-08-31T06:13:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce38b29740 1 -- 172.21.15.53:0/2243648477 shutdown_connections 2024-08-31T06:13:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce38b29740 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562458483da0 0x562458924300 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce38b29740 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624584f0070 0x5624588a9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce38b29740 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624584cf390 0x5624588a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce0b7fe640 0 client.27583 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:13:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce38b29740 1 --2- 172.21.15.53:0/2243648477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624584c71b0 0x5624588a9190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce38b29740 1 -- 172.21.15.53:0/2243648477 >> 172.21.15.53:0/2243648477 conn(0x5624584e4460 msgr2=0x5624588929e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce38b29740 1 -- 172.21.15.53:0/2243648477 shutdown_connections 2024-08-31T06:13:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce38b29740 1 -- 172.21.15.53:0/2243648477 wait complete. 2024-08-31T06:13:43.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce38b29740 20 client.27583 trim_cache size 0 max 16384 2024-08-31T06:13:43.410 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce325b4640 1 -- 172.21.15.53:0/2854742780 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce180b4d20 msgr2=0x7fce180b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce325b4640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce180b4d20 0x7fce180b7230 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0e3010 tx=0x7fce1c010cc0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce325b4640 1 -- 172.21.15.53:0/2854742780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce2c102880 msgr2=0x7fce2c19af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce325b4640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce2c102880 0x7fce2c19af30 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00e9f0 tx=0x7fce1c00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce325b4640 1 -- 172.21.15.53:0/2854742780 shutdown_connections 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce325b4640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce180b4d20 0x7fce180b7230 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce325b4640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce2c108ac0 0x7fce2c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce325b4640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce2c108170 0x7fce2c19b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce325b4640 1 --2- 172.21.15.53:0/2854742780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce2c102880 0x7fce2c19af30 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.395+0000 7fce325b4640 1 -- 172.21.15.53:0/2854742780 >> 172.21.15.53:0/2854742780 conn(0x7fce2c079550 msgr2=0x7fce2c1062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.396+0000 7fce325b4640 1 -- 172.21.15.53:0/2854742780 shutdown_connections 2024-08-31T06:13:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:43.396+0000 7fce325b4640 1 -- 172.21.15.53:0/2854742780 wait complete. 2024-08-31T06:13:43.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:43 smithi130 ceph-mon[22266]: pgmap v592: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 673 KiB/s wr, 75 op/s 2024-08-31T06:13:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:43 smithi153 ceph-mon[22320]: pgmap v592: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 673 KiB/s wr, 75 op/s 2024-08-31T06:13:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:43 smithi053 ceph-mon[18924]: pgmap v592: 97 pgs: 97 active+clean; 86 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 673 KiB/s wr, 75 op/s 2024-08-31T06:13:43.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 150071 1.58 MB/sec execute 333 sec latency 15.887 ms 2024-08-31T06:13:44.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:13:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:44.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.902+0000 7feeab01b640 1 -- 172.21.15.53:0/923259341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea4105120 msgr2=0x7feea410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:44.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.902+0000 7feeab01b640 1 --2- 172.21.15.53:0/923259341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea4105120 0x7feea410d670 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fee90009900 tx=0x7fee9002a410 comp rx=0 tx=0).stop 2024-08-31T06:13:44.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.902+0000 7feeab01b640 1 -- 172.21.15.53:0/923259341 shutdown_connections 2024-08-31T06:13:44.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.902+0000 7feeab01b640 1 --2- 172.21.15.53:0/923259341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feea410dc00 0x7feea41100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.902+0000 7feeab01b640 1 --2- 172.21.15.53:0/923259341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea4105120 0x7feea410d670 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.902+0000 7feeab01b640 1 --2- 172.21.15.53:0/923259341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea41047d0 0x7feea4104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.902+0000 7feeab01b640 1 -- 172.21.15.53:0/923259341 >> 172.21.15.53:0/923259341 conn(0x7feea4079500 msgr2=0x7feea4079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:44.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.902+0000 7feeab01b640 1 -- 172.21.15.53:0/923259341 shutdown_connections 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.902+0000 7feeab01b640 1 -- 172.21.15.53:0/923259341 wait complete. 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.903+0000 7feeab01b640 1 Processor -- start 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.903+0000 7feeab01b640 1 -- start start 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.903+0000 7feeab01b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea41047d0 0x7feea419c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.903+0000 7feeab01b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feea4105120 0x7feea419c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.903+0000 7feeab01b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea410dc00 0x7feea41a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.903+0000 7feeab01b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feea41136f0 con 0x7feea410dc00 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.903+0000 7feeab01b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feea4113570 con 0x7feea41047d0 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.903+0000 7feeab01b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feea4113870 con 0x7feea4105120 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea95b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea410dc00 0x7feea41a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea8db7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea41047d0 0x7feea419c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea8db7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea41047d0 0x7feea419c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36854/0 (socket says 172.21.15.53:36854) 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea8db7640 1 -- 172.21.15.53:0/3299913134 learned_addr learned my addr 172.21.15.53:0/3299913134 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:44.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea95b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea410dc00 0x7feea41a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37068/0 (socket says 172.21.15.53:37068) 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea3fff640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feea4105120 0x7feea419c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea8db7640 1 -- 172.21.15.53:0/3299913134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feea4105120 msgr2=0x7feea419c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea8db7640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feea4105120 0x7feea419c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea8db7640 1 -- 172.21.15.53:0/3299913134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea410dc00 msgr2=0x7feea41a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea8db7640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea410dc00 0x7feea41a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea8db7640 1 -- 172.21.15.53:0/3299913134 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea41a2310 con 0x7feea41047d0 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea95b8640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea410dc00 0x7feea41a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea8db7640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea41047d0 0x7feea419c3a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee9800d770 tx=0x7fee9800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea1ffb640 1 -- 172.21.15.53:0/3299913134 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98017070 con 0x7feea41047d0 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feeab01b640 1 -- 172.21.15.53:0/3299913134 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea41a2600 con 0x7feea41047d0 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea1ffb640 1 -- 172.21.15.53:0/3299913134 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee98009c30 con 0x7feea41047d0 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.904+0000 7feea1ffb640 1 -- 172.21.15.53:0/3299913134 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98003c50 con 0x7feea41047d0 2024-08-31T06:13:44.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.905+0000 7feeab01b640 1 -- 172.21.15.53:0/3299913134 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea41a8d60 con 0x7feea41047d0 2024-08-31T06:13:44.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.907+0000 7feea1ffb640 1 -- 172.21.15.53:0/3299913134 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fee98003df0 con 0x7feea41047d0 2024-08-31T06:13:44.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.907+0000 7feeb1590740 1 Processor -- start 2024-08-31T06:13:44.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.907+0000 7feeb1590740 1 -- start start 2024-08-31T06:13:44.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feeb1590740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeefb070 0x5578ef2a0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feeb1590740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeed21b0 0x5578ef2a0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feeb1590740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 0x5578ef2a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feeb1590740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5578ef217680 con 0x5578eeefb070 2024-08-31T06:13:44.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feeb1590740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5578ef206c10 con 0x5578eeed21b0 2024-08-31T06:13:44.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feeb1590740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5578ef20abc0 con 0x5578eeeda390 2024-08-31T06:13:44.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea95b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeefb070 0x5578ef2a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea95b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeefb070 0x5578ef2a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37084/0 (socket says 172.21.15.53:37084) 2024-08-31T06:13:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea95b8640 1 -- 172.21.15.53:0/3395320012 learned_addr learned my addr 172.21.15.53:0/3395320012 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea3fff640 1 --2- 172.21.15.53:0/3395320012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 0x5578ef2a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea8db7640 1 --2- 172.21.15.53:0/3395320012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeed21b0 0x5578ef2a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea1ffb640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee940b4ca0 0x7fee940b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea3fff640 1 -- 172.21.15.53:0/3395320012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeed21b0 msgr2=0x5578ef2a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea3fff640 1 --2- 172.21.15.53:0/3395320012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeed21b0 0x5578ef2a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea3fff640 1 -- 172.21.15.53:0/3395320012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeefb070 msgr2=0x5578ef2a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea3fff640 1 --2- 172.21.15.53:0/3395320012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeefb070 0x5578ef2a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea3fff640 1 -- 172.21.15.53:0/3395320012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578eef66650 con 0x5578eeeda390 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea8db7640 1 --2- 172.21.15.53:0/3395320012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeed21b0 0x5578ef2a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea1ffb640 1 -- 172.21.15.53:0/3299913134 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7fee980e4ed0 con 0x7feea41047d0 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.908+0000 7feea95b8640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee940b4ca0 0x7fee940b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.909+0000 7feea3fff640 1 --2- 172.21.15.53:0/3395320012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 0x5578ef2a0d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fee9002a930 tx=0x7fee90031c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a672362c8ecf4e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.909+0000 7fee8effd640 1 -- 172.21.15.53:0/3395320012 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee90040070 con 0x5578eeeda390 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.909+0000 7feea95b8640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee940b4ca0 0x7fee940b71b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009fd0 tx=0x7fee9c004ab0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.909+0000 7fee8effd640 1 -- 172.21.15.53:0/3395320012 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee900044c0 con 0x5578eeeda390 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.909+0000 7fee8effd640 1 -- 172.21.15.53:0/3395320012 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee90035040 con 0x5578eeeda390 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.910+0000 7feeb1590740 1 -- 172.21.15.53:0/3395320012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 msgr2=0x5578ef2a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.910+0000 7feeb1590740 1 --2- 172.21.15.53:0/3395320012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 0x5578ef2a0d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fee9002a930 tx=0x7fee90031c50 comp rx=0 tx=0).stop 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.910+0000 7feeb1590740 1 -- 172.21.15.53:0/3395320012 shutdown_connections 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.910+0000 7feeb1590740 1 --2- 172.21.15.53:0/3395320012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 0x5578ef2a0d90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.910+0000 7feeb1590740 1 --2- 172.21.15.53:0/3395320012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeed21b0 0x5578ef2a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.910+0000 7feeb1590740 1 --2- 172.21.15.53:0/3395320012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeefb070 0x5578ef2a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.910+0000 7feeb1590740 1 -- 172.21.15.53:0/3395320012 >> 172.21.15.53:0/3395320012 conn(0x5578eeeef460 msgr2=0x5578ef29e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.910+0000 7feeb1590740 1 -- 172.21.15.53:0/3395320012 shutdown_connections 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.910+0000 7feeb1590740 1 -- 172.21.15.53:0/3395320012 wait complete. 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.910+0000 7feeb1590740 1 -- start start 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.910+0000 7feeb1590740 1 Processor -- start 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feeb1590740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeed21b0 0x5578ef2aba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feeb1590740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 0x5578ef2abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feeb1590740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeefb070 0x5578ef2b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feeb1590740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5578ef069700 con 0x5578eeed21b0 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feeb1590740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5578ef18d750 con 0x5578eeefb070 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feeb1590740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5578ef2aea90 con 0x5578eeeda390 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feeb1590740 10 client.0 _ll_register_callbacks cb 0x5578ef1bce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feea8db7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeed21b0 0x5578ef2aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feea8db7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeed21b0 0x5578ef2aba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37094/0 (socket says 172.21.15.53:37094) 2024-08-31T06:13:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feea8db7640 1 -- 172.21.15.53:0/763834415 learned_addr learned my addr 172.21.15.53:0/763834415 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feea95b8640 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeefb070 0x5578ef2b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feea3fff640 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 0x5578ef2abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feea8db7640 1 -- 172.21.15.53:0/763834415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 msgr2=0x5578ef2abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feea8db7640 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 0x5578ef2abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feea8db7640 1 -- 172.21.15.53:0/763834415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeefb070 msgr2=0x5578ef2b7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feea8db7640 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeefb070 0x5578ef2b7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feea8db7640 1 -- 172.21.15.53:0/763834415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578ef1c6900 con 0x5578eeed21b0 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.911+0000 7feea3fff640 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 0x5578ef2abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.912+0000 7feea8db7640 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeed21b0 0x5578ef2aba80 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fee9800d740 tx=0x7fee980aafa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c405b165958add server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.912+0000 7fee83fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.912+0000 7fee83fff640 1 -- 172.21.15.53:0/763834415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98020050 con 0x5578eeed21b0 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.912+0000 7fee83fff640 1 -- 172.21.15.53:0/763834415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7fee980ce0b0 con 0x5578eeed21b0 2024-08-31T06:13:44.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.912+0000 7feeb1590740 1 -- 172.21.15.53:0/763834415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5578ef2195d0 con 0x5578eeed21b0 2024-08-31T06:13:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.912+0000 7fee83fff640 1 -- 172.21.15.53:0/763834415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fee980a7ca0 con 0x5578eeed21b0 2024-08-31T06:13:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.912+0000 7feeb1590740 10 client.18354 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.912+0000 7feeb1590740 1 -- 172.21.15.53:0/763834415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5578ef2ba860 con 0x5578eeed21b0 2024-08-31T06:13:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.913+0000 7fee83fff640 1 -- 172.21.15.53:0/763834415 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5578ef2195d0 con 0x5578eeed21b0 2024-08-31T06:13:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.913+0000 7fee83fff640 1 -- 172.21.15.53:0/763834415 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7fee9805b230 con 0x5578eeed21b0 2024-08-31T06:13:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.913+0000 7feeb1590740 10 client.18354 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.913+0000 7feeb1590740 10 client.18354 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:13:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.913+0000 7feeb1590740 20 client.18354 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.913+0000 7feeb1590740 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5578eeeb99f0 0x5578ef2be290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.913+0000 7feeb1590740 4 client.18354 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:44.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.913+0000 7feeb1590740 1 -- 172.21.15.53:0/763834415 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578ef215070 con 0x5578eeeb99f0 2024-08-31T06:13:44.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.913+0000 7feea3fff640 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5578eeeb99f0 0x5578ef2be290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.914+0000 7fee83fff640 10 client.18354 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:13:44.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.914+0000 7feea3fff640 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5578eeeb99f0 0x5578ef2be290 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=524424a726756841 server_cookie=ccdaaf751f02f970 in_seq=0 out_seq=0 2024-08-31T06:13:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.914+0000 7fee83fff640 1 -- 172.21.15.53:0/763834415 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578ef215070 con 0x5578eeeb99f0 2024-08-31T06:13:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.914+0000 7fee83fff640 10 client.18354 handle_command_reply: tid=0 2024-08-31T06:13:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.914+0000 7feeb1590740 1 client.18354 shutdown 2024-08-31T06:13:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7feeb1590740 1 -- 172.21.15.53:0/763834415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeed21b0 msgr2=0x5578ef2aba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7feeb1590740 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeed21b0 0x5578ef2aba80 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fee9800d740 tx=0x7fee980aafa0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7feeb1590740 1 -- 172.21.15.53:0/763834415 shutdown_connections 2024-08-31T06:13:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7feeb1590740 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5578eeeb99f0 0x5578ef2be290 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7feeb1590740 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeefb070 0x5578ef2b7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7fee83fff640 0 client.18354 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:13:44.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7feeb1590740 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeda390 0x5578ef2abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7feeb1590740 1 --2- 172.21.15.53:0/763834415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeed21b0 0x5578ef2aba80 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7feeb1590740 1 -- 172.21.15.53:0/763834415 >> 172.21.15.53:0/763834415 conn(0x5578eeeef460 msgr2=0x5578ef2a34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:44.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7feeb1590740 1 -- 172.21.15.53:0/763834415 shutdown_connections 2024-08-31T06:13:44.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7feeb1590740 1 -- 172.21.15.53:0/763834415 wait complete. 2024-08-31T06:13:44.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.915+0000 7feeb1590740 20 client.18354 trim_cache size 0 max 16384 2024-08-31T06:13:44.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.929+0000 7feeb1590740 1 Processor -- start 2024-08-31T06:13:44.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.929+0000 7feeb1590740 1 -- start start 2024-08-31T06:13:44.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.929+0000 7feeb1590740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeef460 0x5578ef2a3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.929+0000 7feeb1590740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeb99f0 0x5578ef2a3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.929+0000 7feeb1590740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeed21b0 0x5578ef2a8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.929+0000 7feeb1590740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feea41b16e0 con 0x5578eeeef460 2024-08-31T06:13:44.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.929+0000 7feeb1590740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feea41b3340 con 0x5578eeed21b0 2024-08-31T06:13:44.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.929+0000 7feeb1590740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feea41b1db0 con 0x5578eeeb99f0 2024-08-31T06:13:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.929+0000 7feea8db7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeef460 0x5578ef2a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7feea3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeb99f0 0x5578ef2a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7feea8db7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeef460 0x5578ef2a3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37106/0 (socket says 172.21.15.53:37106) 2024-08-31T06:13:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7feea3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeb99f0 0x5578ef2a3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34016/0 (socket says 172.21.15.53:34016) 2024-08-31T06:13:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7feea8db7640 1 -- 172.21.15.53:0/3408321021 learned_addr learned my addr 172.21.15.53:0/3408321021 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7feea95b8640 1 --2- 172.21.15.53:0/3408321021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeed21b0 0x5578ef2a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7feea3fff640 1 -- 172.21.15.53:0/3408321021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeed21b0 msgr2=0x5578ef2a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7feea3fff640 1 --2- 172.21.15.53:0/3408321021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeed21b0 0x5578ef2a8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7feea3fff640 1 -- 172.21.15.53:0/3408321021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeef460 msgr2=0x5578ef2a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:44.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7feea3fff640 1 --2- 172.21.15.53:0/3408321021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeef460 0x5578ef2a3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7feea3fff640 1 -- 172.21.15.53:0/3408321021 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578ef2983d0 con 0x5578eeeb99f0 2024-08-31T06:13:44.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7feea3fff640 1 --2- 172.21.15.53:0/3408321021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeb99f0 0x5578ef2a3950 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fee90005940 tx=0x7fee9002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=766dddd7f4496a29 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:44.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7fee8e7fc640 1 -- 172.21.15.53:0/3408321021 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee90035040 con 0x5578eeeb99f0 2024-08-31T06:13:44.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7fee8e7fc640 1 -- 172.21.15.53:0/3408321021 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee900041d0 con 0x5578eeeb99f0 2024-08-31T06:13:44.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.930+0000 7fee8e7fc640 1 -- 172.21.15.53:0/3408321021 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee90040040 con 0x5578eeeb99f0 2024-08-31T06:13:44.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.931+0000 7feeb1590740 1 -- 172.21.15.53:0/3408321021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeb99f0 msgr2=0x5578ef2a3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.931+0000 7feeb1590740 1 --2- 172.21.15.53:0/3408321021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeb99f0 0x5578ef2a3950 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fee90005940 tx=0x7fee9002a410 comp rx=0 tx=0).stop 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.931+0000 7feeb1590740 1 -- 172.21.15.53:0/3408321021 shutdown_connections 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.931+0000 7feeb1590740 1 --2- 172.21.15.53:0/3408321021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeed21b0 0x5578ef2a8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.931+0000 7feeb1590740 1 --2- 172.21.15.53:0/3408321021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeeb99f0 0x5578ef2a3950 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.931+0000 7feeb1590740 1 --2- 172.21.15.53:0/3408321021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeef460 0x5578ef2a3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.931+0000 7feeb1590740 1 -- 172.21.15.53:0/3408321021 >> 172.21.15.53:0/3408321021 conn(0x5578ef2a73d0 msgr2=0x5578ef2aa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.931+0000 7feeb1590740 1 -- 172.21.15.53:0/3408321021 shutdown_connections 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.932+0000 7feeb1590740 1 -- 172.21.15.53:0/3408321021 wait complete. 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.932+0000 7feeb1590740 1 -- start start 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.932+0000 7feeb1590740 1 Processor -- start 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.932+0000 7feeb1590740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeb99f0 0x5578ef2b4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feeb1590740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeed21b0 0x5578ef2afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feeb1590740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeeef460 0x5578ef2b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feeb1590740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feea41b2bb0 con 0x5578eeeb99f0 2024-08-31T06:13:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feeb1590740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feea41b2480 con 0x5578eeeef460 2024-08-31T06:13:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feeb1590740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feea41af6e0 con 0x5578eeed21b0 2024-08-31T06:13:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea8db7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeb99f0 0x5578ef2b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feeb1590740 10 client.0 _ll_register_callbacks cb 0x7fee98003690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea8db7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeb99f0 0x5578ef2b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37116/0 (socket says 172.21.15.53:37116) 2024-08-31T06:13:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea8db7640 1 -- 172.21.15.53:0/2564929402 learned_addr learned my addr 172.21.15.53:0/2564929402 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:44.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea3fff640 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeed21b0 0x5578ef2afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea95b8640 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeeef460 0x5578ef2b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea8db7640 1 -- 172.21.15.53:0/2564929402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeed21b0 msgr2=0x5578ef2afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:44.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea8db7640 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeed21b0 0x5578ef2afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea8db7640 1 -- 172.21.15.53:0/2564929402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeeef460 msgr2=0x5578ef2b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:44.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea8db7640 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeeef460 0x5578ef2b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea8db7640 1 -- 172.21.15.53:0/2564929402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578ef2b0790 con 0x5578eeeb99f0 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea95b8640 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeeef460 0x5578ef2b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7feea8db7640 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeb99f0 0x5578ef2b4540 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fee980e26b0 tx=0x7fee980a7620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14aa73f3329b75bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.933+0000 7fee83fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.934+0000 7fee83fff640 1 -- 172.21.15.53:0/2564929402 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98020040 con 0x5578eeeb99f0 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.934+0000 7fee83fff640 1 -- 172.21.15.53:0/2564929402 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7fee980a71a0 con 0x5578eeeb99f0 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.934+0000 7feeb1590740 1 -- 172.21.15.53:0/2564929402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee900041d0 con 0x5578eeeb99f0 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.934+0000 7fee83fff640 1 -- 172.21.15.53:0/2564929402 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fee980aadc0 con 0x5578eeeb99f0 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.934+0000 7feeb1590740 10 client.18360 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.934+0000 7feeb1590740 1 -- 172.21.15.53:0/2564929402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5578ef328c50 con 0x5578eeeb99f0 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.934+0000 7fee83fff640 1 -- 172.21.15.53:0/2564929402 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee900041d0 con 0x5578eeeb99f0 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.934+0000 7fee83fff640 1 -- 172.21.15.53:0/2564929402 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7fee980aa8b0 con 0x5578eeeb99f0 2024-08-31T06:13:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.935+0000 7feeb1590740 10 client.18360 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:44.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.935+0000 7feeb1590740 10 client.18360 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:13:44.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.935+0000 7feeb1590740 20 client.18360 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:44.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.935+0000 7feeb1590740 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5578eeeda390 0x5578ef32b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:44.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.935+0000 7feeb1590740 4 client.18360 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:13:44.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.935+0000 7feeb1590740 1 -- 172.21.15.53:0/2564929402 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5578ef2127b0 con 0x5578eeeda390 2024-08-31T06:13:44.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.935+0000 7feea3fff640 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5578eeeda390 0x5578ef32b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:44.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.935+0000 7fee83fff640 10 client.18360 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:13:44.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.935+0000 7feea3fff640 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5578eeeda390 0x5578ef32b4a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7cec3c80ff74d41 server_cookie=5e44af4be58ff743 in_seq=0 out_seq=0 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7fee83fff640 1 -- 172.21.15.53:0/2564929402 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5578ef2127b0 con 0x5578eeeda390 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7fee83fff640 10 client.18360 handle_command_reply: tid=0 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 1 client.18360 shutdown 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 1 -- 172.21.15.53:0/2564929402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeb99f0 msgr2=0x5578ef2b4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeb99f0 0x5578ef2b4540 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fee980e26b0 tx=0x7fee980a7620 comp rx=0 tx=0).stop 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 1 -- 172.21.15.53:0/2564929402 shutdown_connections 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5578eeeda390 0x5578ef32b4a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5578eeeef460 0x5578ef2b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5578eeed21b0 0x5578ef2afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 1 --2- 172.21.15.53:0/2564929402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578eeeb99f0 0x5578ef2b4540 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7fee83fff640 0 client.18360 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 1 -- 172.21.15.53:0/2564929402 >> 172.21.15.53:0/2564929402 conn(0x5578ef2a73d0 msgr2=0x5578ef2aa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:44.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 1 -- 172.21.15.53:0/2564929402 shutdown_connections 2024-08-31T06:13:44.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 1 -- 172.21.15.53:0/2564929402 wait complete. 2024-08-31T06:13:44.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.936+0000 7feeb1590740 20 client.18360 trim_cache size 0 max 16384 2024-08-31T06:13:44.945 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:13:44.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 -- 172.21.15.53:0/3299913134 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee940b4ca0 msgr2=0x7fee940b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:44.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee940b4ca0 0x7fee940b71b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009fd0 tx=0x7fee9c004ab0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 -- 172.21.15.53:0/3299913134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea41047d0 msgr2=0x7feea419c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:44.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea41047d0 0x7feea419c3a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee9800d770 tx=0x7fee9800dc30 comp rx=0 tx=0).stop 2024-08-31T06:13:44.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 -- 172.21.15.53:0/3299913134 shutdown_connections 2024-08-31T06:13:44.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fee940b4ca0 0x7fee940b71b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feea410dc00 0x7feea41a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feea4105120 0x7feea419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 --2- 172.21.15.53:0/3299913134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feea41047d0 0x7feea419c3a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:44.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 -- 172.21.15.53:0/3299913134 >> 172.21.15.53:0/3299913134 conn(0x7feea4079500 msgr2=0x7feea4100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:44.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 -- 172.21.15.53:0/3299913134 shutdown_connections 2024-08-31T06:13:44.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:44.937+0000 7feeab01b640 1 -- 172.21.15.53:0/3299913134 wait complete. 2024-08-31T06:13:44.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 150533 1.58 MB/sec execute 334 sec latency 70.298 ms 2024-08-31T06:13:45.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.604+0000 7f044f88b640 1 -- 172.21.15.53:0/1435216893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0448102770 msgr2=0x7f0448102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:45.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.604+0000 7f044f88b640 1 --2- 172.21.15.53:0/1435216893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0448102770 0x7f0448102b80 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f0444009900 tx=0x7f044402a410 comp rx=0 tx=0).stop 2024-08-31T06:13:45.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.604+0000 7f044f88b640 1 -- 172.21.15.53:0/1435216893 shutdown_connections 2024-08-31T06:13:45.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.604+0000 7f044f88b640 1 --2- 172.21.15.53:0/1435216893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04481089f0 0x7f044810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.604+0000 7f044f88b640 1 --2- 172.21.15.53:0/1435216893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04481080a0 0x7f04481084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.604+0000 7f044f88b640 1 --2- 172.21.15.53:0/1435216893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0448102770 0x7f0448102b80 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.604+0000 7f044f88b640 1 -- 172.21.15.53:0/1435216893 >> 172.21.15.53:0/1435216893 conn(0x7f044807a490 msgr2=0x7f044807a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:45.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.604+0000 7f044f88b640 1 -- 172.21.15.53:0/1435216893 shutdown_connections 2024-08-31T06:13:45.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.604+0000 7f044f88b640 1 -- 172.21.15.53:0/1435216893 wait complete. 2024-08-31T06:13:45.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044f88b640 1 Processor -- start 2024-08-31T06:13:45.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044f88b640 1 -- start start 2024-08-31T06:13:45.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044f88b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0448102770 0x7f044819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044f88b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04481080a0 0x7f044819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044f88b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04481089f0 0x7f044819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044f88b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0448112550 con 0x7f0448102770 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044f88b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f04481123d0 con 0x7f04481089f0 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044f88b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04481126d0 con 0x7f04481080a0 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044d627640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0448102770 0x7f044819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044d627640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0448102770 0x7f044819af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37122/0 (socket says 172.21.15.53:37122) 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044d627640 1 -- 172.21.15.53:0/738323962 learned_addr learned my addr 172.21.15.53:0/738323962 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.605+0000 7f044de28640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04481089f0 0x7f044819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f044ce26640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04481080a0 0x7f044819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f044d627640 1 -- 172.21.15.53:0/738323962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04481080a0 msgr2=0x7f044819b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f044d627640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04481080a0 0x7f044819b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f044d627640 1 -- 172.21.15.53:0/738323962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04481089f0 msgr2=0x7f044819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f044d627640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04481089f0 0x7f044819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f044d627640 1 -- 172.21.15.53:0/738323962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04481a61b0 con 0x7f0448102770 2024-08-31T06:13:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f044d627640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0448102770 0x7f044819af20 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f0444009230 tx=0x7f04440319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f043e7fc640 1 -- 172.21.15.53:0/738323962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044403f030 con 0x7f0448102770 2024-08-31T06:13:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f044f88b640 1 -- 172.21.15.53:0/738323962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04481a6440 con 0x7f0448102770 2024-08-31T06:13:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f043e7fc640 1 -- 172.21.15.53:0/738323962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04440043d0 con 0x7f0448102770 2024-08-31T06:13:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f043e7fc640 1 -- 172.21.15.53:0/738323962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444035070 con 0x7f0448102770 2024-08-31T06:13:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.606+0000 7f044f88b640 1 -- 172.21.15.53:0/738323962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04481a6980 con 0x7f0448102770 2024-08-31T06:13:45.612 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:45 smithi053 ceph-mon[18924]: pgmap v593: 97 pgs: 97 active+clean; 86 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 658 KiB/s wr, 73 op/s 2024-08-31T06:13:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f04567f7740 1 Processor -- start 2024-08-31T06:13:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f04567f7740 1 -- start start 2024-08-31T06:13:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f043e7fc640 1 -- 172.21.15.53:0/738323962 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0444042030 con 0x7f0448102770 2024-08-31T06:13:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f04567f7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 0x55da2425eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f04567f7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e922f0 0x55da2425f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f04567f7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e9a4d0 0x55da2425f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f04567f7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55da241d4000 con 0x55da23ebb1b0 2024-08-31T06:13:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f04567f7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55da241c3590 con 0x55da23e9a4d0 2024-08-31T06:13:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f04567f7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55da241c7540 con 0x55da23e922f0 2024-08-31T06:13:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f044de28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 0x55da2425eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f044de28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 0x55da2425eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37132/0 (socket says 172.21.15.53:37132) 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f044de28640 1 -- 172.21.15.53:0/796587519 learned_addr learned my addr 172.21.15.53:0/796587519 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f044d627640 1 --2- 172.21.15.53:0/796587519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e922f0 0x55da2425f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.610+0000 7f044ce26640 1 --2- 172.21.15.53:0/796587519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e9a4d0 0x55da2425f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.611+0000 7f044de28640 1 -- 172.21.15.53:0/796587519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e922f0 msgr2=0x55da2425f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.611+0000 7f044de28640 1 --2- 172.21.15.53:0/796587519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e922f0 0x55da2425f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.611+0000 7f044de28640 1 -- 172.21.15.53:0/796587519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e9a4d0 msgr2=0x55da2425f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.611+0000 7f044de28640 1 --2- 172.21.15.53:0/796587519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e9a4d0 0x55da2425f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.611+0000 7f044de28640 1 -- 172.21.15.53:0/796587519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da23f26790 con 0x55da23ebb1b0 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.611+0000 7f044ce26640 1 --2- 172.21.15.53:0/796587519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e9a4d0 0x55da2425f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.611+0000 7f044de28640 1 --2- 172.21.15.53:0/796587519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 0x55da2425eac0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f0440009fd0 tx=0x7f04400118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5695769982e63448 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.611+0000 7f043e7fc640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04340b4ca0 0x7f04340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.611+0000 7f044d627640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04340b4ca0 0x7f04340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.611+0000 7f043e7fc640 1 -- 172.21.15.53:0/738323962 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f0444105990 con 0x7f0448102770 2024-08-31T06:13:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.612+0000 7f044d627640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04340b4ca0 0x7f04340b71b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0444103170 tx=0x7f0444109430 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.613+0000 7f04337fe640 1 -- 172.21.15.53:0/796587519 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440004d20 con 0x55da23ebb1b0 2024-08-31T06:13:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.613+0000 7f04337fe640 1 -- 172.21.15.53:0/796587519 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0440004050 con 0x55da23ebb1b0 2024-08-31T06:13:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.613+0000 7f04337fe640 1 -- 172.21.15.53:0/796587519 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440005280 con 0x55da23ebb1b0 2024-08-31T06:13:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.614+0000 7f04567f7740 1 -- 172.21.15.53:0/796587519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 msgr2=0x55da2425eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.614+0000 7f04567f7740 1 --2- 172.21.15.53:0/796587519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 0x55da2425eac0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f0440009fd0 tx=0x7f04400118d0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.614+0000 7f04567f7740 1 -- 172.21.15.53:0/796587519 shutdown_connections 2024-08-31T06:13:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.614+0000 7f04567f7740 1 --2- 172.21.15.53:0/796587519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e9a4d0 0x55da2425f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.614+0000 7f04567f7740 1 --2- 172.21.15.53:0/796587519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e922f0 0x55da2425f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.614+0000 7f04567f7740 1 --2- 172.21.15.53:0/796587519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 0x55da2425eac0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.614+0000 7f04567f7740 1 -- 172.21.15.53:0/796587519 >> 172.21.15.53:0/796587519 conn(0x55da23eaf300 msgr2=0x55da2425c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.614+0000 7f04567f7740 1 -- 172.21.15.53:0/796587519 shutdown_connections 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.614+0000 7f04567f7740 1 -- 172.21.15.53:0/796587519 wait complete. 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.614+0000 7f04567f7740 1 -- start start 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f04567f7740 1 Processor -- start 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f04567f7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e922f0 0x55da2426a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f04567f7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e9a4d0 0x55da2426abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f04567f7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 0x55da24276530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f04567f7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55da240fcab0 con 0x55da23ebb1b0 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f04567f7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55da2414a680 con 0x55da23e922f0 2024-08-31T06:13:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f04567f7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55da2426d240 con 0x55da23e9a4d0 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f04567f7740 10 client.0 _ll_register_callbacks cb 0x55da23ed2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f044de28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 0x55da24276530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f044de28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 0x55da24276530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37134/0 (socket says 172.21.15.53:37134) 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f044de28640 1 -- 172.21.15.53:0/2469797866 learned_addr learned my addr 172.21.15.53:0/2469797866 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f044ce26640 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e9a4d0 0x55da2426abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.615+0000 7f044de28640 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e922f0 0x55da2426a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f044ce26640 1 -- 172.21.15.53:0/2469797866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e922f0 msgr2=0x55da2426a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f044ce26640 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e922f0 0x55da2426a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f044ce26640 1 -- 172.21.15.53:0/2469797866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 msgr2=0x55da24276530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f044ce26640 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 0x55da24276530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f044ce26640 1 -- 172.21.15.53:0/2469797866 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da23f9f620 con 0x55da23e9a4d0 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f044ce26640 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e9a4d0 0x55da2426abb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f044806c490 tx=0x7f0438012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4f68396f49b1576 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f0430ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:13:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f0430ff9640 1 -- 172.21.15.53:0/2469797866 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438004320 con 0x55da23e9a4d0 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f0430ff9640 1 -- 172.21.15.53:0/2469797866 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f0438011970 con 0x55da23e9a4d0 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f04567f7740 1 -- 172.21.15.53:0/2469797866 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0440004050 con 0x55da23e9a4d0 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f0430ff9640 1 -- 172.21.15.53:0/2469797866 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f04380044c0 con 0x55da23e9a4d0 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f04567f7740 10 client.27613 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.616+0000 7f04567f7740 1 -- 172.21.15.53:0/2469797866 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55da242792b0 con 0x55da23e9a4d0 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.617+0000 7f0430ff9640 1 -- 172.21.15.53:0/2469797866 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0440004050 con 0x55da23e9a4d0 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.617+0000 7f0430ff9640 1 -- 172.21.15.53:0/2469797866 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f043800f440 con 0x55da23e9a4d0 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.617+0000 7f04567f7740 10 client.27613 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.617+0000 7f04567f7740 10 client.27613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.617+0000 7f04567f7740 20 client.27613 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.617+0000 7f04567f7740 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55da23e79d80 0x55da2427c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.617+0000 7f04567f7740 4 client.27613 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.617+0000 7f04567f7740 1 -- 172.21.15.53:0/2469797866 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da241d5f50 con 0x55da23e79d80 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.617+0000 7f044de28640 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55da23e79d80 0x55da2427c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.617+0000 7f0430ff9640 10 client.27613 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.617+0000 7f044de28640 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55da23e79d80 0x55da2427c910 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16f4353719d2e018 server_cookie=1452f778549e88d5 in_seq=0 out_seq=0 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f0430ff9640 1 -- 172.21.15.53:0/2469797866 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da241d5f50 con 0x55da23e79d80 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f0430ff9640 10 client.27613 handle_command_reply: tid=0 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f04567f7740 1 client.27613 shutdown 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f04567f7740 1 -- 172.21.15.53:0/2469797866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e9a4d0 msgr2=0x55da2426abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f04567f7740 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e9a4d0 0x55da2426abb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f044806c490 tx=0x7f0438012b60 comp rx=0 tx=0).stop 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f04567f7740 1 -- 172.21.15.53:0/2469797866 shutdown_connections 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f04567f7740 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55da23e79d80 0x55da2427c910 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f04567f7740 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23ebb1b0 0x55da24276530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f04567f7740 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e9a4d0 0x55da2426abb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f0430ff9640 0 client.27613 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f04567f7740 1 --2- 172.21.15.53:0/2469797866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e922f0 0x55da2426a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.618+0000 7f04567f7740 1 -- 172.21.15.53:0/2469797866 >> 172.21.15.53:0/2469797866 conn(0x55da23eaf300 msgr2=0x55da2425faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.619+0000 7f04567f7740 1 -- 172.21.15.53:0/2469797866 shutdown_connections 2024-08-31T06:13:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.619+0000 7f04567f7740 1 -- 172.21.15.53:0/2469797866 wait complete. 2024-08-31T06:13:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.619+0000 7f04567f7740 20 client.27613 trim_cache size 0 max 16384 2024-08-31T06:13:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f04567f7740 1 Processor -- start 2024-08-31T06:13:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f04567f7740 1 -- start start 2024-08-31T06:13:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f04567f7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e79d80 0x55da24263bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f04567f7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e922f0 0x55da24264130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f04567f7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e9a4d0 0x55da24276430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f04567f7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f04481af4b0 con 0x55da23e922f0 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f04567f7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f04481b1110 con 0x55da23e79d80 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f04567f7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04481afb80 con 0x55da23e9a4d0 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f044de28640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e79d80 0x55da24263bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f044ce26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e922f0 0x55da24264130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f044de28640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e79d80 0x55da24263bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36946/0 (socket says 172.21.15.53:36946) 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f044de28640 1 -- 172.21.15.53:0/61674743 learned_addr learned my addr 172.21.15.53:0/61674743 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.635+0000 7f044de28640 1 --2- 172.21.15.53:0/61674743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e9a4d0 0x55da24276430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.636+0000 7f044de28640 1 -- 172.21.15.53:0/61674743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e9a4d0 msgr2=0x55da24276430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.636+0000 7f044de28640 1 --2- 172.21.15.53:0/61674743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e9a4d0 0x55da24276430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.636+0000 7f044de28640 1 -- 172.21.15.53:0/61674743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e922f0 msgr2=0x55da24264130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.636+0000 7f044de28640 1 --2- 172.21.15.53:0/61674743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e922f0 0x55da24264130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.636+0000 7f044de28640 1 -- 172.21.15.53:0/61674743 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da24256800 con 0x55da23e79d80 2024-08-31T06:13:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.636+0000 7f044de28640 1 --2- 172.21.15.53:0/61674743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e79d80 0x55da24263bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0440009fd0 tx=0x7f0440009be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbab16a30c0d65ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.636+0000 7f0432ffd640 1 -- 172.21.15.53:0/61674743 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440004250 con 0x55da23e79d80 2024-08-31T06:13:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.636+0000 7f0432ffd640 1 -- 172.21.15.53:0/61674743 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0440003e30 con 0x55da23e79d80 2024-08-31T06:13:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.636+0000 7f0432ffd640 1 -- 172.21.15.53:0/61674743 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044000fe10 con 0x55da23e79d80 2024-08-31T06:13:45.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.637+0000 7f04567f7740 1 -- 172.21.15.53:0/61674743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e79d80 msgr2=0x55da24263bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:45.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.637+0000 7f04567f7740 1 --2- 172.21.15.53:0/61674743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e79d80 0x55da24263bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0440009fd0 tx=0x7f0440009be0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.637+0000 7f04567f7740 1 -- 172.21.15.53:0/61674743 shutdown_connections 2024-08-31T06:13:45.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.637+0000 7f04567f7740 1 --2- 172.21.15.53:0/61674743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e9a4d0 0x55da24276430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.637+0000 7f04567f7740 1 --2- 172.21.15.53:0/61674743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e922f0 0x55da24264130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.637+0000 7f04567f7740 1 --2- 172.21.15.53:0/61674743 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e79d80 0x55da24263bf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.637+0000 7f04567f7740 1 -- 172.21.15.53:0/61674743 >> 172.21.15.53:0/61674743 conn(0x55da23eaf300 msgr2=0x55da24268cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:45.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.637+0000 7f04567f7740 1 -- 172.21.15.53:0/61674743 shutdown_connections 2024-08-31T06:13:45.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.637+0000 7f04567f7740 1 -- 172.21.15.53:0/61674743 wait complete. 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.637+0000 7f04567f7740 1 -- start start 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.637+0000 7f04567f7740 1 Processor -- start 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f04567f7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e79d80 0x55da242729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f04567f7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e922f0 0x55da2426dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f04567f7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e9a4d0 0x55da2426e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f04567f7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f04481b0980 con 0x55da23e79d80 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f04567f7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f04481b0250 con 0x55da23e9a4d0 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f04567f7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04481ad4b0 con 0x55da23e922f0 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f04567f7740 10 client.0 _ll_register_callbacks cb 0x7f0438009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f044de28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e79d80 0x55da242729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f044de28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e79d80 0x55da242729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37154/0 (socket says 172.21.15.53:37154) 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f044de28640 1 -- 172.21.15.53:0/3172555677 learned_addr learned my addr 172.21.15.53:0/3172555677 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f044de28640 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e9a4d0 0x55da2426e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f044ce26640 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e922f0 0x55da2426dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f044de28640 1 -- 172.21.15.53:0/3172555677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e922f0 msgr2=0x55da2426dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f044de28640 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e922f0 0x55da2426dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f044de28640 1 -- 172.21.15.53:0/3172555677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e9a4d0 msgr2=0x55da2426e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f044de28640 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e9a4d0 0x55da2426e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f044de28640 1 -- 172.21.15.53:0/3172555677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da2425d350 con 0x55da23e79d80 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.638+0000 7f044ce26640 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e922f0 0x55da2426dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.639+0000 7f044de28640 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e79d80 0x55da242729f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f04400096c0 tx=0x7f0440000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fdf3afb91bea86 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.639+0000 7f0430ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.639+0000 7f0430ff9640 1 -- 172.21.15.53:0/3172555677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440044060 con 0x55da23e79d80 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.639+0000 7f0430ff9640 1 -- 172.21.15.53:0/3172555677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f044000fd50 con 0x55da23e79d80 2024-08-31T06:13:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.639+0000 7f04567f7740 1 -- 172.21.15.53:0/3172555677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0440003e30 con 0x55da23e79d80 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.639+0000 7f0430ff9640 1 -- 172.21.15.53:0/3172555677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f044000f4e0 con 0x55da23e79d80 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.639+0000 7f04567f7740 10 client.18378 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.639+0000 7f04567f7740 1 -- 172.21.15.53:0/3172555677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55da242e6dc0 con 0x55da23e79d80 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.639+0000 7f0430ff9640 1 -- 172.21.15.53:0/3172555677 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0440003e30 con 0x55da23e79d80 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.639+0000 7f0430ff9640 1 -- 172.21.15.53:0/3172555677 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f0440037030 con 0x55da23e79d80 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.640+0000 7f04567f7740 10 client.18378 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.640+0000 7f04567f7740 10 client.18378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.640+0000 7f04567f7740 20 client.18378 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.640+0000 7f04567f7740 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55da23ebb1b0 0x55da242e9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.640+0000 7f04567f7740 4 client.18378 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.640+0000 7f04567f7740 1 -- 172.21.15.53:0/3172555677 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55da241d19f0 con 0x55da23ebb1b0 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.640+0000 7f044ce26640 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55da23ebb1b0 0x55da242e9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.640+0000 7f0430ff9640 10 client.18378 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.640+0000 7f044ce26640 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55da23ebb1b0 0x55da242e9310 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdea6cb95b692a1e server_cookie=8f7375370c5d6596 in_seq=0 out_seq=0 2024-08-31T06:13:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f0430ff9640 1 -- 172.21.15.53:0/3172555677 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55da241d19f0 con 0x55da23ebb1b0 2024-08-31T06:13:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f0430ff9640 10 client.18378 handle_command_reply: tid=0 2024-08-31T06:13:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 1 client.18378 shutdown 2024-08-31T06:13:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 1 -- 172.21.15.53:0/3172555677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e79d80 msgr2=0x55da242729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e79d80 0x55da242729f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f04400096c0 tx=0x7f0440000f40 comp rx=0 tx=0).stop 2024-08-31T06:13:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 1 -- 172.21.15.53:0/3172555677 shutdown_connections 2024-08-31T06:13:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55da23ebb1b0 0x55da242e9310 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55da23e9a4d0 0x55da2426e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f0430ff9640 0 client.18378 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da23e922f0 0x55da2426dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 1 --2- 172.21.15.53:0/3172555677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da23e79d80 0x55da242729f0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 1 -- 172.21.15.53:0/3172555677 >> 172.21.15.53:0/3172555677 conn(0x55da23eaf300 msgr2=0x55da24263bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 1 -- 172.21.15.53:0/3172555677 shutdown_connections 2024-08-31T06:13:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 1 -- 172.21.15.53:0/3172555677 wait complete. 2024-08-31T06:13:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.668+0000 7f04567f7740 20 client.18378 trim_cache size 0 max 16384 2024-08-31T06:13:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:13:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:13:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:13:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:13:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 -- 172.21.15.53:0/738323962 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04340b4ca0 msgr2=0x7f04340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04340b4ca0 0x7f04340b71b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0444103170 tx=0x7f0444109430 comp rx=0 tx=0).stop 2024-08-31T06:13:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 -- 172.21.15.53:0/738323962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0448102770 msgr2=0x7f044819af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0448102770 0x7f044819af20 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f0444009230 tx=0x7f04440319a0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 -- 172.21.15.53:0/738323962 shutdown_connections 2024-08-31T06:13:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f04340b4ca0 0x7f04340b71b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04481089f0 0x7f044819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04481080a0 0x7f044819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 --2- 172.21.15.53:0/738323962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0448102770 0x7f044819af20 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 -- 172.21.15.53:0/738323962 >> 172.21.15.53:0/738323962 conn(0x7f044807a490 msgr2=0x7f0448106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 -- 172.21.15.53:0/738323962 shutdown_connections 2024-08-31T06:13:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:45.669+0000 7f044f88b640 1 -- 172.21.15.53:0/738323962 wait complete. 2024-08-31T06:13:45.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:13:45.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:45 smithi130 ceph-mon[22266]: pgmap v593: 97 pgs: 97 active+clean; 86 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 658 KiB/s wr, 73 op/s 2024-08-31T06:13:45.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:45 smithi153 ceph-mon[22320]: pgmap v593: 97 pgs: 97 active+clean; 86 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 658 KiB/s wr, 73 op/s 2024-08-31T06:13:45.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 151045 1.58 MB/sec execute 335 sec latency 26.137 ms 2024-08-31T06:13:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:46.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.541+0000 7f407de04640 1 -- 172.21.15.53:0/3651724288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4078104750 msgr2=0x7f4078104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:46.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.541+0000 7f407de04640 1 --2- 172.21.15.53:0/3651724288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4078104750 0x7f4078104b60 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f4068009900 tx=0x7f406802a410 comp rx=0 tx=0).stop 2024-08-31T06:13:46.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.541+0000 7f407de04640 1 -- 172.21.15.53:0/3651724288 shutdown_connections 2024-08-31T06:13:46.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.541+0000 7f407de04640 1 --2- 172.21.15.53:0/3651724288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407810dbb0 0x7f40781100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.541+0000 7f407de04640 1 --2- 172.21.15.53:0/3651724288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40781050a0 0x7f407810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.541+0000 7f407de04640 1 --2- 172.21.15.53:0/3651724288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4078104750 0x7f4078104b60 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.541+0000 7f407de04640 1 -- 172.21.15.53:0/3651724288 >> 172.21.15.53:0/3651724288 conn(0x7f40780794d0 msgr2=0x7f40780798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:46.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.541+0000 7f407de04640 1 -- 172.21.15.53:0/3651724288 shutdown_connections 2024-08-31T06:13:46.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.541+0000 7f407de04640 1 -- 172.21.15.53:0/3651724288 wait complete. 2024-08-31T06:13:46.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.541+0000 7f407de04640 1 Processor -- start 2024-08-31T06:13:46.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f407de04640 1 -- start start 2024-08-31T06:13:46.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f407de04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4078104750 0x7f4078103ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f407de04640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40781050a0 0x7f4078102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f40777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4078104750 0x7f4078103ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f40777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4078104750 0x7f4078103ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37180/0 (socket says 172.21.15.53:37180) 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f407de04640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407810dbb0 0x7f40781029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f40777fe640 1 -- 172.21.15.53:0/2484264354 learned_addr learned my addr 172.21.15.53:0/2484264354 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f407de04640 1 -- 172.21.15.53:0/2484264354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40781136e0 con 0x7f4078104750 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f407de04640 1 -- 172.21.15.53:0/2484264354 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4078113560 con 0x7f40781050a0 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f407de04640 1 -- 172.21.15.53:0/2484264354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4078113860 con 0x7f407810dbb0 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f4076ffd640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40781050a0 0x7f4078102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.542+0000 7f4077fff640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407810dbb0 0x7f40781029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.543+0000 7f40777fe640 1 -- 172.21.15.53:0/2484264354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407810dbb0 msgr2=0x7f40781029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:46.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.543+0000 7f40777fe640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407810dbb0 0x7f40781029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.543+0000 7f40777fe640 1 -- 172.21.15.53:0/2484264354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40781050a0 msgr2=0x7f4078102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:46.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.543+0000 7f40777fe640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40781050a0 0x7f4078102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.543+0000 7f40777fe640 1 -- 172.21.15.53:0/2484264354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40781031f0 con 0x7f4078104750 2024-08-31T06:13:46.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.543+0000 7f40777fe640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4078104750 0x7f4078103ea0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f4068005940 tx=0x7f40680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:46.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.543+0000 7f4074ff9640 1 -- 172.21.15.53:0/2484264354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406803f030 con 0x7f4078104750 2024-08-31T06:13:46.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.543+0000 7f4074ff9640 1 -- 172.21.15.53:0/2484264354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4068003c90 con 0x7f4078104750 2024-08-31T06:13:46.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.543+0000 7f407de04640 1 -- 172.21.15.53:0/2484264354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40781acaf0 con 0x7f4078104750 2024-08-31T06:13:46.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.543+0000 7f4074ff9640 1 -- 172.21.15.53:0/2484264354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068035070 con 0x7f4078104750 2024-08-31T06:13:46.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.543+0000 7f407de04640 1 -- 172.21.15.53:0/2484264354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40781acfd0 con 0x7f4078104750 2024-08-31T06:13:46.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.546+0000 7f4074ff9640 1 -- 172.21.15.53:0/2484264354 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4068042030 con 0x7f4078104750 2024-08-31T06:13:46.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.546+0000 7f4084379740 1 Processor -- start 2024-08-31T06:13:46.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.546+0000 7f4084379740 1 -- start start 2024-08-31T06:13:46.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.546+0000 7f4084379740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5957bf070 0x55f595b64310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.546+0000 7f4084379740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f5957961b0 0x55f595b64850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.546+0000 7f4084379740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f59579e390 0x55f595b64d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.546+0000 7f4084379740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f595adb680 con 0x55f59579e390 2024-08-31T06:13:46.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.546+0000 7f4084379740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f595acac10 con 0x55f5957961b0 2024-08-31T06:13:46.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.546+0000 7f4084379740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f595acebc0 con 0x55f5957bf070 2024-08-31T06:13:46.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f4076ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f59579e390 0x55f595b64d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f4076ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f59579e390 0x55f595b64d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37190/0 (socket says 172.21.15.53:37190) 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f40777fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f5957961b0 0x55f595b64850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f4076ffd640 1 -- 172.21.15.53:0/3287248339 learned_addr learned my addr 172.21.15.53:0/3287248339 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f4077fff640 1 --2- 172.21.15.53:0/3287248339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5957bf070 0x55f595b64310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f4076ffd640 1 -- 172.21.15.53:0/3287248339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5957bf070 msgr2=0x55f595b64310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f4076ffd640 1 --2- 172.21.15.53:0/3287248339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5957bf070 0x55f595b64310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f4076ffd640 1 -- 172.21.15.53:0/3287248339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f5957961b0 msgr2=0x55f595b64850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f4076ffd640 1 --2- 172.21.15.53:0/3287248339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f5957961b0 0x55f595b64850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f4076ffd640 1 -- 172.21.15.53:0/3287248339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f59582a650 con 0x55f59579e390 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f4074ff9640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40600b4ca0 0x7f40600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.547+0000 7f4076ffd640 1 --2- 172.21.15.53:0/3287248339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f59579e390 0x55f595b64d90 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f406c00bca0 tx=0x7f406c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1051ffbf2d92fc9a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.548+0000 7f4077fff640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40600b4ca0 0x7f40600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.548+0000 7f4074ff9640 1 -- 172.21.15.53:0/2484264354 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f4068105a40 con 0x7f4078104750 2024-08-31T06:13:46.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.548+0000 7f405dffb640 1 -- 172.21.15.53:0/3287248339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c01c680 con 0x55f59579e390 2024-08-31T06:13:46.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.548+0000 7f405dffb640 1 -- 172.21.15.53:0/3287248339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f406c00be50 con 0x55f59579e390 2024-08-31T06:13:46.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.548+0000 7f405dffb640 1 -- 172.21.15.53:0/3287248339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c011bc0 con 0x55f59579e390 2024-08-31T06:13:46.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.549+0000 7f4084379740 1 -- 172.21.15.53:0/3287248339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f59579e390 msgr2=0x55f595b64d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:46.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.549+0000 7f4077fff640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40600b4ca0 0x7f40600b71b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4078104550 tx=0x7f407000a4d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:46.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.549+0000 7f4084379740 1 --2- 172.21.15.53:0/3287248339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f59579e390 0x55f595b64d90 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f406c00bca0 tx=0x7f406c0107a0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.549+0000 7f4084379740 1 -- 172.21.15.53:0/3287248339 shutdown_connections 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.549+0000 7f4084379740 1 --2- 172.21.15.53:0/3287248339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f59579e390 0x55f595b64d90 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.549+0000 7f4084379740 1 --2- 172.21.15.53:0/3287248339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f5957961b0 0x55f595b64850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.549+0000 7f4084379740 1 --2- 172.21.15.53:0/3287248339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5957bf070 0x55f595b64310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.549+0000 7f4084379740 1 -- 172.21.15.53:0/3287248339 >> 172.21.15.53:0/3287248339 conn(0x55f5957b3460 msgr2=0x55f595b62200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.549+0000 7f4084379740 1 -- 172.21.15.53:0/3287248339 shutdown_connections 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.549+0000 7f4084379740 1 -- 172.21.15.53:0/3287248339 wait complete. 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.549+0000 7f4084379740 1 -- start start 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f4084379740 1 Processor -- start 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f4084379740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b6fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f4084379740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59579e390 0x55f595b6ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f4084379740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5957bf070 0x55f595b7bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f4084379740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f59592d700 con 0x55f5957961b0 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f4084379740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f595a51750 con 0x55f59579e390 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f4084379740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f595b72af0 con 0x55f5957bf070 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f4084379740 10 client.0 _ll_register_callbacks cb 0x55f595a80e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f40777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b6fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f40777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b6fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37200/0 (socket says 172.21.15.53:37200) 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f40777fe640 1 -- 172.21.15.53:0/1747991917 learned_addr learned my addr 172.21.15.53:0/1747991917 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f4076ffd640 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59579e390 0x55f595b6ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f4077fff640 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5957bf070 0x55f595b7bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f40777fe640 1 -- 172.21.15.53:0/1747991917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5957bf070 msgr2=0x55f595b7bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f40777fe640 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5957bf070 0x55f595b7bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f40777fe640 1 -- 172.21.15.53:0/1747991917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59579e390 msgr2=0x55f595b6ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f40777fe640 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59579e390 0x55f595b6ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.550+0000 7f40777fe640 1 -- 172.21.15.53:0/1747991917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f595a8a900 con 0x55f5957961b0 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.551+0000 7f4076ffd640 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59579e390 0x55f595b6ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.551+0000 7f40777fe640 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b6fa30 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f40681031d0 tx=0x7f4068109180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48ff2623aa6ec51 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.551+0000 7f4056ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.551+0000 7f4056ffd640 1 -- 172.21.15.53:0/1747991917 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068049070 con 0x55f5957961b0 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.551+0000 7f4056ffd640 1 -- 172.21.15.53:0/1747991917 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f40680cc630 con 0x55f5957961b0 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.551+0000 7f4084379740 1 -- 172.21.15.53:0/1747991917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f406c00be50 con 0x55f5957961b0 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.551+0000 7f4056ffd640 1 -- 172.21.15.53:0/1747991917 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f40680c8080 con 0x55f5957961b0 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.551+0000 7f4084379740 10 client.18390 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.551+0000 7f4084379740 1 -- 172.21.15.53:0/1747991917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f595b7e860 con 0x55f5957961b0 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.551+0000 7f4056ffd640 1 -- 172.21.15.53:0/1747991917 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f406c00be50 con 0x55f5957961b0 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.552+0000 7f4056ffd640 1 -- 172.21.15.53:0/1747991917 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f40680d4fa0 con 0x55f5957961b0 2024-08-31T06:13:46.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.552+0000 7f4084379740 10 client.18390 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.552+0000 7f4084379740 10 client.18390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.552+0000 7f4084379740 20 client.18390 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.552+0000 7f4084379740 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f59577d9f0 0x55f595b81d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.552+0000 7f4084379740 4 client.18390 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.552+0000 7f4084379740 1 -- 172.21.15.53:0/1747991917 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f595add5d0 con 0x55f59577d9f0 2024-08-31T06:13:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.552+0000 7f4076ffd640 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f59577d9f0 0x55f595b81d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.552+0000 7f4056ffd640 10 client.18390 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:46.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.552+0000 7f4076ffd640 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f59577d9f0 0x55f595b81d60 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b66eb94364d8499 server_cookie=d4d79d445bd0ee1d in_seq=0 out_seq=0 2024-08-31T06:13:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.553+0000 7f4056ffd640 1 -- 172.21.15.53:0/1747991917 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f595add5d0 con 0x55f59577d9f0 2024-08-31T06:13:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.553+0000 7f4056ffd640 10 client.18390 handle_command_reply: tid=0 2024-08-31T06:13:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.553+0000 7f4084379740 1 client.18390 shutdown 2024-08-31T06:13:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.553+0000 7f4084379740 1 -- 172.21.15.53:0/1747991917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 msgr2=0x55f595b6fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.553+0000 7f4084379740 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b6fa30 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f40681031d0 tx=0x7f4068109180 comp rx=0 tx=0).stop 2024-08-31T06:13:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.553+0000 7f4084379740 1 -- 172.21.15.53:0/1747991917 shutdown_connections 2024-08-31T06:13:46.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.553+0000 7f4084379740 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f59577d9f0 0x55f595b81d60 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.553+0000 7f4084379740 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5957bf070 0x55f595b7bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.553+0000 7f4056ffd640 0 client.18390 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.553+0000 7f4084379740 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59579e390 0x55f595b6ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.554+0000 7f4084379740 1 --2- 172.21.15.53:0/1747991917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b6fa30 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.554+0000 7f4084379740 1 -- 172.21.15.53:0/1747991917 >> 172.21.15.53:0/1747991917 conn(0x55f5957b3460 msgr2=0x55f595b674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.554+0000 7f4084379740 1 -- 172.21.15.53:0/1747991917 shutdown_connections 2024-08-31T06:13:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.554+0000 7f4084379740 1 -- 172.21.15.53:0/1747991917 wait complete. 2024-08-31T06:13:46.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.554+0000 7f4084379740 20 client.18390 trim_cache size 0 max 16384 2024-08-31T06:13:46.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f4084379740 1 Processor -- start 2024-08-31T06:13:46.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f4084379740 1 -- start start 2024-08-31T06:13:46.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f4084379740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 0x55f595b6b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f4084379740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b71910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f4084379740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f59579e390 0x55f595b65a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f4084379740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40781b5a60 con 0x55f5957961b0 2024-08-31T06:13:46.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f4084379740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40781b76c0 con 0x55f59577d9f0 2024-08-31T06:13:46.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f4084379740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40781b6130 con 0x55f59579e390 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f4076ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b71910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f40777fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 0x55f595b6b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f4076ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b71910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37202/0 (socket says 172.21.15.53:37202) 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.568+0000 7f4076ffd640 1 -- 172.21.15.53:0/2422121327 learned_addr learned my addr 172.21.15.53:0/2422121327 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f4077fff640 1 --2- 172.21.15.53:0/2422121327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f59579e390 0x55f595b65a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f40777fe640 1 -- 172.21.15.53:0/2422121327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f59579e390 msgr2=0x55f595b65a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f40777fe640 1 --2- 172.21.15.53:0/2422121327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f59579e390 0x55f595b65a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f40777fe640 1 -- 172.21.15.53:0/2422121327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 msgr2=0x55f595b71910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f40777fe640 1 --2- 172.21.15.53:0/2422121327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b71910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f40777fe640 1 -- 172.21.15.53:0/2422121327 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f595b66600 con 0x55f59577d9f0 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f4076ffd640 1 --2- 172.21.15.53:0/2422121327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b71910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f4077fff640 1 --2- 172.21.15.53:0/2422121327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f59579e390 0x55f595b65a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:13:46.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f40777fe640 1 --2- 172.21.15.53:0/2422121327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 0x55f595b6b1e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4068000c00 tx=0x7f4068009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f4c88bb3617da75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:46.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f405d7fa640 1 -- 172.21.15.53:0/2422121327 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068049070 con 0x55f59577d9f0 2024-08-31T06:13:46.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f405d7fa640 1 -- 172.21.15.53:0/2422121327 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4068003e40 con 0x55f59577d9f0 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.569+0000 7f405d7fa640 1 -- 172.21.15.53:0/2422121327 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40680cb930 con 0x55f59577d9f0 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.570+0000 7f4084379740 1 -- 172.21.15.53:0/2422121327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 msgr2=0x55f595b6b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.570+0000 7f4084379740 1 --2- 172.21.15.53:0/2422121327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 0x55f595b6b1e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4068000c00 tx=0x7f4068009260 comp rx=0 tx=0).stop 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.570+0000 7f4084379740 1 -- 172.21.15.53:0/2422121327 shutdown_connections 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.570+0000 7f4084379740 1 --2- 172.21.15.53:0/2422121327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f59579e390 0x55f595b65a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.570+0000 7f4084379740 1 --2- 172.21.15.53:0/2422121327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b71910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.570+0000 7f4084379740 1 --2- 172.21.15.53:0/2422121327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 0x55f595b6b1e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.570+0000 7f4084379740 1 -- 172.21.15.53:0/2422121327 >> 172.21.15.53:0/2422121327 conn(0x55f5957b3460 msgr2=0x55f595b65340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.570+0000 7f4084379740 1 -- 172.21.15.53:0/2422121327 shutdown_connections 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.570+0000 7f4084379740 1 -- 172.21.15.53:0/2422121327 wait complete. 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f4084379740 1 -- start start 2024-08-31T06:13:46.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f4084379740 1 Processor -- start 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f4084379740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 0x55f595b73eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f4084379740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b743f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f4084379740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f59579e390 0x55f595b74930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f4084379740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40781b6f30 con 0x55f5957961b0 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f4084379740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40781b6800 con 0x55f59577d9f0 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f4084379740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40781b3a60 con 0x55f59579e390 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f4084379740 10 client.0 _ll_register_callbacks cb 0x7f4068109280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f4076ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f40777fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 0x55f595b73eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.571+0000 7f4076ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b743f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37210/0 (socket says 172.21.15.53:37210) 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f4076ffd640 1 -- 172.21.15.53:0/894385004 learned_addr learned my addr 172.21.15.53:0/894385004 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f4077fff640 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f59579e390 0x55f595b74930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f40777fe640 1 -- 172.21.15.53:0/894385004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f59579e390 msgr2=0x55f595b74930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f40777fe640 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f59579e390 0x55f595b74930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f40777fe640 1 -- 172.21.15.53:0/894385004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 msgr2=0x55f595b743f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f40777fe640 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b743f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f40777fe640 1 -- 172.21.15.53:0/894385004 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f595beb910 con 0x55f59577d9f0 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f40777fe640 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 0x55f595b73eb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4068000c00 tx=0x7f4068103680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b7d55ddb52bda6f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f4056ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f4056ffd640 1 -- 172.21.15.53:0/894385004 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40680b7070 con 0x55f59577d9f0 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f4056ffd640 1 -- 172.21.15.53:0/894385004 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f40680cb680 con 0x55f59577d9f0 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f4084379740 1 -- 172.21.15.53:0/894385004 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f595ad9070 con 0x55f59577d9f0 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f4056ffd640 1 -- 172.21.15.53:0/894385004 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4068049050 con 0x55f59577d9f0 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.572+0000 7f4084379740 10 client.27635 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.573+0000 7f4084379740 1 -- 172.21.15.53:0/894385004 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f595beb910 con 0x55f59577d9f0 2024-08-31T06:13:46.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.573+0000 7f4056ffd640 1 -- 172.21.15.53:0/894385004 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f595ad9070 con 0x55f59577d9f0 2024-08-31T06:13:46.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.573+0000 7f4056ffd640 1 -- 172.21.15.53:0/894385004 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f40680b7210 con 0x55f59577d9f0 2024-08-31T06:13:46.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.573+0000 7f4084379740 10 client.27635 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:46.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.573+0000 7f4084379740 10 client.27635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:46.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.573+0000 7f4084379740 20 client.27635 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:46.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.573+0000 7f4084379740 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f5957bf070 0x55f595beee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:46.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.573+0000 7f4084379740 4 client.27635 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:13:46.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.573+0000 7f4084379740 1 -- 172.21.15.53:0/894385004 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f595ad67b0 con 0x55f5957bf070 2024-08-31T06:13:46.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.573+0000 7f4076ffd640 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f5957bf070 0x55f595beee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:46.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4076ffd640 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f5957bf070 0x55f595beee00 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b1a9eae54e67d94 server_cookie=e8cf56ebe56da529 in_seq=0 out_seq=0 2024-08-31T06:13:46.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4056ffd640 10 client.27635 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:46.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4056ffd640 1 -- 172.21.15.53:0/894385004 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f595ad67b0 con 0x55f5957bf070 2024-08-31T06:13:46.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4056ffd640 10 client.27635 handle_command_reply: tid=0 2024-08-31T06:13:46.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4084379740 1 client.27635 shutdown 2024-08-31T06:13:46.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4084379740 1 -- 172.21.15.53:0/894385004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 msgr2=0x55f595b73eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:46.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4084379740 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 0x55f595b73eb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4068000c00 tx=0x7f4068103680 comp rx=0 tx=0).stop 2024-08-31T06:13:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4084379740 1 -- 172.21.15.53:0/894385004 shutdown_connections 2024-08-31T06:13:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4084379740 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f5957bf070 0x55f595beee00 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4084379740 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f59579e390 0x55f595b74930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4084379740 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5957961b0 0x55f595b743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4084379740 1 --2- 172.21.15.53:0/894385004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f59577d9f0 0x55f595b73eb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4084379740 1 -- 172.21.15.53:0/894385004 >> 172.21.15.53:0/894385004 conn(0x55f5957b3460 msgr2=0x55f595b71590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.574+0000 7f4056ffd640 0 client.27635 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f4084379740 1 -- 172.21.15.53:0/894385004 shutdown_connections 2024-08-31T06:13:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f4084379740 1 -- 172.21.15.53:0/894385004 wait complete. 2024-08-31T06:13:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f4084379740 20 client.27635 trim_cache size 0 max 16384 2024-08-31T06:13:46.581 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:13:46.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f407de04640 1 -- 172.21.15.53:0/2484264354 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40600b4ca0 msgr2=0x7f40600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:46.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f407de04640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40600b4ca0 0x7f40600b71b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4078104550 tx=0x7f407000a4d0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f407de04640 1 -- 172.21.15.53:0/2484264354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4078104750 msgr2=0x7f4078103ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:46.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f407de04640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4078104750 0x7f4078103ea0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f4068005940 tx=0x7f40680042f0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f407de04640 1 -- 172.21.15.53:0/2484264354 shutdown_connections 2024-08-31T06:13:46.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f407de04640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40600b4ca0 0x7f40600b71b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f407de04640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407810dbb0 0x7f40781029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f407de04640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40781050a0 0x7f4078102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f407de04640 1 --2- 172.21.15.53:0/2484264354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4078104750 0x7f4078103ea0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:46.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.575+0000 7f407de04640 1 -- 172.21.15.53:0/2484264354 >> 172.21.15.53:0/2484264354 conn(0x7f40780794d0 msgr2=0x7f40781006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:46.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.576+0000 7f407de04640 1 -- 172.21.15.53:0/2484264354 shutdown_connections 2024-08-31T06:13:46.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:46.576+0000 7f407de04640 1 -- 172.21.15.53:0/2484264354 wait complete. 2024-08-31T06:13:46.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 151494 1.58 MB/sec execute 336 sec latency 23.019 ms 2024-08-31T06:13:47.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:47 smithi130 ceph-mon[22266]: pgmap v594: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 754 KiB/s wr, 77 op/s 2024-08-31T06:13:47.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:13:47.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:13:47.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:13:47.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:47 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:13:47.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:47 smithi153 ceph-mon[22320]: pgmap v594: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 754 KiB/s wr, 77 op/s 2024-08-31T06:13:47.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:13:47.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:13:47.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:13:47.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:47 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:13:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:47 smithi053 ceph-mon[18924]: pgmap v594: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 754 KiB/s wr, 77 op/s 2024-08-31T06:13:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:13:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:13:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:13:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:47 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:13:47.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 152268 1.60 MB/sec execute 337 sec latency 14.864 ms 2024-08-31T06:13:48.343 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:13:48.344 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:13:48.620 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:48.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 152585 1.60 MB/sec execute 338 sec latency 39.334 ms 2024-08-31T06:13:49.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.146+0000 7fb082c2d640 1 -- 172.21.15.53:0/94306648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07c109bd0 msgr2=0x7fb07c110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:49.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.146+0000 7fb082c2d640 1 --2- 172.21.15.53:0/94306648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07c109bd0 0x7fb07c110400 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fb074009ca0 tx=0x7fb07402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.146+0000 7fb082c2d640 1 -- 172.21.15.53:0/94306648 shutdown_connections 2024-08-31T06:13:49.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.146+0000 7fb082c2d640 1 --2- 172.21.15.53:0/94306648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07c109bd0 0x7fb07c110400 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.146+0000 7fb082c2d640 1 --2- 172.21.15.53:0/94306648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb07c109280 0x7fb07c109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.146+0000 7fb082c2d640 1 --2- 172.21.15.53:0/94306648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c103940 0x7fb07c103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.146+0000 7fb082c2d640 1 -- 172.21.15.53:0/94306648 >> 172.21.15.53:0/94306648 conn(0x7fb07c0ff3d0 msgr2=0x7fb07c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:49.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.146+0000 7fb082c2d640 1 -- 172.21.15.53:0/94306648 shutdown_connections 2024-08-31T06:13:49.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.146+0000 7fb082c2d640 1 -- 172.21.15.53:0/94306648 wait complete. 2024-08-31T06:13:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb082c2d640 1 Processor -- start 2024-08-31T06:13:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb082c2d640 1 -- start start 2024-08-31T06:13:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb082c2d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c103940 0x7fb07c19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb082c2d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb07c109280 0x7fb07c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb082c2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07c109bd0 0x7fb07c19f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb082c2d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c113790 con 0x7fb07c109bd0 2024-08-31T06:13:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb082c2d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c113610 con 0x7fb07c103940 2024-08-31T06:13:49.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb082c2d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c113910 con 0x7fb07c109280 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb0811ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07c109bd0 0x7fb07c19f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb0811ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07c109bd0 0x7fb07c19f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37232/0 (socket says 172.21.15.53:37232) 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb0811ca640 1 -- 172.21.15.53:0/744587751 learned_addr learned my addr 172.21.15.53:0/744587751 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb07bfff640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb07c109280 0x7fb07c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.147+0000 7fb0809c9640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c103940 0x7fb07c19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.148+0000 7fb0811ca640 1 -- 172.21.15.53:0/744587751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb07c109280 msgr2=0x7fb07c19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.148+0000 7fb0811ca640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb07c109280 0x7fb07c19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.148+0000 7fb0811ca640 1 -- 172.21.15.53:0/744587751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c103940 msgr2=0x7fb07c19a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.148+0000 7fb0811ca640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c103940 0x7fb07c19a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.148+0000 7fb0811ca640 1 -- 172.21.15.53:0/744587751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c19ffd0 con 0x7fb07c109bd0 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.148+0000 7fb0811ca640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07c109bd0 0x7fb07c19f960 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fb074005cc0 tx=0x7fb074032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.148+0000 7fb079ffb640 1 -- 172.21.15.53:0/744587751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074004040 con 0x7fb07c109bd0 2024-08-31T06:13:49.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.148+0000 7fb082c2d640 1 -- 172.21.15.53:0/744587751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07c1a0260 con 0x7fb07c109bd0 2024-08-31T06:13:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.148+0000 7fb079ffb640 1 -- 172.21.15.53:0/744587751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb074004670 con 0x7fb07c109bd0 2024-08-31T06:13:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.148+0000 7fb079ffb640 1 -- 172.21.15.53:0/744587751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074030cc0 con 0x7fb07c109bd0 2024-08-31T06:13:49.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.148+0000 7fb082c2d640 1 -- 172.21.15.53:0/744587751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07c1a6ae0 con 0x7fb07c109bd0 2024-08-31T06:13:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.151+0000 7fb0891a2740 1 Processor -- start 2024-08-31T06:13:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.151+0000 7fb079ffb640 1 -- 172.21.15.53:0/744587751 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb0740041e0 con 0x7fb07c109bd0 2024-08-31T06:13:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.151+0000 7fb0891a2740 1 -- start start 2024-08-31T06:13:49.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.151+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ee6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.151+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b17490 0x55af20ee6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.151+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b1f670 0x55af20ee7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.151+0000 7fb0891a2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55af20e5c5f0 con 0x55af20b40350 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.151+0000 7fb0891a2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55af20e4bb80 con 0x55af20b1f670 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.151+0000 7fb0891a2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55af20e4fb30 con 0x55af20b17490 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ee6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ee6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37240/0 (socket says 172.21.15.53:37240) 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb07bfff640 1 -- 172.21.15.53:0/3178689740 learned_addr learned my addr 172.21.15.53:0/3178689740 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb0809c9640 1 --2- 172.21.15.53:0/3178689740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b17490 0x55af20ee6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb07bfff640 1 --2- 172.21.15.53:0/3178689740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b1f670 0x55af20ee7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb07bfff640 1 -- 172.21.15.53:0/3178689740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b17490 msgr2=0x55af20ee6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb07bfff640 1 --2- 172.21.15.53:0/3178689740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b17490 0x55af20ee6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb079ffb640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb06c0b4cd0 0x7fb06c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb07bfff640 1 -- 172.21.15.53:0/3178689740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b1f670 msgr2=0x55af20ee7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb07bfff640 1 --2- 172.21.15.53:0/3178689740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b1f670 0x55af20ee7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb07bfff640 1 -- 172.21.15.53:0/3178689740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af20bab930 con 0x55af20b40350 2024-08-31T06:13:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb0811ca640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb06c0b4cd0 0x7fb06c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb07bfff640 1 --2- 172.21.15.53:0/3178689740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ee6780 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fb06800af90 tx=0x7fb06800a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8567bc9fa58478fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:49.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb079ffb640 1 -- 172.21.15.53:0/744587751 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7fb074106a10 con 0x7fb07c109bd0 2024-08-31T06:13:49.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.152+0000 7fb066ffd640 1 -- 172.21.15.53:0/3178689740 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068019030 con 0x55af20b40350 2024-08-31T06:13:49.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.153+0000 7fb066ffd640 1 -- 172.21.15.53:0/3178689740 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0680110d0 con 0x55af20b40350 2024-08-31T06:13:49.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.153+0000 7fb066ffd640 1 -- 172.21.15.53:0/3178689740 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068004bc0 con 0x55af20b40350 2024-08-31T06:13:49.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.153+0000 7fb0891a2740 1 -- 172.21.15.53:0/3178689740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 msgr2=0x55af20ee6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:49.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.153+0000 7fb0811ca640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb06c0b4cd0 0x7fb06c0b71e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb0740ca2f0 tx=0x7fb07402a8c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:49.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.153+0000 7fb0891a2740 1 --2- 172.21.15.53:0/3178689740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ee6780 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fb06800af90 tx=0x7fb06800a780 comp rx=0 tx=0).stop 2024-08-31T06:13:49.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.154+0000 7fb0891a2740 1 -- 172.21.15.53:0/3178689740 shutdown_connections 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.154+0000 7fb0891a2740 1 --2- 172.21.15.53:0/3178689740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b1f670 0x55af20ee7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.154+0000 7fb0891a2740 1 --2- 172.21.15.53:0/3178689740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b17490 0x55af20ee6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.154+0000 7fb0891a2740 1 --2- 172.21.15.53:0/3178689740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ee6780 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.154+0000 7fb0891a2740 1 -- 172.21.15.53:0/3178689740 >> 172.21.15.53:0/3178689740 conn(0x55af20b34740 msgr2=0x55af20ee4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.154+0000 7fb0891a2740 1 -- 172.21.15.53:0/3178689740 shutdown_connections 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.154+0000 7fb0891a2740 1 -- 172.21.15.53:0/3178689740 wait complete. 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.154+0000 7fb0891a2740 1 -- start start 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.154+0000 7fb0891a2740 1 Processor -- start 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20ef6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20ef6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b40350 0x55af20f02620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb0891a2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55af20cae890 con 0x55af20b17490 2024-08-31T06:13:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb0891a2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55af20dd2790 con 0x55af20b40350 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb0891a2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55af20ef92c0 con 0x55af20b1f670 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb0891a2740 10 client.0 _ll_register_callbacks cb 0x55af20b57ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20ef6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20ef6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37252/0 (socket says 172.21.15.53:37252) 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb07bfff640 1 -- 172.21.15.53:0/3472726876 learned_addr learned my addr 172.21.15.53:0/3472726876 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb0809c9640 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20ef6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb07bfff640 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b40350 0x55af20f02620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb07bfff640 1 -- 172.21.15.53:0/3472726876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 msgr2=0x55af20ef6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb07bfff640 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20ef6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb07bfff640 1 -- 172.21.15.53:0/3472726876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b40350 msgr2=0x55af20f02620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb07bfff640 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b40350 0x55af20f02620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb07bfff640 1 -- 172.21.15.53:0/3472726876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af20e09f30 con 0x55af20b17490 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb07bfff640 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20ef6340 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb0680058c0 tx=0x7fb0680112c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12072942e058d3f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.155+0000 7fb05bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:49.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb05bfff640 1 -- 172.21.15.53:0/3472726876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068022020 con 0x55af20b17490 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb0891a2740 1 -- 172.21.15.53:0/3472726876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0680110d0 con 0x55af20b17490 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb05bfff640 1 -- 172.21.15.53:0/3472726876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7fb0680052a0 con 0x55af20b17490 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb05bfff640 1 -- 172.21.15.53:0/3472726876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb068033050 con 0x55af20b17490 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb0891a2740 10 client.18408 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb0891a2740 1 -- 172.21.15.53:0/3472726876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55af20f05110 con 0x55af20b17490 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb05bfff640 1 -- 172.21.15.53:0/3472726876 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0680110d0 con 0x55af20b17490 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb05bfff640 1 -- 172.21.15.53:0/3472726876 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7fb06801e460 con 0x55af20b17490 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb0891a2740 10 client.18408 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb0891a2740 10 client.18408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb0891a2740 20 client.18408 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb0891a2740 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55af20afecd0 0x55af20f08520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb0891a2740 4 client.18408 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.156+0000 7fb0891a2740 1 -- 172.21.15.53:0/3472726876 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af20e5e540 con 0x55af20afecd0 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.157+0000 7fb0809c9640 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55af20afecd0 0x55af20f08520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.157+0000 7fb0809c9640 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55af20afecd0 0x55af20f08520 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5c2c1b3d36df22 server_cookie=cb708bad66085c0 in_seq=0 out_seq=0 2024-08-31T06:13:49.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.157+0000 7fb05bfff640 10 client.18408 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb05bfff640 1 -- 172.21.15.53:0/3472726876 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af20e5e540 con 0x55af20afecd0 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb05bfff640 10 client.18408 handle_command_reply: tid=0 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 1 client.18408 shutdown 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 1 -- 172.21.15.53:0/3472726876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 msgr2=0x55af20ef6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20ef6340 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb0680058c0 tx=0x7fb0680112c0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 1 -- 172.21.15.53:0/3472726876 shutdown_connections 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55af20afecd0 0x55af20f08520 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b40350 0x55af20f02620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20ef6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 1 --2- 172.21.15.53:0/3472726876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20ef6340 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 1 -- 172.21.15.53:0/3472726876 >> 172.21.15.53:0/3472726876 conn(0x55af20b34740 msgr2=0x55af20ee8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb05bfff640 0 client.18408 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:49.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 1 -- 172.21.15.53:0/3472726876 shutdown_connections 2024-08-31T06:13:49.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 1 -- 172.21.15.53:0/3472726876 wait complete. 2024-08-31T06:13:49.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.158+0000 7fb0891a2740 20 client.18408 trim_cache size 0 max 16384 2024-08-31T06:13:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.176+0000 7fb0891a2740 1 Processor -- start 2024-08-31T06:13:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.176+0000 7fb0891a2740 1 -- start start 2024-08-31T06:13:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b17490 0x55af20ef6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20ef3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ef3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb0891a2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1ad250 con 0x55af20b40350 2024-08-31T06:13:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb0891a2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1aeeb0 con 0x55af20b17490 2024-08-31T06:13:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb0891a2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1ad920 con 0x55af20b1f670 2024-08-31T06:13:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ef3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ef3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37268/0 (socket says 172.21.15.53:37268) 2024-08-31T06:13:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb07bfff640 1 -- 172.21.15.53:0/2757674131 learned_addr learned my addr 172.21.15.53:0/2757674131 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb0809c9640 1 --2- 172.21.15.53:0/2757674131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20ef3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb07bfff640 1 --2- 172.21.15.53:0/2757674131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b17490 0x55af20ef6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb07bfff640 1 -- 172.21.15.53:0/2757674131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 msgr2=0x55af20ef3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb07bfff640 1 --2- 172.21.15.53:0/2757674131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20ef3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb07bfff640 1 -- 172.21.15.53:0/2757674131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b17490 msgr2=0x55af20ef6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb07bfff640 1 --2- 172.21.15.53:0/2757674131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b17490 0x55af20ef6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb07bfff640 1 -- 172.21.15.53:0/2757674131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af20ee75c0 con 0x55af20b40350 2024-08-31T06:13:49.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.177+0000 7fb07bfff640 1 --2- 172.21.15.53:0/2757674131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ef3a70 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb06800a710 tx=0x7fb06800a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2443d1ddafffab06 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.178+0000 7fb0667fc640 1 -- 172.21.15.53:0/2757674131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06803c020 con 0x55af20b40350 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.178+0000 7fb0667fc640 1 -- 172.21.15.53:0/2757674131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0680110d0 con 0x55af20b40350 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.178+0000 7fb0667fc640 1 -- 172.21.15.53:0/2757674131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068022030 con 0x55af20b40350 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.178+0000 7fb0891a2740 1 -- 172.21.15.53:0/2757674131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 msgr2=0x55af20ef3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.178+0000 7fb0891a2740 1 --2- 172.21.15.53:0/2757674131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ef3a70 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb06800a710 tx=0x7fb06800a780 comp rx=0 tx=0).stop 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.178+0000 7fb0891a2740 1 -- 172.21.15.53:0/2757674131 shutdown_connections 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.178+0000 7fb0891a2740 1 --2- 172.21.15.53:0/2757674131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b40350 0x55af20ef3a70 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.178+0000 7fb0891a2740 1 --2- 172.21.15.53:0/2757674131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20ef3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.178+0000 7fb0891a2740 1 --2- 172.21.15.53:0/2757674131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b17490 0x55af20ef6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.178+0000 7fb0891a2740 1 -- 172.21.15.53:0/2757674131 >> 172.21.15.53:0/2757674131 conn(0x55af20b34740 msgr2=0x55af20ef4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.179+0000 7fb0891a2740 1 -- 172.21.15.53:0/2757674131 shutdown_connections 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.179+0000 7fb0891a2740 1 -- 172.21.15.53:0/2757674131 wait complete. 2024-08-31T06:13:49.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.179+0000 7fb0891a2740 1 -- start start 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.179+0000 7fb0891a2740 1 Processor -- start 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.179+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20efe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.179+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20efed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.179+0000 7fb0891a2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b40350 0x55af20ef9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.179+0000 7fb0891a2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1ae720 con 0x55af20b17490 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.179+0000 7fb0891a2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1adff0 con 0x55af20b40350 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.179+0000 7fb0891a2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1ab250 con 0x55af20b1f670 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.179+0000 7fb0891a2740 10 client.0 _ll_register_callbacks cb 0x7fb07000c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20efe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb07bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20efe790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37280/0 (socket says 172.21.15.53:37280) 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb07bfff640 1 -- 172.21.15.53:0/1470357919 learned_addr learned my addr 172.21.15.53:0/1470357919 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb0809c9640 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20efed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb07bfff640 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b40350 0x55af20ef9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb07bfff640 1 -- 172.21.15.53:0/1470357919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 msgr2=0x55af20efed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb07bfff640 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20efed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb07bfff640 1 -- 172.21.15.53:0/1470357919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b40350 msgr2=0x55af20ef9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb07bfff640 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b40350 0x55af20ef9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb07bfff640 1 -- 172.21.15.53:0/1470357919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af20ef9c30 con 0x55af20b17490 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb07bfff640 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20efe790 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fb06800a570 tx=0x7fb06801e460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3152026db8f3720a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb05bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb05bfff640 1 -- 172.21.15.53:0/1470357919 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06803c030 con 0x55af20b17490 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb05bfff640 1 -- 172.21.15.53:0/1470357919 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7fb06801eca0 con 0x55af20b17490 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.180+0000 7fb0891a2740 1 -- 172.21.15.53:0/1470357919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0680110d0 con 0x55af20b17490 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb05bfff640 1 -- 172.21.15.53:0/1470357919 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb068022070 con 0x55af20b17490 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb0891a2740 10 client.18414 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb0891a2740 1 -- 172.21.15.53:0/1470357919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55af20f73770 con 0x55af20b17490 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb05bfff640 1 -- 172.21.15.53:0/1470357919 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0680110d0 con 0x55af20b17490 2024-08-31T06:13:49.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb05bfff640 1 -- 172.21.15.53:0/1470357919 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7fb068041020 con 0x55af20b17490 2024-08-31T06:13:49.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb0891a2740 10 client.18414 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:49.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb0891a2740 10 client.18414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:49.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb0891a2740 20 client.18414 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:49.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb0891a2740 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55af20ad4080 0x55af20f75ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:49.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb0891a2740 4 client.18414 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:13:49.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb0891a2740 1 -- 172.21.15.53:0/1470357919 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55af20e59fe0 con 0x55af20ad4080 2024-08-31T06:13:49.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.181+0000 7fb0809c9640 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55af20ad4080 0x55af20f75ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:49.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.182+0000 7fb0809c9640 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55af20ad4080 0x55af20f75ee0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0c4df4bd7303913 server_cookie=4cda24a3d7cfd8d6 in_seq=0 out_seq=0 2024-08-31T06:13:49.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.182+0000 7fb05bfff640 10 client.18414 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:49.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb05bfff640 1 -- 172.21.15.53:0/1470357919 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55af20e59fe0 con 0x55af20ad4080 2024-08-31T06:13:49.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb05bfff640 10 client.18414 handle_command_reply: tid=0 2024-08-31T06:13:49.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb0891a2740 1 client.18414 shutdown 2024-08-31T06:13:49.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb0891a2740 1 -- 172.21.15.53:0/1470357919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 msgr2=0x55af20efe790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb0891a2740 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20efe790 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fb06800a570 tx=0x7fb06801e460 comp rx=0 tx=0).stop 2024-08-31T06:13:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb0891a2740 1 -- 172.21.15.53:0/1470357919 shutdown_connections 2024-08-31T06:13:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb0891a2740 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55af20ad4080 0x55af20f75ee0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb05bfff640 0 client.18414 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb0891a2740 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55af20b40350 0x55af20ef9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb0891a2740 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af20b1f670 0x55af20efed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb0891a2740 1 --2- 172.21.15.53:0/1470357919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af20b17490 0x55af20efe790 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.183+0000 7fb0891a2740 1 -- 172.21.15.53:0/1470357919 >> 172.21.15.53:0/1470357919 conn(0x55af20b34740 msgr2=0x55af20ef77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb0891a2740 1 -- 172.21.15.53:0/1470357919 shutdown_connections 2024-08-31T06:13:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb0891a2740 1 -- 172.21.15.53:0/1470357919 wait complete. 2024-08-31T06:13:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb0891a2740 20 client.18414 trim_cache size 0 max 16384 2024-08-31T06:13:49.190 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:13:49.190 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:13:49.190 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9", 2024-08-31T06:13:49.190 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:13:49.190 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:13:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb082c2d640 1 -- 172.21.15.53:0/744587751 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb06c0b4cd0 msgr2=0x7fb06c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb082c2d640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb06c0b4cd0 0x7fb06c0b71e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb0740ca2f0 tx=0x7fb07402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb082c2d640 1 -- 172.21.15.53:0/744587751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07c109bd0 msgr2=0x7fb07c19f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb082c2d640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07c109bd0 0x7fb07c19f960 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fb074005cc0 tx=0x7fb074032c40 comp rx=0 tx=0).stop 2024-08-31T06:13:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb082c2d640 1 -- 172.21.15.53:0/744587751 shutdown_connections 2024-08-31T06:13:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb082c2d640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb06c0b4cd0 0x7fb06c0b71e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb082c2d640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb07c109bd0 0x7fb07c19f960 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb082c2d640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb07c109280 0x7fb07c19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb082c2d640 1 --2- 172.21.15.53:0/744587751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb07c103940 0x7fb07c19a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb082c2d640 1 -- 172.21.15.53:0/744587751 >> 172.21.15.53:0/744587751 conn(0x7fb07c0ff3d0 msgr2=0x7fb07c106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.184+0000 7fb082c2d640 1 -- 172.21.15.53:0/744587751 shutdown_connections 2024-08-31T06:13:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:49.185+0000 7fb082c2d640 1 -- 172.21.15.53:0/744587751 wait complete. 2024-08-31T06:13:49.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:49 smithi130 ceph-mon[22266]: pgmap v595: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 584 KiB/s wr, 83 op/s 2024-08-31T06:13:49.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:49 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:13:49.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:49 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:49 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:49.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:49 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:49.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:49 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:49.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:49 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:49 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:49 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:49 smithi153 ceph-mon[22320]: pgmap v595: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 584 KiB/s wr, 83 op/s 2024-08-31T06:13:49.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:49 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:13:49.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:49 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:49 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:49 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:49 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:49 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:49 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:49 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:49 smithi053 ceph-mon[18924]: pgmap v595: 97 pgs: 97 active+clean; 87 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 584 KiB/s wr, 83 op/s 2024-08-31T06:13:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:49 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:13:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:49 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:49 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:49 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:49 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:49 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:49 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:49 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:49.986 INFO:tasks.workunit.client.0.smithi053.stdout: 1 152686 1.60 MB/sec execute 339 sec latency 507.656 ms 2024-08-31T06:13:50.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:50 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:50.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:50 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:50 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:50.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:50 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:50 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:50.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:50 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:50 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:13:50.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:50 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:50 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:50.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:50 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:50 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:50 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:50 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:50 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:50 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:13:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:50 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:50 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:50 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:50 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:50 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:50 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:50 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:50 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:13:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:50 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:13:50.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 152686 1.59 MB/sec execute 340 sec latency 1507.705 ms 2024-08-31T06:13:51.505 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:13:51.786 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:13:51.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:51 smithi130 ceph-mon[22266]: pgmap v596: 97 pgs: 97 active+clean; 89 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 927 KiB/s wr, 109 op/s 2024-08-31T06:13:51.908 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:51 smithi053 ceph-mon[18924]: pgmap v596: 97 pgs: 97 active+clean; 89 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 927 KiB/s wr, 109 op/s 2024-08-31T06:13:51.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:51 smithi153 ceph-mon[22320]: pgmap v596: 97 pgs: 97 active+clean; 89 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 927 KiB/s wr, 109 op/s 2024-08-31T06:13:51.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 152888 1.59 MB/sec execute 341 sec latency 1765.762 ms 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.314+0000 7f58035a6640 1 -- 172.21.15.53:0/2578139450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc10ff70 msgr2=0x7f57fc112390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.314+0000 7f58035a6640 1 --2- 172.21.15.53:0/2578139450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc10ff70 0x7f57fc112390 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009ca0 tx=0x7f57f402a950 comp rx=0 tx=0).stop 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.314+0000 7f58035a6640 1 -- 172.21.15.53:0/2578139450 shutdown_connections 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.314+0000 7f58035a6640 1 --2- 172.21.15.53:0/2578139450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc10ff70 0x7f57fc112390 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.314+0000 7f58035a6640 1 --2- 172.21.15.53:0/2578139450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc102d10 0x7f57fc10fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.314+0000 7f58035a6640 1 --2- 172.21.15.53:0/2578139450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc1023c0 0x7f57fc1027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.314+0000 7f58035a6640 1 -- 172.21.15.53:0/2578139450 >> 172.21.15.53:0/2578139450 conn(0x7f57fc0794d0 msgr2=0x7f57fc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.314+0000 7f58035a6640 1 -- 172.21.15.53:0/2578139450 shutdown_connections 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.314+0000 7f58035a6640 1 -- 172.21.15.53:0/2578139450 wait complete. 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f58035a6640 1 Processor -- start 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f58035a6640 1 -- start start 2024-08-31T06:13:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f58035a6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc1023c0 0x7f57fc19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f58035a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc102d10 0x7f57fc19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f58035a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc10ff70 0x7f57fc1a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f58035a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1158c0 con 0x7f57fc10ff70 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f58035a6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc115740 con 0x7f57fc102d10 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f58035a6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc115a40 con 0x7f57fc1023c0 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5801b43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc10ff70 0x7f57fc1a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5801342640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc1023c0 0x7f57fc19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5801342640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc1023c0 0x7f57fc19c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34196/0 (socket says 172.21.15.53:34196) 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5801b43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc10ff70 0x7f57fc1a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37304/0 (socket says 172.21.15.53:37304) 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5801342640 1 -- 172.21.15.53:0/3203484052 learned_addr learned my addr 172.21.15.53:0/3203484052 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5800b41640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc102d10 0x7f57fc19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5801342640 1 -- 172.21.15.53:0/3203484052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc102d10 msgr2=0x7f57fc19c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5801342640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc102d10 0x7f57fc19c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5801342640 1 -- 172.21.15.53:0/3203484052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc10ff70 msgr2=0x7f57fc1a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5801342640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc10ff70 0x7f57fc1a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5801342640 1 -- 172.21.15.53:0/3203484052 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc1a2220 con 0x7f57fc1023c0 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.315+0000 7f5801b43640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc10ff70 0x7f57fc1a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.316+0000 7f5801342640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc1023c0 0x7f57fc19c2b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f57f800d950 tx=0x7f57f800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.316+0000 7f57f27fc640 1 -- 172.21.15.53:0/3203484052 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8017070 con 0x7f57fc1023c0 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.316+0000 7f57f27fc640 1 -- 172.21.15.53:0/3203484052 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57f8009c30 con 0x7f57fc1023c0 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.316+0000 7f58035a6640 1 -- 172.21.15.53:0/3203484052 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57fc1a2510 con 0x7f57fc1023c0 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.316+0000 7f57f27fc640 1 -- 172.21.15.53:0/3203484052 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f800f620 con 0x7f57fc1023c0 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.316+0000 7f58035a6640 1 -- 172.21.15.53:0/3203484052 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57fc1a8c70 con 0x7f57fc1023c0 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5809b1b740 1 Processor -- start 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5809b1b740 1 -- start start 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa26070 0x556c1adcb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1a9fd1b0 0x556c1adcb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1aa05390 0x556c1adcbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f57f27fc640 1 -- 172.21.15.53:0/3203484052 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f57f8010460 con 0x7f57fc1023c0 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5809b1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556c1ad42630 con 0x556c1aa26070 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5809b1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556c1ad31bc0 con 0x556c1aa05390 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5809b1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556c1ad35b70 con 0x556c1a9fd1b0 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5801b43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa26070 0x556c1adcb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5801b43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa26070 0x556c1adcb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37312/0 (socket says 172.21.15.53:37312) 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5801b43640 1 -- 172.21.15.53:0/4026720614 learned_addr learned my addr 172.21.15.53:0/4026720614 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5801342640 1 --2- 172.21.15.53:0/4026720614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1a9fd1b0 0x556c1adcb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.319+0000 7f5800b41640 1 --2- 172.21.15.53:0/4026720614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1aa05390 0x556c1adcbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f5800b41640 1 -- 172.21.15.53:0/4026720614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1a9fd1b0 msgr2=0x556c1adcb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f5800b41640 1 --2- 172.21.15.53:0/4026720614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1a9fd1b0 0x556c1adcb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f5800b41640 1 -- 172.21.15.53:0/4026720614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa26070 msgr2=0x556c1adcb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f5800b41640 1 --2- 172.21.15.53:0/4026720614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa26070 0x556c1adcb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f5800b41640 1 -- 172.21.15.53:0/4026720614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c1aa91650 con 0x556c1aa05390 2024-08-31T06:13:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f5800b41640 1 --2- 172.21.15.53:0/4026720614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1aa05390 0x556c1adcbd40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00bbc0 tx=0x7f57ec0103d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=234ae0ba04a4cb44 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f57f27fc640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e80b4ca0 0x7f57e80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f57e77fe640 1 -- 172.21.15.53:0/4026720614 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec004030 con 0x556c1aa05390 2024-08-31T06:13:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f57e77fe640 1 -- 172.21.15.53:0/4026720614 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57ec0035f0 con 0x556c1aa05390 2024-08-31T06:13:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f57e77fe640 1 -- 172.21.15.53:0/4026720614 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0116a0 con 0x556c1aa05390 2024-08-31T06:13:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f57f27fc640 1 -- 172.21.15.53:0/3203484052 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f57f80e5100 con 0x7f57fc1023c0 2024-08-31T06:13:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.320+0000 7f5801b43640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e80b4ca0 0x7f57e80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.321+0000 7f5809b1b740 1 -- 172.21.15.53:0/4026720614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1aa05390 msgr2=0x556c1adcbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.321+0000 7f5801b43640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e80b4ca0 0x7f57e80b71b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f57f40094e0 tx=0x7f57f4005c50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.321+0000 7f5809b1b740 1 --2- 172.21.15.53:0/4026720614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1aa05390 0x556c1adcbd40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00bbc0 tx=0x7f57ec0103d0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.322+0000 7f5809b1b740 1 -- 172.21.15.53:0/4026720614 shutdown_connections 2024-08-31T06:13:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.322+0000 7f5809b1b740 1 --2- 172.21.15.53:0/4026720614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1aa05390 0x556c1adcbd40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.322+0000 7f5809b1b740 1 --2- 172.21.15.53:0/4026720614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1a9fd1b0 0x556c1adcb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.322+0000 7f5809b1b740 1 --2- 172.21.15.53:0/4026720614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa26070 0x556c1adcb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.322+0000 7f5809b1b740 1 -- 172.21.15.53:0/4026720614 >> 172.21.15.53:0/4026720614 conn(0x556c1aa1a460 msgr2=0x556c1adc91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.322+0000 7f5809b1b740 1 -- 172.21.15.53:0/4026720614 shutdown_connections 2024-08-31T06:13:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.322+0000 7f5809b1b740 1 -- 172.21.15.53:0/4026720614 wait complete. 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.322+0000 7f5809b1b740 1 -- start start 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.322+0000 7f5809b1b740 1 Processor -- start 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1add6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa05390 0x556c1add6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa26070 0x556c1ade2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5809b1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556c1ab94700 con 0x556c1aa26070 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5809b1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556c1acb8700 con 0x556c1a9fd1b0 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5809b1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556c1add9aa0 con 0x556c1aa05390 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5809b1b740 10 client.0 _ll_register_callbacks cb 0x556c1ace7dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5801342640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1add6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5801b43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa26070 0x556c1ade2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5800b41640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa05390 0x556c1add6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5801342640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1add6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:37112/0 (socket says 172.21.15.53:37112) 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5801342640 1 -- 172.21.15.53:0/1806392103 learned_addr learned my addr 172.21.15.53:0/1806392103 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5801342640 1 -- 172.21.15.53:0/1806392103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa05390 msgr2=0x556c1add6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5801342640 1 --2- 172.21.15.53:0/1806392103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa05390 0x556c1add6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5801342640 1 -- 172.21.15.53:0/1806392103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa26070 msgr2=0x556c1ade2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5801342640 1 --2- 172.21.15.53:0/1806392103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa26070 0x556c1ade2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.323+0000 7f5801342640 1 -- 172.21.15.53:0/1806392103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c1acf18b0 con 0x556c1a9fd1b0 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.324+0000 7f5801342640 1 --2- 172.21.15.53:0/1806392103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1add6a90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f57f80a8af0 tx=0x7f57f80a7dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c24fcebb01f55bf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.324+0000 7f57e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.324+0000 7f57e4ff9640 1 -- 172.21.15.53:0/1806392103 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8020070 con 0x556c1a9fd1b0 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.324+0000 7f5809b1b740 1 -- 172.21.15.53:0/1806392103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ec0035f0 con 0x556c1a9fd1b0 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.324+0000 7f57e4ff9640 1 -- 172.21.15.53:0/1806392103 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f57f80e70d0 con 0x556c1a9fd1b0 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.324+0000 7f57e4ff9640 1 -- 172.21.15.53:0/1806392103 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f57f80ab650 con 0x556c1a9fd1b0 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.324+0000 7f5809b1b740 10 client.27662 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.324+0000 7f5809b1b740 1 -- 172.21.15.53:0/1806392103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x556c1ade5920 con 0x556c1a9fd1b0 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.325+0000 7f57e4ff9640 1 -- 172.21.15.53:0/1806392103 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57ec0035f0 con 0x556c1a9fd1b0 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.325+0000 7f57e4ff9640 1 -- 172.21.15.53:0/1806392103 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f57f80a71f0 con 0x556c1a9fd1b0 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.325+0000 7f5809b1b740 10 client.27662 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.325+0000 7f5809b1b740 10 client.27662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.325+0000 7f5809b1b740 20 client.27662 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.325+0000 7f5809b1b740 1 --2- 172.21.15.53:0/1806392103 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556c1a9e49f0 0x556c1ade9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.325+0000 7f5809b1b740 4 client.27662 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.325+0000 7f5809b1b740 1 -- 172.21.15.53:0/1806392103 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c1ad44580 con 0x556c1a9e49f0 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.326+0000 7f5800b41640 1 --2- 172.21.15.53:0/1806392103 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556c1a9e49f0 0x556c1ade9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.326+0000 7f57e4ff9640 10 client.27662 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.326+0000 7f5800b41640 1 --2- 172.21.15.53:0/1806392103 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556c1a9e49f0 0x556c1ade9250 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=576e023c90f2fb44 server_cookie=62447bd7f32cbfd5 in_seq=0 out_seq=0 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f57e4ff9640 1 -- 172.21.15.53:0/1806392103 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c1ad44580 con 0x556c1a9e49f0 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f57e4ff9640 10 client.27662 handle_command_reply: tid=0 2024-08-31T06:13:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 1 client.27662 shutdown 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 1 -- 172.21.15.53:0/1806392103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 msgr2=0x556c1add6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 1 --2- 172.21.15.53:0/1806392103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1add6a90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f57f80a8af0 tx=0x7f57f80a7dc0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 1 -- 172.21.15.53:0/1806392103 shutdown_connections 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 1 --2- 172.21.15.53:0/1806392103 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556c1a9e49f0 0x556c1ade9250 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 1 --2- 172.21.15.53:0/1806392103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa26070 0x556c1ade2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 1 --2- 172.21.15.53:0/1806392103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa05390 0x556c1add6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 1 --2- 172.21.15.53:0/1806392103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1add6a90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 1 -- 172.21.15.53:0/1806392103 >> 172.21.15.53:0/1806392103 conn(0x556c1aa1a460 msgr2=0x556c1adce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f57e4ff9640 0 client.27662 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 1 -- 172.21.15.53:0/1806392103 shutdown_connections 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 1 -- 172.21.15.53:0/1806392103 wait complete. 2024-08-31T06:13:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.327+0000 7f5809b1b740 20 client.27662 trim_cache size 0 max 16384 2024-08-31T06:13:52.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.346+0000 7f5809b1b740 1 Processor -- start 2024-08-31T06:13:52.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.346+0000 7f5809b1b740 1 -- start start 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1adc9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1add1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa26070 0x556c1ade2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5809b1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1b16f0 con 0x556c1aa05390 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5809b1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1b3350 con 0x556c1a9fd1b0 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5809b1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1b1dc0 con 0x556c1aa26070 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5800b41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1add1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5800b41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1add1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37336/0 (socket says 172.21.15.53:37336) 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5800b41640 1 -- 172.21.15.53:0/1521795812 learned_addr learned my addr 172.21.15.53:0/1521795812 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5801342640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1adc9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5801b43640 1 --2- 172.21.15.53:0/1521795812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa26070 0x556c1ade2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5800b41640 1 -- 172.21.15.53:0/1521795812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa26070 msgr2=0x556c1ade2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5800b41640 1 --2- 172.21.15.53:0/1521795812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa26070 0x556c1ade2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5800b41640 1 -- 172.21.15.53:0/1521795812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 msgr2=0x556c1adc9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5800b41640 1 --2- 172.21.15.53:0/1521795812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1adc9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5800b41640 1 -- 172.21.15.53:0/1521795812 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c1add59f0 con 0x556c1aa05390 2024-08-31T06:13:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5801342640 1 --2- 172.21.15.53:0/1521795812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1adc9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.347+0000 7f5800b41640 1 --2- 172.21.15.53:0/1521795812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1add1c40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00bbc0 tx=0x7f57ec010980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3276b8e856f123c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.348+0000 7f57e6ffd640 1 -- 172.21.15.53:0/1521795812 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec032070 con 0x556c1aa05390 2024-08-31T06:13:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.348+0000 7f57e6ffd640 1 -- 172.21.15.53:0/1521795812 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57ec02a070 con 0x556c1aa05390 2024-08-31T06:13:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.348+0000 7f57e6ffd640 1 -- 172.21.15.53:0/1521795812 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec003c30 con 0x556c1aa05390 2024-08-31T06:13:52.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.349+0000 7f5809b1b740 1 -- 172.21.15.53:0/1521795812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 msgr2=0x556c1add1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:52.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.349+0000 7f5809b1b740 1 --2- 172.21.15.53:0/1521795812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1add1c40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00bbc0 tx=0x7f57ec010980 comp rx=0 tx=0).stop 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.349+0000 7f5809b1b740 1 -- 172.21.15.53:0/1521795812 shutdown_connections 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.349+0000 7f5809b1b740 1 --2- 172.21.15.53:0/1521795812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa26070 0x556c1ade2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.349+0000 7f5809b1b740 1 --2- 172.21.15.53:0/1521795812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1add1c40 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.349+0000 7f5809b1b740 1 --2- 172.21.15.53:0/1521795812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1adc9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.349+0000 7f5809b1b740 1 -- 172.21.15.53:0/1521795812 >> 172.21.15.53:0/1521795812 conn(0x556c1aa1a460 msgr2=0x556c1adc8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.349+0000 7f5809b1b740 1 -- 172.21.15.53:0/1521795812 shutdown_connections 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.349+0000 7f5809b1b740 1 -- 172.21.15.53:0/1521795812 wait complete. 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.349+0000 7f5809b1b740 1 -- start start 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.349+0000 7f5809b1b740 1 Processor -- start 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1addf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1adda9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5809b1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa26070 0x556c1addaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5809b1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1b2bc0 con 0x556c1aa05390 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5809b1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1b2490 con 0x556c1a9fd1b0 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5800b41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1adda9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5801342640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1addf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5809b1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1af6f0 con 0x556c1aa26070 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5800b41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1adda9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37352/0 (socket says 172.21.15.53:37352) 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5800b41640 1 -- 172.21.15.53:0/3284906242 learned_addr learned my addr 172.21.15.53:0/3284906242 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5801342640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1addf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:37132/0 (socket says 172.21.15.53:37132) 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5801b43640 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa26070 0x556c1addaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.350+0000 7f5809b1b740 10 client.0 _ll_register_callbacks cb 0x7f57f800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f5801342640 1 -- 172.21.15.53:0/3284906242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa26070 msgr2=0x556c1addaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f5801342640 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa26070 0x556c1addaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f5801342640 1 -- 172.21.15.53:0/3284906242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 msgr2=0x556c1adda9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f5801342640 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1adda9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f5801342640 1 -- 172.21.15.53:0/3284906242 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c1addb720 con 0x556c1a9fd1b0 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f5800b41640 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1adda9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f5801342640 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1addf540 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f57f80e50d0 tx=0x7f57f80aad90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e010bd6455c4a2e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f57e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f57e4ff9640 1 -- 172.21.15.53:0/3284906242 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8020030 con 0x556c1a9fd1b0 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f57e4ff9640 1 -- 172.21.15.53:0/3284906242 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f57f8010750 con 0x556c1a9fd1b0 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f5809b1b740 1 -- 172.21.15.53:0/3284906242 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ec02a070 con 0x556c1a9fd1b0 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f57e4ff9640 1 -- 172.21.15.53:0/3284906242 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f57f80e2cc0 con 0x556c1a9fd1b0 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f5809b1b740 10 client.27668 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f5809b1b740 1 -- 172.21.15.53:0/3284906242 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x556c1ae53bb0 con 0x556c1a9fd1b0 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.351+0000 7f57e4ff9640 1 -- 172.21.15.53:0/3284906242 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57ec02a070 con 0x556c1a9fd1b0 2024-08-31T06:13:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.352+0000 7f57e4ff9640 1 -- 172.21.15.53:0/3284906242 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f57f8010950 con 0x556c1a9fd1b0 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.352+0000 7f5809b1b740 10 client.27668 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.352+0000 7f5809b1b740 10 client.27668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.352+0000 7f5809b1b740 20 client.27668 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.352+0000 7f5809b1b740 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556c1a9b9da0 0x556c1ae56410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.352+0000 7f5809b1b740 4 client.27668 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.352+0000 7f5809b1b740 1 -- 172.21.15.53:0/3284906242 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556c1ad40020 con 0x556c1a9b9da0 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.352+0000 7f5800b41640 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556c1a9b9da0 0x556c1ae56410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.352+0000 7f57e4ff9640 10 client.27668 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.352+0000 7f5800b41640 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556c1a9b9da0 0x556c1ae56410 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30bcf9af4a65b086 server_cookie=f25ce60d98973324 in_seq=0 out_seq=0 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f57e4ff9640 1 -- 172.21.15.53:0/3284906242 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x556c1ad40020 con 0x556c1a9b9da0 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f57e4ff9640 10 client.27668 handle_command_reply: tid=0 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 1 client.27668 shutdown 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 1 -- 172.21.15.53:0/3284906242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 msgr2=0x556c1addf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1addf540 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f57f80e50d0 tx=0x7f57f80aad90 comp rx=0 tx=0).stop 2024-08-31T06:13:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 1 -- 172.21.15.53:0/3284906242 shutdown_connections 2024-08-31T06:13:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556c1a9b9da0 0x556c1ae56410 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c1aa26070 0x556c1addaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c1aa05390 0x556c1adda9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 1 --2- 172.21.15.53:0/3284906242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c1a9fd1b0 0x556c1addf540 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f57e4ff9640 0 client.27668 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 1 -- 172.21.15.53:0/3284906242 >> 172.21.15.53:0/3284906242 conn(0x556c1aa1a460 msgr2=0x556c1adce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 1 -- 172.21.15.53:0/3284906242 shutdown_connections 2024-08-31T06:13:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 1 -- 172.21.15.53:0/3284906242 wait complete. 2024-08-31T06:13:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.353+0000 7f5809b1b740 20 client.27668 trim_cache size 0 max 16384 2024-08-31T06:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9", 2024-08-31T06:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.363 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.364 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.365 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:13:52.367 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:13:52.368 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:13:52.369 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:13:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 -- 172.21.15.53:0/3203484052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e80b4ca0 msgr2=0x7f57e80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e80b4ca0 0x7f57e80b71b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f57f40094e0 tx=0x7f57f4005c50 comp rx=0 tx=0).stop 2024-08-31T06:13:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 -- 172.21.15.53:0/3203484052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc1023c0 msgr2=0x7f57fc19c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc1023c0 0x7f57fc19c2b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f57f800d950 tx=0x7f57f800de10 comp rx=0 tx=0).stop 2024-08-31T06:13:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 -- 172.21.15.53:0/3203484052 shutdown_connections 2024-08-31T06:13:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e80b4ca0 0x7f57e80b71b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc10ff70 0x7f57fc1a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc102d10 0x7f57fc19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 --2- 172.21.15.53:0/3203484052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc1023c0 0x7f57fc19c2b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 -- 172.21.15.53:0/3203484052 >> 172.21.15.53:0/3203484052 conn(0x7f57fc0794d0 msgr2=0x7f57fc109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 -- 172.21.15.53:0/3203484052 shutdown_connections 2024-08-31T06:13:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:13:52.354+0000 7f58035a6640 1 -- 172.21.15.53:0/3203484052 wait complete. 2024-08-31T06:13:52.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 153144 1.59 MB/sec execute 342 sec latency 22.268 ms 2024-08-31T06:13:53.090 INFO:tasks.cephfs.filesystem:scrub status for tag:1b03aadd-4a9d-4b56-95ef-ec885b6cfed9 - {'path': '/', 'tag': '1b03aadd-4a9d-4b56-95ef-ec885b6cfed9', 'options': 'recursive,force'} 2024-08-31T06:13:53.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:53 smithi130 ceph-mon[22266]: pgmap v597: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 988 KiB/s wr, 106 op/s 2024-08-31T06:13:53.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:53 smithi153 ceph-mon[22320]: pgmap v597: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 988 KiB/s wr, 106 op/s 2024-08-31T06:13:53.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:53 smithi053 ceph-mon[18924]: pgmap v597: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 988 KiB/s wr, 106 op/s 2024-08-31T06:13:53.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 153644 1.59 MB/sec execute 343 sec latency 15.490 ms 2024-08-31T06:13:54.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 154159 1.59 MB/sec execute 344 sec latency 21.519 ms 2024-08-31T06:13:55.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:55 smithi130 ceph-mon[22266]: pgmap v598: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 1.0 MiB/s wr, 128 op/s 2024-08-31T06:13:55.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:55 smithi153 ceph-mon[22320]: pgmap v598: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 1.0 MiB/s wr, 128 op/s 2024-08-31T06:13:55.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:55 smithi053 ceph-mon[18924]: pgmap v598: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 1.0 MiB/s wr, 128 op/s 2024-08-31T06:13:55.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 154692 1.59 MB/sec execute 345 sec latency 22.145 ms 2024-08-31T06:13:56.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 155164 1.59 MB/sec execute 346 sec latency 15.182 ms 2024-08-31T06:13:57.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:57 smithi153 ceph-mon[22320]: pgmap v599: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 1.3 MiB/s wr, 141 op/s 2024-08-31T06:13:57.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:57 smithi053 ceph-mon[18924]: pgmap v599: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 1.3 MiB/s wr, 141 op/s 2024-08-31T06:13:57.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 155862 1.61 MB/sec execute 347 sec latency 13.829 ms 2024-08-31T06:13:58.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:57 smithi130 ceph-mon[22266]: pgmap v599: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 1.3 MiB/s wr, 141 op/s 2024-08-31T06:13:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.767+0000 7f0b95e77640 1 -- 172.21.15.53:0/2302785559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b9010db50 msgr2=0x7f0b90110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.767+0000 7f0b95e77640 1 --2- 172.21.15.53:0/2302785559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b9010db50 0x7f0b90110030 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009ca0 tx=0x7f0b8802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.768+0000 7f0b95e77640 1 -- 172.21.15.53:0/2302785559 shutdown_connections 2024-08-31T06:13:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.768+0000 7f0b95e77640 1 --2- 172.21.15.53:0/2302785559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b9010db50 0x7f0b90110030 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.768+0000 7f0b95e77640 1 --2- 172.21.15.53:0/2302785559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b90105080 0x7f0b9010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.768+0000 7f0b95e77640 1 --2- 172.21.15.53:0/2302785559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b90104730 0x7f0b90104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.768+0000 7f0b95e77640 1 -- 172.21.15.53:0/2302785559 >> 172.21.15.53:0/2302785559 conn(0x7f0b900fe180 msgr2=0x7f0b901005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.768+0000 7f0b95e77640 1 -- 172.21.15.53:0/2302785559 shutdown_connections 2024-08-31T06:13:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.768+0000 7f0b95e77640 1 -- 172.21.15.53:0/2302785559 wait complete. 2024-08-31T06:13:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.768+0000 7f0b95e77640 1 Processor -- start 2024-08-31T06:13:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.768+0000 7f0b95e77640 1 -- start start 2024-08-31T06:13:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b95e77640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b90104730 0x7f0b9019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b95e77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b90105080 0x7f0b9019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b95e77640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9010db50 0x7f0b9019f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b95e77640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0b901136c0 con 0x7f0b90105080 2024-08-31T06:13:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b95e77640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b90113540 con 0x7f0b90104730 2024-08-31T06:13:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b95e77640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0b90113840 con 0x7f0b9010db50 2024-08-31T06:13:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b90105080 0x7f0b9019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b90105080 0x7f0b9019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35070/0 (socket says 172.21.15.53:35070) 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8effd640 1 -- 172.21.15.53:0/4268013652 learned_addr learned my addr 172.21.15.53:0/4268013652 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b90104730 0x7f0b9019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8ffff640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9010db50 0x7f0b9019f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8effd640 1 -- 172.21.15.53:0/4268013652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9010db50 msgr2=0x7f0b9019f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8effd640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9010db50 0x7f0b9019f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8effd640 1 -- 172.21.15.53:0/4268013652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b90104730 msgr2=0x7f0b9019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8effd640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b90104730 0x7f0b9019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8effd640 1 -- 172.21.15.53:0/4268013652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9019fff0 con 0x7f0b90105080 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8ffff640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9010db50 0x7f0b9019f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8effd640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b90105080 0x7f0b9019a660 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400e9f0 tx=0x7f0b8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8cff9640 1 -- 172.21.15.53:0/4268013652 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400ccc0 con 0x7f0b90105080 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8cff9640 1 -- 172.21.15.53:0/4268013652 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b840108c0 con 0x7f0b90105080 2024-08-31T06:13:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b95e77640 1 -- 172.21.15.53:0/4268013652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b901a02e0 con 0x7f0b90105080 2024-08-31T06:13:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.769+0000 7f0b8cff9640 1 -- 172.21.15.53:0/4268013652 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84018750 con 0x7f0b90105080 2024-08-31T06:13:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.770+0000 7f0b95e77640 1 -- 172.21.15.53:0/4268013652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b901a6a70 con 0x7f0b90105080 2024-08-31T06:13:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.772+0000 7f0b9cde0740 1 Processor -- start 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.772+0000 7f0b9cde0740 1 -- start start 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.772+0000 7f0b8cff9640 1 -- 172.21.15.53:0/4268013652 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0b84010430 con 0x7f0b90105080 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.772+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba896fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.772+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85a32f0 0x555ba8970220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.772+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85ab4d0 0x555ba8970760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555ba88e5000 con 0x555ba85cc1b0 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555ba88d4590 con 0x555ba85ab4d0 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555ba88d8540 con 0x555ba85a32f0 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba896fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba896fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35086/0 (socket says 172.21.15.53:35086) 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8ffff640 1 -- 172.21.15.53:0/581023161 learned_addr learned my addr 172.21.15.53:0/581023161 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/581023161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85a32f0 0x555ba8970220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8effd640 1 --2- 172.21.15.53:0/581023161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85ab4d0 0x555ba8970760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8ffff640 1 -- 172.21.15.53:0/581023161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85a32f0 msgr2=0x555ba8970220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8ffff640 1 --2- 172.21.15.53:0/581023161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85a32f0 0x555ba8970220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8ffff640 1 -- 172.21.15.53:0/581023161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85ab4d0 msgr2=0x555ba8970760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8ffff640 1 --2- 172.21.15.53:0/581023161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85ab4d0 0x555ba8970760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8ffff640 1 -- 172.21.15.53:0/581023161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ba8637790 con 0x555ba85cc1b0 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8effd640 1 --2- 172.21.15.53:0/581023161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85ab4d0 0x555ba8970760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8ffff640 1 --2- 172.21.15.53:0/581023161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba896fce0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f0b880094b0 tx=0x7f0b88009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c532366db26a18a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8cff9640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 0x7f0b780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b75ffb640 1 -- 172.21.15.53:0/581023161 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88031980 con 0x555ba85cc1b0 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b75ffb640 1 -- 172.21.15.53:0/581023161 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b88036040 con 0x555ba85cc1b0 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b75ffb640 1 -- 172.21.15.53:0/581023161 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88004360 con 0x555ba85cc1b0 2024-08-31T06:13:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.773+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 0x7f0b780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.774+0000 7f0b8cff9640 1 -- 172.21.15.53:0/4268013652 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f0b840e5940 con 0x7f0b90105080 2024-08-31T06:13:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.774+0000 7f0b9cde0740 1 -- 172.21.15.53:0/581023161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 msgr2=0x555ba896fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.774+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 0x7f0b780b71b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x555ba896e960 tx=0x7f0b80005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.774+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/581023161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba896fce0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f0b880094b0 tx=0x7f0b88009a20 comp rx=0 tx=0).stop 2024-08-31T06:13:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.774+0000 7f0b9cde0740 1 -- 172.21.15.53:0/581023161 shutdown_connections 2024-08-31T06:13:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.774+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/581023161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85ab4d0 0x555ba8970760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.774+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/581023161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85a32f0 0x555ba8970220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.774+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/581023161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba896fce0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.774+0000 7f0b9cde0740 1 -- 172.21.15.53:0/581023161 >> 172.21.15.53:0/581023161 conn(0x555ba85c0300 msgr2=0x555ba896dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.774+0000 7f0b9cde0740 1 -- 172.21.15.53:0/581023161 shutdown_connections 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.774+0000 7f0b9cde0740 1 -- 172.21.15.53:0/581023161 wait complete. 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b9cde0740 1 -- start start 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b9cde0740 1 Processor -- start 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba897b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba897be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba8987750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555ba880dab0 con 0x555ba85cc1b0 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555ba885b680 con 0x555ba85a32f0 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555ba897e400 con 0x555ba85ab4d0 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b9cde0740 10 client.0 _ll_register_callbacks cb 0x555ba85e3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b8ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba8987750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b8ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba8987750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35090/0 (socket says 172.21.15.53:35090) 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b8ffff640 1 -- 172.21.15.53:0/31302470 learned_addr learned my addr 172.21.15.53:0/31302470 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba897b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.775+0000 7f0b8effd640 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba897be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.776+0000 7f0b8ffff640 1 -- 172.21.15.53:0/31302470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 msgr2=0x555ba897be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.776+0000 7f0b8ffff640 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba897be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.776+0000 7f0b8ffff640 1 -- 172.21.15.53:0/31302470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 msgr2=0x555ba897b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.776+0000 7f0b8ffff640 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba897b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.776+0000 7f0b8ffff640 1 -- 172.21.15.53:0/31302470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ba86b0620 con 0x555ba85cc1b0 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.776+0000 7f0b8ffff640 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba8987750 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f0b88004080 tx=0x7f0b880315d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3ec8a020d3a1b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.776+0000 7f0b6effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.776+0000 7f0b6effd640 1 -- 172.21.15.53:0/31302470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88052020 con 0x555ba85cc1b0 2024-08-31T06:13:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.776+0000 7f0b6effd640 1 -- 172.21.15.53:0/31302470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f0b88003b70 con 0x555ba85cc1b0 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b9cde0740 1 -- 172.21.15.53:0/31302470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b88036040 con 0x555ba85cc1b0 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b6effd640 1 -- 172.21.15.53:0/31302470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f0b8805d050 con 0x555ba85cc1b0 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b9cde0740 10 client.18444 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b9cde0740 1 -- 172.21.15.53:0/31302470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555ba898a430 con 0x555ba85cc1b0 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b6effd640 1 -- 172.21.15.53:0/31302470 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b88036040 con 0x555ba85cc1b0 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b6effd640 1 -- 172.21.15.53:0/31302470 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f0b8804d030 con 0x555ba85cc1b0 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b9cde0740 10 client.18444 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b9cde0740 10 client.18444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b9cde0740 20 client.18444 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555ba858ad80 0x555ba898d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b9cde0740 4 client.18444 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b9cde0740 1 -- 172.21.15.53:0/31302470 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ba88e6f50 con 0x555ba858ad80 2024-08-31T06:13:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.777+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555ba858ad80 0x555ba898d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.778+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555ba858ad80 0x555ba898d790 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f864bd4159fb0a5c server_cookie=6a0a3ebfe5141884 in_seq=0 out_seq=0 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.778+0000 7f0b6effd640 10 client.18444 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.778+0000 7f0b6effd640 1 -- 172.21.15.53:0/31302470 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555ba88e6f50 con 0x555ba858ad80 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.778+0000 7f0b6effd640 10 client.18444 handle_command_reply: tid=0 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.778+0000 7f0b9cde0740 1 client.18444 shutdown 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b9cde0740 1 -- 172.21.15.53:0/31302470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 msgr2=0x555ba8987750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba8987750 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f0b88004080 tx=0x7f0b880315d0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b9cde0740 1 -- 172.21.15.53:0/31302470 shutdown_connections 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555ba858ad80 0x555ba898d790 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba85cc1b0 0x555ba8987750 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba897be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b6effd640 0 client.18444 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/31302470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba897b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b9cde0740 1 -- 172.21.15.53:0/31302470 >> 172.21.15.53:0/31302470 conn(0x555ba85c0300 msgr2=0x555ba8970d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b9cde0740 1 -- 172.21.15.53:0/31302470 shutdown_connections 2024-08-31T06:13:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b9cde0740 1 -- 172.21.15.53:0/31302470 wait complete. 2024-08-31T06:13:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.779+0000 7f0b9cde0740 20 client.18444 trim_cache size 0 max 16384 2024-08-31T06:13:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b9cde0740 1 Processor -- start 2024-08-31T06:13:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b9cde0740 1 -- start start 2024-08-31T06:13:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 0x555ba89876c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba897af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba8978890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0b901af4e0 con 0x555ba858ad80 2024-08-31T06:13:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b901b1140 con 0x555ba85a32f0 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0b901afbb0 con 0x555ba85ab4d0 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b8f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 0x555ba89876c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b8f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 0x555ba89876c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35102/0 (socket says 172.21.15.53:35102) 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b8f7fe640 1 -- 172.21.15.53:0/2902057553 learned_addr learned my addr 172.21.15.53:0/2902057553 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b8ffff640 1 --2- 172.21.15.53:0/2902057553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba8978890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b8effd640 1 --2- 172.21.15.53:0/2902057553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba897af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b8f7fe640 1 -- 172.21.15.53:0/2902057553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 msgr2=0x555ba8978890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/2902057553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba8978890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b8f7fe640 1 -- 172.21.15.53:0/2902057553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 msgr2=0x555ba897af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.794+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/2902057553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba897af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.795+0000 7f0b8f7fe640 1 -- 172.21.15.53:0/2902057553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ba896bf60 con 0x555ba858ad80 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.795+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/2902057553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 0x555ba89876c0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f0b80004360 tx=0x7f0b8001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91be723915829084 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.795+0000 7f0b757fa640 1 -- 172.21.15.53:0/2902057553 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b80004450 con 0x555ba858ad80 2024-08-31T06:13:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.795+0000 7f0b757fa640 1 -- 172.21.15.53:0/2902057553 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b80005020 con 0x555ba858ad80 2024-08-31T06:13:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.795+0000 7f0b757fa640 1 -- 172.21.15.53:0/2902057553 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b80004b00 con 0x555ba858ad80 2024-08-31T06:13:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.796+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2902057553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 msgr2=0x555ba89876c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.796+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/2902057553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 0x555ba89876c0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f0b80004360 tx=0x7f0b8001b000 comp rx=0 tx=0).stop 2024-08-31T06:13:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.796+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2902057553 shutdown_connections 2024-08-31T06:13:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.796+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/2902057553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba8978890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.796+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/2902057553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba897af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.796+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/2902057553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 0x555ba89876c0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.796+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2902057553 >> 172.21.15.53:0/2902057553 conn(0x555ba85c0300 msgr2=0x555ba8976830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.796+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2902057553 shutdown_connections 2024-08-31T06:13:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.796+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2902057553 wait complete. 2024-08-31T06:13:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.796+0000 7f0b9cde0740 1 -- start start 2024-08-31T06:13:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b9cde0740 1 Processor -- start 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 0x555ba89911c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba898e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b9cde0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba898ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0b901b09b0 con 0x555ba858ad80 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b901b0280 con 0x555ba85a32f0 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b9cde0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0b901ad4e0 con 0x555ba85ab4d0 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b9cde0740 10 client.0 _ll_register_callbacks cb 0x7f0b80009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b8f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 0x555ba89911c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b8f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 0x555ba89911c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35108/0 (socket says 172.21.15.53:35108) 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b8f7fe640 1 -- 172.21.15.53:0/2782775562 learned_addr learned my addr 172.21.15.53:0/2782775562 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.797+0000 7f0b8effd640 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba898e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.798+0000 7f0b8ffff640 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba898ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.798+0000 7f0b8effd640 1 -- 172.21.15.53:0/2782775562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 msgr2=0x555ba898ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.798+0000 7f0b8effd640 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba898ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.798+0000 7f0b8effd640 1 -- 172.21.15.53:0/2782775562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 msgr2=0x555ba89911c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:13:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.798+0000 7f0b8effd640 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 0x555ba89911c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.798+0000 7f0b8effd640 1 -- 172.21.15.53:0/2782775562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ba89f6f10 con 0x555ba85a32f0 2024-08-31T06:13:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.798+0000 7f0b8effd640 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba898e710 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b840e3070 tx=0x7f0b840ab840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=836e88030d8f2c3a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:13:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.798+0000 7f0b6effd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:13:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.798+0000 7f0b6effd640 1 -- 172.21.15.53:0/2782775562 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b840ac010 con 0x555ba85a32f0 2024-08-31T06:13:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.799+0000 7f0b6effd640 1 -- 172.21.15.53:0/2782775562 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8557+0+0 (secure 0 0 0) 0x7f0b840a8600 con 0x555ba85a32f0 2024-08-31T06:13:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.799+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2782775562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b80005020 con 0x555ba85a32f0 2024-08-31T06:13:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.799+0000 7f0b6effd640 1 -- 172.21.15.53:0/2782775562 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f0b840b0880 con 0x555ba85a32f0 2024-08-31T06:13:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.799+0000 7f0b9cde0740 10 client.27683 fetch_fsmap learned FSMap version 42 2024-08-31T06:13:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.799+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2782775562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555ba89f80d0 con 0x555ba85a32f0 2024-08-31T06:13:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.799+0000 7f0b6effd640 1 -- 172.21.15.53:0/2782775562 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b80005020 con 0x555ba85a32f0 2024-08-31T06:13:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.800+0000 7f0b6effd640 1 -- 172.21.15.53:0/2782775562 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7f0b840a7a10 con 0x555ba85a32f0 2024-08-31T06:13:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.800+0000 7f0b9cde0740 10 client.27683 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T06:13:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.800+0000 7f0b9cde0740 10 client.27683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:13:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.800+0000 7f0b9cde0740 20 client.27683 populate_metadata read hostname 'smithi053' 2024-08-31T06:13:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.800+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555ba85cc1b0 0x555ba89fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:13:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.800+0000 7f0b9cde0740 4 client.27683 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:13:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.800+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2782775562 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555ba88e29f0 con 0x555ba85cc1b0 2024-08-31T06:13:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.800+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555ba85cc1b0 0x555ba89fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:13:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.801+0000 7f0b6effd640 10 client.27683 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.801+0000 7f0b8f7fe640 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555ba85cc1b0 0x555ba89fa9a0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3308b75fb65bd966 server_cookie=620339c4fb802eba in_seq=0 out_seq=0 2024-08-31T06:13:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.819+0000 7f0b6effd640 1 -- 172.21.15.53:0/2782775562 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555ba88e29f0 con 0x555ba85cc1b0 2024-08-31T06:13:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.819+0000 7f0b6effd640 10 client.27683 handle_command_reply: tid=0 2024-08-31T06:13:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 1 client.27683 shutdown 2024-08-31T06:13:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2782775562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 msgr2=0x555ba898e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba898e710 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b840e3070 tx=0x7f0b840ab840 comp rx=0 tx=0).stop 2024-08-31T06:13:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2782775562 shutdown_connections 2024-08-31T06:13:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555ba85cc1b0 0x555ba89fa9a0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555ba85ab4d0 0x555ba898ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ba85a32f0 0x555ba898e710 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 1 --2- 172.21.15.53:0/2782775562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ba858ad80 0x555ba89911c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b6effd640 0 client.27683 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:13:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2782775562 >> 172.21.15.53:0/2782775562 conn(0x555ba85c0300 msgr2=0x555ba8976830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2782775562 shutdown_connections 2024-08-31T06:13:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 1 -- 172.21.15.53:0/2782775562 wait complete. 2024-08-31T06:13:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b9cde0740 20 client.27683 trim_cache size 0 max 16384 2024-08-31T06:13:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:13:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:13:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:13:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b95e77640 1 -- 172.21.15.53:0/4268013652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 msgr2=0x7f0b780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b95e77640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 0x7f0b780b71b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x555ba896e960 tx=0x7f0b80005f90 comp rx=0 tx=0).stop 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.820+0000 7f0b95e77640 1 -- 172.21.15.53:0/4268013652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b90105080 msgr2=0x7f0b9019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.821+0000 7f0b95e77640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b90105080 0x7f0b9019a660 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400e9f0 tx=0x7f0b8400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.821+0000 7f0b95e77640 1 -- 172.21.15.53:0/4268013652 shutdown_connections 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.821+0000 7f0b95e77640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0b780b4ca0 0x7f0b780b71b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.821+0000 7f0b95e77640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b9010db50 0x7f0b9019f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.821+0000 7f0b95e77640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b90105080 0x7f0b9019a660 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.821+0000 7f0b95e77640 1 --2- 172.21.15.53:0/4268013652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b90104730 0x7f0b9019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.821+0000 7f0b95e77640 1 -- 172.21.15.53:0/4268013652 >> 172.21.15.53:0/4268013652 conn(0x7f0b900fe180 msgr2=0x7f0b90107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.821+0000 7f0b95e77640 1 -- 172.21.15.53:0/4268013652 shutdown_connections 2024-08-31T06:13:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:13:58.821+0000 7f0b95e77640 1 -- 172.21.15.53:0/4268013652 wait complete. 2024-08-31T06:13:58.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 156163 1.61 MB/sec execute 348 sec latency 334.363 ms 2024-08-31T06:13:59.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:13:59 smithi153 ceph-mon[22320]: pgmap v600: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.2 MiB/s wr, 146 op/s 2024-08-31T06:13:59.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:13:59 smithi053 ceph-mon[18924]: pgmap v600: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.2 MiB/s wr, 146 op/s 2024-08-31T06:13:59.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 156163 1.61 MB/sec execute 349 sec latency 1334.408 ms 2024-08-31T06:14:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:13:59 smithi130 ceph-mon[22266]: pgmap v600: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.2 MiB/s wr, 146 op/s 2024-08-31T06:14:00.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:00 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:00.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:00 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:14:00.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:00 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:00.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:00 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:14:00.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 156163 1.60 MB/sec execute 350 sec latency 2334.480 ms 2024-08-31T06:14:01.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:00 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:01.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:00 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:14:01.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:01 smithi153 ceph-mon[22320]: pgmap v601: 97 pgs: 97 active+clean; 88 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-08-31T06:14:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:01 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:14:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:01 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:14:01.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:01 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:14:01.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:01 smithi053 ceph-mon[18924]: pgmap v601: 97 pgs: 97 active+clean; 88 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-08-31T06:14:01.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:01 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:14:01.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:01 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:14:01.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:01 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:14:01.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 156230 1.60 MB/sec execute 351 sec latency 2591.174 ms 2024-08-31T06:14:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:01 smithi130 ceph-mon[22266]: pgmap v601: 97 pgs: 97 active+clean; 88 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-08-31T06:14:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:01 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:14:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:01 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:14:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:01 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:14:02.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 156230 1.59 MB/sec execute 352 sec latency 1473.427 ms 2024-08-31T06:14:03.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:03 smithi153 ceph-mon[22320]: pgmap v602: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-08-31T06:14:03.930 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:03 smithi130 ceph-mon[22266]: pgmap v602: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-08-31T06:14:03.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:03 smithi053 ceph-mon[18924]: pgmap v602: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-08-31T06:14:03.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 156298 1.59 MB/sec execute 353 sec latency 2295.056 ms 2024-08-31T06:14:04.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 156548 1.59 MB/sec execute 354 sec latency 12.155 ms 2024-08-31T06:14:05.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:05 smithi153 ceph-mon[22320]: pgmap v603: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-08-31T06:14:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:05 smithi053 ceph-mon[18924]: pgmap v603: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-08-31T06:14:05.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 156926 1.58 MB/sec execute 355 sec latency 24.399 ms 2024-08-31T06:14:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:05 smithi130 ceph-mon[22266]: pgmap v603: 97 pgs: 97 active+clean; 90 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-08-31T06:14:06.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:06 smithi153 ceph-mon[22320]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T06:14:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:06 smithi053 ceph-mon[18924]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T06:14:06.987 INFO:tasks.workunit.client.0.smithi053.stdout: 1 157378 1.58 MB/sec execute 356 sec latency 72.441 ms 2024-08-31T06:14:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:06 smithi130 ceph-mon[22266]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T06:14:07.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:07 smithi153 ceph-mon[22320]: pgmap v605: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-08-31T06:14:07.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:07 smithi053 ceph-mon[18924]: pgmap v605: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-08-31T06:14:07.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 157907 1.59 MB/sec execute 357 sec latency 21.658 ms 2024-08-31T06:14:08.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:07 smithi130 ceph-mon[22266]: pgmap v605: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-08-31T06:14:08.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 158466 1.59 MB/sec execute 358 sec latency 21.199 ms 2024-08-31T06:14:09.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:09 smithi153 ceph-mon[22320]: pgmap v606: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1.0 MiB/s wr, 116 op/s 2024-08-31T06:14:09.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:09 smithi053 ceph-mon[18924]: pgmap v606: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1.0 MiB/s wr, 116 op/s 2024-08-31T06:14:09.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159067 1.60 MB/sec execute 359 sec latency 14.343 ms 2024-08-31T06:14:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:09 smithi130 ceph-mon[22266]: pgmap v606: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1.0 MiB/s wr, 116 op/s 2024-08-31T06:14:10.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:10 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:10.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159582 1.61 MB/sec execute 360 sec latency 15.054 ms 2024-08-31T06:14:11.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:10 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:11.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:10 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.920+0000 7ff04f12b640 1 -- 172.21.15.53:0/133179894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0481027a0 msgr2=0x7ff048102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.920+0000 7ff04f12b640 1 --2- 172.21.15.53:0/133179894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0481027a0 0x7ff048102bb0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff038009900 tx=0x7ff03802a410 comp rx=0 tx=0).stop 2024-08-31T06:14:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.920+0000 7ff04f12b640 1 -- 172.21.15.53:0/133179894 shutdown_connections 2024-08-31T06:14:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.920+0000 7ff04f12b640 1 --2- 172.21.15.53:0/133179894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff048108a20 0x7ff04810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.920+0000 7ff04f12b640 1 --2- 172.21.15.53:0/133179894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0481080d0 0x7ff0481084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.920+0000 7ff04f12b640 1 --2- 172.21.15.53:0/133179894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0481027a0 0x7ff048102bb0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.920+0000 7ff04f12b640 1 -- 172.21.15.53:0/133179894 >> 172.21.15.53:0/133179894 conn(0x7ff0480fe1c0 msgr2=0x7ff048100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.920+0000 7ff04f12b640 1 -- 172.21.15.53:0/133179894 shutdown_connections 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.920+0000 7ff04f12b640 1 -- 172.21.15.53:0/133179894 wait complete. 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff04f12b640 1 Processor -- start 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff04f12b640 1 -- start start 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff04f12b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0481027a0 0x7ff04819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff04f12b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0481080d0 0x7ff04819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff04f12b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff048108a20 0x7ff04819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff04f12b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481125d0 con 0x7ff0481080d0 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff04f12b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff048112450 con 0x7ff0481027a0 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff04f12b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff048112750 con 0x7ff048108a20 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0481080d0 0x7ff04819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0481080d0 0x7ff04819a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48700/0 (socket says 172.21.15.53:48700) 2024-08-31T06:14:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff047fff640 1 -- 172.21.15.53:0/3310108416 learned_addr learned my addr 172.21.15.53:0/3310108416 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff04d6c8640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff048108a20 0x7ff04819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.921+0000 7ff04cec7640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0481027a0 0x7ff04819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff047fff640 1 -- 172.21.15.53:0/3310108416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff048108a20 msgr2=0x7ff04819f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff047fff640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff048108a20 0x7ff04819f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff047fff640 1 -- 172.21.15.53:0/3310108416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0481027a0 msgr2=0x7ff04819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff047fff640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0481027a0 0x7ff04819a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff047fff640 1 -- 172.21.15.53:0/3310108416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0481a00d0 con 0x7ff0481080d0 2024-08-31T06:14:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff04cec7640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0481027a0 0x7ff04819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff047fff640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0481080d0 0x7ff04819a740 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00e9f0 tx=0x7ff03c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff045ffb640 1 -- 172.21.15.53:0/3310108416 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00ccc0 con 0x7ff0481080d0 2024-08-31T06:14:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff045ffb640 1 -- 172.21.15.53:0/3310108416 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff03c0108c0 con 0x7ff0481080d0 2024-08-31T06:14:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff04f12b640 1 -- 172.21.15.53:0/3310108416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0481a03c0 con 0x7ff0481080d0 2024-08-31T06:14:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff045ffb640 1 -- 172.21.15.53:0/3310108416 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c018750 con 0x7ff0481080d0 2024-08-31T06:14:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.922+0000 7ff04f12b640 1 -- 172.21.15.53:0/3310108416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0481a6b50 con 0x7ff0481080d0 2024-08-31T06:14:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff056099740 1 Processor -- start 2024-08-31T06:14:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff056099740 1 -- start start 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff045ffb640 1 -- 172.21.15.53:0/3310108416 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff03c010430 con 0x7ff0481080d0 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff056099740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 0x561a12ff4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff056099740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ff5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff056099740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a12ff5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff056099740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561a12f6a000 con 0x561a12c282f0 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff056099740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561a12f59590 con 0x561a12c304d0 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff056099740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a12f5d540 con 0x561a12c511b0 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff04cec7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ff5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff04cec7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ff5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48716/0 (socket says 172.21.15.53:48716) 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff04cec7640 1 -- 172.21.15.53:0/4042273329 learned_addr learned my addr 172.21.15.53:0/4042273329 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff04d6c8640 1 --2- 172.21.15.53:0/4042273329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 0x561a12ff4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.925+0000 7ff047fff640 1 --2- 172.21.15.53:0/4042273329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a12ff5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff04cec7640 1 -- 172.21.15.53:0/4042273329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 msgr2=0x561a12ff4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff04cec7640 1 --2- 172.21.15.53:0/4042273329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 0x561a12ff4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff04cec7640 1 -- 172.21.15.53:0/4042273329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 msgr2=0x561a12ff5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff04cec7640 1 --2- 172.21.15.53:0/4042273329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a12ff5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff04cec7640 1 -- 172.21.15.53:0/4042273329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a12cbc790 con 0x561a12c282f0 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff04d6c8640 1 --2- 172.21.15.53:0/4042273329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 0x561a12ff4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff045ffb640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff0300b4d20 0x7ff0300b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff04d6c8640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff0300b4d20 0x7ff0300b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff045ffb640 1 -- 172.21.15.53:0/3310108416 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8601+0+0 (secure 0 0 0) 0x7ff03c0e5920 con 0x7ff0481080d0 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff04cec7640 1 --2- 172.21.15.53:0/4042273329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ff5000 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff0380042e0 tx=0x7ff038004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1927d052a6fd5c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff02effd640 1 -- 172.21.15.53:0/4042273329 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03803f070 con 0x561a12c282f0 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff02effd640 1 -- 172.21.15.53:0/4042273329 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff038005de0 con 0x561a12c282f0 2024-08-31T06:14:11.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.926+0000 7ff02effd640 1 -- 172.21.15.53:0/4042273329 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038035030 con 0x561a12c282f0 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.927+0000 7ff056099740 1 -- 172.21.15.53:0/4042273329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 msgr2=0x561a12ff5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.927+0000 7ff04d6c8640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff0300b4d20 0x7ff0300b7230 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff040005fd0 tx=0x7ff040009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.927+0000 7ff056099740 1 --2- 172.21.15.53:0/4042273329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ff5000 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff0380042e0 tx=0x7ff038004310 comp rx=0 tx=0).stop 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.927+0000 7ff056099740 1 -- 172.21.15.53:0/4042273329 shutdown_connections 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.927+0000 7ff056099740 1 --2- 172.21.15.53:0/4042273329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a12ff5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.927+0000 7ff056099740 1 --2- 172.21.15.53:0/4042273329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ff5000 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.927+0000 7ff056099740 1 --2- 172.21.15.53:0/4042273329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 0x561a12ff4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.927+0000 7ff056099740 1 -- 172.21.15.53:0/4042273329 >> 172.21.15.53:0/4042273329 conn(0x561a12c45300 msgr2=0x561a12ff29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.927+0000 7ff056099740 1 -- 172.21.15.53:0/4042273329 shutdown_connections 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.927+0000 7ff056099740 1 -- 172.21.15.53:0/4042273329 wait complete. 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.927+0000 7ff056099740 1 -- start start 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff056099740 1 Processor -- start 2024-08-31T06:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff056099740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a130005a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff056099740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a13000ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff056099740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 0x561a1300c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff056099740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561a12e92ab0 con 0x561a12c282f0 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff056099740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561a12ee0680 con 0x561a12c304d0 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff056099740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a130031e0 con 0x561a12c511b0 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff056099740 10 client.0 _ll_register_callbacks cb 0x561a12c68a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff04cec7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a130005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff04cec7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a130005a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48722/0 (socket says 172.21.15.53:48722) 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff04cec7640 1 -- 172.21.15.53:0/294233753 learned_addr learned my addr 172.21.15.53:0/294233753 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff04d6c8640 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 0x561a1300c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.928+0000 7ff047fff640 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a13000ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff04cec7640 1 -- 172.21.15.53:0/294233753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 msgr2=0x561a1300c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff04cec7640 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 0x561a1300c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff04cec7640 1 -- 172.21.15.53:0/294233753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 msgr2=0x561a13000ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff04cec7640 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a13000ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff04cec7640 1 -- 172.21.15.53:0/294233753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a12d35620 con 0x561a12c282f0 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff047fff640 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a13000ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff04d6c8640 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 0x561a1300c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff04cec7640 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a130005a0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ff03802a450 tx=0x7ff038004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b577f2ecd764c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff027fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff027fff640 1 -- 172.21.15.53:0/294233753 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03804c070 con 0x561a12c282f0 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff027fff640 1 -- 172.21.15.53:0/294233753 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8601+0+0 (secure 0 0 0) 0x7ff038005370 con 0x561a12c282f0 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff056099740 1 -- 172.21.15.53:0/294233753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a12f6bf50 con 0x561a12c282f0 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff027fff640 1 -- 172.21.15.53:0/294233753 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff038058050 con 0x561a12c282f0 2024-08-31T06:14:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff056099740 10 client.18462 fetch_fsmap learned FSMap version 44 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff056099740 1 -- 172.21.15.53:0/294233753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x561a1300f180 con 0x561a12c282f0 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff027fff640 1 -- 172.21.15.53:0/294233753 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561a12f6bf50 con 0x561a12c282f0 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.929+0000 7ff027fff640 1 -- 172.21.15.53:0/294233753 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 44) ==== 8406+0+0 (secure 0 0 0) 0x7ff038044450 con 0x561a12c282f0 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.930+0000 7ff056099740 10 client.18462 fetch_fsmap finished waiting for FSMap version 44 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.930+0000 7ff056099740 10 client.18462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.930+0000 7ff056099740 20 client.18462 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.930+0000 7ff056099740 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a12c0fd80 0x561a130124e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.930+0000 7ff056099740 4 client.18462 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.930+0000 7ff056099740 1 -- 172.21.15.53:0/294233753 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a12f679f0 con 0x561a12c0fd80 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.930+0000 7ff047fff640 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a12c0fd80 0x561a130124e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.930+0000 7ff027fff640 10 client.18462 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.930+0000 7ff047fff640 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a12c0fd80 0x561a130124e0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5601cdb548cab5c9 server_cookie=67399465cd9687f7 in_seq=0 out_seq=0 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff027fff640 1 -- 172.21.15.53:0/294233753 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a12f679f0 con 0x561a12c0fd80 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff027fff640 10 client.18462 handle_command_reply: tid=0 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 1 client.18462 shutdown 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 1 -- 172.21.15.53:0/294233753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 msgr2=0x561a130005a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a130005a0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ff03802a450 tx=0x7ff038004a90 comp rx=0 tx=0).stop 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 1 -- 172.21.15.53:0/294233753 shutdown_connections 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a12c0fd80 0x561a130124e0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c511b0 0x561a1300c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff027fff640 0 client.18462 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a13000ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 1 --2- 172.21.15.53:0/294233753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a130005a0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 1 -- 172.21.15.53:0/294233753 >> 172.21.15.53:0/294233753 conn(0x561a12c45300 msgr2=0x561a12ff5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 1 -- 172.21.15.53:0/294233753 shutdown_connections 2024-08-31T06:14:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 1 -- 172.21.15.53:0/294233753 wait complete. 2024-08-31T06:14:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.931+0000 7ff056099740 20 client.18462 trim_cache size 0 max 16384 2024-08-31T06:14:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff056099740 1 Processor -- start 2024-08-31T06:14:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff056099740 1 -- start start 2024-08-31T06:14:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff056099740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c0fd80 0x561a13001fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff056099740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ffd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff056099740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a12ffdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff056099740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481af620 con 0x561a12c282f0 2024-08-31T06:14:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff056099740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481b1310 con 0x561a12c304d0 2024-08-31T06:14:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff056099740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481afcf0 con 0x561a12c0fd80 2024-08-31T06:14:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ffd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ffd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48728/0 (socket says 172.21.15.53:48728) 2024-08-31T06:14:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff047fff640 1 -- 172.21.15.53:0/338753340 learned_addr learned my addr 172.21.15.53:0/338753340 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff04cec7640 1 --2- 172.21.15.53:0/338753340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c0fd80 0x561a13001fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff04d6c8640 1 --2- 172.21.15.53:0/338753340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a12ffdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff047fff640 1 -- 172.21.15.53:0/338753340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c0fd80 msgr2=0x561a13001fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff047fff640 1 --2- 172.21.15.53:0/338753340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c0fd80 0x561a13001fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff047fff640 1 -- 172.21.15.53:0/338753340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 msgr2=0x561a12ffdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.946+0000 7ff047fff640 1 --2- 172.21.15.53:0/338753340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a12ffdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.947+0000 7ff047fff640 1 -- 172.21.15.53:0/338753340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a13001230 con 0x561a12c282f0 2024-08-31T06:14:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.947+0000 7ff04d6c8640 1 --2- 172.21.15.53:0/338753340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a12ffdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.947+0000 7ff047fff640 1 --2- 172.21.15.53:0/338753340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ffd560 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0abcc0 tx=0x7ff03c0e7e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b8fa7207a17141 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.947+0000 7ff02e7fc640 1 -- 172.21.15.53:0/338753340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c0ac6c0 con 0x561a12c282f0 2024-08-31T06:14:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.947+0000 7ff02e7fc640 1 -- 172.21.15.53:0/338753340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff03c0abfc0 con 0x561a12c282f0 2024-08-31T06:14:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.947+0000 7ff02e7fc640 1 -- 172.21.15.53:0/338753340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c0a8250 con 0x561a12c282f0 2024-08-31T06:14:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.947+0000 7ff056099740 1 -- 172.21.15.53:0/338753340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 msgr2=0x561a12ffd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.947+0000 7ff056099740 1 --2- 172.21.15.53:0/338753340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ffd560 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0abcc0 tx=0x7ff03c0e7e30 comp rx=0 tx=0).stop 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 -- 172.21.15.53:0/338753340 shutdown_connections 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 --2- 172.21.15.53:0/338753340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c304d0 0x561a12ffdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 --2- 172.21.15.53:0/338753340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c282f0 0x561a12ffd560 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 --2- 172.21.15.53:0/338753340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c0fd80 0x561a13001fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 -- 172.21.15.53:0/338753340 >> 172.21.15.53:0/338753340 conn(0x561a12c45300 msgr2=0x561a130018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 -- 172.21.15.53:0/338753340 shutdown_connections 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 -- 172.21.15.53:0/338753340 wait complete. 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 -- start start 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 Processor -- start 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c0fd80 0x561a13006600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c282f0 0x561a13006b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c304d0 0x561a13007080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481b0b80 con 0x561a12c0fd80 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481b0450 con 0x561a12c282f0 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481ad620 con 0x561a12c304d0 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.948+0000 7ff056099740 10 client.0 _ll_register_callbacks cb 0x7ff038009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff04cec7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c0fd80 0x561a13006600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff04cec7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c0fd80 0x561a13006600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48740/0 (socket says 172.21.15.53:48740) 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff04cec7640 1 -- 172.21.15.53:0/4121755254 learned_addr learned my addr 172.21.15.53:0/4121755254 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff04d6c8640 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c304d0 0x561a13007080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff047fff640 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c282f0 0x561a13006b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff04cec7640 1 -- 172.21.15.53:0/4121755254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c304d0 msgr2=0x561a13007080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff04cec7640 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c304d0 0x561a13007080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff04cec7640 1 -- 172.21.15.53:0/4121755254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c282f0 msgr2=0x561a13006b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff04cec7640 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c282f0 0x561a13006b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff04cec7640 1 -- 172.21.15.53:0/4121755254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a13080250 con 0x561a12c0fd80 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff04cec7640 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c0fd80 0x561a13006600 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ff03802a450 tx=0x7ff038004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbb27bb896f2f44 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff027fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff027fff640 1 -- 172.21.15.53:0/4121755254 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03804c040 con 0x561a12c0fd80 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff027fff640 1 -- 172.21.15.53:0/4121755254 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8601+0+0 (secure 0 0 0) 0x7ff038044c40 con 0x561a12c0fd80 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff056099740 1 -- 172.21.15.53:0/4121755254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff03c0abfc0 con 0x561a12c0fd80 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff027fff640 1 -- 172.21.15.53:0/4121755254 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff03803f050 con 0x561a12c0fd80 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff056099740 10 client.18468 fetch_fsmap learned FSMap version 44 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.949+0000 7ff056099740 1 -- 172.21.15.53:0/4121755254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x561a13081510 con 0x561a12c0fd80 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.950+0000 7ff027fff640 1 -- 172.21.15.53:0/4121755254 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff03c0abfc0 con 0x561a12c0fd80 2024-08-31T06:14:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.950+0000 7ff027fff640 1 -- 172.21.15.53:0/4121755254 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 44) ==== 8406+0+0 (secure 0 0 0) 0x7ff03803b6f0 con 0x561a12c0fd80 2024-08-31T06:14:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.950+0000 7ff056099740 10 client.18468 fetch_fsmap finished waiting for FSMap version 44 2024-08-31T06:14:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.950+0000 7ff056099740 10 client.18468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.950+0000 7ff056099740 20 client.18468 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.950+0000 7ff056099740 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a12c511b0 0x561a13083de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.950+0000 7ff056099740 4 client.18468 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:14:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.950+0000 7ff056099740 1 -- 172.21.15.53:0/4121755254 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561a12f65130 con 0x561a12c511b0 2024-08-31T06:14:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.950+0000 7ff047fff640 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a12c511b0 0x561a13083de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.950+0000 7ff047fff640 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a12c511b0 0x561a13083de0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b5eb846e1aefdd8 server_cookie=53dbfb2a4f1eb667 in_seq=0 out_seq=0 2024-08-31T06:14:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.950+0000 7ff027fff640 10 client.18468 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:11.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:11 smithi053 ceph-mon[18924]: pgmap v607: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1023 KiB/s wr, 118 op/s 2024-08-31T06:14:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff027fff640 1 -- 172.21.15.53:0/4121755254 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561a12f65130 con 0x561a12c511b0 2024-08-31T06:14:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff027fff640 10 client.18468 handle_command_reply: tid=0 2024-08-31T06:14:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff056099740 1 client.18468 shutdown 2024-08-31T06:14:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff056099740 1 -- 172.21.15.53:0/4121755254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c0fd80 msgr2=0x561a13006600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff056099740 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c0fd80 0x561a13006600 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ff03802a450 tx=0x7ff038004740 comp rx=0 tx=0).stop 2024-08-31T06:14:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff056099740 1 -- 172.21.15.53:0/4121755254 shutdown_connections 2024-08-31T06:14:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff056099740 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a12c511b0 0x561a13083de0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff056099740 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a12c304d0 0x561a13007080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff056099740 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a12c282f0 0x561a13006b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff027fff640 0 client.18468 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff056099740 1 --2- 172.21.15.53:0/4121755254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a12c0fd80 0x561a13006600 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff056099740 1 -- 172.21.15.53:0/4121755254 >> 172.21.15.53:0/4121755254 conn(0x561a12c45300 msgr2=0x561a12ffebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff056099740 1 -- 172.21.15.53:0/4121755254 shutdown_connections 2024-08-31T06:14:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.974+0000 7ff056099740 1 -- 172.21.15.53:0/4121755254 wait complete. 2024-08-31T06:14:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.975+0000 7ff056099740 20 client.18468 trim_cache size 0 max 16384 2024-08-31T06:14:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:14:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:14:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:14:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:14:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.975+0000 7ff04f12b640 1 -- 172.21.15.53:0/3310108416 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff0300b4d20 msgr2=0x7ff0300b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.975+0000 7ff04f12b640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff0300b4d20 0x7ff0300b7230 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff040005fd0 tx=0x7ff040009600 comp rx=0 tx=0).stop 2024-08-31T06:14:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.975+0000 7ff04f12b640 1 -- 172.21.15.53:0/3310108416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0481080d0 msgr2=0x7ff04819a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.975+0000 7ff04f12b640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0481080d0 0x7ff04819a740 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00e9f0 tx=0x7ff03c00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.975+0000 7ff04f12b640 1 -- 172.21.15.53:0/3310108416 shutdown_connections 2024-08-31T06:14:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.975+0000 7ff04f12b640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff0300b4d20 0x7ff0300b7230 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.975+0000 7ff04f12b640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff048108a20 0x7ff04819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.975+0000 7ff04f12b640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0481080d0 0x7ff04819a740 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.975+0000 7ff04f12b640 1 --2- 172.21.15.53:0/3310108416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0481027a0 0x7ff04819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.975+0000 7ff04f12b640 1 -- 172.21.15.53:0/3310108416 >> 172.21.15.53:0/3310108416 conn(0x7ff0480fe1c0 msgr2=0x7ff0481012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.976+0000 7ff04f12b640 1 -- 172.21.15.53:0/3310108416 shutdown_connections 2024-08-31T06:14:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:11.976+0000 7ff04f12b640 1 -- 172.21.15.53:0/3310108416 wait complete. 2024-08-31T06:14:11.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159709 1.61 MB/sec execute 361 sec latency 728.864 ms 2024-08-31T06:14:12.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:11 smithi130 ceph-mon[22266]: pgmap v607: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1023 KiB/s wr, 118 op/s 2024-08-31T06:14:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:11 smithi153 ceph-mon[22320]: pgmap v607: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1023 KiB/s wr, 118 op/s 2024-08-31T06:14:12.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159709 1.60 MB/sec execute 362 sec latency 1728.902 ms 2024-08-31T06:14:13.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:13 smithi053 ceph-mon[18924]: pgmap v608: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 994 KiB/s wr, 115 op/s 2024-08-31T06:14:13.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159709 1.60 MB/sec execute 363 sec latency 2728.939 ms 2024-08-31T06:14:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:13 smithi130 ceph-mon[22266]: pgmap v608: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 994 KiB/s wr, 115 op/s 2024-08-31T06:14:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:13 smithi153 ceph-mon[22320]: pgmap v608: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 994 KiB/s wr, 115 op/s 2024-08-31T06:14:14.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159709 1.59 MB/sec execute 364 sec latency 3729.027 ms 2024-08-31T06:14:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:15 smithi130 ceph-mon[22266]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T06:14:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:15 smithi130 ceph-mon[22266]: pgmap v610: 97 pgs: 97 active+clean; 95 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.2 MiB/s wr, 127 op/s 2024-08-31T06:14:15.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:15 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:15 smithi153 ceph-mon[22320]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T06:14:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:15 smithi153 ceph-mon[22320]: pgmap v610: 97 pgs: 97 active+clean; 95 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.2 MiB/s wr, 127 op/s 2024-08-31T06:14:15.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:15 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:15 smithi053 ceph-mon[18924]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T06:14:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:15 smithi053 ceph-mon[18924]: pgmap v610: 97 pgs: 97 active+clean; 95 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.2 MiB/s wr, 127 op/s 2024-08-31T06:14:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:15 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:15.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159709 1.59 MB/sec execute 365 sec latency 4729.167 ms 2024-08-31T06:14:16.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159776 1.58 MB/sec execute 366 sec latency 4986.010 ms 2024-08-31T06:14:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:17 smithi130 ceph-mon[22266]: pgmap v611: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-08-31T06:14:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:17 smithi153 ceph-mon[22320]: pgmap v611: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-08-31T06:14:17.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:17 smithi053 ceph-mon[18924]: pgmap v611: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-08-31T06:14:17.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159776 1.58 MB/sec execute 367 sec latency 1483.635 ms 2024-08-31T06:14:18.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159776 1.58 MB/sec execute 368 sec latency 2483.751 ms 2024-08-31T06:14:19.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:19 smithi130 ceph-mon[22266]: pgmap v612: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 837 KiB/s wr, 77 op/s 2024-08-31T06:14:19.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:19 smithi153 ceph-mon[22320]: pgmap v612: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 837 KiB/s wr, 77 op/s 2024-08-31T06:14:19.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:19 smithi053 ceph-mon[18924]: pgmap v612: 97 pgs: 97 active+clean; 91 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 837 KiB/s wr, 77 op/s 2024-08-31T06:14:19.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159776 1.57 MB/sec execute 369 sec latency 3483.852 ms 2024-08-31T06:14:20.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159776 1.57 MB/sec execute 370 sec latency 4483.952 ms 2024-08-31T06:14:21.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:21 smithi130 ceph-mon[22266]: pgmap v613: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 559 KiB/s wr, 66 op/s 2024-08-31T06:14:21.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:21 smithi153 ceph-mon[22320]: pgmap v613: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 559 KiB/s wr, 66 op/s 2024-08-31T06:14:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:21 smithi053 ceph-mon[18924]: pgmap v613: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 559 KiB/s wr, 66 op/s 2024-08-31T06:14:21.988 INFO:tasks.workunit.client.0.smithi053.stdout: 1 159963 1.57 MB/sec execute 371 sec latency 4740.949 ms 2024-08-31T06:14:22.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 160238 1.56 MB/sec execute 372 sec latency 19.936 ms 2024-08-31T06:14:23.092 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:14:23.369 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:23.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:23 smithi053 ceph-mon[18924]: pgmap v614: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 459 KiB/s wr, 56 op/s 2024-08-31T06:14:23.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:23 smithi130 ceph-mon[22266]: pgmap v614: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 459 KiB/s wr, 56 op/s 2024-08-31T06:14:23.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:23 smithi153 ceph-mon[22320]: pgmap v614: 97 pgs: 97 active+clean; 92 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 459 KiB/s wr, 56 op/s 2024-08-31T06:14:23.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 160689 1.56 MB/sec execute 373 sec latency 40.314 ms 2024-08-31T06:14:24.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.104+0000 7f82bf61a640 1 -- 172.21.15.53:0/4207078070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82b810ff80 msgr2=0x7f82b81123a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:24.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.104+0000 7f82bf61a640 1 --2- 172.21.15.53:0/4207078070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82b810ff80 0x7f82b81123a0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009ca0 tx=0x7f82b002a950 comp rx=0 tx=0).stop 2024-08-31T06:14:24.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.104+0000 7f82bf61a640 1 -- 172.21.15.53:0/4207078070 shutdown_connections 2024-08-31T06:14:24.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.104+0000 7f82bf61a640 1 --2- 172.21.15.53:0/4207078070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82b810ff80 0x7f82b81123a0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.104+0000 7f82bf61a640 1 --2- 172.21.15.53:0/4207078070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b8102d20 0x7f82b810fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.104+0000 7f82bf61a640 1 --2- 172.21.15.53:0/4207078070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b81023d0 0x7f82b81027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.104+0000 7f82bf61a640 1 -- 172.21.15.53:0/4207078070 >> 172.21.15.53:0/4207078070 conn(0x7f82b80794d0 msgr2=0x7f82b80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:24.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.104+0000 7f82bf61a640 1 -- 172.21.15.53:0/4207078070 shutdown_connections 2024-08-31T06:14:24.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.104+0000 7f82bf61a640 1 -- 172.21.15.53:0/4207078070 wait complete. 2024-08-31T06:14:24.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bf61a640 1 Processor -- start 2024-08-31T06:14:24.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bf61a640 1 -- start start 2024-08-31T06:14:24.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bf61a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82b81023d0 0x7f82b819c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bf61a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b8102d20 0x7f82b819c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bf61a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b810ff80 0x7f82b81a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bf61a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f82b81158f0 con 0x7f82b81023d0 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bf61a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82b8115770 con 0x7f82b810ff80 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bf61a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82b8115a70 con 0x7f82b8102d20 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bcbb5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b8102d20 0x7f82b819c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bd3b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82b81023d0 0x7f82b819c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bcbb5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b8102d20 0x7f82b819c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48240/0 (socket says 172.21.15.53:48240) 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bcbb5640 1 -- 172.21.15.53:0/1741983054 learned_addr learned my addr 172.21.15.53:0/1741983054 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.105+0000 7f82bdbb7640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b810ff80 0x7f82b81a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.106+0000 7f82bcbb5640 1 -- 172.21.15.53:0/1741983054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b810ff80 msgr2=0x7f82b81a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.106+0000 7f82bcbb5640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b810ff80 0x7f82b81a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.106+0000 7f82bcbb5640 1 -- 172.21.15.53:0/1741983054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82b81023d0 msgr2=0x7f82b819c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.106+0000 7f82bcbb5640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82b81023d0 0x7f82b819c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.106+0000 7f82bcbb5640 1 -- 172.21.15.53:0/1741983054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b81a2210 con 0x7f82b8102d20 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.106+0000 7f82bdbb7640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b810ff80 0x7f82b81a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.106+0000 7f82bcbb5640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b8102d20 0x7f82b819c840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f82a800d950 tx=0x7f82a800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.106+0000 7f82ae7fc640 1 -- 172.21.15.53:0/1741983054 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a8017030 con 0x7f82b8102d20 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.106+0000 7f82bf61a640 1 -- 172.21.15.53:0/1741983054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b81a2500 con 0x7f82b8102d20 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.106+0000 7f82ae7fc640 1 -- 172.21.15.53:0/1741983054 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82a8004020 con 0x7f82b8102d20 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.106+0000 7f82ae7fc640 1 -- 172.21.15.53:0/1741983054 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a80055d0 con 0x7f82b8102d20 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.107+0000 7f82bf61a640 1 -- 172.21.15.53:0/1741983054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b81a8c60 con 0x7f82b8102d20 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.109+0000 7f82ae7fc640 1 -- 172.21.15.53:0/1741983054 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f82a8009a30 con 0x7f82b8102d20 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.110+0000 7f82c5b8f740 1 Processor -- start 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.110+0000 7f82c5b8f740 1 -- start start 2024-08-31T06:14:24.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.110+0000 7f82ae7fc640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82a40b4ca0 0x7f82a40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da0072c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c391b0 0x55c5da007800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c41390 0x55c5da007d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bdbb7640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82a40b4ca0 0x7f82a40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82ae7fc640 1 -- 172.21.15.53:0/1741983054 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f82a80e4ed0 con 0x7f82b8102d20 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c5d9f7e630 con 0x55c5d9c391b0 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c5d9f6dbc0 con 0x55c5d9c62070 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c5d9f71b70 con 0x55c5d9c41390 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bd3b6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da0072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bd3b6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da0072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60204/0 (socket says 172.21.15.53:60204) 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bd3b6640 1 -- 172.21.15.53:0/3593241826 learned_addr learned my addr 172.21.15.53:0/3593241826 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bdbb7640 1 --2- 172.21.15.53:0/3593241826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c41390 0x55c5da007d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bcbb5640 1 --2- 172.21.15.53:0/3593241826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c391b0 0x55c5da007800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bd3b6640 1 -- 172.21.15.53:0/3593241826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c41390 msgr2=0x55c5da007d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/3593241826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c41390 0x55c5da007d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bd3b6640 1 -- 172.21.15.53:0/3593241826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c391b0 msgr2=0x55c5da007800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/3593241826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c391b0 0x55c5da007800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bd3b6640 1 -- 172.21.15.53:0/3593241826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d9ccd650 con 0x55c5d9c62070 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bdbb7640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82a40b4ca0 0x7f82a40b71b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f82b0006010 tx=0x7f82b0003ca0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.111+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/3593241826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da0072c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009cf0 tx=0x7f82b4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8aeceec366e5507 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.112+0000 7f82a37fe640 1 -- 172.21.15.53:0/3593241826 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4004220 con 0x55c5d9c62070 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.112+0000 7f82a37fe640 1 -- 172.21.15.53:0/3593241826 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82b40043c0 con 0x55c5d9c62070 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.112+0000 7f82a37fe640 1 -- 172.21.15.53:0/3593241826 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b40186c0 con 0x55c5d9c62070 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.113+0000 7f82c5b8f740 1 -- 172.21.15.53:0/3593241826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 msgr2=0x55c5da0072c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.113+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/3593241826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da0072c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009cf0 tx=0x7f82b4011810 comp rx=0 tx=0).stop 2024-08-31T06:14:24.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.113+0000 7f82c5b8f740 1 -- 172.21.15.53:0/3593241826 shutdown_connections 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.113+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/3593241826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c41390 0x55c5da007d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.113+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/3593241826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c391b0 0x55c5da007800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.113+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/3593241826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da0072c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.113+0000 7f82c5b8f740 1 -- 172.21.15.53:0/3593241826 >> 172.21.15.53:0/3593241826 conn(0x55c5d9c56460 msgr2=0x55c5da0051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.113+0000 7f82c5b8f740 1 -- 172.21.15.53:0/3593241826 shutdown_connections 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.113+0000 7f82c5b8f740 1 -- 172.21.15.53:0/3593241826 wait complete. 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.113+0000 7f82c5b8f740 1 -- start start 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.113+0000 7f82c5b8f740 1 Processor -- start 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c391b0 0x55c5da012a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 0x55c5da012fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da01ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c5d9dd0700 con 0x55c5d9c41390 2024-08-31T06:14:24.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c5d9ef4700 con 0x55c5d9c62070 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c5da015aa0 con 0x55c5d9c391b0 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82c5b8f740 10 client.0 _ll_register_callbacks cb 0x55c5d9f23dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bdbb7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da01ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bdbb7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da01ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60218/0 (socket says 172.21.15.53:60218) 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bcbb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 0x55c5da012fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bdbb7640 1 -- 172.21.15.53:0/2894251715 learned_addr learned my addr 172.21.15.53:0/2894251715 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c391b0 0x55c5da012a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bdbb7640 1 -- 172.21.15.53:0/2894251715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c391b0 msgr2=0x55c5da012a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bdbb7640 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c391b0 0x55c5da012a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bdbb7640 1 -- 172.21.15.53:0/2894251715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 msgr2=0x55c5da012fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bdbb7640 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 0x55c5da012fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bdbb7640 1 -- 172.21.15.53:0/2894251715 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5d9f2d8b0 con 0x55c5d9c62070 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bcbb5640 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 0x55c5da012fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:24.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.114+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c391b0 0x55c5da012a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82bdbb7640 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da01ed90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009ca0 tx=0x7f82b002a950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ef6c6c5fb0e91b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2894251715 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0058060 con 0x55c5d9c62070 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2894251715 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f82b0004510 con 0x55c5d9c62070 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2894251715 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82b40043c0 con 0x55c5d9c62070 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2894251715 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f82b0034040 con 0x55c5d9c62070 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82c5b8f740 10 client.27707 fetch_fsmap learned FSMap version 45 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2894251715 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55c5da0218a0 con 0x55c5d9c62070 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2894251715 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82b40043c0 con 0x55c5d9c62070 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2894251715 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 45) ==== 8410+0+0 (secure 0 0 0) 0x7f82b0052030 con 0x55c5d9c62070 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82c5b8f740 10 client.27707 fetch_fsmap finished waiting for FSMap version 45 2024-08-31T06:14:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.115+0000 7f82c5b8f740 10 client.27707 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.116+0000 7f82c5b8f740 20 client.27707 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.116+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5d9c209f0 0x55c5da024e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.116+0000 7f82c5b8f740 4 client.27707 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.116+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2894251715 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5d9f80580 con 0x55c5d9c209f0 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.116+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5d9c209f0 0x55c5da024e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.116+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5d9c209f0 0x55c5da024e50 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b6706d324489e96 server_cookie=5e66a0d64df9a8ef in_seq=0 out_seq=0 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.116+0000 7f82a0ff9640 10 client.27707 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.117+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2894251715 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c5d9f80580 con 0x55c5d9c209f0 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.117+0000 7f82a0ff9640 10 client.27707 handle_command_reply: tid=0 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.117+0000 7f82c5b8f740 1 client.27707 shutdown 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2894251715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 msgr2=0x55c5da01ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da01ed90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009ca0 tx=0x7f82b002a950 comp rx=0 tx=0).stop 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2894251715 shutdown_connections 2024-08-31T06:14:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5d9c209f0 0x55c5da024e50 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c62070 0x55c5da01ed90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 0x55c5da012fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82a0ff9640 0 client.27707 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2894251715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c391b0 0x55c5da012a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2894251715 >> 172.21.15.53:0/2894251715 conn(0x55c5d9c56460 msgr2=0x55c5da00a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2894251715 shutdown_connections 2024-08-31T06:14:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2894251715 wait complete. 2024-08-31T06:14:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.118+0000 7f82c5b8f740 20 client.27707 trim_cache size 0 max 16384 2024-08-31T06:14:24.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82c5b8f740 1 Processor -- start 2024-08-31T06:14:24.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82c5b8f740 1 -- start start 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c209f0 0x55c5da013050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c391b0 0x55c5da00aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c41390 0x55c5da01ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f82b81b1720 con 0x55c5d9c391b0 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82b81b3440 con 0x55c5d9c209f0 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82b81b1df0 con 0x55c5d9c41390 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82bd3b6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c209f0 0x55c5da013050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82bcbb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c391b0 0x55c5da00aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82bd3b6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c209f0 0x55c5da013050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60220/0 (socket says 172.21.15.53:60220) 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82bd3b6640 1 -- 172.21.15.53:0/198578993 learned_addr learned my addr 172.21.15.53:0/198578993 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.138+0000 7f82bdbb7640 1 --2- 172.21.15.53:0/198578993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c41390 0x55c5da01ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.139+0000 7f82bd3b6640 1 -- 172.21.15.53:0/198578993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c41390 msgr2=0x55c5da01ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.139+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/198578993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c41390 0x55c5da01ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.139+0000 7f82bd3b6640 1 -- 172.21.15.53:0/198578993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c391b0 msgr2=0x55c5da00aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:24.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.139+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/198578993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c391b0 0x55c5da00aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.139+0000 7f82bd3b6640 1 -- 172.21.15.53:0/198578993 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5da0095b0 con 0x55c5d9c209f0 2024-08-31T06:14:24.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.139+0000 7f82bcbb5640 1 --2- 172.21.15.53:0/198578993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c391b0 0x55c5da00aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:24.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.139+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/198578993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c209f0 0x55c5da013050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f82b4000c00 tx=0x7f82b4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=736149e6a2f20eb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:24.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.139+0000 7f82a2ffd640 1 -- 172.21.15.53:0/198578993 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4032070 con 0x55c5d9c209f0 2024-08-31T06:14:24.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.139+0000 7f82a2ffd640 1 -- 172.21.15.53:0/198578993 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82b4009910 con 0x55c5d9c209f0 2024-08-31T06:14:24.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.139+0000 7f82a2ffd640 1 -- 172.21.15.53:0/198578993 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4003c00 con 0x55c5d9c209f0 2024-08-31T06:14:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.140+0000 7f82c5b8f740 1 -- 172.21.15.53:0/198578993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c209f0 msgr2=0x55c5da013050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.140+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/198578993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c209f0 0x55c5da013050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f82b4000c00 tx=0x7f82b4011810 comp rx=0 tx=0).stop 2024-08-31T06:14:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.140+0000 7f82c5b8f740 1 -- 172.21.15.53:0/198578993 shutdown_connections 2024-08-31T06:14:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.140+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/198578993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c41390 0x55c5da01ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.140+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/198578993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c391b0 0x55c5da00aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.140+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/198578993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c209f0 0x55c5da013050 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.140+0000 7f82c5b8f740 1 -- 172.21.15.53:0/198578993 >> 172.21.15.53:0/198578993 conn(0x55c5d9c56460 msgr2=0x55c5da00a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.140+0000 7f82c5b8f740 1 -- 172.21.15.53:0/198578993 shutdown_connections 2024-08-31T06:14:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.140+0000 7f82c5b8f740 1 -- 172.21.15.53:0/198578993 wait complete. 2024-08-31T06:14:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.141+0000 7f82c5b8f740 1 -- start start 2024-08-31T06:14:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.141+0000 7f82c5b8f740 1 Processor -- start 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.141+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c209f0 0x55c5da01b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.141+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c391b0 0x55c5da0169b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.141+0000 7f82c5b8f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 0x55c5da016ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.141+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f82b81b2cb0 con 0x55c5d9c41390 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.141+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82b81b2580 con 0x55c5d9c391b0 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.141+0000 7f82c5b8f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82b81af720 con 0x55c5d9c209f0 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.141+0000 7f82c5b8f740 10 client.0 _ll_register_callbacks cb 0x7f82b002f750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bcbb5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c391b0 0x55c5da0169b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bcbb5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c391b0 0x55c5da0169b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60224/0 (socket says 172.21.15.53:60224) 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bdbb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 0x55c5da016ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bcbb5640 1 -- 172.21.15.53:0/2644250145 learned_addr learned my addr 172.21.15.53:0/2644250145 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c209f0 0x55c5da01b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bcbb5640 1 -- 172.21.15.53:0/2644250145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c209f0 msgr2=0x55c5da01b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bcbb5640 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c209f0 0x55c5da01b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bcbb5640 1 -- 172.21.15.53:0/2644250145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 msgr2=0x55c5da016ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bcbb5640 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 0x55c5da016ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bcbb5640 1 -- 172.21.15.53:0/2644250145 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5da017660 con 0x55c5d9c391b0 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bdbb7640 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 0x55c5da016ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82bcbb5640 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c391b0 0x55c5da0169b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005fd0 tx=0x7f82a80ab0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9778db7fa1441845 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2644250145 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a80afe10 con 0x55c5d9c391b0 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2644250145 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f82a80ce0b0 con 0x55c5d9c391b0 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.142+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2644250145 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82b4009910 con 0x55c5d9c391b0 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2644250145 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f82a80b48c0 con 0x55c5d9c391b0 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82c5b8f740 10 client.27713 fetch_fsmap learned FSMap version 45 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2644250145 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55c5da098040 con 0x55c5d9c391b0 2024-08-31T06:14:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2644250145 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82b4009910 con 0x55c5d9c391b0 2024-08-31T06:14:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2644250145 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 45) ==== 8410+0+0 (secure 0 0 0) 0x7f82a80a6f10 con 0x55c5d9c391b0 2024-08-31T06:14:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82c5b8f740 10 client.27713 fetch_fsmap finished waiting for FSMap version 45 2024-08-31T06:14:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82c5b8f740 10 client.27713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82c5b8f740 20 client.27713 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5d9c62070 0x55c5da09a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82c5b8f740 4 client.27713 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:14:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2644250145 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c5d9f7c020 con 0x55c5d9c62070 2024-08-31T06:14:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.143+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5d9c62070 0x55c5da09a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.144+0000 7f82a0ff9640 10 client.27713 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.144+0000 7f82bd3b6640 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5d9c62070 0x55c5da09a840 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdab9df24571e168 server_cookie=eb27bc544edf2fa0 in_seq=0 out_seq=0 2024-08-31T06:14:24.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82a0ff9640 1 -- 172.21.15.53:0/2644250145 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x55c5d9f7c020 con 0x55c5d9c62070 2024-08-31T06:14:24.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82a0ff9640 10 client.27713 handle_command_reply: tid=0 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82c5b8f740 1 client.27713 shutdown 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2644250145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c391b0 msgr2=0x55c5da0169b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c391b0 0x55c5da0169b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005fd0 tx=0x7f82a80ab0b0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2644250145 shutdown_connections 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5d9c62070 0x55c5da09a840 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5d9c41390 0x55c5da016ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5d9c391b0 0x55c5da0169b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82c5b8f740 1 --2- 172.21.15.53:0/2644250145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5d9c209f0 0x55c5da01b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82a0ff9640 0 client.27713 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2644250145 >> 172.21.15.53:0/2644250145 conn(0x55c5d9c56460 msgr2=0x55c5da0051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2644250145 shutdown_connections 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.145+0000 7f82c5b8f740 1 -- 172.21.15.53:0/2644250145 wait complete. 2024-08-31T06:14:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82c5b8f740 20 client.27713 trim_cache size 0 max 16384 2024-08-31T06:14:24.152 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:14:24.152 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:14:24.152 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:14:24.152 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:14:24.152 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:14:24.152 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:14:24.152 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.152 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.152 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.152 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:14:24.153 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:24.154 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:14:24.157 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:24.158 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 -- 172.21.15.53:0/1741983054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82a40b4ca0 msgr2=0x7f82a40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82a40b4ca0 0x7f82a40b71b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f82b0006010 tx=0x7f82b0003ca0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 -- 172.21.15.53:0/1741983054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b8102d20 msgr2=0x7f82b819c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b8102d20 0x7f82b819c840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f82a800d950 tx=0x7f82a800de10 comp rx=0 tx=0).stop 2024-08-31T06:14:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 -- 172.21.15.53:0/1741983054 shutdown_connections 2024-08-31T06:14:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82a40b4ca0 0x7f82a40b71b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82b810ff80 0x7f82b81a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b8102d20 0x7f82b819c840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 --2- 172.21.15.53:0/1741983054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82b81023d0 0x7f82b819c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 -- 172.21.15.53:0/1741983054 >> 172.21.15.53:0/1741983054 conn(0x7f82b80794d0 msgr2=0x7f82b81089f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 -- 172.21.15.53:0/1741983054 shutdown_connections 2024-08-31T06:14:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:24.146+0000 7f82bf61a640 1 -- 172.21.15.53:0/1741983054 wait complete. 2024-08-31T06:14:24.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 161158 1.57 MB/sec execute 374 sec latency 21.377 ms 2024-08-31T06:14:25.093 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:14:25.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:14:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.092+0000 7f9abdb2b640 1 -- 172.21.15.53:0/3261725358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ab8102f10 msgr2=0x7f9ab8103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.092+0000 7f9abdb2b640 1 --2- 172.21.15.53:0/3261725358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ab8102f10 0x7f9ab8103320 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009900 tx=0x7f9aa802a410 comp rx=0 tx=0).stop 2024-08-31T06:14:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.092+0000 7f9abdb2b640 1 -- 172.21.15.53:0/3261725358 shutdown_connections 2024-08-31T06:14:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.092+0000 7f9abdb2b640 1 --2- 172.21.15.53:0/3261725358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab8108a20 0x7f9ab810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.092+0000 7f9abdb2b640 1 --2- 172.21.15.53:0/3261725358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab81080d0 0x7f9ab81084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.092+0000 7f9abdb2b640 1 --2- 172.21.15.53:0/3261725358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ab8102f10 0x7f9ab8103320 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.092+0000 7f9abdb2b640 1 -- 172.21.15.53:0/3261725358 >> 172.21.15.53:0/3261725358 conn(0x7f9ab8079c30 msgr2=0x7f9ab807a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.092+0000 7f9abdb2b640 1 -- 172.21.15.53:0/3261725358 shutdown_connections 2024-08-31T06:14:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.092+0000 7f9abdb2b640 1 -- 172.21.15.53:0/3261725358 wait complete. 2024-08-31T06:14:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.092+0000 7f9abdb2b640 1 Processor -- start 2024-08-31T06:14:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9abdb2b640 1 -- start start 2024-08-31T06:14:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9abdb2b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab8102f10 0x7f9ab819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9abdb2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ab81080d0 0x7f9ab819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9abdb2b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab8108a20 0x7f9ab819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9abdb2b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81136e0 con 0x7f9ab81080d0 2024-08-31T06:14:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9abdb2b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8113560 con 0x7f9ab8108a20 2024-08-31T06:14:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9abdb2b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8113860 con 0x7f9ab8102f10 2024-08-31T06:14:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9ab7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab8108a20 0x7f9ab819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9ab7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab8108a20 0x7f9ab819f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60228/0 (socket says 172.21.15.53:60228) 2024-08-31T06:14:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9ab7fff640 1 -- 172.21.15.53:0/4104815147 learned_addr learned my addr 172.21.15.53:0/4104815147 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ab81080d0 0x7f9ab819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.093+0000 7f9ab77fe640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab8102f10 0x7f9ab819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9ab7fff640 1 -- 172.21.15.53:0/4104815147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab8102f10 msgr2=0x7f9ab819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9ab7fff640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab8102f10 0x7f9ab819a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9ab7fff640 1 -- 172.21.15.53:0/4104815147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ab81080d0 msgr2=0x7f9ab819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9ab7fff640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ab81080d0 0x7f9ab819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9ab7fff640 1 -- 172.21.15.53:0/4104815147 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab81a00d0 con 0x7f9ab8108a20 2024-08-31T06:14:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ab81080d0 0x7f9ab819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9ab7fff640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab8108a20 0x7f9ab819f9d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000eb10 tx=0x7f9ab000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9ab4ff9640 1 -- 172.21.15.53:0/4104815147 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0004b20 con 0x7f9ab8108a20 2024-08-31T06:14:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9ab4ff9640 1 -- 172.21.15.53:0/4104815147 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ab0004cc0 con 0x7f9ab8108a20 2024-08-31T06:14:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9abdb2b640 1 -- 172.21.15.53:0/4104815147 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab81a03c0 con 0x7f9ab8108a20 2024-08-31T06:14:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9ab4ff9640 1 -- 172.21.15.53:0/4104815147 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0010690 con 0x7f9ab8108a20 2024-08-31T06:14:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.094+0000 7f9abdb2b640 1 -- 172.21.15.53:0/4104815147 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab81a6b50 con 0x7f9ab8108a20 2024-08-31T06:14:25.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.097+0000 7f9ac4a98740 1 Processor -- start 2024-08-31T06:14:25.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.097+0000 7f9ab4ff9640 1 -- 172.21.15.53:0/4104815147 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9ab0005020 con 0x7f9ab8108a20 2024-08-31T06:14:25.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.097+0000 7f9ac4a98740 1 -- start start 2024-08-31T06:14:25.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da9773ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93a72f0 0x558da9774220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9774760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ac4a98740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558da96e9000 con 0x558da93a72f0 2024-08-31T06:14:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ac4a98740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558da96d8590 con 0x558da93d01b0 2024-08-31T06:14:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ac4a98740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558da96dc540 con 0x558da93af4d0 2024-08-31T06:14:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ab77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93a72f0 0x558da9774220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ab6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9774760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ab77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93a72f0 0x558da9774220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56308/0 (socket says 172.21.15.53:56308) 2024-08-31T06:14:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ab77fe640 1 -- 172.21.15.53:0/3325037498 learned_addr learned my addr 172.21.15.53:0/3325037498 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/3325037498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da9773ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ab6ffd640 1 -- 172.21.15.53:0/3325037498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 msgr2=0x558da9773ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:25.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/3325037498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da9773ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ab6ffd640 1 -- 172.21.15.53:0/3325037498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93a72f0 msgr2=0x558da9774220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/3325037498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93a72f0 0x558da9774220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ab6ffd640 1 -- 172.21.15.53:0/3325037498 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558da943b790 con 0x558da93af4d0 2024-08-31T06:14:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.098+0000 7f9ab4ff9640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9aa00b4ca0 0x7f9aa00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.099+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/3325037498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9774760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8075440 tx=0x7f9aac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=600f608422d71cef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.099+0000 7f9ab4ff9640 1 -- 172.21.15.53:0/4104815147 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f9ab00e5b40 con 0x7f9ab8108a20 2024-08-31T06:14:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.099+0000 7f9ab77fe640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9aa00b4ca0 0x7f9aa00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.099+0000 7f9a9dffb640 1 -- 172.21.15.53:0/3325037498 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac011050 con 0x558da93af4d0 2024-08-31T06:14:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.099+0000 7f9a9dffb640 1 -- 172.21.15.53:0/3325037498 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aac0044c0 con 0x558da93af4d0 2024-08-31T06:14:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.099+0000 7f9a9dffb640 1 -- 172.21.15.53:0/3325037498 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac005020 con 0x558da93af4d0 2024-08-31T06:14:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.100+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3325037498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 msgr2=0x558da9774760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.100+0000 7f9ab77fe640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9aa00b4ca0 0x7f9aa00b71b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80096c0 tx=0x7f9aa8000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.100+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/3325037498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9774760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8075440 tx=0x7f9aac0046c0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.100+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3325037498 shutdown_connections 2024-08-31T06:14:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.100+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/3325037498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9774760 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.100+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/3325037498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93a72f0 0x558da9774220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.100+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/3325037498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da9773ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.100+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3325037498 >> 172.21.15.53:0/3325037498 conn(0x558da93c4300 msgr2=0x558da9771bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.100+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3325037498 shutdown_connections 2024-08-31T06:14:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.100+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3325037498 wait complete. 2024-08-31T06:14:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.101+0000 7f9ac4a98740 1 -- start start 2024-08-31T06:14:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.101+0000 7f9ac4a98740 1 Processor -- start 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93a72f0 0x558da9783d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9784360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da978fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ac4a98740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558da9611ab0 con 0x558da93a72f0 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ac4a98740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558da965f680 con 0x558da93d01b0 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ac4a98740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558da9786840 con 0x558da93af4d0 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ac4a98740 10 client.0 _ll_register_callbacks cb 0x558da93e7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ab6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9784360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ab7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da978fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ab77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93a72f0 0x558da9783d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ab6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9784360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48316/0 (socket says 172.21.15.53:48316) 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ab6ffd640 1 -- 172.21.15.53:0/1546276681 learned_addr learned my addr 172.21.15.53:0/1546276681 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ab6ffd640 1 -- 172.21.15.53:0/1546276681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 msgr2=0x558da978fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:25.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/1546276681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da978fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ab6ffd640 1 -- 172.21.15.53:0/1546276681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93a72f0 msgr2=0x558da9783d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/1546276681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93a72f0 0x558da9783d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.102+0000 7f9ab6ffd640 1 -- 172.21.15.53:0/1546276681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558da94b4620 con 0x558da93af4d0 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/1546276681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9784360 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00fc90 tx=0x7f9aac009fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2657412fbbd1144 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1546276681 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac005030 con 0x558da93af4d0 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1546276681 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f9aac0051d0 con 0x558da93af4d0 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1546276681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558da96eaf50 con 0x558da93af4d0 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1546276681 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f9aac0053d0 con 0x558da93af4d0 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9ac4a98740 10 client.27724 fetch_fsmap learned FSMap version 45 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1546276681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x558da977b910 con 0x558da93af4d0 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1546276681 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558da96eaf50 con 0x558da93af4d0 2024-08-31T06:14:25.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1546276681 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 45) ==== 8410+0+0 (secure 0 0 0) 0x7f9aac01d020 con 0x558da93af4d0 2024-08-31T06:14:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9ac4a98740 10 client.27724 fetch_fsmap finished waiting for FSMap version 45 2024-08-31T06:14:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9ac4a98740 10 client.27724 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9ac4a98740 20 client.27724 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1546276681 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558da938ed80 0x558da977cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9ac4a98740 4 client.27724 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.103+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1546276681 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558da96e69f0 con 0x558da938ed80 2024-08-31T06:14:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.104+0000 7f9ab77fe640 1 --2- 172.21.15.53:0/1546276681 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558da938ed80 0x558da977cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.104+0000 7f9a96ffd640 10 client.27724 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:25.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.104+0000 7f9ab77fe640 1 --2- 172.21.15.53:0/1546276681 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558da938ed80 0x558da977cd80 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3357219aed62bfc4 server_cookie=2ce4877beb644f31 in_seq=0 out_seq=0 2024-08-31T06:14:25.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1546276681 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558da96e69f0 con 0x558da938ed80 2024-08-31T06:14:25.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9a96ffd640 10 client.27724 handle_command_reply: tid=0 2024-08-31T06:14:25.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9ac4a98740 1 client.27724 shutdown 2024-08-31T06:14:25.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1546276681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 msgr2=0x558da9784360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1546276681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9784360 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00fc90 tx=0x7f9aac009fa0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1546276681 shutdown_connections 2024-08-31T06:14:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1546276681 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558da938ed80 0x558da977cd80 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1546276681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da978fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1546276681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9784360 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1546276681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93a72f0 0x558da9783d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9a96ffd640 0 client.27724 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.105+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1546276681 >> 172.21.15.53:0/1546276681 conn(0x558da93c4300 msgr2=0x558da9770170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.106+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1546276681 shutdown_connections 2024-08-31T06:14:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.106+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1546276681 wait complete. 2024-08-31T06:14:25.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.106+0000 7f9ac4a98740 20 client.27724 trim_cache size 0 max 16384 2024-08-31T06:14:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.125+0000 7f9ac4a98740 1 Processor -- start 2024-08-31T06:14:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.125+0000 7f9ac4a98740 1 -- start start 2024-08-31T06:14:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.125+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93a72f0 0x558da977e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.125+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9771c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.125+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93d01b0 0x558da9770170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.125+0000 7f9ac4a98740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81ad2c0 con 0x558da93d01b0 2024-08-31T06:14:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ab77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93a72f0 0x558da977e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ab7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93d01b0 0x558da9770170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ab77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93a72f0 0x558da977e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60266/0 (socket says 172.21.15.53:60266) 2024-08-31T06:14:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ab77fe640 1 -- 172.21.15.53:0/3039960210 learned_addr learned my addr 172.21.15.53:0/3039960210 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3039960210 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81aefe0 con 0x558da93a72f0 2024-08-31T06:14:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3039960210 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81ad990 con 0x558da93af4d0 2024-08-31T06:14:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/3039960210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9771c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ab77fe640 1 -- 172.21.15.53:0/3039960210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 msgr2=0x558da9771c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ab77fe640 1 --2- 172.21.15.53:0/3039960210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9771c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ab77fe640 1 -- 172.21.15.53:0/3039960210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93d01b0 msgr2=0x558da9770170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ab77fe640 1 --2- 172.21.15.53:0/3039960210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93d01b0 0x558da9770170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ab77fe640 1 -- 172.21.15.53:0/3039960210 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558da976b980 con 0x558da93a72f0 2024-08-31T06:14:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.126+0000 7f9ab77fe640 1 --2- 172.21.15.53:0/3039960210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93a72f0 0x558da977e3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9aa802a930 tx=0x7f9aa803f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7396e90d22e2c391 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.127+0000 7f9a9d7fa640 1 -- 172.21.15.53:0/3039960210 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8035040 con 0x558da93a72f0 2024-08-31T06:14:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.127+0000 7f9a9d7fa640 1 -- 172.21.15.53:0/3039960210 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aa8003df0 con 0x558da93a72f0 2024-08-31T06:14:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.127+0000 7f9a9d7fa640 1 -- 172.21.15.53:0/3039960210 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa803d6b0 con 0x558da93a72f0 2024-08-31T06:14:25.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.128+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3039960210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93a72f0 msgr2=0x558da977e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.128+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/3039960210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93a72f0 0x558da977e3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9aa802a930 tx=0x7f9aa803f000 comp rx=0 tx=0).stop 2024-08-31T06:14:25.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.128+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3039960210 shutdown_connections 2024-08-31T06:14:25.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.128+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/3039960210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93d01b0 0x558da9770170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.128+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/3039960210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93af4d0 0x558da9771c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.128+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/3039960210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93a72f0 0x558da977e3c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.128+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3039960210 >> 172.21.15.53:0/3039960210 conn(0x558da93c4300 msgr2=0x558da97714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:25.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.128+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3039960210 shutdown_connections 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.128+0000 7f9ac4a98740 1 -- 172.21.15.53:0/3039960210 wait complete. 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.128+0000 7f9ac4a98740 1 -- start start 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ac4a98740 1 Processor -- start 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93a72f0 0x558da97a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93af4d0 0x558da979d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ac4a98740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da979d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ac4a98740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81ae850 con 0x558da93af4d0 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ac4a98740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81ae120 con 0x558da93d01b0 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ac4a98740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81ab2c0 con 0x558da93a72f0 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ac4a98740 10 client.0 _ll_register_callbacks cb 0x7f9aac005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ab6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93af4d0 0x558da979d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ab6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93af4d0 0x558da979d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56338/0 (socket says 172.21.15.53:56338) 2024-08-31T06:14:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ab77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93a72f0 0x558da97a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ab6ffd640 1 -- 172.21.15.53:0/1343191602 learned_addr learned my addr 172.21.15.53:0/1343191602 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.129+0000 7f9ab7fff640 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da979d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9ab6ffd640 1 -- 172.21.15.53:0/1343191602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93a72f0 msgr2=0x558da97a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93a72f0 0x558da97a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9ab6ffd640 1 -- 172.21.15.53:0/1343191602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 msgr2=0x558da979d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da979d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9ab6ffd640 1 -- 172.21.15.53:0/1343191602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558da9774ad0 con 0x558da93af4d0 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9ab77fe640 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93a72f0 0x558da97a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9ab7fff640 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da979d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9ab6ffd640 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93af4d0 0x558da979d330 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0058c0 tx=0x7f9aac01f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c81204b90e2acd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1343191602 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac034070 con 0x558da93af4d0 2024-08-31T06:14:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1343191602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9aa8003df0 con 0x558da93af4d0 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1343191602 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f9aac011240 con 0x558da93af4d0 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1343191602 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f9aac040050 con 0x558da93af4d0 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9ac4a98740 10 client.18504 fetch_fsmap learned FSMap version 45 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.130+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1343191602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x558da97760f0 con 0x558da93af4d0 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.131+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1343191602 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aa8003df0 con 0x558da93af4d0 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.131+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1343191602 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 45) ==== 8410+0+0 (secure 0 0 0) 0x7f9aac01d040 con 0x558da93af4d0 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.131+0000 7f9ac4a98740 10 client.18504 fetch_fsmap finished waiting for FSMap version 45 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.131+0000 7f9ac4a98740 10 client.18504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.131+0000 7f9ac4a98740 20 client.18504 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.131+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558da93641c0 0x558da9806be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.131+0000 7f9ac4a98740 4 client.18504 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:14:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.131+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1343191602 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558da96e4130 con 0x558da93641c0 2024-08-31T06:14:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.132+0000 7f9ab77fe640 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558da93641c0 0x558da9806be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.132+0000 7f9a96ffd640 10 client.18504 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.132+0000 7f9ab77fe640 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558da93641c0 0x558da9806be0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12097abb908bc0da server_cookie=b505a5e63789af01 in_seq=0 out_seq=0 2024-08-31T06:14:25.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9a96ffd640 1 -- 172.21.15.53:0/1343191602 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558da96e4130 con 0x558da93641c0 2024-08-31T06:14:25.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9a96ffd640 10 client.18504 handle_command_reply: tid=0 2024-08-31T06:14:25.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9ac4a98740 1 client.18504 shutdown 2024-08-31T06:14:25.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1343191602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93af4d0 msgr2=0x558da979d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93af4d0 0x558da979d330 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0058c0 tx=0x7f9aac01f870 comp rx=0 tx=0).stop 2024-08-31T06:14:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1343191602 shutdown_connections 2024-08-31T06:14:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558da93641c0 0x558da9806be0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558da93d01b0 0x558da979d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9a96ffd640 0 client.18504 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558da93af4d0 0x558da979d330 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9ac4a98740 1 --2- 172.21.15.53:0/1343191602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558da93a72f0 0x558da97a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1343191602 >> 172.21.15.53:0/1343191602 conn(0x558da93c4300 msgr2=0x558da9770170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.156+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1343191602 shutdown_connections 2024-08-31T06:14:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9ac4a98740 1 -- 172.21.15.53:0/1343191602 wait complete. 2024-08-31T06:14:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9ac4a98740 20 client.18504 trim_cache size 0 max 16384 2024-08-31T06:14:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:14:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:14:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:14:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:14:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9abdb2b640 1 -- 172.21.15.53:0/4104815147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9aa00b4ca0 msgr2=0x7f9aa00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9abdb2b640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9aa00b4ca0 0x7f9aa00b71b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80096c0 tx=0x7f9aa8000bc0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9abdb2b640 1 -- 172.21.15.53:0/4104815147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab8108a20 msgr2=0x7f9ab819f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9abdb2b640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab8108a20 0x7f9ab819f9d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000eb10 tx=0x7f9ab000c2d0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9abdb2b640 1 -- 172.21.15.53:0/4104815147 shutdown_connections 2024-08-31T06:14:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9abdb2b640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9aa00b4ca0 0x7f9aa00b71b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9abdb2b640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab8108a20 0x7f9ab819f9d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9abdb2b640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ab81080d0 0x7f9ab819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9abdb2b640 1 --2- 172.21.15.53:0/4104815147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ab8102f10 0x7f9ab819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.157+0000 7f9abdb2b640 1 -- 172.21.15.53:0/4104815147 >> 172.21.15.53:0/4104815147 conn(0x7f9ab8079c30 msgr2=0x7f9ab8106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.158+0000 7f9abdb2b640 1 -- 172.21.15.53:0/4104815147 shutdown_connections 2024-08-31T06:14:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:25.158+0000 7f9abdb2b640 1 -- 172.21.15.53:0/4104815147 wait complete. 2024-08-31T06:14:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:25.838 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:25 smithi053 ceph-mon[18924]: pgmap v615: 97 pgs: 97 active+clean; 94 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 420 KiB/s wr, 55 op/s 2024-08-31T06:14:25.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:25 smithi130 ceph-mon[22266]: pgmap v615: 97 pgs: 97 active+clean; 94 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 420 KiB/s wr, 55 op/s 2024-08-31T06:14:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:25 smithi153 ceph-mon[22320]: pgmap v615: 97 pgs: 97 active+clean; 94 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 420 KiB/s wr, 55 op/s 2024-08-31T06:14:25.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.936+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3316977178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bb0109240 msgr2=0x7f6bb0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.936+0000 7f6bb5cec640 1 --2- 172.21.15.53:0/3316977178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bb0109240 0x7f6bb0109650 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009900 tx=0x7f6ba402a410 comp rx=0 tx=0).stop 2024-08-31T06:14:25.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.936+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3316977178 shutdown_connections 2024-08-31T06:14:25.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.936+0000 7f6bb5cec640 1 --2- 172.21.15.53:0/3316977178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb0109b90 0x7f6bb01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.936+0000 7f6bb5cec640 1 --2- 172.21.15.53:0/3316977178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bb0109240 0x7f6bb0109650 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.936+0000 7f6bb5cec640 1 --2- 172.21.15.53:0/3316977178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0103900 0x7f6bb0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.936+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3316977178 >> 172.21.15.53:0/3316977178 conn(0x7f6bb007b5f0 msgr2=0x7f6bb007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.936+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3316977178 shutdown_connections 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.936+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3316977178 wait complete. 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.937+0000 7f6bb5cec640 1 Processor -- start 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.937+0000 7f6bb5cec640 1 -- start start 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.937+0000 7f6bb5cec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bb0103900 0x7f6bb00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.937+0000 7f6bb5cec640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb0109240 0x7f6bb00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.937+0000 7f6bb5cec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0109b90 0x7f6bb0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.937+0000 7f6bb5cec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0113700 con 0x7f6bb0103900 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.937+0000 7f6bb5cec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0113580 con 0x7f6bb0109b90 2024-08-31T06:14:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.937+0000 7f6bb5cec640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0113880 con 0x7f6bb0109240 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bb0103900 0x7f6bb00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb0109240 0x7f6bb00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bb0103900 0x7f6bb00754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56356/0 (socket says 172.21.15.53:56356) 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baf7fe640 1 -- 172.21.15.53:0/3737070076 learned_addr learned my addr 172.21.15.53:0/3737070076 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baffff640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0109b90 0x7f6bb0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baf7fe640 1 -- 172.21.15.53:0/3737070076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb0109240 msgr2=0x7f6bb00759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baf7fe640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb0109240 0x7f6bb00759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baf7fe640 1 -- 172.21.15.53:0/3737070076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0109b90 msgr2=0x7f6bb0075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baf7fe640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0109b90 0x7f6bb0075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baf7fe640 1 -- 172.21.15.53:0/3737070076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb01a8470 con 0x7f6bb0103900 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baeffd640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb0109240 0x7f6bb00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baffff640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0109b90 0x7f6bb0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6baf7fe640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bb0103900 0x7f6bb00754b0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000e9f0 tx=0x7f6ba000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6bacff9640 1 -- 172.21.15.53:0/3737070076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000cd80 con 0x7f6bb0103900 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3737070076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb01a8760 con 0x7f6bb0103900 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.938+0000 7f6bacff9640 1 -- 172.21.15.53:0/3737070076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ba00108c0 con 0x7f6bb0103900 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.939+0000 7f6bacff9640 1 -- 172.21.15.53:0/3737070076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00187c0 con 0x7f6bb0103900 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.939+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3737070076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb01a8cc0 con 0x7f6bb0103900 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.940+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3737070076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb0103d10 con 0x7f6bb0103900 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.941+0000 7f6bacff9640 1 -- 172.21.15.53:0/3737070076 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6ba0010430 con 0x7f6bb0103900 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.942+0000 7f6bacff9640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b980b4d20 0x7f6b980b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.942+0000 7f6baeffd640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b980b4d20 0x7f6b980b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.942+0000 7f6bacff9640 1 -- 172.21.15.53:0/3737070076 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f6ba00e5d90 con 0x7f6bb0103900 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.942+0000 7f6baeffd640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b980b4d20 0x7f6b980b7230 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4005940 tx=0x7f6ba40058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:25.945+0000 7f6bacff9640 1 -- 172.21.15.53:0/3737070076 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6ba00ac4b0 con 0x7f6bb0103900 2024-08-31T06:14:25.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 161642 1.56 MB/sec execute 375 sec latency 24.192 ms 2024-08-31T06:14:26.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.207+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3737070076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bb00767b0 con 0x7f6bb0103900 2024-08-31T06:14:26.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.207+0000 7f6bacff9640 1 -- 172.21.15.53:0/3737070076 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+12005 (secure 0 0 0) 0x7f6ba00b0c70 con 0x7f6bb0103900 2024-08-31T06:14:26.210 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:14:26.210 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":45,"btime":"2024-08-31T06:14:14:680677+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:14:13.797913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:14:26.210 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 45 2024-08-31T06:14:26.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3737070076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b980b4d20 msgr2=0x7f6b980b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:26.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b980b4d20 0x7f6b980b7230 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4005940 tx=0x7f6ba40058d0 comp rx=0 tx=0).stop 2024-08-31T06:14:26.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3737070076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bb0103900 msgr2=0x7f6bb00754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:26.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bb0103900 0x7f6bb00754b0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000e9f0 tx=0x7f6ba000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:14:26.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3737070076 shutdown_connections 2024-08-31T06:14:26.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b980b4d20 0x7f6b980b7230 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:26.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0109b90 0x7f6bb0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:26.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb0109240 0x7f6bb00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:26.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 --2- 172.21.15.53:0/3737070076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bb0103900 0x7f6bb00754b0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:26.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3737070076 >> 172.21.15.53:0/3737070076 conn(0x7f6bb007b5f0 msgr2=0x7f6bb0107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:26.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3737070076 shutdown_connections 2024-08-31T06:14:26.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:26.211+0000 7f6bb5cec640 1 -- 172.21.15.53:0/3737070076 wait complete. 2024-08-31T06:14:26.550 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 15.5 2024-08-31T06:14:26.551 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:14:26.842 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:26 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3737070076' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:14:26.872 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:14:26.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:26 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3737070076' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:14:26.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:26 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3737070076' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:14:26.941 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:26.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 162115 1.57 MB/sec execute 376 sec latency 21.650 ms 2024-08-31T06:14:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.477+0000 7f95e4c16640 1 -- 172.21.15.53:0/3275914727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95e0108140 msgr2=0x7f95e0108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.477+0000 7f95e4c16640 1 --2- 172.21.15.53:0/3275914727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95e0108140 0x7f95e0108550 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009900 tx=0x7f95d402a410 comp rx=0 tx=0).stop 2024-08-31T06:14:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.477+0000 7f95e4c16640 1 -- 172.21.15.53:0/3275914727 shutdown_connections 2024-08-31T06:14:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.477+0000 7f95e4c16640 1 --2- 172.21.15.53:0/3275914727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95e0108a90 0x7f95e010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.477+0000 7f95e4c16640 1 --2- 172.21.15.53:0/3275914727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95e0108140 0x7f95e0108550 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.477+0000 7f95e4c16640 1 --2- 172.21.15.53:0/3275914727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95e0102800 0x7f95e0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.477+0000 7f95e4c16640 1 -- 172.21.15.53:0/3275914727 >> 172.21.15.53:0/3275914727 conn(0x7f95e00794d0 msgr2=0x7f95e00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.477+0000 7f95e4c16640 1 -- 172.21.15.53:0/3275914727 shutdown_connections 2024-08-31T06:14:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.477+0000 7f95e4c16640 1 -- 172.21.15.53:0/3275914727 wait complete. 2024-08-31T06:14:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.478+0000 7f95e4c16640 1 Processor -- start 2024-08-31T06:14:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.478+0000 7f95e4c16640 1 -- start start 2024-08-31T06:14:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95e4c16640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95e0102800 0x7f95e0199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95e4c16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95e0108140 0x7f95e0199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95e4c16640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95e0108a90 0x7f95e019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95e4c16640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f95e0112570 con 0x7f95e0108140 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95e4c16640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f95e01123f0 con 0x7f95e0102800 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95e4c16640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95e01126f0 con 0x7f95e0108a90 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95ddd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95e0108140 0x7f95e0199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95ddd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95e0108140 0x7f95e0199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56366/0 (socket says 172.21.15.53:56366) 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95de59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95e0102800 0x7f95e0199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95ddd9b640 1 -- 172.21.15.53:0/3770697888 learned_addr learned my addr 172.21.15.53:0/3770697888 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95ded9d640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95e0108a90 0x7f95e019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95de59c640 1 -- 172.21.15.53:0/3770697888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95e0108a90 msgr2=0x7f95e019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95de59c640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95e0108a90 0x7f95e019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95de59c640 1 -- 172.21.15.53:0/3770697888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95e0108140 msgr2=0x7f95e0199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95de59c640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95e0108140 0x7f95e0199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95de59c640 1 -- 172.21.15.53:0/3770697888 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e019eff0 con 0x7f95e0102800 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.479+0000 7f95de59c640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95e0102800 0x7f95e0199080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95d0005fd0 tx=0x7f95d000dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.480+0000 7f95cf7fe640 1 -- 172.21.15.53:0/3770697888 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0009c30 con 0x7f95e0102800 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.480+0000 7f95e4c16640 1 -- 172.21.15.53:0/3770697888 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e019f2e0 con 0x7f95e0102800 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.480+0000 7f95cf7fe640 1 -- 172.21.15.53:0/3770697888 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95d00044c0 con 0x7f95e0102800 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.480+0000 7f95e4c16640 1 -- 172.21.15.53:0/3770697888 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e006ac00 con 0x7f95e0102800 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.480+0000 7f95cf7fe640 1 -- 172.21.15.53:0/3770697888 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0003db0 con 0x7f95e0102800 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.481+0000 7f95e4c16640 1 -- 172.21.15.53:0/3770697888 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e0102c10 con 0x7f95e0102800 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.482+0000 7f95cf7fe640 1 -- 172.21.15.53:0/3770697888 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f95d0004000 con 0x7f95e0102800 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.483+0000 7f95cf7fe640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95c80b4ca0 0x7f95c80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.483+0000 7f95ddd9b640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95c80b4ca0 0x7f95c80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.483+0000 7f95cf7fe640 1 -- 172.21.15.53:0/3770697888 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f95d00e5460 con 0x7f95e0102800 2024-08-31T06:14:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.484+0000 7f95ddd9b640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95c80b4ca0 0x7f95c80b71b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f95e01079c0 tx=0x7f95d40058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:27.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.487+0000 7f95cf7fe640 1 -- 172.21.15.53:0/3770697888 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f95d0017020 con 0x7f95e0102800 2024-08-31T06:14:27.533 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:27.659 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:27 smithi053 ceph-mon[18924]: pgmap v616: 97 pgs: 97 active+clean; 93 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 519 KiB/s wr, 56 op/s 2024-08-31T06:14:27.659 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:27 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:27.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.754+0000 7f95e4c16640 1 -- 172.21.15.53:0/3770697888 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95e019a1b0 con 0x7f95e0102800 2024-08-31T06:14:27.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.754+0000 7f95cf7fe640 1 -- 172.21.15.53:0/3770697888 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+12007 (secure 0 0 0) 0x7f95d00abb80 con 0x7f95e0102800 2024-08-31T06:14:27.757 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:14:27.757 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":46,"btime":"2024-08-31T06:14:26:592569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:14:26.369272+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:14:27.757 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 46 2024-08-31T06:14:27.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 -- 172.21.15.53:0/3770697888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95c80b4ca0 msgr2=0x7f95c80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:27.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95c80b4ca0 0x7f95c80b71b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f95e01079c0 tx=0x7f95d40058d0 comp rx=0 tx=0).stop 2024-08-31T06:14:27.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 -- 172.21.15.53:0/3770697888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95e0102800 msgr2=0x7f95e0199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:27.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95e0102800 0x7f95e0199080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95d0005fd0 tx=0x7f95d000dde0 comp rx=0 tx=0).stop 2024-08-31T06:14:27.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 -- 172.21.15.53:0/3770697888 shutdown_connections 2024-08-31T06:14:27.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95c80b4ca0 0x7f95c80b71b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:27.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95e0108a90 0x7f95e019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:27.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95e0108140 0x7f95e0199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:27.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 --2- 172.21.15.53:0/3770697888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95e0102800 0x7f95e0199080 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:27.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 -- 172.21.15.53:0/3770697888 >> 172.21.15.53:0/3770697888 conn(0x7f95e00794d0 msgr2=0x7f95e0105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:27.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 -- 172.21.15.53:0/3770697888 shutdown_connections 2024-08-31T06:14:27.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:27.757+0000 7f95e4c16640 1 -- 172.21.15.53:0/3770697888 wait complete. 2024-08-31T06:14:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:27 smithi130 ceph-mon[22266]: pgmap v616: 97 pgs: 97 active+clean; 93 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 519 KiB/s wr, 56 op/s 2024-08-31T06:14:27.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:27 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:27 smithi153 ceph-mon[22320]: pgmap v616: 97 pgs: 97 active+clean; 93 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 519 KiB/s wr, 56 op/s 2024-08-31T06:14:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:27 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:14:27.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 162815 1.58 MB/sec execute 377 sec latency 37.289 ms 2024-08-31T06:14:28.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.237+0000 7fbef9f45640 1 -- 172.21.15.53:0/4127257207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbef4108140 msgr2=0x7fbef4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.237+0000 7fbef9f45640 1 --2- 172.21.15.53:0/4127257207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbef4108140 0x7fbef4108550 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009900 tx=0x7fbee802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.237+0000 7fbef9f45640 1 -- 172.21.15.53:0/4127257207 shutdown_connections 2024-08-31T06:14:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.237+0000 7fbef9f45640 1 --2- 172.21.15.53:0/4127257207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbef4108a90 0x7fbef410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.237+0000 7fbef9f45640 1 --2- 172.21.15.53:0/4127257207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbef4108140 0x7fbef4108550 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.237+0000 7fbef9f45640 1 --2- 172.21.15.53:0/4127257207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef4102800 0x7fbef4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.237+0000 7fbef9f45640 1 -- 172.21.15.53:0/4127257207 >> 172.21.15.53:0/4127257207 conn(0x7fbef40794d0 msgr2=0x7fbef40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.237+0000 7fbef9f45640 1 -- 172.21.15.53:0/4127257207 shutdown_connections 2024-08-31T06:14:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.237+0000 7fbef9f45640 1 -- 172.21.15.53:0/4127257207 wait complete. 2024-08-31T06:14:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.237+0000 7fbef9f45640 1 Processor -- start 2024-08-31T06:14:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef9f45640 1 -- start start 2024-08-31T06:14:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef9f45640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef4102800 0x7fbef4104e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef9f45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbef4108140 0x7fbef41053c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef9f45640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbef4108a90 0x7fbef4105900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef9f45640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbef4112570 con 0x7fbef4108140 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef9f45640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbef41123f0 con 0x7fbef4102800 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef9f45640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbef41126f0 con 0x7fbef4108a90 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbef4108140 0x7fbef41053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbef4108140 0x7fbef41053c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56386/0 (socket says 172.21.15.53:56386) 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef2ffd640 1 -- 172.21.15.53:0/880880575 learned_addr learned my addr 172.21.15.53:0/880880575 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef3fff640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbef4108a90 0x7fbef4105900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.238+0000 7fbef37fe640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef4102800 0x7fbef4104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.239+0000 7fbef2ffd640 1 -- 172.21.15.53:0/880880575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbef4108a90 msgr2=0x7fbef4105900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.239+0000 7fbef2ffd640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbef4108a90 0x7fbef4105900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.239+0000 7fbef2ffd640 1 -- 172.21.15.53:0/880880575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef4102800 msgr2=0x7fbef4104e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.239+0000 7fbef2ffd640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef4102800 0x7fbef4104e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.239+0000 7fbef2ffd640 1 -- 172.21.15.53:0/880880575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef41a83c0 con 0x7fbef4108140 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.239+0000 7fbef2ffd640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbef4108140 0x7fbef41053c0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fbee8005940 tx=0x7fbee8005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.239+0000 7fbef0ff9640 1 -- 172.21.15.53:0/880880575 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee803f030 con 0x7fbef4108140 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.239+0000 7fbef0ff9640 1 -- 172.21.15.53:0/880880575 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbee80043d0 con 0x7fbef4108140 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.239+0000 7fbef9f45640 1 -- 172.21.15.53:0/880880575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef41a8650 con 0x7fbef4108140 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.239+0000 7fbef0ff9640 1 -- 172.21.15.53:0/880880575 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8035070 con 0x7fbef4108140 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.239+0000 7fbef9f45640 1 -- 172.21.15.53:0/880880575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef41a8b80 con 0x7fbef4108140 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.242+0000 7fbf004ba740 1 Processor -- start 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.242+0000 7fbf004ba740 1 -- start start 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.242+0000 7fbef0ff9640 1 -- 172.21.15.53:0/880880575 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbee8042030 con 0x7fbef4108140 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d8059dd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059dd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059ddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbf004ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d805954680 con 0x55d80560f1b0 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbf004ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d805943c10 con 0x55d805617390 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbf004ba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d805947bc0 con 0x55d805638070 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059dd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059ddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059dd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56396/0 (socket says 172.21.15.53:56396) 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef37fe640 1 -- 172.21.15.53:0/1510400787 learned_addr learned my addr 172.21.15.53:0/1510400787 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef3fff640 1 --2- 172.21.15.53:0/1510400787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d8059dd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef37fe640 1 -- 172.21.15.53:0/1510400787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 msgr2=0x55d8059dd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef37fe640 1 --2- 172.21.15.53:0/1510400787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d8059dd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef37fe640 1 -- 172.21.15.53:0/1510400787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 msgr2=0x55d8059ddd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef37fe640 1 --2- 172.21.15.53:0/1510400787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059ddd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef37fe640 1 -- 172.21.15.53:0/1510400787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8056a3650 con 0x55d80560f1b0 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef3fff640 1 --2- 172.21.15.53:0/1510400787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d8059dd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef0ff9640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbedc0b4d20 0x7fbedc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef37fe640 1 --2- 172.21.15.53:0/1510400787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059dd850 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009c90 tx=0x7fbee4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6aff6f95a4eaba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.243+0000 7fbef3fff640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbedc0b4d20 0x7fbedc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.244+0000 7fbef0ff9640 1 -- 172.21.15.53:0/880880575 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7fbee81057e0 con 0x7fbef4108140 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.244+0000 7fbed9ffb640 1 -- 172.21.15.53:0/1510400787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4005220 con 0x55d80560f1b0 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.244+0000 7fbed9ffb640 1 -- 172.21.15.53:0/1510400787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbee4004c30 con 0x55d80560f1b0 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.244+0000 7fbed9ffb640 1 -- 172.21.15.53:0/1510400787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4019670 con 0x55d80560f1b0 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.245+0000 7fbf004ba740 1 -- 172.21.15.53:0/1510400787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 msgr2=0x55d8059dd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.245+0000 7fbf004ba740 1 --2- 172.21.15.53:0/1510400787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059dd850 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009c90 tx=0x7fbee4011810 comp rx=0 tx=0).stop 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.245+0000 7fbef3fff640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbedc0b4d20 0x7fbedc0b7230 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbeec005fd0 tx=0x7fbeec009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.245+0000 7fbf004ba740 1 -- 172.21.15.53:0/1510400787 shutdown_connections 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.245+0000 7fbf004ba740 1 --2- 172.21.15.53:0/1510400787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059ddd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.245+0000 7fbf004ba740 1 --2- 172.21.15.53:0/1510400787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059dd850 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.245+0000 7fbf004ba740 1 --2- 172.21.15.53:0/1510400787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d8059dd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.245+0000 7fbf004ba740 1 -- 172.21.15.53:0/1510400787 >> 172.21.15.53:0/1510400787 conn(0x55d80562c460 msgr2=0x55d8059db200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.245+0000 7fbf004ba740 1 -- 172.21.15.53:0/1510400787 shutdown_connections 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.245+0000 7fbf004ba740 1 -- 172.21.15.53:0/1510400787 wait complete. 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.245+0000 7fbf004ba740 1 -- start start 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbf004ba740 1 Processor -- start 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d80560f1b0 0x55d8059e8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805617390 0x55d8059e8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d805638070 0x55d8059f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbf004ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d8057a6700 con 0x55d805638070 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbf004ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d8058ca750 con 0x55d80560f1b0 2024-08-31T06:14:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbf004ba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d8059ebaf0 con 0x55d805617390 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbef3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d805638070 0x55d8059f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbf004ba740 10 client.0 _ll_register_callbacks cb 0x55d8058f9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbef37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d80560f1b0 0x55d8059e8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbef37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d80560f1b0 0x55d8059e8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60342/0 (socket says 172.21.15.53:60342) 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbef37fe640 1 -- 172.21.15.53:0/3456636422 learned_addr learned my addr 172.21.15.53:0/3456636422 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.246+0000 7fbef2ffd640 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805617390 0x55d8059e8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbef3fff640 1 -- 172.21.15.53:0/3456636422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805617390 msgr2=0x55d8059e8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbef3fff640 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805617390 0x55d8059e8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbef3fff640 1 -- 172.21.15.53:0/3456636422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d80560f1b0 msgr2=0x55d8059e8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbef3fff640 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d80560f1b0 0x55d8059e8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbef3fff640 1 -- 172.21.15.53:0/3456636422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d805903900 con 0x55d805638070 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbef37fe640 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d80560f1b0 0x55d8059e8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbef3fff640 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d805638070 0x55d8059f4de0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fbeec003f20 tx=0x7fbeec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f426c6cc6afe2b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbed2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbed2ffd640 1 -- 172.21.15.53:0/3456636422 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec004b20 con 0x55d805638070 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbed2ffd640 1 -- 172.21.15.53:0/3456636422 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7fbeec004cc0 con 0x55d805638070 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbf004ba740 1 -- 172.21.15.53:0/3456636422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbee4004c30 con 0x55d805638070 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbed2ffd640 1 -- 172.21.15.53:0/3456636422 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fbeec00f7b0 con 0x55d805638070 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbf004ba740 10 client.18528 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbf004ba740 1 -- 172.21.15.53:0/3456636422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55d8059f7900 con 0x55d805638070 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.247+0000 7fbed2ffd640 1 -- 172.21.15.53:0/3456636422 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbee4004c30 con 0x55d805638070 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.248+0000 7fbed2ffd640 1 -- 172.21.15.53:0/3456636422 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7fbeec027070 con 0x55d805638070 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.248+0000 7fbf004ba740 10 client.18528 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.248+0000 7fbf004ba740 10 client.18528 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.248+0000 7fbf004ba740 20 client.18528 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.248+0000 7fbf004ba740 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d8055f69f0 0x55d8059faf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.248+0000 7fbf004ba740 4 client.18528 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.248+0000 7fbf004ba740 1 -- 172.21.15.53:0/3456636422 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8059565d0 con 0x55d8055f69f0 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.248+0000 7fbef37fe640 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d8055f69f0 0x55d8059faf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.248+0000 7fbed2ffd640 10 client.18528 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.248+0000 7fbef37fe640 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d8055f69f0 0x55d8059faf20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1046c91ded60cf05 server_cookie=df99aadc44ddaf16 in_seq=0 out_seq=0 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.249+0000 7fbed2ffd640 1 -- 172.21.15.53:0/3456636422 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d8059565d0 con 0x55d8055f69f0 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.249+0000 7fbed2ffd640 10 client.18528 handle_command_reply: tid=0 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.249+0000 7fbf004ba740 1 client.18528 shutdown 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.249+0000 7fbf004ba740 1 -- 172.21.15.53:0/3456636422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d805638070 msgr2=0x55d8059f4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.249+0000 7fbf004ba740 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d805638070 0x55d8059f4de0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fbeec003f20 tx=0x7fbeec004ab0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.250+0000 7fbf004ba740 1 -- 172.21.15.53:0/3456636422 shutdown_connections 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.250+0000 7fbf004ba740 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d805638070 0x55d8059f4de0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.250+0000 7fbf004ba740 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d8055f69f0 0x55d8059faf20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.250+0000 7fbf004ba740 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805617390 0x55d8059e8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.250+0000 7fbf004ba740 1 --2- 172.21.15.53:0/3456636422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d80560f1b0 0x55d8059e8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.250+0000 7fbed2ffd640 0 client.18528 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:14:28.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.250+0000 7fbf004ba740 1 -- 172.21.15.53:0/3456636422 >> 172.21.15.53:0/3456636422 conn(0x55d80562c460 msgr2=0x55d8059e04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:28.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.250+0000 7fbf004ba740 1 -- 172.21.15.53:0/3456636422 shutdown_connections 2024-08-31T06:14:28.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.250+0000 7fbf004ba740 1 -- 172.21.15.53:0/3456636422 wait complete. 2024-08-31T06:14:28.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.250+0000 7fbf004ba740 20 client.18528 trim_cache size 0 max 16384 2024-08-31T06:14:28.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.266+0000 7fbf004ba740 1 Processor -- start 2024-08-31T06:14:28.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.266+0000 7fbf004ba740 1 -- start start 2024-08-31T06:14:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059e0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059e0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d8059e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbf004ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbef41b1690 con 0x55d80560f1b0 2024-08-31T06:14:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbf004ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbef41b33e0 con 0x55d805617390 2024-08-31T06:14:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbf004ba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbef41b1d60 con 0x55d805638070 2024-08-31T06:14:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059e0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059e0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56418/0 (socket says 172.21.15.53:56418) 2024-08-31T06:14:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef37fe640 1 -- 172.21.15.53:0/2720242633 learned_addr learned my addr 172.21.15.53:0/2720242633 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059e0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef3fff640 1 --2- 172.21.15.53:0/2720242633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d8059e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef2ffd640 1 -- 172.21.15.53:0/2720242633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 msgr2=0x55d8059e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef2ffd640 1 --2- 172.21.15.53:0/2720242633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d8059e5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef2ffd640 1 -- 172.21.15.53:0/2720242633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 msgr2=0x55d8059e0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef2ffd640 1 --2- 172.21.15.53:0/2720242633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059e0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef2ffd640 1 -- 172.21.15.53:0/2720242633 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8059df600 con 0x55d805617390 2024-08-31T06:14:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef3fff640 1 --2- 172.21.15.53:0/2720242633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d8059e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef37fe640 1 --2- 172.21.15.53:0/2720242633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059e0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.267+0000 7fbef2ffd640 1 --2- 172.21.15.53:0/2720242633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059e0950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbee8102f10 tx=0x7fbee80c7e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb37c034a57b7b8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.268+0000 7fbed97fa640 1 -- 172.21.15.53:0/2720242633 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8049040 con 0x55d805617390 2024-08-31T06:14:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.268+0000 7fbed97fa640 1 -- 172.21.15.53:0/2720242633 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbee80cba70 con 0x55d805617390 2024-08-31T06:14:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.268+0000 7fbed97fa640 1 -- 172.21.15.53:0/2720242633 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8003c10 con 0x55d805617390 2024-08-31T06:14:28.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.269+0000 7fbf004ba740 1 -- 172.21.15.53:0/2720242633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 msgr2=0x55d8059e0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:28.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.269+0000 7fbf004ba740 1 --2- 172.21.15.53:0/2720242633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059e0950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbee8102f10 tx=0x7fbee80c7e20 comp rx=0 tx=0).stop 2024-08-31T06:14:28.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.269+0000 7fbf004ba740 1 -- 172.21.15.53:0/2720242633 shutdown_connections 2024-08-31T06:14:28.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.269+0000 7fbf004ba740 1 --2- 172.21.15.53:0/2720242633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d8059e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.269+0000 7fbf004ba740 1 --2- 172.21.15.53:0/2720242633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059e0950 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.269+0000 7fbf004ba740 1 --2- 172.21.15.53:0/2720242633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059e0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.269+0000 7fbf004ba740 1 -- 172.21.15.53:0/2720242633 >> 172.21.15.53:0/2720242633 conn(0x55d80562c460 msgr2=0x55d8059e72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:28.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.269+0000 7fbf004ba740 1 -- 172.21.15.53:0/2720242633 shutdown_connections 2024-08-31T06:14:28.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.269+0000 7fbf004ba740 1 -- 172.21.15.53:0/2720242633 wait complete. 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.269+0000 7fbf004ba740 1 -- start start 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.269+0000 7fbf004ba740 1 Processor -- start 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059ed070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbf004ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d805a648e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbf004ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbef41b2c50 con 0x55d80560f1b0 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbf004ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbef41b24f0 con 0x55d805617390 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbf004ba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbef41af690 con 0x55d805638070 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbf004ba740 10 client.0 _ll_register_callbacks cb 0x7fbeec009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059ed070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059ed070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56434/0 (socket says 172.21.15.53:56434) 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef37fe640 1 -- 172.21.15.53:0/2310506857 learned_addr learned my addr 172.21.15.53:0/2310506857 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef2ffd640 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef3fff640 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d805a648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef2ffd640 1 -- 172.21.15.53:0/2310506857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 msgr2=0x55d805a648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef2ffd640 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d805a648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef2ffd640 1 -- 172.21.15.53:0/2310506857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 msgr2=0x55d8059ed070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef2ffd640 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059ed070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef2ffd640 1 -- 172.21.15.53:0/2310506857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8059edea0 con 0x55d805617390 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef3fff640 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d805a648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.270+0000 7fbef37fe640 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059ed070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.271+0000 7fbef2ffd640 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059ed5b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbee80cba20 tx=0x7fbee80c8420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41476f91ecbefe1d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.271+0000 7fbed2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.271+0000 7fbed2ffd640 1 -- 172.21.15.53:0/2310506857 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8049030 con 0x55d805617390 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.271+0000 7fbed2ffd640 1 -- 172.21.15.53:0/2310506857 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7fbee80b71b0 con 0x55d805617390 2024-08-31T06:14:28.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.271+0000 7fbf004ba740 1 -- 172.21.15.53:0/2310506857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbee80cba70 con 0x55d805617390 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.271+0000 7fbed2ffd640 1 -- 172.21.15.53:0/2310506857 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fbee80cb6d0 con 0x55d805617390 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.271+0000 7fbf004ba740 10 client.27761 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.271+0000 7fbf004ba740 1 -- 172.21.15.53:0/2310506857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55d805a65ed0 con 0x55d805617390 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.271+0000 7fbed2ffd640 1 -- 172.21.15.53:0/2310506857 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbee80cba70 con 0x55d805617390 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbed2ffd640 1 -- 172.21.15.53:0/2310506857 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7fbee80d0330 con 0x55d805617390 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbf004ba740 10 client.27761 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbf004ba740 10 client.27761 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbf004ba740 20 client.27761 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbf004ba740 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d8055cbda0 0x55d805a685b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbf004ba740 4 client.27761 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbf004ba740 1 -- 172.21.15.53:0/2310506857 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d805952070 con 0x55d8055cbda0 2024-08-31T06:14:28.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbef37fe640 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d8055cbda0 0x55d805a685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbed2ffd640 10 client.27761 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbef37fe640 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d8055cbda0 0x55d805a685b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=56ce7ea8c282777e server_cookie=a837f6eec38c262e in_seq=0 out_seq=0 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbed2ffd640 1 -- 172.21.15.53:0/2310506857 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d805952070 con 0x55d8055cbda0 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.272+0000 7fbed2ffd640 10 client.27761 handle_command_reply: tid=0 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 1 client.27761 shutdown 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 1 -- 172.21.15.53:0/2310506857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 msgr2=0x55d8059ed5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059ed5b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbee80cba20 tx=0x7fbee80c8420 comp rx=0 tx=0).stop 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 1 -- 172.21.15.53:0/2310506857 shutdown_connections 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d8055cbda0 0x55d805a685b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d805638070 0x55d805a648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d805617390 0x55d8059ed5b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 1 --2- 172.21.15.53:0/2310506857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d80560f1b0 0x55d8059ed070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 1 -- 172.21.15.53:0/2310506857 >> 172.21.15.53:0/2310506857 conn(0x55d80562c460 msgr2=0x55d8059e0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:28.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbed2ffd640 0 client.27761 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:14:28.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 1 -- 172.21.15.53:0/2310506857 shutdown_connections 2024-08-31T06:14:28.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 1 -- 172.21.15.53:0/2310506857 wait complete. 2024-08-31T06:14:28.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.273+0000 7fbf004ba740 20 client.27761 trim_cache size 0 max 16384 2024-08-31T06:14:28.280 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:14:28.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 -- 172.21.15.53:0/880880575 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbedc0b4d20 msgr2=0x7fbedc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:28.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbedc0b4d20 0x7fbedc0b7230 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbeec005fd0 tx=0x7fbeec009500 comp rx=0 tx=0).stop 2024-08-31T06:14:28.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 -- 172.21.15.53:0/880880575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbef4108140 msgr2=0x7fbef41053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:28.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbef4108140 0x7fbef41053c0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fbee8005940 tx=0x7fbee8005e30 comp rx=0 tx=0).stop 2024-08-31T06:14:28.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 -- 172.21.15.53:0/880880575 shutdown_connections 2024-08-31T06:14:28.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbedc0b4d20 0x7fbedc0b7230 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbef4108a90 0x7fbef4105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbef4108140 0x7fbef41053c0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 --2- 172.21.15.53:0/880880575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbef4102800 0x7fbef4104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:28.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 -- 172.21.15.53:0/880880575 >> 172.21.15.53:0/880880575 conn(0x7fbef40794d0 msgr2=0x7fbef406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:28.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 -- 172.21.15.53:0/880880575 shutdown_connections 2024-08-31T06:14:28.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:28.274+0000 7fbef9f45640 1 -- 172.21.15.53:0/880880575 wait complete. 2024-08-31T06:14:28.737 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 135.5 --await-for 45.0' 2024-08-31T06:14:28.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 135.5 --await-for 45.0 2024-08-31T06:14:28.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:28 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3770697888' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:14:28.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:28 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3770697888' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:14:28.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:28 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3770697888' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:14:28.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163192 1.58 MB/sec execute 378 sec latency 15.440 ms 2024-08-31T06:14:29.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:14:29.441 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:29.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:29 smithi130 ceph-mon[22266]: pgmap v617: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 557 KiB/s wr, 76 op/s 2024-08-31T06:14:29.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:29 smithi053 ceph-mon[18924]: pgmap v617: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 557 KiB/s wr, 76 op/s 2024-08-31T06:14:29.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.915+0000 7f67a04da640 1 -- 172.21.15.53:0/2483646670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6798102830 msgr2=0x7f6798102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:29.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.915+0000 7f67a04da640 1 --2- 172.21.15.53:0/2483646670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6798102830 0x7f6798102c40 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f6794009900 tx=0x7f679402a410 comp rx=0 tx=0).stop 2024-08-31T06:14:29.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.915+0000 7f67a04da640 1 -- 172.21.15.53:0/2483646670 shutdown_connections 2024-08-31T06:14:29.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.915+0000 7f67a04da640 1 --2- 172.21.15.53:0/2483646670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6798108ac0 0x7f679810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.915+0000 7f67a04da640 1 --2- 172.21.15.53:0/2483646670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6798108170 0x7f6798108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.915+0000 7f67a04da640 1 --2- 172.21.15.53:0/2483646670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6798102830 0x7f6798102c40 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.915+0000 7f67a04da640 1 -- 172.21.15.53:0/2483646670 >> 172.21.15.53:0/2483646670 conn(0x7f67980795c0 msgr2=0x7f67980799d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:29.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.915+0000 7f67a04da640 1 -- 172.21.15.53:0/2483646670 shutdown_connections 2024-08-31T06:14:29.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.915+0000 7f67a04da640 1 -- 172.21.15.53:0/2483646670 wait complete. 2024-08-31T06:14:29.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f67a04da640 1 Processor -- start 2024-08-31T06:14:29.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f67a04da640 1 -- start start 2024-08-31T06:14:29.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f67a04da640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6798102830 0x7f679819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f67a04da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6798108170 0x7f679819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f67a04da640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6798108ac0 0x7f679819fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f67a04da640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6798112640 con 0x7f6798108170 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f67a04da640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67981124c0 con 0x7f6798108ac0 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f67a04da640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67981127c0 con 0x7f6798102830 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f679da75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6798108170 0x7f679819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f679da75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6798108170 0x7f679819a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56456/0 (socket says 172.21.15.53:56456) 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f679da75640 1 -- 172.21.15.53:0/3753625637 learned_addr learned my addr 172.21.15.53:0/3753625637 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.916+0000 7f679e276640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6798102830 0x7f679819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f679ea77640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6798108ac0 0x7f679819fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f679da75640 1 -- 172.21.15.53:0/3753625637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6798102830 msgr2=0x7f679819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f679da75640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6798102830 0x7f679819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f679da75640 1 -- 172.21.15.53:0/3753625637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6798108ac0 msgr2=0x7f679819fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f679da75640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6798108ac0 0x7f679819fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f679da75640 1 -- 172.21.15.53:0/3753625637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67981a0130 con 0x7f6798108170 2024-08-31T06:14:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f679ea77640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6798108ac0 0x7f679819fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f679da75640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6798108170 0x7f679819a760 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f678800e9c0 tx=0x7f678800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f678f7fe640 1 -- 172.21.15.53:0/3753625637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678800ccc0 con 0x7f6798108170 2024-08-31T06:14:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f67a04da640 1 -- 172.21.15.53:0/3753625637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67981a0420 con 0x7f6798108170 2024-08-31T06:14:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f67a04da640 1 -- 172.21.15.53:0/3753625637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67980ff2b0 con 0x7f6798108170 2024-08-31T06:14:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f678f7fe640 1 -- 172.21.15.53:0/3753625637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67880054b0 con 0x7f6798108170 2024-08-31T06:14:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.917+0000 7f678f7fe640 1 -- 172.21.15.53:0/3753625637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788004e20 con 0x7f6798108170 2024-08-31T06:14:29.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.920+0000 7f67a6a4f740 1 Processor -- start 2024-08-31T06:14:29.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.920+0000 7f67a6a4f740 1 -- start start 2024-08-31T06:14:29.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.920+0000 7f678f7fe640 1 -- 172.21.15.53:0/3753625637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f67880046c0 con 0x7f6798108170 2024-08-31T06:14:29.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.920+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cf3ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.920+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb6e980 0x55925cf3f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.920+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb76b60 0x55925cf3f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.920+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55925ceb3330 con 0x55925cb76b60 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.920+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55925cea28c0 con 0x55925cb97840 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.920+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55925cea6870 con 0x55925cb6e980 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679da75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb76b60 0x55925cf3f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679ea77640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cf3ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679ea77640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cf3ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60376/0 (socket says 172.21.15.53:60376) 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679da75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb76b60 0x55925cf3f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56466/0 (socket says 172.21.15.53:56466) 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679ea77640 1 -- 172.21.15.53:0/2412310470 learned_addr learned my addr 172.21.15.53:0/2412310470 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679e276640 1 --2- 172.21.15.53:0/2412310470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb6e980 0x55925cf3f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679ea77640 1 -- 172.21.15.53:0/2412310470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb6e980 msgr2=0x55925cf3f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:29.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679ea77640 1 --2- 172.21.15.53:0/2412310470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb6e980 0x55925cf3f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679ea77640 1 -- 172.21.15.53:0/2412310470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb76b60 msgr2=0x55925cf3f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:29.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679ea77640 1 --2- 172.21.15.53:0/2412310470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb76b60 0x55925cf3f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679ea77640 1 -- 172.21.15.53:0/2412310470 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55925ce5adf0 con 0x55925cb97840 2024-08-31T06:14:29.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.921+0000 7f679ea77640 1 --2- 172.21.15.53:0/2412310470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cf3ec90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6790009f90 tx=0x7f679000f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86faf9397218571 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:29.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.922+0000 7f678f7fe640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67840b4ca0 0x7f67840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:29 smithi153 ceph-mon[22320]: pgmap v617: 97 pgs: 97 active+clean; 93 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 557 KiB/s wr, 76 op/s 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.922+0000 7f679e276640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67840b4ca0 0x7f67840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.922+0000 7f678cff9640 1 -- 172.21.15.53:0/2412310470 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790003b70 con 0x55925cb97840 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.922+0000 7f678cff9640 1 -- 172.21.15.53:0/2412310470 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6790003d10 con 0x55925cb97840 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.922+0000 7f678f7fe640 1 -- 172.21.15.53:0/3753625637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f67880e5900 con 0x7f6798108170 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.922+0000 7f678cff9640 1 -- 172.21.15.53:0/2412310470 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900118a0 con 0x55925cb97840 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f67a6a4f740 1 -- 172.21.15.53:0/2412310470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 msgr2=0x55925cf3ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/2412310470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cf3ec90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6790009f90 tx=0x7f679000f7f0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f679e276640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67840b4ca0 0x7f67840b71b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6794000c00 tx=0x7f6794005ed0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f67a6a4f740 1 -- 172.21.15.53:0/2412310470 shutdown_connections 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/2412310470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb76b60 0x55925cf3f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/2412310470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb6e980 0x55925cf3f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/2412310470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cf3ec90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f67a6a4f740 1 -- 172.21.15.53:0/2412310470 >> 172.21.15.53:0/2412310470 conn(0x55925cb8b990 msgr2=0x55925cf3cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f67a6a4f740 1 -- 172.21.15.53:0/2412310470 shutdown_connections 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f67a6a4f740 1 -- 172.21.15.53:0/2412310470 wait complete. 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f67a6a4f740 1 -- start start 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.923+0000 7f67a6a4f740 1 Processor -- start 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf4aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cf567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55925cd057a0 con 0x55925cb6e980 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55925ce29240 con 0x55925cb97840 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55925cf4d470 con 0x55925cb76b60 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f67a6a4f740 10 client.0 _ll_register_callbacks cb 0x55925cbaf090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679da75640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf4aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679e276640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679e276640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56472/0 (socket says 172.21.15.53:56472) 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679da75640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf4aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48468/0 (socket says 172.21.15.53:48468) 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679e276640 1 -- 172.21.15.53:0/1191164398 learned_addr learned my addr 172.21.15.53:0/1191164398 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679ea77640 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cf567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679e276640 1 -- 172.21.15.53:0/1191164398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 msgr2=0x55925cf4aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679e276640 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf4aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679e276640 1 -- 172.21.15.53:0/1191164398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 msgr2=0x55925cf567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679e276640 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cf567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679e276640 1 -- 172.21.15.53:0/1191164398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55925ce5f2b0 con 0x55925cb6e980 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.924+0000 7f679da75640 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf4aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.925+0000 7f679ea77640 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cf567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.925+0000 7f679e276640 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4a4c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f6794033000 tx=0x7f6794009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7e07558e30eadb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.925+0000 7f6781ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.925+0000 7f6781ffb640 1 -- 172.21.15.53:0/1191164398 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679404c030 con 0x55925cb6e980 2024-08-31T06:14:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.925+0000 7f6781ffb640 1 -- 172.21.15.53:0/1191164398 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f6794005020 con 0x55925cb6e980 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.925+0000 7f67a6a4f740 1 -- 172.21.15.53:0/1191164398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6790003d10 con 0x55925cb6e980 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.925+0000 7f6781ffb640 1 -- 172.21.15.53:0/1191164398 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6794058050 con 0x55925cb6e980 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.925+0000 7f67a6a4f740 10 client.18546 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.925+0000 7f67a6a4f740 1 -- 172.21.15.53:0/1191164398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55925cc11b90 con 0x55925cb6e980 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.925+0000 7f6781ffb640 1 -- 172.21.15.53:0/1191164398 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6790003d10 con 0x55925cb6e980 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.926+0000 7f6781ffb640 1 -- 172.21.15.53:0/1191164398 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f6794004c60 con 0x55925cb6e980 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.926+0000 7f67a6a4f740 10 client.18546 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.926+0000 7f67a6a4f740 10 client.18546 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.926+0000 7f67a6a4f740 20 client.18546 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.926+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55925cb561c0 0x55925cf5c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.926+0000 7f67a6a4f740 4 client.18546 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.926+0000 7f67a6a4f740 1 -- 172.21.15.53:0/1191164398 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55925ceb5280 con 0x55925cb561c0 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.926+0000 7f679da75640 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55925cb561c0 0x55925cf5c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.926+0000 7f6781ffb640 10 client.18546 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:29.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.927+0000 7f679da75640 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55925cb561c0 0x55925cf5c780 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8425e315965ab11 server_cookie=90acb0b8b05bdec6 in_seq=0 out_seq=0 2024-08-31T06:14:29.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.927+0000 7f6781ffb640 1 -- 172.21.15.53:0/1191164398 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55925ceb5280 con 0x55925cb561c0 2024-08-31T06:14:29.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.927+0000 7f6781ffb640 10 client.18546 handle_command_reply: tid=0 2024-08-31T06:14:29.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.927+0000 7f67a6a4f740 1 client.18546 shutdown 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.927+0000 7f67a6a4f740 1 -- 172.21.15.53:0/1191164398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 msgr2=0x55925cf4a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.927+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4a4c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f6794033000 tx=0x7f6794009260 comp rx=0 tx=0).stop 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.927+0000 7f67a6a4f740 1 -- 172.21.15.53:0/1191164398 shutdown_connections 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.927+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55925cb561c0 0x55925cf5c780 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.928+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cf567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.928+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf4aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.928+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/1191164398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4a4c0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.928+0000 7f67a6a4f740 1 -- 172.21.15.53:0/1191164398 >> 172.21.15.53:0/1191164398 conn(0x55925cb8b990 msgr2=0x55925cf41e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.928+0000 7f6781ffb640 0 client.18546 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.928+0000 7f67a6a4f740 1 -- 172.21.15.53:0/1191164398 shutdown_connections 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.928+0000 7f67a6a4f740 1 -- 172.21.15.53:0/1191164398 wait complete. 2024-08-31T06:14:29.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.928+0000 7f67a6a4f740 20 client.18546 trim_cache size 0 max 16384 2024-08-31T06:14:29.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.946+0000 7f67a6a4f740 1 Processor -- start 2024-08-31T06:14:29.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.946+0000 7f67a6a4f740 1 -- start start 2024-08-31T06:14:29.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.946+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb6e980 0x55925cf4c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.946+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf3c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.946+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb97840 0x55925cf3c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f677c00e8b0 con 0x55925cb97840 2024-08-31T06:14:29.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f677c010600 con 0x55925cb6e980 2024-08-31T06:14:29.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f677c00ef80 con 0x55925cb76b60 2024-08-31T06:14:29.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679ea77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb97840 0x55925cf3c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679ea77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb97840 0x55925cf3c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56474/0 (socket says 172.21.15.53:56474) 2024-08-31T06:14:29.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679ea77640 1 -- 172.21.15.53:0/915653214 learned_addr learned my addr 172.21.15.53:0/915653214 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:29.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679e276640 1 --2- 172.21.15.53:0/915653214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb6e980 0x55925cf4c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679da75640 1 --2- 172.21.15.53:0/915653214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf3c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679e276640 1 -- 172.21.15.53:0/915653214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 msgr2=0x55925cf3c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679e276640 1 --2- 172.21.15.53:0/915653214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf3c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679e276640 1 -- 172.21.15.53:0/915653214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb97840 msgr2=0x55925cf3c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679e276640 1 --2- 172.21.15.53:0/915653214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb97840 0x55925cf3c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679e276640 1 -- 172.21.15.53:0/915653214 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55925ce72d90 con 0x55925cb6e980 2024-08-31T06:14:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679ea77640 1 --2- 172.21.15.53:0/915653214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb97840 0x55925cf3c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.947+0000 7f679e276640 1 --2- 172.21.15.53:0/915653214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb6e980 0x55925cf4c3a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6794003640 tx=0x7f6794031990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a7c71db563c98c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.948+0000 7f6783fff640 1 -- 172.21.15.53:0/915653214 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794061070 con 0x55925cb6e980 2024-08-31T06:14:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.948+0000 7f6783fff640 1 -- 172.21.15.53:0/915653214 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6794003830 con 0x55925cb6e980 2024-08-31T06:14:29.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.948+0000 7f6783fff640 1 -- 172.21.15.53:0/915653214 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679404c040 con 0x55925cb6e980 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.948+0000 7f67a6a4f740 1 -- 172.21.15.53:0/915653214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb6e980 msgr2=0x55925cf4c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.948+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/915653214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb6e980 0x55925cf4c3a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6794003640 tx=0x7f6794031990 comp rx=0 tx=0).stop 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 -- 172.21.15.53:0/915653214 shutdown_connections 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/915653214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb97840 0x55925cf3c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/915653214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf3c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/915653214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb6e980 0x55925cf4c3a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 -- 172.21.15.53:0/915653214 >> 172.21.15.53:0/915653214 conn(0x55925cb8b990 msgr2=0x55925cf4a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 -- 172.21.15.53:0/915653214 shutdown_connections 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 -- 172.21.15.53:0/915653214 wait complete. 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 -- start start 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 Processor -- start 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf4f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cfc6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f677c00fe70 con 0x55925cb6e980 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f677c00f710 con 0x55925cb97840 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f677c00c8b0 con 0x55925cb76b60 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.949+0000 7f67a6a4f740 10 client.0 _ll_register_callbacks cb 0x7f6788005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679e276640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679e276640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56478/0 (socket says 172.21.15.53:56478) 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679e276640 1 -- 172.21.15.53:0/4210181478 learned_addr learned my addr 172.21.15.53:0/4210181478 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679ea77640 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cfc6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679da75640 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf4f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679e276640 1 -- 172.21.15.53:0/4210181478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 msgr2=0x55925cf4f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679e276640 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf4f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679e276640 1 -- 172.21.15.53:0/4210181478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 msgr2=0x55925cfc6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:29.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679e276640 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cfc6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679e276640 1 -- 172.21.15.53:0/4210181478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55925cfc66c0 con 0x55925cb6e980 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679da75640 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf4f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679ea77640 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cfc6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f679e276640 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4ee30 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f679405f040 tx=0x7f6794031830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb22efdb58da6b47 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.950+0000 7f6781ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f6781ffb640 1 -- 172.21.15.53:0/4210181478 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679404c070 con 0x55925cb6e980 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f6781ffb640 1 -- 172.21.15.53:0/4210181478 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f6794066470 con 0x55925cb6e980 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f67a6a4f740 1 -- 172.21.15.53:0/4210181478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6794003830 con 0x55925cb6e980 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f6781ffb640 1 -- 172.21.15.53:0/4210181478 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6794061040 con 0x55925cb6e980 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f67a6a4f740 10 client.18552 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f67a6a4f740 1 -- 172.21.15.53:0/4210181478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55925cfc7920 con 0x55925cb6e980 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f6781ffb640 1 -- 172.21.15.53:0/4210181478 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6794003830 con 0x55925cb6e980 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f6781ffb640 1 -- 172.21.15.53:0/4210181478 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f6794051500 con 0x55925cb6e980 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f67a6a4f740 10 client.18552 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:29.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f67a6a4f740 10 client.18552 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:14:29.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f67a6a4f740 20 client.18552 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:29.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55925cb2b570 0x55925cfca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:29.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f67a6a4f740 4 client.18552 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 135.5, "await_for": 45.0}] 2024-08-31T06:14:29.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.951+0000 7f67a6a4f740 1 -- 172.21.15.53:0/4210181478 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 135.5, "await_for": 45.0}) -- 0x55925ceb0d20 con 0x55925cb2b570 2024-08-31T06:14:29.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.952+0000 7f679da75640 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55925cb2b570 0x55925cfca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:29.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.952+0000 7f6781ffb640 10 client.18552 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:29.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:29.952+0000 7f679da75640 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55925cb2b570 0x55925cfca0f0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77947beb8c581e2 server_cookie=acd53e269474691a in_seq=0 out_seq=0 2024-08-31T06:14:29.959 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:29.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163257 1.58 MB/sec execute 379 sec latency 893.642 ms 2024-08-31T06:14:30.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f6781ffb640 1 -- 172.21.15.53:0/4210181478 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55925ceb0d20 con 0x55925cb2b570 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f6781ffb640 10 client.18552 handle_command_reply: tid=0 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f67a6a4f740 1 client.18552 shutdown 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f67a6a4f740 1 -- 172.21.15.53:0/4210181478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 msgr2=0x55925cf4ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4ee30 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f679405f040 tx=0x7f6794031830 comp rx=0 tx=0).stop 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f67a6a4f740 1 -- 172.21.15.53:0/4210181478 shutdown_connections 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55925cb2b570 0x55925cfca0f0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55925cb97840 0x55925cfc6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f6781ffb640 0 client.18552 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55925cb76b60 0x55925cf4f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f67a6a4f740 1 --2- 172.21.15.53:0/4210181478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925cb6e980 0x55925cf4ee30 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f67a6a4f740 1 -- 172.21.15.53:0/4210181478 >> 172.21.15.53:0/4210181478 conn(0x55925cb8b990 msgr2=0x55925cf4a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f67a6a4f740 1 -- 172.21.15.53:0/4210181478 shutdown_connections 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.032+0000 7f67a6a4f740 1 -- 172.21.15.53:0/4210181478 wait complete. 2024-08-31T06:14:30.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a6a4f740 20 client.18552 trim_cache size 0 max 16384 2024-08-31T06:14:30.037 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:14:30.037 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 46, 2024-08-31T06:14:30.037 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:14:30.037 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 30, 2024-08-31T06:14:30.037 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:14:30.037 INFO:teuthology.orchestra.run.smithi053.stdout: "e5bdbc69": { 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 30, 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 135.5, 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:14:30.038 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:14:30.039 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:30.039 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:30.039 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:30.039 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:30.039 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:30.039 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:14:30.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 -- 172.21.15.53:0/3753625637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67840b4ca0 msgr2=0x7f67840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:30.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67840b4ca0 0x7f67840b71b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6794000c00 tx=0x7f6794005ed0 comp rx=0 tx=0).stop 2024-08-31T06:14:30.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 -- 172.21.15.53:0/3753625637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6798108170 msgr2=0x7f679819a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:30.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6798108170 0x7f679819a760 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f678800e9c0 tx=0x7f678800ee80 comp rx=0 tx=0).stop 2024-08-31T06:14:30.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 -- 172.21.15.53:0/3753625637 shutdown_connections 2024-08-31T06:14:30.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67840b4ca0 0x7f67840b71b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:30.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6798108ac0 0x7f679819fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:30.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6798108170 0x7f679819a760 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:30.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 --2- 172.21.15.53:0/3753625637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6798102830 0x7f679819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:30.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 -- 172.21.15.53:0/3753625637 >> 172.21.15.53:0/3753625637 conn(0x7f67980795c0 msgr2=0x7f679806bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:30.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 -- 172.21.15.53:0/3753625637 shutdown_connections 2024-08-31T06:14:30.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:30.033+0000 7f67a04da640 1 -- 172.21.15.53:0/3753625637 wait complete. 2024-08-31T06:14:30.901 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e5bdbc69', quiesce took 4.4 seconds. Will release after: 11.1 2024-08-31T06:14:30.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.58 MB/sec execute 380 sec latency 940.840 ms 2024-08-31T06:14:31.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.161+0000 7f59070af640 1 -- 172.21.15.53:0/3588743954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5900103920 msgr2=0x7f5900103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:31.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.161+0000 7f59070af640 1 --2- 172.21.15.53:0/3588743954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5900103920 0x7f5900103d30 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009900 tx=0x7f58fc02a410 comp rx=0 tx=0).stop 2024-08-31T06:14:31.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.161+0000 7f59070af640 1 -- 172.21.15.53:0/3588743954 shutdown_connections 2024-08-31T06:14:31.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.161+0000 7f59070af640 1 --2- 172.21.15.53:0/3588743954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5900109bb0 0x7f59001103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.161+0000 7f59070af640 1 --2- 172.21.15.53:0/3588743954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5900109260 0x7f5900109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.161+0000 7f59070af640 1 --2- 172.21.15.53:0/3588743954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5900103920 0x7f5900103d30 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.161+0000 7f59070af640 1 -- 172.21.15.53:0/3588743954 >> 172.21.15.53:0/3588743954 conn(0x7f59000ff370 msgr2=0x7f59001017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:31.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.161+0000 7f59070af640 1 -- 172.21.15.53:0/3588743954 shutdown_connections 2024-08-31T06:14:31.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.161+0000 7f59070af640 1 -- 172.21.15.53:0/3588743954 wait complete. 2024-08-31T06:14:31.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.161+0000 7f59070af640 1 Processor -- start 2024-08-31T06:14:31.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.161+0000 7f59070af640 1 -- start start 2024-08-31T06:14:31.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f59070af640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5900103920 0x7f590019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f59070af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5900109260 0x7f590019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f59070af640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5900109bb0 0x7f590019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f59070af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5900113720 con 0x7f5900109260 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f59070af640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f59001135a0 con 0x7f5900103920 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f59070af640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f59001138a0 con 0x7f5900109bb0 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f58f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5900109260 0x7f590019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f58f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5900109260 0x7f590019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56490/0 (socket says 172.21.15.53:56490) 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f58f7fff640 1 -- 172.21.15.53:0/3468671897 learned_addr learned my addr 172.21.15.53:0/3468671897 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f590564c640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5900109bb0 0x7f590019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f5904e4b640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5900103920 0x7f590019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f58f7fff640 1 -- 172.21.15.53:0/3468671897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5900109bb0 msgr2=0x7f590019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f58f7fff640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5900109bb0 0x7f590019f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f58f7fff640 1 -- 172.21.15.53:0/3468671897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5900103920 msgr2=0x7f590019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f58f7fff640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5900103920 0x7f590019a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f58f7fff640 1 -- 172.21.15.53:0/3468671897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59001a0040 con 0x7f5900109260 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f5904e4b640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5900103920 0x7f590019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:31.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f58f7fff640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5900109260 0x7f590019a730 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f58f000d750 tx=0x7f58f000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:31.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.162+0000 7f58f5ffb640 1 -- 172.21.15.53:0/3468671897 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0017070 con 0x7f5900109260 2024-08-31T06:14:31.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.163+0000 7f58f5ffb640 1 -- 172.21.15.53:0/3468671897 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58f00054b0 con 0x7f5900109260 2024-08-31T06:14:31.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.163+0000 7f59070af640 1 -- 172.21.15.53:0/3468671897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59001a0330 con 0x7f5900109260 2024-08-31T06:14:31.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.163+0000 7f58f5ffb640 1 -- 172.21.15.53:0/3468671897 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0004bc0 con 0x7f5900109260 2024-08-31T06:14:31.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.163+0000 7f59070af640 1 -- 172.21.15.53:0/3468671897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59001a6b50 con 0x7f5900109260 2024-08-31T06:14:31.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f590d624740 1 Processor -- start 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f590d624740 1 -- start start 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f590d624740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73c0070 0x55e9c7765350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f590d624740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73971b0 0x55e9c7765890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f590d624740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c7765dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f590d624740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e9c76dc680 con 0x55e9c73971b0 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f590d624740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e9c76cbc10 con 0x55e9c73c0070 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f590d624740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e9c76cfbc0 con 0x55e9c739f390 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f5904e4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73971b0 0x55e9c7765890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f5904e4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73971b0 0x55e9c7765890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56498/0 (socket says 172.21.15.53:56498) 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f58f5ffb640 1 -- 172.21.15.53:0/3468671897 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f58f0009c30 con 0x7f5900109260 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f5904e4b640 1 -- 172.21.15.53:0/3071020806 learned_addr learned my addr 172.21.15.53:0/3071020806 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.166+0000 7f590564c640 1 --2- 172.21.15.53:0/3071020806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73c0070 0x55e9c7765350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f58f7fff640 1 --2- 172.21.15.53:0/3071020806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c7765dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f5904e4b640 1 -- 172.21.15.53:0/3071020806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 msgr2=0x55e9c7765dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f5904e4b640 1 --2- 172.21.15.53:0/3071020806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c7765dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f5904e4b640 1 -- 172.21.15.53:0/3071020806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73c0070 msgr2=0x55e9c7765350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f5904e4b640 1 --2- 172.21.15.53:0/3071020806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73c0070 0x55e9c7765350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f5904e4b640 1 -- 172.21.15.53:0/3071020806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c742b650 con 0x55e9c73971b0 2024-08-31T06:14:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f5904e4b640 1 --2- 172.21.15.53:0/3071020806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73971b0 0x55e9c7765890 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0096c0 tx=0x7f58fc032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2935db2ef8bb1628 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f58e6ffd640 1 -- 172.21.15.53:0/3071020806 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc03f070 con 0x55e9c73971b0 2024-08-31T06:14:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f58f5ffb640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f58e80b4d50 0x7f58e80b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f58e6ffd640 1 -- 172.21.15.53:0/3071020806 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58fc0044c0 con 0x55e9c73971b0 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f58e6ffd640 1 -- 172.21.15.53:0/3071020806 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc035070 con 0x55e9c73971b0 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.167+0000 7f590564c640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f58e80b4d50 0x7f58e80b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.168+0000 7f58f5ffb640 1 -- 172.21.15.53:0/3468671897 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f58f00e4ed0 con 0x7f5900109260 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.168+0000 7f590d624740 1 -- 172.21.15.53:0/3071020806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73971b0 msgr2=0x55e9c7765890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.168+0000 7f590564c640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f58e80b4d50 0x7f58e80b7260 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f58f8007f80 tx=0x7f58f8007520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.168+0000 7f590d624740 1 --2- 172.21.15.53:0/3071020806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73971b0 0x55e9c7765890 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0096c0 tx=0x7f58fc032d70 comp rx=0 tx=0).stop 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.168+0000 7f590d624740 1 -- 172.21.15.53:0/3071020806 shutdown_connections 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.168+0000 7f590d624740 1 --2- 172.21.15.53:0/3071020806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c7765dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.168+0000 7f590d624740 1 --2- 172.21.15.53:0/3071020806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73971b0 0x55e9c7765890 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.168+0000 7f590d624740 1 --2- 172.21.15.53:0/3071020806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73c0070 0x55e9c7765350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.168+0000 7f590d624740 1 -- 172.21.15.53:0/3071020806 >> 172.21.15.53:0/3071020806 conn(0x55e9c73b4460 msgr2=0x55e9c7763240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.168+0000 7f590d624740 1 -- 172.21.15.53:0/3071020806 shutdown_connections 2024-08-31T06:14:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.168+0000 7f590d624740 1 -- 172.21.15.53:0/3071020806 wait complete. 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.169+0000 7f590d624740 1 -- start start 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.169+0000 7f590d624740 1 Processor -- start 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.169+0000 7f590d624740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7770ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.169+0000 7f590d624740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c7771010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.169+0000 7f590d624740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c777cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.169+0000 7f590d624740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e9c752e700 con 0x55e9c73c0070 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.169+0000 7f590d624740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e9c7652750 con 0x55e9c73971b0 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.169+0000 7f590d624740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e9c7773ad0 con 0x55e9c739f390 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.169+0000 7f590d624740 10 client.0 _ll_register_callbacks cb 0x55e9c7681e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.169+0000 7f590564c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c777cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f5904e4b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7770ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f590564c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c777cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56512/0 (socket says 172.21.15.53:56512) 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f58f7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c7771010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f590564c640 1 -- 172.21.15.53:0/2686933255 learned_addr learned my addr 172.21.15.53:0/2686933255 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f58f7fff640 1 -- 172.21.15.53:0/2686933255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 msgr2=0x55e9c7770ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f58f7fff640 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7770ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f58f7fff640 1 -- 172.21.15.53:0/2686933255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 msgr2=0x55e9c777cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:31.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f58f7fff640 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c777cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f58f7fff640 1 -- 172.21.15.53:0/2686933255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9c768b900 con 0x55e9c739f390 2024-08-31T06:14:31.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f5904e4b640 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7770ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:31.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f590564c640 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c777cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:31.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f58f7fff640 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c7771010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58f00e2600 tx=0x7f58f0005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b906aae9e5723fc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:31.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f58dffff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:14:31.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f58dffff640 1 -- 172.21.15.53:0/2686933255 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0020050 con 0x55e9c739f390 2024-08-31T06:14:31.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f58dffff640 1 -- 172.21.15.53:0/2686933255 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f58f00ce2c0 con 0x55e9c739f390 2024-08-31T06:14:31.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f590d624740 1 -- 172.21.15.53:0/2686933255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9c76de5d0 con 0x55e9c739f390 2024-08-31T06:14:31.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f58dffff640 1 -- 172.21.15.53:0/2686933255 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f58f00aad10 con 0x55e9c739f390 2024-08-31T06:14:31.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f590d624740 10 client.27784 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:31.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.170+0000 7f590d624740 1 -- 172.21.15.53:0/2686933255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55e9c777f8b0 con 0x55e9c739f390 2024-08-31T06:14:31.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.171+0000 7f58dffff640 1 -- 172.21.15.53:0/2686933255 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e9c76de5d0 con 0x55e9c739f390 2024-08-31T06:14:31.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.171+0000 7f58dffff640 1 -- 172.21.15.53:0/2686933255 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f58f00a6f10 con 0x55e9c739f390 2024-08-31T06:14:31.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.171+0000 7f590d624740 10 client.27784 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:31.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.171+0000 7f590d624740 10 client.27784 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.171+0000 7f590d624740 20 client.27784 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.171+0000 7f590d624740 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55e9c737e9f0 0x55e9c7782d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.171+0000 7f590d624740 4 client.27784 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.171+0000 7f590d624740 1 -- 172.21.15.53:0/2686933255 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9c76da070 con 0x55e9c737e9f0 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.171+0000 7f5904e4b640 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55e9c737e9f0 0x55e9c7782d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f5904e4b640 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55e9c737e9f0 0x55e9c7782d40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2ee8cb8caf746f87 server_cookie=bf8aac1fd42cf2ea in_seq=0 out_seq=0 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f58dffff640 10 client.27784 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f58dffff640 1 -- 172.21.15.53:0/2686933255 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e9c76da070 con 0x55e9c737e9f0 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f58dffff640 10 client.27784 handle_command_reply: tid=0 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f590d624740 1 client.27784 shutdown 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f590d624740 1 -- 172.21.15.53:0/2686933255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 msgr2=0x55e9c7771010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f590d624740 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c7771010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58f00e2600 tx=0x7f58f0005740 comp rx=0 tx=0).stop 2024-08-31T06:14:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f590d624740 1 -- 172.21.15.53:0/2686933255 shutdown_connections 2024-08-31T06:14:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f590d624740 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55e9c737e9f0 0x55e9c7782d40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f590d624740 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c777cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f590d624740 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c7771010 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f58dffff640 0 client.27784 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:14:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f590d624740 1 --2- 172.21.15.53:0/2686933255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7770ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.172+0000 7f590d624740 1 -- 172.21.15.53:0/2686933255 >> 172.21.15.53:0/2686933255 conn(0x55e9c73b4460 msgr2=0x55e9c77684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.173+0000 7f590d624740 1 -- 172.21.15.53:0/2686933255 shutdown_connections 2024-08-31T06:14:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.173+0000 7f590d624740 1 -- 172.21.15.53:0/2686933255 wait complete. 2024-08-31T06:14:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.173+0000 7f590d624740 20 client.27784 trim_cache size 0 max 16384 2024-08-31T06:14:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.186+0000 7f590d624740 1 Processor -- start 2024-08-31T06:14:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.186+0000 7f590d624740 1 -- start start 2024-08-31T06:14:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.186+0000 7f590d624740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7766a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.186+0000 7f590d624740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c777ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.186+0000 7f590d624740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c776dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.186+0000 7f590d624740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f59001af3e0 con 0x55e9c73c0070 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.186+0000 7f590d624740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f59001b1130 con 0x55e9c73971b0 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.186+0000 7f590d624740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f59001afab0 con 0x55e9c739f390 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.186+0000 7f590564c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c776dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.186+0000 7f590564c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c776dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56520/0 (socket says 172.21.15.53:56520) 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.186+0000 7f590564c640 1 -- 172.21.15.53:0/1275623355 learned_addr learned my addr 172.21.15.53:0/1275623355 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.187+0000 7f5904e4b640 1 --2- 172.21.15.53:0/1275623355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7766a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.187+0000 7f58f7fff640 1 --2- 172.21.15.53:0/1275623355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c777ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.187+0000 7f590564c640 1 -- 172.21.15.53:0/1275623355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 msgr2=0x55e9c777ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.187+0000 7f590564c640 1 --2- 172.21.15.53:0/1275623355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c777ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.187+0000 7f590564c640 1 -- 172.21.15.53:0/1275623355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 msgr2=0x55e9c7766a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.187+0000 7f590564c640 1 --2- 172.21.15.53:0/1275623355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7766a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.187+0000 7f590564c640 1 -- 172.21.15.53:0/1275623355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c7767640 con 0x55e9c73c0070 2024-08-31T06:14:31.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.187+0000 7f590564c640 1 --2- 172.21.15.53:0/1275623355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c776dcc0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f58f8003ef0 tx=0x7f58f8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f2f7a622f84ec8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:31.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.187+0000 7f58e67fc640 1 -- 172.21.15.53:0/1275623355 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80045c0 con 0x55e9c73c0070 2024-08-31T06:14:31.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.187+0000 7f58e67fc640 1 -- 172.21.15.53:0/1275623355 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58f8004760 con 0x55e9c73c0070 2024-08-31T06:14:31.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.187+0000 7f58e67fc640 1 -- 172.21.15.53:0/1275623355 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f801b630 con 0x55e9c73c0070 2024-08-31T06:14:31.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.188+0000 7f590d624740 1 -- 172.21.15.53:0/1275623355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 msgr2=0x55e9c776dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:31.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.188+0000 7f590d624740 1 --2- 172.21.15.53:0/1275623355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c776dcc0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f58f8003ef0 tx=0x7f58f8018000 comp rx=0 tx=0).stop 2024-08-31T06:14:31.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.188+0000 7f590d624740 1 -- 172.21.15.53:0/1275623355 shutdown_connections 2024-08-31T06:14:31.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.188+0000 7f590d624740 1 --2- 172.21.15.53:0/1275623355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c73c0070 0x55e9c776dcc0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.188+0000 7f590d624740 1 --2- 172.21.15.53:0/1275623355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c739f390 0x55e9c777ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.188+0000 7f590d624740 1 --2- 172.21.15.53:0/1275623355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7766a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.188+0000 7f590d624740 1 -- 172.21.15.53:0/1275623355 >> 172.21.15.53:0/1275623355 conn(0x55e9c73b4460 msgr2=0x55e9c7766380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.188+0000 7f590d624740 1 -- 172.21.15.53:0/1275623355 shutdown_connections 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.188+0000 7f590d624740 1 -- 172.21.15.53:0/1275623355 wait complete. 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.188+0000 7f590d624740 1 -- start start 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.188+0000 7f590d624740 1 Processor -- start 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f590d624740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7778d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f590d624740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c739f390 0x55e9c7779290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f590d624740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c73c0070 0x55e9c77e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f590d624740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f59001b09a0 con 0x55e9c739f390 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f590d624740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f59001b0240 con 0x55e9c73971b0 2024-08-31T06:14:31.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f590d624740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f59001ad3e0 con 0x55e9c73c0070 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f58f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c739f390 0x55e9c7779290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f58f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c739f390 0x55e9c7779290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56536/0 (socket says 172.21.15.53:56536) 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f58f7fff640 1 -- 172.21.15.53:0/1236542001 learned_addr learned my addr 172.21.15.53:0/1236542001 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f590d624740 10 client.0 _ll_register_callbacks cb 0x7f58f00057f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f590564c640 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c73c0070 0x55e9c77e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f5904e4b640 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7778d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f58f7fff640 1 -- 172.21.15.53:0/1236542001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c73c0070 msgr2=0x55e9c77e69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f58f7fff640 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c73c0070 0x55e9c77e69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f58f7fff640 1 -- 172.21.15.53:0/1236542001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 msgr2=0x55e9c7778d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.189+0000 7f58f7fff640 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7778d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f58f7fff640 1 -- 172.21.15.53:0/1236542001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9c7779aa0 con 0x55e9c739f390 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f58f7fff640 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c739f390 0x55e9c7779290 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f58f00ab2a0 tx=0x7f58f00ce4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d80169e729f992 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f58dffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f58dffff640 1 -- 172.21.15.53:0/1236542001 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0020040 con 0x55e9c739f390 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f58dffff640 1 -- 172.21.15.53:0/1236542001 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f58f00aaa10 con 0x55e9c739f390 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f590d624740 1 -- 172.21.15.53:0/1236542001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58f8004760 con 0x55e9c739f390 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f58dffff640 1 -- 172.21.15.53:0/1236542001 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f58f00afe10 con 0x55e9c739f390 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f590d624740 10 client.18570 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f590d624740 1 -- 172.21.15.53:0/1236542001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55e9c77f20a0 con 0x55e9c739f390 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f58dffff640 1 -- 172.21.15.53:0/1236542001 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58f8004760 con 0x55e9c739f390 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f58dffff640 1 -- 172.21.15.53:0/1236542001 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f58f005b1a0 con 0x55e9c739f390 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f590d624740 10 client.18570 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f590d624740 10 client.18570 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.190+0000 7f590d624740 20 client.18570 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.191+0000 7f590d624740 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55e9c7353da0 0x55e9c77f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.191+0000 7f590d624740 4 client.18570 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.191+0000 7f590d624740 1 -- 172.21.15.53:0/1236542001 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9c76d77b0 con 0x55e9c7353da0 2024-08-31T06:14:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.191+0000 7f5904e4b640 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55e9c7353da0 0x55e9c77f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.191+0000 7f58dffff640 10 client.18570 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.191+0000 7f5904e4b640 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55e9c7353da0 0x55e9c77f48a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=78bb45dbbae389ae server_cookie=8e69376801c699af in_seq=0 out_seq=0 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.191+0000 7f58dffff640 1 -- 172.21.15.53:0/1236542001 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9c76d77b0 con 0x55e9c7353da0 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.191+0000 7f58dffff640 10 client.18570 handle_command_reply: tid=0 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.191+0000 7f590d624740 1 client.18570 shutdown 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f590d624740 1 -- 172.21.15.53:0/1236542001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c739f390 msgr2=0x55e9c7779290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f590d624740 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c739f390 0x55e9c7779290 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f58f00ab2a0 tx=0x7f58f00ce4f0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f590d624740 1 -- 172.21.15.53:0/1236542001 shutdown_connections 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f590d624740 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9c73c0070 0x55e9c77e69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f590d624740 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55e9c7353da0 0x55e9c77f48a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f590d624740 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9c739f390 0x55e9c7779290 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f58dffff640 0 client.18570 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f590d624740 1 --2- 172.21.15.53:0/1236542001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9c73971b0 0x55e9c7778d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f590d624740 1 -- 172.21.15.53:0/1236542001 >> 172.21.15.53:0/1236542001 conn(0x55e9c73b4460 msgr2=0x55e9c7766d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f590d624740 1 -- 172.21.15.53:0/1236542001 shutdown_connections 2024-08-31T06:14:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f590d624740 1 -- 172.21.15.53:0/1236542001 wait complete. 2024-08-31T06:14:31.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.192+0000 7f590d624740 20 client.18570 trim_cache size 0 max 16384 2024-08-31T06:14:31.199 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:14:31.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 -- 172.21.15.53:0/3468671897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f58e80b4d50 msgr2=0x7f58e80b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:31.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f58e80b4d50 0x7f58e80b7260 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f58f8007f80 tx=0x7f58f8007520 comp rx=0 tx=0).stop 2024-08-31T06:14:31.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 -- 172.21.15.53:0/3468671897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5900109260 msgr2=0x7f590019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:31.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5900109260 0x7f590019a730 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f58f000d750 tx=0x7f58f000dc10 comp rx=0 tx=0).stop 2024-08-31T06:14:31.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 -- 172.21.15.53:0/3468671897 shutdown_connections 2024-08-31T06:14:31.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f58e80b4d50 0x7f58e80b7260 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5900109bb0 0x7f590019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5900109260 0x7f590019a730 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 --2- 172.21.15.53:0/3468671897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5900103920 0x7f590019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:31.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 -- 172.21.15.53:0/3468671897 >> 172.21.15.53:0/3468671897 conn(0x7f59000ff370 msgr2=0x7f5900101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:31.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 -- 172.21.15.53:0/3468671897 shutdown_connections 2024-08-31T06:14:31.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:31.193+0000 7f59070af640 1 -- 172.21.15.53:0/3468671897 wait complete. 2024-08-31T06:14:31.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:31 smithi130 ceph-mon[22266]: pgmap v618: 97 pgs: 97 active+clean; 94 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 897 KiB/s wr, 99 op/s 2024-08-31T06:14:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:31 smithi153 ceph-mon[22320]: pgmap v618: 97 pgs: 97 active+clean; 94 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 897 KiB/s wr, 99 op/s 2024-08-31T06:14:31.947 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:31 smithi053 ceph-mon[18924]: pgmap v618: 97 pgs: 97 active+clean; 94 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 897 KiB/s wr, 99 op/s 2024-08-31T06:14:31.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:14:31.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.57 MB/sec execute 381 sec latency 1940.887 ms 2024-08-31T06:14:32.226 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.708+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3875660548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40109240 msgr2=0x7f0d40109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.708+0000 7f0d44cc4640 1 --2- 172.21.15.53:0/3875660548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40109240 0x7f0d40109650 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009900 tx=0x7f0d3402a410 comp rx=0 tx=0).stop 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.708+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3875660548 shutdown_connections 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.708+0000 7f0d44cc4640 1 --2- 172.21.15.53:0/3875660548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d40109b90 0x7f0d401103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.708+0000 7f0d44cc4640 1 --2- 172.21.15.53:0/3875660548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40109240 0x7f0d40109650 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.708+0000 7f0d44cc4640 1 --2- 172.21.15.53:0/3875660548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d40103900 0x7f0d40103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.708+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3875660548 >> 172.21.15.53:0/3875660548 conn(0x7f0d4007b5f0 msgr2=0x7f0d4007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.708+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3875660548 shutdown_connections 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.708+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3875660548 wait complete. 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.709+0000 7f0d44cc4640 1 Processor -- start 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.709+0000 7f0d44cc4640 1 -- start start 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.709+0000 7f0d44cc4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d40103900 0x7f0d4019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.709+0000 7f0d44cc4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d40109240 0x7f0d4019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d44cc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40109b90 0x7f0d4019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d44cc4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0d40113700 con 0x7f0d40109b90 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d44cc4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0d40113580 con 0x7f0d40109240 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d44cc4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0d40113880 con 0x7f0d40103900 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d3ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40109b90 0x7f0d4019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d3ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40109b90 0x7f0d4019f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56554/0 (socket says 172.21.15.53:56554) 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d3ed9d640 1 -- 172.21.15.53:0/3915513541 learned_addr learned my addr 172.21.15.53:0/3915513541 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d40109240 0x7f0d4019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d40103900 0x7f0d4019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d3ed9d640 1 -- 172.21.15.53:0/3915513541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d40103900 msgr2=0x7f0d4019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d3ed9d640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d40103900 0x7f0d4019a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d3ed9d640 1 -- 172.21.15.53:0/3915513541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d40109240 msgr2=0x7f0d4019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d3ed9d640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d40109240 0x7f0d4019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d3ed9d640 1 -- 172.21.15.53:0/3915513541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d401a0100 con 0x7f0d40109b90 2024-08-31T06:14:32.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d3ed9d640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40109b90 0x7f0d4019f9d0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800eaa0 tx=0x7f0d3800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d2f7fe640 1 -- 172.21.15.53:0/3915513541 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3800cdb0 con 0x7f0d40109b90 2024-08-31T06:14:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d2f7fe640 1 -- 172.21.15.53:0/3915513541 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d38005020 con 0x7f0d40109b90 2024-08-31T06:14:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3915513541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d401a03f0 con 0x7f0d40109b90 2024-08-31T06:14:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.710+0000 7f0d2f7fe640 1 -- 172.21.15.53:0/3915513541 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d380116d0 con 0x7f0d40109b90 2024-08-31T06:14:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.711+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3915513541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d401a6b50 con 0x7f0d40109b90 2024-08-31T06:14:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.713+0000 7f0d4b239740 1 Processor -- start 2024-08-31T06:14:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.713+0000 7f0d2f7fe640 1 -- 172.21.15.53:0/3915513541 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0d380051d0 con 0x7f0d40109b90 2024-08-31T06:14:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d4b239740 1 -- start start 2024-08-31T06:14:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d6821070 0x55f2d6bc6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d67f81b0 0x55f2d6bc6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bc6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d4b239740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f2d6b3d680 con 0x55f2d67f81b0 2024-08-31T06:14:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d4b239740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f2d6b2cc10 con 0x55f2d6800390 2024-08-31T06:14:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d4b239740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f2d6b30bc0 con 0x55f2d6821070 2024-08-31T06:14:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d3e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d67f81b0 0x55f2d6bc6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d3e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d67f81b0 0x55f2d6bc6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56562/0 (socket says 172.21.15.53:56562) 2024-08-31T06:14:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d3e59c640 1 -- 172.21.15.53:0/1909480335 learned_addr learned my addr 172.21.15.53:0/1909480335 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d2f7fe640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d280b4ca0 0x7f0d280b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/1909480335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bc6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/1909480335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d6821070 0x55f2d6bc6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d3e59c640 1 -- 172.21.15.53:0/1909480335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d6821070 msgr2=0x55f2d6bc6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:32.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/1909480335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d6821070 0x55f2d6bc6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d3e59c640 1 -- 172.21.15.53:0/1909480335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 msgr2=0x55f2d6bc6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:32.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/1909480335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bc6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d3e59c640 1 -- 172.21.15.53:0/1909480335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d688c650 con 0x55f2d67f81b0 2024-08-31T06:14:32.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.714+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/1909480335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bc6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:32.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.715+0000 7f0d2f7fe640 1 -- 172.21.15.53:0/3915513541 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f0d380e56a0 con 0x7f0d40109b90 2024-08-31T06:14:32.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.715+0000 7f0d3ed9d640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d280b4ca0 0x7f0d280b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.715+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/1909480335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d67f81b0 0x55f2d6bc6890 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000ac10 tx=0x7f0d3000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744a4fc92450aaa1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.715+0000 7f0d2cff9640 1 -- 172.21.15.53:0/1909480335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3001d070 con 0x55f2d67f81b0 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.715+0000 7f0d2cff9640 1 -- 172.21.15.53:0/1909480335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d30018ad0 con 0x55f2d67f81b0 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.715+0000 7f0d2cff9640 1 -- 172.21.15.53:0/1909480335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d300109f0 con 0x55f2d67f81b0 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.716+0000 7f0d4b239740 1 -- 172.21.15.53:0/1909480335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d67f81b0 msgr2=0x55f2d6bc6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.716+0000 7f0d3ed9d640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d280b4ca0 0x7f0d280b71b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0d380a7ea0 tx=0x7f0d38005b20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.716+0000 7f0d4b239740 1 --2- 172.21.15.53:0/1909480335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d67f81b0 0x55f2d6bc6890 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000ac10 tx=0x7f0d3000f790 comp rx=0 tx=0).stop 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.716+0000 7f0d4b239740 1 -- 172.21.15.53:0/1909480335 shutdown_connections 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.716+0000 7f0d4b239740 1 --2- 172.21.15.53:0/1909480335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bc6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.716+0000 7f0d4b239740 1 --2- 172.21.15.53:0/1909480335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d67f81b0 0x55f2d6bc6890 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.716+0000 7f0d4b239740 1 --2- 172.21.15.53:0/1909480335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d6821070 0x55f2d6bc6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.716+0000 7f0d4b239740 1 -- 172.21.15.53:0/1909480335 >> 172.21.15.53:0/1909480335 conn(0x55f2d6815460 msgr2=0x55f2d6bc4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.716+0000 7f0d4b239740 1 -- 172.21.15.53:0/1909480335 shutdown_connections 2024-08-31T06:14:32.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.716+0000 7f0d4b239740 1 -- 172.21.15.53:0/1909480335 wait complete. 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.716+0000 7f0d4b239740 1 -- start start 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d4b239740 1 Processor -- start 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bd1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bd2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bdde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d4b239740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f2d698f700 con 0x55f2d6821070 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d4b239740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f2d6ab3750 con 0x55f2d6800390 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d4b239740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f2d6bd4b30 con 0x55f2d67f81b0 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d4b239740 10 client.0 _ll_register_callbacks cb 0x55f2d6ae2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d3dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bdde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d3dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bdde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56564/0 (socket says 172.21.15.53:56564) 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d3dd9b640 1 -- 172.21.15.53:0/374264463 learned_addr learned my addr 172.21.15.53:0/374264463 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bd1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bd2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d3dd9b640 1 -- 172.21.15.53:0/374264463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 msgr2=0x55f2d6bd1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bd1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d3dd9b640 1 -- 172.21.15.53:0/374264463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 msgr2=0x55f2d6bd2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bd2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.717+0000 7f0d3dd9b640 1 -- 172.21.15.53:0/374264463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2d6aec900 con 0x55f2d6821070 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bdde50 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000c00 tx=0x7f0d3402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c576c3a65a75db05 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d25ffb640 1 -- 172.21.15.53:0/374264463 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34035070 con 0x55f2d6821070 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d25ffb640 1 -- 172.21.15.53:0/374264463 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f0d34004480 con 0x55f2d6821070 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d4b239740 1 -- 172.21.15.53:0/374264463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d30018ad0 con 0x55f2d6821070 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d25ffb640 1 -- 172.21.15.53:0/374264463 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f0d340035f0 con 0x55f2d6821070 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d4b239740 10 client.18582 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:32.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d4b239740 1 -- 172.21.15.53:0/374264463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55f2d6be0910 con 0x55f2d6821070 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d25ffb640 1 -- 172.21.15.53:0/374264463 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d30018ad0 con 0x55f2d6821070 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d25ffb640 1 -- 172.21.15.53:0/374264463 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f0d3403d4e0 con 0x55f2d6821070 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d4b239740 10 client.18582 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d4b239740 10 client.18582 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d4b239740 20 client.18582 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d4b239740 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2d67df9f0 0x55f2d6be3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d4b239740 4 client.18582 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.718+0000 7f0d4b239740 1 -- 172.21.15.53:0/374264463 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2d6b3f5d0 con 0x55f2d67df9f0 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.719+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2d67df9f0 0x55f2d6be3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.719+0000 7f0d25ffb640 10 client.18582 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.719+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2d67df9f0 0x55f2d6be3d90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cb84d706ce71dca0 server_cookie=8f7c03c4efc944ab in_seq=0 out_seq=0 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d25ffb640 1 -- 172.21.15.53:0/374264463 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2d6b3f5d0 con 0x55f2d67df9f0 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d25ffb640 10 client.18582 handle_command_reply: tid=0 2024-08-31T06:14:32.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 1 client.18582 shutdown 2024-08-31T06:14:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 1 -- 172.21.15.53:0/374264463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 msgr2=0x55f2d6bdde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bdde50 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000c00 tx=0x7f0d3402a410 comp rx=0 tx=0).stop 2024-08-31T06:14:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 1 -- 172.21.15.53:0/374264463 shutdown_connections 2024-08-31T06:14:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2d67df9f0 0x55f2d6be3d90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bdde50 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bd2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 1 --2- 172.21.15.53:0/374264463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bd1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 1 -- 172.21.15.53:0/374264463 >> 172.21.15.53:0/374264463 conn(0x55f2d6815460 msgr2=0x55f2d6bc94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:32.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d25ffb640 0 client.18582 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:14:32.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 1 -- 172.21.15.53:0/374264463 shutdown_connections 2024-08-31T06:14:32.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 1 -- 172.21.15.53:0/374264463 wait complete. 2024-08-31T06:14:32.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.720+0000 7f0d4b239740 20 client.18582 trim_cache size 0 max 16384 2024-08-31T06:14:32.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d4b239740 1 Processor -- start 2024-08-31T06:14:32.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d4b239740 1 -- start start 2024-08-31T06:14:32.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bc9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6800390 0x55f2d6bc9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6821070 0x55f2d6bcecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d4b239740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401af4b0 con 0x55f2d6800390 2024-08-31T06:14:32.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d4b239740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401b1200 con 0x55f2d6821070 2024-08-31T06:14:32.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d4b239740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401afb80 con 0x55f2d67f81b0 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6800390 0x55f2d6bc9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6800390 0x55f2d6bc9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56566/0 (socket says 172.21.15.53:56566) 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3e59c640 1 -- 172.21.15.53:0/2997158686 learned_addr learned my addr 172.21.15.53:0/2997158686 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/2997158686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bc9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/2997158686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6821070 0x55f2d6bcecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3e59c640 1 -- 172.21.15.53:0/2997158686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 msgr2=0x55f2d6bc9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/2997158686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bc9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3e59c640 1 -- 172.21.15.53:0/2997158686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6821070 msgr2=0x55f2d6bcecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/2997158686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6821070 0x55f2d6bcecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3e59c640 1 -- 172.21.15.53:0/2997158686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d6bc8be0 con 0x55f2d6800390 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/2997158686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bc9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.734+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/2997158686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6800390 0x55f2d6bc9990 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x55f2d6bc4fd0 tx=0x7f0d3000a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bcc1167361c1c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.735+0000 7f0d27fff640 1 -- 172.21.15.53:0/2997158686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30032070 con 0x55f2d6800390 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.735+0000 7f0d27fff640 1 -- 172.21.15.53:0/2997158686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d3001e040 con 0x55f2d6800390 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.735+0000 7f0d27fff640 1 -- 172.21.15.53:0/2997158686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3001d040 con 0x55f2d6800390 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.735+0000 7f0d4b239740 1 -- 172.21.15.53:0/2997158686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6800390 msgr2=0x55f2d6bc9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.735+0000 7f0d4b239740 1 --2- 172.21.15.53:0/2997158686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6800390 0x55f2d6bc9990 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x55f2d6bc4fd0 tx=0x7f0d3000a4a0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 -- 172.21.15.53:0/2997158686 shutdown_connections 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 --2- 172.21.15.53:0/2997158686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6821070 0x55f2d6bcecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 --2- 172.21.15.53:0/2997158686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6800390 0x55f2d6bc9990 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 --2- 172.21.15.53:0/2997158686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bc9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 -- 172.21.15.53:0/2997158686 >> 172.21.15.53:0/2997158686 conn(0x55f2d6815460 msgr2=0x55f2d6bd0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 -- 172.21.15.53:0/2997158686 shutdown_connections 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 -- 172.21.15.53:0/2997158686 wait complete. 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 -- start start 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 Processor -- start 2024-08-31T06:14:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bd5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bd63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bd68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401b0a70 con 0x55f2d6821070 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401b0310 con 0x55f2d6800390 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401ad4b0 con 0x55f2d67f81b0 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.736+0000 7f0d4b239740 10 client.0 _ll_register_callbacks cb 0x7f0d34031760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d3dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bd68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d3dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bd68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56576/0 (socket says 172.21.15.53:56576) 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d3dd9b640 1 -- 172.21.15.53:0/2300041947 learned_addr learned my addr 172.21.15.53:0/2300041947 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bd5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bd63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d3dd9b640 1 -- 172.21.15.53:0/2300041947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 msgr2=0x55f2d6bd5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bd5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d3dd9b640 1 -- 172.21.15.53:0/2300041947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 msgr2=0x55f2d6bd63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bd63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d3dd9b640 1 -- 172.21.15.53:0/2300041947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2d6c4d860 con 0x55f2d6821070 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d3dd9b640 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bd68e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f0d34031470 tx=0x7f0d3402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bb48017bfdfd24 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d25ffb640 1 -- 172.21.15.53:0/2300041947 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34058040 con 0x55f2d6821070 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d25ffb640 1 -- 172.21.15.53:0/2300041947 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f0d3403d650 con 0x55f2d6821070 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d4b239740 1 -- 172.21.15.53:0/2300041947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d3001e040 con 0x55f2d6821070 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d25ffb640 1 -- 172.21.15.53:0/2300041947 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f0d34067050 con 0x55f2d6821070 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d4b239740 10 client.18588 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.737+0000 7f0d4b239740 1 -- 172.21.15.53:0/2300041947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55f2d6c4eae0 con 0x55f2d6821070 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.738+0000 7f0d25ffb640 1 -- 172.21.15.53:0/2300041947 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d3001e040 con 0x55f2d6821070 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.738+0000 7f0d25ffb640 1 -- 172.21.15.53:0/2300041947 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f0d3405e070 con 0x55f2d6821070 2024-08-31T06:14:32.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.738+0000 7f0d4b239740 10 client.18588 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.738+0000 7f0d4b239740 10 client.18588 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.738+0000 7f0d4b239740 20 client.18588 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.738+0000 7f0d4b239740 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2d67b4da0 0x55f2d6c511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.738+0000 7f0d4b239740 4 client.18588 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.738+0000 7f0d4b239740 1 -- 172.21.15.53:0/2300041947 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f2d6b3b070 con 0x55f2d67b4da0 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.738+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2d67b4da0 0x55f2d6c511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d25ffb640 10 client.18588 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d3e59c640 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2d67b4da0 0x55f2d6c511f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae69ce4f8f2b1193 server_cookie=c36852d4de8e07da in_seq=0 out_seq=0 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d25ffb640 1 -- 172.21.15.53:0/2300041947 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f2d6b3b070 con 0x55f2d67b4da0 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d25ffb640 10 client.18588 handle_command_reply: tid=0 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d4b239740 1 client.18588 shutdown 2024-08-31T06:14:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d4b239740 1 -- 172.21.15.53:0/2300041947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 msgr2=0x55f2d6bd68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d4b239740 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bd68e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f0d34031470 tx=0x7f0d3402a410 comp rx=0 tx=0).stop 2024-08-31T06:14:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d4b239740 1 -- 172.21.15.53:0/2300041947 shutdown_connections 2024-08-31T06:14:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d4b239740 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f2d67b4da0 0x55f2d6c511f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d4b239740 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2d6821070 0x55f2d6bd68e0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d4b239740 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2d6800390 0x55f2d6bd63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d4b239740 1 --2- 172.21.15.53:0/2300041947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2d67f81b0 0x55f2d6bd5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d4b239740 1 -- 172.21.15.53:0/2300041947 >> 172.21.15.53:0/2300041947 conn(0x55f2d6815460 msgr2=0x55f2d6bc9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d25ffb640 0 client.18588 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:14:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d4b239740 1 -- 172.21.15.53:0/2300041947 shutdown_connections 2024-08-31T06:14:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.739+0000 7f0d4b239740 1 -- 172.21.15.53:0/2300041947 wait complete. 2024-08-31T06:14:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d4b239740 20 client.18588 trim_cache size 0 max 16384 2024-08-31T06:14:32.751 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:14:32.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3915513541 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d280b4ca0 msgr2=0x7f0d280b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:32.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d280b4ca0 0x7f0d280b71b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0d380a7ea0 tx=0x7f0d38005b20 comp rx=0 tx=0).stop 2024-08-31T06:14:32.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3915513541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40109b90 msgr2=0x7f0d4019f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:32.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40109b90 0x7f0d4019f9d0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800eaa0 tx=0x7f0d3800ef60 comp rx=0 tx=0).stop 2024-08-31T06:14:32.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3915513541 shutdown_connections 2024-08-31T06:14:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d280b4ca0 0x7f0d280b71b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40109b90 0x7f0d4019f9d0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d40109240 0x7f0d4019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 --2- 172.21.15.53:0/3915513541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d40103900 0x7f0d4019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3915513541 >> 172.21.15.53:0/3915513541 conn(0x7f0d4007b5f0 msgr2=0x7f0d40105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3915513541 shutdown_connections 2024-08-31T06:14:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:32.740+0000 7f0d44cc4640 1 -- 172.21.15.53:0/3915513541 wait complete. 2024-08-31T06:14:32.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.57 MB/sec execute 382 sec latency 2940.932 ms 2024-08-31T06:14:33.544 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:14:33.843 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:33.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:33 smithi130 ceph-mon[22266]: pgmap v619: 97 pgs: 97 active+clean; 96 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 968 KiB/s wr, 96 op/s 2024-08-31T06:14:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:33 smithi153 ceph-mon[22320]: pgmap v619: 97 pgs: 97 active+clean; 96 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 968 KiB/s wr, 96 op/s 2024-08-31T06:14:33.964 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:33 smithi053 ceph-mon[18924]: pgmap v619: 97 pgs: 97 active+clean; 96 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 968 KiB/s wr, 96 op/s 2024-08-31T06:14:33.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.56 MB/sec execute 383 sec latency 3941.026 ms 2024-08-31T06:14:34.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.322+0000 7f7b61ad6640 1 -- 172.21.15.53:0/2451040004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b5c109b90 msgr2=0x7f7b5c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:34.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.322+0000 7f7b61ad6640 1 --2- 172.21.15.53:0/2451040004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b5c109b90 0x7f7b5c1103c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009ca0 tx=0x7f7b5402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.322+0000 7f7b61ad6640 1 -- 172.21.15.53:0/2451040004 shutdown_connections 2024-08-31T06:14:34.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.322+0000 7f7b61ad6640 1 --2- 172.21.15.53:0/2451040004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b5c109b90 0x7f7b5c1103c0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.322+0000 7f7b61ad6640 1 --2- 172.21.15.53:0/2451040004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b5c109240 0x7f7b5c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.322+0000 7f7b61ad6640 1 --2- 172.21.15.53:0/2451040004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b5c103900 0x7f7b5c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.322+0000 7f7b61ad6640 1 -- 172.21.15.53:0/2451040004 >> 172.21.15.53:0/2451040004 conn(0x7f7b5c07b5f0 msgr2=0x7f7b5c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:34.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.322+0000 7f7b61ad6640 1 -- 172.21.15.53:0/2451040004 shutdown_connections 2024-08-31T06:14:34.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.322+0000 7f7b61ad6640 1 -- 172.21.15.53:0/2451040004 wait complete. 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.322+0000 7f7b61ad6640 1 Processor -- start 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b61ad6640 1 -- start start 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b61ad6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b5c103900 0x7f7b5c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b61ad6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b5c109240 0x7f7b5c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b61ad6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b5c109b90 0x7f7b5c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b61ad6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c1137b0 con 0x7f7b5c109240 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b61ad6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c113630 con 0x7f7b5c109b90 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b61ad6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c113930 con 0x7f7b5c103900 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b5affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b5c109240 0x7f7b5c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b5affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b5c109240 0x7f7b5c0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52982/0 (socket says 172.21.15.53:52982) 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b5affd640 1 -- 172.21.15.53:0/192220068 learned_addr learned my addr 172.21.15.53:0/192220068 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b5c103900 0x7f7b5c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.323+0000 7f7b5bfff640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b5c109b90 0x7f7b5c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.324+0000 7f7b5affd640 1 -- 172.21.15.53:0/192220068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b5c103900 msgr2=0x7f7b5c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.324+0000 7f7b5affd640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b5c103900 0x7f7b5c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.324+0000 7f7b5affd640 1 -- 172.21.15.53:0/192220068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b5c109b90 msgr2=0x7f7b5c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.324+0000 7f7b5affd640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b5c109b90 0x7f7b5c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.324+0000 7f7b5affd640 1 -- 172.21.15.53:0/192220068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c1a8420 con 0x7f7b5c109240 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.324+0000 7f7b5affd640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b5c109240 0x7f7b5c0759f0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000d740 tx=0x7f7b5000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.324+0000 7f7b58ff9640 1 -- 172.21.15.53:0/192220068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b50017070 con 0x7f7b5c109240 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.324+0000 7f7b58ff9640 1 -- 172.21.15.53:0/192220068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b50010460 con 0x7f7b5c109240 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.324+0000 7f7b58ff9640 1 -- 172.21.15.53:0/192220068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000f620 con 0x7f7b5c109240 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.324+0000 7f7b61ad6640 1 -- 172.21.15.53:0/192220068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5c1a8710 con 0x7f7b5c109240 2024-08-31T06:14:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.324+0000 7f7b61ad6640 1 -- 172.21.15.53:0/192220068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b5c1a8c00 con 0x7f7b5c109240 2024-08-31T06:14:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b6804b740 1 Processor -- start 2024-08-31T06:14:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b6804b740 1 -- start start 2024-08-31T06:14:34.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 0x55b4342a9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433ee3390 0x55b4342a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b6804b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b434220680 con 0x55b433edb1b0 2024-08-31T06:14:34.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b6804b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b43420fc10 con 0x55b433ee3390 2024-08-31T06:14:34.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b6804b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b434213bc0 con 0x55b433f04070 2024-08-31T06:14:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b58ff9640 1 -- 172.21.15.53:0/192220068 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7b5001a070 con 0x7f7b5c109240 2024-08-31T06:14:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b5b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b5b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52994/0 (socket says 172.21.15.53:52994) 2024-08-31T06:14:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b5b7fe640 1 -- 172.21.15.53:0/3135059098 learned_addr learned my addr 172.21.15.53:0/3135059098 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b5bfff640 1 --2- 172.21.15.53:0/3135059098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 0x55b4342a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b5affd640 1 --2- 172.21.15.53:0/3135059098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433ee3390 0x55b4342a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b5b7fe640 1 -- 172.21.15.53:0/3135059098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 msgr2=0x55b4342a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.327+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/3135059098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 0x55b4342a9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.328+0000 7f7b5b7fe640 1 -- 172.21.15.53:0/3135059098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433ee3390 msgr2=0x55b4342a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.328+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/3135059098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433ee3390 0x55b4342a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.328+0000 7f7b5b7fe640 1 -- 172.21.15.53:0/3135059098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b433f6f650 con 0x55b433edb1b0 2024-08-31T06:14:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.328+0000 7f7b5bfff640 1 --2- 172.21.15.53:0/3135059098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 0x55b4342a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.328+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/3135059098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342a9850 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009a40 tx=0x7f7b4c009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6248aed59aa792d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.328+0000 7f7b41ffb640 1 -- 172.21.15.53:0/3135059098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c017070 con 0x55b433edb1b0 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.328+0000 7f7b58ff9640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b440b4ca0 0x7f7b440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.328+0000 7f7b41ffb640 1 -- 172.21.15.53:0/3135059098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b4c013470 con 0x55b433edb1b0 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.328+0000 7f7b41ffb640 1 -- 172.21.15.53:0/3135059098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c012630 con 0x55b433edb1b0 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.328+0000 7f7b5bfff640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b440b4ca0 0x7f7b440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.328+0000 7f7b58ff9640 1 -- 172.21.15.53:0/192220068 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f7b500e4fe0 con 0x7f7b5c109240 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.329+0000 7f7b6804b740 1 -- 172.21.15.53:0/3135059098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 msgr2=0x55b4342a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.329+0000 7f7b5bfff640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b440b4ca0 0x7f7b440b71b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7b54031040 tx=0x7f7b54005c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.329+0000 7f7b6804b740 1 --2- 172.21.15.53:0/3135059098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342a9850 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009a40 tx=0x7f7b4c009f00 comp rx=0 tx=0).stop 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.329+0000 7f7b6804b740 1 -- 172.21.15.53:0/3135059098 shutdown_connections 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.329+0000 7f7b6804b740 1 --2- 172.21.15.53:0/3135059098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433ee3390 0x55b4342a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.329+0000 7f7b6804b740 1 --2- 172.21.15.53:0/3135059098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342a9850 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.329+0000 7f7b6804b740 1 --2- 172.21.15.53:0/3135059098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 0x55b4342a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.329+0000 7f7b6804b740 1 -- 172.21.15.53:0/3135059098 >> 172.21.15.53:0/3135059098 conn(0x55b433ef8460 msgr2=0x55b4342a7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:34.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.329+0000 7f7b6804b740 1 -- 172.21.15.53:0/3135059098 shutdown_connections 2024-08-31T06:14:34.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.329+0000 7f7b6804b740 1 -- 172.21.15.53:0/3135059098 wait complete. 2024-08-31T06:14:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.329+0000 7f7b6804b740 1 -- start start 2024-08-31T06:14:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b6804b740 1 Processor -- start 2024-08-31T06:14:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433edb1b0 0x55b4342b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433ee3390 0x55b4342b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 0x55b4342c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b6804b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b434072700 con 0x55b433ee3390 2024-08-31T06:14:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b6804b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b434196750 con 0x55b433edb1b0 2024-08-31T06:14:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b6804b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b4342b7af0 con 0x55b433f04070 2024-08-31T06:14:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b6804b740 10 client.0 _ll_register_callbacks cb 0x55b4341c5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b5affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433ee3390 0x55b4342b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b5affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433ee3390 0x55b4342b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53002/0 (socket says 172.21.15.53:53002) 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b5affd640 1 -- 172.21.15.53:0/2719327919 learned_addr learned my addr 172.21.15.53:0/2719327919 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.330+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433edb1b0 0x55b4342b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b5bfff640 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 0x55b4342c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b5affd640 1 -- 172.21.15.53:0/2719327919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 msgr2=0x55b4342c0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b5affd640 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 0x55b4342c0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b5affd640 1 -- 172.21.15.53:0/2719327919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433edb1b0 msgr2=0x55b4342b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b5affd640 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433edb1b0 0x55b4342b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b5affd640 1 -- 172.21.15.53:0/2719327919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4341cf900 con 0x55b433ee3390 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b5bfff640 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 0x55b4342c0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433edb1b0 0x55b4342b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b5affd640 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433ee3390 0x55b4342b4fb0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7b500a8900 tx=0x7f7b50000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec343350fd5d0cd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b3affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b3affd640 1 -- 172.21.15.53:0/2719327919 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b50021070 con 0x55b433ee3390 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b3affd640 1 -- 172.21.15.53:0/2719327919 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f7b500a7c80 con 0x55b433ee3390 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b6804b740 1 -- 172.21.15.53:0/2719327919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b4c013470 con 0x55b433ee3390 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b3affd640 1 -- 172.21.15.53:0/2719327919 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f7b500ab1a0 con 0x55b433ee3390 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b6804b740 10 client.18600 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b6804b740 1 -- 172.21.15.53:0/2719327919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b4342c38a0 con 0x55b433ee3390 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.331+0000 7f7b3affd640 1 -- 172.21.15.53:0/2719327919 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b4c013470 con 0x55b433ee3390 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.332+0000 7f7b3affd640 1 -- 172.21.15.53:0/2719327919 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f7b500e7110 con 0x55b433ee3390 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.332+0000 7f7b6804b740 10 client.18600 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.332+0000 7f7b6804b740 10 client.18600 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:14:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.332+0000 7f7b6804b740 20 client.18600 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.332+0000 7f7b6804b740 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b433ec29f0 0x55b4342c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.332+0000 7f7b6804b740 4 client.18600 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.332+0000 7f7b6804b740 1 -- 172.21.15.53:0/2719327919 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4342225d0 con 0x55b433ec29f0 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.332+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b433ec29f0 0x55b4342c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.333+0000 7f7b3affd640 10 client.18600 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.333+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b433ec29f0 0x55b4342c6ed0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5e974f1d453a5ea7 server_cookie=25fdca16d9c69845 in_seq=0 out_seq=0 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.333+0000 7f7b3affd640 1 -- 172.21.15.53:0/2719327919 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4342225d0 con 0x55b433ec29f0 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.333+0000 7f7b3affd640 10 client.18600 handle_command_reply: tid=0 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.333+0000 7f7b6804b740 1 client.18600 shutdown 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b6804b740 1 -- 172.21.15.53:0/2719327919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433ee3390 msgr2=0x55b4342b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b6804b740 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433ee3390 0x55b4342b4fb0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7b500a8900 tx=0x7f7b50000bc0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b6804b740 1 -- 172.21.15.53:0/2719327919 shutdown_connections 2024-08-31T06:14:34.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b6804b740 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b433ec29f0 0x55b4342c6ed0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b6804b740 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433f04070 0x55b4342c0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b6804b740 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433ee3390 0x55b4342b4fb0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b6804b740 1 --2- 172.21.15.53:0/2719327919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433edb1b0 0x55b4342b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b6804b740 1 -- 172.21.15.53:0/2719327919 >> 172.21.15.53:0/2719327919 conn(0x55b433ef8460 msgr2=0x55b4342ac4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:34.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b3affd640 0 client.18600 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:14:34.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b6804b740 1 -- 172.21.15.53:0/2719327919 shutdown_connections 2024-08-31T06:14:34.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b6804b740 1 -- 172.21.15.53:0/2719327919 wait complete. 2024-08-31T06:14:34.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.334+0000 7f7b6804b740 20 client.18600 trim_cache size 0 max 16384 2024-08-31T06:14:34.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b6804b740 1 Processor -- start 2024-08-31T06:14:34.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b6804b740 1 -- start start 2024-08-31T06:14:34.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433ee3390 0x55b4342b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433f04070 0x55b4342ac410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b6804b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c1b1710 con 0x55b433edb1b0 2024-08-31T06:14:34.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b6804b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c1b3460 con 0x55b433f04070 2024-08-31T06:14:34.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b6804b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c1b1de0 con 0x55b433ee3390 2024-08-31T06:14:34.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b5b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b5b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53018/0 (socket says 172.21.15.53:53018) 2024-08-31T06:14:34.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b5b7fe640 1 -- 172.21.15.53:0/264415913 learned_addr learned my addr 172.21.15.53:0/264415913 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:34.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.347+0000 7f7b5affd640 1 --2- 172.21.15.53:0/264415913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433ee3390 0x55b4342b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.348+0000 7f7b5b7fe640 1 -- 172.21.15.53:0/264415913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433ee3390 msgr2=0x55b4342b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:34.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.348+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/264415913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433ee3390 0x55b4342b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.348+0000 7f7b5b7fe640 1 -- 172.21.15.53:0/264415913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433f04070 msgr2=0x55b4342ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:34.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.348+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/264415913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433f04070 0x55b4342ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.348+0000 7f7b5b7fe640 1 -- 172.21.15.53:0/264415913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4342b2f70 con 0x55b433edb1b0 2024-08-31T06:14:34.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.348+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/264415913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342b32f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c013e80 tx=0x7f7b4c013db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d0800515c9a2a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:34.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.348+0000 7f7b417fa640 1 -- 172.21.15.53:0/264415913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c017040 con 0x55b433edb1b0 2024-08-31T06:14:34.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.348+0000 7f7b417fa640 1 -- 172.21.15.53:0/264415913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b4c028030 con 0x55b433edb1b0 2024-08-31T06:14:34.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.348+0000 7f7b417fa640 1 -- 172.21.15.53:0/264415913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c0257c0 con 0x55b433edb1b0 2024-08-31T06:14:34.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.349+0000 7f7b6804b740 1 -- 172.21.15.53:0/264415913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 msgr2=0x55b4342b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:34.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.349+0000 7f7b6804b740 1 --2- 172.21.15.53:0/264415913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342b32f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c013e80 tx=0x7f7b4c013db0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.349+0000 7f7b6804b740 1 -- 172.21.15.53:0/264415913 shutdown_connections 2024-08-31T06:14:34.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.349+0000 7f7b6804b740 1 --2- 172.21.15.53:0/264415913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433f04070 0x55b4342ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.349+0000 7f7b6804b740 1 --2- 172.21.15.53:0/264415913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433ee3390 0x55b4342b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.349+0000 7f7b6804b740 1 --2- 172.21.15.53:0/264415913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433edb1b0 0x55b4342b32f0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.349+0000 7f7b6804b740 1 -- 172.21.15.53:0/264415913 >> 172.21.15.53:0/264415913 conn(0x55b433ef8460 msgr2=0x55b4342afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:34.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.349+0000 7f7b6804b740 1 -- 172.21.15.53:0/264415913 shutdown_connections 2024-08-31T06:14:34.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.349+0000 7f7b6804b740 1 -- 172.21.15.53:0/264415913 wait complete. 2024-08-31T06:14:34.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.349+0000 7f7b6804b740 1 -- start start 2024-08-31T06:14:34.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.349+0000 7f7b6804b740 1 Processor -- start 2024-08-31T06:14:34.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433edb1b0 0x55b4342bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433ee3390 0x55b4342b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b6804b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433f04070 0x55b4342b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b6804b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c1b2cd0 con 0x55b433f04070 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b6804b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c1b2570 con 0x55b433edb1b0 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b6804b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c1af710 con 0x55b433ee3390 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b6804b740 10 client.0 _ll_register_callbacks cb 0x7f7b500ab480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433f04070 0x55b4342b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433f04070 0x55b4342b8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53020/0 (socket says 172.21.15.53:53020) 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433ee3390 0x55b4342b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5bfff640 1 -- 172.21.15.53:0/3965589742 learned_addr learned my addr 172.21.15.53:0/3965589742 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433edb1b0 0x55b4342bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5affd640 1 -- 172.21.15.53:0/3965589742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433edb1b0 msgr2=0x55b4342bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5affd640 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433edb1b0 0x55b4342bd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5affd640 1 -- 172.21.15.53:0/3965589742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433f04070 msgr2=0x55b4342b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5affd640 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433f04070 0x55b4342b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5affd640 1 -- 172.21.15.53:0/3965589742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4342b9460 con 0x55b433ee3390 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5bfff640 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433f04070 0x55b4342b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b5affd640 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433ee3390 0x55b4342b88b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7b500ab390 tx=0x7f7b50010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a3ed5f8bda9a825 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.350+0000 7f7b3affd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b3affd640 1 -- 172.21.15.53:0/3965589742 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b50021070 con 0x55b433ee3390 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b6804b740 1 -- 172.21.15.53:0/3965589742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b4c028030 con 0x55b433ee3390 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b3affd640 1 -- 172.21.15.53:0/3965589742 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f7b500a7c80 con 0x55b433ee3390 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b3affd640 1 -- 172.21.15.53:0/3965589742 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f7b500abd90 con 0x55b433ee3390 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b6804b740 10 client.27817 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b6804b740 1 -- 172.21.15.53:0/3965589742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b434331700 con 0x55b433ee3390 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b3affd640 1 -- 172.21.15.53:0/3965589742 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b4c028030 con 0x55b433ee3390 2024-08-31T06:14:34.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b3affd640 1 -- 172.21.15.53:0/3965589742 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f7b500d21a0 con 0x55b433ee3390 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b6804b740 10 client.27817 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b6804b740 10 client.27817 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b6804b740 20 client.27817 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b6804b740 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b433e97da0 0x55b434333e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b6804b740 4 client.27817 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.351+0000 7f7b6804b740 1 -- 172.21.15.53:0/3965589742 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b43421e070 con 0x55b433e97da0 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b433e97da0 0x55b434333e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b3affd640 10 client.27817 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b5b7fe640 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b433e97da0 0x55b434333e50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cacb10cf08502957 server_cookie=db69739ae2a72d5b in_seq=0 out_seq=0 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b3affd640 1 -- 172.21.15.53:0/3965589742 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b43421e070 con 0x55b433e97da0 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b3affd640 10 client.27817 handle_command_reply: tid=0 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b6804b740 1 client.27817 shutdown 2024-08-31T06:14:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b6804b740 1 -- 172.21.15.53:0/3965589742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433ee3390 msgr2=0x55b4342b88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b6804b740 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433ee3390 0x55b4342b88b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7b500ab390 tx=0x7f7b50010000 comp rx=0 tx=0).stop 2024-08-31T06:14:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b6804b740 1 -- 172.21.15.53:0/3965589742 shutdown_connections 2024-08-31T06:14:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b6804b740 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b433e97da0 0x55b434333e50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b6804b740 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b433f04070 0x55b4342b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b3affd640 0 client.27817 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:14:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.352+0000 7f7b6804b740 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b433ee3390 0x55b4342b88b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b6804b740 1 --2- 172.21.15.53:0/3965589742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b433edb1b0 0x55b4342bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b6804b740 1 -- 172.21.15.53:0/3965589742 >> 172.21.15.53:0/3965589742 conn(0x55b433ef8460 msgr2=0x55b4342b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b6804b740 1 -- 172.21.15.53:0/3965589742 shutdown_connections 2024-08-31T06:14:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b6804b740 1 -- 172.21.15.53:0/3965589742 wait complete. 2024-08-31T06:14:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b6804b740 20 client.27817 trim_cache size 0 max 16384 2024-08-31T06:14:34.369 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:14:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b61ad6640 1 -- 172.21.15.53:0/192220068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b440b4ca0 msgr2=0x7f7b440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b61ad6640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b440b4ca0 0x7f7b440b71b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7b54031040 tx=0x7f7b54005c30 comp rx=0 tx=0).stop 2024-08-31T06:14:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b61ad6640 1 -- 172.21.15.53:0/192220068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b5c109240 msgr2=0x7f7b5c0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b61ad6640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b5c109240 0x7f7b5c0759f0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000d740 tx=0x7f7b5000db40 comp rx=0 tx=0).stop 2024-08-31T06:14:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b61ad6640 1 -- 172.21.15.53:0/192220068 shutdown_connections 2024-08-31T06:14:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b61ad6640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b440b4ca0 0x7f7b440b71b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b61ad6640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b5c109b90 0x7f7b5c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b61ad6640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b5c109240 0x7f7b5c0759f0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b61ad6640 1 --2- 172.21.15.53:0/192220068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b5c103900 0x7f7b5c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.353+0000 7f7b61ad6640 1 -- 172.21.15.53:0/192220068 >> 172.21.15.53:0/192220068 conn(0x7f7b5c07b5f0 msgr2=0x7f7b5c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.354+0000 7f7b61ad6640 1 -- 172.21.15.53:0/192220068 shutdown_connections 2024-08-31T06:14:34.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:34.354+0000 7f7b61ad6640 1 -- 172.21.15.53:0/192220068 wait complete. 2024-08-31T06:14:34.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.56 MB/sec execute 384 sec latency 4941.112 ms 2024-08-31T06:14:35.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:14:35.346 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:35.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:35 smithi053 ceph-mon[18924]: pgmap v620: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 999 KiB/s wr, 110 op/s 2024-08-31T06:14:35.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.823+0000 7ff63926d640 1 -- 172.21.15.53:0/1731323593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff634103900 msgr2=0x7ff634103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:35.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.823+0000 7ff63926d640 1 --2- 172.21.15.53:0/1731323593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff634103900 0x7ff634103d10 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7ff624009900 tx=0x7ff62402a410 comp rx=0 tx=0).stop 2024-08-31T06:14:35.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.823+0000 7ff63926d640 1 -- 172.21.15.53:0/1731323593 shutdown_connections 2024-08-31T06:14:35.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.823+0000 7ff63926d640 1 --2- 172.21.15.53:0/1731323593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff634109b90 0x7ff6341103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.823+0000 7ff63926d640 1 --2- 172.21.15.53:0/1731323593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff634109240 0x7ff634109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.823+0000 7ff63926d640 1 --2- 172.21.15.53:0/1731323593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff634103900 0x7ff634103d10 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.823+0000 7ff63926d640 1 -- 172.21.15.53:0/1731323593 >> 172.21.15.53:0/1731323593 conn(0x7ff63407b5f0 msgr2=0x7ff63407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:35.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.823+0000 7ff63926d640 1 -- 172.21.15.53:0/1731323593 shutdown_connections 2024-08-31T06:14:35.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.823+0000 7ff63926d640 1 -- 172.21.15.53:0/1731323593 wait complete. 2024-08-31T06:14:35.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.824+0000 7ff63926d640 1 Processor -- start 2024-08-31T06:14:35.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.824+0000 7ff63926d640 1 -- start start 2024-08-31T06:14:35.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.824+0000 7ff63926d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff634103900 0x7ff63419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.824+0000 7ff63926d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff634109240 0x7ff63419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.824+0000 7ff63926d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff634109b90 0x7ff63419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.824+0000 7ff63926d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff634113700 con 0x7ff634109240 2024-08-31T06:14:35.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff63926d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff634113580 con 0x7ff634103900 2024-08-31T06:14:35.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff63926d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff634113880 con 0x7ff634109b90 2024-08-31T06:14:35.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff6327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff634109240 0x7ff63419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff6327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff634109240 0x7ff63419a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53038/0 (socket says 172.21.15.53:53038) 2024-08-31T06:14:35.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff6327fc640 1 -- 172.21.15.53:0/1624731051 learned_addr learned my addr 172.21.15.53:0/1624731051 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:35.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff632ffd640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff634103900 0x7ff63419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff6337fe640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff634109b90 0x7ff63419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff6327fc640 1 -- 172.21.15.53:0/1624731051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff634109b90 msgr2=0x7ff63419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:35.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff6327fc640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff634109b90 0x7ff63419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff6327fc640 1 -- 172.21.15.53:0/1624731051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff634103900 msgr2=0x7ff63419a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:35.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff6327fc640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff634103900 0x7ff63419a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff6327fc640 1 -- 172.21.15.53:0/1624731051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6341a0160 con 0x7ff634109240 2024-08-31T06:14:35.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff6327fc640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff634109240 0x7ff63419a790 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7ff62800d740 tx=0x7ff62800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:35.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff61bfff640 1 -- 172.21.15.53:0/1624731051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628017070 con 0x7ff634109240 2024-08-31T06:14:35.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff63926d640 1 -- 172.21.15.53:0/1624731051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6341a0450 con 0x7ff634109240 2024-08-31T06:14:35.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff61bfff640 1 -- 172.21.15.53:0/1624731051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff62800de50 con 0x7ff634109240 2024-08-31T06:14:35.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.825+0000 7ff61bfff640 1 -- 172.21.15.53:0/1624731051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62800f620 con 0x7ff634109240 2024-08-31T06:14:35.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.826+0000 7ff63926d640 1 -- 172.21.15.53:0/1624731051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6341a6bb0 con 0x7ff634109240 2024-08-31T06:14:35.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.828+0000 7ff63f7e2740 1 Processor -- start 2024-08-31T06:14:35.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.828+0000 7ff61bfff640 1 -- 172.21.15.53:0/1624731051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff62801a070 con 0x7ff634109240 2024-08-31T06:14:35.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.828+0000 7ff63f7e2740 1 -- start start 2024-08-31T06:14:35.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 0x55894c9e3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c6151b0 0x55894c9e3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c61d390 0x55894c9e3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55894c95a680 con 0x55894c61d390 2024-08-31T06:14:35.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55894c949c10 con 0x55894c63e070 2024-08-31T06:14:35.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55894c94dbc0 con 0x55894c6151b0 2024-08-31T06:14:35.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff6327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c61d390 0x55894c9e3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff6327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c61d390 0x55894c9e3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53040/0 (socket says 172.21.15.53:53040) 2024-08-31T06:14:35.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff6327fc640 1 -- 172.21.15.53:0/694588813 learned_addr learned my addr 172.21.15.53:0/694588813 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:35.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff6337fe640 1 --2- 172.21.15.53:0/694588813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 0x55894c9e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff632ffd640 1 --2- 172.21.15.53:0/694588813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c6151b0 0x55894c9e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff61bfff640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff61c0b4d20 0x7ff61c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff6327fc640 1 -- 172.21.15.53:0/694588813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c6151b0 msgr2=0x55894c9e3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:35.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff6327fc640 1 --2- 172.21.15.53:0/694588813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c6151b0 0x55894c9e3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff6327fc640 1 -- 172.21.15.53:0/694588813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 msgr2=0x55894c9e3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:35.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff6327fc640 1 --2- 172.21.15.53:0/694588813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 0x55894c9e3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff6327fc640 1 -- 172.21.15.53:0/694588813 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894c6a9650 con 0x55894c61d390 2024-08-31T06:14:35.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff6337fe640 1 --2- 172.21.15.53:0/694588813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 0x55894c9e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:35.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.829+0000 7ff6337fe640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff61c0b4d20 0x7ff61c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.830+0000 7ff61bfff640 1 -- 172.21.15.53:0/1624731051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7ff6280e4f00 con 0x7ff634109240 2024-08-31T06:14:35.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.830+0000 7ff6327fc640 1 --2- 172.21.15.53:0/694588813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c61d390 0x55894c9e3dd0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7ff6280e25a0 tx=0x7ff628023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2b7a265a16d667 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:35.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.830+0000 7ff6197fa640 1 -- 172.21.15.53:0/694588813 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6280ab3a0 con 0x55894c61d390 2024-08-31T06:14:35.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.830+0000 7ff6337fe640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff61c0b4d20 0x7ff61c0b7230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0113e0 tx=0x7ff62c004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:35.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.830+0000 7ff6197fa640 1 -- 172.21.15.53:0/694588813 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6280ab0e0 con 0x55894c61d390 2024-08-31T06:14:35.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.830+0000 7ff6197fa640 1 -- 172.21.15.53:0/694588813 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6280aad40 con 0x55894c61d390 2024-08-31T06:14:35.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.831+0000 7ff63f7e2740 1 -- 172.21.15.53:0/694588813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c61d390 msgr2=0x55894c9e3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:35.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.831+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/694588813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c61d390 0x55894c9e3dd0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7ff6280e25a0 tx=0x7ff628023000 comp rx=0 tx=0).stop 2024-08-31T06:14:35.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.831+0000 7ff63f7e2740 1 -- 172.21.15.53:0/694588813 shutdown_connections 2024-08-31T06:14:35.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.831+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/694588813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c61d390 0x55894c9e3dd0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.831+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/694588813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c6151b0 0x55894c9e3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.831+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/694588813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 0x55894c9e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.831+0000 7ff63f7e2740 1 -- 172.21.15.53:0/694588813 >> 172.21.15.53:0/694588813 conn(0x55894c632460 msgr2=0x55894c9e1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:35.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.831+0000 7ff63f7e2740 1 -- 172.21.15.53:0/694588813 shutdown_connections 2024-08-31T06:14:35.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.831+0000 7ff63f7e2740 1 -- 172.21.15.53:0/694588813 wait complete. 2024-08-31T06:14:35.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff63f7e2740 1 -- start start 2024-08-31T06:14:35.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff63f7e2740 1 Processor -- start 2024-08-31T06:14:35.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c6151b0 0x55894c9f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c61d390 0x55894c9f3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 0x55894c9ff160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55894c7ac700 con 0x55894c6151b0 2024-08-31T06:14:35.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55894c8d0750 con 0x55894c63e070 2024-08-31T06:14:35.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55894c9f5e30 con 0x55894c61d390 2024-08-31T06:14:35.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff63f7e2740 10 client.0 _ll_register_callbacks cb 0x55894c8ffe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:35.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff632ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c6151b0 0x55894c9f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff632ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c6151b0 0x55894c9f2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53046/0 (socket says 172.21.15.53:53046) 2024-08-31T06:14:35.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff632ffd640 1 -- 172.21.15.53:0/3281939435 learned_addr learned my addr 172.21.15.53:0/3281939435 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:35.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff6327fc640 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c61d390 0x55894c9f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.832+0000 7ff6337fe640 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 0x55894c9ff160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff632ffd640 1 -- 172.21.15.53:0/3281939435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c61d390 msgr2=0x55894c9f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff632ffd640 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c61d390 0x55894c9f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff632ffd640 1 -- 172.21.15.53:0/3281939435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 msgr2=0x55894c9ff160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff632ffd640 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 0x55894c9ff160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff632ffd640 1 -- 172.21.15.53:0/3281939435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55894c909900 con 0x55894c6151b0 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff6337fe640 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 0x55894c9ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff632ffd640 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c6151b0 0x55894c9f2f30 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7ff62402a930 tx=0x7ff624031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92182b1a990d668f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff616ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff616ff5640 1 -- 172.21.15.53:0/3281939435 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624035040 con 0x55894c6151b0 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff616ff5640 1 -- 172.21.15.53:0/3281939435 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7ff624004240 con 0x55894c6151b0 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3281939435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6280ab0e0 con 0x55894c6151b0 2024-08-31T06:14:35.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff616ff5640 1 -- 172.21.15.53:0/3281939435 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7ff624004440 con 0x55894c6151b0 2024-08-31T06:14:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff63f7e2740 10 client.18618 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3281939435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55894ca01be0 con 0x55894c6151b0 2024-08-31T06:14:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.833+0000 7ff616ff5640 1 -- 172.21.15.53:0/3281939435 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6280ab0e0 con 0x55894c6151b0 2024-08-31T06:14:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.834+0000 7ff616ff5640 1 -- 172.21.15.53:0/3281939435 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7ff624044020 con 0x55894c6151b0 2024-08-31T06:14:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.834+0000 7ff63f7e2740 10 client.18618 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.834+0000 7ff63f7e2740 10 client.18618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.834+0000 7ff63f7e2740 20 client.18618 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.834+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894c5fc9f0 0x55894ca050e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.834+0000 7ff63f7e2740 4 client.18618 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.834+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3281939435 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55894c95c5d0 con 0x55894c5fc9f0 2024-08-31T06:14:35.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.834+0000 7ff6327fc640 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894c5fc9f0 0x55894ca050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.834+0000 7ff616ff5640 10 client.18618 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.834+0000 7ff6327fc640 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894c5fc9f0 0x55894ca050e0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=384d6921632d453c server_cookie=9a5e06f5bcc04eff in_seq=0 out_seq=0 2024-08-31T06:14:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.835+0000 7ff616ff5640 1 -- 172.21.15.53:0/3281939435 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55894c95c5d0 con 0x55894c5fc9f0 2024-08-31T06:14:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.835+0000 7ff616ff5640 10 client.18618 handle_command_reply: tid=0 2024-08-31T06:14:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.835+0000 7ff63f7e2740 1 client.18618 shutdown 2024-08-31T06:14:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.835+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3281939435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c6151b0 msgr2=0x55894c9f2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.835+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c6151b0 0x55894c9f2f30 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7ff62402a930 tx=0x7ff624031400 comp rx=0 tx=0).stop 2024-08-31T06:14:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.836+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3281939435 shutdown_connections 2024-08-31T06:14:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.836+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894c5fc9f0 0x55894ca050e0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.836+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c63e070 0x55894c9ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.836+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c61d390 0x55894c9f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.836+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3281939435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c6151b0 0x55894c9f2f30 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.836+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3281939435 >> 172.21.15.53:0/3281939435 conn(0x55894c632460 msgr2=0x55894c9df800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.836+0000 7ff616ff5640 0 client.18618 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.836+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3281939435 shutdown_connections 2024-08-31T06:14:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.836+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3281939435 wait complete. 2024-08-31T06:14:35.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.836+0000 7ff63f7e2740 20 client.18618 trim_cache size 0 max 16384 2024-08-31T06:14:35.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff63f7e2740 1 Processor -- start 2024-08-31T06:14:35.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff63f7e2740 1 -- start start 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894c9e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c6151b0 0x55894c9ff060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c61d390 0x55894c9f0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff6341ad340 con 0x55894c632460 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6341af090 con 0x55894c61d390 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6341ada10 con 0x55894c6151b0 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff632ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894c9e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff632ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894c9e12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53058/0 (socket says 172.21.15.53:53058) 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff632ffd640 1 -- 172.21.15.53:0/1972513245 learned_addr learned my addr 172.21.15.53:0/1972513245 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff6327fc640 1 --2- 172.21.15.53:0/1972513245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c6151b0 0x55894c9ff060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.849+0000 7ff6337fe640 1 --2- 172.21.15.53:0/1972513245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c61d390 0x55894c9f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.850+0000 7ff632ffd640 1 -- 172.21.15.53:0/1972513245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c6151b0 msgr2=0x55894c9ff060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.850+0000 7ff632ffd640 1 --2- 172.21.15.53:0/1972513245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c6151b0 0x55894c9ff060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.850+0000 7ff632ffd640 1 -- 172.21.15.53:0/1972513245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c61d390 msgr2=0x55894c9f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.850+0000 7ff632ffd640 1 --2- 172.21.15.53:0/1972513245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c61d390 0x55894c9f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.850+0000 7ff632ffd640 1 -- 172.21.15.53:0/1972513245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894c9e1b30 con 0x55894c632460 2024-08-31T06:14:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.850+0000 7ff6327fc640 1 --2- 172.21.15.53:0/1972513245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c6151b0 0x55894c9ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.850+0000 7ff632ffd640 1 --2- 172.21.15.53:0/1972513245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894c9e12b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7ff624006010 tx=0x7ff62402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb71bf95640795b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.850+0000 7ff618ff9640 1 -- 172.21.15.53:0/1972513245 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624035040 con 0x55894c632460 2024-08-31T06:14:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.850+0000 7ff618ff9640 1 -- 172.21.15.53:0/1972513245 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff62404f950 con 0x55894c632460 2024-08-31T06:14:35.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.850+0000 7ff618ff9640 1 -- 172.21.15.53:0/1972513245 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62403c6a0 con 0x55894c632460 2024-08-31T06:14:35.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 -- 172.21.15.53:0/1972513245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 msgr2=0x55894c9e12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:35.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/1972513245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894c9e12b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7ff624006010 tx=0x7ff62402a410 comp rx=0 tx=0).stop 2024-08-31T06:14:35.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 -- 172.21.15.53:0/1972513245 shutdown_connections 2024-08-31T06:14:35.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/1972513245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c61d390 0x55894c9f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/1972513245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c6151b0 0x55894c9ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/1972513245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894c9e12b0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 -- 172.21.15.53:0/1972513245 >> 172.21.15.53:0/1972513245 conn(0x55894c9ee880 msgr2=0x55894c9e0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 -- 172.21.15.53:0/1972513245 shutdown_connections 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 -- 172.21.15.53:0/1972513245 wait complete. 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 -- start start 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 Processor -- start 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c6151b0 0x55894c9f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c61d390 0x55894c9f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.851+0000 7ff63f7e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894ca6eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff6341ae900 con 0x55894c632460 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6341ae1a0 con 0x55894c6151b0 2024-08-31T06:14:35.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff63f7e2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6341ab340 con 0x55894c61d390 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff63f7e2740 10 client.0 _ll_register_callbacks cb 0x7ff624031a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff6337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894ca6eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff6337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894ca6eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53072/0 (socket says 172.21.15.53:53072) 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff6337fe640 1 -- 172.21.15.53:0/3721499529 learned_addr learned my addr 172.21.15.53:0/3721499529 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff6327fc640 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c61d390 0x55894c9f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff632ffd640 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c6151b0 0x55894c9f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff6337fe640 1 -- 172.21.15.53:0/3721499529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c61d390 msgr2=0x55894c9f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff6337fe640 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c61d390 0x55894c9f7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff6337fe640 1 -- 172.21.15.53:0/3721499529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c6151b0 msgr2=0x55894c9f78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff6337fe640 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c6151b0 0x55894c9f78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff6337fe640 1 -- 172.21.15.53:0/3721499529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55894ca6f1a0 con 0x55894c632460 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff632ffd640 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c6151b0 0x55894c9f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:35.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff6337fe640 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894ca6eb30 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7ff62c012f90 tx=0x7ff62c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3db59f9bc76bc8a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff616ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff616ff5640 1 -- 172.21.15.53:0/3721499529 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c01d660 con 0x55894c632460 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff616ff5640 1 -- 172.21.15.53:0/3721499529 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7ff62c01d800 con 0x55894c632460 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.852+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3721499529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff62404f950 con 0x55894c632460 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff616ff5640 1 -- 172.21.15.53:0/3721499529 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7ff62c01da00 con 0x55894c632460 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff63f7e2740 10 client.18624 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3721499529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55894ca70490 con 0x55894c632460 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff616ff5640 1 -- 172.21.15.53:0/3721499529 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff62404f950 con 0x55894c632460 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff616ff5640 1 -- 172.21.15.53:0/3721499529 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7ff62c029cc0 con 0x55894c632460 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff63f7e2740 10 client.18624 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff63f7e2740 10 client.18624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff63f7e2740 20 client.18624 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894c63e070 0x55894ca72d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:35.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff63f7e2740 4 client.18624 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3721499529 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55894c958070 con 0x55894c63e070 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.853+0000 7ff632ffd640 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894c63e070 0x55894ca72d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff632ffd640 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894c63e070 0x55894ca72d90 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=678beed509abbb07 server_cookie=876213975262450f in_seq=0 out_seq=0 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff616ff5640 10 client.18624 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff616ff5640 1 -- 172.21.15.53:0/3721499529 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55894c958070 con 0x55894c63e070 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff616ff5640 10 client.18624 handle_command_reply: tid=0 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff63f7e2740 1 client.18624 shutdown 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3721499529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 msgr2=0x55894ca6eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894ca6eb30 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7ff62c012f90 tx=0x7ff62c004ab0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3721499529 shutdown_connections 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55894c63e070 0x55894ca72d90 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55894c632460 0x55894ca6eb30 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55894c61d390 0x55894c9f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff63f7e2740 1 --2- 172.21.15.53:0/3721499529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55894c6151b0 0x55894c9f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3721499529 >> 172.21.15.53:0/3721499529 conn(0x55894c9ee880 msgr2=0x55894c9e4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:35.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff616ff5640 0 client.18624 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:35.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3721499529 shutdown_connections 2024-08-31T06:14:35.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.854+0000 7ff63f7e2740 1 -- 172.21.15.53:0/3721499529 wait complete. 2024-08-31T06:14:35.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63f7e2740 20 client.18624 trim_cache size 0 max 16384 2024-08-31T06:14:35.862 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:14:35.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 -- 172.21.15.53:0/1624731051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff61c0b4d20 msgr2=0x7ff61c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:35.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff61c0b4d20 0x7ff61c0b7230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0113e0 tx=0x7ff62c004a40 comp rx=0 tx=0).stop 2024-08-31T06:14:35.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 -- 172.21.15.53:0/1624731051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff634109240 msgr2=0x7ff63419a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:35.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff634109240 0x7ff63419a790 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7ff62800d740 tx=0x7ff62800dc00 comp rx=0 tx=0).stop 2024-08-31T06:14:35.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 -- 172.21.15.53:0/1624731051 shutdown_connections 2024-08-31T06:14:35.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff61c0b4d20 0x7ff61c0b7230 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff634109b90 0x7ff63419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff634109240 0x7ff63419a790 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 --2- 172.21.15.53:0/1624731051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff634103900 0x7ff63419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:35.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 -- 172.21.15.53:0/1624731051 >> 172.21.15.53:0/1624731051 conn(0x7ff63407b5f0 msgr2=0x7ff6341073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:35.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 -- 172.21.15.53:0/1624731051 shutdown_connections 2024-08-31T06:14:35.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:35.855+0000 7ff63926d640 1 -- 172.21.15.53:0/1624731051 wait complete. 2024-08-31T06:14:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:35 smithi130 ceph-mon[22266]: pgmap v620: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 999 KiB/s wr, 110 op/s 2024-08-31T06:14:35.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:35 smithi153 ceph-mon[22320]: pgmap v620: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 999 KiB/s wr, 110 op/s 2024-08-31T06:14:35.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.55 MB/sec execute 385 sec latency 5941.175 ms 2024-08-31T06:14:36.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.55 MB/sec execute 386 sec latency 6941.231 ms 2024-08-31T06:14:37.587 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:14:37.587 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:14:37.855 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:37.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:37 smithi130 ceph-mon[22266]: pgmap v621: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 828 KiB/s wr, 85 op/s 2024-08-31T06:14:37.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:37 smithi153 ceph-mon[22320]: pgmap v621: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 828 KiB/s wr, 85 op/s 2024-08-31T06:14:37.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:37 smithi053 ceph-mon[18924]: pgmap v621: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 828 KiB/s wr, 85 op/s 2024-08-31T06:14:37.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.55 MB/sec execute 387 sec latency 7941.282 ms 2024-08-31T06:14:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.259+0000 7f38b0036640 1 -- 172.21.15.53:0/3129775500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a810db00 msgr2=0x7f38a8110010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.259+0000 7f38b0036640 1 --2- 172.21.15.53:0/3129775500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a810db00 0x7f38a8110010 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009ca0 tx=0x7f38a002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.259+0000 7f38b0036640 1 -- 172.21.15.53:0/3129775500 shutdown_connections 2024-08-31T06:14:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.259+0000 7f38b0036640 1 --2- 172.21.15.53:0/3129775500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a810db00 0x7f38a8110010 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.259+0000 7f38b0036640 1 --2- 172.21.15.53:0/3129775500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38a8105080 0x7f38a810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.259+0000 7f38b0036640 1 --2- 172.21.15.53:0/3129775500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a8104730 0x7f38a8104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.259+0000 7f38b0036640 1 -- 172.21.15.53:0/3129775500 >> 172.21.15.53:0/3129775500 conn(0x7f38a807a480 msgr2=0x7f38a807a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.259+0000 7f38b0036640 1 -- 172.21.15.53:0/3129775500 shutdown_connections 2024-08-31T06:14:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.259+0000 7f38b0036640 1 -- 172.21.15.53:0/3129775500 wait complete. 2024-08-31T06:14:38.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.260+0000 7f38b0036640 1 Processor -- start 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.260+0000 7f38b0036640 1 -- start start 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.260+0000 7f38b0036640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a8104730 0x7f38a8102460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.260+0000 7f38b0036640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a8105080 0x7f38a81029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.260+0000 7f38b0036640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38a810db00 0x7f38a8102ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.260+0000 7f38b0036640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38a8113690 con 0x7f38a8105080 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.260+0000 7f38b0036640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38a8113510 con 0x7f38a810db00 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.260+0000 7f38b0036640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38a8113810 con 0x7f38a8104730 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38ad5d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a8105080 0x7f38a81029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38ad5d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a8105080 0x7f38a81029a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53088/0 (socket says 172.21.15.53:53088) 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38ad5d1640 1 -- 172.21.15.53:0/1592448004 learned_addr learned my addr 172.21.15.53:0/1592448004 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38addd2640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a8104730 0x7f38a8102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38ae5d3640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38a810db00 0x7f38a8102ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38ad5d1640 1 -- 172.21.15.53:0/1592448004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a8104730 msgr2=0x7f38a8102460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a8104730 0x7f38a8102460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38ad5d1640 1 -- 172.21.15.53:0/1592448004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38a810db00 msgr2=0x7f38a8102ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38a810db00 0x7f38a8102ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38ad5d1640 1 -- 172.21.15.53:0/1592448004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a81a82a0 con 0x7f38a8105080 2024-08-31T06:14:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a8105080 0x7f38a81029a0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f389800c970 tx=0x7f389800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f389effd640 1 -- 172.21.15.53:0/1592448004 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898014070 con 0x7f38a8105080 2024-08-31T06:14:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f389effd640 1 -- 172.21.15.53:0/1592448004 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3898004440 con 0x7f38a8105080 2024-08-31T06:14:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f38b0036640 1 -- 172.21.15.53:0/1592448004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a81a8590 con 0x7f38a8105080 2024-08-31T06:14:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.261+0000 7f389effd640 1 -- 172.21.15.53:0/1592448004 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898003d40 con 0x7f38a8105080 2024-08-31T06:14:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.262+0000 7f38b0036640 1 -- 172.21.15.53:0/1592448004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a81a8b30 con 0x7f38a8105080 2024-08-31T06:14:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.264+0000 7f38b7076740 1 Processor -- start 2024-08-31T06:14:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.264+0000 7f38b7076740 1 -- start start 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38b7076740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9ec81b0 0x55c0da26bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38b7076740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 0x55c0da26c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38b7076740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9ea74d0 0x55c0da26c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38b7076740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0da1e1000 con 0x55c0d9ea74d0 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38b7076740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c0da1d0590 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38b7076740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c0da1d4540 con 0x55c0d9ec81b0 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38addd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 0x55c0da26c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38addd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 0x55c0da26c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38600/0 (socket says 172.21.15.53:38600) 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38addd2640 1 -- 172.21.15.53:0/957119511 learned_addr learned my addr 172.21.15.53:0/957119511 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38ae5d3640 1 --2- 172.21.15.53:0/957119511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9ec81b0 0x55c0da26bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38addd2640 1 -- 172.21.15.53:0/957119511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9ec81b0 msgr2=0x55c0da26bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38addd2640 1 --2- 172.21.15.53:0/957119511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9ec81b0 0x55c0da26bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38addd2640 1 -- 172.21.15.53:0/957119511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9ea74d0 msgr2=0x55c0da26c540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:14:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38addd2640 1 --2- 172.21.15.53:0/957119511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9ea74d0 0x55c0da26c540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f38addd2640 1 -- 172.21.15.53:0/957119511 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d9f33790 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.265+0000 7f389effd640 1 -- 172.21.15.53:0/1592448004 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3898017070 con 0x7f38a8105080 2024-08-31T06:14:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.266+0000 7f38addd2640 1 --2- 172.21.15.53:0/957119511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 0x55c0da26c000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f38a400b710 tx=0x7f38a400bbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc034d61c990f67f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.266+0000 7f3893fff640 1 -- 172.21.15.53:0/957119511 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4003dd0 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.266+0000 7f3893fff640 1 -- 172.21.15.53:0/957119511 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38a4015070 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.266+0000 7f3893fff640 1 -- 172.21.15.53:0/957119511 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4004bf0 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.266+0000 7f389effd640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38940b4d20 0x7f38940b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.266+0000 7f38ae5d3640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38940b4d20 0x7f38940b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.266+0000 7f389effd640 1 -- 172.21.15.53:0/1592448004 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f38980e5330 con 0x7f38a8105080 2024-08-31T06:14:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.267+0000 7f38ae5d3640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38940b4d20 0x7f38940b7230 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f38a0006010 tx=0x7f38a0009800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.267+0000 7f38b7076740 1 -- 172.21.15.53:0/957119511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 msgr2=0x55c0da26c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.267+0000 7f38b7076740 1 --2- 172.21.15.53:0/957119511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 0x55c0da26c000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f38a400b710 tx=0x7f38a400bbd0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.267+0000 7f38b7076740 1 -- 172.21.15.53:0/957119511 shutdown_connections 2024-08-31T06:14:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.267+0000 7f38b7076740 1 --2- 172.21.15.53:0/957119511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9ea74d0 0x55c0da26c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.267+0000 7f38b7076740 1 --2- 172.21.15.53:0/957119511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 0x55c0da26c000 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.267+0000 7f38b7076740 1 --2- 172.21.15.53:0/957119511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9ec81b0 0x55c0da26bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.267+0000 7f38b7076740 1 -- 172.21.15.53:0/957119511 >> 172.21.15.53:0/957119511 conn(0x55c0d9ebc300 msgr2=0x55c0da2699b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.267+0000 7f38b7076740 1 -- 172.21.15.53:0/957119511 shutdown_connections 2024-08-31T06:14:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.267+0000 7f38b7076740 1 -- 172.21.15.53:0/957119511 wait complete. 2024-08-31T06:14:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.267+0000 7f38b7076740 1 -- start start 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38b7076740 1 Processor -- start 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38b7076740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9e9f2f0 0x55c0da2776e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38b7076740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9ea74d0 0x55c0da277c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38b7076740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9ec81b0 0x55c0da283560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38b7076740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0da109ab0 con 0x55c0d9ea74d0 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38b7076740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c0da157680 con 0x55c0d9ec81b0 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38b7076740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c0da27a240 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38b7076740 10 client.0 _ll_register_callbacks cb 0x55c0d9edfa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38ad5d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9ea74d0 0x55c0da277c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38ad5d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9ea74d0 0x55c0da277c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53096/0 (socket says 172.21.15.53:53096) 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38ad5d1640 1 -- 172.21.15.53:0/4149484787 learned_addr learned my addr 172.21.15.53:0/4149484787 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38addd2640 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9e9f2f0 0x55c0da2776e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.268+0000 7f38ae5d3640 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9ec81b0 0x55c0da283560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38ad5d1640 1 -- 172.21.15.53:0/4149484787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9e9f2f0 msgr2=0x55c0da2776e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9e9f2f0 0x55c0da2776e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38ad5d1640 1 -- 172.21.15.53:0/4149484787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9ec81b0 msgr2=0x55c0da283560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9ec81b0 0x55c0da283560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38ad5d1640 1 -- 172.21.15.53:0/4149484787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0d9fac620 con 0x55c0d9ea74d0 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9ea74d0 0x55c0da277c60 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f38980ab700 tx=0x7f38980a7190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ed792273a575d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38917fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38917fa640 1 -- 172.21.15.53:0/4149484787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38980b0070 con 0x55c0d9ea74d0 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38917fa640 1 -- 172.21.15.53:0/4149484787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f38980aac60 con 0x55c0d9ea74d0 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38b7076740 1 -- 172.21.15.53:0/4149484787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38a4015070 con 0x55c0d9ea74d0 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38917fa640 1 -- 172.21.15.53:0/4149484787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f38980ce050 con 0x55c0d9ea74d0 2024-08-31T06:14:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38b7076740 10 client.18633 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38b7076740 1 -- 172.21.15.53:0/4149484787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55c0da2862e0 con 0x55c0d9ea74d0 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.269+0000 7f38917fa640 1 -- 172.21.15.53:0/4149484787 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38a4015070 con 0x55c0d9ea74d0 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.270+0000 7f38917fa640 1 -- 172.21.15.53:0/4149484787 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f38980a7370 con 0x55c0d9ea74d0 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.270+0000 7f38b7076740 10 client.18633 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.270+0000 7f38b7076740 10 client.18633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.270+0000 7f38b7076740 20 client.18633 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.270+0000 7f38b7076740 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c0d9e86d80 0x55c0da289830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.270+0000 7f38b7076740 4 client.18633 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.270+0000 7f38b7076740 1 -- 172.21.15.53:0/4149484787 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0da1e2f50 con 0x55c0d9e86d80 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.270+0000 7f38addd2640 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c0d9e86d80 0x55c0da289830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.270+0000 7f38917fa640 10 client.18633 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.270+0000 7f38addd2640 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c0d9e86d80 0x55c0da289830 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d57e5242da9f7bd9 server_cookie=10bbfb4507ec8c1 in_seq=0 out_seq=0 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38917fa640 1 -- 172.21.15.53:0/4149484787 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c0da1e2f50 con 0x55c0d9e86d80 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38917fa640 10 client.18633 handle_command_reply: tid=0 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38b7076740 1 client.18633 shutdown 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38b7076740 1 -- 172.21.15.53:0/4149484787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9ea74d0 msgr2=0x55c0da277c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38b7076740 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9ea74d0 0x55c0da277c60 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f38980ab700 tx=0x7f38980a7190 comp rx=0 tx=0).stop 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38b7076740 1 -- 172.21.15.53:0/4149484787 shutdown_connections 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38b7076740 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c0d9e86d80 0x55c0da289830 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38b7076740 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9ec81b0 0x55c0da283560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38b7076740 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9ea74d0 0x55c0da277c60 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38917fa640 0 client.18633 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38b7076740 1 --2- 172.21.15.53:0/4149484787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9e9f2f0 0x55c0da2776e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.271+0000 7f38b7076740 1 -- 172.21.15.53:0/4149484787 >> 172.21.15.53:0/4149484787 conn(0x55c0d9ebc300 msgr2=0x55c0da26caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.272+0000 7f38b7076740 1 -- 172.21.15.53:0/4149484787 shutdown_connections 2024-08-31T06:14:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.272+0000 7f38b7076740 1 -- 172.21.15.53:0/4149484787 wait complete. 2024-08-31T06:14:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.272+0000 7f38b7076740 20 client.18633 trim_cache size 0 max 16384 2024-08-31T06:14:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.286+0000 7f38b7076740 1 Processor -- start 2024-08-31T06:14:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.286+0000 7f38b7076740 1 -- start start 2024-08-31T06:14:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38b7076740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9e86d80 0x55c0da271290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38b7076740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e9f2f0 0x55c0da2692d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38b7076740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9ea74d0 0x55c0da269810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38b7076740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38a81b15e0 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38b7076740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38a81b3330 con 0x55c0d9ea74d0 2024-08-31T06:14:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38b7076740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38a81b1cb0 con 0x55c0d9e86d80 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38ad5d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e9f2f0 0x55c0da2692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38ad5d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e9f2f0 0x55c0da2692d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53100/0 (socket says 172.21.15.53:53100) 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38ad5d1640 1 -- 172.21.15.53:0/324548909 learned_addr learned my addr 172.21.15.53:0/324548909 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38ae5d3640 1 --2- 172.21.15.53:0/324548909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9ea74d0 0x55c0da269810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38addd2640 1 --2- 172.21.15.53:0/324548909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9e86d80 0x55c0da271290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38ad5d1640 1 -- 172.21.15.53:0/324548909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9e86d80 msgr2=0x55c0da271290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/324548909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9e86d80 0x55c0da271290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38ad5d1640 1 -- 172.21.15.53:0/324548909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9ea74d0 msgr2=0x55c0da269810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/324548909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9ea74d0 0x55c0da269810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38ad5d1640 1 -- 172.21.15.53:0/324548909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0da273050 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38addd2640 1 --2- 172.21.15.53:0/324548909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9e86d80 0x55c0da271290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.287+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/324548909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e9f2f0 0x55c0da2692d0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f38980e5650 tx=0x7f38980a72c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea69b9dedcb09a0c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.288+0000 7f38937fe640 1 -- 172.21.15.53:0/324548909 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38980ab350 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.288+0000 7f38937fe640 1 -- 172.21.15.53:0/324548909 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38980b0030 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.288+0000 7f38937fe640 1 -- 172.21.15.53:0/324548909 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38980aaef0 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.288+0000 7f38b7076740 1 -- 172.21.15.53:0/324548909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e9f2f0 msgr2=0x55c0da2692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.288+0000 7f38b7076740 1 --2- 172.21.15.53:0/324548909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e9f2f0 0x55c0da2692d0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f38980e5650 tx=0x7f38980a72c0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.288+0000 7f38b7076740 1 -- 172.21.15.53:0/324548909 shutdown_connections 2024-08-31T06:14:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.288+0000 7f38b7076740 1 --2- 172.21.15.53:0/324548909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9ea74d0 0x55c0da269810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 --2- 172.21.15.53:0/324548909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e9f2f0 0x55c0da2692d0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 --2- 172.21.15.53:0/324548909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9e86d80 0x55c0da271290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 -- 172.21.15.53:0/324548909 >> 172.21.15.53:0/324548909 conn(0x55c0d9ebc300 msgr2=0x55c0da270b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 -- 172.21.15.53:0/324548909 shutdown_connections 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 -- 172.21.15.53:0/324548909 wait complete. 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 -- start start 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 Processor -- start 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e86d80 0x55c0da27d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 0x55c0da27d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9ea74d0 0x55c0da27de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38a81b2ba0 con 0x55c0d9e86d80 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.289+0000 7f38b7076740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38a81b2440 con 0x55c0d9e9f2f0 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38b7076740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38a81af5e0 con 0x55c0d9ea74d0 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38b7076740 10 client.0 _ll_register_callbacks cb 0x7f3898003ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38addd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e86d80 0x55c0da27d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38addd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e86d80 0x55c0da27d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53108/0 (socket says 172.21.15.53:53108) 2024-08-31T06:14:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38addd2640 1 -- 172.21.15.53:0/3048051502 learned_addr learned my addr 172.21.15.53:0/3048051502 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38ae5d3640 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9ea74d0 0x55c0da27de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 0x55c0da27d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38addd2640 1 -- 172.21.15.53:0/3048051502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9ea74d0 msgr2=0x55c0da27de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38addd2640 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9ea74d0 0x55c0da27de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38addd2640 1 -- 172.21.15.53:0/3048051502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 msgr2=0x55c0da27d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38addd2640 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 0x55c0da27d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38addd2640 1 -- 172.21.15.53:0/3048051502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0da2f31e0 con 0x55c0d9e86d80 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38ae5d3640 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9ea74d0 0x55c0da27de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38addd2640 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e86d80 0x55c0da27d410 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f38a400b710 tx=0x7f38a40040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f910f625ace3c01 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38917fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38917fa640 1 -- 172.21.15.53:0/3048051502 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a402d670 con 0x55c0d9e86d80 2024-08-31T06:14:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38917fa640 1 -- 172.21.15.53:0/3048051502 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f38a402d810 con 0x55c0d9e86d80 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.290+0000 7f38b7076740 1 -- 172.21.15.53:0/3048051502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38980b0030 con 0x55c0d9e86d80 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38917fa640 1 -- 172.21.15.53:0/3048051502 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f38a402da10 con 0x55c0d9e86d80 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38b7076740 10 client.18639 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38b7076740 1 -- 172.21.15.53:0/3048051502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55c0da2f43d0 con 0x55c0d9e86d80 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38917fa640 1 -- 172.21.15.53:0/3048051502 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38980b0030 con 0x55c0d9e86d80 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38917fa640 1 -- 172.21.15.53:0/3048051502 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f38a4011ad0 con 0x55c0d9e86d80 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38b7076740 10 client.18639 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38b7076740 10 client.18639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38b7076740 20 client.18639 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38b7076740 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c0d9ec81b0 0x55c0da2f6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38b7076740 4 client.18639 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38b7076740 1 -- 172.21.15.53:0/3048051502 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c0da1de9f0 con 0x55c0d9ec81b0 2024-08-31T06:14:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.291+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c0d9ec81b0 0x55c0da2f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.292+0000 7f38ad5d1640 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c0d9ec81b0 0x55c0da2f6960 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7947dc80d4c7d4f server_cookie=c29495f747b4167a in_seq=0 out_seq=0 2024-08-31T06:14:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.292+0000 7f38917fa640 10 client.18639 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:38.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.309+0000 7f3224924640 1 -- 172.21.15.53:0/671010408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3220103930 msgr2=0x7f3220103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.309+0000 7f3224924640 1 --2- 172.21.15.53:0/671010408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3220103930 0x7f3220103d40 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f3210009900 tx=0x7f321002a410 comp rx=0 tx=0).stop 2024-08-31T06:14:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.309+0000 7f3224924640 1 -- 172.21.15.53:0/671010408 shutdown_connections 2024-08-31T06:14:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.309+0000 7f3224924640 1 --2- 172.21.15.53:0/671010408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220109bc0 0x7f32201103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.309+0000 7f3224924640 1 --2- 172.21.15.53:0/671010408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3220109270 0x7f3220109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.309+0000 7f3224924640 1 --2- 172.21.15.53:0/671010408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3220103930 0x7f3220103d40 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.309+0000 7f3224924640 1 -- 172.21.15.53:0/671010408 >> 172.21.15.53:0/671010408 conn(0x7f32200ff380 msgr2=0x7f32201017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.309+0000 7f3224924640 1 -- 172.21.15.53:0/671010408 shutdown_connections 2024-08-31T06:14:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.309+0000 7f3224924640 1 -- 172.21.15.53:0/671010408 wait complete. 2024-08-31T06:14:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.310+0000 7f3224924640 1 Processor -- start 2024-08-31T06:14:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.310+0000 7f3224924640 1 -- start start 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f3224924640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3220103930 0x7f322019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f3224924640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220109270 0x7f322019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f3224924640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3220109bc0 0x7f322019f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f3224924640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3220113730 con 0x7f3220103930 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f3224924640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32201135b0 con 0x7f3220109bc0 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f3224924640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32201138b0 con 0x7f3220109270 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f321ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3220109bc0 0x7f322019f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f321dd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220109270 0x7f322019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f321ed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3220109bc0 0x7f322019f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38668/0 (socket says 172.21.15.53:38668) 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f321ed9d640 1 -- 172.21.15.53:0/3891681249 learned_addr learned my addr 172.21.15.53:0/3891681249 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f321dd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220109270 0x7f322019a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57314/0 (socket says 172.21.15.53:57314) 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f321e59c640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3220103930 0x7f322019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f321ed9d640 1 -- 172.21.15.53:0/3891681249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220109270 msgr2=0x7f322019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f321ed9d640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220109270 0x7f322019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.311+0000 7f321ed9d640 1 -- 172.21.15.53:0/3891681249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3220103930 msgr2=0x7f322019a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.312+0000 7f321ed9d640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3220103930 0x7f322019a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.312+0000 7f321ed9d640 1 -- 172.21.15.53:0/3891681249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32201a0110 con 0x7f3220109bc0 2024-08-31T06:14:38.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.312+0000 7f321dd9b640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220109270 0x7f322019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:38.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.312+0000 7f321e59c640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3220103930 0x7f322019a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:38.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.312+0000 7f321ed9d640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3220109bc0 0x7f322019f9e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3218009fd0 tx=0x7f321800b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.312+0000 7f320f7fe640 1 -- 172.21.15.53:0/3891681249 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3218017070 con 0x7f3220109bc0 2024-08-31T06:14:38.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.312+0000 7f3224924640 1 -- 172.21.15.53:0/3891681249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32201a0400 con 0x7f3220109bc0 2024-08-31T06:14:38.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.312+0000 7f320f7fe640 1 -- 172.21.15.53:0/3891681249 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3218003e00 con 0x7f3220109bc0 2024-08-31T06:14:38.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.312+0000 7f320f7fe640 1 -- 172.21.15.53:0/3891681249 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3218010460 con 0x7f3220109bc0 2024-08-31T06:14:38.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.312+0000 7f3224924640 1 -- 172.21.15.53:0/3891681249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32201a6b60 con 0x7f3220109bc0 2024-08-31T06:14:38.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.315+0000 7f322ae99740 1 Processor -- start 2024-08-31T06:14:38.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.315+0000 7f320f7fe640 1 -- 172.21.15.53:0/3891681249 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3218003970 con 0x7f3220109bc0 2024-08-31T06:14:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f322ae99740 1 -- start start 2024-08-31T06:14:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f322ae99740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557154fea1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f322ae99740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 0x557154fea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f322ae99740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 0x557154ffcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f322ae99740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557154f625f0 con 0x557154c25670 2024-08-31T06:14:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f322ae99740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557154f51b80 con 0x557154c46350 2024-08-31T06:14:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f322ae99740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557154f55b30 con 0x557154c1d490 2024-08-31T06:14:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f321e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 0x557154fea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f321dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 0x557154ffcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f321e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 0x557154fea760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57326/0 (socket says 172.21.15.53:57326) 2024-08-31T06:14:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f321e59c640 1 -- 172.21.15.53:0/2629057502 learned_addr learned my addr 172.21.15.53:0/2629057502 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.316+0000 7f320f7fe640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32080b4ca0 0x7f32080b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.317+0000 7f321dd9b640 1 --2- 172.21.15.53:0/2629057502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557154fea1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.317+0000 7f321ed9d640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32080b4ca0 0x7f32080b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.317+0000 7f320f7fe640 1 -- 172.21.15.53:0/3891681249 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f32180e55e0 con 0x7f3220109bc0 2024-08-31T06:14:38.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.317+0000 7f321e59c640 1 -- 172.21.15.53:0/2629057502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 msgr2=0x557154fea1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.317+0000 7f321e59c640 1 --2- 172.21.15.53:0/2629057502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557154fea1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.317+0000 7f321e59c640 1 -- 172.21.15.53:0/2629057502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 msgr2=0x557154ffcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.317+0000 7f321e59c640 1 --2- 172.21.15.53:0/2629057502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 0x557154ffcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.317+0000 7f321e59c640 1 -- 172.21.15.53:0/2629057502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557154cb1930 con 0x557154c1d490 2024-08-31T06:14:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.317+0000 7f321ed9d640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32080b4ca0 0x7f32080b71b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f32180e3310 tx=0x7f32180a05e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.318+0000 7f321e59c640 1 --2- 172.21.15.53:0/2629057502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 0x557154fea760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f321002a930 tx=0x7f3210032f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2cc81427545bd07 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.318+0000 7f320cff9640 1 -- 172.21.15.53:0/2629057502 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210035070 con 0x557154c1d490 2024-08-31T06:14:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.318+0000 7f320cff9640 1 -- 172.21.15.53:0/2629057502 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32100044c0 con 0x557154c1d490 2024-08-31T06:14:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.318+0000 7f320cff9640 1 -- 172.21.15.53:0/2629057502 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210003e40 con 0x557154c1d490 2024-08-31T06:14:38.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.319+0000 7f322ae99740 1 -- 172.21.15.53:0/2629057502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 msgr2=0x557154fea760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.319+0000 7f322ae99740 1 --2- 172.21.15.53:0/2629057502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 0x557154fea760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f321002a930 tx=0x7f3210032f70 comp rx=0 tx=0).stop 2024-08-31T06:14:38.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.319+0000 7f322ae99740 1 -- 172.21.15.53:0/2629057502 shutdown_connections 2024-08-31T06:14:38.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.319+0000 7f322ae99740 1 --2- 172.21.15.53:0/2629057502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 0x557154ffcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.319+0000 7f322ae99740 1 --2- 172.21.15.53:0/2629057502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 0x557154fea760 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.319+0000 7f322ae99740 1 --2- 172.21.15.53:0/2629057502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557154fea1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.319+0000 7f322ae99740 1 -- 172.21.15.53:0/2629057502 >> 172.21.15.53:0/2629057502 conn(0x557154c3a740 msgr2=0x557154fec700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.319+0000 7f322ae99740 1 -- 172.21.15.53:0/2629057502 shutdown_connections 2024-08-31T06:14:38.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.319+0000 7f322ae99740 1 -- 172.21.15.53:0/2629057502 wait complete. 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.320+0000 7f322ae99740 1 -- start start 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.320+0000 7f322ae99740 1 Processor -- start 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.320+0000 7f322ae99740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c1d490 0x557155000f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.320+0000 7f322ae99740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x557155001530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.320+0000 7f322ae99740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c46350 0x557155006550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.320+0000 7f322ae99740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557154db4890 con 0x557154c46350 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.320+0000 7f322ae99740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557154ed8790 con 0x557154c1d490 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.320+0000 7f321e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x557155001530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.320+0000 7f321e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x557155001530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57332/0 (socket says 172.21.15.53:57332) 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.320+0000 7f321dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c1d490 0x557155000f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.320+0000 7f321e59c640 1 -- 172.21.15.53:0/3390322548 learned_addr learned my addr 172.21.15.53:0/3390322548 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f322ae99740 1 -- 172.21.15.53:0/3390322548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557154ffd5d0 con 0x557154c25670 2024-08-31T06:14:38.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f321dd9b640 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c46350 0x557155006550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38917fa640 1 -- 172.21.15.53:0/3048051502 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c0da1de9f0 con 0x55c0d9ec81b0 2024-08-31T06:14:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38917fa640 10 client.18639 handle_command_reply: tid=0 2024-08-31T06:14:38.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f322ae99740 10 client.0 _ll_register_callbacks cb 0x557154c5dba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38b7076740 1 client.18639 shutdown 2024-08-31T06:14:38.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f321e59c640 1 -- 172.21.15.53:0/3390322548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c1d490 msgr2=0x557155000f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38b7076740 1 -- 172.21.15.53:0/3048051502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e86d80 msgr2=0x55c0da27d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38b7076740 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e86d80 0x55c0da27d410 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f38a400b710 tx=0x7f38a40040d0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f321e59c640 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c1d490 0x557155000f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f321e59c640 1 -- 172.21.15.53:0/3390322548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c46350 msgr2=0x557155006550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f321e59c640 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c46350 0x557155006550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f321e59c640 1 -- 172.21.15.53:0/3390322548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557154f0ff30 con 0x557154c25670 2024-08-31T06:14:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f322ae99740 1 -- 172.21.15.53:0/3390322548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557154f64540 con 0x557154c25670 2024-08-31T06:14:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f321e59c640 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x557155001530 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f32100057c0 tx=0x7f3210009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a300dada8e45ad0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38b7076740 1 -- 172.21.15.53:0/3048051502 shutdown_connections 2024-08-31T06:14:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38b7076740 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c0d9ec81b0 0x55c0da2f6960 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38917fa640 0 client.18639 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38b7076740 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0d9ea74d0 0x55c0da27de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38b7076740 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0d9e9f2f0 0x55c0da27d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38b7076740 1 --2- 172.21.15.53:0/3048051502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0d9e86d80 0x55c0da27d410 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f38b7076740 1 -- 172.21.15.53:0/3048051502 >> 172.21.15.53:0/3048051502 conn(0x55c0d9ebc300 msgr2=0x55c0da278980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.321+0000 7f3205ffb640 10 client.27862 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:14:38.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f3205ffb640 1 -- 172.21.15.53:0/3390322548 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210057050 con 0x557154c25670 2024-08-31T06:14:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f38b7076740 1 -- 172.21.15.53:0/3048051502 shutdown_connections 2024-08-31T06:14:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f38b7076740 1 -- 172.21.15.53:0/3048051502 wait complete. 2024-08-31T06:14:38.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f3205ffb640 1 -- 172.21.15.53:0/3390322548 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f3210003bc0 con 0x557154c25670 2024-08-31T06:14:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f38b7076740 20 client.18639 trim_cache size 0 max 16384 2024-08-31T06:14:38.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f3205ffb640 1 -- 172.21.15.53:0/3390322548 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f321004d070 con 0x557154c25670 2024-08-31T06:14:38.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f322ae99740 10 client.27862 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:38.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f322ae99740 1 -- 172.21.15.53:0/3390322548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=46}) -- 0x55715500f3a0 con 0x557154c25670 2024-08-31T06:14:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:14:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:14:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:14:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:14:38.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f3205ffb640 1 -- 172.21.15.53:0/3390322548 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f3210003dc0 con 0x557154c25670 2024-08-31T06:14:38.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f322ae99740 10 client.27862 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:38.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f322ae99740 10 client.27862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 -- 172.21.15.53:0/1592448004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38940b4d20 msgr2=0x7f38940b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38940b4d20 0x7f38940b7230 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f38a0006010 tx=0x7f38a0009800 comp rx=0 tx=0).stop 2024-08-31T06:14:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 -- 172.21.15.53:0/1592448004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a8105080 msgr2=0x7f38a81029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a8105080 0x7f38a81029a0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f389800c970 tx=0x7f389800ce30 comp rx=0 tx=0).stop 2024-08-31T06:14:38.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f322ae99740 20 client.27862 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:38.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f322ae99740 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557154c04cd0 0x557155012700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.322+0000 7f322ae99740 4 client.27862 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:38.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f322ae99740 1 -- 172.21.15.53:0/3390322548 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557154f5ffe0 con 0x557154c04cd0 2024-08-31T06:14:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 -- 172.21.15.53:0/1592448004 shutdown_connections 2024-08-31T06:14:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f38940b4d20 0x7f38940b7230 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f38a810db00 0x7f38a8102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a8105080 0x7f38a81029a0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 --2- 172.21.15.53:0/1592448004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f38a8104730 0x7f38a8102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 -- 172.21.15.53:0/1592448004 >> 172.21.15.53:0/1592448004 conn(0x7f38a807a480 msgr2=0x7f38a8100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f321dd9b640 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557154c04cd0 0x557155012700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 -- 172.21.15.53:0/1592448004 shutdown_connections 2024-08-31T06:14:38.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f38b0036640 1 -- 172.21.15.53:0/1592448004 wait complete. 2024-08-31T06:14:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f3205ffb640 10 client.27862 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.323+0000 7f321dd9b640 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557154c04cd0 0x557155012700 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebe73e5d05c561ff server_cookie=4ee31a47841986af in_seq=0 out_seq=0 2024-08-31T06:14:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.324+0000 7f3205ffb640 1 -- 172.21.15.53:0/3390322548 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557154f5ffe0 con 0x557154c04cd0 2024-08-31T06:14:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.324+0000 7f3205ffb640 10 client.27862 handle_command_reply: tid=0 2024-08-31T06:14:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.324+0000 7f322ae99740 1 client.27862 shutdown 2024-08-31T06:14:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.324+0000 7f322ae99740 1 -- 172.21.15.53:0/3390322548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 msgr2=0x557155001530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.324+0000 7f322ae99740 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x557155001530 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f32100057c0 tx=0x7f3210009680 comp rx=0 tx=0).stop 2024-08-31T06:14:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.324+0000 7f322ae99740 1 -- 172.21.15.53:0/3390322548 shutdown_connections 2024-08-31T06:14:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.324+0000 7f322ae99740 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557154c04cd0 0x557155012700 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.325+0000 7f3205ffb640 0 client.27862 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.325+0000 7f322ae99740 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c46350 0x557155006550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.325+0000 7f322ae99740 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x557155001530 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.325+0000 7f322ae99740 1 --2- 172.21.15.53:0/3390322548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c1d490 0x557155000f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.325+0000 7f322ae99740 1 -- 172.21.15.53:0/3390322548 >> 172.21.15.53:0/3390322548 conn(0x557154c3a740 msgr2=0x557154fe9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.325+0000 7f322ae99740 1 -- 172.21.15.53:0/3390322548 shutdown_connections 2024-08-31T06:14:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.325+0000 7f322ae99740 1 -- 172.21.15.53:0/3390322548 wait complete. 2024-08-31T06:14:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.325+0000 7f322ae99740 20 client.27862 trim_cache size 0 max 16384 2024-08-31T06:14:38.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.344+0000 7f322ae99740 1 Processor -- start 2024-08-31T06:14:38.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.344+0000 7f322ae99740 1 -- start start 2024-08-31T06:14:38.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.344+0000 7f322ae99740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 0x557154fea7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.344+0000 7f322ae99740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 0x557154ffe820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.344+0000 7f322ae99740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557154fec200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.344+0000 7f322ae99740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32201ad230 con 0x557154c25670 2024-08-31T06:14:38.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.344+0000 7f322ae99740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32201aef80 con 0x557154c46350 2024-08-31T06:14:38.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.344+0000 7f322ae99740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32201ad900 con 0x557154c1d490 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 0x557154ffe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321dd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 0x557154fea7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 0x557154ffe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53154/0 (socket says 172.21.15.53:53154) 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321e59c640 1 -- 172.21.15.53:0/1964877668 learned_addr learned my addr 172.21.15.53:0/1964877668 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321dd9b640 1 --2- 172.21.15.53:0/1964877668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557154fec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321dd9b640 1 -- 172.21.15.53:0/1964877668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 msgr2=0x557154fec200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321dd9b640 1 --2- 172.21.15.53:0/1964877668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557154fec200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321dd9b640 1 -- 172.21.15.53:0/1964877668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 msgr2=0x557154ffe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321dd9b640 1 --2- 172.21.15.53:0/1964877668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 0x557154ffe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321dd9b640 1 -- 172.21.15.53:0/1964877668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557154fecff0 con 0x557154c1d490 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321e59c640 1 --2- 172.21.15.53:0/1964877668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 0x557154ffe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:14:38.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f321dd9b640 1 --2- 172.21.15.53:0/1964877668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 0x557154fea7f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x557154ed8820 tx=0x7f321400bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc6b1507c2f3adb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f3207fff640 1 -- 172.21.15.53:0/1964877668 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321401b040 con 0x557154c1d490 2024-08-31T06:14:38.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.345+0000 7f3207fff640 1 -- 172.21.15.53:0/1964877668 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3214004020 con 0x557154c1d490 2024-08-31T06:14:38.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.346+0000 7f3207fff640 1 -- 172.21.15.53:0/1964877668 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3214005410 con 0x557154c1d490 2024-08-31T06:14:38.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.346+0000 7f322ae99740 1 -- 172.21.15.53:0/1964877668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 msgr2=0x557154fea7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.346+0000 7f322ae99740 1 --2- 172.21.15.53:0/1964877668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 0x557154fea7f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x557154ed8820 tx=0x7f321400bb90 comp rx=0 tx=0).stop 2024-08-31T06:14:38.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.346+0000 7f322ae99740 1 -- 172.21.15.53:0/1964877668 shutdown_connections 2024-08-31T06:14:38.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.346+0000 7f322ae99740 1 --2- 172.21.15.53:0/1964877668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557154fec200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.346+0000 7f322ae99740 1 --2- 172.21.15.53:0/1964877668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c25670 0x557154ffe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.346+0000 7f322ae99740 1 --2- 172.21.15.53:0/1964877668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c1d490 0x557154fea7f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.346+0000 7f322ae99740 1 -- 172.21.15.53:0/1964877668 >> 172.21.15.53:0/1964877668 conn(0x557154c3a740 msgr2=0x557155000f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.347+0000 7f322ae99740 1 -- 172.21.15.53:0/1964877668 shutdown_connections 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.347+0000 7f322ae99740 1 -- 172.21.15.53:0/1964877668 wait complete. 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.347+0000 7f322ae99740 1 -- start start 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.347+0000 7f322ae99740 1 Processor -- start 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.347+0000 7f322ae99740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c1d490 0x55715500b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.347+0000 7f322ae99740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x55715500bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.347+0000 7f322ae99740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557155009180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.347+0000 7f322ae99740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32201ae7f0 con 0x557154c1d490 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.347+0000 7f322ae99740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32201ae090 con 0x557154c46350 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.347+0000 7f322ae99740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32201ab230 con 0x557154c25670 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.347+0000 7f322ae99740 10 client.0 _ll_register_callbacks cb 0x7f321400bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c1d490 0x55715500b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x55715500bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c1d490 0x55715500b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53170/0 (socket says 172.21.15.53:53170) 2024-08-31T06:14:38.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x55715500bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57338/0 (socket says 172.21.15.53:57338) 2024-08-31T06:14:38.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321dd9b640 1 -- 172.21.15.53:0/196080262 learned_addr learned my addr 172.21.15.53:0/196080262 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:38.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321dd9b640 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557155009180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321e59c640 1 -- 172.21.15.53:0/196080262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 msgr2=0x557155009180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321e59c640 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557155009180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321e59c640 1 -- 172.21.15.53:0/196080262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c1d490 msgr2=0x55715500b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:38.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321e59c640 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c1d490 0x55715500b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321e59c640 1 -- 172.21.15.53:0/196080262 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571550098f0 con 0x557154c25670 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f321e59c640 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x55715500bf70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x557154ef23a0 tx=0x7f32100058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a84283d4acd8451 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f3205ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.348+0000 7f3205ffb640 1 -- 172.21.15.53:0/196080262 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210057070 con 0x557154c25670 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f3205ffb640 1 -- 172.21.15.53:0/196080262 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f3210031a80 con 0x557154c25670 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f322ae99740 1 -- 172.21.15.53:0/196080262 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3214004020 con 0x557154c25670 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f3205ffb640 1 -- 172.21.15.53:0/196080262 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f3210035070 con 0x557154c25670 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f322ae99740 10 client.27868 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f322ae99740 1 -- 172.21.15.53:0/196080262 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55715507d8a0 con 0x557154c25670 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f3205ffb640 1 -- 172.21.15.53:0/196080262 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557154f64540 con 0x557154c25670 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f3205ffb640 1 -- 172.21.15.53:0/196080262 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f32100324d0 con 0x557154c25670 2024-08-31T06:14:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f322ae99740 10 client.27868 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f322ae99740 10 client.27868 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f322ae99740 20 client.27868 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f322ae99740 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557154bda080 0x557155080050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f322ae99740 4 client.27868 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.349+0000 7f322ae99740 1 -- 172.21.15.53:0/196080262 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f3214004020 con 0x557154bda080 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.350+0000 7f321dd9b640 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557154bda080 0x557155080050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.350+0000 7f3205ffb640 10 client.27868 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.350+0000 7f321dd9b640 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557154bda080 0x557155080050 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e69cbeebdf057142 server_cookie=4a50b1394604b84d in_seq=0 out_seq=0 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f3205ffb640 1 -- 172.21.15.53:0/196080262 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f3214004020 con 0x557154bda080 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f3205ffb640 10 client.27868 handle_command_reply: tid=0 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 1 client.27868 shutdown 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 1 -- 172.21.15.53:0/196080262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 msgr2=0x55715500bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x55715500bf70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x557154ef23a0 tx=0x7f32100058d0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 1 -- 172.21.15.53:0/196080262 shutdown_connections 2024-08-31T06:14:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557154bda080 0x557155080050 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557154c46350 0x557155009180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557154c25670 0x55715500bf70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f3205ffb640 0 client.27868 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 1 --2- 172.21.15.53:0/196080262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557154c1d490 0x55715500b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 1 -- 172.21.15.53:0/196080262 >> 172.21.15.53:0/196080262 conn(0x557154c3a740 msgr2=0x5571550032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 1 -- 172.21.15.53:0/196080262 shutdown_connections 2024-08-31T06:14:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 1 -- 172.21.15.53:0/196080262 wait complete. 2024-08-31T06:14:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.351+0000 7f322ae99740 20 client.27868 trim_cache size 0 max 16384 2024-08-31T06:14:38.358 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:14:38.358 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:14:38.358 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "db980a93-0473-48c6-b079-63ebf1ca0908", 2024-08-31T06:14:38.358 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:14:38.358 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:14:38.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 -- 172.21.15.53:0/3891681249 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32080b4ca0 msgr2=0x7f32080b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32080b4ca0 0x7f32080b71b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f32180e3310 tx=0x7f32180a05e0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 -- 172.21.15.53:0/3891681249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3220109bc0 msgr2=0x7f322019f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3220109bc0 0x7f322019f9e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3218009fd0 tx=0x7f321800b260 comp rx=0 tx=0).stop 2024-08-31T06:14:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 -- 172.21.15.53:0/3891681249 shutdown_connections 2024-08-31T06:14:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f32080b4ca0 0x7f32080b71b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3220109bc0 0x7f322019f9e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220109270 0x7f322019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 --2- 172.21.15.53:0/3891681249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3220103930 0x7f322019a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 -- 172.21.15.53:0/3891681249 >> 172.21.15.53:0/3891681249 conn(0x7f32200ff380 msgr2=0x7f32201017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 -- 172.21.15.53:0/3891681249 shutdown_connections 2024-08-31T06:14:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:38.352+0000 7f3224924640 1 -- 172.21.15.53:0/3891681249 wait complete. 2024-08-31T06:14:38.622 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:14:38.622 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.622 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:14:38.623 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:14:38.367+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020c [...10,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL/ auth{1=1,2=1,3=1,4=1} v29571 ap=3 f(v1482 m2024-08-31T06:14:27.321672+0000 8=8+0) n(v39 rc2024-08-31T06:14:27.324848+0000 b1283356 9=8+1) old_inodes=6 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:406 nref=3)) caps={15441=pAsLsXs/-@25820} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e67e1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000020c:[<0x10000000009/EXCEL v1138>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x1000000020c:[<0x10000000009/EXCEL v29571>,<0x10000000008/~dmtmp v22202>,<0x10000000007/client0 v934>,<0x10000000006/clients v911>,<0x10000000005/tmp v882>,<0x10000000003/client.0 v875>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v871>,<0x10000000001/sv_0 v860>,<0x10000000000/qa v851>,<0x1/volumes v812>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:14:27.297341+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:14:27.324848+0000 b1283356 9=8+1)","memory_value.dirstat":"f(v1482 m2024-08-31T06:14:27.321672+0000 8=8+0)","memory_value.rstat":"n(v39 rc2024-08-31T06:14:27.324848+0000 b1283356 9=8+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:14:38.623 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:14:38.369+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000215 [...10,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL/ auth{1=1,2=1,3=1,4=1} fragtree_t(*^3) v29578 ap=3 f(v980 m2024-08-31T06:14:29.090930+0000 12=12+0) n(v41 rc2024-08-31T06:14:29.090930+0000 b2871494 13=12+1) old_inodes=6 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:405 nref=3)) caps={15441=pAsLsXsFs/-@24064} | dirtyscattered=0 request=1 lock=2 importing=0 dirfrag=8 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5613e69a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000215:[<0x10000000009/COREL v1154>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000215:[<0x10000000009/COREL v29578>,<0x10000000008/~dmtmp v22202>,<0x10000000007/client0 v934>,<0x10000000006/clients v911>,<0x10000000005/tmp v882>,<0x10000000003/client.0 v875>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v871>,<0x10000000001/sv_0 v860>,<0x10000000000/qa v851>,<0x1/volumes v812>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:14:29.090930+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:14:29.090930+0000 b2871494 13=12+1)","memory_value.dirstat":"f(v980 m2024-08-31T06:14:29.090930+0000 12=12+0)","memory_value.rstat":"n(v41 rc2024-08-31T06:14:29.090930+0000 b2871494 13=12+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:14:38.623 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:14:38.379+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000229 [...10,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX/ auth{1=1,2=1,3=1,4=1} fragtree_t(*^3) v29575 ap=3 f(v1396 m2024-08-31T06:14:26.400557+0000 24=24+0) n(v42 rc2024-08-31T06:14:26.400557+0000 b5230239 25=24+1) old_inodes=6 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:410 nref=3)) caps={15441=pAsLsXs/-@28129} | dirtyscattered=0 request=1 lock=2 dirfrag=8 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5613e69bdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000229:[<0x10000000009/PARADOX v1182>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000229:[<0x10000000009/PARADOX v29575>,<0x10000000008/~dmtmp v22202>,<0x10000000007/client0 v934>,<0x10000000006/clients v911>,<0x10000000005/tmp v882>,<0x10000000003/client.0 v875>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v871>,<0x10000000001/sv_0 v860>,<0x10000000000/qa v851>,<0x1/volumes v812>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:14:26.386079+0000 25=25+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:14:26.400557+0000 b5230239 25=24+1)","memory_value.dirstat":"f(v1396 m2024-08-31T06:14:26.400557+0000 24=24+0)","memory_value.rstat":"n(v42 rc2024-08-31T06:14:26.400557+0000 b5230239 25=24+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:14:38.623 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:14:38.383+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000225 [...10,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM/ auth{1=1,2=1,3=1,4=1} v29525 ap=3 f(v2835 m2024-08-31T06:14:22.946934+0000 3=3+0) n(v37 rc2024-08-31T06:14:22.946934+0000 b780288 4=3+1) old_inodes=6 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:411 nref=3)) caps={15441=pAsLsXs/-@32421} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e69bc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000225:[<0x10000000009/PM v1172>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000225:[<0x10000000009/PM v29525>,<0x10000000008/~dmtmp v22202>,<0x10000000007/client0 v934>,<0x10000000006/clients v911>,<0x10000000005/tmp v882>,<0x10000000003/client.0 v875>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v871>,<0x10000000001/sv_0 v860>,<0x10000000000/qa v851>,<0x1/volumes v812>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:14:22.566918+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:14:22.946934+0000 b780288 4=3+1)","memory_value.dirstat":"f(v2835 m2024-08-31T06:14:22.946934+0000 3=3+0)","memory_value.rstat":"n(v37 rc2024-08-31T06:14:22.946934+0000 b780288 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:14:38.623 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:14:38.385+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020f [...10,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PWRPNT/ auth{1=1,2=1,3=1,4=1} v29573 ap=3 f(v1092 m2024-08-31T06:14:23.920530+0000 7=7+0) n(v39 rc2024-08-31T06:14:23.920530+0000 b1462582 8=7+1) old_inodes=6 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:412 nref=3)) caps={15441=pAsLsXs/-@23498} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5613e69a2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000020f:[<0x10000000009/PWRPNT v1372>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x1000000020f:[<0x10000000009/PWRPNT v29573>,<0x10000000008/~dmtmp v22202>,<0x10000000007/client0 v934>,<0x10000000006/clients v911>,<0x10000000005/tmp v882>,<0x10000000003/client.0 v875>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v871>,<0x10000000001/sv_0 v860>,<0x10000000000/qa v851>,<0x1/volumes v812>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:14:23.854062+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:14:23.920530+0000 b1462582 8=7+1)","memory_value.dirstat":"f(v1092 m2024-08-31T06:14:23.920530+0000 7=7+0)","memory_value.rstat":"n(v39 rc2024-08-31T06:14:23.920530+0000 b1462582 8=7+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:14:38.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PWRPNT) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:38 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PWRPNT) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:38 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:14:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:14:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PWRPNT) see mds.b log and `damage ls` output for details 2024-08-31T06:14:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:38 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:38.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.54 MB/sec execute 388 sec latency 8941.376 ms 2024-08-31T06:14:39.152 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:14:39.406 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:39.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:39 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:14:39.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:39 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:39 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:14:39.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:39 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:14:39.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:39 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:39 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:39 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:14:39.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:39 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:39 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:14:39.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:39 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.837 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:39 smithi053 ceph-mon[18924]: pgmap v622: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 666 KiB/s wr, 78 op/s 2024-08-31T06:14:39.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:39 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:14:39.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:39 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:39 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:14:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:39 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:14:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:39 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:39 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:39 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:14:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:39 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:39 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:14:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:39 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:39 smithi130 ceph-mon[22266]: pgmap v622: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 666 KiB/s wr, 78 op/s 2024-08-31T06:14:39.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:39 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:14:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:39 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:39 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:14:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:39 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:14:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:39 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:39 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:39 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:14:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:39 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:39 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:14:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:39 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:14:39.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:39 smithi153 ceph-mon[22320]: pgmap v622: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 666 KiB/s wr, 78 op/s 2024-08-31T06:14:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.926+0000 7f672ceb9640 1 -- 172.21.15.53:0/4165243517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728108140 msgr2=0x7f6728108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.926+0000 7f672ceb9640 1 --2- 172.21.15.53:0/4165243517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728108140 0x7f6728108550 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f671c009900 tx=0x7f671c02a410 comp rx=0 tx=0).stop 2024-08-31T06:14:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.926+0000 7f672ceb9640 1 -- 172.21.15.53:0/4165243517 shutdown_connections 2024-08-31T06:14:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.926+0000 7f672ceb9640 1 --2- 172.21.15.53:0/4165243517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728108a90 0x7f672810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.926+0000 7f672ceb9640 1 --2- 172.21.15.53:0/4165243517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728108140 0x7f6728108550 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.926+0000 7f672ceb9640 1 --2- 172.21.15.53:0/4165243517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728102800 0x7f6728102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.926+0000 7f672ceb9640 1 -- 172.21.15.53:0/4165243517 >> 172.21.15.53:0/4165243517 conn(0x7f67280794d0 msgr2=0x7f67280798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.926+0000 7f672ceb9640 1 -- 172.21.15.53:0/4165243517 shutdown_connections 2024-08-31T06:14:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.926+0000 7f672ceb9640 1 -- 172.21.15.53:0/4165243517 wait complete. 2024-08-31T06:14:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.927+0000 7f672ceb9640 1 Processor -- start 2024-08-31T06:14:39.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.927+0000 7f672ceb9640 1 -- start start 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.927+0000 7f672ceb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728102800 0x7f672819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.927+0000 7f672ceb9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728108140 0x7f672819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.927+0000 7f672ceb9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728108a90 0x7f672819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.927+0000 7f672ceb9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6728112570 con 0x7f6728102800 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.927+0000 7f672ceb9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67281123f0 con 0x7f6728108140 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.927+0000 7f672ceb9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67281126f0 con 0x7f6728108a90 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.927+0000 7f672659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728102800 0x7f672819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.927+0000 7f672659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728102800 0x7f672819a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53192/0 (socket says 172.21.15.53:53192) 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.927+0000 7f672659c640 1 -- 172.21.15.53:0/846798124 learned_addr learned my addr 172.21.15.53:0/846798124 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f6725d9b640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728108140 0x7f672819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f6726d9d640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728108a90 0x7f672819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f672659c640 1 -- 172.21.15.53:0/846798124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728108a90 msgr2=0x7f672819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f672659c640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728108a90 0x7f672819f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f672659c640 1 -- 172.21.15.53:0/846798124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728108140 msgr2=0x7f672819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f672659c640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728108140 0x7f672819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f672659c640 1 -- 172.21.15.53:0/846798124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67281a00c0 con 0x7f6728102800 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f6725d9b640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728108140 0x7f672819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f6726d9d640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728108a90 0x7f672819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f672659c640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728102800 0x7f672819a150 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f671800d950 tx=0x7f671800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f67177fe640 1 -- 172.21.15.53:0/846798124 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718017070 con 0x7f6728102800 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f672ceb9640 1 -- 172.21.15.53:0/846798124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67281a03b0 con 0x7f6728102800 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f67177fe640 1 -- 172.21.15.53:0/846798124 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6718009c30 con 0x7f6728102800 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f67177fe640 1 -- 172.21.15.53:0/846798124 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671800f620 con 0x7f6728102800 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.928+0000 7f672ceb9640 1 -- 172.21.15.53:0/846798124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67281a6b10 con 0x7f6728102800 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.931+0000 7f67177fe640 1 -- 172.21.15.53:0/846798124 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6718010460 con 0x7f6728102800 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.931+0000 7f673342e740 1 Processor -- start 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.931+0000 7f673342e740 1 -- start start 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f673342e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b20236c070 0x55b2027112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f673342e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2023431b0 0x55b202711800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f673342e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202711d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f673342e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b202688630 con 0x55b20234b390 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f673342e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b202677bc0 con 0x55b2023431b0 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f673342e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b20267bb70 con 0x55b20236c070 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f6725d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202711d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f6725d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202711d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53204/0 (socket says 172.21.15.53:53204) 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f6725d9b640 1 -- 172.21.15.53:0/3531586647 learned_addr learned my addr 172.21.15.53:0/3531586647 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f6726d9d640 1 --2- 172.21.15.53:0/3531586647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b20236c070 0x55b2027112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f672659c640 1 --2- 172.21.15.53:0/3531586647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2023431b0 0x55b202711800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f67177fe640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4ca0 0x7f67100b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f6726d9d640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4ca0 0x7f67100b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f6725d9b640 1 -- 172.21.15.53:0/3531586647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b20236c070 msgr2=0x55b2027112c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f6725d9b640 1 --2- 172.21.15.53:0/3531586647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b20236c070 0x55b2027112c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f6725d9b640 1 -- 172.21.15.53:0/3531586647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2023431b0 msgr2=0x55b202711800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:39.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f6725d9b640 1 --2- 172.21.15.53:0/3531586647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2023431b0 0x55b202711800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f6725d9b640 1 -- 172.21.15.53:0/3531586647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2023d7650 con 0x55b20234b390 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f67177fe640 1 -- 172.21.15.53:0/846798124 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f67180e5260 con 0x7f6728102800 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.932+0000 7f6725d9b640 1 --2- 172.21.15.53:0/3531586647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202711d40 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f671c006010 tx=0x7f671c032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f272931d366a69db server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.933+0000 7f6726d9d640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4ca0 0x7f67100b71b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6720005fd0 tx=0x7f6720004ab0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.933+0000 7f6714ff9640 1 -- 172.21.15.53:0/3531586647 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c03f070 con 0x55b20234b390 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.933+0000 7f6714ff9640 1 -- 172.21.15.53:0/3531586647 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f671c0044c0 con 0x55b20234b390 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.933+0000 7f6714ff9640 1 -- 172.21.15.53:0/3531586647 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c035070 con 0x55b20234b390 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.934+0000 7f673342e740 1 -- 172.21.15.53:0/3531586647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 msgr2=0x55b202711d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.934+0000 7f673342e740 1 --2- 172.21.15.53:0/3531586647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202711d40 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f671c006010 tx=0x7f671c032c40 comp rx=0 tx=0).stop 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.934+0000 7f673342e740 1 -- 172.21.15.53:0/3531586647 shutdown_connections 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.934+0000 7f673342e740 1 --2- 172.21.15.53:0/3531586647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202711d40 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.934+0000 7f673342e740 1 --2- 172.21.15.53:0/3531586647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2023431b0 0x55b202711800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.934+0000 7f673342e740 1 --2- 172.21.15.53:0/3531586647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b20236c070 0x55b2027112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.934+0000 7f673342e740 1 -- 172.21.15.53:0/3531586647 >> 172.21.15.53:0/3531586647 conn(0x55b202360460 msgr2=0x55b20270f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:39.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.934+0000 7f673342e740 1 -- 172.21.15.53:0/3531586647 shutdown_connections 2024-08-31T06:14:39.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.934+0000 7f673342e740 1 -- 172.21.15.53:0/3531586647 wait complete. 2024-08-31T06:14:39.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f673342e740 1 -- start start 2024-08-31T06:14:39.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f673342e740 1 Processor -- start 2024-08-31T06:14:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f673342e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2023431b0 0x55b20271c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f673342e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b20234b390 0x55b20271cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f673342e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20236c070 0x55b202728d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f673342e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b2024da700 con 0x55b2023431b0 2024-08-31T06:14:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f673342e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b2025fe700 con 0x55b20236c070 2024-08-31T06:14:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f673342e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b20271fa40 con 0x55b20234b390 2024-08-31T06:14:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f673342e740 10 client.0 _ll_register_callbacks cb 0x55b20262ddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f672659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2023431b0 0x55b20271c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f672659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2023431b0 0x55b20271c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53216/0 (socket says 172.21.15.53:53216) 2024-08-31T06:14:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.935+0000 7f672659c640 1 -- 172.21.15.53:0/2049673363 learned_addr learned my addr 172.21.15.53:0/2049673363 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f6726d9d640 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20236c070 0x55b202728d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f672659c640 1 -- 172.21.15.53:0/2049673363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b20234b390 msgr2=0x55b20271cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f6725d9b640 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b20234b390 0x55b20271cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f672659c640 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b20234b390 0x55b20271cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f672659c640 1 -- 172.21.15.53:0/2049673363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20236c070 msgr2=0x55b202728d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f672659c640 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20236c070 0x55b202728d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f672659c640 1 -- 172.21.15.53:0/2049673363 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2026378b0 con 0x55b2023431b0 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f6725d9b640 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b20234b390 0x55b20271cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f6726d9d640 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20236c070 0x55b202728d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f672659c640 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2023431b0 0x55b20271c9a0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f67180a79b0 tx=0x7f67180a7e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c7f00a2fa4305d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f670dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f670dffb640 1 -- 172.21.15.53:0/2049673363 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718020040 con 0x55b2023431b0 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f670dffb640 1 -- 172.21.15.53:0/2049673363 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f67180e8af0 con 0x55b2023431b0 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f673342e740 1 -- 172.21.15.53:0/2049673363 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b20268a580 con 0x55b2023431b0 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f670dffb640 1 -- 172.21.15.53:0/2049673363 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f67180a70c0 con 0x55b2023431b0 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f673342e740 10 client.18669 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.936+0000 7f673342e740 1 -- 172.21.15.53:0/2049673363 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b20272b7d0 con 0x55b2023431b0 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.937+0000 7f670dffb640 1 -- 172.21.15.53:0/2049673363 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b20268a580 con 0x55b2023431b0 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.937+0000 7f670dffb640 1 -- 172.21.15.53:0/2049673363 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f67180a72a0 con 0x55b2023431b0 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.937+0000 7f673342e740 10 client.18669 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.937+0000 7f673342e740 10 client.18669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.937+0000 7f673342e740 20 client.18669 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.937+0000 7f673342e740 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b20232a9f0 0x55b20272edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.937+0000 7f673342e740 4 client.18669 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.937+0000 7f673342e740 1 -- 172.21.15.53:0/2049673363 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b202686020 con 0x55b20232a9f0 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.937+0000 7f6725d9b640 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b20232a9f0 0x55b20272edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.938+0000 7f6725d9b640 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b20232a9f0 0x55b20272edb0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33112398882f60c server_cookie=bece07a19578ebbd in_seq=0 out_seq=0 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.938+0000 7f670dffb640 10 client.18669 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f670dffb640 1 -- 172.21.15.53:0/2049673363 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b202686020 con 0x55b20232a9f0 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f670dffb640 10 client.18669 handle_command_reply: tid=0 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 1 client.18669 shutdown 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 1 -- 172.21.15.53:0/2049673363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2023431b0 msgr2=0x55b20271c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2023431b0 0x55b20271c9a0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f67180a79b0 tx=0x7f67180a7e80 comp rx=0 tx=0).stop 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 1 -- 172.21.15.53:0/2049673363 shutdown_connections 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b20232a9f0 0x55b20272edb0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20236c070 0x55b202728d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b20234b390 0x55b20271cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 1 --2- 172.21.15.53:0/2049673363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2023431b0 0x55b20271c9a0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f670dffb640 0 client.18669 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:39.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 1 -- 172.21.15.53:0/2049673363 >> 172.21.15.53:0/2049673363 conn(0x55b202360460 msgr2=0x55b202714450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:39.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 1 -- 172.21.15.53:0/2049673363 shutdown_connections 2024-08-31T06:14:39.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 1 -- 172.21.15.53:0/2049673363 wait complete. 2024-08-31T06:14:39.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.939+0000 7f673342e740 20 client.18669 trim_cache size 0 max 16384 2024-08-31T06:14:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f673342e740 1 Processor -- start 2024-08-31T06:14:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f673342e740 1 -- start start 2024-08-31T06:14:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f673342e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2023431b0 0x55b20271c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f673342e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202712a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f673342e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20236c070 0x55b202728c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f673342e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f67281af390 con 0x55b20234b390 2024-08-31T06:14:39.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f673342e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67281b10e0 con 0x55b20236c070 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f673342e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67281afa60 con 0x55b2023431b0 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f6725d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202712a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f6725d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202712a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53226/0 (socket says 172.21.15.53:53226) 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f6725d9b640 1 -- 172.21.15.53:0/1597897443 learned_addr learned my addr 172.21.15.53:0/1597897443 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f6725d9b640 1 -- 172.21.15.53:0/1597897443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2023431b0 msgr2=0x55b20271c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f672659c640 1 --2- 172.21.15.53:0/1597897443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2023431b0 0x55b20271c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f6726d9d640 1 --2- 172.21.15.53:0/1597897443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20236c070 0x55b202728c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f6725d9b640 1 --2- 172.21.15.53:0/1597897443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2023431b0 0x55b20271c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.957+0000 7f6725d9b640 1 -- 172.21.15.53:0/1597897443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20236c070 msgr2=0x55b202728c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.958+0000 7f6725d9b640 1 --2- 172.21.15.53:0/1597897443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20236c070 0x55b202728c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.958+0000 7f6725d9b640 1 -- 172.21.15.53:0/1597897443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b20271b900 con 0x55b20234b390 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.958+0000 7f6725d9b640 1 --2- 172.21.15.53:0/1597897443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202712a00 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f671c0057c0 tx=0x7f671c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b060cdd0054fb03c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.958+0000 7f670ffff640 1 -- 172.21.15.53:0/1597897443 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c050070 con 0x55b20234b390 2024-08-31T06:14:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.958+0000 7f670ffff640 1 -- 172.21.15.53:0/1597897443 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f671c031400 con 0x55b20234b390 2024-08-31T06:14:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.958+0000 7f670ffff640 1 -- 172.21.15.53:0/1597897443 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c035040 con 0x55b20234b390 2024-08-31T06:14:39.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.959+0000 7f673342e740 1 -- 172.21.15.53:0/1597897443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 msgr2=0x55b202712a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.959+0000 7f673342e740 1 --2- 172.21.15.53:0/1597897443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202712a00 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f671c0057c0 tx=0x7f671c005d50 comp rx=0 tx=0).stop 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.959+0000 7f673342e740 1 -- 172.21.15.53:0/1597897443 shutdown_connections 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.959+0000 7f673342e740 1 --2- 172.21.15.53:0/1597897443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20236c070 0x55b202728c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.959+0000 7f673342e740 1 --2- 172.21.15.53:0/1597897443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20234b390 0x55b202712a00 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.959+0000 7f673342e740 1 --2- 172.21.15.53:0/1597897443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2023431b0 0x55b20271c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.959+0000 7f673342e740 1 -- 172.21.15.53:0/1597897443 >> 172.21.15.53:0/1597897443 conn(0x55b202360460 msgr2=0x55b2027122f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.959+0000 7f673342e740 1 -- 172.21.15.53:0/1597897443 shutdown_connections 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.959+0000 7f673342e740 1 -- 172.21.15.53:0/1597897443 wait complete. 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.959+0000 7f673342e740 1 -- start start 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.959+0000 7f673342e740 1 Processor -- start 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f673342e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2023431b0 0x55b2027214e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f673342e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20234b390 0x55b202721ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f673342e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20236c070 0x55b202798770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f673342e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f67281b0950 con 0x55b20236c070 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f673342e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67281b01f0 con 0x55b20234b390 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f673342e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67281ad390 con 0x55b2023431b0 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f673342e740 10 client.0 _ll_register_callbacks cb 0x7f67180a7dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f6726d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20236c070 0x55b202798770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f6726d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20236c070 0x55b202798770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53240/0 (socket says 172.21.15.53:53240) 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f6725d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20234b390 0x55b202721ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f6726d9d640 1 -- 172.21.15.53:0/3364720466 learned_addr learned my addr 172.21.15.53:0/3364720466 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f672659c640 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2023431b0 0x55b2027214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f6726d9d640 1 -- 172.21.15.53:0/3364720466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2023431b0 msgr2=0x55b2027214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f6726d9d640 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2023431b0 0x55b2027214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f6726d9d640 1 -- 172.21.15.53:0/3364720466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20234b390 msgr2=0x55b202721ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f6726d9d640 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20234b390 0x55b202721ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f6726d9d640 1 -- 172.21.15.53:0/3364720466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b202798de0 con 0x55b20236c070 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f6726d9d640 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20236c070 0x55b202798770 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f6720011c50 tx=0x7f6720004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91313eda2ba0c5d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.960+0000 7f670dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f670dffb640 1 -- 172.21.15.53:0/3364720466 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720025020 con 0x55b20236c070 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f670dffb640 1 -- 172.21.15.53:0/3364720466 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f6720021680 con 0x55b20236c070 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f673342e740 1 -- 172.21.15.53:0/3364720466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f671c031400 con 0x55b20236c070 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f670dffb640 1 -- 172.21.15.53:0/3364720466 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6720030050 con 0x55b20236c070 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f673342e740 10 client.18675 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f673342e740 1 -- 172.21.15.53:0/3364720466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b20279a100 con 0x55b20236c070 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f670dffb640 1 -- 172.21.15.53:0/3364720466 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f671c031400 con 0x55b20236c070 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f670dffb640 1 -- 172.21.15.53:0/3364720466 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f672000e690 con 0x55b20236c070 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f673342e740 10 client.18675 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f673342e740 10 client.18675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f673342e740 20 client.18675 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:39.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f673342e740 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b2022ffda0 0x55b20279ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f673342e740 4 client.18675 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.961+0000 7f673342e740 1 -- 172.21.15.53:0/3364720466 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b202683760 con 0x55b2022ffda0 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.962+0000 7f672659c640 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b2022ffda0 0x55b20279ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.962+0000 7f670dffb640 10 client.18675 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.962+0000 7f672659c640 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b2022ffda0 0x55b20279ca30 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbe4fe659e62db79 server_cookie=f19e55a35d9b35bd in_seq=0 out_seq=0 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.962+0000 7f670dffb640 1 -- 172.21.15.53:0/3364720466 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x55b202683760 con 0x55b2022ffda0 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.962+0000 7f670dffb640 10 client.18675 handle_command_reply: tid=0 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.962+0000 7f673342e740 1 client.18675 shutdown 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f673342e740 1 -- 172.21.15.53:0/3364720466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20236c070 msgr2=0x55b202798770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f673342e740 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20236c070 0x55b202798770 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f6720011c50 tx=0x7f6720004a40 comp rx=0 tx=0).stop 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f673342e740 1 -- 172.21.15.53:0/3364720466 shutdown_connections 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f673342e740 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b2022ffda0 0x55b20279ca30 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f670dffb640 0 client.18675 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:39.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f673342e740 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b20236c070 0x55b202798770 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f673342e740 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b20234b390 0x55b202721ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f673342e740 1 --2- 172.21.15.53:0/3364720466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2023431b0 0x55b2027214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f673342e740 1 -- 172.21.15.53:0/3364720466 >> 172.21.15.53:0/3364720466 conn(0x55b202360460 msgr2=0x55b20271dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:39.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f673342e740 1 -- 172.21.15.53:0/3364720466 shutdown_connections 2024-08-31T06:14:39.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f673342e740 1 -- 172.21.15.53:0/3364720466 wait complete. 2024-08-31T06:14:39.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f673342e740 20 client.18675 trim_cache size 0 max 16384 2024-08-31T06:14:39.970 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:14:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:14:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:14:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "db980a93-0473-48c6-b079-63ebf1ca0908", 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:14:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:39.978 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:14:39.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f672ceb9640 1 -- 172.21.15.53:0/846798124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4ca0 msgr2=0x7f67100b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:39.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f672ceb9640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4ca0 0x7f67100b71b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6720005fd0 tx=0x7f6720004ab0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f672ceb9640 1 -- 172.21.15.53:0/846798124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728102800 msgr2=0x7f672819a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:39.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f672ceb9640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728102800 0x7f672819a150 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f671800d950 tx=0x7f671800de10 comp rx=0 tx=0).stop 2024-08-31T06:14:39.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f672ceb9640 1 -- 172.21.15.53:0/846798124 shutdown_connections 2024-08-31T06:14:39.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.963+0000 7f672ceb9640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67100b4ca0 0x7f67100b71b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.964+0000 7f672ceb9640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6728108a90 0x7f672819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.964+0000 7f672ceb9640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6728108140 0x7f672819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.964+0000 7f672ceb9640 1 --2- 172.21.15.53:0/846798124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6728102800 0x7f672819a150 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:39.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.964+0000 7f672ceb9640 1 -- 172.21.15.53:0/846798124 >> 172.21.15.53:0/846798124 conn(0x7f67280794d0 msgr2=0x7f672806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:39.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.964+0000 7f672ceb9640 1 -- 172.21.15.53:0/846798124 shutdown_connections 2024-08-31T06:14:39.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:39.964+0000 7f672ceb9640 1 -- 172.21.15.53:0/846798124 wait complete. 2024-08-31T06:14:39.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.54 MB/sec execute 389 sec latency 9941.412 ms 2024-08-31T06:14:40.733 INFO:tasks.cephfs.filesystem:scrub status for tag:db980a93-0473-48c6-b079-63ebf1ca0908 - {'path': '/', 'tag': 'db980a93-0473-48c6-b079-63ebf1ca0908', 'options': 'recursive,force'} 2024-08-31T06:14:40.989 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.53 MB/sec execute 390 sec latency 10941.475 ms 2024-08-31T06:14:41.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:41 smithi130 ceph-mon[22266]: pgmap v623: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 531 KiB/s wr, 60 op/s 2024-08-31T06:14:41.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:41 smithi153 ceph-mon[22320]: pgmap v623: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 531 KiB/s wr, 60 op/s 2024-08-31T06:14:41.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:41 smithi053 ceph-mon[18924]: pgmap v623: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 531 KiB/s wr, 60 op/s 2024-08-31T06:14:41.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.53 MB/sec execute 391 sec latency 11941.588 ms 2024-08-31T06:14:42.002 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:14:42.270 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:42.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.742+0000 7fea6bd5e640 1 -- 172.21.15.53:0/1864595476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64102fe0 msgr2=0x7fea641033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:42.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.742+0000 7fea6bd5e640 1 --2- 172.21.15.53:0/1864595476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64102fe0 0x7fea641033f0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fea60009900 tx=0x7fea6002a410 comp rx=0 tx=0).stop 2024-08-31T06:14:42.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.742+0000 7fea6bd5e640 1 -- 172.21.15.53:0/1864595476 shutdown_connections 2024-08-31T06:14:42.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.742+0000 7fea6bd5e640 1 --2- 172.21.15.53:0/1864595476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea64108ad0 0x7fea6410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:42.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.742+0000 7fea6bd5e640 1 --2- 172.21.15.53:0/1864595476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea64108180 0x7fea64108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:42.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.742+0000 7fea6bd5e640 1 --2- 172.21.15.53:0/1864595476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64102fe0 0x7fea641033f0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:42.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.742+0000 7fea6bd5e640 1 -- 172.21.15.53:0/1864595476 >> 172.21.15.53:0/1864595476 conn(0x7fea64077a60 msgr2=0x7fea64077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:42.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.742+0000 7fea6bd5e640 1 -- 172.21.15.53:0/1864595476 shutdown_connections 2024-08-31T06:14:42.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.742+0000 7fea6bd5e640 1 -- 172.21.15.53:0/1864595476 wait complete. 2024-08-31T06:14:42.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea6bd5e640 1 Processor -- start 2024-08-31T06:14:42.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea6bd5e640 1 -- start start 2024-08-31T06:14:42.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea6bd5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea64102fe0 0x7fea6419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:42.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea6bd5e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea64108180 0x7fea6419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:42.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea6bd5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64108ad0 0x7fea6419f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:42.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea6bd5e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fea64112650 con 0x7fea64108ad0 2024-08-31T06:14:42.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea6bd5e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fea641124d0 con 0x7fea64102fe0 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea6bd5e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fea641127d0 con 0x7fea64108180 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea6a2fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64108ad0 0x7fea6419f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea6a2fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64108ad0 0x7fea6419f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53244/0 (socket says 172.21.15.53:53244) 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea6a2fb640 1 -- 172.21.15.53:0/155266329 learned_addr learned my addr 172.21.15.53:0/155266329 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea692f9640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea64108180 0x7fea6419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.743+0000 7fea69afa640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea64102fe0 0x7fea6419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea6a2fb640 1 -- 172.21.15.53:0/155266329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea64108180 msgr2=0x7fea6419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea6a2fb640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea64108180 0x7fea6419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea6a2fb640 1 -- 172.21.15.53:0/155266329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea64102fe0 msgr2=0x7fea6419a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea6a2fb640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea64102fe0 0x7fea6419a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea6a2fb640 1 -- 172.21.15.53:0/155266329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea641a00e0 con 0x7fea64108ad0 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea69afa640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea64102fe0 0x7fea6419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:42.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea6a2fb640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64108ad0 0x7fea6419f9b0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00eaa0 tx=0x7fea5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:42.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea56ffd640 1 -- 172.21.15.53:0/155266329 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c00cdb0 con 0x7fea64108ad0 2024-08-31T06:14:42.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea6bd5e640 1 -- 172.21.15.53:0/155266329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea641a03d0 con 0x7fea64108ad0 2024-08-31T06:14:42.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea56ffd640 1 -- 172.21.15.53:0/155266329 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea5c005020 con 0x7fea64108ad0 2024-08-31T06:14:42.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea56ffd640 1 -- 172.21.15.53:0/155266329 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c0116d0 con 0x7fea64108ad0 2024-08-31T06:14:42.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.744+0000 7fea6bd5e640 1 -- 172.21.15.53:0/155266329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea641a6b30 con 0x7fea64108ad0 2024-08-31T06:14:42.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.745+0000 7fea6bd5e640 1 -- 172.21.15.53:0/155266329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea641033f0 con 0x7fea64108ad0 2024-08-31T06:14:42.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.748+0000 7fea56ffd640 1 -- 172.21.15.53:0/155266329 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fea5c004a40 con 0x7fea64108ad0 2024-08-31T06:14:42.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.748+0000 7fea56ffd640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea500b4ca0 0x7fea500b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:42.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.748+0000 7fea69afa640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea500b4ca0 0x7fea500b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:42.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.748+0000 7fea56ffd640 1 -- 172.21.15.53:0/155266329 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7fea5c0e5b30 con 0x7fea64108ad0 2024-08-31T06:14:42.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.749+0000 7fea69afa640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea500b4ca0 0x7fea500b71b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fea60000c00 tx=0x7fea60005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:42.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.752+0000 7fea56ffd640 1 -- 172.21.15.53:0/155266329 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fea5c016030 con 0x7fea64108ad0 2024-08-31T06:14:42.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.974+0000 7fea6bd5e640 1 -- 172.21.15.53:0/155266329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea6419b2a0 con 0x7fea64108ad0 2024-08-31T06:14:42.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.975+0000 7fea56ffd640 1 -- 172.21.15.53:0/155266329 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+12007 (secure 0 0 0) 0x7fea5c0ac8a0 con 0x7fea64108ad0 2024-08-31T06:14:42.977 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:14:42.978 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":46,"btime":"2024-08-31T06:14:26:592569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:14:26.369272+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:14:42.978 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 46 2024-08-31T06:14:42.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 -- 172.21.15.53:0/155266329 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea500b4ca0 msgr2=0x7fea500b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:42.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea500b4ca0 0x7fea500b71b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fea60000c00 tx=0x7fea60005a20 comp rx=0 tx=0).stop 2024-08-31T06:14:42.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 -- 172.21.15.53:0/155266329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64108ad0 msgr2=0x7fea6419f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:42.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64108ad0 0x7fea6419f9b0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00eaa0 tx=0x7fea5c00ef60 comp rx=0 tx=0).stop 2024-08-31T06:14:42.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 -- 172.21.15.53:0/155266329 shutdown_connections 2024-08-31T06:14:42.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea500b4ca0 0x7fea500b71b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:42.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64108ad0 0x7fea6419f9b0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:42.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea64108180 0x7fea6419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:42.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 --2- 172.21.15.53:0/155266329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea64102fe0 0x7fea6419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:42.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 -- 172.21.15.53:0/155266329 >> 172.21.15.53:0/155266329 conn(0x7fea64077a60 msgr2=0x7fea641063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:42.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 -- 172.21.15.53:0/155266329 shutdown_connections 2024-08-31T06:14:42.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:42.978+0000 7fea6bd5e640 1 -- 172.21.15.53:0/155266329 wait complete. 2024-08-31T06:14:42.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.53 MB/sec execute 392 sec latency 12941.631 ms 2024-08-31T06:14:43.659 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:43 smithi053 ceph-mon[18924]: pgmap v624: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 183 KiB/s wr, 35 op/s 2024-08-31T06:14:43.659 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/155266329' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:14:43.660 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id e5bdbc69 --release --await' 2024-08-31T06:14:43.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id e5bdbc69 --release --await 2024-08-31T06:14:43.915 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:14:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:43 smithi153 ceph-mon[22320]: pgmap v624: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 183 KiB/s wr, 35 op/s 2024-08-31T06:14:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:43 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/155266329' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:14:43.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163258 1.52 MB/sec execute 393 sec latency 13941.672 ms 2024-08-31T06:14:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:43 smithi130 ceph-mon[22266]: pgmap v624: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 183 KiB/s wr, 35 op/s 2024-08-31T06:14:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:43 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/155266329' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:14:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.355+0000 7fbc92eea640 1 -- 172.21.15.53:0/4048803642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8c108cf0 msgr2=0x7fbc8c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.355+0000 7fbc92eea640 1 --2- 172.21.15.53:0/4048803642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8c108cf0 0x7fbc8c10f520 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009ca0 tx=0x7fbc8402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.355+0000 7fbc92eea640 1 -- 172.21.15.53:0/4048803642 shutdown_connections 2024-08-31T06:14:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.355+0000 7fbc92eea640 1 --2- 172.21.15.53:0/4048803642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8c108cf0 0x7fbc8c10f520 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.355+0000 7fbc92eea640 1 --2- 172.21.15.53:0/4048803642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc8c1083a0 0x7fbc8c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.355+0000 7fbc92eea640 1 --2- 172.21.15.53:0/4048803642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc8c102f60 0x7fbc8c103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.355+0000 7fbc92eea640 1 -- 172.21.15.53:0/4048803642 >> 172.21.15.53:0/4048803642 conn(0x7fbc8c079bd0 msgr2=0x7fbc8c079fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.355+0000 7fbc92eea640 1 -- 172.21.15.53:0/4048803642 shutdown_connections 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.356+0000 7fbc92eea640 1 -- 172.21.15.53:0/4048803642 wait complete. 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc92eea640 1 Processor -- start 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc92eea640 1 -- start start 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc92eea640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc8c102f60 0x7fbc8c19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc92eea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8c1083a0 0x7fbc8c19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc92eea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc8c108cf0 0x7fbc8c19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc92eea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1139b0 con 0x7fbc8c1083a0 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc92eea640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c113830 con 0x7fbc8c108cf0 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc92eea640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c113b30 con 0x7fbc8c102f60 2024-08-31T06:14:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8c1083a0 0x7fbc8c19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8c1083a0 0x7fbc8c19a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35692/0 (socket says 172.21.15.53:35692) 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc8bfff640 1 -- 172.21.15.53:0/4102835152 learned_addr learned my addr 172.21.15.53:0/4102835152 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc90c86640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc8c102f60 0x7fbc8c19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.357+0000 7fbc91487640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc8c108cf0 0x7fbc8c19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.358+0000 7fbc8bfff640 1 -- 172.21.15.53:0/4102835152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc8c102f60 msgr2=0x7fbc8c19a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.358+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc8c102f60 0x7fbc8c19a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.358+0000 7fbc8bfff640 1 -- 172.21.15.53:0/4102835152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc8c108cf0 msgr2=0x7fbc8c19fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.358+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc8c108cf0 0x7fbc8c19fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.358+0000 7fbc8bfff640 1 -- 172.21.15.53:0/4102835152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8c1a0290 con 0x7fbc8c1083a0 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.358+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8c1083a0 0x7fbc8c19a8c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800d740 tx=0x7fbc7800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.358+0000 7fbc89ffb640 1 -- 172.21.15.53:0/4102835152 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78017070 con 0x7fbc8c1083a0 2024-08-31T06:14:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.358+0000 7fbc92eea640 1 -- 172.21.15.53:0/4102835152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc8c1a0580 con 0x7fbc8c1083a0 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.358+0000 7fbc89ffb640 1 -- 172.21.15.53:0/4102835152 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc7800de50 con 0x7fbc8c1083a0 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.358+0000 7fbc89ffb640 1 -- 172.21.15.53:0/4102835152 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800f620 con 0x7fbc8c1083a0 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.358+0000 7fbc92eea640 1 -- 172.21.15.53:0/4102835152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc8c1a6ce0 con 0x7fbc8c1083a0 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc89ffb640 1 -- 172.21.15.53:0/4102835152 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbc7801a070 con 0x7fbc8c1083a0 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc9945f740 1 Processor -- start 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc9945f740 1 -- start start 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e489c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0bb660 0x55959e48a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0c3840 0x55959e48a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc9945f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55959e400a70 con 0x55959e0e4520 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc9945f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55959e3f0000 con 0x55959e0bb660 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc9945f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55959e3f3fb0 con 0x55959e0c3840 2024-08-31T06:14:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc91487640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e489c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc91487640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e489c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35704/0 (socket says 172.21.15.53:35704) 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc91487640 1 -- 172.21.15.53:0/3849265632 learned_addr learned my addr 172.21.15.53:0/3849265632 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.361+0000 7fbc90c86640 1 --2- 172.21.15.53:0/3849265632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0bb660 0x55959e48a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc89ffb640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc7c0b4ca0 0x7fbc7c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/3849265632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0c3840 0x55959e48a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc91487640 1 -- 172.21.15.53:0/3849265632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0c3840 msgr2=0x55959e48a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc91487640 1 --2- 172.21.15.53:0/3849265632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0c3840 0x55959e48a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc91487640 1 -- 172.21.15.53:0/3849265632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0bb660 msgr2=0x55959e48a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc91487640 1 --2- 172.21.15.53:0/3849265632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0bb660 0x55959e48a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc91487640 1 -- 172.21.15.53:0/3849265632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55959e14fb00 con 0x55959e0e4520 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc90c86640 1 --2- 172.21.15.53:0/3849265632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0bb660 0x55959e48a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc91487640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc7c0b4ca0 0x7fbc7c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc89ffb640 1 -- 172.21.15.53:0/4102835152 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7fbc780e5030 con 0x7fbc8c1083a0 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc91487640 1 --2- 172.21.15.53:0/3849265632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e489c80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fbc84005e30 tx=0x7fbc840314d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a61ab1ddacc8fdb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc76ffd640 1 -- 172.21.15.53:0/3849265632 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84003ab0 con 0x55959e0e4520 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc76ffd640 1 -- 172.21.15.53:0/3849265632 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc84036040 con 0x55959e0e4520 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.362+0000 7fbc76ffd640 1 -- 172.21.15.53:0/3849265632 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc840305c0 con 0x55959e0e4520 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.363+0000 7fbc9945f740 1 -- 172.21.15.53:0/3849265632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 msgr2=0x55959e489c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.363+0000 7fbc91487640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc7c0b4ca0 0x7fbc7c0b71b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbc8404c000 tx=0x7fbc84049000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.363+0000 7fbc9945f740 1 --2- 172.21.15.53:0/3849265632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e489c80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fbc84005e30 tx=0x7fbc840314d0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.363+0000 7fbc9945f740 1 -- 172.21.15.53:0/3849265632 shutdown_connections 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.363+0000 7fbc9945f740 1 --2- 172.21.15.53:0/3849265632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0c3840 0x55959e48a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.363+0000 7fbc9945f740 1 --2- 172.21.15.53:0/3849265632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0bb660 0x55959e48a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.363+0000 7fbc9945f740 1 --2- 172.21.15.53:0/3849265632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e489c80 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.363+0000 7fbc9945f740 1 -- 172.21.15.53:0/3849265632 >> 172.21.15.53:0/3849265632 conn(0x55959e0d8910 msgr2=0x55959e487b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.363+0000 7fbc9945f740 1 -- 172.21.15.53:0/3849265632 shutdown_connections 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.363+0000 7fbc9945f740 1 -- 172.21.15.53:0/3849265632 wait complete. 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc9945f740 1 -- start start 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc9945f740 1 Processor -- start 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0bb660 0x55959e4958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0c3840 0x55959e495df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0e4520 0x55959e4a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc9945f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55959e4982e0 con 0x55959e0c3840 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc9945f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55959e3b1520 con 0x55959e0bb660 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc9945f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55959e498460 con 0x55959e0e4520 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc9945f740 10 client.0 _ll_register_callbacks cb 0x55959e3e9c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0c3840 0x55959e495df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0c3840 0x55959e495df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35720/0 (socket says 172.21.15.53:35720) 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc8bfff640 1 -- 172.21.15.53:0/2226480177 learned_addr learned my addr 172.21.15.53:0/2226480177 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc91487640 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0e4520 0x55959e4a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.364+0000 7fbc90c86640 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0bb660 0x55959e4958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc8bfff640 1 -- 172.21.15.53:0/2226480177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0e4520 msgr2=0x55959e4a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0e4520 0x55959e4a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc8bfff640 1 -- 172.21.15.53:0/2226480177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0bb660 msgr2=0x55959e4958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0bb660 0x55959e4958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc8bfff640 1 -- 172.21.15.53:0/2226480177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55959e1c6960 con 0x55959e0c3840 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0c3840 0x55959e495df0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fbc780ab690 tx=0x7fbc780ab590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb32d439bf55129 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc6bfff640 1 -- 172.21.15.53:0/2226480177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78021070 con 0x55959e0c3840 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc6bfff640 1 -- 172.21.15.53:0/2226480177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7fbc780d1390 con 0x55959e0c3840 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc9945f740 1 -- 172.21.15.53:0/2226480177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55959e38f9a0 con 0x55959e0c3840 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc6bfff640 1 -- 172.21.15.53:0/2226480177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fbc780ab210 con 0x55959e0c3840 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc9945f740 10 client.18693 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc9945f740 1 -- 172.21.15.53:0/2226480177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55959e4a44b0 con 0x55959e0c3840 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.365+0000 7fbc6bfff640 1 -- 172.21.15.53:0/2226480177 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55959e38f9a0 con 0x55959e0c3840 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.366+0000 7fbc6bfff640 1 -- 172.21.15.53:0/2226480177 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7fbc780b4040 con 0x55959e0c3840 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.366+0000 7fbc9945f740 10 client.18693 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.366+0000 7fbc9945f740 10 client.18693 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.366+0000 7fbc9945f740 20 client.18693 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.366+0000 7fbc9945f740 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55959e0a2ea0 0x55959e4a7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.366+0000 7fbc9945f740 4 client.18693 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.366+0000 7fbc9945f740 1 -- 172.21.15.53:0/2226480177 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55959e4029c0 con 0x55959e0a2ea0 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.366+0000 7fbc90c86640 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55959e0a2ea0 0x55959e4a7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.366+0000 7fbc90c86640 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55959e0a2ea0 0x55959e4a7960 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f89d34f84fa1baa server_cookie=83249f21a606763f in_seq=0 out_seq=0 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.366+0000 7fbc6bfff640 10 client.18693 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.367+0000 7fbc6bfff640 1 -- 172.21.15.53:0/2226480177 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55959e4029c0 con 0x55959e0a2ea0 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.367+0000 7fbc6bfff640 10 client.18693 handle_command_reply: tid=0 2024-08-31T06:14:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.367+0000 7fbc9945f740 1 client.18693 shutdown 2024-08-31T06:14:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.368+0000 7fbc9945f740 1 -- 172.21.15.53:0/2226480177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0c3840 msgr2=0x55959e495df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.368+0000 7fbc9945f740 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0c3840 0x55959e495df0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fbc780ab690 tx=0x7fbc780ab590 comp rx=0 tx=0).stop 2024-08-31T06:14:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.368+0000 7fbc9945f740 1 -- 172.21.15.53:0/2226480177 shutdown_connections 2024-08-31T06:14:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.368+0000 7fbc9945f740 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55959e0a2ea0 0x55959e4a7960 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.368+0000 7fbc6bfff640 0 client.18693 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.368+0000 7fbc9945f740 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0e4520 0x55959e4a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.368+0000 7fbc9945f740 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0c3840 0x55959e495df0 secure :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fbc780ab690 tx=0x7fbc780ab590 comp rx=0 tx=0).stop 2024-08-31T06:14:44.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.368+0000 7fbc9945f740 1 --2- 172.21.15.53:0/2226480177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0bb660 0x55959e4958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.368+0000 7fbc9945f740 1 -- 172.21.15.53:0/2226480177 >> 172.21.15.53:0/2226480177 conn(0x55959e0d8910 msgr2=0x55959e48ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:44.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.368+0000 7fbc9945f740 1 -- 172.21.15.53:0/2226480177 shutdown_connections 2024-08-31T06:14:44.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.368+0000 7fbc9945f740 1 -- 172.21.15.53:0/2226480177 wait complete. 2024-08-31T06:14:44.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.369+0000 7fbc9945f740 20 client.18693 trim_cache size 0 max 16384 2024-08-31T06:14:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc9945f740 1 Processor -- start 2024-08-31T06:14:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc9945f740 1 -- start start 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0a2ea0 0x55959e48f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0bb660 0x55959e4ad550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e4ada90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc9945f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1af4d0 con 0x55959e0e4520 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc9945f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1b1220 con 0x55959e0a2ea0 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc9945f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1afba0 con 0x55959e0bb660 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc91487640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e4ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc91487640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e4ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35734/0 (socket says 172.21.15.53:35734) 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc91487640 1 -- 172.21.15.53:0/4277205386 learned_addr learned my addr 172.21.15.53:0/4277205386 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc90c86640 1 --2- 172.21.15.53:0/4277205386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0a2ea0 0x55959e48f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/4277205386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0bb660 0x55959e4ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc91487640 1 -- 172.21.15.53:0/4277205386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0bb660 msgr2=0x55959e4ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc91487640 1 --2- 172.21.15.53:0/4277205386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0bb660 0x55959e4ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc91487640 1 -- 172.21.15.53:0/4277205386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0a2ea0 msgr2=0x55959e48f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:44.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc91487640 1 --2- 172.21.15.53:0/4277205386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0a2ea0 0x55959e48f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.387+0000 7fbc91487640 1 -- 172.21.15.53:0/4277205386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55959e490f40 con 0x55959e0e4520 2024-08-31T06:14:44.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.388+0000 7fbc91487640 1 --2- 172.21.15.53:0/4277205386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e4ada90 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fbc84031750 tx=0x7fbc8403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b88940099391240 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:44.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.388+0000 7fbc767fc640 1 -- 172.21.15.53:0/4277205386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc840305c0 con 0x55959e0e4520 2024-08-31T06:14:44.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.388+0000 7fbc767fc640 1 -- 172.21.15.53:0/4277205386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc84036030 con 0x55959e0e4520 2024-08-31T06:14:44.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.388+0000 7fbc767fc640 1 -- 172.21.15.53:0/4277205386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84004040 con 0x55959e0e4520 2024-08-31T06:14:44.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.389+0000 7fbc9945f740 1 -- 172.21.15.53:0/4277205386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 msgr2=0x55959e4ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:44.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.389+0000 7fbc9945f740 1 --2- 172.21.15.53:0/4277205386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e4ada90 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fbc84031750 tx=0x7fbc8403e000 comp rx=0 tx=0).stop 2024-08-31T06:14:44.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.389+0000 7fbc9945f740 1 -- 172.21.15.53:0/4277205386 shutdown_connections 2024-08-31T06:14:44.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.389+0000 7fbc9945f740 1 --2- 172.21.15.53:0/4277205386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0e4520 0x55959e4ada90 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.389+0000 7fbc9945f740 1 --2- 172.21.15.53:0/4277205386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0bb660 0x55959e4ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.389+0000 7fbc9945f740 1 --2- 172.21.15.53:0/4277205386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0a2ea0 0x55959e48f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.389+0000 7fbc9945f740 1 -- 172.21.15.53:0/4277205386 >> 172.21.15.53:0/4277205386 conn(0x55959e0d8910 msgr2=0x55959e48ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.389+0000 7fbc9945f740 1 -- 172.21.15.53:0/4277205386 shutdown_connections 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.389+0000 7fbc9945f740 1 -- 172.21.15.53:0/4277205386 wait complete. 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.389+0000 7fbc9945f740 1 -- start start 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.389+0000 7fbc9945f740 1 Processor -- start 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0a2ea0 0x55959e49ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0bb660 0x55959e49a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc9945f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0e4520 0x55959e49a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc9945f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1b0a90 con 0x55959e0a2ea0 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc9945f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1b0330 con 0x55959e0e4520 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc9945f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1ad4d0 con 0x55959e0bb660 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc9945f740 10 client.0 _ll_register_callbacks cb 0x7fbc780a7e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:44.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc90c86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0a2ea0 0x55959e49ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc90c86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0a2ea0 0x55959e49ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35740/0 (socket says 172.21.15.53:35740) 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc90c86640 1 -- 172.21.15.53:0/1060049920 learned_addr learned my addr 172.21.15.53:0/1060049920 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc91487640 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0e4520 0x55959e49a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0bb660 0x55959e49a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc90c86640 1 -- 172.21.15.53:0/1060049920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0bb660 msgr2=0x55959e49a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc90c86640 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0bb660 0x55959e49a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc90c86640 1 -- 172.21.15.53:0/1060049920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0e4520 msgr2=0x55959e49a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc90c86640 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0e4520 0x55959e49a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc90c86640 1 -- 172.21.15.53:0/1060049920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55959e49af00 con 0x55959e0a2ea0 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc91487640 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0e4520 0x55959e49a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.390+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0bb660 0x55959e49a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc90c86640 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0a2ea0 0x55959e49ddc0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x55959e48c120 tx=0x7fbc80012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c427bd09095d72f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:44.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc6bfff640 1 -- 172.21.15.53:0/1060049920 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80028060 con 0x55959e0a2ea0 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc6bfff640 1 -- 172.21.15.53:0/1060049920 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7fbc80011850 con 0x55959e0a2ea0 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc9945f740 1 -- 172.21.15.53:0/1060049920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc84036030 con 0x55959e0a2ea0 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc6bfff640 1 -- 172.21.15.53:0/1060049920 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fbc80011a50 con 0x55959e0a2ea0 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc9945f740 10 client.18699 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc9945f740 1 -- 172.21.15.53:0/1060049920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55959e517290 con 0x55959e0a2ea0 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc6bfff640 1 -- 172.21.15.53:0/1060049920 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc84036030 con 0x55959e0a2ea0 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc6bfff640 1 -- 172.21.15.53:0/1060049920 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7fbc80023c30 con 0x55959e0a2ea0 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc9945f740 10 client.18699 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc9945f740 10 client.18699 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc9945f740 20 client.18699 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc9945f740 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55959e078250 0x55959e519af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc9945f740 4 client.18699 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e5bdbc69", "release": true, "await": true}] 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.391+0000 7fbc9945f740 1 -- 172.21.15.53:0/1060049920 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e5bdbc69", "release": true, "await": true}) -- 0x55959e3fe460 con 0x55959e078250 2024-08-31T06:14:44.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.392+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55959e078250 0x55959e519af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:44.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.392+0000 7fbc6bfff640 10 client.18699 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:44.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.392+0000 7fbc8bfff640 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55959e078250 0x55959e519af0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74096b87dcc16c95 server_cookie=cb8269260f843839 in_seq=0 out_seq=0 2024-08-31T06:14:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.413+0000 7fbc6bfff640 1 -- 172.21.15.53:0/1060049920 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55959e3fe460 con 0x55959e078250 2024-08-31T06:14:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.413+0000 7fbc6bfff640 10 client.18699 handle_command_reply: tid=0 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.413+0000 7fbc9945f740 1 client.18699 shutdown 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.413+0000 7fbc9945f740 1 -- 172.21.15.53:0/1060049920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0a2ea0 msgr2=0x55959e49ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.413+0000 7fbc9945f740 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0a2ea0 0x55959e49ddc0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x55959e48c120 tx=0x7fbc80012820 comp rx=0 tx=0).stop 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc9945f740 1 -- 172.21.15.53:0/1060049920 shutdown_connections 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc9945f740 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55959e078250 0x55959e519af0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc9945f740 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55959e0e4520 0x55959e49a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc9945f740 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55959e0bb660 0x55959e49a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc6bfff640 0 client.18699 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc9945f740 1 --2- 172.21.15.53:0/1060049920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959e0a2ea0 0x55959e49ddc0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc9945f740 1 -- 172.21.15.53:0/1060049920 >> 172.21.15.53:0/1060049920 conn(0x55959e0d8910 msgr2=0x55959e48ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc9945f740 1 -- 172.21.15.53:0/1060049920 shutdown_connections 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc9945f740 1 -- 172.21.15.53:0/1060049920 wait complete. 2024-08-31T06:14:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc9945f740 20 client.18699 trim_cache size 0 max 16384 2024-08-31T06:14:44.418 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:14:44.418 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 46, 2024-08-31T06:14:44.418 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:14:44.418 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 32, 2024-08-31T06:14:44.418 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:14:44.418 INFO:teuthology.orchestra.run.smithi053.stdout: "e5bdbc69": { 2024-08-31T06:14:44.418 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 32, 2024-08-31T06:14:44.418 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:14:44.418 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:14:44.418 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 135.5, 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:44.419 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:44.420 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:44.420 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:14:44.420 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:14:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc92eea640 1 -- 172.21.15.53:0/4102835152 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc7c0b4ca0 msgr2=0x7fbc7c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc92eea640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc7c0b4ca0 0x7fbc7c0b71b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbc8404c000 tx=0x7fbc84049000 comp rx=0 tx=0).stop 2024-08-31T06:14:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc92eea640 1 -- 172.21.15.53:0/4102835152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8c1083a0 msgr2=0x7fbc8c19a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.414+0000 7fbc92eea640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8c1083a0 0x7fbc8c19a8c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800d740 tx=0x7fbc7800dc00 comp rx=0 tx=0).stop 2024-08-31T06:14:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.415+0000 7fbc92eea640 1 -- 172.21.15.53:0/4102835152 shutdown_connections 2024-08-31T06:14:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.415+0000 7fbc92eea640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbc7c0b4ca0 0x7fbc7c0b71b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.415+0000 7fbc92eea640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc8c108cf0 0x7fbc8c19fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.415+0000 7fbc92eea640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8c1083a0 0x7fbc8c19a8c0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.415+0000 7fbc92eea640 1 --2- 172.21.15.53:0/4102835152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc8c102f60 0x7fbc8c19a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.415+0000 7fbc92eea640 1 -- 172.21.15.53:0/4102835152 >> 172.21.15.53:0/4102835152 conn(0x7fbc8c079bd0 msgr2=0x7fbc8c104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.415+0000 7fbc92eea640 1 -- 172.21.15.53:0/4102835152 shutdown_connections 2024-08-31T06:14:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:14:44.415+0000 7fbc92eea640 1 -- 172.21.15.53:0/4102835152 wait complete. 2024-08-31T06:14:44.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163323 1.52 MB/sec execute 394 sec latency 14372.265 ms 2024-08-31T06:14:45.130 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e5bdbc69', total seconds elapsed: 18.6 2024-08-31T06:14:45.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:45 smithi153 ceph-mon[22320]: pgmap v625: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 88 KiB/s wr, 37 op/s 2024-08-31T06:14:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:45 smithi053 ceph-mon[18924]: pgmap v625: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 88 KiB/s wr, 37 op/s 2024-08-31T06:14:45.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163323 1.52 MB/sec execute 395 sec latency 1349.240 ms 2024-08-31T06:14:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:45 smithi130 ceph-mon[22266]: pgmap v625: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 88 KiB/s wr, 37 op/s 2024-08-31T06:14:46.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163495 1.51 MB/sec execute 396 sec latency 1603.705 ms 2024-08-31T06:14:47.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:47 smithi153 ceph-mon[22320]: pgmap v626: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 26 op/s 2024-08-31T06:14:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:47 smithi053 ceph-mon[18924]: pgmap v626: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 26 op/s 2024-08-31T06:14:47.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 163745 1.51 MB/sec execute 397 sec latency 16.443 ms 2024-08-31T06:14:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:47 smithi130 ceph-mon[22266]: pgmap v626: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 26 op/s 2024-08-31T06:14:48.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:48 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:14:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:48 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:14:48.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 164173 1.51 MB/sec execute 398 sec latency 14.533 ms 2024-08-31T06:14:49.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:48 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:14:49.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 164675 1.52 MB/sec execute 399 sec latency 24.251 ms 2024-08-31T06:14:50.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:50 smithi130 ceph-mon[22266]: pgmap v627: 97 pgs: 97 active+clean; 93 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 89 KiB/s wr, 35 op/s 2024-08-31T06:14:50.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:14:50.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:14:50.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:50 smithi153 ceph-mon[22320]: pgmap v627: 97 pgs: 97 active+clean; 93 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 89 KiB/s wr, 35 op/s 2024-08-31T06:14:50.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:14:50.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:14:50.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:50 smithi053 ceph-mon[18924]: pgmap v627: 97 pgs: 97 active+clean; 93 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 89 KiB/s wr, 35 op/s 2024-08-31T06:14:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:14:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:14:50.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:14:50.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 165186 1.51 MB/sec execute 400 sec latency 21.230 ms 2024-08-31T06:14:51.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:51 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:14:51.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:51 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:14:51.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:51 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:14:51.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:51 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:14:51.430 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.428+0000 7f7edaf58640 1 -- 172.21.15.53:0/387388258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed41046a0 msgr2=0x7f7ed4104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:51.430 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.428+0000 7f7edaf58640 1 --2- 172.21.15.53:0/387388258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed41046a0 0x7f7ed4104ab0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009900 tx=0x7f7ec802a410 comp rx=0 tx=0).stop 2024-08-31T06:14:51.430 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.428+0000 7f7edaf58640 1 -- 172.21.15.53:0/387388258 shutdown_connections 2024-08-31T06:14:51.430 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.428+0000 7f7edaf58640 1 --2- 172.21.15.53:0/387388258 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed410db00 0x7f7ed410fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.431 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.428+0000 7f7edaf58640 1 --2- 172.21.15.53:0/387388258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ed4104ff0 0x7f7ed410d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.431 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.428+0000 7f7edaf58640 1 --2- 172.21.15.53:0/387388258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed41046a0 0x7f7ed4104ab0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.431 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.428+0000 7f7edaf58640 1 -- 172.21.15.53:0/387388258 >> 172.21.15.53:0/387388258 conn(0x7f7ed407a4e0 msgr2=0x7f7ed407a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:51.431 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.428+0000 7f7edaf58640 1 -- 172.21.15.53:0/387388258 shutdown_connections 2024-08-31T06:14:51.431 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.428+0000 7f7edaf58640 1 -- 172.21.15.53:0/387388258 wait complete. 2024-08-31T06:14:51.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7edaf58640 1 Processor -- start 2024-08-31T06:14:51.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7edaf58640 1 -- start start 2024-08-31T06:14:51.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7edaf58640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed41046a0 0x7f7ed419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7edaf58640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ed4104ff0 0x7f7ed419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7edaf58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed410db00 0x7f7ed419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7edaf58640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed4113620 con 0x7f7ed410db00 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7edaf58640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed41134a0 con 0x7f7ed41046a0 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7edaf58640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed41137a0 con 0x7f7ed4104ff0 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed94f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed410db00 0x7f7ed419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed94f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed410db00 0x7f7ed419f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35766/0 (socket says 172.21.15.53:35766) 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed94f5640 1 -- 172.21.15.53:0/3354007269 learned_addr learned my addr 172.21.15.53:0/3354007269 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed8cf4640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed41046a0 0x7f7ed419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ed4104ff0 0x7f7ed419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed94f5640 1 -- 172.21.15.53:0/3354007269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ed4104ff0 msgr2=0x7f7ed419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed94f5640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ed4104ff0 0x7f7ed419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed94f5640 1 -- 172.21.15.53:0/3354007269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed41046a0 msgr2=0x7f7ed419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed94f5640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed41046a0 0x7f7ed419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed94f5640 1 -- 172.21.15.53:0/3354007269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed41a0030 con 0x7f7ed410db00 2024-08-31T06:14:51.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed8cf4640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed41046a0 0x7f7ed419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:14:51.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.429+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ed4104ff0 0x7f7ed419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:51.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.430+0000 7f7ed94f5640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed410db00 0x7f7ed419f930 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00eb10 tx=0x7f7ecc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:51.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.430+0000 7f7ed1ffb640 1 -- 172.21.15.53:0/3354007269 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc004b20 con 0x7f7ed410db00 2024-08-31T06:14:51.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.430+0000 7f7ed1ffb640 1 -- 172.21.15.53:0/3354007269 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ecc004cc0 con 0x7f7ed410db00 2024-08-31T06:14:51.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.430+0000 7f7edaf58640 1 -- 172.21.15.53:0/3354007269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed41a0320 con 0x7f7ed410db00 2024-08-31T06:14:51.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.430+0000 7f7ed1ffb640 1 -- 172.21.15.53:0/3354007269 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc010690 con 0x7f7ed410db00 2024-08-31T06:14:51.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.430+0000 7f7edaf58640 1 -- 172.21.15.53:0/3354007269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed41a6ab0 con 0x7f7ed410db00 2024-08-31T06:14:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ee1ec1740 1 Processor -- start 2024-08-31T06:14:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ed1ffb640 1 -- 172.21.15.53:0/3354007269 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7ecc005020 con 0x7f7ed410db00 2024-08-31T06:14:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ee1ec1740 1 -- start start 2024-08-31T06:14:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77678ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772ac2f0 0x562b77679000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b77679540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562b775ee000 con 0x562b772d51b0 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562b775dd590 con 0x562b772ac2f0 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562b775e1540 con 0x562b772b44d0 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ed3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77678ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ed3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77678ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35774/0 (socket says 172.21.15.53:35774) 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.433+0000 7f7ed3fff640 1 -- 172.21.15.53:0/2681823092 learned_addr learned my addr 172.21.15.53:0/2681823092 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ed8cf4640 1 --2- 172.21.15.53:0/2681823092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772ac2f0 0x562b77679000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/2681823092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b77679540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ed1ffb640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec40b4ca0 0x7f7ec40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ed3fff640 1 -- 172.21.15.53:0/2681823092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 msgr2=0x562b77679540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/2681823092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b77679540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ed3fff640 1 -- 172.21.15.53:0/2681823092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772ac2f0 msgr2=0x562b77679000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/2681823092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772ac2f0 0x562b77679000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ed3fff640 1 -- 172.21.15.53:0/2681823092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b77340790 con 0x562b772d51b0 2024-08-31T06:14:51.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ed94f5640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec40b4ca0 0x7f7ec40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ed1ffb640 1 -- 172.21.15.53:0/3354007269 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f7ecc0e5c30 con 0x7f7ed410db00 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/2681823092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77678ac0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009e50 tx=0x7f7ec00096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea13cb194aaa4277 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ebeffd640 1 -- 172.21.15.53:0/2681823092 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0012da0 con 0x562b772d51b0 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ebeffd640 1 -- 172.21.15.53:0/2681823092 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ec0018020 con 0x562b772d51b0 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.434+0000 7f7ebeffd640 1 -- 172.21.15.53:0/2681823092 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0003a70 con 0x562b772d51b0 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.435+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/2681823092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 msgr2=0x562b77678ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.435+0000 7f7ed94f5640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec40b4ca0 0x7f7ec40b71b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0e3960 tx=0x7f7ecc0763a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.435+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/2681823092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77678ac0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009e50 tx=0x7f7ec00096a0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.435+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/2681823092 shutdown_connections 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.435+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/2681823092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b77679540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.435+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/2681823092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772ac2f0 0x562b77679000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.435+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/2681823092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77678ac0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.435+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/2681823092 >> 172.21.15.53:0/2681823092 conn(0x562b772c9300 msgr2=0x562b776769b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.435+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/2681823092 shutdown_connections 2024-08-31T06:14:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.435+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/2681823092 wait complete. 2024-08-31T06:14:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.436+0000 7f7ee1ec1740 1 -- start start 2024-08-31T06:14:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.436+0000 7f7ee1ec1740 1 Processor -- start 2024-08-31T06:14:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.436+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772ac2f0 0x562b77684650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.436+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b77684b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.436+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77690530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.436+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562b77516ab0 con 0x562b772d51b0 2024-08-31T06:14:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.436+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562b77564680 con 0x562b772ac2f0 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.436+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562b77687240 con 0x562b772b44d0 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.436+0000 7f7ee1ec1740 10 client.0 _ll_register_callbacks cb 0x562b772eca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ed3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77690530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ed3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77690530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35786/0 (socket says 172.21.15.53:35786) 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ed3fff640 1 -- 172.21.15.53:0/198775658 learned_addr learned my addr 172.21.15.53:0/198775658 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772ac2f0 0x562b77684650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ed8cf4640 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b77684b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ed3fff640 1 -- 172.21.15.53:0/198775658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 msgr2=0x562b77684b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b77684b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ed3fff640 1 -- 172.21.15.53:0/198775658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772ac2f0 msgr2=0x562b77684650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772ac2f0 0x562b77684650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ed3fff640 1 -- 172.21.15.53:0/198775658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b773b9620 con 0x562b772d51b0 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77690530 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009b20 tx=0x7f7ec0003690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b2522e3b9aea6b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7eb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7eb3fff640 1 -- 172.21.15.53:0/198775658 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0003fc0 con 0x562b772d51b0 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7eb3fff640 1 -- 172.21.15.53:0/198775658 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f7ec0004160 con 0x562b772d51b0 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/198775658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ec0018020 con 0x562b772d51b0 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7eb3fff640 1 -- 172.21.15.53:0/198775658 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f7ec0031050 con 0x562b772d51b0 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ee1ec1740 10 client.18711 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.437+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/198775658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x562b77693230 con 0x562b772d51b0 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.438+0000 7f7eb3fff640 1 -- 172.21.15.53:0/198775658 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ec0018020 con 0x562b772d51b0 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.438+0000 7f7eb3fff640 1 -- 172.21.15.53:0/198775658 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f7ec000f040 con 0x562b772d51b0 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.438+0000 7f7ee1ec1740 10 client.18711 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.438+0000 7f7ee1ec1740 10 client.18711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.438+0000 7f7ee1ec1740 20 client.18711 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.438+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562b77293d80 0x562b776966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.438+0000 7f7ee1ec1740 4 client.18711 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.438+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/198775658 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b775eff50 con 0x562b77293d80 2024-08-31T06:14:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.438+0000 7f7ed8cf4640 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562b77293d80 0x562b776966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.439+0000 7f7eb3fff640 10 client.18711 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.439+0000 7f7ed8cf4640 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562b77293d80 0x562b776966a0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2f9709f60bff7f9 server_cookie=47b6df94cf46ee95 in_seq=0 out_seq=0 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.439+0000 7f7eb3fff640 1 -- 172.21.15.53:0/198775658 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b775eff50 con 0x562b77293d80 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.439+0000 7f7eb3fff640 10 client.18711 handle_command_reply: tid=0 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.439+0000 7f7ee1ec1740 1 client.18711 shutdown 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/198775658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 msgr2=0x562b77690530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77690530 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009b20 tx=0x7f7ec0003690 comp rx=0 tx=0).stop 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/198775658 shutdown_connections 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562b77293d80 0x562b776966a0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772d51b0 0x562b77690530 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b77684b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7eb3fff640 0 client.18711 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/198775658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772ac2f0 0x562b77684650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/198775658 >> 172.21.15.53:0/198775658 conn(0x562b772c9300 msgr2=0x562b77679af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/198775658 shutdown_connections 2024-08-31T06:14:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/198775658 wait complete. 2024-08-31T06:14:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.440+0000 7f7ee1ec1740 20 client.18711 trim_cache size 0 max 16384 2024-08-31T06:14:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.457+0000 7f7ee1ec1740 1 Processor -- start 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.457+0000 7f7ee1ec1740 1 -- start start 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.457+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b77293d80 0x562b77682ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.457+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772ac2f0 0x562b776831e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.457+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772b44d0 0x562b77690430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.457+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed41af4e0 con 0x562b77293d80 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.457+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed41b1230 con 0x562b772b44d0 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.457+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed41afbb0 con 0x562b772ac2f0 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b77293d80 0x562b77682ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b77293d80 0x562b77682ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35788/0 (socket says 172.21.15.53:35788) 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed3fff640 1 -- 172.21.15.53:0/1232629422 learned_addr learned my addr 172.21.15.53:0/1232629422 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/1232629422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772b44d0 0x562b77690430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed8cf4640 1 --2- 172.21.15.53:0/1232629422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772ac2f0 0x562b776831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed3fff640 1 -- 172.21.15.53:0/1232629422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772ac2f0 msgr2=0x562b776831e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/1232629422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772ac2f0 0x562b776831e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed3fff640 1 -- 172.21.15.53:0/1232629422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772b44d0 msgr2=0x562b77690430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/1232629422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772b44d0 0x562b77690430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed3fff640 1 -- 172.21.15.53:0/1232629422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b7767e540 con 0x562b77293d80 2024-08-31T06:14:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed8cf4640 1 --2- 172.21.15.53:0/1232629422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772ac2f0 0x562b776831e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/1232629422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b77293d80 0x562b77682ca0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0005dc0 tx=0x7f7ec0005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fc0dfdf8055a8c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ebe7fc640 1 -- 172.21.15.53:0/1232629422 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0012b30 con 0x562b77293d80 2024-08-31T06:14:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ebe7fc640 1 -- 172.21.15.53:0/1232629422 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ec0018040 con 0x562b77293d80 2024-08-31T06:14:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.458+0000 7f7ebe7fc640 1 -- 172.21.15.53:0/1232629422 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec001d6b0 con 0x562b77293d80 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.459+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/1232629422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b77293d80 msgr2=0x562b77682ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.459+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/1232629422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b77293d80 0x562b77682ca0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0005dc0 tx=0x7f7ec0005d30 comp rx=0 tx=0).stop 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.459+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/1232629422 shutdown_connections 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.459+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/1232629422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b772b44d0 0x562b77690430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.459+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/1232629422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772ac2f0 0x562b776831e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.459+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/1232629422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b77293d80 0x562b77682ca0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.459+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/1232629422 >> 172.21.15.53:0/1232629422 conn(0x562b772c9300 msgr2=0x562b7767f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.459+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/1232629422 shutdown_connections 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.459+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/1232629422 wait complete. 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ee1ec1740 1 -- start start 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ee1ec1740 1 Processor -- start 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b77293d80 0x562b77688650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772ac2f0 0x562b77688b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ee1ec1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b776890d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed41b0aa0 con 0x562b772ac2f0 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed41b0340 con 0x562b77293d80 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ee1ec1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed41ad4e0 con 0x562b772b44d0 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ee1ec1740 10 client.0 _ll_register_callbacks cb 0x7f7ecc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ed8cf4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772ac2f0 0x562b77688b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ed8cf4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772ac2f0 0x562b77688b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35800/0 (socket says 172.21.15.53:35800) 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ed8cf4640 1 -- 172.21.15.53:0/51014860 learned_addr learned my addr 172.21.15.53:0/51014860 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.460+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b77293d80 0x562b77688650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b776890d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7ed8cf4640 1 -- 172.21.15.53:0/51014860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 msgr2=0x562b776890d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7ed8cf4640 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b776890d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7ed8cf4640 1 -- 172.21.15.53:0/51014860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b77293d80 msgr2=0x562b77688650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:14:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7ed8cf4640 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b77293d80 0x562b77688650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7ed8cf4640 1 -- 172.21.15.53:0/51014860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b77700190 con 0x562b772ac2f0 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b776890d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7ed8cf4640 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772ac2f0 0x562b77688b90 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8032fd0 tx=0x7f7ec8004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61de16876fbb44a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7eb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7eb3fff640 1 -- 172.21.15.53:0/51014860 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8035040 con 0x562b772ac2f0 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7eb3fff640 1 -- 172.21.15.53:0/51014860 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f7ec8005240 con 0x562b772ac2f0 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/51014860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ec0018040 con 0x562b772ac2f0 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7eb3fff640 1 -- 172.21.15.53:0/51014860 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f7ec8053050 con 0x562b772ac2f0 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7ee1ec1740 10 client.18717 fetch_fsmap learned FSMap version 46 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/51014860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x562b77701390 con 0x562b772ac2f0 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.461+0000 7f7eb3fff640 1 -- 172.21.15.53:0/51014860 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ec0018040 con 0x562b772ac2f0 2024-08-31T06:14:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.462+0000 7f7eb3fff640 1 -- 172.21.15.53:0/51014860 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f7ec80035f0 con 0x562b772ac2f0 2024-08-31T06:14:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.462+0000 7f7ee1ec1740 10 client.18717 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:14:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.462+0000 7f7ee1ec1740 10 client.18717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:14:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.462+0000 7f7ee1ec1740 20 client.18717 populate_metadata read hostname 'smithi053' 2024-08-31T06:14:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.462+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562b772d51b0 0x562b77703c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:14:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.462+0000 7f7ee1ec1740 4 client.18717 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:14:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.462+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/51014860 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b775eb9f0 con 0x562b772d51b0 2024-08-31T06:14:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.462+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562b772d51b0 0x562b77703c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:14:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.462+0000 7f7eb3fff640 10 client.18717 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.462+0000 7f7ed3fff640 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562b772d51b0 0x562b77703c60 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f4cf2208c4fe46 server_cookie=2302348dbf88409c in_seq=0 out_seq=0 2024-08-31T06:14:51.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:51 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:14:51.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:51 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:14:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.486+0000 7f7eb3fff640 1 -- 172.21.15.53:0/51014860 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b775eb9f0 con 0x562b772d51b0 2024-08-31T06:14:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.486+0000 7f7eb3fff640 10 client.18717 handle_command_reply: tid=0 2024-08-31T06:14:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.486+0000 7f7ee1ec1740 1 client.18717 shutdown 2024-08-31T06:14:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.486+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/51014860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772ac2f0 msgr2=0x562b77688b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.486+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772ac2f0 0x562b77688b90 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8032fd0 tx=0x7f7ec8004120 comp rx=0 tx=0).stop 2024-08-31T06:14:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/51014860 shutdown_connections 2024-08-31T06:14:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562b772d51b0 0x562b77703c60 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b772b44d0 0x562b776890d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b772ac2f0 0x562b77688b90 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7ee1ec1740 1 --2- 172.21.15.53:0/51014860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562b77293d80 0x562b77688650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7eb3fff640 0 client.18717 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:14:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/51014860 >> 172.21.15.53:0/51014860 conn(0x562b772c9300 msgr2=0x562b77682bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/51014860 shutdown_connections 2024-08-31T06:14:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7ee1ec1740 1 -- 172.21.15.53:0/51014860 wait complete. 2024-08-31T06:14:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7ee1ec1740 20 client.18717 trim_cache size 0 max 16384 2024-08-31T06:14:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:14:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:14:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:14:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:14:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7edaf58640 1 -- 172.21.15.53:0/3354007269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec40b4ca0 msgr2=0x7f7ec40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7edaf58640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec40b4ca0 0x7f7ec40b71b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0e3960 tx=0x7f7ecc0763a0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7edaf58640 1 -- 172.21.15.53:0/3354007269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed410db00 msgr2=0x7f7ed419f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:14:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7edaf58640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed410db00 0x7f7ed419f930 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00eb10 tx=0x7f7ecc00c2d0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7edaf58640 1 -- 172.21.15.53:0/3354007269 shutdown_connections 2024-08-31T06:14:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7edaf58640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ec40b4ca0 0x7f7ec40b71b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7edaf58640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed410db00 0x7f7ed419f930 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7edaf58640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ed4104ff0 0x7f7ed419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.487+0000 7f7edaf58640 1 --2- 172.21.15.53:0/3354007269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed41046a0 0x7f7ed419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:14:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.488+0000 7f7edaf58640 1 -- 172.21.15.53:0/3354007269 >> 172.21.15.53:0/3354007269 conn(0x7f7ed407a4e0 msgr2=0x7f7ed40ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:14:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.488+0000 7f7edaf58640 1 -- 172.21.15.53:0/3354007269 shutdown_connections 2024-08-31T06:14:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:14:51.488+0000 7f7edaf58640 1 -- 172.21.15.53:0/3354007269 wait complete. 2024-08-31T06:14:51.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 165657 1.52 MB/sec execute 401 sec latency 23.519 ms 2024-08-31T06:14:52.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:52 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:14:52.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:52 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:14:52.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:52 smithi130 ceph-mon[22266]: pgmap v628: 97 pgs: 97 active+clean; 93 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 372 KiB/s wr, 59 op/s 2024-08-31T06:14:52.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:52 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:14:52.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:52 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:14:52.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:52 smithi153 ceph-mon[22320]: pgmap v628: 97 pgs: 97 active+clean; 93 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 372 KiB/s wr, 59 op/s 2024-08-31T06:14:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:52 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:14:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:52 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:14:52.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:52 smithi053 ceph-mon[18924]: pgmap v628: 97 pgs: 97 active+clean; 93 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 372 KiB/s wr, 59 op/s 2024-08-31T06:14:52.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 166450 1.53 MB/sec execute 402 sec latency 12.164 ms 2024-08-31T06:14:53.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 166799 1.53 MB/sec execute 403 sec latency 23.251 ms 2024-08-31T06:14:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:54 smithi130 ceph-mon[22266]: pgmap v629: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 399 KiB/s wr, 53 op/s 2024-08-31T06:14:54.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:54 smithi153 ceph-mon[22320]: pgmap v629: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 399 KiB/s wr, 53 op/s 2024-08-31T06:14:54.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:54 smithi053 ceph-mon[18924]: pgmap v629: 97 pgs: 97 active+clean; 92 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 399 KiB/s wr, 53 op/s 2024-08-31T06:14:54.990 INFO:tasks.workunit.client.0.smithi053.stdout: 1 166799 1.53 MB/sec execute 404 sec latency 1023.352 ms 2024-08-31T06:14:55.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 166799 1.53 MB/sec execute 405 sec latency 2023.420 ms 2024-08-31T06:14:56.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:56 smithi130 ceph-mon[22266]: pgmap v630: 97 pgs: 97 active+clean; 94 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 671 KiB/s wr, 92 op/s 2024-08-31T06:14:56.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:56 smithi153 ceph-mon[22320]: pgmap v630: 97 pgs: 97 active+clean; 94 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 671 KiB/s wr, 92 op/s 2024-08-31T06:14:56.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:56 smithi053 ceph-mon[18924]: pgmap v630: 97 pgs: 97 active+clean; 94 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 671 KiB/s wr, 92 op/s 2024-08-31T06:14:56.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 166866 1.52 MB/sec execute 406 sec latency 2281.125 ms 2024-08-31T06:14:57.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 166866 1.52 MB/sec execute 407 sec latency 1490.506 ms 2024-08-31T06:14:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:14:58 smithi130 ceph-mon[22266]: pgmap v631: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 919 KiB/s wr, 99 op/s 2024-08-31T06:14:58.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:14:58 smithi153 ceph-mon[22320]: pgmap v631: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 919 KiB/s wr, 99 op/s 2024-08-31T06:14:58.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:14:58 smithi053 ceph-mon[18924]: pgmap v631: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 919 KiB/s wr, 99 op/s 2024-08-31T06:14:58.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 166866 1.51 MB/sec execute 408 sec latency 2490.558 ms 2024-08-31T06:14:59.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 166866 1.51 MB/sec execute 409 sec latency 3490.613 ms 2024-08-31T06:15:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:00 smithi130 ceph-mon[22266]: pgmap v632: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 1004 KiB/s wr, 103 op/s 2024-08-31T06:15:00.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:00 smithi153 ceph-mon[22320]: pgmap v632: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 1004 KiB/s wr, 103 op/s 2024-08-31T06:15:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:00 smithi053 ceph-mon[18924]: pgmap v632: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 1004 KiB/s wr, 103 op/s 2024-08-31T06:15:00.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 166866 1.51 MB/sec execute 410 sec latency 4490.695 ms 2024-08-31T06:15:01.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 167055 1.51 MB/sec execute 411 sec latency 4747.647 ms 2024-08-31T06:15:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:02 smithi130 ceph-mon[22266]: pgmap v633: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 981 KiB/s wr, 100 op/s 2024-08-31T06:15:02.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:02 smithi153 ceph-mon[22320]: pgmap v633: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 981 KiB/s wr, 100 op/s 2024-08-31T06:15:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:02 smithi053 ceph-mon[18924]: pgmap v633: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 981 KiB/s wr, 100 op/s 2024-08-31T06:15:02.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 167318 1.50 MB/sec execute 412 sec latency 16.323 ms 2024-08-31T06:15:03.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 167791 1.50 MB/sec execute 413 sec latency 15.557 ms 2024-08-31T06:15:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:04 smithi130 ceph-mon[22266]: pgmap v634: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 698 KiB/s wr, 74 op/s 2024-08-31T06:15:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:04 smithi153 ceph-mon[22320]: pgmap v634: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 698 KiB/s wr, 74 op/s 2024-08-31T06:15:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:04 smithi053 ceph-mon[18924]: pgmap v634: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 698 KiB/s wr, 74 op/s 2024-08-31T06:15:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.592+0000 7f32b65c6640 1 -- 172.21.15.53:0/1766360514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32b01027b0 msgr2=0x7f32b0102bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.592+0000 7f32b65c6640 1 --2- 172.21.15.53:0/1766360514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32b01027b0 0x7f32b0102bc0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009900 tx=0x7f32a002a410 comp rx=0 tx=0).stop 2024-08-31T06:15:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.593+0000 7f32b65c6640 1 -- 172.21.15.53:0/1766360514 shutdown_connections 2024-08-31T06:15:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.593+0000 7f32b65c6640 1 --2- 172.21.15.53:0/1766360514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32b0108a30 0x7f32b010f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.593+0000 7f32b65c6640 1 --2- 172.21.15.53:0/1766360514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b01080e0 0x7f32b01084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.593+0000 7f32b65c6640 1 --2- 172.21.15.53:0/1766360514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32b01027b0 0x7f32b0102bc0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.593+0000 7f32b65c6640 1 -- 172.21.15.53:0/1766360514 >> 172.21.15.53:0/1766360514 conn(0x7f32b00fe1b0 msgr2=0x7f32b0100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.593+0000 7f32b65c6640 1 -- 172.21.15.53:0/1766360514 shutdown_connections 2024-08-31T06:15:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.593+0000 7f32b65c6640 1 -- 172.21.15.53:0/1766360514 wait complete. 2024-08-31T06:15:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.593+0000 7f32b65c6640 1 Processor -- start 2024-08-31T06:15:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.593+0000 7f32b65c6640 1 -- start start 2024-08-31T06:15:04.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32b65c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32b01027b0 0x7f32b0199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32b65c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32b01080e0 0x7f32b0199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32b65c6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b0108a30 0x7f32b019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32b65c6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32b01125b0 con 0x7f32b01027b0 2024-08-31T06:15:04.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32b65c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32b0112430 con 0x7f32b01080e0 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32b65c6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32b0112730 con 0x7f32b0108a30 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32b01027b0 0x7f32b0199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32b01027b0 0x7f32b0199070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52224/0 (socket says 172.21.15.53:52224) 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32affff640 1 -- 172.21.15.53:0/2204904211 learned_addr learned my addr 172.21.15.53:0/2204904211 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32a7fff640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32b01080e0 0x7f32b0199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32b4b63640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b0108a30 0x7f32b019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32affff640 1 -- 172.21.15.53:0/2204904211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b0108a30 msgr2=0x7f32b019e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32affff640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b0108a30 0x7f32b019e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32affff640 1 -- 172.21.15.53:0/2204904211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32b01080e0 msgr2=0x7f32b0199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32affff640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32b01080e0 0x7f32b0199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32affff640 1 -- 172.21.15.53:0/2204904211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b019efa0 con 0x7f32b01027b0 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32b4b63640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b0108a30 0x7f32b019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.594+0000 7f32affff640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32b01027b0 0x7f32b0199070 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009230 tx=0x7f32a00319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.595+0000 7f32adffb640 1 -- 172.21.15.53:0/2204904211 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a0046070 con 0x7f32b01027b0 2024-08-31T06:15:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.595+0000 7f32b65c6640 1 -- 172.21.15.53:0/2204904211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b019f230 con 0x7f32b01027b0 2024-08-31T06:15:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.595+0000 7f32adffb640 1 -- 172.21.15.53:0/2204904211 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32a0004350 con 0x7f32b01027b0 2024-08-31T06:15:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.595+0000 7f32adffb640 1 -- 172.21.15.53:0/2204904211 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a0035050 con 0x7f32b01027b0 2024-08-31T06:15:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.595+0000 7f32b65c6640 1 -- 172.21.15.53:0/2204904211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b006b360 con 0x7f32b01027b0 2024-08-31T06:15:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.597+0000 7f32adffb640 1 -- 172.21.15.53:0/2204904211 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f32a0049070 con 0x7f32b01027b0 2024-08-31T06:15:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32bd61c740 1 Processor -- start 2024-08-31T06:15:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32bd61c740 1 -- start start 2024-08-31T06:15:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80ff71b0 0x559d8139aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d8139b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d8139b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32bd61c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559d81310000 con 0x559d80fce2f0 2024-08-31T06:15:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32bd61c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559d812ff590 con 0x559d80ff71b0 2024-08-31T06:15:04.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32bd61c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559d81303540 con 0x559d80fd64d0 2024-08-31T06:15:04.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d8139b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32b4b63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80ff71b0 0x559d8139aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d8139b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52232/0 (socket says 172.21.15.53:52232) 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32b4b63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80ff71b0 0x559d8139aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:35062/0 (socket says 172.21.15.53:35062) 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32affff640 1 -- 172.21.15.53:0/1500824459 learned_addr learned my addr 172.21.15.53:0/1500824459 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32adffb640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f329c0b4ca0 0x7f329c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.598+0000 7f32a7fff640 1 --2- 172.21.15.53:0/1500824459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d8139b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32affff640 1 -- 172.21.15.53:0/1500824459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 msgr2=0x559d8139b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32affff640 1 --2- 172.21.15.53:0/1500824459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d8139b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32affff640 1 -- 172.21.15.53:0/1500824459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80ff71b0 msgr2=0x559d8139aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32affff640 1 --2- 172.21.15.53:0/1500824459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80ff71b0 0x559d8139aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32affff640 1 -- 172.21.15.53:0/1500824459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d81062790 con 0x559d80fce2f0 2024-08-31T06:15:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32b4b63640 1 --2- 172.21.15.53:0/1500824459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80ff71b0 0x559d8139aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32a7fff640 1 --2- 172.21.15.53:0/1500824459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d8139b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32b4b63640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f329c0b4ca0 0x7f329c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32adffb640 1 -- 172.21.15.53:0/2204904211 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f32a0106fb0 con 0x7f32b01027b0 2024-08-31T06:15:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32affff640 1 --2- 172.21.15.53:0/1500824459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d8139b000 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f32a00cd380 tx=0x7f32a004d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1282065f62d90abe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32b4b63640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f329c0b4ca0 0x7f329c0b71b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009fd0 tx=0x7f32a8004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32a67fc640 1 -- 172.21.15.53:0/1500824459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a0034170 con 0x559d80fce2f0 2024-08-31T06:15:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32a67fc640 1 -- 172.21.15.53:0/1500824459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32a00d62e0 con 0x559d80fce2f0 2024-08-31T06:15:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.599+0000 7f32a67fc640 1 -- 172.21.15.53:0/1500824459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a003d1d0 con 0x559d80fce2f0 2024-08-31T06:15:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.600+0000 7f32bd61c740 1 -- 172.21.15.53:0/1500824459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 msgr2=0x559d8139b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.600+0000 7f32bd61c740 1 --2- 172.21.15.53:0/1500824459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d8139b000 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f32a00cd380 tx=0x7f32a004d000 comp rx=0 tx=0).stop 2024-08-31T06:15:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.600+0000 7f32bd61c740 1 -- 172.21.15.53:0/1500824459 shutdown_connections 2024-08-31T06:15:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.600+0000 7f32bd61c740 1 --2- 172.21.15.53:0/1500824459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d8139b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.600+0000 7f32bd61c740 1 --2- 172.21.15.53:0/1500824459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d8139b000 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.600+0000 7f32bd61c740 1 --2- 172.21.15.53:0/1500824459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80ff71b0 0x559d8139aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.600+0000 7f32bd61c740 1 -- 172.21.15.53:0/1500824459 >> 172.21.15.53:0/1500824459 conn(0x559d80feb300 msgr2=0x559d813989b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.600+0000 7f32bd61c740 1 -- 172.21.15.53:0/1500824459 shutdown_connections 2024-08-31T06:15:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.600+0000 7f32bd61c740 1 -- 172.21.15.53:0/1500824459 wait complete. 2024-08-31T06:15:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32bd61c740 1 -- start start 2024-08-31T06:15:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32bd61c740 1 Processor -- start 2024-08-31T06:15:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fce2f0 0x559d813aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813ab000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80ff71b0 0x559d813b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32bd61c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559d81238ab0 con 0x559d80ff71b0 2024-08-31T06:15:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32bd61c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559d81286680 con 0x559d80fce2f0 2024-08-31T06:15:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32bd61c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559d81310000 con 0x559d80fd64d0 2024-08-31T06:15:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32bd61c740 10 client.0 _ll_register_callbacks cb 0x559d8100ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32b4b63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80ff71b0 0x559d813b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32b4b63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80ff71b0 0x559d813b65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52238/0 (socket says 172.21.15.53:52238) 2024-08-31T06:15:04.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32b4b63640 1 -- 172.21.15.53:0/692363600 learned_addr learned my addr 172.21.15.53:0/692363600 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:04.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32affff640 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fce2f0 0x559d813aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.601+0000 7f32a7fff640 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f32b4b63640 1 -- 172.21.15.53:0/692363600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 msgr2=0x559d813ab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:04.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f32b4b63640 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813ab000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.615 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f32b4b63640 1 -- 172.21.15.53:0/692363600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fce2f0 msgr2=0x559d813aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f32b4b63640 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fce2f0 0x559d813aaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f32b4b63640 1 -- 172.21.15.53:0/692363600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d810db620 con 0x559d80ff71b0 2024-08-31T06:15:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f32b4b63640 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80ff71b0 0x559d813b65a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f32a8013c50 tx=0x7f32a8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed0c952df6164e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f328f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f328f7fe640 1 -- 172.21.15.53:0/692363600 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a801e420 con 0x559d80ff71b0 2024-08-31T06:15:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f328f7fe640 1 -- 172.21.15.53:0/692363600 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f32a801e5c0 con 0x559d80ff71b0 2024-08-31T06:15:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f32bd61c740 1 -- 172.21.15.53:0/692363600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d81311f50 con 0x559d80ff71b0 2024-08-31T06:15:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f328f7fe640 1 -- 172.21.15.53:0/692363600 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f32a801e7c0 con 0x559d80ff71b0 2024-08-31T06:15:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f32bd61c740 10 client.18729 fetch_fsmap learned FSMap version 46 2024-08-31T06:15:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.602+0000 7f32bd61c740 1 -- 172.21.15.53:0/692363600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x559d813b9320 con 0x559d80ff71b0 2024-08-31T06:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.603+0000 7f328f7fe640 1 -- 172.21.15.53:0/692363600 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559d81311f50 con 0x559d80ff71b0 2024-08-31T06:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.603+0000 7f328f7fe640 1 -- 172.21.15.53:0/692363600 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f32a8030b20 con 0x559d80ff71b0 2024-08-31T06:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.603+0000 7f32bd61c740 10 client.18729 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.603+0000 7f32bd61c740 10 client.18729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.603+0000 7f32bd61c740 20 client.18729 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.603+0000 7f32bd61c740 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559d80fb5d80 0x559d813bc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.603+0000 7f32bd61c740 4 client.18729 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.603+0000 7f32bd61c740 1 -- 172.21.15.53:0/692363600 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d8130d9f0 con 0x559d80fb5d80 2024-08-31T06:15:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.603+0000 7f32affff640 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559d80fb5d80 0x559d813bc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.603+0000 7f328f7fe640 10 client.18729 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.603+0000 7f32affff640 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559d80fb5d80 0x559d813bc970 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afac2d94631aebd0 server_cookie=447faea0a345e8c1 in_seq=0 out_seq=0 2024-08-31T06:15:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.604+0000 7f328f7fe640 1 -- 172.21.15.53:0/692363600 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d8130d9f0 con 0x559d80fb5d80 2024-08-31T06:15:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.604+0000 7f328f7fe640 10 client.18729 handle_command_reply: tid=0 2024-08-31T06:15:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.604+0000 7f32bd61c740 1 client.18729 shutdown 2024-08-31T06:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.604+0000 7f32bd61c740 1 -- 172.21.15.53:0/692363600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80ff71b0 msgr2=0x559d813b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.604+0000 7f32bd61c740 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80ff71b0 0x559d813b65a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f32a8013c50 tx=0x7f32a8004ab0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.604+0000 7f32bd61c740 1 -- 172.21.15.53:0/692363600 shutdown_connections 2024-08-31T06:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.605+0000 7f32bd61c740 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559d80fb5d80 0x559d813bc970 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.605+0000 7f328f7fe640 0 client.18729 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.605+0000 7f32bd61c740 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80ff71b0 0x559d813b65a0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.605+0000 7f32bd61c740 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813ab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.605+0000 7f32bd61c740 1 --2- 172.21.15.53:0/692363600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fce2f0 0x559d813aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.605+0000 7f32bd61c740 1 -- 172.21.15.53:0/692363600 >> 172.21.15.53:0/692363600 conn(0x559d80feb300 msgr2=0x559d81396c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.605+0000 7f32bd61c740 1 -- 172.21.15.53:0/692363600 shutdown_connections 2024-08-31T06:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.605+0000 7f32bd61c740 1 -- 172.21.15.53:0/692363600 wait complete. 2024-08-31T06:15:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.605+0000 7f32bd61c740 20 client.18729 trim_cache size 0 max 16384 2024-08-31T06:15:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32bd61c740 1 Processor -- start 2024-08-31T06:15:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32bd61c740 1 -- start start 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fb5d80 0x559d813a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fce2f0 0x559d813aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32bd61c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32b01ad2a0 con 0x559d80fb5d80 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32bd61c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32b01aeff0 con 0x559d80fce2f0 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32bd61c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32b01ad970 con 0x559d80fd64d0 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fb5d80 0x559d813a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fb5d80 0x559d813a9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52244/0 (socket says 172.21.15.53:52244) 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32affff640 1 -- 172.21.15.53:0/4131709002 learned_addr learned my addr 172.21.15.53:0/4131709002 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32b4b63640 1 --2- 172.21.15.53:0/4131709002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32a7fff640 1 --2- 172.21.15.53:0/4131709002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fce2f0 0x559d813aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32affff640 1 -- 172.21.15.53:0/4131709002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 msgr2=0x559d813b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32affff640 1 --2- 172.21.15.53:0/4131709002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32affff640 1 -- 172.21.15.53:0/4131709002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fce2f0 msgr2=0x559d813aa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32affff640 1 --2- 172.21.15.53:0/4131709002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fce2f0 0x559d813aa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32affff640 1 -- 172.21.15.53:0/4131709002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d8139d900 con 0x559d80fb5d80 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32a7fff640 1 --2- 172.21.15.53:0/4131709002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fce2f0 0x559d813aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.623+0000 7f32affff640 1 --2- 172.21.15.53:0/4131709002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fb5d80 0x559d813a9d80 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f32a0104790 tx=0x7f32a0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83618e6f66184b64 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.624+0000 7f32a5ffb640 1 -- 172.21.15.53:0/4131709002 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a00b8070 con 0x559d80fb5d80 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.624+0000 7f32a5ffb640 1 -- 172.21.15.53:0/4131709002 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32a00cdd80 con 0x559d80fb5d80 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.624+0000 7f32a5ffb640 1 -- 172.21.15.53:0/4131709002 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a00c9910 con 0x559d80fb5d80 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.625+0000 7f32bd61c740 1 -- 172.21.15.53:0/4131709002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fb5d80 msgr2=0x559d813a9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.625+0000 7f32bd61c740 1 --2- 172.21.15.53:0/4131709002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fb5d80 0x559d813a9d80 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f32a0104790 tx=0x7f32a0009260 comp rx=0 tx=0).stop 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.625+0000 7f32bd61c740 1 -- 172.21.15.53:0/4131709002 shutdown_connections 2024-08-31T06:15:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.625+0000 7f32bd61c740 1 --2- 172.21.15.53:0/4131709002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.625+0000 7f32bd61c740 1 --2- 172.21.15.53:0/4131709002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fce2f0 0x559d813aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.625+0000 7f32bd61c740 1 --2- 172.21.15.53:0/4131709002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fb5d80 0x559d813a9d80 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.625+0000 7f32bd61c740 1 -- 172.21.15.53:0/4131709002 >> 172.21.15.53:0/4131709002 conn(0x559d80feb300 msgr2=0x559d813a9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.625+0000 7f32bd61c740 1 -- 172.21.15.53:0/4131709002 shutdown_connections 2024-08-31T06:15:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.625+0000 7f32bd61c740 1 -- 172.21.15.53:0/4131709002 wait complete. 2024-08-31T06:15:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.625+0000 7f32bd61c740 1 -- start start 2024-08-31T06:15:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.625+0000 7f32bd61c740 1 Processor -- start 2024-08-31T06:15:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fb5d80 0x559d813ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d813aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32bd61c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813af050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32bd61c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32b01ae860 con 0x559d80fce2f0 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32bd61c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32b01ae100 con 0x559d80fb5d80 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32bd61c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32b01ab2a0 con 0x559d80fd64d0 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32bd61c740 10 client.0 _ll_register_callbacks cb 0x7f32a8009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d813aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d813aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52250/0 (socket says 172.21.15.53:52250) 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32a7fff640 1 -- 172.21.15.53:0/1598784614 learned_addr learned my addr 172.21.15.53:0/1598784614 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32b4b63640 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32affff640 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fb5d80 0x559d813ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32b4b63640 1 -- 172.21.15.53:0/1598784614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fb5d80 msgr2=0x559d813ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32b4b63640 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fb5d80 0x559d813ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32b4b63640 1 -- 172.21.15.53:0/1598784614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 msgr2=0x559d813aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32b4b63640 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d813aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32b4b63640 1 -- 172.21.15.53:0/1598784614 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d81426470 con 0x559d80fd64d0 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32a7fff640 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d813aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f32b4b63640 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813af050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f32a8030f10 tx=0x7f32a8011c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f60ab468196d2c93 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f328f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.626+0000 7f328f7fe640 1 -- 172.21.15.53:0/1598784614 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a801e620 con 0x559d80fd64d0 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f32bd61c740 1 -- 172.21.15.53:0/1598784614 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32a00cdd80 con 0x559d80fd64d0 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f328f7fe640 1 -- 172.21.15.53:0/1598784614 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8557+0+0 (secure 0 0 0) 0x7f32a80284f0 con 0x559d80fd64d0 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f328f7fe640 1 -- 172.21.15.53:0/1598784614 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f32a80286f0 con 0x559d80fd64d0 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f32bd61c740 10 client.27922 fetch_fsmap learned FSMap version 46 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f32bd61c740 1 -- 172.21.15.53:0/1598784614 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x559d81427700 con 0x559d80fd64d0 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f328f7fe640 1 -- 172.21.15.53:0/1598784614 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32a00cdd80 con 0x559d80fd64d0 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f328f7fe640 1 -- 172.21.15.53:0/1598784614 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 46) ==== 8414+0+0 (secure 0 0 0) 0x7f32a8030450 con 0x559d80fd64d0 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f32bd61c740 10 client.27922 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f32bd61c740 10 client.27922 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:04.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f32bd61c740 20 client.27922 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f32bd61c740 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559d80ff71b0 0x559d81429f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f32bd61c740 4 client.27922 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:15:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f32bd61c740 1 -- 172.21.15.53:0/1598784614 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559d8130b130 con 0x559d80ff71b0 2024-08-31T06:15:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.627+0000 7f32affff640 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559d80ff71b0 0x559d81429f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.628+0000 7f328f7fe640 10 client.27922 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:04.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.628+0000 7f32affff640 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559d80ff71b0 0x559d81429f40 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0f82ab8259c4a7f server_cookie=537bc3c176f3f6aa in_seq=0 out_seq=0 2024-08-31T06:15:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f328f7fe640 1 -- 172.21.15.53:0/1598784614 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559d8130b130 con 0x559d80ff71b0 2024-08-31T06:15:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f328f7fe640 10 client.27922 handle_command_reply: tid=0 2024-08-31T06:15:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 1 client.27922 shutdown 2024-08-31T06:15:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 1 -- 172.21.15.53:0/1598784614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 msgr2=0x559d813af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813af050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f32a8030f10 tx=0x7f32a8011c70 comp rx=0 tx=0).stop 2024-08-31T06:15:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 1 -- 172.21.15.53:0/1598784614 shutdown_connections 2024-08-31T06:15:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559d80ff71b0 0x559d81429f40 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d80fd64d0 0x559d813af050 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d80fce2f0 0x559d813aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 1 --2- 172.21.15.53:0/1598784614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d80fb5d80 0x559d813ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f328f7fe640 0 client.27922 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 1 -- 172.21.15.53:0/1598784614 >> 172.21.15.53:0/1598784614 conn(0x559d80feb300 msgr2=0x559d813a9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 1 -- 172.21.15.53:0/1598784614 shutdown_connections 2024-08-31T06:15:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 1 -- 172.21.15.53:0/1598784614 wait complete. 2024-08-31T06:15:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.657+0000 7f32bd61c740 20 client.27922 trim_cache size 0 max 16384 2024-08-31T06:15:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:15:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:15:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:15:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:15:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 -- 172.21.15.53:0/2204904211 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f329c0b4ca0 msgr2=0x7f329c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f329c0b4ca0 0x7f329c0b71b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009fd0 tx=0x7f32a8004a40 comp rx=0 tx=0).stop 2024-08-31T06:15:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 -- 172.21.15.53:0/2204904211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32b01027b0 msgr2=0x7f32b0199070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32b01027b0 0x7f32b0199070 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009230 tx=0x7f32a00319a0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 -- 172.21.15.53:0/2204904211 shutdown_connections 2024-08-31T06:15:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f329c0b4ca0 0x7f329c0b71b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32b0108a30 0x7f32b019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32b01080e0 0x7f32b0199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 --2- 172.21.15.53:0/2204904211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32b01027b0 0x7f32b0199070 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 -- 172.21.15.53:0/2204904211 >> 172.21.15.53:0/2204904211 conn(0x7f32b00fe1b0 msgr2=0x7f32b01005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 -- 172.21.15.53:0/2204904211 shutdown_connections 2024-08-31T06:15:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:04.658+0000 7f32b65c6640 1 -- 172.21.15.53:0/2204904211 wait complete. 2024-08-31T06:15:04.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 168261 1.51 MB/sec execute 414 sec latency 38.949 ms 2024-08-31T06:15:05.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 168795 1.51 MB/sec execute 415 sec latency 22.431 ms 2024-08-31T06:15:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:06 smithi130 ceph-mon[22266]: pgmap v635: 97 pgs: 97 active+clean; 99 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 893 KiB/s wr, 118 op/s 2024-08-31T06:15:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:06 smithi153 ceph-mon[22320]: pgmap v635: 97 pgs: 97 active+clean; 99 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 893 KiB/s wr, 118 op/s 2024-08-31T06:15:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:06 smithi053 ceph-mon[18924]: pgmap v635: 97 pgs: 97 active+clean; 99 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 893 KiB/s wr, 118 op/s 2024-08-31T06:15:06.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 169294 1.51 MB/sec execute 416 sec latency 30.016 ms 2024-08-31T06:15:07.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:07 smithi130 ceph-mon[22266]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T06:15:07.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:07 smithi153 ceph-mon[22320]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T06:15:07.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:07 smithi053 ceph-mon[18924]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T06:15:07.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 170019 1.52 MB/sec execute 417 sec latency 15.557 ms 2024-08-31T06:15:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:08 smithi130 ceph-mon[22266]: pgmap v637: 97 pgs: 97 active+clean; 100 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 666 KiB/s wr, 90 op/s 2024-08-31T06:15:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:08 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:15:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:08 smithi153 ceph-mon[22320]: pgmap v637: 97 pgs: 97 active+clean; 100 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 666 KiB/s wr, 90 op/s 2024-08-31T06:15:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:08 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:15:08.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:08 smithi053 ceph-mon[18924]: pgmap v637: 97 pgs: 97 active+clean; 100 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 666 KiB/s wr, 90 op/s 2024-08-31T06:15:08.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:08 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:15:08.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 170346 1.52 MB/sec execute 418 sec latency 134.134 ms 2024-08-31T06:15:09.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 170346 1.52 MB/sec execute 419 sec latency 1134.204 ms 2024-08-31T06:15:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:10 smithi130 ceph-mon[22266]: pgmap v638: 97 pgs: 97 active+clean; 100 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 686 KiB/s wr, 97 op/s 2024-08-31T06:15:10.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:10 smithi153 ceph-mon[22320]: pgmap v638: 97 pgs: 97 active+clean; 100 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 686 KiB/s wr, 97 op/s 2024-08-31T06:15:10.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:10 smithi053 ceph-mon[18924]: pgmap v638: 97 pgs: 97 active+clean; 100 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 686 KiB/s wr, 97 op/s 2024-08-31T06:15:10.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:15:10.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 170346 1.52 MB/sec execute 420 sec latency 2134.242 ms 2024-08-31T06:15:11.004 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:11.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.521+0000 7f478d3fa640 1 -- 172.21.15.53:0/4073652342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f478810bde0 msgr2=0x7f4788112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.521+0000 7f478d3fa640 1 --2- 172.21.15.53:0/4073652342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f478810bde0 0x7f4788112610 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f4780009ca0 tx=0x7f478002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.521+0000 7f478d3fa640 1 -- 172.21.15.53:0/4073652342 shutdown_connections 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.521+0000 7f478d3fa640 1 --2- 172.21.15.53:0/4073652342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f478810bde0 0x7f4788112610 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.521+0000 7f478d3fa640 1 --2- 172.21.15.53:0/4073652342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f478810b490 0x7f478810b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.521+0000 7f478d3fa640 1 --2- 172.21.15.53:0/4073652342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4788105b50 0x7f4788105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.521+0000 7f478d3fa640 1 -- 172.21.15.53:0/4073652342 >> 172.21.15.53:0/4073652342 conn(0x7f4788101560 msgr2=0x7f47881039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.521+0000 7f478d3fa640 1 -- 172.21.15.53:0/4073652342 shutdown_connections 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.521+0000 7f478d3fa640 1 -- 172.21.15.53:0/4073652342 wait complete. 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.522+0000 7f478d3fa640 1 Processor -- start 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.522+0000 7f478d3fa640 1 -- start start 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.522+0000 7f478d3fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4788105b50 0x7f478819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.522+0000 7f478d3fa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f478810b490 0x7f478819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.522+0000 7f478d3fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f478810bde0 0x7f47881a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.522+0000 7f478d3fa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f47881159a0 con 0x7f4788105b50 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.522+0000 7f478d3fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4788115820 con 0x7f478810bde0 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.522+0000 7f478d3fa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4788115b20 con 0x7f478810b490 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f4786ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4788105b50 0x7f478819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f4786ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4788105b50 0x7f478819c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52274/0 (socket says 172.21.15.53:52274) 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f47867fc640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f478810b490 0x7f478819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f4786ffd640 1 -- 172.21.15.53:0/4081673569 learned_addr learned my addr 172.21.15.53:0/4081673569 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f47877fe640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f478810bde0 0x7f47881a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f47867fc640 1 -- 172.21.15.53:0/4081673569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f478810bde0 msgr2=0x7f47881a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f47867fc640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f478810bde0 0x7f47881a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f47867fc640 1 -- 172.21.15.53:0/4081673569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4788105b50 msgr2=0x7f478819c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f47867fc640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4788105b50 0x7f478819c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f47867fc640 1 -- 172.21.15.53:0/4081673569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47881a2300 con 0x7f478810b490 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f4786ffd640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4788105b50 0x7f478819c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f47867fc640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f478810b490 0x7f478819c930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f477c005fd0 tx=0x7f477c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f476ffff640 1 -- 172.21.15.53:0/4081673569 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c009c00 con 0x7f478810b490 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f478d3fa640 1 -- 172.21.15.53:0/4081673569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47881a25f0 con 0x7f478810b490 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f476ffff640 1 -- 172.21.15.53:0/4081673569 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f477c0044c0 con 0x7f478810b490 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.523+0000 7f476ffff640 1 -- 172.21.15.53:0/4081673569 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c003d70 con 0x7f478810b490 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.524+0000 7f478d3fa640 1 -- 172.21.15.53:0/4081673569 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47881a8d50 con 0x7f478810b490 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.527+0000 7f479396f740 1 Processor -- start 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.527+0000 7f479396f740 1 -- start start 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.527+0000 7f476ffff640 1 -- 172.21.15.53:0/4081673569 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f477c003f10 con 0x7f478810b490 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.527+0000 7f479396f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe9c070 0x5640dc2412c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.527+0000 7f479396f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 0x5640dc241800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.527+0000 7f479396f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc241d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.527+0000 7f479396f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640dc1b8630 con 0x5640dbe9c070 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.527+0000 7f479396f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5640dc1a7bc0 con 0x5640dbe731b0 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.527+0000 7f479396f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5640dc1abb70 con 0x5640dbe7b390 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f4786ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 0x5640dc241800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f47877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe9c070 0x5640dc2412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f47867fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc241d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f4786ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 0x5640dc241800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:35106/0 (socket says 172.21.15.53:35106) 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f4786ffd640 1 -- 172.21.15.53:0/1994264463 learned_addr learned my addr 172.21.15.53:0/1994264463 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f47877fe640 1 -- 172.21.15.53:0/1994264463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 msgr2=0x5640dc241d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f47877fe640 1 --2- 172.21.15.53:0/1994264463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc241d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f47877fe640 1 -- 172.21.15.53:0/1994264463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 msgr2=0x5640dc241800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f47877fe640 1 --2- 172.21.15.53:0/1994264463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 0x5640dc241800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f47877fe640 1 -- 172.21.15.53:0/1994264463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640dbf07650 con 0x5640dbe9c070 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f476ffff640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47700b4ca0 0x7f47700b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f47877fe640 1 --2- 172.21.15.53:0/1994264463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe9c070 0x5640dc2412c0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f4780031040 tx=0x7f4780031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57597e480b7eb902 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f4786ffd640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47700b4ca0 0x7f47700b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.528+0000 7f476ffff640 1 -- 172.21.15.53:0/4081673569 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8601+0+0 (secure 0 0 0) 0x7f477c0e4f30 con 0x7f478810b490 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.529+0000 7f476d7fa640 1 -- 172.21.15.53:0/1994264463 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780031980 con 0x5640dbe9c070 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.529+0000 7f476d7fa640 1 -- 172.21.15.53:0/1994264463 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4780036030 con 0x5640dbe9c070 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.529+0000 7f476d7fa640 1 -- 172.21.15.53:0/1994264463 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780004330 con 0x5640dbe9c070 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f479396f740 1 -- 172.21.15.53:0/1994264463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe9c070 msgr2=0x5640dc2412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f479396f740 1 --2- 172.21.15.53:0/1994264463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe9c070 0x5640dc2412c0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f4780031040 tx=0x7f4780031450 comp rx=0 tx=0).stop 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f4786ffd640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47700b4ca0 0x7f47700b71b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x5640dc23ff40 tx=0x7f4778005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:11.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f479396f740 1 -- 172.21.15.53:0/1994264463 shutdown_connections 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f479396f740 1 --2- 172.21.15.53:0/1994264463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc241d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f479396f740 1 --2- 172.21.15.53:0/1994264463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 0x5640dc241800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f479396f740 1 --2- 172.21.15.53:0/1994264463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe9c070 0x5640dc2412c0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f479396f740 1 -- 172.21.15.53:0/1994264463 >> 172.21.15.53:0/1994264463 conn(0x5640dbe90460 msgr2=0x5640dc23f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f479396f740 1 -- 172.21.15.53:0/1994264463 shutdown_connections 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f479396f740 1 -- 172.21.15.53:0/1994264463 wait complete. 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f479396f740 1 -- start start 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.530+0000 7f479396f740 1 Processor -- start 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f479396f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc24ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f479396f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc24cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f479396f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe9c070 0x5640dc258bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f479396f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640dc00a700 con 0x5640dbe731b0 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f479396f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5640dc12e700 con 0x5640dbe9c070 2024-08-31T06:15:11.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f479396f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5640dc24f8c0 con 0x5640dbe7b390 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f479396f740 10 client.0 _ll_register_callbacks cb 0x5640dc15ddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f4786ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc24ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f4786ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc24ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52284/0 (socket says 172.21.15.53:52284) 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f4786ffd640 1 -- 172.21.15.53:0/1708455056 learned_addr learned my addr 172.21.15.53:0/1708455056 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f47877fe640 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe9c070 0x5640dc258bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f47867fc640 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc24cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f4786ffd640 1 -- 172.21.15.53:0/1708455056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 msgr2=0x5640dc24cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f4786ffd640 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc24cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f4786ffd640 1 -- 172.21.15.53:0/1708455056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe9c070 msgr2=0x5640dc258bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f4786ffd640 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe9c070 0x5640dc258bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.531+0000 7f4786ffd640 1 -- 172.21.15.53:0/1708455056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640dc1678b0 con 0x5640dbe731b0 2024-08-31T06:15:11.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.532+0000 7f4786ffd640 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc24ca30 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f4778004620 tx=0x7f4778004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4535d14c8f3477 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.532+0000 7f476aff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.532+0000 7f476aff5640 1 -- 172.21.15.53:0/1708455056 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778003af0 con 0x5640dbe731b0 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.532+0000 7f476aff5640 1 -- 172.21.15.53:0/1708455056 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8601+0+0 (secure 0 0 0) 0x7f4778003c90 con 0x5640dbe731b0 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.532+0000 7f479396f740 1 -- 172.21.15.53:0/1708455056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4780036030 con 0x5640dbe731b0 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.532+0000 7f476aff5640 1 -- 172.21.15.53:0/1708455056 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f4778029440 con 0x5640dbe731b0 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.532+0000 7f479396f740 10 client.18747 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.532+0000 7f479396f740 1 -- 172.21.15.53:0/1708455056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5640dc25b690 con 0x5640dbe731b0 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.532+0000 7f476aff5640 1 -- 172.21.15.53:0/1708455056 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4780036030 con 0x5640dbe731b0 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.533+0000 7f476aff5640 1 -- 172.21.15.53:0/1708455056 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f4778027070 con 0x5640dbe731b0 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.533+0000 7f479396f740 10 client.18747 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.533+0000 7f479396f740 10 client.18747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.533+0000 7f479396f740 20 client.18747 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.533+0000 7f479396f740 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640dbe5a9f0 0x5640dc25ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.533+0000 7f479396f740 4 client.18747 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:11.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.533+0000 7f479396f740 1 -- 172.21.15.53:0/1708455056 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640dc1ba580 con 0x5640dbe5a9f0 2024-08-31T06:15:11.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.533+0000 7f47867fc640 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640dbe5a9f0 0x5640dc25ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.533+0000 7f47867fc640 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640dbe5a9f0 0x5640dc25ece0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4841d510931058fc server_cookie=2b45693706e83e95 in_seq=0 out_seq=0 2024-08-31T06:15:11.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.533+0000 7f476aff5640 10 client.18747 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:11.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f476aff5640 1 -- 172.21.15.53:0/1708455056 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640dc1ba580 con 0x5640dbe5a9f0 2024-08-31T06:15:11.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f476aff5640 10 client.18747 handle_command_reply: tid=0 2024-08-31T06:15:11.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 1 client.18747 shutdown 2024-08-31T06:15:11.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 1 -- 172.21.15.53:0/1708455056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 msgr2=0x5640dc24ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:11.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc24ca30 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f4778004620 tx=0x7f4778004730 comp rx=0 tx=0).stop 2024-08-31T06:15:11.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 1 -- 172.21.15.53:0/1708455056 shutdown_connections 2024-08-31T06:15:11.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640dbe5a9f0 0x5640dc25ece0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe9c070 0x5640dc258bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc24cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f476aff5640 0 client.18747 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:11.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 1 --2- 172.21.15.53:0/1708455056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc24ca30 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 1 -- 172.21.15.53:0/1708455056 >> 172.21.15.53:0/1708455056 conn(0x5640dbe90460 msgr2=0x5640dc2444a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:11.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 1 -- 172.21.15.53:0/1708455056 shutdown_connections 2024-08-31T06:15:11.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 1 -- 172.21.15.53:0/1708455056 wait complete. 2024-08-31T06:15:11.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.534+0000 7f479396f740 20 client.18747 trim_cache size 0 max 16384 2024-08-31T06:15:11.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f479396f740 1 Processor -- start 2024-08-31T06:15:11.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f479396f740 1 -- start start 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f479396f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe5a9f0 0x5640dc23f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f479396f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc258ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f479396f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc258ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f479396f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f47881b17a0 con 0x5640dbe731b0 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f479396f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f47881b34f0 con 0x5640dbe5a9f0 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f479396f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f47881b1e70 con 0x5640dbe7b390 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f47867fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc258ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f47867fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc258ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52286/0 (socket says 172.21.15.53:52286) 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f47867fc640 1 -- 172.21.15.53:0/1957920178 learned_addr learned my addr 172.21.15.53:0/1957920178 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.552+0000 7f4786ffd640 1 --2- 172.21.15.53:0/1957920178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe5a9f0 0x5640dc23f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.553+0000 7f47877fe640 1 --2- 172.21.15.53:0/1957920178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc258ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.553+0000 7f47867fc640 1 -- 172.21.15.53:0/1957920178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 msgr2=0x5640dc258ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:11.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.553+0000 7f47867fc640 1 --2- 172.21.15.53:0/1957920178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc258ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.553+0000 7f47867fc640 1 -- 172.21.15.53:0/1957920178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe5a9f0 msgr2=0x5640dc23f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:11.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.553+0000 7f47867fc640 1 --2- 172.21.15.53:0/1957920178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe5a9f0 0x5640dc23f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.553+0000 7f47867fc640 1 -- 172.21.15.53:0/1957920178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640dc24dcf0 con 0x5640dbe731b0 2024-08-31T06:15:11.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.553+0000 7f4786ffd640 1 --2- 172.21.15.53:0/1957920178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe5a9f0 0x5640dc23f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:11.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.553+0000 7f47867fc640 1 --2- 172.21.15.53:0/1957920178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc258ab0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f477c0e2690 tx=0x7f477c0ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4369156cc258029b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:11.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.553+0000 7f476cff9640 1 -- 172.21.15.53:0/1957920178 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c020040 con 0x5640dbe731b0 2024-08-31T06:15:11.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.553+0000 7f476cff9640 1 -- 172.21.15.53:0/1957920178 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f477c0b4230 con 0x5640dbe731b0 2024-08-31T06:15:11.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.553+0000 7f476cff9640 1 -- 172.21.15.53:0/1957920178 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c0b48f0 con 0x5640dbe731b0 2024-08-31T06:15:11.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.554+0000 7f479396f740 1 -- 172.21.15.53:0/1957920178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 msgr2=0x5640dc258ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:11.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.554+0000 7f479396f740 1 --2- 172.21.15.53:0/1957920178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc258ab0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f477c0e2690 tx=0x7f477c0ce040 comp rx=0 tx=0).stop 2024-08-31T06:15:11.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.554+0000 7f479396f740 1 -- 172.21.15.53:0/1957920178 shutdown_connections 2024-08-31T06:15:11.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.554+0000 7f479396f740 1 --2- 172.21.15.53:0/1957920178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe7b390 0x5640dc258ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.554+0000 7f479396f740 1 --2- 172.21.15.53:0/1957920178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe731b0 0x5640dc258ab0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.554+0000 7f479396f740 1 --2- 172.21.15.53:0/1957920178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe5a9f0 0x5640dc23f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.554+0000 7f479396f740 1 -- 172.21.15.53:0/1957920178 >> 172.21.15.53:0/1957920178 conn(0x5640dbe90460 msgr2=0x5640dc23eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:11.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.554+0000 7f479396f740 1 -- 172.21.15.53:0/1957920178 shutdown_connections 2024-08-31T06:15:11.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.554+0000 7f479396f740 1 -- 172.21.15.53:0/1957920178 wait complete. 2024-08-31T06:15:11.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.554+0000 7f479396f740 1 -- start start 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f479396f740 1 Processor -- start 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f479396f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe5a9f0 0x5640dc251370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f479396f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 0x5640dc251950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f479396f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe7b390 0x5640dc2c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f479396f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f47881b2d60 con 0x5640dbe7b390 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f479396f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f47881b2600 con 0x5640dbe731b0 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f479396f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f47881af7a0 con 0x5640dbe5a9f0 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f479396f740 10 client.0 _ll_register_callbacks cb 0x7f47780044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f47877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe7b390 0x5640dc2c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f47877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe7b390 0x5640dc2c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52290/0 (socket says 172.21.15.53:52290) 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f47877fe640 1 -- 172.21.15.53:0/3426883485 learned_addr learned my addr 172.21.15.53:0/3426883485 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f4786ffd640 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe5a9f0 0x5640dc251370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f47867fc640 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 0x5640dc251950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f47877fe640 1 -- 172.21.15.53:0/3426883485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe5a9f0 msgr2=0x5640dc251370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f47877fe640 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe5a9f0 0x5640dc251370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f47877fe640 1 -- 172.21.15.53:0/3426883485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 msgr2=0x5640dc251950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f47877fe640 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 0x5640dc251950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f47877fe640 1 -- 172.21.15.53:0/3426883485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640dc2c8d10 con 0x5640dbe7b390 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.555+0000 7f47867fc640 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 0x5640dc251950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f47877fe640 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe7b390 0x5640dc2c86a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f478002aeb0 tx=0x7f4780031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217acfad05c634a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f476aff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f476aff5640 1 -- 172.21.15.53:0/3426883485 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780054030 con 0x5640dbe7b390 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f476aff5640 1 -- 172.21.15.53:0/3426883485 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8601+0+0 (secure 0 0 0) 0x7f4780031d20 con 0x5640dbe7b390 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f479396f740 1 -- 172.21.15.53:0/3426883485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5640dc1b6020 con 0x5640dbe7b390 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f476aff5640 1 -- 172.21.15.53:0/3426883485 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f478004a040 con 0x5640dbe7b390 2024-08-31T06:15:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f479396f740 10 client.18753 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f479396f740 1 -- 172.21.15.53:0/3426883485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5640dc2c9fa0 con 0x5640dbe7b390 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f476aff5640 1 -- 172.21.15.53:0/3426883485 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5640dc1b6020 con 0x5640dbe7b390 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f476aff5640 1 -- 172.21.15.53:0/3426883485 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f4780043070 con 0x5640dbe7b390 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f479396f740 10 client.18753 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f479396f740 10 client.18753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f479396f740 20 client.18753 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.556+0000 7f479396f740 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640dbe9c070 0x5640dc2cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.557+0000 7f479396f740 4 client.18753 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.557+0000 7f479396f740 1 -- 172.21.15.53:0/3426883485 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5640dc1b3760 con 0x5640dbe9c070 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.557+0000 7f4786ffd640 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640dbe9c070 0x5640dc2cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.557+0000 7f4786ffd640 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640dbe9c070 0x5640dc2cc570 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=168e0f2a36d37a93 server_cookie=e841f705e47d3a1c in_seq=0 out_seq=0 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.557+0000 7f476aff5640 10 client.18753 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:11.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.557+0000 7f476aff5640 1 -- 172.21.15.53:0/3426883485 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x5640dc1b3760 con 0x5640dbe9c070 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.557+0000 7f476aff5640 10 client.18753 handle_command_reply: tid=0 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.557+0000 7f479396f740 1 client.18753 shutdown 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.557+0000 7f479396f740 1 -- 172.21.15.53:0/3426883485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe7b390 msgr2=0x5640dc2c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.557+0000 7f479396f740 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe7b390 0x5640dc2c86a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f478002aeb0 tx=0x7f4780031bb0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f479396f740 1 -- 172.21.15.53:0/3426883485 shutdown_connections 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f479396f740 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5640dbe9c070 0x5640dc2cc570 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f479396f740 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640dbe7b390 0x5640dc2c86a0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f479396f740 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5640dbe731b0 0x5640dc251950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f479396f740 1 --2- 172.21.15.53:0/3426883485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640dbe5a9f0 0x5640dc251370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f479396f740 1 -- 172.21.15.53:0/3426883485 >> 172.21.15.53:0/3426883485 conn(0x5640dbe90460 msgr2=0x5640dc2443c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f476aff5640 0 client.18753 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f479396f740 1 -- 172.21.15.53:0/3426883485 shutdown_connections 2024-08-31T06:15:11.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f479396f740 1 -- 172.21.15.53:0/3426883485 wait complete. 2024-08-31T06:15:11.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f479396f740 20 client.18753 trim_cache size 0 max 16384 2024-08-31T06:15:11.567 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:15:11.567 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:15:11.567 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:15:11.567 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:15:11.567 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:15:11.567 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:15:11.567 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.567 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.569 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.570 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.570 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:15:11.570 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:15:11.570 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.570 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.570 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.570 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.570 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.570 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.571 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:15:11.572 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:11.576 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:15:11.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 -- 172.21.15.53:0/4081673569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47700b4ca0 msgr2=0x7f47700b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:11.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47700b4ca0 0x7f47700b71b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x5640dc23ff40 tx=0x7f4778005f90 comp rx=0 tx=0).stop 2024-08-31T06:15:11.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 -- 172.21.15.53:0/4081673569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f478810b490 msgr2=0x7f478819c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:11.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f478810b490 0x7f478819c930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f477c005fd0 tx=0x7f477c00dde0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 -- 172.21.15.53:0/4081673569 shutdown_connections 2024-08-31T06:15:11.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f47700b4ca0 0x7f47700b71b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f478810bde0 0x7f47881a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f478810b490 0x7f478819c930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 --2- 172.21.15.53:0/4081673569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4788105b50 0x7f478819c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:11.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 -- 172.21.15.53:0/4081673569 >> 172.21.15.53:0/4081673569 conn(0x7f4788101560 msgr2=0x7f47881089b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:11.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 -- 172.21.15.53:0/4081673569 shutdown_connections 2024-08-31T06:15:11.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:11.558+0000 7f478d3fa640 1 -- 172.21.15.53:0/4081673569 wait complete. 2024-08-31T06:15:11.991 INFO:tasks.workunit.client.0.smithi053.stdout: 1 170413 1.51 MB/sec execute 421 sec latency 2390.563 ms 2024-08-31T06:15:12.367 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:15:12.367 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:15:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:12 smithi130 ceph-mon[22266]: pgmap v639: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.2 MiB/s wr, 134 op/s 2024-08-31T06:15:12.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:12 smithi053 ceph-mon[18924]: pgmap v639: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.2 MiB/s wr, 134 op/s 2024-08-31T06:15:12.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:12 smithi153 ceph-mon[22320]: pgmap v639: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.2 MiB/s wr, 134 op/s 2024-08-31T06:15:12.623 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:12.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 170413 1.51 MB/sec execute 422 sec latency 1460.066 ms 2024-08-31T06:15:13.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.118+0000 7fe26279e640 1 -- 172.21.15.53:0/3415159422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe25c109b90 msgr2=0x7fe25c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:13.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.118+0000 7fe26279e640 1 --2- 172.21.15.53:0/3415159422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe25c109b90 0x7fe25c1103c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fe254009ca0 tx=0x7fe25402a8e0 comp rx=0 tx=0).stop 2024-08-31T06:15:13.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.118+0000 7fe26279e640 1 -- 172.21.15.53:0/3415159422 shutdown_connections 2024-08-31T06:15:13.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.118+0000 7fe26279e640 1 --2- 172.21.15.53:0/3415159422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe25c109b90 0x7fe25c1103c0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:13.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.118+0000 7fe26279e640 1 --2- 172.21.15.53:0/3415159422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25c109240 0x7fe25c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:13.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.118+0000 7fe26279e640 1 --2- 172.21.15.53:0/3415159422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe25c103900 0x7fe25c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:13.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.118+0000 7fe26279e640 1 -- 172.21.15.53:0/3415159422 >> 172.21.15.53:0/3415159422 conn(0x7fe25c07b5f0 msgr2=0x7fe25c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:13.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.118+0000 7fe26279e640 1 -- 172.21.15.53:0/3415159422 shutdown_connections 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.118+0000 7fe26279e640 1 -- 172.21.15.53:0/3415159422 wait complete. 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe26279e640 1 Processor -- start 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe26279e640 1 -- start start 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe26279e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe25c103900 0x7fe25c19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe26279e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25c109240 0x7fe25c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe26279e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe25c109b90 0x7fe25c19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe26279e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c113740 con 0x7fe25c103900 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe26279e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1135c0 con 0x7fe25c109240 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe26279e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1138c0 con 0x7fe25c109b90 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe25bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe25c103900 0x7fe25c19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe25bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe25c103900 0x7fe25c19a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52306/0 (socket says 172.21.15.53:52306) 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe25bfff640 1 -- 172.21.15.53:0/682960562 learned_addr learned my addr 172.21.15.53:0/682960562 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe260d3b640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe25c109b90 0x7fe25c19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.119+0000 7fe25b7fe640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25c109240 0x7fe25c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe25bfff640 1 -- 172.21.15.53:0/682960562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe25c109b90 msgr2=0x7fe25c19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe25bfff640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe25c109b90 0x7fe25c19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe25bfff640 1 -- 172.21.15.53:0/682960562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25c109240 msgr2=0x7fe25c19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe25bfff640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25c109240 0x7fe25c19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe25bfff640 1 -- 172.21.15.53:0/682960562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c1a0140 con 0x7fe25c103900 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe260d3b640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe25c109b90 0x7fe25c19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe25bfff640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe25c103900 0x7fe25c19a1d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00d950 tx=0x7fe24c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe2597fa640 1 -- 172.21.15.53:0/682960562 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c017030 con 0x7fe25c103900 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe2597fa640 1 -- 172.21.15.53:0/682960562 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe24c004020 con 0x7fe25c103900 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe26279e640 1 -- 172.21.15.53:0/682960562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25c1a0430 con 0x7fe25c103900 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe2597fa640 1 -- 172.21.15.53:0/682960562 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c0055d0 con 0x7fe25c103900 2024-08-31T06:15:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.120+0000 7fe26279e640 1 -- 172.21.15.53:0/682960562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe25c1a6b90 con 0x7fe25c103900 2024-08-31T06:15:13.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.121+0000 7fe26279e640 1 -- 172.21.15.53:0/682960562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe25c103d10 con 0x7fe25c103900 2024-08-31T06:15:13.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.122+0000 7fe2597fa640 1 -- 172.21.15.53:0/682960562 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe24c009a30 con 0x7fe25c103900 2024-08-31T06:15:13.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.123+0000 7fe2597fa640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2440b4ca0 0x7fe2440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:13.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.123+0000 7fe25b7fe640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2440b4ca0 0x7fe2440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:13.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.123+0000 7fe2597fa640 1 -- 172.21.15.53:0/682960562 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8601+0+0 (secure 0 0 0) 0x7fe24c0e5720 con 0x7fe25c103900 2024-08-31T06:15:13.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.124+0000 7fe25b7fe640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2440b4ca0 0x7fe2440b71b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe25c106260 tx=0x7fe250008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:13.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.126+0000 7fe2597fa640 1 -- 172.21.15.53:0/682960562 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe24c0ac4c0 con 0x7fe25c103900 2024-08-31T06:15:13.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.350+0000 7fe26279e640 1 -- 172.21.15.53:0/682960562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe25c19b300 con 0x7fe25c103900 2024-08-31T06:15:13.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.351+0000 7fe2597fa640 1 -- 172.21.15.53:0/682960562 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+12005 (secure 0 0 0) 0x7fe24c0abdc0 con 0x7fe25c103900 2024-08-31T06:15:13.353 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:15:13.354 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":47,"btime":"2024-08-31T06:15:07:112545+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":47,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:15:06.232396+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:15:13.354 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 47 2024-08-31T06:15:13.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.354+0000 7fe26279e640 1 -- 172.21.15.53:0/682960562 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2440b4ca0 msgr2=0x7fe2440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:13.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.354+0000 7fe26279e640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2440b4ca0 0x7fe2440b71b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe25c106260 tx=0x7fe250008040 comp rx=0 tx=0).stop 2024-08-31T06:15:13.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.354+0000 7fe26279e640 1 -- 172.21.15.53:0/682960562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe25c103900 msgr2=0x7fe25c19a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:13.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.354+0000 7fe26279e640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe25c103900 0x7fe25c19a1d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00d950 tx=0x7fe24c00de10 comp rx=0 tx=0).stop 2024-08-31T06:15:13.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.355+0000 7fe26279e640 1 -- 172.21.15.53:0/682960562 shutdown_connections 2024-08-31T06:15:13.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.355+0000 7fe26279e640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2440b4ca0 0x7fe2440b71b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:13.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.355+0000 7fe26279e640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe25c109b90 0x7fe25c19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:13.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.355+0000 7fe26279e640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25c109240 0x7fe25c19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:13.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.355+0000 7fe26279e640 1 --2- 172.21.15.53:0/682960562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe25c103900 0x7fe25c19a1d0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:13.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.355+0000 7fe26279e640 1 -- 172.21.15.53:0/682960562 >> 172.21.15.53:0/682960562 conn(0x7fe25c07b5f0 msgr2=0x7fe25c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:13.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.355+0000 7fe26279e640 1 -- 172.21.15.53:0/682960562 shutdown_connections 2024-08-31T06:15:13.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:13.355+0000 7fe26279e640 1 -- 172.21.15.53:0/682960562 wait complete. 2024-08-31T06:15:13.916 INFO:tasks.quiescer.fs.[cephfs]:Total duration (50.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T06:15:13.917 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.25 2024-08-31T06:15:13.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:15:13.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 170413 1.51 MB/sec execute 423 sec latency 2460.477 ms 2024-08-31T06:15:14.061 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:15:14.183 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:14.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:14 smithi053 ceph-mon[18924]: pgmap v640: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-08-31T06:15:14.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:14 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/682960562' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:14 smithi153 ceph-mon[22320]: pgmap v640: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-08-31T06:15:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:14 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/682960562' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:14 smithi130 ceph-mon[22266]: pgmap v640: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-08-31T06:15:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:14 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/682960562' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:14.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.648+0000 7f7700f5e640 1 -- 172.21.15.53:0/847588866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76fc102820 msgr2=0x7f76fc102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.648+0000 7f7700f5e640 1 --2- 172.21.15.53:0/847588866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76fc102820 0x7f76fc102c30 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009900 tx=0x7f76ec02a410 comp rx=0 tx=0).stop 2024-08-31T06:15:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.649+0000 7f7700f5e640 1 -- 172.21.15.53:0/847588866 shutdown_connections 2024-08-31T06:15:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.649+0000 7f7700f5e640 1 --2- 172.21.15.53:0/847588866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76fc108ab0 0x7f76fc10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.649+0000 7f7700f5e640 1 --2- 172.21.15.53:0/847588866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76fc108160 0x7f76fc108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.649+0000 7f7700f5e640 1 --2- 172.21.15.53:0/847588866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76fc102820 0x7f76fc102c30 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.649+0000 7f7700f5e640 1 -- 172.21.15.53:0/847588866 >> 172.21.15.53:0/847588866 conn(0x7f76fc0794e0 msgr2=0x7f76fc0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.649+0000 7f7700f5e640 1 -- 172.21.15.53:0/847588866 shutdown_connections 2024-08-31T06:15:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.649+0000 7f7700f5e640 1 -- 172.21.15.53:0/847588866 wait complete. 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f7700f5e640 1 Processor -- start 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f7700f5e640 1 -- start start 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f7700f5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76fc102820 0x7f76fc19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f7700f5e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76fc108160 0x7f76fc19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f7700f5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76fc108ab0 0x7f76fc1a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f7700f5e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc1125c0 con 0x7f76fc102820 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f7700f5e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc112440 con 0x7f76fc108ab0 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f7700f5e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc112740 con 0x7f76fc108160 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76fc102820 0x7f76fc19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76fc102820 0x7f76fc19c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35440/0 (socket says 172.21.15.53:35440) 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f76fa59c640 1 -- 172.21.15.53:0/4114657864 learned_addr learned my addr 172.21.15.53:0/4114657864 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f76fad9d640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76fc108ab0 0x7f76fc1a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.650+0000 7f76f3fff640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76fc108160 0x7f76fc19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f76fa59c640 1 -- 172.21.15.53:0/4114657864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76fc108160 msgr2=0x7f76fc19c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f76fa59c640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76fc108160 0x7f76fc19c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f76fa59c640 1 -- 172.21.15.53:0/4114657864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76fc108ab0 msgr2=0x7f76fc1a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f76fa59c640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76fc108ab0 0x7f76fc1a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f76fa59c640 1 -- 172.21.15.53:0/4114657864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76fc1a22b0 con 0x7f76fc102820 2024-08-31T06:15:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f76f3fff640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76fc108160 0x7f76fc19c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:15:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f76fad9d640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76fc108ab0 0x7f76fc1a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f76fa59c640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76fc102820 0x7f76fc19c400 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009a20 tx=0x7f76ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f76f37fe640 1 -- 172.21.15.53:0/4114657864 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec03f030 con 0x7f76fc102820 2024-08-31T06:15:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f76f37fe640 1 -- 172.21.15.53:0/4114657864 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76ec0035f0 con 0x7f76fc102820 2024-08-31T06:15:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f7700f5e640 1 -- 172.21.15.53:0/4114657864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76fc1a2540 con 0x7f76fc102820 2024-08-31T06:15:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f76f37fe640 1 -- 172.21.15.53:0/4114657864 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec035070 con 0x7f76fc102820 2024-08-31T06:15:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.651+0000 7f7700f5e640 1 -- 172.21.15.53:0/4114657864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76fc1a2a20 con 0x7f76fc102820 2024-08-31T06:15:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.652+0000 7f7700f5e640 1 -- 172.21.15.53:0/4114657864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76fc103aa0 con 0x7f76fc102820 2024-08-31T06:15:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.654+0000 7f76f37fe640 1 -- 172.21.15.53:0/4114657864 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f76ec003aa0 con 0x7f76fc102820 2024-08-31T06:15:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.654+0000 7f76f37fe640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76e80b4cd0 0x7f76e80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.654+0000 7f76f3fff640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76e80b4cd0 0x7f76e80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.654+0000 7f76f37fe640 1 -- 172.21.15.53:0/4114657864 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f76ec1065b0 con 0x7f76fc102820 2024-08-31T06:15:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.655+0000 7f76f3fff640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76e80b4cd0 0x7f76e80b71e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f76fc079930 tx=0x7f76e4005d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:14.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.658+0000 7f76f37fe640 1 -- 172.21.15.53:0/4114657864 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f76ec0cd380 con 0x7f76fc102820 2024-08-31T06:15:14.701 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:14.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.895+0000 7f7700f5e640 1 -- 172.21.15.53:0/4114657864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76fc102c30 con 0x7f76fc102820 2024-08-31T06:15:14.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.896+0000 7f76f37fe640 1 -- 172.21.15.53:0/4114657864 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+12005 (secure 0 0 0) 0x7f76ec0ccc80 con 0x7f76fc102820 2024-08-31T06:15:14.898 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:15:14.898 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":47,"btime":"2024-08-31T06:15:07:112545+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":47,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:15:06.232396+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:15:14.898 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 47 2024-08-31T06:15:14.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 -- 172.21.15.53:0/4114657864 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76e80b4cd0 msgr2=0x7f76e80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:14.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76e80b4cd0 0x7f76e80b71e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f76fc079930 tx=0x7f76e4005d90 comp rx=0 tx=0).stop 2024-08-31T06:15:14.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 -- 172.21.15.53:0/4114657864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76fc102820 msgr2=0x7f76fc19c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:14.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76fc102820 0x7f76fc19c400 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009a20 tx=0x7f76ec004270 comp rx=0 tx=0).stop 2024-08-31T06:15:14.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 -- 172.21.15.53:0/4114657864 shutdown_connections 2024-08-31T06:15:14.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76e80b4cd0 0x7f76e80b71e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:14.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76fc108ab0 0x7f76fc1a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:14.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76fc108160 0x7f76fc19c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:14.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 --2- 172.21.15.53:0/4114657864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76fc102820 0x7f76fc19c400 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:14.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 -- 172.21.15.53:0/4114657864 >> 172.21.15.53:0/4114657864 conn(0x7f76fc0794e0 msgr2=0x7f76fc06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:14.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 -- 172.21.15.53:0/4114657864 shutdown_connections 2024-08-31T06:15:14.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:14.898+0000 7f7700f5e640 1 -- 172.21.15.53:0/4114657864 wait complete. 2024-08-31T06:15:14.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 170413 1.50 MB/sec execute 424 sec latency 3460.502 ms 2024-08-31T06:15:15.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.364+0000 7fd350259640 1 -- 172.21.15.53:0/2345059414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348109b90 msgr2=0x7fd3481103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:15.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.364+0000 7fd350259640 1 --2- 172.21.15.53:0/2345059414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348109b90 0x7fd3481103c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fd340009ca0 tx=0x7fd34002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.364+0000 7fd350259640 1 -- 172.21.15.53:0/2345059414 shutdown_connections 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.364+0000 7fd350259640 1 --2- 172.21.15.53:0/2345059414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348109b90 0x7fd3481103c0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.364+0000 7fd350259640 1 --2- 172.21.15.53:0/2345059414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd348109240 0x7fd348109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.364+0000 7fd350259640 1 --2- 172.21.15.53:0/2345059414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd348103900 0x7fd348103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.364+0000 7fd350259640 1 -- 172.21.15.53:0/2345059414 >> 172.21.15.53:0/2345059414 conn(0x7fd34807b5f0 msgr2=0x7fd34807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.364+0000 7fd350259640 1 -- 172.21.15.53:0/2345059414 shutdown_connections 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.364+0000 7fd350259640 1 -- 172.21.15.53:0/2345059414 wait complete. 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.365+0000 7fd350259640 1 Processor -- start 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.365+0000 7fd350259640 1 -- start start 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.365+0000 7fd350259640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd348103900 0x7fd34819a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.365+0000 7fd350259640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd348109240 0x7fd34819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.365+0000 7fd350259640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348109b90 0x7fd34819f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.365+0000 7fd350259640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd348113750 con 0x7fd348109b90 2024-08-31T06:15:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.365+0000 7fd350259640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd3481135d0 con 0x7fd348103900 2024-08-31T06:15:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.365+0000 7fd350259640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd3481138d0 con 0x7fd348109240 2024-08-31T06:15:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.365+0000 7fd34e7f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348109b90 0x7fd34819f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.365+0000 7fd34e7f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348109b90 0x7fd34819f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35458/0 (socket says 172.21.15.53:35458) 2024-08-31T06:15:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.365+0000 7fd34e7f6640 1 -- 172.21.15.53:0/1606072916 learned_addr learned my addr 172.21.15.53:0/1606072916 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd348109240 0x7fd34819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd34dff5640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd348103900 0x7fd34819a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd34e7f6640 1 -- 172.21.15.53:0/1606072916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd348109240 msgr2=0x7fd34819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd34e7f6640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd348109240 0x7fd34819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd34e7f6640 1 -- 172.21.15.53:0/1606072916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd348103900 msgr2=0x7fd34819a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd34e7f6640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd348103900 0x7fd34819a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd34e7f6640 1 -- 172.21.15.53:0/1606072916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3481a00b0 con 0x7fd348109b90 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd348109240 0x7fd34819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd34dff5640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd348103900 0x7fd34819a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd34e7f6640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348109b90 0x7fd34819f980 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fd340005cc0 tx=0x7fd340032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd33effd640 1 -- 172.21.15.53:0/1606072916 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340032e00 con 0x7fd348109b90 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd33effd640 1 -- 172.21.15.53:0/1606072916 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3400044d0 con 0x7fd348109b90 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd350259640 1 -- 172.21.15.53:0/1606072916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3481a0340 con 0x7fd348109b90 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd33effd640 1 -- 172.21.15.53:0/1606072916 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340030b70 con 0x7fd348109b90 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.366+0000 7fd350259640 1 -- 172.21.15.53:0/1606072916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3481a6b00 con 0x7fd348109b90 2024-08-31T06:15:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.369+0000 7fd3567ce740 1 Processor -- start 2024-08-31T06:15:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.369+0000 7fd33effd640 1 -- 172.21.15.53:0/1606072916 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd340030d10 con 0x7fd348109b90 2024-08-31T06:15:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.369+0000 7fd3567ce740 1 -- start start 2024-08-31T06:15:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.369+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2cf070 0x55690e674310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.369+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2a61b0 0x55690e674850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.369+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e674d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.369+0000 7fd3567ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55690e5eb680 con 0x55690e2ae390 2024-08-31T06:15:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.369+0000 7fd3567ce740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55690e5dac10 con 0x55690e2cf070 2024-08-31T06:15:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.369+0000 7fd3567ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55690e5debc0 con 0x55690e2a61b0 2024-08-31T06:15:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34d7f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e674d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34d7f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e674d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35462/0 (socket says 172.21.15.53:35462) 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34d7f4640 1 -- 172.21.15.53:0/495445865 learned_addr learned my addr 172.21.15.53:0/495445865 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34dff5640 1 --2- 172.21.15.53:0/495445865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2a61b0 0x55690e674850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd33effd640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd3340b4ca0 0x7fd3340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/495445865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2cf070 0x55690e674310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34d7f4640 1 -- 172.21.15.53:0/495445865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2a61b0 msgr2=0x55690e674850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/495445865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2a61b0 0x55690e674850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34d7f4640 1 -- 172.21.15.53:0/495445865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2cf070 msgr2=0x55690e674310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/495445865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2cf070 0x55690e674310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34d7f4640 1 -- 172.21.15.53:0/495445865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55690e33a650 con 0x55690e2ae390 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34e7f6640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd3340b4ca0 0x7fd3340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd33effd640 1 -- 172.21.15.53:0/1606072916 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fd3401068c0 con 0x7fd348109b90 2024-08-31T06:15:15.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/495445865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e674d90 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fd33800de50 tx=0x7fd33800d5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a50a176ddff994 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd333fff640 1 -- 172.21.15.53:0/495445865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338011070 con 0x55690e2ae390 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd333fff640 1 -- 172.21.15.53:0/495445865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd338017070 con 0x55690e2ae390 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.370+0000 7fd333fff640 1 -- 172.21.15.53:0/495445865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3380047a0 con 0x55690e2ae390 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.371+0000 7fd3567ce740 1 -- 172.21.15.53:0/495445865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 msgr2=0x55690e674d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.371+0000 7fd3567ce740 1 --2- 172.21.15.53:0/495445865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e674d90 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fd33800de50 tx=0x7fd33800d5d0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.371+0000 7fd34e7f6640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd3340b4ca0 0x7fd3340b71b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd3401040a0 tx=0x7fd3400992a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.371+0000 7fd3567ce740 1 -- 172.21.15.53:0/495445865 shutdown_connections 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.371+0000 7fd3567ce740 1 --2- 172.21.15.53:0/495445865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e674d90 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.371+0000 7fd3567ce740 1 --2- 172.21.15.53:0/495445865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2a61b0 0x55690e674850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.371+0000 7fd3567ce740 1 --2- 172.21.15.53:0/495445865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2cf070 0x55690e674310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.371+0000 7fd3567ce740 1 -- 172.21.15.53:0/495445865 >> 172.21.15.53:0/495445865 conn(0x55690e2c3460 msgr2=0x55690e672200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.371+0000 7fd3567ce740 1 -- 172.21.15.53:0/495445865 shutdown_connections 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.372+0000 7fd3567ce740 1 -- 172.21.15.53:0/495445865 wait complete. 2024-08-31T06:15:15.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.372+0000 7fd3567ce740 1 -- start start 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.372+0000 7fd3567ce740 1 Processor -- start 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.372+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2a61b0 0x55690e67fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.372+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2ae390 0x55690e680000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.372+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2cf070 0x55690e68be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.372+0000 7fd3567ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55690e43d700 con 0x55690e2cf070 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.372+0000 7fd3567ce740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55690e561750 con 0x55690e2a61b0 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.372+0000 7fd3567ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55690e682af0 con 0x55690e2ae390 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd3567ce740 10 client.0 _ll_register_callbacks cb 0x55690e590e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd34d7f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2cf070 0x55690e68be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd34d7f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2cf070 0x55690e68be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35478/0 (socket says 172.21.15.53:35478) 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd34d7f4640 1 -- 172.21.15.53:0/2548431677 learned_addr learned my addr 172.21.15.53:0/2548431677 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2a61b0 0x55690e67fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd34dff5640 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2ae390 0x55690e680000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd34d7f4640 1 -- 172.21.15.53:0/2548431677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2ae390 msgr2=0x55690e680000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2ae390 0x55690e680000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd34d7f4640 1 -- 172.21.15.53:0/2548431677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2a61b0 msgr2=0x55690e67fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2a61b0 0x55690e67fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd34d7f4640 1 -- 172.21.15.53:0/2548431677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55690e59a900 con 0x55690e2cf070 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2cf070 0x55690e68be10 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fd33800dac0 tx=0x7fd338005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72bfa8d53ef4c6c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd3317fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd3317fa640 1 -- 172.21.15.53:0/2548431677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338004050 con 0x55690e2cf070 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd3317fa640 1 -- 172.21.15.53:0/2548431677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fd3380041f0 con 0x55690e2cf070 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.373+0000 7fd3567ce740 1 -- 172.21.15.53:0/2548431677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd338017070 con 0x55690e2cf070 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd3317fa640 1 -- 172.21.15.53:0/2548431677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fd33802f050 con 0x55690e2cf070 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd3567ce740 10 client.18777 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:15.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd3567ce740 1 -- 172.21.15.53:0/2548431677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55690e68e920 con 0x55690e2cf070 2024-08-31T06:15:15.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd3317fa640 1 -- 172.21.15.53:0/2548431677 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd338017070 con 0x55690e2cf070 2024-08-31T06:15:15.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd3317fa640 1 -- 172.21.15.53:0/2548431677 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7fd338027020 con 0x55690e2cf070 2024-08-31T06:15:15.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd3567ce740 10 client.18777 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:15.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd3567ce740 10 client.18777 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:15:15.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd3567ce740 20 client.18777 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:15.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd3567ce740 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55690e28d9f0 0x55690e691d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd3567ce740 4 client.18777 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:15.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd3567ce740 1 -- 172.21.15.53:0/2548431677 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55690e5ed5d0 con 0x55690e28d9f0 2024-08-31T06:15:15.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.374+0000 7fd34dff5640 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55690e28d9f0 0x55690e691d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.375+0000 7fd34dff5640 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55690e28d9f0 0x55690e691d30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=928ad49266eacbb5 server_cookie=75fc526a391e138e in_seq=0 out_seq=0 2024-08-31T06:15:15.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.375+0000 7fd3317fa640 10 client.18777 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:15:15.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3317fa640 1 -- 172.21.15.53:0/2548431677 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55690e5ed5d0 con 0x55690e28d9f0 2024-08-31T06:15:15.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3317fa640 10 client.18777 handle_command_reply: tid=0 2024-08-31T06:15:15.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 1 client.18777 shutdown 2024-08-31T06:15:15.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 1 -- 172.21.15.53:0/2548431677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2cf070 msgr2=0x55690e68be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:15.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2cf070 0x55690e68be10 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fd33800dac0 tx=0x7fd338005430 comp rx=0 tx=0).stop 2024-08-31T06:15:15.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 1 -- 172.21.15.53:0/2548431677 shutdown_connections 2024-08-31T06:15:15.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2cf070 0x55690e68be10 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55690e28d9f0 0x55690e691d30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2ae390 0x55690e680000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 1 --2- 172.21.15.53:0/2548431677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2a61b0 0x55690e67fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 1 -- 172.21.15.53:0/2548431677 >> 172.21.15.53:0/2548431677 conn(0x55690e2c3460 msgr2=0x55690e6774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:15.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3317fa640 0 client.18777 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:15:15.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 1 -- 172.21.15.53:0/2548431677 shutdown_connections 2024-08-31T06:15:15.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 1 -- 172.21.15.53:0/2548431677 wait complete. 2024-08-31T06:15:15.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.376+0000 7fd3567ce740 20 client.18777 trim_cache size 0 max 16384 2024-08-31T06:15:15.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.390+0000 7fd3567ce740 1 Processor -- start 2024-08-31T06:15:15.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.390+0000 7fd3567ce740 1 -- start start 2024-08-31T06:15:15.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.390+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2a61b0 0x55690e677b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.390+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e67ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.390+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2cf070 0x55690e67d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.390+0000 7fd3567ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd3481af500 con 0x55690e2ae390 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.390+0000 7fd3567ce740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd3481b1250 con 0x55690e2cf070 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.390+0000 7fd3567ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd3481afbd0 con 0x55690e2a61b0 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.390+0000 7fd34dff5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e67ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.390+0000 7fd34dff5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e67ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35488/0 (socket says 172.21.15.53:35488) 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.390+0000 7fd34dff5640 1 -- 172.21.15.53:0/3930346536 learned_addr learned my addr 172.21.15.53:0/3930346536 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/3930346536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2cf070 0x55690e67d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/3930346536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2a61b0 0x55690e677b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd34dff5640 1 -- 172.21.15.53:0/3930346536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2a61b0 msgr2=0x55690e677b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd34dff5640 1 --2- 172.21.15.53:0/3930346536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2a61b0 0x55690e677b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd34dff5640 1 -- 172.21.15.53:0/3930346536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2cf070 msgr2=0x55690e67d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd34dff5640 1 --2- 172.21.15.53:0/3930346536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2cf070 0x55690e67d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd34dff5640 1 -- 172.21.15.53:0/3930346536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55690e678060 con 0x55690e2ae390 2024-08-31T06:15:15.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/3930346536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2cf070 0x55690e67d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:15.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd34dff5640 1 --2- 172.21.15.53:0/3930346536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e67ccb0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x55690e692330 tx=0x7fd344005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e1b176ef0ef5a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:15.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd3337fe640 1 -- 172.21.15.53:0/3930346536 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3440142d0 con 0x55690e2ae390 2024-08-31T06:15:15.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd3337fe640 1 -- 172.21.15.53:0/3930346536 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd344005050 con 0x55690e2ae390 2024-08-31T06:15:15.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.391+0000 7fd3337fe640 1 -- 172.21.15.53:0/3930346536 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344004ab0 con 0x55690e2ae390 2024-08-31T06:15:15.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.392+0000 7fd3567ce740 1 -- 172.21.15.53:0/3930346536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 msgr2=0x55690e67ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.392+0000 7fd3567ce740 1 --2- 172.21.15.53:0/3930346536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e67ccb0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x55690e692330 tx=0x7fd344005850 comp rx=0 tx=0).stop 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.392+0000 7fd3567ce740 1 -- 172.21.15.53:0/3930346536 shutdown_connections 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.392+0000 7fd3567ce740 1 --2- 172.21.15.53:0/3930346536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2cf070 0x55690e67d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.392+0000 7fd3567ce740 1 --2- 172.21.15.53:0/3930346536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e67ccb0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.392+0000 7fd3567ce740 1 --2- 172.21.15.53:0/3930346536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2a61b0 0x55690e677b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.392+0000 7fd3567ce740 1 -- 172.21.15.53:0/3930346536 >> 172.21.15.53:0/3930346536 conn(0x55690e2c3460 msgr2=0x55690e677410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.392+0000 7fd3567ce740 1 -- 172.21.15.53:0/3930346536 shutdown_connections 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.392+0000 7fd3567ce740 1 -- 172.21.15.53:0/3930346536 wait complete. 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd3567ce740 1 -- start start 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd3567ce740 1 Processor -- start 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2a61b0 0x55690e683ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e684530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd3567ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2cf070 0x55690e6fb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd3567ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd3481b0ac0 con 0x55690e2ae390 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd3567ce740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd3481b0360 con 0x55690e2a61b0 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd3567ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd3481ad500 con 0x55690e2cf070 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd3567ce740 10 client.0 _ll_register_callbacks cb 0x7fd33800dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd34dff5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e684530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd34dff5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e684530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35498/0 (socket says 172.21.15.53:35498) 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.393+0000 7fd34dff5640 1 -- 172.21.15.53:0/774713791 learned_addr learned my addr 172.21.15.53:0/774713791 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2a61b0 0x55690e683ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2cf070 0x55690e6fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd34dff5640 1 -- 172.21.15.53:0/774713791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2cf070 msgr2=0x55690e6fb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd34dff5640 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2cf070 0x55690e6fb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd34dff5640 1 -- 172.21.15.53:0/774713791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2a61b0 msgr2=0x55690e683ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd34dff5640 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2a61b0 0x55690e683ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd34dff5640 1 -- 172.21.15.53:0/774713791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55690e684d60 con 0x55690e2ae390 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd34dff5640 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e684530 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fd34400bd60 tx=0x7fd344004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eacc824885e93f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd3317fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd3317fa640 1 -- 172.21.15.53:0/774713791 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3440140d0 con 0x55690e2ae390 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd3317fa640 1 -- 172.21.15.53:0/774713791 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fd344014270 con 0x55690e2ae390 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd3567ce740 1 -- 172.21.15.53:0/774713791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd344005050 con 0x55690e2ae390 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd3317fa640 1 -- 172.21.15.53:0/774713791 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fd344005200 con 0x55690e2ae390 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd3567ce740 10 client.18783 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.394+0000 7fd3567ce740 1 -- 172.21.15.53:0/774713791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55690e6fcab0 con 0x55690e2ae390 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.395+0000 7fd3317fa640 1 -- 172.21.15.53:0/774713791 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd344005050 con 0x55690e2ae390 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.395+0000 7fd3317fa640 1 -- 172.21.15.53:0/774713791 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7fd3440035f0 con 0x55690e2ae390 2024-08-31T06:15:15.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.395+0000 7fd3567ce740 10 client.18783 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.395+0000 7fd3567ce740 10 client.18783 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.395+0000 7fd3567ce740 20 client.18783 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.395+0000 7fd3567ce740 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55690e262da0 0x55690e6ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.395+0000 7fd3567ce740 4 client.18783 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.395+0000 7fd3567ce740 1 -- 172.21.15.53:0/774713791 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55690e5e9070 con 0x55690e262da0 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.395+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55690e262da0 0x55690e6ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd34d7f4640 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55690e262da0 0x55690e6ff1b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=287536dcacf55e09 server_cookie=2f54a646ff8f195f in_seq=0 out_seq=0 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3317fa640 10 client.18783 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3317fa640 1 -- 172.21.15.53:0/774713791 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55690e5e9070 con 0x55690e262da0 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3317fa640 10 client.18783 handle_command_reply: tid=0 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 1 client.18783 shutdown 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 1 -- 172.21.15.53:0/774713791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 msgr2=0x55690e684530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e684530 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fd34400bd60 tx=0x7fd344004490 comp rx=0 tx=0).stop 2024-08-31T06:15:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 1 -- 172.21.15.53:0/774713791 shutdown_connections 2024-08-31T06:15:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55690e262da0 0x55690e6ff1b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55690e2cf070 0x55690e6fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55690e2ae390 0x55690e684530 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3317fa640 0 client.18783 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:15:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 1 --2- 172.21.15.53:0/774713791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55690e2a61b0 0x55690e683ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 1 -- 172.21.15.53:0/774713791 >> 172.21.15.53:0/774713791 conn(0x55690e2c3460 msgr2=0x55690e675340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 1 -- 172.21.15.53:0/774713791 shutdown_connections 2024-08-31T06:15:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 1 -- 172.21.15.53:0/774713791 wait complete. 2024-08-31T06:15:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.396+0000 7fd3567ce740 20 client.18783 trim_cache size 0 max 16384 2024-08-31T06:15:15.403 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:15:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 -- 172.21.15.53:0/1606072916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd3340b4ca0 msgr2=0x7fd3340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd3340b4ca0 0x7fd3340b71b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd3401040a0 tx=0x7fd3400992a0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 -- 172.21.15.53:0/1606072916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348109b90 msgr2=0x7fd34819f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348109b90 0x7fd34819f980 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fd340005cc0 tx=0x7fd340032a10 comp rx=0 tx=0).stop 2024-08-31T06:15:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 -- 172.21.15.53:0/1606072916 shutdown_connections 2024-08-31T06:15:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd3340b4ca0 0x7fd3340b71b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348109b90 0x7fd34819f980 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd348109240 0x7fd34819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 --2- 172.21.15.53:0/1606072916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd348103900 0x7fd34819a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:15.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 -- 172.21.15.53:0/1606072916 >> 172.21.15.53:0/1606072916 conn(0x7fd34807b5f0 msgr2=0x7fd348105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:15.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 -- 172.21.15.53:0/1606072916 shutdown_connections 2024-08-31T06:15:15.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:15.397+0000 7fd350259640 1 -- 172.21.15.53:0/1606072916 wait complete. 2024-08-31T06:15:15.642 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:15 smithi130 ceph-mon[22266]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T06:15:15.642 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:15 smithi130 ceph-mon[22266]: pgmap v642: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 965 KiB/s wr, 91 op/s 2024-08-31T06:15:15.642 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:15 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4114657864' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:15 smithi153 ceph-mon[22320]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T06:15:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:15 smithi153 ceph-mon[22320]: pgmap v642: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 965 KiB/s wr, 91 op/s 2024-08-31T06:15:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:15 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4114657864' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:15.719 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:15 smithi053 ceph-mon[18924]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T06:15:15.719 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:15 smithi053 ceph-mon[18924]: pgmap v642: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 965 KiB/s wr, 91 op/s 2024-08-31T06:15:15.719 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:15 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4114657864' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:15.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 170413 1.50 MB/sec execute 425 sec latency 4460.567 ms 2024-08-31T06:15:16.124 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:15:16.653 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0' 2024-08-31T06:15:16.653 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0 2024-08-31T06:15:16.725 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:16.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 170613 1.50 MB/sec execute 426 sec latency 4713.172 ms 2024-08-31T06:15:17.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.226+0000 7fdce05c6640 1 -- 172.21.15.53:0/1166938775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcd8103910 msgr2=0x7fdcd8103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.226+0000 7fdce05c6640 1 --2- 172.21.15.53:0/1166938775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcd8103910 0x7fdcd8103d20 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009900 tx=0x7fdccc02a410 comp rx=0 tx=0).stop 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.226+0000 7fdce05c6640 1 -- 172.21.15.53:0/1166938775 shutdown_connections 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.226+0000 7fdce05c6640 1 --2- 172.21.15.53:0/1166938775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcd8109ba0 0x7fdcd81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.226+0000 7fdce05c6640 1 --2- 172.21.15.53:0/1166938775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd8109250 0x7fdcd8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.226+0000 7fdce05c6640 1 --2- 172.21.15.53:0/1166938775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcd8103910 0x7fdcd8103d20 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.226+0000 7fdce05c6640 1 -- 172.21.15.53:0/1166938775 >> 172.21.15.53:0/1166938775 conn(0x7fdcd80ff380 msgr2=0x7fdcd81017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.226+0000 7fdce05c6640 1 -- 172.21.15.53:0/1166938775 shutdown_connections 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.226+0000 7fdce05c6640 1 -- 172.21.15.53:0/1166938775 wait complete. 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.227+0000 7fdce05c6640 1 Processor -- start 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.227+0000 7fdce05c6640 1 -- start start 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.227+0000 7fdce05c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcd8103910 0x7fdcd819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdce05c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcd8109250 0x7fdcd819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdce05c6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd8109ba0 0x7fdcd819f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdce05c6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd8113710 con 0x7fdcd8109250 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdce05c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd8113590 con 0x7fdcd8103910 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdce05c6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd8113890 con 0x7fdcd8109ba0 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcddb61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcd8109250 0x7fdcd819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcde362640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcd8103910 0x7fdcd819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcddb61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcd8109250 0x7fdcd819a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35516/0 (socket says 172.21.15.53:35516) 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcddb61640 1 -- 172.21.15.53:0/2813519396 learned_addr learned my addr 172.21.15.53:0/2813519396 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd8109ba0 0x7fdcd819f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcde362640 1 -- 172.21.15.53:0/2813519396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd8109ba0 msgr2=0x7fdcd819f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcde362640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd8109ba0 0x7fdcd819f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcde362640 1 -- 172.21.15.53:0/2813519396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcd8109250 msgr2=0x7fdcd819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcde362640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcd8109250 0x7fdcd819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcde362640 1 -- 172.21.15.53:0/2813519396 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd81a00f0 con 0x7fdcd8103910 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcddb61640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcd8109250 0x7fdcd819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd8109ba0 0x7fdcd819f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.228+0000 7fdcde362640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcd8103910 0x7fdcd819a180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdccc005940 tx=0x7fdccc005e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.229+0000 7fdccb7fe640 1 -- 172.21.15.53:0/2813519396 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc03f070 con 0x7fdcd8103910 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.229+0000 7fdce05c6640 1 -- 172.21.15.53:0/2813519396 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd81a0380 con 0x7fdcd8103910 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.229+0000 7fdccb7fe640 1 -- 172.21.15.53:0/2813519396 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdccc003a80 con 0x7fdcd8103910 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.229+0000 7fdccb7fe640 1 -- 172.21.15.53:0/2813519396 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc035070 con 0x7fdcd8103910 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.229+0000 7fdce05c6640 1 -- 172.21.15.53:0/2813519396 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd81a6b40 con 0x7fdcd8103910 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.232+0000 7fdce6b3b740 1 Processor -- start 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.232+0000 7fdce6b3b740 1 -- start start 2024-08-31T06:15:17.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.232+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 0x558c5292b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.232+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 0x558c5292b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.232+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c5292bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.232+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c528a2680 con 0x558c52565390 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.232+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558c52891c10 con 0x558c52586070 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.232+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558c52895bc0 con 0x558c5255d1b0 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdccb7fe640 1 -- 172.21.15.53:0/2813519396 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdccc0035f0 con 0x7fdcd8103910 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcdeb63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 0x558c5292b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcdeb63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 0x558c5292b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53160/0 (socket says 172.21.15.53:53160) 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcdeb63640 1 -- 172.21.15.53:0/1590847501 learned_addr learned my addr 172.21.15.53:0/1590847501 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcddb61640 1 --2- 172.21.15.53:0/1590847501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c5292bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcde362640 1 --2- 172.21.15.53:0/1590847501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 0x558c5292b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcdeb63640 1 -- 172.21.15.53:0/1590847501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 msgr2=0x558c5292b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/1590847501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 0x558c5292b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcdeb63640 1 -- 172.21.15.53:0/1590847501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 msgr2=0x558c5292bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/1590847501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c5292bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcdeb63640 1 -- 172.21.15.53:0/1590847501 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c525f1650 con 0x558c52586070 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/1590847501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 0x558c5292b310 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00117e0 tx=0x7fdcd0011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78ea3e25d1852d42 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.233+0000 7fdcc8ff9640 1 -- 172.21.15.53:0/1590847501 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0011310 con 0x558c52586070 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.234+0000 7fdcc8ff9640 1 -- 172.21.15.53:0/1590847501 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcd0003e00 con 0x558c52586070 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.234+0000 7fdcc8ff9640 1 -- 172.21.15.53:0/1590847501 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0004450 con 0x558c52586070 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.234+0000 7fdccb7fe640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdcc40b4ca0 0x7fdcc40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.234+0000 7fdcde362640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdcc40b4ca0 0x7fdcc40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.234+0000 7fdccb7fe640 1 -- 172.21.15.53:0/2813519396 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fdccc105610 con 0x7fdcd8103910 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1590847501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 msgr2=0x558c5292b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdcde362640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdcc40b4ca0 0x7fdcc40b71b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdccc102df0 tx=0x7fdccc0b3040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/1590847501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 0x558c5292b310 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00117e0 tx=0x7fdcd0011ca0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1590847501 shutdown_connections 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/1590847501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c5292bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/1590847501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 0x558c5292b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/1590847501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 0x558c5292b310 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1590847501 >> 172.21.15.53:0/1590847501 conn(0x558c5257a460 msgr2=0x558c52929200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1590847501 shutdown_connections 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1590847501 wait complete. 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdce6b3b740 1 -- start start 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.235+0000 7fdce6b3b740 1 Processor -- start 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 0x558c52936b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c52937080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 0x558c52942de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c526f4700 con 0x558c52565390 2024-08-31T06:15:17.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558c52818750 con 0x558c52586070 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558c52939af0 con 0x558c5255d1b0 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdce6b3b740 10 client.0 _ll_register_callbacks cb 0x558c52847e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdcddb61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c52937080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdcdeb63640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 0x558c52936b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdcddb61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c52937080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35538/0 (socket says 172.21.15.53:35538) 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdcddb61640 1 -- 172.21.15.53:0/2196095190 learned_addr learned my addr 172.21.15.53:0/2196095190 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdcdeb63640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 0x558c52936b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57468/0 (socket says 172.21.15.53:57468) 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 0x558c52942de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdcdeb63640 1 -- 172.21.15.53:0/2196095190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 msgr2=0x558c52942de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 0x558c52942de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdcdeb63640 1 -- 172.21.15.53:0/2196095190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 msgr2=0x558c52937080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c52937080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.236+0000 7fdcdeb63640 1 -- 172.21.15.53:0/2196095190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c52851900 con 0x558c5255d1b0 2024-08-31T06:15:17.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.237+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 0x558c52936b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0004070 tx=0x7fdcd0005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a656f83b162ca9de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.237+0000 7fdcc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:15:17.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.237+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/2196095190 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0025040 con 0x558c5255d1b0 2024-08-31T06:15:17.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.237+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/2196095190 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fdcd0004a40 con 0x558c5255d1b0 2024-08-31T06:15:17.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.237+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2196095190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcd0003e00 con 0x558c5255d1b0 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.237+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/2196095190 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdcd0032050 con 0x558c5255d1b0 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.237+0000 7fdce6b3b740 10 client.27976 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.237+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2196095190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x558c52945950 con 0x558c5255d1b0 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.237+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/2196095190 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcd001f070 con 0x558c5255d1b0 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.238+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/2196095190 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7fdcd0018020 con 0x558c5255d1b0 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.238+0000 7fdce6b3b740 10 client.27976 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.238+0000 7fdce6b3b740 10 client.27976 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.238+0000 7fdce6b3b740 20 client.27976 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.238+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558c525449f0 0x558c52948ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.238+0000 7fdce6b3b740 4 client.27976 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.238+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2196095190 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdcd0003e00 con 0x558c525449f0 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.238+0000 7fdcddb61640 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558c525449f0 0x558c52948ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.238+0000 7fdcc1ffb640 10 client.27976 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.239+0000 7fdcddb61640 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558c525449f0 0x558c52948ce0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6195566d20666ed9 server_cookie=1dff86ca6dd9870 in_seq=0 out_seq=0 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/2196095190 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fdcd0003e00 con 0x558c525449f0 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdcc1ffb640 10 client.27976 handle_command_reply: tid=0 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 1 client.27976 shutdown 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2196095190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 msgr2=0x558c52936b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 0x558c52936b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0004070 tx=0x7fdcd0005bd0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2196095190 shutdown_connections 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c52586070 0x558c52942de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558c525449f0 0x558c52948ce0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c52937080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/2196095190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c5255d1b0 0x558c52936b00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdcc1ffb640 0 client.27976 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2196095190 >> 172.21.15.53:0/2196095190 conn(0x558c5257a460 msgr2=0x558c5292e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2196095190 shutdown_connections 2024-08-31T06:15:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2196095190 wait complete. 2024-08-31T06:15:17.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.240+0000 7fdce6b3b740 20 client.27976 trim_cache size 0 max 16384 2024-08-31T06:15:17.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.256+0000 7fdce6b3b740 1 Processor -- start 2024-08-31T06:15:17.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.256+0000 7fdce6b3b740 1 -- start start 2024-08-31T06:15:17.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 0x558c529389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c5292c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c52586070 0x558c5292ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81af4f0 con 0x558c52565390 2024-08-31T06:15:17.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81b1240 con 0x558c5255d1b0 2024-08-31T06:15:17.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81afbc0 con 0x558c52586070 2024-08-31T06:15:17.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcdeb63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 0x558c529389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcddb61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c5292c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcdeb63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 0x558c529389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53182/0 (socket says 172.21.15.53:53182) 2024-08-31T06:15:17.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcdeb63640 1 -- 172.21.15.53:0/2313442863 learned_addr learned my addr 172.21.15.53:0/2313442863 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:17.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/2313442863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c52586070 0x558c5292ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcdeb63640 1 -- 172.21.15.53:0/2313442863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c52586070 msgr2=0x558c5292ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/2313442863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c52586070 0x558c5292ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcdeb63640 1 -- 172.21.15.53:0/2313442863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 msgr2=0x558c5292c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/2313442863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c5292c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcdeb63640 1 -- 172.21.15.53:0/2313442863 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c52929e00 con 0x558c5255d1b0 2024-08-31T06:15:17.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcddb61640 1 --2- 172.21.15.53:0/2313442863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c5292c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:17.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.257+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/2313442863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 0x558c529389e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00114a0 tx=0x7fdcd0005cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b3d75adb2fd206d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.258+0000 7fdcc3fff640 1 -- 172.21.15.53:0/2313442863 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0003c70 con 0x558c5255d1b0 2024-08-31T06:15:17.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.258+0000 7fdcc3fff640 1 -- 172.21.15.53:0/2313442863 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcd001f070 con 0x558c5255d1b0 2024-08-31T06:15:17.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.258+0000 7fdcc3fff640 1 -- 172.21.15.53:0/2313442863 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00057f0 con 0x558c5255d1b0 2024-08-31T06:15:17.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.259+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2313442863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 msgr2=0x558c529389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.259+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/2313442863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 0x558c529389e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00114a0 tx=0x7fdcd0005cf0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.259+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2313442863 shutdown_connections 2024-08-31T06:15:17.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.259+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/2313442863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c52586070 0x558c5292ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.259+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/2313442863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52565390 0x558c5292c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.259+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/2313442863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 0x558c529389e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.259+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2313442863 >> 172.21.15.53:0/2313442863 conn(0x558c5257a460 msgr2=0x558c5292c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.259+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2313442863 shutdown_connections 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.259+0000 7fdce6b3b740 1 -- 172.21.15.53:0/2313442863 wait complete. 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.259+0000 7fdce6b3b740 1 -- start start 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.259+0000 7fdce6b3b740 1 Processor -- start 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 0x558c5293d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c52565390 0x558c5293dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdce6b3b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52586070 0x558c529ab630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81b0ab0 con 0x558c52586070 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81b0350 con 0x558c5255d1b0 2024-08-31T06:15:17.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdce6b3b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81ad4f0 con 0x558c52565390 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdce6b3b740 10 client.0 _ll_register_callbacks cb 0x7fdcd4009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdcdeb63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52586070 0x558c529ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdcdeb63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52586070 0x558c529ab630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35548/0 (socket says 172.21.15.53:35548) 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdcdeb63640 1 -- 172.21.15.53:0/1262028592 learned_addr learned my addr 172.21.15.53:0/1262028592 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 0x558c5293d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.260+0000 7fdcddb61640 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c52565390 0x558c5293dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdcdeb63640 1 -- 172.21.15.53:0/1262028592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c52565390 msgr2=0x558c5293dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c52565390 0x558c5293dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdcdeb63640 1 -- 172.21.15.53:0/1262028592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52586070 msgr2=0x558c529ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52586070 0x558c529ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdcdeb63640 1 -- 172.21.15.53:0/1262028592 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c529abb70 con 0x558c5255d1b0 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdcdeb63640 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 0x558c5293d810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0005b70 tx=0x7fdcd000f9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bcde38024f04be2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdcc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:15:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/1262028592 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000fe90 con 0x558c5255d1b0 2024-08-31T06:15:17.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/1262028592 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fdcd0040050 con 0x558c5255d1b0 2024-08-31T06:15:17.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1262028592 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcd001f070 con 0x558c5255d1b0 2024-08-31T06:15:17.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/1262028592 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdcd0049050 con 0x558c5255d1b0 2024-08-31T06:15:17.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdce6b3b740 10 client.27992 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:17.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.261+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1262028592 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x558c529bc9e0 con 0x558c5255d1b0 2024-08-31T06:15:17.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.262+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/1262028592 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcd001f070 con 0x558c5255d1b0 2024-08-31T06:15:17.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.262+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/1262028592 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7fdcd0018070 con 0x558c5255d1b0 2024-08-31T06:15:17.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.262+0000 7fdce6b3b740 10 client.27992 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:17.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.262+0000 7fdce6b3b740 10 client.27992 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:15:17.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.262+0000 7fdce6b3b740 20 client.27992 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:17.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.262+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558c52519da0 0x558c529bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.262+0000 7fdce6b3b740 4 client.27992 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.262+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1262028592 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c528a45d0 con 0x558c52519da0 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.262+0000 7fdcddb61640 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558c52519da0 0x558c529bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.263+0000 7fdcc1ffb640 10 client.27992 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.263+0000 7fdcddb61640 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558c52519da0 0x558c529bf1b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a0dbd0fdfb7ed3f7 server_cookie=902ec8bc9e40db6d in_seq=0 out_seq=0 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdcc1ffb640 1 -- 172.21.15.53:0/1262028592 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c528a45d0 con 0x558c52519da0 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdcc1ffb640 10 client.27992 handle_command_reply: tid=0 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdce6b3b740 1 client.27992 shutdown 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1262028592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 msgr2=0x558c5293d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 0x558c5293d810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0005b70 tx=0x7fdcd000f9a0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1262028592 shutdown_connections 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558c52519da0 0x558c529bf1b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdcc1ffb640 0 client.27992 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:15:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c52586070 0x558c529ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558c52565390 0x558c5293dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdce6b3b740 1 --2- 172.21.15.53:0/1262028592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558c5255d1b0 0x558c5293d810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.264+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1262028592 >> 172.21.15.53:0/1262028592 conn(0x558c5257a460 msgr2=0x558c5292c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1262028592 shutdown_connections 2024-08-31T06:15:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce6b3b740 1 -- 172.21.15.53:0/1262028592 wait complete. 2024-08-31T06:15:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce6b3b740 20 client.27992 trim_cache size 0 max 16384 2024-08-31T06:15:17.270 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:15:17.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce05c6640 1 -- 172.21.15.53:0/2813519396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdcc40b4ca0 msgr2=0x7fdcc40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce05c6640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdcc40b4ca0 0x7fdcc40b71b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdccc102df0 tx=0x7fdccc0b3040 comp rx=0 tx=0).stop 2024-08-31T06:15:17.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce05c6640 1 -- 172.21.15.53:0/2813519396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcd8103910 msgr2=0x7fdcd819a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce05c6640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcd8103910 0x7fdcd819a180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdccc005940 tx=0x7fdccc005e10 comp rx=0 tx=0).stop 2024-08-31T06:15:17.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce05c6640 1 -- 172.21.15.53:0/2813519396 shutdown_connections 2024-08-31T06:15:17.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce05c6640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdcc40b4ca0 0x7fdcc40b71b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce05c6640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd8109ba0 0x7fdcd819f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce05c6640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcd8109250 0x7fdcd819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce05c6640 1 --2- 172.21.15.53:0/2813519396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcd8103910 0x7fdcd819a180 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.265+0000 7fdce05c6640 1 -- 172.21.15.53:0/2813519396 >> 172.21.15.53:0/2813519396 conn(0x7fdcd80ff380 msgr2=0x7fdcd81017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.266+0000 7fdce05c6640 1 -- 172.21.15.53:0/2813519396 shutdown_connections 2024-08-31T06:15:17.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:17.266+0000 7fdce05c6640 1 -- 172.21.15.53:0/2813519396 wait complete. 2024-08-31T06:15:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.766+0000 7f347b7df640 1 -- 172.21.15.53:0/3435545709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3474108a10 msgr2=0x7f347410f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.766+0000 7f347b7df640 1 --2- 172.21.15.53:0/3435545709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3474108a10 0x7f347410f240 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f346c009ca0 tx=0x7f346c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.766+0000 7f347b7df640 1 -- 172.21.15.53:0/3435545709 shutdown_connections 2024-08-31T06:15:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.766+0000 7f347b7df640 1 --2- 172.21.15.53:0/3435545709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3474108a10 0x7f347410f240 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.766+0000 7f347b7df640 1 --2- 172.21.15.53:0/3435545709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34741080c0 0x7f34741084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.766+0000 7f347b7df640 1 --2- 172.21.15.53:0/3435545709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3474102f00 0x7f3474103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.766+0000 7f347b7df640 1 -- 172.21.15.53:0/3435545709 >> 172.21.15.53:0/3435545709 conn(0x7f3474079c20 msgr2=0x7f347407a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.767+0000 7f347b7df640 1 -- 172.21.15.53:0/3435545709 shutdown_connections 2024-08-31T06:15:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.767+0000 7f347b7df640 1 -- 172.21.15.53:0/3435545709 wait complete. 2024-08-31T06:15:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.767+0000 7f347b7df640 1 Processor -- start 2024-08-31T06:15:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.767+0000 7f347b7df640 1 -- start start 2024-08-31T06:15:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347b7df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3474102f00 0x7f34741990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347b7df640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34741080c0 0x7f3474199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347b7df640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3474108a10 0x7f347419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347b7df640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f34741125c0 con 0x7f3474102f00 2024-08-31T06:15:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347b7df640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3474112440 con 0x7f3474108a10 2024-08-31T06:15:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347b7df640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3474112740 con 0x7f34741080c0 2024-08-31T06:15:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347957b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3474102f00 0x7f34741990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347957b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3474102f00 0x7f34741990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35568/0 (socket says 172.21.15.53:35568) 2024-08-31T06:15:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f3478d7a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34741080c0 0x7f3474199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347957b640 1 -- 172.21.15.53:0/210223405 learned_addr learned my addr 172.21.15.53:0/210223405 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f3479d7c640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3474108a10 0x7f347419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347957b640 1 -- 172.21.15.53:0/210223405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34741080c0 msgr2=0x7f3474199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347957b640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34741080c0 0x7f3474199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347957b640 1 -- 172.21.15.53:0/210223405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3474108a10 msgr2=0x7f347419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347957b640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3474108a10 0x7f347419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347957b640 1 -- 172.21.15.53:0/210223405 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347419efd0 con 0x7f3474102f00 2024-08-31T06:15:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.768+0000 7f347957b640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3474102f00 0x7f34741990a0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f347000eb00 tx=0x7f3470009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.769+0000 7f346a7fc640 1 -- 172.21.15.53:0/210223405 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347001c070 con 0x7f3474102f00 2024-08-31T06:15:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.769+0000 7f346a7fc640 1 -- 172.21.15.53:0/210223405 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f347000bc30 con 0x7f3474102f00 2024-08-31T06:15:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.769+0000 7f347b7df640 1 -- 172.21.15.53:0/210223405 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347419f2c0 con 0x7f3474102f00 2024-08-31T06:15:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.769+0000 7f346a7fc640 1 -- 172.21.15.53:0/210223405 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470016610 con 0x7f3474102f00 2024-08-31T06:15:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.769+0000 7f347b7df640 1 -- 172.21.15.53:0/210223405 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3474101b50 con 0x7f3474102f00 2024-08-31T06:15:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3482828740 1 Processor -- start 2024-08-31T06:15:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3482828740 1 -- start start 2024-08-31T06:15:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3482828740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 0x560e549adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3482828740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e12f0 0x560e549ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3482828740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 0x560e549ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3482828740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e54923000 con 0x560e5460a1b0 2024-08-31T06:15:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3482828740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560e54912590 con 0x560e545e12f0 2024-08-31T06:15:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3482828740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560e54916540 con 0x560e545e94d0 2024-08-31T06:15:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3479d7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 0x560e549adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3479d7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 0x560e549adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35582/0 (socket says 172.21.15.53:35582) 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3479d7c640 1 -- 172.21.15.53:0/1851465738 learned_addr learned my addr 172.21.15.53:0/1851465738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f3478d7a640 1 --2- 172.21.15.53:0/1851465738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 0x560e549ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.772+0000 7f346a7fc640 1 -- 172.21.15.53:0/210223405 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f347001f070 con 0x7f3474102f00 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f3478d7a640 1 -- 172.21.15.53:0/1851465738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e12f0 msgr2=0x560e549ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f3478d7a640 1 --2- 172.21.15.53:0/1851465738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e12f0 0x560e549ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f3478d7a640 1 -- 172.21.15.53:0/1851465738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 msgr2=0x560e549adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f3478d7a640 1 --2- 172.21.15.53:0/1851465738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 0x560e549adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f3478d7a640 1 -- 172.21.15.53:0/1851465738 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e54675790 con 0x560e545e94d0 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f3479d7c640 1 --2- 172.21.15.53:0/1851465738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 0x560e549adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f3478d7a640 1 --2- 172.21.15.53:0/1851465738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 0x560e549ae540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f34740756c0 tx=0x7f3464011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c496f1999146bd03 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f345f7fe640 1 -- 172.21.15.53:0/1851465738 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464004050 con 0x560e545e94d0 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f345f7fe640 1 -- 172.21.15.53:0/1851465738 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3464005020 con 0x560e545e94d0 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f345f7fe640 1 -- 172.21.15.53:0/1851465738 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464004b00 con 0x560e545e94d0 2024-08-31T06:15:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f346a7fc640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34600b4d20 0x7f34600b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f3479d7c640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34600b4d20 0x7f34600b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.773+0000 7f346a7fc640 1 -- 172.21.15.53:0/210223405 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f34700e6b10 con 0x7f3474102f00 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.774+0000 7f3482828740 1 -- 172.21.15.53:0/1851465738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 msgr2=0x560e549ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.774+0000 7f3479d7c640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34600b4d20 0x7f34600b7230 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f346c02ade0 tx=0x7f346c009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.774+0000 7f3482828740 1 --2- 172.21.15.53:0/1851465738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 0x560e549ae540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f34740756c0 tx=0x7f3464011810 comp rx=0 tx=0).stop 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.774+0000 7f3482828740 1 -- 172.21.15.53:0/1851465738 shutdown_connections 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.774+0000 7f3482828740 1 --2- 172.21.15.53:0/1851465738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 0x560e549ae540 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.774+0000 7f3482828740 1 --2- 172.21.15.53:0/1851465738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e12f0 0x560e549ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.774+0000 7f3482828740 1 --2- 172.21.15.53:0/1851465738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 0x560e549adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.774+0000 7f3482828740 1 -- 172.21.15.53:0/1851465738 >> 172.21.15.53:0/1851465738 conn(0x560e545fe300 msgr2=0x560e549ab9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.774+0000 7f3482828740 1 -- 172.21.15.53:0/1851465738 shutdown_connections 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.774+0000 7f3482828740 1 -- 172.21.15.53:0/1851465738 wait complete. 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.774+0000 7f3482828740 1 -- start start 2024-08-31T06:15:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.775+0000 7f3482828740 1 Processor -- start 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.775+0000 7f3482828740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e12f0 0x560e549b9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.775+0000 7f3482828740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 0x560e549b9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.775+0000 7f3482828740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 0x560e549bf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.775+0000 7f3482828740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e5484bab0 con 0x560e5460a1b0 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.775+0000 7f3482828740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560e54899680 con 0x560e545e12f0 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.775+0000 7f3482828740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560e549bc240 con 0x560e545e94d0 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.775+0000 7f3482828740 10 client.0 _ll_register_callbacks cb 0x560e54621a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.775+0000 7f347957b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e12f0 0x560e549b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f3478d7a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 0x560e549b9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f3479d7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 0x560e549bf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f347957b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e12f0 0x560e549b9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53222/0 (socket says 172.21.15.53:53222) 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f347957b640 1 -- 172.21.15.53:0/2492101398 learned_addr learned my addr 172.21.15.53:0/2492101398 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f347957b640 1 -- 172.21.15.53:0/2492101398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 msgr2=0x560e549b9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f347957b640 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 0x560e549b9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f347957b640 1 -- 172.21.15.53:0/2492101398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 msgr2=0x560e549bf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f347957b640 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 0x560e549bf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f347957b640 1 -- 172.21.15.53:0/2492101398 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e546ee620 con 0x560e545e12f0 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f3478d7a640 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 0x560e549b9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f3479d7c640 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 0x560e549bf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f347957b640 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e12f0 0x560e549b9760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f34700e42a0 tx=0x7f34700acca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41abcfa5e6ed004c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f345cff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f345cff9640 1 -- 172.21.15.53:0/2492101398 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34700ad290 con 0x560e545e12f0 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f3482828740 1 -- 172.21.15.53:0/2492101398 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3464005020 con 0x560e545e12f0 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.776+0000 7f345cff9640 1 -- 172.21.15.53:0/2492101398 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f34700ac700 con 0x560e545e12f0 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f345cff9640 1 -- 172.21.15.53:0/2492101398 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f34700b1a50 con 0x560e545e12f0 2024-08-31T06:15:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f3482828740 10 client.28001 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f3482828740 1 -- 172.21.15.53:0/2492101398 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x560e549c83c0 con 0x560e545e12f0 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f345cff9640 1 -- 172.21.15.53:0/2492101398 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3464005020 con 0x560e545e12f0 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f345cff9640 1 -- 172.21.15.53:0/2492101398 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f34700b2be0 con 0x560e545e12f0 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f3482828740 10 client.28001 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f3482828740 10 client.28001 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f3482828740 20 client.28001 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f3482828740 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560e545c8d80 0x560e549cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f3482828740 4 client.28001 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f3482828740 1 -- 172.21.15.53:0/2492101398 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e54924f50 con 0x560e545c8d80 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.777+0000 7f3478d7a640 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560e545c8d80 0x560e549cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.778+0000 7f3478d7a640 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560e545c8d80 0x560e549cb910 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=437ffd7d01b788f8 server_cookie=ca9d63f49ba8627f in_seq=0 out_seq=0 2024-08-31T06:15:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.778+0000 7f345cff9640 10 client.28001 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.778+0000 7f345cff9640 1 -- 172.21.15.53:0/2492101398 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560e54924f50 con 0x560e545c8d80 2024-08-31T06:15:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.778+0000 7f345cff9640 10 client.28001 handle_command_reply: tid=0 2024-08-31T06:15:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 1 client.28001 shutdown 2024-08-31T06:15:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 1 -- 172.21.15.53:0/2492101398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e12f0 msgr2=0x560e549b9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e12f0 0x560e549b9760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f34700e42a0 tx=0x7f34700acca0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 1 -- 172.21.15.53:0/2492101398 shutdown_connections 2024-08-31T06:15:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560e545c8d80 0x560e549cb910 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e5460a1b0 0x560e549bf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f345cff9640 0 client.28001 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e94d0 0x560e549b9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 1 --2- 172.21.15.53:0/2492101398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e12f0 0x560e549b9760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 1 -- 172.21.15.53:0/2492101398 >> 172.21.15.53:0/2492101398 conn(0x560e545fe300 msgr2=0x560e549aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 1 -- 172.21.15.53:0/2492101398 shutdown_connections 2024-08-31T06:15:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 1 -- 172.21.15.53:0/2492101398 wait complete. 2024-08-31T06:15:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.779+0000 7f3482828740 20 client.28001 trim_cache size 0 max 16384 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.794+0000 7f3482828740 1 Processor -- start 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f3482828740 1 -- start start 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f3482828740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545c8d80 0x560e549af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f3482828740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 0x560e549b8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f3482828740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545e94d0 0x560e549b9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f3482828740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f34741ad300 con 0x560e545e94d0 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f3482828740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34741af050 con 0x560e545c8d80 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f3482828740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34741ad9d0 con 0x560e545e12f0 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f3479d7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545e94d0 0x560e549b9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f347957b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545c8d80 0x560e549af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f347957b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545c8d80 0x560e549af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53236/0 (socket says 172.21.15.53:53236) 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f347957b640 1 -- 172.21.15.53:0/2625147402 learned_addr learned my addr 172.21.15.53:0/2625147402 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f3478d7a640 1 --2- 172.21.15.53:0/2625147402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 0x560e549b8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f347957b640 1 -- 172.21.15.53:0/2625147402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 msgr2=0x560e549b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f347957b640 1 --2- 172.21.15.53:0/2625147402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 0x560e549b8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f347957b640 1 -- 172.21.15.53:0/2625147402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545e94d0 msgr2=0x560e549b9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f347957b640 1 --2- 172.21.15.53:0/2625147402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545e94d0 0x560e549b9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f347957b640 1 -- 172.21.15.53:0/2625147402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e549ba810 con 0x560e545c8d80 2024-08-31T06:15:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.795+0000 7f3478d7a640 1 --2- 172.21.15.53:0/2625147402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 0x560e549b8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.796+0000 7f347957b640 1 --2- 172.21.15.53:0/2625147402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545c8d80 0x560e549af0b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f34700e4840 tx=0x7f34700acd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b5cf794fb912dca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.796+0000 7f345effd640 1 -- 172.21.15.53:0/2625147402 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34700ad060 con 0x560e545c8d80 2024-08-31T06:15:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.796+0000 7f345effd640 1 -- 172.21.15.53:0/2625147402 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34700b6500 con 0x560e545c8d80 2024-08-31T06:15:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.796+0000 7f345effd640 1 -- 172.21.15.53:0/2625147402 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34700abf60 con 0x560e545c8d80 2024-08-31T06:15:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.797+0000 7f3482828740 1 -- 172.21.15.53:0/2625147402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545c8d80 msgr2=0x560e549af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.797+0000 7f3482828740 1 --2- 172.21.15.53:0/2625147402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545c8d80 0x560e549af0b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f34700e4840 tx=0x7f34700acd10 comp rx=0 tx=0).stop 2024-08-31T06:15:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.797+0000 7f3482828740 1 -- 172.21.15.53:0/2625147402 shutdown_connections 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.797+0000 7f3482828740 1 --2- 172.21.15.53:0/2625147402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545e94d0 0x560e549b9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.797+0000 7f3482828740 1 --2- 172.21.15.53:0/2625147402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 0x560e549b8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.797+0000 7f3482828740 1 --2- 172.21.15.53:0/2625147402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545c8d80 0x560e549af0b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.797+0000 7f3482828740 1 -- 172.21.15.53:0/2625147402 >> 172.21.15.53:0/2625147402 conn(0x560e545fe300 msgr2=0x560e549ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.797+0000 7f3482828740 1 -- 172.21.15.53:0/2625147402 shutdown_connections 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.797+0000 7f3482828740 1 -- 172.21.15.53:0/2625147402 wait complete. 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.797+0000 7f3482828740 1 -- start start 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.797+0000 7f3482828740 1 Processor -- start 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f3482828740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545c8d80 0x560e549c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f3482828740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 0x560e549c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f3482828740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e94d0 0x560e549c1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f3482828740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f34741ae8c0 con 0x560e545c8d80 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f3482828740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34741ae160 con 0x560e545e94d0 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f3482828740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34741ab300 con 0x560e545e12f0 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f3482828740 10 client.0 _ll_register_callbacks cb 0x7f3464009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f347957b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545c8d80 0x560e549c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f3478d7a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 0x560e549c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f347957b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545c8d80 0x560e549c5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35618/0 (socket says 172.21.15.53:35618) 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f347957b640 1 -- 172.21.15.53:0/351295222 learned_addr learned my addr 172.21.15.53:0/351295222 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f3479d7c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e94d0 0x560e549c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f3478d7a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 0x560e549c1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57544/0 (socket says 172.21.15.53:57544) 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f347957b640 1 -- 172.21.15.53:0/351295222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 msgr2=0x560e549c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f347957b640 1 --2- 172.21.15.53:0/351295222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 0x560e549c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f347957b640 1 -- 172.21.15.53:0/351295222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e94d0 msgr2=0x560e549c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f347957b640 1 --2- 172.21.15.53:0/351295222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e94d0 0x560e549c1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f347957b640 1 -- 172.21.15.53:0/351295222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e549c1f30 con 0x560e545c8d80 2024-08-31T06:15:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f347957b640 1 --2- 172.21.15.53:0/351295222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545c8d80 0x560e549c5f60 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f34700a9310 tx=0x7f34700ad060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f589141c1f9981 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f345cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f345cff9640 1 -- 172.21.15.53:0/351295222 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34700c7060 con 0x560e545c8d80 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f345cff9640 1 -- 172.21.15.53:0/351295222 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f34700c2af0 con 0x560e545c8d80 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.798+0000 7f3482828740 1 -- 172.21.15.53:0/351295222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34700b6500 con 0x560e545c8d80 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f345cff9640 1 -- 172.21.15.53:0/351295222 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f34700c2cf0 con 0x560e545c8d80 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f3482828740 10 client.18819 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f3482828740 1 -- 172.21.15.53:0/351295222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x560e54a36080 con 0x560e545c8d80 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f345cff9640 1 -- 172.21.15.53:0/351295222 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34700b6500 con 0x560e545c8d80 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f345cff9640 1 -- 172.21.15.53:0/351295222 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f34700ce2b0 con 0x560e545c8d80 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f3482828740 10 client.18819 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f3482828740 10 client.18819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f3482828740 20 client.18819 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f3482828740 1 --2- 172.21.15.53:0/351295222 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560e5460a1b0 0x560e54a386c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f3482828740 4 client.18819 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:15:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f3482828740 1 -- 172.21.15.53:0/351295222 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e549209f0 con 0x560e5460a1b0 2024-08-31T06:15:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.799+0000 7f3478d7a640 1 --2- 172.21.15.53:0/351295222 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560e5460a1b0 0x560e54a386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.800+0000 7f345cff9640 10 client.18819 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.800+0000 7f3478d7a640 1 --2- 172.21.15.53:0/351295222 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560e5460a1b0 0x560e54a386c0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6170e573700dd86f server_cookie=df08aa12e78c57c2 in_seq=0 out_seq=0 2024-08-31T06:15:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.824+0000 7f345cff9640 1 -- 172.21.15.53:0/351295222 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e549209f0 con 0x560e5460a1b0 2024-08-31T06:15:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.824+0000 7f345cff9640 10 client.18819 handle_command_reply: tid=0 2024-08-31T06:15:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.824+0000 7f3482828740 1 client.18819 shutdown 2024-08-31T06:15:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f3482828740 1 -- 172.21.15.53:0/351295222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545c8d80 msgr2=0x560e549c5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f3482828740 1 --2- 172.21.15.53:0/351295222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545c8d80 0x560e549c5f60 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f34700a9310 tx=0x7f34700ad060 comp rx=0 tx=0).stop 2024-08-31T06:15:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f3482828740 1 -- 172.21.15.53:0/351295222 shutdown_connections 2024-08-31T06:15:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f3482828740 1 --2- 172.21.15.53:0/351295222 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560e5460a1b0 0x560e54a386c0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f3482828740 1 --2- 172.21.15.53:0/351295222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e545e94d0 0x560e549c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f3482828740 1 --2- 172.21.15.53:0/351295222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560e545e12f0 0x560e549c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f345cff9640 0 client.18819 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f3482828740 1 --2- 172.21.15.53:0/351295222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e545c8d80 0x560e549c5f60 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f3482828740 1 -- 172.21.15.53:0/351295222 >> 172.21.15.53:0/351295222 conn(0x560e545fe300 msgr2=0x560e549b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f3482828740 1 -- 172.21.15.53:0/351295222 shutdown_connections 2024-08-31T06:15:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f3482828740 1 -- 172.21.15.53:0/351295222 wait complete. 2024-08-31T06:15:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f3482828740 20 client.18819 trim_cache size 0 max 16384 2024-08-31T06:15:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:15:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:15:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:15:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:15:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f347b7df640 1 -- 172.21.15.53:0/210223405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34600b4d20 msgr2=0x7f34600b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f347b7df640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34600b4d20 0x7f34600b7230 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f346c02ade0 tx=0x7f346c009360 comp rx=0 tx=0).stop 2024-08-31T06:15:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f347b7df640 1 -- 172.21.15.53:0/210223405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3474102f00 msgr2=0x7f34741990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f347b7df640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3474102f00 0x7f34741990a0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f347000eb00 tx=0x7f3470009f20 comp rx=0 tx=0).stop 2024-08-31T06:15:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f347b7df640 1 -- 172.21.15.53:0/210223405 shutdown_connections 2024-08-31T06:15:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f347b7df640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34600b4d20 0x7f34600b7230 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f347b7df640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3474108a10 0x7f347419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f347b7df640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34741080c0 0x7f3474199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f347b7df640 1 --2- 172.21.15.53:0/210223405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3474102f00 0x7f34741990a0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.825+0000 7f347b7df640 1 -- 172.21.15.53:0/210223405 >> 172.21.15.53:0/210223405 conn(0x7f3474079c20 msgr2=0x7f34741061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.826+0000 7f347b7df640 1 -- 172.21.15.53:0/210223405 shutdown_connections 2024-08-31T06:15:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:17.826+0000 7f347b7df640 1 -- 172.21.15.53:0/210223405 wait complete. 2024-08-31T06:15:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:17 smithi130 ceph-mon[22266]: pgmap v643: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 815 KiB/s wr, 81 op/s 2024-08-31T06:15:17.879 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:17 smithi053 ceph-mon[18924]: pgmap v643: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 815 KiB/s wr, 81 op/s 2024-08-31T06:15:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:17 smithi153 ceph-mon[22320]: pgmap v643: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 815 KiB/s wr, 81 op/s 2024-08-31T06:15:17.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 170856 1.49 MB/sec execute 427 sec latency 63.079 ms 2024-08-31T06:15:17.998 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:15:18.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.466+0000 7fdae99c1640 1 -- 172.21.15.53:0/4270139411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae4109bb0 msgr2=0x7fdae41103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:18.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.466+0000 7fdae99c1640 1 --2- 172.21.15.53:0/4270139411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae4109bb0 0x7fdae41103e0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009ca0 tx=0x7fdadc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.466+0000 7fdae99c1640 1 -- 172.21.15.53:0/4270139411 shutdown_connections 2024-08-31T06:15:18.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.466+0000 7fdae99c1640 1 --2- 172.21.15.53:0/4270139411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae4109bb0 0x7fdae41103e0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.466+0000 7fdae99c1640 1 --2- 172.21.15.53:0/4270139411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae4109260 0x7fdae4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.466+0000 7fdae99c1640 1 --2- 172.21.15.53:0/4270139411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdae4101d20 0x7fdae4102130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.466+0000 7fdae99c1640 1 -- 172.21.15.53:0/4270139411 >> 172.21.15.53:0/4270139411 conn(0x7fdae4079cf0 msgr2=0x7fdae407a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:18.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.467+0000 7fdae99c1640 1 -- 172.21.15.53:0/4270139411 shutdown_connections 2024-08-31T06:15:18.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.467+0000 7fdae99c1640 1 -- 172.21.15.53:0/4270139411 wait complete. 2024-08-31T06:15:18.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.467+0000 7fdae99c1640 1 Processor -- start 2024-08-31T06:15:18.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.467+0000 7fdae99c1640 1 -- start start 2024-08-31T06:15:18.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae99c1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdae4101d20 0x7fdae419a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae99c1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae4109260 0x7fdae419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae99c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae4109bb0 0x7fdae419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae99c1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdae4113770 con 0x7fdae4109bb0 2024-08-31T06:15:18.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae99c1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdae41135f0 con 0x7fdae4101d20 2024-08-31T06:15:18.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae99c1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdae41138f0 con 0x7fdae4109260 2024-08-31T06:15:18.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae4109bb0 0x7fdae419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdae4101d20 0x7fdae419a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae27fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae4109260 0x7fdae419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdae4101d20 0x7fdae419a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53268/0 (socket says 172.21.15.53:53268) 2024-08-31T06:15:18.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae2ffd640 1 -- 172.21.15.53:0/905211256 learned_addr learned my addr 172.21.15.53:0/905211256 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:18.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae2ffd640 1 -- 172.21.15.53:0/905211256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae4109260 msgr2=0x7fdae419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:18.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae4109260 0x7fdae419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae2ffd640 1 -- 172.21.15.53:0/905211256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae4109bb0 msgr2=0x7fdae419f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:18.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae4109bb0 0x7fdae419f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.468+0000 7fdae2ffd640 1 -- 172.21.15.53:0/905211256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae41a00d0 con 0x7fdae4101d20 2024-08-31T06:15:18.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.469+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdae4101d20 0x7fdae419a160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdad400ea60 tx=0x7fdad400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:18.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.469+0000 7fdae89bf640 1 -- 172.21.15.53:0/905211256 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad400cde0 con 0x7fdae4101d20 2024-08-31T06:15:18.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.469+0000 7fdae89bf640 1 -- 172.21.15.53:0/905211256 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdad40035f0 con 0x7fdae4101d20 2024-08-31T06:15:18.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.469+0000 7fdae99c1640 1 -- 172.21.15.53:0/905211256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae41a03c0 con 0x7fdae4101d20 2024-08-31T06:15:18.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.469+0000 7fdae89bf640 1 -- 172.21.15.53:0/905211256 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4010690 con 0x7fdae4101d20 2024-08-31T06:15:18.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.469+0000 7fdae99c1640 1 -- 172.21.15.53:0/905211256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae41a6b20 con 0x7fdae4101d20 2024-08-31T06:15:18.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.472+0000 7fdae89bf640 1 -- 172.21.15.53:0/905211256 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdad4010830 con 0x7fdae4101d20 2024-08-31T06:15:18.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.472+0000 7fdaeff36740 1 Processor -- start 2024-08-31T06:15:18.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.472+0000 7fdaeff36740 1 -- start start 2024-08-31T06:15:18.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 0x55dcf442df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf442e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 0x55dcf442ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdaeff36740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dcf43a3380 con 0x55dcf405e990 2024-08-31T06:15:18.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdaeff36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dcf4392910 con 0x55dcf4066b70 2024-08-31T06:15:18.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdaeff36740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55dcf43968c0 con 0x55dcf4087850 2024-08-31T06:15:18.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 0x55dcf442df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf442e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 0x55dcf442ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 0x55dcf442ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53272/0 (socket says 172.21.15.53:53272) 2024-08-31T06:15:18.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae27fc640 1 -- 172.21.15.53:0/98529411 learned_addr learned my addr 172.21.15.53:0/98529411 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:18.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae27fc640 1 -- 172.21.15.53:0/98529411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 msgr2=0x55dcf442df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:18.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae27fc640 1 --2- 172.21.15.53:0/98529411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 0x55dcf442df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae27fc640 1 -- 172.21.15.53:0/98529411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 msgr2=0x55dcf442e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:18.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae27fc640 1 --2- 172.21.15.53:0/98529411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf442e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae27fc640 1 -- 172.21.15.53:0/98529411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcf432f4c0 con 0x55dcf4066b70 2024-08-31T06:15:18.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae37fe640 1 --2- 172.21.15.53:0/98529411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 0x55dcf442df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:18.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.473+0000 7fdae89bf640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdacc0b4d20 0x7fdacc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.474+0000 7fdae27fc640 1 --2- 172.21.15.53:0/98529411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 0x55dcf442ea10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009c20 tx=0x7fdad8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceb97b242ba468f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.474+0000 7fdae37fe640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdacc0b4d20 0x7fdacc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.474+0000 7fdae89bf640 1 -- 172.21.15.53:0/905211256 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fdad40e5910 con 0x7fdae4101d20 2024-08-31T06:15:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.474+0000 7fdac9ffb640 1 -- 172.21.15.53:0/98529411 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8004230 con 0x55dcf4066b70 2024-08-31T06:15:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.474+0000 7fdac9ffb640 1 -- 172.21.15.53:0/98529411 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdad80043d0 con 0x55dcf4066b70 2024-08-31T06:15:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.474+0000 7fdac9ffb640 1 -- 172.21.15.53:0/98529411 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8004bf0 con 0x55dcf4066b70 2024-08-31T06:15:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.475+0000 7fdaeff36740 1 -- 172.21.15.53:0/98529411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 msgr2=0x55dcf442ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.475+0000 7fdaeff36740 1 --2- 172.21.15.53:0/98529411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 0x55dcf442ea10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009c20 tx=0x7fdad8011810 comp rx=0 tx=0).stop 2024-08-31T06:15:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.475+0000 7fdae37fe640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdacc0b4d20 0x7fdacc0b7230 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdadc006010 tx=0x7fdadc009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.475+0000 7fdaeff36740 1 -- 172.21.15.53:0/98529411 shutdown_connections 2024-08-31T06:15:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.475+0000 7fdaeff36740 1 --2- 172.21.15.53:0/98529411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 0x55dcf442ea10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.475+0000 7fdaeff36740 1 --2- 172.21.15.53:0/98529411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf442e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.475+0000 7fdaeff36740 1 --2- 172.21.15.53:0/98529411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 0x55dcf442df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.475+0000 7fdaeff36740 1 -- 172.21.15.53:0/98529411 >> 172.21.15.53:0/98529411 conn(0x55dcf407bc40 msgr2=0x55dcf442be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:18.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.475+0000 7fdaeff36740 1 -- 172.21.15.53:0/98529411 shutdown_connections 2024-08-31T06:15:18.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.475+0000 7fdaeff36740 1 -- 172.21.15.53:0/98529411 wait complete. 2024-08-31T06:15:18.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.476+0000 7fdaeff36740 1 -- start start 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.476+0000 7fdaeff36740 1 Processor -- start 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.476+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf4439660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.476+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 0x55dcf4439ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.476+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 0x55dcf4445a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.476+0000 7fdaeff36740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dcf41f57b0 con 0x55dcf405e990 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.476+0000 7fdaeff36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dcf4319460 con 0x55dcf4066b70 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.477+0000 7fdaeff36740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55dcf443c770 con 0x55dcf4087850 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.477+0000 7fdaeff36740 10 client.0 _ll_register_callbacks cb 0x55dcf433efd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.477+0000 7fdae27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 0x55dcf4439ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.477+0000 7fdae27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 0x55dcf4439ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53274/0 (socket says 172.21.15.53:53274) 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.477+0000 7fdae27fc640 1 -- 172.21.15.53:0/3315487029 learned_addr learned my addr 172.21.15.53:0/3315487029 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.477+0000 7fdae37fe640 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 0x55dcf4445a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.477+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf4439660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.477+0000 7fdae37fe640 1 -- 172.21.15.53:0/3315487029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 msgr2=0x55dcf4439ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.477+0000 7fdae37fe640 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 0x55dcf4439ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.477+0000 7fdae37fe640 1 -- 172.21.15.53:0/3315487029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 msgr2=0x55dcf4439660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.478+0000 7fdae37fe640 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf4439660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.478+0000 7fdae37fe640 1 -- 172.21.15.53:0/3315487029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcf4101ba0 con 0x55dcf4087850 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.478+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf4439660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.478+0000 7fdae37fe640 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 0x55dcf4445a60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdadc031040 tx=0x7fdadc02a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2329be0a8650f5e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.478+0000 7fdac2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.478+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3315487029 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc031450 con 0x55dcf4087850 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.478+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3315487029 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fdadc004250 con 0x55dcf4087850 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdaeff36740 1 -- 172.21.15.53:0/3315487029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdad80043d0 con 0x55dcf4087850 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3315487029 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdadc004450 con 0x55dcf4087850 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdaeff36740 10 client.28012 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdaeff36740 1 -- 172.21.15.53:0/3315487029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55dcf4448820 con 0x55dcf4087850 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3315487029 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdad80043d0 con 0x55dcf4087850 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3315487029 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7fdadc051070 con 0x55dcf4087850 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdaeff36740 10 client.28012 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdaeff36740 10 client.28012 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdaeff36740 20 client.28012 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dcf40461d0 0x55dcf444bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdaeff36740 4 client.28012 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.479+0000 7fdaeff36740 1 -- 172.21.15.53:0/3315487029 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcf43a52d0 con 0x55dcf40461d0 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.480+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dcf40461d0 0x55dcf444bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.480+0000 7fdac2ffd640 10 client.28012 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.480+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dcf40461d0 0x55dcf444bdb0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71fc9c3f36fb2460 server_cookie=5968c39cf46344b1 in_seq=0 out_seq=0 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3315487029 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dcf43a52d0 con 0x55dcf40461d0 2024-08-31T06:15:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdac2ffd640 10 client.28012 handle_command_reply: tid=0 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 1 client.28012 shutdown 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 1 -- 172.21.15.53:0/3315487029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 msgr2=0x55dcf4445a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 0x55dcf4445a60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdadc031040 tx=0x7fdadc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 1 -- 172.21.15.53:0/3315487029 shutdown_connections 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dcf40461d0 0x55dcf444bdb0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf4087850 0x55dcf4445a60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf4066b70 0x55dcf4439ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdac2ffd640 0 client.28012 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3315487029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf4439660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 1 -- 172.21.15.53:0/3315487029 >> 172.21.15.53:0/3315487029 conn(0x55dcf407bc40 msgr2=0x55dcf4431120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 1 -- 172.21.15.53:0/3315487029 shutdown_connections 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 1 -- 172.21.15.53:0/3315487029 wait complete. 2024-08-31T06:15:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.481+0000 7fdaeff36740 20 client.28012 trim_cache size 0 max 16384 2024-08-31T06:15:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdaeff36740 1 Processor -- start 2024-08-31T06:15:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdaeff36740 1 -- start start 2024-08-31T06:15:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf407bc40 0x55dcf4445960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf40461d0 0x55dcf443b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf44331f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdaeff36740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdae41af530 con 0x55dcf405e990 2024-08-31T06:15:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdaeff36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdae41b1280 con 0x55dcf40461d0 2024-08-31T06:15:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdaeff36740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdae41afc00 con 0x55dcf407bc40 2024-08-31T06:15:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdae27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf40461d0 0x55dcf443b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdae27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf40461d0 0x55dcf443b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53276/0 (socket says 172.21.15.53:53276) 2024-08-31T06:15:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdae27fc640 1 -- 172.21.15.53:0/1484584055 learned_addr learned my addr 172.21.15.53:0/1484584055 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/1484584055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf407bc40 0x55dcf4445960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.509+0000 7fdae37fe640 1 --2- 172.21.15.53:0/1484584055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf44331f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.510+0000 7fdae2ffd640 1 -- 172.21.15.53:0/1484584055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf40461d0 msgr2=0x55dcf443b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.510+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/1484584055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf40461d0 0x55dcf443b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.510+0000 7fdae2ffd640 1 -- 172.21.15.53:0/1484584055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 msgr2=0x55dcf44331f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.510+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/1484584055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf44331f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.510+0000 7fdae2ffd640 1 -- 172.21.15.53:0/1484584055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcf442cb60 con 0x55dcf407bc40 2024-08-31T06:15:18.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.510+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/1484584055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf407bc40 0x55dcf4445960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdad40e2fe0 tx=0x7fdad40096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e837057348113d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:18.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.510+0000 7fdac97fa640 1 -- 172.21.15.53:0/1484584055 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad40aba90 con 0x55dcf407bc40 2024-08-31T06:15:18.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.510+0000 7fdac97fa640 1 -- 172.21.15.53:0/1484584055 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdad40ac680 con 0x55dcf407bc40 2024-08-31T06:15:18.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.510+0000 7fdac97fa640 1 -- 172.21.15.53:0/1484584055 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad40e3260 con 0x55dcf407bc40 2024-08-31T06:15:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:18.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.511+0000 7fdaeff36740 1 -- 172.21.15.53:0/1484584055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf407bc40 msgr2=0x55dcf4445960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:18.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.511+0000 7fdaeff36740 1 --2- 172.21.15.53:0/1484584055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf407bc40 0x55dcf4445960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdad40e2fe0 tx=0x7fdad40096c0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.511+0000 7fdaeff36740 1 -- 172.21.15.53:0/1484584055 shutdown_connections 2024-08-31T06:15:18.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.511+0000 7fdaeff36740 1 --2- 172.21.15.53:0/1484584055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf405e990 0x55dcf44331f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.511+0000 7fdaeff36740 1 --2- 172.21.15.53:0/1484584055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf40461d0 0x55dcf443b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.511+0000 7fdaeff36740 1 --2- 172.21.15.53:0/1484584055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf407bc40 0x55dcf4445960 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.511+0000 7fdaeff36740 1 -- 172.21.15.53:0/1484584055 >> 172.21.15.53:0/1484584055 conn(0x55dcf4439d20 msgr2=0x55dcf442a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.511+0000 7fdaeff36740 1 -- 172.21.15.53:0/1484584055 shutdown_connections 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.511+0000 7fdaeff36740 1 -- 172.21.15.53:0/1484584055 wait complete. 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.512+0000 7fdaeff36740 1 -- start start 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.512+0000 7fdaeff36740 1 Processor -- start 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.512+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf40461d0 0x55dcf4442110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.512+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf405e990 0x55dcf443d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdaeff36740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf407bc40 0x55dcf443db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdaeff36740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdae41b0af0 con 0x55dcf407bc40 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdaeff36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdae41b0390 con 0x55dcf405e990 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdaeff36740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdae41ad530 con 0x55dcf40461d0 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdae27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf405e990 0x55dcf443d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdaeff36740 10 client.0 _ll_register_callbacks cb 0x7fdadc003de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdae27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf405e990 0x55dcf443d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53282/0 (socket says 172.21.15.53:53282) 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdae27fc640 1 -- 172.21.15.53:0/3538689501 learned_addr learned my addr 172.21.15.53:0/3538689501 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdae37fe640 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf407bc40 0x55dcf443db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf40461d0 0x55dcf4442110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdae27fc640 1 -- 172.21.15.53:0/3538689501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf40461d0 msgr2=0x55dcf4442110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdae27fc640 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf40461d0 0x55dcf4442110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdae27fc640 1 -- 172.21.15.53:0/3538689501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf407bc40 msgr2=0x55dcf443db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdae27fc640 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf407bc40 0x55dcf443db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdae27fc640 1 -- 172.21.15.53:0/3538689501 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcf443e1f0 con 0x55dcf405e990 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdae27fc640 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf405e990 0x55dcf443d5c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdad80099b0 tx=0x7fdad80045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=773c7c296b06e30c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.513+0000 7fdac2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3538689501 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8005c50 con 0x55dcf405e990 2024-08-31T06:15:18.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3538689501 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fdad8003800 con 0x55dcf405e990 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdaeff36740 1 -- 172.21.15.53:0/3538689501 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdad40ac680 con 0x55dcf405e990 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3538689501 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdad8003a00 con 0x55dcf405e990 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdaeff36740 10 client.28025 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdaeff36740 1 -- 172.21.15.53:0/3538689501 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55dcf44bca50 con 0x55dcf405e990 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3538689501 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdad40ac680 con 0x55dcf405e990 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3538689501 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7fdad8024040 con 0x55dcf405e990 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdaeff36740 10 client.28025 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdaeff36740 10 client.28025 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdaeff36740 20 client.28025 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dcf4066b70 0x55dcf44bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdaeff36740 4 client.28025 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}] 2024-08-31T06:15:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.514+0000 7fdaeff36740 1 -- 172.21.15.53:0/3538689501 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}) -- 0x55dcf43a0d70 con 0x55dcf4066b70 2024-08-31T06:15:18.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.515+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dcf4066b70 0x55dcf44bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:18.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.515+0000 7fdac2ffd640 10 client.28025 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:18.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.515+0000 7fdae2ffd640 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dcf4066b70 0x55dcf44bf0b0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b6e1ec04792c987 server_cookie=e77484fb87bee2c0 in_seq=0 out_seq=0 2024-08-31T06:15:18.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdac2ffd640 1 -- 172.21.15.53:0/3538689501 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55dcf43a0d70 con 0x55dcf4066b70 2024-08-31T06:15:18.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdac2ffd640 10 client.28025 handle_command_reply: tid=0 2024-08-31T06:15:18.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 1 client.28025 shutdown 2024-08-31T06:15:18.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 1 -- 172.21.15.53:0/3538689501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf405e990 msgr2=0x55dcf443d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:18.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf405e990 0x55dcf443d5c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdad80099b0 tx=0x7fdad80045d0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 1 -- 172.21.15.53:0/3538689501 shutdown_connections 2024-08-31T06:15:18.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dcf4066b70 0x55dcf44bf0b0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dcf407bc40 0x55dcf443db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dcf405e990 0x55dcf443d5c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdac2ffd640 0 client.28025 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:18.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 1 --2- 172.21.15.53:0/3538689501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dcf40461d0 0x55dcf4442110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 1 -- 172.21.15.53:0/3538689501 >> 172.21.15.53:0/3538689501 conn(0x55dcf4439d20 msgr2=0x55dcf442a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:18.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 1 -- 172.21.15.53:0/3538689501 shutdown_connections 2024-08-31T06:15:18.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 1 -- 172.21.15.53:0/3538689501 wait complete. 2024-08-31T06:15:18.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.570+0000 7fdaeff36740 20 client.28025 trim_cache size 0 max 16384 2024-08-31T06:15:18.574 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:15:18.574 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 47, 2024-08-31T06:15:18.574 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 34, 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "37dd47d": { 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 34, 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 145.2, 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:15:18.575 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:15:18.576 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:15:18.576 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:15:18.576 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:15:18.576 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:15:18.576 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:18.576 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:18.576 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:18.576 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:18.576 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:18.576 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:15:18.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 -- 172.21.15.53:0/905211256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdacc0b4d20 msgr2=0x7fdacc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:18.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdacc0b4d20 0x7fdacc0b7230 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdadc006010 tx=0x7fdadc009360 comp rx=0 tx=0).stop 2024-08-31T06:15:18.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 -- 172.21.15.53:0/905211256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdae4101d20 msgr2=0x7fdae419a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:18.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdae4101d20 0x7fdae419a160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdad400ea60 tx=0x7fdad400ef20 comp rx=0 tx=0).stop 2024-08-31T06:15:18.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 -- 172.21.15.53:0/905211256 shutdown_connections 2024-08-31T06:15:18.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdacc0b4d20 0x7fdacc0b7230 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae4109bb0 0x7fdae419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdae4109260 0x7fdae419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 --2- 172.21.15.53:0/905211256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdae4101d20 0x7fdae419a160 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:18.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 -- 172.21.15.53:0/905211256 >> 172.21.15.53:0/905211256 conn(0x7fdae4079cf0 msgr2=0x7fdae41072f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:18.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 -- 172.21.15.53:0/905211256 shutdown_connections 2024-08-31T06:15:18.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:18.571+0000 7fdae99c1640 1 -- 172.21.15.53:0/905211256 wait complete. 2024-08-31T06:15:18.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.49 MB/sec execute 428 sec latency 433.680 ms 2024-08-31T06:15:19.450 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '37dd47d', quiesce took 5.5 seconds. Will release after: 19.75 2024-08-31T06:15:19.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.666+0000 7fec01f5b640 1 -- 172.21.15.53:0/1351179361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febfc103950 msgr2=0x7febfc103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.666+0000 7fec01f5b640 1 --2- 172.21.15.53:0/1351179361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febfc103950 0x7febfc103d60 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7febec009900 tx=0x7febec02a410 comp rx=0 tx=0).stop 2024-08-31T06:15:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.666+0000 7fec01f5b640 1 -- 172.21.15.53:0/1351179361 shutdown_connections 2024-08-31T06:15:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.666+0000 7fec01f5b640 1 --2- 172.21.15.53:0/1351179361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febfc109be0 0x7febfc110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.666+0000 7fec01f5b640 1 --2- 172.21.15.53:0/1351179361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc109290 0x7febfc1096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.666+0000 7fec01f5b640 1 --2- 172.21.15.53:0/1351179361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febfc103950 0x7febfc103d60 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.666+0000 7fec01f5b640 1 -- 172.21.15.53:0/1351179361 >> 172.21.15.53:0/1351179361 conn(0x7febfc0ff3a0 msgr2=0x7febfc1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.666+0000 7fec01f5b640 1 -- 172.21.15.53:0/1351179361 shutdown_connections 2024-08-31T06:15:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.666+0000 7fec01f5b640 1 -- 172.21.15.53:0/1351179361 wait complete. 2024-08-31T06:15:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7fec01f5b640 1 Processor -- start 2024-08-31T06:15:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7fec01f5b640 1 -- start start 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7fec01f5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febfc103950 0x7febfc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7fec01f5b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc109290 0x7febfc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7fec01f5b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febfc109be0 0x7febfc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7fec01f5b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7febfc113750 con 0x7febfc103950 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7fec01f5b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1135d0 con 0x7febfc109290 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7fec01f5b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1138d0 con 0x7febfc109be0 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7febfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febfc103950 0x7febfc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7febfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febfc103950 0x7febfc0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35680/0 (socket says 172.21.15.53:35680) 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7febfb7fe640 1 -- 172.21.15.53:0/311101978 learned_addr learned my addr 172.21.15.53:0/311101978 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7febf2ffd640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc109290 0x7febfc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.667+0000 7febfbfff640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febfc109be0 0x7febfc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7febfb7fe640 1 -- 172.21.15.53:0/311101978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febfc109be0 msgr2=0x7febfc075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:19.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7febfb7fe640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febfc109be0 0x7febfc075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7febfb7fe640 1 -- 172.21.15.53:0/311101978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc109290 msgr2=0x7febfc0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:19.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7febfb7fe640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc109290 0x7febfc0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7febfb7fe640 1 -- 172.21.15.53:0/311101978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc1a83b0 con 0x7febfc103950 2024-08-31T06:15:19.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7febf2ffd640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc109290 0x7febfc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:19.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7febfb7fe640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febfc103950 0x7febfc0754b0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7febec009230 tx=0x7febec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:19.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7febf97fa640 1 -- 172.21.15.53:0/311101978 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec03f030 con 0x7febfc103950 2024-08-31T06:15:19.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7febf97fa640 1 -- 172.21.15.53:0/311101978 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febec003a80 con 0x7febfc103950 2024-08-31T06:15:19.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7fec01f5b640 1 -- 172.21.15.53:0/311101978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febfc1a8640 con 0x7febfc103950 2024-08-31T06:15:19.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7febf97fa640 1 -- 172.21.15.53:0/311101978 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec035070 con 0x7febfc103950 2024-08-31T06:15:19.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.668+0000 7fec01f5b640 1 -- 172.21.15.53:0/311101978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febfc1a8b70 con 0x7febfc103950 2024-08-31T06:15:19.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7fec084d0740 1 Processor -- start 2024-08-31T06:15:19.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7febf97fa640 1 -- 172.21.15.53:0/311101978 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7febec042030 con 0x7febfc103950 2024-08-31T06:15:19.673 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:19 smithi053 ceph-mon[18924]: pgmap v644: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 751 KiB/s wr, 80 op/s 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7fec084d0740 1 -- start start 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7fec084d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56183750a070 0x5618378af310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7fec084d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e11b0 0x5618378af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7fec084d0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e9390 0x5618378afd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7fec084d0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561837826680 con 0x5618374e9390 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7fec084d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561837815c10 con 0x5618374e11b0 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7fec084d0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561837819bc0 con 0x56183750a070 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7febf2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e9390 0x5618378afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7febf2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e9390 0x5618378afd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35696/0 (socket says 172.21.15.53:35696) 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7febf2ffd640 1 -- 172.21.15.53:0/2138271056 learned_addr learned my addr 172.21.15.53:0/2138271056 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7febfb7fe640 1 --2- 172.21.15.53:0/2138271056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e11b0 0x5618378af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.671+0000 7febfbfff640 1 --2- 172.21.15.53:0/2138271056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56183750a070 0x5618378af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febf2ffd640 1 -- 172.21.15.53:0/2138271056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56183750a070 msgr2=0x5618378af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febf2ffd640 1 --2- 172.21.15.53:0/2138271056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56183750a070 0x5618378af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febf2ffd640 1 -- 172.21.15.53:0/2138271056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e11b0 msgr2=0x5618378af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febf2ffd640 1 --2- 172.21.15.53:0/2138271056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e11b0 0x5618378af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febf2ffd640 1 -- 172.21.15.53:0/2138271056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561837575650 con 0x5618374e9390 2024-08-31T06:15:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febf97fa640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe80b4d20 0x7febe80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febf2ffd640 1 --2- 172.21.15.53:0/2138271056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e9390 0x5618378afd90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7febe4011470 tx=0x7febe4011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f06e2e01e4cc28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febfbfff640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe80b4d20 0x7febe80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febf97fa640 1 -- 172.21.15.53:0/311101978 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7febec105c70 con 0x7febfc103950 2024-08-31T06:15:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febf1ffb640 1 -- 172.21.15.53:0/2138271056 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe401e070 con 0x5618374e9390 2024-08-31T06:15:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febf1ffb640 1 -- 172.21.15.53:0/2138271056 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febe40035f0 con 0x5618374e9390 2024-08-31T06:15:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.672+0000 7febf1ffb640 1 -- 172.21.15.53:0/2138271056 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe40044c0 con 0x5618374e9390 2024-08-31T06:15:19.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.673+0000 7fec084d0740 1 -- 172.21.15.53:0/2138271056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e9390 msgr2=0x5618378afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:19.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.673+0000 7febfbfff640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe80b4d20 0x7febe80b7230 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7febf4007f80 tx=0x7febf4007520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:19.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.673+0000 7fec084d0740 1 --2- 172.21.15.53:0/2138271056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e9390 0x5618378afd90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7febe4011470 tx=0x7febe4011930 comp rx=0 tx=0).stop 2024-08-31T06:15:19.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.673+0000 7fec084d0740 1 -- 172.21.15.53:0/2138271056 shutdown_connections 2024-08-31T06:15:19.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.673+0000 7fec084d0740 1 --2- 172.21.15.53:0/2138271056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e9390 0x5618378afd90 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.673+0000 7fec084d0740 1 --2- 172.21.15.53:0/2138271056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e11b0 0x5618378af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.673+0000 7fec084d0740 1 --2- 172.21.15.53:0/2138271056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56183750a070 0x5618378af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.673+0000 7fec084d0740 1 -- 172.21.15.53:0/2138271056 >> 172.21.15.53:0/2138271056 conn(0x5618374fe460 msgr2=0x5618378ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.674+0000 7fec084d0740 1 -- 172.21.15.53:0/2138271056 shutdown_connections 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.674+0000 7fec084d0740 1 -- 172.21.15.53:0/2138271056 wait complete. 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.674+0000 7fec084d0740 1 -- start start 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.674+0000 7fec084d0740 1 Processor -- start 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7fec084d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618374e11b0 0x5618378c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7fec084d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 0x5618378c4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7fec084d0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56183750a070 0x5618378c9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7fec084d0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561837678700 con 0x56183750a070 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7fec084d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56183779c750 con 0x5618374e9390 2024-08-31T06:15:19.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7fec084d0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5618378bdaf0 con 0x5618374e11b0 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febfbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56183750a070 0x5618378c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febf2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 0x5618378c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febfbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56183750a070 0x5618378c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35708/0 (socket says 172.21.15.53:35708) 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febf2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 0x5618378c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53320/0 (socket says 172.21.15.53:53320) 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febfb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618374e11b0 0x5618378c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febfbfff640 1 -- 172.21.15.53:0/4026776889 learned_addr learned my addr 172.21.15.53:0/4026776889 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febf2ffd640 1 -- 172.21.15.53:0/4026776889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618374e11b0 msgr2=0x5618378c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febf2ffd640 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618374e11b0 0x5618378c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febf2ffd640 1 -- 172.21.15.53:0/4026776889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56183750a070 msgr2=0x5618378c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febf2ffd640 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56183750a070 0x5618378c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febf2ffd640 1 -- 172.21.15.53:0/4026776889 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618377d5900 con 0x5618374e9390 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febfb7fe640 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618374e11b0 0x5618378c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7febfbfff640 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56183750a070 0x5618378c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.675+0000 7fec084d0740 10 client.0 _ll_register_callbacks cb 0x5618377cbe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.676+0000 7fec084d0740 1 -- 172.21.15.53:0/4026776889 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febe40035f0 con 0x5618374e9390 2024-08-31T06:15:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.676+0000 7febf2ffd640 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 0x5618378c4130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7febe4011e30 tx=0x7febe40045a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86dfc2eafd6eeed2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.676+0000 7febdaffd640 10 client.28037 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:15:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.676+0000 7febdaffd640 1 -- 172.21.15.53:0/4026776889 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe401e070 con 0x5618374e9390 2024-08-31T06:15:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.676+0000 7febdaffd640 1 -- 172.21.15.53:0/4026776889 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7febe4003a30 con 0x5618374e9390 2024-08-31T06:15:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.676+0000 7febdaffd640 1 -- 172.21.15.53:0/4026776889 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7febe4003c70 con 0x5618374e9390 2024-08-31T06:15:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.676+0000 7fec084d0740 10 client.28037 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.676+0000 7fec084d0740 1 -- 172.21.15.53:0/4026776889 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=47}) -- 0x5618378d1f40 con 0x5618374e9390 2024-08-31T06:15:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.677+0000 7febdaffd640 1 -- 172.21.15.53:0/4026776889 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7febe4005040 con 0x5618374e9390 2024-08-31T06:15:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.677+0000 7fec084d0740 10 client.28037 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.677+0000 7fec084d0740 10 client.28037 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:15:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.677+0000 7fec084d0740 20 client.28037 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.677+0000 7fec084d0740 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5618374c89f0 0x5618378d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.677+0000 7fec084d0740 4 client.28037 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.677+0000 7fec084d0740 1 -- 172.21.15.53:0/4026776889 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618378285d0 con 0x5618374c89f0 2024-08-31T06:15:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.677+0000 7febfb7fe640 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5618374c89f0 0x5618378d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.678+0000 7febfb7fe640 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5618374c89f0 0x5618378d52a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1164e9f12ae24628 server_cookie=18398186ede7e086 in_seq=0 out_seq=0 2024-08-31T06:15:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.678+0000 7febdaffd640 10 client.28037 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:15:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.678+0000 7febdaffd640 1 -- 172.21.15.53:0/4026776889 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618378285d0 con 0x5618374c89f0 2024-08-31T06:15:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.678+0000 7febdaffd640 10 client.28037 handle_command_reply: tid=0 2024-08-31T06:15:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.678+0000 7fec084d0740 1 client.28037 shutdown 2024-08-31T06:15:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7fec084d0740 1 -- 172.21.15.53:0/4026776889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 msgr2=0x5618378c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7fec084d0740 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 0x5618378c4130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7febe4011e30 tx=0x7febe40045a0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7fec084d0740 1 -- 172.21.15.53:0/4026776889 shutdown_connections 2024-08-31T06:15:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7fec084d0740 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5618374c89f0 0x5618378d52a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7fec084d0740 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56183750a070 0x5618378c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7fec084d0740 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 0x5618378c4130 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7febdaffd640 0 client.28037 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:15:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7fec084d0740 1 --2- 172.21.15.53:0/4026776889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618374e11b0 0x5618378c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7fec084d0740 1 -- 172.21.15.53:0/4026776889 >> 172.21.15.53:0/4026776889 conn(0x5618374fe460 msgr2=0x5618378b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7fec084d0740 1 -- 172.21.15.53:0/4026776889 shutdown_connections 2024-08-31T06:15:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7fec084d0740 1 -- 172.21.15.53:0/4026776889 wait complete. 2024-08-31T06:15:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.679+0000 7fec084d0740 20 client.28037 trim_cache size 0 max 16384 2024-08-31T06:15:19.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.692+0000 7fec084d0740 1 Processor -- start 2024-08-31T06:15:19.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.692+0000 7fec084d0740 1 -- start start 2024-08-31T06:15:19.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.692+0000 7fec084d0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378bce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.692+0000 7fec084d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618374e9390 0x5618378c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.692+0000 7fec084d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56183750a070 0x5618378c2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.692+0000 7fec084d0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1ad1c0 con 0x5618374e11b0 2024-08-31T06:15:19.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.692+0000 7fec084d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1aef10 con 0x56183750a070 2024-08-31T06:15:19.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.692+0000 7fec084d0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1ad890 con 0x5618374e9390 2024-08-31T06:15:19.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378bce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378bce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35718/0 (socket says 172.21.15.53:35718) 2024-08-31T06:15:19.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febfb7fe640 1 -- 172.21.15.53:0/2762262513 learned_addr learned my addr 172.21.15.53:0/2762262513 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:19.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febf2ffd640 1 --2- 172.21.15.53:0/2762262513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618374e9390 0x5618378c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febfbfff640 1 --2- 172.21.15.53:0/2762262513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56183750a070 0x5618378c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febfb7fe640 1 -- 172.21.15.53:0/2762262513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618374e9390 msgr2=0x5618378c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:19.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febfb7fe640 1 --2- 172.21.15.53:0/2762262513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618374e9390 0x5618378c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febfb7fe640 1 -- 172.21.15.53:0/2762262513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56183750a070 msgr2=0x5618378c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:19.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febfb7fe640 1 --2- 172.21.15.53:0/2762262513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56183750a070 0x5618378c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febfb7fe640 1 -- 172.21.15.53:0/2762262513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618378b1600 con 0x5618374e11b0 2024-08-31T06:15:19.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febfb7fe640 1 --2- 172.21.15.53:0/2762262513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378bce10 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7febec003fd0 tx=0x7febec0d5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef866d4786caf4ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:19.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febf17fa640 1 -- 172.21.15.53:0/2762262513 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec049040 con 0x5618374e11b0 2024-08-31T06:15:19.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febf17fa640 1 -- 172.21.15.53:0/2762262513 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febec0cbf00 con 0x5618374e11b0 2024-08-31T06:15:19.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.693+0000 7febf17fa640 1 -- 172.21.15.53:0/2762262513 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec0ef0b0 con 0x5618374e11b0 2024-08-31T06:15:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.694+0000 7fec084d0740 1 -- 172.21.15.53:0/2762262513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 msgr2=0x5618378bce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.694+0000 7fec084d0740 1 --2- 172.21.15.53:0/2762262513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378bce10 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7febec003fd0 tx=0x7febec0d5040 comp rx=0 tx=0).stop 2024-08-31T06:15:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.694+0000 7fec084d0740 1 -- 172.21.15.53:0/2762262513 shutdown_connections 2024-08-31T06:15:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.694+0000 7fec084d0740 1 --2- 172.21.15.53:0/2762262513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56183750a070 0x5618378c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.694+0000 7fec084d0740 1 --2- 172.21.15.53:0/2762262513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618374e9390 0x5618378c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.694+0000 7fec084d0740 1 --2- 172.21.15.53:0/2762262513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378bce10 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.694+0000 7fec084d0740 1 -- 172.21.15.53:0/2762262513 >> 172.21.15.53:0/2762262513 conn(0x5618374fe460 msgr2=0x5618378bea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.694+0000 7fec084d0740 1 -- 172.21.15.53:0/2762262513 shutdown_connections 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.694+0000 7fec084d0740 1 -- 172.21.15.53:0/2762262513 wait complete. 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7fec084d0740 1 -- start start 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7fec084d0740 1 Processor -- start 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7fec084d0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378db190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7fec084d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 0x5618378c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7fec084d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56183750a070 0x5618378c5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7fec084d0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1ae780 con 0x5618374e11b0 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7fec084d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1ae020 con 0x5618374e9390 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7fec084d0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1ab1e0 con 0x56183750a070 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7fec084d0740 10 client.0 _ll_register_callbacks cb 0x7febe401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7febfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378db190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7febfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378db190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35736/0 (socket says 172.21.15.53:35736) 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7febf2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 0x5618378c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7febfb7fe640 1 -- 172.21.15.53:0/1837840550 learned_addr learned my addr 172.21.15.53:0/1837840550 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.695+0000 7febfbfff640 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56183750a070 0x5618378c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febfb7fe640 1 -- 172.21.15.53:0/1837840550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56183750a070 msgr2=0x5618378c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febfb7fe640 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56183750a070 0x5618378c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febfb7fe640 1 -- 172.21.15.53:0/1837840550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 msgr2=0x5618378c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febfb7fe640 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 0x5618378c4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febfb7fe640 1 -- 172.21.15.53:0/1837840550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618378c5980 con 0x5618374e11b0 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febf2ffd640 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 0x5618378c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febfb7fe640 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378db190 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7febec0d5010 tx=0x7febec031970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5931c122407e3e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febdaffd640 1 -- 172.21.15.53:0/1837840550 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec049070 con 0x5618374e11b0 2024-08-31T06:15:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febdaffd640 1 -- 172.21.15.53:0/1837840550 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7febec0ef0b0 con 0x5618374e11b0 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7fec084d0740 1 -- 172.21.15.53:0/1837840550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febec0cbf00 con 0x5618374e11b0 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febdaffd640 1 -- 172.21.15.53:0/1837840550 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7febec0d0bb0 con 0x5618374e11b0 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7fec084d0740 10 client.18855 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7fec084d0740 1 -- 172.21.15.53:0/1837840550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5618378cfd10 con 0x5618374e11b0 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.696+0000 7febdaffd640 1 -- 172.21.15.53:0/1837840550 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febec0cbf00 con 0x5618374e11b0 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.697+0000 7febdaffd640 1 -- 172.21.15.53:0/1837840550 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7febec003c30 con 0x5618374e11b0 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.697+0000 7fec084d0740 10 client.18855 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.697+0000 7fec084d0740 10 client.18855 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.697+0000 7fec084d0740 20 client.18855 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.697+0000 7fec084d0740 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56183749dda0 0x561837941cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.697+0000 7fec084d0740 4 client.18855 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.697+0000 7fec084d0740 1 -- 172.21.15.53:0/1837840550 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561837824070 con 0x56183749dda0 2024-08-31T06:15:19.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.697+0000 7febf2ffd640 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56183749dda0 0x561837941cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.697+0000 7febdaffd640 10 client.18855 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.697+0000 7febf2ffd640 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56183749dda0 0x561837941cb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=afee8ef7ee20fd57 server_cookie=65f039ebe515f161 in_seq=0 out_seq=0 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.697+0000 7febdaffd640 1 -- 172.21.15.53:0/1837840550 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561837824070 con 0x56183749dda0 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7febdaffd640 10 client.18855 handle_command_reply: tid=0 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 1 client.18855 shutdown 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 1 -- 172.21.15.53:0/1837840550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 msgr2=0x5618378db190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378db190 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7febec0d5010 tx=0x7febec031970 comp rx=0 tx=0).stop 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 1 -- 172.21.15.53:0/1837840550 shutdown_connections 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56183749dda0 0x561837941cb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56183750a070 0x5618378c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618374e9390 0x5618378c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7febdaffd640 0 client.18855 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:15:19.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 1 --2- 172.21.15.53:0/1837840550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618374e11b0 0x5618378db190 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 1 -- 172.21.15.53:0/1837840550 >> 172.21.15.53:0/1837840550 conn(0x5618374fe460 msgr2=0x5618378c3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:19.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 1 -- 172.21.15.53:0/1837840550 shutdown_connections 2024-08-31T06:15:19.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 1 -- 172.21.15.53:0/1837840550 wait complete. 2024-08-31T06:15:19.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec084d0740 20 client.18855 trim_cache size 0 max 16384 2024-08-31T06:15:19.708 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:15:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.698+0000 7fec01f5b640 1 -- 172.21.15.53:0/311101978 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe80b4d20 msgr2=0x7febe80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.699+0000 7fec01f5b640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe80b4d20 0x7febe80b7230 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7febf4007f80 tx=0x7febf4007520 comp rx=0 tx=0).stop 2024-08-31T06:15:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.699+0000 7fec01f5b640 1 -- 172.21.15.53:0/311101978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febfc103950 msgr2=0x7febfc0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.699+0000 7fec01f5b640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febfc103950 0x7febfc0754b0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7febec009230 tx=0x7febec004270 comp rx=0 tx=0).stop 2024-08-31T06:15:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.699+0000 7fec01f5b640 1 -- 172.21.15.53:0/311101978 shutdown_connections 2024-08-31T06:15:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.699+0000 7fec01f5b640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febe80b4d20 0x7febe80b7230 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.699+0000 7fec01f5b640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febfc109be0 0x7febfc075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.699+0000 7fec01f5b640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febfc109290 0x7febfc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.699+0000 7fec01f5b640 1 --2- 172.21.15.53:0/311101978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febfc103950 0x7febfc0754b0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.699+0000 7fec01f5b640 1 -- 172.21.15.53:0/311101978 >> 172.21.15.53:0/311101978 conn(0x7febfc0ff3a0 msgr2=0x7febfc1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.699+0000 7fec01f5b640 1 -- 172.21.15.53:0/311101978 shutdown_connections 2024-08-31T06:15:19.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:19.699+0000 7fec01f5b640 1 -- 172.21.15.53:0/311101978 wait complete. 2024-08-31T06:15:19.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:19 smithi130 ceph-mon[22266]: pgmap v644: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 751 KiB/s wr, 80 op/s 2024-08-31T06:15:19.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:19 smithi153 ceph-mon[22320]: pgmap v644: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 751 KiB/s wr, 80 op/s 2024-08-31T06:15:19.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.49 MB/sec execute 429 sec latency 1433.718 ms 2024-08-31T06:15:20.374 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:15:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:20.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.49 MB/sec execute 430 sec latency 2433.825 ms 2024-08-31T06:15:21.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.108+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3530438335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a48108b50 msgr2=0x7f6a4810f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:21.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.108+0000 7f6a4faeb640 1 --2- 172.21.15.53:0/3530438335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a48108b50 0x7f6a4810f380 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009ca0 tx=0x7f6a4002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.108+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3530438335 shutdown_connections 2024-08-31T06:15:21.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.108+0000 7f6a4faeb640 1 --2- 172.21.15.53:0/3530438335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a48108b50 0x7f6a4810f380 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.108+0000 7f6a4faeb640 1 --2- 172.21.15.53:0/3530438335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a48108200 0x7f6a48108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.108+0000 7f6a4faeb640 1 --2- 172.21.15.53:0/3530438335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a48102f90 0x7f6a481033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.108+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3530438335 >> 172.21.15.53:0/3530438335 conn(0x7f6a48079c60 msgr2=0x7f6a4807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:21.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.108+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3530438335 shutdown_connections 2024-08-31T06:15:21.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.108+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3530438335 wait complete. 2024-08-31T06:15:21.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4faeb640 1 Processor -- start 2024-08-31T06:15:21.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4faeb640 1 -- start start 2024-08-31T06:15:21.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4faeb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a48102f90 0x7f6a4819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4faeb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a48108200 0x7f6a4819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4faeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a48108b50 0x7f6a4819f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4faeb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a48112720 con 0x7f6a48108b50 2024-08-31T06:15:21.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4faeb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481125a0 con 0x7f6a48102f90 2024-08-31T06:15:21.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4faeb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481128a0 con 0x7f6a48108200 2024-08-31T06:15:21.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4e088640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a48108b50 0x7f6a4819f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4d887640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a48102f90 0x7f6a4819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4e088640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a48108b50 0x7f6a4819f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35748/0 (socket says 172.21.15.53:35748) 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4e088640 1 -- 172.21.15.53:0/3259206947 learned_addr learned my addr 172.21.15.53:0/3259206947 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.109+0000 7f6a4d086640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a48108200 0x7f6a4819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.110+0000 7f6a4e088640 1 -- 172.21.15.53:0/3259206947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a48108200 msgr2=0x7f6a4819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.110+0000 7f6a4e088640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a48108200 0x7f6a4819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.110+0000 7f6a4e088640 1 -- 172.21.15.53:0/3259206947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a48102f90 msgr2=0x7f6a4819a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.110+0000 7f6a4e088640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a48102f90 0x7f6a4819a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.110+0000 7f6a4e088640 1 -- 172.21.15.53:0/3259206947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a481a00f0 con 0x7f6a48108b50 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.110+0000 7f6a4e088640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a48108b50 0x7f6a4819f9c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005cc0 tx=0x7f6a40032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.110+0000 7f6a3effd640 1 -- 172.21.15.53:0/3259206947 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40032e00 con 0x7f6a48108b50 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.110+0000 7f6a3effd640 1 -- 172.21.15.53:0/3259206947 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a400044d0 con 0x7f6a48108b50 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.110+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3259206947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a481a0380 con 0x7f6a48108b50 2024-08-31T06:15:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.110+0000 7f6a3effd640 1 -- 172.21.15.53:0/3259206947 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40030b70 con 0x7f6a48108b50 2024-08-31T06:15:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.110+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3259206947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a481a6b40 con 0x7f6a48108b50 2024-08-31T06:15:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.113+0000 7f6a3effd640 1 -- 172.21.15.53:0/3259206947 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6a40004680 con 0x7f6a48108b50 2024-08-31T06:15:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.113+0000 7f6a56060740 1 Processor -- start 2024-08-31T06:15:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a56060740 1 -- start start 2024-08-31T06:15:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a56060740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55627871b070 0x556278ac0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a56060740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ac0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a56060740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278ac0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a56060740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556278a37680 con 0x5562786f21b0 2024-08-31T06:15:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a56060740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556278a26c10 con 0x5562786fa390 2024-08-31T06:15:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a56060740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556278a2abc0 con 0x55627871b070 2024-08-31T06:15:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4d887640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ac0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4d887640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ac0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35754/0 (socket says 172.21.15.53:35754) 2024-08-31T06:15:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4d887640 1 -- 172.21.15.53:0/624360435 learned_addr learned my addr 172.21.15.53:0/624360435 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a3effd640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a340b4ca0 0x7f6a340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4d086640 1 --2- 172.21.15.53:0/624360435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55627871b070 0x556278ac0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4d086640 1 --2- 172.21.15.53:0/624360435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278ac0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4d887640 1 -- 172.21.15.53:0/624360435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55627871b070 msgr2=0x556278ac0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4d887640 1 --2- 172.21.15.53:0/624360435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55627871b070 0x556278ac0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4d887640 1 -- 172.21.15.53:0/624360435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 msgr2=0x556278ac0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4d887640 1 --2- 172.21.15.53:0/624360435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278ac0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4d887640 1 -- 172.21.15.53:0/624360435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556278786650 con 0x5562786f21b0 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4d086640 1 --2- 172.21.15.53:0/624360435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55627871b070 0x556278ac0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a3effd640 1 -- 172.21.15.53:0/3259206947 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f6a40106790 con 0x7f6a48108b50 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.114+0000 7f6a4e088640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a340b4ca0 0x7f6a340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.115+0000 7f6a4d887640 1 --2- 172.21.15.53:0/624360435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ac0850 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400b760 tx=0x7f6a4400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba3785b63da6a9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.115+0000 7f6a33fff640 1 -- 172.21.15.53:0/624360435 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44003dd0 con 0x5562786f21b0 2024-08-31T06:15:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.115+0000 7f6a33fff640 1 -- 172.21.15.53:0/624360435 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a44015070 con 0x5562786f21b0 2024-08-31T06:15:21.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.115+0000 7f6a33fff640 1 -- 172.21.15.53:0/624360435 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44004cc0 con 0x5562786f21b0 2024-08-31T06:15:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.116+0000 7f6a56060740 1 -- 172.21.15.53:0/624360435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 msgr2=0x556278ac0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.116+0000 7f6a56060740 1 --2- 172.21.15.53:0/624360435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ac0850 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400b760 tx=0x7f6a4400bc20 comp rx=0 tx=0).stop 2024-08-31T06:15:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.116+0000 7f6a4e088640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a340b4ca0 0x7f6a340b71b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6a400c8ee0 tx=0x7f6a40032fa0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.116+0000 7f6a56060740 1 -- 172.21.15.53:0/624360435 shutdown_connections 2024-08-31T06:15:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.116+0000 7f6a56060740 1 --2- 172.21.15.53:0/624360435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278ac0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.116+0000 7f6a56060740 1 --2- 172.21.15.53:0/624360435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ac0850 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.116+0000 7f6a56060740 1 --2- 172.21.15.53:0/624360435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55627871b070 0x556278ac0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.116+0000 7f6a56060740 1 -- 172.21.15.53:0/624360435 >> 172.21.15.53:0/624360435 conn(0x55627870f460 msgr2=0x556278abe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.116+0000 7f6a56060740 1 -- 172.21.15.53:0/624360435 shutdown_connections 2024-08-31T06:15:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.116+0000 7f6a56060740 1 -- 172.21.15.53:0/624360435 wait complete. 2024-08-31T06:15:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.116+0000 7f6a56060740 1 -- start start 2024-08-31T06:15:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a56060740 1 Processor -- start 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a56060740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278acfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a56060740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562786fa390 0x556278ad0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a56060740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55627871b070 0x556278adc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a56060740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556278889700 con 0x5562786f21b0 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a56060740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5562789ad750 con 0x55627871b070 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a56060740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556278ad2e20 con 0x5562786fa390 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a56060740 10 client.0 _ll_register_callbacks cb 0x5562789dce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a4d086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278acfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a4d086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278acfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35760/0 (socket says 172.21.15.53:35760) 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a4d086640 1 -- 172.21.15.53:0/3534047111 learned_addr learned my addr 172.21.15.53:0/3534047111 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a4d887640 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562786fa390 0x556278ad0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a4d086640 1 -- 172.21.15.53:0/3534047111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562786fa390 msgr2=0x556278ad0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a4d086640 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562786fa390 0x556278ad0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a4d086640 1 -- 172.21.15.53:0/3534047111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55627871b070 msgr2=0x556278adc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.117+0000 7f6a4d086640 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55627871b070 0x556278adc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.118+0000 7f6a4d086640 1 -- 172.21.15.53:0/3534047111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562789e6900 con 0x5562786f21b0 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.118+0000 7f6a4d086640 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278acfe50 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f6a38004600 tx=0x7f6a38010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d593d5e16331a340 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.118+0000 7f6a317fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.118+0000 7f6a317fa640 1 -- 172.21.15.53:0/3534047111 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38017070 con 0x5562786f21b0 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.118+0000 7f6a56060740 1 -- 172.21.15.53:0/3534047111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a44015070 con 0x5562786f21b0 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.118+0000 7f6a317fa640 1 -- 172.21.15.53:0/3534047111 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f6a3800fdb0 con 0x5562786f21b0 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.118+0000 7f6a317fa640 1 -- 172.21.15.53:0/3534047111 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f6a38005020 con 0x5562786f21b0 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.118+0000 7f6a56060740 10 client.18867 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.118+0000 7f6a56060740 1 -- 172.21.15.53:0/3534047111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x556278adec80 con 0x5562786f21b0 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.118+0000 7f6a317fa640 1 -- 172.21.15.53:0/3534047111 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a44015070 con 0x5562786f21b0 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.119+0000 7f6a317fa640 1 -- 172.21.15.53:0/3534047111 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f6a38023420 con 0x5562786f21b0 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.119+0000 7f6a56060740 10 client.18867 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.119+0000 7f6a56060740 10 client.18867 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:15:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.119+0000 7f6a56060740 20 client.18867 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.119+0000 7f6a56060740 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5562786d99f0 0x556278ae21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.119+0000 7f6a56060740 4 client.18867 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.119+0000 7f6a56060740 1 -- 172.21.15.53:0/3534047111 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556278a395d0 con 0x5562786d99f0 2024-08-31T06:15:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.119+0000 7f6a4d887640 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5562786d99f0 0x556278ae21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.119+0000 7f6a317fa640 10 client.18867 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:15:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.119+0000 7f6a4d887640 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5562786d99f0 0x556278ae21e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8c7d8e4f5c202d22 server_cookie=63b95598aa61761e in_seq=0 out_seq=0 2024-08-31T06:15:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a317fa640 1 -- 172.21.15.53:0/3534047111 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556278a395d0 con 0x5562786d99f0 2024-08-31T06:15:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a317fa640 10 client.18867 handle_command_reply: tid=0 2024-08-31T06:15:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a56060740 1 client.18867 shutdown 2024-08-31T06:15:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a56060740 1 -- 172.21.15.53:0/3534047111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 msgr2=0x556278acfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a56060740 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278acfe50 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f6a38004600 tx=0x7f6a38010df0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a56060740 1 -- 172.21.15.53:0/3534047111 shutdown_connections 2024-08-31T06:15:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a56060740 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5562786d99f0 0x556278ae21e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a56060740 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55627871b070 0x556278adc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a56060740 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562786fa390 0x556278ad0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a56060740 1 --2- 172.21.15.53:0/3534047111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278acfe50 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a317fa640 0 client.18867 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:15:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.120+0000 7f6a56060740 1 -- 172.21.15.53:0/3534047111 >> 172.21.15.53:0/3534047111 conn(0x55627870f460 msgr2=0x556278abc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.121+0000 7f6a56060740 1 -- 172.21.15.53:0/3534047111 shutdown_connections 2024-08-31T06:15:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.121+0000 7f6a56060740 1 -- 172.21.15.53:0/3534047111 wait complete. 2024-08-31T06:15:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.121+0000 7f6a56060740 20 client.18867 trim_cache size 0 max 16384 2024-08-31T06:15:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a56060740 1 Processor -- start 2024-08-31T06:15:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a56060740 1 -- start start 2024-08-31T06:15:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a56060740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562786f21b0 0x556278ad1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a56060740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278adc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a56060740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55627871b070 0x556278acd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a56060740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481ad2b0 con 0x55627871b070 2024-08-31T06:15:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a56060740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481af000 con 0x5562786fa390 2024-08-31T06:15:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a56060740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481ad980 con 0x5562786f21b0 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a4d086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55627871b070 0x556278acd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a4d086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55627871b070 0x556278acd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35776/0 (socket says 172.21.15.53:35776) 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a4d086640 1 -- 172.21.15.53:0/914719420 learned_addr learned my addr 172.21.15.53:0/914719420 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.134+0000 7f6a4d086640 1 --2- 172.21.15.53:0/914719420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562786f21b0 0x556278ad1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.135+0000 7f6a4d086640 1 -- 172.21.15.53:0/914719420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562786f21b0 msgr2=0x556278ad1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.135+0000 7f6a4d887640 1 --2- 172.21.15.53:0/914719420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278adc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.135+0000 7f6a4d086640 1 --2- 172.21.15.53:0/914719420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562786f21b0 0x556278ad1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.135+0000 7f6a4d086640 1 -- 172.21.15.53:0/914719420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 msgr2=0x556278adc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.135+0000 7f6a4d086640 1 --2- 172.21.15.53:0/914719420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278adc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.135+0000 7f6a4d086640 1 -- 172.21.15.53:0/914719420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556278ab8340 con 0x55627871b070 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.135+0000 7f6a4d887640 1 --2- 172.21.15.53:0/914719420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278adc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.135+0000 7f6a4d086640 1 --2- 172.21.15.53:0/914719420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55627871b070 0x556278acd040 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800f970 tx=0x7f6a3800f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726154105e287bd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.135+0000 7f6a337fe640 1 -- 172.21.15.53:0/914719420 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38017040 con 0x55627871b070 2024-08-31T06:15:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.135+0000 7f6a337fe640 1 -- 172.21.15.53:0/914719420 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a38023a80 con 0x55627871b070 2024-08-31T06:15:21.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.135+0000 7f6a337fe640 1 -- 172.21.15.53:0/914719420 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38004dc0 con 0x55627871b070 2024-08-31T06:15:21.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.136+0000 7f6a56060740 1 -- 172.21.15.53:0/914719420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55627871b070 msgr2=0x556278acd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:21.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.136+0000 7f6a56060740 1 --2- 172.21.15.53:0/914719420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55627871b070 0x556278acd040 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800f970 tx=0x7f6a3800f8a0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.136+0000 7f6a56060740 1 -- 172.21.15.53:0/914719420 shutdown_connections 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.136+0000 7f6a56060740 1 --2- 172.21.15.53:0/914719420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55627871b070 0x556278acd040 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.136+0000 7f6a56060740 1 --2- 172.21.15.53:0/914719420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278adc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.136+0000 7f6a56060740 1 --2- 172.21.15.53:0/914719420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562786f21b0 0x556278ad1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.136+0000 7f6a56060740 1 -- 172.21.15.53:0/914719420 >> 172.21.15.53:0/914719420 conn(0x55627870f460 msgr2=0x556278ad1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.136+0000 7f6a56060740 1 -- 172.21.15.53:0/914719420 shutdown_connections 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.136+0000 7f6a56060740 1 -- 172.21.15.53:0/914719420 wait complete. 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.136+0000 7f6a56060740 1 -- start start 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.136+0000 7f6a56060740 1 Processor -- start 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a56060740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ad47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a56060740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278ad4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a56060740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55627871b070 0x556278b4bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a56060740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481ae870 con 0x5562786f21b0 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a56060740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481ae110 con 0x5562786fa390 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a56060740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481ab2b0 con 0x55627871b070 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a56060740 10 client.0 _ll_register_callbacks cb 0x7f6a3800a8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a4d086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ad47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a4d086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ad47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35790/0 (socket says 172.21.15.53:35790) 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a4d086640 1 -- 172.21.15.53:0/2069633317 learned_addr learned my addr 172.21.15.53:0/2069633317 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a4d887640 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278ad4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a4d086640 1 -- 172.21.15.53:0/2069633317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55627871b070 msgr2=0x556278b4bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a4d086640 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55627871b070 0x556278b4bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a4d086640 1 -- 172.21.15.53:0/2069633317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 msgr2=0x556278ad4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a4d086640 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278ad4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a4d086640 1 -- 172.21.15.53:0/2069633317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556278b4c120 con 0x5562786f21b0 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a4d887640 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278ad4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:15:21.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a4d086640 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ad47f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6a38023930 tx=0x7f6a38004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231f474ba886e5a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.137+0000 7f6a317fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a317fa640 1 -- 172.21.15.53:0/2069633317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3803f060 con 0x5562786f21b0 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a317fa640 1 -- 172.21.15.53:0/2069633317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f6a38004b60 con 0x5562786f21b0 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a56060740 1 -- 172.21.15.53:0/2069633317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a38023a80 con 0x5562786f21b0 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a317fa640 1 -- 172.21.15.53:0/2069633317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f6a38017040 con 0x5562786f21b0 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a56060740 10 client.18873 fetch_fsmap learned FSMap version 47 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a56060740 1 -- 172.21.15.53:0/2069633317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x556278b4d310 con 0x5562786f21b0 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a317fa640 1 -- 172.21.15.53:0/2069633317 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a38023a80 con 0x5562786f21b0 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a317fa640 1 -- 172.21.15.53:0/2069633317 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) ==== 8410+0+0 (secure 0 0 0) 0x7f6a38005430 con 0x5562786f21b0 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a56060740 10 client.18873 fetch_fsmap finished waiting for FSMap version 47 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a56060740 10 client.18873 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a56060740 20 client.18873 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:21.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a56060740 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5562786aeda0 0x556278b4fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a56060740 4 client.18873 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.138+0000 7f6a56060740 1 -- 172.21.15.53:0/2069633317 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556278a35070 con 0x5562786aeda0 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.139+0000 7f6a4d887640 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5562786aeda0 0x556278b4fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.139+0000 7f6a317fa640 10 client.18873 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.139+0000 7f6a4d887640 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5562786aeda0 0x556278b4fa20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f98a2c4ad69f00c8 server_cookie=eac4ce33126b76b1 in_seq=0 out_seq=0 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.139+0000 7f6a317fa640 1 -- 172.21.15.53:0/2069633317 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556278a35070 con 0x5562786aeda0 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.139+0000 7f6a317fa640 10 client.18873 handle_command_reply: tid=0 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.139+0000 7f6a56060740 1 client.18873 shutdown 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.139+0000 7f6a56060740 1 -- 172.21.15.53:0/2069633317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 msgr2=0x556278ad47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.139+0000 7f6a56060740 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ad47f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6a38023930 tx=0x7f6a38004810 comp rx=0 tx=0).stop 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a56060740 1 -- 172.21.15.53:0/2069633317 shutdown_connections 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a56060740 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5562786aeda0 0x556278b4fa20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a56060740 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55627871b070 0x556278b4bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a56060740 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5562786fa390 0x556278ad4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a317fa640 0 client.18873 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:15:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a56060740 1 --2- 172.21.15.53:0/2069633317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562786f21b0 0x556278ad47f0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a56060740 1 -- 172.21.15.53:0/2069633317 >> 172.21.15.53:0/2069633317 conn(0x55627870f460 msgr2=0x556278ac1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a56060740 1 -- 172.21.15.53:0/2069633317 shutdown_connections 2024-08-31T06:15:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a56060740 1 -- 172.21.15.53:0/2069633317 wait complete. 2024-08-31T06:15:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a56060740 20 client.18873 trim_cache size 0 max 16384 2024-08-31T06:15:21.147 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:15:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3259206947 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a340b4ca0 msgr2=0x7f6a340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a340b4ca0 0x7f6a340b71b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6a400c8ee0 tx=0x7f6a40032fa0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3259206947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a48108b50 msgr2=0x7f6a4819f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a48108b50 0x7f6a4819f9c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005cc0 tx=0x7f6a40032a10 comp rx=0 tx=0).stop 2024-08-31T06:15:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3259206947 shutdown_connections 2024-08-31T06:15:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a340b4ca0 0x7f6a340b71b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a48108b50 0x7f6a4819f9c0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a48108200 0x7f6a4819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 --2- 172.21.15.53:0/3259206947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a48102f90 0x7f6a4819a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3259206947 >> 172.21.15.53:0/3259206947 conn(0x7f6a48079c60 msgr2=0x7f6a48101060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3259206947 shutdown_connections 2024-08-31T06:15:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:21.140+0000 7f6a4faeb640 1 -- 172.21.15.53:0/3259206947 wait complete. 2024-08-31T06:15:21.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:21 smithi130 ceph-mon[22266]: pgmap v645: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 506 KiB/s wr, 64 op/s 2024-08-31T06:15:21.907 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:21 smithi053 ceph-mon[18924]: pgmap v645: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 506 KiB/s wr, 64 op/s 2024-08-31T06:15:21.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:21 smithi153 ceph-mon[22320]: pgmap v645: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 506 KiB/s wr, 64 op/s 2024-08-31T06:15:21.938 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:15:21.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.48 MB/sec execute 431 sec latency 3433.865 ms 2024-08-31T06:15:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:22.875 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:22 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:15:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.868+0000 7fc24b7c5640 1 -- 172.21.15.53:0/4188475364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc244102820 msgr2=0x7fc244102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.868+0000 7fc24b7c5640 1 --2- 172.21.15.53:0/4188475364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc244102820 0x7fc244102c30 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fc240009900 tx=0x7fc24002a410 comp rx=0 tx=0).stop 2024-08-31T06:15:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.868+0000 7fc24b7c5640 1 -- 172.21.15.53:0/4188475364 shutdown_connections 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.868+0000 7fc24b7c5640 1 --2- 172.21.15.53:0/4188475364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244108ab0 0x7fc24410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.868+0000 7fc24b7c5640 1 --2- 172.21.15.53:0/4188475364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc244108160 0x7fc244108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.868+0000 7fc24b7c5640 1 --2- 172.21.15.53:0/4188475364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc244102820 0x7fc244102c30 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.868+0000 7fc24b7c5640 1 -- 172.21.15.53:0/4188475364 >> 172.21.15.53:0/4188475364 conn(0x7fc2440794e0 msgr2=0x7fc2440798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.868+0000 7fc24b7c5640 1 -- 172.21.15.53:0/4188475364 shutdown_connections 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.868+0000 7fc24b7c5640 1 -- 172.21.15.53:0/4188475364 wait complete. 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc24b7c5640 1 Processor -- start 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc24b7c5640 1 -- start start 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc24b7c5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244102820 0x7fc24419afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc24b7c5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc244108160 0x7fc24419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc24b7c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc244108ab0 0x7fc24419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc24b7c5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441125e0 con 0x7fc244108ab0 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc24b7c5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc244112460 con 0x7fc244108160 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc24b7c5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc244112760 con 0x7fc244102820 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc249d62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc244108ab0 0x7fc24419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc249d62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc244108ab0 0x7fc24419ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35806/0 (socket says 172.21.15.53:35806) 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc248d60640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc244108160 0x7fc24419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc249d62640 1 -- 172.21.15.53:0/1405234078 learned_addr learned my addr 172.21.15.53:0/1405234078 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.869+0000 7fc249561640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244102820 0x7fc24419afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.870+0000 7fc249d62640 1 -- 172.21.15.53:0/1405234078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244102820 msgr2=0x7fc24419afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.870+0000 7fc249d62640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244102820 0x7fc24419afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.870+0000 7fc249d62640 1 -- 172.21.15.53:0/1405234078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc244108160 msgr2=0x7fc24419b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.870+0000 7fc249d62640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc244108160 0x7fc24419b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.870+0000 7fc249d62640 1 -- 172.21.15.53:0/1405234078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2441a6240 con 0x7fc244108ab0 2024-08-31T06:15:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.870+0000 7fc249d62640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc244108ab0 0x7fc24419ba30 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00cad0 tx=0x7fc23c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.870+0000 7fc23a7fc640 1 -- 172.21.15.53:0/1405234078 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00ae20 con 0x7fc244108ab0 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.870+0000 7fc23a7fc640 1 -- 172.21.15.53:0/1405234078 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc23c005020 con 0x7fc244108ab0 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.870+0000 7fc23a7fc640 1 -- 172.21.15.53:0/1405234078 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00f6b0 con 0x7fc244108ab0 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.870+0000 7fc24b7c5640 1 -- 172.21.15.53:0/1405234078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2441a6530 con 0x7fc244108ab0 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.870+0000 7fc24b7c5640 1 -- 172.21.15.53:0/1405234078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2441a6a20 con 0x7fc244108ab0 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.873+0000 7fc251d3a740 1 Processor -- start 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.873+0000 7fc23a7fc640 1 -- 172.21.15.53:0/1405234078 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc23c0051d0 con 0x7fc244108ab0 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.873+0000 7fc251d3a740 1 -- start start 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58ad7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ad7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ad7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc251d3a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557c58a4e680 con 0x557c58711390 2024-08-31T06:15:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc251d3a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557c58a3dc10 con 0x557c587091b0 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc251d3a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557c58a41bc0 con 0x557c58732070 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc248d60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ad7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc248d60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ad7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35810/0 (socket says 172.21.15.53:35810) 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc248d60640 1 -- 172.21.15.53:0/1869605066 learned_addr learned my addr 172.21.15.53:0/1869605066 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc248d60640 1 --2- 172.21.15.53:0/1869605066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58ad7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc249561640 1 --2- 172.21.15.53:0/1869605066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ad7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc248d60640 1 -- 172.21.15.53:0/1869605066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 msgr2=0x557c58ad7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc248d60640 1 --2- 172.21.15.53:0/1869605066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58ad7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc248d60640 1 -- 172.21.15.53:0/1869605066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 msgr2=0x557c58ad7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc248d60640 1 --2- 172.21.15.53:0/1869605066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ad7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.874+0000 7fc248d60640 1 -- 172.21.15.53:0/1869605066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c5879d650 con 0x557c58711390 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.875+0000 7fc248d60640 1 --2- 172.21.15.53:0/1869605066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ad7d90 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fc234012770 tx=0x7fc234004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6373f9449815c98f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:22.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.875+0000 7fc23a7fc640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2300b4d50 0x7fc2300b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.875+0000 7fc249561640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2300b4d50 0x7fc2300b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.875+0000 7fc22f7fe640 1 -- 172.21.15.53:0/1869605066 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234012cf0 con 0x557c58711390 2024-08-31T06:15:22.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.875+0000 7fc22f7fe640 1 -- 172.21.15.53:0/1869605066 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2340044c0 con 0x557c58711390 2024-08-31T06:15:22.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.875+0000 7fc22f7fe640 1 -- 172.21.15.53:0/1869605066 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2340035f0 con 0x557c58711390 2024-08-31T06:15:22.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.875+0000 7fc23a7fc640 1 -- 172.21.15.53:0/1405234078 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fc23c0e5780 con 0x7fc244108ab0 2024-08-31T06:15:22.882 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:22 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:15:22.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.876+0000 7fc251d3a740 1 -- 172.21.15.53:0/1869605066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 msgr2=0x557c58ad7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:22.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.876+0000 7fc249561640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2300b4d50 0x7fc2300b7260 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc24406c440 tx=0x7fc2400058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:22.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.876+0000 7fc251d3a740 1 --2- 172.21.15.53:0/1869605066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ad7d90 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fc234012770 tx=0x7fc234004730 comp rx=0 tx=0).stop 2024-08-31T06:15:22.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.876+0000 7fc251d3a740 1 -- 172.21.15.53:0/1869605066 shutdown_connections 2024-08-31T06:15:22.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.876+0000 7fc251d3a740 1 --2- 172.21.15.53:0/1869605066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ad7d90 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.876+0000 7fc251d3a740 1 --2- 172.21.15.53:0/1869605066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ad7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.876+0000 7fc251d3a740 1 --2- 172.21.15.53:0/1869605066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58ad7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.876+0000 7fc251d3a740 1 -- 172.21.15.53:0/1869605066 >> 172.21.15.53:0/1869605066 conn(0x557c58726460 msgr2=0x557c58ad5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:22.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.876+0000 7fc251d3a740 1 -- 172.21.15.53:0/1869605066 shutdown_connections 2024-08-31T06:15:22.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.876+0000 7fc251d3a740 1 -- 172.21.15.53:0/1869605066 wait complete. 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.876+0000 7fc251d3a740 1 -- start start 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc251d3a740 1 Processor -- start 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ae2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58711390 0x557c58ae3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58732070 0x557c58aeede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc251d3a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557c588a0700 con 0x557c58732070 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc251d3a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557c589c4750 con 0x557c587091b0 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc251d3a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557c58ae5af0 con 0x557c58711390 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc251d3a740 10 client.0 _ll_register_callbacks cb 0x557c589f3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc249d62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58732070 0x557c58aeede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc249d62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58732070 0x557c58aeede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35814/0 (socket says 172.21.15.53:35814) 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc249d62640 1 -- 172.21.15.53:0/4162503056 learned_addr learned my addr 172.21.15.53:0/4162503056 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc248d60640 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58711390 0x557c58ae3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.877+0000 7fc249561640 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ae2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc249d62640 1 -- 172.21.15.53:0/4162503056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58711390 msgr2=0x557c58ae3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc249d62640 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58711390 0x557c58ae3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc249d62640 1 -- 172.21.15.53:0/4162503056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 msgr2=0x557c58ae2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc249d62640 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ae2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc249d62640 1 -- 172.21.15.53:0/4162503056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c589fd900 con 0x557c58732070 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc249d62640 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58732070 0x557c58aeede0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0a7f80 tx=0x7fc23c0abf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e473e267565de33e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc22cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc22cff9640 1 -- 172.21.15.53:0/4162503056 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c01d040 con 0x557c58732070 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc22cff9640 1 -- 172.21.15.53:0/4162503056 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fc23c097230 con 0x557c58732070 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc251d3a740 1 -- 172.21.15.53:0/4162503056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c58a505d0 con 0x557c58732070 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc22cff9640 1 -- 172.21.15.53:0/4162503056 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fc23c0a8190 con 0x557c58732070 2024-08-31T06:15:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc251d3a740 10 client.18885 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.878+0000 7fc251d3a740 1 -- 172.21.15.53:0/4162503056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x557c58af1980 con 0x557c58732070 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.879+0000 7fc22cff9640 1 -- 172.21.15.53:0/4162503056 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557c58a505d0 con 0x557c58732070 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.879+0000 7fc22cff9640 1 -- 172.21.15.53:0/4162503056 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7fc23c0b4ce0 con 0x557c58732070 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.879+0000 7fc251d3a740 10 client.18885 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.879+0000 7fc251d3a740 10 client.18885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.879+0000 7fc251d3a740 20 client.18885 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.879+0000 7fc251d3a740 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c586f09f0 0x557c58af4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.879+0000 7fc251d3a740 4 client.18885 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.879+0000 7fc251d3a740 1 -- 172.21.15.53:0/4162503056 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c58a4c070 con 0x557c586f09f0 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.879+0000 7fc249561640 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c586f09f0 0x557c58af4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.880+0000 7fc22cff9640 10 client.18885 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.880+0000 7fc249561640 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c586f09f0 0x557c58af4f00 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3928180489e1fcba server_cookie=ddbbeeb7437e5b7a in_seq=0 out_seq=0 2024-08-31T06:15:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc22cff9640 1 -- 172.21.15.53:0/4162503056 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c58a4c070 con 0x557c586f09f0 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc22cff9640 10 client.18885 handle_command_reply: tid=0 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 1 client.18885 shutdown 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 1 -- 172.21.15.53:0/4162503056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58732070 msgr2=0x557c58aeede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58732070 0x557c58aeede0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0a7f80 tx=0x7fc23c0abf00 comp rx=0 tx=0).stop 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 1 -- 172.21.15.53:0/4162503056 shutdown_connections 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c586f09f0 0x557c58af4f00 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58732070 0x557c58aeede0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58711390 0x557c58ae3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 1 --2- 172.21.15.53:0/4162503056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ae2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc22cff9640 0 client.18885 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 1 -- 172.21.15.53:0/4162503056 >> 172.21.15.53:0/4162503056 conn(0x557c58726460 msgr2=0x557c58ada4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 1 -- 172.21.15.53:0/4162503056 shutdown_connections 2024-08-31T06:15:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 1 -- 172.21.15.53:0/4162503056 wait complete. 2024-08-31T06:15:22.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.881+0000 7fc251d3a740 20 client.18885 trim_cache size 0 max 16384 2024-08-31T06:15:22.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc251d3a740 1 Processor -- start 2024-08-31T06:15:22.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc251d3a740 1 -- start start 2024-08-31T06:15:22.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ae30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ada410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58ada950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc251d3a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441af540 con 0x557c58711390 2024-08-31T06:15:22.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc251d3a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441b1290 con 0x557c587091b0 2024-08-31T06:15:22.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc251d3a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441afc10 con 0x557c58732070 2024-08-31T06:15:22.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc248d60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ada410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc248d60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ada410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35828/0 (socket says 172.21.15.53:35828) 2024-08-31T06:15:22.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc248d60640 1 -- 172.21.15.53:0/3697640134 learned_addr learned my addr 172.21.15.53:0/3697640134 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:22.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc249561640 1 --2- 172.21.15.53:0/3697640134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ae30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.895+0000 7fc249d62640 1 --2- 172.21.15.53:0/3697640134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58ada950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.896+0000 7fc248d60640 1 -- 172.21.15.53:0/3697640134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 msgr2=0x557c58ada950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:22.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.896+0000 7fc248d60640 1 --2- 172.21.15.53:0/3697640134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58ada950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.896+0000 7fc248d60640 1 -- 172.21.15.53:0/3697640134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 msgr2=0x557c58ae30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:22.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.896+0000 7fc248d60640 1 --2- 172.21.15.53:0/3697640134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ae30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.896+0000 7fc248d60640 1 -- 172.21.15.53:0/3697640134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c58acf3d0 con 0x557c58711390 2024-08-31T06:15:22.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.896+0000 7fc249561640 1 --2- 172.21.15.53:0/3697640134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ae30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:22.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.896+0000 7fc248d60640 1 --2- 172.21.15.53:0/3697640134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ada410 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fc2340108d0 tx=0x7fc234010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e651e764fd195095 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:22.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.896+0000 7fc22effd640 1 -- 172.21.15.53:0/3697640134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23402c070 con 0x557c58711390 2024-08-31T06:15:22.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.896+0000 7fc22effd640 1 -- 172.21.15.53:0/3697640134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc234016040 con 0x557c58711390 2024-08-31T06:15:22.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.896+0000 7fc22effd640 1 -- 172.21.15.53:0/3697640134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234027d80 con 0x557c58711390 2024-08-31T06:15:22.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.897+0000 7fc251d3a740 1 -- 172.21.15.53:0/3697640134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 msgr2=0x557c58ada410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:22.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.897+0000 7fc251d3a740 1 --2- 172.21.15.53:0/3697640134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ada410 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fc2340108d0 tx=0x7fc234010900 comp rx=0 tx=0).stop 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.897+0000 7fc251d3a740 1 -- 172.21.15.53:0/3697640134 shutdown_connections 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.897+0000 7fc251d3a740 1 --2- 172.21.15.53:0/3697640134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58ada950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.897+0000 7fc251d3a740 1 --2- 172.21.15.53:0/3697640134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c58711390 0x557c58ada410 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.897+0000 7fc251d3a740 1 --2- 172.21.15.53:0/3697640134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c587091b0 0x557c58ae30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.897+0000 7fc251d3a740 1 -- 172.21.15.53:0/3697640134 >> 172.21.15.53:0/3697640134 conn(0x557c58726460 msgr2=0x557c58ae1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.897+0000 7fc251d3a740 1 -- 172.21.15.53:0/3697640134 shutdown_connections 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.897+0000 7fc251d3a740 1 -- 172.21.15.53:0/3697640134 wait complete. 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.897+0000 7fc251d3a740 1 -- start start 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc251d3a740 1 Processor -- start 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c587091b0 0x557c58b5b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c58711390 0x557c58aead40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc251d3a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58aeb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc251d3a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441b0b00 con 0x557c587091b0 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc251d3a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441b03a0 con 0x557c58711390 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc251d3a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441ad540 con 0x557c58732070 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc251d3a740 10 client.0 _ll_register_callbacks cb 0x7fc23c007780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc249561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c587091b0 0x557c58b5b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc249561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c587091b0 0x557c58b5b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35834/0 (socket says 172.21.15.53:35834) 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc249561640 1 -- 172.21.15.53:0/1027089909 learned_addr learned my addr 172.21.15.53:0/1027089909 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc249d62640 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58aeb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.898+0000 7fc248d60640 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c58711390 0x557c58aead40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc249561640 1 -- 172.21.15.53:0/1027089909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 msgr2=0x557c58aeb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc249561640 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58aeb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc249561640 1 -- 172.21.15.53:0/1027089909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c58711390 msgr2=0x557c58aead40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:22.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc249561640 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c58711390 0x557c58aead40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc249561640 1 -- 172.21.15.53:0/1027089909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c58aeb990 con 0x557c587091b0 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc248d60640 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c58711390 0x557c58aead40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc249561640 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c587091b0 0x557c58b5b0d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fc240009900 tx=0x7fc240009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826c481b9c353bc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc22cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc22cff9640 1 -- 172.21.15.53:0/1027089909 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240035040 con 0x557c587091b0 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc22cff9640 1 -- 172.21.15.53:0/1027089909 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fc2400035f0 con 0x557c587091b0 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc251d3a740 1 -- 172.21.15.53:0/1027089909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc234016040 con 0x557c587091b0 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc22cff9640 1 -- 172.21.15.53:0/1027089909 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fc2400044d0 con 0x557c587091b0 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc251d3a740 10 client.18891 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.899+0000 7fc251d3a740 1 -- 172.21.15.53:0/1027089909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x557c58b63d10 con 0x557c587091b0 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.900+0000 7fc22cff9640 1 -- 172.21.15.53:0/1027089909 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc234016040 con 0x557c587091b0 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.900+0000 7fc22cff9640 1 -- 172.21.15.53:0/1027089909 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7fc240044040 con 0x557c587091b0 2024-08-31T06:15:22.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.900+0000 7fc251d3a740 10 client.18891 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:22.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.900+0000 7fc251d3a740 10 client.18891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:22.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.900+0000 7fc251d3a740 20 client.18891 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:22.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.900+0000 7fc251d3a740 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c586c5da0 0x557c58b66530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:22.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.900+0000 7fc251d3a740 4 client.18891 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:15:22.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.900+0000 7fc251d3a740 1 -- 172.21.15.53:0/1027089909 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c58a497b0 con 0x557c586c5da0 2024-08-31T06:15:22.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.900+0000 7fc248d60640 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c586c5da0 0x557c58b66530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:22.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc22cff9640 10 client.18891 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:22.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc248d60640 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c586c5da0 0x557c58b66530 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e1224f05a281c4b server_cookie=38fea4f148040012 in_seq=0 out_seq=0 2024-08-31T06:15:22.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc22cff9640 1 -- 172.21.15.53:0/1027089909 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c58a497b0 con 0x557c586c5da0 2024-08-31T06:15:22.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc22cff9640 10 client.18891 handle_command_reply: tid=0 2024-08-31T06:15:22.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc251d3a740 1 client.18891 shutdown 2024-08-31T06:15:22.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc251d3a740 1 -- 172.21.15.53:0/1027089909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c587091b0 msgr2=0x557c58b5b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:22.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc251d3a740 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c587091b0 0x557c58b5b0d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fc240009900 tx=0x7fc240009260 comp rx=0 tx=0).stop 2024-08-31T06:15:22.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc251d3a740 1 -- 172.21.15.53:0/1027089909 shutdown_connections 2024-08-31T06:15:22.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc251d3a740 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c586c5da0 0x557c58b66530 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc251d3a740 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c58732070 0x557c58aeb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc251d3a740 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c58711390 0x557c58aead40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc251d3a740 1 --2- 172.21.15.53:0/1027089909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c587091b0 0x557c58b5b0d0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc251d3a740 1 -- 172.21.15.53:0/1027089909 >> 172.21.15.53:0/1027089909 conn(0x557c58726460 msgr2=0x557c58ae0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:22.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc22cff9640 0 client.18891 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:22.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc251d3a740 1 -- 172.21.15.53:0/1027089909 shutdown_connections 2024-08-31T06:15:22.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.901+0000 7fc251d3a740 1 -- 172.21.15.53:0/1027089909 wait complete. 2024-08-31T06:15:22.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc251d3a740 20 client.18891 trim_cache size 0 max 16384 2024-08-31T06:15:22.908 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:15:22.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 -- 172.21.15.53:0/1405234078 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2300b4d50 msgr2=0x7fc2300b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:22.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2300b4d50 0x7fc2300b7260 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc24406c440 tx=0x7fc2400058d0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 -- 172.21.15.53:0/1405234078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc244108ab0 msgr2=0x7fc24419ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:22.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc244108ab0 0x7fc24419ba30 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00cad0 tx=0x7fc23c00cf90 comp rx=0 tx=0).stop 2024-08-31T06:15:22.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 -- 172.21.15.53:0/1405234078 shutdown_connections 2024-08-31T06:15:22.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2300b4d50 0x7fc2300b7260 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc244108ab0 0x7fc24419ba30 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc244108160 0x7fc24419b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 --2- 172.21.15.53:0/1405234078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244102820 0x7fc24419afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:22.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 -- 172.21.15.53:0/1405234078 >> 172.21.15.53:0/1405234078 conn(0x7fc2440794e0 msgr2=0x7fc244101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:22.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 -- 172.21.15.53:0/1405234078 shutdown_connections 2024-08-31T06:15:22.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:22.902+0000 7fc24b7c5640 1 -- 172.21.15.53:0/1405234078 wait complete. 2024-08-31T06:15:22.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:22 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:15:22.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.48 MB/sec execute 432 sec latency 4433.931 ms 2024-08-31T06:15:23.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:23 smithi130 ceph-mon[22266]: pgmap v646: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 441 KiB/s wr, 65 op/s 2024-08-31T06:15:23.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:23 smithi153 ceph-mon[22320]: pgmap v646: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 441 KiB/s wr, 65 op/s 2024-08-31T06:15:23.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:23 smithi053 ceph-mon[18924]: pgmap v646: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 441 KiB/s wr, 65 op/s 2024-08-31T06:15:23.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.48 MB/sec execute 433 sec latency 5434.027 ms 2024-08-31T06:15:24.578 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:15:24.579 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:15:24.847 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:24.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.47 MB/sec execute 434 sec latency 6434.101 ms 2024-08-31T06:15:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.486+0000 7fbee080f640 1 -- 172.21.15.53:0/3141372059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbedc108160 msgr2=0x7fbedc108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.486+0000 7fbee080f640 1 --2- 172.21.15.53:0/3141372059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbedc108160 0x7fbedc108570 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009900 tx=0x7fbed002a410 comp rx=0 tx=0).stop 2024-08-31T06:15:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.486+0000 7fbee080f640 1 -- 172.21.15.53:0/3141372059 shutdown_connections 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.486+0000 7fbee080f640 1 --2- 172.21.15.53:0/3141372059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbedc108ab0 0x7fbedc10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.486+0000 7fbee080f640 1 --2- 172.21.15.53:0/3141372059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbedc108160 0x7fbedc108570 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.486+0000 7fbee080f640 1 --2- 172.21.15.53:0/3141372059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbedc102820 0x7fbedc102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.486+0000 7fbee080f640 1 -- 172.21.15.53:0/3141372059 >> 172.21.15.53:0/3141372059 conn(0x7fbedc0794e0 msgr2=0x7fbedc0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.486+0000 7fbee080f640 1 -- 172.21.15.53:0/3141372059 shutdown_connections 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.486+0000 7fbee080f640 1 -- 172.21.15.53:0/3141372059 wait complete. 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.487+0000 7fbee080f640 1 Processor -- start 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.487+0000 7fbee080f640 1 -- start start 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbee080f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbedc102820 0x7fbedc10fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbee080f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbedc108160 0x7fbedc1102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbee080f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbedc108ab0 0x7fbedc1107f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbee080f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1136f0 con 0x7fbedc108160 2024-08-31T06:15:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbee080f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc113570 con 0x7fbedc108ab0 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbee080f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc113870 con 0x7fbedc102820 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbed9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbedc108160 0x7fbedc1102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbed9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbedc108160 0x7fbedc1102b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46236/0 (socket says 172.21.15.53:46236) 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbed9d9b640 1 -- 172.21.15.53:0/3619550998 learned_addr learned my addr 172.21.15.53:0/3619550998 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbeda59c640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbedc102820 0x7fbedc10fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbedad9d640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbedc108ab0 0x7fbedc1107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbed9d9b640 1 -- 172.21.15.53:0/3619550998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbedc102820 msgr2=0x7fbedc10fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbedc102820 0x7fbedc10fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbed9d9b640 1 -- 172.21.15.53:0/3619550998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbedc108ab0 msgr2=0x7fbedc1107f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbedc108ab0 0x7fbedc1107f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbed9d9b640 1 -- 172.21.15.53:0/3619550998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc1a8400 con 0x7fbedc108160 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbedc108160 0x7fbedc1102b0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fbed0005940 tx=0x7fbed0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.488+0000 7fbecb7fe640 1 -- 172.21.15.53:0/3619550998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed003f030 con 0x7fbedc108160 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.489+0000 7fbecb7fe640 1 -- 172.21.15.53:0/3619550998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbed0004440 con 0x7fbedc108160 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.489+0000 7fbee080f640 1 -- 172.21.15.53:0/3619550998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc1a8690 con 0x7fbedc108160 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.489+0000 7fbecb7fe640 1 -- 172.21.15.53:0/3619550998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0035070 con 0x7fbedc108160 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.489+0000 7fbee080f640 1 -- 172.21.15.53:0/3619550998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc1a8b70 con 0x7fbedc108160 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.491+0000 7fbee6d84740 1 Processor -- start 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.492+0000 7fbee6d84740 1 -- start start 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.492+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 0x564c99773780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.492+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 0x564c99773cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.492+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 0x564c99774200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.492+0000 7fbee6d84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564c996e95f0 con 0x564c993ac670 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.492+0000 7fbee6d84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564c996d8b80 con 0x564c993cd350 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.492+0000 7fbee6d84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564c996dcb30 con 0x564c993a4490 2024-08-31T06:15:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.492+0000 7fbedad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 0x564c99773780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.492+0000 7fbedad9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 0x564c99773780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51828/0 (socket says 172.21.15.53:51828) 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.492+0000 7fbedad9d640 1 -- 172.21.15.53:0/581988057 learned_addr learned my addr 172.21.15.53:0/581988057 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.492+0000 7fbecb7fe640 1 -- 172.21.15.53:0/3619550998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbed0042030 con 0x7fbedc108160 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.493+0000 7fbeda59c640 1 --2- 172.21.15.53:0/581988057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 0x564c99773cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.493+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/581988057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 0x564c99774200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.493+0000 7fbedad9d640 1 -- 172.21.15.53:0/581988057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 msgr2=0x564c99773cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.493+0000 7fbedad9d640 1 --2- 172.21.15.53:0/581988057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 0x564c99773cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.493+0000 7fbedad9d640 1 -- 172.21.15.53:0/581988057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 msgr2=0x564c99774200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.493+0000 7fbedad9d640 1 --2- 172.21.15.53:0/581988057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 0x564c99774200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.493+0000 7fbedad9d640 1 -- 172.21.15.53:0/581988057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c99438930 con 0x564c993cd350 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.493+0000 7fbeda59c640 1 --2- 172.21.15.53:0/581988057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 0x564c99773cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.493+0000 7fbedad9d640 1 --2- 172.21.15.53:0/581988057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 0x564c99773780 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbed4010370 tx=0x7fbed4010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0312a5c16f67f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.493+0000 7fbecb7fe640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbec40b4ca0 0x7fbec40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.494+0000 7fbeda59c640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbec40b4ca0 0x7fbec40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.494+0000 7fbec8ff9640 1 -- 172.21.15.53:0/581988057 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4016070 con 0x564c993cd350 2024-08-31T06:15:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.494+0000 7fbecb7fe640 1 -- 172.21.15.53:0/3619550998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fbed0105960 con 0x7fbedc108160 2024-08-31T06:15:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.494+0000 7fbec8ff9640 1 -- 172.21.15.53:0/581988057 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbed4004d20 con 0x564c993cd350 2024-08-31T06:15:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.494+0000 7fbec8ff9640 1 -- 172.21.15.53:0/581988057 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4005310 con 0x564c993cd350 2024-08-31T06:15:25.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.495+0000 7fbee6d84740 1 -- 172.21.15.53:0/581988057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 msgr2=0x564c99773780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:25.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.495+0000 7fbeda59c640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbec40b4ca0 0x7fbec40b71b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x564c99772400 tx=0x7fbecc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:25.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.495+0000 7fbee6d84740 1 --2- 172.21.15.53:0/581988057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 0x564c99773780 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbed4010370 tx=0x7fbed4010830 comp rx=0 tx=0).stop 2024-08-31T06:15:25.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.495+0000 7fbee6d84740 1 -- 172.21.15.53:0/581988057 shutdown_connections 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.495+0000 7fbee6d84740 1 --2- 172.21.15.53:0/581988057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 0x564c99774200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.495+0000 7fbee6d84740 1 --2- 172.21.15.53:0/581988057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 0x564c99773cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.495+0000 7fbee6d84740 1 --2- 172.21.15.53:0/581988057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 0x564c99773780 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.495+0000 7fbee6d84740 1 -- 172.21.15.53:0/581988057 >> 172.21.15.53:0/581988057 conn(0x564c993c1740 msgr2=0x564c99771670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.495+0000 7fbee6d84740 1 -- 172.21.15.53:0/581988057 shutdown_connections 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.495+0000 7fbee6d84740 1 -- 172.21.15.53:0/581988057 wait complete. 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.496+0000 7fbee6d84740 1 -- start start 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.496+0000 7fbee6d84740 1 Processor -- start 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.496+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993a4490 0x564c9977efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 0x564c9977f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993cd350 0x564c9978b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbee6d84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564c9953b890 con 0x564c993ac670 2024-08-31T06:15:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbee6d84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564c9965f790 con 0x564c993a4490 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbee6d84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564c99781f60 con 0x564c993cd350 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbed9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 0x564c9977f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbee6d84740 10 client.0 _ll_register_callbacks cb 0x564c993e4ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbed9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 0x564c9977f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46254/0 (socket says 172.21.15.53:46254) 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbed9d9b640 1 -- 172.21.15.53:0/3891102339 learned_addr learned my addr 172.21.15.53:0/3891102339 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbeda59c640 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993a4490 0x564c9977efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbedad9d640 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993cd350 0x564c9978b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbed9d9b640 1 -- 172.21.15.53:0/3891102339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993cd350 msgr2=0x564c9978b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993cd350 0x564c9978b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbed9d9b640 1 -- 172.21.15.53:0/3891102339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993a4490 msgr2=0x564c9977efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993a4490 0x564c9977efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbed9d9b640 1 -- 172.21.15.53:0/3891102339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c99696f30 con 0x564c993ac670 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 0x564c9977f5c0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fbed0000c00 tx=0x7fbed00092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2823404524148f6a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.497+0000 7fbec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbec1ffb640 1 -- 172.21.15.53:0/3891102339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0049070 con 0x564c993ac670 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbec1ffb640 1 -- 172.21.15.53:0/3891102339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fbed0003c80 con 0x564c993ac670 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbee6d84740 1 -- 172.21.15.53:0/3891102339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbed4004d20 con 0x564c993ac670 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbec1ffb640 1 -- 172.21.15.53:0/3891102339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbed00cba30 con 0x564c993ac670 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbee6d84740 10 client.18903 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbee6d84740 1 -- 172.21.15.53:0/3891102339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x564c9978de20 con 0x564c993ac670 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbec1ffb640 1 -- 172.21.15.53:0/3891102339 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbed4004d20 con 0x564c993ac670 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbec1ffb640 1 -- 172.21.15.53:0/3891102339 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7fbed00cc340 con 0x564c993ac670 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbee6d84740 10 client.18903 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbee6d84740 10 client.18903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbee6d84740 20 client.18903 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbee6d84740 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564c9938bcd0 0x564c99791470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbee6d84740 4 client.18903 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.498+0000 7fbee6d84740 1 -- 172.21.15.53:0/3891102339 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c996eb540 con 0x564c9938bcd0 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.499+0000 7fbeda59c640 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564c9938bcd0 0x564c99791470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.499+0000 7fbec1ffb640 10 client.18903 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.499+0000 7fbeda59c640 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564c9938bcd0 0x564c99791470 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73eb8f190c52e760 server_cookie=eb1704443bd9caef in_seq=0 out_seq=0 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbec1ffb640 1 -- 172.21.15.53:0/3891102339 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c996eb540 con 0x564c9938bcd0 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbec1ffb640 10 client.18903 handle_command_reply: tid=0 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbee6d84740 1 client.18903 shutdown 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbee6d84740 1 -- 172.21.15.53:0/3891102339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 msgr2=0x564c9977f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbee6d84740 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 0x564c9977f5c0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fbed0000c00 tx=0x7fbed00092d0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbee6d84740 1 -- 172.21.15.53:0/3891102339 shutdown_connections 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbee6d84740 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564c9938bcd0 0x564c99791470 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbec1ffb640 0 client.18903 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbee6d84740 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993cd350 0x564c9978b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbee6d84740 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993ac670 0x564c9977f5c0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbee6d84740 1 --2- 172.21.15.53:0/3891102339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993a4490 0x564c9977efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbee6d84740 1 -- 172.21.15.53:0/3891102339 >> 172.21.15.53:0/3891102339 conn(0x564c993c1740 msgr2=0x564c99776960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:25.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbee6d84740 1 -- 172.21.15.53:0/3891102339 shutdown_connections 2024-08-31T06:15:25.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.500+0000 7fbee6d84740 1 -- 172.21.15.53:0/3891102339 wait complete. 2024-08-31T06:15:25.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.501+0000 7fbee6d84740 20 client.18903 trim_cache size 0 max 16384 2024-08-31T06:15:25.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.519+0000 7fbee6d84740 1 Processor -- start 2024-08-31T06:15:25.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.519+0000 7fbee6d84740 1 -- start start 2024-08-31T06:15:25.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.519+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 0x564c99776f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.519+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993ac670 0x564c9978b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.519+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993cd350 0x564c9978b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.519+0000 7fbee6d84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1b1670 con 0x564c993cd350 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.519+0000 7fbee6d84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1b33c0 con 0x564c993ac670 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.519+0000 7fbee6d84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1b1d40 con 0x564c993a4490 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.519+0000 7fbedad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993cd350 0x564c9978b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbedad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993cd350 0x564c9978b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46270/0 (socket says 172.21.15.53:46270) 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbedad9d640 1 -- 172.21.15.53:0/3287624952 learned_addr learned my addr 172.21.15.53:0/3287624952 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/3287624952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993ac670 0x564c9978b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbeda59c640 1 --2- 172.21.15.53:0/3287624952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 0x564c99776f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbedad9d640 1 -- 172.21.15.53:0/3287624952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 msgr2=0x564c99776f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbedad9d640 1 --2- 172.21.15.53:0/3287624952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 0x564c99776f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbedad9d640 1 -- 172.21.15.53:0/3287624952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993ac670 msgr2=0x564c9978b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:25.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbedad9d640 1 --2- 172.21.15.53:0/3287624952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993ac670 0x564c9978b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbedad9d640 1 -- 172.21.15.53:0/3287624952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c9977fcd0 con 0x564c993cd350 2024-08-31T06:15:25.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbeda59c640 1 --2- 172.21.15.53:0/3287624952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 0x564c99776f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:15:25.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/3287624952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993ac670 0x564c9978b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:25.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbedad9d640 1 --2- 172.21.15.53:0/3287624952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993cd350 0x564c9978b690 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fbed4010370 tx=0x7fbed4005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f2db610678d8f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:25.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbec3fff640 1 -- 172.21.15.53:0/3287624952 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed402a070 con 0x564c993cd350 2024-08-31T06:15:25.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbec3fff640 1 -- 172.21.15.53:0/3287624952 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbed4004dc0 con 0x564c993cd350 2024-08-31T06:15:25.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.520+0000 7fbec3fff640 1 -- 172.21.15.53:0/3287624952 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4016070 con 0x564c993cd350 2024-08-31T06:15:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.521+0000 7fbee6d84740 1 -- 172.21.15.53:0/3287624952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993cd350 msgr2=0x564c9978b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.521+0000 7fbee6d84740 1 --2- 172.21.15.53:0/3287624952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993cd350 0x564c9978b690 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fbed4010370 tx=0x7fbed4005c70 comp rx=0 tx=0).stop 2024-08-31T06:15:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.521+0000 7fbee6d84740 1 -- 172.21.15.53:0/3287624952 shutdown_connections 2024-08-31T06:15:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.521+0000 7fbee6d84740 1 --2- 172.21.15.53:0/3287624952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993cd350 0x564c9978b690 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.521+0000 7fbee6d84740 1 --2- 172.21.15.53:0/3287624952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993ac670 0x564c9978b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.521+0000 7fbee6d84740 1 --2- 172.21.15.53:0/3287624952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993a4490 0x564c99776f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.521+0000 7fbee6d84740 1 -- 172.21.15.53:0/3287624952 >> 172.21.15.53:0/3287624952 conn(0x564c993c1740 msgr2=0x564c99776880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.521+0000 7fbee6d84740 1 -- 172.21.15.53:0/3287624952 shutdown_connections 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.521+0000 7fbee6d84740 1 -- 172.21.15.53:0/3287624952 wait complete. 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbee6d84740 1 -- start start 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbee6d84740 1 Processor -- start 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993a4490 0x564c997876b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993ac670 0x564c99783bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbee6d84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 0x564c99784100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbee6d84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1b2c30 con 0x564c993a4490 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbee6d84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1b24d0 con 0x564c993cd350 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbee6d84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1af670 con 0x564c993ac670 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbee6d84740 10 client.0 _ll_register_callbacks cb 0x7fbed0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbeda59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993a4490 0x564c997876b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbeda59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993a4490 0x564c997876b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46278/0 (socket says 172.21.15.53:46278) 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.522+0000 7fbeda59c640 1 -- 172.21.15.53:0/1194725536 learned_addr learned my addr 172.21.15.53:0/1194725536 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993ac670 0x564c99783bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbedad9d640 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 0x564c99784100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbeda59c640 1 -- 172.21.15.53:0/1194725536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993ac670 msgr2=0x564c99783bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbeda59c640 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993ac670 0x564c99783bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbeda59c640 1 -- 172.21.15.53:0/1194725536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 msgr2=0x564c99784100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbeda59c640 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 0x564c99784100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbeda59c640 1 -- 172.21.15.53:0/1194725536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c99784640 con 0x564c993a4490 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbeda59c640 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993a4490 0x564c997876b0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fbecc01d540 tx=0x7fbecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddebf4f0648f5325 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbec1ffb640 1 -- 172.21.15.53:0/1194725536 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc01de40 con 0x564c993a4490 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbec1ffb640 1 -- 172.21.15.53:0/1194725536 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fbecc02a410 con 0x564c993a4490 2024-08-31T06:15:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbee6d84740 1 -- 172.21.15.53:0/1194725536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbed4004dc0 con 0x564c993a4490 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbec1ffb640 1 -- 172.21.15.53:0/1194725536 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbecc02a610 con 0x564c993a4490 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbee6d84740 10 client.18909 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbee6d84740 1 -- 172.21.15.53:0/1194725536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x564c997fcad0 con 0x564c993a4490 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.523+0000 7fbec1ffb640 1 -- 172.21.15.53:0/1194725536 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbed4004dc0 con 0x564c993a4490 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.524+0000 7fbec1ffb640 1 -- 172.21.15.53:0/1194725536 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7fbecc02f030 con 0x564c993a4490 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.524+0000 7fbee6d84740 10 client.18909 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.524+0000 7fbee6d84740 10 client.18909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.524+0000 7fbee6d84740 20 client.18909 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.524+0000 7fbee6d84740 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564c99361080 0x564c997ff330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.524+0000 7fbee6d84740 4 client.18909 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.524+0000 7fbee6d84740 1 -- 172.21.15.53:0/1194725536 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564c996e6fe0 con 0x564c99361080 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.524+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564c99361080 0x564c997ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.524+0000 7fbec1ffb640 10 client.18909 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.524+0000 7fbed9d9b640 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564c99361080 0x564c997ff330 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856e8c1fa3aaf404 server_cookie=4f911fe0c344b241 in_seq=0 out_seq=0 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbec1ffb640 1 -- 172.21.15.53:0/1194725536 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564c996e6fe0 con 0x564c99361080 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbec1ffb640 10 client.18909 handle_command_reply: tid=0 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbee6d84740 1 client.18909 shutdown 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbee6d84740 1 -- 172.21.15.53:0/1194725536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993a4490 msgr2=0x564c997876b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbee6d84740 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993a4490 0x564c997876b0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fbecc01d540 tx=0x7fbecc0046c0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbee6d84740 1 -- 172.21.15.53:0/1194725536 shutdown_connections 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbee6d84740 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564c99361080 0x564c997ff330 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbee6d84740 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c993cd350 0x564c99784100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbee6d84740 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c993ac670 0x564c99783bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbee6d84740 1 --2- 172.21.15.53:0/1194725536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c993a4490 0x564c997876b0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbee6d84740 1 -- 172.21.15.53:0/1194725536 >> 172.21.15.53:0/1194725536 conn(0x564c993c1740 msgr2=0x564c99771640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbec1ffb640 0 client.18909 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:25.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.525+0000 7fbee6d84740 1 -- 172.21.15.53:0/1194725536 shutdown_connections 2024-08-31T06:15:25.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee6d84740 1 -- 172.21.15.53:0/1194725536 wait complete. 2024-08-31T06:15:25.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee6d84740 20 client.18909 trim_cache size 0 max 16384 2024-08-31T06:15:25.535 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:15:25.535 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:15:25.535 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61", 2024-08-31T06:15:25.535 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:15:25.535 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:15:25.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee080f640 1 -- 172.21.15.53:0/3619550998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbec40b4ca0 msgr2=0x7fbec40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:25.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee080f640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbec40b4ca0 0x7fbec40b71b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x564c99772400 tx=0x7fbecc005f90 comp rx=0 tx=0).stop 2024-08-31T06:15:25.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee080f640 1 -- 172.21.15.53:0/3619550998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbedc108160 msgr2=0x7fbedc1102b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:25.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee080f640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbedc108160 0x7fbedc1102b0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fbed0005940 tx=0x7fbed0004040 comp rx=0 tx=0).stop 2024-08-31T06:15:25.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee080f640 1 -- 172.21.15.53:0/3619550998 shutdown_connections 2024-08-31T06:15:25.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee080f640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbec40b4ca0 0x7fbec40b71b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee080f640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbedc108ab0 0x7fbedc1107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee080f640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbedc108160 0x7fbedc1102b0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee080f640 1 --2- 172.21.15.53:0/3619550998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbedc102820 0x7fbedc10fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:25.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee080f640 1 -- 172.21.15.53:0/3619550998 >> 172.21.15.53:0/3619550998 conn(0x7fbedc0794e0 msgr2=0x7fbedc1050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:25.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.526+0000 7fbee080f640 1 -- 172.21.15.53:0/3619550998 shutdown_connections 2024-08-31T06:15:25.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:25.527+0000 7fbee080f640 1 -- 172.21.15.53:0/3619550998 wait complete. 2024-08-31T06:15:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:25 smithi153 ceph-mon[22320]: pgmap v647: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 376 KiB/s wr, 59 op/s 2024-08-31T06:15:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:25 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:15:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:25 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:25 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:15:25.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:25 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:25 smithi053 ceph-mon[18924]: pgmap v647: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 376 KiB/s wr, 59 op/s 2024-08-31T06:15:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:25 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:15:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:25 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:25 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:15:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:25 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:25.992 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.47 MB/sec execute 435 sec latency 7434.162 ms 2024-08-31T06:15:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:25 smithi130 ceph-mon[22266]: pgmap v647: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 376 KiB/s wr, 59 op/s 2024-08-31T06:15:26.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:25 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:15:26.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:25 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:25 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:15:26.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:25 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:15:26.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:15:26.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:15:26.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:15:26.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:15:26.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:15:26.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:15:26.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:15:26.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:26 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:15:26.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:15:26.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:26 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:26.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.47 MB/sec execute 436 sec latency 8434.278 ms 2024-08-31T06:15:27.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:15:27.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:27.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:15:27.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:26 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:15:27.285 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:15:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:27.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:27 smithi153 ceph-mon[22320]: pgmap v648: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 319 KiB/s wr, 52 op/s 2024-08-31T06:15:27.955 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:27 smithi053 ceph-mon[18924]: pgmap v648: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 319 KiB/s wr, 52 op/s 2024-08-31T06:15:27.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.46 MB/sec execute 437 sec latency 9434.345 ms 2024-08-31T06:15:28.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.045+0000 7f66f72c7640 1 -- 172.21.15.53:0/426273057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f0109b90 msgr2=0x7f66f01103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:28.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.045+0000 7f66f72c7640 1 --2- 172.21.15.53:0/426273057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f0109b90 0x7f66f01103c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009ca0 tx=0x7f66e802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.045+0000 7f66f72c7640 1 -- 172.21.15.53:0/426273057 shutdown_connections 2024-08-31T06:15:28.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.045+0000 7f66f72c7640 1 --2- 172.21.15.53:0/426273057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f0109b90 0x7f66f01103c0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.045+0000 7f66f72c7640 1 --2- 172.21.15.53:0/426273057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f0109240 0x7f66f0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.045+0000 7f66f72c7640 1 --2- 172.21.15.53:0/426273057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66f0103900 0x7f66f0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.045+0000 7f66f72c7640 1 -- 172.21.15.53:0/426273057 >> 172.21.15.53:0/426273057 conn(0x7f66f007b5f0 msgr2=0x7f66f007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:28.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.045+0000 7f66f72c7640 1 -- 172.21.15.53:0/426273057 shutdown_connections 2024-08-31T06:15:28.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.045+0000 7f66f72c7640 1 -- 172.21.15.53:0/426273057 wait complete. 2024-08-31T06:15:28.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f72c7640 1 Processor -- start 2024-08-31T06:15:28.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f72c7640 1 -- start start 2024-08-31T06:15:28.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f72c7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f0103900 0x7f66f00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f72c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f0109240 0x7f66f00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f72c7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66f0109b90 0x7f66f0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f72c7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f66f0113750 con 0x7f66f0109240 2024-08-31T06:15:28.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f72c7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66f01135d0 con 0x7f66f0109b90 2024-08-31T06:15:28.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f72c7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66f01138d0 con 0x7f66f0103900 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f4862640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f0109240 0x7f66f00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f4862640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f0109240 0x7f66f00759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46296/0 (socket says 172.21.15.53:46296) 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f4862640 1 -- 172.21.15.53:0/2145491341 learned_addr learned my addr 172.21.15.53:0/2145491341 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.046+0000 7f66f5063640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f0103900 0x7f66f00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66f5864640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66f0109b90 0x7f66f0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66f4862640 1 -- 172.21.15.53:0/2145491341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f0103900 msgr2=0x7f66f00754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66f4862640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f0103900 0x7f66f00754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66f4862640 1 -- 172.21.15.53:0/2145491341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66f0109b90 msgr2=0x7f66f0075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66f4862640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66f0109b90 0x7f66f0075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66f4862640 1 -- 172.21.15.53:0/2145491341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f01a8520 con 0x7f66f0109240 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66f5864640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66f0109b90 0x7f66f0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66f4862640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f0109240 0x7f66f00759f0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f66e000d750 tx=0x7f66e000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66e67fc640 1 -- 172.21.15.53:0/2145491341 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0017070 con 0x7f66f0109240 2024-08-31T06:15:28.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66f72c7640 1 -- 172.21.15.53:0/2145491341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f01a8810 con 0x7f66f0109240 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66e67fc640 1 -- 172.21.15.53:0/2145491341 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66e00054b0 con 0x7f66f0109240 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66e67fc640 1 -- 172.21.15.53:0/2145491341 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0004bc0 con 0x7f66f0109240 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.047+0000 7f66f72c7640 1 -- 172.21.15.53:0/2145491341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f01a8d00 con 0x7f66f0109240 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.050+0000 7f66fd83c740 1 Processor -- start 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.050+0000 7f66fd83c740 1 -- start start 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66e67fc640 1 -- 172.21.15.53:0/2145491341 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f66e0009c30 con 0x7f66f0109240 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db102c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d7421b0 0x55fb4db10800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d74a390 0x55fb4db10d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66fd83c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fb4da87630 con 0x55fb4d76b070 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66fd83c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fb4da76bc0 con 0x55fb4d74a390 2024-08-31T06:15:28.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66fd83c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fb4da7ab70 con 0x55fb4d7421b0 2024-08-31T06:15:28.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66f5864640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66f5864640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db102c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46300/0 (socket says 172.21.15.53:46300) 2024-08-31T06:15:28.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66f5864640 1 -- 172.21.15.53:0/159177695 learned_addr learned my addr 172.21.15.53:0/159177695 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:28.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66f4862640 1 --2- 172.21.15.53:0/159177695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d74a390 0x55fb4db10d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66f5063640 1 --2- 172.21.15.53:0/159177695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d7421b0 0x55fb4db10800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66f5864640 1 -- 172.21.15.53:0/159177695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d7421b0 msgr2=0x55fb4db10800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:28.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66f5864640 1 --2- 172.21.15.53:0/159177695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d7421b0 0x55fb4db10800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66f5864640 1 -- 172.21.15.53:0/159177695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d74a390 msgr2=0x55fb4db10d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:28.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66f5864640 1 --2- 172.21.15.53:0/159177695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d74a390 0x55fb4db10d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66f5864640 1 -- 172.21.15.53:0/159177695 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb4d7d6650 con 0x55fb4d76b070 2024-08-31T06:15:28.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.051+0000 7f66f4862640 1 --2- 172.21.15.53:0/159177695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d74a390 0x55fb4db10d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.052+0000 7f66e67fc640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66dc0b4ca0 0x7f66dc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.052+0000 7f66f5864640 1 --2- 172.21.15.53:0/159177695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db102c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f66e8031500 tx=0x7f66e8031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fe1833efd83d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.052+0000 7f66f5063640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66dc0b4ca0 0x7f66dc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.052+0000 7f66e67fc640 1 -- 172.21.15.53:0/2145491341 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f66e00e4f10 con 0x7f66f0109240 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.052+0000 7f66db7fe640 1 -- 172.21.15.53:0/159177695 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8031980 con 0x55fb4d76b070 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.052+0000 7f66db7fe640 1 -- 172.21.15.53:0/159177695 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66e8036070 con 0x55fb4d76b070 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.052+0000 7f66db7fe640 1 -- 172.21.15.53:0/159177695 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8004510 con 0x55fb4d76b070 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66fd83c740 1 -- 172.21.15.53:0/159177695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 msgr2=0x55fb4db102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66f5063640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66dc0b4ca0 0x7f66dc0b71b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x55fb4db0ef40 tx=0x7f66ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66fd83c740 1 --2- 172.21.15.53:0/159177695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db102c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f66e8031500 tx=0x7f66e8031530 comp rx=0 tx=0).stop 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66fd83c740 1 -- 172.21.15.53:0/159177695 shutdown_connections 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66fd83c740 1 --2- 172.21.15.53:0/159177695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d74a390 0x55fb4db10d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66fd83c740 1 --2- 172.21.15.53:0/159177695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d7421b0 0x55fb4db10800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66fd83c740 1 --2- 172.21.15.53:0/159177695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db102c0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66fd83c740 1 -- 172.21.15.53:0/159177695 >> 172.21.15.53:0/159177695 conn(0x55fb4d75f460 msgr2=0x55fb4db0e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66fd83c740 1 -- 172.21.15.53:0/159177695 shutdown_connections 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66fd83c740 1 -- 172.21.15.53:0/159177695 wait complete. 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66fd83c740 1 -- start start 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.053+0000 7f66fd83c740 1 Processor -- start 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d7421b0 0x55fb4db1ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db1bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db27d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66fd83c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fb4d8d9700 con 0x55fb4d76b070 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66fd83c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fb4d9fd700 con 0x55fb4d7421b0 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66fd83c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fb4db1ea40 con 0x55fb4d74a390 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66fd83c740 10 client.0 _ll_register_callbacks cb 0x55fb4da2cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:28.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66f5864640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db27d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66f5864640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db27d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46312/0 (socket says 172.21.15.53:46312) 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66f5864640 1 -- 172.21.15.53:0/1925890770 learned_addr learned my addr 172.21.15.53:0/1925890770 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66f4862640 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db1bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66f5063640 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d7421b0 0x55fb4db1ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66f5864640 1 -- 172.21.15.53:0/1925890770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 msgr2=0x55fb4db1bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66f5864640 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db1bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66f5864640 1 -- 172.21.15.53:0/1925890770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d7421b0 msgr2=0x55fb4db1ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66f5864640 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d7421b0 0x55fb4db1ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.054+0000 7f66f5864640 1 -- 172.21.15.53:0/1925890770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb4da368b0 con 0x55fb4d76b070 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66f5864640 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db27d30 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f66e80040d0 tx=0x7f66e8031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47831f4a44eb3957 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1925890770 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8049040 con 0x55fb4d76b070 2024-08-31T06:15:28.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1925890770 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f66e8003cb0 con 0x55fb4d76b070 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66fd83c740 1 -- 172.21.15.53:0/1925890770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66e8036070 con 0x55fb4d76b070 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1925890770 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f66e805b050 con 0x55fb4d76b070 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66fd83c740 10 client.18921 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66fd83c740 1 -- 172.21.15.53:0/1925890770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55fb4db2a870 con 0x55fb4d76b070 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1925890770 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66e8036070 con 0x55fb4d76b070 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1925890770 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7f66e804c070 con 0x55fb4d76b070 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66fd83c740 10 client.18921 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66fd83c740 10 client.18921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66fd83c740 20 client.18921 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66fd83c740 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fb4d7299f0 0x55fb4db2dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66fd83c740 4 client.18921 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:28.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.055+0000 7f66fd83c740 1 -- 172.21.15.53:0/1925890770 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb4da89580 con 0x55fb4d7299f0 2024-08-31T06:15:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.056+0000 7f66f5063640 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fb4d7299f0 0x55fb4db2dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.056+0000 7f66d8ff9640 10 client.18921 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.056+0000 7f66f5063640 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fb4d7299f0 0x55fb4db2dbd0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cf2ce533dc4ce65 server_cookie=dad4903c874417f1 in_seq=0 out_seq=0 2024-08-31T06:15:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1925890770 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb4da89580 con 0x55fb4d7299f0 2024-08-31T06:15:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66d8ff9640 10 client.18921 handle_command_reply: tid=0 2024-08-31T06:15:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66fd83c740 1 client.18921 shutdown 2024-08-31T06:15:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66fd83c740 1 -- 172.21.15.53:0/1925890770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 msgr2=0x55fb4db27d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66fd83c740 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db27d30 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f66e80040d0 tx=0x7f66e8031750 comp rx=0 tx=0).stop 2024-08-31T06:15:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66fd83c740 1 -- 172.21.15.53:0/1925890770 shutdown_connections 2024-08-31T06:15:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66fd83c740 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fb4d7299f0 0x55fb4db2dbd0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66fd83c740 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db27d30 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66fd83c740 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db1bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66fd83c740 1 --2- 172.21.15.53:0/1925890770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d7421b0 0x55fb4db1ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66fd83c740 1 -- 172.21.15.53:0/1925890770 >> 172.21.15.53:0/1925890770 conn(0x55fb4d75f460 msgr2=0x55fb4db134a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.057+0000 7f66d8ff9640 0 client.18921 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.058+0000 7f66fd83c740 1 -- 172.21.15.53:0/1925890770 shutdown_connections 2024-08-31T06:15:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.058+0000 7f66fd83c740 1 -- 172.21.15.53:0/1925890770 wait complete. 2024-08-31T06:15:28.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.058+0000 7f66fd83c740 20 client.18921 trim_cache size 0 max 16384 2024-08-31T06:15:28.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.075+0000 7f66fd83c740 1 Processor -- start 2024-08-31T06:15:28.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.075+0000 7f66fd83c740 1 -- start start 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d7421b0 0x55fb4db1bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db133c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db13900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66fd83c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f66f01b1720 con 0x55fb4d76b070 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66fd83c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66f01b3470 con 0x55fb4d7421b0 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66fd83c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66f01b1df0 con 0x55fb4d74a390 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66f5864640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db13900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66f5864640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db13900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46314/0 (socket says 172.21.15.53:46314) 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66f5864640 1 -- 172.21.15.53:0/2196199993 learned_addr learned my addr 172.21.15.53:0/2196199993 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66f5063640 1 --2- 172.21.15.53:0/2196199993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d7421b0 0x55fb4db1bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66f4862640 1 --2- 172.21.15.53:0/2196199993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66f5864640 1 -- 172.21.15.53:0/2196199993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 msgr2=0x55fb4db133c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66f5864640 1 --2- 172.21.15.53:0/2196199993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66f5864640 1 -- 172.21.15.53:0/2196199993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d7421b0 msgr2=0x55fb4db1bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66f5864640 1 --2- 172.21.15.53:0/2196199993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d7421b0 0x55fb4db1bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66f5864640 1 -- 172.21.15.53:0/2196199993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb4db09550 con 0x55fb4d76b070 2024-08-31T06:15:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66f5864640 1 --2- 172.21.15.53:0/2196199993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db13900 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f66e802ade0 tx=0x7f66e8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd43913cc9131dd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66daffd640 1 -- 172.21.15.53:0/2196199993 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8031450 con 0x55fb4d76b070 2024-08-31T06:15:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66daffd640 1 -- 172.21.15.53:0/2196199993 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66e8036070 con 0x55fb4d76b070 2024-08-31T06:15:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.076+0000 7f66daffd640 1 -- 172.21.15.53:0/2196199993 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8004570 con 0x55fb4d76b070 2024-08-31T06:15:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.077+0000 7f66fd83c740 1 -- 172.21.15.53:0/2196199993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 msgr2=0x55fb4db13900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.077+0000 7f66fd83c740 1 --2- 172.21.15.53:0/2196199993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db13900 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f66e802ade0 tx=0x7f66e8009a20 comp rx=0 tx=0).stop 2024-08-31T06:15:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.077+0000 7f66fd83c740 1 -- 172.21.15.53:0/2196199993 shutdown_connections 2024-08-31T06:15:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.077+0000 7f66fd83c740 1 --2- 172.21.15.53:0/2196199993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d76b070 0x55fb4db13900 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.077+0000 7f66fd83c740 1 --2- 172.21.15.53:0/2196199993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db133c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.077+0000 7f66fd83c740 1 --2- 172.21.15.53:0/2196199993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d7421b0 0x55fb4db1bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.077+0000 7f66fd83c740 1 -- 172.21.15.53:0/2196199993 >> 172.21.15.53:0/2196199993 conn(0x55fb4d75f460 msgr2=0x55fb4db1b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.077+0000 7f66fd83c740 1 -- 172.21.15.53:0/2196199993 shutdown_connections 2024-08-31T06:15:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.077+0000 7f66fd83c740 1 -- 172.21.15.53:0/2196199993 wait complete. 2024-08-31T06:15:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66fd83c740 1 -- start start 2024-08-31T06:15:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66fd83c740 1 Processor -- start 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d7421b0 0x55fb4db2f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db2fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66fd83c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d76b070 0x55fb4db91390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66fd83c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f66f01b2ce0 con 0x55fb4d7421b0 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66fd83c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66f01b2580 con 0x55fb4d76b070 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66fd83c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66f01af720 con 0x55fb4d74a390 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66fd83c740 10 client.0 _ll_register_callbacks cb 0x7f66ec00a5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66f5063640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d7421b0 0x55fb4db2f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66f5063640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d7421b0 0x55fb4db2f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46324/0 (socket says 172.21.15.53:46324) 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66f5063640 1 -- 172.21.15.53:0/3471394567 learned_addr learned my addr 172.21.15.53:0/3471394567 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.078+0000 7f66f5864640 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d76b070 0x55fb4db91390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66f4862640 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db2fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66f5063640 1 -- 172.21.15.53:0/3471394567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 msgr2=0x55fb4db2fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66f5063640 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db2fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66f5063640 1 -- 172.21.15.53:0/3471394567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d76b070 msgr2=0x55fb4db91390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66f5063640 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d76b070 0x55fb4db91390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66f5063640 1 -- 172.21.15.53:0/3471394567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb4db91a00 con 0x55fb4d7421b0 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66f5864640 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d76b070 0x55fb4db91390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66f5063640 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d7421b0 0x55fb4db2f570 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x55fb4db1e2e0 tx=0x7f66ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1f428c96196c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66d8ff9640 1 -- 172.21.15.53:0/3471394567 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec02a040 con 0x55fb4d7421b0 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66d8ff9640 1 -- 172.21.15.53:0/3471394567 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f66ec01bce0 con 0x55fb4d7421b0 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66fd83c740 1 -- 172.21.15.53:0/3471394567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66e8036070 con 0x55fb4d7421b0 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66d8ff9640 1 -- 172.21.15.53:0/3471394567 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f66ec004020 con 0x55fb4d7421b0 2024-08-31T06:15:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66fd83c740 10 client.18927 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66fd83c740 1 -- 172.21.15.53:0/3471394567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55fb4db98de0 con 0x55fb4d7421b0 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.079+0000 7f66d8ff9640 1 -- 172.21.15.53:0/3471394567 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66e8036070 con 0x55fb4d7421b0 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.080+0000 7f66d8ff9640 1 -- 172.21.15.53:0/3471394567 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7f66ec028430 con 0x55fb4d7421b0 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.080+0000 7f66fd83c740 10 client.18927 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.080+0000 7f66fd83c740 10 client.18927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.080+0000 7f66fd83c740 20 client.18927 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.080+0000 7f66fd83c740 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fb4d6feda0 0x55fb4db9b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.080+0000 7f66fd83c740 4 client.18927 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.080+0000 7f66fd83c740 1 -- 172.21.15.53:0/3471394567 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fb4db28550 con 0x55fb4d6feda0 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.080+0000 7f66f4862640 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fb4d6feda0 0x55fb4db9b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.080+0000 7f66f4862640 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fb4d6feda0 0x55fb4db9b690 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5dd33b6836ac21d server_cookie=4a2f7f7dbff96578 in_seq=0 out_seq=0 2024-08-31T06:15:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.080+0000 7f66d8ff9640 10 client.18927 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66d8ff9640 1 -- 172.21.15.53:0/3471394567 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x55fb4db28550 con 0x55fb4d6feda0 2024-08-31T06:15:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66d8ff9640 10 client.18927 handle_command_reply: tid=0 2024-08-31T06:15:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 1 client.18927 shutdown 2024-08-31T06:15:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 1 -- 172.21.15.53:0/3471394567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d7421b0 msgr2=0x55fb4db2f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d7421b0 0x55fb4db2f570 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x55fb4db1e2e0 tx=0x7f66ec0046c0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 1 -- 172.21.15.53:0/3471394567 shutdown_connections 2024-08-31T06:15:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fb4d6feda0 0x55fb4db9b690 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fb4d76b070 0x55fb4db91390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb4d74a390 0x55fb4db2fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 1 --2- 172.21.15.53:0/3471394567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb4d7421b0 0x55fb4db2f570 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 1 -- 172.21.15.53:0/3471394567 >> 172.21.15.53:0/3471394567 conn(0x55fb4d75f460 msgr2=0x55fb4db133c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:28.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66d8ff9640 0 client.18927 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:28.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 1 -- 172.21.15.53:0/3471394567 shutdown_connections 2024-08-31T06:15:28.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 1 -- 172.21.15.53:0/3471394567 wait complete. 2024-08-31T06:15:28.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.081+0000 7f66fd83c740 20 client.18927 trim_cache size 0 max 16384 2024-08-31T06:15:28.089 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:15:28.089 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:15:28.089 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:15:28.089 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:15:28.089 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61", 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.091 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:15:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.093 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.094 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.094 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:15:28.094 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:15:28.094 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.094 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.094 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.094 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.094 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.094 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:15:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:15:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:15:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:15:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.095 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:15:28.098 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:15:28.099 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:28.099 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:28.099 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:28.099 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:28.099 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:28.099 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:28.099 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:28.099 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:15:28.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 -- 172.21.15.53:0/2145491341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66dc0b4ca0 msgr2=0x7f66dc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:28.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66dc0b4ca0 0x7f66dc0b71b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x55fb4db0ef40 tx=0x7f66ec00a2d0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 -- 172.21.15.53:0/2145491341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f0109240 msgr2=0x7f66f00759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:28.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f0109240 0x7f66f00759f0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f66e000d750 tx=0x7f66e000dc10 comp rx=0 tx=0).stop 2024-08-31T06:15:28.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 -- 172.21.15.53:0/2145491341 shutdown_connections 2024-08-31T06:15:28.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66dc0b4ca0 0x7f66dc0b71b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66f0109b90 0x7f66f0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f0109240 0x7f66f00759f0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 --2- 172.21.15.53:0/2145491341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f0103900 0x7f66f00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:28.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 -- 172.21.15.53:0/2145491341 >> 172.21.15.53:0/2145491341 conn(0x7f66f007b5f0 msgr2=0x7f66f0107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 -- 172.21.15.53:0/2145491341 shutdown_connections 2024-08-31T06:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:28.082+0000 7f66f72c7640 1 -- 172.21.15.53:0/2145491341 wait complete. 2024-08-31T06:15:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:27 smithi130 ceph-mon[22266]: pgmap v648: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 319 KiB/s wr, 52 op/s 2024-08-31T06:15:28.907 INFO:tasks.cephfs.filesystem:scrub status for tag:abd92b8d-89e2-4a96-b2e5-c9a89ac76d61 - {'path': '/', 'tag': 'abd92b8d-89e2-4a96-b2e5-c9a89ac76d61', 'options': 'recursive,force'} 2024-08-31T06:15:28.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.46 MB/sec execute 438 sec latency 10434.391 ms 2024-08-31T06:15:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:29 smithi153 ceph-mon[22320]: pgmap v649: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 320 KiB/s wr, 54 op/s 2024-08-31T06:15:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:29 smithi053 ceph-mon[18924]: pgmap v649: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 320 KiB/s wr, 54 op/s 2024-08-31T06:15:29.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.46 MB/sec execute 439 sec latency 11434.430 ms 2024-08-31T06:15:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:29 smithi130 ceph-mon[22266]: pgmap v649: 97 pgs: 97 active+clean; 97 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 320 KiB/s wr, 54 op/s 2024-08-31T06:15:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.939+0000 7efc81b62640 1 -- 172.21.15.53:0/2183552778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc7c102750 msgr2=0x7efc7c102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.939+0000 7efc81b62640 1 --2- 172.21.15.53:0/2183552778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc7c102750 0x7efc7c102b60 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009900 tx=0x7efc6c02a410 comp rx=0 tx=0).stop 2024-08-31T06:15:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.939+0000 7efc81b62640 1 -- 172.21.15.53:0/2183552778 shutdown_connections 2024-08-31T06:15:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.939+0000 7efc81b62640 1 --2- 172.21.15.53:0/2183552778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c1089d0 0x7efc7c10f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.939+0000 7efc81b62640 1 --2- 172.21.15.53:0/2183552778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc7c108080 0x7efc7c108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.939+0000 7efc81b62640 1 --2- 172.21.15.53:0/2183552778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc7c102750 0x7efc7c102b60 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.939+0000 7efc81b62640 1 -- 172.21.15.53:0/2183552778 >> 172.21.15.53:0/2183552778 conn(0x7efc7c07a4e0 msgr2=0x7efc7c07a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.939+0000 7efc81b62640 1 -- 172.21.15.53:0/2183552778 shutdown_connections 2024-08-31T06:15:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.939+0000 7efc81b62640 1 -- 172.21.15.53:0/2183552778 wait complete. 2024-08-31T06:15:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.940+0000 7efc81b62640 1 Processor -- start 2024-08-31T06:15:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.940+0000 7efc81b62640 1 -- start start 2024-08-31T06:15:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc81b62640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc7c102750 0x7efc7c19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc81b62640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c108080 0x7efc7c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc81b62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc7c1089d0 0x7efc7c19f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc81b62640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c113660 con 0x7efc7c1089d0 2024-08-31T06:15:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc81b62640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1134e0 con 0x7efc7c102750 2024-08-31T06:15:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc81b62640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1137e0 con 0x7efc7c108080 2024-08-31T06:15:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc7c1089d0 0x7efc7c19f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc7c1089d0 0x7efc7c19f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46332/0 (socket says 172.21.15.53:46332) 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc7bfff640 1 -- 172.21.15.53:0/1658019203 learned_addr learned my addr 172.21.15.53:0/1658019203 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc73fff640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c108080 0x7efc7c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc7b7fe640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc7c102750 0x7efc7c19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc7bfff640 1 -- 172.21.15.53:0/1658019203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c108080 msgr2=0x7efc7c19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc7bfff640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c108080 0x7efc7c19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc7bfff640 1 -- 172.21.15.53:0/1658019203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc7c102750 msgr2=0x7efc7c19a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc7bfff640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc7c102750 0x7efc7c19a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.941+0000 7efc7bfff640 1 -- 172.21.15.53:0/1658019203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7c1a0030 con 0x7efc7c1089d0 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.942+0000 7efc7bfff640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc7c1089d0 0x7efc7c19f930 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7efc7400eb10 tx=0x7efc7400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.942+0000 7efc797fa640 1 -- 172.21.15.53:0/1658019203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74004b20 con 0x7efc7c1089d0 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.942+0000 7efc81b62640 1 -- 172.21.15.53:0/1658019203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7c1a0320 con 0x7efc7c1089d0 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.942+0000 7efc797fa640 1 -- 172.21.15.53:0/1658019203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc74004cc0 con 0x7efc7c1089d0 2024-08-31T06:15:30.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.942+0000 7efc797fa640 1 -- 172.21.15.53:0/1658019203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74010690 con 0x7efc7c1089d0 2024-08-31T06:15:30.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.942+0000 7efc81b62640 1 -- 172.21.15.53:0/1658019203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc7c1a6ab0 con 0x7efc7c1089d0 2024-08-31T06:15:30.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.945+0000 7efc88acc740 1 Processor -- start 2024-08-31T06:15:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc797fa640 1 -- 172.21.15.53:0/1658019203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7efc74010830 con 0x7efc7c1089d0 2024-08-31T06:15:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc88acc740 1 -- start start 2024-08-31T06:15:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc88acc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22d51b0 0x5634b2678ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc88acc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22ac2f0 0x5634b2679220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc88acc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b2679760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc88acc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5634b25ee000 con 0x5634b22b44d0 2024-08-31T06:15:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc88acc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5634b25dd590 con 0x5634b22ac2f0 2024-08-31T06:15:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc88acc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5634b25e1540 con 0x5634b22d51b0 2024-08-31T06:15:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc73fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b2679760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc73fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b2679760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46336/0 (socket says 172.21.15.53:46336) 2024-08-31T06:15:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc73fff640 1 -- 172.21.15.53:0/1024142866 learned_addr learned my addr 172.21.15.53:0/1024142866 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc7b7fe640 1 --2- 172.21.15.53:0/1024142866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22ac2f0 0x5634b2679220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.946+0000 7efc73fff640 1 --2- 172.21.15.53:0/1024142866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22d51b0 0x5634b2678ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc73fff640 1 -- 172.21.15.53:0/1024142866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22d51b0 msgr2=0x5634b2678ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc73fff640 1 --2- 172.21.15.53:0/1024142866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22d51b0 0x5634b2678ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc797fa640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efc680b4ca0 0x7efc680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc73fff640 1 -- 172.21.15.53:0/1024142866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22ac2f0 msgr2=0x5634b2679220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc73fff640 1 --2- 172.21.15.53:0/1024142866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22ac2f0 0x5634b2679220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc73fff640 1 -- 172.21.15.53:0/1024142866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634b2340790 con 0x5634b22b44d0 2024-08-31T06:15:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc7bfff640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efc680b4ca0 0x7efc680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc73fff640 1 --2- 172.21.15.53:0/1024142866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b2679760 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7efc640124c0 tx=0x7efc64005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831f25ccd75ae4a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc797fa640 1 -- 172.21.15.53:0/1658019203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7efc740e5b20 con 0x7efc7c1089d0 2024-08-31T06:15:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc71ffb640 1 -- 172.21.15.53:0/1024142866 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64004230 con 0x5634b22b44d0 2024-08-31T06:15:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc71ffb640 1 -- 172.21.15.53:0/1024142866 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc640043d0 con 0x5634b22b44d0 2024-08-31T06:15:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.947+0000 7efc71ffb640 1 -- 172.21.15.53:0/1024142866 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64004d60 con 0x5634b22b44d0 2024-08-31T06:15:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.948+0000 7efc88acc740 1 -- 172.21.15.53:0/1024142866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 msgr2=0x5634b2679760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.948+0000 7efc7bfff640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efc680b4ca0 0x7efc680b71b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efc740e3850 tx=0x7efc740e0040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.948+0000 7efc88acc740 1 --2- 172.21.15.53:0/1024142866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b2679760 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7efc640124c0 tx=0x7efc64005c90 comp rx=0 tx=0).stop 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.948+0000 7efc88acc740 1 -- 172.21.15.53:0/1024142866 shutdown_connections 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.948+0000 7efc88acc740 1 --2- 172.21.15.53:0/1024142866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b2679760 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.948+0000 7efc88acc740 1 --2- 172.21.15.53:0/1024142866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22ac2f0 0x5634b2679220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.948+0000 7efc88acc740 1 --2- 172.21.15.53:0/1024142866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22d51b0 0x5634b2678ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.948+0000 7efc88acc740 1 -- 172.21.15.53:0/1024142866 >> 172.21.15.53:0/1024142866 conn(0x5634b22c9300 msgr2=0x5634b2676bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.948+0000 7efc88acc740 1 -- 172.21.15.53:0/1024142866 shutdown_connections 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.948+0000 7efc88acc740 1 -- 172.21.15.53:0/1024142866 wait complete. 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc88acc740 1 -- start start 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc88acc740 1 Processor -- start 2024-08-31T06:15:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc88acc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b2688d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc88acc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22b44d0 0x5634b2689340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc88acc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b268eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc88acc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5634b2516ab0 con 0x5634b22ac2f0 2024-08-31T06:15:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc88acc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5634b2564680 con 0x5634b22d51b0 2024-08-31T06:15:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc88acc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5634b268b840 con 0x5634b22b44d0 2024-08-31T06:15:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc88acc740 10 client.0 _ll_register_callbacks cb 0x5634b22eca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc73fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b2688d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc73fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b2688d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46350/0 (socket says 172.21.15.53:46350) 2024-08-31T06:15:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.949+0000 7efc73fff640 1 -- 172.21.15.53:0/4232386995 learned_addr learned my addr 172.21.15.53:0/4232386995 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc7b7fe640 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22b44d0 0x5634b2689340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc73fff640 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b268eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc73fff640 1 -- 172.21.15.53:0/4232386995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22b44d0 msgr2=0x5634b2689340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc73fff640 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22b44d0 0x5634b2689340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc73fff640 1 -- 172.21.15.53:0/4232386995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 msgr2=0x5634b268eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc73fff640 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b268eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc73fff640 1 -- 172.21.15.53:0/4232386995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634b23b9620 con 0x5634b22ac2f0 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc73fff640 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b2688d60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7efc64004a40 tx=0x7efc64005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61e8053c07edc48 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc5affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc5affd640 1 -- 172.21.15.53:0/4232386995 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc640051a0 con 0x5634b22ac2f0 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc5affd640 1 -- 172.21.15.53:0/4232386995 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7efc64005340 con 0x5634b22ac2f0 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc88acc740 1 -- 172.21.15.53:0/4232386995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc640043d0 con 0x5634b22ac2f0 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc5affd640 1 -- 172.21.15.53:0/4232386995 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7efc64005540 con 0x5634b22ac2f0 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc88acc740 10 client.18939 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.950+0000 7efc88acc740 1 -- 172.21.15.53:0/4232386995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5634b26979c0 con 0x5634b22ac2f0 2024-08-31T06:15:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.951+0000 7efc5affd640 1 -- 172.21.15.53:0/4232386995 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc640043d0 con 0x5634b22ac2f0 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.951+0000 7efc5affd640 1 -- 172.21.15.53:0/4232386995 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7efc6401d430 con 0x5634b22ac2f0 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.951+0000 7efc88acc740 10 client.18939 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.951+0000 7efc88acc740 10 client.18939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.951+0000 7efc88acc740 20 client.18939 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.951+0000 7efc88acc740 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5634b2293d80 0x5634b269ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.951+0000 7efc88acc740 4 client.18939 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.951+0000 7efc88acc740 1 -- 172.21.15.53:0/4232386995 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634b25eff50 con 0x5634b2293d80 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.951+0000 7efc7b7fe640 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5634b2293d80 0x5634b269ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.952+0000 7efc7b7fe640 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5634b2293d80 0x5634b269ad80 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8112210196239edf server_cookie=f81f50c1bf646eba in_seq=0 out_seq=0 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.952+0000 7efc5affd640 10 client.18939 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc5affd640 1 -- 172.21.15.53:0/4232386995 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5634b25eff50 con 0x5634b2293d80 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc5affd640 10 client.18939 handle_command_reply: tid=0 2024-08-31T06:15:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 1 client.18939 shutdown 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 1 -- 172.21.15.53:0/4232386995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 msgr2=0x5634b2688d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b2688d60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7efc64004a40 tx=0x7efc64005890 comp rx=0 tx=0).stop 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 1 -- 172.21.15.53:0/4232386995 shutdown_connections 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5634b2293d80 0x5634b269ad80 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b268eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22b44d0 0x5634b2689340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc5affd640 0 client.18939 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 1 --2- 172.21.15.53:0/4232386995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b2688d60 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 1 -- 172.21.15.53:0/4232386995 >> 172.21.15.53:0/4232386995 conn(0x5634b22c9300 msgr2=0x5634b2675170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 1 -- 172.21.15.53:0/4232386995 shutdown_connections 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 1 -- 172.21.15.53:0/4232386995 wait complete. 2024-08-31T06:15:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.953+0000 7efc88acc740 20 client.18939 trim_cache size 0 max 16384 2024-08-31T06:15:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc88acc740 1 Processor -- start 2024-08-31T06:15:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc88acc740 1 -- start start 2024-08-31T06:15:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc88acc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b268eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc88acc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22b44d0 0x5634b2695940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc88acc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b2675880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc88acc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1ad300 con 0x5634b22ac2f0 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc88acc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1af050 con 0x5634b22d51b0 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc88acc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1ad9d0 con 0x5634b22b44d0 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc73fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b268eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc73fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b268eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46356/0 (socket says 172.21.15.53:46356) 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc73fff640 1 -- 172.21.15.53:0/2074900649 learned_addr learned my addr 172.21.15.53:0/2074900649 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.968+0000 7efc7b7fe640 1 --2- 172.21.15.53:0/2074900649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22b44d0 0x5634b2695940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.969+0000 7efc73fff640 1 --2- 172.21.15.53:0/2074900649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b2675880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.969+0000 7efc73fff640 1 -- 172.21.15.53:0/2074900649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22b44d0 msgr2=0x5634b2695940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.969+0000 7efc73fff640 1 --2- 172.21.15.53:0/2074900649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22b44d0 0x5634b2695940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.969+0000 7efc73fff640 1 -- 172.21.15.53:0/2074900649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 msgr2=0x5634b2675880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.969+0000 7efc73fff640 1 --2- 172.21.15.53:0/2074900649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b2675880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.969+0000 7efc73fff640 1 -- 172.21.15.53:0/2074900649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634b2670980 con 0x5634b22ac2f0 2024-08-31T06:15:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.969+0000 7efc73fff640 1 --2- 172.21.15.53:0/2074900649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b268eab0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7efc6400b6b0 tx=0x7efc64004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df20ce4e4911438e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.969+0000 7efc717fa640 1 -- 172.21.15.53:0/2074900649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64039040 con 0x5634b22ac2f0 2024-08-31T06:15:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.969+0000 7efc717fa640 1 -- 172.21.15.53:0/2074900649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc6403a040 con 0x5634b22ac2f0 2024-08-31T06:15:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.969+0000 7efc717fa640 1 -- 172.21.15.53:0/2074900649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64004fa0 con 0x5634b22ac2f0 2024-08-31T06:15:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.970+0000 7efc88acc740 1 -- 172.21.15.53:0/2074900649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 msgr2=0x5634b268eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.970+0000 7efc88acc740 1 --2- 172.21.15.53:0/2074900649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b268eab0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7efc6400b6b0 tx=0x7efc64004a70 comp rx=0 tx=0).stop 2024-08-31T06:15:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.970+0000 7efc88acc740 1 -- 172.21.15.53:0/2074900649 shutdown_connections 2024-08-31T06:15:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.970+0000 7efc88acc740 1 --2- 172.21.15.53:0/2074900649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b2675880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.970+0000 7efc88acc740 1 --2- 172.21.15.53:0/2074900649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22b44d0 0x5634b2695940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.970+0000 7efc88acc740 1 --2- 172.21.15.53:0/2074900649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22ac2f0 0x5634b268eab0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.970+0000 7efc88acc740 1 -- 172.21.15.53:0/2074900649 >> 172.21.15.53:0/2074900649 conn(0x5634b22c9300 msgr2=0x5634b2675170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.970+0000 7efc88acc740 1 -- 172.21.15.53:0/2074900649 shutdown_connections 2024-08-31T06:15:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.970+0000 7efc88acc740 1 -- 172.21.15.53:0/2074900649 wait complete. 2024-08-31T06:15:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc88acc740 1 -- start start 2024-08-31T06:15:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc88acc740 1 Processor -- start 2024-08-31T06:15:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc88acc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22ac2f0 0x5634b2695450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc88acc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b26908f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc88acc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b2690e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc88acc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1ae8c0 con 0x5634b22b44d0 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc88acc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1ae160 con 0x5634b22d51b0 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc88acc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1ab300 con 0x5634b22ac2f0 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc88acc740 10 client.0 _ll_register_callbacks cb 0x7efc6c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc7b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b26908f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc7b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b26908f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46372/0 (socket says 172.21.15.53:46372) 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.971+0000 7efc7b7fe640 1 -- 172.21.15.53:0/4078324644 learned_addr learned my addr 172.21.15.53:0/4078324644 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc73fff640 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22ac2f0 0x5634b2695450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc73fff640 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b2690e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc7b7fe640 1 -- 172.21.15.53:0/4078324644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22ac2f0 msgr2=0x5634b2695450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc7b7fe640 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22ac2f0 0x5634b2695450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc7b7fe640 1 -- 172.21.15.53:0/4078324644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 msgr2=0x5634b2690e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc7b7fe640 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b2690e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc7b7fe640 1 -- 172.21.15.53:0/4078324644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634b2679ad0 con 0x5634b22b44d0 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc73fff640 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b2690e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc7b7fe640 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b26908f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0092a0 tx=0x7efc6c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393af59036b4ab46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc5affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc5affd640 1 -- 172.21.15.53:0/4078324644 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c035040 con 0x5634b22b44d0 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc5affd640 1 -- 172.21.15.53:0/4078324644 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7efc6c031600 con 0x5634b22b44d0 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc88acc740 1 -- 172.21.15.53:0/4078324644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc6403a040 con 0x5634b22b44d0 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc5affd640 1 -- 172.21.15.53:0/4078324644 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7efc6c031800 con 0x5634b22b44d0 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc88acc740 10 client.18945 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc88acc740 1 -- 172.21.15.53:0/4078324644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5634b2705100 con 0x5634b22b44d0 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.972+0000 7efc5affd640 1 -- 172.21.15.53:0/4078324644 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc6403a040 con 0x5634b22b44d0 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.973+0000 7efc5affd640 1 -- 172.21.15.53:0/4078324644 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7efc6c03c640 con 0x5634b22b44d0 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.973+0000 7efc88acc740 10 client.18945 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.973+0000 7efc88acc740 10 client.18945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.973+0000 7efc88acc740 20 client.18945 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.973+0000 7efc88acc740 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5634b22691c0 0x5634b2707a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.973+0000 7efc88acc740 4 client.18945 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:15:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.973+0000 7efc88acc740 1 -- 172.21.15.53:0/4078324644 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5634b25eb9f0 con 0x5634b22691c0 2024-08-31T06:15:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.973+0000 7efc73fff640 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5634b22691c0 0x5634b2707a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.973+0000 7efc5affd640 10 client.18945 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.973+0000 7efc73fff640 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5634b22691c0 0x5634b2707a00 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b847bb9ffa56a3 server_cookie=66e98b83c1e85051 in_seq=0 out_seq=0 2024-08-31T06:15:30.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.45 MB/sec execute 440 sec latency 12434.478 ms 2024-08-31T06:15:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc5affd640 1 -- 172.21.15.53:0/4078324644 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5634b25eb9f0 con 0x5634b22691c0 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc5affd640 10 client.18945 handle_command_reply: tid=0 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 1 client.18945 shutdown 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 1 -- 172.21.15.53:0/4078324644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 msgr2=0x5634b26908f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b26908f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0092a0 tx=0x7efc6c004340 comp rx=0 tx=0).stop 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 1 -- 172.21.15.53:0/4078324644 shutdown_connections 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5634b22691c0 0x5634b2707a00 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5634b22d51b0 0x5634b2690e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634b22b44d0 0x5634b26908f0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 1 --2- 172.21.15.53:0/4078324644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5634b22ac2f0 0x5634b2695450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc5affd640 0 client.18945 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 1 -- 172.21.15.53:0/4078324644 >> 172.21.15.53:0/4078324644 conn(0x5634b22c9300 msgr2=0x5634b2675170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 1 -- 172.21.15.53:0/4078324644 shutdown_connections 2024-08-31T06:15:30.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 1 -- 172.21.15.53:0/4078324644 wait complete. 2024-08-31T06:15:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.996+0000 7efc88acc740 20 client.18945 trim_cache size 0 max 16384 2024-08-31T06:15:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:15:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:15:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:15:31.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:15:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 -- 172.21.15.53:0/1658019203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efc680b4ca0 msgr2=0x7efc680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efc680b4ca0 0x7efc680b71b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efc740e3850 tx=0x7efc740e0040 comp rx=0 tx=0).stop 2024-08-31T06:15:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 -- 172.21.15.53:0/1658019203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc7c1089d0 msgr2=0x7efc7c19f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc7c1089d0 0x7efc7c19f930 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7efc7400eb10 tx=0x7efc7400c2d0 comp rx=0 tx=0).stop 2024-08-31T06:15:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 -- 172.21.15.53:0/1658019203 shutdown_connections 2024-08-31T06:15:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efc680b4ca0 0x7efc680b71b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc7c1089d0 0x7efc7c19f930 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc7c108080 0x7efc7c19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 --2- 172.21.15.53:0/1658019203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc7c102750 0x7efc7c19a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 -- 172.21.15.53:0/1658019203 >> 172.21.15.53:0/1658019203 conn(0x7efc7c07a4e0 msgr2=0x7efc7c1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 -- 172.21.15.53:0/1658019203 shutdown_connections 2024-08-31T06:15:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:30.997+0000 7efc81b62640 1 -- 172.21.15.53:0/1658019203 wait complete. 2024-08-31T06:15:31.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:31 smithi153 ceph-mon[22320]: pgmap v650: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 275 KiB/s wr, 50 op/s 2024-08-31T06:15:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:31 smithi053 ceph-mon[18924]: pgmap v650: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 275 KiB/s wr, 50 op/s 2024-08-31T06:15:31.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.45 MB/sec execute 441 sec latency 13434.507 ms 2024-08-31T06:15:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:31 smithi130 ceph-mon[22266]: pgmap v650: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 275 KiB/s wr, 50 op/s 2024-08-31T06:15:32.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.45 MB/sec execute 442 sec latency 14434.624 ms 2024-08-31T06:15:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:33 smithi153 ceph-mon[22320]: pgmap v651: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 KiB/s wr, 24 op/s 2024-08-31T06:15:33.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:33 smithi053 ceph-mon[18924]: pgmap v651: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 KiB/s wr, 24 op/s 2024-08-31T06:15:33.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.44 MB/sec execute 443 sec latency 15434.753 ms 2024-08-31T06:15:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:33 smithi130 ceph-mon[22266]: pgmap v651: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 KiB/s wr, 24 op/s 2024-08-31T06:15:34.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.44 MB/sec execute 444 sec latency 16434.858 ms 2024-08-31T06:15:35.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:35 smithi153 ceph-mon[22320]: pgmap v652: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-31T06:15:35.930 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:35 smithi130 ceph-mon[22266]: pgmap v652: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-31T06:15:35.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:35 smithi053 ceph-mon[18924]: pgmap v652: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-31T06:15:35.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.44 MB/sec execute 445 sec latency 17434.954 ms 2024-08-31T06:15:36.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.43 MB/sec execute 446 sec latency 18435.078 ms 2024-08-31T06:15:37.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:37 smithi153 ceph-mon[22320]: pgmap v653: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-08-31T06:15:37.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:37 smithi053 ceph-mon[18924]: pgmap v653: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-08-31T06:15:37.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.43 MB/sec execute 447 sec latency 19435.182 ms 2024-08-31T06:15:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:37 smithi130 ceph-mon[22266]: pgmap v653: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-08-31T06:15:38.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.43 MB/sec execute 448 sec latency 20435.268 ms 2024-08-31T06:15:39.201 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:15:39.472 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:39.907 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:39 smithi053 ceph-mon[18924]: pgmap v654: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 32 KiB/s wr, 22 op/s 2024-08-31T06:15:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.904+0000 7f2a055bc640 1 -- 172.21.15.53:0/3629689096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a00102f50 msgr2=0x7f2a00103360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.904+0000 7f2a055bc640 1 --2- 172.21.15.53:0/3629689096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a00102f50 0x7f2a00103360 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009900 tx=0x7f29f002a410 comp rx=0 tx=0).stop 2024-08-31T06:15:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.904+0000 7f2a055bc640 1 -- 172.21.15.53:0/3629689096 shutdown_connections 2024-08-31T06:15:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.904+0000 7f2a055bc640 1 --2- 172.21.15.53:0/3629689096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a001058b0 0x7f2a0010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.904+0000 7f2a055bc640 1 --2- 172.21.15.53:0/3629689096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a00104f60 0x7f2a00105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.904+0000 7f2a055bc640 1 --2- 172.21.15.53:0/3629689096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a00102f50 0x7f2a00103360 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.904+0000 7f2a055bc640 1 -- 172.21.15.53:0/3629689096 >> 172.21.15.53:0/3629689096 conn(0x7f2a00079d30 msgr2=0x7f2a0007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.904+0000 7f2a055bc640 1 -- 172.21.15.53:0/3629689096 shutdown_connections 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.904+0000 7f2a055bc640 1 -- 172.21.15.53:0/3629689096 wait complete. 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.905+0000 7f2a055bc640 1 Processor -- start 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.905+0000 7f2a055bc640 1 -- start start 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.905+0000 7f2a055bc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a00102f50 0x7f2a0019af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f2a055bc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a00104f60 0x7f2a0019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f2a055bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001058b0 0x7f2a0019b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f2a055bc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00112650 con 0x7f2a001058b0 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f2a055bc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2a001124d0 con 0x7f2a00102f50 2024-08-31T06:15:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f2a055bc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2a001127d0 con 0x7f2a00104f60 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29ff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001058b0 0x7f2a0019b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29ff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001058b0 0x7f2a0019b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35826/0 (socket says 172.21.15.53:35826) 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29ff7fe640 1 -- 172.21.15.53:0/1634651112 learned_addr learned my addr 172.21.15.53:0/1634651112 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29feffd640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a00102f50 0x7f2a0019af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29fe7fc640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a00104f60 0x7f2a0019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29ff7fe640 1 -- 172.21.15.53:0/1634651112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a00104f60 msgr2=0x7f2a0019b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29ff7fe640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a00104f60 0x7f2a0019b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29ff7fe640 1 -- 172.21.15.53:0/1634651112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a00102f50 msgr2=0x7f2a0019af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29ff7fe640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a00102f50 0x7f2a0019af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29ff7fe640 1 -- 172.21.15.53:0/1634651112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a001a6270 con 0x7f2a001058b0 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29feffd640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a00102f50 0x7f2a0019af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29ff7fe640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001058b0 0x7f2a0019b9e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f29f800eaa0 tx=0x7f29f800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29e7fff640 1 -- 172.21.15.53:0/1634651112 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f800cdb0 con 0x7f2a001058b0 2024-08-31T06:15:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f2a055bc640 1 -- 172.21.15.53:0/1634651112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a001a6560 con 0x7f2a001058b0 2024-08-31T06:15:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29e7fff640 1 -- 172.21.15.53:0/1634651112 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29f8005020 con 0x7f2a001058b0 2024-08-31T06:15:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.906+0000 7f29e7fff640 1 -- 172.21.15.53:0/1634651112 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f80116d0 con 0x7f2a001058b0 2024-08-31T06:15:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.907+0000 7f2a055bc640 1 -- 172.21.15.53:0/1634651112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a001a6af0 con 0x7f2a001058b0 2024-08-31T06:15:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.908+0000 7f2a055bc640 1 -- 172.21.15.53:0/1634651112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a00103360 con 0x7f2a001058b0 2024-08-31T06:15:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.909+0000 7f29e7fff640 1 -- 172.21.15.53:0/1634651112 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f29f8004a40 con 0x7f2a001058b0 2024-08-31T06:15:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.910+0000 7f29e7fff640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29e80b4ca0 0x7f29e80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.910+0000 7f29feffd640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29e80b4ca0 0x7f29e80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.910+0000 7f29e7fff640 1 -- 172.21.15.53:0/1634651112 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f29f80e5820 con 0x7f2a001058b0 2024-08-31T06:15:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.910+0000 7f29feffd640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29e80b4ca0 0x7f29e80b71b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f29f0006010 tx=0x7f29f0005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:39.916+0000 7f29e7fff640 1 -- 172.21.15.53:0/1634651112 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f29f8016030 con 0x7f2a001058b0 2024-08-31T06:15:39.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:39 smithi153 ceph-mon[22320]: pgmap v654: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 32 KiB/s wr, 22 op/s 2024-08-31T06:15:39.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.42 MB/sec execute 449 sec latency 21435.319 ms 2024-08-31T06:15:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:39 smithi130 ceph-mon[22266]: pgmap v654: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 32 KiB/s wr, 22 op/s 2024-08-31T06:15:40.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.138+0000 7f2a055bc640 1 -- 172.21.15.53:0/1634651112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a0010a850 con 0x7f2a001058b0 2024-08-31T06:15:40.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.138+0000 7f29e7fff640 1 -- 172.21.15.53:0/1634651112 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+12004 (secure 0 0 0) 0x7f29f80ac590 con 0x7f2a001058b0 2024-08-31T06:15:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:15:40.141 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":48,"btime":"2024-08-31T06:15:21:610334+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:15:21.232855+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:15:40.141 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 48 2024-08-31T06:15:40.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 -- 172.21.15.53:0/1634651112 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29e80b4ca0 msgr2=0x7f29e80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:40.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29e80b4ca0 0x7f29e80b71b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f29f0006010 tx=0x7f29f0005a20 comp rx=0 tx=0).stop 2024-08-31T06:15:40.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 -- 172.21.15.53:0/1634651112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001058b0 msgr2=0x7f2a0019b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:40.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001058b0 0x7f2a0019b9e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f29f800eaa0 tx=0x7f29f800ef60 comp rx=0 tx=0).stop 2024-08-31T06:15:40.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 -- 172.21.15.53:0/1634651112 shutdown_connections 2024-08-31T06:15:40.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f29e80b4ca0 0x7f29e80b71b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:40.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a001058b0 0x7f2a0019b9e0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:40.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a00104f60 0x7f2a0019b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:40.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 --2- 172.21.15.53:0/1634651112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a00102f50 0x7f2a0019af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:40.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 -- 172.21.15.53:0/1634651112 >> 172.21.15.53:0/1634651112 conn(0x7f2a00079d30 msgr2=0x7f2a00107170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:40.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 -- 172.21.15.53:0/1634651112 shutdown_connections 2024-08-31T06:15:40.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:40.141+0000 7f2a055bc640 1 -- 172.21.15.53:0/1634651112 wait complete. 2024-08-31T06:15:40.875 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:40 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1634651112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:40.877 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id 37dd47d --release --await' 2024-08-31T06:15:40.877 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id 37dd47d --release --await 2024-08-31T06:15:40.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:40 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1634651112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:40.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171072 1.42 MB/sec execute 450 sec latency 22435.369 ms 2024-08-31T06:15:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:40 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1634651112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:41.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.627+0000 7f09f6374640 1 -- 172.21.15.53:0/4250559413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09f0108160 msgr2=0x7f09f0108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:41.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.627+0000 7f09f6374640 1 --2- 172.21.15.53:0/4250559413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09f0108160 0x7f09f0108570 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009900 tx=0x7f09e402a410 comp rx=0 tx=0).stop 2024-08-31T06:15:41.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.627+0000 7f09f6374640 1 -- 172.21.15.53:0/4250559413 shutdown_connections 2024-08-31T06:15:41.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.627+0000 7f09f6374640 1 --2- 172.21.15.53:0/4250559413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09f0108ab0 0x7f09f010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.627+0000 7f09f6374640 1 --2- 172.21.15.53:0/4250559413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09f0108160 0x7f09f0108570 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.627+0000 7f09f6374640 1 --2- 172.21.15.53:0/4250559413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f0102820 0x7f09f0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.627+0000 7f09f6374640 1 -- 172.21.15.53:0/4250559413 >> 172.21.15.53:0/4250559413 conn(0x7f09f00794e0 msgr2=0x7f09f00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.627+0000 7f09f6374640 1 -- 172.21.15.53:0/4250559413 shutdown_connections 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.627+0000 7f09f6374640 1 -- 172.21.15.53:0/4250559413 wait complete. 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.628+0000 7f09f6374640 1 Processor -- start 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.628+0000 7f09f6374640 1 -- start start 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.628+0000 7f09f6374640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f0102820 0x7f09f019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.628+0000 7f09f6374640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09f0108160 0x7f09f019a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.628+0000 7f09f6374640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09f0108ab0 0x7f09f019fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.628+0000 7f09f6374640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f09f01125b0 con 0x7f09f0108ab0 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.628+0000 7f09f6374640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f09f0112430 con 0x7f09f0102820 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.628+0000 7f09f6374640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f09f0112730 con 0x7f09f0108160 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09f4911640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09f0108ab0 0x7f09f019fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09f4911640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09f0108ab0 0x7f09f019fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35842/0 (socket says 172.21.15.53:35842) 2024-08-31T06:15:41.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09f4911640 1 -- 172.21.15.53:0/3606293245 learned_addr learned my addr 172.21.15.53:0/3606293245 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:41.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09f0108160 0x7f09f019a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09effff640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f0102820 0x7f09f019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09f4911640 1 -- 172.21.15.53:0/3606293245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09f0108160 msgr2=0x7f09f019a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:41.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09f4911640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09f0108160 0x7f09f019a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09f4911640 1 -- 172.21.15.53:0/3606293245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f0102820 msgr2=0x7f09f019a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:41.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09f4911640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f0102820 0x7f09f019a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09f4911640 1 -- 172.21.15.53:0/3606293245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f01a0180 con 0x7f09f0108ab0 2024-08-31T06:15:41.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09f4911640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09f0108ab0 0x7f09f019fa50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f09e800eb10 tx=0x7f09e800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09ed7fa640 1 -- 172.21.15.53:0/3606293245 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8004b20 con 0x7f09f0108ab0 2024-08-31T06:15:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09f6374640 1 -- 172.21.15.53:0/3606293245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f01a0470 con 0x7f09f0108ab0 2024-08-31T06:15:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09ed7fa640 1 -- 172.21.15.53:0/3606293245 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09e8004cc0 con 0x7f09f0108ab0 2024-08-31T06:15:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.629+0000 7f09ed7fa640 1 -- 172.21.15.53:0/3606293245 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8010690 con 0x7f09f0108ab0 2024-08-31T06:15:41.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.630+0000 7f09f6374640 1 -- 172.21.15.53:0/3606293245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f01a6bd0 con 0x7f09f0108ab0 2024-08-31T06:15:41.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.632+0000 7f09fc8e9740 1 Processor -- start 2024-08-31T06:15:41.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09ed7fa640 1 -- 172.21.15.53:0/3606293245 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f09e8005020 con 0x7f09f0108ab0 2024-08-31T06:15:41.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09fc8e9740 1 -- start start 2024-08-31T06:15:41.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbde520 0x55829bf83c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbb5660 0x55829bf841c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbbd840 0x55829bf84700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55829befaa70 con 0x55829bbbd840 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55829beea000 con 0x55829bbde520 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55829beedfb0 con 0x55829bbb5660 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbbd840 0x55829bf84700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbbd840 0x55829bf84700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35846/0 (socket says 172.21.15.53:35846) 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09ef7fe640 1 -- 172.21.15.53:0/3589860301 learned_addr learned my addr 172.21.15.53:0/3589860301 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/3589860301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbde520 0x55829bf83c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.633+0000 7f09effff640 1 --2- 172.21.15.53:0/3589860301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbb5660 0x55829bf841c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09ef7fe640 1 -- 172.21.15.53:0/3589860301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbb5660 msgr2=0x55829bf841c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/3589860301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbb5660 0x55829bf841c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09ef7fe640 1 -- 172.21.15.53:0/3589860301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbde520 msgr2=0x55829bf83c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:41.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/3589860301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbde520 0x55829bf83c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09ed7fa640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f09d80b4ca0 0x7f09d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09ef7fe640 1 -- 172.21.15.53:0/3589860301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55829bc49b00 con 0x55829bbbd840 2024-08-31T06:15:41.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09effff640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f09d80b4ca0 0x7f09d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/3589860301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbbd840 0x55829bf84700 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f09e40057c0 tx=0x7f09e4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2e1fafab8ea292 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:41.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09ed7fa640 1 -- 172.21.15.53:0/3606293245 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f09e80e5a80 con 0x7f09f0108ab0 2024-08-31T06:15:41.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09d67fc640 1 -- 172.21.15.53:0/3589860301 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4035040 con 0x55829bbbd840 2024-08-31T06:15:41.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09d67fc640 1 -- 172.21.15.53:0/3589860301 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09e4004030 con 0x55829bbbd840 2024-08-31T06:15:41.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.634+0000 7f09d67fc640 1 -- 172.21.15.53:0/3589860301 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4003930 con 0x55829bbbd840 2024-08-31T06:15:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.635+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3589860301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbbd840 msgr2=0x55829bf84700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.635+0000 7f09effff640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f09d80b4ca0 0x7f09d80b71b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55829bf82900 tx=0x7f09e000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.635+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/3589860301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbbd840 0x55829bf84700 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f09e40057c0 tx=0x7f09e4005fd0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.635+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3589860301 shutdown_connections 2024-08-31T06:15:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.635+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/3589860301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbbd840 0x55829bf84700 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.635+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/3589860301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbb5660 0x55829bf841c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.635+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/3589860301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbde520 0x55829bf83c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.635+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3589860301 >> 172.21.15.53:0/3589860301 conn(0x55829bbd2910 msgr2=0x55829bf81b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.635+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3589860301 shutdown_connections 2024-08-31T06:15:41.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.635+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3589860301 wait complete. 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.635+0000 7f09fc8e9740 1 -- start start 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09fc8e9740 1 Processor -- start 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbb5660 0x55829bf8f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbbd840 0x55829bf8fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbde520 0x55829bf9b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55829bf92400 con 0x55829bbde520 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55829beab520 con 0x55829bbbd840 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55829bf92580 con 0x55829bbb5660 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09fc8e9740 10 client.0 _ll_register_callbacks cb 0x55829bee3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09f4911640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbde520 0x55829bf9b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09f4911640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbde520 0x55829bf9b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35850/0 (socket says 172.21.15.53:35850) 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09f4911640 1 -- 172.21.15.53:0/2802466374 learned_addr learned my addr 172.21.15.53:0/2802466374 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbbd840 0x55829bf8fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.636+0000 7f09effff640 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbb5660 0x55829bf8f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09f4911640 1 -- 172.21.15.53:0/2802466374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbb5660 msgr2=0x55829bf8f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09f4911640 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbb5660 0x55829bf8f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09f4911640 1 -- 172.21.15.53:0/2802466374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbbd840 msgr2=0x55829bf8fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09f4911640 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbbd840 0x55829bf8fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09f4911640 1 -- 172.21.15.53:0/2802466374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55829bcc0960 con 0x55829bbde520 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09effff640 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbb5660 0x55829bf8f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09f4911640 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbde520 0x55829bf9b8a0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f09e80ac0e0 tx=0x7f09e80a8110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389f1368c4eb14bb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09cf7fe640 1 -- 172.21.15.53:0/2802466374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e80ac850 con 0x55829bbde520 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09cf7fe640 1 -- 172.21.15.53:0/2802466374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f09e80ac5c0 con 0x55829bbde520 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09fc8e9740 1 -- 172.21.15.53:0/2802466374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55829be899a0 con 0x55829bbde520 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09cf7fe640 1 -- 172.21.15.53:0/2802466374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f09e80ac150 con 0x55829bbde520 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09fc8e9740 10 client.18963 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:41.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09fc8e9740 1 -- 172.21.15.53:0/2802466374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55829bf9e610 con 0x55829bbde520 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.637+0000 7f09cf7fe640 1 -- 172.21.15.53:0/2802466374 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55829be899a0 con 0x55829bbde520 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.638+0000 7f09cf7fe640 1 -- 172.21.15.53:0/2802466374 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7f09e8097230 con 0x55829bbde520 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.638+0000 7f09fc8e9740 10 client.18963 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.638+0000 7f09fc8e9740 10 client.18963 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.638+0000 7f09fc8e9740 20 client.18963 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.638+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55829bb9cea0 0x55829bfa1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.638+0000 7f09fc8e9740 4 client.18963 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.638+0000 7f09fc8e9740 1 -- 172.21.15.53:0/2802466374 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55829befc9c0 con 0x55829bb9cea0 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.638+0000 7f09effff640 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55829bb9cea0 0x55829bfa1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.638+0000 7f09cf7fe640 10 client.18963 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.638+0000 7f09effff640 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55829bb9cea0 0x55829bfa1be0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd13315f99d386f3 server_cookie=b04222134a909620 in_seq=0 out_seq=0 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.639+0000 7f09cf7fe640 1 -- 172.21.15.53:0/2802466374 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55829befc9c0 con 0x55829bb9cea0 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.639+0000 7f09cf7fe640 10 client.18963 handle_command_reply: tid=0 2024-08-31T06:15:41.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.639+0000 7f09fc8e9740 1 client.18963 shutdown 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.639+0000 7f09fc8e9740 1 -- 172.21.15.53:0/2802466374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbde520 msgr2=0x55829bf9b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.639+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbde520 0x55829bf9b8a0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f09e80ac0e0 tx=0x7f09e80a8110 comp rx=0 tx=0).stop 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.639+0000 7f09fc8e9740 1 -- 172.21.15.53:0/2802466374 shutdown_connections 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.639+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55829bb9cea0 0x55829bfa1be0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.639+0000 7f09cf7fe640 0 client.18963 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.639+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbde520 0x55829bf9b8a0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.639+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbbd840 0x55829bf8fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.639+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/2802466374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbb5660 0x55829bf8f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.640+0000 7f09fc8e9740 1 -- 172.21.15.53:0/2802466374 >> 172.21.15.53:0/2802466374 conn(0x55829bbd2910 msgr2=0x55829bf86e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.640+0000 7f09fc8e9740 1 -- 172.21.15.53:0/2802466374 shutdown_connections 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.640+0000 7f09fc8e9740 1 -- 172.21.15.53:0/2802466374 wait complete. 2024-08-31T06:15:41.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.640+0000 7f09fc8e9740 20 client.18963 trim_cache size 0 max 16384 2024-08-31T06:15:41.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.657+0000 7f09fc8e9740 1 Processor -- start 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.657+0000 7f09fc8e9740 1 -- start start 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bb9cea0 0x55829bf85670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbb5660 0x55829bf9b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbbd840 0x55829bf912b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f09f01af520 con 0x55829bbb5660 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f09f01b1270 con 0x55829bb9cea0 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f09f01afbf0 con 0x55829bbbd840 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbb5660 0x55829bf9b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbb5660 0x55829bf9b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35858/0 (socket says 172.21.15.53:35858) 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09ef7fe640 1 -- 172.21.15.53:0/4103762370 learned_addr learned my addr 172.21.15.53:0/4103762370 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09effff640 1 --2- 172.21.15.53:0/4103762370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bb9cea0 0x55829bf85670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09f4911640 1 --2- 172.21.15.53:0/4103762370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbbd840 0x55829bf912b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09ef7fe640 1 -- 172.21.15.53:0/4103762370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbbd840 msgr2=0x55829bf912b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/4103762370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbbd840 0x55829bf912b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09ef7fe640 1 -- 172.21.15.53:0/4103762370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bb9cea0 msgr2=0x55829bf85670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/4103762370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bb9cea0 0x55829bf85670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.658+0000 7f09ef7fe640 1 -- 172.21.15.53:0/4103762370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55829bf82460 con 0x55829bbb5660 2024-08-31T06:15:41.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.659+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/4103762370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbb5660 0x55829bf9b7a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009900 tx=0x7f09e402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df02aa3ed3e6e874 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:41.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.659+0000 7f09d5ffb640 1 -- 172.21.15.53:0/4103762370 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4051070 con 0x55829bbb5660 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.659+0000 7f09d5ffb640 1 -- 172.21.15.53:0/4103762370 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09e403d8e0 con 0x55829bbb5660 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.659+0000 7f09d5ffb640 1 -- 172.21.15.53:0/4103762370 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4035070 con 0x55829bbb5660 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.660+0000 7f09fc8e9740 1 -- 172.21.15.53:0/4103762370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbb5660 msgr2=0x55829bf9b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.660+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/4103762370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbb5660 0x55829bf9b7a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009900 tx=0x7f09e402a410 comp rx=0 tx=0).stop 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.660+0000 7f09fc8e9740 1 -- 172.21.15.53:0/4103762370 shutdown_connections 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.660+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/4103762370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbbd840 0x55829bf912b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.660+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/4103762370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bbb5660 0x55829bf9b7a0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.660+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/4103762370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bb9cea0 0x55829bf85670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.660+0000 7f09fc8e9740 1 -- 172.21.15.53:0/4103762370 >> 172.21.15.53:0/4103762370 conn(0x55829bbd2910 msgr2=0x55829bf90ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.660+0000 7f09fc8e9740 1 -- 172.21.15.53:0/4103762370 shutdown_connections 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.660+0000 7f09fc8e9740 1 -- 172.21.15.53:0/4103762370 wait complete. 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.660+0000 7f09fc8e9740 1 -- start start 2024-08-31T06:15:41.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09fc8e9740 1 Processor -- start 2024-08-31T06:15:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bb9cea0 0x55829bf98090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbbd840 0x55829bf945a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09fc8e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbde520 0x55829bf94b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f09f01b0ae0 con 0x55829bb9cea0 2024-08-31T06:15:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f09f01b0380 con 0x55829bbde520 2024-08-31T06:15:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09fc8e9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f09f01ad520 con 0x55829bbbd840 2024-08-31T06:15:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09fc8e9740 10 client.0 _ll_register_callbacks cb 0x7f09e80abf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bb9cea0 0x55829bf98090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bb9cea0 0x55829bf98090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35860/0 (socket says 172.21.15.53:35860) 2024-08-31T06:15:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09effff640 1 -- 172.21.15.53:0/3808093824 learned_addr learned my addr 172.21.15.53:0/3808093824 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:41.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.661+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbbd840 0x55829bf945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.662+0000 7f09f4911640 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbde520 0x55829bf94b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.662+0000 7f09ef7fe640 1 -- 172.21.15.53:0/3808093824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbde520 msgr2=0x55829bf94b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.662+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbde520 0x55829bf94b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.662+0000 7f09ef7fe640 1 -- 172.21.15.53:0/3808093824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bb9cea0 msgr2=0x55829bf98090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.662+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bb9cea0 0x55829bf98090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.662+0000 7f09ef7fe640 1 -- 172.21.15.53:0/3808093824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55829bf95310 con 0x55829bbbd840 2024-08-31T06:15:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.662+0000 7f09effff640 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bb9cea0 0x55829bf98090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.662+0000 7f09ef7fe640 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbbd840 0x55829bf945a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55829bf9c8f0 tx=0x7f09e403d660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ada2a076694670d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:41.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.662+0000 7f09cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.664+0000 7f09cf7fe640 1 -- 172.21.15.53:0/3808093824 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4035040 con 0x55829bbbd840 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.664+0000 7f09cf7fe640 1 -- 172.21.15.53:0/3808093824 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f09e403dca0 con 0x55829bbbd840 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.664+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3808093824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09e403d8e0 con 0x55829bbbd840 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.664+0000 7f09cf7fe640 1 -- 172.21.15.53:0/3808093824 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f09e4051040 con 0x55829bbbd840 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.664+0000 7f09fc8e9740 10 client.28129 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.664+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3808093824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55829c0119e0 con 0x55829bbbd840 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.664+0000 7f09cf7fe640 1 -- 172.21.15.53:0/3808093824 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09e403d8e0 con 0x55829bbbd840 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.665+0000 7f09cf7fe640 1 -- 172.21.15.53:0/3808093824 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7f09e4004200 con 0x55829bbbd840 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.665+0000 7f09fc8e9740 10 client.28129 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.665+0000 7f09fc8e9740 10 client.28129 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.665+0000 7f09fc8e9740 20 client.28129 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.665+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55829bb72250 0x55829c013bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:41.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.665+0000 7f09fc8e9740 4 client.28129 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "37dd47d", "release": true, "await": true}] 2024-08-31T06:15:41.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.665+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3808093824 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "37dd47d", "release": true, "await": true}) -- 0x55829bf8b230 con 0x55829bb72250 2024-08-31T06:15:41.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.665+0000 7f09effff640 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55829bb72250 0x55829c013bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:41.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.665+0000 7f09effff640 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55829bb72250 0x55829c013bc0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2cb6421230a88b7 server_cookie=2a5b348d6a424826 in_seq=0 out_seq=0 2024-08-31T06:15:41.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.665+0000 7f09cf7fe640 10 client.28129 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:41.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09cf7fe640 1 -- 172.21.15.53:0/3808093824 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55829bf8b230 con 0x55829bb72250 2024-08-31T06:15:41.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09cf7fe640 10 client.28129 handle_command_reply: tid=0 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 1 client.28129 shutdown 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3808093824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbbd840 msgr2=0x55829bf945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbbd840 0x55829bf945a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55829bf9c8f0 tx=0x7f09e403d660 comp rx=0 tx=0).stop 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3808093824 shutdown_connections 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55829bb72250 0x55829c013bc0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55829bbde520 0x55829bf94b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55829bbbd840 0x55829bf945a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09cf7fe640 0 client.28129 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 1 --2- 172.21.15.53:0/3808093824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55829bb9cea0 0x55829bf98090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3808093824 >> 172.21.15.53:0/3808093824 conn(0x55829bbd2910 msgr2=0x55829bf853b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3808093824 shutdown_connections 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 1 -- 172.21.15.53:0/3808093824 wait complete. 2024-08-31T06:15:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.683+0000 7f09fc8e9740 20 client.28129 trim_cache size 0 max 16384 2024-08-31T06:15:41.687 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:15:41.687 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 48, 2024-08-31T06:15:41.687 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:15:41.687 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 36, 2024-08-31T06:15:41.687 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:15:41.687 INFO:teuthology.orchestra.run.smithi053.stdout: "37dd47d": { 2024-08-31T06:15:41.687 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 36, 2024-08-31T06:15:41.687 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:15:41.687 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:15:41.687 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 145.2, 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:41.688 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:41.689 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:41.689 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:41.689 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:15:41.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 -- 172.21.15.53:0/3606293245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f09d80b4ca0 msgr2=0x7f09d80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:41.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f09d80b4ca0 0x7f09d80b71b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55829bf82900 tx=0x7f09e000b390 comp rx=0 tx=0).stop 2024-08-31T06:15:41.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 -- 172.21.15.53:0/3606293245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09f0108ab0 msgr2=0x7f09f019fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:41.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09f0108ab0 0x7f09f019fa50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f09e800eb10 tx=0x7f09e800c2d0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 -- 172.21.15.53:0/3606293245 shutdown_connections 2024-08-31T06:15:41.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f09d80b4ca0 0x7f09d80b71b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09f0108ab0 0x7f09f019fa50 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09f0108160 0x7f09f019a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 --2- 172.21.15.53:0/3606293245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09f0102820 0x7f09f019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:41.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 -- 172.21.15.53:0/3606293245 >> 172.21.15.53:0/3606293245 conn(0x7f09f00794e0 msgr2=0x7f09f006bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:41.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 -- 172.21.15.53:0/3606293245 shutdown_connections 2024-08-31T06:15:41.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:41.684+0000 7f09f6374640 1 -- 172.21.15.53:0/3606293245 wait complete. 2024-08-31T06:15:41.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:41 smithi153 ceph-mon[22320]: pgmap v655: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 30 KiB/s wr, 19 op/s 2024-08-31T06:15:41.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:41 smithi053 ceph-mon[18924]: pgmap v655: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 30 KiB/s wr, 19 op/s 2024-08-31T06:15:41.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171209 1.42 MB/sec execute 451 sec latency 23140.394 ms 2024-08-31T06:15:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:41 smithi130 ceph-mon[22266]: pgmap v655: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 30 KiB/s wr, 19 op/s 2024-08-31T06:15:42.512 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '37dd47d', total seconds elapsed: 28.6 2024-08-31T06:15:42.512 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.25 2024-08-31T06:15:42.512 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:15:42.808 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:42.994 INFO:tasks.workunit.client.0.smithi053.stdout: 1 171706 1.42 MB/sec execute 452 sec latency 18.020 ms 2024-08-31T06:15:43.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.351+0000 7f48f0e2a640 1 -- 172.21.15.53:0/907317021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48ec104620 msgr2=0x7f48ec104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:43.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.351+0000 7f48f0e2a640 1 --2- 172.21.15.53:0/907317021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48ec104620 0x7f48ec104a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009860 tx=0x7f48dc02a340 comp rx=0 tx=0).stop 2024-08-31T06:15:43.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.351+0000 7f48f0e2a640 1 -- 172.21.15.53:0/907317021 shutdown_connections 2024-08-31T06:15:43.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.351+0000 7f48f0e2a640 1 --2- 172.21.15.53:0/907317021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ec10dbd0 0x7f48ec1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:43.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.351+0000 7f48f0e2a640 1 --2- 172.21.15.53:0/907317021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48ec105050 0x7f48ec10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:43.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.351+0000 7f48f0e2a640 1 --2- 172.21.15.53:0/907317021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48ec104620 0x7f48ec104a30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:43.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.351+0000 7f48f0e2a640 1 -- 172.21.15.53:0/907317021 >> 172.21.15.53:0/907317021 conn(0x7f48ec0794d0 msgr2=0x7f48ec0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:43.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.351+0000 7f48f0e2a640 1 -- 172.21.15.53:0/907317021 shutdown_connections 2024-08-31T06:15:43.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.351+0000 7f48f0e2a640 1 -- 172.21.15.53:0/907317021 wait complete. 2024-08-31T06:15:43.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.352+0000 7f48f0e2a640 1 Processor -- start 2024-08-31T06:15:43.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.353+0000 7f48f0e2a640 1 -- start start 2024-08-31T06:15:43.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.353+0000 7f48f0e2a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48ec104620 0x7f48ec19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:43.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.353+0000 7f48f0e2a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48ec105050 0x7f48ec19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:43.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.353+0000 7f48ea59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48ec104620 0x7f48ec19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:43.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.353+0000 7f48ea59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48ec104620 0x7f48ec19a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:53574/0 (socket says 172.21.15.53:53574) 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.353+0000 7f48f0e2a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ec10dbd0 0x7f48ec19f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.353+0000 7f48e9d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48ec105050 0x7f48ec19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.353+0000 7f48e9d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48ec105050 0x7f48ec19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:45784/0 (socket says 172.21.15.53:45784) 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48ead9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ec10dbd0 0x7f48ec19f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48ead9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ec10dbd0 0x7f48ec19f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44896/0 (socket says 172.21.15.53:44896) 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48ead9d640 1 -- 172.21.15.53:0/3070234848 learned_addr learned my addr 172.21.15.53:0/3070234848 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec1136a0 con 0x7f48ec10dbd0 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec113520 con 0x7f48ec105050 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec113820 con 0x7f48ec104620 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48ead9d640 1 -- 172.21.15.53:0/3070234848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48ec104620 msgr2=0x7f48ec19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48ead9d640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48ec104620 0x7f48ec19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48ead9d640 1 -- 172.21.15.53:0/3070234848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48ec105050 msgr2=0x7f48ec19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48ead9d640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48ec105050 0x7f48ec19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48ead9d640 1 -- 172.21.15.53:0/3070234848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ec1a00e0 con 0x7f48ec10dbd0 2024-08-31T06:15:43.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.354+0000 7f48ead9d640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ec10dbd0 0x7f48ec19f9b0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f48e400eb10 tx=0x7f48e400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:43.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.355+0000 7f48db7fe640 1 -- 172.21.15.53:0/3070234848 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e400ce20 con 0x7f48ec10dbd0 2024-08-31T06:15:43.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.355+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ec1a03d0 con 0x7f48ec10dbd0 2024-08-31T06:15:43.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.355+0000 7f48db7fe640 1 -- 172.21.15.53:0/3070234848 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48e4005020 con 0x7f48ec10dbd0 2024-08-31T06:15:43.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.355+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ec1a6b30 con 0x7f48ec10dbd0 2024-08-31T06:15:43.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.356+0000 7f48db7fe640 1 -- 172.21.15.53:0/3070234848 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4010690 con 0x7f48ec10dbd0 2024-08-31T06:15:43.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.356+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48cc005290 con 0x7f48ec10dbd0 2024-08-31T06:15:43.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.358+0000 7f48db7fe640 1 -- 172.21.15.53:0/3070234848 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f48e4004a40 con 0x7f48ec10dbd0 2024-08-31T06:15:43.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.360+0000 7f48db7fe640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d40b4d20 0x7f48d40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:43.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.360+0000 7f48ea59c640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d40b4d20 0x7f48d40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:43.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.361+0000 7f48db7fe640 1 -- 172.21.15.53:0/3070234848 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f48e40e5a70 con 0x7f48ec10dbd0 2024-08-31T06:15:43.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.361+0000 7f48ea59c640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d40b4d20 0x7f48d40b7230 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f48dc005940 tx=0x7f48dc0058b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.364+0000 7f48db7fe640 1 -- 172.21.15.53:0/3070234848 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f48e4056130 con 0x7f48ec10dbd0 2024-08-31T06:15:43.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.626+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48cc005580 con 0x7f48ec10dbd0 2024-08-31T06:15:43.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.627+0000 7f48db7fe640 1 -- 172.21.15.53:0/3070234848 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+12004 (secure 0 0 0) 0x7f48e40ac840 con 0x7f48ec10dbd0 2024-08-31T06:15:43.630 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:15:43.630 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":48,"btime":"2024-08-31T06:15:21:610334+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:15:21.232855+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:15:43.630 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 48 2024-08-31T06:15:43.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d40b4d20 msgr2=0x7f48d40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:43.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d40b4d20 0x7f48d40b7230 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f48dc005940 tx=0x7f48dc0058b0 comp rx=0 tx=0).stop 2024-08-31T06:15:43.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ec10dbd0 msgr2=0x7f48ec19f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:43.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ec10dbd0 0x7f48ec19f9b0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f48e400eb10 tx=0x7f48e400ef10 comp rx=0 tx=0).stop 2024-08-31T06:15:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 shutdown_connections 2024-08-31T06:15:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f48d40b4d20 0x7f48d40b7230 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ec10dbd0 0x7f48ec19f9b0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48ec105050 0x7f48ec19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 --2- 172.21.15.53:0/3070234848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48ec104620 0x7f48ec19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 >> 172.21.15.53:0/3070234848 conn(0x7f48ec0794d0 msgr2=0x7f48ec100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 shutdown_connections 2024-08-31T06:15:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:43.630+0000 7f48f0e2a640 1 -- 172.21.15.53:0/3070234848 wait complete. 2024-08-31T06:15:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:43 smithi153 ceph-mon[22320]: pgmap v656: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-31T06:15:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:43 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3070234848' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:43.969 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:43 smithi053 ceph-mon[18924]: pgmap v656: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-31T06:15:43.969 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3070234848' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:43.993 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172148 1.42 MB/sec execute 453 sec latency 22.328 ms 2024-08-31T06:15:44.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.109+0000 7f52a7fc6640 1 -- 172.21.15.53:0/3053633547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52a0106fc0 msgr2=0x7f52a01073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:44.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.109+0000 7f52a7fc6640 1 --2- 172.21.15.53:0/3053633547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52a0106fc0 0x7f52a01073d0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f5290009900 tx=0x7f529002a410 comp rx=0 tx=0).stop 2024-08-31T06:15:44.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.109+0000 7f52a7fc6640 1 -- 172.21.15.53:0/3053633547 shutdown_connections 2024-08-31T06:15:44.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.109+0000 7f52a7fc6640 1 --2- 172.21.15.53:0/3053633547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52a0107910 0x7f52a0108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.109+0000 7f52a7fc6640 1 --2- 172.21.15.53:0/3053633547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52a0106fc0 0x7f52a01073d0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.109+0000 7f52a7fc6640 1 --2- 172.21.15.53:0/3053633547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52a0101e00 0x7f52a0102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.109+0000 7f52a7fc6640 1 -- 172.21.15.53:0/3053633547 >> 172.21.15.53:0/3053633547 conn(0x7f52a0079c30 msgr2=0x7f52a007a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:44.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.109+0000 7f52a7fc6640 1 -- 172.21.15.53:0/3053633547 shutdown_connections 2024-08-31T06:15:44.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.109+0000 7f52a7fc6640 1 -- 172.21.15.53:0/3053633547 wait complete. 2024-08-31T06:15:44.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a7fc6640 1 Processor -- start 2024-08-31T06:15:44.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a7fc6640 1 -- start start 2024-08-31T06:15:44.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a7fc6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52a0101e00 0x7f52a01a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a7fc6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52a0106fc0 0x7f52a01a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a7fc6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52a0107910 0x7f52a01a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a7fc6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0119c60 con 0x7f52a0101e00 2024-08-31T06:15:44.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a7fc6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0119ae0 con 0x7f52a0106fc0 2024-08-31T06:15:44.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a7fc6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0119de0 con 0x7f52a0107910 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a5d62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52a0101e00 0x7f52a01a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a5d62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52a0101e00 0x7f52a01a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44908/0 (socket says 172.21.15.53:44908) 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a5d62640 1 -- 172.21.15.53:0/2138952311 learned_addr learned my addr 172.21.15.53:0/2138952311 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a6563640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52a0107910 0x7f52a01a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.110+0000 7f52a5561640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52a0106fc0 0x7f52a01a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f52a5d62640 1 -- 172.21.15.53:0/2138952311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52a0107910 msgr2=0x7f52a01a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f52a5d62640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52a0107910 0x7f52a01a6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f52a5d62640 1 -- 172.21.15.53:0/2138952311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52a0106fc0 msgr2=0x7f52a01a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f52a5d62640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52a0106fc0 0x7f52a01a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f52a5d62640 1 -- 172.21.15.53:0/2138952311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a01a6710 con 0x7f52a0101e00 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f52a5561640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52a0106fc0 0x7f52a01a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f52a5d62640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52a0101e00 0x7f52a01a07e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f529c00e9f0 tx=0x7f529c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f5296ffd640 1 -- 172.21.15.53:0/2138952311 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c00cd80 con 0x7f52a0101e00 2024-08-31T06:15:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f52a7fc6640 1 -- 172.21.15.53:0/2138952311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a01a6a00 con 0x7f52a0101e00 2024-08-31T06:15:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f5296ffd640 1 -- 172.21.15.53:0/2138952311 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f529c0054b0 con 0x7f52a0101e00 2024-08-31T06:15:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f5296ffd640 1 -- 172.21.15.53:0/2138952311 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c010430 con 0x7f52a0101e00 2024-08-31T06:15:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.111+0000 7f52a7fc6640 1 -- 172.21.15.53:0/2138952311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a01ad190 con 0x7f52a0101e00 2024-08-31T06:15:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.114+0000 7f5296ffd640 1 -- 172.21.15.53:0/2138952311 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f529c0046c0 con 0x7f52a0101e00 2024-08-31T06:15:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.114+0000 7f52af017740 1 Processor -- start 2024-08-31T06:15:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.114+0000 7f52af017740 1 -- start start 2024-08-31T06:15:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52af017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9221b0 0x55b69ccc5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52af017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c8f92f0 0x55b69ccc6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52af017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 0x55b69ccc6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52af017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b69cc3b000 con 0x55b69c9221b0 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52af017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b69cc2a590 con 0x55b69c9014d0 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52af017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b69cc2e540 con 0x55b69c8f92f0 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52a6563640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9221b0 0x55b69ccc5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52a5d62640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c8f92f0 0x55b69ccc6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52a6563640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9221b0 0x55b69ccc5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44918/0 (socket says 172.21.15.53:44918) 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52a5561640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 0x55b69ccc6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52a6563640 1 -- 172.21.15.53:0/1016101017 learned_addr learned my addr 172.21.15.53:0/1016101017 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52a5561640 1 -- 172.21.15.53:0/1016101017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c8f92f0 msgr2=0x55b69ccc6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52a5561640 1 --2- 172.21.15.53:0/1016101017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c8f92f0 0x55b69ccc6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52a5561640 1 -- 172.21.15.53:0/1016101017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9221b0 msgr2=0x55b69ccc5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52a5561640 1 --2- 172.21.15.53:0/1016101017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9221b0 0x55b69ccc5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52a5561640 1 -- 172.21.15.53:0/1016101017 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69c98d790 con 0x55b69c9014d0 2024-08-31T06:15:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f5296ffd640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f528c0b4ca0 0x7f528c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.115+0000 7f52a6563640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f528c0b4ca0 0x7f528c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.116+0000 7f52a5561640 1 --2- 172.21.15.53:0/1016101017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 0x55b69ccc6760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f52a0075440 tx=0x7f5290032e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd74d3f52c3f070e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.116+0000 7f5296ffd640 1 -- 172.21.15.53:0/2138952311 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f529c0e58e0 con 0x7f52a0101e00 2024-08-31T06:15:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.116+0000 7f528bfff640 1 -- 172.21.15.53:0/1016101017 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290035040 con 0x55b69c9014d0 2024-08-31T06:15:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.116+0000 7f528bfff640 1 -- 172.21.15.53:0/1016101017 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52900044c0 con 0x55b69c9014d0 2024-08-31T06:15:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.116+0000 7f528bfff640 1 -- 172.21.15.53:0/1016101017 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290003c80 con 0x55b69c9014d0 2024-08-31T06:15:44.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.117+0000 7f52af017740 1 -- 172.21.15.53:0/1016101017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 msgr2=0x55b69ccc6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.117+0000 7f52af017740 1 --2- 172.21.15.53:0/1016101017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 0x55b69ccc6760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f52a0075440 tx=0x7f5290032e30 comp rx=0 tx=0).stop 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.117+0000 7f52a6563640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f528c0b4ca0 0x7f528c0b71b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5298011630 tx=0x7f5298009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.117+0000 7f52af017740 1 -- 172.21.15.53:0/1016101017 shutdown_connections 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.117+0000 7f52af017740 1 --2- 172.21.15.53:0/1016101017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 0x55b69ccc6760 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.117+0000 7f52af017740 1 --2- 172.21.15.53:0/1016101017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c8f92f0 0x55b69ccc6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.117+0000 7f52af017740 1 --2- 172.21.15.53:0/1016101017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9221b0 0x55b69ccc5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.117+0000 7f52af017740 1 -- 172.21.15.53:0/1016101017 >> 172.21.15.53:0/1016101017 conn(0x55b69c916300 msgr2=0x55b69ccc3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.117+0000 7f52af017740 1 -- 172.21.15.53:0/1016101017 shutdown_connections 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.117+0000 7f52af017740 1 -- 172.21.15.53:0/1016101017 wait complete. 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.118+0000 7f52af017740 1 -- start start 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.118+0000 7f52af017740 1 Processor -- start 2024-08-31T06:15:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.118+0000 7f52af017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c8f92f0 0x55b69ccd1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52af017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 0x55b69ccd1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52af017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c9221b0 0x55b69ccdd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52af017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b69cb63ab0 con 0x55b69c8f92f0 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52af017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b69cbb1680 con 0x55b69c9014d0 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52af017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b69ccd4400 con 0x55b69c9221b0 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a5d62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c8f92f0 0x55b69ccd1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52af017740 10 client.0 _ll_register_callbacks cb 0x55b69c939a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a5d62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c8f92f0 0x55b69ccd1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44924/0 (socket says 172.21.15.53:44924) 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a5d62640 1 -- 172.21.15.53:0/2241433226 learned_addr learned my addr 172.21.15.53:0/2241433226 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a5561640 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 0x55b69ccd1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a6563640 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c9221b0 0x55b69ccdd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a5561640 1 -- 172.21.15.53:0/2241433226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c9221b0 msgr2=0x55b69ccdd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a5561640 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c9221b0 0x55b69ccdd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a5561640 1 -- 172.21.15.53:0/2241433226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c8f92f0 msgr2=0x55b69ccd1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a5561640 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c8f92f0 0x55b69ccd1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a5561640 1 -- 172.21.15.53:0/2241433226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69ca06620 con 0x55b69c9014d0 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a5d62640 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c8f92f0 0x55b69ccd1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52a5561640 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 0x55b69ccd1f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52900057c0 tx=0x7f5290000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ca10e5370e3a020 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52897fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.119+0000 7f52897fa640 1 -- 172.21.15.53:0/2241433226 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529004e020 con 0x55b69c9014d0 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52af017740 1 -- 172.21.15.53:0/2241433226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b69cc3cf50 con 0x55b69c9014d0 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52897fa640 1 -- 172.21.15.53:0/2241433226 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f5290003a00 con 0x55b69c9014d0 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52897fa640 1 -- 172.21.15.53:0/2241433226 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f5290059050 con 0x55b69c9014d0 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52af017740 10 client.28148 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52af017740 1 -- 172.21.15.53:0/2241433226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b69cce04d0 con 0x55b69c9014d0 2024-08-31T06:15:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52897fa640 1 -- 172.21.15.53:0/2241433226 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b69cc3cf50 con 0x55b69c9014d0 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52897fa640 1 -- 172.21.15.53:0/2241433226 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7f529003c7b0 con 0x55b69c9014d0 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52af017740 10 client.28148 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52af017740 10 client.28148 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52af017740 20 client.28148 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52af017740 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b69c8e0d80 0x55b69cce3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52af017740 4 client.28148 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52af017740 1 -- 172.21.15.53:0/2241433226 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b69cc389f0 con 0x55b69c8e0d80 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.120+0000 7f52a5d62640 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b69c8e0d80 0x55b69cce3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.121+0000 7f52897fa640 10 client.28148 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.121+0000 7f52a5d62640 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b69c8e0d80 0x55b69cce3830 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d847d25d458059 server_cookie=d07df9c6bb3e2d3a in_seq=0 out_seq=0 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52897fa640 1 -- 172.21.15.53:0/2241433226 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b69cc389f0 con 0x55b69c8e0d80 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52897fa640 10 client.28148 handle_command_reply: tid=0 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52af017740 1 client.28148 shutdown 2024-08-31T06:15:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52af017740 1 -- 172.21.15.53:0/2241433226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 msgr2=0x55b69ccd1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52af017740 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 0x55b69ccd1f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52900057c0 tx=0x7f5290000bc0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52af017740 1 -- 172.21.15.53:0/2241433226 shutdown_connections 2024-08-31T06:15:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52af017740 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b69c8e0d80 0x55b69cce3830 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52af017740 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c9221b0 0x55b69ccdd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52af017740 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9014d0 0x55b69ccd1f40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52897fa640 0 client.28148 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52af017740 1 --2- 172.21.15.53:0/2241433226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c8f92f0 0x55b69ccd1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52af017740 1 -- 172.21.15.53:0/2241433226 >> 172.21.15.53:0/2241433226 conn(0x55b69c916300 msgr2=0x55b69ccc6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.122+0000 7f52af017740 1 -- 172.21.15.53:0/2241433226 shutdown_connections 2024-08-31T06:15:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.123+0000 7f52af017740 1 -- 172.21.15.53:0/2241433226 wait complete. 2024-08-31T06:15:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.123+0000 7f52af017740 20 client.28148 trim_cache size 0 max 16384 2024-08-31T06:15:44.131 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:43 smithi130 ceph-mon[22266]: pgmap v656: 97 pgs: 97 active+clean; 98 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-31T06:15:44.131 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:43 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3070234848' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:15:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.138+0000 7f52af017740 1 Processor -- start 2024-08-31T06:15:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.138+0000 7f52af017740 1 -- start start 2024-08-31T06:15:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.138+0000 7f52af017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c8f92f0 0x55b69ccd1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.138+0000 7f52af017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.138+0000 7f52af017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9221b0 0x55b69cccae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52af017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01b5af0 con 0x55b69c9014d0 2024-08-31T06:15:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52af017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01b7840 con 0x55b69c9221b0 2024-08-31T06:15:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52af017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01b61c0 con 0x55b69c8f92f0 2024-08-31T06:15:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52a5561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52a6563640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9221b0 0x55b69cccae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52a5561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44930/0 (socket says 172.21.15.53:44930) 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52a5d62640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c8f92f0 0x55b69ccd1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52a5561640 1 -- 172.21.15.53:0/3142333211 learned_addr learned my addr 172.21.15.53:0/3142333211 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52a5561640 1 -- 172.21.15.53:0/3142333211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c8f92f0 msgr2=0x55b69ccd1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52a5561640 1 --2- 172.21.15.53:0/3142333211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c8f92f0 0x55b69ccd1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52a5561640 1 -- 172.21.15.53:0/3142333211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9221b0 msgr2=0x55b69cccae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52a5561640 1 --2- 172.21.15.53:0/3142333211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9221b0 0x55b69cccae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52a5561640 1 -- 172.21.15.53:0/3142333211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69ccc8af0 con 0x55b69c9014d0 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f52a5561640 1 --2- 172.21.15.53:0/3142333211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd1ea0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f529003cb80 tx=0x7f5290009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0c62d5f028c76b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f528b7fe640 1 -- 172.21.15.53:0/3142333211 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529004e040 con 0x55b69c9014d0 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f528b7fe640 1 -- 172.21.15.53:0/3142333211 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5290062070 con 0x55b69c9014d0 2024-08-31T06:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.139+0000 7f528b7fe640 1 -- 172.21.15.53:0/3142333211 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290035040 con 0x55b69c9014d0 2024-08-31T06:15:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.141+0000 7f52af017740 1 -- 172.21.15.53:0/3142333211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 msgr2=0x55b69ccd1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.141+0000 7f52af017740 1 --2- 172.21.15.53:0/3142333211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd1ea0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f529003cb80 tx=0x7f5290009680 comp rx=0 tx=0).stop 2024-08-31T06:15:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.141+0000 7f52af017740 1 -- 172.21.15.53:0/3142333211 shutdown_connections 2024-08-31T06:15:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.141+0000 7f52af017740 1 --2- 172.21.15.53:0/3142333211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c9221b0 0x55b69cccae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.141+0000 7f52af017740 1 --2- 172.21.15.53:0/3142333211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd1ea0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.141+0000 7f52af017740 1 --2- 172.21.15.53:0/3142333211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c8f92f0 0x55b69ccd1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.141+0000 7f52af017740 1 -- 172.21.15.53:0/3142333211 >> 172.21.15.53:0/3142333211 conn(0x55b69c916300 msgr2=0x55b69cccffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.141+0000 7f52af017740 1 -- 172.21.15.53:0/3142333211 shutdown_connections 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.141+0000 7f52af017740 1 -- 172.21.15.53:0/3142333211 wait complete. 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.141+0000 7f52af017740 1 -- start start 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.141+0000 7f52af017740 1 Processor -- start 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52af017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c8f92f0 0x55b69ccd4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52af017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52af017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c9221b0 0x55b69cd4bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52af017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01b70b0 con 0x55b69c9014d0 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52af017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01b6950 con 0x55b69c8f92f0 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52af017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01b3af0 con 0x55b69c9221b0 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52af017740 10 client.0 _ll_register_callbacks cb 0x7f5290040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a5561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a5561640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44938/0 (socket says 172.21.15.53:44938) 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a5561640 1 -- 172.21.15.53:0/589579758 learned_addr learned my addr 172.21.15.53:0/589579758 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a5d62640 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c8f92f0 0x55b69ccd4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a6563640 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c9221b0 0x55b69cd4bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a5561640 1 -- 172.21.15.53:0/589579758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c9221b0 msgr2=0x55b69cd4bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a5561640 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c9221b0 0x55b69cd4bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a5561640 1 -- 172.21.15.53:0/589579758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c8f92f0 msgr2=0x55b69ccd4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a5561640 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c8f92f0 0x55b69ccd4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a5561640 1 -- 172.21.15.53:0/589579758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69ccd57e0 con 0x55b69c9014d0 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a5d62640 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c8f92f0 0x55b69ccd4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a6563640 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c9221b0 0x55b69cd4bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52a5561640 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd4f90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f52900057c0 tx=0x7f5290005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2f8890e2a26bc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52897fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.142+0000 7f52897fa640 1 -- 172.21.15.53:0/589579758 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529006b060 con 0x55b69c9014d0 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52897fa640 1 -- 172.21.15.53:0/589579758 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f529003c640 con 0x55b69c9014d0 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52af017740 1 -- 172.21.15.53:0/589579758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5290062070 con 0x55b69c9014d0 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52897fa640 1 -- 172.21.15.53:0/589579758 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f5290035070 con 0x55b69c9014d0 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52af017740 10 client.18993 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52af017740 1 -- 172.21.15.53:0/589579758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b69cd4d520 con 0x55b69c9014d0 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52897fa640 1 -- 172.21.15.53:0/589579758 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5290062070 con 0x55b69c9014d0 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52897fa640 1 -- 172.21.15.53:0/589579758 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7f52900667c0 con 0x55b69c9014d0 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52af017740 10 client.18993 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52af017740 10 client.18993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52af017740 20 client.18993 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52af017740 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b69c8b61c0 0x55b69cd4fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52af017740 4 client.18993 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:15:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52af017740 1 -- 172.21.15.53:0/589579758 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b69cc36130 con 0x55b69c8b61c0 2024-08-31T06:15:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.143+0000 7f52a5d62640 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b69c8b61c0 0x55b69cd4fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.144+0000 7f52897fa640 10 client.18993 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.144+0000 7f52a5d62640 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b69c8b61c0 0x55b69cd4fce0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84fd746023d317b5 server_cookie=f89ffcb43c933ad7 in_seq=0 out_seq=0 2024-08-31T06:15:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52897fa640 1 -- 172.21.15.53:0/589579758 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b69cc36130 con 0x55b69c8b61c0 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52897fa640 10 client.18993 handle_command_reply: tid=0 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 1 client.18993 shutdown 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 1 -- 172.21.15.53:0/589579758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 msgr2=0x55b69ccd4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd4f90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f52900057c0 tx=0x7f5290005990 comp rx=0 tx=0).stop 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 1 -- 172.21.15.53:0/589579758 shutdown_connections 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b69c8b61c0 0x55b69cd4fce0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b69c9221b0 0x55b69cd4bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69c9014d0 0x55b69ccd4f90 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52897fa640 0 client.18993 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 1 --2- 172.21.15.53:0/589579758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b69c8f92f0 0x55b69ccd4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 1 -- 172.21.15.53:0/589579758 >> 172.21.15.53:0/589579758 conn(0x55b69c916300 msgr2=0x55b69cccfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 1 -- 172.21.15.53:0/589579758 shutdown_connections 2024-08-31T06:15:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 1 -- 172.21.15.53:0/589579758 wait complete. 2024-08-31T06:15:44.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.163+0000 7f52af017740 20 client.18993 trim_cache size 0 max 16384 2024-08-31T06:15:44.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:15:44.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:15:44.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:15:44.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:15:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 -- 172.21.15.53:0/2138952311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f528c0b4ca0 msgr2=0x7f528c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f528c0b4ca0 0x7f528c0b71b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5298011630 tx=0x7f5298009500 comp rx=0 tx=0).stop 2024-08-31T06:15:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 -- 172.21.15.53:0/2138952311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52a0101e00 msgr2=0x7f52a01a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52a0101e00 0x7f52a01a07e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f529c00e9f0 tx=0x7f529c00edf0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 -- 172.21.15.53:0/2138952311 shutdown_connections 2024-08-31T06:15:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f528c0b4ca0 0x7f528c0b71b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52a0107910 0x7f52a01a6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52a0106fc0 0x7f52a01a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 --2- 172.21.15.53:0/2138952311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52a0101e00 0x7f52a01a07e0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 -- 172.21.15.53:0/2138952311 >> 172.21.15.53:0/2138952311 conn(0x7f52a0079c30 msgr2=0x7f52a0100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 -- 172.21.15.53:0/2138952311 shutdown_connections 2024-08-31T06:15:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:44.164+0000 7f52a7fc6640 1 -- 172.21.15.53:0/2138952311 wait complete. 2024-08-31T06:15:44.437 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0' 2024-08-31T06:15:44.438 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0 2024-08-31T06:15:44.727 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:44.994 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172699 1.42 MB/sec execute 454 sec latency 28.140 ms 2024-08-31T06:15:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.256+0000 7fbea3faf640 1 -- 172.21.15.53:0/1328562043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9c108190 msgr2=0x7fbe9c1085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.256+0000 7fbea3faf640 1 --2- 172.21.15.53:0/1328562043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9c108190 0x7fbe9c1085a0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009900 tx=0x7fbe8c02a410 comp rx=0 tx=0).stop 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.256+0000 7fbea3faf640 1 -- 172.21.15.53:0/1328562043 shutdown_connections 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.256+0000 7fbea3faf640 1 --2- 172.21.15.53:0/1328562043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe9c108ae0 0x7fbe9c10f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.256+0000 7fbea3faf640 1 --2- 172.21.15.53:0/1328562043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9c108190 0x7fbe9c1085a0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.256+0000 7fbea3faf640 1 --2- 172.21.15.53:0/1328562043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe9c1028a0 0x7fbe9c102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.256+0000 7fbea3faf640 1 -- 172.21.15.53:0/1328562043 >> 172.21.15.53:0/1328562043 conn(0x7fbe9c079470 msgr2=0x7fbe9c079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.256+0000 7fbea3faf640 1 -- 172.21.15.53:0/1328562043 shutdown_connections 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.256+0000 7fbea3faf640 1 -- 172.21.15.53:0/1328562043 wait complete. 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea3faf640 1 Processor -- start 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea3faf640 1 -- start start 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea3faf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe9c1028a0 0x7fbe9c199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea3faf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9c108190 0x7fbe9c1995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea3faf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe9c108ae0 0x7fbe9c19e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea3faf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c1125e0 con 0x7fbe9c108190 2024-08-31T06:15:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea3faf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c112460 con 0x7fbe9c108ae0 2024-08-31T06:15:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea3faf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c112760 con 0x7fbe9c1028a0 2024-08-31T06:15:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea154a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9c108190 0x7fbe9c1995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea154a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9c108190 0x7fbe9c1995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44948/0 (socket says 172.21.15.53:44948) 2024-08-31T06:15:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea154a640 1 -- 172.21.15.53:0/3804146996 learned_addr learned my addr 172.21.15.53:0/3804146996 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea1d4b640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe9c1028a0 0x7fbe9c199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea254c640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe9c108ae0 0x7fbe9c19e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea154a640 1 -- 172.21.15.53:0/3804146996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe9c1028a0 msgr2=0x7fbe9c199030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:45.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea154a640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe9c1028a0 0x7fbe9c199030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea154a640 1 -- 172.21.15.53:0/3804146996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe9c108ae0 msgr2=0x7fbe9c19e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea154a640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe9c108ae0 0x7fbe9c19e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.257+0000 7fbea154a640 1 -- 172.21.15.53:0/3804146996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c19efa0 con 0x7fbe9c108190 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.258+0000 7fbea154a640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9c108190 0x7fbe9c1995d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005940 tx=0x7fbe8c005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.258+0000 7fbe92ffd640 1 -- 172.21.15.53:0/3804146996 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c03f030 con 0x7fbe9c108190 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.258+0000 7fbea3faf640 1 -- 172.21.15.53:0/3804146996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9c19f230 con 0x7fbe9c108190 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.258+0000 7fbe92ffd640 1 -- 172.21.15.53:0/3804146996 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe8c0043d0 con 0x7fbe9c108190 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.258+0000 7fbe92ffd640 1 -- 172.21.15.53:0/3804146996 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c035070 con 0x7fbe9c108190 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.258+0000 7fbea3faf640 1 -- 172.21.15.53:0/3804146996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9c1a59f0 con 0x7fbe9c108190 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.261+0000 7fbe92ffd640 1 -- 172.21.15.53:0/3804146996 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbe8c042030 con 0x7fbe9c108190 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.261+0000 7fbeaa524740 1 Processor -- start 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.261+0000 7fbeaa524740 1 -- start start 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.261+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479268850 0x55e479613c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.261+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 0x55e4796111a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479247b70 0x55e479611850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbeaa524740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e479584380 con 0x55e47923f990 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea1d4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 0x55e4796111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbeaa524740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e479573910 con 0x55e479268850 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbeaa524740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e4795778c0 con 0x55e479247b70 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea254c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479268850 0x55e479613c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea1d4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 0x55e4796111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44950/0 (socket says 172.21.15.53:44950) 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea1d4b640 1 -- 172.21.15.53:0/249596777 learned_addr learned my addr 172.21.15.53:0/249596777 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea154a640 1 --2- 172.21.15.53:0/249596777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479247b70 0x55e479611850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea254c640 1 -- 172.21.15.53:0/249596777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479247b70 msgr2=0x55e479611850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbe92ffd640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe880b4ca0 0x7fbe880b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea254c640 1 --2- 172.21.15.53:0/249596777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479247b70 0x55e479611850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea254c640 1 -- 172.21.15.53:0/249596777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 msgr2=0x55e4796111a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea254c640 1 --2- 172.21.15.53:0/249596777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 0x55e4796111a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea254c640 1 -- 172.21.15.53:0/249596777 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4795104c0 con 0x55e479268850 2024-08-31T06:15:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea154a640 1 --2- 172.21.15.53:0/249596777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479247b70 0x55e479611850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:15:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea1d4b640 1 --2- 172.21.15.53:0/249596777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 0x55e4796111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea254c640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe880b4ca0 0x7fbe880b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbe92ffd640 1 -- 172.21.15.53:0/3804146996 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fbe8c105be0 con 0x7fbe9c108190 2024-08-31T06:15:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.262+0000 7fbea254c640 1 --2- 172.21.15.53:0/249596777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479268850 0x55e479613c70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009f00 tx=0x7fbe94011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c92d3a9a4c131d5c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.263+0000 7fbe87fff640 1 -- 172.21.15.53:0/249596777 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94004030 con 0x55e479268850 2024-08-31T06:15:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.263+0000 7fbe87fff640 1 -- 172.21.15.53:0/249596777 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe94004830 con 0x55e479268850 2024-08-31T06:15:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.263+0000 7fbe87fff640 1 -- 172.21.15.53:0/249596777 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9401c620 con 0x55e479268850 2024-08-31T06:15:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.264+0000 7fbeaa524740 1 -- 172.21.15.53:0/249596777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479268850 msgr2=0x55e479613c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.264+0000 7fbea254c640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe880b4ca0 0x7fbe880b71b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbe94020000 tx=0x7fbe94021000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.264+0000 7fbeaa524740 1 --2- 172.21.15.53:0/249596777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479268850 0x55e479613c70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009f00 tx=0x7fbe94011810 comp rx=0 tx=0).stop 2024-08-31T06:15:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.264+0000 7fbeaa524740 1 -- 172.21.15.53:0/249596777 shutdown_connections 2024-08-31T06:15:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.264+0000 7fbeaa524740 1 --2- 172.21.15.53:0/249596777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479247b70 0x55e479611850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.264+0000 7fbeaa524740 1 --2- 172.21.15.53:0/249596777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 0x55e4796111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.264+0000 7fbeaa524740 1 --2- 172.21.15.53:0/249596777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479268850 0x55e479613c70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.264+0000 7fbeaa524740 1 -- 172.21.15.53:0/249596777 >> 172.21.15.53:0/249596777 conn(0x55e47925cc40 msgr2=0x55e47960f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.264+0000 7fbeaa524740 1 -- 172.21.15.53:0/249596777 shutdown_connections 2024-08-31T06:15:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.264+0000 7fbeaa524740 1 -- 172.21.15.53:0/249596777 wait complete. 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.264+0000 7fbeaa524740 1 -- start start 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbeaa524740 1 Processor -- start 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e47923f990 0x55e47961eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e47961f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479268850 0x55e47961f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbeaa524740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e4793d67b0 con 0x55e479268850 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbeaa524740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e4794fa460 con 0x55e479247b70 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbeaa524740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e479621af0 con 0x55e47923f990 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbeaa524740 10 client.0 _ll_register_callbacks cb 0x55e47951ffd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbea154a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e47961f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbea254c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479268850 0x55e47961f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbea154a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e47961f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:45846/0 (socket says 172.21.15.53:45846) 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbea254c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479268850 0x55e47961f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44966/0 (socket says 172.21.15.53:44966) 2024-08-31T06:15:45.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbea154a640 1 -- 172.21.15.53:0/3619444268 learned_addr learned my addr 172.21.15.53:0/3619444268 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.265+0000 7fbea1d4b640 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e47923f990 0x55e47961eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.266+0000 7fbea254c640 1 -- 172.21.15.53:0/3619444268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e47923f990 msgr2=0x55e47961eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.266+0000 7fbea254c640 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e47923f990 0x55e47961eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.266+0000 7fbea254c640 1 -- 172.21.15.53:0/3619444268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 msgr2=0x55e47961f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.266+0000 7fbea254c640 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e47961f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.266+0000 7fbea254c640 1 -- 172.21.15.53:0/3619444268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4792e2ba0 con 0x55e479268850 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.266+0000 7fbea154a640 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e47961f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.266+0000 7fbea254c640 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479268850 0x55e47961f5d0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fbe94003f70 tx=0x7fbe94003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f07dd007e5f9250 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.266+0000 7fbe857fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.266+0000 7fbe857fa640 1 -- 172.21.15.53:0/3619444268 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9400f480 con 0x55e479268850 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.266+0000 7fbeaa524740 1 -- 172.21.15.53:0/3619444268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe94004830 con 0x55e479268850 2024-08-31T06:15:45.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.266+0000 7fbe857fa640 1 -- 172.21.15.53:0/3619444268 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fbe9400f620 con 0x55e479268850 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbe857fa640 1 -- 172.21.15.53:0/3619444268 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbe9403d050 con 0x55e479268850 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbeaa524740 10 client.19005 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbeaa524740 1 -- 172.21.15.53:0/3619444268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55e47962daa0 con 0x55e479268850 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbe857fa640 1 -- 172.21.15.53:0/3619444268 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe94004830 con 0x55e479268850 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbe857fa640 1 -- 172.21.15.53:0/3619444268 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7fbe9402f450 con 0x55e479268850 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbeaa524740 10 client.19005 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbeaa524740 10 client.19005 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbeaa524740 20 client.19005 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbeaa524740 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4792271d0 0x55e479630f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbeaa524740 4 client.19005 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbeaa524740 1 -- 172.21.15.53:0/3619444268 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4795862d0 con 0x55e4792271d0 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.267+0000 7fbea1d4b640 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4792271d0 0x55e479630f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.268+0000 7fbe857fa640 10 client.19005 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.268+0000 7fbea1d4b640 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4792271d0 0x55e479630f00 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9372c5655a3262a1 server_cookie=623cf3ab9650df16 in_seq=0 out_seq=0 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbe857fa640 1 -- 172.21.15.53:0/3619444268 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e4795862d0 con 0x55e4792271d0 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbe857fa640 10 client.19005 handle_command_reply: tid=0 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 1 client.19005 shutdown 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 1 -- 172.21.15.53:0/3619444268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479268850 msgr2=0x55e47961f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479268850 0x55e47961f5d0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fbe94003f70 tx=0x7fbe94003d90 comp rx=0 tx=0).stop 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 1 -- 172.21.15.53:0/3619444268 shutdown_connections 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4792271d0 0x55e479630f00 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479268850 0x55e47961f5d0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e47961f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 1 --2- 172.21.15.53:0/3619444268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e47923f990 0x55e47961eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbe857fa640 0 client.19005 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 1 -- 172.21.15.53:0/3619444268 >> 172.21.15.53:0/3619444268 conn(0x55e47925cc40 msgr2=0x55e4796163d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 1 -- 172.21.15.53:0/3619444268 shutdown_connections 2024-08-31T06:15:45.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 1 -- 172.21.15.53:0/3619444268 wait complete. 2024-08-31T06:15:45.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.269+0000 7fbeaa524740 20 client.19005 trim_cache size 0 max 16384 2024-08-31T06:15:45.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbeaa524740 1 Processor -- start 2024-08-31T06:15:45.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbeaa524740 1 -- start start 2024-08-31T06:15:45.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e47923f990 0x55e479612b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479247b70 0x55e47960e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479268850 0x55e479636700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbeaa524740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c1ad280 con 0x55e479247b70 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbeaa524740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c1aefd0 con 0x55e47923f990 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbeaa524740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c1ad950 con 0x55e479268850 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbea154a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479247b70 0x55e47960e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbea154a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479247b70 0x55e47960e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44968/0 (socket says 172.21.15.53:44968) 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbea154a640 1 -- 172.21.15.53:0/2050903491 learned_addr learned my addr 172.21.15.53:0/2050903491 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbea1d4b640 1 --2- 172.21.15.53:0/2050903491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e47923f990 0x55e479612b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.289+0000 7fbea254c640 1 --2- 172.21.15.53:0/2050903491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479268850 0x55e479636700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.290+0000 7fbea154a640 1 -- 172.21.15.53:0/2050903491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479268850 msgr2=0x55e479636700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.290+0000 7fbea154a640 1 --2- 172.21.15.53:0/2050903491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479268850 0x55e479636700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.290+0000 7fbea154a640 1 -- 172.21.15.53:0/2050903491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e47923f990 msgr2=0x55e479612b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.290+0000 7fbea154a640 1 --2- 172.21.15.53:0/2050903491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e47923f990 0x55e479612b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.290+0000 7fbea154a640 1 -- 172.21.15.53:0/2050903491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47960e210 con 0x55e479247b70 2024-08-31T06:15:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.290+0000 7fbea154a640 1 --2- 172.21.15.53:0/2050903491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479247b70 0x55e47960e9b0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0cc2f0 tx=0x7fbe8c0d5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1925dd25a51cba6f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:45.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.290+0000 7fbe877fe640 1 -- 172.21.15.53:0/2050903491 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c049040 con 0x55e479247b70 2024-08-31T06:15:45.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.290+0000 7fbe877fe640 1 -- 172.21.15.53:0/2050903491 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe8c0cbe70 con 0x55e479247b70 2024-08-31T06:15:45.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.290+0000 7fbe877fe640 1 -- 172.21.15.53:0/2050903491 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0c8780 con 0x55e479247b70 2024-08-31T06:15:45.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.291+0000 7fbeaa524740 1 -- 172.21.15.53:0/2050903491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479247b70 msgr2=0x55e47960e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:45.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.291+0000 7fbeaa524740 1 --2- 172.21.15.53:0/2050903491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479247b70 0x55e47960e9b0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0cc2f0 tx=0x7fbe8c0d5040 comp rx=0 tx=0).stop 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.291+0000 7fbeaa524740 1 -- 172.21.15.53:0/2050903491 shutdown_connections 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.291+0000 7fbeaa524740 1 --2- 172.21.15.53:0/2050903491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479268850 0x55e479636700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.291+0000 7fbeaa524740 1 --2- 172.21.15.53:0/2050903491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e479247b70 0x55e47960e9b0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.291+0000 7fbeaa524740 1 --2- 172.21.15.53:0/2050903491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e47923f990 0x55e479612b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.291+0000 7fbeaa524740 1 -- 172.21.15.53:0/2050903491 >> 172.21.15.53:0/2050903491 conn(0x55e47925cc40 msgr2=0x55e47961d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.291+0000 7fbeaa524740 1 -- 172.21.15.53:0/2050903491 shutdown_connections 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.291+0000 7fbeaa524740 1 -- 172.21.15.53:0/2050903491 wait complete. 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbeaa524740 1 -- start start 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbeaa524740 1 Processor -- start 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 0x55e479623db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e4796242f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbeaa524740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479268850 0x55e479624830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbeaa524740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c1ae840 con 0x55e47923f990 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbeaa524740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c1ae0e0 con 0x55e479247b70 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbeaa524740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c1ab280 con 0x55e479268850 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbeaa524740 10 client.0 _ll_register_callbacks cb 0x7fbe94009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbea154a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e4796242f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbea254c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479268850 0x55e479624830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbea154a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e4796242f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:45866/0 (socket says 172.21.15.53:45866) 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbea154a640 1 -- 172.21.15.53:0/1281538330 learned_addr learned my addr 172.21.15.53:0/1281538330 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.292+0000 7fbea1d4b640 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 0x55e479623db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.293+0000 7fbea154a640 1 -- 172.21.15.53:0/1281538330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479268850 msgr2=0x55e479624830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.293+0000 7fbea154a640 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479268850 0x55e479624830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.293+0000 7fbea154a640 1 -- 172.21.15.53:0/1281538330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 msgr2=0x55e479623db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.293+0000 7fbea154a640 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 0x55e479623db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.293+0000 7fbea154a640 1 -- 172.21.15.53:0/1281538330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e47969b910 con 0x55e479247b70 2024-08-31T06:15:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.293+0000 7fbea254c640 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479268850 0x55e479624830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.293+0000 7fbea1d4b640 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 0x55e479623db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.293+0000 7fbea154a640 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e4796242f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c1033c0 tx=0x7fbe8c0cc7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce5030302bd9e1fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.293+0000 7fbe857fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.293+0000 7fbe857fa640 1 -- 172.21.15.53:0/1281538330 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0c8760 con 0x55e479247b70 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.293+0000 7fbe857fa640 1 -- 172.21.15.53:0/1281538330 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fbe8c0d5350 con 0x55e479247b70 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbeaa524740 1 -- 172.21.15.53:0/1281538330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe8c0cbe70 con 0x55e479247b70 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbe857fa640 1 -- 172.21.15.53:0/1281538330 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbe8c0cc360 con 0x55e479247b70 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbeaa524740 10 client.28172 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbeaa524740 1 -- 172.21.15.53:0/1281538330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55e47969cb00 con 0x55e479247b70 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbe857fa640 1 -- 172.21.15.53:0/1281538330 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe8c0cbe70 con 0x55e479247b70 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbe857fa640 1 -- 172.21.15.53:0/1281538330 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7fbe8c0c7cd0 con 0x55e479247b70 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbeaa524740 10 client.28172 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbeaa524740 10 client.28172 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:15:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbeaa524740 20 client.28172 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbeaa524740 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4791fc580 0x55e47969f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbeaa524740 4 client.28172 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}] 2024-08-31T06:15:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbeaa524740 1 -- 172.21.15.53:0/1281538330 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}) -- 0x55e479581d70 con 0x55e4791fc580 2024-08-31T06:15:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.294+0000 7fbea1d4b640 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4791fc580 0x55e47969f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.295+0000 7fbe857fa640 10 client.28172 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.295+0000 7fbea1d4b640 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4791fc580 0x55e47969f350 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=605099a595edc561 server_cookie=f50025066500d4d3 in_seq=0 out_seq=0 2024-08-31T06:15:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbe857fa640 1 -- 172.21.15.53:0/1281538330 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e479581d70 con 0x55e4791fc580 2024-08-31T06:15:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbe857fa640 10 client.28172 handle_command_reply: tid=0 2024-08-31T06:15:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 1 client.28172 shutdown 2024-08-31T06:15:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 1 -- 172.21.15.53:0/1281538330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 msgr2=0x55e4796242f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e4796242f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c1033c0 tx=0x7fbe8c0cc7f0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 1 -- 172.21.15.53:0/1281538330 shutdown_connections 2024-08-31T06:15:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4791fc580 0x55e47969f350 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e479268850 0x55e479624830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbe857fa640 0 client.28172 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e479247b70 0x55e4796242f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 1 --2- 172.21.15.53:0/1281538330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e47923f990 0x55e479623db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 1 -- 172.21.15.53:0/1281538330 >> 172.21.15.53:0/1281538330 conn(0x55e47925cc40 msgr2=0x55e4796121d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 1 -- 172.21.15.53:0/1281538330 shutdown_connections 2024-08-31T06:15:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 1 -- 172.21.15.53:0/1281538330 wait complete. 2024-08-31T06:15:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.363+0000 7fbeaa524740 20 client.28172 trim_cache size 0 max 16384 2024-08-31T06:15:45.367 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:15:45.367 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 48, 2024-08-31T06:15:45.367 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:15:45.367 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 38, 2024-08-31T06:15:45.367 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "be9c6f0c": { 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 38, 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 145.2, 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:15:45.368 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:15:45.369 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:15:45.369 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:15:45.369 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:45.369 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:45.369 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:45.369 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:45.369 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:45.369 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:15:45.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 -- 172.21.15.53:0/3804146996 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe880b4ca0 msgr2=0x7fbe880b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:45.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe880b4ca0 0x7fbe880b71b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbe94020000 tx=0x7fbe94021000 comp rx=0 tx=0).stop 2024-08-31T06:15:45.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 -- 172.21.15.53:0/3804146996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9c108190 msgr2=0x7fbe9c1995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:45.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9c108190 0x7fbe9c1995d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005940 tx=0x7fbe8c005e30 comp rx=0 tx=0).stop 2024-08-31T06:15:45.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 -- 172.21.15.53:0/3804146996 shutdown_connections 2024-08-31T06:15:45.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbe880b4ca0 0x7fbe880b71b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbe9c108ae0 0x7fbe9c19e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe9c108190 0x7fbe9c1995d0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 --2- 172.21.15.53:0/3804146996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe9c1028a0 0x7fbe9c199030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:45.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 -- 172.21.15.53:0/3804146996 >> 172.21.15.53:0/3804146996 conn(0x7fbe9c079470 msgr2=0x7fbe9c105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:45.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 -- 172.21.15.53:0/3804146996 shutdown_connections 2024-08-31T06:15:45.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:45.364+0000 7fbea3faf640 1 -- 172.21.15.53:0/3804146996 wait complete. 2024-08-31T06:15:45.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:45 smithi153 ceph-mon[22320]: pgmap v657: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 131 KiB/s wr, 31 op/s 2024-08-31T06:15:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:45 smithi053 ceph-mon[18924]: pgmap v657: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 131 KiB/s wr, 31 op/s 2024-08-31T06:15:45.994 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.42 MB/sec execute 455 sec latency 650.971 ms 2024-08-31T06:15:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:45 smithi130 ceph-mon[22266]: pgmap v657: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 131 KiB/s wr, 31 op/s 2024-08-31T06:15:46.166 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'be9c6f0c', quiesce took 3.7 seconds. Will release after: 21.55 2024-08-31T06:15:46.994 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.42 MB/sec execute 456 sec latency 1651.088 ms 2024-08-31T06:15:47.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:47 smithi153 ceph-mon[22320]: pgmap v658: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 311 KiB/s wr, 38 op/s 2024-08-31T06:15:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:47 smithi053 ceph-mon[18924]: pgmap v658: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 311 KiB/s wr, 38 op/s 2024-08-31T06:15:47.994 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.41 MB/sec execute 457 sec latency 2651.136 ms 2024-08-31T06:15:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:47 smithi130 ceph-mon[22266]: pgmap v658: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 311 KiB/s wr, 38 op/s 2024-08-31T06:15:48.994 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.41 MB/sec execute 458 sec latency 3651.275 ms 2024-08-31T06:15:49.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:49 smithi153 ceph-mon[22320]: pgmap v659: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 392 KiB/s wr, 44 op/s 2024-08-31T06:15:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:49 smithi053 ceph-mon[18924]: pgmap v659: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 392 KiB/s wr, 44 op/s 2024-08-31T06:15:49.994 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.41 MB/sec execute 459 sec latency 4651.338 ms 2024-08-31T06:15:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:49 smithi130 ceph-mon[22266]: pgmap v659: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 392 KiB/s wr, 44 op/s 2024-08-31T06:15:50.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:15:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:15:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:15:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:50 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:15:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:15:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:15:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:15:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:50.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:50 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:15:50.994 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.40 MB/sec execute 460 sec latency 5651.433 ms 2024-08-31T06:15:51.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:15:51.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:51.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:51.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:51.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:51.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:51.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:51.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:15:51.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:15:51.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:15:51.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:50 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:15:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:51 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:15:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:51 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:15:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:51 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:15:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:51 smithi053 ceph-mon[18924]: pgmap v660: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 432 KiB/s wr, 54 op/s 2024-08-31T06:15:51.994 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.40 MB/sec execute 461 sec latency 6651.503 ms 2024-08-31T06:15:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:51 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:15:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:51 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:15:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:51 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:15:52.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:51 smithi130 ceph-mon[22266]: pgmap v660: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 432 KiB/s wr, 54 op/s 2024-08-31T06:15:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:51 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:15:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:51 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:15:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:51 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:15:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:51 smithi153 ceph-mon[22320]: pgmap v660: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 432 KiB/s wr, 54 op/s 2024-08-31T06:15:52.994 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.40 MB/sec execute 462 sec latency 7651.605 ms 2024-08-31T06:15:53.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:53 smithi053 ceph-mon[18924]: pgmap v661: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 433 KiB/s wr, 53 op/s 2024-08-31T06:15:53.994 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.40 MB/sec execute 463 sec latency 8651.717 ms 2024-08-31T06:15:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:53 smithi130 ceph-mon[22266]: pgmap v661: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 433 KiB/s wr, 53 op/s 2024-08-31T06:15:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:53 smithi153 ceph-mon[22320]: pgmap v661: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 433 KiB/s wr, 53 op/s 2024-08-31T06:15:54.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.39 MB/sec execute 464 sec latency 9651.828 ms 2024-08-31T06:15:55.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:55 smithi053 ceph-mon[18924]: pgmap v662: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 434 KiB/s wr, 56 op/s 2024-08-31T06:15:55.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.39 MB/sec execute 465 sec latency 10651.910 ms 2024-08-31T06:15:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:55 smithi130 ceph-mon[22266]: pgmap v662: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 434 KiB/s wr, 56 op/s 2024-08-31T06:15:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:55 smithi153 ceph-mon[22320]: pgmap v662: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 434 KiB/s wr, 56 op/s 2024-08-31T06:15:56.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.39 MB/sec execute 466 sec latency 11652.070 ms 2024-08-31T06:15:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.275+0000 7fa89c8f2640 1 -- 172.21.15.53:0/1101170951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa898102750 msgr2=0x7fa898102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.275+0000 7fa89c8f2640 1 --2- 172.21.15.53:0/1101170951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa898102750 0x7fa898102b60 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fa888009900 tx=0x7fa88802a410 comp rx=0 tx=0).stop 2024-08-31T06:15:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.275+0000 7fa89c8f2640 1 -- 172.21.15.53:0/1101170951 shutdown_connections 2024-08-31T06:15:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.275+0000 7fa89c8f2640 1 --2- 172.21.15.53:0/1101170951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8981089d0 0x7fa89810f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.275+0000 7fa89c8f2640 1 --2- 172.21.15.53:0/1101170951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa898108080 0x7fa898108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.275+0000 7fa89c8f2640 1 --2- 172.21.15.53:0/1101170951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa898102750 0x7fa898102b60 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.275+0000 7fa89c8f2640 1 -- 172.21.15.53:0/1101170951 >> 172.21.15.53:0/1101170951 conn(0x7fa89807a4e0 msgr2=0x7fa89807a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.275+0000 7fa89c8f2640 1 -- 172.21.15.53:0/1101170951 shutdown_connections 2024-08-31T06:15:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.275+0000 7fa89c8f2640 1 -- 172.21.15.53:0/1101170951 wait complete. 2024-08-31T06:15:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.276+0000 7fa89c8f2640 1 Processor -- start 2024-08-31T06:15:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.276+0000 7fa89c8f2640 1 -- start start 2024-08-31T06:15:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89c8f2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa898102750 0x7fa89819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89c8f2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa898108080 0x7fa89819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89c8f2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8981089d0 0x7fa89819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89c8f2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa898112550 con 0x7fa898102750 2024-08-31T06:15:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89c8f2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981123d0 con 0x7fa898108080 2024-08-31T06:15:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89c8f2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981126d0 con 0x7fa8981089d0 2024-08-31T06:15:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa898102750 0x7fa89819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa898102750 0x7fa89819a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36254/0 (socket says 172.21.15.53:36254) 2024-08-31T06:15:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89659c640 1 -- 172.21.15.53:0/2480620183 learned_addr learned my addr 172.21.15.53:0/2480620183 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa896d9d640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8981089d0 0x7fa89819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa895d9b640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa898108080 0x7fa89819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89659c640 1 -- 172.21.15.53:0/2480620183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8981089d0 msgr2=0x7fa89819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89659c640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8981089d0 0x7fa89819f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89659c640 1 -- 172.21.15.53:0/2480620183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa898108080 msgr2=0x7fa89819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89659c640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa898108080 0x7fa89819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89659c640 1 -- 172.21.15.53:0/2480620183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8981a0090 con 0x7fa898102750 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.277+0000 7fa89659c640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa898102750 0x7fa89819a160 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fa888009230 tx=0x7fa888004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.278+0000 7fa8877fe640 1 -- 172.21.15.53:0/2480620183 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88803f030 con 0x7fa898102750 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.278+0000 7fa8877fe640 1 -- 172.21.15.53:0/2480620183 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa888003a80 con 0x7fa898102750 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.278+0000 7fa89c8f2640 1 -- 172.21.15.53:0/2480620183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8981a0320 con 0x7fa898102750 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.278+0000 7fa8877fe640 1 -- 172.21.15.53:0/2480620183 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888035070 con 0x7fa898102750 2024-08-31T06:15:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.278+0000 7fa89c8f2640 1 -- 172.21.15.53:0/2480620183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8981a6b10 con 0x7fa898102750 2024-08-31T06:15:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.280+0000 7fa8a385e740 1 Processor -- start 2024-08-31T06:15:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa8a385e740 1 -- start start 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe831b0 0x560ad0226ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe5a2f0 0x560ad0227000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad0227540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa8a385e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560ad019c000 con 0x560acfe624d0 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa8a385e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560ad018b590 con 0x560acfe5a2f0 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa8a385e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560ad018f540 con 0x560acfe831b0 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa8877fe640 1 -- 172.21.15.53:0/2480620183 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa888042030 con 0x7fa898102750 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa895d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad0227540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa895d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad0227540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36266/0 (socket says 172.21.15.53:36266) 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa895d9b640 1 -- 172.21.15.53:0/2352558343 learned_addr learned my addr 172.21.15.53:0/2352558343 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa896d9d640 1 --2- 172.21.15.53:0/2352558343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe831b0 0x560ad0226ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa895d9b640 1 -- 172.21.15.53:0/2352558343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe831b0 msgr2=0x560ad0226ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa895d9b640 1 --2- 172.21.15.53:0/2352558343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe831b0 0x560ad0226ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa895d9b640 1 -- 172.21.15.53:0/2352558343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe5a2f0 msgr2=0x560ad0227000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa895d9b640 1 --2- 172.21.15.53:0/2352558343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe5a2f0 0x560ad0227000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.281+0000 7fa895d9b640 1 -- 172.21.15.53:0/2352558343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560acfeee790 con 0x560acfe624d0 2024-08-31T06:15:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.282+0000 7fa895d9b640 1 --2- 172.21.15.53:0/2352558343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad0227540 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00b690 tx=0x7fa88c00bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bee0875e12fc33 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.282+0000 7fa8877fe640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8800b4d20 0x7fa8800b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.282+0000 7fa884ff9640 1 -- 172.21.15.53:0/2352558343 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c003bd0 con 0x560acfe624d0 2024-08-31T06:15:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.282+0000 7fa896d9d640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8800b4d20 0x7fa8800b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.282+0000 7fa884ff9640 1 -- 172.21.15.53:0/2352558343 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa88c015070 con 0x560acfe624d0 2024-08-31T06:15:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.282+0000 7fa884ff9640 1 -- 172.21.15.53:0/2352558343 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c004c10 con 0x560acfe624d0 2024-08-31T06:15:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.282+0000 7fa8877fe640 1 -- 172.21.15.53:0/2480620183 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fa888105bd0 con 0x7fa898102750 2024-08-31T06:15:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa8a385e740 1 -- 172.21.15.53:0/2352558343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 msgr2=0x560ad0227540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2352558343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad0227540 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00b690 tx=0x7fa88c00bb50 comp rx=0 tx=0).stop 2024-08-31T06:15:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa896d9d640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8800b4d20 0x7fa8800b7230 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa890005fd0 tx=0x7fa890009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa8a385e740 1 -- 172.21.15.53:0/2352558343 shutdown_connections 2024-08-31T06:15:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2352558343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad0227540 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2352558343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe5a2f0 0x560ad0227000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2352558343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe831b0 0x560ad0226ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa8a385e740 1 -- 172.21.15.53:0/2352558343 >> 172.21.15.53:0/2352558343 conn(0x560acfe77300 msgr2=0x560ad02249b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa8a385e740 1 -- 172.21.15.53:0/2352558343 shutdown_connections 2024-08-31T06:15:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa8a385e740 1 -- 172.21.15.53:0/2352558343 wait complete. 2024-08-31T06:15:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa8a385e740 1 -- start start 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.283+0000 7fa8a385e740 1 Processor -- start 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe5a2f0 0x560ad02326f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe624d0 0x560ad0232c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe831b0 0x560ad023e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa8a385e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560ad00c4ab0 con 0x560acfe5a2f0 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa8a385e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560ad0112680 con 0x560acfe831b0 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa8a385e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560ad0235240 con 0x560acfe624d0 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa8a385e740 10 client.0 _ll_register_callbacks cb 0x560acfe9aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa89659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe5a2f0 0x560ad02326f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa89659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe5a2f0 0x560ad02326f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36272/0 (socket says 172.21.15.53:36272) 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa89659c640 1 -- 172.21.15.53:0/502334765 learned_addr learned my addr 172.21.15.53:0/502334765 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa896d9d640 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe831b0 0x560ad023e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa895d9b640 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe624d0 0x560ad0232c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa89659c640 1 -- 172.21.15.53:0/502334765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe624d0 msgr2=0x560ad0232c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa89659c640 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe624d0 0x560ad0232c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa89659c640 1 -- 172.21.15.53:0/502334765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe831b0 msgr2=0x560ad023e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa89659c640 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe831b0 0x560ad023e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa89659c640 1 -- 172.21.15.53:0/502334765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560acff67620 con 0x560acfe5a2f0 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa89659c640 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe5a2f0 0x560ad02326f0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fa8881033b0 tx=0x7fa8880cc1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd8991eacf77f34 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.284+0000 7fa87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa87dffb640 1 -- 172.21.15.53:0/502334765 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888049030 con 0x560acfe5a2f0 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa87dffb640 1 -- 172.21.15.53:0/502334765 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fa88803bc30 con 0x560acfe5a2f0 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa8a385e740 1 -- 172.21.15.53:0/502334765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa88c015070 con 0x560acfe5a2f0 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa87dffb640 1 -- 172.21.15.53:0/502334765 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa8880cbe60 con 0x560acfe5a2f0 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa8a385e740 10 client.19023 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa8a385e740 1 -- 172.21.15.53:0/502334765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x560ad0241360 con 0x560acfe5a2f0 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa87dffb640 1 -- 172.21.15.53:0/502334765 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa88c015070 con 0x560acfe5a2f0 2024-08-31T06:15:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa87dffb640 1 -- 172.21.15.53:0/502334765 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7fa8880cc5b0 con 0x560acfe5a2f0 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa8a385e740 10 client.19023 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa8a385e740 10 client.19023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa8a385e740 20 client.19023 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa8a385e740 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560acfe41d80 0x560ad0244930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa8a385e740 4 client.19023 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa8a385e740 1 -- 172.21.15.53:0/502334765 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ad019df50 con 0x560acfe41d80 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.285+0000 7fa895d9b640 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560acfe41d80 0x560ad0244930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.286+0000 7fa895d9b640 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560acfe41d80 0x560ad0244930 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8edd8ef62c359332 server_cookie=3ab72401305dec76 in_seq=0 out_seq=0 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.286+0000 7fa87dffb640 10 client.19023 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa87dffb640 1 -- 172.21.15.53:0/502334765 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560ad019df50 con 0x560acfe41d80 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa87dffb640 10 client.19023 handle_command_reply: tid=0 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 1 client.19023 shutdown 2024-08-31T06:15:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 1 -- 172.21.15.53:0/502334765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe5a2f0 msgr2=0x560ad02326f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe5a2f0 0x560ad02326f0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fa8881033b0 tx=0x7fa8880cc1e0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 1 -- 172.21.15.53:0/502334765 shutdown_connections 2024-08-31T06:15:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560acfe41d80 0x560ad0244930 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe831b0 0x560ad023e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe624d0 0x560ad0232c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa87dffb640 0 client.19023 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 1 --2- 172.21.15.53:0/502334765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe5a2f0 0x560ad02326f0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 1 -- 172.21.15.53:0/502334765 >> 172.21.15.53:0/502334765 conn(0x560acfe77300 msgr2=0x560ad0227af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 1 -- 172.21.15.53:0/502334765 shutdown_connections 2024-08-31T06:15:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 1 -- 172.21.15.53:0/502334765 wait complete. 2024-08-31T06:15:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.287+0000 7fa8a385e740 20 client.19023 trim_cache size 0 max 16384 2024-08-31T06:15:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa8a385e740 1 Processor -- start 2024-08-31T06:15:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa8a385e740 1 -- start start 2024-08-31T06:15:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe41d80 0x560ad022f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe5a2f0 0x560ad022fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad024a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa8a385e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981af2e0 con 0x560acfe624d0 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa8a385e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981b1030 con 0x560acfe41d80 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa8a385e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981af9b0 con 0x560acfe5a2f0 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa896d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad024a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa896d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad024a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36286/0 (socket says 172.21.15.53:36286) 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa896d9d640 1 -- 172.21.15.53:0/2317493816 learned_addr learned my addr 172.21.15.53:0/2317493816 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.302+0000 7fa895d9b640 1 --2- 172.21.15.53:0/2317493816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe5a2f0 0x560ad022fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.303+0000 7fa896d9d640 1 -- 172.21.15.53:0/2317493816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe5a2f0 msgr2=0x560ad022fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.303+0000 7fa89659c640 1 --2- 172.21.15.53:0/2317493816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe41d80 0x560ad022f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.303+0000 7fa896d9d640 1 --2- 172.21.15.53:0/2317493816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe5a2f0 0x560ad022fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.303+0000 7fa896d9d640 1 -- 172.21.15.53:0/2317493816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe41d80 msgr2=0x560ad022f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.303+0000 7fa896d9d640 1 --2- 172.21.15.53:0/2317493816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe41d80 0x560ad022f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.303+0000 7fa896d9d640 1 -- 172.21.15.53:0/2317493816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad02252b0 con 0x560acfe624d0 2024-08-31T06:15:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.303+0000 7fa89659c640 1 --2- 172.21.15.53:0/2317493816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe41d80 0x560ad022f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:15:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.303+0000 7fa896d9d640 1 --2- 172.21.15.53:0/2317493816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad024a0f0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fa890011820 tx=0x7fa890016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6345aff05b2e5972 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.303+0000 7fa87ffff640 1 -- 172.21.15.53:0/2317493816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8900219b0 con 0x560acfe624d0 2024-08-31T06:15:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.303+0000 7fa87ffff640 1 -- 172.21.15.53:0/2317493816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa890003970 con 0x560acfe624d0 2024-08-31T06:15:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.303+0000 7fa87ffff640 1 -- 172.21.15.53:0/2317493816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8900045c0 con 0x560acfe624d0 2024-08-31T06:15:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 -- 172.21.15.53:0/2317493816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 msgr2=0x560ad024a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2317493816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad024a0f0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fa890011820 tx=0x7fa890016000 comp rx=0 tx=0).stop 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 -- 172.21.15.53:0/2317493816 shutdown_connections 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2317493816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe624d0 0x560ad024a0f0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2317493816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe5a2f0 0x560ad022fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2317493816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe41d80 0x560ad022f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 -- 172.21.15.53:0/2317493816 >> 172.21.15.53:0/2317493816 conn(0x560acfe77300 msgr2=0x560ad0230d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 -- 172.21.15.53:0/2317493816 shutdown_connections 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 -- 172.21.15.53:0/2317493816 wait complete. 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 -- start start 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 Processor -- start 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe41d80 0x560ad0239010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe5a2f0 0x560ad02395f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe624d0 0x560ad02a7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981b08a0 con 0x560acfe41d80 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981b0140 con 0x560acfe5a2f0 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.304+0000 7fa8a385e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981ad2e0 con 0x560acfe624d0 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa8a385e740 10 client.0 _ll_register_callbacks cb 0x7fa888005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa89659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe41d80 0x560ad0239010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa89659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe41d80 0x560ad0239010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36298/0 (socket says 172.21.15.53:36298) 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa89659c640 1 -- 172.21.15.53:0/2554640573 learned_addr learned my addr 172.21.15.53:0/2554640573 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa896d9d640 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe624d0 0x560ad02a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa895d9b640 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe5a2f0 0x560ad02395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa89659c640 1 -- 172.21.15.53:0/2554640573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe624d0 msgr2=0x560ad02a7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa89659c640 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe624d0 0x560ad02a7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa89659c640 1 -- 172.21.15.53:0/2554640573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe5a2f0 msgr2=0x560ad02395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa89659c640 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe5a2f0 0x560ad02395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa89659c640 1 -- 172.21.15.53:0/2554640573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ad02a79d0 con 0x560acfe41d80 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa896d9d640 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe624d0 0x560ad02a7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa895d9b640 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe5a2f0 0x560ad02395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa89659c640 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe41d80 0x560ad0239010 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fa888103900 tx=0x7fa88803be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672ee14e50d9bca1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa87dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa87dffb640 1 -- 172.21.15.53:0/2554640573 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888049030 con 0x560acfe41d80 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa87dffb640 1 -- 172.21.15.53:0/2554640573 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fa888003800 con 0x560acfe41d80 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa8a385e740 1 -- 172.21.15.53:0/2554640573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa890003970 con 0x560acfe41d80 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa87dffb640 1 -- 172.21.15.53:0/2554640573 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa8880cbac0 con 0x560acfe41d80 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa8a385e740 10 client.19029 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.305+0000 7fa8a385e740 1 -- 172.21.15.53:0/2554640573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x560ad02afe00 con 0x560acfe41d80 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.306+0000 7fa87dffb640 1 -- 172.21.15.53:0/2554640573 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa890003970 con 0x560acfe41d80 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.306+0000 7fa87dffb640 1 -- 172.21.15.53:0/2554640573 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7fa8880e1bb0 con 0x560acfe41d80 2024-08-31T06:15:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.306+0000 7fa8a385e740 10 client.19029 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.306+0000 7fa8a385e740 10 client.19029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.306+0000 7fa8a385e740 20 client.19029 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.306+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560acfe831b0 0x560ad02b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.306+0000 7fa8a385e740 4 client.19029 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:15:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.306+0000 7fa8a385e740 1 -- 172.21.15.53:0/2554640573 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560ad01999f0 con 0x560acfe831b0 2024-08-31T06:15:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.306+0000 7fa895d9b640 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560acfe831b0 0x560ad02b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.307+0000 7fa895d9b640 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560acfe831b0 0x560ad02b24b0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a62b8062cb483b9c server_cookie=6b96503c8483dd97 in_seq=0 out_seq=0 2024-08-31T06:15:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.307+0000 7fa87dffb640 10 client.19029 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa87dffb640 1 -- 172.21.15.53:0/2554640573 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560ad01999f0 con 0x560acfe831b0 2024-08-31T06:15:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa87dffb640 10 client.19029 handle_command_reply: tid=0 2024-08-31T06:15:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 1 client.19029 shutdown 2024-08-31T06:15:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 1 -- 172.21.15.53:0/2554640573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe41d80 msgr2=0x560ad0239010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe41d80 0x560ad0239010 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fa888103900 tx=0x7fa88803be60 comp rx=0 tx=0).stop 2024-08-31T06:15:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 1 -- 172.21.15.53:0/2554640573 shutdown_connections 2024-08-31T06:15:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560acfe831b0 0x560ad02b24b0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560acfe624d0 0x560ad02a7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560acfe5a2f0 0x560ad02395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 1 --2- 172.21.15.53:0/2554640573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560acfe41d80 0x560ad0239010 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa87dffb640 0 client.19029 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 1 -- 172.21.15.53:0/2554640573 >> 172.21.15.53:0/2554640573 conn(0x560acfe77300 msgr2=0x560ad0233990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 1 -- 172.21.15.53:0/2554640573 shutdown_connections 2024-08-31T06:15:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 1 -- 172.21.15.53:0/2554640573 wait complete. 2024-08-31T06:15:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.329+0000 7fa8a385e740 20 client.19029 trim_cache size 0 max 16384 2024-08-31T06:15:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:15:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:15:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:15:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:15:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 -- 172.21.15.53:0/2480620183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8800b4d20 msgr2=0x7fa8800b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8800b4d20 0x7fa8800b7230 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa890005fd0 tx=0x7fa890009600 comp rx=0 tx=0).stop 2024-08-31T06:15:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 -- 172.21.15.53:0/2480620183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa898102750 msgr2=0x7fa89819a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa898102750 0x7fa89819a160 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fa888009230 tx=0x7fa888004270 comp rx=0 tx=0).stop 2024-08-31T06:15:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 -- 172.21.15.53:0/2480620183 shutdown_connections 2024-08-31T06:15:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8800b4d20 0x7fa8800b7230 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8981089d0 0x7fa89819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa898108080 0x7fa89819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 --2- 172.21.15.53:0/2480620183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa898102750 0x7fa89819a160 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 -- 172.21.15.53:0/2480620183 >> 172.21.15.53:0/2480620183 conn(0x7fa89807a4e0 msgr2=0x7fa898101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 -- 172.21.15.53:0/2480620183 shutdown_connections 2024-08-31T06:15:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:15:57.330+0000 7fa89c8f2640 1 -- 172.21.15.53:0/2480620183 wait complete. 2024-08-31T06:15:57.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:57 smithi053 ceph-mon[18924]: pgmap v663: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 330 KiB/s wr, 39 op/s 2024-08-31T06:15:57.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.38 MB/sec execute 467 sec latency 12652.154 ms 2024-08-31T06:15:58.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:57 smithi130 ceph-mon[22266]: pgmap v663: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 330 KiB/s wr, 39 op/s 2024-08-31T06:15:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:57 smithi153 ceph-mon[22320]: pgmap v663: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 330 KiB/s wr, 39 op/s 2024-08-31T06:15:58.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:15:58.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.38 MB/sec execute 468 sec latency 13652.199 ms 2024-08-31T06:15:59.177 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:15:59.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.790+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/3832444288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b28108ab0 msgr2=0x7f9b2810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:59.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.790+0000 7f9b2dcd2640 1 --2- 172.21.15.53:0/3832444288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b28108ab0 0x7f9b2810f2e0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009ca0 tx=0x7f9b2002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.790+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/3832444288 shutdown_connections 2024-08-31T06:15:59.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.790+0000 7f9b2dcd2640 1 --2- 172.21.15.53:0/3832444288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b28108ab0 0x7f9b2810f2e0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.790+0000 7f9b2dcd2640 1 --2- 172.21.15.53:0/3832444288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b28108160 0x7f9b28108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.790+0000 7f9b2dcd2640 1 --2- 172.21.15.53:0/3832444288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b28102820 0x7f9b28102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.790+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/3832444288 >> 172.21.15.53:0/3832444288 conn(0x7f9b280794e0 msgr2=0x7f9b280798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:59.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.790+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/3832444288 shutdown_connections 2024-08-31T06:15:59.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.790+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/3832444288 wait complete. 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.791+0000 7f9b2dcd2640 1 Processor -- start 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.791+0000 7f9b2dcd2640 1 -- start start 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b2dcd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b28102820 0x7f9b2819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b2dcd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b28108160 0x7f9b2819b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b2dcd2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b28108ab0 0x7f9b2819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b2dcd2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9b28112630 con 0x7f9b28102820 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b2dcd2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9b281124b0 con 0x7f9b28108160 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b2dcd2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9b281127b0 con 0x7f9b28108ab0 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b28102820 0x7f9b2819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b28102820 0x7f9b2819af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36318/0 (socket says 172.21.15.53:36318) 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b277fe640 1 -- 172.21.15.53:0/2161084588 learned_addr learned my addr 172.21.15.53:0/2161084588 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b1effd640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b28108160 0x7f9b2819b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b27fff640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b28108ab0 0x7f9b2819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b277fe640 1 -- 172.21.15.53:0/2161084588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b28108ab0 msgr2=0x7f9b2819b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b277fe640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b28108ab0 0x7f9b2819b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b277fe640 1 -- 172.21.15.53:0/2161084588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b28108160 msgr2=0x7f9b2819b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b277fe640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b28108160 0x7f9b2819b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b277fe640 1 -- 172.21.15.53:0/2161084588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b281a6200 con 0x7f9b28102820 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b277fe640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b28102820 0x7f9b2819af40 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800d770 tx=0x7f9b1800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b257fa640 1 -- 172.21.15.53:0/2161084588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18017070 con 0x7f9b28102820 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b257fa640 1 -- 172.21.15.53:0/2161084588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b180054b0 con 0x7f9b28102820 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/2161084588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b281a64f0 con 0x7f9b28102820 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.792+0000 7f9b257fa640 1 -- 172.21.15.53:0/2161084588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18004c60 con 0x7f9b28102820 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.793+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/2161084588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b281a69e0 con 0x7f9b28102820 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b34247740 1 Processor -- start 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b34247740 1 -- start start 2024-08-31T06:15:59.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b34247740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 0x55cc101ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b257fa640 1 -- 172.21.15.53:0/2161084588 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9b18010460 con 0x7f9b28102820 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b34247740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b34247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 0x55cc101add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b34247740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cc10124630 con 0x55cc0fe08070 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b34247740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cc10113bc0 con 0x55cc0fddf1b0 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b34247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cc10117b70 con 0x55cc0fde7390 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b27fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 0x55cc101ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b27fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 0x55cc101ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36334/0 (socket says 172.21.15.53:36334) 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b27fff640 1 -- 172.21.15.53:0/150727242 learned_addr learned my addr 172.21.15.53:0/150727242 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b277fe640 1 --2- 172.21.15.53:0/150727242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b1effd640 1 --2- 172.21.15.53:0/150727242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 0x55cc101add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b27fff640 1 -- 172.21.15.53:0/150727242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 msgr2=0x55cc101add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:59.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b27fff640 1 --2- 172.21.15.53:0/150727242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 0x55cc101add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b27fff640 1 -- 172.21.15.53:0/150727242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 msgr2=0x55cc101ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b27fff640 1 --2- 172.21.15.53:0/150727242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b27fff640 1 -- 172.21.15.53:0/150727242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0fe73650 con 0x55cc0fe08070 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b1effd640 1 --2- 172.21.15.53:0/150727242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 0x55cc101add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b27fff640 1 --2- 172.21.15.53:0/150727242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 0x55cc101ad2c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f9b2002ade0 tx=0x7f9b20009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a62beb0a8221c12 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b257fa640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b140b4ca0 0x7f9b140b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b277fe640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b140b4ca0 0x7f9b140b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.796+0000 7f9b1dffb640 1 -- 172.21.15.53:0/150727242 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20031980 con 0x55cc0fe08070 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b1dffb640 1 -- 172.21.15.53:0/150727242 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b20036070 con 0x55cc0fe08070 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b1dffb640 1 -- 172.21.15.53:0/150727242 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b200042a0 con 0x55cc0fe08070 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b257fa640 1 -- 172.21.15.53:0/2161084588 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f9b180e50e0 con 0x7f9b28102820 2024-08-31T06:15:59.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b34247740 1 -- 172.21.15.53:0/150727242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 msgr2=0x55cc101ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b277fe640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b140b4ca0 0x7f9b140b71b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9b180e28c0 tx=0x7f9b180e8c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b34247740 1 --2- 172.21.15.53:0/150727242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 0x55cc101ad2c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f9b2002ade0 tx=0x7f9b20009490 comp rx=0 tx=0).stop 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b34247740 1 -- 172.21.15.53:0/150727242 shutdown_connections 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b34247740 1 --2- 172.21.15.53:0/150727242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 0x55cc101add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b34247740 1 --2- 172.21.15.53:0/150727242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b34247740 1 --2- 172.21.15.53:0/150727242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 0x55cc101ad2c0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b34247740 1 -- 172.21.15.53:0/150727242 >> 172.21.15.53:0/150727242 conn(0x55cc0fdfc460 msgr2=0x55cc101ab1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b34247740 1 -- 172.21.15.53:0/150727242 shutdown_connections 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.797+0000 7f9b34247740 1 -- 172.21.15.53:0/150727242 wait complete. 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.798+0000 7f9b34247740 1 -- start start 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.798+0000 7f9b34247740 1 Processor -- start 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.798+0000 7f9b34247740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.798+0000 7f9b34247740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fde7390 0x55cc101b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.798+0000 7f9b34247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fe08070 0x55cc101c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.798+0000 7f9b34247740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cc0ff76700 con 0x55cc0fde7390 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.798+0000 7f9b34247740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cc1009a700 con 0x55cc0fddf1b0 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.798+0000 7f9b34247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cc101bfe50 con 0x55cc0fe08070 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.798+0000 7f9b34247740 10 client.0 _ll_register_callbacks cb 0x55cc100c9dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.798+0000 7f9b1effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fde7390 0x55cc101b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.798+0000 7f9b1effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fde7390 0x55cc101b8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36344/0 (socket says 172.21.15.53:36344) 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b1effd640 1 -- 172.21.15.53:0/3075431859 learned_addr learned my addr 172.21.15.53:0/3075431859 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b27fff640 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b27fff640 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fe08070 0x55cc101c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b1effd640 1 -- 172.21.15.53:0/3075431859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fe08070 msgr2=0x55cc101c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b1effd640 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fe08070 0x55cc101c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b1effd640 1 -- 172.21.15.53:0/3075431859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 msgr2=0x55cc101b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:59.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b1effd640 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101b8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b1effd640 1 -- 172.21.15.53:0/3075431859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc100d38b0 con 0x55cc0fde7390 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b27fff640 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b1effd640 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fde7390 0x55cc101b8fa0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000afa0 tx=0x7f9b1000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80865f27e98b074b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b06ffd640 1 -- 172.21.15.53:0/3075431859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10005220 con 0x55cc0fde7390 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b06ffd640 1 -- 172.21.15.53:0/3075431859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f9b100053c0 con 0x55cc0fde7390 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b34247740 1 -- 172.21.15.53:0/3075431859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b20036070 con 0x55cc0fde7390 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b06ffd640 1 -- 172.21.15.53:0/3075431859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f9b100055c0 con 0x55cc0fde7390 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b34247740 10 client.19041 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.799+0000 7f9b34247740 1 -- 172.21.15.53:0/3075431859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55cc101cbc20 con 0x55cc0fde7390 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.800+0000 7f9b06ffd640 1 -- 172.21.15.53:0/3075431859 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b20036070 con 0x55cc0fde7390 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.800+0000 7f9b06ffd640 1 -- 172.21.15.53:0/3075431859 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7f9b10011b90 con 0x55cc0fde7390 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.800+0000 7f9b34247740 10 client.19041 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.800+0000 7f9b34247740 10 client.19041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.800+0000 7f9b34247740 20 client.19041 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.800+0000 7f9b34247740 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc0fdc69f0 0x55cc101cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.800+0000 7f9b34247740 4 client.19041 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.800+0000 7f9b34247740 1 -- 172.21.15.53:0/3075431859 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc10126580 con 0x55cc0fdc69f0 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.800+0000 7f9b27fff640 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc0fdc69f0 0x55cc101cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.801+0000 7f9b27fff640 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc0fdc69f0 0x55cc101cf140 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e2dc618059df59 server_cookie=fea877be51fcefeb in_seq=0 out_seq=0 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.801+0000 7f9b06ffd640 10 client.19041 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.801+0000 7f9b06ffd640 1 -- 172.21.15.53:0/3075431859 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc10126580 con 0x55cc0fdc69f0 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.801+0000 7f9b06ffd640 10 client.19041 handle_command_reply: tid=0 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.801+0000 7f9b34247740 1 client.19041 shutdown 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b34247740 1 -- 172.21.15.53:0/3075431859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fde7390 msgr2=0x55cc101b8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b34247740 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fde7390 0x55cc101b8fa0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000afa0 tx=0x7f9b1000f7f0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b34247740 1 -- 172.21.15.53:0/3075431859 shutdown_connections 2024-08-31T06:15:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b34247740 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc0fdc69f0 0x55cc101cf140 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b34247740 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fe08070 0x55cc101c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b34247740 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fde7390 0x55cc101b8fa0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b06ffd640 0 client.19041 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b34247740 1 --2- 172.21.15.53:0/3075431859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b34247740 1 -- 172.21.15.53:0/3075431859 >> 172.21.15.53:0/3075431859 conn(0x55cc0fdfc460 msgr2=0x55cc101b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b34247740 1 -- 172.21.15.53:0/3075431859 shutdown_connections 2024-08-31T06:15:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b34247740 1 -- 172.21.15.53:0/3075431859 wait complete. 2024-08-31T06:15:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.802+0000 7f9b34247740 20 client.19041 trim_cache size 0 max 16384 2024-08-31T06:15:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b34247740 1 Processor -- start 2024-08-31T06:15:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b34247740 1 -- start start 2024-08-31T06:15:59.823 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:15:59 smithi053 ceph-mon[18924]: pgmap v664: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 134 KiB/s wr, 29 op/s 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b34247740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b34247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 0x55cc101b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b34247740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 0x55cc101b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b34247740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9b281ad290 con 0x55cc0fe08070 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b34247740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9b281aefe0 con 0x55cc0fddf1b0 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b34247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9b281ad960 con 0x55cc0fde7390 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b27fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b27fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101b89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:42454/0 (socket says 172.21.15.53:42454) 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b27fff640 1 -- 172.21.15.53:0/3047983124 learned_addr learned my addr 172.21.15.53:0/3047983124 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b27fff640 1 --2- 172.21.15.53:0/3047983124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 0x55cc101b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.820+0000 7f9b1effd640 1 --2- 172.21.15.53:0/3047983124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 0x55cc101b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.821+0000 7f9b27fff640 1 -- 172.21.15.53:0/3047983124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 msgr2=0x55cc101b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.821+0000 7f9b27fff640 1 --2- 172.21.15.53:0/3047983124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 0x55cc101b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.821+0000 7f9b27fff640 1 -- 172.21.15.53:0/3047983124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 msgr2=0x55cc101b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.821+0000 7f9b27fff640 1 --2- 172.21.15.53:0/3047983124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 0x55cc101b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.821+0000 7f9b27fff640 1 -- 172.21.15.53:0/3047983124 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc101b79c0 con 0x55cc0fddf1b0 2024-08-31T06:15:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.821+0000 7f9b1effd640 1 --2- 172.21.15.53:0/3047983124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 0x55cc101b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:15:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.821+0000 7f9b27fff640 1 --2- 172.21.15.53:0/3047983124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101b89d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9b20000f80 tx=0x7f9b20003f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e2d602f5158799d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.821+0000 7f9b1d7fa640 1 -- 172.21.15.53:0/3047983124 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20049040 con 0x55cc0fddf1b0 2024-08-31T06:15:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.821+0000 7f9b1d7fa640 1 -- 172.21.15.53:0/3047983124 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b20036070 con 0x55cc0fddf1b0 2024-08-31T06:15:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.821+0000 7f9b1d7fa640 1 -- 172.21.15.53:0/3047983124 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b200305c0 con 0x55cc0fddf1b0 2024-08-31T06:15:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.822+0000 7f9b34247740 1 -- 172.21.15.53:0/3047983124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 msgr2=0x55cc101b89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.822+0000 7f9b34247740 1 --2- 172.21.15.53:0/3047983124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101b89d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9b20000f80 tx=0x7f9b20003f00 comp rx=0 tx=0).stop 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.822+0000 7f9b34247740 1 -- 172.21.15.53:0/3047983124 shutdown_connections 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.822+0000 7f9b34247740 1 --2- 172.21.15.53:0/3047983124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fe08070 0x55cc101b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.822+0000 7f9b34247740 1 --2- 172.21.15.53:0/3047983124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fde7390 0x55cc101b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.822+0000 7f9b34247740 1 --2- 172.21.15.53:0/3047983124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fddf1b0 0x55cc101b89d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.822+0000 7f9b34247740 1 -- 172.21.15.53:0/3047983124 >> 172.21.15.53:0/3047983124 conn(0x55cc0fdfc460 msgr2=0x55cc101b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.822+0000 7f9b34247740 1 -- 172.21.15.53:0/3047983124 shutdown_connections 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.822+0000 7f9b34247740 1 -- 172.21.15.53:0/3047983124 wait complete. 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.822+0000 7f9b34247740 1 -- start start 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b34247740 1 Processor -- start 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b34247740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fddf1b0 0x55cc101c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b34247740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fde7390 0x55cc101c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b34247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fe08070 0x55cc101bcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b34247740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9b281ae850 con 0x55cc0fddf1b0 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b34247740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9b281ae0f0 con 0x55cc0fde7390 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b34247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9b281ab290 con 0x55cc0fe08070 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b34247740 10 client.0 _ll_register_callbacks cb 0x7f9b1000a310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b27fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fddf1b0 0x55cc101c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b27fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fddf1b0 0x55cc101c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36364/0 (socket says 172.21.15.53:36364) 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b27fff640 1 -- 172.21.15.53:0/4126200808 learned_addr learned my addr 172.21.15.53:0/4126200808 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b1effd640 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fde7390 0x55cc101c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b27fff640 1 -- 172.21.15.53:0/4126200808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fe08070 msgr2=0x55cc101bcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b27fff640 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fe08070 0x55cc101bcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b27fff640 1 -- 172.21.15.53:0/4126200808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fde7390 msgr2=0x55cc101c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.823+0000 7f9b27fff640 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fde7390 0x55cc101c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.824+0000 7f9b27fff640 1 -- 172.21.15.53:0/4126200808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc101c5db0 con 0x55cc0fddf1b0 2024-08-31T06:15:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.824+0000 7f9b27fff640 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fddf1b0 0x55cc101c50a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f9b20031920 tx=0x7f9b20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb2200247e103e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.824+0000 7f9b06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.824+0000 7f9b06ffd640 1 -- 172.21.15.53:0/4126200808 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20049040 con 0x55cc0fddf1b0 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.824+0000 7f9b06ffd640 1 -- 172.21.15.53:0/4126200808 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f9b20031980 con 0x55cc0fddf1b0 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.824+0000 7f9b34247740 1 -- 172.21.15.53:0/4126200808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b20036070 con 0x55cc0fddf1b0 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.824+0000 7f9b06ffd640 1 -- 172.21.15.53:0/4126200808 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f9b20031b80 con 0x55cc0fddf1b0 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.824+0000 7f9b34247740 10 client.19047 fetch_fsmap learned FSMap version 48 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.824+0000 7f9b34247740 1 -- 172.21.15.53:0/4126200808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55cc1023e880 con 0x55cc0fddf1b0 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.824+0000 7f9b06ffd640 1 -- 172.21.15.53:0/4126200808 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b20036070 con 0x55cc0fddf1b0 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.825+0000 7f9b06ffd640 1 -- 172.21.15.53:0/4126200808 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7f9b2004f040 con 0x55cc0fddf1b0 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.825+0000 7f9b34247740 10 client.19047 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.825+0000 7f9b34247740 10 client.19047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.825+0000 7f9b34247740 20 client.19047 populate_metadata read hostname 'smithi053' 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.825+0000 7f9b34247740 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc0fd9bda0 0x55cc10240c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:15:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.825+0000 7f9b34247740 4 client.19047 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.825+0000 7f9b34247740 1 -- 172.21.15.53:0/4126200808 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc10122020 con 0x55cc0fd9bda0 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.825+0000 7f9b1effd640 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc0fd9bda0 0x55cc10240c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.825+0000 7f9b1effd640 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc0fd9bda0 0x55cc10240c20 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a962320535fdbf61 server_cookie=eaccfbaec40eceec in_seq=0 out_seq=0 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.825+0000 7f9b06ffd640 10 client.19047 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b06ffd640 1 -- 172.21.15.53:0/4126200808 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x55cc10122020 con 0x55cc0fd9bda0 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b06ffd640 10 client.19047 handle_command_reply: tid=0 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 1 client.19047 shutdown 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 1 -- 172.21.15.53:0/4126200808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fddf1b0 msgr2=0x55cc101c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fddf1b0 0x55cc101c50a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f9b20031920 tx=0x7f9b20009bb0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 1 -- 172.21.15.53:0/4126200808 shutdown_connections 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc0fd9bda0 0x55cc10240c20 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc0fe08070 0x55cc101bcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc0fde7390 0x55cc101c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b06ffd640 0 client.19047 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:15:59.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 1 --2- 172.21.15.53:0/4126200808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc0fddf1b0 0x55cc101c50a0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 1 -- 172.21.15.53:0/4126200808 >> 172.21.15.53:0/4126200808 conn(0x55cc0fdfc460 msgr2=0x55cc101ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:59.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 1 -- 172.21.15.53:0/4126200808 shutdown_connections 2024-08-31T06:15:59.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 1 -- 172.21.15.53:0/4126200808 wait complete. 2024-08-31T06:15:59.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.826+0000 7f9b34247740 20 client.19047 trim_cache size 0 max 16384 2024-08-31T06:15:59.834 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:15:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:15:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:15:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:15:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:15:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:15:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.836 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.837 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.837 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.837 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.837 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:15:59.838 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:15:59.838 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.838 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.838 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.838 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:15:59.839 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.840 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.841 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.842 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.842 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.842 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.842 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:15:59.843 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:15:59.843 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.843 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.843 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.843 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.843 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.843 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:15:59.843 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:15:59.843 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.843 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:15:59.844 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:15:59.845 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:15:59.846 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:59.846 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:15:59.846 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:15:59.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/2161084588 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b140b4ca0 msgr2=0x7f9b140b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:59.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b140b4ca0 0x7f9b140b71b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9b180e28c0 tx=0x7f9b180e8c30 comp rx=0 tx=0).stop 2024-08-31T06:15:59.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/2161084588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b28102820 msgr2=0x7f9b2819af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:15:59.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b28102820 0x7f9b2819af40 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800d770 tx=0x7f9b1800dc30 comp rx=0 tx=0).stop 2024-08-31T06:15:59.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/2161084588 shutdown_connections 2024-08-31T06:15:59.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9b140b4ca0 0x7f9b140b71b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b28108ab0 0x7f9b2819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b28108160 0x7f9b2819b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 --2- 172.21.15.53:0/2161084588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b28102820 0x7f9b2819af40 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:15:59.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/2161084588 >> 172.21.15.53:0/2161084588 conn(0x7f9b280794e0 msgr2=0x7f9b28104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:15:59.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/2161084588 shutdown_connections 2024-08-31T06:15:59.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:15:59.827+0000 7f9b2dcd2640 1 -- 172.21.15.53:0/2161084588 wait complete. 2024-08-31T06:15:59.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.38 MB/sec execute 469 sec latency 14652.279 ms 2024-08-31T06:16:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:15:59 smithi130 ceph-mon[22266]: pgmap v664: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 134 KiB/s wr, 29 op/s 2024-08-31T06:16:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:15:59 smithi153 ceph-mon[22320]: pgmap v664: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 134 KiB/s wr, 29 op/s 2024-08-31T06:16:00.606 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:16:00.607 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:16:00.859 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:00.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.37 MB/sec execute 470 sec latency 15652.355 ms 2024-08-31T06:16:01.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.380+0000 7f7137a39640 1 -- 172.21.15.53:0/3508375595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7130104750 msgr2=0x7f7130104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:01.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.380+0000 7f7137a39640 1 --2- 172.21.15.53:0/3508375595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7130104750 0x7f7130104b60 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f712c009900 tx=0x7f712c02a410 comp rx=0 tx=0).stop 2024-08-31T06:16:01.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.380+0000 7f7137a39640 1 -- 172.21.15.53:0/3508375595 shutdown_connections 2024-08-31T06:16:01.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.380+0000 7f7137a39640 1 --2- 172.21.15.53:0/3508375595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f713010dbb0 0x7f71301100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:01.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.380+0000 7f7137a39640 1 --2- 172.21.15.53:0/3508375595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71301050a0 0x7f713010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:01.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.380+0000 7f7137a39640 1 --2- 172.21.15.53:0/3508375595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7130104750 0x7f7130104b60 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:01.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.380+0000 7f7137a39640 1 -- 172.21.15.53:0/3508375595 >> 172.21.15.53:0/3508375595 conn(0x7f71300794d0 msgr2=0x7f71300798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:01.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.380+0000 7f7137a39640 1 -- 172.21.15.53:0/3508375595 shutdown_connections 2024-08-31T06:16:01.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.380+0000 7f7137a39640 1 -- 172.21.15.53:0/3508375595 wait complete. 2024-08-31T06:16:01.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f7137a39640 1 Processor -- start 2024-08-31T06:16:01.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f7137a39640 1 -- start start 2024-08-31T06:16:01.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f7137a39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7130104750 0x7f713019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:01.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f7137a39640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71301050a0 0x7f713019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:01.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f7137a39640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f713010dbb0 0x7f713019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:01.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f7137a39640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f71301136c0 con 0x7f7130104750 2024-08-31T06:16:01.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f7137a39640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7130113540 con 0x7f713010dbb0 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f7137a39640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7130113840 con 0x7f71301050a0 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f71357d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7130104750 0x7f713019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f71357d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7130104750 0x7f713019a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36392/0 (socket says 172.21.15.53:36392) 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f71357d5640 1 -- 172.21.15.53:0/3905725405 learned_addr learned my addr 172.21.15.53:0/3905725405 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f7135fd6640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f713010dbb0 0x7f713019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.381+0000 7f7134fd4640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71301050a0 0x7f713019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f7135fd6640 1 -- 172.21.15.53:0/3905725405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71301050a0 msgr2=0x7f713019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f7135fd6640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71301050a0 0x7f713019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f7135fd6640 1 -- 172.21.15.53:0/3905725405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7130104750 msgr2=0x7f713019a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f7135fd6640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7130104750 0x7f713019a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f7135fd6640 1 -- 172.21.15.53:0/3905725405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71301a00c0 con 0x7f713010dbb0 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f71357d5640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7130104750 0x7f713019a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f7135fd6640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f713010dbb0 0x7f713019f990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f712800e940 tx=0x7f712800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f71267fc640 1 -- 172.21.15.53:0/3905725405 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128004d20 con 0x7f713010dbb0 2024-08-31T06:16:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f7137a39640 1 -- 172.21.15.53:0/3905725405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71301a03b0 con 0x7f713010dbb0 2024-08-31T06:16:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f71267fc640 1 -- 172.21.15.53:0/3905725405 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7128005020 con 0x7f713010dbb0 2024-08-31T06:16:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f71267fc640 1 -- 172.21.15.53:0/3905725405 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71280116d0 con 0x7f713010dbb0 2024-08-31T06:16:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.382+0000 7f7137a39640 1 -- 172.21.15.53:0/3905725405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71301a6b10 con 0x7f713010dbb0 2024-08-31T06:16:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.383+0000 7f7137a39640 1 -- 172.21.15.53:0/3905725405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7130104b60 con 0x7f713010dbb0 2024-08-31T06:16:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.385+0000 7f71267fc640 1 -- 172.21.15.53:0/3905725405 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f712800cb20 con 0x7f713010dbb0 2024-08-31T06:16:01.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.386+0000 7f71267fc640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f711c0b4ca0 0x7f711c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:01.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.386+0000 7f71357d5640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f711c0b4ca0 0x7f711c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:01.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.386+0000 7f71267fc640 1 -- 172.21.15.53:0/3905725405 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f71280e5a10 con 0x7f713010dbb0 2024-08-31T06:16:01.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.387+0000 7f71357d5640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f711c0b4ca0 0x7f711c0b71b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f712c0096c0 tx=0x7f712c0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:01.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.390+0000 7f71267fc640 1 -- 172.21.15.53:0/3905725405 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7128016030 con 0x7f713010dbb0 2024-08-31T06:16:01.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.611+0000 7f7137a39640 1 -- 172.21.15.53:0/3905725405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f713019b280 con 0x7f713010dbb0 2024-08-31T06:16:01.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.612+0000 7f71267fc640 1 -- 172.21.15.53:0/3905725405 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+12004 (secure 0 0 0) 0x7f713019b280 con 0x7f713010dbb0 2024-08-31T06:16:01.615 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:16:01.615 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":48,"btime":"2024-08-31T06:15:21:610334+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:15:21.232855+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:16:01.615 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 48 2024-08-31T06:16:01.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 -- 172.21.15.53:0/3905725405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f711c0b4ca0 msgr2=0x7f711c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:01.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f711c0b4ca0 0x7f711c0b71b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f712c0096c0 tx=0x7f712c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:16:01.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 -- 172.21.15.53:0/3905725405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f713010dbb0 msgr2=0x7f713019f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:01.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f713010dbb0 0x7f713019f990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f712800e940 tx=0x7f712800ee00 comp rx=0 tx=0).stop 2024-08-31T06:16:01.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 -- 172.21.15.53:0/3905725405 shutdown_connections 2024-08-31T06:16:01.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f711c0b4ca0 0x7f711c0b71b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:01.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f713010dbb0 0x7f713019f990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:01.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71301050a0 0x7f713019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:01.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 --2- 172.21.15.53:0/3905725405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7130104750 0x7f713019a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:01.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 -- 172.21.15.53:0/3905725405 >> 172.21.15.53:0/3905725405 conn(0x7f71300794d0 msgr2=0x7f71301006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:01.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 -- 172.21.15.53:0/3905725405 shutdown_connections 2024-08-31T06:16:01.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:01.615+0000 7f7137a39640 1 -- 172.21.15.53:0/3905725405 wait complete. 2024-08-31T06:16:01.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:01 smithi053 ceph-mon[18924]: pgmap v665: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 25 op/s 2024-08-31T06:16:01.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:01 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3905725405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:16:01.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.37 MB/sec execute 471 sec latency 16652.392 ms 2024-08-31T06:16:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:01 smithi130 ceph-mon[22266]: pgmap v665: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 25 op/s 2024-08-31T06:16:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:01 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3905725405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:16:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:01 smithi153 ceph-mon[22320]: pgmap v665: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 25 op/s 2024-08-31T06:16:02.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:01 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3905725405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:16:02.310 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:16:02.563 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:02.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.37 MB/sec execute 472 sec latency 17652.419 ms 2024-08-31T06:16:03.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.083+0000 7f8d8359e640 1 -- 172.21.15.53:0/237002027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d84107f60 msgr2=0x7f8d84108370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:03.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.083+0000 7f8d8359e640 1 --2- 172.21.15.53:0/237002027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d84107f60 0x7f8d84108370 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009900 tx=0x7f8d7802a410 comp rx=0 tx=0).stop 2024-08-31T06:16:03.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.084+0000 7f8d8359e640 1 -- 172.21.15.53:0/237002027 shutdown_connections 2024-08-31T06:16:03.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.084+0000 7f8d8359e640 1 --2- 172.21.15.53:0/237002027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d841088b0 0x7f8d8410f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.084+0000 7f8d8359e640 1 --2- 172.21.15.53:0/237002027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d84107f60 0x7f8d84108370 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.084+0000 7f8d8359e640 1 --2- 172.21.15.53:0/237002027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d84102620 0x7f8d84102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.084+0000 7f8d8359e640 1 -- 172.21.15.53:0/237002027 >> 172.21.15.53:0/237002027 conn(0x7f8d840fe070 msgr2=0x7f8d841004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:03.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.084+0000 7f8d8359e640 1 -- 172.21.15.53:0/237002027 shutdown_connections 2024-08-31T06:16:03.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.084+0000 7f8d8359e640 1 -- 172.21.15.53:0/237002027 wait complete. 2024-08-31T06:16:03.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.084+0000 7f8d8359e640 1 Processor -- start 2024-08-31T06:16:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d8359e640 1 -- start start 2024-08-31T06:16:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d8359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d84102620 0x7f8d8419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d8359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d84107f60 0x7f8d8419b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d8359e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d841088b0 0x7f8d8419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d8359e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841123d0 con 0x7f8d84107f60 2024-08-31T06:16:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d8359e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84112250 con 0x7f8d84102620 2024-08-31T06:16:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d8359e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84112550 con 0x7f8d841088b0 2024-08-31T06:16:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d81d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d84107f60 0x7f8d8419b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d81d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d84107f60 0x7f8d8419b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36420/0 (socket says 172.21.15.53:36420) 2024-08-31T06:16:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d81d9b640 1 -- 172.21.15.53:0/3744450535 learned_addr learned my addr 172.21.15.53:0/3744450535 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d8259c640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d84102620 0x7f8d8419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d82d9d640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d841088b0 0x7f8d8419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d81d9b640 1 -- 172.21.15.53:0/3744450535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d841088b0 msgr2=0x7f8d8419b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d81d9b640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d841088b0 0x7f8d8419b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d81d9b640 1 -- 172.21.15.53:0/3744450535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d84102620 msgr2=0x7f8d8419ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d81d9b640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d84102620 0x7f8d8419ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.085+0000 7f8d81d9b640 1 -- 172.21.15.53:0/3744450535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d841a5f40 con 0x7f8d84107f60 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.086+0000 7f8d81d9b640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d84107f60 0x7f8d8419b280 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f8d78005940 tx=0x7f8d780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.086+0000 7f8d737fe640 1 -- 172.21.15.53:0/3744450535 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7803f030 con 0x7f8d84107f60 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.086+0000 7f8d8359e640 1 -- 172.21.15.53:0/3744450535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d841a61d0 con 0x7f8d84107f60 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.086+0000 7f8d737fe640 1 -- 172.21.15.53:0/3744450535 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d78003c90 con 0x7f8d84107f60 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.086+0000 7f8d737fe640 1 -- 172.21.15.53:0/3744450535 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78035070 con 0x7f8d84107f60 2024-08-31T06:16:03.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.086+0000 7f8d8359e640 1 -- 172.21.15.53:0/3744450535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d841a66b0 con 0x7f8d84107f60 2024-08-31T06:16:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.088+0000 7f8d8ed78740 1 Processor -- start 2024-08-31T06:16:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.088+0000 7f8d8ed78740 1 -- start start 2024-08-31T06:16:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695ee61b0 0x55a6962b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695eee390 0x55a6962b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a69622b680 con 0x55a695f0f070 2024-08-31T06:16:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a69621ac10 con 0x55a695ee61b0 2024-08-31T06:16:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a69621ebc0 con 0x55a695eee390 2024-08-31T06:16:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d82d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d82d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36430/0 (socket says 172.21.15.53:36430) 2024-08-31T06:16:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d82d9d640 1 -- 172.21.15.53:0/616254014 learned_addr learned my addr 172.21.15.53:0/616254014 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d737fe640 1 -- 172.21.15.53:0/3744450535 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8d78042030 con 0x7f8d84107f60 2024-08-31T06:16:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d8259c640 1 --2- 172.21.15.53:0/616254014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695ee61b0 0x55a6962b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d82d9d640 1 -- 172.21.15.53:0/616254014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695eee390 msgr2=0x55a6962b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d82d9d640 1 --2- 172.21.15.53:0/616254014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695eee390 0x55a6962b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d82d9d640 1 -- 172.21.15.53:0/616254014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695ee61b0 msgr2=0x55a6962b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d82d9d640 1 --2- 172.21.15.53:0/616254014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695ee61b0 0x55a6962b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d82d9d640 1 -- 172.21.15.53:0/616254014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a695f7a650 con 0x55a695f0f070 2024-08-31T06:16:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.089+0000 7f8d82d9d640 1 --2- 172.21.15.53:0/616254014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962b44b0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c007f40 tx=0x7f8d7c00f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e4549ae34dd4f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.090+0000 7f8d70ff9640 1 -- 172.21.15.53:0/616254014 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c010840 con 0x55a695f0f070 2024-08-31T06:16:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.090+0000 7f8d70ff9640 1 -- 172.21.15.53:0/616254014 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d7c0183f0 con 0x55a695f0f070 2024-08-31T06:16:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.090+0000 7f8d70ff9640 1 -- 172.21.15.53:0/616254014 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c018e60 con 0x55a695f0f070 2024-08-31T06:16:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.090+0000 7f8d737fe640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d6c0b4cd0 0x7f8d6c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.090+0000 7f8d8259c640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d6c0b4cd0 0x7f8d6c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.090+0000 7f8d737fe640 1 -- 172.21.15.53:0/3744450535 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f8d78105a80 con 0x7f8d84107f60 2024-08-31T06:16:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8ed78740 1 -- 172.21.15.53:0/616254014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 msgr2=0x55a6962b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8259c640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d6c0b4cd0 0x7f8d6c0b71e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55a6962b3130 tx=0x7f8d7400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/616254014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962b44b0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c007f40 tx=0x7f8d7c00f850 comp rx=0 tx=0).stop 2024-08-31T06:16:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8ed78740 1 -- 172.21.15.53:0/616254014 shutdown_connections 2024-08-31T06:16:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/616254014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695eee390 0x55a6962b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/616254014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695ee61b0 0x55a6962b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/616254014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962b44b0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8ed78740 1 -- 172.21.15.53:0/616254014 >> 172.21.15.53:0/616254014 conn(0x55a695f03460 msgr2=0x55a6962b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8ed78740 1 -- 172.21.15.53:0/616254014 shutdown_connections 2024-08-31T06:16:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8ed78740 1 -- 172.21.15.53:0/616254014 wait complete. 2024-08-31T06:16:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8ed78740 1 -- start start 2024-08-31T06:16:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.091+0000 7f8d8ed78740 1 Processor -- start 2024-08-31T06:16:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695ee61b0 0x55a6962c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695eee390 0x55a6962c4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a69607d700 con 0x55a695f0f070 2024-08-31T06:16:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a6961a1750 con 0x55a695ee61b0 2024-08-31T06:16:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a6962c6ff0 con 0x55a695eee390 2024-08-31T06:16:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d8ed78740 10 client.0 _ll_register_callbacks cb 0x55a6961d0e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d82d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d82d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36446/0 (socket says 172.21.15.53:36446) 2024-08-31T06:16:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d82d9d640 1 -- 172.21.15.53:0/2772920809 learned_addr learned my addr 172.21.15.53:0/2772920809 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d8259c640 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695ee61b0 0x55a6962c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d81d9b640 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695eee390 0x55a6962c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d82d9d640 1 -- 172.21.15.53:0/2772920809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695eee390 msgr2=0x55a6962c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d82d9d640 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695eee390 0x55a6962c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d82d9d640 1 -- 172.21.15.53:0/2772920809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695ee61b0 msgr2=0x55a6962c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d82d9d640 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695ee61b0 0x55a6962c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d82d9d640 1 -- 172.21.15.53:0/2772920809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6961da900 con 0x55a695f0f070 2024-08-31T06:16:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d82d9d640 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962d0380 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c018d80 tx=0x7f8d7c003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a958ea6173c87ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.092+0000 7f8d69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d69ffb640 1 -- 172.21.15.53:0/2772920809 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c026020 con 0x55a695f0f070 2024-08-31T06:16:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d69ffb640 1 -- 172.21.15.53:0/2772920809 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f8d7c0187b0 con 0x55a695f0f070 2024-08-31T06:16:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2772920809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d7c0183f0 con 0x55a695f0f070 2024-08-31T06:16:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d69ffb640 1 -- 172.21.15.53:0/2772920809 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f8d7c031050 con 0x55a695f0f070 2024-08-31T06:16:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d8ed78740 10 client.19065 fetch_fsmap learned FSMap version 48 2024-08-31T06:16:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2772920809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a6962d2e00 con 0x55a695f0f070 2024-08-31T06:16:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d69ffb640 1 -- 172.21.15.53:0/2772920809 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d7c0183f0 con 0x55a695f0f070 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d69ffb640 1 -- 172.21.15.53:0/2772920809 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7f8d7c0040d0 con 0x55a695f0f070 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d8ed78740 10 client.19065 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d8ed78740 10 client.19065 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d8ed78740 20 client.19065 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a695ecd9f0 0x55a6962d6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d8ed78740 4 client.19065 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.093+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2772920809 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a69622d5d0 con 0x55a695ecd9f0 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.094+0000 7f8d8259c640 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a695ecd9f0 0x55a6962d6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.094+0000 7f8d8259c640 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a695ecd9f0 0x55a6962d6270 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1d0038857efd067d server_cookie=3fb4baac65c50002 in_seq=0 out_seq=0 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.094+0000 7f8d69ffb640 10 client.19065 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d69ffb640 1 -- 172.21.15.53:0/2772920809 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a69622d5d0 con 0x55a695ecd9f0 2024-08-31T06:16:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d69ffb640 10 client.19065 handle_command_reply: tid=0 2024-08-31T06:16:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 1 client.19065 shutdown 2024-08-31T06:16:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2772920809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 msgr2=0x55a6962d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962d0380 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c018d80 tx=0x7f8d7c003f20 comp rx=0 tx=0).stop 2024-08-31T06:16:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2772920809 shutdown_connections 2024-08-31T06:16:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695f0f070 0x55a6962d0380 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a695ecd9f0 0x55a6962d6270 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695eee390 0x55a6962c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/2772920809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695ee61b0 0x55a6962c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2772920809 >> 172.21.15.53:0/2772920809 conn(0x55a695f03460 msgr2=0x55a6962b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d69ffb640 0 client.19065 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:16:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2772920809 shutdown_connections 2024-08-31T06:16:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2772920809 wait complete. 2024-08-31T06:16:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.095+0000 7f8d8ed78740 20 client.19065 trim_cache size 0 max 16384 2024-08-31T06:16:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.108+0000 7f8d8ed78740 1 Processor -- start 2024-08-31T06:16:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d8ed78740 1 -- start start 2024-08-31T06:16:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695ee61b0 0x55a6962c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695f0f070 0x55a6962c11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841acff0 con 0x55a695eee390 2024-08-31T06:16:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841aed40 con 0x55a695f0f070 2024-08-31T06:16:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841ad6c0 con 0x55a695ee61b0 2024-08-31T06:16:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d81d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d81d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36450/0 (socket says 172.21.15.53:36450) 2024-08-31T06:16:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d81d9b640 1 -- 172.21.15.53:0/2231109298 learned_addr learned my addr 172.21.15.53:0/2231109298 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d81d9b640 1 -- 172.21.15.53:0/2231109298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695ee61b0 msgr2=0x55a6962c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d8259c640 1 --2- 172.21.15.53:0/2231109298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695ee61b0 0x55a6962c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d82d9d640 1 --2- 172.21.15.53:0/2231109298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695f0f070 0x55a6962c11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d81d9b640 1 --2- 172.21.15.53:0/2231109298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695ee61b0 0x55a6962c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d81d9b640 1 -- 172.21.15.53:0/2231109298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695f0f070 msgr2=0x55a6962c11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d81d9b640 1 --2- 172.21.15.53:0/2231109298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695f0f070 0x55a6962c11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d81d9b640 1 -- 172.21.15.53:0/2231109298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6962b52a0 con 0x55a695eee390 2024-08-31T06:16:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d82d9d640 1 --2- 172.21.15.53:0/2231109298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695f0f070 0x55a6962c11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d81d9b640 1 --2- 172.21.15.53:0/2231109298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d02f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f8d780c81d0 tx=0x7f8d78105d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9843321fe61544fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.109+0000 7f8d6bfff640 1 -- 172.21.15.53:0/2231109298 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78049070 con 0x55a695eee390 2024-08-31T06:16:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.110+0000 7f8d6bfff640 1 -- 172.21.15.53:0/2231109298 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d78003e40 con 0x55a695eee390 2024-08-31T06:16:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.110+0000 7f8d6bfff640 1 -- 172.21.15.53:0/2231109298 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d780d5470 con 0x55a695eee390 2024-08-31T06:16:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.110+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2231109298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 msgr2=0x55a6962d02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.110+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/2231109298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d02f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f8d780c81d0 tx=0x7f8d78105d80 comp rx=0 tx=0).stop 2024-08-31T06:16:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.110+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2231109298 shutdown_connections 2024-08-31T06:16:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.110+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/2231109298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695f0f070 0x55a6962c11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.110+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/2231109298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d02f0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.110+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/2231109298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695ee61b0 0x55a6962c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.110+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2231109298 >> 172.21.15.53:0/2231109298 conn(0x55a695f03460 msgr2=0x55a6962c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.110+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2231109298 shutdown_connections 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.110+0000 7f8d8ed78740 1 -- 172.21.15.53:0/2231109298 wait complete. 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d8ed78740 1 -- start start 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d8ed78740 1 Processor -- start 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695ee61b0 0x55a6962d7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d8ed78740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695f0f070 0x55a6962d7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841ae5b0 con 0x55a695eee390 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841ade50 con 0x55a695f0f070 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d8ed78740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841ab010 con 0x55a695ee61b0 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d8ed78740 10 client.0 _ll_register_callbacks cb 0x7f8d7c007d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d81d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d81d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36452/0 (socket says 172.21.15.53:36452) 2024-08-31T06:16:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d81d9b640 1 -- 172.21.15.53:0/3079475388 learned_addr learned my addr 172.21.15.53:0/3079475388 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d8259c640 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695ee61b0 0x55a6962d7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d82d9d640 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695f0f070 0x55a6962d7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d81d9b640 1 -- 172.21.15.53:0/3079475388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695ee61b0 msgr2=0x55a6962d7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d81d9b640 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695ee61b0 0x55a6962d7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d81d9b640 1 -- 172.21.15.53:0/3079475388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695f0f070 msgr2=0x55a6962d7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d81d9b640 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695f0f070 0x55a6962d7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.111+0000 7f8d81d9b640 1 -- 172.21.15.53:0/3079475388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a69633fba0 con 0x55a695eee390 2024-08-31T06:16:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d81d9b640 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d79c0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8d780cbe50 tx=0x7f8d7802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5d4113b5457f56 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d69ffb640 1 -- 172.21.15.53:0/3079475388 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d780b7020 con 0x55a695eee390 2024-08-31T06:16:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d69ffb640 1 -- 172.21.15.53:0/3079475388 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f8d780cc3b0 con 0x55a695eee390 2024-08-31T06:16:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d8ed78740 1 -- 172.21.15.53:0/3079475388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a696229070 con 0x55a695eee390 2024-08-31T06:16:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d69ffb640 1 -- 172.21.15.53:0/3079475388 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f8d780e6050 con 0x55a695eee390 2024-08-31T06:16:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d8ed78740 10 client.19071 fetch_fsmap learned FSMap version 48 2024-08-31T06:16:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d8ed78740 1 -- 172.21.15.53:0/3079475388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a696340d70 con 0x55a695eee390 2024-08-31T06:16:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d69ffb640 1 -- 172.21.15.53:0/3079475388 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a696229070 con 0x55a695eee390 2024-08-31T06:16:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d69ffb640 1 -- 172.21.15.53:0/3079475388 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) ==== 8406+0+0 (secure 0 0 0) 0x7f8d780cb3b0 con 0x55a695eee390 2024-08-31T06:16:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d8ed78740 10 client.19071 fetch_fsmap finished waiting for FSMap version 48 2024-08-31T06:16:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d8ed78740 10 client.19071 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d8ed78740 20 client.19071 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a695ea2da0 0x55a6963434c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d8ed78740 4 client.19071 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.112+0000 7f8d8ed78740 1 -- 172.21.15.53:0/3079475388 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a6962267b0 con 0x55a695ea2da0 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d8259c640 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a695ea2da0 0x55a6963434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d69ffb640 10 client.19071 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d8259c640 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a695ea2da0 0x55a6963434c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9b9ddfb7c5203e5b server_cookie=5fc8457aab736f67 in_seq=0 out_seq=0 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d69ffb640 1 -- 172.21.15.53:0/3079475388 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a6962267b0 con 0x55a695ea2da0 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d69ffb640 10 client.19071 handle_command_reply: tid=0 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d8ed78740 1 client.19071 shutdown 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d8ed78740 1 -- 172.21.15.53:0/3079475388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 msgr2=0x55a6962d79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d79c0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8d780cbe50 tx=0x7f8d7802a410 comp rx=0 tx=0).stop 2024-08-31T06:16:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d8ed78740 1 -- 172.21.15.53:0/3079475388 shutdown_connections 2024-08-31T06:16:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a695f0f070 0x55a6962d7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a695eee390 0x55a6962d79c0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a695ea2da0 0x55a6963434c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.113+0000 7f8d8ed78740 1 --2- 172.21.15.53:0/3079475388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a695ee61b0 0x55a6962d7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8ed78740 1 -- 172.21.15.53:0/3079475388 >> 172.21.15.53:0/3079475388 conn(0x55a695f03460 msgr2=0x55a6962ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d69ffb640 0 client.19071 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:16:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8ed78740 1 -- 172.21.15.53:0/3079475388 shutdown_connections 2024-08-31T06:16:03.472 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:16:03.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8ed78740 1 -- 172.21.15.53:0/3079475388 wait complete. 2024-08-31T06:16:03.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8ed78740 20 client.19071 trim_cache size 0 max 16384 2024-08-31T06:16:03.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 -- 172.21.15.53:0/3744450535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d6c0b4cd0 msgr2=0x7f8d6c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:03.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d6c0b4cd0 0x7f8d6c0b71e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55a6962b3130 tx=0x7f8d7400a2d0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 -- 172.21.15.53:0/3744450535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d84107f60 msgr2=0x7f8d8419b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d84107f60 0x7f8d8419b280 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f8d78005940 tx=0x7f8d780042f0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 -- 172.21.15.53:0/3744450535 shutdown_connections 2024-08-31T06:16:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d6c0b4cd0 0x7f8d6c0b71e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d841088b0 0x7f8d8419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d84107f60 0x7f8d8419b280 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 --2- 172.21.15.53:0/3744450535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d84102620 0x7f8d8419ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 -- 172.21.15.53:0/3744450535 >> 172.21.15.53:0/3744450535 conn(0x7f8d840fe070 msgr2=0x7f8d84100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 -- 172.21.15.53:0/3744450535 shutdown_connections 2024-08-31T06:16:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:03.114+0000 7f8d8359e640 1 -- 172.21.15.53:0/3744450535 wait complete. 2024-08-31T06:16:03.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:03 smithi053 ceph-mon[18924]: pgmap v666: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-08-31T06:16:03.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.37 MB/sec execute 473 sec latency 18652.519 ms 2024-08-31T06:16:04.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:16:04.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:03 smithi130 ceph-mon[22266]: pgmap v666: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-08-31T06:16:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:03 smithi153 ceph-mon[22320]: pgmap v666: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-08-31T06:16:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:04.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.820+0000 7f89e735f640 1 -- 172.21.15.53:0/1214124521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e0075ea0 msgr2=0x7f89e010f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:04.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.820+0000 7f89e735f640 1 --2- 172.21.15.53:0/1214124521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e0075ea0 0x7f89e010f920 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009900 tx=0x7f89d402a410 comp rx=0 tx=0).stop 2024-08-31T06:16:04.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.820+0000 7f89e735f640 1 -- 172.21.15.53:0/1214124521 shutdown_connections 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.820+0000 7f89e735f640 1 --2- 172.21.15.53:0/1214124521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e010fe60 0x7f89e01122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.820+0000 7f89e735f640 1 --2- 172.21.15.53:0/1214124521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e0075ea0 0x7f89e010f920 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.820+0000 7f89e735f640 1 --2- 172.21.15.53:0/1214124521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89e0075550 0x7f89e0075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.820+0000 7f89e735f640 1 -- 172.21.15.53:0/1214124521 >> 172.21.15.53:0/1214124521 conn(0x7f89e007b5f0 msgr2=0x7f89e007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.820+0000 7f89e735f640 1 -- 172.21.15.53:0/1214124521 shutdown_connections 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.820+0000 7f89e735f640 1 -- 172.21.15.53:0/1214124521 wait complete. 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.820+0000 7f89e735f640 1 Processor -- start 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.820+0000 7f89e735f640 1 -- start start 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e735f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e0075550 0x7f89e019c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e735f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89e0075ea0 0x7f89e019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e735f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e010fe60 0x7f89e01a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e735f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0115880 con 0x7f89e010fe60 2024-08-31T06:16:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e735f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0115700 con 0x7f89e0075ea0 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e735f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0115a00 con 0x7f89e0075550 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e58fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e010fe60 0x7f89e01a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e58fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e010fe60 0x7f89e01a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34020/0 (socket says 172.21.15.53:34020) 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e58fc640 1 -- 172.21.15.53:0/112154913 learned_addr learned my addr 172.21.15.53:0/112154913 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e50fb640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e0075550 0x7f89e019c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e48fa640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89e0075ea0 0x7f89e019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e58fc640 1 -- 172.21.15.53:0/112154913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e0075550 msgr2=0x7f89e019c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e58fc640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e0075550 0x7f89e019c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e58fc640 1 -- 172.21.15.53:0/112154913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89e0075ea0 msgr2=0x7f89e019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e58fc640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89e0075ea0 0x7f89e019c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e58fc640 1 -- 172.21.15.53:0/112154913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e01a2220 con 0x7f89e010fe60 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.821+0000 7f89e58fc640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e010fe60 0x7f89e01a1bb0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f89d800c970 tx=0x7f89d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.822+0000 7f89de7fc640 1 -- 172.21.15.53:0/112154913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8007bb0 con 0x7f89e010fe60 2024-08-31T06:16:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.822+0000 7f89de7fc640 1 -- 172.21.15.53:0/112154913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89d8007d50 con 0x7f89e010fe60 2024-08-31T06:16:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.822+0000 7f89e735f640 1 -- 172.21.15.53:0/112154913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e01a2510 con 0x7f89e010fe60 2024-08-31T06:16:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.822+0000 7f89de7fc640 1 -- 172.21.15.53:0/112154913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8018660 con 0x7f89e010fe60 2024-08-31T06:16:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.822+0000 7f89e735f640 1 -- 172.21.15.53:0/112154913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e01a29d0 con 0x7f89e010fe60 2024-08-31T06:16:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89ed8d4740 1 Processor -- start 2024-08-31T06:16:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89de7fc640 1 -- 172.21.15.53:0/112154913 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f89d800f970 con 0x7f89e010fe60 2024-08-31T06:16:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89ed8d4740 1 -- start start 2024-08-31T06:16:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538341070 0x55c5386e6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538320390 0x55c5386e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c53865d680 con 0x55c5383181b0 2024-08-31T06:16:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c53864cc10 con 0x55c538320390 2024-08-31T06:16:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c538650bc0 con 0x55c538341070 2024-08-31T06:16:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89e50fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89e50fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34030/0 (socket says 172.21.15.53:34030) 2024-08-31T06:16:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89e50fb640 1 -- 172.21.15.53:0/2662512704 learned_addr learned my addr 172.21.15.53:0/2662512704 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.825+0000 7f89e48fa640 1 --2- 172.21.15.53:0/2662512704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538341070 0x55c5386e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89e48fa640 1 --2- 172.21.15.53:0/2662512704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538320390 0x55c5386e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89e50fb640 1 -- 172.21.15.53:0/2662512704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538341070 msgr2=0x55c5386e6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89e50fb640 1 --2- 172.21.15.53:0/2662512704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538341070 0x55c5386e6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89e50fb640 1 -- 172.21.15.53:0/2662512704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538320390 msgr2=0x55c5386e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89e50fb640 1 --2- 172.21.15.53:0/2662512704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538320390 0x55c5386e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89e50fb640 1 -- 172.21.15.53:0/2662512704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5383ac650 con 0x55c5383181b0 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89e48fa640 1 --2- 172.21.15.53:0/2662512704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538341070 0x55c5386e6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89de7fc640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89c80b4cd0 0x7f89c80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89e48fa640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89c80b4cd0 0x7f89c80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89e50fb640 1 --2- 172.21.15.53:0/2662512704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e6850 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f89d00039f0 tx=0x7f89d0003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f40e19fdc615db server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89de7fc640 1 -- 172.21.15.53:0/112154913 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f89d80e54c0 con 0x7f89e010fe60 2024-08-31T06:16:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89c77fe640 1 -- 172.21.15.53:0/2662512704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0004b20 con 0x55c5383181b0 2024-08-31T06:16:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89c77fe640 1 -- 172.21.15.53:0/2662512704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89d0004cc0 con 0x55c5383181b0 2024-08-31T06:16:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.826+0000 7f89c77fe640 1 -- 172.21.15.53:0/2662512704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d00126b0 con 0x55c5383181b0 2024-08-31T06:16:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.827+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2662512704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 msgr2=0x55c5386e6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.827+0000 7f89e48fa640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89c80b4cd0 0x7f89c80b71e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f89d4004770 tx=0x7f89d40058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.827+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/2662512704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e6850 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f89d00039f0 tx=0x7f89d0003eb0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.827+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2662512704 shutdown_connections 2024-08-31T06:16:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.827+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/2662512704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538320390 0x55c5386e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.827+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/2662512704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e6850 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.827+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/2662512704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538341070 0x55c5386e6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.827+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2662512704 >> 172.21.15.53:0/2662512704 conn(0x55c538335460 msgr2=0x55c5386e4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.827+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2662512704 shutdown_connections 2024-08-31T06:16:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.827+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2662512704 wait complete. 2024-08-31T06:16:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89ed8d4740 1 -- start start 2024-08-31T06:16:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89ed8d4740 1 Processor -- start 2024-08-31T06:16:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5383181b0 0x55c5386f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538320390 0x55c5386f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 0x55c5386fdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c5384af700 con 0x55c538320390 2024-08-31T06:16:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c5385d3750 con 0x55c538341070 2024-08-31T06:16:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c5386f4af0 con 0x55c5383181b0 2024-08-31T06:16:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89ed8d4740 10 client.0 _ll_register_callbacks cb 0x55c538602e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89e48fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538320390 0x55c5386f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89e48fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538320390 0x55c5386f1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34046/0 (socket says 172.21.15.53:34046) 2024-08-31T06:16:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.828+0000 7f89e48fa640 1 -- 172.21.15.53:0/2239994000 learned_addr learned my addr 172.21.15.53:0/2239994000 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89e50fb640 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5383181b0 0x55c5386f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89e58fc640 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 0x55c5386fdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89e48fa640 1 -- 172.21.15.53:0/2239994000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5383181b0 msgr2=0x55c5386f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89e48fa640 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5383181b0 0x55c5386f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89e48fa640 1 -- 172.21.15.53:0/2239994000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 msgr2=0x55c5386fdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89e48fa640 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 0x55c5386fdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89e48fa640 1 -- 172.21.15.53:0/2239994000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c53860c900 con 0x55c538320390 2024-08-31T06:16:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89e58fc640 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 0x55c5386fdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89e48fa640 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538320390 0x55c5386f1f50 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f89e006c500 tx=0x7f89d4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d25ab9933b5939c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89c4ff9640 1 -- 172.21.15.53:0/2239994000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d404e070 con 0x55c538320390 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89c4ff9640 1 -- 172.21.15.53:0/2239994000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f89d4004450 con 0x55c538320390 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.829+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2239994000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89d0004cc0 con 0x55c538320390 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89c4ff9640 1 -- 172.21.15.53:0/2239994000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f89d4035040 con 0x55c538320390 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89ed8d4740 10 client.19083 fetch_fsmap learned FSMap version 49 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2239994000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55c538700860 con 0x55c538320390 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89c4ff9640 1 -- 172.21.15.53:0/2239994000 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89d0004cc0 con 0x55c538320390 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89c4ff9640 1 -- 172.21.15.53:0/2239994000 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 49) ==== 8402+0+0 (secure 0 0 0) 0x7f89d4047040 con 0x55c538320390 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89ed8d4740 10 client.19083 fetch_fsmap finished waiting for FSMap version 49 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89ed8d4740 10 client.19083 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89ed8d4740 20 client.19083 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c5382ff9f0 0x55c538703d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89ed8d4740 4 client.19083 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2239994000 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c53865f5d0 con 0x55c5382ff9f0 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.830+0000 7f89e50fb640 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c5382ff9f0 0x55c538703d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.831+0000 7f89e50fb640 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c5382ff9f0 0x55c538703d80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a9286a4d94171d9b server_cookie=22d40cc393d46209 in_seq=0 out_seq=0 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.831+0000 7f89c4ff9640 10 client.19083 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.831+0000 7f89c4ff9640 1 -- 172.21.15.53:0/2239994000 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c53865f5d0 con 0x55c5382ff9f0 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.831+0000 7f89c4ff9640 10 client.19083 handle_command_reply: tid=0 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.831+0000 7f89ed8d4740 1 client.19083 shutdown 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2239994000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538320390 msgr2=0x55c5386f1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538320390 0x55c5386f1f50 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f89e006c500 tx=0x7f89d4005fd0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2239994000 shutdown_connections 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 0x55c5386fdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c5382ff9f0 0x55c538703d80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538320390 0x55c5386f1f50 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/2239994000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5383181b0 0x55c5386f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2239994000 >> 172.21.15.53:0/2239994000 conn(0x55c538335460 msgr2=0x55c5386e94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:04.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89c4ff9640 0 client.19083 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:16:04.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2239994000 shutdown_connections 2024-08-31T06:16:04.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89ed8d4740 1 -- 172.21.15.53:0/2239994000 wait complete. 2024-08-31T06:16:04.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.832+0000 7f89ed8d4740 20 client.19083 trim_cache size 0 max 16384 2024-08-31T06:16:04.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.845+0000 7f89ed8d4740 1 Processor -- start 2024-08-31T06:16:04.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.845+0000 7f89ed8d4740 1 -- start start 2024-08-31T06:16:04.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538320390 0x55c5386fdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 0x55c5386e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01b1690 con 0x55c5383181b0 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01b33b0 con 0x55c538341070 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01b1d60 con 0x55c538320390 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89e50fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89e50fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34060/0 (socket says 172.21.15.53:34060) 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89e50fb640 1 -- 172.21.15.53:0/1756910697 learned_addr learned my addr 172.21.15.53:0/1756910697 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89e58fc640 1 --2- 172.21.15.53:0/1756910697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 0x55c5386e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89e48fa640 1 --2- 172.21.15.53:0/1756910697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538320390 0x55c5386fdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89e50fb640 1 -- 172.21.15.53:0/1756910697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538320390 msgr2=0x55c5386fdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89e50fb640 1 --2- 172.21.15.53:0/1756910697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538320390 0x55c5386fdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89e50fb640 1 -- 172.21.15.53:0/1756910697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 msgr2=0x55c5386e3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89e50fb640 1 --2- 172.21.15.53:0/1756910697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 0x55c5386e3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89e50fb640 1 -- 172.21.15.53:0/1756910697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5386e8600 con 0x55c5383181b0 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.846+0000 7f89e58fc640 1 --2- 172.21.15.53:0/1756910697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 0x55c5386e3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.847+0000 7f89e50fb640 1 --2- 172.21.15.53:0/1756910697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e9b20 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009e30 tx=0x7f89d0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f093b1481e6cdfb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.847+0000 7f89c6ffd640 1 -- 172.21.15.53:0/1756910697 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d002f460 con 0x55c5383181b0 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.847+0000 7f89c6ffd640 1 -- 172.21.15.53:0/1756910697 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89d002fa90 con 0x55c5383181b0 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.847+0000 7f89c6ffd640 1 -- 172.21.15.53:0/1756910697 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d00126b0 con 0x55c5383181b0 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.848+0000 7f89ed8d4740 1 -- 172.21.15.53:0/1756910697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 msgr2=0x55c5386e9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.848+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/1756910697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e9b20 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009e30 tx=0x7f89d0000f40 comp rx=0 tx=0).stop 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.848+0000 7f89ed8d4740 1 -- 172.21.15.53:0/1756910697 shutdown_connections 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.848+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/1756910697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c538341070 0x55c5386e3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.848+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/1756910697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538320390 0x55c5386fdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.848+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/1756910697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5383181b0 0x55c5386e9b20 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.848+0000 7f89ed8d4740 1 -- 172.21.15.53:0/1756910697 >> 172.21.15.53:0/1756910697 conn(0x55c538335460 msgr2=0x55c5386e9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.848+0000 7f89ed8d4740 1 -- 172.21.15.53:0/1756910697 shutdown_connections 2024-08-31T06:16:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.848+0000 7f89ed8d4740 1 -- 172.21.15.53:0/1756910697 wait complete. 2024-08-31T06:16:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.848+0000 7f89ed8d4740 1 -- start start 2024-08-31T06:16:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.848+0000 7f89ed8d4740 1 Processor -- start 2024-08-31T06:16:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5383181b0 0x55c5386f6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538320390 0x55c5386f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89ed8d4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538341070 0x55c53876d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01b2c20 con 0x55c538341070 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01b24c0 con 0x55c5383181b0 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89ed8d4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f89e01af690 con 0x55c538320390 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89ed8d4740 10 client.0 _ll_register_callbacks cb 0x7f89d4031c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89e58fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538341070 0x55c53876d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89e58fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538341070 0x55c53876d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34068/0 (socket says 172.21.15.53:34068) 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89e58fc640 1 -- 172.21.15.53:0/4215353332 learned_addr learned my addr 172.21.15.53:0/4215353332 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89e48fa640 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538320390 0x55c5386f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89e50fb640 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5383181b0 0x55c5386f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89e58fc640 1 -- 172.21.15.53:0/4215353332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538320390 msgr2=0x55c5386f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89e58fc640 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538320390 0x55c5386f65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89e58fc640 1 -- 172.21.15.53:0/4215353332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5383181b0 msgr2=0x55c5386f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89e58fc640 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5383181b0 0x55c5386f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89e58fc640 1 -- 172.21.15.53:0/4215353332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5386f6ea0 con 0x55c538341070 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89e58fc640 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538341070 0x55c53876d760 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f89d80a7c10 tx=0x7f89d80a73f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6683b23d067f0d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.849+0000 7f89c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89c4ff9640 1 -- 172.21.15.53:0/4215353332 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d80abb90 con 0x55c538341070 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89c4ff9640 1 -- 172.21.15.53:0/4215353332 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f89d800f450 con 0x55c538341070 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89ed8d4740 1 -- 172.21.15.53:0/4215353332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89d002fa90 con 0x55c538341070 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89c4ff9640 1 -- 172.21.15.53:0/4215353332 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f89d80b0400 con 0x55c538341070 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89ed8d4740 10 client.19089 fetch_fsmap learned FSMap version 49 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89ed8d4740 1 -- 172.21.15.53:0/4215353332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55c53876edb0 con 0x55c538341070 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89c4ff9640 1 -- 172.21.15.53:0/4215353332 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89d002fa90 con 0x55c538341070 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89c4ff9640 1 -- 172.21.15.53:0/4215353332 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 49) ==== 8402+0+0 (secure 0 0 0) 0x7f89d8094070 con 0x55c538341070 2024-08-31T06:16:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89ed8d4740 10 client.19089 fetch_fsmap finished waiting for FSMap version 49 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89ed8d4740 10 client.19089 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89ed8d4740 20 client.19089 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c5382d4da0 0x55c538771520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89ed8d4740 4 client.19089 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89ed8d4740 1 -- 172.21.15.53:0/4215353332 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c53865b070 con 0x55c5382d4da0 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.850+0000 7f89e50fb640 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c5382d4da0 0x55c538771520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89e50fb640 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c5382d4da0 0x55c538771520 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ac7fd9adc95b72c8 server_cookie=691b5c52e228dd0d in_seq=0 out_seq=0 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89c4ff9640 10 client.19089 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89c4ff9640 1 -- 172.21.15.53:0/4215353332 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c53865b070 con 0x55c5382d4da0 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89c4ff9640 10 client.19089 handle_command_reply: tid=0 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89ed8d4740 1 client.19089 shutdown 2024-08-31T06:16:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89ed8d4740 1 -- 172.21.15.53:0/4215353332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538341070 msgr2=0x55c53876d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538341070 0x55c53876d760 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f89d80a7c10 tx=0x7f89d80a73f0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89ed8d4740 1 -- 172.21.15.53:0/4215353332 shutdown_connections 2024-08-31T06:16:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c5382d4da0 0x55c538771520 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c538341070 0x55c53876d760 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c538320390 0x55c5386f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89c4ff9640 0 client.19089 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:16:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89ed8d4740 1 --2- 172.21.15.53:0/4215353332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5383181b0 0x55c5386f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89ed8d4740 1 -- 172.21.15.53:0/4215353332 >> 172.21.15.53:0/4215353332 conn(0x55c538335460 msgr2=0x55c5386e39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.851+0000 7f89ed8d4740 1 -- 172.21.15.53:0/4215353332 shutdown_connections 2024-08-31T06:16:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89ed8d4740 1 -- 172.21.15.53:0/4215353332 wait complete. 2024-08-31T06:16:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89ed8d4740 20 client.19089 trim_cache size 0 max 16384 2024-08-31T06:16:04.868 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:16:04.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 -- 172.21.15.53:0/112154913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89c80b4cd0 msgr2=0x7f89c80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:04.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89c80b4cd0 0x7f89c80b71e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f89d4004770 tx=0x7f89d40058d0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 -- 172.21.15.53:0/112154913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e010fe60 msgr2=0x7f89e01a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:04.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e010fe60 0x7f89e01a1bb0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f89d800c970 tx=0x7f89d800ce30 comp rx=0 tx=0).stop 2024-08-31T06:16:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 -- 172.21.15.53:0/112154913 shutdown_connections 2024-08-31T06:16:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f89c80b4cd0 0x7f89c80b71e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89e010fe60 0x7f89e01a1bb0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89e0075ea0 0x7f89e019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 --2- 172.21.15.53:0/112154913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e0075550 0x7f89e019c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 -- 172.21.15.53:0/112154913 >> 172.21.15.53:0/112154913 conn(0x7f89e007b5f0 msgr2=0x7f89e0101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 -- 172.21.15.53:0/112154913 shutdown_connections 2024-08-31T06:16:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:04.852+0000 7f89e735f640 1 -- 172.21.15.53:0/112154913 wait complete. 2024-08-31T06:16:04.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.36 MB/sec execute 474 sec latency 19652.603 ms 2024-08-31T06:16:05.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:16:05.775 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:05.896 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:05 smithi053 ceph-mon[18924]: pgmap v667: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-08-31T06:16:05.896 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:05 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:16:05.978 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:05 smithi153 ceph-mon[22320]: pgmap v667: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-08-31T06:16:05.978 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:05 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:16:05.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.36 MB/sec execute 475 sec latency 20652.696 ms 2024-08-31T06:16:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:05 smithi130 ceph-mon[22266]: pgmap v667: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 50 KiB/s wr, 30 op/s 2024-08-31T06:16:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:05 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:16:06.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.260+0000 7f36357b9640 1 -- 172.21.15.53:0/1584311902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3630109240 msgr2=0x7f3630109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:06.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.260+0000 7f36357b9640 1 --2- 172.21.15.53:0/1584311902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3630109240 0x7f3630109650 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f3624009900 tx=0x7f362402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.260+0000 7f36357b9640 1 -- 172.21.15.53:0/1584311902 shutdown_connections 2024-08-31T06:16:06.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.260+0000 7f36357b9640 1 --2- 172.21.15.53:0/1584311902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630109b90 0x7f36301103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.260+0000 7f36357b9640 1 --2- 172.21.15.53:0/1584311902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3630109240 0x7f3630109650 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.260+0000 7f36357b9640 1 --2- 172.21.15.53:0/1584311902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3630103900 0x7f3630103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.260+0000 7f36357b9640 1 -- 172.21.15.53:0/1584311902 >> 172.21.15.53:0/1584311902 conn(0x7f363007b5f0 msgr2=0x7f363007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.260+0000 7f36357b9640 1 -- 172.21.15.53:0/1584311902 shutdown_connections 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.260+0000 7f36357b9640 1 -- 172.21.15.53:0/1584311902 wait complete. 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.261+0000 7f36357b9640 1 Processor -- start 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.261+0000 7f36357b9640 1 -- start start 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f36357b9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630103900 0x7f363019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f36357b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3630109240 0x7f363019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f36357b9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3630109b90 0x7f363019f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f36357b9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3630113700 con 0x7f3630109240 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f36357b9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3630113580 con 0x7f3630109b90 2024-08-31T06:16:06.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f36357b9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3630113880 con 0x7f3630103900 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3630109240 0x7f363019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3630109240 0x7f363019a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34094/0 (socket says 172.21.15.53:34094) 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362e7fc640 1 -- 172.21.15.53:0/3461921206 learned_addr learned my addr 172.21.15.53:0/3461921206 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362f7fe640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3630109b90 0x7f363019f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362effd640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630103900 0x7f363019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362e7fc640 1 -- 172.21.15.53:0/3461921206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630103900 msgr2=0x7f363019a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362e7fc640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630103900 0x7f363019a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362e7fc640 1 -- 172.21.15.53:0/3461921206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3630109b90 msgr2=0x7f363019f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362e7fc640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3630109b90 0x7f363019f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362e7fc640 1 -- 172.21.15.53:0/3461921206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36301a0120 con 0x7f3630109240 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362effd640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630103900 0x7f363019a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.262+0000 7f362e7fc640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3630109240 0x7f363019a750 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f3624005940 tx=0x7f36240040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:06.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.263+0000 7f3617fff640 1 -- 172.21.15.53:0/3461921206 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362403f030 con 0x7f3630109240 2024-08-31T06:16:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.263+0000 7f36357b9640 1 -- 172.21.15.53:0/3461921206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36301a03b0 con 0x7f3630109240 2024-08-31T06:16:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.263+0000 7f3617fff640 1 -- 172.21.15.53:0/3461921206 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3624003a80 con 0x7f3630109240 2024-08-31T06:16:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.263+0000 7f3617fff640 1 -- 172.21.15.53:0/3461921206 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624035070 con 0x7f3630109240 2024-08-31T06:16:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.263+0000 7f36357b9640 1 -- 172.21.15.53:0/3461921206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36301a6b70 con 0x7f3630109240 2024-08-31T06:16:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.265+0000 7f363bd2e740 1 Processor -- start 2024-08-31T06:16:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.265+0000 7f3617fff640 1 -- 172.21.15.53:0/3461921206 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3624042030 con 0x7f3630109240 2024-08-31T06:16:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.265+0000 7f363bd2e740 1 -- start start 2024-08-31T06:16:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.265+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885d3070 0x55f788978350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.265+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f788978890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.265+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f788978dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f363bd2e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7888ef680 con 0x55f7885b2390 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f363bd2e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f7888dec10 con 0x55f7885d3070 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f363bd2e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f7888e2bc0 con 0x55f7885aa1b0 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f788978dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f788978dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34106/0 (socket says 172.21.15.53:34106) 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362e7fc640 1 -- 172.21.15.53:0/2999890561 learned_addr learned my addr 172.21.15.53:0/2999890561 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362f7fe640 1 --2- 172.21.15.53:0/2999890561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885d3070 0x55f788978350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362effd640 1 --2- 172.21.15.53:0/2999890561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f788978890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362e7fc640 1 -- 172.21.15.53:0/2999890561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 msgr2=0x55f788978890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362e7fc640 1 --2- 172.21.15.53:0/2999890561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f788978890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362e7fc640 1 -- 172.21.15.53:0/2999890561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885d3070 msgr2=0x55f788978350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362e7fc640 1 --2- 172.21.15.53:0/2999890561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885d3070 0x55f788978350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362e7fc640 1 -- 172.21.15.53:0/2999890561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f78863e650 con 0x55f7885b2390 2024-08-31T06:16:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f3617fff640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36180b4ca0 0x7f36180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362f7fe640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36180b4ca0 0x7f36180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f362e7fc640 1 --2- 172.21.15.53:0/2999890561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f788978dd0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f3624103180 tx=0x7f3624109de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f52a6c8b93f2e03 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.266+0000 7f3617fff640 1 -- 172.21.15.53:0/3461921206 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f3624105b10 con 0x7f3630109240 2024-08-31T06:16:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.267+0000 7f36157fa640 1 -- 172.21.15.53:0/2999890561 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624049020 con 0x55f7885b2390 2024-08-31T06:16:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.267+0000 7f36157fa640 1 -- 172.21.15.53:0/2999890561 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36240cbcc0 con 0x55f7885b2390 2024-08-31T06:16:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.267+0000 7f36157fa640 1 -- 172.21.15.53:0/2999890561 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362410a040 con 0x55f7885b2390 2024-08-31T06:16:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.267+0000 7f363bd2e740 1 -- 172.21.15.53:0/2999890561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 msgr2=0x55f788978dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.267+0000 7f362f7fe640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36180b4ca0 0x7f36180b71b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3628005fd0 tx=0x7f3628009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.267+0000 7f363bd2e740 1 --2- 172.21.15.53:0/2999890561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f788978dd0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f3624103180 tx=0x7f3624109de0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 -- 172.21.15.53:0/2999890561 shutdown_connections 2024-08-31T06:16:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 --2- 172.21.15.53:0/2999890561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f788978dd0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 --2- 172.21.15.53:0/2999890561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f788978890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 --2- 172.21.15.53:0/2999890561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885d3070 0x55f788978350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 -- 172.21.15.53:0/2999890561 >> 172.21.15.53:0/2999890561 conn(0x55f7885c7460 msgr2=0x55f788976240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 -- 172.21.15.53:0/2999890561 shutdown_connections 2024-08-31T06:16:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 -- 172.21.15.53:0/2999890561 wait complete. 2024-08-31T06:16:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 -- start start 2024-08-31T06:16:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 Processor -- start 2024-08-31T06:16:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f788983ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885b2390 0x55f788984000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885d3070 0x55f78898fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f788741700 con 0x55f7885d3070 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f788865750 con 0x55f7885b2390 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.268+0000 7f363bd2e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f7889868f0 con 0x55f7885aa1b0 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f362f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885d3070 0x55f78898fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f363bd2e740 10 client.0 _ll_register_callbacks cb 0x55f788894e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f362f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885d3070 0x55f78898fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34118/0 (socket says 172.21.15.53:34118) 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f362f7fe640 1 -- 172.21.15.53:0/1872224981 learned_addr learned my addr 172.21.15.53:0/1872224981 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f362effd640 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f788983ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f362e7fc640 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885b2390 0x55f788984000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f362f7fe640 1 -- 172.21.15.53:0/1872224981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 msgr2=0x55f788983ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f362f7fe640 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f788983ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f362f7fe640 1 -- 172.21.15.53:0/1872224981 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885b2390 msgr2=0x55f788984000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f362f7fe640 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885b2390 0x55f788984000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f362f7fe640 1 -- 172.21.15.53:0/1872224981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f78889e900 con 0x55f7885d3070 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f362f7fe640 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885d3070 0x55f78898fb50 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f3628005c40 tx=0x7f3628004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82ea3461b0ace59 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f3612ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f3612ff5640 1 -- 172.21.15.53:0/1872224981 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3628020620 con 0x55f7885d3070 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f3612ff5640 1 -- 172.21.15.53:0/1872224981 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f36280207c0 con 0x55f7885d3070 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.269+0000 7f363bd2e740 1 -- 172.21.15.53:0/1872224981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36240cbcc0 con 0x55f7885d3070 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.270+0000 7f3612ff5640 1 -- 172.21.15.53:0/1872224981 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f3628020a00 con 0x55f7885d3070 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.270+0000 7f363bd2e740 10 client.19101 fetch_fsmap learned FSMap version 49 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.270+0000 7f363bd2e740 1 -- 172.21.15.53:0/1872224981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55f788992690 con 0x55f7885d3070 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.270+0000 7f3612ff5640 1 -- 172.21.15.53:0/1872224981 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36240cbcc0 con 0x55f7885d3070 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.270+0000 7f3612ff5640 1 -- 172.21.15.53:0/1872224981 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 49) ==== 8402+0+0 (secure 0 0 0) 0x7f362800f040 con 0x55f7885d3070 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.270+0000 7f363bd2e740 10 client.19101 fetch_fsmap finished waiting for FSMap version 49 2024-08-31T06:16:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.270+0000 7f363bd2e740 10 client.19101 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:16:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.270+0000 7f363bd2e740 20 client.19101 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.270+0000 7f363bd2e740 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7885919f0 0x55f788995cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.270+0000 7f363bd2e740 4 client.19101 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.270+0000 7f363bd2e740 1 -- 172.21.15.53:0/1872224981 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7888f15d0 con 0x55f7885919f0 2024-08-31T06:16:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.271+0000 7f362effd640 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7885919f0 0x55f788995cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.271+0000 7f362effd640 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7885919f0 0x55f788995cf0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=edffad52219cd5f7 server_cookie=243c3bdd4c0d140 in_seq=0 out_seq=0 2024-08-31T06:16:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.271+0000 7f3612ff5640 10 client.19101 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:16:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f3612ff5640 1 -- 172.21.15.53:0/1872224981 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7888f15d0 con 0x55f7885919f0 2024-08-31T06:16:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f3612ff5640 10 client.19101 handle_command_reply: tid=0 2024-08-31T06:16:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 1 client.19101 shutdown 2024-08-31T06:16:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 1 -- 172.21.15.53:0/1872224981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885d3070 msgr2=0x55f78898fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885d3070 0x55f78898fb50 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f3628005c40 tx=0x7f3628004a40 comp rx=0 tx=0).stop 2024-08-31T06:16:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 1 -- 172.21.15.53:0/1872224981 shutdown_connections 2024-08-31T06:16:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7885919f0 0x55f788995cf0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885d3070 0x55f78898fb50 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885b2390 0x55f788984000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f3612ff5640 0 client.19101 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:16:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 1 --2- 172.21.15.53:0/1872224981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f788983ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 1 -- 172.21.15.53:0/1872224981 >> 172.21.15.53:0/1872224981 conn(0x55f7885c7460 msgr2=0x55f78897b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 1 -- 172.21.15.53:0/1872224981 shutdown_connections 2024-08-31T06:16:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 1 -- 172.21.15.53:0/1872224981 wait complete. 2024-08-31T06:16:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.272+0000 7f363bd2e740 20 client.19101 trim_cache size 0 max 16384 2024-08-31T06:16:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.285+0000 7f363bd2e740 1 Processor -- start 2024-08-31T06:16:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.285+0000 7f363bd2e740 1 -- start start 2024-08-31T06:16:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885919f0 0x55f78897bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f78898fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f78898ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f363bd2e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f36301af5d0 con 0x55f7885b2390 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f363bd2e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f36301b12f0 con 0x55f7885919f0 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f363bd2e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36301afca0 con 0x55f7885aa1b0 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f78898ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f78898ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34132/0 (socket says 172.21.15.53:34132) 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362f7fe640 1 -- 172.21.15.53:0/932097541 learned_addr learned my addr 172.21.15.53:0/932097541 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362effd640 1 --2- 172.21.15.53:0/932097541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885919f0 0x55f78897bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362f7fe640 1 -- 172.21.15.53:0/932097541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 msgr2=0x55f78898fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362e7fc640 1 --2- 172.21.15.53:0/932097541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f78898fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362f7fe640 1 --2- 172.21.15.53:0/932097541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f78898fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362f7fe640 1 -- 172.21.15.53:0/932097541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885919f0 msgr2=0x55f78897bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362f7fe640 1 --2- 172.21.15.53:0/932097541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885919f0 0x55f78897bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362f7fe640 1 -- 172.21.15.53:0/932097541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f788970410 con 0x55f7885b2390 2024-08-31T06:16:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362effd640 1 --2- 172.21.15.53:0/932097541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885919f0 0x55f78897bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362e7fc640 1 --2- 172.21.15.53:0/932097541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f78898fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.286+0000 7f362f7fe640 1 --2- 172.21.15.53:0/932097541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f78898ff50 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f3628009ec0 tx=0x7f3628005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8ca68037df68da server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.287+0000 7f3614ff9640 1 -- 172.21.15.53:0/932097541 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3628020da0 con 0x55f7885b2390 2024-08-31T06:16:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.287+0000 7f3614ff9640 1 -- 172.21.15.53:0/932097541 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f362801fe80 con 0x55f7885b2390 2024-08-31T06:16:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.287+0000 7f3614ff9640 1 -- 172.21.15.53:0/932097541 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362801d650 con 0x55f7885b2390 2024-08-31T06:16:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.287+0000 7f363bd2e740 1 -- 172.21.15.53:0/932097541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 msgr2=0x55f78898ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.287+0000 7f363bd2e740 1 --2- 172.21.15.53:0/932097541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f78898ff50 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f3628009ec0 tx=0x7f3628005d10 comp rx=0 tx=0).stop 2024-08-31T06:16:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.287+0000 7f363bd2e740 1 -- 172.21.15.53:0/932097541 shutdown_connections 2024-08-31T06:16:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.287+0000 7f363bd2e740 1 --2- 172.21.15.53:0/932097541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885b2390 0x55f78898ff50 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.287+0000 7f363bd2e740 1 --2- 172.21.15.53:0/932097541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885aa1b0 0x55f78898fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.287+0000 7f363bd2e740 1 --2- 172.21.15.53:0/932097541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885919f0 0x55f78897bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.287+0000 7f363bd2e740 1 -- 172.21.15.53:0/932097541 >> 172.21.15.53:0/932097541 conn(0x55f7885c7460 msgr2=0x55f78897b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f363bd2e740 1 -- 172.21.15.53:0/932097541 shutdown_connections 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f363bd2e740 1 -- 172.21.15.53:0/932097541 wait complete. 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f363bd2e740 1 -- start start 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f363bd2e740 1 Processor -- start 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885919f0 0x55f788987cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885aa1b0 0x55f7889881f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f363bd2e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885b2390 0x55f7889ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f363bd2e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f36301b0b60 con 0x55f7885919f0 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f363bd2e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f36301b0400 con 0x55f7885aa1b0 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f363bd2e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36301ad5d0 con 0x55f7885b2390 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f362effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885919f0 0x55f788987cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f363bd2e740 10 client.0 _ll_register_callbacks cb 0x7f3628009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f362effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885919f0 0x55f788987cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34144/0 (socket says 172.21.15.53:34144) 2024-08-31T06:16:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.288+0000 7f362effd640 1 -- 172.21.15.53:0/2140444240 learned_addr learned my addr 172.21.15.53:0/2140444240 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f362e7fc640 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885aa1b0 0x55f7889881f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f362f7fe640 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885b2390 0x55f7889ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f362effd640 1 -- 172.21.15.53:0/2140444240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885b2390 msgr2=0x55f7889ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f362effd640 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885b2390 0x55f7889ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f362effd640 1 -- 172.21.15.53:0/2140444240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885aa1b0 msgr2=0x55f7889881f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f362effd640 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885aa1b0 0x55f7889881f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f362effd640 1 -- 172.21.15.53:0/2140444240 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7889889e0 con 0x55f7885919f0 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f362e7fc640 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885aa1b0 0x55f7889881f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f362effd640 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885919f0 0x55f788987cb0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f3620005fd0 tx=0x7f3620011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69d36c3bc7ae92a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f3612ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f3612ff5640 1 -- 172.21.15.53:0/2140444240 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620004300 con 0x55f7885919f0 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f3612ff5640 1 -- 172.21.15.53:0/2140444240 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f36200035f0 con 0x55f7885919f0 2024-08-31T06:16:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f363bd2e740 1 -- 172.21.15.53:0/2140444240 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f7888ed070 con 0x55f7885919f0 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f3612ff5640 1 -- 172.21.15.53:0/2140444240 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f36200044a0 con 0x55f7885919f0 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f363bd2e740 10 client.19107 fetch_fsmap learned FSMap version 49 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.289+0000 7f363bd2e740 1 -- 172.21.15.53:0/2140444240 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55f788a00b10 con 0x55f7885919f0 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.290+0000 7f3612ff5640 1 -- 172.21.15.53:0/2140444240 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f7888ed070 con 0x55f7885919f0 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.290+0000 7f3612ff5640 1 -- 172.21.15.53:0/2140444240 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 49) ==== 8402+0+0 (secure 0 0 0) 0x7f3620010a20 con 0x55f7885919f0 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.290+0000 7f363bd2e740 10 client.19107 fetch_fsmap finished waiting for FSMap version 49 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.290+0000 7f363bd2e740 10 client.19107 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.290+0000 7f363bd2e740 20 client.19107 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.290+0000 7f363bd2e740 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7885d3070 0x55f788a03390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.290+0000 7f363bd2e740 4 client.19107 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.290+0000 7f363bd2e740 1 -- 172.21.15.53:0/2140444240 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f7888ea7b0 con 0x55f7885d3070 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.290+0000 7f362e7fc640 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7885d3070 0x55f788a03390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.290+0000 7f3612ff5640 10 client.19107 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.290+0000 7f362e7fc640 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7885d3070 0x55f788a03390 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed4019b2e1b1cc3d server_cookie=4691d2a704f3a842 in_seq=0 out_seq=0 2024-08-31T06:16:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f3612ff5640 1 -- 172.21.15.53:0/2140444240 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f7888ea7b0 con 0x55f7885d3070 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f3612ff5640 10 client.19107 handle_command_reply: tid=0 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 1 client.19107 shutdown 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 1 -- 172.21.15.53:0/2140444240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885919f0 msgr2=0x55f788987cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885919f0 0x55f788987cb0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f3620005fd0 tx=0x7f3620011940 comp rx=0 tx=0).stop 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 1 -- 172.21.15.53:0/2140444240 shutdown_connections 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7885d3070 0x55f788a03390 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7885b2390 0x55f7889ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f3612ff5640 0 client.19107 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7885aa1b0 0x55f7889881f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 1 --2- 172.21.15.53:0/2140444240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7885919f0 0x55f788987cb0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 1 -- 172.21.15.53:0/2140444240 >> 172.21.15.53:0/2140444240 conn(0x55f7885c7460 msgr2=0x55f788975a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 1 -- 172.21.15.53:0/2140444240 shutdown_connections 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 1 -- 172.21.15.53:0/2140444240 wait complete. 2024-08-31T06:16:06.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.291+0000 7f363bd2e740 20 client.19107 trim_cache size 0 max 16384 2024-08-31T06:16:06.299 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:16:06.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 -- 172.21.15.53:0/3461921206 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36180b4ca0 msgr2=0x7f36180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36180b4ca0 0x7f36180b71b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3628005fd0 tx=0x7f3628009600 comp rx=0 tx=0).stop 2024-08-31T06:16:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 -- 172.21.15.53:0/3461921206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3630109240 msgr2=0x7f363019a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3630109240 0x7f363019a750 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f3624005940 tx=0x7f36240040e0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 -- 172.21.15.53:0/3461921206 shutdown_connections 2024-08-31T06:16:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f36180b4ca0 0x7f36180b71b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3630109b90 0x7f363019f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3630109240 0x7f363019a750 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 --2- 172.21.15.53:0/3461921206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3630103900 0x7f363019a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 -- 172.21.15.53:0/3461921206 >> 172.21.15.53:0/3461921206 conn(0x7f363007b5f0 msgr2=0x7f3630107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 -- 172.21.15.53:0/3461921206 shutdown_connections 2024-08-31T06:16:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:06.292+0000 7f36357b9640 1 -- 172.21.15.53:0/3461921206 wait complete. 2024-08-31T06:16:06.908 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:06 smithi053 ceph-mon[18924]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T06:16:06.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:16:06.996 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.36 MB/sec execute 476 sec latency 21652.753 ms 2024-08-31T06:16:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:06 smithi130 ceph-mon[22266]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T06:16:07.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:06 smithi153 ceph-mon[22320]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T06:16:07.185 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:07.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.610+0000 7f372d852640 1 -- 172.21.15.53:0/266811194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3728105070 msgr2=0x7f372810d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:07.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.610+0000 7f372d852640 1 --2- 172.21.15.53:0/266811194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3728105070 0x7f372810d6b0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f371c009900 tx=0x7f371c02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.611+0000 7f372d852640 1 -- 172.21.15.53:0/266811194 shutdown_connections 2024-08-31T06:16:07.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.611+0000 7f372d852640 1 --2- 172.21.15.53:0/266811194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f372810dbf0 0x7f3728110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.611+0000 7f372d852640 1 --2- 172.21.15.53:0/266811194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3728105070 0x7f372810d6b0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.611+0000 7f372d852640 1 --2- 172.21.15.53:0/266811194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3728104640 0x7f3728104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.611+0000 7f372d852640 1 -- 172.21.15.53:0/266811194 >> 172.21.15.53:0/266811194 conn(0x7f37280794d0 msgr2=0x7f37280798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:07.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.611+0000 7f372d852640 1 -- 172.21.15.53:0/266811194 shutdown_connections 2024-08-31T06:16:07.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.611+0000 7f372d852640 1 -- 172.21.15.53:0/266811194 wait complete. 2024-08-31T06:16:07.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.611+0000 7f372d852640 1 Processor -- start 2024-08-31T06:16:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.611+0000 7f372d852640 1 -- start start 2024-08-31T06:16:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f372d852640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3728104640 0x7f372819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f372d852640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3728105070 0x7f372819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f372d852640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f372810dbf0 0x7f372819fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f372d852640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f37281136f0 con 0x7f3728105070 2024-08-31T06:16:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f372d852640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3728113570 con 0x7f3728104640 2024-08-31T06:16:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f372d852640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3728113870 con 0x7f372810dbf0 2024-08-31T06:16:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f37267fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3728105070 0x7f372819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f37267fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3728105070 0x7f372819a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34168/0 (socket says 172.21.15.53:34168) 2024-08-31T06:16:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f37267fc640 1 -- 172.21.15.53:0/3546694436 learned_addr learned my addr 172.21.15.53:0/3546694436 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f3726ffd640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3728104640 0x7f372819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f37277fe640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f372810dbf0 0x7f372819fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f37267fc640 1 -- 172.21.15.53:0/3546694436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f372810dbf0 msgr2=0x7f372819fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f37267fc640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f372810dbf0 0x7f372819fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f37267fc640 1 -- 172.21.15.53:0/3546694436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3728104640 msgr2=0x7f372819a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f37267fc640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3728104640 0x7f372819a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f37267fc640 1 -- 172.21.15.53:0/3546694436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37281a0090 con 0x7f3728105070 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.612+0000 7f37277fe640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f372810dbf0 0x7f372819fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.613+0000 7f37267fc640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3728105070 0x7f372819a780 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f371c005940 tx=0x7f371c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.613+0000 7f372c850640 1 -- 172.21.15.53:0/3546694436 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c03f030 con 0x7f3728105070 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.613+0000 7f372c850640 1 -- 172.21.15.53:0/3546694436 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f371c003c90 con 0x7f3728105070 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.613+0000 7f372d852640 1 -- 172.21.15.53:0/3546694436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37281a0320 con 0x7f3728105070 2024-08-31T06:16:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.613+0000 7f372c850640 1 -- 172.21.15.53:0/3546694436 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c035070 con 0x7f3728105070 2024-08-31T06:16:07.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.613+0000 7f372d852640 1 -- 172.21.15.53:0/3546694436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37281a6ba0 con 0x7f3728105070 2024-08-31T06:16:07.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.615+0000 7f3733dc7740 1 Processor -- start 2024-08-31T06:16:07.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.615+0000 7f3733dc7740 1 -- start start 2024-08-31T06:16:07.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77c01c070 0x55c77c3c1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77bffb390 0x55c77c3c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3733dc7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c77c338680 con 0x55c77bff31b0 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3733dc7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c77c327c10 con 0x55c77c01c070 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3733dc7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c77c32bbc0 con 0x55c77bffb390 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3726ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f372c850640 1 -- 172.21.15.53:0/3546694436 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f371c042030 con 0x7f3728105070 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3726ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34172/0 (socket says 172.21.15.53:34172) 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3726ffd640 1 -- 172.21.15.53:0/655942736 learned_addr learned my addr 172.21.15.53:0/655942736 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f37277fe640 1 --2- 172.21.15.53:0/655942736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77c01c070 0x55c77c3c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3726ffd640 1 -- 172.21.15.53:0/655942736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77bffb390 msgr2=0x55c77c3c1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3726ffd640 1 --2- 172.21.15.53:0/655942736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77bffb390 0x55c77c3c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3726ffd640 1 -- 172.21.15.53:0/655942736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77c01c070 msgr2=0x55c77c3c1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3726ffd640 1 --2- 172.21.15.53:0/655942736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77c01c070 0x55c77c3c1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3726ffd640 1 -- 172.21.15.53:0/655942736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c77c087650 con 0x55c77bff31b0 2024-08-31T06:16:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.616+0000 7f3726ffd640 1 --2- 172.21.15.53:0/655942736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c1850 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f371800ac70 tx=0x7f371800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacbbd3120b77f8c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.617+0000 7f370dffb640 1 -- 172.21.15.53:0/655942736 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718005220 con 0x55c77bff31b0 2024-08-31T06:16:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.617+0000 7f370dffb640 1 -- 172.21.15.53:0/655942736 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37180047a0 con 0x55c77bff31b0 2024-08-31T06:16:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.617+0000 7f370dffb640 1 -- 172.21.15.53:0/655942736 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37180186f0 con 0x55c77bff31b0 2024-08-31T06:16:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.617+0000 7f372c850640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37100b4cd0 0x7f37100b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.617+0000 7f37277fe640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37100b4cd0 0x7f37100b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.617+0000 7f372c850640 1 -- 172.21.15.53:0/3546694436 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f371c105bf0 con 0x7f3728105070 2024-08-31T06:16:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f3733dc7740 1 -- 172.21.15.53:0/655942736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 msgr2=0x55c77c3c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f37277fe640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37100b4cd0 0x7f37100b71e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f372000f4c0 tx=0x7f3720007740 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f3733dc7740 1 --2- 172.21.15.53:0/655942736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c1850 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f371800ac70 tx=0x7f371800f790 comp rx=0 tx=0).stop 2024-08-31T06:16:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f3733dc7740 1 -- 172.21.15.53:0/655942736 shutdown_connections 2024-08-31T06:16:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f3733dc7740 1 --2- 172.21.15.53:0/655942736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77bffb390 0x55c77c3c1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f3733dc7740 1 --2- 172.21.15.53:0/655942736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c1850 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f3733dc7740 1 --2- 172.21.15.53:0/655942736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77c01c070 0x55c77c3c1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f3733dc7740 1 -- 172.21.15.53:0/655942736 >> 172.21.15.53:0/655942736 conn(0x55c77c010460 msgr2=0x55c77c3bf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f3733dc7740 1 -- 172.21.15.53:0/655942736 shutdown_connections 2024-08-31T06:16:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f3733dc7740 1 -- 172.21.15.53:0/655942736 wait complete. 2024-08-31T06:16:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f3733dc7740 1 -- start start 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.618+0000 7f3733dc7740 1 Processor -- start 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77bff31b0 0x55c77c3cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bffb390 0x55c77c3ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77c01c070 0x55c77c3d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f3733dc7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c77c18a700 con 0x55c77bffb390 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f3733dc7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c77c2ae750 con 0x55c77c01c070 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f3733dc7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c77c3cfaf0 con 0x55c77bff31b0 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f3733dc7740 10 client.0 _ll_register_callbacks cb 0x55c77c2dde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f37267fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bffb390 0x55c77c3ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f37267fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bffb390 0x55c77c3ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34176/0 (socket says 172.21.15.53:34176) 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f37267fc640 1 -- 172.21.15.53:0/1762479350 learned_addr learned my addr 172.21.15.53:0/1762479350 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f37277fe640 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77c01c070 0x55c77c3d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f3726ffd640 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77bff31b0 0x55c77c3cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f37267fc640 1 -- 172.21.15.53:0/1762479350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77bff31b0 msgr2=0x55c77c3cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f37267fc640 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77bff31b0 0x55c77c3cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f37267fc640 1 -- 172.21.15.53:0/1762479350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77c01c070 msgr2=0x55c77c3d8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f37267fc640 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77c01c070 0x55c77c3d8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f37267fc640 1 -- 172.21.15.53:0/1762479350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c77c2e7900 con 0x55c77bffb390 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f3726ffd640 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77bff31b0 0x55c77c3cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f37267fc640 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bffb390 0x55c77c3ccfc0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f371c000c00 tx=0x7f371c0cbc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90eb803fe6b632b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.619+0000 7f3706ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3706ffd640 1 -- 172.21.15.53:0/1762479350 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c049040 con 0x55c77bffb390 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3706ffd640 1 -- 172.21.15.53:0/1762479350 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f371c103510 con 0x55c77bffb390 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3733dc7740 1 -- 172.21.15.53:0/1762479350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37180047a0 con 0x55c77bffb390 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3706ffd640 1 -- 172.21.15.53:0/1762479350 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f371c103710 con 0x55c77bffb390 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3733dc7740 10 client.19119 fetch_fsmap learned FSMap version 49 2024-08-31T06:16:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3733dc7740 1 -- 172.21.15.53:0/1762479350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55c77c3db8b0 con 0x55c77bffb390 2024-08-31T06:16:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3706ffd640 1 -- 172.21.15.53:0/1762479350 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37180047a0 con 0x55c77bffb390 2024-08-31T06:16:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3706ffd640 1 -- 172.21.15.53:0/1762479350 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 49) ==== 8402+0+0 (secure 0 0 0) 0x7f371c0d50c0 con 0x55c77bffb390 2024-08-31T06:16:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3733dc7740 10 client.19119 fetch_fsmap finished waiting for FSMap version 49 2024-08-31T06:16:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3733dc7740 10 client.19119 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:16:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3733dc7740 20 client.19119 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3733dc7740 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c77bfda9f0 0x55c77c3ded50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3733dc7740 4 client.19119 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.620+0000 7f3733dc7740 1 -- 172.21.15.53:0/1762479350 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c77c33a5d0 con 0x55c77bfda9f0 2024-08-31T06:16:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.621+0000 7f3726ffd640 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c77bfda9f0 0x55c77c3ded50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.621+0000 7f3726ffd640 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c77bfda9f0 0x55c77c3ded50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc3e1c123255282 server_cookie=8728c0f0ec856ed9 in_seq=0 out_seq=0 2024-08-31T06:16:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.621+0000 7f3706ffd640 10 client.19119 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:16:07.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.622+0000 7f3706ffd640 1 -- 172.21.15.53:0/1762479350 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c77c33a5d0 con 0x55c77bfda9f0 2024-08-31T06:16:07.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.622+0000 7f3706ffd640 10 client.19119 handle_command_reply: tid=0 2024-08-31T06:16:07.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.622+0000 7f3733dc7740 1 client.19119 shutdown 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3733dc7740 1 -- 172.21.15.53:0/1762479350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bffb390 msgr2=0x55c77c3ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3733dc7740 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bffb390 0x55c77c3ccfc0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f371c000c00 tx=0x7f371c0cbc70 comp rx=0 tx=0).stop 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3733dc7740 1 -- 172.21.15.53:0/1762479350 shutdown_connections 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3733dc7740 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c77bfda9f0 0x55c77c3ded50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3733dc7740 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77c01c070 0x55c77c3d8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3733dc7740 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bffb390 0x55c77c3ccfc0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3733dc7740 1 --2- 172.21.15.53:0/1762479350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77bff31b0 0x55c77c3cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3706ffd640 0 client.19119 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3733dc7740 1 -- 172.21.15.53:0/1762479350 >> 172.21.15.53:0/1762479350 conn(0x55c77c010460 msgr2=0x55c77c3c44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3733dc7740 1 -- 172.21.15.53:0/1762479350 shutdown_connections 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3733dc7740 1 -- 172.21.15.53:0/1762479350 wait complete. 2024-08-31T06:16:07.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.623+0000 7f3733dc7740 20 client.19119 trim_cache size 0 max 16384 2024-08-31T06:16:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.636+0000 7f3733dc7740 1 Processor -- start 2024-08-31T06:16:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.636+0000 7f3733dc7740 1 -- start start 2024-08-31T06:16:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.636+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.636+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77bffb390 0x55c77c3d8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.636+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77c01c070 0x55c77c3c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.636+0000 7f3733dc7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f37281af550 con 0x55c77bff31b0 2024-08-31T06:16:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.636+0000 7f3733dc7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37281b1270 con 0x55c77bffb390 2024-08-31T06:16:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.636+0000 7f3733dc7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37281afc20 con 0x55c77c01c070 2024-08-31T06:16:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.636+0000 7f3726ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.636+0000 7f3726ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34192/0 (socket says 172.21.15.53:34192) 2024-08-31T06:16:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.636+0000 7f3726ffd640 1 -- 172.21.15.53:0/3356064926 learned_addr learned my addr 172.21.15.53:0/3356064926 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.637+0000 7f37277fe640 1 --2- 172.21.15.53:0/3356064926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77c01c070 0x55c77c3c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.637+0000 7f3726ffd640 1 -- 172.21.15.53:0/3356064926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77c01c070 msgr2=0x55c77c3c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.637+0000 7f3726ffd640 1 --2- 172.21.15.53:0/3356064926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77c01c070 0x55c77c3c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.637+0000 7f3726ffd640 1 -- 172.21.15.53:0/3356064926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77bffb390 msgr2=0x55c77c3d8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.637+0000 7f3726ffd640 1 --2- 172.21.15.53:0/3356064926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77bffb390 0x55c77c3d8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.637+0000 7f3726ffd640 1 -- 172.21.15.53:0/3356064926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c77c3c5060 con 0x55c77bff31b0 2024-08-31T06:16:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.637+0000 7f3726ffd640 1 --2- 172.21.15.53:0/3356064926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c4b20 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f371800a710 tx=0x7f3718005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b663a0d3341b7fea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:07.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.637+0000 7f370d7fa640 1 -- 172.21.15.53:0/3356064926 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718004b10 con 0x55c77bff31b0 2024-08-31T06:16:07.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.637+0000 7f370d7fa640 1 -- 172.21.15.53:0/3356064926 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3718004550 con 0x55c77bff31b0 2024-08-31T06:16:07.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.637+0000 7f370d7fa640 1 -- 172.21.15.53:0/3356064926 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37180039f0 con 0x55c77bff31b0 2024-08-31T06:16:07.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.638+0000 7f3733dc7740 1 -- 172.21.15.53:0/3356064926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 msgr2=0x55c77c3c4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:07.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.638+0000 7f3733dc7740 1 --2- 172.21.15.53:0/3356064926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c4b20 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f371800a710 tx=0x7f3718005e60 comp rx=0 tx=0).stop 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.638+0000 7f3733dc7740 1 -- 172.21.15.53:0/3356064926 shutdown_connections 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.638+0000 7f3733dc7740 1 --2- 172.21.15.53:0/3356064926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77c01c070 0x55c77c3c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.638+0000 7f3733dc7740 1 --2- 172.21.15.53:0/3356064926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77bffb390 0x55c77c3d8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.638+0000 7f3733dc7740 1 --2- 172.21.15.53:0/3356064926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3c4b20 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.638+0000 7f3733dc7740 1 -- 172.21.15.53:0/3356064926 >> 172.21.15.53:0/3356064926 conn(0x55c77c010460 msgr2=0x55c77c3c4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.638+0000 7f3733dc7740 1 -- 172.21.15.53:0/3356064926 shutdown_connections 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.638+0000 7f3733dc7740 1 -- 172.21.15.53:0/3356064926 wait complete. 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.638+0000 7f3733dc7740 1 -- start start 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3733dc7740 1 Processor -- start 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77bffb390 0x55c77c3d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3733dc7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77c01c070 0x55c77c442750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3733dc7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f37281b0ae0 con 0x55c77bff31b0 2024-08-31T06:16:07.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3733dc7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37281b0380 con 0x55c77bffb390 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3733dc7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37281ad550 con 0x55c77c01c070 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3733dc7740 10 client.0 _ll_register_callbacks cb 0x7f371c005e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3726ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3726ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34194/0 (socket says 172.21.15.53:34194) 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3726ffd640 1 -- 172.21.15.53:0/443390307 learned_addr learned my addr 172.21.15.53:0/443390307 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f37267fc640 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77bffb390 0x55c77c3d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f37277fe640 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77c01c070 0x55c77c442750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3726ffd640 1 -- 172.21.15.53:0/443390307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77c01c070 msgr2=0x55c77c442750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3726ffd640 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77c01c070 0x55c77c442750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3726ffd640 1 -- 172.21.15.53:0/443390307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77bffb390 msgr2=0x55c77c3d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3726ffd640 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77bffb390 0x55c77c3d1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f3726ffd640 1 -- 172.21.15.53:0/443390307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c77c442dc0 con 0x55c77bff31b0 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.639+0000 7f37277fe640 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77c01c070 0x55c77c442750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:07.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3726ffd640 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3d1760 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f371800afe0 tx=0x7f37180040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b917f5d7c3bd637d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3706ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3706ffd640 1 -- 172.21.15.53:0/443390307 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718004370 con 0x55c77bff31b0 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3706ffd640 1 -- 172.21.15.53:0/443390307 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f3718031070 con 0x55c77bff31b0 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3733dc7740 1 -- 172.21.15.53:0/443390307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3718004550 con 0x55c77bff31b0 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3706ffd640 1 -- 172.21.15.53:0/443390307 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f37180050e0 con 0x55c77bff31b0 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3733dc7740 10 client.19125 fetch_fsmap learned FSMap version 49 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3733dc7740 1 -- 172.21.15.53:0/443390307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55c77c44e5a0 con 0x55c77bff31b0 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3706ffd640 1 -- 172.21.15.53:0/443390307 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3718004550 con 0x55c77bff31b0 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3706ffd640 1 -- 172.21.15.53:0/443390307 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 49) ==== 8402+0+0 (secure 0 0 0) 0x7f3718003c00 con 0x55c77bff31b0 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3733dc7740 10 client.19125 fetch_fsmap finished waiting for FSMap version 49 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3733dc7740 10 client.19125 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3733dc7740 20 client.19125 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3733dc7740 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c77bfafda0 0x55c77c450b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:07.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3733dc7740 4 client.19125 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:16:07.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.640+0000 7f3733dc7740 1 -- 172.21.15.53:0/443390307 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c77c336070 con 0x55c77bfafda0 2024-08-31T06:16:07.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.641+0000 7f37267fc640 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c77bfafda0 0x55c77c450b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:07.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.641+0000 7f3706ffd640 10 client.19125 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:16:07.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.641+0000 7f37267fc640 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c77bfafda0 0x55c77c450b40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ceead49ffab54b8 server_cookie=b817d8baeacf2114 in_seq=0 out_seq=0 2024-08-31T06:16:07.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.641+0000 7f3706ffd640 1 -- 172.21.15.53:0/443390307 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c77c336070 con 0x55c77bfafda0 2024-08-31T06:16:07.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.641+0000 7f3706ffd640 10 client.19125 handle_command_reply: tid=0 2024-08-31T06:16:07.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.641+0000 7f3733dc7740 1 client.19125 shutdown 2024-08-31T06:16:07.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3733dc7740 1 -- 172.21.15.53:0/443390307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 msgr2=0x55c77c3d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:07.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3733dc7740 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3d1760 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f371800afe0 tx=0x7f37180040c0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3733dc7740 1 -- 172.21.15.53:0/443390307 shutdown_connections 2024-08-31T06:16:07.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3733dc7740 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c77bfafda0 0x55c77c450b40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3733dc7740 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c77c01c070 0x55c77c442750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3733dc7740 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c77bffb390 0x55c77c3d1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3733dc7740 1 --2- 172.21.15.53:0/443390307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c77bff31b0 0x55c77c3d1760 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3733dc7740 1 -- 172.21.15.53:0/443390307 >> 172.21.15.53:0/443390307 conn(0x55c77c010460 msgr2=0x55c77c3cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:07.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3706ffd640 0 client.19125 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:16:07.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3733dc7740 1 -- 172.21.15.53:0/443390307 shutdown_connections 2024-08-31T06:16:07.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3733dc7740 1 -- 172.21.15.53:0/443390307 wait complete. 2024-08-31T06:16:07.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f3733dc7740 20 client.19125 trim_cache size 0 max 16384 2024-08-31T06:16:07.649 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:16:07.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f372d852640 1 -- 172.21.15.53:0/3546694436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37100b4cd0 msgr2=0x7f37100b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:07.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.642+0000 7f372d852640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37100b4cd0 0x7f37100b71e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f372000f4c0 tx=0x7f3720007740 comp rx=0 tx=0).stop 2024-08-31T06:16:07.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.643+0000 7f372d852640 1 -- 172.21.15.53:0/3546694436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3728105070 msgr2=0x7f372819a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:07.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.643+0000 7f372d852640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3728105070 0x7f372819a780 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f371c005940 tx=0x7f371c0042f0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.643+0000 7f372d852640 1 -- 172.21.15.53:0/3546694436 shutdown_connections 2024-08-31T06:16:07.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.643+0000 7f372d852640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37100b4cd0 0x7f37100b71e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.643+0000 7f372d852640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f372810dbf0 0x7f372819fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.643+0000 7f372d852640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3728105070 0x7f372819a780 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.643+0000 7f372d852640 1 --2- 172.21.15.53:0/3546694436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3728104640 0x7f372819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:07.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.643+0000 7f372d852640 1 -- 172.21.15.53:0/3546694436 >> 172.21.15.53:0/3546694436 conn(0x7f37280794d0 msgr2=0x7f37280ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:07.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.643+0000 7f372d852640 1 -- 172.21.15.53:0/3546694436 shutdown_connections 2024-08-31T06:16:07.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:07.643+0000 7f372d852640 1 -- 172.21.15.53:0/3546694436 wait complete. 2024-08-31T06:16:07.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:16:07.742 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:07 smithi053 ceph-mon[18924]: pgmap v669: 97 pgs: 97 active+clean; 96 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 78 KiB/s wr, 35 op/s 2024-08-31T06:16:07.971 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:07.996 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.35 MB/sec execute 477 sec latency 22652.793 ms 2024-08-31T06:16:08.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:07 smithi130 ceph-mon[22266]: pgmap v669: 97 pgs: 97 active+clean; 96 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 78 KiB/s wr, 35 op/s 2024-08-31T06:16:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:07 smithi153 ceph-mon[22320]: pgmap v669: 97 pgs: 97 active+clean; 96 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 78 KiB/s wr, 35 op/s 2024-08-31T06:16:08.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.439+0000 7f84f5707640 1 -- 172.21.15.53:0/3807989169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0109b90 msgr2=0x7f84f01103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:08.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.439+0000 7f84f5707640 1 --2- 172.21.15.53:0/3807989169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0109b90 0x7f84f01103c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009ca0 tx=0x7f84e802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:16:08.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.439+0000 7f84f5707640 1 -- 172.21.15.53:0/3807989169 shutdown_connections 2024-08-31T06:16:08.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.439+0000 7f84f5707640 1 --2- 172.21.15.53:0/3807989169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0109b90 0x7f84f01103c0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.439+0000 7f84f5707640 1 --2- 172.21.15.53:0/3807989169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84f0109240 0x7f84f0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.439+0000 7f84f5707640 1 --2- 172.21.15.53:0/3807989169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84f0103900 0x7f84f0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.439+0000 7f84f5707640 1 -- 172.21.15.53:0/3807989169 >> 172.21.15.53:0/3807989169 conn(0x7f84f007b5f0 msgr2=0x7f84f007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.439+0000 7f84f5707640 1 -- 172.21.15.53:0/3807989169 shutdown_connections 2024-08-31T06:16:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.439+0000 7f84f5707640 1 -- 172.21.15.53:0/3807989169 wait complete. 2024-08-31T06:16:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.440+0000 7f84f5707640 1 Processor -- start 2024-08-31T06:16:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.440+0000 7f84f5707640 1 -- start start 2024-08-31T06:16:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.440+0000 7f84f5707640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84f0103900 0x7f84f019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.440+0000 7f84f5707640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84f0109240 0x7f84f019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.440+0000 7f84f5707640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0109b90 0x7f84f019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.440+0000 7f84f5707640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0113750 con 0x7f84f0109b90 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.440+0000 7f84f5707640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01135d0 con 0x7f84f0109240 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.440+0000 7f84f5707640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01138d0 con 0x7f84f0103900 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0109b90 0x7f84f019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0109b90 0x7f84f019f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34218/0 (socket says 172.21.15.53:34218) 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84ef7fe640 1 -- 172.21.15.53:0/4059126279 learned_addr learned my addr 172.21.15.53:0/4059126279 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84eeffd640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84f0103900 0x7f84f019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84ee7fc640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84f0109240 0x7f84f019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84ef7fe640 1 -- 172.21.15.53:0/4059126279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84f0103900 msgr2=0x7f84f019a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84ef7fe640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84f0103900 0x7f84f019a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84ef7fe640 1 -- 172.21.15.53:0/4059126279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84f0109240 msgr2=0x7f84f019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84ef7fe640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84f0109240 0x7f84f019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84ef7fe640 1 -- 172.21.15.53:0/4059126279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f01a0030 con 0x7f84f0109b90 2024-08-31T06:16:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84ef7fe640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0109b90 0x7f84f019f9c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f84e8005cc0 tx=0x7f84e8032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84d7fff640 1 -- 172.21.15.53:0/4059126279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8032e00 con 0x7f84f0109b90 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84f5707640 1 -- 172.21.15.53:0/4059126279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f01a02c0 con 0x7f84f0109b90 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84d7fff640 1 -- 172.21.15.53:0/4059126279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84e80044d0 con 0x7f84f0109b90 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84d7fff640 1 -- 172.21.15.53:0/4059126279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8030b70 con 0x7f84f0109b90 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.441+0000 7f84f5707640 1 -- 172.21.15.53:0/4059126279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f01a6b40 con 0x7f84f0109b90 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.442+0000 7f84f5707640 1 -- 172.21.15.53:0/4059126279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f0103d10 con 0x7f84f0109b90 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.444+0000 7f84d7fff640 1 -- 172.21.15.53:0/4059126279 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f84e8030d10 con 0x7f84f0109b90 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.445+0000 7f84d7fff640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f84d80b4cd0 0x7f84d80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.445+0000 7f84eeffd640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f84d80b4cd0 0x7f84d80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.445+0000 7f84d7fff640 1 -- 172.21.15.53:0/4059126279 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f84e81069b0 con 0x7f84f0109b90 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.445+0000 7f84eeffd640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f84d80b4cd0 0x7f84d80b71e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f84e000bbe0 tx=0x7f84e000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.448+0000 7f84d7fff640 1 -- 172.21.15.53:0/4059126279 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f84e80cd780 con 0x7f84f0109b90 2024-08-31T06:16:08.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.676+0000 7f84f5707640 1 -- 172.21.15.53:0/4059126279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84f010b980 con 0x7f84f0109b90 2024-08-31T06:16:08.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.677+0000 7f84d7fff640 1 -- 172.21.15.53:0/4059126279 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+12002 (secure 0 0 0) 0x7f84e80cd080 con 0x7f84f0109b90 2024-08-31T06:16:08.679 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:16:08.680 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":49,"btime":"2024-08-31T06:16:04:692906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:16:03.799735+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:16:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 49 2024-08-31T06:16:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 -- 172.21.15.53:0/4059126279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f84d80b4cd0 msgr2=0x7f84d80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f84d80b4cd0 0x7f84d80b71e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f84e000bbe0 tx=0x7f84e000b390 comp rx=0 tx=0).stop 2024-08-31T06:16:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 -- 172.21.15.53:0/4059126279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0109b90 msgr2=0x7f84f019f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0109b90 0x7f84f019f9c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f84e8005cc0 tx=0x7f84e8032a10 comp rx=0 tx=0).stop 2024-08-31T06:16:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 -- 172.21.15.53:0/4059126279 shutdown_connections 2024-08-31T06:16:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f84d80b4cd0 0x7f84d80b71e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0109b90 0x7f84f019f9c0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84f0109240 0x7f84f019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 --2- 172.21.15.53:0/4059126279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84f0103900 0x7f84f019a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 -- 172.21.15.53:0/4059126279 >> 172.21.15.53:0/4059126279 conn(0x7f84f007b5f0 msgr2=0x7f84f0105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 -- 172.21.15.53:0/4059126279 shutdown_connections 2024-08-31T06:16:08.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:08.679+0000 7f84f5707640 1 -- 172.21.15.53:0/4059126279 wait complete. 2024-08-31T06:16:08.947 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:08 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4059126279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:16:08.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:16:08.995 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.35 MB/sec execute 478 sec latency 23652.825 ms 2024-08-31T06:16:09.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:08 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4059126279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:16:09.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:08 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4059126279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:16:09.634 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id be9c6f0c --release --await' 2024-08-31T06:16:09.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id be9c6f0c --release --await 2024-08-31T06:16:09.673 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:09 smithi053 ceph-mon[18924]: pgmap v670: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 75 KiB/s wr, 33 op/s 2024-08-31T06:16:09.996 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.35 MB/sec execute 479 sec latency 24652.850 ms 2024-08-31T06:16:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:09 smithi130 ceph-mon[22266]: pgmap v670: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 75 KiB/s wr, 33 op/s 2024-08-31T06:16:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:09 smithi153 ceph-mon[22320]: pgmap v670: 97 pgs: 97 active+clean; 96 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 75 KiB/s wr, 33 op/s 2024-08-31T06:16:10.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.162+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/882889450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2d81092a0 msgr2=0x7fb2d81096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.162+0000 7fb2dfc7b640 1 --2- 172.21.15.53:0/882889450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2d81092a0 0x7fb2d81096b0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009900 tx=0x7fb2c802a410 comp rx=0 tx=0).stop 2024-08-31T06:16:10.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.162+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/882889450 shutdown_connections 2024-08-31T06:16:10.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.162+0000 7fb2dfc7b640 1 --2- 172.21.15.53:0/882889450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d8109bf0 0x7fb2d8110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.162+0000 7fb2dfc7b640 1 --2- 172.21.15.53:0/882889450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2d81092a0 0x7fb2d81096b0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.162+0000 7fb2dfc7b640 1 --2- 172.21.15.53:0/882889450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d8101d60 0x7fb2d8102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.162+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/882889450 >> 172.21.15.53:0/882889450 conn(0x7fb2d8079d30 msgr2=0x7fb2d807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.162+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/882889450 shutdown_connections 2024-08-31T06:16:10.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.162+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/882889450 wait complete. 2024-08-31T06:16:10.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2dfc7b640 1 Processor -- start 2024-08-31T06:16:10.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2dfc7b640 1 -- start start 2024-08-31T06:16:10.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2dfc7b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d8101d60 0x7fb2d819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2dfc7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2d81092a0 0x7fb2d819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2dfc7b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d8109bf0 0x7fb2d819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2dfc7b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8113760 con 0x7fb2d81092a0 2024-08-31T06:16:10.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2dfc7b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d81135e0 con 0x7fb2d8109bf0 2024-08-31T06:16:10.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2dfc7b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d81138e0 con 0x7fb2d8101d60 2024-08-31T06:16:10.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2dd216640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2d81092a0 0x7fb2d819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2dd216640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2d81092a0 0x7fb2d819a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34236/0 (socket says 172.21.15.53:34236) 2024-08-31T06:16:10.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2dd216640 1 -- 172.21.15.53:0/4285874528 learned_addr learned my addr 172.21.15.53:0/4285874528 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:10.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.163+0000 7fb2de218640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d8109bf0 0x7fb2d819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2dda17640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d8101d60 0x7fb2d819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2dd216640 1 -- 172.21.15.53:0/4285874528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d8101d60 msgr2=0x7fb2d819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2dd216640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d8101d60 0x7fb2d819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2dd216640 1 -- 172.21.15.53:0/4285874528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d8109bf0 msgr2=0x7fb2d819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2dd216640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d8109bf0 0x7fb2d819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2dd216640 1 -- 172.21.15.53:0/4285874528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d81a0140 con 0x7fb2d81092a0 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2dd216640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2d81092a0 0x7fb2d819a770 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8005940 tx=0x7fb2c80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2ceffd640 1 -- 172.21.15.53:0/4285874528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c803f030 con 0x7fb2d81092a0 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/4285874528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d81a03d0 con 0x7fb2d81092a0 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2ceffd640 1 -- 172.21.15.53:0/4285874528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2c8003a80 con 0x7fb2d81092a0 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2ceffd640 1 -- 172.21.15.53:0/4285874528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8035070 con 0x7fb2d81092a0 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.164+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/4285874528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d81a6b90 con 0x7fb2d81092a0 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2e61f0740 1 Processor -- start 2024-08-31T06:16:10.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2e61f0740 1 -- start start 2024-08-31T06:16:10.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6da070 0x561f9da7f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6b11b0 0x561f9da7f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b9390 0x561f9da7fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561f9d9f6680 con 0x561f9d6da070 2024-08-31T06:16:10.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561f9d9e5c10 con 0x561f9d6b11b0 2024-08-31T06:16:10.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561f9d9e9bc0 con 0x561f9d6b9390 2024-08-31T06:16:10.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2ceffd640 1 -- 172.21.15.53:0/4285874528 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb2c8042030 con 0x7fb2d81092a0 2024-08-31T06:16:10.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2de218640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6da070 0x561f9da7f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2de218640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6da070 0x561f9da7f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34246/0 (socket says 172.21.15.53:34246) 2024-08-31T06:16:10.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2de218640 1 -- 172.21.15.53:0/2497128907 learned_addr learned my addr 172.21.15.53:0/2497128907 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.167+0000 7fb2dda17640 1 --2- 172.21.15.53:0/2497128907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6b11b0 0x561f9da7f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2dd216640 1 --2- 172.21.15.53:0/2497128907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b9390 0x561f9da7fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2de218640 1 -- 172.21.15.53:0/2497128907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b9390 msgr2=0x561f9da7fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2de218640 1 --2- 172.21.15.53:0/2497128907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b9390 0x561f9da7fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2de218640 1 -- 172.21.15.53:0/2497128907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6b11b0 msgr2=0x561f9da7f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2de218640 1 --2- 172.21.15.53:0/2497128907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6b11b0 0x561f9da7f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2de218640 1 -- 172.21.15.53:0/2497128907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9d745650 con 0x561f9d6da070 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2dd216640 1 --2- 172.21.15.53:0/2497128907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b9390 0x561f9da7fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2de218640 1 --2- 172.21.15.53:0/2497128907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6da070 0x561f9da7f310 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0010370 tx=0x7fb2d0010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9993806fdf5ed973 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2ceffd640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2c40b4ca0 0x7fb2c40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2c3fff640 1 -- 172.21.15.53:0/2497128907 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0016070 con 0x561f9d6da070 2024-08-31T06:16:10.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2c3fff640 1 -- 172.21.15.53:0/2497128907 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2d0004d20 con 0x561f9d6da070 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2dda17640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2c40b4ca0 0x7fb2c40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2c3fff640 1 -- 172.21.15.53:0/2497128907 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0005280 con 0x561f9d6da070 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.168+0000 7fb2ceffd640 1 -- 172.21.15.53:0/4285874528 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7fb2c8105b20 con 0x7fb2d81092a0 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.169+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2497128907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6da070 msgr2=0x561f9da7f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.169+0000 7fb2dda17640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2c40b4ca0 0x7fb2c40b71b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x561f9da7df90 tx=0x7fb2d400c430 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.169+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2497128907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6da070 0x561f9da7f310 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0010370 tx=0x7fb2d0010830 comp rx=0 tx=0).stop 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.169+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2497128907 shutdown_connections 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.169+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2497128907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b9390 0x561f9da7fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.169+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2497128907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6b11b0 0x561f9da7f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.169+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2497128907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6da070 0x561f9da7f310 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.169+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2497128907 >> 172.21.15.53:0/2497128907 conn(0x561f9d6ce460 msgr2=0x561f9da7d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.169+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2497128907 shutdown_connections 2024-08-31T06:16:10.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.169+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2497128907 wait complete. 2024-08-31T06:16:10.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2e61f0740 1 -- start start 2024-08-31T06:16:10.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2e61f0740 1 Processor -- start 2024-08-31T06:16:10.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b11b0 0x561f9da8ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9da8b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6da070 0x561f9da96e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561f9d848700 con 0x561f9d6b9390 2024-08-31T06:16:10.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561f9d96c750 con 0x561f9d6da070 2024-08-31T06:16:10.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561f9da8daf0 con 0x561f9d6b11b0 2024-08-31T06:16:10.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2e61f0740 10 client.0 _ll_register_callbacks cb 0x561f9d99be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:10.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2dd216640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9da8b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2dd216640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9da8b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34256/0 (socket says 172.21.15.53:34256) 2024-08-31T06:16:10.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.170+0000 7fb2dd216640 1 -- 172.21.15.53:0/1771793237 learned_addr learned my addr 172.21.15.53:0/1771793237 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:10.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2dda17640 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b11b0 0x561f9da8ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2de218640 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6da070 0x561f9da96e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2dd216640 1 -- 172.21.15.53:0/1771793237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b11b0 msgr2=0x561f9da8ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2dd216640 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b11b0 0x561f9da8ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2dd216640 1 -- 172.21.15.53:0/1771793237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6da070 msgr2=0x561f9da96e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2dd216640 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6da070 0x561f9da96e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2dd216640 1 -- 172.21.15.53:0/1771793237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f9d9a5900 con 0x561f9d6b9390 2024-08-31T06:16:10.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2de218640 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6da070 0x561f9da96e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2dd216640 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9da8b050 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8000c00 tx=0x7fb2c80cbff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d28a3de19d2b20 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2c17fa640 1 -- 172.21.15.53:0/1771793237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8049070 con 0x561f9d6b9390 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2c17fa640 1 -- 172.21.15.53:0/1771793237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7fb2c8103440 con 0x561f9d6b9390 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2e61f0740 1 -- 172.21.15.53:0/1771793237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2d0004d20 con 0x561f9d6b9390 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2c17fa640 1 -- 172.21.15.53:0/1771793237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fb2c8103640 con 0x561f9d6b9390 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2e61f0740 10 client.19143 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2e61f0740 1 -- 172.21.15.53:0/1771793237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x561f9da998c0 con 0x561f9d6b9390 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2c17fa640 1 -- 172.21.15.53:0/1771793237 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2d0004d20 con 0x561f9d6b9390 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.171+0000 7fb2c17fa640 1 -- 172.21.15.53:0/1771793237 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7fb2c80cc3c0 con 0x561f9d6b9390 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.172+0000 7fb2e61f0740 10 client.19143 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.172+0000 7fb2e61f0740 10 client.19143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:10.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.172+0000 7fb2e61f0740 20 client.19143 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:10.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.172+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561f9d6989f0 0x561f9da9cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.172+0000 7fb2e61f0740 4 client.19143 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:10.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.172+0000 7fb2e61f0740 1 -- 172.21.15.53:0/1771793237 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f9d9f85d0 con 0x561f9d6989f0 2024-08-31T06:16:10.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.172+0000 7fb2dda17640 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561f9d6989f0 0x561f9da9cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.172+0000 7fb2c17fa640 10 client.19143 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:10.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.172+0000 7fb2dda17640 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561f9d6989f0 0x561f9da9cdb0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfbdaf957db11395 server_cookie=1ff4f67c96f19991 in_seq=0 out_seq=0 2024-08-31T06:16:10.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.173+0000 7fb2c17fa640 1 -- 172.21.15.53:0/1771793237 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f9d9f85d0 con 0x561f9d6989f0 2024-08-31T06:16:10.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.173+0000 7fb2c17fa640 10 client.19143 handle_command_reply: tid=0 2024-08-31T06:16:10.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.173+0000 7fb2e61f0740 1 client.19143 shutdown 2024-08-31T06:16:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.173+0000 7fb2e61f0740 1 -- 172.21.15.53:0/1771793237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 msgr2=0x561f9da8b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.173+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9da8b050 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8000c00 tx=0x7fb2c80cbff0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.174+0000 7fb2e61f0740 1 -- 172.21.15.53:0/1771793237 shutdown_connections 2024-08-31T06:16:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.174+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561f9d6989f0 0x561f9da9cdb0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.174+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6da070 0x561f9da96e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.174+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9da8b050 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.174+0000 7fb2c17fa640 0 client.19143 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.174+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/1771793237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b11b0 0x561f9da8ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.174+0000 7fb2e61f0740 1 -- 172.21.15.53:0/1771793237 >> 172.21.15.53:0/1771793237 conn(0x561f9d6ce460 msgr2=0x561f9da824f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.174+0000 7fb2e61f0740 1 -- 172.21.15.53:0/1771793237 shutdown_connections 2024-08-31T06:16:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.174+0000 7fb2e61f0740 1 -- 172.21.15.53:0/1771793237 wait complete. 2024-08-31T06:16:10.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.174+0000 7fb2e61f0740 20 client.19143 trim_cache size 0 max 16384 2024-08-31T06:16:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.187+0000 7fb2e61f0740 1 Processor -- start 2024-08-31T06:16:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.187+0000 7fb2e61f0740 1 -- start start 2024-08-31T06:16:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 0x561f9da8c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b11b0 0x561f9da96d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b9390 0x561f9da97250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d81af580 con 0x561f9d6b11b0 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d81b1240 con 0x561f9d6989f0 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d81afc50 con 0x561f9d6b9390 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2dd216640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b11b0 0x561f9da96d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2dd216640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b11b0 0x561f9da96d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34262/0 (socket says 172.21.15.53:34262) 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2dd216640 1 -- 172.21.15.53:0/2566576298 learned_addr learned my addr 172.21.15.53:0/2566576298 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2dda17640 1 --2- 172.21.15.53:0/2566576298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 0x561f9da8c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2de218640 1 --2- 172.21.15.53:0/2566576298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b9390 0x561f9da97250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2dd216640 1 -- 172.21.15.53:0/2566576298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b9390 msgr2=0x561f9da97250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2dd216640 1 --2- 172.21.15.53:0/2566576298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b9390 0x561f9da97250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2dd216640 1 -- 172.21.15.53:0/2566576298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 msgr2=0x561f9da8c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2dd216640 1 --2- 172.21.15.53:0/2566576298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 0x561f9da8c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2dd216640 1 -- 172.21.15.53:0/2566576298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9da8bdd0 con 0x561f9d6b11b0 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2dda17640 1 --2- 172.21.15.53:0/2566576298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 0x561f9da8c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.188+0000 7fb2dd216640 1 --2- 172.21.15.53:0/2566576298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b11b0 0x561f9da96d10 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8006010 tx=0x7fb2c8009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0770e0deed97ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.189+0000 7fb2c37fe640 1 -- 172.21.15.53:0/2566576298 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c80cbc70 con 0x561f9d6b11b0 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.189+0000 7fb2c37fe640 1 -- 172.21.15.53:0/2566576298 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2c80cc860 con 0x561f9d6b11b0 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.189+0000 7fb2c37fe640 1 -- 172.21.15.53:0/2566576298 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c80d5070 con 0x561f9d6b11b0 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.190+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2566576298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b11b0 msgr2=0x561f9da96d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.190+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2566576298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b11b0 0x561f9da96d10 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8006010 tx=0x7fb2c8009650 comp rx=0 tx=0).stop 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.190+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2566576298 shutdown_connections 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.190+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2566576298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b9390 0x561f9da97250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.190+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2566576298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b11b0 0x561f9da96d10 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.190+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2566576298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 0x561f9da8c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.190+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2566576298 >> 172.21.15.53:0/2566576298 conn(0x561f9d6ce460 msgr2=0x561f9da8c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.190+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2566576298 shutdown_connections 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.190+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2566576298 wait complete. 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.190+0000 7fb2e61f0740 1 -- start start 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.190+0000 7fb2e61f0740 1 Processor -- start 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 0x561f9da8f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b11b0 0x561f9da8fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2e61f0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9db00860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d81b0ab0 con 0x561f9d6b9390 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d81b0350 con 0x561f9d6989f0 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2e61f0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d81ad580 con 0x561f9d6b11b0 2024-08-31T06:16:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2e61f0740 10 client.0 _ll_register_callbacks cb 0x7fb2c8009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2de218640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9db00860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2de218640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9db00860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34268/0 (socket says 172.21.15.53:34268) 2024-08-31T06:16:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2de218640 1 -- 172.21.15.53:0/2313301539 learned_addr learned my addr 172.21.15.53:0/2313301539 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2dda17640 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 0x561f9da8f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2dd216640 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b11b0 0x561f9da8fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2de218640 1 -- 172.21.15.53:0/2313301539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b11b0 msgr2=0x561f9da8fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2de218640 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b11b0 0x561f9da8fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2de218640 1 -- 172.21.15.53:0/2313301539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 msgr2=0x561f9da8f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.191+0000 7fb2de218640 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 0x561f9da8f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.192+0000 7fb2de218640 1 -- 172.21.15.53:0/2313301539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f9db00ed0 con 0x561f9d6b9390 2024-08-31T06:16:10.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.192+0000 7fb2dda17640 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 0x561f9da8f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.192+0000 7fb2de218640 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9db00860 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0010370 tx=0x7fb2d0003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92533bbee3de9a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.192+0000 7fb2c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.192+0000 7fb2c17fa640 1 -- 172.21.15.53:0/2313301539 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0016070 con 0x561f9d6b9390 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.192+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2313301539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2c80cc860 con 0x561f9d6b9390 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.192+0000 7fb2c17fa640 1 -- 172.21.15.53:0/2313301539 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7fb2d0012710 con 0x561f9d6b9390 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.192+0000 7fb2c17fa640 1 -- 172.21.15.53:0/2313301539 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fb2d0012910 con 0x561f9d6b9390 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.192+0000 7fb2e61f0740 10 client.19149 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.192+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2313301539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x561f9db08310 con 0x561f9d6b9390 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.192+0000 7fb2c17fa640 1 -- 172.21.15.53:0/2313301539 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2c80cc860 con 0x561f9d6b9390 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.193+0000 7fb2c17fa640 1 -- 172.21.15.53:0/2313301539 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7fb2d000f040 con 0x561f9d6b9390 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.193+0000 7fb2e61f0740 10 client.19149 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.193+0000 7fb2e61f0740 10 client.19149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:10.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.193+0000 7fb2e61f0740 20 client.19149 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.193+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561f9d6da070 0x561f9db0a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.193+0000 7fb2e61f0740 4 client.19149 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:16:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.193+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2313301539 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f9d9f4070 con 0x561f9d6da070 2024-08-31T06:16:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.193+0000 7fb2dda17640 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561f9d6da070 0x561f9db0a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.193+0000 7fb2c17fa640 10 client.19149 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2dda17640 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561f9d6da070 0x561f9db0a990 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb1cdd84dbb6eb29 server_cookie=5a5df5aa33e0a614 in_seq=0 out_seq=0 2024-08-31T06:16:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2c17fa640 1 -- 172.21.15.53:0/2313301539 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f9d9f4070 con 0x561f9d6da070 2024-08-31T06:16:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2c17fa640 10 client.19149 handle_command_reply: tid=0 2024-08-31T06:16:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 1 client.19149 shutdown 2024-08-31T06:16:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2313301539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 msgr2=0x561f9db00860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9db00860 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0010370 tx=0x7fb2d0003b80 comp rx=0 tx=0).stop 2024-08-31T06:16:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2313301539 shutdown_connections 2024-08-31T06:16:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561f9d6da070 0x561f9db0a990 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f9d6b9390 0x561f9db00860 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561f9d6b11b0 0x561f9da8fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 1 --2- 172.21.15.53:0/2313301539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f9d6989f0 0x561f9da8f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2c17fa640 0 client.19149 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2313301539 >> 172.21.15.53:0/2313301539 conn(0x561f9d6ce460 msgr2=0x561f9da8bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2313301539 shutdown_connections 2024-08-31T06:16:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 1 -- 172.21.15.53:0/2313301539 wait complete. 2024-08-31T06:16:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.194+0000 7fb2e61f0740 20 client.19149 trim_cache size 0 max 16384 2024-08-31T06:16:10.213 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:16:10.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/4285874528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2c40b4ca0 msgr2=0x7fb2c40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2c40b4ca0 0x7fb2c40b71b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x561f9da7df90 tx=0x7fb2d400c430 comp rx=0 tx=0).stop 2024-08-31T06:16:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/4285874528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2d81092a0 msgr2=0x7fb2d819a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2d81092a0 0x7fb2d819a770 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8005940 tx=0x7fb2c80040e0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/4285874528 shutdown_connections 2024-08-31T06:16:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2c40b4ca0 0x7fb2c40b71b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2d8109bf0 0x7fb2d819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2d81092a0 0x7fb2d819a770 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 --2- 172.21.15.53:0/4285874528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2d8101d60 0x7fb2d819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/4285874528 >> 172.21.15.53:0/4285874528 conn(0x7fb2d8079d30 msgr2=0x7fb2d81073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/4285874528 shutdown_connections 2024-08-31T06:16:10.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:10.195+0000 7fb2dfc7b640 1 -- 172.21.15.53:0/4285874528 wait complete. 2024-08-31T06:16:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.429+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/415762578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ab0109b20 msgr2=0x7f4ab0110350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.429+0000 7f4ab5e2f640 1 --2- 172.21.15.53:0/415762578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ab0109b20 0x7f4ab0110350 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009ca0 tx=0x7f4aa802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.429+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/415762578 shutdown_connections 2024-08-31T06:16:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.429+0000 7f4ab5e2f640 1 --2- 172.21.15.53:0/415762578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ab0109b20 0x7f4ab0110350 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.429+0000 7f4ab5e2f640 1 --2- 172.21.15.53:0/415762578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ab01091d0 0x7f4ab01095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.429+0000 7f4ab5e2f640 1 --2- 172.21.15.53:0/415762578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab01038a0 0x7f4ab0103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.429+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/415762578 >> 172.21.15.53:0/415762578 conn(0x7f4ab00ff2a0 msgr2=0x7f4ab01016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.429+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/415762578 shutdown_connections 2024-08-31T06:16:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.429+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/415762578 wait complete. 2024-08-31T06:16:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.430+0000 7f4ab5e2f640 1 Processor -- start 2024-08-31T06:16:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.430+0000 7f4ab5e2f640 1 -- start start 2024-08-31T06:16:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.430+0000 7f4ab5e2f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ab01038a0 0x7f4ab019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.430+0000 7f4ab5e2f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab01091d0 0x7f4ab019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.430+0000 7f4ab5e2f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ab0109b20 0x7f4ab019f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.430+0000 7f4ab5e2f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01136f0 con 0x7f4ab0109b20 2024-08-31T06:16:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.430+0000 7f4ab5e2f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0113570 con 0x7f4ab01038a0 2024-08-31T06:16:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.430+0000 7f4ab5e2f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0113870 con 0x7f4ab01091d0 2024-08-31T06:16:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aaffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ab0109b20 0x7f4ab019f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aaffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ab0109b20 0x7f4ab019f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34296/0 (socket says 172.21.15.53:34296) 2024-08-31T06:16:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aaffff640 1 -- 172.21.15.53:0/322711843 learned_addr learned my addr 172.21.15.53:0/322711843 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab01091d0 0x7f4ab019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ab01038a0 0x7f4ab019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aaffff640 1 -- 172.21.15.53:0/322711843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab01091d0 msgr2=0x7f4ab019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aaffff640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab01091d0 0x7f4ab019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aaffff640 1 -- 172.21.15.53:0/322711843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ab01038a0 msgr2=0x7f4ab019a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aaffff640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ab01038a0 0x7f4ab019a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aaffff640 1 -- 172.21.15.53:0/322711843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab01a0020 con 0x7f4ab0109b20 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab01091d0 0x7f4ab019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aaffff640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ab0109b20 0x7f4ab019f920 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8005e30 tx=0x7f4aa80093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aad7fa640 1 -- 172.21.15.53:0/322711843 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8032d10 con 0x7f4ab0109b20 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aad7fa640 1 -- 172.21.15.53:0/322711843 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aa8032eb0 con 0x7f4ab0109b20 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/322711843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab01a02b0 con 0x7f4ab0109b20 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4aad7fa640 1 -- 172.21.15.53:0/322711843 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8030b20 con 0x7f4ab0109b20 2024-08-31T06:16:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.431+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/322711843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab01a6aa0 con 0x7f4ab0109b20 2024-08-31T06:16:10.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.434+0000 7f4abce7f740 1 Processor -- start 2024-08-31T06:16:10.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.434+0000 7f4aad7fa640 1 -- 172.21.15.53:0/322711843 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4aa8030cc0 con 0x7f4ab0109b20 2024-08-31T06:16:10.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.434+0000 7f4abce7f740 1 -- start start 2024-08-31T06:16:10.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c610c1b0 0x55a4c64afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60e32f0 0x55a4c64b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60eb4d0 0x55a4c64b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4abce7f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a4c6425000 con 0x55a4c610c1b0 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4abce7f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a4c6414590 con 0x55a4c60e32f0 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4abce7f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a4c6418540 con 0x55a4c60eb4d0 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c610c1b0 0x55a4c64afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c610c1b0 0x55a4c64afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34298/0 (socket says 172.21.15.53:34298) 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aa7fff640 1 -- 172.21.15.53:0/3657976568 learned_addr learned my addr 172.21.15.53:0/3657976568 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/3657976568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60e32f0 0x55a4c64b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aa7fff640 1 -- 172.21.15.53:0/3657976568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60eb4d0 msgr2=0x55a4c64b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/3657976568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60eb4d0 0x55a4c64b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aa7fff640 1 -- 172.21.15.53:0/3657976568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60e32f0 msgr2=0x55a4c64b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/3657976568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60e32f0 0x55a4c64b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aa7fff640 1 -- 172.21.15.53:0/3657976568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4c6177790 con 0x55a4c610c1b0 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/3657976568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60e32f0 0x55a4c64b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aad7fa640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a9c0b4d20 0x7f4a9c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/3657976568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c610c1b0 0x55a4c64afac0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009d10 tx=0x7f4a980137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf49e39abb0ee50 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a9c0b4d20 0x7f4a9c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aad7fa640 1 -- 172.21.15.53:0/322711843 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f4aa81068c0 con 0x7f4ab0109b20 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.435+0000 7f4aa5ffb640 1 -- 172.21.15.53:0/3657976568 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98013070 con 0x55a4c610c1b0 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4aa5ffb640 1 -- 172.21.15.53:0/3657976568 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a980044c0 con 0x55a4c610c1b0 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4aa5ffb640 1 -- 172.21.15.53:0/3657976568 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800f480 con 0x55a4c610c1b0 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4abce7f740 1 -- 172.21.15.53:0/3657976568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c610c1b0 msgr2=0x55a4c64afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a9c0b4d20 0x7f4a9c0b7230 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x55a4c64ae740 tx=0x7f4aa000c6e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4abce7f740 1 --2- 172.21.15.53:0/3657976568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c610c1b0 0x55a4c64afac0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009d10 tx=0x7f4a980137d0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4abce7f740 1 -- 172.21.15.53:0/3657976568 shutdown_connections 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4abce7f740 1 --2- 172.21.15.53:0/3657976568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60eb4d0 0x55a4c64b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4abce7f740 1 --2- 172.21.15.53:0/3657976568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60e32f0 0x55a4c64b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4abce7f740 1 --2- 172.21.15.53:0/3657976568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c610c1b0 0x55a4c64afac0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4abce7f740 1 -- 172.21.15.53:0/3657976568 >> 172.21.15.53:0/3657976568 conn(0x55a4c6100300 msgr2=0x55a4c64ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4abce7f740 1 -- 172.21.15.53:0/3657976568 shutdown_connections 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.436+0000 7f4abce7f740 1 -- 172.21.15.53:0/3657976568 wait complete. 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.437+0000 7f4abce7f740 1 -- start start 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.437+0000 7f4abce7f740 1 Processor -- start 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.437+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60e32f0 0x55a4c64bb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.437+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60eb4d0 0x55a4c64bbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.437+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c610c1b0 0x55a4c64c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.437+0000 7f4abce7f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a4c634dab0 con 0x55a4c60eb4d0 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.437+0000 7f4abce7f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a4c639b680 con 0x55a4c60e32f0 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.437+0000 7f4abce7f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a4c64be240 con 0x55a4c610c1b0 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4abce7f740 10 client.0 _ll_register_callbacks cb 0x55a4c6123a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60eb4d0 0x55a4c64bbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60eb4d0 0x55a4c64bbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34308/0 (socket says 172.21.15.53:34308) 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aa7fff640 1 -- 172.21.15.53:0/430955514 learned_addr learned my addr 172.21.15.53:0/430955514 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aaffff640 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c610c1b0 0x55a4c64c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60e32f0 0x55a4c64bb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aa7fff640 1 -- 172.21.15.53:0/430955514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c610c1b0 msgr2=0x55a4c64c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c610c1b0 0x55a4c64c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aa7fff640 1 -- 172.21.15.53:0/430955514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60e32f0 msgr2=0x55a4c64bb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60e32f0 0x55a4c64bb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aa7fff640 1 -- 172.21.15.53:0/430955514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4c61f0620 con 0x55a4c60eb4d0 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aaffff640 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c610c1b0 0x55a4c64c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60eb4d0 0x55a4c64bbca0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009ce0 tx=0x7f4a98013360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee3a16d696b2745 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4a8effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4a8effd640 1 -- 172.21.15.53:0/430955514 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98003ec0 con 0x55a4c60eb4d0 2024-08-31T06:16:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4a8effd640 1 -- 172.21.15.53:0/430955514 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f4a98004060 con 0x55a4c60eb4d0 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4abce7f740 1 -- 172.21.15.53:0/430955514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a4c6426f50 con 0x55a4c60eb4d0 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4a8effd640 1 -- 172.21.15.53:0/430955514 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f4a98004260 con 0x55a4c60eb4d0 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4abce7f740 10 client.19161 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.438+0000 7f4abce7f740 1 -- 172.21.15.53:0/430955514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55a4c64ca2d0 con 0x55a4c60eb4d0 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.439+0000 7f4a8effd640 1 -- 172.21.15.53:0/430955514 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a4c6426f50 con 0x55a4c60eb4d0 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.439+0000 7f4a8effd640 1 -- 172.21.15.53:0/430955514 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7f4a98011440 con 0x55a4c60eb4d0 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.439+0000 7f4abce7f740 10 client.19161 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.439+0000 7f4abce7f740 10 client.19161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.439+0000 7f4abce7f740 20 client.19161 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.439+0000 7f4abce7f740 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a4c60cad80 0x55a4c64cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.439+0000 7f4abce7f740 4 client.19161 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.439+0000 7f4abce7f740 1 -- 172.21.15.53:0/430955514 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4c64229f0 con 0x55a4c60cad80 2024-08-31T06:16:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.439+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a4c60cad80 0x55a4c64cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.440+0000 7f4a8effd640 10 client.19161 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:10.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.440+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a4c60cad80 0x55a4c64cd6e0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1a0a89f8ebd1fff server_cookie=4d4cc9d4a37b6ad0 in_seq=0 out_seq=0 2024-08-31T06:16:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.440+0000 7f4a8effd640 1 -- 172.21.15.53:0/430955514 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a4c64229f0 con 0x55a4c60cad80 2024-08-31T06:16:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.440+0000 7f4a8effd640 10 client.19161 handle_command_reply: tid=0 2024-08-31T06:16:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.440+0000 7f4abce7f740 1 client.19161 shutdown 2024-08-31T06:16:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.440+0000 7f4abce7f740 1 -- 172.21.15.53:0/430955514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60eb4d0 msgr2=0x55a4c64bbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.440+0000 7f4abce7f740 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60eb4d0 0x55a4c64bbca0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009ce0 tx=0x7f4a98013360 comp rx=0 tx=0).stop 2024-08-31T06:16:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.441+0000 7f4abce7f740 1 -- 172.21.15.53:0/430955514 shutdown_connections 2024-08-31T06:16:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.441+0000 7f4abce7f740 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a4c60cad80 0x55a4c64cd6e0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.441+0000 7f4abce7f740 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c610c1b0 0x55a4c64c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.441+0000 7f4abce7f740 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60eb4d0 0x55a4c64bbca0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.441+0000 7f4a8effd640 0 client.19161 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.441+0000 7f4abce7f740 1 --2- 172.21.15.53:0/430955514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60e32f0 0x55a4c64bb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.441+0000 7f4abce7f740 1 -- 172.21.15.53:0/430955514 >> 172.21.15.53:0/430955514 conn(0x55a4c6100300 msgr2=0x55a4c64b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.441+0000 7f4abce7f740 1 -- 172.21.15.53:0/430955514 shutdown_connections 2024-08-31T06:16:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.441+0000 7f4abce7f740 1 -- 172.21.15.53:0/430955514 wait complete. 2024-08-31T06:16:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.441+0000 7f4abce7f740 20 client.19161 trim_cache size 0 max 16384 2024-08-31T06:16:10.456 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.457+0000 7f4abce7f740 1 Processor -- start 2024-08-31T06:16:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.457+0000 7f4abce7f740 1 -- start start 2024-08-31T06:16:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60cad80 0x55a4c64b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60e32f0 0x55a4c64d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60eb4d0 0x55a4c64d31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4abce7f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01af4b0 con 0x55a4c60e32f0 2024-08-31T06:16:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4abce7f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b1170 con 0x55a4c60cad80 2024-08-31T06:16:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4abce7f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01afb80 con 0x55a4c60eb4d0 2024-08-31T06:16:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60e32f0 0x55a4c64d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aa7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60e32f0 0x55a4c64d2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34322/0 (socket says 172.21.15.53:34322) 2024-08-31T06:16:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aa7fff640 1 -- 172.21.15.53:0/1536196700 learned_addr learned my addr 172.21.15.53:0/1536196700 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aaffff640 1 --2- 172.21.15.53:0/1536196700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60eb4d0 0x55a4c64d31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/1536196700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60cad80 0x55a4c64b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aa7fff640 1 -- 172.21.15.53:0/1536196700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60eb4d0 msgr2=0x55a4c64d31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/1536196700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60eb4d0 0x55a4c64d31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aa7fff640 1 -- 172.21.15.53:0/1536196700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60cad80 msgr2=0x55a4c64b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/1536196700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60cad80 0x55a4c64b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aa7fff640 1 -- 172.21.15.53:0/1536196700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4c64cda50 con 0x55a4c60e32f0 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aaffff640 1 --2- 172.21.15.53:0/1536196700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60eb4d0 0x55a4c64d31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/1536196700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60cad80 0x55a4c64b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.458+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/1536196700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60e32f0 0x55a4c64d2c80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f4a98001eb0 tx=0x7f4a98013e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ce5d618573b408 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.459+0000 7f4aa57fa640 1 -- 172.21.15.53:0/1536196700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9803a070 con 0x55a4c60e32f0 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.459+0000 7f4aa57fa640 1 -- 172.21.15.53:0/1536196700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a98009e00 con 0x55a4c60e32f0 2024-08-31T06:16:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.459+0000 7f4aa57fa640 1 -- 172.21.15.53:0/1536196700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800f480 con 0x55a4c60e32f0 2024-08-31T06:16:10.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.460+0000 7f4abce7f740 1 -- 172.21.15.53:0/1536196700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60e32f0 msgr2=0x55a4c64d2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.460+0000 7f4abce7f740 1 --2- 172.21.15.53:0/1536196700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60e32f0 0x55a4c64d2c80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f4a98001eb0 tx=0x7f4a98013e00 comp rx=0 tx=0).stop 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.460+0000 7f4abce7f740 1 -- 172.21.15.53:0/1536196700 shutdown_connections 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.460+0000 7f4abce7f740 1 --2- 172.21.15.53:0/1536196700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60eb4d0 0x55a4c64d31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.460+0000 7f4abce7f740 1 --2- 172.21.15.53:0/1536196700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60e32f0 0x55a4c64d2c80 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.460+0000 7f4abce7f740 1 --2- 172.21.15.53:0/1536196700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60cad80 0x55a4c64b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.460+0000 7f4abce7f740 1 -- 172.21.15.53:0/1536196700 >> 172.21.15.53:0/1536196700 conn(0x55a4c6100300 msgr2=0x55a4c64b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.460+0000 7f4abce7f740 1 -- 172.21.15.53:0/1536196700 shutdown_connections 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.460+0000 7f4abce7f740 1 -- 172.21.15.53:0/1536196700 wait complete. 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.460+0000 7f4abce7f740 1 -- start start 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.460+0000 7f4abce7f740 1 Processor -- start 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60cad80 0x55a4c64c1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60e32f0 0x55a4c64c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4abce7f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60eb4d0 0x55a4c64c2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4abce7f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b09e0 con 0x55a4c60cad80 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4abce7f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b0280 con 0x55a4c60eb4d0 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4abce7f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01ad4b0 con 0x55a4c60e32f0 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4abce7f740 10 client.0 _ll_register_callbacks cb 0x7f4a98009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4aaf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60cad80 0x55a4c64c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4aaf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60cad80 0x55a4c64c1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34330/0 (socket says 172.21.15.53:34330) 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4aaf7fe640 1 -- 172.21.15.53:0/2510858392 learned_addr learned my addr 172.21.15.53:0/2510858392 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60e32f0 0x55a4c64c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4aaf7fe640 1 -- 172.21.15.53:0/2510858392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60e32f0 msgr2=0x55a4c64c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60e32f0 0x55a4c64c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4aaf7fe640 1 -- 172.21.15.53:0/2510858392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60eb4d0 msgr2=0x55a4c64c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60eb4d0 0x55a4c64c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.461+0000 7f4aaf7fe640 1 -- 172.21.15.53:0/2510858392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4c6537090 con 0x55a4c60cad80 2024-08-31T06:16:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.462+0000 7f4aaf7fe640 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60cad80 0x55a4c64c1680 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00116c0 tx=0x7f4aa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d8a2be83e8e7b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.462+0000 7f4a8effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.462+0000 7f4a8effd640 1 -- 172.21.15.53:0/2510858392 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0033060 con 0x55a4c60cad80 2024-08-31T06:16:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.462+0000 7f4a8effd640 1 -- 172.21.15.53:0/2510858392 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f4aa001e830 con 0x55a4c60cad80 2024-08-31T06:16:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4abce7f740 1 -- 172.21.15.53:0/2510858392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a98009e00 con 0x55a4c60cad80 2024-08-31T06:16:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4a8effd640 1 -- 172.21.15.53:0/2510858392 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f4aa001ea30 con 0x55a4c60cad80 2024-08-31T06:16:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4abce7f740 10 client.19167 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4abce7f740 1 -- 172.21.15.53:0/2510858392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55a4c65383b0 con 0x55a4c60cad80 2024-08-31T06:16:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4a8effd640 1 -- 172.21.15.53:0/2510858392 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a98009e00 con 0x55a4c60cad80 2024-08-31T06:16:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4a8effd640 1 -- 172.21.15.53:0/2510858392 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7f4aa002ec00 con 0x55a4c60cad80 2024-08-31T06:16:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4abce7f740 10 client.19167 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4abce7f740 10 client.19167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4abce7f740 20 client.19167 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4abce7f740 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a4c610c1b0 0x55a4c653abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4abce7f740 4 client.19167 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:16:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.463+0000 7f4abce7f740 1 -- 172.21.15.53:0/2510858392 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a4c6420130 con 0x55a4c610c1b0 2024-08-31T06:16:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.464+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a4c610c1b0 0x55a4c653abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.464+0000 7f4a8effd640 10 client.19167 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.464+0000 7f4aa7fff640 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a4c610c1b0 0x55a4c653abf0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87a725d33eae3eae server_cookie=5071385c3092b7b4 in_seq=0 out_seq=0 2024-08-31T06:16:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.485+0000 7f4a8effd640 1 -- 172.21.15.53:0/2510858392 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a4c6420130 con 0x55a4c610c1b0 2024-08-31T06:16:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.485+0000 7f4a8effd640 10 client.19167 handle_command_reply: tid=0 2024-08-31T06:16:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.485+0000 7f4abce7f740 1 client.19167 shutdown 2024-08-31T06:16:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4abce7f740 1 -- 172.21.15.53:0/2510858392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60cad80 msgr2=0x55a4c64c1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4abce7f740 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60cad80 0x55a4c64c1680 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00116c0 tx=0x7f4aa00046c0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4abce7f740 1 -- 172.21.15.53:0/2510858392 shutdown_connections 2024-08-31T06:16:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4abce7f740 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a4c610c1b0 0x55a4c653abf0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4abce7f740 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a4c60eb4d0 0x55a4c64c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4abce7f740 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4c60e32f0 0x55a4c64c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4a8effd640 0 client.19167 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4abce7f740 1 --2- 172.21.15.53:0/2510858392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4c60cad80 0x55a4c64c1680 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4abce7f740 1 -- 172.21.15.53:0/2510858392 >> 172.21.15.53:0/2510858392 conn(0x55a4c6100300 msgr2=0x55a4c64bc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4abce7f740 1 -- 172.21.15.53:0/2510858392 shutdown_connections 2024-08-31T06:16:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4abce7f740 1 -- 172.21.15.53:0/2510858392 wait complete. 2024-08-31T06:16:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4abce7f740 20 client.19167 trim_cache size 0 max 16384 2024-08-31T06:16:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:16:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:16:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:16:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:16:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/322711843 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a9c0b4d20 msgr2=0x7f4a9c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4ab5e2f640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a9c0b4d20 0x7f4a9c0b7230 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x55a4c64ae740 tx=0x7f4aa000c6e0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/322711843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ab0109b20 msgr2=0x7f4ab019f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.486+0000 7f4ab5e2f640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ab0109b20 0x7f4ab019f920 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8005e30 tx=0x7f4aa80093d0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.487+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/322711843 shutdown_connections 2024-08-31T06:16:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.487+0000 7f4ab5e2f640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4a9c0b4d20 0x7f4a9c0b7230 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.487+0000 7f4ab5e2f640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ab0109b20 0x7f4ab019f920 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.487+0000 7f4ab5e2f640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab01091d0 0x7f4ab019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.487+0000 7f4ab5e2f640 1 --2- 172.21.15.53:0/322711843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ab01038a0 0x7f4ab019a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.487+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/322711843 >> 172.21.15.53:0/322711843 conn(0x7f4ab00ff2a0 msgr2=0x7f4ab0106760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.487+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/322711843 shutdown_connections 2024-08-31T06:16:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:10.487+0000 7f4ab5e2f640 1 -- 172.21.15.53:0/322711843 wait complete. 2024-08-31T06:16:10.851 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:10 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:16:10.996 INFO:tasks.workunit.client.0.smithi053.stdout: 1 172835 1.35 MB/sec execute 480 sec latency 25653.172 ms 2024-08-31T06:16:11.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:10 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:16:11.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:10 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:16:11.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.410+0000 7f6b5400f640 1 -- 172.21.15.53:0/3683142352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b4c102800 msgr2=0x7f6b4c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:11.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.410+0000 7f6b5400f640 1 --2- 172.21.15.53:0/3683142352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b4c102800 0x7f6b4c102c10 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009ca0 tx=0x7f6b3c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.410+0000 7f6b5400f640 1 -- 172.21.15.53:0/3683142352 shutdown_connections 2024-08-31T06:16:11.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.410+0000 7f6b5400f640 1 --2- 172.21.15.53:0/3683142352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4c108a90 0x7f6b4c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.410+0000 7f6b5400f640 1 --2- 172.21.15.53:0/3683142352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b4c108140 0x7f6b4c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.410+0000 7f6b5400f640 1 --2- 172.21.15.53:0/3683142352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b4c102800 0x7f6b4c102c10 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.410+0000 7f6b5400f640 1 -- 172.21.15.53:0/3683142352 >> 172.21.15.53:0/3683142352 conn(0x7f6b4c0794d0 msgr2=0x7f6b4c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:11.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.410+0000 7f6b5400f640 1 -- 172.21.15.53:0/3683142352 shutdown_connections 2024-08-31T06:16:11.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.410+0000 7f6b5400f640 1 -- 172.21.15.53:0/3683142352 wait complete. 2024-08-31T06:16:11.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b5400f640 1 Processor -- start 2024-08-31T06:16:11.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b5400f640 1 -- start start 2024-08-31T06:16:11.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b5400f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b4c102800 0x7f6b4c19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b5400f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b4c108140 0x7f6b4c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b5400f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4c108a90 0x7f6b4c19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b5400f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c1137e0 con 0x7f6b4c102800 2024-08-31T06:16:11.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b5400f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c113660 con 0x7f6b4c108a90 2024-08-31T06:16:11.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b5400f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c113960 con 0x7f6b4c108140 2024-08-31T06:16:11.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b51dab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b4c102800 0x7f6b4c19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b51dab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b4c102800 0x7f6b4c19a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34358/0 (socket says 172.21.15.53:34358) 2024-08-31T06:16:11.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b51dab640 1 -- 172.21.15.53:0/2136011741 learned_addr learned my addr 172.21.15.53:0/2136011741 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:11.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b515aa640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b4c108140 0x7f6b4c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.411+0000 7f6b525ac640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4c108a90 0x7f6b4c19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b51dab640 1 -- 172.21.15.53:0/2136011741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b4c108140 msgr2=0x7f6b4c19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:11.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b51dab640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b4c108140 0x7f6b4c19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b51dab640 1 -- 172.21.15.53:0/2136011741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4c108a90 msgr2=0x7f6b4c19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:11.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b51dab640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4c108a90 0x7f6b4c19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b51dab640 1 -- 172.21.15.53:0/2136011741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c1a0140 con 0x7f6b4c102800 2024-08-31T06:16:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b525ac640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4c108a90 0x7f6b4c19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b51dab640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b4c102800 0x7f6b4c19a1d0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c006010 tx=0x7f6b3c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b4affd640 1 -- 172.21.15.53:0/2136011741 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c004040 con 0x7f6b4c102800 2024-08-31T06:16:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b5400f640 1 -- 172.21.15.53:0/2136011741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c1a03d0 con 0x7f6b4c102800 2024-08-31T06:16:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b4affd640 1 -- 172.21.15.53:0/2136011741 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b3c004670 con 0x7f6b4c102800 2024-08-31T06:16:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b5400f640 1 -- 172.21.15.53:0/2136011741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c1a6b90 con 0x7f6b4c102800 2024-08-31T06:16:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.412+0000 7f6b4affd640 1 -- 172.21.15.53:0/2136011741 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c030ce0 con 0x7f6b4c102800 2024-08-31T06:16:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b5a584740 1 Processor -- start 2024-08-31T06:16:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b5a584740 1 -- start start 2024-08-31T06:16:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b4affd640 1 -- 172.21.15.53:0/2136011741 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6b3c0305c0 con 0x7f6b4c102800 2024-08-31T06:16:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d9f520 0x55eb13144c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb131451c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d7e840 0x55eb13145700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b5a584740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eb130bba70 con 0x55eb12d76660 2024-08-31T06:16:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b5a584740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55eb130ab000 con 0x55eb12d9f520 2024-08-31T06:16:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b5a584740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55eb130aefb0 con 0x55eb12d7e840 2024-08-31T06:16:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b51dab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb131451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b51dab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb131451c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34362/0 (socket says 172.21.15.53:34362) 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b51dab640 1 -- 172.21.15.53:0/2689590745 learned_addr learned my addr 172.21.15.53:0/2689590745 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b515aa640 1 --2- 172.21.15.53:0/2689590745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d7e840 0x55eb13145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.415+0000 7f6b525ac640 1 --2- 172.21.15.53:0/2689590745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d9f520 0x55eb13144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b51dab640 1 -- 172.21.15.53:0/2689590745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d7e840 msgr2=0x55eb13145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b51dab640 1 --2- 172.21.15.53:0/2689590745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d7e840 0x55eb13145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b51dab640 1 -- 172.21.15.53:0/2689590745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d9f520 msgr2=0x55eb13144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b51dab640 1 --2- 172.21.15.53:0/2689590745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d9f520 0x55eb13144c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b51dab640 1 -- 172.21.15.53:0/2689590745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb12e0ab00 con 0x55eb12d76660 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b4affd640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b340b4ca0 0x7f6b340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b525ac640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b340b4ca0 0x7f6b340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b51dab640 1 --2- 172.21.15.53:0/2689590745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb131451c0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c104130 tx=0x7f6b3c10ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd55f0e2355be40 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b4affd640 1 -- 172.21.15.53:0/2136011741 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f6b3c106ac0 con 0x7f6b4c102800 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b33fff640 1 -- 172.21.15.53:0/2689590745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0c9020 con 0x55eb12d76660 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b33fff640 1 -- 172.21.15.53:0/2689590745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b3c036030 con 0x55eb12d76660 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.416+0000 7f6b33fff640 1 -- 172.21.15.53:0/2689590745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0cc8d0 con 0x55eb12d76660 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.417+0000 7f6b5a584740 1 -- 172.21.15.53:0/2689590745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 msgr2=0x55eb131451c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.417+0000 7f6b525ac640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b340b4ca0 0x7f6b340b71b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400bad0 tx=0x7f6b44008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.417+0000 7f6b5a584740 1 --2- 172.21.15.53:0/2689590745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb131451c0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c104130 tx=0x7f6b3c10ac00 comp rx=0 tx=0).stop 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.417+0000 7f6b5a584740 1 -- 172.21.15.53:0/2689590745 shutdown_connections 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.417+0000 7f6b5a584740 1 --2- 172.21.15.53:0/2689590745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d7e840 0x55eb13145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.417+0000 7f6b5a584740 1 --2- 172.21.15.53:0/2689590745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb131451c0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.417+0000 7f6b5a584740 1 --2- 172.21.15.53:0/2689590745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d9f520 0x55eb13144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.417+0000 7f6b5a584740 1 -- 172.21.15.53:0/2689590745 >> 172.21.15.53:0/2689590745 conn(0x55eb12d93910 msgr2=0x55eb13142b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.418+0000 7f6b5a584740 1 -- 172.21.15.53:0/2689590745 shutdown_connections 2024-08-31T06:16:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.418+0000 7f6b5a584740 1 -- 172.21.15.53:0/2689590745 wait complete. 2024-08-31T06:16:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.418+0000 7f6b5a584740 1 -- start start 2024-08-31T06:16:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.418+0000 7f6b5a584740 1 Processor -- start 2024-08-31T06:16:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.418+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb13154b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.418+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d7e840 0x55eb131550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.418+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb131608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.418+0000 7f6b5a584740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eb130bba70 con 0x55eb12d76660 2024-08-31T06:16:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.418+0000 7f6b5a584740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55eb1306c520 con 0x55eb12d7e840 2024-08-31T06:16:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.418+0000 7f6b5a584740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55eb13157580 con 0x55eb12d9f520 2024-08-31T06:16:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b5a584740 10 client.0 _ll_register_callbacks cb 0x55eb130a4c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b51dab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb13154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b51dab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb13154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34372/0 (socket says 172.21.15.53:34372) 2024-08-31T06:16:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b51dab640 1 -- 172.21.15.53:0/866857279 learned_addr learned my addr 172.21.15.53:0/866857279 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b525ac640 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb131608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b515aa640 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d7e840 0x55eb131550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b51dab640 1 -- 172.21.15.53:0/866857279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 msgr2=0x55eb131608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b51dab640 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb131608b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b51dab640 1 -- 172.21.15.53:0/866857279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d7e840 msgr2=0x55eb131550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b51dab640 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d7e840 0x55eb131550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b51dab640 1 -- 172.21.15.53:0/866857279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb12e81960 con 0x55eb12d76660 2024-08-31T06:16:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b51dab640 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb13154b90 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c108040 tx=0x7f6b3c1046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489d2d6cebaf3997 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b317fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b317fa640 1 -- 172.21.15.53:0/866857279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0ccab0 con 0x55eb12d76660 2024-08-31T06:16:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b317fa640 1 -- 172.21.15.53:0/866857279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f6b3c0cd5d0 con 0x55eb12d76660 2024-08-31T06:16:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.419+0000 7f6b5a584740 1 -- 172.21.15.53:0/866857279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eb1304a9a0 con 0x55eb12d76660 2024-08-31T06:16:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b317fa640 1 -- 172.21.15.53:0/866857279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f6b3c0ccf30 con 0x55eb12d76660 2024-08-31T06:16:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b5a584740 10 client.19179 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b5a584740 1 -- 172.21.15.53:0/866857279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55eb131634e0 con 0x55eb12d76660 2024-08-31T06:16:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b317fa640 1 -- 172.21.15.53:0/866857279 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55eb1304a9a0 con 0x55eb12d76660 2024-08-31T06:16:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b317fa640 1 -- 172.21.15.53:0/866857279 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7f6b3c0d5ff0 con 0x55eb12d76660 2024-08-31T06:16:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b5a584740 10 client.19179 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b5a584740 10 client.19179 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:16:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b5a584740 20 client.19179 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b5a584740 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb12d5dea0 0x55eb13166940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b5a584740 4 client.19179 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b5a584740 1 -- 172.21.15.53:0/866857279 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb130bd9c0 con 0x55eb12d5dea0 2024-08-31T06:16:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.420+0000 7f6b515aa640 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb12d5dea0 0x55eb13166940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.421+0000 7f6b515aa640 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb12d5dea0 0x55eb13166940 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4f1d6058e707b7a server_cookie=c9d2486d71dc57a9 in_seq=0 out_seq=0 2024-08-31T06:16:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.421+0000 7f6b317fa640 10 client.19179 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b317fa640 1 -- 172.21.15.53:0/866857279 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb130bd9c0 con 0x55eb12d5dea0 2024-08-31T06:16:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b317fa640 10 client.19179 handle_command_reply: tid=0 2024-08-31T06:16:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 1 client.19179 shutdown 2024-08-31T06:16:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 1 -- 172.21.15.53:0/866857279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 msgr2=0x55eb13154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb13154b90 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c108040 tx=0x7f6b3c1046f0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 1 -- 172.21.15.53:0/866857279 shutdown_connections 2024-08-31T06:16:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb12d5dea0 0x55eb13166940 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb131608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d7e840 0x55eb131550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b317fa640 0 client.19179 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 1 --2- 172.21.15.53:0/866857279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d76660 0x55eb13154b90 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 1 -- 172.21.15.53:0/866857279 >> 172.21.15.53:0/866857279 conn(0x55eb12d93910 msgr2=0x55eb13141150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 1 -- 172.21.15.53:0/866857279 shutdown_connections 2024-08-31T06:16:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 1 -- 172.21.15.53:0/866857279 wait complete. 2024-08-31T06:16:11.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.422+0000 7f6b5a584740 20 client.19179 trim_cache size 0 max 16384 2024-08-31T06:16:11.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.439+0000 7f6b5a584740 1 Processor -- start 2024-08-31T06:16:11.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.439+0000 7f6b5a584740 1 -- start start 2024-08-31T06:16:11.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d76660 0x55eb131425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb13151b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb131520c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b5a584740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3800e900 con 0x55eb12d7e840 2024-08-31T06:16:11.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b5a584740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6b380105c0 con 0x55eb12d76660 2024-08-31T06:16:11.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b5a584740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3800efd0 con 0x55eb12d9f520 2024-08-31T06:16:11.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b515aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb13151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b515aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb13151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34380/0 (socket says 172.21.15.53:34380) 2024-08-31T06:16:11.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b515aa640 1 -- 172.21.15.53:0/354674758 learned_addr learned my addr 172.21.15.53:0/354674758 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:11.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b525ac640 1 --2- 172.21.15.53:0/354674758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb131520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b51dab640 1 --2- 172.21.15.53:0/354674758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d76660 0x55eb131425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b515aa640 1 -- 172.21.15.53:0/354674758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 msgr2=0x55eb131520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:11.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b515aa640 1 --2- 172.21.15.53:0/354674758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb131520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b515aa640 1 -- 172.21.15.53:0/354674758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d76660 msgr2=0x55eb131425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:11.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b515aa640 1 --2- 172.21.15.53:0/354674758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d76660 0x55eb131425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b515aa640 1 -- 172.21.15.53:0/354674758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb13145a70 con 0x55eb12d7e840 2024-08-31T06:16:11.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b51dab640 1 --2- 172.21.15.53:0/354674758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d76660 0x55eb131425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:11.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.440+0000 7f6b515aa640 1 --2- 172.21.15.53:0/354674758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb13151b80 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009bb0 tx=0x7f6b40009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb189b63aca4ea9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:11.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.441+0000 7f6b337fe640 1 -- 172.21.15.53:0/354674758 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40015a70 con 0x55eb12d7e840 2024-08-31T06:16:11.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.441+0000 7f6b337fe640 1 -- 172.21.15.53:0/354674758 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b40023070 con 0x55eb12d7e840 2024-08-31T06:16:11.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.441+0000 7f6b337fe640 1 -- 172.21.15.53:0/354674758 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40014410 con 0x55eb12d7e840 2024-08-31T06:16:11.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.441+0000 7f6b5a584740 1 -- 172.21.15.53:0/354674758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 msgr2=0x55eb13151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:11.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.441+0000 7f6b5a584740 1 --2- 172.21.15.53:0/354674758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb13151b80 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009bb0 tx=0x7f6b40009110 comp rx=0 tx=0).stop 2024-08-31T06:16:11.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.441+0000 7f6b5a584740 1 -- 172.21.15.53:0/354674758 shutdown_connections 2024-08-31T06:16:11.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.441+0000 7f6b5a584740 1 --2- 172.21.15.53:0/354674758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb131520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.441+0000 7f6b5a584740 1 --2- 172.21.15.53:0/354674758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb13151b80 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.441+0000 7f6b5a584740 1 --2- 172.21.15.53:0/354674758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d76660 0x55eb131425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.441+0000 7f6b5a584740 1 -- 172.21.15.53:0/354674758 >> 172.21.15.53:0/354674758 conn(0x55eb12d93910 msgr2=0x55eb13141ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:11.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.442+0000 7f6b5a584740 1 -- 172.21.15.53:0/354674758 shutdown_connections 2024-08-31T06:16:11.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.442+0000 7f6b5a584740 1 -- 172.21.15.53:0/354674758 wait complete. 2024-08-31T06:16:11.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.442+0000 7f6b5a584740 1 -- start start 2024-08-31T06:16:11.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.442+0000 7f6b5a584740 1 Processor -- start 2024-08-31T06:16:11.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.442+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d76660 0x55eb1315cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb1315d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b5a584740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb13157930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b5a584740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3800fe30 con 0x55eb12d7e840 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b5a584740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3800f6d0 con 0x55eb12d76660 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b5a584740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3800c900 con 0x55eb12d9f520 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b5a584740 10 client.0 _ll_register_callbacks cb 0x7f6b4400b1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b515aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb1315d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b525ac640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb13157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b515aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb1315d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34390/0 (socket says 172.21.15.53:34390) 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b515aa640 1 -- 172.21.15.53:0/1442716647 learned_addr learned my addr 172.21.15.53:0/1442716647 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b51dab640 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d76660 0x55eb1315cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b525ac640 1 -- 172.21.15.53:0/1442716647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d76660 msgr2=0x55eb1315cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b525ac640 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d76660 0x55eb1315cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b525ac640 1 -- 172.21.15.53:0/1442716647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 msgr2=0x55eb1315d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:11.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b525ac640 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb1315d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b525ac640 1 -- 172.21.15.53:0/1442716647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb131580a0 con 0x55eb12d9f520 2024-08-31T06:16:11.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b515aa640 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb1315d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:11.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b525ac640 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb13157930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6b44011010 tx=0x7f6b440047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43d92ef8bfd20986 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:11.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.443+0000 7f6b317fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:16:11.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b317fa640 1 -- 172.21.15.53:0/1442716647 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44028070 con 0x55eb12d9f520 2024-08-31T06:16:11.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b5a584740 1 -- 172.21.15.53:0/1442716647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b40023070 con 0x55eb12d9f520 2024-08-31T06:16:11.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b317fa640 1 -- 172.21.15.53:0/1442716647 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f6b440149b0 con 0x55eb12d9f520 2024-08-31T06:16:11.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b317fa640 1 -- 172.21.15.53:0/1442716647 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f6b44034050 con 0x55eb12d9f520 2024-08-31T06:16:11.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b5a584740 10 client.28282 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:11.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b5a584740 1 -- 172.21.15.53:0/1442716647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55eb131d1ee0 con 0x55eb12d9f520 2024-08-31T06:16:11.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b317fa640 1 -- 172.21.15.53:0/1442716647 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b40023070 con 0x55eb12d9f520 2024-08-31T06:16:11.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b317fa640 1 -- 172.21.15.53:0/1442716647 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7f6b44022040 con 0x55eb12d9f520 2024-08-31T06:16:11.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b5a584740 10 client.28282 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:11.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b5a584740 10 client.28282 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:16:11.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b5a584740 20 client.28282 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:11.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.444+0000 7f6b5a584740 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb12d33250 0x55eb131d4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:11.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.445+0000 7f6b5a584740 4 client.28282 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "be9c6f0c", "release": true, "await": true}] 2024-08-31T06:16:11.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.445+0000 7f6b5a584740 1 -- 172.21.15.53:0/1442716647 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "be9c6f0c", "release": true, "await": true}) -- 0x55eb130b9460 con 0x55eb12d33250 2024-08-31T06:16:11.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.445+0000 7f6b51dab640 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb12d33250 0x55eb131d4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:11.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.445+0000 7f6b317fa640 10 client.28282 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:11.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.445+0000 7f6b51dab640 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb12d33250 0x55eb131d4770 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57fc4a2108ddb163 server_cookie=9057c26da1de9bc1 in_seq=0 out_seq=0 2024-08-31T06:16:11.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b317fa640 1 -- 172.21.15.53:0/1442716647 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55eb130b9460 con 0x55eb12d33250 2024-08-31T06:16:11.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b317fa640 10 client.28282 handle_command_reply: tid=0 2024-08-31T06:16:11.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b5a584740 1 client.28282 shutdown 2024-08-31T06:16:11.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b5a584740 1 -- 172.21.15.53:0/1442716647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 msgr2=0x55eb13157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:11.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b5a584740 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb13157930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6b44011010 tx=0x7f6b440047d0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b5a584740 1 -- 172.21.15.53:0/1442716647 shutdown_connections 2024-08-31T06:16:11.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b5a584740 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eb12d33250 0x55eb131d4770 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b5a584740 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb12d9f520 0x55eb13157930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b5a584740 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb12d7e840 0x55eb1315d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b317fa640 0 client.28282 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:11.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b5a584740 1 --2- 172.21.15.53:0/1442716647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb12d76660 0x55eb1315cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.451+0000 7f6b5a584740 1 -- 172.21.15.53:0/1442716647 >> 172.21.15.53:0/1442716647 conn(0x55eb12d93910 msgr2=0x55eb1314a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:11.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5a584740 1 -- 172.21.15.53:0/1442716647 shutdown_connections 2024-08-31T06:16:11.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5a584740 1 -- 172.21.15.53:0/1442716647 wait complete. 2024-08-31T06:16:11.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5a584740 20 client.28282 trim_cache size 0 max 16384 2024-08-31T06:16:11.456 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:16:11.456 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 50, 2024-08-31T06:16:11.456 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:16:11.456 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 40, 2024-08-31T06:16:11.456 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:16:11.456 INFO:teuthology.orchestra.run.smithi053.stdout: "be9c6f0c": { 2024-08-31T06:16:11.456 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 40, 2024-08-31T06:16:11.456 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:16:11.456 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:16:11.456 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 145.2, 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:11.457 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:11.458 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:11.458 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:11.458 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:11.458 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:16:11.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 -- 172.21.15.53:0/2136011741 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b340b4ca0 msgr2=0x7f6b340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:11.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b340b4ca0 0x7f6b340b71b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400bad0 tx=0x7f6b44008040 comp rx=0 tx=0).stop 2024-08-31T06:16:11.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 -- 172.21.15.53:0/2136011741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b4c102800 msgr2=0x7f6b4c19a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:11.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b4c102800 0x7f6b4c19a1d0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c006010 tx=0x7f6b3c032bc0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 -- 172.21.15.53:0/2136011741 shutdown_connections 2024-08-31T06:16:11.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6b340b4ca0 0x7f6b340b71b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4c108a90 0x7f6b4c19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b4c108140 0x7f6b4c19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 --2- 172.21.15.53:0/2136011741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b4c102800 0x7f6b4c19a1d0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:11.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 -- 172.21.15.53:0/2136011741 >> 172.21.15.53:0/2136011741 conn(0x7f6b4c0794d0 msgr2=0x7f6b4c101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:11.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 -- 172.21.15.53:0/2136011741 shutdown_connections 2024-08-31T06:16:11.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:11.452+0000 7f6b5400f640 1 -- 172.21.15.53:0/2136011741 wait complete. 2024-08-31T06:16:11.877 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:16:11.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:16:11.996 INFO:tasks.workunit.client.0.smithi053.stdout: 1 173238 1.35 MB/sec execute 481 sec latency 26112.927 ms 2024-08-31T06:16:12.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:11 smithi130 ceph-mon[22266]: pgmap v671: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 59 KiB/s wr, 31 op/s 2024-08-31T06:16:12.145 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:11 smithi053 ceph-mon[18924]: pgmap v671: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 59 KiB/s wr, 31 op/s 2024-08-31T06:16:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:11 smithi153 ceph-mon[22320]: pgmap v671: 97 pgs: 97 active+clean; 95 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 59 KiB/s wr, 31 op/s 2024-08-31T06:16:12.177 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'be9c6f0c', total seconds elapsed: 29.7 2024-08-31T06:16:12.236 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.744+0000 7f711f7fc640 1 -- 172.21.15.53:0/2371583590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7118104620 msgr2=0x7f7118104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.744+0000 7f711f7fc640 1 --2- 172.21.15.53:0/2371583590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7118104620 0x7f7118104a30 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f7114009900 tx=0x7f711402a410 comp rx=0 tx=0).stop 2024-08-31T06:16:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.744+0000 7f711f7fc640 1 -- 172.21.15.53:0/2371583590 shutdown_connections 2024-08-31T06:16:12.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.744+0000 7f711f7fc640 1 --2- 172.21.15.53:0/2371583590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f711810dbd0 0x7f71181100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.744+0000 7f711f7fc640 1 --2- 172.21.15.53:0/2371583590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7118105050 0x7f711810d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.744+0000 7f711f7fc640 1 --2- 172.21.15.53:0/2371583590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7118104620 0x7f7118104a30 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.745+0000 7f711f7fc640 1 -- 172.21.15.53:0/2371583590 >> 172.21.15.53:0/2371583590 conn(0x7f71180794d0 msgr2=0x7f71180798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.745+0000 7f711f7fc640 1 -- 172.21.15.53:0/2371583590 shutdown_connections 2024-08-31T06:16:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.745+0000 7f711f7fc640 1 -- 172.21.15.53:0/2371583590 wait complete. 2024-08-31T06:16:12.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711f7fc640 1 Processor -- start 2024-08-31T06:16:12.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711f7fc640 1 -- start start 2024-08-31T06:16:12.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711f7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7118105050 0x7f7118102530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711f7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f711810dbd0 0x7f7118102a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711f7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7118102fb0 0x7f71181a8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711f7fc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f71181136a0 con 0x7f711810dbd0 2024-08-31T06:16:12.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711f7fc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7118113520 con 0x7f7118105050 2024-08-31T06:16:12.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711f7fc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7118113820 con 0x7f7118102fb0 2024-08-31T06:16:12.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711cd97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f711810dbd0 0x7f7118102a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711cd97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f711810dbd0 0x7f7118102a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34414/0 (socket says 172.21.15.53:34414) 2024-08-31T06:16:12.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711cd97640 1 -- 172.21.15.53:0/120106770 learned_addr learned my addr 172.21.15.53:0/120106770 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711d598640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7118105050 0x7f7118102530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711dd99640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7118102fb0 0x7f71181a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711cd97640 1 -- 172.21.15.53:0/120106770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7118102fb0 msgr2=0x7f71181a8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711cd97640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7118102fb0 0x7f71181a8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711cd97640 1 -- 172.21.15.53:0/120106770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7118105050 msgr2=0x7f7118102530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.746+0000 7f711cd97640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7118105050 0x7f7118102530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.747+0000 7f711cd97640 1 -- 172.21.15.53:0/120106770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71181a89f0 con 0x7f711810dbd0 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.747+0000 7f711dd99640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7118102fb0 0x7f71181a8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.747+0000 7f711d598640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7118105050 0x7f7118102530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.747+0000 7f711cd97640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f711810dbd0 0x7f7118102a70 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f710800e9c0 tx=0x7f710800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.747+0000 7f710e7fc640 1 -- 172.21.15.53:0/120106770 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710800cd80 con 0x7f711810dbd0 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.747+0000 7f710e7fc640 1 -- 172.21.15.53:0/120106770 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71080054b0 con 0x7f711810dbd0 2024-08-31T06:16:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.747+0000 7f711f7fc640 1 -- 172.21.15.53:0/120106770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71181a8ce0 con 0x7f711810dbd0 2024-08-31T06:16:12.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.747+0000 7f710e7fc640 1 -- 172.21.15.53:0/120106770 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108010430 con 0x7f711810dbd0 2024-08-31T06:16:12.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.747+0000 7f711f7fc640 1 -- 172.21.15.53:0/120106770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71181a91a0 con 0x7f711810dbd0 2024-08-31T06:16:12.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.750+0000 7f710e7fc640 1 -- 172.21.15.53:0/120106770 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7108004f10 con 0x7f711810dbd0 2024-08-31T06:16:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.751+0000 7f7125d71740 1 Processor -- start 2024-08-31T06:16:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.751+0000 7f710e7fc640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71040b4ca0 0x7f71040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.751+0000 7f7125d71740 1 -- start start 2024-08-31T06:16:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.751+0000 7f711dd99640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71040b4ca0 0x7f71040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.751+0000 7f7125d71740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628791a3350 0x562879549780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.751+0000 7f710e7fc640 1 -- 172.21.15.53:0/120106770 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f71080e5af0 con 0x7f711810dbd0 2024-08-31T06:16:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.751+0000 7f7125d71740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56287917a490 0x562879549cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.751+0000 7f7125d71740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879182670 0x56287954a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.751+0000 7f7125d71740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5628794bf5f0 con 0x5628791a3350 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.751+0000 7f7125d71740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5628794aeb80 con 0x562879182670 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.751+0000 7f7125d71740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5628794b2b30 con 0x56287917a490 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711d598640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628791a3350 0x562879549780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711dd99640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879182670 0x56287954a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711d598640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628791a3350 0x562879549780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34428/0 (socket says 172.21.15.53:34428) 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711d598640 1 -- 172.21.15.53:0/1120132969 learned_addr learned my addr 172.21.15.53:0/1120132969 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711dd99640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71040b4ca0 0x7f71040b71b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7110005fd0 tx=0x7f7110011b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711cd97640 1 --2- 172.21.15.53:0/1120132969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56287917a490 0x562879549cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711dd99640 1 -- 172.21.15.53:0/1120132969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56287917a490 msgr2=0x562879549cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711dd99640 1 --2- 172.21.15.53:0/1120132969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56287917a490 0x562879549cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711dd99640 1 -- 172.21.15.53:0/1120132969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628791a3350 msgr2=0x562879549780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711dd99640 1 --2- 172.21.15.53:0/1120132969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628791a3350 0x562879549780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711dd99640 1 -- 172.21.15.53:0/1120132969 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56287920e930 con 0x562879182670 2024-08-31T06:16:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.752+0000 7f711dd99640 1 --2- 172.21.15.53:0/1120132969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879182670 0x56287954a200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f711000f790 tx=0x7f711001c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb0d904c22c5fabd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.753+0000 7f71037fe640 1 -- 172.21.15.53:0/1120132969 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7110017040 con 0x562879182670 2024-08-31T06:16:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.753+0000 7f71037fe640 1 -- 172.21.15.53:0/1120132969 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7110022070 con 0x562879182670 2024-08-31T06:16:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.753+0000 7f71037fe640 1 -- 172.21.15.53:0/1120132969 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711001eae0 con 0x562879182670 2024-08-31T06:16:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.753+0000 7f7125d71740 1 -- 172.21.15.53:0/1120132969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879182670 msgr2=0x56287954a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.754+0000 7f7125d71740 1 --2- 172.21.15.53:0/1120132969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879182670 0x56287954a200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f711000f790 tx=0x7f711001c000 comp rx=0 tx=0).stop 2024-08-31T06:16:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.754+0000 7f7125d71740 1 -- 172.21.15.53:0/1120132969 shutdown_connections 2024-08-31T06:16:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.754+0000 7f7125d71740 1 --2- 172.21.15.53:0/1120132969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879182670 0x56287954a200 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.754+0000 7f7125d71740 1 --2- 172.21.15.53:0/1120132969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56287917a490 0x562879549cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.754+0000 7f7125d71740 1 --2- 172.21.15.53:0/1120132969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5628791a3350 0x562879549780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.754+0000 7f7125d71740 1 -- 172.21.15.53:0/1120132969 >> 172.21.15.53:0/1120132969 conn(0x562879197740 msgr2=0x562879547670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.754+0000 7f7125d71740 1 -- 172.21.15.53:0/1120132969 shutdown_connections 2024-08-31T06:16:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.754+0000 7f7125d71740 1 -- 172.21.15.53:0/1120132969 wait complete. 2024-08-31T06:16:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.754+0000 7f7125d71740 1 -- start start 2024-08-31T06:16:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.754+0000 7f7125d71740 1 Processor -- start 2024-08-31T06:16:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f7125d71740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56287917a490 0x562879555200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f7125d71740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562879182670 0x562879555740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f7125d71740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628791a3350 0x562879561250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f7125d71740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562879311890 con 0x562879182670 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f7125d71740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562879435790 con 0x56287917a490 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f7125d71740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562879557f60 con 0x5628791a3350 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f7125d71740 10 client.0 _ll_register_callbacks cb 0x5628791baba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711cd97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562879182670 0x562879555740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711cd97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562879182670 0x562879555740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34436/0 (socket says 172.21.15.53:34436) 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711d598640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56287917a490 0x562879555200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711cd97640 1 -- 172.21.15.53:0/3073722383 learned_addr learned my addr 172.21.15.53:0/3073722383 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711dd99640 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628791a3350 0x562879561250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711d598640 1 -- 172.21.15.53:0/3073722383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628791a3350 msgr2=0x562879561250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711d598640 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628791a3350 0x562879561250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711d598640 1 -- 172.21.15.53:0/3073722383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562879182670 msgr2=0x562879555740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711d598640 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562879182670 0x562879555740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711d598640 1 -- 172.21.15.53:0/3073722383 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56287946cf30 con 0x56287917a490 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711cd97640 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562879182670 0x562879555740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f711d598640 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56287917a490 0x562879555200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7114005760 tx=0x7f7114031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a822feae827c9d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.755+0000 7f7100ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7100ff9640 1 -- 172.21.15.53:0/3073722383 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7114035040 con 0x56287917a490 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7100ff9640 1 -- 172.21.15.53:0/3073722383 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f7114004250 con 0x56287917a490 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7125d71740 1 -- 172.21.15.53:0/3073722383 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7110022070 con 0x56287917a490 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7100ff9640 1 -- 172.21.15.53:0/3073722383 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7114004450 con 0x56287917a490 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7125d71740 10 client.28304 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7125d71740 1 -- 172.21.15.53:0/3073722383 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x562879563e30 con 0x56287917a490 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7100ff9640 1 -- 172.21.15.53:0/3073722383 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7110022070 con 0x56287917a490 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7100ff9640 1 -- 172.21.15.53:0/3073722383 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7f7114048530 con 0x56287917a490 2024-08-31T06:16:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7125d71740 10 client.28304 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7125d71740 10 client.28304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7125d71740 20 client.28304 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7125d71740 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562879161cd0 0x562879567420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7125d71740 4 client.28304 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.756+0000 7f7125d71740 1 -- 172.21.15.53:0/3073722383 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628794c1540 con 0x562879161cd0 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.757+0000 7f711cd97640 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562879161cd0 0x562879567420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.757+0000 7f7100ff9640 10 client.28304 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.757+0000 7f711cd97640 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562879161cd0 0x562879567420 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00bb82582a1c0d2 server_cookie=dcdfaffa4fb980f6 in_seq=0 out_seq=0 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7100ff9640 1 -- 172.21.15.53:0/3073722383 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5628794c1540 con 0x562879161cd0 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7100ff9640 10 client.28304 handle_command_reply: tid=0 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 1 client.28304 shutdown 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 1 -- 172.21.15.53:0/3073722383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56287917a490 msgr2=0x562879555200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:12.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56287917a490 0x562879555200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7114005760 tx=0x7f7114031630 comp rx=0 tx=0).stop 2024-08-31T06:16:12.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 1 -- 172.21.15.53:0/3073722383 shutdown_connections 2024-08-31T06:16:12.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562879161cd0 0x562879567420 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628791a3350 0x562879561250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562879182670 0x562879555740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7100ff9640 0 client.28304 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:12.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 1 --2- 172.21.15.53:0/3073722383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56287917a490 0x562879555200 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 1 -- 172.21.15.53:0/3073722383 >> 172.21.15.53:0/3073722383 conn(0x562879197740 msgr2=0x56287954c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:12.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 1 -- 172.21.15.53:0/3073722383 shutdown_connections 2024-08-31T06:16:12.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 1 -- 172.21.15.53:0/3073722383 wait complete. 2024-08-31T06:16:12.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.758+0000 7f7125d71740 20 client.28304 trim_cache size 0 max 16384 2024-08-31T06:16:12.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f7125d71740 1 Processor -- start 2024-08-31T06:16:12.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f7125d71740 1 -- start start 2024-08-31T06:16:12.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f7125d71740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879161cd0 0x5628795476a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f7125d71740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 0x562879561150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f7125d71740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562879182670 0x562879561690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f7125d71740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f71181b1cb0 con 0x56287917a490 2024-08-31T06:16:12.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f7125d71740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71181b3970 con 0x562879161cd0 2024-08-31T06:16:12.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f7125d71740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71181b2380 con 0x562879182670 2024-08-31T06:16:12.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f711cd97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 0x562879561150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f711d598640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879161cd0 0x5628795476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f711cd97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 0x562879561150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34450/0 (socket says 172.21.15.53:34450) 2024-08-31T06:16:12.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f711cd97640 1 -- 172.21.15.53:0/72133289 learned_addr learned my addr 172.21.15.53:0/72133289 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:12.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.778+0000 7f711dd99640 1 --2- 172.21.15.53:0/72133289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562879182670 0x562879561690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.779+0000 7f711d598640 1 -- 172.21.15.53:0/72133289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562879182670 msgr2=0x562879561690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:12.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.779+0000 7f711d598640 1 --2- 172.21.15.53:0/72133289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562879182670 0x562879561690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.779+0000 7f711d598640 1 -- 172.21.15.53:0/72133289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 msgr2=0x562879561150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:12.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.779+0000 7f711d598640 1 --2- 172.21.15.53:0/72133289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 0x562879561150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.779+0000 7f711d598640 1 -- 172.21.15.53:0/72133289 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56287954ba70 con 0x562879161cd0 2024-08-31T06:16:12.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.779+0000 7f711d598640 1 --2- 172.21.15.53:0/72133289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879161cd0 0x5628795476a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7114005940 tx=0x7f7114001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b5b299b6ea5ed58 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:12.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.779+0000 7f7102ffd640 1 -- 172.21.15.53:0/72133289 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7114035070 con 0x562879161cd0 2024-08-31T06:16:12.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.779+0000 7f7102ffd640 1 -- 172.21.15.53:0/72133289 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71140054b0 con 0x562879161cd0 2024-08-31T06:16:12.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.779+0000 7f7102ffd640 1 -- 172.21.15.53:0/72133289 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71140319f0 con 0x562879161cd0 2024-08-31T06:16:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.780+0000 7f7125d71740 1 -- 172.21.15.53:0/72133289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879161cd0 msgr2=0x5628795476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.780+0000 7f7125d71740 1 --2- 172.21.15.53:0/72133289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879161cd0 0x5628795476a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7114005940 tx=0x7f7114001e50 comp rx=0 tx=0).stop 2024-08-31T06:16:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.780+0000 7f7125d71740 1 -- 172.21.15.53:0/72133289 shutdown_connections 2024-08-31T06:16:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.780+0000 7f7125d71740 1 --2- 172.21.15.53:0/72133289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562879182670 0x562879561690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.780+0000 7f7125d71740 1 --2- 172.21.15.53:0/72133289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 0x562879561150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.780+0000 7f7125d71740 1 --2- 172.21.15.53:0/72133289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879161cd0 0x5628795476a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.780+0000 7f7125d71740 1 -- 172.21.15.53:0/72133289 >> 172.21.15.53:0/72133289 conn(0x562879197740 msgr2=0x562879546f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.780+0000 7f7125d71740 1 -- 172.21.15.53:0/72133289 shutdown_connections 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.780+0000 7f7125d71740 1 -- 172.21.15.53:0/72133289 wait complete. 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f7125d71740 1 -- start start 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f7125d71740 1 Processor -- start 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f7125d71740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562879161cd0 0x562879559c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f7125d71740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 0x56287955a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f7125d71740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879182670 0x5628795cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f7125d71740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f71181b31e0 con 0x56287917a490 2024-08-31T06:16:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f7125d71740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71181b2a80 con 0x562879182670 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f7125d71740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71181afcb0 con 0x562879161cd0 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f7125d71740 10 client.0 _ll_register_callbacks cb 0x7f7114009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f711cd97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 0x56287955a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f711cd97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 0x56287955a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34466/0 (socket says 172.21.15.53:34466) 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.781+0000 7f711cd97640 1 -- 172.21.15.53:0/1164366738 learned_addr learned my addr 172.21.15.53:0/1164366738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f711dd99640 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879182670 0x5628795cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f711d598640 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562879161cd0 0x562879559c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f711cd97640 1 -- 172.21.15.53:0/1164366738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562879161cd0 msgr2=0x562879559c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f711cd97640 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562879161cd0 0x562879559c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f711cd97640 1 -- 172.21.15.53:0/1164366738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879182670 msgr2=0x5628795cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f711cd97640 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879182670 0x5628795cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f711cd97640 1 -- 172.21.15.53:0/1164366738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628795cb500 con 0x56287917a490 2024-08-31T06:16:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f711cd97640 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 0x56287955a1e0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f71080e37f0 tx=0x7f71080ac080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1bf8acb0593727 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f7100ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f7100ff9640 1 -- 172.21.15.53:0/1164366738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71080ac190 con 0x56287917a490 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f7100ff9640 1 -- 172.21.15.53:0/1164366738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7f71080ab3f0 con 0x56287917a490 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f7125d71740 1 -- 172.21.15.53:0/1164366738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71140054b0 con 0x56287917a490 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.782+0000 7f7100ff9640 1 -- 172.21.15.53:0/1164366738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f71080b0a00 con 0x56287917a490 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.783+0000 7f7125d71740 10 client.19203 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.783+0000 7f7125d71740 1 -- 172.21.15.53:0/1164366738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5628795d2910 con 0x56287917a490 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.783+0000 7f7100ff9640 1 -- 172.21.15.53:0/1164366738 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71140054b0 con 0x56287917a490 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.783+0000 7f7100ff9640 1 -- 172.21.15.53:0/1164366738 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7f71080ab060 con 0x56287917a490 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.783+0000 7f7125d71740 10 client.19203 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.783+0000 7f7125d71740 10 client.19203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.783+0000 7f7125d71740 20 client.19203 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.783+0000 7f7125d71740 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5628791a3350 0x5628795d5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.783+0000 7f7125d71740 4 client.19203 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:16:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.783+0000 7f7125d71740 1 -- 172.21.15.53:0/1164366738 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5628794bcfe0 con 0x5628791a3350 2024-08-31T06:16:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.783+0000 7f711d598640 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5628791a3350 0x5628795d5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.784+0000 7f7100ff9640 10 client.19203 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.784+0000 7f711d598640 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5628791a3350 0x5628795d5150 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28c319ce9e9ace4d server_cookie=4a650fa2b837ff61 in_seq=0 out_seq=0 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.785+0000 7f7100ff9640 1 -- 172.21.15.53:0/1164366738 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5628794bcfe0 con 0x5628791a3350 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.785+0000 7f7100ff9640 10 client.19203 handle_command_reply: tid=0 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.785+0000 7f7125d71740 1 client.19203 shutdown 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7125d71740 1 -- 172.21.15.53:0/1164366738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 msgr2=0x56287955a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7125d71740 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 0x56287955a1e0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f71080e37f0 tx=0x7f71080ac080 comp rx=0 tx=0).stop 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7125d71740 1 -- 172.21.15.53:0/1164366738 shutdown_connections 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7125d71740 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5628791a3350 0x5628795d5150 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7125d71740 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562879182670 0x5628795cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7125d71740 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56287917a490 0x56287955a1e0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7125d71740 1 --2- 172.21.15.53:0/1164366738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562879161cd0 0x562879559c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7125d71740 1 -- 172.21.15.53:0/1164366738 >> 172.21.15.53:0/1164366738 conn(0x562879197740 msgr2=0x56287954c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:12.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7100ff9640 0 client.19203 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:12.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7125d71740 1 -- 172.21.15.53:0/1164366738 shutdown_connections 2024-08-31T06:16:12.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7125d71740 1 -- 172.21.15.53:0/1164366738 wait complete. 2024-08-31T06:16:12.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f7125d71740 20 client.19203 trim_cache size 0 max 16384 2024-08-31T06:16:12.792 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:16:12.792 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:16:12.792 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "c852752b-53bf-4f84-90ac-1759f148a9bf", 2024-08-31T06:16:12.792 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:16:12.792 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:16:12.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f711f7fc640 1 -- 172.21.15.53:0/120106770 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71040b4ca0 msgr2=0x7f71040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:12.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.786+0000 7f711f7fc640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71040b4ca0 0x7f71040b71b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7110005fd0 tx=0x7f7110011b50 comp rx=0 tx=0).stop 2024-08-31T06:16:12.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.787+0000 7f711f7fc640 1 -- 172.21.15.53:0/120106770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f711810dbd0 msgr2=0x7f7118102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:12.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.787+0000 7f711f7fc640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f711810dbd0 0x7f7118102a70 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f710800e9c0 tx=0x7f710800ee80 comp rx=0 tx=0).stop 2024-08-31T06:16:12.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.787+0000 7f711f7fc640 1 -- 172.21.15.53:0/120106770 shutdown_connections 2024-08-31T06:16:12.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.787+0000 7f711f7fc640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71040b4ca0 0x7f71040b71b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.787+0000 7f711f7fc640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7118102fb0 0x7f71181a8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.787+0000 7f711f7fc640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f711810dbd0 0x7f7118102a70 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.787+0000 7f711f7fc640 1 --2- 172.21.15.53:0/120106770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7118105050 0x7f7118102530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.787+0000 7f711f7fc640 1 -- 172.21.15.53:0/120106770 >> 172.21.15.53:0/120106770 conn(0x7f71180794d0 msgr2=0x7f71180ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.787+0000 7f711f7fc640 1 -- 172.21.15.53:0/120106770 shutdown_connections 2024-08-31T06:16:12.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:12.787+0000 7f711f7fc640 1 -- 172.21.15.53:0/120106770 wait complete. 2024-08-31T06:16:12.996 INFO:tasks.workunit.client.0.smithi053.stdout: 1 173631 1.35 MB/sec execute 482 sec latency 24.682 ms 2024-08-31T06:16:13.128 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:16:12 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:16:12.808+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000208 [...12,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORD/ auth{1=1,2=1,3=1,4=1} v31225 ap=2 f(v1008 m2024-08-31T06:15:42.757655+0000 5=5+0) n(v45 rc2024-08-31T06:15:42.757655+0000 b814326 6=5+1) old_inodes=6 (inest sync->mix g=1,2,3,4) caps={15441=pAsLsXsFs/-@25116} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5613e676b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000208:[<0x10000000009/WORD v1430>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000208:[<0x10000000009/WORD v31225>,<0x10000000008/~dmtmp v23883>,<0x10000000007/client0 v1044>,<0x10000000006/clients v1019>,<0x10000000005/tmp v991>,<0x10000000003/client.0 v984>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v980>,<0x10000000001/sv_0 v967>,<0x10000000000/qa v956>,<0x1/volumes v905>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:15:42.744059+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:15:42.757655+0000 b814326 6=5+1)","memory_value.dirstat":"f(v1008 m2024-08-31T06:15:42.757655+0000 5=5+0)","memory_value.rstat":"n(v45 rc2024-08-31T06:15:42.757655+0000 b814326 6=5+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:16:13.129 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:16:12 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:16:12.810+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000215 [...12,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL/ auth{1=1,2=1,3=1,4=1} fragtree_t(*^3) v31035 ap=2 f(v1032 m2024-08-31T06:15:17.940753+0000 11=11+0) n(v47 rc2024-08-31T06:15:17.940753+0000 b2861056 12=11+1) old_inodes=6 (inest sync->mix g=1,2,3,4) caps={15441=pAsLsXsFs/-@25578} | dirtyscattered=0 request=0 lock=0 importing=0 dirfrag=8 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5613e69a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000215:[<0x10000000009/COREL v1154>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000215:[<0x10000000009/COREL v31035>,<0x10000000008/~dmtmp v23883>,<0x10000000007/client0 v1044>,<0x10000000006/clients v1019>,<0x10000000005/tmp v991>,<0x10000000003/client.0 v984>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v980>,<0x10000000001/sv_0 v967>,<0x10000000000/qa v956>,<0x1/volumes v905>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:15:17.928409+0000 12=12+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:15:17.940753+0000 b2861056 12=11+1)","memory_value.dirstat":"f(v1032 m2024-08-31T06:15:17.940753+0000 11=11+0)","memory_value.rstat":"n(v47 rc2024-08-31T06:15:17.940753+0000 b2861056 12=11+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:16:13.129 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:16:12 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:16:12.827+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000225 [...12,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM/ auth{1=1,2=1,3=1,4=1} v31027 ap=2 f(v3057 m2024-08-31T06:15:18.016703+0000 3=3+0) n(v40 rc2024-08-31T06:15:18.016703+0000 b780288 4=3+1) old_inodes=6 (inest sync->mix g=1,2,3,4) caps={15441=pAsLsXsFs/-@34514} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e69bc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000225:[<0x10000000009/PM v1172>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000225:[<0x10000000009/PM v31027>,<0x10000000008/~dmtmp v23885>,<0x10000000007/client0 v1046>,<0x10000000006/clients v1021>,<0x10000000005/tmp v993>,<0x10000000003/client.0 v986>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v982>,<0x10000000001/sv_0 v969>,<0x10000000000/qa v958>,<0x1/volumes v908>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:15:17.625102+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:15:18.016703+0000 b780288 4=3+1)","memory_value.dirstat":"f(v3057 m2024-08-31T06:15:18.016703+0000 3=3+0)","memory_value.rstat":"n(v40 rc2024-08-31T06:15:18.016703+0000 b780288 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:16:13.129 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:16:12 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:16:12.833+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000229 [...12,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX/ auth{1=1,2=1,3=1,4=1} fragtree_t(*^3) v31229 ap=2 f(v1501 m2024-08-31T06:15:44.602748+0000 24=24+0) n(v47 rc2024-08-31T06:15:44.602748+0000 b5230239 25=24+1) old_inodes=6 (inest sync->mix g=1,2,3,4) caps={15441=pAsLsXsFs/-@29909} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5613e69bdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000229:[<0x10000000009/PARADOX v1182>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000229:[<0x10000000009/PARADOX v31229>,<0x10000000008/~dmtmp v23887>,<0x10000000007/client0 v1046>,<0x10000000006/clients v1021>,<0x10000000005/tmp v993>,<0x10000000003/client.0 v986>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v982>,<0x10000000001/sv_0 v969>,<0x10000000000/qa v958>,<0x1/volumes v908>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:15:44.588044+0000 25=25+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:15:44.602748+0000 b5230239 25=24+1)","memory_value.dirstat":"f(v1501 m2024-08-31T06:15:44.602748+0000 24=24+0)","memory_value.rstat":"n(v47 rc2024-08-31T06:15:44.602748+0000 b5230239 25=24+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:16:13.129 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:16:12 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:16:12.844+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020f [...12,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PWRPNT/ auth{1=1,2=1,3=1,4=1} v31227 ap=2 f(v1176 m2024-08-31T06:15:42.146964+0000 7=7+0) n(v43 rc2024-08-31T06:15:42.146964+0000 b1462582 8=7+1) old_inodes=6 (inest sync->mix g=1,2,3,4) caps={15441=pAsLsXsFs/-@24989} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5613e69a2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000020f:[<0x10000000009/PWRPNT v1372>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x1000000020f:[<0x10000000009/PWRPNT v31227>,<0x10000000008/~dmtmp v23891>,<0x10000000007/client0 v1046>,<0x10000000006/clients v1021>,<0x10000000005/tmp v993>,<0x10000000003/client.0 v986>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v982>,<0x10000000001/sv_0 v969>,<0x10000000000/qa v958>,<0x1/volumes v908>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:15:42.125046+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:15:42.146964+0000 b1462582 8=7+1)","memory_value.dirstat":"f(v1176 m2024-08-31T06:15:42.146964+0000 7=7+0)","memory_value.rstat":"n(v43 rc2024-08-31T06:15:42.146964+0000 b1462582 8=7+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:16:13.567 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:16:13.823 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:13.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: pgmap v672: 97 pgs: 97 active+clean; 95 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 64 KiB/s wr, 31 op/s 2024-08-31T06:16:13.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:16:13.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:13.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:13.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:13.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:13.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:13.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:13.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:13.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORD) see mds.b log and `damage ls` output for details 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2024-08-31T06:16:13.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:13.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PWRPNT) see mds.b log and `damage ls` output for details 2024-08-31T06:16:13.946 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:13 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:13.996 INFO:tasks.workunit.client.0.smithi053.stdout: 1 173891 1.36 MB/sec execute 483 sec latency 589.366 ms 2024-08-31T06:16:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: pgmap v672: 97 pgs: 97 active+clean; 95 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 64 KiB/s wr, 31 op/s 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORD) see mds.b log and `damage ls` output for details 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PWRPNT) see mds.b log and `damage ls` output for details 2024-08-31T06:16:14.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:13 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: pgmap v672: 97 pgs: 97 active+clean; 95 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 64 KiB/s wr, 31 op/s 2024-08-31T06:16:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:16:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/WORD) see mds.b log and `damage ls` output for details 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PWRPNT) see mds.b log and `damage ls` output for details 2024-08-31T06:16:14.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:13 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.326+0000 7fb74ff81640 1 -- 172.21.15.53:0/4157310067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb748109b90 msgr2=0x7fb7481103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.326+0000 7fb74ff81640 1 --2- 172.21.15.53:0/4157310067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb748109b90 0x7fb7481103c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fb740009ca0 tx=0x7fb74002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.326+0000 7fb74ff81640 1 -- 172.21.15.53:0/4157310067 shutdown_connections 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.326+0000 7fb74ff81640 1 --2- 172.21.15.53:0/4157310067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb748109b90 0x7fb7481103c0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.326+0000 7fb74ff81640 1 --2- 172.21.15.53:0/4157310067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb748109240 0x7fb748109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.326+0000 7fb74ff81640 1 --2- 172.21.15.53:0/4157310067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb748103900 0x7fb748103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.326+0000 7fb74ff81640 1 -- 172.21.15.53:0/4157310067 >> 172.21.15.53:0/4157310067 conn(0x7fb74807b5f0 msgr2=0x7fb74807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.326+0000 7fb74ff81640 1 -- 172.21.15.53:0/4157310067 shutdown_connections 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.326+0000 7fb74ff81640 1 -- 172.21.15.53:0/4157310067 wait complete. 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.327+0000 7fb74ff81640 1 Processor -- start 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.327+0000 7fb74ff81640 1 -- start start 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.327+0000 7fb74ff81640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb748103900 0x7fb74819a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.327+0000 7fb74ff81640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb748109240 0x7fb74819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.327+0000 7fb74ff81640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb748109b90 0x7fb74819f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.327+0000 7fb74ff81640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb748113750 con 0x7fb748109240 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.327+0000 7fb74ff81640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481135d0 con 0x7fb748109b90 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.327+0000 7fb74ff81640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481138d0 con 0x7fb748103900 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74d51c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb748109240 0x7fb74819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74d51c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb748109240 0x7fb74819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55926/0 (socket says 172.21.15.53:55926) 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74d51c640 1 -- 172.21.15.53:0/2852999963 learned_addr learned my addr 172.21.15.53:0/2852999963 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74e51e640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb748109b90 0x7fb74819f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74dd1d640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb748103900 0x7fb74819a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74d51c640 1 -- 172.21.15.53:0/2852999963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb748103900 msgr2=0x7fb74819a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74d51c640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb748103900 0x7fb74819a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74d51c640 1 -- 172.21.15.53:0/2852999963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb748109b90 msgr2=0x7fb74819f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74d51c640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb748109b90 0x7fb74819f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74d51c640 1 -- 172.21.15.53:0/2852999963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7481a00b0 con 0x7fb748109240 2024-08-31T06:16:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74e51e640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb748109b90 0x7fb74819f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74d51c640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb748109240 0x7fb74819a6e0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb73800c970 tx=0x7fb73800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb73effd640 1 -- 172.21.15.53:0/2852999963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738007bb0 con 0x7fb748109240 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb73effd640 1 -- 172.21.15.53:0/2852999963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb738007d50 con 0x7fb748109240 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74ff81640 1 -- 172.21.15.53:0/2852999963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7481a03a0 con 0x7fb748109240 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb73effd640 1 -- 172.21.15.53:0/2852999963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738004da0 con 0x7fb748109240 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.328+0000 7fb74ff81640 1 -- 172.21.15.53:0/2852999963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7481a6b00 con 0x7fb748109240 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.331+0000 7fb7564f6740 1 Processor -- start 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.331+0000 7fb73effd640 1 -- 172.21.15.53:0/2852999963 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb738004f60 con 0x7fb748109240 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.331+0000 7fb7564f6740 1 -- start start 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd2d070 0x5653d00d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd041b0 0x5653d00d2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb7564f6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5653d0049630 con 0x5653cfd0c390 2024-08-31T06:16:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb7564f6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5653d0038bc0 con 0x5653cfd2d070 2024-08-31T06:16:14.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb7564f6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5653d003cb70 con 0x5653cfd041b0 2024-08-31T06:16:14.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74d51c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74d51c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55942/0 (socket says 172.21.15.53:55942) 2024-08-31T06:16:14.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74d51c640 1 -- 172.21.15.53:0/3389869029 learned_addr learned my addr 172.21.15.53:0/3389869029 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:14.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74e51e640 1 --2- 172.21.15.53:0/3389869029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd2d070 0x5653d00d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74dd1d640 1 --2- 172.21.15.53:0/3389869029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd041b0 0x5653d00d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb73effd640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb7340b4d20 0x7fb7340b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74d51c640 1 -- 172.21.15.53:0/3389869029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd041b0 msgr2=0x5653d00d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:14.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74d51c640 1 --2- 172.21.15.53:0/3389869029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd041b0 0x5653d00d2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74d51c640 1 -- 172.21.15.53:0/3389869029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd2d070 msgr2=0x5653d00d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:14.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74d51c640 1 --2- 172.21.15.53:0/3389869029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd2d070 0x5653d00d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74d51c640 1 -- 172.21.15.53:0/3389869029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653cfd98650 con 0x5653cfd0c390 2024-08-31T06:16:14.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74dd1d640 1 --2- 172.21.15.53:0/3389869029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd041b0 0x5653d00d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:14.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.332+0000 7fb74e51e640 1 --2- 172.21.15.53:0/3389869029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd2d070 0x5653d00d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:14.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.333+0000 7fb74e51e640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb7340b4d20 0x7fb7340b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.333+0000 7fb73effd640 1 -- 172.21.15.53:0/2852999963 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7fb7380e5180 con 0x7fb748109240 2024-08-31T06:16:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.333+0000 7fb74d51c640 1 --2- 172.21.15.53:0/3389869029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00d2d40 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb7380e27f0 tx=0x7fb73801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2371c79578069e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.333+0000 7fb733fff640 1 -- 172.21.15.53:0/3389869029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7380ab6a0 con 0x5653cfd0c390 2024-08-31T06:16:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.333+0000 7fb733fff640 1 -- 172.21.15.53:0/3389869029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7380046c0 con 0x5653cfd0c390 2024-08-31T06:16:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.333+0000 7fb733fff640 1 -- 172.21.15.53:0/3389869029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7380a7060 con 0x5653cfd0c390 2024-08-31T06:16:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.334+0000 7fb7564f6740 1 -- 172.21.15.53:0/3389869029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 msgr2=0x5653d00d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.334+0000 7fb7564f6740 1 --2- 172.21.15.53:0/3389869029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00d2d40 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb7380e27f0 tx=0x7fb73801f000 comp rx=0 tx=0).stop 2024-08-31T06:16:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.334+0000 7fb74e51e640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb7340b4d20 0x7fb7340b7230 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb740006010 tx=0x7fb7400095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.334+0000 7fb7564f6740 1 -- 172.21.15.53:0/3389869029 shutdown_connections 2024-08-31T06:16:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.334+0000 7fb7564f6740 1 --2- 172.21.15.53:0/3389869029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00d2d40 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.334+0000 7fb7564f6740 1 --2- 172.21.15.53:0/3389869029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd041b0 0x5653d00d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.334+0000 7fb7564f6740 1 --2- 172.21.15.53:0/3389869029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd2d070 0x5653d00d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.334+0000 7fb7564f6740 1 -- 172.21.15.53:0/3389869029 >> 172.21.15.53:0/3389869029 conn(0x5653cfd21460 msgr2=0x5653d00d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.334+0000 7fb7564f6740 1 -- 172.21.15.53:0/3389869029 shutdown_connections 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.334+0000 7fb7564f6740 1 -- 172.21.15.53:0/3389869029 wait complete. 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb7564f6740 1 -- start start 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb7564f6740 1 Processor -- start 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd041b0 0x5653d00dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00ddf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd2d070 0x5653d00e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb7564f6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5653cfe9b700 con 0x5653cfd0c390 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb7564f6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5653cffbf700 con 0x5653cfd041b0 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb7564f6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5653d00e09e0 con 0x5653cfd2d070 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb7564f6740 10 client.0 _ll_register_callbacks cb 0x5653cffeedc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb74d51c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00ddf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb74d51c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00ddf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55950/0 (socket says 172.21.15.53:55950) 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb74d51c640 1 -- 172.21.15.53:0/2814623557 learned_addr learned my addr 172.21.15.53:0/2814623557 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.335+0000 7fb74dd1d640 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd041b0 0x5653d00dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb74e51e640 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd2d070 0x5653d00e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb74d51c640 1 -- 172.21.15.53:0/2814623557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd2d070 msgr2=0x5653d00e9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb74d51c640 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd2d070 0x5653d00e9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb74d51c640 1 -- 172.21.15.53:0/2814623557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd041b0 msgr2=0x5653d00dd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb74d51c640 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd041b0 0x5653d00dd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb74d51c640 1 -- 172.21.15.53:0/2814623557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653cfff88b0 con 0x5653cfd0c390 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb74e51e640 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd2d070 0x5653d00e9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb74d51c640 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00ddf30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fb7380e2930 tx=0x7fb738007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddf03f0617cedf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb7317fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb7317fa640 1 -- 172.21.15.53:0/2814623557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73801d040 con 0x5653cfd0c390 2024-08-31T06:16:14.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb7317fa640 1 -- 172.21.15.53:0/2814623557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7fb7380a7240 con 0x5653cfd0c390 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb7564f6740 1 -- 172.21.15.53:0/2814623557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5653d004b580 con 0x5653cfd0c390 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb7317fa640 1 -- 172.21.15.53:0/2814623557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fb7380ab040 con 0x5653cfd0c390 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb7564f6740 10 client.19215 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb7564f6740 1 -- 172.21.15.53:0/2814623557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5653d00ec7a0 con 0x5653cfd0c390 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.336+0000 7fb7317fa640 1 -- 172.21.15.53:0/2814623557 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5653d004b580 con 0x5653cfd0c390 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.337+0000 7fb7317fa640 1 -- 172.21.15.53:0/2814623557 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7fb7380abb30 con 0x5653cfd0c390 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.337+0000 7fb7564f6740 10 client.19215 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.337+0000 7fb7564f6740 10 client.19215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.337+0000 7fb7564f6740 20 client.19215 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.337+0000 7fb7564f6740 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5653cfceb9f0 0x5653d00efb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.337+0000 7fb7564f6740 4 client.19215 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.337+0000 7fb7564f6740 1 -- 172.21.15.53:0/2814623557 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653d0047020 con 0x5653cfceb9f0 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.337+0000 7fb74dd1d640 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5653cfceb9f0 0x5653d00efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.337+0000 7fb74dd1d640 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5653cfceb9f0 0x5653d00efb00 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d4d53884a19c123 server_cookie=4cfad51c1b9043a7 in_seq=0 out_seq=0 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.337+0000 7fb7317fa640 10 client.19215 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7317fa640 1 -- 172.21.15.53:0/2814623557 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653d0047020 con 0x5653cfceb9f0 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7317fa640 10 client.19215 handle_command_reply: tid=0 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7564f6740 1 client.19215 shutdown 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7564f6740 1 -- 172.21.15.53:0/2814623557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 msgr2=0x5653d00ddf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7564f6740 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00ddf30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fb7380e2930 tx=0x7fb738007f70 comp rx=0 tx=0).stop 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7564f6740 1 -- 172.21.15.53:0/2814623557 shutdown_connections 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7564f6740 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5653cfceb9f0 0x5653d00efb00 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7564f6740 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd2d070 0x5653d00e9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7564f6740 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00ddf30 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7317fa640 0 client.19215 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7564f6740 1 --2- 172.21.15.53:0/2814623557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd041b0 0x5653d00dd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7564f6740 1 -- 172.21.15.53:0/2814623557 >> 172.21.15.53:0/2814623557 conn(0x5653cfd21460 msgr2=0x5653d00d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:14.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7564f6740 1 -- 172.21.15.53:0/2814623557 shutdown_connections 2024-08-31T06:16:14.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.338+0000 7fb7564f6740 1 -- 172.21.15.53:0/2814623557 wait complete. 2024-08-31T06:16:14.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.339+0000 7fb7564f6740 20 client.19215 trim_cache size 0 max 16384 2024-08-31T06:16:14.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.356+0000 7fb7564f6740 1 Processor -- start 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.356+0000 7fb7564f6740 1 -- start start 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd041b0 0x5653d00d5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd0c390 0x5653d00e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd2d070 0x5653d00cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb7564f6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481af610 con 0x5653cfd041b0 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb7564f6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481b12d0 con 0x5653cfd0c390 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb7564f6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481afce0 con 0x5653cfd2d070 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb74dd1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd041b0 0x5653d00d5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb74dd1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd041b0 0x5653d00d5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55952/0 (socket says 172.21.15.53:55952) 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb74dd1d640 1 -- 172.21.15.53:0/190400728 learned_addr learned my addr 172.21.15.53:0/190400728 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb74e51e640 1 --2- 172.21.15.53:0/190400728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd2d070 0x5653d00cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb74d51c640 1 --2- 172.21.15.53:0/190400728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd0c390 0x5653d00e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb74dd1d640 1 -- 172.21.15.53:0/190400728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd2d070 msgr2=0x5653d00cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:14.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb74dd1d640 1 --2- 172.21.15.53:0/190400728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd2d070 0x5653d00cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb74dd1d640 1 -- 172.21.15.53:0/190400728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd0c390 msgr2=0x5653d00e9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:14.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb74dd1d640 1 --2- 172.21.15.53:0/190400728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd0c390 0x5653d00e9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb74dd1d640 1 -- 172.21.15.53:0/190400728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d00d8670 con 0x5653cfd041b0 2024-08-31T06:16:14.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.357+0000 7fb74dd1d640 1 --2- 172.21.15.53:0/190400728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd041b0 0x5653d00d5ad0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x5653d00d0f40 tx=0x7fb744005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a318d194d86e055 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:14.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.358+0000 7fb7337fe640 1 -- 172.21.15.53:0/190400728 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744003db0 con 0x5653cfd041b0 2024-08-31T06:16:14.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.358+0000 7fb7337fe640 1 -- 172.21.15.53:0/190400728 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7440108c0 con 0x5653cfd041b0 2024-08-31T06:16:14.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.358+0000 7fb7337fe640 1 -- 172.21.15.53:0/190400728 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74401e8e0 con 0x5653cfd041b0 2024-08-31T06:16:14.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.358+0000 7fb7564f6740 1 -- 172.21.15.53:0/190400728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd041b0 msgr2=0x5653d00d5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:14.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.358+0000 7fb7564f6740 1 --2- 172.21.15.53:0/190400728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd041b0 0x5653d00d5ad0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x5653d00d0f40 tx=0x7fb744005f90 comp rx=0 tx=0).stop 2024-08-31T06:16:14.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.358+0000 7fb7564f6740 1 -- 172.21.15.53:0/190400728 shutdown_connections 2024-08-31T06:16:14.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.358+0000 7fb7564f6740 1 --2- 172.21.15.53:0/190400728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd2d070 0x5653d00cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.358+0000 7fb7564f6740 1 --2- 172.21.15.53:0/190400728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd0c390 0x5653d00e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.358+0000 7fb7564f6740 1 --2- 172.21.15.53:0/190400728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd041b0 0x5653d00d5ad0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.358+0000 7fb7564f6740 1 -- 172.21.15.53:0/190400728 >> 172.21.15.53:0/190400728 conn(0x5653cfd21460 msgr2=0x5653d00d53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:14.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.359+0000 7fb7564f6740 1 -- 172.21.15.53:0/190400728 shutdown_connections 2024-08-31T06:16:14.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.359+0000 7fb7564f6740 1 -- 172.21.15.53:0/190400728 wait complete. 2024-08-31T06:16:14.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.359+0000 7fb7564f6740 1 -- start start 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.359+0000 7fb7564f6740 1 Processor -- start 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd041b0 0x5653d00f0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00f1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb7564f6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd2d070 0x5653d00f1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb7564f6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481b0b40 con 0x5653cfd0c390 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb7564f6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481b03e0 con 0x5653cfd2d070 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb7564f6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481ad610 con 0x5653cfd041b0 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb7564f6740 10 client.0 _ll_register_callbacks cb 0x7fb740009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb74d51c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb74d51c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00f1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55954/0 (socket says 172.21.15.53:55954) 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb74d51c640 1 -- 172.21.15.53:0/1440969180 learned_addr learned my addr 172.21.15.53:0/1440969180 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb74dd1d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd041b0 0x5653d00f0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb74e51e640 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd2d070 0x5653d00f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb74d51c640 1 -- 172.21.15.53:0/1440969180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd041b0 msgr2=0x5653d00f0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb74d51c640 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd041b0 0x5653d00f0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb74d51c640 1 -- 172.21.15.53:0/1440969180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd2d070 msgr2=0x5653d00f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb74d51c640 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd2d070 0x5653d00f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb74d51c640 1 -- 172.21.15.53:0/1440969180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d0159350 con 0x5653cfd0c390 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb74d51c640 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00f1130 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fb7380ab860 tx=0x7fb7380b4c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab821b2ca7865d7a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb7317fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb7317fa640 1 -- 172.21.15.53:0/1440969180 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73801d070 con 0x5653cfd0c390 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb7317fa640 1 -- 172.21.15.53:0/1440969180 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8601+0+0 (secure 0 0 0) 0x7fb7380a7240 con 0x5653cfd0c390 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.360+0000 7fb7564f6740 1 -- 172.21.15.53:0/1440969180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7440108c0 con 0x5653cfd0c390 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb7317fa640 1 -- 172.21.15.53:0/1440969180 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fb7380ab220 con 0x5653cfd0c390 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb7564f6740 10 client.19221 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb7564f6740 1 -- 172.21.15.53:0/1440969180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5653d015a5e0 con 0x5653cfd0c390 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb7317fa640 1 -- 172.21.15.53:0/1440969180 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7440108c0 con 0x5653cfd0c390 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb7317fa640 1 -- 172.21.15.53:0/1440969180 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7fb7380aab30 con 0x5653cfd0c390 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb7564f6740 10 client.19221 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb7564f6740 10 client.19221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb7564f6740 20 client.19221 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb7564f6740 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5653cfcc0da0 0x5653d015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb7564f6740 4 client.19221 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb7564f6740 1 -- 172.21.15.53:0/1440969180 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5653d00d95a0 con 0x5653cfcc0da0 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.361+0000 7fb74dd1d640 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5653cfcc0da0 0x5653d015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb74dd1d640 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5653cfcc0da0 0x5653d015cb30 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83b25584535196c9 server_cookie=9a6b64d017a43fb6 in_seq=0 out_seq=0 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7317fa640 10 client.19221 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7317fa640 1 -- 172.21.15.53:0/1440969180 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x5653d00d95a0 con 0x5653cfcc0da0 2024-08-31T06:16:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7317fa640 10 client.19221 handle_command_reply: tid=0 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7564f6740 1 client.19221 shutdown 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7564f6740 1 -- 172.21.15.53:0/1440969180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 msgr2=0x5653d00f1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7564f6740 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00f1130 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fb7380ab860 tx=0x7fb7380b4c40 comp rx=0 tx=0).stop 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7564f6740 1 -- 172.21.15.53:0/1440969180 shutdown_connections 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7564f6740 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5653cfcc0da0 0x5653d015cb30 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7564f6740 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653cfd2d070 0x5653d00f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7564f6740 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5653cfd0c390 0x5653d00f1130 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7564f6740 1 --2- 172.21.15.53:0/1440969180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653cfd041b0 0x5653d00f0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7317fa640 0 client.19221 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7564f6740 1 -- 172.21.15.53:0/1440969180 >> 172.21.15.53:0/1440969180 conn(0x5653cfd21460 msgr2=0x5653d00cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.362+0000 7fb7564f6740 1 -- 172.21.15.53:0/1440969180 shutdown_connections 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb7564f6740 1 -- 172.21.15.53:0/1440969180 wait complete. 2024-08-31T06:16:14.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb7564f6740 20 client.19221 trim_cache size 0 max 16384 2024-08-31T06:16:14.371 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:16:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:16:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:16:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:16:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "c852752b-53bf-4f84-90ac-1759f148a9bf", 2024-08-31T06:16:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:16:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:16:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:16:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:16:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:14.381 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:16:14.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 -- 172.21.15.53:0/2852999963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb7340b4d20 msgr2=0x7fb7340b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:14.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb7340b4d20 0x7fb7340b7230 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb740006010 tx=0x7fb7400095c0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 -- 172.21.15.53:0/2852999963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb748109240 msgr2=0x7fb74819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:14.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb748109240 0x7fb74819a6e0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb73800c970 tx=0x7fb73800ce30 comp rx=0 tx=0).stop 2024-08-31T06:16:14.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 -- 172.21.15.53:0/2852999963 shutdown_connections 2024-08-31T06:16:14.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb7340b4d20 0x7fb7340b7230 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb748109b90 0x7fb74819f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb748109240 0x7fb74819a6e0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 --2- 172.21.15.53:0/2852999963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb748103900 0x7fb74819a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:14.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 -- 172.21.15.53:0/2852999963 >> 172.21.15.53:0/2852999963 conn(0x7fb74807b5f0 msgr2=0x7fb748105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:14.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 -- 172.21.15.53:0/2852999963 shutdown_connections 2024-08-31T06:16:14.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:14.363+0000 7fb74ff81640 1 -- 172.21.15.53:0/2852999963 wait complete. 2024-08-31T06:16:14.996 INFO:tasks.workunit.client.0.smithi053.stdout: 1 173891 1.36 MB/sec execute 484 sec latency 1589.421 ms 2024-08-31T06:16:15.230 INFO:tasks.cephfs.filesystem:scrub status for tag:c852752b-53bf-4f84-90ac-1759f148a9bf - {'path': '/', 'tag': 'c852752b-53bf-4f84-90ac-1759f148a9bf', 'options': 'recursive,force'} 2024-08-31T06:16:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:15 smithi053 ceph-mon[18924]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T06:16:15.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:15 smithi053 ceph-mon[18924]: pgmap v674: 97 pgs: 97 active+clean; 96 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 145 KiB/s wr, 29 op/s 2024-08-31T06:16:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:15 smithi153 ceph-mon[22320]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T06:16:15.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:15 smithi153 ceph-mon[22320]: pgmap v674: 97 pgs: 97 active+clean; 96 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 145 KiB/s wr, 29 op/s 2024-08-31T06:16:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:15 smithi130 ceph-mon[22266]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T06:16:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:15 smithi130 ceph-mon[22266]: pgmap v674: 97 pgs: 97 active+clean; 96 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 145 KiB/s wr, 29 op/s 2024-08-31T06:16:15.996 INFO:tasks.workunit.client.0.smithi053.stdout: 1 173891 1.35 MB/sec execute 485 sec latency 2589.521 ms 2024-08-31T06:16:16.996 INFO:tasks.workunit.client.0.smithi053.stdout: 1 173958 1.35 MB/sec execute 486 sec latency 2840.086 ms 2024-08-31T06:16:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:17 smithi130 ceph-mon[22266]: pgmap v675: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 358 KiB/s wr, 42 op/s 2024-08-31T06:16:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:17 smithi153 ceph-mon[22320]: pgmap v675: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 358 KiB/s wr, 42 op/s 2024-08-31T06:16:17.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:17 smithi053 ceph-mon[18924]: pgmap v675: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 358 KiB/s wr, 42 op/s 2024-08-31T06:16:17.996 INFO:tasks.workunit.client.0.smithi053.stdout: 1 173958 1.35 MB/sec execute 487 sec latency 1501.082 ms 2024-08-31T06:16:18.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 173958 1.34 MB/sec execute 488 sec latency 2501.177 ms 2024-08-31T06:16:19.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:19 smithi153 ceph-mon[22320]: pgmap v676: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 396 KiB/s wr, 46 op/s 2024-08-31T06:16:19.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:19 smithi053 ceph-mon[18924]: pgmap v676: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 396 KiB/s wr, 46 op/s 2024-08-31T06:16:19.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 173958 1.34 MB/sec execute 489 sec latency 3501.306 ms 2024-08-31T06:16:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:19 smithi130 ceph-mon[22266]: pgmap v676: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 396 KiB/s wr, 46 op/s 2024-08-31T06:16:20.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:20 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:16:20.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:20 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:16:20.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 173958 1.34 MB/sec execute 490 sec latency 4501.400 ms 2024-08-31T06:16:21.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:20 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:16:21.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:21 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:16:21.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:21 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:16:21.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:21 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:16:21.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:21 smithi153 ceph-mon[22320]: pgmap v677: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 423 KiB/s wr, 52 op/s 2024-08-31T06:16:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:21 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:16:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:21 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:16:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:21 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:16:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:21 smithi053 ceph-mon[18924]: pgmap v677: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 423 KiB/s wr, 52 op/s 2024-08-31T06:16:21.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 174160 1.34 MB/sec execute 491 sec latency 4749.629 ms 2024-08-31T06:16:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:21 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:16:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:21 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:16:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:21 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:16:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:21 smithi130 ceph-mon[22266]: pgmap v677: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 423 KiB/s wr, 52 op/s 2024-08-31T06:16:22.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 174424 1.34 MB/sec execute 492 sec latency 14.874 ms 2024-08-31T06:16:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.589+0000 7fd2c2512640 1 -- 172.21.15.53:0/2234598570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2bc108a30 msgr2=0x7fd2bc10f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.589+0000 7fd2c2512640 1 --2- 172.21.15.53:0/2234598570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2bc108a30 0x7fd2bc10f260 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009ca0 tx=0x7fd2b402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.589+0000 7fd2c2512640 1 -- 172.21.15.53:0/2234598570 shutdown_connections 2024-08-31T06:16:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.589+0000 7fd2c2512640 1 --2- 172.21.15.53:0/2234598570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2bc108a30 0x7fd2bc10f260 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.589+0000 7fd2c2512640 1 --2- 172.21.15.53:0/2234598570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2bc1080e0 0x7fd2bc1084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.589+0000 7fd2c2512640 1 --2- 172.21.15.53:0/2234598570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2bc1027b0 0x7fd2bc102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.589+0000 7fd2c2512640 1 -- 172.21.15.53:0/2234598570 >> 172.21.15.53:0/2234598570 conn(0x7fd2bc0fe1b0 msgr2=0x7fd2bc100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.589+0000 7fd2c2512640 1 -- 172.21.15.53:0/2234598570 shutdown_connections 2024-08-31T06:16:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.589+0000 7fd2c2512640 1 -- 172.21.15.53:0/2234598570 wait complete. 2024-08-31T06:16:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2c2512640 1 Processor -- start 2024-08-31T06:16:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2c2512640 1 -- start start 2024-08-31T06:16:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2c2512640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2bc1027b0 0x7fd2bc19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2c2512640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2bc1080e0 0x7fd2bc19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2c2512640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2bc108a30 0x7fd2bc19fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2c2512640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc1125e0 con 0x7fd2bc1080e0 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2c2512640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc112460 con 0x7fd2bc1027b0 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2c2512640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc112760 con 0x7fd2bc108a30 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2bc1080e0 0x7fd2bc19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2c0aaf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2bc108a30 0x7fd2bc19fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2bc1027b0 0x7fd2bc19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2bc1080e0 0x7fd2bc19a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53424/0 (socket says 172.21.15.53:53424) 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2c0aaf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2bc108a30 0x7fd2bc19fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:55290/0 (socket says 172.21.15.53:55290) 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.590+0000 7fd2bb7fe640 1 -- 172.21.15.53:0/1992389338 learned_addr learned my addr 172.21.15.53:0/1992389338 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2bb7fe640 1 -- 172.21.15.53:0/1992389338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2bc108a30 msgr2=0x7fd2bc19fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2bb7fe640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2bc108a30 0x7fd2bc19fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2bb7fe640 1 -- 172.21.15.53:0/1992389338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2bc1027b0 msgr2=0x7fd2bc19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2bb7fe640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2bc1027b0 0x7fd2bc19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2bb7fe640 1 -- 172.21.15.53:0/1992389338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc1a0100 con 0x7fd2bc1080e0 2024-08-31T06:16:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2c0aaf640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2bc108a30 0x7fd2bc19fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2bb7fe640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2bc1080e0 0x7fd2bc19a770 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c970 tx=0x7fd2b000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2b97fa640 1 -- 172.21.15.53:0/1992389338 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0007bb0 con 0x7fd2bc1080e0 2024-08-31T06:16:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2c2512640 1 -- 172.21.15.53:0/1992389338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2bc1a03f0 con 0x7fd2bc1080e0 2024-08-31T06:16:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2b97fa640 1 -- 172.21.15.53:0/1992389338 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2b0007d50 con 0x7fd2bc1080e0 2024-08-31T06:16:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2b97fa640 1 -- 172.21.15.53:0/1992389338 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0004d40 con 0x7fd2bc1080e0 2024-08-31T06:16:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.591+0000 7fd2c2512640 1 -- 172.21.15.53:0/1992389338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2bc1a6b80 con 0x7fd2bc1080e0 2024-08-31T06:16:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.594+0000 7fd2c9479740 1 Processor -- start 2024-08-31T06:16:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.594+0000 7fd2c9479740 1 -- start start 2024-08-31T06:16:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.594+0000 7fd2b97fa640 1 -- 172.21.15.53:0/1992389338 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd2b000f450 con 0x7fd2bc1080e0 2024-08-31T06:16:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.594+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7217d1b0 0x55ce72520ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.594+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 0x55ce72521220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.594+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce7215c4d0 0x55ce72521760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.594+0000 7fd2c9479740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ce72496000 con 0x55ce7215c4d0 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.594+0000 7fd2c9479740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ce72485590 con 0x55ce721542f0 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.594+0000 7fd2c9479740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ce72489540 con 0x55ce7217d1b0 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2c0aaf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7217d1b0 0x55ce72520ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2c0aaf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7217d1b0 0x55ce72520ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:55300/0 (socket says 172.21.15.53:55300) 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2c0aaf640 1 -- 172.21.15.53:0/2157375829 learned_addr learned my addr 172.21.15.53:0/2157375829 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2bb7fe640 1 --2- 172.21.15.53:0/2157375829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce7215c4d0 0x55ce72521760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/2157375829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 0x55ce72521220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2c0aaf640 1 -- 172.21.15.53:0/2157375829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 msgr2=0x55ce72521220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2c0aaf640 1 --2- 172.21.15.53:0/2157375829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 0x55ce72521220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2c0aaf640 1 -- 172.21.15.53:0/2157375829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce7215c4d0 msgr2=0x55ce72521760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2c0aaf640 1 --2- 172.21.15.53:0/2157375829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce7215c4d0 0x55ce72521760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2c0aaf640 1 -- 172.21.15.53:0/2157375829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce721e8790 con 0x55ce7217d1b0 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2c0aaf640 1 --2- 172.21.15.53:0/2157375829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7217d1b0 0x55ce72520ce0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4035000 tx=0x7fd2b4009940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61e31bca02e0130b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:23.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2b97fa640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2a40b4d20 0x7fd2a40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2a40b4d20 0x7fd2a40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2a27fc640 1 -- 172.21.15.53:0/2157375829 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4031d40 con 0x55ce7217d1b0 2024-08-31T06:16:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2a27fc640 1 -- 172.21.15.53:0/2157375829 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2b4036070 con 0x55ce7217d1b0 2024-08-31T06:16:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2b97fa640 1 -- 172.21.15.53:0/1992389338 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fd2b00e5160 con 0x7fd2bc1080e0 2024-08-31T06:16:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.595+0000 7fd2a27fc640 1 -- 172.21.15.53:0/2157375829 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4004810 con 0x55ce7217d1b0 2024-08-31T06:16:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.596+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2a40b4d20 0x7fd2a40b7230 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55ce7251f960 tx=0x7fd2ac015040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.596+0000 7fd2c9479740 1 -- 172.21.15.53:0/2157375829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7217d1b0 msgr2=0x55ce72520ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.596+0000 7fd2c9479740 1 --2- 172.21.15.53:0/2157375829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7217d1b0 0x55ce72520ce0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4035000 tx=0x7fd2b4009940 comp rx=0 tx=0).stop 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.596+0000 7fd2c9479740 1 -- 172.21.15.53:0/2157375829 shutdown_connections 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.596+0000 7fd2c9479740 1 --2- 172.21.15.53:0/2157375829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce7215c4d0 0x55ce72521760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.596+0000 7fd2c9479740 1 --2- 172.21.15.53:0/2157375829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 0x55ce72521220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.597+0000 7fd2c9479740 1 --2- 172.21.15.53:0/2157375829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7217d1b0 0x55ce72520ce0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.597+0000 7fd2c9479740 1 -- 172.21.15.53:0/2157375829 >> 172.21.15.53:0/2157375829 conn(0x55ce72171300 msgr2=0x55ce7251ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.597+0000 7fd2c9479740 1 -- 172.21.15.53:0/2157375829 shutdown_connections 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.597+0000 7fd2c9479740 1 -- 172.21.15.53:0/2157375829 wait complete. 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.597+0000 7fd2c9479740 1 -- start start 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.597+0000 7fd2c9479740 1 Processor -- start 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 0x55ce7252c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce7252cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce7217d1b0 0x55ce72532570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2c9479740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ce723beab0 con 0x55ce7217d1b0 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2c9479740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ce7240c680 con 0x55ce721542f0 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2c9479740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ce7252f280 con 0x55ce7215c4d0 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2c9479740 10 client.0 _ll_register_callbacks cb 0x55ce72194a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 0x55ce7252c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2bb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce7252cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2c0aaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce7217d1b0 0x55ce72532570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 0x55ce7252c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:41992/0 (socket says 172.21.15.53:41992) 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2bb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce7252cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:55306/0 (socket says 172.21.15.53:55306) 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2bbfff640 1 -- 172.21.15.53:0/37316961 learned_addr learned my addr 172.21.15.53:0/37316961 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2bbfff640 1 -- 172.21.15.53:0/37316961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 msgr2=0x55ce7252cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce7252cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2bbfff640 1 -- 172.21.15.53:0/37316961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce7217d1b0 msgr2=0x55ce72532570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce7217d1b0 0x55ce72532570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2bbfff640 1 -- 172.21.15.53:0/37316961 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce72261620 con 0x55ce721542f0 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2c0aaf640 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce7217d1b0 0x55ce72532570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 0x55ce7252c990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac003870 tx=0x7fd2ac004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5be48aa4833bcef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.598+0000 7fd29b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd29b7fe640 1 -- 172.21.15.53:0/37316961 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac025040 con 0x55ce721542f0 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd2c9479740 1 -- 172.21.15.53:0/37316961 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2b4036070 con 0x55ce721542f0 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd29b7fe640 1 -- 172.21.15.53:0/37316961 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fd2ac00e9d0 con 0x55ce721542f0 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd29b7fe640 1 -- 172.21.15.53:0/37316961 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fd2ac00ebd0 con 0x55ce721542f0 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd2c9479740 10 client.28334 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd2c9479740 1 -- 172.21.15.53:0/37316961 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55ce7253b450 con 0x55ce721542f0 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd29b7fe640 1 -- 172.21.15.53:0/37316961 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2b4036070 con 0x55ce721542f0 2024-08-31T06:16:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd29b7fe640 1 -- 172.21.15.53:0/37316961 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7fd2ac01f3f0 con 0x55ce721542f0 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd2c9479740 10 client.28334 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd2c9479740 10 client.28334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd2c9479740 20 client.28334 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd2c9479740 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ce7213bd80 0x55ce7253eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd2c9479740 4 client.28334 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.599+0000 7fd2c9479740 1 -- 172.21.15.53:0/37316961 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce72497f50 con 0x55ce7213bd80 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.600+0000 7fd2bb7fe640 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ce7213bd80 0x55ce7253eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.600+0000 7fd29b7fe640 10 client.28334 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.600+0000 7fd2bb7fe640 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ce7213bd80 0x55ce7253eac0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6962fea41eee00c server_cookie=550109619a1af879 in_seq=0 out_seq=0 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd29b7fe640 1 -- 172.21.15.53:0/37316961 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce72497f50 con 0x55ce7213bd80 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd29b7fe640 10 client.28334 handle_command_reply: tid=0 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 1 client.28334 shutdown 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 1 -- 172.21.15.53:0/37316961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 msgr2=0x55ce7252c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 0x55ce7252c990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac003870 tx=0x7fd2ac004730 comp rx=0 tx=0).stop 2024-08-31T06:16:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 1 -- 172.21.15.53:0/37316961 shutdown_connections 2024-08-31T06:16:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ce7213bd80 0x55ce7253eac0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce7217d1b0 0x55ce72532570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd29b7fe640 0 client.28334 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce7252cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 1 --2- 172.21.15.53:0/37316961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce721542f0 0x55ce7252c990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 1 -- 172.21.15.53:0/37316961 >> 172.21.15.53:0/37316961 conn(0x55ce72171300 msgr2=0x55ce72521d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 1 -- 172.21.15.53:0/37316961 shutdown_connections 2024-08-31T06:16:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 1 -- 172.21.15.53:0/37316961 wait complete. 2024-08-31T06:16:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.601+0000 7fd2c9479740 20 client.28334 trim_cache size 0 max 16384 2024-08-31T06:16:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.617+0000 7fd2c9479740 1 Processor -- start 2024-08-31T06:16:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.617+0000 7fd2c9479740 1 -- start start 2024-08-31T06:16:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce7252e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce7251e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7217d1b0 0x55ce7251e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2c9479740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc1ad2f0 con 0x55ce721542f0 2024-08-31T06:16:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2c9479740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc1aefb0 con 0x55ce7217d1b0 2024-08-31T06:16:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2c9479740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc1ad9c0 con 0x55ce7215c4d0 2024-08-31T06:16:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce7252e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce7252e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53452/0 (socket says 172.21.15.53:53452) 2024-08-31T06:16:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2bbfff640 1 -- 172.21.15.53:0/1779262890 learned_addr learned my addr 172.21.15.53:0/1779262890 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2c0aaf640 1 --2- 172.21.15.53:0/1779262890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7217d1b0 0x55ce7251e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2bb7fe640 1 --2- 172.21.15.53:0/1779262890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce7251e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2bbfff640 1 -- 172.21.15.53:0/1779262890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 msgr2=0x55ce7251e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/1779262890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce7251e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2bbfff640 1 -- 172.21.15.53:0/1779262890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7217d1b0 msgr2=0x55ce7251e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/1779262890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7217d1b0 0x55ce7251e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2bbfff640 1 -- 172.21.15.53:0/1779262890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7251cf60 con 0x55ce721542f0 2024-08-31T06:16:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.618+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/1779262890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce7252e3b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac000c00 tx=0x7fd2ac004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f09e5dee97fedba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.619+0000 7fd2a1ffb640 1 -- 172.21.15.53:0/1779262890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac025040 con 0x55ce721542f0 2024-08-31T06:16:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.619+0000 7fd2a1ffb640 1 -- 172.21.15.53:0/1779262890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2ac00e8a0 con 0x55ce721542f0 2024-08-31T06:16:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.619+0000 7fd2a1ffb640 1 -- 172.21.15.53:0/1779262890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac01fa50 con 0x55ce721542f0 2024-08-31T06:16:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.620+0000 7fd2c9479740 1 -- 172.21.15.53:0/1779262890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 msgr2=0x55ce7252e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.620+0000 7fd2c9479740 1 --2- 172.21.15.53:0/1779262890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce7252e3b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac000c00 tx=0x7fd2ac004000 comp rx=0 tx=0).stop 2024-08-31T06:16:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.620+0000 7fd2c9479740 1 -- 172.21.15.53:0/1779262890 shutdown_connections 2024-08-31T06:16:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.620+0000 7fd2c9479740 1 --2- 172.21.15.53:0/1779262890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7217d1b0 0x55ce7251e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.620+0000 7fd2c9479740 1 --2- 172.21.15.53:0/1779262890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce7251e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.620+0000 7fd2c9479740 1 --2- 172.21.15.53:0/1779262890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce7252e3b0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.620+0000 7fd2c9479740 1 -- 172.21.15.53:0/1779262890 >> 172.21.15.53:0/1779262890 conn(0x55ce72171300 msgr2=0x55ce7252dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.620+0000 7fd2c9479740 1 -- 172.21.15.53:0/1779262890 shutdown_connections 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.620+0000 7fd2c9479740 1 -- 172.21.15.53:0/1779262890 wait complete. 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.620+0000 7fd2c9479740 1 -- start start 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2c9479740 1 Processor -- start 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce725340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce72534630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2c9479740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7217d1b0 0x55ce725a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2c9479740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc1ae820 con 0x55ce721542f0 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2c9479740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc1ae0c0 con 0x55ce7217d1b0 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2c9479740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc1ab2f0 con 0x55ce7215c4d0 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2c9479740 10 client.0 _ll_register_callbacks cb 0x7fd2ac022040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce725340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce725340f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53462/0 (socket says 172.21.15.53:53462) 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2bbfff640 1 -- 172.21.15.53:0/1730703602 learned_addr learned my addr 172.21.15.53:0/1730703602 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2c0aaf640 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7217d1b0 0x55ce725a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2bb7fe640 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce72534630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2bbfff640 1 -- 172.21.15.53:0/1730703602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 msgr2=0x55ce72534630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce72534630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2bbfff640 1 -- 172.21.15.53:0/1730703602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7217d1b0 msgr2=0x55ce725a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7217d1b0 0x55ce725a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.621+0000 7fd2bbfff640 1 -- 172.21.15.53:0/1730703602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce725a7aa0 con 0x55ce721542f0 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.622+0000 7fd2bbfff640 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce725340f0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac006010 tx=0x7fd2ac00eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61f4d29298c5918 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.622+0000 7fd29b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.622+0000 7fd29b7fe640 1 -- 172.21.15.53:0/1730703602 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac048020 con 0x55ce721542f0 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.622+0000 7fd29b7fe640 1 -- 172.21.15.53:0/1730703602 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fd2ac009040 con 0x55ce721542f0 2024-08-31T06:16:23.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.622+0000 7fd2c9479740 1 -- 172.21.15.53:0/1730703602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2ac00e8a0 con 0x55ce721542f0 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.622+0000 7fd29b7fe640 1 -- 172.21.15.53:0/1730703602 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fd2ac053050 con 0x55ce721542f0 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.622+0000 7fd2c9479740 10 client.19239 fetch_fsmap learned FSMap version 50 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.622+0000 7fd2c9479740 1 -- 172.21.15.53:0/1730703602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55ce725a8d30 con 0x55ce721542f0 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.622+0000 7fd29b7fe640 1 -- 172.21.15.53:0/1730703602 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2ac00e8a0 con 0x55ce721542f0 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.623+0000 7fd29b7fe640 1 -- 172.21.15.53:0/1730703602 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) ==== 8394+0+0 (secure 0 0 0) 0x7fd2ac03b450 con 0x55ce721542f0 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.623+0000 7fd2c9479740 10 client.19239 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.623+0000 7fd2c9479740 10 client.19239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.623+0000 7fd2c9479740 20 client.19239 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.623+0000 7fd2c9479740 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ce721111c0 0x55ce725ab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.623+0000 7fd2c9479740 4 client.19239 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.623+0000 7fd2c9479740 1 -- 172.21.15.53:0/1730703602 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ce725282f0 con 0x55ce721111c0 2024-08-31T06:16:23.629 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.623+0000 7fd2bb7fe640 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ce721111c0 0x55ce725ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:23.630 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.623+0000 7fd29b7fe640 10 client.19239 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:23.630 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.623+0000 7fd2bb7fe640 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ce721111c0 0x55ce725ab540 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58cd573b3f000b63 server_cookie=868b10a30db88dab in_seq=0 out_seq=0 2024-08-31T06:16:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.645+0000 7fd29b7fe640 1 -- 172.21.15.53:0/1730703602 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ce725282f0 con 0x55ce721111c0 2024-08-31T06:16:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.645+0000 7fd29b7fe640 10 client.19239 handle_command_reply: tid=0 2024-08-31T06:16:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 1 client.19239 shutdown 2024-08-31T06:16:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 1 -- 172.21.15.53:0/1730703602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 msgr2=0x55ce725340f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce725340f0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac006010 tx=0x7fd2ac00eac0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 1 -- 172.21.15.53:0/1730703602 shutdown_connections 2024-08-31T06:16:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ce721111c0 0x55ce725ab540 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7217d1b0 0x55ce725a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce7215c4d0 0x55ce72534630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd29b7fe640 0 client.19239 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 1 --2- 172.21.15.53:0/1730703602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce721542f0 0x55ce725340f0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 1 -- 172.21.15.53:0/1730703602 >> 172.21.15.53:0/1730703602 conn(0x55ce72171300 msgr2=0x55ce7252da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 1 -- 172.21.15.53:0/1730703602 shutdown_connections 2024-08-31T06:16:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 1 -- 172.21.15.53:0/1730703602 wait complete. 2024-08-31T06:16:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.646+0000 7fd2c9479740 20 client.19239 trim_cache size 0 max 16384 2024-08-31T06:16:23.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:16:23.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:16:23.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:16:23.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:16:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 -- 172.21.15.53:0/1992389338 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2a40b4d20 msgr2=0x7fd2a40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2a40b4d20 0x7fd2a40b7230 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55ce7251f960 tx=0x7fd2ac015040 comp rx=0 tx=0).stop 2024-08-31T06:16:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 -- 172.21.15.53:0/1992389338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2bc1080e0 msgr2=0x7fd2bc19a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2bc1080e0 0x7fd2bc19a770 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c970 tx=0x7fd2b000ce30 comp rx=0 tx=0).stop 2024-08-31T06:16:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 -- 172.21.15.53:0/1992389338 shutdown_connections 2024-08-31T06:16:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd2a40b4d20 0x7fd2a40b7230 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2bc108a30 0x7fd2bc19fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2bc1080e0 0x7fd2bc19a770 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 --2- 172.21.15.53:0/1992389338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2bc1027b0 0x7fd2bc19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 -- 172.21.15.53:0/1992389338 >> 172.21.15.53:0/1992389338 conn(0x7fd2bc0fe1b0 msgr2=0x7fd2bc106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 -- 172.21.15.53:0/1992389338 shutdown_connections 2024-08-31T06:16:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:23.647+0000 7fd2c2512640 1 -- 172.21.15.53:0/1992389338 wait complete. 2024-08-31T06:16:23.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:23 smithi153 ceph-mon[22320]: pgmap v678: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 419 KiB/s wr, 52 op/s 2024-08-31T06:16:23.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:23 smithi053 ceph-mon[18924]: pgmap v678: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 419 KiB/s wr, 52 op/s 2024-08-31T06:16:23.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 174916 1.34 MB/sec execute 493 sec latency 16.245 ms 2024-08-31T06:16:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:23 smithi130 ceph-mon[22266]: pgmap v678: 97 pgs: 97 active+clean; 99 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 419 KiB/s wr, 52 op/s 2024-08-31T06:16:24.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 175416 1.34 MB/sec execute 494 sec latency 22.481 ms 2024-08-31T06:16:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:25 smithi153 ceph-mon[22320]: pgmap v679: 97 pgs: 97 active+clean; 100 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 407 KiB/s wr, 58 op/s 2024-08-31T06:16:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:25 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:16:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:25 smithi053 ceph-mon[18924]: pgmap v679: 97 pgs: 97 active+clean; 100 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 407 KiB/s wr, 58 op/s 2024-08-31T06:16:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:25 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:16:25.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 175928 1.34 MB/sec execute 495 sec latency 43.257 ms 2024-08-31T06:16:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:25 smithi130 ceph-mon[22266]: pgmap v679: 97 pgs: 97 active+clean; 100 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 407 KiB/s wr, 58 op/s 2024-08-31T06:16:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:25 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:16:26.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 176419 1.34 MB/sec execute 496 sec latency 22.120 ms 2024-08-31T06:16:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:27 smithi153 ceph-mon[22320]: pgmap v680: 97 pgs: 97 active+clean; 102 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 665 KiB/s wr, 74 op/s 2024-08-31T06:16:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:27 smithi053 ceph-mon[18924]: pgmap v680: 97 pgs: 97 active+clean; 102 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 665 KiB/s wr, 74 op/s 2024-08-31T06:16:27.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 177126 1.35 MB/sec execute 497 sec latency 14.628 ms 2024-08-31T06:16:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:27 smithi130 ceph-mon[22266]: pgmap v680: 97 pgs: 97 active+clean; 102 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 665 KiB/s wr, 74 op/s 2024-08-31T06:16:28.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 177436 1.36 MB/sec execute 498 sec latency 262.279 ms 2024-08-31T06:16:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:29 smithi153 ceph-mon[22320]: pgmap v681: 97 pgs: 97 active+clean; 102 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 626 KiB/s wr, 71 op/s 2024-08-31T06:16:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:29 smithi053 ceph-mon[18924]: pgmap v681: 97 pgs: 97 active+clean; 102 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 626 KiB/s wr, 71 op/s 2024-08-31T06:16:29.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 177436 1.35 MB/sec execute 499 sec latency 1262.309 ms 2024-08-31T06:16:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:29 smithi130 ceph-mon[22266]: pgmap v681: 97 pgs: 97 active+clean; 102 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 626 KiB/s wr, 71 op/s 2024-08-31T06:16:30.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 177436 1.35 MB/sec execute 500 sec latency 2262.395 ms 2024-08-31T06:16:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:31 smithi153 ceph-mon[22320]: pgmap v682: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 936 KiB/s wr, 99 op/s 2024-08-31T06:16:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:31 smithi053 ceph-mon[18924]: pgmap v682: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 936 KiB/s wr, 99 op/s 2024-08-31T06:16:31.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 177503 1.35 MB/sec execute 501 sec latency 2513.297 ms 2024-08-31T06:16:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:31 smithi130 ceph-mon[22266]: pgmap v682: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 936 KiB/s wr, 99 op/s 2024-08-31T06:16:32.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 177503 1.35 MB/sec execute 502 sec latency 1489.644 ms 2024-08-31T06:16:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:33 smithi153 ceph-mon[22320]: pgmap v683: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 966 KiB/s wr, 95 op/s 2024-08-31T06:16:33.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:33 smithi053 ceph-mon[18924]: pgmap v683: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 966 KiB/s wr, 95 op/s 2024-08-31T06:16:33.997 INFO:tasks.workunit.client.0.smithi053.stdout: 1 177503 1.34 MB/sec execute 503 sec latency 2489.698 ms 2024-08-31T06:16:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:33 smithi130 ceph-mon[22266]: pgmap v683: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 966 KiB/s wr, 95 op/s 2024-08-31T06:16:34.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 177503 1.34 MB/sec execute 504 sec latency 3489.795 ms 2024-08-31T06:16:35.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:35 smithi153 ceph-mon[22320]: pgmap v684: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-08-31T06:16:35.930 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:35 smithi130 ceph-mon[22266]: pgmap v684: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-08-31T06:16:35.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:35 smithi053 ceph-mon[18924]: pgmap v684: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-08-31T06:16:35.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 177503 1.34 MB/sec execute 505 sec latency 4489.881 ms 2024-08-31T06:16:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.750+0000 7f46bc7f8640 1 -- 172.21.15.53:0/3198211981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46b41081a0 msgr2=0x7f46b410e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.750+0000 7f46bc7f8640 1 --2- 172.21.15.53:0/3198211981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46b41081a0 0x7f46b410e9d0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009ca0 tx=0x7f46ac02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.750+0000 7f46bc7f8640 1 -- 172.21.15.53:0/3198211981 shutdown_connections 2024-08-31T06:16:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.750+0000 7f46bc7f8640 1 --2- 172.21.15.53:0/3198211981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46b41081a0 0x7f46b410e9d0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.750+0000 7f46bc7f8640 1 --2- 172.21.15.53:0/3198211981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b4107850 0x7f46b4107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.750+0000 7f46bc7f8640 1 --2- 172.21.15.53:0/3198211981 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b4101f20 0x7f46b4102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.750+0000 7f46bc7f8640 1 -- 172.21.15.53:0/3198211981 >> 172.21.15.53:0/3198211981 conn(0x7f46b4079c30 msgr2=0x7f46b407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.750+0000 7f46bc7f8640 1 -- 172.21.15.53:0/3198211981 shutdown_connections 2024-08-31T06:16:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.750+0000 7f46bc7f8640 1 -- 172.21.15.53:0/3198211981 wait complete. 2024-08-31T06:16:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46bc7f8640 1 Processor -- start 2024-08-31T06:16:36.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46bc7f8640 1 -- start start 2024-08-31T06:16:36.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46bc7f8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b4101f20 0x7f46b419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46bc7f8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b4107850 0x7f46b419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46bc7f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46b41081a0 0x7f46b419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46bc7f8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41114e0 con 0x7f46b41081a0 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46bc7f8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4111360 con 0x7f46b4101f20 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46bc7f8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4111660 con 0x7f46b4107850 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46bad95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46b41081a0 0x7f46b419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46ba594640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b4101f20 0x7f46b419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46bad95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46b41081a0 0x7f46b419fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42932/0 (socket says 172.21.15.53:42932) 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.751+0000 7f46bad95640 1 -- 172.21.15.53:0/562287092 learned_addr learned my addr 172.21.15.53:0/562287092 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46b9d93640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b4107850 0x7f46b419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46bad95640 1 -- 172.21.15.53:0/562287092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b4107850 msgr2=0x7f46b419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46bad95640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b4107850 0x7f46b419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46bad95640 1 -- 172.21.15.53:0/562287092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b4101f20 msgr2=0x7f46b419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46bad95640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b4101f20 0x7f46b419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46bad95640 1 -- 172.21.15.53:0/562287092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b41a0110 con 0x7f46b41081a0 2024-08-31T06:16:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46ba594640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b4101f20 0x7f46b419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46bad95640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46b41081a0 0x7f46b419fa10 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f46ac005e30 tx=0x7f46ac0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46ab7fe640 1 -- 172.21.15.53:0/562287092 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac032d10 con 0x7f46b41081a0 2024-08-31T06:16:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46ab7fe640 1 -- 172.21.15.53:0/562287092 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46ac032eb0 con 0x7f46b41081a0 2024-08-31T06:16:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46bc7f8640 1 -- 172.21.15.53:0/562287092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b41a03a0 con 0x7f46b41081a0 2024-08-31T06:16:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46ab7fe640 1 -- 172.21.15.53:0/562287092 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac030b20 con 0x7f46b41081a0 2024-08-31T06:16:36.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.752+0000 7f46bc7f8640 1 -- 172.21.15.53:0/562287092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b41a6b90 con 0x7f46b41081a0 2024-08-31T06:16:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.755+0000 7f46c383d740 1 Processor -- start 2024-08-31T06:16:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.756+0000 7f46ab7fe640 1 -- 172.21.15.53:0/562287092 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f46ac030cc0 con 0x7f46b41081a0 2024-08-31T06:16:36.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.756+0000 7f46c383d740 1 -- start start 2024-08-31T06:16:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.756+0000 7f46c383d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23fa1b0 0x55bda279dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.756+0000 7f46c383d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23d12f0 0x55bda279e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.756+0000 7f46c383d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d94d0 0x55bda279e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.756+0000 7f46c383d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bda2713000 con 0x55bda23fa1b0 2024-08-31T06:16:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.756+0000 7f46c383d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bda2702590 con 0x55bda23d94d0 2024-08-31T06:16:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.756+0000 7f46c383d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bda2706540 con 0x55bda23d12f0 2024-08-31T06:16:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.756+0000 7f46b9d93640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23fa1b0 0x55bda279dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.756+0000 7f46b9d93640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23fa1b0 0x55bda279dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42936/0 (socket says 172.21.15.53:42936) 2024-08-31T06:16:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.756+0000 7f46b9d93640 1 -- 172.21.15.53:0/3003857887 learned_addr learned my addr 172.21.15.53:0/3003857887 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:36.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46b9d93640 1 --2- 172.21.15.53:0/3003857887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d94d0 0x55bda279e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46ba594640 1 --2- 172.21.15.53:0/3003857887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23d12f0 0x55bda279e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46ba594640 1 -- 172.21.15.53:0/3003857887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d94d0 msgr2=0x55bda279e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46ba594640 1 --2- 172.21.15.53:0/3003857887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d94d0 0x55bda279e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46ab7fe640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f46a00b4ca0 0x7f46a00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46ba594640 1 -- 172.21.15.53:0/3003857887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23fa1b0 msgr2=0x55bda279dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46ba594640 1 --2- 172.21.15.53:0/3003857887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23fa1b0 0x55bda279dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46ba594640 1 -- 172.21.15.53:0/3003857887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bda2465790 con 0x55bda23d12f0 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46b9d93640 1 --2- 172.21.15.53:0/3003857887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23fa1b0 0x55bda279dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46ab7fe640 1 -- 172.21.15.53:0/562287092 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f46ac106710 con 0x7f46b41081a0 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46ba594640 1 --2- 172.21.15.53:0/3003857887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23d12f0 0x55bda279e220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f46b000e530 tx=0x7f46b0005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1f5137759d1915e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46bad95640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f46a00b4ca0 0x7f46a00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46a8ff9640 1 -- 172.21.15.53:0/3003857887 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b001c070 con 0x55bda23d12f0 2024-08-31T06:16:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46a8ff9640 1 -- 172.21.15.53:0/3003857887 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46b0004230 con 0x55bda23d12f0 2024-08-31T06:16:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.757+0000 7f46a8ff9640 1 -- 172.21.15.53:0/3003857887 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0003810 con 0x55bda23d12f0 2024-08-31T06:16:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.758+0000 7f46c383d740 1 -- 172.21.15.53:0/3003857887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23d12f0 msgr2=0x55bda279e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.758+0000 7f46bad95640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f46a00b4ca0 0x7f46a00b71b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f46ac006010 tx=0x7f46ac009460 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.758+0000 7f46c383d740 1 --2- 172.21.15.53:0/3003857887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23d12f0 0x55bda279e220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f46b000e530 tx=0x7f46b0005f90 comp rx=0 tx=0).stop 2024-08-31T06:16:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 -- 172.21.15.53:0/3003857887 shutdown_connections 2024-08-31T06:16:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 --2- 172.21.15.53:0/3003857887 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d94d0 0x55bda279e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 --2- 172.21.15.53:0/3003857887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23d12f0 0x55bda279e220 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 --2- 172.21.15.53:0/3003857887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23fa1b0 0x55bda279dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 -- 172.21.15.53:0/3003857887 >> 172.21.15.53:0/3003857887 conn(0x55bda23ee300 msgr2=0x55bda279bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 -- 172.21.15.53:0/3003857887 shutdown_connections 2024-08-31T06:16:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 -- 172.21.15.53:0/3003857887 wait complete. 2024-08-31T06:16:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 -- start start 2024-08-31T06:16:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 Processor -- start 2024-08-31T06:16:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27a9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d94d0 0x55bda27a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23fa1b0 0x55bda27af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bda263bab0 con 0x55bda23d94d0 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bda2689680 con 0x55bda23d12f0 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bda27ac460 con 0x55bda23fa1b0 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.759+0000 7f46c383d740 10 client.0 _ll_register_callbacks cb 0x55bda2411a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46b9d93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46ba594640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d94d0 0x55bda27a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46b9d93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:37658/0 (socket says 172.21.15.53:37658) 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46b9d93640 1 -- 172.21.15.53:0/430885893 learned_addr learned my addr 172.21.15.53:0/430885893 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46b9d93640 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23fa1b0 0x55bda27af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46b9d93640 1 -- 172.21.15.53:0/430885893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23fa1b0 msgr2=0x55bda27af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46b9d93640 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23fa1b0 0x55bda27af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46b9d93640 1 -- 172.21.15.53:0/430885893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d94d0 msgr2=0x55bda27a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46b9d93640 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d94d0 0x55bda27a9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46b9d93640 1 -- 172.21.15.53:0/430885893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bda24de620 con 0x55bda23d12f0 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46b9d93640 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27a9990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f46a400bef0 tx=0x7f46a4014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12d8475f1f0a9371 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f469dffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f469dffb640 1 -- 172.21.15.53:0/430885893 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4010ad0 con 0x55bda23d12f0 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f469dffb640 1 -- 172.21.15.53:0/430885893 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f46a4010c70 con 0x55bda23d12f0 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.760+0000 7f46c383d740 1 -- 172.21.15.53:0/430885893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46b0004230 con 0x55bda23d12f0 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f469dffb640 1 -- 172.21.15.53:0/430885893 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f46a4010e70 con 0x55bda23d12f0 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f46c383d740 10 client.28352 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f46c383d740 1 -- 172.21.15.53:0/430885893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55bda27b8550 con 0x55bda23d12f0 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f469dffb640 1 -- 172.21.15.53:0/430885893 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46b0004230 con 0x55bda23d12f0 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f469dffb640 1 -- 172.21.15.53:0/430885893 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f46a4004b10 con 0x55bda23d12f0 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f46c383d740 10 client.28352 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:36.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f46c383d740 10 client.28352 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f46c383d740 20 client.28352 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f46c383d740 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bda23b8d80 0x55bda27bbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f46c383d740 4 client.28352 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f46c383d740 1 -- 172.21.15.53:0/430885893 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bda2714f50 con 0x55bda23b8d80 2024-08-31T06:16:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.761+0000 7f46ba594640 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bda23b8d80 0x55bda27bbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.762+0000 7f469dffb640 10 client.28352 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.762+0000 7f46ba594640 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bda23b8d80 0x55bda27bbac0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffeb576fe7c96f05 server_cookie=77bfd81d490d541b in_seq=0 out_seq=0 2024-08-31T06:16:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f469dffb640 1 -- 172.21.15.53:0/430885893 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bda2714f50 con 0x55bda23b8d80 2024-08-31T06:16:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f469dffb640 10 client.28352 handle_command_reply: tid=0 2024-08-31T06:16:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 1 client.28352 shutdown 2024-08-31T06:16:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 1 -- 172.21.15.53:0/430885893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 msgr2=0x55bda27a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27a9990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f46a400bef0 tx=0x7f46a4014040 comp rx=0 tx=0).stop 2024-08-31T06:16:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 1 -- 172.21.15.53:0/430885893 shutdown_connections 2024-08-31T06:16:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bda23b8d80 0x55bda27bbac0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f469dffb640 0 client.28352 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23fa1b0 0x55bda27af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d94d0 0x55bda27a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 1 --2- 172.21.15.53:0/430885893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27a9990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 1 -- 172.21.15.53:0/430885893 >> 172.21.15.53:0/430885893 conn(0x55bda23ee300 msgr2=0x55bda279ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 1 -- 172.21.15.53:0/430885893 shutdown_connections 2024-08-31T06:16:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 1 -- 172.21.15.53:0/430885893 wait complete. 2024-08-31T06:16:36.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.763+0000 7f46c383d740 20 client.28352 trim_cache size 0 max 16384 2024-08-31T06:16:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.778+0000 7f46c383d740 1 Processor -- start 2024-08-31T06:16:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46c383d740 1 -- start start 2024-08-31T06:16:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46c383d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 0x55bda27a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46c383d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d12f0 0x55bda27ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46c383d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d94d0 0x55bda27a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46c383d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41af570 con 0x55bda23d12f0 2024-08-31T06:16:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46c383d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41b1200 con 0x55bda23d94d0 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46c383d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41afc40 con 0x55bda23b8d80 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46ba594640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d12f0 0x55bda27ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46b9d93640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d94d0 0x55bda27a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46ba594640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d12f0 0x55bda27ab3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42952/0 (socket says 172.21.15.53:42952) 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46ba594640 1 -- 172.21.15.53:0/3217679918 learned_addr learned my addr 172.21.15.53:0/3217679918 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46b9d93640 1 --2- 172.21.15.53:0/3217679918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 0x55bda27a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46b9d93640 1 -- 172.21.15.53:0/3217679918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 msgr2=0x55bda27a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46b9d93640 1 --2- 172.21.15.53:0/3217679918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 0x55bda27a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46b9d93640 1 -- 172.21.15.53:0/3217679918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d12f0 msgr2=0x55bda27ab3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46b9d93640 1 --2- 172.21.15.53:0/3217679918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d12f0 0x55bda27ab3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46b9d93640 1 -- 172.21.15.53:0/3217679918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bda279c4d0 con 0x55bda23d94d0 2024-08-31T06:16:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.779+0000 7f46ba594640 1 --2- 172.21.15.53:0/3217679918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d12f0 0x55bda27ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.780+0000 7f46b9d93640 1 --2- 172.21.15.53:0/3217679918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d94d0 0x55bda27a8ff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f46a400b620 tx=0x7f46a400bb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cba60e2d5744c309 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.780+0000 7f469ffff640 1 -- 172.21.15.53:0/3217679918 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4012b50 con 0x55bda23d94d0 2024-08-31T06:16:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.780+0000 7f469ffff640 1 -- 172.21.15.53:0/3217679918 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46a4010c30 con 0x55bda23d94d0 2024-08-31T06:16:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.780+0000 7f469ffff640 1 -- 172.21.15.53:0/3217679918 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4004b50 con 0x55bda23d94d0 2024-08-31T06:16:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 -- 172.21.15.53:0/3217679918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d94d0 msgr2=0x55bda27a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 --2- 172.21.15.53:0/3217679918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d94d0 0x55bda27a8ff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f46a400b620 tx=0x7f46a400bb70 comp rx=0 tx=0).stop 2024-08-31T06:16:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 -- 172.21.15.53:0/3217679918 shutdown_connections 2024-08-31T06:16:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 --2- 172.21.15.53:0/3217679918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d94d0 0x55bda27a8ff0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 --2- 172.21.15.53:0/3217679918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d12f0 0x55bda27ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 --2- 172.21.15.53:0/3217679918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 0x55bda27a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 -- 172.21.15.53:0/3217679918 >> 172.21.15.53:0/3217679918 conn(0x55bda23ee300 msgr2=0x55bda27aaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 -- 172.21.15.53:0/3217679918 shutdown_connections 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 -- 172.21.15.53:0/3217679918 wait complete. 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 -- start start 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 Processor -- start 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 0x55bda27b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d94d0 0x55bda27b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.781+0000 7f46c383d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41b0a70 con 0x55bda23d94d0 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46c383d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41b0310 con 0x55bda23d12f0 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46c383d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41ad570 con 0x55bda23b8d80 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46c383d740 10 client.0 _ll_register_callbacks cb 0x7f46a400bdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46b9d93640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d94d0 0x55bda27b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46b9d93640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 0x55bda27b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46ba594640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46b9d93640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 0x55bda27b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:33530/0 (socket says 172.21.15.53:33530) 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46ba594640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:37674/0 (socket says 172.21.15.53:37674) 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46b9d93640 1 -- 172.21.15.53:0/2348518683 learned_addr learned my addr 172.21.15.53:0/2348518683 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46ba594640 1 -- 172.21.15.53:0/2348518683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 msgr2=0x55bda27b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46ba594640 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 0x55bda27b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46ba594640 1 -- 172.21.15.53:0/2348518683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d94d0 msgr2=0x55bda27b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46ba594640 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d94d0 0x55bda27b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46ba594640 1 -- 172.21.15.53:0/2348518683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bda27b6030 con 0x55bda23d12f0 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46b9d93640 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 0x55bda27b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f46ba594640 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27b1ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f46b0011020 tx=0x7f46b000df40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b074c488c268a6d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f469dffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f469dffb640 1 -- 172.21.15.53:0/2348518683 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b001c040 con 0x55bda23d12f0 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.782+0000 7f469dffb640 1 -- 172.21.15.53:0/2348518683 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f46b0005550 con 0x55bda23d12f0 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f46c383d740 1 -- 172.21.15.53:0/2348518683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46a4010c30 con 0x55bda23d12f0 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f469dffb640 1 -- 172.21.15.53:0/2348518683 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f46b0005c50 con 0x55bda23d12f0 2024-08-31T06:16:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f46c383d740 10 client.28358 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f46c383d740 1 -- 172.21.15.53:0/2348518683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55bda2825f60 con 0x55bda23d12f0 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f469dffb640 1 -- 172.21.15.53:0/2348518683 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46a4010c30 con 0x55bda23d12f0 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f469dffb640 1 -- 172.21.15.53:0/2348518683 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f46b000b040 con 0x55bda23d12f0 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f46c383d740 10 client.28358 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f46c383d740 10 client.28358 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f46c383d740 20 client.28358 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f46c383d740 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bda23fa1b0 0x55bda2828400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f46c383d740 4 client.28358 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f46c383d740 1 -- 172.21.15.53:0/2348518683 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bda27109f0 con 0x55bda23fa1b0 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.783+0000 7f46b9d93640 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bda23fa1b0 0x55bda2828400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.784+0000 7f469dffb640 10 client.28358 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.784+0000 7f46b9d93640 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bda23fa1b0 0x55bda2828400 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3f6eeb5e18beefe server_cookie=c02f6b2e5190daeb in_seq=0 out_seq=0 2024-08-31T06:16:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f469dffb640 1 -- 172.21.15.53:0/2348518683 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bda27109f0 con 0x55bda23fa1b0 2024-08-31T06:16:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f469dffb640 10 client.28358 handle_command_reply: tid=0 2024-08-31T06:16:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f46c383d740 1 client.28358 shutdown 2024-08-31T06:16:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f46c383d740 1 -- 172.21.15.53:0/2348518683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 msgr2=0x55bda27b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f46c383d740 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27b1ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f46b0011020 tx=0x7f46b000df40 comp rx=0 tx=0).stop 2024-08-31T06:16:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f46c383d740 1 -- 172.21.15.53:0/2348518683 shutdown_connections 2024-08-31T06:16:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f46c383d740 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bda23fa1b0 0x55bda2828400 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f46c383d740 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda23d94d0 0x55bda27b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f469dffb640 0 client.28358 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f46c383d740 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bda23d12f0 0x55bda27b1ab0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f46c383d740 1 --2- 172.21.15.53:0/2348518683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bda23b8d80 0x55bda27b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f46c383d740 1 -- 172.21.15.53:0/2348518683 >> 172.21.15.53:0/2348518683 conn(0x55bda23ee300 msgr2=0x55bda279f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f46c383d740 1 -- 172.21.15.53:0/2348518683 shutdown_connections 2024-08-31T06:16:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.809+0000 7f46c383d740 1 -- 172.21.15.53:0/2348518683 wait complete. 2024-08-31T06:16:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46c383d740 20 client.28358 trim_cache size 0 max 16384 2024-08-31T06:16:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:16:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:16:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:16:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:16:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 -- 172.21.15.53:0/562287092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f46a00b4ca0 msgr2=0x7f46a00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f46a00b4ca0 0x7f46a00b71b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f46ac006010 tx=0x7f46ac009460 comp rx=0 tx=0).stop 2024-08-31T06:16:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 -- 172.21.15.53:0/562287092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46b41081a0 msgr2=0x7f46b419fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46b41081a0 0x7f46b419fa10 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f46ac005e30 tx=0x7f46ac0093d0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 -- 172.21.15.53:0/562287092 shutdown_connections 2024-08-31T06:16:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f46a00b4ca0 0x7f46a00b71b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46b41081a0 0x7f46b419fa10 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b4107850 0x7f46b419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 --2- 172.21.15.53:0/562287092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b4101f20 0x7f46b419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 -- 172.21.15.53:0/562287092 >> 172.21.15.53:0/562287092 conn(0x7f46b4079c30 msgr2=0x7f46b4105b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 -- 172.21.15.53:0/562287092 shutdown_connections 2024-08-31T06:16:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:36.810+0000 7f46bc7f8640 1 -- 172.21.15.53:0/562287092 wait complete. 2024-08-31T06:16:36.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 177677 1.34 MB/sec execute 506 sec latency 4738.467 ms 2024-08-31T06:16:37.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:37 smithi153 ceph-mon[22320]: pgmap v685: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 946 KiB/s wr, 87 op/s 2024-08-31T06:16:37.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:37 smithi053 ceph-mon[18924]: pgmap v685: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 946 KiB/s wr, 87 op/s 2024-08-31T06:16:37.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 177945 1.33 MB/sec execute 507 sec latency 17.520 ms 2024-08-31T06:16:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:37 smithi130 ceph-mon[22266]: pgmap v685: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 946 KiB/s wr, 87 op/s 2024-08-31T06:16:38.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 178415 1.34 MB/sec execute 508 sec latency 15.422 ms 2024-08-31T06:16:39.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:39 smithi153 ceph-mon[22320]: pgmap v686: 97 pgs: 97 active+clean; 106 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 775 KiB/s wr, 76 op/s 2024-08-31T06:16:39.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:39 smithi053 ceph-mon[18924]: pgmap v686: 97 pgs: 97 active+clean; 106 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 775 KiB/s wr, 76 op/s 2024-08-31T06:16:39.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 178902 1.34 MB/sec execute 509 sec latency 21.606 ms 2024-08-31T06:16:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:39 smithi130 ceph-mon[22266]: pgmap v686: 97 pgs: 97 active+clean; 106 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 775 KiB/s wr, 76 op/s 2024-08-31T06:16:40.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 179443 1.34 MB/sec execute 510 sec latency 20.652 ms 2024-08-31T06:16:41.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:41 smithi153 ceph-mon[22320]: pgmap v687: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 840 KiB/s wr, 87 op/s 2024-08-31T06:16:41.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:41 smithi053 ceph-mon[18924]: pgmap v687: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 840 KiB/s wr, 87 op/s 2024-08-31T06:16:41.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 179926 1.34 MB/sec execute 511 sec latency 23.258 ms 2024-08-31T06:16:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:41 smithi130 ceph-mon[22266]: pgmap v687: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 840 KiB/s wr, 87 op/s 2024-08-31T06:16:42.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 180645 1.35 MB/sec execute 512 sec latency 21.339 ms 2024-08-31T06:16:43.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:43 smithi153 ceph-mon[22320]: pgmap v688: 97 pgs: 97 active+clean; 102 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 596 KiB/s wr, 73 op/s 2024-08-31T06:16:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:43 smithi053 ceph-mon[18924]: pgmap v688: 97 pgs: 97 active+clean; 102 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 596 KiB/s wr, 73 op/s 2024-08-31T06:16:43.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 180982 1.35 MB/sec execute 513 sec latency 94.691 ms 2024-08-31T06:16:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:43 smithi130 ceph-mon[22266]: pgmap v688: 97 pgs: 97 active+clean; 102 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 596 KiB/s wr, 73 op/s 2024-08-31T06:16:44.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 180982 1.35 MB/sec execute 514 sec latency 1094.733 ms 2024-08-31T06:16:45.231 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:16:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:45.903 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:45 smithi053 ceph-mon[18924]: pgmap v689: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 744 KiB/s wr, 96 op/s 2024-08-31T06:16:45.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:45 smithi153 ceph-mon[22320]: pgmap v689: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 744 KiB/s wr, 96 op/s 2024-08-31T06:16:45.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.994+0000 7fec0ae34640 1 -- 172.21.15.53:0/2958940340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec04109240 msgr2=0x7fec04109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:45.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.994+0000 7fec0ae34640 1 --2- 172.21.15.53:0/2958940340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec04109240 0x7fec04109650 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7febf0009900 tx=0x7febf002a410 comp rx=0 tx=0).stop 2024-08-31T06:16:45.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.994+0000 7fec0ae34640 1 -- 172.21.15.53:0/2958940340 shutdown_connections 2024-08-31T06:16:45.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.994+0000 7fec0ae34640 1 --2- 172.21.15.53:0/2958940340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec04109b90 0x7fec041103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:45.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.994+0000 7fec0ae34640 1 --2- 172.21.15.53:0/2958940340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec04109240 0x7fec04109650 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:45.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.994+0000 7fec0ae34640 1 --2- 172.21.15.53:0/2958940340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec04103900 0x7fec04103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:45.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.994+0000 7fec0ae34640 1 -- 172.21.15.53:0/2958940340 >> 172.21.15.53:0/2958940340 conn(0x7fec0407b5f0 msgr2=0x7fec0407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:45.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.994+0000 7fec0ae34640 1 -- 172.21.15.53:0/2958940340 shutdown_connections 2024-08-31T06:16:45.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.994+0000 7fec0ae34640 1 -- 172.21.15.53:0/2958940340 wait complete. 2024-08-31T06:16:45.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec0ae34640 1 Processor -- start 2024-08-31T06:16:45.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec0ae34640 1 -- start start 2024-08-31T06:16:45.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 180982 1.35 MB/sec execute 515 sec latency 2094.765 ms 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec0ae34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec04103900 0x7fec0419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec0ae34640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec04109240 0x7fec0419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec0ae34640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec04109b90 0x7fec0419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec0ae34640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fec041137a0 con 0x7fec04103900 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec0ae34640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fec04113620 con 0x7fec04109b90 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec0ae34640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fec04113920 con 0x7fec04109240 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec08bd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec04103900 0x7fec0419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec08bd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec04103900 0x7fec0419a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59346/0 (socket says 172.21.15.53:59346) 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec08bd0640 1 -- 172.21.15.53:0/1443847554 learned_addr learned my addr 172.21.15.53:0/1443847554 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.995+0000 7fec093d1640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec04109b90 0x7fec0419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec03fff640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec04109240 0x7fec0419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec08bd0640 1 -- 172.21.15.53:0/1443847554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec04109240 msgr2=0x7fec0419a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec08bd0640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec04109240 0x7fec0419a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec08bd0640 1 -- 172.21.15.53:0/1443847554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec04109b90 msgr2=0x7fec0419fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec08bd0640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec04109b90 0x7fec0419fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec08bd0640 1 -- 172.21.15.53:0/1443847554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec041a0260 con 0x7fec04103900 2024-08-31T06:16:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec093d1640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec04109b90 0x7fec0419fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec08bd0640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec04103900 0x7fec0419a2f0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7febf800b4a0 tx=0x7febf800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec01ffb640 1 -- 172.21.15.53:0/1443847554 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8014070 con 0x7fec04103900 2024-08-31T06:16:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec01ffb640 1 -- 172.21.15.53:0/1443847554 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febf8010aa0 con 0x7fec04103900 2024-08-31T06:16:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec0ae34640 1 -- 172.21.15.53:0/1443847554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec041a0550 con 0x7fec04103900 2024-08-31T06:16:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec01ffb640 1 -- 172.21.15.53:0/1443847554 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8017b70 con 0x7fec04103900 2024-08-31T06:16:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.996+0000 7fec0ae34640 1 -- 172.21.15.53:0/1443847554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec04075390 con 0x7fec04103900 2024-08-31T06:16:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.999+0000 7fec01ffb640 1 -- 172.21.15.53:0/1443847554 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7febf8017070 con 0x7fec04103900 2024-08-31T06:16:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.999+0000 7fec113a9740 1 Processor -- start 2024-08-31T06:16:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.999+0000 7fec113a9740 1 -- start start 2024-08-31T06:16:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.999+0000 7fec113a9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 0x560aa82d4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.999+0000 7fec113a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f061b0 0x560aa82d4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.999+0000 7fec113a9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82d4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.999+0000 7fec113a9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560aa824b630 con 0x560aa7f0e390 2024-08-31T06:16:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.999+0000 7fec113a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560aa823abc0 con 0x560aa7f061b0 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:45.999+0000 7fec113a9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560aa823eb70 con 0x560aa7f2f070 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec03fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82d4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec03fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82d4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59350/0 (socket says 172.21.15.53:59350) 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec03fff640 1 -- 172.21.15.53:0/3478090929 learned_addr learned my addr 172.21.15.53:0/3478090929 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec093d1640 1 --2- 172.21.15.53:0/3478090929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 0x560aa82d4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec08bd0640 1 --2- 172.21.15.53:0/3478090929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f061b0 0x560aa82d4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec01ffb640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febf40b4d20 0x7febf40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec03fff640 1 -- 172.21.15.53:0/3478090929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 msgr2=0x560aa82d4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec03fff640 1 --2- 172.21.15.53:0/3478090929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 0x560aa82d4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec03fff640 1 -- 172.21.15.53:0/3478090929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f061b0 msgr2=0x560aa82d4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec03fff640 1 --2- 172.21.15.53:0/3478090929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f061b0 0x560aa82d4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec03fff640 1 -- 172.21.15.53:0/3478090929 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa7f9a650 con 0x560aa7f0e390 2024-08-31T06:16:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec093d1640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febf40b4d20 0x7febf40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec01ffb640 1 -- 172.21.15.53:0/1443847554 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7febf80e4b80 con 0x7fec04103900 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7fec03fff640 1 --2- 172.21.15.53:0/3478090929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82d4d80 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7febf0000c00 tx=0x7febf0031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47912856779b3c83 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7febeeffd640 1 -- 172.21.15.53:0/3478090929 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0035030 con 0x560aa7f0e390 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7febeeffd640 1 -- 172.21.15.53:0/3478090929 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febf00044c0 con 0x560aa7f0e390 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.000+0000 7febeeffd640 1 -- 172.21.15.53:0/3478090929 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0003ae0 con 0x560aa7f0e390 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.001+0000 7fec113a9740 1 -- 172.21.15.53:0/3478090929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 msgr2=0x560aa82d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.001+0000 7fec093d1640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febf40b4d20 0x7febf40b7230 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7febfc00a5a0 tx=0x7febfc00e040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.001+0000 7fec113a9740 1 --2- 172.21.15.53:0/3478090929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82d4d80 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7febf0000c00 tx=0x7febf0031dc0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.001+0000 7fec113a9740 1 -- 172.21.15.53:0/3478090929 shutdown_connections 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.001+0000 7fec113a9740 1 --2- 172.21.15.53:0/3478090929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82d4d80 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.001+0000 7fec113a9740 1 --2- 172.21.15.53:0/3478090929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f061b0 0x560aa82d4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.001+0000 7fec113a9740 1 --2- 172.21.15.53:0/3478090929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 0x560aa82d4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.001+0000 7fec113a9740 1 -- 172.21.15.53:0/3478090929 >> 172.21.15.53:0/3478090929 conn(0x560aa7f23460 msgr2=0x560aa82d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.001+0000 7fec113a9740 1 -- 172.21.15.53:0/3478090929 shutdown_connections 2024-08-31T06:16:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.001+0000 7fec113a9740 1 -- 172.21.15.53:0/3478090929 wait complete. 2024-08-31T06:16:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.002+0000 7fec113a9740 1 -- start start 2024-08-31T06:16:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.002+0000 7fec113a9740 1 Processor -- start 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.002+0000 7fec113a9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.002+0000 7fec113a9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f0e390 0x560aa82dff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec113a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f2f070 0x560aa82ebd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec113a9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560aa809d700 con 0x560aa7f061b0 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec113a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560aa81c1700 con 0x560aa7f2f070 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec113a9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560aa82e2a80 con 0x560aa7f0e390 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec113a9740 10 client.0 _ll_register_callbacks cb 0x560aa81f0dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec08bd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec08bd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59352/0 (socket says 172.21.15.53:59352) 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec08bd0640 1 -- 172.21.15.53:0/1544059847 learned_addr learned my addr 172.21.15.53:0/1544059847 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec03fff640 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f0e390 0x560aa82dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec093d1640 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f2f070 0x560aa82ebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec08bd0640 1 -- 172.21.15.53:0/1544059847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f0e390 msgr2=0x560aa82dff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec08bd0640 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f0e390 0x560aa82dff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec08bd0640 1 -- 172.21.15.53:0/1544059847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f2f070 msgr2=0x560aa82ebd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec08bd0640 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f2f070 0x560aa82ebd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec08bd0640 1 -- 172.21.15.53:0/1544059847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa81fa8b0 con 0x560aa7f061b0 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec08bd0640 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df9c0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7febf800b470 tx=0x7febf8017360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8b00dd8da15e78 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7febe3fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7febe3fff640 1 -- 172.21.15.53:0/1544059847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf801e070 con 0x560aa7f061b0 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7febe3fff640 1 -- 172.21.15.53:0/1544059847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7febf80e2530 con 0x560aa7f061b0 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.003+0000 7fec113a9740 1 -- 172.21.15.53:0/1544059847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560aa824d580 con 0x560aa7f061b0 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7febe3fff640 1 -- 172.21.15.53:0/1544059847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7febf80e8030 con 0x560aa7f061b0 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7fec113a9740 10 client.19269 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7fec113a9740 1 -- 172.21.15.53:0/1544059847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560aa82ee790 con 0x560aa7f061b0 2024-08-31T06:16:46.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7febe3fff640 1 -- 172.21.15.53:0/1544059847 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560aa824d580 con 0x560aa7f061b0 2024-08-31T06:16:46.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7febe3fff640 1 -- 172.21.15.53:0/1544059847 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7febf80a74e0 con 0x560aa7f061b0 2024-08-31T06:16:46.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7fec113a9740 10 client.19269 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:46.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7fec113a9740 10 client.19269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:46.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7fec113a9740 20 client.19269 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:46.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7fec113a9740 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa7eed9f0 0x560aa82f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7fec113a9740 4 client.19269 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:46.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7fec113a9740 1 -- 172.21.15.53:0/1544059847 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560aa8249020 con 0x560aa7eed9f0 2024-08-31T06:16:46.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.004+0000 7fec03fff640 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa7eed9f0 0x560aa82f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.005+0000 7fec03fff640 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa7eed9f0 0x560aa82f1ce0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f313ab23544b0bf server_cookie=56e479f08872b0bf in_seq=0 out_seq=0 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.005+0000 7febe3fff640 10 client.19269 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7febe3fff640 1 -- 172.21.15.53:0/1544059847 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560aa8249020 con 0x560aa7eed9f0 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7febe3fff640 10 client.19269 handle_command_reply: tid=0 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 1 client.19269 shutdown 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 1 -- 172.21.15.53:0/1544059847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 msgr2=0x560aa82df9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df9c0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7febf800b470 tx=0x7febf8017360 comp rx=0 tx=0).stop 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 1 -- 172.21.15.53:0/1544059847 shutdown_connections 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa7eed9f0 0x560aa82f1ce0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f2f070 0x560aa82ebd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f0e390 0x560aa82dff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 1 --2- 172.21.15.53:0/1544059847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df9c0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7febe3fff640 0 client.19269 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 1 -- 172.21.15.53:0/1544059847 >> 172.21.15.53:0/1544059847 conn(0x560aa7f23460 msgr2=0x560aa82d7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:46.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 1 -- 172.21.15.53:0/1544059847 shutdown_connections 2024-08-31T06:16:46.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 1 -- 172.21.15.53:0/1544059847 wait complete. 2024-08-31T06:16:46.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.006+0000 7fec113a9740 20 client.19269 trim_cache size 0 max 16384 2024-08-31T06:16:46.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec113a9740 1 Processor -- start 2024-08-31T06:16:46.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec113a9740 1 -- start start 2024-08-31T06:16:46.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec113a9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec113a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f0e390 0x560aa82e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec113a9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 0x560aa82ebc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec113a9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fec041b1770 con 0x560aa7f061b0 2024-08-31T06:16:46.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec113a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fec041b3400 con 0x560aa7f0e390 2024-08-31T06:16:46.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec113a9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fec041b1e40 con 0x560aa7f2f070 2024-08-31T06:16:46.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec08bd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec08bd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59354/0 (socket says 172.21.15.53:59354) 2024-08-31T06:16:46.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec08bd0640 1 -- 172.21.15.53:0/816904523 learned_addr learned my addr 172.21.15.53:0/816904523 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:46.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec03fff640 1 --2- 172.21.15.53:0/816904523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f0e390 0x560aa82e15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec08bd0640 1 -- 172.21.15.53:0/816904523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 msgr2=0x560aa82ebc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:46.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec08bd0640 1 --2- 172.21.15.53:0/816904523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 0x560aa82ebc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec08bd0640 1 -- 172.21.15.53:0/816904523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f0e390 msgr2=0x560aa82e15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.024+0000 7fec08bd0640 1 --2- 172.21.15.53:0/816904523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f0e390 0x560aa82e15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.025+0000 7fec08bd0640 1 -- 172.21.15.53:0/816904523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa82de920 con 0x560aa7f061b0 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.025+0000 7fec03fff640 1 --2- 172.21.15.53:0/816904523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f0e390 0x560aa82e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.025+0000 7fec08bd0640 1 --2- 172.21.15.53:0/816904523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df930 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7febf80ab1e0 tx=0x7febf80aade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6c6727a62009d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.025+0000 7febee7fc640 1 -- 172.21.15.53:0/816904523 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf801e070 con 0x560aa7f061b0 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.025+0000 7febee7fc640 1 -- 172.21.15.53:0/816904523 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febf80ab250 con 0x560aa7f061b0 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.025+0000 7febee7fc640 1 -- 172.21.15.53:0/816904523 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf80a74e0 con 0x560aa7f061b0 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.026+0000 7fec113a9740 1 -- 172.21.15.53:0/816904523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 msgr2=0x560aa82df930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.026+0000 7fec113a9740 1 --2- 172.21.15.53:0/816904523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df930 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7febf80ab1e0 tx=0x7febf80aade0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.026+0000 7fec113a9740 1 -- 172.21.15.53:0/816904523 shutdown_connections 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.026+0000 7fec113a9740 1 --2- 172.21.15.53:0/816904523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 0x560aa82ebc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.026+0000 7fec113a9740 1 --2- 172.21.15.53:0/816904523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f0e390 0x560aa82e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.026+0000 7fec113a9740 1 --2- 172.21.15.53:0/816904523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f061b0 0x560aa82df930 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.026+0000 7fec113a9740 1 -- 172.21.15.53:0/816904523 >> 172.21.15.53:0/816904523 conn(0x560aa7f23460 msgr2=0x560aa82e0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.026+0000 7fec113a9740 1 -- 172.21.15.53:0/816904523 shutdown_connections 2024-08-31T06:16:46.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.026+0000 7fec113a9740 1 -- 172.21.15.53:0/816904523 wait complete. 2024-08-31T06:16:46.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.026+0000 7fec113a9740 1 -- start start 2024-08-31T06:16:46.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.026+0000 7fec113a9740 1 Processor -- start 2024-08-31T06:16:46.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec113a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f061b0 0x560aa82e4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec113a9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec113a9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 0x560aa8355790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec113a9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fec041b2c70 con 0x560aa7f0e390 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec113a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fec041b2510 con 0x560aa7f061b0 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec113a9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fec041af770 con 0x560aa7f2f070 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec113a9740 10 client.0 _ll_register_callbacks cb 0x7febf8017550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec03fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec03fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82e4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59360/0 (socket says 172.21.15.53:59360) 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec03fff640 1 -- 172.21.15.53:0/3801825592 learned_addr learned my addr 172.21.15.53:0/3801825592 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec08bd0640 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f061b0 0x560aa82e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec093d1640 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 0x560aa8355790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec03fff640 1 -- 172.21.15.53:0/3801825592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 msgr2=0x560aa8355790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec03fff640 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 0x560aa8355790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec03fff640 1 -- 172.21.15.53:0/3801825592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f061b0 msgr2=0x560aa82e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec03fff640 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f061b0 0x560aa82e4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec03fff640 1 -- 172.21.15.53:0/3801825592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa8355e00 con 0x560aa7f0e390 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7fec03fff640 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82e4c70 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7febf002a930 tx=0x7febf0031500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8578ba4a5c3c0bd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7febe3fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.027+0000 7febe3fff640 1 -- 172.21.15.53:0/3801825592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0035040 con 0x560aa7f0e390 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7febe3fff640 1 -- 172.21.15.53:0/3801825592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7febf003c440 con 0x560aa7f0e390 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7fec113a9740 1 -- 172.21.15.53:0/3801825592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf80ab250 con 0x560aa7f0e390 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7febe3fff640 1 -- 172.21.15.53:0/3801825592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7febf003c640 con 0x560aa7f0e390 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7fec113a9740 10 client.19275 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7fec113a9740 1 -- 172.21.15.53:0/3801825592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560aa835d0f0 con 0x560aa7f0e390 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7febe3fff640 1 -- 172.21.15.53:0/3801825592 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febf80ab250 con 0x560aa7f0e390 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7febe3fff640 1 -- 172.21.15.53:0/3801825592 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7febf004f8e0 con 0x560aa7f0e390 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7fec113a9740 10 client.19275 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7fec113a9740 10 client.19275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7fec113a9740 20 client.19275 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7fec113a9740 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa7ec2da0 0x560aa835f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7fec113a9740 4 client.19275 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.028+0000 7fec113a9740 1 -- 172.21.15.53:0/3801825592 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560aa8246760 con 0x560aa7ec2da0 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.029+0000 7fec08bd0640 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa7ec2da0 0x560aa835f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.029+0000 7febe3fff640 10 client.19275 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.029+0000 7fec08bd0640 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa7ec2da0 0x560aa835f530 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0826737c0874707 server_cookie=22e7e776c27b32db in_seq=0 out_seq=0 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.029+0000 7febe3fff640 1 -- 172.21.15.53:0/3801825592 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x560aa8246760 con 0x560aa7ec2da0 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.029+0000 7febe3fff640 10 client.19275 handle_command_reply: tid=0 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.029+0000 7fec113a9740 1 client.19275 shutdown 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.029+0000 7fec113a9740 1 -- 172.21.15.53:0/3801825592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 msgr2=0x560aa82e4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.029+0000 7fec113a9740 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82e4c70 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7febf002a930 tx=0x7febf0031500 comp rx=0 tx=0).stop 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec113a9740 1 -- 172.21.15.53:0/3801825592 shutdown_connections 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec113a9740 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560aa7ec2da0 0x560aa835f530 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec113a9740 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560aa7f2f070 0x560aa8355790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec113a9740 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa7f0e390 0x560aa82e4c70 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec113a9740 1 --2- 172.21.15.53:0/3801825592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560aa7f061b0 0x560aa82e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7febe3fff640 0 client.19275 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec113a9740 1 -- 172.21.15.53:0/3801825592 >> 172.21.15.53:0/3801825592 conn(0x560aa7f23460 msgr2=0x560aa82e0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec113a9740 1 -- 172.21.15.53:0/3801825592 shutdown_connections 2024-08-31T06:16:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec113a9740 1 -- 172.21.15.53:0/3801825592 wait complete. 2024-08-31T06:16:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec113a9740 20 client.19275 trim_cache size 0 max 16384 2024-08-31T06:16:46.037 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:16:46.037 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:16:46.037 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:16:46.037 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:16:46.037 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.040 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:16:46.041 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:16:46.042 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:46.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:46.046 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:46.046 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:46.046 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:16:46.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec0ae34640 1 -- 172.21.15.53:0/1443847554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febf40b4d20 msgr2=0x7febf40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:46.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec0ae34640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febf40b4d20 0x7febf40b7230 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7febfc00a5a0 tx=0x7febfc00e040 comp rx=0 tx=0).stop 2024-08-31T06:16:46.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec0ae34640 1 -- 172.21.15.53:0/1443847554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec04103900 msgr2=0x7fec0419a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:46.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.030+0000 7fec0ae34640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec04103900 0x7fec0419a2f0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7febf800b4a0 tx=0x7febf800b960 comp rx=0 tx=0).stop 2024-08-31T06:16:46.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.031+0000 7fec0ae34640 1 -- 172.21.15.53:0/1443847554 shutdown_connections 2024-08-31T06:16:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.031+0000 7fec0ae34640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7febf40b4d20 0x7febf40b7230 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.031+0000 7fec0ae34640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec04109b90 0x7fec0419fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.031+0000 7fec0ae34640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec04109240 0x7fec0419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.031+0000 7fec0ae34640 1 --2- 172.21.15.53:0/1443847554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec04103900 0x7fec0419a2f0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.031+0000 7fec0ae34640 1 -- 172.21.15.53:0/1443847554 >> 172.21.15.53:0/1443847554 conn(0x7fec0407b5f0 msgr2=0x7fec04107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.031+0000 7fec0ae34640 1 -- 172.21.15.53:0/1443847554 shutdown_connections 2024-08-31T06:16:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:46.031+0000 7fec0ae34640 1 -- 172.21.15.53:0/1443847554 wait complete. 2024-08-31T06:16:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:45 smithi130 ceph-mon[22266]: pgmap v689: 97 pgs: 97 active+clean; 103 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 744 KiB/s wr, 96 op/s 2024-08-31T06:16:46.835 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:16:46.836 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:16:46.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 181049 1.35 MB/sec execute 516 sec latency 2345.869 ms 2024-08-31T06:16:47.088 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:47.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.558+0000 7fa8c65c0640 1 -- 172.21.15.53:0/4123570297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8c0103940 msgr2=0x7fa8c0103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.558+0000 7fa8c65c0640 1 --2- 172.21.15.53:0/4123570297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8c0103940 0x7fa8c0103d50 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009900 tx=0x7fa8b002a410 comp rx=0 tx=0).stop 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.558+0000 7fa8c65c0640 1 -- 172.21.15.53:0/4123570297 shutdown_connections 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.558+0000 7fa8c65c0640 1 --2- 172.21.15.53:0/4123570297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8c0109bd0 0x7fa8c0110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.558+0000 7fa8c65c0640 1 --2- 172.21.15.53:0/4123570297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8c0109280 0x7fa8c0109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.558+0000 7fa8c65c0640 1 --2- 172.21.15.53:0/4123570297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8c0103940 0x7fa8c0103d50 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.558+0000 7fa8c65c0640 1 -- 172.21.15.53:0/4123570297 >> 172.21.15.53:0/4123570297 conn(0x7fa8c00ff3d0 msgr2=0x7fa8c0101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.558+0000 7fa8c65c0640 1 -- 172.21.15.53:0/4123570297 shutdown_connections 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.558+0000 7fa8c65c0640 1 -- 172.21.15.53:0/4123570297 wait complete. 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8c65c0640 1 Processor -- start 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8c65c0640 1 -- start start 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8c65c0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8c0103940 0x7fa8c00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8c65c0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8c0109280 0x7fa8c00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8c65c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8c0109bd0 0x7fa8c0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8c65c0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c0113740 con 0x7fa8c0109bd0 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8c65c0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01135c0 con 0x7fa8c0103940 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8c65c0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01138c0 con 0x7fa8c0109280 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8c4b5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8c0109bd0 0x7fa8c0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8c4b5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8c0109bd0 0x7fa8c0075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59368/0 (socket says 172.21.15.53:59368) 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8c4b5d640 1 -- 172.21.15.53:0/1747431667 learned_addr learned my addr 172.21.15.53:0/1747431667 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.559+0000 7fa8bffff640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8c0103940 0x7fa8c00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8b7fff640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8c0109280 0x7fa8c00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8c4b5d640 1 -- 172.21.15.53:0/1747431667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8c0109280 msgr2=0x7fa8c00759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8c4b5d640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8c0109280 0x7fa8c00759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8c4b5d640 1 -- 172.21.15.53:0/1747431667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8c0103940 msgr2=0x7fa8c00754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8c4b5d640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8c0103940 0x7fa8c00754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8c4b5d640 1 -- 172.21.15.53:0/1747431667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c01a8470 con 0x7fa8c0109bd0 2024-08-31T06:16:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8c4b5d640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8c0109bd0 0x7fa8c0075f30 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800cad0 tx=0x7fa8b800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8bdffb640 1 -- 172.21.15.53:0/1747431667 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800ae20 con 0x7fa8c0109bd0 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8bdffb640 1 -- 172.21.15.53:0/1747431667 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8b8005020 con 0x7fa8c0109bd0 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8c65c0640 1 -- 172.21.15.53:0/1747431667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c01a8760 con 0x7fa8c0109bd0 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8bdffb640 1 -- 172.21.15.53:0/1747431667 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800f6b0 con 0x7fa8c0109bd0 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.560+0000 7fa8c65c0640 1 -- 172.21.15.53:0/1747431667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c01a8cf0 con 0x7fa8c0109bd0 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.561+0000 7fa8c65c0640 1 -- 172.21.15.53:0/1747431667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c0103d50 con 0x7fa8c0109bd0 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.563+0000 7fa8bdffb640 1 -- 172.21.15.53:0/1747431667 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa8b80051d0 con 0x7fa8c0109bd0 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.564+0000 7fa8bdffb640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8ac0b4d20 0x7fa8ac0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.564+0000 7fa8bffff640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8ac0b4d20 0x7fa8ac0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.564+0000 7fa8bdffb640 1 -- 172.21.15.53:0/1747431667 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fa8b80e5920 con 0x7fa8c0109bd0 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.564+0000 7fa8bffff640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8ac0b4d20 0x7fa8ac0b7230 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0076f00 tx=0x7fa8b00058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.567+0000 7fa8bdffb640 1 -- 172.21.15.53:0/1747431667 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa8b8014030 con 0x7fa8c0109bd0 2024-08-31T06:16:47.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:47 smithi053 ceph-mon[18924]: pgmap v690: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 906 KiB/s wr, 94 op/s 2024-08-31T06:16:47.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.790+0000 7fa8c65c0640 1 -- 172.21.15.53:0/1747431667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8c00767b0 con 0x7fa8c0109bd0 2024-08-31T06:16:47.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.791+0000 7fa8bdffb640 1 -- 172.21.15.53:0/1747431667 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+11997 (secure 0 0 0) 0x7fa8c00767b0 con 0x7fa8c0109bd0 2024-08-31T06:16:47.795 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:16:47.795 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":51,"btime":"2024-08-31T06:16:24:637521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":51,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:16:23.799987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:16:47.795 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 51 2024-08-31T06:16:47.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 -- 172.21.15.53:0/1747431667 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8ac0b4d20 msgr2=0x7fa8ac0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:47.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8ac0b4d20 0x7fa8ac0b7230 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0076f00 tx=0x7fa8b00058d0 comp rx=0 tx=0).stop 2024-08-31T06:16:47.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 -- 172.21.15.53:0/1747431667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8c0109bd0 msgr2=0x7fa8c0075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:47.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8c0109bd0 0x7fa8c0075f30 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800cad0 tx=0x7fa8b800cf90 comp rx=0 tx=0).stop 2024-08-31T06:16:47.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 -- 172.21.15.53:0/1747431667 shutdown_connections 2024-08-31T06:16:47.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8ac0b4d20 0x7fa8ac0b7230 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:47.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8c0109bd0 0x7fa8c0075f30 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:47.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8c0109280 0x7fa8c00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:47.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 --2- 172.21.15.53:0/1747431667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8c0103940 0x7fa8c00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:47.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 -- 172.21.15.53:0/1747431667 >> 172.21.15.53:0/1747431667 conn(0x7fa8c00ff3d0 msgr2=0x7fa8c01017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:47.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 -- 172.21.15.53:0/1747431667 shutdown_connections 2024-08-31T06:16:47.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:47.794+0000 7fa8c65c0640 1 -- 172.21.15.53:0/1747431667 wait complete. 2024-08-31T06:16:47.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:47 smithi153 ceph-mon[22320]: pgmap v690: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 906 KiB/s wr, 94 op/s 2024-08-31T06:16:47.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 181049 1.34 MB/sec execute 517 sec latency 1461.956 ms 2024-08-31T06:16:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:47 smithi130 ceph-mon[22266]: pgmap v690: 97 pgs: 97 active+clean; 104 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 906 KiB/s wr, 94 op/s 2024-08-31T06:16:48.446 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:16:48.699 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:48.950 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:48 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1747431667' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:16:48.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 181049 1.34 MB/sec execute 518 sec latency 2461.993 ms 2024-08-31T06:16:49.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:48 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1747431667' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:16:49.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:48 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1747431667' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:16:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.179+0000 7fd833aa2640 1 -- 172.21.15.53:0/993402505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd82c103920 msgr2=0x7fd82c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.179+0000 7fd833aa2640 1 --2- 172.21.15.53:0/993402505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd82c103920 0x7fd82c103d30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd828009900 tx=0x7fd82802a410 comp rx=0 tx=0).stop 2024-08-31T06:16:49.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.179+0000 7fd833aa2640 1 -- 172.21.15.53:0/993402505 shutdown_connections 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.179+0000 7fd833aa2640 1 --2- 172.21.15.53:0/993402505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd82c109bb0 0x7fd82c1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.179+0000 7fd833aa2640 1 --2- 172.21.15.53:0/993402505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd82c109260 0x7fd82c109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.179+0000 7fd833aa2640 1 --2- 172.21.15.53:0/993402505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd82c103920 0x7fd82c103d30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.179+0000 7fd833aa2640 1 -- 172.21.15.53:0/993402505 >> 172.21.15.53:0/993402505 conn(0x7fd82c0ff3b0 msgr2=0x7fd82c101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.179+0000 7fd833aa2640 1 -- 172.21.15.53:0/993402505 shutdown_connections 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.179+0000 7fd833aa2640 1 -- 172.21.15.53:0/993402505 wait complete. 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd833aa2640 1 Processor -- start 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd833aa2640 1 -- start start 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd833aa2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd82c103920 0x7fd82c19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd833aa2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd82c109260 0x7fd82c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd833aa2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd82c109bb0 0x7fd82c19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd833aa2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c113720 con 0x7fd82c103920 2024-08-31T06:16:49.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd833aa2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1135a0 con 0x7fd82c109bb0 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd833aa2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1138a0 con 0x7fd82c109260 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd83183e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd82c103920 0x7fd82c19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd83183e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd82c103920 0x7fd82c19a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59390/0 (socket says 172.21.15.53:59390) 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd83183e640 1 -- 172.21.15.53:0/748757687 learned_addr learned my addr 172.21.15.53:0/748757687 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd83103d640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd82c109260 0x7fd82c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.180+0000 7fd83203f640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd82c109bb0 0x7fd82c19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd83183e640 1 -- 172.21.15.53:0/748757687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd82c109260 msgr2=0x7fd82c19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd83183e640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd82c109260 0x7fd82c19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd83183e640 1 -- 172.21.15.53:0/748757687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd82c109bb0 msgr2=0x7fd82c19f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd83183e640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd82c109bb0 0x7fd82c19f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd83183e640 1 -- 172.21.15.53:0/748757687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82c1a00c0 con 0x7fd82c103920 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd83103d640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd82c109260 0x7fd82c19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:49.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd83203f640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd82c109bb0 0x7fd82c19f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd83183e640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd82c103920 0x7fd82c19a150 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd828009230 tx=0x7fd828004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd822ffd640 1 -- 172.21.15.53:0/748757687 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82803f030 con 0x7fd82c103920 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd833aa2640 1 -- 172.21.15.53:0/748757687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd82c1a0350 con 0x7fd82c103920 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd822ffd640 1 -- 172.21.15.53:0/748757687 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd828003a80 con 0x7fd82c103920 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd833aa2640 1 -- 172.21.15.53:0/748757687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd82c1a6b10 con 0x7fd82c103920 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.181+0000 7fd822ffd640 1 -- 172.21.15.53:0/748757687 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828035070 con 0x7fd82c103920 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83a017740 1 Processor -- start 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd822ffd640 1 -- 172.21.15.53:0/748757687 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd828042030 con 0x7fd82c103920 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83a017740 1 -- start start 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83a017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce75310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83a017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caa71b0 0x55ac1ce75850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83a017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce75d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83a017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ac1cdec680 con 0x55ac1cad0070 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83a017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ac1cddbc10 con 0x55ac1caa71b0 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83a017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ac1cddfbc0 con 0x55ac1caaf390 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83203f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce75310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83203f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce75310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59406/0 (socket says 172.21.15.53:59406) 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83203f640 1 -- 172.21.15.53:0/4082777604 learned_addr learned my addr 172.21.15.53:0/4082777604 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.184+0000 7fd83183e640 1 --2- 172.21.15.53:0/4082777604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caa71b0 0x55ac1ce75850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd83103d640 1 --2- 172.21.15.53:0/4082777604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce75d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd822ffd640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8180b4ca0 0x7fd8180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd83203f640 1 -- 172.21.15.53:0/4082777604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 msgr2=0x55ac1ce75d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd83203f640 1 --2- 172.21.15.53:0/4082777604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce75d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd83203f640 1 -- 172.21.15.53:0/4082777604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caa71b0 msgr2=0x55ac1ce75850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd83203f640 1 --2- 172.21.15.53:0/4082777604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caa71b0 0x55ac1ce75850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd83203f640 1 -- 172.21.15.53:0/4082777604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1cb3b650 con 0x55ac1cad0070 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd83183e640 1 --2- 172.21.15.53:0/4082777604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caa71b0 0x55ac1ce75850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd822ffd640 1 -- 172.21.15.53:0/748757687 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fd828105e40 con 0x7fd82c103920 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd83203f640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8180b4ca0 0x7fd8180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd83203f640 1 --2- 172.21.15.53:0/4082777604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce75310 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fd824009fb0 tx=0x7fd824010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f1357fde1dc14f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd817fff640 1 -- 172.21.15.53:0/4082777604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824022070 con 0x55ac1cad0070 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd817fff640 1 -- 172.21.15.53:0/4082777604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd82401cd70 con 0x55ac1cad0070 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.185+0000 7fd817fff640 1 -- 172.21.15.53:0/4082777604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824016070 con 0x55ac1cad0070 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.186+0000 7fd83a017740 1 -- 172.21.15.53:0/4082777604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 msgr2=0x55ac1ce75310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.186+0000 7fd83a017740 1 --2- 172.21.15.53:0/4082777604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce75310 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fd824009fb0 tx=0x7fd824010800 comp rx=0 tx=0).stop 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.186+0000 7fd83203f640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8180b4ca0 0x7fd8180b71b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd82401f000 tx=0x7fd824022000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.186+0000 7fd83a017740 1 -- 172.21.15.53:0/4082777604 shutdown_connections 2024-08-31T06:16:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.186+0000 7fd83a017740 1 --2- 172.21.15.53:0/4082777604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce75d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.186+0000 7fd83a017740 1 --2- 172.21.15.53:0/4082777604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caa71b0 0x55ac1ce75850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.186+0000 7fd83a017740 1 --2- 172.21.15.53:0/4082777604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce75310 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.186+0000 7fd83a017740 1 -- 172.21.15.53:0/4082777604 >> 172.21.15.53:0/4082777604 conn(0x55ac1cac4460 msgr2=0x55ac1ce73200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:49.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.187+0000 7fd83a017740 1 -- 172.21.15.53:0/4082777604 shutdown_connections 2024-08-31T06:16:49.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.187+0000 7fd83a017740 1 -- 172.21.15.53:0/4082777604 wait complete. 2024-08-31T06:16:49.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.187+0000 7fd83a017740 1 -- start start 2024-08-31T06:16:49.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.187+0000 7fd83a017740 1 Processor -- start 2024-08-31T06:16:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83a017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1caa71b0 0x55ac1ce80a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83a017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce80fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83a017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1cad0070 0x55ac1ce8ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83a017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ac1cc3e700 con 0x55ac1caa71b0 2024-08-31T06:16:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83a017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ac1cd62750 con 0x55ac1cad0070 2024-08-31T06:16:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83a017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ac1ce83af0 con 0x55ac1caaf390 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83a017740 10 client.0 _ll_register_callbacks cb 0x55ac1cd91e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83183e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1caa71b0 0x55ac1ce80a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83183e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1caa71b0 0x55ac1ce80a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59416/0 (socket says 172.21.15.53:59416) 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83183e640 1 -- 172.21.15.53:0/3552517380 learned_addr learned my addr 172.21.15.53:0/3552517380 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83103d640 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce80fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83203f640 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1cad0070 0x55ac1ce8ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83183e640 1 -- 172.21.15.53:0/3552517380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 msgr2=0x55ac1ce80fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83183e640 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce80fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83183e640 1 -- 172.21.15.53:0/3552517380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1cad0070 msgr2=0x55ac1ce8ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83183e640 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1cad0070 0x55ac1ce8ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83183e640 1 -- 172.21.15.53:0/3552517380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1cd9b900 con 0x55ac1caa71b0 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd83183e640 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1caa71b0 0x55ac1ce80a80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fd828003fd0 tx=0x7fd82802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326fd419cddd548d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd8157fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.188+0000 7fd8157fa640 1 -- 172.21.15.53:0/3552517380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828049040 con 0x55ac1caa71b0 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd8157fa640 1 -- 172.21.15.53:0/3552517380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fd828003c30 con 0x55ac1caa71b0 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd83a017740 1 -- 172.21.15.53:0/3552517380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd82401cd70 con 0x55ac1caa71b0 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd8157fa640 1 -- 172.21.15.53:0/3552517380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fd8280d5170 con 0x55ac1caa71b0 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd83a017740 10 client.19293 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd83a017740 1 -- 172.21.15.53:0/3552517380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55ac1ce8f800 con 0x55ac1caa71b0 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd8157fa640 1 -- 172.21.15.53:0/3552517380 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd82401cd70 con 0x55ac1caa71b0 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd8157fa640 1 -- 172.21.15.53:0/3552517380 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7fd8280ef110 con 0x55ac1caa71b0 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd83a017740 10 client.19293 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd83a017740 10 client.19293 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd83a017740 20 client.19293 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd83a017740 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ac1ca8e9f0 0x55ac1ce92c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd83a017740 4 client.19293 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.189+0000 7fd83a017740 1 -- 172.21.15.53:0/3552517380 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac1cdee5d0 con 0x55ac1ca8e9f0 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.190+0000 7fd83103d640 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ac1ca8e9f0 0x55ac1ce92c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.190+0000 7fd83103d640 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ac1ca8e9f0 0x55ac1ce92c60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=354f2a8eebaa346 server_cookie=3578836f2018853b in_seq=0 out_seq=0 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.190+0000 7fd8157fa640 10 client.19293 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd8157fa640 1 -- 172.21.15.53:0/3552517380 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac1cdee5d0 con 0x55ac1ca8e9f0 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd8157fa640 10 client.19293 handle_command_reply: tid=0 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 1 client.19293 shutdown 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 1 -- 172.21.15.53:0/3552517380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1caa71b0 msgr2=0x55ac1ce80a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1caa71b0 0x55ac1ce80a80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fd828003fd0 tx=0x7fd82802a410 comp rx=0 tx=0).stop 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 1 -- 172.21.15.53:0/3552517380 shutdown_connections 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1cad0070 0x55ac1ce8ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ac1ca8e9f0 0x55ac1ce92c60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce80fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 1 --2- 172.21.15.53:0/3552517380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1caa71b0 0x55ac1ce80a80 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd8157fa640 0 client.19293 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:16:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 1 -- 172.21.15.53:0/3552517380 >> 172.21.15.53:0/3552517380 conn(0x55ac1cac4460 msgr2=0x55ac1ce784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 1 -- 172.21.15.53:0/3552517380 shutdown_connections 2024-08-31T06:16:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 1 -- 172.21.15.53:0/3552517380 wait complete. 2024-08-31T06:16:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.191+0000 7fd83a017740 20 client.19293 trim_cache size 0 max 16384 2024-08-31T06:16:49.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.204+0000 7fd83a017740 1 Processor -- start 2024-08-31T06:16:49.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.204+0000 7fd83a017740 1 -- start start 2024-08-31T06:16:49.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83a017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caa71b0 0x55ac1ce73300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83a017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caaf390 0x55ac1ce8cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83a017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce78410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83a017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1af3d0 con 0x55ac1cad0070 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83a017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1b1060 con 0x55ac1caaf390 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83a017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1afaa0 con 0x55ac1caa71b0 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83203f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce78410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83203f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce78410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59428/0 (socket says 172.21.15.53:59428) 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83203f640 1 -- 172.21.15.53:0/2446369312 learned_addr learned my addr 172.21.15.53:0/2446369312 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83103d640 1 --2- 172.21.15.53:0/2446369312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caaf390 0x55ac1ce8cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83183e640 1 --2- 172.21.15.53:0/2446369312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caa71b0 0x55ac1ce73300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83203f640 1 -- 172.21.15.53:0/2446369312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caa71b0 msgr2=0x55ac1ce73300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83203f640 1 --2- 172.21.15.53:0/2446369312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caa71b0 0x55ac1ce73300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83203f640 1 -- 172.21.15.53:0/2446369312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caaf390 msgr2=0x55ac1ce8cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83203f640 1 --2- 172.21.15.53:0/2446369312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caaf390 0x55ac1ce8cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83203f640 1 -- 172.21.15.53:0/2446369312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1ce7ef80 con 0x55ac1cad0070 2024-08-31T06:16:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.205+0000 7fd83203f640 1 --2- 172.21.15.53:0/2446369312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce78410 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fd824010d00 tx=0x7fd824025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c117a3daea26b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.206+0000 7fd8177fe640 1 -- 172.21.15.53:0/2446369312 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824016040 con 0x55ac1cad0070 2024-08-31T06:16:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.206+0000 7fd8177fe640 1 -- 172.21.15.53:0/2446369312 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd824035070 con 0x55ac1cad0070 2024-08-31T06:16:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.206+0000 7fd8177fe640 1 -- 172.21.15.53:0/2446369312 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824011640 con 0x55ac1cad0070 2024-08-31T06:16:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.207+0000 7fd83a017740 1 -- 172.21.15.53:0/2446369312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 msgr2=0x55ac1ce78410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.207+0000 7fd83a017740 1 --2- 172.21.15.53:0/2446369312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce78410 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fd824010d00 tx=0x7fd824025000 comp rx=0 tx=0).stop 2024-08-31T06:16:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.207+0000 7fd83a017740 1 -- 172.21.15.53:0/2446369312 shutdown_connections 2024-08-31T06:16:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.207+0000 7fd83a017740 1 --2- 172.21.15.53:0/2446369312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce78410 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.207+0000 7fd83a017740 1 --2- 172.21.15.53:0/2446369312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caaf390 0x55ac1ce8cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.207+0000 7fd83a017740 1 --2- 172.21.15.53:0/2446369312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caa71b0 0x55ac1ce73300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.207+0000 7fd83a017740 1 -- 172.21.15.53:0/2446369312 >> 172.21.15.53:0/2446369312 conn(0x55ac1cac4460 msgr2=0x55ac1ce72bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.207+0000 7fd83a017740 1 -- 172.21.15.53:0/2446369312 shutdown_connections 2024-08-31T06:16:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.207+0000 7fd83a017740 1 -- 172.21.15.53:0/2446369312 wait complete. 2024-08-31T06:16:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.207+0000 7fd83a017740 1 -- start start 2024-08-31T06:16:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.207+0000 7fd83a017740 1 Processor -- start 2024-08-31T06:16:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83a017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caa71b0 0x55ac1ce89230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83a017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce856f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83a017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce85c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83a017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1b08d0 con 0x55ac1cad0070 2024-08-31T06:16:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83a017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1b0170 con 0x55ac1caa71b0 2024-08-31T06:16:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83a017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1ad3d0 con 0x55ac1caaf390 2024-08-31T06:16:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83a017740 10 client.0 _ll_register_callbacks cb 0x7fd828009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83203f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce85c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83203f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce85c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59434/0 (socket says 172.21.15.53:59434) 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83203f640 1 -- 172.21.15.53:0/1959717365 learned_addr learned my addr 172.21.15.53:0/1959717365 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83183e640 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caa71b0 0x55ac1ce89230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83103d640 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce856f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83203f640 1 -- 172.21.15.53:0/1959717365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 msgr2=0x55ac1ce856f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83203f640 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce856f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83203f640 1 -- 172.21.15.53:0/1959717365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caa71b0 msgr2=0x55ac1ce89230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83203f640 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caa71b0 0x55ac1ce89230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83203f640 1 -- 172.21.15.53:0/1959717365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1ce86170 con 0x55ac1cad0070 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd83203f640 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce85c30 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd824009c20 tx=0x7fd824009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628a9c416a0a6a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.208+0000 7fd8157fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd8157fa640 1 -- 172.21.15.53:0/1959717365 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82403d070 con 0x55ac1cad0070 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd83a017740 1 -- 172.21.15.53:0/1959717365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd824035070 con 0x55ac1cad0070 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd8157fa640 1 -- 172.21.15.53:0/1959717365 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fd824004c00 con 0x55ac1cad0070 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd8157fa640 1 -- 172.21.15.53:0/1959717365 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fd824049050 con 0x55ac1cad0070 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd83a017740 10 client.19299 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd83a017740 1 -- 172.21.15.53:0/1959717365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55ac1cefe250 con 0x55ac1cad0070 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd8157fa640 1 -- 172.21.15.53:0/1959717365 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd824035070 con 0x55ac1cad0070 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd8157fa640 1 -- 172.21.15.53:0/1959717365 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7fd82400f040 con 0x55ac1cad0070 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd83a017740 10 client.19299 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd83a017740 10 client.19299 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd83a017740 20 client.19299 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd83a017740 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ac1ca63da0 0x55ac1cf007e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd83a017740 4 client.19299 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.209+0000 7fd83a017740 1 -- 172.21.15.53:0/1959717365 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ac1cdea070 con 0x55ac1ca63da0 2024-08-31T06:16:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.210+0000 7fd83183e640 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ac1ca63da0 0x55ac1cf007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.210+0000 7fd83183e640 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ac1ca63da0 0x55ac1cf007e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c5196d78fc61eaa4 server_cookie=28edc7038192fecb in_seq=0 out_seq=0 2024-08-31T06:16:49.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.210+0000 7fd8157fa640 10 client.19299 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:16:49.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.210+0000 7fd8157fa640 1 -- 172.21.15.53:0/1959717365 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ac1cdea070 con 0x55ac1ca63da0 2024-08-31T06:16:49.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.210+0000 7fd8157fa640 10 client.19299 handle_command_reply: tid=0 2024-08-31T06:16:49.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.210+0000 7fd83a017740 1 client.19299 shutdown 2024-08-31T06:16:49.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.210+0000 7fd83a017740 1 -- 172.21.15.53:0/1959717365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 msgr2=0x55ac1ce85c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd83a017740 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce85c30 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd824009c20 tx=0x7fd824009c50 comp rx=0 tx=0).stop 2024-08-31T06:16:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd83a017740 1 -- 172.21.15.53:0/1959717365 shutdown_connections 2024-08-31T06:16:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd83a017740 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1cad0070 0x55ac1ce85c30 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd83a017740 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ac1ca63da0 0x55ac1cf007e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd83a017740 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ac1caaf390 0x55ac1ce856f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd83a017740 1 --2- 172.21.15.53:0/1959717365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac1caa71b0 0x55ac1ce89230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd8157fa640 0 client.19299 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:16:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd83a017740 1 -- 172.21.15.53:0/1959717365 >> 172.21.15.53:0/1959717365 conn(0x55ac1cac4460 msgr2=0x55ac1ce78410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd83a017740 1 -- 172.21.15.53:0/1959717365 shutdown_connections 2024-08-31T06:16:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd83a017740 1 -- 172.21.15.53:0/1959717365 wait complete. 2024-08-31T06:16:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd83a017740 20 client.19299 trim_cache size 0 max 16384 2024-08-31T06:16:49.218 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:16:49.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd833aa2640 1 -- 172.21.15.53:0/748757687 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8180b4ca0 msgr2=0x7fd8180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd833aa2640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8180b4ca0 0x7fd8180b71b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd82401f000 tx=0x7fd824022000 comp rx=0 tx=0).stop 2024-08-31T06:16:49.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd833aa2640 1 -- 172.21.15.53:0/748757687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd82c103920 msgr2=0x7fd82c19a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd833aa2640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd82c103920 0x7fd82c19a150 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd828009230 tx=0x7fd828004270 comp rx=0 tx=0).stop 2024-08-31T06:16:49.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd833aa2640 1 -- 172.21.15.53:0/748757687 shutdown_connections 2024-08-31T06:16:49.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd833aa2640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8180b4ca0 0x7fd8180b71b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.211+0000 7fd833aa2640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd82c109bb0 0x7fd82c19f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.212+0000 7fd833aa2640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd82c109260 0x7fd82c19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.212+0000 7fd833aa2640 1 --2- 172.21.15.53:0/748757687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd82c103920 0x7fd82c19a150 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.212+0000 7fd833aa2640 1 -- 172.21.15.53:0/748757687 >> 172.21.15.53:0/748757687 conn(0x7fd82c0ff3b0 msgr2=0x7fd82c1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:49.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.212+0000 7fd833aa2640 1 -- 172.21.15.53:0/748757687 shutdown_connections 2024-08-31T06:16:49.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:49.212+0000 7fd833aa2640 1 -- 172.21.15.53:0/748757687 wait complete. 2024-08-31T06:16:49.869 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:49 smithi053 ceph-mon[18924]: pgmap v691: 97 pgs: 97 active+clean; 105 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2024-08-31T06:16:49.910 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:16:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.924+0000 7f36531ba640 1 -- 172.21.15.53:0/102400437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f364c103870 msgr2=0x7f364c103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.924+0000 7f36531ba640 1 --2- 172.21.15.53:0/102400437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f364c103870 0x7f364c103c80 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f3640009900 tx=0x7f364002a410 comp rx=0 tx=0).stop 2024-08-31T06:16:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.924+0000 7f36531ba640 1 -- 172.21.15.53:0/102400437 shutdown_connections 2024-08-31T06:16:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.924+0000 7f36531ba640 1 --2- 172.21.15.53:0/102400437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f364c109af0 0x7f364c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.924+0000 7f36531ba640 1 --2- 172.21.15.53:0/102400437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f364c1091a0 0x7f364c1095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.924+0000 7f36531ba640 1 --2- 172.21.15.53:0/102400437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f364c103870 0x7f364c103c80 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.924+0000 7f36531ba640 1 -- 172.21.15.53:0/102400437 >> 172.21.15.53:0/102400437 conn(0x7f364c0ff2b0 msgr2=0x7f364c101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.924+0000 7f36531ba640 1 -- 172.21.15.53:0/102400437 shutdown_connections 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.924+0000 7f36531ba640 1 -- 172.21.15.53:0/102400437 wait complete. 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.924+0000 7f36531ba640 1 Processor -- start 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.924+0000 7f36531ba640 1 -- start start 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f36531ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f364c103870 0x7f364c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f36531ba640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f364c1091a0 0x7f364c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f36531ba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f364c109af0 0x7f364c19f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f36531ba640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f364c113670 con 0x7f364c103870 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f36531ba640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f364c1134f0 con 0x7f364c1091a0 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f36531ba640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f364c1137f0 con 0x7f364c109af0 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f3650f56640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f364c103870 0x7f364c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f3650f56640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f364c103870 0x7f364c19a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59460/0 (socket says 172.21.15.53:59460) 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f3650f56640 1 -- 172.21.15.53:0/2156749596 learned_addr learned my addr 172.21.15.53:0/2156749596 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f364bfff640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f364c1091a0 0x7f364c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f3651757640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f364c109af0 0x7f364c19f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f3650f56640 1 -- 172.21.15.53:0/2156749596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f364c109af0 msgr2=0x7f364c19f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f3650f56640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f364c109af0 0x7f364c19f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f3650f56640 1 -- 172.21.15.53:0/2156749596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f364c1091a0 msgr2=0x7f364c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f3650f56640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f364c1091a0 0x7f364c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f3650f56640 1 -- 172.21.15.53:0/2156749596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364c1a0010 con 0x7f364c103870 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.925+0000 7f3650f56640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f364c103870 0x7f364c19a170 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f3640009a20 tx=0x7f3640004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.926+0000 7f3649ffb640 1 -- 172.21.15.53:0/2156749596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364003f030 con 0x7f364c103870 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.926+0000 7f36531ba640 1 -- 172.21.15.53:0/2156749596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364c1a02a0 con 0x7f364c103870 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.926+0000 7f3649ffb640 1 -- 172.21.15.53:0/2156749596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36400035f0 con 0x7f364c103870 2024-08-31T06:16:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.926+0000 7f3649ffb640 1 -- 172.21.15.53:0/2156749596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640035070 con 0x7f364c103870 2024-08-31T06:16:49.932 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.926+0000 7f36531ba640 1 -- 172.21.15.53:0/2156749596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f364c1a07e0 con 0x7f364c103870 2024-08-31T06:16:49.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f365a202740 1 Processor -- start 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f365a202740 1 -- start start 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f3649ffb640 1 -- 172.21.15.53:0/2156749596 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3640032260 con 0x7f364c103870 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f365a202740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c755226ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f365a202740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c755227220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f365a202740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c755227760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f365a202740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c75519c000 con 0x55c754e831b0 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f365a202740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c75518b590 con 0x55c754e5a2f0 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f365a202740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c75518f540 con 0x55c754e624d0 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f3651757640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c755226ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f3651757640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c755226ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59462/0 (socket says 172.21.15.53:59462) 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f3651757640 1 -- 172.21.15.53:0/2404201721 learned_addr learned my addr 172.21.15.53:0/2404201721 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f3650f56640 1 --2- 172.21.15.53:0/2404201721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c755227220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f364bfff640 1 --2- 172.21.15.53:0/2404201721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c755227760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f3651757640 1 -- 172.21.15.53:0/2404201721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 msgr2=0x55c755227760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f3651757640 1 --2- 172.21.15.53:0/2404201721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c755227760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f3651757640 1 -- 172.21.15.53:0/2404201721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 msgr2=0x55c755227220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.929+0000 7f3651757640 1 --2- 172.21.15.53:0/2404201721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c755227220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.930+0000 7f3651757640 1 -- 172.21.15.53:0/2404201721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c754eee790 con 0x55c754e831b0 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.930+0000 7f3651757640 1 --2- 172.21.15.53:0/2404201721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c755226ce0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f3644007e50 tx=0x7f364400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9c8b361e7e37de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.930+0000 7f3636ffd640 1 -- 172.21.15.53:0/2404201721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644014070 con 0x55c754e831b0 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.930+0000 7f3649ffb640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f363c0b4ca0 0x7f363c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.930+0000 7f3636ffd640 1 -- 172.21.15.53:0/2404201721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f364400ee90 con 0x55c754e831b0 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.930+0000 7f3636ffd640 1 -- 172.21.15.53:0/2404201721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36440053a0 con 0x55c754e831b0 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.930+0000 7f3650f56640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f363c0b4ca0 0x7f363c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.930+0000 7f3649ffb640 1 -- 172.21.15.53:0/2156749596 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f3640105f00 con 0x7f364c103870 2024-08-31T06:16:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.931+0000 7f365a202740 1 -- 172.21.15.53:0/2404201721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 msgr2=0x55c755226ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.931+0000 7f3650f56640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f363c0b4ca0 0x7f363c0b71b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f36401036e0 tx=0x7f3640109c60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.931+0000 7f365a202740 1 --2- 172.21.15.53:0/2404201721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c755226ce0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f3644007e50 tx=0x7f364400e720 comp rx=0 tx=0).stop 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.931+0000 7f365a202740 1 -- 172.21.15.53:0/2404201721 shutdown_connections 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.931+0000 7f365a202740 1 --2- 172.21.15.53:0/2404201721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c755227760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.931+0000 7f365a202740 1 --2- 172.21.15.53:0/2404201721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c755227220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.931+0000 7f365a202740 1 --2- 172.21.15.53:0/2404201721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c755226ce0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.931+0000 7f365a202740 1 -- 172.21.15.53:0/2404201721 >> 172.21.15.53:0/2404201721 conn(0x55c754e77300 msgr2=0x55c755224bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.931+0000 7f365a202740 1 -- 172.21.15.53:0/2404201721 shutdown_connections 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.931+0000 7f365a202740 1 -- 172.21.15.53:0/2404201721 wait complete. 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.932+0000 7f365a202740 1 -- start start 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.932+0000 7f365a202740 1 Processor -- start 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.932+0000 7f365a202740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c7552328a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.932+0000 7f365a202740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c755232de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.932+0000 7f365a202740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c75523e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.932+0000 7f365a202740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c7550c4ab0 con 0x55c754e831b0 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.932+0000 7f365a202740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c755112680 con 0x55c754e5a2f0 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.932+0000 7f365a202740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c755235460 con 0x55c754e624d0 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.932+0000 7f365a202740 10 client.0 _ll_register_callbacks cb 0x55c754e9aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f3651757640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c75523e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f3651757640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c75523e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59474/0 (socket says 172.21.15.53:59474) 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f3651757640 1 -- 172.21.15.53:0/3235930882 learned_addr learned my addr 172.21.15.53:0/3235930882 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f364bfff640 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c755232de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f3651757640 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c7552328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f3651757640 1 -- 172.21.15.53:0/3235930882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 msgr2=0x55c755232de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f3651757640 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c755232de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f3651757640 1 -- 172.21.15.53:0/3235930882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 msgr2=0x55c7552328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f3651757640 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c7552328a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f3651757640 1 -- 172.21.15.53:0/3235930882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c754f67620 con 0x55c754e831b0 2024-08-31T06:16:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f364bfff640 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c755232de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f3651757640 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c75523e7b0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f3644010ea0 tx=0x7f3644010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3598f59c43e6cf04 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f362bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f362bfff640 1 -- 172.21.15.53:0/3235930882 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364401c020 con 0x55c754e831b0 2024-08-31T06:16:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f362bfff640 1 -- 172.21.15.53:0/3235930882 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f3644003970 con 0x55c754e831b0 2024-08-31T06:16:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.933+0000 7f365a202740 1 -- 172.21.15.53:0/3235930882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f364400ee90 con 0x55c754e831b0 2024-08-31T06:16:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f362bfff640 1 -- 172.21.15.53:0/3235930882 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f364402d050 con 0x55c754e831b0 2024-08-31T06:16:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f365a202740 10 client.19311 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f365a202740 1 -- 172.21.15.53:0/3235930882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55c7552414d0 con 0x55c754e831b0 2024-08-31T06:16:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f362bfff640 1 -- 172.21.15.53:0/3235930882 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f364400ee90 con 0x55c754e831b0 2024-08-31T06:16:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f362bfff640 1 -- 172.21.15.53:0/3235930882 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f3644004430 con 0x55c754e831b0 2024-08-31T06:16:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f365a202740 10 client.19311 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f365a202740 10 client.19311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f365a202740 20 client.19311 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f365a202740 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c754e41d80 0x55c7552448e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f365a202740 4 client.19311 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f365a202740 1 -- 172.21.15.53:0/3235930882 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c75519df50 con 0x55c754e41d80 2024-08-31T06:16:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.934+0000 7f364bfff640 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c754e41d80 0x55c7552448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.935+0000 7f362bfff640 10 client.19311 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.935+0000 7f364bfff640 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c754e41d80 0x55c7552448e0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ffdc6aafc064714 server_cookie=86e40290ab3b052d in_seq=0 out_seq=0 2024-08-31T06:16:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f362bfff640 1 -- 172.21.15.53:0/3235930882 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c75519df50 con 0x55c754e41d80 2024-08-31T06:16:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f362bfff640 10 client.19311 handle_command_reply: tid=0 2024-08-31T06:16:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 1 client.19311 shutdown 2024-08-31T06:16:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 1 -- 172.21.15.53:0/3235930882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 msgr2=0x55c75523e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c75523e7b0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f3644010ea0 tx=0x7f3644010f00 comp rx=0 tx=0).stop 2024-08-31T06:16:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 1 -- 172.21.15.53:0/3235930882 shutdown_connections 2024-08-31T06:16:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c754e41d80 0x55c7552448e0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e831b0 0x55c75523e7b0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f362bfff640 0 client.19311 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c755232de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 1 --2- 172.21.15.53:0/3235930882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c7552328a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 1 -- 172.21.15.53:0/3235930882 >> 172.21.15.53:0/3235930882 conn(0x55c754e77300 msgr2=0x55c755227d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 1 -- 172.21.15.53:0/3235930882 shutdown_connections 2024-08-31T06:16:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 1 -- 172.21.15.53:0/3235930882 wait complete. 2024-08-31T06:16:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.936+0000 7f365a202740 20 client.19311 trim_cache size 0 max 16384 2024-08-31T06:16:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f365a202740 1 Processor -- start 2024-08-31T06:16:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f365a202740 1 -- start start 2024-08-31T06:16:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f365a202740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e41d80 0x55c7552286d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f365a202740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e5a2f0 0x55c755232b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f365a202740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e624d0 0x55c7552342c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f365a202740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f364c1af460 con 0x55c754e5a2f0 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f365a202740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f364c1b10f0 con 0x55c754e624d0 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f365a202740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f364c1afb30 con 0x55c754e41d80 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f364bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e5a2f0 0x55c755232b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f364bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e5a2f0 0x55c755232b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59484/0 (socket says 172.21.15.53:59484) 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f364bfff640 1 -- 172.21.15.53:0/565348103 learned_addr learned my addr 172.21.15.53:0/565348103 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.966+0000 7f3651757640 1 --2- 172.21.15.53:0/565348103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e41d80 0x55c7552286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.967+0000 7f3651757640 1 --2- 172.21.15.53:0/565348103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e624d0 0x55c7552342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.967+0000 7f364bfff640 1 -- 172.21.15.53:0/565348103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e41d80 msgr2=0x55c7552286d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.967+0000 7f364bfff640 1 --2- 172.21.15.53:0/565348103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e41d80 0x55c7552286d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.967+0000 7f364bfff640 1 -- 172.21.15.53:0/565348103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e624d0 msgr2=0x55c7552342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.967+0000 7f364bfff640 1 --2- 172.21.15.53:0/565348103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e624d0 0x55c7552342c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.967+0000 7f364bfff640 1 -- 172.21.15.53:0/565348103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c755222f60 con 0x55c754e5a2f0 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.967+0000 7f3651757640 1 --2- 172.21.15.53:0/565348103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e624d0 0x55c7552342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.967+0000 7f364bfff640 1 --2- 172.21.15.53:0/565348103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e5a2f0 0x55c755232b70 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f364c06c390 tx=0x7f363800a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c307e48eea40553b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.967+0000 7f36367fc640 1 -- 172.21.15.53:0/565348103 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638028070 con 0x55c754e5a2f0 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.967+0000 7f36367fc640 1 -- 172.21.15.53:0/565348103 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36380054b0 con 0x55c754e5a2f0 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.967+0000 7f36367fc640 1 -- 172.21.15.53:0/565348103 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638004dd0 con 0x55c754e5a2f0 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.968+0000 7f365a202740 1 -- 172.21.15.53:0/565348103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e5a2f0 msgr2=0x55c755232b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.968+0000 7f365a202740 1 --2- 172.21.15.53:0/565348103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e5a2f0 0x55c755232b70 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f364c06c390 tx=0x7f363800a250 comp rx=0 tx=0).stop 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.968+0000 7f365a202740 1 -- 172.21.15.53:0/565348103 shutdown_connections 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.968+0000 7f365a202740 1 --2- 172.21.15.53:0/565348103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e624d0 0x55c7552342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.968+0000 7f365a202740 1 --2- 172.21.15.53:0/565348103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e5a2f0 0x55c755232b70 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.968+0000 7f365a202740 1 --2- 172.21.15.53:0/565348103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e41d80 0x55c7552286d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.968+0000 7f365a202740 1 -- 172.21.15.53:0/565348103 >> 172.21.15.53:0/565348103 conn(0x55c754e77300 msgr2=0x55c755233bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.968+0000 7f365a202740 1 -- 172.21.15.53:0/565348103 shutdown_connections 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.968+0000 7f365a202740 1 -- 172.21.15.53:0/565348103 wait complete. 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.968+0000 7f365a202740 1 -- start start 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.968+0000 7f365a202740 1 Processor -- start 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f365a202740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e41d80 0x55c755235d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f365a202740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c7552362e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f365a202740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c7552ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f365a202740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f364c1b0960 con 0x55c754e41d80 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f365a202740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f364c1b0200 con 0x55c754e5a2f0 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f365a202740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f364c1ad460 con 0x55c754e624d0 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f365a202740 10 client.0 _ll_register_callbacks cb 0x7f3640109b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f3651757640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e41d80 0x55c755235d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f3651757640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e41d80 0x55c755235d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59498/0 (socket says 172.21.15.53:59498) 2024-08-31T06:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f3651757640 1 -- 172.21.15.53:0/2021192971 learned_addr learned my addr 172.21.15.53:0/2021192971 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f3651757640 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c7552ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f364bfff640 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c7552362e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f3651757640 1 -- 172.21.15.53:0/2021192971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 msgr2=0x55c7552ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f3651757640 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c7552ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f3651757640 1 -- 172.21.15.53:0/2021192971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 msgr2=0x55c7552362e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f3651757640 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c7552362e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.969+0000 7f3651757640 1 -- 172.21.15.53:0/2021192971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7552ad7b0 con 0x55c754e41d80 2024-08-31T06:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f3651757640 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e41d80 0x55c755235d00 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f3644010ea0 tx=0x7f3644010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e094be85089415a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f362bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f362bfff640 1 -- 172.21.15.53:0/2021192971 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364401c040 con 0x55c754e41d80 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f362bfff640 1 -- 172.21.15.53:0/2021192971 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f3644021070 con 0x55c754e41d80 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f365a202740 1 -- 172.21.15.53:0/2021192971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36380054b0 con 0x55c754e41d80 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f362bfff640 1 -- 172.21.15.53:0/2021192971 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f3644014070 con 0x55c754e41d80 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f365a202740 10 client.19317 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f365a202740 1 -- 172.21.15.53:0/2021192971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55c7552ae8e0 con 0x55c754e41d80 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f362bfff640 1 -- 172.21.15.53:0/2021192971 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36380054b0 con 0x55c754e41d80 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f362bfff640 1 -- 172.21.15.53:0/2021192971 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f364403d480 con 0x55c754e41d80 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f365a202740 10 client.19317 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f365a202740 10 client.19317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f365a202740 20 client.19317 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f365a202740 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c754e831b0 0x55c7552b1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f365a202740 4 client.19317 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:16:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.970+0000 7f365a202740 1 -- 172.21.15.53:0/2021192971 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c7551999f0 con 0x55c754e831b0 2024-08-31T06:16:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.971+0000 7f364bfff640 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c754e831b0 0x55c7552b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.971+0000 7f364bfff640 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c754e831b0 0x55c7552b1100 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2812231c5d36267e server_cookie=86ba3182392a2b51 in_seq=0 out_seq=0 2024-08-31T06:16:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:49.971+0000 7f362bfff640 10 client.19317 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:49.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 181049 1.34 MB/sec execute 519 sec latency 3462.017 ms 2024-08-31T06:16:50.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f362bfff640 1 -- 172.21.15.53:0/2021192971 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c7551999f0 con 0x55c754e831b0 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f362bfff640 10 client.19317 handle_command_reply: tid=0 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 1 client.19317 shutdown 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 1 -- 172.21.15.53:0/2021192971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e41d80 msgr2=0x55c755235d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e41d80 0x55c755235d00 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f3644010ea0 tx=0x7f3644010f00 comp rx=0 tx=0).stop 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 1 -- 172.21.15.53:0/2021192971 shutdown_connections 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c754e831b0 0x55c7552b1100 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c754e624d0 0x55c7552ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c754e5a2f0 0x55c7552362e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f362bfff640 0 client.19317 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 1 --2- 172.21.15.53:0/2021192971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c754e41d80 0x55c755235d00 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 1 -- 172.21.15.53:0/2021192971 >> 172.21.15.53:0/2021192971 conn(0x55c754e77300 msgr2=0x55c755234490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 1 -- 172.21.15.53:0/2021192971 shutdown_connections 2024-08-31T06:16:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 1 -- 172.21.15.53:0/2021192971 wait complete. 2024-08-31T06:16:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.005+0000 7f365a202740 20 client.19317 trim_cache size 0 max 16384 2024-08-31T06:16:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:16:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:16:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:16:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:16:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 -- 172.21.15.53:0/2156749596 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f363c0b4ca0 msgr2=0x7f363c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f363c0b4ca0 0x7f363c0b71b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f36401036e0 tx=0x7f3640109c60 comp rx=0 tx=0).stop 2024-08-31T06:16:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 -- 172.21.15.53:0/2156749596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f364c103870 msgr2=0x7f364c19a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f364c103870 0x7f364c19a170 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f3640009a20 tx=0x7f3640004270 comp rx=0 tx=0).stop 2024-08-31T06:16:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 -- 172.21.15.53:0/2156749596 shutdown_connections 2024-08-31T06:16:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f363c0b4ca0 0x7f363c0b71b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f364c109af0 0x7f364c19f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f364c1091a0 0x7f364c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 --2- 172.21.15.53:0/2156749596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f364c103870 0x7f364c19a170 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 -- 172.21.15.53:0/2156749596 >> 172.21.15.53:0/2156749596 conn(0x7f364c0ff2b0 msgr2=0x7f364c1016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 -- 172.21.15.53:0/2156749596 shutdown_connections 2024-08-31T06:16:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:16:50.006+0000 7f36531ba640 1 -- 172.21.15.53:0/2156749596 wait complete. 2024-08-31T06:16:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:49 smithi130 ceph-mon[22266]: pgmap v691: 97 pgs: 97 active+clean; 105 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2024-08-31T06:16:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:49 smithi153 ceph-mon[22320]: pgmap v691: 97 pgs: 97 active+clean; 105 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2024-08-31T06:16:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:50.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.647+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3994887090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4102870 msgr2=0x7f3eb4102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.647+0000 7f3eb8c24640 1 --2- 172.21.15.53:0/3994887090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4102870 0x7f3eb4102c80 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009900 tx=0x7f3ea402a410 comp rx=0 tx=0).stop 2024-08-31T06:16:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.647+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3994887090 shutdown_connections 2024-08-31T06:16:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.647+0000 7f3eb8c24640 1 --2- 172.21.15.53:0/3994887090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3eb4108ab0 0x7f3eb410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.647+0000 7f3eb8c24640 1 --2- 172.21.15.53:0/3994887090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb4108160 0x7f3eb4108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.647+0000 7f3eb8c24640 1 --2- 172.21.15.53:0/3994887090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4102870 0x7f3eb4102c80 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.647+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3994887090 >> 172.21.15.53:0/3994887090 conn(0x7f3eb4079470 msgr2=0x7f3eb4079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.647+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3994887090 shutdown_connections 2024-08-31T06:16:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.647+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3994887090 wait complete. 2024-08-31T06:16:50.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.648+0000 7f3eb8c24640 1 Processor -- start 2024-08-31T06:16:50.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.648+0000 7f3eb8c24640 1 -- start start 2024-08-31T06:16:50.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.648+0000 7f3eb8c24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4102870 0x7f3eb4100e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.648+0000 7f3eb8c24640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb4108160 0x7f3eb40ff440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.648+0000 7f3eb8c24640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3eb4108ab0 0x7f3eb40ff980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.648+0000 7f3eb8c24640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4112610 con 0x7f3eb4102870 2024-08-31T06:16:50.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.648+0000 7f3eb8c24640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4112490 con 0x7f3eb4108ab0 2024-08-31T06:16:50.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.648+0000 7f3eb8c24640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb4112790 con 0x7f3eb4108160 2024-08-31T06:16:50.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4102870 0x7f3eb4100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4102870 0x7f3eb4100e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59528/0 (socket says 172.21.15.53:59528) 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb259c640 1 -- 172.21.15.53:0/3232849245 learned_addr learned my addr 172.21.15.53:0/3232849245 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3eb4108ab0 0x7f3eb40ff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb4108160 0x7f3eb40ff440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb259c640 1 -- 172.21.15.53:0/3232849245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb4108160 msgr2=0x7f3eb40ff440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb259c640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb4108160 0x7f3eb40ff440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb259c640 1 -- 172.21.15.53:0/3232849245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3eb4108ab0 msgr2=0x7f3eb40ff980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb259c640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3eb4108ab0 0x7f3eb40ff980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb259c640 1 -- 172.21.15.53:0/3232849245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb41001a0 con 0x7f3eb4102870 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb259c640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4102870 0x7f3eb4100e50 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009230 tx=0x7f3ea4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eab7fe640 1 -- 172.21.15.53:0/3232849245 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea403f030 con 0x7f3eb4102870 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eab7fe640 1 -- 172.21.15.53:0/3232849245 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ea4003a80 con 0x7f3eb4102870 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.649+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3232849245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb41acad0 con 0x7f3eb4102870 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.650+0000 7f3eab7fe640 1 -- 172.21.15.53:0/3232849245 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4035070 con 0x7f3eb4102870 2024-08-31T06:16:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.650+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3232849245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb41ad000 con 0x7f3eb4102870 2024-08-31T06:16:50.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.652+0000 7f3ebf199740 1 Processor -- start 2024-08-31T06:16:50.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.652+0000 7f3ebf199740 1 -- start start 2024-08-31T06:16:50.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.652+0000 7f3eab7fe640 1 -- 172.21.15.53:0/3232849245 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3ea4042030 con 0x7f3eb4102870 2024-08-31T06:16:50.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68b1a070 0x55ec68ebf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af11b0 0x55ec68ebf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 0x55ec68ebfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3ebf199740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ec68e36680 con 0x55ec68af9390 2024-08-31T06:16:50.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3ebf199740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec68e25c10 con 0x55ec68b1a070 2024-08-31T06:16:50.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3ebf199740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ec68e29bc0 con 0x55ec68af11b0 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3eb2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68b1a070 0x55ec68ebf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3eb1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 0x55ec68ebfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3eb2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68b1a070 0x55ec68ebf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38110/0 (socket says 172.21.15.53:38110) 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3eb2d9d640 1 -- 172.21.15.53:0/1453900602 learned_addr learned my addr 172.21.15.53:0/1453900602 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3eb259c640 1 --2- 172.21.15.53:0/1453900602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af11b0 0x55ec68ebf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3eb2d9d640 1 -- 172.21.15.53:0/1453900602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af11b0 msgr2=0x55ec68ebf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/1453900602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af11b0 0x55ec68ebf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3eb2d9d640 1 -- 172.21.15.53:0/1453900602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 msgr2=0x55ec68ebfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/1453900602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 0x55ec68ebfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.653+0000 7f3eb2d9d640 1 -- 172.21.15.53:0/1453900602 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec68b85650 con 0x55ec68b1a070 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.654+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/1453900602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68b1a070 0x55ec68ebf310 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3eac003970 tx=0x7f3eac003e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81540792e22c780c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:50.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.654+0000 7f3eab7fe640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ea00b4d20 0x7f3ea00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.654+0000 7f3eb259c640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ea00b4d20 0x7f3ea00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.654+0000 7f3ea8ff9640 1 -- 172.21.15.53:0/1453900602 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac011440 con 0x55ec68b1a070 2024-08-31T06:16:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.654+0000 7f3ea8ff9640 1 -- 172.21.15.53:0/1453900602 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3eac015030 con 0x55ec68b1a070 2024-08-31T06:16:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.654+0000 7f3ea8ff9640 1 -- 172.21.15.53:0/1453900602 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0108a0 con 0x55ec68b1a070 2024-08-31T06:16:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.654+0000 7f3eab7fe640 1 -- 172.21.15.53:0/3232849245 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f3ea41059a0 con 0x7f3eb4102870 2024-08-31T06:16:50.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.655+0000 7f3ebf199740 1 -- 172.21.15.53:0/1453900602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68b1a070 msgr2=0x55ec68ebf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.655+0000 7f3eb259c640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ea00b4d20 0x7f3ea00b7230 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4103180 tx=0x7f3ea4009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:50.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.655+0000 7f3ebf199740 1 --2- 172.21.15.53:0/1453900602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68b1a070 0x55ec68ebf310 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3eac003970 tx=0x7f3eac003e30 comp rx=0 tx=0).stop 2024-08-31T06:16:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.655+0000 7f3ebf199740 1 -- 172.21.15.53:0/1453900602 shutdown_connections 2024-08-31T06:16:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.655+0000 7f3ebf199740 1 --2- 172.21.15.53:0/1453900602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 0x55ec68ebfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.655+0000 7f3ebf199740 1 --2- 172.21.15.53:0/1453900602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af11b0 0x55ec68ebf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.655+0000 7f3ebf199740 1 --2- 172.21.15.53:0/1453900602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68b1a070 0x55ec68ebf310 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.655+0000 7f3ebf199740 1 -- 172.21.15.53:0/1453900602 >> 172.21.15.53:0/1453900602 conn(0x55ec68b0e460 msgr2=0x55ec68ebd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.655+0000 7f3ebf199740 1 -- 172.21.15.53:0/1453900602 shutdown_connections 2024-08-31T06:16:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.655+0000 7f3ebf199740 1 -- 172.21.15.53:0/1453900602 wait complete. 2024-08-31T06:16:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.655+0000 7f3ebf199740 1 -- start start 2024-08-31T06:16:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3ebf199740 1 Processor -- start 2024-08-31T06:16:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af11b0 0x55ec68ecaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af9390 0x55ec68ecafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68b1a070 0x55ec68ed6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3ebf199740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ec68c88700 con 0x55ec68af11b0 2024-08-31T06:16:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3ebf199740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec68dac750 con 0x55ec68af9390 2024-08-31T06:16:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3ebf199740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ec68ecdaf0 con 0x55ec68b1a070 2024-08-31T06:16:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3ebf199740 10 client.0 _ll_register_callbacks cb 0x55ec68ddbe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3eb2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af11b0 0x55ec68ecaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3eb1d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af9390 0x55ec68ecafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3eb1d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af9390 0x55ec68ecafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38122/0 (socket says 172.21.15.53:38122) 2024-08-31T06:16:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.656+0000 7f3eb1d9b640 1 -- 172.21.15.53:0/124892171 learned_addr learned my addr 172.21.15.53:0/124892171 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.657+0000 7f3eb1d9b640 1 -- 172.21.15.53:0/124892171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68b1a070 msgr2=0x55ec68ed6e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:16:50.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.657+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68b1a070 0x55ec68ed6e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.657+0000 7f3eb1d9b640 1 -- 172.21.15.53:0/124892171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af11b0 msgr2=0x55ec68ecaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.657+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af11b0 0x55ec68ecaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.657+0000 7f3eb1d9b640 1 -- 172.21.15.53:0/124892171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec68de5900 con 0x55ec68af9390 2024-08-31T06:16:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.657+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af11b0 0x55ec68ecaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.657+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af9390 0x55ec68ecafb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00bad0 tx=0x7f3e9c00bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fafff579889e789 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.657+0000 7f3e99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:16:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.657+0000 7f3e99ffb640 1 -- 172.21.15.53:0/124892171 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c003e20 con 0x55ec68af9390 2024-08-31T06:16:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.657+0000 7f3e99ffb640 1 -- 172.21.15.53:0/124892171 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f3e9c011440 con 0x55ec68af9390 2024-08-31T06:16:50.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.657+0000 7f3ebf199740 1 -- 172.21.15.53:0/124892171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3eac015030 con 0x55ec68af9390 2024-08-31T06:16:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.658+0000 7f3e99ffb640 1 -- 172.21.15.53:0/124892171 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f3e9c011640 con 0x55ec68af9390 2024-08-31T06:16:50.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.658+0000 7f3ebf199740 10 client.28418 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.658+0000 7f3ebf199740 1 -- 172.21.15.53:0/124892171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55ec68ed9930 con 0x55ec68af9390 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.658+0000 7f3e99ffb640 1 -- 172.21.15.53:0/124892171 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3eac015030 con 0x55ec68af9390 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.658+0000 7f3e99ffb640 1 -- 172.21.15.53:0/124892171 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f3e9c023840 con 0x55ec68af9390 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.658+0000 7f3ebf199740 10 client.28418 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.658+0000 7f3ebf199740 10 client.28418 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.658+0000 7f3ebf199740 20 client.28418 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.658+0000 7f3ebf199740 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ec68ad89f0 0x55ec68edcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.658+0000 7f3ebf199740 4 client.28418 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.658+0000 7f3ebf199740 1 -- 172.21.15.53:0/124892171 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec68e385d0 con 0x55ec68ad89f0 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.659+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ec68ad89f0 0x55ec68edcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.659+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ec68ad89f0 0x55ec68edcfc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=49f0f7d42e7a71b9 server_cookie=8942de1d64ffa55e in_seq=0 out_seq=0 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.659+0000 7f3e99ffb640 10 client.28418 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.660+0000 7f3e99ffb640 1 -- 172.21.15.53:0/124892171 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec68e385d0 con 0x55ec68ad89f0 2024-08-31T06:16:50.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.660+0000 7f3e99ffb640 10 client.28418 handle_command_reply: tid=0 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.660+0000 7f3ebf199740 1 client.28418 shutdown 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3ebf199740 1 -- 172.21.15.53:0/124892171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af9390 msgr2=0x55ec68ecafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3ebf199740 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af9390 0x55ec68ecafb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00bad0 tx=0x7f3e9c00bf90 comp rx=0 tx=0).stop 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3ebf199740 1 -- 172.21.15.53:0/124892171 shutdown_connections 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3ebf199740 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68b1a070 0x55ec68ed6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3ebf199740 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af9390 0x55ec68ecafb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3ebf199740 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ec68ad89f0 0x55ec68edcfc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3e99ffb640 0 client.28418 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3ebf199740 1 --2- 172.21.15.53:0/124892171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af11b0 0x55ec68ecaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3ebf199740 1 -- 172.21.15.53:0/124892171 >> 172.21.15.53:0/124892171 conn(0x55ec68b0e460 msgr2=0x55ec68ec24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3ebf199740 1 -- 172.21.15.53:0/124892171 shutdown_connections 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3ebf199740 1 -- 172.21.15.53:0/124892171 wait complete. 2024-08-31T06:16:50.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.661+0000 7f3ebf199740 20 client.28418 trim_cache size 0 max 16384 2024-08-31T06:16:50.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.674+0000 7f3ebf199740 1 Processor -- start 2024-08-31T06:16:50.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.674+0000 7f3ebf199740 1 -- start start 2024-08-31T06:16:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68ad89f0 0x55ec68eb8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af11b0 0x55ec68ecb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 0x55ec68ec2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3ebf199740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41b5b00 con 0x55ec68af9390 2024-08-31T06:16:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3ebf199740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41b7790 con 0x55ec68ad89f0 2024-08-31T06:16:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3ebf199740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41b61d0 con 0x55ec68af11b0 2024-08-31T06:16:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3eb2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 0x55ec68ec2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3eb2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 0x55ec68ec2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59556/0 (socket says 172.21.15.53:59556) 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3eb2d9d640 1 -- 172.21.15.53:0/3429277009 learned_addr learned my addr 172.21.15.53:0/3429277009 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/3429277009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af11b0 0x55ec68ecb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/3429277009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68ad89f0 0x55ec68eb8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3eb2d9d640 1 -- 172.21.15.53:0/3429277009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af11b0 msgr2=0x55ec68ecb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/3429277009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af11b0 0x55ec68ecb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3eb2d9d640 1 -- 172.21.15.53:0/3429277009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68ad89f0 msgr2=0x55ec68eb8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/3429277009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68ad89f0 0x55ec68eb8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3eb2d9d640 1 -- 172.21.15.53:0/3429277009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec68ec99d0 con 0x55ec68af9390 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.675+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/3429277009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 0x55ec68ec2410 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009d90 tx=0x7f3eac003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f9837fe66ade45 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.676+0000 7f3e9bfff640 1 -- 172.21.15.53:0/3429277009 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac010aa0 con 0x55ec68af9390 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.676+0000 7f3e9bfff640 1 -- 172.21.15.53:0/3429277009 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3eac015070 con 0x55ec68af9390 2024-08-31T06:16:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.676+0000 7f3e9bfff640 1 -- 172.21.15.53:0/3429277009 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac011d60 con 0x55ec68af9390 2024-08-31T06:16:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.677+0000 7f3ebf199740 1 -- 172.21.15.53:0/3429277009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 msgr2=0x55ec68ec2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.677+0000 7f3ebf199740 1 --2- 172.21.15.53:0/3429277009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 0x55ec68ec2410 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009d90 tx=0x7f3eac003e30 comp rx=0 tx=0).stop 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.677+0000 7f3ebf199740 1 -- 172.21.15.53:0/3429277009 shutdown_connections 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.677+0000 7f3ebf199740 1 --2- 172.21.15.53:0/3429277009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68af9390 0x55ec68ec2410 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.677+0000 7f3ebf199740 1 --2- 172.21.15.53:0/3429277009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af11b0 0x55ec68ecb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.677+0000 7f3ebf199740 1 --2- 172.21.15.53:0/3429277009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68ad89f0 0x55ec68eb8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.677+0000 7f3ebf199740 1 -- 172.21.15.53:0/3429277009 >> 172.21.15.53:0/3429277009 conn(0x55ec68b0e460 msgr2=0x55ec68eca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.677+0000 7f3ebf199740 1 -- 172.21.15.53:0/3429277009 shutdown_connections 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.677+0000 7f3ebf199740 1 -- 172.21.15.53:0/3429277009 wait complete. 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.677+0000 7f3ebf199740 1 -- start start 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.677+0000 7f3ebf199740 1 Processor -- start 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68ad89f0 0x55ec68eceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af11b0 0x55ec68ecf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3ebf199740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af9390 0x55ec68f46980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3ebf199740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41b7000 con 0x55ec68ad89f0 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3ebf199740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41b68a0 con 0x55ec68af11b0 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3ebf199740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb41b3b00 con 0x55ec68af9390 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3ebf199740 10 client.0 _ll_register_callbacks cb 0x7f3e9c004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3eb2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68ad89f0 0x55ec68eceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3eb2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68ad89f0 0x55ec68eceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59570/0 (socket says 172.21.15.53:59570) 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3eb2d9d640 1 -- 172.21.15.53:0/3657143938 learned_addr learned my addr 172.21.15.53:0/3657143938 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af11b0 0x55ec68ecf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.678+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af9390 0x55ec68f46980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.679+0000 7f3eb1d9b640 1 -- 172.21.15.53:0/3657143938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af9390 msgr2=0x55ec68f46980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.679+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af9390 0x55ec68f46980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.679+0000 7f3eb1d9b640 1 -- 172.21.15.53:0/3657143938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68ad89f0 msgr2=0x55ec68eceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.679+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68ad89f0 0x55ec68eceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.679+0000 7f3eb1d9b640 1 -- 172.21.15.53:0/3657143938 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec68ecfd20 con 0x55ec68af11b0 2024-08-31T06:16:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.679+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68ad89f0 0x55ec68eceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:50.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.679+0000 7f3eb1d9b640 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af11b0 0x55ec68ecf530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c023d00 tx=0x7f3e9c0114b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2621097f6d69a7c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:50.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.679+0000 7f3e99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:16:50.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.681+0000 7f3e99ffb640 1 -- 172.21.15.53:0/3657143938 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c031060 con 0x55ec68af11b0 2024-08-31T06:16:50.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.681+0000 7f3e99ffb640 1 -- 172.21.15.53:0/3657143938 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f3e9c0117e0 con 0x55ec68af11b0 2024-08-31T06:16:50.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.681+0000 7f3ebf199740 1 -- 172.21.15.53:0/3657143938 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3eac015070 con 0x55ec68af11b0 2024-08-31T06:16:50.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.685+0000 7f3e99ffb640 1 -- 172.21.15.53:0/3657143938 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f3e9c00b480 con 0x55ec68af11b0 2024-08-31T06:16:50.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.685+0000 7f3ebf199740 10 client.28424 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:50.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.685+0000 7f3ebf199740 1 -- 172.21.15.53:0/3657143938 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55ec68f47e70 con 0x55ec68af11b0 2024-08-31T06:16:50.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.686+0000 7f3e99ffb640 1 -- 172.21.15.53:0/3657143938 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3eac015070 con 0x55ec68af11b0 2024-08-31T06:16:50.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.686+0000 7f3e99ffb640 1 -- 172.21.15.53:0/3657143938 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f3e9c023920 con 0x55ec68af11b0 2024-08-31T06:16:50.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.686+0000 7f3ebf199740 10 client.28424 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:50.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.686+0000 7f3ebf199740 10 client.28424 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:16:50.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.686+0000 7f3ebf199740 20 client.28424 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:50.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.686+0000 7f3ebf199740 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ec68b1a070 0x55ec68f4a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:50.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.686+0000 7f3ebf199740 4 client.28424 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:16:50.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.686+0000 7f3ebf199740 1 -- 172.21.15.53:0/3657143938 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec68e34070 con 0x55ec68b1a070 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.686+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ec68b1a070 0x55ec68f4a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3e99ffb640 10 client.28424 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3eb2d9d640 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ec68b1a070 0x55ec68f4a660 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e565148308bab44e server_cookie=d83a937ffa6c9149 in_seq=0 out_seq=0 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3e99ffb640 1 -- 172.21.15.53:0/3657143938 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec68e34070 con 0x55ec68b1a070 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3e99ffb640 10 client.28424 handle_command_reply: tid=0 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3ebf199740 1 client.28424 shutdown 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3ebf199740 1 -- 172.21.15.53:0/3657143938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af11b0 msgr2=0x55ec68ecf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3ebf199740 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af11b0 0x55ec68ecf530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c023d00 tx=0x7f3e9c0114b0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3ebf199740 1 -- 172.21.15.53:0/3657143938 shutdown_connections 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3ebf199740 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec68af9390 0x55ec68f46980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3ebf199740 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec68af11b0 0x55ec68ecf530 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3ebf199740 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ec68b1a070 0x55ec68f4a660 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3ebf199740 1 --2- 172.21.15.53:0/3657143938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec68ad89f0 0x55ec68eceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3e99ffb640 0 client.28424 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:16:50.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3ebf199740 1 -- 172.21.15.53:0/3657143938 >> 172.21.15.53:0/3657143938 conn(0x55ec68b0e460 msgr2=0x55ec68ec2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:50.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.687+0000 7f3ebf199740 1 -- 172.21.15.53:0/3657143938 shutdown_connections 2024-08-31T06:16:50.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3ebf199740 1 -- 172.21.15.53:0/3657143938 wait complete. 2024-08-31T06:16:50.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3ebf199740 20 client.28424 trim_cache size 0 max 16384 2024-08-31T06:16:50.692 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:16:50.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3232849245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ea00b4d20 msgr2=0x7f3ea00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3eb8c24640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ea00b4d20 0x7f3ea00b7230 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4103180 tx=0x7f3ea4009260 comp rx=0 tx=0).stop 2024-08-31T06:16:50.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3232849245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4102870 msgr2=0x7f3eb4100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:50.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3eb8c24640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4102870 0x7f3eb4100e50 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009230 tx=0x7f3ea4004270 comp rx=0 tx=0).stop 2024-08-31T06:16:50.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3232849245 shutdown_connections 2024-08-31T06:16:50.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3eb8c24640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ea00b4d20 0x7f3ea00b7230 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3eb8c24640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3eb4108ab0 0x7f3eb40ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3eb8c24640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb4108160 0x7f3eb40ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3eb8c24640 1 --2- 172.21.15.53:0/3232849245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eb4102870 0x7f3eb4100e50 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:50.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.688+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3232849245 >> 172.21.15.53:0/3232849245 conn(0x7f3eb4079470 msgr2=0x7f3eb4101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:50.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.689+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3232849245 shutdown_connections 2024-08-31T06:16:50.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:50.689+0000 7f3eb8c24640 1 -- 172.21.15.53:0/3232849245 wait complete. 2024-08-31T06:16:50.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:50 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:16:50.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 181049 1.34 MB/sec execute 520 sec latency 4462.062 ms 2024-08-31T06:16:51.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:50 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:16:51.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:50 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:16:51.616 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:16:51.929 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:51 smithi053 ceph-mon[18924]: pgmap v692: 97 pgs: 97 active+clean; 105 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 902 KiB/s wr, 95 op/s 2024-08-31T06:16:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:16:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:16:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:16:51.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 181251 1.34 MB/sec execute 521 sec latency 4708.548 ms 2024-08-31T06:16:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:51 smithi130 ceph-mon[22266]: pgmap v692: 97 pgs: 97 active+clean; 105 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 902 KiB/s wr, 95 op/s 2024-08-31T06:16:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:16:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:16:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:16:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:51 smithi153 ceph-mon[22320]: pgmap v692: 97 pgs: 97 active+clean; 105 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 902 KiB/s wr, 95 op/s 2024-08-31T06:16:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:16:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:16:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:16:52.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.432+0000 7f2397624640 1 -- 172.21.15.53:0/3222529291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2390102fb0 msgr2=0x7f23901033c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:52.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.432+0000 7f2397624640 1 --2- 172.21.15.53:0/3222529291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2390102fb0 0x7f23901033c0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f238c009900 tx=0x7f238c02a410 comp rx=0 tx=0).stop 2024-08-31T06:16:52.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.432+0000 7f2397624640 1 -- 172.21.15.53:0/3222529291 shutdown_connections 2024-08-31T06:16:52.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.432+0000 7f2397624640 1 --2- 172.21.15.53:0/3222529291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2390105910 0x7f239010f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.432+0000 7f2397624640 1 --2- 172.21.15.53:0/3222529291 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2390104fc0 0x7f23901053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.432+0000 7f2397624640 1 --2- 172.21.15.53:0/3222529291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2390102fb0 0x7f23901033c0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.432+0000 7f2397624640 1 -- 172.21.15.53:0/3222529291 >> 172.21.15.53:0/3222529291 conn(0x7f2390079c60 msgr2=0x7f239007a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:52.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.432+0000 7f2397624640 1 -- 172.21.15.53:0/3222529291 shutdown_connections 2024-08-31T06:16:52.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.432+0000 7f2397624640 1 -- 172.21.15.53:0/3222529291 wait complete. 2024-08-31T06:16:52.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.433+0000 7f2397624640 1 Processor -- start 2024-08-31T06:16:52.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.433+0000 7f2397624640 1 -- start start 2024-08-31T06:16:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.433+0000 7f2397624640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2390102fb0 0x7f239019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.433+0000 7f2397624640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2390104fc0 0x7f239019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.433+0000 7f2397624640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2390105910 0x7f239019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f2397624640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23901126c0 con 0x7f2390104fc0 2024-08-31T06:16:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f2397624640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2390112540 con 0x7f2390102fb0 2024-08-31T06:16:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f2397624640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2390112840 con 0x7f2390105910 2024-08-31T06:16:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f23953c0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2390102fb0 0x7f239019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f2394bbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2390104fc0 0x7f239019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f23953c0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2390102fb0 0x7f239019a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38162/0 (socket says 172.21.15.53:38162) 2024-08-31T06:16:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f23953c0640 1 -- 172.21.15.53:0/4122631171 learned_addr learned my addr 172.21.15.53:0/4122631171 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f2395bc1640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2390105910 0x7f239019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f23953c0640 1 -- 172.21.15.53:0/4122631171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2390105910 msgr2=0x7f239019fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f23953c0640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2390105910 0x7f239019fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f23953c0640 1 -- 172.21.15.53:0/4122631171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2390104fc0 msgr2=0x7f239019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f23953c0640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2390104fc0 0x7f239019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f23953c0640 1 -- 172.21.15.53:0/4122631171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23901a0210 con 0x7f2390102fb0 2024-08-31T06:16:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.434+0000 7f23953c0640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2390102fb0 0x7f239019a2a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f238c009230 tx=0x7f238c0319a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.435+0000 7f23867fc640 1 -- 172.21.15.53:0/4122631171 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c03f030 con 0x7f2390102fb0 2024-08-31T06:16:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.435+0000 7f23867fc640 1 -- 172.21.15.53:0/4122631171 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f238c0043d0 con 0x7f2390102fb0 2024-08-31T06:16:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.435+0000 7f23867fc640 1 -- 172.21.15.53:0/4122631171 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c035070 con 0x7f2390102fb0 2024-08-31T06:16:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.435+0000 7f2397624640 1 -- 172.21.15.53:0/4122631171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23901a04a0 con 0x7f2390102fb0 2024-08-31T06:16:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.435+0000 7f2397624640 1 -- 172.21.15.53:0/4122631171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23901a6c60 con 0x7f2390102fb0 2024-08-31T06:16:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f239db99740 1 Processor -- start 2024-08-31T06:16:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f239db99740 1 -- start start 2024-08-31T06:16:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f23867fc640 1 -- 172.21.15.53:0/4122631171 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f238c042030 con 0x7f2390102fb0 2024-08-31T06:16:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f239db99740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90b9070 0x55bea945e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f239db99740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea90901b0 0x55bea945e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f239db99740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea9098390 0x55bea945edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f239db99740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bea93d5680 con 0x55bea9098390 2024-08-31T06:16:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f239db99740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bea93c4c10 con 0x55bea90901b0 2024-08-31T06:16:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f239db99740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bea93c8bc0 con 0x55bea90b9070 2024-08-31T06:16:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f23953c0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea90901b0 0x55bea945e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f2394bbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea9098390 0x55bea945edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f2394bbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea9098390 0x55bea945edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59598/0 (socket says 172.21.15.53:59598) 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f2394bbf640 1 -- 172.21.15.53:0/3829039050 learned_addr learned my addr 172.21.15.53:0/3829039050 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.438+0000 7f2395bc1640 1 --2- 172.21.15.53:0/3829039050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90b9070 0x55bea945e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.439+0000 7f23953c0640 1 -- 172.21.15.53:0/3829039050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90b9070 msgr2=0x55bea945e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.439+0000 7f23953c0640 1 --2- 172.21.15.53:0/3829039050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90b9070 0x55bea945e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.439+0000 7f23953c0640 1 -- 172.21.15.53:0/3829039050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea9098390 msgr2=0x55bea945edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.439+0000 7f23953c0640 1 --2- 172.21.15.53:0/3829039050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea9098390 0x55bea945edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.439+0000 7f23953c0640 1 -- 172.21.15.53:0/3829039050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bea9124650 con 0x55bea90901b0 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.439+0000 7f2394bbf640 1 --2- 172.21.15.53:0/3829039050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea9098390 0x55bea945edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.439+0000 7f23867fc640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f237c0b4ca0 0x7f237c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.439+0000 7f2395bc1640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f237c0b4ca0 0x7f237c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.439+0000 7f23867fc640 1 -- 172.21.15.53:0/4122631171 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f238c1058e0 con 0x7f2390102fb0 2024-08-31T06:16:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.439+0000 7f23953c0640 1 --2- 172.21.15.53:0/3829039050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea90901b0 0x55bea945e890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f238c103010 tx=0x7f238c10bc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac351702f258ce8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.440+0000 7f237b7fe640 1 -- 172.21.15.53:0/3829039050 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c049070 con 0x55bea90901b0 2024-08-31T06:16:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.440+0000 7f237b7fe640 1 -- 172.21.15.53:0/3829039050 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f238c0b1e50 con 0x55bea90901b0 2024-08-31T06:16:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.440+0000 7f237b7fe640 1 -- 172.21.15.53:0/3829039050 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c0cbe30 con 0x55bea90901b0 2024-08-31T06:16:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.440+0000 7f2395bc1640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f237c0b4ca0 0x7f237c0b71b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2388005fd0 tx=0x7f2388009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.440+0000 7f239db99740 1 -- 172.21.15.53:0/3829039050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea90901b0 msgr2=0x55bea945e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.441+0000 7f239db99740 1 --2- 172.21.15.53:0/3829039050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea90901b0 0x55bea945e890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f238c103010 tx=0x7f238c10bc10 comp rx=0 tx=0).stop 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.441+0000 7f239db99740 1 -- 172.21.15.53:0/3829039050 shutdown_connections 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.441+0000 7f239db99740 1 --2- 172.21.15.53:0/3829039050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea9098390 0x55bea945edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.441+0000 7f239db99740 1 --2- 172.21.15.53:0/3829039050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea90901b0 0x55bea945e890 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.441+0000 7f239db99740 1 --2- 172.21.15.53:0/3829039050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90b9070 0x55bea945e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.441+0000 7f239db99740 1 -- 172.21.15.53:0/3829039050 >> 172.21.15.53:0/3829039050 conn(0x55bea90ad460 msgr2=0x55bea945c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.441+0000 7f239db99740 1 -- 172.21.15.53:0/3829039050 shutdown_connections 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.441+0000 7f239db99740 1 -- 172.21.15.53:0/3829039050 wait complete. 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.441+0000 7f239db99740 1 -- start start 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.441+0000 7f239db99740 1 Processor -- start 2024-08-31T06:16:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f239db99740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90901b0 0x55bea9469b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f239db99740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 0x55bea946a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f239db99740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90b9070 0x55bea9479ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f239db99740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bea9227700 con 0x55bea90b9070 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f239db99740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bea934b750 con 0x55bea9098390 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f239db99740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bea93c4c10 con 0x55bea90901b0 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f239db99740 10 client.0 _ll_register_callbacks cb 0x55bea937ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f2394bbf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 0x55bea946a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f2394bbf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 0x55bea946a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38184/0 (socket says 172.21.15.53:38184) 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f2395bc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90b9070 0x55bea9479ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f2394bbf640 1 -- 172.21.15.53:0/2255271562 learned_addr learned my addr 172.21.15.53:0/2255271562 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f23953c0640 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90901b0 0x55bea9469b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f23953c0640 1 -- 172.21.15.53:0/2255271562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 msgr2=0x55bea946a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f23953c0640 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 0x55bea946a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f23953c0640 1 -- 172.21.15.53:0/2255271562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90b9070 msgr2=0x55bea9479ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f23953c0640 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90b9070 0x55bea9479ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.442+0000 7f23953c0640 1 -- 172.21.15.53:0/2255271562 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bea9384900 con 0x55bea90901b0 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.443+0000 7f23953c0640 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90901b0 0x55bea9469b40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f238c103010 tx=0x7f238c005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=574621521d53f7d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.443+0000 7f2378ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.443+0000 7f2378ff9640 1 -- 172.21.15.53:0/2255271562 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c049040 con 0x55bea90901b0 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.443+0000 7f239db99740 1 -- 172.21.15.53:0/2255271562 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f238c0b1e50 con 0x55bea90901b0 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.443+0000 7f2378ff9640 1 -- 172.21.15.53:0/2255271562 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f238c0c82f0 con 0x55bea90901b0 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.443+0000 7f2378ff9640 1 -- 172.21.15.53:0/2255271562 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f238c0cb7d0 con 0x55bea90901b0 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.443+0000 7f239db99740 10 client.28417 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.443+0000 7f239db99740 1 -- 172.21.15.53:0/2255271562 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55bea947ca30 con 0x55bea90901b0 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.443+0000 7f2378ff9640 1 -- 172.21.15.53:0/2255271562 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f238c0b1e50 con 0x55bea90901b0 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.444+0000 7f2378ff9640 1 -- 172.21.15.53:0/2255271562 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f238c003bf0 con 0x55bea90901b0 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.444+0000 7f239db99740 10 client.28417 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.444+0000 7f239db99740 10 client.28417 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:16:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.444+0000 7f239db99740 20 client.28417 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.444+0000 7f239db99740 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bea90779f0 0x55bea947fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.444+0000 7f239db99740 4 client.28417 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.444+0000 7f239db99740 1 -- 172.21.15.53:0/2255271562 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bea93d75d0 con 0x55bea90779f0 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.444+0000 7f2394bbf640 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bea90779f0 0x55bea947fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.444+0000 7f2378ff9640 10 client.28417 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.444+0000 7f2394bbf640 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bea90779f0 0x55bea947fd90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6eb0e0be82242c5a server_cookie=f746beff2e33c423 in_seq=0 out_seq=0 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f2378ff9640 1 -- 172.21.15.53:0/2255271562 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bea93d75d0 con 0x55bea90779f0 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f2378ff9640 10 client.28417 handle_command_reply: tid=0 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f239db99740 1 client.28417 shutdown 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f239db99740 1 -- 172.21.15.53:0/2255271562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90901b0 msgr2=0x55bea9469b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f239db99740 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90901b0 0x55bea9469b40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f238c103010 tx=0x7f238c005c90 comp rx=0 tx=0).stop 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f239db99740 1 -- 172.21.15.53:0/2255271562 shutdown_connections 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f239db99740 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bea90779f0 0x55bea947fd90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f239db99740 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90b9070 0x55bea9479ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f239db99740 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 0x55bea946a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f2378ff9640 0 client.28417 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:16:52.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f239db99740 1 --2- 172.21.15.53:0/2255271562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90901b0 0x55bea9469b40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.445+0000 7f239db99740 1 -- 172.21.15.53:0/2255271562 >> 172.21.15.53:0/2255271562 conn(0x55bea90ad460 msgr2=0x55bea94614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:52.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.446+0000 7f239db99740 1 -- 172.21.15.53:0/2255271562 shutdown_connections 2024-08-31T06:16:52.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.446+0000 7f239db99740 1 -- 172.21.15.53:0/2255271562 wait complete. 2024-08-31T06:16:52.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.446+0000 7f239db99740 20 client.28417 trim_cache size 0 max 16384 2024-08-31T06:16:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.460+0000 7f239db99740 1 Processor -- start 2024-08-31T06:16:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.460+0000 7f239db99740 1 -- start start 2024-08-31T06:16:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f239db99740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 0x55bea946b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f239db99740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea9098390 0x55bea9479dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f239db99740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea90b9070 0x55bea947a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f239db99740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23901ad330 con 0x55bea90901b0 2024-08-31T06:16:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f239db99740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f23901aefc0 con 0x55bea90b9070 2024-08-31T06:16:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f239db99740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23901ada00 con 0x55bea9098390 2024-08-31T06:16:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f23953c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 0x55bea946b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f23953c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 0x55bea946b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59616/0 (socket says 172.21.15.53:59616) 2024-08-31T06:16:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f23953c0640 1 -- 172.21.15.53:0/4146033535 learned_addr learned my addr 172.21.15.53:0/4146033535 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f2395bc1640 1 --2- 172.21.15.53:0/4146033535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea90b9070 0x55bea947a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f2394bbf640 1 --2- 172.21.15.53:0/4146033535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea9098390 0x55bea9479dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f23953c0640 1 -- 172.21.15.53:0/4146033535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea9098390 msgr2=0x55bea9479dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f23953c0640 1 --2- 172.21.15.53:0/4146033535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea9098390 0x55bea9479dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f23953c0640 1 -- 172.21.15.53:0/4146033535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea90b9070 msgr2=0x55bea947a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f23953c0640 1 --2- 172.21.15.53:0/4146033535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea90b9070 0x55bea947a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f23953c0640 1 -- 172.21.15.53:0/4146033535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bea9480100 con 0x55bea90901b0 2024-08-31T06:16:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.461+0000 7f23953c0640 1 --2- 172.21.15.53:0/4146033535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 0x55bea946b770 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f238c0c92d0 tx=0x7f238c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2244dfdd26aed77 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.462+0000 7f237affd640 1 -- 172.21.15.53:0/4146033535 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c049030 con 0x55bea90901b0 2024-08-31T06:16:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.462+0000 7f237affd640 1 -- 172.21.15.53:0/4146033535 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f238c0b1e50 con 0x55bea90901b0 2024-08-31T06:16:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.462+0000 7f237affd640 1 -- 172.21.15.53:0/4146033535 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c0cb9b0 con 0x55bea90901b0 2024-08-31T06:16:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.463+0000 7f239db99740 1 -- 172.21.15.53:0/4146033535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 msgr2=0x55bea946b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.463+0000 7f239db99740 1 --2- 172.21.15.53:0/4146033535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 0x55bea946b770 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f238c0c92d0 tx=0x7f238c02a410 comp rx=0 tx=0).stop 2024-08-31T06:16:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.463+0000 7f239db99740 1 -- 172.21.15.53:0/4146033535 shutdown_connections 2024-08-31T06:16:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.463+0000 7f239db99740 1 --2- 172.21.15.53:0/4146033535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea90b9070 0x55bea947a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.463+0000 7f239db99740 1 --2- 172.21.15.53:0/4146033535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea9098390 0x55bea9479dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.463+0000 7f239db99740 1 --2- 172.21.15.53:0/4146033535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 0x55bea946b770 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.463+0000 7f239db99740 1 -- 172.21.15.53:0/4146033535 >> 172.21.15.53:0/4146033535 conn(0x55bea90ad460 msgr2=0x55bea946b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.463+0000 7f239db99740 1 -- 172.21.15.53:0/4146033535 shutdown_connections 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.463+0000 7f239db99740 1 -- 172.21.15.53:0/4146033535 wait complete. 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.463+0000 7f239db99740 1 -- start start 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.463+0000 7f239db99740 1 Processor -- start 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f239db99740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 0x55bea94721f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f239db99740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 0x55bea9472770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f239db99740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90b9070 0x55bea94e9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f239db99740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23901ae830 con 0x55bea90901b0 2024-08-31T06:16:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f239db99740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f23901ae0d0 con 0x55bea9098390 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f239db99740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23901ab330 con 0x55bea90b9070 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f239db99740 10 client.0 _ll_register_callbacks cb 0x7f23800097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f2394bbf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 0x55bea9472770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f2394bbf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 0x55bea9472770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38202/0 (socket says 172.21.15.53:38202) 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f2394bbf640 1 -- 172.21.15.53:0/3770659850 learned_addr learned my addr 172.21.15.53:0/3770659850 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f23953c0640 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 0x55bea94721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f2395bc1640 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90b9070 0x55bea94e9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f2394bbf640 1 -- 172.21.15.53:0/3770659850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90b9070 msgr2=0x55bea94e9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f2394bbf640 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90b9070 0x55bea94e9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f2394bbf640 1 -- 172.21.15.53:0/3770659850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 msgr2=0x55bea94721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f2394bbf640 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 0x55bea94721f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f2394bbf640 1 -- 172.21.15.53:0/3770659850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bea94e9ad0 con 0x55bea9098390 2024-08-31T06:16:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f2394bbf640 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 0x55bea9472770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55bea9480300 tx=0x7f23800044d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea814af6f2bfd314 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.464+0000 7f2378ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f2378ff9640 1 -- 172.21.15.53:0/3770659850 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238002a060 con 0x55bea9098390 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f239db99740 1 -- 172.21.15.53:0/3770659850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f238c0b1e50 con 0x55bea9098390 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f2378ff9640 1 -- 172.21.15.53:0/3770659850 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f2380010690 con 0x55bea9098390 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f2378ff9640 1 -- 172.21.15.53:0/3770659850 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f2380016030 con 0x55bea9098390 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f239db99740 10 client.28442 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f239db99740 1 -- 172.21.15.53:0/3770659850 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55bea94eacb0 con 0x55bea9098390 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f2378ff9640 1 -- 172.21.15.53:0/3770659850 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f238c0b1e50 con 0x55bea9098390 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f2378ff9640 1 -- 172.21.15.53:0/3770659850 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f23800054a0 con 0x55bea9098390 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f239db99740 10 client.28442 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f239db99740 10 client.28442 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f239db99740 20 client.28442 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f239db99740 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bea904cda0 0x55bea94ed450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f239db99740 4 client.28442 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.465+0000 7f239db99740 1 -- 172.21.15.53:0/3770659850 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bea93d3070 con 0x55bea904cda0 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.466+0000 7f23953c0640 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bea904cda0 0x55bea94ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.466+0000 7f2378ff9640 10 client.28442 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.466+0000 7f23953c0640 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bea904cda0 0x55bea94ed450 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ce0b247742fd718 server_cookie=caba2b8ade1c179e in_seq=0 out_seq=0 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.466+0000 7f2378ff9640 1 -- 172.21.15.53:0/3770659850 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bea93d3070 con 0x55bea904cda0 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.466+0000 7f2378ff9640 10 client.28442 handle_command_reply: tid=0 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.466+0000 7f239db99740 1 client.28442 shutdown 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.466+0000 7f239db99740 1 -- 172.21.15.53:0/3770659850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 msgr2=0x55bea9472770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.466+0000 7f239db99740 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 0x55bea9472770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55bea9480300 tx=0x7f23800044d0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f239db99740 1 -- 172.21.15.53:0/3770659850 shutdown_connections 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f239db99740 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55bea904cda0 0x55bea94ed450 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f239db99740 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bea90b9070 0x55bea94e9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f239db99740 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bea9098390 0x55bea9472770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f2378ff9640 0 client.28442 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:16:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f239db99740 1 --2- 172.21.15.53:0/3770659850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bea90901b0 0x55bea94721f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f239db99740 1 -- 172.21.15.53:0/3770659850 >> 172.21.15.53:0/3770659850 conn(0x55bea90ad460 msgr2=0x55bea945fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f239db99740 1 -- 172.21.15.53:0/3770659850 shutdown_connections 2024-08-31T06:16:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f239db99740 1 -- 172.21.15.53:0/3770659850 wait complete. 2024-08-31T06:16:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f239db99740 20 client.28442 trim_cache size 0 max 16384 2024-08-31T06:16:52.475 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:16:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f2397624640 1 -- 172.21.15.53:0/4122631171 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f237c0b4ca0 msgr2=0x7f237c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f2397624640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f237c0b4ca0 0x7f237c0b71b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2388005fd0 tx=0x7f2388009500 comp rx=0 tx=0).stop 2024-08-31T06:16:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f2397624640 1 -- 172.21.15.53:0/4122631171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2390102fb0 msgr2=0x7f239019a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f2397624640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2390102fb0 0x7f239019a2a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f238c009230 tx=0x7f238c0319a0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f2397624640 1 -- 172.21.15.53:0/4122631171 shutdown_connections 2024-08-31T06:16:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f2397624640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f237c0b4ca0 0x7f237c0b71b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f2397624640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2390105910 0x7f239019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f2397624640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2390104fc0 0x7f239019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.467+0000 7f2397624640 1 --2- 172.21.15.53:0/4122631171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2390102fb0 0x7f239019a2a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.468+0000 7f2397624640 1 -- 172.21.15.53:0/4122631171 >> 172.21.15.53:0/4122631171 conn(0x7f2390079c60 msgr2=0x7f2390101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.468+0000 7f2397624640 1 -- 172.21.15.53:0/4122631171 shutdown_connections 2024-08-31T06:16:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:52.468+0000 7f2397624640 1 -- 172.21.15.53:0/4122631171 wait complete. 2024-08-31T06:16:52.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 181509 1.33 MB/sec execute 522 sec latency 17.738 ms 2024-08-31T06:16:53.227 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:16:53.498 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:53.894 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:53 smithi053 ceph-mon[18924]: pgmap v693: 97 pgs: 97 active+clean; 105 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 692 KiB/s wr, 76 op/s 2024-08-31T06:16:53.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 181974 1.33 MB/sec execute 523 sec latency 14.680 ms 2024-08-31T06:16:54.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.990+0000 7f69e16af640 1 -- 172.21.15.53:0/3208627704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc102800 msgr2=0x7f69dc102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:54.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.991+0000 7f69e16af640 1 --2- 172.21.15.53:0/3208627704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc102800 0x7f69dc102c10 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009900 tx=0x7f69cc02a410 comp rx=0 tx=0).stop 2024-08-31T06:16:54.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.991+0000 7f69e16af640 1 -- 172.21.15.53:0/3208627704 shutdown_connections 2024-08-31T06:16:54.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.991+0000 7f69e16af640 1 --2- 172.21.15.53:0/3208627704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc108a90 0x7f69dc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.991+0000 7f69e16af640 1 --2- 172.21.15.53:0/3208627704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69dc108140 0x7f69dc108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.991+0000 7f69e16af640 1 --2- 172.21.15.53:0/3208627704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc102800 0x7f69dc102c10 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.991+0000 7f69e16af640 1 -- 172.21.15.53:0/3208627704 >> 172.21.15.53:0/3208627704 conn(0x7f69dc0794d0 msgr2=0x7f69dc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:54.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.991+0000 7f69e16af640 1 -- 172.21.15.53:0/3208627704 shutdown_connections 2024-08-31T06:16:54.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.991+0000 7f69e16af640 1 -- 172.21.15.53:0/3208627704 wait complete. 2024-08-31T06:16:54.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.991+0000 7f69e16af640 1 Processor -- start 2024-08-31T06:16:54.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69e16af640 1 -- start start 2024-08-31T06:16:54.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69e16af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc102800 0x7f69dc19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69e16af640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69dc108140 0x7f69dc19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69e16af640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc108a90 0x7f69dc19f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69e16af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc1125c0 con 0x7f69dc102800 2024-08-31T06:16:54.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69e16af640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc112440 con 0x7f69dc108a90 2024-08-31T06:16:54.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69e16af640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc112740 con 0x7f69dc108140 2024-08-31T06:16:54.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69daffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc102800 0x7f69dc19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69daffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc102800 0x7f69dc19a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38506/0 (socket says 172.21.15.53:38506) 2024-08-31T06:16:54.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69daffd640 1 -- 172.21.15.53:0/3807856076 learned_addr learned my addr 172.21.15.53:0/3807856076 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:54.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69db7fe640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc108a90 0x7f69dc19f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69da7fc640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69dc108140 0x7f69dc19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69daffd640 1 -- 172.21.15.53:0/3807856076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69dc108140 msgr2=0x7f69dc19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:54.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69daffd640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69dc108140 0x7f69dc19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69daffd640 1 -- 172.21.15.53:0/3807856076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc108a90 msgr2=0x7f69dc19f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:54.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69daffd640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc108a90 0x7f69dc19f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.992+0000 7f69daffd640 1 -- 172.21.15.53:0/3807856076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69dc1a0090 con 0x7f69dc102800 2024-08-31T06:16:54.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.993+0000 7f69daffd640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc102800 0x7f69dc19a120 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009230 tx=0x7f69cc0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:54.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.993+0000 7f69c3fff640 1 -- 172.21.15.53:0/3807856076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc03f030 con 0x7f69dc102800 2024-08-31T06:16:54.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.993+0000 7f69c3fff640 1 -- 172.21.15.53:0/3807856076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69cc0043d0 con 0x7f69dc102800 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.993+0000 7f69e16af640 1 -- 172.21.15.53:0/3807856076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69dc1a0320 con 0x7f69dc102800 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.993+0000 7f69c3fff640 1 -- 172.21.15.53:0/3807856076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc035070 con 0x7f69dc102800 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.993+0000 7f69e16af640 1 -- 172.21.15.53:0/3807856076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69dc1a6ae0 con 0x7f69dc102800 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.995+0000 7f69e7c24740 1 Processor -- start 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69e7c24740 1 -- start start 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69c3fff640 1 -- 172.21.15.53:0/3807856076 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f69cc042030 con 0x7f69dc102800 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72cc070 0x557fe7671310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72a31b0 0x557fe7671850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72ab390 0x557fe7671d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69e7c24740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557fe75e8680 con 0x557fe72ab390 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69e7c24740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557fe75d7c10 con 0x557fe72a31b0 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69e7c24740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557fe75dbbc0 con 0x557fe72cc070 2024-08-31T06:16:54.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69da7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72ab390 0x557fe7671d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69db7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72cc070 0x557fe7671310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69daffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72a31b0 0x557fe7671850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69da7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72ab390 0x557fe7671d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38512/0 (socket says 172.21.15.53:38512) 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69da7fc640 1 -- 172.21.15.53:0/571174818 learned_addr learned my addr 172.21.15.53:0/571174818 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69db7fe640 1 -- 172.21.15.53:0/571174818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72a31b0 msgr2=0x557fe7671850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69db7fe640 1 --2- 172.21.15.53:0/571174818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72a31b0 0x557fe7671850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69db7fe640 1 -- 172.21.15.53:0/571174818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72ab390 msgr2=0x557fe7671d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69db7fe640 1 --2- 172.21.15.53:0/571174818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72ab390 0x557fe7671d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69db7fe640 1 -- 172.21.15.53:0/571174818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fe7337650 con 0x557fe72cc070 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.996+0000 7f69da7fc640 1 --2- 172.21.15.53:0/571174818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72ab390 0x557fe7671d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.997+0000 7f69db7fe640 1 --2- 172.21.15.53:0/571174818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72cc070 0x557fe7671310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009f00 tx=0x7f69d4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e56af7fb0dd4dd04 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.997+0000 7f69c3fff640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69c40b4ca0 0x7f69c40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.997+0000 7f69c17fa640 1 -- 172.21.15.53:0/571174818 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4004d20 con 0x557fe72cc070 2024-08-31T06:16:54.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.997+0000 7f69c17fa640 1 -- 172.21.15.53:0/571174818 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69d4004030 con 0x557fe72cc070 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.997+0000 7f69daffd640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69c40b4ca0 0x7f69c40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.997+0000 7f69c17fa640 1 -- 172.21.15.53:0/571174818 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4005280 con 0x557fe72cc070 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.997+0000 7f69c3fff640 1 -- 172.21.15.53:0/3807856076 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f69cc1058b0 con 0x7f69dc102800 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69e7c24740 1 -- 172.21.15.53:0/571174818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72cc070 msgr2=0x557fe7671310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69daffd640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69c40b4ca0 0x7f69c40b71b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f69cc103090 tx=0x7f69cc10b550 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69e7c24740 1 --2- 172.21.15.53:0/571174818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72cc070 0x557fe7671310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009f00 tx=0x7f69d4011810 comp rx=0 tx=0).stop 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69e7c24740 1 -- 172.21.15.53:0/571174818 shutdown_connections 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69e7c24740 1 --2- 172.21.15.53:0/571174818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72ab390 0x557fe7671d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69e7c24740 1 --2- 172.21.15.53:0/571174818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72a31b0 0x557fe7671850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69e7c24740 1 --2- 172.21.15.53:0/571174818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72cc070 0x557fe7671310 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69e7c24740 1 -- 172.21.15.53:0/571174818 >> 172.21.15.53:0/571174818 conn(0x557fe72c0460 msgr2=0x557fe766f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69e7c24740 1 -- 172.21.15.53:0/571174818 shutdown_connections 2024-08-31T06:16:54.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69e7c24740 1 -- 172.21.15.53:0/571174818 wait complete. 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69e7c24740 1 -- start start 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.998+0000 7f69e7c24740 1 Processor -- start 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72a31b0 0x557fe767cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72ab390 0x557fe767d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7688de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69e7c24740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557fe743a700 con 0x557fe72cc070 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69e7c24740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557fe755e750 con 0x557fe72ab390 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69e7c24740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557fe767faf0 con 0x557fe72a31b0 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69e7c24740 10 client.0 _ll_register_callbacks cb 0x557fe758de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7688de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7688de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38516/0 (socket says 172.21.15.53:38516) 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69da7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72ab390 0x557fe767d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69db7fe640 1 -- 172.21.15.53:0/1717394379 learned_addr learned my addr 172.21.15.53:0/1717394379 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69db7fe640 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72a31b0 0x557fe767cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69da7fc640 1 -- 172.21.15.53:0/1717394379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72a31b0 msgr2=0x557fe767cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69da7fc640 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72a31b0 0x557fe767cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69da7fc640 1 -- 172.21.15.53:0/1717394379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 msgr2=0x557fe7688de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69da7fc640 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7688de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69da7fc640 1 -- 172.21.15.53:0/1717394379 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fe7597900 con 0x557fe72ab390 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:53.999+0000 7f69db7fe640 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7688de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.000+0000 7f69da7fc640 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72ab390 0x557fe767d010 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f69d0012700 tx=0x7f69d0012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d220b016f79213ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.000+0000 7f69beff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.000+0000 7f69beff5640 1 -- 172.21.15.53:0/1717394379 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0004030 con 0x557fe72ab390 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.000+0000 7f69beff5640 1 -- 172.21.15.53:0/1717394379 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f69d00041d0 con 0x557fe72ab390 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.000+0000 7f69e7c24740 1 -- 172.21.15.53:0/1717394379 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69d4004030 con 0x557fe72ab390 2024-08-31T06:16:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.001+0000 7f69beff5640 1 -- 172.21.15.53:0/1717394379 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f69d00043d0 con 0x557fe72ab390 2024-08-31T06:16:54.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.001+0000 7f69e7c24740 10 client.28454 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:54.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.001+0000 7f69e7c24740 1 -- 172.21.15.53:0/1717394379 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557fe768b980 con 0x557fe72ab390 2024-08-31T06:16:54.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.001+0000 7f69beff5640 1 -- 172.21.15.53:0/1717394379 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69d4004030 con 0x557fe72ab390 2024-08-31T06:16:54.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.001+0000 7f69beff5640 1 -- 172.21.15.53:0/1717394379 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f69d0003b20 con 0x557fe72ab390 2024-08-31T06:16:54.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.002+0000 7f69e7c24740 10 client.28454 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.002+0000 7f69e7c24740 10 client.28454 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.002+0000 7f69e7c24740 20 client.28454 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.002+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x557fe728a9f0 0x557fe768ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.002+0000 7f69e7c24740 4 client.28454 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.002+0000 7f69e7c24740 1 -- 172.21.15.53:0/1717394379 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fe75ea5d0 con 0x557fe728a9f0 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.002+0000 7f69db7fe640 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x557fe728a9f0 0x557fe768ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.002+0000 7f69beff5640 10 client.28454 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.002+0000 7f69db7fe640 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x557fe728a9f0 0x557fe768ee70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1dd83c0a473b1acd server_cookie=ed7a1b202130fcfa in_seq=0 out_seq=0 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.003+0000 7f69beff5640 1 -- 172.21.15.53:0/1717394379 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557fe75ea5d0 con 0x557fe728a9f0 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.003+0000 7f69beff5640 10 client.28454 handle_command_reply: tid=0 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.003+0000 7f69e7c24740 1 client.28454 shutdown 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.003+0000 7f69e7c24740 1 -- 172.21.15.53:0/1717394379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72ab390 msgr2=0x557fe767d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.003+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72ab390 0x557fe767d010 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f69d0012700 tx=0x7f69d0012bc0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.004+0000 7f69e7c24740 1 -- 172.21.15.53:0/1717394379 shutdown_connections 2024-08-31T06:16:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.004+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x557fe728a9f0 0x557fe768ee70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.004+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7688de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.004+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72ab390 0x557fe767d010 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.004+0000 7f69beff5640 0 client.28454 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:16:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.004+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1717394379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72a31b0 0x557fe767cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.004+0000 7f69e7c24740 1 -- 172.21.15.53:0/1717394379 >> 172.21.15.53:0/1717394379 conn(0x557fe72c0460 msgr2=0x557fe76744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.004+0000 7f69e7c24740 1 -- 172.21.15.53:0/1717394379 shutdown_connections 2024-08-31T06:16:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.004+0000 7f69e7c24740 1 -- 172.21.15.53:0/1717394379 wait complete. 2024-08-31T06:16:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.004+0000 7f69e7c24740 20 client.28454 trim_cache size 0 max 16384 2024-08-31T06:16:54.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.019+0000 7f69e7c24740 1 Processor -- start 2024-08-31T06:16:54.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.019+0000 7f69e7c24740 1 -- start start 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72a31b0 0x557fe7674b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 0x557fe7688ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7689220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69e7c24740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc1af400 con 0x557fe72cc070 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69e7c24740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc1b1090 con 0x557fe72a31b0 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69e7c24740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc1afad0 con 0x557fe72ab390 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7689220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7689220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38526/0 (socket says 172.21.15.53:38526) 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69db7fe640 1 -- 172.21.15.53:0/3749837544 learned_addr learned my addr 172.21.15.53:0/3749837544 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69db7fe640 1 --2- 172.21.15.53:0/3749837544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72a31b0 0x557fe7674b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69da7fc640 1 --2- 172.21.15.53:0/3749837544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 0x557fe7688ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69db7fe640 1 -- 172.21.15.53:0/3749837544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 msgr2=0x557fe7688ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:54.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69db7fe640 1 --2- 172.21.15.53:0/3749837544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 0x557fe7688ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69db7fe640 1 -- 172.21.15.53:0/3749837544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72a31b0 msgr2=0x557fe7674b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69db7fe640 1 --2- 172.21.15.53:0/3749837544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72a31b0 0x557fe7674b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69db7fe640 1 -- 172.21.15.53:0/3749837544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fe7674170 con 0x557fe72cc070 2024-08-31T06:16:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69da7fc640 1 --2- 172.21.15.53:0/3749837544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 0x557fe7688ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.020+0000 7f69db7fe640 1 --2- 172.21.15.53:0/3749837544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7689220 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f69d4011d10 tx=0x7f69d40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6e3a4175ad0b48 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.021+0000 7f69c0ff9640 1 -- 172.21.15.53:0/3749837544 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4003d40 con 0x557fe72cc070 2024-08-31T06:16:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.021+0000 7f69c0ff9640 1 -- 172.21.15.53:0/3749837544 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69d401f040 con 0x557fe72cc070 2024-08-31T06:16:54.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.021+0000 7f69c0ff9640 1 -- 172.21.15.53:0/3749837544 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d400fac0 con 0x557fe72cc070 2024-08-31T06:16:54.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.021+0000 7f69e7c24740 1 -- 172.21.15.53:0/3749837544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 msgr2=0x557fe7689220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:54.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.021+0000 7f69e7c24740 1 --2- 172.21.15.53:0/3749837544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7689220 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f69d4011d10 tx=0x7f69d40047d0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 -- 172.21.15.53:0/3749837544 shutdown_connections 2024-08-31T06:16:54.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 --2- 172.21.15.53:0/3749837544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72cc070 0x557fe7689220 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 --2- 172.21.15.53:0/3749837544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 0x557fe7688ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 --2- 172.21.15.53:0/3749837544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72a31b0 0x557fe7674b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 -- 172.21.15.53:0/3749837544 >> 172.21.15.53:0/3749837544 conn(0x557fe72c0460 msgr2=0x557fe7674410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 -- 172.21.15.53:0/3749837544 shutdown_connections 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 -- 172.21.15.53:0/3749837544 wait complete. 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 -- start start 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 Processor -- start 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72a31b0 0x557fe7681000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 0x557fe7681540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.022+0000 7f69e7c24740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72cc070 0x557fe76f8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69e7c24740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc1b0900 con 0x557fe72a31b0 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69e7c24740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc1b01a0 con 0x557fe72cc070 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69e7c24740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc1ad400 con 0x557fe72ab390 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69e7c24740 10 client.0 _ll_register_callbacks cb 0x7f69d0009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69da7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 0x557fe7681540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69da7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 0x557fe7681540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48234/0 (socket says 172.21.15.53:48234) 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69da7fc640 1 -- 172.21.15.53:0/1172286035 learned_addr learned my addr 172.21.15.53:0/1172286035 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69db7fe640 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72a31b0 0x557fe7681000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69da7fc640 1 -- 172.21.15.53:0/1172286035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72cc070 msgr2=0x557fe76f8830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69da7fc640 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72cc070 0x557fe76f8830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69da7fc640 1 -- 172.21.15.53:0/1172286035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72a31b0 msgr2=0x557fe7681000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69da7fc640 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72a31b0 0x557fe7681000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69da7fc640 1 -- 172.21.15.53:0/1172286035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fe7675060 con 0x557fe72ab390 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69db7fe640 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72a31b0 0x557fe7681000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69da7fc640 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 0x557fe7681540 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f69d0000c00 tx=0x7f69d0009d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de2bd50fa6b63b02 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69beff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.023+0000 7f69beff5640 1 -- 172.21.15.53:0/1172286035 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d000fb30 con 0x557fe72ab390 2024-08-31T06:16:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69beff5640 1 -- 172.21.15.53:0/1172286035 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f69d000fcd0 con 0x557fe72ab390 2024-08-31T06:16:54.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69e7c24740 1 -- 172.21.15.53:0/1172286035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69d401f040 con 0x557fe72ab390 2024-08-31T06:16:54.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69beff5640 1 -- 172.21.15.53:0/1172286035 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f69d0036050 con 0x557fe72ab390 2024-08-31T06:16:54.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69e7c24740 10 client.28441 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:54.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69e7c24740 1 -- 172.21.15.53:0/1172286035 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557fe76f9bd0 con 0x557fe72ab390 2024-08-31T06:16:54.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69beff5640 1 -- 172.21.15.53:0/1172286035 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69d401f040 con 0x557fe72ab390 2024-08-31T06:16:54.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69beff5640 1 -- 172.21.15.53:0/1172286035 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f69d002f060 con 0x557fe72ab390 2024-08-31T06:16:54.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69e7c24740 10 client.28441 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:54.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69e7c24740 10 client.28441 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:16:54.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69e7c24740 20 client.28441 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:54.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x557fe725fda0 0x557fe76fc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69e7c24740 4 client.28441 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69e7c24740 1 -- 172.21.15.53:0/1172286035 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557fe75e6070 con 0x557fe725fda0 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.024+0000 7f69db7fe640 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x557fe725fda0 0x557fe76fc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69db7fe640 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x557fe725fda0 0x557fe76fc390 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=817d0caa6ba2f781 server_cookie=81fd0e641185a5c9 in_seq=0 out_seq=0 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69beff5640 10 client.28441 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69beff5640 1 -- 172.21.15.53:0/1172286035 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557fe75e6070 con 0x557fe725fda0 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69beff5640 10 client.28441 handle_command_reply: tid=0 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 1 client.28441 shutdown 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 1 -- 172.21.15.53:0/1172286035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 msgr2=0x557fe7681540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 0x557fe7681540 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f69d0000c00 tx=0x7f69d0009d60 comp rx=0 tx=0).stop 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 1 -- 172.21.15.53:0/1172286035 shutdown_connections 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x557fe725fda0 0x557fe76fc390 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557fe72cc070 0x557fe76f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557fe72ab390 0x557fe7681540 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69beff5640 0 client.28441 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:16:54.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 1 --2- 172.21.15.53:0/1172286035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557fe72a31b0 0x557fe7681000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 1 -- 172.21.15.53:0/1172286035 >> 172.21.15.53:0/1172286035 conn(0x557fe72c0460 msgr2=0x557fe7672340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:54.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 1 -- 172.21.15.53:0/1172286035 shutdown_connections 2024-08-31T06:16:54.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 1 -- 172.21.15.53:0/1172286035 wait complete. 2024-08-31T06:16:54.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.025+0000 7f69e7c24740 20 client.28441 trim_cache size 0 max 16384 2024-08-31T06:16:54.033 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:16:54.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 -- 172.21.15.53:0/3807856076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69c40b4ca0 msgr2=0x7f69c40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:54.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69c40b4ca0 0x7f69c40b71b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f69cc103090 tx=0x7f69cc10b550 comp rx=0 tx=0).stop 2024-08-31T06:16:54.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 -- 172.21.15.53:0/3807856076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc102800 msgr2=0x7f69dc19a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:54.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc102800 0x7f69dc19a120 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009230 tx=0x7f69cc0319a0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 -- 172.21.15.53:0/3807856076 shutdown_connections 2024-08-31T06:16:54.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f69c40b4ca0 0x7f69c40b71b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69dc108a90 0x7f69dc19f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69dc108140 0x7f69dc19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 --2- 172.21.15.53:0/3807856076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc102800 0x7f69dc19a120 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:54.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 -- 172.21.15.53:0/3807856076 >> 172.21.15.53:0/3807856076 conn(0x7f69dc0794d0 msgr2=0x7f69dc1018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:54.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 -- 172.21.15.53:0/3807856076 shutdown_connections 2024-08-31T06:16:54.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:54.026+0000 7f69e16af640 1 -- 172.21.15.53:0/3807856076 wait complete. 2024-08-31T06:16:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:53 smithi130 ceph-mon[22266]: pgmap v693: 97 pgs: 97 active+clean; 105 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 692 KiB/s wr, 76 op/s 2024-08-31T06:16:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:53 smithi153 ceph-mon[22320]: pgmap v693: 97 pgs: 97 active+clean; 105 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 692 KiB/s wr, 76 op/s 2024-08-31T06:16:54.746 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:16:54.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 182471 1.34 MB/sec execute 524 sec latency 24.165 ms 2024-08-31T06:16:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.506+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2479239554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0108170 msgr2=0x7fb0a0108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.506+0000 7fb0a5f86640 1 --2- 172.21.15.53:0/2479239554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0108170 0x7fb0a0108580 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb094009900 tx=0x7fb09402a410 comp rx=0 tx=0).stop 2024-08-31T06:16:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.506+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2479239554 shutdown_connections 2024-08-31T06:16:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.506+0000 7fb0a5f86640 1 --2- 172.21.15.53:0/2479239554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0a0108ac0 0x7fb0a010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.506+0000 7fb0a5f86640 1 --2- 172.21.15.53:0/2479239554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0108170 0x7fb0a0108580 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.506+0000 7fb0a5f86640 1 --2- 172.21.15.53:0/2479239554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a0102880 0x7fb0a0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.506+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2479239554 >> 172.21.15.53:0/2479239554 conn(0x7fb0a0079550 msgr2=0x7fb0a0079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.506+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2479239554 shutdown_connections 2024-08-31T06:16:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.506+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2479239554 wait complete. 2024-08-31T06:16:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.507+0000 7fb0a5f86640 1 Processor -- start 2024-08-31T06:16:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.507+0000 7fb0a5f86640 1 -- start start 2024-08-31T06:16:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.507+0000 7fb0a5f86640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0a0102880 0x7fb0a019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.507+0000 7fb0a5f86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0108170 0x7fb0a019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.507+0000 7fb0a5f86640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a0108ac0 0x7fb0a019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.507+0000 7fb0a5f86640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01125e0 con 0x7fb0a0108170 2024-08-31T06:16:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.507+0000 7fb0a5f86640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a0112460 con 0x7fb0a0102880 2024-08-31T06:16:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.507+0000 7fb0a5f86640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a0112760 con 0x7fb0a0108ac0 2024-08-31T06:16:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.507+0000 7fb09effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0108170 0x7fb0a019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.507+0000 7fb09f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0a0102880 0x7fb0a019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.507+0000 7fb09f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0a0102880 0x7fb0a019af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:41982/0 (socket says 172.21.15.53:41982) 2024-08-31T06:16:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09f7fe640 1 -- 172.21.15.53:0/2310799720 learned_addr learned my addr 172.21.15.53:0/2310799720 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09ffff640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a0108ac0 0x7fb0a019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09effd640 1 -- 172.21.15.53:0/2310799720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a0108ac0 msgr2=0x7fb0a019b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09effd640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a0108ac0 0x7fb0a019b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09effd640 1 -- 172.21.15.53:0/2310799720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0a0102880 msgr2=0x7fb0a019af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09effd640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0a0102880 0x7fb0a019af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09effd640 1 -- 172.21.15.53:0/2310799720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a01a6280 con 0x7fb0a0108170 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0a0102880 0x7fb0a019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09effd640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0108170 0x7fb0a019b4b0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb09402a930 tx=0x7fb0940040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09cff9640 1 -- 172.21.15.53:0/2310799720 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09403f070 con 0x7fb0a0108170 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09cff9640 1 -- 172.21.15.53:0/2310799720 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb094003c80 con 0x7fb0a0108170 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2310799720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a01a6510 con 0x7fb0a0108170 2024-08-31T06:16:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb09cff9640 1 -- 172.21.15.53:0/2310799720 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094035070 con 0x7fb0a0108170 2024-08-31T06:16:55.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.508+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2310799720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a01a6a10 con 0x7fb0a0108170 2024-08-31T06:16:55.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.511+0000 7fb0ac4fb740 1 Processor -- start 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.511+0000 7fb09cff9640 1 -- 172.21.15.53:0/2310799720 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb09403b460 con 0x7fb0a0108170 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.511+0000 7fb0ac4fb740 1 -- start start 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.511+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928aa1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.511+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 0x556928aa1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.511+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928aa1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.511+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556928a18680 con 0x5569286fc070 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.511+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556928a07c10 con 0x5569286db390 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.511+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556928a0bbc0 con 0x5569286d31b0 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928aa1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 0x556928aa1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928aa1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38552/0 (socket says 172.21.15.53:38552) 2024-08-31T06:16:55.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09ffff640 1 -- 172.21.15.53:0/1801927806 learned_addr learned my addr 172.21.15.53:0/1801927806 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 0x556928aa1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48256/0 (socket says 172.21.15.53:48256) 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09effd640 1 --2- 172.21.15.53:0/1801927806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928aa1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09f7fe640 1 -- 172.21.15.53:0/1801927806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 msgr2=0x556928aa1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/1801927806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928aa1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09f7fe640 1 -- 172.21.15.53:0/1801927806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 msgr2=0x556928aa1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/1801927806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928aa1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09cff9640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0880b4d20 0x7fb0880b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09f7fe640 1 -- 172.21.15.53:0/1801927806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556928767650 con 0x5569286d31b0 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09ffff640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0880b4d20 0x7fb0880b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09cff9640 1 -- 172.21.15.53:0/2310799720 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fb094105b00 con 0x7fb0a0108170 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/1801927806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 0x556928aa1890 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb090005fd0 tx=0x7fb0900109e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=734cb54f94f5d5fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.512+0000 7fb085ffb640 1 -- 172.21.15.53:0/1801927806 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090004230 con 0x5569286d31b0 2024-08-31T06:16:55.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.513+0000 7fb085ffb640 1 -- 172.21.15.53:0/1801927806 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0900043d0 con 0x5569286d31b0 2024-08-31T06:16:55.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.513+0000 7fb085ffb640 1 -- 172.21.15.53:0/1801927806 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090004e30 con 0x5569286d31b0 2024-08-31T06:16:55.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.513+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1801927806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 msgr2=0x556928aa1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:55.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.513+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1801927806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 0x556928aa1890 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb090005fd0 tx=0x7fb0900109e0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.513+0000 7fb09ffff640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0880b4d20 0x7fb0880b7230 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb098011500 tx=0x7fb0980096a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:55.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.513+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1801927806 shutdown_connections 2024-08-31T06:16:55.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.513+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1801927806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928aa1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.513+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1801927806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 0x556928aa1890 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.513+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1801927806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928aa1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.513+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1801927806 >> 172.21.15.53:0/1801927806 conn(0x5569286f0460 msgr2=0x556928a9f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:55.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.514+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1801927806 shutdown_connections 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.514+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1801927806 wait complete. 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.514+0000 7fb0ac4fb740 1 -- start start 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.514+0000 7fb0ac4fb740 1 Processor -- start 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.514+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286d31b0 0x556928aacb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.514+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928aad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.514+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286fc070 0x556928ab8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb09f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286d31b0 0x556928aacb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55692886a700 con 0x5569286d31b0 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55692898e750 con 0x5569286db390 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb09f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286d31b0 0x556928aacb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38558/0 (socket says 172.21.15.53:38558) 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb09f7fe640 1 -- 172.21.15.53:0/1332491036 learned_addr learned my addr 172.21.15.53:0/1332491036 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:55.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb09effd640 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928aad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556928aafb30 con 0x5569286fc070 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb09ffff640 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286fc070 0x556928ab8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb0ac4fb740 10 client.0 _ll_register_callbacks cb 0x5569289bde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb09f7fe640 1 -- 172.21.15.53:0/1332491036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286fc070 msgr2=0x556928ab8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286fc070 0x556928ab8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb09f7fe640 1 -- 172.21.15.53:0/1332491036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 msgr2=0x556928aad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928aad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb09f7fe640 1 -- 172.21.15.53:0/1332491036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569289c7900 con 0x5569286d31b0 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286d31b0 0x556928aacb40 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fb09000b740 tx=0x7fb090004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b780705fc4a4652b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.515+0000 7fb07effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb07effd640 1 -- 172.21.15.53:0/1332491036 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090029060 con 0x5569286d31b0 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb07effd640 1 -- 172.21.15.53:0/1332491036 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fb09000e980 con 0x5569286d31b0 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1332491036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0900043d0 con 0x5569286d31b0 2024-08-31T06:16:55.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb07effd640 1 -- 172.21.15.53:0/1332491036 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb09000eb80 con 0x5569286d31b0 2024-08-31T06:16:55.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb0ac4fb740 10 client.19383 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:55.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1332491036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x556928abb6d0 con 0x5569286d31b0 2024-08-31T06:16:55.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb07effd640 1 -- 172.21.15.53:0/1332491036 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0900043d0 con 0x5569286d31b0 2024-08-31T06:16:55.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb07effd640 1 -- 172.21.15.53:0/1332491036 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7fb090019420 con 0x5569286d31b0 2024-08-31T06:16:55.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb0ac4fb740 10 client.19383 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:55.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb0ac4fb740 10 client.19383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:55.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb0ac4fb740 20 client.19383 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:55.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5569286ba9f0 0x556928abcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb0ac4fb740 4 client.19383 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:55.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.516+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1332491036 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556928a1a5d0 con 0x5569286ba9f0 2024-08-31T06:16:55.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.517+0000 7fb09effd640 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5569286ba9f0 0x556928abcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.517+0000 7fb07effd640 10 client.19383 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:55.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.517+0000 7fb09effd640 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5569286ba9f0 0x556928abcb30 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e60b37443caeb2d server_cookie=6955256c84c50b27 in_seq=0 out_seq=0 2024-08-31T06:16:55.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.518+0000 7fb07effd640 1 -- 172.21.15.53:0/1332491036 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556928a1a5d0 con 0x5569286ba9f0 2024-08-31T06:16:55.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.518+0000 7fb07effd640 10 client.19383 handle_command_reply: tid=0 2024-08-31T06:16:55.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.518+0000 7fb0ac4fb740 1 client.19383 shutdown 2024-08-31T06:16:55.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1332491036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286d31b0 msgr2=0x556928aacb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:55.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286d31b0 0x556928aacb40 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fb09000b740 tx=0x7fb090004750 comp rx=0 tx=0).stop 2024-08-31T06:16:55.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1332491036 shutdown_connections 2024-08-31T06:16:55.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5569286ba9f0 0x556928abcb30 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286fc070 0x556928ab8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928aad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1332491036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286d31b0 0x556928aacb40 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1332491036 >> 172.21.15.53:0/1332491036 conn(0x5569286f0460 msgr2=0x556928aa4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:55.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb07effd640 0 client.19383 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:55.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1332491036 shutdown_connections 2024-08-31T06:16:55.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1332491036 wait complete. 2024-08-31T06:16:55.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.519+0000 7fb0ac4fb740 20 client.19383 trim_cache size 0 max 16384 2024-08-31T06:16:55.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb0ac4fb740 1 Processor -- start 2024-08-31T06:16:55.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb0ac4fb740 1 -- start start 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286d31b0 0x556928aa4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286db390 0x556928aa4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928aa9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01ad260 con 0x5569286fc070 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01aeef0 con 0x5569286d31b0 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01ad930 con 0x5569286db390 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb09f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286d31b0 0x556928aa4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb09f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286d31b0 0x556928aa4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:42012/0 (socket says 172.21.15.53:42012) 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb09f7fe640 1 -- 172.21.15.53:0/1719591111 learned_addr learned my addr 172.21.15.53:0/1719591111 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.534+0000 7fb09ffff640 1 --2- 172.21.15.53:0/1719591111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928aa9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.535+0000 7fb09effd640 1 --2- 172.21.15.53:0/1719591111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286db390 0x556928aa4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.535+0000 7fb09f7fe640 1 -- 172.21.15.53:0/1719591111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286db390 msgr2=0x556928aa4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:55.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.535+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/1719591111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286db390 0x556928aa4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.535+0000 7fb09f7fe640 1 -- 172.21.15.53:0/1719591111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 msgr2=0x556928aa9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:55.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.535+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/1719591111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928aa9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.535+0000 7fb09f7fe640 1 -- 172.21.15.53:0/1719591111 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556928aab040 con 0x5569286d31b0 2024-08-31T06:16:55.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.535+0000 7fb09effd640 1 --2- 172.21.15.53:0/1719591111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286db390 0x556928aa4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:55.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.535+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/1719591111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286d31b0 0x556928aa4450 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb090010fb0 tx=0x7fb090019f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b369acd2effeb337 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:55.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.535+0000 7fb0857fa640 1 -- 172.21.15.53:0/1719591111 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090029030 con 0x5569286d31b0 2024-08-31T06:16:55.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.535+0000 7fb0857fa640 1 -- 172.21.15.53:0/1719591111 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb090004500 con 0x5569286d31b0 2024-08-31T06:16:55.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.535+0000 7fb0857fa640 1 -- 172.21.15.53:0/1719591111 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090019a60 con 0x5569286d31b0 2024-08-31T06:16:55.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.536+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1719591111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286d31b0 msgr2=0x556928aa4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:55.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.536+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1719591111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286d31b0 0x556928aa4450 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb090010fb0 tx=0x7fb090019f00 comp rx=0 tx=0).stop 2024-08-31T06:16:55.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.536+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1719591111 shutdown_connections 2024-08-31T06:16:55.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.536+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1719591111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928aa9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.536+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1719591111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286db390 0x556928aa4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.536+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/1719591111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286d31b0 0x556928aa4450 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.536+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1719591111 >> 172.21.15.53:0/1719591111 conn(0x5569286f0460 msgr2=0x556928aa7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:55.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.536+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1719591111 shutdown_connections 2024-08-31T06:16:55.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.536+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/1719591111 wait complete. 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb0ac4fb740 1 -- start start 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb0ac4fb740 1 Processor -- start 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 0x556928ac2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928ac2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb0ac4fb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928ac30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01ae760 con 0x5569286fc070 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01ae000 con 0x5569286db390 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb0ac4fb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a01ab260 con 0x5569286d31b0 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb0ac4fb740 10 client.0 _ll_register_callbacks cb 0x7fb098009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb09ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928ac30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb09effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928ac2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb09effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928ac2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:42026/0 (socket says 172.21.15.53:42026) 2024-08-31T06:16:55.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb09ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928ac30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38568/0 (socket says 172.21.15.53:38568) 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.537+0000 7fb09effd640 1 -- 172.21.15.53:0/2012703738 learned_addr learned my addr 172.21.15.53:0/2012703738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 0x556928ac2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb09effd640 1 -- 172.21.15.53:0/2012703738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 msgr2=0x556928ac2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb09effd640 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 0x556928ac2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb09effd640 1 -- 172.21.15.53:0/2012703738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 msgr2=0x556928ac30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb09effd640 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928ac30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb09effd640 1 -- 172.21.15.53:0/2012703738 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556928b28870 con 0x5569286db390 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb09effd640 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928ac2b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb094103830 tx=0x7fb09402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bde083a8c66ab6c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb07effd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb07effd640 1 -- 172.21.15.53:0/2012703738 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094048040 con 0x5569286db390 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/2012703738 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb090004500 con 0x5569286db390 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb07effd640 1 -- 172.21.15.53:0/2012703738 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fb0940c8870 con 0x5569286db390 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.538+0000 7fb07effd640 1 -- 172.21.15.53:0/2012703738 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb0940cbbd0 con 0x5569286db390 2024-08-31T06:16:55.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.539+0000 7fb0ac4fb740 10 client.28475 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:55.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.539+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/2012703738 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x556928b29b50 con 0x5569286db390 2024-08-31T06:16:55.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.539+0000 7fb07effd640 1 -- 172.21.15.53:0/2012703738 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb090004500 con 0x5569286db390 2024-08-31T06:16:55.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.539+0000 7fb07effd640 1 -- 172.21.15.53:0/2012703738 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7fb09404b060 con 0x5569286db390 2024-08-31T06:16:55.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.539+0000 7fb0ac4fb740 10 client.28475 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:55.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.539+0000 7fb0ac4fb740 10 client.28475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:55.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.539+0000 7fb0ac4fb740 20 client.28475 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:55.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.539+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55692868fda0 0x556928b2c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:55.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.539+0000 7fb0ac4fb740 4 client.28475 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:16:55.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.539+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/2012703738 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556928a16070 con 0x55692868fda0 2024-08-31T06:16:55.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.539+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55692868fda0 0x556928b2c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:55.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.540+0000 7fb07effd640 10 client.28475 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.540+0000 7fb09f7fe640 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55692868fda0 0x556928b2c2f0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89f5ab3817a37f3e server_cookie=795c80d8eaae0e75 in_seq=0 out_seq=0 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb07effd640 1 -- 172.21.15.53:0/2012703738 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556928a16070 con 0x55692868fda0 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb07effd640 10 client.28475 handle_command_reply: tid=0 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 1 client.28475 shutdown 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/2012703738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 msgr2=0x556928ac2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928ac2b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb094103830 tx=0x7fb09402a410 comp rx=0 tx=0).stop 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/2012703738 shutdown_connections 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55692868fda0 0x556928b2c2f0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5569286fc070 0x556928ac30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569286db390 0x556928ac2b80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 1 --2- 172.21.15.53:0/2012703738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5569286d31b0 0x556928ac2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/2012703738 >> 172.21.15.53:0/2012703738 conn(0x5569286f0460 msgr2=0x556928aa4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:55.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb07effd640 0 client.28475 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:55.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/2012703738 shutdown_connections 2024-08-31T06:16:55.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 1 -- 172.21.15.53:0/2012703738 wait complete. 2024-08-31T06:16:55.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.541+0000 7fb0ac4fb740 20 client.28475 trim_cache size 0 max 16384 2024-08-31T06:16:55.549 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:16:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2310799720 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0880b4d20 msgr2=0x7fb0880b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0880b4d20 0x7fb0880b7230 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb098011500 tx=0x7fb0980096a0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2310799720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0108170 msgr2=0x7fb0a019b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0108170 0x7fb0a019b4b0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb09402a930 tx=0x7fb0940040e0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2310799720 shutdown_connections 2024-08-31T06:16:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0880b4d20 0x7fb0880b7230 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a0108ac0 0x7fb0a019b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0108170 0x7fb0a019b4b0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 --2- 172.21.15.53:0/2310799720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0a0102880 0x7fb0a019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:55.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2310799720 >> 172.21.15.53:0/2310799720 conn(0x7fb0a0079550 msgr2=0x7fb0a01062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:55.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2310799720 shutdown_connections 2024-08-31T06:16:55.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:55.542+0000 7fb0a5f86640 1 -- 172.21.15.53:0/2310799720 wait complete. 2024-08-31T06:16:55.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:55 smithi053 ceph-mon[18924]: pgmap v694: 97 pgs: 97 active+clean; 107 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 815 KiB/s wr, 86 op/s 2024-08-31T06:16:55.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 182966 1.34 MB/sec execute 525 sec latency 46.206 ms 2024-08-31T06:16:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:55 smithi130 ceph-mon[22266]: pgmap v694: 97 pgs: 97 active+clean; 107 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 815 KiB/s wr, 86 op/s 2024-08-31T06:16:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:55 smithi153 ceph-mon[22320]: pgmap v694: 97 pgs: 97 active+clean; 107 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 815 KiB/s wr, 86 op/s 2024-08-31T06:16:56.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 183461 1.34 MB/sec execute 526 sec latency 25.931 ms 2024-08-31T06:16:57.257 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:16:57.257 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:16:57.521 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:57.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:57 smithi053 ceph-mon[18924]: pgmap v695: 97 pgs: 97 active+clean; 106 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 752 KiB/s wr, 68 op/s 2024-08-31T06:16:57.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 184178 1.35 MB/sec execute 527 sec latency 46.653 ms 2024-08-31T06:16:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.082+0000 7fb02b405640 1 -- 172.21.15.53:0/3633081278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb024102800 msgr2=0x7fb024102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.082+0000 7fb02b405640 1 --2- 172.21.15.53:0/3633081278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb024102800 0x7fb024102c10 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fb020009900 tx=0x7fb02002a410 comp rx=0 tx=0).stop 2024-08-31T06:16:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.082+0000 7fb02b405640 1 -- 172.21.15.53:0/3633081278 shutdown_connections 2024-08-31T06:16:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.082+0000 7fb02b405640 1 --2- 172.21.15.53:0/3633081278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb024108a90 0x7fb02410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.082+0000 7fb02b405640 1 --2- 172.21.15.53:0/3633081278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb024108140 0x7fb024108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.082+0000 7fb02b405640 1 --2- 172.21.15.53:0/3633081278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb024102800 0x7fb024102c10 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.082+0000 7fb02b405640 1 -- 172.21.15.53:0/3633081278 >> 172.21.15.53:0/3633081278 conn(0x7fb0240794d0 msgr2=0x7fb0240798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.082+0000 7fb02b405640 1 -- 172.21.15.53:0/3633081278 shutdown_connections 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.082+0000 7fb02b405640 1 -- 172.21.15.53:0/3633081278 wait complete. 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb02b405640 1 Processor -- start 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb02b405640 1 -- start start 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb02b405640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb024102800 0x7fb024103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb02b405640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb024108140 0x7fb024104530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb02b405640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb024108a90 0x7fb024104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb02b405640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb0241125c0 con 0x7fb024108a90 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb02b405640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb024112440 con 0x7fb024108140 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb02b405640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb024112740 con 0x7fb024102800 2024-08-31T06:16:58.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb0299a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb024108a90 0x7fb024104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb0299a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb024108a90 0x7fb024104a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38592/0 (socket says 172.21.15.53:38592) 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb0299a2640 1 -- 172.21.15.53:0/145770903 learned_addr learned my addr 172.21.15.53:0/145770903 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb0289a0640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb024108140 0x7fb024104530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.083+0000 7fb0291a1640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb024102800 0x7fb024103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb0299a2640 1 -- 172.21.15.53:0/145770903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb024102800 msgr2=0x7fb024103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb0299a2640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb024102800 0x7fb024103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb0299a2640 1 -- 172.21.15.53:0/145770903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb024108140 msgr2=0x7fb024104530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb0299a2640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb024108140 0x7fb024104530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb0299a2640 1 -- 172.21.15.53:0/145770903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0241a83e0 con 0x7fb024108a90 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb0289a0640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb024108140 0x7fb024104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb0299a2640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb024108a90 0x7fb024104a70 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00eb10 tx=0x7fb01c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb01a7fc640 1 -- 172.21.15.53:0/145770903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c004b20 con 0x7fb024108a90 2024-08-31T06:16:58.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb02b405640 1 -- 172.21.15.53:0/145770903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0241a86d0 con 0x7fb024108a90 2024-08-31T06:16:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb01a7fc640 1 -- 172.21.15.53:0/145770903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb01c004cc0 con 0x7fb024108a90 2024-08-31T06:16:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb01a7fc640 1 -- 172.21.15.53:0/145770903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c010690 con 0x7fb024108a90 2024-08-31T06:16:58.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.084+0000 7fb02b405640 1 -- 172.21.15.53:0/145770903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0241a8bc0 con 0x7fb024108a90 2024-08-31T06:16:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.087+0000 7fb03197a740 1 Processor -- start 2024-08-31T06:16:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.087+0000 7fb01a7fc640 1 -- 172.21.15.53:0/145770903 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb01c005020 con 0x7fb024108a90 2024-08-31T06:16:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.087+0000 7fb03197a740 1 -- start start 2024-08-31T06:16:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.087+0000 7fb03197a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338f0350 0x560b33c96780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.087+0000 7fb03197a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33c96cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.087+0000 7fb03197a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338cf670 0x560b33c97200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.087+0000 7fb03197a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560b33c0c5f0 con 0x560b338cf670 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.087+0000 7fb03197a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560b33bfbb80 con 0x560b338c7490 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.087+0000 7fb03197a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560b33bffb30 con 0x560b338f0350 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0289a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338cf670 0x560b33c97200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0291a1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33c96cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0291a1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33c96cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:42052/0 (socket says 172.21.15.53:42052) 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0291a1640 1 -- 172.21.15.53:0/3354073697 learned_addr learned my addr 172.21.15.53:0/3354073697 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0289a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338cf670 0x560b33c97200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38598/0 (socket says 172.21.15.53:38598) 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0289a0640 1 --2- 172.21.15.53:0/3354073697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338f0350 0x560b33c96780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0291a1640 1 -- 172.21.15.53:0/3354073697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338f0350 msgr2=0x560b33c96780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0291a1640 1 --2- 172.21.15.53:0/3354073697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338f0350 0x560b33c96780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0291a1640 1 -- 172.21.15.53:0/3354073697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338cf670 msgr2=0x560b33c97200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:58.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0291a1640 1 --2- 172.21.15.53:0/3354073697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338cf670 0x560b33c97200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0291a1640 1 -- 172.21.15.53:0/3354073697 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3395b930 con 0x560b338c7490 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb01a7fc640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0100b4ca0 0x7fb0100b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0289a0640 1 --2- 172.21.15.53:0/3354073697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338f0350 0x560b33c96780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0289a0640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0100b4ca0 0x7fb0100b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb01a7fc640 1 -- 172.21.15.53:0/145770903 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fb01c0e5b40 con 0x7fb024108a90 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.088+0000 7fb0291a1640 1 --2- 172.21.15.53:0/3354073697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33c96cc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb020000c00 tx=0x7fb020031ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=798be8333a453e4f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.089+0000 7fb00f7fe640 1 -- 172.21.15.53:0/3354073697 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020035030 con 0x560b338c7490 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.089+0000 7fb00f7fe640 1 -- 172.21.15.53:0/3354073697 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb020040070 con 0x560b338c7490 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.089+0000 7fb00f7fe640 1 -- 172.21.15.53:0/3354073697 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0200037f0 con 0x560b338c7490 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb03197a740 1 -- 172.21.15.53:0/3354073697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 msgr2=0x560b33c96cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb0289a0640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0100b4ca0 0x7fb0100b71b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb01400bfd0 tx=0x7fb014004730 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:58.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb03197a740 1 --2- 172.21.15.53:0/3354073697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33c96cc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb020000c00 tx=0x7fb020031ba0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb03197a740 1 -- 172.21.15.53:0/3354073697 shutdown_connections 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb03197a740 1 --2- 172.21.15.53:0/3354073697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338cf670 0x560b33c97200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb03197a740 1 --2- 172.21.15.53:0/3354073697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33c96cc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb03197a740 1 --2- 172.21.15.53:0/3354073697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338f0350 0x560b33c96780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb03197a740 1 -- 172.21.15.53:0/3354073697 >> 172.21.15.53:0/3354073697 conn(0x560b338e4740 msgr2=0x560b33c94670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb03197a740 1 -- 172.21.15.53:0/3354073697 shutdown_connections 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb03197a740 1 -- 172.21.15.53:0/3354073697 wait complete. 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb03197a740 1 -- start start 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.090+0000 7fb03197a740 1 Processor -- start 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb03197a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 0x560b33ca1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb03197a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 0x560b33ca2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb03197a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338f0350 0x560b33cae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb03197a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560b33a5e890 con 0x560b338f0350 2024-08-31T06:16:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb03197a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560b33b82790 con 0x560b338cf670 2024-08-31T06:16:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb03197a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560b33ca4f00 con 0x560b338c7490 2024-08-31T06:16:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb03197a740 10 client.0 _ll_register_callbacks cb 0x560b33907ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb0289a0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 0x560b33ca2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb0289a0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 0x560b33ca2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:42054/0 (socket says 172.21.15.53:42054) 2024-08-31T06:16:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb0289a0640 1 -- 172.21.15.53:0/784633052 learned_addr learned my addr 172.21.15.53:0/784633052 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb0299a2640 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338f0350 0x560b33cae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb0291a1640 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 0x560b33ca1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb0289a0640 1 -- 172.21.15.53:0/784633052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 msgr2=0x560b33ca1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:58.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb0289a0640 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 0x560b33ca1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb0289a0640 1 -- 172.21.15.53:0/784633052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338f0350 msgr2=0x560b33cae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb0289a0640 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338f0350 0x560b33cae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.091+0000 7fb0289a0640 1 -- 172.21.15.53:0/784633052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b33bb9f30 con 0x560b338cf670 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.092+0000 7fb0291a1640 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 0x560b33ca1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.092+0000 7fb0299a2640 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338f0350 0x560b33cae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.092+0000 7fb0289a0640 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 0x560b33ca2430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0140127e0 tx=0x7fb01400b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=881f684b6b751f7f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.092+0000 7fb00cff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.092+0000 7fb00cff9640 1 -- 172.21.15.53:0/784633052 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb014011b60 con 0x560b338cf670 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.092+0000 7fb00cff9640 1 -- 172.21.15.53:0/784633052 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fb014011d00 con 0x560b338cf670 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.092+0000 7fb03197a740 1 -- 172.21.15.53:0/784633052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb020040070 con 0x560b338cf670 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.092+0000 7fb00cff9640 1 -- 172.21.15.53:0/784633052 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb01402b470 con 0x560b338cf670 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.092+0000 7fb03197a740 10 client.28487 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.092+0000 7fb03197a740 1 -- 172.21.15.53:0/784633052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560b33cb0d30 con 0x560b338cf670 2024-08-31T06:16:58.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.092+0000 7fb00cff9640 1 -- 172.21.15.53:0/784633052 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb020040070 con 0x560b338cf670 2024-08-31T06:16:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.093+0000 7fb00cff9640 1 -- 172.21.15.53:0/784633052 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7fb0140214c0 con 0x560b338cf670 2024-08-31T06:16:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.093+0000 7fb03197a740 10 client.28487 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.093+0000 7fb03197a740 10 client.28487 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.093+0000 7fb03197a740 20 client.28487 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.093+0000 7fb03197a740 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b338aecd0 0x560b33cb4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.093+0000 7fb03197a740 4 client.28487 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.093+0000 7fb03197a740 1 -- 172.21.15.53:0/784633052 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b33c0e540 con 0x560b338aecd0 2024-08-31T06:16:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.093+0000 7fb0291a1640 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b338aecd0 0x560b33cb4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.093+0000 7fb00cff9640 10 client.28487 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.093+0000 7fb0291a1640 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b338aecd0 0x560b33cb4230 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cec834ac38d61f1 server_cookie=79c21fcf8866259e in_seq=0 out_seq=0 2024-08-31T06:16:58.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.094+0000 7fb00cff9640 1 -- 172.21.15.53:0/784633052 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b33c0e540 con 0x560b338aecd0 2024-08-31T06:16:58.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.094+0000 7fb00cff9640 10 client.28487 handle_command_reply: tid=0 2024-08-31T06:16:58.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.094+0000 7fb03197a740 1 client.28487 shutdown 2024-08-31T06:16:58.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb03197a740 1 -- 172.21.15.53:0/784633052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 msgr2=0x560b33ca2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb03197a740 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 0x560b33ca2430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0140127e0 tx=0x7fb01400b390 comp rx=0 tx=0).stop 2024-08-31T06:16:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb03197a740 1 -- 172.21.15.53:0/784633052 shutdown_connections 2024-08-31T06:16:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb03197a740 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b338aecd0 0x560b33cb4230 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb00cff9640 0 client.28487 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb03197a740 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338f0350 0x560b33cae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb03197a740 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 0x560b33ca2430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb03197a740 1 --2- 172.21.15.53:0/784633052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 0x560b33ca1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb03197a740 1 -- 172.21.15.53:0/784633052 >> 172.21.15.53:0/784633052 conn(0x560b338e4740 msgr2=0x560b33c99910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb03197a740 1 -- 172.21.15.53:0/784633052 shutdown_connections 2024-08-31T06:16:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb03197a740 1 -- 172.21.15.53:0/784633052 wait complete. 2024-08-31T06:16:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.095+0000 7fb03197a740 20 client.28487 trim_cache size 0 max 16384 2024-08-31T06:16:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb03197a740 1 Processor -- start 2024-08-31T06:16:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb03197a740 1 -- start start 2024-08-31T06:16:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb03197a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 0x560b33ca3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb03197a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 0x560b33cae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb03197a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 0x560b33c9f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb03197a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb0241b1680 con 0x560b338aecd0 2024-08-31T06:16:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb03197a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb0241b3310 con 0x560b338cf670 2024-08-31T06:16:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb03197a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0241b1d50 con 0x560b338c7490 2024-08-31T06:16:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb0291a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 0x560b33ca3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb0291a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 0x560b33ca3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38622/0 (socket says 172.21.15.53:38622) 2024-08-31T06:16:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb0291a1640 1 -- 172.21.15.53:0/2659579197 learned_addr learned my addr 172.21.15.53:0/2659579197 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb0299a2640 1 --2- 172.21.15.53:0/2659579197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 0x560b33c9f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.116+0000 7fb0289a0640 1 --2- 172.21.15.53:0/2659579197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 0x560b33cae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.117+0000 7fb0291a1640 1 -- 172.21.15.53:0/2659579197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 msgr2=0x560b33cae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.117+0000 7fb0291a1640 1 --2- 172.21.15.53:0/2659579197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 0x560b33cae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.117+0000 7fb0291a1640 1 -- 172.21.15.53:0/2659579197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 msgr2=0x560b33c9f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.117+0000 7fb0291a1640 1 --2- 172.21.15.53:0/2659579197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 0x560b33c9f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.117+0000 7fb0291a1640 1 -- 172.21.15.53:0/2659579197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b33c995e0 con 0x560b338aecd0 2024-08-31T06:16:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.117+0000 7fb0289a0640 1 --2- 172.21.15.53:0/2659579197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 0x560b33cae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.117+0000 7fb0299a2640 1 --2- 172.21.15.53:0/2659579197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 0x560b33c9f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.117+0000 7fb0291a1640 1 --2- 172.21.15.53:0/2659579197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 0x560b33ca3b20 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fb020009900 tx=0x7fb0200058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d024efbf115f7034 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.117+0000 7fb00effd640 1 -- 172.21.15.53:0/2659579197 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020035040 con 0x560b338aecd0 2024-08-31T06:16:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.117+0000 7fb00effd640 1 -- 172.21.15.53:0/2659579197 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb020040050 con 0x560b338aecd0 2024-08-31T06:16:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.117+0000 7fb00effd640 1 -- 172.21.15.53:0/2659579197 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020003970 con 0x560b338aecd0 2024-08-31T06:16:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.118+0000 7fb03197a740 1 -- 172.21.15.53:0/2659579197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 msgr2=0x560b33ca3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.118+0000 7fb03197a740 1 --2- 172.21.15.53:0/2659579197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 0x560b33ca3b20 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fb020009900 tx=0x7fb0200058d0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.118+0000 7fb03197a740 1 -- 172.21.15.53:0/2659579197 shutdown_connections 2024-08-31T06:16:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.118+0000 7fb03197a740 1 --2- 172.21.15.53:0/2659579197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338cf670 0x560b33c9f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.118+0000 7fb03197a740 1 --2- 172.21.15.53:0/2659579197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338c7490 0x560b33cae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.118+0000 7fb03197a740 1 --2- 172.21.15.53:0/2659579197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 0x560b33ca3b20 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.118+0000 7fb03197a740 1 -- 172.21.15.53:0/2659579197 >> 172.21.15.53:0/2659579197 conn(0x560b338e4740 msgr2=0x560b33ca3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.118+0000 7fb03197a740 1 -- 172.21.15.53:0/2659579197 shutdown_connections 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.118+0000 7fb03197a740 1 -- 172.21.15.53:0/2659579197 wait complete. 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.119+0000 7fb03197a740 1 -- start start 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.119+0000 7fb03197a740 1 Processor -- start 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.119+0000 7fb03197a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 0x560b33caa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.119+0000 7fb03197a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33ca5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.119+0000 7fb03197a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338cf670 0x560b33ca62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.119+0000 7fb03197a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb0241b2b80 con 0x560b338aecd0 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.119+0000 7fb03197a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb0241b2420 con 0x560b338c7490 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.119+0000 7fb03197a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0241af680 con 0x560b338cf670 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.119+0000 7fb03197a740 10 client.0 _ll_register_callbacks cb 0x7fb01400bd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0289a0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33ca5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0291a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 0x560b33caa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0289a0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33ca5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:42062/0 (socket says 172.21.15.53:42062) 2024-08-31T06:16:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0289a0640 1 -- 172.21.15.53:0/1687013302 learned_addr learned my addr 172.21.15.53:0/1687013302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0299a2640 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338cf670 0x560b33ca62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0289a0640 1 -- 172.21.15.53:0/1687013302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338cf670 msgr2=0x560b33ca62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0289a0640 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338cf670 0x560b33ca62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0289a0640 1 -- 172.21.15.53:0/1687013302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 msgr2=0x560b33caa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0289a0640 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 0x560b33caa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0289a0640 1 -- 172.21.15.53:0/1687013302 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b33ca6a10 con 0x560b338c7490 2024-08-31T06:16:58.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0291a1640 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 0x560b33caa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb0289a0640 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33ca5d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb014004700 tx=0x7fb014021df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee7f241a0074237 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb00cff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:16:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb00cff9640 1 -- 172.21.15.53:0/1687013302 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb014021670 con 0x560b338c7490 2024-08-31T06:16:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.120+0000 7fb00cff9640 1 -- 172.21.15.53:0/1687013302 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fb014011bc0 con 0x560b338c7490 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb03197a740 1 -- 172.21.15.53:0/1687013302 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb020040050 con 0x560b338c7490 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb00cff9640 1 -- 172.21.15.53:0/1687013302 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb014011dc0 con 0x560b338c7490 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb03197a740 10 client.28493 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb03197a740 1 -- 172.21.15.53:0/1687013302 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560b33d1ead0 con 0x560b338c7490 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb00cff9640 1 -- 172.21.15.53:0/1687013302 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb020040050 con 0x560b338c7490 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb00cff9640 1 -- 172.21.15.53:0/1687013302 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7fb0140455e0 con 0x560b338c7490 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb03197a740 10 client.28493 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb03197a740 10 client.28493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb03197a740 20 client.28493 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb03197a740 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b338f0350 0x560b33d21350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb03197a740 4 client.28493 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb03197a740 1 -- 172.21.15.53:0/1687013302 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560b33c09fe0 con 0x560b338f0350 2024-08-31T06:16:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.121+0000 7fb0291a1640 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b338f0350 0x560b33d21350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.122+0000 7fb00cff9640 10 client.28493 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.122+0000 7fb0291a1640 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b338f0350 0x560b33d21350 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0b50bde396bd136 server_cookie=be0c60cf4520fa9d in_seq=0 out_seq=0 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb00cff9640 1 -- 172.21.15.53:0/1687013302 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560b33c09fe0 con 0x560b338f0350 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb00cff9640 10 client.28493 handle_command_reply: tid=0 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb03197a740 1 client.28493 shutdown 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb03197a740 1 -- 172.21.15.53:0/1687013302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 msgr2=0x560b33ca5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb03197a740 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33ca5d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb014004700 tx=0x7fb014021df0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb03197a740 1 -- 172.21.15.53:0/1687013302 shutdown_connections 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb03197a740 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560b338f0350 0x560b33d21350 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb03197a740 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b338cf670 0x560b33ca62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb03197a740 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560b338c7490 0x560b33ca5d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb03197a740 1 --2- 172.21.15.53:0/1687013302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b338aecd0 0x560b33caa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb03197a740 1 -- 172.21.15.53:0/1687013302 >> 172.21.15.53:0/1687013302 conn(0x560b338e4740 msgr2=0x560b33ca3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:58.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.123+0000 7fb00cff9640 0 client.28493 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:58.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb03197a740 1 -- 172.21.15.53:0/1687013302 shutdown_connections 2024-08-31T06:16:58.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb03197a740 1 -- 172.21.15.53:0/1687013302 wait complete. 2024-08-31T06:16:58.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb03197a740 20 client.28493 trim_cache size 0 max 16384 2024-08-31T06:16:58.129 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:16:58.129 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:16:58.129 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "00e51c37-5337-4356-af2b-24afda8741d6", 2024-08-31T06:16:58.129 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:16:58.130 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:16:58.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb02b405640 1 -- 172.21.15.53:0/145770903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0100b4ca0 msgr2=0x7fb0100b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:58.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb02b405640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0100b4ca0 0x7fb0100b71b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb01400bfd0 tx=0x7fb014004730 comp rx=0 tx=0).stop 2024-08-31T06:16:58.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb02b405640 1 -- 172.21.15.53:0/145770903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb024108a90 msgr2=0x7fb024104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:58.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb02b405640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb024108a90 0x7fb024104a70 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00eb10 tx=0x7fb01c00c2d0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb02b405640 1 -- 172.21.15.53:0/145770903 shutdown_connections 2024-08-31T06:16:58.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb02b405640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb0100b4ca0 0x7fb0100b71b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb02b405640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb024108a90 0x7fb024104a70 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb02b405640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb024108140 0x7fb024104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb02b405640 1 --2- 172.21.15.53:0/145770903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb024102800 0x7fb024103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:58.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb02b405640 1 -- 172.21.15.53:0/145770903 >> 172.21.15.53:0/145770903 conn(0x7fb0240794d0 msgr2=0x7fb024101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:58.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.124+0000 7fb02b405640 1 -- 172.21.15.53:0/145770903 shutdown_connections 2024-08-31T06:16:58.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:58.125+0000 7fb02b405640 1 -- 172.21.15.53:0/145770903 wait complete. 2024-08-31T06:16:58.131 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:57 smithi130 ceph-mon[22266]: pgmap v695: 97 pgs: 97 active+clean; 106 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 752 KiB/s wr, 68 op/s 2024-08-31T06:16:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:57 smithi153 ceph-mon[22320]: pgmap v695: 97 pgs: 97 active+clean; 106 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 752 KiB/s wr, 68 op/s 2024-08-31T06:16:58.907 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:16:58.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:58 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:16:58.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:58 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:58.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:58 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:58.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:58 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:58.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:58 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:58.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:58 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:58.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:58 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:58.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:58 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:58.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:58 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:58.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:58 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:58.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 184478 1.35 MB/sec execute 528 sec latency 30.721 ms 2024-08-31T06:16:59.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:58 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:16:59.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:58 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:58 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:59.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:58 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:59.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:58 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:59.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:58 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:58 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:58 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:16:59.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:58 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:58 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.174 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:16:59.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:58 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:16:59.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:58 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:58 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:59.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:58 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:59.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:58 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:59.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:58 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:58 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:58 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:16:59.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:58 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:58 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.664+0000 7fcee8308640 1 -- 172.21.15.53:0/1686979752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee0102880 msgr2=0x7fcee0102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:59.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.664+0000 7fcee8308640 1 --2- 172.21.15.53:0/1686979752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee0102880 0x7fcee0102c90 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009900 tx=0x7fcedc02a410 comp rx=0 tx=0).stop 2024-08-31T06:16:59.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.664+0000 7fcee8308640 1 -- 172.21.15.53:0/1686979752 shutdown_connections 2024-08-31T06:16:59.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.664+0000 7fcee8308640 1 --2- 172.21.15.53:0/1686979752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0108ac0 0x7fcee010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.664+0000 7fcee8308640 1 --2- 172.21.15.53:0/1686979752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee0108170 0x7fcee0108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.664+0000 7fcee8308640 1 --2- 172.21.15.53:0/1686979752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee0102880 0x7fcee0102c90 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.664+0000 7fcee8308640 1 -- 172.21.15.53:0/1686979752 >> 172.21.15.53:0/1686979752 conn(0x7fcee0079550 msgr2=0x7fcee0079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:59.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.664+0000 7fcee8308640 1 -- 172.21.15.53:0/1686979752 shutdown_connections 2024-08-31T06:16:59.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.664+0000 7fcee8308640 1 -- 172.21.15.53:0/1686979752 wait complete. 2024-08-31T06:16:59.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.665+0000 7fcee8308640 1 Processor -- start 2024-08-31T06:16:59.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.665+0000 7fcee8308640 1 -- start start 2024-08-31T06:16:59.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.665+0000 7fcee8308640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee0102880 0x7fcee01991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.665+0000 7fcee8308640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee0108170 0x7fcee0199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.665+0000 7fcee8308640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0108ac0 0x7fcee019e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.665+0000 7fcee8308640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcee0112620 con 0x7fcee0108170 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.665+0000 7fcee8308640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcee01124a0 con 0x7fcee0108ac0 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.665+0000 7fcee8308640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcee01127a0 con 0x7fcee0102880 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee58a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee0108170 0x7fcee0199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee58a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee0108170 0x7fcee0199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38634/0 (socket says 172.21.15.53:38634) 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee58a3640 1 -- 172.21.15.53:0/1626117557 learned_addr learned my addr 172.21.15.53:0/1626117557 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee60a4640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee0102880 0x7fcee01991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee68a5640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0108ac0 0x7fcee019e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee58a3640 1 -- 172.21.15.53:0/1626117557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee0102880 msgr2=0x7fcee01991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee58a3640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee0102880 0x7fcee01991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee58a3640 1 -- 172.21.15.53:0/1626117557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0108ac0 msgr2=0x7fcee019e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee58a3640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0108ac0 0x7fcee019e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee58a3640 1 -- 172.21.15.53:0/1626117557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee019f120 con 0x7fcee0108170 2024-08-31T06:16:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee68a5640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0108ac0 0x7fcee019e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:16:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee58a3640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee0108170 0x7fcee0199750 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fced00098a0 tx=0x7fced0009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fced77fe640 1 -- 172.21.15.53:0/1626117557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0004020 con 0x7fcee0108170 2024-08-31T06:16:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fced77fe640 1 -- 172.21.15.53:0/1626117557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fced00054b0 con 0x7fcee0108170 2024-08-31T06:16:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fced77fe640 1 -- 172.21.15.53:0/1626117557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0004c40 con 0x7fcee0108170 2024-08-31T06:16:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee8308640 1 -- 172.21.15.53:0/1626117557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee019f410 con 0x7fcee0108170 2024-08-31T06:16:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.666+0000 7fcee8308640 1 -- 172.21.15.53:0/1626117557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee006b5c0 con 0x7fcee0108170 2024-08-31T06:16:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.669+0000 7fceee87d740 1 Processor -- start 2024-08-31T06:16:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.669+0000 7fceee87d740 1 -- start start 2024-08-31T06:16:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.669+0000 7fceee87d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4fc070 0x557e9c8a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.669+0000 7fceee87d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4d31b0 0x557e9c8a1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fceee87d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 0x557e9c8a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fceee87d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557e9c818630 con 0x557e9c4db390 2024-08-31T06:16:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fceee87d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e9c807bc0 con 0x557e9c4d31b0 2024-08-31T06:16:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fceee87d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557e9c80bb70 con 0x557e9c4fc070 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fcee60a4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4d31b0 0x557e9c8a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fced77fe640 1 -- 172.21.15.53:0/1626117557 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fced001f020 con 0x7fcee0108170 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fcee68a5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4fc070 0x557e9c8a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fcee60a4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4d31b0 0x557e9c8a1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:42098/0 (socket says 172.21.15.53:42098) 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fcee60a4640 1 -- 172.21.15.53:0/17892014 learned_addr learned my addr 172.21.15.53:0/17892014 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fcee58a3640 1 --2- 172.21.15.53:0/17892014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 0x557e9c8a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fcee68a5640 1 -- 172.21.15.53:0/17892014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4d31b0 msgr2=0x557e9c8a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fcee68a5640 1 --2- 172.21.15.53:0/17892014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4d31b0 0x557e9c8a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fcee68a5640 1 -- 172.21.15.53:0/17892014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 msgr2=0x557e9c8a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fcee68a5640 1 --2- 172.21.15.53:0/17892014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 0x557e9c8a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.670+0000 7fcee68a5640 1 -- 172.21.15.53:0/17892014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9c567650 con 0x557e9c4fc070 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.671+0000 7fcee68a5640 1 --2- 172.21.15.53:0/17892014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4fc070 0x557e9c8a12c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fced8009d80 tx=0x7fced800f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f2523c4c20bf09c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.671+0000 7fced4d9a640 1 -- 172.21.15.53:0/17892014 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8004b20 con 0x557e9c4fc070 2024-08-31T06:16:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.671+0000 7fced77fe640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcecc0b4ca0 0x7fcecc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.671+0000 7fced4d9a640 1 -- 172.21.15.53:0/17892014 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fced8004cc0 con 0x557e9c4fc070 2024-08-31T06:16:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.671+0000 7fced4d9a640 1 -- 172.21.15.53:0/17892014 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8011640 con 0x557e9c4fc070 2024-08-31T06:16:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.671+0000 7fcee60a4640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcecc0b4ca0 0x7fcecc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.671+0000 7fced77fe640 1 -- 172.21.15.53:0/1626117557 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fced00e6760 con 0x7fcee0108170 2024-08-31T06:16:59.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fceee87d740 1 -- 172.21.15.53:0/17892014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4fc070 msgr2=0x557e9c8a12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:59.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fcee60a4640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcecc0b4ca0 0x7fcecc0b71b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x557e9c89ff40 tx=0x7fcedc005ed0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fceee87d740 1 --2- 172.21.15.53:0/17892014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4fc070 0x557e9c8a12c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fced8009d80 tx=0x7fced800f730 comp rx=0 tx=0).stop 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fceee87d740 1 -- 172.21.15.53:0/17892014 shutdown_connections 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fceee87d740 1 --2- 172.21.15.53:0/17892014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 0x557e9c8a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fceee87d740 1 --2- 172.21.15.53:0/17892014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4d31b0 0x557e9c8a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fceee87d740 1 --2- 172.21.15.53:0/17892014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4fc070 0x557e9c8a12c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fceee87d740 1 -- 172.21.15.53:0/17892014 >> 172.21.15.53:0/17892014 conn(0x557e9c4f0460 msgr2=0x557e9c89f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fceee87d740 1 -- 172.21.15.53:0/17892014 shutdown_connections 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fceee87d740 1 -- 172.21.15.53:0/17892014 wait complete. 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fceee87d740 1 -- start start 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.672+0000 7fceee87d740 1 Processor -- start 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fceee87d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8aca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fceee87d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4db390 0x557e9c8acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fceee87d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c8b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fceee87d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557e9c66a700 con 0x557e9c4d31b0 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fceee87d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e9c78e700 con 0x557e9c4fc070 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fceee87d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557e9c8afaa0 con 0x557e9c4db390 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fceee87d740 10 client.0 _ll_register_callbacks cb 0x557e9c7bddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee60a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee60a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8aca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38652/0 (socket says 172.21.15.53:38652) 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee60a4640 1 -- 172.21.15.53:0/2679163510 learned_addr learned my addr 172.21.15.53:0/2679163510 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee58a3640 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4db390 0x557e9c8acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee68a5640 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c8b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee60a4640 1 -- 172.21.15.53:0/2679163510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4db390 msgr2=0x557e9c8acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee60a4640 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4db390 0x557e9c8acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee60a4640 1 -- 172.21.15.53:0/2679163510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 msgr2=0x557e9c8b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee60a4640 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c8b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee60a4640 1 -- 172.21.15.53:0/2679163510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e9c7c78b0 con 0x557e9c4d31b0 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee68a5640 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c8b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcee60a4640 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8aca80 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fcedc006010 tx=0x7fcedc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a077c41baf48f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.673+0000 7fcec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fcec9ffb640 1 -- 172.21.15.53:0/2679163510 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc04c070 con 0x557e9c4d31b0 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fcec9ffb640 1 -- 172.21.15.53:0/2679163510 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fcedc005250 con 0x557e9c4d31b0 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fceee87d740 1 -- 172.21.15.53:0/2679163510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fced8004cc0 con 0x557e9c4d31b0 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fcec9ffb640 1 -- 172.21.15.53:0/2679163510 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fcedc058050 con 0x557e9c4d31b0 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fceee87d740 10 client.19419 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fceee87d740 1 -- 172.21.15.53:0/2679163510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557e9c8bb930 con 0x557e9c4d31b0 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fcec9ffb640 1 -- 172.21.15.53:0/2679163510 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fced8004cc0 con 0x557e9c4d31b0 2024-08-31T06:16:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fcec9ffb640 1 -- 172.21.15.53:0/2679163510 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7fcedc0035f0 con 0x557e9c4d31b0 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fceee87d740 10 client.19419 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fceee87d740 10 client.19419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fceee87d740 20 client.19419 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fceee87d740 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557e9c4ba9f0 0x557e9c8bef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fceee87d740 4 client.19419 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.674+0000 7fceee87d740 1 -- 172.21.15.53:0/2679163510 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e9c81a580 con 0x557e9c4ba9f0 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.675+0000 7fcee58a3640 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557e9c4ba9f0 0x557e9c8bef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.675+0000 7fcee58a3640 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557e9c4ba9f0 0x557e9c8bef40 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ad6c4a9c8b844bc server_cookie=5a39588d6ce5648c in_seq=0 out_seq=0 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.675+0000 7fcec9ffb640 10 client.19419 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fcec9ffb640 1 -- 172.21.15.53:0/2679163510 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e9c81a580 con 0x557e9c4ba9f0 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fcec9ffb640 10 client.19419 handle_command_reply: tid=0 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 1 client.19419 shutdown 2024-08-31T06:16:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 1 -- 172.21.15.53:0/2679163510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 msgr2=0x557e9c8aca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8aca80 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fcedc006010 tx=0x7fcedc009260 comp rx=0 tx=0).stop 2024-08-31T06:16:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 1 -- 172.21.15.53:0/2679163510 shutdown_connections 2024-08-31T06:16:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557e9c4ba9f0 0x557e9c8bef40 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c8b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4db390 0x557e9c8acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 1 --2- 172.21.15.53:0/2679163510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8aca80 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 1 -- 172.21.15.53:0/2679163510 >> 172.21.15.53:0/2679163510 conn(0x557e9c4f0460 msgr2=0x557e9c8a4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fcec9ffb640 0 client.19419 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 1 -- 172.21.15.53:0/2679163510 shutdown_connections 2024-08-31T06:16:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 1 -- 172.21.15.53:0/2679163510 wait complete. 2024-08-31T06:16:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.676+0000 7fceee87d740 20 client.19419 trim_cache size 0 max 16384 2024-08-31T06:16:59.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fceee87d740 1 Processor -- start 2024-08-31T06:16:59.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fceee87d740 1 -- start start 2024-08-31T06:16:59.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fceee87d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4d31b0 0x557e9c8acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fceee87d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 0x557e9c8a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fceee87d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c8a9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fceee87d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcee01ad4b0 con 0x557e9c4db390 2024-08-31T06:16:59.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fceee87d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcee01af140 con 0x557e9c4fc070 2024-08-31T06:16:59.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fceee87d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcee01adb80 con 0x557e9c4d31b0 2024-08-31T06:16:59.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fcee58a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 0x557e9c8a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fcee58a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 0x557e9c8a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38660/0 (socket says 172.21.15.53:38660) 2024-08-31T06:16:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fcee58a3640 1 -- 172.21.15.53:0/1306210401 learned_addr learned my addr 172.21.15.53:0/1306210401 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fcee68a5640 1 --2- 172.21.15.53:0/1306210401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c8a9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fcee60a4640 1 --2- 172.21.15.53:0/1306210401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4d31b0 0x557e9c8acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fcee58a3640 1 -- 172.21.15.53:0/1306210401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4d31b0 msgr2=0x557e9c8acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fcee58a3640 1 --2- 172.21.15.53:0/1306210401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4d31b0 0x557e9c8acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fcee58a3640 1 -- 172.21.15.53:0/1306210401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 msgr2=0x557e9c8a9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.694+0000 7fcee58a3640 1 --2- 172.21.15.53:0/1306210401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c8a9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.695+0000 7fcee58a3640 1 -- 172.21.15.53:0/1306210401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9c8ab9e0 con 0x557e9c4db390 2024-08-31T06:16:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.695+0000 7fcee58a3640 1 --2- 172.21.15.53:0/1306210401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 0x557e9c8a4ad0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fced00aa0a0 tx=0x7fced0094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a31c8022bd6e86 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.695+0000 7fcecbfff640 1 -- 172.21.15.53:0/1306210401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced001c040 con 0x557e9c4db390 2024-08-31T06:16:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.699+0000 7fcecbfff640 1 -- 172.21.15.53:0/1306210401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fced00ac940 con 0x557e9c4db390 2024-08-31T06:16:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.699+0000 7fcecbfff640 1 -- 172.21.15.53:0/1306210401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced00e4110 con 0x557e9c4db390 2024-08-31T06:16:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 -- 172.21.15.53:0/1306210401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 msgr2=0x557e9c8a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 --2- 172.21.15.53:0/1306210401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 0x557e9c8a4ad0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fced00aa0a0 tx=0x7fced0094040 comp rx=0 tx=0).stop 2024-08-31T06:16:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 -- 172.21.15.53:0/1306210401 shutdown_connections 2024-08-31T06:16:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 --2- 172.21.15.53:0/1306210401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c8a9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 --2- 172.21.15.53:0/1306210401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4db390 0x557e9c8a4ad0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 --2- 172.21.15.53:0/1306210401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4d31b0 0x557e9c8acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 -- 172.21.15.53:0/1306210401 >> 172.21.15.53:0/1306210401 conn(0x557e9c4f0460 msgr2=0x557e9c8a43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 -- 172.21.15.53:0/1306210401 shutdown_connections 2024-08-31T06:16:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 -- 172.21.15.53:0/1306210401 wait complete. 2024-08-31T06:16:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 -- start start 2024-08-31T06:16:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 Processor -- start 2024-08-31T06:16:59.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.700+0000 7fceee87d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4db390 0x557e9c8b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fceee87d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c928900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fceee87d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcee01ae9b0 con 0x557e9c4d31b0 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fceee87d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcee01ae250 con 0x557e9c4fc070 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fceee87d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcee01ab4b0 con 0x557e9c4db390 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fceee87d740 10 client.0 _ll_register_callbacks cb 0x7fcedc032f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee60a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee60a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38676/0 (socket says 172.21.15.53:38676) 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee58a3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4db390 0x557e9c8b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee60a4640 1 -- 172.21.15.53:0/266463945 learned_addr learned my addr 172.21.15.53:0/266463945 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee68a5640 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c928900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee60a4640 1 -- 172.21.15.53:0/266463945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4db390 msgr2=0x557e9c8b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee60a4640 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4db390 0x557e9c8b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee60a4640 1 -- 172.21.15.53:0/266463945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 msgr2=0x557e9c928900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee60a4640 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c928900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee60a4640 1 -- 172.21.15.53:0/266463945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e9c8b1e20 con 0x557e9c4d31b0 2024-08-31T06:16:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee58a3640 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4db390 0x557e9c8b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcee60a4640 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8b1040 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009230 tx=0x7fcedc003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0297a9d85d3811 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcec9ffb640 1 -- 172.21.15.53:0/266463945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc060070 con 0x557e9c4d31b0 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fcec9ffb640 1 -- 172.21.15.53:0/266463945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7fcedc005030 con 0x557e9c4d31b0 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.701+0000 7fceee87d740 1 -- 172.21.15.53:0/266463945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fced00ac940 con 0x557e9c4d31b0 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fcec9ffb640 1 -- 172.21.15.53:0/266463945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fcedc06c050 con 0x557e9c4d31b0 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fceee87d740 10 client.19425 fetch_fsmap learned FSMap version 51 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fceee87d740 1 -- 172.21.15.53:0/266463945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557e9c929ea0 con 0x557e9c4d31b0 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fcec9ffb640 1 -- 172.21.15.53:0/266463945 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fced00ac940 con 0x557e9c4d31b0 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fcec9ffb640 1 -- 172.21.15.53:0/266463945 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7fcedc004cd0 con 0x557e9c4d31b0 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fceee87d740 10 client.19425 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fceee87d740 10 client.19425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:16:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fceee87d740 20 client.19425 populate_metadata read hostname 'smithi053' 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fceee87d740 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557e9c48fda0 0x557e9c92c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fceee87d740 4 client.19425 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fceee87d740 1 -- 172.21.15.53:0/266463945 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557e9c816020 con 0x557e9c48fda0 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.702+0000 7fcee58a3640 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557e9c48fda0 0x557e9c92c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.703+0000 7fcec9ffb640 10 client.19425 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.703+0000 7fcee58a3640 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557e9c48fda0 0x557e9c92c750 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d3d944176abc5ac server_cookie=10f68fb892d147e2 in_seq=0 out_seq=0 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.703+0000 7fcec9ffb640 1 -- 172.21.15.53:0/266463945 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x557e9c816020 con 0x557e9c48fda0 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.703+0000 7fcec9ffb640 10 client.19425 handle_command_reply: tid=0 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.703+0000 7fceee87d740 1 client.19425 shutdown 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.703+0000 7fceee87d740 1 -- 172.21.15.53:0/266463945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 msgr2=0x557e9c8b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.703+0000 7fceee87d740 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8b1040 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009230 tx=0x7fcedc003820 comp rx=0 tx=0).stop 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.703+0000 7fceee87d740 1 -- 172.21.15.53:0/266463945 shutdown_connections 2024-08-31T06:16:59.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.703+0000 7fceee87d740 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557e9c48fda0 0x557e9c92c750 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fceee87d740 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e9c4fc070 0x557e9c928900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fceee87d740 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557e9c4db390 0x557e9c8b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fcec9ffb640 0 client.19425 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:16:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fceee87d740 1 --2- 172.21.15.53:0/266463945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e9c4d31b0 0x557e9c8b1040 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fceee87d740 1 -- 172.21.15.53:0/266463945 >> 172.21.15.53:0/266463945 conn(0x557e9c4f0460 msgr2=0x557e9c8a22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fceee87d740 1 -- 172.21.15.53:0/266463945 shutdown_connections 2024-08-31T06:16:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fceee87d740 1 -- 172.21.15.53:0/266463945 wait complete. 2024-08-31T06:16:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fceee87d740 20 client.19425 trim_cache size 0 max 16384 2024-08-31T06:16:59.710 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:16:59.710 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:16:59.710 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "00e51c37-5337-4356-af2b-24afda8741d6", 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.712 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:16:59.713 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:16:59.714 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.715 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.716 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.717 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.719 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:16:59.720 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:16:59.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fcee8308640 1 -- 172.21.15.53:0/1626117557 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcecc0b4ca0 msgr2=0x7fcecc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:59.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fcee8308640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcecc0b4ca0 0x7fcecc0b71b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x557e9c89ff40 tx=0x7fcedc005ed0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fcee8308640 1 -- 172.21.15.53:0/1626117557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee0108170 msgr2=0x7fcee0199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:16:59.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fcee8308640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee0108170 0x7fcee0199750 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fced00098a0 tx=0x7fced0009d60 comp rx=0 tx=0).stop 2024-08-31T06:16:59.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fcee8308640 1 -- 172.21.15.53:0/1626117557 shutdown_connections 2024-08-31T06:16:59.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fcee8308640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcecc0b4ca0 0x7fcecc0b71b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fcee8308640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcee0108ac0 0x7fcee019e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fcee8308640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee0108170 0x7fcee0199750 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fcee8308640 1 --2- 172.21.15.53:0/1626117557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcee0102880 0x7fcee01991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:16:59.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.704+0000 7fcee8308640 1 -- 172.21.15.53:0/1626117557 >> 172.21.15.53:0/1626117557 conn(0x7fcee0079550 msgr2=0x7fcee0106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:16:59.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.705+0000 7fcee8308640 1 -- 172.21.15.53:0/1626117557 shutdown_connections 2024-08-31T06:16:59.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:16:59.705+0000 7fcee8308640 1 -- 172.21.15.53:0/1626117557 wait complete. 2024-08-31T06:16:59.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:59 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:59.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:59 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:59 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:59.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:59 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:59 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:59.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:59 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:59 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:59.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:59 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:59 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:16:59.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:59 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:16:59.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:16:59 smithi053 ceph-mon[18924]: pgmap v696: 97 pgs: 97 active+clean; 106 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 712 KiB/s wr, 83 op/s 2024-08-31T06:16:59.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 184528 1.35 MB/sec execute 529 sec latency 957.359 ms 2024-08-31T06:17:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:59 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:00.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:59 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:00.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:59 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:00.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:59 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:00.132 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:59 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:00.132 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:59 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:00.132 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:59 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:00.132 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:59 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:00.132 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:59 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:00.132 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:59 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:00.132 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:16:59 smithi130 ceph-mon[22266]: pgmap v696: 97 pgs: 97 active+clean; 106 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 712 KiB/s wr, 83 op/s 2024-08-31T06:17:00.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:59 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:00.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:59 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:00.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:59 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:00.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:59 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:00.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:59 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:00.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:59 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:00.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:59 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:00.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:59 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:00.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:59 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:00.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:59 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:00.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:16:59 smithi153 ceph-mon[22320]: pgmap v696: 97 pgs: 97 active+clean; 106 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 712 KiB/s wr, 83 op/s 2024-08-31T06:17:00.503 INFO:tasks.cephfs.filesystem:scrub status for tag:00e51c37-5337-4356-af2b-24afda8741d6 - {'path': '/', 'tag': '00e51c37-5337-4356-af2b-24afda8741d6', 'options': 'recursive,force'} 2024-08-31T06:17:00.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 184528 1.35 MB/sec execute 530 sec latency 1957.397 ms 2024-08-31T06:17:01.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:01 smithi053 ceph-mon[18924]: pgmap v697: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 872 KiB/s wr, 103 op/s 2024-08-31T06:17:01.998 INFO:tasks.workunit.client.0.smithi053.stdout: 1 184595 1.34 MB/sec execute 531 sec latency 2206.707 ms 2024-08-31T06:17:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:01 smithi130 ceph-mon[22266]: pgmap v697: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 872 KiB/s wr, 103 op/s 2024-08-31T06:17:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:01 smithi153 ceph-mon[22320]: pgmap v697: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 872 KiB/s wr, 103 op/s 2024-08-31T06:17:02.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 184595 1.34 MB/sec execute 532 sec latency 1494.744 ms 2024-08-31T06:17:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.118+0000 7f83540d5640 1 -- 172.21.15.53:0/586753910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f834c108a10 msgr2=0x7f834c10f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.118+0000 7f83540d5640 1 --2- 172.21.15.53:0/586753910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f834c108a10 0x7f834c10f240 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f8344009900 tx=0x7f834402a410 comp rx=0 tx=0).stop 2024-08-31T06:17:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.118+0000 7f83540d5640 1 -- 172.21.15.53:0/586753910 shutdown_connections 2024-08-31T06:17:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.118+0000 7f83540d5640 1 --2- 172.21.15.53:0/586753910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f834c108a10 0x7f834c10f240 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.118+0000 7f83540d5640 1 --2- 172.21.15.53:0/586753910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f834c1080c0 0x7f834c1084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.118+0000 7f83540d5640 1 --2- 172.21.15.53:0/586753910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f834c102f00 0x7f834c103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.118+0000 7f83540d5640 1 -- 172.21.15.53:0/586753910 >> 172.21.15.53:0/586753910 conn(0x7f834c079c20 msgr2=0x7f834c07a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.118+0000 7f83540d5640 1 -- 172.21.15.53:0/586753910 shutdown_connections 2024-08-31T06:17:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.118+0000 7f83540d5640 1 -- 172.21.15.53:0/586753910 wait complete. 2024-08-31T06:17:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.119+0000 7f83540d5640 1 Processor -- start 2024-08-31T06:17:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.119+0000 7f83540d5640 1 -- start start 2024-08-31T06:17:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.119+0000 7f83540d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f834c102f00 0x7f834c19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.119+0000 7f83540d5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f834c1080c0 0x7f834c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.119+0000 7f83540d5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f834c108a10 0x7f834c19f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.119+0000 7f83540d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f834c112590 con 0x7f834c102f00 2024-08-31T06:17:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.119+0000 7f83540d5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f834c112410 con 0x7f834c108a10 2024-08-31T06:17:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.119+0000 7f83540d5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f834c112710 con 0x7f834c1080c0 2024-08-31T06:17:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.119+0000 7f8351e71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f834c102f00 0x7f834c19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.119+0000 7f8351e71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f834c102f00 0x7f834c19a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38706/0 (socket says 172.21.15.53:38706) 2024-08-31T06:17:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.119+0000 7f8351e71640 1 -- 172.21.15.53:0/3448760177 learned_addr learned my addr 172.21.15.53:0/3448760177 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f8351670640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f834c1080c0 0x7f834c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f8352672640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f834c108a10 0x7f834c19f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f8351e71640 1 -- 172.21.15.53:0/3448760177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f834c1080c0 msgr2=0x7f834c19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f8351e71640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f834c1080c0 0x7f834c19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f8351e71640 1 -- 172.21.15.53:0/3448760177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f834c108a10 msgr2=0x7f834c19f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f8351e71640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f834c108a10 0x7f834c19f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f8351e71640 1 -- 172.21.15.53:0/3448760177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834c1a0030 con 0x7f834c102f00 2024-08-31T06:17:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f8351e71640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f834c102f00 0x7f834c19a100 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f833c00db80 tx=0x7f833c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f834affd640 1 -- 172.21.15.53:0/3448760177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c017070 con 0x7f834c102f00 2024-08-31T06:17:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f834affd640 1 -- 172.21.15.53:0/3448760177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f833c004020 con 0x7f834c102f00 2024-08-31T06:17:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f834affd640 1 -- 172.21.15.53:0/3448760177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c00be60 con 0x7f834c102f00 2024-08-31T06:17:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f83540d5640 1 -- 172.21.15.53:0/3448760177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834c1a0320 con 0x7f834c102f00 2024-08-31T06:17:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.120+0000 7f83540d5640 1 -- 172.21.15.53:0/3448760177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834c1a6ab0 con 0x7f834c102f00 2024-08-31T06:17:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f835b041740 1 Processor -- start 2024-08-31T06:17:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f835b041740 1 -- start start 2024-08-31T06:17:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f834affd640 1 -- 172.21.15.53:0/3448760177 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f833c003b70 con 0x7f834c102f00 2024-08-31T06:17:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f835b041740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d951b0 0x5573d3138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f835b041740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d6c2f0 0x5573d3139000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f835b041740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3139540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f835b041740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573d30ae000 con 0x5573d2d744d0 2024-08-31T06:17:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f835b041740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5573d309d590 con 0x5573d2d951b0 2024-08-31T06:17:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f835b041740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5573d30a1540 con 0x5573d2d6c2f0 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f8351670640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f8352672640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d951b0 0x5573d3138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f8351670640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3139540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38718/0 (socket says 172.21.15.53:38718) 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f8352672640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d951b0 0x5573d3138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:42156/0 (socket says 172.21.15.53:42156) 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.123+0000 7f8351670640 1 -- 172.21.15.53:0/4210843107 learned_addr learned my addr 172.21.15.53:0/4210843107 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f8351e71640 1 --2- 172.21.15.53:0/4210843107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d6c2f0 0x5573d3139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f8351670640 1 -- 172.21.15.53:0/4210843107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d6c2f0 msgr2=0x5573d3139000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f8351670640 1 --2- 172.21.15.53:0/4210843107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d6c2f0 0x5573d3139000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f834affd640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83340b4ca0 0x7f83340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f8351670640 1 -- 172.21.15.53:0/4210843107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d951b0 msgr2=0x5573d3138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f8351670640 1 --2- 172.21.15.53:0/4210843107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d951b0 0x5573d3138ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f8351670640 1 -- 172.21.15.53:0/4210843107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d2e00790 con 0x5573d2d744d0 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f8352672640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83340b4ca0 0x7f83340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f8351670640 1 --2- 172.21.15.53:0/4210843107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3139540 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f834000bb90 tx=0x7f834000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4a73e6e6d56681 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f834affd640 1 -- 172.21.15.53:0/3448760177 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f833c0e5750 con 0x7f834c102f00 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f8333fff640 1 -- 172.21.15.53:0/4210843107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340015070 con 0x5573d2d744d0 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f8333fff640 1 -- 172.21.15.53:0/4210843107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83400054b0 con 0x5573d2d744d0 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.124+0000 7f8333fff640 1 -- 172.21.15.53:0/4210843107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340011440 con 0x5573d2d744d0 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.125+0000 7f835b041740 1 -- 172.21.15.53:0/4210843107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 msgr2=0x5573d3139540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.125+0000 7f835b041740 1 --2- 172.21.15.53:0/4210843107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3139540 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f834000bb90 tx=0x7f834000f730 comp rx=0 tx=0).stop 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.125+0000 7f8352672640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83340b4ca0 0x7f83340b71b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8344005940 tx=0x7f8344009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.125+0000 7f835b041740 1 -- 172.21.15.53:0/4210843107 shutdown_connections 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.125+0000 7f835b041740 1 --2- 172.21.15.53:0/4210843107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3139540 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.125+0000 7f835b041740 1 --2- 172.21.15.53:0/4210843107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d6c2f0 0x5573d3139000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.125+0000 7f835b041740 1 --2- 172.21.15.53:0/4210843107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d951b0 0x5573d3138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.125+0000 7f835b041740 1 -- 172.21.15.53:0/4210843107 >> 172.21.15.53:0/4210843107 conn(0x5573d2d89300 msgr2=0x5573d31369b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.125+0000 7f835b041740 1 -- 172.21.15.53:0/4210843107 shutdown_connections 2024-08-31T06:17:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.125+0000 7f835b041740 1 -- 172.21.15.53:0/4210843107 wait complete. 2024-08-31T06:17:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.126+0000 7f835b041740 1 -- start start 2024-08-31T06:17:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.126+0000 7f835b041740 1 Processor -- start 2024-08-31T06:17:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.126+0000 7f835b041740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d6c2f0 0x5573d3144640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.126+0000 7f835b041740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3144b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.126+0000 7f835b041740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d951b0 0x5573d3150530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.126+0000 7f835b041740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573d2fd6ab0 con 0x5573d2d744d0 2024-08-31T06:17:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.126+0000 7f835b041740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5573d3024680 con 0x5573d2d951b0 2024-08-31T06:17:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.126+0000 7f835b041740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5573d3147240 con 0x5573d2d6c2f0 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.126+0000 7f835b041740 10 client.0 _ll_register_callbacks cb 0x5573d2daca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f8351670640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f8351670640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38732/0 (socket says 172.21.15.53:38732) 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f8351670640 1 -- 172.21.15.53:0/2670159577 learned_addr learned my addr 172.21.15.53:0/2670159577 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f8352672640 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d951b0 0x5573d3150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f8351e71640 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d6c2f0 0x5573d3144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f8351670640 1 -- 172.21.15.53:0/2670159577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d6c2f0 msgr2=0x5573d3144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f8351670640 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d6c2f0 0x5573d3144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f8351670640 1 -- 172.21.15.53:0/2670159577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d951b0 msgr2=0x5573d3150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f8351670640 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d951b0 0x5573d3150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f8351670640 1 -- 172.21.15.53:0/2670159577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d2e79620 con 0x5573d2d744d0 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f8351670640 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3144b80 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f8340004a90 tx=0x7f834000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8b6eb3f9f677bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f83317fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f83317fa640 1 -- 172.21.15.53:0/2670159577 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340028060 con 0x5573d2d744d0 2024-08-31T06:17:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f83317fa640 1 -- 172.21.15.53:0/2670159577 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f8340004bf0 con 0x5573d2d744d0 2024-08-31T06:17:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.127+0000 7f835b041740 1 -- 172.21.15.53:0/2670159577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83400054b0 con 0x5573d2d744d0 2024-08-31T06:17:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f83317fa640 1 -- 172.21.15.53:0/2670159577 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8340015070 con 0x5573d2d744d0 2024-08-31T06:17:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f835b041740 10 client.19437 fetch_fsmap learned FSMap version 51 2024-08-31T06:17:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f835b041740 1 -- 172.21.15.53:0/2670159577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5573d3153210 con 0x5573d2d744d0 2024-08-31T06:17:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f83317fa640 1 -- 172.21.15.53:0/2670159577 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83400054b0 con 0x5573d2d744d0 2024-08-31T06:17:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f83317fa640 1 -- 172.21.15.53:0/2670159577 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f8340011900 con 0x5573d2d744d0 2024-08-31T06:17:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f835b041740 10 client.19437 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:17:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f835b041740 10 client.19437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:03.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f835b041740 20 client.19437 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f835b041740 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573d2d53d80 0x5573d3156680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f835b041740 4 client.19437 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f835b041740 1 -- 172.21.15.53:0/2670159577 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573d30aff50 con 0x5573d2d53d80 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.128+0000 7f8351e71640 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573d2d53d80 0x5573d3156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.129+0000 7f83317fa640 10 client.19437 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.129+0000 7f8351e71640 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573d2d53d80 0x5573d3156680 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b658b21818d0bff server_cookie=33a06303ff086369 in_seq=0 out_seq=0 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.129+0000 7f83317fa640 1 -- 172.21.15.53:0/2670159577 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5573d30aff50 con 0x5573d2d53d80 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.129+0000 7f83317fa640 10 client.19437 handle_command_reply: tid=0 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 1 client.19437 shutdown 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 1 -- 172.21.15.53:0/2670159577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 msgr2=0x5573d3144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3144b80 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f8340004a90 tx=0x7f834000b900 comp rx=0 tx=0).stop 2024-08-31T06:17:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 1 -- 172.21.15.53:0/2670159577 shutdown_connections 2024-08-31T06:17:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573d2d53d80 0x5573d3156680 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d951b0 0x5573d3150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d744d0 0x5573d3144b80 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f83317fa640 0 client.19437 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 1 --2- 172.21.15.53:0/2670159577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d6c2f0 0x5573d3144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 1 -- 172.21.15.53:0/2670159577 >> 172.21.15.53:0/2670159577 conn(0x5573d2d89300 msgr2=0x5573d3139af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 1 -- 172.21.15.53:0/2670159577 shutdown_connections 2024-08-31T06:17:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 1 -- 172.21.15.53:0/2670159577 wait complete. 2024-08-31T06:17:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.130+0000 7f835b041740 20 client.19437 trim_cache size 0 max 16384 2024-08-31T06:17:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f835b041740 1 Processor -- start 2024-08-31T06:17:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f835b041740 1 -- start start 2024-08-31T06:17:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f835b041740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d6c2f0 0x5573d313db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f835b041740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d744d0 0x5573d313e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f835b041740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d3143900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f835b041740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1af430 con 0x5573d2d951b0 2024-08-31T06:17:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f835b041740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1b10c0 con 0x5573d2d6c2f0 2024-08-31T06:17:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f835b041740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1afb00 con 0x5573d2d744d0 2024-08-31T06:17:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f8352672640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d3143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f8352672640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d3143900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38734/0 (socket says 172.21.15.53:38734) 2024-08-31T06:17:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f8352672640 1 -- 172.21.15.53:0/385645315 learned_addr learned my addr 172.21.15.53:0/385645315 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.145+0000 7f8351e71640 1 --2- 172.21.15.53:0/385645315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d6c2f0 0x5573d313db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f8352672640 1 -- 172.21.15.53:0/385645315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d744d0 msgr2=0x5573d313e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f8351670640 1 --2- 172.21.15.53:0/385645315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d744d0 0x5573d313e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f8352672640 1 --2- 172.21.15.53:0/385645315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d744d0 0x5573d313e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f8352672640 1 -- 172.21.15.53:0/385645315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d6c2f0 msgr2=0x5573d313db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f8352672640 1 --2- 172.21.15.53:0/385645315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d6c2f0 0x5573d313db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f8352672640 1 -- 172.21.15.53:0/385645315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d313adc0 con 0x5573d2d951b0 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f8351e71640 1 --2- 172.21.15.53:0/385645315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d6c2f0 0x5573d313db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f8351670640 1 --2- 172.21.15.53:0/385645315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d744d0 0x5573d313e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f8352672640 1 --2- 172.21.15.53:0/385645315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d3143900 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f8344009900 tx=0x7f834403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80aa630be1f1d358 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f83337fe640 1 -- 172.21.15.53:0/385645315 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344035040 con 0x5573d2d951b0 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f83337fe640 1 -- 172.21.15.53:0/385645315 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f834404f070 con 0x5573d2d951b0 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.146+0000 7f83337fe640 1 -- 172.21.15.53:0/385645315 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344004ab0 con 0x5573d2d951b0 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.147+0000 7f835b041740 1 -- 172.21.15.53:0/385645315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 msgr2=0x5573d3143900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.147+0000 7f835b041740 1 --2- 172.21.15.53:0/385645315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d3143900 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f8344009900 tx=0x7f834403e000 comp rx=0 tx=0).stop 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.147+0000 7f835b041740 1 -- 172.21.15.53:0/385645315 shutdown_connections 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.147+0000 7f835b041740 1 --2- 172.21.15.53:0/385645315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d3143900 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.147+0000 7f835b041740 1 --2- 172.21.15.53:0/385645315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d744d0 0x5573d313e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.147+0000 7f835b041740 1 --2- 172.21.15.53:0/385645315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d6c2f0 0x5573d313db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.147+0000 7f835b041740 1 -- 172.21.15.53:0/385645315 >> 172.21.15.53:0/385645315 conn(0x5573d2d89300 msgr2=0x5573d313f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.147+0000 7f835b041740 1 -- 172.21.15.53:0/385645315 shutdown_connections 2024-08-31T06:17:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.147+0000 7f835b041740 1 -- 172.21.15.53:0/385645315 wait complete. 2024-08-31T06:17:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.147+0000 7f835b041740 1 -- start start 2024-08-31T06:17:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.147+0000 7f835b041740 1 Processor -- start 2024-08-31T06:17:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f835b041740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d6c2f0 0x5573d3148c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f835b041740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d744d0 0x5573d3149180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f835b041740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d31bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f835b041740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1b0930 con 0x5573d2d951b0 2024-08-31T06:17:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f835b041740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1b01d0 con 0x5573d2d6c2f0 2024-08-31T06:17:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f835b041740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1ad430 con 0x5573d2d744d0 2024-08-31T06:17:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f835b041740 10 client.0 _ll_register_callbacks cb 0x7f8344009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f8352672640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d31bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f8352672640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d31bfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38750/0 (socket says 172.21.15.53:38750) 2024-08-31T06:17:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f8352672640 1 -- 172.21.15.53:0/2013323604 learned_addr learned my addr 172.21.15.53:0/2013323604 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f8351e71640 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d6c2f0 0x5573d3148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f8351670640 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d744d0 0x5573d3149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f8352672640 1 -- 172.21.15.53:0/2013323604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d744d0 msgr2=0x5573d3149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f8352672640 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d744d0 0x5573d3149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f8352672640 1 -- 172.21.15.53:0/2013323604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d6c2f0 msgr2=0x5573d3148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f8352672640 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d6c2f0 0x5573d3148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f8352672640 1 -- 172.21.15.53:0/2013323604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d31c0470 con 0x5573d2d951b0 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f8352672640 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d31bfe80 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f8344005f70 tx=0x7f83440052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affe53460423a5f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.148+0000 7f83317fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f83317fa640 1 -- 172.21.15.53:0/2013323604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344035030 con 0x5573d2d951b0 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f83317fa640 1 -- 172.21.15.53:0/2013323604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8557+0+0 (secure 0 0 0) 0x7f83440048c0 con 0x5573d2d951b0 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f835b041740 1 -- 172.21.15.53:0/2013323604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f834404f070 con 0x5573d2d951b0 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f83317fa640 1 -- 172.21.15.53:0/2013323604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8344004ac0 con 0x5573d2d951b0 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f835b041740 10 client.19443 fetch_fsmap learned FSMap version 51 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f835b041740 1 -- 172.21.15.53:0/2013323604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5573d31c1670 con 0x5573d2d951b0 2024-08-31T06:17:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f83317fa640 1 -- 172.21.15.53:0/2013323604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f834404f070 con 0x5573d2d951b0 2024-08-31T06:17:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f83317fa640 1 -- 172.21.15.53:0/2013323604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) ==== 8390+0+0 (secure 0 0 0) 0x7f8344003d30 con 0x5573d2d951b0 2024-08-31T06:17:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f835b041740 10 client.19443 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T06:17:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f835b041740 10 client.19443 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f835b041740 20 client.19443 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f835b041740 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573d2d291c0 0x5573d31c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f835b041740 4 client.19443 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:17:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.149+0000 7f835b041740 1 -- 172.21.15.53:0/2013323604 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5573d30ab9f0 con 0x5573d2d291c0 2024-08-31T06:17:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.150+0000 7f8351e71640 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573d2d291c0 0x5573d31c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.150+0000 7f8351e71640 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573d2d291c0 0x5573d31c3ee0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=321f9d51aaa4e4c5 server_cookie=5510aa831e13b0b8 in_seq=0 out_seq=0 2024-08-31T06:17:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.150+0000 7f83317fa640 10 client.19443 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f83317fa640 1 -- 172.21.15.53:0/2013323604 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5573d30ab9f0 con 0x5573d2d291c0 2024-08-31T06:17:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f83317fa640 10 client.19443 handle_command_reply: tid=0 2024-08-31T06:17:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 1 client.19443 shutdown 2024-08-31T06:17:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 1 -- 172.21.15.53:0/2013323604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 msgr2=0x5573d31bfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d31bfe80 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f8344005f70 tx=0x7f83440052f0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 1 -- 172.21.15.53:0/2013323604 shutdown_connections 2024-08-31T06:17:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573d2d291c0 0x5573d31c3ee0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d2d951b0 0x5573d31bfe80 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5573d2d744d0 0x5573d3149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 1 --2- 172.21.15.53:0/2013323604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573d2d6c2f0 0x5573d3148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 1 -- 172.21.15.53:0/2013323604 >> 172.21.15.53:0/2013323604 conn(0x5573d2d89300 msgr2=0x5573d313f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:03.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f83317fa640 0 client.19443 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:03.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 1 -- 172.21.15.53:0/2013323604 shutdown_connections 2024-08-31T06:17:03.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 1 -- 172.21.15.53:0/2013323604 wait complete. 2024-08-31T06:17:03.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.179+0000 7f835b041740 20 client.19443 trim_cache size 0 max 16384 2024-08-31T06:17:03.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:17:03.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:17:03.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:17:03.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:17:03.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 -- 172.21.15.53:0/3448760177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83340b4ca0 msgr2=0x7f83340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:03.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83340b4ca0 0x7f83340b71b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8344005940 tx=0x7f8344009260 comp rx=0 tx=0).stop 2024-08-31T06:17:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 -- 172.21.15.53:0/3448760177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f834c102f00 msgr2=0x7f834c19a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f834c102f00 0x7f834c19a100 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f833c00db80 tx=0x7f833c00b630 comp rx=0 tx=0).stop 2024-08-31T06:17:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 -- 172.21.15.53:0/3448760177 shutdown_connections 2024-08-31T06:17:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f83340b4ca0 0x7f83340b71b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f834c108a10 0x7f834c19f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f834c1080c0 0x7f834c19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 --2- 172.21.15.53:0/3448760177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f834c102f00 0x7f834c19a100 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 -- 172.21.15.53:0/3448760177 >> 172.21.15.53:0/3448760177 conn(0x7f834c079c20 msgr2=0x7f834c101ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 -- 172.21.15.53:0/3448760177 shutdown_connections 2024-08-31T06:17:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:03.180+0000 7f83540d5640 1 -- 172.21.15.53:0/3448760177 wait complete. 2024-08-31T06:17:03.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:03 smithi053 ceph-mon[18924]: pgmap v698: 97 pgs: 97 active+clean; 109 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1006 KiB/s wr, 110 op/s 2024-08-31T06:17:03.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 184595 1.34 MB/sec execute 533 sec latency 2494.858 ms 2024-08-31T06:17:04.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:03 smithi130 ceph-mon[22266]: pgmap v698: 97 pgs: 97 active+clean; 109 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1006 KiB/s wr, 110 op/s 2024-08-31T06:17:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:03 smithi153 ceph-mon[22320]: pgmap v698: 97 pgs: 97 active+clean; 109 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1006 KiB/s wr, 110 op/s 2024-08-31T06:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 184595 1.34 MB/sec execute 534 sec latency 3494.970 ms 2024-08-31T06:17:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:05 smithi053 ceph-mon[18924]: pgmap v699: 97 pgs: 97 active+clean; 105 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2024-08-31T06:17:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:05 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:17:05.977 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:05 smithi153 ceph-mon[22320]: pgmap v699: 97 pgs: 97 active+clean; 105 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2024-08-31T06:17:05.977 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:05 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:17:05.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 184595 1.33 MB/sec execute 535 sec latency 4495.039 ms 2024-08-31T06:17:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:05 smithi130 ceph-mon[22266]: pgmap v699: 97 pgs: 97 active+clean; 105 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2024-08-31T06:17:06.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:05 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:17:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:17:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:17:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:17:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:06 smithi053 ceph-mon[18924]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T06:17:06.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 184796 1.33 MB/sec execute 536 sec latency 4746.003 ms 2024-08-31T06:17:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:17:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:17:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:17:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:06 smithi130 ceph-mon[22266]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T06:17:07.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:17:07.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:17:07.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:17:07.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:06 smithi153 ceph-mon[22320]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T06:17:07.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:07 smithi053 ceph-mon[18924]: pgmap v701: 97 pgs: 97 active+clean; 105 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 900 KiB/s wr, 123 op/s 2024-08-31T06:17:07.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 185050 1.33 MB/sec execute 537 sec latency 17.498 ms 2024-08-31T06:17:08.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:07 smithi130 ceph-mon[22266]: pgmap v701: 97 pgs: 97 active+clean; 105 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 900 KiB/s wr, 123 op/s 2024-08-31T06:17:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:07 smithi153 ceph-mon[22320]: pgmap v701: 97 pgs: 97 active+clean; 105 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 900 KiB/s wr, 123 op/s 2024-08-31T06:17:08.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 185512 1.33 MB/sec execute 538 sec latency 14.902 ms 2024-08-31T06:17:09.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:09 smithi053 ceph-mon[18924]: pgmap v702: 97 pgs: 97 active+clean; 105 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 693 KiB/s wr, 98 op/s 2024-08-31T06:17:09.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 186015 1.34 MB/sec execute 539 sec latency 21.506 ms 2024-08-31T06:17:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:09 smithi130 ceph-mon[22266]: pgmap v702: 97 pgs: 97 active+clean; 105 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 693 KiB/s wr, 98 op/s 2024-08-31T06:17:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:09 smithi153 ceph-mon[22320]: pgmap v702: 97 pgs: 97 active+clean; 105 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 693 KiB/s wr, 98 op/s 2024-08-31T06:17:10.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 186522 1.33 MB/sec execute 540 sec latency 26.197 ms 2024-08-31T06:17:11.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 187006 1.34 MB/sec execute 541 sec latency 23.170 ms 2024-08-31T06:17:12.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:11 smithi130 ceph-mon[22266]: pgmap v703: 97 pgs: 97 active+clean; 107 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 714 KiB/s wr, 95 op/s 2024-08-31T06:17:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:11 smithi153 ceph-mon[22320]: pgmap v703: 97 pgs: 97 active+clean; 107 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 714 KiB/s wr, 95 op/s 2024-08-31T06:17:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:11 smithi053 ceph-mon[18924]: pgmap v703: 97 pgs: 97 active+clean; 107 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 714 KiB/s wr, 95 op/s 2024-08-31T06:17:12.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 187734 1.35 MB/sec execute 542 sec latency 14.948 ms 2024-08-31T06:17:13.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 188073 1.35 MB/sec execute 543 sec latency 20.478 ms 2024-08-31T06:17:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:13 smithi130 ceph-mon[22266]: pgmap v704: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 670 KiB/s wr, 104 op/s 2024-08-31T06:17:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:13 smithi153 ceph-mon[22320]: pgmap v704: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 670 KiB/s wr, 104 op/s 2024-08-31T06:17:14.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:13 smithi053 ceph-mon[18924]: pgmap v704: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 670 KiB/s wr, 104 op/s 2024-08-31T06:17:14.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 188073 1.35 MB/sec execute 544 sec latency 1006.792 ms 2024-08-31T06:17:15.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:15 smithi153 ceph-mon[22320]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T06:17:15.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:15 smithi153 ceph-mon[22320]: pgmap v706: 97 pgs: 97 active+clean; 109 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 850 KiB/s wr, 106 op/s 2024-08-31T06:17:15.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:15 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:17:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:15 smithi053 ceph-mon[18924]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T06:17:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:15 smithi053 ceph-mon[18924]: pgmap v706: 97 pgs: 97 active+clean; 109 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 850 KiB/s wr, 106 op/s 2024-08-31T06:17:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:15 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:17:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:15 smithi130 ceph-mon[22266]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T06:17:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:15 smithi130 ceph-mon[22266]: pgmap v706: 97 pgs: 97 active+clean; 109 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 850 KiB/s wr, 106 op/s 2024-08-31T06:17:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:15 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:17:15.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 188073 1.34 MB/sec execute 545 sec latency 2006.893 ms 2024-08-31T06:17:16.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.296+0000 7f4c4949b640 1 -- 172.21.15.53:0/1609635933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c44108080 msgr2=0x7f4c44108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.296+0000 7f4c4949b640 1 --2- 172.21.15.53:0/1609635933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c44108080 0x7f4c44108490 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009900 tx=0x7f4c3802a410 comp rx=0 tx=0).stop 2024-08-31T06:17:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.296+0000 7f4c4949b640 1 -- 172.21.15.53:0/1609635933 shutdown_connections 2024-08-31T06:17:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.296+0000 7f4c4949b640 1 --2- 172.21.15.53:0/1609635933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c441089d0 0x7f4c4410f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.296+0000 7f4c4949b640 1 --2- 172.21.15.53:0/1609635933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c44108080 0x7f4c44108490 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.296+0000 7f4c4949b640 1 --2- 172.21.15.53:0/1609635933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c44102750 0x7f4c44102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.296+0000 7f4c4949b640 1 -- 172.21.15.53:0/1609635933 >> 172.21.15.53:0/1609635933 conn(0x7f4c4407a4e0 msgr2=0x7f4c4407a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.296+0000 7f4c4949b640 1 -- 172.21.15.53:0/1609635933 shutdown_connections 2024-08-31T06:17:16.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.296+0000 7f4c4949b640 1 -- 172.21.15.53:0/1609635933 wait complete. 2024-08-31T06:17:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.297+0000 7f4c4949b640 1 Processor -- start 2024-08-31T06:17:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.297+0000 7f4c4949b640 1 -- start start 2024-08-31T06:17:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.297+0000 7f4c4949b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c44102750 0x7f4c440ff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.297+0000 7f4c4949b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c44108080 0x7f4c440ff830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.297+0000 7f4c4949b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c441089d0 0x7f4c440ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.297+0000 7f4c4949b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4c44112510 con 0x7f4c441089d0 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.297+0000 7f4c4949b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c44112390 con 0x7f4c44108080 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.297+0000 7f4c4949b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c44112690 con 0x7f4c44102750 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c441089d0 0x7f4c440ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c42ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c44102750 0x7f4c440ff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c427fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c44108080 0x7f4c440ff830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c441089d0 0x7f4c440ffd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60660/0 (socket says 172.21.15.53:60660) 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c42ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c44102750 0x7f4c440ff2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:54622/0 (socket says 172.21.15.53:54622) 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c437fe640 1 -- 172.21.15.53:0/510104642 learned_addr learned my addr 172.21.15.53:0/510104642 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c437fe640 1 -- 172.21.15.53:0/510104642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c44102750 msgr2=0x7f4c440ff2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c437fe640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c44102750 0x7f4c440ff2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c437fe640 1 -- 172.21.15.53:0/510104642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c44108080 msgr2=0x7f4c440ff830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c437fe640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c44108080 0x7f4c440ff830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c437fe640 1 -- 172.21.15.53:0/510104642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c441a83b0 con 0x7f4c441089d0 2024-08-31T06:17:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c437fe640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c441089d0 0x7f4c440ffd70 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00eb10 tx=0x7f4c3c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c2bfff640 1 -- 172.21.15.53:0/510104642 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c004b20 con 0x7f4c441089d0 2024-08-31T06:17:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c2bfff640 1 -- 172.21.15.53:0/510104642 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c3c004cc0 con 0x7f4c441089d0 2024-08-31T06:17:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c4949b640 1 -- 172.21.15.53:0/510104642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c441a86a0 con 0x7f4c441089d0 2024-08-31T06:17:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c2bfff640 1 -- 172.21.15.53:0/510104642 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c010690 con 0x7f4c441089d0 2024-08-31T06:17:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.298+0000 7f4c4949b640 1 -- 172.21.15.53:0/510104642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c441a8bc0 con 0x7f4c441089d0 2024-08-31T06:17:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.301+0000 7f4c50409740 1 Processor -- start 2024-08-31T06:17:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c2bfff640 1 -- 172.21.15.53:0/510104642 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4c3c010830 con 0x7f4c441089d0 2024-08-31T06:17:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c50409740 1 -- start start 2024-08-31T06:17:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c50409740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42851b0 0x55add4628ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c50409740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add4629000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c50409740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 0x55add4629540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c50409740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55add459e000 con 0x55add42644d0 2024-08-31T06:17:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c50409740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55add458d590 con 0x55add425c2f0 2024-08-31T06:17:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c50409740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55add4591540 con 0x55add42851b0 2024-08-31T06:17:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 0x55add4629540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c42ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add4629000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c42ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add4629000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51184/0 (socket says 172.21.15.53:51184) 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c42ffd640 1 -- 172.21.15.53:0/2633484756 learned_addr learned my addr 172.21.15.53:0/2633484756 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.302+0000 7f4c427fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42851b0 0x55add4628ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c2bfff640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c2c0b4cd0 0x7f4c2c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c42ffd640 1 -- 172.21.15.53:0/2633484756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42851b0 msgr2=0x55add4628ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c42ffd640 1 --2- 172.21.15.53:0/2633484756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42851b0 0x55add4628ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c42ffd640 1 -- 172.21.15.53:0/2633484756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 msgr2=0x55add4629540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c42ffd640 1 --2- 172.21.15.53:0/2633484756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 0x55add4629540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c42ffd640 1 -- 172.21.15.53:0/2633484756 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55add42f0790 con 0x55add425c2f0 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c437fe640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c2c0b4cd0 0x7f4c2c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c2bfff640 1 -- 172.21.15.53:0/510104642 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f4c3c0e5a60 con 0x7f4c441089d0 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c42ffd640 1 --2- 172.21.15.53:0/2633484756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add4629000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009cc0 tx=0x7f4c34011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a723fe4dbb8be389 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c297fa640 1 -- 172.21.15.53:0/2633484756 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34005020 con 0x55add425c2f0 2024-08-31T06:17:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c297fa640 1 -- 172.21.15.53:0/2633484756 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c340047a0 con 0x55add425c2f0 2024-08-31T06:17:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c297fa640 1 -- 172.21.15.53:0/2633484756 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34005650 con 0x55add425c2f0 2024-08-31T06:17:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.303+0000 7f4c437fe640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c2c0b4cd0 0x7f4c2c0b71e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0a81b0 tx=0x7f4c3c000f40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:16.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.304+0000 7f4c50409740 1 -- 172.21.15.53:0/2633484756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 msgr2=0x55add4629000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.304+0000 7f4c50409740 1 --2- 172.21.15.53:0/2633484756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add4629000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009cc0 tx=0x7f4c34011810 comp rx=0 tx=0).stop 2024-08-31T06:17:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.305+0000 7f4c50409740 1 -- 172.21.15.53:0/2633484756 shutdown_connections 2024-08-31T06:17:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.305+0000 7f4c50409740 1 --2- 172.21.15.53:0/2633484756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 0x55add4629540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.305+0000 7f4c50409740 1 --2- 172.21.15.53:0/2633484756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add4629000 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.305+0000 7f4c50409740 1 --2- 172.21.15.53:0/2633484756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42851b0 0x55add4628ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.305+0000 7f4c50409740 1 -- 172.21.15.53:0/2633484756 >> 172.21.15.53:0/2633484756 conn(0x55add4279300 msgr2=0x55add46269b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.305+0000 7f4c50409740 1 -- 172.21.15.53:0/2633484756 shutdown_connections 2024-08-31T06:17:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.305+0000 7f4c50409740 1 -- 172.21.15.53:0/2633484756 wait complete. 2024-08-31T06:17:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.305+0000 7f4c50409740 1 -- start start 2024-08-31T06:17:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.305+0000 7f4c50409740 1 Processor -- start 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c50409740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4634690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c50409740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42644d0 0x55add4634bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c50409740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add42851b0 0x55add4640560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c50409740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55add44c6ab0 con 0x55add425c2f0 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c50409740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55add4514680 con 0x55add42851b0 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c50409740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55add4637240 con 0x55add42644d0 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c50409740 10 client.0 _ll_register_callbacks cb 0x55add429ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4634690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4634690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60692/0 (socket says 172.21.15.53:60692) 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c427fc640 1 -- 172.21.15.53:0/41782593 learned_addr learned my addr 172.21.15.53:0/41782593 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c42ffd640 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42644d0 0x55add4634bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c427fc640 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add42851b0 0x55add4640560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c427fc640 1 -- 172.21.15.53:0/41782593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42644d0 msgr2=0x55add4634bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c427fc640 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42644d0 0x55add4634bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c427fc640 1 -- 172.21.15.53:0/41782593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add42851b0 msgr2=0x55add4640560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c427fc640 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add42851b0 0x55add4640560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c427fc640 1 -- 172.21.15.53:0/41782593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55add4369620 con 0x55add425c2f0 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c427fc640 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4634690 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f4c380057c0 tx=0x7f4c3802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbe6403bc385ae3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c26ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c26ff5640 1 -- 172.21.15.53:0/41782593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38035040 con 0x55add425c2f0 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c26ff5640 1 -- 172.21.15.53:0/41782593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f4c38004450 con 0x55add425c2f0 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.306+0000 7f4c50409740 1 -- 172.21.15.53:0/41782593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c340047a0 con 0x55add425c2f0 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c26ff5640 1 -- 172.21.15.53:0/41782593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f4c380035f0 con 0x55add425c2f0 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c50409740 10 client.19455 fetch_fsmap learned FSMap version 52 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c50409740 1 -- 172.21.15.53:0/41782593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55add4643240 con 0x55add425c2f0 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c26ff5640 1 -- 172.21.15.53:0/41782593 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c340047a0 con 0x55add425c2f0 2024-08-31T06:17:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c26ff5640 1 -- 172.21.15.53:0/41782593 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 52) ==== 8394+0+0 (secure 0 0 0) 0x7f4c3803b660 con 0x55add425c2f0 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c50409740 10 client.19455 fetch_fsmap finished waiting for FSMap version 52 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c50409740 10 client.19455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c50409740 20 client.19455 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c50409740 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55add4243d80 0x55add4646810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c50409740 4 client.19455 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c50409740 1 -- 172.21.15.53:0/41782593 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55add459ff50 con 0x55add4243d80 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.307+0000 7f4c42ffd640 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55add4243d80 0x55add4646810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.308+0000 7f4c26ff5640 10 client.19455 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.308+0000 7f4c42ffd640 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55add4243d80 0x55add4646810 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f31e9aacf00d08d server_cookie=130b7752df604c2e in_seq=0 out_seq=0 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.308+0000 7f4c26ff5640 1 -- 172.21.15.53:0/41782593 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55add459ff50 con 0x55add4243d80 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.308+0000 7f4c26ff5640 10 client.19455 handle_command_reply: tid=0 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.308+0000 7f4c50409740 1 client.19455 shutdown 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c50409740 1 -- 172.21.15.53:0/41782593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 msgr2=0x55add4634690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c50409740 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4634690 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f4c380057c0 tx=0x7f4c3802a410 comp rx=0 tx=0).stop 2024-08-31T06:17:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c50409740 1 -- 172.21.15.53:0/41782593 shutdown_connections 2024-08-31T06:17:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c50409740 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55add4243d80 0x55add4646810 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c50409740 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add42851b0 0x55add4640560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c50409740 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42644d0 0x55add4634bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c26ff5640 0 client.19455 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c50409740 1 --2- 172.21.15.53:0/41782593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4634690 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c50409740 1 -- 172.21.15.53:0/41782593 >> 172.21.15.53:0/41782593 conn(0x55add4279300 msgr2=0x55add4629af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c50409740 1 -- 172.21.15.53:0/41782593 shutdown_connections 2024-08-31T06:17:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c50409740 1 -- 172.21.15.53:0/41782593 wait complete. 2024-08-31T06:17:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.309+0000 7f4c50409740 20 client.19455 trim_cache size 0 max 16384 2024-08-31T06:17:16.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.324+0000 7f4c50409740 1 Processor -- start 2024-08-31T06:17:16.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.324+0000 7f4c50409740 1 -- start start 2024-08-31T06:17:16.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c50409740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add4243d80 0x55add462dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c50409740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add462e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c50409740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 0x55add4631650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c50409740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4c441b16e0 con 0x55add42644d0 2024-08-31T06:17:16.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c50409740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c441b33a0 con 0x55add425c2f0 2024-08-31T06:17:16.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c50409740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c441b1db0 con 0x55add4243d80 2024-08-31T06:17:16.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 0x55add4631650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.328 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c42ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add462e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 0x55add4631650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60700/0 (socket says 172.21.15.53:60700) 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c42ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add462e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51198/0 (socket says 172.21.15.53:51198) 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c427fc640 1 -- 172.21.15.53:0/2292297992 learned_addr learned my addr 172.21.15.53:0/2292297992 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c427fc640 1 --2- 172.21.15.53:0/2292297992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add4243d80 0x55add462dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c427fc640 1 -- 172.21.15.53:0/2292297992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add4243d80 msgr2=0x55add462dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c427fc640 1 --2- 172.21.15.53:0/2292297992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add4243d80 0x55add462dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c427fc640 1 -- 172.21.15.53:0/2292297992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 msgr2=0x55add462e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c427fc640 1 --2- 172.21.15.53:0/2292297992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add462e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c427fc640 1 -- 172.21.15.53:0/2292297992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55add462b2c0 con 0x55add42644d0 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c42ffd640 1 --2- 172.21.15.53:0/2292297992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add462e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.325+0000 7f4c427fc640 1 --2- 172.21.15.53:0/2292297992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 0x55add4631650 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f4c38033000 tx=0x7f4c38005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6639dcb12b9d46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.326+0000 7f4c28ff9640 1 -- 172.21.15.53:0/2292297992 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38035030 con 0x55add42644d0 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.326+0000 7f4c28ff9640 1 -- 172.21.15.53:0/2292297992 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c38004450 con 0x55add42644d0 2024-08-31T06:17:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.326+0000 7f4c28ff9640 1 -- 172.21.15.53:0/2292297992 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38058040 con 0x55add42644d0 2024-08-31T06:17:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.326+0000 7f4c50409740 1 -- 172.21.15.53:0/2292297992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 msgr2=0x55add4631650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.326+0000 7f4c50409740 1 --2- 172.21.15.53:0/2292297992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 0x55add4631650 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f4c38033000 tx=0x7f4c38005fd0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 -- 172.21.15.53:0/2292297992 shutdown_connections 2024-08-31T06:17:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 --2- 172.21.15.53:0/2292297992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add42644d0 0x55add4631650 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 --2- 172.21.15.53:0/2292297992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add425c2f0 0x55add462e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 --2- 172.21.15.53:0/2292297992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add4243d80 0x55add462dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 -- 172.21.15.53:0/2292297992 >> 172.21.15.53:0/2292297992 conn(0x55add4279300 msgr2=0x55add462f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 -- 172.21.15.53:0/2292297992 shutdown_connections 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 -- 172.21.15.53:0/2292297992 wait complete. 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 -- start start 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 Processor -- start 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add4243d80 0x55add463ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4639f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42644d0 0x55add463a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4c441b2c10 con 0x55add425c2f0 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c441b24b0 con 0x55add4243d80 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4c441af6e0 con 0x55add42644d0 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.327+0000 7f4c50409740 10 client.0 _ll_register_callbacks cb 0x7f4c38031540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c42ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4639f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c42ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4639f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60702/0 (socket says 172.21.15.53:60702) 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c427fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add4243d80 0x55add463ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c42ffd640 1 -- 172.21.15.53:0/3222361825 learned_addr learned my addr 172.21.15.53:0/3222361825 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c427fc640 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42644d0 0x55add463a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c427fc640 1 -- 172.21.15.53:0/3222361825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42644d0 msgr2=0x55add463a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c427fc640 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42644d0 0x55add463a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c427fc640 1 -- 172.21.15.53:0/3222361825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 msgr2=0x55add4639f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c427fc640 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4639f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c427fc640 1 -- 172.21.15.53:0/3222361825 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55add463a9f0 con 0x55add4243d80 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c42ffd640 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4639f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c427fc640 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add4243d80 0x55add463ca80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4c380057c0 tx=0x7f4c38031910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30e1ff87c7172ac1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c26ff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c26ff5640 1 -- 172.21.15.53:0/3222361825 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38062070 con 0x55add4243d80 2024-08-31T06:17:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c26ff5640 1 -- 172.21.15.53:0/3222361825 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f4c3803b660 con 0x55add4243d80 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.328+0000 7f4c50409740 1 -- 172.21.15.53:0/3222361825 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c38004450 con 0x55add4243d80 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c26ff5640 1 -- 172.21.15.53:0/3222361825 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f4c38058070 con 0x55add4243d80 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c50409740 10 client.28544 fetch_fsmap learned FSMap version 52 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c50409740 1 -- 172.21.15.53:0/3222361825 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55add46b0f10 con 0x55add4243d80 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c26ff5640 1 -- 172.21.15.53:0/3222361825 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c38004450 con 0x55add4243d80 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c26ff5640 1 -- 172.21.15.53:0/3222361825 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 52) ==== 8394+0+0 (secure 0 0 0) 0x7f4c38054450 con 0x55add4243d80 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c50409740 10 client.28544 fetch_fsmap finished waiting for FSMap version 52 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c50409740 10 client.28544 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c50409740 20 client.28544 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c50409740 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55add42851b0 0x55add46b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c50409740 4 client.28544 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c50409740 1 -- 172.21.15.53:0/3222361825 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55add459b9f0 con 0x55add42851b0 2024-08-31T06:17:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.329+0000 7f4c42ffd640 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55add42851b0 0x55add46b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.330+0000 7f4c26ff5640 10 client.28544 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:16.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.330+0000 7f4c42ffd640 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55add42851b0 0x55add46b36f0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f528551381355fbe server_cookie=3f8ad62669b8a0d in_seq=0 out_seq=0 2024-08-31T06:17:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c26ff5640 1 -- 172.21.15.53:0/3222361825 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55add459b9f0 con 0x55add42851b0 2024-08-31T06:17:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c26ff5640 10 client.28544 handle_command_reply: tid=0 2024-08-31T06:17:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 1 client.28544 shutdown 2024-08-31T06:17:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 1 -- 172.21.15.53:0/3222361825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add4243d80 msgr2=0x55add463ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add4243d80 0x55add463ca80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4c380057c0 tx=0x7f4c38031910 comp rx=0 tx=0).stop 2024-08-31T06:17:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 1 -- 172.21.15.53:0/3222361825 shutdown_connections 2024-08-31T06:17:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55add42851b0 0x55add46b36f0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55add42644d0 0x55add463a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55add425c2f0 0x55add4639f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c26ff5640 0 client.28544 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 1 --2- 172.21.15.53:0/3222361825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55add4243d80 0x55add463ca80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 1 -- 172.21.15.53:0/3222361825 >> 172.21.15.53:0/3222361825 conn(0x55add4279300 msgr2=0x55add462f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 1 -- 172.21.15.53:0/3222361825 shutdown_connections 2024-08-31T06:17:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 1 -- 172.21.15.53:0/3222361825 wait complete. 2024-08-31T06:17:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.355+0000 7f4c50409740 20 client.28544 trim_cache size 0 max 16384 2024-08-31T06:17:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:17:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:17:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:17:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:17:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 -- 172.21.15.53:0/510104642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c2c0b4cd0 msgr2=0x7f4c2c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c2c0b4cd0 0x7f4c2c0b71e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0a81b0 tx=0x7f4c3c000f40 comp rx=0 tx=0).stop 2024-08-31T06:17:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 -- 172.21.15.53:0/510104642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c441089d0 msgr2=0x7f4c440ffd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c441089d0 0x7f4c440ffd70 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00eb10 tx=0x7f4c3c00c2d0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 -- 172.21.15.53:0/510104642 shutdown_connections 2024-08-31T06:17:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4c2c0b4cd0 0x7f4c2c0b71e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c441089d0 0x7f4c440ffd70 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c44108080 0x7f4c440ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 --2- 172.21.15.53:0/510104642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c44102750 0x7f4c440ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 -- 172.21.15.53:0/510104642 >> 172.21.15.53:0/510104642 conn(0x7f4c4407a4e0 msgr2=0x7f4c441017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 -- 172.21.15.53:0/510104642 shutdown_connections 2024-08-31T06:17:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:16.356+0000 7f4c4949b640 1 -- 172.21.15.53:0/510104642 wait complete. 2024-08-31T06:17:17.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 188140 1.34 MB/sec execute 546 sec latency 2254.892 ms 2024-08-31T06:17:17.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:17 smithi153 ceph-mon[22320]: pgmap v707: 97 pgs: 97 active+clean; 111 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 1.0 MiB/s wr, 105 op/s 2024-08-31T06:17:17.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:17 smithi053 ceph-mon[18924]: pgmap v707: 97 pgs: 97 active+clean; 111 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 1.0 MiB/s wr, 105 op/s 2024-08-31T06:17:17.999 INFO:tasks.workunit.client.0.smithi053.stdout: 1 188140 1.34 MB/sec execute 547 sec latency 1411.768 ms 2024-08-31T06:17:18.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:17 smithi130 ceph-mon[22266]: pgmap v707: 97 pgs: 97 active+clean; 111 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 1.0 MiB/s wr, 105 op/s 2024-08-31T06:17:19.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 188140 1.34 MB/sec execute 548 sec latency 2411.885 ms 2024-08-31T06:17:19.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:19 smithi153 ceph-mon[22320]: pgmap v708: 97 pgs: 97 active+clean; 112 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 1.2 MiB/s wr, 116 op/s 2024-08-31T06:17:19.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:19 smithi053 ceph-mon[18924]: pgmap v708: 97 pgs: 97 active+clean; 112 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 1.2 MiB/s wr, 116 op/s 2024-08-31T06:17:20.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 188140 1.33 MB/sec execute 549 sec latency 3411.953 ms 2024-08-31T06:17:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:19 smithi130 ceph-mon[22266]: pgmap v708: 97 pgs: 97 active+clean; 112 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 1.2 MiB/s wr, 116 op/s 2024-08-31T06:17:21.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 188140 1.33 MB/sec execute 550 sec latency 4412.055 ms 2024-08-31T06:17:21.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:21 smithi153 ceph-mon[22320]: pgmap v709: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 846 KiB/s wr, 91 op/s 2024-08-31T06:17:21.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:21 smithi053 ceph-mon[18924]: pgmap v709: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 846 KiB/s wr, 91 op/s 2024-08-31T06:17:22.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 188321 1.33 MB/sec execute 551 sec latency 4660.187 ms 2024-08-31T06:17:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:21 smithi130 ceph-mon[22266]: pgmap v709: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 846 KiB/s wr, 91 op/s 2024-08-31T06:17:23.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 188586 1.33 MB/sec execute 552 sec latency 15.100 ms 2024-08-31T06:17:23.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:23 smithi153 ceph-mon[22320]: pgmap v710: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 722 KiB/s wr, 67 op/s 2024-08-31T06:17:23.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:23 smithi053 ceph-mon[18924]: pgmap v710: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 722 KiB/s wr, 67 op/s 2024-08-31T06:17:24.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 189048 1.33 MB/sec execute 553 sec latency 15.175 ms 2024-08-31T06:17:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:23 smithi130 ceph-mon[22266]: pgmap v710: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 722 KiB/s wr, 67 op/s 2024-08-31T06:17:25.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 189515 1.33 MB/sec execute 554 sec latency 22.852 ms 2024-08-31T06:17:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:25 smithi153 ceph-mon[22320]: pgmap v711: 97 pgs: 97 active+clean; 110 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 672 KiB/s wr, 66 op/s 2024-08-31T06:17:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:25 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:17:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:25 smithi053 ceph-mon[18924]: pgmap v711: 97 pgs: 97 active+clean; 110 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 672 KiB/s wr, 66 op/s 2024-08-31T06:17:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:25 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:17:26.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 190044 1.33 MB/sec execute 555 sec latency 24.034 ms 2024-08-31T06:17:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:25 smithi130 ceph-mon[22266]: pgmap v711: 97 pgs: 97 active+clean; 110 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 672 KiB/s wr, 66 op/s 2024-08-31T06:17:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:25 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:17:27.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 190500 1.33 MB/sec execute 556 sec latency 23.656 ms 2024-08-31T06:17:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:27 smithi153 ceph-mon[22320]: pgmap v712: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 739 KiB/s wr, 63 op/s 2024-08-31T06:17:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:27 smithi053 ceph-mon[18924]: pgmap v712: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 739 KiB/s wr, 63 op/s 2024-08-31T06:17:28.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 191268 1.34 MB/sec execute 557 sec latency 15.229 ms 2024-08-31T06:17:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:27 smithi130 ceph-mon[22266]: pgmap v712: 97 pgs: 97 active+clean; 108 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 739 KiB/s wr, 63 op/s 2024-08-31T06:17:29.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 191620 1.35 MB/sec execute 558 sec latency 18.603 ms 2024-08-31T06:17:29.459 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.454+0000 7f6626f24640 1 -- 172.21.15.53:0/2362399960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201089d0 msgr2=0x7f662010f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.454+0000 7f6626f24640 1 --2- 172.21.15.53:0/2362399960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201089d0 0x7f662010f200 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f6618009ca0 tx=0x7f661802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.454+0000 7f6626f24640 1 -- 172.21.15.53:0/2362399960 shutdown_connections 2024-08-31T06:17:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.454+0000 7f6626f24640 1 --2- 172.21.15.53:0/2362399960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201089d0 0x7f662010f200 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.454+0000 7f6626f24640 1 --2- 172.21.15.53:0/2362399960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6620108080 0x7f6620108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.454+0000 7f6626f24640 1 --2- 172.21.15.53:0/2362399960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6620102750 0x7f6620102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.454+0000 7f6626f24640 1 -- 172.21.15.53:0/2362399960 >> 172.21.15.53:0/2362399960 conn(0x7f662007a4e0 msgr2=0x7f662007a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.454+0000 7f6626f24640 1 -- 172.21.15.53:0/2362399960 shutdown_connections 2024-08-31T06:17:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.454+0000 7f6626f24640 1 -- 172.21.15.53:0/2362399960 wait complete. 2024-08-31T06:17:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f6626f24640 1 Processor -- start 2024-08-31T06:17:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f6626f24640 1 -- start start 2024-08-31T06:17:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f6626f24640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6620102750 0x7f662019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f6626f24640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6620108080 0x7f662019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f6626f24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201089d0 0x7f662019f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f6626f24640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6620112580 con 0x7f66201089d0 2024-08-31T06:17:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f6626f24640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6620112400 con 0x7f6620102750 2024-08-31T06:17:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f6626f24640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6620112700 con 0x7f6620108080 2024-08-31T06:17:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f66254c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201089d0 0x7f662019f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f66254c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201089d0 0x7f662019f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59126/0 (socket says 172.21.15.53:59126) 2024-08-31T06:17:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f66254c1640 1 -- 172.21.15.53:0/773760931 learned_addr learned my addr 172.21.15.53:0/773760931 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f6624cc0640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6620102750 0x7f662019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f6617fff640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6620108080 0x7f662019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f66254c1640 1 -- 172.21.15.53:0/773760931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6620108080 msgr2=0x7f662019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f66254c1640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6620108080 0x7f662019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f66254c1640 1 -- 172.21.15.53:0/773760931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6620102750 msgr2=0x7f662019a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f66254c1640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6620102750 0x7f662019a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.455+0000 7f66254c1640 1 -- 172.21.15.53:0/773760931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66201a0000 con 0x7f66201089d0 2024-08-31T06:17:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.456+0000 7f66254c1640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201089d0 0x7f662019f900 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f6618005cc0 tx=0x7f6618003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.456+0000 7f6615ffb640 1 -- 172.21.15.53:0/773760931 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618032c10 con 0x7f66201089d0 2024-08-31T06:17:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.456+0000 7f6615ffb640 1 -- 172.21.15.53:0/773760931 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6618032db0 con 0x7f66201089d0 2024-08-31T06:17:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.456+0000 7f6626f24640 1 -- 172.21.15.53:0/773760931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66201a0290 con 0x7f66201089d0 2024-08-31T06:17:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.456+0000 7f6615ffb640 1 -- 172.21.15.53:0/773760931 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618030a60 con 0x7f66201089d0 2024-08-31T06:17:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.456+0000 7f6626f24640 1 -- 172.21.15.53:0/773760931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66201a6a80 con 0x7f66201089d0 2024-08-31T06:17:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.458+0000 7f662de93740 1 Processor -- start 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6615ffb640 1 -- 172.21.15.53:0/773760931 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6618030c20 con 0x7f66201089d0 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f662de93740 1 -- start start 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f662de93740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d6a1b0 0x5623b510dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f662de93740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d412f0 0x5623b510e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f662de93740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d494d0 0x5623b510e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f662de93740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5623b5083000 con 0x5623b4d6a1b0 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f662de93740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5623b5072590 con 0x5623b4d412f0 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f662de93740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5623b5076540 con 0x5623b4d494d0 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6617fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d6a1b0 0x5623b510dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6617fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d6a1b0 0x5623b510dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59132/0 (socket says 172.21.15.53:59132) 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6617fff640 1 -- 172.21.15.53:0/1724387621 learned_addr learned my addr 172.21.15.53:0/1724387621 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6624cc0640 1 --2- 172.21.15.53:0/1724387621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d412f0 0x5623b510e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6617fff640 1 --2- 172.21.15.53:0/1724387621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d494d0 0x5623b510e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6615ffb640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66080b4d20 0x7f66080b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6617fff640 1 -- 172.21.15.53:0/1724387621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d494d0 msgr2=0x5623b510e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6617fff640 1 --2- 172.21.15.53:0/1724387621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d494d0 0x5623b510e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6617fff640 1 -- 172.21.15.53:0/1724387621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d412f0 msgr2=0x5623b510e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6617fff640 1 --2- 172.21.15.53:0/1724387621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d412f0 0x5623b510e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.459+0000 7f6617fff640 1 -- 172.21.15.53:0/1724387621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b4dd5790 con 0x5623b4d6a1b0 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.460+0000 7f66254c1640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66080b4d20 0x7f66080b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.460+0000 7f6617fff640 1 --2- 172.21.15.53:0/1724387621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d6a1b0 0x5623b510dac0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f6610009f80 tx=0x7f6610009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750aa476473dee0e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.460+0000 7f6615ffb640 1 -- 172.21.15.53:0/773760931 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f6618106680 con 0x7f66201089d0 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.460+0000 7f6606ffd640 1 -- 172.21.15.53:0/1724387621 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661001a030 con 0x5623b4d6a1b0 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.460+0000 7f6606ffd640 1 -- 172.21.15.53:0/1724387621 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6610012070 con 0x5623b4d6a1b0 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.460+0000 7f6606ffd640 1 -- 172.21.15.53:0/1724387621 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610003b20 con 0x5623b4d6a1b0 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f662de93740 1 -- 172.21.15.53:0/1724387621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d6a1b0 msgr2=0x5623b510dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:29.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f66254c1640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66080b4d20 0x7f66080b7230 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6618103e60 tx=0x7f661809a300 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f662de93740 1 --2- 172.21.15.53:0/1724387621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d6a1b0 0x5623b510dac0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f6610009f80 tx=0x7f6610009740 comp rx=0 tx=0).stop 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f662de93740 1 -- 172.21.15.53:0/1724387621 shutdown_connections 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f662de93740 1 --2- 172.21.15.53:0/1724387621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d494d0 0x5623b510e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f662de93740 1 --2- 172.21.15.53:0/1724387621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d412f0 0x5623b510e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f662de93740 1 --2- 172.21.15.53:0/1724387621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d6a1b0 0x5623b510dac0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f662de93740 1 -- 172.21.15.53:0/1724387621 >> 172.21.15.53:0/1724387621 conn(0x5623b4d5e300 msgr2=0x5623b510b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f662de93740 1 -- 172.21.15.53:0/1724387621 shutdown_connections 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f662de93740 1 -- 172.21.15.53:0/1724387621 wait complete. 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f662de93740 1 -- start start 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.461+0000 7f662de93740 1 Processor -- start 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f662de93740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d412f0 0x5623b5119650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f662de93740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b5119b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f662de93740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d6a1b0 0x5623b5125530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f662de93740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5623b4fabab0 con 0x5623b4d494d0 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f662de93740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5623b4ff9680 con 0x5623b4d6a1b0 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f662de93740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5623b511c240 con 0x5623b4d412f0 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f662de93740 10 client.0 _ll_register_callbacks cb 0x5623b4d81a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6624cc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b5119b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6624cc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b5119b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59144/0 (socket says 172.21.15.53:59144) 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6624cc0640 1 -- 172.21.15.53:0/3100152928 learned_addr learned my addr 172.21.15.53:0/3100152928 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6617fff640 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d6a1b0 0x5623b5125530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6617fff640 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d412f0 0x5623b5119650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6624cc0640 1 -- 172.21.15.53:0/3100152928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d412f0 msgr2=0x5623b5119650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6624cc0640 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d412f0 0x5623b5119650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6624cc0640 1 -- 172.21.15.53:0/3100152928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d6a1b0 msgr2=0x5623b5125530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6624cc0640 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d6a1b0 0x5623b5125530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6624cc0640 1 -- 172.21.15.53:0/3100152928 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b4e4e620 con 0x5623b4d494d0 2024-08-31T06:17:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6617fff640 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d412f0 0x5623b5119650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f6624cc0640 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b5119b90 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f661c012740 tx=0x7f661c012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427992896d21c162 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f65fffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.462+0000 7f65fffff640 1 -- 172.21.15.53:0/3100152928 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c00f920 con 0x5623b4d494d0 2024-08-31T06:17:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f65fffff640 1 -- 172.21.15.53:0/3100152928 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f661c00fac0 con 0x5623b4d494d0 2024-08-31T06:17:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f662de93740 1 -- 172.21.15.53:0/3100152928 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6610012070 con 0x5623b4d494d0 2024-08-31T06:17:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f65fffff640 1 -- 172.21.15.53:0/3100152928 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f661c00fcc0 con 0x5623b4d494d0 2024-08-31T06:17:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f662de93740 10 client.19473 fetch_fsmap learned FSMap version 53 2024-08-31T06:17:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f662de93740 1 -- 172.21.15.53:0/3100152928 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5623b5128290 con 0x5623b4d494d0 2024-08-31T06:17:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f65fffff640 1 -- 172.21.15.53:0/3100152928 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6610012070 con 0x5623b4d494d0 2024-08-31T06:17:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f65fffff640 1 -- 172.21.15.53:0/3100152928 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 53) ==== 8402+0+0 (secure 0 0 0) 0x7f661c024420 con 0x5623b4d494d0 2024-08-31T06:17:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f662de93740 10 client.19473 fetch_fsmap finished waiting for FSMap version 53 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f662de93740 10 client.19473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f662de93740 20 client.19473 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f662de93740 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623b4d28d80 0x5623b512b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f662de93740 4 client.19473 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f662de93740 1 -- 172.21.15.53:0/3100152928 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623b5084f50 con 0x5623b4d28d80 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.463+0000 7f6617fff640 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623b4d28d80 0x5623b512b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.464+0000 7f65fffff640 10 client.19473 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.464+0000 7f6617fff640 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623b4d28d80 0x5623b512b8f0 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8af3ad86dc78ce5 server_cookie=d6b2db6695fc4bd8 in_seq=0 out_seq=0 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f65fffff640 1 -- 172.21.15.53:0/3100152928 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623b5084f50 con 0x5623b4d28d80 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f65fffff640 10 client.19473 handle_command_reply: tid=0 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 1 client.19473 shutdown 2024-08-31T06:17:29.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 1 -- 172.21.15.53:0/3100152928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 msgr2=0x5623b5119b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b5119b90 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f661c012740 tx=0x7f661c012c00 comp rx=0 tx=0).stop 2024-08-31T06:17:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 1 -- 172.21.15.53:0/3100152928 shutdown_connections 2024-08-31T06:17:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623b4d28d80 0x5623b512b8f0 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d6a1b0 0x5623b5125530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b5119b90 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f65fffff640 0 client.19473 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 1 --2- 172.21.15.53:0/3100152928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d412f0 0x5623b5119650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 1 -- 172.21.15.53:0/3100152928 >> 172.21.15.53:0/3100152928 conn(0x5623b4d5e300 msgr2=0x5623b510eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 1 -- 172.21.15.53:0/3100152928 shutdown_connections 2024-08-31T06:17:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 1 -- 172.21.15.53:0/3100152928 wait complete. 2024-08-31T06:17:29.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.465+0000 7f662de93740 20 client.19473 trim_cache size 0 max 16384 2024-08-31T06:17:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f662de93740 1 Processor -- start 2024-08-31T06:17:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f662de93740 1 -- start start 2024-08-31T06:17:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f662de93740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d412f0 0x5623b5112b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f662de93740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d494d0 0x5623b51130c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f662de93740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d6a1b0 0x5623b5118910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f662de93740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f66201af470 con 0x5623b4d412f0 2024-08-31T06:17:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f662de93740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66201b1190 con 0x5623b4d6a1b0 2024-08-31T06:17:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f662de93740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66201afb40 con 0x5623b4d494d0 2024-08-31T06:17:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f6617fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d412f0 0x5623b5112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f6617fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d412f0 0x5623b5112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59150/0 (socket says 172.21.15.53:59150) 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f6617fff640 1 -- 172.21.15.53:0/4231558703 learned_addr learned my addr 172.21.15.53:0/4231558703 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f6624cc0640 1 --2- 172.21.15.53:0/4231558703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d494d0 0x5623b51130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f6617fff640 1 -- 172.21.15.53:0/4231558703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d494d0 msgr2=0x5623b51130c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f6617fff640 1 --2- 172.21.15.53:0/4231558703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d494d0 0x5623b51130c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f6617fff640 1 -- 172.21.15.53:0/4231558703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d6a1b0 msgr2=0x5623b5118910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f6617fff640 1 --2- 172.21.15.53:0/4231558703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d6a1b0 0x5623b5118910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f6617fff640 1 -- 172.21.15.53:0/4231558703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b5113da0 con 0x5623b4d412f0 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f6624cc0640 1 --2- 172.21.15.53:0/4231558703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d494d0 0x5623b51130c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.480+0000 7f6617fff640 1 --2- 172.21.15.53:0/4231558703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d412f0 0x5623b5112b80 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f6610009f80 tx=0x7f6610009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb553dd14548e068 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f66067fc640 1 -- 172.21.15.53:0/4231558703 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610005030 con 0x5623b4d412f0 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f66067fc640 1 -- 172.21.15.53:0/4231558703 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6610004660 con 0x5623b4d412f0 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f66067fc640 1 -- 172.21.15.53:0/4231558703 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661001f440 con 0x5623b4d412f0 2024-08-31T06:17:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f662de93740 1 -- 172.21.15.53:0/4231558703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d412f0 msgr2=0x5623b5112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f662de93740 1 --2- 172.21.15.53:0/4231558703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d412f0 0x5623b5112b80 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f6610009f80 tx=0x7f6610009dd0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f662de93740 1 -- 172.21.15.53:0/4231558703 shutdown_connections 2024-08-31T06:17:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f662de93740 1 --2- 172.21.15.53:0/4231558703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d6a1b0 0x5623b5118910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f662de93740 1 --2- 172.21.15.53:0/4231558703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d494d0 0x5623b51130c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f662de93740 1 --2- 172.21.15.53:0/4231558703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d412f0 0x5623b5112b80 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f662de93740 1 -- 172.21.15.53:0/4231558703 >> 172.21.15.53:0/4231558703 conn(0x5623b4d5e300 msgr2=0x5623b5117ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f662de93740 1 -- 172.21.15.53:0/4231558703 shutdown_connections 2024-08-31T06:17:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.481+0000 7f662de93740 1 -- 172.21.15.53:0/4231558703 wait complete. 2024-08-31T06:17:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f662de93740 1 -- start start 2024-08-31T06:17:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f662de93740 1 Processor -- start 2024-08-31T06:17:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f662de93740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d412f0 0x5623b511d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f662de93740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b511dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f662de93740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d6a1b0 0x5623b51952d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f662de93740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f66201b0a00 con 0x5623b4d494d0 2024-08-31T06:17:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f662de93740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66201b02a0 con 0x5623b4d412f0 2024-08-31T06:17:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f662de93740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66201ad470 con 0x5623b4d6a1b0 2024-08-31T06:17:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f662de93740 10 client.0 _ll_register_callbacks cb 0x7f661c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f6624cc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b511dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f6624cc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b511dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59164/0 (socket says 172.21.15.53:59164) 2024-08-31T06:17:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.482+0000 7f6624cc0640 1 -- 172.21.15.53:0/610512964 learned_addr learned my addr 172.21.15.53:0/610512964 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f6617fff640 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d412f0 0x5623b511d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f6617fff640 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d6a1b0 0x5623b51952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f6624cc0640 1 -- 172.21.15.53:0/610512964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d6a1b0 msgr2=0x5623b51952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f6624cc0640 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d6a1b0 0x5623b51952d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f6624cc0640 1 -- 172.21.15.53:0/610512964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d412f0 msgr2=0x5623b511d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f6624cc0640 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d412f0 0x5623b511d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f6624cc0640 1 -- 172.21.15.53:0/610512964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b511e5f0 con 0x5623b4d494d0 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f6617fff640 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d412f0 0x5623b511d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f6624cc0640 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b511dd20 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f661c024a80 tx=0x7f661c00fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279501f73114a24c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f65fffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f65fffff640 1 -- 172.21.15.53:0/610512964 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c024e10 con 0x5623b4d494d0 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f65fffff640 1 -- 172.21.15.53:0/610512964 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f661c024420 con 0x5623b4d494d0 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f662de93740 1 -- 172.21.15.53:0/610512964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6610004660 con 0x5623b4d494d0 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f65fffff640 1 -- 172.21.15.53:0/610512964 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f661c034050 con 0x5623b4d494d0 2024-08-31T06:17:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f662de93740 10 client.19479 fetch_fsmap learned FSMap version 53 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f662de93740 1 -- 172.21.15.53:0/610512964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5623b51968a0 con 0x5623b4d494d0 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.483+0000 7f65fffff640 1 -- 172.21.15.53:0/610512964 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6610004660 con 0x5623b4d494d0 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.484+0000 7f65fffff640 1 -- 172.21.15.53:0/610512964 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 53) ==== 8402+0+0 (secure 0 0 0) 0x7f661c02b020 con 0x5623b4d494d0 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.484+0000 7f662de93740 10 client.19479 fetch_fsmap finished waiting for FSMap version 53 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.484+0000 7f662de93740 10 client.19479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.484+0000 7f662de93740 20 client.19479 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.484+0000 7f662de93740 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623b4cfe1c0 0x5623b51991a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.484+0000 7f662de93740 4 client.19479 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.484+0000 7f662de93740 1 -- 172.21.15.53:0/610512964 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5623b50809f0 con 0x5623b4cfe1c0 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.484+0000 7f6617fff640 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623b4cfe1c0 0x5623b51991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.484+0000 7f65fffff640 10 client.19479 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.484+0000 7f6617fff640 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623b4cfe1c0 0x5623b51991a0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f81b3047a21204 server_cookie=b51af24e23cabb81 in_seq=0 out_seq=0 2024-08-31T06:17:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f65fffff640 1 -- 172.21.15.53:0/610512964 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623b50809f0 con 0x5623b4cfe1c0 2024-08-31T06:17:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f65fffff640 10 client.19479 handle_command_reply: tid=0 2024-08-31T06:17:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 1 client.19479 shutdown 2024-08-31T06:17:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 1 -- 172.21.15.53:0/610512964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 msgr2=0x5623b511dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b511dd20 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f661c024a80 tx=0x7f661c00fee0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 1 -- 172.21.15.53:0/610512964 shutdown_connections 2024-08-31T06:17:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623b4cfe1c0 0x5623b51991a0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623b4d6a1b0 0x5623b51952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4d494d0 0x5623b511dd20 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 1 --2- 172.21.15.53:0/610512964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623b4d412f0 0x5623b511d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f65fffff640 0 client.19479 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 1 -- 172.21.15.53:0/610512964 >> 172.21.15.53:0/610512964 conn(0x5623b4d5e300 msgr2=0x5623b511a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 1 -- 172.21.15.53:0/610512964 shutdown_connections 2024-08-31T06:17:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 1 -- 172.21.15.53:0/610512964 wait complete. 2024-08-31T06:17:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f662de93740 20 client.19479 trim_cache size 0 max 16384 2024-08-31T06:17:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:17:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:17:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:17:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:17:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f6626f24640 1 -- 172.21.15.53:0/773760931 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66080b4d20 msgr2=0x7f66080b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f6626f24640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66080b4d20 0x7f66080b7230 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6618103e60 tx=0x7f661809a300 comp rx=0 tx=0).stop 2024-08-31T06:17:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f6626f24640 1 -- 172.21.15.53:0/773760931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201089d0 msgr2=0x7f662019f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f6626f24640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201089d0 0x7f662019f900 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f6618005cc0 tx=0x7f6618003f90 comp rx=0 tx=0).stop 2024-08-31T06:17:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f6626f24640 1 -- 172.21.15.53:0/773760931 shutdown_connections 2024-08-31T06:17:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f6626f24640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f66080b4d20 0x7f66080b7230 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f6626f24640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201089d0 0x7f662019f900 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f6626f24640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6620108080 0x7f662019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f6626f24640 1 --2- 172.21.15.53:0/773760931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6620102750 0x7f662019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.510+0000 7f6626f24640 1 -- 172.21.15.53:0/773760931 >> 172.21.15.53:0/773760931 conn(0x7f662007a4e0 msgr2=0x7f662006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.511+0000 7f6626f24640 1 -- 172.21.15.53:0/773760931 shutdown_connections 2024-08-31T06:17:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:29.511+0000 7f6626f24640 1 -- 172.21.15.53:0/773760931 wait complete. 2024-08-31T06:17:29.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:29 smithi153 ceph-mon[22320]: pgmap v713: 97 pgs: 97 active+clean; 110 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 766 KiB/s wr, 91 op/s 2024-08-31T06:17:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:29 smithi053 ceph-mon[18924]: pgmap v713: 97 pgs: 97 active+clean; 110 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 766 KiB/s wr, 91 op/s 2024-08-31T06:17:30.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 191620 1.34 MB/sec execute 559 sec latency 1007.219 ms 2024-08-31T06:17:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:29 smithi130 ceph-mon[22266]: pgmap v713: 97 pgs: 97 active+clean; 110 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 766 KiB/s wr, 91 op/s 2024-08-31T06:17:30.504 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:17:30.770 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:17:30.891 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:30 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:17:30.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:30 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:17:31.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 191620 1.34 MB/sec execute 560 sec latency 2007.289 ms 2024-08-31T06:17:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:30 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:17:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.267+0000 7fe0140de640 1 -- 172.21.15.53:0/2875956765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c108ae0 msgr2=0x7fe00c10f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.267+0000 7fe0140de640 1 --2- 172.21.15.53:0/2875956765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c108ae0 0x7fe00c10f310 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fe004009ca0 tx=0x7fe00402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.268+0000 7fe0140de640 1 -- 172.21.15.53:0/2875956765 shutdown_connections 2024-08-31T06:17:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.268+0000 7fe0140de640 1 --2- 172.21.15.53:0/2875956765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c108ae0 0x7fe00c10f310 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.268+0000 7fe0140de640 1 --2- 172.21.15.53:0/2875956765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe00c108190 0x7fe00c1085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.268+0000 7fe0140de640 1 --2- 172.21.15.53:0/2875956765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe00c102850 0x7fe00c102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.268+0000 7fe0140de640 1 -- 172.21.15.53:0/2875956765 >> 172.21.15.53:0/2875956765 conn(0x7fe00c079450 msgr2=0x7fe00c079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.268+0000 7fe0140de640 1 -- 172.21.15.53:0/2875956765 shutdown_connections 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.268+0000 7fe0140de640 1 -- 172.21.15.53:0/2875956765 wait complete. 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.268+0000 7fe0140de640 1 Processor -- start 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.268+0000 7fe0140de640 1 -- start start 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe0140de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe00c102850 0x7fe00c19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe0140de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c108190 0x7fe00c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe0140de640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe00c108ae0 0x7fe00c19f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe0140de640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c112660 con 0x7fe00c108190 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe0140de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1124e0 con 0x7fe00c102850 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe0140de640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1127e0 con 0x7fe00c108ae0 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe011679640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c108190 0x7fe00c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe011679640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c108190 0x7fe00c19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59172/0 (socket says 172.21.15.53:59172) 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe011679640 1 -- 172.21.15.53:0/1653550591 learned_addr learned my addr 172.21.15.53:0/1653550591 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe01267b640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe00c108ae0 0x7fe00c19f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe011e7a640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe00c102850 0x7fe00c19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe011679640 1 -- 172.21.15.53:0/1653550591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe00c108ae0 msgr2=0x7fe00c19f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe011679640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe00c108ae0 0x7fe00c19f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe011679640 1 -- 172.21.15.53:0/1653550591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe00c102850 msgr2=0x7fe00c19a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe011679640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe00c102850 0x7fe00c19a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe011679640 1 -- 172.21.15.53:0/1653550591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c1a0110 con 0x7fe00c108190 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe01267b640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe00c108ae0 0x7fe00c19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.269+0000 7fe011679640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c108190 0x7fe00c19a740 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fdffc005fd0 tx=0x7fdffc00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.270+0000 7fe002ffd640 1 -- 172.21.15.53:0/1653550591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc017070 con 0x7fe00c108190 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.270+0000 7fe002ffd640 1 -- 172.21.15.53:0/1653550591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdffc009c30 con 0x7fe00c108190 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.270+0000 7fe0140de640 1 -- 172.21.15.53:0/1653550591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00c1a0400 con 0x7fe00c108190 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.270+0000 7fe002ffd640 1 -- 172.21.15.53:0/1653550591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc003c70 con 0x7fe00c108190 2024-08-31T06:17:31.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.270+0000 7fe0140de640 1 -- 172.21.15.53:0/1653550591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00c1a6b60 con 0x7fe00c108190 2024-08-31T06:17:31.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.272+0000 7fe01a653740 1 Processor -- start 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.272+0000 7fe002ffd640 1 -- 172.21.15.53:0/1653550591 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdffc003e10 con 0x7fe00c108190 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01a653740 1 -- start start 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01a653740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1edb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01a653740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b0d1b0 0x559bb1edb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01a653740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b15390 0x559bb1edbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01a653740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559bb1e52630 con 0x559bb1b36070 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01a653740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559bb1e41bc0 con 0x559bb1b15390 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01a653740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559bb1e45b70 con 0x559bb1b0d1b0 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01267b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1edb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01267b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1edb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59176/0 (socket says 172.21.15.53:59176) 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01267b640 1 -- 172.21.15.53:0/2339329932 learned_addr learned my addr 172.21.15.53:0/2339329932 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe011e7a640 1 --2- 172.21.15.53:0/2339329932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b0d1b0 0x559bb1edb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe011679640 1 --2- 172.21.15.53:0/2339329932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b15390 0x559bb1edbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01267b640 1 -- 172.21.15.53:0/2339329932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b0d1b0 msgr2=0x559bb1edb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.273+0000 7fe01267b640 1 --2- 172.21.15.53:0/2339329932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b0d1b0 0x559bb1edb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fe01267b640 1 -- 172.21.15.53:0/2339329932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b15390 msgr2=0x559bb1edbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fe01267b640 1 --2- 172.21.15.53:0/2339329932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b15390 0x559bb1edbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fe01267b640 1 -- 172.21.15.53:0/2339329932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb1ba1650 con 0x559bb1b36070 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fe011679640 1 --2- 172.21.15.53:0/2339329932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b15390 0x559bb1edbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fe011e7a640 1 --2- 172.21.15.53:0/2339329932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b0d1b0 0x559bb1edb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fe002ffd640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdff80b4d20 0x7fdff80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fe01267b640 1 --2- 172.21.15.53:0/2339329932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1edb2c0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fe0040094b0 tx=0x7fe004009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14307214a099b53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fe011e7a640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdff80b4d20 0x7fdff80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fe002ffd640 1 -- 172.21.15.53:0/1653550591 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7fdffc0e5160 con 0x7fe00c108190 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fdff7fff640 1 -- 172.21.15.53:0/2339329932 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004031980 con 0x559bb1b36070 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fdff7fff640 1 -- 172.21.15.53:0/2339329932 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe004036040 con 0x559bb1b36070 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.274+0000 7fdff7fff640 1 -- 172.21.15.53:0/2339329932 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004004400 con 0x559bb1b36070 2024-08-31T06:17:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.275+0000 7fe01a653740 1 -- 172.21.15.53:0/2339329932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 msgr2=0x559bb1edb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.275+0000 7fe01a653740 1 --2- 172.21.15.53:0/2339329932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1edb2c0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fe0040094b0 tx=0x7fe004009a20 comp rx=0 tx=0).stop 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.275+0000 7fe011e7a640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdff80b4d20 0x7fdff80b7230 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x559bb1ed9f40 tx=0x7fe008005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.275+0000 7fe01a653740 1 -- 172.21.15.53:0/2339329932 shutdown_connections 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.275+0000 7fe01a653740 1 --2- 172.21.15.53:0/2339329932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b15390 0x559bb1edbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.275+0000 7fe01a653740 1 --2- 172.21.15.53:0/2339329932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b0d1b0 0x559bb1edb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.275+0000 7fe01a653740 1 --2- 172.21.15.53:0/2339329932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1edb2c0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.275+0000 7fe01a653740 1 -- 172.21.15.53:0/2339329932 >> 172.21.15.53:0/2339329932 conn(0x559bb1b2a460 msgr2=0x559bb1ed91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.275+0000 7fe01a653740 1 -- 172.21.15.53:0/2339329932 shutdown_connections 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.276+0000 7fe01a653740 1 -- 172.21.15.53:0/2339329932 wait complete. 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.276+0000 7fe01a653740 1 -- start start 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.276+0000 7fe01a653740 1 Processor -- start 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.276+0000 7fe01a653740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1ee6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.276+0000 7fe01a653740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b15390 0x559bb1ee6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.276+0000 7fe01a653740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b36070 0x559bb1ef2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.276+0000 7fe01a653740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559bb1ca4700 con 0x559bb1b0d1b0 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.276+0000 7fe01a653740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559bb1dc8700 con 0x559bb1b36070 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.276+0000 7fe01a653740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559bb1ee9a40 con 0x559bb1b15390 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe01a653740 10 client.0 _ll_register_callbacks cb 0x559bb1df7dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe011e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1ee6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe011e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1ee6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59178/0 (socket says 172.21.15.53:59178) 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe011e7a640 1 -- 172.21.15.53:0/2580637989 learned_addr learned my addr 172.21.15.53:0/2580637989 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe011679640 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b15390 0x559bb1ee6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe01267b640 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b36070 0x559bb1ef2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe011e7a640 1 -- 172.21.15.53:0/2580637989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b15390 msgr2=0x559bb1ee6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe011e7a640 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b15390 0x559bb1ee6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe011e7a640 1 -- 172.21.15.53:0/2580637989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b36070 msgr2=0x559bb1ef2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe011e7a640 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b36070 0x559bb1ef2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe011e7a640 1 -- 172.21.15.53:0/2580637989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bb1e018b0 con 0x559bb1b0d1b0 2024-08-31T06:17:31.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fe011e7a640 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1ee6aa0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe00801e9d0 tx=0x7fe008004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2d08a7d09fc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fdff57fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.277+0000 7fdff57fa640 1 -- 172.21.15.53:0/2580637989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00802e060 con 0x559bb1b0d1b0 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fdff57fa640 1 -- 172.21.15.53:0/2580637989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7fe008018030 con 0x559bb1b0d1b0 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fe01a653740 1 -- 172.21.15.53:0/2580637989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe004036040 con 0x559bb1b0d1b0 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fdff57fa640 1 -- 172.21.15.53:0/2580637989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fe008009db0 con 0x559bb1b0d1b0 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fe01a653740 10 client.19491 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fe01a653740 1 -- 172.21.15.53:0/2580637989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x559bb1ef5840 con 0x559bb1b0d1b0 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fdff57fa640 1 -- 172.21.15.53:0/2580637989 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe004036040 con 0x559bb1b0d1b0 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fdff57fa640 1 -- 172.21.15.53:0/2580637989 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7fe00800f450 con 0x559bb1b0d1b0 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fe01a653740 10 client.19491 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fe01a653740 10 client.19491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fe01a653740 20 client.19491 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fe01a653740 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bb1af49f0 0x559bb1ef8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fe01a653740 4 client.19491 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:31.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.278+0000 7fe01a653740 1 -- 172.21.15.53:0/2580637989 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bb1e54580 con 0x559bb1af49f0 2024-08-31T06:17:31.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.279+0000 7fe011679640 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bb1af49f0 0x559bb1ef8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.279+0000 7fdff57fa640 10 client.19491 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.279+0000 7fe011679640 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bb1af49f0 0x559bb1ef8dc0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6609766256520f3c server_cookie=a01c9651693197d6 in_seq=0 out_seq=0 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fdff57fa640 1 -- 172.21.15.53:0/2580637989 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559bb1e54580 con 0x559bb1af49f0 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fdff57fa640 10 client.19491 handle_command_reply: tid=0 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 1 client.19491 shutdown 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 1 -- 172.21.15.53:0/2580637989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 msgr2=0x559bb1ee6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1ee6aa0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe00801e9d0 tx=0x7fe008004730 comp rx=0 tx=0).stop 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 1 -- 172.21.15.53:0/2580637989 shutdown_connections 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bb1af49f0 0x559bb1ef8dc0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b36070 0x559bb1ef2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b15390 0x559bb1ee6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fdff57fa640 0 client.19491 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:31.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 1 --2- 172.21.15.53:0/2580637989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1ee6aa0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 1 -- 172.21.15.53:0/2580637989 >> 172.21.15.53:0/2580637989 conn(0x559bb1b2a460 msgr2=0x559bb1ede4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 1 -- 172.21.15.53:0/2580637989 shutdown_connections 2024-08-31T06:17:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 1 -- 172.21.15.53:0/2580637989 wait complete. 2024-08-31T06:17:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.280+0000 7fe01a653740 20 client.19491 trim_cache size 0 max 16384 2024-08-31T06:17:31.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe01a653740 1 Processor -- start 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe01a653740 1 -- start start 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe01a653740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1edead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe01a653740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b15390 0x559bb1ee3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe01a653740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b36070 0x559bb1ee41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe01a653740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1af5e0 con 0x559bb1b0d1b0 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe01a653740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1b1330 con 0x559bb1b15390 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe01a653740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1afcb0 con 0x559bb1b36070 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe011e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1edead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe011e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1edead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59194/0 (socket says 172.21.15.53:59194) 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe011e7a640 1 -- 172.21.15.53:0/1269236691 learned_addr learned my addr 172.21.15.53:0/1269236691 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe01267b640 1 --2- 172.21.15.53:0/1269236691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b36070 0x559bb1ee41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.301+0000 7fe011679640 1 --2- 172.21.15.53:0/1269236691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b15390 0x559bb1ee3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.302+0000 7fe011e7a640 1 -- 172.21.15.53:0/1269236691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b36070 msgr2=0x559bb1ee41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:31.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.302+0000 7fe011e7a640 1 --2- 172.21.15.53:0/1269236691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b36070 0x559bb1ee41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.302+0000 7fe011e7a640 1 -- 172.21.15.53:0/1269236691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b15390 msgr2=0x559bb1ee3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:31.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.302+0000 7fe011e7a640 1 --2- 172.21.15.53:0/1269236691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b15390 0x559bb1ee3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.302+0000 7fe011e7a640 1 -- 172.21.15.53:0/1269236691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bb1ee76d0 con 0x559bb1b0d1b0 2024-08-31T06:17:31.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.302+0000 7fe011e7a640 1 --2- 172.21.15.53:0/1269236691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1edead0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fe0080059f0 tx=0x7fe008005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1c85394e6e0e4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:31.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.302+0000 7fdff77fe640 1 -- 172.21.15.53:0/1269236691 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00800f3c0 con 0x559bb1b0d1b0 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.302+0000 7fdff77fe640 1 -- 172.21.15.53:0/1269236691 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe00800f560 con 0x559bb1b0d1b0 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.302+0000 7fdff77fe640 1 -- 172.21.15.53:0/1269236691 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008032d40 con 0x559bb1b0d1b0 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.303+0000 7fe01a653740 1 -- 172.21.15.53:0/1269236691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 msgr2=0x559bb1edead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.303+0000 7fe01a653740 1 --2- 172.21.15.53:0/1269236691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1edead0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fe0080059f0 tx=0x7fe008005de0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.303+0000 7fe01a653740 1 -- 172.21.15.53:0/1269236691 shutdown_connections 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.303+0000 7fe01a653740 1 --2- 172.21.15.53:0/1269236691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b36070 0x559bb1ee41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.303+0000 7fe01a653740 1 --2- 172.21.15.53:0/1269236691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b15390 0x559bb1ee3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.303+0000 7fe01a653740 1 --2- 172.21.15.53:0/1269236691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b0d1b0 0x559bb1edead0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.303+0000 7fe01a653740 1 -- 172.21.15.53:0/1269236691 >> 172.21.15.53:0/1269236691 conn(0x559bb1b2a460 msgr2=0x559bb1ede3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.303+0000 7fe01a653740 1 -- 172.21.15.53:0/1269236691 shutdown_connections 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.303+0000 7fe01a653740 1 -- 172.21.15.53:0/1269236691 wait complete. 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.303+0000 7fe01a653740 1 -- start start 2024-08-31T06:17:31.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01a653740 1 Processor -- start 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01a653740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b0d1b0 0x559bb1f5cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01a653740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b15390 0x559bb1f5d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01a653740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1eeecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01a653740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1b0ba0 con 0x559bb1b36070 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01a653740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1b0440 con 0x559bb1b0d1b0 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01a653740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1ad5e0 con 0x559bb1b15390 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01a653740 10 client.0 _ll_register_callbacks cb 0x7fe008005d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01267b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1eeecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe011e7a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b0d1b0 0x559bb1f5cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01267b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1eeecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59196/0 (socket says 172.21.15.53:59196) 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01267b640 1 -- 172.21.15.53:0/2047552282 learned_addr learned my addr 172.21.15.53:0/2047552282 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe011679640 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b15390 0x559bb1f5d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01267b640 1 -- 172.21.15.53:0/2047552282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b15390 msgr2=0x559bb1f5d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:31.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.304+0000 7fe01267b640 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b15390 0x559bb1f5d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fe01267b640 1 -- 172.21.15.53:0/2047552282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b0d1b0 msgr2=0x559bb1f5cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:31.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fe01267b640 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b0d1b0 0x559bb1f5cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fe01267b640 1 -- 172.21.15.53:0/2047552282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bb1eef200 con 0x559bb1b36070 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fe01267b640 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1eeecc0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe004009bf0 tx=0x7fe004031730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f08c8fff7657b7c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fdff57fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fdff57fa640 1 -- 172.21.15.53:0/2047552282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00404a040 con 0x559bb1b36070 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fdff57fa640 1 -- 172.21.15.53:0/2047552282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7fe004031b80 con 0x559bb1b36070 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fe01a653740 1 -- 172.21.15.53:0/2047552282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe00800f560 con 0x559bb1b36070 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fdff57fa640 1 -- 172.21.15.53:0/2047552282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fe00405e050 con 0x559bb1b36070 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fe01a653740 10 client.19497 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fe01a653740 1 -- 172.21.15.53:0/2047552282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x559bb1f68420 con 0x559bb1b36070 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.305+0000 7fdff57fa640 1 -- 172.21.15.53:0/2047552282 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe00800f560 con 0x559bb1b36070 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.306+0000 7fdff57fa640 1 -- 172.21.15.53:0/2047552282 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7fe004004330 con 0x559bb1b36070 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.306+0000 7fe01a653740 10 client.19497 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:31.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.306+0000 7fe01a653740 10 client.19497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.306+0000 7fe01a653740 20 client.19497 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.306+0000 7fe01a653740 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bb1ac9da0 0x559bb1f6a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.306+0000 7fe01a653740 4 client.19497 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.306+0000 7fe01a653740 1 -- 172.21.15.53:0/2047552282 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559bb1e50020 con 0x559bb1ac9da0 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.306+0000 7fe011e7a640 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bb1ac9da0 0x559bb1f6a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.306+0000 7fdff57fa640 10 client.19497 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.306+0000 7fe011e7a640 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bb1ac9da0 0x559bb1f6a900 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbac020f64c9e863 server_cookie=3cfabbe0ee9f33e3 in_seq=0 out_seq=0 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fdff57fa640 1 -- 172.21.15.53:0/2047552282 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x559bb1e50020 con 0x559bb1ac9da0 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fdff57fa640 10 client.19497 handle_command_reply: tid=0 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 1 client.19497 shutdown 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 1 -- 172.21.15.53:0/2047552282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 msgr2=0x559bb1eeecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1eeecc0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe004009bf0 tx=0x7fe004031730 comp rx=0 tx=0).stop 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 1 -- 172.21.15.53:0/2047552282 shutdown_connections 2024-08-31T06:17:31.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559bb1ac9da0 0x559bb1f6a900 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bb1b36070 0x559bb1eeecc0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559bb1b15390 0x559bb1f5d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fdff57fa640 0 client.19497 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 1 --2- 172.21.15.53:0/2047552282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559bb1b0d1b0 0x559bb1f5cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 1 -- 172.21.15.53:0/2047552282 >> 172.21.15.53:0/2047552282 conn(0x559bb1b2a460 msgr2=0x559bb1edc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 1 -- 172.21.15.53:0/2047552282 shutdown_connections 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 1 -- 172.21.15.53:0/2047552282 wait complete. 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.307+0000 7fe01a653740 20 client.19497 trim_cache size 0 max 16384 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:17:31.314 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.315 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:17:31.316 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.318 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.319 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:17:31.320 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:17:31.321 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.322 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:31.323 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:31.324 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:17:31.324 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:17:31.324 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:17:31.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 -- 172.21.15.53:0/1653550591 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdff80b4d20 msgr2=0x7fdff80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:31.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdff80b4d20 0x7fdff80b7230 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x559bb1ed9f40 tx=0x7fe008005f90 comp rx=0 tx=0).stop 2024-08-31T06:17:31.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 -- 172.21.15.53:0/1653550591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c108190 msgr2=0x7fe00c19a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:31.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c108190 0x7fe00c19a740 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fdffc005fd0 tx=0x7fdffc00dde0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 -- 172.21.15.53:0/1653550591 shutdown_connections 2024-08-31T06:17:31.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdff80b4d20 0x7fdff80b7230 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe00c108ae0 0x7fe00c19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe00c108190 0x7fe00c19a740 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 --2- 172.21.15.53:0/1653550591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe00c102850 0x7fe00c19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:31.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 -- 172.21.15.53:0/1653550591 >> 172.21.15.53:0/1653550591 conn(0x7fe00c079450 msgr2=0x7fe00c06bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:31.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 -- 172.21.15.53:0/1653550591 shutdown_connections 2024-08-31T06:17:31.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:31.308+0000 7fe0140de640 1 -- 172.21.15.53:0/1653550591 wait complete. 2024-08-31T06:17:31.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:31 smithi153 ceph-mon[22320]: pgmap v714: 97 pgs: 97 active+clean; 111 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 907 KiB/s wr, 95 op/s 2024-08-31T06:17:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:31 smithi053 ceph-mon[18924]: pgmap v714: 97 pgs: 97 active+clean; 111 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 907 KiB/s wr, 95 op/s 2024-08-31T06:17:32.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 191687 1.34 MB/sec execute 561 sec latency 2257.727 ms 2024-08-31T06:17:32.119 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:17:32.119 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:17:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:31 smithi130 ceph-mon[22266]: pgmap v714: 97 pgs: 97 active+clean; 111 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 907 KiB/s wr, 95 op/s 2024-08-31T06:17:32.375 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:17:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.872+0000 7f289d25e640 1 -- 172.21.15.53:0/3120473359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2898108aa0 msgr2=0x7f289810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.872+0000 7f289d25e640 1 --2- 172.21.15.53:0/3120473359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2898108aa0 0x7f289810f2d0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f2890009ca0 tx=0x7f289002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:17:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.872+0000 7f289d25e640 1 -- 172.21.15.53:0/3120473359 shutdown_connections 2024-08-31T06:17:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.872+0000 7f289d25e640 1 --2- 172.21.15.53:0/3120473359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2898108aa0 0x7f289810f2d0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.872+0000 7f289d25e640 1 --2- 172.21.15.53:0/3120473359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2898108150 0x7f2898108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.872+0000 7f289d25e640 1 --2- 172.21.15.53:0/3120473359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2898102810 0x7f2898102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.872+0000 7f289d25e640 1 -- 172.21.15.53:0/3120473359 >> 172.21.15.53:0/3120473359 conn(0x7f28980794b0 msgr2=0x7f28980798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.872+0000 7f289d25e640 1 -- 172.21.15.53:0/3120473359 shutdown_connections 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.872+0000 7f289d25e640 1 -- 172.21.15.53:0/3120473359 wait complete. 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.873+0000 7f289d25e640 1 Processor -- start 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.873+0000 7f289d25e640 1 -- start start 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.873+0000 7f289d25e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2898102810 0x7f289819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.873+0000 7f289d25e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2898108150 0x7f289819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.873+0000 7f289d25e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2898108aa0 0x7f289819f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.873+0000 7f289d25e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2898113760 con 0x7f2898108aa0 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.873+0000 7f289d25e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f28981135e0 con 0x7f2898108150 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.873+0000 7f289d25e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28981138e0 con 0x7f2898102810 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.873+0000 7f289759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2898108aa0 0x7f289819f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.873+0000 7f289759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2898108aa0 0x7f289819f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59210/0 (socket says 172.21.15.53:59210) 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.873+0000 7f289759e640 1 -- 172.21.15.53:0/3781608592 learned_addr learned my addr 172.21.15.53:0/3781608592 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f289659c640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2898108150 0x7f289819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f2896d9d640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2898102810 0x7f289819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f289759e640 1 -- 172.21.15.53:0/3781608592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2898102810 msgr2=0x7f289819a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f289759e640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2898102810 0x7f289819a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f289759e640 1 -- 172.21.15.53:0/3781608592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2898108150 msgr2=0x7f289819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f289759e640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2898108150 0x7f289819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f289759e640 1 -- 172.21.15.53:0/3781608592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289819ff40 con 0x7f2898108aa0 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f289659c640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2898108150 0x7f289819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f289759e640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2898108aa0 0x7f289819f8d0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f2890005cc0 tx=0x7f2890032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f287ffff640 1 -- 172.21.15.53:0/3781608592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2890004040 con 0x7f2898108aa0 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f289d25e640 1 -- 172.21.15.53:0/3781608592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28981a01d0 con 0x7f2898108aa0 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f287ffff640 1 -- 172.21.15.53:0/3781608592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2890004670 con 0x7f2898108aa0 2024-08-31T06:17:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f287ffff640 1 -- 172.21.15.53:0/3781608592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2890030cc0 con 0x7f2898108aa0 2024-08-31T06:17:32.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.874+0000 7f289d25e640 1 -- 172.21.15.53:0/3781608592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28981a6a50 con 0x7f2898108aa0 2024-08-31T06:17:32.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.875+0000 7f289d25e640 1 -- 172.21.15.53:0/3781608592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2898103a90 con 0x7f2898108aa0 2024-08-31T06:17:32.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.877+0000 7f287ffff640 1 -- 172.21.15.53:0/3781608592 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f28900041e0 con 0x7f2898108aa0 2024-08-31T06:17:32.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.877+0000 7f287ffff640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28800b4cd0 0x7f28800b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:32.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.878+0000 7f2896d9d640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28800b4cd0 0x7f28800b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:32.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.878+0000 7f287ffff640 1 -- 172.21.15.53:0/3781608592 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f2890106bf0 con 0x7f2898108aa0 2024-08-31T06:17:32.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.878+0000 7f2896d9d640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28800b4cd0 0x7f28800b71e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2888005e10 tx=0x7f2888005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:32.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:32.881+0000 7f287ffff640 1 -- 172.21.15.53:0/3781608592 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f28900cda50 con 0x7f2898108aa0 2024-08-31T06:17:33.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 191687 1.34 MB/sec execute 562 sec latency 1506.101 ms 2024-08-31T06:17:33.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.104+0000 7f289d25e640 1 -- 172.21.15.53:0/3781608592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f289819b1c0 con 0x7f2898108aa0 2024-08-31T06:17:33.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.105+0000 7f287ffff640 1 -- 172.21.15.53:0/3781608592 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+12004 (secure 0 0 0) 0x7f28900cd350 con 0x7f2898108aa0 2024-08-31T06:17:33.108 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:17:33.108 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":54,"btime":"2024-08-31T06:17:29:658044+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:17:28.801260+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:17:33.109 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 54 2024-08-31T06:17:33.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.107+0000 7f289d25e640 1 -- 172.21.15.53:0/3781608592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28800b4cd0 msgr2=0x7f28800b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:33.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.107+0000 7f289d25e640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28800b4cd0 0x7f28800b71e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2888005e10 tx=0x7f2888005da0 comp rx=0 tx=0).stop 2024-08-31T06:17:33.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.107+0000 7f289d25e640 1 -- 172.21.15.53:0/3781608592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2898108aa0 msgr2=0x7f289819f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:33.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.107+0000 7f289d25e640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2898108aa0 0x7f289819f8d0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f2890005cc0 tx=0x7f2890032c40 comp rx=0 tx=0).stop 2024-08-31T06:17:33.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.107+0000 7f289d25e640 1 -- 172.21.15.53:0/3781608592 shutdown_connections 2024-08-31T06:17:33.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.107+0000 7f289d25e640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28800b4cd0 0x7f28800b71e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:33.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.107+0000 7f289d25e640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2898108aa0 0x7f289819f8d0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:33.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.107+0000 7f289d25e640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2898108150 0x7f289819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:33.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.107+0000 7f289d25e640 1 --2- 172.21.15.53:0/3781608592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2898102810 0x7f289819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:33.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.107+0000 7f289d25e640 1 -- 172.21.15.53:0/3781608592 >> 172.21.15.53:0/3781608592 conn(0x7f28980794b0 msgr2=0x7f2898104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:33.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.108+0000 7f289d25e640 1 -- 172.21.15.53:0/3781608592 shutdown_connections 2024-08-31T06:17:33.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:33.108+0000 7f289d25e640 1 -- 172.21.15.53:0/3781608592 wait complete. 2024-08-31T06:17:33.696 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:33 smithi053 ceph-mon[18924]: pgmap v715: 97 pgs: 97 active+clean; 112 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 955 KiB/s wr, 94 op/s 2024-08-31T06:17:33.696 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:33 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3781608592' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:17:33.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:17:33.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:33 smithi153 ceph-mon[22320]: pgmap v715: 97 pgs: 97 active+clean; 112 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 955 KiB/s wr, 94 op/s 2024-08-31T06:17:33.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:33 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3781608592' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:17:33.975 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:17:34.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 191687 1.34 MB/sec execute 563 sec latency 2506.145 ms 2024-08-31T06:17:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:33 smithi130 ceph-mon[22266]: pgmap v715: 97 pgs: 97 active+clean; 112 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 955 KiB/s wr, 94 op/s 2024-08-31T06:17:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:33 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3781608592' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:17:34.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.430+0000 7f7475aea640 1 -- 172.21.15.53:0/608643700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7470102800 msgr2=0x7f7470102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:34.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.430+0000 7f7475aea640 1 --2- 172.21.15.53:0/608643700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7470102800 0x7f7470102c10 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f7460009900 tx=0x7f746002a410 comp rx=0 tx=0).stop 2024-08-31T06:17:34.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.430+0000 7f7475aea640 1 -- 172.21.15.53:0/608643700 shutdown_connections 2024-08-31T06:17:34.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.430+0000 7f7475aea640 1 --2- 172.21.15.53:0/608643700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7470108a90 0x7f747010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.430+0000 7f7475aea640 1 --2- 172.21.15.53:0/608643700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7470108140 0x7f7470108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.430+0000 7f7475aea640 1 --2- 172.21.15.53:0/608643700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7470102800 0x7f7470102c10 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.430+0000 7f7475aea640 1 -- 172.21.15.53:0/608643700 >> 172.21.15.53:0/608643700 conn(0x7f74700794d0 msgr2=0x7f74700798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.430+0000 7f7475aea640 1 -- 172.21.15.53:0/608643700 shutdown_connections 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.430+0000 7f7475aea640 1 -- 172.21.15.53:0/608643700 wait complete. 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f7475aea640 1 Processor -- start 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f7475aea640 1 -- start start 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f7475aea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7470102800 0x7f7470104280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f7475aea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7470108140 0x7f74701047c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f7475aea640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7470108a90 0x7f7470104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f7475aea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f74701125a0 con 0x7f7470108140 2024-08-31T06:17:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f7475aea640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7470112420 con 0x7f7470102800 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f7475aea640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7470112720 con 0x7f7470108a90 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f7466ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7470108140 0x7f74701047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f7466ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7470108140 0x7f74701047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34620/0 (socket says 172.21.15.53:34620) 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f7466ffd640 1 -- 172.21.15.53:0/3235925467 learned_addr learned my addr 172.21.15.53:0/3235925467 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f746ffff640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7470108a90 0x7f7470104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.431+0000 7f746f7fe640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7470102800 0x7f7470104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.432+0000 7f7466ffd640 1 -- 172.21.15.53:0/3235925467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7470108a90 msgr2=0x7f7470104d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.432+0000 7f7466ffd640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7470108a90 0x7f7470104d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.432+0000 7f7466ffd640 1 -- 172.21.15.53:0/3235925467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7470102800 msgr2=0x7f7470104280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.432+0000 7f7466ffd640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7470102800 0x7f7470104280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.432+0000 7f7466ffd640 1 -- 172.21.15.53:0/3235925467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74701a83b0 con 0x7f7470108140 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.432+0000 7f7466ffd640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7470108140 0x7f74701047c0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f745800c970 tx=0x7f745800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.432+0000 7f746d7fa640 1 -- 172.21.15.53:0/3235925467 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458014070 con 0x7f7470108140 2024-08-31T06:17:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.432+0000 7f7475aea640 1 -- 172.21.15.53:0/3235925467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74701a86a0 con 0x7f7470108140 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.432+0000 7f746d7fa640 1 -- 172.21.15.53:0/3235925467 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7458004440 con 0x7f7470108140 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.432+0000 7f746d7fa640 1 -- 172.21.15.53:0/3235925467 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458003d40 con 0x7f7470108140 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.432+0000 7f7475aea640 1 -- 172.21.15.53:0/3235925467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74701a8c30 con 0x7f7470108140 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.435+0000 7f747c05f740 1 Processor -- start 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.435+0000 7f746d7fa640 1 -- 172.21.15.53:0/3235925467 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7458017070 con 0x7f7470108140 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.435+0000 7f747c05f740 1 -- start start 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.435+0000 7f747c05f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9dc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.435+0000 7f747c05f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb60e1b0 0x55acdb9dc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.435+0000 7f747c05f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb616390 0x55acdb9dcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.435+0000 7f747c05f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55acdb953680 con 0x55acdb637070 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.435+0000 7f747c05f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55acdb942c10 con 0x55acdb60e1b0 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.435+0000 7f747c05f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55acdb946bc0 con 0x55acdb616390 2024-08-31T06:17:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.435+0000 7f746ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9dc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9dc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34624/0 (socket says 172.21.15.53:34624) 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746ffff640 1 -- 172.21.15.53:0/1416728769 learned_addr learned my addr 172.21.15.53:0/1416728769 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f7466ffd640 1 --2- 172.21.15.53:0/1416728769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb616390 0x55acdb9dcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746f7fe640 1 --2- 172.21.15.53:0/1416728769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb60e1b0 0x55acdb9dc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746ffff640 1 -- 172.21.15.53:0/1416728769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb616390 msgr2=0x55acdb9dcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746ffff640 1 --2- 172.21.15.53:0/1416728769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb616390 0x55acdb9dcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746ffff640 1 -- 172.21.15.53:0/1416728769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb60e1b0 msgr2=0x55acdb9dc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746ffff640 1 --2- 172.21.15.53:0/1416728769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb60e1b0 0x55acdb9dc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746ffff640 1 -- 172.21.15.53:0/1416728769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdb6a2650 con 0x55acdb637070 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f7466ffd640 1 --2- 172.21.15.53:0/1416728769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb616390 0x55acdb9dcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746d7fa640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f745c0b4ca0 0x7f745c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746f7fe640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f745c0b4ca0 0x7f745c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746ffff640 1 --2- 172.21.15.53:0/1416728769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9dc310 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f7468009f90 tx=0x7f7468010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d338dbd326efed3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f746d7fa640 1 -- 172.21.15.53:0/3235925467 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f74580e5390 con 0x7f7470108140 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f7465ffb640 1 -- 172.21.15.53:0/1416728769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468011700 con 0x55acdb637070 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f7465ffb640 1 -- 172.21.15.53:0/1416728769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7468011d30 con 0x55acdb637070 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.436+0000 7f7465ffb640 1 -- 172.21.15.53:0/1416728769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468019cd0 con 0x55acdb637070 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.437+0000 7f747c05f740 1 -- 172.21.15.53:0/1416728769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 msgr2=0x55acdb9dc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.437+0000 7f746f7fe640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f745c0b4ca0 0x7f745c0b71b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7470105cd0 tx=0x7f74600058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.437+0000 7f747c05f740 1 --2- 172.21.15.53:0/1416728769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9dc310 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f7468009f90 tx=0x7f7468010860 comp rx=0 tx=0).stop 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.437+0000 7f747c05f740 1 -- 172.21.15.53:0/1416728769 shutdown_connections 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.437+0000 7f747c05f740 1 --2- 172.21.15.53:0/1416728769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb616390 0x55acdb9dcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.437+0000 7f747c05f740 1 --2- 172.21.15.53:0/1416728769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb60e1b0 0x55acdb9dc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.437+0000 7f747c05f740 1 --2- 172.21.15.53:0/1416728769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9dc310 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.437+0000 7f747c05f740 1 -- 172.21.15.53:0/1416728769 >> 172.21.15.53:0/1416728769 conn(0x55acdb62b460 msgr2=0x55acdb9da200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.437+0000 7f747c05f740 1 -- 172.21.15.53:0/1416728769 shutdown_connections 2024-08-31T06:17:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.437+0000 7f747c05f740 1 -- 172.21.15.53:0/1416728769 wait complete. 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f747c05f740 1 -- start start 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f747c05f740 1 Processor -- start 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f747c05f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb60e1b0 0x55acdb9e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f747c05f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb616390 0x55acdb9e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f747c05f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f747c05f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55acdb7a5700 con 0x55acdb637070 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f747c05f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55acdb8c9750 con 0x55acdb616390 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f747c05f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55acdb9eaaf0 con 0x55acdb60e1b0 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f747c05f740 10 client.0 _ll_register_callbacks cb 0x55acdb8f8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f746ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f746ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9f3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34632/0 (socket says 172.21.15.53:34632) 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f746ffff640 1 -- 172.21.15.53:0/1495511558 learned_addr learned my addr 172.21.15.53:0/1495511558 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.438+0000 7f746f7fe640 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb60e1b0 0x55acdb9e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f7466ffd640 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb616390 0x55acdb9e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f746ffff640 1 -- 172.21.15.53:0/1495511558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb60e1b0 msgr2=0x55acdb9e7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f746ffff640 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb60e1b0 0x55acdb9e7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f746ffff640 1 -- 172.21.15.53:0/1495511558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb616390 msgr2=0x55acdb9e7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f746ffff640 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb616390 0x55acdb9e7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f746ffff640 1 -- 172.21.15.53:0/1495511558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acdb902900 con 0x55acdb637070 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f7466ffd640 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb616390 0x55acdb9e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f746ffff640 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9f3de0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f7468011010 tx=0x7f7468009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464f17064ba60873 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f744effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f744effd640 1 -- 172.21.15.53:0/1495511558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468027030 con 0x55acdb637070 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f744effd640 1 -- 172.21.15.53:0/1495511558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f746801f070 con 0x55acdb637070 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f747c05f740 1 -- 172.21.15.53:0/1495511558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7468011d30 con 0x55acdb637070 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f744effd640 1 -- 172.21.15.53:0/1495511558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f7468031050 con 0x55acdb637070 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f747c05f740 10 client.19515 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.439+0000 7f747c05f740 1 -- 172.21.15.53:0/1495511558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55acdb9f68f0 con 0x55acdb637070 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.440+0000 7f744effd640 1 -- 172.21.15.53:0/1495511558 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7468011d30 con 0x55acdb637070 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.440+0000 7f744effd640 1 -- 172.21.15.53:0/1495511558 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f7468011590 con 0x55acdb637070 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.440+0000 7f747c05f740 10 client.19515 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.440+0000 7f747c05f740 10 client.19515 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.440+0000 7f747c05f740 20 client.19515 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.440+0000 7f747c05f740 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55acdb5f59f0 0x55acdb9f9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.440+0000 7f747c05f740 4 client.19515 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.440+0000 7f747c05f740 1 -- 172.21.15.53:0/1495511558 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acdb9555d0 con 0x55acdb5f59f0 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.440+0000 7f746f7fe640 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55acdb5f59f0 0x55acdb9f9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.441+0000 7f744effd640 10 client.19515 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.441+0000 7f746f7fe640 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55acdb5f59f0 0x55acdb9f9d00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f06b9fd711eb01e5 server_cookie=c522d5354f2f1b05 in_seq=0 out_seq=0 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.441+0000 7f744effd640 1 -- 172.21.15.53:0/1495511558 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55acdb9555d0 con 0x55acdb5f59f0 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.441+0000 7f744effd640 10 client.19515 handle_command_reply: tid=0 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.441+0000 7f747c05f740 1 client.19515 shutdown 2024-08-31T06:17:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f747c05f740 1 -- 172.21.15.53:0/1495511558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 msgr2=0x55acdb9f3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f747c05f740 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9f3de0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f7468011010 tx=0x7f7468009c70 comp rx=0 tx=0).stop 2024-08-31T06:17:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f747c05f740 1 -- 172.21.15.53:0/1495511558 shutdown_connections 2024-08-31T06:17:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f747c05f740 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb637070 0x55acdb9f3de0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f747c05f740 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb616390 0x55acdb9e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f747c05f740 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55acdb5f59f0 0x55acdb9f9d00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f747c05f740 1 --2- 172.21.15.53:0/1495511558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb60e1b0 0x55acdb9e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f744effd640 0 client.19515 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:17:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f747c05f740 1 -- 172.21.15.53:0/1495511558 >> 172.21.15.53:0/1495511558 conn(0x55acdb62b460 msgr2=0x55acdb9df4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f747c05f740 1 -- 172.21.15.53:0/1495511558 shutdown_connections 2024-08-31T06:17:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f747c05f740 1 -- 172.21.15.53:0/1495511558 wait complete. 2024-08-31T06:17:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.442+0000 7f747c05f740 20 client.19515 trim_cache size 0 max 16384 2024-08-31T06:17:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.460+0000 7f747c05f740 1 Processor -- start 2024-08-31T06:17:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.460+0000 7f747c05f740 1 -- start start 2024-08-31T06:17:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.460+0000 7f747c05f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb60e1b0 0x55acdb9dda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.460+0000 7f747c05f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.460+0000 7f747c05f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb637070 0x55acdb9e4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.460+0000 7f747c05f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b1780 con 0x55acdb616390 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.460+0000 7f747c05f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b34d0 con 0x55acdb60e1b0 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.460+0000 7f747c05f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b1e50 con 0x55acdb637070 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.460+0000 7f7466ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f7466ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9f3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34642/0 (socket says 172.21.15.53:34642) 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f7466ffd640 1 -- 172.21.15.53:0/1309520271 learned_addr learned my addr 172.21.15.53:0/1309520271 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f746f7fe640 1 --2- 172.21.15.53:0/1309520271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb60e1b0 0x55acdb9dda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f746ffff640 1 --2- 172.21.15.53:0/1309520271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb637070 0x55acdb9e4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f7466ffd640 1 -- 172.21.15.53:0/1309520271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb637070 msgr2=0x55acdb9e4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f7466ffd640 1 --2- 172.21.15.53:0/1309520271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb637070 0x55acdb9e4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f7466ffd640 1 -- 172.21.15.53:0/1309520271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb60e1b0 msgr2=0x55acdb9dda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f7466ffd640 1 --2- 172.21.15.53:0/1309520271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb60e1b0 0x55acdb9dda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f7466ffd640 1 -- 172.21.15.53:0/1309520271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdb9e5fb0 con 0x55acdb616390 2024-08-31T06:17:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f746f7fe640 1 --2- 172.21.15.53:0/1309520271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb60e1b0 0x55acdb9dda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f7466ffd640 1 --2- 172.21.15.53:0/1309520271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9f3d50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f74580ab760 tx=0x7f74580ab8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbfcdbb53b8cceb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f74657fa640 1 -- 172.21.15.53:0/1309520271 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74580ab570 con 0x55acdb616390 2024-08-31T06:17:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f74657fa640 1 -- 172.21.15.53:0/1309520271 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74580a7040 con 0x55acdb616390 2024-08-31T06:17:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.461+0000 7f74657fa640 1 -- 172.21.15.53:0/1309520271 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74580b4d80 con 0x55acdb616390 2024-08-31T06:17:34.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.462+0000 7f747c05f740 1 -- 172.21.15.53:0/1309520271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 msgr2=0x55acdb9f3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:34.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.462+0000 7f747c05f740 1 --2- 172.21.15.53:0/1309520271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9f3d50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f74580ab760 tx=0x7f74580ab8f0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.462+0000 7f747c05f740 1 -- 172.21.15.53:0/1309520271 shutdown_connections 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.462+0000 7f747c05f740 1 --2- 172.21.15.53:0/1309520271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb637070 0x55acdb9e4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.462+0000 7f747c05f740 1 --2- 172.21.15.53:0/1309520271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9f3d50 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.462+0000 7f747c05f740 1 --2- 172.21.15.53:0/1309520271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb60e1b0 0x55acdb9dda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.462+0000 7f747c05f740 1 -- 172.21.15.53:0/1309520271 >> 172.21.15.53:0/1309520271 conn(0x55acdb62b460 msgr2=0x55acdb9dd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.462+0000 7f747c05f740 1 -- 172.21.15.53:0/1309520271 shutdown_connections 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.462+0000 7f747c05f740 1 -- 172.21.15.53:0/1309520271 wait complete. 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f747c05f740 1 -- start start 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f747c05f740 1 Processor -- start 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f747c05f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb60e1b0 0x55acdb9fafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f747c05f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9fb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f747c05f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb637070 0x55acdb9fba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f747c05f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b2d40 con 0x55acdb616390 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f747c05f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b25e0 con 0x55acdb637070 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f747c05f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f74701af780 con 0x55acdb60e1b0 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f7466ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9fb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f7466ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9fb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34652/0 (socket says 172.21.15.53:34652) 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f7466ffd640 1 -- 172.21.15.53:0/2148868719 learned_addr learned my addr 172.21.15.53:0/2148868719 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f747c05f740 10 client.0 _ll_register_callbacks cb 0x7f7468009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.463+0000 7f746f7fe640 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb60e1b0 0x55acdb9fafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f746ffff640 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb637070 0x55acdb9fba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f7466ffd640 1 -- 172.21.15.53:0/2148868719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb60e1b0 msgr2=0x55acdb9fafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f7466ffd640 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb60e1b0 0x55acdb9fafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f7466ffd640 1 -- 172.21.15.53:0/2148868719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb637070 msgr2=0x55acdb9fba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f7466ffd640 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb637070 0x55acdb9fba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f7466ffd640 1 -- 172.21.15.53:0/2148868719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acdba636d0 con 0x55acdb616390 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f746f7fe640 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb60e1b0 0x55acdb9fafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:34.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f746ffff640 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb637070 0x55acdb9fba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f7466ffd640 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9fb500 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f74580ab9a0 tx=0x7f74580a7f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c667b1e86a28de0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f744effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f744effd640 1 -- 172.21.15.53:0/2148868719 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74580ac160 con 0x55acdb616390 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f744effd640 1 -- 172.21.15.53:0/2148868719 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f74580a8050 con 0x55acdb616390 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f747c05f740 1 -- 172.21.15.53:0/2148868719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74580a7040 con 0x55acdb616390 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f744effd640 1 -- 172.21.15.53:0/2148868719 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f74580b4d80 con 0x55acdb616390 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f747c05f740 10 client.19521 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f747c05f740 1 -- 172.21.15.53:0/2148868719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55acdba64950 con 0x55acdb616390 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.464+0000 7f744effd640 1 -- 172.21.15.53:0/2148868719 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74580a7040 con 0x55acdb616390 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.465+0000 7f744effd640 1 -- 172.21.15.53:0/2148868719 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f74580a73d0 con 0x55acdb616390 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.465+0000 7f747c05f740 10 client.19521 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.465+0000 7f747c05f740 10 client.19521 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:17:34.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.465+0000 7f747c05f740 20 client.19521 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.465+0000 7f747c05f740 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55acdb5cada0 0x55acdba66fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.465+0000 7f747c05f740 4 client.19521 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.465+0000 7f747c05f740 1 -- 172.21.15.53:0/2148868719 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55acdb951070 con 0x55acdb5cada0 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.465+0000 7f746f7fe640 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55acdb5cada0 0x55acdba66fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.465+0000 7f744effd640 10 client.19521 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.465+0000 7f746f7fe640 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55acdb5cada0 0x55acdba66fe0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6ebde55b2f44df7 server_cookie=c334b8126771c3ec in_seq=0 out_seq=0 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f744effd640 1 -- 172.21.15.53:0/2148868719 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55acdb951070 con 0x55acdb5cada0 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f744effd640 10 client.19521 handle_command_reply: tid=0 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 1 client.19521 shutdown 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 1 -- 172.21.15.53:0/2148868719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 msgr2=0x55acdb9fb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9fb500 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f74580ab9a0 tx=0x7f74580a7f20 comp rx=0 tx=0).stop 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 1 -- 172.21.15.53:0/2148868719 shutdown_connections 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55acdb637070 0x55acdb9fba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acdb616390 0x55acdb9fb500 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55acdb5cada0 0x55acdba66fe0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 1 --2- 172.21.15.53:0/2148868719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55acdb60e1b0 0x55acdb9fafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 1 -- 172.21.15.53:0/2148868719 >> 172.21.15.53:0/2148868719 conn(0x55acdb62b460 msgr2=0x55acdb9e7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:34.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f744effd640 0 client.19521 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:17:34.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 1 -- 172.21.15.53:0/2148868719 shutdown_connections 2024-08-31T06:17:34.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 1 -- 172.21.15.53:0/2148868719 wait complete. 2024-08-31T06:17:34.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.466+0000 7f747c05f740 20 client.19521 trim_cache size 0 max 16384 2024-08-31T06:17:34.474 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 -- 172.21.15.53:0/3235925467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f745c0b4ca0 msgr2=0x7f745c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f745c0b4ca0 0x7f745c0b71b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7470105cd0 tx=0x7f74600058d0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 -- 172.21.15.53:0/3235925467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7470108140 msgr2=0x7f74701047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7470108140 0x7f74701047c0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f745800c970 tx=0x7f745800ce30 comp rx=0 tx=0).stop 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 -- 172.21.15.53:0/3235925467 shutdown_connections 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f745c0b4ca0 0x7f745c0b71b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7470108a90 0x7f7470104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7470108140 0x7f74701047c0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 --2- 172.21.15.53:0/3235925467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7470102800 0x7f7470104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 -- 172.21.15.53:0/3235925467 >> 172.21.15.53:0/3235925467 conn(0x7f74700794d0 msgr2=0x7f7470106750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 -- 172.21.15.53:0/3235925467 shutdown_connections 2024-08-31T06:17:34.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:34.467+0000 7f7475aea640 1 -- 172.21.15.53:0/3235925467 wait complete. 2024-08-31T06:17:35.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 191687 1.33 MB/sec execute 564 sec latency 3506.221 ms 2024-08-31T06:17:35.222 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:17:35.481 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:17:35.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:35 smithi053 ceph-mon[18924]: pgmap v716: 97 pgs: 97 active+clean; 112 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-08-31T06:17:35.931 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:35 smithi130 ceph-mon[22266]: pgmap v716: 97 pgs: 97 active+clean; 112 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-08-31T06:17:35.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.937+0000 7f8a49b10640 1 -- 172.21.15.53:0/3479686329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a44108b10 msgr2=0x7f8a4410f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:35.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.937+0000 7f8a49b10640 1 --2- 172.21.15.53:0/3479686329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a44108b10 0x7f8a4410f340 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009ca0 tx=0x7f8a3c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.937+0000 7f8a49b10640 1 -- 172.21.15.53:0/3479686329 shutdown_connections 2024-08-31T06:17:35.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.937+0000 7f8a49b10640 1 --2- 172.21.15.53:0/3479686329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a44108b10 0x7f8a4410f340 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.937+0000 7f8a49b10640 1 --2- 172.21.15.53:0/3479686329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a441081c0 0x7f8a441085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.937+0000 7f8a49b10640 1 --2- 172.21.15.53:0/3479686329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a44102880 0x7f8a44102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.937+0000 7f8a49b10640 1 -- 172.21.15.53:0/3479686329 >> 172.21.15.53:0/3479686329 conn(0x7f8a44079510 msgr2=0x7f8a44079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.937+0000 7f8a49b10640 1 -- 172.21.15.53:0/3479686329 shutdown_connections 2024-08-31T06:17:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.937+0000 7f8a49b10640 1 -- 172.21.15.53:0/3479686329 wait complete. 2024-08-31T06:17:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.938+0000 7f8a49b10640 1 Processor -- start 2024-08-31T06:17:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.938+0000 7f8a49b10640 1 -- start start 2024-08-31T06:17:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.938+0000 7f8a49b10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a44102880 0x7f8a4419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.938+0000 7f8a49b10640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a441081c0 0x7f8a4419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.938+0000 7f8a49b10640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a44108b10 0x7f8a4419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.938+0000 7f8a49b10640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441137d0 con 0x7f8a44102880 2024-08-31T06:17:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.938+0000 7f8a49b10640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a44113650 con 0x7f8a441081c0 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.938+0000 7f8a49b10640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a44113950 con 0x7f8a44108b10 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.938+0000 7f8a437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a44102880 0x7f8a4419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.938+0000 7f8a437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a44102880 0x7f8a4419a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34670/0 (socket says 172.21.15.53:34670) 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.938+0000 7f8a437fe640 1 -- 172.21.15.53:0/966451080 learned_addr learned my addr 172.21.15.53:0/966451080 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a43fff640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a44108b10 0x7f8a4419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a437fe640 1 -- 172.21.15.53:0/966451080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a44108b10 msgr2=0x7f8a4419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a437fe640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a44108b10 0x7f8a4419fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a437fe640 1 -- 172.21.15.53:0/966451080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a441081c0 msgr2=0x7f8a4419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a3affd640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a441081c0 0x7f8a4419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a437fe640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a441081c0 0x7f8a4419a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a437fe640 1 -- 172.21.15.53:0/966451080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a441a0170 con 0x7f8a44102880 2024-08-31T06:17:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a43fff640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a44108b10 0x7f8a4419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a437fe640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a44102880 0x7f8a4419a200 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400d950 tx=0x7f8a3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a417fa640 1 -- 172.21.15.53:0/966451080 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34017030 con 0x7f8a44102880 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a417fa640 1 -- 172.21.15.53:0/966451080 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a34004020 con 0x7f8a44102880 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a49b10640 1 -- 172.21.15.53:0/966451080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a441a0460 con 0x7f8a44102880 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a417fa640 1 -- 172.21.15.53:0/966451080 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340055d0 con 0x7f8a44102880 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.939+0000 7f8a49b10640 1 -- 172.21.15.53:0/966451080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a441a6bc0 con 0x7f8a44102880 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.942+0000 7f8a417fa640 1 -- 172.21.15.53:0/966451080 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8a34009a30 con 0x7f8a44102880 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.942+0000 7f8a50085740 1 Processor -- start 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.942+0000 7f8a50085740 1 -- start start 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.942+0000 7f8a50085740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19af1070 0x558a19e96310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.942+0000 7f8a50085740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e96850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.942+0000 7f8a50085740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19ad0390 0x558a19e96d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.942+0000 7f8a50085740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558a19e0d680 con 0x558a19ac81b0 2024-08-31T06:17:35.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.942+0000 7f8a50085740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558a19dfcc10 con 0x558a19af1070 2024-08-31T06:17:35.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.942+0000 7f8a50085740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558a19e00bc0 con 0x558a19ad0390 2024-08-31T06:17:35.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e96850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e96850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34680/0 (socket says 172.21.15.53:34680) 2024-08-31T06:17:35.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a437fe640 1 -- 172.21.15.53:0/6805482 learned_addr learned my addr 172.21.15.53:0/6805482 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:35.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a43fff640 1 --2- 172.21.15.53:0/6805482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19af1070 0x558a19e96310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a3affd640 1 --2- 172.21.15.53:0/6805482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19ad0390 0x558a19e96d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a417fa640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a300b4ca0 0x7f8a300b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a437fe640 1 -- 172.21.15.53:0/6805482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19ad0390 msgr2=0x558a19e96d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:35.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a437fe640 1 --2- 172.21.15.53:0/6805482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19ad0390 0x558a19e96d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a437fe640 1 -- 172.21.15.53:0/6805482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19af1070 msgr2=0x558a19e96310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a437fe640 1 --2- 172.21.15.53:0/6805482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19af1070 0x558a19e96310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a437fe640 1 -- 172.21.15.53:0/6805482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a19b5c650 con 0x558a19ac81b0 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a43fff640 1 --2- 172.21.15.53:0/6805482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19af1070 0x558a19e96310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a43fff640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a300b4ca0 0x7f8a300b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a437fe640 1 --2- 172.21.15.53:0/6805482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e96850 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f8a340e26b0 tx=0x7f8a340a7e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728f06efcde68f21 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a417fa640 1 -- 172.21.15.53:0/966451080 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f8a340e50a0 con 0x7f8a44102880 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a39ffb640 1 -- 172.21.15.53:0/6805482 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340ab4e0 con 0x558a19ac81b0 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a39ffb640 1 -- 172.21.15.53:0/6805482 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a340b9e30 con 0x558a19ac81b0 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.943+0000 7f8a39ffb640 1 -- 172.21.15.53:0/6805482 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340ba020 con 0x558a19ac81b0 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.944+0000 7f8a50085740 1 -- 172.21.15.53:0/6805482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 msgr2=0x558a19e96850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.944+0000 7f8a50085740 1 --2- 172.21.15.53:0/6805482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e96850 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f8a340e26b0 tx=0x7f8a340a7e20 comp rx=0 tx=0).stop 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.944+0000 7f8a43fff640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a300b4ca0 0x7f8a300b71b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0094e0 tx=0x7f8a3c0095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:35.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.944+0000 7f8a50085740 1 -- 172.21.15.53:0/6805482 shutdown_connections 2024-08-31T06:17:35.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.944+0000 7f8a50085740 1 --2- 172.21.15.53:0/6805482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19ad0390 0x558a19e96d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.944+0000 7f8a50085740 1 --2- 172.21.15.53:0/6805482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e96850 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.944+0000 7f8a50085740 1 --2- 172.21.15.53:0/6805482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19af1070 0x558a19e96310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.944+0000 7f8a50085740 1 -- 172.21.15.53:0/6805482 >> 172.21.15.53:0/6805482 conn(0x558a19ae5460 msgr2=0x558a19e94200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:35.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.944+0000 7f8a50085740 1 -- 172.21.15.53:0/6805482 shutdown_connections 2024-08-31T06:17:35.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.944+0000 7f8a50085740 1 -- 172.21.15.53:0/6805482 wait complete. 2024-08-31T06:17:35.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.945+0000 7f8a50085740 1 -- start start 2024-08-31T06:17:35.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.945+0000 7f8a50085740 1 Processor -- start 2024-08-31T06:17:35.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.946+0000 7f8a50085740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19ac81b0 0x558a19ea1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.946+0000 7f8a50085740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ad0390 0x558a19ea1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.946+0000 7f8a50085740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19af1070 0x558a19eadd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.946+0000 7f8a50085740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558a19c5f700 con 0x558a19ad0390 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.946+0000 7f8a50085740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558a19d83750 con 0x558a19ac81b0 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.946+0000 7f8a50085740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558a19ea4a30 con 0x558a19af1070 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.946+0000 7f8a50085740 10 client.0 _ll_register_callbacks cb 0x558a19db2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.946+0000 7f8a3affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ad0390 0x558a19ea1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.946+0000 7f8a3affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ad0390 0x558a19ea1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34692/0 (socket says 172.21.15.53:34692) 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.946+0000 7f8a3affd640 1 -- 172.21.15.53:0/3428314444 learned_addr learned my addr 172.21.15.53:0/3428314444 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a43fff640 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19af1070 0x558a19eadd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a437fe640 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19ac81b0 0x558a19ea1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a3affd640 1 -- 172.21.15.53:0/3428314444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19af1070 msgr2=0x558a19eadd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a3affd640 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19af1070 0x558a19eadd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a3affd640 1 -- 172.21.15.53:0/3428314444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19ac81b0 msgr2=0x558a19ea1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a3affd640 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19ac81b0 0x558a19ea1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a3affd640 1 -- 172.21.15.53:0/3428314444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a19dbc900 con 0x558a19ad0390 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a3affd640 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ad0390 0x558a19ea1ff0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0103a0 tx=0x7f8a2c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8709f1f99fb4f4ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a22ffd640 1 -- 172.21.15.53:0/3428314444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c005220 con 0x558a19ad0390 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a22ffd640 1 -- 172.21.15.53:0/3428314444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f8a2c0053c0 con 0x558a19ad0390 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a50085740 1 -- 172.21.15.53:0/3428314444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a19e0f5d0 con 0x558a19ad0390 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a22ffd640 1 -- 172.21.15.53:0/3428314444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8a2c0055c0 con 0x558a19ad0390 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a50085740 10 client.19533 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.947+0000 7f8a50085740 1 -- 172.21.15.53:0/3428314444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x558a19eb0860 con 0x558a19ad0390 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.948+0000 7f8a22ffd640 1 -- 172.21.15.53:0/3428314444 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558a19e0f5d0 con 0x558a19ad0390 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.948+0000 7f8a22ffd640 1 -- 172.21.15.53:0/3428314444 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f8a2c00f040 con 0x558a19ad0390 2024-08-31T06:17:35.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.948+0000 7f8a50085740 10 client.19533 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.948+0000 7f8a50085740 10 client.19533 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.948+0000 7f8a50085740 20 client.19533 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.948+0000 7f8a50085740 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558a19aaf9f0 0x558a19eb3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.948+0000 7f8a50085740 4 client.19533 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.948+0000 7f8a50085740 1 -- 172.21.15.53:0/3428314444 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a19e0b070 con 0x558a19aaf9f0 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.949+0000 7f8a437fe640 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558a19aaf9f0 0x558a19eb3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.949+0000 7f8a437fe640 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558a19aaf9f0 0x558a19eb3de0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=31d0f9f1d64fcc5a server_cookie=5c399e1b24912ba6 in_seq=0 out_seq=0 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.949+0000 7f8a22ffd640 10 client.19533 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.950+0000 7f8a22ffd640 1 -- 172.21.15.53:0/3428314444 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a19e0b070 con 0x558a19aaf9f0 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.950+0000 7f8a22ffd640 10 client.19533 handle_command_reply: tid=0 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.950+0000 7f8a50085740 1 client.19533 shutdown 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.950+0000 7f8a50085740 1 -- 172.21.15.53:0/3428314444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ad0390 msgr2=0x558a19ea1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.950+0000 7f8a50085740 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ad0390 0x558a19ea1ff0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0103a0 tx=0x7f8a2c010860 comp rx=0 tx=0).stop 2024-08-31T06:17:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.950+0000 7f8a50085740 1 -- 172.21.15.53:0/3428314444 shutdown_connections 2024-08-31T06:17:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.950+0000 7f8a50085740 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19af1070 0x558a19eadd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.950+0000 7f8a50085740 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558a19aaf9f0 0x558a19eb3de0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.950+0000 7f8a50085740 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ad0390 0x558a19ea1ff0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.950+0000 7f8a50085740 1 --2- 172.21.15.53:0/3428314444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19ac81b0 0x558a19ea1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.950+0000 7f8a50085740 1 -- 172.21.15.53:0/3428314444 >> 172.21.15.53:0/3428314444 conn(0x558a19ae5460 msgr2=0x558a19e994a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.951+0000 7f8a22ffd640 0 client.19533 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:17:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.951+0000 7f8a50085740 1 -- 172.21.15.53:0/3428314444 shutdown_connections 2024-08-31T06:17:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.951+0000 7f8a50085740 1 -- 172.21.15.53:0/3428314444 wait complete. 2024-08-31T06:17:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.951+0000 7f8a50085740 20 client.19533 trim_cache size 0 max 16384 2024-08-31T06:17:35.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a50085740 1 Processor -- start 2024-08-31T06:17:35.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a50085740 1 -- start start 2024-08-31T06:17:35.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a50085740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e8f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a50085740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19ad0390 0x558a19ea1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a50085740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19af1070 0x558a19e99410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a50085740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441af4e0 con 0x558a19ac81b0 2024-08-31T06:17:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a50085740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441b1230 con 0x558a19ad0390 2024-08-31T06:17:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a50085740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441afbb0 con 0x558a19af1070 2024-08-31T06:17:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e8f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e8f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34706/0 (socket says 172.21.15.53:34706) 2024-08-31T06:17:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a437fe640 1 -- 172.21.15.53:0/4197946229 learned_addr learned my addr 172.21.15.53:0/4197946229 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.965+0000 7f8a43fff640 1 --2- 172.21.15.53:0/4197946229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19af1070 0x558a19e99410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.964+0000 7f8a3affd640 1 --2- 172.21.15.53:0/4197946229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19ad0390 0x558a19ea1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.965+0000 7f8a437fe640 1 -- 172.21.15.53:0/4197946229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19af1070 msgr2=0x558a19e99410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:35.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.965+0000 7f8a437fe640 1 --2- 172.21.15.53:0/4197946229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19af1070 0x558a19e99410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.965+0000 7f8a437fe640 1 -- 172.21.15.53:0/4197946229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19ad0390 msgr2=0x558a19ea1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:35.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.965+0000 7f8a437fe640 1 --2- 172.21.15.53:0/4197946229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19ad0390 0x558a19ea1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.965+0000 7f8a437fe640 1 -- 172.21.15.53:0/4197946229 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a19ea0a10 con 0x558a19ac81b0 2024-08-31T06:17:35.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.965+0000 7f8a437fe640 1 --2- 172.21.15.53:0/4197946229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e8f230 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f8a34000c00 tx=0x7f8a340e4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab6956fa742f336 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:35.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.965+0000 7f8a397fa640 1 -- 172.21.15.53:0/4197946229 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340aae80 con 0x558a19ac81b0 2024-08-31T06:17:35.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.965+0000 7f8a397fa640 1 -- 172.21.15.53:0/4197946229 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a340b4370 con 0x558a19ac81b0 2024-08-31T06:17:35.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.965+0000 7f8a397fa640 1 -- 172.21.15.53:0/4197946229 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340ab060 con 0x558a19ac81b0 2024-08-31T06:17:35.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.966+0000 7f8a50085740 1 -- 172.21.15.53:0/4197946229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 msgr2=0x558a19e8f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:35.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.966+0000 7f8a50085740 1 --2- 172.21.15.53:0/4197946229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e8f230 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f8a34000c00 tx=0x7f8a340e4040 comp rx=0 tx=0).stop 2024-08-31T06:17:35.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.966+0000 7f8a50085740 1 -- 172.21.15.53:0/4197946229 shutdown_connections 2024-08-31T06:17:35.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.966+0000 7f8a50085740 1 --2- 172.21.15.53:0/4197946229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19af1070 0x558a19e99410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.966+0000 7f8a50085740 1 --2- 172.21.15.53:0/4197946229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19ad0390 0x558a19ea1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.966+0000 7f8a50085740 1 --2- 172.21.15.53:0/4197946229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19e8f230 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.966+0000 7f8a50085740 1 -- 172.21.15.53:0/4197946229 >> 172.21.15.53:0/4197946229 conn(0x558a19ae5460 msgr2=0x558a19ea1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.966+0000 7f8a50085740 1 -- 172.21.15.53:0/4197946229 shutdown_connections 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.966+0000 7f8a50085740 1 -- 172.21.15.53:0/4197946229 wait complete. 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.966+0000 7f8a50085740 1 -- start start 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a50085740 1 Processor -- start 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a50085740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19eaa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a50085740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19ad0390 0x558a19ea5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a50085740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19af1070 0x558a19ea6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a50085740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441b0aa0 con 0x558a19ac81b0 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a50085740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441b0340 con 0x558a19af1070 2024-08-31T06:17:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a50085740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441ad4e0 con 0x558a19ad0390 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a50085740 10 client.0 _ll_register_callbacks cb 0x7f8a2c005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19eaa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19eaa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34712/0 (socket says 172.21.15.53:34712) 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a437fe640 1 -- 172.21.15.53:0/1356635188 learned_addr learned my addr 172.21.15.53:0/1356635188 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a43fff640 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19af1070 0x558a19ea6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a3affd640 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19ad0390 0x558a19ea5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a437fe640 1 -- 172.21.15.53:0/1356635188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19ad0390 msgr2=0x558a19ea5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.967+0000 7f8a437fe640 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19ad0390 0x558a19ea5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a437fe640 1 -- 172.21.15.53:0/1356635188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19af1070 msgr2=0x558a19ea6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a437fe640 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19af1070 0x558a19ea6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a437fe640 1 -- 172.21.15.53:0/1356635188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a19f1d7a0 con 0x558a19ac81b0 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a437fe640 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19eaa5e0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f8a34005c30 tx=0x7f8a34004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6f3b8583dbea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a22ffd640 1 -- 172.21.15.53:0/1356635188 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340ab060 con 0x558a19ac81b0 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a22ffd640 1 -- 172.21.15.53:0/1356635188 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f8a340e29f0 con 0x558a19ac81b0 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a50085740 1 -- 172.21.15.53:0/1356635188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a19e087b0 con 0x558a19ac81b0 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a22ffd640 1 -- 172.21.15.53:0/1356635188 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8a340ab4e0 con 0x558a19ac81b0 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a50085740 10 client.19539 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a50085740 1 -- 172.21.15.53:0/1356635188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x558a19f1e860 con 0x558a19ac81b0 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a22ffd640 1 -- 172.21.15.53:0/1356635188 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558a19e087b0 con 0x558a19ac81b0 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a22ffd640 1 -- 172.21.15.53:0/1356635188 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f8a3405b1b0 con 0x558a19ac81b0 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a50085740 10 client.19539 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a50085740 10 client.19539 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.968+0000 7f8a50085740 20 client.19539 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.969+0000 7f8a50085740 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558a19a84da0 0x558a19f20af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.969+0000 7f8a50085740 4 client.19539 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:17:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.969+0000 7f8a50085740 1 -- 172.21.15.53:0/1356635188 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a19d7faa0 con 0x558a19a84da0 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.969+0000 7f8a3affd640 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558a19a84da0 0x558a19f20af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.969+0000 7f8a22ffd640 10 client.19539 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.969+0000 7f8a3affd640 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558a19a84da0 0x558a19f20af0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a65d4eed565ecf58 server_cookie=ffd8e67a72a7277b in_seq=0 out_seq=0 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.969+0000 7f8a22ffd640 1 -- 172.21.15.53:0/1356635188 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a19d7faa0 con 0x558a19a84da0 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.969+0000 7f8a22ffd640 10 client.19539 handle_command_reply: tid=0 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.969+0000 7f8a50085740 1 client.19539 shutdown 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a50085740 1 -- 172.21.15.53:0/1356635188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 msgr2=0x558a19eaa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a50085740 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19eaa5e0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f8a34005c30 tx=0x7f8a34004560 comp rx=0 tx=0).stop 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a50085740 1 -- 172.21.15.53:0/1356635188 shutdown_connections 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a50085740 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a19af1070 0x558a19ea6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a50085740 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a19ad0390 0x558a19ea5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a50085740 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x558a19a84da0 0x558a19f20af0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a50085740 1 --2- 172.21.15.53:0/1356635188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558a19ac81b0 0x558a19eaa5e0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a50085740 1 -- 172.21.15.53:0/1356635188 >> 172.21.15.53:0/1356635188 conn(0x558a19ae5460 msgr2=0x558a19e99410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a22ffd640 0 client.19539 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:17:35.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a50085740 1 -- 172.21.15.53:0/1356635188 shutdown_connections 2024-08-31T06:17:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a50085740 1 -- 172.21.15.53:0/1356635188 wait complete. 2024-08-31T06:17:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a50085740 20 client.19539 trim_cache size 0 max 16384 2024-08-31T06:17:35.979 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:17:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a49b10640 1 -- 172.21.15.53:0/966451080 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a300b4ca0 msgr2=0x7f8a300b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a49b10640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a300b4ca0 0x7f8a300b71b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0094e0 tx=0x7f8a3c0095c0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a49b10640 1 -- 172.21.15.53:0/966451080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a44102880 msgr2=0x7f8a4419a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a49b10640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a44102880 0x7f8a4419a200 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400d950 tx=0x7f8a3400de10 comp rx=0 tx=0).stop 2024-08-31T06:17:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.970+0000 7f8a49b10640 1 -- 172.21.15.53:0/966451080 shutdown_connections 2024-08-31T06:17:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.971+0000 7f8a49b10640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8a300b4ca0 0x7f8a300b71b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.971+0000 7f8a49b10640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a44108b10 0x7f8a4419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.971+0000 7f8a49b10640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a441081c0 0x7f8a4419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.971+0000 7f8a49b10640 1 --2- 172.21.15.53:0/966451080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a44102880 0x7f8a4419a200 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.971+0000 7f8a49b10640 1 -- 172.21.15.53:0/966451080 >> 172.21.15.53:0/966451080 conn(0x7f8a44079510 msgr2=0x7f8a441062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.971+0000 7f8a49b10640 1 -- 172.21.15.53:0/966451080 shutdown_connections 2024-08-31T06:17:35.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:35.971+0000 7f8a49b10640 1 -- 172.21.15.53:0/966451080 wait complete. 2024-08-31T06:17:36.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 191687 1.33 MB/sec execute 565 sec latency 4506.284 ms 2024-08-31T06:17:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:35 smithi153 ceph-mon[22320]: pgmap v716: 97 pgs: 97 active+clean; 112 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-08-31T06:17:36.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:17:36.950 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:17:37.000 INFO:tasks.workunit.client.0.smithi053.stdout: 1 191887 1.33 MB/sec execute 566 sec latency 4753.587 ms 2024-08-31T06:17:37.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.426+0000 7f4fda9ef640 1 -- 172.21.15.53:0/1202765079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fd4108ac0 msgr2=0x7f4fd410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:37.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.426+0000 7f4fda9ef640 1 --2- 172.21.15.53:0/1202765079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fd4108ac0 0x7f4fd410f2f0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009ca0 tx=0x7f4fcc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.426+0000 7f4fda9ef640 1 -- 172.21.15.53:0/1202765079 shutdown_connections 2024-08-31T06:17:37.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.426+0000 7f4fda9ef640 1 --2- 172.21.15.53:0/1202765079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fd4108ac0 0x7f4fd410f2f0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.426+0000 7f4fda9ef640 1 --2- 172.21.15.53:0/1202765079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd4108170 0x7f4fd4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.426+0000 7f4fda9ef640 1 --2- 172.21.15.53:0/1202765079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fd4102880 0x7f4fd4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.426+0000 7f4fda9ef640 1 -- 172.21.15.53:0/1202765079 >> 172.21.15.53:0/1202765079 conn(0x7f4fd4079530 msgr2=0x7f4fd4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.426+0000 7f4fda9ef640 1 -- 172.21.15.53:0/1202765079 shutdown_connections 2024-08-31T06:17:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.426+0000 7f4fda9ef640 1 -- 172.21.15.53:0/1202765079 wait complete. 2024-08-31T06:17:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.427+0000 7f4fda9ef640 1 Processor -- start 2024-08-31T06:17:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.427+0000 7f4fda9ef640 1 -- start start 2024-08-31T06:17:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fda9ef640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fd4102880 0x7f4fd410fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fda9ef640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd4108170 0x7f4fd4110310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fda9ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fd4108ac0 0x7f4fd4110850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fda9ef640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd4113780 con 0x7f4fd4108ac0 2024-08-31T06:17:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fda9ef640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd4113600 con 0x7f4fd4102880 2024-08-31T06:17:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fda9ef640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd4113900 con 0x7f4fd4108170 2024-08-31T06:17:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd8f8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fd4108ac0 0x7f4fd4110850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd8f8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fd4108ac0 0x7f4fd4110850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34724/0 (socket says 172.21.15.53:34724) 2024-08-31T06:17:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd8f8c640 1 -- 172.21.15.53:0/3144463850 learned_addr learned my addr 172.21.15.53:0/3144463850 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd8f8c640 1 -- 172.21.15.53:0/3144463850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd4108170 msgr2=0x7f4fd4110310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T06:17:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd8f8c640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd4108170 0x7f4fd4110310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd8f8c640 1 -- 172.21.15.53:0/3144463850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fd4102880 msgr2=0x7f4fd410fdd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T06:17:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd8f8c640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fd4102880 0x7f4fd410fdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd8f8c640 1 -- 172.21.15.53:0/3144463850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd41a83d0 con 0x7f4fd4108ac0 2024-08-31T06:17:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd8f8c640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fd4108ac0 0x7f4fd4110850 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc005cc0 tx=0x7f4fcc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd17fa640 1 -- 172.21.15.53:0/3144463850 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc032c10 con 0x7f4fd4108ac0 2024-08-31T06:17:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fda9ef640 1 -- 172.21.15.53:0/3144463850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd41a8660 con 0x7f4fd4108ac0 2024-08-31T06:17:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd17fa640 1 -- 172.21.15.53:0/3144463850 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fcc032db0 con 0x7f4fd4108ac0 2024-08-31T06:17:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.428+0000 7f4fd17fa640 1 -- 172.21.15.53:0/3144463850 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc030a60 con 0x7f4fd4108ac0 2024-08-31T06:17:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.429+0000 7f4fda9ef640 1 -- 172.21.15.53:0/3144463850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd41a8bf0 con 0x7f4fd4108ac0 2024-08-31T06:17:37.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.431+0000 7f4fd17fa640 1 -- 172.21.15.53:0/3144463850 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4fcc030c00 con 0x7f4fd4108ac0 2024-08-31T06:17:37.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.431+0000 7f4fe0f64740 1 Processor -- start 2024-08-31T06:17:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.431+0000 7f4fe0f64740 1 -- start start 2024-08-31T06:17:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f25654310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25654850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f25654d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556f255cb680 con 0x556f252861b0 2024-08-31T06:17:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556f255bac10 con 0x556f2528e390 2024-08-31T06:17:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556f255bebc0 con 0x556f252af070 2024-08-31T06:17:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25654850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f25654310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25654850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34734/0 (socket says 172.21.15.53:34734) 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd3fff640 1 -- 172.21.15.53:0/1251733247 learned_addr learned my addr 172.21.15.53:0/1251733247 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/1251733247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f25654d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd3fff640 1 -- 172.21.15.53:0/1251733247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 msgr2=0x556f25654310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/1251733247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f25654310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd3fff640 1 -- 172.21.15.53:0/1251733247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 msgr2=0x556f25654d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/1251733247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f25654d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd3fff640 1 -- 172.21.15.53:0/1251733247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f2531a650 con 0x556f252861b0 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/1251733247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f25654d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd17fa640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4fbc0b4ca0 0x7f4fbc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/1251733247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25654850 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009b70 tx=0x7f4fc400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4153fe7cdd828f18 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.432+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4fbc0b4ca0 0x7f4fbc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.433+0000 7f4fd17fa640 1 -- 172.21.15.53:0/3144463850 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f4fcc1069d0 con 0x7f4fd4108ac0 2024-08-31T06:17:37.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.433+0000 7f4fba7fc640 1 -- 172.21.15.53:0/1251733247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4009e60 con 0x556f252861b0 2024-08-31T06:17:37.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.433+0000 7f4fba7fc640 1 -- 172.21.15.53:0/1251733247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fc40054b0 con 0x556f252861b0 2024-08-31T06:17:37.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.433+0000 7f4fba7fc640 1 -- 172.21.15.53:0/1251733247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4010430 con 0x556f252861b0 2024-08-31T06:17:37.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fe0f64740 1 -- 172.21.15.53:0/1251733247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 msgr2=0x556f25654850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:37.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/1251733247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25654850 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009b70 tx=0x7f4fc400e720 comp rx=0 tx=0).stop 2024-08-31T06:17:37.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4fbc0b4ca0 0x7f4fbc0b71b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4079ba0 tx=0x7f4fc8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:37.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fe0f64740 1 -- 172.21.15.53:0/1251733247 shutdown_connections 2024-08-31T06:17:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/1251733247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f25654d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/1251733247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25654850 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/1251733247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f25654310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fe0f64740 1 -- 172.21.15.53:0/1251733247 >> 172.21.15.53:0/1251733247 conn(0x556f252a3460 msgr2=0x556f25652200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fe0f64740 1 -- 172.21.15.53:0/1251733247 shutdown_connections 2024-08-31T06:17:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fe0f64740 1 -- 172.21.15.53:0/1251733247 wait complete. 2024-08-31T06:17:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fe0f64740 1 -- start start 2024-08-31T06:17:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.434+0000 7f4fe0f64740 1 Processor -- start 2024-08-31T06:17:37.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f2565faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f2565ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f2566bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556f2541d700 con 0x556f252861b0 2024-08-31T06:17:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556f25541750 con 0x556f2528e390 2024-08-31T06:17:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556f25662af0 con 0x556f252af070 2024-08-31T06:17:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fe0f64740 10 client.0 _ll_register_callbacks cb 0x556f25570e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f2565faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f2565faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34742/0 (socket says 172.21.15.53:34742) 2024-08-31T06:17:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fd3fff640 1 -- 172.21.15.53:0/2437080727 learned_addr learned my addr 172.21.15.53:0/2437080727 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f2565ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fd8f8c640 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f2566bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fd3fff640 1 -- 172.21.15.53:0/2437080727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 msgr2=0x556f2566bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f2566bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fd3fff640 1 -- 172.21.15.53:0/2437080727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 msgr2=0x556f2565ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f2565ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.435+0000 7f4fd3fff640 1 -- 172.21.15.53:0/2437080727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f2557a900 con 0x556f252861b0 2024-08-31T06:17:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f2565faa0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4004ad0 tx=0x7f4fc40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cac8582526a0ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fb37fe640 1 -- 172.21.15.53:0/2437080727 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc401d040 con 0x556f252861b0 2024-08-31T06:17:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fb37fe640 1 -- 172.21.15.53:0/2437080727 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f4fc4005020 con 0x556f252861b0 2024-08-31T06:17:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fe0f64740 1 -- 172.21.15.53:0/2437080727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fc40054b0 con 0x556f252861b0 2024-08-31T06:17:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fb37fe640 1 -- 172.21.15.53:0/2437080727 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4fc4030050 con 0x556f252861b0 2024-08-31T06:17:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fe0f64740 10 client.19551 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fe0f64740 1 -- 172.21.15.53:0/2437080727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x556f2566e8d0 con 0x556f252861b0 2024-08-31T06:17:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fb37fe640 1 -- 172.21.15.53:0/2437080727 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fc40054b0 con 0x556f252861b0 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fb37fe640 1 -- 172.21.15.53:0/2437080727 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f4fc4003780 con 0x556f252861b0 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fe0f64740 10 client.19551 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fe0f64740 10 client.19551 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fe0f64740 20 client.19551 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x556f2526d9f0 0x556f25671ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fe0f64740 4 client.19551 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.436+0000 7f4fe0f64740 1 -- 172.21.15.53:0/2437080727 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f255cd5d0 con 0x556f2526d9f0 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.437+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x556f2526d9f0 0x556f25671ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.437+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x556f2526d9f0 0x556f25671ce0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=12523d386119f047 server_cookie=2a3235a7e3f92925 in_seq=0 out_seq=0 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.437+0000 7f4fb37fe640 10 client.19551 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fb37fe640 1 -- 172.21.15.53:0/2437080727 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f255cd5d0 con 0x556f2526d9f0 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fb37fe640 10 client.19551 handle_command_reply: tid=0 2024-08-31T06:17:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 1 client.19551 shutdown 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 1 -- 172.21.15.53:0/2437080727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 msgr2=0x556f2565faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f2565faa0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4004ad0 tx=0x7f4fc40048f0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 1 -- 172.21.15.53:0/2437080727 shutdown_connections 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x556f2526d9f0 0x556f25671ce0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f2566bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f2565ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/2437080727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f2565faa0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 1 -- 172.21.15.53:0/2437080727 >> 172.21.15.53:0/2437080727 conn(0x556f252a3460 msgr2=0x556f256574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fb37fe640 0 client.19551 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 1 -- 172.21.15.53:0/2437080727 shutdown_connections 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 1 -- 172.21.15.53:0/2437080727 wait complete. 2024-08-31T06:17:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.438+0000 7f4fe0f64740 20 client.19551 trim_cache size 0 max 16384 2024-08-31T06:17:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.453+0000 7f4fe0f64740 1 Processor -- start 2024-08-31T06:17:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.453+0000 7f4fe0f64740 1 -- start start 2024-08-31T06:17:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.453+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25657410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.453+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f25657950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.453+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f2565cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd41b1730 con 0x556f252861b0 2024-08-31T06:17:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd41b3480 con 0x556f2528e390 2024-08-31T06:17:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd41b1e00 con 0x556f252af070 2024-08-31T06:17:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25657410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25657410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34748/0 (socket says 172.21.15.53:34748) 2024-08-31T06:17:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd3fff640 1 -- 172.21.15.53:0/3448989699 learned_addr learned my addr 172.21.15.53:0/3448989699 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/3448989699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f25657950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd3fff640 1 -- 172.21.15.53:0/3448989699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 msgr2=0x556f2565cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd8f8c640 1 --2- 172.21.15.53:0/3448989699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f2565cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/3448989699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f2565cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd3fff640 1 -- 172.21.15.53:0/3448989699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 msgr2=0x556f25657950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/3448989699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f25657950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd3fff640 1 -- 172.21.15.53:0/3448989699 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f2564d5a0 con 0x556f252861b0 2024-08-31T06:17:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd8f8c640 1 --2- 172.21.15.53:0/3448989699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f2565cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/3448989699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f25657950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:37.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/3448989699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25657410 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4005d70 tx=0x7f4fc4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07d1231e47a4f36 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:37.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fb9ffb640 1 -- 172.21.15.53:0/3448989699 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4038020 con 0x556f252861b0 2024-08-31T06:17:37.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fb9ffb640 1 -- 172.21.15.53:0/3448989699 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fc4027070 con 0x556f252861b0 2024-08-31T06:17:37.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.454+0000 7f4fb9ffb640 1 -- 172.21.15.53:0/3448989699 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40052d0 con 0x556f252861b0 2024-08-31T06:17:37.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.455+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3448989699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 msgr2=0x556f25657410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:37.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.455+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/3448989699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25657410 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4005d70 tx=0x7f4fc4005fd0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.455+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3448989699 shutdown_connections 2024-08-31T06:17:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.455+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/3448989699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252af070 0x556f2565cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.455+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/3448989699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f2528e390 0x556f25657950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.455+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/3448989699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f252861b0 0x556f25657410 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.455+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3448989699 >> 172.21.15.53:0/3448989699 conn(0x556f252a3460 msgr2=0x556f2565e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.455+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3448989699 shutdown_connections 2024-08-31T06:17:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.456+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3448989699 wait complete. 2024-08-31T06:17:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.456+0000 7f4fe0f64740 1 -- start start 2024-08-31T06:17:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.456+0000 7f4fe0f64740 1 Processor -- start 2024-08-31T06:17:37.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.456+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252861b0 0x556f25663dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.456+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f2528e390 0x556f25664300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.456+0000 7f4fe0f64740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f252af070 0x556f25664840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.456+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd41b2cf0 con 0x556f2528e390 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.456+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd41b2590 con 0x556f252af070 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.456+0000 7f4fe0f64740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd41af730 con 0x556f252861b0 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fe0f64740 10 client.0 _ll_register_callbacks cb 0x7f4fc8009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f2528e390 0x556f25664300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f2528e390 0x556f25664300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34750/0 (socket says 172.21.15.53:34750) 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd37fe640 1 -- 172.21.15.53:0/3300942558 learned_addr learned my addr 172.21.15.53:0/3300942558 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd8f8c640 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f252af070 0x556f25664840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252861b0 0x556f25663dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd37fe640 1 -- 172.21.15.53:0/3300942558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252861b0 msgr2=0x556f25663dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252861b0 0x556f25663dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd37fe640 1 -- 172.21.15.53:0/3300942558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f252af070 msgr2=0x556f25664840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f252af070 0x556f25664840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd37fe640 1 -- 172.21.15.53:0/3300942558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f256e3e00 con 0x556f2528e390 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252861b0 0x556f25663dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fd37fe640 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f2528e390 0x556f25664300 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009c10 tx=0x7f4fc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882cc93bc7edf4ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fb37fe640 1 -- 172.21.15.53:0/3300942558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8004220 con 0x556f2528e390 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fb37fe640 1 -- 172.21.15.53:0/3300942558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f4fc80043c0 con 0x556f2528e390 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.457+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3300942558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fc4027070 con 0x556f2528e390 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fb37fe640 1 -- 172.21.15.53:0/3300942558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4fc8037050 con 0x556f2528e390 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fe0f64740 10 client.19557 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3300942558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x556f256e4ff0 con 0x556f2528e390 2024-08-31T06:17:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fb37fe640 1 -- 172.21.15.53:0/3300942558 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fc4027070 con 0x556f2528e390 2024-08-31T06:17:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fb37fe640 1 -- 172.21.15.53:0/3300942558 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f4fc8003780 con 0x556f2528e390 2024-08-31T06:17:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fe0f64740 10 client.19557 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fe0f64740 10 client.19557 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:17:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fe0f64740 20 client.19557 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x556f25242da0 0x556f256e78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fe0f64740 4 client.19557 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:17:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3300942558 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f255c9070 con 0x556f25242da0 2024-08-31T06:17:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.458+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x556f25242da0 0x556f256e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.459+0000 7f4fd3fff640 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x556f25242da0 0x556f256e78a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f7a9344c2cb013ca server_cookie=1c4e3d42b7f75d0e in_seq=0 out_seq=0 2024-08-31T06:17:37.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.459+0000 7f4fb37fe640 10 client.19557 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.459+0000 7f4fb37fe640 1 -- 172.21.15.53:0/3300942558 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f255c9070 con 0x556f25242da0 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.459+0000 7f4fb37fe640 10 client.19557 handle_command_reply: tid=0 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.459+0000 7f4fe0f64740 1 client.19557 shutdown 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3300942558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f2528e390 msgr2=0x556f25664300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f2528e390 0x556f25664300 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009c10 tx=0x7f4fc8004730 comp rx=0 tx=0).stop 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3300942558 shutdown_connections 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x556f25242da0 0x556f256e78a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556f252af070 0x556f25664840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556f2528e390 0x556f25664300 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fe0f64740 1 --2- 172.21.15.53:0/3300942558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f252861b0 0x556f25663dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3300942558 >> 172.21.15.53:0/3300942558 conn(0x556f252a3460 msgr2=0x556f25657410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fb37fe640 0 client.19557 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:17:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3300942558 shutdown_connections 2024-08-31T06:17:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fe0f64740 1 -- 172.21.15.53:0/3300942558 wait complete. 2024-08-31T06:17:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fe0f64740 20 client.19557 trim_cache size 0 max 16384 2024-08-31T06:17:37.469 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fda9ef640 1 -- 172.21.15.53:0/3144463850 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4fbc0b4ca0 msgr2=0x7f4fbc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fda9ef640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4fbc0b4ca0 0x7f4fbc0b71b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4079ba0 tx=0x7f4fc8005f90 comp rx=0 tx=0).stop 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fda9ef640 1 -- 172.21.15.53:0/3144463850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fd4108ac0 msgr2=0x7f4fd4110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.460+0000 7f4fda9ef640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fd4108ac0 0x7f4fd4110850 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc005cc0 tx=0x7f4fcc003f90 comp rx=0 tx=0).stop 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.461+0000 7f4fda9ef640 1 -- 172.21.15.53:0/3144463850 shutdown_connections 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.461+0000 7f4fda9ef640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4fbc0b4ca0 0x7f4fbc0b71b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.461+0000 7f4fda9ef640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fd4108ac0 0x7f4fd4110850 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.461+0000 7f4fda9ef640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd4108170 0x7f4fd4110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.461+0000 7f4fda9ef640 1 --2- 172.21.15.53:0/3144463850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fd4102880 0x7f4fd410fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.461+0000 7f4fda9ef640 1 -- 172.21.15.53:0/3144463850 >> 172.21.15.53:0/3144463850 conn(0x7f4fd4079530 msgr2=0x7f4fd41061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.461+0000 7f4fda9ef640 1 -- 172.21.15.53:0/3144463850 shutdown_connections 2024-08-31T06:17:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:37.461+0000 7f4fda9ef640 1 -- 172.21.15.53:0/3144463850 wait complete. 2024-08-31T06:17:37.680 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:37 smithi053 ceph-mon[18924]: pgmap v717: 97 pgs: 97 active+clean; 113 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 879 KiB/s wr, 85 op/s 2024-08-31T06:17:38.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 192133 1.33 MB/sec execute 567 sec latency 25.799 ms 2024-08-31T06:17:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:37 smithi130 ceph-mon[22266]: pgmap v717: 97 pgs: 97 active+clean; 113 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 879 KiB/s wr, 85 op/s 2024-08-31T06:17:38.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:37 smithi153 ceph-mon[22320]: pgmap v717: 97 pgs: 97 active+clean; 113 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 879 KiB/s wr, 85 op/s 2024-08-31T06:17:38.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:17:38.518 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:17:39.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 192546 1.33 MB/sec execute 568 sec latency 44.285 ms 2024-08-31T06:17:39.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:39 smithi053 ceph-mon[18924]: pgmap v718: 97 pgs: 97 active+clean; 113 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 801 KiB/s wr, 89 op/s 2024-08-31T06:17:40.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 193041 1.33 MB/sec execute 569 sec latency 41.726 ms 2024-08-31T06:17:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:39 smithi130 ceph-mon[22266]: pgmap v718: 97 pgs: 97 active+clean; 113 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 801 KiB/s wr, 89 op/s 2024-08-31T06:17:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:39 smithi153 ceph-mon[22320]: pgmap v718: 97 pgs: 97 active+clean; 113 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 801 KiB/s wr, 89 op/s 2024-08-31T06:17:40.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.380+0000 7fa6fe952640 1 -- 172.21.15.53:0/2469493925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f8104640 msgr2=0x7fa6f8104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:40.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.380+0000 7fa6fe952640 1 --2- 172.21.15.53:0/2469493925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f8104640 0x7fa6f8104a50 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009860 tx=0x7fa6e802a340 comp rx=0 tx=0).stop 2024-08-31T06:17:40.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.381+0000 7fa6fe952640 1 -- 172.21.15.53:0/2469493925 shutdown_connections 2024-08-31T06:17:40.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.381+0000 7fa6fe952640 1 --2- 172.21.15.53:0/2469493925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f810dbf0 0x7fa6f81100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.381+0000 7fa6fe952640 1 --2- 172.21.15.53:0/2469493925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f8105070 0x7fa6f810d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.381+0000 7fa6fe952640 1 --2- 172.21.15.53:0/2469493925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f8104640 0x7fa6f8104a50 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.381+0000 7fa6fe952640 1 -- 172.21.15.53:0/2469493925 >> 172.21.15.53:0/2469493925 conn(0x7fa6f80794e0 msgr2=0x7fa6f80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:40.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.381+0000 7fa6fe952640 1 -- 172.21.15.53:0/2469493925 shutdown_connections 2024-08-31T06:17:40.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.381+0000 7fa6fe952640 1 -- 172.21.15.53:0/2469493925 wait complete. 2024-08-31T06:17:40.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.381+0000 7fa6fe952640 1 Processor -- start 2024-08-31T06:17:40.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6fe952640 1 -- start start 2024-08-31T06:17:40.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6fe952640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f8104640 0x7fa6f8074cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6fe952640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f8105070 0x7fa6f806df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6fe952640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f810dbf0 0x7fa6f806e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6fe952640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f81136c0 con 0x7fa6f810dbf0 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6fe952640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f8113540 con 0x7fa6f8105070 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6fe952640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f8113840 con 0x7fa6f8104640 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6fceef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f810dbf0 0x7fa6f806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6fceef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f810dbf0 0x7fa6f806e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34774/0 (socket says 172.21.15.53:34774) 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6fceef640 1 -- 172.21.15.53:0/1795040637 learned_addr learned my addr 172.21.15.53:0/1795040637 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f8105070 0x7fa6f806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.382+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f8104640 0x7fa6f8074cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.383+0000 7fa6fceef640 1 -- 172.21.15.53:0/1795040637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f8104640 msgr2=0x7fa6f8074cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.383+0000 7fa6fceef640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f8104640 0x7fa6f8074cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.383+0000 7fa6fceef640 1 -- 172.21.15.53:0/1795040637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f8105070 msgr2=0x7fa6f806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.383+0000 7fa6fceef640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f8105070 0x7fa6f806df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.383+0000 7fa6fceef640 1 -- 172.21.15.53:0/1795040637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f8073930 con 0x7fa6f810dbf0 2024-08-31T06:17:40.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.383+0000 7fa6fceef640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f810dbf0 0x7fa6f806e610 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000eaa0 tx=0x7fa6f000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:40.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.383+0000 7fa6f57fa640 1 -- 172.21.15.53:0/1795040637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0004d20 con 0x7fa6f810dbf0 2024-08-31T06:17:40.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.383+0000 7fa6f57fa640 1 -- 172.21.15.53:0/1795040637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6f0005020 con 0x7fa6f810dbf0 2024-08-31T06:17:40.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.383+0000 7fa6fe952640 1 -- 172.21.15.53:0/1795040637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f8073bc0 con 0x7fa6f810dbf0 2024-08-31T06:17:40.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.384+0000 7fa6fe952640 1 -- 172.21.15.53:0/1795040637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f8074100 con 0x7fa6f810dbf0 2024-08-31T06:17:40.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.384+0000 7fa6f57fa640 1 -- 172.21.15.53:0/1795040637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00116d0 con 0x7fa6f810dbf0 2024-08-31T06:17:40.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.387+0000 7fa704ec7740 1 Processor -- start 2024-08-31T06:17:40.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.387+0000 7fa6f57fa640 1 -- 172.21.15.53:0/1795040637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa6f0011870 con 0x7fa6f810dbf0 2024-08-31T06:17:40.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.387+0000 7fa704ec7740 1 -- start start 2024-08-31T06:17:40.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.387+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 0x55f185594350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.387+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851c61b0 0x55f185594890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.387+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 0x55f185594dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.387+0000 7fa704ec7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f18550b680 con 0x55f1851ce390 2024-08-31T06:17:40.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.387+0000 7fa704ec7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f1854fac10 con 0x55f1851ef070 2024-08-31T06:17:40.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa704ec7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f1854febc0 con 0x55f1851c61b0 2024-08-31T06:17:40.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851c61b0 0x55f185594890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 0x55f185594350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851c61b0 0x55f185594890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:39808/0 (socket says 172.21.15.53:39808) 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f7fff640 1 -- 172.21.15.53:0/2836168063 learned_addr learned my addr 172.21.15.53:0/2836168063 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 0x55f185594350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52962/0 (socket says 172.21.15.53:52962) 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/2836168063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 0x55f185594dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f57fa640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6e00b4d20 0x7fa6e00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f7fff640 1 -- 172.21.15.53:0/2836168063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 msgr2=0x55f185594350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/2836168063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 0x55f185594350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f7fff640 1 -- 172.21.15.53:0/2836168063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 msgr2=0x55f185594dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/2836168063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 0x55f185594dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f7fff640 1 -- 172.21.15.53:0/2836168063 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f18525a650 con 0x55f1851c61b0 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/2836168063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 0x55f185594350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6fceef640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6e00b4d20 0x7fa6e00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f57fa640 1 -- 172.21.15.53:0/1795040637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7fa6f00e53d0 con 0x7fa6f810dbf0 2024-08-31T06:17:40.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.388+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/2836168063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851c61b0 0x55f185594890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009830 tx=0x7fa6e80058b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d583b55e9de53451 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:40.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.389+0000 7fa6fceef640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6e00b4d20 0x7fa6e00b7230 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00ab7a0 tx=0x7fa6f0095040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:40.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.389+0000 7fa6de7fc640 1 -- 172.21.15.53:0/2836168063 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e804b070 con 0x55f1851c61b0 2024-08-31T06:17:40.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.389+0000 7fa6de7fc640 1 -- 172.21.15.53:0/2836168063 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6e80044c0 con 0x55f1851c61b0 2024-08-31T06:17:40.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.389+0000 7fa6de7fc640 1 -- 172.21.15.53:0/2836168063 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8030870 con 0x55f1851c61b0 2024-08-31T06:17:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.390+0000 7fa704ec7740 1 -- 172.21.15.53:0/2836168063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851c61b0 msgr2=0x55f185594890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.390+0000 7fa704ec7740 1 --2- 172.21.15.53:0/2836168063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851c61b0 0x55f185594890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009830 tx=0x7fa6e80058b0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.390+0000 7fa704ec7740 1 -- 172.21.15.53:0/2836168063 shutdown_connections 2024-08-31T06:17:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.390+0000 7fa704ec7740 1 --2- 172.21.15.53:0/2836168063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 0x55f185594dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.390+0000 7fa704ec7740 1 --2- 172.21.15.53:0/2836168063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851c61b0 0x55f185594890 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.390+0000 7fa704ec7740 1 --2- 172.21.15.53:0/2836168063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 0x55f185594350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.390+0000 7fa704ec7740 1 -- 172.21.15.53:0/2836168063 >> 172.21.15.53:0/2836168063 conn(0x55f1851e3460 msgr2=0x55f185592240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.390+0000 7fa704ec7740 1 -- 172.21.15.53:0/2836168063 shutdown_connections 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.390+0000 7fa704ec7740 1 -- 172.21.15.53:0/2836168063 wait complete. 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.390+0000 7fa704ec7740 1 -- start start 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa704ec7740 1 Processor -- start 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 0x55f18559fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ce390 0x55f1855a0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ef070 0x55f1855abe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa704ec7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f18535d700 con 0x55f1851c61b0 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa704ec7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f185481750 con 0x55f1851ce390 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa704ec7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f1855a2ad0 con 0x55f1851ef070 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa704ec7740 10 client.0 _ll_register_callbacks cb 0x55f1854b0e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 0x55f18559fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 0x55f18559fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34784/0 (socket says 172.21.15.53:34784) 2024-08-31T06:17:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa6f77fe640 1 -- 172.21.15.53:0/1044375157 learned_addr learned my addr 172.21.15.53:0/1044375157 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ce390 0x55f1855a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.391+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ef070 0x55f1855abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa6f77fe640 1 -- 172.21.15.53:0/1044375157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ef070 msgr2=0x55f1855abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ef070 0x55f1855abe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa6f77fe640 1 -- 172.21.15.53:0/1044375157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ce390 msgr2=0x55f1855a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ce390 0x55f1855a0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa6f77fe640 1 -- 172.21.15.53:0/1044375157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1854ba900 con 0x55f1851c61b0 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 0x55f18559fb00 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec003780 tx=0x7fa6ec009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6298d694b64e38 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa6d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1044375157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec011b70 con 0x55f1851c61b0 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa704ec7740 1 -- 172.21.15.53:0/1044375157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f18550d5d0 con 0x55f1851c61b0 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1044375157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7fa6ec011d10 con 0x55f1851c61b0 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1044375157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fa6ec005020 con 0x55f1851c61b0 2024-08-31T06:17:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa704ec7740 10 client.19569 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.392+0000 7fa704ec7740 1 -- 172.21.15.53:0/1044375157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55f1855ae960 con 0x55f1851c61b0 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.393+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1044375157 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f18550d5d0 con 0x55f1851c61b0 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.393+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1044375157 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7fa6ec004af0 con 0x55f1851c61b0 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.393+0000 7fa704ec7740 10 client.19569 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.393+0000 7fa704ec7740 10 client.19569 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.393+0000 7fa704ec7740 20 client.19569 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.393+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f1851ad9f0 0x55f1855b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.393+0000 7fa704ec7740 4 client.19569 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.393+0000 7fa704ec7740 1 -- 172.21.15.53:0/1044375157 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f185509070 con 0x55f1851ad9f0 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.393+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f1851ad9f0 0x55f1855b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.394+0000 7fa6d77fe640 10 client.19569 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:17:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.394+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f1851ad9f0 0x55f1855b1ed0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c871af821daf9fac server_cookie=336391db4e6c33f6 in_seq=0 out_seq=0 2024-08-31T06:17:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.394+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1044375157 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f185509070 con 0x55f1851ad9f0 2024-08-31T06:17:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.394+0000 7fa6d77fe640 10 client.19569 handle_command_reply: tid=0 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.394+0000 7fa704ec7740 1 client.19569 shutdown 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa704ec7740 1 -- 172.21.15.53:0/1044375157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 msgr2=0x55f18559fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 0x55f18559fb00 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec003780 tx=0x7fa6ec009260 comp rx=0 tx=0).stop 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa704ec7740 1 -- 172.21.15.53:0/1044375157 shutdown_connections 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f1851ad9f0 0x55f1855b1ed0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ef070 0x55f1855abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ce390 0x55f1855a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1044375157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 0x55f18559fb00 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa704ec7740 1 -- 172.21.15.53:0/1044375157 >> 172.21.15.53:0/1044375157 conn(0x55f1851e3460 msgr2=0x55f1855974e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa6d77fe640 0 client.19569 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa704ec7740 1 -- 172.21.15.53:0/1044375157 shutdown_connections 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa704ec7740 1 -- 172.21.15.53:0/1044375157 wait complete. 2024-08-31T06:17:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.395+0000 7fa704ec7740 20 client.19569 trim_cache size 0 max 16384 2024-08-31T06:17:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.410+0000 7fa704ec7740 1 Processor -- start 2024-08-31T06:17:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.410+0000 7fa704ec7740 1 -- start start 2024-08-31T06:17:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.410+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 0x55f185597450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.410+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ce390 0x55f185597990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.410+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 0x55f18559ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.410+0000 7fa704ec7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e400e8b0 con 0x55f1851c61b0 2024-08-31T06:17:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.410+0000 7fa704ec7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e4010600 con 0x55f1851ef070 2024-08-31T06:17:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.410+0000 7fa704ec7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e400ef80 con 0x55f1851ce390 2024-08-31T06:17:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 0x55f185597450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 0x55f185597450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34796/0 (socket says 172.21.15.53:34796) 2024-08-31T06:17:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f77fe640 1 -- 172.21.15.53:0/374959728 learned_addr learned my addr 172.21.15.53:0/374959728 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/374959728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ce390 0x55f185597990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/374959728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 0x55f18559ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f7fff640 1 -- 172.21.15.53:0/374959728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 msgr2=0x55f18559ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/374959728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 0x55f18559ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f7fff640 1 -- 172.21.15.53:0/374959728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 msgr2=0x55f185597450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/374959728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 0x55f185597450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f7fff640 1 -- 172.21.15.53:0/374959728 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1855a06e0 con 0x55f1851ce390 2024-08-31T06:17:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/374959728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 0x55f18559ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/374959728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ce390 0x55f185597990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6e802a860 tx=0x7fa6e8000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45cdf3e9115a0a8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6ddffb640 1 -- 172.21.15.53:0/374959728 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e804b040 con 0x55f1851ce390 2024-08-31T06:17:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6ddffb640 1 -- 172.21.15.53:0/374959728 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6e8030ab0 con 0x55f1851ce390 2024-08-31T06:17:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.411+0000 7fa6ddffb640 1 -- 172.21.15.53:0/374959728 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8003bc0 con 0x55f1851ce390 2024-08-31T06:17:40.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.412+0000 7fa704ec7740 1 -- 172.21.15.53:0/374959728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ce390 msgr2=0x55f185597990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:40.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.412+0000 7fa704ec7740 1 --2- 172.21.15.53:0/374959728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ce390 0x55f185597990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6e802a860 tx=0x7fa6e8000bc0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.412+0000 7fa704ec7740 1 -- 172.21.15.53:0/374959728 shutdown_connections 2024-08-31T06:17:40.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.412+0000 7fa704ec7740 1 --2- 172.21.15.53:0/374959728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851ef070 0x55f18559ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.412+0000 7fa704ec7740 1 --2- 172.21.15.53:0/374959728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ce390 0x55f185597990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.412+0000 7fa704ec7740 1 --2- 172.21.15.53:0/374959728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851c61b0 0x55f185597450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.412+0000 7fa704ec7740 1 -- 172.21.15.53:0/374959728 >> 172.21.15.53:0/374959728 conn(0x55f1851e3460 msgr2=0x55f18559e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.412+0000 7fa704ec7740 1 -- 172.21.15.53:0/374959728 shutdown_connections 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.412+0000 7fa704ec7740 1 -- 172.21.15.53:0/374959728 wait complete. 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.413+0000 7fa704ec7740 1 -- start start 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.413+0000 7fa704ec7740 1 Processor -- start 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.413+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851c61b0 0x55f1855a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.413+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 0x55f1855a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.413+0000 7fa704ec7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ef070 0x55f1855a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.413+0000 7fa704ec7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e400fe70 con 0x55f1851ce390 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.413+0000 7fa704ec7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e400f710 con 0x55f1851c61b0 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.413+0000 7fa704ec7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e400c8b0 con 0x55f1851ef070 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa704ec7740 10 client.0 _ll_register_callbacks cb 0x7fa6ec0035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 0x55f1855a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 0x55f1855a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34808/0 (socket says 172.21.15.53:34808) 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f7fff640 1 -- 172.21.15.53:0/1705056630 learned_addr learned my addr 172.21.15.53:0/1705056630 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851c61b0 0x55f1855a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ef070 0x55f1855a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f7fff640 1 -- 172.21.15.53:0/1705056630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ef070 msgr2=0x55f1855a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ef070 0x55f1855a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f7fff640 1 -- 172.21.15.53:0/1705056630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851c61b0 msgr2=0x55f1855a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851c61b0 0x55f1855a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f7fff640 1 -- 172.21.15.53:0/1705056630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f18561b8d0 con 0x55f1851ce390 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ef070 0x55f1855a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6f7fff640 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 0x55f1855a42b0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8005eb0 tx=0x7fa6e80040b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2858def323fbc84 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1705056630 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e804b040 con 0x55f1851ce390 2024-08-31T06:17:40.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa704ec7740 1 -- 172.21.15.53:0/1705056630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6e8030ab0 con 0x55f1851ce390 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.414+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1705056630 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7fa6e8030c60 con 0x55f1851ce390 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.415+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1705056630 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fa6e8064050 con 0x55f1851ce390 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.415+0000 7fa704ec7740 10 client.19575 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.415+0000 7fa704ec7740 1 -- 172.21.15.53:0/1705056630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55f18561ca30 con 0x55f1851ce390 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.415+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1705056630 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6e8030ab0 con 0x55f1851ce390 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.415+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1705056630 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7fa6e803a580 con 0x55f1851ce390 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.415+0000 7fa704ec7740 10 client.19575 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.415+0000 7fa704ec7740 10 client.19575 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.415+0000 7fa704ec7740 20 client.19575 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.415+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f185182da0 0x55f18561ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.415+0000 7fa704ec7740 4 client.19575 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.415+0000 7fa704ec7740 1 -- 172.21.15.53:0/1705056630 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1855067b0 con 0x55f185182da0 2024-08-31T06:17:40.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.416+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f185182da0 0x55f18561ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:40.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.416+0000 7fa6d77fe640 10 client.19575 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:17:40.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.416+0000 7fa6f77fe640 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f185182da0 0x55f18561ed70 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e1ded8dad366387b server_cookie=d0dab506c9de4fbf in_seq=0 out_seq=0 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.416+0000 7fa6d77fe640 1 -- 172.21.15.53:0/1705056630 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1855067b0 con 0x55f185182da0 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.416+0000 7fa6d77fe640 10 client.19575 handle_command_reply: tid=0 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.416+0000 7fa704ec7740 1 client.19575 shutdown 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa704ec7740 1 -- 172.21.15.53:0/1705056630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 msgr2=0x55f1855a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 0x55f1855a42b0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8005eb0 tx=0x7fa6e80040b0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa704ec7740 1 -- 172.21.15.53:0/1705056630 shutdown_connections 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f185182da0 0x55f18561ed70 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1851ef070 0x55f1855a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1851ce390 0x55f1855a42b0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa704ec7740 1 --2- 172.21.15.53:0/1705056630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f1851c61b0 0x55f1855a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa704ec7740 1 -- 172.21.15.53:0/1705056630 >> 172.21.15.53:0/1705056630 conn(0x55f1851e3460 msgr2=0x55f185597b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:40.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa6d77fe640 0 client.19575 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:17:40.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa704ec7740 1 -- 172.21.15.53:0/1705056630 shutdown_connections 2024-08-31T06:17:40.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa704ec7740 1 -- 172.21.15.53:0/1705056630 wait complete. 2024-08-31T06:17:40.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa704ec7740 20 client.19575 trim_cache size 0 max 16384 2024-08-31T06:17:40.424 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:17:40.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa6fe952640 1 -- 172.21.15.53:0/1795040637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6e00b4d20 msgr2=0x7fa6e00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:40.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa6fe952640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6e00b4d20 0x7fa6e00b7230 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00ab7a0 tx=0x7fa6f0095040 comp rx=0 tx=0).stop 2024-08-31T06:17:40.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa6fe952640 1 -- 172.21.15.53:0/1795040637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f810dbf0 msgr2=0x7fa6f806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:40.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.417+0000 7fa6fe952640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f810dbf0 0x7fa6f806e610 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000eaa0 tx=0x7fa6f000eea0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.418+0000 7fa6fe952640 1 -- 172.21.15.53:0/1795040637 shutdown_connections 2024-08-31T06:17:40.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.418+0000 7fa6fe952640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6e00b4d20 0x7fa6e00b7230 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.418+0000 7fa6fe952640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6f810dbf0 0x7fa6f806e610 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.418+0000 7fa6fe952640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6f8105070 0x7fa6f806df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.418+0000 7fa6fe952640 1 --2- 172.21.15.53:0/1795040637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f8104640 0x7fa6f8074cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:40.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.418+0000 7fa6fe952640 1 -- 172.21.15.53:0/1795040637 >> 172.21.15.53:0/1795040637 conn(0x7fa6f80794e0 msgr2=0x7fa6f81007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:40.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.418+0000 7fa6fe952640 1 -- 172.21.15.53:0/1795040637 shutdown_connections 2024-08-31T06:17:40.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:40.418+0000 7fa6fe952640 1 -- 172.21.15.53:0/1795040637 wait complete. 2024-08-31T06:17:41.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 193525 1.33 MB/sec execute 570 sec latency 49.617 ms 2024-08-31T06:17:41.303 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:17:41.582 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:17:41.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:41 smithi053 ceph-mon[18924]: pgmap v719: 97 pgs: 97 active+clean; 113 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 715 KiB/s wr, 67 op/s 2024-08-31T06:17:42.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 193995 1.33 MB/sec execute 571 sec latency 23.583 ms 2024-08-31T06:17:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.102+0000 7fd950475640 1 -- 172.21.15.53:0/3682784356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94810dbd0 msgr2=0x7fd9481100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.102+0000 7fd950475640 1 --2- 172.21.15.53:0/3682784356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94810dbd0 0x7fd9481100c0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd940009ca0 tx=0x7fd94002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.102+0000 7fd950475640 1 -- 172.21.15.53:0/3682784356 shutdown_connections 2024-08-31T06:17:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.102+0000 7fd950475640 1 --2- 172.21.15.53:0/3682784356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94810dbd0 0x7fd9481100c0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.102+0000 7fd950475640 1 --2- 172.21.15.53:0/3682784356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9481050c0 0x7fd94810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.102+0000 7fd950475640 1 --2- 172.21.15.53:0/3682784356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948104770 0x7fd948104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.103+0000 7fd950475640 1 -- 172.21.15.53:0/3682784356 >> 172.21.15.53:0/3682784356 conn(0x7fd9480794e0 msgr2=0x7fd9480798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.103+0000 7fd950475640 1 -- 172.21.15.53:0/3682784356 shutdown_connections 2024-08-31T06:17:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.103+0000 7fd950475640 1 -- 172.21.15.53:0/3682784356 wait complete. 2024-08-31T06:17:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.103+0000 7fd950475640 1 Processor -- start 2024-08-31T06:17:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.103+0000 7fd950475640 1 -- start start 2024-08-31T06:17:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd950475640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948104770 0x7fd94819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd950475640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9481050c0 0x7fd94819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd950475640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94810dbd0 0x7fd94819f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd950475640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd948113750 con 0x7fd9481050c0 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd950475640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd9481135d0 con 0x7fd948104770 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd950475640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9481138d0 con 0x7fd94810dbd0 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94e211640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948104770 0x7fd94819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94da10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9481050c0 0x7fd94819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94e211640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948104770 0x7fd94819a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53016/0 (socket says 172.21.15.53:53016) 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94e211640 1 -- 172.21.15.53:0/3439203802 learned_addr learned my addr 172.21.15.53:0/3439203802 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94da10640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9481050c0 0x7fd94819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34818/0 (socket says 172.21.15.53:34818) 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94da10640 1 -- 172.21.15.53:0/3439203802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94810dbd0 msgr2=0x7fd94819f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94ea12640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94810dbd0 0x7fd94819f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94da10640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94810dbd0 0x7fd94819f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94da10640 1 -- 172.21.15.53:0/3439203802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948104770 msgr2=0x7fd94819a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94da10640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948104770 0x7fd94819a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94da10640 1 -- 172.21.15.53:0/3439203802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9481a00d0 con 0x7fd9481050c0 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94e211640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948104770 0x7fd94819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.104+0000 7fd94da10640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9481050c0 0x7fd94819a700 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd94806b6f0 tx=0x7fd93800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.105+0000 7fd93f7fe640 1 -- 172.21.15.53:0/3439203802 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93800cc40 con 0x7fd9481050c0 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.105+0000 7fd93f7fe640 1 -- 172.21.15.53:0/3439203802 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd93800cde0 con 0x7fd9481050c0 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.105+0000 7fd93f7fe640 1 -- 172.21.15.53:0/3439203802 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938004800 con 0x7fd9481050c0 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.105+0000 7fd950475640 1 -- 172.21.15.53:0/3439203802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9481a03c0 con 0x7fd9481050c0 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.105+0000 7fd950475640 1 -- 172.21.15.53:0/3439203802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9481a6b20 con 0x7fd9481050c0 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.108+0000 7fd9569ea740 1 Processor -- start 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.108+0000 7fd93f7fe640 1 -- 172.21.15.53:0/3439203802 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd938004a20 con 0x7fd9481050c0 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.108+0000 7fd9569ea740 1 -- start start 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.108+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 0x56447e367310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.108+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447df991b0 0x56447e367850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.108+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 0x56447e367d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.108+0000 7fd9569ea740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56447e2de680 con 0x56447dfa1390 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.108+0000 7fd9569ea740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56447e2cdc10 con 0x56447df991b0 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.108+0000 7fd9569ea740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56447e2d1bc0 con 0x56447dfc2070 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94da10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 0x56447e367d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94ea12640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 0x56447e367310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94e211640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447df991b0 0x56447e367850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94da10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 0x56447e367d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34828/0 (socket says 172.21.15.53:34828) 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94da10640 1 -- 172.21.15.53:0/3167855133 learned_addr learned my addr 172.21.15.53:0/3167855133 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94ea12640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 0x56447e367310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:39864/0 (socket says 172.21.15.53:39864) 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94ea12640 1 -- 172.21.15.53:0/3167855133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447df991b0 msgr2=0x56447e367850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94ea12640 1 --2- 172.21.15.53:0/3167855133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447df991b0 0x56447e367850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94ea12640 1 -- 172.21.15.53:0/3167855133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 msgr2=0x56447e367d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94ea12640 1 --2- 172.21.15.53:0/3167855133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 0x56447e367d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94ea12640 1 -- 172.21.15.53:0/3167855133 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56447e02d650 con 0x56447dfc2070 2024-08-31T06:17:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd93f7fe640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4df0 0x7fd9340b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94e211640 1 --2- 172.21.15.53:0/3167855133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447df991b0 0x56447e367850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94e211640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4df0 0x7fd9340b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd93f7fe640 1 -- 172.21.15.53:0/3439203802 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7fd9380e5450 con 0x7fd9481050c0 2024-08-31T06:17:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.109+0000 7fd94ea12640 1 --2- 172.21.15.53:0/3167855133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 0x56447e367310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd940005cc0 tx=0x7fd940009910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5686b80df34dd8f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.110+0000 7fd93cd9a640 1 -- 172.21.15.53:0/3167855133 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9400316d0 con 0x56447dfc2070 2024-08-31T06:17:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.110+0000 7fd93cd9a640 1 -- 172.21.15.53:0/3167855133 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd940036070 con 0x56447dfc2070 2024-08-31T06:17:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.110+0000 7fd93cd9a640 1 -- 172.21.15.53:0/3167855133 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9400042a0 con 0x56447dfc2070 2024-08-31T06:17:42.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.111+0000 7fd9569ea740 1 -- 172.21.15.53:0/3167855133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 msgr2=0x56447e367310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.111+0000 7fd94e211640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4df0 0x7fd9340b7300 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x56447e365f90 tx=0x7fd944005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.111+0000 7fd9569ea740 1 --2- 172.21.15.53:0/3167855133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 0x56447e367310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd940005cc0 tx=0x7fd940009910 comp rx=0 tx=0).stop 2024-08-31T06:17:42.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.111+0000 7fd9569ea740 1 -- 172.21.15.53:0/3167855133 shutdown_connections 2024-08-31T06:17:42.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.111+0000 7fd9569ea740 1 --2- 172.21.15.53:0/3167855133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 0x56447e367d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.111+0000 7fd9569ea740 1 --2- 172.21.15.53:0/3167855133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447df991b0 0x56447e367850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.111+0000 7fd9569ea740 1 --2- 172.21.15.53:0/3167855133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 0x56447e367310 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.111+0000 7fd9569ea740 1 -- 172.21.15.53:0/3167855133 >> 172.21.15.53:0/3167855133 conn(0x56447dfb6460 msgr2=0x56447e365200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.111+0000 7fd9569ea740 1 -- 172.21.15.53:0/3167855133 shutdown_connections 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.111+0000 7fd9569ea740 1 -- 172.21.15.53:0/3167855133 wait complete. 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd9569ea740 1 -- start start 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd9569ea740 1 Processor -- start 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447df991b0 0x56447e372b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 0x56447e3730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 0x56447e37ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd9569ea740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56447e130700 con 0x56447dfa1390 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd9569ea740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56447e254750 con 0x56447df991b0 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd9569ea740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56447e375a90 con 0x56447dfc2070 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd9569ea740 10 client.0 _ll_register_callbacks cb 0x56447e283e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd94da10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 0x56447e3730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd94da10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 0x56447e3730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34836/0 (socket says 172.21.15.53:34836) 2024-08-31T06:17:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd94da10640 1 -- 172.21.15.53:0/2514357332 learned_addr learned my addr 172.21.15.53:0/2514357332 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd94ea12640 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 0x56447e37ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.112+0000 7fd94e211640 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447df991b0 0x56447e372b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd94da10640 1 -- 172.21.15.53:0/2514357332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 msgr2=0x56447e37ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd94da10640 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 0x56447e37ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd94da10640 1 -- 172.21.15.53:0/2514357332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447df991b0 msgr2=0x56447e372b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd94da10640 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447df991b0 0x56447e372b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd94da10640 1 -- 172.21.15.53:0/2514357332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56447e28d900 con 0x56447dfa1390 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd94da10640 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 0x56447e3730a0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fd9380e2c30 tx=0x7fd9380096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cc59cb090624e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd931ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd931ffb640 1 -- 172.21.15.53:0/2514357332 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93801c040 con 0x56447dfa1390 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd931ffb640 1 -- 172.21.15.53:0/2514357332 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7fd9380a7db0 con 0x56447dfa1390 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd9569ea740 1 -- 172.21.15.53:0/2514357332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd940036070 con 0x56447dfa1390 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd931ffb640 1 -- 172.21.15.53:0/2514357332 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fd9380ab290 con 0x56447dfa1390 2024-08-31T06:17:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd9569ea740 10 client.19587 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.113+0000 7fd9569ea740 1 -- 172.21.15.53:0/2514357332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x56447e381950 con 0x56447dfa1390 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.114+0000 7fd931ffb640 1 -- 172.21.15.53:0/2514357332 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd940036070 con 0x56447dfa1390 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.114+0000 7fd931ffb640 1 -- 172.21.15.53:0/2514357332 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7fd9380b49b0 con 0x56447dfa1390 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.114+0000 7fd9569ea740 10 client.19587 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.114+0000 7fd9569ea740 10 client.19587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.114+0000 7fd9569ea740 20 client.19587 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.114+0000 7fd9569ea740 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56447df809f0 0x56447e384e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.114+0000 7fd9569ea740 4 client.19587 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.114+0000 7fd9569ea740 1 -- 172.21.15.53:0/2514357332 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56447e2e05d0 con 0x56447df809f0 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.114+0000 7fd94e211640 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56447df809f0 0x56447e384e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.115+0000 7fd931ffb640 10 client.19587 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.115+0000 7fd94e211640 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56447df809f0 0x56447e384e90 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f17b39b95c2c65f5 server_cookie=e366a845c3cbeffb in_seq=0 out_seq=0 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.115+0000 7fd931ffb640 1 -- 172.21.15.53:0/2514357332 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56447e2e05d0 con 0x56447df809f0 2024-08-31T06:17:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.115+0000 7fd931ffb640 10 client.19587 handle_command_reply: tid=0 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.115+0000 7fd9569ea740 1 client.19587 shutdown 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.115+0000 7fd9569ea740 1 -- 172.21.15.53:0/2514357332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 msgr2=0x56447e3730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.115+0000 7fd9569ea740 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 0x56447e3730a0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fd9380e2c30 tx=0x7fd9380096e0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.116+0000 7fd9569ea740 1 -- 172.21.15.53:0/2514357332 shutdown_connections 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.116+0000 7fd9569ea740 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56447df809f0 0x56447e384e90 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.116+0000 7fd9569ea740 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfc2070 0x56447e37ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.116+0000 7fd9569ea740 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447dfa1390 0x56447e3730a0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.116+0000 7fd9569ea740 1 --2- 172.21.15.53:0/2514357332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447df991b0 0x56447e372b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.116+0000 7fd9569ea740 1 -- 172.21.15.53:0/2514357332 >> 172.21.15.53:0/2514357332 conn(0x56447dfb6460 msgr2=0x56447e36a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.116+0000 7fd931ffb640 0 client.19587 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.116+0000 7fd9569ea740 1 -- 172.21.15.53:0/2514357332 shutdown_connections 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.116+0000 7fd9569ea740 1 -- 172.21.15.53:0/2514357332 wait complete. 2024-08-31T06:17:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.116+0000 7fd9569ea740 20 client.19587 trim_cache size 0 max 16384 2024-08-31T06:17:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:41 smithi130 ceph-mon[22266]: pgmap v719: 97 pgs: 97 active+clean; 113 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 715 KiB/s wr, 67 op/s 2024-08-31T06:17:42.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd9569ea740 1 Processor -- start 2024-08-31T06:17:42.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd9569ea740 1 -- start start 2024-08-31T06:17:42.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e36a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfa1390 0x56447e36a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447dfc2070 0x56447e36fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd9569ea740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd9481af400 con 0x56447df991b0 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd9569ea740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd9481b1150 con 0x56447dfc2070 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd9569ea740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9481afad0 con 0x56447dfa1390 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd94e211640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e36a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd94da10640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfa1390 0x56447e36a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd94e211640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e36a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34840/0 (socket says 172.21.15.53:34840) 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd94e211640 1 -- 172.21.15.53:0/1438957662 learned_addr learned my addr 172.21.15.53:0/1438957662 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.133+0000 7fd94ea12640 1 --2- 172.21.15.53:0/1438957662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447dfc2070 0x56447e36fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.134+0000 7fd94e211640 1 -- 172.21.15.53:0/1438957662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfa1390 msgr2=0x56447e36a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.134+0000 7fd94e211640 1 --2- 172.21.15.53:0/1438957662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfa1390 0x56447e36a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.134+0000 7fd94e211640 1 -- 172.21.15.53:0/1438957662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447dfc2070 msgr2=0x56447e36fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.134+0000 7fd94e211640 1 --2- 172.21.15.53:0/1438957662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447dfc2070 0x56447e36fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.134+0000 7fd94e211640 1 -- 172.21.15.53:0/1438957662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56447e3737b0 con 0x56447df991b0 2024-08-31T06:17:42.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.134+0000 7fd94da10640 1 --2- 172.21.15.53:0/1438957662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfa1390 0x56447e36a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:42.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.134+0000 7fd94e211640 1 --2- 172.21.15.53:0/1438957662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e36a410 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fd944004340 tx=0x7fd94401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acba65f550142d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.134+0000 7fd933fff640 1 -- 172.21.15.53:0/1438957662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944004370 con 0x56447df991b0 2024-08-31T06:17:42.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.134+0000 7fd933fff640 1 -- 172.21.15.53:0/1438957662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd944003e80 con 0x56447df991b0 2024-08-31T06:17:42.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.134+0000 7fd933fff640 1 -- 172.21.15.53:0/1438957662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9440047a0 con 0x56447df991b0 2024-08-31T06:17:42.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.135+0000 7fd9569ea740 1 -- 172.21.15.53:0/1438957662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 msgr2=0x56447e36a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.135+0000 7fd9569ea740 1 --2- 172.21.15.53:0/1438957662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e36a410 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fd944004340 tx=0x7fd94401b000 comp rx=0 tx=0).stop 2024-08-31T06:17:42.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.135+0000 7fd9569ea740 1 -- 172.21.15.53:0/1438957662 shutdown_connections 2024-08-31T06:17:42.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.135+0000 7fd9569ea740 1 --2- 172.21.15.53:0/1438957662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447dfc2070 0x56447e36fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.135+0000 7fd9569ea740 1 --2- 172.21.15.53:0/1438957662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfa1390 0x56447e36a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.135+0000 7fd9569ea740 1 --2- 172.21.15.53:0/1438957662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e36a410 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.135+0000 7fd9569ea740 1 -- 172.21.15.53:0/1438957662 >> 172.21.15.53:0/1438957662 conn(0x56447dfb6460 msgr2=0x56447e3713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.135+0000 7fd9569ea740 1 -- 172.21.15.53:0/1438957662 shutdown_connections 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.135+0000 7fd9569ea740 1 -- 172.21.15.53:0/1438957662 wait complete. 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd9569ea740 1 -- start start 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd9569ea740 1 Processor -- start 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e37ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfa1390 0x56447e37b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd9569ea740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447dfc2070 0x56447e3e8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd9569ea740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd9481b09c0 con 0x56447df991b0 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd9569ea740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd9481b0260 con 0x56447dfc2070 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd9569ea740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9481ad400 con 0x56447dfa1390 2024-08-31T06:17:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd9569ea740 10 client.0 _ll_register_callbacks cb 0x7fd9380046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd94e211640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e37ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd94e211640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e37ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34842/0 (socket says 172.21.15.53:34842) 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd94e211640 1 -- 172.21.15.53:0/43108215 learned_addr learned my addr 172.21.15.53:0/43108215 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd94ea12640 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447dfc2070 0x56447e3e8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.136+0000 7fd94da10640 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfa1390 0x56447e37b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd94e211640 1 -- 172.21.15.53:0/43108215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfa1390 msgr2=0x56447e37b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd94e211640 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfa1390 0x56447e37b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd94e211640 1 -- 172.21.15.53:0/43108215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447dfc2070 msgr2=0x56447e3e8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd94e211640 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447dfc2070 0x56447e3e8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd94e211640 1 -- 172.21.15.53:0/43108215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56447e37b7e0 con 0x56447df991b0 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd94e211640 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e37ace0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fd944019040 tx=0x7fd944009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c364db5e176bdc16 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd931ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd931ffb640 1 -- 172.21.15.53:0/43108215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944005420 con 0x56447df991b0 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd931ffb640 1 -- 172.21.15.53:0/43108215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7fd9440055c0 con 0x56447df991b0 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd9569ea740 1 -- 172.21.15.53:0/43108215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd944003e80 con 0x56447df991b0 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd931ffb640 1 -- 172.21.15.53:0/43108215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fd944049050 con 0x56447df991b0 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd9569ea740 10 client.19593 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.137+0000 7fd9569ea740 1 -- 172.21.15.53:0/43108215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x56447e3f3fd0 con 0x56447df991b0 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.138+0000 7fd931ffb640 1 -- 172.21.15.53:0/43108215 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd944003e80 con 0x56447df991b0 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.138+0000 7fd931ffb640 1 -- 172.21.15.53:0/43108215 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7fd94402b420 con 0x56447df991b0 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.138+0000 7fd9569ea740 10 client.19593 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.138+0000 7fd9569ea740 10 client.19593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.138+0000 7fd9569ea740 20 client.19593 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.138+0000 7fd9569ea740 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56447df55da0 0x56447e3f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.138+0000 7fd9569ea740 4 client.19593 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.138+0000 7fd9569ea740 1 -- 172.21.15.53:0/43108215 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56447e2dc070 con 0x56447df55da0 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.138+0000 7fd94da10640 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56447df55da0 0x56447e3f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd94da10640 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56447df55da0 0x56447e3f67c0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a6d3860a76d62ce server_cookie=548759a1b1ff2c22 in_seq=0 out_seq=0 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd931ffb640 10 client.19593 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd931ffb640 1 -- 172.21.15.53:0/43108215 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56447e2dc070 con 0x56447df55da0 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd931ffb640 10 client.19593 handle_command_reply: tid=0 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd9569ea740 1 client.19593 shutdown 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd9569ea740 1 -- 172.21.15.53:0/43108215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 msgr2=0x56447e37ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd9569ea740 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e37ace0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fd944019040 tx=0x7fd944009e80 comp rx=0 tx=0).stop 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd9569ea740 1 -- 172.21.15.53:0/43108215 shutdown_connections 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd9569ea740 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56447df55da0 0x56447e3f67c0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd9569ea740 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56447dfc2070 0x56447e3e8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd9569ea740 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56447dfa1390 0x56447e37b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd9569ea740 1 --2- 172.21.15.53:0/43108215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56447df991b0 0x56447e37ace0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd9569ea740 1 -- 172.21.15.53:0/43108215 >> 172.21.15.53:0/43108215 conn(0x56447dfb6460 msgr2=0x56447e36a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd931ffb640 0 client.19593 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd9569ea740 1 -- 172.21.15.53:0/43108215 shutdown_connections 2024-08-31T06:17:42.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.139+0000 7fd9569ea740 1 -- 172.21.15.53:0/43108215 wait complete. 2024-08-31T06:17:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd9569ea740 20 client.19593 trim_cache size 0 max 16384 2024-08-31T06:17:42.147 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:17:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 -- 172.21.15.53:0/3439203802 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4df0 msgr2=0x7fd9340b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4df0 0x7fd9340b7300 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x56447e365f90 tx=0x7fd944005f90 comp rx=0 tx=0).stop 2024-08-31T06:17:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 -- 172.21.15.53:0/3439203802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9481050c0 msgr2=0x7fd94819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9481050c0 0x7fd94819a700 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd94806b6f0 tx=0x7fd93800ee50 comp rx=0 tx=0).stop 2024-08-31T06:17:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 -- 172.21.15.53:0/3439203802 shutdown_connections 2024-08-31T06:17:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4df0 0x7fd9340b7300 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94810dbd0 0x7fd94819f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9481050c0 0x7fd94819a700 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 --2- 172.21.15.53:0/3439203802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948104770 0x7fd94819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 -- 172.21.15.53:0/3439203802 >> 172.21.15.53:0/3439203802 conn(0x7fd9480794e0 msgr2=0x7fd9480ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 -- 172.21.15.53:0/3439203802 shutdown_connections 2024-08-31T06:17:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:42.140+0000 7fd950475640 1 -- 172.21.15.53:0/3439203802 wait complete. 2024-08-31T06:17:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:41 smithi153 ceph-mon[22320]: pgmap v719: 97 pgs: 97 active+clean; 113 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 715 KiB/s wr, 67 op/s 2024-08-31T06:17:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.620+0000 7f819f626640 1 -- 172.21.15.53:0/779792520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8198101f20 msgr2=0x7f8198102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.620+0000 7f819f626640 1 --2- 172.21.15.53:0/779792520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8198101f20 0x7f8198102330 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f8194009900 tx=0x7f819402a410 comp rx=0 tx=0).stop 2024-08-31T06:17:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.620+0000 7f819f626640 1 -- 172.21.15.53:0/779792520 shutdown_connections 2024-08-31T06:17:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.620+0000 7f819f626640 1 --2- 172.21.15.53:0/779792520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81981081a0 0x7f819810e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.620+0000 7f819f626640 1 --2- 172.21.15.53:0/779792520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8198107850 0x7f8198107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.620+0000 7f819f626640 1 --2- 172.21.15.53:0/779792520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8198101f20 0x7f8198102330 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.620+0000 7f819f626640 1 -- 172.21.15.53:0/779792520 >> 172.21.15.53:0/779792520 conn(0x7f8198079c30 msgr2=0x7f819807a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.620+0000 7f819f626640 1 -- 172.21.15.53:0/779792520 shutdown_connections 2024-08-31T06:17:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.620+0000 7f819f626640 1 -- 172.21.15.53:0/779792520 wait complete. 2024-08-31T06:17:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.621+0000 7f819f626640 1 Processor -- start 2024-08-31T06:17:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.621+0000 7f819f626640 1 -- start start 2024-08-31T06:17:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.622+0000 7f819f626640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8198101f20 0x7f8198199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.622+0000 7f819f626640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8198107850 0x7f8198199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.622+0000 7f819f626640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81981081a0 0x7f819819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.622+0000 7f819f626640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8198112590 con 0x7f8198107850 2024-08-31T06:17:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.622+0000 7f819f626640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8198112410 con 0x7f8198101f20 2024-08-31T06:17:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.622+0000 7f819f626640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8198112710 con 0x7f81981081a0 2024-08-31T06:17:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.622+0000 7f819cbc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8198107850 0x7f8198199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.622+0000 7f819dbc3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81981081a0 0x7f819819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.623+0000 7f819dbc3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81981081a0 0x7f819819e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:39898/0 (socket says 172.21.15.53:39898) 2024-08-31T06:17:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.623+0000 7f819dbc3640 1 -- 172.21.15.53:0/2116983065 learned_addr learned my addr 172.21.15.53:0/2116983065 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.623+0000 7f819d3c2640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8198101f20 0x7f8198199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.623+0000 7f819cbc1640 1 -- 172.21.15.53:0/2116983065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81981081a0 msgr2=0x7f819819e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.623+0000 7f819cbc1640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81981081a0 0x7f819819e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.623+0000 7f819cbc1640 1 -- 172.21.15.53:0/2116983065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8198101f20 msgr2=0x7f8198199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.623+0000 7f819cbc1640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8198101f20 0x7f8198199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.623+0000 7f819cbc1640 1 -- 172.21.15.53:0/2116983065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819819efa0 con 0x7f8198107850 2024-08-31T06:17:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.623+0000 7f819dbc3640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81981081a0 0x7f819819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.624+0000 7f819cbc1640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8198107850 0x7f8198199610 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f81980756d0 tx=0x7f818800b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.624+0000 7f818e7fc640 1 -- 172.21.15.53:0/2116983065 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818801e070 con 0x7f8198107850 2024-08-31T06:17:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.624+0000 7f818e7fc640 1 -- 172.21.15.53:0/2116983065 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81880198a0 con 0x7f8198107850 2024-08-31T06:17:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.624+0000 7f818e7fc640 1 -- 172.21.15.53:0/2116983065 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8188018610 con 0x7f8198107850 2024-08-31T06:17:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.624+0000 7f819f626640 1 -- 172.21.15.53:0/2116983065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f819819f290 con 0x7f8198107850 2024-08-31T06:17:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.624+0000 7f819f626640 1 -- 172.21.15.53:0/2116983065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f819810f390 con 0x7f8198107850 2024-08-31T06:17:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f81a6665740 1 Processor -- start 2024-08-31T06:17:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f81a6665740 1 -- start start 2024-08-31T06:17:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f81a6665740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061ee1b0 0x55bb06591ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f81a6665740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb06592220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f81a6665740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 0x55bb06592760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f81a6665740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb06507000 con 0x55bb061cd4d0 2024-08-31T06:17:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f81a6665740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bb064f6590 con 0x55bb061ee1b0 2024-08-31T06:17:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f81a6665740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bb064fa540 con 0x55bb061c52f0 2024-08-31T06:17:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f818e7fc640 1 -- 172.21.15.53:0/2116983065 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8188021070 con 0x7f8198107850 2024-08-31T06:17:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f819d3c2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb06592220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f819d3c2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb06592220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:39912/0 (socket says 172.21.15.53:39912) 2024-08-31T06:17:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f819d3c2640 1 -- 172.21.15.53:0/3068412760 learned_addr learned my addr 172.21.15.53:0/3068412760 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f819cbc1640 1 --2- 172.21.15.53:0/3068412760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 0x55bb06592760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.628+0000 7f819dbc3640 1 --2- 172.21.15.53:0/3068412760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061ee1b0 0x55bb06591ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.629+0000 7f819cbc1640 1 -- 172.21.15.53:0/3068412760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 msgr2=0x55bb06592220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.629+0000 7f819cbc1640 1 --2- 172.21.15.53:0/3068412760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb06592220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.629+0000 7f819cbc1640 1 -- 172.21.15.53:0/3068412760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061ee1b0 msgr2=0x55bb06591ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.629+0000 7f819cbc1640 1 --2- 172.21.15.53:0/3068412760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061ee1b0 0x55bb06591ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.629+0000 7f819cbc1640 1 -- 172.21.15.53:0/3068412760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb06259790 con 0x55bb061cd4d0 2024-08-31T06:17:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.629+0000 7f819d3c2640 1 --2- 172.21.15.53:0/3068412760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb06592220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.629+0000 7f819cbc1640 1 --2- 172.21.15.53:0/3068412760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 0x55bb06592760 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f81880e6360 tx=0x7f81880f1760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff8be26e7385217 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.629+0000 7f818e7fc640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f81840b4d20 0x7f81840b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.630+0000 7f81837fe640 1 -- 172.21.15.53:0/3068412760 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81880aba00 con 0x55bb061cd4d0 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.630+0000 7f819dbc3640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f81840b4d20 0x7f81840b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.630+0000 7f81837fe640 1 -- 172.21.15.53:0/3068412760 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81880f6070 con 0x55bb061cd4d0 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.630+0000 7f81837fe640 1 -- 172.21.15.53:0/3068412760 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81880aeb20 con 0x55bb061cd4d0 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.630+0000 7f818e7fc640 1 -- 172.21.15.53:0/2116983065 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f81880e8c30 con 0x7f8198107850 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f81a6665740 1 -- 172.21.15.53:0/3068412760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 msgr2=0x55bb06592760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f819dbc3640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f81840b4d20 0x7f81840b7230 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f81900049d0 tx=0x7f8190010040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f81a6665740 1 --2- 172.21.15.53:0/3068412760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 0x55bb06592760 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f81880e6360 tx=0x7f81880f1760 comp rx=0 tx=0).stop 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f81a6665740 1 -- 172.21.15.53:0/3068412760 shutdown_connections 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f81a6665740 1 --2- 172.21.15.53:0/3068412760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 0x55bb06592760 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f81a6665740 1 --2- 172.21.15.53:0/3068412760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb06592220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f81a6665740 1 --2- 172.21.15.53:0/3068412760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061ee1b0 0x55bb06591ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f81a6665740 1 -- 172.21.15.53:0/3068412760 >> 172.21.15.53:0/3068412760 conn(0x55bb061e2300 msgr2=0x55bb0658fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f81a6665740 1 -- 172.21.15.53:0/3068412760 shutdown_connections 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f81a6665740 1 -- 172.21.15.53:0/3068412760 wait complete. 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f81a6665740 1 -- start start 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.631+0000 7f81a6665740 1 Processor -- start 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f81a6665740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061c52f0 0x55bb0659d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f81a6665740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061cd4d0 0x55bb0659deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f81a6665740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061ee1b0 0x55bb065a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f81a6665740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb0642fab0 con 0x55bb061ee1b0 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f81a6665740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bb0647d680 con 0x55bb061c52f0 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f81a6665740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bb065a0460 con 0x55bb061cd4d0 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f81a6665740 10 client.0 _ll_register_callbacks cb 0x55bb06205a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f819cbc1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061cd4d0 0x55bb0659deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f819dbc3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061ee1b0 0x55bb065a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f819cbc1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061cd4d0 0x55bb0659deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:39918/0 (socket says 172.21.15.53:39918) 2024-08-31T06:17:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f819cbc1640 1 -- 172.21.15.53:0/3893541036 learned_addr learned my addr 172.21.15.53:0/3893541036 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f819d3c2640 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061c52f0 0x55bb0659d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f819cbc1640 1 -- 172.21.15.53:0/3893541036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061c52f0 msgr2=0x55bb0659d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f819cbc1640 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061c52f0 0x55bb0659d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f819cbc1640 1 -- 172.21.15.53:0/3893541036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061ee1b0 msgr2=0x55bb065a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f819cbc1640 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061ee1b0 0x55bb065a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.632+0000 7f819cbc1640 1 -- 172.21.15.53:0/3893541036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb062d2620 con 0x55bb061cd4d0 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.633+0000 7f819dbc3640 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061ee1b0 0x55bb065a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.633+0000 7f819d3c2640 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061c52f0 0x55bb0659d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.633+0000 7f819cbc1640 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061cd4d0 0x55bb0659deb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f81880ac620 tx=0x7f81880e8f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb5da1b312d36c5d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.633+0000 7f8180ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.633+0000 7f8180ff9640 1 -- 172.21.15.53:0/3893541036 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81880aed00 con 0x55bb061cd4d0 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.633+0000 7f8180ff9640 1 -- 172.21.15.53:0/3893541036 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f81880d2070 con 0x55bb061cd4d0 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.633+0000 7f81a6665740 1 -- 172.21.15.53:0/3893541036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81880f6070 con 0x55bb061cd4d0 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.633+0000 7f8180ff9640 1 -- 172.21.15.53:0/3893541036 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f81880aeef0 con 0x55bb061cd4d0 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.633+0000 7f81a6665740 10 client.28648 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.633+0000 7f81a6665740 1 -- 172.21.15.53:0/3893541036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55bb065ac4f0 con 0x55bb061cd4d0 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.633+0000 7f8180ff9640 1 -- 172.21.15.53:0/3893541036 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81880f6070 con 0x55bb061cd4d0 2024-08-31T06:17:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.634+0000 7f8180ff9640 1 -- 172.21.15.53:0/3893541036 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f81880ee050 con 0x55bb061cd4d0 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.634+0000 7f81a6665740 10 client.28648 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.634+0000 7f81a6665740 10 client.28648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.634+0000 7f81a6665740 20 client.28648 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.634+0000 7f81a6665740 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb061acd80 0x55bb065af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.634+0000 7f81a6665740 4 client.28648 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.634+0000 7f81a6665740 1 -- 172.21.15.53:0/3893541036 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb06508f50 con 0x55bb061acd80 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.634+0000 7f819d3c2640 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb061acd80 0x55bb065af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.634+0000 7f8180ff9640 10 client.28648 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.634+0000 7f819d3c2640 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb061acd80 0x55bb065af850 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f23092b8dd3a351 server_cookie=933c7de283e9ad8b in_seq=0 out_seq=0 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f8180ff9640 1 -- 172.21.15.53:0/3893541036 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb06508f50 con 0x55bb061acd80 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f8180ff9640 10 client.28648 handle_command_reply: tid=0 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f81a6665740 1 client.28648 shutdown 2024-08-31T06:17:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f81a6665740 1 -- 172.21.15.53:0/3893541036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061cd4d0 msgr2=0x55bb0659deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f81a6665740 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061cd4d0 0x55bb0659deb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f81880ac620 tx=0x7f81880e8f00 comp rx=0 tx=0).stop 2024-08-31T06:17:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f81a6665740 1 -- 172.21.15.53:0/3893541036 shutdown_connections 2024-08-31T06:17:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f81a6665740 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb061acd80 0x55bb065af850 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f81a6665740 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061ee1b0 0x55bb065a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f8180ff9640 0 client.28648 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f81a6665740 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061cd4d0 0x55bb0659deb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f81a6665740 1 --2- 172.21.15.53:0/3893541036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061c52f0 0x55bb0659d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.635+0000 7f81a6665740 1 -- 172.21.15.53:0/3893541036 >> 172.21.15.53:0/3893541036 conn(0x55bb061e2300 msgr2=0x55bb06592d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.636+0000 7f81a6665740 1 -- 172.21.15.53:0/3893541036 shutdown_connections 2024-08-31T06:17:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.636+0000 7f81a6665740 1 -- 172.21.15.53:0/3893541036 wait complete. 2024-08-31T06:17:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.636+0000 7f81a6665740 20 client.28648 trim_cache size 0 max 16384 2024-08-31T06:17:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.652+0000 7f81a6665740 1 Processor -- start 2024-08-31T06:17:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.652+0000 7f81a6665740 1 -- start start 2024-08-31T06:17:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.652+0000 7f81a6665740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061acd80 0x55bb0659d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.652+0000 7f81a6665740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061c52f0 0x55bb06597db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.652+0000 7f81a6665740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061cd4d0 0x55bb0659a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.652+0000 7f81a6665740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f81981ad170 con 0x55bb061c52f0 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.652+0000 7f81a6665740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f81981aeec0 con 0x55bb061cd4d0 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.652+0000 7f81a6665740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f81981ad840 con 0x55bb061acd80 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.652+0000 7f819cbc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061c52f0 0x55bb06597db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.652+0000 7f819cbc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061c52f0 0x55bb06597db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34870/0 (socket says 172.21.15.53:34870) 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.652+0000 7f819cbc1640 1 -- 172.21.15.53:0/2070050068 learned_addr learned my addr 172.21.15.53:0/2070050068 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.653+0000 7f819dbc3640 1 --2- 172.21.15.53:0/2070050068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061cd4d0 0x55bb0659a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.653+0000 7f819d3c2640 1 --2- 172.21.15.53:0/2070050068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061acd80 0x55bb0659d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.653+0000 7f819cbc1640 1 -- 172.21.15.53:0/2070050068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061acd80 msgr2=0x55bb0659d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.653+0000 7f819cbc1640 1 --2- 172.21.15.53:0/2070050068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061acd80 0x55bb0659d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.653+0000 7f819cbc1640 1 -- 172.21.15.53:0/2070050068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061cd4d0 msgr2=0x55bb0659a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.653+0000 7f819cbc1640 1 --2- 172.21.15.53:0/2070050068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061cd4d0 0x55bb0659a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.653+0000 7f819cbc1640 1 -- 172.21.15.53:0/2070050068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb0658aaa0 con 0x55bb061c52f0 2024-08-31T06:17:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.653+0000 7f819dbc3640 1 --2- 172.21.15.53:0/2070050068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061cd4d0 0x55bb0659a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.653+0000 7f819cbc1640 1 --2- 172.21.15.53:0/2070050068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061c52f0 0x55bb06597db0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f81880aeec0 tx=0x7f81880e8f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb7a856e83ce5e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.653+0000 7f8182ffd640 1 -- 172.21.15.53:0/2070050068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81880af180 con 0x55bb061c52f0 2024-08-31T06:17:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.654+0000 7f8182ffd640 1 -- 172.21.15.53:0/2070050068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81880f6020 con 0x55bb061c52f0 2024-08-31T06:17:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.654+0000 7f8182ffd640 1 -- 172.21.15.53:0/2070050068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81880aad20 con 0x55bb061c52f0 2024-08-31T06:17:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.655+0000 7f81a6665740 1 -- 172.21.15.53:0/2070050068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061c52f0 msgr2=0x55bb06597db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.655+0000 7f81a6665740 1 --2- 172.21.15.53:0/2070050068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061c52f0 0x55bb06597db0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f81880aeec0 tx=0x7f81880e8f70 comp rx=0 tx=0).stop 2024-08-31T06:17:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.655+0000 7f81a6665740 1 -- 172.21.15.53:0/2070050068 shutdown_connections 2024-08-31T06:17:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.655+0000 7f81a6665740 1 --2- 172.21.15.53:0/2070050068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061cd4d0 0x55bb0659a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.655+0000 7f81a6665740 1 --2- 172.21.15.53:0/2070050068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061c52f0 0x55bb06597db0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.655+0000 7f81a6665740 1 --2- 172.21.15.53:0/2070050068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061acd80 0x55bb0659d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.655+0000 7f81a6665740 1 -- 172.21.15.53:0/2070050068 >> 172.21.15.53:0/2070050068 conn(0x55bb061e2300 msgr2=0x55bb0659cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.655+0000 7f81a6665740 1 -- 172.21.15.53:0/2070050068 shutdown_connections 2024-08-31T06:17:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.655+0000 7f81a6665740 1 -- 172.21.15.53:0/2070050068 wait complete. 2024-08-31T06:17:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.655+0000 7f81a6665740 1 -- start start 2024-08-31T06:17:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.655+0000 7f81a6665740 1 Processor -- start 2024-08-31T06:17:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f81a6665740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061acd80 0x55bb065b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f81a6665740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb065b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f81a6665740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 0x55bb065b0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f81a6665740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f81981ae730 con 0x55bb061cd4d0 2024-08-31T06:17:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f81a6665740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f81981adfd0 con 0x55bb061acd80 2024-08-31T06:17:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f81a6665740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f81981ab170 con 0x55bb061c52f0 2024-08-31T06:17:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f81a6665740 10 client.0 _ll_register_callbacks cb 0x7f81900093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819cbc1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb065b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819dbc3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 0x55bb065b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819d3c2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061acd80 0x55bb065b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819cbc1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb065b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:39946/0 (socket says 172.21.15.53:39946) 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819cbc1640 1 -- 172.21.15.53:0/648010046 learned_addr learned my addr 172.21.15.53:0/648010046 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819d3c2640 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061acd80 0x55bb065b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53110/0 (socket says 172.21.15.53:53110) 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819dbc3640 1 -- 172.21.15.53:0/648010046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 msgr2=0x55bb065b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819dbc3640 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb065b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819dbc3640 1 -- 172.21.15.53:0/648010046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061acd80 msgr2=0x55bb065b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819dbc3640 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061acd80 0x55bb065b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819dbc3640 1 -- 172.21.15.53:0/648010046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb065982f0 con 0x55bb061cd4d0 2024-08-31T06:17:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.656+0000 7f819cbc1640 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb065b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.657+0000 7f819dbc3640 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 0x55bb065b0860 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f819001a590 tx=0x7f8190004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1175f2856732bea7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.657+0000 7f8180ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.657+0000 7f8180ff9640 1 -- 172.21.15.53:0/648010046 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819002b070 con 0x55bb061cd4d0 2024-08-31T06:17:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.657+0000 7f8180ff9640 1 -- 172.21.15.53:0/648010046 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f81900279c0 con 0x55bb061cd4d0 2024-08-31T06:17:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.657+0000 7f81a6665740 1 -- 172.21.15.53:0/648010046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81880f6020 con 0x55bb061cd4d0 2024-08-31T06:17:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.657+0000 7f8180ff9640 1 -- 172.21.15.53:0/648010046 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8190020040 con 0x55bb061cd4d0 2024-08-31T06:17:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.657+0000 7f81a6665740 10 client.19611 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.657+0000 7f81a6665740 1 -- 172.21.15.53:0/648010046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55bb06619b60 con 0x55bb061cd4d0 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.657+0000 7f8180ff9640 1 -- 172.21.15.53:0/648010046 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81880f6020 con 0x55bb061cd4d0 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.658+0000 7f8180ff9640 1 -- 172.21.15.53:0/648010046 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f8190038c70 con 0x55bb061cd4d0 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.658+0000 7f81a6665740 10 client.19611 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.658+0000 7f81a6665740 10 client.19611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.658+0000 7f81a6665740 20 client.19611 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.658+0000 7f81a6665740 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb061ee1b0 0x55bb0661c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.658+0000 7f81a6665740 4 client.19611 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.658+0000 7f81a6665740 1 -- 172.21.15.53:0/648010046 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb065049f0 con 0x55bb061ee1b0 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.658+0000 7f819d3c2640 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb061ee1b0 0x55bb0661c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.658+0000 7f8180ff9640 10 client.19611 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.659+0000 7f819d3c2640 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb061ee1b0 0x55bb0661c3c0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cd3cb5296465958 server_cookie=2187e5b13bd29ddb in_seq=0 out_seq=0 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f8180ff9640 1 -- 172.21.15.53:0/648010046 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bb065049f0 con 0x55bb061ee1b0 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f8180ff9640 10 client.19611 handle_command_reply: tid=0 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f81a6665740 1 client.19611 shutdown 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f81a6665740 1 -- 172.21.15.53:0/648010046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 msgr2=0x55bb065b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f81a6665740 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 0x55bb065b0860 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f819001a590 tx=0x7f8190004ab0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f81a6665740 1 -- 172.21.15.53:0/648010046 shutdown_connections 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f81a6665740 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bb061ee1b0 0x55bb0661c3c0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f8180ff9640 0 client.19611 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f81a6665740 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb061cd4d0 0x55bb065b0860 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f81a6665740 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb061c52f0 0x55bb065b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f81a6665740 1 --2- 172.21.15.53:0/648010046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bb061acd80 0x55bb065b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f81a6665740 1 -- 172.21.15.53:0/648010046 >> 172.21.15.53:0/648010046 conn(0x55bb061e2300 msgr2=0x55bb06592d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f81a6665740 1 -- 172.21.15.53:0/648010046 shutdown_connections 2024-08-31T06:17:42.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.682+0000 7f81a6665740 1 -- 172.21.15.53:0/648010046 wait complete. 2024-08-31T06:17:42.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f81a6665740 20 client.19611 trim_cache size 0 max 16384 2024-08-31T06:17:42.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:17:42.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:17:42.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:17:42.686 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:17:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 -- 172.21.15.53:0/2116983065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f81840b4d20 msgr2=0x7f81840b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f81840b4d20 0x7f81840b7230 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f81900049d0 tx=0x7f8190010040 comp rx=0 tx=0).stop 2024-08-31T06:17:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 -- 172.21.15.53:0/2116983065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8198107850 msgr2=0x7f8198199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8198107850 0x7f8198199610 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f81980756d0 tx=0x7f818800b690 comp rx=0 tx=0).stop 2024-08-31T06:17:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 -- 172.21.15.53:0/2116983065 shutdown_connections 2024-08-31T06:17:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f81840b4d20 0x7f81840b7230 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81981081a0 0x7f819819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8198107850 0x7f8198199610 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 --2- 172.21.15.53:0/2116983065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8198101f20 0x7f8198199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 -- 172.21.15.53:0/2116983065 >> 172.21.15.53:0/2116983065 conn(0x7f8198079c30 msgr2=0x7f81981059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 -- 172.21.15.53:0/2116983065 shutdown_connections 2024-08-31T06:17:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:42.683+0000 7f819f626640 1 -- 172.21.15.53:0/2116983065 wait complete. 2024-08-31T06:17:43.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 194570 1.34 MB/sec execute 572 sec latency 15.621 ms 2024-08-31T06:17:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:43 smithi053 ceph-mon[18924]: pgmap v720: 97 pgs: 97 active+clean; 115 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 636 KiB/s wr, 81 op/s 2024-08-31T06:17:43.989 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:17:43.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:17:44.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 195061 1.34 MB/sec execute 573 sec latency 41.684 ms 2024-08-31T06:17:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:43 smithi130 ceph-mon[22266]: pgmap v720: 97 pgs: 97 active+clean; 115 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 636 KiB/s wr, 81 op/s 2024-08-31T06:17:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:43 smithi153 ceph-mon[22320]: pgmap v720: 97 pgs: 97 active+clean; 115 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 636 KiB/s wr, 81 op/s 2024-08-31T06:17:44.262 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:17:44.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.741+0000 7f389a419640 1 -- 172.21.15.53:0/1886879778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3894108180 msgr2=0x7f3894108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:44.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.741+0000 7f389a419640 1 --2- 172.21.15.53:0/1886879778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3894108180 0x7f3894108590 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f3888009900 tx=0x7f388802a410 comp rx=0 tx=0).stop 2024-08-31T06:17:44.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.741+0000 7f389a419640 1 -- 172.21.15.53:0/1886879778 shutdown_connections 2024-08-31T06:17:44.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.741+0000 7f389a419640 1 --2- 172.21.15.53:0/1886879778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894108ad0 0x7f389410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.741+0000 7f389a419640 1 --2- 172.21.15.53:0/1886879778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3894108180 0x7f3894108590 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.741+0000 7f389a419640 1 --2- 172.21.15.53:0/1886879778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3894102840 0x7f3894102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.741+0000 7f389a419640 1 -- 172.21.15.53:0/1886879778 >> 172.21.15.53:0/1886879778 conn(0x7f3894079580 msgr2=0x7f3894079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.741+0000 7f389a419640 1 -- 172.21.15.53:0/1886879778 shutdown_connections 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.741+0000 7f389a419640 1 -- 172.21.15.53:0/1886879778 wait complete. 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.742+0000 7f389a419640 1 Processor -- start 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.742+0000 7f389a419640 1 -- start start 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.742+0000 7f389a419640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894102840 0x7f389419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.742+0000 7f389a419640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3894108180 0x7f389419b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.742+0000 7f389a419640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3894108ad0 0x7f389419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.742+0000 7f389a419640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38941125d0 con 0x7f3894108ad0 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.742+0000 7f389a419640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3894112450 con 0x7f3894108180 2024-08-31T06:17:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.742+0000 7f389a419640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3894112750 con 0x7f3894102840 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.742+0000 7f38989b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3894108ad0 0x7f389419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.742+0000 7f38989b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3894108ad0 0x7f389419ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48098/0 (socket says 172.21.15.53:48098) 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.742+0000 7f38989b6640 1 -- 172.21.15.53:0/2812657086 learned_addr learned my addr 172.21.15.53:0/2812657086 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f38937fe640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3894108180 0x7f389419b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f3893fff640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894102840 0x7f389419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f38989b6640 1 -- 172.21.15.53:0/2812657086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894102840 msgr2=0x7f389419afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f38989b6640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894102840 0x7f389419afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f38989b6640 1 -- 172.21.15.53:0/2812657086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3894108180 msgr2=0x7f389419b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f38989b6640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3894108180 0x7f389419b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f38989b6640 1 -- 172.21.15.53:0/2812657086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38941a6280 con 0x7f3894108ad0 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f3893fff640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894102840 0x7f389419afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f38989b6640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3894108ad0 0x7f389419ba40 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f388c00eb10 tx=0x7f388c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f38917fa640 1 -- 172.21.15.53:0/2812657086 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c004b20 con 0x7f3894108ad0 2024-08-31T06:17:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f38917fa640 1 -- 172.21.15.53:0/2812657086 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f388c004cc0 con 0x7f3894108ad0 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f389a419640 1 -- 172.21.15.53:0/2812657086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38941a6570 con 0x7f3894108ad0 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f38917fa640 1 -- 172.21.15.53:0/2812657086 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c010690 con 0x7f3894108ad0 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.743+0000 7f389a419640 1 -- 172.21.15.53:0/2812657086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38941a6a80 con 0x7f3894108ad0 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.746+0000 7f38a098e740 1 Processor -- start 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.746+0000 7f38917fa640 1 -- 172.21.15.53:0/2812657086 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f388c005020 con 0x7f3894108ad0 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38a098e740 1 -- start start 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38a098e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 0x564096837780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38a098e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 0x564096837cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38a098e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096470670 0x564096838200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38a098e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640967ad5f0 con 0x564096470670 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38a098e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56409679cb80 con 0x564096491350 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38a098e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5640967a0b30 con 0x564096468490 2024-08-31T06:17:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38937fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096470670 0x564096838200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38937fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 0x564096837780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38937fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 0x564096837780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39936/0 (socket says 172.21.15.53:39936) 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38937fe640 1 -- 172.21.15.53:0/3493459840 learned_addr learned my addr 172.21.15.53:0/3493459840 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f3893fff640 1 --2- 172.21.15.53:0/3493459840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 0x564096837cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38917fa640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f387c0b4ca0 0x7f387c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38937fe640 1 -- 172.21.15.53:0/3493459840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 msgr2=0x564096837cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38937fe640 1 --2- 172.21.15.53:0/3493459840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 0x564096837cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38937fe640 1 -- 172.21.15.53:0/3493459840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096470670 msgr2=0x564096838200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38937fe640 1 --2- 172.21.15.53:0/3493459840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096470670 0x564096838200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.747+0000 7f38937fe640 1 -- 172.21.15.53:0/3493459840 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640964fc930 con 0x564096491350 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.748+0000 7f38989b6640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f387c0b4ca0 0x7f387c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.748+0000 7f38917fa640 1 -- 172.21.15.53:0/2812657086 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f388c0e5c10 con 0x7f3894108ad0 2024-08-31T06:17:44.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.748+0000 7f38937fe640 1 --2- 172.21.15.53:0/3493459840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 0x564096837780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3888009900 tx=0x7f3888000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5c22cf7c7265d42 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.748+0000 7f387a7fc640 1 -- 172.21.15.53:0/3493459840 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888035040 con 0x564096491350 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.748+0000 7f38989b6640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f387c0b4ca0 0x7f387c0b71b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f388c0e3940 tx=0x7f388c012d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.748+0000 7f387a7fc640 1 -- 172.21.15.53:0/3493459840 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38880044c0 con 0x564096491350 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.748+0000 7f387a7fc640 1 -- 172.21.15.53:0/3493459840 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888003b50 con 0x564096491350 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.749+0000 7f38a098e740 1 -- 172.21.15.53:0/3493459840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 msgr2=0x564096837780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.749+0000 7f38a098e740 1 --2- 172.21.15.53:0/3493459840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 0x564096837780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3888009900 tx=0x7f3888000bc0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.749+0000 7f38a098e740 1 -- 172.21.15.53:0/3493459840 shutdown_connections 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.749+0000 7f38a098e740 1 --2- 172.21.15.53:0/3493459840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096470670 0x564096838200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.749+0000 7f38a098e740 1 --2- 172.21.15.53:0/3493459840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 0x564096837cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.749+0000 7f38a098e740 1 --2- 172.21.15.53:0/3493459840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 0x564096837780 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.749+0000 7f38a098e740 1 -- 172.21.15.53:0/3493459840 >> 172.21.15.53:0/3493459840 conn(0x564096485740 msgr2=0x564096835670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:44.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.749+0000 7f38a098e740 1 -- 172.21.15.53:0/3493459840 shutdown_connections 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.749+0000 7f38a098e740 1 -- 172.21.15.53:0/3493459840 wait complete. 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.749+0000 7f38a098e740 1 -- start start 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38a098e740 1 Processor -- start 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38a098e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096468490 0x564096842f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38a098e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096470670 0x564096843460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38a098e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 0x56409684f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38a098e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640965ff890 con 0x564096468490 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38a098e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564096723790 con 0x564096491350 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38a098e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564096845f00 con 0x564096470670 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38a098e740 10 client.0 _ll_register_callbacks cb 0x5640964a8ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38937fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096468490 0x564096842f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38937fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096468490 0x564096842f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48108/0 (socket says 172.21.15.53:48108) 2024-08-31T06:17:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38937fe640 1 -- 172.21.15.53:0/3103065111 learned_addr learned my addr 172.21.15.53:0/3103065111 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38937fe640 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 0x56409684f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38937fe640 1 -- 172.21.15.53:0/3103065111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096470670 msgr2=0x564096843460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38937fe640 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096470670 0x564096843460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38937fe640 1 -- 172.21.15.53:0/3103065111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 msgr2=0x56409684f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38937fe640 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 0x56409684f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38937fe640 1 -- 172.21.15.53:0/3103065111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56409675af30 con 0x564096468490 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38937fe640 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096468490 0x564096842f20 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f3888005760 tx=0x7f38880056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4be09927dd7826f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.750+0000 7f38737fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38737fe640 1 -- 172.21.15.53:0/3103065111 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888052060 con 0x564096468490 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38737fe640 1 -- 172.21.15.53:0/3103065111 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f3888031c70 con 0x564096468490 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38a098e740 1 -- 172.21.15.53:0/3103065111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5640967af540 con 0x564096468490 2024-08-31T06:17:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38737fe640 1 -- 172.21.15.53:0/3103065111 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f3888035040 con 0x564096468490 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38a098e740 10 client.19623 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38a098e740 1 -- 172.21.15.53:0/3103065111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x564096851d00 con 0x564096468490 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38737fe640 1 -- 172.21.15.53:0/3103065111 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5640967af540 con 0x564096468490 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38737fe640 1 -- 172.21.15.53:0/3103065111 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f388804a4b0 con 0x564096468490 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38a098e740 10 client.19623 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38a098e740 10 client.19623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38a098e740 20 client.19623 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38a098e740 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56409644fcd0 0x564096855060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38a098e740 4 client.19623 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.751+0000 7f38a098e740 1 -- 172.21.15.53:0/3103065111 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640967aafe0 con 0x56409644fcd0 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.752+0000 7f3893fff640 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56409644fcd0 0x564096855060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.752+0000 7f3893fff640 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56409644fcd0 0x564096855060 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc97952795276434 server_cookie=61955b93a30ba62 in_seq=0 out_seq=0 2024-08-31T06:17:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.752+0000 7f38737fe640 10 client.19623 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.753+0000 7f38737fe640 1 -- 172.21.15.53:0/3103065111 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640967aafe0 con 0x56409644fcd0 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.753+0000 7f38737fe640 10 client.19623 handle_command_reply: tid=0 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.753+0000 7f38a098e740 1 client.19623 shutdown 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.753+0000 7f38a098e740 1 -- 172.21.15.53:0/3103065111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096468490 msgr2=0x564096842f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.753+0000 7f38a098e740 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096468490 0x564096842f20 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f3888005760 tx=0x7f38880056d0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.754+0000 7f38a098e740 1 -- 172.21.15.53:0/3103065111 shutdown_connections 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.754+0000 7f38a098e740 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56409644fcd0 0x564096855060 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.754+0000 7f38a098e740 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096491350 0x56409684f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.754+0000 7f38a098e740 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096470670 0x564096843460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.754+0000 7f38a098e740 1 --2- 172.21.15.53:0/3103065111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096468490 0x564096842f20 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.754+0000 7f38a098e740 1 -- 172.21.15.53:0/3103065111 >> 172.21.15.53:0/3103065111 conn(0x564096485740 msgr2=0x56409683a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.754+0000 7f38737fe640 0 client.19623 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.754+0000 7f38a098e740 1 -- 172.21.15.53:0/3103065111 shutdown_connections 2024-08-31T06:17:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.754+0000 7f38a098e740 1 -- 172.21.15.53:0/3103065111 wait complete. 2024-08-31T06:17:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.754+0000 7f38a098e740 20 client.19623 trim_cache size 0 max 16384 2024-08-31T06:17:44.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.772+0000 7f38a098e740 1 Processor -- start 2024-08-31T06:17:44.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.772+0000 7f38a098e740 1 -- start start 2024-08-31T06:17:44.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.772+0000 7f38a098e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 0x564096844e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.772+0000 7f38a098e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096470670 0x56409683af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.772+0000 7f38a098e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x56409684f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.772+0000 7f38a098e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38941af530 con 0x564096491350 2024-08-31T06:17:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.772+0000 7f38a098e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38941b1280 con 0x564096470670 2024-08-31T06:17:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.772+0000 7f38a098e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38941afc00 con 0x564096468490 2024-08-31T06:17:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.772+0000 7f38937fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x56409684f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.772+0000 7f38937fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x56409684f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48112/0 (socket says 172.21.15.53:48112) 2024-08-31T06:17:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.772+0000 7f38937fe640 1 -- 172.21.15.53:0/2360631122 learned_addr learned my addr 172.21.15.53:0/2360631122 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:44.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.773+0000 7f38937fe640 1 -- 172.21.15.53:0/2360631122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 msgr2=0x564096844e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:44.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.773+0000 7f38937fe640 1 --2- 172.21.15.53:0/2360631122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 0x564096844e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.773+0000 7f38937fe640 1 -- 172.21.15.53:0/2360631122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096470670 msgr2=0x56409683af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:44.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.773+0000 7f38937fe640 1 --2- 172.21.15.53:0/2360631122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096470670 0x56409683af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.773+0000 7f38937fe640 1 -- 172.21.15.53:0/2360631122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564096839ca0 con 0x564096491350 2024-08-31T06:17:44.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.773+0000 7f38937fe640 1 --2- 172.21.15.53:0/2360631122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x56409684f0f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f3888009850 tx=0x7f3888005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03766572965d246 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:44.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.773+0000 7f3879ffb640 1 -- 172.21.15.53:0/2360631122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888052040 con 0x564096491350 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.773+0000 7f3879ffb640 1 -- 172.21.15.53:0/2360631122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f388804e020 con 0x564096491350 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.773+0000 7f3879ffb640 1 -- 172.21.15.53:0/2360631122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888032030 con 0x564096491350 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.774+0000 7f38a098e740 1 -- 172.21.15.53:0/2360631122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 msgr2=0x56409684f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.774+0000 7f38a098e740 1 --2- 172.21.15.53:0/2360631122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x56409684f0f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f3888009850 tx=0x7f3888005d50 comp rx=0 tx=0).stop 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.774+0000 7f38a098e740 1 -- 172.21.15.53:0/2360631122 shutdown_connections 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.774+0000 7f38a098e740 1 --2- 172.21.15.53:0/2360631122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x56409684f0f0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.774+0000 7f38a098e740 1 --2- 172.21.15.53:0/2360631122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096470670 0x56409683af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.774+0000 7f38a098e740 1 --2- 172.21.15.53:0/2360631122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 0x564096844e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.774+0000 7f38a098e740 1 -- 172.21.15.53:0/2360631122 >> 172.21.15.53:0/2360631122 conn(0x564096485740 msgr2=0x56409683a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.774+0000 7f38a098e740 1 -- 172.21.15.53:0/2360631122 shutdown_connections 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.774+0000 7f38a098e740 1 -- 172.21.15.53:0/2360631122 wait complete. 2024-08-31T06:17:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.774+0000 7f38a098e740 1 -- start start 2024-08-31T06:17:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.774+0000 7f38a098e740 1 Processor -- start 2024-08-31T06:17:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38a098e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 0x564096847540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38a098e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096470670 0x564096847ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38a098e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x5640968be820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38a098e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38941b0af0 con 0x564096491350 2024-08-31T06:17:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38a098e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38941b0390 con 0x564096470670 2024-08-31T06:17:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38a098e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38941ad530 con 0x564096468490 2024-08-31T06:17:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38a098e740 10 client.0 _ll_register_callbacks cb 0x7f3888009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38937fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x5640968be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38937fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x5640968be820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48122/0 (socket says 172.21.15.53:48122) 2024-08-31T06:17:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38937fe640 1 -- 172.21.15.53:0/2075284329 learned_addr learned my addr 172.21.15.53:0/2075284329 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f3893fff640 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096470670 0x564096847ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38937fe640 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 0x564096847540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38937fe640 1 -- 172.21.15.53:0/2075284329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 msgr2=0x564096847540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38937fe640 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 0x564096847540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38937fe640 1 -- 172.21.15.53:0/2075284329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096470670 msgr2=0x564096847ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38937fe640 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096470670 0x564096847ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38937fe640 1 -- 172.21.15.53:0/2075284329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640968bed60 con 0x564096491350 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38937fe640 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x5640968be820 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f3888005820 tx=0x7f3888005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db5dd7b86e98e82 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.775+0000 7f38737fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38737fe640 1 -- 172.21.15.53:0/2075284329 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888052030 con 0x564096491350 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38737fe640 1 -- 172.21.15.53:0/2075284329 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f3888005050 con 0x564096491350 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38a098e740 1 -- 172.21.15.53:0/2075284329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f388804e020 con 0x564096491350 2024-08-31T06:17:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38737fe640 1 -- 172.21.15.53:0/2075284329 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f3888005250 con 0x564096491350 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38a098e740 10 client.19629 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38a098e740 1 -- 172.21.15.53:0/2075284329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5640968bfef0 con 0x564096491350 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38737fe640 1 -- 172.21.15.53:0/2075284329 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f388804e020 con 0x564096491350 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38737fe640 1 -- 172.21.15.53:0/2075284329 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f388803d510 con 0x564096491350 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38a098e740 10 client.19629 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38a098e740 10 client.19629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38a098e740 20 client.19629 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38a098e740 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564096425080 0x5640968c2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38a098e740 4 client.19629 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.776+0000 7f38a098e740 1 -- 172.21.15.53:0/2075284329 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5640967a8720 con 0x564096425080 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.777+0000 7f3893fff640 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564096425080 0x5640968c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.777+0000 7f3893fff640 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564096425080 0x5640968c2390 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23c74474cfa20f2c server_cookie=66e676abad59c1de in_seq=0 out_seq=0 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.777+0000 7f38737fe640 10 client.19629 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38737fe640 1 -- 172.21.15.53:0/2075284329 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5640967a8720 con 0x564096425080 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38737fe640 10 client.19629 handle_command_reply: tid=0 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 1 client.19629 shutdown 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 1 -- 172.21.15.53:0/2075284329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 msgr2=0x5640968be820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x5640968be820 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f3888005820 tx=0x7f3888005970 comp rx=0 tx=0).stop 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 1 -- 172.21.15.53:0/2075284329 shutdown_connections 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564096425080 0x5640968c2390 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564096491350 0x5640968be820 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564096470670 0x564096847ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 1 --2- 172.21.15.53:0/2075284329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564096468490 0x564096847540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 1 -- 172.21.15.53:0/2075284329 >> 172.21.15.53:0/2075284329 conn(0x564096485740 msgr2=0x56409683a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38737fe640 0 client.19629 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 1 -- 172.21.15.53:0/2075284329 shutdown_connections 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 1 -- 172.21.15.53:0/2075284329 wait complete. 2024-08-31T06:17:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.778+0000 7f38a098e740 20 client.19629 trim_cache size 0 max 16384 2024-08-31T06:17:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:17:44.785 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:17:44.785 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "3c548943-e999-41ac-a451-79dccf0c05e3", 2024-08-31T06:17:44.785 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:17:44.785 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 -- 172.21.15.53:0/2812657086 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f387c0b4ca0 msgr2=0x7f387c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f387c0b4ca0 0x7f387c0b71b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f388c0e3940 tx=0x7f388c012d90 comp rx=0 tx=0).stop 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 -- 172.21.15.53:0/2812657086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3894108ad0 msgr2=0x7f389419ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3894108ad0 0x7f389419ba40 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f388c00eb10 tx=0x7f388c00c2d0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 -- 172.21.15.53:0/2812657086 shutdown_connections 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f387c0b4ca0 0x7f387c0b71b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3894108ad0 0x7f389419ba40 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3894108180 0x7f389419b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 --2- 172.21.15.53:0/2812657086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894102840 0x7f389419afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 -- 172.21.15.53:0/2812657086 >> 172.21.15.53:0/2812657086 conn(0x7f3894079580 msgr2=0x7f3894105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 -- 172.21.15.53:0/2812657086 shutdown_connections 2024-08-31T06:17:44.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:44.779+0000 7f389a419640 1 -- 172.21.15.53:0/2812657086 wait complete. 2024-08-31T06:17:45.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 195210 1.34 MB/sec execute 574 sec latency 601.259 ms 2024-08-31T06:17:45.437 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:17:45.728 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:17:45.963 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.7 2024-08-31T06:17:45.963 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:17:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: pgmap v721: 97 pgs: 97 active+clean; 110 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 670 KiB/s wr, 90 op/s 2024-08-31T06:17:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:17:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:17:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:17:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:17:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:17:45.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:17:45.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:45.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:45.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:17:45.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:45.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:17:45.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:45.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:17:45.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:45.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:45.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:45 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 195232 1.34 MB/sec execute 575 sec latency 910.787 ms 2024-08-31T06:17:46.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: pgmap v721: 97 pgs: 97 active+clean; 110 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 670 KiB/s wr, 90 op/s 2024-08-31T06:17:46.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:17:46.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:46.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:46.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:46.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:46.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:46.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:46.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:46.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:17:46.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:45 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: pgmap v721: 97 pgs: 97 active+clean; 110 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 670 KiB/s wr, 90 op/s 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:46.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:46.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:17:46.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:45 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.216+0000 7f5caeb67640 1 -- 172.21.15.53:0/185523745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ca8102880 msgr2=0x7f5ca8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.216+0000 7f5caeb67640 1 --2- 172.21.15.53:0/185523745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ca8102880 0x7f5ca8102c90 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009900 tx=0x7f5c9802a410 comp rx=0 tx=0).stop 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.216+0000 7f5caeb67640 1 -- 172.21.15.53:0/185523745 shutdown_connections 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.216+0000 7f5caeb67640 1 --2- 172.21.15.53:0/185523745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ca8108ac0 0x7f5ca810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.216+0000 7f5caeb67640 1 --2- 172.21.15.53:0/185523745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca8108170 0x7f5ca8108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.216+0000 7f5caeb67640 1 --2- 172.21.15.53:0/185523745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ca8102880 0x7f5ca8102c90 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.216+0000 7f5caeb67640 1 -- 172.21.15.53:0/185523745 >> 172.21.15.53:0/185523745 conn(0x7f5ca8079500 msgr2=0x7f5ca8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.216+0000 7f5caeb67640 1 -- 172.21.15.53:0/185523745 shutdown_connections 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.216+0000 7f5caeb67640 1 -- 172.21.15.53:0/185523745 wait complete. 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.216+0000 7f5caeb67640 1 Processor -- start 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5caeb67640 1 -- start start 2024-08-31T06:17:46.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5caeb67640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca8102880 0x7f5ca819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5caeb67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ca8108170 0x7f5ca819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5caeb67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ca8108ac0 0x7f5ca81a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5caeb67640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81125d0 con 0x7f5ca8108ac0 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5caeb67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca8112450 con 0x7f5ca8108170 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5caeb67640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca8112750 con 0x7f5ca8102880 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5cad104640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ca8108ac0 0x7f5ca81a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5cad104640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ca8108ac0 0x7f5ca81a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48128/0 (socket says 172.21.15.53:48128) 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5cad104640 1 -- 172.21.15.53:0/3445301519 learned_addr learned my addr 172.21.15.53:0/3445301519 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ca8108170 0x7f5ca819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5cac903640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca8102880 0x7f5ca819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5cad104640 1 -- 172.21.15.53:0/3445301519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca8102880 msgr2=0x7f5ca819c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5cad104640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca8102880 0x7f5ca819c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5cad104640 1 -- 172.21.15.53:0/3445301519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ca8108170 msgr2=0x7f5ca819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5cad104640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ca8108170 0x7f5ca819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.217+0000 7f5cad104640 1 -- 172.21.15.53:0/3445301519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca81a22e0 con 0x7f5ca8108ac0 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.218+0000 7f5cad104640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ca8108ac0 0x7f5ca81a1bb0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000eaa0 tx=0x7f5ca000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.218+0000 7f5ca5ffb640 1 -- 172.21.15.53:0/3445301519 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca000cdb0 con 0x7f5ca8108ac0 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.218+0000 7f5ca5ffb640 1 -- 172.21.15.53:0/3445301519 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ca0005020 con 0x7f5ca8108ac0 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.218+0000 7f5ca5ffb640 1 -- 172.21.15.53:0/3445301519 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00116d0 con 0x7f5ca8108ac0 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.218+0000 7f5caeb67640 1 -- 172.21.15.53:0/3445301519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca81a25d0 con 0x7f5ca8108ac0 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.218+0000 7f5caeb67640 1 -- 172.21.15.53:0/3445301519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca81a8d30 con 0x7f5ca8108ac0 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5ca5ffb640 1 -- 172.21.15.53:0/3445301519 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5ca00051d0 con 0x7f5ca8108ac0 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5cb50dc740 1 Processor -- start 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5cb50dc740 1 -- start start 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f3c070 0x560fa22e12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f131b0 0x560fa22e1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f1b390 0x560fa22e1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560fa2258630 con 0x560fa1f131b0 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560fa2247bc0 con 0x560fa1f3c070 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560fa224bb70 con 0x560fa1f1b390 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5cac903640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f131b0 0x560fa22e1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5cac903640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f131b0 0x560fa22e1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48130/0 (socket says 172.21.15.53:48130) 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.221+0000 7f5cac903640 1 -- 172.21.15.53:0/1435820213 learned_addr learned my addr 172.21.15.53:0/1435820213 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5ca5ffb640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5c900b4d20 0x7f5c900b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/1435820213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f3c070 0x560fa22e12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5cac903640 1 -- 172.21.15.53:0/1435820213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f1b390 msgr2=0x560fa22e1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5cac903640 1 --2- 172.21.15.53:0/1435820213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f1b390 0x560fa22e1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5cac903640 1 -- 172.21.15.53:0/1435820213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f3c070 msgr2=0x560fa22e12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5cac903640 1 --2- 172.21.15.53:0/1435820213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f3c070 0x560fa22e12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5cac903640 1 -- 172.21.15.53:0/1435820213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa1fa7650 con 0x560fa1f131b0 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/1435820213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f3c070 0x560fa22e12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5cad104640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5c900b4d20 0x7f5c900b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5cac903640 1 --2- 172.21.15.53:0/1435820213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f131b0 0x560fa22e1800 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f5c9802a930 tx=0x7f5c98031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cab5adad908b024 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5ca5ffb640 1 -- 172.21.15.53:0/3445301519 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f5ca00e55a0 con 0x7f5ca8108ac0 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5c8effd640 1 -- 172.21.15.53:0/1435820213 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98035030 con 0x560fa1f131b0 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5c8effd640 1 -- 172.21.15.53:0/1435820213 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c98040070 con 0x560fa1f131b0 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.222+0000 7f5c8effd640 1 -- 172.21.15.53:0/1435820213 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98003a20 con 0x560fa1f131b0 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.223+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1435820213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f131b0 msgr2=0x560fa22e1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.223+0000 7f5cad104640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5c900b4d20 0x7f5c900b7230 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00abcb0 tx=0x7f5ca00d4040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.223+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1435820213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f131b0 0x560fa22e1800 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f5c9802a930 tx=0x7f5c98031dc0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.223+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1435820213 shutdown_connections 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.223+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1435820213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f1b390 0x560fa22e1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.223+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1435820213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f131b0 0x560fa22e1800 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.223+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1435820213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f3c070 0x560fa22e12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.223+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1435820213 >> 172.21.15.53:0/1435820213 conn(0x560fa1f30460 msgr2=0x560fa22df1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.223+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1435820213 shutdown_connections 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.223+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1435820213 wait complete. 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5cb50dc740 1 -- start start 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5cb50dc740 1 Processor -- start 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f131b0 0x560fa22ecab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f1b390 0x560fa22ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f3c070 0x560fa22f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560fa20aa700 con 0x560fa1f3c070 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560fa21ce700 con 0x560fa1f1b390 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560fa22efa40 con 0x560fa1f131b0 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5cb50dc740 10 client.0 _ll_register_callbacks cb 0x560fa21fddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:46.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f3c070 0x560fa22f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f3c070 0x560fa22f8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48144/0 (socket says 172.21.15.53:48144) 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5ca7fff640 1 -- 172.21.15.53:0/170793085 learned_addr learned my addr 172.21.15.53:0/170793085 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5cac903640 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f1b390 0x560fa22ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5ca7fff640 1 -- 172.21.15.53:0/170793085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f131b0 msgr2=0x560fa22ecab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f131b0 0x560fa22ecab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5ca7fff640 1 -- 172.21.15.53:0/170793085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f1b390 msgr2=0x560fa22ecff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.224+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f1b390 0x560fa22ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5ca7fff640 1 -- 172.21.15.53:0/170793085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fa22078b0 con 0x560fa1f3c070 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f3c070 0x560fa22f8d90 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0057c0 tx=0x7f5c9c012cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af8f53e51764d4c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5c87fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5c87fff640 1 -- 172.21.15.53:0/170793085 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00eae0 con 0x560fa1f3c070 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5cb50dc740 1 -- 172.21.15.53:0/170793085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c98040070 con 0x560fa1f3c070 2024-08-31T06:17:46.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5c87fff640 1 -- 172.21.15.53:0/170793085 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f5c9c00ec80 con 0x560fa1f3c070 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5c87fff640 1 -- 172.21.15.53:0/170793085 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f5c9c005020 con 0x560fa1f3c070 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5cb50dc740 10 client.19641 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5cb50dc740 1 -- 172.21.15.53:0/170793085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x560fa22fb850 con 0x560fa1f3c070 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5c87fff640 1 -- 172.21.15.53:0/170793085 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c98040070 con 0x560fa1f3c070 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5c87fff640 1 -- 172.21.15.53:0/170793085 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f5c9c004bd0 con 0x560fa1f3c070 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5cb50dc740 10 client.19641 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.225+0000 7f5cb50dc740 10 client.19641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.226+0000 7f5cb50dc740 20 client.19641 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.226+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560fa1efa9f0 0x560fa22fed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.226+0000 7f5cb50dc740 4 client.19641 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.226+0000 7f5cb50dc740 1 -- 172.21.15.53:0/170793085 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fa225a580 con 0x560fa1efa9f0 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.226+0000 7f5cac903640 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560fa1efa9f0 0x560fa22fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.226+0000 7f5cac903640 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560fa1efa9f0 0x560fa22fed80 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eda563ab53d357fa server_cookie=1285ec356295fc9e in_seq=0 out_seq=0 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.226+0000 7f5c87fff640 10 client.19641 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5c87fff640 1 -- 172.21.15.53:0/170793085 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560fa225a580 con 0x560fa1efa9f0 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5c87fff640 10 client.19641 handle_command_reply: tid=0 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5cb50dc740 1 client.19641 shutdown 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5cb50dc740 1 -- 172.21.15.53:0/170793085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f3c070 msgr2=0x560fa22f8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f3c070 0x560fa22f8d90 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0057c0 tx=0x7f5c9c012cc0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5cb50dc740 1 -- 172.21.15.53:0/170793085 shutdown_connections 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560fa1efa9f0 0x560fa22fed80 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f3c070 0x560fa22f8d90 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f1b390 0x560fa22ecff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/170793085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f131b0 0x560fa22ecab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5cb50dc740 1 -- 172.21.15.53:0/170793085 >> 172.21.15.53:0/170793085 conn(0x560fa1f30460 msgr2=0x560fa22e4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.227+0000 7f5c87fff640 0 client.19641 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:46.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.228+0000 7f5cb50dc740 1 -- 172.21.15.53:0/170793085 shutdown_connections 2024-08-31T06:17:46.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.228+0000 7f5cb50dc740 1 -- 172.21.15.53:0/170793085 wait complete. 2024-08-31T06:17:46.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.228+0000 7f5cb50dc740 20 client.19641 trim_cache size 0 max 16384 2024-08-31T06:17:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.252+0000 7f5cb50dc740 1 Processor -- start 2024-08-31T06:17:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.252+0000 7f5cb50dc740 1 -- start start 2024-08-31T06:17:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.252+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f131b0 0x560fa22eb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.252+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22e4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.252+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f3c070 0x560fa22e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.252+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81b1730 con 0x560fa1f1b390 2024-08-31T06:17:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.252+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81b3480 con 0x560fa1f131b0 2024-08-31T06:17:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.252+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81b1e00 con 0x560fa1f3c070 2024-08-31T06:17:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5cac903640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22e4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f131b0 0x560fa22eb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5cac903640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22e4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48160/0 (socket says 172.21.15.53:48160) 2024-08-31T06:17:46.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5cac903640 1 -- 172.21.15.53:0/1044700895 learned_addr learned my addr 172.21.15.53:0/1044700895 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:46.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/1044700895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f3c070 0x560fa22e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5cac903640 1 -- 172.21.15.53:0/1044700895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f3c070 msgr2=0x560fa22e9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:46.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5cac903640 1 --2- 172.21.15.53:0/1044700895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f3c070 0x560fa22e9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5cac903640 1 -- 172.21.15.53:0/1044700895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f131b0 msgr2=0x560fa22eb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:46.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5cac903640 1 --2- 172.21.15.53:0/1044700895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f131b0 0x560fa22eb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5cac903640 1 -- 172.21.15.53:0/1044700895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa22ef1f0 con 0x560fa1f1b390 2024-08-31T06:17:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5cac903640 1 --2- 172.21.15.53:0/1044700895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22e4ad0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009900 tx=0x7f5c9802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f437e06930271ef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5c8e7fc640 1 -- 172.21.15.53:0/1044700895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98049040 con 0x560fa1f1b390 2024-08-31T06:17:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5c8e7fc640 1 -- 172.21.15.53:0/1044700895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c98040070 con 0x560fa1f1b390 2024-08-31T06:17:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.253+0000 7f5c8e7fc640 1 -- 172.21.15.53:0/1044700895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9804ef90 con 0x560fa1f1b390 2024-08-31T06:17:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.254+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1044700895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 msgr2=0x560fa22e4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.254+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1044700895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22e4ad0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009900 tx=0x7f5c9802a410 comp rx=0 tx=0).stop 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.254+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1044700895 shutdown_connections 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.254+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1044700895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f3c070 0x560fa22e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.254+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1044700895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22e4ad0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.254+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1044700895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f131b0 0x560fa22eb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.254+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1044700895 >> 172.21.15.53:0/1044700895 conn(0x560fa1f30460 msgr2=0x560fa22e43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.254+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1044700895 shutdown_connections 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.254+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1044700895 wait complete. 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.255+0000 7f5cb50dc740 1 -- start start 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.255+0000 7f5cb50dc740 1 Processor -- start 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.255+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f131b0 0x560fa22f5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.255+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.255+0000 7f5cb50dc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f3c070 0x560fa22f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.255+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81b2cf0 con 0x560fa1f1b390 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.255+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81b2590 con 0x560fa1f131b0 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5cb50dc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81af730 con 0x560fa1f3c070 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5cac903640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5cb50dc740 10 client.0 _ll_register_callbacks cb 0x7f5c9c00a5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5cac903640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22f0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48168/0 (socket says 172.21.15.53:48168) 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5cac903640 1 -- 172.21.15.53:0/1306334188 learned_addr learned my addr 172.21.15.53:0/1306334188 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f131b0 0x560fa22f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f3c070 0x560fa22f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5ca7fff640 1 -- 172.21.15.53:0/1306334188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f3c070 msgr2=0x560fa22f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f3c070 0x560fa22f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5ca7fff640 1 -- 172.21.15.53:0/1306334188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 msgr2=0x560fa22f0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22f0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5ca7fff640 1 -- 172.21.15.53:0/1306334188 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fa22f1920 con 0x560fa1f131b0 2024-08-31T06:17:46.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5cac903640 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:46.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5ca7fff640 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f131b0 0x560fa22f5610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00efd0 tx=0x7f5c9c00a690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cfa45ccb210d61b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:46.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5c87fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:17:46.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5c87fff640 1 -- 172.21.15.53:0/1306334188 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00eae0 con 0x560fa1f131b0 2024-08-31T06:17:46.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1306334188 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c98040070 con 0x560fa1f131b0 2024-08-31T06:17:46.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.256+0000 7f5c87fff640 1 -- 172.21.15.53:0/1306334188 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f5c9c00ec80 con 0x560fa1f131b0 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.257+0000 7f5c87fff640 1 -- 172.21.15.53:0/1306334188 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f5c9c0046c0 con 0x560fa1f131b0 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.257+0000 7f5cb50dc740 10 client.28691 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.257+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1306334188 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x560fa23697d0 con 0x560fa1f131b0 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.257+0000 7f5c87fff640 1 -- 172.21.15.53:0/1306334188 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c98040070 con 0x560fa1f131b0 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.257+0000 7f5c87fff640 1 -- 172.21.15.53:0/1306334188 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f5c9c0239d0 con 0x560fa1f131b0 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.257+0000 7f5cb50dc740 10 client.28691 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.257+0000 7f5cb50dc740 10 client.28691 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.257+0000 7f5cb50dc740 20 client.28691 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.257+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560fa1ecfda0 0x560fa236bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.257+0000 7f5cb50dc740 4 client.28691 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.257+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1306334188 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560fa2256020 con 0x560fa1ecfda0 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.259+0000 7f5cac903640 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560fa1ecfda0 0x560fa236bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.259+0000 7f5c87fff640 10 client.28691 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.259+0000 7f5cac903640 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560fa1ecfda0 0x560fa236bfd0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a32db4230e66afb0 server_cookie=96d28764d4263872 in_seq=0 out_seq=0 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5c87fff640 1 -- 172.21.15.53:0/1306334188 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x560fa2256020 con 0x560fa1ecfda0 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5c87fff640 10 client.28691 handle_command_reply: tid=0 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 1 client.28691 shutdown 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1306334188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f131b0 msgr2=0x560fa22f5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f131b0 0x560fa22f5610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00efd0 tx=0x7f5c9c00a690 comp rx=0 tx=0).stop 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1306334188 shutdown_connections 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560fa1ecfda0 0x560fa236bfd0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560fa1f3c070 0x560fa22f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560fa1f1b390 0x560fa22f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5c87fff640 0 client.28691 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 1 --2- 172.21.15.53:0/1306334188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560fa1f131b0 0x560fa22f5610 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1306334188 >> 172.21.15.53:0/1306334188 conn(0x560fa1f30460 msgr2=0x560fa22edd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1306334188 shutdown_connections 2024-08-31T06:17:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 1 -- 172.21.15.53:0/1306334188 wait complete. 2024-08-31T06:17:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.260+0000 7f5cb50dc740 20 client.28691 trim_cache size 0 max 16384 2024-08-31T06:17:46.265 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:17:46.265 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:17:46.265 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:17:46.265 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:17:46.265 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.265 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "3c548943-e999-41ac-a451-79dccf0c05e3", 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.266 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.268 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.269 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:17:46.270 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.271 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:17:46.274 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:17:46.275 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:17:46.276 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:17:46.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 -- 172.21.15.53:0/3445301519 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5c900b4d20 msgr2=0x7f5c900b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:46.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5c900b4d20 0x7f5c900b7230 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00abcb0 tx=0x7f5ca00d4040 comp rx=0 tx=0).stop 2024-08-31T06:17:46.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 -- 172.21.15.53:0/3445301519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ca8108ac0 msgr2=0x7f5ca81a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:46.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ca8108ac0 0x7f5ca81a1bb0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000eaa0 tx=0x7f5ca000ef60 comp rx=0 tx=0).stop 2024-08-31T06:17:46.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 -- 172.21.15.53:0/3445301519 shutdown_connections 2024-08-31T06:17:46.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5c900b4d20 0x7f5c900b7230 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ca8108ac0 0x7f5ca81a1bb0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ca8108170 0x7f5ca819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 --2- 172.21.15.53:0/3445301519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca8102880 0x7f5ca819c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:46.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 -- 172.21.15.53:0/3445301519 >> 172.21.15.53:0/3445301519 conn(0x7f5ca8079500 msgr2=0x7f5ca806b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:46.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 -- 172.21.15.53:0/3445301519 shutdown_connections 2024-08-31T06:17:46.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:46.261+0000 7f5caeb67640 1 -- 172.21.15.53:0/3445301519 wait complete. 2024-08-31T06:17:47.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 195437 1.34 MB/sec execute 576 sec latency 1159.365 ms 2024-08-31T06:17:47.085 INFO:tasks.cephfs.filesystem:scrub status for tag:3c548943-e999-41ac-a451-79dccf0c05e3 - {'path': '/', 'tag': '3c548943-e999-41ac-a451-79dccf0c05e3', 'options': 'recursive,force'} 2024-08-31T06:17:47.088 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:17:47.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.578+0000 7f37ed074640 1 -- 172.21.15.53:0/1392191376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e8102870 msgr2=0x7f37e8102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:47.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.578+0000 7f37ed074640 1 --2- 172.21.15.53:0/1392191376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e8102870 0x7f37e8102c80 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009900 tx=0x7f37d802a410 comp rx=0 tx=0).stop 2024-08-31T06:17:47.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.578+0000 7f37ed074640 1 -- 172.21.15.53:0/1392191376 shutdown_connections 2024-08-31T06:17:47.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.578+0000 7f37ed074640 1 --2- 172.21.15.53:0/1392191376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e8108ab0 0x7f37e810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.578+0000 7f37ed074640 1 --2- 172.21.15.53:0/1392191376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37e8108160 0x7f37e8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.578+0000 7f37ed074640 1 --2- 172.21.15.53:0/1392191376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e8102870 0x7f37e8102c80 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.578+0000 7f37ed074640 1 -- 172.21.15.53:0/1392191376 >> 172.21.15.53:0/1392191376 conn(0x7f37e8079470 msgr2=0x7f37e8079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.578+0000 7f37ed074640 1 -- 172.21.15.53:0/1392191376 shutdown_connections 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.578+0000 7f37ed074640 1 -- 172.21.15.53:0/1392191376 wait complete. 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.579+0000 7f37ed074640 1 Processor -- start 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.579+0000 7f37ed074640 1 -- start start 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.579+0000 7f37ed074640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e8102870 0x7f37e819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.579+0000 7f37ed074640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e8108160 0x7f37e819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.579+0000 7f37ed074640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37e8108ab0 0x7f37e819fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.579+0000 7f37ed074640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f37e8112660 con 0x7f37e8108160 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.579+0000 7f37ed074640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37e81124e0 con 0x7f37e8108ab0 2024-08-31T06:17:47.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.579+0000 7f37ed074640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37e81127e0 con 0x7f37e8102870 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e8108160 0x7f37e819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e8108160 0x7f37e819a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48186/0 (socket says 172.21.15.53:48186) 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e659c640 1 -- 172.21.15.53:0/1521311787 learned_addr learned my addr 172.21.15.53:0/1521311787 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e659c640 1 -- 172.21.15.53:0/1521311787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e8102870 msgr2=0x7f37e819a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e759e640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37e8108ab0 0x7f37e819fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e6d9d640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e8102870 0x7f37e819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e659c640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e8102870 0x7f37e819a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e659c640 1 -- 172.21.15.53:0/1521311787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37e8108ab0 msgr2=0x7f37e819fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e659c640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37e8108ab0 0x7f37e819fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e659c640 1 -- 172.21.15.53:0/1521311787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e81a0150 con 0x7f37e8108160 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e759e640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37e8108ab0 0x7f37e819fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e6d9d640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e8102870 0x7f37e819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37e659c640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e8108160 0x7f37e819a780 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f37dc006fd0 tx=0x7f37dc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:47.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37cffff640 1 -- 172.21.15.53:0/1521311787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc011830 con 0x7f37e8108160 2024-08-31T06:17:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37ed074640 1 -- 172.21.15.53:0/1521311787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e81a0440 con 0x7f37e8108160 2024-08-31T06:17:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37cffff640 1 -- 172.21.15.53:0/1521311787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37dc016070 con 0x7f37e8108160 2024-08-31T06:17:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37cffff640 1 -- 172.21.15.53:0/1521311787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc010cf0 con 0x7f37e8108160 2024-08-31T06:17:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.580+0000 7f37ed074640 1 -- 172.21.15.53:0/1521311787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e81a6c20 con 0x7f37e8108160 2024-08-31T06:17:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.582+0000 7f37ed074640 1 -- 172.21.15.53:0/1521311787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e8103aa0 con 0x7f37e8108160 2024-08-31T06:17:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.584+0000 7f37cffff640 1 -- 172.21.15.53:0/1521311787 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f37dc0119d0 con 0x7f37e8108160 2024-08-31T06:17:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.585+0000 7f37cffff640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37d00b4ca0 0x7f37d00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.585+0000 7f37e6d9d640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37d00b4ca0 0x7f37d00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.585+0000 7f37cffff640 1 -- 172.21.15.53:0/1521311787 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f37dc0e5290 con 0x7f37e8108160 2024-08-31T06:17:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.585+0000 7f37e6d9d640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37d00b4ca0 0x7f37d00b71b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f37d8000c00 tx=0x7f37d8032c60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:47.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.588+0000 7f37cffff640 1 -- 172.21.15.53:0/1521311787 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f37dc0ac060 con 0x7f37e8108160 2024-08-31T06:17:47.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.839+0000 7f37ed074640 1 -- 172.21.15.53:0/1521311787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37e819b310 con 0x7f37e8108160 2024-08-31T06:17:47.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.840+0000 7f37cffff640 1 -- 172.21.15.53:0/1521311787 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+12004 (secure 0 0 0) 0x7f37e819b310 con 0x7f37e8108160 2024-08-31T06:17:47.842 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:17:47.842 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":54,"btime":"2024-08-31T06:17:29:658044+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:17:28.801260+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:17:47.843 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 54 2024-08-31T06:17:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.842+0000 7f37ed074640 1 -- 172.21.15.53:0/1521311787 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37d00b4ca0 msgr2=0x7f37d00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.842+0000 7f37ed074640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37d00b4ca0 0x7f37d00b71b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f37d8000c00 tx=0x7f37d8032c60 comp rx=0 tx=0).stop 2024-08-31T06:17:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.842+0000 7f37ed074640 1 -- 172.21.15.53:0/1521311787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e8108160 msgr2=0x7f37e819a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.842+0000 7f37ed074640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e8108160 0x7f37e819a780 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f37dc006fd0 tx=0x7f37dc00b8e0 comp rx=0 tx=0).stop 2024-08-31T06:17:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.842+0000 7f37ed074640 1 -- 172.21.15.53:0/1521311787 shutdown_connections 2024-08-31T06:17:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.842+0000 7f37ed074640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37d00b4ca0 0x7f37d00b71b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.842+0000 7f37ed074640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37e8108ab0 0x7f37e819fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.842+0000 7f37ed074640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e8108160 0x7f37e819a780 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.842+0000 7f37ed074640 1 --2- 172.21.15.53:0/1521311787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e8102870 0x7f37e819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.842+0000 7f37ed074640 1 -- 172.21.15.53:0/1521311787 >> 172.21.15.53:0/1521311787 conn(0x7f37e8079470 msgr2=0x7f37e8101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:47.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.843+0000 7f37ed074640 1 -- 172.21.15.53:0/1521311787 shutdown_connections 2024-08-31T06:17:47.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:47.843+0000 7f37ed074640 1 -- 172.21.15.53:0/1521311787 wait complete. 2024-08-31T06:17:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:47 smithi053 ceph-mon[18924]: pgmap v722: 97 pgs: 97 active+clean; 112 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 881 KiB/s wr, 102 op/s 2024-08-31T06:17:48.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 195694 1.34 MB/sec execute 577 sec latency 17.202 ms 2024-08-31T06:17:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:47 smithi130 ceph-mon[22266]: pgmap v722: 97 pgs: 97 active+clean; 112 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 881 KiB/s wr, 102 op/s 2024-08-31T06:17:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:47 smithi153 ceph-mon[22320]: pgmap v722: 97 pgs: 97 active+clean; 112 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 881 KiB/s wr, 102 op/s 2024-08-31T06:17:48.560 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 134.7 --await-for 45.0' 2024-08-31T06:17:48.560 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 134.7 --await-for 45.0 2024-08-31T06:17:48.879 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:17:48.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:48 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1521311787' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:17:49.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196165 1.34 MB/sec execute 578 sec latency 14.429 ms 2024-08-31T06:17:49.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:48 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1521311787' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:17:49.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:48 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1521311787' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:17:49.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.395+0000 7f49a7f8b640 1 -- 172.21.15.53:0/435969971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0102820 msgr2=0x7f49a0102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:49.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.395+0000 7f49a7f8b640 1 --2- 172.21.15.53:0/435969971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0102820 0x7f49a0102c30 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f499c009900 tx=0x7f499c02a410 comp rx=0 tx=0).stop 2024-08-31T06:17:49.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.395+0000 7f49a7f8b640 1 -- 172.21.15.53:0/435969971 shutdown_connections 2024-08-31T06:17:49.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.395+0000 7f49a7f8b640 1 --2- 172.21.15.53:0/435969971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a0108bc0 0x7f49a010f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.395+0000 7f49a7f8b640 1 --2- 172.21.15.53:0/435969971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a0108270 0x7f49a0108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.395+0000 7f49a7f8b640 1 --2- 172.21.15.53:0/435969971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0102820 0x7f49a0102c30 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.395+0000 7f49a7f8b640 1 -- 172.21.15.53:0/435969971 >> 172.21.15.53:0/435969971 conn(0x7f49a00794c0 msgr2=0x7f49a00798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:49.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.395+0000 7f49a7f8b640 1 -- 172.21.15.53:0/435969971 shutdown_connections 2024-08-31T06:17:49.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.395+0000 7f49a7f8b640 1 -- 172.21.15.53:0/435969971 wait complete. 2024-08-31T06:17:49.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.396+0000 7f49a7f8b640 1 Processor -- start 2024-08-31T06:17:49.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.396+0000 7f49a7f8b640 1 -- start start 2024-08-31T06:17:49.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.396+0000 7f49a7f8b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a0102820 0x7f49a019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.396+0000 7f49a7f8b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a0108270 0x7f49a019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.396+0000 7f49a7f8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0108bc0 0x7f49a019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.396+0000 7f49a7f8b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f49a0112730 con 0x7f49a0108bc0 2024-08-31T06:17:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.396+0000 7f49a7f8b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01125b0 con 0x7f49a0102820 2024-08-31T06:17:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.396+0000 7f49a7f8b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01128b0 con 0x7f49a0108270 2024-08-31T06:17:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a5d27640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a0102820 0x7f49a019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a5d27640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a0102820 0x7f49a019a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:40082/0 (socket says 172.21.15.53:40082) 2024-08-31T06:17:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a5d27640 1 -- 172.21.15.53:0/3922034822 learned_addr learned my addr 172.21.15.53:0/3922034822 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a6528640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0108bc0 0x7f49a019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a5526640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a0108270 0x7f49a019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a6528640 1 -- 172.21.15.53:0/3922034822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a0108270 msgr2=0x7f49a019a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a6528640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a0108270 0x7f49a019a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a6528640 1 -- 172.21.15.53:0/3922034822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a0102820 msgr2=0x7f49a019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a6528640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a0102820 0x7f49a019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a6528640 1 -- 172.21.15.53:0/3922034822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a01a0260 con 0x7f49a0108bc0 2024-08-31T06:17:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a5d27640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a0102820 0x7f49a019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a5526640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a0108270 0x7f49a019a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.397+0000 7f49a6528640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0108bc0 0x7f49a019fb30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f4998009fd0 tx=0x7f499800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.398+0000 7f4996ffd640 1 -- 172.21.15.53:0/3922034822 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499800ce20 con 0x7f49a0108bc0 2024-08-31T06:17:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.398+0000 7f49a7f8b640 1 -- 172.21.15.53:0/3922034822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a01a0550 con 0x7f49a0108bc0 2024-08-31T06:17:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.398+0000 7f4996ffd640 1 -- 172.21.15.53:0/3922034822 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4998005020 con 0x7f49a0108bc0 2024-08-31T06:17:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.398+0000 7f4996ffd640 1 -- 172.21.15.53:0/3922034822 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4998010690 con 0x7f49a0108bc0 2024-08-31T06:17:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.398+0000 7f49a7f8b640 1 -- 172.21.15.53:0/3922034822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a01a6cb0 con 0x7f49a0108bc0 2024-08-31T06:17:49.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.400+0000 7f49ae500740 1 Processor -- start 2024-08-31T06:17:49.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f4996ffd640 1 -- 172.21.15.53:0/3922034822 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4998004a40 con 0x7f49a0108bc0 2024-08-31T06:17:49.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f49ae500740 1 -- start start 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f49ae500740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154446840 0x5561547edc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f49ae500740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55615441d980 0x5561547ee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f49ae500740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154425b60 0x5561547ee710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f49ae500740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556154762330 con 0x55615441d980 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f49ae500740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5561547518c0 con 0x556154446840 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f49ae500740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556154755870 con 0x556154425b60 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f49a5d27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55615441d980 0x5561547ee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f49a5d27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55615441d980 0x5561547ee1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48212/0 (socket says 172.21.15.53:48212) 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f49a5d27640 1 -- 172.21.15.53:0/3429357933 learned_addr learned my addr 172.21.15.53:0/3429357933 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.401+0000 7f49a5526640 1 --2- 172.21.15.53:0/3429357933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154446840 0x5561547edc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f49a5526640 1 --2- 172.21.15.53:0/3429357933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154425b60 0x5561547ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f4996ffd640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f498c0b4ca0 0x7f498c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f49a5526640 1 -- 172.21.15.53:0/3429357933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154425b60 msgr2=0x5561547ee710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:49.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f49a5526640 1 --2- 172.21.15.53:0/3429357933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154425b60 0x5561547ee710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f49a6528640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f498c0b4ca0 0x7f498c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f49a5526640 1 -- 172.21.15.53:0/3429357933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55615441d980 msgr2=0x5561547ee1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:49.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f49a5526640 1 --2- 172.21.15.53:0/3429357933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55615441d980 0x5561547ee1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f49a5526640 1 -- 172.21.15.53:0/3429357933 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556154709df0 con 0x556154446840 2024-08-31T06:17:49.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f4996ffd640 1 -- 172.21.15.53:0/3922034822 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f49980e5cc0 con 0x7f49a0108bc0 2024-08-31T06:17:49.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f49a5d27640 1 --2- 172.21.15.53:0/3429357933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55615441d980 0x5561547ee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:49.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f49a5526640 1 --2- 172.21.15.53:0/3429357933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154446840 0x5561547edc90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f49a006b2d0 tx=0x7f4990009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62f366cfa7f99439 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:49.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f498bfff640 1 -- 172.21.15.53:0/3429357933 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990012ca0 con 0x556154446840 2024-08-31T06:17:49.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f498bfff640 1 -- 172.21.15.53:0/3429357933 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49900044d0 con 0x556154446840 2024-08-31T06:17:49.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.402+0000 7f498bfff640 1 -- 172.21.15.53:0/3429357933 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900035f0 con 0x556154446840 2024-08-31T06:17:49.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.403+0000 7f49ae500740 1 -- 172.21.15.53:0/3429357933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154446840 msgr2=0x5561547edc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:49.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.403+0000 7f49ae500740 1 --2- 172.21.15.53:0/3429357933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154446840 0x5561547edc90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f49a006b2d0 tx=0x7f4990009680 comp rx=0 tx=0).stop 2024-08-31T06:17:49.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.403+0000 7f49a6528640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f498c0b4ca0 0x7f498c0b71b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f49980e34a0 tx=0x7f49980b5040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:49.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.404+0000 7f49ae500740 1 -- 172.21.15.53:0/3429357933 shutdown_connections 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.404+0000 7f49ae500740 1 --2- 172.21.15.53:0/3429357933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154425b60 0x5561547ee710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.404+0000 7f49ae500740 1 --2- 172.21.15.53:0/3429357933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55615441d980 0x5561547ee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.404+0000 7f49ae500740 1 --2- 172.21.15.53:0/3429357933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154446840 0x5561547edc90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.404+0000 7f49ae500740 1 -- 172.21.15.53:0/3429357933 >> 172.21.15.53:0/3429357933 conn(0x55615443a990 msgr2=0x5561547ebb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.404+0000 7f49ae500740 1 -- 172.21.15.53:0/3429357933 shutdown_connections 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.404+0000 7f49ae500740 1 -- 172.21.15.53:0/3429357933 wait complete. 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.404+0000 7f49ae500740 1 -- start start 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.404+0000 7f49ae500740 1 Processor -- start 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49ae500740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55615441d980 0x5561547f94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49ae500740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154425b60 0x5561547f9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49ae500740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154446840 0x556154805790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49ae500740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5561545b47a0 con 0x556154446840 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49ae500740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5561546d8240 con 0x55615441d980 2024-08-31T06:17:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49ae500740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5561547fc470 con 0x556154425b60 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49ae500740 10 client.0 _ll_register_callbacks cb 0x55615445e090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49a5526640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154446840 0x556154805790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49a5526640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154446840 0x556154805790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48218/0 (socket says 172.21.15.53:48218) 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49a5526640 1 -- 172.21.15.53:0/1807570482 learned_addr learned my addr 172.21.15.53:0/1807570482 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49a5d27640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154425b60 0x5561547f9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49a5526640 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55615441d980 0x5561547f94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49a5d27640 1 -- 172.21.15.53:0/1807570482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55615441d980 msgr2=0x5561547f94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49a5d27640 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55615441d980 0x5561547f94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49a5d27640 1 -- 172.21.15.53:0/1807570482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154446840 msgr2=0x556154805790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49a5d27640 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154446840 0x556154805790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49a5d27640 1 -- 172.21.15.53:0/1807570482 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55615470e2b0 con 0x556154425b60 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.405+0000 7f49a5526640 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154446840 0x556154805790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.406+0000 7f49a5d27640 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154425b60 0x5561547f9a60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5561547ec910 tx=0x7f499c031700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1df25fe3af21c447 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.406+0000 7f49897fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:17:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.406+0000 7f49897fa640 1 -- 172.21.15.53:0/1807570482 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c049060 con 0x556154425b60 2024-08-31T06:17:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.406+0000 7f49897fa640 1 -- 172.21.15.53:0/1807570482 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f499c004450 con 0x556154425b60 2024-08-31T06:17:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.406+0000 7f49ae500740 1 -- 172.21.15.53:0/1807570482 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49900044d0 con 0x556154425b60 2024-08-31T06:17:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.406+0000 7f49897fa640 1 -- 172.21.15.53:0/1807570482 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f499c035070 con 0x556154425b60 2024-08-31T06:17:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.406+0000 7f49ae500740 10 client.28687 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.406+0000 7f49ae500740 1 -- 172.21.15.53:0/1807570482 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5561544c0b90 con 0x556154425b60 2024-08-31T06:17:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.406+0000 7f49897fa640 1 -- 172.21.15.53:0/1807570482 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49900044d0 con 0x556154425b60 2024-08-31T06:17:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.407+0000 7f49897fa640 1 -- 172.21.15.53:0/1807570482 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f499c043030 con 0x556154425b60 2024-08-31T06:17:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.407+0000 7f49ae500740 10 client.28687 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.407+0000 7f49ae500740 10 client.28687 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:17:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.407+0000 7f49ae500740 20 client.28687 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.407+0000 7f49ae500740 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561544051c0 0x55615480b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.407+0000 7f49ae500740 4 client.28687 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.407+0000 7f49ae500740 1 -- 172.21.15.53:0/1807570482 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556154764280 con 0x5561544051c0 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.407+0000 7f49a5526640 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561544051c0 0x55615480b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.407+0000 7f49897fa640 10 client.28687 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.407+0000 7f49a5526640 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561544051c0 0x55615480b720 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e21fea85b24993d server_cookie=130f63526246428d in_seq=0 out_seq=0 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.408+0000 7f49897fa640 1 -- 172.21.15.53:0/1807570482 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556154764280 con 0x5561544051c0 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.408+0000 7f49897fa640 10 client.28687 handle_command_reply: tid=0 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 1 client.28687 shutdown 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 1 -- 172.21.15.53:0/1807570482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154425b60 msgr2=0x5561547f9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154425b60 0x5561547f9a60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5561547ec910 tx=0x7f499c031700 comp rx=0 tx=0).stop 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 1 -- 172.21.15.53:0/1807570482 shutdown_connections 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561544051c0 0x55615480b720 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154446840 0x556154805790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154425b60 0x5561547f9a60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 1 --2- 172.21.15.53:0/1807570482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55615441d980 0x5561547f94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49897fa640 0 client.28687 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 1 -- 172.21.15.53:0/1807570482 >> 172.21.15.53:0/1807570482 conn(0x55615443a990 msgr2=0x5561547f0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 1 -- 172.21.15.53:0/1807570482 shutdown_connections 2024-08-31T06:17:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 1 -- 172.21.15.53:0/1807570482 wait complete. 2024-08-31T06:17:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.409+0000 7f49ae500740 20 client.28687 trim_cache size 0 max 16384 2024-08-31T06:17:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.430+0000 7f49ae500740 1 Processor -- start 2024-08-31T06:17:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.430+0000 7f49ae500740 1 -- start start 2024-08-31T06:17:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.430+0000 7f49ae500740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55615441d980 0x5561547ef680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.430+0000 7f49ae500740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.430+0000 7f49ae500740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154446840 0x5561547f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.430+0000 7f49ae500740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01af500 con 0x556154425b60 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.430+0000 7f49ae500740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01b1250 con 0x556154446840 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.430+0000 7f49ae500740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01afbd0 con 0x55615441d980 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.430+0000 7f49a5d27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.430+0000 7f49a5d27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48230/0 (socket says 172.21.15.53:48230) 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f49a5d27640 1 -- 172.21.15.53:0/3855271701 learned_addr learned my addr 172.21.15.53:0/3855271701 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f49a5526640 1 --2- 172.21.15.53:0/3855271701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55615441d980 0x5561547ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f49a5526640 1 --2- 172.21.15.53:0/3855271701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154446840 0x5561547f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f49a5d27640 1 -- 172.21.15.53:0/3855271701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55615441d980 msgr2=0x5561547ef680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f49a5d27640 1 --2- 172.21.15.53:0/3855271701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55615441d980 0x5561547ef680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f49a5d27640 1 -- 172.21.15.53:0/3855271701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154446840 msgr2=0x5561547f66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f49a5d27640 1 --2- 172.21.15.53:0/3855271701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154446840 0x5561547f66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f49a5d27640 1 -- 172.21.15.53:0/3855271701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556154721d90 con 0x556154425b60 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f49a5d27640 1 --2- 172.21.15.53:0/3855271701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fb110 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f499c005e00 tx=0x7f499c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eed1f07a76d2639 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f498b7fe640 1 -- 172.21.15.53:0/3855271701 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c049040 con 0x556154425b60 2024-08-31T06:17:49.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f498b7fe640 1 -- 172.21.15.53:0/3855271701 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f499c03c920 con 0x556154425b60 2024-08-31T06:17:49.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.431+0000 7f498b7fe640 1 -- 172.21.15.53:0/3855271701 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c03cdc0 con 0x556154425b60 2024-08-31T06:17:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.432+0000 7f49ae500740 1 -- 172.21.15.53:0/3855271701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 msgr2=0x5561547fb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.432+0000 7f49ae500740 1 --2- 172.21.15.53:0/3855271701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fb110 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f499c005e00 tx=0x7f499c000bc0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.432+0000 7f49ae500740 1 -- 172.21.15.53:0/3855271701 shutdown_connections 2024-08-31T06:17:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.432+0000 7f49ae500740 1 --2- 172.21.15.53:0/3855271701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154446840 0x5561547f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.432+0000 7f49ae500740 1 --2- 172.21.15.53:0/3855271701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fb110 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.432+0000 7f49ae500740 1 --2- 172.21.15.53:0/3855271701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55615441d980 0x5561547ef680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.432+0000 7f49ae500740 1 -- 172.21.15.53:0/3855271701 >> 172.21.15.53:0/3855271701 conn(0x55615443a990 msgr2=0x5561547faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.432+0000 7f49ae500740 1 -- 172.21.15.53:0/3855271701 shutdown_connections 2024-08-31T06:17:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.432+0000 7f49ae500740 1 -- 172.21.15.53:0/3855271701 wait complete. 2024-08-31T06:17:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.433+0000 7f49ae500740 1 -- start start 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.433+0000 7f49ae500740 1 Processor -- start 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.433+0000 7f49ae500740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55615441d980 0x556154801bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.433+0000 7f49ae500740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.433+0000 7f49ae500740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154446840 0x5561547fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.433+0000 7f49ae500740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01b0ac0 con 0x556154425b60 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.433+0000 7f49ae500740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01b0360 con 0x55615441d980 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.433+0000 7f49ae500740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01ad500 con 0x556154446840 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.433+0000 7f49ae500740 10 client.0 _ll_register_callbacks cb 0x7f499c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.433+0000 7f49a5d27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49a5d27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48232/0 (socket says 172.21.15.53:48232) 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49a5d27640 1 -- 172.21.15.53:0/3637437114 learned_addr learned my addr 172.21.15.53:0/3637437114 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49a5526640 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55615441d980 0x556154801bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49a5526640 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154446840 0x5561547fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49a5d27640 1 -- 172.21.15.53:0/3637437114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154446840 msgr2=0x5561547fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49a5d27640 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154446840 0x5561547fcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49a5d27640 1 -- 172.21.15.53:0/3637437114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55615441d980 msgr2=0x556154801bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49a5d27640 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55615441d980 0x556154801bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49a5d27640 1 -- 172.21.15.53:0/3637437114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561547fd130 con 0x556154425b60 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49a5526640 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55615441d980 0x556154801bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49a5d27640 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fc6b0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f499c009850 tx=0x7f499c004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482a112ae2f3480d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49897fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.434+0000 7f49897fa640 1 -- 172.21.15.53:0/3637437114 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c049040 con 0x556154425b60 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.435+0000 7f49ae500740 1 -- 172.21.15.53:0/3637437114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f499c03c920 con 0x556154425b60 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.435+0000 7f49897fa640 1 -- 172.21.15.53:0/3637437114 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f499c03cd80 con 0x556154425b60 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.435+0000 7f49897fa640 1 -- 172.21.15.53:0/3637437114 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f499c067050 con 0x556154425b60 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.435+0000 7f49ae500740 10 client.19671 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.435+0000 7f49ae500740 1 -- 172.21.15.53:0/3637437114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x556154876d10 con 0x556154425b60 2024-08-31T06:17:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.435+0000 7f49897fa640 1 -- 172.21.15.53:0/3637437114 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f499c03c920 con 0x556154425b60 2024-08-31T06:17:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.435+0000 7f49897fa640 1 -- 172.21.15.53:0/3637437114 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f499c043040 con 0x556154425b60 2024-08-31T06:17:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.435+0000 7f49ae500740 10 client.19671 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.435+0000 7f49ae500740 10 client.19671 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:17:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.435+0000 7f49ae500740 20 client.19671 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.435+0000 7f49ae500740 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561543da570 0x556154879430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.436+0000 7f49ae500740 4 client.19671 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.7, "await_for": 45.0}] 2024-08-31T06:17:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.436+0000 7f49ae500740 1 -- 172.21.15.53:0/3637437114 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.7, "await_for": 45.0}) -- 0x55615475fd20 con 0x5561543da570 2024-08-31T06:17:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.436+0000 7f49a5526640 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561543da570 0x556154879430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.436+0000 7f49897fa640 10 client.19671 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.436+0000 7f49a5526640 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561543da570 0x556154879430 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b40449fa3b61de server_cookie=ed82d98f1d2ad619 in_seq=0 out_seq=0 2024-08-31T06:17:49.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.485+0000 7f49897fa640 1 -- 172.21.15.53:0/3637437114 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55615475fd20 con 0x5561543da570 2024-08-31T06:17:49.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.485+0000 7f49897fa640 10 client.19671 handle_command_reply: tid=0 2024-08-31T06:17:49.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.485+0000 7f49ae500740 1 client.19671 shutdown 2024-08-31T06:17:49.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.485+0000 7f49ae500740 1 -- 172.21.15.53:0/3637437114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 msgr2=0x5561547fc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:49.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.485+0000 7f49ae500740 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fc6b0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f499c009850 tx=0x7f499c004500 comp rx=0 tx=0).stop 2024-08-31T06:17:49.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.485+0000 7f49ae500740 1 -- 172.21.15.53:0/3637437114 shutdown_connections 2024-08-31T06:17:49.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.485+0000 7f49ae500740 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561543da570 0x556154879430 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.485+0000 7f49ae500740 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556154446840 0x5561547fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.485+0000 7f49ae500740 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556154425b60 0x5561547fc6b0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.485+0000 7f49897fa640 0 client.19671 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:49.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.485+0000 7f49ae500740 1 --2- 172.21.15.53:0/3637437114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55615441d980 0x556154801bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.486+0000 7f49ae500740 1 -- 172.21.15.53:0/3637437114 >> 172.21.15.53:0/3637437114 conn(0x55615443a990 msgr2=0x5561547ef450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:49.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.486+0000 7f49ae500740 1 -- 172.21.15.53:0/3637437114 shutdown_connections 2024-08-31T06:17:49.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.486+0000 7f49ae500740 1 -- 172.21.15.53:0/3637437114 wait complete. 2024-08-31T06:17:49.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.486+0000 7f49ae500740 20 client.19671 trim_cache size 0 max 16384 2024-08-31T06:17:49.489 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:17:49.489 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 54, 2024-08-31T06:17:49.489 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:17:49.489 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 42, 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "56cee97c": { 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 42, 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 134.7, 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:17:49.490 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:17:49.491 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:17:49.491 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:17:49.491 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:17:49.491 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:17:49.491 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:17:49.491 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:17:49.491 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:17:49.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.486+0000 7f49a7f8b640 1 -- 172.21.15.53:0/3922034822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f498c0b4ca0 msgr2=0x7f498c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:49.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.486+0000 7f49a7f8b640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f498c0b4ca0 0x7f498c0b71b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f49980e34a0 tx=0x7f49980b5040 comp rx=0 tx=0).stop 2024-08-31T06:17:49.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.486+0000 7f49a7f8b640 1 -- 172.21.15.53:0/3922034822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0108bc0 msgr2=0x7f49a019fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:49.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.486+0000 7f49a7f8b640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0108bc0 0x7f49a019fb30 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f4998009fd0 tx=0x7f499800ef10 comp rx=0 tx=0).stop 2024-08-31T06:17:49.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.487+0000 7f49a7f8b640 1 -- 172.21.15.53:0/3922034822 shutdown_connections 2024-08-31T06:17:49.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.487+0000 7f49a7f8b640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f498c0b4ca0 0x7f498c0b71b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.487+0000 7f49a7f8b640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0108bc0 0x7f49a019fb30 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.487+0000 7f49a7f8b640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a0108270 0x7f49a019a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.487+0000 7f49a7f8b640 1 --2- 172.21.15.53:0/3922034822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49a0102820 0x7f49a019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:49.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.487+0000 7f49a7f8b640 1 -- 172.21.15.53:0/3922034822 >> 172.21.15.53:0/3922034822 conn(0x7f49a00794c0 msgr2=0x7f49a006bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:49.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.487+0000 7f49a7f8b640 1 -- 172.21.15.53:0/3922034822 shutdown_connections 2024-08-31T06:17:49.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:17:49.487+0000 7f49a7f8b640 1 -- 172.21.15.53:0/3922034822 wait complete. 2024-08-31T06:17:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:49 smithi053 ceph-mon[18924]: pgmap v723: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-08-31T06:17:50.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.34 MB/sec execute 579 sec latency 523.925 ms 2024-08-31T06:17:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:49 smithi130 ceph-mon[22266]: pgmap v723: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-08-31T06:17:50.129 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '56cee97c', quiesce took 4.2 seconds. Will release after: 10.5 2024-08-31T06:17:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:49 smithi153 ceph-mon[22320]: pgmap v723: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-08-31T06:17:51.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.33 MB/sec execute 580 sec latency 1524.025 ms 2024-08-31T06:17:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:51 smithi053 ceph-mon[18924]: pgmap v724: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 1.2 MiB/s wr, 127 op/s 2024-08-31T06:17:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:17:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:17:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:17:51.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:17:52.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.33 MB/sec execute 581 sec latency 2524.122 ms 2024-08-31T06:17:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:51 smithi130 ceph-mon[22266]: pgmap v724: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 1.2 MiB/s wr, 127 op/s 2024-08-31T06:17:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:17:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:17:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:17:52.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:17:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:51 smithi153 ceph-mon[22320]: pgmap v724: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 1.2 MiB/s wr, 127 op/s 2024-08-31T06:17:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:17:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:17:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:17:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:17:53.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.33 MB/sec execute 582 sec latency 3524.233 ms 2024-08-31T06:17:53.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:53 smithi053 ceph-mon[18924]: pgmap v725: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.1 MiB/s wr, 138 op/s 2024-08-31T06:17:54.001 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.33 MB/sec execute 583 sec latency 4524.335 ms 2024-08-31T06:17:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:53 smithi130 ceph-mon[22266]: pgmap v725: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.1 MiB/s wr, 138 op/s 2024-08-31T06:17:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:53 smithi153 ceph-mon[22320]: pgmap v725: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.1 MiB/s wr, 138 op/s 2024-08-31T06:17:55.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.33 MB/sec execute 584 sec latency 5524.436 ms 2024-08-31T06:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.796+0000 7f558081d640 1 -- 172.21.15.53:0/2984694809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f557c1038a0 msgr2=0x7f557c103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.796+0000 7f558081d640 1 --2- 172.21.15.53:0/2984694809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f557c1038a0 0x7f557c103cb0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f556c009900 tx=0x7f556c02a410 comp rx=0 tx=0).stop 2024-08-31T06:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.797+0000 7f558081d640 1 -- 172.21.15.53:0/2984694809 shutdown_connections 2024-08-31T06:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.797+0000 7f558081d640 1 --2- 172.21.15.53:0/2984694809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f557c109b20 0x7f557c110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.797+0000 7f558081d640 1 --2- 172.21.15.53:0/2984694809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f557c1091d0 0x7f557c1095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.797+0000 7f558081d640 1 --2- 172.21.15.53:0/2984694809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f557c1038a0 0x7f557c103cb0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.797+0000 7f558081d640 1 -- 172.21.15.53:0/2984694809 >> 172.21.15.53:0/2984694809 conn(0x7f557c0ff2a0 msgr2=0x7f557c1016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:55.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.797+0000 7f558081d640 1 -- 172.21.15.53:0/2984694809 shutdown_connections 2024-08-31T06:17:55.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.797+0000 7f558081d640 1 -- 172.21.15.53:0/2984694809 wait complete. 2024-08-31T06:17:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.798+0000 7f558081d640 1 Processor -- start 2024-08-31T06:17:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.798+0000 7f558081d640 1 -- start start 2024-08-31T06:17:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.798+0000 7f558081d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f557c1038a0 0x7f557c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.798+0000 7f558081d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f557c1091d0 0x7f557c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.798+0000 7f558081d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f557c109b20 0x7f557c19f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.798+0000 7f558081d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f557c113690 con 0x7f557c109b20 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.798+0000 7f558081d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f557c113510 con 0x7f557c1091d0 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.798+0000 7f558081d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f557c113810 con 0x7f557c1038a0 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f557ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f557c109b20 0x7f557c19f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f557a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f557c1038a0 0x7f557c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f5579d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f557c1091d0 0x7f557c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f557ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f557c109b20 0x7f557c19f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45474/0 (socket says 172.21.15.53:45474) 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f557ad9d640 1 -- 172.21.15.53:0/3262136985 learned_addr learned my addr 172.21.15.53:0/3262136985 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f557ad9d640 1 -- 172.21.15.53:0/3262136985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f557c1038a0 msgr2=0x7f557c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f557ad9d640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f557c1038a0 0x7f557c19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f557ad9d640 1 -- 172.21.15.53:0/3262136985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f557c1091d0 msgr2=0x7f557c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f557ad9d640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f557c1091d0 0x7f557c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f557ad9d640 1 -- 172.21.15.53:0/3262136985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557c1a00a0 con 0x7f557c109b20 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f5579d9b640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f557c1091d0 0x7f557c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:17:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f557ad9d640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f557c109b20 0x7f557c19f9a0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f5574009fd0 tx=0x7f557400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f556b7fe640 1 -- 172.21.15.53:0/3262136985 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5574017070 con 0x7f557c109b20 2024-08-31T06:17:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f558081d640 1 -- 172.21.15.53:0/3262136985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557c1a0390 con 0x7f557c109b20 2024-08-31T06:17:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f556b7fe640 1 -- 172.21.15.53:0/3262136985 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5574003e00 con 0x7f557c109b20 2024-08-31T06:17:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f556b7fe640 1 -- 172.21.15.53:0/3262136985 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5574010460 con 0x7f557c109b20 2024-08-31T06:17:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.799+0000 7f558081d640 1 -- 172.21.15.53:0/3262136985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f557c1a6b20 con 0x7f557c109b20 2024-08-31T06:17:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.802+0000 7f5587863740 1 Processor -- start 2024-08-31T06:17:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.802+0000 7f556b7fe640 1 -- 172.21.15.53:0/3262136985 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5574003970 con 0x7f557c109b20 2024-08-31T06:17:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f5587863740 1 -- start start 2024-08-31T06:17:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f5587863740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ef01b0 0x55e544293ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f5587863740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e544294000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f5587863740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e544294540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f5587863740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e544209000 con 0x55e543ec72f0 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f5587863740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e5441f8590 con 0x55e543ecf4d0 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f5587863740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e5441fc540 con 0x55e543ef01b0 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f557a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e544294000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f557a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e544294000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45476/0 (socket says 172.21.15.53:45476) 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f557a59c640 1 -- 172.21.15.53:0/3976794832 learned_addr learned my addr 172.21.15.53:0/3976794832 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f5579d9b640 1 --2- 172.21.15.53:0/3976794832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ef01b0 0x55e544293ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f5579d9b640 1 --2- 172.21.15.53:0/3976794832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e544294540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f556b7fe640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f55640b4ca0 0x7f55640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f557a59c640 1 -- 172.21.15.53:0/3976794832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ef01b0 msgr2=0x55e544293ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f557a59c640 1 --2- 172.21.15.53:0/3976794832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ef01b0 0x55e544293ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f557a59c640 1 -- 172.21.15.53:0/3976794832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 msgr2=0x55e544294540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f557a59c640 1 --2- 172.21.15.53:0/3976794832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e544294540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f557a59c640 1 -- 172.21.15.53:0/3976794832 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e543f5b790 con 0x55e543ec72f0 2024-08-31T06:17:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.803+0000 7f5579d9b640 1 --2- 172.21.15.53:0/3976794832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e544294540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:17:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.804+0000 7f557ad9d640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f55640b4ca0 0x7f55640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.804+0000 7f557a59c640 1 --2- 172.21.15.53:0/3976794832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e544294000 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f556c02a930 tx=0x7f556c031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7805ec8339bf6bdf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.804+0000 7f556b7fe640 1 -- 172.21.15.53:0/3262136985 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f55740e5620 con 0x7f557c109b20 2024-08-31T06:17:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.804+0000 7f5568ff9640 1 -- 172.21.15.53:0/3976794832 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c035030 con 0x55e543ec72f0 2024-08-31T06:17:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.804+0000 7f5568ff9640 1 -- 172.21.15.53:0/3976794832 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f556c040070 con 0x55e543ec72f0 2024-08-31T06:17:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.804+0000 7f5568ff9640 1 -- 172.21.15.53:0/3976794832 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c0038c0 con 0x55e543ec72f0 2024-08-31T06:17:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.805+0000 7f5587863740 1 -- 172.21.15.53:0/3976794832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 msgr2=0x55e544294000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.805+0000 7f557ad9d640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f55640b4ca0 0x7f55640b71b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f55740abaa0 tx=0x7f5574093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.805+0000 7f5587863740 1 --2- 172.21.15.53:0/3976794832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e544294000 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f556c02a930 tx=0x7f556c031af0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.805+0000 7f5587863740 1 -- 172.21.15.53:0/3976794832 shutdown_connections 2024-08-31T06:17:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.805+0000 7f5587863740 1 --2- 172.21.15.53:0/3976794832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e544294540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.805+0000 7f5587863740 1 --2- 172.21.15.53:0/3976794832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e544294000 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.805+0000 7f5587863740 1 --2- 172.21.15.53:0/3976794832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ef01b0 0x55e544293ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.805+0000 7f5587863740 1 -- 172.21.15.53:0/3976794832 >> 172.21.15.53:0/3976794832 conn(0x55e543ee4300 msgr2=0x55e5442919b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.805+0000 7f5587863740 1 -- 172.21.15.53:0/3976794832 shutdown_connections 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.805+0000 7f5587863740 1 -- 172.21.15.53:0/3976794832 wait complete. 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.805+0000 7f5587863740 1 -- start start 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5587863740 1 Processor -- start 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5587863740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e54429f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5587863740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e54429fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5587863740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ef01b0 0x55e5442ab500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5587863740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e544131ab0 con 0x55e543ec72f0 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5587863740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e54417f680 con 0x55e543ecf4d0 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5587863740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e5442a21e0 con 0x55e543ef01b0 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5587863740 10 client.0 _ll_register_callbacks cb 0x55e543f07a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5579d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e54429f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5579d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e54429f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45490/0 (socket says 172.21.15.53:45490) 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5579d9b640 1 -- 172.21.15.53:0/102361489 learned_addr learned my addr 172.21.15.53:0/102361489 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f557a59c640 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e54429fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5579d9b640 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ef01b0 0x55e5442ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5579d9b640 1 -- 172.21.15.53:0/102361489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ef01b0 msgr2=0x55e5442ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5579d9b640 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ef01b0 0x55e5442ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5579d9b640 1 -- 172.21.15.53:0/102361489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 msgr2=0x55e54429fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5579d9b640 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e54429fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.806+0000 7f5579d9b640 1 -- 172.21.15.53:0/102361489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e543fd4620 con 0x55e543ec72f0 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5579d9b640 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e54429f660 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f5570004620 tx=0x7f5570005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1589580081bc0963 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5561ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5561ffb640 1 -- 172.21.15.53:0/102361489 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570005020 con 0x55e543ec72f0 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5561ffb640 1 -- 172.21.15.53:0/102361489 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f55700051c0 con 0x55e543ec72f0 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5587863740 1 -- 172.21.15.53:0/102361489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f556c040070 con 0x55e543ec72f0 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5561ffb640 1 -- 172.21.15.53:0/102361489 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f55700053c0 con 0x55e543ec72f0 2024-08-31T06:17:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5587863740 10 client.19683 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5587863740 1 -- 172.21.15.53:0/102361489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55e5442ae260 con 0x55e543ec72f0 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5561ffb640 1 -- 172.21.15.53:0/102361489 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f556c040070 con 0x55e543ec72f0 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5561ffb640 1 -- 172.21.15.53:0/102361489 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f557001d030 con 0x55e543ec72f0 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5587863740 10 client.19683 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5587863740 10 client.19683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5587863740 20 client.19683 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.807+0000 7f5587863740 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e543eaed80 0x55e5442b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.808+0000 7f5587863740 4 client.19683 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.808+0000 7f5587863740 1 -- 172.21.15.53:0/102361489 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e54420af50 con 0x55e543eaed80 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.808+0000 7f557a59c640 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e543eaed80 0x55e5442b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.808+0000 7f5561ffb640 10 client.19683 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.808+0000 7f557a59c640 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e543eaed80 0x55e5442b1810 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=748a21d2df3e7fc7 server_cookie=2ab8a9dd584e21a6 in_seq=0 out_seq=0 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5561ffb640 1 -- 172.21.15.53:0/102361489 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e54420af50 con 0x55e543eaed80 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5561ffb640 10 client.19683 handle_command_reply: tid=0 2024-08-31T06:17:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5587863740 1 client.19683 shutdown 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5587863740 1 -- 172.21.15.53:0/102361489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 msgr2=0x55e54429f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5587863740 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e54429f660 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f5570004620 tx=0x7f5570005f90 comp rx=0 tx=0).stop 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5587863740 1 -- 172.21.15.53:0/102361489 shutdown_connections 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5587863740 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e543eaed80 0x55e5442b1810 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5587863740 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ef01b0 0x55e5442ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5587863740 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e54429fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5561ffb640 0 client.19683 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5587863740 1 --2- 172.21.15.53:0/102361489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ec72f0 0x55e54429f660 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5587863740 1 -- 172.21.15.53:0/102361489 >> 172.21.15.53:0/102361489 conn(0x55e543ee4300 msgr2=0x55e544294af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5587863740 1 -- 172.21.15.53:0/102361489 shutdown_connections 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.809+0000 7f5587863740 1 -- 172.21.15.53:0/102361489 wait complete. 2024-08-31T06:17:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.810+0000 7f5587863740 20 client.19683 trim_cache size 0 max 16384 2024-08-31T06:17:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.824+0000 7f5587863740 1 Processor -- start 2024-08-31T06:17:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.824+0000 7f5587863740 1 -- start start 2024-08-31T06:17:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5587863740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ec72f0 0x55e54429c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5587863740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ecf4d0 0x55e54429cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5587863740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5587863740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1af510 con 0x55e543ef01b0 2024-08-31T06:17:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5587863740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1b1260 con 0x55e543ec72f0 2024-08-31T06:17:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5587863740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1afbe0 con 0x55e543ecf4d0 2024-08-31T06:17:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5579d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5579d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442b7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45502/0 (socket says 172.21.15.53:45502) 2024-08-31T06:17:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5579d9b640 1 -- 172.21.15.53:0/2310177988 learned_addr learned my addr 172.21.15.53:0/2310177988 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5579d9b640 1 -- 172.21.15.53:0/2310177988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ecf4d0 msgr2=0x55e54429cb60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:17:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5579d9b640 1 --2- 172.21.15.53:0/2310177988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ecf4d0 0x55e54429cb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5579d9b640 1 -- 172.21.15.53:0/2310177988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ec72f0 msgr2=0x55e54429c620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:17:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5579d9b640 1 --2- 172.21.15.53:0/2310177988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ec72f0 0x55e54429c620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5579d9b640 1 -- 172.21.15.53:0/2310177988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e544295dc0 con 0x55e543ef01b0 2024-08-31T06:17:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.825+0000 7f5579d9b640 1 --2- 172.21.15.53:0/2310177988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442b7010 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f55700045f0 tx=0x7f5570005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38facd464f8b27a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5563fff640 1 -- 172.21.15.53:0/2310177988 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557002e040 con 0x55e543ef01b0 2024-08-31T06:17:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5563fff640 1 -- 172.21.15.53:0/2310177988 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5570005620 con 0x55e543ef01b0 2024-08-31T06:17:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5563fff640 1 -- 172.21.15.53:0/2310177988 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55700219b0 con 0x55e543ef01b0 2024-08-31T06:17:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5587863740 1 -- 172.21.15.53:0/2310177988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 msgr2=0x55e5442b7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5587863740 1 --2- 172.21.15.53:0/2310177988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442b7010 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f55700045f0 tx=0x7f5570005db0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5587863740 1 -- 172.21.15.53:0/2310177988 shutdown_connections 2024-08-31T06:17:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5587863740 1 --2- 172.21.15.53:0/2310177988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442b7010 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5587863740 1 --2- 172.21.15.53:0/2310177988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ecf4d0 0x55e54429cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5587863740 1 --2- 172.21.15.53:0/2310177988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ec72f0 0x55e54429c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5587863740 1 -- 172.21.15.53:0/2310177988 >> 172.21.15.53:0/2310177988 conn(0x55e543ee4300 msgr2=0x55e54429dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5587863740 1 -- 172.21.15.53:0/2310177988 shutdown_connections 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.826+0000 7f5587863740 1 -- 172.21.15.53:0/2310177988 wait complete. 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5587863740 1 -- start start 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5587863740 1 Processor -- start 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5587863740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ec72f0 0x55e5442a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5587863740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e5442a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5587863740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442a6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5587863740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1b0ad0 con 0x55e543ef01b0 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5587863740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1b0370 con 0x55e543ecf4d0 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5587863740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1ad510 con 0x55e543ec72f0 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5587863740 10 client.0 _ll_register_callbacks cb 0x7f5570004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5579d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5579d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442a6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45504/0 (socket says 172.21.15.53:45504) 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5579d9b640 1 -- 172.21.15.53:0/799162629 learned_addr learned my addr 172.21.15.53:0/799162629 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:17:55.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5579d9b640 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ec72f0 0x55e5442a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f557a59c640 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e5442a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5579d9b640 1 -- 172.21.15.53:0/799162629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ec72f0 msgr2=0x55e5442a7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.827+0000 7f5579d9b640 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ec72f0 0x55e5442a7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5579d9b640 1 -- 172.21.15.53:0/799162629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 msgr2=0x55e5442a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5579d9b640 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e5442a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5579d9b640 1 -- 172.21.15.53:0/799162629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5442a6950 con 0x55e543ef01b0 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5579d9b640 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442a6410 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f5570004620 tx=0x7f55700096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e62ce533847d0f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5561ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5561ffb640 1 -- 172.21.15.53:0/799162629 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557002e070 con 0x55e543ef01b0 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5561ffb640 1 -- 172.21.15.53:0/799162629 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f5570021db0 con 0x55e543ef01b0 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5587863740 1 -- 172.21.15.53:0/799162629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5570005620 con 0x55e543ef01b0 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5561ffb640 1 -- 172.21.15.53:0/799162629 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f5570011020 con 0x55e543ef01b0 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5587863740 10 client.19689 fetch_fsmap learned FSMap version 54 2024-08-31T06:17:55.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5587863740 1 -- 172.21.15.53:0/799162629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55e54431cf30 con 0x55e543ef01b0 2024-08-31T06:17:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5561ffb640 1 -- 172.21.15.53:0/799162629 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5570005620 con 0x55e543ef01b0 2024-08-31T06:17:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5561ffb640 1 -- 172.21.15.53:0/799162629 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f557001d070 con 0x55e543ef01b0 2024-08-31T06:17:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5587863740 10 client.19689 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:17:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.828+0000 7f5587863740 10 client.19689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:17:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.829+0000 7f5587863740 20 client.19689 populate_metadata read hostname 'smithi053' 2024-08-31T06:17:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.829+0000 7f5587863740 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e543e841c0 0x55e54431f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:17:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.829+0000 7f5587863740 4 client.19689 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:17:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.829+0000 7f5587863740 1 -- 172.21.15.53:0/799162629 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e5442069f0 con 0x55e543e841c0 2024-08-31T06:17:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.829+0000 7f557a59c640 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e543e841c0 0x55e54431f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:17:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.829+0000 7f557a59c640 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e543e841c0 0x55e54431f650 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef7f742e734f28be server_cookie=278d82aad8c5b0a7 in_seq=0 out_seq=0 2024-08-31T06:17:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.829+0000 7f5561ffb640 10 client.19689 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5561ffb640 1 -- 172.21.15.53:0/799162629 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e5442069f0 con 0x55e543e841c0 2024-08-31T06:17:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5561ffb640 10 client.19689 handle_command_reply: tid=0 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 1 client.19689 shutdown 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 1 -- 172.21.15.53:0/799162629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 msgr2=0x55e5442a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442a6410 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f5570004620 tx=0x7f55700096a0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 1 -- 172.21.15.53:0/799162629 shutdown_connections 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e543e841c0 0x55e54431f650 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e543ef01b0 0x55e5442a6410 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5561ffb640 0 client.19689 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e543ecf4d0 0x55e5442a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 1 --2- 172.21.15.53:0/799162629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e543ec72f0 0x55e5442a7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 1 -- 172.21.15.53:0/799162629 >> 172.21.15.53:0/799162629 conn(0x55e543ee4300 msgr2=0x55e54429dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 1 -- 172.21.15.53:0/799162629 shutdown_connections 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 1 -- 172.21.15.53:0/799162629 wait complete. 2024-08-31T06:17:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.851+0000 7f5587863740 20 client.19689 trim_cache size 0 max 16384 2024-08-31T06:17:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:17:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:17:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:17:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 -- 172.21.15.53:0/3262136985 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f55640b4ca0 msgr2=0x7f55640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f55640b4ca0 0x7f55640b71b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f55740abaa0 tx=0x7f5574093040 comp rx=0 tx=0).stop 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 -- 172.21.15.53:0/3262136985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f557c109b20 msgr2=0x7f557c19f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f557c109b20 0x7f557c19f9a0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f5574009fd0 tx=0x7f557400b260 comp rx=0 tx=0).stop 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 -- 172.21.15.53:0/3262136985 shutdown_connections 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f55640b4ca0 0x7f55640b71b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f557c109b20 0x7f557c19f9a0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f557c1091d0 0x7f557c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 --2- 172.21.15.53:0/3262136985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f557c1038a0 0x7f557c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 -- 172.21.15.53:0/3262136985 >> 172.21.15.53:0/3262136985 conn(0x7f557c0ff2a0 msgr2=0x7f557c1016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 -- 172.21.15.53:0/3262136985 shutdown_connections 2024-08-31T06:17:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:17:55.852+0000 7f558081d640 1 -- 172.21.15.53:0/3262136985 wait complete. 2024-08-31T06:17:55.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:55 smithi053 ceph-mon[18924]: pgmap v726: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 1002 KiB/s wr, 116 op/s 2024-08-31T06:17:55.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:55 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:17:56.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.32 MB/sec execute 585 sec latency 6524.490 ms 2024-08-31T06:17:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:55 smithi130 ceph-mon[22266]: pgmap v726: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 1002 KiB/s wr, 116 op/s 2024-08-31T06:17:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:55 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:17:56.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:55 smithi153 ceph-mon[22320]: pgmap v726: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 1002 KiB/s wr, 116 op/s 2024-08-31T06:17:56.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:55 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:17:56.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:56 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:17:56.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:56 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:17:56.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:56 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:17:57.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.32 MB/sec execute 586 sec latency 7524.519 ms 2024-08-31T06:17:57.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:56 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:17:57.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:56 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:17:57.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:56 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:17:57.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:56 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:17:57.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:56 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:17:57.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:56 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:17:57.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:57 smithi053 ceph-mon[18924]: pgmap v727: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 928 KiB/s wr, 102 op/s 2024-08-31T06:17:58.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.32 MB/sec execute 587 sec latency 8524.554 ms 2024-08-31T06:17:58.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:57 smithi130 ceph-mon[22266]: pgmap v727: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 928 KiB/s wr, 102 op/s 2024-08-31T06:17:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:57 smithi153 ceph-mon[22320]: pgmap v727: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 928 KiB/s wr, 102 op/s 2024-08-31T06:17:59.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.32 MB/sec execute 588 sec latency 9524.587 ms 2024-08-31T06:17:59.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:17:59 smithi053 ceph-mon[18924]: pgmap v728: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 644 KiB/s wr, 81 op/s 2024-08-31T06:18:00.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.31 MB/sec execute 589 sec latency 10524.622 ms 2024-08-31T06:18:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:17:59 smithi130 ceph-mon[22266]: pgmap v728: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 644 KiB/s wr, 81 op/s 2024-08-31T06:18:00.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:17:59 smithi153 ceph-mon[22320]: pgmap v728: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 644 KiB/s wr, 81 op/s 2024-08-31T06:18:00.630 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:18:00.883 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:01.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.31 MB/sec execute 590 sec latency 11524.704 ms 2024-08-31T06:18:01.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.517+0000 7fef795a0640 1 -- 172.21.15.53:0/2461265348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74102610 msgr2=0x7fef74102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:01.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.517+0000 7fef795a0640 1 --2- 172.21.15.53:0/2461265348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74102610 0x7fef74102a20 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fef64009900 tx=0x7fef6402a440 comp rx=0 tx=0).stop 2024-08-31T06:18:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.517+0000 7fef795a0640 1 -- 172.21.15.53:0/2461265348 shutdown_connections 2024-08-31T06:18:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.517+0000 7fef795a0640 1 --2- 172.21.15.53:0/2461265348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef741088a0 0x7fef7410f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.517+0000 7fef795a0640 1 --2- 172.21.15.53:0/2461265348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef74107f50 0x7fef74108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.517+0000 7fef795a0640 1 --2- 172.21.15.53:0/2461265348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74102610 0x7fef74102a20 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.517+0000 7fef795a0640 1 -- 172.21.15.53:0/2461265348 >> 172.21.15.53:0/2461265348 conn(0x7fef740fe060 msgr2=0x7fef741004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.517+0000 7fef795a0640 1 -- 172.21.15.53:0/2461265348 shutdown_connections 2024-08-31T06:18:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.517+0000 7fef795a0640 1 -- 172.21.15.53:0/2461265348 wait complete. 2024-08-31T06:18:01.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.518+0000 7fef795a0640 1 Processor -- start 2024-08-31T06:18:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.518+0000 7fef795a0640 1 -- start start 2024-08-31T06:18:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.518+0000 7fef795a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74102610 0x7fef7419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.518+0000 7fef795a0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef74107f50 0x7fef7419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.518+0000 7fef795a0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef741088a0 0x7fef7419f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.518+0000 7fef795a0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fef741135f0 con 0x7fef74102610 2024-08-31T06:18:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.518+0000 7fef795a0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fef74113470 con 0x7fef741088a0 2024-08-31T06:18:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.518+0000 7fef795a0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef74113770 con 0x7fef74107f50 2024-08-31T06:18:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.518+0000 7fef73fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74102610 0x7fef7419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.518+0000 7fef73fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74102610 0x7fef7419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45530/0 (socket says 172.21.15.53:45530) 2024-08-31T06:18:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.518+0000 7fef73fff640 1 -- 172.21.15.53:0/1561129053 learned_addr learned my addr 172.21.15.53:0/1561129053 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef78d9f640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef741088a0 0x7fef7419f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef73fff640 1 -- 172.21.15.53:0/1561129053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef74107f50 msgr2=0x7fef7419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef73fff640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef74107f50 0x7fef7419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef73fff640 1 -- 172.21.15.53:0/1561129053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef741088a0 msgr2=0x7fef7419f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef73fff640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef741088a0 0x7fef7419f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef73fff640 1 -- 172.21.15.53:0/1561129053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef741a0090 con 0x7fef74102610 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef73fff640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74102610 0x7fef7419a120 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fef64006010 tx=0x7fef640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef717fa640 1 -- 172.21.15.53:0/1561129053 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6403f070 con 0x7fef74102610 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef795a0640 1 -- 172.21.15.53:0/1561129053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef741a0320 con 0x7fef74102610 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef717fa640 1 -- 172.21.15.53:0/1561129053 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef64003a80 con 0x7fef74102610 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef717fa640 1 -- 172.21.15.53:0/1561129053 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef64035070 con 0x7fef74102610 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.519+0000 7fef795a0640 1 -- 172.21.15.53:0/1561129053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef741a6ae0 con 0x7fef74102610 2024-08-31T06:18:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.521+0000 7fef795a0640 1 -- 172.21.15.53:0/1561129053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef74102aa0 con 0x7fef74102610 2024-08-31T06:18:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.522+0000 7fef717fa640 1 -- 172.21.15.53:0/1561129053 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fef64042070 con 0x7fef74102610 2024-08-31T06:18:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.523+0000 7fef717fa640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef5c0b4ca0 0x7fef5c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.523+0000 7fef737fe640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef5c0b4ca0 0x7fef5c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.523+0000 7fef717fa640 1 -- 172.21.15.53:0/1561129053 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7fef64106570 con 0x7fef74102610 2024-08-31T06:18:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.523+0000 7fef737fe640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef5c0b4ca0 0x7fef5c0b71b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fef74107ba0 tx=0x7fef68006c90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:01.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.526+0000 7fef717fa640 1 -- 172.21.15.53:0/1561129053 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fef640cd2e0 con 0x7fef74102610 2024-08-31T06:18:01.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.750+0000 7fef795a0640 1 -- 172.21.15.53:0/1561129053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef7402e430 con 0x7fef74102610 2024-08-31T06:18:01.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.751+0000 7fef717fa640 1 -- 172.21.15.53:0/1561129053 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+12004 (secure 0 0 0) 0x7fef640ccbe0 con 0x7fef74102610 2024-08-31T06:18:01.753 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:18:01.753 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":54,"btime":"2024-08-31T06:17:29:658044+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:17:28.801260+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:18:01.753 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 54 2024-08-31T06:18:01.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 -- 172.21.15.53:0/1561129053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef5c0b4ca0 msgr2=0x7fef5c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:01.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef5c0b4ca0 0x7fef5c0b71b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fef74107ba0 tx=0x7fef68006c90 comp rx=0 tx=0).stop 2024-08-31T06:18:01.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 -- 172.21.15.53:0/1561129053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74102610 msgr2=0x7fef7419a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:01.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74102610 0x7fef7419a120 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fef64006010 tx=0x7fef640042f0 comp rx=0 tx=0).stop 2024-08-31T06:18:01.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 -- 172.21.15.53:0/1561129053 shutdown_connections 2024-08-31T06:18:01.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef5c0b4ca0 0x7fef5c0b71b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:01.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef741088a0 0x7fef7419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:01.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef74107f50 0x7fef7419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:01.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 --2- 172.21.15.53:0/1561129053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74102610 0x7fef7419a120 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:01.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 -- 172.21.15.53:0/1561129053 >> 172.21.15.53:0/1561129053 conn(0x7fef740fe060 msgr2=0x7fef74100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:01.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 -- 172.21.15.53:0/1561129053 shutdown_connections 2024-08-31T06:18:01.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:01.753+0000 7fef795a0640 1 -- 172.21.15.53:0/1561129053 wait complete. 2024-08-31T06:18:01.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:01 smithi053 ceph-mon[18924]: pgmap v729: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 459 KiB/s wr, 70 op/s 2024-08-31T06:18:02.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.31 MB/sec execute 591 sec latency 12524.787 ms 2024-08-31T06:18:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:01 smithi130 ceph-mon[22266]: pgmap v729: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 459 KiB/s wr, 70 op/s 2024-08-31T06:18:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:01 smithi153 ceph-mon[22320]: pgmap v729: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 459 KiB/s wr, 70 op/s 2024-08-31T06:18:02.597 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id 56cee97c --release --await' 2024-08-31T06:18:02.597 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id 56cee97c --release --await 2024-08-31T06:18:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:02.974 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:02 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1561129053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:18:03.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196339 1.31 MB/sec execute 592 sec latency 13524.873 ms 2024-08-31T06:18:03.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:02 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1561129053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:18:03.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:02 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1561129053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:18:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.305+0000 7f4239c2a640 1 -- 172.21.15.53:0/3006622612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4234109b90 msgr2=0x7f42341103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.305+0000 7f4239c2a640 1 --2- 172.21.15.53:0/3006622612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4234109b90 0x7f42341103c0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f422c009ca0 tx=0x7f422c02a8e0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.305+0000 7f4239c2a640 1 -- 172.21.15.53:0/3006622612 shutdown_connections 2024-08-31T06:18:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.305+0000 7f4239c2a640 1 --2- 172.21.15.53:0/3006622612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4234109b90 0x7f42341103c0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.305+0000 7f4239c2a640 1 --2- 172.21.15.53:0/3006622612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4234109240 0x7f4234109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.305+0000 7f4239c2a640 1 --2- 172.21.15.53:0/3006622612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4234103900 0x7f4234103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.305+0000 7f4239c2a640 1 -- 172.21.15.53:0/3006622612 >> 172.21.15.53:0/3006622612 conn(0x7f423407b5f0 msgr2=0x7f423407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.305+0000 7f4239c2a640 1 -- 172.21.15.53:0/3006622612 shutdown_connections 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.305+0000 7f4239c2a640 1 -- 172.21.15.53:0/3006622612 wait complete. 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4239c2a640 1 Processor -- start 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4239c2a640 1 -- start start 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4239c2a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4234103900 0x7f423419a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4239c2a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4234109240 0x7f423419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4239c2a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4234109b90 0x7f423419f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4239c2a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4234113740 con 0x7f4234109240 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4239c2a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42341135c0 con 0x7f4234109b90 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4239c2a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f42341138c0 con 0x7f4234103900 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4232ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4234109240 0x7f423419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4232ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4234109240 0x7f423419a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45026/0 (socket says 172.21.15.53:45026) 2024-08-31T06:18:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4232ffd640 1 -- 172.21.15.53:0/3037164215 learned_addr learned my addr 172.21.15.53:0/3037164215 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.306+0000 7f4233fff640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4234109b90 0x7f423419f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4232ffd640 1 -- 172.21.15.53:0/3037164215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4234103900 msgr2=0x7f423419a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4232ffd640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4234103900 0x7f423419a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4232ffd640 1 -- 172.21.15.53:0/3037164215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4234109b90 msgr2=0x7f423419f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4232ffd640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4234109b90 0x7f423419f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4232ffd640 1 -- 172.21.15.53:0/3037164215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42341a00a0 con 0x7f4234109240 2024-08-31T06:18:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4233fff640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4234109b90 0x7f423419f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4232ffd640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4234109240 0x7f423419a6d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f4228006fd0 tx=0x7f422800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4230ff9640 1 -- 172.21.15.53:0/3037164215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4228011830 con 0x7f4234109240 2024-08-31T06:18:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4230ff9640 1 -- 172.21.15.53:0/3037164215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4228016070 con 0x7f4234109240 2024-08-31T06:18:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4230ff9640 1 -- 172.21.15.53:0/3037164215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4228010d30 con 0x7f4234109240 2024-08-31T06:18:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4239c2a640 1 -- 172.21.15.53:0/3037164215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42341a0390 con 0x7f4234109240 2024-08-31T06:18:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.307+0000 7f4239c2a640 1 -- 172.21.15.53:0/3037164215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42341a6af0 con 0x7f4234109240 2024-08-31T06:18:03.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f424019f740 1 Processor -- start 2024-08-31T06:18:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f424019f740 1 -- start start 2024-08-31T06:18:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f4230ff9640 1 -- 172.21.15.53:0/3037164215 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f42280119d0 con 0x7f4234109240 2024-08-31T06:18:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f424019f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571625a9520 0x55716294ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f424019f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x55716294f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f424019f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557162588840 0x55716294f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f424019f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5571628c5a70 con 0x557162580660 2024-08-31T06:18:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f424019f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5571628b5000 con 0x5571625a9520 2024-08-31T06:18:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f424019f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5571628b8fb0 con 0x557162588840 2024-08-31T06:18:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f42337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x55716294f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f42337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x55716294f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45032/0 (socket says 172.21.15.53:45032) 2024-08-31T06:18:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f42337fe640 1 -- 172.21.15.53:0/1407782738 learned_addr learned my addr 172.21.15.53:0/1407782738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.310+0000 7f4233fff640 1 --2- 172.21.15.53:0/1407782738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571625a9520 0x55716294ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f42337fe640 1 -- 172.21.15.53:0/1407782738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557162588840 msgr2=0x55716294f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f42337fe640 1 --2- 172.21.15.53:0/1407782738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557162588840 0x55716294f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f42337fe640 1 -- 172.21.15.53:0/1407782738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571625a9520 msgr2=0x55716294ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f42337fe640 1 --2- 172.21.15.53:0/1407782738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571625a9520 0x55716294ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f42337fe640 1 -- 172.21.15.53:0/1407782738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557162614b00 con 0x557162580660 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f4230ff9640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f421c0b4ca0 0x7f421c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f42337fe640 1 --2- 172.21.15.53:0/1407782738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x55716294f1c0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f422400a9f0 tx=0x7f422400aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61131379d27c7970 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f4233fff640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f421c0b4ca0 0x7f421c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f4230ff9640 1 -- 172.21.15.53:0/3037164215 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f42280e4b90 con 0x7f4234109240 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f4219ffb640 1 -- 172.21.15.53:0/1407782738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422400cd80 con 0x557162580660 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f4219ffb640 1 -- 172.21.15.53:0/1407782738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f422400f8e0 con 0x557162580660 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.311+0000 7f4219ffb640 1 -- 172.21.15.53:0/1407782738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42240187a0 con 0x557162580660 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.312+0000 7f424019f740 1 -- 172.21.15.53:0/1407782738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 msgr2=0x55716294f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.312+0000 7f4233fff640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f421c0b4ca0 0x7f421c0b71b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f422c009a60 tx=0x7f422c009890 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.312+0000 7f424019f740 1 --2- 172.21.15.53:0/1407782738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x55716294f1c0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f422400a9f0 tx=0x7f422400aeb0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.312+0000 7f424019f740 1 -- 172.21.15.53:0/1407782738 shutdown_connections 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.312+0000 7f424019f740 1 --2- 172.21.15.53:0/1407782738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557162588840 0x55716294f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.312+0000 7f424019f740 1 --2- 172.21.15.53:0/1407782738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x55716294f1c0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.312+0000 7f424019f740 1 --2- 172.21.15.53:0/1407782738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571625a9520 0x55716294ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.312+0000 7f424019f740 1 -- 172.21.15.53:0/1407782738 >> 172.21.15.53:0/1407782738 conn(0x55716259d910 msgr2=0x55716294cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.312+0000 7f424019f740 1 -- 172.21.15.53:0/1407782738 shutdown_connections 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.312+0000 7f424019f740 1 -- 172.21.15.53:0/1407782738 wait complete. 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f424019f740 1 -- start start 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f424019f740 1 Processor -- start 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f424019f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557162580660 0x55716295ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f424019f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f424019f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5571625a9520 0x55716296ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f424019f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5571629617c0 con 0x557162588840 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f424019f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557162876520 con 0x557162580660 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f424019f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557162961940 con 0x5571625a9520 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f424019f740 10 client.0 _ll_register_callbacks cb 0x5571628aec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f4232ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f4232ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45044/0 (socket says 172.21.15.53:45044) 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.313+0000 7f4232ffd640 1 -- 172.21.15.53:0/3803285512 learned_addr learned my addr 172.21.15.53:0/3803285512 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f4232ffd640 1 -- 172.21.15.53:0/3803285512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5571625a9520 msgr2=0x55716296ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f4232ffd640 1 --2- 172.21.15.53:0/3803285512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5571625a9520 0x55716296ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f4232ffd640 1 -- 172.21.15.53:0/3803285512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557162580660 msgr2=0x55716295ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f4232ffd640 1 --2- 172.21.15.53:0/3803285512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557162580660 0x55716295ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f4232ffd640 1 -- 172.21.15.53:0/3803285512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55716268b960 con 0x557162588840 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f4232ffd640 1 --2- 172.21.15.53:0/3803285512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295f250 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f42280a84d0 tx=0x7f42280ab120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da05eee80f0d2aa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f4212ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:18:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f4212ffd640 1 -- 172.21.15.53:0/3803285512 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42280aad70 con 0x557162588840 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f4212ffd640 1 -- 172.21.15.53:0/3803285512 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f42280a74f0 con 0x557162588840 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f424019f740 1 -- 172.21.15.53:0/3803285512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5571628549a0 con 0x557162588840 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f4212ffd640 1 -- 172.21.15.53:0/3803285512 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f42280ab960 con 0x557162588840 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f424019f740 10 client.19707 fetch_fsmap learned FSMap version 54 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f424019f740 1 -- 172.21.15.53:0/3803285512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55716296d9e0 con 0x557162588840 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.314+0000 7f4212ffd640 1 -- 172.21.15.53:0/3803285512 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5571628549a0 con 0x557162588840 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.315+0000 7f4212ffd640 1 -- 172.21.15.53:0/3803285512 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f42280a6bd0 con 0x557162588840 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.315+0000 7f424019f740 10 client.19707 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.315+0000 7f424019f740 10 client.19707 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.315+0000 7f424019f740 20 client.19707 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.315+0000 7f424019f740 1 --2- 172.21.15.53:0/3803285512 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557162567ea0 0x557162970f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.315+0000 7f424019f740 4 client.19707 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.315+0000 7f424019f740 1 -- 172.21.15.53:0/3803285512 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571628c79c0 con 0x557162567ea0 2024-08-31T06:18:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.315+0000 7f42337fe640 1 --2- 172.21.15.53:0/3803285512 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557162567ea0 0x557162970f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.316+0000 7f4212ffd640 10 client.19707 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:03.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.316+0000 7f42337fe640 1 --2- 172.21.15.53:0/3803285512 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557162567ea0 0x557162970f80 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11406f14f5782e6b server_cookie=313a61191a909205 in_seq=0 out_seq=0 2024-08-31T06:18:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.316+0000 7f4212ffd640 1 -- 172.21.15.53:0/3803285512 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5571628c79c0 con 0x557162567ea0 2024-08-31T06:18:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.316+0000 7f4212ffd640 10 client.19707 handle_command_reply: tid=0 2024-08-31T06:18:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.316+0000 7f424019f740 1 client.19707 shutdown 2024-08-31T06:18:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f424019f740 1 -- 172.21.15.53:0/3803285512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 msgr2=0x55716295f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f424019f740 1 --2- 172.21.15.53:0/3803285512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295f250 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f42280a84d0 tx=0x7f42280ab120 comp rx=0 tx=0).stop 2024-08-31T06:18:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f424019f740 1 -- 172.21.15.53:0/3803285512 shutdown_connections 2024-08-31T06:18:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f424019f740 1 --2- 172.21.15.53:0/3803285512 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557162567ea0 0x557162970f80 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f424019f740 1 --2- 172.21.15.53:0/3803285512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5571625a9520 0x55716296ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f424019f740 1 --2- 172.21.15.53:0/3803285512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295f250 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f424019f740 1 --2- 172.21.15.53:0/3803285512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557162580660 0x55716295ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f424019f740 1 -- 172.21.15.53:0/3803285512 >> 172.21.15.53:0/3803285512 conn(0x55716259d910 msgr2=0x557162950670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f4212ffd640 0 client.19707 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f424019f740 1 -- 172.21.15.53:0/3803285512 shutdown_connections 2024-08-31T06:18:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f424019f740 1 -- 172.21.15.53:0/3803285512 wait complete. 2024-08-31T06:18:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.317+0000 7f424019f740 20 client.19707 trim_cache size 0 max 16384 2024-08-31T06:18:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.334+0000 7f424019f740 1 Processor -- start 2024-08-31T06:18:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.334+0000 7f424019f740 1 -- start start 2024-08-31T06:18:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f424019f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557162580660 0x55716295d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f424019f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f424019f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5571625a9520 0x55716294c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f424019f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f42341ad3d0 con 0x557162588840 2024-08-31T06:18:03.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f424019f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42341af120 con 0x557162580660 2024-08-31T06:18:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f424019f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f42341adaa0 con 0x5571625a9520 2024-08-31T06:18:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f4232ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f4232ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45056/0 (socket says 172.21.15.53:45056) 2024-08-31T06:18:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f4232ffd640 1 -- 172.21.15.53:0/3542530550 learned_addr learned my addr 172.21.15.53:0/3542530550 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f4233fff640 1 --2- 172.21.15.53:0/3542530550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5571625a9520 0x55716294c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f42337fe640 1 --2- 172.21.15.53:0/3542530550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557162580660 0x55716295d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f4232ffd640 1 -- 172.21.15.53:0/3542530550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5571625a9520 msgr2=0x55716294c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f4232ffd640 1 --2- 172.21.15.53:0/3542530550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5571625a9520 0x55716294c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f4232ffd640 1 -- 172.21.15.53:0/3542530550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557162580660 msgr2=0x55716295d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f4232ffd640 1 --2- 172.21.15.53:0/3542530550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557162580660 0x55716295d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f4232ffd640 1 -- 172.21.15.53:0/3542530550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557162954490 con 0x557162588840 2024-08-31T06:18:03.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f42337fe640 1 --2- 172.21.15.53:0/3542530550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557162580660 0x55716295d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:03.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.335+0000 7f4232ffd640 1 --2- 172.21.15.53:0/3542530550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295d890 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f42280aaf60 tx=0x7f4228000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec535db2f90f31b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:03.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.336+0000 7f42197fa640 1 -- 172.21.15.53:0/3542530550 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42280a7120 con 0x557162588840 2024-08-31T06:18:03.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.336+0000 7f42197fa640 1 -- 172.21.15.53:0/3542530550 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42280b2e50 con 0x557162588840 2024-08-31T06:18:03.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.336+0000 7f42197fa640 1 -- 172.21.15.53:0/3542530550 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42280b4580 con 0x557162588840 2024-08-31T06:18:03.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.336+0000 7f424019f740 1 -- 172.21.15.53:0/3542530550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 msgr2=0x55716295d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:03.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.336+0000 7f424019f740 1 --2- 172.21.15.53:0/3542530550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295d890 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f42280aaf60 tx=0x7f4228000bc0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.336+0000 7f424019f740 1 -- 172.21.15.53:0/3542530550 shutdown_connections 2024-08-31T06:18:03.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.336+0000 7f424019f740 1 --2- 172.21.15.53:0/3542530550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5571625a9520 0x55716294c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.336+0000 7f424019f740 1 --2- 172.21.15.53:0/3542530550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162588840 0x55716295d890 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.336+0000 7f424019f740 1 --2- 172.21.15.53:0/3542530550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557162580660 0x55716295d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.336+0000 7f424019f740 1 -- 172.21.15.53:0/3542530550 >> 172.21.15.53:0/3542530550 conn(0x55716259d910 msgr2=0x557162959c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:03.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.337+0000 7f424019f740 1 -- 172.21.15.53:0/3542530550 shutdown_connections 2024-08-31T06:18:03.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.337+0000 7f424019f740 1 -- 172.21.15.53:0/3542530550 wait complete. 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.337+0000 7f424019f740 1 -- start start 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.337+0000 7f424019f740 1 Processor -- start 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f424019f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x557162966f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f424019f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557162588840 0x557162967550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f424019f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571625a9520 0x557162961ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f424019f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f42341ae990 con 0x557162580660 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f424019f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42341ae230 con 0x5571625a9520 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f424019f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f42341ab3d0 con 0x557162588840 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f42337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x557162966f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f42337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x557162966f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45072/0 (socket says 172.21.15.53:45072) 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f42337fe640 1 -- 172.21.15.53:0/707082649 learned_addr learned my addr 172.21.15.53:0/707082649 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:03.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f424019f740 10 client.0 _ll_register_callbacks cb 0x7f42280092c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f4232ffd640 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557162588840 0x557162967550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f4233fff640 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571625a9520 0x557162961ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f42337fe640 1 -- 172.21.15.53:0/707082649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557162588840 msgr2=0x557162967550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f42337fe640 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557162588840 0x557162967550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f42337fe640 1 -- 172.21.15.53:0/707082649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571625a9520 msgr2=0x557162961ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f42337fe640 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571625a9520 0x557162961ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f42337fe640 1 -- 172.21.15.53:0/707082649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557162962430 con 0x557162580660 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f42337fe640 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x557162966f90 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x55716294d900 tx=0x7f422400a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51371c982d9165d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f4212ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f4212ffd640 1 -- 172.21.15.53:0/707082649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422400cd90 con 0x557162580660 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f4212ffd640 1 -- 172.21.15.53:0/707082649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f4224025420 con 0x557162580660 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.338+0000 7f424019f740 1 -- 172.21.15.53:0/707082649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42280b2e50 con 0x557162580660 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f4212ffd640 1 -- 172.21.15.53:0/707082649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4224025620 con 0x557162580660 2024-08-31T06:18:03.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f424019f740 10 client.19713 fetch_fsmap learned FSMap version 54 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f424019f740 1 -- 172.21.15.53:0/707082649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5571629dc480 con 0x557162580660 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f4212ffd640 1 -- 172.21.15.53:0/707082649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42280b2e50 con 0x557162580660 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f4212ffd640 1 -- 172.21.15.53:0/707082649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f4224022070 con 0x557162580660 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f424019f740 10 client.19713 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f424019f740 10 client.19713 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f424019f740 20 client.19713 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f424019f740 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55716253d250 0x5571629dea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f424019f740 4 client.19713 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "56cee97c", "release": true, "await": true}] 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f424019f740 1 -- 172.21.15.53:0/707082649 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "56cee97c", "release": true, "await": true}) -- 0x5571628c3460 con 0x55716253d250 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.339+0000 7f4232ffd640 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55716253d250 0x5571629dea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.340+0000 7f4232ffd640 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55716253d250 0x5571629dea50 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=824fecbd114176d8 server_cookie=828233ca5a25a7cd in_seq=0 out_seq=0 2024-08-31T06:18:03.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.340+0000 7f4212ffd640 10 client.19713 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:03.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f4212ffd640 1 -- 172.21.15.53:0/707082649 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5571628c3460 con 0x55716253d250 2024-08-31T06:18:03.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f4212ffd640 10 client.19713 handle_command_reply: tid=0 2024-08-31T06:18:03.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f424019f740 1 client.19713 shutdown 2024-08-31T06:18:03.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f424019f740 1 -- 172.21.15.53:0/707082649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 msgr2=0x557162966f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:03.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f424019f740 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x557162966f90 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x55716294d900 tx=0x7f422400a500 comp rx=0 tx=0).stop 2024-08-31T06:18:03.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f424019f740 1 -- 172.21.15.53:0/707082649 shutdown_connections 2024-08-31T06:18:03.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f424019f740 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55716253d250 0x5571629dea50 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f424019f740 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571625a9520 0x557162961ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f424019f740 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557162588840 0x557162967550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f424019f740 1 --2- 172.21.15.53:0/707082649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557162580660 0x557162966f90 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f4212ffd640 0 client.19713 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:03.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f424019f740 1 -- 172.21.15.53:0/707082649 >> 172.21.15.53:0/707082649 conn(0x55716259d910 msgr2=0x55716294c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:03.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.345+0000 7f424019f740 1 -- 172.21.15.53:0/707082649 shutdown_connections 2024-08-31T06:18:03.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.346+0000 7f424019f740 1 -- 172.21.15.53:0/707082649 wait complete. 2024-08-31T06:18:03.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.346+0000 7f424019f740 20 client.19713 trim_cache size 0 max 16384 2024-08-31T06:18:03.349 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:18:03.349 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 54, 2024-08-31T06:18:03.349 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:18:03.349 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 44, 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "56cee97c": { 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 44, 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 134.7, 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:18:03.350 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:18:03.351 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:18:03.351 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:18:03.351 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:18:03.351 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:03.351 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:03.351 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:03.351 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:03.351 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:03.351 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:18:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.346+0000 7f4239c2a640 1 -- 172.21.15.53:0/3037164215 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f421c0b4ca0 msgr2=0x7f421c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.346+0000 7f4239c2a640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f421c0b4ca0 0x7f421c0b71b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f422c009a60 tx=0x7f422c009890 comp rx=0 tx=0).stop 2024-08-31T06:18:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.346+0000 7f4239c2a640 1 -- 172.21.15.53:0/3037164215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4234109240 msgr2=0x7f423419a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.346+0000 7f4239c2a640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4234109240 0x7f423419a6d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f4228006fd0 tx=0x7f422800b8e0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.347+0000 7f4239c2a640 1 -- 172.21.15.53:0/3037164215 shutdown_connections 2024-08-31T06:18:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.347+0000 7f4239c2a640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f421c0b4ca0 0x7f421c0b71b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.347+0000 7f4239c2a640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4234109b90 0x7f423419f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.347+0000 7f4239c2a640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4234109240 0x7f423419a6d0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.347+0000 7f4239c2a640 1 --2- 172.21.15.53:0/3037164215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4234103900 0x7f423419a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.347+0000 7f4239c2a640 1 -- 172.21.15.53:0/3037164215 >> 172.21.15.53:0/3037164215 conn(0x7f423407b5f0 msgr2=0x7f42341072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:03.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.347+0000 7f4239c2a640 1 -- 172.21.15.53:0/3037164215 shutdown_connections 2024-08-31T06:18:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:03.347+0000 7f4239c2a640 1 -- 172.21.15.53:0/3037164215 wait complete. 2024-08-31T06:18:03.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:03 smithi053 ceph-mon[18924]: pgmap v730: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 243 KiB/s wr, 48 op/s 2024-08-31T06:18:04.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 196658 1.31 MB/sec execute 593 sec latency 13868.766 ms 2024-08-31T06:18:04.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:03 smithi130 ceph-mon[22266]: pgmap v730: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 243 KiB/s wr, 48 op/s 2024-08-31T06:18:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:03 smithi153 ceph-mon[22320]: pgmap v730: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 243 KiB/s wr, 48 op/s 2024-08-31T06:18:04.204 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '56cee97c', total seconds elapsed: 18.2 2024-08-31T06:18:05.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 197180 1.31 MB/sec execute 594 sec latency 21.528 ms 2024-08-31T06:18:06.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 197657 1.31 MB/sec execute 595 sec latency 26.145 ms 2024-08-31T06:18:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:05 smithi130 ceph-mon[22266]: pgmap v731: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 104 KiB/s wr, 41 op/s 2024-08-31T06:18:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:05 smithi153 ceph-mon[22320]: pgmap v731: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 104 KiB/s wr, 41 op/s 2024-08-31T06:18:06.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:05 smithi053 ceph-mon[18924]: pgmap v731: 97 pgs: 97 active+clean; 113 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 104 KiB/s wr, 41 op/s 2024-08-31T06:18:07.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 198376 1.32 MB/sec execute 596 sec latency 44.812 ms 2024-08-31T06:18:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:06 smithi130 ceph-mon[22266]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T06:18:07.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:06 smithi153 ceph-mon[22320]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T06:18:07.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:06 smithi053 ceph-mon[18924]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T06:18:08.002 INFO:tasks.workunit.client.0.smithi053.stdout: 1 198710 1.32 MB/sec execute 597 sec latency 67.521 ms 2024-08-31T06:18:08.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:07 smithi130 ceph-mon[22266]: pgmap v733: 97 pgs: 97 active+clean; 114 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 137 KiB/s wr, 46 op/s 2024-08-31T06:18:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:07 smithi153 ceph-mon[22320]: pgmap v733: 97 pgs: 97 active+clean; 114 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 137 KiB/s wr, 46 op/s 2024-08-31T06:18:08.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:07 smithi053 ceph-mon[18924]: pgmap v733: 97 pgs: 97 active+clean; 114 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 137 KiB/s wr, 46 op/s 2024-08-31T06:18:08.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.964+0000 7f68a98de640 1 -- 172.21.15.53:0/2691086737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a41068f0 msgr2=0x7f68a4110360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:08.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.964+0000 7f68a98de640 1 --2- 172.21.15.53:0/2691086737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a41068f0 0x7f68a4110360 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f6894009ca0 tx=0x7f689402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.964+0000 7f68a98de640 1 -- 172.21.15.53:0/2691086737 shutdown_connections 2024-08-31T06:18:08.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.964+0000 7f68a98de640 1 --2- 172.21.15.53:0/2691086737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a41068f0 0x7f68a4110360 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.964+0000 7f68a98de640 1 --2- 172.21.15.53:0/2691086737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a4105fa0 0x7f68a41063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.964+0000 7f68a98de640 1 --2- 172.21.15.53:0/2691086737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68a4101e30 0x7f68a4102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.964+0000 7f68a98de640 1 -- 172.21.15.53:0/2691086737 >> 172.21.15.53:0/2691086737 conn(0x7f68a4079c60 msgr2=0x7f68a407a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.964+0000 7f68a98de640 1 -- 172.21.15.53:0/2691086737 shutdown_connections 2024-08-31T06:18:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.964+0000 7f68a98de640 1 -- 172.21.15.53:0/2691086737 wait complete. 2024-08-31T06:18:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.965+0000 7f68a98de640 1 Processor -- start 2024-08-31T06:18:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.965+0000 7f68a98de640 1 -- start start 2024-08-31T06:18:08.970 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.965+0000 7f68a98de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68a4101e30 0x7f68a4102dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.970 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.965+0000 7f68a98de640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a4105fa0 0x7f68a4103300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.970 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.965+0000 7f68a98de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a41068f0 0x7f68a4103840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.970 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.965+0000 7f68a98de640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68a4113740 con 0x7f68a41068f0 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.965+0000 7f68a98de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41135c0 con 0x7f68a4101e30 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.965+0000 7f68a98de640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41138c0 con 0x7f68a4105fa0 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a41068f0 0x7f68a4103840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a41068f0 0x7f68a4103840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45082/0 (socket says 172.21.15.53:45082) 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a37fe640 1 -- 172.21.15.53:0/4173085489 learned_addr learned my addr 172.21.15.53:0/4173085489 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a27fc640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a4105fa0 0x7f68a4103300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a2ffd640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68a4101e30 0x7f68a4102dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a37fe640 1 -- 172.21.15.53:0/4173085489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a4105fa0 msgr2=0x7f68a4103300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a37fe640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a4105fa0 0x7f68a4103300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a37fe640 1 -- 172.21.15.53:0/4173085489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68a4101e30 msgr2=0x7f68a4102dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a37fe640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68a4101e30 0x7f68a4102dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a37fe640 1 -- 172.21.15.53:0/4173085489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a41a8450 con 0x7f68a41068f0 2024-08-31T06:18:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a27fc640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a4105fa0 0x7f68a4103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a37fe640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a41068f0 0x7f68a4103840 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f6894005e30 tx=0x7f68940093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a88dc640 1 -- 172.21.15.53:0/4173085489 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894032d10 con 0x7f68a41068f0 2024-08-31T06:18:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a88dc640 1 -- 172.21.15.53:0/4173085489 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6894032eb0 con 0x7f68a41068f0 2024-08-31T06:18:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.966+0000 7f68a98de640 1 -- 172.21.15.53:0/4173085489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a41a86e0 con 0x7f68a41068f0 2024-08-31T06:18:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.967+0000 7f68a88dc640 1 -- 172.21.15.53:0/4173085489 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894030a60 con 0x7f68a41068f0 2024-08-31T06:18:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.967+0000 7f68a98de640 1 -- 172.21.15.53:0/4173085489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a41a8c80 con 0x7f68a41068f0 2024-08-31T06:18:08.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.969+0000 7f68b084d740 1 Processor -- start 2024-08-31T06:18:08.977 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.969+0000 7f68a88dc640 1 -- 172.21.15.53:0/4173085489 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6894030c00 con 0x7f68a41068f0 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68b084d740 1 -- start start 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68b084d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 0x5556a27e9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68b084d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a241d2f0 0x5556a27ea000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68b084d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27ea540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68b084d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5556a275f000 con 0x5556a24254d0 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68b084d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5556a274e590 con 0x5556a24461b0 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68b084d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5556a2752540 con 0x5556a241d2f0 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68a27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68a27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27ea540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45084/0 (socket says 172.21.15.53:45084) 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68a27fc640 1 -- 172.21.15.53:0/402812681 learned_addr learned my addr 172.21.15.53:0/402812681 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68a2ffd640 1 --2- 172.21.15.53:0/402812681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a241d2f0 0x5556a27ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68a27fc640 1 --2- 172.21.15.53:0/402812681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 0x5556a27e9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68a27fc640 1 -- 172.21.15.53:0/402812681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a241d2f0 msgr2=0x5556a27ea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68a27fc640 1 --2- 172.21.15.53:0/402812681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a241d2f0 0x5556a27ea000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68a27fc640 1 -- 172.21.15.53:0/402812681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 msgr2=0x5556a27e9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68a27fc640 1 --2- 172.21.15.53:0/402812681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 0x5556a27e9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68a27fc640 1 -- 172.21.15.53:0/402812681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a24b1790 con 0x5556a24254d0 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.970+0000 7f68a2ffd640 1 --2- 172.21.15.53:0/402812681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a241d2f0 0x5556a27ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.971+0000 7f68a88dc640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68900b4d50 0x7f68900b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.971+0000 7f68a27fc640 1 --2- 172.21.15.53:0/402812681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27ea540 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f688c0117c0 tx=0x7f688c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d400847b8bf9c78 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.971+0000 7f68a2ffd640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68900b4d50 0x7f68900b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.971+0000 7f68a88dc640 1 -- 172.21.15.53:0/4173085489 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8601+0+0 (secure 0 0 0) 0x7f68941066d0 con 0x7f68a41068f0 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.971+0000 7f6899ffb640 1 -- 172.21.15.53:0/402812681 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c011050 con 0x5556a24254d0 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.971+0000 7f6899ffb640 1 -- 172.21.15.53:0/402812681 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f688c0111f0 con 0x5556a24254d0 2024-08-31T06:18:08.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.971+0000 7f6899ffb640 1 -- 172.21.15.53:0/402812681 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0035f0 con 0x5556a24254d0 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.972+0000 7f68b084d740 1 -- 172.21.15.53:0/402812681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 msgr2=0x5556a27ea540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.972+0000 7f68a2ffd640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68900b4d50 0x7f68900b7260 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x5556a27e8740 tx=0x7f689c008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.972+0000 7f68b084d740 1 --2- 172.21.15.53:0/402812681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27ea540 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f688c0117c0 tx=0x7f688c005850 comp rx=0 tx=0).stop 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.972+0000 7f68b084d740 1 -- 172.21.15.53:0/402812681 shutdown_connections 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.972+0000 7f68b084d740 1 --2- 172.21.15.53:0/402812681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27ea540 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.972+0000 7f68b084d740 1 --2- 172.21.15.53:0/402812681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a241d2f0 0x5556a27ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.972+0000 7f68b084d740 1 --2- 172.21.15.53:0/402812681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 0x5556a27e9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.972+0000 7f68b084d740 1 -- 172.21.15.53:0/402812681 >> 172.21.15.53:0/402812681 conn(0x5556a243a300 msgr2=0x5556a27e79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.972+0000 7f68b084d740 1 -- 172.21.15.53:0/402812681 shutdown_connections 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.972+0000 7f68b084d740 1 -- 172.21.15.53:0/402812681 wait complete. 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.972+0000 7f68b084d740 1 -- start start 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68b084d740 1 Processor -- start 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68b084d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68b084d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24254d0 0x5556a27f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68b084d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a24461b0 0x5556a2801560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68b084d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5556a2687ab0 con 0x5556a241d2f0 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68b084d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5556a26d5680 con 0x5556a24254d0 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68b084d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5556a27f8240 con 0x5556a24461b0 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68b084d740 10 client.0 _ll_register_callbacks cb 0x5556a245da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45092/0 (socket says 172.21.15.53:45092) 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a2ffd640 1 -- 172.21.15.53:0/3126852699 learned_addr learned my addr 172.21.15.53:0/3126852699 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a37fe640 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a24461b0 0x5556a2801560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a27fc640 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24254d0 0x5556a27f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a2ffd640 1 -- 172.21.15.53:0/3126852699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a24461b0 msgr2=0x5556a2801560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a2ffd640 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a24461b0 0x5556a2801560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a2ffd640 1 -- 172.21.15.53:0/3126852699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24254d0 msgr2=0x5556a27f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a2ffd640 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24254d0 0x5556a27f5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a2ffd640 1 -- 172.21.15.53:0/3126852699 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556a252a620 con 0x5556a241d2f0 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a27fc640 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24254d0 0x5556a27f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.973+0000 7f68a37fe640 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a24461b0 0x5556a2801560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.974+0000 7f68a2ffd640 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f56b0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f689c0156f0 tx=0x7f689c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1c4e3086321d17 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.974+0000 7f6882ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.974+0000 7f6882ffd640 1 -- 172.21.15.53:0/3126852699 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c025020 con 0x5556a241d2f0 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.974+0000 7f6882ffd640 1 -- 172.21.15.53:0/3126852699 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8601+0+0 (secure 0 0 0) 0x7f689c021440 con 0x5556a241d2f0 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.974+0000 7f68b084d740 1 -- 172.21.15.53:0/3126852699 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f688c0111f0 con 0x5556a241d2f0 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.974+0000 7f6882ffd640 1 -- 172.21.15.53:0/3126852699 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f689c030050 con 0x5556a241d2f0 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.974+0000 7f68b084d740 10 client.19725 fetch_fsmap learned FSMap version 54 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.974+0000 7f68b084d740 1 -- 172.21.15.53:0/3126852699 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5556a2804330 con 0x5556a241d2f0 2024-08-31T06:18:08.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.974+0000 7f6882ffd640 1 -- 172.21.15.53:0/3126852699 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f688c0111f0 con 0x5556a241d2f0 2024-08-31T06:18:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.975+0000 7f6882ffd640 1 -- 172.21.15.53:0/3126852699 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f689c014750 con 0x5556a241d2f0 2024-08-31T06:18:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.975+0000 7f68b084d740 10 client.19725 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:18:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.975+0000 7f68b084d740 10 client.19725 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.975+0000 7f68b084d740 20 client.19725 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.975+0000 7f68b084d740 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5556a2404d80 0x5556a2807a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.975+0000 7f68b084d740 4 client.19725 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.975+0000 7f68b084d740 1 -- 172.21.15.53:0/3126852699 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556a2760f50 con 0x5556a2404d80 2024-08-31T06:18:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.975+0000 7f68a27fc640 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5556a2404d80 0x5556a2807a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.975+0000 7f68a27fc640 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5556a2404d80 0x5556a2807a10 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c53ab63a0e5f1a server_cookie=55af686c0724d1b5 in_seq=0 out_seq=0 2024-08-31T06:18:08.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.975+0000 7f6882ffd640 10 client.19725 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:08.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.976+0000 7f6882ffd640 1 -- 172.21.15.53:0/3126852699 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556a2760f50 con 0x5556a2404d80 2024-08-31T06:18:08.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.976+0000 7f6882ffd640 10 client.19725 handle_command_reply: tid=0 2024-08-31T06:18:08.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.976+0000 7f68b084d740 1 client.19725 shutdown 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.976+0000 7f68b084d740 1 -- 172.21.15.53:0/3126852699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 msgr2=0x5556a27f56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.976+0000 7f68b084d740 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f56b0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f689c0156f0 tx=0x7f689c0046c0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.977+0000 7f68b084d740 1 -- 172.21.15.53:0/3126852699 shutdown_connections 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.977+0000 7f68b084d740 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5556a2404d80 0x5556a2807a10 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.977+0000 7f68b084d740 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a24461b0 0x5556a2801560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.977+0000 7f68b084d740 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24254d0 0x5556a27f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.977+0000 7f6882ffd640 0 client.19725 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.977+0000 7f68b084d740 1 --2- 172.21.15.53:0/3126852699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f56b0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.977+0000 7f68b084d740 1 -- 172.21.15.53:0/3126852699 >> 172.21.15.53:0/3126852699 conn(0x5556a243a300 msgr2=0x5556a27eaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.977+0000 7f68b084d740 1 -- 172.21.15.53:0/3126852699 shutdown_connections 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.977+0000 7f68b084d740 1 -- 172.21.15.53:0/3126852699 wait complete. 2024-08-31T06:18:08.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.977+0000 7f68b084d740 20 client.19725 trim_cache size 0 max 16384 2024-08-31T06:18:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68b084d740 1 Processor -- start 2024-08-31T06:18:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68b084d740 1 -- start start 2024-08-31T06:18:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68b084d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a241d2f0 0x5556a2801460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68b084d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68b084d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 0x5556a27ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68b084d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41b1740 con 0x5556a24254d0 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68b084d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41b3490 con 0x5556a24461b0 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68b084d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41b1e10 con 0x5556a241d2f0 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68a27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68a27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27eeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45094/0 (socket says 172.21.15.53:45094) 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68a27fc640 1 -- 172.21.15.53:0/3281894099 learned_addr learned my addr 172.21.15.53:0/3281894099 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68a27fc640 1 -- 172.21.15.53:0/3281894099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a241d2f0 msgr2=0x5556a2801460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68a27fc640 1 --2- 172.21.15.53:0/3281894099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a241d2f0 0x5556a2801460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68a27fc640 1 -- 172.21.15.53:0/3281894099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 msgr2=0x5556a27ef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68a27fc640 1 --2- 172.21.15.53:0/3281894099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 0x5556a27ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.992+0000 7f68a27fc640 1 -- 172.21.15.53:0/3281894099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a27e82b0 con 0x5556a24254d0 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.993+0000 7f68a27fc640 1 --2- 172.21.15.53:0/3281894099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27eeb80 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f688c009730 tx=0x7f688c00fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f792617f7afb80 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.993+0000 7f68997fa640 1 -- 172.21.15.53:0/3281894099 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c00fa50 con 0x5556a24254d0 2024-08-31T06:18:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.993+0000 7f68997fa640 1 -- 172.21.15.53:0/3281894099 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f688c011020 con 0x5556a24254d0 2024-08-31T06:18:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.993+0000 7f68997fa640 1 -- 172.21.15.53:0/3281894099 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c003ab0 con 0x5556a24254d0 2024-08-31T06:18:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.994+0000 7f68b084d740 1 -- 172.21.15.53:0/3281894099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 msgr2=0x5556a27eeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.994+0000 7f68b084d740 1 --2- 172.21.15.53:0/3281894099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27eeb80 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f688c009730 tx=0x7f688c00fca0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.994+0000 7f68b084d740 1 -- 172.21.15.53:0/3281894099 shutdown_connections 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.994+0000 7f68b084d740 1 --2- 172.21.15.53:0/3281894099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 0x5556a27ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.994+0000 7f68b084d740 1 --2- 172.21.15.53:0/3281894099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a24254d0 0x5556a27eeb80 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.994+0000 7f68b084d740 1 --2- 172.21.15.53:0/3281894099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a241d2f0 0x5556a2801460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.994+0000 7f68b084d740 1 -- 172.21.15.53:0/3281894099 >> 172.21.15.53:0/3281894099 conn(0x5556a243a300 msgr2=0x5556a27f3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.994+0000 7f68b084d740 1 -- 172.21.15.53:0/3281894099 shutdown_connections 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.994+0000 7f68b084d740 1 -- 172.21.15.53:0/3281894099 wait complete. 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.994+0000 7f68b084d740 1 -- start start 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.994+0000 7f68b084d740 1 Processor -- start 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68b084d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68b084d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a24254d0 0x5556a27f9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68b084d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 0x5556a28713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68b084d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41b2d00 con 0x5556a241d2f0 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68b084d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41b25a0 con 0x5556a24461b0 2024-08-31T06:18:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68b084d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41af740 con 0x5556a24254d0 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68b084d740 10 client.0 _ll_register_callbacks cb 0x7f689c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45098/0 (socket says 172.21.15.53:45098) 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68a2ffd640 1 -- 172.21.15.53:0/1183781782 learned_addr learned my addr 172.21.15.53:0/1183781782 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68a27fc640 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a24254d0 0x5556a27f9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68a37fe640 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 0x5556a28713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68a2ffd640 1 -- 172.21.15.53:0/1183781782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a24254d0 msgr2=0x5556a27f9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68a2ffd640 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a24254d0 0x5556a27f9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68a2ffd640 1 -- 172.21.15.53:0/1183781782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 msgr2=0x5556a28713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68a2ffd640 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 0x5556a28713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68a2ffd640 1 -- 172.21.15.53:0/1183781782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556a2871910 con 0x5556a241d2f0 2024-08-31T06:18:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68a2ffd640 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f9810 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f689c014bf0 tx=0x7f689c014f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bcd93063bd0af7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f6882ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f6882ffd640 1 -- 172.21.15.53:0/1183781782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c025040 con 0x5556a241d2f0 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f6882ffd640 1 -- 172.21.15.53:0/1183781782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8601+0+0 (secure 0 0 0) 0x7f689c014830 con 0x5556a241d2f0 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.995+0000 7f68b084d740 1 -- 172.21.15.53:0/1183781782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f688c011020 con 0x5556a241d2f0 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f6882ffd640 1 -- 172.21.15.53:0/1183781782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f689c042050 con 0x5556a241d2f0 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f68b084d740 10 client.19731 fetch_fsmap learned FSMap version 54 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f68b084d740 1 -- 172.21.15.53:0/1183781782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5556a28729f0 con 0x5556a241d2f0 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f6882ffd640 1 -- 172.21.15.53:0/1183781782 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f688c011020 con 0x5556a241d2f0 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f6882ffd640 1 -- 172.21.15.53:0/1183781782 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 54) ==== 8406+0+0 (secure 0 0 0) 0x7f689c034430 con 0x5556a241d2f0 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f68b084d740 10 client.19731 fetch_fsmap finished waiting for FSMap version 54 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f68b084d740 10 client.19731 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f68b084d740 20 client.19731 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:09.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f68b084d740 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5556a23da1c0 0x5556a28752f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f68b084d740 4 client.19731 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:18:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f68b084d740 1 -- 172.21.15.53:0/1183781782 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5556a275c9f0 con 0x5556a23da1c0 2024-08-31T06:18:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.996+0000 7f68a27fc640 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5556a23da1c0 0x5556a28752f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.997+0000 7f6882ffd640 10 client.19731 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:09.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:08.997+0000 7f68a27fc640 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5556a23da1c0 0x5556a28752f0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b832627d0703fe8 server_cookie=a339f00854962eee in_seq=0 out_seq=0 2024-08-31T06:18:09.004 INFO:tasks.workunit.client.0.smithi053.stdout: 1 198710 1.32 MB/sec execute 598 sec latency 1067.605 ms 2024-08-31T06:18:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f6882ffd640 1 -- 172.21.15.53:0/1183781782 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5556a275c9f0 con 0x5556a23da1c0 2024-08-31T06:18:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f6882ffd640 10 client.19731 handle_command_reply: tid=0 2024-08-31T06:18:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f68b084d740 1 client.19731 shutdown 2024-08-31T06:18:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f68b084d740 1 -- 172.21.15.53:0/1183781782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 msgr2=0x5556a27f9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f68b084d740 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f9810 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f689c014bf0 tx=0x7f689c014f30 comp rx=0 tx=0).stop 2024-08-31T06:18:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f68b084d740 1 -- 172.21.15.53:0/1183781782 shutdown_connections 2024-08-31T06:18:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f68b084d740 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5556a23da1c0 0x5556a28752f0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f6882ffd640 0 client.19731 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f68b084d740 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a24461b0 0x5556a28713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f68b084d740 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5556a24254d0 0x5556a27f9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f68b084d740 1 --2- 172.21.15.53:0/1183781782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5556a241d2f0 0x5556a27f9810 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f68b084d740 1 -- 172.21.15.53:0/1183781782 >> 172.21.15.53:0/1183781782 conn(0x5556a243a300 msgr2=0x5556a27eeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.020+0000 7f68b084d740 1 -- 172.21.15.53:0/1183781782 shutdown_connections 2024-08-31T06:18:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68b084d740 1 -- 172.21.15.53:0/1183781782 wait complete. 2024-08-31T06:18:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68b084d740 20 client.19731 trim_cache size 0 max 16384 2024-08-31T06:18:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:18:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:18:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:18:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:18:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68a98de640 1 -- 172.21.15.53:0/4173085489 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68900b4d50 msgr2=0x7f68900b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68a98de640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68900b4d50 0x7f68900b7260 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x5556a27e8740 tx=0x7f689c008040 comp rx=0 tx=0).stop 2024-08-31T06:18:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68a98de640 1 -- 172.21.15.53:0/4173085489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a41068f0 msgr2=0x7f68a4103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68a98de640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a41068f0 0x7f68a4103840 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f6894005e30 tx=0x7f68940093d0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68a98de640 1 -- 172.21.15.53:0/4173085489 shutdown_connections 2024-08-31T06:18:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68a98de640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68900b4d50 0x7f68900b7260 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68a98de640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a41068f0 0x7f68a4103840 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68a98de640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a4105fa0 0x7f68a4103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68a98de640 1 --2- 172.21.15.53:0/4173085489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68a4101e30 0x7f68a4102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.021+0000 7f68a98de640 1 -- 172.21.15.53:0/4173085489 >> 172.21.15.53:0/4173085489 conn(0x7f68a4079c60 msgr2=0x7f68a41051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.022+0000 7f68a98de640 1 -- 172.21.15.53:0/4173085489 shutdown_connections 2024-08-31T06:18:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:09.022+0000 7f68a98de640 1 -- 172.21.15.53:0/4173085489 wait complete. 2024-08-31T06:18:10.003 INFO:tasks.workunit.client.0.smithi053.stdout: 1 198710 1.32 MB/sec execute 599 sec latency 2067.704 ms 2024-08-31T06:18:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:09 smithi130 ceph-mon[22266]: pgmap v734: 97 pgs: 97 active+clean; 115 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 343 KiB/s wr, 62 op/s 2024-08-31T06:18:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:09 smithi153 ceph-mon[22320]: pgmap v734: 97 pgs: 97 active+clean; 115 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 343 KiB/s wr, 62 op/s 2024-08-31T06:18:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:09 smithi053 ceph-mon[18924]: pgmap v734: 97 pgs: 97 active+clean; 115 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 343 KiB/s wr, 62 op/s 2024-08-31T06:18:11.003 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 600 sec 2024-08-31T06:18:12.003 INFO:tasks.workunit.client.0.smithi053.stdout: 1 cleanup 601 sec 2024-08-31T06:18:12.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:11 smithi130 ceph-mon[22266]: pgmap v735: 97 pgs: 97 active+clean; 114 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 705 KiB/s wr, 84 op/s 2024-08-31T06:18:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:11 smithi153 ceph-mon[22320]: pgmap v735: 97 pgs: 97 active+clean; 114 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 705 KiB/s wr, 84 op/s 2024-08-31T06:18:12.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:11 smithi053 ceph-mon[18924]: pgmap v735: 97 pgs: 97 active+clean; 114 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 705 KiB/s wr, 84 op/s 2024-08-31T06:18:12.252 INFO:tasks.workunit.client.0.smithi053.stdout: 0 cleanup 601 sec 2024-08-31T06:18:12.252 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-08-31T06:18:12.252 INFO:tasks.workunit.client.0.smithi053.stdout: Operation Count AvgLat MaxLat 2024-08-31T06:18:12.252 INFO:tasks.workunit.client.0.smithi053.stdout: ---------------------------------------- 2024-08-31T06:18:12.252 INFO:tasks.workunit.client.0.smithi053.stdout: NTCreateX 25220 8.422 26149.352 2024-08-31T06:18:12.252 INFO:tasks.workunit.client.0.smithi053.stdout: Close 18523 0.048 2.622 2024-08-31T06:18:12.252 INFO:tasks.workunit.client.0.smithi053.stdout: Rename 1071 98.478 4985.999 2024-08-31T06:18:12.253 INFO:tasks.workunit.client.0.smithi053.stdout: Unlink 5098 9.672 28358.213 2024-08-31T06:18:12.253 INFO:tasks.workunit.client.0.smithi053.stdout: Qpathinfo 22887 3.353 89.856 2024-08-31T06:18:12.253 INFO:tasks.workunit.client.0.smithi053.stdout: Qfileinfo 3994 0.074 0.220 2024-08-31T06:18:12.253 INFO:tasks.workunit.client.0.smithi053.stdout: Qfsinfo 4215 0.330 4.122 2024-08-31T06:18:12.253 INFO:tasks.workunit.client.0.smithi053.stdout: Sfileinfo 2050 18.659 21593.763 2024-08-31T06:18:12.253 INFO:tasks.workunit.client.0.smithi053.stdout: Find 8876 11.536 2351.291 2024-08-31T06:18:12.253 INFO:tasks.workunit.client.0.smithi053.stdout: WriteX 12482 2.038 23140.389 2024-08-31T06:18:12.253 INFO:tasks.workunit.client.0.smithi053.stdout: ReadX 39770 0.004 0.155 2024-08-31T06:18:12.253 INFO:tasks.workunit.client.0.smithi053.stdout: LockX 82 0.669 1.147 2024-08-31T06:18:12.253 INFO:tasks.workunit.client.0.smithi053.stdout: UnlockX 82 0.544 1.032 2024-08-31T06:18:12.253 INFO:tasks.workunit.client.0.smithi053.stdout: Flush 1771 2.827 52.238 2024-08-31T06:18:12.254 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-08-31T06:18:12.254 INFO:tasks.workunit.client.0.smithi053.stdout:Throughput 1.31849 MB/sec 1 clients 1 procs max_latency=28358.221 ms 2024-08-31T06:18:12.254 INFO:tasks.workunit.client.0.smithi053.stderr:+ dbench 10 2024-08-31T06:18:12.255 INFO:tasks.workunit.client.0.smithi053.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-08-31T06:18:12.255 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-08-31T06:18:12.255 INFO:tasks.workunit.client.0.smithi053.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-08-31T06:18:12.255 INFO:tasks.workunit.client.0.smithi053.stdout:8 of 10 processes prepared for launch 0 sec 2024-08-31T06:18:12.354 INFO:tasks.workunit.client.0.smithi053.stdout:10 of 10 processes prepared for launch 0 sec 2024-08-31T06:18:12.354 INFO:tasks.workunit.client.0.smithi053.stdout:releasing clients 2024-08-31T06:18:13.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 239 91.70 MB/sec warmup 1 sec latency 94.447 ms 2024-08-31T06:18:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:13 smithi130 ceph-mon[22266]: pgmap v736: 97 pgs: 97 active+clean; 112 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 834 KiB/s wr, 92 op/s 2024-08-31T06:18:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:13 smithi153 ceph-mon[22320]: pgmap v736: 97 pgs: 97 active+clean; 112 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 834 KiB/s wr, 92 op/s 2024-08-31T06:18:14.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:13 smithi053 ceph-mon[18924]: pgmap v736: 97 pgs: 97 active+clean; 112 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 834 KiB/s wr, 92 op/s 2024-08-31T06:18:14.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 418 73.94 MB/sec warmup 2 sec latency 105.999 ms 2024-08-31T06:18:15.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 625 68.50 MB/sec warmup 3 sec latency 102.759 ms 2024-08-31T06:18:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:15 smithi053 ceph-mon[18924]: osdmap e90: 12 total, 12 up, 12 in 2024-08-31T06:18:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:15 smithi053 ceph-mon[18924]: pgmap v738: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 4.0 MiB/s wr, 95 op/s 2024-08-31T06:18:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:15 smithi130 ceph-mon[22266]: osdmap e90: 12 total, 12 up, 12 in 2024-08-31T06:18:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:15 smithi130 ceph-mon[22266]: pgmap v738: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 4.0 MiB/s wr, 95 op/s 2024-08-31T06:18:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:15 smithi153 ceph-mon[22320]: osdmap e90: 12 total, 12 up, 12 in 2024-08-31T06:18:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:15 smithi153 ceph-mon[22320]: pgmap v738: 97 pgs: 97 active+clean; 140 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 4.0 MiB/s wr, 95 op/s 2024-08-31T06:18:16.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 780 53.48 MB/sec warmup 4 sec latency 232.310 ms 2024-08-31T06:18:17.085 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:18:17.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 950 43.77 MB/sec warmup 5 sec latency 801.034 ms 2024-08-31T06:18:17.438 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:17.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:17 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:18:17.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:17 smithi053 ceph-mon[18924]: pgmap v739: 97 pgs: 97 active+clean; 225 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 12 MiB/s wr, 133 op/s 2024-08-31T06:18:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:17 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:18:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:17 smithi130 ceph-mon[22266]: pgmap v739: 97 pgs: 97 active+clean; 225 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 12 MiB/s wr, 133 op/s 2024-08-31T06:18:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:17 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:18:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:17 smithi153 ceph-mon[22320]: pgmap v739: 97 pgs: 97 active+clean; 225 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 12 MiB/s wr, 133 op/s 2024-08-31T06:18:18.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.044+0000 7fce257a6640 1 -- 172.21.15.53:0/2695640121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce20108a90 msgr2=0x7fce2010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:18.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.044+0000 7fce257a6640 1 --2- 172.21.15.53:0/2695640121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce20108a90 0x7fce2010f2c0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fce18009ca0 tx=0x7fce1802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.044+0000 7fce257a6640 1 -- 172.21.15.53:0/2695640121 shutdown_connections 2024-08-31T06:18:18.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.044+0000 7fce257a6640 1 --2- 172.21.15.53:0/2695640121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce20108a90 0x7fce2010f2c0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.044+0000 7fce257a6640 1 --2- 172.21.15.53:0/2695640121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce20108140 0x7fce20108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.044+0000 7fce257a6640 1 --2- 172.21.15.53:0/2695640121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce20102800 0x7fce20102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.044+0000 7fce257a6640 1 -- 172.21.15.53:0/2695640121 >> 172.21.15.53:0/2695640121 conn(0x7fce200794d0 msgr2=0x7fce200798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:18.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.044+0000 7fce257a6640 1 -- 172.21.15.53:0/2695640121 shutdown_connections 2024-08-31T06:18:18.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.044+0000 7fce257a6640 1 -- 172.21.15.53:0/2695640121 wait complete. 2024-08-31T06:18:18.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.045+0000 7fce257a6640 1 Processor -- start 2024-08-31T06:18:18.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.045+0000 7fce257a6640 1 -- start start 2024-08-31T06:18:18.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.046+0000 7fce257a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce20102800 0x7fce2019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.046+0000 7fce257a6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce20108140 0x7fce2019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.046+0000 7fce1effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce20102800 0x7fce2019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.046+0000 7fce257a6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce20108a90 0x7fce201a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.046+0000 7fce257a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce201125f0 con 0x7fce20102800 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.046+0000 7fce1effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce20102800 0x7fce2019c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36798/0 (socket says 172.21.15.53:36798) 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.046+0000 7fce257a6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce20112470 con 0x7fce20108a90 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.046+0000 7fce1effd640 1 -- 172.21.15.53:0/1800460629 learned_addr learned my addr 172.21.15.53:0/1800460629 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.046+0000 7fce257a6640 1 -- 172.21.15.53:0/1800460629 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce20112770 con 0x7fce20108140 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.046+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce20108140 0x7fce2019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.046+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce20108a90 0x7fce201a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.047+0000 7fce1effd640 1 -- 172.21.15.53:0/1800460629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce20108140 msgr2=0x7fce2019c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.047+0000 7fce1effd640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce20108140 0x7fce2019c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.047+0000 7fce1effd640 1 -- 172.21.15.53:0/1800460629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce20108a90 msgr2=0x7fce201a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:18.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.047+0000 7fce1effd640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce20108a90 0x7fce201a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.047+0000 7fce1effd640 1 -- 172.21.15.53:0/1800460629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce201a2240 con 0x7fce20102800 2024-08-31T06:18:18.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.047+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce20108140 0x7fce2019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:18.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.047+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce20108a90 0x7fce201a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:18.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.047+0000 7fce1effd640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce20102800 0x7fce2019c2d0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fce1000e9f0 tx=0x7fce1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:18.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.047+0000 7fce07fff640 1 -- 172.21.15.53:0/1800460629 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1000cd80 con 0x7fce20102800 2024-08-31T06:18:18.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.047+0000 7fce07fff640 1 -- 172.21.15.53:0/1800460629 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce100108c0 con 0x7fce20102800 2024-08-31T06:18:18.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.047+0000 7fce07fff640 1 -- 172.21.15.53:0/1800460629 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce100187c0 con 0x7fce20102800 2024-08-31T06:18:18.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.048+0000 7fce257a6640 1 -- 172.21.15.53:0/1800460629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce201a2530 con 0x7fce20102800 2024-08-31T06:18:18.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.048+0000 7fce257a6640 1 -- 172.21.15.53:0/1800460629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce201a8c90 con 0x7fce20102800 2024-08-31T06:18:18.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.052+0000 7fce2bd1b740 1 Processor -- start 2024-08-31T06:18:18.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.052+0000 7fce07fff640 1 -- 172.21.15.53:0/1800460629 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fce10010430 con 0x7fce20102800 2024-08-31T06:18:18.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.052+0000 7fce2bd1b740 1 -- start start 2024-08-31T06:18:18.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307aa070 0x55cc30b4f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307811b0 0x55cc30b4f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc30789390 0x55cc30b4fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cc30ac6630 con 0x55cc307811b0 2024-08-31T06:18:18.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cc30ab5bc0 con 0x55cc307aa070 2024-08-31T06:18:18.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cc30ab9b70 con 0x55cc30789390 2024-08-31T06:18:18.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307aa070 0x55cc30b4f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce1e7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc30789390 0x55cc30b4fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307aa070 0x55cc30b4f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36520/0 (socket says 172.21.15.53:36520) 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce1f7fe640 1 -- 172.21.15.53:0/669006340 learned_addr learned my addr 172.21.15.53:0/669006340 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce1effd640 1 --2- 172.21.15.53:0/669006340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307811b0 0x55cc30b4f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce1f7fe640 1 -- 172.21.15.53:0/669006340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc30789390 msgr2=0x55cc30b4fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/669006340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc30789390 0x55cc30b4fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce1f7fe640 1 -- 172.21.15.53:0/669006340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307811b0 msgr2=0x55cc30b4f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/669006340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307811b0 0x55cc30b4f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.053+0000 7fce1f7fe640 1 -- 172.21.15.53:0/669006340 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc30815650 con 0x55cc307aa070 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.054+0000 7fce07fff640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce080b4df0 0x7fce080b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.054+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/669006340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307aa070 0x55cc30b4f2c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fce18031450 tx=0x7fce18031480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cafd07f028377c14 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.054+0000 7fce1effd640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce080b4df0 0x7fce080b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.054+0000 7fce07fff640 1 -- 172.21.15.53:0/1800460629 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fce100e58b0 con 0x7fce20102800 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.054+0000 7fce057fa640 1 -- 172.21.15.53:0/669006340 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18031980 con 0x55cc307aa070 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.054+0000 7fce057fa640 1 -- 172.21.15.53:0/669006340 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce18036040 con 0x55cc307aa070 2024-08-31T06:18:18.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.054+0000 7fce057fa640 1 -- 172.21.15.53:0/669006340 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18004490 con 0x55cc307aa070 2024-08-31T06:18:18.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.055+0000 7fce2bd1b740 1 -- 172.21.15.53:0/669006340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307aa070 msgr2=0x55cc30b4f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:18.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.055+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/669006340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307aa070 0x55cc30b4f2c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fce18031450 tx=0x7fce18031480 comp rx=0 tx=0).stop 2024-08-31T06:18:18.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.055+0000 7fce1effd640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce080b4df0 0x7fce080b7300 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fce100e3090 tx=0x7fce10010cc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:18.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.055+0000 7fce2bd1b740 1 -- 172.21.15.53:0/669006340 shutdown_connections 2024-08-31T06:18:18.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.055+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/669006340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc30789390 0x55cc30b4fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.055+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/669006340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307811b0 0x55cc30b4f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.055+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/669006340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307aa070 0x55cc30b4f2c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.055+0000 7fce2bd1b740 1 -- 172.21.15.53:0/669006340 >> 172.21.15.53:0/669006340 conn(0x55cc3079e460 msgr2=0x55cc30b4d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:18.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.055+0000 7fce2bd1b740 1 -- 172.21.15.53:0/669006340 shutdown_connections 2024-08-31T06:18:18.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.055+0000 7fce2bd1b740 1 -- 172.21.15.53:0/669006340 wait complete. 2024-08-31T06:18:18.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.056+0000 7fce2bd1b740 1 -- start start 2024-08-31T06:18:18.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.056+0000 7fce2bd1b740 1 Processor -- start 2024-08-31T06:18:18.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc307811b0 0x55cc30b5aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc30789390 0x55cc30b5af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce1e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc30789390 0x55cc30b5af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307aa070 0x55cc30b66d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cc30918700 con 0x55cc30789390 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cc30a3c700 con 0x55cc307aa070 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cc30b5da40 con 0x55cc307811b0 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce1e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc30789390 0x55cc30b5af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36812/0 (socket says 172.21.15.53:36812) 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce1e7fc640 1 -- 172.21.15.53:0/2955845838 learned_addr learned my addr 172.21.15.53:0/2955845838 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce2bd1b740 10 client.0 _ll_register_callbacks cb 0x55cc30a6bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc307811b0 0x55cc30b5aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce1e7fc640 1 -- 172.21.15.53:0/2955845838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc307811b0 msgr2=0x55cc30b5aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc307811b0 0x55cc30b5aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce1e7fc640 1 -- 172.21.15.53:0/2955845838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307aa070 msgr2=0x55cc30b66d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307aa070 0x55cc30b66d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce1e7fc640 1 -- 172.21.15.53:0/2955845838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc30a758b0 con 0x55cc30789390 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc30789390 0x55cc30b5af40 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fce14012d20 tx=0x7fce1400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800c89feee3f6df4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.057+0000 7fce02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.058+0000 7fce02ff5640 1 -- 172.21.15.53:0/2955845838 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14012110 con 0x55cc30789390 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.058+0000 7fce2bd1b740 1 -- 172.21.15.53:0/2955845838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce18036040 con 0x55cc30789390 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.058+0000 7fce02ff5640 1 -- 172.21.15.53:0/2955845838 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fce14004050 con 0x55cc30789390 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.058+0000 7fce02ff5640 1 -- 172.21.15.53:0/2955845838 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fce140122b0 con 0x55cc30789390 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.058+0000 7fce2bd1b740 10 client.19743 fetch_fsmap learned FSMap version 55 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.058+0000 7fce2bd1b740 1 -- 172.21.15.53:0/2955845838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55cc30b69860 con 0x55cc30789390 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.058+0000 7fce02ff5640 1 -- 172.21.15.53:0/2955845838 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce18036040 con 0x55cc30789390 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.059+0000 7fce02ff5640 1 -- 172.21.15.53:0/2955845838 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 55) ==== 8414+0+0 (secure 0 0 0) 0x7fce14010430 con 0x55cc30789390 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.059+0000 7fce2bd1b740 10 client.19743 fetch_fsmap finished waiting for FSMap version 55 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.059+0000 7fce2bd1b740 10 client.19743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.059+0000 7fce2bd1b740 20 client.19743 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.059+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc307689f0 0x55cc30b6cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.059+0000 7fce2bd1b740 4 client.19743 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:18.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.059+0000 7fce2bd1b740 1 -- 172.21.15.53:0/2955845838 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc30ac8580 con 0x55cc307689f0 2024-08-31T06:18:18.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.059+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc307689f0 0x55cc30b6cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.060+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc307689f0 0x55cc30b6cd70 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=424bbbf66b1481b5 server_cookie=1d4e3774fefd4688 in_seq=0 out_seq=0 2024-08-31T06:18:18.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.060+0000 7fce02ff5640 10 client.19743 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:18.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.060+0000 7fce02ff5640 1 -- 172.21.15.53:0/2955845838 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc30ac8580 con 0x55cc307689f0 2024-08-31T06:18:18.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.060+0000 7fce02ff5640 10 client.19743 handle_command_reply: tid=0 2024-08-31T06:18:18.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.060+0000 7fce2bd1b740 1 client.19743 shutdown 2024-08-31T06:18:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.061+0000 7fce2bd1b740 1 -- 172.21.15.53:0/2955845838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc30789390 msgr2=0x55cc30b5af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.061+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc30789390 0x55cc30b5af40 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fce14012d20 tx=0x7fce1400f790 comp rx=0 tx=0).stop 2024-08-31T06:18:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.061+0000 7fce2bd1b740 1 -- 172.21.15.53:0/2955845838 shutdown_connections 2024-08-31T06:18:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.061+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc307689f0 0x55cc30b6cd70 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.061+0000 7fce02ff5640 0 client.19743 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.061+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307aa070 0x55cc30b66d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.061+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc30789390 0x55cc30b5af40 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.061+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/2955845838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc307811b0 0x55cc30b5aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.061+0000 7fce2bd1b740 1 -- 172.21.15.53:0/2955845838 >> 172.21.15.53:0/2955845838 conn(0x55cc3079e460 msgr2=0x55cc30b524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.061+0000 7fce2bd1b740 1 -- 172.21.15.53:0/2955845838 shutdown_connections 2024-08-31T06:18:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.061+0000 7fce2bd1b740 1 -- 172.21.15.53:0/2955845838 wait complete. 2024-08-31T06:18:18.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.062+0000 7fce2bd1b740 20 client.19743 trim_cache size 0 max 16384 2024-08-31T06:18:18.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.094+0000 7fce2bd1b740 1 Processor -- start 2024-08-31T06:18:18.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.094+0000 7fce2bd1b740 1 -- start start 2024-08-31T06:18:18.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.094+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 0x55cc30b50cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.094+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc307811b0 0x55cc30b5c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.094+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc30789390 0x55cc30b66c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.094+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce201b17a0 con 0x55cc307689f0 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.094+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce201b3520 con 0x55cc30789390 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.094+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce201b1e70 con 0x55cc307811b0 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.095+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 0x55cc30b50cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.095+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 0x55cc30b50cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36824/0 (socket says 172.21.15.53:36824) 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.095+0000 7fce1f7fe640 1 -- 172.21.15.53:0/1103853889 learned_addr learned my addr 172.21.15.53:0/1103853889 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.095+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/1103853889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc307811b0 0x55cc30b5c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.095+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/1103853889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc30789390 0x55cc30b66c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.095+0000 7fce1e7fc640 1 -- 172.21.15.53:0/1103853889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc30789390 msgr2=0x55cc30b66c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.095+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/1103853889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc30789390 0x55cc30b66c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.095+0000 7fce1e7fc640 1 -- 172.21.15.53:0/1103853889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 msgr2=0x55cc30b50cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:18.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.095+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/1103853889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 0x55cc30b50cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.095+0000 7fce1e7fc640 1 -- 172.21.15.53:0/1103853889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc30b48550 con 0x55cc307811b0 2024-08-31T06:18:18.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.095+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/1103853889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc307811b0 0x55cc30b5c630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fce14006010 tx=0x7fce14009320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34028d2256f62c1f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:18.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.096+0000 7fce04ff9640 1 -- 172.21.15.53:0/1103853889 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14028070 con 0x55cc307811b0 2024-08-31T06:18:18.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.096+0000 7fce04ff9640 1 -- 172.21.15.53:0/1103853889 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce14010c70 con 0x55cc307811b0 2024-08-31T06:18:18.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.096+0000 7fce04ff9640 1 -- 172.21.15.53:0/1103853889 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce140038e0 con 0x55cc307811b0 2024-08-31T06:18:18.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.097+0000 7fce2bd1b740 1 -- 172.21.15.53:0/1103853889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc307811b0 msgr2=0x55cc30b5c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:18.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.097+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/1103853889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc307811b0 0x55cc30b5c630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fce14006010 tx=0x7fce14009320 comp rx=0 tx=0).stop 2024-08-31T06:18:18.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.097+0000 7fce2bd1b740 1 -- 172.21.15.53:0/1103853889 shutdown_connections 2024-08-31T06:18:18.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.097+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/1103853889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc30789390 0x55cc30b66c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.097+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/1103853889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc307811b0 0x55cc30b5c630 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.097+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/1103853889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 0x55cc30b50cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.097+0000 7fce2bd1b740 1 -- 172.21.15.53:0/1103853889 >> 172.21.15.53:0/1103853889 conn(0x55cc3079e460 msgr2=0x55cc30b5bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:18.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.097+0000 7fce2bd1b740 1 -- 172.21.15.53:0/1103853889 shutdown_connections 2024-08-31T06:18:18.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.097+0000 7fce2bd1b740 1 -- 172.21.15.53:0/1103853889 wait complete. 2024-08-31T06:18:18.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.097+0000 7fce2bd1b740 1 -- start start 2024-08-31T06:18:18.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce2bd1b740 1 Processor -- start 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 0x55cc30b5ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307811b0 0x55cc30b5f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce2bd1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc30789390 0x55cc30b5f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce201b2d90 con 0x55cc307689f0 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce201b2600 con 0x55cc307811b0 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce2bd1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce201af7a0 con 0x55cc30789390 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 0x55cc30b5ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce2bd1b740 10 client.0 _ll_register_callbacks cb 0x7fce14009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 0x55cc30b5ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36836/0 (socket says 172.21.15.53:36836) 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce1f7fe640 1 -- 172.21.15.53:0/4172291873 learned_addr learned my addr 172.21.15.53:0/4172291873 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc30789390 0x55cc30b5f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.098+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307811b0 0x55cc30b5f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce1f7fe640 1 -- 172.21.15.53:0/4172291873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc30789390 msgr2=0x55cc30b5f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc30789390 0x55cc30b5f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce1f7fe640 1 -- 172.21.15.53:0/4172291873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307811b0 msgr2=0x55cc30b5f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307811b0 0x55cc30b5f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce1f7fe640 1 -- 172.21.15.53:0/4172291873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc30bd6770 con 0x55cc307689f0 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce1f7fe640 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 0x55cc30b5ec20 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fce18009bf0 tx=0x7fce180095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f93d8970892e6cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce02ff5640 1 -- 172.21.15.53:0/4172291873 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1804a040 con 0x55cc307689f0 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce02ff5640 1 -- 172.21.15.53:0/4172291873 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fce18003b70 con 0x55cc307689f0 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce2bd1b740 1 -- 172.21.15.53:0/4172291873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc30ac4020 con 0x55cc307689f0 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce02ff5640 1 -- 172.21.15.53:0/4172291873 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fce18003d70 con 0x55cc307689f0 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce2bd1b740 10 client.19749 fetch_fsmap learned FSMap version 55 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.099+0000 7fce2bd1b740 1 -- 172.21.15.53:0/4172291873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55cc30be01c0 con 0x55cc307689f0 2024-08-31T06:18:18.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.100+0000 7fce02ff5640 1 -- 172.21.15.53:0/4172291873 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce18036040 con 0x55cc307689f0 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.100+0000 7fce02ff5640 1 -- 172.21.15.53:0/4172291873 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 55) ==== 8414+0+0 (secure 0 0 0) 0x7fce180307d0 con 0x55cc307689f0 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.100+0000 7fce2bd1b740 10 client.19749 fetch_fsmap finished waiting for FSMap version 55 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.100+0000 7fce2bd1b740 10 client.19749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.100+0000 7fce2bd1b740 20 client.19749 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.100+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc307aa070 0x55cc30be25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.100+0000 7fce2bd1b740 4 client.19749 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.100+0000 7fce2bd1b740 1 -- 172.21.15.53:0/4172291873 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc30ac4020 con 0x55cc307aa070 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.100+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc307aa070 0x55cc30be25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.101+0000 7fce02ff5640 10 client.19749 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.101+0000 7fce1e7fc640 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc307aa070 0x55cc30be25c0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a66d69fa18df4ed server_cookie=2fb32b967919513b in_seq=0 out_seq=0 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.101+0000 7fce02ff5640 1 -- 172.21.15.53:0/4172291873 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x55cc30ac4020 con 0x55cc307aa070 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.101+0000 7fce02ff5640 10 client.19749 handle_command_reply: tid=0 2024-08-31T06:18:18.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.101+0000 7fce2bd1b740 1 client.19749 shutdown 2024-08-31T06:18:18.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.101+0000 7fce2bd1b740 1 -- 172.21.15.53:0/4172291873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 msgr2=0x55cc30b5ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:18.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.101+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 0x55cc30b5ec20 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fce18009bf0 tx=0x7fce180095c0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.102+0000 7fce2bd1b740 1 -- 172.21.15.53:0/4172291873 shutdown_connections 2024-08-31T06:18:18.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.102+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cc307aa070 0x55cc30be25c0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.102+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc30789390 0x55cc30b5f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.102+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc307811b0 0x55cc30b5f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.102+0000 7fce2bd1b740 1 --2- 172.21.15.53:0/4172291873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cc307689f0 0x55cc30b5ec20 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.102+0000 7fce02ff5640 0 client.19749 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:18.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.102+0000 7fce2bd1b740 1 -- 172.21.15.53:0/4172291873 >> 172.21.15.53:0/4172291873 conn(0x55cc3079e460 msgr2=0x55cc30b5c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:18.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.102+0000 7fce2bd1b740 1 -- 172.21.15.53:0/4172291873 shutdown_connections 2024-08-31T06:18:18.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.102+0000 7fce2bd1b740 1 -- 172.21.15.53:0/4172291873 wait complete. 2024-08-31T06:18:18.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.102+0000 7fce2bd1b740 20 client.19749 trim_cache size 0 max 16384 2024-08-31T06:18:18.111 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:18:18.111 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:18:18.111 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:18:18.111 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:18:18.113 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.114 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:18:18.117 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.118 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:18:18.119 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:18.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:18.122 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:18.122 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:18.122 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:18.122 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:18.122 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:18:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 -- 172.21.15.53:0/1800460629 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce080b4df0 msgr2=0x7fce080b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce080b4df0 0x7fce080b7300 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fce100e3090 tx=0x7fce10010cc0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 -- 172.21.15.53:0/1800460629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce20102800 msgr2=0x7fce2019c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce20102800 0x7fce2019c2d0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fce1000e9f0 tx=0x7fce1000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 -- 172.21.15.53:0/1800460629 shutdown_connections 2024-08-31T06:18:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce080b4df0 0x7fce080b7300 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce20108a90 0x7fce201a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce20108140 0x7fce2019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 --2- 172.21.15.53:0/1800460629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce20102800 0x7fce2019c2d0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 -- 172.21.15.53:0/1800460629 >> 172.21.15.53:0/1800460629 conn(0x7fce200794d0 msgr2=0x7fce20104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 -- 172.21.15.53:0/1800460629 shutdown_connections 2024-08-31T06:18:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:18.103+0000 7fce257a6640 1 -- 172.21.15.53:0/1800460629 wait complete. 2024-08-31T06:18:18.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1115 38.05 MB/sec warmup 6 sec latency 1801.067 ms 2024-08-31T06:18:18.990 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:18:18.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:18:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:19.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1328 36.47 MB/sec warmup 7 sec latency 2801.101 ms 2024-08-31T06:18:19.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:19 smithi053 ceph-mon[18924]: pgmap v740: 97 pgs: 97 active+clean; 295 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 19 MiB/s wr, 177 op/s 2024-08-31T06:18:19.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.888+0000 7f7f62877640 1 -- 172.21.15.53:0/4092187539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f5c108140 msgr2=0x7f7f5c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:19.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.888+0000 7f7f62877640 1 --2- 172.21.15.53:0/4092187539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f5c108140 0x7f7f5c108550 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009860 tx=0x7f7f5002a340 comp rx=0 tx=0).stop 2024-08-31T06:18:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.888+0000 7f7f62877640 1 -- 172.21.15.53:0/4092187539 shutdown_connections 2024-08-31T06:18:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.888+0000 7f7f62877640 1 --2- 172.21.15.53:0/4092187539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f5c108a90 0x7f7f5c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.888+0000 7f7f62877640 1 --2- 172.21.15.53:0/4092187539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f5c108140 0x7f7f5c108550 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.888+0000 7f7f62877640 1 --2- 172.21.15.53:0/4092187539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5c102800 0x7f7f5c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.888+0000 7f7f62877640 1 -- 172.21.15.53:0/4092187539 >> 172.21.15.53:0/4092187539 conn(0x7f7f5c0794d0 msgr2=0x7f7f5c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.888+0000 7f7f62877640 1 -- 172.21.15.53:0/4092187539 shutdown_connections 2024-08-31T06:18:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.889+0000 7f7f62877640 1 -- 172.21.15.53:0/4092187539 wait complete. 2024-08-31T06:18:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.889+0000 7f7f62877640 1 Processor -- start 2024-08-31T06:18:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.889+0000 7f7f62877640 1 -- start start 2024-08-31T06:18:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f62877640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f5c102800 0x7f7f5c19c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f62877640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5c108140 0x7f7f5c19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f62877640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f5c108a90 0x7f7f5c1a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f62877640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c112570 con 0x7f7f5c108a90 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f62877640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c1123f0 con 0x7f7f5c108140 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f62877640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c1126f0 con 0x7f7f5c102800 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f5bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f5c102800 0x7f7f5c19c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f5b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5c108140 0x7f7f5c19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f5bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f5c102800 0x7f7f5c19c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49038/0 (socket says 172.21.15.53:49038) 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f5b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5c108140 0x7f7f5c19c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36542/0 (socket says 172.21.15.53:36542) 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f5bfff640 1 -- 172.21.15.53:0/1291191070 learned_addr learned my addr 172.21.15.53:0/1291191070 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.890+0000 7f7f60e14640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f5c108a90 0x7f7f5c1a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.891+0000 7f7f5b7fe640 1 -- 172.21.15.53:0/1291191070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f5c102800 msgr2=0x7f7f5c19c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.891+0000 7f7f5b7fe640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f5c102800 0x7f7f5c19c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.891+0000 7f7f5b7fe640 1 -- 172.21.15.53:0/1291191070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f5c108a90 msgr2=0x7f7f5c1a1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.891+0000 7f7f5b7fe640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f5c108a90 0x7f7f5c1a1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.891+0000 7f7f5b7fe640 1 -- 172.21.15.53:0/1291191070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c1a22c0 con 0x7f7f5c108140 2024-08-31T06:18:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.891+0000 7f7f5bfff640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f5c102800 0x7f7f5c19c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.891+0000 7f7f5b7fe640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5c108140 0x7f7f5c19c8f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7f5002a860 tx=0x7f7f5002ae40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.891+0000 7f7f597fa640 1 -- 172.21.15.53:0/1291191070 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50040020 con 0x7f7f5c108140 2024-08-31T06:18:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.891+0000 7f7f597fa640 1 -- 172.21.15.53:0/1291191070 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f500044d0 con 0x7f7f5c108140 2024-08-31T06:18:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.891+0000 7f7f597fa640 1 -- 172.21.15.53:0/1291191070 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50037040 con 0x7f7f5c108140 2024-08-31T06:18:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.891+0000 7f7f62877640 1 -- 172.21.15.53:0/1291191070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5c1a2550 con 0x7f7f5c108140 2024-08-31T06:18:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.892+0000 7f7f62877640 1 -- 172.21.15.53:0/1291191070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5c1a28f0 con 0x7f7f5c108140 2024-08-31T06:18:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.893+0000 7f7f62877640 1 -- 172.21.15.53:0/1291191070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5c102c10 con 0x7f7f5c108140 2024-08-31T06:18:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.895+0000 7f7f597fa640 1 -- 172.21.15.53:0/1291191070 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7f50043020 con 0x7f7f5c108140 2024-08-31T06:18:19.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.895+0000 7f7f597fa640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f440b4ca0 0x7f7f440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:19.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.896+0000 7f7f5bfff640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f440b4ca0 0x7f7f440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:19.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.896+0000 7f7f597fa640 1 -- 172.21.15.53:0/1291191070 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f7f501053d0 con 0x7f7f5c108140 2024-08-31T06:18:19.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.896+0000 7f7f5bfff640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f440b4ca0 0x7f7f440b71b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0095f0 tx=0x7f7f4c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:19.900+0000 7f7f597fa640 1 -- 172.21.15.53:0/1291191070 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7f5004a020 con 0x7f7f5c108140 2024-08-31T06:18:19.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:19 smithi153 ceph-mon[22320]: pgmap v740: 97 pgs: 97 active+clean; 295 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 19 MiB/s wr, 177 op/s 2024-08-31T06:18:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:19 smithi130 ceph-mon[22266]: pgmap v740: 97 pgs: 97 active+clean; 295 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 19 MiB/s wr, 177 op/s 2024-08-31T06:18:20.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.274+0000 7f7f62877640 1 -- 172.21.15.53:0/1291191070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f5c1a8f30 con 0x7f7f5c108140 2024-08-31T06:18:20.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.275+0000 7f7f597fa640 1 -- 172.21.15.53:0/1291191070 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+12007 (secure 0 0 0) 0x7f7f500ee090 con 0x7f7f5c108140 2024-08-31T06:18:20.278 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:18:20.279 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":55,"btime":"2024-08-31T06:18:16:433133+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:18:16.373515+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:18:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 55 2024-08-31T06:18:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 -- 172.21.15.53:0/1291191070 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f440b4ca0 msgr2=0x7f7f440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f440b4ca0 0x7f7f440b71b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0095f0 tx=0x7f7f4c005f90 comp rx=0 tx=0).stop 2024-08-31T06:18:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 -- 172.21.15.53:0/1291191070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5c108140 msgr2=0x7f7f5c19c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5c108140 0x7f7f5c19c8f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7f5002a860 tx=0x7f7f5002ae40 comp rx=0 tx=0).stop 2024-08-31T06:18:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 -- 172.21.15.53:0/1291191070 shutdown_connections 2024-08-31T06:18:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7f440b4ca0 0x7f7f440b71b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f5c108a90 0x7f7f5c1a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f5c108140 0x7f7f5c19c8f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 --2- 172.21.15.53:0/1291191070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f5c102800 0x7f7f5c19c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 -- 172.21.15.53:0/1291191070 >> 172.21.15.53:0/1291191070 conn(0x7f7f5c0794d0 msgr2=0x7f7f5c06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 -- 172.21.15.53:0/1291191070 shutdown_connections 2024-08-31T06:18:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:20.278+0000 7f7f62877640 1 -- 172.21.15.53:0/1291191070 wait complete. 2024-08-31T06:18:20.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1474 32.03 MB/sec warmup 8 sec latency 3801.135 ms 2024-08-31T06:18:20.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:20 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1291191070' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:18:20.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:20 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1291191070' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:18:20.977 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:18:21.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:20 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1291191070' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:18:21.330 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:21.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1642 28.65 MB/sec warmup 9 sec latency 4038.663 ms 2024-08-31T06:18:21.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:21 smithi053 ceph-mon[18924]: pgmap v741: 97 pgs: 97 active+clean; 318 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 22 MiB/s wr, 213 op/s 2024-08-31T06:18:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.883+0000 7ffb50321640 1 -- 172.21.15.53:0/2540463515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb48104780 msgr2=0x7ffb48104b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.883+0000 7ffb50321640 1 --2- 172.21.15.53:0/2540463515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb48104780 0x7ffb48104b90 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009900 tx=0x7ffb4402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.883+0000 7ffb50321640 1 -- 172.21.15.53:0/2540463515 shutdown_connections 2024-08-31T06:18:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.883+0000 7ffb50321640 1 --2- 172.21.15.53:0/2540463515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb4810dbe0 0x7ffb481100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.883+0000 7ffb50321640 1 --2- 172.21.15.53:0/2540463515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb481050d0 0x7ffb4810d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.883+0000 7ffb50321640 1 --2- 172.21.15.53:0/2540463515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb48104780 0x7ffb48104b90 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.883+0000 7ffb50321640 1 -- 172.21.15.53:0/2540463515 >> 172.21.15.53:0/2540463515 conn(0x7ffb480794a0 msgr2=0x7ffb480798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:21.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.883+0000 7ffb50321640 1 -- 172.21.15.53:0/2540463515 shutdown_connections 2024-08-31T06:18:21.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.883+0000 7ffb50321640 1 -- 172.21.15.53:0/2540463515 wait complete. 2024-08-31T06:18:21.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.884+0000 7ffb50321640 1 Processor -- start 2024-08-31T06:18:21.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.884+0000 7ffb50321640 1 -- start start 2024-08-31T06:18:21.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.885+0000 7ffb50321640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb48104780 0x7ffb481024c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.885+0000 7ffb50321640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb481050d0 0x7ffb48102a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.885+0000 7ffb50321640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb4810dbe0 0x7ffb48102f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.885+0000 7ffb4e0bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb48104780 0x7ffb481024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.885+0000 7ffb4e0bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb48104780 0x7ffb481024c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36858/0 (socket says 172.21.15.53:36858) 2024-08-31T06:18:21.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.885+0000 7ffb4d8bc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb481050d0 0x7ffb48102a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.885+0000 7ffb4d8bc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb481050d0 0x7ffb48102a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36548/0 (socket says 172.21.15.53:36548) 2024-08-31T06:18:21.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.885+0000 7ffb50321640 1 -- 172.21.15.53:0/949664076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481136f0 con 0x7ffb48104780 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.885+0000 7ffb4e0bd640 1 -- 172.21.15.53:0/949664076 learned_addr learned my addr 172.21.15.53:0/949664076 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.885+0000 7ffb50321640 1 -- 172.21.15.53:0/949664076 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffb48113570 con 0x7ffb481050d0 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.885+0000 7ffb50321640 1 -- 172.21.15.53:0/949664076 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffb48113870 con 0x7ffb4810dbe0 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.886+0000 7ffb4e0bd640 1 -- 172.21.15.53:0/949664076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb4810dbe0 msgr2=0x7ffb48102f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.886+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb4810dbe0 0x7ffb48102f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.886+0000 7ffb4e0bd640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb4810dbe0 0x7ffb48102f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.886+0000 7ffb4e0bd640 1 -- 172.21.15.53:0/949664076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb481050d0 msgr2=0x7ffb48102a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.886+0000 7ffb4e0bd640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb481050d0 0x7ffb48102a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.886+0000 7ffb4e0bd640 1 -- 172.21.15.53:0/949664076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb481a8420 con 0x7ffb48104780 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.886+0000 7ffb4d8bc640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb481050d0 0x7ffb48102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.886+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb4810dbe0 0x7ffb48102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.886+0000 7ffb4e0bd640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb48104780 0x7ffb481024c0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009230 tx=0x7ffb440319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.887+0000 7ffb3f7fe640 1 -- 172.21.15.53:0/949664076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4403f030 con 0x7ffb48104780 2024-08-31T06:18:21.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.887+0000 7ffb3f7fe640 1 -- 172.21.15.53:0/949664076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb440043d0 con 0x7ffb48104780 2024-08-31T06:18:21.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.887+0000 7ffb3f7fe640 1 -- 172.21.15.53:0/949664076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44035070 con 0x7ffb48104780 2024-08-31T06:18:21.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.887+0000 7ffb50321640 1 -- 172.21.15.53:0/949664076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb481a86b0 con 0x7ffb48104780 2024-08-31T06:18:21.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.887+0000 7ffb50321640 1 -- 172.21.15.53:0/949664076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb481a8b40 con 0x7ffb48104780 2024-08-31T06:18:21.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.890+0000 7ffb56896740 1 Processor -- start 2024-08-31T06:18:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.890+0000 7ffb56896740 1 -- start start 2024-08-31T06:18:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb56896740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 0x55986c646310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb56896740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c646850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb56896740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 0x55986c646d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb56896740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55986c5bd680 con 0x55986c280390 2024-08-31T06:18:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb56896740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55986c5acc10 con 0x55986c2781b0 2024-08-31T06:18:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb56896740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55986c5b0bc0 con 0x55986c2a1070 2024-08-31T06:18:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4e8be640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 0x55986c646310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb3f7fe640 1 -- 172.21.15.53:0/949664076 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ffb44042030 con 0x7ffb48104780 2024-08-31T06:18:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4e8be640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 0x55986c646310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49076/0 (socket says 172.21.15.53:49076) 2024-08-31T06:18:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4e8be640 1 -- 172.21.15.53:0/4062343969 learned_addr learned my addr 172.21.15.53:0/4062343969 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4d8bc640 1 --2- 172.21.15.53:0/4062343969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 0x55986c646d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4e0bd640 1 --2- 172.21.15.53:0/4062343969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c646850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4e8be640 1 -- 172.21.15.53:0/4062343969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 msgr2=0x55986c646850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/4062343969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c646850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4e8be640 1 -- 172.21.15.53:0/4062343969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 msgr2=0x55986c646d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/4062343969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 0x55986c646d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4e8be640 1 -- 172.21.15.53:0/4062343969 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986c30c650 con 0x55986c2a1070 2024-08-31T06:18:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4d8bc640 1 --2- 172.21.15.53:0/4062343969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 0x55986c646d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.891+0000 7ffb4e0bd640 1 --2- 172.21.15.53:0/4062343969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c646850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.892+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/4062343969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 0x55986c646310 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009f60 tx=0x7ffb40009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83dacfc09591e1f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.892+0000 7ffb3cd9a640 1 -- 172.21.15.53:0/4062343969 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40011640 con 0x55986c2a1070 2024-08-31T06:18:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.892+0000 7ffb3cd9a640 1 -- 172.21.15.53:0/4062343969 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb40011c70 con 0x55986c2a1070 2024-08-31T06:18:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.892+0000 7ffb3cd9a640 1 -- 172.21.15.53:0/4062343969 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40010bb0 con 0x55986c2a1070 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.892+0000 7ffb3f7fe640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb340b4d20 0x7ffb340b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.892+0000 7ffb3f7fe640 1 -- 172.21.15.53:0/949664076 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7ffb441059a0 con 0x7ffb48104780 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.893+0000 7ffb4e0bd640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb340b4d20 0x7ffb340b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.893+0000 7ffb4e0bd640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb340b4d20 0x7ffb340b7230 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ffb44103180 tx=0x7ffb44009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.893+0000 7ffb56896740 1 -- 172.21.15.53:0/4062343969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 msgr2=0x55986c646310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.893+0000 7ffb56896740 1 --2- 172.21.15.53:0/4062343969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 0x55986c646310 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009f60 tx=0x7ffb40009f90 comp rx=0 tx=0).stop 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.893+0000 7ffb56896740 1 -- 172.21.15.53:0/4062343969 shutdown_connections 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.893+0000 7ffb56896740 1 --2- 172.21.15.53:0/4062343969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 0x55986c646d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.893+0000 7ffb56896740 1 --2- 172.21.15.53:0/4062343969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c646850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.893+0000 7ffb56896740 1 --2- 172.21.15.53:0/4062343969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 0x55986c646310 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.893+0000 7ffb56896740 1 -- 172.21.15.53:0/4062343969 >> 172.21.15.53:0/4062343969 conn(0x55986c295460 msgr2=0x55986c644200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.894+0000 7ffb56896740 1 -- 172.21.15.53:0/4062343969 shutdown_connections 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.894+0000 7ffb56896740 1 -- 172.21.15.53:0/4062343969 wait complete. 2024-08-31T06:18:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.894+0000 7ffb56896740 1 -- start start 2024-08-31T06:18:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.894+0000 7ffb56896740 1 Processor -- start 2024-08-31T06:18:21.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb56896740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c651a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb56896740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 0x55986c651fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb56896740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 0x55986c65de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb4e8be640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c651a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb4e8be640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c651a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36564/0 (socket says 172.21.15.53:36564) 2024-08-31T06:18:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb4e8be640 1 -- 172.21.15.53:0/540385330 learned_addr learned my addr 172.21.15.53:0/540385330 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb4d8bc640 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 0x55986c651fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb56896740 1 -- 172.21.15.53:0/540385330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55986c40f700 con 0x55986c280390 2024-08-31T06:18:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb56896740 1 -- 172.21.15.53:0/540385330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55986c533750 con 0x55986c2781b0 2024-08-31T06:18:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb56896740 1 -- 172.21.15.53:0/540385330 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55986c654af0 con 0x55986c2a1070 2024-08-31T06:18:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 0x55986c65de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb4e8be640 1 -- 172.21.15.53:0/540385330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 msgr2=0x55986c65de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 0x55986c65de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.895+0000 7ffb4e8be640 1 -- 172.21.15.53:0/540385330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 msgr2=0x55986c651fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 0x55986c651fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb56896740 10 client.0 _ll_register_callbacks cb 0x55986c562e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb4e8be640 1 -- 172.21.15.53:0/540385330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55986c56c900 con 0x55986c2781b0 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb4d8bc640 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 0x55986c651fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb56896740 1 -- 172.21.15.53:0/540385330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb40011c70 con 0x55986c2781b0 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c651a80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009d50 tx=0x7ffb40000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=503efbd06d11d4ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb31ffb640 10 client.28772 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb31ffb640 1 -- 172.21.15.53:0/540385330 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40030050 con 0x55986c2781b0 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb31ffb640 1 -- 172.21.15.53:0/540385330 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7ffb40010a60 con 0x55986c2781b0 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb31ffb640 1 -- 172.21.15.53:0/540385330 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ffb40010c60 con 0x55986c2781b0 2024-08-31T06:18:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb56896740 10 client.28772 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.896+0000 7ffb56896740 1 -- 172.21.15.53:0/540385330 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55986c6606e0 con 0x55986c2781b0 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.897+0000 7ffb31ffb640 1 -- 172.21.15.53:0/540385330 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7ffb40033020 con 0x55986c2781b0 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.897+0000 7ffb56896740 10 client.28772 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.897+0000 7ffb56896740 10 client.28772 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.897+0000 7ffb56896740 20 client.28772 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.897+0000 7ffb56896740 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55986c25f9f0 0x55986c663a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.897+0000 7ffb56896740 4 client.28772 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.897+0000 7ffb56896740 1 -- 172.21.15.53:0/540385330 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55986c5bf5d0 con 0x55986c25f9f0 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.897+0000 7ffb4d8bc640 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55986c25f9f0 0x55986c663a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.897+0000 7ffb4d8bc640 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55986c25f9f0 0x55986c663a40 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2574065032c56cd7 server_cookie=af50268530e3f276 in_seq=0 out_seq=0 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.897+0000 7ffb31ffb640 10 client.28772 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb31ffb640 1 -- 172.21.15.53:0/540385330 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55986c5bf5d0 con 0x55986c25f9f0 2024-08-31T06:18:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb31ffb640 10 client.28772 handle_command_reply: tid=0 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb56896740 1 client.28772 shutdown 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb56896740 1 -- 172.21.15.53:0/540385330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 msgr2=0x55986c651a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb56896740 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c651a80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009d50 tx=0x7ffb40000f40 comp rx=0 tx=0).stop 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb56896740 1 -- 172.21.15.53:0/540385330 shutdown_connections 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb56896740 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55986c25f9f0 0x55986c663a40 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb31ffb640 0 client.28772 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb56896740 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c2a1070 0x55986c65de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb56896740 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c280390 0x55986c651fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb56896740 1 --2- 172.21.15.53:0/540385330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c651a80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.898+0000 7ffb56896740 1 -- 172.21.15.53:0/540385330 >> 172.21.15.53:0/540385330 conn(0x55986c295460 msgr2=0x55986c6494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.899+0000 7ffb56896740 1 -- 172.21.15.53:0/540385330 shutdown_connections 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.899+0000 7ffb56896740 1 -- 172.21.15.53:0/540385330 wait complete. 2024-08-31T06:18:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.899+0000 7ffb56896740 20 client.28772 trim_cache size 0 max 16384 2024-08-31T06:18:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.917+0000 7ffb56896740 1 Processor -- start 2024-08-31T06:18:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.917+0000 7ffb56896740 1 -- start start 2024-08-31T06:18:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb56896740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c295460 0x55986c6536b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb56896740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 0x55986c65dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb56896740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c2781b0 0x55986c64ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb56896740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481b16a0 con 0x55986c2781b0 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb56896740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481b3420 con 0x55986c295460 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb56896740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481b1d70 con 0x55986c25f9f0 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb4e8be640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c295460 0x55986c6536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb4e8be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c2781b0 0x55986c64ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb4d8bc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 0x55986c65dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb4e8be640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c295460 0x55986c6536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36580/0 (socket says 172.21.15.53:36580) 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb4e8be640 1 -- 172.21.15.53:0/4014497718 learned_addr learned my addr 172.21.15.53:0/4014497718 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb4e8be640 1 -- 172.21.15.53:0/4014497718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 msgr2=0x55986c65dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/4014497718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 0x55986c65dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb4e8be640 1 -- 172.21.15.53:0/4014497718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c2781b0 msgr2=0x55986c64ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/4014497718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c2781b0 0x55986c64ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb4e8be640 1 -- 172.21.15.53:0/4014497718 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986c6528b0 con 0x55986c295460 2024-08-31T06:18:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.918+0000 7ffb4d8bc640 1 --2- 172.21.15.53:0/4014497718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 0x55986c65dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.919+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/4014497718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c295460 0x55986c6536b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffb40003a10 tx=0x7ffb40025000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=709d3fc105183b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.919+0000 7ffb33fff640 1 -- 172.21.15.53:0/4014497718 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40030040 con 0x55986c295460 2024-08-31T06:18:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.919+0000 7ffb33fff640 1 -- 172.21.15.53:0/4014497718 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb40011c70 con 0x55986c295460 2024-08-31T06:18:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.919+0000 7ffb33fff640 1 -- 172.21.15.53:0/4014497718 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb400052a0 con 0x55986c295460 2024-08-31T06:18:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.920+0000 7ffb56896740 1 -- 172.21.15.53:0/4014497718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c295460 msgr2=0x55986c6536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.920+0000 7ffb56896740 1 --2- 172.21.15.53:0/4014497718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c295460 0x55986c6536b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffb40003a10 tx=0x7ffb40025000 comp rx=0 tx=0).stop 2024-08-31T06:18:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.920+0000 7ffb56896740 1 -- 172.21.15.53:0/4014497718 shutdown_connections 2024-08-31T06:18:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.920+0000 7ffb56896740 1 --2- 172.21.15.53:0/4014497718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c2781b0 0x55986c64ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.920+0000 7ffb56896740 1 --2- 172.21.15.53:0/4014497718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 0x55986c65dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.920+0000 7ffb56896740 1 --2- 172.21.15.53:0/4014497718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c295460 0x55986c6536b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.920+0000 7ffb56896740 1 -- 172.21.15.53:0/4014497718 >> 172.21.15.53:0/4014497718 conn(0x55986c644500 msgr2=0x55986c652fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.920+0000 7ffb56896740 1 -- 172.21.15.53:0/4014497718 shutdown_connections 2024-08-31T06:18:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.920+0000 7ffb56896740 1 -- 172.21.15.53:0/4014497718 wait complete. 2024-08-31T06:18:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.921+0000 7ffb56896740 1 -- start start 2024-08-31T06:18:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.921+0000 7ffb56896740 1 Processor -- start 2024-08-31T06:18:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.921+0000 7ffb56896740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 0x55986c665580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.921+0000 7ffb56896740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c665b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.921+0000 7ffb56896740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c295460 0x55986c6c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.921+0000 7ffb56896740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481b2c90 con 0x55986c295460 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.921+0000 7ffb56896740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481b2500 con 0x55986c2781b0 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.921+0000 7ffb56896740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481af6a0 con 0x55986c25f9f0 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.921+0000 7ffb56896740 10 client.0 _ll_register_callbacks cb 0x7ffb40015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.921+0000 7ffb4e8be640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 0x55986c665580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4d8bc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c665b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4e8be640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 0x55986c665580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49090/0 (socket says 172.21.15.53:49090) 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4d8bc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c665b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36582/0 (socket says 172.21.15.53:36582) 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4e8be640 1 -- 172.21.15.53:0/797529016 learned_addr learned my addr 172.21.15.53:0/797529016 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c295460 0x55986c6c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4d8bc640 1 -- 172.21.15.53:0/797529016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 msgr2=0x55986c665580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4d8bc640 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 0x55986c665580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4d8bc640 1 -- 172.21.15.53:0/797529016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c295460 msgr2=0x55986c6c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4d8bc640 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c295460 0x55986c6c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4d8bc640 1 -- 172.21.15.53:0/797529016 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55986c6c6860 con 0x55986c2781b0 2024-08-31T06:18:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c295460 0x55986c6c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb4d8bc640 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c665b20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55986c533810 tx=0x7ffb38013ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faf6df12df87080e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.922+0000 7ffb31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb31ffb640 1 -- 172.21.15.53:0/797529016 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3802b060 con 0x55986c2781b0 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb31ffb640 1 -- 172.21.15.53:0/797529016 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7ffb38003970 con 0x55986c2781b0 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb56896740 1 -- 172.21.15.53:0/797529016 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb40011c70 con 0x55986c2781b0 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb31ffb640 1 -- 172.21.15.53:0/797529016 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ffb38022040 con 0x55986c2781b0 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb56896740 10 client.28778 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb56896740 1 -- 172.21.15.53:0/797529016 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55986c6ceda0 con 0x55986c2781b0 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb31ffb640 1 -- 172.21.15.53:0/797529016 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb40011c70 con 0x55986c2781b0 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb31ffb640 1 -- 172.21.15.53:0/797529016 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7ffb38026b50 con 0x55986c2781b0 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb56896740 10 client.28778 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb56896740 10 client.28778 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb56896740 20 client.28778 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.923+0000 7ffb56896740 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55986c280390 0x55986c6d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.924+0000 7ffb56896740 4 client.28778 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:18:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.924+0000 7ffb56896740 1 -- 172.21.15.53:0/797529016 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55986c5bb070 con 0x55986c280390 2024-08-31T06:18:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.924+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55986c280390 0x55986c6d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.924+0000 7ffb31ffb640 10 client.28778 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:18:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.924+0000 7ffb4e8be640 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55986c280390 0x55986c6d1560 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=75f350419a6878aa server_cookie=653b6459a7867e74 in_seq=0 out_seq=0 2024-08-31T06:18:21.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.927+0000 7ffb31ffb640 1 -- 172.21.15.53:0/797529016 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55986c5bb070 con 0x55986c280390 2024-08-31T06:18:21.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.927+0000 7ffb31ffb640 10 client.28778 handle_command_reply: tid=0 2024-08-31T06:18:21.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.927+0000 7ffb56896740 1 client.28778 shutdown 2024-08-31T06:18:21.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb56896740 1 -- 172.21.15.53:0/797529016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 msgr2=0x55986c665b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:21.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb56896740 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c665b20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55986c533810 tx=0x7ffb38013ad0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb56896740 1 -- 172.21.15.53:0/797529016 shutdown_connections 2024-08-31T06:18:21.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb56896740 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55986c295460 0x55986c6c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb56896740 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55986c2781b0 0x55986c665b20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb56896740 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55986c280390 0x55986c6d1560 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb56896740 1 --2- 172.21.15.53:0/797529016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55986c25f9f0 0x55986c665580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb56896740 1 -- 172.21.15.53:0/797529016 >> 172.21.15.53:0/797529016 conn(0x55986c644500 msgr2=0x55986c649b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:21.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb31ffb640 0 client.28778 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:18:21.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb56896740 1 -- 172.21.15.53:0/797529016 shutdown_connections 2024-08-31T06:18:21.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb56896740 1 -- 172.21.15.53:0/797529016 wait complete. 2024-08-31T06:18:21.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb56896740 20 client.28778 trim_cache size 0 max 16384 2024-08-31T06:18:21.932 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:18:21.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb50321640 1 -- 172.21.15.53:0/949664076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb340b4d20 msgr2=0x7ffb340b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:21.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb50321640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb340b4d20 0x7ffb340b7230 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ffb44103180 tx=0x7ffb44009260 comp rx=0 tx=0).stop 2024-08-31T06:18:21.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb50321640 1 -- 172.21.15.53:0/949664076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb48104780 msgr2=0x7ffb481024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:21.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.928+0000 7ffb50321640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb48104780 0x7ffb481024c0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009230 tx=0x7ffb440319a0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.929+0000 7ffb50321640 1 -- 172.21.15.53:0/949664076 shutdown_connections 2024-08-31T06:18:21.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.929+0000 7ffb50321640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffb340b4d20 0x7ffb340b7230 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.929+0000 7ffb50321640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb4810dbe0 0x7ffb48102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.929+0000 7ffb50321640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb481050d0 0x7ffb48102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.929+0000 7ffb50321640 1 --2- 172.21.15.53:0/949664076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb48104780 0x7ffb481024c0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:21.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.929+0000 7ffb50321640 1 -- 172.21.15.53:0/949664076 >> 172.21.15.53:0/949664076 conn(0x7ffb480794a0 msgr2=0x7ffb481005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:21.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.929+0000 7ffb50321640 1 -- 172.21.15.53:0/949664076 shutdown_connections 2024-08-31T06:18:21.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:21.929+0000 7ffb50321640 1 -- 172.21.15.53:0/949664076 wait complete. 2024-08-31T06:18:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:21 smithi130 ceph-mon[22266]: pgmap v741: 97 pgs: 97 active+clean; 318 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 22 MiB/s wr, 213 op/s 2024-08-31T06:18:22.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.153+0000 7f1c4d28b640 1 -- 172.21.15.53:0/7390738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c48109af0 msgr2=0x7f1c48110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:22.156 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.153+0000 7f1c4d28b640 1 --2- 172.21.15.53:0/7390738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c48109af0 0x7f1c48110320 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009ca0 tx=0x7f1c4002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.153+0000 7f1c4d28b640 1 -- 172.21.15.53:0/7390738 shutdown_connections 2024-08-31T06:18:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.153+0000 7f1c4d28b640 1 --2- 172.21.15.53:0/7390738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c48109af0 0x7f1c48110320 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.153+0000 7f1c4d28b640 1 --2- 172.21.15.53:0/7390738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c481091a0 0x7f1c481095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.153+0000 7f1c4d28b640 1 --2- 172.21.15.53:0/7390738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c48103870 0x7f1c48103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.153+0000 7f1c4d28b640 1 -- 172.21.15.53:0/7390738 >> 172.21.15.53:0/7390738 conn(0x7f1c480ff2b0 msgr2=0x7f1c48101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.153+0000 7f1c4d28b640 1 -- 172.21.15.53:0/7390738 shutdown_connections 2024-08-31T06:18:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.153+0000 7f1c4d28b640 1 -- 172.21.15.53:0/7390738 wait complete. 2024-08-31T06:18:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.154+0000 7f1c4d28b640 1 Processor -- start 2024-08-31T06:18:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c4d28b640 1 -- start start 2024-08-31T06:18:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c4d28b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c48103870 0x7f1c48118d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c4d28b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c481091a0 0x7f1c48119280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c4d28b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c48109af0 0x7f1c48113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c4d28b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1c48111480 con 0x7f1c48109af0 2024-08-31T06:18:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c4d28b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1c48111300 con 0x7f1c48103870 2024-08-31T06:18:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c4d28b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c48111600 con 0x7f1c481091a0 2024-08-31T06:18:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c3e7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c481091a0 0x7f1c48119280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c48109af0 0x7f1c48113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c3e7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c481091a0 0x7f1c48119280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49106/0 (socket says 172.21.15.53:49106) 2024-08-31T06:18:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c3e7fc640 1 -- 172.21.15.53:0/3127892465 learned_addr learned my addr 172.21.15.53:0/3127892465 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c48109af0 0x7f1c48113170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36902/0 (socket says 172.21.15.53:36902) 2024-08-31T06:18:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.155+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c48103870 0x7f1c48118d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.156+0000 7f1c3e7fc640 1 -- 172.21.15.53:0/3127892465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c48103870 msgr2=0x7f1c48118d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.156+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c48103870 0x7f1c48118d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.156+0000 7f1c3e7fc640 1 -- 172.21.15.53:0/3127892465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c48109af0 msgr2=0x7f1c48113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.156+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c48109af0 0x7f1c48113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.156+0000 7f1c3e7fc640 1 -- 172.21.15.53:0/3127892465 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c48113990 con 0x7f1c481091a0 2024-08-31T06:18:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.156+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c481091a0 0x7f1c48119280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000e9f0 tx=0x7f1c3000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.156+0000 7f1c44ff9640 1 -- 172.21.15.53:0/3127892465 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000ccc0 con 0x7f1c481091a0 2024-08-31T06:18:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.156+0000 7f1c4d28b640 1 -- 172.21.15.53:0/3127892465 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c48113c80 con 0x7f1c481091a0 2024-08-31T06:18:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.156+0000 7f1c4d28b640 1 -- 172.21.15.53:0/3127892465 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c481b5810 con 0x7f1c481091a0 2024-08-31T06:18:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.156+0000 7f1c44ff9640 1 -- 172.21.15.53:0/3127892465 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c300108c0 con 0x7f1c481091a0 2024-08-31T06:18:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.156+0000 7f1c44ff9640 1 -- 172.21.15.53:0/3127892465 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30018750 con 0x7f1c481091a0 2024-08-31T06:18:22.163 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.160+0000 7f1c541f5740 1 Processor -- start 2024-08-31T06:18:22.163 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.160+0000 7f1c541f5740 1 -- start start 2024-08-31T06:18:22.163 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.160+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa279021b0 0x55aa27ca5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.160+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 0x55aa27ca6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.160+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 0x55aa27ca6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.160+0000 7f1c541f5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55aa27c1b000 con 0x55aa278e14d0 2024-08-31T06:18:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.160+0000 7f1c541f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55aa27c0a590 con 0x55aa279021b0 2024-08-31T06:18:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.160+0000 7f1c541f5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa27c0e540 con 0x55aa278d92f0 2024-08-31T06:18:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.160+0000 7f1c477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa279021b0 0x55aa27ca5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.160+0000 7f1c44ff9640 1 -- 172.21.15.53:0/3127892465 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1c300188f0 con 0x7f1c481091a0 2024-08-31T06:18:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.160+0000 7f1c477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa279021b0 0x55aa27ca5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36610/0 (socket says 172.21.15.53:36610) 2024-08-31T06:18:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.161+0000 7f1c477fe640 1 -- 172.21.15.53:0/253646487 learned_addr learned my addr 172.21.15.53:0/253646487 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.161+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/253646487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 0x55aa27ca6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.161+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/253646487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 0x55aa27ca6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.161+0000 7f1c46ffd640 1 -- 172.21.15.53:0/253646487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa279021b0 msgr2=0x55aa27ca5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.161+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/253646487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa279021b0 0x55aa27ca5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.161+0000 7f1c46ffd640 1 -- 172.21.15.53:0/253646487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 msgr2=0x55aa27ca6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.161+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/253646487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 0x55aa27ca6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.161+0000 7f1c46ffd640 1 -- 172.21.15.53:0/253646487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa2796d790 con 0x55aa278d92f0 2024-08-31T06:18:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.161+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/253646487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 0x55aa27ca6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.162+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/253646487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 0x55aa27ca6220 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1c38005fd0 tx=0x7f1c380107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31690a46889fc1dc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.162+0000 7f1c3d7fa640 1 -- 172.21.15.53:0/253646487 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3801c680 con 0x55aa278d92f0 2024-08-31T06:18:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.162+0000 7f1c3d7fa640 1 -- 172.21.15.53:0/253646487 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c3800be20 con 0x55aa278d92f0 2024-08-31T06:18:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.162+0000 7f1c3d7fa640 1 -- 172.21.15.53:0/253646487 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38011b30 con 0x55aa278d92f0 2024-08-31T06:18:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.162+0000 7f1c44ff9640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c340b4d00 0x7f1c340b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.163+0000 7f1c44ff9640 1 -- 172.21.15.53:0/3127892465 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f1c300e5640 con 0x7f1c481091a0 2024-08-31T06:18:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.163+0000 7f1c477fe640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c340b4d00 0x7f1c340b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.163+0000 7f1c541f5740 1 -- 172.21.15.53:0/253646487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 msgr2=0x55aa27ca6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.163+0000 7f1c541f5740 1 --2- 172.21.15.53:0/253646487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 0x55aa27ca6220 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1c38005fd0 tx=0x7f1c380107a0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.163+0000 7f1c477fe640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c340b4d00 0x7f1c340b7210 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009a60 tx=0x7f1c40009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.163+0000 7f1c541f5740 1 -- 172.21.15.53:0/253646487 shutdown_connections 2024-08-31T06:18:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.163+0000 7f1c541f5740 1 --2- 172.21.15.53:0/253646487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 0x55aa27ca6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.163+0000 7f1c541f5740 1 --2- 172.21.15.53:0/253646487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 0x55aa27ca6220 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.163+0000 7f1c541f5740 1 --2- 172.21.15.53:0/253646487 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa279021b0 0x55aa27ca5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.163+0000 7f1c541f5740 1 -- 172.21.15.53:0/253646487 >> 172.21.15.53:0/253646487 conn(0x55aa278f6300 msgr2=0x55aa27ca3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.164+0000 7f1c541f5740 1 -- 172.21.15.53:0/253646487 shutdown_connections 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.164+0000 7f1c541f5740 1 -- 172.21.15.53:0/253646487 wait complete. 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.164+0000 7f1c541f5740 1 -- start start 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.164+0000 7f1c541f5740 1 Processor -- start 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278d92f0 0x55aa27cb1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 0x55aa27cb1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa279021b0 0x55aa27cbd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c541f5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55aa27b43ab0 con 0x55aa278e14d0 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c541f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55aa27b91680 con 0x55aa278d92f0 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c541f5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa27cb4460 con 0x55aa279021b0 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c3e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 0x55aa27cb1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c46ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278d92f0 0x55aa27cb1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c3e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 0x55aa27cb1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36928/0 (socket says 172.21.15.53:36928) 2024-08-31T06:18:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c46ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278d92f0 0x55aa27cb1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36618/0 (socket says 172.21.15.53:36618) 2024-08-31T06:18:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c3e7fc640 1 -- 172.21.15.53:0/47379216 learned_addr learned my addr 172.21.15.53:0/47379216 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c541f5740 10 client.0 _ll_register_callbacks cb 0x55aa27919a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c477fe640 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa279021b0 0x55aa27cbd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c46ffd640 1 -- 172.21.15.53:0/47379216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa279021b0 msgr2=0x55aa27cbd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa279021b0 0x55aa27cbd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c46ffd640 1 -- 172.21.15.53:0/47379216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 msgr2=0x55aa27cb1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 0x55aa27cb1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c46ffd640 1 -- 172.21.15.53:0/47379216 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa279e6620 con 0x55aa278d92f0 2024-08-31T06:18:22.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.165+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 0x55aa27cb1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.166+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278d92f0 0x55aa27cb1840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c38005d00 tx=0x7f1c3800ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5015331e7f4abb0f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.166+0000 7f1c2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.166+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/47379216 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38012dd0 con 0x55aa278d92f0 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.166+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/47379216 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f1c38005020 con 0x55aa278d92f0 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.166+0000 7f1c541f5740 1 -- 172.21.15.53:0/47379216 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c3800be20 con 0x55aa278d92f0 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.166+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/47379216 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f1c38005220 con 0x55aa278d92f0 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.166+0000 7f1c541f5740 10 client.28790 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.166+0000 7f1c541f5740 1 -- 172.21.15.53:0/47379216 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55aa27cc04b0 con 0x55aa278d92f0 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.166+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/47379216 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c3800be20 con 0x55aa278d92f0 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.167+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/47379216 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f1c3801c480 con 0x55aa278d92f0 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.167+0000 7f1c541f5740 10 client.28790 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.167+0000 7f1c541f5740 10 client.28790 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.167+0000 7f1c541f5740 20 client.28790 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.167+0000 7f1c541f5740 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa278c0d80 0x55aa27cc3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.167+0000 7f1c541f5740 4 client.28790 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.167+0000 7f1c541f5740 1 -- 172.21.15.53:0/47379216 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa27c1cf50 con 0x55aa278c0d80 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.167+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa278c0d80 0x55aa27cc3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.168+0000 7f1c2e7fc640 10 client.28790 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.168+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa278c0d80 0x55aa27cc3870 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e26aeb36294859fe server_cookie=ed8110a832d88e51 in_seq=0 out_seq=0 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.168+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/47379216 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa27c1cf50 con 0x55aa278c0d80 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.168+0000 7f1c2e7fc640 10 client.28790 handle_command_reply: tid=0 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.168+0000 7f1c541f5740 1 client.28790 shutdown 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c541f5740 1 -- 172.21.15.53:0/47379216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278d92f0 msgr2=0x55aa27cb1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c541f5740 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278d92f0 0x55aa27cb1840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c38005d00 tx=0x7f1c3800ba20 comp rx=0 tx=0).stop 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c541f5740 1 -- 172.21.15.53:0/47379216 shutdown_connections 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c541f5740 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa278c0d80 0x55aa27cc3870 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c541f5740 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa279021b0 0x55aa27cbd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c541f5740 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278e14d0 0x55aa27cb1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c541f5740 1 --2- 172.21.15.53:0/47379216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278d92f0 0x55aa27cb1840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c2e7fc640 0 client.28790 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c541f5740 1 -- 172.21.15.53:0/47379216 >> 172.21.15.53:0/47379216 conn(0x55aa278f6300 msgr2=0x55aa27ca6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c541f5740 1 -- 172.21.15.53:0/47379216 shutdown_connections 2024-08-31T06:18:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c541f5740 1 -- 172.21.15.53:0/47379216 wait complete. 2024-08-31T06:18:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.169+0000 7f1c541f5740 20 client.28790 trim_cache size 0 max 16384 2024-08-31T06:18:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:21 smithi153 ceph-mon[22320]: pgmap v741: 97 pgs: 97 active+clean; 318 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 22 MiB/s wr, 213 op/s 2024-08-31T06:18:22.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c541f5740 1 Processor -- start 2024-08-31T06:18:22.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c541f5740 1 -- start start 2024-08-31T06:18:22.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278d92f0 0x55aa27ca76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278e14d0 0x55aa27cb1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa279021b0 0x55aa27cb3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c541f5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2800e8c0 con 0x55aa278d92f0 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c541f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1c28010640 con 0x55aa279021b0 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c541f5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2800ef90 con 0x55aa278e14d0 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278d92f0 0x55aa27ca76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278d92f0 0x55aa27ca76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36930/0 (socket says 172.21.15.53:36930) 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c46ffd640 1 -- 172.21.15.53:0/2084305061 learned_addr learned my addr 172.21.15.53:0/2084305061 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/2084305061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278e14d0 0x55aa27cb1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.192+0000 7f1c477fe640 1 --2- 172.21.15.53:0/2084305061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa279021b0 0x55aa27cb3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.193+0000 7f1c46ffd640 1 -- 172.21.15.53:0/2084305061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278e14d0 msgr2=0x55aa27cb1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.193+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/2084305061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278e14d0 0x55aa27cb1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.193+0000 7f1c46ffd640 1 -- 172.21.15.53:0/2084305061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa279021b0 msgr2=0x55aa27cb3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.193+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/2084305061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa279021b0 0x55aa27cb3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.193+0000 7f1c46ffd640 1 -- 172.21.15.53:0/2084305061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa27ca4570 con 0x55aa278d92f0 2024-08-31T06:18:22.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.193+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/2084305061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278d92f0 0x55aa27ca76d0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1c3801c850 tx=0x7f1c38005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0658b6b73b6184c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:22.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.193+0000 7f1c3cff9640 1 -- 172.21.15.53:0/2084305061 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c380053c0 con 0x55aa278d92f0 2024-08-31T06:18:22.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.193+0000 7f1c3cff9640 1 -- 172.21.15.53:0/2084305061 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c38005560 con 0x55aa278d92f0 2024-08-31T06:18:22.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.193+0000 7f1c3cff9640 1 -- 172.21.15.53:0/2084305061 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c380122a0 con 0x55aa278d92f0 2024-08-31T06:18:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.195+0000 7f1c541f5740 1 -- 172.21.15.53:0/2084305061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278d92f0 msgr2=0x55aa27ca76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.195+0000 7f1c541f5740 1 --2- 172.21.15.53:0/2084305061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278d92f0 0x55aa27ca76d0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1c3801c850 tx=0x7f1c38005780 comp rx=0 tx=0).stop 2024-08-31T06:18:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.195+0000 7f1c541f5740 1 -- 172.21.15.53:0/2084305061 shutdown_connections 2024-08-31T06:18:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.195+0000 7f1c541f5740 1 --2- 172.21.15.53:0/2084305061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa279021b0 0x55aa27cb3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.195+0000 7f1c541f5740 1 --2- 172.21.15.53:0/2084305061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278e14d0 0x55aa27cb1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.195+0000 7f1c541f5740 1 --2- 172.21.15.53:0/2084305061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa278d92f0 0x55aa27ca76d0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.195+0000 7f1c541f5740 1 -- 172.21.15.53:0/2084305061 >> 172.21.15.53:0/2084305061 conn(0x55aa278f6300 msgr2=0x55aa27cb2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.195+0000 7f1c541f5740 1 -- 172.21.15.53:0/2084305061 shutdown_connections 2024-08-31T06:18:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.195+0000 7f1c541f5740 1 -- 172.21.15.53:0/2084305061 wait complete. 2024-08-31T06:18:22.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.195+0000 7f1c541f5740 1 -- start start 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c541f5740 1 Processor -- start 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 0x55aa27cb4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278e14d0 0x55aa27cb5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c541f5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa279021b0 0x55aa27d2c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c541f5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2800feb0 con 0x55aa279021b0 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c541f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2800f720 con 0x55aa278e14d0 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c541f5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2800c8c0 con 0x55aa278d92f0 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c46ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 0x55aa27cb4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c541f5740 10 client.0 _ll_register_callbacks cb 0x7f1c300eb420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c46ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 0x55aa27cb4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49154/0 (socket says 172.21.15.53:49154) 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c46ffd640 1 -- 172.21.15.53:0/3465158490 learned_addr learned my addr 172.21.15.53:0/3465158490 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.196+0000 7f1c477fe640 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa279021b0 0x55aa27d2c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.201 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.197+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278e14d0 0x55aa27cb5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.197+0000 7f1c46ffd640 1 -- 172.21.15.53:0/3465158490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278e14d0 msgr2=0x55aa27cb5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.197+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278e14d0 0x55aa27cb5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.197+0000 7f1c46ffd640 1 -- 172.21.15.53:0/3465158490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa279021b0 msgr2=0x55aa27d2c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.197+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa279021b0 0x55aa27d2c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.202 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.197+0000 7f1c46ffd640 1 -- 172.21.15.53:0/3465158490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa27ca8af0 con 0x55aa278d92f0 2024-08-31T06:18:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.197+0000 7f1c46ffd640 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 0x55aa27cb4f40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1c38010e80 tx=0x7f1c38005b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d5c406b31a40e88 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.197+0000 7f1c2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:18:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.197+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/3465158490 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c380053c0 con 0x55aa278d92f0 2024-08-31T06:18:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.197+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/3465158490 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f1c3801ccc0 con 0x55aa278d92f0 2024-08-31T06:18:22.203 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.197+0000 7f1c541f5740 1 -- 172.21.15.53:0/3465158490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c38005560 con 0x55aa278d92f0 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.198+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/3465158490 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f1c38049050 con 0x55aa278d92f0 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.198+0000 7f1c541f5740 10 client.28786 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.198+0000 7f1c541f5740 1 -- 172.21.15.53:0/3465158490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55aa27d2d830 con 0x55aa278d92f0 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.198+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/3465158490 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c38005560 con 0x55aa278d92f0 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.198+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/3465158490 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f1c38011650 con 0x55aa278d92f0 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.198+0000 7f1c541f5740 10 client.28786 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.198+0000 7f1c541f5740 10 client.28786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.198+0000 7f1c541f5740 20 client.28786 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.198+0000 7f1c541f5740 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa278961c0 0x55aa27d2ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.198+0000 7f1c541f5740 4 client.28786 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.198+0000 7f1c541f5740 1 -- 172.21.15.53:0/3465158490 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aa27c189f0 con 0x55aa278961c0 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.199+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa278961c0 0x55aa27d2ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:22.204 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.199+0000 7f1c2e7fc640 10 client.28786 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:22.205 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.199+0000 7f1c3e7fc640 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa278961c0 0x55aa27d2ff90 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab48f78659c41d44 server_cookie=2434cf5efd6236e6 in_seq=0 out_seq=0 2024-08-31T06:18:22.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.298+0000 7f1c2e7fc640 1 -- 172.21.15.53:0/3465158490 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aa27c189f0 con 0x55aa278961c0 2024-08-31T06:18:22.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.298+0000 7f1c2e7fc640 10 client.28786 handle_command_reply: tid=0 2024-08-31T06:18:22.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.298+0000 7f1c541f5740 1 client.28786 shutdown 2024-08-31T06:18:22.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.298+0000 7f1c541f5740 1 -- 172.21.15.53:0/3465158490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 msgr2=0x55aa27cb4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.298+0000 7f1c541f5740 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 0x55aa27cb4f40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1c38010e80 tx=0x7f1c38005b90 comp rx=0 tx=0).stop 2024-08-31T06:18:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c541f5740 1 -- 172.21.15.53:0/3465158490 shutdown_connections 2024-08-31T06:18:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c541f5740 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa278961c0 0x55aa27d2ff90 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c541f5740 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa279021b0 0x55aa27d2c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c2e7fc640 0 client.28786 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c541f5740 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa278e14d0 0x55aa27cb5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c541f5740 1 --2- 172.21.15.53:0/3465158490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa278d92f0 0x55aa27cb4f40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c541f5740 1 -- 172.21.15.53:0/3465158490 >> 172.21.15.53:0/3465158490 conn(0x55aa278f6300 msgr2=0x55aa27cb33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c541f5740 1 -- 172.21.15.53:0/3465158490 shutdown_connections 2024-08-31T06:18:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c541f5740 1 -- 172.21.15.53:0/3465158490 wait complete. 2024-08-31T06:18:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c541f5740 20 client.28786 trim_cache size 0 max 16384 2024-08-31T06:18:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:18:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:18:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:18:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:18:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c4d28b640 1 -- 172.21.15.53:0/3127892465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c340b4d00 msgr2=0x7f1c340b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c4d28b640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c340b4d00 0x7f1c340b7210 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009a60 tx=0x7f1c40009360 comp rx=0 tx=0).stop 2024-08-31T06:18:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c4d28b640 1 -- 172.21.15.53:0/3127892465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c481091a0 msgr2=0x7f1c48119280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.299+0000 7f1c4d28b640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c481091a0 0x7f1c48119280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000e9f0 tx=0x7f1c3000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.300+0000 7f1c4d28b640 1 -- 172.21.15.53:0/3127892465 shutdown_connections 2024-08-31T06:18:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.300+0000 7f1c4d28b640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c340b4d00 0x7f1c340b7210 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.300+0000 7f1c4d28b640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c48109af0 0x7f1c48113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.300+0000 7f1c4d28b640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c481091a0 0x7f1c48119280 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.300+0000 7f1c4d28b640 1 --2- 172.21.15.53:0/3127892465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c48103870 0x7f1c48118d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.300+0000 7f1c4d28b640 1 -- 172.21.15.53:0/3127892465 >> 172.21.15.53:0/3127892465 conn(0x7f1c480ff2b0 msgr2=0x7f1c481016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.300+0000 7f1c4d28b640 1 -- 172.21.15.53:0/3127892465 shutdown_connections 2024-08-31T06:18:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:22.300+0000 7f1c4d28b640 1 -- 172.21.15.53:0/3127892465 wait complete. 2024-08-31T06:18:22.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1803 25.96 MB/sec warmup 10 sec latency 105.049 ms 2024-08-31T06:18:22.754 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:18:22.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:22 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:18:23.116 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:23.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:22 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:18:23.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:22 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:18:23.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 1991 23.97 MB/sec warmup 11 sec latency 64.790 ms 2024-08-31T06:18:23.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.689+0000 7f45ba517640 1 -- 172.21.15.53:0/500252423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45b4102800 msgr2=0x7f45b4102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:23.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.689+0000 7f45ba517640 1 --2- 172.21.15.53:0/500252423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45b4102800 0x7f45b4102c10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f45a4009860 tx=0x7f45a402a340 comp rx=0 tx=0).stop 2024-08-31T06:18:23.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.689+0000 7f45ba517640 1 -- 172.21.15.53:0/500252423 shutdown_connections 2024-08-31T06:18:23.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.689+0000 7f45ba517640 1 --2- 172.21.15.53:0/500252423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45b4108a90 0x7f45b410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.689+0000 7f45ba517640 1 --2- 172.21.15.53:0/500252423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45b4108140 0x7f45b4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.689+0000 7f45ba517640 1 --2- 172.21.15.53:0/500252423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45b4102800 0x7f45b4102c10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.689+0000 7f45ba517640 1 -- 172.21.15.53:0/500252423 >> 172.21.15.53:0/500252423 conn(0x7f45b40794d0 msgr2=0x7f45b40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:23.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.690+0000 7f45ba517640 1 -- 172.21.15.53:0/500252423 shutdown_connections 2024-08-31T06:18:23.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.690+0000 7f45ba517640 1 -- 172.21.15.53:0/500252423 wait complete. 2024-08-31T06:18:23.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.690+0000 7f45ba517640 1 Processor -- start 2024-08-31T06:18:23.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45ba517640 1 -- start start 2024-08-31T06:18:23.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45ba517640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45b4102800 0x7f45b419c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45ba517640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45b4108140 0x7f45b419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45ba517640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45b4108a90 0x7f45b41a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45ba517640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f45b41158a0 con 0x7f45b4108a90 2024-08-31T06:18:23.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45ba517640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f45b4115720 con 0x7f45b4102800 2024-08-31T06:18:23.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45ba517640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f45b4115a20 con 0x7f45b4108140 2024-08-31T06:18:23.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45b3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45b4102800 0x7f45b419c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45b37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45b4108140 0x7f45b419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45b3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45b4102800 0x7f45b419c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53346/0 (socket says 172.21.15.53:53346) 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45b3fff640 1 -- 172.21.15.53:0/2132333337 learned_addr learned my addr 172.21.15.53:0/2132333337 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.691+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45b4108a90 0x7f45b41a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45b37fe640 1 -- 172.21.15.53:0/2132333337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45b4102800 msgr2=0x7f45b419c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45b37fe640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45b4102800 0x7f45b419c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45b37fe640 1 -- 172.21.15.53:0/2132333337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45b4108a90 msgr2=0x7f45b41a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45b37fe640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45b4108a90 0x7f45b41a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45b37fe640 1 -- 172.21.15.53:0/2132333337 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b41a2280 con 0x7f45b4108140 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45b3fff640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45b4102800 0x7f45b419c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45b37fe640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45b4108140 0x7f45b419c8b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f459c00e9c0 tx=0x7f459c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45b17fa640 1 -- 172.21.15.53:0/2132333337 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c00ccc0 con 0x7f45b4108140 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45ba517640 1 -- 172.21.15.53:0/2132333337 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b41a2570 con 0x7f45b4108140 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45b17fa640 1 -- 172.21.15.53:0/2132333337 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f459c0108c0 con 0x7f45b4108140 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45b17fa640 1 -- 172.21.15.53:0/2132333337 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c018730 con 0x7f45b4108140 2024-08-31T06:18:23.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.692+0000 7f45ba517640 1 -- 172.21.15.53:0/2132333337 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b41a8cd0 con 0x7f45b4108140 2024-08-31T06:18:23.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45c0a8c740 1 Processor -- start 2024-08-31T06:18:23.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45c0a8c740 1 -- start start 2024-08-31T06:18:23.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45b17fa640 1 -- 172.21.15.53:0/2132333337 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f459c010430 con 0x7f45b4108140 2024-08-31T06:18:23.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c295f9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c2922b1b0 0x555c295f9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c29233390 0x555c295f9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45c0a8c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555c29570680 con 0x555c29233390 2024-08-31T06:18:23.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45c0a8c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555c2955fc10 con 0x555c29254070 2024-08-31T06:18:23.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45c0a8c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555c29563bc0 con 0x555c2922b1b0 2024-08-31T06:18:23.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45b3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c2922b1b0 0x555c295f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45b3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c2922b1b0 0x555c295f9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:55702/0 (socket says 172.21.15.53:55702) 2024-08-31T06:18:23.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45b3fff640 1 -- 172.21.15.53:0/663255661 learned_addr learned my addr 172.21.15.53:0/663255661 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:23.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.696+0000 7f45b37fe640 1 --2- 172.21.15.53:0/663255661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c29233390 0x555c295f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.697+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/663255661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c295f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.697+0000 7f45b3fff640 1 -- 172.21.15.53:0/663255661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 msgr2=0x555c295f9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:23.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.697+0000 7f45b3fff640 1 --2- 172.21.15.53:0/663255661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c295f9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.697+0000 7f45b3fff640 1 -- 172.21.15.53:0/663255661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c29233390 msgr2=0x555c295f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:23.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.697+0000 7f45b17fa640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45a00b4c90 0x7f45a00b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.698+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45a00b4c90 0x7f45a00b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.698+0000 7f45b17fa640 1 -- 172.21.15.53:0/2132333337 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f459c0e5880 con 0x7f45b4108140 2024-08-31T06:18:23.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.698+0000 7f45b3fff640 1 --2- 172.21.15.53:0/663255661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c29233390 0x555c295f9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.698+0000 7f45b3fff640 1 -- 172.21.15.53:0/663255661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c292bf650 con 0x555c2922b1b0 2024-08-31T06:18:23.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.698+0000 7f45b37fe640 1 --2- 172.21.15.53:0/663255661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c29233390 0x555c295f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:23.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.698+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45a00b4c90 0x7f45a00b71a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f45ac005fd0 tx=0x7f45ac010040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:23.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.698+0000 7f45b3fff640 1 --2- 172.21.15.53:0/663255661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c2922b1b0 0x555c295f9850 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f45a4005940 tx=0x7f45a4030ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1787b9b7c14530fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:23.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.701+0000 7f45aa7fc640 1 -- 172.21.15.53:0/663255661 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4037040 con 0x555c2922b1b0 2024-08-31T06:18:23.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.701+0000 7f45aa7fc640 1 -- 172.21.15.53:0/663255661 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45a40044c0 con 0x555c2922b1b0 2024-08-31T06:18:23.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.701+0000 7f45aa7fc640 1 -- 172.21.15.53:0/663255661 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4032ae0 con 0x555c2922b1b0 2024-08-31T06:18:23.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.702+0000 7f45c0a8c740 1 -- 172.21.15.53:0/663255661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c2922b1b0 msgr2=0x555c295f9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:23.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.702+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/663255661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c2922b1b0 0x555c295f9850 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f45a4005940 tx=0x7f45a4030ab0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.702+0000 7f45c0a8c740 1 -- 172.21.15.53:0/663255661 shutdown_connections 2024-08-31T06:18:23.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.702+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/663255661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c29233390 0x555c295f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.702+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/663255661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c2922b1b0 0x555c295f9850 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.702+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/663255661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c295f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.702+0000 7f45c0a8c740 1 -- 172.21.15.53:0/663255661 >> 172.21.15.53:0/663255661 conn(0x555c29248460 msgr2=0x555c295f7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:23.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.703+0000 7f45c0a8c740 1 -- 172.21.15.53:0/663255661 shutdown_connections 2024-08-31T06:18:23.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.703+0000 7f45c0a8c740 1 -- 172.21.15.53:0/663255661 wait complete. 2024-08-31T06:18:23.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.703+0000 7f45c0a8c740 1 -- start start 2024-08-31T06:18:23.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.703+0000 7f45c0a8c740 1 Processor -- start 2024-08-31T06:18:23.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.704+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c29604ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.704+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29233390 0x555c29605000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.704+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c29610d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.704+0000 7f45b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c29604ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.704+0000 7f45b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c29604ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49126/0 (socket says 172.21.15.53:49126) 2024-08-31T06:18:23.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.704+0000 7f45b3fff640 1 -- 172.21.15.53:0/4067232675 learned_addr learned my addr 172.21.15.53:0/4067232675 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:23.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.704+0000 7f45c0a8c740 1 -- 172.21.15.53:0/4067232675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555c293c2700 con 0x555c2922b1b0 2024-08-31T06:18:23.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.704+0000 7f45c0a8c740 1 -- 172.21.15.53:0/4067232675 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555c294e6750 con 0x555c29254070 2024-08-31T06:18:23.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.704+0000 7f45c0a8c740 1 -- 172.21.15.53:0/4067232675 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555c29607a90 con 0x555c29233390 2024-08-31T06:18:23.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.704+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c29610d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.704+0000 7f45c0a8c740 10 client.0 _ll_register_callbacks cb 0x555c29515e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45b37fe640 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29233390 0x555c29605000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45b8ab4640 1 -- 172.21.15.53:0/4067232675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29233390 msgr2=0x555c29605000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29233390 0x555c29605000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45b8ab4640 1 -- 172.21.15.53:0/4067232675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 msgr2=0x555c29604ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c29604ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45b8ab4640 1 -- 172.21.15.53:0/4067232675 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c2951f900 con 0x555c29254070 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45b3fff640 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c29604ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45b37fe640 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29233390 0x555c29605000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c29610d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45ac004390 tx=0x7f45ac004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa8071ec836faff2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45937fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45937fe640 1 -- 172.21.15.53:0/4067232675 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac020040 con 0x555c29254070 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45937fe640 1 -- 172.21.15.53:0/4067232675 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f45ac00dc60 con 0x555c29254070 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45c0a8c740 1 -- 172.21.15.53:0/4067232675 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c295725d0 con 0x555c29254070 2024-08-31T06:18:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45937fe640 1 -- 172.21.15.53:0/4067232675 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f45ac032050 con 0x555c29254070 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45c0a8c740 10 client.28808 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.705+0000 7f45c0a8c740 1 -- 172.21.15.53:0/4067232675 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x555c296138d0 con 0x555c29254070 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.706+0000 7f45937fe640 1 -- 172.21.15.53:0/4067232675 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555c295725d0 con 0x555c29254070 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.706+0000 7f45937fe640 1 -- 172.21.15.53:0/4067232675 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f45ac00b040 con 0x555c29254070 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.706+0000 7f45c0a8c740 10 client.28808 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.706+0000 7f45c0a8c740 10 client.28808 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.706+0000 7f45c0a8c740 20 client.28808 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.706+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555c292129f0 0x555c29616f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.706+0000 7f45c0a8c740 4 client.28808 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.706+0000 7f45c0a8c740 1 -- 172.21.15.53:0/4067232675 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c2956e070 con 0x555c292129f0 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.706+0000 7f45b3fff640 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555c292129f0 0x555c29616f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.707+0000 7f45937fe640 10 client.28808 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:18:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.707+0000 7f45b3fff640 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555c292129f0 0x555c29616f60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=43aa2856a1d53882 server_cookie=608b30f5224b3118 in_seq=0 out_seq=0 2024-08-31T06:18:23.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.707+0000 7f45937fe640 1 -- 172.21.15.53:0/4067232675 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c2956e070 con 0x555c292129f0 2024-08-31T06:18:23.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.707+0000 7f45937fe640 10 client.28808 handle_command_reply: tid=0 2024-08-31T06:18:23.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.708+0000 7f45c0a8c740 1 client.28808 shutdown 2024-08-31T06:18:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.708+0000 7f45c0a8c740 1 -- 172.21.15.53:0/4067232675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 msgr2=0x555c29610d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.708+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c29610d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45ac004390 tx=0x7f45ac004ab0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.708+0000 7f45c0a8c740 1 -- 172.21.15.53:0/4067232675 shutdown_connections 2024-08-31T06:18:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.708+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c29610d80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.708+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29233390 0x555c29605000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.708+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555c292129f0 0x555c29616f60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.708+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/4067232675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c29604ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.708+0000 7f45937fe640 0 client.28808 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:18:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.708+0000 7f45c0a8c740 1 -- 172.21.15.53:0/4067232675 >> 172.21.15.53:0/4067232675 conn(0x555c29248460 msgr2=0x555c295fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.709+0000 7f45c0a8c740 1 -- 172.21.15.53:0/4067232675 shutdown_connections 2024-08-31T06:18:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.709+0000 7f45c0a8c740 1 -- 172.21.15.53:0/4067232675 wait complete. 2024-08-31T06:18:23.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.709+0000 7f45c0a8c740 20 client.28808 trim_cache size 0 max 16384 2024-08-31T06:18:23.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.728+0000 7f45c0a8c740 1 Processor -- start 2024-08-31T06:18:23.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.728+0000 7f45c0a8c740 1 -- start start 2024-08-31T06:18:23.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c295faa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29233390 0x555c29601cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29254070 0x555c296021f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45c0a8c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f45b41b16d0 con 0x555c2922b1b0 2024-08-31T06:18:23.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45c0a8c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f45b41b3450 con 0x555c29233390 2024-08-31T06:18:23.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45c0a8c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f45b41b1da0 con 0x555c29254070 2024-08-31T06:18:23.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c295faa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c295faa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49128/0 (socket says 172.21.15.53:49128) 2024-08-31T06:18:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45b3fff640 1 -- 172.21.15.53:0/3320663871 learned_addr learned my addr 172.21.15.53:0/3320663871 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45b37fe640 1 --2- 172.21.15.53:0/3320663871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29233390 0x555c29601cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/3320663871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29254070 0x555c296021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45b3fff640 1 -- 172.21.15.53:0/3320663871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29254070 msgr2=0x555c296021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45b3fff640 1 --2- 172.21.15.53:0/3320663871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29254070 0x555c296021f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45b3fff640 1 -- 172.21.15.53:0/3320663871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29233390 msgr2=0x555c29601cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45b3fff640 1 --2- 172.21.15.53:0/3320663871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29233390 0x555c29601cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45b3fff640 1 -- 172.21.15.53:0/3320663871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c295fb600 con 0x555c2922b1b0 2024-08-31T06:18:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.729+0000 7f45b37fe640 1 --2- 172.21.15.53:0/3320663871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29233390 0x555c29601cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.730+0000 7f45b3fff640 1 --2- 172.21.15.53:0/3320663871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c295faa50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f45a4031000 tx=0x7f45a403f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22eba936afe2d19 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.730+0000 7f45a9ffb640 1 -- 172.21.15.53:0/3320663871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4037040 con 0x555c2922b1b0 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.730+0000 7f45a9ffb640 1 -- 172.21.15.53:0/3320663871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45a4053070 con 0x555c2922b1b0 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.730+0000 7f45a9ffb640 1 -- 172.21.15.53:0/3320663871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4032a50 con 0x555c2922b1b0 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.731+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3320663871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 msgr2=0x555c295faa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.731+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/3320663871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c295faa50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f45a4031000 tx=0x7f45a403f040 comp rx=0 tx=0).stop 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.731+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3320663871 shutdown_connections 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.731+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/3320663871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29254070 0x555c296021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.731+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/3320663871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29233390 0x555c29601cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.731+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/3320663871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c295faa50 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.731+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3320663871 >> 172.21.15.53:0/3320663871 conn(0x555c29248460 msgr2=0x555c295fa340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.731+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3320663871 shutdown_connections 2024-08-31T06:18:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.731+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3320663871 wait complete. 2024-08-31T06:18:23.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.732+0000 7f45c0a8c740 1 -- start start 2024-08-31T06:18:23.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.732+0000 7f45c0a8c740 1 Processor -- start 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c2960a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29233390 0x555c2960ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45c0a8c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c296788e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45c0a8c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f45b41b2cc0 con 0x555c2922b1b0 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c2960a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45c0a8c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f45b41b2530 con 0x555c29254070 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45c0a8c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f45b41af6d0 con 0x555c29233390 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c2960a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49142/0 (socket says 172.21.15.53:49142) 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45b3fff640 1 -- 172.21.15.53:0/3419455469 learned_addr learned my addr 172.21.15.53:0/3419455469 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45c0a8c740 10 client.0 _ll_register_callbacks cb 0x7f45ac01d040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45b37fe640 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29233390 0x555c2960ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.733+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c296788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.734+0000 7f45b8ab4640 1 -- 172.21.15.53:0/3419455469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29233390 msgr2=0x555c2960ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.734+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29233390 0x555c2960ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.734+0000 7f45b8ab4640 1 -- 172.21.15.53:0/3419455469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 msgr2=0x555c2960a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.734+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c2960a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.734+0000 7f45b8ab4640 1 -- 172.21.15.53:0/3419455469 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c29678f50 con 0x555c29254070 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.734+0000 7f45b8ab4640 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c296788e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00eea0 tx=0x7f45ac024840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4e10e8cb386da7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.734+0000 7f45937fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.734+0000 7f45937fe640 1 -- 172.21.15.53:0/3419455469 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac020040 con 0x555c29254070 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.734+0000 7f45937fe640 1 -- 172.21.15.53:0/3419455469 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f45ac024a30 con 0x555c29254070 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.734+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3419455469 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45a4053070 con 0x555c29254070 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.735+0000 7f45937fe640 1 -- 172.21.15.53:0/3419455469 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f45ac024c30 con 0x555c29254070 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.735+0000 7f45c0a8c740 10 client.28814 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.735+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3419455469 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x555c29681410 con 0x555c29254070 2024-08-31T06:18:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.735+0000 7f45937fe640 1 -- 172.21.15.53:0/3419455469 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45a4053070 con 0x555c29254070 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.735+0000 7f45937fe640 1 -- 172.21.15.53:0/3419455469 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f45ac00b040 con 0x555c29254070 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.735+0000 7f45c0a8c740 10 client.28814 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.735+0000 7f45c0a8c740 10 client.28814 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.735+0000 7f45c0a8c740 20 client.28814 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.736+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555c291e7da0 0x555c29683c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.736+0000 7f45c0a8c740 4 client.28814 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.736+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3419455469 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555c2956b7b0 con 0x555c291e7da0 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.736+0000 7f45b3fff640 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555c291e7da0 0x555c29683c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.736+0000 7f45937fe640 10 client.28814 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.736+0000 7f45b3fff640 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555c291e7da0 0x555c29683c40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ef1240dff27d281d server_cookie=b4c239df23c49e10 in_seq=0 out_seq=0 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.736+0000 7f45937fe640 1 -- 172.21.15.53:0/3419455469 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555c2956b7b0 con 0x555c291e7da0 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45937fe640 10 client.28814 handle_command_reply: tid=0 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45c0a8c740 1 client.28814 shutdown 2024-08-31T06:18:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3419455469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 msgr2=0x555c296788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:23.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c296788e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00eea0 tx=0x7f45ac024840 comp rx=0 tx=0).stop 2024-08-31T06:18:23.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3419455469 shutdown_connections 2024-08-31T06:18:23.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c29254070 0x555c296788e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c29233390 0x555c2960ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555c291e7da0 0x555c29683c40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45c0a8c740 1 --2- 172.21.15.53:0/3419455469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2922b1b0 0x555c2960a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3419455469 >> 172.21.15.53:0/3419455469 conn(0x555c29248460 msgr2=0x555c29605d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45937fe640 0 client.28814 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:18:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3419455469 shutdown_connections 2024-08-31T06:18:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.737+0000 7f45c0a8c740 1 -- 172.21.15.53:0/3419455469 wait complete. 2024-08-31T06:18:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.738+0000 7f45c0a8c740 20 client.28814 trim_cache size 0 max 16384 2024-08-31T06:18:23.744 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:18:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.738+0000 7f45ba517640 1 -- 172.21.15.53:0/2132333337 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45a00b4c90 msgr2=0x7f45a00b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.738+0000 7f45ba517640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45a00b4c90 0x7f45a00b71a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f45ac005fd0 tx=0x7f45ac010040 comp rx=0 tx=0).stop 2024-08-31T06:18:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.738+0000 7f45ba517640 1 -- 172.21.15.53:0/2132333337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45b4108140 msgr2=0x7f45b419c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.738+0000 7f45ba517640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45b4108140 0x7f45b419c8b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f459c00e9c0 tx=0x7f459c00ee80 comp rx=0 tx=0).stop 2024-08-31T06:18:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.738+0000 7f45ba517640 1 -- 172.21.15.53:0/2132333337 shutdown_connections 2024-08-31T06:18:23.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.738+0000 7f45ba517640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45a00b4c90 0x7f45a00b71a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.738+0000 7f45ba517640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45b4108a90 0x7f45b41a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.738+0000 7f45ba517640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45b4108140 0x7f45b419c8b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.738+0000 7f45ba517640 1 --2- 172.21.15.53:0/2132333337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45b4102800 0x7f45b419c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:23.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.738+0000 7f45ba517640 1 -- 172.21.15.53:0/2132333337 >> 172.21.15.53:0/2132333337 conn(0x7f45b40794d0 msgr2=0x7f45b4101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:23.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.739+0000 7f45ba517640 1 -- 172.21.15.53:0/2132333337 shutdown_connections 2024-08-31T06:18:23.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:23.739+0000 7f45ba517640 1 -- 172.21.15.53:0/2132333337 wait complete. 2024-08-31T06:18:23.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:23 smithi053 ceph-mon[18924]: pgmap v742: 97 pgs: 97 active+clean; 320 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 22 MiB/s wr, 245 op/s 2024-08-31T06:18:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:23 smithi130 ceph-mon[22266]: pgmap v742: 97 pgs: 97 active+clean; 320 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 22 MiB/s wr, 245 op/s 2024-08-31T06:18:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:23 smithi153 ceph-mon[22320]: pgmap v742: 97 pgs: 97 active+clean; 320 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 22 MiB/s wr, 245 op/s 2024-08-31T06:18:24.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 2158 22.52 MB/sec warmup 12 sec latency 68.223 ms 2024-08-31T06:18:24.565 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:18:24.913 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:25.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 2318 21.44 MB/sec warmup 13 sec latency 62.848 ms 2024-08-31T06:18:25.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.476+0000 7f672026d640 1 -- 172.21.15.53:0/2773490471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6718108160 msgr2=0x7f6718108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:25.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.476+0000 7f672026d640 1 --2- 172.21.15.53:0/2773490471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6718108160 0x7f6718108570 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f6708009900 tx=0x7f670802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.476+0000 7f672026d640 1 -- 172.21.15.53:0/2773490471 shutdown_connections 2024-08-31T06:18:25.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.476+0000 7f672026d640 1 --2- 172.21.15.53:0/2773490471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6718108ab0 0x7f671810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.476+0000 7f672026d640 1 --2- 172.21.15.53:0/2773490471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6718108160 0x7f6718108570 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.476+0000 7f672026d640 1 --2- 172.21.15.53:0/2773490471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6718102870 0x7f6718102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.476+0000 7f672026d640 1 -- 172.21.15.53:0/2773490471 >> 172.21.15.53:0/2773490471 conn(0x7f6718079470 msgr2=0x7f6718079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:25.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.476+0000 7f672026d640 1 -- 172.21.15.53:0/2773490471 shutdown_connections 2024-08-31T06:18:25.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.476+0000 7f672026d640 1 -- 172.21.15.53:0/2773490471 wait complete. 2024-08-31T06:18:25.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.477+0000 7f672026d640 1 Processor -- start 2024-08-31T06:18:25.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.477+0000 7f672026d640 1 -- start start 2024-08-31T06:18:25.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f672026d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6718102870 0x7f6718110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f672026d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6718108160 0x7f6718110590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f672026d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6718108ab0 0x7f6718110ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f672026d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f67181136d0 con 0x7f6718108160 2024-08-31T06:18:25.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f672026d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6718113550 con 0x7f6718102870 2024-08-31T06:18:25.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f672026d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6718113850 con 0x7f6718108ab0 2024-08-31T06:18:25.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f671d808640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6718108160 0x7f6718110590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f671e009640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6718102870 0x7f6718110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f671d808640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6718108160 0x7f6718110590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49150/0 (socket says 172.21.15.53:49150) 2024-08-31T06:18:25.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f671d808640 1 -- 172.21.15.53:0/1455979944 learned_addr learned my addr 172.21.15.53:0/1455979944 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:25.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f671e80a640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6718108ab0 0x7f6718110ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f671e009640 1 -- 172.21.15.53:0/1455979944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6718108ab0 msgr2=0x7f6718110ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f671e009640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6718108ab0 0x7f6718110ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f671e009640 1 -- 172.21.15.53:0/1455979944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6718108160 msgr2=0x7f6718110590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f671e009640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6718108160 0x7f6718110590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f671e009640 1 -- 172.21.15.53:0/1455979944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67181a84e0 con 0x7f6718102870 2024-08-31T06:18:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.478+0000 7f671e80a640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6718108ab0 0x7f6718110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.479+0000 7f671e009640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6718102870 0x7f6718110050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f671400e9f0 tx=0x7f671400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.479+0000 7f670f7fe640 1 -- 172.21.15.53:0/1455979944 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671400cd80 con 0x7f6718102870 2024-08-31T06:18:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.479+0000 7f672026d640 1 -- 172.21.15.53:0/1455979944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67181a87d0 con 0x7f6718102870 2024-08-31T06:18:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.479+0000 7f670f7fe640 1 -- 172.21.15.53:0/1455979944 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67140035f0 con 0x7f6718102870 2024-08-31T06:18:25.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.479+0000 7f672026d640 1 -- 172.21.15.53:0/1455979944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67181a8ce0 con 0x7f6718102870 2024-08-31T06:18:25.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.479+0000 7f670f7fe640 1 -- 172.21.15.53:0/1455979944 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714010670 con 0x7f6718102870 2024-08-31T06:18:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.483+0000 7f67267e2740 1 Processor -- start 2024-08-31T06:18:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.483+0000 7f670f7fe640 1 -- 172.21.15.53:0/1455979944 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f67140108d0 con 0x7f6718102870 2024-08-31T06:18:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.483+0000 7f67267e2740 1 -- start start 2024-08-31T06:18:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.483+0000 7f67267e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2c14070 0x559ed2fb9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.483+0000 7f67267e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2beb1b0 0x559ed2fb9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.483+0000 7f67267e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 0x559ed2fb9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.483+0000 7f67267e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559ed2f30680 con 0x559ed2beb1b0 2024-08-31T06:18:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.483+0000 7f67267e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559ed2f1fc10 con 0x559ed2bf3390 2024-08-31T06:18:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.483+0000 7f67267e2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559ed2f23bc0 con 0x559ed2c14070 2024-08-31T06:18:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f671e009640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2beb1b0 0x559ed2fb9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f671e80a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2c14070 0x559ed2fb9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f671d808640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 0x559ed2fb9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f671e009640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2beb1b0 0x559ed2fb9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49164/0 (socket says 172.21.15.53:49164) 2024-08-31T06:18:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f671e009640 1 -- 172.21.15.53:0/2163827861 learned_addr learned my addr 172.21.15.53:0/2163827861 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f670f7fe640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67040b4ca0 0x7f67040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f671e009640 1 -- 172.21.15.53:0/2163827861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2c14070 msgr2=0x559ed2fb9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f671e009640 1 --2- 172.21.15.53:0/2163827861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2c14070 0x559ed2fb9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f671e009640 1 -- 172.21.15.53:0/2163827861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 msgr2=0x559ed2fb9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f671e80a640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67040b4ca0 0x7f67040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f671e009640 1 --2- 172.21.15.53:0/2163827861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 0x559ed2fb9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.484+0000 7f670f7fe640 1 -- 172.21.15.53:0/1455979944 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f67140e56f0 con 0x7f6718102870 2024-08-31T06:18:25.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.485+0000 7f671e009640 1 -- 172.21.15.53:0/2163827861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed2c7f650 con 0x559ed2beb1b0 2024-08-31T06:18:25.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.485+0000 7f671d808640 1 --2- 172.21.15.53:0/2163827861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 0x559ed2fb9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:25.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.485+0000 7f671e009640 1 --2- 172.21.15.53:0/2163827861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2beb1b0 0x559ed2fb9850 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f67140e2d90 tx=0x7f671400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca41360cd5856510 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:25.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.485+0000 7f671e80a640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67040b4ca0 0x7f67040b71b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6710005fd0 tx=0x7f6710004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:25.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.485+0000 7f670cd9a640 1 -- 172.21.15.53:0/2163827861 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67140ab530 con 0x559ed2beb1b0 2024-08-31T06:18:25.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.485+0000 7f670cd9a640 1 -- 172.21.15.53:0/2163827861 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67140ab8d0 con 0x559ed2beb1b0 2024-08-31T06:18:25.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.485+0000 7f670cd9a640 1 -- 172.21.15.53:0/2163827861 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67140ab530 con 0x559ed2beb1b0 2024-08-31T06:18:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.486+0000 7f67267e2740 1 -- 172.21.15.53:0/2163827861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2beb1b0 msgr2=0x559ed2fb9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.486+0000 7f67267e2740 1 --2- 172.21.15.53:0/2163827861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2beb1b0 0x559ed2fb9850 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f67140e2d90 tx=0x7f671400cf60 comp rx=0 tx=0).stop 2024-08-31T06:18:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.486+0000 7f67267e2740 1 -- 172.21.15.53:0/2163827861 shutdown_connections 2024-08-31T06:18:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.486+0000 7f67267e2740 1 --2- 172.21.15.53:0/2163827861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 0x559ed2fb9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.486+0000 7f67267e2740 1 --2- 172.21.15.53:0/2163827861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2beb1b0 0x559ed2fb9850 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.486+0000 7f67267e2740 1 --2- 172.21.15.53:0/2163827861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2c14070 0x559ed2fb9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.486+0000 7f67267e2740 1 -- 172.21.15.53:0/2163827861 >> 172.21.15.53:0/2163827861 conn(0x559ed2c08460 msgr2=0x559ed2fb7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.487+0000 7f67267e2740 1 -- 172.21.15.53:0/2163827861 shutdown_connections 2024-08-31T06:18:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.487+0000 7f67267e2740 1 -- 172.21.15.53:0/2163827861 wait complete. 2024-08-31T06:18:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.487+0000 7f67267e2740 1 -- start start 2024-08-31T06:18:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.487+0000 7f67267e2740 1 Processor -- start 2024-08-31T06:18:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f67267e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bf3390 0x559ed2fc4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f67267e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2c14070 0x559ed2fc4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f67267e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2bd29f0 0x559ed2fd0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f67267e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559ed2d82700 con 0x559ed2bf3390 2024-08-31T06:18:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f67267e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559ed2ea6750 con 0x559ed2c14070 2024-08-31T06:18:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f67267e2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559ed2fc7a90 con 0x559ed2bd29f0 2024-08-31T06:18:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f67267e2740 10 client.0 _ll_register_callbacks cb 0x559ed2ed5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f671e009640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bf3390 0x559ed2fc4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f671e009640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bf3390 0x559ed2fc4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49166/0 (socket says 172.21.15.53:49166) 2024-08-31T06:18:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f671d808640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2c14070 0x559ed2fc4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f671e009640 1 -- 172.21.15.53:0/1185115995 learned_addr learned my addr 172.21.15.53:0/1185115995 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.488+0000 7f671e80a640 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2bd29f0 0x559ed2fd0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f671d808640 1 -- 172.21.15.53:0/1185115995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2bd29f0 msgr2=0x559ed2fd0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f671d808640 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2bd29f0 0x559ed2fd0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f671d808640 1 -- 172.21.15.53:0/1185115995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bf3390 msgr2=0x559ed2fc4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f671d808640 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bf3390 0x559ed2fc4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f671d808640 1 -- 172.21.15.53:0/1185115995 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed2edf900 con 0x559ed2c14070 2024-08-31T06:18:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f671e80a640 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2bd29f0 0x559ed2fd0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f671d808640 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2c14070 0x559ed2fc4f80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f67080057c0 tx=0x7f6708031e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cfe313d54ae09da server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f6701ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:18:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f6701ffb640 1 -- 172.21.15.53:0/1185115995 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708035040 con 0x559ed2c14070 2024-08-31T06:18:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f6701ffb640 1 -- 172.21.15.53:0/1185115995 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f6708004040 con 0x559ed2c14070 2024-08-31T06:18:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f67267e2740 1 -- 172.21.15.53:0/1185115995 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67140ab8d0 con 0x559ed2c14070 2024-08-31T06:18:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.489+0000 7f6701ffb640 1 -- 172.21.15.53:0/1185115995 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f6708004240 con 0x559ed2c14070 2024-08-31T06:18:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.490+0000 7f67267e2740 10 client.28826 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.490+0000 7f67267e2740 1 -- 172.21.15.53:0/1185115995 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x559ed2fd3890 con 0x559ed2c14070 2024-08-31T06:18:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.490+0000 7f6701ffb640 1 -- 172.21.15.53:0/1185115995 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67140ab8d0 con 0x559ed2c14070 2024-08-31T06:18:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.490+0000 7f6701ffb640 1 -- 172.21.15.53:0/1185115995 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f6708044020 con 0x559ed2c14070 2024-08-31T06:18:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.490+0000 7f67267e2740 10 client.28826 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.490+0000 7f67267e2740 10 client.28826 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:18:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.490+0000 7f67267e2740 20 client.28826 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.490+0000 7f67267e2740 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x559ed2ba7da0 0x559ed2fd6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.490+0000 7f67267e2740 4 client.28826 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.490+0000 7f67267e2740 1 -- 172.21.15.53:0/1185115995 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ed2f325d0 con 0x559ed2ba7da0 2024-08-31T06:18:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.491+0000 7f671e009640 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x559ed2ba7da0 0x559ed2fd6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.491+0000 7f6701ffb640 10 client.28826 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.491+0000 7f671e009640 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x559ed2ba7da0 0x559ed2fd6ed0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7f8f7ba2cbbff135 server_cookie=401f143cf058175b in_seq=0 out_seq=0 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f6701ffb640 1 -- 172.21.15.53:0/1185115995 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559ed2f325d0 con 0x559ed2ba7da0 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f6701ffb640 10 client.28826 handle_command_reply: tid=0 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f67267e2740 1 client.28826 shutdown 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f67267e2740 1 -- 172.21.15.53:0/1185115995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2c14070 msgr2=0x559ed2fc4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f67267e2740 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2c14070 0x559ed2fc4f80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f67080057c0 tx=0x7f6708031e70 comp rx=0 tx=0).stop 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f67267e2740 1 -- 172.21.15.53:0/1185115995 shutdown_connections 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f67267e2740 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x559ed2ba7da0 0x559ed2fd6ed0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f67267e2740 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2bd29f0 0x559ed2fd0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f67267e2740 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2c14070 0x559ed2fc4f80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f6701ffb640 0 client.28826 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f67267e2740 1 --2- 172.21.15.53:0/1185115995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bf3390 0x559ed2fc4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.492+0000 7f67267e2740 1 -- 172.21.15.53:0/1185115995 >> 172.21.15.53:0/1185115995 conn(0x559ed2c08460 msgr2=0x559ed2fbad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.493+0000 7f67267e2740 1 -- 172.21.15.53:0/1185115995 shutdown_connections 2024-08-31T06:18:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.493+0000 7f67267e2740 1 -- 172.21.15.53:0/1185115995 wait complete. 2024-08-31T06:18:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.493+0000 7f67267e2740 20 client.28826 trim_cache size 0 max 16384 2024-08-31T06:18:25.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.517+0000 7f67267e2740 1 Processor -- start 2024-08-31T06:18:25.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.517+0000 7f67267e2740 1 -- start start 2024-08-31T06:18:25.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.517+0000 7f67267e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 0x559ed2fd0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.517+0000 7f67267e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2bf3390 0x559ed2fc32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.517+0000 7f67267e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2c14070 0x559ed2fc3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.517+0000 7f67267e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc00e830 con 0x559ed2bd29f0 2024-08-31T06:18:25.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.517+0000 7f67267e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc0105b0 con 0x559ed2c14070 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.517+0000 7f67267e2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc00ef00 con 0x559ed2bf3390 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.517+0000 7f671e009640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 0x559ed2fd0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.517+0000 7f671e009640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 0x559ed2fd0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49178/0 (socket says 172.21.15.53:49178) 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.517+0000 7f671e009640 1 -- 172.21.15.53:0/3188706276 learned_addr learned my addr 172.21.15.53:0/3188706276 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.518+0000 7f671d808640 1 --2- 172.21.15.53:0/3188706276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2bf3390 0x559ed2fc32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.518+0000 7f671e80a640 1 --2- 172.21.15.53:0/3188706276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2c14070 0x559ed2fc3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.518+0000 7f671e009640 1 -- 172.21.15.53:0/3188706276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2bf3390 msgr2=0x559ed2fc32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.518+0000 7f671e009640 1 --2- 172.21.15.53:0/3188706276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2bf3390 0x559ed2fc32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.518+0000 7f671e009640 1 -- 172.21.15.53:0/3188706276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2c14070 msgr2=0x559ed2fc3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.518+0000 7f671e009640 1 --2- 172.21.15.53:0/3188706276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2c14070 0x559ed2fc3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.518+0000 7f671e009640 1 -- 172.21.15.53:0/3188706276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed2fbc170 con 0x559ed2bd29f0 2024-08-31T06:18:25.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.518+0000 7f671e009640 1 --2- 172.21.15.53:0/3188706276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 0x559ed2fd0d10 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f671400cfd0 tx=0x7f67140eb550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2659a76ff6996103 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:25.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.518+0000 7f6703fff640 1 -- 172.21.15.53:0/3188706276 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67140ab8d0 con 0x559ed2bd29f0 2024-08-31T06:18:25.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.518+0000 7f6703fff640 1 -- 172.21.15.53:0/3188706276 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67140b50e0 con 0x559ed2bd29f0 2024-08-31T06:18:25.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.518+0000 7f6703fff640 1 -- 172.21.15.53:0/3188706276 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67140a8050 con 0x559ed2bd29f0 2024-08-31T06:18:25.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.520+0000 7f67267e2740 1 -- 172.21.15.53:0/3188706276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 msgr2=0x559ed2fd0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:25.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.520+0000 7f67267e2740 1 --2- 172.21.15.53:0/3188706276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 0x559ed2fd0d10 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f671400cfd0 tx=0x7f67140eb550 comp rx=0 tx=0).stop 2024-08-31T06:18:25.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.520+0000 7f67267e2740 1 -- 172.21.15.53:0/3188706276 shutdown_connections 2024-08-31T06:18:25.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.520+0000 7f67267e2740 1 --2- 172.21.15.53:0/3188706276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2c14070 0x559ed2fc3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.520+0000 7f67267e2740 1 --2- 172.21.15.53:0/3188706276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2bf3390 0x559ed2fc32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.520+0000 7f67267e2740 1 --2- 172.21.15.53:0/3188706276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 0x559ed2fd0d10 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.520+0000 7f67267e2740 1 -- 172.21.15.53:0/3188706276 >> 172.21.15.53:0/3188706276 conn(0x559ed2c08460 msgr2=0x559ed2fbfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.520+0000 7f67267e2740 1 -- 172.21.15.53:0/3188706276 shutdown_connections 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.520+0000 7f67267e2740 1 -- 172.21.15.53:0/3188706276 wait complete. 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.520+0000 7f67267e2740 1 -- start start 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.520+0000 7f67267e2740 1 Processor -- start 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.521+0000 7f67267e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 0x559ed2fc8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.521+0000 7f67267e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 0x559ed2fc9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.521+0000 7f67267e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2c14070 0x559ed2fc98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.521+0000 7f671e009640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 0x559ed2fc8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.521+0000 7f67267e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc00fe20 con 0x559ed2bd29f0 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f671d808640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 0x559ed2fc9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f671e80a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2c14070 0x559ed2fc98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f671d808640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 0x559ed2fc9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53402/0 (socket says 172.21.15.53:53402) 2024-08-31T06:18:25.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f671d808640 1 -- 172.21.15.53:0/3759483679 learned_addr learned my addr 172.21.15.53:0/3759483679 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:25.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f67267e2740 1 -- 172.21.15.53:0/3759483679 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc00f690 con 0x559ed2bf3390 2024-08-31T06:18:25.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f67267e2740 1 -- 172.21.15.53:0/3759483679 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc00c830 con 0x559ed2c14070 2024-08-31T06:18:25.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f67267e2740 10 client.0 _ll_register_callbacks cb 0x7f6708009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f671d808640 1 -- 172.21.15.53:0/3759483679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2c14070 msgr2=0x559ed2fc98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f671d808640 1 --2- 172.21.15.53:0/3759483679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2c14070 0x559ed2fc98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f671d808640 1 -- 172.21.15.53:0/3759483679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 msgr2=0x559ed2fc8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f671d808640 1 --2- 172.21.15.53:0/3759483679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 0x559ed2fc8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.522+0000 7f671d808640 1 -- 172.21.15.53:0/3759483679 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed3040920 con 0x559ed2bf3390 2024-08-31T06:18:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.523+0000 7f67267e2740 1 -- 172.21.15.53:0/3759483679 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67140b50e0 con 0x559ed2bf3390 2024-08-31T06:18:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.523+0000 7f671d808640 1 --2- 172.21.15.53:0/3759483679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 0x559ed2fc9360 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6708006010 tx=0x7f6708004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29856259c1e2e842 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.523+0000 7f6701ffb640 10 client.28832 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.523+0000 7f6701ffb640 1 -- 172.21.15.53:0/3759483679 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670805c050 con 0x559ed2bf3390 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.523+0000 7f6701ffb640 1 -- 172.21.15.53:0/3759483679 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f6708031750 con 0x559ed2bf3390 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.523+0000 7f6701ffb640 1 -- 172.21.15.53:0/3759483679 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f6708052070 con 0x559ed2bf3390 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.523+0000 7f67267e2740 10 client.28832 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.524+0000 7f67267e2740 1 -- 172.21.15.53:0/3759483679 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=56}) -- 0x559ed3041a40 con 0x559ed2bf3390 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.524+0000 7f6701ffb640 1 -- 172.21.15.53:0/3759483679 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f670805f020 con 0x559ed2bf3390 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.524+0000 7f67267e2740 10 client.28832 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.524+0000 7f67267e2740 10 client.28832 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.524+0000 7f67267e2740 20 client.28832 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.524+0000 7f67267e2740 1 --2- 172.21.15.53:0/3759483679 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x559ed3042170 0x559ed30445c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.524+0000 7f67267e2740 4 client.28832 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.524+0000 7f67267e2740 1 -- 172.21.15.53:0/3759483679 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f67140b50e0 con 0x559ed3042170 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.525+0000 7f671e009640 1 --2- 172.21.15.53:0/3759483679 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x559ed3042170 0x559ed30445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:25.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.525+0000 7f6701ffb640 10 client.28832 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.525+0000 7f671e009640 1 --2- 172.21.15.53:0/3759483679 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x559ed3042170 0x559ed30445c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf4f701cf3578d9 server_cookie=1512f92e4cff2a36 in_seq=0 out_seq=0 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f6701ffb640 1 -- 172.21.15.53:0/3759483679 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f67140b50e0 con 0x559ed3042170 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f6701ffb640 10 client.28832 handle_command_reply: tid=0 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f67267e2740 1 client.28832 shutdown 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f67267e2740 1 -- 172.21.15.53:0/3759483679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 msgr2=0x559ed2fc9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f67267e2740 1 --2- 172.21.15.53:0/3759483679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 0x559ed2fc9360 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6708006010 tx=0x7f6708004610 comp rx=0 tx=0).stop 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f67267e2740 1 -- 172.21.15.53:0/3759483679 shutdown_connections 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f67267e2740 1 --2- 172.21.15.53:0/3759483679 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x559ed3042170 0x559ed30445c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f67267e2740 1 --2- 172.21.15.53:0/3759483679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559ed2c14070 0x559ed2fc98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f67267e2740 1 --2- 172.21.15.53:0/3759483679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559ed2bf3390 0x559ed2fc9360 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f67267e2740 1 --2- 172.21.15.53:0/3759483679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed2bd29f0 0x559ed2fc8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f67267e2740 1 -- 172.21.15.53:0/3759483679 >> 172.21.15.53:0/3759483679 conn(0x559ed2c08460 msgr2=0x559ed2fbfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:25.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f6701ffb640 0 client.28832 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:18:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f67267e2740 1 -- 172.21.15.53:0/3759483679 shutdown_connections 2024-08-31T06:18:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.526+0000 7f67267e2740 1 -- 172.21.15.53:0/3759483679 wait complete. 2024-08-31T06:18:25.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.527+0000 7f67267e2740 20 client.28832 trim_cache size 0 max 16384 2024-08-31T06:18:25.533 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:18:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.527+0000 7f672026d640 1 -- 172.21.15.53:0/1455979944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67040b4ca0 msgr2=0x7f67040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.527+0000 7f672026d640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67040b4ca0 0x7f67040b71b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6710005fd0 tx=0x7f6710004a40 comp rx=0 tx=0).stop 2024-08-31T06:18:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.527+0000 7f672026d640 1 -- 172.21.15.53:0/1455979944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6718102870 msgr2=0x7f6718110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.527+0000 7f672026d640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6718102870 0x7f6718110050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f671400e9f0 tx=0x7f671400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.527+0000 7f672026d640 1 -- 172.21.15.53:0/1455979944 shutdown_connections 2024-08-31T06:18:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.527+0000 7f672026d640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f67040b4ca0 0x7f67040b71b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.527+0000 7f672026d640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6718108ab0 0x7f6718110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.527+0000 7f672026d640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6718108160 0x7f6718110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.527+0000 7f672026d640 1 --2- 172.21.15.53:0/1455979944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6718102870 0x7f6718110050 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:25.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.527+0000 7f672026d640 1 -- 172.21.15.53:0/1455979944 >> 172.21.15.53:0/1455979944 conn(0x7f6718079470 msgr2=0x7f6718106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:25.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.528+0000 7f672026d640 1 -- 172.21.15.53:0/1455979944 shutdown_connections 2024-08-31T06:18:25.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:25.528+0000 7f672026d640 1 -- 172.21.15.53:0/1455979944 wait complete. 2024-08-31T06:18:25.703 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:25 smithi053 ceph-mon[18924]: pgmap v743: 97 pgs: 97 active+clean; 321 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 20 MiB/s wr, 280 op/s 2024-08-31T06:18:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:25 smithi130 ceph-mon[22266]: pgmap v743: 97 pgs: 97 active+clean; 321 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 20 MiB/s wr, 280 op/s 2024-08-31T06:18:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:25 smithi153 ceph-mon[22320]: pgmap v743: 97 pgs: 97 active+clean; 321 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 20 MiB/s wr, 280 op/s 2024-08-31T06:18:26.258 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:18:26.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 2481 20.71 MB/sec warmup 14 sec latency 69.622 ms 2024-08-31T06:18:26.603 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:27.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.164+0000 7f7f15aeb640 1 -- 172.21.15.53:0/636789493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f10111ce0 msgr2=0x7f7f1010a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:27.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.164+0000 7f7f15aeb640 1 --2- 172.21.15.53:0/636789493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f10111ce0 0x7f7f1010a160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009900 tx=0x7f7f0002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.164+0000 7f7f15aeb640 1 -- 172.21.15.53:0/636789493 shutdown_connections 2024-08-31T06:18:27.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.164+0000 7f7f15aeb640 1 --2- 172.21.15.53:0/636789493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f1011c9d0 0x7f7f1011eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.164+0000 7f7f15aeb640 1 --2- 172.21.15.53:0/636789493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f1010a780 0x7f7f1010ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.164+0000 7f7f15aeb640 1 --2- 172.21.15.53:0/636789493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f10111ce0 0x7f7f1010a160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.164+0000 7f7f15aeb640 1 -- 172.21.15.53:0/636789493 >> 172.21.15.53:0/636789493 conn(0x7f7f10070c60 msgr2=0x7f7f10071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:27.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.164+0000 7f7f15aeb640 1 -- 172.21.15.53:0/636789493 shutdown_connections 2024-08-31T06:18:27.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.164+0000 7f7f15aeb640 1 -- 172.21.15.53:0/636789493 wait complete. 2024-08-31T06:18:27.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.165+0000 7f7f15aeb640 1 Processor -- start 2024-08-31T06:18:27.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.166+0000 7f7f15aeb640 1 -- start start 2024-08-31T06:18:27.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.166+0000 7f7f15aeb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f1010a780 0x7f7f101a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.166+0000 7f7f15aeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f10111ce0 0x7f7f101a95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.166+0000 7f7f15aeb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f1011c9d0 0x7f7f101ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.166+0000 7f7f15aeb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f10122540 con 0x7f7f10111ce0 2024-08-31T06:18:27.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.166+0000 7f7f15aeb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101223c0 con 0x7f7f1011c9d0 2024-08-31T06:18:27.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.166+0000 7f7f15aeb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101226c0 con 0x7f7f1010a780 2024-08-31T06:18:27.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.167+0000 7f7f0ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f1011c9d0 0x7f7f101ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.167+0000 7f7f0ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f1011c9d0 0x7f7f101ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53414/0 (socket says 172.21.15.53:53414) 2024-08-31T06:18:27.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.167+0000 7f7f0ffff640 1 -- 172.21.15.53:0/3114285832 learned_addr learned my addr 172.21.15.53:0/3114285832 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:27.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.167+0000 7f7f0f7fe640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f1010a780 0x7f7f101a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.167+0000 7f7f0ffff640 1 -- 172.21.15.53:0/3114285832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f1010a780 msgr2=0x7f7f101a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:27.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.167+0000 7f7f0ffff640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f1010a780 0x7f7f101a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.167+0000 7f7f0ffff640 1 -- 172.21.15.53:0/3114285832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f10111ce0 msgr2=0x7f7f101a95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:27.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.167+0000 7f7f0ffff640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f10111ce0 0x7f7f101a95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.167+0000 7f7f0ffff640 1 -- 172.21.15.53:0/3114285832 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f101aefa0 con 0x7f7f1011c9d0 2024-08-31T06:18:27.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.168+0000 7f7f0ffff640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f1011c9d0 0x7f7f101ae870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800eb10 tx=0x7f7f0800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:27.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.168+0000 7f7f0cff9640 1 -- 172.21.15.53:0/3114285832 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08004b20 con 0x7f7f1011c9d0 2024-08-31T06:18:27.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.168+0000 7f7f0cff9640 1 -- 172.21.15.53:0/3114285832 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f08004cc0 con 0x7f7f1011c9d0 2024-08-31T06:18:27.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.168+0000 7f7f0cff9640 1 -- 172.21.15.53:0/3114285832 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08010690 con 0x7f7f1011c9d0 2024-08-31T06:18:27.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.168+0000 7f7f15aeb640 1 -- 172.21.15.53:0/3114285832 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f101af290 con 0x7f7f1011c9d0 2024-08-31T06:18:27.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.168+0000 7f7f15aeb640 1 -- 172.21.15.53:0/3114285832 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f101b59f0 con 0x7f7f1011c9d0 2024-08-31T06:18:27.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.172+0000 7f7f1c060740 1 Processor -- start 2024-08-31T06:18:27.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.172+0000 7f7f0cff9640 1 -- 172.21.15.53:0/3114285832 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7f08005020 con 0x7f7f1011c9d0 2024-08-31T06:18:27.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.172+0000 7f7f1c060740 1 -- start start 2024-08-31T06:18:27.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790e0d070 0x5597911b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790dec390 0x5597911b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f1c060740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559791129680 con 0x559790de41b0 2024-08-31T06:18:27.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f1c060740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559791118c10 con 0x559790dec390 2024-08-31T06:18:27.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f1c060740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55979111cbc0 con 0x559790e0d070 2024-08-31T06:18:27.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790e0d070 0x5597911b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0cff9640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ef80b4d20 0x7f7ef80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49214/0 (socket says 172.21.15.53:49214) 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0f7fe640 1 -- 172.21.15.53:0/1420521962 learned_addr learned my addr 172.21.15.53:0/1420521962 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0cff9640 1 -- 172.21.15.53:0/3114285832 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f7f080e5c60 con 0x7f7f1011c9d0 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0effd640 1 --2- 172.21.15.53:0/1420521962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790dec390 0x5597911b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0f7fe640 1 -- 172.21.15.53:0/1420521962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790e0d070 msgr2=0x5597911b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0f7fe640 1 --2- 172.21.15.53:0/1420521962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790e0d070 0x5597911b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0f7fe640 1 -- 172.21.15.53:0/1420521962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790dec390 msgr2=0x5597911b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0f7fe640 1 --2- 172.21.15.53:0/1420521962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790dec390 0x5597911b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0f7fe640 1 -- 172.21.15.53:0/1420521962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559790e78650 con 0x559790de41b0 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.173+0000 7f7f0ffff640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ef80b4d20 0x7f7ef80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.174+0000 7f7f0effd640 1 --2- 172.21.15.53:0/1420521962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790dec390 0x5597911b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.174+0000 7f7f0f7fe640 1 --2- 172.21.15.53:0/1420521962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911b2850 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7f0002a9e0 tx=0x7f7f00004150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ae42840e6b90c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:27.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.174+0000 7f7ef5ffb640 1 -- 172.21.15.53:0/1420521962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00035030 con 0x559790de41b0 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.174+0000 7f7ef5ffb640 1 -- 172.21.15.53:0/1420521962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f000054d0 con 0x559790de41b0 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.174+0000 7f7ef5ffb640 1 -- 172.21.15.53:0/1420521962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f000035f0 con 0x559790de41b0 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.175+0000 7f7f1c060740 1 -- 172.21.15.53:0/1420521962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 msgr2=0x5597911b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.175+0000 7f7f1c060740 1 --2- 172.21.15.53:0/1420521962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911b2850 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7f0002a9e0 tx=0x7f7f00004150 comp rx=0 tx=0).stop 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.175+0000 7f7f0ffff640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ef80b4d20 0x7f7ef80b7230 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7f080e3440 tx=0x7f7f0800c950 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.175+0000 7f7f1c060740 1 -- 172.21.15.53:0/1420521962 shutdown_connections 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.175+0000 7f7f1c060740 1 --2- 172.21.15.53:0/1420521962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790dec390 0x5597911b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.175+0000 7f7f1c060740 1 --2- 172.21.15.53:0/1420521962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911b2850 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.175+0000 7f7f1c060740 1 --2- 172.21.15.53:0/1420521962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790e0d070 0x5597911b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.175+0000 7f7f1c060740 1 -- 172.21.15.53:0/1420521962 >> 172.21.15.53:0/1420521962 conn(0x559790e01460 msgr2=0x5597911b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.175+0000 7f7f1c060740 1 -- 172.21.15.53:0/1420521962 shutdown_connections 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.175+0000 7f7f1c060740 1 -- 172.21.15.53:0/1420521962 wait complete. 2024-08-31T06:18:27.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.176+0000 7f7f1c060740 1 -- start start 2024-08-31T06:18:27.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.176+0000 7f7f1c060740 1 Processor -- start 2024-08-31T06:18:27.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.177+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.177+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790dec390 0x5597911bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.177+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790e0d070 0x5597911c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.177+0000 7f7f0effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.177+0000 7f7f0effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49228/0 (socket says 172.21.15.53:49228) 2024-08-31T06:18:27.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.178+0000 7f7f0f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790dec390 0x5597911bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.178+0000 7f7f0f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790dec390 0x5597911bdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:55816/0 (socket says 172.21.15.53:55816) 2024-08-31T06:18:27.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.178+0000 7f7f0effd640 1 -- 172.21.15.53:0/2108147871 learned_addr learned my addr 172.21.15.53:0/2108147871 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.178+0000 7f7f1c060740 1 -- 172.21.15.53:0/2108147871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559790f7b700 con 0x559790de41b0 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.178+0000 7f7f1c060740 1 -- 172.21.15.53:0/2108147871 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55979109f750 con 0x559790e0d070 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.178+0000 7f7f1c060740 1 -- 172.21.15.53:0/2108147871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5597911c0a90 con 0x559790dec390 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.178+0000 7f7f1c060740 10 client.0 _ll_register_callbacks cb 0x5597910cee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.178+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790e0d070 0x5597911c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.179+0000 7f7f0f7fe640 1 -- 172.21.15.53:0/2108147871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790e0d070 msgr2=0x5597911c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.179+0000 7f7f0f7fe640 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790e0d070 0x5597911c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.179+0000 7f7f0f7fe640 1 -- 172.21.15.53:0/2108147871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 msgr2=0x5597911bda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.179+0000 7f7f0f7fe640 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.179+0000 7f7f0f7fe640 1 -- 172.21.15.53:0/2108147871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597910d8900 con 0x559790dec390 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.179+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.179+0000 7f7f0f7fe640 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790dec390 0x5597911bdf70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f000057c0 tx=0x7f7f000048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=446bcc9ff0e05308 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:27.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.179+0000 7f7eeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:18:27.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.179+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2108147871 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00035040 con 0x559790dec390 2024-08-31T06:18:27.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.180+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2108147871 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f7f000050e0 con 0x559790dec390 2024-08-31T06:18:27.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.180+0000 7f7f1c060740 1 -- 172.21.15.53:0/2108147871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f000054d0 con 0x559790dec390 2024-08-31T06:18:27.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.180+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2108147871 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f7f00059050 con 0x559790dec390 2024-08-31T06:18:27.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.180+0000 7f7f1c060740 10 client.28831 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:27.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.180+0000 7f7f1c060740 1 -- 172.21.15.53:0/2108147871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5597911cc7b0 con 0x559790dec390 2024-08-31T06:18:27.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.181+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2108147871 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f000052e0 con 0x559790dec390 2024-08-31T06:18:27.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.181+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2108147871 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f7f00054030 con 0x559790dec390 2024-08-31T06:18:27.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.181+0000 7f7f1c060740 10 client.28831 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:27.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.181+0000 7f7f1c060740 10 client.28831 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:18:27.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.181+0000 7f7f1c060740 20 client.28831 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.181+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559790dcb9f0 0x5597911cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.182+0000 7f7f1c060740 4 client.28831 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.182+0000 7f7f1c060740 1 -- 172.21.15.53:0/2108147871 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7f000054d0 con 0x559790dcb9f0 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.182+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559790dcb9f0 0x5597911cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.182+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559790dcb9f0 0x5597911cfdf0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d97b12fc584e220f server_cookie=846b41a8a99c8794 in_seq=0 out_seq=0 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.182+0000 7f7eeeffd640 10 client.28831 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.183+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2108147871 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f7f000054d0 con 0x559790dcb9f0 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.183+0000 7f7eeeffd640 10 client.28831 handle_command_reply: tid=0 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.183+0000 7f7f1c060740 1 client.28831 shutdown 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7f1c060740 1 -- 172.21.15.53:0/2108147871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790dec390 msgr2=0x5597911bdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790dec390 0x5597911bdf70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f000057c0 tx=0x7f7f000048f0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7f1c060740 1 -- 172.21.15.53:0/2108147871 shutdown_connections 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559790dcb9f0 0x5597911cfdf0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790e0d070 0x5597911c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790dec390 0x5597911bdf70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2108147871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7eeeffd640 0 client.28831 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:18:27.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7f1c060740 1 -- 172.21.15.53:0/2108147871 >> 172.21.15.53:0/2108147871 conn(0x559790e01460 msgr2=0x5597911b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:27.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7f1c060740 1 -- 172.21.15.53:0/2108147871 shutdown_connections 2024-08-31T06:18:27.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7f1c060740 1 -- 172.21.15.53:0/2108147871 wait complete. 2024-08-31T06:18:27.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.184+0000 7f7f1c060740 20 client.28831 trim_cache size 0 max 16384 2024-08-31T06:18:27.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.208+0000 7f7f1c060740 1 Processor -- start 2024-08-31T06:18:27.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.208+0000 7f7f1c060740 1 -- start start 2024-08-31T06:18:27.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.208+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.208+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790dec390 0x5597911bdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.208+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790e0d070 0x5597911b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.208+0000 7f7f1c060740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101be330 con 0x559790de41b0 2024-08-31T06:18:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.208+0000 7f7f1c060740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101c00b0 con 0x559790dec390 2024-08-31T06:18:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.208+0000 7f7f1c060740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101bea00 con 0x559790e0d070 2024-08-31T06:18:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.208+0000 7f7f0effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.209+0000 7f7f0effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49240/0 (socket says 172.21.15.53:49240) 2024-08-31T06:18:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.209+0000 7f7f0effd640 1 -- 172.21.15.53:0/2126158721 learned_addr learned my addr 172.21.15.53:0/2126158721 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.209+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2126158721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790e0d070 0x5597911b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.209+0000 7f7f0effd640 1 -- 172.21.15.53:0/2126158721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790e0d070 msgr2=0x5597911b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.209+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2126158721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790e0d070 0x5597911b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.209+0000 7f7f0effd640 1 -- 172.21.15.53:0/2126158721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790dec390 msgr2=0x5597911bdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.209+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2126158721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790dec390 0x5597911bdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.209+0000 7f7f0effd640 1 -- 172.21.15.53:0/2126158721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597911b4830 con 0x559790de41b0 2024-08-31T06:18:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.209+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2126158721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bd7e0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009650 tx=0x7f7f040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e80e7cec7f81bf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.210+0000 7f7ef57fa640 1 -- 172.21.15.53:0/2126158721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0401b070 con 0x559790de41b0 2024-08-31T06:18:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.210+0000 7f7ef57fa640 1 -- 172.21.15.53:0/2126158721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f040054b0 con 0x559790de41b0 2024-08-31T06:18:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.210+0000 7f7ef57fa640 1 -- 172.21.15.53:0/2126158721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f04020f90 con 0x559790de41b0 2024-08-31T06:18:27.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.211+0000 7f7f1c060740 1 -- 172.21.15.53:0/2126158721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 msgr2=0x5597911bd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.211+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2126158721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bd7e0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009650 tx=0x7f7f040046c0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.211+0000 7f7f1c060740 1 -- 172.21.15.53:0/2126158721 shutdown_connections 2024-08-31T06:18:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.211+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2126158721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790e0d070 0x5597911b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.211+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2126158721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790dec390 0x5597911bdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.211+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2126158721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790de41b0 0x5597911bd7e0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.211+0000 7f7f1c060740 1 -- 172.21.15.53:0/2126158721 >> 172.21.15.53:0/2126158721 conn(0x559790e01460 msgr2=0x5597911bc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.211+0000 7f7f1c060740 1 -- 172.21.15.53:0/2126158721 shutdown_connections 2024-08-31T06:18:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.211+0000 7f7f1c060740 1 -- 172.21.15.53:0/2126158721 wait complete. 2024-08-31T06:18:27.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.212+0000 7f7f1c060740 1 -- start start 2024-08-31T06:18:27.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.212+0000 7f7f1c060740 1 Processor -- start 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790de41b0 0x5597911c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790dec390 0x5597911c1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f1c060740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790e0d070 0x5597911c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f1c060740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101bf920 con 0x559790dec390 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f1c060740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101bf190 con 0x559790e0d070 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f1c060740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101bc330 con 0x559790de41b0 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f1c060740 10 client.0 _ll_register_callbacks cb 0x7f7f04005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f0effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790de41b0 0x5597911c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f0effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790de41b0 0x5597911c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:55828/0 (socket says 172.21.15.53:55828) 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f0effd640 1 -- 172.21.15.53:0/2329815593 learned_addr learned my addr 172.21.15.53:0/2329815593 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f0f7fe640 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790dec390 0x5597911c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790e0d070 0x5597911c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f0effd640 1 -- 172.21.15.53:0/2329815593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790e0d070 msgr2=0x5597911c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:27.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790e0d070 0x5597911c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f0effd640 1 -- 172.21.15.53:0/2329815593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790dec390 msgr2=0x5597911c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:27.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.213+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790dec390 0x5597911c1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.214+0000 7f7f0effd640 1 -- 172.21.15.53:0/2329815593 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597911c24e0 con 0x559790de41b0 2024-08-31T06:18:27.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.214+0000 7f7f0effd640 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790de41b0 0x5597911c6430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009b30 tx=0x7f7f04005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e95a2c3098b8873 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:27.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.214+0000 7f7eeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:18:27.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.214+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2329815593 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0401b040 con 0x559790de41b0 2024-08-31T06:18:27.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.214+0000 7f7f1c060740 1 -- 172.21.15.53:0/2329815593 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f040054b0 con 0x559790de41b0 2024-08-31T06:18:27.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.214+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2329815593 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f7f04023070 con 0x559790de41b0 2024-08-31T06:18:27.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.214+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2329815593 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f7f0403d050 con 0x559790de41b0 2024-08-31T06:18:27.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.214+0000 7f7f1c060740 10 client.28837 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:27.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.214+0000 7f7f1c060740 1 -- 172.21.15.53:0/2329815593 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55979123a5b0 con 0x559790de41b0 2024-08-31T06:18:27.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.215+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2329815593 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f040054b0 con 0x559790de41b0 2024-08-31T06:18:27.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.215+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2329815593 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f7f0402a430 con 0x559790de41b0 2024-08-31T06:18:27.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.215+0000 7f7f1c060740 10 client.28837 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.215+0000 7f7f1c060740 10 client.28837 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.215+0000 7f7f1c060740 20 client.28837 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.215+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559790da0da0 0x55979123cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.215+0000 7f7f1c060740 4 client.28837 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.215+0000 7f7f1c060740 1 -- 172.21.15.53:0/2329815593 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55979112b5d0 con 0x559790da0da0 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.215+0000 7f7f0f7fe640 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559790da0da0 0x55979123cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.215+0000 7f7eeeffd640 10 client.28837 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.216+0000 7f7f0f7fe640 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559790da0da0 0x55979123cd50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9341114edcacd06d server_cookie=e50cb02f33d6b7ab in_seq=0 out_seq=0 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.216+0000 7f7eeeffd640 1 -- 172.21.15.53:0/2329815593 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55979112b5d0 con 0x559790da0da0 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.216+0000 7f7eeeffd640 10 client.28837 handle_command_reply: tid=0 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.216+0000 7f7f1c060740 1 client.28837 shutdown 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.216+0000 7f7f1c060740 1 -- 172.21.15.53:0/2329815593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790de41b0 msgr2=0x5597911c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:27.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.216+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790de41b0 0x5597911c6430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009b30 tx=0x7f7f04005fd0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.216+0000 7f7f1c060740 1 -- 172.21.15.53:0/2329815593 shutdown_connections 2024-08-31T06:18:27.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.217+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559790da0da0 0x55979123cd50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.217+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559790e0d070 0x5597911c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.217+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559790dec390 0x5597911c1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.217+0000 7f7f1c060740 1 --2- 172.21.15.53:0/2329815593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559790de41b0 0x5597911c6430 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.217+0000 7f7eeeffd640 0 client.28837 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:18:27.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.217+0000 7f7f1c060740 1 -- 172.21.15.53:0/2329815593 >> 172.21.15.53:0/2329815593 conn(0x559790e01460 msgr2=0x5597911bd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:27.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.217+0000 7f7f1c060740 1 -- 172.21.15.53:0/2329815593 shutdown_connections 2024-08-31T06:18:27.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.217+0000 7f7f1c060740 1 -- 172.21.15.53:0/2329815593 wait complete. 2024-08-31T06:18:27.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.217+0000 7f7f1c060740 20 client.28837 trim_cache size 0 max 16384 2024-08-31T06:18:27.222 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:18:27.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 -- 172.21.15.53:0/3114285832 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ef80b4d20 msgr2=0x7f7ef80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:27.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ef80b4d20 0x7f7ef80b7230 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7f080e3440 tx=0x7f7f0800c950 comp rx=0 tx=0).stop 2024-08-31T06:18:27.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 -- 172.21.15.53:0/3114285832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f1011c9d0 msgr2=0x7f7f101ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:27.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f1011c9d0 0x7f7f101ae870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800eb10 tx=0x7f7f0800c2d0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 -- 172.21.15.53:0/3114285832 shutdown_connections 2024-08-31T06:18:27.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7ef80b4d20 0x7f7ef80b7230 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f1011c9d0 0x7f7f101ae870 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f10111ce0 0x7f7f101a95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 --2- 172.21.15.53:0/3114285832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f1010a780 0x7f7f101a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:27.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 -- 172.21.15.53:0/3114285832 >> 172.21.15.53:0/3114285832 conn(0x7f7f10070c60 msgr2=0x7f7f10071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:27.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 -- 172.21.15.53:0/3114285832 shutdown_connections 2024-08-31T06:18:27.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:27.218+0000 7f7f15aeb640 1 -- 172.21.15.53:0/3114285832 wait complete. 2024-08-31T06:18:27.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 2722 20.98 MB/sec warmup 15 sec latency 67.868 ms 2024-08-31T06:18:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:27 smithi053 ceph-mon[18924]: pgmap v744: 97 pgs: 97 active+clean; 319 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 17 MiB/s wr, 288 op/s 2024-08-31T06:18:28.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:18:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:27 smithi130 ceph-mon[22266]: pgmap v744: 97 pgs: 97 active+clean; 319 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 17 MiB/s wr, 288 op/s 2024-08-31T06:18:28.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:27 smithi153 ceph-mon[22320]: pgmap v744: 97 pgs: 97 active+clean; 319 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 17 MiB/s wr, 288 op/s 2024-08-31T06:18:28.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 2983 20.86 MB/sec warmup 16 sec latency 61.913 ms 2024-08-31T06:18:28.389 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:28.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.969+0000 7fc8e73d0640 1 -- 172.21.15.53:0/366147550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e0108180 msgr2=0x7fc8e0108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:28.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.969+0000 7fc8e73d0640 1 --2- 172.21.15.53:0/366147550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e0108180 0x7fc8e0108590 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009900 tx=0x7fc8d002a410 comp rx=0 tx=0).stop 2024-08-31T06:18:28.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.969+0000 7fc8e73d0640 1 -- 172.21.15.53:0/366147550 shutdown_connections 2024-08-31T06:18:28.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.969+0000 7fc8e73d0640 1 --2- 172.21.15.53:0/366147550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e0108ad0 0x7fc8e010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.969+0000 7fc8e73d0640 1 --2- 172.21.15.53:0/366147550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e0108180 0x7fc8e0108590 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.969+0000 7fc8e73d0640 1 --2- 172.21.15.53:0/366147550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8e0102840 0x7fc8e0102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.969+0000 7fc8e73d0640 1 -- 172.21.15.53:0/366147550 >> 172.21.15.53:0/366147550 conn(0x7fc8e00794f0 msgr2=0x7fc8e0079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:28.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.969+0000 7fc8e73d0640 1 -- 172.21.15.53:0/366147550 shutdown_connections 2024-08-31T06:18:28.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.969+0000 7fc8e73d0640 1 -- 172.21.15.53:0/366147550 wait complete. 2024-08-31T06:18:28.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.970+0000 7fc8e73d0640 1 Processor -- start 2024-08-31T06:18:28.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.970+0000 7fc8e73d0640 1 -- start start 2024-08-31T06:18:28.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.970+0000 7fc8e73d0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e0102840 0x7fc8e00ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:28.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.970+0000 7fc8e73d0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e0108180 0x7fc8e00ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:28.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.970+0000 7fc8e73d0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8e0108ad0 0x7fc8e00ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:28.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e73d0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e0112610 con 0x7fc8e0108180 2024-08-31T06:18:28.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e73d0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e0112490 con 0x7fc8e0108ad0 2024-08-31T06:18:28.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e73d0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e0112790 con 0x7fc8e0102840 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e496b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e0108180 0x7fc8e00ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e496b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e0108180 0x7fc8e00ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49252/0 (socket says 172.21.15.53:49252) 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e496b640 1 -- 172.21.15.53:0/2236786418 learned_addr learned my addr 172.21.15.53:0/2236786418 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e516c640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e0102840 0x7fc8e00ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e596d640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8e0108ad0 0x7fc8e00ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e496b640 1 -- 172.21.15.53:0/2236786418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e0102840 msgr2=0x7fc8e00ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e496b640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e0102840 0x7fc8e00ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e496b640 1 -- 172.21.15.53:0/2236786418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8e0108ad0 msgr2=0x7fc8e00ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e496b640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8e0108ad0 0x7fc8e00ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e496b640 1 -- 172.21.15.53:0/2236786418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e01a84f0 con 0x7fc8e0108180 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e596d640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8e0108ad0 0x7fc8e00ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.971+0000 7fc8e496b640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e0108180 0x7fc8e00ff950 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0005940 tx=0x7fc8d0005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.972+0000 7fc8d67fc640 1 -- 172.21.15.53:0/2236786418 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d003f030 con 0x7fc8e0108180 2024-08-31T06:18:28.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.972+0000 7fc8d67fc640 1 -- 172.21.15.53:0/2236786418 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8d00043d0 con 0x7fc8e0108180 2024-08-31T06:18:28.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.972+0000 7fc8e73d0640 1 -- 172.21.15.53:0/2236786418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e01a8780 con 0x7fc8e0108180 2024-08-31T06:18:28.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.972+0000 7fc8d67fc640 1 -- 172.21.15.53:0/2236786418 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0035070 con 0x7fc8e0108180 2024-08-31T06:18:28.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.972+0000 7fc8e73d0640 1 -- 172.21.15.53:0/2236786418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e01a8c60 con 0x7fc8e0108180 2024-08-31T06:18:28.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.975+0000 7fc8ed945740 1 Processor -- start 2024-08-31T06:18:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.975+0000 7fc8ed945740 1 -- start start 2024-08-31T06:18:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.975+0000 7fc8d67fc640 1 -- 172.21.15.53:0/2236786418 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc8d0042030 con 0x7fc8e0108180 2024-08-31T06:18:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8ed945740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91eb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8ed945740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e1d1b0 0x5591f91eb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8ed945740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e25390 0x5591f91ebdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8e596d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91eb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8e516c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e1d1b0 0x5591f91eb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8ed945740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5591f9162680 con 0x5591f8e46070 2024-08-31T06:18:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8e596d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91eb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49258/0 (socket says 172.21.15.53:49258) 2024-08-31T06:18:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8e516c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e1d1b0 0x5591f91eb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53482/0 (socket says 172.21.15.53:53482) 2024-08-31T06:18:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8e596d640 1 -- 172.21.15.53:0/1814630661 learned_addr learned my addr 172.21.15.53:0/1814630661 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8ed945740 1 -- 172.21.15.53:0/1814630661 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5591f9151c10 con 0x5591f8e1d1b0 2024-08-31T06:18:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8ed945740 1 -- 172.21.15.53:0/1814630661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5591f9155bc0 con 0x5591f8e25390 2024-08-31T06:18:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8e496b640 1 --2- 172.21.15.53:0/1814630661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e25390 0x5591f91ebdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.976+0000 7fc8e596d640 1 -- 172.21.15.53:0/1814630661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e25390 msgr2=0x5591f91ebdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.977+0000 7fc8e596d640 1 --2- 172.21.15.53:0/1814630661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e25390 0x5591f91ebdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.977+0000 7fc8e596d640 1 -- 172.21.15.53:0/1814630661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e1d1b0 msgr2=0x5591f91eb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.977+0000 7fc8e596d640 1 --2- 172.21.15.53:0/1814630661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e1d1b0 0x5591f91eb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.977+0000 7fc8e596d640 1 -- 172.21.15.53:0/1814630661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591f8eb1650 con 0x5591f8e46070 2024-08-31T06:18:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.977+0000 7fc8d67fc640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8cc0b4ca0 0x7fc8cc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.977+0000 7fc8e516c640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8cc0b4ca0 0x7fc8cc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.977+0000 7fc8d67fc640 1 -- 172.21.15.53:0/2236786418 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fc8d0105920 con 0x7fc8e0108180 2024-08-31T06:18:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.977+0000 7fc8e596d640 1 --2- 172.21.15.53:0/1814630661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91eb350 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009f10 tx=0x7fc8d800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837b05b8f57fa4e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.977+0000 7fc8cb7fe640 1 -- 172.21.15.53:0/1814630661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8003b70 con 0x5591f8e46070 2024-08-31T06:18:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.977+0000 7fc8cb7fe640 1 -- 172.21.15.53:0/1814630661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8d8003d10 con 0x5591f8e46070 2024-08-31T06:18:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.977+0000 7fc8cb7fe640 1 -- 172.21.15.53:0/1814630661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d80118e0 con 0x5591f8e46070 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.978+0000 7fc8ed945740 1 -- 172.21.15.53:0/1814630661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 msgr2=0x5591f91eb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.978+0000 7fc8ed945740 1 --2- 172.21.15.53:0/1814630661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91eb350 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009f10 tx=0x7fc8d800f730 comp rx=0 tx=0).stop 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.978+0000 7fc8e516c640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8cc0b4ca0 0x7fc8cc0b71b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5591f91e9fd0 tx=0x7fc8dc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.979+0000 7fc8ed945740 1 -- 172.21.15.53:0/1814630661 shutdown_connections 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.979+0000 7fc8ed945740 1 --2- 172.21.15.53:0/1814630661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e25390 0x5591f91ebdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.979+0000 7fc8ed945740 1 --2- 172.21.15.53:0/1814630661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e1d1b0 0x5591f91eb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.979+0000 7fc8ed945740 1 --2- 172.21.15.53:0/1814630661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91eb350 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.979+0000 7fc8ed945740 1 -- 172.21.15.53:0/1814630661 >> 172.21.15.53:0/1814630661 conn(0x5591f8e3a460 msgr2=0x5591f91e9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.979+0000 7fc8ed945740 1 -- 172.21.15.53:0/1814630661 shutdown_connections 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.979+0000 7fc8ed945740 1 -- 172.21.15.53:0/1814630661 wait complete. 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.979+0000 7fc8ed945740 1 -- start start 2024-08-31T06:18:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.979+0000 7fc8ed945740 1 Processor -- start 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8ed945740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e1d1b0 0x5591f91f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8ed945740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 0x5591f91f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8e496b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 0x5591f91f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8e496b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 0x5591f91f6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49270/0 (socket says 172.21.15.53:49270) 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8e496b640 1 -- 172.21.15.53:0/3632289504 learned_addr learned my addr 172.21.15.53:0/3632289504 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e46070 0x5591f9202e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8ed945740 1 -- 172.21.15.53:0/3632289504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5591f8fb4700 con 0x5591f8e25390 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8ed945740 1 -- 172.21.15.53:0/3632289504 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5591f90d8750 con 0x5591f8e46070 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8ed945740 1 -- 172.21.15.53:0/3632289504 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5591f91f9b30 con 0x5591f8e1d1b0 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8e516c640 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e1d1b0 0x5591f91f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8ed945740 10 client.0 _ll_register_callbacks cb 0x5591f9107e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8e516c640 1 -- 172.21.15.53:0/3632289504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e46070 msgr2=0x5591f9202e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8e596d640 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e46070 0x5591f9202e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8e516c640 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e46070 0x5591f9202e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8e516c640 1 -- 172.21.15.53:0/3632289504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 msgr2=0x5591f91f6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8e516c640 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 0x5591f91f6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.980+0000 7fc8e516c640 1 -- 172.21.15.53:0/3632289504 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591f9111900 con 0x5591f8e1d1b0 2024-08-31T06:18:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.981+0000 7fc8e596d640 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e46070 0x5591f9202e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.981+0000 7fc8e496b640 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 0x5591f91f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.981+0000 7fc8e516c640 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e1d1b0 0x5591f91f6a80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0100e60 tx=0x7fc8dc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ec301abae39e0ed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.981+0000 7fc8c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:18:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.981+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3632289504 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc01f630 con 0x5591f8e1d1b0 2024-08-31T06:18:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.981+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3632289504 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fc8dc01f7d0 con 0x5591f8e1d1b0 2024-08-31T06:18:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.981+0000 7fc8ed945740 1 -- 172.21.15.53:0/3632289504 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8d8003d10 con 0x5591f8e1d1b0 2024-08-31T06:18:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.981+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3632289504 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fc8dc01f9d0 con 0x5591f8e1d1b0 2024-08-31T06:18:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.981+0000 7fc8ed945740 10 client.28849 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.981+0000 7fc8ed945740 1 -- 172.21.15.53:0/3632289504 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5591f9205940 con 0x5591f8e1d1b0 2024-08-31T06:18:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.982+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3632289504 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8dc029440 con 0x5591f8e1d1b0 2024-08-31T06:18:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.982+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3632289504 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fc8dc027070 con 0x5591f8e1d1b0 2024-08-31T06:18:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.982+0000 7fc8ed945740 10 client.28849 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.982+0000 7fc8ed945740 10 client.28849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.982+0000 7fc8ed945740 20 client.28849 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.982+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5591f8e049f0 0x5591f9208fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.982+0000 7fc8ed945740 4 client.28849 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.982+0000 7fc8ed945740 1 -- 172.21.15.53:0/3632289504 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc8d8003d10 con 0x5591f8e049f0 2024-08-31T06:18:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.982+0000 7fc8e496b640 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5591f8e049f0 0x5591f9208fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.983+0000 7fc8c8ff9640 10 client.28849 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.983+0000 7fc8e496b640 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5591f8e049f0 0x5591f9208fe0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2150dec40388e2 server_cookie=c513d8469f6bf285 in_seq=0 out_seq=0 2024-08-31T06:18:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.984+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3632289504 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc8d8003d10 con 0x5591f8e049f0 2024-08-31T06:18:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.984+0000 7fc8c8ff9640 10 client.28849 handle_command_reply: tid=0 2024-08-31T06:18:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.984+0000 7fc8ed945740 1 client.28849 shutdown 2024-08-31T06:18:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.984+0000 7fc8ed945740 1 -- 172.21.15.53:0/3632289504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e1d1b0 msgr2=0x5591f91f6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.984+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e1d1b0 0x5591f91f6a80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0100e60 tx=0x7fc8dc004730 comp rx=0 tx=0).stop 2024-08-31T06:18:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.984+0000 7fc8ed945740 1 -- 172.21.15.53:0/3632289504 shutdown_connections 2024-08-31T06:18:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.984+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5591f8e049f0 0x5591f9208fe0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.985+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e46070 0x5591f9202e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.985+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 0x5591f91f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.985+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3632289504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e1d1b0 0x5591f91f6a80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.985+0000 7fc8ed945740 1 -- 172.21.15.53:0/3632289504 >> 172.21.15.53:0/3632289504 conn(0x5591f8e3a460 msgr2=0x5591f91ee530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.985+0000 7fc8c8ff9640 0 client.28849 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.985+0000 7fc8ed945740 1 -- 172.21.15.53:0/3632289504 shutdown_connections 2024-08-31T06:18:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.985+0000 7fc8ed945740 1 -- 172.21.15.53:0/3632289504 wait complete. 2024-08-31T06:18:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:28.985+0000 7fc8ed945740 20 client.28849 trim_cache size 0 max 16384 2024-08-31T06:18:29.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.004+0000 7fc8ed945740 1 Processor -- start 2024-08-31T06:18:29.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.004+0000 7fc8ed945740 1 -- start start 2024-08-31T06:18:29.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.004+0000 7fc8ed945740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e1d1b0 0x5591f91e4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:29.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.004+0000 7fc8ed945740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e25390 0x5591f91ee450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:29.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.004+0000 7fc8ed945740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91ee990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:29.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.004+0000 7fc8ed945740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e01ad3f0 con 0x5591f8e46070 2024-08-31T06:18:29.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.004+0000 7fc8ed945740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e01af170 con 0x5591f8e25390 2024-08-31T06:18:29.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.004+0000 7fc8ed945740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e01adac0 con 0x5591f8e1d1b0 2024-08-31T06:18:29.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e596d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91ee990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:29.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e496b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e25390 0x5591f91ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:29.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e596d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91ee990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49282/0 (socket says 172.21.15.53:49282) 2024-08-31T06:18:29.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e596d640 1 -- 172.21.15.53:0/4194327932 learned_addr learned my addr 172.21.15.53:0/4194327932 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:29.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e496b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e25390 0x5591f91ee450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53508/0 (socket says 172.21.15.53:53508) 2024-08-31T06:18:29.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e516c640 1 --2- 172.21.15.53:0/4194327932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e1d1b0 0x5591f91e4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:29.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e596d640 1 -- 172.21.15.53:0/4194327932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e1d1b0 msgr2=0x5591f91e4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:29.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e596d640 1 --2- 172.21.15.53:0/4194327932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e1d1b0 0x5591f91e4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e596d640 1 -- 172.21.15.53:0/4194327932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e25390 msgr2=0x5591f91ee450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:29.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e596d640 1 --2- 172.21.15.53:0/4194327932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e25390 0x5591f91ee450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e596d640 1 -- 172.21.15.53:0/4194327932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591f91ed870 con 0x5591f8e46070 2024-08-31T06:18:29.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e496b640 1 --2- 172.21.15.53:0/4194327932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e25390 0x5591f91ee450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:29.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.005+0000 7fc8e596d640 1 --2- 172.21.15.53:0/4194327932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91ee990 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009c60 tx=0x7fc8d8009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d833f3fe14e2efae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:29.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.006+0000 7fc8caffd640 1 -- 172.21.15.53:0/4194327932 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8003ab0 con 0x5591f8e46070 2024-08-31T06:18:29.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.006+0000 7fc8caffd640 1 -- 172.21.15.53:0/4194327932 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8d8003c50 con 0x5591f8e46070 2024-08-31T06:18:29.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.006+0000 7fc8caffd640 1 -- 172.21.15.53:0/4194327932 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d80116a0 con 0x5591f8e46070 2024-08-31T06:18:29.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.007+0000 7fc8ed945740 1 -- 172.21.15.53:0/4194327932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 msgr2=0x5591f91ee990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:29.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.007+0000 7fc8ed945740 1 --2- 172.21.15.53:0/4194327932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91ee990 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009c60 tx=0x7fc8d8009c90 comp rx=0 tx=0).stop 2024-08-31T06:18:29.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.007+0000 7fc8ed945740 1 -- 172.21.15.53:0/4194327932 shutdown_connections 2024-08-31T06:18:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.007+0000 7fc8ed945740 1 --2- 172.21.15.53:0/4194327932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e46070 0x5591f91ee990 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.007+0000 7fc8ed945740 1 --2- 172.21.15.53:0/4194327932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e25390 0x5591f91ee450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.007+0000 7fc8ed945740 1 --2- 172.21.15.53:0/4194327932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e1d1b0 0x5591f91e4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.007+0000 7fc8ed945740 1 -- 172.21.15.53:0/4194327932 >> 172.21.15.53:0/4194327932 conn(0x5591f8e3a460 msgr2=0x5591f91f5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.007+0000 7fc8ed945740 1 -- 172.21.15.53:0/4194327932 shutdown_connections 2024-08-31T06:18:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.007+0000 7fc8ed945740 1 -- 172.21.15.53:0/4194327932 wait complete. 2024-08-31T06:18:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.007+0000 7fc8ed945740 1 -- start start 2024-08-31T06:18:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.007+0000 7fc8ed945740 1 Processor -- start 2024-08-31T06:18:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8ed945740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e1d1b0 0x5591f91faf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8ed945740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 0x5591f91fb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:29.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8ed945740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e46070 0x5591f91fba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:29.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8ed945740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e01ae9e0 con 0x5591f8e25390 2024-08-31T06:18:29.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8ed945740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e01ae250 con 0x5591f8e1d1b0 2024-08-31T06:18:29.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8ed945740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e01ab3f0 con 0x5591f8e46070 2024-08-31T06:18:29.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8e596d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e46070 0x5591f91fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:29.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8ed945740 10 client.0 _ll_register_callbacks cb 0x7fc8dc009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:29.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8e596d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e46070 0x5591f91fba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:55894/0 (socket says 172.21.15.53:55894) 2024-08-31T06:18:29.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8e596d640 1 -- 172.21.15.53:0/3066748667 learned_addr learned my addr 172.21.15.53:0/3066748667 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:29.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8e516c640 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e1d1b0 0x5591f91faf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:29.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8e496b640 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 0x5591f91fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:29.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8e596d640 1 -- 172.21.15.53:0/3066748667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e1d1b0 msgr2=0x5591f91faf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:29.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8e596d640 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e1d1b0 0x5591f91faf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8e596d640 1 -- 172.21.15.53:0/3066748667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 msgr2=0x5591f91fb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:29.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8e596d640 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 0x5591f91fb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.008+0000 7fc8e596d640 1 -- 172.21.15.53:0/3066748667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591f9272b20 con 0x5591f8e46070 2024-08-31T06:18:29.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.009+0000 7fc8e596d640 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e46070 0x5591f91fba00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80059e0 tx=0x7fc8d80052e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1ca21adb3ac37cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:29.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.009+0000 7fc8c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:18:29.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.009+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3066748667 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8033060 con 0x5591f8e46070 2024-08-31T06:18:29.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.009+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3066748667 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fc8d8003e00 con 0x5591f8e46070 2024-08-31T06:18:29.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.009+0000 7fc8ed945740 1 -- 172.21.15.53:0/3066748667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8d8003c50 con 0x5591f8e46070 2024-08-31T06:18:29.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.009+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3066748667 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fc8d8003ab0 con 0x5591f8e46070 2024-08-31T06:18:29.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.009+0000 7fc8ed945740 10 client.28855 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:29.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.009+0000 7fc8ed945740 1 -- 172.21.15.53:0/3066748667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5591f9273da0 con 0x5591f8e46070 2024-08-31T06:18:29.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.010+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3066748667 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8d8009aa0 con 0x5591f8e46070 2024-08-31T06:18:29.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.010+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3066748667 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fc8d802e470 con 0x5591f8e46070 2024-08-31T06:18:29.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.010+0000 7fc8ed945740 10 client.28855 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:29.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.010+0000 7fc8ed945740 10 client.28855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:29.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.010+0000 7fc8ed945740 20 client.28855 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:29.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.010+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5591f8dd9da0 0x5591f9276360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:29.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.010+0000 7fc8ed945740 4 client.28855 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:18:29.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.010+0000 7fc8ed945740 1 -- 172.21.15.53:0/3066748667 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fc8d8003c50 con 0x5591f8dd9da0 2024-08-31T06:18:29.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.010+0000 7fc8e516c640 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5591f8dd9da0 0x5591f9276360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:29.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8e516c640 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5591f8dd9da0 0x5591f9276360 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b441885723b8b43c server_cookie=e60740b23437878a in_seq=0 out_seq=0 2024-08-31T06:18:29.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8c8ff9640 10 client.28855 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:29.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8c8ff9640 1 -- 172.21.15.53:0/3066748667 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc8d8003c50 con 0x5591f8dd9da0 2024-08-31T06:18:29.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8c8ff9640 10 client.28855 handle_command_reply: tid=0 2024-08-31T06:18:29.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8ed945740 1 client.28855 shutdown 2024-08-31T06:18:29.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8ed945740 1 -- 172.21.15.53:0/3066748667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e46070 msgr2=0x5591f91fba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:29.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e46070 0x5591f91fba00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80059e0 tx=0x7fc8d80052e0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8ed945740 1 -- 172.21.15.53:0/3066748667 shutdown_connections 2024-08-31T06:18:29.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5591f8dd9da0 0x5591f9276360 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5591f8e46070 0x5591f91fba00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5591f8e25390 0x5591f91fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8ed945740 1 --2- 172.21.15.53:0/3066748667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5591f8e1d1b0 0x5591f91faf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8ed945740 1 -- 172.21.15.53:0/3066748667 >> 172.21.15.53:0/3066748667 conn(0x5591f8e3a460 msgr2=0x5591f91f52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:29.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8c8ff9640 0 client.28855 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:29.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8ed945740 1 -- 172.21.15.53:0/3066748667 shutdown_connections 2024-08-31T06:18:29.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.011+0000 7fc8ed945740 1 -- 172.21.15.53:0/3066748667 wait complete. 2024-08-31T06:18:29.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.012+0000 7fc8ed945740 20 client.28855 trim_cache size 0 max 16384 2024-08-31T06:18:29.021 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.012+0000 7fc8e73d0640 1 -- 172.21.15.53:0/2236786418 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8cc0b4ca0 msgr2=0x7fc8cc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.012+0000 7fc8e73d0640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8cc0b4ca0 0x7fc8cc0b71b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5591f91e9fd0 tx=0x7fc8dc005f90 comp rx=0 tx=0).stop 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.012+0000 7fc8e73d0640 1 -- 172.21.15.53:0/2236786418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e0108180 msgr2=0x7fc8e00ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.012+0000 7fc8e73d0640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e0108180 0x7fc8e00ff950 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0005940 tx=0x7fc8d0005e10 comp rx=0 tx=0).stop 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.012+0000 7fc8e73d0640 1 -- 172.21.15.53:0/2236786418 shutdown_connections 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.012+0000 7fc8e73d0640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8cc0b4ca0 0x7fc8cc0b71b0 secure :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5591f91e9fd0 tx=0x7fc8dc005f90 comp rx=0 tx=0).stop 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.012+0000 7fc8e73d0640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8e0108ad0 0x7fc8e00ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.012+0000 7fc8e73d0640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e0108180 0x7fc8e00ff950 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.012+0000 7fc8e73d0640 1 --2- 172.21.15.53:0/2236786418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e0102840 0x7fc8e00ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.012+0000 7fc8e73d0640 1 -- 172.21.15.53:0/2236786418 >> 172.21.15.53:0/2236786418 conn(0x7fc8e00794f0 msgr2=0x7fc8e0101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.013+0000 7fc8e73d0640 1 -- 172.21.15.53:0/2236786418 shutdown_connections 2024-08-31T06:18:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:29.013+0000 7fc8e73d0640 1 -- 172.21.15.53:0/2236786418 wait complete. 2024-08-31T06:18:29.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 3220 20.53 MB/sec warmup 17 sec latency 73.870 ms 2024-08-31T06:18:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:29 smithi053 ceph-mon[18924]: pgmap v745: 97 pgs: 97 active+clean; 323 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 10 MiB/s wr, 273 op/s 2024-08-31T06:18:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:29 smithi130 ceph-mon[22266]: pgmap v745: 97 pgs: 97 active+clean; 323 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 10 MiB/s wr, 273 op/s 2024-08-31T06:18:30.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:29 smithi153 ceph-mon[22320]: pgmap v745: 97 pgs: 97 active+clean; 323 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 10 MiB/s wr, 273 op/s 2024-08-31T06:18:30.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 3294 19.50 MB/sec warmup 18 sec latency 67.128 ms 2024-08-31T06:18:30.823 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:18:30.824 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:18:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:31.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 3418 18.91 MB/sec warmup 19 sec latency 72.404 ms 2024-08-31T06:18:31.505 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 35.0 2024-08-31T06:18:31.505 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:18:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.730+0000 7f95db50d640 1 -- 172.21.15.53:0/3024154746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d4102cc0 msgr2=0x7f95d410f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.730+0000 7f95db50d640 1 --2- 172.21.15.53:0/3024154746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d4102cc0 0x7f95d410f9e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009860 tx=0x7f95c802a3d0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.731+0000 7f95db50d640 1 -- 172.21.15.53:0/3024154746 shutdown_connections 2024-08-31T06:18:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.731+0000 7f95db50d640 1 --2- 172.21.15.53:0/3024154746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d410ff20 0x7f95d4112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.731+0000 7f95db50d640 1 --2- 172.21.15.53:0/3024154746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d4102cc0 0x7f95d410f9e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.731+0000 7f95db50d640 1 --2- 172.21.15.53:0/3024154746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95d4102370 0x7f95d4102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.731+0000 7f95db50d640 1 -- 172.21.15.53:0/3024154746 >> 172.21.15.53:0/3024154746 conn(0x7f95d40794d0 msgr2=0x7f95d40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.731+0000 7f95db50d640 1 -- 172.21.15.53:0/3024154746 shutdown_connections 2024-08-31T06:18:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.731+0000 7f95db50d640 1 -- 172.21.15.53:0/3024154746 wait complete. 2024-08-31T06:18:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.732+0000 7f95db50d640 1 Processor -- start 2024-08-31T06:18:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.732+0000 7f95db50d640 1 -- start start 2024-08-31T06:18:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.732+0000 7f95db50d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95d4102370 0x7f95d419c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.732+0000 7f95db50d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d4102cc0 0x7f95d419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.732+0000 7f95db50d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d410ff20 0x7f95d41a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.732+0000 7f95db50d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f95d41158c0 con 0x7f95d410ff20 2024-08-31T06:18:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.732+0000 7f95db50d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f95d4115740 con 0x7f95d4102cc0 2024-08-31T06:18:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.732+0000 7f95db50d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95d4115a40 con 0x7f95d4102370 2024-08-31T06:18:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.733+0000 7f95d8aa8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d4102cc0 0x7f95d419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.733+0000 7f95d8aa8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d4102cc0 0x7f95d419c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53544/0 (socket says 172.21.15.53:53544) 2024-08-31T06:18:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.733+0000 7f95d8aa8640 1 -- 172.21.15.53:0/2044732803 learned_addr learned my addr 172.21.15.53:0/2044732803 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:31.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.733+0000 7f95d9aaa640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d410ff20 0x7f95d41a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.733+0000 7f95d92a9640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95d4102370 0x7f95d419c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.733+0000 7f95d8aa8640 1 -- 172.21.15.53:0/2044732803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95d4102370 msgr2=0x7f95d419c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.733+0000 7f95d8aa8640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95d4102370 0x7f95d419c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.733+0000 7f95d8aa8640 1 -- 172.21.15.53:0/2044732803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d410ff20 msgr2=0x7f95d41a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.733+0000 7f95d8aa8640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d410ff20 0x7f95d41a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.733+0000 7f95d8aa8640 1 -- 172.21.15.53:0/2044732803 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d41a22a0 con 0x7f95d4102cc0 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.733+0000 7f95d92a9640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95d4102370 0x7f95d419c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.734+0000 7f95d8aa8640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d4102cc0 0x7f95d419c8d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f95c8000c00 tx=0x7f95c8031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.734+0000 7f95d27fc640 1 -- 172.21.15.53:0/2044732803 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8040070 con 0x7f95d4102cc0 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.734+0000 7f95d27fc640 1 -- 172.21.15.53:0/2044732803 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95c8004b50 con 0x7f95d4102cc0 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.734+0000 7f95d27fc640 1 -- 172.21.15.53:0/2044732803 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8030b40 con 0x7f95d4102cc0 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.734+0000 7f95db50d640 1 -- 172.21.15.53:0/2044732803 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d41a2530 con 0x7f95d4102cc0 2024-08-31T06:18:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.734+0000 7f95db50d640 1 -- 172.21.15.53:0/2044732803 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d41a2900 con 0x7f95d4102cc0 2024-08-31T06:18:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.738+0000 7f95e1a82740 1 Processor -- start 2024-08-31T06:18:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.738+0000 7f95e1a82740 1 -- start start 2024-08-31T06:18:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.738+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620fac42780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.738+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 0x5620fac42cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.738+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa87b670 0x5620fac43200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.738+0000 7f95e1a82740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5620fabb85f0 con 0x5620fa873490 2024-08-31T06:18:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.738+0000 7f95e1a82740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5620faba7b80 con 0x5620fa87b670 2024-08-31T06:18:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.738+0000 7f95e1a82740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5620fababb30 con 0x5620fa89c350 2024-08-31T06:18:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.739+0000 7f95d92a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 0x5620fac42cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.739+0000 7f95d9aaa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620fac42780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.739+0000 7f95d92a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 0x5620fac42cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49300/0 (socket says 172.21.15.53:49300) 2024-08-31T06:18:31.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.739+0000 7f95d92a9640 1 -- 172.21.15.53:0/1927804398 learned_addr learned my addr 172.21.15.53:0/1927804398 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.739+0000 7f95d9aaa640 1 -- 172.21.15.53:0/1927804398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa87b670 msgr2=0x5620fac43200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:18:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.739+0000 7f95d9aaa640 1 --2- 172.21.15.53:0/1927804398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa87b670 0x5620fac43200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.739+0000 7f95d9aaa640 1 -- 172.21.15.53:0/1927804398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 msgr2=0x5620fac42cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.739+0000 7f95d9aaa640 1 --2- 172.21.15.53:0/1927804398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 0x5620fac42cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.739+0000 7f95d27fc640 1 -- 172.21.15.53:0/2044732803 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f95c8039040 con 0x7f95d4102cc0 2024-08-31T06:18:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.739+0000 7f95d9aaa640 1 -- 172.21.15.53:0/1927804398 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620fa907930 con 0x5620fa89c350 2024-08-31T06:18:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.739+0000 7f95d9aaa640 1 --2- 172.21.15.53:0/1927804398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620fac42780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0099b0 tx=0x7f95cc0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9557cccf1965944 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.740+0000 7f95bb7fe640 1 -- 172.21.15.53:0/1927804398 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc003970 con 0x5620fa89c350 2024-08-31T06:18:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.740+0000 7f95bb7fe640 1 -- 172.21.15.53:0/1927804398 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95cc00d6b0 con 0x5620fa89c350 2024-08-31T06:18:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.740+0000 7f95bb7fe640 1 -- 172.21.15.53:0/1927804398 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc004240 con 0x5620fa89c350 2024-08-31T06:18:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.740+0000 7f95d27fc640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95bc0b4d20 0x7f95bc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.740+0000 7f95d92a9640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95bc0b4d20 0x7f95bc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.740+0000 7f95d27fc640 1 -- 172.21.15.53:0/2044732803 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f95c8106580 con 0x7f95d4102cc0 2024-08-31T06:18:31.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.741+0000 7f95e1a82740 1 -- 172.21.15.53:0/1927804398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 msgr2=0x5620fac42780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:31.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.741+0000 7f95e1a82740 1 --2- 172.21.15.53:0/1927804398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620fac42780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0099b0 tx=0x7f95cc0095c0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.741+0000 7f95e1a82740 1 -- 172.21.15.53:0/1927804398 shutdown_connections 2024-08-31T06:18:31.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.741+0000 7f95e1a82740 1 --2- 172.21.15.53:0/1927804398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa87b670 0x5620fac43200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.741+0000 7f95e1a82740 1 --2- 172.21.15.53:0/1927804398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 0x5620fac42cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.741+0000 7f95e1a82740 1 --2- 172.21.15.53:0/1927804398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620fac42780 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.741+0000 7f95e1a82740 1 -- 172.21.15.53:0/1927804398 >> 172.21.15.53:0/1927804398 conn(0x5620fa890740 msgr2=0x5620fac40670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:31.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.741+0000 7f95d92a9640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95bc0b4d20 0x7f95bc0b7230 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x5620fac41400 tx=0x7f95c4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:31.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.741+0000 7f95e1a82740 1 -- 172.21.15.53:0/1927804398 shutdown_connections 2024-08-31T06:18:31.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.741+0000 7f95e1a82740 1 -- 172.21.15.53:0/1927804398 wait complete. 2024-08-31T06:18:31.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.742+0000 7f95e1a82740 1 -- start start 2024-08-31T06:18:31.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.742+0000 7f95e1a82740 1 Processor -- start 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.742+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 0x5620fac4df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.742+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa87b670 0x5620fac4e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620fac5a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95e1a82740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5620faa0a890 con 0x5620fa873490 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95e1a82740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5620fab2e790 con 0x5620fa87b670 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95e1a82740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5620fac50f60 con 0x5620fa89c350 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d92a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 0x5620fac4df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d9aaa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620fac5a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95e1a82740 10 client.0 _ll_register_callbacks cb 0x5620fa8b3ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d8aa8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa87b670 0x5620fac4e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d9aaa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620fac5a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:55932/0 (socket says 172.21.15.53:55932) 2024-08-31T06:18:31.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d9aaa640 1 -- 172.21.15.53:0/1506067989 learned_addr learned my addr 172.21.15.53:0/1506067989 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:31.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d9aaa640 1 -- 172.21.15.53:0/1506067989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa87b670 msgr2=0x5620fac4e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:31.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d9aaa640 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa87b670 0x5620fac4e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d9aaa640 1 -- 172.21.15.53:0/1506067989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 msgr2=0x5620fac4df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:31.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d9aaa640 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 0x5620fac4df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d9aaa640 1 -- 172.21.15.53:0/1506067989 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620fab65f30 con 0x5620fa89c350 2024-08-31T06:18:31.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d92a9640 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 0x5620fac4df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:31.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.743+0000 7f95d8aa8640 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa87b670 0x5620fac4e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:31.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.744+0000 7f95d9aaa640 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620fac5a280 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f95cc006010 tx=0x7f95cc00db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24ef27cc8e7fcfcc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:31.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.744+0000 7f95b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:18:31.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.744+0000 7f95b8ff9640 1 -- 172.21.15.53:0/1506067989 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc027070 con 0x5620fa89c350 2024-08-31T06:18:31.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.744+0000 7f95e1a82740 1 -- 172.21.15.53:0/1506067989 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95cc00d6b0 con 0x5620fa89c350 2024-08-31T06:18:31.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.744+0000 7f95b8ff9640 1 -- 172.21.15.53:0/1506067989 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f95cc004020 con 0x5620fa89c350 2024-08-31T06:18:31.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.744+0000 7f95b8ff9640 1 -- 172.21.15.53:0/1506067989 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f95cc033050 con 0x5620fa89c350 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.744+0000 7f95e1a82740 10 client.28864 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.744+0000 7f95e1a82740 1 -- 172.21.15.53:0/1506067989 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5620fac5cd60 con 0x5620fa89c350 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.745+0000 7f95b8ff9640 1 -- 172.21.15.53:0/1506067989 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95cc003e00 con 0x5620fa89c350 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.745+0000 7f95b8ff9640 1 -- 172.21.15.53:0/1506067989 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f95cc00b040 con 0x5620fa89c350 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.745+0000 7f95e1a82740 10 client.28864 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.745+0000 7f95e1a82740 10 client.28864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.745+0000 7f95e1a82740 20 client.28864 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.745+0000 7f95e1a82740 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620fa85acd0 0x5620fac60180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.745+0000 7f95e1a82740 4 client.28864 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.745+0000 7f95e1a82740 1 -- 172.21.15.53:0/1506067989 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f95cc00d6b0 con 0x5620fa85acd0 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.745+0000 7f95d92a9640 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620fa85acd0 0x5620fac60180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.746+0000 7f95b8ff9640 10 client.28864 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.746+0000 7f95d92a9640 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620fa85acd0 0x5620fac60180 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78ae028bed9ce98 server_cookie=9c9d2b0fb27a0ed1 in_seq=0 out_seq=0 2024-08-31T06:18:31.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95b8ff9640 1 -- 172.21.15.53:0/1506067989 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f95cc00d6b0 con 0x5620fa85acd0 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95b8ff9640 10 client.28864 handle_command_reply: tid=0 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95e1a82740 1 client.28864 shutdown 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95e1a82740 1 -- 172.21.15.53:0/1506067989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 msgr2=0x5620fac5a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95e1a82740 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620fac5a280 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f95cc006010 tx=0x7f95cc00db10 comp rx=0 tx=0).stop 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95e1a82740 1 -- 172.21.15.53:0/1506067989 shutdown_connections 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95e1a82740 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620fa85acd0 0x5620fac60180 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95e1a82740 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620fac5a280 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95e1a82740 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa87b670 0x5620fac4e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95b8ff9640 0 client.28864 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95e1a82740 1 --2- 172.21.15.53:0/1506067989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa873490 0x5620fac4df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95e1a82740 1 -- 172.21.15.53:0/1506067989 >> 172.21.15.53:0/1506067989 conn(0x5620fa890740 msgr2=0x5620fac45910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95e1a82740 1 -- 172.21.15.53:0/1506067989 shutdown_connections 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.747+0000 7f95e1a82740 1 -- 172.21.15.53:0/1506067989 wait complete. 2024-08-31T06:18:31.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.748+0000 7f95e1a82740 20 client.28864 trim_cache size 0 max 16384 2024-08-31T06:18:31.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95e1a82740 1 Processor -- start 2024-08-31T06:18:31.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95e1a82740 1 -- start start 2024-08-31T06:18:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa873490 0x5620fac49730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 0x5620fac4fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa89c350 0x5620fac4b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95e1a82740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f95d41b1760 con 0x5620fa87b670 2024-08-31T06:18:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95e1a82740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f95d41b34e0 con 0x5620fa89c350 2024-08-31T06:18:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95e1a82740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95d41b1e30 con 0x5620fa873490 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95d8aa8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 0x5620fac4fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95d8aa8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 0x5620fac4fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49320/0 (socket says 172.21.15.53:49320) 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95d8aa8640 1 -- 172.21.15.53:0/687979544 learned_addr learned my addr 172.21.15.53:0/687979544 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.780+0000 7f95d92a9640 1 --2- 172.21.15.53:0/687979544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa873490 0x5620fac49730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.781+0000 7f95d9aaa640 1 --2- 172.21.15.53:0/687979544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa89c350 0x5620fac4b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.781+0000 7f95d8aa8640 1 -- 172.21.15.53:0/687979544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa873490 msgr2=0x5620fac49730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.781+0000 7f95d8aa8640 1 --2- 172.21.15.53:0/687979544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa873490 0x5620fac49730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.781+0000 7f95d8aa8640 1 -- 172.21.15.53:0/687979544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa89c350 msgr2=0x5620fac4b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.781+0000 7f95d8aa8640 1 --2- 172.21.15.53:0/687979544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa89c350 0x5620fac4b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.781+0000 7f95d8aa8640 1 -- 172.21.15.53:0/687979544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620fac4ceb0 con 0x5620fa87b670 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.781+0000 7f95d92a9640 1 --2- 172.21.15.53:0/687979544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa873490 0x5620fac49730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.781+0000 7f95d9aaa640 1 --2- 172.21.15.53:0/687979544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa89c350 0x5620fac4b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.781+0000 7f95d8aa8640 1 --2- 172.21.15.53:0/687979544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 0x5620fac4fb80 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f95c80c9e60 tx=0x7f95c80cc490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3102489855fb11c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.781+0000 7f95baffd640 1 -- 172.21.15.53:0/687979544 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c80ccbf0 con 0x5620fa87b670 2024-08-31T06:18:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.782+0000 7f95baffd640 1 -- 172.21.15.53:0/687979544 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95c80d1460 con 0x5620fa87b670 2024-08-31T06:18:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.782+0000 7f95baffd640 1 -- 172.21.15.53:0/687979544 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c80c8e80 con 0x5620fa87b670 2024-08-31T06:18:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.783+0000 7f95e1a82740 1 -- 172.21.15.53:0/687979544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 msgr2=0x5620fac4fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.783+0000 7f95e1a82740 1 --2- 172.21.15.53:0/687979544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 0x5620fac4fb80 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f95c80c9e60 tx=0x7f95c80cc490 comp rx=0 tx=0).stop 2024-08-31T06:18:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.783+0000 7f95e1a82740 1 -- 172.21.15.53:0/687979544 shutdown_connections 2024-08-31T06:18:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.783+0000 7f95e1a82740 1 --2- 172.21.15.53:0/687979544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa89c350 0x5620fac4b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.783+0000 7f95e1a82740 1 --2- 172.21.15.53:0/687979544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 0x5620fac4fb80 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.783+0000 7f95e1a82740 1 --2- 172.21.15.53:0/687979544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa873490 0x5620fac49730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.783+0000 7f95e1a82740 1 -- 172.21.15.53:0/687979544 >> 172.21.15.53:0/687979544 conn(0x5620fa890740 msgr2=0x5620fac4f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.784+0000 7f95e1a82740 1 -- 172.21.15.53:0/687979544 shutdown_connections 2024-08-31T06:18:31.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.784+0000 7f95e1a82740 1 -- 172.21.15.53:0/687979544 wait complete. 2024-08-31T06:18:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.785+0000 7f95e1a82740 1 -- start start 2024-08-31T06:18:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.785+0000 7f95e1a82740 1 Processor -- start 2024-08-31T06:18:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa873490 0x5620fac52440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 0x5620fac52980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95e1a82740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620facc9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95d92a9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa873490 0x5620fac52440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95e1a82740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f95d41b2d50 con 0x5620fa87b670 2024-08-31T06:18:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95d8aa8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 0x5620fac52980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95d92a9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa873490 0x5620fac52440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53578/0 (socket says 172.21.15.53:53578) 2024-08-31T06:18:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95d92a9640 1 -- 172.21.15.53:0/2592580003 learned_addr learned my addr 172.21.15.53:0/2592580003 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95e1a82740 1 -- 172.21.15.53:0/2592580003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f95d41b25c0 con 0x5620fa873490 2024-08-31T06:18:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95e1a82740 1 -- 172.21.15.53:0/2592580003 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95d41af760 con 0x5620fa89c350 2024-08-31T06:18:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95d9aaa640 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620facc9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.786+0000 7f95e1a82740 10 client.0 _ll_register_callbacks cb 0x7f95c40095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:31.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.787+0000 7f95d92a9640 1 -- 172.21.15.53:0/2592580003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 msgr2=0x5620facc9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:31.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.787+0000 7f95d92a9640 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620facc9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.787+0000 7f95d92a9640 1 -- 172.21.15.53:0/2592580003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 msgr2=0x5620fac52980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:31.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.787+0000 7f95d92a9640 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 0x5620fac52980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.787+0000 7f95d92a9640 1 -- 172.21.15.53:0/2592580003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620fac53190 con 0x5620fa873490 2024-08-31T06:18:31.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.787+0000 7f95d92a9640 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa873490 0x5620fac52440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x5620fac606c0 tx=0x7f95c40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca8ad4be97025ad0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:31.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.787+0000 7f95b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:18:31.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.787+0000 7f95b8ff9640 1 -- 172.21.15.53:0/2592580003 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4011860 con 0x5620fa873490 2024-08-31T06:18:31.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.787+0000 7f95b8ff9640 1 -- 172.21.15.53:0/2592580003 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f95c4011a00 con 0x5620fa873490 2024-08-31T06:18:31.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.787+0000 7f95e1a82740 1 -- 172.21.15.53:0/2592580003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95c80d1460 con 0x5620fa873490 2024-08-31T06:18:31.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.788+0000 7f95b8ff9640 1 -- 172.21.15.53:0/2592580003 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f95c4011c00 con 0x5620fa873490 2024-08-31T06:18:31.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.788+0000 7f95e1a82740 10 client.28871 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:31.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.788+0000 7f95e1a82740 1 -- 172.21.15.53:0/2592580003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5620faccaea0 con 0x5620fa873490 2024-08-31T06:18:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.788+0000 7f95b8ff9640 1 -- 172.21.15.53:0/2592580003 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95c4011da0 con 0x5620fa873490 2024-08-31T06:18:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.788+0000 7f95b8ff9640 1 -- 172.21.15.53:0/2592580003 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f95c400f040 con 0x5620fa873490 2024-08-31T06:18:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.788+0000 7f95e1a82740 10 client.28871 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.788+0000 7f95e1a82740 10 client.28871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.788+0000 7f95e1a82740 20 client.28871 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.788+0000 7f95e1a82740 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620fa830080 0x5620faccd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.788+0000 7f95e1a82740 4 client.28871 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:18:31.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.788+0000 7f95e1a82740 1 -- 172.21.15.53:0/2592580003 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f95c80d1460 con 0x5620fa830080 2024-08-31T06:18:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.789+0000 7f95d8aa8640 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620fa830080 0x5620faccd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.789+0000 7f95b8ff9640 10 client.28871 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.789+0000 7f95d8aa8640 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620fa830080 0x5620faccd7a0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b06fff4b5006307f server_cookie=ab71ba02411187a0 in_seq=0 out_seq=0 2024-08-31T06:18:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.790+0000 7f95b8ff9640 1 -- 172.21.15.53:0/2592580003 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f95c80d1460 con 0x5620fa830080 2024-08-31T06:18:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.790+0000 7f95b8ff9640 10 client.28871 handle_command_reply: tid=0 2024-08-31T06:18:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.790+0000 7f95e1a82740 1 client.28871 shutdown 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.790+0000 7f95e1a82740 1 -- 172.21.15.53:0/2592580003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa873490 msgr2=0x5620fac52440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.790+0000 7f95e1a82740 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa873490 0x5620fac52440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x5620fac606c0 tx=0x7f95c40046c0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.790+0000 7f95e1a82740 1 -- 172.21.15.53:0/2592580003 shutdown_connections 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.790+0000 7f95e1a82740 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620fa830080 0x5620faccd7a0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.790+0000 7f95e1a82740 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620fa89c350 0x5620facc9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.790+0000 7f95b8ff9640 0 client.28871 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.791+0000 7f95e1a82740 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620fa87b670 0x5620fac52980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.791+0000 7f95e1a82740 1 --2- 172.21.15.53:0/2592580003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fa873490 0x5620fac52440 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.791+0000 7f95e1a82740 1 -- 172.21.15.53:0/2592580003 >> 172.21.15.53:0/2592580003 conn(0x5620fa890740 msgr2=0x5620fac4f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.791+0000 7f95e1a82740 1 -- 172.21.15.53:0/2592580003 shutdown_connections 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.791+0000 7f95e1a82740 1 -- 172.21.15.53:0/2592580003 wait complete. 2024-08-31T06:18:31.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.791+0000 7f95e1a82740 20 client.28871 trim_cache size 0 max 16384 2024-08-31T06:18:31.795 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:18:31.795 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:18:31.795 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "a849b420-52ce-457c-9b7e-01903fe0dfa3", 2024-08-31T06:18:31.795 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:18:31.795 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:18:31.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 -- 172.21.15.53:0/2044732803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95bc0b4d20 msgr2=0x7f95bc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95bc0b4d20 0x7f95bc0b7230 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x5620fac41400 tx=0x7f95c4005f90 comp rx=0 tx=0).stop 2024-08-31T06:18:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 -- 172.21.15.53:0/2044732803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d4102cc0 msgr2=0x7f95d419c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d4102cc0 0x7f95d419c8d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f95c8000c00 tx=0x7f95c8031630 comp rx=0 tx=0).stop 2024-08-31T06:18:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 -- 172.21.15.53:0/2044732803 shutdown_connections 2024-08-31T06:18:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f95bc0b4d20 0x7f95bc0b7230 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95d410ff20 0x7f95d41a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95d4102cc0 0x7f95d419c8d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 --2- 172.21.15.53:0/2044732803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95d4102370 0x7f95d419c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 -- 172.21.15.53:0/2044732803 >> 172.21.15.53:0/2044732803 conn(0x7f95d40794d0 msgr2=0x7f95d41113f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 -- 172.21.15.53:0/2044732803 shutdown_connections 2024-08-31T06:18:31.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:31.792+0000 7f95db50d640 1 -- 172.21.15.53:0/2044732803 wait complete. 2024-08-31T06:18:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:31 smithi053 ceph-mon[18924]: pgmap v746: 97 pgs: 97 active+clean; 335 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.7 MiB/s wr, 281 op/s 2024-08-31T06:18:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:31 smithi130 ceph-mon[22266]: pgmap v746: 97 pgs: 97 active+clean; 335 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.7 MiB/s wr, 281 op/s 2024-08-31T06:18:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:31 smithi153 ceph-mon[22320]: pgmap v746: 97 pgs: 97 active+clean; 335 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.7 MiB/s wr, 281 op/s 2024-08-31T06:18:32.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 3561 19.09 MB/sec warmup 20 sec latency 537.934 ms 2024-08-31T06:18:32.875 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:18:32.939 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:32.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:18:32.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:32.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:18:32.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:18:32.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:32.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:18:32.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:18:32.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:18:32.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:18:32.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:32.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:32.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:32 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:18:33.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:18:33.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:18:33.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:18:33.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:18:33.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:18:33.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:18:33.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:32 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:18:33.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:18:33.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:18:33.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:18:33.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:18:33.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:18:33.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:18:33.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:32 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 3714 18.40 MB/sec warmup 21 sec latency 548.100 ms 2024-08-31T06:18:33.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.546+0000 7fd79a575640 1 -- 172.21.15.53:0/1092824354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd794108180 msgr2=0x7fd794108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.546+0000 7fd79a575640 1 --2- 172.21.15.53:0/1092824354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd794108180 0x7fd794108590 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fd788009900 tx=0x7fd78802a410 comp rx=0 tx=0).stop 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.546+0000 7fd79a575640 1 -- 172.21.15.53:0/1092824354 shutdown_connections 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.546+0000 7fd79a575640 1 --2- 172.21.15.53:0/1092824354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd794108ad0 0x7fd79410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.546+0000 7fd79a575640 1 --2- 172.21.15.53:0/1092824354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd794108180 0x7fd794108590 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.546+0000 7fd79a575640 1 --2- 172.21.15.53:0/1092824354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794102840 0x7fd794102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.546+0000 7fd79a575640 1 -- 172.21.15.53:0/1092824354 >> 172.21.15.53:0/1092824354 conn(0x7fd794079580 msgr2=0x7fd794079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.546+0000 7fd79a575640 1 -- 172.21.15.53:0/1092824354 shutdown_connections 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.546+0000 7fd79a575640 1 -- 172.21.15.53:0/1092824354 wait complete. 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.547+0000 7fd79a575640 1 Processor -- start 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.547+0000 7fd79a575640 1 -- start start 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd79a575640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd794102840 0x7fd79419a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:33.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd79a575640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108180 0x7fd79419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd79a575640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd794108ad0 0x7fd79419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd79a575640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd794112600 con 0x7fd794102840 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd79a575640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd794112480 con 0x7fd794108180 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd79a575640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd794112780 con 0x7fd794108ad0 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd793fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd794102840 0x7fd79419a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd7937fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108180 0x7fd79419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd7937fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108180 0x7fd79419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51566/0 (socket says 172.21.15.53:51566) 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd7937fe640 1 -- 172.21.15.53:0/2129839893 learned_addr learned my addr 172.21.15.53:0/2129839893 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd793fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd794102840 0x7fd79419a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46414/0 (socket says 172.21.15.53:46414) 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd798b12640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd794108ad0 0x7fd79419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd793fff640 1 -- 172.21.15.53:0/2129839893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd794108ad0 msgr2=0x7fd79419f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:33.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd793fff640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd794108ad0 0x7fd79419f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd793fff640 1 -- 172.21.15.53:0/2129839893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108180 msgr2=0x7fd79419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd793fff640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108180 0x7fd79419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.548+0000 7fd793fff640 1 -- 172.21.15.53:0/2129839893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7941a00d0 con 0x7fd794102840 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.549+0000 7fd793fff640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd794102840 0x7fd79419a160 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fd78400e9f0 tx=0x7fd78400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.549+0000 7fd7917fa640 1 -- 172.21.15.53:0/2129839893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78400ccc0 con 0x7fd794102840 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.549+0000 7fd7917fa640 1 -- 172.21.15.53:0/2129839893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7840108c0 con 0x7fd794102840 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.549+0000 7fd7917fa640 1 -- 172.21.15.53:0/2129839893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7840187e0 con 0x7fd794102840 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.549+0000 7fd79a575640 1 -- 172.21.15.53:0/2129839893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7941a03c0 con 0x7fd794102840 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.549+0000 7fd79a575640 1 -- 172.21.15.53:0/2129839893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7941a6b20 con 0x7fd794102840 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.550+0000 7fd79a575640 1 -- 172.21.15.53:0/2129839893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd794102c50 con 0x7fd794102840 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.553+0000 7fd7917fa640 1 -- 172.21.15.53:0/2129839893 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd784010430 con 0x7fd794102840 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.554+0000 7fd7917fa640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd77c0b4e70 0x7fd77c0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:33.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.554+0000 7fd7937fe640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd77c0b4e70 0x7fd77c0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:33.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.554+0000 7fd7917fa640 1 -- 172.21.15.53:0/2129839893 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fd7840e5c40 con 0x7fd794102840 2024-08-31T06:18:33.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.555+0000 7fd7937fe640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd77c0b4e70 0x7fd77c0b7380 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd7880096c0 tx=0x7fd788005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:33.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.560+0000 7fd7917fa640 1 -- 172.21.15.53:0/2129839893 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd7840ac3e0 con 0x7fd794102840 2024-08-31T06:18:33.639 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:33.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.957+0000 7fd79a575640 1 -- 172.21.15.53:0/2129839893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd79419b290 con 0x7fd794102840 2024-08-31T06:18:33.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.958+0000 7fd7917fa640 1 -- 172.21.15.53:0/2129839893 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+12011 (secure 0 0 0) 0x7fd7840b0ba0 con 0x7fd794102840 2024-08-31T06:18:33.960 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:18:33.961 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":56,"btime":"2024-08-31T06:18:21:665793+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:18:21.236924+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:18:33.961 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 56 2024-08-31T06:18:33.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.961+0000 7fd79a575640 1 -- 172.21.15.53:0/2129839893 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd77c0b4e70 msgr2=0x7fd77c0b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:33.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.961+0000 7fd79a575640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd77c0b4e70 0x7fd77c0b7380 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd7880096c0 tx=0x7fd788005e80 comp rx=0 tx=0).stop 2024-08-31T06:18:33.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.962+0000 7fd79a575640 1 -- 172.21.15.53:0/2129839893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd794102840 msgr2=0x7fd79419a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:33.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.962+0000 7fd79a575640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd794102840 0x7fd79419a160 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fd78400e9f0 tx=0x7fd78400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:18:33.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.962+0000 7fd79a575640 1 -- 172.21.15.53:0/2129839893 shutdown_connections 2024-08-31T06:18:33.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.962+0000 7fd79a575640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd77c0b4e70 0x7fd77c0b7380 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:33.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.962+0000 7fd79a575640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd794108ad0 0x7fd79419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:33.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.962+0000 7fd79a575640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108180 0x7fd79419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:33.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.962+0000 7fd79a575640 1 --2- 172.21.15.53:0/2129839893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd794102840 0x7fd79419a160 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:33.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.962+0000 7fd79a575640 1 -- 172.21.15.53:0/2129839893 >> 172.21.15.53:0/2129839893 conn(0x7fd794079580 msgr2=0x7fd79406b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:33.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.962+0000 7fd79a575640 1 -- 172.21.15.53:0/2129839893 shutdown_connections 2024-08-31T06:18:33.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:33.962+0000 7fd79a575640 1 -- 172.21.15.53:0/2129839893 wait complete. 2024-08-31T06:18:33.968 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:33 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.968 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:33 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:33.968 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:33 smithi053 ceph-mon[18924]: pgmap v747: 97 pgs: 97 active+clean; 344 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 4.7 MiB/s wr, 258 op/s 2024-08-31T06:18:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:33 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:33 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:33 smithi130 ceph-mon[22266]: pgmap v747: 97 pgs: 97 active+clean; 344 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 4.7 MiB/s wr, 258 op/s 2024-08-31T06:18:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:33 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:33 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:18:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:33 smithi153 ceph-mon[22320]: pgmap v747: 97 pgs: 97 active+clean; 344 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 4.7 MiB/s wr, 258 op/s 2024-08-31T06:18:34.354 INFO:tasks.workunit.client.0.smithi053.stdout: 10 3860 17.88 MB/sec warmup 22 sec latency 558.514 ms 2024-08-31T06:18:34.660 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 155.0 --await-for 45.0' 2024-08-31T06:18:34.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 155.0 --await-for 45.0 2024-08-31T06:18:34.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:34 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2129839893' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:18:34.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.970+0000 7fbabef2b640 1 -- 172.21.15.53:0/3037268810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8102810 msgr2=0x7fbab8102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.970+0000 7fbabef2b640 1 --2- 172.21.15.53:0/3037268810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8102810 0x7fbab8102c20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009900 tx=0x7fbaac02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.970+0000 7fbabef2b640 1 -- 172.21.15.53:0/3037268810 shutdown_connections 2024-08-31T06:18:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.970+0000 7fbabef2b640 1 --2- 172.21.15.53:0/3037268810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab8108aa0 0x7fbab810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.970+0000 7fbabef2b640 1 --2- 172.21.15.53:0/3037268810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbab8108150 0x7fbab8108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.970+0000 7fbabef2b640 1 --2- 172.21.15.53:0/3037268810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8102810 0x7fbab8102c20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.970+0000 7fbabef2b640 1 -- 172.21.15.53:0/3037268810 >> 172.21.15.53:0/3037268810 conn(0x7fbab80794d0 msgr2=0x7fbab80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.970+0000 7fbabef2b640 1 -- 172.21.15.53:0/3037268810 shutdown_connections 2024-08-31T06:18:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.970+0000 7fbabef2b640 1 -- 172.21.15.53:0/3037268810 wait complete. 2024-08-31T06:18:34.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.971+0000 7fbabef2b640 1 Processor -- start 2024-08-31T06:18:34.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.971+0000 7fbabef2b640 1 -- start start 2024-08-31T06:18:34.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbabef2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbab8102810 0x7fbab81981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbabef2b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8108150 0x7fbab8198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbabef2b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab8108aa0 0x7fbab819d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbabef2b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbab81125b0 con 0x7fbab8102810 2024-08-31T06:18:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbabef2b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbab8112430 con 0x7fbab8108150 2024-08-31T06:18:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbabef2b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbab8112730 con 0x7fbab8108aa0 2024-08-31T06:18:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbabd4c8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab8108aa0 0x7fbab819d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbab7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8108150 0x7fbab8198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:34.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbabd4c8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab8108aa0 0x7fbab819d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:39166/0 (socket says 172.21.15.53:39166) 2024-08-31T06:18:34.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbabd4c8640 1 -- 172.21.15.53:0/1086968592 learned_addr learned my addr 172.21.15.53:0/1086968592 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:34.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbab7fff640 1 -- 172.21.15.53:0/1086968592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab8108aa0 msgr2=0x7fbab819d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:34.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbab7fff640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab8108aa0 0x7fbab819d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbab7fff640 1 -- 172.21.15.53:0/1086968592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbab8102810 msgr2=0x7fbab81981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:34.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.972+0000 7fbab7fff640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbab8102810 0x7fbab81981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.973+0000 7fbab7fff640 1 -- 172.21.15.53:0/1086968592 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab819dfa0 con 0x7fbab8108150 2024-08-31T06:18:34.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.973+0000 7fbab7fff640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8108150 0x7fbab8198730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400e9c0 tx=0x7fbaa400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:34.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.973+0000 7fbab5ffb640 1 -- 172.21.15.53:0/1086968592 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa400cd80 con 0x7fbab8108150 2024-08-31T06:18:34.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.973+0000 7fbabef2b640 1 -- 172.21.15.53:0/1086968592 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab819e230 con 0x7fbab8108150 2024-08-31T06:18:34.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.973+0000 7fbab5ffb640 1 -- 172.21.15.53:0/1086968592 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbaa40054b0 con 0x7fbab8108150 2024-08-31T06:18:34.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.973+0000 7fbabef2b640 1 -- 172.21.15.53:0/1086968592 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab819e9e0 con 0x7fbab8108150 2024-08-31T06:18:34.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.974+0000 7fbab5ffb640 1 -- 172.21.15.53:0/1086968592 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4010430 con 0x7fbab8108150 2024-08-31T06:18:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.977+0000 7fbab5ffb640 1 -- 172.21.15.53:0/1086968592 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbaa4005020 con 0x7fbab8108150 2024-08-31T06:18:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.978+0000 7fbac54a0740 1 Processor -- start 2024-08-31T06:18:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.978+0000 7fbac54a0740 1 -- start start 2024-08-31T06:18:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.978+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0031070 0x5559f03d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.978+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f00081b0 0x5559f03d6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:34.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.978+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0010390 0x5559f03d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:34.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.978+0000 7fbac54a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559f034d630 con 0x5559f0031070 2024-08-31T06:18:34.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbac54a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5559f033cbc0 con 0x5559f0010390 2024-08-31T06:18:34.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbac54a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5559f0340b70 con 0x5559f00081b0 2024-08-31T06:18:34.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbab7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0010390 0x5559f03d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:34.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbab7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0010390 0x5559f03d6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51584/0 (socket says 172.21.15.53:51584) 2024-08-31T06:18:34.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbab7fff640 1 -- 172.21.15.53:0/2710514177 learned_addr learned my addr 172.21.15.53:0/2710514177 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:34.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbabd4c8640 1 --2- 172.21.15.53:0/2710514177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0031070 0x5559f03d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:34.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbabccc7640 1 --2- 172.21.15.53:0/2710514177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f00081b0 0x5559f03d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:34.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbab7fff640 1 -- 172.21.15.53:0/2710514177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f00081b0 msgr2=0x5559f03d6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:34.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbab7fff640 1 --2- 172.21.15.53:0/2710514177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f00081b0 0x5559f03d6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbab7fff640 1 -- 172.21.15.53:0/2710514177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0031070 msgr2=0x5559f03d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbab7fff640 1 --2- 172.21.15.53:0/2710514177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0031070 0x5559f03d62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbab7fff640 1 -- 172.21.15.53:0/2710514177 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559f009c650 con 0x5559f0010390 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.979+0000 7fbabd4c8640 1 --2- 172.21.15.53:0/2710514177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0031070 0x5559f03d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.980+0000 7fbabccc7640 1 --2- 172.21.15.53:0/2710514177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f00081b0 0x5559f03d6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.980+0000 7fbab5ffb640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaa80b4d20 0x7fbaa80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.980+0000 7fbab7fff640 1 --2- 172.21.15.53:0/2710514177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0010390 0x5559f03d6d40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40e30f0 tx=0x7fbaa40ee590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d32828ea968f3c5e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.980+0000 7fbabd4c8640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaa80b4d20 0x7fbaa80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.981+0000 7fbaa2ffd640 1 -- 172.21.15.53:0/2710514177 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40a7fe0 con 0x5559f0010390 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.981+0000 7fbaa2ffd640 1 -- 172.21.15.53:0/2710514177 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbaa40e9e40 con 0x5559f0010390 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.981+0000 7fbaa2ffd640 1 -- 172.21.15.53:0/2710514177 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4005310 con 0x5559f0010390 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.981+0000 7fbab5ffb640 1 -- 172.21.15.53:0/1086968592 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fbaa40e5a50 con 0x7fbab8108150 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.982+0000 7fbac54a0740 1 -- 172.21.15.53:0/2710514177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0010390 msgr2=0x5559f03d6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:34.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.982+0000 7fbabd4c8640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaa80b4d20 0x7fbaa80b7230 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbab00099a0 tx=0x7fbab0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.982+0000 7fbac54a0740 1 --2- 172.21.15.53:0/2710514177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0010390 0x5559f03d6d40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40e30f0 tx=0x7fbaa40ee590 comp rx=0 tx=0).stop 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.982+0000 7fbac54a0740 1 -- 172.21.15.53:0/2710514177 shutdown_connections 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.982+0000 7fbac54a0740 1 --2- 172.21.15.53:0/2710514177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0010390 0x5559f03d6d40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.982+0000 7fbac54a0740 1 --2- 172.21.15.53:0/2710514177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f00081b0 0x5559f03d6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.982+0000 7fbac54a0740 1 --2- 172.21.15.53:0/2710514177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0031070 0x5559f03d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.982+0000 7fbac54a0740 1 -- 172.21.15.53:0/2710514177 >> 172.21.15.53:0/2710514177 conn(0x5559f0025460 msgr2=0x5559f03d41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.983+0000 7fbac54a0740 1 -- 172.21.15.53:0/2710514177 shutdown_connections 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.983+0000 7fbac54a0740 1 -- 172.21.15.53:0/2710514177 wait complete. 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.983+0000 7fbac54a0740 1 -- start start 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.983+0000 7fbac54a0740 1 Processor -- start 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f00081b0 0x5559f03e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0010390 0x5559f03e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:34.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 0x5559f03edd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbac54a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559f019f700 con 0x5559f0010390 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbac54a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5559f02c3700 con 0x5559f0031070 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbac54a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5559f03e4aa0 con 0x5559f00081b0 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbac54a0740 10 client.0 _ll_register_callbacks cb 0x5559f02f2dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbabd4c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 0x5559f03edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbabd4c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 0x5559f03edd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51586/0 (socket says 172.21.15.53:51586) 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbabd4c8640 1 -- 172.21.15.53:0/3205459494 learned_addr learned my addr 172.21.15.53:0/3205459494 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbab7fff640 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0010390 0x5559f03e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.984+0000 7fbabccc7640 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f00081b0 0x5559f03e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fbabd4c8640 1 -- 172.21.15.53:0/3205459494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f00081b0 msgr2=0x5559f03e1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fbabd4c8640 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f00081b0 0x5559f03e1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fbabd4c8640 1 -- 172.21.15.53:0/3205459494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0010390 msgr2=0x5559f03e1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:34.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fbabd4c8640 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0010390 0x5559f03e1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fbabd4c8640 1 -- 172.21.15.53:0/3205459494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559f02fc8b0 con 0x5559f0031070 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fbab7fff640 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0010390 0x5559f03e1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fbabd4c8640 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 0x5559f03edd90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009270 tx=0x7fbab0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90798490f1f8e4a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fba97fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fba97fff640 1 -- 172.21.15.53:0/3205459494 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab001fa50 con 0x5559f0031070 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fba97fff640 1 -- 172.21.15.53:0/3205459494 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fbab001fbf0 con 0x5559f0031070 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fbac54a0740 1 -- 172.21.15.53:0/3205459494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5559f034f580 con 0x5559f0031070 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.985+0000 7fba97fff640 1 -- 172.21.15.53:0/3205459494 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fbab001fdf0 con 0x5559f0031070 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.986+0000 7fbac54a0740 10 client.28889 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.986+0000 7fbac54a0740 1 -- 172.21.15.53:0/3205459494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5559f03f0850 con 0x5559f0031070 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.986+0000 7fba97fff640 1 -- 172.21.15.53:0/3205459494 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbab0032910 con 0x5559f0031070 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.986+0000 7fba97fff640 1 -- 172.21.15.53:0/3205459494 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fbab001d700 con 0x5559f0031070 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.986+0000 7fbac54a0740 10 client.28889 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:34.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.986+0000 7fbac54a0740 10 client.28889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:34.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.986+0000 7fbac54a0740 20 client.28889 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:34.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.986+0000 7fbac54a0740 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5559effef9f0 0x5559f03f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:34.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.986+0000 7fbac54a0740 4 client.28889 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:34.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.986+0000 7fbac54a0740 1 -- 172.21.15.53:0/3205459494 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559f034f580 con 0x5559effef9f0 2024-08-31T06:18:34.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.986+0000 7fbabccc7640 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5559effef9f0 0x5559f03f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:34.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.987+0000 7fba97fff640 10 client.28889 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:34.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.987+0000 7fbabccc7640 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5559effef9f0 0x5559f03f3e50 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82716126397ed854 server_cookie=b83806b16ba18df6 in_seq=0 out_seq=0 2024-08-31T06:18:34.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fba97fff640 1 -- 172.21.15.53:0/3205459494 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5559f034f580 con 0x5559effef9f0 2024-08-31T06:18:34.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fba97fff640 10 client.28889 handle_command_reply: tid=0 2024-08-31T06:18:34.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fbac54a0740 1 client.28889 shutdown 2024-08-31T06:18:34.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fbac54a0740 1 -- 172.21.15.53:0/3205459494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 msgr2=0x5559f03edd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:34.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fbac54a0740 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 0x5559f03edd90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009270 tx=0x7fbab0004a40 comp rx=0 tx=0).stop 2024-08-31T06:18:34.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fbac54a0740 1 -- 172.21.15.53:0/3205459494 shutdown_connections 2024-08-31T06:18:34.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fbac54a0740 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5559effef9f0 0x5559f03f3e50 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fbac54a0740 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 0x5559f03edd90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fbac54a0740 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0010390 0x5559f03e1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fba97fff640 0 client.28889 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:34.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fbac54a0740 1 --2- 172.21.15.53:0/3205459494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f00081b0 0x5559f03e1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:34.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.988+0000 7fbac54a0740 1 -- 172.21.15.53:0/3205459494 >> 172.21.15.53:0/3205459494 conn(0x5559f0025460 msgr2=0x5559f03d94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:34.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.989+0000 7fbac54a0740 1 -- 172.21.15.53:0/3205459494 shutdown_connections 2024-08-31T06:18:34.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.989+0000 7fbac54a0740 1 -- 172.21.15.53:0/3205459494 wait complete. 2024-08-31T06:18:34.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:34.989+0000 7fbac54a0740 20 client.28889 trim_cache size 0 max 16384 2024-08-31T06:18:35.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.013+0000 7fbac54a0740 1 Processor -- start 2024-08-31T06:18:35.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.013+0000 7fbac54a0740 1 -- start start 2024-08-31T06:18:35.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.013+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f00081b0 0x5559f03d9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f0010390 0x5559f03edc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 0x5559f03ee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbabccc7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f00081b0 0x5559f03d9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbac54a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbab81be440 con 0x5559f00081b0 2024-08-31T06:18:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbac54a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbab81c01c0 con 0x5559f0031070 2024-08-31T06:18:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbac54a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbab81beb10 con 0x5559f0010390 2024-08-31T06:18:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbabccc7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f00081b0 0x5559f03d9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46456/0 (socket says 172.21.15.53:46456) 2024-08-31T06:18:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbabccc7640 1 -- 172.21.15.53:0/886735404 learned_addr learned my addr 172.21.15.53:0/886735404 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbab7fff640 1 --2- 172.21.15.53:0/886735404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f0010390 0x5559f03edc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbabd4c8640 1 --2- 172.21.15.53:0/886735404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 0x5559f03ee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbabccc7640 1 -- 172.21.15.53:0/886735404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f0010390 msgr2=0x5559f03edc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbabccc7640 1 --2- 172.21.15.53:0/886735404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f0010390 0x5559f03edc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbabccc7640 1 -- 172.21.15.53:0/886735404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 msgr2=0x5559f03ee1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbabccc7640 1 --2- 172.21.15.53:0/886735404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 0x5559f03ee1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.014+0000 7fbabccc7640 1 -- 172.21.15.53:0/886735404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559f03e4180 con 0x5559f00081b0 2024-08-31T06:18:35.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.015+0000 7fbabccc7640 1 --2- 172.21.15.53:0/886735404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f00081b0 0x5559f03d9ad0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fbab819e900 tx=0x7fbaac009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2da08eba59ad167 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:35.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.015+0000 7fbaa27fc640 1 -- 172.21.15.53:0/886735404 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac049070 con 0x5559f00081b0 2024-08-31T06:18:35.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.015+0000 7fbaa27fc640 1 -- 172.21.15.53:0/886735404 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5559f034f580 con 0x5559f00081b0 2024-08-31T06:18:35.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.015+0000 7fbaa27fc640 1 -- 172.21.15.53:0/886735404 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac035020 con 0x5559f00081b0 2024-08-31T06:18:35.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.016+0000 7fbac54a0740 1 -- 172.21.15.53:0/886735404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f00081b0 msgr2=0x5559f03d9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.016+0000 7fbac54a0740 1 --2- 172.21.15.53:0/886735404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f00081b0 0x5559f03d9ad0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fbab819e900 tx=0x7fbaac009260 comp rx=0 tx=0).stop 2024-08-31T06:18:35.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.016+0000 7fbac54a0740 1 -- 172.21.15.53:0/886735404 shutdown_connections 2024-08-31T06:18:35.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.016+0000 7fbac54a0740 1 --2- 172.21.15.53:0/886735404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f0031070 0x5559f03ee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.016+0000 7fbac54a0740 1 --2- 172.21.15.53:0/886735404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f0010390 0x5559f03edc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.016+0000 7fbac54a0740 1 --2- 172.21.15.53:0/886735404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f00081b0 0x5559f03d9ad0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.016+0000 7fbac54a0740 1 -- 172.21.15.53:0/886735404 >> 172.21.15.53:0/886735404 conn(0x5559f0025460 msgr2=0x5559f03d93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:35.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.016+0000 7fbac54a0740 1 -- 172.21.15.53:0/886735404 shutdown_connections 2024-08-31T06:18:35.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.016+0000 7fbac54a0740 1 -- 172.21.15.53:0/886735404 wait complete. 2024-08-31T06:18:35.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.017+0000 7fbac54a0740 1 -- start start 2024-08-31T06:18:35.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.017+0000 7fbac54a0740 1 Processor -- start 2024-08-31T06:18:35.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f00081b0 0x5559f03ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f0010390 0x5559f03e5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbac54a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0031070 0x5559f03e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbac54a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbab81bfa30 con 0x5559f0031070 2024-08-31T06:18:35.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbac54a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbab81bf2a0 con 0x5559f00081b0 2024-08-31T06:18:35.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbac54a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbab81bc440 con 0x5559f0010390 2024-08-31T06:18:35.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbac54a0740 10 client.0 _ll_register_callbacks cb 0x7fbab0009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbabd4c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0031070 0x5559f03e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbabccc7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f00081b0 0x5559f03ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbabccc7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f00081b0 0x5559f03ea6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51610/0 (socket says 172.21.15.53:51610) 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbabccc7640 1 -- 172.21.15.53:0/2855088992 learned_addr learned my addr 172.21.15.53:0/2855088992 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbab7fff640 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f0010390 0x5559f03e5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbabccc7640 1 -- 172.21.15.53:0/2855088992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f0010390 msgr2=0x5559f03e5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbabccc7640 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f0010390 0x5559f03e5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbabccc7640 1 -- 172.21.15.53:0/2855088992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0031070 msgr2=0x5559f03e62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbabccc7640 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0031070 0x5559f03e62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.018+0000 7fbabccc7640 1 -- 172.21.15.53:0/2855088992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559f045d850 con 0x5559f00081b0 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.019+0000 7fbabccc7640 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f00081b0 0x5559f03ea6f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbaac005ab0 tx=0x7fbaac005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29460e3247845e16 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:35.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.019+0000 7fba97fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:18:35.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.019+0000 7fba97fff640 1 -- 172.21.15.53:0/2855088992 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac035070 con 0x5559f00081b0 2024-08-31T06:18:35.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.019+0000 7fbac54a0740 1 -- 172.21.15.53:0/2855088992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5559f034f580 con 0x5559f00081b0 2024-08-31T06:18:35.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.019+0000 7fba97fff640 1 -- 172.21.15.53:0/2855088992 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fbaac004030 con 0x5559f00081b0 2024-08-31T06:18:35.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.019+0000 7fba97fff640 1 -- 172.21.15.53:0/2855088992 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fbaac049050 con 0x5559f00081b0 2024-08-31T06:18:35.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.019+0000 7fbac54a0740 10 client.28895 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:35.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.019+0000 7fbac54a0740 1 -- 172.21.15.53:0/2855088992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5559f045e9b0 con 0x5559f00081b0 2024-08-31T06:18:35.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.020+0000 7fba97fff640 1 -- 172.21.15.53:0/2855088992 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5559f034f580 con 0x5559f00081b0 2024-08-31T06:18:35.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.020+0000 7fba97fff640 1 -- 172.21.15.53:0/2855088992 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fbaac03a040 con 0x5559f00081b0 2024-08-31T06:18:35.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.021+0000 7fbac54a0740 10 client.28895 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:35.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.021+0000 7fbac54a0740 10 client.28895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:35.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.021+0000 7fbac54a0740 20 client.28895 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:35.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.021+0000 7fbac54a0740 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5559effc4da0 0x5559f0461290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.021+0000 7fbac54a0740 4 client.28895 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:18:35.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.021+0000 7fbac54a0740 1 -- 172.21.15.53:0/2855088992 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5559f034b020 con 0x5559effc4da0 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.021+0000 7fbab7fff640 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5559effc4da0 0x5559f0461290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.021+0000 7fba97fff640 10 client.28895 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.021+0000 7fbab7fff640 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5559effc4da0 0x5559f0461290 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42cd56e362d291bc server_cookie=f2f07fb84ae4202a in_seq=0 out_seq=0 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fba97fff640 1 -- 172.21.15.53:0/2855088992 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5398 (crc 0 0 0) 0x5559f034b020 con 0x5559effc4da0 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fba97fff640 10 client.28895 handle_command_reply: tid=0 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 1 client.28895 shutdown 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 1 -- 172.21.15.53:0/2855088992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f00081b0 msgr2=0x5559f03ea6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f00081b0 0x5559f03ea6f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbaac005ab0 tx=0x7fbaac005740 comp rx=0 tx=0).stop 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 1 -- 172.21.15.53:0/2855088992 shutdown_connections 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5559effc4da0 0x5559f0461290 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559f0031070 0x5559f03e62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5559f0010390 0x5559f03e5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 1 --2- 172.21.15.53:0/2855088992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5559f00081b0 0x5559f03ea6f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 1 -- 172.21.15.53:0/2855088992 >> 172.21.15.53:0/2855088992 conn(0x5559f0025460 msgr2=0x5559f03e2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:35.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fba97fff640 0 client.28895 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:35.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 1 -- 172.21.15.53:0/2855088992 shutdown_connections 2024-08-31T06:18:35.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 1 -- 172.21.15.53:0/2855088992 wait complete. 2024-08-31T06:18:35.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.022+0000 7fbac54a0740 20 client.28895 trim_cache size 0 max 16384 2024-08-31T06:18:35.028 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:18:35.028 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:18:35.028 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:18:35.028 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "a849b420-52ce-457c-9b7e-01903fe0dfa3", 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.029 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:18:35.030 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.032 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:18:35.033 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.035 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:18:35.035 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:18:35.035 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.035 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.035 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.035 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.035 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.035 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:18:35.035 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.036 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:18:35.037 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.038 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.039 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:35.040 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:18:35.040 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:18:35.040 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:18:35.040 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:18:35.040 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:18:35.040 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:18:35.040 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:18:35.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:35.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:35.040 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:18:35.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.023+0000 7fbabef2b640 1 -- 172.21.15.53:0/1086968592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaa80b4d20 msgr2=0x7fbaa80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.024+0000 7fbabef2b640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaa80b4d20 0x7fbaa80b7230 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbab00099a0 tx=0x7fbab0009500 comp rx=0 tx=0).stop 2024-08-31T06:18:35.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.024+0000 7fbabef2b640 1 -- 172.21.15.53:0/1086968592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8108150 msgr2=0x7fbab8198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.024+0000 7fbabef2b640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8108150 0x7fbab8198730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400e9c0 tx=0x7fbaa400ee80 comp rx=0 tx=0).stop 2024-08-31T06:18:35.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.024+0000 7fbabef2b640 1 -- 172.21.15.53:0/1086968592 shutdown_connections 2024-08-31T06:18:35.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.024+0000 7fbabef2b640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbaa80b4d20 0x7fbaa80b7230 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.024+0000 7fbabef2b640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab8108aa0 0x7fbab819d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.024+0000 7fbabef2b640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab8108150 0x7fbab8198730 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.024+0000 7fbabef2b640 1 --2- 172.21.15.53:0/1086968592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbab8102810 0x7fbab81981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.024+0000 7fbabef2b640 1 -- 172.21.15.53:0/1086968592 >> 172.21.15.53:0/1086968592 conn(0x7fbab80794d0 msgr2=0x7fbab806b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:35.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.024+0000 7fbabef2b640 1 -- 172.21.15.53:0/1086968592 shutdown_connections 2024-08-31T06:18:35.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:35.024+0000 7fbabef2b640 1 -- 172.21.15.53:0/1086968592 wait complete. 2024-08-31T06:18:35.042 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:34 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2129839893' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:18:35.045 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:18:35.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:34 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2129839893' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:18:35.355 INFO:tasks.workunit.client.0.smithi053.stdout: 10 3973 17.26 MB/sec warmup 23 sec latency 81.405 ms 2024-08-31T06:18:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.432+0000 7f8c8a894640 1 -- 172.21.15.53:0/557930033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c841089f0 msgr2=0x7f8c8410f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.432+0000 7f8c8a894640 1 --2- 172.21.15.53:0/557930033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c841089f0 0x7f8c8410f220 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00bd70 tx=0x7f8c7c02c430 comp rx=0 tx=0).stop 2024-08-31T06:18:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.432+0000 7f8c8a894640 1 -- 172.21.15.53:0/557930033 shutdown_connections 2024-08-31T06:18:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.432+0000 7f8c8a894640 1 --2- 172.21.15.53:0/557930033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c841089f0 0x7f8c8410f220 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.432+0000 7f8c8a894640 1 --2- 172.21.15.53:0/557930033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c841080a0 0x7f8c841084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.432+0000 7f8c8a894640 1 --2- 172.21.15.53:0/557930033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c84102770 0x7f8c84102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.432+0000 7f8c8a894640 1 -- 172.21.15.53:0/557930033 >> 172.21.15.53:0/557930033 conn(0x7f8c8407a490 msgr2=0x7f8c8407a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.432+0000 7f8c8a894640 1 -- 172.21.15.53:0/557930033 shutdown_connections 2024-08-31T06:18:35.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.432+0000 7f8c8a894640 1 -- 172.21.15.53:0/557930033 wait complete. 2024-08-31T06:18:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.433+0000 7f8c8a894640 1 Processor -- start 2024-08-31T06:18:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.433+0000 7f8c8a894640 1 -- start start 2024-08-31T06:18:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c8a894640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c84102770 0x7f8c84197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c8a894640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c841080a0 0x7f8c84198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c8a894640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c841089f0 0x7f8c8419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c8a894640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84111460 con 0x7f8c84102770 2024-08-31T06:18:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c8a894640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841112e0 con 0x7f8c841080a0 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c8a894640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841115e0 con 0x7f8c841089f0 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c837fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c841080a0 0x7f8c84198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c84102770 0x7f8c84197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c837fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c841080a0 0x7f8c84198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51628/0 (socket says 172.21.15.53:51628) 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c837fe640 1 -- 172.21.15.53:0/3273583990 learned_addr learned my addr 172.21.15.53:0/3273583990 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c88e31640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c841089f0 0x7f8c8419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c837fe640 1 -- 172.21.15.53:0/3273583990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c841089f0 msgr2=0x7f8c8419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c837fe640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c841089f0 0x7f8c8419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c837fe640 1 -- 172.21.15.53:0/3273583990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c84102770 msgr2=0x7f8c84197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c837fe640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c84102770 0x7f8c84197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c837fe640 1 -- 172.21.15.53:0/3273583990 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8419ddb0 con 0x7f8c841080a0 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.434+0000 7f8c83fff640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c84102770 0x7f8c84197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.435+0000 7f8c837fe640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c841080a0 0x7f8c84198420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800e9f0 tx=0x7f8c7800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.435+0000 7f8c817fa640 1 -- 172.21.15.53:0/3273583990 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800ccc0 con 0x7f8c841080a0 2024-08-31T06:18:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.435+0000 7f8c8a894640 1 -- 172.21.15.53:0/3273583990 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8419e0a0 con 0x7f8c841080a0 2024-08-31T06:18:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.435+0000 7f8c8a894640 1 -- 172.21.15.53:0/3273583990 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c841a4830 con 0x7f8c841080a0 2024-08-31T06:18:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.435+0000 7f8c817fa640 1 -- 172.21.15.53:0/3273583990 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c780108c0 con 0x7f8c841080a0 2024-08-31T06:18:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.435+0000 7f8c817fa640 1 -- 172.21.15.53:0/3273583990 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78018660 con 0x7f8c841080a0 2024-08-31T06:18:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.438+0000 7f8c91804740 1 Processor -- start 2024-08-31T06:18:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.438+0000 7f8c91804740 1 -- start start 2024-08-31T06:18:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.438+0000 7f8c817fa640 1 -- 172.21.15.53:0/3273583990 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8c78018920 con 0x7f8c841080a0 2024-08-31T06:18:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.438+0000 7f8c91804740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86e81b0 0x55a5b8a900f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.438+0000 7f8c91804740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a90630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.438+0000 7f8c91804740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86c74d0 0x55a5b8a90b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.438+0000 7f8c91804740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a5b8a01000 con 0x55a5b86e81b0 2024-08-31T06:18:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.438+0000 7f8c91804740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a5b89f0590 con 0x55a5b86c74d0 2024-08-31T06:18:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.438+0000 7f8c91804740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a5b89f4540 con 0x55a5b86bf2f0 2024-08-31T06:18:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c837fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86c74d0 0x55a5b8a90b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c837fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86c74d0 0x55a5b8a90b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51638/0 (socket says 172.21.15.53:51638) 2024-08-31T06:18:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c837fe640 1 -- 172.21.15.53:0/778790199 learned_addr learned my addr 172.21.15.53:0/778790199 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c88e31640 1 --2- 172.21.15.53:0/778790199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86e81b0 0x55a5b8a900f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c83fff640 1 --2- 172.21.15.53:0/778790199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a90630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c837fe640 1 -- 172.21.15.53:0/778790199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86bf2f0 msgr2=0x55a5b8a90630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c837fe640 1 --2- 172.21.15.53:0/778790199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a90630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c817fa640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c6c0b4d20 0x7f8c6c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c837fe640 1 -- 172.21.15.53:0/778790199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86e81b0 msgr2=0x55a5b8a900f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c837fe640 1 --2- 172.21.15.53:0/778790199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86e81b0 0x55a5b8a900f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c837fe640 1 -- 172.21.15.53:0/778790199 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5b8753790 con 0x55a5b86c74d0 2024-08-31T06:18:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c83fff640 1 --2- 172.21.15.53:0/778790199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a90630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.439+0000 7f8c88e31640 1 --2- 172.21.15.53:0/778790199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86e81b0 0x55a5b8a900f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.440+0000 7f8c817fa640 1 -- 172.21.15.53:0/3273583990 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f8c780e5700 con 0x7f8c841080a0 2024-08-31T06:18:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.440+0000 7f8c88e31640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c6c0b4d20 0x7f8c6c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.440+0000 7f8c837fe640 1 --2- 172.21.15.53:0/778790199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86c74d0 0x55a5b8a90b70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8c780e2d70 tx=0x7f8c780a8590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfb3e827b9d10984 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.440+0000 7f8c6a7fc640 1 -- 172.21.15.53:0/778790199 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78026030 con 0x55a5b86c74d0 2024-08-31T06:18:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.440+0000 7f8c6a7fc640 1 -- 172.21.15.53:0/778790199 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c780ab990 con 0x55a5b86c74d0 2024-08-31T06:18:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.440+0000 7f8c6a7fc640 1 -- 172.21.15.53:0/778790199 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c780ab7d0 con 0x55a5b86c74d0 2024-08-31T06:18:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.441+0000 7f8c91804740 1 -- 172.21.15.53:0/778790199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86c74d0 msgr2=0x55a5b8a90b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.441+0000 7f8c91804740 1 --2- 172.21.15.53:0/778790199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86c74d0 0x55a5b8a90b70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8c780e2d70 tx=0x7f8c780a8590 comp rx=0 tx=0).stop 2024-08-31T06:18:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.441+0000 7f8c88e31640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c6c0b4d20 0x7f8c6c0b7230 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c02c950 tx=0x7f8c7c00b710 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.441+0000 7f8c91804740 1 -- 172.21.15.53:0/778790199 shutdown_connections 2024-08-31T06:18:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.441+0000 7f8c91804740 1 --2- 172.21.15.53:0/778790199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86c74d0 0x55a5b8a90b70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.441+0000 7f8c91804740 1 --2- 172.21.15.53:0/778790199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a90630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.441+0000 7f8c91804740 1 --2- 172.21.15.53:0/778790199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86e81b0 0x55a5b8a900f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.441+0000 7f8c91804740 1 -- 172.21.15.53:0/778790199 >> 172.21.15.53:0/778790199 conn(0x55a5b86dc300 msgr2=0x55a5b8a8dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.441+0000 7f8c91804740 1 -- 172.21.15.53:0/778790199 shutdown_connections 2024-08-31T06:18:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.441+0000 7f8c91804740 1 -- 172.21.15.53:0/778790199 wait complete. 2024-08-31T06:18:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.442+0000 7f8c91804740 1 -- start start 2024-08-31T06:18:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.442+0000 7f8c91804740 1 Processor -- start 2024-08-31T06:18:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.442+0000 7f8c91804740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a9bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.442+0000 7f8c91804740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 0x55a5b8a9c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.442+0000 7f8c91804740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86e81b0 0x55a5b8aa7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c91804740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a5b8929ab0 con 0x55a5b86bf2f0 2024-08-31T06:18:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a9bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a9bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46506/0 (socket says 172.21.15.53:46506) 2024-08-31T06:18:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c83fff640 1 -- 172.21.15.53:0/3611371339 learned_addr learned my addr 172.21.15.53:0/3611371339 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c91804740 1 -- 172.21.15.53:0/3611371339 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a5b8977680 con 0x55a5b86e81b0 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c91804740 1 -- 172.21.15.53:0/3611371339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a5b8a9e870 con 0x55a5b86c74d0 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c837fe640 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 0x55a5b8a9c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c88e31640 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86e81b0 0x55a5b8aa7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c91804740 10 client.0 _ll_register_callbacks cb 0x55a5b86ffa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c83fff640 1 -- 172.21.15.53:0/3611371339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 msgr2=0x55a5b8a9c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c83fff640 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 0x55a5b8a9c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c83fff640 1 -- 172.21.15.53:0/3611371339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86e81b0 msgr2=0x55a5b8aa7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c83fff640 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86e81b0 0x55a5b8aa7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c83fff640 1 -- 172.21.15.53:0/3611371339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5b87cc620 con 0x55a5b86bf2f0 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c88e31640 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86e81b0 0x55a5b8aa7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c837fe640 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 0x55a5b8a9c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c83fff640 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a9bc70 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f8c74012d20 tx=0x7f8c7400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3024acc8af7f93 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.443+0000 7f8c637fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.444+0000 7f8c637fe640 1 -- 172.21.15.53:0/3611371339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c740120d0 con 0x55a5b86bf2f0 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.444+0000 7f8c637fe640 1 -- 172.21.15.53:0/3611371339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f8c740047a0 con 0x55a5b86bf2f0 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.444+0000 7f8c91804740 1 -- 172.21.15.53:0/3611371339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c780ab990 con 0x55a5b86bf2f0 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.444+0000 7f8c637fe640 1 -- 172.21.15.53:0/3611371339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f8c74012270 con 0x55a5b86bf2f0 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.444+0000 7f8c91804740 10 client.19911 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.444+0000 7f8c91804740 1 -- 172.21.15.53:0/3611371339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55a5b8aaa920 con 0x55a5b86bf2f0 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.444+0000 7f8c637fe640 1 -- 172.21.15.53:0/3611371339 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c780ab990 con 0x55a5b86bf2f0 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.445+0000 7f8c637fe640 1 -- 172.21.15.53:0/3611371339 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f8c74010630 con 0x55a5b86bf2f0 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.445+0000 7f8c91804740 10 client.19911 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.445+0000 7f8c91804740 10 client.19911 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.445+0000 7f8c91804740 20 client.19911 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.445+0000 7f8c91804740 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5b86a6d80 0x55a5b8aadf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.445+0000 7f8c91804740 4 client.19911 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.445+0000 7f8c91804740 1 -- 172.21.15.53:0/3611371339 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5b8a02f50 con 0x55a5b86a6d80 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.445+0000 7f8c837fe640 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5b86a6d80 0x55a5b8aadf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.445+0000 7f8c637fe640 10 client.19911 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.446+0000 7f8c837fe640 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5b86a6d80 0x55a5b8aadf80 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=464d0ababec3d81e server_cookie=f63dd0adcfab2b04 in_seq=0 out_seq=0 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.446+0000 7f8c637fe640 1 -- 172.21.15.53:0/3611371339 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a5b8a02f50 con 0x55a5b86a6d80 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.446+0000 7f8c637fe640 10 client.19911 handle_command_reply: tid=0 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.446+0000 7f8c91804740 1 client.19911 shutdown 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c91804740 1 -- 172.21.15.53:0/3611371339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 msgr2=0x55a5b8a9bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c91804740 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a9bc70 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f8c74012d20 tx=0x7f8c7400f790 comp rx=0 tx=0).stop 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c91804740 1 -- 172.21.15.53:0/3611371339 shutdown_connections 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c91804740 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5b86a6d80 0x55a5b8aadf80 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c91804740 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86e81b0 0x55a5b8aa7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c91804740 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 0x55a5b8a9c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c637fe640 0 client.19911 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c91804740 1 --2- 172.21.15.53:0/3611371339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a9bc70 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c91804740 1 -- 172.21.15.53:0/3611371339 >> 172.21.15.53:0/3611371339 conn(0x55a5b86dc300 msgr2=0x55a5b8a91120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c91804740 1 -- 172.21.15.53:0/3611371339 shutdown_connections 2024-08-31T06:18:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c91804740 1 -- 172.21.15.53:0/3611371339 wait complete. 2024-08-31T06:18:35.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.447+0000 7f8c91804740 20 client.19911 trim_cache size 0 max 16384 2024-08-31T06:18:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.473+0000 7f8c91804740 1 Processor -- start 2024-08-31T06:18:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c91804740 1 -- start start 2024-08-31T06:18:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c91804740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86a6d80 0x55a5b8a91830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c91804740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c91804740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86c74d0 0x55a5b8a9bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c91804740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7000e8c0 con 0x55a5b86c74d0 2024-08-31T06:18:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c91804740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8c70010640 con 0x55a5b86bf2f0 2024-08-31T06:18:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c91804740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7000ef90 con 0x55a5b86a6d80 2024-08-31T06:18:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c88e31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86c74d0 0x55a5b8a9bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c837fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c88e31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86c74d0 0x55a5b8a9bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46510/0 (socket says 172.21.15.53:46510) 2024-08-31T06:18:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c88e31640 1 -- 172.21.15.53:0/2370262963 learned_addr learned my addr 172.21.15.53:0/2370262963 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.474+0000 7f8c83fff640 1 --2- 172.21.15.53:0/2370262963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86a6d80 0x55a5b8a91830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.475+0000 7f8c88e31640 1 -- 172.21.15.53:0/2370262963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86a6d80 msgr2=0x55a5b8a91830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.475+0000 7f8c88e31640 1 --2- 172.21.15.53:0/2370262963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86a6d80 0x55a5b8a91830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.475+0000 7f8c88e31640 1 -- 172.21.15.53:0/2370262963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86bf2f0 msgr2=0x55a5b8a961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.475+0000 7f8c88e31640 1 --2- 172.21.15.53:0/2370262963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.475+0000 7f8c88e31640 1 -- 172.21.15.53:0/2370262963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5b8a9e1a0 con 0x55a5b86c74d0 2024-08-31T06:18:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.475+0000 7f8c837fe640 1 --2- 172.21.15.53:0/2370262963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.475+0000 7f8c88e31640 1 --2- 172.21.15.53:0/2370262963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86c74d0 0x55a5b8a9bf40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00bd70 tx=0x7f8c7c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b904cf0cf17fbc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.475+0000 7f8c69ffb640 1 -- 172.21.15.53:0/2370262963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c038040 con 0x55a5b86c74d0 2024-08-31T06:18:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.475+0000 7f8c69ffb640 1 -- 172.21.15.53:0/2370262963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c7c040440 con 0x55a5b86c74d0 2024-08-31T06:18:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.475+0000 7f8c69ffb640 1 -- 172.21.15.53:0/2370262963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c04b680 con 0x55a5b86c74d0 2024-08-31T06:18:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.476+0000 7f8c91804740 1 -- 172.21.15.53:0/2370262963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86c74d0 msgr2=0x55a5b8a9bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.476+0000 7f8c91804740 1 --2- 172.21.15.53:0/2370262963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86c74d0 0x55a5b8a9bf40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00bd70 tx=0x7f8c7c041000 comp rx=0 tx=0).stop 2024-08-31T06:18:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.476+0000 7f8c91804740 1 -- 172.21.15.53:0/2370262963 shutdown_connections 2024-08-31T06:18:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.476+0000 7f8c91804740 1 --2- 172.21.15.53:0/2370262963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86c74d0 0x55a5b8a9bf40 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.476+0000 7f8c91804740 1 --2- 172.21.15.53:0/2370262963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.477+0000 7f8c91804740 1 --2- 172.21.15.53:0/2370262963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86a6d80 0x55a5b8a91830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.477+0000 7f8c91804740 1 -- 172.21.15.53:0/2370262963 >> 172.21.15.53:0/2370262963 conn(0x55a5b86dc300 msgr2=0x55a5b8a91120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.477+0000 7f8c91804740 1 -- 172.21.15.53:0/2370262963 shutdown_connections 2024-08-31T06:18:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.477+0000 7f8c91804740 1 -- 172.21.15.53:0/2370262963 wait complete. 2024-08-31T06:18:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.477+0000 7f8c91804740 1 -- start start 2024-08-31T06:18:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.477+0000 7f8c91804740 1 Processor -- start 2024-08-31T06:18:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c91804740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86a6d80 0x55a5b8a8a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c91804740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a8ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c91804740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 0x55a5b8a8b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c83fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86a6d80 0x55a5b8a8a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c83fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86a6d80 0x55a5b8a8a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51670/0 (socket says 172.21.15.53:51670) 2024-08-31T06:18:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c91804740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7000feb0 con 0x55a5b86bf2f0 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c83fff640 1 -- 172.21.15.53:0/2767066825 learned_addr learned my addr 172.21.15.53:0/2767066825 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c91804740 1 -- 172.21.15.53:0/2767066825 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7000f720 con 0x55a5b86a6d80 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c91804740 1 -- 172.21.15.53:0/2767066825 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7000c8c0 con 0x55a5b86c74d0 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c91804740 10 client.0 _ll_register_callbacks cb 0x7f8c74009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c837fe640 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a8ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.478+0000 7f8c88e31640 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 0x55a5b8a8b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c83fff640 1 -- 172.21.15.53:0/2767066825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 msgr2=0x55a5b8a8b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c83fff640 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 0x55a5b8a8b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c83fff640 1 -- 172.21.15.53:0/2767066825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 msgr2=0x55a5b8a8ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c83fff640 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a8ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c83fff640 1 -- 172.21.15.53:0/2767066825 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5b8aa2cc0 con 0x55a5b86a6d80 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c88e31640 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 0x55a5b8a8b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c83fff640 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86a6d80 0x55a5b8a8a8a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c74012cf0 tx=0x7f8c740129e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce5c1f4b4aa8127d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c637fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c637fe640 1 -- 172.21.15.53:0/2767066825 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74005d10 con 0x55a5b86a6d80 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c91804740 1 -- 172.21.15.53:0/2767066825 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c7c040440 con 0x55a5b86a6d80 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c637fe640 1 -- 172.21.15.53:0/2767066825 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f8c74010640 con 0x55a5b86a6d80 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.479+0000 7f8c637fe640 1 -- 172.21.15.53:0/2767066825 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f8c74004020 con 0x55a5b86a6d80 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.480+0000 7f8c91804740 10 client.28913 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.480+0000 7f8c91804740 1 -- 172.21.15.53:0/2767066825 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55a5b8aa3f60 con 0x55a5b86a6d80 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.480+0000 7f8c637fe640 1 -- 172.21.15.53:0/2767066825 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c7c040440 con 0x55a5b86a6d80 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.480+0000 7f8c637fe640 1 -- 172.21.15.53:0/2767066825 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f8c74003c80 con 0x55a5b86a6d80 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.480+0000 7f8c91804740 10 client.28913 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.480+0000 7f8c91804740 10 client.28913 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.480+0000 7f8c91804740 20 client.28913 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.480+0000 7f8c91804740 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5b86e81b0 0x55a5b8b1f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.480+0000 7f8c91804740 4 client.28913 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:18:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.480+0000 7f8c91804740 1 -- 172.21.15.53:0/2767066825 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a5b89fe9f0 con 0x55a5b86e81b0 2024-08-31T06:18:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.480+0000 7f8c837fe640 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5b86e81b0 0x55a5b8b1f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.481+0000 7f8c637fe640 10 client.28913 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.481+0000 7f8c837fe640 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5b86e81b0 0x55a5b8b1f180 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ed13e403b58ca79 server_cookie=bcfeb78ef9920b63 in_seq=0 out_seq=0 2024-08-31T06:18:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c637fe640 1 -- 172.21.15.53:0/2767066825 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a5b89fe9f0 con 0x55a5b86e81b0 2024-08-31T06:18:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c637fe640 10 client.28913 handle_command_reply: tid=0 2024-08-31T06:18:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 1 client.28913 shutdown 2024-08-31T06:18:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 1 -- 172.21.15.53:0/2767066825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86a6d80 msgr2=0x55a5b8a8a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86a6d80 0x55a5b8a8a8a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c74012cf0 tx=0x7f8c740129e0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 1 -- 172.21.15.53:0/2767066825 shutdown_connections 2024-08-31T06:18:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5b86e81b0 0x55a5b8b1f180 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5b86c74d0 0x55a5b8a8b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5b86bf2f0 0x55a5b8a8ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c637fe640 0 client.28913 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 1 --2- 172.21.15.53:0/2767066825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5b86a6d80 0x55a5b8a8a8a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 1 -- 172.21.15.53:0/2767066825 >> 172.21.15.53:0/2767066825 conn(0x55a5b86dc300 msgr2=0x55a5b8a9cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 1 -- 172.21.15.53:0/2767066825 shutdown_connections 2024-08-31T06:18:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 1 -- 172.21.15.53:0/2767066825 wait complete. 2024-08-31T06:18:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.518+0000 7f8c91804740 20 client.28913 trim_cache size 0 max 16384 2024-08-31T06:18:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:18:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:18:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:18:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:18:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 -- 172.21.15.53:0/3273583990 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c6c0b4d20 msgr2=0x7f8c6c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c6c0b4d20 0x7f8c6c0b7230 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c02c950 tx=0x7f8c7c00b710 comp rx=0 tx=0).stop 2024-08-31T06:18:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 -- 172.21.15.53:0/3273583990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c841080a0 msgr2=0x7f8c84198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c841080a0 0x7f8c84198420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800e9f0 tx=0x7f8c7800eeb0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 -- 172.21.15.53:0/3273583990 shutdown_connections 2024-08-31T06:18:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c6c0b4d20 0x7f8c6c0b7230 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c841089f0 0x7f8c8419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c841080a0 0x7f8c84198420 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 --2- 172.21.15.53:0/3273583990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c84102770 0x7f8c84197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 -- 172.21.15.53:0/3273583990 >> 172.21.15.53:0/3273583990 conn(0x7f8c8407a490 msgr2=0x7f8c84106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 -- 172.21.15.53:0/3273583990 shutdown_connections 2024-08-31T06:18:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:35.519+0000 7f8c8a894640 1 -- 172.21.15.53:0/3273583990 wait complete. 2024-08-31T06:18:35.784 INFO:tasks.cephfs.filesystem:scrub status for tag:a849b420-52ce-457c-9b7e-01903fe0dfa3 - {'path': '/', 'tag': 'a849b420-52ce-457c-9b7e-01903fe0dfa3', 'options': 'recursive,force'} 2024-08-31T06:18:35.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:35 smithi053 ceph-mon[18924]: pgmap v748: 97 pgs: 97 active+clean; 348 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 4.8 MiB/s wr, 263 op/s 2024-08-31T06:18:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:35 smithi130 ceph-mon[22266]: pgmap v748: 97 pgs: 97 active+clean; 348 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 4.8 MiB/s wr, 263 op/s 2024-08-31T06:18:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:35 smithi153 ceph-mon[22320]: pgmap v748: 97 pgs: 97 active+clean; 348 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 4.8 MiB/s wr, 263 op/s 2024-08-31T06:18:36.355 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4085 16.62 MB/sec warmup 24 sec latency 72.785 ms 2024-08-31T06:18:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.362+0000 7fa1130b7640 1 -- 172.21.15.53:0/1739677515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa10c108ab0 msgr2=0x7fa10c10f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.362+0000 7fa1130b7640 1 --2- 172.21.15.53:0/1739677515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa10c108ab0 0x7fa10c10f2e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa104009be0 tx=0x7fa10402a6c0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.363+0000 7fa1130b7640 1 -- 172.21.15.53:0/1739677515 shutdown_connections 2024-08-31T06:18:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.363+0000 7fa1130b7640 1 --2- 172.21.15.53:0/1739677515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa10c108ab0 0x7fa10c10f2e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.363+0000 7fa1130b7640 1 --2- 172.21.15.53:0/1739677515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c108160 0x7fa10c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.363+0000 7fa1130b7640 1 --2- 172.21.15.53:0/1739677515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa10c102820 0x7fa10c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.363+0000 7fa1130b7640 1 -- 172.21.15.53:0/1739677515 >> 172.21.15.53:0/1739677515 conn(0x7fa10c079500 msgr2=0x7fa10c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.363+0000 7fa1130b7640 1 -- 172.21.15.53:0/1739677515 shutdown_connections 2024-08-31T06:18:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.363+0000 7fa1130b7640 1 -- 172.21.15.53:0/1739677515 wait complete. 2024-08-31T06:18:36.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.363+0000 7fa1130b7640 1 Processor -- start 2024-08-31T06:18:36.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa1130b7640 1 -- start start 2024-08-31T06:18:36.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa1130b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa10c102820 0x7fa10c10cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa1130b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa10c108160 0x7fa10c1092b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa1130b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c108ab0 0x7fa10c1099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa1130b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c1125c0 con 0x7fa10c108ab0 2024-08-31T06:18:36.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa110e53640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa10c102820 0x7fa10c10cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa1130b7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c112440 con 0x7fa10c102820 2024-08-31T06:18:36.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa111654640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c108ab0 0x7fa10c1099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa10c108160 0x7fa10c1092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa1130b7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c112740 con 0x7fa10c108160 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa111654640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c108ab0 0x7fa10c1099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46536/0 (socket says 172.21.15.53:46536) 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa10c108160 0x7fa10c1092b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:39252/0 (socket says 172.21.15.53:39252) 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa110e53640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa10c102820 0x7fa10c10cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51682/0 (socket says 172.21.15.53:51682) 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa111654640 1 -- 172.21.15.53:0/2083518236 learned_addr learned my addr 172.21.15.53:0/2083518236 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa111654640 1 -- 172.21.15.53:0/2083518236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa10c108160 msgr2=0x7fa10c1092b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa111654640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa10c108160 0x7fa10c1092b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa111654640 1 -- 172.21.15.53:0/2083518236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa10c102820 msgr2=0x7fa10c10cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.364+0000 7fa111654640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa10c102820 0x7fa10c10cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.365+0000 7fa111654640 1 -- 172.21.15.53:0/2083518236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c1ac890 con 0x7fa10c108ab0 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.365+0000 7fa111654640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c108ab0 0x7fa10c1099d0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fa104004af0 tx=0x7fa104030b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.365+0000 7fa109ffb640 1 -- 172.21.15.53:0/2083518236 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104041020 con 0x7fa10c108ab0 2024-08-31T06:18:36.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.365+0000 7fa1130b7640 1 -- 172.21.15.53:0/2083518236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10c1aca60 con 0x7fa10c108ab0 2024-08-31T06:18:36.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.365+0000 7fa109ffb640 1 -- 172.21.15.53:0/2083518236 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa104037040 con 0x7fa10c108ab0 2024-08-31T06:18:36.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.365+0000 7fa109ffb640 1 -- 172.21.15.53:0/2083518236 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104036070 con 0x7fa10c108ab0 2024-08-31T06:18:36.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.365+0000 7fa1130b7640 1 -- 172.21.15.53:0/2083518236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10c1acee0 con 0x7fa10c108ab0 2024-08-31T06:18:36.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.369+0000 7fa11962c740 1 Processor -- start 2024-08-31T06:18:36.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.369+0000 7fa109ffb640 1 -- 172.21.15.53:0/2083518236 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa104044020 con 0x7fa10c108ab0 2024-08-31T06:18:36.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.369+0000 7fa11962c740 1 -- start start 2024-08-31T06:18:36.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.369+0000 7fa11962c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf3994840 0x55abf3d3bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.369+0000 7fa11962c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf396b980 0x55abf3d3c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.369+0000 7fa11962c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d3c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.369+0000 7fa11962c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55abf3cb0330 con 0x55abf396b980 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.369+0000 7fa11962c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55abf3c9f8c0 con 0x55abf3973b60 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.369+0000 7fa11962c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55abf3ca3870 con 0x55abf3994840 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf3994840 0x55abf3d3bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d3c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa110e53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf396b980 0x55abf3d3c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d3c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51688/0 (socket says 172.21.15.53:51688) 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa110e53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf396b980 0x55abf3d3c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46546/0 (socket says 172.21.15.53:46546) 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa10bfff640 1 -- 172.21.15.53:0/2055648866 learned_addr learned my addr 172.21.15.53:0/2055648866 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa10bfff640 1 -- 172.21.15.53:0/2055648866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf3994840 msgr2=0x55abf3d3bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa10bfff640 1 --2- 172.21.15.53:0/2055648866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf3994840 0x55abf3d3bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa10bfff640 1 -- 172.21.15.53:0/2055648866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf396b980 msgr2=0x55abf3d3c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa10bfff640 1 --2- 172.21.15.53:0/2055648866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf396b980 0x55abf3d3c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa10bfff640 1 -- 172.21.15.53:0/2055648866 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abf3c57df0 con 0x55abf3973b60 2024-08-31T06:18:36.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa109ffb640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0fc0b4d20 0x7fa0fc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa109ffb640 1 -- 172.21.15.53:0/2083518236 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fa104105860 con 0x7fa10c108ab0 2024-08-31T06:18:36.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.370+0000 7fa10bfff640 1 --2- 172.21.15.53:0/2055648866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d3c710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8013740 tx=0x7fa0f8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5e05d79e2b4419c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.371+0000 7fa10bfff640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0fc0b4d20 0x7fa0fc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.371+0000 7fa0f6ffd640 1 -- 172.21.15.53:0/2055648866 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8013110 con 0x55abf3973b60 2024-08-31T06:18:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.371+0000 7fa0f6ffd640 1 -- 172.21.15.53:0/2055648866 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f80132b0 con 0x55abf3973b60 2024-08-31T06:18:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.371+0000 7fa0f6ffd640 1 -- 172.21.15.53:0/2055648866 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8020bb0 con 0x55abf3973b60 2024-08-31T06:18:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.372+0000 7fa11962c740 1 -- 172.21.15.53:0/2055648866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 msgr2=0x55abf3d3c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.372+0000 7fa10bfff640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0fc0b4d20 0x7fa0fc0b7230 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa0f801d000 tx=0x7fa0f8020e30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.372+0000 7fa11962c740 1 --2- 172.21.15.53:0/2055648866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d3c710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8013740 tx=0x7fa0f8004730 comp rx=0 tx=0).stop 2024-08-31T06:18:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.372+0000 7fa11962c740 1 -- 172.21.15.53:0/2055648866 shutdown_connections 2024-08-31T06:18:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.372+0000 7fa11962c740 1 --2- 172.21.15.53:0/2055648866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d3c710 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.372+0000 7fa11962c740 1 --2- 172.21.15.53:0/2055648866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf396b980 0x55abf3d3c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.372+0000 7fa11962c740 1 --2- 172.21.15.53:0/2055648866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf3994840 0x55abf3d3bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.372+0000 7fa11962c740 1 -- 172.21.15.53:0/2055648866 >> 172.21.15.53:0/2055648866 conn(0x55abf3988990 msgr2=0x55abf3d39b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.372+0000 7fa11962c740 1 -- 172.21.15.53:0/2055648866 shutdown_connections 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.372+0000 7fa11962c740 1 -- 172.21.15.53:0/2055648866 wait complete. 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.372+0000 7fa11962c740 1 -- start start 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.373+0000 7fa11962c740 1 Processor -- start 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.373+0000 7fa11962c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf396b980 0x55abf3d47470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.373+0000 7fa11962c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d479d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.373+0000 7fa11962c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3994840 0x55abf3d53760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.373+0000 7fa11962c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55abf3b027a0 con 0x55abf3973b60 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.373+0000 7fa11962c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55abf3c26240 con 0x55abf3994840 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.373+0000 7fa11962c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55abf3d4a470 con 0x55abf396b980 2024-08-31T06:18:36.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.373+0000 7fa11962c740 10 client.0 _ll_register_callbacks cb 0x55abf39ac090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:36.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46556/0 (socket says 172.21.15.53:46556) 2024-08-31T06:18:36.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa10bfff640 1 -- 172.21.15.53:0/815409972 learned_addr learned my addr 172.21.15.53:0/815409972 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:36.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa111654640 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3994840 0x55abf3d53760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa10bfff640 1 -- 172.21.15.53:0/815409972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf396b980 msgr2=0x55abf3d47470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:36.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa10bfff640 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf396b980 0x55abf3d47470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa10bfff640 1 -- 172.21.15.53:0/815409972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3994840 msgr2=0x55abf3d53760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:36.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa10bfff640 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3994840 0x55abf3d53760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa10bfff640 1 -- 172.21.15.53:0/815409972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abf3c5c2b0 con 0x55abf3973b60 2024-08-31T06:18:36.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa10bfff640 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d479d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8006010 tx=0x7fa0f8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbaddd50b8924e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:36.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa0ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:18:36.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.374+0000 7fa0ebfff640 1 -- 172.21.15.53:0/815409972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8013110 con 0x55abf3973b60 2024-08-31T06:18:36.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.375+0000 7fa0ebfff640 1 -- 172.21.15.53:0/815409972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fa0f80107d0 con 0x55abf3973b60 2024-08-31T06:18:36.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.375+0000 7fa11962c740 1 -- 172.21.15.53:0/815409972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0f80132b0 con 0x55abf3973b60 2024-08-31T06:18:36.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.375+0000 7fa0ebfff640 1 -- 172.21.15.53:0/815409972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fa0f8009c30 con 0x55abf3973b60 2024-08-31T06:18:36.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.375+0000 7fa11962c740 10 client.19929 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:36.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.375+0000 7fa11962c740 1 -- 172.21.15.53:0/815409972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55abf3a0eb90 con 0x55abf3973b60 2024-08-31T06:18:36.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.375+0000 7fa0ebfff640 1 -- 172.21.15.53:0/815409972 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f802f070 con 0x55abf3973b60 2024-08-31T06:18:36.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.375+0000 7fa0ebfff640 1 -- 172.21.15.53:0/815409972 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fa0f8003680 con 0x55abf3973b60 2024-08-31T06:18:36.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.375+0000 7fa11962c740 10 client.19929 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:36.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.375+0000 7fa11962c740 10 client.19929 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:18:36.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.376+0000 7fa11962c740 20 client.19929 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:36.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.376+0000 7fa11962c740 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55abf39531c0 0x55abf3d59550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.376+0000 7fa11962c740 4 client.19929 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:36.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.376+0000 7fa11962c740 1 -- 172.21.15.53:0/815409972 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa0f80132b0 con 0x55abf39531c0 2024-08-31T06:18:36.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.376+0000 7fa110e53640 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55abf39531c0 0x55abf3d59550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.376+0000 7fa0ebfff640 10 client.19929 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:36.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.376+0000 7fa110e53640 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55abf39531c0 0x55abf3d59550 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fd4517b59142fb0 server_cookie=80239ca743770c41 in_seq=0 out_seq=0 2024-08-31T06:18:36.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.377+0000 7fa0ebfff640 1 -- 172.21.15.53:0/815409972 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa0f80132b0 con 0x55abf39531c0 2024-08-31T06:18:36.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.377+0000 7fa0ebfff640 10 client.19929 handle_command_reply: tid=0 2024-08-31T06:18:36.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.378+0000 7fa11962c740 1 client.19929 shutdown 2024-08-31T06:18:36.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.378+0000 7fa11962c740 1 -- 172.21.15.53:0/815409972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 msgr2=0x55abf3d479d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:36.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.378+0000 7fa11962c740 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d479d0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8006010 tx=0x7fa0f8013000 comp rx=0 tx=0).stop 2024-08-31T06:18:36.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.378+0000 7fa11962c740 1 -- 172.21.15.53:0/815409972 shutdown_connections 2024-08-31T06:18:36.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.378+0000 7fa11962c740 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55abf39531c0 0x55abf3d59550 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.378+0000 7fa11962c740 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3994840 0x55abf3d53760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.378+0000 7fa11962c740 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d479d0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.378+0000 7fa11962c740 1 --2- 172.21.15.53:0/815409972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf396b980 0x55abf3d47470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.378+0000 7fa11962c740 1 -- 172.21.15.53:0/815409972 >> 172.21.15.53:0/815409972 conn(0x55abf3988990 msgr2=0x55abf3d3ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:36.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.379+0000 7fa0ebfff640 0 client.19929 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:36.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.379+0000 7fa11962c740 1 -- 172.21.15.53:0/815409972 shutdown_connections 2024-08-31T06:18:36.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.379+0000 7fa11962c740 1 -- 172.21.15.53:0/815409972 wait complete. 2024-08-31T06:18:36.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.379+0000 7fa11962c740 20 client.19929 trim_cache size 0 max 16384 2024-08-31T06:18:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.403+0000 7fa11962c740 1 Processor -- start 2024-08-31T06:18:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.403+0000 7fa11962c740 1 -- start start 2024-08-31T06:18:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa11962c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf396b980 0x55abf3d3d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa11962c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d53660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa11962c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf3994840 0x55abf3d53ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa11962c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c1b5a20 con 0x55abf396b980 2024-08-31T06:18:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa11962c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c1b77a0 con 0x55abf3973b60 2024-08-31T06:18:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa11962c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c1b60f0 con 0x55abf3994840 2024-08-31T06:18:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d53660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d53660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51700/0 (socket says 172.21.15.53:51700) 2024-08-31T06:18:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa10bfff640 1 -- 172.21.15.53:0/1699161729 learned_addr learned my addr 172.21.15.53:0/1699161729 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa110e53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf396b980 0x55abf3d3d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa111654640 1 --2- 172.21.15.53:0/1699161729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf3994840 0x55abf3d53ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa10bfff640 1 -- 172.21.15.53:0/1699161729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf3994840 msgr2=0x55abf3d53ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa10bfff640 1 --2- 172.21.15.53:0/1699161729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf3994840 0x55abf3d53ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa10bfff640 1 -- 172.21.15.53:0/1699161729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf396b980 msgr2=0x55abf3d3d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa10bfff640 1 --2- 172.21.15.53:0/1699161729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf396b980 0x55abf3d3d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.404+0000 7fa10bfff640 1 -- 172.21.15.53:0/1699161729 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abf3c6fd90 con 0x55abf3973b60 2024-08-31T06:18:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.405+0000 7fa111654640 1 --2- 172.21.15.53:0/1699161729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf3994840 0x55abf3d53ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.405+0000 7fa10bfff640 1 --2- 172.21.15.53:0/1699161729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d53660 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80116b0 tx=0x7fa0f80092c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3858bba831ae354e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.405+0000 7fa0f67fc640 1 -- 172.21.15.53:0/1699161729 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8040070 con 0x55abf3973b60 2024-08-31T06:18:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.405+0000 7fa0f67fc640 1 -- 172.21.15.53:0/1699161729 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f802f040 con 0x55abf3973b60 2024-08-31T06:18:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.405+0000 7fa0f67fc640 1 -- 172.21.15.53:0/1699161729 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8010c30 con 0x55abf3973b60 2024-08-31T06:18:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.406+0000 7fa11962c740 1 -- 172.21.15.53:0/1699161729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 msgr2=0x55abf3d53660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.406+0000 7fa11962c740 1 --2- 172.21.15.53:0/1699161729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d53660 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80116b0 tx=0x7fa0f80092c0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.406+0000 7fa11962c740 1 -- 172.21.15.53:0/1699161729 shutdown_connections 2024-08-31T06:18:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.406+0000 7fa11962c740 1 --2- 172.21.15.53:0/1699161729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf3994840 0x55abf3d53ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.406+0000 7fa11962c740 1 --2- 172.21.15.53:0/1699161729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3973b60 0x55abf3d53660 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.406+0000 7fa11962c740 1 --2- 172.21.15.53:0/1699161729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf396b980 0x55abf3d3d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.406+0000 7fa11962c740 1 -- 172.21.15.53:0/1699161729 >> 172.21.15.53:0/1699161729 conn(0x55abf3988990 msgr2=0x55abf3d3ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.406+0000 7fa11962c740 1 -- 172.21.15.53:0/1699161729 shutdown_connections 2024-08-31T06:18:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.406+0000 7fa11962c740 1 -- 172.21.15.53:0/1699161729 wait complete. 2024-08-31T06:18:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.407+0000 7fa11962c740 1 -- start start 2024-08-31T06:18:36.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.407+0000 7fa11962c740 1 Processor -- start 2024-08-31T06:18:36.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.407+0000 7fa11962c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf396b980 0x55abf3d4f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.407+0000 7fa11962c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d4fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa11962c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3994840 0x55abf3d4a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d4fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d4fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46570/0 (socket says 172.21.15.53:46570) 2024-08-31T06:18:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa110e53640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf396b980 0x55abf3d4f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa10bfff640 1 -- 172.21.15.53:0/2036120657 learned_addr learned my addr 172.21.15.53:0/2036120657 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa11962c740 1 -- 172.21.15.53:0/2036120657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c1b7010 con 0x55abf3973b60 2024-08-31T06:18:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa11962c740 1 -- 172.21.15.53:0/2036120657 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c1b6880 con 0x55abf3994840 2024-08-31T06:18:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa11962c740 1 -- 172.21.15.53:0/2036120657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c1b3a20 con 0x55abf396b980 2024-08-31T06:18:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa111654640 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3994840 0x55abf3d4a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa11962c740 10 client.0 _ll_register_callbacks cb 0x7fa1000097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa10bfff640 1 -- 172.21.15.53:0/2036120657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf396b980 msgr2=0x55abf3d4f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa10bfff640 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf396b980 0x55abf3d4f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa10bfff640 1 -- 172.21.15.53:0/2036120657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3994840 msgr2=0x55abf3d4a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa10bfff640 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3994840 0x55abf3d4a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa10bfff640 1 -- 172.21.15.53:0/2036120657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abf3d50430 con 0x55abf3973b60 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa111654640 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3994840 0x55abf3d4a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa10bfff640 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d4fc10 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8005010 tx=0x7fa0f8020830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917060ec8c176a97 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.408+0000 7fa0ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.409+0000 7fa0ebfff640 1 -- 172.21.15.53:0/2036120657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8040070 con 0x55abf3973b60 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.409+0000 7fa11962c740 1 -- 172.21.15.53:0/2036120657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0f802f040 con 0x55abf3973b60 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.409+0000 7fa0ebfff640 1 -- 172.21.15.53:0/2036120657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fa0f80107a0 con 0x55abf3973b60 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.409+0000 7fa0ebfff640 1 -- 172.21.15.53:0/2036120657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fa0f8053050 con 0x55abf3973b60 2024-08-31T06:18:36.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.409+0000 7fa11962c740 10 client.19935 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.409+0000 7fa11962c740 1 -- 172.21.15.53:0/2036120657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55abf3dc4460 con 0x55abf3973b60 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.409+0000 7fa0ebfff640 1 -- 172.21.15.53:0/2036120657 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f802f040 con 0x55abf3973b60 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.409+0000 7fa0ebfff640 1 -- 172.21.15.53:0/2036120657 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fa0f801e6d0 con 0x55abf3973b60 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.410+0000 7fa11962c740 10 client.19935 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.410+0000 7fa11962c740 10 client.19935 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.410+0000 7fa11962c740 20 client.19935 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.410+0000 7fa11962c740 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55abf3928570 0x55abf3dc6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.410+0000 7fa11962c740 4 client.19935 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 155.0, "await_for": 45.0}] 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.410+0000 7fa11962c740 1 -- 172.21.15.53:0/2036120657 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 155.0, "await_for": 45.0}) -- 0x55abf3cb2280 con 0x55abf3928570 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.410+0000 7fa110e53640 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55abf3928570 0x55abf3dc6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.410+0000 7fa0ebfff640 10 client.19935 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:36.411+0000 7fa110e53640 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55abf3928570 0x55abf3dc6ce0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bca8a598d5a254e server_cookie=9a266ff53a696721 in_seq=0 out_seq=0 2024-08-31T06:18:37.355 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 15.96 MB/sec warmup 25 sec latency 823.737 ms 2024-08-31T06:18:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:37 smithi130 ceph-mon[22266]: pgmap v749: 97 pgs: 97 active+clean; 352 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 5.4 MiB/s wr, 276 op/s 2024-08-31T06:18:38.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:37 smithi153 ceph-mon[22320]: pgmap v749: 97 pgs: 97 active+clean; 352 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 5.4 MiB/s wr, 276 op/s 2024-08-31T06:18:38.228 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:37 smithi053 ceph-mon[18924]: pgmap v749: 97 pgs: 97 active+clean; 352 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 5.4 MiB/s wr, 276 op/s 2024-08-31T06:18:38.355 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 15.34 MB/sec warmup 26 sec latency 1823.809 ms 2024-08-31T06:18:38.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa0ebfff640 1 -- 172.21.15.53:0/2036120657 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55abf3cb2280 con 0x55abf3928570 2024-08-31T06:18:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa0ebfff640 10 client.19935 handle_command_reply: tid=0 2024-08-31T06:18:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa11962c740 1 client.19935 shutdown 2024-08-31T06:18:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa11962c740 1 -- 172.21.15.53:0/2036120657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 msgr2=0x55abf3d4fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa11962c740 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d4fc10 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8005010 tx=0x7fa0f8020830 comp rx=0 tx=0).stop 2024-08-31T06:18:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa11962c740 1 -- 172.21.15.53:0/2036120657 shutdown_connections 2024-08-31T06:18:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa11962c740 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55abf3928570 0x55abf3dc6ce0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa0ebfff640 0 client.19935 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa11962c740 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abf3994840 0x55abf3d4a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa11962c740 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf3973b60 0x55abf3d4fc10 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa11962c740 1 --2- 172.21.15.53:0/2036120657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55abf396b980 0x55abf3d4f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:38.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa11962c740 1 -- 172.21.15.53:0/2036120657 >> 172.21.15.53:0/2036120657 conn(0x55abf3988990 msgr2=0x55abf3d45cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:38.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa11962c740 1 -- 172.21.15.53:0/2036120657 shutdown_connections 2024-08-31T06:18:38.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.754+0000 7fa11962c740 1 -- 172.21.15.53:0/2036120657 wait complete. 2024-08-31T06:18:38.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.755+0000 7fa11962c740 20 client.19935 trim_cache size 0 max 16384 2024-08-31T06:18:38.758 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:18:38.758 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 56, 2024-08-31T06:18:38.758 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:18:38.758 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 46, 2024-08-31T06:18:38.758 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:18:38.758 INFO:teuthology.orchestra.run.smithi053.stdout: "22799662": { 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 46, 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 155.0, 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:18:38.759 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:18:38.760 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:38.760 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:38.760 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:38.760 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:38.760 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:18:38.760 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:18:38.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.755+0000 7fa1130b7640 1 -- 172.21.15.53:0/2083518236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0fc0b4d20 msgr2=0x7fa0fc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:38.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.755+0000 7fa1130b7640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0fc0b4d20 0x7fa0fc0b7230 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa0f801d000 tx=0x7fa0f8020e30 comp rx=0 tx=0).stop 2024-08-31T06:18:38.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.755+0000 7fa1130b7640 1 -- 172.21.15.53:0/2083518236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c108ab0 msgr2=0x7fa10c1099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.755+0000 7fa1130b7640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c108ab0 0x7fa10c1099d0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fa104004af0 tx=0x7fa104030b80 comp rx=0 tx=0).stop 2024-08-31T06:18:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.756+0000 7fa1130b7640 1 -- 172.21.15.53:0/2083518236 shutdown_connections 2024-08-31T06:18:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.756+0000 7fa1130b7640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0fc0b4d20 0x7fa0fc0b7230 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.756+0000 7fa1130b7640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c108ab0 0x7fa10c1099d0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.756+0000 7fa1130b7640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa10c108160 0x7fa10c1092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.756+0000 7fa1130b7640 1 --2- 172.21.15.53:0/2083518236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa10c102820 0x7fa10c10cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.756+0000 7fa1130b7640 1 -- 172.21.15.53:0/2083518236 >> 172.21.15.53:0/2083518236 conn(0x7fa10c079500 msgr2=0x7fa10c06ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.756+0000 7fa1130b7640 1 -- 172.21.15.53:0/2083518236 shutdown_connections 2024-08-31T06:18:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:18:38.756+0000 7fa1130b7640 1 -- 172.21.15.53:0/2083518236 wait complete. 2024-08-31T06:18:39.355 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 14.78 MB/sec warmup 27 sec latency 2823.899 ms 2024-08-31T06:18:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:39 smithi130 ceph-mon[22266]: pgmap v750: 97 pgs: 97 active+clean; 353 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 5.4 MiB/s wr, 257 op/s 2024-08-31T06:18:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:39 smithi153 ceph-mon[22320]: pgmap v750: 97 pgs: 97 active+clean; 353 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 5.4 MiB/s wr, 257 op/s 2024-08-31T06:18:40.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:39 smithi053 ceph-mon[18924]: pgmap v750: 97 pgs: 97 active+clean; 353 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 5.4 MiB/s wr, 257 op/s 2024-08-31T06:18:40.355 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 14.25 MB/sec warmup 28 sec latency 3824.014 ms 2024-08-31T06:18:41.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:40 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:18:41.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:40 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:18:41.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:40 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:18:41.355 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 13.76 MB/sec warmup 29 sec latency 4824.107 ms 2024-08-31T06:18:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:41 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:18:42.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:41 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:18:42.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:41 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:18:42.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:41 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:18:42.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:41 smithi130 ceph-mon[22266]: pgmap v751: 97 pgs: 97 active+clean; 351 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.9 MiB/s wr, 255 op/s 2024-08-31T06:18:42.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:41 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:18:42.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:41 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:18:42.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:41 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:18:42.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:41 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:18:42.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:41 smithi153 ceph-mon[22320]: pgmap v751: 97 pgs: 97 active+clean; 351 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.9 MiB/s wr, 255 op/s 2024-08-31T06:18:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:41 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:18:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:41 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:18:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:41 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:18:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:41 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:18:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:41 smithi053 ceph-mon[18924]: pgmap v751: 97 pgs: 97 active+clean; 351 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.9 MiB/s wr, 255 op/s 2024-08-31T06:18:42.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 13.30 MB/sec warmup 30 sec latency 5824.175 ms 2024-08-31T06:18:43.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 12.87 MB/sec warmup 31 sec latency 6824.275 ms 2024-08-31T06:18:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:43 smithi130 ceph-mon[22266]: pgmap v752: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 3.6 MiB/s wr, 205 op/s 2024-08-31T06:18:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:43 smithi153 ceph-mon[22320]: pgmap v752: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 3.6 MiB/s wr, 205 op/s 2024-08-31T06:18:44.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:43 smithi053 ceph-mon[18924]: pgmap v752: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 3.6 MiB/s wr, 205 op/s 2024-08-31T06:18:44.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 12.47 MB/sec warmup 32 sec latency 7824.371 ms 2024-08-31T06:18:45.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 12.09 MB/sec warmup 33 sec latency 8824.421 ms 2024-08-31T06:18:45.736 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '22799662', quiesce took 14.2 seconds. Will release after: 20.8 2024-08-31T06:18:45.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:45 smithi053 ceph-mon[18924]: pgmap v753: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 2.4 MiB/s wr, 181 op/s 2024-08-31T06:18:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:45 smithi130 ceph-mon[22266]: pgmap v753: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 2.4 MiB/s wr, 181 op/s 2024-08-31T06:18:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:45 smithi153 ceph-mon[22320]: pgmap v753: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 2.4 MiB/s wr, 181 op/s 2024-08-31T06:18:46.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 11.73 MB/sec warmup 34 sec latency 9824.472 ms 2024-08-31T06:18:47.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 11.40 MB/sec warmup 35 sec latency 10824.525 ms 2024-08-31T06:18:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:47 smithi130 ceph-mon[22266]: pgmap v754: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-08-31T06:18:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:47 smithi153 ceph-mon[22320]: pgmap v754: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-08-31T06:18:48.228 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:47 smithi053 ceph-mon[18924]: pgmap v754: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-08-31T06:18:48.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 11.08 MB/sec warmup 36 sec latency 11824.563 ms 2024-08-31T06:18:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.635+0000 7f6845c36640 1 -- 172.21.15.53:0/3973855510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f684010db50 msgr2=0x7f6840110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.635+0000 7f6845c36640 1 --2- 172.21.15.53:0/3973855510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f684010db50 0x7f6840110030 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f6838009ca0 tx=0x7f683802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.635+0000 7f6845c36640 1 -- 172.21.15.53:0/3973855510 shutdown_connections 2024-08-31T06:18:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.635+0000 7f6845c36640 1 --2- 172.21.15.53:0/3973855510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f684010db50 0x7f6840110030 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.635+0000 7f6845c36640 1 --2- 172.21.15.53:0/3973855510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6840105080 0x7f684010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.635+0000 7f6845c36640 1 --2- 172.21.15.53:0/3973855510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6840104730 0x7f6840104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.635+0000 7f6845c36640 1 -- 172.21.15.53:0/3973855510 >> 172.21.15.53:0/3973855510 conn(0x7f68400fe160 msgr2=0x7f68401005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.635+0000 7f6845c36640 1 -- 172.21.15.53:0/3973855510 shutdown_connections 2024-08-31T06:18:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.635+0000 7f6845c36640 1 -- 172.21.15.53:0/3973855510 wait complete. 2024-08-31T06:18:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f6845c36640 1 Processor -- start 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f6845c36640 1 -- start start 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f6845c36640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6840104730 0x7f684019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f6845c36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6840105080 0x7f684019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f6845c36640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f684010db50 0x7f684019f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f6845c36640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68401136d0 con 0x7f6840105080 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f6845c36640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6840113550 con 0x7f684010db50 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f6845c36640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6840113850 con 0x7f6840104730 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f6836ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6840105080 0x7f684019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f6836ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6840105080 0x7f684019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39302/0 (socket says 172.21.15.53:39302) 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f6836ffd640 1 -- 172.21.15.53:0/888094011 learned_addr learned my addr 172.21.15.53:0/888094011 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.636+0000 7f683ffff640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f684010db50 0x7f684019f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f6836ffd640 1 -- 172.21.15.53:0/888094011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6840104730 msgr2=0x7f684019a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f683f7fe640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6840104730 0x7f684019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f6836ffd640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6840104730 0x7f684019a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f6836ffd640 1 -- 172.21.15.53:0/888094011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f684010db50 msgr2=0x7f684019f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f6836ffd640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f684010db50 0x7f684019f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f6836ffd640 1 -- 172.21.15.53:0/888094011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68401a0010 con 0x7f6840105080 2024-08-31T06:18:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f683ffff640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f684010db50 0x7f684019f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f6836ffd640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6840105080 0x7f684019a680 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f682800d750 tx=0x7f682800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f683d7fa640 1 -- 172.21.15.53:0/888094011 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828017070 con 0x7f6840105080 2024-08-31T06:18:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f6845c36640 1 -- 172.21.15.53:0/888094011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68401a0300 con 0x7f6840105080 2024-08-31T06:18:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f683d7fa640 1 -- 172.21.15.53:0/888094011 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68280054b0 con 0x7f6840105080 2024-08-31T06:18:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f683d7fa640 1 -- 172.21.15.53:0/888094011 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828004bc0 con 0x7f6840105080 2024-08-31T06:18:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.637+0000 7f6845c36640 1 -- 172.21.15.53:0/888094011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68401a6a90 con 0x7f6840105080 2024-08-31T06:18:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f683d7fa640 1 -- 172.21.15.53:0/888094011 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6828009c30 con 0x7f6840105080 2024-08-31T06:18:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f684cc76740 1 Processor -- start 2024-08-31T06:18:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f684cc76740 1 -- start start 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f684cc76740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56234964b1b0 0x5623499eece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f684cc76740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623496222f0 0x5623499ef220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f684cc76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234962a4d0 0x5623499ef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f684cc76740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562349964000 con 0x56234964b1b0 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f684cc76740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562349953590 con 0x5623496222f0 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f684cc76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562349957540 con 0x56234962a4d0 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f683ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56234964b1b0 0x5623499eece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f683ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56234964b1b0 0x5623499eece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39318/0 (socket says 172.21.15.53:39318) 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f683ffff640 1 -- 172.21.15.53:0/3842148879 learned_addr learned my addr 172.21.15.53:0/3842148879 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.640+0000 7f683f7fe640 1 --2- 172.21.15.53:0/3842148879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623496222f0 0x5623499ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f6836ffd640 1 --2- 172.21.15.53:0/3842148879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234962a4d0 0x5623499ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f683d7fa640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f682c0b4ca0 0x7f682c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f683ffff640 1 -- 172.21.15.53:0/3842148879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234962a4d0 msgr2=0x5623499ef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f683ffff640 1 --2- 172.21.15.53:0/3842148879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234962a4d0 0x5623499ef760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f683ffff640 1 -- 172.21.15.53:0/3842148879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623496222f0 msgr2=0x5623499ef220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f683ffff640 1 --2- 172.21.15.53:0/3842148879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623496222f0 0x5623499ef220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f683ffff640 1 -- 172.21.15.53:0/3842148879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623496b6790 con 0x56234964b1b0 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f6836ffd640 1 --2- 172.21.15.53:0/3842148879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234962a4d0 0x5623499ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f683d7fa640 1 -- 172.21.15.53:0/888094011 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f68280e5050 con 0x7f6840105080 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f683ffff640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f682c0b4ca0 0x7f682c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f683ffff640 1 --2- 172.21.15.53:0/3842148879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56234964b1b0 0x5623499eece0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f6838031560 tx=0x7f6838031590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53ed97f6d7adaa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f6835ffb640 1 -- 172.21.15.53:0/3842148879 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838031c40 con 0x56234964b1b0 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f6835ffb640 1 -- 172.21.15.53:0/3842148879 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6838036070 con 0x56234964b1b0 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.641+0000 7f6835ffb640 1 -- 172.21.15.53:0/3842148879 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838030b00 con 0x56234964b1b0 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.642+0000 7f684cc76740 1 -- 172.21.15.53:0/3842148879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56234964b1b0 msgr2=0x5623499eece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.642+0000 7f683ffff640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f682c0b4ca0 0x7f682c0b71b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f683804b000 tx=0x7f6838048000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.642+0000 7f684cc76740 1 --2- 172.21.15.53:0/3842148879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56234964b1b0 0x5623499eece0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f6838031560 tx=0x7f6838031590 comp rx=0 tx=0).stop 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.642+0000 7f684cc76740 1 -- 172.21.15.53:0/3842148879 shutdown_connections 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.642+0000 7f684cc76740 1 --2- 172.21.15.53:0/3842148879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234962a4d0 0x5623499ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.642+0000 7f684cc76740 1 --2- 172.21.15.53:0/3842148879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623496222f0 0x5623499ef220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.642+0000 7f684cc76740 1 --2- 172.21.15.53:0/3842148879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56234964b1b0 0x5623499eece0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.642+0000 7f684cc76740 1 -- 172.21.15.53:0/3842148879 >> 172.21.15.53:0/3842148879 conn(0x56234963f300 msgr2=0x5623499ecbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.642+0000 7f684cc76740 1 -- 172.21.15.53:0/3842148879 shutdown_connections 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.642+0000 7f684cc76740 1 -- 172.21.15.53:0/3842148879 wait complete. 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f684cc76740 1 -- start start 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f684cc76740 1 Processor -- start 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f684cc76740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499fed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f684cc76740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 0x5623499ff280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f684cc76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234964b1b0 0x562349a0a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f684cc76740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56234988cab0 con 0x5623496222f0 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f684cc76740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5623498da680 con 0x56234962a4d0 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f684cc76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562349a016c0 con 0x56234964b1b0 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f684cc76740 10 client.0 _ll_register_callbacks cb 0x562349662a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f683f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499fed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f683f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499fed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39334/0 (socket says 172.21.15.53:39334) 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.643+0000 7f683f7fe640 1 -- 172.21.15.53:0/2896619326 learned_addr learned my addr 172.21.15.53:0/2896619326 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f6836ffd640 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 0x5623499ff280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f683ffff640 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234964b1b0 0x562349a0a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f683f7fe640 1 -- 172.21.15.53:0/2896619326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234964b1b0 msgr2=0x562349a0a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f683f7fe640 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234964b1b0 0x562349a0a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f683f7fe640 1 -- 172.21.15.53:0/2896619326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 msgr2=0x5623499ff280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f683f7fe640 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 0x5623499ff280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f683f7fe640 1 -- 172.21.15.53:0/2896619326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56234972f620 con 0x5623496222f0 2024-08-31T06:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f683ffff640 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234964b1b0 0x562349a0a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f683f7fe640 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499fed00 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f6830013710 tx=0x7f6830013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff38d681dc52533 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f681effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f681effd640 1 -- 172.21.15.53:0/2896619326 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830011dd0 con 0x5623496222f0 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f681effd640 1 -- 172.21.15.53:0/2896619326 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f6830004020 con 0x5623496222f0 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f684cc76740 1 -- 172.21.15.53:0/2896619326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6838036070 con 0x5623496222f0 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f681effd640 1 -- 172.21.15.53:0/2896619326 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f6830004220 con 0x5623496222f0 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f684cc76740 10 client.19947 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.644+0000 7f684cc76740 1 -- 172.21.15.53:0/2896619326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x562349a0d7c0 con 0x5623496222f0 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.645+0000 7f681effd640 1 -- 172.21.15.53:0/2896619326 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6838036070 con 0x5623496222f0 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.645+0000 7f681effd640 1 -- 172.21.15.53:0/2896619326 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f683001a070 con 0x5623496222f0 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.645+0000 7f684cc76740 10 client.19947 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.645+0000 7f684cc76740 10 client.19947 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.645+0000 7f684cc76740 20 client.19947 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.645+0000 7f684cc76740 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562349609d80 0x562349a10e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.645+0000 7f684cc76740 4 client.19947 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.645+0000 7f684cc76740 1 -- 172.21.15.53:0/2896619326 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562349965f50 con 0x562349609d80 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.645+0000 7f6836ffd640 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562349609d80 0x562349a10e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.646+0000 7f6836ffd640 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562349609d80 0x562349a10e50 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d991213327f4630c server_cookie=5d493d26f178088f in_seq=0 out_seq=0 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.646+0000 7f681effd640 10 client.19947 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.646+0000 7f681effd640 1 -- 172.21.15.53:0/2896619326 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562349965f50 con 0x562349609d80 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.646+0000 7f681effd640 10 client.19947 handle_command_reply: tid=0 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.646+0000 7f684cc76740 1 client.19947 shutdown 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.646+0000 7f684cc76740 1 -- 172.21.15.53:0/2896619326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 msgr2=0x5623499fed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.646+0000 7f684cc76740 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499fed00 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f6830013710 tx=0x7f6830013bd0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.647+0000 7f684cc76740 1 -- 172.21.15.53:0/2896619326 shutdown_connections 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.647+0000 7f684cc76740 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562349609d80 0x562349a10e50 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.647+0000 7f684cc76740 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56234964b1b0 0x562349a0a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.647+0000 7f684cc76740 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 0x5623499ff280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.647+0000 7f681effd640 0 client.19947 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.647+0000 7f684cc76740 1 --2- 172.21.15.53:0/2896619326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499fed00 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.647+0000 7f684cc76740 1 -- 172.21.15.53:0/2896619326 >> 172.21.15.53:0/2896619326 conn(0x56234963f300 msgr2=0x5623499eb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.647+0000 7f684cc76740 1 -- 172.21.15.53:0/2896619326 shutdown_connections 2024-08-31T06:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.647+0000 7f684cc76740 1 -- 172.21.15.53:0/2896619326 wait complete. 2024-08-31T06:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.647+0000 7f684cc76740 20 client.19947 trim_cache size 0 max 16384 2024-08-31T06:18:48.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.661+0000 7f684cc76740 1 Processor -- start 2024-08-31T06:18:48.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.661+0000 7f684cc76740 1 -- start start 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f684cc76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562349609d80 0x5623499ec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f684cc76740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499eca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f684cc76740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 0x5623499eb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f684cc76740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68401ad200 con 0x5623496222f0 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f684cc76740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f68401aef80 con 0x56234962a4d0 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f684cc76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68401ad8d0 con 0x562349609d80 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f6836ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f6836ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499eca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39342/0 (socket says 172.21.15.53:39342) 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f6836ffd640 1 -- 172.21.15.53:0/3789256716 learned_addr learned my addr 172.21.15.53:0/3789256716 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f6836ffd640 1 -- 172.21.15.53:0/3789256716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562349609d80 msgr2=0x5623499ec510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f6836ffd640 1 --2- 172.21.15.53:0/3789256716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562349609d80 0x5623499ec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.666 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f6836ffd640 1 -- 172.21.15.53:0/3789256716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 msgr2=0x5623499eb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f6836ffd640 1 --2- 172.21.15.53:0/3789256716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 0x5623499eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f6836ffd640 1 -- 172.21.15.53:0/3789256716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623499f9780 con 0x5623496222f0 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f6836ffd640 1 --2- 172.21.15.53:0/3789256716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499eca50 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f68280a8990 tx=0x7f68280ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a27713d9e66112 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f68357fa640 1 -- 172.21.15.53:0/3789256716 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828096020 con 0x5623496222f0 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f68357fa640 1 -- 172.21.15.53:0/3789256716 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68280abe20 con 0x5623496222f0 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.662+0000 7f68357fa640 1 -- 172.21.15.53:0/3789256716 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828020040 con 0x5623496222f0 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.663+0000 7f684cc76740 1 -- 172.21.15.53:0/3789256716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 msgr2=0x5623499eca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.663+0000 7f684cc76740 1 --2- 172.21.15.53:0/3789256716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499eca50 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f68280a8990 tx=0x7f68280ce040 comp rx=0 tx=0).stop 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.663+0000 7f684cc76740 1 -- 172.21.15.53:0/3789256716 shutdown_connections 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.663+0000 7f684cc76740 1 --2- 172.21.15.53:0/3789256716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 0x5623499eb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.663+0000 7f684cc76740 1 --2- 172.21.15.53:0/3789256716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623496222f0 0x5623499eca50 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.663+0000 7f684cc76740 1 --2- 172.21.15.53:0/3789256716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562349609d80 0x5623499ec510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.663+0000 7f684cc76740 1 -- 172.21.15.53:0/3789256716 >> 172.21.15.53:0/3789256716 conn(0x56234963f300 msgr2=0x5623499f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.663+0000 7f684cc76740 1 -- 172.21.15.53:0/3789256716 shutdown_connections 2024-08-31T06:18:48.667 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.663+0000 7f684cc76740 1 -- 172.21.15.53:0/3789256716 wait complete. 2024-08-31T06:18:48.668 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.663+0000 7f684cc76740 1 -- start start 2024-08-31T06:18:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f684cc76740 1 Processor -- start 2024-08-31T06:18:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f684cc76740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562349609d80 0x562349a02150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f684cc76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623496222f0 0x562349a02690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f684cc76740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 0x562349a79800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f684cc76740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68401ae7f0 con 0x562349609d80 2024-08-31T06:18:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f684cc76740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f68401ae060 con 0x56234962a4d0 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f684cc76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68401ab200 con 0x5623496222f0 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f684cc76740 10 client.0 _ll_register_callbacks cb 0x7f6830009d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f683f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562349609d80 0x562349a02150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f683f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562349609d80 0x562349a02150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39350/0 (socket says 172.21.15.53:39350) 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f683f7fe640 1 -- 172.21.15.53:0/3089785925 learned_addr learned my addr 172.21.15.53:0/3089785925 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f6836ffd640 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623496222f0 0x562349a02690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f683f7fe640 1 -- 172.21.15.53:0/3089785925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623496222f0 msgr2=0x562349a02690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f683f7fe640 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623496222f0 0x562349a02690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f683f7fe640 1 -- 172.21.15.53:0/3089785925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 msgr2=0x562349a79800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f683f7fe640 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 0x562349a79800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f683f7fe640 1 -- 172.21.15.53:0/3089785925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562349a79d40 con 0x562349609d80 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.664+0000 7f6836ffd640 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623496222f0 0x562349a02690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f683f7fe640 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562349609d80 0x562349a02150 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f6830023520 tx=0x7f6830009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d39baa13d325fe1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f681effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f681effd640 1 -- 172.21.15.53:0/3089785925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830023b40 con 0x562349609d80 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f681effd640 1 -- 172.21.15.53:0/3089785925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f6830023ce0 con 0x562349609d80 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f684cc76740 1 -- 172.21.15.53:0/3089785925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68280abe20 con 0x562349609d80 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f681effd640 1 -- 172.21.15.53:0/3089785925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f6830033050 con 0x562349609d80 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f684cc76740 10 client.19953 fetch_fsmap learned FSMap version 56 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f684cc76740 1 -- 172.21.15.53:0/3089785925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x562349a7af60 con 0x562349609d80 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f681effd640 1 -- 172.21.15.53:0/3089785925 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68280abe20 con 0x562349609d80 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f681effd640 1 -- 172.21.15.53:0/3089785925 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f683001a070 con 0x562349609d80 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f684cc76740 10 client.19953 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f684cc76740 10 client.19953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f684cc76740 20 client.19953 populate_metadata read hostname 'smithi053' 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f684cc76740 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56234964b1b0 0x562349a7d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f684cc76740 4 client.19953 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.665+0000 7f684cc76740 1 -- 172.21.15.53:0/3089785925 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5623499619f0 con 0x56234964b1b0 2024-08-31T06:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.666+0000 7f6836ffd640 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56234964b1b0 0x562349a7d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.666+0000 7f6836ffd640 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56234964b1b0 0x562349a7d7b0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18b03c93d1f199c2 server_cookie=a6f82e49436f748f in_seq=0 out_seq=0 2024-08-31T06:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.666+0000 7f681effd640 10 client.19953 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:48.691 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f681effd640 1 -- 172.21.15.53:0/3089785925 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623499619f0 con 0x56234964b1b0 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f681effd640 10 client.19953 handle_command_reply: tid=0 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 1 client.19953 shutdown 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 1 -- 172.21.15.53:0/3089785925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562349609d80 msgr2=0x562349a02150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562349609d80 0x562349a02150 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f6830023520 tx=0x7f6830009be0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 1 -- 172.21.15.53:0/3089785925 shutdown_connections 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56234964b1b0 0x562349a7d7b0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56234962a4d0 0x562349a79800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623496222f0 0x562349a02690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f681effd640 0 client.19953 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 1 --2- 172.21.15.53:0/3089785925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562349609d80 0x562349a02150 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 1 -- 172.21.15.53:0/3089785925 >> 172.21.15.53:0/3089785925 conn(0x56234963f300 msgr2=0x5623499f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 1 -- 172.21.15.53:0/3089785925 shutdown_connections 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 1 -- 172.21.15.53:0/3089785925 wait complete. 2024-08-31T06:18:48.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.689+0000 7f684cc76740 20 client.19953 trim_cache size 0 max 16384 2024-08-31T06:18:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:18:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:18:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:18:48.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:18:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 -- 172.21.15.53:0/888094011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f682c0b4ca0 msgr2=0x7f682c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f682c0b4ca0 0x7f682c0b71b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f683804b000 tx=0x7f6838048000 comp rx=0 tx=0).stop 2024-08-31T06:18:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 -- 172.21.15.53:0/888094011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6840105080 msgr2=0x7f684019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:18:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6840105080 0x7f684019a680 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f682800d750 tx=0x7f682800dc10 comp rx=0 tx=0).stop 2024-08-31T06:18:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 -- 172.21.15.53:0/888094011 shutdown_connections 2024-08-31T06:18:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f682c0b4ca0 0x7f682c0b71b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f684010db50 0x7f684019f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6840105080 0x7f684019a680 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 --2- 172.21.15.53:0/888094011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6840104730 0x7f684019a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:18:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 -- 172.21.15.53:0/888094011 >> 172.21.15.53:0/888094011 conn(0x7f68400fe160 msgr2=0x7f6840107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:18:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 -- 172.21.15.53:0/888094011 shutdown_connections 2024-08-31T06:18:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:18:48.690+0000 7f6845c36640 1 -- 172.21.15.53:0/888094011 wait complete. 2024-08-31T06:18:49.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 10.78 MB/sec warmup 37 sec latency 12824.608 ms 2024-08-31T06:18:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:49 smithi130 ceph-mon[22266]: pgmap v755: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 756 KiB/s wr, 83 op/s 2024-08-31T06:18:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:49 smithi153 ceph-mon[22320]: pgmap v755: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 756 KiB/s wr, 83 op/s 2024-08-31T06:18:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:49 smithi053 ceph-mon[18924]: pgmap v755: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 756 KiB/s wr, 83 op/s 2024-08-31T06:18:50.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 10.50 MB/sec warmup 38 sec latency 13824.670 ms 2024-08-31T06:18:51.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 10.23 MB/sec warmup 39 sec latency 14824.770 ms 2024-08-31T06:18:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:51 smithi130 ceph-mon[22266]: pgmap v756: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 303 KiB/s wr, 56 op/s 2024-08-31T06:18:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:51 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:18:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:51 smithi153 ceph-mon[22320]: pgmap v756: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 303 KiB/s wr, 56 op/s 2024-08-31T06:18:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:51 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:18:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:51 smithi053 ceph-mon[18924]: pgmap v756: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 303 KiB/s wr, 56 op/s 2024-08-31T06:18:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:51 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:18:52.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 9.97 MB/sec warmup 40 sec latency 15824.843 ms 2024-08-31T06:18:53.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:52 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:18:53.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:52 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:18:53.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:52 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:18:53.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:52 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:18:53.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:52 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:18:53.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:52 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:18:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:52 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:18:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:52 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:18:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:52 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:18:53.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 9.73 MB/sec warmup 41 sec latency 16824.922 ms 2024-08-31T06:18:54.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 9.50 MB/sec warmup 42 sec latency 17824.999 ms 2024-08-31T06:18:54.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:54 smithi053 ceph-mon[18924]: pgmap v757: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 63 KiB/s wr, 28 op/s 2024-08-31T06:18:54.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:54 smithi130 ceph-mon[22266]: pgmap v757: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 63 KiB/s wr, 28 op/s 2024-08-31T06:18:54.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:54 smithi153 ceph-mon[22320]: pgmap v757: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 63 KiB/s wr, 28 op/s 2024-08-31T06:18:55.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 9.28 MB/sec warmup 43 sec latency 18825.074 ms 2024-08-31T06:18:56.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 9.07 MB/sec warmup 44 sec latency 19825.140 ms 2024-08-31T06:18:56.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:56 smithi053 ceph-mon[18924]: pgmap v758: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 20 op/s 2024-08-31T06:18:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:56 smithi130 ceph-mon[22266]: pgmap v758: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 20 op/s 2024-08-31T06:18:56.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:56 smithi153 ceph-mon[22320]: pgmap v758: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 20 op/s 2024-08-31T06:18:57.356 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 8.87 MB/sec warmup 45 sec latency 20825.199 ms 2024-08-31T06:18:58.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 8.67 MB/sec warmup 46 sec latency 21825.261 ms 2024-08-31T06:18:58.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:18:58 smithi053 ceph-mon[18924]: pgmap v759: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-31T06:18:58.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:18:58 smithi130 ceph-mon[22266]: pgmap v759: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-31T06:18:58.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:18:58 smithi153 ceph-mon[22320]: pgmap v759: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-31T06:18:59.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 8.49 MB/sec warmup 47 sec latency 22825.344 ms 2024-08-31T06:19:00.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 8.31 MB/sec warmup 48 sec latency 23825.455 ms 2024-08-31T06:19:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:00 smithi053 ceph-mon[18924]: pgmap v760: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-08-31T06:19:00.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:00 smithi130 ceph-mon[22266]: pgmap v760: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-08-31T06:19:00.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:00 smithi153 ceph-mon[22320]: pgmap v760: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-08-31T06:19:01.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 8.14 MB/sec warmup 49 sec latency 24825.546 ms 2024-08-31T06:19:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.800+0000 7f964a27e640 1 -- 172.21.15.53:0/3285671914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96441091a0 msgr2=0x7f96441095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.800+0000 7f964a27e640 1 --2- 172.21.15.53:0/3285671914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96441091a0 0x7f96441095b0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f962c009900 tx=0x7f962c02a410 comp rx=0 tx=0).stop 2024-08-31T06:19:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.800+0000 7f964a27e640 1 -- 172.21.15.53:0/3285671914 shutdown_connections 2024-08-31T06:19:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.800+0000 7f964a27e640 1 --2- 172.21.15.53:0/3285671914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9644109af0 0x7f9644110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.800+0000 7f964a27e640 1 --2- 172.21.15.53:0/3285671914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96441091a0 0x7f96441095b0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.800+0000 7f964a27e640 1 --2- 172.21.15.53:0/3285671914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644103870 0x7f9644103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.800+0000 7f964a27e640 1 -- 172.21.15.53:0/3285671914 >> 172.21.15.53:0/3285671914 conn(0x7f96440ff2b0 msgr2=0x7f9644101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.800+0000 7f964a27e640 1 -- 172.21.15.53:0/3285671914 shutdown_connections 2024-08-31T06:19:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.800+0000 7f964a27e640 1 -- 172.21.15.53:0/3285671914 wait complete. 2024-08-31T06:19:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.801+0000 7f964a27e640 1 Processor -- start 2024-08-31T06:19:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.801+0000 7f964a27e640 1 -- start start 2024-08-31T06:19:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.801+0000 7f964a27e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9644103870 0x7f964419a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.801+0000 7f964a27e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96441091a0 0x7f964419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.801+0000 7f964a27e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9644109af0 0x7f964419f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.801+0000 7f964a27e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9644113610 con 0x7f9644103870 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.801+0000 7f964a27e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9644113490 con 0x7f9644109af0 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.801+0000 7f964a27e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9644113790 con 0x7f96441091a0 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.801+0000 7f9643fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9644103870 0x7f964419a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.801+0000 7f9643fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9644103870 0x7f964419a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34838/0 (socket says 172.21.15.53:34838) 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.801+0000 7f9643fff640 1 -- 172.21.15.53:0/2443573636 learned_addr learned my addr 172.21.15.53:0/2443573636 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f964881b640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9644109af0 0x7f964419f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f963bfff640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96441091a0 0x7f964419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f9643fff640 1 -- 172.21.15.53:0/2443573636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96441091a0 msgr2=0x7f964419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f9643fff640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96441091a0 0x7f964419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f9643fff640 1 -- 172.21.15.53:0/2443573636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9644109af0 msgr2=0x7f964419f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f9643fff640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9644109af0 0x7f964419f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f9643fff640 1 -- 172.21.15.53:0/2443573636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96441a0080 con 0x7f9644103870 2024-08-31T06:19:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f964881b640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9644109af0 0x7f964419f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:19:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f963bfff640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96441091a0 0x7f964419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:19:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f9643fff640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9644103870 0x7f964419a150 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f963400d950 tx=0x7f963400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f9641ffb640 1 -- 172.21.15.53:0/2443573636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634017070 con 0x7f9644103870 2024-08-31T06:19:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f9641ffb640 1 -- 172.21.15.53:0/2443573636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9634009c30 con 0x7f9644103870 2024-08-31T06:19:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f9641ffb640 1 -- 172.21.15.53:0/2443573636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963400f620 con 0x7f9644103870 2024-08-31T06:19:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f964a27e640 1 -- 172.21.15.53:0/2443573636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96441a0370 con 0x7f9644103870 2024-08-31T06:19:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.802+0000 7f964a27e640 1 -- 172.21.15.53:0/2443573636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96441a6b00 con 0x7f9644103870 2024-08-31T06:19:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.805+0000 7f96511e4740 1 Processor -- start 2024-08-31T06:19:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.805+0000 7f96511e4740 1 -- start start 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f96511e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33911b0 0x5575b3734ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f96511e4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 0x5575b3735000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f96511e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33704d0 0x5575b3735540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f96511e4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5575b36aa000 con 0x5575b33682f0 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f96511e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5575b3699590 con 0x5575b33911b0 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f96511e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5575b369d540 con 0x5575b33704d0 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f9641ffb640 1 -- 172.21.15.53:0/2443573636 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9634010460 con 0x7f9644103870 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f964881b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33911b0 0x5575b3734ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f964881b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33911b0 0x5575b3734ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54946/0 (socket says 172.21.15.53:54946) 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f964881b640 1 -- 172.21.15.53:0/2614681112 learned_addr learned my addr 172.21.15.53:0/2614681112 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f963bfff640 1 --2- 172.21.15.53:0/2614681112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33704d0 0x5575b3735540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f9643fff640 1 --2- 172.21.15.53:0/2614681112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 0x5575b3735000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f964881b640 1 -- 172.21.15.53:0/2614681112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33704d0 msgr2=0x5575b3735540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f964881b640 1 --2- 172.21.15.53:0/2614681112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33704d0 0x5575b3735540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f964881b640 1 -- 172.21.15.53:0/2614681112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 msgr2=0x5575b3735000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f964881b640 1 --2- 172.21.15.53:0/2614681112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 0x5575b3735000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f964881b640 1 -- 172.21.15.53:0/2614681112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b33fc790 con 0x5575b33911b0 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.806+0000 7f9643fff640 1 --2- 172.21.15.53:0/2614681112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 0x5575b3735000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.807+0000 7f964881b640 1 --2- 172.21.15.53:0/2614681112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33911b0 0x5575b3734ac0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f963c010450 tx=0x7f963c010910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=754098b972d4d2a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.807+0000 7f963a7fc640 1 -- 172.21.15.53:0/2614681112 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c017070 con 0x5575b33911b0 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.807+0000 7f963a7fc640 1 -- 172.21.15.53:0/2614681112 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f963c011bf0 con 0x5575b33911b0 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.807+0000 7f963a7fc640 1 -- 172.21.15.53:0/2614681112 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c01ac20 con 0x5575b33911b0 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.807+0000 7f9641ffb640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f96300b4d20 0x7f96300b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.807+0000 7f9643fff640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f96300b4d20 0x7f96300b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.807+0000 7f9641ffb640 1 -- 172.21.15.53:0/2443573636 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f96340e5200 con 0x7f9644103870 2024-08-31T06:19:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.808+0000 7f96511e4740 1 -- 172.21.15.53:0/2614681112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33911b0 msgr2=0x5575b3734ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.808+0000 7f96511e4740 1 --2- 172.21.15.53:0/2614681112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33911b0 0x5575b3734ac0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f963c010450 tx=0x7f963c010910 comp rx=0 tx=0).stop 2024-08-31T06:19:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.808+0000 7f9643fff640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f96300b4d20 0x7f96300b7230 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f96340e29e0 tx=0x7f963400df40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.808+0000 7f96511e4740 1 -- 172.21.15.53:0/2614681112 shutdown_connections 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.808+0000 7f96511e4740 1 --2- 172.21.15.53:0/2614681112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33704d0 0x5575b3735540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.808+0000 7f96511e4740 1 --2- 172.21.15.53:0/2614681112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 0x5575b3735000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.808+0000 7f96511e4740 1 --2- 172.21.15.53:0/2614681112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33911b0 0x5575b3734ac0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.808+0000 7f96511e4740 1 -- 172.21.15.53:0/2614681112 >> 172.21.15.53:0/2614681112 conn(0x5575b3385300 msgr2=0x5575b37329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.808+0000 7f96511e4740 1 -- 172.21.15.53:0/2614681112 shutdown_connections 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.808+0000 7f96511e4740 1 -- 172.21.15.53:0/2614681112 wait complete. 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.808+0000 7f96511e4740 1 -- start start 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f96511e4740 1 Processor -- start 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f96511e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33682f0 0x5575b37406f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f96511e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 0x5575b3740c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f96511e4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33911b0 0x5575b374c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f96511e4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5575b35d2ab0 con 0x5575b33911b0 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f96511e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5575b3620680 con 0x5575b33704d0 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f96511e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5575b3743240 con 0x5575b33682f0 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f96511e4740 10 client.0 _ll_register_callbacks cb 0x5575b33a8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f964881b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33911b0 0x5575b374c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f964881b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33911b0 0x5575b374c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34854/0 (socket says 172.21.15.53:34854) 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f964881b640 1 -- 172.21.15.53:0/3203086218 learned_addr learned my addr 172.21.15.53:0/3203086218 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f963bfff640 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 0x5575b3740c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.809+0000 7f964881b640 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33682f0 0x5575b37406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f964881b640 1 -- 172.21.15.53:0/3203086218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33682f0 msgr2=0x5575b37406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f964881b640 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33682f0 0x5575b37406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f964881b640 1 -- 172.21.15.53:0/3203086218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 msgr2=0x5575b3740c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f964881b640 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 0x5575b3740c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f964881b640 1 -- 172.21.15.53:0/3203086218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575b3475620 con 0x5575b33911b0 2024-08-31T06:19:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f964881b640 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33911b0 0x5575b374c560 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f963c000f80 tx=0x7f963c01a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9bd3b4ee633b74 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f96237fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f96237fe640 1 -- 172.21.15.53:0/3203086218 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c02d060 con 0x5575b33911b0 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f96237fe640 1 -- 172.21.15.53:0/3203086218 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f963c011560 con 0x5575b33911b0 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f96511e4740 1 -- 172.21.15.53:0/3203086218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f963c011bf0 con 0x5575b33911b0 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f96237fe640 1 -- 172.21.15.53:0/3203086218 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f963c017070 con 0x5575b33911b0 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f96511e4740 10 client.19965 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f96511e4740 1 -- 172.21.15.53:0/3203086218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5575b374f300 con 0x5575b33911b0 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.810+0000 7f96237fe640 1 -- 172.21.15.53:0/3203086218 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f963c011bf0 con 0x5575b33911b0 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.811+0000 7f96237fe640 1 -- 172.21.15.53:0/3203086218 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f963c026040 con 0x5575b33911b0 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.811+0000 7f96511e4740 10 client.19965 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.811+0000 7f96511e4740 10 client.19965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.811+0000 7f96511e4740 20 client.19965 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.811+0000 7f96511e4740 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575b334fd80 0x5575b3752710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.811+0000 7f96511e4740 4 client.19965 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.811+0000 7f96511e4740 1 -- 172.21.15.53:0/3203086218 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575b36abf50 con 0x5575b334fd80 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.811+0000 7f963bfff640 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575b334fd80 0x5575b3752710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.811+0000 7f963bfff640 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575b334fd80 0x5575b3752710 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d899326b8119043d server_cookie=3eafb6488912cfb4 in_seq=0 out_seq=0 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.811+0000 7f96237fe640 10 client.19965 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.812+0000 7f96237fe640 1 -- 172.21.15.53:0/3203086218 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575b36abf50 con 0x5575b334fd80 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.812+0000 7f96237fe640 10 client.19965 handle_command_reply: tid=0 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.812+0000 7f96511e4740 1 client.19965 shutdown 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.812+0000 7f96511e4740 1 -- 172.21.15.53:0/3203086218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33911b0 msgr2=0x5575b374c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.812+0000 7f96511e4740 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33911b0 0x5575b374c560 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f963c000f80 tx=0x7f963c01a780 comp rx=0 tx=0).stop 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.813+0000 7f96511e4740 1 -- 172.21.15.53:0/3203086218 shutdown_connections 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.813+0000 7f96511e4740 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575b334fd80 0x5575b3752710 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.813+0000 7f96511e4740 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33911b0 0x5575b374c560 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.813+0000 7f96511e4740 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 0x5575b3740c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.813+0000 7f96237fe640 0 client.19965 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.813+0000 7f96511e4740 1 --2- 172.21.15.53:0/3203086218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33682f0 0x5575b37406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.813+0000 7f96511e4740 1 -- 172.21.15.53:0/3203086218 >> 172.21.15.53:0/3203086218 conn(0x5575b3385300 msgr2=0x5575b3735af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.813+0000 7f96511e4740 1 -- 172.21.15.53:0/3203086218 shutdown_connections 2024-08-31T06:19:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.813+0000 7f96511e4740 1 -- 172.21.15.53:0/3203086218 wait complete. 2024-08-31T06:19:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.813+0000 7f96511e4740 20 client.19965 trim_cache size 0 max 16384 2024-08-31T06:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.827+0000 7f96511e4740 1 Processor -- start 2024-08-31T06:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.827+0000 7f96511e4740 1 -- start start 2024-08-31T06:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f96511e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b334fd80 0x5575b373bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f96511e4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 0x5575b3742110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f96511e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 0x5575b374c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f96511e4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f96441af570 con 0x5575b33682f0 2024-08-31T06:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f96511e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f96441b12f0 con 0x5575b33704d0 2024-08-31T06:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f96511e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96441afc40 con 0x5575b334fd80 2024-08-31T06:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f963bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 0x5575b3742110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f963bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 0x5575b3742110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34866/0 (socket says 172.21.15.53:34866) 2024-08-31T06:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f963bfff640 1 -- 172.21.15.53:0/3705521391 learned_addr learned my addr 172.21.15.53:0/3705521391 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f964881b640 1 --2- 172.21.15.53:0/3705521391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b334fd80 0x5575b373bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f963bfff640 1 -- 172.21.15.53:0/3705521391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b334fd80 msgr2=0x5575b373bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f963bfff640 1 --2- 172.21.15.53:0/3705521391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b334fd80 0x5575b373bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f963bfff640 1 -- 172.21.15.53:0/3705521391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 msgr2=0x5575b374c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f963bfff640 1 --2- 172.21.15.53:0/3705521391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 0x5575b374c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f963bfff640 1 -- 172.21.15.53:0/3705521391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b37410f0 con 0x5575b33682f0 2024-08-31T06:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f963bfff640 1 --2- 172.21.15.53:0/3705521391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 0x5575b3742110 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f962c005ab0 tx=0x7f962c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877300fc00c19353 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f9639ffb640 1 -- 172.21.15.53:0/3705521391 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c035040 con 0x5575b33682f0 2024-08-31T06:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f9639ffb640 1 -- 172.21.15.53:0/3705521391 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f962c049070 con 0x5575b33682f0 2024-08-31T06:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.828+0000 7f9639ffb640 1 -- 172.21.15.53:0/3705521391 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c004920 con 0x5575b33682f0 2024-08-31T06:19:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.829+0000 7f96511e4740 1 -- 172.21.15.53:0/3705521391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 msgr2=0x5575b3742110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.829+0000 7f96511e4740 1 --2- 172.21.15.53:0/3705521391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 0x5575b3742110 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f962c005ab0 tx=0x7f962c005a20 comp rx=0 tx=0).stop 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.829+0000 7f96511e4740 1 -- 172.21.15.53:0/3705521391 shutdown_connections 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.829+0000 7f96511e4740 1 --2- 172.21.15.53:0/3705521391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 0x5575b374c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.829+0000 7f96511e4740 1 --2- 172.21.15.53:0/3705521391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b33682f0 0x5575b3742110 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.829+0000 7f96511e4740 1 --2- 172.21.15.53:0/3705521391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b334fd80 0x5575b373bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.829+0000 7f96511e4740 1 -- 172.21.15.53:0/3705521391 >> 172.21.15.53:0/3705521391 conn(0x5575b3385300 msgr2=0x5575b3741a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.829+0000 7f96511e4740 1 -- 172.21.15.53:0/3705521391 shutdown_connections 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.829+0000 7f96511e4740 1 -- 172.21.15.53:0/3705521391 wait complete. 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.829+0000 7f96511e4740 1 -- start start 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f96511e4740 1 Processor -- start 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f96511e4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b334fd80 0x5575b3746920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f96511e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33682f0 0x5575b3746ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f96511e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 0x5575b37bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f96511e4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f96441b0b60 con 0x5575b334fd80 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f96511e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f96441b03d0 con 0x5575b33704d0 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f96511e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96441ad570 con 0x5575b33682f0 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f96511e4740 10 client.0 _ll_register_callbacks cb 0x7f963c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f964881b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b334fd80 0x5575b3746920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f964881b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b334fd80 0x5575b3746920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34882/0 (socket says 172.21.15.53:34882) 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f964881b640 1 -- 172.21.15.53:0/2749480720 learned_addr learned my addr 172.21.15.53:0/2749480720 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f963bfff640 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33682f0 0x5575b3746ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.830+0000 7f964881b640 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 0x5575b37bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f964881b640 1 -- 172.21.15.53:0/2749480720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33682f0 msgr2=0x5575b3746ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f964881b640 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33682f0 0x5575b3746ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f964881b640 1 -- 172.21.15.53:0/2749480720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 msgr2=0x5575b37bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f964881b640 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 0x5575b37bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f964881b640 1 -- 172.21.15.53:0/2749480720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575b37bc400 con 0x5575b334fd80 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f964881b640 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b334fd80 0x5575b3746920 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f963c009b20 tx=0x7f963c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90d66a53968d54a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f96237fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f96237fe640 1 -- 172.21.15.53:0/2749480720 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c02d040 con 0x5575b334fd80 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f96237fe640 1 -- 172.21.15.53:0/2749480720 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f963c020040 con 0x5575b334fd80 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f96511e4740 1 -- 172.21.15.53:0/2749480720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f962c049070 con 0x5575b334fd80 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f96237fe640 1 -- 172.21.15.53:0/2749480720 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f963c028ba0 con 0x5575b334fd80 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f96511e4740 10 client.19971 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f96511e4740 1 -- 172.21.15.53:0/2749480720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5575b37bd590 con 0x5575b334fd80 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f96237fe640 1 -- 172.21.15.53:0/2749480720 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f962c049070 con 0x5575b334fd80 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.831+0000 7f96237fe640 1 -- 172.21.15.53:0/2749480720 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f963c011560 con 0x5575b334fd80 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.832+0000 7f96511e4740 10 client.19971 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.832+0000 7f96511e4740 10 client.19971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.832+0000 7f96511e4740 20 client.19971 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.832+0000 7f96511e4740 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575b33911b0 0x5575b37bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.832+0000 7f96511e4740 4 client.19971 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:19:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.832+0000 7f96511e4740 1 -- 172.21.15.53:0/2749480720 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5575b36a79f0 con 0x5575b33911b0 2024-08-31T06:19:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.832+0000 7f963bfff640 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575b33911b0 0x5575b37bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.832+0000 7f96237fe640 10 client.19971 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.832+0000 7f963bfff640 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575b33911b0 0x5575b37bfd00 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5657c3b8de879da4 server_cookie=afaef94952276d25 in_seq=0 out_seq=0 2024-08-31T06:19:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96237fe640 1 -- 172.21.15.53:0/2749480720 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5575b36a79f0 con 0x5575b33911b0 2024-08-31T06:19:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96237fe640 10 client.19971 handle_command_reply: tid=0 2024-08-31T06:19:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96511e4740 1 client.19971 shutdown 2024-08-31T06:19:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96511e4740 1 -- 172.21.15.53:0/2749480720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b334fd80 msgr2=0x5575b3746920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96511e4740 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b334fd80 0x5575b3746920 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f963c009b20 tx=0x7f963c009ed0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96511e4740 1 -- 172.21.15.53:0/2749480720 shutdown_connections 2024-08-31T06:19:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96511e4740 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575b33911b0 0x5575b37bfd00 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96511e4740 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575b33704d0 0x5575b37bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96511e4740 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575b33682f0 0x5575b3746ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96237fe640 0 client.19971 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:01.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96511e4740 1 --2- 172.21.15.53:0/2749480720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575b334fd80 0x5575b3746920 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96511e4740 1 -- 172.21.15.53:0/2749480720 >> 172.21.15.53:0/2749480720 conn(0x5575b3385300 msgr2=0x5575b37421d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:01.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96511e4740 1 -- 172.21.15.53:0/2749480720 shutdown_connections 2024-08-31T06:19:01.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.851+0000 7f96511e4740 1 -- 172.21.15.53:0/2749480720 wait complete. 2024-08-31T06:19:01.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f96511e4740 20 client.19971 trim_cache size 0 max 16384 2024-08-31T06:19:01.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:19:01.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:19:01.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:19:01.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:19:01.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 -- 172.21.15.53:0/2443573636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f96300b4d20 msgr2=0x7f96300b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:01.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f96300b4d20 0x7f96300b7230 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f96340e29e0 tx=0x7f963400df40 comp rx=0 tx=0).stop 2024-08-31T06:19:01.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 -- 172.21.15.53:0/2443573636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9644103870 msgr2=0x7f964419a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:01.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9644103870 0x7f964419a150 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f963400d950 tx=0x7f963400de10 comp rx=0 tx=0).stop 2024-08-31T06:19:01.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 -- 172.21.15.53:0/2443573636 shutdown_connections 2024-08-31T06:19:01.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f96300b4d20 0x7f96300b7230 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9644109af0 0x7f964419f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96441091a0 0x7f964419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 --2- 172.21.15.53:0/2443573636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9644103870 0x7f964419a150 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:01.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 -- 172.21.15.53:0/2443573636 >> 172.21.15.53:0/2443573636 conn(0x7f96440ff2b0 msgr2=0x7f96441016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:01.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 -- 172.21.15.53:0/2443573636 shutdown_connections 2024-08-31T06:19:01.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:01.852+0000 7f964a27e640 1 -- 172.21.15.53:0/2443573636 wait complete. 2024-08-31T06:19:02.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 7.98 MB/sec warmup 50 sec latency 25825.654 ms 2024-08-31T06:19:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:02 smithi053 ceph-mon[18924]: pgmap v761: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-08-31T06:19:02.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:02 smithi130 ceph-mon[22266]: pgmap v761: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-08-31T06:19:02.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:02 smithi153 ceph-mon[22320]: pgmap v761: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-08-31T06:19:03.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 7.82 MB/sec warmup 51 sec latency 26825.760 ms 2024-08-31T06:19:04.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 7.67 MB/sec warmup 52 sec latency 27825.826 ms 2024-08-31T06:19:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:04 smithi053 ceph-mon[18924]: pgmap v762: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 KiB/s wr, 13 op/s 2024-08-31T06:19:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:04 smithi130 ceph-mon[22266]: pgmap v762: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 KiB/s wr, 13 op/s 2024-08-31T06:19:04.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:04 smithi153 ceph-mon[22320]: pgmap v762: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 KiB/s wr, 13 op/s 2024-08-31T06:19:05.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 7.53 MB/sec warmup 53 sec latency 28825.944 ms 2024-08-31T06:19:05.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:19:06.053 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:06.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 7.39 MB/sec warmup 54 sec latency 29826.028 ms 2024-08-31T06:19:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:06 smithi053 ceph-mon[18924]: pgmap v763: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 40 KiB/s wr, 31 op/s 2024-08-31T06:19:06.477 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:06 smithi153 ceph-mon[22320]: pgmap v763: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 40 KiB/s wr, 31 op/s 2024-08-31T06:19:06.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:19:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:06 smithi130 ceph-mon[22266]: pgmap v763: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 40 KiB/s wr, 31 op/s 2024-08-31T06:19:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.732+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/3186302953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc68108140 msgr2=0x7fcc68108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.732+0000 7fcc6dfc9640 1 --2- 172.21.15.53:0/3186302953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc68108140 0x7fcc68108550 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009900 tx=0x7fcc5c02a410 comp rx=0 tx=0).stop 2024-08-31T06:19:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.732+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/3186302953 shutdown_connections 2024-08-31T06:19:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.732+0000 7fcc6dfc9640 1 --2- 172.21.15.53:0/3186302953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc68108a90 0x7fcc6810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.732+0000 7fcc6dfc9640 1 --2- 172.21.15.53:0/3186302953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc68108140 0x7fcc68108550 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.732+0000 7fcc6dfc9640 1 --2- 172.21.15.53:0/3186302953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc68102800 0x7fcc68102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.732+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/3186302953 >> 172.21.15.53:0/3186302953 conn(0x7fcc680794d0 msgr2=0x7fcc680798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.732+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/3186302953 shutdown_connections 2024-08-31T06:19:06.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.733+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/3186302953 wait complete. 2024-08-31T06:19:06.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.734+0000 7fcc6dfc9640 1 Processor -- start 2024-08-31T06:19:06.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.734+0000 7fcc6dfc9640 1 -- start start 2024-08-31T06:19:06.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.734+0000 7fcc6dfc9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc68102800 0x7fcc6819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.734+0000 7fcc6dfc9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc68108140 0x7fcc6819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.734+0000 7fcc6dfc9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc68108a90 0x7fcc6819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.734+0000 7fcc6dfc9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcc68112570 con 0x7fcc68108a90 2024-08-31T06:19:06.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.734+0000 7fcc6dfc9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcc681123f0 con 0x7fcc68102800 2024-08-31T06:19:06.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.734+0000 7fcc6dfc9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc681126f0 con 0x7fcc68108140 2024-08-31T06:19:06.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.734+0000 7fcc67fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc68108a90 0x7fcc6819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.734+0000 7fcc67fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc68108a90 0x7fcc6819f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38776/0 (socket says 172.21.15.53:38776) 2024-08-31T06:19:06.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.735+0000 7fcc67fff640 1 -- 172.21.15.53:0/2799827061 learned_addr learned my addr 172.21.15.53:0/2799827061 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:06.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.735+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc68108140 0x7fcc6819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.735+0000 7fcc677fe640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc68102800 0x7fcc6819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.735+0000 7fcc67fff640 1 -- 172.21.15.53:0/2799827061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc68108140 msgr2=0x7fcc6819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:06.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.735+0000 7fcc67fff640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc68108140 0x7fcc6819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.735+0000 7fcc67fff640 1 -- 172.21.15.53:0/2799827061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc68102800 msgr2=0x7fcc6819a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:06.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.735+0000 7fcc67fff640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc68102800 0x7fcc6819a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.735+0000 7fcc67fff640 1 -- 172.21.15.53:0/2799827061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc681a00e0 con 0x7fcc68108a90 2024-08-31T06:19:06.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.735+0000 7fcc67fff640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc68108a90 0x7fcc6819f9b0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000eaa0 tx=0x7fcc6000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:06.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.735+0000 7fcc64ff9640 1 -- 172.21.15.53:0/2799827061 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6000cdb0 con 0x7fcc68108a90 2024-08-31T06:19:06.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.735+0000 7fcc64ff9640 1 -- 172.21.15.53:0/2799827061 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc60005020 con 0x7fcc68108a90 2024-08-31T06:19:06.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.736+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/2799827061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc681a03d0 con 0x7fcc68108a90 2024-08-31T06:19:06.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.736+0000 7fcc64ff9640 1 -- 172.21.15.53:0/2799827061 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc600116d0 con 0x7fcc68108a90 2024-08-31T06:19:06.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.736+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/2799827061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc680ff2f0 con 0x7fcc68108a90 2024-08-31T06:19:06.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.738+0000 7fcc7453e740 1 Processor -- start 2024-08-31T06:19:06.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.738+0000 7fcc64ff9640 1 -- 172.21.15.53:0/2799827061 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcc60011870 con 0x7fcc68108a90 2024-08-31T06:19:06.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc7453e740 1 -- start start 2024-08-31T06:19:06.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb47792c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb4779800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43b3390 0x55cbb4779d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc7453e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cbb46f0630 con 0x55cbb43d4070 2024-08-31T06:19:06.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc7453e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cbb46dfbc0 con 0x55cbb43ab1b0 2024-08-31T06:19:06.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc7453e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cbb46e3b70 con 0x55cbb43b3390 2024-08-31T06:19:06.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc66ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb47792c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc66ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb47792c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38784/0 (socket says 172.21.15.53:38784) 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc66ffd640 1 -- 172.21.15.53:0/2572816054 learned_addr learned my addr 172.21.15.53:0/2572816054 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc677fe640 1 --2- 172.21.15.53:0/2572816054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb4779800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/2572816054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43b3390 0x55cbb4779d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.739+0000 7fcc64ff9640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcc500b4d20 0x7fcc500b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc677fe640 1 -- 172.21.15.53:0/2572816054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43b3390 msgr2=0x55cbb4779d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc677fe640 1 --2- 172.21.15.53:0/2572816054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43b3390 0x55cbb4779d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc677fe640 1 -- 172.21.15.53:0/2572816054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 msgr2=0x55cbb47792c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc677fe640 1 --2- 172.21.15.53:0/2572816054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb47792c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc67fff640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcc500b4d20 0x7fcc500b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc677fe640 1 -- 172.21.15.53:0/2572816054 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbb443f650 con 0x55cbb43ab1b0 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/2572816054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb47792c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc64ff9640 1 -- 172.21.15.53:0/2799827061 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7fcc600e5950 con 0x7fcc68108a90 2024-08-31T06:19:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc677fe640 1 --2- 172.21.15.53:0/2572816054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb4779800 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcc58005fd0 tx=0x7fcc580107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee58d7135bc0ecc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:06.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc4dffb640 1 -- 172.21.15.53:0/2572816054 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5801c680 con 0x55cbb43ab1b0 2024-08-31T06:19:06.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc4dffb640 1 -- 172.21.15.53:0/2572816054 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc5800be20 con 0x55cbb43ab1b0 2024-08-31T06:19:06.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.740+0000 7fcc4dffb640 1 -- 172.21.15.53:0/2572816054 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc58011b90 con 0x55cbb43ab1b0 2024-08-31T06:19:06.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.742+0000 7fcc7453e740 1 -- 172.21.15.53:0/2572816054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 msgr2=0x55cbb4779800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:06.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.742+0000 7fcc67fff640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcc500b4d20 0x7fcc500b7230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcc600e3650 tx=0x7fcc60093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:06.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.742+0000 7fcc7453e740 1 --2- 172.21.15.53:0/2572816054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb4779800 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcc58005fd0 tx=0x7fcc580107a0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.742+0000 7fcc7453e740 1 -- 172.21.15.53:0/2572816054 shutdown_connections 2024-08-31T06:19:06.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.742+0000 7fcc7453e740 1 --2- 172.21.15.53:0/2572816054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43b3390 0x55cbb4779d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.742+0000 7fcc7453e740 1 --2- 172.21.15.53:0/2572816054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb4779800 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.742+0000 7fcc7453e740 1 --2- 172.21.15.53:0/2572816054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb47792c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.742+0000 7fcc7453e740 1 -- 172.21.15.53:0/2572816054 >> 172.21.15.53:0/2572816054 conn(0x55cbb43c8460 msgr2=0x55cbb47771b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:06.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.742+0000 7fcc7453e740 1 -- 172.21.15.53:0/2572816054 shutdown_connections 2024-08-31T06:19:06.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.742+0000 7fcc7453e740 1 -- 172.21.15.53:0/2572816054 wait complete. 2024-08-31T06:19:06.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.742+0000 7fcc7453e740 1 -- start start 2024-08-31T06:19:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc7453e740 1 Processor -- start 2024-08-31T06:19:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb478dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43b3390 0x55cbb478e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb4793200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc7453e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cbb4542700 con 0x55cbb43d4070 2024-08-31T06:19:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc7453e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cbb4666700 con 0x55cbb43ab1b0 2024-08-31T06:19:06.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc7453e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cbb4787aa0 con 0x55cbb43b3390 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc7453e740 10 client.0 _ll_register_callbacks cb 0x55cbb4695dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc66ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb4793200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc677fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43b3390 0x55cbb478e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc66ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb4793200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38788/0 (socket says 172.21.15.53:38788) 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.743+0000 7fcc66ffd640 1 -- 172.21.15.53:0/3433437175 learned_addr learned my addr 172.21.15.53:0/3433437175 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.744+0000 7fcc677fe640 1 -- 172.21.15.53:0/3433437175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 msgr2=0x55cbb478dc00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.744+0000 7fcc677fe640 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb478dc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.744+0000 7fcc677fe640 1 -- 172.21.15.53:0/3433437175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 msgr2=0x55cbb4793200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.744+0000 7fcc677fe640 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb4793200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.744+0000 7fcc677fe640 1 -- 172.21.15.53:0/3433437175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbb469f8b0 con 0x55cbb43b3390 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.744+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb4793200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.744+0000 7fcc677fe640 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43b3390 0x55cbb478e1e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcc58011770 tx=0x7fcc58011670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9759881f108b9cc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:06.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.744+0000 7fcc46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:19:06.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.744+0000 7fcc46ffd640 1 -- 172.21.15.53:0/3433437175 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc58011de0 con 0x55cbb43b3390 2024-08-31T06:19:06.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.745+0000 7fcc46ffd640 1 -- 172.21.15.53:0/3433437175 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7fcc58005040 con 0x55cbb43b3390 2024-08-31T06:19:06.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.745+0000 7fcc7453e740 1 -- 172.21.15.53:0/3433437175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc5800be20 con 0x55cbb43b3390 2024-08-31T06:19:06.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.745+0000 7fcc46ffd640 1 -- 172.21.15.53:0/3433437175 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fcc58032050 con 0x55cbb43b3390 2024-08-31T06:19:06.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.745+0000 7fcc7453e740 10 client.28960 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:06.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.745+0000 7fcc7453e740 1 -- 172.21.15.53:0/3433437175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55cbb479c150 con 0x55cbb43b3390 2024-08-31T06:19:06.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.745+0000 7fcc46ffd640 1 -- 172.21.15.53:0/3433437175 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc5800be20 con 0x55cbb43b3390 2024-08-31T06:19:06.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.745+0000 7fcc46ffd640 1 -- 172.21.15.53:0/3433437175 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fcc5802d030 con 0x55cbb43b3390 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.746+0000 7fcc7453e740 10 client.28960 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.746+0000 7fcc7453e740 10 client.28960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.746+0000 7fcc7453e740 20 client.28960 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.746+0000 7fcc7453e740 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cbb43929f0 0x55cbb479f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.746+0000 7fcc7453e740 4 client.28960 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.746+0000 7fcc7453e740 1 -- 172.21.15.53:0/3433437175 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbb46f2580 con 0x55cbb43929f0 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.746+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cbb43929f0 0x55cbb479f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.746+0000 7fcc46ffd640 10 client.28960 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.746+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cbb43929f0 0x55cbb479f4b0 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e09db37aa0714972 server_cookie=85f7390dbbaabb5c in_seq=0 out_seq=0 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.747+0000 7fcc46ffd640 1 -- 172.21.15.53:0/3433437175 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cbb46f2580 con 0x55cbb43929f0 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.747+0000 7fcc46ffd640 10 client.28960 handle_command_reply: tid=0 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.747+0000 7fcc7453e740 1 client.28960 shutdown 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc7453e740 1 -- 172.21.15.53:0/3433437175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43b3390 msgr2=0x55cbb478e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:06.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc7453e740 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43b3390 0x55cbb478e1e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcc58011770 tx=0x7fcc58011670 comp rx=0 tx=0).stop 2024-08-31T06:19:06.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc7453e740 1 -- 172.21.15.53:0/3433437175 shutdown_connections 2024-08-31T06:19:06.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc7453e740 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cbb43929f0 0x55cbb479f4b0 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc7453e740 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43d4070 0x55cbb4793200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc46ffd640 0 client.28960 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:06.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc7453e740 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43b3390 0x55cbb478e1e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc7453e740 1 --2- 172.21.15.53:0/3433437175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb478dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc7453e740 1 -- 172.21.15.53:0/3433437175 >> 172.21.15.53:0/3433437175 conn(0x55cbb43c8460 msgr2=0x55cbb477c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:06.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc7453e740 1 -- 172.21.15.53:0/3433437175 shutdown_connections 2024-08-31T06:19:06.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc7453e740 1 -- 172.21.15.53:0/3433437175 wait complete. 2024-08-31T06:19:06.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.748+0000 7fcc7453e740 20 client.28960 trim_cache size 0 max 16384 2024-08-31T06:19:06.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc7453e740 1 Processor -- start 2024-08-31T06:19:06.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc7453e740 1 -- start start 2024-08-31T06:19:06.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43929f0 0x55cbb478e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43ab1b0 0x55cbb4793170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43b3390 0x55cbb47936b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc7453e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcc681ad370 con 0x55cbb43ab1b0 2024-08-31T06:19:06.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc7453e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcc681af0f0 con 0x55cbb43b3390 2024-08-31T06:19:06.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc7453e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc681ada40 con 0x55cbb43929f0 2024-08-31T06:19:06.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc677fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43ab1b0 0x55cbb4793170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc677fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43ab1b0 0x55cbb4793170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38804/0 (socket says 172.21.15.53:38804) 2024-08-31T06:19:06.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc677fe640 1 -- 172.21.15.53:0/1257273763 learned_addr learned my addr 172.21.15.53:0/1257273763 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:06.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/1257273763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43929f0 0x55cbb478e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/1257273763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43b3390 0x55cbb47936b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc677fe640 1 -- 172.21.15.53:0/1257273763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43929f0 msgr2=0x55cbb478e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:06.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc677fe640 1 --2- 172.21.15.53:0/1257273763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43929f0 0x55cbb478e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.767+0000 7fcc677fe640 1 -- 172.21.15.53:0/1257273763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43b3390 msgr2=0x55cbb47936b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:06.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.768+0000 7fcc677fe640 1 --2- 172.21.15.53:0/1257273763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43b3390 0x55cbb47936b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.768+0000 7fcc677fe640 1 -- 172.21.15.53:0/1257273763 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbb478ecc0 con 0x55cbb43ab1b0 2024-08-31T06:19:06.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.768+0000 7fcc677fe640 1 --2- 172.21.15.53:0/1257273763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43ab1b0 0x55cbb4793170 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fcc58000c00 tx=0x7fcc5800bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d26c9a6868d755 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:06.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.768+0000 7fcc4d7fa640 1 -- 172.21.15.53:0/1257273763 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5801c480 con 0x55cbb43ab1b0 2024-08-31T06:19:06.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.768+0000 7fcc4d7fa640 1 -- 172.21.15.53:0/1257273763 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc58004af0 con 0x55cbb43ab1b0 2024-08-31T06:19:06.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.768+0000 7fcc4d7fa640 1 -- 172.21.15.53:0/1257273763 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5801cb40 con 0x55cbb43ab1b0 2024-08-31T06:19:06.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.769+0000 7fcc7453e740 1 -- 172.21.15.53:0/1257273763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43ab1b0 msgr2=0x55cbb4793170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:06.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.769+0000 7fcc7453e740 1 --2- 172.21.15.53:0/1257273763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43ab1b0 0x55cbb4793170 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fcc58000c00 tx=0x7fcc5800bba0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.769+0000 7fcc7453e740 1 -- 172.21.15.53:0/1257273763 shutdown_connections 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.769+0000 7fcc7453e740 1 --2- 172.21.15.53:0/1257273763 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43b3390 0x55cbb47936b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.769+0000 7fcc7453e740 1 --2- 172.21.15.53:0/1257273763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43ab1b0 0x55cbb4793170 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.769+0000 7fcc7453e740 1 --2- 172.21.15.53:0/1257273763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43929f0 0x55cbb478e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.769+0000 7fcc7453e740 1 -- 172.21.15.53:0/1257273763 >> 172.21.15.53:0/1257273763 conn(0x55cbb43c8460 msgr2=0x55cbb478dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.769+0000 7fcc7453e740 1 -- 172.21.15.53:0/1257273763 shutdown_connections 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.769+0000 7fcc7453e740 1 -- 172.21.15.53:0/1257273763 wait complete. 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc7453e740 1 -- start start 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc7453e740 1 Processor -- start 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43929f0 0x55cbb47955e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb4795b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc7453e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43b3390 0x55cbb4796060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc7453e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcc681ae960 con 0x55cbb43b3390 2024-08-31T06:19:06.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc7453e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcc681ae1d0 con 0x55cbb43ab1b0 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc7453e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc681ab370 con 0x55cbb43929f0 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc7453e740 10 client.0 _ll_register_callbacks cb 0x7fcc5c0095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc66ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43b3390 0x55cbb4796060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc66ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43b3390 0x55cbb4796060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38816/0 (socket says 172.21.15.53:38816) 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc66ffd640 1 -- 172.21.15.53:0/1051707762 learned_addr learned my addr 172.21.15.53:0/1051707762 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.770+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43929f0 0x55cbb47955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.771+0000 7fcc677fe640 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb4795b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.771+0000 7fcc66ffd640 1 -- 172.21.15.53:0/1051707762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43929f0 msgr2=0x55cbb47955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.771+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43929f0 0x55cbb47955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.771+0000 7fcc66ffd640 1 -- 172.21.15.53:0/1051707762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 msgr2=0x55cbb4795b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.771+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb4795b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.771+0000 7fcc66ffd640 1 -- 172.21.15.53:0/1051707762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbb4808ce0 con 0x55cbb43b3390 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.771+0000 7fcc66ffd640 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43b3390 0x55cbb4796060 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c02a930 tx=0x7fcc5c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de2dbb39a02b978 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:06.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.771+0000 7fcc46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:06.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.771+0000 7fcc46ffd640 1 -- 172.21.15.53:0/1051707762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c035040 con 0x55cbb43b3390 2024-08-31T06:19:06.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.771+0000 7fcc46ffd640 1 -- 172.21.15.53:0/1051707762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7fcc5c031b60 con 0x55cbb43b3390 2024-08-31T06:19:06.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.771+0000 7fcc7453e740 1 -- 172.21.15.53:0/1051707762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc58004af0 con 0x55cbb43b3390 2024-08-31T06:19:06.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.772+0000 7fcc46ffd640 1 -- 172.21.15.53:0/1051707762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fcc5c031d60 con 0x55cbb43b3390 2024-08-31T06:19:06.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.772+0000 7fcc7453e740 10 client.19989 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:06.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.772+0000 7fcc7453e740 1 -- 172.21.15.53:0/1051707762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55cbb4809f70 con 0x55cbb43b3390 2024-08-31T06:19:06.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.772+0000 7fcc46ffd640 1 -- 172.21.15.53:0/1051707762 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc58004af0 con 0x55cbb43b3390 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.772+0000 7fcc46ffd640 1 -- 172.21.15.53:0/1051707762 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fcc5c051070 con 0x55cbb43b3390 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.772+0000 7fcc7453e740 10 client.19989 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.772+0000 7fcc7453e740 10 client.19989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.772+0000 7fcc7453e740 20 client.19989 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.772+0000 7fcc7453e740 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cbb43d4070 0x55cbb480c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.772+0000 7fcc7453e740 4 client.19989 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.772+0000 7fcc7453e740 1 -- 172.21.15.53:0/1051707762 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cbb46ee020 con 0x55cbb43d4070 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.773+0000 7fcc677fe640 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cbb43d4070 0x55cbb480c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.773+0000 7fcc677fe640 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cbb43d4070 0x55cbb480c7d0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60f559b613d5bc4f server_cookie=38f680a59b169e11 in_seq=0 out_seq=0 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.773+0000 7fcc46ffd640 10 client.19989 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.773+0000 7fcc46ffd640 1 -- 172.21.15.53:0/1051707762 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x55cbb46ee020 con 0x55cbb43d4070 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.773+0000 7fcc46ffd640 10 client.19989 handle_command_reply: tid=0 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.773+0000 7fcc7453e740 1 client.19989 shutdown 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc7453e740 1 -- 172.21.15.53:0/1051707762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43b3390 msgr2=0x55cbb4796060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:06.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc7453e740 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43b3390 0x55cbb4796060 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c02a930 tx=0x7fcc5c02a410 comp rx=0 tx=0).stop 2024-08-31T06:19:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc7453e740 1 -- 172.21.15.53:0/1051707762 shutdown_connections 2024-08-31T06:19:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc7453e740 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cbb43d4070 0x55cbb480c7d0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc7453e740 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbb43b3390 0x55cbb4796060 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc7453e740 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cbb43ab1b0 0x55cbb4795b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc46ffd640 0 client.19989 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc7453e740 1 --2- 172.21.15.53:0/1051707762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cbb43929f0 0x55cbb47955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc7453e740 1 -- 172.21.15.53:0/1051707762 >> 172.21.15.53:0/1051707762 conn(0x55cbb43c8460 msgr2=0x55cbb477c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc7453e740 1 -- 172.21.15.53:0/1051707762 shutdown_connections 2024-08-31T06:19:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc7453e740 1 -- 172.21.15.53:0/1051707762 wait complete. 2024-08-31T06:19:06.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.774+0000 7fcc7453e740 20 client.19989 trim_cache size 0 max 16384 2024-08-31T06:19:06.780 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.781 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:19:06.782 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:19:06.783 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.784 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.785 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.786 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.787 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.788 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:19:06.789 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:06.790 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:06.791 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:06.791 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:06.791 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:19:06.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/2799827061 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcc500b4d20 msgr2=0x7fcc500b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:06.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcc500b4d20 0x7fcc500b7230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcc600e3650 tx=0x7fcc60093040 comp rx=0 tx=0).stop 2024-08-31T06:19:06.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/2799827061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc68108a90 msgr2=0x7fcc6819f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:06.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc68108a90 0x7fcc6819f9b0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000eaa0 tx=0x7fcc6000ef60 comp rx=0 tx=0).stop 2024-08-31T06:19:06.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/2799827061 shutdown_connections 2024-08-31T06:19:06.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcc500b4d20 0x7fcc500b7230 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc68108a90 0x7fcc6819f9b0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc68108140 0x7fcc6819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 --2- 172.21.15.53:0/2799827061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc68102800 0x7fcc6819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:06.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/2799827061 >> 172.21.15.53:0/2799827061 conn(0x7fcc680794d0 msgr2=0x7fcc6806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:06.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/2799827061 shutdown_connections 2024-08-31T06:19:06.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:06.775+0000 7fcc6dfc9640 1 -- 172.21.15.53:0/2799827061 wait complete. 2024-08-31T06:19:07.034 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:07.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 7.25 MB/sec warmup 55 sec latency 30826.139 ms 2024-08-31T06:19:07.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:07 smithi053 ceph-mon[18924]: osdmap e91: 12 total, 12 up, 12 in 2024-08-31T06:19:07.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:07 smithi130 ceph-mon[22266]: osdmap e91: 12 total, 12 up, 12 in 2024-08-31T06:19:07.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:07 smithi153 ceph-mon[22320]: osdmap e91: 12 total, 12 up, 12 in 2024-08-31T06:19:07.713 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:19:07.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:19:08.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.160+0000 7f8dae45f640 1 -- 172.21.15.53:0/505460982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8da8109240 msgr2=0x7f8da8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:08.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.160+0000 7f8dae45f640 1 --2- 172.21.15.53:0/505460982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8da8109240 0x7f8da8109650 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009900 tx=0x7f8d9c02a410 comp rx=0 tx=0).stop 2024-08-31T06:19:08.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.160+0000 7f8dae45f640 1 -- 172.21.15.53:0/505460982 shutdown_connections 2024-08-31T06:19:08.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.160+0000 7f8dae45f640 1 --2- 172.21.15.53:0/505460982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8da8109b90 0x7f8da81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.160+0000 7f8dae45f640 1 --2- 172.21.15.53:0/505460982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8da8109240 0x7f8da8109650 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.160+0000 7f8dae45f640 1 --2- 172.21.15.53:0/505460982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8da8103900 0x7f8da8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.160+0000 7f8dae45f640 1 -- 172.21.15.53:0/505460982 >> 172.21.15.53:0/505460982 conn(0x7f8da807b5f0 msgr2=0x7f8da807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:08.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.160+0000 7f8dae45f640 1 -- 172.21.15.53:0/505460982 shutdown_connections 2024-08-31T06:19:08.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.160+0000 7f8dae45f640 1 -- 172.21.15.53:0/505460982 wait complete. 2024-08-31T06:19:08.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.161+0000 7f8dae45f640 1 Processor -- start 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.161+0000 7f8dae45f640 1 -- start start 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8dae45f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8da8103900 0x7f8da819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8dae45f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8da8109240 0x7f8da819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8dae45f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8da8109b90 0x7f8da819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8dae45f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8113720 con 0x7f8da8109240 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8dae45f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81135a0 con 0x7f8da8109b90 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8dae45f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81138a0 con 0x7f8da8103900 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8da77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8da8109240 0x7f8da819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8da77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8da8109240 0x7f8da819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38832/0 (socket says 172.21.15.53:38832) 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8da77fe640 1 -- 172.21.15.53:0/1002906983 learned_addr learned my addr 172.21.15.53:0/1002906983 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8dac9fc640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8da8109b90 0x7f8da819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8da7fff640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8da8103900 0x7f8da819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:08.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8da77fe640 1 -- 172.21.15.53:0/1002906983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8da8103900 msgr2=0x7f8da819a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8da77fe640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8da8103900 0x7f8da819a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8da77fe640 1 -- 172.21.15.53:0/1002906983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8da8109b90 msgr2=0x7f8da819f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8da77fe640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8da8109b90 0x7f8da819f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.162+0000 7f8da77fe640 1 -- 172.21.15.53:0/1002906983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da81a0100 con 0x7f8da8109240 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.163+0000 7f8da77fe640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8da8109240 0x7f8da819a730 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005940 tx=0x7f8d9c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.163+0000 7f8da57fa640 1 -- 172.21.15.53:0/1002906983 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c03f030 con 0x7f8da8109240 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.163+0000 7f8da57fa640 1 -- 172.21.15.53:0/1002906983 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d9c003c90 con 0x7f8da8109240 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.163+0000 7f8dae45f640 1 -- 172.21.15.53:0/1002906983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da81a0390 con 0x7f8da8109240 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.163+0000 7f8da57fa640 1 -- 172.21.15.53:0/1002906983 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c035070 con 0x7f8da8109240 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.163+0000 7f8dae45f640 1 -- 172.21.15.53:0/1002906983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da81a6b50 con 0x7f8da8109240 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.164+0000 7f8dae45f640 1 -- 172.21.15.53:0/1002906983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da8103d10 con 0x7f8da8109240 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.166+0000 7f8da57fa640 1 -- 172.21.15.53:0/1002906983 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8d9c042030 con 0x7f8da8109240 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.166+0000 7f8da57fa640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d900b4ca0 0x7f8d900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:08.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.166+0000 7f8da57fa640 1 -- 172.21.15.53:0/1002906983 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7f8d9c105f80 con 0x7f8da8109240 2024-08-31T06:19:08.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.166+0000 7f8da7fff640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d900b4ca0 0x7f8d900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:08.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.167+0000 7f8da7fff640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d900b4ca0 0x7f8d900b71b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8d980058c0 tx=0x7f8d9800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:08.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.170+0000 7f8da57fa640 1 -- 172.21.15.53:0/1002906983 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d9c0cc6d0 con 0x7f8da8109240 2024-08-31T06:19:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:08.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 7.12 MB/sec warmup 56 sec latency 31826.167 ms 2024-08-31T06:19:08.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.396+0000 7f8dae45f640 1 -- 172.21.15.53:0/1002906983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8da810b980 con 0x7f8da8109240 2024-08-31T06:19:08.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.397+0000 7f8da57fa640 1 -- 172.21.15.53:0/1002906983 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+12011 (secure 0 0 0) 0x7f8d9c0d0e90 con 0x7f8da8109240 2024-08-31T06:19:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:19:08.400 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":56,"btime":"2024-08-31T06:18:21:665793+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:18:21.236924+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:19:08.401 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 56 2024-08-31T06:19:08.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 -- 172.21.15.53:0/1002906983 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d900b4ca0 msgr2=0x7f8d900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:08.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d900b4ca0 0x7f8d900b71b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8d980058c0 tx=0x7f8d9800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 -- 172.21.15.53:0/1002906983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8da8109240 msgr2=0x7f8da819a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:08.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8da8109240 0x7f8da819a730 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005940 tx=0x7f8d9c0042f0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 -- 172.21.15.53:0/1002906983 shutdown_connections 2024-08-31T06:19:08.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d900b4ca0 0x7f8d900b71b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8da8109b90 0x7f8da819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8da8109240 0x7f8da819a730 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 --2- 172.21.15.53:0/1002906983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8da8103900 0x7f8da819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 -- 172.21.15.53:0/1002906983 >> 172.21.15.53:0/1002906983 conn(0x7f8da807b5f0 msgr2=0x7f8da8107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:08.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 -- 172.21.15.53:0/1002906983 shutdown_connections 2024-08-31T06:19:08.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.399+0000 7f8dae45f640 1 -- 172.21.15.53:0/1002906983 wait complete. 2024-08-31T06:19:08.481 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:08 smithi053 ceph-mon[18924]: pgmap v765: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 70 KiB/s wr, 37 op/s 2024-08-31T06:19:08.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:08 smithi130 ceph-mon[22266]: pgmap v765: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 70 KiB/s wr, 37 op/s 2024-08-31T06:19:08.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:08 smithi153 ceph-mon[22320]: pgmap v765: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 70 KiB/s wr, 37 op/s 2024-08-31T06:19:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.849+0000 7fa8c473d640 1 -- 172.21.15.53:0/1193917509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8bc1081a0 msgr2=0x7fa8bc1085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.849+0000 7fa8c473d640 1 --2- 172.21.15.53:0/1193917509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8bc1081a0 0x7fa8bc1085b0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009900 tx=0x7fa8b002a410 comp rx=0 tx=0).stop 2024-08-31T06:19:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.850+0000 7fa8c473d640 1 -- 172.21.15.53:0/1193917509 shutdown_connections 2024-08-31T06:19:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.850+0000 7fa8c473d640 1 --2- 172.21.15.53:0/1193917509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8bc108af0 0x7fa8bc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.850+0000 7fa8c473d640 1 --2- 172.21.15.53:0/1193917509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8bc1081a0 0x7fa8bc1085b0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.850+0000 7fa8c473d640 1 --2- 172.21.15.53:0/1193917509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8bc102f30 0x7fa8bc103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.850+0000 7fa8c473d640 1 -- 172.21.15.53:0/1193917509 >> 172.21.15.53:0/1193917509 conn(0x7fa8bc079d30 msgr2=0x7fa8bc07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:08.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.850+0000 7fa8c473d640 1 -- 172.21.15.53:0/1193917509 shutdown_connections 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.850+0000 7fa8c473d640 1 -- 172.21.15.53:0/1193917509 wait complete. 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.850+0000 7fa8c473d640 1 Processor -- start 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.850+0000 7fa8c473d640 1 -- start start 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c473d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8bc102f30 0x7fa8bc19b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c473d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8bc1081a0 0x7fa8bc19b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c473d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8bc108af0 0x7fa8bc19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c473d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc112660 con 0x7fa8bc102f30 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c473d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc1124e0 con 0x7fa8bc108af0 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c473d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc1127e0 con 0x7fa8bc1081a0 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c24d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8bc102f30 0x7fa8bc19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c24d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8bc102f30 0x7fa8bc19b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38840/0 (socket says 172.21.15.53:38840) 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c24d9640 1 -- 172.21.15.53:0/562186708 learned_addr learned my addr 172.21.15.53:0/562186708 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c1cd8640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8bc1081a0 0x7fa8bc19b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:08.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c2cda640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8bc108af0 0x7fa8bc19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c24d9640 1 -- 172.21.15.53:0/562186708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8bc1081a0 msgr2=0x7fa8bc19b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c24d9640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8bc1081a0 0x7fa8bc19b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c24d9640 1 -- 172.21.15.53:0/562186708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8bc108af0 msgr2=0x7fa8bc19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c24d9640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8bc108af0 0x7fa8bc19bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c24d9640 1 -- 172.21.15.53:0/562186708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc1a6250 con 0x7fa8bc102f30 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c24d9640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8bc102f30 0x7fa8bc19b050 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800d950 tx=0x7fa8b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8af7fe640 1 -- 172.21.15.53:0/562186708 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8017070 con 0x7fa8bc102f30 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8af7fe640 1 -- 172.21.15.53:0/562186708 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8b8009c30 con 0x7fa8bc102f30 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8c473d640 1 -- 172.21.15.53:0/562186708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8bc1a6540 con 0x7fa8bc102f30 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.851+0000 7fa8af7fe640 1 -- 172.21.15.53:0/562186708 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800f620 con 0x7fa8bc102f30 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.852+0000 7fa8c473d640 1 -- 172.21.15.53:0/562186708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8bc1a6a50 con 0x7fa8bc102f30 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.853+0000 7fa8c473d640 1 -- 172.21.15.53:0/562186708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8bc103cb0 con 0x7fa8bc102f30 2024-08-31T06:19:08.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.854+0000 7fa8af7fe640 1 -- 172.21.15.53:0/562186708 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa8b8010460 con 0x7fa8bc102f30 2024-08-31T06:19:08.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.855+0000 7fa8af7fe640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8a80b4cd0 0x7fa8a80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:08.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.855+0000 7fa8c1cd8640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8a80b4cd0 0x7fa8a80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:08.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.855+0000 7fa8af7fe640 1 -- 172.21.15.53:0/562186708 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7fa8b80e5170 con 0x7fa8bc102f30 2024-08-31T06:19:08.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.855+0000 7fa8c1cd8640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8a80b4cd0 0x7fa8a80b71e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa8b002a930 tx=0x7fa8b0005a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:08.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:08.859+0000 7fa8af7fe640 1 -- 172.21.15.53:0/562186708 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa8b8009de0 con 0x7fa8bc102f30 2024-08-31T06:19:09.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.083+0000 7fa8c473d640 1 -- 172.21.15.53:0/562186708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8bc103340 con 0x7fa8bc102f30 2024-08-31T06:19:09.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.084+0000 7fa8af7fe640 1 -- 172.21.15.53:0/562186708 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+12011 (secure 0 0 0) 0x7fa8b80b43f0 con 0x7fa8bc102f30 2024-08-31T06:19:09.087 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:19:09.087 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":56,"btime":"2024-08-31T06:18:21:665793+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:18:21.236924+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:19:09.088 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 56 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.086+0000 7fa8c473d640 1 -- 172.21.15.53:0/562186708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8a80b4cd0 msgr2=0x7fa8a80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.086+0000 7fa8c473d640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8a80b4cd0 0x7fa8a80b71e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa8b002a930 tx=0x7fa8b0005a40 comp rx=0 tx=0).stop 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.086+0000 7fa8c473d640 1 -- 172.21.15.53:0/562186708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8bc102f30 msgr2=0x7fa8bc19b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.086+0000 7fa8c473d640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8bc102f30 0x7fa8bc19b050 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800d950 tx=0x7fa8b800de10 comp rx=0 tx=0).stop 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.087+0000 7fa8c473d640 1 -- 172.21.15.53:0/562186708 shutdown_connections 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.087+0000 7fa8c473d640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa8a80b4cd0 0x7fa8a80b71e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.087+0000 7fa8c473d640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8bc108af0 0x7fa8bc19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.087+0000 7fa8c473d640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8bc1081a0 0x7fa8bc19b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.087+0000 7fa8c473d640 1 --2- 172.21.15.53:0/562186708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8bc102f30 0x7fa8bc19b050 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.087+0000 7fa8c473d640 1 -- 172.21.15.53:0/562186708 >> 172.21.15.53:0/562186708 conn(0x7fa8bc079d30 msgr2=0x7fa8bc106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.087+0000 7fa8c473d640 1 -- 172.21.15.53:0/562186708 shutdown_connections 2024-08-31T06:19:09.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:09.087+0000 7fa8c473d640 1 -- 172.21.15.53:0/562186708 wait complete. 2024-08-31T06:19:09.339 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:09 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1002906983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:19:09.340 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:09 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/562186708' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:19:09.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 7.00 MB/sec warmup 57 sec latency 32826.213 ms 2024-08-31T06:19:09.368 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id 22799662 --release --await' 2024-08-31T06:19:09.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id 22799662 --release --await 2024-08-31T06:19:09.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:09 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1002906983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:19:09.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:09 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/562186708' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:19:09.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:09 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1002906983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:19:09.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:09 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/562186708' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:19:10.072 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:19:10.155 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:10.303 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:10 smithi053 ceph-mon[18924]: pgmap v766: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 70 KiB/s wr, 36 op/s 2024-08-31T06:19:10.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4110 6.88 MB/sec warmup 58 sec latency 33826.308 ms 2024-08-31T06:19:10.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:10 smithi130 ceph-mon[22266]: pgmap v766: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 70 KiB/s wr, 36 op/s 2024-08-31T06:19:10.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:10 smithi153 ceph-mon[22320]: pgmap v766: 97 pgs: 97 active+clean; 349 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 70 KiB/s wr, 36 op/s 2024-08-31T06:19:10.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.678+0000 7fe626930640 1 -- 172.21.15.53:0/2556488827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe620108220 msgr2=0x7fe62010ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:10.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.678+0000 7fe626930640 1 --2- 172.21.15.53:0/2556488827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe620108220 0x7fe62010ea50 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fe61800adb0 tx=0x7fe61802b7a0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.678+0000 7fe626930640 1 -- 172.21.15.53:0/2556488827 shutdown_connections 2024-08-31T06:19:10.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.678+0000 7fe626930640 1 --2- 172.21.15.53:0/2556488827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe620108220 0x7fe62010ea50 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.678+0000 7fe626930640 1 --2- 172.21.15.53:0/2556488827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6201078d0 0x7fe620107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.678+0000 7fe626930640 1 --2- 172.21.15.53:0/2556488827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe620101f90 0x7fe6201023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.678+0000 7fe626930640 1 -- 172.21.15.53:0/2556488827 >> 172.21.15.53:0/2556488827 conn(0x7fe620077a00 msgr2=0x7fe620077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:10.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.678+0000 7fe626930640 1 -- 172.21.15.53:0/2556488827 shutdown_connections 2024-08-31T06:19:10.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.678+0000 7fe626930640 1 -- 172.21.15.53:0/2556488827 wait complete. 2024-08-31T06:19:10.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.679+0000 7fe626930640 1 Processor -- start 2024-08-31T06:19:10.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.679+0000 7fe626930640 1 -- start start 2024-08-31T06:19:10.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.679+0000 7fe626930640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe620101f90 0x7fe62019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.679+0000 7fe626930640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6201078d0 0x7fe62019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.679+0000 7fe626930640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620108220 0x7fe62019f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.679+0000 7fe626930640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe620111510 con 0x7fe620101f90 2024-08-31T06:19:10.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.679+0000 7fe626930640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe620111390 con 0x7fe6201078d0 2024-08-31T06:19:10.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.679+0000 7fe626930640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe620111690 con 0x7fe620108220 2024-08-31T06:19:10.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.679+0000 7fe61ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe620101f90 0x7fe62019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe620101f90 0x7fe62019a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38854/0 (socket says 172.21.15.53:38854) 2024-08-31T06:19:10.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61ffff640 1 -- 172.21.15.53:0/648812613 learned_addr learned my addr 172.21.15.53:0/648812613 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:10.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61f7fe640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6201078d0 0x7fe62019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe624ecd640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620108220 0x7fe62019f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61ffff640 1 -- 172.21.15.53:0/648812613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620108220 msgr2=0x7fe62019f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:10.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61ffff640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620108220 0x7fe62019f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61ffff640 1 -- 172.21.15.53:0/648812613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6201078d0 msgr2=0x7fe62019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:10.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61ffff640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6201078d0 0x7fe62019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61ffff640 1 -- 172.21.15.53:0/648812613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6201a0050 con 0x7fe620101f90 2024-08-31T06:19:10.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61ffff640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe620101f90 0x7fe62019a0e0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c890 tx=0x7fe61000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:10.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61d7fa640 1 -- 172.21.15.53:0/648812613 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610004220 con 0x7fe620101f90 2024-08-31T06:19:10.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe626930640 1 -- 172.21.15.53:0/648812613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6201a0340 con 0x7fe620101f90 2024-08-31T06:19:10.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61d7fa640 1 -- 172.21.15.53:0/648812613 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe610007e40 con 0x7fe620101f90 2024-08-31T06:19:10.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe61d7fa640 1 -- 172.21.15.53:0/648812613 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610004a00 con 0x7fe620101f90 2024-08-31T06:19:10.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.680+0000 7fe626930640 1 -- 172.21.15.53:0/648812613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6200fea60 con 0x7fe620101f90 2024-08-31T06:19:10.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.683+0000 7fe62cea5740 1 Processor -- start 2024-08-31T06:19:10.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.683+0000 7fe62cea5740 1 -- start start 2024-08-31T06:19:10.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe61d7fa640 1 -- 172.21.15.53:0/648812613 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe6100079b0 con 0x7fe620101f90 2024-08-31T06:19:10.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 0x55743c3bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3bc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743bff5840 0x55743c3bc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe62cea5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55743c332a70 con 0x55743bfed660 2024-08-31T06:19:10.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe62cea5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55743c322000 con 0x55743c016520 2024-08-31T06:19:10.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe62cea5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55743c325fb0 con 0x55743bff5840 2024-08-31T06:19:10.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe624ecd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 0x55743c3bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe61ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3bc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe624ecd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 0x55743c3bbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:59606/0 (socket says 172.21.15.53:59606) 2024-08-31T06:19:10.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe624ecd640 1 -- 172.21.15.53:0/2748676950 learned_addr learned my addr 172.21.15.53:0/2748676950 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:10.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.684+0000 7fe61f7fe640 1 --2- 172.21.15.53:0/2748676950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743bff5840 0x55743c3bc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe61ffff640 1 -- 172.21.15.53:0/2748676950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743bff5840 msgr2=0x55743c3bc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:10.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe61ffff640 1 --2- 172.21.15.53:0/2748676950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743bff5840 0x55743c3bc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe61ffff640 1 -- 172.21.15.53:0/2748676950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 msgr2=0x55743c3bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe61ffff640 1 --2- 172.21.15.53:0/2748676950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 0x55743c3bbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe61ffff640 1 -- 172.21.15.53:0/2748676950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55743c081b00 con 0x55743bfed660 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe624ecd640 1 --2- 172.21.15.53:0/2748676950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 0x55743c3bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe61ffff640 1 --2- 172.21.15.53:0/2748676950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3bc1c0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fe6100e2960 tx=0x7fe6100ed950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3865b4a858d92f5b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe61d7fa640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6080b4d20 0x7fe6080b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe6067fc640 1 -- 172.21.15.53:0/2748676950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6100f8070 con 0x55743bfed660 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe6067fc640 1 -- 172.21.15.53:0/2748676950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6100ab410 con 0x55743bfed660 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe624ecd640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6080b4d20 0x7fe6080b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe6067fc640 1 -- 172.21.15.53:0/2748676950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61006d160 con 0x55743bfed660 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.685+0000 7fe61d7fa640 1 -- 172.21.15.53:0/648812613 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7fe6100e5260 con 0x7fe620101f90 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.686+0000 7fe62cea5740 1 -- 172.21.15.53:0/2748676950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 msgr2=0x55743c3bc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.686+0000 7fe624ecd640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6080b4d20 0x7fe6080b7230 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe618032ea0 tx=0x7fe618032a70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.686+0000 7fe62cea5740 1 --2- 172.21.15.53:0/2748676950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3bc1c0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fe6100e2960 tx=0x7fe6100ed950 comp rx=0 tx=0).stop 2024-08-31T06:19:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.686+0000 7fe62cea5740 1 -- 172.21.15.53:0/2748676950 shutdown_connections 2024-08-31T06:19:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.686+0000 7fe62cea5740 1 --2- 172.21.15.53:0/2748676950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743bff5840 0x55743c3bc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.686+0000 7fe62cea5740 1 --2- 172.21.15.53:0/2748676950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3bc1c0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.686+0000 7fe62cea5740 1 --2- 172.21.15.53:0/2748676950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 0x55743c3bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.686+0000 7fe62cea5740 1 -- 172.21.15.53:0/2748676950 >> 172.21.15.53:0/2748676950 conn(0x55743c00a910 msgr2=0x55743c3b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.687+0000 7fe62cea5740 1 -- 172.21.15.53:0/2748676950 shutdown_connections 2024-08-31T06:19:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.687+0000 7fe62cea5740 1 -- 172.21.15.53:0/2748676950 wait complete. 2024-08-31T06:19:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.687+0000 7fe62cea5740 1 -- start start 2024-08-31T06:19:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe62cea5740 1 Processor -- start 2024-08-31T06:19:10.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743bff5840 0x55743c3c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 0x55743c3d38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe62cea5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55743c3ca460 con 0x55743bfed660 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe62cea5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55743c2e3520 con 0x55743c016520 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe62cea5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55743c3ca5e0 con 0x55743bff5840 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe62cea5740 10 client.0 _ll_register_callbacks cb 0x55743c31bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe61ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe61ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38874/0 (socket says 172.21.15.53:38874) 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe61ffff640 1 -- 172.21.15.53:0/269668076 learned_addr learned my addr 172.21.15.53:0/269668076 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.688+0000 7fe61f7fe640 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743bff5840 0x55743c3c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe624ecd640 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 0x55743c3d38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe61ffff640 1 -- 172.21.15.53:0/269668076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743bff5840 msgr2=0x55743c3c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe61ffff640 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743bff5840 0x55743c3c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe61ffff640 1 -- 172.21.15.53:0/269668076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 msgr2=0x55743c3d38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe61ffff640 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 0x55743c3d38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe61ffff640 1 -- 172.21.15.53:0/269668076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55743c0f8960 con 0x55743bfed660 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe624ecd640 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 0x55743c3d38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe61ffff640 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3c77e0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fe6100ab890 tx=0x7fe6100e2960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9fc0170f7b5666 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe5ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/269668076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61006f650 con 0x55743bfed660 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe62cea5740 1 -- 172.21.15.53:0/269668076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55743c2c19a0 con 0x55743bfed660 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/269668076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7fe6100a7ef0 con 0x55743bfed660 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/269668076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fe61006f830 con 0x55743bfed660 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe62cea5740 10 client.20013 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.689+0000 7fe62cea5740 1 -- 172.21.15.53:0/269668076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55743c3ca460 con 0x55743bfed660 2024-08-31T06:19:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.690+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/269668076 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55743c2c19a0 con 0x55743bfed660 2024-08-31T06:19:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.690+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/269668076 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fe6100a7b90 con 0x55743bfed660 2024-08-31T06:19:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.690+0000 7fe62cea5740 10 client.20013 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.690+0000 7fe62cea5740 10 client.20013 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:19:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.690+0000 7fe62cea5740 20 client.20013 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.690+0000 7fe62cea5740 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55743bfd4ea0 0x55743c3d9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.690+0000 7fe62cea5740 4 client.20013 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.690+0000 7fe62cea5740 1 -- 172.21.15.53:0/269668076 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55743c3349c0 con 0x55743bfd4ea0 2024-08-31T06:19:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.691+0000 7fe61f7fe640 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55743bfd4ea0 0x55743c3d9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.691+0000 7fe61f7fe640 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55743bfd4ea0 0x55743c3d9a50 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b73bcb9f907e43bf server_cookie=db5bee667394cea0 in_seq=0 out_seq=0 2024-08-31T06:19:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.691+0000 7fe5ff7fe640 10 client.20013 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:10.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.692+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/269668076 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55743c3349c0 con 0x55743bfd4ea0 2024-08-31T06:19:10.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.692+0000 7fe5ff7fe640 10 client.20013 handle_command_reply: tid=0 2024-08-31T06:19:10.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.692+0000 7fe62cea5740 1 client.20013 shutdown 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe62cea5740 1 -- 172.21.15.53:0/269668076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 msgr2=0x55743c3c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe62cea5740 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3c77e0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fe6100ab890 tx=0x7fe6100e2960 comp rx=0 tx=0).stop 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe62cea5740 1 -- 172.21.15.53:0/269668076 shutdown_connections 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe62cea5740 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55743bfd4ea0 0x55743c3d9a50 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe62cea5740 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743c016520 0x55743c3d38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe62cea5740 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743bff5840 0x55743c3c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe62cea5740 1 --2- 172.21.15.53:0/269668076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3c77e0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe62cea5740 1 -- 172.21.15.53:0/269668076 >> 172.21.15.53:0/269668076 conn(0x55743c00a910 msgr2=0x55743c3bee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe5ff7fe640 0 client.20013 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe62cea5740 1 -- 172.21.15.53:0/269668076 shutdown_connections 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe62cea5740 1 -- 172.21.15.53:0/269668076 wait complete. 2024-08-31T06:19:10.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.693+0000 7fe62cea5740 20 client.20013 trim_cache size 0 max 16384 2024-08-31T06:19:10.705 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.714+0000 7fe62cea5740 1 Processor -- start 2024-08-31T06:19:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.714+0000 7fe62cea5740 1 -- start start 2024-08-31T06:19:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.714+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3d37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.714+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743bff5840 0x55743c3d3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.714+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743c016520 0x55743c3c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.714+0000 7fe62cea5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201b1800 con 0x55743bfed660 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.714+0000 7fe62cea5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201b3580 con 0x55743bff5840 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.714+0000 7fe62cea5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201b1ed0 con 0x55743c016520 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe61ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3d37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe61ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3d37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38890/0 (socket says 172.21.15.53:38890) 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe61ffff640 1 -- 172.21.15.53:0/1971524800 learned_addr learned my addr 172.21.15.53:0/1971524800 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe61f7fe640 1 --2- 172.21.15.53:0/1971524800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743bff5840 0x55743c3d3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe624ecd640 1 --2- 172.21.15.53:0/1971524800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743c016520 0x55743c3c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe61ffff640 1 -- 172.21.15.53:0/1971524800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743c016520 msgr2=0x55743c3c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe61ffff640 1 --2- 172.21.15.53:0/1971524800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743c016520 0x55743c3c0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe61ffff640 1 -- 172.21.15.53:0/1971524800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743bff5840 msgr2=0x55743c3d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe61ffff640 1 --2- 172.21.15.53:0/1971524800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743bff5840 0x55743c3d3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe61ffff640 1 -- 172.21.15.53:0/1971524800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55743c3c2ee0 con 0x55743bfed660 2024-08-31T06:19:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe61ffff640 1 --2- 172.21.15.53:0/1971524800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3d37d0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe6100ab600 tx=0x7fe61006fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a420ad4caa22f328 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe605ffb640 1 -- 172.21.15.53:0/1971524800 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61001d070 con 0x55743bfed660 2024-08-31T06:19:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe605ffb640 1 -- 172.21.15.53:0/1971524800 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6100056a0 con 0x55743bfed660 2024-08-31T06:19:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.715+0000 7fe605ffb640 1 -- 172.21.15.53:0/1971524800 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61006fa10 con 0x55743bfed660 2024-08-31T06:19:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.716+0000 7fe62cea5740 1 -- 172.21.15.53:0/1971524800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 msgr2=0x55743c3d37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.716+0000 7fe62cea5740 1 --2- 172.21.15.53:0/1971524800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3d37d0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe6100ab600 tx=0x7fe61006fe20 comp rx=0 tx=0).stop 2024-08-31T06:19:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.716+0000 7fe62cea5740 1 -- 172.21.15.53:0/1971524800 shutdown_connections 2024-08-31T06:19:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.716+0000 7fe62cea5740 1 --2- 172.21.15.53:0/1971524800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743c016520 0x55743c3c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.716+0000 7fe62cea5740 1 --2- 172.21.15.53:0/1971524800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743bff5840 0x55743c3d3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.716+0000 7fe62cea5740 1 --2- 172.21.15.53:0/1971524800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bfed660 0x55743c3d37d0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.716+0000 7fe62cea5740 1 -- 172.21.15.53:0/1971524800 >> 172.21.15.53:0/1971524800 conn(0x55743c00a910 msgr2=0x55743c3c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.717+0000 7fe62cea5740 1 -- 172.21.15.53:0/1971524800 shutdown_connections 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.717+0000 7fe62cea5740 1 -- 172.21.15.53:0/1971524800 wait complete. 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.717+0000 7fe62cea5740 1 -- start start 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.717+0000 7fe62cea5740 1 Processor -- start 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743bfed660 0x55743c3d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bff5840 0x55743c3deea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe62cea5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743c016520 0x55743c3df440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe62cea5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201b2df0 con 0x55743bff5840 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe62cea5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201b2660 con 0x55743bfed660 2024-08-31T06:19:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe62cea5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe6201af7e0 con 0x55743c016520 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe62cea5740 10 client.0 _ll_register_callbacks cb 0x7fe6100f6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe61f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bff5840 0x55743c3deea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe61f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bff5840 0x55743c3deea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38906/0 (socket says 172.21.15.53:38906) 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe61f7fe640 1 -- 172.21.15.53:0/2546628951 learned_addr learned my addr 172.21.15.53:0/2546628951 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe61ffff640 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743bfed660 0x55743c3d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe624ecd640 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743c016520 0x55743c3df440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe61f7fe640 1 -- 172.21.15.53:0/2546628951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743c016520 msgr2=0x55743c3df440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe61f7fe640 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743c016520 0x55743c3df440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe61f7fe640 1 -- 172.21.15.53:0/2546628951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743bfed660 msgr2=0x55743c3d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe61f7fe640 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743bfed660 0x55743c3d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe61f7fe640 1 -- 172.21.15.53:0/2546628951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55743c3dfbd0 con 0x55743bff5840 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe61ffff640 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743bfed660 0x55743c3d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:19:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe61f7fe640 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bff5840 0x55743c3deea0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe6200755c0 tx=0x7fe61401f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3c39b98ef65237 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.718+0000 7fe5ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.719+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/2546628951 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614027030 con 0x55743bff5840 2024-08-31T06:19:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.719+0000 7fe62cea5740 1 -- 172.21.15.53:0/2546628951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6100056a0 con 0x55743bff5840 2024-08-31T06:19:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.719+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/2546628951 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7fe614004020 con 0x55743bff5840 2024-08-31T06:19:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.719+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/2546628951 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fe614030050 con 0x55743bff5840 2024-08-31T06:19:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.719+0000 7fe62cea5740 10 client.20019 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.719+0000 7fe62cea5740 1 -- 172.21.15.53:0/2546628951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55743c4444f0 con 0x55743bff5840 2024-08-31T06:19:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.719+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/2546628951 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6100056a0 con 0x55743bff5840 2024-08-31T06:19:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.719+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/2546628951 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fe6140118f0 con 0x55743bff5840 2024-08-31T06:19:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.720+0000 7fe62cea5740 10 client.20019 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.720+0000 7fe62cea5740 10 client.20019 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:19:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.720+0000 7fe62cea5740 20 client.20019 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.720+0000 7fe62cea5740 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55743bfaa250 0x55743c446dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.720+0000 7fe62cea5740 4 client.20019 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "22799662", "release": true, "await": true}] 2024-08-31T06:19:10.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.720+0000 7fe62cea5740 1 -- 172.21.15.53:0/2546628951 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "22799662", "release": true, "await": true}) -- 0x55743c330460 con 0x55743bfaa250 2024-08-31T06:19:10.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.720+0000 7fe61ffff640 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55743bfaa250 0x55743c446dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:10.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.720+0000 7fe5ff7fe640 10 client.20019 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:10.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.720+0000 7fe61ffff640 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55743bfaa250 0x55743c446dd0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4b4858c7c893cd8 server_cookie=818f756a5c8f7f14 in_seq=0 out_seq=0 2024-08-31T06:19:10.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.762+0000 7fe5ff7fe640 1 -- 172.21.15.53:0/2546628951 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55743c330460 con 0x55743bfaa250 2024-08-31T06:19:10.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.762+0000 7fe5ff7fe640 10 client.20019 handle_command_reply: tid=0 2024-08-31T06:19:10.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.762+0000 7fe62cea5740 1 client.20019 shutdown 2024-08-31T06:19:10.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.762+0000 7fe62cea5740 1 -- 172.21.15.53:0/2546628951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bff5840 msgr2=0x55743c3deea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:10.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.762+0000 7fe62cea5740 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bff5840 0x55743c3deea0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe6200755c0 tx=0x7fe61401f8b0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.762+0000 7fe62cea5740 1 -- 172.21.15.53:0/2546628951 shutdown_connections 2024-08-31T06:19:10.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.762+0000 7fe62cea5740 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55743bfaa250 0x55743c446dd0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.762+0000 7fe62cea5740 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55743c016520 0x55743c3df440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.762+0000 7fe62cea5740 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55743bff5840 0x55743c3deea0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.763+0000 7fe62cea5740 1 --2- 172.21.15.53:0/2546628951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55743bfed660 0x55743c3d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.763+0000 7fe62cea5740 1 -- 172.21.15.53:0/2546628951 >> 172.21.15.53:0/2546628951 conn(0x55743c00a910 msgr2=0x55743c3c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:10.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.763+0000 7fe5ff7fe640 0 client.20019 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:10.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.763+0000 7fe62cea5740 1 -- 172.21.15.53:0/2546628951 shutdown_connections 2024-08-31T06:19:10.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.763+0000 7fe62cea5740 1 -- 172.21.15.53:0/2546628951 wait complete. 2024-08-31T06:19:10.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.763+0000 7fe62cea5740 20 client.20019 trim_cache size 0 max 16384 2024-08-31T06:19:10.767 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:19:10.767 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 56, 2024-08-31T06:19:10.767 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 48, 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "22799662": { 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 48, 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 155.0, 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:19:10.768 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:19:10.769 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:19:10.769 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:19:10.769 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:19:10.769 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:19:10.769 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:10.769 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:10.769 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:10.769 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:10.769 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:10.769 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:19:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 -- 172.21.15.53:0/648812613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6080b4d20 msgr2=0x7fe6080b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6080b4d20 0x7fe6080b7230 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe618032ea0 tx=0x7fe618032a70 comp rx=0 tx=0).stop 2024-08-31T06:19:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 -- 172.21.15.53:0/648812613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe620101f90 msgr2=0x7fe62019a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe620101f90 0x7fe62019a0e0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c890 tx=0x7fe61000cd50 comp rx=0 tx=0).stop 2024-08-31T06:19:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 -- 172.21.15.53:0/648812613 shutdown_connections 2024-08-31T06:19:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6080b4d20 0x7fe6080b7230 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe620108220 0x7fe62019f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6201078d0 0x7fe62019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 --2- 172.21.15.53:0/648812613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe620101f90 0x7fe62019a0e0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:10.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 -- 172.21.15.53:0/648812613 >> 172.21.15.53:0/648812613 conn(0x7fe620077a00 msgr2=0x7fe620103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:10.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 -- 172.21.15.53:0/648812613 shutdown_connections 2024-08-31T06:19:10.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:10.764+0000 7fe626930640 1 -- 172.21.15.53:0/648812613 wait complete. 2024-08-31T06:19:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.300+0000 7f219128c640 1 -- 172.21.15.53:0/789201037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f218c103960 msgr2=0x7f218c103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.300+0000 7f219128c640 1 --2- 172.21.15.53:0/789201037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f218c103960 0x7f218c103d70 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f217c009900 tx=0x7f217c02a410 comp rx=0 tx=0).stop 2024-08-31T06:19:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.300+0000 7f219128c640 1 -- 172.21.15.53:0/789201037 shutdown_connections 2024-08-31T06:19:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.300+0000 7f219128c640 1 --2- 172.21.15.53:0/789201037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c109ba0 0x7f218c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.300+0000 7f219128c640 1 --2- 172.21.15.53:0/789201037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f218c109250 0x7f218c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.300+0000 7f219128c640 1 --2- 172.21.15.53:0/789201037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f218c103960 0x7f218c103d70 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.300+0000 7f219128c640 1 -- 172.21.15.53:0/789201037 >> 172.21.15.53:0/789201037 conn(0x7f218c07b6b0 msgr2=0x7f218c07bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.300+0000 7f219128c640 1 -- 172.21.15.53:0/789201037 shutdown_connections 2024-08-31T06:19:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.301+0000 7f219128c640 1 -- 172.21.15.53:0/789201037 wait complete. 2024-08-31T06:19:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f219128c640 1 Processor -- start 2024-08-31T06:19:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f219128c640 1 -- start start 2024-08-31T06:19:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f219128c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f218c109250 0x7f218c076ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f219128c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f218c109ba0 0x7f218c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f219128c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c0759f0 0x7f218c075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f218affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f218c109250 0x7f218c076ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f218affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f218c109250 0x7f218c076ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46208/0 (socket says 172.21.15.53:46208) 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f218affd640 1 -- 172.21.15.53:0/1389437884 learned_addr learned my addr 172.21.15.53:0/1389437884 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f219128c640 1 -- 172.21.15.53:0/1389437884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f218c113710 con 0x7f218c109ba0 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f219128c640 1 -- 172.21.15.53:0/1389437884 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f218c113590 con 0x7f218c0759f0 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f219128c640 1 -- 172.21.15.53:0/1389437884 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f218c113890 con 0x7f218c109250 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.302+0000 7f218b7fe640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c0759f0 0x7f218c075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.303+0000 7f217bfff640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f218c109ba0 0x7f218c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.303+0000 7f218affd640 1 -- 172.21.15.53:0/1389437884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c0759f0 msgr2=0x7f218c075eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.303+0000 7f218affd640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c0759f0 0x7f218c075eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.303+0000 7f218affd640 1 -- 172.21.15.53:0/1389437884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f218c109ba0 msgr2=0x7f218c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.303+0000 7f218affd640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f218c109ba0 0x7f218c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.303+0000 7f218affd640 1 -- 172.21.15.53:0/1389437884 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218c1acd70 con 0x7f218c109250 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.303+0000 7f218affd640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f218c109250 0x7f218c076ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f217c005940 tx=0x7f217c005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.303+0000 7f2188ff9640 1 -- 172.21.15.53:0/1389437884 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c03f030 con 0x7f218c109250 2024-08-31T06:19:11.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.304+0000 7f2188ff9640 1 -- 172.21.15.53:0/1389437884 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f217c0043d0 con 0x7f218c109250 2024-08-31T06:19:11.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.304+0000 7f219128c640 1 -- 172.21.15.53:0/1389437884 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218c1ad000 con 0x7f218c109250 2024-08-31T06:19:11.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.304+0000 7f219128c640 1 -- 172.21.15.53:0/1389437884 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f218c1ad490 con 0x7f218c109250 2024-08-31T06:19:11.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.304+0000 7f2188ff9640 1 -- 172.21.15.53:0/1389437884 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c035070 con 0x7f218c109250 2024-08-31T06:19:11.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.307+0000 7f2188ff9640 1 -- 172.21.15.53:0/1389437884 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f217c042030 con 0x7f218c109250 2024-08-31T06:19:11.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.308+0000 7f2197801740 1 Processor -- start 2024-08-31T06:19:11.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.308+0000 7f2197801740 1 -- start start 2024-08-31T06:19:11.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.308+0000 7f2197801740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da59070 0x55ec9ddfe310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.308+0000 7f2197801740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da301b0 0x55ec9ddfe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f2197801740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da38390 0x55ec9ddfed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f2197801740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ec9dd75680 con 0x55ec9da301b0 2024-08-31T06:19:11.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f2197801740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec9dd64c10 con 0x55ec9da59070 2024-08-31T06:19:11.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f2197801740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ec9dd68bc0 con 0x55ec9da38390 2024-08-31T06:19:11.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f2188ff9640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f21740b4df0 0x7f21740b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f218b7fe640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f21740b4df0 0x7f21740b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f218affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da301b0 0x55ec9ddfe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f217bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da38390 0x55ec9ddfed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f218b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da59070 0x55ec9ddfe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f218affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da301b0 0x55ec9ddfe850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38924/0 (socket says 172.21.15.53:38924) 2024-08-31T06:19:11.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f217bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da38390 0x55ec9ddfed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46224/0 (socket says 172.21.15.53:46224) 2024-08-31T06:19:11.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f218affd640 1 -- 172.21.15.53:0/238799190 learned_addr learned my addr 172.21.15.53:0/238799190 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:11.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f2188ff9640 1 -- 172.21.15.53:0/1389437884 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7f217c105570 con 0x7f218c109250 2024-08-31T06:19:11.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f218affd640 1 -- 172.21.15.53:0/238799190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da38390 msgr2=0x55ec9ddfed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:11.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f218affd640 1 --2- 172.21.15.53:0/238799190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da38390 0x55ec9ddfed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f218affd640 1 -- 172.21.15.53:0/238799190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da59070 msgr2=0x55ec9ddfe310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:11.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f218affd640 1 --2- 172.21.15.53:0/238799190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da59070 0x55ec9ddfe310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.309+0000 7f218affd640 1 -- 172.21.15.53:0/238799190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec9dac4650 con 0x55ec9da301b0 2024-08-31T06:19:11.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.310+0000 7f218affd640 1 --2- 172.21.15.53:0/238799190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da301b0 0x55ec9ddfe850 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f217c006010 tx=0x7f217c0cba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8314efe59c44eb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:11.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.310+0000 7f218b7fe640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f21740b4df0 0x7f21740b7300 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2184005fd0 tx=0x7f2184009f00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:11.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.310+0000 7f21797fa640 1 -- 172.21.15.53:0/238799190 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c049070 con 0x55ec9da301b0 2024-08-31T06:19:11.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.310+0000 7f21797fa640 1 -- 172.21.15.53:0/238799190 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f217c0cb720 con 0x55ec9da301b0 2024-08-31T06:19:11.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.310+0000 7f21797fa640 1 -- 172.21.15.53:0/238799190 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c0d4f30 con 0x55ec9da301b0 2024-08-31T06:19:11.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.311+0000 7f2197801740 1 -- 172.21.15.53:0/238799190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da301b0 msgr2=0x55ec9ddfe850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:11.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.311+0000 7f2197801740 1 --2- 172.21.15.53:0/238799190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da301b0 0x55ec9ddfe850 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f217c006010 tx=0x7f217c0cba60 comp rx=0 tx=0).stop 2024-08-31T06:19:11.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.311+0000 7f2197801740 1 -- 172.21.15.53:0/238799190 shutdown_connections 2024-08-31T06:19:11.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.311+0000 7f2197801740 1 --2- 172.21.15.53:0/238799190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da38390 0x55ec9ddfed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.311+0000 7f2197801740 1 --2- 172.21.15.53:0/238799190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da301b0 0x55ec9ddfe850 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.311+0000 7f2197801740 1 --2- 172.21.15.53:0/238799190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da59070 0x55ec9ddfe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.311+0000 7f2197801740 1 -- 172.21.15.53:0/238799190 >> 172.21.15.53:0/238799190 conn(0x55ec9da4d460 msgr2=0x55ec9ddfc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:11.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.311+0000 7f2197801740 1 -- 172.21.15.53:0/238799190 shutdown_connections 2024-08-31T06:19:11.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.311+0000 7f2197801740 1 -- 172.21.15.53:0/238799190 wait complete. 2024-08-31T06:19:11.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.312+0000 7f2197801740 1 -- start start 2024-08-31T06:19:11.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.312+0000 7f2197801740 1 Processor -- start 2024-08-31T06:19:11.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.313+0000 7f2197801740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da301b0 0x55ec9de09a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.313+0000 7f2197801740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da38390 0x55ec9de09f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.313+0000 7f2197801740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da59070 0x55ec9de15b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.313+0000 7f2197801740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ec9dbc7700 con 0x55ec9da59070 2024-08-31T06:19:11.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.313+0000 7f2197801740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec9dceb750 con 0x55ec9da301b0 2024-08-31T06:19:11.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.313+0000 7f2197801740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ec9de0c8b0 con 0x55ec9da38390 2024-08-31T06:19:11.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.313+0000 7f2197801740 10 client.0 _ll_register_callbacks cb 0x55ec9dd1ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:11.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.313+0000 7f218affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da301b0 0x55ec9de09a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.313+0000 7f218b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da59070 0x55ec9de15b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f218affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da301b0 0x55ec9de09a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:59690/0 (socket says 172.21.15.53:59690) 2024-08-31T06:19:11.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f218affd640 1 -- 172.21.15.53:0/165342860 learned_addr learned my addr 172.21.15.53:0/165342860 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:11.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f217bfff640 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da38390 0x55ec9de09f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f218affd640 1 -- 172.21.15.53:0/165342860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da38390 msgr2=0x55ec9de09f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f218affd640 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da38390 0x55ec9de09f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f218affd640 1 -- 172.21.15.53:0/165342860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da59070 msgr2=0x55ec9de15b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f218affd640 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da59070 0x55ec9de15b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f218affd640 1 -- 172.21.15.53:0/165342860 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec9dd24900 con 0x55ec9da301b0 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f218b7fe640 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da59070 0x55ec9de15b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f218affd640 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da301b0 0x55ec9de09a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f217c0cbba0 tx=0x7f217c0d03b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09c2d4e98579a40 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f21727fc640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f21727fc640 1 -- 172.21.15.53:0/165342860 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c0f2020 con 0x55ec9da301b0 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f21727fc640 1 -- 172.21.15.53:0/165342860 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7f217c0035f0 con 0x55ec9da301b0 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.314+0000 7f2197801740 1 -- 172.21.15.53:0/165342860 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f217c0cb720 con 0x55ec9da301b0 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.315+0000 7f21727fc640 1 -- 172.21.15.53:0/165342860 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f217c049040 con 0x55ec9da301b0 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.315+0000 7f2197801740 10 client.29003 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.315+0000 7f2197801740 1 -- 172.21.15.53:0/165342860 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55ec9de185b0 con 0x55ec9da301b0 2024-08-31T06:19:11.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.315+0000 7f21727fc640 1 -- 172.21.15.53:0/165342860 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f217c0cb720 con 0x55ec9da301b0 2024-08-31T06:19:11.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.315+0000 7f21727fc640 1 -- 172.21.15.53:0/165342860 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f217c0cbe70 con 0x55ec9da301b0 2024-08-31T06:19:11.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.316+0000 7f2197801740 10 client.29003 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:11.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.316+0000 7f2197801740 10 client.29003 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:19:11.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.316+0000 7f2197801740 20 client.29003 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.316+0000 7f2197801740 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ec9da179f0 0x55ec9de1b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.316+0000 7f2197801740 4 client.29003 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.316+0000 7f2197801740 1 -- 172.21.15.53:0/165342860 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec9dd775d0 con 0x55ec9da179f0 2024-08-31T06:19:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.316+0000 7f217bfff640 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ec9da179f0 0x55ec9de1b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.316+0000 7f21727fc640 10 client.29003 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:19:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.317+0000 7f217bfff640 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ec9da179f0 0x55ec9de1b910 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ad145d7cf3bcbbdc server_cookie=b87199e1f297ebb6 in_seq=0 out_seq=0 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.317+0000 7f21727fc640 1 -- 172.21.15.53:0/165342860 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec9dd775d0 con 0x55ec9da179f0 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.317+0000 7f21727fc640 10 client.29003 handle_command_reply: tid=0 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 1 client.29003 shutdown 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 1 -- 172.21.15.53:0/165342860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da301b0 msgr2=0x55ec9de09a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da301b0 0x55ec9de09a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f217c0cbba0 tx=0x7f217c0d03b0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 1 -- 172.21.15.53:0/165342860 shutdown_connections 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da59070 0x55ec9de15b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ec9da179f0 0x55ec9de1b910 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f21727fc640 0 client.29003 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da38390 0x55ec9de09f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 1 --2- 172.21.15.53:0/165342860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da301b0 0x55ec9de09a30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 1 -- 172.21.15.53:0/165342860 >> 172.21.15.53:0/165342860 conn(0x55ec9da4d460 msgr2=0x55ec9de014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:11.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 1 -- 172.21.15.53:0/165342860 shutdown_connections 2024-08-31T06:19:11.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 1 -- 172.21.15.53:0/165342860 wait complete. 2024-08-31T06:19:11.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.318+0000 7f2197801740 20 client.29003 trim_cache size 0 max 16384 2024-08-31T06:19:11.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.341+0000 7f2197801740 1 Processor -- start 2024-08-31T06:19:11.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.341+0000 7f2197801740 1 -- start start 2024-08-31T06:19:11.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.341+0000 7f2197801740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da179f0 0x55ec9de01b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.341+0000 7f2197801740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de06c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.341+0000 7f2197801740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da38390 0x55ec9de07160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.341+0000 7f2197801740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f216c00e940 con 0x55ec9da38390 2024-08-31T06:19:11.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.341+0000 7f2197801740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f216c0106c0 con 0x55ec9da179f0 2024-08-31T06:19:11.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.341+0000 7f2197801740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f216c00f010 con 0x55ec9da301b0 2024-08-31T06:19:11.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.342+0000 7f217bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de06c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.342+0000 7f217bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de06c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46234/0 (socket says 172.21.15.53:46234) 2024-08-31T06:19:11.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.342+0000 7f217bfff640 1 -- 172.21.15.53:0/1055998519 learned_addr learned my addr 172.21.15.53:0/1055998519 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:11.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.342+0000 7f218b7fe640 1 --2- 172.21.15.53:0/1055998519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da38390 0x55ec9de07160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.342+0000 7f218affd640 1 --2- 172.21.15.53:0/1055998519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da179f0 0x55ec9de01b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.342+0000 7f217bfff640 1 -- 172.21.15.53:0/1055998519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da179f0 msgr2=0x55ec9de01b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:11.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.342+0000 7f217bfff640 1 --2- 172.21.15.53:0/1055998519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da179f0 0x55ec9de01b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.342+0000 7f217bfff640 1 -- 172.21.15.53:0/1055998519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da38390 msgr2=0x55ec9de07160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:11.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.342+0000 7f217bfff640 1 --2- 172.21.15.53:0/1055998519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da38390 0x55ec9de07160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.342+0000 7f217bfff640 1 -- 172.21.15.53:0/1055998519 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec9de04660 con 0x55ec9da301b0 2024-08-31T06:19:11.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.342+0000 7f217bfff640 1 --2- 172.21.15.53:0/1055998519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de06c20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2180009e80 tx=0x7f2180005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6000daa1b02181e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:11.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.343+0000 7f2178ff9640 1 -- 172.21.15.53:0/1055998519 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180004220 con 0x55ec9da301b0 2024-08-31T06:19:11.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.343+0000 7f2178ff9640 1 -- 172.21.15.53:0/1055998519 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21800043c0 con 0x55ec9da301b0 2024-08-31T06:19:11.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.343+0000 7f2178ff9640 1 -- 172.21.15.53:0/1055998519 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21800258c0 con 0x55ec9da301b0 2024-08-31T06:19:11.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.344+0000 7f2197801740 1 -- 172.21.15.53:0/1055998519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 msgr2=0x55ec9de06c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:11.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.344+0000 7f2197801740 1 --2- 172.21.15.53:0/1055998519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de06c20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2180009e80 tx=0x7f2180005f90 comp rx=0 tx=0).stop 2024-08-31T06:19:11.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.344+0000 7f2197801740 1 -- 172.21.15.53:0/1055998519 shutdown_connections 2024-08-31T06:19:11.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.344+0000 7f2197801740 1 --2- 172.21.15.53:0/1055998519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da38390 0x55ec9de07160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.344+0000 7f2197801740 1 --2- 172.21.15.53:0/1055998519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de06c20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.344+0000 7f2197801740 1 --2- 172.21.15.53:0/1055998519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da179f0 0x55ec9de01b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.344+0000 7f2197801740 1 -- 172.21.15.53:0/1055998519 >> 172.21.15.53:0/1055998519 conn(0x55ec9da4d460 msgr2=0x55ec9de01410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:11.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.344+0000 7f2197801740 1 -- 172.21.15.53:0/1055998519 shutdown_connections 2024-08-31T06:19:11.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.344+0000 7f2197801740 1 -- 172.21.15.53:0/1055998519 wait complete. 2024-08-31T06:19:11.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.345+0000 7f2197801740 1 -- start start 2024-08-31T06:19:11.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.345+0000 7f2197801740 1 Processor -- start 2024-08-31T06:19:11.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.345+0000 7f2197801740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da179f0 0x55ec9de0dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.345+0000 7f2197801740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de0e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.345+0000 7f2197801740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da38390 0x55ec9de85230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.345+0000 7f2197801740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f216c00ff30 con 0x55ec9da38390 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.345+0000 7f2197801740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f216c00f7a0 con 0x55ec9da179f0 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.345+0000 7f2197801740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f216c00c940 con 0x55ec9da301b0 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.345+0000 7f2197801740 10 client.0 _ll_register_callbacks cb 0x7f21840117a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f217bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de0e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f217bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de0e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46242/0 (socket says 172.21.15.53:46242) 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f217bfff640 1 -- 172.21.15.53:0/3794932267 learned_addr learned my addr 172.21.15.53:0/3794932267 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f218b7fe640 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da38390 0x55ec9de85230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f218affd640 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da179f0 0x55ec9de0dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f217bfff640 1 -- 172.21.15.53:0/3794932267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da179f0 msgr2=0x55ec9de0dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f217bfff640 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da179f0 0x55ec9de0dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f217bfff640 1 -- 172.21.15.53:0/3794932267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da38390 msgr2=0x55ec9de85230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f217bfff640 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da38390 0x55ec9de85230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f217bfff640 1 -- 172.21.15.53:0/3794932267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec9de0eab0 con 0x55ec9da301b0 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f217bfff640 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de0e2c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2180013fd0 tx=0x7f21800038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6690e9efcdc5f42 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.346+0000 7f21727fc640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f21727fc640 1 -- 172.21.15.53:0/3794932267 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180033020 con 0x55ec9da301b0 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f21727fc640 1 -- 172.21.15.53:0/3794932267 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7f2180025460 con 0x55ec9da301b0 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f2197801740 1 -- 172.21.15.53:0/3794932267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21800043c0 con 0x55ec9da301b0 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f21727fc640 1 -- 172.21.15.53:0/3794932267 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f218003e050 con 0x55ec9da301b0 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f2197801740 10 client.29005 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f2197801740 1 -- 172.21.15.53:0/3794932267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55ec9de86720 con 0x55ec9da301b0 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f21727fc640 1 -- 172.21.15.53:0/3794932267 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21800099a0 con 0x55ec9da301b0 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f21727fc640 1 -- 172.21.15.53:0/3794932267 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f218002e540 con 0x55ec9da301b0 2024-08-31T06:19:11.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f2197801740 10 client.29005 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:11.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f2197801740 10 client.29005 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:19:11.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f2197801740 20 client.29005 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:11.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f2197801740 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ec9da59070 0x55ec9de88f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:11.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f2197801740 4 client.29005 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:19:11.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.347+0000 7f2197801740 1 -- 172.21.15.53:0/3794932267 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f21800043c0 con 0x55ec9da59070 2024-08-31T06:19:11.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.348+0000 7f218affd640 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ec9da59070 0x55ec9de88f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.348+0000 7f21727fc640 10 client.29005 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:19:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.348+0000 7f218affd640 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ec9da59070 0x55ec9de88f40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c22f475e533312d8 server_cookie=4dfd8e76cb3369ff in_seq=0 out_seq=0 2024-08-31T06:19:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.348+0000 7f21727fc640 1 -- 172.21.15.53:0/3794932267 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f21800043c0 con 0x55ec9da59070 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.348+0000 7f21727fc640 10 client.29005 handle_command_reply: tid=0 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.348+0000 7f2197801740 1 client.29005 shutdown 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f2197801740 1 -- 172.21.15.53:0/3794932267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 msgr2=0x55ec9de0e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f2197801740 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de0e2c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2180013fd0 tx=0x7f21800038a0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f2197801740 1 -- 172.21.15.53:0/3794932267 shutdown_connections 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f2197801740 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec9da38390 0x55ec9de85230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f2197801740 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55ec9da59070 0x55ec9de88f40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f2197801740 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec9da301b0 0x55ec9de0e2c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f2197801740 1 --2- 172.21.15.53:0/3794932267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec9da179f0 0x55ec9de0dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f2197801740 1 -- 172.21.15.53:0/3794932267 >> 172.21.15.53:0/3794932267 conn(0x55ec9da4d460 msgr2=0x55ec9ddff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f21727fc640 0 client.29005 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f2197801740 1 -- 172.21.15.53:0/3794932267 shutdown_connections 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f2197801740 1 -- 172.21.15.53:0/3794932267 wait complete. 2024-08-31T06:19:11.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.349+0000 7f2197801740 20 client.29005 trim_cache size 0 max 16384 2024-08-31T06:19:11.356 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:19:11.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 -- 172.21.15.53:0/1389437884 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f21740b4df0 msgr2=0x7f21740b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:11.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f21740b4df0 0x7f21740b7300 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2184005fd0 tx=0x7f2184009f00 comp rx=0 tx=0).stop 2024-08-31T06:19:11.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 -- 172.21.15.53:0/1389437884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f218c109250 msgr2=0x7f218c076ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:11.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f218c109250 0x7f218c076ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f217c005940 tx=0x7f217c005e50 comp rx=0 tx=0).stop 2024-08-31T06:19:11.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 -- 172.21.15.53:0/1389437884 shutdown_connections 2024-08-31T06:19:11.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f21740b4df0 0x7f21740b7300 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f218c0759f0 0x7f218c075eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f218c109ba0 0x7f218c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 --2- 172.21.15.53:0/1389437884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f218c109250 0x7f218c076ec0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:11.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 -- 172.21.15.53:0/1389437884 >> 172.21.15.53:0/1389437884 conn(0x7f218c07b6b0 msgr2=0x7f218c107400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:11.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 -- 172.21.15.53:0/1389437884 shutdown_connections 2024-08-31T06:19:11.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:11.350+0000 7f219128c640 1 -- 172.21.15.53:0/1389437884 wait complete. 2024-08-31T06:19:11.357 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4183 6.77 MB/sec warmup 59 sec latency 34234.961 ms 2024-08-31T06:19:12.004 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '22799662', total seconds elapsed: 40.5 2024-08-31T06:19:12.358 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4352 6.75 MB/sec warmup 60 sec latency 1591.451 ms 2024-08-31T06:19:12.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:12 smithi053 ceph-mon[18924]: pgmap v767: 97 pgs: 97 active+clean; 348 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 67 KiB/s wr, 35 op/s 2024-08-31T06:19:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:12 smithi130 ceph-mon[22266]: pgmap v767: 97 pgs: 97 active+clean; 348 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 67 KiB/s wr, 35 op/s 2024-08-31T06:19:12.670 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:19:12.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:12 smithi153 ceph-mon[22320]: pgmap v767: 97 pgs: 97 active+clean; 348 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 67 KiB/s wr, 35 op/s 2024-08-31T06:19:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:13.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4529 6.83 MB/sec warmup 61 sec latency 2596.479 ms 2024-08-31T06:19:13.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.712+0000 7f1850bfa640 1 -- 172.21.15.53:0/4126787588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f184c108140 msgr2=0x7f184c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:13.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.712+0000 7f1850bfa640 1 --2- 172.21.15.53:0/4126787588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f184c108140 0x7f184c108550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1840009900 tx=0x7f184002a410 comp rx=0 tx=0).stop 2024-08-31T06:19:13.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.712+0000 7f1850bfa640 1 -- 172.21.15.53:0/4126787588 shutdown_connections 2024-08-31T06:19:13.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.712+0000 7f1850bfa640 1 --2- 172.21.15.53:0/4126787588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f184c108a90 0x7f184c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.712+0000 7f1850bfa640 1 --2- 172.21.15.53:0/4126787588 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f184c108140 0x7f184c108550 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.712+0000 7f1850bfa640 1 --2- 172.21.15.53:0/4126787588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c102800 0x7f184c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.712+0000 7f1850bfa640 1 -- 172.21.15.53:0/4126787588 >> 172.21.15.53:0/4126787588 conn(0x7f184c0794d0 msgr2=0x7f184c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:13.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.712+0000 7f1850bfa640 1 -- 172.21.15.53:0/4126787588 shutdown_connections 2024-08-31T06:19:13.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.712+0000 7f1850bfa640 1 -- 172.21.15.53:0/4126787588 wait complete. 2024-08-31T06:19:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.714+0000 7f1850bfa640 1 Processor -- start 2024-08-31T06:19:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.714+0000 7f1850bfa640 1 -- start start 2024-08-31T06:19:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.714+0000 7f1850bfa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c102800 0x7f184c10fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.714+0000 7f1850bfa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f184c108140 0x7f184c110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.714+0000 7f1850bfa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f184c108a90 0x7f184c1107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.714+0000 7f1850bfa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f184c1136d0 con 0x7f184c102800 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.714+0000 7f1850bfa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f184c113550 con 0x7f184c108140 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.714+0000 7f1850bfa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f184c113850 con 0x7f184c108a90 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.714+0000 7f184ad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f184c108a90 0x7f184c1107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.714+0000 7f184ad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f184c108a90 0x7f184c1107d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:40154/0 (socket says 172.21.15.53:40154) 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.714+0000 7f184ad9d640 1 -- 172.21.15.53:0/3708970992 learned_addr learned my addr 172.21.15.53:0/3708970992 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.715+0000 7f1849d9b640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f184c108140 0x7f184c110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.715+0000 7f184a59c640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c102800 0x7f184c10fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.715+0000 7f184ad9d640 1 -- 172.21.15.53:0/3708970992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f184c108140 msgr2=0x7f184c110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.715+0000 7f184ad9d640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f184c108140 0x7f184c110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.715+0000 7f184ad9d640 1 -- 172.21.15.53:0/3708970992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c102800 msgr2=0x7f184c10fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.715+0000 7f184ad9d640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c102800 0x7f184c10fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.715+0000 7f184ad9d640 1 -- 172.21.15.53:0/3708970992 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184c1a83c0 con 0x7f184c108a90 2024-08-31T06:19:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.715+0000 7f184ad9d640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f184c108a90 0x7f184c1107d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f184400eb10 tx=0x7f184400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:13.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.715+0000 7f183b7fe640 1 -- 172.21.15.53:0/3708970992 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844004b20 con 0x7f184c108a90 2024-08-31T06:19:13.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.716+0000 7f183b7fe640 1 -- 172.21.15.53:0/3708970992 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1844004cc0 con 0x7f184c108a90 2024-08-31T06:19:13.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.716+0000 7f183b7fe640 1 -- 172.21.15.53:0/3708970992 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844010690 con 0x7f184c108a90 2024-08-31T06:19:13.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.716+0000 7f1850bfa640 1 -- 172.21.15.53:0/3708970992 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184c1a86b0 con 0x7f184c108a90 2024-08-31T06:19:13.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.716+0000 7f1850bfa640 1 -- 172.21.15.53:0/3708970992 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184c1a8bc0 con 0x7f184c108a90 2024-08-31T06:19:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.719+0000 7f185716f740 1 Processor -- start 2024-08-31T06:19:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.719+0000 7f183b7fe640 1 -- 172.21.15.53:0/3708970992 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1844010830 con 0x7f184c108a90 2024-08-31T06:19:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.720+0000 7f185716f740 1 -- start start 2024-08-31T06:19:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.720+0000 7f185716f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598d6070 0x564c59c7b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.720+0000 7f185716f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 0x564c59c7b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.720+0000 7f185716f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 0x564c59c7bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.720+0000 7f1849d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598d6070 0x564c59c7b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.720+0000 7f185716f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564c59bf2680 con 0x564c598d6070 2024-08-31T06:19:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.720+0000 7f1849d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598d6070 0x564c59c7b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47542/0 (socket says 172.21.15.53:47542) 2024-08-31T06:19:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.720+0000 7f185716f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564c59be1c10 con 0x564c598b5390 2024-08-31T06:19:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.720+0000 7f1849d9b640 1 -- 172.21.15.53:0/2143785420 learned_addr learned my addr 172.21.15.53:0/2143785420 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.721+0000 7f185716f740 1 -- 172.21.15.53:0/2143785420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564c59be5bc0 con 0x564c598ad1b0 2024-08-31T06:19:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.721+0000 7f184a59c640 1 --2- 172.21.15.53:0/2143785420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 0x564c59c7b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.721+0000 7f184a59c640 1 -- 172.21.15.53:0/2143785420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 msgr2=0x564c59c7bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.721+0000 7f184a59c640 1 --2- 172.21.15.53:0/2143785420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 0x564c59c7bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.721+0000 7f184a59c640 1 -- 172.21.15.53:0/2143785420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598d6070 msgr2=0x564c59c7b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.721+0000 7f184a59c640 1 --2- 172.21.15.53:0/2143785420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598d6070 0x564c59c7b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.721+0000 7f184a59c640 1 -- 172.21.15.53:0/2143785420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c59941650 con 0x564c598ad1b0 2024-08-31T06:19:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.721+0000 7f183b7fe640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f18340b4d20 0x7f18340b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.721+0000 7f1849d9b640 1 --2- 172.21.15.53:0/2143785420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598d6070 0x564c59c7b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.722+0000 7f184a59c640 1 --2- 172.21.15.53:0/2143785420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 0x564c59c7b850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f183c009bf0 tx=0x7f183c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20ea5927ef5da0fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.722+0000 7f183b7fe640 1 -- 172.21.15.53:0/3708970992 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7f18440e5850 con 0x7f184c108a90 2024-08-31T06:19:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.722+0000 7f1838ff9640 1 -- 172.21.15.53:0/2143785420 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c01e070 con 0x564c598ad1b0 2024-08-31T06:19:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.722+0000 7f1849d9b640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f18340b4d20 0x7f18340b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.722+0000 7f1838ff9640 1 -- 172.21.15.53:0/2143785420 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f183c009da0 con 0x564c598ad1b0 2024-08-31T06:19:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.722+0000 7f1838ff9640 1 -- 172.21.15.53:0/2143785420 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c003e60 con 0x564c598ad1b0 2024-08-31T06:19:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.723+0000 7f185716f740 1 -- 172.21.15.53:0/2143785420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 msgr2=0x564c59c7b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.723+0000 7f1849d9b640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f18340b4d20 0x7f18340b7230 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1840006010 tx=0x7f1840005df0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.723+0000 7f185716f740 1 --2- 172.21.15.53:0/2143785420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 0x564c59c7b850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f183c009bf0 tx=0x7f183c011810 comp rx=0 tx=0).stop 2024-08-31T06:19:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.724+0000 7f185716f740 1 -- 172.21.15.53:0/2143785420 shutdown_connections 2024-08-31T06:19:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.724+0000 7f185716f740 1 --2- 172.21.15.53:0/2143785420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 0x564c59c7bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.724+0000 7f185716f740 1 --2- 172.21.15.53:0/2143785420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 0x564c59c7b850 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.724+0000 7f185716f740 1 --2- 172.21.15.53:0/2143785420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598d6070 0x564c59c7b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.724+0000 7f185716f740 1 -- 172.21.15.53:0/2143785420 >> 172.21.15.53:0/2143785420 conn(0x564c598ca460 msgr2=0x564c59c79200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.724+0000 7f185716f740 1 -- 172.21.15.53:0/2143785420 shutdown_connections 2024-08-31T06:19:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.724+0000 7f185716f740 1 -- 172.21.15.53:0/2143785420 wait complete. 2024-08-31T06:19:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.725+0000 7f185716f740 1 -- start start 2024-08-31T06:19:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.725+0000 7f185716f740 1 Processor -- start 2024-08-31T06:19:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.725+0000 7f185716f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 0x564c59c86a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.725+0000 7f185716f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598b5390 0x564c59c86f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f185716f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598d6070 0x564c59c9b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f185716f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564c59a44700 con 0x564c598b5390 2024-08-31T06:19:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f185716f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564c59b68750 con 0x564c598d6070 2024-08-31T06:19:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f185716f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564c59c89af0 con 0x564c598ad1b0 2024-08-31T06:19:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f185716f740 10 client.0 _ll_register_callbacks cb 0x564c59b97e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f1849d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598b5390 0x564c59c86f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f1849d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598b5390 0x564c59c86f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47550/0 (socket says 172.21.15.53:47550) 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f184a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 0x564c59c86a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f1849d9b640 1 -- 172.21.15.53:0/945024689 learned_addr learned my addr 172.21.15.53:0/945024689 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f184ad9d640 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598d6070 0x564c59c9b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f184a59c640 1 -- 172.21.15.53:0/945024689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598d6070 msgr2=0x564c59c9b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f184a59c640 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598d6070 0x564c59c9b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f184a59c640 1 -- 172.21.15.53:0/945024689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598b5390 msgr2=0x564c59c86f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f184a59c640 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598b5390 0x564c59c86f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f184a59c640 1 -- 172.21.15.53:0/945024689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c59ba1900 con 0x564c598ad1b0 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f1849d9b640 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598b5390 0x564c59c86f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.726+0000 7f184ad9d640 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598d6070 0x564c59c9b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.727+0000 7f184a59c640 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 0x564c59c86a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f183c003a80 tx=0x7f183c0056a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=932a2b5f1e6488f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.727+0000 7f1831ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:19:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.727+0000 7f1831ffb640 1 -- 172.21.15.53:0/945024689 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c01e070 con 0x564c598ad1b0 2024-08-31T06:19:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.727+0000 7f1831ffb640 1 -- 172.21.15.53:0/945024689 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7f183c0046c0 con 0x564c598ad1b0 2024-08-31T06:19:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.727+0000 7f185716f740 1 -- 172.21.15.53:0/945024689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f183c009da0 con 0x564c598ad1b0 2024-08-31T06:19:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.727+0000 7f1831ffb640 1 -- 172.21.15.53:0/945024689 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f183c031050 con 0x564c598ad1b0 2024-08-31T06:19:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.727+0000 7f185716f740 10 client.29017 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.727+0000 7f185716f740 1 -- 172.21.15.53:0/945024689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x564c59c9e0d0 con 0x564c598ad1b0 2024-08-31T06:19:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.727+0000 7f1831ffb640 1 -- 172.21.15.53:0/945024689 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f183c028070 con 0x564c598ad1b0 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.728+0000 7f1831ffb640 1 -- 172.21.15.53:0/945024689 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f183c003ec0 con 0x564c598ad1b0 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.728+0000 7f185716f740 10 client.29017 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.728+0000 7f185716f740 10 client.29017 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.728+0000 7f185716f740 20 client.29017 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.728+0000 7f185716f740 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564c598949f0 0x564c59ca14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.728+0000 7f185716f740 4 client.29017 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.728+0000 7f185716f740 1 -- 172.21.15.53:0/945024689 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f183c009da0 con 0x564c598949f0 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.728+0000 7f1849d9b640 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564c598949f0 0x564c59ca14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.728+0000 7f1831ffb640 10 client.29017 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.729+0000 7f1849d9b640 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564c598949f0 0x564c59ca14e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5c655a1d926acc0c server_cookie=4161a29a5c6f182d in_seq=0 out_seq=0 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.729+0000 7f1831ffb640 1 -- 172.21.15.53:0/945024689 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f183c009da0 con 0x564c598949f0 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.729+0000 7f1831ffb640 10 client.29017 handle_command_reply: tid=0 2024-08-31T06:19:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.729+0000 7f185716f740 1 client.29017 shutdown 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f185716f740 1 -- 172.21.15.53:0/945024689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 msgr2=0x564c59c86a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f185716f740 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 0x564c59c86a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f183c003a80 tx=0x7f183c0056a0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f185716f740 1 -- 172.21.15.53:0/945024689 shutdown_connections 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f185716f740 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598d6070 0x564c59c9b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f185716f740 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564c598949f0 0x564c59ca14e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f185716f740 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598b5390 0x564c59c86f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f185716f740 1 --2- 172.21.15.53:0/945024689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598ad1b0 0x564c59c86a50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f1831ffb640 0 client.29017 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f185716f740 1 -- 172.21.15.53:0/945024689 >> 172.21.15.53:0/945024689 conn(0x564c598ca460 msgr2=0x564c59c7e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f185716f740 1 -- 172.21.15.53:0/945024689 shutdown_connections 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f185716f740 1 -- 172.21.15.53:0/945024689 wait complete. 2024-08-31T06:19:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.730+0000 7f185716f740 20 client.29017 trim_cache size 0 max 16384 2024-08-31T06:19:13.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f185716f740 1 Processor -- start 2024-08-31T06:19:13.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f185716f740 1 -- start start 2024-08-31T06:19:13.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f185716f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c86f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f185716f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 0x564c59c7e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f185716f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598d6070 0x564c59c7e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f185716f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f182c00e940 con 0x564c598ad1b0 2024-08-31T06:19:13.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f185716f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f182c0106c0 con 0x564c598b5390 2024-08-31T06:19:13.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f185716f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f182c00f010 con 0x564c598d6070 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f184a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c86f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f184a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c86f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47566/0 (socket says 172.21.15.53:47566) 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f184a59c640 1 -- 172.21.15.53:0/2224001859 learned_addr learned my addr 172.21.15.53:0/2224001859 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.750+0000 7f184ad9d640 1 --2- 172.21.15.53:0/2224001859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598d6070 0x564c59c7e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.751+0000 7f184a59c640 1 -- 172.21.15.53:0/2224001859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598d6070 msgr2=0x564c59c7e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.751+0000 7f184a59c640 1 --2- 172.21.15.53:0/2224001859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598d6070 0x564c59c7e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.751+0000 7f184a59c640 1 -- 172.21.15.53:0/2224001859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 msgr2=0x564c59c7e410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.751+0000 7f184a59c640 1 --2- 172.21.15.53:0/2224001859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 0x564c59c7e410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.751+0000 7f184a59c640 1 -- 172.21.15.53:0/2224001859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c59c9bd70 con 0x564c598ad1b0 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.751+0000 7f184a59c640 1 --2- 172.21.15.53:0/2224001859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c86f10 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f183c0059f0 tx=0x7f183c011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6be0ef4b4cb442 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.751+0000 7f1833fff640 1 -- 172.21.15.53:0/2224001859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c01e070 con 0x564c598ad1b0 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.751+0000 7f1833fff640 1 -- 172.21.15.53:0/2224001859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f183c028040 con 0x564c598ad1b0 2024-08-31T06:19:13.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.751+0000 7f1833fff640 1 -- 172.21.15.53:0/2224001859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c019a70 con 0x564c598ad1b0 2024-08-31T06:19:13.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.752+0000 7f185716f740 1 -- 172.21.15.53:0/2224001859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 msgr2=0x564c59c86f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:13.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.752+0000 7f185716f740 1 --2- 172.21.15.53:0/2224001859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c86f10 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f183c0059f0 tx=0x7f183c011d10 comp rx=0 tx=0).stop 2024-08-31T06:19:13.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.752+0000 7f185716f740 1 -- 172.21.15.53:0/2224001859 shutdown_connections 2024-08-31T06:19:13.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.752+0000 7f185716f740 1 --2- 172.21.15.53:0/2224001859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598d6070 0x564c59c7e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.752+0000 7f185716f740 1 --2- 172.21.15.53:0/2224001859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 0x564c59c7e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.752+0000 7f185716f740 1 --2- 172.21.15.53:0/2224001859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c86f10 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.752+0000 7f185716f740 1 -- 172.21.15.53:0/2224001859 >> 172.21.15.53:0/2224001859 conn(0x564c598ca460 msgr2=0x564c59c86800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:13.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.752+0000 7f185716f740 1 -- 172.21.15.53:0/2224001859 shutdown_connections 2024-08-31T06:19:13.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.752+0000 7f185716f740 1 -- 172.21.15.53:0/2224001859 wait complete. 2024-08-31T06:19:13.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.753+0000 7f185716f740 1 -- start start 2024-08-31T06:19:13.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.753+0000 7f185716f740 1 Processor -- start 2024-08-31T06:19:13.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.753+0000 7f185716f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c97e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.753+0000 7f185716f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 0x564c59c93320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.753+0000 7f185716f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598d6070 0x564c59c93880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.753+0000 7f185716f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f182c00ff30 con 0x564c598ad1b0 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f1849d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 0x564c59c93320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f184a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c97e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f184a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c97e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47576/0 (socket says 172.21.15.53:47576) 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f184a59c640 1 -- 172.21.15.53:0/4075855299 learned_addr learned my addr 172.21.15.53:0/4075855299 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f185716f740 1 -- 172.21.15.53:0/4075855299 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f182c00f7a0 con 0x564c598b5390 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f184ad9d640 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598d6070 0x564c59c93880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f185716f740 1 -- 172.21.15.53:0/4075855299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f182c00c940 con 0x564c598d6070 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f185716f740 10 client.0 _ll_register_callbacks cb 0x7f183c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f184a59c640 1 -- 172.21.15.53:0/4075855299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598d6070 msgr2=0x564c59c93880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f184a59c640 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598d6070 0x564c59c93880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f184a59c640 1 -- 172.21.15.53:0/4075855299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 msgr2=0x564c59c93320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f184a59c640 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 0x564c59c93320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f184a59c640 1 -- 172.21.15.53:0/4075855299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c59c94010 con 0x564c598ad1b0 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f184a59c640 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c97e70 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f183c0058b0 tx=0x7f183c005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7358b59b3c94d003 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.754+0000 7f1831ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.755+0000 7f1831ffb640 1 -- 172.21.15.53:0/4075855299 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c01e040 con 0x564c598ad1b0 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.755+0000 7f1831ffb640 1 -- 172.21.15.53:0/4075855299 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8601+0+0 (secure 0 0 0) 0x7f183c003d10 con 0x564c598ad1b0 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.755+0000 7f185716f740 1 -- 172.21.15.53:0/4075855299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f183c028040 con 0x564c598ad1b0 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.755+0000 7f1831ffb640 1 -- 172.21.15.53:0/4075855299 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f183c04c050 con 0x564c598ad1b0 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.755+0000 7f185716f740 10 client.20055 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.755+0000 7f185716f740 1 -- 172.21.15.53:0/4075855299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x564c59d0bd70 con 0x564c598ad1b0 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.755+0000 7f1831ffb640 1 -- 172.21.15.53:0/4075855299 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f183c043070 con 0x564c598ad1b0 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.756+0000 7f1831ffb640 1 -- 172.21.15.53:0/4075855299 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f183c004500 con 0x564c598ad1b0 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.756+0000 7f185716f740 10 client.20055 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.756+0000 7f185716f740 10 client.20055 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:19:13.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.756+0000 7f185716f740 20 client.20055 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.756+0000 7f185716f740 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564c59869da0 0x564c59d0e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.756+0000 7f185716f740 4 client.20055 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.756+0000 7f185716f740 1 -- 172.21.15.53:0/4075855299 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f183c028040 con 0x564c59869da0 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.756+0000 7f1849d9b640 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564c59869da0 0x564c59d0e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.756+0000 7f1831ffb640 10 client.20055 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.756+0000 7f1849d9b640 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564c59869da0 0x564c59d0e4d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6ee8c7612d51ff0c server_cookie=b3eeb20ca81ea2de in_seq=0 out_seq=0 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f1831ffb640 1 -- 172.21.15.53:0/4075855299 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f183c028040 con 0x564c59869da0 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f1831ffb640 10 client.20055 handle_command_reply: tid=0 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 1 client.20055 shutdown 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 1 -- 172.21.15.53:0/4075855299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 msgr2=0x564c59c97e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c97e70 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f183c0058b0 tx=0x7f183c005b90 comp rx=0 tx=0).stop 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 1 -- 172.21.15.53:0/4075855299 shutdown_connections 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c598d6070 0x564c59c93880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564c598b5390 0x564c59c93320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x564c59869da0 0x564c59d0e4d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 1 --2- 172.21.15.53:0/4075855299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c598ad1b0 0x564c59c97e70 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 1 -- 172.21.15.53:0/4075855299 >> 172.21.15.53:0/4075855299 conn(0x564c598ca460 msgr2=0x564c59c7e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:13.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f1831ffb640 0 client.20055 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:19:13.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 1 -- 172.21.15.53:0/4075855299 shutdown_connections 2024-08-31T06:19:13.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 1 -- 172.21.15.53:0/4075855299 wait complete. 2024-08-31T06:19:13.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.757+0000 7f185716f740 20 client.20055 trim_cache size 0 max 16384 2024-08-31T06:19:13.764 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.758+0000 7f1850bfa640 1 -- 172.21.15.53:0/3708970992 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f18340b4d20 msgr2=0x7f18340b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.758+0000 7f1850bfa640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f18340b4d20 0x7f18340b7230 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1840006010 tx=0x7f1840005df0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.758+0000 7f1850bfa640 1 -- 172.21.15.53:0/3708970992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f184c108a90 msgr2=0x7f184c1107d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.758+0000 7f1850bfa640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f184c108a90 0x7f184c1107d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f184400eb10 tx=0x7f184400c2d0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.758+0000 7f1850bfa640 1 -- 172.21.15.53:0/3708970992 shutdown_connections 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.758+0000 7f1850bfa640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f18340b4d20 0x7f18340b7230 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.758+0000 7f1850bfa640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f184c108a90 0x7f184c1107d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.758+0000 7f1850bfa640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f184c108140 0x7f184c110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.758+0000 7f1850bfa640 1 --2- 172.21.15.53:0/3708970992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c102800 0x7f184c10fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.758+0000 7f1850bfa640 1 -- 172.21.15.53:0/3708970992 >> 172.21.15.53:0/3708970992 conn(0x7f184c0794d0 msgr2=0x7f184c105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.759+0000 7f1850bfa640 1 -- 172.21.15.53:0/3708970992 shutdown_connections 2024-08-31T06:19:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:13.759+0000 7f1850bfa640 1 -- 172.21.15.53:0/3708970992 wait complete. 2024-08-31T06:19:14.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4683 6.83 MB/sec warmup 62 sec latency 3198.257 ms 2024-08-31T06:19:14.460 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:14 smithi053 ceph-mon[18924]: pgmap v768: 97 pgs: 97 active+clean; 350 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 262 KiB/s wr, 40 op/s 2024-08-31T06:19:14.504 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:19:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:14 smithi130 ceph-mon[22266]: pgmap v768: 97 pgs: 97 active+clean; 350 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 262 KiB/s wr, 40 op/s 2024-08-31T06:19:14.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:14 smithi153 ceph-mon[22320]: pgmap v768: 97 pgs: 97 active+clean; 350 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 262 KiB/s wr, 40 op/s 2024-08-31T06:19:14.874 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:14.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.984+0000 7fb4377c3640 1 -- 172.21.15.53:0/2346225583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4301080b0 msgr2=0x7fb4301084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:14.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.984+0000 7fb4377c3640 1 --2- 172.21.15.53:0/2346225583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4301080b0 0x7fb4301084c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb420009900 tx=0x7fb42002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:19:14.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.984+0000 7fb4377c3640 1 -- 172.21.15.53:0/2346225583 shutdown_connections 2024-08-31T06:19:14.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.984+0000 7fb4377c3640 1 --2- 172.21.15.53:0/2346225583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb430108a00 0x7fb43010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:14.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.984+0000 7fb4377c3640 1 --2- 172.21.15.53:0/2346225583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4301080b0 0x7fb4301084c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.984+0000 7fb4377c3640 1 --2- 172.21.15.53:0/2346225583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb430102780 0x7fb430102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.984+0000 7fb4377c3640 1 -- 172.21.15.53:0/2346225583 >> 172.21.15.53:0/2346225583 conn(0x7fb4300fe180 msgr2=0x7fb4301005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.984+0000 7fb4377c3640 1 -- 172.21.15.53:0/2346225583 shutdown_connections 2024-08-31T06:19:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.984+0000 7fb4377c3640 1 -- 172.21.15.53:0/2346225583 wait complete. 2024-08-31T06:19:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.985+0000 7fb4377c3640 1 Processor -- start 2024-08-31T06:19:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.985+0000 7fb4377c3640 1 -- start start 2024-08-31T06:19:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.985+0000 7fb4377c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb430102780 0x7fb43019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.985+0000 7fb4377c3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4301080b0 0x7fb43019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.985+0000 7fb4377c3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb430108a00 0x7fb43019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.985+0000 7fb4377c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb430112540 con 0x7fb430102780 2024-08-31T06:19:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.985+0000 7fb4377c3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4301123c0 con 0x7fb4301080b0 2024-08-31T06:19:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.985+0000 7fb4377c3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4301126c0 con 0x7fb430108a00 2024-08-31T06:19:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.985+0000 7fb43555f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb430102780 0x7fb43019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.985+0000 7fb434d5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4301080b0 0x7fb43019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb43555f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb430102780 0x7fb43019af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47588/0 (socket says 172.21.15.53:47588) 2024-08-31T06:19:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb43555f640 1 -- 172.21.15.53:0/2305826283 learned_addr learned my addr 172.21.15.53:0/2305826283 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb435d60640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb430108a00 0x7fb43019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb43555f640 1 -- 172.21.15.53:0/2305826283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb430108a00 msgr2=0x7fb43019b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb43555f640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb430108a00 0x7fb43019b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb43555f640 1 -- 172.21.15.53:0/2305826283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4301080b0 msgr2=0x7fb43019b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb43555f640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4301080b0 0x7fb43019b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb43555f640 1 -- 172.21.15.53:0/2305826283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4301a6200 con 0x7fb430102780 2024-08-31T06:19:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb43555f640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb430102780 0x7fb43019af70 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00b340 tx=0x7fb42c00b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb4267fc640 1 -- 172.21.15.53:0/2305826283 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c005020 con 0x7fb430102780 2024-08-31T06:19:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb4377c3640 1 -- 172.21.15.53:0/2305826283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb430198dc0 con 0x7fb430102780 2024-08-31T06:19:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb4267fc640 1 -- 172.21.15.53:0/2305826283 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb42c005650 con 0x7fb430102780 2024-08-31T06:19:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb4267fc640 1 -- 172.21.15.53:0/2305826283 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c01a6e0 con 0x7fb430102780 2024-08-31T06:19:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.986+0000 7fb4377c3640 1 -- 172.21.15.53:0/2305826283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4301992e0 con 0x7fb430102780 2024-08-31T06:19:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.990+0000 7fb43e80c740 1 Processor -- start 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.990+0000 7fb43e80c740 1 -- start start 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.990+0000 7fb4267fc640 1 -- 172.21.15.53:0/2305826283 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb42c01a880 con 0x7fb430102780 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.990+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 0x56004c81cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.990+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4502f0 0x56004c81d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.990+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4584d0 0x56004c81d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.990+0000 7fb43e80c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56004c792000 con 0x56004c4502f0 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.990+0000 7fb43e80c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56004c781590 con 0x56004c4791b0 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.990+0000 7fb43e80c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56004c785540 con 0x56004c4584d0 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.990+0000 7fb435d60640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 0x56004c81cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb435d60640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 0x56004c81cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52572/0 (socket says 172.21.15.53:52572) 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb43555f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4502f0 0x56004c81d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb435d60640 1 -- 172.21.15.53:0/2423388161 learned_addr learned my addr 172.21.15.53:0/2423388161 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb434d5e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4584d0 0x56004c81d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb435d60640 1 -- 172.21.15.53:0/2423388161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4584d0 msgr2=0x56004c81d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb435d60640 1 --2- 172.21.15.53:0/2423388161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4584d0 0x56004c81d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb435d60640 1 -- 172.21.15.53:0/2423388161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4502f0 msgr2=0x56004c81d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb435d60640 1 --2- 172.21.15.53:0/2423388161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4502f0 0x56004c81d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb435d60640 1 -- 172.21.15.53:0/2423388161 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56004c4e4790 con 0x56004c4791b0 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb435d60640 1 --2- 172.21.15.53:0/2423388161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 0x56004c81cac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb428011470 tx=0x7fb428011930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c16ac0618c27d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb4267fc640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb41c0b4ca0 0x7fb41c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb41b7fe640 1 -- 172.21.15.53:0/2423388161 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42801e070 con 0x56004c4791b0 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.991+0000 7fb43555f640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb41c0b4ca0 0x7fb41c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.992+0000 7fb41b7fe640 1 -- 172.21.15.53:0/2423388161 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb428003c30 con 0x56004c4791b0 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.992+0000 7fb4267fc640 1 -- 172.21.15.53:0/2305826283 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fb42c0ed3b0 con 0x7fb430102780 2024-08-31T06:19:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.992+0000 7fb41b7fe640 1 -- 172.21.15.53:0/2423388161 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42800f830 con 0x56004c4791b0 2024-08-31T06:19:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.993+0000 7fb43e80c740 1 -- 172.21.15.53:0/2423388161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 msgr2=0x56004c81cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.993+0000 7fb43555f640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb41c0b4ca0 0x7fb41c0b71b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0eab90 tx=0x7fb42c0f0f00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.993+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2423388161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 0x56004c81cac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb428011470 tx=0x7fb428011930 comp rx=0 tx=0).stop 2024-08-31T06:19:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.993+0000 7fb43e80c740 1 -- 172.21.15.53:0/2423388161 shutdown_connections 2024-08-31T06:19:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.993+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2423388161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4584d0 0x56004c81d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.993+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2423388161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4502f0 0x56004c81d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.993+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2423388161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 0x56004c81cac0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.993+0000 7fb43e80c740 1 -- 172.21.15.53:0/2423388161 >> 172.21.15.53:0/2423388161 conn(0x56004c46d300 msgr2=0x56004c81a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.993+0000 7fb43e80c740 1 -- 172.21.15.53:0/2423388161 shutdown_connections 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.993+0000 7fb43e80c740 1 -- 172.21.15.53:0/2423388161 wait complete. 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.993+0000 7fb43e80c740 1 -- start start 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.994+0000 7fb43e80c740 1 Processor -- start 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.994+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4502f0 0x56004c828660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.994+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4584d0 0x56004c828ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.994+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4791b0 0x56004c834560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.994+0000 7fb43e80c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56004c6baab0 con 0x56004c4791b0 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.994+0000 7fb435d60640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4502f0 0x56004c828660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.994+0000 7fb435d60640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4502f0 0x56004c828660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52588/0 (socket says 172.21.15.53:52588) 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.994+0000 7fb435d60640 1 -- 172.21.15.53:0/2472164885 learned_addr learned my addr 172.21.15.53:0/2472164885 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.994+0000 7fb43e80c740 1 -- 172.21.15.53:0/2472164885 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56004c708680 con 0x56004c4502f0 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.994+0000 7fb43e80c740 1 -- 172.21.15.53:0/2472164885 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56004c82b240 con 0x56004c4584d0 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.994+0000 7fb434d5e640 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4584d0 0x56004c828ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.995+0000 7fb43e80c740 10 client.0 _ll_register_callbacks cb 0x56004c490a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.995+0000 7fb435d60640 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4791b0 0x56004c834560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.995+0000 7fb434d5e640 1 -- 172.21.15.53:0/2472164885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4502f0 msgr2=0x56004c828660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.995+0000 7fb434d5e640 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4502f0 0x56004c828660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.995+0000 7fb434d5e640 1 -- 172.21.15.53:0/2472164885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4791b0 msgr2=0x56004c834560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.995+0000 7fb434d5e640 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4791b0 0x56004c834560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.995+0000 7fb434d5e640 1 -- 172.21.15.53:0/2472164885 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56004c55d620 con 0x56004c4584d0 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.995+0000 7fb435d60640 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4791b0 0x56004c834560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.995+0000 7fb434d5e640 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4584d0 0x56004c828ba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb420009850 tx=0x7fb420031de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a76fa4fd87b622b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.995+0000 7fb418ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.996+0000 7fb418ff9640 1 -- 172.21.15.53:0/2472164885 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420035040 con 0x56004c4584d0 2024-08-31T06:19:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.996+0000 7fb418ff9640 1 -- 172.21.15.53:0/2472164885 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fb4200316c0 con 0x56004c4584d0 2024-08-31T06:19:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.996+0000 7fb43e80c740 1 -- 172.21.15.53:0/2472164885 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb428003c30 con 0x56004c4584d0 2024-08-31T06:19:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.996+0000 7fb418ff9640 1 -- 172.21.15.53:0/2472164885 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fb4200318c0 con 0x56004c4584d0 2024-08-31T06:19:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.996+0000 7fb43e80c740 10 client.29035 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.996+0000 7fb43e80c740 1 -- 172.21.15.53:0/2472164885 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x56004c837220 con 0x56004c4584d0 2024-08-31T06:19:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.996+0000 7fb418ff9640 1 -- 172.21.15.53:0/2472164885 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb428003c30 con 0x56004c4584d0 2024-08-31T06:19:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.996+0000 7fb418ff9640 1 -- 172.21.15.53:0/2472164885 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fb420003af0 con 0x56004c4584d0 2024-08-31T06:19:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.997+0000 7fb43e80c740 10 client.29035 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.997+0000 7fb43e80c740 10 client.29035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.997+0000 7fb43e80c740 20 client.29035 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.997+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56004c437d80 0x56004c83a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.997+0000 7fb43e80c740 4 client.29035 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.997+0000 7fb43e80c740 1 -- 172.21.15.53:0/2472164885 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56004c793f50 con 0x56004c437d80 2024-08-31T06:19:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.997+0000 7fb435d60640 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56004c437d80 0x56004c83a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.997+0000 7fb418ff9640 10 client.29035 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.997+0000 7fb435d60640 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56004c437d80 0x56004c83a830 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b63f7c0d2ad78c89 server_cookie=18ac1df1b513d8ea in_seq=0 out_seq=0 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb418ff9640 1 -- 172.21.15.53:0/2472164885 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56004c793f50 con 0x56004c437d80 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb418ff9640 10 client.29035 handle_command_reply: tid=0 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb43e80c740 1 client.29035 shutdown 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb43e80c740 1 -- 172.21.15.53:0/2472164885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4584d0 msgr2=0x56004c828ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4584d0 0x56004c828ba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb420009850 tx=0x7fb420031de0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb43e80c740 1 -- 172.21.15.53:0/2472164885 shutdown_connections 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56004c437d80 0x56004c83a830 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4791b0 0x56004c834560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4584d0 0x56004c828ba0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb418ff9640 0 client.29035 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2472164885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4502f0 0x56004c828660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb43e80c740 1 -- 172.21.15.53:0/2472164885 >> 172.21.15.53:0/2472164885 conn(0x56004c46d300 msgr2=0x56004c81daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb43e80c740 1 -- 172.21.15.53:0/2472164885 shutdown_connections 2024-08-31T06:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.998+0000 7fb43e80c740 1 -- 172.21.15.53:0/2472164885 wait complete. 2024-08-31T06:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:14.999+0000 7fb43e80c740 20 client.29035 trim_cache size 0 max 16384 2024-08-31T06:19:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.022+0000 7fb43e80c740 1 Processor -- start 2024-08-31T06:19:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.022+0000 7fb43e80c740 1 -- start start 2024-08-31T06:19:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 0x56004c826cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4584d0 0x56004c8271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4791b0 0x56004c821b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb43e80c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb4301ad2d0 con 0x56004c4791b0 2024-08-31T06:19:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb43e80c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4301af050 con 0x56004c4584d0 2024-08-31T06:19:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb43e80c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4301ad9a0 con 0x56004c4502f0 2024-08-31T06:19:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb434d5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4584d0 0x56004c8271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb435d60640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 0x56004c826cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb434d5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4584d0 0x56004c8271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52598/0 (socket says 172.21.15.53:52598) 2024-08-31T06:19:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb434d5e640 1 -- 172.21.15.53:0/2443865860 learned_addr learned my addr 172.21.15.53:0/2443865860 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb435d60640 1 --2- 172.21.15.53:0/2443865860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4791b0 0x56004c821b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb434d5e640 1 -- 172.21.15.53:0/2443865860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 msgr2=0x56004c826cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb434d5e640 1 --2- 172.21.15.53:0/2443865860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 0x56004c826cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb434d5e640 1 -- 172.21.15.53:0/2443865860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4791b0 msgr2=0x56004c821b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb434d5e640 1 --2- 172.21.15.53:0/2443865860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4791b0 0x56004c821b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb434d5e640 1 -- 172.21.15.53:0/2443865860 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56004c829020 con 0x56004c4584d0 2024-08-31T06:19:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.023+0000 7fb434d5e640 1 --2- 172.21.15.53:0/2443865860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4584d0 0x56004c8271f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb4200467c0 tx=0x7fb42002a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6e93a9c189cfbb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.024+0000 7fb41affd640 1 -- 172.21.15.53:0/2443865860 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420053030 con 0x56004c4584d0 2024-08-31T06:19:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.024+0000 7fb41affd640 1 -- 172.21.15.53:0/2443865860 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb420003f90 con 0x56004c4584d0 2024-08-31T06:19:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.024+0000 7fb41affd640 1 -- 172.21.15.53:0/2443865860 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420031720 con 0x56004c4584d0 2024-08-31T06:19:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.025+0000 7fb43e80c740 1 -- 172.21.15.53:0/2443865860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4584d0 msgr2=0x56004c8271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.025+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2443865860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4584d0 0x56004c8271f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb4200467c0 tx=0x7fb42002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.025+0000 7fb43e80c740 1 -- 172.21.15.53:0/2443865860 shutdown_connections 2024-08-31T06:19:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.025+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2443865860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4791b0 0x56004c821b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.025+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2443865860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4584d0 0x56004c8271f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.025+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2443865860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 0x56004c826cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.025+0000 7fb43e80c740 1 -- 172.21.15.53:0/2443865860 >> 172.21.15.53:0/2443865860 conn(0x56004c46d300 msgr2=0x56004c8235c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.025+0000 7fb43e80c740 1 -- 172.21.15.53:0/2443865860 shutdown_connections 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.025+0000 7fb43e80c740 1 -- 172.21.15.53:0/2443865860 wait complete. 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.025+0000 7fb43e80c740 1 -- start start 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.025+0000 7fb43e80c740 1 Processor -- start 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 0x56004c82c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4584d0 0x56004c82cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb43e80c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 0x56004c82d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb43e80c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb4301ae8c0 con 0x56004c4584d0 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb43e80c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4301ae130 con 0x56004c4791b0 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb43e80c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4301ab2d0 con 0x56004c4502f0 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb43e80c740 10 client.0 _ll_register_callbacks cb 0x7fb420009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb435d60640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 0x56004c82c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb435d60640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 0x56004c82c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:40246/0 (socket says 172.21.15.53:40246) 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb434d5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4584d0 0x56004c82cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb435d60640 1 -- 172.21.15.53:0/2748620167 learned_addr learned my addr 172.21.15.53:0/2748620167 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb435d60640 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 0x56004c82d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb435d60640 1 -- 172.21.15.53:0/2748620167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 msgr2=0x56004c82d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.026+0000 7fb435d60640 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 0x56004c82d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb435d60640 1 -- 172.21.15.53:0/2748620167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4584d0 msgr2=0x56004c82cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb435d60640 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4584d0 0x56004c82cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb435d60640 1 -- 172.21.15.53:0/2748620167 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56004c8a42f0 con 0x56004c4502f0 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb435d60640 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 0x56004c82c5d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb428011470 tx=0x7fb428009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5dff0478ab2c281 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb418ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb418ff9640 1 -- 172.21.15.53:0/2748620167 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42801e040 con 0x56004c4502f0 2024-08-31T06:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb418ff9640 1 -- 172.21.15.53:0/2748620167 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fb428005130 con 0x56004c4502f0 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb43e80c740 1 -- 172.21.15.53:0/2748620167 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb420003f90 con 0x56004c4502f0 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb418ff9640 1 -- 172.21.15.53:0/2748620167 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fb428005330 con 0x56004c4502f0 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb43e80c740 10 client.29041 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb43e80c740 1 -- 172.21.15.53:0/2748620167 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x56004c8a5580 con 0x56004c4502f0 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.027+0000 7fb418ff9640 1 -- 172.21.15.53:0/2748620167 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb420003f90 con 0x56004c4502f0 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.028+0000 7fb418ff9640 1 -- 172.21.15.53:0/2748620167 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fb428024040 con 0x56004c4502f0 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.028+0000 7fb43e80c740 10 client.29041 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.028+0000 7fb43e80c740 10 client.29041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.028+0000 7fb43e80c740 20 client.29041 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.028+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56004c40d1c0 0x56004c8a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.028+0000 7fb43e80c740 4 client.29041 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.028+0000 7fb43e80c740 1 -- 172.21.15.53:0/2748620167 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56004c78f9f0 con 0x56004c40d1c0 2024-08-31T06:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.028+0000 7fb434d5e640 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56004c40d1c0 0x56004c8a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.029+0000 7fb418ff9640 10 client.29041 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.029+0000 7fb434d5e640 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56004c40d1c0 0x56004c8a7c20 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e97037a0e6eb3920 server_cookie=f9024e60a8ca1c99 in_seq=0 out_seq=0 2024-08-31T06:19:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb418ff9640 1 -- 172.21.15.53:0/2748620167 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56004c78f9f0 con 0x56004c40d1c0 2024-08-31T06:19:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb418ff9640 10 client.29041 handle_command_reply: tid=0 2024-08-31T06:19:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb43e80c740 1 client.29041 shutdown 2024-08-31T06:19:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb43e80c740 1 -- 172.21.15.53:0/2748620167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 msgr2=0x56004c82c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 0x56004c82c5d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb428011470 tx=0x7fb428009500 comp rx=0 tx=0).stop 2024-08-31T06:19:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb43e80c740 1 -- 172.21.15.53:0/2748620167 shutdown_connections 2024-08-31T06:19:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56004c40d1c0 0x56004c8a7c20 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb418ff9640 0 client.29041 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56004c4791b0 0x56004c82d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56004c4584d0 0x56004c82cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb43e80c740 1 --2- 172.21.15.53:0/2748620167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56004c4502f0 0x56004c82c5d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.068+0000 7fb43e80c740 1 -- 172.21.15.53:0/2748620167 >> 172.21.15.53:0/2748620167 conn(0x56004c46d300 msgr2=0x56004c8235c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.069+0000 7fb43e80c740 1 -- 172.21.15.53:0/2748620167 shutdown_connections 2024-08-31T06:19:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.069+0000 7fb43e80c740 1 -- 172.21.15.53:0/2748620167 wait complete. 2024-08-31T06:19:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.069+0000 7fb43e80c740 20 client.29041 trim_cache size 0 max 16384 2024-08-31T06:19:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:19:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:19:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:19:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:19:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 -- 172.21.15.53:0/2305826283 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb41c0b4ca0 msgr2=0x7fb41c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb41c0b4ca0 0x7fb41c0b71b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0eab90 tx=0x7fb42c0f0f00 comp rx=0 tx=0).stop 2024-08-31T06:19:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 -- 172.21.15.53:0/2305826283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb430102780 msgr2=0x7fb43019af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb430102780 0x7fb43019af70 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00b340 tx=0x7fb42c00b740 comp rx=0 tx=0).stop 2024-08-31T06:19:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 -- 172.21.15.53:0/2305826283 shutdown_connections 2024-08-31T06:19:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb41c0b4ca0 0x7fb41c0b71b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb430108a00 0x7fb43019b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4301080b0 0x7fb43019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 --2- 172.21.15.53:0/2305826283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb430102780 0x7fb43019af70 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 -- 172.21.15.53:0/2305826283 >> 172.21.15.53:0/2305826283 conn(0x7fb4300fe180 msgr2=0x7fb4301005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 -- 172.21.15.53:0/2305826283 shutdown_connections 2024-08-31T06:19:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:15.070+0000 7fb4377c3640 1 -- 172.21.15.53:0/2305826283 wait complete. 2024-08-31T06:19:15.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 4856 6.93 MB/sec warmup 63 sec latency 3897.104 ms 2024-08-31T06:19:15.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.482+0000 7fc57f388640 1 -- 172.21.15.53:0/592883890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578108ad0 msgr2=0x7fc57810f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.482+0000 7fc57f388640 1 --2- 172.21.15.53:0/592883890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578108ad0 0x7fc57810f300 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fc570009ca0 tx=0x7fc57002c790 comp rx=0 tx=0).stop 2024-08-31T06:19:15.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.482+0000 7fc57f388640 1 -- 172.21.15.53:0/592883890 shutdown_connections 2024-08-31T06:19:15.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.482+0000 7fc57f388640 1 --2- 172.21.15.53:0/592883890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578108ad0 0x7fc57810f300 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.482+0000 7fc57f388640 1 --2- 172.21.15.53:0/592883890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc578108180 0x7fc578108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.482+0000 7fc57f388640 1 --2- 172.21.15.53:0/592883890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc578102840 0x7fc578102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.482+0000 7fc57f388640 1 -- 172.21.15.53:0/592883890 >> 172.21.15.53:0/592883890 conn(0x7fc5780794f0 msgr2=0x7fc578079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.482+0000 7fc57f388640 1 -- 172.21.15.53:0/592883890 shutdown_connections 2024-08-31T06:19:15.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.482+0000 7fc57f388640 1 -- 172.21.15.53:0/592883890 wait complete. 2024-08-31T06:19:15.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57f388640 1 Processor -- start 2024-08-31T06:19:15.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57f388640 1 -- start start 2024-08-31T06:19:15.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57f388640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc578102840 0x7fc57819c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57f388640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578108180 0x7fc57819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57f388640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc578108ad0 0x7fc5781a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57c923640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578108180 0x7fc57819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57d124640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc578102840 0x7fc57819c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57c923640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578108180 0x7fc57819c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47638/0 (socket says 172.21.15.53:47638) 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57d124640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc578102840 0x7fc57819c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52634/0 (socket says 172.21.15.53:52634) 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57f388640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc578111540 con 0x7fc578108180 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57f388640 1 -- 172.21.15.53:0/416746491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc5781113c0 con 0x7fc578102840 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57c923640 1 -- 172.21.15.53:0/416746491 learned_addr learned my addr 172.21.15.53:0/416746491 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57f388640 1 -- 172.21.15.53:0/416746491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc5781116c0 con 0x7fc578108ad0 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.483+0000 7fc57d925640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc578108ad0 0x7fc5781a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc57d124640 1 -- 172.21.15.53:0/416746491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc578108ad0 msgr2=0x7fc5781a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc57d124640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc578108ad0 0x7fc5781a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc57d124640 1 -- 172.21.15.53:0/416746491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578108180 msgr2=0x7fc57819c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc57d124640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578108180 0x7fc57819c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc57d124640 1 -- 172.21.15.53:0/416746491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5781a2290 con 0x7fc578102840 2024-08-31T06:19:15.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc57c923640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578108180 0x7fc57819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:15.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc57d124640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc578102840 0x7fc57819c320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc57400e9f0 tx=0x7fc57400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:15.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc56e7fc640 1 -- 172.21.15.53:0/416746491 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57400ccc0 con 0x7fc578102840 2024-08-31T06:19:15.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc56e7fc640 1 -- 172.21.15.53:0/416746491 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5740108c0 con 0x7fc578102840 2024-08-31T06:19:15.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc57f388640 1 -- 172.21.15.53:0/416746491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5781a2580 con 0x7fc578102840 2024-08-31T06:19:15.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc57f388640 1 -- 172.21.15.53:0/416746491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc578197c20 con 0x7fc578102840 2024-08-31T06:19:15.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.484+0000 7fc56e7fc640 1 -- 172.21.15.53:0/416746491 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5740187e0 con 0x7fc578102840 2024-08-31T06:19:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.488+0000 7fc56e7fc640 1 -- 172.21.15.53:0/416746491 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc574018980 con 0x7fc578102840 2024-08-31T06:19:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.488+0000 7fc5858fd740 1 Processor -- start 2024-08-31T06:19:15.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.488+0000 7fc5858fd740 1 -- start start 2024-08-31T06:19:15.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 0x55a1459ea310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a14561c1b0 0x55a1459ea850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145624390 0x55a1459ead90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc5858fd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a145961680 con 0x55a145645070 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc5858fd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a145950c10 con 0x55a14561c1b0 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc5858fd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a145954bc0 con 0x55a145624390 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57d925640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 0x55a1459ea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57c923640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145624390 0x55a1459ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57c923640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145624390 0x55a1459ead90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:40264/0 (socket says 172.21.15.53:40264) 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57c923640 1 -- 172.21.15.53:0/1803049444 learned_addr learned my addr 172.21.15.53:0/1803049444 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc56e7fc640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5640b4ca0 0x7fc5640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57d124640 1 --2- 172.21.15.53:0/1803049444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a14561c1b0 0x55a1459ea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57c923640 1 -- 172.21.15.53:0/1803049444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a14561c1b0 msgr2=0x55a1459ea850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57c923640 1 --2- 172.21.15.53:0/1803049444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a14561c1b0 0x55a1459ea850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57c923640 1 -- 172.21.15.53:0/1803049444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 msgr2=0x55a1459ea310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57c923640 1 --2- 172.21.15.53:0/1803049444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 0x55a1459ea310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57c923640 1 -- 172.21.15.53:0/1803049444 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1456b0650 con 0x55a145624390 2024-08-31T06:19:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57d925640 1 --2- 172.21.15.53:0/1803049444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 0x55a1459ea310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:19:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc56e7fc640 1 -- 172.21.15.53:0/416746491 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fc5740e57d0 con 0x7fc578102840 2024-08-31T06:19:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57d925640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5640b4ca0 0x7fc5640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.489+0000 7fc57c923640 1 --2- 172.21.15.53:0/1803049444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145624390 0x55a1459ead90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc568009c30 tx=0x7fc568005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f8ddcefd712680c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.490+0000 7fc5637fe640 1 -- 172.21.15.53:0/1803049444 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568009d20 con 0x55a145624390 2024-08-31T06:19:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.490+0000 7fc5637fe640 1 -- 172.21.15.53:0/1803049444 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc56801e890 con 0x55a145624390 2024-08-31T06:19:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.490+0000 7fc5637fe640 1 -- 172.21.15.53:0/1803049444 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56801d820 con 0x55a145624390 2024-08-31T06:19:15.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.491+0000 7fc5858fd740 1 -- 172.21.15.53:0/1803049444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145624390 msgr2=0x55a1459ead90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.491+0000 7fc5858fd740 1 --2- 172.21.15.53:0/1803049444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145624390 0x55a1459ead90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc568009c30 tx=0x7fc568005f90 comp rx=0 tx=0).stop 2024-08-31T06:19:15.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.491+0000 7fc57d925640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5640b4ca0 0x7fc5640b71b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc57000d4e0 tx=0x7fc5700095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:15.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.491+0000 7fc5858fd740 1 -- 172.21.15.53:0/1803049444 shutdown_connections 2024-08-31T06:19:15.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.491+0000 7fc5858fd740 1 --2- 172.21.15.53:0/1803049444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145624390 0x55a1459ead90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.491+0000 7fc5858fd740 1 --2- 172.21.15.53:0/1803049444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a14561c1b0 0x55a1459ea850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.491+0000 7fc5858fd740 1 --2- 172.21.15.53:0/1803049444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 0x55a1459ea310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.491+0000 7fc5858fd740 1 -- 172.21.15.53:0/1803049444 >> 172.21.15.53:0/1803049444 conn(0x55a145639460 msgr2=0x55a1459e8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.491+0000 7fc5858fd740 1 -- 172.21.15.53:0/1803049444 shutdown_connections 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.491+0000 7fc5858fd740 1 -- 172.21.15.53:0/1803049444 wait complete. 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.492+0000 7fc5858fd740 1 -- start start 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.492+0000 7fc5858fd740 1 Processor -- start 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.492+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a14561c1b0 0x55a1459f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145624390 0x55a1459f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc57d124640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a14561c1b0 0x55a1459f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc57d124640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a14561c1b0 0x55a1459f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:40276/0 (socket says 172.21.15.53:40276) 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145645070 0x55a145a01e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc57d124640 1 -- 172.21.15.53:0/1049520381 learned_addr learned my addr 172.21.15.53:0/1049520381 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc5858fd740 1 -- 172.21.15.53:0/1049520381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a1457b3700 con 0x55a145624390 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc5858fd740 1 -- 172.21.15.53:0/1049520381 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a1458d7750 con 0x55a145645070 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc5858fd740 1 -- 172.21.15.53:0/1049520381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a1459f8af0 con 0x55a14561c1b0 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc57d925640 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145645070 0x55a145a01e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc57d124640 1 -- 172.21.15.53:0/1049520381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145645070 msgr2=0x55a145a01e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc57d124640 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145645070 0x55a145a01e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc57d124640 1 -- 172.21.15.53:0/1049520381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145624390 msgr2=0x55a1459f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc5858fd740 10 client.0 _ll_register_callbacks cb 0x55a145906e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc57c923640 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145624390 0x55a1459f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc57d124640 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145624390 0x55a1459f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc57d124640 1 -- 172.21.15.53:0/1049520381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a145910900 con 0x55a14561c1b0 2024-08-31T06:19:15.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc5858fd740 1 -- 172.21.15.53:0/1049520381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc56801e890 con 0x55a14561c1b0 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.493+0000 7fc57c923640 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145624390 0x55a1459f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.494+0000 7fc57d124640 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a14561c1b0 0x55a1459f5a20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc5740e2f60 tx=0x7fc57400ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6f2ef1fd29b65c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.494+0000 7fc560ff9640 10 client.29053 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.494+0000 7fc560ff9640 1 -- 172.21.15.53:0/1049520381 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5740abf50 con 0x55a14561c1b0 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.494+0000 7fc560ff9640 1 -- 172.21.15.53:0/1049520381 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fc574010430 con 0x55a14561c1b0 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.494+0000 7fc560ff9640 1 -- 172.21.15.53:0/1049520381 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fc574010650 con 0x55a14561c1b0 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.494+0000 7fc5858fd740 10 client.29053 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.494+0000 7fc5858fd740 1 -- 172.21.15.53:0/1049520381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55a145a046f0 con 0x55a14561c1b0 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.495+0000 7fc560ff9640 1 -- 172.21.15.53:0/1049520381 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fc5740ab1b0 con 0x55a14561c1b0 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.495+0000 7fc5858fd740 10 client.29053 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.495+0000 7fc5858fd740 10 client.29053 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.495+0000 7fc5858fd740 20 client.29053 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:15.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.495+0000 7fc5858fd740 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a1456039f0 0x55a145a07bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.495+0000 7fc5858fd740 4 client.29053 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:15.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.495+0000 7fc5858fd740 1 -- 172.21.15.53:0/1049520381 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1459635d0 con 0x55a1456039f0 2024-08-31T06:19:15.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.495+0000 7fc57c923640 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a1456039f0 0x55a145a07bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.496+0000 7fc560ff9640 10 client.29053 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:19:15.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.496+0000 7fc57c923640 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a1456039f0 0x55a145a07bb0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=555730b7c9239b53 server_cookie=ad06454ab947e5b4 in_seq=0 out_seq=0 2024-08-31T06:19:15.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.496+0000 7fc560ff9640 1 -- 172.21.15.53:0/1049520381 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1459635d0 con 0x55a1456039f0 2024-08-31T06:19:15.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.496+0000 7fc560ff9640 10 client.29053 handle_command_reply: tid=0 2024-08-31T06:19:15.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.496+0000 7fc5858fd740 1 client.29053 shutdown 2024-08-31T06:19:15.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc5858fd740 1 -- 172.21.15.53:0/1049520381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a14561c1b0 msgr2=0x55a1459f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc5858fd740 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a14561c1b0 0x55a1459f5a20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc5740e2f60 tx=0x7fc57400ce60 comp rx=0 tx=0).stop 2024-08-31T06:19:15.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc5858fd740 1 -- 172.21.15.53:0/1049520381 shutdown_connections 2024-08-31T06:19:15.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc5858fd740 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a1456039f0 0x55a145a07bb0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc560ff9640 0 client.29053 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:19:15.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc5858fd740 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145645070 0x55a145a01e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc5858fd740 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145624390 0x55a1459f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc5858fd740 1 --2- 172.21.15.53:0/1049520381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a14561c1b0 0x55a1459f5a20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc5858fd740 1 -- 172.21.15.53:0/1049520381 >> 172.21.15.53:0/1049520381 conn(0x55a145639460 msgr2=0x55a1459ed4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:15.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc5858fd740 1 -- 172.21.15.53:0/1049520381 shutdown_connections 2024-08-31T06:19:15.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc5858fd740 1 -- 172.21.15.53:0/1049520381 wait complete. 2024-08-31T06:19:15.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.497+0000 7fc5858fd740 20 client.29053 trim_cache size 0 max 16384 2024-08-31T06:19:15.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.516+0000 7fc5858fd740 1 Processor -- start 2024-08-31T06:19:15.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.516+0000 7fc5858fd740 1 -- start start 2024-08-31T06:19:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.516+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1456039f0 0x55a1459f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.516+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145624390 0x55a1459f3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.516+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145645070 0x55a145a0d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.516+0000 7fc5858fd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c00e820 con 0x55a1456039f0 2024-08-31T06:19:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.516+0000 7fc5858fd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c0105a0 con 0x55a145624390 2024-08-31T06:19:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.516+0000 7fc5858fd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c00eef0 con 0x55a145645070 2024-08-31T06:19:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.516+0000 7fc57d124640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1456039f0 0x55a1459f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.517+0000 7fc57d124640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1456039f0 0x55a1459f2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47664/0 (socket says 172.21.15.53:47664) 2024-08-31T06:19:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.517+0000 7fc57d124640 1 -- 172.21.15.53:0/219316278 learned_addr learned my addr 172.21.15.53:0/219316278 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.517+0000 7fc57c923640 1 --2- 172.21.15.53:0/219316278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145624390 0x55a1459f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.517+0000 7fc57d925640 1 --2- 172.21.15.53:0/219316278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145645070 0x55a145a0d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.517+0000 7fc57d124640 1 -- 172.21.15.53:0/219316278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145645070 msgr2=0x55a145a0d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.517+0000 7fc57d124640 1 --2- 172.21.15.53:0/219316278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145645070 0x55a145a0d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.517+0000 7fc57d124640 1 -- 172.21.15.53:0/219316278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145624390 msgr2=0x55a1459f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.517+0000 7fc57d124640 1 --2- 172.21.15.53:0/219316278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145624390 0x55a1459f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.517+0000 7fc57d124640 1 -- 172.21.15.53:0/219316278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1459f3f20 con 0x55a1456039f0 2024-08-31T06:19:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.517+0000 7fc57d124640 1 --2- 172.21.15.53:0/219316278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1456039f0 0x55a1459f2c10 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fc5740e2fb0 tx=0x7fc5740e4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d548e86ff610a3b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.517+0000 7fc562ffd640 1 -- 172.21.15.53:0/219316278 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5740b0710 con 0x55a1456039f0 2024-08-31T06:19:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.518+0000 7fc562ffd640 1 -- 172.21.15.53:0/219316278 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc56801e890 con 0x55a1456039f0 2024-08-31T06:19:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.518+0000 7fc562ffd640 1 -- 172.21.15.53:0/219316278 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5740b03d0 con 0x55a1456039f0 2024-08-31T06:19:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.519+0000 7fc5858fd740 1 -- 172.21.15.53:0/219316278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1456039f0 msgr2=0x55a1459f2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.519+0000 7fc5858fd740 1 --2- 172.21.15.53:0/219316278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1456039f0 0x55a1459f2c10 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fc5740e2fb0 tx=0x7fc5740e4000 comp rx=0 tx=0).stop 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.519+0000 7fc5858fd740 1 -- 172.21.15.53:0/219316278 shutdown_connections 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.519+0000 7fc5858fd740 1 --2- 172.21.15.53:0/219316278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a145645070 0x55a145a0d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.519+0000 7fc5858fd740 1 --2- 172.21.15.53:0/219316278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145624390 0x55a1459f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.519+0000 7fc5858fd740 1 --2- 172.21.15.53:0/219316278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1456039f0 0x55a1459f2c10 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.519+0000 7fc5858fd740 1 -- 172.21.15.53:0/219316278 >> 172.21.15.53:0/219316278 conn(0x55a145639460 msgr2=0x55a1459f0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.519+0000 7fc5858fd740 1 -- 172.21.15.53:0/219316278 shutdown_connections 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.519+0000 7fc5858fd740 1 -- 172.21.15.53:0/219316278 wait complete. 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.519+0000 7fc5858fd740 1 -- start start 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.519+0000 7fc5858fd740 1 Processor -- start 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1456039f0 0x55a1459fa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145624390 0x55a1459fa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc5858fd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 0x55a145a71600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc5858fd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c00fe10 con 0x55a145645070 2024-08-31T06:19:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc57d925640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 0x55a145a71600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc5858fd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c00f680 con 0x55a145624390 2024-08-31T06:19:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc5858fd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c00c820 con 0x55a1456039f0 2024-08-31T06:19:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc57c923640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145624390 0x55a1459fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc57d925640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 0x55a145a71600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47674/0 (socket says 172.21.15.53:47674) 2024-08-31T06:19:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc57d925640 1 -- 172.21.15.53:0/2887833489 learned_addr learned my addr 172.21.15.53:0/2887833489 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc5858fd740 10 client.0 _ll_register_callbacks cb 0x7fc5740a8670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.520+0000 7fc57d124640 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1456039f0 0x55a1459fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc57c923640 1 -- 172.21.15.53:0/2887833489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1456039f0 msgr2=0x55a1459fa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc57c923640 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1456039f0 0x55a1459fa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc57c923640 1 -- 172.21.15.53:0/2887833489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 msgr2=0x55a145a71600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc57c923640 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 0x55a145a71600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc57c923640 1 -- 172.21.15.53:0/2887833489 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a145a71b40 con 0x55a145624390 2024-08-31T06:19:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc57c923640 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145624390 0x55a1459fa680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc568000c00 tx=0x7fc568005d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b69cfd011eddfe5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc560ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:19:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc560ff9640 1 -- 172.21.15.53:0/2887833489 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56801ee50 con 0x55a145624390 2024-08-31T06:19:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc560ff9640 1 -- 172.21.15.53:0/2887833489 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fc5680050d0 con 0x55a145624390 2024-08-31T06:19:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc5858fd740 1 -- 172.21.15.53:0/2887833489 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc56801e890 con 0x55a145624390 2024-08-31T06:19:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc560ff9640 1 -- 172.21.15.53:0/2887833489 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fc568040050 con 0x55a145624390 2024-08-31T06:19:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc5858fd740 10 client.29054 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.521+0000 7fc5858fd740 1 -- 172.21.15.53:0/2887833489 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55a145a72c60 con 0x55a145624390 2024-08-31T06:19:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.522+0000 7fc560ff9640 1 -- 172.21.15.53:0/2887833489 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc56801e890 con 0x55a145624390 2024-08-31T06:19:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.522+0000 7fc560ff9640 1 -- 172.21.15.53:0/2887833489 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fc56801d6a0 con 0x55a145624390 2024-08-31T06:19:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.522+0000 7fc5858fd740 10 client.29054 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.522+0000 7fc5858fd740 10 client.29054 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:19:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.522+0000 7fc5858fd740 20 client.29054 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.522+0000 7fc5858fd740 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a1455d8da0 0x55a145a750d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.522+0000 7fc5858fd740 4 client.29054 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:19:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.522+0000 7fc5858fd740 1 -- 172.21.15.53:0/2887833489 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a14595f070 con 0x55a1455d8da0 2024-08-31T06:19:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.522+0000 7fc57d124640 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a1455d8da0 0x55a145a750d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.523+0000 7fc560ff9640 10 client.29054 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.523+0000 7fc57d124640 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a1455d8da0 0x55a145a750d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b00cf23303b0dd84 server_cookie=12ef58a3f38be07b in_seq=0 out_seq=0 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.523+0000 7fc560ff9640 1 -- 172.21.15.53:0/2887833489 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a14595f070 con 0x55a1455d8da0 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.523+0000 7fc560ff9640 10 client.29054 handle_command_reply: tid=0 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.523+0000 7fc5858fd740 1 client.29054 shutdown 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc5858fd740 1 -- 172.21.15.53:0/2887833489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145624390 msgr2=0x55a1459fa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc5858fd740 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145624390 0x55a1459fa680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc568000c00 tx=0x7fc568005d20 comp rx=0 tx=0).stop 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc5858fd740 1 -- 172.21.15.53:0/2887833489 shutdown_connections 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc5858fd740 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55a1455d8da0 0x55a145a750d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc5858fd740 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a145645070 0x55a145a71600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc5858fd740 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a145624390 0x55a1459fa680 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc5858fd740 1 --2- 172.21.15.53:0/2887833489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1456039f0 0x55a1459fa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc5858fd740 1 -- 172.21.15.53:0/2887833489 >> 172.21.15.53:0/2887833489 conn(0x55a145639460 msgr2=0x55a1459f42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc560ff9640 0 client.29054 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:19:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc5858fd740 1 -- 172.21.15.53:0/2887833489 shutdown_connections 2024-08-31T06:19:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc5858fd740 1 -- 172.21.15.53:0/2887833489 wait complete. 2024-08-31T06:19:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.524+0000 7fc5858fd740 20 client.29054 trim_cache size 0 max 16384 2024-08-31T06:19:15.530 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:19:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 -- 172.21.15.53:0/416746491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5640b4ca0 msgr2=0x7fc5640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5640b4ca0 0x7fc5640b71b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc57000d4e0 tx=0x7fc5700095c0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 -- 172.21.15.53:0/416746491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc578102840 msgr2=0x7fc57819c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc578102840 0x7fc57819c320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc57400e9f0 tx=0x7fc57400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 -- 172.21.15.53:0/416746491 shutdown_connections 2024-08-31T06:19:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5640b4ca0 0x7fc5640b71b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc578108ad0 0x7fc5781a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578108180 0x7fc57819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 --2- 172.21.15.53:0/416746491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc578102840 0x7fc57819c320 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 -- 172.21.15.53:0/416746491 >> 172.21.15.53:0/416746491 conn(0x7fc5780794f0 msgr2=0x7fc578104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 -- 172.21.15.53:0/416746491 shutdown_connections 2024-08-31T06:19:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:15.525+0000 7fc57f388640 1 -- 172.21.15.53:0/416746491 wait complete. 2024-08-31T06:19:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:15 smithi053 ceph-mon[18924]: osdmap e92: 12 total, 12 up, 12 in 2024-08-31T06:19:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:15 smithi053 ceph-mon[18924]: pgmap v770: 97 pgs: 97 active+clean; 352 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 547 KiB/s wr, 50 op/s 2024-08-31T06:19:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:15 smithi130 ceph-mon[22266]: osdmap e92: 12 total, 12 up, 12 in 2024-08-31T06:19:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:15 smithi130 ceph-mon[22266]: pgmap v770: 97 pgs: 97 active+clean; 352 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 547 KiB/s wr, 50 op/s 2024-08-31T06:19:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:15 smithi153 ceph-mon[22320]: osdmap e92: 12 total, 12 up, 12 in 2024-08-31T06:19:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:15 smithi153 ceph-mon[22320]: pgmap v770: 97 pgs: 97 active+clean; 352 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 547 KiB/s wr, 50 op/s 2024-08-31T06:19:16.253 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:19:16.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 5031 6.97 MB/sec warmup 64 sec latency 77.320 ms 2024-08-31T06:19:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:17.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 5168 6.90 MB/sec warmup 65 sec latency 128.760 ms 2024-08-31T06:19:17.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:17 smithi053 ceph-mon[18924]: pgmap v771: 97 pgs: 97 active+clean; 358 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.2 MiB/s wr, 99 op/s 2024-08-31T06:19:18.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:17 smithi130 ceph-mon[22266]: pgmap v771: 97 pgs: 97 active+clean; 358 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.2 MiB/s wr, 99 op/s 2024-08-31T06:19:18.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:17 smithi153 ceph-mon[22320]: pgmap v771: 97 pgs: 97 active+clean; 358 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.2 MiB/s wr, 99 op/s 2024-08-31T06:19:18.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 5329 6.82 MB/sec warmup 66 sec latency 150.220 ms 2024-08-31T06:19:19.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 5493 6.79 MB/sec warmup 67 sec latency 102.751 ms 2024-08-31T06:19:19.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.576+0000 7f7039711640 1 -- 172.21.15.53:0/3640521013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7034109280 msgr2=0x7f7034109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:19.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.576+0000 7f7039711640 1 --2- 172.21.15.53:0/3640521013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7034109280 0x7f7034109690 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f7028009900 tx=0x7f702802a410 comp rx=0 tx=0).stop 2024-08-31T06:19:19.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.577+0000 7f7039711640 1 -- 172.21.15.53:0/3640521013 shutdown_connections 2024-08-31T06:19:19.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.577+0000 7f7039711640 1 --2- 172.21.15.53:0/3640521013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7034109bd0 0x7f7034110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.577+0000 7f7039711640 1 --2- 172.21.15.53:0/3640521013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7034109280 0x7f7034109690 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.577+0000 7f7039711640 1 --2- 172.21.15.53:0/3640521013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7034103940 0x7f7034103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.577+0000 7f7039711640 1 -- 172.21.15.53:0/3640521013 >> 172.21.15.53:0/3640521013 conn(0x7f70340ff3d0 msgr2=0x7f7034101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:19.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.577+0000 7f7039711640 1 -- 172.21.15.53:0/3640521013 shutdown_connections 2024-08-31T06:19:19.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.577+0000 7f7039711640 1 -- 172.21.15.53:0/3640521013 wait complete. 2024-08-31T06:19:19.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.578+0000 7f7039711640 1 Processor -- start 2024-08-31T06:19:19.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.578+0000 7f7039711640 1 -- start start 2024-08-31T06:19:19.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.578+0000 7f7039711640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7034103940 0x7f703419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.579+0000 7f7039711640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7034109280 0x7f703419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.579+0000 7f7039711640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7034109bd0 0x7f703419f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.579+0000 7f7039711640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7034113740 con 0x7f7034109280 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.579+0000 7f7032ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7034103940 0x7f703419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.579+0000 7f70327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7034109280 0x7f703419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.579+0000 7f7032ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7034103940 0x7f703419a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52698/0 (socket says 172.21.15.53:52698) 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.579+0000 7f7032ffd640 1 -- 172.21.15.53:0/3166342467 learned_addr learned my addr 172.21.15.53:0/3166342467 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.579+0000 7f70337fe640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7034109bd0 0x7f703419f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.579+0000 7f7039711640 1 -- 172.21.15.53:0/3166342467 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70341135c0 con 0x7f7034103940 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.579+0000 7f7039711640 1 -- 172.21.15.53:0/3166342467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70341138c0 con 0x7f7034109bd0 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f7032ffd640 1 -- 172.21.15.53:0/3166342467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7034109bd0 msgr2=0x7f703419f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f7032ffd640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7034109bd0 0x7f703419f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f7032ffd640 1 -- 172.21.15.53:0/3166342467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7034109280 msgr2=0x7f703419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f7032ffd640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7034109280 0x7f703419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f7032ffd640 1 -- 172.21.15.53:0/3166342467 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70341a00e0 con 0x7f7034103940 2024-08-31T06:19:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f70327fc640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7034109280 0x7f703419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f7032ffd640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7034103940 0x7f703419a170 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7024009f20 tx=0x7f702400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f701bfff640 1 -- 172.21.15.53:0/3166342467 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024020070 con 0x7f7034103940 2024-08-31T06:19:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f7039711640 1 -- 172.21.15.53:0/3166342467 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70341a03d0 con 0x7f7034103940 2024-08-31T06:19:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f701bfff640 1 -- 172.21.15.53:0/3166342467 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f702400cd80 con 0x7f7034103940 2024-08-31T06:19:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f701bfff640 1 -- 172.21.15.53:0/3166342467 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702401ba80 con 0x7f7034103940 2024-08-31T06:19:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.580+0000 7f7039711640 1 -- 172.21.15.53:0/3166342467 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7034075390 con 0x7f7034103940 2024-08-31T06:19:19.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.584+0000 7f701bfff640 1 -- 172.21.15.53:0/3166342467 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7024023070 con 0x7f7034103940 2024-08-31T06:19:19.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.584+0000 7f703fc86740 1 Processor -- start 2024-08-31T06:19:19.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.584+0000 7f703fc86740 1 -- start start 2024-08-31T06:19:19.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.584+0000 7f703fc86740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f75b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.584+0000 7f703fc86740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f76060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.584+0000 7f703fc86740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f765a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.584+0000 7f703fc86740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5574c1ee4680 con 0x5574c1ba7390 2024-08-31T06:19:19.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.584+0000 7f703fc86740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5574c1ed3c10 con 0x5574c1bc8070 2024-08-31T06:19:19.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.584+0000 7f703fc86740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5574c1ed7bc0 con 0x5574c1b9f1b0 2024-08-31T06:19:19.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f70337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f75b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f70337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f75b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52712/0 (socket says 172.21.15.53:52712) 2024-08-31T06:19:19.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f70337fe640 1 -- 172.21.15.53:0/1081044375 learned_addr learned my addr 172.21.15.53:0/1081044375 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:19.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f70327fc640 1 --2- 172.21.15.53:0/1081044375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f7032ffd640 1 --2- 172.21.15.53:0/1081044375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f76060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f701bfff640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f701c0b4d20 0x7f701c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f70337fe640 1 -- 172.21.15.53:0/1081044375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 msgr2=0x5574c1f76060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f70337fe640 1 --2- 172.21.15.53:0/1081044375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f76060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f70337fe640 1 -- 172.21.15.53:0/1081044375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 msgr2=0x5574c1f765a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f70337fe640 1 --2- 172.21.15.53:0/1081044375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f765a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f70337fe640 1 -- 172.21.15.53:0/1081044375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574c1c33650 con 0x5574c1bc8070 2024-08-31T06:19:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f70337fe640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f701c0b4d20 0x7f701c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f701bfff640 1 -- 172.21.15.53:0/3166342467 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f70240e5100 con 0x7f7034103940 2024-08-31T06:19:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.585+0000 7f70337fe640 1 --2- 172.21.15.53:0/1081044375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f75b20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f702c011590 tx=0x7f702c011a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5543fba26f6e0e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.586+0000 7f70197fa640 1 -- 172.21.15.53:0/1081044375 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c017050 con 0x5574c1bc8070 2024-08-31T06:19:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.586+0000 7f70197fa640 1 -- 172.21.15.53:0/1081044375 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f702c00fcd0 con 0x5574c1bc8070 2024-08-31T06:19:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.586+0000 7f70197fa640 1 -- 172.21.15.53:0/1081044375 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c00e8d0 con 0x5574c1bc8070 2024-08-31T06:19:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.587+0000 7f703fc86740 1 -- 172.21.15.53:0/1081044375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 msgr2=0x5574c1f75b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.587+0000 7f70337fe640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f701c0b4d20 0x7f701c0b7230 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f702c022000 tx=0x7f702c023000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.587+0000 7f703fc86740 1 --2- 172.21.15.53:0/1081044375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f75b20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f702c011590 tx=0x7f702c011a50 comp rx=0 tx=0).stop 2024-08-31T06:19:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.587+0000 7f703fc86740 1 -- 172.21.15.53:0/1081044375 shutdown_connections 2024-08-31T06:19:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.587+0000 7f703fc86740 1 --2- 172.21.15.53:0/1081044375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f765a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.587+0000 7f703fc86740 1 --2- 172.21.15.53:0/1081044375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f76060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.587+0000 7f703fc86740 1 --2- 172.21.15.53:0/1081044375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f75b20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.587+0000 7f703fc86740 1 -- 172.21.15.53:0/1081044375 >> 172.21.15.53:0/1081044375 conn(0x5574c1bbc460 msgr2=0x5574c1f73a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.587+0000 7f703fc86740 1 -- 172.21.15.53:0/1081044375 shutdown_connections 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.587+0000 7f703fc86740 1 -- 172.21.15.53:0/1081044375 wait complete. 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.587+0000 7f703fc86740 1 -- start start 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f703fc86740 1 Processor -- start 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f703fc86740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f812a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f703fc86740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f817e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f703fc86740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f8d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f703fc86740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5574c1d36700 con 0x5574c1ba7390 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f703fc86740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5574c1e5a750 con 0x5574c1bc8070 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f703fc86740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5574c1f84300 con 0x5574c1b9f1b0 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f70327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f817e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f703fc86740 10 client.0 _ll_register_callbacks cb 0x5574c1e89e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:19.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f70337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f8d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f70337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f8d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52716/0 (socket says 172.21.15.53:52716) 2024-08-31T06:19:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f70327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f817e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47724/0 (socket says 172.21.15.53:47724) 2024-08-31T06:19:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f70337fe640 1 -- 172.21.15.53:0/3796305873 learned_addr learned my addr 172.21.15.53:0/3796305873 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.588+0000 7f7032ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f812a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.589+0000 7f70327fc640 1 -- 172.21.15.53:0/3796305873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 msgr2=0x5574c1f812a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.589+0000 7f70327fc640 1 --2- 172.21.15.53:0/3796305873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f812a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.589+0000 7f70327fc640 1 -- 172.21.15.53:0/3796305873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 msgr2=0x5574c1f8d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.589+0000 7f70327fc640 1 --2- 172.21.15.53:0/3796305873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f8d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.589+0000 7f70327fc640 1 -- 172.21.15.53:0/3796305873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574c1e93900 con 0x5574c1ba7390 2024-08-31T06:19:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.589+0000 7f70327fc640 1 --2- 172.21.15.53:0/3796305873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f817e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f702802a930 tx=0x7f7028031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51caef907d6c5f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.589+0000 7f7016ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.589+0000 7f7016ff5640 1 -- 172.21.15.53:0/3796305873 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028035040 con 0x5574c1ba7390 2024-08-31T06:19:19.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.589+0000 7f703fc86740 1 -- 172.21.15.53:0/3796305873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f702c00fcd0 con 0x5574c1ba7390 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.589+0000 7f7016ff5640 1 -- 172.21.15.53:0/3796305873 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f7028004450 con 0x5574c1ba7390 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f7016ff5640 1 -- 172.21.15.53:0/3796305873 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f70280035f0 con 0x5574c1ba7390 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f703fc86740 10 client.20097 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f703fc86740 1 -- 172.21.15.53:0/3796305873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5574c1f90130 con 0x5574c1ba7390 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f7016ff5640 1 -- 172.21.15.53:0/3796305873 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f702c00fcd0 con 0x5574c1ba7390 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f7016ff5640 1 -- 172.21.15.53:0/3796305873 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f702803d7c0 con 0x5574c1ba7390 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f703fc86740 10 client.20097 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f703fc86740 10 client.20097 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f703fc86740 20 client.20097 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f703fc86740 1 --2- 172.21.15.53:0/3796305873 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5574c1b869f0 0x5574c1f93a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f703fc86740 4 client.20097 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f703fc86740 1 -- 172.21.15.53:0/3796305873 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574c1ee65d0 con 0x5574c1b869f0 2024-08-31T06:19:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.590+0000 7f7032ffd640 1 --2- 172.21.15.53:0/3796305873 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5574c1b869f0 0x5574c1f93a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.591+0000 7f7016ff5640 10 client.20097 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.591+0000 7f7032ffd640 1 --2- 172.21.15.53:0/3796305873 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5574c1b869f0 0x5574c1f93a40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=33c66c0900a48e02 server_cookie=c0be54141c0ddffa in_seq=0 out_seq=0 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f7016ff5640 1 -- 172.21.15.53:0/3796305873 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5574c1ee65d0 con 0x5574c1b869f0 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f7016ff5640 10 client.20097 handle_command_reply: tid=0 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f703fc86740 1 client.20097 shutdown 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f703fc86740 1 -- 172.21.15.53:0/3796305873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 msgr2=0x5574c1f817e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f703fc86740 1 --2- 172.21.15.53:0/3796305873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f817e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f702802a930 tx=0x7f7028031630 comp rx=0 tx=0).stop 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f703fc86740 1 -- 172.21.15.53:0/3796305873 shutdown_connections 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f703fc86740 1 --2- 172.21.15.53:0/3796305873 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5574c1b869f0 0x5574c1f93a40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f703fc86740 1 --2- 172.21.15.53:0/3796305873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f8d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f703fc86740 1 --2- 172.21.15.53:0/3796305873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f817e0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f703fc86740 1 --2- 172.21.15.53:0/3796305873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f812a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f703fc86740 1 -- 172.21.15.53:0/3796305873 >> 172.21.15.53:0/3796305873 conn(0x5574c1bbc460 msgr2=0x5574c1f78d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f7016ff5640 0 client.20097 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:19:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f703fc86740 1 -- 172.21.15.53:0/3796305873 shutdown_connections 2024-08-31T06:19:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.592+0000 7f703fc86740 1 -- 172.21.15.53:0/3796305873 wait complete. 2024-08-31T06:19:19.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.593+0000 7f703fc86740 20 client.20097 trim_cache size 0 max 16384 2024-08-31T06:19:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.611+0000 7f703fc86740 1 Processor -- start 2024-08-31T06:19:19.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.611+0000 7f703fc86740 1 -- start start 2024-08-31T06:19:19.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.611+0000 7f703fc86740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f7ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.611+0000 7f703fc86740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f81760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.611+0000 7f703fc86740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f8d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f703fc86740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f70341ad280 con 0x5574c1ba7390 2024-08-31T06:19:19.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f703fc86740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70341af000 con 0x5574c1bc8070 2024-08-31T06:19:19.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f703fc86740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70341ad950 con 0x5574c1b9f1b0 2024-08-31T06:19:19.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f70327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f81760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f7032ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f7ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f70327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f81760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47730/0 (socket says 172.21.15.53:47730) 2024-08-31T06:19:19.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f70327fc640 1 -- 172.21.15.53:0/2784514506 learned_addr learned my addr 172.21.15.53:0/2784514506 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:19.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f70337fe640 1 --2- 172.21.15.53:0/2784514506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f8d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f7032ffd640 1 -- 172.21.15.53:0/2784514506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 msgr2=0x5574c1f8d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:19.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f7032ffd640 1 --2- 172.21.15.53:0/2784514506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f8d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f7032ffd640 1 -- 172.21.15.53:0/2784514506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 msgr2=0x5574c1f81760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:19.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f7032ffd640 1 --2- 172.21.15.53:0/2784514506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f81760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f7032ffd640 1 -- 172.21.15.53:0/2784514506 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574c1f78980 con 0x5574c1b9f1b0 2024-08-31T06:19:19.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f70337fe640 1 --2- 172.21.15.53:0/2784514506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f8d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:19:19.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f70327fc640 1 --2- 172.21.15.53:0/2784514506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f81760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:19.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.612+0000 7f7032ffd640 1 --2- 172.21.15.53:0/2784514506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f7ca50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f70240e28d0 tx=0x7f7024015040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5697193b59981d1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:19.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.613+0000 7f7018ff9640 1 -- 172.21.15.53:0/2784514506 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70240af680 con 0x5574c1b9f1b0 2024-08-31T06:19:19.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.613+0000 7f7018ff9640 1 -- 172.21.15.53:0/2784514506 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70240af840 con 0x5574c1b9f1b0 2024-08-31T06:19:19.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.613+0000 7f7018ff9640 1 -- 172.21.15.53:0/2784514506 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70240af4a0 con 0x5574c1b9f1b0 2024-08-31T06:19:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.614+0000 7f703fc86740 1 -- 172.21.15.53:0/2784514506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 msgr2=0x5574c1f7ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.614+0000 7f703fc86740 1 --2- 172.21.15.53:0/2784514506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f7ca50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f70240e28d0 tx=0x7f7024015040 comp rx=0 tx=0).stop 2024-08-31T06:19:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.614+0000 7f703fc86740 1 -- 172.21.15.53:0/2784514506 shutdown_connections 2024-08-31T06:19:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.614+0000 7f703fc86740 1 --2- 172.21.15.53:0/2784514506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1bc8070 0x5574c1f8d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.614+0000 7f703fc86740 1 --2- 172.21.15.53:0/2784514506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1ba7390 0x5574c1f81760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.614+0000 7f703fc86740 1 --2- 172.21.15.53:0/2784514506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f7ca50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.614+0000 7f703fc86740 1 -- 172.21.15.53:0/2784514506 >> 172.21.15.53:0/2784514506 conn(0x5574c1bbc460 msgr2=0x5574c1f81050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.614+0000 7f703fc86740 1 -- 172.21.15.53:0/2784514506 shutdown_connections 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.614+0000 7f703fc86740 1 -- 172.21.15.53:0/2784514506 wait complete. 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.615+0000 7f703fc86740 1 -- start start 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.615+0000 7f703fc86740 1 Processor -- start 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.615+0000 7f703fc86740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f89d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.615+0000 7f703fc86740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1ba7390 0x5574c1f851e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.615+0000 7f703fc86740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1bc8070 0x5574c1f85720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.615+0000 7f70327fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1ba7390 0x5574c1f851e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.615+0000 7f70327fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1ba7390 0x5574c1f851e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52732/0 (socket says 172.21.15.53:52732) 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.615+0000 7f7032ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f89d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f7032ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f89d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:40362/0 (socket says 172.21.15.53:40362) 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f70337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1bc8070 0x5574c1f85720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f703fc86740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f70341ae870 con 0x5574c1bc8070 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f70327fc640 1 -- 172.21.15.53:0/2424066562 learned_addr learned my addr 172.21.15.53:0/2424066562 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:19.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f703fc86740 1 -- 172.21.15.53:0/2424066562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70341ae0e0 con 0x5574c1ba7390 2024-08-31T06:19:19.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f703fc86740 1 -- 172.21.15.53:0/2424066562 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70341ab280 con 0x5574c1b9f1b0 2024-08-31T06:19:19.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f703fc86740 10 client.0 _ll_register_callbacks cb 0x7f7028009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f70337fe640 1 -- 172.21.15.53:0/2424066562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 msgr2=0x5574c1f89d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f70337fe640 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f89d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f70337fe640 1 -- 172.21.15.53:0/2424066562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1ba7390 msgr2=0x5574c1f851e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f70337fe640 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1ba7390 0x5574c1f851e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f70337fe640 1 -- 172.21.15.53:0/2424066562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574c1f85eb0 con 0x5574c1bc8070 2024-08-31T06:19:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.616+0000 7f7032ffd640 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f89d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.617+0000 7f70337fe640 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1bc8070 0x5574c1f85720 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f702c009240 tx=0x7f702c00efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c566260354fde0d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.617+0000 7f7016ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.617+0000 7f7016ff5640 1 -- 172.21.15.53:0/2424066562 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c039060 con 0x5574c1bc8070 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.617+0000 7f7016ff5640 1 -- 172.21.15.53:0/2424066562 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f702c00e840 con 0x5574c1bc8070 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.617+0000 7f703fc86740 1 -- 172.21.15.53:0/2424066562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70240af840 con 0x5574c1bc8070 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.617+0000 7f7016ff5640 1 -- 172.21.15.53:0/2424066562 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f702c00e3b0 con 0x5574c1bc8070 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.617+0000 7f703fc86740 10 client.20103 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.617+0000 7f703fc86740 1 -- 172.21.15.53:0/2424066562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5574c1ffe370 con 0x5574c1bc8070 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.618+0000 7f7016ff5640 1 -- 172.21.15.53:0/2424066562 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f702c00f640 con 0x5574c1bc8070 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.618+0000 7f7016ff5640 1 -- 172.21.15.53:0/2424066562 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f702c01a070 con 0x5574c1bc8070 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.618+0000 7f703fc86740 10 client.20103 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.618+0000 7f703fc86740 10 client.20103 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:19:19.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.618+0000 7f703fc86740 20 client.20103 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.618+0000 7f703fc86740 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5574c1b5bda0 0x5574c20009c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.618+0000 7f703fc86740 4 client.20103 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.618+0000 7f703fc86740 1 -- 172.21.15.53:0/2424066562 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f70240af840 con 0x5574c1b5bda0 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.618+0000 7f7032ffd640 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5574c1b5bda0 0x5574c20009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f7016ff5640 10 client.20103 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f7032ffd640 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5574c1b5bda0 0x5574c20009c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ebd9bf991a007149 server_cookie=115868a6c11c08b8 in_seq=0 out_seq=0 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f7016ff5640 1 -- 172.21.15.53:0/2424066562 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f70240af840 con 0x5574c1b5bda0 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f7016ff5640 10 client.20103 handle_command_reply: tid=0 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f703fc86740 1 client.20103 shutdown 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f703fc86740 1 -- 172.21.15.53:0/2424066562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1bc8070 msgr2=0x5574c1f85720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f703fc86740 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1bc8070 0x5574c1f85720 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f702c009240 tx=0x7f702c00efd0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f703fc86740 1 -- 172.21.15.53:0/2424066562 shutdown_connections 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f703fc86740 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5574c1b5bda0 0x5574c20009c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f703fc86740 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574c1bc8070 0x5574c1f85720 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f703fc86740 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5574c1ba7390 0x5574c1f851e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f703fc86740 1 --2- 172.21.15.53:0/2424066562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5574c1b9f1b0 0x5574c1f89d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f7016ff5640 0 client.20103 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:19:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.619+0000 7f703fc86740 1 -- 172.21.15.53:0/2424066562 >> 172.21.15.53:0/2424066562 conn(0x5574c1bbc460 msgr2=0x5574c1f76b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.620+0000 7f703fc86740 1 -- 172.21.15.53:0/2424066562 shutdown_connections 2024-08-31T06:19:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.620+0000 7f703fc86740 1 -- 172.21.15.53:0/2424066562 wait complete. 2024-08-31T06:19:19.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.620+0000 7f703fc86740 20 client.20103 trim_cache size 0 max 16384 2024-08-31T06:19:19.625 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:19:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 -- 172.21.15.53:0/3166342467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f701c0b4d20 msgr2=0x7f701c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f701c0b4d20 0x7f701c0b7230 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f702c022000 tx=0x7f702c023000 comp rx=0 tx=0).stop 2024-08-31T06:19:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 -- 172.21.15.53:0/3166342467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7034103940 msgr2=0x7f703419a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7034103940 0x7f703419a170 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7024009f20 tx=0x7f702400ee80 comp rx=0 tx=0).stop 2024-08-31T06:19:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 -- 172.21.15.53:0/3166342467 shutdown_connections 2024-08-31T06:19:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f701c0b4d20 0x7f701c0b7230 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7034109bd0 0x7f703419f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7034109280 0x7f703419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 --2- 172.21.15.53:0/3166342467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7034103940 0x7f703419a170 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:19.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 -- 172.21.15.53:0/3166342467 >> 172.21.15.53:0/3166342467 conn(0x7f70340ff3d0 msgr2=0x7f70341017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:19.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 -- 172.21.15.53:0/3166342467 shutdown_connections 2024-08-31T06:19:19.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:19.621+0000 7f7039711640 1 -- 172.21.15.53:0/3166342467 wait complete. 2024-08-31T06:19:19.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:19 smithi053 ceph-mon[18924]: pgmap v772: 97 pgs: 97 active+clean; 364 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 1.9 MiB/s wr, 162 op/s 2024-08-31T06:19:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:19 smithi130 ceph-mon[22266]: pgmap v772: 97 pgs: 97 active+clean; 364 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 1.9 MiB/s wr, 162 op/s 2024-08-31T06:19:20.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:19 smithi153 ceph-mon[22320]: pgmap v772: 97 pgs: 97 active+clean; 364 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 1.9 MiB/s wr, 162 op/s 2024-08-31T06:19:20.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 5651 6.74 MB/sec warmup 68 sec latency 61.708 ms 2024-08-31T06:19:20.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:19:20.814 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:21.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 5833 6.81 MB/sec warmup 69 sec latency 76.289 ms 2024-08-31T06:19:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.443+0000 7fd952737640 1 -- 172.21.15.53:0/3486772045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94c102860 msgr2=0x7fd94c102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.443+0000 7fd952737640 1 --2- 172.21.15.53:0/3486772045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94c102860 0x7fd94c102c70 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009900 tx=0x7fd93c02a410 comp rx=0 tx=0).stop 2024-08-31T06:19:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.443+0000 7fd952737640 1 -- 172.21.15.53:0/3486772045 shutdown_connections 2024-08-31T06:19:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.443+0000 7fd952737640 1 --2- 172.21.15.53:0/3486772045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd94c108aa0 0x7fd94c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.443+0000 7fd952737640 1 --2- 172.21.15.53:0/3486772045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94c108150 0x7fd94c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.443+0000 7fd952737640 1 --2- 172.21.15.53:0/3486772045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94c102860 0x7fd94c102c70 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.443+0000 7fd952737640 1 -- 172.21.15.53:0/3486772045 >> 172.21.15.53:0/3486772045 conn(0x7fd94c0794c0 msgr2=0x7fd94c0798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:21.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.443+0000 7fd952737640 1 -- 172.21.15.53:0/3486772045 shutdown_connections 2024-08-31T06:19:21.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.443+0000 7fd952737640 1 -- 172.21.15.53:0/3486772045 wait complete. 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.444+0000 7fd952737640 1 Processor -- start 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.444+0000 7fd952737640 1 -- start start 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.445+0000 7fd952737640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94c102860 0x7fd94c19a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.445+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94c102860 0x7fd94c19a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.445+0000 7fd952737640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94c108150 0x7fd94c19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.445+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94c102860 0x7fd94c19a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47758/0 (socket says 172.21.15.53:47758) 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.445+0000 7fd94bfff640 1 -- 172.21.15.53:0/463950811 learned_addr learned my addr 172.21.15.53:0/463950811 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.445+0000 7fd952737640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd94c108aa0 0x7fd94c19fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.445+0000 7fd952737640 1 -- 172.21.15.53:0/463950811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c113730 con 0x7fd94c102860 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.445+0000 7fd952737640 1 -- 172.21.15.53:0/463950811 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1135b0 con 0x7fd94c108aa0 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.445+0000 7fd952737640 1 -- 172.21.15.53:0/463950811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1138b0 con 0x7fd94c108150 2024-08-31T06:19:21.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.445+0000 7fd94b7fe640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94c108150 0x7fd94c19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.445+0000 7fd950cd4640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd94c108aa0 0x7fd94c19fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.446+0000 7fd94b7fe640 1 -- 172.21.15.53:0/463950811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd94c108aa0 msgr2=0x7fd94c19fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.446+0000 7fd94b7fe640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd94c108aa0 0x7fd94c19fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.446+0000 7fd94b7fe640 1 -- 172.21.15.53:0/463950811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94c102860 msgr2=0x7fd94c19a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.446+0000 7fd94b7fe640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94c102860 0x7fd94c19a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.446+0000 7fd94b7fe640 1 -- 172.21.15.53:0/463950811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c1a0150 con 0x7fd94c108150 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.446+0000 7fd950cd4640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd94c108aa0 0x7fd94c19fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.446+0000 7fd94b7fe640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94c108150 0x7fd94c19a780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd94c06a8c0 tx=0x7fd94000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.446+0000 7fd9497fa640 1 -- 172.21.15.53:0/463950811 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94000cd00 con 0x7fd94c108150 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.446+0000 7fd952737640 1 -- 172.21.15.53:0/463950811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94c1a0440 con 0x7fd94c108150 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.446+0000 7fd9497fa640 1 -- 172.21.15.53:0/463950811 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9400035f0 con 0x7fd94c108150 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.446+0000 7fd9497fa640 1 -- 172.21.15.53:0/463950811 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940010690 con 0x7fd94c108150 2024-08-31T06:19:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.447+0000 7fd952737640 1 -- 172.21.15.53:0/463950811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94c10fc90 con 0x7fd94c108150 2024-08-31T06:19:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.450+0000 7fd9497fa640 1 -- 172.21.15.53:0/463950811 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd940004000 con 0x7fd94c108150 2024-08-31T06:19:21.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.450+0000 7fd958cac740 1 Processor -- start 2024-08-31T06:19:21.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd958cac740 1 -- start start 2024-08-31T06:19:21.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd958cac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b02b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd958cac740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd958cac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308734390 0x557308b035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd958cac740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557308a71680 con 0x55730872c1b0 2024-08-31T06:19:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd958cac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557308a60c10 con 0x557308734390 2024-08-31T06:19:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd958cac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557308a64bc0 con 0x557308755070 2024-08-31T06:19:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47768/0 (socket says 172.21.15.53:47768) 2024-08-31T06:19:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd94bfff640 1 -- 172.21.15.53:0/3121980707 learned_addr learned my addr 172.21.15.53:0/3121980707 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd950cd4640 1 --2- 172.21.15.53:0/3121980707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b02b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd9497fa640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4ca0 0x7fd9340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.451+0000 7fd94b7fe640 1 --2- 172.21.15.53:0/3121980707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308734390 0x557308b035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.452+0000 7fd94bfff640 1 -- 172.21.15.53:0/3121980707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 msgr2=0x557308b02b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.452+0000 7fd94bfff640 1 --2- 172.21.15.53:0/3121980707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b02b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.452+0000 7fd94bfff640 1 -- 172.21.15.53:0/3121980707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308734390 msgr2=0x557308b035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.452+0000 7fd94bfff640 1 --2- 172.21.15.53:0/3121980707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308734390 0x557308b035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.452+0000 7fd94bfff640 1 -- 172.21.15.53:0/3121980707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573087c0650 con 0x55730872c1b0 2024-08-31T06:19:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.452+0000 7fd9497fa640 1 -- 172.21.15.53:0/463950811 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fd9400e5950 con 0x7fd94c108150 2024-08-31T06:19:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.452+0000 7fd950cd4640 1 --2- 172.21.15.53:0/3121980707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b02b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:19:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.452+0000 7fd94bfff640 1 --2- 172.21.15.53:0/3121980707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b030a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009a20 tx=0x7fd93c031b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3380a9faba2d4baf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.452+0000 7fd94b7fe640 1 --2- 172.21.15.53:0/3121980707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308734390 0x557308b035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:19:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.453+0000 7fd9327fc640 1 -- 172.21.15.53:0/3121980707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c035030 con 0x55730872c1b0 2024-08-31T06:19:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.453+0000 7fd950cd4640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4ca0 0x7fd9340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.453+0000 7fd9327fc640 1 -- 172.21.15.53:0/3121980707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd93c040070 con 0x55730872c1b0 2024-08-31T06:19:21.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.453+0000 7fd9327fc640 1 -- 172.21.15.53:0/3121980707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c003850 con 0x55730872c1b0 2024-08-31T06:19:21.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.454+0000 7fd950cd4640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4ca0 0x7fd9340b71b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd944005fd0 tx=0x7fd944004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.454+0000 7fd958cac740 1 -- 172.21.15.53:0/3121980707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 msgr2=0x557308b030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.454+0000 7fd958cac740 1 --2- 172.21.15.53:0/3121980707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b030a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009a20 tx=0x7fd93c031b00 comp rx=0 tx=0).stop 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.454+0000 7fd958cac740 1 -- 172.21.15.53:0/3121980707 shutdown_connections 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.454+0000 7fd958cac740 1 --2- 172.21.15.53:0/3121980707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308734390 0x557308b035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.454+0000 7fd958cac740 1 --2- 172.21.15.53:0/3121980707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b030a0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.454+0000 7fd958cac740 1 --2- 172.21.15.53:0/3121980707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b02b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.454+0000 7fd958cac740 1 -- 172.21.15.53:0/3121980707 >> 172.21.15.53:0/3121980707 conn(0x557308749460 msgr2=0x557308b00a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.454+0000 7fd958cac740 1 -- 172.21.15.53:0/3121980707 shutdown_connections 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.454+0000 7fd958cac740 1 -- 172.21.15.53:0/3121980707 wait complete. 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.455+0000 7fd958cac740 1 -- start start 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.455+0000 7fd958cac740 1 Processor -- start 2024-08-31T06:19:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.455+0000 7fd958cac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730872c1b0 0x557308b0e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.455+0000 7fd958cac740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557308734390 0x557308b0e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.455+0000 7fd958cac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b1a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.455+0000 7fd958cac740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573088c3700 con 0x557308734390 2024-08-31T06:19:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.455+0000 7fd958cac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5573089e7750 con 0x55730872c1b0 2024-08-31T06:19:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.455+0000 7fd958cac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557308b112e0 con 0x557308755070 2024-08-31T06:19:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.455+0000 7fd958cac740 10 client.0 _ll_register_callbacks cb 0x557308a16e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.456+0000 7fd94b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557308734390 0x557308b0e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.456+0000 7fd950cd4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b1a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.456+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730872c1b0 0x557308b0e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.456+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730872c1b0 0x557308b0e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52762/0 (socket says 172.21.15.53:52762) 2024-08-31T06:19:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.456+0000 7fd94bfff640 1 -- 172.21.15.53:0/1000256436 learned_addr learned my addr 172.21.15.53:0/1000256436 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.456+0000 7fd950cd4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b1a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:40404/0 (socket says 172.21.15.53:40404) 2024-08-31T06:19:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.456+0000 7fd94bfff640 1 -- 172.21.15.53:0/1000256436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 msgr2=0x557308b1a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.456+0000 7fd94bfff640 1 --2- 172.21.15.53:0/1000256436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b1a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.456+0000 7fd94bfff640 1 -- 172.21.15.53:0/1000256436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557308734390 msgr2=0x557308b0e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.456+0000 7fd94bfff640 1 --2- 172.21.15.53:0/1000256436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557308734390 0x557308b0e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.456+0000 7fd94bfff640 1 -- 172.21.15.53:0/1000256436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557308a20900 con 0x55730872c1b0 2024-08-31T06:19:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.457+0000 7fd94bfff640 1 --2- 172.21.15.53:0/1000256436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730872c1b0 0x557308b0e360 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd93c02a450 tx=0x7fd93c031f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79051e6f9a0f9f1c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.457+0000 7fd92b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:19:21.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.457+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1000256436 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c052060 con 0x55730872c1b0 2024-08-31T06:19:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.457+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1000256436 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fd93c03c440 con 0x55730872c1b0 2024-08-31T06:19:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.457+0000 7fd958cac740 1 -- 172.21.15.53:0/1000256436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd93c040070 con 0x55730872c1b0 2024-08-31T06:19:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.457+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1000256436 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fd93c035070 con 0x55730872c1b0 2024-08-31T06:19:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.457+0000 7fd958cac740 10 client.29084 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.457+0000 7fd958cac740 1 -- 172.21.15.53:0/1000256436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x557308b1d140 con 0x55730872c1b0 2024-08-31T06:19:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.458+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1000256436 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd93c03cad0 con 0x55730872c1b0 2024-08-31T06:19:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.458+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1000256436 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fd93c04c030 con 0x55730872c1b0 2024-08-31T06:19:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.458+0000 7fd958cac740 10 client.29084 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.458+0000 7fd958cac740 10 client.29084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.458+0000 7fd958cac740 20 client.29084 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.458+0000 7fd958cac740 1 --2- 172.21.15.53:0/1000256436 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573087139f0 0x557308b204a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.458+0000 7fd958cac740 4 client.29084 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.458+0000 7fd958cac740 1 -- 172.21.15.53:0/1000256436 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd93c040070 con 0x5573087139f0 2024-08-31T06:19:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.458+0000 7fd94b7fe640 1 --2- 172.21.15.53:0/1000256436 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573087139f0 0x557308b204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.459+0000 7fd92b7fe640 10 client.29084 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.459+0000 7fd94b7fe640 1 --2- 172.21.15.53:0/1000256436 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573087139f0 0x557308b204a0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b9f8fa1a2b8a8c server_cookie=170ddf3d433f5994 in_seq=0 out_seq=0 2024-08-31T06:19:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.460+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1000256436 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd93c040070 con 0x5573087139f0 2024-08-31T06:19:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.460+0000 7fd92b7fe640 10 client.29084 handle_command_reply: tid=0 2024-08-31T06:19:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 1 client.29084 shutdown 2024-08-31T06:19:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 1 -- 172.21.15.53:0/1000256436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730872c1b0 msgr2=0x557308b0e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 1 --2- 172.21.15.53:0/1000256436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730872c1b0 0x557308b0e360 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd93c02a450 tx=0x7fd93c031f20 comp rx=0 tx=0).stop 2024-08-31T06:19:21.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 1 -- 172.21.15.53:0/1000256436 shutdown_connections 2024-08-31T06:19:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 1 --2- 172.21.15.53:0/1000256436 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573087139f0 0x557308b204a0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 1 --2- 172.21.15.53:0/1000256436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b1a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 1 --2- 172.21.15.53:0/1000256436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557308734390 0x557308b0e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 1 --2- 172.21.15.53:0/1000256436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730872c1b0 0x557308b0e360 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd92b7fe640 0 client.29084 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 1 -- 172.21.15.53:0/1000256436 >> 172.21.15.53:0/1000256436 conn(0x557308749460 msgr2=0x557308b05cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 1 -- 172.21.15.53:0/1000256436 shutdown_connections 2024-08-31T06:19:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 1 -- 172.21.15.53:0/1000256436 wait complete. 2024-08-31T06:19:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.461+0000 7fd958cac740 20 client.29084 trim_cache size 0 max 16384 2024-08-31T06:19:21.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd958cac740 1 Processor -- start 2024-08-31T06:19:21.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd958cac740 1 -- start start 2024-08-31T06:19:21.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd958cac740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b0ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd958cac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308734390 0x557308b1a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd958cac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308755070 0x557308b1aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd958cac740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1ad300 con 0x55730872c1b0 2024-08-31T06:19:21.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd958cac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1af080 con 0x557308755070 2024-08-31T06:19:21.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd958cac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1ad9d0 con 0x557308734390 2024-08-31T06:19:21.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b0ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd94b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308734390 0x557308b1a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b0ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47782/0 (socket says 172.21.15.53:47782) 2024-08-31T06:19:21.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd94bfff640 1 -- 172.21.15.53:0/49308644 learned_addr learned my addr 172.21.15.53:0/49308644 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:21.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.485+0000 7fd950cd4640 1 --2- 172.21.15.53:0/49308644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308755070 0x557308b1aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.486+0000 7fd94bfff640 1 -- 172.21.15.53:0/49308644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308734390 msgr2=0x557308b1a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:21.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.486+0000 7fd94bfff640 1 --2- 172.21.15.53:0/49308644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308734390 0x557308b1a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.486+0000 7fd94bfff640 1 -- 172.21.15.53:0/49308644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308755070 msgr2=0x557308b1aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:21.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.486+0000 7fd94bfff640 1 --2- 172.21.15.53:0/49308644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308755070 0x557308b1aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.486+0000 7fd94bfff640 1 -- 172.21.15.53:0/49308644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557308b04e50 con 0x55730872c1b0 2024-08-31T06:19:21.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.486+0000 7fd94bfff640 1 --2- 172.21.15.53:0/49308644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b0ff90 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0057c0 tx=0x7fd93c031b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab29c53359ff1826 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:21.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.486+0000 7fd931ffb640 1 -- 172.21.15.53:0/49308644 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c052040 con 0x55730872c1b0 2024-08-31T06:19:21.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.486+0000 7fd931ffb640 1 -- 172.21.15.53:0/49308644 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd93c040070 con 0x55730872c1b0 2024-08-31T06:19:21.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.486+0000 7fd931ffb640 1 -- 172.21.15.53:0/49308644 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0052d0 con 0x55730872c1b0 2024-08-31T06:19:21.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.487+0000 7fd958cac740 1 -- 172.21.15.53:0/49308644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 msgr2=0x557308b0ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:21.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.487+0000 7fd958cac740 1 --2- 172.21.15.53:0/49308644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b0ff90 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0057c0 tx=0x7fd93c031b80 comp rx=0 tx=0).stop 2024-08-31T06:19:21.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.487+0000 7fd958cac740 1 -- 172.21.15.53:0/49308644 shutdown_connections 2024-08-31T06:19:21.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.487+0000 7fd958cac740 1 --2- 172.21.15.53:0/49308644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308755070 0x557308b1aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.487+0000 7fd958cac740 1 --2- 172.21.15.53:0/49308644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308734390 0x557308b1a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.487+0000 7fd958cac740 1 --2- 172.21.15.53:0/49308644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b0ff90 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.487+0000 7fd958cac740 1 -- 172.21.15.53:0/49308644 >> 172.21.15.53:0/49308644 conn(0x557308749460 msgr2=0x557308b0f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:21.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.488+0000 7fd958cac740 1 -- 172.21.15.53:0/49308644 shutdown_connections 2024-08-31T06:19:21.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.488+0000 7fd958cac740 1 -- 172.21.15.53:0/49308644 wait complete. 2024-08-31T06:19:21.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.488+0000 7fd958cac740 1 -- start start 2024-08-31T06:19:21.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.488+0000 7fd958cac740 1 Processor -- start 2024-08-31T06:19:21.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd958cac740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b21d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd958cac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308734390 0x557308b22310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd958cac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b83bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd958cac740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1ae8f0 con 0x55730872c1b0 2024-08-31T06:19:21.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd958cac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1ae160 con 0x557308734390 2024-08-31T06:19:21.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b21d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd958cac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1ab300 con 0x557308755070 2024-08-31T06:19:21.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b21d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47784/0 (socket says 172.21.15.53:47784) 2024-08-31T06:19:21.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd94bfff640 1 -- 172.21.15.53:0/1539204102 learned_addr learned my addr 172.21.15.53:0/1539204102 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd958cac740 10 client.0 _ll_register_callbacks cb 0x7fd93c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd94b7fe640 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308734390 0x557308b22310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.489+0000 7fd950cd4640 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b83bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd94bfff640 1 -- 172.21.15.53:0/1539204102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 msgr2=0x557308b83bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd94bfff640 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b83bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd94bfff640 1 -- 172.21.15.53:0/1539204102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308734390 msgr2=0x557308b22310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd94bfff640 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308734390 0x557308b22310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd94bfff640 1 -- 172.21.15.53:0/1539204102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557308b84260 con 0x55730872c1b0 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd950cd4640 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b83bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd94bfff640 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b21d30 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009850 tx=0x7fd93c044610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15aa3ff06219769 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd92b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:21.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1539204102 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c052070 con 0x55730872c1b0 2024-08-31T06:19:21.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1539204102 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fd93c005450 con 0x55730872c1b0 2024-08-31T06:19:21.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd958cac740 1 -- 172.21.15.53:0/1539204102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd93c040070 con 0x55730872c1b0 2024-08-31T06:19:21.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1539204102 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fd93c06e050 con 0x55730872c1b0 2024-08-31T06:19:21.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd958cac740 10 client.20121 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:21.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.490+0000 7fd958cac740 1 -- 172.21.15.53:0/1539204102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x557308b8b560 con 0x55730872c1b0 2024-08-31T06:19:21.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.491+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1539204102 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd93c062030 con 0x55730872c1b0 2024-08-31T06:19:21.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.491+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1539204102 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fd93c04c040 con 0x55730872c1b0 2024-08-31T06:19:21.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.491+0000 7fd958cac740 10 client.20121 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:21.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.491+0000 7fd958cac740 10 client.20121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:21.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.491+0000 7fd958cac740 20 client.20121 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:21.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.491+0000 7fd958cac740 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573086e8da0 0x557308b8dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.491+0000 7fd958cac740 4 client.20121 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.492+0000 7fd958cac740 1 -- 172.21.15.53:0/1539204102 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd93c040070 con 0x5573086e8da0 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.492+0000 7fd94b7fe640 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573086e8da0 0x557308b8dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd92b7fe640 10 client.20121 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd94b7fe640 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573086e8da0 0x557308b8dcf0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8803710b13d9a53d server_cookie=437d5ff12a575a7d in_seq=0 out_seq=0 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd92b7fe640 1 -- 172.21.15.53:0/1539204102 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd93c040070 con 0x5573086e8da0 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd92b7fe640 10 client.20121 handle_command_reply: tid=0 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd958cac740 1 client.20121 shutdown 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd958cac740 1 -- 172.21.15.53:0/1539204102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 msgr2=0x557308b21d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd958cac740 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b21d30 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009850 tx=0x7fd93c044610 comp rx=0 tx=0).stop 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd958cac740 1 -- 172.21.15.53:0/1539204102 shutdown_connections 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd958cac740 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5573086e8da0 0x557308b8dcf0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd958cac740 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557308755070 0x557308b83bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd958cac740 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557308734390 0x557308b22310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd958cac740 1 --2- 172.21.15.53:0/1539204102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55730872c1b0 0x557308b21d30 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd958cac740 1 -- 172.21.15.53:0/1539204102 >> 172.21.15.53:0/1539204102 conn(0x557308749460 msgr2=0x557308b00a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:21.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.493+0000 7fd92b7fe640 0 client.20121 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:21.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.494+0000 7fd958cac740 1 -- 172.21.15.53:0/1539204102 shutdown_connections 2024-08-31T06:19:21.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.494+0000 7fd958cac740 1 -- 172.21.15.53:0/1539204102 wait complete. 2024-08-31T06:19:21.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.494+0000 7fd958cac740 20 client.20121 trim_cache size 0 max 16384 2024-08-31T06:19:21.498 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:19:21.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.494+0000 7fd952737640 1 -- 172.21.15.53:0/463950811 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4ca0 msgr2=0x7fd9340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:21.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.494+0000 7fd952737640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4ca0 0x7fd9340b71b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd944005fd0 tx=0x7fd944004a40 comp rx=0 tx=0).stop 2024-08-31T06:19:21.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.494+0000 7fd952737640 1 -- 172.21.15.53:0/463950811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94c108150 msgr2=0x7fd94c19a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:21.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.494+0000 7fd952737640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94c108150 0x7fd94c19a780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd94c06a8c0 tx=0x7fd94000ee50 comp rx=0 tx=0).stop 2024-08-31T06:19:21.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.495+0000 7fd952737640 1 -- 172.21.15.53:0/463950811 shutdown_connections 2024-08-31T06:19:21.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.495+0000 7fd952737640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9340b4ca0 0x7fd9340b71b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.495+0000 7fd952737640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd94c108aa0 0x7fd94c19fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.495+0000 7fd952737640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd94c108150 0x7fd94c19a780 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.495+0000 7fd952737640 1 --2- 172.21.15.53:0/463950811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd94c102860 0x7fd94c19a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:21.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.495+0000 7fd952737640 1 -- 172.21.15.53:0/463950811 >> 172.21.15.53:0/463950811 conn(0x7fd94c0794c0 msgr2=0x7fd94c106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:21.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.495+0000 7fd952737640 1 -- 172.21.15.53:0/463950811 shutdown_connections 2024-08-31T06:19:21.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:21.495+0000 7fd952737640 1 -- 172.21.15.53:0/463950811 wait complete. 2024-08-31T06:19:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:21 smithi053 ceph-mon[18924]: pgmap v773: 97 pgs: 97 active+clean; 363 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 2.3 MiB/s wr, 214 op/s 2024-08-31T06:19:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:21 smithi130 ceph-mon[22266]: pgmap v773: 97 pgs: 97 active+clean; 363 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 2.3 MiB/s wr, 214 op/s 2024-08-31T06:19:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:21 smithi153 ceph-mon[22320]: pgmap v773: 97 pgs: 97 active+clean; 363 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 2.3 MiB/s wr, 214 op/s 2024-08-31T06:19:22.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 6044 6.92 MB/sec warmup 70 sec latency 68.939 ms 2024-08-31T06:19:23.231 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:19:23.231 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:19:23.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 6241 7.08 MB/sec warmup 71 sec latency 56.518 ms 2024-08-31T06:19:23.574 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:23.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:23 smithi053 ceph-mon[18924]: pgmap v774: 97 pgs: 97 active+clean; 367 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 2.9 MiB/s wr, 247 op/s 2024-08-31T06:19:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:23 smithi130 ceph-mon[22266]: pgmap v774: 97 pgs: 97 active+clean; 367 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 2.9 MiB/s wr, 247 op/s 2024-08-31T06:19:24.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.142+0000 7ffaa5c52640 1 -- 172.21.15.53:0/3781654926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaa0108140 msgr2=0x7ffaa0108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:24.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.142+0000 7ffaa5c52640 1 --2- 172.21.15.53:0/3781654926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaa0108140 0x7ffaa0108550 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009900 tx=0x7ffa9402a410 comp rx=0 tx=0).stop 2024-08-31T06:19:24.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.143+0000 7ffaa5c52640 1 -- 172.21.15.53:0/3781654926 shutdown_connections 2024-08-31T06:19:24.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.143+0000 7ffaa5c52640 1 --2- 172.21.15.53:0/3781654926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa0108a90 0x7ffaa010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.143+0000 7ffaa5c52640 1 --2- 172.21.15.53:0/3781654926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaa0108140 0x7ffaa0108550 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.143+0000 7ffaa5c52640 1 --2- 172.21.15.53:0/3781654926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa0102800 0x7ffaa0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.143+0000 7ffaa5c52640 1 -- 172.21.15.53:0/3781654926 >> 172.21.15.53:0/3781654926 conn(0x7ffaa00794d0 msgr2=0x7ffaa00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.143+0000 7ffaa5c52640 1 -- 172.21.15.53:0/3781654926 shutdown_connections 2024-08-31T06:19:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.143+0000 7ffaa5c52640 1 -- 172.21.15.53:0/3781654926 wait complete. 2024-08-31T06:19:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.144+0000 7ffaa5c52640 1 Processor -- start 2024-08-31T06:19:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.144+0000 7ffaa5c52640 1 -- start start 2024-08-31T06:19:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.145+0000 7ffaa5c52640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa0102800 0x7ffaa0199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.145+0000 7ffaa5c52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaa0108a90 0x7ffaa01997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.145+0000 7ffaa5c52640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa019e980 0x7ffaa019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.145+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaa0108a90 0x7ffaa01997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.145+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaa0108a90 0x7ffaa01997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43424/0 (socket says 172.21.15.53:43424) 2024-08-31T06:19:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.145+0000 7ffaa5c52640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0112570 con 0x7ffaa0108a90 2024-08-31T06:19:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.145+0000 7ffaa5c52640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa01123f0 con 0x7ffaa019e980 2024-08-31T06:19:24.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.145+0000 7ffaa5c52640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa01126f0 con 0x7ffaa0102800 2024-08-31T06:19:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.145+0000 7ffa9effd640 1 -- 172.21.15.53:0/1076806888 learned_addr learned my addr 172.21.15.53:0/1076806888 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.146+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa0102800 0x7ffaa0199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.146+0000 7ffa9ffff640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa019e980 0x7ffaa019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.146+0000 7ffa9f7fe640 1 -- 172.21.15.53:0/1076806888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa019e980 msgr2=0x7ffaa019ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.146+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa019e980 0x7ffaa019ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.146+0000 7ffa9f7fe640 1 -- 172.21.15.53:0/1076806888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaa0108a90 msgr2=0x7ffaa01997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:24.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.146+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaa0108a90 0x7ffaa01997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.146+0000 7ffa9f7fe640 1 -- 172.21.15.53:0/1076806888 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa019f560 con 0x7ffaa0102800 2024-08-31T06:19:24.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.146+0000 7ffa9effd640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaa0108a90 0x7ffaa01997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:24.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.146+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa0102800 0x7ffaa0199200 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009c40 tx=0x7ffa9000d6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:24.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.147+0000 7ffa9cff9640 1 -- 172.21.15.53:0/1076806888 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000de80 con 0x7ffaa0102800 2024-08-31T06:19:24.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.147+0000 7ffaa5c52640 1 -- 172.21.15.53:0/1076806888 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa006ac00 con 0x7ffaa0102800 2024-08-31T06:19:24.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.147+0000 7ffa9cff9640 1 -- 172.21.15.53:0/1076806888 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa90019ce0 con 0x7ffaa0102800 2024-08-31T06:19:24.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.147+0000 7ffa9cff9640 1 -- 172.21.15.53:0/1076806888 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90022ca0 con 0x7ffaa0102800 2024-08-31T06:19:24.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.147+0000 7ffaa5c52640 1 -- 172.21.15.53:0/1076806888 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa006b160 con 0x7ffaa0102800 2024-08-31T06:19:24.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.150+0000 7ffa9cff9640 1 -- 172.21.15.53:0/1076806888 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ffa9002b3f0 con 0x7ffaa0102800 2024-08-31T06:19:24.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.150+0000 7ffaac1c7740 1 Processor -- start 2024-08-31T06:19:24.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.150+0000 7ffaac1c7740 1 -- start start 2024-08-31T06:19:24.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.151+0000 7ffaac1c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a691c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.151+0000 7ffaac1c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a691ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.151+0000 7ffaac1c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a691d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.151+0000 7ffaac1c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5629a68925f0 con 0x5629a6555670 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.151+0000 7ffaac1c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5629a6881b80 con 0x5629a654d490 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.151+0000 7ffaac1c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5629a6885b30 con 0x5629a6576350 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.151+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a691d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.151+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a691c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.151+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a691d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43426/0 (socket says 172.21.15.53:43426) 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.151+0000 7ffa9effd640 1 -- 172.21.15.53:0/2609579158 learned_addr learned my addr 172.21.15.53:0/2609579158 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.152+0000 7ffa9effd640 1 -- 172.21.15.53:0/2609579158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 msgr2=0x5629a691c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.152+0000 7ffa9effd640 1 --2- 172.21.15.53:0/2609579158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a691c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.152+0000 7ffa9effd640 1 -- 172.21.15.53:0/2609579158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 msgr2=0x5629a691ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.152+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/2609579158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a691ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.152+0000 7ffa9cff9640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa880b4da0 0x7ffa880b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.152+0000 7ffa9effd640 1 --2- 172.21.15.53:0/2609579158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a691ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.152+0000 7ffa9effd640 1 -- 172.21.15.53:0/2609579158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a65e1930 con 0x5629a6555670 2024-08-31T06:19:24.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.152+0000 7ffa9ffff640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa880b4da0 0x7ffa880b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.152+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/2609579158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a691ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:19:24.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.153+0000 7ffa9cff9640 1 -- 172.21.15.53:0/1076806888 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7ffa900edf80 con 0x7ffaa0102800 2024-08-31T06:19:24.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.153+0000 7ffa9effd640 1 --2- 172.21.15.53:0/2609579158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a691d200 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7ffa94006010 tx=0x7ffa940058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27677f0159e8e501 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:24.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.153+0000 7ffa9ffff640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa880b4da0 0x7ffa880b72b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffa98005fd0 tx=0x7ffa98009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:24.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.153+0000 7ffa85ffb640 1 -- 172.21.15.53:0/2609579158 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa94047070 con 0x5629a6555670 2024-08-31T06:19:24.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.153+0000 7ffa85ffb640 1 -- 172.21.15.53:0/2609579158 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa940044c0 con 0x5629a6555670 2024-08-31T06:19:24.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.153+0000 7ffa85ffb640 1 -- 172.21.15.53:0/2609579158 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa94035050 con 0x5629a6555670 2024-08-31T06:19:24.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.154+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2609579158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 msgr2=0x5629a691d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.154+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/2609579158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a691d200 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7ffa94006010 tx=0x7ffa940058d0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.154+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2609579158 shutdown_connections 2024-08-31T06:19:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.154+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/2609579158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a691d200 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.154+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/2609579158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a691ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.154+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/2609579158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a691c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.154+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2609579158 >> 172.21.15.53:0/2609579158 conn(0x5629a656a740 msgr2=0x5629a691a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.155+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2609579158 shutdown_connections 2024-08-31T06:19:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.155+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2609579158 wait complete. 2024-08-31T06:19:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.155+0000 7ffaac1c7740 1 -- start start 2024-08-31T06:19:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.156+0000 7ffaac1c7740 1 Processor -- start 2024-08-31T06:19:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.156+0000 7ffaac1c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a6927ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.156+0000 7ffaac1c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a6928400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.156+0000 7ffaac1c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a6934220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.156+0000 7ffaac1c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5629a66e4890 con 0x5629a6555670 2024-08-31T06:19:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.156+0000 7ffaac1c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5629a6808790 con 0x5629a654d490 2024-08-31T06:19:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.156+0000 7ffaac1c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5629a692af00 con 0x5629a6576350 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.156+0000 7ffaac1c7740 10 client.0 _ll_register_callbacks cb 0x5629a658dba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.156+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a6928400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.156+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a6928400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43434/0 (socket says 172.21.15.53:43434) 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa9effd640 1 -- 172.21.15.53:0/2333593154 learned_addr learned my addr 172.21.15.53:0/2333593154 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a6927ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa9ffff640 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a6934220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa9effd640 1 -- 172.21.15.53:0/2333593154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 msgr2=0x5629a6934220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa9effd640 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a6934220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa9effd640 1 -- 172.21.15.53:0/2333593154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 msgr2=0x5629a6927ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa9effd640 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a6927ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa9effd640 1 -- 172.21.15.53:0/2333593154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a683ff30 con 0x5629a6555670 2024-08-31T06:19:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a6927ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa9effd640 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a6928400 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7ffa94045040 tx=0x7ffa94003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5afad854a96f52e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa7effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.157+0000 7ffa7effd640 1 -- 172.21.15.53:0/2333593154 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa94035050 con 0x5629a6555670 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.158+0000 7ffa7effd640 1 -- 172.21.15.53:0/2333593154 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7ffa94003bc0 con 0x5629a6555670 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.158+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2333593154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5629a6894540 con 0x5629a6555670 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.158+0000 7ffa7effd640 1 -- 172.21.15.53:0/2333593154 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ffa9405a050 con 0x5629a6555670 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.158+0000 7ffaac1c7740 10 client.20133 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.158+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2333593154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5629a6936c30 con 0x5629a6555670 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.158+0000 7ffa7effd640 1 -- 172.21.15.53:0/2333593154 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5629a6894540 con 0x5629a6555670 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.158+0000 7ffa7effd640 1 -- 172.21.15.53:0/2333593154 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7ffa94055030 con 0x5629a6555670 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.159+0000 7ffaac1c7740 10 client.20133 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.159+0000 7ffaac1c7740 10 client.20133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.159+0000 7ffaac1c7740 20 client.20133 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:24.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.159+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5629a6534cd0 0x5629a693a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.159+0000 7ffaac1c7740 4 client.20133 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:24.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.159+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2333593154 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629a688ffe0 con 0x5629a6534cd0 2024-08-31T06:19:24.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.159+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5629a6534cd0 0x5629a693a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.159+0000 7ffa7effd640 10 client.20133 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:24.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.159+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5629a6534cd0 0x5629a693a0e0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f868b36162128fa0 server_cookie=9b71794effe2e8d3 in_seq=0 out_seq=0 2024-08-31T06:19:24.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.160+0000 7ffa7effd640 1 -- 172.21.15.53:0/2333593154 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629a688ffe0 con 0x5629a6534cd0 2024-08-31T06:19:24.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.160+0000 7ffa7effd640 10 client.20133 handle_command_reply: tid=0 2024-08-31T06:19:24.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.160+0000 7ffaac1c7740 1 client.20133 shutdown 2024-08-31T06:19:24.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2333593154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 msgr2=0x5629a6928400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:24.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a6928400 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7ffa94045040 tx=0x7ffa94003820 comp rx=0 tx=0).stop 2024-08-31T06:19:24.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2333593154 shutdown_connections 2024-08-31T06:19:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5629a6534cd0 0x5629a693a0e0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a6934220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a6928400 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/2333593154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a6927ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2333593154 >> 172.21.15.53:0/2333593154 conn(0x5629a656a740 msgr2=0x5629a691f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffa7effd640 0 client.20133 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2333593154 shutdown_connections 2024-08-31T06:19:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffaac1c7740 1 -- 172.21.15.53:0/2333593154 wait complete. 2024-08-31T06:19:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.161+0000 7ffaac1c7740 20 client.20133 trim_cache size 0 max 16384 2024-08-31T06:19:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:23 smithi153 ceph-mon[22320]: pgmap v774: 97 pgs: 97 active+clean; 367 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 2.9 MiB/s wr, 247 op/s 2024-08-31T06:19:24.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.188+0000 7ffaac1c7740 1 Processor -- start 2024-08-31T06:19:24.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.188+0000 7ffaac1c7740 1 -- start start 2024-08-31T06:19:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.188+0000 7ffaac1c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a654d490 0x5629a6934120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.188+0000 7ffaac1c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a6555670 0x5629a6926740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.188+0000 7ffaac1c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6576350 0x5629a6926c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.188+0000 7ffaac1c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa01ad860 con 0x5629a6576350 2024-08-31T06:19:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.188+0000 7ffaac1c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa01af5e0 con 0x5629a6555670 2024-08-31T06:19:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.188+0000 7ffaac1c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa01adf30 con 0x5629a654d490 2024-08-31T06:19:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6576350 0x5629a6926c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a6555670 0x5629a6926740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a654d490 0x5629a6934120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a654d490 0x5629a6934120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46854/0 (socket says 172.21.15.53:46854) 2024-08-31T06:19:24.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a6555670 0x5629a6926740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43964/0 (socket says 172.21.15.53:43964) 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6576350 0x5629a6926c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43450/0 (socket says 172.21.15.53:43450) 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9f7fe640 1 -- 172.21.15.53:0/3197781714 learned_addr learned my addr 172.21.15.53:0/3197781714 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9effd640 1 -- 172.21.15.53:0/3197781714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a654d490 msgr2=0x5629a6934120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9effd640 1 --2- 172.21.15.53:0/3197781714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a654d490 0x5629a6934120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9effd640 1 -- 172.21.15.53:0/3197781714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6576350 msgr2=0x5629a6926c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9effd640 1 --2- 172.21.15.53:0/3197781714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6576350 0x5629a6926c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.189+0000 7ffa9effd640 1 -- 172.21.15.53:0/3197781714 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a6915d90 con 0x5629a6555670 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.190+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/3197781714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a654d490 0x5629a6934120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.190+0000 7ffa9ffff640 1 --2- 172.21.15.53:0/3197781714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6576350 0x5629a6926c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.190+0000 7ffa9effd640 1 --2- 172.21.15.53:0/3197781714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a6555670 0x5629a6926740 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffa940428c0 tx=0x7ffa94031920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f13994b8b1c33067 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.190+0000 7ffa857fa640 1 -- 172.21.15.53:0/3197781714 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa94035040 con 0x5629a6555670 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.190+0000 7ffa857fa640 1 -- 172.21.15.53:0/3197781714 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa94009520 con 0x5629a6555670 2024-08-31T06:19:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.190+0000 7ffa857fa640 1 -- 172.21.15.53:0/3197781714 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa94047040 con 0x5629a6555670 2024-08-31T06:19:24.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.191+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3197781714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a6555670 msgr2=0x5629a6926740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:24.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.191+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/3197781714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a6555670 0x5629a6926740 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffa940428c0 tx=0x7ffa94031920 comp rx=0 tx=0).stop 2024-08-31T06:19:24.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.192+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3197781714 shutdown_connections 2024-08-31T06:19:24.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.192+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/3197781714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6576350 0x5629a6926c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.192+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/3197781714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a6555670 0x5629a6926740 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.192+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/3197781714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a654d490 0x5629a6934120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.192+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3197781714 >> 172.21.15.53:0/3197781714 conn(0x5629a656a740 msgr2=0x5629a6923000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:24.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.192+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3197781714 shutdown_connections 2024-08-31T06:19:24.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.192+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3197781714 wait complete. 2024-08-31T06:19:24.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.192+0000 7ffaac1c7740 1 -- start start 2024-08-31T06:19:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.193+0000 7ffaac1c7740 1 Processor -- start 2024-08-31T06:19:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.194+0000 7ffaac1c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a6930560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.194+0000 7ffaac1c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a6930b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.194+0000 7ffa9f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a6930560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.194+0000 7ffa9f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a6930560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43974/0 (socket says 172.21.15.53:43974) 2024-08-31T06:19:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.194+0000 7ffa9f7fe640 1 -- 172.21.15.53:0/3045836173 learned_addr learned my addr 172.21.15.53:0/3045836173 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.194+0000 7ffa9effd640 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a6930b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.194+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a692bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.194+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3045836173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa01aee50 con 0x5629a6555670 2024-08-31T06:19:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.194+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3045836173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa01ae6c0 con 0x5629a654d490 2024-08-31T06:19:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.194+0000 7ffa9ffff640 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a692bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.195+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3045836173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa01ab860 con 0x5629a6576350 2024-08-31T06:19:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.195+0000 7ffaac1c7740 10 client.0 _ll_register_callbacks cb 0x7ffa94045070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.195+0000 7ffa9f7fe640 1 -- 172.21.15.53:0/3045836173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 msgr2=0x5629a692bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.195+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a692bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.195+0000 7ffa9f7fe640 1 -- 172.21.15.53:0/3045836173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 msgr2=0x5629a6930b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.195+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a6930b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.195+0000 7ffa9f7fe640 1 -- 172.21.15.53:0/3045836173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a692c2e0 con 0x5629a654d490 2024-08-31T06:19:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.196+0000 7ffa9f7fe640 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a6930560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffa900ee2b0 tx=0x7ffa900108b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69cd9bf54c3f2897 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.196+0000 7ffa7effd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:19:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.196+0000 7ffa9ffff640 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a692bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:19:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.196+0000 7ffa9effd640 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a6930b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:19:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.196+0000 7ffa7effd640 1 -- 172.21.15.53:0/3045836173 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90065020 con 0x5629a654d490 2024-08-31T06:19:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.196+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3045836173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa94009520 con 0x5629a654d490 2024-08-31T06:19:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.196+0000 7ffa7effd640 1 -- 172.21.15.53:0/3045836173 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7ffa900651c0 con 0x5629a654d490 2024-08-31T06:19:24.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.197+0000 7ffa7effd640 1 -- 172.21.15.53:0/3045836173 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ffa900b4100 con 0x5629a654d490 2024-08-31T06:19:24.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.197+0000 7ffaac1c7740 10 client.29105 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:24.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.197+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3045836173 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5629a69a4640 con 0x5629a654d490 2024-08-31T06:19:24.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.198+0000 7ffa7effd640 1 -- 172.21.15.53:0/3045836173 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa94009520 con 0x5629a654d490 2024-08-31T06:19:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.199+0000 7ffa7effd640 1 -- 172.21.15.53:0/3045836173 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7ffa900cf020 con 0x5629a654d490 2024-08-31T06:19:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.199+0000 7ffaac1c7740 10 client.29105 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.199+0000 7ffaac1c7740 10 client.29105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.199+0000 7ffaac1c7740 20 client.29105 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.199+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5629a650a080 0x5629a69a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.199+0000 7ffaac1c7740 4 client.29105 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:19:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.199+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3045836173 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5629a688d720 con 0x5629a650a080 2024-08-31T06:19:24.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.199+0000 7ffa9effd640 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5629a650a080 0x5629a69a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:24.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.200+0000 7ffa7effd640 10 client.29105 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:24.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.200+0000 7ffa9effd640 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5629a650a080 0x5629a69a6e20 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d973a35b88087a7d server_cookie=e020ee09a3576348 in_seq=0 out_seq=0 2024-08-31T06:19:24.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.203+0000 7ffa7effd640 1 -- 172.21.15.53:0/3045836173 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5629a688d720 con 0x5629a650a080 2024-08-31T06:19:24.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.203+0000 7ffa7effd640 10 client.29105 handle_command_reply: tid=0 2024-08-31T06:19:24.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.203+0000 7ffaac1c7740 1 client.29105 shutdown 2024-08-31T06:19:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.203+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3045836173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 msgr2=0x5629a6930560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.203+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a6930560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffa900ee2b0 tx=0x7ffa900108b0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.204+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3045836173 shutdown_connections 2024-08-31T06:19:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.204+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5629a650a080 0x5629a69a6e20 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.204+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629a6576350 0x5629a692bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.204+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5629a6555670 0x5629a6930b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.204+0000 7ffaac1c7740 1 --2- 172.21.15.53:0/3045836173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5629a654d490 0x5629a6930560 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.204+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3045836173 >> 172.21.15.53:0/3045836173 conn(0x5629a656a740 msgr2=0x5629a6926680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.204+0000 7ffa7effd640 0 client.29105 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.204+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3045836173 shutdown_connections 2024-08-31T06:19:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.204+0000 7ffaac1c7740 1 -- 172.21.15.53:0/3045836173 wait complete. 2024-08-31T06:19:24.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.204+0000 7ffaac1c7740 20 client.29105 trim_cache size 0 max 16384 2024-08-31T06:19:24.207 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:19:24.208 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:19:24.208 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5", 2024-08-31T06:19:24.208 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:19:24.208 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.205+0000 7ffaa5c52640 1 -- 172.21.15.53:0/1076806888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa880b4da0 msgr2=0x7ffa880b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.205+0000 7ffaa5c52640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa880b4da0 0x7ffa880b72b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffa98005fd0 tx=0x7ffa98009500 comp rx=0 tx=0).stop 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.205+0000 7ffaa5c52640 1 -- 172.21.15.53:0/1076806888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa0102800 msgr2=0x7ffaa0199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.205+0000 7ffaa5c52640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa0102800 0x7ffaa0199200 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009c40 tx=0x7ffa9000d6b0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.205+0000 7ffaa5c52640 1 -- 172.21.15.53:0/1076806888 shutdown_connections 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.205+0000 7ffaa5c52640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffa880b4da0 0x7ffa880b72b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.205+0000 7ffaa5c52640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa019e980 0x7ffaa019ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.205+0000 7ffaa5c52640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaa0108a90 0x7ffaa01997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.205+0000 7ffaa5c52640 1 --2- 172.21.15.53:0/1076806888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffaa0102800 0x7ffaa0199200 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.205+0000 7ffaa5c52640 1 -- 172.21.15.53:0/1076806888 >> 172.21.15.53:0/1076806888 conn(0x7ffaa00794d0 msgr2=0x7ffaa01043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.206+0000 7ffaa5c52640 1 -- 172.21.15.53:0/1076806888 shutdown_connections 2024-08-31T06:19:24.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:24.206+0000 7ffaa5c52640 1 -- 172.21.15.53:0/1076806888 wait complete. 2024-08-31T06:19:24.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 6389 7.18 MB/sec warmup 72 sec latency 192.875 ms 2024-08-31T06:19:24.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:24 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:19:24.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:24 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:24.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:24 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:19:24.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:24 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:19:24.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:24 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:19:24.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:24 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:24.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:24 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:25.069 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:19:25.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:24 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:19:25.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:24 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:25.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:24 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:19:25.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:24 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:19:25.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:24 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:19:25.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:24 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:25.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:24 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:25.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:24 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:19:25.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:24 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:25.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:24 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:19:25.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:24 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:19:25.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:24 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:19:25.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:24 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:25.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:24 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:25.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 6610 7.35 MB/sec warmup 73 sec latency 497.376 ms 2024-08-31T06:19:25.428 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:25.874 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:25 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:19:25.875 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:25 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:25.875 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:25 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:19:25.875 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:25 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:19:25.875 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:25 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:25.875 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:25 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:25.875 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:25 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:25.875 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:25 smithi053 ceph-mon[18924]: pgmap v775: 97 pgs: 97 active+clean; 375 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 266 op/s 2024-08-31T06:19:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.001+0000 7fa9ec10d640 1 -- 172.21.15.53:0/2928718843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4102880 msgr2=0x7fa9e4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.001+0000 7fa9ec10d640 1 --2- 172.21.15.53:0/2928718843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4102880 0x7fa9e4102c90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009860 tx=0x7fa9e002a340 comp rx=0 tx=0).stop 2024-08-31T06:19:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.001+0000 7fa9ec10d640 1 -- 172.21.15.53:0/2928718843 shutdown_connections 2024-08-31T06:19:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.001+0000 7fa9ec10d640 1 --2- 172.21.15.53:0/2928718843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9e4108ac0 0x7fa9e410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.001+0000 7fa9ec10d640 1 --2- 172.21.15.53:0/2928718843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9e4108170 0x7fa9e4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.001+0000 7fa9ec10d640 1 --2- 172.21.15.53:0/2928718843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4102880 0x7fa9e4102c90 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009860 tx=0x7fa9e002a340 comp rx=0 tx=0).stop 2024-08-31T06:19:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.001+0000 7fa9ec10d640 1 -- 172.21.15.53:0/2928718843 >> 172.21.15.53:0/2928718843 conn(0x7fa9e4079530 msgr2=0x7fa9e4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.002+0000 7fa9ec10d640 1 -- 172.21.15.53:0/2928718843 shutdown_connections 2024-08-31T06:19:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.002+0000 7fa9ec10d640 1 -- 172.21.15.53:0/2928718843 wait complete. 2024-08-31T06:19:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.003+0000 7fa9ec10d640 1 Processor -- start 2024-08-31T06:19:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.003+0000 7fa9ec10d640 1 -- start start 2024-08-31T06:19:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.003+0000 7fa9ec10d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4108170 0x7fa9e4198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.003+0000 7fa9ec10d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9e4108ac0 0x7fa9e41986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.003+0000 7fa9ec10d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9e419d8c0 0x7fa9e419dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.003+0000 7fa9ec10d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e4111530 con 0x7fa9e4108ac0 2024-08-31T06:19:26.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.004+0000 7fa9ec10d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e41113b0 con 0x7fa9e419d8c0 2024-08-31T06:19:26.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.004+0000 7fa9e9ea9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4108170 0x7fa9e4198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.004+0000 7fa9e96a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9e4108ac0 0x7fa9e41986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.004+0000 7fa9e9ea9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4108170 0x7fa9e4198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46880/0 (socket says 172.21.15.53:46880) 2024-08-31T06:19:26.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.004+0000 7fa9e9ea9640 1 -- 172.21.15.53:0/1443154954 learned_addr learned my addr 172.21.15.53:0/1443154954 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:26.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.004+0000 7fa9e96a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9e4108ac0 0x7fa9e41986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43474/0 (socket says 172.21.15.53:43474) 2024-08-31T06:19:26.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.004+0000 7fa9ec10d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e41116b0 con 0x7fa9e4108170 2024-08-31T06:19:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.004+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9e419d8c0 0x7fa9e419dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.004+0000 7fa9e9ea9640 1 -- 172.21.15.53:0/1443154954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9e419d8c0 msgr2=0x7fa9e419dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.004+0000 7fa9e9ea9640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9e419d8c0 0x7fa9e419dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.005+0000 7fa9e9ea9640 1 -- 172.21.15.53:0/1443154954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9e4108ac0 msgr2=0x7fa9e41986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.005+0000 7fa9e9ea9640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9e4108ac0 0x7fa9e41986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.005+0000 7fa9e9ea9640 1 -- 172.21.15.53:0/1443154954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e419e4a0 con 0x7fa9e4108170 2024-08-31T06:19:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.005+0000 7fa9e9ea9640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4108170 0x7fa9e4198140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0000c00 tx=0x7fa9e0005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.005+0000 7fa9daffd640 1 -- 172.21.15.53:0/1443154954 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0037070 con 0x7fa9e4108170 2024-08-31T06:19:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.005+0000 7fa9daffd640 1 -- 172.21.15.53:0/1443154954 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9e0042070 con 0x7fa9e4108170 2024-08-31T06:19:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.005+0000 7fa9ec10d640 1 -- 172.21.15.53:0/1443154954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e41a4a40 con 0x7fa9e4108170 2024-08-31T06:19:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.005+0000 7fa9ec10d640 1 -- 172.21.15.53:0/1443154954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e41a4de0 con 0x7fa9e4108170 2024-08-31T06:19:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.005+0000 7fa9daffd640 1 -- 172.21.15.53:0/1443154954 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e003d820 con 0x7fa9e4108170 2024-08-31T06:19:26.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.008+0000 7fa9f2682740 1 Processor -- start 2024-08-31T06:19:26.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9f2682740 1 -- start start 2024-08-31T06:19:26.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x5608697832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 0x560869783800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 0x560869783d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9f2682740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608696fa630 con 0x5608693bd390 2024-08-31T06:19:26.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9f2682740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5608696e9bc0 con 0x5608693b51b0 2024-08-31T06:19:26.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9f2682740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5608696edb70 con 0x5608693de070 2024-08-31T06:19:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9e96a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 0x560869783d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9e96a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 0x560869783d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43478/0 (socket says 172.21.15.53:43478) 2024-08-31T06:19:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9e96a8640 1 -- 172.21.15.53:0/2373364448 learned_addr learned my addr 172.21.15.53:0/2373364448 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/2373364448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x5608697832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.009+0000 7fa9daffd640 1 -- 172.21.15.53:0/1443154954 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa9e003d9c0 con 0x7fa9e4108170 2024-08-31T06:19:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.010+0000 7fa9e9ea9640 1 --2- 172.21.15.53:0/2373364448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 0x560869783800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.010+0000 7fa9e96a8640 1 -- 172.21.15.53:0/2373364448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 msgr2=0x5608697832c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.010+0000 7fa9e96a8640 1 --2- 172.21.15.53:0/2373364448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x5608697832c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.010+0000 7fa9e96a8640 1 -- 172.21.15.53:0/2373364448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 msgr2=0x560869783800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.010+0000 7fa9e96a8640 1 --2- 172.21.15.53:0/2373364448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 0x560869783800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.010+0000 7fa9e96a8640 1 -- 172.21.15.53:0/2373364448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560869449650 con 0x5608693bd390 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.010+0000 7fa9e9ea9640 1 --2- 172.21.15.53:0/2373364448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 0x560869783800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.010+0000 7fa9e96a8640 1 --2- 172.21.15.53:0/2373364448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 0x560869783d40 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009c30 tx=0x7fa9d4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218e5a2c8b4b7c15 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.011+0000 7fa9cffff640 1 -- 172.21.15.53:0/2373364448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4004020 con 0x5608693bd390 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.011+0000 7fa9cffff640 1 -- 172.21.15.53:0/2373364448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9d40041c0 con 0x5608693bd390 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.011+0000 7fa9daffd640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa9d00b4d20 0x7fa9d00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.011+0000 7fa9cffff640 1 -- 172.21.15.53:0/2373364448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4019670 con 0x5608693bd390 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.011+0000 7fa9daffd640 1 -- 172.21.15.53:0/1443154954 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fa9e01053b0 con 0x7fa9e4108170 2024-08-31T06:19:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.011+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa9d00b4d20 0x7fa9d00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.012+0000 7fa9f2682740 1 -- 172.21.15.53:0/2373364448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 msgr2=0x560869783d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.012+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa9d00b4d20 0x7fa9d00b7230 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00bfd0 tx=0x7fa9dc00d040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.012+0000 7fa9f2682740 1 --2- 172.21.15.53:0/2373364448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 0x560869783d40 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009c30 tx=0x7fa9d4011810 comp rx=0 tx=0).stop 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.012+0000 7fa9f2682740 1 -- 172.21.15.53:0/2373364448 shutdown_connections 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.012+0000 7fa9f2682740 1 --2- 172.21.15.53:0/2373364448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 0x560869783d40 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.012+0000 7fa9f2682740 1 --2- 172.21.15.53:0/2373364448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 0x560869783800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.012+0000 7fa9f2682740 1 --2- 172.21.15.53:0/2373364448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x5608697832c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.012+0000 7fa9f2682740 1 -- 172.21.15.53:0/2373364448 >> 172.21.15.53:0/2373364448 conn(0x5608693d2460 msgr2=0x5608697811b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.012+0000 7fa9f2682740 1 -- 172.21.15.53:0/2373364448 shutdown_connections 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.012+0000 7fa9f2682740 1 -- 172.21.15.53:0/2373364448 wait complete. 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.013+0000 7fa9f2682740 1 -- start start 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.013+0000 7fa9f2682740 1 Processor -- start 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.013+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693b51b0 0x56086978e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.013+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693bd390 0x56086978ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.013+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x56086979ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.013+0000 7fa9f2682740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56086954c700 con 0x5608693b51b0 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.013+0000 7fa9f2682740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560869670700 con 0x5608693bd390 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.013+0000 7fa9f2682740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560869791b40 con 0x5608693de070 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9e9ea9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693b51b0 0x56086978e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9e9ea9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693b51b0 0x56086978e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43492/0 (socket says 172.21.15.53:43492) 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9e9ea9640 1 -- 172.21.15.53:0/3444235840 learned_addr learned my addr 172.21.15.53:0/3444235840 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9f2682740 10 client.0 _ll_register_callbacks cb 0x56086969fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x56086979ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9e96a8640 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693bd390 0x56086978ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9e9ea9640 1 -- 172.21.15.53:0/3444235840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 msgr2=0x56086979ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9e9ea9640 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x56086979ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9e9ea9640 1 -- 172.21.15.53:0/3444235840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693bd390 msgr2=0x56086978ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9e9ea9640 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693bd390 0x56086978ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9e9ea9640 1 -- 172.21.15.53:0/3444235840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608696a98b0 con 0x5608693b51b0 2024-08-31T06:19:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9e9ea9640 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693b51b0 0x56086978e920 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00c8cf0 tx=0x7fa9e00c7a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04045633618692f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.014+0000 7fa9cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.015+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/3444235840 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00cb1f0 con 0x5608693b51b0 2024-08-31T06:19:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.015+0000 7fa9f2682740 1 -- 172.21.15.53:0/3444235840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9d40041c0 con 0x5608693b51b0 2024-08-31T06:19:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.015+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/3444235840 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fa9e00d4b20 con 0x5608693b51b0 2024-08-31T06:19:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.015+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/3444235840 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fa9e00c7210 con 0x5608693b51b0 2024-08-31T06:19:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.015+0000 7fa9f2682740 10 client.20148 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.015+0000 7fa9f2682740 1 -- 172.21.15.53:0/3444235840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x56086979d760 con 0x5608693b51b0 2024-08-31T06:19:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.015+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/3444235840 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9d40041c0 con 0x5608693b51b0 2024-08-31T06:19:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.015+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/3444235840 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fa9e00cace0 con 0x5608693b51b0 2024-08-31T06:19:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.015+0000 7fa9f2682740 10 client.20148 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.015+0000 7fa9f2682740 10 client.20148 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.015+0000 7fa9f2682740 20 client.20148 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.016+0000 7fa9f2682740 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56086939c9f0 0x5608697a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.016+0000 7fa9f2682740 4 client.20148 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.016+0000 7fa9f2682740 1 -- 172.21.15.53:0/3444235840 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608696fc580 con 0x56086939c9f0 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.016+0000 7fa9e96a8640 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56086939c9f0 0x5608697a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.016+0000 7fa9cd7fa640 10 client.20148 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.017+0000 7fa9e96a8640 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56086939c9f0 0x5608697a0ed0 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96e44282ec06a930 server_cookie=11ef2eff9430a867 in_seq=0 out_seq=0 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.017+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/3444235840 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5608696fc580 con 0x56086939c9f0 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.017+0000 7fa9cd7fa640 10 client.20148 handle_command_reply: tid=0 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.017+0000 7fa9f2682740 1 client.20148 shutdown 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.017+0000 7fa9f2682740 1 -- 172.21.15.53:0/3444235840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693b51b0 msgr2=0x56086978e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.017+0000 7fa9f2682740 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693b51b0 0x56086978e920 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00c8cf0 tx=0x7fa9e00c7a00 comp rx=0 tx=0).stop 2024-08-31T06:19:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.018+0000 7fa9f2682740 1 -- 172.21.15.53:0/3444235840 shutdown_connections 2024-08-31T06:19:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.018+0000 7fa9f2682740 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56086939c9f0 0x5608697a0ed0 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.018+0000 7fa9f2682740 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x56086979ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.018+0000 7fa9f2682740 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693bd390 0x56086978ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.018+0000 7fa9f2682740 1 --2- 172.21.15.53:0/3444235840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693b51b0 0x56086978e920 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.018+0000 7fa9f2682740 1 -- 172.21.15.53:0/3444235840 >> 172.21.15.53:0/3444235840 conn(0x5608693d2460 msgr2=0x5608697842f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.018+0000 7fa9cd7fa640 0 client.20148 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.018+0000 7fa9f2682740 1 -- 172.21.15.53:0/3444235840 shutdown_connections 2024-08-31T06:19:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.018+0000 7fa9f2682740 1 -- 172.21.15.53:0/3444235840 wait complete. 2024-08-31T06:19:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.018+0000 7fa9f2682740 20 client.20148 trim_cache size 0 max 16384 2024-08-31T06:19:26.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.051+0000 7fa9f2682740 1 Processor -- start 2024-08-31T06:19:26.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.051+0000 7fa9f2682740 1 -- start start 2024-08-31T06:19:26.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 0x56086978e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 0x560869784a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x56086979ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9f2682740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e41ad990 con 0x5608693bd390 2024-08-31T06:19:26.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9f2682740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e41af710 con 0x5608693b51b0 2024-08-31T06:19:26.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9f2682740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e41ae060 con 0x5608693de070 2024-08-31T06:19:26.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9ea6aa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x56086979ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9e9ea9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 0x56086978e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9e9ea9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 0x56086978e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:44024/0 (socket says 172.21.15.53:44024) 2024-08-31T06:19:26.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9ea6aa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x56086979ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46898/0 (socket says 172.21.15.53:46898) 2024-08-31T06:19:26.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9e9ea9640 1 -- 172.21.15.53:0/568655986 learned_addr learned my addr 172.21.15.53:0/568655986 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:26.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9e96a8640 1 --2- 172.21.15.53:0/568655986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 0x560869784a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9ea6aa640 1 -- 172.21.15.53:0/568655986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 msgr2=0x56086978e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:26.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/568655986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 0x56086978e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9ea6aa640 1 -- 172.21.15.53:0/568655986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 msgr2=0x560869784a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:26.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/568655986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 0x560869784a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.052+0000 7fa9ea6aa640 1 -- 172.21.15.53:0/568655986 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086978d880 con 0x5608693de070 2024-08-31T06:19:26.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.053+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/568655986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x56086979ad30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00b450 tx=0x7fa9dc019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3a094cd1893b64b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:26.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.053+0000 7fa9cf7fe640 1 -- 172.21.15.53:0/568655986 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc003970 con 0x5608693de070 2024-08-31T06:19:26.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.053+0000 7fa9cf7fe640 1 -- 172.21.15.53:0/568655986 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9dc025720 con 0x5608693de070 2024-08-31T06:19:26.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.053+0000 7fa9cf7fe640 1 -- 172.21.15.53:0/568655986 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc004240 con 0x5608693de070 2024-08-31T06:19:26.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.054+0000 7fa9f2682740 1 -- 172.21.15.53:0/568655986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 msgr2=0x56086979ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:26.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.054+0000 7fa9f2682740 1 --2- 172.21.15.53:0/568655986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x56086979ad30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00b450 tx=0x7fa9dc019000 comp rx=0 tx=0).stop 2024-08-31T06:19:26.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.054+0000 7fa9f2682740 1 -- 172.21.15.53:0/568655986 shutdown_connections 2024-08-31T06:19:26.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.054+0000 7fa9f2682740 1 --2- 172.21.15.53:0/568655986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693de070 0x56086979ad30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.054+0000 7fa9f2682740 1 --2- 172.21.15.53:0/568655986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693bd390 0x560869784a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.054+0000 7fa9f2682740 1 --2- 172.21.15.53:0/568655986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693b51b0 0x56086978e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.054+0000 7fa9f2682740 1 -- 172.21.15.53:0/568655986 >> 172.21.15.53:0/568655986 conn(0x5608693d2460 msgr2=0x5608697842f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:26.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.055+0000 7fa9f2682740 1 -- 172.21.15.53:0/568655986 shutdown_connections 2024-08-31T06:19:26.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.055+0000 7fa9f2682740 1 -- 172.21.15.53:0/568655986 wait complete. 2024-08-31T06:19:26.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.055+0000 7fa9f2682740 1 -- start start 2024-08-31T06:19:26.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.055+0000 7fa9f2682740 1 Processor -- start 2024-08-31T06:19:26.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693b51b0 0x560869804ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693bd390 0x560869805530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9f2682740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693de070 0x560869796d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9f2682740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e41aef80 con 0x5608693de070 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9f2682740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e41ae7f0 con 0x5608693bd390 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9f2682740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e41ab990 con 0x5608693b51b0 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9e9ea9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693b51b0 0x560869804ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9f2682740 10 client.0 _ll_register_callbacks cb 0x7fa9e0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9e9ea9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693b51b0 0x560869804ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46910/0 (socket says 172.21.15.53:46910) 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9e9ea9640 1 -- 172.21.15.53:0/1640804176 learned_addr learned my addr 172.21.15.53:0/1640804176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693de070 0x560869796d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9e96a8640 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693bd390 0x560869805530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9ea6aa640 1 -- 172.21.15.53:0/1640804176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693b51b0 msgr2=0x560869804ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693b51b0 0x560869804ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9ea6aa640 1 -- 172.21.15.53:0/1640804176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693bd390 msgr2=0x560869805530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.056+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693bd390 0x560869805530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.057+0000 7fa9ea6aa640 1 -- 172.21.15.53:0/1640804176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608697972d0 con 0x5608693de070 2024-08-31T06:19:26.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.057+0000 7fa9e9ea9640 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693b51b0 0x560869804ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:26.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.057+0000 7fa9ea6aa640 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693de070 0x560869796d90 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc006010 tx=0x7fa9dc02f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc76b1ecd75f17ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:26.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.057+0000 7fa9cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:26.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.057+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/1640804176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc004e50 con 0x5608693de070 2024-08-31T06:19:26.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.057+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/1640804176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fa9dc003970 con 0x5608693de070 2024-08-31T06:19:26.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.057+0000 7fa9f2682740 1 -- 172.21.15.53:0/1640804176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9dc025720 con 0x5608693de070 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.058+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/1640804176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fa9dc003b70 con 0x5608693de070 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.058+0000 7fa9f2682740 10 client.20154 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.058+0000 7fa9f2682740 1 -- 172.21.15.53:0/1640804176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x560869810470 con 0x5608693de070 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.058+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/1640804176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9dc003d10 con 0x5608693de070 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.058+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/1640804176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fa9dc036070 con 0x5608693de070 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.058+0000 7fa9f2682740 10 client.20154 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.058+0000 7fa9f2682740 10 client.20154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.058+0000 7fa9f2682740 20 client.20154 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.058+0000 7fa9f2682740 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560869371da0 0x560869812bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.058+0000 7fa9f2682740 4 client.20154 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.058+0000 7fa9f2682740 1 -- 172.21.15.53:0/1640804176 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa9dc025720 con 0x560869371da0 2024-08-31T06:19:26.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.059+0000 7fa9e9ea9640 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560869371da0 0x560869812bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9e9ea9640 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560869371da0 0x560869812bc0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b91f9549ac88d079 server_cookie=8ddff6689dd710c7 in_seq=0 out_seq=0 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9cd7fa640 10 client.20154 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9cd7fa640 1 -- 172.21.15.53:0/1640804176 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5682 (crc 0 0 0) 0x7fa9dc025720 con 0x560869371da0 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9cd7fa640 10 client.20154 handle_command_reply: tid=0 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9f2682740 1 client.20154 shutdown 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9f2682740 1 -- 172.21.15.53:0/1640804176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693de070 msgr2=0x560869796d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9f2682740 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693de070 0x560869796d90 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc006010 tx=0x7fa9dc02f660 comp rx=0 tx=0).stop 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9f2682740 1 -- 172.21.15.53:0/1640804176 shutdown_connections 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9f2682740 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560869371da0 0x560869812bc0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9f2682740 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608693de070 0x560869796d90 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9f2682740 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608693bd390 0x560869805530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9cd7fa640 0 client.20154 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9f2682740 1 --2- 172.21.15.53:0/1640804176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608693b51b0 0x560869804ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.060+0000 7fa9f2682740 1 -- 172.21.15.53:0/1640804176 >> 172.21.15.53:0/1640804176 conn(0x5608693d2460 msgr2=0x56086978fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:26.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.061+0000 7fa9f2682740 1 -- 172.21.15.53:0/1640804176 shutdown_connections 2024-08-31T06:19:26.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.061+0000 7fa9f2682740 1 -- 172.21.15.53:0/1640804176 wait complete. 2024-08-31T06:19:26.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.061+0000 7fa9f2682740 20 client.20154 trim_cache size 0 max 16384 2024-08-31T06:19:26.066 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:19:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:19:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:19:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:19:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5", 2024-08-31T06:19:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:19:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:19:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:19:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:19:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:26.078 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:19:26.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 -- 172.21.15.53:0/1443154954 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa9d00b4d20 msgr2=0x7fa9d00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:26.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa9d00b4d20 0x7fa9d00b7230 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00bfd0 tx=0x7fa9dc00d040 comp rx=0 tx=0).stop 2024-08-31T06:19:26.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 -- 172.21.15.53:0/1443154954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4108170 msgr2=0x7fa9e4198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:26.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4108170 0x7fa9e4198140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0000c00 tx=0x7fa9e0005040 comp rx=0 tx=0).stop 2024-08-31T06:19:26.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 -- 172.21.15.53:0/1443154954 shutdown_connections 2024-08-31T06:19:26.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa9d00b4d20 0x7fa9d00b7230 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9e419d8c0 0x7fa9e419dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9e4108ac0 0x7fa9e41986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 --2- 172.21.15.53:0/1443154954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4108170 0x7fa9e4198140 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:26.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 -- 172.21.15.53:0/1443154954 >> 172.21.15.53:0/1443154954 conn(0x7fa9e4079530 msgr2=0x7fa9e4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:26.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 -- 172.21.15.53:0/1443154954 shutdown_connections 2024-08-31T06:19:26.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:26.062+0000 7fa9ec10d640 1 -- 172.21.15.53:0/1443154954 wait complete. 2024-08-31T06:19:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:25 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:19:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:25 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:25 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:19:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:25 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:19:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:25 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:26.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:25 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:26.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:25 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:26.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:25 smithi130 ceph-mon[22266]: pgmap v775: 97 pgs: 97 active+clean; 375 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 266 op/s 2024-08-31T06:19:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:25 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:19:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:25 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:25 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:19:26.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:25 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:19:26.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:25 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:26.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:25 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:26.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:25 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:19:26.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:25 smithi153 ceph-mon[22320]: pgmap v775: 97 pgs: 97 active+clean; 375 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 266 op/s 2024-08-31T06:19:26.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 6794 7.36 MB/sec warmup 74 sec latency 77.463 ms 2024-08-31T06:19:27.004 INFO:tasks.cephfs.filesystem:scrub status for tag:bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5 - {'path': '/', 'tag': 'bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5', 'options': 'recursive,force'} 2024-08-31T06:19:27.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 6896 7.33 MB/sec warmup 75 sec latency 75.889 ms 2024-08-31T06:19:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:27 smithi053 ceph-mon[18924]: pgmap v776: 97 pgs: 97 active+clean; 383 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 266 op/s 2024-08-31T06:19:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:27 smithi130 ceph-mon[22266]: pgmap v776: 97 pgs: 97 active+clean; 383 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 266 op/s 2024-08-31T06:19:28.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:27 smithi153 ceph-mon[22320]: pgmap v776: 97 pgs: 97 active+clean; 383 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 266 op/s 2024-08-31T06:19:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.206+0000 7f580108c640 1 -- 172.21.15.53:0/4263149234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc1089f0 msgr2=0x7f57fc10f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.206+0000 7f580108c640 1 --2- 172.21.15.53:0/4263149234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc1089f0 0x7f57fc10f220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009be0 tx=0x7f57f402a6c0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.207+0000 7f580108c640 1 -- 172.21.15.53:0/4263149234 shutdown_connections 2024-08-31T06:19:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.207+0000 7f580108c640 1 --2- 172.21.15.53:0/4263149234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc1089f0 0x7f57fc10f220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.207+0000 7f580108c640 1 --2- 172.21.15.53:0/4263149234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc1080a0 0x7f57fc1084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.207+0000 7f580108c640 1 --2- 172.21.15.53:0/4263149234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc102770 0x7f57fc102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.207+0000 7f580108c640 1 -- 172.21.15.53:0/4263149234 >> 172.21.15.53:0/4263149234 conn(0x7f57fc07a490 msgr2=0x7f57fc07a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.207+0000 7f580108c640 1 -- 172.21.15.53:0/4263149234 shutdown_connections 2024-08-31T06:19:28.250 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.207+0000 7f580108c640 1 -- 172.21.15.53:0/4263149234 wait complete. 2024-08-31T06:19:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.208+0000 7f580108c640 1 Processor -- start 2024-08-31T06:19:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.208+0000 7f580108c640 1 -- start start 2024-08-31T06:19:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f580108c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc102770 0x7f57fc199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f580108c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc1080a0 0x7f57fc1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f57fad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc102770 0x7f57fc199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f57fad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc102770 0x7f57fc199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46928/0 (socket says 172.21.15.53:46928) 2024-08-31T06:19:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f57fa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc1080a0 0x7f57fc1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f57fa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc1080a0 0x7f57fc1995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43540/0 (socket says 172.21.15.53:43540) 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f580108c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc1089f0 0x7f57fc19e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f57fa59c640 1 -- 172.21.15.53:0/3076042582 learned_addr learned my addr 172.21.15.53:0/3076042582 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f580108c640 1 -- 172.21.15.53:0/3076042582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc112550 con 0x7f57fc1080a0 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f580108c640 1 -- 172.21.15.53:0/3076042582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1123d0 con 0x7f57fc1089f0 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f580108c640 1 -- 172.21.15.53:0/3076042582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1126d0 con 0x7f57fc102770 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.209+0000 7f57fb59e640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc1089f0 0x7f57fc19e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.210+0000 7f57fa59c640 1 -- 172.21.15.53:0/3076042582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc102770 msgr2=0x7f57fc199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.210+0000 7f57fa59c640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc102770 0x7f57fc199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.210+0000 7f57fa59c640 1 -- 172.21.15.53:0/3076042582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc1089f0 msgr2=0x7f57fc19e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.210+0000 7f57fa59c640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc1089f0 0x7f57fc19e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.210+0000 7f57fa59c640 1 -- 172.21.15.53:0/3076042582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc19ef40 con 0x7f57fc1080a0 2024-08-31T06:19:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.210+0000 7f57fa59c640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc1080a0 0x7f57fc1995b0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009e20 tx=0x7f57f000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.210+0000 7f57e3fff640 1 -- 172.21.15.53:0/3076042582 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f001e070 con 0x7f57fc1080a0 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.210+0000 7f580108c640 1 -- 172.21.15.53:0/3076042582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57fc19f230 con 0x7f57fc1080a0 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.210+0000 7f580108c640 1 -- 172.21.15.53:0/3076042582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57fc06b340 con 0x7f57fc1080a0 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.210+0000 7f57e3fff640 1 -- 172.21.15.53:0/3076042582 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57f000ccc0 con 0x7f57fc1080a0 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.210+0000 7f57e3fff640 1 -- 172.21.15.53:0/3076042582 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f00196a0 con 0x7f57fc1080a0 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.213+0000 7f5807ff3740 1 Processor -- start 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f5807ff3740 1 -- start start 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042ae1b0 0x556304651ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f57e3fff640 1 -- 172.21.15.53:0/3076042582 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f57f0021070 con 0x7f57fc1080a0 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042852f0 0x556304652220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 0x556304652760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f5807ff3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5563045c7000 con 0x5563042852f0 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f5807ff3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5563045b6590 con 0x5563042ae1b0 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f5807ff3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5563045ba540 con 0x55630428d4d0 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f57fad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042852f0 0x556304652220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f57fad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042852f0 0x556304652220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43548/0 (socket says 172.21.15.53:43548) 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f57fad9d640 1 -- 172.21.15.53:0/4240149825 learned_addr learned my addr 172.21.15.53:0/4240149825 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.214+0000 7f57fa59c640 1 --2- 172.21.15.53:0/4240149825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 0x556304652760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.215+0000 7f57fb59e640 1 --2- 172.21.15.53:0/4240149825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042ae1b0 0x556304651ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.215+0000 7f57fad9d640 1 -- 172.21.15.53:0/4240149825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 msgr2=0x556304652760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.215+0000 7f57fad9d640 1 --2- 172.21.15.53:0/4240149825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 0x556304652760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.215+0000 7f57fad9d640 1 -- 172.21.15.53:0/4240149825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042ae1b0 msgr2=0x556304651ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.215+0000 7f57fad9d640 1 --2- 172.21.15.53:0/4240149825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042ae1b0 0x556304651ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.215+0000 7f57fad9d640 1 -- 172.21.15.53:0/4240149825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556304319790 con 0x5563042852f0 2024-08-31T06:19:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.215+0000 7f57fa59c640 1 --2- 172.21.15.53:0/4240149825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 0x556304652760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.215+0000 7f57fad9d640 1 --2- 172.21.15.53:0/4240149825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042852f0 0x556304652220 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009cf0 tx=0x7f57ec011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a1e233ed8ca7e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.215+0000 7f57e17fa640 1 -- 172.21.15.53:0/4240149825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec004230 con 0x5563042852f0 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.215+0000 7f57e17fa640 1 -- 172.21.15.53:0/4240149825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57ec0043d0 con 0x5563042852f0 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.215+0000 7f57e17fa640 1 -- 172.21.15.53:0/4240149825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0197a0 con 0x5563042852f0 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.216+0000 7f57e3fff640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e40b4d20 0x7f57e40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.217+0000 7f5807ff3740 1 -- 172.21.15.53:0/4240149825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042852f0 msgr2=0x556304652220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.217+0000 7f5807ff3740 1 --2- 172.21.15.53:0/4240149825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042852f0 0x556304652220 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009cf0 tx=0x7f57ec011810 comp rx=0 tx=0).stop 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.217+0000 7f57fb59e640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e40b4d20 0x7f57e40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.217+0000 7f5807ff3740 1 -- 172.21.15.53:0/4240149825 shutdown_connections 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.217+0000 7f5807ff3740 1 --2- 172.21.15.53:0/4240149825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 0x556304652760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.217+0000 7f5807ff3740 1 --2- 172.21.15.53:0/4240149825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042852f0 0x556304652220 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.217+0000 7f5807ff3740 1 --2- 172.21.15.53:0/4240149825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042ae1b0 0x556304651ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.217+0000 7f5807ff3740 1 -- 172.21.15.53:0/4240149825 >> 172.21.15.53:0/4240149825 conn(0x5563042a2300 msgr2=0x55630464fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.217+0000 7f57e3fff640 1 -- 172.21.15.53:0/3076042582 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f57f00e70b0 con 0x7f57fc1080a0 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.217+0000 7f57fb59e640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e40b4d20 0x7f57e40b7230 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f57f4006010 tx=0x7f57f4009930 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.218+0000 7f5807ff3740 1 -- 172.21.15.53:0/4240149825 shutdown_connections 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.218+0000 7f5807ff3740 1 -- 172.21.15.53:0/4240149825 wait complete. 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.218+0000 7f5807ff3740 1 -- start start 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.219+0000 7f5807ff3740 1 Processor -- start 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.219+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042852f0 0x55630465f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.220+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 0x55630465f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.220+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 0x5563046597f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.220+0000 7f5807ff3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5563044efab0 con 0x5563042ae1b0 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.220+0000 7f5807ff3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55630453d680 con 0x5563042852f0 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.220+0000 7f5807ff3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556304660400 con 0x55630428d4d0 2024-08-31T06:19:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.220+0000 7f57fa59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 0x55630465f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.220+0000 7f57fa59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 0x55630465f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46936/0 (socket says 172.21.15.53:46936) 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.220+0000 7f5807ff3740 10 client.0 _ll_register_callbacks cb 0x5563042c5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.220+0000 7f57fa59c640 1 -- 172.21.15.53:0/1351832755 learned_addr learned my addr 172.21.15.53:0/1351832755 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.220+0000 7f57fb59e640 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 0x5563046597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.220+0000 7f57fad9d640 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042852f0 0x55630465f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.221+0000 7f57fa59c640 1 -- 172.21.15.53:0/1351832755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042852f0 msgr2=0x55630465f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.221+0000 7f57fa59c640 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042852f0 0x55630465f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.221+0000 7f57fa59c640 1 -- 172.21.15.53:0/1351832755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 msgr2=0x5563046597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.221+0000 7f57fa59c640 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 0x5563046597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.221+0000 7f57fa59c640 1 -- 172.21.15.53:0/1351832755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556304392620 con 0x55630428d4d0 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.221+0000 7f57fa59c640 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 0x55630465f8e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f57f0011e70 tx=0x7f57f00addd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ecca379fed10d49 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.222+0000 7f57deff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:19:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.222+0000 7f57deff5640 1 -- 172.21.15.53:0/1351832755 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f00ad600 con 0x55630428d4d0 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.222+0000 7f57deff5640 1 -- 172.21.15.53:0/1351832755 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f57f00e8d90 con 0x55630428d4d0 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.222+0000 7f5807ff3740 1 -- 172.21.15.53:0/1351832755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ec0043d0 con 0x55630428d4d0 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.222+0000 7f57deff5640 1 -- 172.21.15.53:0/1351832755 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f57f00acfa0 con 0x55630428d4d0 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.222+0000 7f5807ff3740 10 client.29140 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.222+0000 7f5807ff3740 1 -- 172.21.15.53:0/1351832755 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x556304674c80 con 0x55630428d4d0 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.223+0000 7f57deff5640 1 -- 172.21.15.53:0/1351832755 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57ec0043d0 con 0x55630428d4d0 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.223+0000 7f57deff5640 1 -- 172.21.15.53:0/1351832755 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f57f00110d0 con 0x55630428d4d0 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.223+0000 7f5807ff3740 10 client.29140 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.223+0000 7f5807ff3740 10 client.29140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.223+0000 7f5807ff3740 20 client.29140 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.223+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55630426cd80 0x5563046781a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.223+0000 7f5807ff3740 4 client.29140 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.223+0000 7f5807ff3740 1 -- 172.21.15.53:0/1351832755 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563045c8f50 con 0x55630426cd80 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.223+0000 7f57fad9d640 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55630426cd80 0x5563046781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.224+0000 7f57deff5640 10 client.29140 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.224+0000 7f57fad9d640 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55630426cd80 0x5563046781a0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40c5557bb3ca313c server_cookie=8ed0002138334a92 in_seq=0 out_seq=0 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.225+0000 7f57deff5640 1 -- 172.21.15.53:0/1351832755 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5563045c8f50 con 0x55630426cd80 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.225+0000 7f57deff5640 10 client.29140 handle_command_reply: tid=0 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.225+0000 7f5807ff3740 1 client.29140 shutdown 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.225+0000 7f5807ff3740 1 -- 172.21.15.53:0/1351832755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 msgr2=0x55630465f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.225+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 0x55630465f8e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f57f0011e70 tx=0x7f57f00addd0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.226+0000 7f5807ff3740 1 -- 172.21.15.53:0/1351832755 shutdown_connections 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.226+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55630426cd80 0x5563046781a0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.226+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 0x5563046597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.226+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55630428d4d0 0x55630465f8e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.226+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1351832755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042852f0 0x55630465f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.226+0000 7f5807ff3740 1 -- 172.21.15.53:0/1351832755 >> 172.21.15.53:0/1351832755 conn(0x5563042a2300 msgr2=0x556304652d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.226+0000 7f57deff5640 0 client.29140 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.226+0000 7f5807ff3740 1 -- 172.21.15.53:0/1351832755 shutdown_connections 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.226+0000 7f5807ff3740 1 -- 172.21.15.53:0/1351832755 wait complete. 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.226+0000 7f5807ff3740 20 client.29140 trim_cache size 0 max 16384 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.247+0000 7f5807ff3740 1 Processor -- start 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.247+0000 7f5807ff3740 1 -- start start 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5563042852f0 0x55630464f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55630428d4d0 0x55630464fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 0x55630467d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f5807ff3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57e800e980 con 0x5563042ae1b0 2024-08-31T06:19:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f5807ff3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57e8010700 con 0x55630428d4d0 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f5807ff3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57e800f050 con 0x5563042852f0 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f57fb59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 0x55630467d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f57fad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5563042852f0 0x55630464f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f57fb59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 0x55630467d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43562/0 (socket says 172.21.15.53:43562) 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f57fb59e640 1 -- 172.21.15.53:0/3950341695 learned_addr learned my addr 172.21.15.53:0/3950341695 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f57fa59c640 1 --2- 172.21.15.53:0/3950341695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55630428d4d0 0x55630464fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f57fb59e640 1 -- 172.21.15.53:0/3950341695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5563042852f0 msgr2=0x55630464f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f57fb59e640 1 --2- 172.21.15.53:0/3950341695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5563042852f0 0x55630464f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f57fb59e640 1 -- 172.21.15.53:0/3950341695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55630428d4d0 msgr2=0x55630464fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f57fb59e640 1 --2- 172.21.15.53:0/3950341695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55630428d4d0 0x55630464fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.248+0000 7f57fb59e640 1 -- 172.21.15.53:0/3950341695 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556304654210 con 0x5563042ae1b0 2024-08-31T06:19:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.249+0000 7f57fb59e640 1 --2- 172.21.15.53:0/3950341695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 0x55630467d9a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009be0 tx=0x7f57f403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a3f1ef1c340291 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.249+0000 7f57e0ff9640 1 -- 172.21.15.53:0/3950341695 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f404f070 con 0x5563042ae1b0 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.249+0000 7f57e0ff9640 1 -- 172.21.15.53:0/3950341695 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57f4037040 con 0x5563042ae1b0 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.249+0000 7f57e0ff9640 1 -- 172.21.15.53:0/3950341695 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4036040 con 0x5563042ae1b0 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.250+0000 7f5807ff3740 1 -- 172.21.15.53:0/3950341695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 msgr2=0x55630467d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.250+0000 7f5807ff3740 1 --2- 172.21.15.53:0/3950341695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 0x55630467d9a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009be0 tx=0x7f57f403e000 comp rx=0 tx=0).stop 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.250+0000 7f5807ff3740 1 -- 172.21.15.53:0/3950341695 shutdown_connections 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.250+0000 7f5807ff3740 1 --2- 172.21.15.53:0/3950341695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5563042ae1b0 0x55630467d9a0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.250+0000 7f5807ff3740 1 --2- 172.21.15.53:0/3950341695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55630428d4d0 0x55630464fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.250+0000 7f5807ff3740 1 --2- 172.21.15.53:0/3950341695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5563042852f0 0x55630464f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.250+0000 7f5807ff3740 1 -- 172.21.15.53:0/3950341695 >> 172.21.15.53:0/3950341695 conn(0x5563042a2300 msgr2=0x556304659270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.251+0000 7f5807ff3740 1 -- 172.21.15.53:0/3950341695 shutdown_connections 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.251+0000 7f5807ff3740 1 -- 172.21.15.53:0/3950341695 wait complete. 2024-08-31T06:19:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.251+0000 7f5807ff3740 1 -- start start 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.251+0000 7f5807ff3740 1 Processor -- start 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042852f0 0x556304672790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55630428d4d0 0x55630466dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f5807ff3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5563042ae1b0 0x55630466e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f5807ff3740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57e800ff70 con 0x55630428d4d0 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f5807ff3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57e800f7e0 con 0x5563042852f0 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f5807ff3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57e800c980 con 0x5563042ae1b0 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f57fa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55630428d4d0 0x55630466dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f57fa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55630428d4d0 0x55630466dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43570/0 (socket says 172.21.15.53:43570) 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f57fa59c640 1 -- 172.21.15.53:0/1926011192 learned_addr learned my addr 172.21.15.53:0/1926011192 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f5807ff3740 10 client.0 _ll_register_callbacks cb 0x7f57f00a7f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f57fa59c640 1 -- 172.21.15.53:0/1926011192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5563042ae1b0 msgr2=0x55630466e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f57fa59c640 1 --2- 172.21.15.53:0/1926011192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5563042ae1b0 0x55630466e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f57fa59c640 1 -- 172.21.15.53:0/1926011192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042852f0 msgr2=0x556304672790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f57fa59c640 1 --2- 172.21.15.53:0/1926011192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042852f0 0x556304672790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.252+0000 7f57fa59c640 1 -- 172.21.15.53:0/1926011192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55630466e6b0 con 0x55630428d4d0 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.253+0000 7f57fa59c640 1 --2- 172.21.15.53:0/1926011192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55630428d4d0 0x55630466dc30 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f57f000c6a0 tx=0x7f57f0011300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57831f6ce4fd3cdf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.253+0000 7f57deff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.253+0000 7f57deff5640 1 -- 172.21.15.53:0/1926011192 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f00ad180 con 0x55630428d4d0 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.253+0000 7f57deff5640 1 -- 172.21.15.53:0/1926011192 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f57f00acca0 con 0x55630428d4d0 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.253+0000 7f5807ff3740 1 -- 172.21.15.53:0/1926011192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57f4037040 con 0x55630428d4d0 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.253+0000 7f57deff5640 1 -- 172.21.15.53:0/1926011192 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f57f00ad600 con 0x55630428d4d0 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.253+0000 7f5807ff3740 10 client.20172 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.253+0000 7f5807ff3740 1 -- 172.21.15.53:0/1926011192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5563046e2850 con 0x55630428d4d0 2024-08-31T06:19:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.253+0000 7f57deff5640 1 -- 172.21.15.53:0/1926011192 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57f00b63e0 con 0x55630428d4d0 2024-08-31T06:19:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.254+0000 7f57deff5640 1 -- 172.21.15.53:0/1926011192 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f57f00ac620 con 0x55630428d4d0 2024-08-31T06:19:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.254+0000 7f5807ff3740 10 client.20172 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.254+0000 7f5807ff3740 10 client.20172 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.254+0000 7f5807ff3740 20 client.20172 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.254+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1926011192 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5563042421c0 0x5563046e50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.254+0000 7f5807ff3740 4 client.20172 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:19:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.254+0000 7f5807ff3740 1 -- 172.21.15.53:0/1926011192 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f57f4037040 con 0x5563042421c0 2024-08-31T06:19:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.254+0000 7f57fad9d640 1 --2- 172.21.15.53:0/1926011192 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5563042421c0 0x5563046e50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.255+0000 7f57deff5640 10 client.20172 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.255+0000 7f57fad9d640 1 --2- 172.21.15.53:0/1926011192 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5563042421c0 0x5563046e50f0 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e174bb3be796ef6 server_cookie=46913460b3caa69 in_seq=0 out_seq=0 2024-08-31T06:19:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f57deff5640 1 -- 172.21.15.53:0/1926011192 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f57f4037040 con 0x5563042421c0 2024-08-31T06:19:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f57deff5640 10 client.20172 handle_command_reply: tid=0 2024-08-31T06:19:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f5807ff3740 1 client.20172 shutdown 2024-08-31T06:19:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f5807ff3740 1 -- 172.21.15.53:0/1926011192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55630428d4d0 msgr2=0x55630466dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1926011192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55630428d4d0 0x55630466dc30 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f57f000c6a0 tx=0x7f57f0011300 comp rx=0 tx=0).stop 2024-08-31T06:19:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f5807ff3740 1 -- 172.21.15.53:0/1926011192 shutdown_connections 2024-08-31T06:19:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1926011192 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5563042421c0 0x5563046e50f0 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1926011192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5563042ae1b0 0x55630466e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1926011192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55630428d4d0 0x55630466dc30 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f5807ff3740 1 --2- 172.21.15.53:0/1926011192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563042852f0 0x556304672790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f5807ff3740 1 -- 172.21.15.53:0/1926011192 >> 172.21.15.53:0/1926011192 conn(0x5563042a2300 msgr2=0x55630464f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f57deff5640 0 client.20172 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f5807ff3740 1 -- 172.21.15.53:0/1926011192 shutdown_connections 2024-08-31T06:19:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.294+0000 7f5807ff3740 1 -- 172.21.15.53:0/1926011192 wait complete. 2024-08-31T06:19:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.295+0000 7f5807ff3740 20 client.20172 trim_cache size 0 max 16384 2024-08-31T06:19:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:19:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:19:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:19:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:19:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.295+0000 7f580108c640 1 -- 172.21.15.53:0/3076042582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e40b4d20 msgr2=0x7f57e40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.295+0000 7f580108c640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e40b4d20 0x7f57e40b7230 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f57f4006010 tx=0x7f57f4009930 comp rx=0 tx=0).stop 2024-08-31T06:19:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.295+0000 7f580108c640 1 -- 172.21.15.53:0/3076042582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc1080a0 msgr2=0x7f57fc1995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.295+0000 7f580108c640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc1080a0 0x7f57fc1995b0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009e20 tx=0x7f57f000ed90 comp rx=0 tx=0).stop 2024-08-31T06:19:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.295+0000 7f580108c640 1 -- 172.21.15.53:0/3076042582 shutdown_connections 2024-08-31T06:19:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.295+0000 7f580108c640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57e40b4d20 0x7f57e40b7230 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.295+0000 7f580108c640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57fc1089f0 0x7f57fc19e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.295+0000 7f580108c640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57fc1080a0 0x7f57fc1995b0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.295+0000 7f580108c640 1 --2- 172.21.15.53:0/3076042582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc102770 0x7f57fc199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:28.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.295+0000 7f580108c640 1 -- 172.21.15.53:0/3076042582 >> 172.21.15.53:0/3076042582 conn(0x7f57fc07a490 msgr2=0x7f57fc1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:28.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.296+0000 7f580108c640 1 -- 172.21.15.53:0/3076042582 shutdown_connections 2024-08-31T06:19:28.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:28.296+0000 7f580108c640 1 -- 172.21.15.53:0/3076042582 wait complete. 2024-08-31T06:19:28.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 7029 7.36 MB/sec warmup 76 sec latency 64.671 ms 2024-08-31T06:19:29.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 7209 7.43 MB/sec warmup 77 sec latency 59.861 ms 2024-08-31T06:19:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:29 smithi053 ceph-mon[18924]: pgmap v777: 97 pgs: 97 active+clean; 389 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 266 op/s 2024-08-31T06:19:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:29 smithi130 ceph-mon[22266]: pgmap v777: 97 pgs: 97 active+clean; 389 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 266 op/s 2024-08-31T06:19:30.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:29 smithi153 ceph-mon[22320]: pgmap v777: 97 pgs: 97 active+clean; 389 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 266 op/s 2024-08-31T06:19:30.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 7365 7.39 MB/sec warmup 78 sec latency 104.523 ms 2024-08-31T06:19:30.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:30 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:19:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:30 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:19:31.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:30 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:19:31.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 7510 7.38 MB/sec warmup 79 sec latency 50.856 ms 2024-08-31T06:19:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:19:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:19:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:19:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:19:31.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:31 smithi053 ceph-mon[18924]: pgmap v778: 97 pgs: 97 active+clean; 396 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.9 MiB/s wr, 279 op/s 2024-08-31T06:19:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:19:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:19:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:19:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:19:32.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:31 smithi130 ceph-mon[22266]: pgmap v778: 97 pgs: 97 active+clean; 396 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.9 MiB/s wr, 279 op/s 2024-08-31T06:19:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:19:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:19:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:19:32.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:19:32.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:31 smithi153 ceph-mon[22320]: pgmap v778: 97 pgs: 97 active+clean; 396 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.9 MiB/s wr, 279 op/s 2024-08-31T06:19:32.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 7648 7.37 MB/sec warmup 80 sec latency 53.050 ms 2024-08-31T06:19:33.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 7805 7.35 MB/sec warmup 81 sec latency 111.839 ms 2024-08-31T06:19:33.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:33 smithi053 ceph-mon[18924]: pgmap v779: 97 pgs: 97 active+clean; 396 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.3 MiB/s wr, 253 op/s 2024-08-31T06:19:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:33 smithi130 ceph-mon[22266]: pgmap v779: 97 pgs: 97 active+clean; 396 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.3 MiB/s wr, 253 op/s 2024-08-31T06:19:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:33 smithi153 ceph-mon[22320]: pgmap v779: 97 pgs: 97 active+clean; 396 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.3 MiB/s wr, 253 op/s 2024-08-31T06:19:34.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 7987 7.37 MB/sec warmup 82 sec latency 69.547 ms 2024-08-31T06:19:35.363 INFO:tasks.workunit.client.0.smithi053.stdout: 10 8153 7.33 MB/sec warmup 83 sec latency 72.466 ms 2024-08-31T06:19:35.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:35 smithi053 ceph-mon[18924]: pgmap v780: 97 pgs: 97 active+clean; 397 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.4 MiB/s wr, 267 op/s 2024-08-31T06:19:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:35 smithi130 ceph-mon[22266]: pgmap v780: 97 pgs: 97 active+clean; 397 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.4 MiB/s wr, 267 op/s 2024-08-31T06:19:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:35 smithi153 ceph-mon[22320]: pgmap v780: 97 pgs: 97 active+clean; 397 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.4 MiB/s wr, 267 op/s 2024-08-31T06:19:36.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 8317 7.33 MB/sec warmup 84 sec latency 81.204 ms 2024-08-31T06:19:37.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 8507 7.40 MB/sec warmup 85 sec latency 113.640 ms 2024-08-31T06:19:37.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:37 smithi053 ceph-mon[18924]: pgmap v781: 97 pgs: 97 active+clean; 395 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.3 MiB/s wr, 291 op/s 2024-08-31T06:19:37.977 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:37 smithi153 ceph-mon[22320]: pgmap v781: 97 pgs: 97 active+clean; 395 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.3 MiB/s wr, 291 op/s 2024-08-31T06:19:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:37 smithi130 ceph-mon[22266]: pgmap v781: 97 pgs: 97 active+clean; 395 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.3 MiB/s wr, 291 op/s 2024-08-31T06:19:38.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 8672 7.38 MB/sec warmup 86 sec latency 112.327 ms 2024-08-31T06:19:39.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 8849 7.45 MB/sec warmup 87 sec latency 55.229 ms 2024-08-31T06:19:39.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:39 smithi053 ceph-mon[18924]: pgmap v782: 97 pgs: 97 active+clean; 394 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 304 op/s 2024-08-31T06:19:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:39 smithi130 ceph-mon[22266]: pgmap v782: 97 pgs: 97 active+clean; 394 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 304 op/s 2024-08-31T06:19:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:39 smithi153 ceph-mon[22320]: pgmap v782: 97 pgs: 97 active+clean; 394 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 304 op/s 2024-08-31T06:19:40.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 9019 7.41 MB/sec warmup 88 sec latency 55.089 ms 2024-08-31T06:19:41.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 9238 7.47 MB/sec warmup 89 sec latency 53.349 ms 2024-08-31T06:19:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.429+0000 7fb5d3807640 1 -- 172.21.15.53:0/3220675665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc102f10 msgr2=0x7fb5cc103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.429+0000 7fb5d3807640 1 --2- 172.21.15.53:0/3220675665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc102f10 0x7fb5cc103320 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009900 tx=0x7fb5c802a410 comp rx=0 tx=0).stop 2024-08-31T06:19:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.430+0000 7fb5d3807640 1 -- 172.21.15.53:0/3220675665 shutdown_connections 2024-08-31T06:19:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.430+0000 7fb5d3807640 1 --2- 172.21.15.53:0/3220675665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc108a20 0x7fb5cc10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.430+0000 7fb5d3807640 1 --2- 172.21.15.53:0/3220675665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5cc1080d0 0x7fb5cc1084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.430+0000 7fb5d3807640 1 --2- 172.21.15.53:0/3220675665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc102f10 0x7fb5cc103320 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.430+0000 7fb5d3807640 1 -- 172.21.15.53:0/3220675665 >> 172.21.15.53:0/3220675665 conn(0x7fb5cc079c30 msgr2=0x7fb5cc07a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.430+0000 7fb5d3807640 1 -- 172.21.15.53:0/3220675665 shutdown_connections 2024-08-31T06:19:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.430+0000 7fb5d3807640 1 -- 172.21.15.53:0/3220675665 wait complete. 2024-08-31T06:19:41.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d3807640 1 Processor -- start 2024-08-31T06:19:41.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d3807640 1 -- start start 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d3807640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc102f10 0x7fb5cc109340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d3807640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5cc1080d0 0x7fb5cc109880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d3807640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc108a20 0x7fb5cc109dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d3807640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1125d0 con 0x7fb5cc102f10 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d3807640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc112450 con 0x7fb5cc108a20 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d3807640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc112750 con 0x7fb5cc1080d0 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d15a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc102f10 0x7fb5cc109340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d0da2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5cc1080d0 0x7fb5cc109880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d15a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc102f10 0x7fb5cc109340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45786/0 (socket says 172.21.15.53:45786) 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d15a3640 1 -- 172.21.15.53:0/2585458786 learned_addr learned my addr 172.21.15.53:0/2585458786 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.431+0000 7fb5d1da4640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc108a20 0x7fb5cc109dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5d1da4640 1 -- 172.21.15.53:0/2585458786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5cc1080d0 msgr2=0x7fb5cc109880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5d1da4640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5cc1080d0 0x7fb5cc109880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5d1da4640 1 -- 172.21.15.53:0/2585458786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc102f10 msgr2=0x7fb5cc109340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5d1da4640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc102f10 0x7fb5cc109340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5d1da4640 1 -- 172.21.15.53:0/2585458786 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc1a8450 con 0x7fb5cc108a20 2024-08-31T06:19:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc102f10 0x7fb5cc109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5d1da4640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc108a20 0x7fb5cc109dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009fd0 tx=0x7fb5c400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5c27fc640 1 -- 172.21.15.53:0/2585458786 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400ce20 con 0x7fb5cc108a20 2024-08-31T06:19:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5c27fc640 1 -- 172.21.15.53:0/2585458786 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5c4005020 con 0x7fb5cc108a20 2024-08-31T06:19:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5c27fc640 1 -- 172.21.15.53:0/2585458786 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4010690 con 0x7fb5cc108a20 2024-08-31T06:19:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5d3807640 1 -- 172.21.15.53:0/2585458786 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5cc1a8740 con 0x7fb5cc108a20 2024-08-31T06:19:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.432+0000 7fb5d3807640 1 -- 172.21.15.53:0/2585458786 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5cc1a8c40 con 0x7fb5cc108a20 2024-08-31T06:19:41.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5c27fc640 1 -- 172.21.15.53:0/2585458786 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb5c4004a40 con 0x7fb5cc108a20 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5da852740 1 Processor -- start 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5da852740 1 -- start start 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5da852740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 0x5589cafdcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5da852740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac102f0 0x5589cafdd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5da852740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac184d0 0x5589cafdd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5da852740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5589caf52000 con 0x5589cac184d0 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5da852740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5589caf41590 con 0x5589cac391b0 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5da852740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5589caf45540 con 0x5589cac102f0 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5d0da2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 0x5589cafdcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5d15a3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac102f0 0x5589cafdd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5d0da2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 0x5589cafdcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:41168/0 (socket says 172.21.15.53:41168) 2024-08-31T06:19:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.436+0000 7fb5d0da2640 1 -- 172.21.15.53:0/1109483004 learned_addr learned my addr 172.21.15.53:0/1109483004 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5d0da2640 1 --2- 172.21.15.53:0/1109483004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac184d0 0x5589cafdd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5d15a3640 1 -- 172.21.15.53:0/1109483004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 msgr2=0x5589cafdcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/1109483004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 0x5589cafdcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5c27fc640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5b80b4cd0 0x7fb5b80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5d15a3640 1 -- 172.21.15.53:0/1109483004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac184d0 msgr2=0x5589cafdd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/1109483004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac184d0 0x5589cafdd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5d15a3640 1 -- 172.21.15.53:0/1109483004 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589caca4790 con 0x5589cac102f0 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5d0da2640 1 --2- 172.21.15.53:0/1109483004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 0x5589cafdcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5d1da4640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5b80b4cd0 0x7fb5b80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/1109483004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac102f0 0x5589cafdd220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8006010 tx=0x7fb5c8004480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba775de67b90e496 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5c27fc640 1 -- 172.21.15.53:0/2585458786 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fb5c40e5bc0 con 0x7fb5cc108a20 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.437+0000 7fb5b77fe640 1 -- 172.21.15.53:0/1109483004 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8035040 con 0x5589cac102f0 2024-08-31T06:19:41.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.438+0000 7fb5b77fe640 1 -- 172.21.15.53:0/1109483004 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5c8003dc0 con 0x5589cac102f0 2024-08-31T06:19:41.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.438+0000 7fb5b77fe640 1 -- 172.21.15.53:0/1109483004 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c803cd70 con 0x5589cac102f0 2024-08-31T06:19:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5da852740 1 -- 172.21.15.53:0/1109483004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac102f0 msgr2=0x5589cafdd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5d1da4640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5b80b4cd0 0x7fb5b80b71e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40e33a0 tx=0x7fb5c4075400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5da852740 1 --2- 172.21.15.53:0/1109483004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac102f0 0x5589cafdd220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8006010 tx=0x7fb5c8004480 comp rx=0 tx=0).stop 2024-08-31T06:19:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5da852740 1 -- 172.21.15.53:0/1109483004 shutdown_connections 2024-08-31T06:19:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5da852740 1 --2- 172.21.15.53:0/1109483004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac184d0 0x5589cafdd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5da852740 1 --2- 172.21.15.53:0/1109483004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac102f0 0x5589cafdd220 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5da852740 1 --2- 172.21.15.53:0/1109483004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 0x5589cafdcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5da852740 1 -- 172.21.15.53:0/1109483004 >> 172.21.15.53:0/1109483004 conn(0x5589cac2d300 msgr2=0x5589cafdabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5da852740 1 -- 172.21.15.53:0/1109483004 shutdown_connections 2024-08-31T06:19:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5da852740 1 -- 172.21.15.53:0/1109483004 wait complete. 2024-08-31T06:19:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5da852740 1 -- start start 2024-08-31T06:19:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.439+0000 7fb5da852740 1 Processor -- start 2024-08-31T06:19:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5da852740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac102f0 0x5589cafe88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5da852740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 0x5589cafe8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5da852740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac391b0 0x5589caff4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5da852740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5589cae7aab0 con 0x5589cac391b0 2024-08-31T06:19:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5da852740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5589caec8680 con 0x5589cac102f0 2024-08-31T06:19:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5da852740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5589cafeb400 con 0x5589cac184d0 2024-08-31T06:19:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5da852740 10 client.0 _ll_register_callbacks cb 0x5589cac50a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5d0da2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac391b0 0x5589caff4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5d15a3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 0x5589cafe8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5d0da2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac391b0 0x5589caff4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45794/0 (socket says 172.21.15.53:45794) 2024-08-31T06:19:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5d15a3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 0x5589cafe8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:60728/0 (socket says 172.21.15.53:60728) 2024-08-31T06:19:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5d0da2640 1 -- 172.21.15.53:0/1155546714 learned_addr learned my addr 172.21.15.53:0/1155546714 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5d0da2640 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac102f0 0x5589cafe88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5d15a3640 1 -- 172.21.15.53:0/1155546714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac102f0 msgr2=0x5589cafe88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac102f0 0x5589cafe88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5d15a3640 1 -- 172.21.15.53:0/1155546714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac391b0 msgr2=0x5589caff4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac391b0 0x5589caff4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.440+0000 7fb5d15a3640 1 -- 172.21.15.53:0/1155546714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589cad1d620 con 0x5589cac184d0 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.441+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 0x5589cafe8e00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5589cafdb960 tx=0x7fb5c802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d58e2907fa1a5fdb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.441+0000 7fb5b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.441+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/1155546714 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c804d070 con 0x5589cac184d0 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.441+0000 7fb5da852740 1 -- 172.21.15.53:0/1155546714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5c8003dc0 con 0x5589cac184d0 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.441+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/1155546714 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fb5c803c850 con 0x5589cac184d0 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.441+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/1155546714 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fb5c8035040 con 0x5589cac184d0 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.441+0000 7fb5da852740 10 client.29155 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.441+0000 7fb5da852740 1 -- 172.21.15.53:0/1155546714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5589caff7470 con 0x5589cac184d0 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.441+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/1155546714 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5c8003dc0 con 0x5589cac184d0 2024-08-31T06:19:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.442+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/1155546714 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fb5c8031590 con 0x5589cac184d0 2024-08-31T06:19:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.442+0000 7fb5da852740 10 client.29155 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.442+0000 7fb5da852740 10 client.29155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.442+0000 7fb5da852740 20 client.29155 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.442+0000 7fb5da852740 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589cabf7d80 0x5589caffa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.442+0000 7fb5da852740 4 client.29155 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.442+0000 7fb5da852740 1 -- 172.21.15.53:0/1155546714 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589caf53f50 con 0x5589cabf7d80 2024-08-31T06:19:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.442+0000 7fb5d0da2640 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589cabf7d80 0x5589caffa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.443+0000 7fb5d0da2640 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589cabf7d80 0x5589caffa7d0 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1079f8eaada245d6 server_cookie=6fb38161251c12c in_seq=0 out_seq=0 2024-08-31T06:19:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.443+0000 7fb5b4ff9640 10 client.29155 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.443+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/1155546714 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589caf53f50 con 0x5589cabf7d80 2024-08-31T06:19:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.443+0000 7fb5b4ff9640 10 client.29155 handle_command_reply: tid=0 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.443+0000 7fb5da852740 1 client.29155 shutdown 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5da852740 1 -- 172.21.15.53:0/1155546714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 msgr2=0x5589cafe8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5da852740 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 0x5589cafe8e00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5589cafdb960 tx=0x7fb5c802a410 comp rx=0 tx=0).stop 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5da852740 1 -- 172.21.15.53:0/1155546714 shutdown_connections 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5da852740 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589cabf7d80 0x5589caffa7d0 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5da852740 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac391b0 0x5589caff4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5da852740 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 0x5589cafe8e00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5da852740 1 --2- 172.21.15.53:0/1155546714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac102f0 0x5589cafe88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5da852740 1 -- 172.21.15.53:0/1155546714 >> 172.21.15.53:0/1155546714 conn(0x5589cac2d300 msgr2=0x5589cafddd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5b4ff9640 0 client.29155 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5da852740 1 -- 172.21.15.53:0/1155546714 shutdown_connections 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5da852740 1 -- 172.21.15.53:0/1155546714 wait complete. 2024-08-31T06:19:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.444+0000 7fb5da852740 20 client.29155 trim_cache size 0 max 16384 2024-08-31T06:19:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.465+0000 7fb5da852740 1 Processor -- start 2024-08-31T06:19:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.465+0000 7fb5da852740 1 -- start start 2024-08-31T06:19:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.465+0000 7fb5da852740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 0x5589cafde420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.465+0000 7fb5da852740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac184d0 0x5589cafe8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.465+0000 7fb5da852740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac391b0 0x5589caff4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.465+0000 7fb5da852740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1b1630 con 0x5589cac102f0 2024-08-31T06:19:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.465+0000 7fb5d0da2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 0x5589cafde420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.465+0000 7fb5d0da2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 0x5589cafde420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45800/0 (socket says 172.21.15.53:45800) 2024-08-31T06:19:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.465+0000 7fb5d0da2640 1 -- 172.21.15.53:0/1882411038 learned_addr learned my addr 172.21.15.53:0/1882411038 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.465+0000 7fb5da852740 1 -- 172.21.15.53:0/1882411038 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1b33b0 con 0x5589cac184d0 2024-08-31T06:19:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.465+0000 7fb5da852740 1 -- 172.21.15.53:0/1882411038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1b1d00 con 0x5589cac391b0 2024-08-31T06:19:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.466+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/1882411038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac184d0 0x5589cafe8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.466+0000 7fb5d0da2640 1 --2- 172.21.15.53:0/1882411038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac391b0 0x5589caff4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.466+0000 7fb5d15a3640 1 -- 172.21.15.53:0/1882411038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac391b0 msgr2=0x5589caff4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.466+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/1882411038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac391b0 0x5589caff4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.466+0000 7fb5d15a3640 1 -- 172.21.15.53:0/1882411038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 msgr2=0x5589cafde420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.466+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/1882411038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 0x5589cafde420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.466+0000 7fb5d15a3640 1 -- 172.21.15.53:0/1882411038 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589caff5790 con 0x5589cac184d0 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.466+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/1882411038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac184d0 0x5589cafe8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb5c802a9d0 tx=0x7fb5c8004480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca18d4769fe96d8b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.467+0000 7fb5b6ffd640 1 -- 172.21.15.53:0/1882411038 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c804d040 con 0x5589cac184d0 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.467+0000 7fb5b6ffd640 1 -- 172.21.15.53:0/1882411038 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5c8031400 con 0x5589cac184d0 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.467+0000 7fb5b6ffd640 1 -- 172.21.15.53:0/1882411038 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8003be0 con 0x5589cac184d0 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.467+0000 7fb5da852740 1 -- 172.21.15.53:0/1882411038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac184d0 msgr2=0x5589cafe8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.468+0000 7fb5da852740 1 --2- 172.21.15.53:0/1882411038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac184d0 0x5589cafe8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb5c802a9d0 tx=0x7fb5c8004480 comp rx=0 tx=0).stop 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.468+0000 7fb5da852740 1 -- 172.21.15.53:0/1882411038 shutdown_connections 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.468+0000 7fb5da852740 1 --2- 172.21.15.53:0/1882411038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac391b0 0x5589caff4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.468+0000 7fb5da852740 1 --2- 172.21.15.53:0/1882411038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac184d0 0x5589cafe8b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.468+0000 7fb5da852740 1 --2- 172.21.15.53:0/1882411038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 0x5589cafde420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.468+0000 7fb5da852740 1 -- 172.21.15.53:0/1882411038 >> 172.21.15.53:0/1882411038 conn(0x5589cac2d300 msgr2=0x5589cafddd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.468+0000 7fb5da852740 1 -- 172.21.15.53:0/1882411038 shutdown_connections 2024-08-31T06:19:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.468+0000 7fb5da852740 1 -- 172.21.15.53:0/1882411038 wait complete. 2024-08-31T06:19:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.468+0000 7fb5da852740 1 -- start start 2024-08-31T06:19:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.468+0000 7fb5da852740 1 Processor -- start 2024-08-31T06:19:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5da852740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 0x5589caffaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5da852740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 0x5589caffb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5da852740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 0x5589cb073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5da852740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1b2c20 con 0x5589cac102f0 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5da852740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1b2490 con 0x5589cac391b0 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5da852740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc1af630 con 0x5589cac184d0 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5da852740 10 client.0 _ll_register_callbacks cb 0x7fb5bc009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d0da2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 0x5589caffaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d0da2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 0x5589caffaee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45808/0 (socket says 172.21.15.53:45808) 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d0da2640 1 -- 172.21.15.53:0/3445983200 learned_addr learned my addr 172.21.15.53:0/3445983200 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 0x5589caffb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d0da2640 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 0x5589cb073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d0da2640 1 -- 172.21.15.53:0/3445983200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 msgr2=0x5589caffb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d0da2640 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 0x5589caffb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d0da2640 1 -- 172.21.15.53:0/3445983200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 msgr2=0x5589cb073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d0da2640 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 0x5589cb073f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d0da2640 1 -- 172.21.15.53:0/3445983200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589cb074490 con 0x5589cac102f0 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 0x5589caffb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5d0da2640 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 0x5589caffaee0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc011420 tx=0x7fb5bc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e18b615b85ec54 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.469+0000 7fb5b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/3445983200 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0037f0 con 0x5589cac102f0 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/3445983200 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fb5bc003990 con 0x5589cac102f0 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5da852740 1 -- 172.21.15.53:0/3445983200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5c8031400 con 0x5589cac102f0 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/3445983200 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fb5bc003b90 con 0x5589cac102f0 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5da852740 10 client.20190 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5da852740 1 -- 172.21.15.53:0/3445983200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5589cb075780 con 0x5589cac102f0 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/3445983200 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5c8031400 con 0x5589cac102f0 2024-08-31T06:19:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/3445983200 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fb5bc020040 con 0x5589cac102f0 2024-08-31T06:19:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5da852740 10 client.20190 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5da852740 10 client.20190 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5da852740 20 client.20190 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5da852740 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589cabcd1c0 0x5589cb078030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5da852740 4 client.20190 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:19:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.470+0000 7fb5da852740 1 -- 172.21.15.53:0/3445983200 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5589caf4f9f0 con 0x5589cabcd1c0 2024-08-31T06:19:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.471+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589cabcd1c0 0x5589cb078030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.471+0000 7fb5b4ff9640 10 client.20190 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.471+0000 7fb5d15a3640 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589cabcd1c0 0x5589cb078030 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=317c6c8df984c11b server_cookie=1fd97bad7f28f1a in_seq=0 out_seq=0 2024-08-31T06:19:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.551+0000 7fb5b4ff9640 1 -- 172.21.15.53:0/3445983200 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5589caf4f9f0 con 0x5589cabcd1c0 2024-08-31T06:19:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.551+0000 7fb5b4ff9640 10 client.20190 handle_command_reply: tid=0 2024-08-31T06:19:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.551+0000 7fb5da852740 1 client.20190 shutdown 2024-08-31T06:19:41.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.551+0000 7fb5da852740 1 -- 172.21.15.53:0/3445983200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 msgr2=0x5589caffaee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:41.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.551+0000 7fb5da852740 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 0x5589caffaee0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc011420 tx=0x7fb5bc005f90 comp rx=0 tx=0).stop 2024-08-31T06:19:41.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.552+0000 7fb5da852740 1 -- 172.21.15.53:0/3445983200 shutdown_connections 2024-08-31T06:19:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.552+0000 7fb5da852740 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589cabcd1c0 0x5589cb078030 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.552+0000 7fb5da852740 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589cac391b0 0x5589cb073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.552+0000 7fb5da852740 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589cac184d0 0x5589caffb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.552+0000 7fb5da852740 1 --2- 172.21.15.53:0/3445983200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589cac102f0 0x5589caffaee0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.552+0000 7fb5da852740 1 -- 172.21.15.53:0/3445983200 >> 172.21.15.53:0/3445983200 conn(0x5589cac2d300 msgr2=0x5589cafe9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.552+0000 7fb5b4ff9640 0 client.20190 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.552+0000 7fb5da852740 1 -- 172.21.15.53:0/3445983200 shutdown_connections 2024-08-31T06:19:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.552+0000 7fb5da852740 1 -- 172.21.15.53:0/3445983200 wait complete. 2024-08-31T06:19:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.552+0000 7fb5da852740 20 client.20190 trim_cache size 0 max 16384 2024-08-31T06:19:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:19:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:19:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:19:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:19:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.553+0000 7fb5d3807640 1 -- 172.21.15.53:0/2585458786 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5b80b4cd0 msgr2=0x7fb5b80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.553+0000 7fb5d3807640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5b80b4cd0 0x7fb5b80b71e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40e33a0 tx=0x7fb5c4075400 comp rx=0 tx=0).stop 2024-08-31T06:19:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.553+0000 7fb5d3807640 1 -- 172.21.15.53:0/2585458786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc108a20 msgr2=0x7fb5cc109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.553+0000 7fb5d3807640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc108a20 0x7fb5cc109dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009fd0 tx=0x7fb5c400ef10 comp rx=0 tx=0).stop 2024-08-31T06:19:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.553+0000 7fb5d3807640 1 -- 172.21.15.53:0/2585458786 shutdown_connections 2024-08-31T06:19:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.553+0000 7fb5d3807640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5b80b4cd0 0x7fb5b80b71e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.553+0000 7fb5d3807640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5cc108a20 0x7fb5cc109dc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.553+0000 7fb5d3807640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5cc1080d0 0x7fb5cc109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.553+0000 7fb5d3807640 1 --2- 172.21.15.53:0/2585458786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5cc102f10 0x7fb5cc109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.553+0000 7fb5d3807640 1 -- 172.21.15.53:0/2585458786 >> 172.21.15.53:0/2585458786 conn(0x7fb5cc079c30 msgr2=0x7fb5cc101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.553+0000 7fb5d3807640 1 -- 172.21.15.53:0/2585458786 shutdown_connections 2024-08-31T06:19:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:41.554+0000 7fb5d3807640 1 -- 172.21.15.53:0/2585458786 wait complete. 2024-08-31T06:19:41.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:41 smithi053 ceph-mon[18924]: pgmap v783: 97 pgs: 97 active+clean; 392 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 329 op/s 2024-08-31T06:19:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:41 smithi130 ceph-mon[22266]: pgmap v783: 97 pgs: 97 active+clean; 392 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 329 op/s 2024-08-31T06:19:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:41 smithi153 ceph-mon[22320]: pgmap v783: 97 pgs: 97 active+clean; 392 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 329 op/s 2024-08-31T06:19:42.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 9412 7.43 MB/sec warmup 90 sec latency 129.426 ms 2024-08-31T06:19:43.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 9568 7.44 MB/sec warmup 91 sec latency 78.939 ms 2024-08-31T06:19:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:43 smithi053 ceph-mon[18924]: pgmap v784: 97 pgs: 97 active+clean; 394 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 285 op/s 2024-08-31T06:19:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:43 smithi130 ceph-mon[22266]: pgmap v784: 97 pgs: 97 active+clean; 394 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 285 op/s 2024-08-31T06:19:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:43 smithi153 ceph-mon[22320]: pgmap v784: 97 pgs: 97 active+clean; 394 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 285 op/s 2024-08-31T06:19:44.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 9718 7.44 MB/sec warmup 92 sec latency 63.107 ms 2024-08-31T06:19:45.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 9915 7.58 MB/sec warmup 93 sec latency 62.352 ms 2024-08-31T06:19:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:45 smithi130 ceph-mon[22266]: pgmap v785: 97 pgs: 97 active+clean; 397 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 322 op/s 2024-08-31T06:19:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:45 smithi153 ceph-mon[22320]: pgmap v785: 97 pgs: 97 active+clean; 397 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 322 op/s 2024-08-31T06:19:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:45 smithi053 ceph-mon[18924]: pgmap v785: 97 pgs: 97 active+clean; 397 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 322 op/s 2024-08-31T06:19:46.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 10101 7.62 MB/sec warmup 94 sec latency 75.356 ms 2024-08-31T06:19:47.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 10296 7.68 MB/sec warmup 95 sec latency 140.519 ms 2024-08-31T06:19:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:47 smithi130 ceph-mon[22266]: pgmap v786: 97 pgs: 97 active+clean; 399 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 349 op/s 2024-08-31T06:19:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:47 smithi153 ceph-mon[22320]: pgmap v786: 97 pgs: 97 active+clean; 399 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 349 op/s 2024-08-31T06:19:48.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:47 smithi053 ceph-mon[18924]: pgmap v786: 97 pgs: 97 active+clean; 399 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 349 op/s 2024-08-31T06:19:48.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 10473 7.70 MB/sec warmup 96 sec latency 56.342 ms 2024-08-31T06:19:49.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 10612 7.68 MB/sec warmup 97 sec latency 73.168 ms 2024-08-31T06:19:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:49 smithi130 ceph-mon[22266]: pgmap v787: 97 pgs: 97 active+clean; 404 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 322 op/s 2024-08-31T06:19:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:49 smithi153 ceph-mon[22320]: pgmap v787: 97 pgs: 97 active+clean; 404 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 322 op/s 2024-08-31T06:19:50.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:49 smithi053 ceph-mon[18924]: pgmap v787: 97 pgs: 97 active+clean; 404 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 322 op/s 2024-08-31T06:19:50.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 10775 7.72 MB/sec warmup 98 sec latency 82.366 ms 2024-08-31T06:19:51.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 10935 7.76 MB/sec warmup 99 sec latency 69.083 ms 2024-08-31T06:19:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:51 smithi130 ceph-mon[22266]: pgmap v788: 97 pgs: 97 active+clean; 414 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.9 MiB/s wr, 315 op/s 2024-08-31T06:19:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:51 smithi153 ceph-mon[22320]: pgmap v788: 97 pgs: 97 active+clean; 414 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.9 MiB/s wr, 315 op/s 2024-08-31T06:19:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:51 smithi053 ceph-mon[18924]: pgmap v788: 97 pgs: 97 active+clean; 414 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.9 MiB/s wr, 315 op/s 2024-08-31T06:19:52.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 11075 7.75 MB/sec warmup 100 sec latency 52.648 ms 2024-08-31T06:19:53.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:52 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:19:53.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:52 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:19:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:52 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:19:53.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 11236 7.81 MB/sec warmup 101 sec latency 73.933 ms 2024-08-31T06:19:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:53 smithi130 ceph-mon[22266]: pgmap v789: 97 pgs: 97 active+clean; 418 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.9 MiB/s wr, 284 op/s 2024-08-31T06:19:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:19:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:19:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:19:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:53 smithi153 ceph-mon[22320]: pgmap v789: 97 pgs: 97 active+clean; 418 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.9 MiB/s wr, 284 op/s 2024-08-31T06:19:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:19:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:19:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:19:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:53 smithi053 ceph-mon[18924]: pgmap v789: 97 pgs: 97 active+clean; 418 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.9 MiB/s wr, 284 op/s 2024-08-31T06:19:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:19:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:19:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:19:54.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 11377 7.77 MB/sec warmup 102 sec latency 60.690 ms 2024-08-31T06:19:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.694+0000 7f1b086bd640 1 -- 172.21.15.53:0/1394944466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b00102750 msgr2=0x7f1b00102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.694+0000 7f1b086bd640 1 --2- 172.21.15.53:0/1394944466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b00102750 0x7f1b00102b60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009900 tx=0x7f1afc02a410 comp rx=0 tx=0).stop 2024-08-31T06:19:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.694+0000 7f1b086bd640 1 -- 172.21.15.53:0/1394944466 shutdown_connections 2024-08-31T06:19:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.694+0000 7f1b086bd640 1 --2- 172.21.15.53:0/1394944466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b001089d0 0x7f1b0010f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.694+0000 7f1b086bd640 1 --2- 172.21.15.53:0/1394944466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b00108080 0x7f1b00108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.694+0000 7f1b086bd640 1 --2- 172.21.15.53:0/1394944466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b00102750 0x7f1b00102b60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.694+0000 7f1b086bd640 1 -- 172.21.15.53:0/1394944466 >> 172.21.15.53:0/1394944466 conn(0x7f1b0007a4e0 msgr2=0x7f1b0007a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.695+0000 7f1b086bd640 1 -- 172.21.15.53:0/1394944466 shutdown_connections 2024-08-31T06:19:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.695+0000 7f1b086bd640 1 -- 172.21.15.53:0/1394944466 wait complete. 2024-08-31T06:19:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.695+0000 7f1b086bd640 1 Processor -- start 2024-08-31T06:19:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b086bd640 1 -- start start 2024-08-31T06:19:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b086bd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b00102750 0x7f1b000ff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b086bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b00108080 0x7f1b000ff830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b086bd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b001089d0 0x7f1b000ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b086bd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1b001125a0 con 0x7f1b00108080 2024-08-31T06:19:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b086bd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b00112420 con 0x7f1b001089d0 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b086bd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1b00112720 con 0x7f1b00102750 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b05c58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b00108080 0x7f1b000ff830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b05c58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b00108080 0x7f1b000ff830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39270/0 (socket says 172.21.15.53:39270) 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b05c58640 1 -- 172.21.15.53:0/2501599259 learned_addr learned my addr 172.21.15.53:0/2501599259 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b001089d0 0x7f1b000ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b06459640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b00102750 0x7f1b000ff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b05c58640 1 -- 172.21.15.53:0/2501599259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b00102750 msgr2=0x7f1b000ff2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b05c58640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b00102750 0x7f1b000ff2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b05c58640 1 -- 172.21.15.53:0/2501599259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b001089d0 msgr2=0x7f1b000ffd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b05c58640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b001089d0 0x7f1b000ffd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.696+0000 7f1b05c58640 1 -- 172.21.15.53:0/2501599259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b001a83c0 con 0x7f1b00108080 2024-08-31T06:19:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.697+0000 7f1b05c58640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b00108080 0x7f1b000ff830 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f1af000e9f0 tx=0x7f1af000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.697+0000 7f1af77fe640 1 -- 172.21.15.53:0/2501599259 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af000ccc0 con 0x7f1b00108080 2024-08-31T06:19:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.697+0000 7f1b086bd640 1 -- 172.21.15.53:0/2501599259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b001a86b0 con 0x7f1b00108080 2024-08-31T06:19:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.697+0000 7f1af77fe640 1 -- 172.21.15.53:0/2501599259 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1af00108c0 con 0x7f1b00108080 2024-08-31T06:19:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.697+0000 7f1b086bd640 1 -- 172.21.15.53:0/2501599259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b001a8c50 con 0x7f1b00108080 2024-08-31T06:19:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.697+0000 7f1af77fe640 1 -- 172.21.15.53:0/2501599259 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0018660 con 0x7f1b00108080 2024-08-31T06:19:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.700+0000 7f1b0f625740 1 Processor -- start 2024-08-31T06:19:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1b0f625740 1 -- start start 2024-08-31T06:19:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daeeac1b0 0x563daf24fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee832f0 0x563daf250000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 0x563daf250540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1b0f625740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563daf1c5000 con 0x563daee8b4d0 2024-08-31T06:19:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1b0f625740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563daf1b4590 con 0x563daeeac1b0 2024-08-31T06:19:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1b0f625740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563daf1b8540 con 0x563daee832f0 2024-08-31T06:19:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1b06c5a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daeeac1b0 0x563daf24fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1b06459640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee832f0 0x563daf250000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1b06c5a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daeeac1b0 0x563daf24fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39392/0 (socket says 172.21.15.53:39392) 2024-08-31T06:19:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1b06c5a640 1 -- 172.21.15.53:0/3827766485 learned_addr learned my addr 172.21.15.53:0/3827766485 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.701+0000 7f1af77fe640 1 -- 172.21.15.53:0/2501599259 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1af0018900 con 0x7f1b00108080 2024-08-31T06:19:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.702+0000 7f1b05c58640 1 --2- 172.21.15.53:0/3827766485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 0x563daf250540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.702+0000 7f1b06459640 1 -- 172.21.15.53:0/3827766485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daeeac1b0 msgr2=0x563daf24fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.702+0000 7f1b06459640 1 --2- 172.21.15.53:0/3827766485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daeeac1b0 0x563daf24fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.702+0000 7f1b06459640 1 -- 172.21.15.53:0/3827766485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 msgr2=0x563daf250540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.702+0000 7f1b06459640 1 --2- 172.21.15.53:0/3827766485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 0x563daf250540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.702+0000 7f1b06459640 1 -- 172.21.15.53:0/3827766485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563daef17790 con 0x563daee832f0 2024-08-31T06:19:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.702+0000 7f1b05c58640 1 --2- 172.21.15.53:0/3827766485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 0x563daf250540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:19:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.703+0000 7f1af77fe640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1aec0b4d50 0x7f1aec0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.703+0000 7f1b06459640 1 --2- 172.21.15.53:0/3827766485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee832f0 0x563daf250000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009230 tx=0x7f1afc005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d512de723f63226 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.703+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1aec0b4d50 0x7f1aec0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.703+0000 7f1af77fe640 1 -- 172.21.15.53:0/2501599259 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f1af00e5960 con 0x7f1b00108080 2024-08-31T06:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.703+0000 7f1af4bfe640 1 -- 172.21.15.53:0/3827766485 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc035040 con 0x563daee832f0 2024-08-31T06:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.703+0000 7f1af4bfe640 1 -- 172.21.15.53:0/3827766485 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1afc004450 con 0x563daee832f0 2024-08-31T06:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.703+0000 7f1af4bfe640 1 -- 172.21.15.53:0/3827766485 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0035f0 con 0x563daee832f0 2024-08-31T06:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.704+0000 7f1b0f625740 1 -- 172.21.15.53:0/3827766485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee832f0 msgr2=0x563daf250000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.704+0000 7f1b0f625740 1 --2- 172.21.15.53:0/3827766485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee832f0 0x563daf250000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009230 tx=0x7f1afc005fd0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.704+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1aec0b4d50 0x7f1aec0b7260 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1af80116b0 tx=0x7f1af8009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.704+0000 7f1b0f625740 1 -- 172.21.15.53:0/3827766485 shutdown_connections 2024-08-31T06:19:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.704+0000 7f1b0f625740 1 --2- 172.21.15.53:0/3827766485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 0x563daf250540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.704+0000 7f1b0f625740 1 --2- 172.21.15.53:0/3827766485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee832f0 0x563daf250000 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.704+0000 7f1b0f625740 1 --2- 172.21.15.53:0/3827766485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daeeac1b0 0x563daf24fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.704+0000 7f1b0f625740 1 -- 172.21.15.53:0/3827766485 >> 172.21.15.53:0/3827766485 conn(0x563daeea0300 msgr2=0x563daf24d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.704+0000 7f1b0f625740 1 -- 172.21.15.53:0/3827766485 shutdown_connections 2024-08-31T06:19:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.704+0000 7f1b0f625740 1 -- 172.21.15.53:0/3827766485 wait complete. 2024-08-31T06:19:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.705+0000 7f1b0f625740 1 -- start start 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.705+0000 7f1b0f625740 1 Processor -- start 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.705+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee832f0 0x563daf25b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.705+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee8b4d0 0x563daf25bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.705+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daeeac1b0 0x563daf2674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b0f625740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563daf0edab0 con 0x563daee832f0 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b06459640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee832f0 0x563daf25b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b05c58640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee8b4d0 0x563daf25bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b05c58640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee8b4d0 0x563daf25bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39408/0 (socket says 172.21.15.53:39408) 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b05c58640 1 -- 172.21.15.53:0/2465447980 learned_addr learned my addr 172.21.15.53:0/2465447980 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b06459640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee832f0 0x563daf25b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39300/0 (socket says 172.21.15.53:39300) 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b0f625740 1 -- 172.21.15.53:0/2465447980 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563daf13b680 con 0x563daee8b4d0 2024-08-31T06:19:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b0f625740 1 -- 172.21.15.53:0/2465447980 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563daf25e1e0 con 0x563daeeac1b0 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daeeac1b0 0x563daf2674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b0f625740 10 client.0 _ll_register_callbacks cb 0x563daeec3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b06c5a640 1 -- 172.21.15.53:0/2465447980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee8b4d0 msgr2=0x563daf25bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee8b4d0 0x563daf25bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b06c5a640 1 -- 172.21.15.53:0/2465447980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee832f0 msgr2=0x563daf25b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee832f0 0x563daf25b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b06c5a640 1 -- 172.21.15.53:0/2465447980 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563daef90620 con 0x563daeeac1b0 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daeeac1b0 0x563daf2674d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1af8011f40 tx=0x7f1af8004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6c2bd6d5b3c40c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.706+0000 7f1ae9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.707+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/2465447980 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8003c40 con 0x563daeeac1b0 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.707+0000 7f1b0f625740 1 -- 172.21.15.53:0/2465447980 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1afc004450 con 0x563daeeac1b0 2024-08-31T06:19:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.707+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/2465447980 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f1af8003de0 con 0x563daeeac1b0 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.707+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/2465447980 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f1af8004050 con 0x563daeeac1b0 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.707+0000 7f1b0f625740 10 client.29173 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.707+0000 7f1b0f625740 1 -- 172.21.15.53:0/2465447980 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x563daf272ac0 con 0x563daeeac1b0 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.707+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/2465447980 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1afc004450 con 0x563daeeac1b0 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.707+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/2465447980 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f1af8026070 con 0x563daeeac1b0 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.707+0000 7f1b0f625740 10 client.29173 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.707+0000 7f1b0f625740 10 client.29173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.708+0000 7f1b0f625740 20 client.29173 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.708+0000 7f1b0f625740 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563daee6ad80 0x563daf276130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.708+0000 7f1b0f625740 4 client.29173 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.708+0000 7f1b0f625740 1 -- 172.21.15.53:0/2465447980 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563daf1c6f50 con 0x563daee6ad80 2024-08-31T06:19:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.708+0000 7f1b06459640 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563daee6ad80 0x563daf276130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.708+0000 7f1ae9ffb640 10 client.29173 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.708+0000 7f1b06459640 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563daee6ad80 0x563daf276130 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ded521ad79f5638 server_cookie=aa154e89115b8a41 in_seq=0 out_seq=0 2024-08-31T06:19:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.709+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/2465447980 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563daf1c6f50 con 0x563daee6ad80 2024-08-31T06:19:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.709+0000 7f1ae9ffb640 10 client.29173 handle_command_reply: tid=0 2024-08-31T06:19:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.709+0000 7f1b0f625740 1 client.29173 shutdown 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.709+0000 7f1b0f625740 1 -- 172.21.15.53:0/2465447980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daeeac1b0 msgr2=0x563daf2674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.709+0000 7f1b0f625740 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daeeac1b0 0x563daf2674d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1af8011f40 tx=0x7f1af8004ab0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.709+0000 7f1b0f625740 1 -- 172.21.15.53:0/2465447980 shutdown_connections 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.709+0000 7f1b0f625740 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563daee6ad80 0x563daf276130 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.710+0000 7f1b0f625740 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daeeac1b0 0x563daf2674d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.710+0000 7f1ae9ffb640 0 client.29173 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.710+0000 7f1b0f625740 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee8b4d0 0x563daf25bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.710+0000 7f1b0f625740 1 --2- 172.21.15.53:0/2465447980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee832f0 0x563daf25b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.710+0000 7f1b0f625740 1 -- 172.21.15.53:0/2465447980 >> 172.21.15.53:0/2465447980 conn(0x563daeea0300 msgr2=0x563daf250af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.710+0000 7f1b0f625740 1 -- 172.21.15.53:0/2465447980 shutdown_connections 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.710+0000 7f1b0f625740 1 -- 172.21.15.53:0/2465447980 wait complete. 2024-08-31T06:19:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.710+0000 7f1b0f625740 20 client.29173 trim_cache size 0 max 16384 2024-08-31T06:19:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b0f625740 1 Processor -- start 2024-08-31T06:19:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b0f625740 1 -- start start 2024-08-31T06:19:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee6ad80 0x563daf254bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee832f0 0x563daf255130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 0x563daf2586a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b0f625740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1b001ad410 con 0x563daee8b4d0 2024-08-31T06:19:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b0f625740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b001af190 con 0x563daee832f0 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b0f625740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1b001adae0 con 0x563daee6ad80 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b06c5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 0x563daf2586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b06c5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 0x563daf2586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39316/0 (socket says 172.21.15.53:39316) 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b06c5a640 1 -- 172.21.15.53:0/463276597 learned_addr learned my addr 172.21.15.53:0/463276597 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.731+0000 7f1b06459640 1 --2- 172.21.15.53:0/463276597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee6ad80 0x563daf254bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.732+0000 7f1b05c58640 1 --2- 172.21.15.53:0/463276597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee832f0 0x563daf255130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.732+0000 7f1b06c5a640 1 -- 172.21.15.53:0/463276597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee6ad80 msgr2=0x563daf254bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.732+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/463276597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee6ad80 0x563daf254bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.732+0000 7f1b06c5a640 1 -- 172.21.15.53:0/463276597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee832f0 msgr2=0x563daf255130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.732+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/463276597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee832f0 0x563daf255130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.732+0000 7f1b06c5a640 1 -- 172.21.15.53:0/463276597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563daf2599b0 con 0x563daee8b4d0 2024-08-31T06:19:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.732+0000 7f1b06459640 1 --2- 172.21.15.53:0/463276597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee6ad80 0x563daf254bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.732+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/463276597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 0x563daf2586a0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f1af800f6d0 tx=0x7f1af8005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fc1e17a64c056 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.732+0000 7f1aebfff640 1 -- 172.21.15.53:0/463276597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8003e40 con 0x563daee8b4d0 2024-08-31T06:19:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.733+0000 7f1aebfff640 1 -- 172.21.15.53:0/463276597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1af801f040 con 0x563daee8b4d0 2024-08-31T06:19:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.733+0000 7f1aebfff640 1 -- 172.21.15.53:0/463276597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8004550 con 0x563daee8b4d0 2024-08-31T06:19:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.734+0000 7f1b0f625740 1 -- 172.21.15.53:0/463276597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 msgr2=0x563daf2586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.734+0000 7f1b0f625740 1 --2- 172.21.15.53:0/463276597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 0x563daf2586a0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f1af800f6d0 tx=0x7f1af8005f50 comp rx=0 tx=0).stop 2024-08-31T06:19:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.734+0000 7f1b0f625740 1 -- 172.21.15.53:0/463276597 shutdown_connections 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.734+0000 7f1b0f625740 1 --2- 172.21.15.53:0/463276597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee8b4d0 0x563daf2586a0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.734+0000 7f1b0f625740 1 --2- 172.21.15.53:0/463276597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee832f0 0x563daf255130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.734+0000 7f1b0f625740 1 --2- 172.21.15.53:0/463276597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee6ad80 0x563daf254bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.734+0000 7f1b0f625740 1 -- 172.21.15.53:0/463276597 >> 172.21.15.53:0/463276597 conn(0x563daeea0300 msgr2=0x563daf256640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.734+0000 7f1b0f625740 1 -- 172.21.15.53:0/463276597 shutdown_connections 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.734+0000 7f1b0f625740 1 -- 172.21.15.53:0/463276597 wait complete. 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.734+0000 7f1b0f625740 1 -- start start 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b0f625740 1 Processor -- start 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee6ad80 0x563daf261650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee832f0 0x563daf261b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b0f625740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee8b4d0 0x563daf262110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b0f625740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1b001aea00 con 0x563daee6ad80 2024-08-31T06:19:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b0f625740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b001ae270 con 0x563daee832f0 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b0f625740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1b001ab430 con 0x563daee8b4d0 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b0f625740 10 client.0 _ll_register_callbacks cb 0x7f1af8009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b06459640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee6ad80 0x563daf261650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b06459640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee6ad80 0x563daf261650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39322/0 (socket says 172.21.15.53:39322) 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b06459640 1 -- 172.21.15.53:0/16157090 learned_addr learned my addr 172.21.15.53:0/16157090 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b05c58640 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee832f0 0x563daf261b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.735+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee8b4d0 0x563daf262110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1b05c58640 1 -- 172.21.15.53:0/16157090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee8b4d0 msgr2=0x563daf262110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1b05c58640 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee8b4d0 0x563daf262110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1b05c58640 1 -- 172.21.15.53:0/16157090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee6ad80 msgr2=0x563daf261650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1b05c58640 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee6ad80 0x563daf261650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1b05c58640 1 -- 172.21.15.53:0/16157090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563daf2dfd50 con 0x563daee832f0 2024-08-31T06:19:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1b06459640 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee6ad80 0x563daf261650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1b06c5a640 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee8b4d0 0x563daf262110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1b05c58640 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee832f0 0x563daf261b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1af00abd80 tx=0x7f1af00abb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f9133826d571a71 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1ae9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:19:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/16157090 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af00b52f0 con 0x563daee832f0 2024-08-31T06:19:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1b0f625740 1 -- 172.21.15.53:0/16157090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1af801f040 con 0x563daee832f0 2024-08-31T06:19:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/16157090 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f1af00b3bc0 con 0x563daee832f0 2024-08-31T06:19:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/16157090 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f1af00b3dc0 con 0x563daee832f0 2024-08-31T06:19:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1b0f625740 10 client.29171 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.736+0000 7f1b0f625740 1 -- 172.21.15.53:0/16157090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x563daf2e1090 con 0x563daee832f0 2024-08-31T06:19:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.737+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/16157090 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1af801f040 con 0x563daee832f0 2024-08-31T06:19:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.737+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/16157090 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f1af00ab470 con 0x563daee832f0 2024-08-31T06:19:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.737+0000 7f1b0f625740 10 client.29171 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.737+0000 7f1b0f625740 10 client.29171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.737+0000 7f1b0f625740 20 client.29171 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.737+0000 7f1b0f625740 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563daeeac1b0 0x563daf2e3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.737+0000 7f1b0f625740 4 client.29171 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:19:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.737+0000 7f1b0f625740 1 -- 172.21.15.53:0/16157090 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563daf1c29f0 con 0x563daeeac1b0 2024-08-31T06:19:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.737+0000 7f1b06459640 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563daeeac1b0 0x563daf2e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.738+0000 7f1b06459640 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563daeeac1b0 0x563daf2e3880 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91fe59d85b822361 server_cookie=4255c92d12bffc0 in_seq=0 out_seq=0 2024-08-31T06:19:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.738+0000 7f1ae9ffb640 10 client.29171 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:54.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.819+0000 7f1ae9ffb640 1 -- 172.21.15.53:0/16157090 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563daf1c29f0 con 0x563daeeac1b0 2024-08-31T06:19:54.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.819+0000 7f1ae9ffb640 10 client.29171 handle_command_reply: tid=0 2024-08-31T06:19:54.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.819+0000 7f1b0f625740 1 client.29171 shutdown 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.819+0000 7f1b0f625740 1 -- 172.21.15.53:0/16157090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee832f0 msgr2=0x563daf261b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.819+0000 7f1b0f625740 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee832f0 0x563daf261b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1af00abd80 tx=0x7f1af00abb90 comp rx=0 tx=0).stop 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.819+0000 7f1b0f625740 1 -- 172.21.15.53:0/16157090 shutdown_connections 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.819+0000 7f1b0f625740 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563daeeac1b0 0x563daf2e3880 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.820+0000 7f1ae9ffb640 0 client.29171 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.820+0000 7f1b0f625740 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563daee8b4d0 0x563daf262110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.820+0000 7f1b0f625740 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563daee832f0 0x563daf261b90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.820+0000 7f1b0f625740 1 --2- 172.21.15.53:0/16157090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563daee6ad80 0x563daf261650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.820+0000 7f1b0f625740 1 -- 172.21.15.53:0/16157090 >> 172.21.15.53:0/16157090 conn(0x563daeea0300 msgr2=0x563daf256640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.820+0000 7f1b0f625740 1 -- 172.21.15.53:0/16157090 shutdown_connections 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.820+0000 7f1b0f625740 1 -- 172.21.15.53:0/16157090 wait complete. 2024-08-31T06:19:54.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.820+0000 7f1b0f625740 20 client.29171 trim_cache size 0 max 16384 2024-08-31T06:19:54.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:19:54.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:19:54.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:19:54.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:19:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 -- 172.21.15.53:0/2501599259 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1aec0b4d50 msgr2=0x7f1aec0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1aec0b4d50 0x7f1aec0b7260 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1af80116b0 tx=0x7f1af8009500 comp rx=0 tx=0).stop 2024-08-31T06:19:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 -- 172.21.15.53:0/2501599259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b00108080 msgr2=0x7f1b000ff830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b00108080 0x7f1b000ff830 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f1af000e9f0 tx=0x7f1af000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 -- 172.21.15.53:0/2501599259 shutdown_connections 2024-08-31T06:19:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1aec0b4d50 0x7f1aec0b7260 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b001089d0 0x7f1b000ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b00108080 0x7f1b000ff830 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 --2- 172.21.15.53:0/2501599259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b00102750 0x7f1b000ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 -- 172.21.15.53:0/2501599259 >> 172.21.15.53:0/2501599259 conn(0x7f1b0007a4e0 msgr2=0x7f1b00101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 -- 172.21.15.53:0/2501599259 shutdown_connections 2024-08-31T06:19:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:19:54.821+0000 7f1b086bd640 1 -- 172.21.15.53:0/2501599259 wait complete. 2024-08-31T06:19:55.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 11507 7.72 MB/sec warmup 103 sec latency 94.830 ms 2024-08-31T06:19:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:55 smithi130 ceph-mon[22266]: pgmap v790: 97 pgs: 97 active+clean; 416 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.1 MiB/s wr, 303 op/s 2024-08-31T06:19:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:55 smithi153 ceph-mon[22320]: pgmap v790: 97 pgs: 97 active+clean; 416 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.1 MiB/s wr, 303 op/s 2024-08-31T06:19:56.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:55 smithi053 ceph-mon[18924]: pgmap v790: 97 pgs: 97 active+clean; 416 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.1 MiB/s wr, 303 op/s 2024-08-31T06:19:56.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 11654 7.67 MB/sec warmup 104 sec latency 57.103 ms 2024-08-31T06:19:57.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:19:57.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 11800 7.66 MB/sec warmup 105 sec latency 88.048 ms 2024-08-31T06:19:57.377 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:57.829 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:57 smithi053 ceph-mon[18924]: pgmap v791: 97 pgs: 97 active+clean; 421 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.4 MiB/s wr, 357 op/s 2024-08-31T06:19:57.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.983+0000 7fbec4f94640 1 -- 172.21.15.53:0/2091309115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec0108180 msgr2=0x7fbec0108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:57.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.983+0000 7fbec4f94640 1 --2- 172.21.15.53:0/2091309115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec0108180 0x7fbec0108590 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009900 tx=0x7fbeb402a410 comp rx=0 tx=0).stop 2024-08-31T06:19:57.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.983+0000 7fbec4f94640 1 -- 172.21.15.53:0/2091309115 shutdown_connections 2024-08-31T06:19:57.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.983+0000 7fbec4f94640 1 --2- 172.21.15.53:0/2091309115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec0108ad0 0x7fbec010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:57.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.983+0000 7fbec4f94640 1 --2- 172.21.15.53:0/2091309115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec0108180 0x7fbec0108590 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:57.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.983+0000 7fbec4f94640 1 --2- 172.21.15.53:0/2091309115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbec0102840 0x7fbec0102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:57.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.983+0000 7fbec4f94640 1 -- 172.21.15.53:0/2091309115 >> 172.21.15.53:0/2091309115 conn(0x7fbec0079580 msgr2=0x7fbec0079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:57.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.983+0000 7fbec4f94640 1 -- 172.21.15.53:0/2091309115 shutdown_connections 2024-08-31T06:19:57.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.983+0000 7fbec4f94640 1 -- 172.21.15.53:0/2091309115 wait complete. 2024-08-31T06:19:57.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.984+0000 7fbec4f94640 1 Processor -- start 2024-08-31T06:19:57.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.984+0000 7fbec4f94640 1 -- start start 2024-08-31T06:19:57.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbec4f94640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbec0102840 0x7fbec019c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:57.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbec4f94640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec0108180 0x7fbec019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:57.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbec4f94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec0108ad0 0x7fbec01a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:57.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbec4f94640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbec01125b0 con 0x7fbec0108ad0 2024-08-31T06:19:57.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbec4f94640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbec0112430 con 0x7fbec0102840 2024-08-31T06:19:57.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbec4f94640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbec0112730 con 0x7fbec0108180 2024-08-31T06:19:57.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbebe59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbec0102840 0x7fbec019c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:57.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbebe59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbec0102840 0x7fbec019c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39444/0 (socket says 172.21.15.53:39444) 2024-08-31T06:19:57.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbebe59c640 1 -- 172.21.15.53:0/2347052693 learned_addr learned my addr 172.21.15.53:0/2347052693 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:57.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbebed9d640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec0108ad0 0x7fbec01a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:57.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec0108180 0x7fbec019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:57.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbebed9d640 1 -- 172.21.15.53:0/2347052693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec0108180 msgr2=0x7fbec019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:57.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.985+0000 7fbebed9d640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec0108180 0x7fbec019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:57.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.986+0000 7fbebed9d640 1 -- 172.21.15.53:0/2347052693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbec0102840 msgr2=0x7fbec019c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.986+0000 7fbebed9d640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbec0102840 0x7fbec019c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.986+0000 7fbebed9d640 1 -- 172.21.15.53:0/2347052693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec01a2310 con 0x7fbec0108ad0 2024-08-31T06:19:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.986+0000 7fbebe59c640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbec0102840 0x7fbec019c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.986+0000 7fbebed9d640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec0108ad0 0x7fbec01a1be0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800da10 tx=0x7fbeb800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.986+0000 7fbeaf7fe640 1 -- 172.21.15.53:0/2347052693 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb800bd70 con 0x7fbec0108ad0 2024-08-31T06:19:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.986+0000 7fbeaf7fe640 1 -- 172.21.15.53:0/2347052693 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbeb8003e00 con 0x7fbec0108ad0 2024-08-31T06:19:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.986+0000 7fbeaf7fe640 1 -- 172.21.15.53:0/2347052693 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80106c0 con 0x7fbec0108ad0 2024-08-31T06:19:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.986+0000 7fbec4f94640 1 -- 172.21.15.53:0/2347052693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec01a2600 con 0x7fbec0108ad0 2024-08-31T06:19:57.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.986+0000 7fbec4f94640 1 -- 172.21.15.53:0/2347052693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec01a8d60 con 0x7fbec0108ad0 2024-08-31T06:19:57.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.989+0000 7fbecb509740 1 Processor -- start 2024-08-31T06:19:57.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.991+0000 7fbeaf7fe640 1 -- 172.21.15.53:0/2347052693 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbeb8003970 con 0x7fbec0108ad0 2024-08-31T06:19:57.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.991+0000 7fbecb509740 1 -- start start 2024-08-31T06:19:57.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.991+0000 7fbecb509740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b5710070 0x55f8b5ab52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.991+0000 7fbecb509740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56e71b0 0x55f8b5ab5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.991+0000 7fbecb509740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56ef390 0x55f8b5ab5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.991+0000 7fbecb509740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f8b5a2c630 con 0x55f8b56e71b0 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.991+0000 7fbecb509740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f8b5a1bbc0 con 0x55f8b5710070 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.991+0000 7fbecb509740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f8b5a1fb70 con 0x55f8b56ef390 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.992+0000 7fbebe59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56e71b0 0x55f8b5ab5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.992+0000 7fbebe59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56e71b0 0x55f8b5ab5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39344/0 (socket says 172.21.15.53:39344) 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.992+0000 7fbebe59c640 1 -- 172.21.15.53:0/4064030723 learned_addr learned my addr 172.21.15.53:0/4064030723 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.992+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/4064030723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b5710070 0x55f8b5ab52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.992+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/4064030723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56ef390 0x55f8b5ab5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.992+0000 7fbebdd9b640 1 -- 172.21.15.53:0/4064030723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b5710070 msgr2=0x55f8b5ab52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.992+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/4064030723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b5710070 0x55f8b5ab52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:57.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.992+0000 7fbebdd9b640 1 -- 172.21.15.53:0/4064030723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56e71b0 msgr2=0x55f8b5ab5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:57.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.992+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/4064030723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56e71b0 0x55f8b5ab5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:57.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.992+0000 7fbebdd9b640 1 -- 172.21.15.53:0/4064030723 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b577b650 con 0x55f8b56ef390 2024-08-31T06:19:57.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.992+0000 7fbebe59c640 1 --2- 172.21.15.53:0/4064030723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56e71b0 0x55f8b5ab5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:19:57.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.993+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/4064030723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56ef390 0x55f8b5ab5d40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009230 tx=0x7fbeb402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffc35c7f66d1d3d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:57.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.993+0000 7fbeaf7fe640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbea80b4d20 0x7fbea80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:57.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.993+0000 7fbeacff9640 1 -- 172.21.15.53:0/4064030723 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4035070 con 0x55f8b56ef390 2024-08-31T06:19:57.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.993+0000 7fbebe59c640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbea80b4d20 0x7fbea80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:57.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.993+0000 7fbeacff9640 1 -- 172.21.15.53:0/4064030723 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbeb4004030 con 0x55f8b56ef390 2024-08-31T06:19:57.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.993+0000 7fbeaf7fe640 1 -- 172.21.15.53:0/2347052693 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fbeb80e58f0 con 0x7fbec0108ad0 2024-08-31T06:19:57.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.994+0000 7fbeacff9640 1 -- 172.21.15.53:0/4064030723 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40038e0 con 0x55f8b56ef390 2024-08-31T06:19:57.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.994+0000 7fbecb509740 1 -- 172.21.15.53:0/4064030723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56ef390 msgr2=0x55f8b5ab5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:57.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.994+0000 7fbecb509740 1 --2- 172.21.15.53:0/4064030723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56ef390 0x55f8b5ab5d40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009230 tx=0x7fbeb402a410 comp rx=0 tx=0).stop 2024-08-31T06:19:57.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.994+0000 7fbebe59c640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbea80b4d20 0x7fbea80b7230 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0009fd0 tx=0x7fbeb0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:57.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.994+0000 7fbecb509740 1 -- 172.21.15.53:0/4064030723 shutdown_connections 2024-08-31T06:19:57.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.994+0000 7fbecb509740 1 --2- 172.21.15.53:0/4064030723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56ef390 0x55f8b5ab5d40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:57.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.994+0000 7fbecb509740 1 --2- 172.21.15.53:0/4064030723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56e71b0 0x55f8b5ab5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:57.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.994+0000 7fbecb509740 1 --2- 172.21.15.53:0/4064030723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b5710070 0x55f8b5ab52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:57.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.994+0000 7fbecb509740 1 -- 172.21.15.53:0/4064030723 >> 172.21.15.53:0/4064030723 conn(0x55f8b5704460 msgr2=0x55f8b5ab31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:58.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.994+0000 7fbecb509740 1 -- 172.21.15.53:0/4064030723 shutdown_connections 2024-08-31T06:19:58.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.995+0000 7fbecb509740 1 -- 172.21.15.53:0/4064030723 wait complete. 2024-08-31T06:19:58.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.995+0000 7fbecb509740 1 -- start start 2024-08-31T06:19:58.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.995+0000 7fbecb509740 1 Processor -- start 2024-08-31T06:19:58.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.996+0000 7fbecb509740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b56e71b0 0x55f8b5ac0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:58.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.996+0000 7fbecb509740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ac0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:58.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.996+0000 7fbecb509740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 0x55f8b5accdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:58.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.996+0000 7fbebdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ac0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.996+0000 7fbebdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ac0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39346/0 (socket says 172.21.15.53:39346) 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.996+0000 7fbebdd9b640 1 -- 172.21.15.53:0/1708677508 learned_addr learned my addr 172.21.15.53:0/1708677508 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.996+0000 7fbecb509740 1 -- 172.21.15.53:0/1708677508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f8b587e700 con 0x55f8b56ef390 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.996+0000 7fbecb509740 1 -- 172.21.15.53:0/1708677508 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f8b59a2700 con 0x55f8b56e71b0 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.996+0000 7fbecb509740 1 -- 172.21.15.53:0/1708677508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f8b5ac3ae0 con 0x55f8b5710070 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.996+0000 7fbebe59c640 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b56e71b0 0x55f8b5ac0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.996+0000 7fbecb509740 10 client.0 _ll_register_callbacks cb 0x55f8b59d1dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.997+0000 7fbebed9d640 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 0x55f8b5accdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.997+0000 7fbebdd9b640 1 -- 172.21.15.53:0/1708677508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 msgr2=0x55f8b5accdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.997+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 0x55f8b5accdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.997+0000 7fbebdd9b640 1 -- 172.21.15.53:0/1708677508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b56e71b0 msgr2=0x55f8b5ac0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:58.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.997+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b56e71b0 0x55f8b5ac0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.997+0000 7fbebdd9b640 1 -- 172.21.15.53:0/1708677508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b59db8b0 con 0x55f8b56ef390 2024-08-31T06:19:58.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.997+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ac0f60 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4001eb0 tx=0x7fbeb4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c87f8715372516a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:58.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.997+0000 7fbea5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:19:58.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.997+0000 7fbea5ffb640 1 -- 172.21.15.53:0/1708677508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4035070 con 0x55f8b56ef390 2024-08-31T06:19:58.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.998+0000 7fbea5ffb640 1 -- 172.21.15.53:0/1708677508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fbeb4003660 con 0x55f8b56ef390 2024-08-31T06:19:58.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.998+0000 7fbecb509740 1 -- 172.21.15.53:0/1708677508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbeb4004030 con 0x55f8b56ef390 2024-08-31T06:19:58.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.998+0000 7fbea5ffb640 1 -- 172.21.15.53:0/1708677508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fbeb4009520 con 0x55f8b56ef390 2024-08-31T06:19:58.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.998+0000 7fbecb509740 10 client.20220 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:58.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.998+0000 7fbecb509740 1 -- 172.21.15.53:0/1708677508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55f8b5acf800 con 0x55f8b56ef390 2024-08-31T06:19:58.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.999+0000 7fbea5ffb640 1 -- 172.21.15.53:0/1708677508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbeb4004030 con 0x55f8b56ef390 2024-08-31T06:19:58.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.999+0000 7fbea5ffb640 1 -- 172.21.15.53:0/1708677508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fbeb403e7a0 con 0x55f8b56ef390 2024-08-31T06:19:58.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.999+0000 7fbecb509740 10 client.20220 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:58.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.999+0000 7fbecb509740 10 client.20220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:58.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.999+0000 7fbecb509740 20 client.20220 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:58.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.999+0000 7fbecb509740 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f8b56ce9f0 0x55f8b5ad2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:58.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.999+0000 7fbecb509740 4 client.20220 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:19:58.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:57.999+0000 7fbecb509740 1 -- 172.21.15.53:0/1708677508 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8b5a2e580 con 0x55f8b56ce9f0 2024-08-31T06:19:58.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.000+0000 7fbebe59c640 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f8b56ce9f0 0x55f8b5ad2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:58.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.000+0000 7fbebe59c640 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f8b56ce9f0 0x55f8b5ad2b60 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7736ce30815c2e0c server_cookie=ee153505ac46ea70 in_seq=0 out_seq=0 2024-08-31T06:19:58.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.000+0000 7fbea5ffb640 10 client.20220 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:58.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.001+0000 7fbea5ffb640 1 -- 172.21.15.53:0/1708677508 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8b5a2e580 con 0x55f8b56ce9f0 2024-08-31T06:19:58.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.001+0000 7fbea5ffb640 10 client.20220 handle_command_reply: tid=0 2024-08-31T06:19:58.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.001+0000 7fbecb509740 1 client.20220 shutdown 2024-08-31T06:19:58.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.001+0000 7fbecb509740 1 -- 172.21.15.53:0/1708677508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 msgr2=0x55f8b5ac0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:58.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.001+0000 7fbecb509740 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ac0f60 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4001eb0 tx=0x7fbeb4004410 comp rx=0 tx=0).stop 2024-08-31T06:19:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.001+0000 7fbecb509740 1 -- 172.21.15.53:0/1708677508 shutdown_connections 2024-08-31T06:19:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.001+0000 7fbecb509740 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f8b56ce9f0 0x55f8b5ad2b60 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.001+0000 7fbecb509740 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 0x55f8b5accdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.001+0000 7fbecb509740 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ac0f60 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.001+0000 7fbecb509740 1 --2- 172.21.15.53:0/1708677508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b56e71b0 0x55f8b5ac0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.001+0000 7fbecb509740 1 -- 172.21.15.53:0/1708677508 >> 172.21.15.53:0/1708677508 conn(0x55f8b5704460 msgr2=0x55f8b5ab62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.002+0000 7fbea5ffb640 0 client.20220 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.002+0000 7fbecb509740 1 -- 172.21.15.53:0/1708677508 shutdown_connections 2024-08-31T06:19:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.002+0000 7fbecb509740 1 -- 172.21.15.53:0/1708677508 wait complete. 2024-08-31T06:19:58.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.002+0000 7fbecb509740 20 client.20220 trim_cache size 0 max 16384 2024-08-31T06:19:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.027+0000 7fbecb509740 1 Processor -- start 2024-08-31T06:19:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.027+0000 7fbecb509740 1 -- start start 2024-08-31T06:19:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.027+0000 7fbecb509740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b56e71b0 0x55f8b5ab6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.027+0000 7fbecb509740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ac0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.027+0000 7fbecb509740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 0x55f8b5accd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.027+0000 7fbecb509740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbec01b1800 con 0x55f8b56ef390 2024-08-31T06:19:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.027+0000 7fbecb509740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbec01b3580 con 0x55f8b56e71b0 2024-08-31T06:19:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.027+0000 7fbecb509740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbec01b1ed0 con 0x55f8b5710070 2024-08-31T06:19:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 0x55f8b5accd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 0x55f8b5accd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48482/0 (socket says 172.21.15.53:48482) 2024-08-31T06:19:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebed9d640 1 -- 172.21.15.53:0/2076977390 learned_addr learned my addr 172.21.15.53:0/2076977390 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebe59c640 1 --2- 172.21.15.53:0/2076977390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b56e71b0 0x55f8b5ab6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/2076977390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ac0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebed9d640 1 -- 172.21.15.53:0/2076977390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b56e71b0 msgr2=0x55f8b5ab6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebed9d640 1 --2- 172.21.15.53:0/2076977390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b56e71b0 0x55f8b5ab6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebed9d640 1 -- 172.21.15.53:0/2076977390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 msgr2=0x55f8b5ac0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebed9d640 1 --2- 172.21.15.53:0/2076977390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ac0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebed9d640 1 -- 172.21.15.53:0/2076977390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b5abf980 con 0x55f8b5710070 2024-08-31T06:19:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/2076977390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ac0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:19:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.028+0000 7fbebed9d640 1 --2- 172.21.15.53:0/2076977390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 0x55f8b5accd40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80a91d0 tx=0x7fbeb8003c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f8058bd2884bc5f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.029+0000 7fbea7fff640 1 -- 172.21.15.53:0/2076977390 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80abf60 con 0x55f8b5710070 2024-08-31T06:19:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.029+0000 7fbea7fff640 1 -- 172.21.15.53:0/2076977390 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbeb80b07d0 con 0x55f8b5710070 2024-08-31T06:19:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.029+0000 7fbea7fff640 1 -- 172.21.15.53:0/2076977390 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80b03e0 con 0x55f8b5710070 2024-08-31T06:19:58.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.030+0000 7fbecb509740 1 -- 172.21.15.53:0/2076977390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 msgr2=0x55f8b5accd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:58.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.030+0000 7fbecb509740 1 --2- 172.21.15.53:0/2076977390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 0x55f8b5accd40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80a91d0 tx=0x7fbeb8003c60 comp rx=0 tx=0).stop 2024-08-31T06:19:58.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.030+0000 7fbecb509740 1 -- 172.21.15.53:0/2076977390 shutdown_connections 2024-08-31T06:19:58.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.030+0000 7fbecb509740 1 --2- 172.21.15.53:0/2076977390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b5710070 0x55f8b5accd40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.030+0000 7fbecb509740 1 --2- 172.21.15.53:0/2076977390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ac0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.030+0000 7fbecb509740 1 --2- 172.21.15.53:0/2076977390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b56e71b0 0x55f8b5ab6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.030+0000 7fbecb509740 1 -- 172.21.15.53:0/2076977390 >> 172.21.15.53:0/2076977390 conn(0x55f8b5704460 msgr2=0x55f8b5ab62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.030+0000 7fbecb509740 1 -- 172.21.15.53:0/2076977390 shutdown_connections 2024-08-31T06:19:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.030+0000 7fbecb509740 1 -- 172.21.15.53:0/2076977390 wait complete. 2024-08-31T06:19:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.031+0000 7fbecb509740 1 -- start start 2024-08-31T06:19:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.031+0000 7fbecb509740 1 Processor -- start 2024-08-31T06:19:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.031+0000 7fbecb509740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56e71b0 0x55f8b5ad3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.031+0000 7fbecb509740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ad4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.031+0000 7fbecb509740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b5710070 0x55f8b5ad4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.031+0000 7fbecb509740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbec01b2df0 con 0x55f8b56ef390 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbecb509740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbec01b2660 con 0x55f8b5710070 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebe59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56e71b0 0x55f8b5ad3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbecb509740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbec01af800 con 0x55f8b56e71b0 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b5710070 0x55f8b5ad4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebe59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56e71b0 0x55f8b5ad3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48488/0 (socket says 172.21.15.53:48488) 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebe59c640 1 -- 172.21.15.53:0/2957939628 learned_addr learned my addr 172.21.15.53:0/2957939628 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ad4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbecb509740 10 client.0 _ll_register_callbacks cb 0x7fbeb0009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebed9d640 1 -- 172.21.15.53:0/2957939628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56e71b0 msgr2=0x55f8b5ad3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebed9d640 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56e71b0 0x55f8b5ad3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebed9d640 1 -- 172.21.15.53:0/2957939628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 msgr2=0x55f8b5ad4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebed9d640 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ad4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebed9d640 1 -- 172.21.15.53:0/2957939628 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b5b3c360 con 0x55f8b5710070 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebdd9b640 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ad4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbebed9d640 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b5710070 0x55f8b5ad4690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80abc10 tx=0x7fbeb80044a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=151455f2ffdc8884 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbea5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.032+0000 7fbea5ffb640 1 -- 172.21.15.53:0/2957939628 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80abf60 con 0x55f8b5710070 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbea5ffb640 1 -- 172.21.15.53:0/2957939628 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fbeb80e3240 con 0x55f8b5710070 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbecb509740 1 -- 172.21.15.53:0/2957939628 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbeb80b07d0 con 0x55f8b5710070 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbea5ffb640 1 -- 172.21.15.53:0/2957939628 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fbeb80b5280 con 0x55f8b5710070 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbecb509740 10 client.29189 fetch_fsmap learned FSMap version 56 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbecb509740 1 -- 172.21.15.53:0/2957939628 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55f8b5b3d590 con 0x55f8b5710070 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbea5ffb640 1 -- 172.21.15.53:0/2957939628 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbeb80b07d0 con 0x55f8b5710070 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbea5ffb640 1 -- 172.21.15.53:0/2957939628 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fbeb80af070 con 0x55f8b5710070 2024-08-31T06:19:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbecb509740 10 client.29189 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:19:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbecb509740 10 client.29189 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:19:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbecb509740 20 client.29189 populate_metadata read hostname 'smithi053' 2024-08-31T06:19:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbecb509740 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f8b56a3da0 0x55f8b5b3fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:19:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbecb509740 4 client.29189 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:19:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.033+0000 7fbecb509740 1 -- 172.21.15.53:0/2957939628 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f8b5a2a020 con 0x55f8b56a3da0 2024-08-31T06:19:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.034+0000 7fbebe59c640 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f8b56a3da0 0x55f8b5b3fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.034+0000 7fbea5ffb640 10 client.29189 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.034+0000 7fbebe59c640 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f8b56a3da0 0x55f8b5b3fd80 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f60f6bb78497d813 server_cookie=4e5fe5ec3a619135 in_seq=0 out_seq=0 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbea5ffb640 1 -- 172.21.15.53:0/2957939628 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x55f8b5a2a020 con 0x55f8b56a3da0 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbea5ffb640 10 client.29189 handle_command_reply: tid=0 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbecb509740 1 client.29189 shutdown 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbecb509740 1 -- 172.21.15.53:0/2957939628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b5710070 msgr2=0x55f8b5ad4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbecb509740 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b5710070 0x55f8b5ad4690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80abc10 tx=0x7fbeb80044a0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbecb509740 1 -- 172.21.15.53:0/2957939628 shutdown_connections 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbecb509740 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f8b56a3da0 0x55f8b5b3fd80 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbea5ffb640 0 client.29189 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbecb509740 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8b5710070 0x55f8b5ad4690 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbecb509740 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8b56ef390 0x55f8b5ad4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbecb509740 1 --2- 172.21.15.53:0/2957939628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8b56e71b0 0x55f8b5ad3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbecb509740 1 -- 172.21.15.53:0/2957939628 >> 172.21.15.53:0/2957939628 conn(0x55f8b5704460 msgr2=0x55f8b5ab2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.035+0000 7fbecb509740 1 -- 172.21.15.53:0/2957939628 shutdown_connections 2024-08-31T06:19:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.036+0000 7fbecb509740 1 -- 172.21.15.53:0/2957939628 wait complete. 2024-08-31T06:19:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.036+0000 7fbecb509740 20 client.29189 trim_cache size 0 max 16384 2024-08-31T06:19:58.042 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:19:58.042 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:19:58.042 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:19:58.042 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:19:58.044 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.046 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:19:58.047 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.048 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.049 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.050 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:19:58.051 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.052 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:19:58.053 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:19:58.054 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:19:58.054 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:19:58.054 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:58.054 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:19:58.054 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:19:58.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.036+0000 7fbec4f94640 1 -- 172.21.15.53:0/2347052693 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbea80b4d20 msgr2=0x7fbea80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:58.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.036+0000 7fbec4f94640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbea80b4d20 0x7fbea80b7230 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0009fd0 tx=0x7fbeb0005f90 comp rx=0 tx=0).stop 2024-08-31T06:19:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.036+0000 7fbec4f94640 1 -- 172.21.15.53:0/2347052693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec0108ad0 msgr2=0x7fbec01a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:19:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.036+0000 7fbec4f94640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec0108ad0 0x7fbec01a1be0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800da10 tx=0x7fbeb800ded0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.037+0000 7fbec4f94640 1 -- 172.21.15.53:0/2347052693 shutdown_connections 2024-08-31T06:19:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.037+0000 7fbec4f94640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbea80b4d20 0x7fbea80b7230 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.037+0000 7fbec4f94640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbec0108ad0 0x7fbec01a1be0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.037+0000 7fbec4f94640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec0108180 0x7fbec019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.037+0000 7fbec4f94640 1 --2- 172.21.15.53:0/2347052693 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbec0102840 0x7fbec019c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:19:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.037+0000 7fbec4f94640 1 -- 172.21.15.53:0/2347052693 >> 172.21.15.53:0/2347052693 conn(0x7fbec0079580 msgr2=0x7fbec01052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:19:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.037+0000 7fbec4f94640 1 -- 172.21.15.53:0/2347052693 shutdown_connections 2024-08-31T06:19:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:19:58.037+0000 7fbec4f94640 1 -- 172.21.15.53:0/2347052693 wait complete. 2024-08-31T06:19:58.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:57 smithi130 ceph-mon[22266]: pgmap v791: 97 pgs: 97 active+clean; 421 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.4 MiB/s wr, 357 op/s 2024-08-31T06:19:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:57 smithi153 ceph-mon[22320]: pgmap v791: 97 pgs: 97 active+clean; 421 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.4 MiB/s wr, 357 op/s 2024-08-31T06:19:58.364 INFO:tasks.workunit.client.0.smithi053.stdout: 10 11948 7.64 MB/sec warmup 106 sec latency 80.148 ms 2024-08-31T06:19:58.996 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:19:58.997 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:19:59.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 12095 7.66 MB/sec warmup 107 sec latency 82.391 ms 2024-08-31T06:19:59.380 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:19:59.891 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:19:59 smithi053 ceph-mon[18924]: pgmap v792: 97 pgs: 97 active+clean; 417 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 335 op/s 2024-08-31T06:20:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.023+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3448282902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b8104fe0 msgr2=0x7fd6b810d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.023+0000 7fd6bdefc640 1 --2- 172.21.15.53:0/3448282902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b8104fe0 0x7fd6b810d700 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009900 tx=0x7fd6ac02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.023+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3448282902 shutdown_connections 2024-08-31T06:20:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.023+0000 7fd6bdefc640 1 --2- 172.21.15.53:0/3448282902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6b810dc40 0x7fd6b81100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.023+0000 7fd6bdefc640 1 --2- 172.21.15.53:0/3448282902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b8104fe0 0x7fd6b810d700 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.023+0000 7fd6bdefc640 1 --2- 172.21.15.53:0/3448282902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6b8104690 0x7fd6b8104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.023+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3448282902 >> 172.21.15.53:0/3448282902 conn(0x7fd6b8079470 msgr2=0x7fd6b8079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.023+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3448282902 shutdown_connections 2024-08-31T06:20:00.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.023+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3448282902 wait complete. 2024-08-31T06:20:00.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.024+0000 7fd6bdefc640 1 Processor -- start 2024-08-31T06:20:00.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.024+0000 7fd6bdefc640 1 -- start start 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6bdefc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6b8104690 0x7fd6b81025a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6bdefc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6b8104fe0 0x7fd6b8102ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6bdefc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b810dc40 0x7fd6b8103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6bdefc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8113710 con 0x7fd6b810dc40 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6bdefc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8113590 con 0x7fd6b8104690 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6bdefc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8113890 con 0x7fd6b8104fe0 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6b7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b810dc40 0x7fd6b8103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6b77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6b8104690 0x7fd6b81025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6b7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b810dc40 0x7fd6b8103020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39376/0 (socket says 172.21.15.53:39376) 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6b7fff640 1 -- 172.21.15.53:0/3498854236 learned_addr learned my addr 172.21.15.53:0/3498854236 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6b6ffd640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6b8104fe0 0x7fd6b8102ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:00.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6b77fe640 1 -- 172.21.15.53:0/3498854236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6b8104fe0 msgr2=0x7fd6b8102ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6b77fe640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6b8104fe0 0x7fd6b8102ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6b77fe640 1 -- 172.21.15.53:0/3498854236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b810dc40 msgr2=0x7fd6b8103020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6b77fe640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b810dc40 0x7fd6b8103020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.025+0000 7fd6b77fe640 1 -- 172.21.15.53:0/3498854236 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b81a8440 con 0x7fd6b8104690 2024-08-31T06:20:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.026+0000 7fd6b6ffd640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6b8104fe0 0x7fd6b8102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.026+0000 7fd6b7fff640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b810dc40 0x7fd6b8103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.026+0000 7fd6b77fe640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6b8104690 0x7fd6b81025a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800e9f0 tx=0x7fd6a800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.026+0000 7fd6b4ff9640 1 -- 172.21.15.53:0/3498854236 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800ccc0 con 0x7fd6b8104690 2024-08-31T06:20:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.026+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3498854236 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b81a8730 con 0x7fd6b8104690 2024-08-31T06:20:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.026+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3498854236 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b81a8c90 con 0x7fd6b8104690 2024-08-31T06:20:00.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.026+0000 7fd6b4ff9640 1 -- 172.21.15.53:0/3498854236 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6a80108c0 con 0x7fd6b8104690 2024-08-31T06:20:00.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.027+0000 7fd6b4ff9640 1 -- 172.21.15.53:0/3498854236 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a80187c0 con 0x7fd6b8104690 2024-08-31T06:20:00.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.028+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3498854236 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a40052c0 con 0x7fd6b8104690 2024-08-31T06:20:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.030+0000 7fd6b4ff9640 1 -- 172.21.15.53:0/3498854236 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd6a8010430 con 0x7fd6b8104690 2024-08-31T06:20:00.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.031+0000 7fd6b4ff9640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6a00b4d20 0x7fd6a00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:00.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.031+0000 7fd6b6ffd640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6a00b4d20 0x7fd6a00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:00.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.031+0000 7fd6b4ff9640 1 -- 172.21.15.53:0/3498854236 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7fd6a80e56e0 con 0x7fd6b8104690 2024-08-31T06:20:00.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.031+0000 7fd6b6ffd640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6a00b4d20 0x7fd6a00b7230 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0057c0 tx=0x7fd6ac000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.037+0000 7fd6b4ff9640 1 -- 172.21.15.53:0/3498854236 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd6a80ac4b0 con 0x7fd6b8104690 2024-08-31T06:20:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:19:59 smithi130 ceph-mon[22266]: pgmap v792: 97 pgs: 97 active+clean; 417 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 335 op/s 2024-08-31T06:20:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:19:59 smithi153 ceph-mon[22320]: pgmap v792: 97 pgs: 97 active+clean; 417 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 335 op/s 2024-08-31T06:20:00.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 12269 7.69 MB/sec warmup 108 sec latency 97.860 ms 2024-08-31T06:20:00.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.410+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3498854236 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6a4005880 con 0x7fd6b8104690 2024-08-31T06:20:00.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.410+0000 7fd6b4ff9640 1 -- 172.21.15.53:0/3498854236 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+12011 (secure 0 0 0) 0x7fd6a80abdb0 con 0x7fd6b8104690 2024-08-31T06:20:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:20:00.414 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":56,"btime":"2024-08-31T06:18:21:665793+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:18:21.236924+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:20:00.415 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 56 2024-08-31T06:20:00.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3498854236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6a00b4d20 msgr2=0x7fd6a00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:00.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6a00b4d20 0x7fd6a00b7230 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0057c0 tx=0x7fd6ac000bc0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3498854236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6b8104690 msgr2=0x7fd6b81025a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:00.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6b8104690 0x7fd6b81025a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800e9f0 tx=0x7fd6a800eeb0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3498854236 shutdown_connections 2024-08-31T06:20:00.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd6a00b4d20 0x7fd6a00b7230 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b810dc40 0x7fd6b8103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6b8104fe0 0x7fd6b8102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 --2- 172.21.15.53:0/3498854236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6b8104690 0x7fd6b81025a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:00.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3498854236 >> 172.21.15.53:0/3498854236 conn(0x7fd6b8079470 msgr2=0x7fd6b80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:00.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3498854236 shutdown_connections 2024-08-31T06:20:00.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:00.414+0000 7fd6bdefc640 1 -- 172.21.15.53:0/3498854236 wait complete. 2024-08-31T06:20:01.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:00 smithi130 ceph-mon[22266]: overall HEALTH_OK 2024-08-31T06:20:01.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:00 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3498854236' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:01.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:00 smithi153 ceph-mon[22320]: overall HEALTH_OK 2024-08-31T06:20:01.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:00 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3498854236' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:01.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:00 smithi053 ceph-mon[18924]: overall HEALTH_OK 2024-08-31T06:20:01.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:00 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3498854236' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:01.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:20:01.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 12451 7.76 MB/sec warmup 109 sec latency 106.772 ms 2024-08-31T06:20:01.656 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:01 smithi130 ceph-mon[22266]: pgmap v793: 97 pgs: 97 active+clean; 412 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 377 op/s 2024-08-31T06:20:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:01 smithi153 ceph-mon[22320]: pgmap v793: 97 pgs: 97 active+clean; 412 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 377 op/s 2024-08-31T06:20:02.219 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:01 smithi053 ceph-mon[18924]: pgmap v793: 97 pgs: 97 active+clean; 412 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 377 op/s 2024-08-31T06:20:02.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.352+0000 7f9929b7d640 1 -- 172.21.15.53:0/3028472246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924102880 msgr2=0x7f9924102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:02.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.352+0000 7f9929b7d640 1 --2- 172.21.15.53:0/3028472246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924102880 0x7f9924102c90 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f9914009900 tx=0x7f991402a410 comp rx=0 tx=0).stop 2024-08-31T06:20:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.352+0000 7f9929b7d640 1 -- 172.21.15.53:0/3028472246 shutdown_connections 2024-08-31T06:20:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.352+0000 7f9929b7d640 1 --2- 172.21.15.53:0/3028472246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924108ac0 0x7f992410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.352+0000 7f9929b7d640 1 --2- 172.21.15.53:0/3028472246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108170 0x7f9924108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.352+0000 7f9929b7d640 1 --2- 172.21.15.53:0/3028472246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924102880 0x7f9924102c90 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.352+0000 7f9929b7d640 1 -- 172.21.15.53:0/3028472246 >> 172.21.15.53:0/3028472246 conn(0x7f9924079500 msgr2=0x7f9924079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.352+0000 7f9929b7d640 1 -- 172.21.15.53:0/3028472246 shutdown_connections 2024-08-31T06:20:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.352+0000 7f9929b7d640 1 -- 172.21.15.53:0/3028472246 wait complete. 2024-08-31T06:20:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.353+0000 7f9929b7d640 1 Processor -- start 2024-08-31T06:20:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f9929b7d640 1 -- start start 2024-08-31T06:20:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f9929b7d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924102880 0x7f992419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f9929b7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108170 0x7f992419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f9929b7d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108ac0 0x7f992419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f9929b7d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9924113730 con 0x7f9924108170 2024-08-31T06:20:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f9929b7d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99241135b0 con 0x7f9924102880 2024-08-31T06:20:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f9929b7d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99241138b0 con 0x7f9924108ac0 2024-08-31T06:20:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f9922ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108170 0x7f992419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f99237fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924102880 0x7f992419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f9922ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108170 0x7f992419a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39398/0 (socket says 172.21.15.53:39398) 2024-08-31T06:20:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f9922ffd640 1 -- 172.21.15.53:0/2180367792 learned_addr learned my addr 172.21.15.53:0/2180367792 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.354+0000 7f9923fff640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108ac0 0x7f992419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.355+0000 7f9922ffd640 1 -- 172.21.15.53:0/2180367792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108ac0 msgr2=0x7f992419f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.355+0000 7f9922ffd640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108ac0 0x7f992419f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.355+0000 7f9922ffd640 1 -- 172.21.15.53:0/2180367792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924102880 msgr2=0x7f992419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.355+0000 7f9922ffd640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924102880 0x7f992419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.355+0000 7f9922ffd640 1 -- 172.21.15.53:0/2180367792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99241a0110 con 0x7f9924108170 2024-08-31T06:20:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.355+0000 7f9922ffd640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108170 0x7f992419a740 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f991800d770 tx=0x7f991800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.355+0000 7f9920ff9640 1 -- 172.21.15.53:0/2180367792 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918017070 con 0x7f9924108170 2024-08-31T06:20:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.355+0000 7f9920ff9640 1 -- 172.21.15.53:0/2180367792 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9918009c30 con 0x7f9924108170 2024-08-31T06:20:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.355+0000 7f9920ff9640 1 -- 172.21.15.53:0/2180367792 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991800f620 con 0x7f9924108170 2024-08-31T06:20:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.355+0000 7f9929b7d640 1 -- 172.21.15.53:0/2180367792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99241a0400 con 0x7f9924108170 2024-08-31T06:20:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.356+0000 7f9929b7d640 1 -- 172.21.15.53:0/2180367792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f992410fc60 con 0x7f9924108170 2024-08-31T06:20:02.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.359+0000 7f99300f2740 1 Processor -- start 2024-08-31T06:20:02.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.359+0000 7f99300f2740 1 -- start start 2024-08-31T06:20:02.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99300f2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434bbe310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99300f2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99300f2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bbed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99300f2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562434b35680 con 0x5624347f01b0 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99300f2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562434b24c10 con 0x562434819070 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99300f2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562434b28bc0 con 0x5624347f8390 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f9920ff9640 1 -- 172.21.15.53:0/2180367792 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f991801a070 con 0x7f9924108170 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbe850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39410/0 (socket says 172.21.15.53:39410) 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99237fe640 1 -- 172.21.15.53:0/1139385386 learned_addr learned my addr 172.21.15.53:0/1139385386 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f9923fff640 1 --2- 172.21.15.53:0/1139385386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434bbe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f9922ffd640 1 --2- 172.21.15.53:0/1139385386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bbed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99237fe640 1 -- 172.21.15.53:0/1139385386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 msgr2=0x562434bbed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99237fe640 1 --2- 172.21.15.53:0/1139385386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bbed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99237fe640 1 -- 172.21.15.53:0/1139385386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 msgr2=0x562434bbe310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:02.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99237fe640 1 --2- 172.21.15.53:0/1139385386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434bbe310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.360+0000 7f99237fe640 1 -- 172.21.15.53:0/1139385386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562434884650 con 0x5624347f01b0 2024-08-31T06:20:02.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.361+0000 7f99237fe640 1 --2- 172.21.15.53:0/1139385386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbe850 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f991402aa00 tx=0x7f9914004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d38a9825142bba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:02.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.361+0000 7f9920ff9640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4da0 0x7f990c0b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.361+0000 7f9909ffb640 1 -- 172.21.15.53:0/1139385386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914035070 con 0x5624347f01b0 2024-08-31T06:20:02.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.361+0000 7f9909ffb640 1 -- 172.21.15.53:0/1139385386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99140054c0 con 0x5624347f01b0 2024-08-31T06:20:02.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.361+0000 7f9909ffb640 1 -- 172.21.15.53:0/1139385386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99140035f0 con 0x5624347f01b0 2024-08-31T06:20:02.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.361+0000 7f9923fff640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4da0 0x7f990c0b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.361+0000 7f9920ff9640 1 -- 172.21.15.53:0/2180367792 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f99180e5010 con 0x7f9924108170 2024-08-31T06:20:02.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 12631 7.77 MB/sec warmup 110 sec latency 93.872 ms 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.362+0000 7f99300f2740 1 -- 172.21.15.53:0/1139385386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 msgr2=0x562434bbe850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.362+0000 7f99300f2740 1 --2- 172.21.15.53:0/1139385386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbe850 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f991402aa00 tx=0x7f9914004180 comp rx=0 tx=0).stop 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.362+0000 7f9923fff640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4da0 0x7f990c0b72b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f991c005fd0 tx=0x7f991c0096a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.362+0000 7f99300f2740 1 -- 172.21.15.53:0/1139385386 shutdown_connections 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.362+0000 7f99300f2740 1 --2- 172.21.15.53:0/1139385386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bbed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.362+0000 7f99300f2740 1 --2- 172.21.15.53:0/1139385386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbe850 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.362+0000 7f99300f2740 1 --2- 172.21.15.53:0/1139385386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434bbe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.362+0000 7f99300f2740 1 -- 172.21.15.53:0/1139385386 >> 172.21.15.53:0/1139385386 conn(0x56243480d460 msgr2=0x562434bbc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.362+0000 7f99300f2740 1 -- 172.21.15.53:0/1139385386 shutdown_connections 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.362+0000 7f99300f2740 1 -- 172.21.15.53:0/1139385386 wait complete. 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.363+0000 7f99300f2740 1 -- start start 2024-08-31T06:20:02.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.363+0000 7f99300f2740 1 Processor -- start 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99300f2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bd2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99300f2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bd2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99300f2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434bde520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99300f2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562434987700 con 0x5624347f01b0 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99300f2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562434aab750 con 0x562434819070 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99300f2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562434bd51c0 con 0x5624347f8390 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bd2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99300f2740 10 client.0 _ll_register_callbacks cb 0x562434adae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bd2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39416/0 (socket says 172.21.15.53:39416) 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99237fe640 1 -- 172.21.15.53:0/293752312 learned_addr learned my addr 172.21.15.53:0/293752312 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99237fe640 1 -- 172.21.15.53:0/293752312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 msgr2=0x562434bd2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99237fe640 1 --2- 172.21.15.53:0/293752312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bd2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99237fe640 1 -- 172.21.15.53:0/293752312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 msgr2=0x562434bde520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:02.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99237fe640 1 --2- 172.21.15.53:0/293752312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434bde520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.364+0000 7f99237fe640 1 -- 172.21.15.53:0/293752312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562434ae4900 con 0x5624347f01b0 2024-08-31T06:20:02.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.365+0000 7f99237fe640 1 --2- 172.21.15.53:0/293752312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bd2230 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f991402a930 tx=0x7f99140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80717bff3346763 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:02.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.365+0000 7f9902ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:02.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.365+0000 7f9902ffd640 1 -- 172.21.15.53:0/293752312 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914052060 con 0x5624347f01b0 2024-08-31T06:20:02.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.365+0000 7f99300f2740 1 -- 172.21.15.53:0/293752312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99140054c0 con 0x5624347f01b0 2024-08-31T06:20:02.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.365+0000 7f9902ffd640 1 -- 172.21.15.53:0/293752312 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f99140050d0 con 0x5624347f01b0 2024-08-31T06:20:02.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.365+0000 7f9902ffd640 1 -- 172.21.15.53:0/293752312 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f9914035070 con 0x5624347f01b0 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.366+0000 7f99300f2740 10 client.20244 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.366+0000 7f99300f2740 1 -- 172.21.15.53:0/293752312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x562434be0fa0 con 0x5624347f01b0 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.366+0000 7f9902ffd640 1 -- 172.21.15.53:0/293752312 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99140054c0 con 0x5624347f01b0 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.366+0000 7f9902ffd640 1 -- 172.21.15.53:0/293752312 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f9914044450 con 0x5624347f01b0 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.366+0000 7f99300f2740 10 client.20244 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.366+0000 7f99300f2740 10 client.20244 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.366+0000 7f99300f2740 20 client.20244 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.366+0000 7f99300f2740 1 --2- 172.21.15.53:0/293752312 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5624347d79f0 0x562434be4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.367+0000 7f99300f2740 4 client.20244 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.367+0000 7f99300f2740 1 -- 172.21.15.53:0/293752312 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562434b375d0 con 0x5624347d79f0 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.367+0000 7f9922ffd640 1 --2- 172.21.15.53:0/293752312 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5624347d79f0 0x562434be4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.367+0000 7f9922ffd640 1 --2- 172.21.15.53:0/293752312 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5624347d79f0 0x562434be4300 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7aa61c18f466b047 server_cookie=6b14253bc2e1ebc7 in_seq=0 out_seq=0 2024-08-31T06:20:02.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.367+0000 7f9902ffd640 10 client.20244 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.368+0000 7f9902ffd640 1 -- 172.21.15.53:0/293752312 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562434b375d0 con 0x5624347d79f0 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.368+0000 7f9902ffd640 10 client.20244 handle_command_reply: tid=0 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.368+0000 7f99300f2740 1 client.20244 shutdown 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f99300f2740 1 -- 172.21.15.53:0/293752312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 msgr2=0x562434bd2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f99300f2740 1 --2- 172.21.15.53:0/293752312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bd2230 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f991402a930 tx=0x7f99140048f0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f99300f2740 1 -- 172.21.15.53:0/293752312 shutdown_connections 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f99300f2740 1 --2- 172.21.15.53:0/293752312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434bde520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f99300f2740 1 --2- 172.21.15.53:0/293752312 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5624347d79f0 0x562434be4300 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f99300f2740 1 --2- 172.21.15.53:0/293752312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bd2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f99300f2740 1 --2- 172.21.15.53:0/293752312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bd2230 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f9902ffd640 0 client.20244 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f99300f2740 1 -- 172.21.15.53:0/293752312 >> 172.21.15.53:0/293752312 conn(0x56243480d460 msgr2=0x562434bba7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:02.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f99300f2740 1 -- 172.21.15.53:0/293752312 shutdown_connections 2024-08-31T06:20:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f99300f2740 1 -- 172.21.15.53:0/293752312 wait complete. 2024-08-31T06:20:02.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.369+0000 7f99300f2740 20 client.20244 trim_cache size 0 max 16384 2024-08-31T06:20:02.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f99300f2740 1 Processor -- start 2024-08-31T06:20:02.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f99300f2740 1 -- start start 2024-08-31T06:20:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f99300f2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f99300f2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bde490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f99300f2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434bcf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f99300f2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99241ad340 con 0x5624347f01b0 2024-08-31T06:20:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f99300f2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99241af0c0 con 0x562434819070 2024-08-31T06:20:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f99300f2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99241ada10 con 0x5624347f8390 2024-08-31T06:20:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f99237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f99237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39424/0 (socket says 172.21.15.53:39424) 2024-08-31T06:20:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f99237fe640 1 -- 172.21.15.53:0/3957995504 learned_addr learned my addr 172.21.15.53:0/3957995504 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:02.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f9922ffd640 1 --2- 172.21.15.53:0/3957995504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bde490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.390+0000 7f9923fff640 1 --2- 172.21.15.53:0/3957995504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434bcf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.391+0000 7f9922ffd640 1 -- 172.21.15.53:0/3957995504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 msgr2=0x562434bcf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:02.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.391+0000 7f9922ffd640 1 --2- 172.21.15.53:0/3957995504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434bcf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.391+0000 7f9922ffd640 1 -- 172.21.15.53:0/3957995504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 msgr2=0x562434bbc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:02.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.391+0000 7f9922ffd640 1 --2- 172.21.15.53:0/3957995504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.391+0000 7f9922ffd640 1 -- 172.21.15.53:0/3957995504 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562434bd34f0 con 0x5624347f8390 2024-08-31T06:20:02.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.391+0000 7f99237fe640 1 --2- 172.21.15.53:0/3957995504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:02.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.391+0000 7f9922ffd640 1 --2- 172.21.15.53:0/3957995504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bde490 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f99180e26e0 tx=0x7f991800df10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ca96c69bb755cc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:02.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.391+0000 7f99097fa640 1 -- 172.21.15.53:0/3957995504 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918021040 con 0x5624347f8390 2024-08-31T06:20:02.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.391+0000 7f99097fa640 1 -- 172.21.15.53:0/3957995504 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99180a5e50 con 0x5624347f8390 2024-08-31T06:20:02.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.391+0000 7f99097fa640 1 -- 172.21.15.53:0/3957995504 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99180b49a0 con 0x5624347f8390 2024-08-31T06:20:02.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.392+0000 7f99300f2740 1 -- 172.21.15.53:0/3957995504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 msgr2=0x562434bde490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.392+0000 7f99300f2740 1 --2- 172.21.15.53:0/3957995504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bde490 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f99180e26e0 tx=0x7f991800df10 comp rx=0 tx=0).stop 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.392+0000 7f99300f2740 1 -- 172.21.15.53:0/3957995504 shutdown_connections 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.392+0000 7f99300f2740 1 --2- 172.21.15.53:0/3957995504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434bcf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.392+0000 7f99300f2740 1 --2- 172.21.15.53:0/3957995504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434bde490 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.392+0000 7f99300f2740 1 --2- 172.21.15.53:0/3957995504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434bbc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.393+0000 7f99300f2740 1 -- 172.21.15.53:0/3957995504 >> 172.21.15.53:0/3957995504 conn(0x56243480d460 msgr2=0x562434bbbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.393+0000 7f99300f2740 1 -- 172.21.15.53:0/3957995504 shutdown_connections 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.393+0000 7f99300f2740 1 -- 172.21.15.53:0/3957995504 wait complete. 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.393+0000 7f99300f2740 1 -- start start 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.393+0000 7f99300f2740 1 Processor -- start 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f99300f2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434be5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f99300f2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434be5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f99300f2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434c4da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f99300f2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99241ae930 con 0x5624347f01b0 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f99300f2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99241ae1a0 con 0x562434819070 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f99300f2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99241ab340 con 0x5624347f8390 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f99300f2740 10 client.0 _ll_register_callbacks cb 0x7f991c009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f99237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434be5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f99237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434be5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39436/0 (socket says 172.21.15.53:39436) 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f99237fe640 1 -- 172.21.15.53:0/1674171729 learned_addr learned my addr 172.21.15.53:0/1674171729 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f9923fff640 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434c4da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.394+0000 7f9922ffd640 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434be5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f99237fe640 1 -- 172.21.15.53:0/1674171729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 msgr2=0x562434be5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:02.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f99237fe640 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434be5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f99237fe640 1 -- 172.21.15.53:0/1674171729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 msgr2=0x562434c4da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f99237fe640 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434c4da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f99237fe640 1 -- 172.21.15.53:0/1674171729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562434be64b0 con 0x5624347f01b0 2024-08-31T06:20:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f99237fe640 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434be5680 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f991402a930 tx=0x7f9914005100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e365133d7413c3aa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f9902ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f9902ffd640 1 -- 172.21.15.53:0/1674171729 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914052070 con 0x5624347f01b0 2024-08-31T06:20:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f99300f2740 1 -- 172.21.15.53:0/1674171729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99180a5e50 con 0x5624347f01b0 2024-08-31T06:20:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f9902ffd640 1 -- 172.21.15.53:0/1674171729 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f99140035f0 con 0x5624347f01b0 2024-08-31T06:20:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f9902ffd640 1 -- 172.21.15.53:0/1674171729 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f9914066050 con 0x5624347f01b0 2024-08-31T06:20:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f99300f2740 10 client.20250 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.395+0000 7f99300f2740 1 -- 172.21.15.53:0/1674171729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x562434c4f070 con 0x5624347f01b0 2024-08-31T06:20:02.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.396+0000 7f9902ffd640 1 -- 172.21.15.53:0/1674171729 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99180a5e50 con 0x5624347f01b0 2024-08-31T06:20:02.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.396+0000 7f9902ffd640 1 -- 172.21.15.53:0/1674171729 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f9914056430 con 0x5624347f01b0 2024-08-31T06:20:02.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.396+0000 7f99300f2740 10 client.20250 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:02.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.396+0000 7f99300f2740 10 client.20250 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:20:02.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.396+0000 7f99300f2740 20 client.20250 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:02.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.396+0000 7f99300f2740 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5624347acda0 0x562434c51740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.396+0000 7f99300f2740 4 client.20250 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.396+0000 7f99300f2740 1 -- 172.21.15.53:0/1674171729 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562434b33070 con 0x5624347acda0 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.396+0000 7f9922ffd640 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5624347acda0 0x562434c51740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.397+0000 7f9902ffd640 10 client.20250 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.397+0000 7f9922ffd640 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5624347acda0 0x562434c51740 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6998c9d4b573c97c server_cookie=fd53fcdb34af3ff0 in_seq=0 out_seq=0 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.397+0000 7f9902ffd640 1 -- 172.21.15.53:0/1674171729 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562434b33070 con 0x5624347acda0 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.397+0000 7f9902ffd640 10 client.20250 handle_command_reply: tid=0 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.397+0000 7f99300f2740 1 client.20250 shutdown 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f99300f2740 1 -- 172.21.15.53:0/1674171729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 msgr2=0x562434be5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f99300f2740 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434be5680 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f991402a930 tx=0x7f9914005100 comp rx=0 tx=0).stop 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f99300f2740 1 -- 172.21.15.53:0/1674171729 shutdown_connections 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f99300f2740 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562434819070 0x562434c4da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f99300f2740 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5624347acda0 0x562434c51740 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f99300f2740 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624347f8390 0x562434be5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f99300f2740 1 --2- 172.21.15.53:0/1674171729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624347f01b0 0x562434be5680 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f9902ffd640 0 client.20250 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:20:02.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f99300f2740 1 -- 172.21.15.53:0/1674171729 >> 172.21.15.53:0/1674171729 conn(0x56243480d460 msgr2=0x562434bbf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:02.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f99300f2740 1 -- 172.21.15.53:0/1674171729 shutdown_connections 2024-08-31T06:20:02.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f99300f2740 1 -- 172.21.15.53:0/1674171729 wait complete. 2024-08-31T06:20:02.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.398+0000 7f99300f2740 20 client.20250 trim_cache size 0 max 16384 2024-08-31T06:20:02.405 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:20:02.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 -- 172.21.15.53:0/2180367792 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4da0 msgr2=0x7f990c0b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:02.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4da0 0x7f990c0b72b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f991c005fd0 tx=0x7f991c0096a0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 -- 172.21.15.53:0/2180367792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108170 msgr2=0x7f992419a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:02.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108170 0x7f992419a740 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f991800d770 tx=0x7f991800dc30 comp rx=0 tx=0).stop 2024-08-31T06:20:02.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 -- 172.21.15.53:0/2180367792 shutdown_connections 2024-08-31T06:20:02.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4da0 0x7f990c0b72b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108ac0 0x7f992419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108170 0x7f992419a740 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 --2- 172.21.15.53:0/2180367792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924102880 0x7f992419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:02.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 -- 172.21.15.53:0/2180367792 >> 172.21.15.53:0/2180367792 conn(0x7f9924079500 msgr2=0x7f99241013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:02.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 -- 172.21.15.53:0/2180367792 shutdown_connections 2024-08-31T06:20:02.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:02.399+0000 7f9929b7d640 1 -- 172.21.15.53:0/2180367792 wait complete. 2024-08-31T06:20:03.328 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:20:03.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 12780 7.74 MB/sec warmup 111 sec latency 58.876 ms 2024-08-31T06:20:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:04.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:03 smithi130 ceph-mon[22266]: pgmap v794: 97 pgs: 97 active+clean; 413 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 386 op/s 2024-08-31T06:20:04.173 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:03 smithi053 ceph-mon[18924]: pgmap v794: 97 pgs: 97 active+clean; 413 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 386 op/s 2024-08-31T06:20:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:03 smithi153 ceph-mon[22320]: pgmap v794: 97 pgs: 97 active+clean; 413 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 386 op/s 2024-08-31T06:20:04.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.298+0000 7f41d9fd3640 1 -- 172.21.15.53:0/1059126659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d4108150 msgr2=0x7f41d4108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:04.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.298+0000 7f41d9fd3640 1 --2- 172.21.15.53:0/1059126659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d4108150 0x7f41d4108560 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009900 tx=0x7f41c802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.298+0000 7f41d9fd3640 1 -- 172.21.15.53:0/1059126659 shutdown_connections 2024-08-31T06:20:04.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.298+0000 7f41d9fd3640 1 --2- 172.21.15.53:0/1059126659 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41d4108aa0 0x7f41d410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.298+0000 7f41d9fd3640 1 --2- 172.21.15.53:0/1059126659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d4108150 0x7f41d4108560 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.298+0000 7f41d9fd3640 1 --2- 172.21.15.53:0/1059126659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d4102810 0x7f41d4102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.298+0000 7f41d9fd3640 1 -- 172.21.15.53:0/1059126659 >> 172.21.15.53:0/1059126659 conn(0x7f41d40794d0 msgr2=0x7f41d40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:04.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.298+0000 7f41d9fd3640 1 -- 172.21.15.53:0/1059126659 shutdown_connections 2024-08-31T06:20:04.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.298+0000 7f41d9fd3640 1 -- 172.21.15.53:0/1059126659 wait complete. 2024-08-31T06:20:04.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.299+0000 7f41d9fd3640 1 Processor -- start 2024-08-31T06:20:04.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.299+0000 7f41d9fd3640 1 -- start start 2024-08-31T06:20:04.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d9fd3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41d4102810 0x7f41d41a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d9fd3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d4108150 0x7f41d41a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d9fd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d4108aa0 0x7f41d41a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d9fd3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4111500 con 0x7f41d4108aa0 2024-08-31T06:20:04.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d9fd3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4111380 con 0x7f41d4102810 2024-08-31T06:20:04.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d9fd3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4111680 con 0x7f41d4108150 2024-08-31T06:20:04.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41d4102810 0x7f41d41a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d2ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d4108150 0x7f41d41a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41d4102810 0x7f41d41a07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47932/0 (socket says 172.21.15.53:47932) 2024-08-31T06:20:04.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d37fe640 1 -- 172.21.15.53:0/4048891775 learned_addr learned my addr 172.21.15.53:0/4048891775 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:04.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d3fff640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d4108aa0 0x7f41d41a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d2ffd640 1 -- 172.21.15.53:0/4048891775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41d4102810 msgr2=0x7f41d41a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:04.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d2ffd640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41d4102810 0x7f41d41a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d2ffd640 1 -- 172.21.15.53:0/4048891775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d4108aa0 msgr2=0x7f41d41a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:04.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d2ffd640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d4108aa0 0x7f41d41a5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d2ffd640 1 -- 172.21.15.53:0/4048891775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d41a6710 con 0x7f41d4108150 2024-08-31T06:20:04.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d3fff640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d4108aa0 0x7f41d41a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:04.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.300+0000 7f41d37fe640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41d4102810 0x7f41d41a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:04.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.301+0000 7f41d2ffd640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d4108150 0x7f41d41a0d40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009230 tx=0x7f41c8003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:04.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.301+0000 7f41d0ff9640 1 -- 172.21.15.53:0/4048891775 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c803f070 con 0x7f41d4108150 2024-08-31T06:20:04.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.301+0000 7f41d9fd3640 1 -- 172.21.15.53:0/4048891775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d41a69a0 con 0x7f41d4108150 2024-08-31T06:20:04.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.301+0000 7f41d0ff9640 1 -- 172.21.15.53:0/4048891775 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41c803baf0 con 0x7f41d4108150 2024-08-31T06:20:04.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.301+0000 7f41d0ff9640 1 -- 172.21.15.53:0/4048891775 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8035030 con 0x7f41d4108150 2024-08-31T06:20:04.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.301+0000 7f41d9fd3640 1 -- 172.21.15.53:0/4048891775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d41ad160 con 0x7f41d4108150 2024-08-31T06:20:04.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41d0ff9640 1 -- 172.21.15.53:0/4048891775 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f41c8042070 con 0x7f41d4108150 2024-08-31T06:20:04.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41e0548740 1 Processor -- start 2024-08-31T06:20:04.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41e0548740 1 -- start start 2024-08-31T06:20:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41e0548740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3ad070 0x55718d752310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41e0548740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3841b0 0x55718d752850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41e0548740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d38c390 0x55718d752d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41e0548740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55718d6c9680 con 0x55718d3841b0 2024-08-31T06:20:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41e0548740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55718d6b8c10 con 0x55718d38c390 2024-08-31T06:20:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41e0548740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55718d6bcbc0 con 0x55718d3ad070 2024-08-31T06:20:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41d37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3841b0 0x55718d752850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41d37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3841b0 0x55718d752850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48916/0 (socket says 172.21.15.53:48916) 2024-08-31T06:20:04.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.305+0000 7f41d37fe640 1 -- 172.21.15.53:0/3070497521 learned_addr learned my addr 172.21.15.53:0/3070497521 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:04.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.306+0000 7f41d37fe640 1 -- 172.21.15.53:0/3070497521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3ad070 msgr2=0x55718d752310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:04.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.306+0000 7f41d37fe640 1 --2- 172.21.15.53:0/3070497521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3ad070 0x55718d752310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.306+0000 7f41d37fe640 1 -- 172.21.15.53:0/3070497521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d38c390 msgr2=0x55718d752d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:04.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.306+0000 7f41d37fe640 1 --2- 172.21.15.53:0/3070497521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d38c390 0x55718d752d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.306+0000 7f41d37fe640 1 -- 172.21.15.53:0/3070497521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55718d418650 con 0x55718d3841b0 2024-08-31T06:20:04.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.306+0000 7f41d37fe640 1 --2- 172.21.15.53:0/3070497521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3841b0 0x55718d752850 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f41c4012350 tx=0x7f41c4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc8130b51983c54 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.306+0000 7f41b9ffb640 1 -- 172.21.15.53:0/3070497521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c401a070 con 0x55718d3841b0 2024-08-31T06:20:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.306+0000 7f41b9ffb640 1 -- 172.21.15.53:0/3070497521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41c40168b0 con 0x55718d3841b0 2024-08-31T06:20:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.306+0000 7f41b9ffb640 1 -- 172.21.15.53:0/3070497521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c400a9b0 con 0x55718d3841b0 2024-08-31T06:20:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.307+0000 7f41d0ff9640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f41bc0b4d20 0x7f41bc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.307+0000 7f41d3fff640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f41bc0b4d20 0x7f41bc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.307+0000 7f41d0ff9640 1 -- 172.21.15.53:0/4048891775 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f41c8105a90 con 0x7f41d4108150 2024-08-31T06:20:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.307+0000 7f41e0548740 1 -- 172.21.15.53:0/3070497521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3841b0 msgr2=0x55718d752850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.307+0000 7f41e0548740 1 --2- 172.21.15.53:0/3070497521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3841b0 0x55718d752850 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f41c4012350 tx=0x7f41c4005f90 comp rx=0 tx=0).stop 2024-08-31T06:20:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.308+0000 7f41e0548740 1 -- 172.21.15.53:0/3070497521 shutdown_connections 2024-08-31T06:20:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.308+0000 7f41e0548740 1 --2- 172.21.15.53:0/3070497521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d38c390 0x55718d752d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.308+0000 7f41e0548740 1 --2- 172.21.15.53:0/3070497521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3841b0 0x55718d752850 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.308+0000 7f41e0548740 1 --2- 172.21.15.53:0/3070497521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3ad070 0x55718d752310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.308+0000 7f41e0548740 1 -- 172.21.15.53:0/3070497521 >> 172.21.15.53:0/3070497521 conn(0x55718d3a1460 msgr2=0x55718d750200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:04.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.308+0000 7f41e0548740 1 -- 172.21.15.53:0/3070497521 shutdown_connections 2024-08-31T06:20:04.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.308+0000 7f41d3fff640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f41bc0b4d20 0x7f41bc0b7230 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f41cc005fd0 tx=0x7f41cc00d910 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:04.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.308+0000 7f41e0548740 1 -- 172.21.15.53:0/3070497521 wait complete. 2024-08-31T06:20:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.308+0000 7f41e0548740 1 -- start start 2024-08-31T06:20:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.308+0000 7f41e0548740 1 Processor -- start 2024-08-31T06:20:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41e0548740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 0x55718d75db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41e0548740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d38c390 0x55718d75e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41e0548740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d769e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41e0548740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55718d51b700 con 0x55718d38c390 2024-08-31T06:20:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41e0548740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55718d63f750 con 0x55718d3ad070 2024-08-31T06:20:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41e0548740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55718d760af0 con 0x55718d3841b0 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41e0548740 10 client.0 _ll_register_callbacks cb 0x55718d66ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d769e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d769e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47960/0 (socket says 172.21.15.53:47960) 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41d3fff640 1 -- 172.21.15.53:0/1260555597 learned_addr learned my addr 172.21.15.53:0/1260555597 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41d37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 0x55718d75db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41d2ffd640 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d38c390 0x55718d75e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.309+0000 7f41d3fff640 1 -- 172.21.15.53:0/1260555597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 msgr2=0x55718d75db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41d3fff640 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 0x55718d75db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41d3fff640 1 -- 172.21.15.53:0/1260555597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d38c390 msgr2=0x55718d75e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41d3fff640 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d38c390 0x55718d75e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41d3fff640 1 -- 172.21.15.53:0/1260555597 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55718d678900 con 0x55718d3ad070 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41d2ffd640 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d38c390 0x55718d75e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:04.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41d3fff640 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d769e10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f41cc004a80 tx=0x7f41cc004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91dd7c4e00a439b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41b2ffd640 1 -- 172.21.15.53:0/1260555597 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc02a060 con 0x55718d3ad070 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41b2ffd640 1 -- 172.21.15.53:0/1260555597 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f41cc015030 con 0x55718d3ad070 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41e0548740 1 -- 172.21.15.53:0/1260555597 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41c40168b0 con 0x55718d3ad070 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41b2ffd640 1 -- 172.21.15.53:0/1260555597 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f41cc01d9b0 con 0x55718d3ad070 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41e0548740 10 client.29219 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.310+0000 7f41e0548740 1 -- 172.21.15.53:0/1260555597 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55718d76c9e0 con 0x55718d3ad070 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.311+0000 7f41b2ffd640 1 -- 172.21.15.53:0/1260555597 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41c40168b0 con 0x55718d3ad070 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.311+0000 7f41b2ffd640 1 -- 172.21.15.53:0/1260555597 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f41cc01abf0 con 0x55718d3ad070 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.311+0000 7f41e0548740 10 client.29219 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.311+0000 7f41e0548740 10 client.29219 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:20:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.311+0000 7f41e0548740 20 client.29219 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:04.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.311+0000 7f41e0548740 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55718d36b9f0 0x55718d76ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.311+0000 7f41e0548740 4 client.29219 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:04.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.311+0000 7f41e0548740 1 -- 172.21.15.53:0/1260555597 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55718d6cb5d0 con 0x55718d36b9f0 2024-08-31T06:20:04.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.311+0000 7f41d37fe640 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55718d36b9f0 0x55718d76ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.312+0000 7f41b2ffd640 10 client.29219 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:20:04.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.312+0000 7f41d37fe640 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55718d36b9f0 0x55718d76ff80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=baf2d5ffcdb6a8f4 server_cookie=e6b8bdbf3a835502 in_seq=0 out_seq=0 2024-08-31T06:20:04.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.313+0000 7f41b2ffd640 1 -- 172.21.15.53:0/1260555597 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55718d6cb5d0 con 0x55718d36b9f0 2024-08-31T06:20:04.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.313+0000 7f41b2ffd640 10 client.29219 handle_command_reply: tid=0 2024-08-31T06:20:04.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.313+0000 7f41e0548740 1 client.29219 shutdown 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.313+0000 7f41e0548740 1 -- 172.21.15.53:0/1260555597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 msgr2=0x55718d769e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.313+0000 7f41e0548740 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d769e10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f41cc004a80 tx=0x7f41cc004ab0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.313+0000 7f41e0548740 1 -- 172.21.15.53:0/1260555597 shutdown_connections 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.313+0000 7f41e0548740 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d769e10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.314+0000 7f41e0548740 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55718d36b9f0 0x55718d76ff80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.314+0000 7f41e0548740 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d38c390 0x55718d75e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.314+0000 7f41e0548740 1 --2- 172.21.15.53:0/1260555597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 0x55718d75db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.314+0000 7f41e0548740 1 -- 172.21.15.53:0/1260555597 >> 172.21.15.53:0/1260555597 conn(0x55718d3a1460 msgr2=0x55718d7512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.314+0000 7f41b2ffd640 0 client.29219 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.314+0000 7f41e0548740 1 -- 172.21.15.53:0/1260555597 shutdown_connections 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.314+0000 7f41e0548740 1 -- 172.21.15.53:0/1260555597 wait complete. 2024-08-31T06:20:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.314+0000 7f41e0548740 20 client.29219 trim_cache size 0 max 16384 2024-08-31T06:20:04.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41e0548740 1 Processor -- start 2024-08-31T06:20:04.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41e0548740 1 -- start start 2024-08-31T06:20:04.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41e0548740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 0x55718d769f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41e0548740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d38c390 0x55718d75c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41e0548740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3ad070 0x55718d75c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41e0548740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41b5aa0 con 0x55718d3ad070 2024-08-31T06:20:04.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41e0548740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41b7820 con 0x55718d38c390 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41e0548740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41b6170 con 0x55718d3841b0 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41d2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d38c390 0x55718d75c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41d2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d38c390 0x55718d75c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47970/0 (socket says 172.21.15.53:47970) 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41d2ffd640 1 -- 172.21.15.53:0/2562094610 learned_addr learned my addr 172.21.15.53:0/2562094610 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41d3fff640 1 --2- 172.21.15.53:0/2562094610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3ad070 0x55718d75c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.335+0000 7f41d37fe640 1 --2- 172.21.15.53:0/2562094610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 0x55718d769f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.336+0000 7f41d2ffd640 1 -- 172.21.15.53:0/2562094610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 msgr2=0x55718d769f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.336+0000 7f41d2ffd640 1 --2- 172.21.15.53:0/2562094610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 0x55718d769f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.336+0000 7f41d2ffd640 1 -- 172.21.15.53:0/2562094610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3ad070 msgr2=0x55718d75c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.336+0000 7f41d2ffd640 1 --2- 172.21.15.53:0/2562094610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3ad070 0x55718d75c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.336+0000 7f41d2ffd640 1 -- 172.21.15.53:0/2562094610 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55718d36bc10 con 0x55718d38c390 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.336+0000 7f41d2ffd640 1 --2- 172.21.15.53:0/2562094610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d38c390 0x55718d75c400 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f41c80c8230 tx=0x7f41c80cc050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ecedeaf63dc50f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.336+0000 7f41b97fa640 1 -- 172.21.15.53:0/2562094610 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8049040 con 0x55718d38c390 2024-08-31T06:20:04.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.336+0000 7f41b97fa640 1 -- 172.21.15.53:0/2562094610 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41c8031400 con 0x55718d38c390 2024-08-31T06:20:04.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.336+0000 7f41b97fa640 1 -- 172.21.15.53:0/2562094610 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c81033e0 con 0x55718d38c390 2024-08-31T06:20:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.337+0000 7f41e0548740 1 -- 172.21.15.53:0/2562094610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d38c390 msgr2=0x55718d75c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.337+0000 7f41e0548740 1 --2- 172.21.15.53:0/2562094610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d38c390 0x55718d75c400 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f41c80c8230 tx=0x7f41c80cc050 comp rx=0 tx=0).stop 2024-08-31T06:20:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.337+0000 7f41e0548740 1 -- 172.21.15.53:0/2562094610 shutdown_connections 2024-08-31T06:20:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.337+0000 7f41e0548740 1 --2- 172.21.15.53:0/2562094610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d3ad070 0x55718d75c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.337+0000 7f41e0548740 1 --2- 172.21.15.53:0/2562094610 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d38c390 0x55718d75c400 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.337+0000 7f41e0548740 1 --2- 172.21.15.53:0/2562094610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 0x55718d769f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.337+0000 7f41e0548740 1 -- 172.21.15.53:0/2562094610 >> 172.21.15.53:0/2562094610 conn(0x55718d3a1460 msgr2=0x55718d74ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.337+0000 7f41e0548740 1 -- 172.21.15.53:0/2562094610 shutdown_connections 2024-08-31T06:20:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.337+0000 7f41e0548740 1 -- 172.21.15.53:0/2562094610 wait complete. 2024-08-31T06:20:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.338+0000 7f41e0548740 1 -- start start 2024-08-31T06:20:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.338+0000 7f41e0548740 1 Processor -- start 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41e0548740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 0x55718d766750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41e0548740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d38c390 0x55718d761c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41e0548740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d762350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41e0548740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41b7090 con 0x55718d38c390 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41e0548740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41b6900 con 0x55718d3ad070 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41e0548740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41b3aa0 con 0x55718d3841b0 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41e0548740 10 client.0 _ll_register_callbacks cb 0x7f41cc00d420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d762350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d762350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47982/0 (socket says 172.21.15.53:47982) 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41d3fff640 1 -- 172.21.15.53:0/4282019578 learned_addr learned my addr 172.21.15.53:0/4282019578 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41d2ffd640 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d38c390 0x55718d761c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41d3fff640 1 -- 172.21.15.53:0/4282019578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 msgr2=0x55718d766750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41d3fff640 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 0x55718d766750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41d3fff640 1 -- 172.21.15.53:0/4282019578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d38c390 msgr2=0x55718d761c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:04.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41d3fff640 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d38c390 0x55718d761c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41d3fff640 1 -- 172.21.15.53:0/4282019578 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55718d7d9940 con 0x55718d3ad070 2024-08-31T06:20:04.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41d3fff640 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d762350 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f41cc010010 tx=0x7f41cc02d8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dc3bdec44c7593c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:04.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.339+0000 7f41b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:20:04.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.340+0000 7f41b2ffd640 1 -- 172.21.15.53:0/4282019578 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc03d060 con 0x55718d3ad070 2024-08-31T06:20:04.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.340+0000 7f41b2ffd640 1 -- 172.21.15.53:0/4282019578 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8557+0+0 (secure 0 0 0) 0x7f41cc02dcc0 con 0x55718d3ad070 2024-08-31T06:20:04.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.340+0000 7f41e0548740 1 -- 172.21.15.53:0/4282019578 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55718d6c7070 con 0x55718d3ad070 2024-08-31T06:20:04.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.340+0000 7f41b2ffd640 1 -- 172.21.15.53:0/4282019578 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f41cc00b610 con 0x55718d3ad070 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.340+0000 7f41e0548740 10 client.29225 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.340+0000 7f41e0548740 1 -- 172.21.15.53:0/4282019578 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55718d7daa70 con 0x55718d3ad070 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.340+0000 7f41b2ffd640 1 -- 172.21.15.53:0/4282019578 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41cc01a880 con 0x55718d3ad070 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.341+0000 7f41b2ffd640 1 -- 172.21.15.53:0/4282019578 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f41cc026450 con 0x55718d3ad070 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.341+0000 7f41e0548740 10 client.29225 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.341+0000 7f41e0548740 10 client.29225 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.341+0000 7f41e0548740 20 client.29225 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.341+0000 7f41e0548740 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55718d340da0 0x55718d7dd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.341+0000 7f41e0548740 4 client.29225 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.341+0000 7f41e0548740 1 -- 172.21.15.53:0/4282019578 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55718d6c7070 con 0x55718d340da0 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.341+0000 7f41d37fe640 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55718d340da0 0x55718d7dd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.341+0000 7f41b2ffd640 10 client.29225 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.341+0000 7f41d37fe640 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55718d340da0 0x55718d7dd300 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f4fdbcd5a8fda3a6 server_cookie=77e603905c51bc80 in_seq=0 out_seq=0 2024-08-31T06:20:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41b2ffd640 1 -- 172.21.15.53:0/4282019578 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55718d6c7070 con 0x55718d340da0 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41b2ffd640 10 client.29225 handle_command_reply: tid=0 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 1 client.29225 shutdown 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 1 -- 172.21.15.53:0/4282019578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 msgr2=0x55718d762350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d762350 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f41cc010010 tx=0x7f41cc02d8c0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 1 -- 172.21.15.53:0/4282019578 shutdown_connections 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55718d3ad070 0x55718d762350 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55718d340da0 0x55718d7dd300 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55718d38c390 0x55718d761c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 1 --2- 172.21.15.53:0/4282019578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55718d3841b0 0x55718d766750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 1 -- 172.21.15.53:0/4282019578 >> 172.21.15.53:0/4282019578 conn(0x55718d3a1460 msgr2=0x55718d74fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41b2ffd640 0 client.29225 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 1 -- 172.21.15.53:0/4282019578 shutdown_connections 2024-08-31T06:20:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 1 -- 172.21.15.53:0/4282019578 wait complete. 2024-08-31T06:20:04.349 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:20:04.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.342+0000 7f41e0548740 20 client.29225 trim_cache size 0 max 16384 2024-08-31T06:20:04.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.343+0000 7f41d9fd3640 1 -- 172.21.15.53:0/4048891775 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f41bc0b4d20 msgr2=0x7f41bc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.343+0000 7f41d9fd3640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f41bc0b4d20 0x7f41bc0b7230 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f41cc005fd0 tx=0x7f41cc00d910 comp rx=0 tx=0).stop 2024-08-31T06:20:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.343+0000 7f41d9fd3640 1 -- 172.21.15.53:0/4048891775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d4108150 msgr2=0x7f41d41a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.343+0000 7f41d9fd3640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d4108150 0x7f41d41a0d40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009230 tx=0x7f41c8003b90 comp rx=0 tx=0).stop 2024-08-31T06:20:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.343+0000 7f41d9fd3640 1 -- 172.21.15.53:0/4048891775 shutdown_connections 2024-08-31T06:20:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.343+0000 7f41d9fd3640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f41bc0b4d20 0x7f41bc0b7230 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.343+0000 7f41d9fd3640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d4108aa0 0x7f41d41a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.343+0000 7f41d9fd3640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d4108150 0x7f41d41a0d40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.343+0000 7f41d9fd3640 1 --2- 172.21.15.53:0/4048891775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41d4102810 0x7f41d41a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.343+0000 7f41d9fd3640 1 -- 172.21.15.53:0/4048891775 >> 172.21.15.53:0/4048891775 conn(0x7f41d40794d0 msgr2=0x7f41d4104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.344+0000 7f41d9fd3640 1 -- 172.21.15.53:0/4048891775 shutdown_connections 2024-08-31T06:20:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:04.344+0000 7f41d9fd3640 1 -- 172.21.15.53:0/4048891775 wait complete. 2024-08-31T06:20:04.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 12927 7.72 MB/sec warmup 112 sec latency 67.987 ms 2024-08-31T06:20:05.076 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:20:05.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 13098 7.74 MB/sec warmup 113 sec latency 64.205 ms 2024-08-31T06:20:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:05.958 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:05 smithi053 ceph-mon[18924]: pgmap v795: 97 pgs: 97 active+clean; 414 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 389 op/s 2024-08-31T06:20:06.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.090+0000 7fdc12452640 1 -- 172.21.15.53:0/3718998403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0c108ad0 msgr2=0x7fdc0c10f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:06.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.090+0000 7fdc12452640 1 --2- 172.21.15.53:0/3718998403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0c108ad0 0x7fdc0c10f300 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009ca0 tx=0x7fdc0402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.090+0000 7fdc12452640 1 -- 172.21.15.53:0/3718998403 shutdown_connections 2024-08-31T06:20:06.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.090+0000 7fdc12452640 1 --2- 172.21.15.53:0/3718998403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0c108ad0 0x7fdc0c10f300 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.090+0000 7fdc12452640 1 --2- 172.21.15.53:0/3718998403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc0c108180 0x7fdc0c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.091+0000 7fdc12452640 1 --2- 172.21.15.53:0/3718998403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c102840 0x7fdc0c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.091+0000 7fdc12452640 1 -- 172.21.15.53:0/3718998403 >> 172.21.15.53:0/3718998403 conn(0x7fdc0c079580 msgr2=0x7fdc0c079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:06.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.091+0000 7fdc12452640 1 -- 172.21.15.53:0/3718998403 shutdown_connections 2024-08-31T06:20:06.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.091+0000 7fdc12452640 1 -- 172.21.15.53:0/3718998403 wait complete. 2024-08-31T06:20:06.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.092+0000 7fdc12452640 1 Processor -- start 2024-08-31T06:20:06.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.092+0000 7fdc12452640 1 -- start start 2024-08-31T06:20:06.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.093+0000 7fdc12452640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc0c102840 0x7fdc0c19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.093+0000 7fdc12452640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c108180 0x7fdc0c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.093+0000 7fdc12452640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0c108ad0 0x7fdc0c19f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.093+0000 7fdc0bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc0c102840 0x7fdc0c19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.093+0000 7fdc0bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc0c102840 0x7fdc0c19a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47996/0 (socket says 172.21.15.53:47996) 2024-08-31T06:20:06.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.093+0000 7fdc0bfff640 1 -- 172.21.15.53:0/2116507926 learned_addr learned my addr 172.21.15.53:0/2116507926 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:06.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.093+0000 7fdc12452640 1 -- 172.21.15.53:0/2116507926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c113740 con 0x7fdc0c108ad0 2024-08-31T06:20:06.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.093+0000 7fdc12452640 1 -- 172.21.15.53:0/2116507926 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1135c0 con 0x7fdc0c102840 2024-08-31T06:20:06.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.093+0000 7fdc12452640 1 -- 172.21.15.53:0/2116507926 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1138c0 con 0x7fdc0c108180 2024-08-31T06:20:06.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.093+0000 7fdc109ef640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0c108ad0 0x7fdc0c19f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.093+0000 7fdc0b7fe640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c108180 0x7fdc0c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc0bfff640 1 -- 172.21.15.53:0/2116507926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c108180 msgr2=0x7fdc0c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:06.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc0bfff640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c108180 0x7fdc0c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc0bfff640 1 -- 172.21.15.53:0/2116507926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0c108ad0 msgr2=0x7fdc0c19f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:06.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc0bfff640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0c108ad0 0x7fdc0c19f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc0bfff640 1 -- 172.21.15.53:0/2116507926 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c1a0040 con 0x7fdc0c102840 2024-08-31T06:20:06.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc109ef640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0c108ad0 0x7fdc0c19f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:06.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc0bfff640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc0c102840 0x7fdc0c19a0d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00e9f0 tx=0x7fdbfc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:06.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc097fa640 1 -- 172.21.15.53:0/2116507926 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc00cd80 con 0x7fdc0c102840 2024-08-31T06:20:06.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc12452640 1 -- 172.21.15.53:0/2116507926 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0c1a0330 con 0x7fdc0c102840 2024-08-31T06:20:06.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc097fa640 1 -- 172.21.15.53:0/2116507926 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbfc0108c0 con 0x7fdc0c102840 2024-08-31T06:20:06.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc097fa640 1 -- 172.21.15.53:0/2116507926 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0187c0 con 0x7fdc0c102840 2024-08-31T06:20:06.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.094+0000 7fdc12452640 1 -- 172.21.15.53:0/2116507926 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0c10fc70 con 0x7fdc0c102840 2024-08-31T06:20:06.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.099+0000 7fdc189c7740 1 Processor -- start 2024-08-31T06:20:06.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.099+0000 7fdc189c7740 1 -- start start 2024-08-31T06:20:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.100+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb44f070 0x55e6eb7f4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.100+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb4261b0 0x55e6eb7f4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.100+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb42e390 0x55e6eb7f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.100+0000 7fdc189c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e6eb76b680 con 0x55e6eb42e390 2024-08-31T06:20:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.100+0000 7fdc189c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e6eb75ac10 con 0x55e6eb44f070 2024-08-31T06:20:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.100+0000 7fdc189c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e6eb75ebc0 con 0x55e6eb4261b0 2024-08-31T06:20:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.100+0000 7fdc109ef640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb44f070 0x55e6eb7f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.100+0000 7fdc109ef640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb44f070 0x55e6eb7f4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48006/0 (socket says 172.21.15.53:48006) 2024-08-31T06:20:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.100+0000 7fdc109ef640 1 -- 172.21.15.53:0/4074578416 learned_addr learned my addr 172.21.15.53:0/4074578416 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:06.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.100+0000 7fdc0bfff640 1 --2- 172.21.15.53:0/4074578416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb4261b0 0x55e6eb7f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.100+0000 7fdc097fa640 1 -- 172.21.15.53:0/2116507926 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdbfc018960 con 0x7fdc0c102840 2024-08-31T06:20:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.101+0000 7fdc109ef640 1 -- 172.21.15.53:0/4074578416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb4261b0 msgr2=0x55e6eb7f4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.101+0000 7fdc109ef640 1 --2- 172.21.15.53:0/4074578416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb4261b0 0x55e6eb7f4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.101+0000 7fdc109ef640 1 -- 172.21.15.53:0/4074578416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb42e390 msgr2=0x55e6eb7f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.101+0000 7fdc109ef640 1 --2- 172.21.15.53:0/4074578416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb42e390 0x55e6eb7f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.101+0000 7fdc109ef640 1 -- 172.21.15.53:0/4074578416 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6eb4ba650 con 0x55e6eb44f070 2024-08-31T06:20:06.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.102+0000 7fdc109ef640 1 --2- 172.21.15.53:0/4074578416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb44f070 0x55e6eb7f4310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009ca0 tx=0x7fdc04009870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=830b432ca4a38253 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:06.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.102+0000 7fdbf27fc640 1 -- 172.21.15.53:0/4074578416 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04031c40 con 0x55e6eb44f070 2024-08-31T06:20:06.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.102+0000 7fdbf27fc640 1 -- 172.21.15.53:0/4074578416 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc04036030 con 0x55e6eb44f070 2024-08-31T06:20:06.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.103+0000 7fdbf27fc640 1 -- 172.21.15.53:0/4074578416 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc040046a0 con 0x55e6eb44f070 2024-08-31T06:20:06.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.103+0000 7fdc097fa640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbf40b4d20 0x7fdbf40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.103+0000 7fdc097fa640 1 -- 172.21.15.53:0/2116507926 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7fdbfc0e59b0 con 0x7fdc0c102840 2024-08-31T06:20:06.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.103+0000 7fdc0bfff640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbf40b4d20 0x7fdbf40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.104+0000 7fdc189c7740 1 -- 172.21.15.53:0/4074578416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb44f070 msgr2=0x55e6eb7f4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:06.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.104+0000 7fdc189c7740 1 --2- 172.21.15.53:0/4074578416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb44f070 0x55e6eb7f4310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009ca0 tx=0x7fdc04009870 comp rx=0 tx=0).stop 2024-08-31T06:20:06.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.104+0000 7fdc189c7740 1 -- 172.21.15.53:0/4074578416 shutdown_connections 2024-08-31T06:20:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.104+0000 7fdc189c7740 1 --2- 172.21.15.53:0/4074578416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb42e390 0x55e6eb7f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.104+0000 7fdc189c7740 1 --2- 172.21.15.53:0/4074578416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb4261b0 0x55e6eb7f4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.104+0000 7fdc189c7740 1 --2- 172.21.15.53:0/4074578416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb44f070 0x55e6eb7f4310 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.104+0000 7fdc189c7740 1 -- 172.21.15.53:0/4074578416 >> 172.21.15.53:0/4074578416 conn(0x55e6eb443460 msgr2=0x55e6eb7f2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.105+0000 7fdc189c7740 1 -- 172.21.15.53:0/4074578416 shutdown_connections 2024-08-31T06:20:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.105+0000 7fdc189c7740 1 -- 172.21.15.53:0/4074578416 wait complete. 2024-08-31T06:20:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.105+0000 7fdc0bfff640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbf40b4d20 0x7fdbf40b7230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0e8fd0 tx=0x7fdbfc0eb4b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.105+0000 7fdc189c7740 1 -- start start 2024-08-31T06:20:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.106+0000 7fdc189c7740 1 Processor -- start 2024-08-31T06:20:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.107+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb4261b0 0x55e6eb7ffab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.107+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb42e390 0x55e6eb7ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.107+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb44f070 0x55e6eb80bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.107+0000 7fdc189c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e6eb5bd700 con 0x55e6eb44f070 2024-08-31T06:20:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.107+0000 7fdc189c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e6eb6e1750 con 0x55e6eb4261b0 2024-08-31T06:20:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.107+0000 7fdc189c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e6eb802960 con 0x55e6eb42e390 2024-08-31T06:20:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.107+0000 7fdc189c7740 10 client.0 _ll_register_callbacks cb 0x55e6eb710e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.107+0000 7fdc0b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb42e390 0x55e6eb7ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.107+0000 7fdc109ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb44f070 0x55e6eb80bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.107+0000 7fdc0b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb42e390 0x55e6eb7ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50864/0 (socket says 172.21.15.53:50864) 2024-08-31T06:20:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.107+0000 7fdc0b7fe640 1 -- 172.21.15.53:0/3261919398 learned_addr learned my addr 172.21.15.53:0/3261919398 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:06.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.108+0000 7fdc0b7fe640 1 -- 172.21.15.53:0/3261919398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb4261b0 msgr2=0x55e6eb7ffab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:06.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.108+0000 7fdc0b7fe640 1 --2- 172.21.15.53:0/3261919398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb4261b0 0x55e6eb7ffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.108+0000 7fdc0b7fe640 1 -- 172.21.15.53:0/3261919398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb44f070 msgr2=0x55e6eb80bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:06.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.108+0000 7fdc0b7fe640 1 --2- 172.21.15.53:0/3261919398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb44f070 0x55e6eb80bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.108+0000 7fdc0b7fe640 1 -- 172.21.15.53:0/3261919398 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6eb71a900 con 0x55e6eb42e390 2024-08-31T06:20:06.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.108+0000 7fdc0b7fe640 1 --2- 172.21.15.53:0/3261919398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb42e390 0x55e6eb7ffff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdc000116c0 tx=0x7fdc00011b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2284608537a89c26 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:06.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.108+0000 7fdbeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:20:06.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.108+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/3261919398 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000fd30 con 0x55e6eb42e390 2024-08-31T06:20:06.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.108+0000 7fdc189c7740 1 -- 172.21.15.53:0/3261919398 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc04036030 con 0x55e6eb42e390 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.108+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/3261919398 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7fdc00004020 con 0x55e6eb42e390 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.109+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/3261919398 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fdc00004220 con 0x55e6eb42e390 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.109+0000 7fdc189c7740 10 client.29242 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.109+0000 7fdc189c7740 1 -- 172.21.15.53:0/3261919398 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55e6eb80e7c0 con 0x55e6eb42e390 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.109+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/3261919398 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc04036030 con 0x55e6eb42e390 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.109+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/3261919398 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fdc00019430 con 0x55e6eb42e390 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.109+0000 7fdc189c7740 10 client.29242 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.109+0000 7fdc189c7740 10 client.29242 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.109+0000 7fdc189c7740 20 client.29242 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.109+0000 7fdc189c7740 1 --2- 172.21.15.53:0/3261919398 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55e6eb40d9f0 0x55e6eb811d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.109+0000 7fdc189c7740 4 client.29242 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.109+0000 7fdc189c7740 1 -- 172.21.15.53:0/3261919398 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6eb76d5d0 con 0x55e6eb40d9f0 2024-08-31T06:20:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.110+0000 7fdc109ef640 1 --2- 172.21.15.53:0/3261919398 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55e6eb40d9f0 0x55e6eb811d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.111+0000 7fdbeb7fe640 10 client.29242 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:20:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.111+0000 7fdc109ef640 1 --2- 172.21.15.53:0/3261919398 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55e6eb40d9f0 0x55e6eb811d80 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3d6f672443fc405e server_cookie=f856d7a6b9789c25 in_seq=0 out_seq=0 2024-08-31T06:20:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.112+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/3261919398 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6eb76d5d0 con 0x55e6eb40d9f0 2024-08-31T06:20:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.112+0000 7fdbeb7fe640 10 client.29242 handle_command_reply: tid=0 2024-08-31T06:20:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.112+0000 7fdc189c7740 1 client.29242 shutdown 2024-08-31T06:20:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.112+0000 7fdc189c7740 1 -- 172.21.15.53:0/3261919398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb42e390 msgr2=0x55e6eb7ffff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.112+0000 7fdc189c7740 1 --2- 172.21.15.53:0/3261919398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb42e390 0x55e6eb7ffff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdc000116c0 tx=0x7fdc00011b80 comp rx=0 tx=0).stop 2024-08-31T06:20:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.113+0000 7fdc189c7740 1 -- 172.21.15.53:0/3261919398 shutdown_connections 2024-08-31T06:20:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.113+0000 7fdc189c7740 1 --2- 172.21.15.53:0/3261919398 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55e6eb40d9f0 0x55e6eb811d80 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.113+0000 7fdc189c7740 1 --2- 172.21.15.53:0/3261919398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb44f070 0x55e6eb80bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.113+0000 7fdbeb7fe640 0 client.29242 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:20:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.113+0000 7fdc189c7740 1 --2- 172.21.15.53:0/3261919398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb42e390 0x55e6eb7ffff0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.113+0000 7fdc189c7740 1 --2- 172.21.15.53:0/3261919398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb4261b0 0x55e6eb7ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.113+0000 7fdc189c7740 1 -- 172.21.15.53:0/3261919398 >> 172.21.15.53:0/3261919398 conn(0x55e6eb443460 msgr2=0x55e6eb7f74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.113+0000 7fdc189c7740 1 -- 172.21.15.53:0/3261919398 shutdown_connections 2024-08-31T06:20:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.113+0000 7fdc189c7740 1 -- 172.21.15.53:0/3261919398 wait complete. 2024-08-31T06:20:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.113+0000 7fdc189c7740 20 client.29242 trim_cache size 0 max 16384 2024-08-31T06:20:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:05 smithi130 ceph-mon[22266]: pgmap v795: 97 pgs: 97 active+clean; 414 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 389 op/s 2024-08-31T06:20:06.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc189c7740 1 Processor -- start 2024-08-31T06:20:06.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc189c7740 1 -- start start 2024-08-31T06:20:06.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb40d9f0 0x55e6eb7f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb4261b0 0x55e6eb80bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb42e390 0x55e6eb80c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc189c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b1690 con 0x55e6eb42e390 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc189c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b3410 con 0x55e6eb4261b0 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc189c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b1d60 con 0x55e6eb40d9f0 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc0b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb4261b0 0x55e6eb80bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc109ef640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb40d9f0 0x55e6eb7f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc109ef640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb40d9f0 0x55e6eb7f7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50880/0 (socket says 172.21.15.53:50880) 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc0b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb4261b0 0x55e6eb80bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48030/0 (socket says 172.21.15.53:48030) 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc109ef640 1 -- 172.21.15.53:0/2552946138 learned_addr learned my addr 172.21.15.53:0/2552946138 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.130+0000 7fdc109ef640 1 --2- 172.21.15.53:0/2552946138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb42e390 0x55e6eb80c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.131+0000 7fdc109ef640 1 -- 172.21.15.53:0/2552946138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb4261b0 msgr2=0x55e6eb80bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.131+0000 7fdc109ef640 1 --2- 172.21.15.53:0/2552946138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb4261b0 0x55e6eb80bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.131+0000 7fdc109ef640 1 -- 172.21.15.53:0/2552946138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb42e390 msgr2=0x55e6eb80c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:06.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.131+0000 7fdc109ef640 1 --2- 172.21.15.53:0/2552946138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb42e390 0x55e6eb80c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.131+0000 7fdc109ef640 1 -- 172.21.15.53:0/2552946138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6eb7f8060 con 0x55e6eb40d9f0 2024-08-31T06:20:06.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.131+0000 7fdc0b7fe640 1 --2- 172.21.15.53:0/2552946138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb4261b0 0x55e6eb80bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:06.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.131+0000 7fdc109ef640 1 --2- 172.21.15.53:0/2552946138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb40d9f0 0x55e6eb7f7b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdc04031870 tx=0x7fdc040042a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f36bf2c39a7202d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:06.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.131+0000 7fdbf1ffb640 1 -- 172.21.15.53:0/2552946138 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0405f070 con 0x55e6eb40d9f0 2024-08-31T06:20:06.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.131+0000 7fdbf1ffb640 1 -- 172.21.15.53:0/2552946138 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc04036070 con 0x55e6eb40d9f0 2024-08-31T06:20:06.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.131+0000 7fdbf1ffb640 1 -- 172.21.15.53:0/2552946138 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04003c60 con 0x55e6eb40d9f0 2024-08-31T06:20:06.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.132+0000 7fdc189c7740 1 -- 172.21.15.53:0/2552946138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb40d9f0 msgr2=0x55e6eb7f7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:06.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.132+0000 7fdc189c7740 1 --2- 172.21.15.53:0/2552946138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb40d9f0 0x55e6eb7f7b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdc04031870 tx=0x7fdc040042a0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.132+0000 7fdc189c7740 1 -- 172.21.15.53:0/2552946138 shutdown_connections 2024-08-31T06:20:06.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.132+0000 7fdc189c7740 1 --2- 172.21.15.53:0/2552946138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb42e390 0x55e6eb80c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.132+0000 7fdc189c7740 1 --2- 172.21.15.53:0/2552946138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb4261b0 0x55e6eb80bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.132+0000 7fdc189c7740 1 --2- 172.21.15.53:0/2552946138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb40d9f0 0x55e6eb7f7b20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.132+0000 7fdc189c7740 1 -- 172.21.15.53:0/2552946138 >> 172.21.15.53:0/2552946138 conn(0x55e6eb443460 msgr2=0x55e6eb7f7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:06.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.133+0000 7fdc189c7740 1 -- 172.21.15.53:0/2552946138 shutdown_connections 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.133+0000 7fdc189c7740 1 -- 172.21.15.53:0/2552946138 wait complete. 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.133+0000 7fdc189c7740 1 -- start start 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.133+0000 7fdc189c7740 1 Processor -- start 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb40d9f0 0x55e6eb803c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb4261b0 0x55e6eb8041b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc189c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb42e390 0x55e6eb8046f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc189c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b2c80 con 0x55e6eb4261b0 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc189c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b24f0 con 0x55e6eb40d9f0 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc189c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1af690 con 0x55e6eb42e390 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc189c7740 10 client.0 _ll_register_callbacks cb 0x7fdc00009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb4261b0 0x55e6eb8041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb4261b0 0x55e6eb8041b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49004/0 (socket says 172.21.15.53:49004) 2024-08-31T06:20:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc0b7fe640 1 -- 172.21.15.53:0/1752294967 learned_addr learned my addr 172.21.15.53:0/1752294967 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc0b7fe640 1 -- 172.21.15.53:0/1752294967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb42e390 msgr2=0x55e6eb8046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc0b7fe640 1 --2- 172.21.15.53:0/1752294967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb42e390 0x55e6eb8046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc0b7fe640 1 -- 172.21.15.53:0/1752294967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb40d9f0 msgr2=0x55e6eb803c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc0b7fe640 1 --2- 172.21.15.53:0/1752294967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb40d9f0 0x55e6eb803c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.134+0000 7fdc0b7fe640 1 -- 172.21.15.53:0/1752294967 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6eb87b820 con 0x55e6eb4261b0 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.135+0000 7fdc0b7fe640 1 --2- 172.21.15.53:0/1752294967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb4261b0 0x55e6eb8041b0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fdc00014020 tx=0x7fdc00005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910261f5a2d351c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.135+0000 7fdbeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.135+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/1752294967 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00021460 con 0x55e6eb4261b0 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.135+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/1752294967 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7fdc00021600 con 0x55e6eb4261b0 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.135+0000 7fdc189c7740 1 -- 172.21.15.53:0/1752294967 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc04036070 con 0x55e6eb4261b0 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.135+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/1752294967 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fdc00037050 con 0x55e6eb4261b0 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.135+0000 7fdc189c7740 10 client.20283 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.135+0000 7fdc189c7740 1 -- 172.21.15.53:0/1752294967 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55e6eb87cab0 con 0x55e6eb4261b0 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.136+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/1752294967 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc04036070 con 0x55e6eb4261b0 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.136+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/1752294967 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fdc00032030 con 0x55e6eb4261b0 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.136+0000 7fdc189c7740 10 client.20283 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.136+0000 7fdc189c7740 10 client.20283 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.136+0000 7fdc189c7740 20 client.20283 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.136+0000 7fdc189c7740 1 --2- 172.21.15.53:0/1752294967 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55e6eb44f070 0x55e6eb87f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.136+0000 7fdc189c7740 4 client.20283 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.136+0000 7fdc189c7740 1 -- 172.21.15.53:0/1752294967 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6eb769070 con 0x55e6eb44f070 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.136+0000 7fdc109ef640 1 --2- 172.21.15.53:0/1752294967 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55e6eb44f070 0x55e6eb87f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdbeb7fe640 10 client.20283 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdc109ef640 1 --2- 172.21.15.53:0/1752294967 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55e6eb44f070 0x55e6eb87f350 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33d1b83b4be837c server_cookie=f279b475de8a56f7 in_seq=0 out_seq=0 2024-08-31T06:20:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdbeb7fe640 1 -- 172.21.15.53:0/1752294967 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6eb769070 con 0x55e6eb44f070 2024-08-31T06:20:06.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdbeb7fe640 10 client.20283 handle_command_reply: tid=0 2024-08-31T06:20:06.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdc189c7740 1 client.20283 shutdown 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdc189c7740 1 -- 172.21.15.53:0/1752294967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb4261b0 msgr2=0x55e6eb8041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdc189c7740 1 --2- 172.21.15.53:0/1752294967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb4261b0 0x55e6eb8041b0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fdc00014020 tx=0x7fdc00005780 comp rx=0 tx=0).stop 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdc189c7740 1 -- 172.21.15.53:0/1752294967 shutdown_connections 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdc189c7740 1 --2- 172.21.15.53:0/1752294967 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55e6eb44f070 0x55e6eb87f350 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdc189c7740 1 --2- 172.21.15.53:0/1752294967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6eb42e390 0x55e6eb8046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdbeb7fe640 0 client.20283 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdc189c7740 1 --2- 172.21.15.53:0/1752294967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6eb4261b0 0x55e6eb8041b0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdc189c7740 1 --2- 172.21.15.53:0/1752294967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e6eb40d9f0 0x55e6eb803c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdc189c7740 1 -- 172.21.15.53:0/1752294967 >> 172.21.15.53:0/1752294967 conn(0x55e6eb443460 msgr2=0x55e6eb7f5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.137+0000 7fdc189c7740 1 -- 172.21.15.53:0/1752294967 shutdown_connections 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.138+0000 7fdc189c7740 1 -- 172.21.15.53:0/1752294967 wait complete. 2024-08-31T06:20:06.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.138+0000 7fdc189c7740 20 client.20283 trim_cache size 0 max 16384 2024-08-31T06:20:06.145 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:20:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.138+0000 7fdc12452640 1 -- 172.21.15.53:0/2116507926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbf40b4d20 msgr2=0x7fdbf40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.138+0000 7fdc12452640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbf40b4d20 0x7fdbf40b7230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0e8fd0 tx=0x7fdbfc0eb4b0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.138+0000 7fdc12452640 1 -- 172.21.15.53:0/2116507926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc0c102840 msgr2=0x7fdc0c19a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.138+0000 7fdc12452640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc0c102840 0x7fdc0c19a0d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00e9f0 tx=0x7fdbfc00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.139+0000 7fdc12452640 1 -- 172.21.15.53:0/2116507926 shutdown_connections 2024-08-31T06:20:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.139+0000 7fdc12452640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdbf40b4d20 0x7fdbf40b7230 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.139+0000 7fdc12452640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0c108ad0 0x7fdc0c19f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.139+0000 7fdc12452640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc0c108180 0x7fdc0c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.139+0000 7fdc12452640 1 --2- 172.21.15.53:0/2116507926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc0c102840 0x7fdc0c19a0d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.139+0000 7fdc12452640 1 -- 172.21.15.53:0/2116507926 >> 172.21.15.53:0/2116507926 conn(0x7fdc0c079580 msgr2=0x7fdc0c104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.139+0000 7fdc12452640 1 -- 172.21.15.53:0/2116507926 shutdown_connections 2024-08-31T06:20:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:06.139+0000 7fdc12452640 1 -- 172.21.15.53:0/2116507926 wait complete. 2024-08-31T06:20:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:05 smithi153 ceph-mon[22320]: pgmap v795: 97 pgs: 97 active+clean; 414 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 389 op/s 2024-08-31T06:20:06.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 13242 7.72 MB/sec warmup 114 sec latency 90.392 ms 2024-08-31T06:20:06.965 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:06 smithi053 ceph-mon[18924]: osdmap e93: 12 total, 12 up, 12 in 2024-08-31T06:20:07.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:20:07.029 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:06 smithi130 ceph-mon[22266]: osdmap e93: 12 total, 12 up, 12 in 2024-08-31T06:20:07.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:06 smithi153 ceph-mon[22320]: osdmap e93: 12 total, 12 up, 12 in 2024-08-31T06:20:07.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 13386 7.72 MB/sec warmup 115 sec latency 72.677 ms 2024-08-31T06:20:07.366 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:07.777 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:07 smithi053 ceph-mon[18924]: pgmap v797: 97 pgs: 97 active+clean; 420 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 363 op/s 2024-08-31T06:20:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.962+0000 7f6647c7e640 1 -- 172.21.15.53:0/2902636567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6640109b10 msgr2=0x7f6640110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.962+0000 7f6647c7e640 1 --2- 172.21.15.53:0/2902636567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6640109b10 0x7f6640110340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6638009be0 tx=0x7f663802a6c0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.962+0000 7f6647c7e640 1 -- 172.21.15.53:0/2902636567 shutdown_connections 2024-08-31T06:20:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.962+0000 7f6647c7e640 1 --2- 172.21.15.53:0/2902636567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6640109b10 0x7f6640110340 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.962+0000 7f6647c7e640 1 --2- 172.21.15.53:0/2902636567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66401091c0 0x7f66401095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.962+0000 7f6647c7e640 1 --2- 172.21.15.53:0/2902636567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6640103890 0x7f6640103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.962+0000 7f6647c7e640 1 -- 172.21.15.53:0/2902636567 >> 172.21.15.53:0/2902636567 conn(0x7f66400ff310 msgr2=0x7f6640101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.962+0000 7f6647c7e640 1 -- 172.21.15.53:0/2902636567 shutdown_connections 2024-08-31T06:20:07.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.962+0000 7f6647c7e640 1 -- 172.21.15.53:0/2902636567 wait complete. 2024-08-31T06:20:07.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.963+0000 7f6647c7e640 1 Processor -- start 2024-08-31T06:20:07.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.963+0000 7f6647c7e640 1 -- start start 2024-08-31T06:20:07.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6647c7e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6640103890 0x7f6640110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:07.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6647c7e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66401091c0 0x7f664010d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:07.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6647c7e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6640109b10 0x7f664010d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:07.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6647c7e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6640076910 con 0x7f66401091c0 2024-08-31T06:20:07.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6647c7e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6640076790 con 0x7f6640103890 2024-08-31T06:20:07.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6647c7e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6640076a90 con 0x7f6640109b10 2024-08-31T06:20:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f664621b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6640109b10 0x7f664010d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6645a1a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6640103890 0x7f6640110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f664621b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6640109b10 0x7f664010d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50910/0 (socket says 172.21.15.53:50910) 2024-08-31T06:20:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6645219640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66401091c0 0x7f664010d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:07.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f664621b640 1 -- 172.21.15.53:0/1862012058 learned_addr learned my addr 172.21.15.53:0/1862012058 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6645a1a640 1 -- 172.21.15.53:0/1862012058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6640109b10 msgr2=0x7f664010d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6645a1a640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6640109b10 0x7f664010d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6645a1a640 1 -- 172.21.15.53:0/1862012058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66401091c0 msgr2=0x7f664010d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6645a1a640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66401091c0 0x7f664010d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6645a1a640 1 -- 172.21.15.53:0/1862012058 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664010e050 con 0x7f6640103890 2024-08-31T06:20:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.964+0000 7f6645219640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66401091c0 0x7f664010d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.965+0000 7f6645a1a640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6640103890 0x7f6640110060 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f663c00e9f0 tx=0x7f663c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.965+0000 7f6636ffd640 1 -- 172.21.15.53:0/1862012058 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c00ccc0 con 0x7f6640103890 2024-08-31T06:20:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.965+0000 7f6636ffd640 1 -- 172.21.15.53:0/1862012058 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f663c005020 con 0x7f6640103890 2024-08-31T06:20:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.965+0000 7f6636ffd640 1 -- 172.21.15.53:0/1862012058 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c00ce60 con 0x7f6640103890 2024-08-31T06:20:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.965+0000 7f6647c7e640 1 -- 172.21.15.53:0/1862012058 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66401acaa0 con 0x7f6640103890 2024-08-31T06:20:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.965+0000 7f6647c7e640 1 -- 172.21.15.53:0/1862012058 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66401acfa0 con 0x7f6640103890 2024-08-31T06:20:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.969+0000 7f664ebe9740 1 Processor -- start 2024-08-31T06:20:07.971 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.969+0000 7f664ebe9740 1 -- start start 2024-08-31T06:20:07.972 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.969+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 0x56514b395ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b396220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 0x56514b396760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f6636ffd640 1 -- 172.21.15.53:0/1862012058 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f663c004a60 con 0x7f6640103890 2024-08-31T06:20:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f664ebe9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56514b30b000 con 0x56514afd14d0 2024-08-31T06:20:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f664ebe9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56514b2fa590 con 0x56514aff21b0 2024-08-31T06:20:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f664ebe9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56514b2fe540 con 0x56514afc92f0 2024-08-31T06:20:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f6645a1a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b396220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f6645219640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 0x56514b396760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f664621b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 0x56514b395ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f6645219640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 0x56514b396760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49034/0 (socket says 172.21.15.53:49034) 2024-08-31T06:20:07.973 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f6645219640 1 -- 172.21.15.53:0/3436702023 learned_addr learned my addr 172.21.15.53:0/3436702023 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:07.974 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f6645a1a640 1 -- 172.21.15.53:0/3436702023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 msgr2=0x56514b395ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:07.974 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f6645a1a640 1 --2- 172.21.15.53:0/3436702023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 0x56514b395ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.974 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f6645a1a640 1 -- 172.21.15.53:0/3436702023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 msgr2=0x56514b396760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:07.974 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f6645a1a640 1 --2- 172.21.15.53:0/3436702023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 0x56514b396760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.974 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f6645a1a640 1 -- 172.21.15.53:0/3436702023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514b05d790 con 0x56514afc92f0 2024-08-31T06:20:07.974 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.970+0000 7f664621b640 1 --2- 172.21.15.53:0/3436702023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 0x56514b395ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.971+0000 7f6645a1a640 1 --2- 172.21.15.53:0/3436702023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b396220 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f663c0e2ba0 tx=0x7f663c0eb770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88d91a4a2737cf4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.971+0000 7f662bfff640 1 -- 172.21.15.53:0/3436702023 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c0f9070 con 0x56514afc92f0 2024-08-31T06:20:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.971+0000 7f662bfff640 1 -- 172.21.15.53:0/3436702023 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f663c0e5d90 con 0x56514afc92f0 2024-08-31T06:20:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.971+0000 7f662bfff640 1 -- 172.21.15.53:0/3436702023 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c0f1770 con 0x56514afc92f0 2024-08-31T06:20:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.971+0000 7f6636ffd640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f662c0b4d20 0x7f662c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.972+0000 7f664621b640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f662c0b4d20 0x7f662c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.972+0000 7f6636ffd640 1 -- 172.21.15.53:0/1862012058 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7f663c0e54d0 con 0x7f6640103890 2024-08-31T06:20:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.972+0000 7f664ebe9740 1 -- 172.21.15.53:0/3436702023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 msgr2=0x56514b396220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.972+0000 7f664621b640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f662c0b4d20 0x7f662c0b7230 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6638009420 tx=0x7f66380303a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.972+0000 7f664ebe9740 1 --2- 172.21.15.53:0/3436702023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b396220 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f663c0e2ba0 tx=0x7f663c0eb770 comp rx=0 tx=0).stop 2024-08-31T06:20:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.973+0000 7f664ebe9740 1 -- 172.21.15.53:0/3436702023 shutdown_connections 2024-08-31T06:20:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.973+0000 7f664ebe9740 1 --2- 172.21.15.53:0/3436702023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 0x56514b396760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.973+0000 7f664ebe9740 1 --2- 172.21.15.53:0/3436702023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b396220 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.973+0000 7f664ebe9740 1 --2- 172.21.15.53:0/3436702023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 0x56514b395ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.973+0000 7f664ebe9740 1 -- 172.21.15.53:0/3436702023 >> 172.21.15.53:0/3436702023 conn(0x56514afe6300 msgr2=0x56514b393bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.973+0000 7f664ebe9740 1 -- 172.21.15.53:0/3436702023 shutdown_connections 2024-08-31T06:20:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.973+0000 7f664ebe9740 1 -- 172.21.15.53:0/3436702023 wait complete. 2024-08-31T06:20:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.974+0000 7f664ebe9740 1 -- start start 2024-08-31T06:20:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.974+0000 7f664ebe9740 1 Processor -- start 2024-08-31T06:20:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.975+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afc92f0 0x56514b3a1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.975+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afd14d0 0x56514b3a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.975+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514aff21b0 0x56514b3ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.975+0000 7f6645a1a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afc92f0 0x56514b3a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.975+0000 7f6645a1a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afc92f0 0x56514b3a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48082/0 (socket says 172.21.15.53:48082) 2024-08-31T06:20:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.975+0000 7f6645219640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afd14d0 0x56514b3a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.975+0000 7f6645219640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afd14d0 0x56514b3a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50924/0 (socket says 172.21.15.53:50924) 2024-08-31T06:20:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.975+0000 7f6645a1a640 1 -- 172.21.15.53:0/1811629157 learned_addr learned my addr 172.21.15.53:0/1811629157 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f664ebe9740 1 -- 172.21.15.53:0/1811629157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56514b233ab0 con 0x56514aff21b0 2024-08-31T06:20:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f664ebe9740 1 -- 172.21.15.53:0/1811629157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56514b281680 con 0x56514afc92f0 2024-08-31T06:20:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f664621b640 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514aff21b0 0x56514b3ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f664ebe9740 1 -- 172.21.15.53:0/1811629157 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56514b3a4460 con 0x56514afd14d0 2024-08-31T06:20:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f664ebe9740 10 client.0 _ll_register_callbacks cb 0x56514b009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f6645a1a640 1 -- 172.21.15.53:0/1811629157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afd14d0 msgr2=0x56514b3a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f6645a1a640 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afd14d0 0x56514b3a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f6645a1a640 1 -- 172.21.15.53:0/1811629157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514aff21b0 msgr2=0x56514b3ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f6645a1a640 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514aff21b0 0x56514b3ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f6645a1a640 1 -- 172.21.15.53:0/1811629157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56514b0d6620 con 0x56514afc92f0 2024-08-31T06:20:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f664ebe9740 1 -- 172.21.15.53:0/1811629157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f663c0e5d90 con 0x56514afc92f0 2024-08-31T06:20:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.976+0000 7f6645a1a640 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afc92f0 0x56514b3a1890 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f663c0a7bf0 tx=0x7f663c0e57d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fca5d5e7e482424 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.977+0000 7f66297fa640 10 client.29249 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.977+0000 7f66297fa640 1 -- 172.21.15.53:0/1811629157 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c01c070 con 0x56514afc92f0 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.977+0000 7f66297fa640 1 -- 172.21.15.53:0/1811629157 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7f663c0e5b90 con 0x56514afc92f0 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.977+0000 7f66297fa640 1 -- 172.21.15.53:0/1811629157 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f663c0a7a30 con 0x56514afc92f0 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.977+0000 7f664ebe9740 10 client.29249 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.977+0000 7f664ebe9740 1 -- 172.21.15.53:0/1811629157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=56}) -- 0x56514b3b02d0 con 0x56514afc92f0 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.977+0000 7f66297fa640 1 -- 172.21.15.53:0/1811629157 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f663c0e2e50 con 0x56514afc92f0 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.977+0000 7f664ebe9740 10 client.29249 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.977+0000 7f664ebe9740 10 client.29249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.977+0000 7f664ebe9740 20 client.29249 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.977+0000 7f664ebe9740 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56514afb0d80 0x56514b3b3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.978+0000 7f664ebe9740 4 client.29249 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:07.981 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.978+0000 7f664ebe9740 1 -- 172.21.15.53:0/1811629157 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56514b30cf50 con 0x56514afb0d80 2024-08-31T06:20:07.982 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.978+0000 7f6645219640 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56514afb0d80 0x56514b3b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.978+0000 7f6645219640 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56514afb0d80 0x56514b3b3950 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fc15479dc1d9df6 server_cookie=b620321c1ef59819 in_seq=0 out_seq=0 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.978+0000 7f66297fa640 10 client.29249 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f66297fa640 1 -- 172.21.15.53:0/1811629157 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56514b30cf50 con 0x56514afb0d80 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f66297fa640 10 client.29249 handle_command_reply: tid=0 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f664ebe9740 1 client.29249 shutdown 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f664ebe9740 1 -- 172.21.15.53:0/1811629157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afc92f0 msgr2=0x56514b3a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f664ebe9740 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afc92f0 0x56514b3a1890 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f663c0a7bf0 tx=0x7f663c0e57d0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f664ebe9740 1 -- 172.21.15.53:0/1811629157 shutdown_connections 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f664ebe9740 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56514afb0d80 0x56514b3b3950 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f66297fa640 0 client.29249 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f664ebe9740 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514aff21b0 0x56514b3ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f664ebe9740 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afd14d0 0x56514b3a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f664ebe9740 1 --2- 172.21.15.53:0/1811629157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afc92f0 0x56514b3a1890 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.979+0000 7f664ebe9740 1 -- 172.21.15.53:0/1811629157 >> 172.21.15.53:0/1811629157 conn(0x56514afe6300 msgr2=0x56514b396d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.980+0000 7f664ebe9740 1 -- 172.21.15.53:0/1811629157 shutdown_connections 2024-08-31T06:20:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.980+0000 7f664ebe9740 1 -- 172.21.15.53:0/1811629157 wait complete. 2024-08-31T06:20:07.984 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:07.980+0000 7f664ebe9740 20 client.29249 trim_cache size 0 max 16384 2024-08-31T06:20:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.000+0000 7f664ebe9740 1 Processor -- start 2024-08-31T06:20:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.000+0000 7f664ebe9740 1 -- start start 2024-08-31T06:20:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b3976d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 0x56514b39bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 0x56514b3a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f664ebe9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b5b10 con 0x56514afd14d0 2024-08-31T06:20:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f664ebe9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b7890 con 0x56514aff21b0 2024-08-31T06:20:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f664ebe9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b61e0 con 0x56514afc92f0 2024-08-31T06:20:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f6645219640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 0x56514b39bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f6645219640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 0x56514b39bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49060/0 (socket says 172.21.15.53:49060) 2024-08-31T06:20:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f6645219640 1 -- 172.21.15.53:0/1570853509 learned_addr learned my addr 172.21.15.53:0/1570853509 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f664621b640 1 --2- 172.21.15.53:0/1570853509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 0x56514b3a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f6645a1a640 1 --2- 172.21.15.53:0/1570853509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b3976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f664621b640 1 -- 172.21.15.53:0/1570853509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 msgr2=0x56514b3976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.001+0000 7f664621b640 1 --2- 172.21.15.53:0/1570853509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b3976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.002+0000 7f664621b640 1 -- 172.21.15.53:0/1570853509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 msgr2=0x56514b39bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.002+0000 7f664621b640 1 --2- 172.21.15.53:0/1570853509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 0x56514b39bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.002+0000 7f664621b640 1 -- 172.21.15.53:0/1570853509 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514b38eaa0 con 0x56514aff21b0 2024-08-31T06:20:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.002+0000 7f6645219640 1 --2- 172.21.15.53:0/1570853509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 0x56514b39bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.002+0000 7f664621b640 1 --2- 172.21.15.53:0/1570853509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 0x56514b3a32b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6638009370 tx=0x7f6638040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a88e9886b147a477 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.002+0000 7f662b7fe640 1 -- 172.21.15.53:0/1570853509 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638036040 con 0x56514aff21b0 2024-08-31T06:20:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.002+0000 7f662b7fe640 1 -- 172.21.15.53:0/1570853509 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6638037040 con 0x56514aff21b0 2024-08-31T06:20:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.002+0000 7f662b7fe640 1 -- 172.21.15.53:0/1570853509 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663803f7d0 con 0x56514aff21b0 2024-08-31T06:20:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.004+0000 7f664ebe9740 1 -- 172.21.15.53:0/1570853509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 msgr2=0x56514b3a32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.004+0000 7f664ebe9740 1 --2- 172.21.15.53:0/1570853509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 0x56514b3a32b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6638009370 tx=0x7f6638040000 comp rx=0 tx=0).stop 2024-08-31T06:20:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.004+0000 7f664ebe9740 1 -- 172.21.15.53:0/1570853509 shutdown_connections 2024-08-31T06:20:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.004+0000 7f664ebe9740 1 --2- 172.21.15.53:0/1570853509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514aff21b0 0x56514b3a32b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.004+0000 7f664ebe9740 1 --2- 172.21.15.53:0/1570853509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514afd14d0 0x56514b39bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.004+0000 7f664ebe9740 1 --2- 172.21.15.53:0/1570853509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b3976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.004+0000 7f664ebe9740 1 -- 172.21.15.53:0/1570853509 >> 172.21.15.53:0/1570853509 conn(0x56514afe6300 msgr2=0x56514b3a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.004+0000 7f664ebe9740 1 -- 172.21.15.53:0/1570853509 shutdown_connections 2024-08-31T06:20:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.004+0000 7f664ebe9740 1 -- 172.21.15.53:0/1570853509 wait complete. 2024-08-31T06:20:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.004+0000 7f664ebe9740 1 -- start start 2024-08-31T06:20:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.005+0000 7f664ebe9740 1 Processor -- start 2024-08-31T06:20:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.005+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b3a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.005+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afd14d0 0x56514b3a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.005+0000 7f664ebe9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514aff21b0 0x56514b41c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.005+0000 7f664ebe9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b7100 con 0x56514aff21b0 2024-08-31T06:20:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.005+0000 7f664ebe9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b6970 con 0x56514afd14d0 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.005+0000 7f664ebe9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f66401b3b10 con 0x56514afc92f0 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.005+0000 7f664ebe9740 10 client.0 _ll_register_callbacks cb 0x7f663c0f7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.005+0000 7f6645219640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afd14d0 0x56514b3a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f6645219640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afd14d0 0x56514b3a53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48102/0 (socket says 172.21.15.53:48102) 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f6645219640 1 -- 172.21.15.53:0/89055566 learned_addr learned my addr 172.21.15.53:0/89055566 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f664621b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514aff21b0 0x56514b41c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f6645a1a640 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b3a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f6645219640 1 -- 172.21.15.53:0/89055566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 msgr2=0x56514b3a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f6645219640 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b3a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f6645219640 1 -- 172.21.15.53:0/89055566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514aff21b0 msgr2=0x56514b41c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f6645219640 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514aff21b0 0x56514b41c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f6645219640 1 -- 172.21.15.53:0/89055566 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56514b41c840 con 0x56514afd14d0 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f6645219640 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afd14d0 0x56514b3a53f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x56514b3a4030 tx=0x7f6630012be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c2bb6800308acbc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f66297fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f66297fa640 1 -- 172.21.15.53:0/89055566 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6630004020 con 0x56514afd14d0 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f66297fa640 1 -- 172.21.15.53:0/89055566 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7f66300041c0 con 0x56514afd14d0 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.006+0000 7f664ebe9740 1 -- 172.21.15.53:0/89055566 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6638037040 con 0x56514afd14d0 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f66297fa640 1 -- 172.21.15.53:0/89055566 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f6630031050 con 0x56514afd14d0 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f664ebe9740 10 client.29255 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f664ebe9740 1 -- 172.21.15.53:0/89055566 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x56514b41daf0 con 0x56514afd14d0 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f66297fa640 1 -- 172.21.15.53:0/89055566 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6638037040 con 0x56514afd14d0 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f66297fa640 1 -- 172.21.15.53:0/89055566 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f6630003890 con 0x56514afd14d0 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f664ebe9740 10 client.29255 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f664ebe9740 10 client.29255 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f664ebe9740 20 client.29255 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f664ebe9740 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56514af861c0 0x56514b4203d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f664ebe9740 4 client.29255 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:20:08.011 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f664ebe9740 1 -- 172.21.15.53:0/89055566 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56514b3089f0 con 0x56514af861c0 2024-08-31T06:20:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.007+0000 7f6645a1a640 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56514af861c0 0x56514b4203d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.008+0000 7f66297fa640 10 client.29255 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.008+0000 7f6645a1a640 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56514af861c0 0x56514b4203d0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9da963e8411947f9 server_cookie=f9562c482b95b85a in_seq=0 out_seq=0 2024-08-31T06:20:08.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.020+0000 7f2c8c977640 1 -- 172.21.15.53:0/3730399163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c88106020 msgr2=0x7f2c88106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.020+0000 7f2c8c977640 1 --2- 172.21.15.53:0/3730399163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c88106020 0x7f2c88106430 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00fb10 tx=0x7f2c7c02e570 comp rx=0 tx=0).stop 2024-08-31T06:20:08.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.020+0000 7f2c8c977640 1 -- 172.21.15.53:0/3730399163 shutdown_connections 2024-08-31T06:20:08.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.020+0000 7f2c8c977640 1 --2- 172.21.15.53:0/3730399163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c88106970 0x7f2c88110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.020+0000 7f2c8c977640 1 --2- 172.21.15.53:0/3730399163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c88106020 0x7f2c88106430 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.020+0000 7f2c8c977640 1 --2- 172.21.15.53:0/3730399163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c88101dd0 0x7f2c881021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.020+0000 7f2c8c977640 1 -- 172.21.15.53:0/3730399163 >> 172.21.15.53:0/3730399163 conn(0x7f2c88077a00 msgr2=0x7f2c88077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:08.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.020+0000 7f2c8c977640 1 -- 172.21.15.53:0/3730399163 shutdown_connections 2024-08-31T06:20:08.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.020+0000 7f2c8c977640 1 -- 172.21.15.53:0/3730399163 wait complete. 2024-08-31T06:20:08.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.021+0000 7f2c8c977640 1 Processor -- start 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.021+0000 7f2c8c977640 1 -- start start 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.021+0000 7f2c8c977640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c88101dd0 0x7f2c881a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8c977640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c88106020 0x7f2c881a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8c977640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c88106970 0x7f2c881a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8c977640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88111500 con 0x7f2c88101dd0 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8c977640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88111380 con 0x7f2c88106970 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8c977640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88111680 con 0x7f2c88106020 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c88101dd0 0x7f2c881a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c88101dd0 0x7f2c881a0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49086/0 (socket says 172.21.15.53:49086) 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8659c640 1 -- 172.21.15.53:0/3022440237 learned_addr learned my addr 172.21.15.53:0/3022440237 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c88106020 0x7f2c881a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c86d9d640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c88106970 0x7f2c881a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8659c640 1 -- 172.21.15.53:0/3022440237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c88106020 msgr2=0x7f2c881a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8659c640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c88106020 0x7f2c881a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8659c640 1 -- 172.21.15.53:0/3022440237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c88106970 msgr2=0x7f2c881a60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8659c640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c88106970 0x7f2c881a60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8659c640 1 -- 172.21.15.53:0/3022440237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c881a67f0 con 0x7f2c88101dd0 2024-08-31T06:20:08.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.022+0000 7f2c8659c640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c88101dd0 0x7f2c881a0880 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800e9c0 tx=0x7f2c7800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:08.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.023+0000 7f2c777fe640 1 -- 172.21.15.53:0/3022440237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800cd80 con 0x7f2c88101dd0 2024-08-31T06:20:08.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.023+0000 7f2c8c977640 1 -- 172.21.15.53:0/3022440237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c881a6ae0 con 0x7f2c88101dd0 2024-08-31T06:20:08.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.023+0000 7f2c8c977640 1 -- 172.21.15.53:0/3022440237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c881ad240 con 0x7f2c88101dd0 2024-08-31T06:20:08.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.023+0000 7f2c777fe640 1 -- 172.21.15.53:0/3022440237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c780044b0 con 0x7f2c88101dd0 2024-08-31T06:20:08.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.023+0000 7f2c777fe640 1 -- 172.21.15.53:0/3022440237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78010430 con 0x7f2c88101dd0 2024-08-31T06:20:08.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.026+0000 7f2c777fe640 1 -- 172.21.15.53:0/3022440237 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2c780035f0 con 0x7f2c88101dd0 2024-08-31T06:20:08.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.027+0000 7f2c92eec740 1 Processor -- start 2024-08-31T06:20:08.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.027+0000 7f2c777fe640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c700b4d20 0x7f2c700b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.027+0000 7f2c92eec740 1 -- start start 2024-08-31T06:20:08.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.027+0000 7f2c777fe640 1 -- 172.21.15.53:0/3022440237 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7f2c780e57b0 con 0x7f2c88101dd0 2024-08-31T06:20:08.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c86d9d640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c700b4d20 0x7f2c700b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 0x55f8f6688310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62ba1b0 0x55f8f6688850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62c2390 0x55f8f6688d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c92eec740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f8f65ff680 con 0x55f8f62e3070 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c92eec740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f8f65eec10 con 0x55f8f62c2390 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c92eec740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f8f65f2bc0 con 0x55f8f62ba1b0 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c8659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 0x55f8f6688310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c85d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62ba1b0 0x55f8f6688850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c8659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 0x55f8f6688310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49100/0 (socket says 172.21.15.53:49100) 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c85d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62ba1b0 0x55f8f6688850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50954/0 (socket says 172.21.15.53:50954) 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.028+0000 7f2c8659c640 1 -- 172.21.15.53:0/6546388 learned_addr learned my addr 172.21.15.53:0/6546388 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.029+0000 7f2c85d9b640 1 -- 172.21.15.53:0/6546388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62c2390 msgr2=0x55f8f6688d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.029+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/6546388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62c2390 0x55f8f6688d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.029+0000 7f2c85d9b640 1 -- 172.21.15.53:0/6546388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 msgr2=0x55f8f6688310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:08.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.029+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/6546388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 0x55f8f6688310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.029+0000 7f2c85d9b640 1 -- 172.21.15.53:0/6546388 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f634e650 con 0x55f8f62ba1b0 2024-08-31T06:20:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.029+0000 7f2c86d9d640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c700b4d20 0x7f2c700b7230 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2c80005fd0 tx=0x7f2c80009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.029+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/6546388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62ba1b0 0x55f8f6688850 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c02ea90 tx=0x7f2c7c00f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ce7f5fa8deceadc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.029+0000 7f2c74ff9640 1 -- 172.21.15.53:0/6546388 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c043070 con 0x55f8f62ba1b0 2024-08-31T06:20:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.029+0000 7f2c74ff9640 1 -- 172.21.15.53:0/6546388 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c7c00f110 con 0x55f8f62ba1b0 2024-08-31T06:20:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.029+0000 7f2c74ff9640 1 -- 172.21.15.53:0/6546388 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00e9b0 con 0x55f8f62ba1b0 2024-08-31T06:20:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.030+0000 7f2c92eec740 1 -- 172.21.15.53:0/6546388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62ba1b0 msgr2=0x55f8f6688850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.030+0000 7f2c92eec740 1 --2- 172.21.15.53:0/6546388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62ba1b0 0x55f8f6688850 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c02ea90 tx=0x7f2c7c00f840 comp rx=0 tx=0).stop 2024-08-31T06:20:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.031+0000 7f2c92eec740 1 -- 172.21.15.53:0/6546388 shutdown_connections 2024-08-31T06:20:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.031+0000 7f2c92eec740 1 --2- 172.21.15.53:0/6546388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62c2390 0x55f8f6688d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.031+0000 7f2c92eec740 1 --2- 172.21.15.53:0/6546388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62ba1b0 0x55f8f6688850 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.031+0000 7f2c92eec740 1 --2- 172.21.15.53:0/6546388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 0x55f8f6688310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.031+0000 7f2c92eec740 1 -- 172.21.15.53:0/6546388 >> 172.21.15.53:0/6546388 conn(0x55f8f62d7460 msgr2=0x55f8f6686200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.031+0000 7f2c92eec740 1 -- 172.21.15.53:0/6546388 shutdown_connections 2024-08-31T06:20:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.031+0000 7f2c92eec740 1 -- 172.21.15.53:0/6546388 wait complete. 2024-08-31T06:20:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.031+0000 7f2c92eec740 1 -- start start 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.031+0000 7f2c92eec740 1 Processor -- start 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.032+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62ba1b0 0x55f8f6693b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.032+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 0x55f8f6694050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.032+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 0x55f8f669fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.032+0000 7f2c92eec740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f8f6451700 con 0x55f8f62e3070 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.032+0000 7f2c92eec740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f8f6575750 con 0x55f8f62ba1b0 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.032+0000 7f2c92eec740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f8f6696a90 con 0x55f8f62c2390 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.032+0000 7f2c92eec740 10 client.0 _ll_register_callbacks cb 0x55f8f65a4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.032+0000 7f2c85d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 0x55f8f6694050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.032+0000 7f2c85d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 0x55f8f6694050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50964/0 (socket says 172.21.15.53:50964) 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.032+0000 7f2c85d9b640 1 -- 172.21.15.53:0/2319973340 learned_addr learned my addr 172.21.15.53:0/2319973340 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.032+0000 7f2c86d9d640 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 0x55f8f669fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.033+0000 7f2c85d9b640 1 -- 172.21.15.53:0/2319973340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62ba1b0 msgr2=0x55f8f6693b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:20:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.033+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62ba1b0 0x55f8f6693b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.033+0000 7f2c85d9b640 1 -- 172.21.15.53:0/2319973340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 msgr2=0x55f8f669fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.033+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 0x55f8f669fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.033+0000 7f2c85d9b640 1 -- 172.21.15.53:0/2319973340 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8f65ae900 con 0x55f8f62c2390 2024-08-31T06:20:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.033+0000 7f2c86d9d640 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 0x55f8f669fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:08.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.033+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 0x55f8f6694050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00e850 tx=0x7f2c7c005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8e9a18b6136d5df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:08.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.033+0000 7f2c6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:20:08.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.033+0000 7f2c6dffb640 1 -- 172.21.15.53:0/2319973340 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c056060 con 0x55f8f62c2390 2024-08-31T06:20:08.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.033+0000 7f2c6dffb640 1 -- 172.21.15.53:0/2319973340 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7f2c7c00e3c0 con 0x55f8f62c2390 2024-08-31T06:20:08.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.033+0000 7f2c92eec740 1 -- 172.21.15.53:0/2319973340 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c7c00f110 con 0x55f8f62c2390 2024-08-31T06:20:08.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.034+0000 7f2c6dffb640 1 -- 172.21.15.53:0/2319973340 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f2c7c043070 con 0x55f8f62c2390 2024-08-31T06:20:08.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.034+0000 7f2c92eec740 10 client.29275 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.034+0000 7f2c92eec740 1 -- 172.21.15.53:0/2319973340 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55f8f66a28f0 con 0x55f8f62c2390 2024-08-31T06:20:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.034+0000 7f2c6dffb640 1 -- 172.21.15.53:0/2319973340 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c7c00f110 con 0x55f8f62c2390 2024-08-31T06:20:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.034+0000 7f2c6dffb640 1 -- 172.21.15.53:0/2319973340 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f2c7c0486c0 con 0x55f8f62c2390 2024-08-31T06:20:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.034+0000 7f2c92eec740 10 client.29275 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.034+0000 7f2c92eec740 10 client.29275 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:20:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.034+0000 7f2c92eec740 20 client.29275 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.034+0000 7f2c92eec740 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f8f62a19f0 0x55f8f66a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.034+0000 7f2c92eec740 4 client.29275 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.034+0000 7f2c92eec740 1 -- 172.21.15.53:0/2319973340 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8f66015d0 con 0x55f8f62a19f0 2024-08-31T06:20:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.036+0000 7f2c8659c640 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f8f62a19f0 0x55f8f66a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.036+0000 7f2c8659c640 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f8f62a19f0 0x55f8f66a5c50 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=82edcc9f0874d4ce server_cookie=4718f248d13271fb in_seq=0 out_seq=0 2024-08-31T06:20:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.037+0000 7f2c6dffb640 10 client.29275 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.037+0000 7f2c6dffb640 1 -- 172.21.15.53:0/2319973340 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8f66015d0 con 0x55f8f62a19f0 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.037+0000 7f2c6dffb640 10 client.29275 handle_command_reply: tid=0 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.037+0000 7f2c92eec740 1 client.29275 shutdown 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.037+0000 7f2c92eec740 1 -- 172.21.15.53:0/2319973340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 msgr2=0x55f8f6694050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.037+0000 7f2c92eec740 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 0x55f8f6694050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00e850 tx=0x7f2c7c005de0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.038+0000 7f2c92eec740 1 -- 172.21.15.53:0/2319973340 shutdown_connections 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.038+0000 7f2c92eec740 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f8f62a19f0 0x55f8f66a5c50 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.038+0000 7f2c6dffb640 0 client.29275 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.038+0000 7f2c92eec740 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62e3070 0x55f8f669fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.038+0000 7f2c92eec740 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 0x55f8f6694050 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.038+0000 7f2c92eec740 1 --2- 172.21.15.53:0/2319973340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62ba1b0 0x55f8f6693b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.038+0000 7f2c92eec740 1 -- 172.21.15.53:0/2319973340 >> 172.21.15.53:0/2319973340 conn(0x55f8f62d7460 msgr2=0x55f8f668b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:08.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.038+0000 7f2c92eec740 1 -- 172.21.15.53:0/2319973340 shutdown_connections 2024-08-31T06:20:08.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.038+0000 7f2c92eec740 1 -- 172.21.15.53:0/2319973340 wait complete. 2024-08-31T06:20:08.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.038+0000 7f2c92eec740 20 client.29275 trim_cache size 0 max 16384 2024-08-31T06:20:08.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.058+0000 7f2c92eec740 1 Processor -- start 2024-08-31T06:20:08.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.058+0000 7f2c92eec740 1 -- start start 2024-08-31T06:20:08.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.059+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62a19f0 0x55f8f6689a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.059+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62ba1b0 0x55f8f669fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.059+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62c2390 0x55f8f66a0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.059+0000 7f2c92eec740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6800e940 con 0x55f8f62ba1b0 2024-08-31T06:20:08.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.059+0000 7f2c92eec740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2c680106c0 con 0x55f8f62c2390 2024-08-31T06:20:08.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.059+0000 7f2c92eec740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6800f010 con 0x55f8f62a19f0 2024-08-31T06:20:08.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.059+0000 7f2c85d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62ba1b0 0x55f8f669fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.059+0000 7f2c8659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62a19f0 0x55f8f6689a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.059+0000 7f2c85d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62ba1b0 0x55f8f669fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49118/0 (socket says 172.21.15.53:49118) 2024-08-31T06:20:08.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.059+0000 7f2c85d9b640 1 -- 172.21.15.53:0/3169928233 learned_addr learned my addr 172.21.15.53:0/3169928233 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:08.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.059+0000 7f2c86d9d640 1 --2- 172.21.15.53:0/3169928233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62c2390 0x55f8f66a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.060+0000 7f2c85d9b640 1 -- 172.21.15.53:0/3169928233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62a19f0 msgr2=0x55f8f6689a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:08.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.060+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/3169928233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62a19f0 0x55f8f6689a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.060+0000 7f2c85d9b640 1 -- 172.21.15.53:0/3169928233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62c2390 msgr2=0x55f8f66a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:08.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.060+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/3169928233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62c2390 0x55f8f66a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.060+0000 7f2c85d9b640 1 -- 172.21.15.53:0/3169928233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f6694bd0 con 0x55f8f62ba1b0 2024-08-31T06:20:08.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.060+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/3169928233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62ba1b0 0x55f8f669fce0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c005eb0 tx=0x7f2c7c02e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366383fca54f1793 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:08.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.060+0000 7f2c6ffff640 1 -- 172.21.15.53:0/3169928233 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c056070 con 0x55f8f62ba1b0 2024-08-31T06:20:08.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.060+0000 7f2c6ffff640 1 -- 172.21.15.53:0/3169928233 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c7c0488e0 con 0x55f8f62ba1b0 2024-08-31T06:20:08.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.060+0000 7f2c6ffff640 1 -- 172.21.15.53:0/3169928233 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c03f480 con 0x55f8f62ba1b0 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.061+0000 7f2c92eec740 1 -- 172.21.15.53:0/3169928233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62ba1b0 msgr2=0x55f8f669fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.061+0000 7f2c92eec740 1 --2- 172.21.15.53:0/3169928233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62ba1b0 0x55f8f669fce0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c005eb0 tx=0x7f2c7c02e570 comp rx=0 tx=0).stop 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.061+0000 7f2c92eec740 1 -- 172.21.15.53:0/3169928233 shutdown_connections 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.061+0000 7f2c92eec740 1 --2- 172.21.15.53:0/3169928233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62c2390 0x55f8f66a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.061+0000 7f2c92eec740 1 --2- 172.21.15.53:0/3169928233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62ba1b0 0x55f8f669fce0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.061+0000 7f2c92eec740 1 --2- 172.21.15.53:0/3169928233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62a19f0 0x55f8f6689a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.061+0000 7f2c92eec740 1 -- 172.21.15.53:0/3169928233 >> 172.21.15.53:0/3169928233 conn(0x55f8f62d7460 msgr2=0x55f8f6689340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.062+0000 7f2c92eec740 1 -- 172.21.15.53:0/3169928233 shutdown_connections 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.062+0000 7f2c92eec740 1 -- 172.21.15.53:0/3169928233 wait complete. 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.062+0000 7f2c92eec740 1 -- start start 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.062+0000 7f2c92eec740 1 Processor -- start 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62a19f0 0x55f8f6698500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62ba1b0 0x55f8f6698a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c92eec740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 0x55f8f670f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c92eec740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6800ff30 con 0x55f8f62a19f0 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c92eec740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6800f7a0 con 0x55f8f62ba1b0 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c8659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62a19f0 0x55f8f6698500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c92eec740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6800c940 con 0x55f8f62c2390 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c8659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62a19f0 0x55f8f6698500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49134/0 (socket says 172.21.15.53:49134) 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c8659c640 1 -- 172.21.15.53:0/3787803584 learned_addr learned my addr 172.21.15.53:0/3787803584 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c92eec740 10 client.0 _ll_register_callbacks cb 0x7f2c780a7cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62ba1b0 0x55f8f6698a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c86d9d640 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 0x55f8f670f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c8659c640 1 -- 172.21.15.53:0/3787803584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 msgr2=0x55f8f670f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c8659c640 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 0x55f8f670f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c8659c640 1 -- 172.21.15.53:0/3787803584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62ba1b0 msgr2=0x55f8f6698a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:08.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c8659c640 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62ba1b0 0x55f8f6698a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c8659c640 1 -- 172.21.15.53:0/3787803584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8f670fa40 con 0x55f8f62a19f0 2024-08-31T06:20:08.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c86d9d640 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 0x55f8f670f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:08.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c8659c640 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62a19f0 0x55f8f6698500 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f2c780a9060 tx=0x7f2c780e2e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afe694efd6e3b2d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:08.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.063+0000 7f2c6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:08.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.064+0000 7f2c6dffb640 1 -- 172.21.15.53:0/3787803584 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c780b0660 con 0x55f8f62a19f0 2024-08-31T06:20:08.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.064+0000 7f2c6dffb640 1 -- 172.21.15.53:0/3787803584 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7f2c78091be0 con 0x55f8f62a19f0 2024-08-31T06:20:08.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.064+0000 7f2c92eec740 1 -- 172.21.15.53:0/3787803584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c7c0488e0 con 0x55f8f62a19f0 2024-08-31T06:20:08.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.064+0000 7f2c6dffb640 1 -- 172.21.15.53:0/3787803584 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f2c780b5110 con 0x55f8f62a19f0 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.064+0000 7f2c92eec740 10 client.20319 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.064+0000 7f2c92eec740 1 -- 172.21.15.53:0/3787803584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55f8f6710d20 con 0x55f8f62a19f0 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.064+0000 7f2c6dffb640 1 -- 172.21.15.53:0/3787803584 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c7c0488e0 con 0x55f8f62a19f0 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.065+0000 7f2c6dffb640 1 -- 172.21.15.53:0/3787803584 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f2c780ac0c0 con 0x55f8f62a19f0 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.065+0000 7f2c92eec740 10 client.20319 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.065+0000 7f2c92eec740 10 client.20319 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.065+0000 7f2c92eec740 20 client.20319 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.065+0000 7f2c92eec740 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f8f62e3070 0x55f8f6713520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.065+0000 7f2c92eec740 4 client.20319 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.065+0000 7f2c92eec740 1 -- 172.21.15.53:0/3787803584 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f8f65fd070 con 0x55f8f62e3070 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.065+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f8f62e3070 0x55f8f6713520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.065+0000 7f2c6dffb640 10 client.20319 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:20:08.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.065+0000 7f2c85d9b640 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f8f62e3070 0x55f8f6713520 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=96108df7d9715729 server_cookie=5fe9aa884bd08df0 in_seq=0 out_seq=0 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c6dffb640 1 -- 172.21.15.53:0/3787803584 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f8f65fd070 con 0x55f8f62e3070 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c6dffb640 10 client.20319 handle_command_reply: tid=0 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c92eec740 1 client.20319 shutdown 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c92eec740 1 -- 172.21.15.53:0/3787803584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62a19f0 msgr2=0x55f8f6698500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c92eec740 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62a19f0 0x55f8f6698500 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f2c780a9060 tx=0x7f2c780e2e30 comp rx=0 tx=0).stop 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c92eec740 1 -- 172.21.15.53:0/3787803584 shutdown_connections 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c92eec740 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f8f62e3070 0x55f8f6713520 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c92eec740 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f8f62c2390 0x55f8f670f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c6dffb640 0 client.20319 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c92eec740 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f8f62ba1b0 0x55f8f6698a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c92eec740 1 --2- 172.21.15.53:0/3787803584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8f62a19f0 0x55f8f6698500 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c92eec740 1 -- 172.21.15.53:0/3787803584 >> 172.21.15.53:0/3787803584 conn(0x55f8f62d7460 msgr2=0x55f8f6694ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:08.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c92eec740 1 -- 172.21.15.53:0/3787803584 shutdown_connections 2024-08-31T06:20:08.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.066+0000 7f2c92eec740 1 -- 172.21.15.53:0/3787803584 wait complete. 2024-08-31T06:20:08.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.067+0000 7f2c92eec740 20 client.20319 trim_cache size 0 max 16384 2024-08-31T06:20:08.073 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:20:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.067+0000 7f2c8c977640 1 -- 172.21.15.53:0/3022440237 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c700b4d20 msgr2=0x7f2c700b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.067+0000 7f2c8c977640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c700b4d20 0x7f2c700b7230 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2c80005fd0 tx=0x7f2c80009500 comp rx=0 tx=0).stop 2024-08-31T06:20:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.067+0000 7f2c8c977640 1 -- 172.21.15.53:0/3022440237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c88101dd0 msgr2=0x7f2c881a0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.067+0000 7f2c8c977640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c88101dd0 0x7f2c881a0880 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800e9c0 tx=0x7f2c7800ee80 comp rx=0 tx=0).stop 2024-08-31T06:20:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.067+0000 7f2c8c977640 1 -- 172.21.15.53:0/3022440237 shutdown_connections 2024-08-31T06:20:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.067+0000 7f2c8c977640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2c700b4d20 0x7f2c700b7230 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.068+0000 7f2c8c977640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c88106970 0x7f2c881a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.068+0000 7f2c8c977640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c88106020 0x7f2c881a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.068+0000 7f2c8c977640 1 --2- 172.21.15.53:0/3022440237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c88101dd0 0x7f2c881a0880 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.068+0000 7f2c8c977640 1 -- 172.21.15.53:0/3022440237 >> 172.21.15.53:0/3022440237 conn(0x7f2c88077a00 msgr2=0x7f2c88107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:08.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.068+0000 7f2c8c977640 1 -- 172.21.15.53:0/3022440237 shutdown_connections 2024-08-31T06:20:08.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:08.068+0000 7f2c8c977640 1 -- 172.21.15.53:0/3022440237 wait complete. 2024-08-31T06:20:08.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:07 smithi130 ceph-mon[22266]: pgmap v797: 97 pgs: 97 active+clean; 420 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 363 op/s 2024-08-31T06:20:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.136+0000 7f66297fa640 1 -- 172.21.15.53:0/89055566 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56514b3089f0 con 0x56514af861c0 2024-08-31T06:20:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.136+0000 7f66297fa640 10 client.29255 handle_command_reply: tid=0 2024-08-31T06:20:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.136+0000 7f664ebe9740 1 client.29255 shutdown 2024-08-31T06:20:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f664ebe9740 1 -- 172.21.15.53:0/89055566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afd14d0 msgr2=0x56514b3a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f664ebe9740 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afd14d0 0x56514b3a53f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x56514b3a4030 tx=0x7f6630012be0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f664ebe9740 1 -- 172.21.15.53:0/89055566 shutdown_connections 2024-08-31T06:20:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f664ebe9740 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56514af861c0 0x56514b4203d0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f664ebe9740 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56514aff21b0 0x56514b41c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f66297fa640 0 client.29255 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f664ebe9740 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514afd14d0 0x56514b3a53f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f664ebe9740 1 --2- 172.21.15.53:0/89055566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56514afc92f0 0x56514b3a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f664ebe9740 1 -- 172.21.15.53:0/89055566 >> 172.21.15.53:0/89055566 conn(0x56514afe6300 msgr2=0x56514b3a34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f664ebe9740 1 -- 172.21.15.53:0/89055566 shutdown_connections 2024-08-31T06:20:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f664ebe9740 1 -- 172.21.15.53:0/89055566 wait complete. 2024-08-31T06:20:08.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.137+0000 7f664ebe9740 20 client.29255 trim_cache size 0 max 16384 2024-08-31T06:20:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:20:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:20:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:20:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:20:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.138+0000 7f6647c7e640 1 -- 172.21.15.53:0/1862012058 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f662c0b4d20 msgr2=0x7f662c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.138+0000 7f6647c7e640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f662c0b4d20 0x7f662c0b7230 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6638009420 tx=0x7f66380303a0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.138+0000 7f6647c7e640 1 -- 172.21.15.53:0/1862012058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6640103890 msgr2=0x7f6640110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.138+0000 7f6647c7e640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6640103890 0x7f6640110060 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f663c00e9f0 tx=0x7f663c00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.138+0000 7f6647c7e640 1 -- 172.21.15.53:0/1862012058 shutdown_connections 2024-08-31T06:20:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.138+0000 7f6647c7e640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f662c0b4d20 0x7f662c0b7230 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.138+0000 7f6647c7e640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6640109b10 0x7f664010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.138+0000 7f6647c7e640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66401091c0 0x7f664010d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.138+0000 7f6647c7e640 1 --2- 172.21.15.53:0/1862012058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6640103890 0x7f6640110060 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.138+0000 7f6647c7e640 1 -- 172.21.15.53:0/1862012058 >> 172.21.15.53:0/1862012058 conn(0x7f66400ff310 msgr2=0x7f6640104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.139+0000 7f6647c7e640 1 -- 172.21.15.53:0/1862012058 shutdown_connections 2024-08-31T06:20:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:08.139+0000 7f6647c7e640 1 -- 172.21.15.53:0/1862012058 wait complete. 2024-08-31T06:20:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:07 smithi153 ceph-mon[22320]: pgmap v797: 97 pgs: 97 active+clean; 420 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 363 op/s 2024-08-31T06:20:08.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 13534 7.73 MB/sec warmup 116 sec latency 91.079 ms 2024-08-31T06:20:09.156 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:20:09.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 13711 7.76 MB/sec warmup 117 sec latency 72.238 ms 2024-08-31T06:20:09.526 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:09.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:09 smithi053 ceph-mon[18924]: pgmap v798: 97 pgs: 97 active+clean; 426 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 350 op/s 2024-08-31T06:20:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:09 smithi130 ceph-mon[22266]: pgmap v798: 97 pgs: 97 active+clean; 426 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 350 op/s 2024-08-31T06:20:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:09 smithi153 ceph-mon[22320]: pgmap v798: 97 pgs: 97 active+clean; 426 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 350 op/s 2024-08-31T06:20:10.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 13911 7.78 MB/sec warmup 118 sec latency 81.197 ms 2024-08-31T06:20:10.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.513+0000 7ff849209640 1 -- 172.21.15.53:0/533261347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff844108140 msgr2=0x7ff844108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:10.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.513+0000 7ff849209640 1 --2- 172.21.15.53:0/533261347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff844108140 0x7ff844108550 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7ff838009900 tx=0x7ff83802a410 comp rx=0 tx=0).stop 2024-08-31T06:20:10.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.513+0000 7ff849209640 1 -- 172.21.15.53:0/533261347 shutdown_connections 2024-08-31T06:20:10.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.513+0000 7ff849209640 1 --2- 172.21.15.53:0/533261347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff844108a90 0x7ff84410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.513+0000 7ff849209640 1 --2- 172.21.15.53:0/533261347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff844108140 0x7ff844108550 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.513+0000 7ff849209640 1 --2- 172.21.15.53:0/533261347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844102800 0x7ff844102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.513+0000 7ff849209640 1 -- 172.21.15.53:0/533261347 >> 172.21.15.53:0/533261347 conn(0x7ff8440794d0 msgr2=0x7ff8440798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:10.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.513+0000 7ff849209640 1 -- 172.21.15.53:0/533261347 shutdown_connections 2024-08-31T06:20:10.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.513+0000 7ff849209640 1 -- 172.21.15.53:0/533261347 wait complete. 2024-08-31T06:20:10.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.514+0000 7ff849209640 1 Processor -- start 2024-08-31T06:20:10.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff849209640 1 -- start start 2024-08-31T06:20:10.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff849209640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844102800 0x7ff84419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff849209640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff844108140 0x7ff84419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff849209640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff844108a90 0x7ff84419f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff849209640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff844113740 con 0x7ff844108140 2024-08-31T06:20:10.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff849209640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff84406bb10 con 0x7ff844108a90 2024-08-31T06:20:10.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff849209640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441138c0 con 0x7ff844102800 2024-08-31T06:20:10.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff84259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff844108140 0x7ff84419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff84359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff844108a90 0x7ff84419f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff842d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844102800 0x7ff84419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff84259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff844108140 0x7ff84419a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49152/0 (socket says 172.21.15.53:49152) 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff84359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff844108a90 0x7ff84419f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48162/0 (socket says 172.21.15.53:48162) 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.515+0000 7ff84259c640 1 -- 172.21.15.53:0/3537499251 learned_addr learned my addr 172.21.15.53:0/3537499251 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.516+0000 7ff842d9d640 1 -- 172.21.15.53:0/3537499251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff844108a90 msgr2=0x7ff84419f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.516+0000 7ff842d9d640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff844108a90 0x7ff84419f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.516+0000 7ff842d9d640 1 -- 172.21.15.53:0/3537499251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff844108140 msgr2=0x7ff84419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.516+0000 7ff842d9d640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff844108140 0x7ff84419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.516+0000 7ff842d9d640 1 -- 172.21.15.53:0/3537499251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8441a0100 con 0x7ff844102800 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.516+0000 7ff84359e640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff844108a90 0x7ff84419f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:10.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.516+0000 7ff84259c640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff844108140 0x7ff84419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:10.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.516+0000 7ff842d9d640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844102800 0x7ff84419a190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e9f0 tx=0x7ff83400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:10.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.516+0000 7ff82bfff640 1 -- 172.21.15.53:0/3537499251 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83400ccc0 con 0x7ff844102800 2024-08-31T06:20:10.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.516+0000 7ff849209640 1 -- 172.21.15.53:0/3537499251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8441a03f0 con 0x7ff844102800 2024-08-31T06:20:10.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.516+0000 7ff82bfff640 1 -- 172.21.15.53:0/3537499251 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8340108c0 con 0x7ff844102800 2024-08-31T06:20:10.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.517+0000 7ff82bfff640 1 -- 172.21.15.53:0/3537499251 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8340187c0 con 0x7ff844102800 2024-08-31T06:20:10.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.517+0000 7ff849209640 1 -- 172.21.15.53:0/3537499251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff844111530 con 0x7ff844102800 2024-08-31T06:20:10.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.520+0000 7ff84f77e740 1 Processor -- start 2024-08-31T06:20:10.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.520+0000 7ff84f77e740 1 -- start start 2024-08-31T06:20:10.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.520+0000 7ff82bfff640 1 -- 172.21.15.53:0/3537499251 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff834018960 con 0x7ff844102800 2024-08-31T06:20:10.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.520+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b373310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.520+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b373850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.520+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b373d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.520+0000 7ff84f77e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55609b2ea680 con 0x55609afad390 2024-08-31T06:20:10.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.520+0000 7ff84f77e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55609b2d9c10 con 0x55609afce070 2024-08-31T06:20:10.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.520+0000 7ff84f77e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55609b2ddbc0 con 0x55609afa51b0 2024-08-31T06:20:10.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.521+0000 7ff84359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b373310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.521+0000 7ff84359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b373310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48168/0 (socket says 172.21.15.53:48168) 2024-08-31T06:20:10.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.521+0000 7ff84359e640 1 -- 172.21.15.53:0/2505868774 learned_addr learned my addr 172.21.15.53:0/2505868774 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:10.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.521+0000 7ff84259c640 1 --2- 172.21.15.53:0/2505868774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b373d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.521+0000 7ff84359e640 1 -- 172.21.15.53:0/2505868774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 msgr2=0x55609b373850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:10.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.521+0000 7ff842d9d640 1 --2- 172.21.15.53:0/2505868774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b373850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.522+0000 7ff84359e640 1 --2- 172.21.15.53:0/2505868774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b373850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.522+0000 7ff84359e640 1 -- 172.21.15.53:0/2505868774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 msgr2=0x55609b373d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:10.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.522+0000 7ff84359e640 1 --2- 172.21.15.53:0/2505868774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b373d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.522+0000 7ff84359e640 1 -- 172.21.15.53:0/2505868774 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55609b039650 con 0x55609afce070 2024-08-31T06:20:10.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.522+0000 7ff84259c640 1 --2- 172.21.15.53:0/2505868774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b373d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:10.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.522+0000 7ff842d9d640 1 --2- 172.21.15.53:0/2505868774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b373850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:20:10.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.522+0000 7ff84359e640 1 --2- 172.21.15.53:0/2505868774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b373310 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009fd0 tx=0x7ff83c010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=704e8fd7aa52963c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:10.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.522+0000 7ff82bfff640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff82c0b4ea0 0x7ff82c0b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.522+0000 7ff8297fa640 1 -- 172.21.15.53:0/2505868774 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c011700 con 0x55609afce070 2024-08-31T06:20:10.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.522+0000 7ff8297fa640 1 -- 172.21.15.53:0/2505868774 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff83c011d30 con 0x55609afce070 2024-08-31T06:20:10.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.523+0000 7ff8297fa640 1 -- 172.21.15.53:0/2505868774 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00e3c0 con 0x55609afce070 2024-08-31T06:20:10.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.523+0000 7ff82bfff640 1 -- 172.21.15.53:0/3537499251 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7ff834018560 con 0x7ff844102800 2024-08-31T06:20:10.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.523+0000 7ff842d9d640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff82c0b4ea0 0x7ff82c0b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff84f77e740 1 -- 172.21.15.53:0/2505868774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 msgr2=0x55609b373310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:10.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff842d9d640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff82c0b4ea0 0x7ff82c0b73b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff8340e2db0 tx=0x7ff83401f000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:10.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff84f77e740 1 --2- 172.21.15.53:0/2505868774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b373310 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009fd0 tx=0x7ff83c010860 comp rx=0 tx=0).stop 2024-08-31T06:20:10.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff84f77e740 1 -- 172.21.15.53:0/2505868774 shutdown_connections 2024-08-31T06:20:10.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff84f77e740 1 --2- 172.21.15.53:0/2505868774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b373d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff84f77e740 1 --2- 172.21.15.53:0/2505868774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b373850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff84f77e740 1 --2- 172.21.15.53:0/2505868774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b373310 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff84f77e740 1 -- 172.21.15.53:0/2505868774 >> 172.21.15.53:0/2505868774 conn(0x55609afc2460 msgr2=0x55609b371200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff84f77e740 1 -- 172.21.15.53:0/2505868774 shutdown_connections 2024-08-31T06:20:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff84f77e740 1 -- 172.21.15.53:0/2505868774 wait complete. 2024-08-31T06:20:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff84f77e740 1 -- start start 2024-08-31T06:20:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.524+0000 7ff84f77e740 1 Processor -- start 2024-08-31T06:20:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b37eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b37eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b38aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84f77e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55609b13c700 con 0x55609afad390 2024-08-31T06:20:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84f77e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55609b260750 con 0x55609afce070 2024-08-31T06:20:10.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84f77e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55609b381b90 con 0x55609afa51b0 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84f77e740 10 client.0 _ll_register_callbacks cb 0x55609b28fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b38aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b37eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b38aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48174/0 (socket says 172.21.15.53:48174) 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84359e640 1 -- 172.21.15.53:0/2244301574 learned_addr learned my addr 172.21.15.53:0/2244301574 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84359e640 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b37eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84359e640 1 -- 172.21.15.53:0/2244301574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 msgr2=0x55609b37eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84359e640 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b37eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84359e640 1 -- 172.21.15.53:0/2244301574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 msgr2=0x55609b37eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.525+0000 7ff84359e640 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b37eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.526+0000 7ff84359e640 1 -- 172.21.15.53:0/2244301574 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55609b299900 con 0x55609afce070 2024-08-31T06:20:10.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.526+0000 7ff84359e640 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b38aee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff83c01bb30 tx=0x7ff83c01ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5dcbfde4801bdad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.526+0000 7ff826ff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:20:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.526+0000 7ff826ff5640 1 -- 172.21.15.53:0/2244301574 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c024040 con 0x55609afce070 2024-08-31T06:20:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.526+0000 7ff84f77e740 1 -- 172.21.15.53:0/2244301574 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff83c011d30 con 0x55609afce070 2024-08-31T06:20:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.526+0000 7ff826ff5640 1 -- 172.21.15.53:0/2244301574 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7ff83c02b430 con 0x55609afce070 2024-08-31T06:20:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.526+0000 7ff826ff5640 1 -- 172.21.15.53:0/2244301574 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff83c02b630 con 0x55609afce070 2024-08-31T06:20:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.526+0000 7ff84f77e740 10 client.29279 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.526+0000 7ff84f77e740 1 -- 172.21.15.53:0/2244301574 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55609b38d8d0 con 0x55609afce070 2024-08-31T06:20:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.526+0000 7ff826ff5640 1 -- 172.21.15.53:0/2244301574 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff83c011d30 con 0x55609afce070 2024-08-31T06:20:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.527+0000 7ff826ff5640 1 -- 172.21.15.53:0/2244301574 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7ff83c02d8d0 con 0x55609afce070 2024-08-31T06:20:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.527+0000 7ff84f77e740 10 client.29279 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.527+0000 7ff84f77e740 10 client.29279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.527+0000 7ff84f77e740 20 client.29279 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.527+0000 7ff84f77e740 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609af8c9f0 0x55609b391150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.527+0000 7ff84f77e740 4 client.29279 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.527+0000 7ff84f77e740 1 -- 172.21.15.53:0/2244301574 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55609b2ec5d0 con 0x55609af8c9f0 2024-08-31T06:20:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.527+0000 7ff84259c640 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609af8c9f0 0x55609b391150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.528+0000 7ff826ff5640 10 client.29279 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.528+0000 7ff84259c640 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609af8c9f0 0x55609b391150 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bf251bfd3e1a24a server_cookie=27f8613ea78fc3dd in_seq=0 out_seq=0 2024-08-31T06:20:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.528+0000 7ff826ff5640 1 -- 172.21.15.53:0/2244301574 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55609b2ec5d0 con 0x55609af8c9f0 2024-08-31T06:20:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.528+0000 7ff826ff5640 10 client.29279 handle_command_reply: tid=0 2024-08-31T06:20:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.528+0000 7ff84f77e740 1 client.29279 shutdown 2024-08-31T06:20:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff84f77e740 1 -- 172.21.15.53:0/2244301574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 msgr2=0x55609b38aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff84f77e740 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b38aee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff83c01bb30 tx=0x7ff83c01ba30 comp rx=0 tx=0).stop 2024-08-31T06:20:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff84f77e740 1 -- 172.21.15.53:0/2244301574 shutdown_connections 2024-08-31T06:20:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff84f77e740 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609af8c9f0 0x55609b391150 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff84f77e740 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b38aee0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff84f77e740 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b37eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff84f77e740 1 --2- 172.21.15.53:0/2244301574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b37eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff84f77e740 1 -- 172.21.15.53:0/2244301574 >> 172.21.15.53:0/2244301574 conn(0x55609afc2460 msgr2=0x55609b3764a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff826ff5640 0 client.29279 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff84f77e740 1 -- 172.21.15.53:0/2244301574 shutdown_connections 2024-08-31T06:20:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff84f77e740 1 -- 172.21.15.53:0/2244301574 wait complete. 2024-08-31T06:20:10.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.529+0000 7ff84f77e740 20 client.29279 trim_cache size 0 max 16384 2024-08-31T06:20:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.548+0000 7ff84f77e740 1 Processor -- start 2024-08-31T06:20:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.548+0000 7ff84f77e740 1 -- start start 2024-08-31T06:20:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b37f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b38ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b376410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84f77e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff83000e940 con 0x55609afad390 2024-08-31T06:20:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84f77e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff8300106c0 con 0x55609afce070 2024-08-31T06:20:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84f77e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff83000f010 con 0x55609afa51b0 2024-08-31T06:20:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84359e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b37f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84359e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b37f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51054/0 (socket says 172.21.15.53:51054) 2024-08-31T06:20:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84359e640 1 -- 172.21.15.53:0/840650247 learned_addr learned my addr 172.21.15.53:0/840650247 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84359e640 1 --2- 172.21.15.53:0/840650247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b376410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84259c640 1 --2- 172.21.15.53:0/840650247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b38ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84359e640 1 -- 172.21.15.53:0/840650247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 msgr2=0x55609b37f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:10.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84359e640 1 --2- 172.21.15.53:0/840650247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b37f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84359e640 1 -- 172.21.15.53:0/840650247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 msgr2=0x55609b38ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:10.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84359e640 1 --2- 172.21.15.53:0/840650247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b38ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84359e640 1 -- 172.21.15.53:0/840650247 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55609b3811f0 con 0x55609afce070 2024-08-31T06:20:10.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.549+0000 7ff84259c640 1 --2- 172.21.15.53:0/840650247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b38ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:10.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.550+0000 7ff84359e640 1 --2- 172.21.15.53:0/840650247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b376410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff83c02de60 tx=0x7ff83c000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633a1e00ec289bab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:10.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.550+0000 7ff828ff9640 1 -- 172.21.15.53:0/840650247 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c037040 con 0x55609afce070 2024-08-31T06:20:10.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.550+0000 7ff828ff9640 1 -- 172.21.15.53:0/840650247 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff83c004e50 con 0x55609afce070 2024-08-31T06:20:10.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.550+0000 7ff828ff9640 1 -- 172.21.15.53:0/840650247 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c005320 con 0x55609afce070 2024-08-31T06:20:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.551+0000 7ff84f77e740 1 -- 172.21.15.53:0/840650247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 msgr2=0x55609b376410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.551+0000 7ff84f77e740 1 --2- 172.21.15.53:0/840650247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b376410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff83c02de60 tx=0x7ff83c000f40 comp rx=0 tx=0).stop 2024-08-31T06:20:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.551+0000 7ff84f77e740 1 -- 172.21.15.53:0/840650247 shutdown_connections 2024-08-31T06:20:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.551+0000 7ff84f77e740 1 --2- 172.21.15.53:0/840650247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afce070 0x55609b376410 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.551+0000 7ff84f77e740 1 --2- 172.21.15.53:0/840650247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b38ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.551+0000 7ff84f77e740 1 --2- 172.21.15.53:0/840650247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afa51b0 0x55609b37f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.551+0000 7ff84f77e740 1 -- 172.21.15.53:0/840650247 >> 172.21.15.53:0/840650247 conn(0x55609afc2460 msgr2=0x55609b37ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.551+0000 7ff84f77e740 1 -- 172.21.15.53:0/840650247 shutdown_connections 2024-08-31T06:20:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.551+0000 7ff84f77e740 1 -- 172.21.15.53:0/840650247 wait complete. 2024-08-31T06:20:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.552+0000 7ff84f77e740 1 -- start start 2024-08-31T06:20:10.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.552+0000 7ff84f77e740 1 Processor -- start 2024-08-31T06:20:10.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.552+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afa51b0 0x55609b382650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.552+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b382c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.552+0000 7ff84f77e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afce070 0x55609b3f9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.552+0000 7ff84f77e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff83000ff30 con 0x55609afad390 2024-08-31T06:20:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.552+0000 7ff84f77e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff83000f7a0 con 0x55609afa51b0 2024-08-31T06:20:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.552+0000 7ff84f77e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff83000c940 con 0x55609afce070 2024-08-31T06:20:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84f77e740 10 client.0 _ll_register_callbacks cb 0x7ff834005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afa51b0 0x55609b382650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b382c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afa51b0 0x55609b382650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48190/0 (socket says 172.21.15.53:48190) 2024-08-31T06:20:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84359e640 1 -- 172.21.15.53:0/438381583 learned_addr learned my addr 172.21.15.53:0/438381583 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84359e640 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afce070 0x55609b3f9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84359e640 1 -- 172.21.15.53:0/438381583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afce070 msgr2=0x55609b3f9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84359e640 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afce070 0x55609b3f9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84359e640 1 -- 172.21.15.53:0/438381583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 msgr2=0x55609b382c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84359e640 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b382c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84359e640 1 -- 172.21.15.53:0/438381583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55609b3fa1b0 con 0x55609afa51b0 2024-08-31T06:20:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff84359e640 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afa51b0 0x55609b382650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009d90 tx=0x7ff83c01b450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5f8f8e6e1589d90 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.553+0000 7ff826ff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:20:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.554+0000 7ff826ff5640 1 -- 172.21.15.53:0/438381583 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c037040 con 0x55609afa51b0 2024-08-31T06:20:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.554+0000 7ff826ff5640 1 -- 172.21.15.53:0/438381583 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7ff83c02b430 con 0x55609afa51b0 2024-08-31T06:20:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.554+0000 7ff84f77e740 1 -- 172.21.15.53:0/438381583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff83c004e50 con 0x55609afa51b0 2024-08-31T06:20:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.554+0000 7ff826ff5640 1 -- 172.21.15.53:0/438381583 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff83c011a70 con 0x55609afa51b0 2024-08-31T06:20:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.554+0000 7ff84f77e740 10 client.29285 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.554+0000 7ff84f77e740 1 -- 172.21.15.53:0/438381583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55609b3fb410 con 0x55609afa51b0 2024-08-31T06:20:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.554+0000 7ff826ff5640 1 -- 172.21.15.53:0/438381583 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff83c011c10 con 0x55609afa51b0 2024-08-31T06:20:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.554+0000 7ff826ff5640 1 -- 172.21.15.53:0/438381583 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7ff83c005000 con 0x55609afa51b0 2024-08-31T06:20:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.554+0000 7ff84f77e740 10 client.29285 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.554+0000 7ff84f77e740 10 client.29285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.555+0000 7ff84f77e740 20 client.29285 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.555+0000 7ff84f77e740 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609af61da0 0x55609b3fd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.555+0000 7ff84f77e740 4 client.29285 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:20:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.555+0000 7ff84f77e740 1 -- 172.21.15.53:0/438381583 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff83c004e50 con 0x55609af61da0 2024-08-31T06:20:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.555+0000 7ff84259c640 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609af61da0 0x55609b3fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff826ff5640 10 client.29285 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff84259c640 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609af61da0 0x55609b3fd840 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86fe7afcbe811880 server_cookie=f5793cd07f2e13b3 in_seq=0 out_seq=0 2024-08-31T06:20:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff826ff5640 1 -- 172.21.15.53:0/438381583 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff83c004e50 con 0x55609af61da0 2024-08-31T06:20:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff826ff5640 10 client.29285 handle_command_reply: tid=0 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff84f77e740 1 client.29285 shutdown 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff84f77e740 1 -- 172.21.15.53:0/438381583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afa51b0 msgr2=0x55609b382650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff84f77e740 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afa51b0 0x55609b382650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009d90 tx=0x7ff83c01b450 comp rx=0 tx=0).stop 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff84f77e740 1 -- 172.21.15.53:0/438381583 shutdown_connections 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff84f77e740 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609af61da0 0x55609b3fd840 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff826ff5640 0 client.29285 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff84f77e740 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609afce070 0x55609b3f9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff84f77e740 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609afad390 0x55609b382c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff84f77e740 1 --2- 172.21.15.53:0/438381583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609afa51b0 0x55609b382650 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.556+0000 7ff84f77e740 1 -- 172.21.15.53:0/438381583 >> 172.21.15.53:0/438381583 conn(0x55609afc2460 msgr2=0x55609b37ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.557+0000 7ff84f77e740 1 -- 172.21.15.53:0/438381583 shutdown_connections 2024-08-31T06:20:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.557+0000 7ff84f77e740 1 -- 172.21.15.53:0/438381583 wait complete. 2024-08-31T06:20:10.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.557+0000 7ff84f77e740 20 client.29285 trim_cache size 0 max 16384 2024-08-31T06:20:10.563 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:20:10.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.558+0000 7ff849209640 1 -- 172.21.15.53:0/3537499251 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff82c0b4ea0 msgr2=0x7ff82c0b73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.558+0000 7ff849209640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff82c0b4ea0 0x7ff82c0b73b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff8340e2db0 tx=0x7ff83401f000 comp rx=0 tx=0).stop 2024-08-31T06:20:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.558+0000 7ff849209640 1 -- 172.21.15.53:0/3537499251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844102800 msgr2=0x7ff84419a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.558+0000 7ff849209640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844102800 0x7ff84419a190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e9f0 tx=0x7ff83400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.558+0000 7ff849209640 1 -- 172.21.15.53:0/3537499251 shutdown_connections 2024-08-31T06:20:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.558+0000 7ff849209640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff82c0b4ea0 0x7ff82c0b73b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.558+0000 7ff849209640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff844108a90 0x7ff84419f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.558+0000 7ff849209640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff844108140 0x7ff84419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.558+0000 7ff849209640 1 --2- 172.21.15.53:0/3537499251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff844102800 0x7ff84419a190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.558+0000 7ff849209640 1 -- 172.21.15.53:0/3537499251 >> 172.21.15.53:0/3537499251 conn(0x7ff8440794d0 msgr2=0x7ff844104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.559+0000 7ff849209640 1 -- 172.21.15.53:0/3537499251 shutdown_connections 2024-08-31T06:20:10.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:10.559+0000 7ff849209640 1 -- 172.21.15.53:0/3537499251 wait complete. 2024-08-31T06:20:11.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 14074 7.79 MB/sec warmup 119 sec latency 61.317 ms 2024-08-31T06:20:12.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:11 smithi130 ceph-mon[22266]: pgmap v799: 97 pgs: 97 active+clean; 431 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 324 op/s 2024-08-31T06:20:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:11 smithi153 ceph-mon[22320]: pgmap v799: 97 pgs: 97 active+clean; 431 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 324 op/s 2024-08-31T06:20:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:11 smithi053 ceph-mon[18924]: pgmap v799: 97 pgs: 97 active+clean; 431 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 324 op/s 2024-08-31T06:20:12.491 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:20:12.491 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:20:12.847 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:13.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 14383 12.49 MB/sec execute 1 sec latency 84.827 ms 2024-08-31T06:20:13.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.427+0000 7f5bc1930640 1 -- 172.21.15.53:0/3845917217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bbc10dc00 msgr2=0x7f5bbc1100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:13.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.427+0000 7f5bc1930640 1 --2- 172.21.15.53:0/3845917217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bbc10dc00 0x7f5bbc1100d0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009ca0 tx=0x7f5bb402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.427+0000 7f5bc1930640 1 -- 172.21.15.53:0/3845917217 shutdown_connections 2024-08-31T06:20:13.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.427+0000 7f5bc1930640 1 --2- 172.21.15.53:0/3845917217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bbc10dc00 0x7f5bbc1100d0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.427+0000 7f5bc1930640 1 --2- 172.21.15.53:0/3845917217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bbc105120 0x7f5bbc10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.427+0000 7f5bc1930640 1 --2- 172.21.15.53:0/3845917217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bbc1047d0 0x7f5bbc104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.428+0000 7f5bc1930640 1 -- 172.21.15.53:0/3845917217 >> 172.21.15.53:0/3845917217 conn(0x7f5bbc079530 msgr2=0x7f5bbc079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:13.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.428+0000 7f5bc1930640 1 -- 172.21.15.53:0/3845917217 shutdown_connections 2024-08-31T06:20:13.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.428+0000 7f5bc1930640 1 -- 172.21.15.53:0/3845917217 wait complete. 2024-08-31T06:20:13.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bc1930640 1 Processor -- start 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bc1930640 1 -- start start 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bc1930640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bbc1047d0 0x7f5bbc19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bc1930640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bbc105120 0x7f5bbc19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bc1930640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bbc10dc00 0x7f5bbc19f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bc1930640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc113760 con 0x7f5bbc105120 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bc1930640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc1135e0 con 0x7f5bbc10dc00 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bc1930640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc1138e0 con 0x7f5bbc1047d0 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bb3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bbc105120 0x7f5bbc19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bb3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bbc105120 0x7f5bbc19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49120/0 (socket says 172.21.15.53:49120) 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bb3fff640 1 -- 172.21.15.53:0/4003530652 learned_addr learned my addr 172.21.15.53:0/4003530652 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bbc1047d0 0x7f5bbc19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.429+0000 7f5bbb7fe640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bbc10dc00 0x7f5bbc19f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bbaffd640 1 -- 172.21.15.53:0/4003530652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bbc10dc00 msgr2=0x7f5bbc19f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bbc10dc00 0x7f5bbc19f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bbaffd640 1 -- 172.21.15.53:0/4003530652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bbc105120 msgr2=0x7f5bbc19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bbc105120 0x7f5bbc19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bbaffd640 1 -- 172.21.15.53:0/4003530652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bbc1a0080 con 0x7f5bbc1047d0 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bbc105120 0x7f5bbc19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bbb7fe640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bbc10dc00 0x7f5bbc19f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bbc1047d0 0x7f5bbc19a110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00e9f0 tx=0x7f5bac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bc092e640 1 -- 172.21.15.53:0/4003530652 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac00cd80 con 0x7f5bbc1047d0 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bc092e640 1 -- 172.21.15.53:0/4003530652 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bac0035f0 con 0x7f5bbc1047d0 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bc1930640 1 -- 172.21.15.53:0/4003530652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bbc1a0370 con 0x7f5bbc1047d0 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bc092e640 1 -- 172.21.15.53:0/4003530652 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac010670 con 0x7f5bbc1047d0 2024-08-31T06:20:13.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.430+0000 7f5bc1930640 1 -- 172.21.15.53:0/4003530652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bbc1a6ad0 con 0x7f5bbc1047d0 2024-08-31T06:20:13.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.434+0000 7f5bc092e640 1 -- 172.21.15.53:0/4003530652 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5bac004000 con 0x7f5bbc1047d0 2024-08-31T06:20:13.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.434+0000 7f5bc7ea5740 1 Processor -- start 2024-08-31T06:20:13.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.434+0000 7f5bc7ea5740 1 -- start start 2024-08-31T06:20:13.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bc7ea5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f411350 0x55cf7f7b7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bc7ea5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f3e8490 0x55cf7f7b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bc7ea5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 0x55cf7f7b8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bc7ea5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cf7f72d5f0 con 0x55cf7f3f0670 2024-08-31T06:20:13.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bc7ea5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cf7f71cb80 con 0x55cf7f3e8490 2024-08-31T06:20:13.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bc7ea5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cf7f720b30 con 0x55cf7f411350 2024-08-31T06:20:13.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bb3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 0x55cf7f7b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bbb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f411350 0x55cf7f7b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bb3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 0x55cf7f7b8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49122/0 (socket says 172.21.15.53:49122) 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bbb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f411350 0x55cf7f7b7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:59044/0 (socket says 172.21.15.53:59044) 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bb3fff640 1 -- 172.21.15.53:0/1355774484 learned_addr learned my addr 172.21.15.53:0/1355774484 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/1355774484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f3e8490 0x55cf7f7b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bc092e640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ba80b4d20 0x7f5ba80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bb3fff640 1 -- 172.21.15.53:0/1355774484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f411350 msgr2=0x55cf7f7b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/1355774484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f411350 0x55cf7f7b7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.435+0000 7f5bb3fff640 1 -- 172.21.15.53:0/1355774484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f3e8490 msgr2=0x55cf7f7b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.436+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/1355774484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f3e8490 0x55cf7f7b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.436+0000 7f5bb3fff640 1 -- 172.21.15.53:0/1355774484 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf7f47c930 con 0x55cf7f3f0670 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.436+0000 7f5bbb7fe640 1 --2- 172.21.15.53:0/1355774484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f411350 0x55cf7f7b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.436+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/1355774484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f3e8490 0x55cf7f7b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.436+0000 7f5bc092e640 1 -- 172.21.15.53:0/4003530652 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7f5bac0e5820 con 0x7f5bbc1047d0 2024-08-31T06:20:13.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.436+0000 7f5bbb7fe640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ba80b4d20 0x7f5ba80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.436+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/1355774484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 0x55cf7f7b8200 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4011540 tx=0x7f5ba4011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e80ca71f92632 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:13.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.436+0000 7f5bb1ffb640 1 -- 172.21.15.53:0/1355774484 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4005020 con 0x55cf7f3f0670 2024-08-31T06:20:13.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.436+0000 7f5bb1ffb640 1 -- 172.21.15.53:0/1355774484 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ba40047a0 con 0x55cf7f3f0670 2024-08-31T06:20:13.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.437+0000 7f5bbb7fe640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ba80b4d20 0x7f5ba80b7230 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4006010 tx=0x7f5bb40095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:13.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.437+0000 7f5bb1ffb640 1 -- 172.21.15.53:0/1355774484 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba400f8a0 con 0x55cf7f3f0670 2024-08-31T06:20:13.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.437+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/1355774484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 msgr2=0x55cf7f7b8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:13.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.438+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/1355774484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 0x55cf7f7b8200 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4011540 tx=0x7f5ba4011a00 comp rx=0 tx=0).stop 2024-08-31T06:20:13.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.438+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/1355774484 shutdown_connections 2024-08-31T06:20:13.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.438+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/1355774484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 0x55cf7f7b8200 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.438+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/1355774484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f3e8490 0x55cf7f7b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.438+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/1355774484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f411350 0x55cf7f7b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.438+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/1355774484 >> 172.21.15.53:0/1355774484 conn(0x55cf7f405740 msgr2=0x55cf7f7b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.438+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/1355774484 shutdown_connections 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.438+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/1355774484 wait complete. 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.438+0000 7f5bc7ea5740 1 -- start start 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.439+0000 7f5bc7ea5740 1 Processor -- start 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.439+0000 7f5bc7ea5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.439+0000 7f5bc7ea5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 0x55cf7f7c8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.439+0000 7f5bbaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.439+0000 7f5bbaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49138/0 (socket says 172.21.15.53:49138) 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.439+0000 7f5bbaffd640 1 -- 172.21.15.53:0/2733731639 learned_addr learned my addr 172.21.15.53:0/2733731639 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2733731639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cf7f57f890 con 0x55cf7f3e8490 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2733731639 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cf7f6a3790 con 0x55cf7f411350 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2733731639 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cf7f7c5f60 con 0x55cf7f3f0670 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 0x55cf7f7c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bbb7fe640 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bc7ea5740 10 client.0 _ll_register_callbacks cb 0x55cf7f428ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bbaffd640 1 -- 172.21.15.53:0/2733731639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 msgr2=0x55cf7f7c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 0x55cf7f7c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bbaffd640 1 -- 172.21.15.53:0/2733731639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 msgr2=0x55cf7f7cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bbaffd640 1 -- 172.21.15.53:0/2733731639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf7f6daf30 con 0x55cf7f3e8490 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 0x55cf7f7c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c7bb0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f5bac01f000 tx=0x7f5bac0ab970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03b5c9ed190e4ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:13.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.440+0000 7f5b9affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:13.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.441+0000 7f5b9affd640 1 -- 172.21.15.53:0/2733731639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0b06d0 con 0x55cf7f3e8490 2024-08-31T06:20:13.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.441+0000 7f5b9affd640 1 -- 172.21.15.53:0/2733731639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7f5bac0a8450 con 0x55cf7f3e8490 2024-08-31T06:20:13.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.441+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2733731639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ba40047a0 con 0x55cf7f3e8490 2024-08-31T06:20:13.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.441+0000 7f5b9affd640 1 -- 172.21.15.53:0/2733731639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f5bac0b5180 con 0x55cf7f3e8490 2024-08-31T06:20:13.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.441+0000 7f5bc7ea5740 10 client.20349 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:13.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.441+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2733731639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55cf7f7d60c0 con 0x55cf7f3e8490 2024-08-31T06:20:13.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.441+0000 7f5b9affd640 1 -- 172.21.15.53:0/2733731639 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ba40047a0 con 0x55cf7f3e8490 2024-08-31T06:20:13.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.442+0000 7f5b9affd640 1 -- 172.21.15.53:0/2733731639 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f5bac0b0310 con 0x55cf7f3e8490 2024-08-31T06:20:13.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.442+0000 7f5bc7ea5740 10 client.20349 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:13.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.442+0000 7f5bc7ea5740 10 client.20349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:13.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.442+0000 7f5bc7ea5740 20 client.20349 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:13.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.442+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf7f3cfcd0 0x55cf7f7d9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.442+0000 7f5bc7ea5740 4 client.20349 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:13.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.442+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2733731639 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf7f72f540 con 0x55cf7f3cfcd0 2024-08-31T06:20:13.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.442+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf7f3cfcd0 0x55cf7f7d9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.442+0000 7f5b9affd640 10 client.20349 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:13.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.442+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf7f3cfcd0 0x55cf7f7d9930 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b163f8f16f5dff4 server_cookie=ff1985d04cde3793 in_seq=0 out_seq=0 2024-08-31T06:20:13.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.443+0000 7f5b9affd640 1 -- 172.21.15.53:0/2733731639 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf7f72f540 con 0x55cf7f3cfcd0 2024-08-31T06:20:13.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.443+0000 7f5b9affd640 10 client.20349 handle_command_reply: tid=0 2024-08-31T06:20:13.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.443+0000 7f5bc7ea5740 1 client.20349 shutdown 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2733731639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 msgr2=0x55cf7f7c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c7bb0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f5bac01f000 tx=0x7f5bac0ab970 comp rx=0 tx=0).stop 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2733731639 shutdown_connections 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf7f3cfcd0 0x55cf7f7d9930 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 0x55cf7f7c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2733731639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c7bb0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5b9affd640 0 client.20349 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2733731639 >> 172.21.15.53:0/2733731639 conn(0x55cf7f405740 msgr2=0x55cf7f7ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2733731639 shutdown_connections 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2733731639 wait complete. 2024-08-31T06:20:13.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.444+0000 7f5bc7ea5740 20 client.20349 trim_cache size 0 max 16384 2024-08-31T06:20:13.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.473+0000 7f5bc7ea5740 1 Processor -- start 2024-08-31T06:20:13.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.473+0000 7f5bc7ea5740 1 -- start start 2024-08-31T06:20:13.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.473+0000 7f5bc7ea5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.473+0000 7f5bc7ea5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 0x55cf7f7b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bc7ea5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bbaffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bc7ea5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc1ad350 con 0x55cf7f3f0670 2024-08-31T06:20:13.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bc7ea5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc1af0d0 con 0x55cf7f411350 2024-08-31T06:20:13.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bc7ea5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc1ada20 con 0x55cf7f3e8490 2024-08-31T06:20:13.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bbaffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:59060/0 (socket says 172.21.15.53:59060) 2024-08-31T06:20:13.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bbaffd640 1 -- 172.21.15.53:0/1175256458 learned_addr learned my addr 172.21.15.53:0/1175256458 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:13.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bbb7fe640 1 --2- 172.21.15.53:0/1175256458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/1175256458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 0x55cf7f7b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bbaffd640 1 -- 172.21.15.53:0/1175256458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 msgr2=0x55cf7f7ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:13.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/1175256458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bbaffd640 1 -- 172.21.15.53:0/1175256458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 msgr2=0x55cf7f7b8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:13.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/1175256458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 0x55cf7f7b8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.474+0000 7f5bbaffd640 1 -- 172.21.15.53:0/1175256458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf7f7b9a70 con 0x55cf7f3e8490 2024-08-31T06:20:13.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.475+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/1175256458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c68d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00c6a0 tx=0x7f5bac0a7e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61ab99998b359f4d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:13.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.475+0000 7f5bb17fa640 1 -- 172.21.15.53:0/1175256458 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0b06d0 con 0x55cf7f3e8490 2024-08-31T06:20:13.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.475+0000 7f5bb17fa640 1 -- 172.21.15.53:0/1175256458 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bac0971c0 con 0x55cf7f3e8490 2024-08-31T06:20:13.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.475+0000 7f5bb17fa640 1 -- 172.21.15.53:0/1175256458 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac093110 con 0x55cf7f3e8490 2024-08-31T06:20:13.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.476+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/1175256458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3e8490 msgr2=0x55cf7f7c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:13.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.476+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/1175256458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c68d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00c6a0 tx=0x7f5bac0a7e50 comp rx=0 tx=0).stop 2024-08-31T06:20:13.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.476+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/1175256458 shutdown_connections 2024-08-31T06:20:13.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.476+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/1175256458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.476+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/1175256458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3f0670 0x55cf7f7b8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.476+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/1175256458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3e8490 0x55cf7f7c68d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.476+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/1175256458 >> 172.21.15.53:0/1175256458 conn(0x55cf7f405740 msgr2=0x55cf7f7b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:13.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.476+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/1175256458 shutdown_connections 2024-08-31T06:20:13.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.476+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/1175256458 wait complete. 2024-08-31T06:20:13.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.477+0000 7f5bc7ea5740 1 -- start start 2024-08-31T06:20:13.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.477+0000 7f5bc7ea5740 1 Processor -- start 2024-08-31T06:20:13.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bc7ea5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 0x55cf7f7cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bc7ea5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 0x55cf7f7cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bc7ea5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bc7ea5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc1ae940 con 0x55cf7f3e8490 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bc7ea5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc1ae1b0 con 0x55cf7f411350 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bc7ea5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc1ab350 con 0x55cf7f3f0670 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bbaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 0x55cf7f7cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bb3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 0x55cf7f7cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bbaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 0x55cf7f7cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49166/0 (socket says 172.21.15.53:49166) 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bbaffd640 1 -- 172.21.15.53:0/2923974461 learned_addr learned my addr 172.21.15.53:0/2923974461 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bbb7fe640 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bc7ea5740 10 client.0 _ll_register_callbacks cb 0x7f5bac0ab5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bb3fff640 1 -- 172.21.15.53:0/2923974461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 msgr2=0x55cf7f7d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:13.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bb3fff640 1 -- 172.21.15.53:0/2923974461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 msgr2=0x55cf7f7cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:13.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 0x55cf7f7cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.478+0000 7f5bb3fff640 1 -- 172.21.15.53:0/2923974461 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf7f8432c0 con 0x55cf7f3f0670 2024-08-31T06:20:13.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.479+0000 7f5bbb7fe640 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:13.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.479+0000 7f5bb3fff640 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 0x55cf7f7cfd40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4004650 tx=0x7f5ba40047a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f359bc1743472b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:13.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.479+0000 7f5b9affd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:20:13.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.479+0000 7f5b9affd640 1 -- 172.21.15.53:0/2923974461 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4033060 con 0x55cf7f3f0670 2024-08-31T06:20:13.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.479+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2923974461 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bac0971c0 con 0x55cf7f3f0670 2024-08-31T06:20:13.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.479+0000 7f5b9affd640 1 -- 172.21.15.53:0/2923974461 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8601+0+0 (secure 0 0 0) 0x7f5ba4011030 con 0x55cf7f3f0670 2024-08-31T06:20:13.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.479+0000 7f5b9affd640 1 -- 172.21.15.53:0/2923974461 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f5ba401d040 con 0x55cf7f3f0670 2024-08-31T06:20:13.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.479+0000 7f5bc7ea5740 10 client.29314 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:13.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.479+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2923974461 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55cf7f844560 con 0x55cf7f3f0670 2024-08-31T06:20:13.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.480+0000 7f5b9affd640 1 -- 172.21.15.53:0/2923974461 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ba4011230 con 0x55cf7f3f0670 2024-08-31T06:20:13.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.480+0000 7f5b9affd640 1 -- 172.21.15.53:0/2923974461 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f5ba400f840 con 0x55cf7f3f0670 2024-08-31T06:20:13.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.480+0000 7f5bc7ea5740 10 client.29314 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:13.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.480+0000 7f5bc7ea5740 10 client.29314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:13.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.480+0000 7f5bc7ea5740 20 client.29314 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:13.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.480+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf7f3a5080 0x55cf7f846c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:13.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.480+0000 7f5bc7ea5740 4 client.29314 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:20:13.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.480+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2923974461 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f5bac0971c0 con 0x55cf7f3a5080 2024-08-31T06:20:13.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.481+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf7f3a5080 0x55cf7f846c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:13.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.481+0000 7f5b9affd640 10 client.29314 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:13.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.481+0000 7f5bbaffd640 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf7f3a5080 0x55cf7f846c10 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6de99e72d19e5f3b server_cookie=4f496dbd7e630934 in_seq=0 out_seq=0 2024-08-31T06:20:13.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5b9affd640 1 -- 172.21.15.53:0/2923974461 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f5bac0971c0 con 0x55cf7f3a5080 2024-08-31T06:20:13.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5b9affd640 10 client.29314 handle_command_reply: tid=0 2024-08-31T06:20:13.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5bc7ea5740 1 client.29314 shutdown 2024-08-31T06:20:13.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2923974461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 msgr2=0x55cf7f7cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:13.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 0x55cf7f7cfd40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4004650 tx=0x7f5ba40047a0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2923974461 shutdown_connections 2024-08-31T06:20:13.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cf7f3a5080 0x55cf7f846c10 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cf7f411350 0x55cf7f7d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf7f3f0670 0x55cf7f7cfd40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5bc7ea5740 1 --2- 172.21.15.53:0/2923974461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf7f3e8490 0x55cf7f7cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2923974461 >> 172.21.15.53:0/2923974461 conn(0x55cf7f405740 msgr2=0x55cf7f7c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:13.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.483+0000 7f5b9affd640 0 client.29314 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:13.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.484+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2923974461 shutdown_connections 2024-08-31T06:20:13.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.484+0000 7f5bc7ea5740 1 -- 172.21.15.53:0/2923974461 wait complete. 2024-08-31T06:20:13.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.484+0000 7f5bc7ea5740 20 client.29314 trim_cache size 0 max 16384 2024-08-31T06:20:13.487 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:20:13.487 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:20:13.487 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "935f53e4-02aa-49a7-b769-bab4481269e9", 2024-08-31T06:20:13.487 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:20:13.487 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:20:13.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 -- 172.21.15.53:0/4003530652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ba80b4d20 msgr2=0x7f5ba80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:13.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ba80b4d20 0x7f5ba80b7230 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4006010 tx=0x7f5bb40095c0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 -- 172.21.15.53:0/4003530652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bbc1047d0 msgr2=0x7f5bbc19a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:13.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bbc1047d0 0x7f5bbc19a110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00e9f0 tx=0x7f5bac00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 -- 172.21.15.53:0/4003530652 shutdown_connections 2024-08-31T06:20:13.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ba80b4d20 0x7f5ba80b7230 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bbc10dc00 0x7f5bbc19f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bbc105120 0x7f5bbc19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 --2- 172.21.15.53:0/4003530652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bbc1047d0 0x7f5bbc19a110 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:13.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 -- 172.21.15.53:0/4003530652 >> 172.21.15.53:0/4003530652 conn(0x7f5bbc079530 msgr2=0x7f5bbc107700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:13.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 -- 172.21.15.53:0/4003530652 shutdown_connections 2024-08-31T06:20:13.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:13.485+0000 7f5bc1930640 1 -- 172.21.15.53:0/4003530652 wait complete. 2024-08-31T06:20:14.091 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:13 smithi053 ceph-mon[18924]: pgmap v800: 97 pgs: 97 active+clean; 435 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 309 op/s 2024-08-31T06:20:14.091 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:13 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:20:14.091 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:13 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:14.091 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:13 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:20:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:13 smithi130 ceph-mon[22266]: pgmap v800: 97 pgs: 97 active+clean; 435 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 309 op/s 2024-08-31T06:20:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:13 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:20:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:13 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:13 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:20:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:13 smithi153 ceph-mon[22320]: pgmap v800: 97 pgs: 97 active+clean; 435 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 309 op/s 2024-08-31T06:20:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:13 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:20:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:13 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:13 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:20:14.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 14501 11.54 MB/sec execute 2 sec latency 474.735 ms 2024-08-31T06:20:14.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:20:14.891 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:15.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:20:15.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:20:15.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:20:15.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:14 smithi130 ceph-mon[22266]: osdmap e94: 12 total, 12 up, 12 in 2024-08-31T06:20:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:20:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:20:15.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:14 smithi153 ceph-mon[22320]: osdmap e94: 12 total, 12 up, 12 in 2024-08-31T06:20:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:20:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:20:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:20:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:20:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:20:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:20:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:20:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:20:15.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:14 smithi053 ceph-mon[18924]: osdmap e94: 12 total, 12 up, 12 in 2024-08-31T06:20:15.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 14642 9.69 MB/sec execute 3 sec latency 98.673 ms 2024-08-31T06:20:16.078 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:15 smithi053 ceph-mon[18924]: pgmap v802: 97 pgs: 97 active+clean; 440 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 291 op/s 2024-08-31T06:20:16.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:15 smithi130 ceph-mon[22266]: pgmap v802: 97 pgs: 97 active+clean; 440 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 291 op/s 2024-08-31T06:20:16.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:15 smithi153 ceph-mon[22320]: pgmap v802: 97 pgs: 97 active+clean; 440 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 291 op/s 2024-08-31T06:20:16.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 14792 9.62 MB/sec execute 4 sec latency 65.175 ms 2024-08-31T06:20:17.005 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T06:20:17.005 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.25 2024-08-31T06:20:17.006 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:20:17.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 14913 8.20 MB/sec execute 5 sec latency 125.412 ms 2024-08-31T06:20:18.123 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:17 smithi053 ceph-mon[18924]: pgmap v803: 97 pgs: 97 active+clean; 444 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.8 MiB/s wr, 328 op/s 2024-08-31T06:20:18.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:17 smithi130 ceph-mon[22266]: pgmap v803: 97 pgs: 97 active+clean; 444 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.8 MiB/s wr, 328 op/s 2024-08-31T06:20:18.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:17 smithi153 ceph-mon[22320]: pgmap v803: 97 pgs: 97 active+clean; 444 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.8 MiB/s wr, 328 op/s 2024-08-31T06:20:18.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 15037 7.96 MB/sec execute 6 sec latency 94.354 ms 2024-08-31T06:20:19.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.247+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/3173046429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf24108170 msgr2=0x7fbf24108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.247+0000 7fbf2c2b1640 1 --2- 172.21.15.53:0/3173046429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf24108170 0x7fbf24108580 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009900 tx=0x7fbf1402a410 comp rx=0 tx=0).stop 2024-08-31T06:20:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.247+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/3173046429 shutdown_connections 2024-08-31T06:20:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.247+0000 7fbf2c2b1640 1 --2- 172.21.15.53:0/3173046429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf24108ac0 0x7fbf2410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.248+0000 7fbf2c2b1640 1 --2- 172.21.15.53:0/3173046429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf24108170 0x7fbf24108580 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.248+0000 7fbf2c2b1640 1 --2- 172.21.15.53:0/3173046429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf24102880 0x7fbf24102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.248+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/3173046429 >> 172.21.15.53:0/3173046429 conn(0x7fbf24079530 msgr2=0x7fbf24079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.248+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/3173046429 shutdown_connections 2024-08-31T06:20:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.248+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/3173046429 wait complete. 2024-08-31T06:20:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.248+0000 7fbf2c2b1640 1 Processor -- start 2024-08-31T06:20:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.248+0000 7fbf2c2b1640 1 -- start start 2024-08-31T06:20:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2c2b1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf24102880 0x7fbf241990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2c2b1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf24108170 0x7fbf24199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2c2b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf24108ac0 0x7fbf2419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2c2b1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbf24112600 con 0x7fbf24108ac0 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2c2b1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf24112480 con 0x7fbf24108170 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2c2b1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf24112780 con 0x7fbf24102880 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2a84e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf24108ac0 0x7fbf2419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2a84e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf24108ac0 0x7fbf2419e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49178/0 (socket says 172.21.15.53:49178) 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2a84e640 1 -- 172.21.15.53:0/75392507 learned_addr learned my addr 172.21.15.53:0/75392507 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf24102880 0x7fbf241990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2984c640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf24108170 0x7fbf24199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2a84e640 1 -- 172.21.15.53:0/75392507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf24102880 msgr2=0x7fbf241990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2a84e640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf24102880 0x7fbf241990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2a84e640 1 -- 172.21.15.53:0/75392507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf24108170 msgr2=0x7fbf24199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2a84e640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf24108170 0x7fbf24199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2a84e640 1 -- 172.21.15.53:0/75392507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2419f040 con 0x7fbf24108ac0 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2a84e640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf24108ac0 0x7fbf2419e910 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00efd0 tx=0x7fbf1c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf1b7fe640 1 -- 172.21.15.53:0/75392507 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c003b70 con 0x7fbf24108ac0 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf1b7fe640 1 -- 172.21.15.53:0/75392507 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf1c003d10 con 0x7fbf24108ac0 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/75392507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2419f330 con 0x7fbf24108ac0 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf1b7fe640 1 -- 172.21.15.53:0/75392507 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c010850 con 0x7fbf24108ac0 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.249+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/75392507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf241a5a90 con 0x7fbf24108ac0 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.252+0000 7fbf32826740 1 Processor -- start 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.252+0000 7fbf1b7fe640 1 -- 172.21.15.53:0/75392507 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbf1c004020 con 0x7fbf24108ac0 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.252+0000 7fbf32826740 1 -- start start 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf32826740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5c7070 0x55bc7c96c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf32826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c59e1b0 0x55bc7c96c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf32826740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5a6390 0x55bc7c96cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf32826740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c8e3630 con 0x55bc7c5a6390 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf32826740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c8d2bc0 con 0x55bc7c5c7070 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf32826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c8d6b70 con 0x55bc7c59e1b0 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2984c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5a6390 0x55bc7c96cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2984c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5a6390 0x55bc7c96cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49194/0 (socket says 172.21.15.53:49194) 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2984c640 1 -- 172.21.15.53:0/471304274 learned_addr learned my addr 172.21.15.53:0/471304274 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2984c640 1 --2- 172.21.15.53:0/471304274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5c7070 0x55bc7c96c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/471304274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c59e1b0 0x55bc7c96c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf1b7fe640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf100b4ca0 0x7fbf100b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2984c640 1 -- 172.21.15.53:0/471304274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c59e1b0 msgr2=0x55bc7c96c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2984c640 1 --2- 172.21.15.53:0/471304274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c59e1b0 0x55bc7c96c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2984c640 1 -- 172.21.15.53:0/471304274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5c7070 msgr2=0x55bc7c96c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2984c640 1 --2- 172.21.15.53:0/471304274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5c7070 0x55bc7c96c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2984c640 1 -- 172.21.15.53:0/471304274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc7c632650 con 0x55bc7c5a6390 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2a84e640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf100b4ca0 0x7fbf100b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf1b7fe640 1 -- 172.21.15.53:0/75392507 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fbf1c0e5990 con 0x7fbf24108ac0 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf2984c640 1 --2- 172.21.15.53:0/471304274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5a6390 0x55bc7c96cd40 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fbf140057c0 tx=0x7fbf14005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c206e9f31fba50c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.253+0000 7fbf18d9a640 1 -- 172.21.15.53:0/471304274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14044020 con 0x55bc7c5a6390 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.254+0000 7fbf18d9a640 1 -- 172.21.15.53:0/471304274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf14031c70 con 0x55bc7c5a6390 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.254+0000 7fbf18d9a640 1 -- 172.21.15.53:0/471304274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14035070 con 0x55bc7c5a6390 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.254+0000 7fbf32826740 1 -- 172.21.15.53:0/471304274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5a6390 msgr2=0x55bc7c96cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.254+0000 7fbf2a84e640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf100b4ca0 0x7fbf100b71b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0a92d0 tx=0x7fbf1c009f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.254+0000 7fbf32826740 1 --2- 172.21.15.53:0/471304274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5a6390 0x55bc7c96cd40 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fbf140057c0 tx=0x7fbf14005fd0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.254+0000 7fbf32826740 1 -- 172.21.15.53:0/471304274 shutdown_connections 2024-08-31T06:20:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.254+0000 7fbf32826740 1 --2- 172.21.15.53:0/471304274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5a6390 0x55bc7c96cd40 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.254+0000 7fbf32826740 1 --2- 172.21.15.53:0/471304274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c59e1b0 0x55bc7c96c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.254+0000 7fbf32826740 1 --2- 172.21.15.53:0/471304274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5c7070 0x55bc7c96c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.254+0000 7fbf32826740 1 -- 172.21.15.53:0/471304274 >> 172.21.15.53:0/471304274 conn(0x55bc7c5bb460 msgr2=0x55bc7c96a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf32826740 1 -- 172.21.15.53:0/471304274 shutdown_connections 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf32826740 1 -- 172.21.15.53:0/471304274 wait complete. 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf32826740 1 -- start start 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf32826740 1 Processor -- start 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf32826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c59e1b0 0x55bc7c9779e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf32826740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5a6390 0x55bc7c977f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf32826740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5c7070 0x55bc7c985f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf32826740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c735700 con 0x55bc7c5c7070 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf32826740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c859700 con 0x55bc7c5a6390 2024-08-31T06:20:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf32826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c97cc50 con 0x55bc7c59e1b0 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf32826740 10 client.0 _ll_register_callbacks cb 0x55bc7c888dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.255+0000 7fbf2984c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5c7070 0x55bc7c985f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf2984c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5c7070 0x55bc7c985f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49196/0 (socket says 172.21.15.53:49196) 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf2984c640 1 -- 172.21.15.53:0/2735967807 learned_addr learned my addr 172.21.15.53:0/2735967807 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5a6390 0x55bc7c977f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf2984c640 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c59e1b0 0x55bc7c9779e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf2984c640 1 -- 172.21.15.53:0/2735967807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c59e1b0 msgr2=0x55bc7c9779e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf2984c640 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c59e1b0 0x55bc7c9779e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf2984c640 1 -- 172.21.15.53:0/2735967807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5a6390 msgr2=0x55bc7c977f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf2984c640 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5a6390 0x55bc7c977f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf2984c640 1 -- 172.21.15.53:0/2735967807 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc7c8928b0 con 0x55bc7c5c7070 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf2984c640 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5c7070 0x55bc7c985f70 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fbf1402ac00 tx=0x7fbf14005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eefe0e2f16bee79 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf0dffb640 1 -- 172.21.15.53:0/2735967807 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14044050 con 0x55bc7c5c7070 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf0dffb640 1 -- 172.21.15.53:0/2735967807 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fbf1403d650 con 0x55bc7c5c7070 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf32826740 1 -- 172.21.15.53:0/2735967807 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf14031c70 con 0x55bc7c5c7070 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf0dffb640 1 -- 172.21.15.53:0/2735967807 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fbf14035040 con 0x55bc7c5c7070 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf32826740 10 client.20367 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.256+0000 7fbf32826740 1 -- 172.21.15.53:0/2735967807 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55bc7c9889f0 con 0x55bc7c5c7070 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.257+0000 7fbf0dffb640 1 -- 172.21.15.53:0/2735967807 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf14031c70 con 0x55bc7c5c7070 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.257+0000 7fbf0dffb640 1 -- 172.21.15.53:0/2735967807 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fbf14049620 con 0x55bc7c5c7070 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.257+0000 7fbf32826740 10 client.20367 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.257+0000 7fbf32826740 10 client.20367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.257+0000 7fbf32826740 20 client.20367 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.257+0000 7fbf32826740 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc7c5859f0 0x55bc7c98bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.257+0000 7fbf32826740 4 client.20367 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.257+0000 7fbf32826740 1 -- 172.21.15.53:0/2735967807 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc7c8e5580 con 0x55bc7c5859f0 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.257+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc7c5859f0 0x55bc7c98bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.258+0000 7fbf0dffb640 10 client.20367 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.258+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc7c5859f0 0x55bc7c98bd50 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0193b1e908f1843 server_cookie=ac809aefac7a64c in_seq=0 out_seq=0 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.258+0000 7fbf0dffb640 1 -- 172.21.15.53:0/2735967807 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc7c8e5580 con 0x55bc7c5859f0 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.258+0000 7fbf0dffb640 10 client.20367 handle_command_reply: tid=0 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.258+0000 7fbf32826740 1 client.20367 shutdown 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf32826740 1 -- 172.21.15.53:0/2735967807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5c7070 msgr2=0x55bc7c985f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf32826740 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5c7070 0x55bc7c985f70 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fbf1402ac00 tx=0x7fbf14005ed0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf32826740 1 -- 172.21.15.53:0/2735967807 shutdown_connections 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf32826740 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc7c5859f0 0x55bc7c98bd50 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf32826740 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c5c7070 0x55bc7c985f70 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf0dffb640 0 client.20367 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf32826740 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5a6390 0x55bc7c977f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf32826740 1 --2- 172.21.15.53:0/2735967807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c59e1b0 0x55bc7c9779e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf32826740 1 -- 172.21.15.53:0/2735967807 >> 172.21.15.53:0/2735967807 conn(0x55bc7c5bb460 msgr2=0x55bc7c96f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf32826740 1 -- 172.21.15.53:0/2735967807 shutdown_connections 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf32826740 1 -- 172.21.15.53:0/2735967807 wait complete. 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.259+0000 7fbf32826740 20 client.20367 trim_cache size 0 max 16384 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.281+0000 7fbf32826740 1 Processor -- start 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.281+0000 7fbf32826740 1 -- start start 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf32826740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5859f0 0x55bc7c96faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf32826740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 0x55bc7c977950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf32826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c5a6390 0x55bc7c974bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf32826740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbf241ad240 con 0x55bc7c59e1b0 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf32826740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf241aefc0 con 0x55bc7c5859f0 2024-08-31T06:20:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf32826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf241ad910 con 0x55bc7c5a6390 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf2a04d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 0x55bc7c977950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf2a04d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 0x55bc7c977950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49200/0 (socket says 172.21.15.53:49200) 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf2a04d640 1 -- 172.21.15.53:0/73521745 learned_addr learned my addr 172.21.15.53:0/73521745 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf2984c640 1 --2- 172.21.15.53:0/73521745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5859f0 0x55bc7c96faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf2984c640 1 --2- 172.21.15.53:0/73521745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c5a6390 0x55bc7c974bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf2a04d640 1 -- 172.21.15.53:0/73521745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c5a6390 msgr2=0x55bc7c974bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/73521745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c5a6390 0x55bc7c974bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf2a04d640 1 -- 172.21.15.53:0/73521745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5859f0 msgr2=0x55bc7c96faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/73521745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5859f0 0x55bc7c96faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf2a04d640 1 -- 172.21.15.53:0/73521745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc7c976940 con 0x55bc7c59e1b0 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.282+0000 7fbf2984c640 1 --2- 172.21.15.53:0/73521745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5859f0 0x55bc7c96faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.283+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/73521745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 0x55bc7c977950 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009be0 tx=0x7fbf20005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82781886ab463bc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.283+0000 7fbf0ffff640 1 -- 172.21.15.53:0/73521745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20005020 con 0x55bc7c59e1b0 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.283+0000 7fbf0ffff640 1 -- 172.21.15.53:0/73521745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf200047a0 con 0x55bc7c59e1b0 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.283+0000 7fbf0ffff640 1 -- 172.21.15.53:0/73521745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20005650 con 0x55bc7c59e1b0 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.284+0000 7fbf32826740 1 -- 172.21.15.53:0/73521745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 msgr2=0x55bc7c977950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.284+0000 7fbf32826740 1 --2- 172.21.15.53:0/73521745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 0x55bc7c977950 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009be0 tx=0x7fbf20005f90 comp rx=0 tx=0).stop 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.284+0000 7fbf32826740 1 -- 172.21.15.53:0/73521745 shutdown_connections 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.284+0000 7fbf32826740 1 --2- 172.21.15.53:0/73521745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c5a6390 0x55bc7c974bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.284+0000 7fbf32826740 1 --2- 172.21.15.53:0/73521745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 0x55bc7c977950 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.284+0000 7fbf32826740 1 --2- 172.21.15.53:0/73521745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5859f0 0x55bc7c96faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.284+0000 7fbf32826740 1 -- 172.21.15.53:0/73521745 >> 172.21.15.53:0/73521745 conn(0x55bc7c5bb460 msgr2=0x55bc7c96f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.284+0000 7fbf32826740 1 -- 172.21.15.53:0/73521745 shutdown_connections 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.284+0000 7fbf32826740 1 -- 172.21.15.53:0/73521745 wait complete. 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.285+0000 7fbf32826740 1 -- start start 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.285+0000 7fbf32826740 1 Processor -- start 2024-08-31T06:20:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.285+0000 7fbf32826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c5859f0 0x55bc7c98d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.285+0000 7fbf32826740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 0x55bc7c98df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.285+0000 7fbf32826740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5a6390 0x55bc7c9ed480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.285+0000 7fbf32826740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbf241ae830 con 0x55bc7c59e1b0 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.285+0000 7fbf32826740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf241ae0a0 con 0x55bc7c5a6390 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.285+0000 7fbf32826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf241ab240 con 0x55bc7c5859f0 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf32826740 10 client.0 _ll_register_callbacks cb 0x7fbf14009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf2984c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c5859f0 0x55bc7c98d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf2984c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c5859f0 0x55bc7c98d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:59118/0 (socket says 172.21.15.53:59118) 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf2984c640 1 -- 172.21.15.53:0/661114504 learned_addr learned my addr 172.21.15.53:0/661114504 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 0x55bc7c98df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf2984c640 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5a6390 0x55bc7c9ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf2a04d640 1 -- 172.21.15.53:0/661114504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c5859f0 msgr2=0x55bc7c98d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c5859f0 0x55bc7c98d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf2a04d640 1 -- 172.21.15.53:0/661114504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5a6390 msgr2=0x55bc7c9ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5a6390 0x55bc7c9ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf2a04d640 1 -- 172.21.15.53:0/661114504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc7c9edaf0 con 0x55bc7c59e1b0 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.286+0000 7fbf2a04d640 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 0x55bc7c98df10 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fbf20005890 tx=0x7fbf20009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d409586e12f743c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.287+0000 7fbf0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.287+0000 7fbf0dffb640 1 -- 172.21.15.53:0/661114504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20029040 con 0x55bc7c59e1b0 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.287+0000 7fbf32826740 1 -- 172.21.15.53:0/661114504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf200047a0 con 0x55bc7c59e1b0 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.287+0000 7fbf0dffb640 1 -- 172.21.15.53:0/661114504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fbf20003cd0 con 0x55bc7c59e1b0 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.287+0000 7fbf0dffb640 1 -- 172.21.15.53:0/661114504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fbf20004950 con 0x55bc7c59e1b0 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.287+0000 7fbf32826740 10 client.20373 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.287+0000 7fbf32826740 1 -- 172.21.15.53:0/661114504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55bc7c97a6a0 con 0x55bc7c59e1b0 2024-08-31T06:20:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.287+0000 7fbf0dffb640 1 -- 172.21.15.53:0/661114504 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf200047a0 con 0x55bc7c59e1b0 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.288+0000 7fbf0dffb640 1 -- 172.21.15.53:0/661114504 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fbf20023070 con 0x55bc7c59e1b0 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.288+0000 7fbf32826740 10 client.20373 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.288+0000 7fbf32826740 10 client.20373 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.288+0000 7fbf32826740 20 client.20373 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.288+0000 7fbf32826740 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc7c5c7070 0x55bc7c97adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.288+0000 7fbf32826740 4 client.20373 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.288+0000 7fbf32826740 1 -- 172.21.15.53:0/661114504 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bc7c8e1020 con 0x55bc7c5c7070 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.288+0000 7fbf2984c640 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc7c5c7070 0x55bc7c97adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.288+0000 7fbf0dffb640 10 client.20373 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.288+0000 7fbf2984c640 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc7c5c7070 0x55bc7c97adb0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7d72a7f7f1ec1f server_cookie=eac1f9351e9ebd7 in_seq=0 out_seq=0 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf0dffb640 1 -- 172.21.15.53:0/661114504 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5966 (crc 0 0 0) 0x55bc7c8e1020 con 0x55bc7c5c7070 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf0dffb640 10 client.20373 handle_command_reply: tid=0 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 1 client.20373 shutdown 2024-08-31T06:20:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 1 -- 172.21.15.53:0/661114504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 msgr2=0x55bc7c98df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 0x55bc7c98df10 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fbf20005890 tx=0x7fbf20009ae0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 1 -- 172.21.15.53:0/661114504 shutdown_connections 2024-08-31T06:20:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bc7c5c7070 0x55bc7c97adb0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bc7c5a6390 0x55bc7c9ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bc7c59e1b0 0x55bc7c98df10 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf0dffb640 0 client.20373 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 1 --2- 172.21.15.53:0/661114504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc7c5859f0 0x55bc7c98d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 1 -- 172.21.15.53:0/661114504 >> 172.21.15.53:0/661114504 conn(0x55bc7c5bb460 msgr2=0x55bc7c96d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 1 -- 172.21.15.53:0/661114504 shutdown_connections 2024-08-31T06:20:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 1 -- 172.21.15.53:0/661114504 wait complete. 2024-08-31T06:20:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.289+0000 7fbf32826740 20 client.20373 trim_cache size 0 max 16384 2024-08-31T06:20:19.174 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:20:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:20:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:20:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:20:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "935f53e4-02aa-49a7-b769-bab4481269e9", 2024-08-31T06:20:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:20:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:20:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:20:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:20:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:19.186 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:20:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/75392507 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf100b4ca0 msgr2=0x7fbf100b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf100b4ca0 0x7fbf100b71b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0a92d0 tx=0x7fbf1c009f90 comp rx=0 tx=0).stop 2024-08-31T06:20:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/75392507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf24108ac0 msgr2=0x7fbf2419e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf24108ac0 0x7fbf2419e910 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00efd0 tx=0x7fbf1c00c6a0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/75392507 shutdown_connections 2024-08-31T06:20:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf100b4ca0 0x7fbf100b71b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf24108ac0 0x7fbf2419e910 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf24108170 0x7fbf24199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 --2- 172.21.15.53:0/75392507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf24102880 0x7fbf241990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/75392507 >> 172.21.15.53:0/75392507 conn(0x7fbf24079530 msgr2=0x7fbf24104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:19.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/75392507 shutdown_connections 2024-08-31T06:20:19.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:18.290+0000 7fbf2c2b1640 1 -- 172.21.15.53:0/75392507 wait complete. 2024-08-31T06:20:19.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 15150 7.35 MB/sec execute 7 sec latency 134.917 ms 2024-08-31T06:20:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:19 smithi130 ceph-mon[22266]: pgmap v804: 97 pgs: 97 active+clean; 447 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.8 MiB/s wr, 372 op/s 2024-08-31T06:20:20.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:19 smithi153 ceph-mon[22320]: pgmap v804: 97 pgs: 97 active+clean; 447 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.8 MiB/s wr, 372 op/s 2024-08-31T06:20:20.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:19 smithi053 ceph-mon[18924]: pgmap v804: 97 pgs: 97 active+clean; 447 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.8 MiB/s wr, 372 op/s 2024-08-31T06:20:20.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 15285 7.48 MB/sec execute 8 sec latency 131.334 ms 2024-08-31T06:20:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.292+0000 7f525c9a1640 1 -- 172.21.15.53:0/2553463843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52581080a0 msgr2=0x7f52581084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.292+0000 7f525c9a1640 1 --2- 172.21.15.53:0/2553463843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52581080a0 0x7f52581084b0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f524c009900 tx=0x7f524c02a410 comp rx=0 tx=0).stop 2024-08-31T06:20:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.292+0000 7f525c9a1640 1 -- 172.21.15.53:0/2553463843 shutdown_connections 2024-08-31T06:20:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.292+0000 7f525c9a1640 1 --2- 172.21.15.53:0/2553463843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52581089f0 0x7f525810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.292+0000 7f525c9a1640 1 --2- 172.21.15.53:0/2553463843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52581080a0 0x7f52581084b0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.292+0000 7f525c9a1640 1 --2- 172.21.15.53:0/2553463843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5258102770 0x7f5258102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.292+0000 7f525c9a1640 1 -- 172.21.15.53:0/2553463843 >> 172.21.15.53:0/2553463843 conn(0x7f525807a490 msgr2=0x7f525807a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.292+0000 7f525c9a1640 1 -- 172.21.15.53:0/2553463843 shutdown_connections 2024-08-31T06:20:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.292+0000 7f525c9a1640 1 -- 172.21.15.53:0/2553463843 wait complete. 2024-08-31T06:20:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.293+0000 7f525c9a1640 1 Processor -- start 2024-08-31T06:20:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.294+0000 7f525c9a1640 1 -- start start 2024-08-31T06:20:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.294+0000 7f525c9a1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5258102770 0x7f52581a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.294+0000 7f525c9a1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52581080a0 0x7f52581a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.294+0000 7f525c9a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52581089f0 0x7f52581a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.294+0000 7f525c9a1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5258112530 con 0x7f52581089f0 2024-08-31T06:20:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.294+0000 7f525c9a1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f52581123b0 con 0x7f52581080a0 2024-08-31T06:20:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.294+0000 7f525c9a1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52581126b0 con 0x7f5258102770 2024-08-31T06:20:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.294+0000 7f5256d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52581089f0 0x7f52581a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.294+0000 7f5256d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52581089f0 0x7f52581a5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49232/0 (socket says 172.21.15.53:49232) 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.294+0000 7f5256d9d640 1 -- 172.21.15.53:0/3853009298 learned_addr learned my addr 172.21.15.53:0/3853009298 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.294+0000 7f5255d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52581080a0 0x7f52581a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.295+0000 7f525659c640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5258102770 0x7f52581a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.295+0000 7f5256d9d640 1 -- 172.21.15.53:0/3853009298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5258102770 msgr2=0x7f52581a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.295+0000 7f5256d9d640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5258102770 0x7f52581a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.295+0000 7f5256d9d640 1 -- 172.21.15.53:0/3853009298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52581080a0 msgr2=0x7f52581a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.295+0000 7f5256d9d640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52581080a0 0x7f52581a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.295+0000 7f5256d9d640 1 -- 172.21.15.53:0/3853009298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52581a64a0 con 0x7f52581089f0 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.295+0000 7f5255d9b640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52581080a0 0x7f52581a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.295+0000 7f525659c640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5258102770 0x7f52581a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.295+0000 7f5256d9d640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52581089f0 0x7f52581a5da0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f525000eb10 tx=0x7f525000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.295+0000 7f52477fe640 1 -- 172.21.15.53:0/3853009298 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250004b20 con 0x7f52581089f0 2024-08-31T06:20:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.295+0000 7f52477fe640 1 -- 172.21.15.53:0/3853009298 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5250004cc0 con 0x7f52581089f0 2024-08-31T06:20:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.296+0000 7f525c9a1640 1 -- 172.21.15.53:0/3853009298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52581a6790 con 0x7f52581089f0 2024-08-31T06:20:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.296+0000 7f525c9a1640 1 -- 172.21.15.53:0/3853009298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52581acf20 con 0x7f52581089f0 2024-08-31T06:20:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.296+0000 7f52477fe640 1 -- 172.21.15.53:0/3853009298 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250010690 con 0x7f52581089f0 2024-08-31T06:20:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.299+0000 7f52639e6740 1 Processor -- start 2024-08-31T06:20:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.299+0000 7f52477fe640 1 -- 172.21.15.53:0/3853009298 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5250010830 con 0x7f52581089f0 2024-08-31T06:20:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.300+0000 7f52639e6740 1 -- start start 2024-08-31T06:20:21.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.300+0000 7f52639e6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 0x55aa03da1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.300+0000 7f52639e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039d52f0 0x55aa03da2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.300+0000 7f52639e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039dd4d0 0x55aa03da2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.300+0000 7f52639e6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55aa03d17000 con 0x55aa039fe1b0 2024-08-31T06:20:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.300+0000 7f52639e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55aa03d06590 con 0x55aa039d52f0 2024-08-31T06:20:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.300+0000 7f52639e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa03d0a540 con 0x55aa039dd4d0 2024-08-31T06:20:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.300+0000 7f5255d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 0x55aa03da1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.300+0000 7f525659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039d52f0 0x55aa03da2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.300+0000 7f5255d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 0x55aa03da1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49246/0 (socket says 172.21.15.53:49246) 2024-08-31T06:20:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.300+0000 7f5255d9b640 1 -- 172.21.15.53:0/2961932913 learned_addr learned my addr 172.21.15.53:0/2961932913 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.301+0000 7f525659c640 1 -- 172.21.15.53:0/2961932913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039dd4d0 msgr2=0x55aa03da2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.301+0000 7f525659c640 1 --2- 172.21.15.53:0/2961932913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039dd4d0 0x55aa03da2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.301+0000 7f525659c640 1 -- 172.21.15.53:0/2961932913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 msgr2=0x55aa03da1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.301+0000 7f525659c640 1 --2- 172.21.15.53:0/2961932913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 0x55aa03da1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.301+0000 7f525659c640 1 -- 172.21.15.53:0/2961932913 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa03a69790 con 0x55aa039d52f0 2024-08-31T06:20:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.301+0000 7f5255d9b640 1 --2- 172.21.15.53:0/2961932913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 0x55aa03da1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.301+0000 7f525659c640 1 --2- 172.21.15.53:0/2961932913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039d52f0 0x55aa03da2000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5248009c70 tx=0x7f5248010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdfe845fa95233d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.301+0000 7f52477fe640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52400b4da0 0x7f52400b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.301+0000 7f5244ff9640 1 -- 172.21.15.53:0/2961932913 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248004030 con 0x55aa039d52f0 2024-08-31T06:20:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.302+0000 7f52477fe640 1 -- 172.21.15.53:0/3853009298 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f52500e5b00 con 0x7f52581089f0 2024-08-31T06:20:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.302+0000 7f5255d9b640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52400b4da0 0x7f52400b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.302+0000 7f5244ff9640 1 -- 172.21.15.53:0/2961932913 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52480035f0 con 0x55aa039d52f0 2024-08-31T06:20:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.302+0000 7f5244ff9640 1 -- 172.21.15.53:0/2961932913 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248012690 con 0x55aa039d52f0 2024-08-31T06:20:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.303+0000 7f52639e6740 1 -- 172.21.15.53:0/2961932913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039d52f0 msgr2=0x55aa03da2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.303+0000 7f52639e6740 1 --2- 172.21.15.53:0/2961932913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039d52f0 0x55aa03da2000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5248009c70 tx=0x7f5248010740 comp rx=0 tx=0).stop 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.303+0000 7f5255d9b640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52400b4da0 0x7f52400b72b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f524c00b230 tx=0x7f524c00b040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.303+0000 7f52639e6740 1 -- 172.21.15.53:0/2961932913 shutdown_connections 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.303+0000 7f52639e6740 1 --2- 172.21.15.53:0/2961932913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039dd4d0 0x55aa03da2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.303+0000 7f52639e6740 1 --2- 172.21.15.53:0/2961932913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039d52f0 0x55aa03da2000 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.303+0000 7f52639e6740 1 --2- 172.21.15.53:0/2961932913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 0x55aa03da1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.303+0000 7f52639e6740 1 -- 172.21.15.53:0/2961932913 >> 172.21.15.53:0/2961932913 conn(0x55aa039f2300 msgr2=0x55aa03d9f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.303+0000 7f52639e6740 1 -- 172.21.15.53:0/2961932913 shutdown_connections 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.303+0000 7f52639e6740 1 -- 172.21.15.53:0/2961932913 wait complete. 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.304+0000 7f52639e6740 1 -- start start 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.304+0000 7f52639e6740 1 Processor -- start 2024-08-31T06:20:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.304+0000 7f52639e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039d52f0 0x55aa03dad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.304+0000 7f52639e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 0x55aa03dadc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f52639e6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 0x55aa03db95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f52639e6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55aa03c3fab0 con 0x55aa039fe1b0 2024-08-31T06:20:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f52639e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55aa03c8d680 con 0x55aa039dd4d0 2024-08-31T06:20:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f52639e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa03db0240 con 0x55aa039d52f0 2024-08-31T06:20:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f5255d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 0x55aa03dadc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f5255d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 0x55aa03dadc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52910/0 (socket says 172.21.15.53:52910) 2024-08-31T06:20:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f5255d9b640 1 -- 172.21.15.53:0/53723672 learned_addr learned my addr 172.21.15.53:0/53723672 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f52639e6740 10 client.0 _ll_register_callbacks cb 0x55aa03a15a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f5256d9d640 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 0x55aa03db95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f525659c640 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039d52f0 0x55aa03dad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f5255d9b640 1 -- 172.21.15.53:0/53723672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039d52f0 msgr2=0x55aa03dad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f5255d9b640 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039d52f0 0x55aa03dad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f5255d9b640 1 -- 172.21.15.53:0/53723672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 msgr2=0x55aa03db95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f5255d9b640 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 0x55aa03db95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f5255d9b640 1 -- 172.21.15.53:0/53723672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa03ae2620 con 0x55aa039dd4d0 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f5255d9b640 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 0x55aa03dadc60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f524c009900 tx=0x7f524c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7644852a3ff4ff58 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.305+0000 7f523dffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f523dffb640 1 -- 172.21.15.53:0/53723672 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c03dc10 con 0x55aa039dd4d0 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f52639e6740 1 -- 172.21.15.53:0/53723672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52480035f0 con 0x55aa039dd4d0 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f523dffb640 1 -- 172.21.15.53:0/53723672 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f524c03ddb0 con 0x55aa039dd4d0 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f523dffb640 1 -- 172.21.15.53:0/53723672 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f524c046460 con 0x55aa039dd4d0 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f52639e6740 10 client.29333 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f52639e6740 1 -- 172.21.15.53:0/53723672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55aa03dbc340 con 0x55aa039dd4d0 2024-08-31T06:20:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f523dffb640 1 -- 172.21.15.53:0/53723672 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52480035f0 con 0x55aa039dd4d0 2024-08-31T06:20:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f523dffb640 1 -- 172.21.15.53:0/53723672 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f524c04f070 con 0x55aa039dd4d0 2024-08-31T06:20:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f52639e6740 10 client.29333 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f52639e6740 10 client.29333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f52639e6740 20 client.29333 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f52639e6740 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa039bcd80 0x55aa03dbfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f52639e6740 4 client.29333 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.306+0000 7f52639e6740 1 -- 172.21.15.53:0/53723672 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa03d18f50 con 0x55aa039bcd80 2024-08-31T06:20:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.307+0000 7f525659c640 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa039bcd80 0x55aa03dbfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.307+0000 7f525659c640 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa039bcd80 0x55aa03dbfbf0 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb9dd85281569394 server_cookie=a11ff8d6ef9663f7 in_seq=0 out_seq=0 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.307+0000 7f523dffb640 10 client.29333 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f523dffb640 1 -- 172.21.15.53:0/53723672 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa03d18f50 con 0x55aa039bcd80 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f523dffb640 10 client.29333 handle_command_reply: tid=0 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 1 client.29333 shutdown 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 1 -- 172.21.15.53:0/53723672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 msgr2=0x55aa03dadc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 0x55aa03dadc60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f524c009900 tx=0x7f524c000bc0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 1 -- 172.21.15.53:0/53723672 shutdown_connections 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa039bcd80 0x55aa03dbfbf0 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039fe1b0 0x55aa03db95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 0x55aa03dadc60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 1 --2- 172.21.15.53:0/53723672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039d52f0 0x55aa03dad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f523dffb640 0 client.29333 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 1 -- 172.21.15.53:0/53723672 >> 172.21.15.53:0/53723672 conn(0x55aa039f2300 msgr2=0x55aa03da2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 1 -- 172.21.15.53:0/53723672 shutdown_connections 2024-08-31T06:20:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 1 -- 172.21.15.53:0/53723672 wait complete. 2024-08-31T06:20:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.308+0000 7f52639e6740 20 client.29333 trim_cache size 0 max 16384 2024-08-31T06:20:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.332+0000 7f52639e6740 1 Processor -- start 2024-08-31T06:20:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.332+0000 7f52639e6740 1 -- start start 2024-08-31T06:20:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f52639e6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039d52f0 0x55aa03da7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f52639e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 0x55aa03db94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f52639e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039fe1b0 0x55aa03db9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f52639e6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f52581b5b50 con 0x55aa039d52f0 2024-08-31T06:20:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f52639e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f52581b78d0 con 0x55aa039dd4d0 2024-08-31T06:20:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f52639e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52581b6220 con 0x55aa039fe1b0 2024-08-31T06:20:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f525659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039d52f0 0x55aa03da7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f525659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039d52f0 0x55aa03da7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49270/0 (socket says 172.21.15.53:49270) 2024-08-31T06:20:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f525659c640 1 -- 172.21.15.53:0/3678711818 learned_addr learned my addr 172.21.15.53:0/3678711818 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f5255d9b640 1 --2- 172.21.15.53:0/3678711818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 0x55aa03db94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f5256d9d640 1 --2- 172.21.15.53:0/3678711818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039fe1b0 0x55aa03db9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f525659c640 1 -- 172.21.15.53:0/3678711818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039fe1b0 msgr2=0x55aa03db9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f525659c640 1 --2- 172.21.15.53:0/3678711818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039fe1b0 0x55aa03db9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f525659c640 1 -- 172.21.15.53:0/3678711818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 msgr2=0x55aa03db94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f525659c640 1 --2- 172.21.15.53:0/3678711818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 0x55aa03db94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f525659c640 1 -- 172.21.15.53:0/3678711818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa03da9000 con 0x55aa039d52f0 2024-08-31T06:20:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.333+0000 7f5255d9b640 1 --2- 172.21.15.53:0/3678711818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 0x55aa03db94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.334+0000 7f525659c640 1 --2- 172.21.15.53:0/3678711818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039d52f0 0x55aa03da7300 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f5248009b60 tx=0x7f5248010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b3f584c6ab8494 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.334+0000 7f523ffff640 1 -- 172.21.15.53:0/3678711818 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248005240 con 0x55aa039d52f0 2024-08-31T06:20:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.334+0000 7f523ffff640 1 -- 172.21.15.53:0/3678711818 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52480053e0 con 0x55aa039d52f0 2024-08-31T06:20:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.334+0000 7f523ffff640 1 -- 172.21.15.53:0/3678711818 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52480126b0 con 0x55aa039d52f0 2024-08-31T06:20:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.335+0000 7f52639e6740 1 -- 172.21.15.53:0/3678711818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039d52f0 msgr2=0x55aa03da7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.335+0000 7f52639e6740 1 --2- 172.21.15.53:0/3678711818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039d52f0 0x55aa03da7300 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f5248009b60 tx=0x7f5248010f70 comp rx=0 tx=0).stop 2024-08-31T06:20:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.335+0000 7f52639e6740 1 -- 172.21.15.53:0/3678711818 shutdown_connections 2024-08-31T06:20:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.335+0000 7f52639e6740 1 --2- 172.21.15.53:0/3678711818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039fe1b0 0x55aa03db9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.335+0000 7f52639e6740 1 --2- 172.21.15.53:0/3678711818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039dd4d0 0x55aa03db94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.335+0000 7f52639e6740 1 --2- 172.21.15.53:0/3678711818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039d52f0 0x55aa03da7300 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.335+0000 7f52639e6740 1 -- 172.21.15.53:0/3678711818 >> 172.21.15.53:0/3678711818 conn(0x55aa039f2300 msgr2=0x55aa03da6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.335+0000 7f52639e6740 1 -- 172.21.15.53:0/3678711818 shutdown_connections 2024-08-31T06:20:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.335+0000 7f52639e6740 1 -- 172.21.15.53:0/3678711818 wait complete. 2024-08-31T06:20:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.335+0000 7f52639e6740 1 -- start start 2024-08-31T06:20:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f52639e6740 1 Processor -- start 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f52639e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039d52f0 0x55aa03db0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f52639e6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039dd4d0 0x55aa03db1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f52639e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039fe1b0 0x55aa03e285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f52639e6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f52581b7140 con 0x55aa039dd4d0 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f52639e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f52581b69b0 con 0x55aa039d52f0 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f5255d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039dd4d0 0x55aa03db1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f52639e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52581b3b50 con 0x55aa039fe1b0 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f525659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039d52f0 0x55aa03db0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f5255d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039dd4d0 0x55aa03db1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49276/0 (socket says 172.21.15.53:49276) 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f5255d9b640 1 -- 172.21.15.53:0/3034139444 learned_addr learned my addr 172.21.15.53:0/3034139444 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.336+0000 7f5256d9d640 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039fe1b0 0x55aa03e285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.337+0000 7f52639e6740 10 client.0 _ll_register_callbacks cb 0x7f524c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.337+0000 7f5255d9b640 1 -- 172.21.15.53:0/3034139444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039fe1b0 msgr2=0x55aa03e285a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.337+0000 7f5255d9b640 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039fe1b0 0x55aa03e285a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.337+0000 7f5255d9b640 1 -- 172.21.15.53:0/3034139444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039d52f0 msgr2=0x55aa03db0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.337+0000 7f5255d9b640 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039d52f0 0x55aa03db0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.337+0000 7f5255d9b640 1 -- 172.21.15.53:0/3034139444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa03e28b60 con 0x55aa039dd4d0 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.337+0000 7f5255d9b640 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039dd4d0 0x55aa03db1260 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f524c042040 tx=0x7f524c0319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e475bbcac924a483 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.337+0000 7f523dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.337+0000 7f523dffb640 1 -- 172.21.15.53:0/3034139444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c046800 con 0x55aa039dd4d0 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.337+0000 7f523dffb640 1 -- 172.21.15.53:0/3034139444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f524c0469a0 con 0x55aa039dd4d0 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.337+0000 7f52639e6740 1 -- 172.21.15.53:0/3034139444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52480053e0 con 0x55aa039dd4d0 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.338+0000 7f523dffb640 1 -- 172.21.15.53:0/3034139444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f524c046ba0 con 0x55aa039dd4d0 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.338+0000 7f52639e6740 10 client.20391 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.338+0000 7f52639e6740 1 -- 172.21.15.53:0/3034139444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55aa03e29e10 con 0x55aa039dd4d0 2024-08-31T06:20:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.338+0000 7f523dffb640 1 -- 172.21.15.53:0/3034139444 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52480053e0 con 0x55aa039dd4d0 2024-08-31T06:20:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.338+0000 7f523dffb640 1 -- 172.21.15.53:0/3034139444 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f524c04f040 con 0x55aa039dd4d0 2024-08-31T06:20:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.338+0000 7f52639e6740 10 client.20391 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.338+0000 7f52639e6740 10 client.20391 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.338+0000 7f52639e6740 20 client.20391 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.338+0000 7f52639e6740 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa039921c0 0x55aa03e2c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.338+0000 7f52639e6740 4 client.20391 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:20:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.338+0000 7f52639e6740 1 -- 172.21.15.53:0/3034139444 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aa03d149f0 con 0x55aa039921c0 2024-08-31T06:20:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.339+0000 7f525659c640 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa039921c0 0x55aa03e2c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.339+0000 7f525659c640 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa039921c0 0x55aa03e2c670 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=173f31dd0ec8da61 server_cookie=dd3d6f1e63a22dbe in_seq=0 out_seq=0 2024-08-31T06:20:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.339+0000 7f523dffb640 10 client.20391 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:21.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 15438 7.27 MB/sec execute 9 sec latency 68.819 ms 2024-08-31T06:20:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f523dffb640 1 -- 172.21.15.53:0/3034139444 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aa03d149f0 con 0x55aa039921c0 2024-08-31T06:20:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f523dffb640 10 client.20391 handle_command_reply: tid=0 2024-08-31T06:20:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f52639e6740 1 client.20391 shutdown 2024-08-31T06:20:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f52639e6740 1 -- 172.21.15.53:0/3034139444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039dd4d0 msgr2=0x55aa03db1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f52639e6740 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039dd4d0 0x55aa03db1260 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f524c042040 tx=0x7f524c0319b0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f52639e6740 1 -- 172.21.15.53:0/3034139444 shutdown_connections 2024-08-31T06:20:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f52639e6740 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aa039921c0 0x55aa03e2c670 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f52639e6740 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa039fe1b0 0x55aa03e285a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f52639e6740 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa039dd4d0 0x55aa03db1260 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f52639e6740 1 --2- 172.21.15.53:0/3034139444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa039d52f0 0x55aa03db0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f52639e6740 1 -- 172.21.15.53:0/3034139444 >> 172.21.15.53:0/3034139444 conn(0x55aa039f2300 msgr2=0x55aa03d9f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f523dffb640 0 client.20391 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f52639e6740 1 -- 172.21.15.53:0/3034139444 shutdown_connections 2024-08-31T06:20:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.431+0000 7f52639e6740 1 -- 172.21.15.53:0/3034139444 wait complete. 2024-08-31T06:20:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.432+0000 7f52639e6740 20 client.20391 trim_cache size 0 max 16384 2024-08-31T06:20:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:20:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:20:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:20:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:20:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.432+0000 7f525c9a1640 1 -- 172.21.15.53:0/3853009298 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52400b4da0 msgr2=0x7f52400b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.432+0000 7f525c9a1640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52400b4da0 0x7f52400b72b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f524c00b230 tx=0x7f524c00b040 comp rx=0 tx=0).stop 2024-08-31T06:20:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.432+0000 7f525c9a1640 1 -- 172.21.15.53:0/3853009298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52581089f0 msgr2=0x7f52581a5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.432+0000 7f525c9a1640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52581089f0 0x7f52581a5da0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f525000eb10 tx=0x7f525000c2d0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.432+0000 7f525c9a1640 1 -- 172.21.15.53:0/3853009298 shutdown_connections 2024-08-31T06:20:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.432+0000 7f525c9a1640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f52400b4da0 0x7f52400b72b0 secure :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f524c00b230 tx=0x7f524c00b040 comp rx=0 tx=0).stop 2024-08-31T06:20:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.432+0000 7f525c9a1640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52581089f0 0x7f52581a5da0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.432+0000 7f525c9a1640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52581080a0 0x7f52581a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.432+0000 7f525c9a1640 1 --2- 172.21.15.53:0/3853009298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5258102770 0x7f52581a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.432+0000 7f525c9a1640 1 -- 172.21.15.53:0/3853009298 >> 172.21.15.53:0/3853009298 conn(0x7f525807a490 msgr2=0x7f5258105f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.433+0000 7f525c9a1640 1 -- 172.21.15.53:0/3853009298 shutdown_connections 2024-08-31T06:20:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:21.433+0000 7f525c9a1640 1 -- 172.21.15.53:0/3853009298 wait complete. 2024-08-31T06:20:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:21 smithi130 ceph-mon[22266]: pgmap v805: 97 pgs: 97 active+clean; 453 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.6 MiB/s wr, 389 op/s 2024-08-31T06:20:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:21 smithi153 ceph-mon[22320]: pgmap v805: 97 pgs: 97 active+clean; 453 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.6 MiB/s wr, 389 op/s 2024-08-31T06:20:22.181 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:21 smithi053 ceph-mon[18924]: pgmap v805: 97 pgs: 97 active+clean; 453 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.6 MiB/s wr, 389 op/s 2024-08-31T06:20:22.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 15577 7.64 MB/sec execute 10 sec latency 166.104 ms 2024-08-31T06:20:23.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 15704 7.57 MB/sec execute 11 sec latency 303.050 ms 2024-08-31T06:20:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:23 smithi130 ceph-mon[22266]: pgmap v806: 97 pgs: 97 active+clean; 455 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 358 op/s 2024-08-31T06:20:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:23 smithi153 ceph-mon[22320]: pgmap v806: 97 pgs: 97 active+clean; 455 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 358 op/s 2024-08-31T06:20:24.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:23 smithi053 ceph-mon[18924]: pgmap v806: 97 pgs: 97 active+clean; 455 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 358 op/s 2024-08-31T06:20:24.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 15852 7.58 MB/sec execute 12 sec latency 120.917 ms 2024-08-31T06:20:25.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 15985 7.74 MB/sec execute 13 sec latency 118.608 ms 2024-08-31T06:20:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:25 smithi130 ceph-mon[22266]: pgmap v807: 97 pgs: 97 active+clean; 459 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 400 op/s 2024-08-31T06:20:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:25 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:20:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:25 smithi153 ceph-mon[22320]: pgmap v807: 97 pgs: 97 active+clean; 459 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 400 op/s 2024-08-31T06:20:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:25 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:20:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:25 smithi053 ceph-mon[18924]: pgmap v807: 97 pgs: 97 active+clean; 459 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 400 op/s 2024-08-31T06:20:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:25 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:20:26.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16123 7.64 MB/sec execute 14 sec latency 119.574 ms 2024-08-31T06:20:26.561 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:26.563 INFO:tasks.cephfs.filesystem:scrub status for tag:935f53e4-02aa-49a7-b769-bab4481269e9 - {'path': '/', 'tag': '935f53e4-02aa-49a7-b769-bab4481269e9', 'options': 'recursive,force'} 2024-08-31T06:20:27.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:26 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:20:27.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:26 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:20:27.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:26 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:20:27.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:26 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:20:27.136 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:26 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:20:27.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:26 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:20:27.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:26 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:20:27.137 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:26 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:20:27.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:26 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:20:27.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:26 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:20:27.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:26 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:20:27.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:26 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:20:27.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16253 7.60 MB/sec execute 15 sec latency 142.021 ms 2024-08-31T06:20:27.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.527+0000 7fc94378a640 1 -- 172.21.15.53:0/1250015052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c10a160 msgr2=0x7fc93c10a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:27.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.527+0000 7fc94378a640 1 --2- 172.21.15.53:0/1250015052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c10a160 0x7fc93c10a570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc938009900 tx=0x7fc93802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:20:27.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.528+0000 7fc94378a640 1 -- 172.21.15.53:0/1250015052 shutdown_connections 2024-08-31T06:20:27.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.528+0000 7fc94378a640 1 --2- 172.21.15.53:0/1250015052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc93c1186a0 0x7fc93c11aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:27.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.528+0000 7fc94378a640 1 --2- 172.21.15.53:0/1250015052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc93c10aab0 0x7fc93c118160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:27.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.528+0000 7fc94378a640 1 --2- 172.21.15.53:0/1250015052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c10a160 0x7fc93c10a570 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.528+0000 7fc94378a640 1 -- 172.21.15.53:0/1250015052 >> 172.21.15.53:0/1250015052 conn(0x7fc93c071090 msgr2=0x7fc93c073bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.528+0000 7fc94378a640 1 -- 172.21.15.53:0/1250015052 shutdown_connections 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.528+0000 7fc94378a640 1 -- 172.21.15.53:0/1250015052 wait complete. 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.529+0000 7fc94378a640 1 Processor -- start 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.529+0000 7fc94378a640 1 -- start start 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc94378a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc93c10a160 0x7fc93c111b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc94378a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c10aab0 0x7fc93c10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc94378a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc93c1186a0 0x7fc93c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc94378a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c11e130 con 0x7fc93c1186a0 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc94378a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c11dfb0 con 0x7fc93c10a160 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc94378a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c11e2b0 con 0x7fc93c10aab0 2024-08-31T06:20:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc941526640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc93c10a160 0x7fc93c111b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc941526640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc93c10a160 0x7fc93c111b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:58020/0 (socket says 172.21.15.53:58020) 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc941526640 1 -- 172.21.15.53:0/1200546426 learned_addr learned my addr 172.21.15.53:0/1200546426 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc941d27640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc93c1186a0 0x7fc93c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc940d25640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c10aab0 0x7fc93c10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc941526640 1 -- 172.21.15.53:0/1200546426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c10aab0 msgr2=0x7fc93c10de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc941526640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c10aab0 0x7fc93c10de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc941526640 1 -- 172.21.15.53:0/1200546426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc93c1186a0 msgr2=0x7fc93c10e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc941526640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc93c1186a0 0x7fc93c10e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.530+0000 7fc941526640 1 -- 172.21.15.53:0/1200546426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c1b5130 con 0x7fc93c10a160 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.531+0000 7fc941526640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc93c10a160 0x7fc93c111b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc938009230 tx=0x7fc9380319a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.531+0000 7fc9327fc640 1 -- 172.21.15.53:0/1200546426 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93803f030 con 0x7fc93c10a160 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.531+0000 7fc94378a640 1 -- 172.21.15.53:0/1200546426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93c1b5300 con 0x7fc93c10a160 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.531+0000 7fc94378a640 1 -- 172.21.15.53:0/1200546426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93c1b5890 con 0x7fc93c10a160 2024-08-31T06:20:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.531+0000 7fc9327fc640 1 -- 172.21.15.53:0/1200546426 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9380043d0 con 0x7fc93c10a160 2024-08-31T06:20:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.531+0000 7fc9327fc640 1 -- 172.21.15.53:0/1200546426 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc938035070 con 0x7fc93c10a160 2024-08-31T06:20:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.533+0000 7fc94378a640 1 -- 172.21.15.53:0/1200546426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9200052c0 con 0x7fc93c10a160 2024-08-31T06:20:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.534+0000 7fc9327fc640 1 -- 172.21.15.53:0/1200546426 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc938042030 con 0x7fc93c10a160 2024-08-31T06:20:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.535+0000 7fc9327fc640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9280b4da0 0x7fc9280b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.535+0000 7fc940d25640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9280b4da0 0x7fc9280b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.535+0000 7fc9327fc640 1 -- 172.21.15.53:0/1200546426 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fc938105760 con 0x7fc93c10a160 2024-08-31T06:20:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.536+0000 7fc940d25640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9280b4da0 0x7fc9280b72b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc93c118e60 tx=0x7fc92c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.541+0000 7fc9327fc640 1 -- 172.21.15.53:0/1200546426 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc9380cc4d0 con 0x7fc93c10a160 2024-08-31T06:20:27.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.923+0000 7fc94378a640 1 -- 172.21.15.53:0/1200546426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc920005880 con 0x7fc93c10a160 2024-08-31T06:20:27.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:27 smithi053 ceph-mon[18924]: pgmap v808: 97 pgs: 97 active+clean; 450 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 402 op/s 2024-08-31T06:20:27.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.924+0000 7fc9327fc640 1 -- 172.21.15.53:0/1200546426 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+12011 (secure 0 0 0) 0x7fc9380cbdd0 con 0x7fc93c10a160 2024-08-31T06:20:27.926 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:20:27.926 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":56,"btime":"2024-08-31T06:18:21:665793+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:18:21.236924+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:20:27.927 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 56 2024-08-31T06:20:27.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 -- 172.21.15.53:0/1200546426 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9280b4da0 msgr2=0x7fc9280b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:27.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9280b4da0 0x7fc9280b72b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc93c118e60 tx=0x7fc92c005f90 comp rx=0 tx=0).stop 2024-08-31T06:20:27.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 -- 172.21.15.53:0/1200546426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc93c10a160 msgr2=0x7fc93c111b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:27.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc93c10a160 0x7fc93c111b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc938009230 tx=0x7fc9380319a0 comp rx=0 tx=0).stop 2024-08-31T06:20:27.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 -- 172.21.15.53:0/1200546426 shutdown_connections 2024-08-31T06:20:27.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc9280b4da0 0x7fc9280b72b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:27.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc93c1186a0 0x7fc93c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:27.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc93c10aab0 0x7fc93c10de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:27.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 --2- 172.21.15.53:0/1200546426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc93c10a160 0x7fc93c111b50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:27.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 -- 172.21.15.53:0/1200546426 >> 172.21.15.53:0/1200546426 conn(0x7fc93c071090 msgr2=0x7fc93c11a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:27.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 -- 172.21.15.53:0/1200546426 shutdown_connections 2024-08-31T06:20:27.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:27.927+0000 7fc94378a640 1 -- 172.21.15.53:0/1200546426 wait complete. 2024-08-31T06:20:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:27 smithi130 ceph-mon[22266]: pgmap v808: 97 pgs: 97 active+clean; 450 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 402 op/s 2024-08-31T06:20:28.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:27 smithi153 ceph-mon[22320]: pgmap v808: 97 pgs: 97 active+clean; 450 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 402 op/s 2024-08-31T06:20:28.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16414 7.58 MB/sec execute 16 sec latency 79.829 ms 2024-08-31T06:20:28.869 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 141.25 --await-for 45.0' 2024-08-31T06:20:28.869 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 141.25 --await-for 45.0 2024-08-31T06:20:29.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:28 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1200546426' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:29.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:28 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1200546426' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:29.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:28 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1200546426' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:29.239 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:29.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16549 7.27 MB/sec execute 17 sec latency 67.038 ms 2024-08-31T06:20:29.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.895+0000 7f70205ce640 1 -- 172.21.15.53:0/2625494736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f701810dcd0 msgr2=0x7f70181101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:29.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.895+0000 7f70205ce640 1 --2- 172.21.15.53:0/2625494736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f701810dcd0 0x7f70181101e0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f7010009ca0 tx=0x7f701002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.895+0000 7f70205ce640 1 -- 172.21.15.53:0/2625494736 shutdown_connections 2024-08-31T06:20:29.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.895+0000 7f70205ce640 1 --2- 172.21.15.53:0/2625494736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f701810dcd0 0x7f70181101e0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.895+0000 7f70205ce640 1 --2- 172.21.15.53:0/2625494736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70181051c0 0x7f701810d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.895+0000 7f70205ce640 1 --2- 172.21.15.53:0/2625494736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7018104790 0x7f7018104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.895+0000 7f70205ce640 1 -- 172.21.15.53:0/2625494736 >> 172.21.15.53:0/2625494736 conn(0x7f7018079590 msgr2=0x7f70180799a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:29.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.895+0000 7f70205ce640 1 -- 172.21.15.53:0/2625494736 shutdown_connections 2024-08-31T06:20:29.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.895+0000 7f70205ce640 1 -- 172.21.15.53:0/2625494736 wait complete. 2024-08-31T06:20:29.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.896+0000 7f70205ce640 1 Processor -- start 2024-08-31T06:20:29.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.896+0000 7f70205ce640 1 -- start start 2024-08-31T06:20:29.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.896+0000 7f70205ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7018104790 0x7f701819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.896+0000 7f70205ce640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70181051c0 0x7f701819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.896+0000 7f70205ce640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701810dcd0 0x7f701819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.896+0000 7f70205ce640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7018113850 con 0x7f7018104790 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.896+0000 7f70205ce640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70181136d0 con 0x7f70181051c0 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.896+0000 7f70205ce640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70181139d0 con 0x7f701810dcd0 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.897+0000 7f701e36a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7018104790 0x7f701819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.897+0000 7f701e36a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7018104790 0x7f701819a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51636/0 (socket says 172.21.15.53:51636) 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.897+0000 7f701e36a640 1 -- 172.21.15.53:0/24138102 learned_addr learned my addr 172.21.15.53:0/24138102 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.897+0000 7f701eb6b640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701810dcd0 0x7f701819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.897+0000 7f701db69640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70181051c0 0x7f701819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.897+0000 7f701e36a640 1 -- 172.21.15.53:0/24138102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701810dcd0 msgr2=0x7f701819f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.897+0000 7f701e36a640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701810dcd0 0x7f701819f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.897+0000 7f701e36a640 1 -- 172.21.15.53:0/24138102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70181051c0 msgr2=0x7f701819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.897+0000 7f701e36a640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70181051c0 0x7f701819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.897+0000 7f701e36a640 1 -- 172.21.15.53:0/24138102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70181a0110 con 0x7f7018104790 2024-08-31T06:20:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.897+0000 7f701e36a640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7018104790 0x7f701819a1a0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f701400e9f0 tx=0x7f701400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.898+0000 7f700f7fe640 1 -- 172.21.15.53:0/24138102 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701400cd80 con 0x7f7018104790 2024-08-31T06:20:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.898+0000 7f700f7fe640 1 -- 172.21.15.53:0/24138102 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70140108c0 con 0x7f7018104790 2024-08-31T06:20:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.898+0000 7f700f7fe640 1 -- 172.21.15.53:0/24138102 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70140187c0 con 0x7f7018104790 2024-08-31T06:20:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.898+0000 7f70205ce640 1 -- 172.21.15.53:0/24138102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70181a0400 con 0x7f7018104790 2024-08-31T06:20:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.898+0000 7f70205ce640 1 -- 172.21.15.53:0/24138102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70181023b0 con 0x7f7018104790 2024-08-31T06:20:29.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.901+0000 7f7026b43740 1 Processor -- start 2024-08-31T06:20:29.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.902+0000 7f7026b43740 1 -- start start 2024-08-31T06:20:29.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.902+0000 7f7026b43740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b74373ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.902+0000 7f7026b43740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b74373f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.902+0000 7f7026b43740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743377b70 0x55b74373fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.902+0000 7f7026b43740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7436b4380 con 0x55b743398850 2024-08-31T06:20:29.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.902+0000 7f7026b43740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b7436a3910 con 0x55b743377b70 2024-08-31T06:20:29.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.902+0000 7f7026b43740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b7436a78c0 con 0x55b74336f990 2024-08-31T06:20:29.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.902+0000 7f701eb6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b74373ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.902+0000 7f701eb6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b74373ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51642/0 (socket says 172.21.15.53:51642) 2024-08-31T06:20:29.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.902+0000 7f701eb6b640 1 -- 172.21.15.53:0/2182315223 learned_addr learned my addr 172.21.15.53:0/2182315223 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:29.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.902+0000 7f701db69640 1 --2- 172.21.15.53:0/2182315223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743377b70 0x55b74373fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.903+0000 7f701eb6b640 1 -- 172.21.15.53:0/2182315223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 msgr2=0x55b74373f4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:20:29.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.903+0000 7f701eb6b640 1 --2- 172.21.15.53:0/2182315223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b74373f4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.903+0000 7f701eb6b640 1 -- 172.21.15.53:0/2182315223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743377b70 msgr2=0x55b74373fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:29.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.903+0000 7f701eb6b640 1 --2- 172.21.15.53:0/2182315223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743377b70 0x55b74373fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.903+0000 7f701eb6b640 1 -- 172.21.15.53:0/2182315223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7436404c0 con 0x55b743398850 2024-08-31T06:20:29.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.903+0000 7f700f7fe640 1 -- 172.21.15.53:0/24138102 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7014010430 con 0x7f7018104790 2024-08-31T06:20:29.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.903+0000 7f701eb6b640 1 --2- 172.21.15.53:0/2182315223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b74373ef90 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f7010009ca0 tx=0x7f7010009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404e52bb2afae39d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.903+0000 7f700cff9640 1 -- 172.21.15.53:0/2182315223 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010031790 con 0x55b743398850 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.903+0000 7f700cff9640 1 -- 172.21.15.53:0/2182315223 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7010036030 con 0x55b743398850 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.903+0000 7f700cff9640 1 -- 172.21.15.53:0/2182315223 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010004330 con 0x55b743398850 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.904+0000 7f700f7fe640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70040b4da0 0x7f70040b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.904+0000 7f701e36a640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70040b4da0 0x7f70040b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.904+0000 7f700f7fe640 1 -- 172.21.15.53:0/24138102 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f70140e58f0 con 0x7f7018104790 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.905+0000 7f7026b43740 1 -- 172.21.15.53:0/2182315223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 msgr2=0x55b74373ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.905+0000 7f7026b43740 1 --2- 172.21.15.53:0/2182315223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b74373ef90 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f7010009ca0 tx=0x7f7010009a20 comp rx=0 tx=0).stop 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.905+0000 7f7026b43740 1 -- 172.21.15.53:0/2182315223 shutdown_connections 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.905+0000 7f7026b43740 1 --2- 172.21.15.53:0/2182315223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743377b70 0x55b74373fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.905+0000 7f7026b43740 1 --2- 172.21.15.53:0/2182315223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b74373f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.905+0000 7f7026b43740 1 --2- 172.21.15.53:0/2182315223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b74373ef90 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.905+0000 7f7026b43740 1 -- 172.21.15.53:0/2182315223 >> 172.21.15.53:0/2182315223 conn(0x55b74338cc40 msgr2=0x55b74373ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:29.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.905+0000 7f701e36a640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70040b4da0 0x7f70040b72b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x55b74373dc10 tx=0x7f7014093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:29.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.905+0000 7f7026b43740 1 -- 172.21.15.53:0/2182315223 shutdown_connections 2024-08-31T06:20:29.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.905+0000 7f7026b43740 1 -- 172.21.15.53:0/2182315223 wait complete. 2024-08-31T06:20:29.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.905+0000 7f7026b43740 1 -- start start 2024-08-31T06:20:29.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f7026b43740 1 Processor -- start 2024-08-31T06:20:29.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f7026b43740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b74374a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f7026b43740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743377b70 0x55b74374aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f7026b43740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b743756930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f7026b43740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7435067b0 con 0x55b743398850 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f7026b43740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b74362a460 con 0x55b743377b70 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f7026b43740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b74374d590 con 0x55b74336f990 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f701db69640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743377b70 0x55b74374aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f701eb6b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b74374a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f701eb6b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b74374a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50828/0 (socket says 172.21.15.53:50828) 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f701eb6b640 1 -- 172.21.15.53:0/132050260 learned_addr learned my addr 172.21.15.53:0/132050260 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.906+0000 7f7026b43740 10 client.0 _ll_register_callbacks cb 0x55b74364ffd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.907+0000 7f701eb6b640 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b743756930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.907+0000 7f701eb6b640 1 -- 172.21.15.53:0/132050260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743377b70 msgr2=0x55b74374aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.907+0000 7f701eb6b640 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743377b70 0x55b74374aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.907+0000 7f701eb6b640 1 -- 172.21.15.53:0/132050260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 msgr2=0x55b743756930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.907+0000 7f701eb6b640 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b743756930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.907+0000 7f701eb6b640 1 -- 172.21.15.53:0/132050260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b743412ba0 con 0x55b74336f990 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.907+0000 7f701eb6b640 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b74374a660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7010009bf0 tx=0x7f701002a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a2829541cc39301 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.907+0000 7f7001ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.907+0000 7f7001ffb640 1 -- 172.21.15.53:0/132050260 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010058060 con 0x55b74336f990 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.907+0000 7f7001ffb640 1 -- 172.21.15.53:0/132050260 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f7010004170 con 0x55b74336f990 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.907+0000 7f7026b43740 1 -- 172.21.15.53:0/132050260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7010036030 con 0x55b74336f990 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.908+0000 7f7001ffb640 1 -- 172.21.15.53:0/132050260 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f7010004370 con 0x55b74336f990 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.908+0000 7f7026b43740 10 client.29359 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.908+0000 7f7026b43740 1 -- 172.21.15.53:0/132050260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55b7437596a0 con 0x55b74336f990 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.908+0000 7f7001ffb640 1 -- 172.21.15.53:0/132050260 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7010036030 con 0x55b74336f990 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.908+0000 7f7001ffb640 1 -- 172.21.15.53:0/132050260 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f7010043070 con 0x55b74336f990 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.908+0000 7f7026b43740 10 client.29359 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.908+0000 7f7026b43740 10 client.29359 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:20:29.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.908+0000 7f7026b43740 20 client.29359 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:29.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.908+0000 7f7026b43740 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b7433571d0 0x55b74375ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.908+0000 7f7026b43740 4 client.29359 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:29.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.908+0000 7f7026b43740 1 -- 172.21.15.53:0/132050260 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7436b62d0 con 0x55b7433571d0 2024-08-31T06:20:29.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.909+0000 7f701db69640 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b7433571d0 0x55b74375ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.909+0000 7f701db69640 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b7433571d0 0x55b74375ca00 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adc2af8d5a1ee6d4 server_cookie=f94b1b027e8be812 in_seq=0 out_seq=0 2024-08-31T06:20:29.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.909+0000 7f7001ffb640 10 client.29359 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7001ffb640 1 -- 172.21.15.53:0/132050260 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b7436b62d0 con 0x55b7433571d0 2024-08-31T06:20:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7001ffb640 10 client.29359 handle_command_reply: tid=0 2024-08-31T06:20:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7026b43740 1 client.29359 shutdown 2024-08-31T06:20:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7026b43740 1 -- 172.21.15.53:0/132050260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 msgr2=0x55b74374a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7026b43740 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b74374a660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7010009bf0 tx=0x7f701002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7026b43740 1 -- 172.21.15.53:0/132050260 shutdown_connections 2024-08-31T06:20:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7026b43740 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b7433571d0 0x55b74375ca00 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7026b43740 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b743756930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7026b43740 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743377b70 0x55b74374aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7026b43740 1 --2- 172.21.15.53:0/132050260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b74374a660 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7026b43740 1 -- 172.21.15.53:0/132050260 >> 172.21.15.53:0/132050260 conn(0x55b74338cc40 msgr2=0x55b743742170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:29.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7001ffb640 0 client.29359 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:29.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7026b43740 1 -- 172.21.15.53:0/132050260 shutdown_connections 2024-08-31T06:20:29.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.910+0000 7f7026b43740 1 -- 172.21.15.53:0/132050260 wait complete. 2024-08-31T06:20:29.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.911+0000 7f7026b43740 20 client.29359 trim_cache size 0 max 16384 2024-08-31T06:20:29.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f7026b43740 1 Processor -- start 2024-08-31T06:20:29.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f7026b43740 1 -- start start 2024-08-31T06:20:29.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f7026b43740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b743756830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f7026b43740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743377b70 0x55b74374aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f7026b43740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743398850 0x55b74374c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f7026b43740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f70181b1600 con 0x55b743377b70 2024-08-31T06:20:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f7026b43740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70181b3380 con 0x55b743398850 2024-08-31T06:20:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f7026b43740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70181b1cd0 con 0x55b74336f990 2024-08-31T06:20:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f701db69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743377b70 0x55b74374aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f701eb6b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b743756830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f701db69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743377b70 0x55b74374aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51666/0 (socket says 172.21.15.53:51666) 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f701db69640 1 -- 172.21.15.53:0/3341318101 learned_addr learned my addr 172.21.15.53:0/3341318101 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.935+0000 7f701eb6b640 1 --2- 172.21.15.53:0/3341318101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743398850 0x55b74374c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.936+0000 7f701eb6b640 1 -- 172.21.15.53:0/3341318101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743398850 msgr2=0x55b74374c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.936+0000 7f701eb6b640 1 --2- 172.21.15.53:0/3341318101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743398850 0x55b74374c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.936+0000 7f701eb6b640 1 -- 172.21.15.53:0/3341318101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743377b70 msgr2=0x55b74374aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.936+0000 7f701eb6b640 1 --2- 172.21.15.53:0/3341318101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743377b70 0x55b74374aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.936+0000 7f701eb6b640 1 -- 172.21.15.53:0/3341318101 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b743357400 con 0x55b74336f990 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.936+0000 7f701eb6b640 1 --2- 172.21.15.53:0/3341318101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b743756830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7010005de0 tx=0x7f7010005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ee6319039e7a69e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.936+0000 7f7003fff640 1 -- 172.21.15.53:0/3341318101 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010058040 con 0x55b74336f990 2024-08-31T06:20:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.936+0000 7f7003fff640 1 -- 172.21.15.53:0/3341318101 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7010036030 con 0x55b74336f990 2024-08-31T06:20:29.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.936+0000 7f7003fff640 1 -- 172.21.15.53:0/3341318101 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010004510 con 0x55b74336f990 2024-08-31T06:20:29.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.937+0000 7f7026b43740 1 -- 172.21.15.53:0/3341318101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 msgr2=0x55b743756830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.937+0000 7f7026b43740 1 --2- 172.21.15.53:0/3341318101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b743756830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7010005de0 tx=0x7f7010005fd0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.937+0000 7f7026b43740 1 -- 172.21.15.53:0/3341318101 shutdown_connections 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.937+0000 7f7026b43740 1 --2- 172.21.15.53:0/3341318101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b743398850 0x55b74374c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.937+0000 7f7026b43740 1 --2- 172.21.15.53:0/3341318101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743377b70 0x55b74374aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.937+0000 7f7026b43740 1 --2- 172.21.15.53:0/3341318101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b74336f990 0x55b743756830 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.937+0000 7f7026b43740 1 -- 172.21.15.53:0/3341318101 >> 172.21.15.53:0/3341318101 conn(0x55b74338cc40 msgr2=0x55b74374bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.938+0000 7f7026b43740 1 -- 172.21.15.53:0/3341318101 shutdown_connections 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.938+0000 7f7026b43740 1 -- 172.21.15.53:0/3341318101 wait complete. 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.938+0000 7f7026b43740 1 -- start start 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.938+0000 7f7026b43740 1 Processor -- start 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f7026b43740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b74336f990 0x55b74374ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f7026b43740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b743377b70 0x55b74374ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f7026b43740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b74374f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f7026b43740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f70181b2bf0 con 0x55b743398850 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f7026b43740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70181b2460 con 0x55b74336f990 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f7026b43740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70181af600 con 0x55b743377b70 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f7026b43740 10 client.0 _ll_register_callbacks cb 0x7f7010003ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f701eb6b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b74336f990 0x55b74374ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f701eb6b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b74336f990 0x55b74374ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:58068/0 (socket says 172.21.15.53:58068) 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f701eb6b640 1 -- 172.21.15.53:0/4236908626 learned_addr learned my addr 172.21.15.53:0/4236908626 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f701db69640 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b743377b70 0x55b74374ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f701eb6b640 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b74374f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f701eb6b640 1 -- 172.21.15.53:0/4236908626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b743377b70 msgr2=0x55b74374ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f701eb6b640 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b743377b70 0x55b74374ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f701eb6b640 1 -- 172.21.15.53:0/4236908626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 msgr2=0x55b74374f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f701eb6b640 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b74374f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f701eb6b640 1 -- 172.21.15.53:0/4236908626 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7437c6460 con 0x55b74336f990 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f701eb6b640 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b74336f990 0x55b74374ea40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55b7437537e0 tx=0x7f7010000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0f8f5a60dadb6b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:29.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.939+0000 7f7001ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.940+0000 7f7001ffb640 1 -- 172.21.15.53:0/4236908626 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010058070 con 0x55b74336f990 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.940+0000 7f7026b43740 1 -- 172.21.15.53:0/4236908626 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7010036030 con 0x55b74336f990 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.940+0000 7f7001ffb640 1 -- 172.21.15.53:0/4236908626 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f7010004510 con 0x55b74336f990 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.940+0000 7f7001ffb640 1 -- 172.21.15.53:0/4236908626 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f7010004e00 con 0x55b74336f990 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.940+0000 7f7026b43740 10 client.29363 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.940+0000 7f7026b43740 1 -- 172.21.15.53:0/4236908626 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55b7437c76a0 con 0x55b74336f990 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.940+0000 7f7001ffb640 1 -- 172.21.15.53:0/4236908626 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7010036030 con 0x55b74336f990 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.940+0000 7f7001ffb640 1 -- 172.21.15.53:0/4236908626 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7f7010043070 con 0x55b74336f990 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.941+0000 7f7026b43740 10 client.29363 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.941+0000 7f7026b43740 10 client.29363 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.941+0000 7f7026b43740 20 client.29363 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.941+0000 7f7026b43740 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b74332c580 0x55b7437c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.941+0000 7f7026b43740 4 client.29363 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.25, "await_for": 45.0}] 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.941+0000 7f7026b43740 1 -- 172.21.15.53:0/4236908626 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.25, "await_for": 45.0}) -- 0x55b7436b1d70 con 0x55b74332c580 2024-08-31T06:20:29.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.941+0000 7f701db69640 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b74332c580 0x55b7437c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:29.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.941+0000 7f701db69640 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b74332c580 0x55b7437c9e90 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b65517473f851963 server_cookie=d5e9580cbd8586ab in_seq=0 out_seq=0 2024-08-31T06:20:29.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:29.941+0000 7f7001ffb640 10 client.29363 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:29 smithi130 ceph-mon[22266]: pgmap v809: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 354 op/s 2024-08-31T06:20:30.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:29 smithi153 ceph-mon[22320]: pgmap v809: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 354 op/s 2024-08-31T06:20:30.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:29 smithi053 ceph-mon[18924]: pgmap v809: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 354 op/s 2024-08-31T06:20:30.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7001ffb640 1 -- 172.21.15.53:0/4236908626 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b7436b1d70 con 0x55b74332c580 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7001ffb640 10 client.29363 handle_command_reply: tid=0 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 1 client.29363 shutdown 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 1 -- 172.21.15.53:0/4236908626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b74336f990 msgr2=0x55b74374ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b74336f990 0x55b74374ea40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55b7437537e0 tx=0x7f7010000f40 comp rx=0 tx=0).stop 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 1 -- 172.21.15.53:0/4236908626 shutdown_connections 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b74332c580 0x55b7437c9e90 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b743398850 0x55b74374f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b743377b70 0x55b74374ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 1 --2- 172.21.15.53:0/4236908626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b74336f990 0x55b74374ea40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7001ffb640 0 client.29363 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 1 -- 172.21.15.53:0/4236908626 >> 172.21.15.53:0/4236908626 conn(0x55b74338cc40 msgr2=0x55b74374b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 1 -- 172.21.15.53:0/4236908626 shutdown_connections 2024-08-31T06:20:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 1 -- 172.21.15.53:0/4236908626 wait complete. 2024-08-31T06:20:30.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.301+0000 7f7026b43740 20 client.29363 trim_cache size 0 max 16384 2024-08-31T06:20:30.305 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:20:30.305 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 56, 2024-08-31T06:20:30.305 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:20:30.305 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 50, 2024-08-31T06:20:30.305 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:20:30.305 INFO:teuthology.orchestra.run.smithi053.stdout: "55b0fc43": { 2024-08-31T06:20:30.305 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 50, 2024-08-31T06:20:30.305 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:20:30.305 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 141.2, 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:30.307 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:30.307 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:30.307 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:20:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 -- 172.21.15.53:0/24138102 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70040b4da0 msgr2=0x7f70040b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70040b4da0 0x7f70040b72b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x55b74373dc10 tx=0x7f7014093040 comp rx=0 tx=0).stop 2024-08-31T06:20:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 -- 172.21.15.53:0/24138102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7018104790 msgr2=0x7f701819a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:30.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7018104790 0x7f701819a1a0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f701400e9f0 tx=0x7f701400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:20:30.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 -- 172.21.15.53:0/24138102 shutdown_connections 2024-08-31T06:20:30.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70040b4da0 0x7f70040b72b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:30.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701810dcd0 0x7f701819f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:30.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70181051c0 0x7f701819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:30.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 --2- 172.21.15.53:0/24138102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7018104790 0x7f701819a1a0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:30.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 -- 172.21.15.53:0/24138102 >> 172.21.15.53:0/24138102 conn(0x7f7018079590 msgr2=0x7f70181076f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:30.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 -- 172.21.15.53:0/24138102 shutdown_connections 2024-08-31T06:20:30.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:30.302+0000 7f70205ce640 1 -- 172.21.15.53:0/24138102 wait complete. 2024-08-31T06:20:30.365 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16644 7.04 MB/sec execute 18 sec latency 417.398 ms 2024-08-31T06:20:31.090 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '55b0fc43', quiesce took 14.1 seconds. Will release after: 7.15 2024-08-31T06:20:31.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16645 6.67 MB/sec execute 19 sec latency 1417.425 ms 2024-08-31T06:20:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:31 smithi130 ceph-mon[22266]: pgmap v810: 97 pgs: 97 active+clean; 455 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 370 op/s 2024-08-31T06:20:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:31 smithi153 ceph-mon[22320]: pgmap v810: 97 pgs: 97 active+clean; 455 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 370 op/s 2024-08-31T06:20:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:31 smithi053 ceph-mon[18924]: pgmap v810: 97 pgs: 97 active+clean; 455 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 370 op/s 2024-08-31T06:20:32.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16645 6.33 MB/sec execute 20 sec latency 2417.454 ms 2024-08-31T06:20:33.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16645 6.03 MB/sec execute 21 sec latency 3417.488 ms 2024-08-31T06:20:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:33 smithi130 ceph-mon[22266]: pgmap v811: 97 pgs: 97 active+clean; 454 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 307 op/s 2024-08-31T06:20:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:33 smithi153 ceph-mon[22320]: pgmap v811: 97 pgs: 97 active+clean; 454 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 307 op/s 2024-08-31T06:20:34.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:33 smithi053 ceph-mon[18924]: pgmap v811: 97 pgs: 97 active+clean; 454 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 307 op/s 2024-08-31T06:20:34.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16645 5.76 MB/sec execute 22 sec latency 4417.534 ms 2024-08-31T06:20:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.547+0000 7fe689b50640 1 -- 172.21.15.53:0/3224121095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684102750 msgr2=0x7fe684102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.547+0000 7fe689b50640 1 --2- 172.21.15.53:0/3224121095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684102750 0x7fe684102b60 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fe674009900 tx=0x7fe67402a410 comp rx=0 tx=0).stop 2024-08-31T06:20:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.547+0000 7fe689b50640 1 -- 172.21.15.53:0/3224121095 shutdown_connections 2024-08-31T06:20:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.547+0000 7fe689b50640 1 --2- 172.21.15.53:0/3224121095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6841089d0 0x7fe68410f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.547+0000 7fe689b50640 1 --2- 172.21.15.53:0/3224121095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe684108080 0x7fe684108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.547+0000 7fe689b50640 1 --2- 172.21.15.53:0/3224121095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684102750 0x7fe684102b60 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.547+0000 7fe689b50640 1 -- 172.21.15.53:0/3224121095 >> 172.21.15.53:0/3224121095 conn(0x7fe68407a4e0 msgr2=0x7fe68407a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.547+0000 7fe689b50640 1 -- 172.21.15.53:0/3224121095 shutdown_connections 2024-08-31T06:20:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.547+0000 7fe689b50640 1 -- 172.21.15.53:0/3224121095 wait complete. 2024-08-31T06:20:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.548+0000 7fe689b50640 1 Processor -- start 2024-08-31T06:20:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.548+0000 7fe689b50640 1 -- start start 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe689b50640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe684102750 0x7fe68419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe689b50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684108080 0x7fe68419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe689b50640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6841089d0 0x7fe68419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe689b50640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe684113630 con 0x7fe684108080 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe689b50640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe6841134b0 con 0x7fe6841089d0 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe689b50640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe6841137b0 con 0x7fe684102750 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe67affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684108080 0x7fe68419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe67affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684108080 0x7fe68419a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53082/0 (socket says 172.21.15.53:53082) 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe67affd640 1 -- 172.21.15.53:0/2587296508 learned_addr learned my addr 172.21.15.53:0/2587296508 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe683fff640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6841089d0 0x7fe68419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe6837fe640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe684102750 0x7fe68419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe67affd640 1 -- 172.21.15.53:0/2587296508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe684102750 msgr2=0x7fe68419a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe67affd640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe684102750 0x7fe68419a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe67affd640 1 -- 172.21.15.53:0/2587296508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6841089d0 msgr2=0x7fe68419f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe67affd640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6841089d0 0x7fe68419f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe67affd640 1 -- 172.21.15.53:0/2587296508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6841a00a0 con 0x7fe684108080 2024-08-31T06:20:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.549+0000 7fe67affd640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684108080 0x7fe68419a710 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00d740 tx=0x7fe66c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.550+0000 7fe6817fa640 1 -- 172.21.15.53:0/2587296508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c017070 con 0x7fe684108080 2024-08-31T06:20:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.550+0000 7fe6817fa640 1 -- 172.21.15.53:0/2587296508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe66c00de50 con 0x7fe684108080 2024-08-31T06:20:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.550+0000 7fe689b50640 1 -- 172.21.15.53:0/2587296508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6841a0390 con 0x7fe684108080 2024-08-31T06:20:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.550+0000 7fe6817fa640 1 -- 172.21.15.53:0/2587296508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00f620 con 0x7fe684108080 2024-08-31T06:20:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.550+0000 7fe689b50640 1 -- 172.21.15.53:0/2587296508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6841a6b20 con 0x7fe684108080 2024-08-31T06:20:34.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe690abb740 1 Processor -- start 2024-08-31T06:20:34.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe690abb740 1 -- start start 2024-08-31T06:20:34.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe690abb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed8b1b0 0x555cbf12eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe690abb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf12f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe690abb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf12f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe690abb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555cbf0a4000 con 0x555cbed6a4d0 2024-08-31T06:20:34.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe690abb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555cbf093590 con 0x555cbed622f0 2024-08-31T06:20:34.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe690abb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555cbf097540 con 0x555cbed8b1b0 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe6837fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf12f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe6817fa640 1 -- 172.21.15.53:0/2587296508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe66c01a070 con 0x7fe684108080 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe6837fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf12f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50406/0 (socket says 172.21.15.53:50406) 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe6837fe640 1 -- 172.21.15.53:0/1870135484 learned_addr learned my addr 172.21.15.53:0/1870135484 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.553+0000 7fe683fff640 1 --2- 172.21.15.53:0/1870135484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed8b1b0 0x555cbf12eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe67affd640 1 --2- 172.21.15.53:0/1870135484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf12f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe6837fe640 1 -- 172.21.15.53:0/1870135484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed8b1b0 msgr2=0x555cbf12eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe6837fe640 1 --2- 172.21.15.53:0/1870135484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed8b1b0 0x555cbf12eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe6837fe640 1 -- 172.21.15.53:0/1870135484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 msgr2=0x555cbf12f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe6837fe640 1 --2- 172.21.15.53:0/1870135484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf12f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe6837fe640 1 -- 172.21.15.53:0/1870135484 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cbedf6790 con 0x555cbed622f0 2024-08-31T06:20:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe6837fe640 1 --2- 172.21.15.53:0/1870135484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf12f000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe674033000 tx=0x7fe674032ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31fc416708635358 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe6817fa640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6700b4ca0 0x7fe6700b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe679ffb640 1 -- 172.21.15.53:0/1870135484 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674035030 con 0x555cbed622f0 2024-08-31T06:20:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe683fff640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6700b4ca0 0x7fe6700b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe679ffb640 1 -- 172.21.15.53:0/1870135484 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe674004030 con 0x555cbed622f0 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.554+0000 7fe679ffb640 1 -- 172.21.15.53:0/1870135484 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6740055a0 con 0x555cbed622f0 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.555+0000 7fe6817fa640 1 -- 172.21.15.53:0/2587296508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fe66c0e4fb0 con 0x7fe684108080 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.555+0000 7fe690abb740 1 -- 172.21.15.53:0/1870135484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 msgr2=0x555cbf12f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.555+0000 7fe690abb740 1 --2- 172.21.15.53:0/1870135484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf12f000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe674033000 tx=0x7fe674032ba0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.555+0000 7fe683fff640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6700b4ca0 0x7fe6700b71b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe67c005fd0 tx=0x7fe67c009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.555+0000 7fe690abb740 1 -- 172.21.15.53:0/1870135484 shutdown_connections 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.555+0000 7fe690abb740 1 --2- 172.21.15.53:0/1870135484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf12f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.555+0000 7fe690abb740 1 --2- 172.21.15.53:0/1870135484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf12f000 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.555+0000 7fe690abb740 1 --2- 172.21.15.53:0/1870135484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed8b1b0 0x555cbf12eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.555+0000 7fe690abb740 1 -- 172.21.15.53:0/1870135484 >> 172.21.15.53:0/1870135484 conn(0x555cbed7f300 msgr2=0x555cbf12c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.555+0000 7fe690abb740 1 -- 172.21.15.53:0/1870135484 shutdown_connections 2024-08-31T06:20:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.555+0000 7fe690abb740 1 -- 172.21.15.53:0/1870135484 wait complete. 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.556+0000 7fe690abb740 1 -- start start 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.556+0000 7fe690abb740 1 Processor -- start 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.556+0000 7fe690abb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf13a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.556+0000 7fe690abb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf13ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.556+0000 7fe690abb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed8b1b0 0x555cbf146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.556+0000 7fe690abb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555cbefccab0 con 0x555cbed6a4d0 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.556+0000 7fe690abb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555cbf01a680 con 0x555cbed622f0 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.556+0000 7fe690abb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555cbf13d1e0 con 0x555cbed8b1b0 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.556+0000 7fe690abb740 10 client.0 _ll_register_callbacks cb 0x555cbeda2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe67affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf13ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe67affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf13ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53108/0 (socket says 172.21.15.53:53108) 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe67affd640 1 -- 172.21.15.53:0/1437457782 learned_addr learned my addr 172.21.15.53:0/1437457782 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe6837fe640 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf13a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe683fff640 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed8b1b0 0x555cbf146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe67affd640 1 -- 172.21.15.53:0/1437457782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed8b1b0 msgr2=0x555cbf146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe67affd640 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed8b1b0 0x555cbf146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe67affd640 1 -- 172.21.15.53:0/1437457782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 msgr2=0x555cbf13a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe67affd640 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf13a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe67affd640 1 -- 172.21.15.53:0/1437457782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cbee6f620 con 0x555cbed6a4d0 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe6837fe640 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf13a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe67affd640 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf13ab90 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0a88f0 tx=0x7fe66c010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db2f63be9bdaa86 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe662ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe662ffd640 1 -- 172.21.15.53:0/1437457782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c021070 con 0x555cbed6a4d0 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe662ffd640 1 -- 172.21.15.53:0/1437457782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fe66c0a7910 con 0x555cbed6a4d0 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.557+0000 7fe690abb740 1 -- 172.21.15.53:0/1437457782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe674004030 con 0x555cbed6a4d0 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe662ffd640 1 -- 172.21.15.53:0/1437457782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fe66c0aadf0 con 0x555cbed6a4d0 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe690abb740 10 client.20427 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe690abb740 1 -- 172.21.15.53:0/1437457782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x555cbf1491e0 con 0x555cbed6a4d0 2024-08-31T06:20:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe662ffd640 1 -- 172.21.15.53:0/1437457782 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe674004030 con 0x555cbed6a4d0 2024-08-31T06:20:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe662ffd640 1 -- 172.21.15.53:0/1437457782 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fe66c0e70d0 con 0x555cbed6a4d0 2024-08-31T06:20:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe690abb740 10 client.20427 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe690abb740 10 client.20427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe690abb740 20 client.20427 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe690abb740 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555cbed49d80 0x555cbf14c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe690abb740 4 client.20427 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe690abb740 1 -- 172.21.15.53:0/1437457782 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cbf0a5f50 con 0x555cbed49d80 2024-08-31T06:20:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.558+0000 7fe6837fe640 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555cbed49d80 0x555cbf14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.559+0000 7fe662ffd640 10 client.20427 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.559+0000 7fe6837fe640 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555cbed49d80 0x555cbf14c830 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a8c7a536f3569b4 server_cookie=b077b5c344a05737 in_seq=0 out_seq=0 2024-08-31T06:20:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe662ffd640 1 -- 172.21.15.53:0/1437457782 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555cbf0a5f50 con 0x555cbed49d80 2024-08-31T06:20:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe662ffd640 10 client.20427 handle_command_reply: tid=0 2024-08-31T06:20:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 1 client.20427 shutdown 2024-08-31T06:20:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 1 -- 172.21.15.53:0/1437457782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 msgr2=0x555cbf13ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf13ab90 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0a88f0 tx=0x7fe66c010f30 comp rx=0 tx=0).stop 2024-08-31T06:20:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 1 -- 172.21.15.53:0/1437457782 shutdown_connections 2024-08-31T06:20:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555cbed49d80 0x555cbf14c830 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed8b1b0 0x555cbf146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf13ab90 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 1 --2- 172.21.15.53:0/1437457782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf13a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 1 -- 172.21.15.53:0/1437457782 >> 172.21.15.53:0/1437457782 conn(0x555cbed7f300 msgr2=0x555cbf12faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe662ffd640 0 client.20427 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 1 -- 172.21.15.53:0/1437457782 shutdown_connections 2024-08-31T06:20:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 1 -- 172.21.15.53:0/1437457782 wait complete. 2024-08-31T06:20:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.560+0000 7fe690abb740 20 client.20427 trim_cache size 0 max 16384 2024-08-31T06:20:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.575+0000 7fe690abb740 1 Processor -- start 2024-08-31T06:20:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.575+0000 7fe690abb740 1 -- start start 2024-08-31T06:20:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.575+0000 7fe690abb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf12c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.575+0000 7fe690abb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed6a4d0 0x555cbf12c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.575+0000 7fe690abb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed8b1b0 0x555cbf137610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.575+0000 7fe690abb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe6841af4d0 con 0x555cbed8b1b0 2024-08-31T06:20:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.575+0000 7fe690abb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe6841b1250 con 0x555cbed622f0 2024-08-31T06:20:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.575+0000 7fe690abb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe6841afba0 con 0x555cbed6a4d0 2024-08-31T06:20:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.575+0000 7fe683fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed8b1b0 0x555cbf137610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe683fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed8b1b0 0x555cbf137610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53114/0 (socket says 172.21.15.53:53114) 2024-08-31T06:20:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe683fff640 1 -- 172.21.15.53:0/521949924 learned_addr learned my addr 172.21.15.53:0/521949924 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe6837fe640 1 --2- 172.21.15.53:0/521949924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf12c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe67affd640 1 --2- 172.21.15.53:0/521949924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed6a4d0 0x555cbf12c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe683fff640 1 -- 172.21.15.53:0/521949924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed6a4d0 msgr2=0x555cbf12c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe683fff640 1 --2- 172.21.15.53:0/521949924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed6a4d0 0x555cbf12c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe683fff640 1 -- 172.21.15.53:0/521949924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 msgr2=0x555cbf12c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe683fff640 1 --2- 172.21.15.53:0/521949924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf12c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe683fff640 1 -- 172.21.15.53:0/521949924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cbed49fb0 con 0x555cbed8b1b0 2024-08-31T06:20:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe67affd640 1 --2- 172.21.15.53:0/521949924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed6a4d0 0x555cbf12c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe6837fe640 1 --2- 172.21.15.53:0/521949924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf12c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe683fff640 1 --2- 172.21.15.53:0/521949924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed8b1b0 0x555cbf137610 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009850 tx=0x7fe67c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771a4f1464141bd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe6797fa640 1 -- 172.21.15.53:0/521949924 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c003970 con 0x555cbed8b1b0 2024-08-31T06:20:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe6797fa640 1 -- 172.21.15.53:0/521949924 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe67c004030 con 0x555cbed8b1b0 2024-08-31T06:20:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.576+0000 7fe6797fa640 1 -- 172.21.15.53:0/521949924 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c02a6c0 con 0x555cbed8b1b0 2024-08-31T06:20:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.577+0000 7fe690abb740 1 -- 172.21.15.53:0/521949924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed8b1b0 msgr2=0x555cbf137610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.577+0000 7fe690abb740 1 --2- 172.21.15.53:0/521949924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed8b1b0 0x555cbf137610 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009850 tx=0x7fe67c016000 comp rx=0 tx=0).stop 2024-08-31T06:20:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.577+0000 7fe690abb740 1 -- 172.21.15.53:0/521949924 shutdown_connections 2024-08-31T06:20:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.577+0000 7fe690abb740 1 --2- 172.21.15.53:0/521949924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed8b1b0 0x555cbf137610 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.577+0000 7fe690abb740 1 --2- 172.21.15.53:0/521949924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed6a4d0 0x555cbf12c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.577+0000 7fe690abb740 1 --2- 172.21.15.53:0/521949924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed622f0 0x555cbf12c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.577+0000 7fe690abb740 1 -- 172.21.15.53:0/521949924 >> 172.21.15.53:0/521949924 conn(0x555cbed7f300 msgr2=0x555cbf1355b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.577+0000 7fe690abb740 1 -- 172.21.15.53:0/521949924 shutdown_connections 2024-08-31T06:20:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.577+0000 7fe690abb740 1 -- 172.21.15.53:0/521949924 wait complete. 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.577+0000 7fe690abb740 1 -- start start 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe690abb740 1 Processor -- start 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe690abb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed622f0 0x555cbf142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe690abb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe690abb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed8b1b0 0x555cbf1405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe690abb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe6841b0ac0 con 0x555cbed6a4d0 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe690abb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe6841b0330 con 0x555cbed8b1b0 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe690abb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe6841ad4d0 con 0x555cbed622f0 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe690abb740 10 client.0 _ll_register_callbacks cb 0x7fe66c009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe67affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe67affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf140060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53126/0 (socket says 172.21.15.53:53126) 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe67affd640 1 -- 172.21.15.53:0/3588067052 learned_addr learned my addr 172.21.15.53:0/3588067052 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:34.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe683fff640 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed8b1b0 0x555cbf1405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe6837fe640 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed622f0 0x555cbf142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe67affd640 1 -- 172.21.15.53:0/3588067052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed622f0 msgr2=0x555cbf142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe67affd640 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed622f0 0x555cbf142ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe67affd640 1 -- 172.21.15.53:0/3588067052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed8b1b0 msgr2=0x555cbf1405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe67affd640 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed8b1b0 0x555cbf1405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.578+0000 7fe67affd640 1 -- 172.21.15.53:0/3588067052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cbf140c90 con 0x555cbed6a4d0 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe67affd640 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf140060 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0e2790 tx=0x7fe66c0a7bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107e7aedfd77a55e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe662ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe662ffd640 1 -- 172.21.15.53:0/3588067052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c021070 con 0x555cbed6a4d0 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe662ffd640 1 -- 172.21.15.53:0/3588067052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fe66c0aaaf0 con 0x555cbed6a4d0 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe690abb740 1 -- 172.21.15.53:0/3588067052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe67c004030 con 0x555cbed6a4d0 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe662ffd640 1 -- 172.21.15.53:0/3588067052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fe66c0ab450 con 0x555cbed6a4d0 2024-08-31T06:20:34.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe690abb740 10 client.20433 fetch_fsmap learned FSMap version 56 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe690abb740 1 -- 172.21.15.53:0/3588067052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x555cbf1b7070 con 0x555cbed6a4d0 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe662ffd640 1 -- 172.21.15.53:0/3588067052 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe67c004030 con 0x555cbed6a4d0 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe662ffd640 1 -- 172.21.15.53:0/3588067052 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 56) ==== 8422+0+0 (secure 0 0 0) 0x7fe66c0d2230 con 0x555cbed6a4d0 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe690abb740 10 client.20433 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe690abb740 10 client.20433 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe690abb740 20 client.20433 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe690abb740 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555cbed1f1c0 0x555cbf1b9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe690abb740 4 client.20433 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.579+0000 7fe690abb740 1 -- 172.21.15.53:0/3588067052 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555cbf0a19f0 con 0x555cbed1f1c0 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.580+0000 7fe6837fe640 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555cbed1f1c0 0x555cbf1b9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.580+0000 7fe662ffd640 10 client.20433 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.580+0000 7fe6837fe640 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555cbed1f1c0 0x555cbf1b9750 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceb7f9b565f9737f server_cookie=a8ea1e38a1282be in_seq=0 out_seq=0 2024-08-31T06:20:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.637+0000 7fe662ffd640 1 -- 172.21.15.53:0/3588067052 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555cbf0a19f0 con 0x555cbed1f1c0 2024-08-31T06:20:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.637+0000 7fe662ffd640 10 client.20433 handle_command_reply: tid=0 2024-08-31T06:20:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.637+0000 7fe690abb740 1 client.20433 shutdown 2024-08-31T06:20:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe690abb740 1 -- 172.21.15.53:0/3588067052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 msgr2=0x555cbf140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe690abb740 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf140060 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0e2790 tx=0x7fe66c0a7bc0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe690abb740 1 -- 172.21.15.53:0/3588067052 shutdown_connections 2024-08-31T06:20:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe690abb740 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555cbed1f1c0 0x555cbf1b9750 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe690abb740 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cbed8b1b0 0x555cbf1405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe690abb740 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cbed6a4d0 0x555cbf140060 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe690abb740 1 --2- 172.21.15.53:0/3588067052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbed622f0 0x555cbf142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe662ffd640 0 client.20433 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe690abb740 1 -- 172.21.15.53:0/3588067052 >> 172.21.15.53:0/3588067052 conn(0x555cbed7f300 msgr2=0x555cbf1355b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe690abb740 1 -- 172.21.15.53:0/3588067052 shutdown_connections 2024-08-31T06:20:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe690abb740 1 -- 172.21.15.53:0/3588067052 wait complete. 2024-08-31T06:20:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe690abb740 20 client.20433 trim_cache size 0 max 16384 2024-08-31T06:20:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:20:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:20:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:20:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe689b50640 1 -- 172.21.15.53:0/2587296508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6700b4ca0 msgr2=0x7fe6700b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe689b50640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6700b4ca0 0x7fe6700b71b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe67c005fd0 tx=0x7fe67c009600 comp rx=0 tx=0).stop 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe689b50640 1 -- 172.21.15.53:0/2587296508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684108080 msgr2=0x7fe68419a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.638+0000 7fe689b50640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684108080 0x7fe68419a710 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00d740 tx=0x7fe66c00dc00 comp rx=0 tx=0).stop 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.639+0000 7fe689b50640 1 -- 172.21.15.53:0/2587296508 shutdown_connections 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.639+0000 7fe689b50640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe6700b4ca0 0x7fe6700b71b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.639+0000 7fe689b50640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6841089d0 0x7fe68419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.639+0000 7fe689b50640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684108080 0x7fe68419a710 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.639+0000 7fe689b50640 1 --2- 172.21.15.53:0/2587296508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe684102750 0x7fe68419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.639+0000 7fe689b50640 1 -- 172.21.15.53:0/2587296508 >> 172.21.15.53:0/2587296508 conn(0x7fe68407a4e0 msgr2=0x7fe6841061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.639+0000 7fe689b50640 1 -- 172.21.15.53:0/2587296508 shutdown_connections 2024-08-31T06:20:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:34.639+0000 7fe689b50640 1 -- 172.21.15.53:0/2587296508 wait complete. 2024-08-31T06:20:35.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16645 5.51 MB/sec execute 23 sec latency 5417.592 ms 2024-08-31T06:20:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:35 smithi130 ceph-mon[22266]: pgmap v812: 97 pgs: 97 active+clean; 453 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 317 op/s 2024-08-31T06:20:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:35 smithi153 ceph-mon[22320]: pgmap v812: 97 pgs: 97 active+clean; 453 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 317 op/s 2024-08-31T06:20:36.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:35 smithi053 ceph-mon[18924]: pgmap v812: 97 pgs: 97 active+clean; 453 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 317 op/s 2024-08-31T06:20:36.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16645 5.28 MB/sec execute 24 sec latency 6417.693 ms 2024-08-31T06:20:37.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16645 5.07 MB/sec execute 25 sec latency 7417.801 ms 2024-08-31T06:20:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:37 smithi130 ceph-mon[22266]: pgmap v813: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 2.6 MiB/s wr, 240 op/s 2024-08-31T06:20:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:37 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:38.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:37 smithi153 ceph-mon[22320]: pgmap v813: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 2.6 MiB/s wr, 240 op/s 2024-08-31T06:20:38.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:37 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:38.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:37 smithi053 ceph-mon[18924]: pgmap v813: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 2.6 MiB/s wr, 240 op/s 2024-08-31T06:20:38.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:37 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:38.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:20:38.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16645 4.87 MB/sec execute 26 sec latency 8417.854 ms 2024-08-31T06:20:38.510 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:39.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.018+0000 7f155275a640 1 -- 172.21.15.53:0/2792054753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f154c108160 msgr2=0x7f154c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:39.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.018+0000 7f155275a640 1 --2- 172.21.15.53:0/2792054753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f154c108160 0x7f154c108570 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f1540009900 tx=0x7f154002a410 comp rx=0 tx=0).stop 2024-08-31T06:20:39.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.018+0000 7f155275a640 1 -- 172.21.15.53:0/2792054753 shutdown_connections 2024-08-31T06:20:39.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.018+0000 7f155275a640 1 --2- 172.21.15.53:0/2792054753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f154c108ab0 0x7f154c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:39.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.018+0000 7f155275a640 1 --2- 172.21.15.53:0/2792054753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f154c108160 0x7f154c108570 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:39.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.018+0000 7f155275a640 1 --2- 172.21.15.53:0/2792054753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f154c102820 0x7f154c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:39.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.018+0000 7f155275a640 1 -- 172.21.15.53:0/2792054753 >> 172.21.15.53:0/2792054753 conn(0x7f154c0794e0 msgr2=0x7f154c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:39.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.018+0000 7f155275a640 1 -- 172.21.15.53:0/2792054753 shutdown_connections 2024-08-31T06:20:39.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.018+0000 7f155275a640 1 -- 172.21.15.53:0/2792054753 wait complete. 2024-08-31T06:20:39.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.018+0000 7f155275a640 1 Processor -- start 2024-08-31T06:20:39.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f155275a640 1 -- start start 2024-08-31T06:20:39.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f155275a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f154c102820 0x7f154c19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:39.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f155275a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f154c108160 0x7f154c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:39.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f155275a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f154c108ab0 0x7f154c19f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:39.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f155275a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f154c1136f0 con 0x7f154c108ab0 2024-08-31T06:20:39.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f155275a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f154c113570 con 0x7f154c108160 2024-08-31T06:20:39.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f155275a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f154c113870 con 0x7f154c102820 2024-08-31T06:20:39.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f1550cf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f154c108ab0 0x7f154c19f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:39.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f1550cf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f154c108ab0 0x7f154c19f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53154/0 (socket says 172.21.15.53:53154) 2024-08-31T06:20:39.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f1550cf7640 1 -- 172.21.15.53:0/2061418836 learned_addr learned my addr 172.21.15.53:0/2061418836 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:39.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f154bfff640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f154c102820 0x7f154c19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.019+0000 7f154b7fe640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f154c108160 0x7f154c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.020+0000 7f1550cf7640 1 -- 172.21.15.53:0/2061418836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f154c102820 msgr2=0x7f154c19a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.020+0000 7f1550cf7640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f154c102820 0x7f154c19a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.020+0000 7f1550cf7640 1 -- 172.21.15.53:0/2061418836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f154c108160 msgr2=0x7f154c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.020+0000 7f1550cf7640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f154c108160 0x7f154c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.020+0000 7f1550cf7640 1 -- 172.21.15.53:0/2061418836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154c1a00b0 con 0x7f154c108ab0 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.020+0000 7f1550cf7640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f154c108ab0 0x7f154c19f980 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f154400eaa0 tx=0x7f154400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.020+0000 7f15497fa640 1 -- 172.21.15.53:0/2061418836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154400cdb0 con 0x7f154c108ab0 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.020+0000 7f15497fa640 1 -- 172.21.15.53:0/2061418836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1544005020 con 0x7f154c108ab0 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.020+0000 7f15497fa640 1 -- 172.21.15.53:0/2061418836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15440116d0 con 0x7f154c108ab0 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.020+0000 7f155275a640 1 -- 172.21.15.53:0/2061418836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154c1a03a0 con 0x7f154c108ab0 2024-08-31T06:20:39.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.020+0000 7f155275a640 1 -- 172.21.15.53:0/2061418836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154c1a6b00 con 0x7f154c108ab0 2024-08-31T06:20:39.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.021+0000 7f155275a640 1 -- 172.21.15.53:0/2061418836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f154c103aa0 con 0x7f154c108ab0 2024-08-31T06:20:39.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.023+0000 7f15497fa640 1 -- 172.21.15.53:0/2061418836 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f15440051d0 con 0x7f154c108ab0 2024-08-31T06:20:39.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.024+0000 7f15497fa640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15340b4ca0 0x7f15340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:39.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.024+0000 7f154bfff640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15340b4ca0 0x7f15340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:39.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.024+0000 7f15497fa640 1 -- 172.21.15.53:0/2061418836 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f15440e5b10 con 0x7f154c108ab0 2024-08-31T06:20:39.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.024+0000 7f154bfff640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15340b4ca0 0x7f15340b71b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f153c00bbe0 tx=0x7f153c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:39.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.027+0000 7f15497fa640 1 -- 172.21.15.53:0/2061418836 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1544016030 con 0x7f154c108ab0 2024-08-31T06:20:39.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.250+0000 7f155275a640 1 -- 172.21.15.53:0/2061418836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f154c102c30 con 0x7f154c108ab0 2024-08-31T06:20:39.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.250+0000 7f15497fa640 1 -- 172.21.15.53:0/2061418836 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+12007 (secure 0 0 0) 0x7f154c102c30 con 0x7f154c108ab0 2024-08-31T06:20:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:20:39.254 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":57,"btime":"2024-08-31T06:20:36:840987+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":57,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:20:36.242314+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:20:39.254 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 57 2024-08-31T06:20:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.252+0000 7f155275a640 1 -- 172.21.15.53:0/2061418836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15340b4ca0 msgr2=0x7f15340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.252+0000 7f155275a640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15340b4ca0 0x7f15340b71b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f153c00bbe0 tx=0x7f153c00b390 comp rx=0 tx=0).stop 2024-08-31T06:20:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.252+0000 7f155275a640 1 -- 172.21.15.53:0/2061418836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f154c108ab0 msgr2=0x7f154c19f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.252+0000 7f155275a640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f154c108ab0 0x7f154c19f980 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f154400eaa0 tx=0x7f154400ef60 comp rx=0 tx=0).stop 2024-08-31T06:20:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.253+0000 7f155275a640 1 -- 172.21.15.53:0/2061418836 shutdown_connections 2024-08-31T06:20:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.253+0000 7f155275a640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15340b4ca0 0x7f15340b71b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.253+0000 7f155275a640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f154c108ab0 0x7f154c19f980 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.253+0000 7f155275a640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f154c108160 0x7f154c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.253+0000 7f155275a640 1 --2- 172.21.15.53:0/2061418836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f154c102820 0x7f154c19a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.253+0000 7f155275a640 1 -- 172.21.15.53:0/2061418836 >> 172.21.15.53:0/2061418836 conn(0x7f154c0794e0 msgr2=0x7f154c1050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:39.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.253+0000 7f155275a640 1 -- 172.21.15.53:0/2061418836 shutdown_connections 2024-08-31T06:20:39.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:39.253+0000 7f155275a640 1 -- 172.21.15.53:0/2061418836 wait complete. 2024-08-31T06:20:39.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16645 4.69 MB/sec execute 27 sec latency 9417.930 ms 2024-08-31T06:20:39.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:39 smithi053 ceph-mon[18924]: pgmap v814: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 2.0 MiB/s wr, 186 op/s 2024-08-31T06:20:39.937 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:39 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2061418836' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:39.938 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id 55b0fc43 --release --await' 2024-08-31T06:20:39.938 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id 55b0fc43 --release --await 2024-08-31T06:20:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:39 smithi130 ceph-mon[22266]: pgmap v814: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 2.0 MiB/s wr, 186 op/s 2024-08-31T06:20:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:39 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2061418836' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:39 smithi153 ceph-mon[22320]: pgmap v814: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 2.0 MiB/s wr, 186 op/s 2024-08-31T06:20:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:39 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2061418836' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:40.192 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:40.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16645 4.52 MB/sec execute 28 sec latency 10418.006 ms 2024-08-31T06:20:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.672+0000 7f8b29224640 1 -- 172.21.15.53:0/618755077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b24105120 msgr2=0x7f8b2410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.672+0000 7f8b29224640 1 --2- 172.21.15.53:0/618755077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b24105120 0x7f8b2410d670 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009900 tx=0x7f8b1802a410 comp rx=0 tx=0).stop 2024-08-31T06:20:40.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.673+0000 7f8b29224640 1 -- 172.21.15.53:0/618755077 shutdown_connections 2024-08-31T06:20:40.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.673+0000 7f8b29224640 1 --2- 172.21.15.53:0/618755077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2410dc30 0x7f8b24110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.673+0000 7f8b29224640 1 --2- 172.21.15.53:0/618755077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b24105120 0x7f8b2410d670 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.673+0000 7f8b29224640 1 --2- 172.21.15.53:0/618755077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b241047d0 0x7f8b24104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.673+0000 7f8b29224640 1 -- 172.21.15.53:0/618755077 >> 172.21.15.53:0/618755077 conn(0x7f8b24079510 msgr2=0x7f8b24079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:40.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.673+0000 7f8b29224640 1 -- 172.21.15.53:0/618755077 shutdown_connections 2024-08-31T06:20:40.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.673+0000 7f8b29224640 1 -- 172.21.15.53:0/618755077 wait complete. 2024-08-31T06:20:40.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.673+0000 7f8b29224640 1 Processor -- start 2024-08-31T06:20:40.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b29224640 1 -- start start 2024-08-31T06:20:40.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b29224640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b241047d0 0x7f8b2419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b29224640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b24105120 0x7f8b2419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b29224640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2410dc30 0x7f8b2419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b29224640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24113780 con 0x7f8b241047d0 2024-08-31T06:20:40.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b29224640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24113600 con 0x7f8b24105120 2024-08-31T06:20:40.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b29224640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24113900 con 0x7f8b2410dc30 2024-08-31T06:20:40.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b22d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b241047d0 0x7f8b2419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b22d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b241047d0 0x7f8b2419a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53164/0 (socket says 172.21.15.53:53164) 2024-08-31T06:20:40.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b22d9d640 1 -- 172.21.15.53:0/3327102265 learned_addr learned my addr 172.21.15.53:0/3327102265 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b2259c640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b24105120 0x7f8b2419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b2359e640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2410dc30 0x7f8b2419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b22d9d640 1 -- 172.21.15.53:0/3327102265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2410dc30 msgr2=0x7f8b2419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2410dc30 0x7f8b2419fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b22d9d640 1 -- 172.21.15.53:0/3327102265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b24105120 msgr2=0x7f8b2419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b24105120 0x7f8b2419a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b22d9d640 1 -- 172.21.15.53:0/3327102265 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b241a02a0 con 0x7f8b241047d0 2024-08-31T06:20:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b2359e640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2410dc30 0x7f8b2419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.674+0000 7f8b2259c640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b24105120 0x7f8b2419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.675+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b241047d0 0x7f8b2419a330 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400c890 tx=0x7f8b1400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.675+0000 7f8b0bfff640 1 -- 172.21.15.53:0/3327102265 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14004220 con 0x7f8b241047d0 2024-08-31T06:20:40.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.675+0000 7f8b29224640 1 -- 172.21.15.53:0/3327102265 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b241a0590 con 0x7f8b241047d0 2024-08-31T06:20:40.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.675+0000 7f8b0bfff640 1 -- 172.21.15.53:0/3327102265 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b14007e40 con 0x7f8b241047d0 2024-08-31T06:20:40.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.675+0000 7f8b0bfff640 1 -- 172.21.15.53:0/3327102265 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14004a00 con 0x7f8b241047d0 2024-08-31T06:20:40.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.675+0000 7f8b29224640 1 -- 172.21.15.53:0/3327102265 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b241a6cf0 con 0x7f8b241047d0 2024-08-31T06:20:40.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.677+0000 7f8b2f799740 1 Processor -- start 2024-08-31T06:20:40.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2f799740 1 -- start start 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 0x55663c2f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 0x55663c2f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c2f8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2f799740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55663c26ea70 con 0x55663bf29660 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2f799740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55663c25e000 con 0x55663bf52520 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2f799740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55663c261fb0 con 0x55663bf31840 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b0bfff640 1 -- 172.21.15.53:0/3327102265 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8b14004ba0 con 0x7f8b241047d0 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 0x55663c2f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 0x55663c2f7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50462/0 (socket says 172.21.15.53:50462) 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2359e640 1 -- 172.21.15.53:0/311722689 learned_addr learned my addr 172.21.15.53:0/311722689 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b22d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 0x55663c2f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2259c640 1 --2- 172.21.15.53:0/311722689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c2f8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b22d9d640 1 -- 172.21.15.53:0/311722689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 msgr2=0x55663c2f8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/311722689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c2f8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b22d9d640 1 -- 172.21.15.53:0/311722689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 msgr2=0x55663c2f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/311722689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 0x55663c2f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b22d9d640 1 -- 172.21.15.53:0/311722689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55663bfbdb00 con 0x55663bf29660 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2259c640 1 --2- 172.21.15.53:0/311722689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c2f8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.678+0000 7f8b2359e640 1 --2- 172.21.15.53:0/311722689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 0x55663c2f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.679+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/311722689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 0x55663c2f81c0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f8b140e2a70 tx=0x7f8b140ed9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d5ddc496505e92 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.679+0000 7f8b097fa640 1 -- 172.21.15.53:0/311722689 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140f9070 con 0x55663bf29660 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.679+0000 7f8b097fa640 1 -- 172.21.15.53:0/311722689 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b140e74e0 con 0x55663bf29660 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.679+0000 7f8b097fa640 1 -- 172.21.15.53:0/311722689 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140f1890 con 0x55663bf29660 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.679+0000 7f8b0bfff640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8b0c0b4ca0 0x7f8b0c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.679+0000 7f8b2359e640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8b0c0b4ca0 0x7f8b0c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.679+0000 7f8b0bfff640 1 -- 172.21.15.53:0/3327102265 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f8b140e53a0 con 0x7f8b241047d0 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.680+0000 7f8b2f799740 1 -- 172.21.15.53:0/311722689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 msgr2=0x55663c2f81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.680+0000 7f8b2f799740 1 --2- 172.21.15.53:0/311722689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 0x55663c2f81c0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f8b140e2a70 tx=0x7f8b140ed9f0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.680+0000 7f8b2359e640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8b0c0b4ca0 0x7f8b0c0b71b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009fd0 tx=0x7f8b1c00e040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.680+0000 7f8b2f799740 1 -- 172.21.15.53:0/311722689 shutdown_connections 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.680+0000 7f8b2f799740 1 --2- 172.21.15.53:0/311722689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c2f8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.680+0000 7f8b2f799740 1 --2- 172.21.15.53:0/311722689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 0x55663c2f81c0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.680+0000 7f8b2f799740 1 --2- 172.21.15.53:0/311722689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 0x55663c2f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.680+0000 7f8b2f799740 1 -- 172.21.15.53:0/311722689 >> 172.21.15.53:0/311722689 conn(0x55663bf46910 msgr2=0x55663c2f5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.680+0000 7f8b2f799740 1 -- 172.21.15.53:0/311722689 shutdown_connections 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.680+0000 7f8b2f799740 1 -- 172.21.15.53:0/311722689 wait complete. 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.680+0000 7f8b2f799740 1 -- start start 2024-08-31T06:20:40.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2f799740 1 Processor -- start 2024-08-31T06:20:40.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf29660 0x55663c303840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf31840 0x55663c303d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c30f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2f799740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55663c306460 con 0x55663bf52520 2024-08-31T06:20:40.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2f799740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55663c21f520 con 0x55663bf31840 2024-08-31T06:20:40.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2f799740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55663c3065e0 con 0x55663bf29660 2024-08-31T06:20:40.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2f799740 10 client.0 _ll_register_callbacks cb 0x55663c257c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:40.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c30f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c30f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53188/0 (socket says 172.21.15.53:53188) 2024-08-31T06:20:40.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2359e640 1 -- 172.21.15.53:0/170339545 learned_addr learned my addr 172.21.15.53:0/170339545 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:40.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf29660 0x55663c303840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2259c640 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf31840 0x55663c303d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2359e640 1 -- 172.21.15.53:0/170339545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf29660 msgr2=0x55663c303840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:40.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2359e640 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf29660 0x55663c303840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2359e640 1 -- 172.21.15.53:0/170339545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf31840 msgr2=0x55663c303d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:40.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2359e640 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf31840 0x55663c303d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2359e640 1 -- 172.21.15.53:0/170339545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55663c034960 con 0x55663bf52520 2024-08-31T06:20:40.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.681+0000 7f8b2259c640 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf31840 0x55663c303d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:20:40.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b2359e640 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c30f900 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0183f0 tx=0x7f8b1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fe4a8007a1b138 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:40.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:40.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b06ff5640 1 -- 172.21.15.53:0/170339545 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c01e040 con 0x55663bf52520 2024-08-31T06:20:40.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b06ff5640 1 -- 172.21.15.53:0/170339545 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f8b1c022620 con 0x55663bf52520 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b2f799740 1 -- 172.21.15.53:0/170339545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55663c1fd9a0 con 0x55663bf52520 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b06ff5640 1 -- 172.21.15.53:0/170339545 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f8b1c022820 con 0x55663bf52520 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b2f799740 10 client.20451 fetch_fsmap learned FSMap version 57 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b2f799740 1 -- 172.21.15.53:0/170339545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x55663c3125d0 con 0x55663bf52520 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b06ff5640 1 -- 172.21.15.53:0/170339545 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55663c1fd9a0 con 0x55663bf52520 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b06ff5640 1 -- 172.21.15.53:0/170339545 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 57) ==== 8414+0+0 (secure 0 0 0) 0x7f8b1c02ba10 con 0x55663bf52520 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b2f799740 10 client.20451 fetch_fsmap finished waiting for FSMap version 57 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b2f799740 10 client.20451 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b2f799740 20 client.20451 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.682+0000 7f8b2f799740 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55663bf10ea0 0x55663c315bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.683+0000 7f8b2f799740 4 client.20451 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.683+0000 7f8b2f799740 1 -- 172.21.15.53:0/170339545 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55663c2709c0 con 0x55663bf10ea0 2024-08-31T06:20:40.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.683+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55663bf10ea0 0x55663c315bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.683+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55663bf10ea0 0x55663c315bd0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aabc9de6df559619 server_cookie=49a289d975877780 in_seq=0 out_seq=0 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.683+0000 7f8b06ff5640 10 client.20451 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.684+0000 7f8b06ff5640 1 -- 172.21.15.53:0/170339545 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55663c2709c0 con 0x55663bf10ea0 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.684+0000 7f8b06ff5640 10 client.20451 handle_command_reply: tid=0 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.684+0000 7f8b2f799740 1 client.20451 shutdown 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.684+0000 7f8b2f799740 1 -- 172.21.15.53:0/170339545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 msgr2=0x55663c30f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.684+0000 7f8b2f799740 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c30f900 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0183f0 tx=0x7f8b1c004a40 comp rx=0 tx=0).stop 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.684+0000 7f8b2f799740 1 -- 172.21.15.53:0/170339545 shutdown_connections 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.684+0000 7f8b2f799740 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55663bf10ea0 0x55663c315bd0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.684+0000 7f8b2f799740 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c30f900 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.684+0000 7f8b2f799740 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf31840 0x55663c303d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.684+0000 7f8b2f799740 1 --2- 172.21.15.53:0/170339545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf29660 0x55663c303840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.684+0000 7f8b2f799740 1 -- 172.21.15.53:0/170339545 >> 172.21.15.53:0/170339545 conn(0x55663bf46910 msgr2=0x55663c2fae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:40.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.685+0000 7f8b06ff5640 0 client.20451 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:40.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.685+0000 7f8b2f799740 1 -- 172.21.15.53:0/170339545 shutdown_connections 2024-08-31T06:20:40.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.685+0000 7f8b2f799740 1 -- 172.21.15.53:0/170339545 wait complete. 2024-08-31T06:20:40.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.685+0000 7f8b2f799740 20 client.20451 trim_cache size 0 max 16384 2024-08-31T06:20:40.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.702+0000 7f8b2f799740 1 Processor -- start 2024-08-31T06:20:40.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.702+0000 7f8b2f799740 1 -- start start 2024-08-31T06:20:40.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.702+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf29660 0x55663c305270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.702+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c2f5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.702+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c2f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.702+0000 7f8b2f799740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241af620 con 0x55663bf52520 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.702+0000 7f8b2f799740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241b13a0 con 0x55663bf29660 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.702+0000 7f8b2f799740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241afcf0 con 0x55663bf31840 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.702+0000 7f8b2359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c2f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.702+0000 7f8b2359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c2f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53194/0 (socket says 172.21.15.53:53194) 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.702+0000 7f8b2359e640 1 -- 172.21.15.53:0/2681452083 learned_addr learned my addr 172.21.15.53:0/2681452083 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.703+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/2681452083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf29660 0x55663c305270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.703+0000 7f8b2259c640 1 --2- 172.21.15.53:0/2681452083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c2f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.703+0000 7f8b2359e640 1 -- 172.21.15.53:0/2681452083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 msgr2=0x55663c2f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.703+0000 7f8b2359e640 1 --2- 172.21.15.53:0/2681452083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c2f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.703+0000 7f8b2359e640 1 -- 172.21.15.53:0/2681452083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf29660 msgr2=0x55663c305270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:40.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.703+0000 7f8b2359e640 1 --2- 172.21.15.53:0/2681452083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf29660 0x55663c305270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.703+0000 7f8b2359e640 1 -- 172.21.15.53:0/2681452083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55663c304900 con 0x55663bf52520 2024-08-31T06:20:40.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.703+0000 7f8b2359e640 1 --2- 172.21.15.53:0/2681452083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c2f56a0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c007cd0 tx=0x7f8b1c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd039c7e9c235ad9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:40.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.703+0000 7f8b08ff9640 1 -- 172.21.15.53:0/2681452083 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c01e040 con 0x55663bf52520 2024-08-31T06:20:40.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.703+0000 7f8b08ff9640 1 -- 172.21.15.53:0/2681452083 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b1c027070 con 0x55663bf52520 2024-08-31T06:20:40.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.703+0000 7f8b08ff9640 1 -- 172.21.15.53:0/2681452083 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c02b900 con 0x55663bf52520 2024-08-31T06:20:40.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.704+0000 7f8b2f799740 1 -- 172.21.15.53:0/2681452083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 msgr2=0x55663c2f56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:40.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.704+0000 7f8b2f799740 1 --2- 172.21.15.53:0/2681452083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c2f56a0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c007cd0 tx=0x7f8b1c004b50 comp rx=0 tx=0).stop 2024-08-31T06:20:40.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.704+0000 7f8b2f799740 1 -- 172.21.15.53:0/2681452083 shutdown_connections 2024-08-31T06:20:40.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.704+0000 7f8b2f799740 1 --2- 172.21.15.53:0/2681452083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf52520 0x55663c2f56a0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.704+0000 7f8b2f799740 1 --2- 172.21.15.53:0/2681452083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c2f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.704+0000 7f8b2f799740 1 --2- 172.21.15.53:0/2681452083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf29660 0x55663c305270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.704+0000 7f8b2f799740 1 -- 172.21.15.53:0/2681452083 >> 172.21.15.53:0/2681452083 conn(0x55663bf46910 msgr2=0x55663c304b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.704+0000 7f8b2f799740 1 -- 172.21.15.53:0/2681452083 shutdown_connections 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.704+0000 7f8b2f799740 1 -- 172.21.15.53:0/2681452083 wait complete. 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.704+0000 7f8b2f799740 1 -- start start 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b2f799740 1 Processor -- start 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 0x55663c307ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c308220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b2f799740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 0x55663c37f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b2f799740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241b0c10 con 0x55663bf29660 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b2f799740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241b0480 con 0x55663bf52520 2024-08-31T06:20:40.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b2f799740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b241ad620 con 0x55663bf31840 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b2f799740 10 client.0 _ll_register_callbacks cb 0x7f8b1c01b040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b22d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 0x55663c307ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b22d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 0x55663c307ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53200/0 (socket says 172.21.15.53:53200) 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b22d9d640 1 -- 172.21.15.53:0/1844563929 learned_addr learned my addr 172.21.15.53:0/1844563929 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b2359e640 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 0x55663c37f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b2259c640 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c308220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b22d9d640 1 -- 172.21.15.53:0/1844563929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 msgr2=0x55663c308220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c308220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b22d9d640 1 -- 172.21.15.53:0/1844563929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 msgr2=0x55663c37f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 0x55663c37f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.705+0000 7f8b22d9d640 1 -- 172.21.15.53:0/1844563929 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55663c37fb10 con 0x55663bf29660 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b22d9d640 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 0x55663c307ca0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f8b140a7a90 tx=0x7f8b140e9f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6794b3370c48f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:40.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b06ff5640 1 -- 172.21.15.53:0/1844563929 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14094020 con 0x55663bf29660 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b06ff5640 1 -- 172.21.15.53:0/1844563929 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f8b140a8000 con 0x55663bf29660 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b2f799740 1 -- 172.21.15.53:0/1844563929 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b1c027070 con 0x55663bf29660 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b06ff5640 1 -- 172.21.15.53:0/1844563929 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f8b1401d040 con 0x55663bf29660 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b2f799740 10 client.20457 fetch_fsmap learned FSMap version 57 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b2f799740 1 -- 172.21.15.53:0/1844563929 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x55663c380ca0 con 0x55663bf29660 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b06ff5640 1 -- 172.21.15.53:0/1844563929 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b1c027070 con 0x55663bf29660 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b06ff5640 1 -- 172.21.15.53:0/1844563929 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 57) ==== 8414+0+0 (secure 0 0 0) 0x7f8b140a7ca0 con 0x55663bf29660 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b2f799740 10 client.20457 fetch_fsmap finished waiting for FSMap version 57 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b2f799740 10 client.20457 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b2f799740 20 client.20457 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b2f799740 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55663bee6250 0x55663c3830b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:40.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b2f799740 4 client.20457 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "55b0fc43", "release": true, "await": true}] 2024-08-31T06:20:40.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.706+0000 7f8b2f799740 1 -- 172.21.15.53:0/1844563929 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "55b0fc43", "release": true, "await": true}) -- 0x55663c26c460 con 0x55663bee6250 2024-08-31T06:20:40.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.707+0000 7f8b2259c640 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55663bee6250 0x55663c3830b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:40.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.707+0000 7f8b2259c640 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55663bee6250 0x55663c3830b0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82e028ce89afc8fb server_cookie=b2f2663f4466d19a in_seq=0 out_seq=0 2024-08-31T06:20:40.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.707+0000 7f8b06ff5640 10 client.20457 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:40.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b06ff5640 1 -- 172.21.15.53:0/1844563929 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55663c26c460 con 0x55663bee6250 2024-08-31T06:20:40.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b06ff5640 10 client.20457 handle_command_reply: tid=0 2024-08-31T06:20:40.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 1 client.20457 shutdown 2024-08-31T06:20:40.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 1 -- 172.21.15.53:0/1844563929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 msgr2=0x55663c307ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:40.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 0x55663c307ca0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f8b140a7a90 tx=0x7f8b140e9f50 comp rx=0 tx=0).stop 2024-08-31T06:20:40.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 1 -- 172.21.15.53:0/1844563929 shutdown_connections 2024-08-31T06:20:40.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55663bee6250 0x55663c3830b0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b06ff5640 0 client.20457 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:40.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55663bf52520 0x55663c37f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55663bf31840 0x55663c308220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 1 --2- 172.21.15.53:0/1844563929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55663bf29660 0x55663c307ca0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 1 -- 172.21.15.53:0/1844563929 >> 172.21.15.53:0/1844563929 conn(0x55663bf46910 msgr2=0x55663c304ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:40.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 1 -- 172.21.15.53:0/1844563929 shutdown_connections 2024-08-31T06:20:40.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 1 -- 172.21.15.53:0/1844563929 wait complete. 2024-08-31T06:20:40.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.747+0000 7f8b2f799740 20 client.20457 trim_cache size 0 max 16384 2024-08-31T06:20:40.752 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:20:40.752 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 57, 2024-08-31T06:20:40.752 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:20:40.752 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 52, 2024-08-31T06:20:40.752 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:20:40.752 INFO:teuthology.orchestra.run.smithi053.stdout: "55b0fc43": { 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 52, 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 141.2, 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:20:40.753 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:20:40.754 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:20:40.754 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:40.754 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:40.754 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:40.754 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:40.754 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:40.754 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:20:40.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.748+0000 7f8b29224640 1 -- 172.21.15.53:0/3327102265 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8b0c0b4ca0 msgr2=0x7f8b0c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.748+0000 7f8b29224640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8b0c0b4ca0 0x7f8b0c0b71b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009fd0 tx=0x7f8b1c00e040 comp rx=0 tx=0).stop 2024-08-31T06:20:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.748+0000 7f8b29224640 1 -- 172.21.15.53:0/3327102265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b241047d0 msgr2=0x7f8b2419a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.748+0000 7f8b29224640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b241047d0 0x7f8b2419a330 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400c890 tx=0x7f8b1400cd50 comp rx=0 tx=0).stop 2024-08-31T06:20:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.748+0000 7f8b29224640 1 -- 172.21.15.53:0/3327102265 shutdown_connections 2024-08-31T06:20:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.748+0000 7f8b29224640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8b0c0b4ca0 0x7f8b0c0b71b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.748+0000 7f8b29224640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b2410dc30 0x7f8b2419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.748+0000 7f8b29224640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b24105120 0x7f8b2419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.748+0000 7f8b29224640 1 --2- 172.21.15.53:0/3327102265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b241047d0 0x7f8b2419a330 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.748+0000 7f8b29224640 1 -- 172.21.15.53:0/3327102265 >> 172.21.15.53:0/3327102265 conn(0x7f8b24079510 msgr2=0x7f8b241007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.749+0000 7f8b29224640 1 -- 172.21.15.53:0/3327102265 shutdown_connections 2024-08-31T06:20:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:40.749+0000 7f8b29224640 1 -- 172.21.15.53:0/3327102265 wait complete. 2024-08-31T06:20:41.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16750 4.53 MB/sec execute 29 sec latency 10809.532 ms 2024-08-31T06:20:41.611 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '55b0fc43', total seconds elapsed: 24.6 2024-08-31T06:20:41.611 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.25 2024-08-31T06:20:41.612 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:20:41.964 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:42.113 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:41 smithi053 ceph-mon[18924]: pgmap v815: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 1.4 MiB/s wr, 170 op/s 2024-08-31T06:20:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:41 smithi130 ceph-mon[22266]: pgmap v815: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 1.4 MiB/s wr, 170 op/s 2024-08-31T06:20:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:41 smithi153 ceph-mon[22320]: pgmap v815: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 1.4 MiB/s wr, 170 op/s 2024-08-31T06:20:42.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 16908 4.63 MB/sec execute 30 sec latency 67.361 ms 2024-08-31T06:20:42.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.514+0000 7fb393c23640 1 -- 172.21.15.53:0/202839605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb38c102800 msgr2=0x7fb38c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:42.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.514+0000 7fb393c23640 1 --2- 172.21.15.53:0/202839605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb38c102800 0x7fb38c102c10 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fb388009900 tx=0x7fb38802a410 comp rx=0 tx=0).stop 2024-08-31T06:20:42.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.514+0000 7fb393c23640 1 -- 172.21.15.53:0/202839605 shutdown_connections 2024-08-31T06:20:42.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.514+0000 7fb393c23640 1 --2- 172.21.15.53:0/202839605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb38c108a90 0x7fb38c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.514+0000 7fb393c23640 1 --2- 172.21.15.53:0/202839605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb38c108140 0x7fb38c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.514+0000 7fb393c23640 1 --2- 172.21.15.53:0/202839605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb38c102800 0x7fb38c102c10 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.514+0000 7fb393c23640 1 -- 172.21.15.53:0/202839605 >> 172.21.15.53:0/202839605 conn(0x7fb38c0794d0 msgr2=0x7fb38c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.514+0000 7fb393c23640 1 -- 172.21.15.53:0/202839605 shutdown_connections 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.515+0000 7fb393c23640 1 -- 172.21.15.53:0/202839605 wait complete. 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.515+0000 7fb393c23640 1 Processor -- start 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.515+0000 7fb393c23640 1 -- start start 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.516+0000 7fb393c23640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb38c102800 0x7fb38c197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.516+0000 7fb393c23640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb38c108140 0x7fb38c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.516+0000 7fb393c23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb38c108a90 0x7fb38c19d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.516+0000 7fb3919bf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb38c102800 0x7fb38c197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.516+0000 7fb3919bf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb38c102800 0x7fb38c197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50514/0 (socket says 172.21.15.53:50514) 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.516+0000 7fb3919bf640 1 -- 172.21.15.53:0/717974545 learned_addr learned my addr 172.21.15.53:0/717974545 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.516+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb38c1114b0 con 0x7fb38c108a90 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.516+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb38c111330 con 0x7fb38c102800 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.516+0000 7fb3921c0640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb38c108a90 0x7fb38c19d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.516+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb38c111630 con 0x7fb38c108140 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.516+0000 7fb3911be640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb38c108140 0x7fb38c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.517+0000 7fb3919bf640 1 -- 172.21.15.53:0/717974545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb38c108140 msgr2=0x7fb38c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.517+0000 7fb3919bf640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb38c108140 0x7fb38c198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.517+0000 7fb3919bf640 1 -- 172.21.15.53:0/717974545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb38c108a90 msgr2=0x7fb38c19d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.517+0000 7fb3919bf640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb38c108a90 0x7fb38c19d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.517+0000 7fb3919bf640 1 -- 172.21.15.53:0/717974545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38c19def0 con 0x7fb38c102800 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.517+0000 7fb3921c0640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb38c108a90 0x7fb38c19d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.517+0000 7fb3919bf640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb38c102800 0x7fb38c197f80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb388009230 tx=0x7fb3880319a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.517+0000 7fb382ffd640 1 -- 172.21.15.53:0/717974545 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38803f030 con 0x7fb38c102800 2024-08-31T06:20:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.517+0000 7fb382ffd640 1 -- 172.21.15.53:0/717974545 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3880043d0 con 0x7fb38c102800 2024-08-31T06:20:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.517+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38c19e180 con 0x7fb38c102800 2024-08-31T06:20:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.517+0000 7fb382ffd640 1 -- 172.21.15.53:0/717974545 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb388035070 con 0x7fb38c102800 2024-08-31T06:20:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.518+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb38c19e5f0 con 0x7fb38c102800 2024-08-31T06:20:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.519+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb38c102c10 con 0x7fb38c102800 2024-08-31T06:20:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.520+0000 7fb382ffd640 1 -- 172.21.15.53:0/717974545 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb388042030 con 0x7fb38c102800 2024-08-31T06:20:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.521+0000 7fb382ffd640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3780b4d20 0x7fb3780b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.521+0000 7fb3911be640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3780b4d20 0x7fb3780b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.521+0000 7fb382ffd640 1 -- 172.21.15.53:0/717974545 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fb388105890 con 0x7fb38c102800 2024-08-31T06:20:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.522+0000 7fb3911be640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3780b4d20 0x7fb3780b7230 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb38c100ac0 tx=0x7fb37c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.527+0000 7fb382ffd640 1 -- 172.21.15.53:0/717974545 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb38c19e5f0 con 0x7fb38c102800 2024-08-31T06:20:42.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.883+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb38c10a8c0 con 0x7fb38c102800 2024-08-31T06:20:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:20:42.887 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":57,"btime":"2024-08-31T06:20:36:840987+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":57,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:20:36.242314+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:20:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.884+0000 7fb382ffd640 1 -- 172.21.15.53:0/717974545 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+12007 (secure 0 0 0) 0x7fb3880cbfb0 con 0x7fb38c102800 2024-08-31T06:20:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 57 2024-08-31T06:20:42.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3780b4d20 msgr2=0x7fb3780b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:42.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3780b4d20 0x7fb3780b7230 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb38c100ac0 tx=0x7fb37c005f90 comp rx=0 tx=0).stop 2024-08-31T06:20:42.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb38c102800 msgr2=0x7fb38c197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb38c102800 0x7fb38c197f80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb388009230 tx=0x7fb3880319a0 comp rx=0 tx=0).stop 2024-08-31T06:20:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 shutdown_connections 2024-08-31T06:20:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3780b4d20 0x7fb3780b7230 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb38c108a90 0x7fb38c19d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb38c108140 0x7fb38c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 --2- 172.21.15.53:0/717974545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb38c102800 0x7fb38c197f80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 >> 172.21.15.53:0/717974545 conn(0x7fb38c0794d0 msgr2=0x7fb38c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 shutdown_connections 2024-08-31T06:20:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:42.887+0000 7fb393c23640 1 -- 172.21.15.53:0/717974545 wait complete. 2024-08-31T06:20:43.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17061 4.72 MB/sec execute 31 sec latency 65.867 ms 2024-08-31T06:20:43.798 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 141.25 --await-for 45.0' 2024-08-31T06:20:43.799 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 141.25 --await-for 45.0 2024-08-31T06:20:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:43 smithi130 ceph-mon[22266]: pgmap v816: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 561 KiB/s wr, 79 op/s 2024-08-31T06:20:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:43 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/717974545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:43 smithi153 ceph-mon[22320]: pgmap v816: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 561 KiB/s wr, 79 op/s 2024-08-31T06:20:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:43 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/717974545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:44.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:43 smithi053 ceph-mon[18924]: pgmap v816: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 561 KiB/s wr, 79 op/s 2024-08-31T06:20:44.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:43 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/717974545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:20:44.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17251 4.83 MB/sec execute 32 sec latency 59.675 ms 2024-08-31T06:20:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.760+0000 7fdc97982640 1 -- 172.21.15.53:0/902910289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc9010ff60 msgr2=0x7fdc90112380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.760+0000 7fdc97982640 1 --2- 172.21.15.53:0/902910289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc9010ff60 0x7fdc90112380 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009ca0 tx=0x7fdc8802a950 comp rx=0 tx=0).stop 2024-08-31T06:20:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.760+0000 7fdc97982640 1 -- 172.21.15.53:0/902910289 shutdown_connections 2024-08-31T06:20:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.760+0000 7fdc97982640 1 --2- 172.21.15.53:0/902910289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc9010ff60 0x7fdc90112380 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.760+0000 7fdc97982640 1 --2- 172.21.15.53:0/902910289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc90102d00 0x7fdc9010fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.760+0000 7fdc97982640 1 --2- 172.21.15.53:0/902910289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc901023b0 0x7fdc901027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.760+0000 7fdc97982640 1 -- 172.21.15.53:0/902910289 >> 172.21.15.53:0/902910289 conn(0x7fdc90079500 msgr2=0x7fdc90079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.760+0000 7fdc97982640 1 -- 172.21.15.53:0/902910289 shutdown_connections 2024-08-31T06:20:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.760+0000 7fdc97982640 1 -- 172.21.15.53:0/902910289 wait complete. 2024-08-31T06:20:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.761+0000 7fdc97982640 1 Processor -- start 2024-08-31T06:20:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.761+0000 7fdc97982640 1 -- start start 2024-08-31T06:20:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.761+0000 7fdc97982640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc901023b0 0x7fdc90108400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.762+0000 7fdc97982640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90102d00 0x7fdc901046e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.762+0000 7fdc9571e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc901023b0 0x7fdc90108400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.762+0000 7fdc9571e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc901023b0 0x7fdc90108400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52746/0 (socket says 172.21.15.53:52746) 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.762+0000 7fdc9571e640 1 -- 172.21.15.53:0/2742341652 learned_addr learned my addr 172.21.15.53:0/2742341652 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.762+0000 7fdc97982640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc9010ff60 0x7fdc90104e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.762+0000 7fdc97982640 1 -- 172.21.15.53:0/2742341652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdc90115920 con 0x7fdc901023b0 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.762+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90102d00 0x7fdc901046e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.762+0000 7fdc97982640 1 -- 172.21.15.53:0/2742341652 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901157a0 con 0x7fdc90102d00 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.762+0000 7fdc97982640 1 -- 172.21.15.53:0/2742341652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc90115aa0 con 0x7fdc9010ff60 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.762+0000 7fdc95f1f640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc9010ff60 0x7fdc90104e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.763+0000 7fdc95f1f640 1 -- 172.21.15.53:0/2742341652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90102d00 msgr2=0x7fdc901046e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.763+0000 7fdc95f1f640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90102d00 0x7fdc901046e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.763+0000 7fdc95f1f640 1 -- 172.21.15.53:0/2742341652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc901023b0 msgr2=0x7fdc90108400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.763+0000 7fdc95f1f640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc901023b0 0x7fdc90108400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.763+0000 7fdc95f1f640 1 -- 172.21.15.53:0/2742341652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc901ac5f0 con 0x7fdc9010ff60 2024-08-31T06:20:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.763+0000 7fdc95f1f640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc9010ff60 0x7fdc90104e00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdc8802af40 tx=0x7fdc88003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:44.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.763+0000 7fdc867fc640 1 -- 172.21.15.53:0/2742341652 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88034040 con 0x7fdc9010ff60 2024-08-31T06:20:44.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.763+0000 7fdc97982640 1 -- 172.21.15.53:0/2742341652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc901ac7c0 con 0x7fdc9010ff60 2024-08-31T06:20:44.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.764+0000 7fdc867fc640 1 -- 172.21.15.53:0/2742341652 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc88030850 con 0x7fdc9010ff60 2024-08-31T06:20:44.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.764+0000 7fdc867fc640 1 -- 172.21.15.53:0/2742341652 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc880046b0 con 0x7fdc9010ff60 2024-08-31T06:20:44.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.764+0000 7fdc97982640 1 -- 172.21.15.53:0/2742341652 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc901acd50 con 0x7fdc9010ff60 2024-08-31T06:20:44.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.766+0000 7fdc867fc640 1 -- 172.21.15.53:0/2742341652 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdc88037020 con 0x7fdc9010ff60 2024-08-31T06:20:44.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.767+0000 7fdc9def7740 1 Processor -- start 2024-08-31T06:20:44.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.767+0000 7fdc9def7740 1 -- start start 2024-08-31T06:20:44.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba441c850 0x55aba47c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9571e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 0x55aba47c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9def7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55aba4738380 con 0x55aba43f3990 2024-08-31T06:20:44.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9571e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52754/0 (socket says 172.21.15.53:52754) 2024-08-31T06:20:44.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9def7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55aba4727910 con 0x55aba441c850 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9def7740 1 -- 172.21.15.53:0/4053387807 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aba472b8c0 con 0x55aba43fbb70 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9571e640 1 -- 172.21.15.53:0/4053387807 learned_addr learned my addr 172.21.15.53:0/4053387807 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/4053387807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba441c850 0x55aba47c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc867fc640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc7c0b4ca0 0x7fdc7c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/4053387807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 0x55aba47c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9571e640 1 -- 172.21.15.53:0/4053387807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 msgr2=0x55aba47c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9571e640 1 --2- 172.21.15.53:0/4053387807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 0x55aba47c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9571e640 1 -- 172.21.15.53:0/4053387807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba441c850 msgr2=0x55aba47c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9571e640 1 --2- 172.21.15.53:0/4053387807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba441c850 0x55aba47c2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc9571e640 1 -- 172.21.15.53:0/4053387807 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba46c44c0 con 0x55aba43f3990 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc95f1f640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc7c0b4ca0 0x7fdc7c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.769+0000 7fdc9571e640 1 --2- 172.21.15.53:0/4053387807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47c34d0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009d70 tx=0x7fdc8c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123730f081ff8b5b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.768+0000 7fdc867fc640 1 -- 172.21.15.53:0/2742341652 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fdc88106290 con 0x7fdc9010ff60 2024-08-31T06:20:44.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.769+0000 7fdc7b7fe640 1 -- 172.21.15.53:0/4053387807 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c01e070 con 0x55aba43f3990 2024-08-31T06:20:44.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.769+0000 7fdc95f1f640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc7c0b4ca0 0x7fdc7c0b71b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdc881039c0 tx=0x7fdc8802a950 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:44.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.769+0000 7fdc7b7fe640 1 -- 172.21.15.53:0/4053387807 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc8c019ac0 con 0x55aba43f3990 2024-08-31T06:20:44.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.770+0000 7fdc7b7fe640 1 -- 172.21.15.53:0/4053387807 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00ea80 con 0x55aba43f3990 2024-08-31T06:20:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.770+0000 7fdc9def7740 1 -- 172.21.15.53:0/4053387807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 msgr2=0x55aba47c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.770+0000 7fdc9def7740 1 --2- 172.21.15.53:0/4053387807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47c34d0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009d70 tx=0x7fdc8c011810 comp rx=0 tx=0).stop 2024-08-31T06:20:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.771+0000 7fdc9def7740 1 -- 172.21.15.53:0/4053387807 shutdown_connections 2024-08-31T06:20:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.771+0000 7fdc9def7740 1 --2- 172.21.15.53:0/4053387807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 0x55aba47c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.771+0000 7fdc9def7740 1 --2- 172.21.15.53:0/4053387807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47c34d0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.771+0000 7fdc9def7740 1 --2- 172.21.15.53:0/4053387807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba441c850 0x55aba47c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.771+0000 7fdc9def7740 1 -- 172.21.15.53:0/4053387807 >> 172.21.15.53:0/4053387807 conn(0x55aba4410c40 msgr2=0x55aba47c0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.771+0000 7fdc9def7740 1 -- 172.21.15.53:0/4053387807 shutdown_connections 2024-08-31T06:20:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.771+0000 7fdc9def7740 1 -- 172.21.15.53:0/4053387807 wait complete. 2024-08-31T06:20:44.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.771+0000 7fdc9def7740 1 -- start start 2024-08-31T06:20:44.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc9def7740 1 Processor -- start 2024-08-31T06:20:44.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 0x55aba47ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba441c850 0x55aba47daab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc9def7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55aba458a7b0 con 0x55aba43f3990 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc9def7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55aba46ae460 con 0x55aba441c850 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc9def7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aba47d17c0 con 0x55aba43fbb70 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc9def7740 10 client.0 _ll_register_callbacks cb 0x55aba46d3fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc9571e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 0x55aba47ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc94f1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc9571e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 0x55aba47ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34300/0 (socket says 172.21.15.53:34300) 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc9571e640 1 -- 172.21.15.53:0/2071230814 learned_addr learned my addr 172.21.15.53:0/2071230814 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.772+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba441c850 0x55aba47daab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.773+0000 7fdc9571e640 1 -- 172.21.15.53:0/2071230814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba441c850 msgr2=0x55aba47daab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.773+0000 7fdc9571e640 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba441c850 0x55aba47daab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.773+0000 7fdc9571e640 1 -- 172.21.15.53:0/2071230814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 msgr2=0x55aba47ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:44.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.773+0000 7fdc9571e640 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.773+0000 7fdc9571e640 1 -- 172.21.15.53:0/2071230814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba4496ba0 con 0x55aba43fbb70 2024-08-31T06:20:44.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.773+0000 7fdc9571e640 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 0x55aba47ceba0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00e450 tx=0x7fdc8c0056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=806e82b12cd4a972 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:44.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.773+0000 7fdc78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:20:44.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.773+0000 7fdc78ff9640 1 -- 172.21.15.53:0/2071230814 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c01e050 con 0x55aba43fbb70 2024-08-31T06:20:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.774+0000 7fdc9def7740 1 -- 172.21.15.53:0/2071230814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc8c019ac0 con 0x55aba43fbb70 2024-08-31T06:20:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.774+0000 7fdc78ff9640 1 -- 172.21.15.53:0/2071230814 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fdc8c019630 con 0x55aba43fbb70 2024-08-31T06:20:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.774+0000 7fdc78ff9640 1 -- 172.21.15.53:0/2071230814 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fdc8c033050 con 0x55aba43fbb70 2024-08-31T06:20:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.774+0000 7fdc9def7740 10 client.29416 fetch_fsmap learned FSMap version 57 2024-08-31T06:20:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.774+0000 7fdc9def7740 1 -- 172.21.15.53:0/2071230814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x55aba47dd840 con 0x55aba43fbb70 2024-08-31T06:20:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.774+0000 7fdc78ff9640 1 -- 172.21.15.53:0/2071230814 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc8c019ac0 con 0x55aba43fbb70 2024-08-31T06:20:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.775+0000 7fdc78ff9640 1 -- 172.21.15.53:0/2071230814 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 57) ==== 8414+0+0 (secure 0 0 0) 0x7fdc8c0036c0 con 0x55aba43fbb70 2024-08-31T06:20:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.775+0000 7fdc9def7740 10 client.29416 fetch_fsmap finished waiting for FSMap version 57 2024-08-31T06:20:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.775+0000 7fdc9def7740 10 client.29416 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:20:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.775+0000 7fdc9def7740 20 client.29416 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.775+0000 7fdc9def7740 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aba43db1d0 0x55aba47e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.775+0000 7fdc9def7740 4 client.29416 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:44.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.775+0000 7fdc9def7740 1 -- 172.21.15.53:0/2071230814 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aba473a2d0 con 0x55aba43db1d0 2024-08-31T06:20:44.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.775+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aba43db1d0 0x55aba47e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.776+0000 7fdc78ff9640 10 client.29416 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:44.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.776+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aba43db1d0 0x55aba47e0ba0 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a06f2162be37bfba server_cookie=fda51e16d0244df6 in_seq=0 out_seq=0 2024-08-31T06:20:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.776+0000 7fdc78ff9640 1 -- 172.21.15.53:0/2071230814 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aba473a2d0 con 0x55aba43db1d0 2024-08-31T06:20:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.776+0000 7fdc78ff9640 10 client.29416 handle_command_reply: tid=0 2024-08-31T06:20:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.776+0000 7fdc9def7740 1 client.29416 shutdown 2024-08-31T06:20:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc9def7740 1 -- 172.21.15.53:0/2071230814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 msgr2=0x55aba47ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc9def7740 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 0x55aba47ceba0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00e450 tx=0x7fdc8c0056d0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc9def7740 1 -- 172.21.15.53:0/2071230814 shutdown_connections 2024-08-31T06:20:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc9def7740 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aba43db1d0 0x55aba47e0ba0 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc9def7740 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba441c850 0x55aba47daab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc9def7740 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba43fbb70 0x55aba47ceba0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc9def7740 1 --2- 172.21.15.53:0/2071230814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc9def7740 1 -- 172.21.15.53:0/2071230814 >> 172.21.15.53:0/2071230814 conn(0x55aba4410c40 msgr2=0x55aba47c6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc78ff9640 0 client.29416 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc9def7740 1 -- 172.21.15.53:0/2071230814 shutdown_connections 2024-08-31T06:20:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc9def7740 1 -- 172.21.15.53:0/2071230814 wait complete. 2024-08-31T06:20:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.777+0000 7fdc9def7740 20 client.29416 trim_cache size 0 max 16384 2024-08-31T06:20:44.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.809+0000 7fdc9def7740 1 Processor -- start 2024-08-31T06:20:44.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.809+0000 7fdc9def7740 1 -- start start 2024-08-31T06:20:44.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43f3990 0x55aba47da9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43fbb70 0x55aba47d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba441c850 0x55aba47bf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9def7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901ad1c0 con 0x55aba43fbb70 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9def7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901aef40 con 0x55aba43f3990 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9def7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901ad890 con 0x55aba441c850 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc94f1d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43f3990 0x55aba47da9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9571e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43fbb70 0x55aba47d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9571e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43fbb70 0x55aba47d0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52768/0 (socket says 172.21.15.53:52768) 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc94f1d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43f3990 0x55aba47da9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36856/0 (socket says 172.21.15.53:36856) 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9571e640 1 -- 172.21.15.53:0/2055783733 learned_addr learned my addr 172.21.15.53:0/2055783733 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/2055783733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba441c850 0x55aba47bf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9571e640 1 -- 172.21.15.53:0/2055783733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba441c850 msgr2=0x55aba47bf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9571e640 1 --2- 172.21.15.53:0/2055783733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba441c850 0x55aba47bf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9571e640 1 -- 172.21.15.53:0/2055783733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43f3990 msgr2=0x55aba47da9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:44.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9571e640 1 --2- 172.21.15.53:0/2055783733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43f3990 0x55aba47da9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.810+0000 7fdc9571e640 1 -- 172.21.15.53:0/2055783733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba47ccb60 con 0x55aba43fbb70 2024-08-31T06:20:44.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.811+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/2055783733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba441c850 0x55aba47bf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:44.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.811+0000 7fdc9571e640 1 --2- 172.21.15.53:0/2055783733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43fbb70 0x55aba47d0290 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c000c00 tx=0x7fdc8c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfddf4800a7d4f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.811+0000 7fdc7affd640 1 -- 172.21.15.53:0/2055783733 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c03c070 con 0x55aba43fbb70 2024-08-31T06:20:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.811+0000 7fdc7affd640 1 -- 172.21.15.53:0/2055783733 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc8c02a070 con 0x55aba43fbb70 2024-08-31T06:20:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.811+0000 7fdc7affd640 1 -- 172.21.15.53:0/2055783733 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c01e040 con 0x55aba43fbb70 2024-08-31T06:20:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.812+0000 7fdc9def7740 1 -- 172.21.15.53:0/2055783733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43fbb70 msgr2=0x55aba47d0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.812+0000 7fdc9def7740 1 --2- 172.21.15.53:0/2055783733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43fbb70 0x55aba47d0290 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c000c00 tx=0x7fdc8c003f10 comp rx=0 tx=0).stop 2024-08-31T06:20:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.812+0000 7fdc9def7740 1 -- 172.21.15.53:0/2055783733 shutdown_connections 2024-08-31T06:20:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.812+0000 7fdc9def7740 1 --2- 172.21.15.53:0/2055783733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba441c850 0x55aba47bf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.812+0000 7fdc9def7740 1 --2- 172.21.15.53:0/2055783733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43fbb70 0x55aba47d0290 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.812+0000 7fdc9def7740 1 --2- 172.21.15.53:0/2055783733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43f3990 0x55aba47da9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.812+0000 7fdc9def7740 1 -- 172.21.15.53:0/2055783733 >> 172.21.15.53:0/2055783733 conn(0x55aba4410c40 msgr2=0x55aba47cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:44.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.813+0000 7fdc9def7740 1 -- 172.21.15.53:0/2055783733 shutdown_connections 2024-08-31T06:20:44.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.813+0000 7fdc9def7740 1 -- 172.21.15.53:0/2055783733 wait complete. 2024-08-31T06:20:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.813+0000 7fdc9def7740 1 -- start start 2024-08-31T06:20:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.813+0000 7fdc9def7740 1 Processor -- start 2024-08-31T06:20:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47d6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43fbb70 0x55aba47d6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc9def7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba441c850 0x55aba47d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc9def7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901ae7b0 con 0x55aba43f3990 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc9def7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901ae020 con 0x55aba43fbb70 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc9def7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdc900736a0 con 0x55aba441c850 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc9def7740 10 client.0 _ll_register_callbacks cb 0x7fdc800095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc94f1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47d6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc9571e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43fbb70 0x55aba47d6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc9571e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43fbb70 0x55aba47d6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36870/0 (socket says 172.21.15.53:36870) 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc9571e640 1 -- 172.21.15.53:0/1390572785 learned_addr learned my addr 172.21.15.53:0/1390572785 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.814+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba441c850 0x55aba47d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc94f1d640 1 -- 172.21.15.53:0/1390572785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba441c850 msgr2=0x55aba47d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba441c850 0x55aba47d19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc94f1d640 1 -- 172.21.15.53:0/1390572785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43fbb70 msgr2=0x55aba47d6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43fbb70 0x55aba47d6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc94f1d640 1 -- 172.21.15.53:0/1390572785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba47d75d0 con 0x55aba43f3990 2024-08-31T06:20:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc94f1d640 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47d6a20 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fdc80000c00 tx=0x7fdc80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa781660ba2c9571 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc78ff9640 1 -- 172.21.15.53:0/1390572785 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8002b040 con 0x55aba43f3990 2024-08-31T06:20:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc78ff9640 1 -- 172.21.15.53:0/1390572785 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fdc80034d10 con 0x55aba43f3990 2024-08-31T06:20:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc9def7740 1 -- 172.21.15.53:0/1390572785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc8c02a070 con 0x55aba43f3990 2024-08-31T06:20:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc78ff9640 1 -- 172.21.15.53:0/1390572785 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fdc800234f0 con 0x55aba43f3990 2024-08-31T06:20:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc9def7740 10 client.20481 fetch_fsmap learned FSMap version 57 2024-08-31T06:20:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.815+0000 7fdc9def7740 1 -- 172.21.15.53:0/1390572785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x55aba484b810 con 0x55aba43f3990 2024-08-31T06:20:44.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.816+0000 7fdc78ff9640 1 -- 172.21.15.53:0/1390572785 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc8c02a070 con 0x55aba43f3990 2024-08-31T06:20:44.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.816+0000 7fdc78ff9640 1 -- 172.21.15.53:0/1390572785 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 57) ==== 8414+0+0 (secure 0 0 0) 0x7fdc80031040 con 0x55aba43f3990 2024-08-31T06:20:44.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.816+0000 7fdc9def7740 10 client.20481 fetch_fsmap finished waiting for FSMap version 57 2024-08-31T06:20:44.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.816+0000 7fdc9def7740 10 client.20481 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:20:44.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.816+0000 7fdc9def7740 20 client.20481 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.816+0000 7fdc9def7740 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aba43b0580 0x55aba484e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.816+0000 7fdc9def7740 4 client.20481 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.25, "await_for": 45.0}] 2024-08-31T06:20:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.816+0000 7fdc9def7740 1 -- 172.21.15.53:0/1390572785 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.25, "await_for": 45.0}) -- 0x55aba4735d70 con 0x55aba43b0580 2024-08-31T06:20:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.816+0000 7fdc9571e640 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aba43b0580 0x55aba484e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.817+0000 7fdc78ff9640 10 client.20481 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:44.817+0000 7fdc9571e640 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aba43b0580 0x55aba484e130 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48cd486c1767847e server_cookie=2738fb52ff14ca86 in_seq=0 out_seq=0 2024-08-31T06:20:45.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc78ff9640 1 -- 172.21.15.53:0/1390572785 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55aba4735d70 con 0x55aba43b0580 2024-08-31T06:20:45.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc78ff9640 10 client.20481 handle_command_reply: tid=0 2024-08-31T06:20:45.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 1 client.20481 shutdown 2024-08-31T06:20:45.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 1 -- 172.21.15.53:0/1390572785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 msgr2=0x55aba47d6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:45.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47d6a20 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fdc80000c00 tx=0x7fdc80004730 comp rx=0 tx=0).stop 2024-08-31T06:20:45.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 1 -- 172.21.15.53:0/1390572785 shutdown_connections 2024-08-31T06:20:45.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55aba43b0580 0x55aba484e130 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:45.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aba441c850 0x55aba47d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:45.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc78ff9640 0 client.20481 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:45.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aba43fbb70 0x55aba47d6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:45.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 1 --2- 172.21.15.53:0/1390572785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aba43f3990 0x55aba47d6a20 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:45.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 1 -- 172.21.15.53:0/1390572785 >> 172.21.15.53:0/1390572785 conn(0x55aba4410c40 msgr2=0x55aba47bf520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:45.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 1 -- 172.21.15.53:0/1390572785 shutdown_connections 2024-08-31T06:20:45.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 1 -- 172.21.15.53:0/1390572785 wait complete. 2024-08-31T06:20:45.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.185+0000 7fdc9def7740 20 client.20481 trim_cache size 0 max 16384 2024-08-31T06:20:45.190 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:20:45.190 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 57, 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 54, 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "b1859690": { 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 54, 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 141.2, 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:20:45.191 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:20:45.192 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:20:45.192 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:20:45.192 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:20:45.192 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:20:45.192 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:45.192 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:45.192 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:45.192 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:45.192 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:45.192 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:20:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 -- 172.21.15.53:0/2742341652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc7c0b4ca0 msgr2=0x7fdc7c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc7c0b4ca0 0x7fdc7c0b71b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdc881039c0 tx=0x7fdc8802a950 comp rx=0 tx=0).stop 2024-08-31T06:20:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 -- 172.21.15.53:0/2742341652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc9010ff60 msgr2=0x7fdc90104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc9010ff60 0x7fdc90104e00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdc8802af40 tx=0x7fdc88003f10 comp rx=0 tx=0).stop 2024-08-31T06:20:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 -- 172.21.15.53:0/2742341652 shutdown_connections 2024-08-31T06:20:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdc7c0b4ca0 0x7fdc7c0b71b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc9010ff60 0x7fdc90104e00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc90102d00 0x7fdc901046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 --2- 172.21.15.53:0/2742341652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc901023b0 0x7fdc90108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 -- 172.21.15.53:0/2742341652 >> 172.21.15.53:0/2742341652 conn(0x7fdc90079500 msgr2=0x7fdc901012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:45.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 -- 172.21.15.53:0/2742341652 shutdown_connections 2024-08-31T06:20:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:45.186+0000 7fdc97982640 1 -- 172.21.15.53:0/2742341652 wait complete. 2024-08-31T06:20:45.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 5.01 MB/sec execute 33 sec latency 555.759 ms 2024-08-31T06:20:46.001 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b1859690', quiesce took 4.4 seconds. Will release after: 16.85 2024-08-31T06:20:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:45 smithi130 ceph-mon[22266]: pgmap v817: 97 pgs: 97 active+clean; 456 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 705 KiB/s wr, 107 op/s 2024-08-31T06:20:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:45 smithi153 ceph-mon[22320]: pgmap v817: 97 pgs: 97 active+clean; 456 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 705 KiB/s wr, 107 op/s 2024-08-31T06:20:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:45 smithi053 ceph-mon[18924]: pgmap v817: 97 pgs: 97 active+clean; 456 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 705 KiB/s wr, 107 op/s 2024-08-31T06:20:46.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 4.86 MB/sec execute 34 sec latency 1555.804 ms 2024-08-31T06:20:47.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 4.72 MB/sec execute 35 sec latency 2555.838 ms 2024-08-31T06:20:47.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.749+0000 7f6ac4069640 1 -- 172.21.15.53:0/874501446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1080a0 msgr2=0x7f6abc1084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:47.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.749+0000 7f6ac4069640 1 --2- 172.21.15.53:0/874501446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1080a0 0x7f6abc1084b0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009900 tx=0x7f6aac02a410 comp rx=0 tx=0).stop 2024-08-31T06:20:47.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.749+0000 7f6ac4069640 1 -- 172.21.15.53:0/874501446 shutdown_connections 2024-08-31T06:20:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.749+0000 7f6ac4069640 1 --2- 172.21.15.53:0/874501446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6abc1089f0 0x7f6abc10f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.749+0000 7f6ac4069640 1 --2- 172.21.15.53:0/874501446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1080a0 0x7f6abc1084b0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.749+0000 7f6ac4069640 1 --2- 172.21.15.53:0/874501446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc102770 0x7f6abc102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.749+0000 7f6ac4069640 1 -- 172.21.15.53:0/874501446 >> 172.21.15.53:0/874501446 conn(0x7f6abc0fe190 msgr2=0x7f6abc1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.749+0000 7f6ac4069640 1 -- 172.21.15.53:0/874501446 shutdown_connections 2024-08-31T06:20:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.749+0000 7f6ac4069640 1 -- 172.21.15.53:0/874501446 wait complete. 2024-08-31T06:20:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac4069640 1 Processor -- start 2024-08-31T06:20:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac4069640 1 -- start start 2024-08-31T06:20:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac4069640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc102770 0x7f6abc19af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac4069640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6abc1080a0 0x7f6abc19b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac4069640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1089f0 0x7f6abc19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac4069640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc112530 con 0x7f6abc1089f0 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac4069640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc1123b0 con 0x7f6abc1080a0 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac4069640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc1126b0 con 0x7f6abc102770 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac2606640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1089f0 0x7f6abc19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac2606640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1089f0 0x7f6abc19b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52794/0 (socket says 172.21.15.53:52794) 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac2606640 1 -- 172.21.15.53:0/648032959 learned_addr learned my addr 172.21.15.53:0/648032959 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac1604640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6abc1080a0 0x7f6abc19b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc102770 0x7f6abc19af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac2606640 1 -- 172.21.15.53:0/648032959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc102770 msgr2=0x7f6abc19af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac2606640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc102770 0x7f6abc19af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac2606640 1 -- 172.21.15.53:0/648032959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6abc1080a0 msgr2=0x7f6abc19b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac2606640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6abc1080a0 0x7f6abc19b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.750+0000 7f6ac2606640 1 -- 172.21.15.53:0/648032959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc1a6200 con 0x7f6abc1089f0 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.751+0000 7f6ac2606640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1089f0 0x7f6abc19b9c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009fd0 tx=0x7f6ab400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.751+0000 7f6ab2ffd640 1 -- 172.21.15.53:0/648032959 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4017070 con 0x7f6abc1089f0 2024-08-31T06:20:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.751+0000 7f6ab2ffd640 1 -- 172.21.15.53:0/648032959 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ab4003e00 con 0x7f6abc1089f0 2024-08-31T06:20:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.751+0000 7f6ac4069640 1 -- 172.21.15.53:0/648032959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6abc1a64f0 con 0x7f6abc1089f0 2024-08-31T06:20:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.751+0000 7f6ab2ffd640 1 -- 172.21.15.53:0/648032959 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4010460 con 0x7f6abc1089f0 2024-08-31T06:20:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.751+0000 7f6ac4069640 1 -- 172.21.15.53:0/648032959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6abc1a6a10 con 0x7f6abc1089f0 2024-08-31T06:20:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.754+0000 7f6acafd4740 1 Processor -- start 2024-08-31T06:20:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.754+0000 7f6ab2ffd640 1 -- 172.21.15.53:0/648032959 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6ab4003970 con 0x7f6abc1089f0 2024-08-31T06:20:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6acafd4740 1 -- start start 2024-08-31T06:20:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa2cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa2d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa2d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6acafd4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f9a2000 con 0x55ae5f6684d0 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6acafd4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f991590 con 0x55ae5f6891b0 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6acafd4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f995540 con 0x55ae5f6602f0 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6ac1604640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa2d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6ac1604640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa2d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52810/0 (socket says 172.21.15.53:52810) 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6ac1604640 1 -- 172.21.15.53:0/2614133265 learned_addr learned my addr 172.21.15.53:0/2614133265 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6ac1604640 1 --2- 172.21.15.53:0/2614133265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa2cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/2614133265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa2d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.755+0000 7f6ab2ffd640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6aa80b4d20 0x7f6aa80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.756+0000 7f6ac1604640 1 -- 172.21.15.53:0/2614133265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 msgr2=0x55ae5fa2d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.756+0000 7f6ac1604640 1 --2- 172.21.15.53:0/2614133265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa2d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.756+0000 7f6ac1604640 1 -- 172.21.15.53:0/2614133265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 msgr2=0x55ae5fa2cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.756+0000 7f6ac1604640 1 --2- 172.21.15.53:0/2614133265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa2cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.756+0000 7f6ac1604640 1 -- 172.21.15.53:0/2614133265 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae5f6f4790 con 0x55ae5f6684d0 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.756+0000 7f6ac2606640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6aa80b4d20 0x7f6aa80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.756+0000 7f6ab2ffd640 1 -- 172.21.15.53:0/648032959 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f6ab40e5700 con 0x7f6abc1089f0 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.756+0000 7f6ac1604640 1 --2- 172.21.15.53:0/2614133265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa2d760 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0057c0 tx=0x7f6aac005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ecc5a49f980d08 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.756+0000 7f6aa7fff640 1 -- 172.21.15.53:0/2614133265 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac035070 con 0x55ae5f6684d0 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.756+0000 7f6aa7fff640 1 -- 172.21.15.53:0/2614133265 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6aac0044c0 con 0x55ae5f6684d0 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.756+0000 7f6aa7fff640 1 -- 172.21.15.53:0/2614133265 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac003c40 con 0x55ae5f6684d0 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.757+0000 7f6acafd4740 1 -- 172.21.15.53:0/2614133265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 msgr2=0x55ae5fa2d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.757+0000 7f6ac2606640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6aa80b4d20 0x7f6aa80b7230 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40a7df0 tx=0x7f6ab4077f70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.757+0000 7f6acafd4740 1 --2- 172.21.15.53:0/2614133265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa2d760 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0057c0 tx=0x7f6aac005fd0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.757+0000 7f6acafd4740 1 -- 172.21.15.53:0/2614133265 shutdown_connections 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.757+0000 7f6acafd4740 1 --2- 172.21.15.53:0/2614133265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa2d760 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.757+0000 7f6acafd4740 1 --2- 172.21.15.53:0/2614133265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa2d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.757+0000 7f6acafd4740 1 --2- 172.21.15.53:0/2614133265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa2cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.757+0000 7f6acafd4740 1 -- 172.21.15.53:0/2614133265 >> 172.21.15.53:0/2614133265 conn(0x55ae5f67d300 msgr2=0x55ae5fa2abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.757+0000 7f6acafd4740 1 -- 172.21.15.53:0/2614133265 shutdown_connections 2024-08-31T06:20:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.757+0000 7f6acafd4740 1 -- 172.21.15.53:0/2614133265 wait complete. 2024-08-31T06:20:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.757+0000 7f6acafd4740 1 -- start start 2024-08-31T06:20:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6acafd4740 1 Processor -- start 2024-08-31T06:20:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa388a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa38de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa44720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6acafd4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f8caab0 con 0x55ae5f6684d0 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6acafd4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f918680 con 0x55ae5f6891b0 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6acafd4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ae5fa3b400 con 0x55ae5f6602f0 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6acafd4740 10 client.0 _ll_register_callbacks cb 0x55ae5f6a0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6ac1e05640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa38de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6ac1e05640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa38de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52826/0 (socket says 172.21.15.53:52826) 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6ac1e05640 1 -- 172.21.15.53:0/3017270265 learned_addr learned my addr 172.21.15.53:0/3017270265 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6ac1604640 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa44720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.758+0000 7f6ac1604640 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6ac1e05640 1 -- 172.21.15.53:0/3017270265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 msgr2=0x55ae5fa388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6ac1e05640 1 -- 172.21.15.53:0/3017270265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 msgr2=0x55ae5fa44720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa44720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6ac1e05640 1 -- 172.21.15.53:0/3017270265 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae5f76d620 con 0x55ae5f6684d0 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6ac1604640 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa44720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa38de0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8012700 tx=0x7f6ab8012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220ae15c6877decf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6aa57fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3017270265 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8004260 con 0x55ae5f6684d0 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3017270265 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f6ab8004400 con 0x55ae5f6684d0 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6acafd4740 1 -- 172.21.15.53:0/3017270265 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ae5f9a3f50 con 0x55ae5f6684d0 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3017270265 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f6ab80119a0 con 0x55ae5f6684d0 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6acafd4740 10 client.20493 fetch_fsmap learned FSMap version 57 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.759+0000 7f6acafd4740 1 -- 172.21.15.53:0/3017270265 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x55ae5fa474f0 con 0x55ae5f6684d0 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.760+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3017270265 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ae5f9a3f50 con 0x55ae5f6684d0 2024-08-31T06:20:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.760+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3017270265 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 57) ==== 8414+0+0 (secure 0 0 0) 0x7f6ab800f440 con 0x55ae5f6684d0 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.760+0000 7f6acafd4740 10 client.20493 fetch_fsmap finished waiting for FSMap version 57 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.760+0000 7f6acafd4740 10 client.20493 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.760+0000 7f6acafd4740 20 client.20493 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.760+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae5f647d80 0x55ae5fa4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.760+0000 7f6acafd4740 4 client.20493 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.760+0000 7f6acafd4740 1 -- 172.21.15.53:0/3017270265 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae5f99f9f0 con 0x55ae5f647d80 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.760+0000 7f6ac1604640 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae5f647d80 0x55ae5fa4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.761+0000 7f6aa57fa640 10 client.20493 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.761+0000 7f6ac1604640 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae5f647d80 0x55ae5fa4ab00 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74c34855ae78aae0 server_cookie=ced87f1b13a2f377 in_seq=0 out_seq=0 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.761+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3017270265 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae5f99f9f0 con 0x55ae5f647d80 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.761+0000 7f6aa57fa640 10 client.20493 handle_command_reply: tid=0 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.761+0000 7f6acafd4740 1 client.20493 shutdown 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6acafd4740 1 -- 172.21.15.53:0/3017270265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 msgr2=0x55ae5fa38de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa38de0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8012700 tx=0x7f6ab8012bc0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6acafd4740 1 -- 172.21.15.53:0/3017270265 shutdown_connections 2024-08-31T06:20:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae5f647d80 0x55ae5fa4ab00 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa44720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa38de0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6aa57fa640 0 client.20493 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3017270265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6acafd4740 1 -- 172.21.15.53:0/3017270265 >> 172.21.15.53:0/3017270265 conn(0x55ae5f67d300 msgr2=0x55ae5fa2dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6acafd4740 1 -- 172.21.15.53:0/3017270265 shutdown_connections 2024-08-31T06:20:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6acafd4740 1 -- 172.21.15.53:0/3017270265 wait complete. 2024-08-31T06:20:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.762+0000 7f6acafd4740 20 client.20493 trim_cache size 0 max 16384 2024-08-31T06:20:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6acafd4740 1 Processor -- start 2024-08-31T06:20:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6acafd4740 1 -- start start 2024-08-31T06:20:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa44620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa37b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa380a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6acafd4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc1af410 con 0x55ae5f6684d0 2024-08-31T06:20:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6acafd4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc1b1190 con 0x55ae5f6891b0 2024-08-31T06:20:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6acafd4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc1afae0 con 0x55ae5f6602f0 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6ac1e05640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa37b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6ac1e05640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa37b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52840/0 (socket says 172.21.15.53:52840) 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6ac1e05640 1 -- 172.21.15.53:0/1005027345 learned_addr learned my addr 172.21.15.53:0/1005027345 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6ac1604640 1 --2- 172.21.15.53:0/1005027345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa44620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6ac1604640 1 --2- 172.21.15.53:0/1005027345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6ac1e05640 1 -- 172.21.15.53:0/1005027345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 msgr2=0x55ae5fa44620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/1005027345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa44620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6ac1e05640 1 -- 172.21.15.53:0/1005027345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 msgr2=0x55ae5fa380a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/1005027345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa380a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6ac1e05640 1 -- 172.21.15.53:0/1005027345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae5fa25aa0 con 0x55ae5f6684d0 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.777+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/1005027345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa37b60 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80126d0 tx=0x7f6ab80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560518cd792bb2bc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.778+0000 7f6aa77fe640 1 -- 172.21.15.53:0/1005027345 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8032070 con 0x55ae5f6684d0 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.778+0000 7f6aa77fe640 1 -- 172.21.15.53:0/1005027345 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ab800f440 con 0x55ae5f6684d0 2024-08-31T06:20:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.778+0000 7f6aa77fe640 1 -- 172.21.15.53:0/1005027345 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8029040 con 0x55ae5f6684d0 2024-08-31T06:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.778+0000 7f6acafd4740 1 -- 172.21.15.53:0/1005027345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 msgr2=0x55ae5fa37b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.778+0000 7f6acafd4740 1 --2- 172.21.15.53:0/1005027345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa37b60 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80126d0 tx=0x7f6ab80118d0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.778+0000 7f6acafd4740 1 -- 172.21.15.53:0/1005027345 shutdown_connections 2024-08-31T06:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.778+0000 7f6acafd4740 1 --2- 172.21.15.53:0/1005027345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6891b0 0x55ae5fa380a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.779+0000 7f6acafd4740 1 --2- 172.21.15.53:0/1005027345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6684d0 0x55ae5fa37b60 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.779+0000 7f6acafd4740 1 --2- 172.21.15.53:0/1005027345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa44620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.779+0000 7f6acafd4740 1 -- 172.21.15.53:0/1005027345 >> 172.21.15.53:0/1005027345 conn(0x55ae5f67d300 msgr2=0x55ae5fa36ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.779+0000 7f6acafd4740 1 -- 172.21.15.53:0/1005027345 shutdown_connections 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.779+0000 7f6acafd4740 1 -- 172.21.15.53:0/1005027345 wait complete. 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.779+0000 7f6acafd4740 1 -- start start 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.779+0000 7f6acafd4740 1 Processor -- start 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.779+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa40c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.779+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6684d0 0x55ae5fa3c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.779+0000 7f6acafd4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6891b0 0x55ae5fa3c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.779+0000 7f6acafd4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc1b0a00 con 0x55ae5f6891b0 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6acafd4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc1b0270 con 0x55ae5f6684d0 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6acafd4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc1ad410 con 0x55ae5f6602f0 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6acafd4740 10 client.0 _ll_register_callbacks cb 0x7f6ab80096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1604640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6891b0 0x55ae5fa3c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1604640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6891b0 0x55ae5fa3c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52852/0 (socket says 172.21.15.53:52852) 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1604640 1 -- 172.21.15.53:0/3220074396 learned_addr learned my addr 172.21.15.53:0/3220074396 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1604640 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa40c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6684d0 0x55ae5fa3c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1604640 1 -- 172.21.15.53:0/3220074396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 msgr2=0x55ae5fa40c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1604640 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa40c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1604640 1 -- 172.21.15.53:0/3220074396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6684d0 msgr2=0x55ae5fa3c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1604640 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6684d0 0x55ae5fa3c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1604640 1 -- 172.21.15.53:0/3220074396 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae5fa3cc70 con 0x55ae5f6891b0 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6684d0 0x55ae5fa3c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6ac1604640 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6891b0 0x55ae5fa3c6b0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f6aac033000 tx=0x7f6aac04c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b8b87e35d1e25b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6aa57fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3220074396 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac059070 con 0x55ae5f6891b0 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3220074396 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f6aac03d450 con 0x55ae5f6891b0 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6acafd4740 1 -- 172.21.15.53:0/3220074396 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ab800f440 con 0x55ae5f6891b0 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3220074396 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f6aac064050 con 0x55ae5f6891b0 2024-08-31T06:20:47.788 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6acafd4740 10 client.20499 fetch_fsmap learned FSMap version 57 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.780+0000 7f6acafd4740 1 -- 172.21.15.53:0/3220074396 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x55ae5fab5260 con 0x55ae5f6891b0 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.781+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3220074396 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ab800f440 con 0x55ae5f6891b0 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.781+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3220074396 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 57) ==== 8414+0+0 (secure 0 0 0) 0x7f6aac03c440 con 0x55ae5f6891b0 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.781+0000 7f6acafd4740 10 client.20499 fetch_fsmap finished waiting for FSMap version 57 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.781+0000 7f6acafd4740 10 client.20499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.781+0000 7f6acafd4740 20 client.20499 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.781+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae5f61d1c0 0x55ae5fab7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.781+0000 7f6acafd4740 4 client.20499 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.781+0000 7f6acafd4740 1 -- 172.21.15.53:0/3220074396 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae5f99d130 con 0x55ae5f61d1c0 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.781+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae5f61d1c0 0x55ae5fab7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.781+0000 7f6ac1e05640 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae5f61d1c0 0x55ae5fab7600 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a45133ec8d0dbd9a server_cookie=c718724a0f90441a in_seq=0 out_seq=0 2024-08-31T06:20:47.789 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.781+0000 7f6aa57fa640 10 client.20499 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6aa57fa640 1 -- 172.21.15.53:0/3220074396 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae5f99d130 con 0x55ae5f61d1c0 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6aa57fa640 10 client.20499 handle_command_reply: tid=0 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 1 client.20499 shutdown 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 1 -- 172.21.15.53:0/3220074396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6891b0 msgr2=0x55ae5fa3c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6891b0 0x55ae5fa3c6b0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f6aac033000 tx=0x7f6aac04c040 comp rx=0 tx=0).stop 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 1 -- 172.21.15.53:0/3220074396 shutdown_connections 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae5f61d1c0 0x55ae5fab7600 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6aa57fa640 0 client.20499 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae5f6891b0 0x55ae5fa3c6b0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae5f6684d0 0x55ae5fa3c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 1 --2- 172.21.15.53:0/3220074396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae5f6602f0 0x55ae5fa40c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 1 -- 172.21.15.53:0/3220074396 >> 172.21.15.53:0/3220074396 conn(0x55ae5f67d300 msgr2=0x55ae5fa37b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 1 -- 172.21.15.53:0/3220074396 shutdown_connections 2024-08-31T06:20:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 1 -- 172.21.15.53:0/3220074396 wait complete. 2024-08-31T06:20:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.822+0000 7f6acafd4740 20 client.20499 trim_cache size 0 max 16384 2024-08-31T06:20:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:20:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:20:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:20:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:20:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 -- 172.21.15.53:0/648032959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6aa80b4d20 msgr2=0x7f6aa80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6aa80b4d20 0x7f6aa80b7230 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40a7df0 tx=0x7f6ab4077f70 comp rx=0 tx=0).stop 2024-08-31T06:20:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 -- 172.21.15.53:0/648032959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1089f0 msgr2=0x7f6abc19b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1089f0 0x7f6abc19b9c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009fd0 tx=0x7f6ab400b260 comp rx=0 tx=0).stop 2024-08-31T06:20:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 -- 172.21.15.53:0/648032959 shutdown_connections 2024-08-31T06:20:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6aa80b4d20 0x7f6aa80b7230 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc1089f0 0x7f6abc19b9c0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6abc1080a0 0x7f6abc19b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 --2- 172.21.15.53:0/648032959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6abc102770 0x7f6abc19af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 -- 172.21.15.53:0/648032959 >> 172.21.15.53:0/648032959 conn(0x7f6abc0fe190 msgr2=0x7f6abc1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 -- 172.21.15.53:0/648032959 shutdown_connections 2024-08-31T06:20:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:20:47.823+0000 7f6ac4069640 1 -- 172.21.15.53:0/648032959 wait complete. 2024-08-31T06:20:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:47 smithi130 ceph-mon[22266]: pgmap v818: 97 pgs: 97 active+clean; 458 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 1018 KiB/s wr, 119 op/s 2024-08-31T06:20:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:47 smithi153 ceph-mon[22320]: pgmap v818: 97 pgs: 97 active+clean; 458 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 1018 KiB/s wr, 119 op/s 2024-08-31T06:20:48.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:47 smithi053 ceph-mon[18924]: pgmap v818: 97 pgs: 97 active+clean; 458 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 1018 KiB/s wr, 119 op/s 2024-08-31T06:20:48.366 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 4.59 MB/sec execute 36 sec latency 3555.871 ms 2024-08-31T06:20:49.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 4.47 MB/sec execute 37 sec latency 4555.950 ms 2024-08-31T06:20:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:49 smithi130 ceph-mon[22266]: pgmap v819: 97 pgs: 97 active+clean; 457 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2024-08-31T06:20:50.251 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:49 smithi053 ceph-mon[18924]: pgmap v819: 97 pgs: 97 active+clean; 457 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2024-08-31T06:20:50.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:49 smithi153 ceph-mon[22320]: pgmap v819: 97 pgs: 97 active+clean; 457 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2024-08-31T06:20:50.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 4.35 MB/sec execute 38 sec latency 5556.002 ms 2024-08-31T06:20:51.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 4.24 MB/sec execute 39 sec latency 6556.042 ms 2024-08-31T06:20:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:51 smithi130 ceph-mon[22266]: pgmap v820: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-08-31T06:20:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:51 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:51 smithi153 ceph-mon[22320]: pgmap v820: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-08-31T06:20:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:51 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:51 smithi053 ceph-mon[18924]: pgmap v820: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-08-31T06:20:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:51 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:52.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 4.13 MB/sec execute 40 sec latency 7556.132 ms 2024-08-31T06:20:53.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:52 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:52 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:53.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 4.03 MB/sec execute 41 sec latency 8556.183 ms 2024-08-31T06:20:53.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:52 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:53 smithi153 ceph-mon[22320]: pgmap v821: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-08-31T06:20:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:20:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:20:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:20:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:20:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:53 smithi053 ceph-mon[18924]: pgmap v821: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-08-31T06:20:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:20:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:20:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:20:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:20:54.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.94 MB/sec execute 42 sec latency 9556.249 ms 2024-08-31T06:20:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:53 smithi130 ceph-mon[22266]: pgmap v821: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-08-31T06:20:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:20:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:20:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:20:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:20:55.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.85 MB/sec execute 43 sec latency 10556.299 ms 2024-08-31T06:20:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:55 smithi153 ceph-mon[22320]: pgmap v822: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-08-31T06:20:56.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:55 smithi053 ceph-mon[18924]: pgmap v822: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-08-31T06:20:56.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.76 MB/sec execute 44 sec latency 11556.397 ms 2024-08-31T06:20:56.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:55 smithi130 ceph-mon[22266]: pgmap v822: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-08-31T06:20:56.564 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:20:56.832 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:20:57.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:56 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:57.222 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:56 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:57.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.314+0000 7fd372d12640 1 -- 172.21.15.53:0/3011501310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd36c109240 msgr2=0x7fd36c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:57.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.314+0000 7fd372d12640 1 --2- 172.21.15.53:0/3011501310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd36c109240 0x7fd36c109650 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fd358009900 tx=0x7fd35802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.314+0000 7fd372d12640 1 -- 172.21.15.53:0/3011501310 shutdown_connections 2024-08-31T06:20:57.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.314+0000 7fd372d12640 1 --2- 172.21.15.53:0/3011501310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd36c109b90 0x7fd36c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.314+0000 7fd372d12640 1 --2- 172.21.15.53:0/3011501310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd36c109240 0x7fd36c109650 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.314+0000 7fd372d12640 1 --2- 172.21.15.53:0/3011501310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c103900 0x7fd36c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.314+0000 7fd372d12640 1 -- 172.21.15.53:0/3011501310 >> 172.21.15.53:0/3011501310 conn(0x7fd36c07b5f0 msgr2=0x7fd36c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.314+0000 7fd372d12640 1 -- 172.21.15.53:0/3011501310 shutdown_connections 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.314+0000 7fd372d12640 1 -- 172.21.15.53:0/3011501310 wait complete. 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.314+0000 7fd372d12640 1 Processor -- start 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.314+0000 7fd372d12640 1 -- start start 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd372d12640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd36c103900 0x7fd36c19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd372d12640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd36c109240 0x7fd36c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd372d12640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c109b90 0x7fd36c19f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd372d12640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c113700 con 0x7fd36c103900 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd372d12640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c113580 con 0x7fd36c109240 2024-08-31T06:20:57.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd372d12640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c113880 con 0x7fd36c109b90 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd370aae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd36c103900 0x7fd36c19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd370aae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd36c103900 0x7fd36c19a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40238/0 (socket says 172.21.15.53:40238) 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd370aae640 1 -- 172.21.15.53:0/787049912 learned_addr learned my addr 172.21.15.53:0/787049912 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd36bfff640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd36c109240 0x7fd36c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd3712af640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c109b90 0x7fd36c19f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd370aae640 1 -- 172.21.15.53:0/787049912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c109b90 msgr2=0x7fd36c19f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd370aae640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c109b90 0x7fd36c19f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd370aae640 1 -- 172.21.15.53:0/787049912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd36c109240 msgr2=0x7fd36c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd370aae640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd36c109240 0x7fd36c19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd370aae640 1 -- 172.21.15.53:0/787049912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36c19ffa0 con 0x7fd36c103900 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd3712af640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c109b90 0x7fd36c19f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:20:57.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.315+0000 7fd370aae640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd36c103900 0x7fd36c19a0f0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fd36000c920 tx=0x7fd36000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.316+0000 7fd369ffb640 1 -- 172.21.15.53:0/787049912 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360007c70 con 0x7fd36c103900 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.316+0000 7fd369ffb640 1 -- 172.21.15.53:0/787049912 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd360007e10 con 0x7fd36c103900 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.316+0000 7fd372d12640 1 -- 172.21.15.53:0/787049912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36c1a0290 con 0x7fd36c103900 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.316+0000 7fd369ffb640 1 -- 172.21.15.53:0/787049912 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360018710 con 0x7fd36c103900 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.316+0000 7fd372d12640 1 -- 172.21.15.53:0/787049912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36c1a6ab0 con 0x7fd36c103900 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.319+0000 7fd379287740 1 Processor -- start 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.319+0000 7fd369ffb640 1 -- 172.21.15.53:0/787049912 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd36000f450 con 0x7fd36c103900 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.319+0000 7fd379287740 1 -- start start 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd379287740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 0x5651339682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd379287740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 0x565133968800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd379287740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133968d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd379287740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5651338df630 con 0x5651335a2390 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd379287740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5651338cebc0 con 0x5651335c3070 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd379287740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5651338d2b70 con 0x56513359a1b0 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd36bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133968d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd36bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133968d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40254/0 (socket says 172.21.15.53:40254) 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd36bfff640 1 -- 172.21.15.53:0/1171982847 learned_addr learned my addr 172.21.15.53:0/1171982847 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd3712af640 1 --2- 172.21.15.53:0/1171982847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 0x5651339682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd370aae640 1 --2- 172.21.15.53:0/1171982847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 0x565133968800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd36bfff640 1 -- 172.21.15.53:0/1171982847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 msgr2=0x565133968800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd36bfff640 1 --2- 172.21.15.53:0/1171982847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 0x565133968800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd36bfff640 1 -- 172.21.15.53:0/1171982847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 msgr2=0x5651339682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd36bfff640 1 --2- 172.21.15.53:0/1171982847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 0x5651339682c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd36bfff640 1 -- 172.21.15.53:0/1171982847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513362e650 con 0x5651335a2390 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd369ffb640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd35c0b4d50 0x7fd35c0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd3712af640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd35c0b4d50 0x7fd35c0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.320+0000 7fd36bfff640 1 --2- 172.21.15.53:0/1171982847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133968d40 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fd358000c00 tx=0x7fd358031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce8349f2e1047b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.321+0000 7fd369ffb640 1 -- 172.21.15.53:0/787049912 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fd3600e5710 con 0x7fd36c103900 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.321+0000 7fd356ffd640 1 -- 172.21.15.53:0/1171982847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358035030 con 0x5651335a2390 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.321+0000 7fd356ffd640 1 -- 172.21.15.53:0/1171982847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd358040070 con 0x5651335a2390 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.321+0000 7fd356ffd640 1 -- 172.21.15.53:0/1171982847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358003a80 con 0x5651335a2390 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd379287740 1 -- 172.21.15.53:0/1171982847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 msgr2=0x565133968d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd3712af640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd35c0b4d50 0x7fd35c0b7260 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd364005fd0 tx=0x7fd3640086a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd379287740 1 --2- 172.21.15.53:0/1171982847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133968d40 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fd358000c00 tx=0x7fd358031dc0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd379287740 1 -- 172.21.15.53:0/1171982847 shutdown_connections 2024-08-31T06:20:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd379287740 1 --2- 172.21.15.53:0/1171982847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133968d40 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd379287740 1 --2- 172.21.15.53:0/1171982847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 0x565133968800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd379287740 1 --2- 172.21.15.53:0/1171982847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 0x5651339682c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd379287740 1 -- 172.21.15.53:0/1171982847 >> 172.21.15.53:0/1171982847 conn(0x5651335b7460 msgr2=0x5651339661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd379287740 1 -- 172.21.15.53:0/1171982847 shutdown_connections 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd379287740 1 -- 172.21.15.53:0/1171982847 wait complete. 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd379287740 1 -- start start 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.322+0000 7fd379287740 1 Processor -- start 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd379287740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 0x565133973a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd379287740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335a2390 0x565133973f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd379287740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335c3070 0x56513397fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd379287740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x565133731700 con 0x5651335c3070 2024-08-31T06:20:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd379287740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x565133855700 con 0x5651335a2390 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd379287740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565133976a40 con 0x56513359a1b0 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd379287740 10 client.0 _ll_register_callbacks cb 0x565133884dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd3712af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335c3070 0x56513397fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd3712af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335c3070 0x56513397fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40256/0 (socket says 172.21.15.53:40256) 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd36bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335a2390 0x565133973f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd3712af640 1 -- 172.21.15.53:0/3789589051 learned_addr learned my addr 172.21.15.53:0/3789589051 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd370aae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 0x565133973a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd3712af640 1 -- 172.21.15.53:0/3789589051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 msgr2=0x565133973a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd3712af640 1 --2- 172.21.15.53:0/3789589051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 0x565133973a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd3712af640 1 -- 172.21.15.53:0/3789589051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335a2390 msgr2=0x565133973f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd3712af640 1 --2- 172.21.15.53:0/3789589051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335a2390 0x565133973f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd3712af640 1 -- 172.21.15.53:0/3789589051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56513388e8b0 con 0x5651335c3070 2024-08-31T06:20:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd3712af640 1 --2- 172.21.15.53:0/3789589051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335c3070 0x56513397fd30 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fd36401cda0 tx=0x7fd364004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e09239a7bde1346 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.323+0000 7fd34bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd34bfff640 1 -- 172.21.15.53:0/3789589051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36401d620 con 0x5651335c3070 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd34bfff640 1 -- 172.21.15.53:0/3789589051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fd36401d7c0 con 0x5651335c3070 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd379287740 1 -- 172.21.15.53:0/3789589051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd358040070 con 0x5651335c3070 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd34bfff640 1 -- 172.21.15.53:0/3789589051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fd364004b20 con 0x5651335c3070 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd379287740 10 client.20511 fetch_fsmap learned FSMap version 60 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd379287740 1 -- 172.21.15.53:0/3789589051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x565133982880 con 0x5651335c3070 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd34bfff640 1 -- 172.21.15.53:0/3789589051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd358040070 con 0x5651335c3070 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd34bfff640 1 -- 172.21.15.53:0/3789589051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fd364005250 con 0x5651335c3070 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd379287740 10 client.20511 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd379287740 10 client.20511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd379287740 20 client.20511 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd379287740 1 --2- 172.21.15.53:0/3789589051 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5651335819f0 0x565133985e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd379287740 4 client.20511 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.324+0000 7fd379287740 1 -- 172.21.15.53:0/3789589051 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651338e1580 con 0x5651335819f0 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.325+0000 7fd370aae640 1 --2- 172.21.15.53:0/3789589051 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5651335819f0 0x565133985e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.325+0000 7fd370aae640 1 --2- 172.21.15.53:0/3789589051 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5651335819f0 0x565133985e60 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4798162785827ff server_cookie=5d6f007e4f584681 in_seq=0 out_seq=0 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.325+0000 7fd34bfff640 10 client.20511 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd34bfff640 1 -- 172.21.15.53:0/3789589051 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5651338e1580 con 0x5651335819f0 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd34bfff640 10 client.20511 handle_command_reply: tid=0 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 1 client.20511 shutdown 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 1 -- 172.21.15.53:0/3789589051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335c3070 msgr2=0x56513397fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 1 --2- 172.21.15.53:0/3789589051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335c3070 0x56513397fd30 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fd36401cda0 tx=0x7fd364004a40 comp rx=0 tx=0).stop 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 1 -- 172.21.15.53:0/3789589051 shutdown_connections 2024-08-31T06:20:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 1 --2- 172.21.15.53:0/3789589051 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5651335819f0 0x565133985e60 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd34bfff640 0 client.20511 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 1 --2- 172.21.15.53:0/3789589051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335c3070 0x56513397fd30 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 1 --2- 172.21.15.53:0/3789589051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335a2390 0x565133973f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 1 --2- 172.21.15.53:0/3789589051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 0x565133973a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 1 -- 172.21.15.53:0/3789589051 >> 172.21.15.53:0/3789589051 conn(0x5651335b7460 msgr2=0x56513396b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 1 -- 172.21.15.53:0/3789589051 shutdown_connections 2024-08-31T06:20:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 1 -- 172.21.15.53:0/3789589051 wait complete. 2024-08-31T06:20:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.326+0000 7fd379287740 20 client.20511 trim_cache size 0 max 16384 2024-08-31T06:20:57.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.344+0000 7fd379287740 1 Processor -- start 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.344+0000 7fd379287740 1 -- start start 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd379287740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56513359a1b0 0x565133969a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd379287740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651335a2390 0x56513397fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd379287740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 0x565133980170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd379287740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c1af390 con 0x56513359a1b0 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd379287740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c1b1050 con 0x5651335c3070 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd379287740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c1afa60 con 0x5651335a2390 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd370aae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56513359a1b0 0x565133969a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd370aae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56513359a1b0 0x565133969a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40260/0 (socket says 172.21.15.53:40260) 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd370aae640 1 -- 172.21.15.53:0/2371677204 learned_addr learned my addr 172.21.15.53:0/2371677204 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd3712af640 1 --2- 172.21.15.53:0/2371677204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 0x565133980170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd36bfff640 1 --2- 172.21.15.53:0/2371677204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651335a2390 0x56513397fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd370aae640 1 -- 172.21.15.53:0/2371677204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651335a2390 msgr2=0x56513397fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd370aae640 1 --2- 172.21.15.53:0/2371677204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651335a2390 0x56513397fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd370aae640 1 -- 172.21.15.53:0/2371677204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 msgr2=0x565133980170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd370aae640 1 --2- 172.21.15.53:0/2371677204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 0x565133980170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd370aae640 1 -- 172.21.15.53:0/2371677204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513396a5b0 con 0x56513359a1b0 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd370aae640 1 --2- 172.21.15.53:0/2371677204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56513359a1b0 0x565133969a00 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fd3600e2e40 tx=0x7fd36000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39db92671563c56b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd3567fc640 1 -- 172.21.15.53:0/2371677204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3600b50a0 con 0x56513359a1b0 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd3567fc640 1 -- 172.21.15.53:0/2371677204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd36000fa70 con 0x56513359a1b0 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.345+0000 7fd3567fc640 1 -- 172.21.15.53:0/2371677204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3600b0240 con 0x56513359a1b0 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.346+0000 7fd379287740 1 -- 172.21.15.53:0/2371677204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56513359a1b0 msgr2=0x565133969a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.346+0000 7fd379287740 1 --2- 172.21.15.53:0/2371677204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56513359a1b0 0x565133969a00 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fd3600e2e40 tx=0x7fd36000fd40 comp rx=0 tx=0).stop 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.346+0000 7fd379287740 1 -- 172.21.15.53:0/2371677204 shutdown_connections 2024-08-31T06:20:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.346+0000 7fd379287740 1 --2- 172.21.15.53:0/2371677204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 0x565133980170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.346+0000 7fd379287740 1 --2- 172.21.15.53:0/2371677204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651335a2390 0x56513397fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.346+0000 7fd379287740 1 --2- 172.21.15.53:0/2371677204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56513359a1b0 0x565133969a00 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.346+0000 7fd379287740 1 -- 172.21.15.53:0/2371677204 >> 172.21.15.53:0/2371677204 conn(0x5651335b7460 msgr2=0x5651339692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.346+0000 7fd379287740 1 -- 172.21.15.53:0/2371677204 shutdown_connections 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.346+0000 7fd379287740 1 -- 172.21.15.53:0/2371677204 wait complete. 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd379287740 1 -- start start 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd379287740 1 Processor -- start 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd379287740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 0x565133978be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd379287740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133979120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd379287740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 0x565133979660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd379287740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c1b0980 con 0x5651335a2390 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd379287740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c1b01f0 con 0x5651335c3070 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd379287740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c1ad390 con 0x56513359a1b0 2024-08-31T06:20:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd379287740 10 client.0 _ll_register_callbacks cb 0x7fd364008be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd36bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133979120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd36bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133979120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40264/0 (socket says 172.21.15.53:40264) 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.347+0000 7fd36bfff640 1 -- 172.21.15.53:0/628270047 learned_addr learned my addr 172.21.15.53:0/628270047 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd36bfff640 1 -- 172.21.15.53:0/628270047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 msgr2=0x565133978be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd36bfff640 1 --2- 172.21.15.53:0/628270047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 0x565133978be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd36bfff640 1 -- 172.21.15.53:0/628270047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 msgr2=0x565133979660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd36bfff640 1 --2- 172.21.15.53:0/628270047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 0x565133979660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd36bfff640 1 -- 172.21.15.53:0/628270047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651339f0830 con 0x5651335a2390 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd36bfff640 1 --2- 172.21.15.53:0/628270047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133979120 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fd358005e70 tx=0x7fd358031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607bd113bfc91559 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd34bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd34bfff640 1 -- 172.21.15.53:0/628270047 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358035050 con 0x5651335a2390 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd34bfff640 1 -- 172.21.15.53:0/628270047 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fd35803c650 con 0x5651335a2390 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd379287740 1 -- 172.21.15.53:0/628270047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd36000fa70 con 0x5651335a2390 2024-08-31T06:20:57.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd34bfff640 1 -- 172.21.15.53:0/628270047 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fd358049070 con 0x5651335a2390 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd379287740 10 client.20517 fetch_fsmap learned FSMap version 60 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.348+0000 7fd379287740 1 -- 172.21.15.53:0/628270047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5651339f1a50 con 0x5651335a2390 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.349+0000 7fd34bfff640 1 -- 172.21.15.53:0/628270047 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd36000fa70 con 0x5651335a2390 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.349+0000 7fd34bfff640 1 -- 172.21.15.53:0/628270047 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fd358054430 con 0x5651335a2390 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.349+0000 7fd379287740 10 client.20517 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.349+0000 7fd379287740 10 client.20517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.349+0000 7fd379287740 20 client.20517 populate_metadata read hostname 'smithi053' 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.349+0000 7fd379287740 1 --2- 172.21.15.53:0/628270047 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x565133556da0 0x5651339f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.349+0000 7fd379287740 4 client.20517 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.349+0000 7fd379287740 1 -- 172.21.15.53:0/628270047 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5651338dd020 con 0x565133556da0 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.349+0000 7fd370aae640 1 --2- 172.21.15.53:0/628270047 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x565133556da0 0x5651339f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.349+0000 7fd34bfff640 10 client.20517 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.349+0000 7fd370aae640 1 --2- 172.21.15.53:0/628270047 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x565133556da0 0x5651339f3e60 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a58cadfdd7b5bac7 server_cookie=99e29626ee57c5aa in_seq=0 out_seq=0 2024-08-31T06:20:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd34bfff640 1 -- 172.21.15.53:0/628270047 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x5651338dd020 con 0x565133556da0 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd34bfff640 10 client.20517 handle_command_reply: tid=0 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd379287740 1 client.20517 shutdown 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd379287740 1 -- 172.21.15.53:0/628270047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 msgr2=0x565133979120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd379287740 1 --2- 172.21.15.53:0/628270047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133979120 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fd358005e70 tx=0x7fd358031630 comp rx=0 tx=0).stop 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd379287740 1 -- 172.21.15.53:0/628270047 shutdown_connections 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd379287740 1 --2- 172.21.15.53:0/628270047 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x565133556da0 0x5651339f3e60 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd379287740 1 --2- 172.21.15.53:0/628270047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651335c3070 0x565133979660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd34bfff640 0 client.20517 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd379287740 1 --2- 172.21.15.53:0/628270047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651335a2390 0x565133979120 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd379287740 1 --2- 172.21.15.53:0/628270047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56513359a1b0 0x565133978be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd379287740 1 -- 172.21.15.53:0/628270047 >> 172.21.15.53:0/628270047 conn(0x5651335b7460 msgr2=0x565133974e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd379287740 1 -- 172.21.15.53:0/628270047 shutdown_connections 2024-08-31T06:20:57.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.350+0000 7fd379287740 1 -- 172.21.15.53:0/628270047 wait complete. 2024-08-31T06:20:57.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd379287740 20 client.20517 trim_cache size 0 max 16384 2024-08-31T06:20:57.361 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:20:57.361 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:20:57.361 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:20:57.361 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:20:57.361 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:20:57.361 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:20:57.361 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.363 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:20:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:20:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.365 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:20:57.365 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:20:57.365 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.365 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.365 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.365 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.365 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.365 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:20:57.365 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.366 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:20:57.367 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.369 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:20:57.370 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.371 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.372 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:20:57.373 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:20:57.374 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:20:57.374 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:20:57.374 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:20:57.374 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:57.374 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:20:57.374 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 -- 172.21.15.53:0/787049912 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd35c0b4d50 msgr2=0x7fd35c0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd35c0b4d50 0x7fd35c0b7260 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd364005fd0 tx=0x7fd3640086a0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 -- 172.21.15.53:0/787049912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd36c103900 msgr2=0x7fd36c19a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd36c103900 0x7fd36c19a0f0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fd36000c920 tx=0x7fd36000cde0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 -- 172.21.15.53:0/787049912 shutdown_connections 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd35c0b4d50 0x7fd35c0b7260 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd36c109b90 0x7fd36c19f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd36c109240 0x7fd36c19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 --2- 172.21.15.53:0/787049912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd36c103900 0x7fd36c19a0f0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 -- 172.21.15.53:0/787049912 >> 172.21.15.53:0/787049912 conn(0x7fd36c07b5f0 msgr2=0x7fd36c105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 -- 172.21.15.53:0/787049912 shutdown_connections 2024-08-31T06:20:57.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:20:57.351+0000 7fd372d12640 1 -- 172.21.15.53:0/787049912 wait complete. 2024-08-31T06:20:57.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.67 MB/sec execute 45 sec latency 12556.445 ms 2024-08-31T06:20:57.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:56 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:20:58.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:57 smithi153 ceph-mon[22320]: pgmap v823: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 1.1 MiB/s wr, 110 op/s 2024-08-31T06:20:58.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:57 smithi053 ceph-mon[18924]: pgmap v823: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 1.1 MiB/s wr, 110 op/s 2024-08-31T06:20:58.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.60 MB/sec execute 46 sec latency 13556.482 ms 2024-08-31T06:20:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:57 smithi130 ceph-mon[22266]: pgmap v823: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 1.1 MiB/s wr, 110 op/s 2024-08-31T06:20:59.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.52 MB/sec execute 47 sec latency 14556.519 ms 2024-08-31T06:21:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:20:59 smithi153 ceph-mon[22320]: pgmap v824: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 622 KiB/s wr, 73 op/s 2024-08-31T06:21:00.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:20:59 smithi053 ceph-mon[18924]: pgmap v824: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 622 KiB/s wr, 73 op/s 2024-08-31T06:21:00.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.45 MB/sec execute 48 sec latency 15556.571 ms 2024-08-31T06:21:00.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:20:59 smithi130 ceph-mon[22266]: pgmap v824: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 622 KiB/s wr, 73 op/s 2024-08-31T06:21:00.484 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:21:00.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:21:00.766 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.923+0000 7fa0d49cc640 1 -- 172.21.15.53:0/161034289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d0102780 msgr2=0x7fa0d0102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.923+0000 7fa0d49cc640 1 --2- 172.21.15.53:0/161034289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d0102780 0x7fa0d0102b90 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009900 tx=0x7fa0c002a410 comp rx=0 tx=0).stop 2024-08-31T06:21:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.924+0000 7fa0d49cc640 1 -- 172.21.15.53:0/161034289 shutdown_connections 2024-08-31T06:21:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.924+0000 7fa0d49cc640 1 --2- 172.21.15.53:0/161034289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d0108a00 0x7fa0d010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.924+0000 7fa0d49cc640 1 --2- 172.21.15.53:0/161034289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d01080b0 0x7fa0d01084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.924+0000 7fa0d49cc640 1 --2- 172.21.15.53:0/161034289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d0102780 0x7fa0d0102b90 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.924+0000 7fa0d49cc640 1 -- 172.21.15.53:0/161034289 >> 172.21.15.53:0/161034289 conn(0x7fa0d007a430 msgr2=0x7fa0d007a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.924+0000 7fa0d49cc640 1 -- 172.21.15.53:0/161034289 shutdown_connections 2024-08-31T06:21:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.924+0000 7fa0d49cc640 1 -- 172.21.15.53:0/161034289 wait complete. 2024-08-31T06:21:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.924+0000 7fa0d49cc640 1 Processor -- start 2024-08-31T06:21:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0d49cc640 1 -- start start 2024-08-31T06:21:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0d49cc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d0102780 0x7fa0d019af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0d49cc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d01080b0 0x7fa0d019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0d49cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d0108a00 0x7fa0d019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0d49cc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d0112520 con 0x7fa0d0108a00 2024-08-31T06:21:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0d49cc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d01123a0 con 0x7fa0d0102780 2024-08-31T06:21:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0d49cc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d01126a0 con 0x7fa0d01080b0 2024-08-31T06:21:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0ced9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d0108a00 0x7fa0d019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0ced9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d0108a00 0x7fa0d019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40288/0 (socket says 172.21.15.53:40288) 2024-08-31T06:21:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0ced9d640 1 -- 172.21.15.53:0/3057818 learned_addr learned my addr 172.21.15.53:0/3057818 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d01080b0 0x7fa0d019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d0102780 0x7fa0d019af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0ced9d640 1 -- 172.21.15.53:0/3057818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d01080b0 msgr2=0x7fa0d019b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0ced9d640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d01080b0 0x7fa0d019b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0ced9d640 1 -- 172.21.15.53:0/3057818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d0102780 msgr2=0x7fa0d019af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0ced9d640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d0102780 0x7fa0d019af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0ced9d640 1 -- 172.21.15.53:0/3057818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d01a6210 con 0x7fa0d0108a00 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d0102780 0x7fa0d019af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.925+0000 7fa0ced9d640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d0108a00 0x7fa0d019b9d0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009fd0 tx=0x7fa0c800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.926+0000 7fa0bf7fe640 1 -- 172.21.15.53:0/3057818 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8017070 con 0x7fa0d0108a00 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.926+0000 7fa0d49cc640 1 -- 172.21.15.53:0/3057818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d01a6500 con 0x7fa0d0108a00 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.926+0000 7fa0bf7fe640 1 -- 172.21.15.53:0/3057818 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c8003e00 con 0x7fa0d0108a00 2024-08-31T06:21:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.926+0000 7fa0bf7fe640 1 -- 172.21.15.53:0/3057818 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8010460 con 0x7fa0d0108a00 2024-08-31T06:21:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.926+0000 7fa0d49cc640 1 -- 172.21.15.53:0/3057818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d01a6a00 con 0x7fa0d0108a00 2024-08-31T06:21:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.928+0000 7fa0bf7fe640 1 -- 172.21.15.53:0/3057818 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa0c8003970 con 0x7fa0d0108a00 2024-08-31T06:21:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.928+0000 7fa0dba10740 1 Processor -- start 2024-08-31T06:21:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0dba10740 1 -- start start 2024-08-31T06:21:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557961ffc2f0 0x5579623c9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579620044d0 0x5579623c9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0dba10740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55796233e000 con 0x5579620251b0 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0dba10740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55796232d590 con 0x557961ffc2f0 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0dba10740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557962331540 con 0x5579620044d0 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0cdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0cdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40298/0 (socket says 172.21.15.53:40298) 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/2471888190 learned_addr learned my addr 172.21.15.53:0/2471888190 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/2471888190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557961ffc2f0 0x5579623c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0bf7fe640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0b80b4ca0 0x7fa0b80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/2471888190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579620044d0 0x5579623c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0ced9d640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0b80b4ca0 0x7fa0b80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/2471888190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579620044d0 msgr2=0x5579623c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/2471888190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579620044d0 0x5579623c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/2471888190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557961ffc2f0 msgr2=0x5579623c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/2471888190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557961ffc2f0 0x5579623c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.929+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/2471888190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557962090790 con 0x5579620251b0 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.930+0000 7fa0bf7fe640 1 -- 172.21.15.53:0/3057818 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fa0c80e56b0 con 0x7fa0d0108a00 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.930+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/2471888190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623c8ac0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40124f0 tx=0x7fa0c400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808f707f900a12c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.930+0000 7fa0bcff9640 1 -- 172.21.15.53:0/2471888190 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4004020 con 0x5579620251b0 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.930+0000 7fa0ced9d640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0b80b4ca0 0x7fa0b80b71b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80e33e0 tx=0x7fa0c8005ab0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.930+0000 7fa0bcff9640 1 -- 172.21.15.53:0/2471888190 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c4004c30 con 0x5579620251b0 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.930+0000 7fa0bcff9640 1 -- 172.21.15.53:0/2471888190 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4005280 con 0x5579620251b0 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.931+0000 7fa0dba10740 1 -- 172.21.15.53:0/2471888190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 msgr2=0x5579623c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.931+0000 7fa0dba10740 1 --2- 172.21.15.53:0/2471888190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623c8ac0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40124f0 tx=0x7fa0c400b650 comp rx=0 tx=0).stop 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.931+0000 7fa0dba10740 1 -- 172.21.15.53:0/2471888190 shutdown_connections 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.931+0000 7fa0dba10740 1 --2- 172.21.15.53:0/2471888190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579620044d0 0x5579623c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.931+0000 7fa0dba10740 1 --2- 172.21.15.53:0/2471888190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557961ffc2f0 0x5579623c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.931+0000 7fa0dba10740 1 --2- 172.21.15.53:0/2471888190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623c8ac0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.931+0000 7fa0dba10740 1 -- 172.21.15.53:0/2471888190 >> 172.21.15.53:0/2471888190 conn(0x557962019300 msgr2=0x5579623c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.931+0000 7fa0dba10740 1 -- 172.21.15.53:0/2471888190 shutdown_connections 2024-08-31T06:21:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.931+0000 7fa0dba10740 1 -- 172.21.15.53:0/2471888190 wait complete. 2024-08-31T06:21:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.931+0000 7fa0dba10740 1 -- start start 2024-08-31T06:21:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.931+0000 7fa0dba10740 1 Processor -- start 2024-08-31T06:21:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623d4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620044d0 0x5579623d4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623e0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0dba10740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557962266ab0 con 0x5579620251b0 2024-08-31T06:21:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0dba10740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5579622b4680 con 0x5579620044d0 2024-08-31T06:21:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0dba10740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5579623d7240 con 0x557961ffc2f0 2024-08-31T06:21:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0dba10740 10 client.0 _ll_register_callbacks cb 0x55796203ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0cdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0cdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623e0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40302/0 (socket says 172.21.15.53:40302) 2024-08-31T06:21:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/4178595707 learned_addr learned my addr 172.21.15.53:0/4178595707 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623d4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620044d0 0x5579623d4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/4178595707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 msgr2=0x5579623d4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623d4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/4178595707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620044d0 msgr2=0x5579623d4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620044d0 0x5579623d4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/4178595707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557962109620 con 0x5579620251b0 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623e0530 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x5579623c13a0 tx=0x7fa0c40044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e01ea630797999 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.932+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/4178595707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4022060 con 0x5579620251b0 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/4178595707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fa0c4005460 con 0x5579620251b0 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0dba10740 1 -- 172.21.15.53:0/4178595707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0c4004c30 con 0x5579620251b0 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/4178595707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fa0c4028040 con 0x5579620251b0 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0dba10740 10 client.20529 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0dba10740 1 -- 172.21.15.53:0/4178595707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5579623e3200 con 0x5579620251b0 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/4178595707 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c4004c30 con 0x5579620251b0 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/4178595707 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fa0c4010a10 con 0x5579620251b0 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0dba10740 10 client.20529 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0dba10740 10 client.20529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0dba10740 20 client.20529 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0dba10740 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557961fe3d80 0x5579623e6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0dba10740 4 client.20529 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0dba10740 1 -- 172.21.15.53:0/4178595707 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55796233ff50 con 0x557961fe3d80 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.933+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557961fe3d80 0x5579623e6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.934+0000 7fa0b5ffb640 10 client.20529 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.934+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557961fe3d80 0x5579623e6560 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a8924fdb994c36c server_cookie=f8874830910f8095 in_seq=0 out_seq=0 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/4178595707 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55796233ff50 con 0x557961fe3d80 2024-08-31T06:21:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0b5ffb640 10 client.20529 handle_command_reply: tid=0 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 1 client.20529 shutdown 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 1 -- 172.21.15.53:0/4178595707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 msgr2=0x5579623e0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623e0530 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x5579623c13a0 tx=0x7fa0c40044a0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 1 -- 172.21.15.53:0/4178595707 shutdown_connections 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557961fe3d80 0x5579623e6560 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623e0530 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620044d0 0x5579623d4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0b5ffb640 0 client.20529 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 1 --2- 172.21.15.53:0/4178595707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623d4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 1 -- 172.21.15.53:0/4178595707 >> 172.21.15.53:0/4178595707 conn(0x557962019300 msgr2=0x5579623c9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 1 -- 172.21.15.53:0/4178595707 shutdown_connections 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 1 -- 172.21.15.53:0/4178595707 wait complete. 2024-08-31T06:21:00.943 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.935+0000 7fa0dba10740 20 client.20529 trim_cache size 0 max 16384 2024-08-31T06:21:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.949+0000 7fa0dba10740 1 Processor -- start 2024-08-31T06:21:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.949+0000 7fa0dba10740 1 -- start start 2024-08-31T06:21:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.949+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.949+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620044d0 0x5579623e0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.949+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620251b0 0x5579623e0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0dba10740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d01af510 con 0x5579620044d0 2024-08-31T06:21:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0dba10740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d01b11d0 con 0x5579620251b0 2024-08-31T06:21:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0dba10740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d01afbe0 con 0x557961ffc2f0 2024-08-31T06:21:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620044d0 0x5579623e0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620044d0 0x5579623e0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40308/0 (socket says 172.21.15.53:40308) 2024-08-31T06:21:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0ce59c640 1 -- 172.21.15.53:0/2670829056 learned_addr learned my addr 172.21.15.53:0/2670829056 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/2670829056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/2670829056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620251b0 0x5579623e0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0ce59c640 1 -- 172.21.15.53:0/2670829056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 msgr2=0x5579623ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/2670829056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0ce59c640 1 -- 172.21.15.53:0/2670829056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620251b0 msgr2=0x5579623e0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/2670829056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620251b0 0x5579623e0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0ce59c640 1 -- 172.21.15.53:0/2670829056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579623d5320 con 0x5579620044d0 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/2670829056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/2670829056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620044d0 0x5579623e0430 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0000c00 tx=0x7fa0c0009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d032e178381b8b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0b7fff640 1 -- 172.21.15.53:0/2670829056 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0035040 con 0x5579620044d0 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0b7fff640 1 -- 172.21.15.53:0/2670829056 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c00054d0 con 0x5579620044d0 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.950+0000 7fa0b7fff640 1 -- 172.21.15.53:0/2670829056 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0004c90 con 0x5579620044d0 2024-08-31T06:21:00.957 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.951+0000 7fa0dba10740 1 -- 172.21.15.53:0/2670829056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620044d0 msgr2=0x5579623e0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.951+0000 7fa0dba10740 1 --2- 172.21.15.53:0/2670829056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620044d0 0x5579623e0430 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0000c00 tx=0x7fa0c0009560 comp rx=0 tx=0).stop 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.951+0000 7fa0dba10740 1 -- 172.21.15.53:0/2670829056 shutdown_connections 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.951+0000 7fa0dba10740 1 --2- 172.21.15.53:0/2670829056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620251b0 0x5579623e0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.951+0000 7fa0dba10740 1 --2- 172.21.15.53:0/2670829056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620044d0 0x5579623e0430 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.951+0000 7fa0dba10740 1 --2- 172.21.15.53:0/2670829056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.951+0000 7fa0dba10740 1 -- 172.21.15.53:0/2670829056 >> 172.21.15.53:0/2670829056 conn(0x557962019300 msgr2=0x5579623d2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.951+0000 7fa0dba10740 1 -- 172.21.15.53:0/2670829056 shutdown_connections 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.951+0000 7fa0dba10740 1 -- 172.21.15.53:0/2670829056 wait complete. 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.951+0000 7fa0dba10740 1 -- start start 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.951+0000 7fa0dba10740 1 Processor -- start 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623d84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620044d0 0x5579623d8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0dba10740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623d8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.958 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0dba10740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d01b0b00 con 0x5579620251b0 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0dba10740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d01b0370 con 0x5579620044d0 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0dba10740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d01ad510 con 0x557961ffc2f0 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0dba10740 10 client.0 _ll_register_callbacks cb 0x7fa0c0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0cdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623d8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0cdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623d8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40310/0 (socket says 172.21.15.53:40310) 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/1080471836 learned_addr learned my addr 172.21.15.53:0/1080471836 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623d84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620044d0 0x5579623d8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/1080471836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 msgr2=0x5579623d84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623d84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/1080471836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620044d0 msgr2=0x5579623d8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620044d0 0x5579623d8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.959 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0cdd9b640 1 -- 172.21.15.53:0/1080471836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796244fe10 con 0x5579620251b0 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0cdd9b640 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623d8f50 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400be90 tx=0x7fa0c4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56f2762534c97dd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.952+0000 7fa0b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/1080471836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4022050 con 0x5579620251b0 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/1080471836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fa0c4004ad0 con 0x5579620251b0 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0dba10740 1 -- 172.21.15.53:0/1080471836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0c00054d0 con 0x5579620251b0 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/1080471836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fa0c4004cd0 con 0x5579620251b0 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0dba10740 10 client.20535 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0dba10740 1 -- 172.21.15.53:0/1080471836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x557962451010 con 0x5579620251b0 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/1080471836 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c00054d0 con 0x5579620251b0 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/1080471836 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fa0c4010690 con 0x5579620251b0 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0dba10740 10 client.20535 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0dba10740 10 client.20535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:00.960 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0dba10740 20 client.20535 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0dba10740 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557961fb91c0 0x5579624536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0dba10740 4 client.20535 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:21:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.953+0000 7fa0dba10740 1 -- 172.21.15.53:0/1080471836 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55796233b9f0 con 0x557961fb91c0 2024-08-31T06:21:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.954+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557961fb91c0 0x5579624536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.954+0000 7fa0ce59c640 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557961fb91c0 0x5579624536c0 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aa6b29181906f8c server_cookie=980fabdc797beac2 in_seq=0 out_seq=0 2024-08-31T06:21:00.961 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.954+0000 7fa0b5ffb640 10 client.20535 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.982+0000 7fa0b5ffb640 1 -- 172.21.15.53:0/1080471836 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55796233b9f0 con 0x557961fb91c0 2024-08-31T06:21:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.982+0000 7fa0b5ffb640 10 client.20535 handle_command_reply: tid=0 2024-08-31T06:21:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.982+0000 7fa0dba10740 1 client.20535 shutdown 2024-08-31T06:21:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0dba10740 1 -- 172.21.15.53:0/1080471836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 msgr2=0x5579623d8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0dba10740 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623d8f50 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400be90 tx=0x7fa0c4014040 comp rx=0 tx=0).stop 2024-08-31T06:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0dba10740 1 -- 172.21.15.53:0/1080471836 shutdown_connections 2024-08-31T06:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0dba10740 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557961fb91c0 0x5579624536c0 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0dba10740 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579620251b0 0x5579623d8f50 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0dba10740 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5579620044d0 0x5579623d8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0b5ffb640 0 client.20535 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0dba10740 1 --2- 172.21.15.53:0/1080471836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557961ffc2f0 0x5579623d84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0dba10740 1 -- 172.21.15.53:0/1080471836 >> 172.21.15.53:0/1080471836 conn(0x557962019300 msgr2=0x5579623d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0dba10740 1 -- 172.21.15.53:0/1080471836 shutdown_connections 2024-08-31T06:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0dba10740 1 -- 172.21.15.53:0/1080471836 wait complete. 2024-08-31T06:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0dba10740 20 client.20535 trim_cache size 0 max 16384 2024-08-31T06:21:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:21:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:21:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:21:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:21:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0d49cc640 1 -- 172.21.15.53:0/3057818 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0b80b4ca0 msgr2=0x7fa0b80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0d49cc640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0b80b4ca0 0x7fa0b80b71b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80e33e0 tx=0x7fa0c8005ab0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0d49cc640 1 -- 172.21.15.53:0/3057818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d0108a00 msgr2=0x7fa0d019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.983+0000 7fa0d49cc640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d0108a00 0x7fa0d019b9d0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009fd0 tx=0x7fa0c800b260 comp rx=0 tx=0).stop 2024-08-31T06:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.984+0000 7fa0d49cc640 1 -- 172.21.15.53:0/3057818 shutdown_connections 2024-08-31T06:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.984+0000 7fa0d49cc640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0b80b4ca0 0x7fa0b80b71b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.984+0000 7fa0d49cc640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0d0108a00 0x7fa0d019b9d0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.984+0000 7fa0d49cc640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0d01080b0 0x7fa0d019b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.984+0000 7fa0d49cc640 1 --2- 172.21.15.53:0/3057818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0d0102780 0x7fa0d019af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.984+0000 7fa0d49cc640 1 -- 172.21.15.53:0/3057818 >> 172.21.15.53:0/3057818 conn(0x7fa0d007a430 msgr2=0x7fa0d0101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.984+0000 7fa0d49cc640 1 -- 172.21.15.53:0/3057818 shutdown_connections 2024-08-31T06:21:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:00.984+0000 7fa0d49cc640 1 -- 172.21.15.53:0/3057818 wait complete. 2024-08-31T06:21:01.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.284+0000 7fd9eedc7640 1 -- 172.21.15.53:0/2872211976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8108a90 msgr2=0x7fd9e810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:01.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.284+0000 7fd9eedc7640 1 --2- 172.21.15.53:0/2872211976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8108a90 0x7fd9e810f2c0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009ca0 tx=0x7fd9e002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:21:01.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.284+0000 7fd9eedc7640 1 -- 172.21.15.53:0/2872211976 shutdown_connections 2024-08-31T06:21:01.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.284+0000 7fd9eedc7640 1 --2- 172.21.15.53:0/2872211976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8108a90 0x7fd9e810f2c0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:01.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.284+0000 7fd9eedc7640 1 --2- 172.21.15.53:0/2872211976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e8108140 0x7fd9e8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:01.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.284+0000 7fd9eedc7640 1 --2- 172.21.15.53:0/2872211976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8102800 0x7fd9e8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:01.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.284+0000 7fd9eedc7640 1 -- 172.21.15.53:0/2872211976 >> 172.21.15.53:0/2872211976 conn(0x7fd9e80794d0 msgr2=0x7fd9e80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:01.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.284+0000 7fd9eedc7640 1 -- 172.21.15.53:0/2872211976 shutdown_connections 2024-08-31T06:21:01.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.284+0000 7fd9eedc7640 1 -- 172.21.15.53:0/2872211976 wait complete. 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.285+0000 7fd9eedc7640 1 Processor -- start 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.285+0000 7fd9eedc7640 1 -- start start 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.285+0000 7fd9eedc7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e8102800 0x7fd9e819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.285+0000 7fd9eedc7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8108140 0x7fd9e819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.285+0000 7fd9eedc7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8108a90 0x7fd9e819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.285+0000 7fd9eedc7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8112610 con 0x7fd9e8108140 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.285+0000 7fd9eedc7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8112490 con 0x7fd9e8108a90 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.285+0000 7fd9eedc7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8112790 con 0x7fd9e8102800 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.285+0000 7fd9e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8108140 0x7fd9e819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.285+0000 7fd9e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8108140 0x7fd9e819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40332/0 (socket says 172.21.15.53:40332) 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.285+0000 7fd9e7fff640 1 -- 172.21.15.53:0/4201416440 learned_addr learned my addr 172.21.15.53:0/4201416440 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9ed364640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8108a90 0x7fd9e819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:01.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9ecb63640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e8102800 0x7fd9e819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9e7fff640 1 -- 172.21.15.53:0/4201416440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e8102800 msgr2=0x7fd9e819a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9e7fff640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e8102800 0x7fd9e819a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9e7fff640 1 -- 172.21.15.53:0/4201416440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8108a90 msgr2=0x7fd9e819f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9e7fff640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8108a90 0x7fd9e819f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9e7fff640 1 -- 172.21.15.53:0/4201416440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e81a0100 con 0x7fd9e8108140 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9ed364640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8108a90 0x7fd9e819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9e7fff640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8108140 0x7fd9e819a730 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400e9f0 tx=0x7fd9d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9e5ffb640 1 -- 172.21.15.53:0/4201416440 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400ccc0 con 0x7fd9e8108140 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9eedc7640 1 -- 172.21.15.53:0/4201416440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e81a03f0 con 0x7fd9e8108140 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9e5ffb640 1 -- 172.21.15.53:0/4201416440 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9d40054b0 con 0x7fd9e8108140 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9e5ffb640 1 -- 172.21.15.53:0/4201416440 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4010430 con 0x7fd9e8108140 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.286+0000 7fd9eedc7640 1 -- 172.21.15.53:0/4201416440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e81a6b50 con 0x7fd9e8108140 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.287+0000 7fd9eedc7640 1 -- 172.21.15.53:0/4201416440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e8102c10 con 0x7fd9e8108140 2024-08-31T06:21:01.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.289+0000 7fd9e5ffb640 1 -- 172.21.15.53:0/4201416440 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd9d40046c0 con 0x7fd9e8108140 2024-08-31T06:21:01.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.289+0000 7fd9e5ffb640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d80b4ca0 0x7fd9d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:01.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.289+0000 7fd9ecb63640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d80b4ca0 0x7fd9d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:01.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.289+0000 7fd9e5ffb640 1 -- 172.21.15.53:0/4201416440 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7fd9d40e5b70 con 0x7fd9e8108140 2024-08-31T06:21:01.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.290+0000 7fd9ecb63640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d80b4ca0 0x7fd9d80b71b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009aa0 tx=0x7fd9dc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:01.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.293+0000 7fd9e5ffb640 1 -- 172.21.15.53:0/4201416440 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd9d4056130 con 0x7fd9e8108140 2024-08-31T06:21:01.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.37 MB/sec execute 49 sec latency 16556.629 ms 2024-08-31T06:21:01.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.517+0000 7fd9eedc7640 1 -- 172.21.15.53:0/4201416440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9e819b2c0 con 0x7fd9e8108140 2024-08-31T06:21:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.518+0000 7fd9e5ffb640 1 -- 172.21.15.53:0/4201416440 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+11999 (secure 0 0 0) 0x7fd9d40ac940 con 0x7fd9e8108140 2024-08-31T06:21:01.520 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:21:01.520 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":60,"btime":"2024-08-31T06:20:55:888273+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":60,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:20:55.550353+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:21:01.521 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 60 2024-08-31T06:21:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 -- 172.21.15.53:0/4201416440 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d80b4ca0 msgr2=0x7fd9d80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:01.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d80b4ca0 0x7fd9d80b71b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009aa0 tx=0x7fd9dc005f90 comp rx=0 tx=0).stop 2024-08-31T06:21:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 -- 172.21.15.53:0/4201416440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8108140 msgr2=0x7fd9e819a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8108140 0x7fd9e819a730 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400e9f0 tx=0x7fd9d400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:21:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 -- 172.21.15.53:0/4201416440 shutdown_connections 2024-08-31T06:21:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd9d80b4ca0 0x7fd9d80b71b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd9e8108a90 0x7fd9e819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e8108140 0x7fd9e819a730 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 --2- 172.21.15.53:0/4201416440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9e8102800 0x7fd9e819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 -- 172.21.15.53:0/4201416440 >> 172.21.15.53:0/4201416440 conn(0x7fd9e80794d0 msgr2=0x7fd9e80ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 -- 172.21.15.53:0/4201416440 shutdown_connections 2024-08-31T06:21:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:01.520+0000 7fd9eedc7640 1 -- 172.21.15.53:0/4201416440 wait complete. 2024-08-31T06:21:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:01 smithi153 ceph-mon[22320]: pgmap v825: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 305 KiB/s wr, 60 op/s 2024-08-31T06:21:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:01 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4201416440' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:21:02.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:01 smithi053 ceph-mon[18924]: pgmap v825: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 305 KiB/s wr, 60 op/s 2024-08-31T06:21:02.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:01 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4201416440' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:21:02.296 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:21:02.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.31 MB/sec execute 50 sec latency 17556.681 ms 2024-08-31T06:21:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:01 smithi130 ceph-mon[22266]: pgmap v825: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 305 KiB/s wr, 60 op/s 2024-08-31T06:21:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:01 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4201416440' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:21:02.553 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:02.852 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.045+0000 7f77332ec640 1 -- 172.21.15.53:0/2913189847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c102840 msgr2=0x7f772c102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.045+0000 7f77332ec640 1 --2- 172.21.15.53:0/2913189847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c102840 0x7f772c102c50 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f7728009900 tx=0x7f772802a410 comp rx=0 tx=0).stop 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.045+0000 7f77332ec640 1 -- 172.21.15.53:0/2913189847 shutdown_connections 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.045+0000 7f77332ec640 1 --2- 172.21.15.53:0/2913189847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f772c108ad0 0x7f772c10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.045+0000 7f77332ec640 1 --2- 172.21.15.53:0/2913189847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f772c108180 0x7f772c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.045+0000 7f77332ec640 1 --2- 172.21.15.53:0/2913189847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c102840 0x7f772c102c50 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.045+0000 7f77332ec640 1 -- 172.21.15.53:0/2913189847 >> 172.21.15.53:0/2913189847 conn(0x7f772c079580 msgr2=0x7f772c079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.046+0000 7f77332ec640 1 -- 172.21.15.53:0/2913189847 shutdown_connections 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.046+0000 7f77332ec640 1 -- 172.21.15.53:0/2913189847 wait complete. 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.046+0000 7f77332ec640 1 Processor -- start 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.046+0000 7f77332ec640 1 -- start start 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f77332ec640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f772c102840 0x7f772c19afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f77332ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c108180 0x7f772c19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f77332ec640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f772c108ad0 0x7f772c19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f77332ec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f772c112600 con 0x7f772c108180 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f77332ec640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f772c112480 con 0x7f772c108ad0 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f77332ec640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f772c112780 con 0x7f772c102840 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f7730887640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c108180 0x7f772c19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f7730887640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c108180 0x7f772c19b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40348/0 (socket says 172.21.15.53:40348) 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f7730887640 1 -- 172.21.15.53:0/3486771963 learned_addr learned my addr 172.21.15.53:0/3486771963 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f7731889640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f772c108ad0 0x7f772c19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f7731088640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f772c102840 0x7f772c19afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f7730887640 1 -- 172.21.15.53:0/3486771963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f772c102840 msgr2=0x7f772c19afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f7730887640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f772c102840 0x7f772c19afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f7730887640 1 -- 172.21.15.53:0/3486771963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f772c108ad0 msgr2=0x7f772c19ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:03.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f7730887640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f772c108ad0 0x7f772c19ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f7730887640 1 -- 172.21.15.53:0/3486771963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772c1a6290 con 0x7f772c108180 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.047+0000 7f7731889640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f772c108ad0 0x7f772c19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.048+0000 7f7730887640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c108180 0x7f772c19b510 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f772000c970 tx=0x7f772000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.048+0000 7f771e7fc640 1 -- 172.21.15.53:0/3486771963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720007bb0 con 0x7f772c108180 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.048+0000 7f771e7fc640 1 -- 172.21.15.53:0/3486771963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7720007d50 con 0x7f772c108180 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.048+0000 7f77332ec640 1 -- 172.21.15.53:0/3486771963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772c1a6580 con 0x7f772c108180 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.048+0000 7f771e7fc640 1 -- 172.21.15.53:0/3486771963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720018660 con 0x7f772c108180 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.048+0000 7f77332ec640 1 -- 172.21.15.53:0/3486771963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f772c1a6a70 con 0x7f772c108180 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.051+0000 7f7739861740 1 Processor -- start 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.051+0000 7f771e7fc640 1 -- 172.21.15.53:0/3486771963 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7720018820 con 0x7f772c108180 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.051+0000 7f7739861740 1 -- start start 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.051+0000 7f7739861740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe711070 0x55d4feab6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.051+0000 7f7739861740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feab6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.051+0000 7f7739861740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6f0390 0x55d4feab6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.051+0000 7f7739861740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d4fea2d680 con 0x55d4fe6e81b0 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.051+0000 7f7739861740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d4fea1cc10 con 0x55d4fe711070 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.051+0000 7f7739861740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d4fea20bc0 con 0x55d4fe6f0390 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731088640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feab6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731088640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feab6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40360/0 (socket says 172.21.15.53:40360) 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731088640 1 -- 172.21.15.53:0/3814527794 learned_addr learned my addr 172.21.15.53:0/3814527794 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7730887640 1 --2- 172.21.15.53:0/3814527794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6f0390 0x55d4feab6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731889640 1 --2- 172.21.15.53:0/3814527794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe711070 0x55d4feab6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731088640 1 -- 172.21.15.53:0/3814527794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6f0390 msgr2=0x55d4feab6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731088640 1 --2- 172.21.15.53:0/3814527794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6f0390 0x55d4feab6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731088640 1 -- 172.21.15.53:0/3814527794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe711070 msgr2=0x55d4feab6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731088640 1 --2- 172.21.15.53:0/3814527794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe711070 0x55d4feab6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731088640 1 -- 172.21.15.53:0/3814527794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4fe77c650 con 0x55d4fe6e81b0 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731889640 1 --2- 172.21.15.53:0/3814527794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe711070 0x55d4feab6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f771e7fc640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f77180b4ca0 0x7f77180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731889640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f77180b4ca0 0x7f77180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f7731088640 1 --2- 172.21.15.53:0/3814527794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feab6850 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f772802a930 tx=0x7f7728031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7365f2e286c3db96 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.052+0000 7f771e7fc640 1 -- 172.21.15.53:0/3486771963 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f77200e56b0 con 0x7f772c108180 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.053+0000 7f77177fe640 1 -- 172.21.15.53:0/3814527794 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728035030 con 0x55d4fe6e81b0 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.053+0000 7f77177fe640 1 -- 172.21.15.53:0/3814527794 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77280044c0 con 0x55d4fe6e81b0 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.053+0000 7f77177fe640 1 -- 172.21.15.53:0/3814527794 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728003bc0 con 0x55d4fe6e81b0 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.053+0000 7f7739861740 1 -- 172.21.15.53:0/3814527794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 msgr2=0x55d4feab6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.053+0000 7f7739861740 1 --2- 172.21.15.53:0/3814527794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feab6850 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f772802a930 tx=0x7f7728031dc0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.053+0000 7f7731889640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f77180b4ca0 0x7f77180b71b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f772400a520 tx=0x7f772400a4b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.054+0000 7f7739861740 1 -- 172.21.15.53:0/3814527794 shutdown_connections 2024-08-31T06:21:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.054+0000 7f7739861740 1 --2- 172.21.15.53:0/3814527794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6f0390 0x55d4feab6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.054+0000 7f7739861740 1 --2- 172.21.15.53:0/3814527794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feab6850 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.054+0000 7f7739861740 1 --2- 172.21.15.53:0/3814527794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe711070 0x55d4feab6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.054+0000 7f7739861740 1 -- 172.21.15.53:0/3814527794 >> 172.21.15.53:0/3814527794 conn(0x55d4fe705460 msgr2=0x55d4feab4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.054+0000 7f7739861740 1 -- 172.21.15.53:0/3814527794 shutdown_connections 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.054+0000 7f7739861740 1 -- 172.21.15.53:0/3814527794 wait complete. 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.054+0000 7f7739861740 1 -- start start 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.054+0000 7f7739861740 1 Processor -- start 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7739861740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feac19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7739861740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe6f0390 0x55d4feac1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7739861740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe711070 0x55d4fead21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7739861740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d4fe87f700 con 0x55d4fe6e81b0 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7739861740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d4fe9a3750 con 0x55d4fe6f0390 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7739861740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d4feac8ea0 con 0x55d4fe711070 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7739861740 10 client.0 _ll_register_callbacks cb 0x55d4fe9d2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7731088640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feac19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7731088640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feac19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40364/0 (socket says 172.21.15.53:40364) 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7731088640 1 -- 172.21.15.53:0/3308119896 learned_addr learned my addr 172.21.15.53:0/3308119896 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7731889640 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe711070 0x55d4fead21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7730887640 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe6f0390 0x55d4feac1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7731088640 1 -- 172.21.15.53:0/3308119896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe711070 msgr2=0x55d4fead21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7731088640 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe711070 0x55d4fead21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7731088640 1 -- 172.21.15.53:0/3308119896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe6f0390 msgr2=0x55d4feac1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7731088640 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe6f0390 0x55d4feac1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.055+0000 7f7731088640 1 -- 172.21.15.53:0/3308119896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4fe9dc900 con 0x55d4fe6e81b0 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.056+0000 7f7731088640 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feac19f0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7728031630 tx=0x7f7728031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f400edcd08280 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.056+0000 7f7714ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.056+0000 7f7714ff9640 1 -- 172.21.15.53:0/3308119896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728035070 con 0x55d4fe6e81b0 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.056+0000 7f7739861740 1 -- 172.21.15.53:0/3308119896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d4fea2f5d0 con 0x55d4fe6e81b0 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.056+0000 7f7714ff9640 1 -- 172.21.15.53:0/3308119896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f7728003bb0 con 0x55d4fe6e81b0 2024-08-31T06:21:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.056+0000 7f7714ff9640 1 -- 172.21.15.53:0/3308119896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f7728031880 con 0x55d4fe6e81b0 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.056+0000 7f7739861740 10 client.20553 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.056+0000 7f7739861740 1 -- 172.21.15.53:0/3308119896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55d4fead4c10 con 0x55d4fe6e81b0 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.056+0000 7f7714ff9640 1 -- 172.21.15.53:0/3308119896 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d4fea2f5d0 con 0x55d4fe6e81b0 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.056+0000 7f7714ff9640 1 -- 172.21.15.53:0/3308119896 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f772804e850 con 0x55d4fe6e81b0 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.057+0000 7f7739861740 10 client.20553 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.057+0000 7f7739861740 10 client.20553 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.057+0000 7f7739861740 20 client.20553 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.057+0000 7f7739861740 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d4fe6cf9f0 0x55d4fead7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.057+0000 7f7739861740 4 client.20553 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.057+0000 7f7739861740 1 -- 172.21.15.53:0/3308119896 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4fea2b070 con 0x55d4fe6cf9f0 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.057+0000 7f7730887640 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d4fe6cf9f0 0x55d4fead7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.057+0000 7f7714ff9640 10 client.20553 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.057+0000 7f7730887640 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d4fe6cf9f0 0x55d4fead7f70 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=501bfb3ff9a9b945 server_cookie=4e5a088ab866ae80 in_seq=0 out_seq=0 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7714ff9640 1 -- 172.21.15.53:0/3308119896 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4fea2b070 con 0x55d4fe6cf9f0 2024-08-31T06:21:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7714ff9640 10 client.20553 handle_command_reply: tid=0 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7739861740 1 client.20553 shutdown 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7739861740 1 -- 172.21.15.53:0/3308119896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 msgr2=0x55d4feac19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7739861740 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feac19f0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7728031630 tx=0x7f7728031660 comp rx=0 tx=0).stop 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7739861740 1 -- 172.21.15.53:0/3308119896 shutdown_connections 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7739861740 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d4fe6cf9f0 0x55d4fead7f70 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7739861740 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe711070 0x55d4fead21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7739861740 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe6f0390 0x55d4feac1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7739861740 1 --2- 172.21.15.53:0/3308119896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6e81b0 0x55d4feac19f0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7739861740 1 -- 172.21.15.53:0/3308119896 >> 172.21.15.53:0/3308119896 conn(0x55d4fe705460 msgr2=0x55d4feab94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.058+0000 7f7714ff9640 0 client.20553 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.059+0000 7f7739861740 1 -- 172.21.15.53:0/3308119896 shutdown_connections 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.059+0000 7f7739861740 1 -- 172.21.15.53:0/3308119896 wait complete. 2024-08-31T06:21:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.059+0000 7f7739861740 20 client.20553 trim_cache size 0 max 16384 2024-08-31T06:21:03.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.075+0000 7f7739861740 1 Processor -- start 2024-08-31T06:21:03.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.075+0000 7f7739861740 1 -- start start 2024-08-31T06:21:03.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7739861740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6e81b0 0x55d4fead2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7739861740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6f0390 0x55d4feabebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7739861740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe711070 0x55d4feabf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7739861740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1ad2e0 con 0x55d4fe6f0390 2024-08-31T06:21:03.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7739861740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1aefa0 con 0x55d4fe711070 2024-08-31T06:21:03.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7739861740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1ad9b0 con 0x55d4fe6e81b0 2024-08-31T06:21:03.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7730887640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6f0390 0x55d4feabebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7730887640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6f0390 0x55d4feabebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40376/0 (socket says 172.21.15.53:40376) 2024-08-31T06:21:03.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7730887640 1 -- 172.21.15.53:0/2884602868 learned_addr learned my addr 172.21.15.53:0/2884602868 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:03.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7731088640 1 --2- 172.21.15.53:0/2884602868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6e81b0 0x55d4fead2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7731889640 1 --2- 172.21.15.53:0/2884602868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe711070 0x55d4feabf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7730887640 1 -- 172.21.15.53:0/2884602868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6e81b0 msgr2=0x55d4fead2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7730887640 1 --2- 172.21.15.53:0/2884602868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6e81b0 0x55d4fead2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7730887640 1 -- 172.21.15.53:0/2884602868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe711070 msgr2=0x55d4feabf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7730887640 1 --2- 172.21.15.53:0/2884602868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe711070 0x55d4feabf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7730887640 1 -- 172.21.15.53:0/2884602868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4feade260 con 0x55d4fe6f0390 2024-08-31T06:21:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.076+0000 7f7730887640 1 --2- 172.21.15.53:0/2884602868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6f0390 0x55d4feabebe0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f77200abd10 tx=0x7f77200eb550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c04c29a88f6b525 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.077+0000 7f7716ffd640 1 -- 172.21.15.53:0/2884602868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77200ab890 con 0x55d4fe6f0390 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.077+0000 7f7716ffd640 1 -- 172.21.15.53:0/2884602868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77200ac480 con 0x55d4fe6f0390 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.077+0000 7f7716ffd640 1 -- 172.21.15.53:0/2884602868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77200e3060 con 0x55d4fe6f0390 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.078+0000 7f7739861740 1 -- 172.21.15.53:0/2884602868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6f0390 msgr2=0x55d4feabebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.078+0000 7f7739861740 1 --2- 172.21.15.53:0/2884602868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6f0390 0x55d4feabebe0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f77200abd10 tx=0x7f77200eb550 comp rx=0 tx=0).stop 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.078+0000 7f7739861740 1 -- 172.21.15.53:0/2884602868 shutdown_connections 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.078+0000 7f7739861740 1 --2- 172.21.15.53:0/2884602868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe711070 0x55d4feabf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.078+0000 7f7739861740 1 --2- 172.21.15.53:0/2884602868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe6f0390 0x55d4feabebe0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.078+0000 7f7739861740 1 --2- 172.21.15.53:0/2884602868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6e81b0 0x55d4fead2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.078+0000 7f7739861740 1 -- 172.21.15.53:0/2884602868 >> 172.21.15.53:0/2884602868 conn(0x55d4fe705460 msgr2=0x55d4feac0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.078+0000 7f7739861740 1 -- 172.21.15.53:0/2884602868 shutdown_connections 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.078+0000 7f7739861740 1 -- 172.21.15.53:0/2884602868 wait complete. 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.078+0000 7f7739861740 1 -- start start 2024-08-31T06:21:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.078+0000 7f7739861740 1 Processor -- start 2024-08-31T06:21:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7739861740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6e81b0 0x55d4fead9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7739861740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe6f0390 0x55d4fead95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7739861740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe711070 0x55d4fead9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7739861740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1ae8d0 con 0x55d4fe711070 2024-08-31T06:21:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7739861740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1ae140 con 0x55d4fe6f0390 2024-08-31T06:21:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7739861740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1ab2e0 con 0x55d4fe6e81b0 2024-08-31T06:21:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7739861740 10 client.0 _ll_register_callbacks cb 0x7f77200eb420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7731889640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe711070 0x55d4fead9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7731889640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe711070 0x55d4fead9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40392/0 (socket says 172.21.15.53:40392) 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7731889640 1 -- 172.21.15.53:0/1055068238 learned_addr learned my addr 172.21.15.53:0/1055068238 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7730887640 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe6f0390 0x55d4fead95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.079+0000 7f7731088640 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6e81b0 0x55d4fead9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7730887640 1 -- 172.21.15.53:0/1055068238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6e81b0 msgr2=0x55d4fead9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7730887640 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6e81b0 0x55d4fead9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7730887640 1 -- 172.21.15.53:0/1055068238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe711070 msgr2=0x55d4fead9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7730887640 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe711070 0x55d4fead9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7730887640 1 -- 172.21.15.53:0/1055068238 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4feb417a0 con 0x55d4fe6f0390 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7731889640 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe711070 0x55d4fead9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7731088640 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6e81b0 0x55d4fead9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7730887640 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe6f0390 0x55d4fead95c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f772000c940 tx=0x7f77200e3270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f06f23a85f69789 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7714ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7714ff9640 1 -- 172.21.15.53:0/1055068238 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77200ab890 con 0x55d4fe6f0390 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7714ff9640 1 -- 172.21.15.53:0/1055068238 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f7720018b10 con 0x55d4fe6f0390 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7739861740 1 -- 172.21.15.53:0/1055068238 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77200ac480 con 0x55d4fe6f0390 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7714ff9640 1 -- 172.21.15.53:0/1055068238 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f77200abd80 con 0x55d4fe6f0390 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7739861740 10 client.29483 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.080+0000 7f7739861740 1 -- 172.21.15.53:0/1055068238 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55d4feb42a00 con 0x55d4fe6f0390 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.081+0000 7f7714ff9640 1 -- 172.21.15.53:0/1055068238 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77200ac480 con 0x55d4fe6f0390 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.081+0000 7f7714ff9640 1 -- 172.21.15.53:0/1055068238 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f7720020030 con 0x55d4fe6f0390 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.081+0000 7f7739861740 10 client.29483 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.081+0000 7f7739861740 10 client.29483 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.081+0000 7f7739861740 20 client.29483 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.081+0000 7f7739861740 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d4fe6a4da0 0x55d4feb450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.081+0000 7f7739861740 4 client.29483 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:21:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.081+0000 7f7739861740 1 -- 172.21.15.53:0/1055068238 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d4fea287b0 con 0x55d4fe6a4da0 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.081+0000 7f7731088640 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d4fe6a4da0 0x55d4feb450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7714ff9640 10 client.29483 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7731088640 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d4fe6a4da0 0x55d4feb450c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ffecd67a2c3a8790 server_cookie=afb31a02f017cf48 in_seq=0 out_seq=0 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7714ff9640 1 -- 172.21.15.53:0/1055068238 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d4fea287b0 con 0x55d4fe6a4da0 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7714ff9640 10 client.29483 handle_command_reply: tid=0 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7739861740 1 client.29483 shutdown 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7739861740 1 -- 172.21.15.53:0/1055068238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe6f0390 msgr2=0x55d4fead95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7739861740 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe6f0390 0x55d4fead95c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f772000c940 tx=0x7f77200e3270 comp rx=0 tx=0).stop 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7739861740 1 -- 172.21.15.53:0/1055068238 shutdown_connections 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7739861740 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4fe711070 0x55d4fead9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7739861740 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d4fe6f0390 0x55d4fead95c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7739861740 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55d4fe6a4da0 0x55d4feb450c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7739861740 1 --2- 172.21.15.53:0/1055068238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d4fe6e81b0 0x55d4fead9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7714ff9640 0 client.29483 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:21:03.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7739861740 1 -- 172.21.15.53:0/1055068238 >> 172.21.15.53:0/1055068238 conn(0x55d4fe705460 msgr2=0x55d4feab7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:03.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.082+0000 7f7739861740 1 -- 172.21.15.53:0/1055068238 shutdown_connections 2024-08-31T06:21:03.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f7739861740 1 -- 172.21.15.53:0/1055068238 wait complete. 2024-08-31T06:21:03.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f7739861740 20 client.29483 trim_cache size 0 max 16384 2024-08-31T06:21:03.089 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:21:03.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 -- 172.21.15.53:0/3486771963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f77180b4ca0 msgr2=0x7f77180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f77180b4ca0 0x7f77180b71b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f772400a520 tx=0x7f772400a4b0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 -- 172.21.15.53:0/3486771963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c108180 msgr2=0x7f772c19b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c108180 0x7f772c19b510 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f772000c970 tx=0x7f772000ce30 comp rx=0 tx=0).stop 2024-08-31T06:21:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 -- 172.21.15.53:0/3486771963 shutdown_connections 2024-08-31T06:21:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f77180b4ca0 0x7f77180b71b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f772c108ad0 0x7f772c19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c108180 0x7f772c19b510 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 --2- 172.21.15.53:0/3486771963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f772c102840 0x7f772c19afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 -- 172.21.15.53:0/3486771963 >> 172.21.15.53:0/3486771963 conn(0x7f772c079580 msgr2=0x7f772c1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 -- 172.21.15.53:0/3486771963 shutdown_connections 2024-08-31T06:21:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:03.083+0000 7f77332ec640 1 -- 172.21.15.53:0/3486771963 wait complete. 2024-08-31T06:21:03.367 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.24 MB/sec execute 51 sec latency 18556.767 ms 2024-08-31T06:21:03.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:03 smithi053 ceph-mon[18924]: pgmap v826: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 173 KiB/s wr, 18 op/s 2024-08-31T06:21:04.097 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:21:04.098 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:03 smithi153 ceph-mon[22320]: pgmap v826: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 173 KiB/s wr, 18 op/s 2024-08-31T06:21:04.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.18 MB/sec execute 52 sec latency 19556.977 ms 2024-08-31T06:21:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:03 smithi130 ceph-mon[22266]: pgmap v826: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 173 KiB/s wr, 18 op/s 2024-08-31T06:21:04.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.626+0000 7f1cacc0a640 1 -- 172.21.15.53:0/392795642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca8108140 msgr2=0x7f1ca8108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:04.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.626+0000 7f1cacc0a640 1 --2- 172.21.15.53:0/392795642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca8108140 0x7f1ca8108550 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009900 tx=0x7f1c9c02a410 comp rx=0 tx=0).stop 2024-08-31T06:21:04.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.626+0000 7f1cacc0a640 1 -- 172.21.15.53:0/392795642 shutdown_connections 2024-08-31T06:21:04.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.626+0000 7f1cacc0a640 1 --2- 172.21.15.53:0/392795642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca8108a90 0x7f1ca810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:04.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.626+0000 7f1cacc0a640 1 --2- 172.21.15.53:0/392795642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca8108140 0x7f1ca8108550 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:04.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.626+0000 7f1cacc0a640 1 --2- 172.21.15.53:0/392795642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ca8102800 0x7f1ca8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:04.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.626+0000 7f1cacc0a640 1 -- 172.21.15.53:0/392795642 >> 172.21.15.53:0/392795642 conn(0x7f1ca80794d0 msgr2=0x7f1ca80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:04.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.626+0000 7f1cacc0a640 1 -- 172.21.15.53:0/392795642 shutdown_connections 2024-08-31T06:21:04.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.626+0000 7f1cacc0a640 1 -- 172.21.15.53:0/392795642 wait complete. 2024-08-31T06:21:04.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.627+0000 7f1cacc0a640 1 Processor -- start 2024-08-31T06:21:04.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.627+0000 7f1cacc0a640 1 -- start start 2024-08-31T06:21:04.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.627+0000 7f1cacc0a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ca8102800 0x7f1ca819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:04.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1cacc0a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca8108140 0x7f1ca819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1cacc0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca8108a90 0x7f1ca819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1cacc0a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca8112610 con 0x7f1ca8108a90 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1cacc0a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca8112490 con 0x7f1ca8108140 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1cacc0a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca8112790 con 0x7f1ca8102800 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1ca6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca8108a90 0x7f1ca819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1ca6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca8108a90 0x7f1ca819fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36852/0 (socket says 172.21.15.53:36852) 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1ca5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca8108140 0x7f1ca819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1ca6d9d640 1 -- 172.21.15.53:0/159261051 learned_addr learned my addr 172.21.15.53:0/159261051 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1ca659c640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ca8102800 0x7f1ca819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1ca6d9d640 1 -- 172.21.15.53:0/159261051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ca8102800 msgr2=0x7f1ca819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1ca6d9d640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ca8102800 0x7f1ca819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1ca6d9d640 1 -- 172.21.15.53:0/159261051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca8108140 msgr2=0x7f1ca819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:04.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1ca6d9d640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca8108140 0x7f1ca819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:04.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.628+0000 7f1ca6d9d640 1 -- 172.21.15.53:0/159261051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca81a0140 con 0x7f1ca8108a90 2024-08-31T06:21:04.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.629+0000 7f1ca6d9d640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca8108a90 0x7f1ca819fa10 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000eaa0 tx=0x7f1ca000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:04.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.629+0000 7f1c977fe640 1 -- 172.21.15.53:0/159261051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca000cdb0 con 0x7f1ca8108a90 2024-08-31T06:21:04.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.629+0000 7f1cacc0a640 1 -- 172.21.15.53:0/159261051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca81a0430 con 0x7f1ca8108a90 2024-08-31T06:21:04.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.629+0000 7f1c977fe640 1 -- 172.21.15.53:0/159261051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ca0005020 con 0x7f1ca8108a90 2024-08-31T06:21:04.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.629+0000 7f1c977fe640 1 -- 172.21.15.53:0/159261051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca00116d0 con 0x7f1ca8108a90 2024-08-31T06:21:04.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.630+0000 7f1cacc0a640 1 -- 172.21.15.53:0/159261051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca81a6b90 con 0x7f1ca8108a90 2024-08-31T06:21:04.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.631+0000 7f1cacc0a640 1 -- 172.21.15.53:0/159261051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca8102c10 con 0x7f1ca8108a90 2024-08-31T06:21:04.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.632+0000 7f1c977fe640 1 -- 172.21.15.53:0/159261051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1ca00051d0 con 0x7f1ca8108a90 2024-08-31T06:21:04.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.633+0000 7f1c977fe640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c900b4ca0 0x7f1c900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:04.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.633+0000 7f1ca659c640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c900b4ca0 0x7f1c900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:04.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.633+0000 7f1c977fe640 1 -- 172.21.15.53:0/159261051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f1ca00e5ad0 con 0x7f1ca8108a90 2024-08-31T06:21:04.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.633+0000 7f1ca659c640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c900b4ca0 0x7f1c900b71b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1c98006fd0 tx=0x7f1c980090e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:04.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.636+0000 7f1c977fe640 1 -- 172.21.15.53:0/159261051 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1ca0016030 con 0x7f1ca8108a90 2024-08-31T06:21:04.660 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:04.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.870+0000 7f1cacc0a640 1 -- 172.21.15.53:0/159261051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ca819b300 con 0x7f1ca8108a90 2024-08-31T06:21:04.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.871+0000 7f1c977fe640 1 -- 172.21.15.53:0/159261051 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+11999 (secure 0 0 0) 0x7f1ca819b300 con 0x7f1ca8108a90 2024-08-31T06:21:04.874 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:21:04.874 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":60,"btime":"2024-08-31T06:20:55:888273+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":60,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:20:55.550353+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:21:04.874 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 60 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 -- 172.21.15.53:0/159261051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c900b4ca0 msgr2=0x7f1c900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c900b4ca0 0x7f1c900b71b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1c98006fd0 tx=0x7f1c980090e0 comp rx=0 tx=0).stop 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 -- 172.21.15.53:0/159261051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca8108a90 msgr2=0x7f1ca819fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca8108a90 0x7f1ca819fa10 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000eaa0 tx=0x7f1ca000ef60 comp rx=0 tx=0).stop 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 -- 172.21.15.53:0/159261051 shutdown_connections 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1c900b4ca0 0x7f1c900b71b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca8108a90 0x7f1ca819fa10 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ca8108140 0x7f1ca819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 --2- 172.21.15.53:0/159261051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ca8102800 0x7f1ca819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 -- 172.21.15.53:0/159261051 >> 172.21.15.53:0/159261051 conn(0x7f1ca80794d0 msgr2=0x7f1ca806b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 -- 172.21.15.53:0/159261051 shutdown_connections 2024-08-31T06:21:04.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:04.873+0000 7f1cacc0a640 1 -- 172.21.15.53:0/159261051 wait complete. 2024-08-31T06:21:05.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:04 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/159261051' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:21:05.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:04 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/159261051' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:21:05.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.12 MB/sec execute 53 sec latency 20557.070 ms 2024-08-31T06:21:05.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:04 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/159261051' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:21:05.685 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id b1859690 --release --await' 2024-08-31T06:21:05.686 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id b1859690 --release --await 2024-08-31T06:21:05.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.906+0000 7f3801476640 1 -- 172.21.15.53:0/1877862494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc102800 msgr2=0x7f37fc102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:05.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.906+0000 7f3801476640 1 --2- 172.21.15.53:0/1877862494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc102800 0x7f37fc102c10 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009900 tx=0x7f37ec02a410 comp rx=0 tx=0).stop 2024-08-31T06:21:05.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.906+0000 7f3801476640 1 -- 172.21.15.53:0/1877862494 shutdown_connections 2024-08-31T06:21:05.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.906+0000 7f3801476640 1 --2- 172.21.15.53:0/1877862494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37fc108a90 0x7f37fc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.906+0000 7f3801476640 1 --2- 172.21.15.53:0/1877862494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37fc108140 0x7f37fc108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.906+0000 7f3801476640 1 --2- 172.21.15.53:0/1877862494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc102800 0x7f37fc102c10 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.906+0000 7f3801476640 1 -- 172.21.15.53:0/1877862494 >> 172.21.15.53:0/1877862494 conn(0x7f37fc0794d0 msgr2=0x7f37fc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.906+0000 7f3801476640 1 -- 172.21.15.53:0/1877862494 shutdown_connections 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.906+0000 7f3801476640 1 -- 172.21.15.53:0/1877862494 wait complete. 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.907+0000 7f3801476640 1 Processor -- start 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.907+0000 7f3801476640 1 -- start start 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.907+0000 7f3801476640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37fc102800 0x7f37fc19aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.907+0000 7f3801476640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc108140 0x7f37fc19b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.907+0000 7f3801476640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37fc108a90 0x7f37fc19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.907+0000 7f3801476640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc1125a0 con 0x7f37fc108140 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.907+0000 7f3801476640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc112420 con 0x7f37fc102800 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.907+0000 7f3801476640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc112720 con 0x7f37fc108a90 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.907+0000 7f37fa7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc108140 0x7f37fc19b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.907+0000 7f37fa7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc108140 0x7f37fc19b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36862/0 (socket says 172.21.15.53:36862) 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37fa7fc640 1 -- 172.21.15.53:0/608181803 learned_addr learned my addr 172.21.15.53:0/608181803 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37faffd640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37fc102800 0x7f37fc19aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37fb7fe640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37fc108a90 0x7f37fc19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37fa7fc640 1 -- 172.21.15.53:0/608181803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37fc108a90 msgr2=0x7f37fc19ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37fa7fc640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37fc108a90 0x7f37fc19ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37fa7fc640 1 -- 172.21.15.53:0/608181803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37fc102800 msgr2=0x7f37fc19aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37fa7fc640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37fc102800 0x7f37fc19aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37fa7fc640 1 -- 172.21.15.53:0/608181803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc1a61f0 con 0x7f37fc108140 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37faffd640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37fc102800 0x7f37fc19aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37fb7fe640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37fc108a90 0x7f37fc19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37fa7fc640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc108140 0x7f37fc19b530 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f37e400c970 tx=0x7f37e400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37f3fff640 1 -- 172.21.15.53:0/608181803 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4014070 con 0x7f37fc108140 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37f3fff640 1 -- 172.21.15.53:0/608181803 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37e4004440 con 0x7f37fc108140 2024-08-31T06:21:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f3801476640 1 -- 172.21.15.53:0/608181803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37fc1a64e0 con 0x7f37fc108140 2024-08-31T06:21:05.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f37f3fff640 1 -- 172.21.15.53:0/608181803 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4003d40 con 0x7f37fc108140 2024-08-31T06:21:05.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.908+0000 7f3801476640 1 -- 172.21.15.53:0/608181803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37fc1a6a20 con 0x7f37fc108140 2024-08-31T06:21:05.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.911+0000 7f38079eb740 1 Processor -- start 2024-08-31T06:21:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.911+0000 7f38079eb740 1 -- start start 2024-08-31T06:21:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.912+0000 7f38079eb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe921070 0x5555fecc6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.912+0000 7f38079eb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecc6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.912+0000 7f38079eb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecc6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.912+0000 7f38079eb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5555fec3d680 con 0x5555fe8f81b0 2024-08-31T06:21:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.912+0000 7f38079eb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5555fec2cc10 con 0x5555fe921070 2024-08-31T06:21:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.912+0000 7f38079eb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5555fec30bc0 con 0x5555fe900390 2024-08-31T06:21:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.912+0000 7f37faffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecc6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.912+0000 7f37f3fff640 1 -- 172.21.15.53:0/608181803 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f37e4017070 con 0x7f37fc108140 2024-08-31T06:21:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.912+0000 7f37faffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecc6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36864/0 (socket says 172.21.15.53:36864) 2024-08-31T06:21:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.912+0000 7f37faffd640 1 -- 172.21.15.53:0/2214350368 learned_addr learned my addr 172.21.15.53:0/2214350368 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.912+0000 7f37fb7fe640 1 --2- 172.21.15.53:0/2214350368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe921070 0x5555fecc6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.913+0000 7f37fa7fc640 1 --2- 172.21.15.53:0/2214350368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecc6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.913+0000 7f37faffd640 1 -- 172.21.15.53:0/2214350368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 msgr2=0x5555fecc6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.913+0000 7f37faffd640 1 --2- 172.21.15.53:0/2214350368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecc6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.913+0000 7f37faffd640 1 -- 172.21.15.53:0/2214350368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe921070 msgr2=0x5555fecc6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.913+0000 7f37faffd640 1 --2- 172.21.15.53:0/2214350368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe921070 0x5555fecc6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.913+0000 7f37faffd640 1 -- 172.21.15.53:0/2214350368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fe98c650 con 0x5555fe8f81b0 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.913+0000 7f37fb7fe640 1 --2- 172.21.15.53:0/2214350368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe921070 0x5555fecc6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.913+0000 7f37f3fff640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37e80b4cd0 0x7f37e80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.913+0000 7f37faffd640 1 --2- 172.21.15.53:0/2214350368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecc6850 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0096c0 tx=0x7f37ec032d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfac3a8b29d6fd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.914+0000 7f37f3fff640 1 -- 172.21.15.53:0/608181803 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f37e40e51d0 con 0x7f37fc108140 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.914+0000 7f37fb7fe640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37e80b4cd0 0x7f37e80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.914+0000 7f37f17fa640 1 -- 172.21.15.53:0/2214350368 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec03f070 con 0x5555fe8f81b0 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.914+0000 7f37f17fa640 1 -- 172.21.15.53:0/2214350368 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37ec0044c0 con 0x5555fe8f81b0 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.914+0000 7f37f17fa640 1 -- 172.21.15.53:0/2214350368 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec035070 con 0x5555fe8f81b0 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.915+0000 7f38079eb740 1 -- 172.21.15.53:0/2214350368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 msgr2=0x5555fecc6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.915+0000 7f38079eb740 1 --2- 172.21.15.53:0/2214350368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecc6850 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0096c0 tx=0x7f37ec032d90 comp rx=0 tx=0).stop 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.915+0000 7f37fb7fe640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37e80b4cd0 0x7f37e80b71e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009370 tx=0x7f37f4009720 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.915+0000 7f38079eb740 1 -- 172.21.15.53:0/2214350368 shutdown_connections 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.915+0000 7f38079eb740 1 --2- 172.21.15.53:0/2214350368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecc6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.915+0000 7f38079eb740 1 --2- 172.21.15.53:0/2214350368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecc6850 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.915+0000 7f38079eb740 1 --2- 172.21.15.53:0/2214350368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe921070 0x5555fecc6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.915+0000 7f38079eb740 1 -- 172.21.15.53:0/2214350368 >> 172.21.15.53:0/2214350368 conn(0x5555fe915460 msgr2=0x5555fecc4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.915+0000 7f38079eb740 1 -- 172.21.15.53:0/2214350368 shutdown_connections 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.915+0000 7f38079eb740 1 -- 172.21.15.53:0/2214350368 wait complete. 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.915+0000 7f38079eb740 1 -- start start 2024-08-31T06:21:05.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f38079eb740 1 Processor -- start 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f38079eb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 0x5555fecd1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f38079eb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecd1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f38079eb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe921070 0x5555fecddd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f38079eb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5555fea8f700 con 0x5555fe921070 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f38079eb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5555febb3750 con 0x5555fe8f81b0 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f38079eb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5555fecd4a90 con 0x5555fe900390 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f38079eb740 10 client.0 _ll_register_callbacks cb 0x5555febe2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f37faffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 0x5555fecd1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f37fb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe921070 0x5555fecddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f37fa7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecd1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f37fa7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecd1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44050/0 (socket says 172.21.15.53:44050) 2024-08-31T06:21:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f37fa7fc640 1 -- 172.21.15.53:0/4291777063 learned_addr learned my addr 172.21.15.53:0/4291777063 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:05.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.916+0000 7f37fb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe921070 0x5555fecddd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36868/0 (socket says 172.21.15.53:36868) 2024-08-31T06:21:05.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.917+0000 7f37fb7fe640 1 -- 172.21.15.53:0/4291777063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 msgr2=0x5555fecd1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.917+0000 7f37fb7fe640 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecd1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.917+0000 7f37fb7fe640 1 -- 172.21.15.53:0/4291777063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 msgr2=0x5555fecd1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.917+0000 7f37fb7fe640 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 0x5555fecd1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.917+0000 7f37fb7fe640 1 -- 172.21.15.53:0/4291777063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555febec900 con 0x5555fe921070 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.917+0000 7f37faffd640 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 0x5555fecd1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.918+0000 7f37fb7fe640 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe921070 0x5555fecddd80 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009fd0 tx=0x7f37f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ed4165d70fe3c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.918+0000 7f37e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.918+0000 7f37e27fc640 1 -- 172.21.15.53:0/4291777063 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f400fb20 con 0x5555fe921070 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.918+0000 7f37e27fc640 1 -- 172.21.15.53:0/4291777063 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8557+0+0 (secure 0 0 0) 0x7f37f400fcc0 con 0x5555fe921070 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.918+0000 7f38079eb740 1 -- 172.21.15.53:0/4291777063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5555fec3f5d0 con 0x5555fe921070 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.919+0000 7f37e27fc640 1 -- 172.21.15.53:0/4291777063 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f37f401f420 con 0x5555fe921070 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.919+0000 7f38079eb740 10 client.20577 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:05.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.919+0000 7f38079eb740 1 -- 172.21.15.53:0/4291777063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5555fece0880 con 0x5555fe921070 2024-08-31T06:21:05.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.925+0000 7f37e27fc640 1 -- 172.21.15.53:0/4291777063 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5555fec3f5d0 con 0x5555fe921070 2024-08-31T06:21:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.927+0000 7f37e27fc640 1 -- 172.21.15.53:0/4291777063 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f37f400f040 con 0x5555fe921070 2024-08-31T06:21:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.927+0000 7f38079eb740 10 client.20577 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.927+0000 7f38079eb740 10 client.20577 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:21:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.927+0000 7f38079eb740 20 client.20577 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.927+0000 7f38079eb740 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5555fe8df9f0 0x5555fece4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.927+0000 7f38079eb740 4 client.20577 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.927+0000 7f38079eb740 1 -- 172.21.15.53:0/4291777063 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555fec3b070 con 0x5555fe8df9f0 2024-08-31T06:21:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.929+0000 7f37faffd640 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5555fe8df9f0 0x5555fece4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.936+0000 7f37e27fc640 10 client.20577 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:21:05.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.936+0000 7f37faffd640 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5555fe8df9f0 0x5555fece4200 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=91853ec13fa3893f server_cookie=49918afa3e316c53 in_seq=0 out_seq=0 2024-08-31T06:21:05.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.937+0000 7f37e27fc640 1 -- 172.21.15.53:0/4291777063 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5555fec3b070 con 0x5555fe8df9f0 2024-08-31T06:21:05.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.937+0000 7f37e27fc640 10 client.20577 handle_command_reply: tid=0 2024-08-31T06:21:05.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.938+0000 7f38079eb740 1 client.20577 shutdown 2024-08-31T06:21:05.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.938+0000 7f38079eb740 1 -- 172.21.15.53:0/4291777063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe921070 msgr2=0x5555fecddd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.938+0000 7f38079eb740 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe921070 0x5555fecddd80 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009fd0 tx=0x7f37f4004a40 comp rx=0 tx=0).stop 2024-08-31T06:21:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.939+0000 7f38079eb740 1 -- 172.21.15.53:0/4291777063 shutdown_connections 2024-08-31T06:21:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.939+0000 7f38079eb740 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5555fe8df9f0 0x5555fece4200 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.939+0000 7f38079eb740 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe921070 0x5555fecddd80 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.939+0000 7f38079eb740 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecd1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.939+0000 7f38079eb740 1 --2- 172.21.15.53:0/4291777063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 0x5555fecd1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.939+0000 7f38079eb740 1 -- 172.21.15.53:0/4291777063 >> 172.21.15.53:0/4291777063 conn(0x5555fe915460 msgr2=0x5555fecc94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:05.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.939+0000 7f37e27fc640 0 client.20577 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:21:05.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.940+0000 7f38079eb740 1 -- 172.21.15.53:0/4291777063 shutdown_connections 2024-08-31T06:21:05.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.940+0000 7f38079eb740 1 -- 172.21.15.53:0/4291777063 wait complete. 2024-08-31T06:21:05.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.940+0000 7f38079eb740 20 client.20577 trim_cache size 0 max 16384 2024-08-31T06:21:05.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.966+0000 7f38079eb740 1 Processor -- start 2024-08-31T06:21:05.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.966+0000 7f38079eb740 1 -- start start 2024-08-31T06:21:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.967+0000 7f38079eb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecbf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.967+0000 7f38079eb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecc9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.967+0000 7f38079eb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe921070 0x5555fecc9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.967+0000 7f38079eb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc1b15d0 con 0x5555fe8f81b0 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.967+0000 7f38079eb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc1b3290 con 0x5555fe921070 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.967+0000 7f38079eb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc1b1ca0 con 0x5555fe900390 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.967+0000 7f37faffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecbf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.967+0000 7f37faffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecbf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36878/0 (socket says 172.21.15.53:36878) 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.967+0000 7f37faffd640 1 -- 172.21.15.53:0/355859247 learned_addr learned my addr 172.21.15.53:0/355859247 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.967+0000 7f37fa7fc640 1 --2- 172.21.15.53:0/355859247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecc9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.967+0000 7f37fb7fe640 1 --2- 172.21.15.53:0/355859247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe921070 0x5555fecc9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.968+0000 7f37fa7fc640 1 -- 172.21.15.53:0/355859247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe921070 msgr2=0x5555fecc9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.968+0000 7f37fa7fc640 1 --2- 172.21.15.53:0/355859247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe921070 0x5555fecc9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.968+0000 7f37fa7fc640 1 -- 172.21.15.53:0/355859247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 msgr2=0x5555fecbf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.968+0000 7f37fa7fc640 1 --2- 172.21.15.53:0/355859247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecbf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.968+0000 7f37fa7fc640 1 -- 172.21.15.53:0/355859247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555fecc8600 con 0x5555fe900390 2024-08-31T06:21:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.968+0000 7f37faffd640 1 --2- 172.21.15.53:0/355859247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecbf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.968+0000 7f37fa7fc640 1 --2- 172.21.15.53:0/355859247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecc9410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f37e40a78c0 tx=0x7f37e40e8c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8371dc34c29ad70c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.968+0000 7f37f0ff9640 1 -- 172.21.15.53:0/355859247 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e40ab190 con 0x5555fe900390 2024-08-31T06:21:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.968+0000 7f37f0ff9640 1 -- 172.21.15.53:0/355859247 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37e40ab350 con 0x5555fe900390 2024-08-31T06:21:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.968+0000 7f37f0ff9640 1 -- 172.21.15.53:0/355859247 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e40aafb0 con 0x5555fe900390 2024-08-31T06:21:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.970+0000 7f38079eb740 1 -- 172.21.15.53:0/355859247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 msgr2=0x5555fecc9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.970+0000 7f38079eb740 1 --2- 172.21.15.53:0/355859247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecc9410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f37e40a78c0 tx=0x7f37e40e8c80 comp rx=0 tx=0).stop 2024-08-31T06:21:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.970+0000 7f38079eb740 1 -- 172.21.15.53:0/355859247 shutdown_connections 2024-08-31T06:21:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.970+0000 7f38079eb740 1 --2- 172.21.15.53:0/355859247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe921070 0x5555fecc9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.970+0000 7f38079eb740 1 --2- 172.21.15.53:0/355859247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe900390 0x5555fecc9410 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.970+0000 7f38079eb740 1 --2- 172.21.15.53:0/355859247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe8f81b0 0x5555fecbf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.970+0000 7f38079eb740 1 -- 172.21.15.53:0/355859247 >> 172.21.15.53:0/355859247 conn(0x5555fe915460 msgr2=0x5555fecd0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.970+0000 7f38079eb740 1 -- 172.21.15.53:0/355859247 shutdown_connections 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.970+0000 7f38079eb740 1 -- 172.21.15.53:0/355859247 wait complete. 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f38079eb740 1 -- start start 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f38079eb740 1 Processor -- start 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f38079eb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 0x5555fecda390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f38079eb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe900390 0x5555fecd5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f38079eb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe921070 0x5555fecd5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f38079eb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc1b2bc0 con 0x5555fe900390 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f38079eb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc1b2430 con 0x5555fe8f81b0 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f37faffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 0x5555fecda390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f38079eb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc1af660 con 0x5555fe921070 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f37faffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 0x5555fecda390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54088/0 (socket says 172.21.15.53:54088) 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f37faffd640 1 -- 172.21.15.53:0/2593065677 learned_addr learned my addr 172.21.15.53:0/2593065677 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.971+0000 7f37fa7fc640 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe900390 0x5555fecd5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f37fb7fe640 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe921070 0x5555fecd5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f38079eb740 10 client.0 _ll_register_callbacks cb 0x7f37f4009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f37faffd640 1 -- 172.21.15.53:0/2593065677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe921070 msgr2=0x5555fecd5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f37faffd640 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe921070 0x5555fecd5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f37faffd640 1 -- 172.21.15.53:0/2593065677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe900390 msgr2=0x5555fecd5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f37faffd640 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe900390 0x5555fecd5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f37faffd640 1 -- 172.21.15.53:0/2593065677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555fecd63f0 con 0x5555fe8f81b0 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f37faffd640 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 0x5555fecda390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37ec02a930 tx=0x7f37ec009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=323e976b0d943cc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f37e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f37e27fc640 1 -- 172.21.15.53:0/2593065677 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec03f040 con 0x5555fe8f81b0 2024-08-31T06:21:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f38079eb740 1 -- 172.21.15.53:0/2593065677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37e40ab350 con 0x5555fe8f81b0 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f37e27fc640 1 -- 172.21.15.53:0/2593065677 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7f37ec031a70 con 0x5555fe8f81b0 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.972+0000 7f37e27fc640 1 -- 172.21.15.53:0/2593065677 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f37ec035040 con 0x5555fe8f81b0 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.973+0000 7f38079eb740 10 client.29501 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.973+0000 7f38079eb740 1 -- 172.21.15.53:0/2593065677 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5555fed4ea50 con 0x5555fe8f81b0 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.973+0000 7f37e27fc640 1 -- 172.21.15.53:0/2593065677 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37e40ab350 con 0x5555fe8f81b0 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.973+0000 7f37e27fc640 1 -- 172.21.15.53:0/2593065677 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f37ec04d9d0 con 0x5555fe8f81b0 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.973+0000 7f38079eb740 10 client.29501 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.973+0000 7f38079eb740 10 client.29501 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.973+0000 7f38079eb740 20 client.29501 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.973+0000 7f38079eb740 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5555fe8b4da0 0x5555fed50da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.973+0000 7f38079eb740 4 client.29501 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.973+0000 7f38079eb740 1 -- 172.21.15.53:0/2593065677 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5555fec387b0 con 0x5555fe8b4da0 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.973+0000 7f37fa7fc640 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5555fe8b4da0 0x5555fed50da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f37e27fc640 10 client.29501 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f37fa7fc640 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5555fe8b4da0 0x5555fed50da0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cc93ade7b4b11dc0 server_cookie=97b09cf9396373c3 in_seq=0 out_seq=0 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f37e27fc640 1 -- 172.21.15.53:0/2593065677 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5555fec387b0 con 0x5555fe8b4da0 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f37e27fc640 10 client.29501 handle_command_reply: tid=0 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 1 client.29501 shutdown 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 1 -- 172.21.15.53:0/2593065677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 msgr2=0x5555fecda390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 0x5555fecda390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37ec02a930 tx=0x7f37ec009560 comp rx=0 tx=0).stop 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 1 -- 172.21.15.53:0/2593065677 shutdown_connections 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5555fe921070 0x5555fecd5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5555fe8b4da0 0x5555fed50da0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555fe900390 0x5555fecd5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 1 --2- 172.21.15.53:0/2593065677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5555fe8f81b0 0x5555fecda390 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 1 -- 172.21.15.53:0/2593065677 >> 172.21.15.53:0/2593065677 conn(0x5555fe915460 msgr2=0x5555fecc9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f37e27fc640 0 client.29501 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:21:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 1 -- 172.21.15.53:0/2593065677 shutdown_connections 2024-08-31T06:21:05.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 1 -- 172.21.15.53:0/2593065677 wait complete. 2024-08-31T06:21:05.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.974+0000 7f38079eb740 20 client.29501 trim_cache size 0 max 16384 2024-08-31T06:21:05.982 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:21:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 -- 172.21.15.53:0/608181803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37e80b4cd0 msgr2=0x7f37e80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37e80b4cd0 0x7f37e80b71e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009370 tx=0x7f37f4009720 comp rx=0 tx=0).stop 2024-08-31T06:21:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 -- 172.21.15.53:0/608181803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc108140 msgr2=0x7f37fc19b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc108140 0x7f37fc19b530 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f37e400c970 tx=0x7f37e400ce30 comp rx=0 tx=0).stop 2024-08-31T06:21:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 -- 172.21.15.53:0/608181803 shutdown_connections 2024-08-31T06:21:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37e80b4cd0 0x7f37e80b71e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37fc108a90 0x7f37fc19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37fc108140 0x7f37fc19b530 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 --2- 172.21.15.53:0/608181803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37fc102800 0x7f37fc19aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:05.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 -- 172.21.15.53:0/608181803 >> 172.21.15.53:0/608181803 conn(0x7f37fc0794d0 msgr2=0x7f37fc1013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:05.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 -- 172.21.15.53:0/608181803 shutdown_connections 2024-08-31T06:21:05.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:05.975+0000 7f3801476640 1 -- 172.21.15.53:0/608181803 wait complete. 2024-08-31T06:21:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:05 smithi053 ceph-mon[18924]: pgmap v827: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 161 KiB/s wr, 36 op/s 2024-08-31T06:21:06.244 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:06.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.06 MB/sec execute 54 sec latency 21557.110 ms 2024-08-31T06:21:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:05 smithi130 ceph-mon[22266]: pgmap v827: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 161 KiB/s wr, 36 op/s 2024-08-31T06:21:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:05 smithi153 ceph-mon[22320]: pgmap v827: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 161 KiB/s wr, 36 op/s 2024-08-31T06:21:06.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:21:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:06 smithi053 ceph-mon[18924]: osdmap e95: 12 total, 12 up, 12 in 2024-08-31T06:21:07.280 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:06 smithi130 ceph-mon[22266]: osdmap e95: 12 total, 12 up, 12 in 2024-08-31T06:21:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.301+0000 7f827cda0640 1 -- 172.21.15.53:0/1007324718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8278107f60 msgr2=0x7f8278108370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.301+0000 7f827cda0640 1 --2- 172.21.15.53:0/1007324718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8278107f60 0x7f8278108370 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f826c009900 tx=0x7f826c02a410 comp rx=0 tx=0).stop 2024-08-31T06:21:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.301+0000 7f827cda0640 1 -- 172.21.15.53:0/1007324718 shutdown_connections 2024-08-31T06:21:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.301+0000 7f827cda0640 1 --2- 172.21.15.53:0/1007324718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82781088b0 0x7f827810f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.301+0000 7f827cda0640 1 --2- 172.21.15.53:0/1007324718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8278107f60 0x7f8278108370 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.301+0000 7f827cda0640 1 --2- 172.21.15.53:0/1007324718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8278102620 0x7f8278102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.301+0000 7f827cda0640 1 -- 172.21.15.53:0/1007324718 >> 172.21.15.53:0/1007324718 conn(0x7f82780fe070 msgr2=0x7f82781004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.301+0000 7f827cda0640 1 -- 172.21.15.53:0/1007324718 shutdown_connections 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.301+0000 7f827cda0640 1 -- 172.21.15.53:0/1007324718 wait complete. 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.302+0000 7f827cda0640 1 Processor -- start 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.302+0000 7f827cda0640 1 -- start start 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.302+0000 7f827cda0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8278102620 0x7f8278198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.302+0000 7f827cda0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8278107f60 0x7f8278199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.302+0000 7f827cda0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82781088b0 0x7f827819e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.302+0000 7f827cda0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f82781123f0 con 0x7f82781088b0 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.302+0000 7f827cda0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8278112270 con 0x7f8278107f60 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.302+0000 7f827cda0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8278112570 con 0x7f8278102620 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8277fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82781088b0 0x7f827819e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8277fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82781088b0 0x7f827819e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36906/0 (socket says 172.21.15.53:36906) 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8277fff640 1 -- 172.21.15.53:0/3177004003 learned_addr learned my addr 172.21.15.53:0/3177004003 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f82777fe640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8278102620 0x7f8278198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8276ffd640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8278107f60 0x7f8278199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8277fff640 1 -- 172.21.15.53:0/3177004003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8278102620 msgr2=0x7f8278198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8277fff640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8278102620 0x7f8278198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8277fff640 1 -- 172.21.15.53:0/3177004003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8278107f60 msgr2=0x7f8278199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8277fff640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8278107f60 0x7f8278199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8277fff640 1 -- 172.21.15.53:0/3177004003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827819ee50 con 0x7f82781088b0 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8276ffd640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8278107f60 0x7f8278199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8277fff640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82781088b0 0x7f827819e720 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f827000cad0 tx=0x7f827000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8274ff9640 1 -- 172.21.15.53:0/3177004003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827000ae20 con 0x7f82781088b0 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f827cda0640 1 -- 172.21.15.53:0/3177004003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827819f140 con 0x7f82781088b0 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8274ff9640 1 -- 172.21.15.53:0/3177004003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8270005020 con 0x7f82781088b0 2024-08-31T06:21:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f8274ff9640 1 -- 172.21.15.53:0/3177004003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827000f6b0 con 0x7f82781088b0 2024-08-31T06:21:07.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.303+0000 7f827cda0640 1 -- 172.21.15.53:0/3177004003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827806b700 con 0x7f82781088b0 2024-08-31T06:21:07.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.306+0000 7f8274ff9640 1 -- 172.21.15.53:0/3177004003 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f82700051d0 con 0x7f82781088b0 2024-08-31T06:21:07.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.307+0000 7f8274ff9640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82600b4ca0 0x7f82600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.307+0000 7f8274ff9640 1 -- 172.21.15.53:0/3177004003 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7f82700e5950 con 0x7f82781088b0 2024-08-31T06:21:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.307+0000 7f82777fe640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82600b4ca0 0x7f82600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.307+0000 7f8284577740 1 Processor -- start 2024-08-31T06:21:07.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f8284577740 1 -- start start 2024-08-31T06:21:07.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f82777fe640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82600b4ca0 0x7f82600b71b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8268005fd0 tx=0x7f826800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:07.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f8284577740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4ade70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f8284577740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0df660 0x56378f4ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f8284577740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0e7840 0x56378f4ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f8284577740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56378f424a70 con 0x56378f108520 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f8284577740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56378f414000 con 0x56378f0e7840 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f8284577740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56378f417fb0 con 0x56378f0df660 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f82777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f82777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36910/0 (socket says 172.21.15.53:36910) 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f82777fe640 1 -- 172.21.15.53:0/1527442762 learned_addr learned my addr 172.21.15.53:0/1527442762 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f8276ffd640 1 --2- 172.21.15.53:0/1527442762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0df660 0x56378f4ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.308+0000 7f8277fff640 1 --2- 172.21.15.53:0/1527442762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0e7840 0x56378f4ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.309+0000 7f82777fe640 1 -- 172.21.15.53:0/1527442762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0df660 msgr2=0x56378f4ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.309+0000 7f82777fe640 1 --2- 172.21.15.53:0/1527442762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0df660 0x56378f4ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.309+0000 7f82777fe640 1 -- 172.21.15.53:0/1527442762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0e7840 msgr2=0x56378f4ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.309+0000 7f82777fe640 1 --2- 172.21.15.53:0/1527442762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0e7840 0x56378f4ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.309+0000 7f82777fe640 1 -- 172.21.15.53:0/1527442762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56378f173b00 con 0x56378f108520 2024-08-31T06:21:07.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.309+0000 7f82777fe640 1 --2- 172.21.15.53:0/1527442762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4ade70 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f826800b620 tx=0x7f8268013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a959cc2be772439f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:07.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.309+0000 7f825dffb640 1 -- 172.21.15.53:0/1527442762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268003e90 con 0x56378f108520 2024-08-31T06:21:07.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.309+0000 7f825dffb640 1 -- 172.21.15.53:0/1527442762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82680054b0 con 0x56378f108520 2024-08-31T06:21:07.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.309+0000 7f825dffb640 1 -- 172.21.15.53:0/1527442762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826801e420 con 0x56378f108520 2024-08-31T06:21:07.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.310+0000 7f8284577740 1 -- 172.21.15.53:0/1527442762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 msgr2=0x56378f4ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:07.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.310+0000 7f8284577740 1 --2- 172.21.15.53:0/1527442762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4ade70 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f826800b620 tx=0x7f8268013000 comp rx=0 tx=0).stop 2024-08-31T06:21:07.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.310+0000 7f8284577740 1 -- 172.21.15.53:0/1527442762 shutdown_connections 2024-08-31T06:21:07.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.310+0000 7f8284577740 1 --2- 172.21.15.53:0/1527442762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0e7840 0x56378f4ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.310+0000 7f8284577740 1 --2- 172.21.15.53:0/1527442762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0df660 0x56378f4ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.310+0000 7f8284577740 1 --2- 172.21.15.53:0/1527442762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4ade70 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.310+0000 7f8284577740 1 -- 172.21.15.53:0/1527442762 >> 172.21.15.53:0/1527442762 conn(0x56378f0fc910 msgr2=0x56378f4abd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.310+0000 7f8284577740 1 -- 172.21.15.53:0/1527442762 shutdown_connections 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.310+0000 7f8284577740 1 -- 172.21.15.53:0/1527442762 wait complete. 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.311+0000 7f8284577740 1 -- start start 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.311+0000 7f8284577740 1 Processor -- start 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.311+0000 7f8284577740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0df660 0x56378f4b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.311+0000 7f8284577740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0e7840 0x56378f4b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.311+0000 7f8284577740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f108520 0x56378f4ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.311+0000 7f8284577740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56378f4c4de0 con 0x56378f0df660 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.311+0000 7f8284577740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56378f3d5520 con 0x56378f0e7840 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.311+0000 7f8284577740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56378f4c4f60 con 0x56378f108520 2024-08-31T06:21:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.311+0000 7f8284577740 10 client.0 _ll_register_callbacks cb 0x56378f40dc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.311+0000 7f82777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0df660 0x56378f4b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.311+0000 7f82777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0df660 0x56378f4b5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36920/0 (socket says 172.21.15.53:36920) 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f82777fe640 1 -- 172.21.15.53:0/1727158416 learned_addr learned my addr 172.21.15.53:0/1727158416 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f8277fff640 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f108520 0x56378f4ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f82777fe640 1 -- 172.21.15.53:0/1727158416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f108520 msgr2=0x56378f4ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f82777fe640 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f108520 0x56378f4ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f82777fe640 1 -- 172.21.15.53:0/1727158416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0e7840 msgr2=0x56378f4b5f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f82777fe640 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0e7840 0x56378f4b5f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f82777fe640 1 -- 172.21.15.53:0/1727158416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56378f1ea960 con 0x56378f0df660 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f82777fe640 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0df660 0x56378f4b5a10 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f8268003ff0 tx=0x7f826800b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43d1bd05ee881d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f8256ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f8256ffd640 1 -- 172.21.15.53:0/1727158416 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268036060 con 0x56378f0df660 2024-08-31T06:21:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f8256ffd640 1 -- 172.21.15.53:0/1727158416 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7f8268004fe0 con 0x56378f0df660 2024-08-31T06:21:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.312+0000 7f8284577740 1 -- 172.21.15.53:0/1727158416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56378f3b39a0 con 0x56378f0df660 2024-08-31T06:21:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.313+0000 7f8256ffd640 1 -- 172.21.15.53:0/1727158416 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f82680048d0 con 0x56378f0df660 2024-08-31T06:21:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.313+0000 7f8284577740 10 client.20595 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.313+0000 7f8284577740 1 -- 172.21.15.53:0/1727158416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x56378f4d0f00 con 0x56378f0df660 2024-08-31T06:21:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.313+0000 7f8256ffd640 1 -- 172.21.15.53:0/1727158416 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56378f3b39a0 con 0x56378f0df660 2024-08-31T06:21:07.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.313+0000 7f8256ffd640 1 -- 172.21.15.53:0/1727158416 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f826801e9d0 con 0x56378f0df660 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.313+0000 7f8284577740 10 client.20595 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.313+0000 7f8284577740 10 client.20595 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.313+0000 7f8284577740 20 client.20595 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.313+0000 7f8284577740 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56378f0c6ea0 0x56378f4d42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.313+0000 7f8284577740 4 client.20595 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.313+0000 7f8284577740 1 -- 172.21.15.53:0/1727158416 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56378f4269c0 con 0x56378f0c6ea0 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.314+0000 7f8276ffd640 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56378f0c6ea0 0x56378f4d42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.314+0000 7f8256ffd640 10 client.20595 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.314+0000 7f8276ffd640 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56378f0c6ea0 0x56378f4d42c0 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14da05ed980e9631 server_cookie=61169b5a2209a1d9 in_seq=0 out_seq=0 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.315+0000 7f8256ffd640 1 -- 172.21.15.53:0/1727158416 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56378f4269c0 con 0x56378f0c6ea0 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.315+0000 7f8256ffd640 10 client.20595 handle_command_reply: tid=0 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.315+0000 7f8284577740 1 client.20595 shutdown 2024-08-31T06:21:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8284577740 1 -- 172.21.15.53:0/1727158416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0df660 msgr2=0x56378f4b5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8284577740 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0df660 0x56378f4b5a10 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f8268003ff0 tx=0x7f826800b4c0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8284577740 1 -- 172.21.15.53:0/1727158416 shutdown_connections 2024-08-31T06:21:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8284577740 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56378f0c6ea0 0x56378f4d42c0 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8284577740 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f108520 0x56378f4ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8284577740 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0e7840 0x56378f4b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8284577740 1 --2- 172.21.15.53:0/1727158416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0df660 0x56378f4b5a10 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8284577740 1 -- 172.21.15.53:0/1727158416 >> 172.21.15.53:0/1727158416 conn(0x56378f0fc910 msgr2=0x56378f4aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8256ffd640 0 client.20595 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8284577740 1 -- 172.21.15.53:0/1727158416 shutdown_connections 2024-08-31T06:21:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8284577740 1 -- 172.21.15.53:0/1727158416 wait complete. 2024-08-31T06:21:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.316+0000 7f8284577740 20 client.20595 trim_cache size 0 max 16384 2024-08-31T06:21:07.327 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:06 smithi153 ceph-mon[22320]: osdmap e95: 12 total, 12 up, 12 in 2024-08-31T06:21:07.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.344+0000 7f8284577740 1 Processor -- start 2024-08-31T06:21:07.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.344+0000 7f8284577740 1 -- start start 2024-08-31T06:21:07.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.344+0000 7f8284577740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0df660 0x56378f4ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.344+0000 7f8284577740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0e7840 0x56378f4b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.344+0000 7f8284577740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.344+0000 7f8284577740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f82781ad260 con 0x56378f108520 2024-08-31T06:21:07.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.344+0000 7f8284577740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82781aef20 con 0x56378f0df660 2024-08-31T06:21:07.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.344+0000 7f8284577740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82781ad930 con 0x56378f0e7840 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f8277fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f8277fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36936/0 (socket says 172.21.15.53:36936) 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f8277fff640 1 -- 172.21.15.53:0/3711389778 learned_addr learned my addr 172.21.15.53:0/3711389778 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f82777fe640 1 --2- 172.21.15.53:0/3711389778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0df660 0x56378f4ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f8276ffd640 1 --2- 172.21.15.53:0/3711389778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0e7840 0x56378f4b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f8277fff640 1 -- 172.21.15.53:0/3711389778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0e7840 msgr2=0x56378f4b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f8277fff640 1 --2- 172.21.15.53:0/3711389778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0e7840 0x56378f4b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f8277fff640 1 -- 172.21.15.53:0/3711389778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0df660 msgr2=0x56378f4ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f8277fff640 1 --2- 172.21.15.53:0/3711389778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0df660 0x56378f4ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f8277fff640 1 -- 172.21.15.53:0/3711389778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56378f4b0790 con 0x56378f108520 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f8276ffd640 1 --2- 172.21.15.53:0/3711389778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0e7840 0x56378f4b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f82777fe640 1 --2- 172.21.15.53:0/3711389778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0df660 0x56378f4ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:07.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f8277fff640 1 --2- 172.21.15.53:0/3711389778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4b45d0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f82700a8070 tx=0x7f82700ac740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550df25139091de7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:07.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.345+0000 7f825d7fa640 1 -- 172.21.15.53:0/3711389778 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827001d040 con 0x56378f108520 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.346+0000 7f825d7fa640 1 -- 172.21.15.53:0/3711389778 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82700b5310 con 0x56378f108520 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.346+0000 7f825d7fa640 1 -- 172.21.15.53:0/3711389778 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82700ac250 con 0x56378f108520 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.347+0000 7f8284577740 1 -- 172.21.15.53:0/3711389778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 msgr2=0x56378f4b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.347+0000 7f8284577740 1 --2- 172.21.15.53:0/3711389778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4b45d0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f82700a8070 tx=0x7f82700ac740 comp rx=0 tx=0).stop 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.347+0000 7f8284577740 1 -- 172.21.15.53:0/3711389778 shutdown_connections 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.347+0000 7f8284577740 1 --2- 172.21.15.53:0/3711389778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f108520 0x56378f4b45d0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.347+0000 7f8284577740 1 --2- 172.21.15.53:0/3711389778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0e7840 0x56378f4b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.347+0000 7f8284577740 1 --2- 172.21.15.53:0/3711389778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f0df660 0x56378f4ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.347+0000 7f8284577740 1 -- 172.21.15.53:0/3711389778 >> 172.21.15.53:0/3711389778 conn(0x56378f0fc910 msgr2=0x56378f4c2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.347+0000 7f8284577740 1 -- 172.21.15.53:0/3711389778 shutdown_connections 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.347+0000 7f8284577740 1 -- 172.21.15.53:0/3711389778 wait complete. 2024-08-31T06:21:07.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.347+0000 7f8284577740 1 -- start start 2024-08-31T06:21:07.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.348+0000 7f8284577740 1 Processor -- start 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.348+0000 7f8284577740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0df660 0x56378f4ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.348+0000 7f8284577740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0e7840 0x56378f4caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f8284577740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f108520 0x56378f4c5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f8284577740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f82781ae850 con 0x56378f0e7840 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f8284577740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82781ae0c0 con 0x56378f108520 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f8284577740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82781ab260 con 0x56378f0df660 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f8276ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0e7840 0x56378f4caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f8276ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0e7840 0x56378f4caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36948/0 (socket says 172.21.15.53:36948) 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f8276ffd640 1 -- 172.21.15.53:0/1568150284 learned_addr learned my addr 172.21.15.53:0/1568150284 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f82777fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0df660 0x56378f4ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f8284577740 10 client.0 _ll_register_callbacks cb 0x7f82700a7eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f8277fff640 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f108520 0x56378f4c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f82777fe640 1 -- 172.21.15.53:0/1568150284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f108520 msgr2=0x56378f4c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f82777fe640 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f108520 0x56378f4c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f82777fe640 1 -- 172.21.15.53:0/1568150284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0e7840 msgr2=0x56378f4caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f82777fe640 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0e7840 0x56378f4caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f82777fe640 1 -- 172.21.15.53:0/1568150284 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56378f4ac2a0 con 0x56378f0df660 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f82777fe640 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0df660 0x56378f4ca520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f826801ed70 tx=0x7f8268032b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5e2b80477b63626 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.349+0000 7f8256ffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.350+0000 7f8256ffd640 1 -- 172.21.15.53:0/1568150284 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268036040 con 0x56378f0df660 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.350+0000 7f8284577740 1 -- 172.21.15.53:0/1568150284 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82700b5310 con 0x56378f0df660 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.350+0000 7f8256ffd640 1 -- 172.21.15.53:0/1568150284 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7f826801e830 con 0x56378f0df660 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.350+0000 7f8256ffd640 1 -- 172.21.15.53:0/1568150284 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f8268003950 con 0x56378f0df660 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.350+0000 7f8284577740 10 client.29506 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.350+0000 7f8284577740 1 -- 172.21.15.53:0/1568150284 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x56378f4b0390 con 0x56378f0df660 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.350+0000 7f8256ffd640 1 -- 172.21.15.53:0/1568150284 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82700b5310 con 0x56378f0df660 2024-08-31T06:21:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.350+0000 7f8256ffd640 1 -- 172.21.15.53:0/1568150284 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f8268005150 con 0x56378f0df660 2024-08-31T06:21:07.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.350+0000 7f8284577740 10 client.29506 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:07.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.350+0000 7f8284577740 10 client.29506 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:21:07.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.351+0000 7f8284577740 20 client.29506 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:07.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.351+0000 7f8284577740 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56378f09c250 0x56378f541990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:07.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.351+0000 7f8284577740 4 client.29506 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b1859690", "release": true, "await": true}] 2024-08-31T06:21:07.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.351+0000 7f8284577740 1 -- 172.21.15.53:0/1568150284 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b1859690", "release": true, "await": true}) -- 0x56378f422460 con 0x56378f09c250 2024-08-31T06:21:07.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.351+0000 7f8276ffd640 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56378f09c250 0x56378f541990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:07.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.351+0000 7f8256ffd640 10 client.29506 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:07.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.351+0000 7f8276ffd640 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56378f09c250 0x56378f541990 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63861d1565a7d566 server_cookie=eda02b882696f331 in_seq=0 out_seq=0 2024-08-31T06:21:07.357 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:07.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17369 3.01 MB/sec execute 55 sec latency 22557.136 ms 2024-08-31T06:21:07.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8256ffd640 1 -- 172.21.15.53:0/1568150284 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56378f422460 con 0x56378f09c250 2024-08-31T06:21:07.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8256ffd640 10 client.29506 handle_command_reply: tid=0 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 1 client.29506 shutdown 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 1 -- 172.21.15.53:0/1568150284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0df660 msgr2=0x56378f4ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0df660 0x56378f4ca520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f826801ed70 tx=0x7f8268032b40 comp rx=0 tx=0).stop 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 1 -- 172.21.15.53:0/1568150284 shutdown_connections 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56378f09c250 0x56378f541990 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56378f108520 0x56378f4c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56378f0e7840 0x56378f4caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 1 --2- 172.21.15.53:0/1568150284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56378f0df660 0x56378f4ca520 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 1 -- 172.21.15.53:0/1568150284 >> 172.21.15.53:0/1568150284 conn(0x56378f0fc910 msgr2=0x56378f4aa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8256ffd640 0 client.29506 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 1 -- 172.21.15.53:0/1568150284 shutdown_connections 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 1 -- 172.21.15.53:0/1568150284 wait complete. 2024-08-31T06:21:07.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.393+0000 7f8284577740 20 client.29506 trim_cache size 0 max 16384 2024-08-31T06:21:07.397 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:21:07.397 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 60, 2024-08-31T06:21:07.397 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:21:07.397 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 56, 2024-08-31T06:21:07.397 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:21:07.397 INFO:teuthology.orchestra.run.smithi053.stdout: "b1859690": { 2024-08-31T06:21:07.397 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 56, 2024-08-31T06:21:07.397 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:21:07.397 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 141.2, 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:21:07.398 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:21:07.399 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:21:07.399 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:21:07.399 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:21:07.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 -- 172.21.15.53:0/3177004003 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82600b4ca0 msgr2=0x7f82600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:07.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82600b4ca0 0x7f82600b71b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8268005fd0 tx=0x7f826800b390 comp rx=0 tx=0).stop 2024-08-31T06:21:07.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 -- 172.21.15.53:0/3177004003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82781088b0 msgr2=0x7f827819e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82781088b0 0x7f827819e720 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f827000cad0 tx=0x7f827000cf90 comp rx=0 tx=0).stop 2024-08-31T06:21:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 -- 172.21.15.53:0/3177004003 shutdown_connections 2024-08-31T06:21:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82600b4ca0 0x7f82600b71b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82781088b0 0x7f827819e720 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8278107f60 0x7f8278199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 --2- 172.21.15.53:0/3177004003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8278102620 0x7f8278198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 -- 172.21.15.53:0/3177004003 >> 172.21.15.53:0/3177004003 conn(0x7f82780fe070 msgr2=0x7f8278100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 -- 172.21.15.53:0/3177004003 shutdown_connections 2024-08-31T06:21:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:07.394+0000 7f827cda0640 1 -- 172.21.15.53:0/3177004003 wait complete. 2024-08-31T06:21:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.143+0000 7fa6d71cd640 1 -- 172.21.15.53:0/52054036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6d010dbf0 msgr2=0x7fa6d01100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.143+0000 7fa6d71cd640 1 --2- 172.21.15.53:0/52054036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6d010dbf0 0x7fa6d01100e0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009ca0 tx=0x7fa6c802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.144+0000 7fa6d71cd640 1 -- 172.21.15.53:0/52054036 shutdown_connections 2024-08-31T06:21:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.144+0000 7fa6d71cd640 1 --2- 172.21.15.53:0/52054036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6d010dbf0 0x7fa6d01100e0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.144+0000 7fa6d71cd640 1 --2- 172.21.15.53:0/52054036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6d01050e0 0x7fa6d010d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.144+0000 7fa6d71cd640 1 --2- 172.21.15.53:0/52054036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6d0104790 0x7fa6d0104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.144+0000 7fa6d71cd640 1 -- 172.21.15.53:0/52054036 >> 172.21.15.53:0/52054036 conn(0x7fa6d00794f0 msgr2=0x7fa6d0079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.144+0000 7fa6d71cd640 1 -- 172.21.15.53:0/52054036 shutdown_connections 2024-08-31T06:21:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.144+0000 7fa6d71cd640 1 -- 172.21.15.53:0/52054036 wait complete. 2024-08-31T06:21:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.145+0000 7fa6d71cd640 1 Processor -- start 2024-08-31T06:21:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.145+0000 7fa6d71cd640 1 -- start start 2024-08-31T06:21:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.145+0000 7fa6d71cd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6d0104790 0x7fa6d019c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.145+0000 7fa6d71cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6d01050e0 0x7fa6d019c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.145+0000 7fa6d71cd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6d010dbf0 0x7fa6d01a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.145+0000 7fa6d71cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0113770 con 0x7fa6d01050e0 2024-08-31T06:21:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.145+0000 7fa6d71cd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01135f0 con 0x7fa6d010dbf0 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.145+0000 7fa6d71cd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01138f0 con 0x7fa6d0104790 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.146+0000 7fa6cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6d01050e0 0x7fa6d019c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.146+0000 7fa6d4f69640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6d0104790 0x7fa6d019c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.146+0000 7fa6cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6d01050e0 0x7fa6d019c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36962/0 (socket says 172.21.15.53:36962) 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.146+0000 7fa6cffff640 1 -- 172.21.15.53:0/235578809 learned_addr learned my addr 172.21.15.53:0/235578809 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.146+0000 7fa6d576a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6d010dbf0 0x7fa6d01a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.146+0000 7fa6cffff640 1 -- 172.21.15.53:0/235578809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6d0104790 msgr2=0x7fa6d019c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.146+0000 7fa6cffff640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6d0104790 0x7fa6d019c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.146+0000 7fa6cffff640 1 -- 172.21.15.53:0/235578809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6d010dbf0 msgr2=0x7fa6d01a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.146+0000 7fa6cffff640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6d010dbf0 0x7fa6d01a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.146+0000 7fa6cffff640 1 -- 172.21.15.53:0/235578809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d01a2290 con 0x7fa6d01050e0 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.146+0000 7fa6cffff640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6d01050e0 0x7fa6d019c8c0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00e9c0 tx=0x7fa6bc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.147+0000 7fa6cdffb640 1 -- 172.21.15.53:0/235578809 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00ccc0 con 0x7fa6d01050e0 2024-08-31T06:21:08.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.147+0000 7fa6d71cd640 1 -- 172.21.15.53:0/235578809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d01a2580 con 0x7fa6d01050e0 2024-08-31T06:21:08.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.147+0000 7fa6cdffb640 1 -- 172.21.15.53:0/235578809 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6bc0054b0 con 0x7fa6d01050e0 2024-08-31T06:21:08.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.147+0000 7fa6cdffb640 1 -- 172.21.15.53:0/235578809 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc010430 con 0x7fa6d01050e0 2024-08-31T06:21:08.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.147+0000 7fa6d71cd640 1 -- 172.21.15.53:0/235578809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d01a8ce0 con 0x7fa6d01050e0 2024-08-31T06:21:08.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.150+0000 7fa6dd742740 1 Processor -- start 2024-08-31T06:21:08.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.151+0000 7fa6cdffb640 1 -- 172.21.15.53:0/235578809 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa6bc004f20 con 0x7fa6d01050e0 2024-08-31T06:21:08.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.151+0000 7fa6dd742740 1 -- start start 2024-08-31T06:21:08.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.152+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x56317649d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.152+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x56317649d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.152+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x56317649dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.152+0000 7fa6dd742740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563176414680 con 0x5631760f8070 2024-08-31T06:21:08.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.152+0000 7fa6dd742740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563176403c10 con 0x5631760d7390 2024-08-31T06:21:08.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.152+0000 7fa6dd742740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563176407bc0 con 0x5631760cf1b0 2024-08-31T06:21:08.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.152+0000 7fa6d576a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x56317649d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.152+0000 7fa6d576a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x56317649d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36970/0 (socket says 172.21.15.53:36970) 2024-08-31T06:21:08.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.152+0000 7fa6d576a640 1 -- 172.21.15.53:0/3563685872 learned_addr learned my addr 172.21.15.53:0/3563685872 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:08.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.152+0000 7fa6d4f69640 1 --2- 172.21.15.53:0/3563685872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x56317649d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.152+0000 7fa6cffff640 1 --2- 172.21.15.53:0/3563685872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x56317649dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.153+0000 7fa6d576a640 1 -- 172.21.15.53:0/3563685872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 msgr2=0x56317649d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:08.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.153+0000 7fa6d576a640 1 --2- 172.21.15.53:0/3563685872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x56317649d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.153+0000 7fa6d576a640 1 -- 172.21.15.53:0/3563685872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 msgr2=0x56317649dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:08.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.153+0000 7fa6d576a640 1 --2- 172.21.15.53:0/3563685872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x56317649dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.153+0000 7fa6d576a640 1 -- 172.21.15.53:0/3563685872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563176163650 con 0x5631760f8070 2024-08-31T06:21:08.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.153+0000 7fa6cdffb640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6c00b4ca0 0x7fa6c00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.153+0000 7fa6d4f69640 1 --2- 172.21.15.53:0/3563685872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x56317649d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:08.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.153+0000 7fa6d4f69640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6c00b4ca0 0x7fa6c00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.154+0000 7fa6cdffb640 1 -- 172.21.15.53:0/235578809 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7fa6bc0e58e0 con 0x7fa6d01050e0 2024-08-31T06:21:08.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.154+0000 7fa6d576a640 1 --2- 172.21.15.53:0/3563685872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x56317649d310 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009ca0 tx=0x7fa6c8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55474d40235fea7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:08.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.154+0000 7fa6baffd640 1 -- 172.21.15.53:0/3563685872 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8031790 con 0x5631760f8070 2024-08-31T06:21:08.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.154+0000 7fa6baffd640 1 -- 172.21.15.53:0/3563685872 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c8036030 con 0x5631760f8070 2024-08-31T06:21:08.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.154+0000 7fa6baffd640 1 -- 172.21.15.53:0/3563685872 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8004330 con 0x5631760f8070 2024-08-31T06:21:08.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.155+0000 7fa6dd742740 1 -- 172.21.15.53:0/3563685872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 msgr2=0x56317649d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:08.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.155+0000 7fa6dd742740 1 --2- 172.21.15.53:0/3563685872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x56317649d310 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009ca0 tx=0x7fa6c8009a20 comp rx=0 tx=0).stop 2024-08-31T06:21:08.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.155+0000 7fa6d4f69640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6c00b4ca0 0x7fa6c00b71b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x56317649bf90 tx=0x7fa6c4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:08.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.156+0000 7fa6dd742740 1 -- 172.21.15.53:0/3563685872 shutdown_connections 2024-08-31T06:21:08.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.156+0000 7fa6dd742740 1 --2- 172.21.15.53:0/3563685872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x56317649dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.156+0000 7fa6dd742740 1 --2- 172.21.15.53:0/3563685872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x56317649d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.156+0000 7fa6dd742740 1 --2- 172.21.15.53:0/3563685872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x56317649d310 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.156+0000 7fa6dd742740 1 -- 172.21.15.53:0/3563685872 >> 172.21.15.53:0/3563685872 conn(0x5631760ec460 msgr2=0x56317649b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:08.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.156+0000 7fa6dd742740 1 -- 172.21.15.53:0/3563685872 shutdown_connections 2024-08-31T06:21:08.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.156+0000 7fa6dd742740 1 -- 172.21.15.53:0/3563685872 wait complete. 2024-08-31T06:21:08.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.156+0000 7fa6dd742740 1 -- start start 2024-08-31T06:21:08.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6dd742740 1 Processor -- start 2024-08-31T06:21:08.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x5631764a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x5631764bd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6dd742740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563176266700 con 0x5631760f8070 2024-08-31T06:21:08.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6cffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x5631764a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6dd742740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56317638a750 con 0x5631760d7390 2024-08-31T06:21:08.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6d4f69640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6dd742740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5631764ab910 con 0x5631760cf1b0 2024-08-31T06:21:08.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6cffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x5631764a8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54154/0 (socket says 172.21.15.53:54154) 2024-08-31T06:21:08.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6cffff640 1 -- 172.21.15.53:0/1008469839 learned_addr learned my addr 172.21.15.53:0/1008469839 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6dd742740 10 client.0 _ll_register_callbacks cb 0x5631763b9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.157+0000 7fa6d576a640 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x5631764bd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6cffff640 1 -- 172.21.15.53:0/1008469839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 msgr2=0x5631764a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6cffff640 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764a8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6cffff640 1 -- 172.21.15.53:0/1008469839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 msgr2=0x5631764bd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6cffff640 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x5631764bd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6cffff640 1 -- 172.21.15.53:0/1008469839 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631763c3900 con 0x5631760d7390 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6cffff640 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x5631764a8fc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc004650 tx=0x7fa6bc0abe50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fddaa2364262ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6affff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6affff640 1 -- 172.21.15.53:0/1008469839 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0aba90 con 0x5631760d7390 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6dd742740 1 -- 172.21.15.53:0/1008469839 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6c8036030 con 0x5631760d7390 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6affff640 1 -- 172.21.15.53:0/1008469839 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7fa6bc0a8210 con 0x5631760d7390 2024-08-31T06:21:08.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6affff640 1 -- 172.21.15.53:0/1008469839 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fa6bc0ac680 con 0x5631760d7390 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6dd742740 10 client.29525 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.158+0000 7fa6dd742740 1 -- 172.21.15.53:0/1008469839 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5631764bff10 con 0x5631760d7390 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.159+0000 7fa6affff640 1 -- 172.21.15.53:0/1008469839 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c8036030 con 0x5631760d7390 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.159+0000 7fa6affff640 1 -- 172.21.15.53:0/1008469839 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fa6bc0b0400 con 0x5631760d7390 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.159+0000 7fa6dd742740 10 client.29525 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.159+0000 7fa6dd742740 10 client.29525 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.159+0000 7fa6dd742740 20 client.29525 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.159+0000 7fa6dd742740 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5631760b69f0 0x5631764c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.159+0000 7fa6dd742740 4 client.29525 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.159+0000 7fa6dd742740 1 -- 172.21.15.53:0/1008469839 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631764165d0 con 0x5631760b69f0 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.159+0000 7fa6d4f69640 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5631760b69f0 0x5631764c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.160+0000 7fa6affff640 10 client.29525 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:21:08.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.160+0000 7fa6d4f69640 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5631760b69f0 0x5631764c3440 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=98b2b3d515b062be server_cookie=59ecaf791c374876 in_seq=0 out_seq=0 2024-08-31T06:21:08.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6affff640 1 -- 172.21.15.53:0/1008469839 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631764165d0 con 0x5631760b69f0 2024-08-31T06:21:08.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6affff640 10 client.29525 handle_command_reply: tid=0 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 1 client.29525 shutdown 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 1 -- 172.21.15.53:0/1008469839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 msgr2=0x5631764a8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x5631764a8fc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc004650 tx=0x7fa6bc0abe50 comp rx=0 tx=0).stop 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 1 -- 172.21.15.53:0/1008469839 shutdown_connections 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5631760b69f0 0x5631764c3440 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x5631764bd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x5631764a8fc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 1 --2- 172.21.15.53:0/1008469839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764a8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 1 -- 172.21.15.53:0/1008469839 >> 172.21.15.53:0/1008469839 conn(0x5631760ec460 msgr2=0x5631764a04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6affff640 0 client.29525 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 1 -- 172.21.15.53:0/1008469839 shutdown_connections 2024-08-31T06:21:08.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 1 -- 172.21.15.53:0/1008469839 wait complete. 2024-08-31T06:21:08.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.161+0000 7fa6dd742740 20 client.29525 trim_cache size 0 max 16384 2024-08-31T06:21:08.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.184+0000 7fa6dd742740 1 Processor -- start 2024-08-31T06:21:08.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.184+0000 7fa6dd742740 1 -- start start 2024-08-31T06:21:08.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.184+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.184+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760d7390 0x5631764bd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.184+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760f8070 0x5631764a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.184+0000 7fa6dd742740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01ad2b0 con 0x5631760d7390 2024-08-31T06:21:08.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.184+0000 7fa6dd742740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01aef70 con 0x5631760f8070 2024-08-31T06:21:08.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6dd742740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01ad980 con 0x5631760cf1b0 2024-08-31T06:21:08.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6d576a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760f8070 0x5631764a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6d576a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760f8070 0x5631764a5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54164/0 (socket says 172.21.15.53:54164) 2024-08-31T06:21:08.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6d576a640 1 -- 172.21.15.53:0/2384474883 learned_addr learned my addr 172.21.15.53:0/2384474883 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:08.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6d4f69640 1 --2- 172.21.15.53:0/2384474883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6cffff640 1 --2- 172.21.15.53:0/2384474883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760d7390 0x5631764bd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6d576a640 1 -- 172.21.15.53:0/2384474883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 msgr2=0x5631764a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:08.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6d576a640 1 --2- 172.21.15.53:0/2384474883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6d576a640 1 -- 172.21.15.53:0/2384474883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760d7390 msgr2=0x5631764bd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:08.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6d576a640 1 --2- 172.21.15.53:0/2384474883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760d7390 0x5631764bd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6d576a640 1 -- 172.21.15.53:0/2384474883 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631764a9d40 con 0x5631760f8070 2024-08-31T06:21:08.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6d4f69640 1 --2- 172.21.15.53:0/2384474883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:08.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.185+0000 7fa6d576a640 1 --2- 172.21.15.53:0/2384474883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760f8070 0x5631764a5c70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8045000 tx=0x7fa6c802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cecc4264cd0844cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:08.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.186+0000 7fa6ba7fc640 1 -- 172.21.15.53:0/2384474883 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8031590 con 0x5631760f8070 2024-08-31T06:21:08.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.186+0000 7fa6ba7fc640 1 -- 172.21.15.53:0/2384474883 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c8036070 con 0x5631760f8070 2024-08-31T06:21:08.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.186+0000 7fa6ba7fc640 1 -- 172.21.15.53:0/2384474883 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8004040 con 0x5631760f8070 2024-08-31T06:21:08.189 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:07 smithi053 ceph-mon[18924]: pgmap v829: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 42 op/s 2024-08-31T06:21:08.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.187+0000 7fa6dd742740 1 -- 172.21.15.53:0/2384474883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760f8070 msgr2=0x5631764a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:08.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.187+0000 7fa6dd742740 1 --2- 172.21.15.53:0/2384474883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760f8070 0x5631764a5c70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8045000 tx=0x7fa6c802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.187+0000 7fa6dd742740 1 -- 172.21.15.53:0/2384474883 shutdown_connections 2024-08-31T06:21:08.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.187+0000 7fa6dd742740 1 --2- 172.21.15.53:0/2384474883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760f8070 0x5631764a5c70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.187+0000 7fa6dd742740 1 --2- 172.21.15.53:0/2384474883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760d7390 0x5631764bd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.187+0000 7fa6dd742740 1 --2- 172.21.15.53:0/2384474883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.187+0000 7fa6dd742740 1 -- 172.21.15.53:0/2384474883 >> 172.21.15.53:0/2384474883 conn(0x5631760ec460 msgr2=0x5631764a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:08.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.187+0000 7fa6dd742740 1 -- 172.21.15.53:0/2384474883 shutdown_connections 2024-08-31T06:21:08.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.187+0000 7fa6dd742740 1 -- 172.21.15.53:0/2384474883 wait complete. 2024-08-31T06:21:08.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.188+0000 7fa6dd742740 1 -- start start 2024-08-31T06:21:08.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.188+0000 7fa6dd742740 1 Processor -- start 2024-08-31T06:21:08.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x5631764b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6dd742740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x5631764b5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6dd742740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01ae8a0 con 0x5631760f8070 2024-08-31T06:21:08.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6dd742740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01ae110 con 0x5631760d7390 2024-08-31T06:21:08.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6dd742740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01ab2f0 con 0x5631760cf1b0 2024-08-31T06:21:08.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6dd742740 10 client.0 _ll_register_callbacks cb 0x7fa6bc004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6cffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x5631764b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6d4f69640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6d576a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x5631764b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6cffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x5631764b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54174/0 (socket says 172.21.15.53:54174) 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6d576a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x5631764b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37008/0 (socket says 172.21.15.53:37008) 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6cffff640 1 -- 172.21.15.53:0/4178878416 learned_addr learned my addr 172.21.15.53:0/4178878416 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6d576a640 1 -- 172.21.15.53:0/4178878416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 msgr2=0x5631764b9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6d576a640 1 --2- 172.21.15.53:0/4178878416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764b9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6d576a640 1 -- 172.21.15.53:0/4178878416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 msgr2=0x5631764b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.189+0000 7fa6d576a640 1 --2- 172.21.15.53:0/4178878416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x5631764b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.190+0000 7fa6d576a640 1 -- 172.21.15.53:0/4178878416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631764b6090 con 0x5631760f8070 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.190+0000 7fa6d576a640 1 --2- 172.21.15.53:0/4178878416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x5631764b5900 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8045000 tx=0x7fa6c80317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae34e55a6caa5b8b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.190+0000 7fa6affff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:08.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.190+0000 7fa6affff640 1 -- 172.21.15.53:0/4178878416 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8031b90 con 0x5631760f8070 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.190+0000 7fa6affff640 1 -- 172.21.15.53:0/4178878416 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7fa6c8031d30 con 0x5631760f8070 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.190+0000 7fa6dd742740 1 -- 172.21.15.53:0/4178878416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6c8036070 con 0x5631760f8070 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.190+0000 7fa6affff640 1 -- 172.21.15.53:0/4178878416 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fa6c80305c0 con 0x5631760f8070 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.190+0000 7fa6dd742740 10 client.20619 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.191+0000 7fa6dd742740 1 -- 172.21.15.53:0/4178878416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x56317652def0 con 0x5631760f8070 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.191+0000 7fa6affff640 1 -- 172.21.15.53:0/4178878416 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c8036070 con 0x5631760f8070 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.191+0000 7fa6affff640 1 -- 172.21.15.53:0/4178878416 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fa6c8043070 con 0x5631760f8070 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.191+0000 7fa6dd742740 10 client.20619 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.191+0000 7fa6dd742740 10 client.20619 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.191+0000 7fa6dd742740 20 client.20619 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.191+0000 7fa6dd742740 1 --2- 172.21.15.53:0/4178878416 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56317608bda0 0x563176530330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.191+0000 7fa6dd742740 4 client.20619 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:21:08.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.191+0000 7fa6dd742740 1 -- 172.21.15.53:0/4178878416 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563176412070 con 0x56317608bda0 2024-08-31T06:21:08.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.192+0000 7fa6d4f69640 1 --2- 172.21.15.53:0/4178878416 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56317608bda0 0x563176530330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:08.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.192+0000 7fa6affff640 10 client.20619 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:21:08.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.192+0000 7fa6d4f69640 1 --2- 172.21.15.53:0/4178878416 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56317608bda0 0x563176530330 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f4522d92ad22392 server_cookie=702e8ff44121757e in_seq=0 out_seq=0 2024-08-31T06:21:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.193+0000 7fa6affff640 1 -- 172.21.15.53:0/4178878416 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563176412070 con 0x56317608bda0 2024-08-31T06:21:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.193+0000 7fa6affff640 10 client.20619 handle_command_reply: tid=0 2024-08-31T06:21:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.193+0000 7fa6dd742740 1 client.20619 shutdown 2024-08-31T06:21:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.193+0000 7fa6dd742740 1 -- 172.21.15.53:0/4178878416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 msgr2=0x5631764b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.193+0000 7fa6dd742740 1 --2- 172.21.15.53:0/4178878416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x5631764b5900 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8045000 tx=0x7fa6c80317c0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.194+0000 7fa6dd742740 1 -- 172.21.15.53:0/4178878416 shutdown_connections 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.194+0000 7fa6dd742740 1 --2- 172.21.15.53:0/4178878416 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56317608bda0 0x563176530330 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.194+0000 7fa6affff640 0 client.20619 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.194+0000 7fa6dd742740 1 --2- 172.21.15.53:0/4178878416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631760f8070 0x5631764b5900 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.194+0000 7fa6dd742740 1 --2- 172.21.15.53:0/4178878416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631760d7390 0x5631764b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.194+0000 7fa6dd742740 1 --2- 172.21.15.53:0/4178878416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631760cf1b0 0x5631764b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.194+0000 7fa6dd742740 1 -- 172.21.15.53:0/4178878416 >> 172.21.15.53:0/4178878416 conn(0x5631760ec460 msgr2=0x5631764a0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.194+0000 7fa6dd742740 1 -- 172.21.15.53:0/4178878416 shutdown_connections 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.194+0000 7fa6dd742740 1 -- 172.21.15.53:0/4178878416 wait complete. 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.194+0000 7fa6dd742740 20 client.20619 trim_cache size 0 max 16384 2024-08-31T06:21:08.198 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:21:08.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 -- 172.21.15.53:0/235578809 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6c00b4ca0 msgr2=0x7fa6c00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:08.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6c00b4ca0 0x7fa6c00b71b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x56317649bf90 tx=0x7fa6c4005f90 comp rx=0 tx=0).stop 2024-08-31T06:21:08.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 -- 172.21.15.53:0/235578809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6d01050e0 msgr2=0x7fa6d019c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:08.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6d01050e0 0x7fa6d019c8c0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00e9c0 tx=0x7fa6bc00ee80 comp rx=0 tx=0).stop 2024-08-31T06:21:08.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 -- 172.21.15.53:0/235578809 shutdown_connections 2024-08-31T06:21:08.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa6c00b4ca0 0x7fa6c00b71b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6d010dbf0 0x7fa6d01a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6d01050e0 0x7fa6d019c8c0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 --2- 172.21.15.53:0/235578809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6d0104790 0x7fa6d019c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:08.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 -- 172.21.15.53:0/235578809 >> 172.21.15.53:0/235578809 conn(0x7fa6d00794f0 msgr2=0x7fa6d010cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:08.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 -- 172.21.15.53:0/235578809 shutdown_connections 2024-08-31T06:21:08.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:08.195+0000 7fa6d71cd640 1 -- 172.21.15.53:0/235578809 wait complete. 2024-08-31T06:21:08.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17515 3.09 MB/sec execute 56 sec latency 22589.407 ms 2024-08-31T06:21:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:07 smithi130 ceph-mon[22266]: pgmap v829: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 42 op/s 2024-08-31T06:21:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:07 smithi153 ceph-mon[22320]: pgmap v829: 97 pgs: 97 active+clean; 452 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 42 op/s 2024-08-31T06:21:08.816 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b1859690', total seconds elapsed: 27.2 2024-08-31T06:21:09.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17728 3.24 MB/sec execute 57 sec latency 55.730 ms 2024-08-31T06:21:09.621 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:21:09.974 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:09 smithi053 ceph-mon[18924]: pgmap v830: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 151 KiB/s wr, 42 op/s 2024-08-31T06:21:10.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17865 3.37 MB/sec execute 58 sec latency 79.468 ms 2024-08-31T06:21:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:09 smithi130 ceph-mon[22266]: pgmap v830: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 151 KiB/s wr, 42 op/s 2024-08-31T06:21:10.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:09 smithi153 ceph-mon[22320]: pgmap v830: 97 pgs: 97 active+clean; 451 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 151 KiB/s wr, 42 op/s 2024-08-31T06:21:10.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.554+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2289467026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a241025c0 msgr2=0x7f6a241029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:10.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.554+0000 7f6a2a3b7640 1 --2- 172.21.15.53:0/2289467026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a241025c0 0x7f6a241029d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009900 tx=0x7f6a1402a410 comp rx=0 tx=0).stop 2024-08-31T06:21:10.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.554+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2289467026 shutdown_connections 2024-08-31T06:21:10.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.554+0000 7f6a2a3b7640 1 --2- 172.21.15.53:0/2289467026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a241079d0 0x7f6a24107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.554+0000 7f6a2a3b7640 1 --2- 172.21.15.53:0/2289467026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a24102f10 0x7f6a24107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.554+0000 7f6a2a3b7640 1 --2- 172.21.15.53:0/2289467026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a241025c0 0x7f6a241029d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.554+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2289467026 >> 172.21.15.53:0/2289467026 conn(0x7f6a24079530 msgr2=0x7f6a24079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:10.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.554+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2289467026 shutdown_connections 2024-08-31T06:21:10.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.554+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2289467026 wait complete. 2024-08-31T06:21:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.555+0000 7f6a2a3b7640 1 Processor -- start 2024-08-31T06:21:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.555+0000 7f6a2a3b7640 1 -- start start 2024-08-31T06:21:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.556+0000 7f6a2a3b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a241025c0 0x7f6a241a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.556+0000 7f6a2a3b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a24102f10 0x7f6a241a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.556+0000 7f6a2a3b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a241079d0 0x7f6a241a6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.556+0000 7f6a2a3b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a24119d70 con 0x7f6a241079d0 2024-08-31T06:21:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.556+0000 7f6a2a3b7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a24119bf0 con 0x7f6a24102f10 2024-08-31T06:21:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.556+0000 7f6a2a3b7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a24119ef0 con 0x7f6a241025c0 2024-08-31T06:21:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.556+0000 7f6a237fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a24102f10 0x7f6a241a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.556+0000 7f6a237fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a24102f10 0x7f6a241a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54198/0 (socket says 172.21.15.53:54198) 2024-08-31T06:21:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.556+0000 7f6a237fe640 1 -- 172.21.15.53:0/2747879904 learned_addr learned my addr 172.21.15.53:0/2747879904 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.556+0000 7f6a28954640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a241079d0 0x7f6a241a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.557+0000 7f6a28954640 1 -- 172.21.15.53:0/2747879904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a241025c0 msgr2=0x7f6a241a0800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T06:21:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.557+0000 7f6a28954640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a241025c0 0x7f6a241a0800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.557+0000 7f6a28954640 1 -- 172.21.15.53:0/2747879904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a24102f10 msgr2=0x7f6a241a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.557+0000 7f6a28954640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a24102f10 0x7f6a241a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.557+0000 7f6a28954640 1 -- 172.21.15.53:0/2747879904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a241a6770 con 0x7f6a241079d0 2024-08-31T06:21:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.557+0000 7f6a237fe640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a24102f10 0x7f6a241a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.557+0000 7f6a28954640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a241079d0 0x7f6a241a6040 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00be20 tx=0x7f6a1c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.558+0000 7f6a217fa640 1 -- 172.21.15.53:0/2747879904 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c019070 con 0x7f6a241079d0 2024-08-31T06:21:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.558+0000 7f6a217fa640 1 -- 172.21.15.53:0/2747879904 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a1c0148d0 con 0x7f6a241079d0 2024-08-31T06:21:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.558+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2747879904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a241a6a60 con 0x7f6a241079d0 2024-08-31T06:21:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.558+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2747879904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a241ad1c0 con 0x7f6a241079d0 2024-08-31T06:21:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.558+0000 7f6a217fa640 1 -- 172.21.15.53:0/2747879904 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0127e0 con 0x7f6a241079d0 2024-08-31T06:21:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.562+0000 7f6a3092c740 1 Processor -- start 2024-08-31T06:21:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.562+0000 7f6a217fa640 1 -- 172.21.15.53:0/2747879904 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6a1c01c070 con 0x7f6a241079d0 2024-08-31T06:21:10.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.562+0000 7f6a3092c740 1 -- start start 2024-08-31T06:21:10.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34e7070 0x55a9c388c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c388c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34c6390 0x55a9c388cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a3092c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3803680 con 0x55a9c34e7070 2024-08-31T06:21:10.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a3092c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a9c37f2c10 con 0x55a9c34be1b0 2024-08-31T06:21:10.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a3092c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a9c37f6bc0 con 0x55a9c34c6390 2024-08-31T06:21:10.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a23fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c388c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a23fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c388c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54214/0 (socket says 172.21.15.53:54214) 2024-08-31T06:21:10.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a23fff640 1 -- 172.21.15.53:0/901431474 learned_addr learned my addr 172.21.15.53:0/901431474 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:10.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a237fe640 1 --2- 172.21.15.53:0/901431474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34e7070 0x55a9c388c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a237fe640 1 --2- 172.21.15.53:0/901431474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34c6390 0x55a9c388cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a23fff640 1 -- 172.21.15.53:0/901431474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34c6390 msgr2=0x55a9c388cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a23fff640 1 --2- 172.21.15.53:0/901431474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34c6390 0x55a9c388cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a23fff640 1 -- 172.21.15.53:0/901431474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34e7070 msgr2=0x55a9c388c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a23fff640 1 --2- 172.21.15.53:0/901431474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34e7070 0x55a9c388c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a23fff640 1 -- 172.21.15.53:0/901431474 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9c3552650 con 0x55a9c34be1b0 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.563+0000 7f6a237fe640 1 --2- 172.21.15.53:0/901431474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34e7070 0x55a9c388c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.564+0000 7f6a23fff640 1 --2- 172.21.15.53:0/901431474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c388c850 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009230 tx=0x7f6a14009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b802020a37a9ad0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.564+0000 7f6a217fa640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4df0 0x7f6a0c0b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.564+0000 7f6a0a7fc640 1 -- 172.21.15.53:0/901431474 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14040070 con 0x55a9c34be1b0 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.564+0000 7f6a0a7fc640 1 -- 172.21.15.53:0/901431474 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a14032e00 con 0x55a9c34be1b0 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.564+0000 7f6a0a7fc640 1 -- 172.21.15.53:0/901431474 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14035040 con 0x55a9c34be1b0 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.564+0000 7f6a237fe640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4df0 0x7f6a0c0b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.565+0000 7f6a217fa640 1 -- 172.21.15.53:0/2747879904 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7f6a1c0e4ac0 con 0x7f6a241079d0 2024-08-31T06:21:10.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.565+0000 7f6a3092c740 1 -- 172.21.15.53:0/901431474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 msgr2=0x55a9c388c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:10.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.565+0000 7f6a3092c740 1 --2- 172.21.15.53:0/901431474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c388c850 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009230 tx=0x7f6a14009650 comp rx=0 tx=0).stop 2024-08-31T06:21:10.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.565+0000 7f6a237fe640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4df0 0x7f6a0c0b7300 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6a180058c0 tx=0x7f6a18015040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:10.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.566+0000 7f6a3092c740 1 -- 172.21.15.53:0/901431474 shutdown_connections 2024-08-31T06:21:10.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.566+0000 7f6a3092c740 1 --2- 172.21.15.53:0/901431474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34c6390 0x55a9c388cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.566+0000 7f6a3092c740 1 --2- 172.21.15.53:0/901431474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c388c850 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.566+0000 7f6a3092c740 1 --2- 172.21.15.53:0/901431474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34e7070 0x55a9c388c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.566+0000 7f6a3092c740 1 -- 172.21.15.53:0/901431474 >> 172.21.15.53:0/901431474 conn(0x55a9c34db460 msgr2=0x55a9c388a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:10.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.566+0000 7f6a3092c740 1 -- 172.21.15.53:0/901431474 shutdown_connections 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.566+0000 7f6a3092c740 1 -- 172.21.15.53:0/901431474 wait complete. 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.566+0000 7f6a3092c740 1 -- start start 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.567+0000 7f6a3092c740 1 Processor -- start 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.567+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c3897b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.567+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c3898050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.567+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34e7070 0x55a9c38a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.567+0000 7f6a3092c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3655700 con 0x55a9c34c6390 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.567+0000 7f6a3092c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a9c3779750 con 0x55a9c34be1b0 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.567+0000 7f6a3092c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a9c389aae0 con 0x55a9c34e7070 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.567+0000 7f6a3092c740 10 client.0 _ll_register_callbacks cb 0x55a9c37a8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.567+0000 7f6a23fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c3897b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a23fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c3897b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54222/0 (socket says 172.21.15.53:54222) 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a23fff640 1 -- 172.21.15.53:0/2823054063 learned_addr learned my addr 172.21.15.53:0/2823054063 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a237fe640 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c3898050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a28954640 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34e7070 0x55a9c38a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a237fe640 1 -- 172.21.15.53:0/2823054063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34e7070 msgr2=0x55a9c38a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a237fe640 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34e7070 0x55a9c38a3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a237fe640 1 -- 172.21.15.53:0/2823054063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 msgr2=0x55a9c3897b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a237fe640 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c3897b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a237fe640 1 -- 172.21.15.53:0/2823054063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9c37b2900 con 0x55a9c34c6390 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a23fff640 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c3897b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a237fe640 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c3898050 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f6a180095c0 tx=0x7f6a18005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409975d333a850da server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.568+0000 7f6a037fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.569+0000 7f6a037fe640 1 -- 172.21.15.53:0/2823054063 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a18003d40 con 0x55a9c34c6390 2024-08-31T06:21:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.569+0000 7f6a3092c740 1 -- 172.21.15.53:0/2823054063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a14032e00 con 0x55a9c34c6390 2024-08-31T06:21:10.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.569+0000 7f6a037fe640 1 -- 172.21.15.53:0/2823054063 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7f6a18023420 con 0x55a9c34c6390 2024-08-31T06:21:10.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.569+0000 7f6a037fe640 1 -- 172.21.15.53:0/2823054063 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f6a18031050 con 0x55a9c34c6390 2024-08-31T06:21:10.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.569+0000 7f6a3092c740 10 client.20628 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:10.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.569+0000 7f6a3092c740 1 -- 172.21.15.53:0/2823054063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55a9c38a69c0 con 0x55a9c34c6390 2024-08-31T06:21:10.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.569+0000 7f6a037fe640 1 -- 172.21.15.53:0/2823054063 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a14032e00 con 0x55a9c34c6390 2024-08-31T06:21:10.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.570+0000 7f6a037fe640 1 -- 172.21.15.53:0/2823054063 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f6a1802c510 con 0x55a9c34c6390 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.570+0000 7f6a3092c740 10 client.20628 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.570+0000 7f6a3092c740 10 client.20628 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.570+0000 7f6a3092c740 20 client.20628 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.570+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55a9c34a59f0 0x55a9c38a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.570+0000 7f6a3092c740 4 client.20628 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.570+0000 7f6a3092c740 1 -- 172.21.15.53:0/2823054063 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9c38055d0 con 0x55a9c34a59f0 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.570+0000 7f6a23fff640 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55a9c34a59f0 0x55a9c38a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.571+0000 7f6a037fe640 10 client.20628 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.571+0000 7f6a23fff640 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55a9c34a59f0 0x55a9c38a9ff0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=119eb9fdd10f1126 server_cookie=2d20fee3edf90b7f in_seq=0 out_seq=0 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.572+0000 7f6a037fe640 1 -- 172.21.15.53:0/2823054063 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a9c38055d0 con 0x55a9c34a59f0 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.572+0000 7f6a037fe640 10 client.20628 handle_command_reply: tid=0 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.572+0000 7f6a3092c740 1 client.20628 shutdown 2024-08-31T06:21:10.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.572+0000 7f6a3092c740 1 -- 172.21.15.53:0/2823054063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 msgr2=0x55a9c3898050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:10.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.572+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c3898050 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f6a180095c0 tx=0x7f6a18005f90 comp rx=0 tx=0).stop 2024-08-31T06:21:10.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.572+0000 7f6a3092c740 1 -- 172.21.15.53:0/2823054063 shutdown_connections 2024-08-31T06:21:10.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.572+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55a9c34a59f0 0x55a9c38a9ff0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.573+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34e7070 0x55a9c38a3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.573+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c3898050 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.573+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2823054063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34be1b0 0x55a9c3897b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.573+0000 7f6a3092c740 1 -- 172.21.15.53:0/2823054063 >> 172.21.15.53:0/2823054063 conn(0x55a9c34db460 msgr2=0x55a9c388f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:10.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.573+0000 7f6a037fe640 0 client.20628 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:21:10.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.573+0000 7f6a3092c740 1 -- 172.21.15.53:0/2823054063 shutdown_connections 2024-08-31T06:21:10.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.573+0000 7f6a3092c740 1 -- 172.21.15.53:0/2823054063 wait complete. 2024-08-31T06:21:10.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.573+0000 7f6a3092c740 20 client.20628 trim_cache size 0 max 16384 2024-08-31T06:21:10.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a3092c740 1 Processor -- start 2024-08-31T06:21:10.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a3092c740 1 -- start start 2024-08-31T06:21:10.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34be1b0 0x55a9c3897fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c388f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34e7070 0x55a9c388f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a3092c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1000e8e0 con 0x55a9c34c6390 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a3092c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a100105a0 con 0x55a9c34e7070 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c388f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a3092c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1000efb0 con 0x55a9c34be1b0 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c388f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37054/0 (socket says 172.21.15.53:37054) 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a237fe640 1 -- 172.21.15.53:0/3249213196 learned_addr learned my addr 172.21.15.53:0/3249213196 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.599+0000 7f6a23fff640 1 --2- 172.21.15.53:0/3249213196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34be1b0 0x55a9c3897fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.600+0000 7f6a237fe640 1 -- 172.21.15.53:0/3249213196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34be1b0 msgr2=0x55a9c3897fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.600+0000 7f6a237fe640 1 --2- 172.21.15.53:0/3249213196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34be1b0 0x55a9c3897fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.600+0000 7f6a237fe640 1 -- 172.21.15.53:0/3249213196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34e7070 msgr2=0x55a9c388f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.600+0000 7f6a237fe640 1 --2- 172.21.15.53:0/3249213196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34e7070 0x55a9c388f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.600+0000 7f6a237fe640 1 -- 172.21.15.53:0/3249213196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9c388aaf0 con 0x55a9c34c6390 2024-08-31T06:21:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.600+0000 7f6a237fe640 1 --2- 172.21.15.53:0/3249213196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c388f410 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f6a180092e0 tx=0x7f6a18004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e77ca509b437f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:10.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.600+0000 7f6a09ffb640 1 -- 172.21.15.53:0/3249213196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1802cd40 con 0x55a9c34c6390 2024-08-31T06:21:10.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.600+0000 7f6a09ffb640 1 -- 172.21.15.53:0/3249213196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a18039030 con 0x55a9c34c6390 2024-08-31T06:21:10.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.600+0000 7f6a09ffb640 1 -- 172.21.15.53:0/3249213196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a18023660 con 0x55a9c34c6390 2024-08-31T06:21:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.601+0000 7f6a3092c740 1 -- 172.21.15.53:0/3249213196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 msgr2=0x55a9c388f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.601+0000 7f6a3092c740 1 --2- 172.21.15.53:0/3249213196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c388f410 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f6a180092e0 tx=0x7f6a18004580 comp rx=0 tx=0).stop 2024-08-31T06:21:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.602+0000 7f6a3092c740 1 -- 172.21.15.53:0/3249213196 shutdown_connections 2024-08-31T06:21:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.602+0000 7f6a3092c740 1 --2- 172.21.15.53:0/3249213196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34e7070 0x55a9c388f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.602+0000 7f6a3092c740 1 --2- 172.21.15.53:0/3249213196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c388f410 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.602+0000 7f6a3092c740 1 --2- 172.21.15.53:0/3249213196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34be1b0 0x55a9c3897fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.602+0000 7f6a3092c740 1 -- 172.21.15.53:0/3249213196 >> 172.21.15.53:0/3249213196 conn(0x55a9c34db460 msgr2=0x55a9c38978c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.602+0000 7f6a3092c740 1 -- 172.21.15.53:0/3249213196 shutdown_connections 2024-08-31T06:21:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.602+0000 7f6a3092c740 1 -- 172.21.15.53:0/3249213196 wait complete. 2024-08-31T06:21:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.602+0000 7f6a3092c740 1 -- start start 2024-08-31T06:21:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.602+0000 7f6a3092c740 1 Processor -- start 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34be1b0 0x55a9c389c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c389c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a3092c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34e7070 0x55a9c39139b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a3092c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1000fed0 con 0x55a9c34c6390 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a3092c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1000f740 con 0x55a9c34e7070 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a3092c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1000c8e0 con 0x55a9c34be1b0 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a3092c740 10 client.0 _ll_register_callbacks cb 0x7f6a18013920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c389c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c389c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37062/0 (socket says 172.21.15.53:37062) 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a23fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34be1b0 0x55a9c389c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a237fe640 1 -- 172.21.15.53:0/2813851519 learned_addr learned my addr 172.21.15.53:0/2813851519 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:10.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.603+0000 7f6a28954640 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34e7070 0x55a9c39139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.604+0000 7f6a237fe640 1 -- 172.21.15.53:0/2813851519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34be1b0 msgr2=0x55a9c389c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.604+0000 7f6a237fe640 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34be1b0 0x55a9c389c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.604+0000 7f6a237fe640 1 -- 172.21.15.53:0/2813851519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34e7070 msgr2=0x55a9c39139b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.604+0000 7f6a237fe640 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34e7070 0x55a9c39139b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.604+0000 7f6a237fe640 1 -- 172.21.15.53:0/2813851519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9c389ce40 con 0x55a9c34c6390 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.604+0000 7f6a237fe640 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c389c5c0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f6a180095c0 tx=0x7f6a180135d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5ef92a02f5e876 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.604+0000 7f6a037fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.604+0000 7f6a037fe640 1 -- 172.21.15.53:0/2813851519 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1802c5f0 con 0x55a9c34c6390 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.604+0000 7f6a3092c740 1 -- 172.21.15.53:0/2813851519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a18039030 con 0x55a9c34c6390 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.604+0000 7f6a037fe640 1 -- 172.21.15.53:0/2813851519 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7f6a180039c0 con 0x55a9c34c6390 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.604+0000 7f6a037fe640 1 -- 172.21.15.53:0/2813851519 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f6a18003bc0 con 0x55a9c34c6390 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.605+0000 7f6a3092c740 10 client.20634 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:10.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.605+0000 7f6a3092c740 1 -- 172.21.15.53:0/2813851519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55a9c3914f30 con 0x55a9c34c6390 2024-08-31T06:21:10.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.605+0000 7f6a037fe640 1 -- 172.21.15.53:0/2813851519 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a18003d60 con 0x55a9c34c6390 2024-08-31T06:21:10.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.605+0000 7f6a037fe640 1 -- 172.21.15.53:0/2813851519 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f6a18004b00 con 0x55a9c34c6390 2024-08-31T06:21:10.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.605+0000 7f6a3092c740 10 client.20634 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:10.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.605+0000 7f6a3092c740 10 client.20634 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:21:10.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.605+0000 7f6a3092c740 20 client.20634 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:10.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.605+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55a9c347ada0 0x55a9c3917640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.605+0000 7f6a3092c740 4 client.20634 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.605+0000 7f6a3092c740 1 -- 172.21.15.53:0/2813851519 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f6a18039030 con 0x55a9c347ada0 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.606+0000 7f6a23fff640 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55a9c347ada0 0x55a9c3917640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.606+0000 7f6a037fe640 10 client.20634 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.606+0000 7f6a23fff640 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55a9c347ada0 0x55a9c3917640 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2dce6a975e370894 server_cookie=a4066d6133d6f67a in_seq=0 out_seq=0 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a037fe640 1 -- 172.21.15.53:0/2813851519 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f6a18039030 con 0x55a9c347ada0 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a037fe640 10 client.20634 handle_command_reply: tid=0 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 1 client.20634 shutdown 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 1 -- 172.21.15.53:0/2813851519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 msgr2=0x55a9c389c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c389c5c0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f6a180095c0 tx=0x7f6a180135d0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 1 -- 172.21.15.53:0/2813851519 shutdown_connections 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55a9c347ada0 0x55a9c3917640 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9c34e7070 0x55a9c39139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a9c34c6390 0x55a9c389c5c0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 1 --2- 172.21.15.53:0/2813851519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a9c34be1b0 0x55a9c389c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 1 -- 172.21.15.53:0/2813851519 >> 172.21.15.53:0/2813851519 conn(0x55a9c34db460 msgr2=0x55a9c388f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:10.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a037fe640 0 client.20634 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:21:10.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 1 -- 172.21.15.53:0/2813851519 shutdown_connections 2024-08-31T06:21:10.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 1 -- 172.21.15.53:0/2813851519 wait complete. 2024-08-31T06:21:10.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.607+0000 7f6a3092c740 20 client.20634 trim_cache size 0 max 16384 2024-08-31T06:21:10.612 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:21:10.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.608+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2747879904 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4df0 msgr2=0x7f6a0c0b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:10.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.608+0000 7f6a2a3b7640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4df0 0x7f6a0c0b7300 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6a180058c0 tx=0x7f6a18015040 comp rx=0 tx=0).stop 2024-08-31T06:21:10.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.608+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2747879904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a241079d0 msgr2=0x7f6a241a6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:10.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.608+0000 7f6a2a3b7640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a241079d0 0x7f6a241a6040 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00be20 tx=0x7f6a1c00bf10 comp rx=0 tx=0).stop 2024-08-31T06:21:10.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.608+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2747879904 shutdown_connections 2024-08-31T06:21:10.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.608+0000 7f6a2a3b7640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4df0 0x7f6a0c0b7300 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.608+0000 7f6a2a3b7640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a241079d0 0x7f6a241a6040 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.608+0000 7f6a2a3b7640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a24102f10 0x7f6a241a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.608+0000 7f6a2a3b7640 1 --2- 172.21.15.53:0/2747879904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a241025c0 0x7f6a241a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:10.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.608+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2747879904 >> 172.21.15.53:0/2747879904 conn(0x7f6a24079530 msgr2=0x7f6a241053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:10.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.609+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2747879904 shutdown_connections 2024-08-31T06:21:10.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:10.609+0000 7f6a2a3b7640 1 -- 172.21.15.53:0/2747879904 wait complete. 2024-08-31T06:21:11.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 17998 3.39 MB/sec execute 59 sec latency 72.552 ms 2024-08-31T06:21:11.607 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:21:11.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:11 smithi053 ceph-mon[18924]: pgmap v831: 97 pgs: 97 active+clean; 457 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 958 KiB/s wr, 95 op/s 2024-08-31T06:21:11.975 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:12.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 18203 3.64 MB/sec execute 60 sec latency 66.774 ms 2024-08-31T06:21:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:11 smithi130 ceph-mon[22266]: pgmap v831: 97 pgs: 97 active+clean; 457 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 958 KiB/s wr, 95 op/s 2024-08-31T06:21:12.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:11 smithi153 ceph-mon[22320]: pgmap v831: 97 pgs: 97 active+clean; 457 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 958 KiB/s wr, 95 op/s 2024-08-31T06:21:12.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.594+0000 7fae08aa2640 1 -- 172.21.15.53:0/1267437645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04108a90 msgr2=0x7fae0410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:12.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.594+0000 7fae08aa2640 1 --2- 172.21.15.53:0/1267437645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04108a90 0x7fae0410f2c0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009ca0 tx=0x7fadfc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.595+0000 7fae08aa2640 1 -- 172.21.15.53:0/1267437645 shutdown_connections 2024-08-31T06:21:12.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.595+0000 7fae08aa2640 1 --2- 172.21.15.53:0/1267437645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04108a90 0x7fae0410f2c0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.595+0000 7fae08aa2640 1 --2- 172.21.15.53:0/1267437645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04108140 0x7fae04108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.595+0000 7fae08aa2640 1 --2- 172.21.15.53:0/1267437645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04102800 0x7fae04102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.595+0000 7fae08aa2640 1 -- 172.21.15.53:0/1267437645 >> 172.21.15.53:0/1267437645 conn(0x7fae040794d0 msgr2=0x7fae040798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:12.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.595+0000 7fae08aa2640 1 -- 172.21.15.53:0/1267437645 shutdown_connections 2024-08-31T06:21:12.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.595+0000 7fae08aa2640 1 -- 172.21.15.53:0/1267437645 wait complete. 2024-08-31T06:21:12.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae08aa2640 1 Processor -- start 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae08aa2640 1 -- start start 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae08aa2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04102800 0x7fae04104e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae08aa2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04108140 0x7fae041053c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae08aa2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04108a90 0x7fae04105900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae08aa2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fae04112610 con 0x7fae04108140 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae08aa2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae04112490 con 0x7fae04108a90 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae08aa2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae04112790 con 0x7fae04102800 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae0259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04102800 0x7fae04104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae02d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04108a90 0x7fae04105900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae01d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04108140 0x7fae041053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae0259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04102800 0x7fae04104e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44254/0 (socket says 172.21.15.53:44254) 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae02d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04108a90 0x7fae04105900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54256/0 (socket says 172.21.15.53:54256) 2024-08-31T06:21:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.596+0000 7fae0259c640 1 -- 172.21.15.53:0/1815747203 learned_addr learned my addr 172.21.15.53:0/1815747203 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fae0259c640 1 -- 172.21.15.53:0/1815747203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04108a90 msgr2=0x7fae04105900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fae0259c640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04108a90 0x7fae04105900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fae0259c640 1 -- 172.21.15.53:0/1815747203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04108140 msgr2=0x7fae041053c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fae0259c640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04108140 0x7fae041053c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fae0259c640 1 -- 172.21.15.53:0/1815747203 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae041a8380 con 0x7fae04102800 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fae01d9b640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04108140 0x7fae041053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fae0259c640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04102800 0x7fae04104e80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf800e9f0 tx=0x7fadf800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fadf37fe640 1 -- 172.21.15.53:0/1815747203 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf800cd80 con 0x7fae04102800 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fae08aa2640 1 -- 172.21.15.53:0/1815747203 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae041a8670 con 0x7fae04102800 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fadf37fe640 1 -- 172.21.15.53:0/1815747203 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadf80108c0 con 0x7fae04102800 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fadf37fe640 1 -- 172.21.15.53:0/1815747203 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf80187c0 con 0x7fae04102800 2024-08-31T06:21:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.597+0000 7fae08aa2640 1 -- 172.21.15.53:0/1815747203 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae041a8c00 con 0x7fae04102800 2024-08-31T06:21:12.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.600+0000 7fae0f017740 1 Processor -- start 2024-08-31T06:21:12.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.601+0000 7fae0f017740 1 -- start start 2024-08-31T06:21:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.601+0000 7fadf37fe640 1 -- 172.21.15.53:0/1815747203 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fadf8018960 con 0x7fae04102800 2024-08-31T06:21:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.601+0000 7fae0f017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 0x55e4bf97fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.601+0000 7fae0f017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5a91b0 0x55e4bf9800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.601+0000 7fae0f017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5b1390 0x55e4bf9805e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.601+0000 7fae0f017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e4bf8ee680 con 0x55e4bf5d2070 2024-08-31T06:21:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.601+0000 7fae0f017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e4bf8ddc10 con 0x55e4bf5b1390 2024-08-31T06:21:12.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.601+0000 7fae0f017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e4bf8e1bc0 con 0x55e4bf5a91b0 2024-08-31T06:21:12.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.601+0000 7fae0259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5a91b0 0x55e4bf9800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.602+0000 7fae01d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5b1390 0x55e4bf9805e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.602+0000 7fae01d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5b1390 0x55e4bf9805e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54266/0 (socket says 172.21.15.53:54266) 2024-08-31T06:21:12.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.602+0000 7fae01d9b640 1 -- 172.21.15.53:0/3202299497 learned_addr learned my addr 172.21.15.53:0/3202299497 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:12.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.602+0000 7fadf37fe640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadec0b4d20 0x7fadec0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.602+0000 7fae02d9d640 1 --2- 172.21.15.53:0/3202299497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 0x55e4bf97fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.602+0000 7fae01d9b640 1 -- 172.21.15.53:0/3202299497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5a91b0 msgr2=0x55e4bf9800a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:12.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.602+0000 7fae01d9b640 1 --2- 172.21.15.53:0/3202299497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5a91b0 0x55e4bf9800a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.603+0000 7fae01d9b640 1 -- 172.21.15.53:0/3202299497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 msgr2=0x55e4bf97fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.603+0000 7fae01d9b640 1 --2- 172.21.15.53:0/3202299497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 0x55e4bf97fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.603+0000 7fae01d9b640 1 -- 172.21.15.53:0/3202299497 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4bf63d650 con 0x55e4bf5b1390 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.603+0000 7fae02d9d640 1 --2- 172.21.15.53:0/3202299497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 0x55e4bf97fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.603+0000 7fadf37fe640 1 -- 172.21.15.53:0/1815747203 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7fadf80e58b0 con 0x7fae04102800 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.603+0000 7fae02d9d640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadec0b4d20 0x7fadec0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.603+0000 7fae01d9b640 1 --2- 172.21.15.53:0/3202299497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5b1390 0x55e4bf9805e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fadf40114f0 tx=0x7fadf40119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b699e52988cab2d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.603+0000 7fadf0ff9640 1 -- 172.21.15.53:0/3202299497 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4005020 con 0x55e4bf5b1390 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.603+0000 7fadf0ff9640 1 -- 172.21.15.53:0/3202299497 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadf40047a0 con 0x55e4bf5b1390 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.603+0000 7fadf0ff9640 1 -- 172.21.15.53:0/3202299497 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf400f880 con 0x55e4bf5b1390 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.604+0000 7fae0f017740 1 -- 172.21.15.53:0/3202299497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5b1390 msgr2=0x55e4bf9805e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:12.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.604+0000 7fae0f017740 1 --2- 172.21.15.53:0/3202299497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5b1390 0x55e4bf9805e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fadf40114f0 tx=0x7fadf40119b0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.604+0000 7fae02d9d640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadec0b4d20 0x7fadec0b7230 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fadfc006010 tx=0x7fadfc0095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:12.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.604+0000 7fae0f017740 1 -- 172.21.15.53:0/3202299497 shutdown_connections 2024-08-31T06:21:12.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.604+0000 7fae0f017740 1 --2- 172.21.15.53:0/3202299497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5b1390 0x55e4bf9805e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.605+0000 7fae0f017740 1 --2- 172.21.15.53:0/3202299497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5a91b0 0x55e4bf9800a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.605+0000 7fae0f017740 1 --2- 172.21.15.53:0/3202299497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 0x55e4bf97fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.605+0000 7fae0f017740 1 -- 172.21.15.53:0/3202299497 >> 172.21.15.53:0/3202299497 conn(0x55e4bf5c6460 msgr2=0x55e4bf97da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:12.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.605+0000 7fae0f017740 1 -- 172.21.15.53:0/3202299497 shutdown_connections 2024-08-31T06:21:12.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.605+0000 7fae0f017740 1 -- 172.21.15.53:0/3202299497 wait complete. 2024-08-31T06:21:12.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.606+0000 7fae0f017740 1 -- start start 2024-08-31T06:21:12.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.606+0000 7fae0f017740 1 Processor -- start 2024-08-31T06:21:12.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0f017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf98b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0f017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5b1390 0x55e4bf98b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0f017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 0x55e4bf997630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0f017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e4bf740700 con 0x55e4bf5d2070 2024-08-31T06:21:12.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf98b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae01d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5b1390 0x55e4bf98b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0f017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e4bf864750 con 0x55e4bf5a91b0 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0f017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e4bf98e340 con 0x55e4bf5b1390 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf98b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54268/0 (socket says 172.21.15.53:54268) 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0259c640 1 -- 172.21.15.53:0/4142199340 learned_addr learned my addr 172.21.15.53:0/4142199340 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0f017740 10 client.0 _ll_register_callbacks cb 0x55e4bf893e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae02d9d640 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 0x55e4bf997630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0259c640 1 -- 172.21.15.53:0/4142199340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5b1390 msgr2=0x55e4bf98b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0259c640 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5b1390 0x55e4bf98b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0259c640 1 -- 172.21.15.53:0/4142199340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 msgr2=0x55e4bf997630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0259c640 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 0x55e4bf997630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae0259c640 1 -- 172.21.15.53:0/4142199340 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4bf89d900 con 0x55e4bf5a91b0 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.607+0000 7fae02d9d640 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 0x55e4bf997630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.608+0000 7fae0259c640 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf98b2c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fadf80e3010 tx=0x7fadf80abdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2b59bfc5754b51d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.608+0000 7fade9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:21:12.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.608+0000 7fade9ffb640 1 -- 172.21.15.53:0/4142199340 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf80abb10 con 0x55e4bf5a91b0 2024-08-31T06:21:12.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.608+0000 7fae0f017740 1 -- 172.21.15.53:0/4142199340 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf40047a0 con 0x55e4bf5a91b0 2024-08-31T06:21:12.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.608+0000 7fade9ffb640 1 -- 172.21.15.53:0/4142199340 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7fadf80b03e0 con 0x55e4bf5a91b0 2024-08-31T06:21:12.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.608+0000 7fade9ffb640 1 -- 172.21.15.53:0/4142199340 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fadf80b07c0 con 0x55e4bf5a91b0 2024-08-31T06:21:12.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.608+0000 7fae0f017740 10 client.29558 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:12.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.608+0000 7fae0f017740 1 -- 172.21.15.53:0/4142199340 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55e4bf99a0f0 con 0x55e4bf5a91b0 2024-08-31T06:21:12.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.608+0000 7fade9ffb640 1 -- 172.21.15.53:0/4142199340 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadf40047a0 con 0x55e4bf5a91b0 2024-08-31T06:21:12.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.609+0000 7fade9ffb640 1 -- 172.21.15.53:0/4142199340 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fadf80af070 con 0x55e4bf5a91b0 2024-08-31T06:21:12.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.609+0000 7fae0f017740 10 client.29558 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:12.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.609+0000 7fae0f017740 10 client.29558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:12.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.609+0000 7fae0f017740 20 client.29558 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:12.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.609+0000 7fae0f017740 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4bf5909f0 0x55e4bf99d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.609+0000 7fae0f017740 4 client.29558 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:12.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.609+0000 7fae0f017740 1 -- 172.21.15.53:0/4142199340 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4bf8f05d0 con 0x55e4bf5909f0 2024-08-31T06:21:12.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.609+0000 7fae01d9b640 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4bf5909f0 0x55e4bf99d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.610+0000 7fae01d9b640 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4bf5909f0 0x55e4bf99d5c0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bccd39ff980392db server_cookie=afbb9977cbc58623 in_seq=0 out_seq=0 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.610+0000 7fade9ffb640 10 client.29558 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.610+0000 7fade9ffb640 1 -- 172.21.15.53:0/4142199340 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e4bf8f05d0 con 0x55e4bf5909f0 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.610+0000 7fade9ffb640 10 client.29558 handle_command_reply: tid=0 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.610+0000 7fae0f017740 1 client.29558 shutdown 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fae0f017740 1 -- 172.21.15.53:0/4142199340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 msgr2=0x55e4bf98b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fae0f017740 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf98b2c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fadf80e3010 tx=0x7fadf80abdd0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fae0f017740 1 -- 172.21.15.53:0/4142199340 shutdown_connections 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fae0f017740 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4bf5909f0 0x55e4bf99d5c0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fae0f017740 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5d2070 0x55e4bf997630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fae0f017740 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5b1390 0x55e4bf98b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fae0f017740 1 --2- 172.21.15.53:0/4142199340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf98b2c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fade9ffb640 0 client.29558 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:12.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fae0f017740 1 -- 172.21.15.53:0/4142199340 >> 172.21.15.53:0/4142199340 conn(0x55e4bf5c6460 msgr2=0x55e4bf982d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:12.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fae0f017740 1 -- 172.21.15.53:0/4142199340 shutdown_connections 2024-08-31T06:21:12.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fae0f017740 1 -- 172.21.15.53:0/4142199340 wait complete. 2024-08-31T06:21:12.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.611+0000 7fae0f017740 20 client.29558 trim_cache size 0 max 16384 2024-08-31T06:21:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.632+0000 7fae0f017740 1 Processor -- start 2024-08-31T06:21:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.632+0000 7fae0f017740 1 -- start start 2024-08-31T06:21:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.632+0000 7fae0f017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5909f0 0x55e4bf98b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.632+0000 7fae0f017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf997530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.632+0000 7fae0f017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5b1390 0x55e4bf997a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.632+0000 7fae0f017740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fae041ad250 con 0x55e4bf5909f0 2024-08-31T06:21:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.632+0000 7fae0f017740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae041aef10 con 0x55e4bf5a91b0 2024-08-31T06:21:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.632+0000 7fae0f017740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae041ad920 con 0x55e4bf5b1390 2024-08-31T06:21:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.633+0000 7fae0259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5909f0 0x55e4bf98b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.633+0000 7fae0259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5909f0 0x55e4bf98b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37102/0 (socket says 172.21.15.53:37102) 2024-08-31T06:21:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.633+0000 7fae0259c640 1 -- 172.21.15.53:0/3403966542 learned_addr learned my addr 172.21.15.53:0/3403966542 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.633+0000 7fae01d9b640 1 --2- 172.21.15.53:0/3403966542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf997530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.633+0000 7fae0259c640 1 -- 172.21.15.53:0/3403966542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5b1390 msgr2=0x55e4bf997a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.633+0000 7fae0259c640 1 --2- 172.21.15.53:0/3403966542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5b1390 0x55e4bf997a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.633+0000 7fae0259c640 1 -- 172.21.15.53:0/3403966542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 msgr2=0x55e4bf997530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.633+0000 7fae0259c640 1 --2- 172.21.15.53:0/3403966542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf997530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.633+0000 7fae0259c640 1 -- 172.21.15.53:0/3403966542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4bf9823f0 con 0x55e4bf5909f0 2024-08-31T06:21:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.633+0000 7fae0259c640 1 --2- 172.21.15.53:0/3403966542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5909f0 0x55e4bf98b780 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fadf80abd00 tx=0x7fadf80abf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e72af635ce93ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.634+0000 7fadebfff640 1 -- 172.21.15.53:0/3403966542 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf80abb10 con 0x55e4bf5909f0 2024-08-31T06:21:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.634+0000 7fadebfff640 1 -- 172.21.15.53:0/3403966542 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadf80c5020 con 0x55e4bf5909f0 2024-08-31T06:21:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.634+0000 7fadebfff640 1 -- 172.21.15.53:0/3403966542 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf80b03e0 con 0x55e4bf5909f0 2024-08-31T06:21:12.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.635+0000 7fae0f017740 1 -- 172.21.15.53:0/3403966542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5909f0 msgr2=0x55e4bf98b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:12.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.635+0000 7fae0f017740 1 --2- 172.21.15.53:0/3403966542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5909f0 0x55e4bf98b780 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fadf80abd00 tx=0x7fadf80abf00 comp rx=0 tx=0).stop 2024-08-31T06:21:12.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.635+0000 7fae0f017740 1 -- 172.21.15.53:0/3403966542 shutdown_connections 2024-08-31T06:21:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.635+0000 7fae0f017740 1 --2- 172.21.15.53:0/3403966542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5b1390 0x55e4bf997a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.635+0000 7fae0f017740 1 --2- 172.21.15.53:0/3403966542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf997530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.635+0000 7fae0f017740 1 --2- 172.21.15.53:0/3403966542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5909f0 0x55e4bf98b780 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.635+0000 7fae0f017740 1 -- 172.21.15.53:0/3403966542 >> 172.21.15.53:0/3403966542 conn(0x55e4bf5c6460 msgr2=0x55e4bf98b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.635+0000 7fae0f017740 1 -- 172.21.15.53:0/3403966542 shutdown_connections 2024-08-31T06:21:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.635+0000 7fae0f017740 1 -- 172.21.15.53:0/3403966542 wait complete. 2024-08-31T06:21:12.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.636+0000 7fae0f017740 1 -- start start 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.636+0000 7fae0f017740 1 Processor -- start 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.636+0000 7fae0f017740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5909f0 0x55e4bf990030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.636+0000 7fae0f017740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf9905d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.636+0000 7fae0f017740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5b1390 0x55e4bfa01010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae02d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5b1390 0x55e4bfa01010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5909f0 0x55e4bf990030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5909f0 0x55e4bf990030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44286/0 (socket says 172.21.15.53:44286) 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0259c640 1 -- 172.21.15.53:0/3621949833 learned_addr learned my addr 172.21.15.53:0/3621949833 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0f017740 1 -- 172.21.15.53:0/3621949833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fae041ae840 con 0x55e4bf5b1390 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0f017740 1 -- 172.21.15.53:0/3621949833 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae041ae0b0 con 0x55e4bf5a91b0 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0f017740 1 -- 172.21.15.53:0/3621949833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae041ab250 con 0x55e4bf5909f0 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0f017740 10 client.0 _ll_register_callbacks cb 0x7fadf80eb240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae01d9b640 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf9905d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0259c640 1 -- 172.21.15.53:0/3621949833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 msgr2=0x55e4bf9905d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0259c640 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf9905d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0259c640 1 -- 172.21.15.53:0/3621949833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5b1390 msgr2=0x55e4bfa01010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0259c640 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5b1390 0x55e4bfa01010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0259c640 1 -- 172.21.15.53:0/3621949833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4bfa01680 con 0x55e4bf5909f0 2024-08-31T06:21:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae01d9b640 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf9905d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fae0259c640 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5909f0 0x55e4bf990030 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fadf80a85a0 tx=0x7fadf80b06f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8094e2a55b3d649 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.637+0000 7fade9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:21:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.638+0000 7fade9ffb640 1 -- 172.21.15.53:0/3621949833 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf80b5270 con 0x55e4bf5909f0 2024-08-31T06:21:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.638+0000 7fade9ffb640 1 -- 172.21.15.53:0/3621949833 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7fadf8010640 con 0x55e4bf5909f0 2024-08-31T06:21:12.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.638+0000 7fae0f017740 1 -- 172.21.15.53:0/3621949833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf80c5020 con 0x55e4bf5909f0 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.638+0000 7fade9ffb640 1 -- 172.21.15.53:0/3621949833 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fadf80ac000 con 0x55e4bf5909f0 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.638+0000 7fae0f017740 10 client.29551 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.638+0000 7fae0f017740 1 -- 172.21.15.53:0/3621949833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55e4bfa08a70 con 0x55e4bf5909f0 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.639+0000 7fade9ffb640 1 -- 172.21.15.53:0/3621949833 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadf80cd280 con 0x55e4bf5909f0 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.639+0000 7fade9ffb640 1 -- 172.21.15.53:0/3621949833 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fadf80af070 con 0x55e4bf5909f0 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.639+0000 7fae0f017740 10 client.29551 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.639+0000 7fae0f017740 10 client.29551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.639+0000 7fae0f017740 20 client.29551 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.639+0000 7fae0f017740 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4bf5d2070 0x55e4bfa0afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.639+0000 7fae0f017740 4 client.29551 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.639+0000 7fae0f017740 1 -- 172.21.15.53:0/3621949833 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fadf80c5020 con 0x55e4bf5d2070 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.639+0000 7fae01d9b640 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4bf5d2070 0x55e4bfa0afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fade9ffb640 10 client.29551 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fae01d9b640 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4bf5d2070 0x55e4bfa0afa0 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7475b54165c8a923 server_cookie=7d9148b9a437fcd0 in_seq=0 out_seq=0 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fade9ffb640 1 -- 172.21.15.53:0/3621949833 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fadf80c5020 con 0x55e4bf5d2070 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fade9ffb640 10 client.29551 handle_command_reply: tid=0 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fae0f017740 1 client.29551 shutdown 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fae0f017740 1 -- 172.21.15.53:0/3621949833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5909f0 msgr2=0x55e4bf990030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fae0f017740 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5909f0 0x55e4bf990030 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fadf80a85a0 tx=0x7fadf80b06f0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fae0f017740 1 -- 172.21.15.53:0/3621949833 shutdown_connections 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fae0f017740 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4bf5d2070 0x55e4bfa0afa0 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fae0f017740 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4bf5b1390 0x55e4bfa01010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fae0f017740 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4bf5a91b0 0x55e4bf9905d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fae0f017740 1 --2- 172.21.15.53:0/3621949833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4bf5909f0 0x55e4bf990030 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fae0f017740 1 -- 172.21.15.53:0/3621949833 >> 172.21.15.53:0/3621949833 conn(0x55e4bf5c6460 msgr2=0x55e4bf980b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:12.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.640+0000 7fade9ffb640 0 client.29551 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:12.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.641+0000 7fae0f017740 1 -- 172.21.15.53:0/3621949833 shutdown_connections 2024-08-31T06:21:12.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.641+0000 7fae0f017740 1 -- 172.21.15.53:0/3621949833 wait complete. 2024-08-31T06:21:12.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.641+0000 7fae0f017740 20 client.29551 trim_cache size 0 max 16384 2024-08-31T06:21:12.645 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:21:12.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.642+0000 7fae08aa2640 1 -- 172.21.15.53:0/1815747203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadec0b4d20 msgr2=0x7fadec0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:12.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.642+0000 7fae08aa2640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadec0b4d20 0x7fadec0b7230 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fadfc006010 tx=0x7fadfc0095c0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.642+0000 7fae08aa2640 1 -- 172.21.15.53:0/1815747203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04102800 msgr2=0x7fae04104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:12.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.642+0000 7fae08aa2640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04102800 0x7fae04104e80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fadf800e9f0 tx=0x7fadf800eeb0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.642+0000 7fae08aa2640 1 -- 172.21.15.53:0/1815747203 shutdown_connections 2024-08-31T06:21:12.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.642+0000 7fae08aa2640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadec0b4d20 0x7fadec0b7230 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.642+0000 7fae08aa2640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04108a90 0x7fae04105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.642+0000 7fae08aa2640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04108140 0x7fae041053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.642+0000 7fae08aa2640 1 --2- 172.21.15.53:0/1815747203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04102800 0x7fae04104e80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:12.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.642+0000 7fae08aa2640 1 -- 172.21.15.53:0/1815747203 >> 172.21.15.53:0/1815747203 conn(0x7fae040794d0 msgr2=0x7fae0406af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:12.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.643+0000 7fae08aa2640 1 -- 172.21.15.53:0/1815747203 shutdown_connections 2024-08-31T06:21:12.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:12.643+0000 7fae08aa2640 1 -- 172.21.15.53:0/1815747203 wait complete. 2024-08-31T06:21:13.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 18353 3.69 MB/sec execute 61 sec latency 100.115 ms 2024-08-31T06:21:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.121+0000 7fb47419e640 1 -- 172.21.15.53:0/334776196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb46c1046c0 msgr2=0x7fb46c104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.121+0000 7fb47419e640 1 --2- 172.21.15.53:0/334776196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb46c1046c0 0x7fb46c104ad0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fb468009900 tx=0x7fb46802a410 comp rx=0 tx=0).stop 2024-08-31T06:21:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.122+0000 7fb47419e640 1 -- 172.21.15.53:0/334776196 shutdown_connections 2024-08-31T06:21:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.122+0000 7fb47419e640 1 --2- 172.21.15.53:0/334776196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb46c10db10 0x7fb46c110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.122+0000 7fb47419e640 1 --2- 172.21.15.53:0/334776196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb46c105010 0x7fb46c10d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.122+0000 7fb47419e640 1 --2- 172.21.15.53:0/334776196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb46c1046c0 0x7fb46c104ad0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.122+0000 7fb47419e640 1 -- 172.21.15.53:0/334776196 >> 172.21.15.53:0/334776196 conn(0x7fb46c07a490 msgr2=0x7fb46c07a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.122+0000 7fb47419e640 1 -- 172.21.15.53:0/334776196 shutdown_connections 2024-08-31T06:21:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.122+0000 7fb47419e640 1 -- 172.21.15.53:0/334776196 wait complete. 2024-08-31T06:21:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.122+0000 7fb47419e640 1 Processor -- start 2024-08-31T06:21:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb47419e640 1 -- start start 2024-08-31T06:21:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb47419e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb46c1046c0 0x7fb46c19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb47419e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb46c105010 0x7fb46c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb47419e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb46c10db10 0x7fb46c19f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb47419e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c113610 con 0x7fb46c105010 2024-08-31T06:21:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb47419e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c113490 con 0x7fb46c1046c0 2024-08-31T06:21:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb47419e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c113790 con 0x7fb46c10db10 2024-08-31T06:21:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb471739640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb46c105010 0x7fb46c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb471739640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb46c105010 0x7fb46c19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41090/0 (socket says 172.21.15.53:41090) 2024-08-31T06:21:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb471739640 1 -- 172.21.15.53:0/4145925386 learned_addr learned my addr 172.21.15.53:0/4145925386 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb47273b640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb46c10db10 0x7fb46c19f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb471f3a640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb46c1046c0 0x7fb46c19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb471739640 1 -- 172.21.15.53:0/4145925386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb46c10db10 msgr2=0x7fb46c19f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb471739640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb46c10db10 0x7fb46c19f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb471739640 1 -- 172.21.15.53:0/4145925386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb46c1046c0 msgr2=0x7fb46c19a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb471739640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb46c1046c0 0x7fb46c19a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb471739640 1 -- 172.21.15.53:0/4145925386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46c1a0000 con 0x7fb46c105010 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.123+0000 7fb47273b640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb46c10db10 0x7fb46c19f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.124+0000 7fb471739640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb46c105010 0x7fb46c19a670 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00d770 tx=0x7fb45c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.124+0000 7fb462ffd640 1 -- 172.21.15.53:0/4145925386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c017070 con 0x7fb46c105010 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.124+0000 7fb47419e640 1 -- 172.21.15.53:0/4145925386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46c1a02f0 con 0x7fb46c105010 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.124+0000 7fb462ffd640 1 -- 172.21.15.53:0/4145925386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb45c009c30 con 0x7fb46c105010 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.124+0000 7fb47419e640 1 -- 172.21.15.53:0/4145925386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46c1a6a80 con 0x7fb46c105010 2024-08-31T06:21:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.124+0000 7fb462ffd640 1 -- 172.21.15.53:0/4145925386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c00f620 con 0x7fb46c105010 2024-08-31T06:21:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.127+0000 7fb47b1e4740 1 Processor -- start 2024-08-31T06:21:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.127+0000 7fb47b1e4740 1 -- start start 2024-08-31T06:21:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 0x5630a2d85ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29b92f0 0x5630a2d86220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29c14d0 0x5630a2d86760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5630a2cfb000 con 0x5630a29c14d0 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5630a2cea590 con 0x5630a29e21b0 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5630a2cee540 con 0x5630a29b92f0 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb462ffd640 1 -- 172.21.15.53:0/4145925386 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb45c01a070 con 0x7fb46c105010 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47273b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 0x5630a2d85ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb471f3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29b92f0 0x5630a2d86220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb471f3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29b92f0 0x5630a2d86220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34658/0 (socket says 172.21.15.53:34658) 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb471f3a640 1 -- 172.21.15.53:0/120784518 learned_addr learned my addr 172.21.15.53:0/120784518 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb471739640 1 --2- 172.21.15.53:0/120784518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29c14d0 0x5630a2d86760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47273b640 1 -- 172.21.15.53:0/120784518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29b92f0 msgr2=0x5630a2d86220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47273b640 1 --2- 172.21.15.53:0/120784518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29b92f0 0x5630a2d86220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47273b640 1 -- 172.21.15.53:0/120784518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29c14d0 msgr2=0x5630a2d86760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47273b640 1 --2- 172.21.15.53:0/120784518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29c14d0 0x5630a2d86760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.128+0000 7fb47273b640 1 -- 172.21.15.53:0/120784518 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630a2a4d790 con 0x5630a29e21b0 2024-08-31T06:21:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.129+0000 7fb471f3a640 1 --2- 172.21.15.53:0/120784518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29b92f0 0x5630a2d86220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.129+0000 7fb47273b640 1 --2- 172.21.15.53:0/120784518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 0x5630a2d85ce0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb464005fd0 tx=0x7fb464011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=596b7452559739ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.129+0000 7fb457fff640 1 -- 172.21.15.53:0/120784518 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464004d20 con 0x5630a29e21b0 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.129+0000 7fb457fff640 1 -- 172.21.15.53:0/120784518 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb46400f9a0 con 0x5630a29e21b0 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.129+0000 7fb457fff640 1 -- 172.21.15.53:0/120784518 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4640043d0 con 0x5630a29e21b0 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.129+0000 7fb462ffd640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4580b4ca0 0x7fb4580b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.129+0000 7fb471f3a640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4580b4ca0 0x7fb4580b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.129+0000 7fb462ffd640 1 -- 172.21.15.53:0/4145925386 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7fb45c0e5030 con 0x7fb46c105010 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.130+0000 7fb47b1e4740 1 -- 172.21.15.53:0/120784518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 msgr2=0x5630a2d85ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.130+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/120784518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 0x5630a2d85ce0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb464005fd0 tx=0x7fb464011bf0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.130+0000 7fb471f3a640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4580b4ca0 0x7fb4580b71b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x5630a2d84960 tx=0x7fb4680058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.130+0000 7fb47b1e4740 1 -- 172.21.15.53:0/120784518 shutdown_connections 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.130+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/120784518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29c14d0 0x5630a2d86760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.130+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/120784518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29b92f0 0x5630a2d86220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.130+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/120784518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 0x5630a2d85ce0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.130+0000 7fb47b1e4740 1 -- 172.21.15.53:0/120784518 >> 172.21.15.53:0/120784518 conn(0x5630a29d6300 msgr2=0x5630a2d83bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.130+0000 7fb47b1e4740 1 -- 172.21.15.53:0/120784518 shutdown_connections 2024-08-31T06:21:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.130+0000 7fb47b1e4740 1 -- 172.21.15.53:0/120784518 wait complete. 2024-08-31T06:21:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.131+0000 7fb47b1e4740 1 -- start start 2024-08-31T06:21:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.131+0000 7fb47b1e4740 1 Processor -- start 2024-08-31T06:21:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2d95c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29c14d0 0x5630a2d961b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 0x5630a2da1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5630a2c23ab0 con 0x5630a29b92f0 2024-08-31T06:21:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5630a2c71680 con 0x5630a29e21b0 2024-08-31T06:21:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5630a2d98840 con 0x5630a29c14d0 2024-08-31T06:21:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47b1e4740 10 client.0 _ll_register_callbacks cb 0x5630a29f9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb471f3a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2d95c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb471f3a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2d95c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41120/0 (socket says 172.21.15.53:41120) 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb471f3a640 1 -- 172.21.15.53:0/3997616360 learned_addr learned my addr 172.21.15.53:0/3997616360 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb471739640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29c14d0 0x5630a2d961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47273b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 0x5630a2da1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47273b640 1 -- 172.21.15.53:0/3997616360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29c14d0 msgr2=0x5630a2d961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47273b640 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29c14d0 0x5630a2d961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47273b640 1 -- 172.21.15.53:0/3997616360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 msgr2=0x5630a2d95c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47273b640 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2d95c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb47273b640 1 -- 172.21.15.53:0/3997616360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630a2ac6620 con 0x5630a29e21b0 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.132+0000 7fb471f3a640 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2d95c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.133+0000 7fb47273b640 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 0x5630a2da1bd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb46400a010 tx=0x7fb464003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a892225181d05a29 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.133+0000 7fb4557fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.133+0000 7fb4557fa640 1 -- 172.21.15.53:0/3997616360 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464029060 con 0x5630a29e21b0 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.133+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3997616360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb46400f9a0 con 0x5630a29e21b0 2024-08-31T06:21:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.133+0000 7fb4557fa640 1 -- 172.21.15.53:0/3997616360 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7fb464011270 con 0x5630a29e21b0 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.133+0000 7fb4557fa640 1 -- 172.21.15.53:0/3997616360 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fb46401e040 con 0x5630a29e21b0 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.133+0000 7fb47b1e4740 10 client.29576 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.133+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3997616360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5630a2da48b0 con 0x5630a29e21b0 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.134+0000 7fb4557fa640 1 -- 172.21.15.53:0/3997616360 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb46400f9a0 con 0x5630a29e21b0 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.134+0000 7fb4557fa640 1 -- 172.21.15.53:0/3997616360 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fb464018070 con 0x5630a29e21b0 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.134+0000 7fb47b1e4740 10 client.29576 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.134+0000 7fb47b1e4740 10 client.29576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.134+0000 7fb47b1e4740 20 client.29576 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.134+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5630a29a0d80 0x5630a2da7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.134+0000 7fb47b1e4740 4 client.29576 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.134+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3997616360 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630a2cfcf50 con 0x5630a29a0d80 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.134+0000 7fb471f3a640 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5630a29a0d80 0x5630a2da7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.135+0000 7fb4557fa640 10 client.29576 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.135+0000 7fb471f3a640 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5630a29a0d80 0x5630a2da7cd0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a844a3dec3b4f39b server_cookie=1aa5f39b9fa19c15 in_seq=0 out_seq=0 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb4557fa640 1 -- 172.21.15.53:0/3997616360 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630a2cfcf50 con 0x5630a29a0d80 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb4557fa640 10 client.29576 handle_command_reply: tid=0 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 1 client.29576 shutdown 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3997616360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 msgr2=0x5630a2da1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 0x5630a2da1bd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb46400a010 tx=0x7fb464003ce0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3997616360 shutdown_connections 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5630a29a0d80 0x5630a2da7cd0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29e21b0 0x5630a2da1bd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29c14d0 0x5630a2d961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb4557fa640 0 client.29576 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3997616360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2d95c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3997616360 >> 172.21.15.53:0/3997616360 conn(0x5630a29d6300 msgr2=0x5630a2d876d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3997616360 shutdown_connections 2024-08-31T06:21:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3997616360 wait complete. 2024-08-31T06:21:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.136+0000 7fb47b1e4740 20 client.29576 trim_cache size 0 max 16384 2024-08-31T06:21:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.161+0000 7fb47b1e4740 1 Processor -- start 2024-08-31T06:21:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.161+0000 7fb47b1e4740 1 -- start start 2024-08-31T06:21:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2da1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2da2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29c14d0 0x5630a2d95c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1ad340 con 0x5630a29b92f0 2024-08-31T06:21:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1af000 con 0x5630a29c14d0 2024-08-31T06:21:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1ada10 con 0x5630a29a0d80 2024-08-31T06:21:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb471739640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2da2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb471f3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2da1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb471739640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2da2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41132/0 (socket says 172.21.15.53:41132) 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb471f3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2da1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34672/0 (socket says 172.21.15.53:34672) 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb471739640 1 -- 172.21.15.53:0/1476426484 learned_addr learned my addr 172.21.15.53:0/1476426484 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb47273b640 1 --2- 172.21.15.53:0/1476426484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29c14d0 0x5630a2d95c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb471739640 1 -- 172.21.15.53:0/1476426484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 msgr2=0x5630a2da1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb471739640 1 --2- 172.21.15.53:0/1476426484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2da1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb471739640 1 -- 172.21.15.53:0/1476426484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29c14d0 msgr2=0x5630a2d95c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb471739640 1 --2- 172.21.15.53:0/1476426484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29c14d0 0x5630a2d95c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb471739640 1 -- 172.21.15.53:0/1476426484 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630a2d7ea90 con 0x5630a29b92f0 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb471f3a640 1 --2- 172.21.15.53:0/1476426484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2da1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.162+0000 7fb47273b640 1 --2- 172.21.15.53:0/1476426484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29c14d0 0x5630a2d95c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.163+0000 7fb471739640 1 --2- 172.21.15.53:0/1476426484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2da2010 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0a7800 tx=0x7fb45c0a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b714b7ca86e1a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.163+0000 7fb4577fe640 1 -- 172.21.15.53:0/1476426484 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c021070 con 0x5630a29b92f0 2024-08-31T06:21:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.163+0000 7fb4577fe640 1 -- 172.21.15.53:0/1476426484 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb45c010e40 con 0x5630a29b92f0 2024-08-31T06:21:14.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.163+0000 7fb4577fe640 1 -- 172.21.15.53:0/1476426484 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0aff40 con 0x5630a29b92f0 2024-08-31T06:21:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.164+0000 7fb47b1e4740 1 -- 172.21.15.53:0/1476426484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 msgr2=0x5630a2da2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.164+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/1476426484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2da2010 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0a7800 tx=0x7fb45c0a7040 comp rx=0 tx=0).stop 2024-08-31T06:21:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.164+0000 7fb47b1e4740 1 -- 172.21.15.53:0/1476426484 shutdown_connections 2024-08-31T06:21:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.164+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/1476426484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29c14d0 0x5630a2d95c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.164+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/1476426484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29b92f0 0x5630a2da2010 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.164+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/1476426484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2da1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.164+0000 7fb47b1e4740 1 -- 172.21.15.53:0/1476426484 >> 172.21.15.53:0/1476426484 conn(0x5630a29d6300 msgr2=0x5630a2d942c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.164+0000 7fb47b1e4740 1 -- 172.21.15.53:0/1476426484 shutdown_connections 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.164+0000 7fb47b1e4740 1 -- 172.21.15.53:0/1476426484 wait complete. 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.165+0000 7fb47b1e4740 1 -- start start 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.165+0000 7fb47b1e4740 1 Processor -- start 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.165+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2d9e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.165+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29b92f0 0x5630a2d99520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.165+0000 7fb47b1e4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29c14d0 0x5630a2d99a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1ae930 con 0x5630a29c14d0 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1ae1a0 con 0x5630a29b92f0 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb47b1e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c1ab340 con 0x5630a29a0d80 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb47b1e4740 10 client.0 _ll_register_callbacks cb 0x7fb45c0e8a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb471f3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2d9e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb471f3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2d9e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34688/0 (socket says 172.21.15.53:34688) 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb471f3a640 1 -- 172.21.15.53:0/3353565366 learned_addr learned my addr 172.21.15.53:0/3353565366 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb47273b640 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29c14d0 0x5630a2d99a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb471739640 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29b92f0 0x5630a2d99520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb471f3a640 1 -- 172.21.15.53:0/3353565366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29b92f0 msgr2=0x5630a2d99520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb471f3a640 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29b92f0 0x5630a2d99520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb471f3a640 1 -- 172.21.15.53:0/3353565366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29c14d0 msgr2=0x5630a2d99a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb471f3a640 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29c14d0 0x5630a2d99a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb471f3a640 1 -- 172.21.15.53:0/3353565366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630a2d99fa0 con 0x5630a29a0d80 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb471f3a640 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2d9e080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb468006010 tx=0x7fb468009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a8ec59bbc655695 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.166+0000 7fb4557fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.167+0000 7fb4557fa640 1 -- 172.21.15.53:0/3353565366 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46805d060 con 0x5630a29a0d80 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.167+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3353565366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5630a2cf89f0 con 0x5630a29a0d80 2024-08-31T06:21:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.167+0000 7fb4557fa640 1 -- 172.21.15.53:0/3353565366 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8601+0+0 (secure 0 0 0) 0x7fb468004250 con 0x5630a29a0d80 2024-08-31T06:21:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.167+0000 7fb4557fa640 1 -- 172.21.15.53:0/3353565366 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fb468035040 con 0x5630a29a0d80 2024-08-31T06:21:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.167+0000 7fb47b1e4740 10 client.29569 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.167+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3353565366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5630a2e12210 con 0x5630a29a0d80 2024-08-31T06:21:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.167+0000 7fb4557fa640 1 -- 172.21.15.53:0/3353565366 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5630a2cf89f0 con 0x5630a29a0d80 2024-08-31T06:21:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.168+0000 7fb4557fa640 1 -- 172.21.15.53:0/3353565366 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fb468050050 con 0x5630a29a0d80 2024-08-31T06:21:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.168+0000 7fb47b1e4740 10 client.29569 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.168+0000 7fb47b1e4740 10 client.29569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.168+0000 7fb47b1e4740 20 client.29569 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.169+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5630a29e21b0 0x5630a2e14930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.169+0000 7fb47b1e4740 4 client.29569 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:21:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.169+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3353565366 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5630a2cf6130 con 0x5630a29e21b0 2024-08-31T06:21:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.169+0000 7fb471739640 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5630a29e21b0 0x5630a2e14930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.169+0000 7fb471739640 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5630a29e21b0 0x5630a2e14930 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b336c2dad38d2953 server_cookie=bf5ad996cd9dfc1f in_seq=0 out_seq=0 2024-08-31T06:21:14.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.170+0000 7fb4557fa640 10 client.29569 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.218+0000 7fb4557fa640 1 -- 172.21.15.53:0/3353565366 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5630a2cf6130 con 0x5630a29e21b0 2024-08-31T06:21:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.218+0000 7fb4557fa640 10 client.29569 handle_command_reply: tid=0 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.218+0000 7fb47b1e4740 1 client.29569 shutdown 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3353565366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 msgr2=0x5630a2d9e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2d9e080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb468006010 tx=0x7fb468009260 comp rx=0 tx=0).stop 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3353565366 shutdown_connections 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5630a29e21b0 0x5630a2e14930 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630a29c14d0 0x5630a2d99a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb4557fa640 0 client.29569 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630a29b92f0 0x5630a2d99520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb47b1e4740 1 --2- 172.21.15.53:0/3353565366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5630a29a0d80 0x5630a2d9e080 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3353565366 >> 172.21.15.53:0/3353565366 conn(0x5630a29d6300 msgr2=0x5630a2d95c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3353565366 shutdown_connections 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb47b1e4740 1 -- 172.21.15.53:0/3353565366 wait complete. 2024-08-31T06:21:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.219+0000 7fb47b1e4740 20 client.29569 trim_cache size 0 max 16384 2024-08-31T06:21:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:21:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:21:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:21:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:21:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 -- 172.21.15.53:0/4145925386 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4580b4ca0 msgr2=0x7fb4580b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4580b4ca0 0x7fb4580b71b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x5630a2d84960 tx=0x7fb4680058d0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 -- 172.21.15.53:0/4145925386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb46c105010 msgr2=0x7fb46c19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb46c105010 0x7fb46c19a670 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00d770 tx=0x7fb45c00dc30 comp rx=0 tx=0).stop 2024-08-31T06:21:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 -- 172.21.15.53:0/4145925386 shutdown_connections 2024-08-31T06:21:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4580b4ca0 0x7fb4580b71b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb46c10db10 0x7fb46c19f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb46c105010 0x7fb46c19a670 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 --2- 172.21.15.53:0/4145925386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb46c1046c0 0x7fb46c19a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 -- 172.21.15.53:0/4145925386 >> 172.21.15.53:0/4145925386 conn(0x7fb46c07a490 msgr2=0x7fb46c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 -- 172.21.15.53:0/4145925386 shutdown_connections 2024-08-31T06:21:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:14.220+0000 7fb47419e640 1 -- 172.21.15.53:0/4145925386 wait complete. 2024-08-31T06:21:14.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:13 smithi053 ceph-mon[18924]: pgmap v832: 97 pgs: 97 active+clean; 462 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-08-31T06:21:14.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 18509 3.74 MB/sec execute 62 sec latency 85.410 ms 2024-08-31T06:21:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:13 smithi130 ceph-mon[22266]: pgmap v832: 97 pgs: 97 active+clean; 462 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-08-31T06:21:14.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:13 smithi153 ceph-mon[22320]: pgmap v832: 97 pgs: 97 active+clean; 462 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-08-31T06:21:14.560 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:21:14.561 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:21:14.925 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:15.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 18645 3.85 MB/sec execute 63 sec latency 92.342 ms 2024-08-31T06:21:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.659+0000 7fe4e6e73640 1 -- 172.21.15.53:0/135968084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e0104750 msgr2=0x7fe4e0104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.659+0000 7fe4e6e73640 1 --2- 172.21.15.53:0/135968084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e0104750 0x7fe4e0104b60 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009900 tx=0x7fe4d402a410 comp rx=0 tx=0).stop 2024-08-31T06:21:15.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.659+0000 7fe4e6e73640 1 -- 172.21.15.53:0/135968084 shutdown_connections 2024-08-31T06:21:15.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.659+0000 7fe4e6e73640 1 --2- 172.21.15.53:0/135968084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4e010dbb0 0x7fe4e01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.659+0000 7fe4e6e73640 1 --2- 172.21.15.53:0/135968084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e01050a0 0x7fe4e010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.659+0000 7fe4e6e73640 1 --2- 172.21.15.53:0/135968084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e0104750 0x7fe4e0104b60 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.659+0000 7fe4e6e73640 1 -- 172.21.15.53:0/135968084 >> 172.21.15.53:0/135968084 conn(0x7fe4e00794d0 msgr2=0x7fe4e00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:15.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.659+0000 7fe4e6e73640 1 -- 172.21.15.53:0/135968084 shutdown_connections 2024-08-31T06:21:15.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.659+0000 7fe4e6e73640 1 -- 172.21.15.53:0/135968084 wait complete. 2024-08-31T06:21:15.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.660+0000 7fe4e6e73640 1 Processor -- start 2024-08-31T06:21:15.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.660+0000 7fe4e6e73640 1 -- start start 2024-08-31T06:21:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4e6e73640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e0104750 0x7fe4e0197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4e6e73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01050a0 0x7fe4e0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4e6e73640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4e010dbb0 0x7fe4e019d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4e6e73640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01114d0 con 0x7fe4e01050a0 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4e6e73640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e0111350 con 0x7fe4e0104750 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4e6e73640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e0111650 con 0x7fe4e010dbb0 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01050a0 0x7fe4e0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01050a0 0x7fe4e0198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41160/0 (socket says 172.21.15.53:41160) 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4dffff640 1 -- 172.21.15.53:0/2927037655 learned_addr learned my addr 172.21.15.53:0/2927037655 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e0104750 0x7fe4e0197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4e4c0f640 1 -- 172.21.15.53:0/2927037655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4e010dbb0 msgr2=0x7fe4e019d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.661+0000 7fe4e5410640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4e010dbb0 0x7fe4e019d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.662+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4e010dbb0 0x7fe4e019d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.662+0000 7fe4e4c0f640 1 -- 172.21.15.53:0/2927037655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01050a0 msgr2=0x7fe4e0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:15.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.662+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01050a0 0x7fe4e0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.662+0000 7fe4e4c0f640 1 -- 172.21.15.53:0/2927037655 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e019def0 con 0x7fe4e0104750 2024-08-31T06:21:15.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.662+0000 7fe4e5410640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4e010dbb0 0x7fe4e019d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:15.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.662+0000 7fe4dffff640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01050a0 0x7fe4e0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:15.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.662+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e0104750 0x7fe4e0197f80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009230 tx=0x7fe4d4005e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:15.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.663+0000 7fe4ddffb640 1 -- 172.21.15.53:0/2927037655 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d403f070 con 0x7fe4e0104750 2024-08-31T06:21:15.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.663+0000 7fe4e6e73640 1 -- 172.21.15.53:0/2927037655 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e019e180 con 0x7fe4e0104750 2024-08-31T06:21:15.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.663+0000 7fe4e6e73640 1 -- 172.21.15.53:0/2927037655 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e01a4940 con 0x7fe4e0104750 2024-08-31T06:21:15.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.663+0000 7fe4ddffb640 1 -- 172.21.15.53:0/2927037655 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4d4003a80 con 0x7fe4e0104750 2024-08-31T06:21:15.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.663+0000 7fe4ddffb640 1 -- 172.21.15.53:0/2927037655 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4048060 con 0x7fe4e0104750 2024-08-31T06:21:15.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.666+0000 7fe4ed3e8740 1 Processor -- start 2024-08-31T06:21:15.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4ed3e8740 1 -- start start 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce2110350 0x561ce24b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 0x561ce24b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce20ef670 0x561ce24b7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4ed3e8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561ce242c5f0 con 0x561ce20e7490 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4ed3e8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561ce241bb80 con 0x561ce2110350 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4ed3e8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561ce241fb30 con 0x561ce20ef670 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4e5410640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce2110350 0x561ce24b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4e5410640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce2110350 0x561ce24b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43708/0 (socket says 172.21.15.53:43708) 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4dffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce20ef670 0x561ce24b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4e5410640 1 -- 172.21.15.53:0/1327575782 learned_addr learned my addr 172.21.15.53:0/1327575782 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.667+0000 7fe4ddffb640 1 -- 172.21.15.53:0/2927037655 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe4d4003c30 con 0x7fe4e0104750 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.668+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/1327575782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 0x561ce24b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.668+0000 7fe4dffff640 1 -- 172.21.15.53:0/1327575782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce2110350 msgr2=0x561ce24b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.668+0000 7fe4dffff640 1 --2- 172.21.15.53:0/1327575782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce2110350 0x561ce24b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.668+0000 7fe4dffff640 1 -- 172.21.15.53:0/1327575782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 msgr2=0x561ce24b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:15.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.669+0000 7fe4ddffb640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe4d00b4da0 0x7fe4d00b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.669+0000 7fe4dffff640 1 --2- 172.21.15.53:0/1327575782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 0x561ce24b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.669+0000 7fe4dffff640 1 -- 172.21.15.53:0/1327575782 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce217b930 con 0x561ce20ef670 2024-08-31T06:21:15.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.669+0000 7fe4e5410640 1 --2- 172.21.15.53:0/1327575782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce2110350 0x561ce24b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:15.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.669+0000 7fe4ddffb640 1 -- 172.21.15.53:0/2927037655 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fe4d4105990 con 0x7fe4e0104750 2024-08-31T06:21:15.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.669+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/1327575782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 0x561ce24b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:15.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.669+0000 7fe4e5410640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe4d00b4da0 0x7fe4d00b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.670+0000 7fe4dffff640 1 --2- 172.21.15.53:0/1327575782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce20ef670 0x561ce24b7200 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0114c0 tx=0x7fe4cc009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f15152715eb5b2fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.670+0000 7fe4caffd640 1 -- 172.21.15.53:0/1327575782 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc01e070 con 0x561ce20ef670 2024-08-31T06:21:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.670+0000 7fe4e5410640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe4d00b4da0 0x7fe4d00b72b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800dfd0 tx=0x7fe4d800f040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.670+0000 7fe4caffd640 1 -- 172.21.15.53:0/1327575782 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4cc0044c0 con 0x561ce20ef670 2024-08-31T06:21:15.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.670+0000 7fe4caffd640 1 -- 172.21.15.53:0/1327575782 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00f7a0 con 0x561ce20ef670 2024-08-31T06:21:15.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.671+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/1327575782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce20ef670 msgr2=0x561ce24b7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:15.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.671+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/1327575782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce20ef670 0x561ce24b7200 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0114c0 tx=0x7fe4cc009f90 comp rx=0 tx=0).stop 2024-08-31T06:21:15.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.671+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/1327575782 shutdown_connections 2024-08-31T06:21:15.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.671+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/1327575782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce20ef670 0x561ce24b7200 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.671+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/1327575782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 0x561ce24b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.671+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/1327575782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce2110350 0x561ce24b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.671+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/1327575782 >> 172.21.15.53:0/1327575782 conn(0x561ce2104740 msgr2=0x561ce24b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:15.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.671+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/1327575782 shutdown_connections 2024-08-31T06:21:15.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.671+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/1327575782 wait complete. 2024-08-31T06:21:15.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.672+0000 7fe4ed3e8740 1 -- start start 2024-08-31T06:21:15.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.672+0000 7fe4ed3e8740 1 Processor -- start 2024-08-31T06:21:15.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.672+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 0x561ce24c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.672+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20ef670 0x561ce24c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce2110350 0x561ce24c2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4ed3e8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561ce227e890 con 0x561ce20e7490 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4ed3e8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561ce23a2790 con 0x561ce20ef670 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4ed3e8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561ce24cd810 con 0x561ce2110350 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4e4c0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 0x561ce24c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4ed3e8740 10 client.0 _ll_register_callbacks cb 0x561ce2127ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4e4c0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 0x561ce24c1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41176/0 (socket says 172.21.15.53:41176) 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4e5410640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce2110350 0x561ce24c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4e4c0f640 1 -- 172.21.15.53:0/4263232971 learned_addr learned my addr 172.21.15.53:0/4263232971 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4dffff640 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20ef670 0x561ce24c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4e4c0f640 1 -- 172.21.15.53:0/4263232971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce2110350 msgr2=0x561ce24c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce2110350 0x561ce24c2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4e4c0f640 1 -- 172.21.15.53:0/4263232971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20ef670 msgr2=0x561ce24c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20ef670 0x561ce24c22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.673+0000 7fe4e4c0f640 1 -- 172.21.15.53:0/4263232971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce23d9f30 con 0x561ce20e7490 2024-08-31T06:21:15.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.674+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 0x561ce24c1d90 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40c9250 tx=0x7fe4d403a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218e99f62c0208d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:15.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.674+0000 7fe4bffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:15.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.674+0000 7fe4bffff640 1 -- 172.21.15.53:0/4263232971 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4035070 con 0x561ce20e7490 2024-08-31T06:21:15.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.674+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/4263232971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561ce242e540 con 0x561ce20e7490 2024-08-31T06:21:15.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.674+0000 7fe4bffff640 1 -- 172.21.15.53:0/4263232971 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fe4d40cc450 con 0x561ce20e7490 2024-08-31T06:21:15.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.675+0000 7fe4bffff640 1 -- 172.21.15.53:0/4263232971 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fe4d40cb750 con 0x561ce20e7490 2024-08-31T06:21:15.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.676+0000 7fe4ed3e8740 10 client.20676 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:15.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.676+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/4263232971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x561ce24d93e0 con 0x561ce20e7490 2024-08-31T06:21:15.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.676+0000 7fe4bffff640 1 -- 172.21.15.53:0/4263232971 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4d40cbaf0 con 0x561ce20e7490 2024-08-31T06:21:15.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.676+0000 7fe4bffff640 1 -- 172.21.15.53:0/4263232971 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fe4d40d3bd0 con 0x561ce20e7490 2024-08-31T06:21:15.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.677+0000 7fe4ed3e8740 10 client.20676 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:15.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.677+0000 7fe4ed3e8740 10 client.20676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:15.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.677+0000 7fe4ed3e8740 20 client.20676 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:15.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.677+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ce20cecd0 0x561ce24dcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.677+0000 7fe4ed3e8740 4 client.20676 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:15.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.677+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/4263232971 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ce242e540 con 0x561ce20cecd0 2024-08-31T06:21:15.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.677+0000 7fe4dffff640 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ce20cecd0 0x561ce24dcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.678+0000 7fe4bffff640 10 client.20676 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:15.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.678+0000 7fe4dffff640 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ce20cecd0 0x561ce24dcaf0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f6279469687dc60 server_cookie=fc9a51da7c824de7 in_seq=0 out_seq=0 2024-08-31T06:21:15.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.679+0000 7fe4bffff640 1 -- 172.21.15.53:0/4263232971 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ce242e540 con 0x561ce20cecd0 2024-08-31T06:21:15.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.679+0000 7fe4bffff640 10 client.20676 handle_command_reply: tid=0 2024-08-31T06:21:15.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.679+0000 7fe4ed3e8740 1 client.20676 shutdown 2024-08-31T06:21:15.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.679+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/4263232971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 msgr2=0x561ce24c1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:15.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.679+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 0x561ce24c1d90 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40c9250 tx=0x7fe4d403a3c0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.680+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/4263232971 shutdown_connections 2024-08-31T06:21:15.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.680+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ce20cecd0 0x561ce24dcaf0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.680+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce2110350 0x561ce24c2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.680+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20ef670 0x561ce24c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.680+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/4263232971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20e7490 0x561ce24c1d90 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.680+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/4263232971 >> 172.21.15.53:0/4263232971 conn(0x561ce2104740 msgr2=0x561ce24b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:15.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.680+0000 7fe4bffff640 0 client.20676 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.680+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/4263232971 shutdown_connections 2024-08-31T06:21:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.680+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/4263232971 wait complete. 2024-08-31T06:21:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.681+0000 7fe4ed3e8740 20 client.20676 trim_cache size 0 max 16384 2024-08-31T06:21:15.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.714+0000 7fe4ed3e8740 1 Processor -- start 2024-08-31T06:21:15.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.714+0000 7fe4ed3e8740 1 -- start start 2024-08-31T06:21:15.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 0x561ce24b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20ef670 0x561ce24bef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce2110350 0x561ce24bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4ed3e8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c400e990 con 0x561ce20ef670 2024-08-31T06:21:15.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4ed3e8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c4010650 con 0x561ce20e7490 2024-08-31T06:21:15.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4ed3e8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c400f060 con 0x561ce2110350 2024-08-31T06:21:15.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20ef670 0x561ce24bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20ef670 0x561ce24bef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41180/0 (socket says 172.21.15.53:41180) 2024-08-31T06:21:15.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4dffff640 1 -- 172.21.15.53:0/1240558110 learned_addr learned my addr 172.21.15.53:0/1240558110 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:15.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4e5410640 1 --2- 172.21.15.53:0/1240558110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce2110350 0x561ce24bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/1240558110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 0x561ce24b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4dffff640 1 -- 172.21.15.53:0/1240558110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce2110350 msgr2=0x561ce24bf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4dffff640 1 --2- 172.21.15.53:0/1240558110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce2110350 0x561ce24bf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4dffff640 1 -- 172.21.15.53:0/1240558110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 msgr2=0x561ce24b7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4dffff640 1 --2- 172.21.15.53:0/1240558110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 0x561ce24b7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.715+0000 7fe4dffff640 1 -- 172.21.15.53:0/1240558110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce24b8a70 con 0x561ce20ef670 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.716+0000 7fe4dffff640 1 --2- 172.21.15.53:0/1240558110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20ef670 0x561ce24bef80 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009790 tx=0x7fe4cc012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c506c8f36ccdc9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.716+0000 7fe4ca7fc640 1 -- 172.21.15.53:0/1240558110 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc032070 con 0x561ce20ef670 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.716+0000 7fe4ca7fc640 1 -- 172.21.15.53:0/1240558110 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4cc009bb0 con 0x561ce20ef670 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.716+0000 7fe4ca7fc640 1 -- 172.21.15.53:0/1240558110 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc01e040 con 0x561ce20ef670 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.718+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/1240558110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20ef670 msgr2=0x561ce24bef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.718+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/1240558110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20ef670 0x561ce24bef80 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009790 tx=0x7fe4cc012ed0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.718+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/1240558110 shutdown_connections 2024-08-31T06:21:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.718+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/1240558110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce2110350 0x561ce24bf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.718+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/1240558110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce20ef670 0x561ce24bef80 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.718+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/1240558110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 0x561ce24b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.718+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/1240558110 >> 172.21.15.53:0/1240558110 conn(0x561ce2104740 msgr2=0x561ce24b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.718+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/1240558110 shutdown_connections 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.718+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/1240558110 wait complete. 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.719+0000 7fe4ed3e8740 1 -- start start 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.719+0000 7fe4ed3e8740 1 Processor -- start 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.720+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 0x561ce24d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.720+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce20ef670 0x561ce24d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.720+0000 7fe4ed3e8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce2110350 0x561ce2546500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.720+0000 7fe4e4c0f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 0x561ce24d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.720+0000 7fe4e4c0f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 0x561ce24d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43740/0 (socket says 172.21.15.53:43740) 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.720+0000 7fe4e5410640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce2110350 0x561ce2546500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.720+0000 7fe4e4c0f640 1 -- 172.21.15.53:0/3929330210 learned_addr learned my addr 172.21.15.53:0/3929330210 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.720+0000 7fe4dffff640 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce20ef670 0x561ce24d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.720+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/3929330210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c400ff80 con 0x561ce2110350 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.720+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/3929330210 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c400f7f0 con 0x561ce20e7490 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.720+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/3929330210 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c400c990 con 0x561ce20ef670 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.721+0000 7fe4ed3e8740 10 client.0 _ll_register_callbacks cb 0x7fe4d41034f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.721+0000 7fe4e4c0f640 1 -- 172.21.15.53:0/3929330210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce20ef670 msgr2=0x561ce24d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.721+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce20ef670 0x561ce24d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.721+0000 7fe4e4c0f640 1 -- 172.21.15.53:0/3929330210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce2110350 msgr2=0x561ce2546500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.721+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce2110350 0x561ce2546500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.721+0000 7fe4e4c0f640 1 -- 172.21.15.53:0/3929330210 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce2546a40 con 0x561ce20e7490 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.721+0000 7fe4e5410640 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce2110350 0x561ce2546500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.722+0000 7fe4e4c0f640 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 0x561ce24d0e80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40b7380 tx=0x7fe4d40b71a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acd7352e166ea7c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.722+0000 7fe4bffff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.722+0000 7fe4bffff640 1 -- 172.21.15.53:0/3929330210 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d40f1020 con 0x561ce20e7490 2024-08-31T06:21:15.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.722+0000 7fe4bffff640 1 -- 172.21.15.53:0/3929330210 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fe4d4003800 con 0x561ce20e7490 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.722+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/3929330210 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4cc009bb0 con 0x561ce20e7490 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.723+0000 7fe4bffff640 1 -- 172.21.15.53:0/3929330210 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fe4d4035070 con 0x561ce20e7490 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.723+0000 7fe4ed3e8740 10 client.29600 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.723+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/3929330210 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x561ce2547b60 con 0x561ce20e7490 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.723+0000 7fe4bffff640 1 -- 172.21.15.53:0/3929330210 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4d4079030 con 0x561ce20e7490 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.723+0000 7fe4bffff640 1 -- 172.21.15.53:0/3929330210 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fe4d40c7950 con 0x561ce20e7490 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.723+0000 7fe4ed3e8740 10 client.29600 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.723+0000 7fe4ed3e8740 10 client.29600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.723+0000 7fe4ed3e8740 20 client.29600 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.723+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ce20a4080 0x561ce254a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.723+0000 7fe4ed3e8740 4 client.29600 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.723+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/3929330210 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fe4cc009bb0 con 0x561ce20a4080 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.724+0000 7fe4dffff640 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ce20a4080 0x561ce254a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:15.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.724+0000 7fe4bffff640 10 client.29600 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.724+0000 7fe4dffff640 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ce20a4080 0x561ce254a1e0 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db5643a60b90f175 server_cookie=53d01e033985d415 in_seq=0 out_seq=0 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.726+0000 7fe4bffff640 1 -- 172.21.15.53:0/3929330210 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fe4cc009bb0 con 0x561ce20a4080 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.726+0000 7fe4bffff640 10 client.29600 handle_command_reply: tid=0 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.726+0000 7fe4ed3e8740 1 client.29600 shutdown 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.727+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/3929330210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 msgr2=0x561ce24d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.727+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 0x561ce24d0e80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40b7380 tx=0x7fe4d40b71a0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.727+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/3929330210 shutdown_connections 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.727+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ce20a4080 0x561ce254a1e0 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.727+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ce2110350 0x561ce2546500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.727+0000 7fe4bffff640 0 client.29600 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.727+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ce20ef670 0x561ce24d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.727+0000 7fe4ed3e8740 1 --2- 172.21.15.53:0/3929330210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ce20e7490 0x561ce24d0e80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.727+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/3929330210 >> 172.21.15.53:0/3929330210 conn(0x561ce2104740 msgr2=0x561ce24b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.727+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/3929330210 shutdown_connections 2024-08-31T06:21:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.728+0000 7fe4ed3e8740 1 -- 172.21.15.53:0/3929330210 wait complete. 2024-08-31T06:21:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.728+0000 7fe4ed3e8740 20 client.29600 trim_cache size 0 max 16384 2024-08-31T06:21:15.794 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:21:15.794 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:21:15.794 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "1087e56d-4883-4320-a656-e3bc73bc3344", 2024-08-31T06:21:15.794 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:21:15.794 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:21:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.729+0000 7fe4e6e73640 1 -- 172.21.15.53:0/2927037655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe4d00b4da0 msgr2=0x7fe4d00b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.729+0000 7fe4e6e73640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe4d00b4da0 0x7fe4d00b72b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800dfd0 tx=0x7fe4d800f040 comp rx=0 tx=0).stop 2024-08-31T06:21:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.729+0000 7fe4e6e73640 1 -- 172.21.15.53:0/2927037655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e0104750 msgr2=0x7fe4e0197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.729+0000 7fe4e6e73640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e0104750 0x7fe4e0197f80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009230 tx=0x7fe4d4005e10 comp rx=0 tx=0).stop 2024-08-31T06:21:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.729+0000 7fe4e6e73640 1 -- 172.21.15.53:0/2927037655 shutdown_connections 2024-08-31T06:21:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.729+0000 7fe4e6e73640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe4d00b4da0 0x7fe4d00b72b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.729+0000 7fe4e6e73640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4e010dbb0 0x7fe4e019d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.729+0000 7fe4e6e73640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01050a0 0x7fe4e0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.729+0000 7fe4e6e73640 1 --2- 172.21.15.53:0/2927037655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4e0104750 0x7fe4e0197f80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.729+0000 7fe4e6e73640 1 -- 172.21.15.53:0/2927037655 >> 172.21.15.53:0/2927037655 conn(0x7fe4e00794d0 msgr2=0x7fe4e0100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:15.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.730+0000 7fe4e6e73640 1 -- 172.21.15.53:0/2927037655 shutdown_connections 2024-08-31T06:21:15.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:15.730+0000 7fe4e6e73640 1 -- 172.21.15.53:0/2927037655 wait complete. 2024-08-31T06:21:15.796 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:15 smithi053 ceph-mon[18924]: osdmap e96: 12 total, 12 up, 12 in 2024-08-31T06:21:15.796 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:15 smithi053 ceph-mon[18924]: pgmap v834: 97 pgs: 97 active+clean; 468 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 2.4 MiB/s wr, 179 op/s 2024-08-31T06:21:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:15 smithi130 ceph-mon[22266]: osdmap e96: 12 total, 12 up, 12 in 2024-08-31T06:21:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:15 smithi130 ceph-mon[22266]: pgmap v834: 97 pgs: 97 active+clean; 468 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 2.4 MiB/s wr, 179 op/s 2024-08-31T06:21:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:15 smithi153 ceph-mon[22320]: osdmap e96: 12 total, 12 up, 12 in 2024-08-31T06:21:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:15 smithi153 ceph-mon[22320]: pgmap v834: 97 pgs: 97 active+clean; 468 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 2.4 MiB/s wr, 179 op/s 2024-08-31T06:21:16.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 18720 3.83 MB/sec execute 64 sec latency 450.066 ms 2024-08-31T06:21:16.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:21:16.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:21:16.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:21:16.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:21:16.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:16.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:16.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:21:16.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:21:16.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:21:16.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:21:16.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:16.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:16.891 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:21:16.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:21:16.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:21:16.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:21:16.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:21:16.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:16.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.266 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:17.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 18881 3.97 MB/sec execute 65 sec latency 273.124 ms 2024-08-31T06:21:17.708 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:17 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:21:17.708 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:17 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.708 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:17 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:21:17.708 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:17 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.708 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:17 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.708 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:17 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.708 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:17 smithi053 ceph-mon[18924]: pgmap v835: 97 pgs: 97 active+clean; 475 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-08-31T06:21:17.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.841+0000 7f3554f04640 1 -- 172.21.15.53:0/1386208384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3550102800 msgr2=0x7f3550102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:17.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.841+0000 7f3554f04640 1 --2- 172.21.15.53:0/1386208384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3550102800 0x7f3550102c10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3540009900 tx=0x7f354002a410 comp rx=0 tx=0).stop 2024-08-31T06:21:17.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.841+0000 7f3554f04640 1 -- 172.21.15.53:0/1386208384 shutdown_connections 2024-08-31T06:21:17.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.841+0000 7f3554f04640 1 --2- 172.21.15.53:0/1386208384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3550108a90 0x7f355010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.841+0000 7f3554f04640 1 --2- 172.21.15.53:0/1386208384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3550108140 0x7f3550108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.841+0000 7f3554f04640 1 --2- 172.21.15.53:0/1386208384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3550102800 0x7f3550102c10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.841+0000 7f3554f04640 1 -- 172.21.15.53:0/1386208384 >> 172.21.15.53:0/1386208384 conn(0x7f35500794d0 msgr2=0x7f35500798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:17.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.841+0000 7f3554f04640 1 -- 172.21.15.53:0/1386208384 shutdown_connections 2024-08-31T06:21:17.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.842+0000 7f3554f04640 1 -- 172.21.15.53:0/1386208384 wait complete. 2024-08-31T06:21:17.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.843+0000 7f3554f04640 1 Processor -- start 2024-08-31T06:21:17.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.843+0000 7f3554f04640 1 -- start start 2024-08-31T06:21:17.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.843+0000 7f3554f04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3550102800 0x7f355019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.843+0000 7f3554f04640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3550108140 0x7f355019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.843+0000 7f3554f04640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3550108a90 0x7f35501a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.843+0000 7f354e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3550102800 0x7f355019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.843+0000 7f354e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3550102800 0x7f355019c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41198/0 (socket says 172.21.15.53:41198) 2024-08-31T06:21:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.844+0000 7f354e59c640 1 -- 172.21.15.53:0/1637512372 learned_addr learned my addr 172.21.15.53:0/1637512372 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.844+0000 7f3554f04640 1 -- 172.21.15.53:0/1637512372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f35501114b0 con 0x7f3550102800 2024-08-31T06:21:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.844+0000 7f3554f04640 1 -- 172.21.15.53:0/1637512372 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3550111330 con 0x7f3550108a90 2024-08-31T06:21:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.844+0000 7f3554f04640 1 -- 172.21.15.53:0/1637512372 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3550111630 con 0x7f3550108140 2024-08-31T06:21:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.844+0000 7f354dd9b640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3550108140 0x7f355019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.844+0000 7f354e59c640 1 -- 172.21.15.53:0/1637512372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3550108140 msgr2=0x7f355019c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.844+0000 7f354e59c640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3550108140 0x7f355019c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.844+0000 7f354e59c640 1 -- 172.21.15.53:0/1637512372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3550108a90 msgr2=0x7f35501a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.844+0000 7f354e59c640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3550108a90 0x7f35501a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.844+0000 7f354e59c640 1 -- 172.21.15.53:0/1637512372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35501a2360 con 0x7f3550102800 2024-08-31T06:21:17.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.844+0000 7f354e59c640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3550102800 0x7f355019c3f0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3540009230 tx=0x7f35400319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:17.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.845+0000 7f353f7fe640 1 -- 172.21.15.53:0/1637512372 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354003f030 con 0x7f3550102800 2024-08-31T06:21:17.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.845+0000 7f3554f04640 1 -- 172.21.15.53:0/1637512372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35501a25f0 con 0x7f3550102800 2024-08-31T06:21:17.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.845+0000 7f353f7fe640 1 -- 172.21.15.53:0/1637512372 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35400043d0 con 0x7f3550102800 2024-08-31T06:21:17.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.845+0000 7f353f7fe640 1 -- 172.21.15.53:0/1637512372 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540035070 con 0x7f3550102800 2024-08-31T06:21:17.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.845+0000 7f3554f04640 1 -- 172.21.15.53:0/1637512372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35501a8db0 con 0x7f3550102800 2024-08-31T06:21:17.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.848+0000 7f353f7fe640 1 -- 172.21.15.53:0/1637512372 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3540042030 con 0x7f3550102800 2024-08-31T06:21:17.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.849+0000 7f355b479740 1 Processor -- start 2024-08-31T06:21:17.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.849+0000 7f355b479740 1 -- start start 2024-08-31T06:21:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.849+0000 7f355b479740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 0x56394883d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.849+0000 7f355b479740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394846f1b0 0x56394883d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.849+0000 7f355b479740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948477390 0x56394883dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.849+0000 7f355b479740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5639487b4630 con 0x56394846f1b0 2024-08-31T06:21:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.849+0000 7f355b479740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5639487a3bc0 con 0x563948477390 2024-08-31T06:21:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.849+0000 7f355b479740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5639487a7b70 con 0x563948498070 2024-08-31T06:21:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 0x56394883d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 0x56394883d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:34774/0 (socket says 172.21.15.53:34774) 2024-08-31T06:21:17.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354ed9d640 1 -- 172.21.15.53:0/1218507964 learned_addr learned my addr 172.21.15.53:0/1218507964 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:17.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354e59c640 1 --2- 172.21.15.53:0/1218507964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394846f1b0 0x56394883d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354dd9b640 1 --2- 172.21.15.53:0/1218507964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948477390 0x56394883dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354dd9b640 1 -- 172.21.15.53:0/1218507964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 msgr2=0x56394883d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354dd9b640 1 --2- 172.21.15.53:0/1218507964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 0x56394883d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354dd9b640 1 -- 172.21.15.53:0/1218507964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394846f1b0 msgr2=0x56394883d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354dd9b640 1 --2- 172.21.15.53:0/1218507964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394846f1b0 0x56394883d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354dd9b640 1 -- 172.21.15.53:0/1218507964 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563948503650 con 0x563948477390 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354ed9d640 1 --2- 172.21.15.53:0/1218507964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 0x56394883d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f354dd9b640 1 --2- 172.21.15.53:0/1218507964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948477390 0x56394883dd80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f355006a840 tx=0x7f35440113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b963650d7388af5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.850+0000 7f353f7fe640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f35380b4de0 0x7f35380b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.851+0000 7f353cff9640 1 -- 172.21.15.53:0/1218507964 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544011de0 con 0x563948477390 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.851+0000 7f353cff9640 1 -- 172.21.15.53:0/1218507964 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35440128e0 con 0x563948477390 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.851+0000 7f353cff9640 1 -- 172.21.15.53:0/1218507964 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354400f880 con 0x563948477390 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.851+0000 7f353f7fe640 1 -- 172.21.15.53:0/1637512372 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f3540105980 con 0x7f3550102800 2024-08-31T06:21:17.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.851+0000 7f354ed9d640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f35380b4de0 0x7f35380b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.852+0000 7f354ed9d640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f35380b4de0 0x7f35380b72f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f35480099a0 tx=0x7f35480098d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:17.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.852+0000 7f355b479740 1 -- 172.21.15.53:0/1218507964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948477390 msgr2=0x56394883dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:17.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.852+0000 7f355b479740 1 --2- 172.21.15.53:0/1218507964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948477390 0x56394883dd80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f355006a840 tx=0x7f35440113e0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.852+0000 7f355b479740 1 -- 172.21.15.53:0/1218507964 shutdown_connections 2024-08-31T06:21:17.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.852+0000 7f355b479740 1 --2- 172.21.15.53:0/1218507964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948477390 0x56394883dd80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.852+0000 7f355b479740 1 --2- 172.21.15.53:0/1218507964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394846f1b0 0x56394883d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.852+0000 7f355b479740 1 --2- 172.21.15.53:0/1218507964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 0x56394883d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.852+0000 7f355b479740 1 -- 172.21.15.53:0/1218507964 >> 172.21.15.53:0/1218507964 conn(0x56394848c460 msgr2=0x56394883b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:17.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.852+0000 7f355b479740 1 -- 172.21.15.53:0/1218507964 shutdown_connections 2024-08-31T06:21:17.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.852+0000 7f355b479740 1 -- 172.21.15.53:0/1218507964 wait complete. 2024-08-31T06:21:17.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.853+0000 7f355b479740 1 -- start start 2024-08-31T06:21:17.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.853+0000 7f355b479740 1 Processor -- start 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.853+0000 7f355b479740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56394846f1b0 0x563948848a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.853+0000 7f355b479740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948477390 0x563948848f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f355b479740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948498070 0x563948854e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f355b479740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563948606700 con 0x563948498070 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f355b479740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56394872a700 con 0x563948477390 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f355b479740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56394884bb80 con 0x56394846f1b0 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f354ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948498070 0x563948854e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f354ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948498070 0x563948854e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41212/0 (socket says 172.21.15.53:41212) 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f354ed9d640 1 -- 172.21.15.53:0/910050757 learned_addr learned my addr 172.21.15.53:0/910050757 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f354e59c640 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56394846f1b0 0x563948848a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f354dd9b640 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948477390 0x563948848f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f355b479740 10 client.0 _ll_register_callbacks cb 0x563948759dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f354e59c640 1 -- 172.21.15.53:0/910050757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948477390 msgr2=0x563948848f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f354e59c640 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948477390 0x563948848f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f354e59c640 1 -- 172.21.15.53:0/910050757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948498070 msgr2=0x563948854e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f354e59c640 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948498070 0x563948854e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.854+0000 7f354e59c640 1 -- 172.21.15.53:0/910050757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639487638b0 con 0x56394846f1b0 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.855+0000 7f354e59c640 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56394846f1b0 0x563948848a00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f35401030b0 tx=0x7f3540109040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26bc784ea40b9d39 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.855+0000 7f3535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.855+0000 7f3535ffb640 1 -- 172.21.15.53:0/910050757 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540049070 con 0x56394846f1b0 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.855+0000 7f355b479740 1 -- 172.21.15.53:0/910050757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35440128e0 con 0x56394846f1b0 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.855+0000 7f3535ffb640 1 -- 172.21.15.53:0/910050757 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f35400d50f0 con 0x56394846f1b0 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.855+0000 7f3535ffb640 1 -- 172.21.15.53:0/910050757 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f35400cba80 con 0x56394846f1b0 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.855+0000 7f355b479740 10 client.29593 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.855+0000 7f355b479740 1 -- 172.21.15.53:0/910050757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x563948860100 con 0x56394846f1b0 2024-08-31T06:21:17.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.856+0000 7f3535ffb640 1 -- 172.21.15.53:0/910050757 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35440128e0 con 0x56394846f1b0 2024-08-31T06:21:17.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.856+0000 7f3535ffb640 1 -- 172.21.15.53:0/910050757 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f35400c7ca0 con 0x56394846f1b0 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.856+0000 7f355b479740 10 client.29593 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.856+0000 7f355b479740 10 client.29593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.856+0000 7f355b479740 20 client.29593 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.856+0000 7f355b479740 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5639484569f0 0x5639488637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.856+0000 7f355b479740 4 client.29593 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.856+0000 7f355b479740 1 -- 172.21.15.53:0/910050757 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639487b6580 con 0x5639484569f0 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.856+0000 7f354dd9b640 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5639484569f0 0x5639488637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.857+0000 7f354dd9b640 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5639484569f0 0x5639488637c0 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=259ce24ea7284012 server_cookie=24d7ffe5ae6311ee in_seq=0 out_seq=0 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.857+0000 7f3535ffb640 10 client.29593 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f3535ffb640 1 -- 172.21.15.53:0/910050757 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5639487b6580 con 0x5639484569f0 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f3535ffb640 10 client.29593 handle_command_reply: tid=0 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 1 client.29593 shutdown 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 1 -- 172.21.15.53:0/910050757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56394846f1b0 msgr2=0x563948848a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:17.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56394846f1b0 0x563948848a00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f35401030b0 tx=0x7f3540109040 comp rx=0 tx=0).stop 2024-08-31T06:21:17.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 1 -- 172.21.15.53:0/910050757 shutdown_connections 2024-08-31T06:21:17.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5639484569f0 0x5639488637c0 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948498070 0x563948854e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948477390 0x563948848f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 1 --2- 172.21.15.53:0/910050757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56394846f1b0 0x563948848a00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 1 -- 172.21.15.53:0/910050757 >> 172.21.15.53:0/910050757 conn(0x56394848c460 msgr2=0x56394883e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:17.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f3535ffb640 0 client.29593 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:17.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 1 -- 172.21.15.53:0/910050757 shutdown_connections 2024-08-31T06:21:17.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 1 -- 172.21.15.53:0/910050757 wait complete. 2024-08-31T06:21:17.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.858+0000 7f355b479740 20 client.29593 trim_cache size 0 max 16384 2024-08-31T06:21:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:17 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:21:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:17 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:17 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:21:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:17 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:17 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:17 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:17 smithi130 ceph-mon[22266]: pgmap v835: 97 pgs: 97 active+clean; 475 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-08-31T06:21:17.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.882+0000 7f355b479740 1 Processor -- start 2024-08-31T06:21:17.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.882+0000 7f355b479740 1 -- start start 2024-08-31T06:21:17.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f355b479740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56394846f1b0 0x5639488478f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f355b479740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948477390 0x563948848ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f355b479740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948498070 0x563948845bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f355b479740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f35501ad310 con 0x563948477390 2024-08-31T06:21:17.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f355b479740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f35501aefd0 con 0x563948498070 2024-08-31T06:21:17.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f355b479740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f35501ad9e0 con 0x56394846f1b0 2024-08-31T06:21:17.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f354dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948477390 0x563948848ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f354e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56394846f1b0 0x5639488478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f354dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948477390 0x563948848ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41226/0 (socket says 172.21.15.53:41226) 2024-08-31T06:21:17.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f354dd9b640 1 -- 172.21.15.53:0/1106254503 learned_addr learned my addr 172.21.15.53:0/1106254503 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:17.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f354ed9d640 1 --2- 172.21.15.53:0/1106254503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948498070 0x563948845bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f354dd9b640 1 -- 172.21.15.53:0/1106254503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56394846f1b0 msgr2=0x5639488478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:17.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f354dd9b640 1 --2- 172.21.15.53:0/1106254503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56394846f1b0 0x5639488478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f354dd9b640 1 -- 172.21.15.53:0/1106254503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948498070 msgr2=0x563948845bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:17.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f354dd9b640 1 --2- 172.21.15.53:0/1106254503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948498070 0x563948845bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.883+0000 7f354dd9b640 1 -- 172.21.15.53:0/1106254503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563948843630 con 0x563948477390 2024-08-31T06:21:17.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.884+0000 7f354dd9b640 1 --2- 172.21.15.53:0/1106254503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948477390 0x563948848ec0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f354401c040 tx=0x7f35440058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361d6418aebb88e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:17.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.884+0000 7f3537fff640 1 -- 172.21.15.53:0/1106254503 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544005030 con 0x563948477390 2024-08-31T06:21:17.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.884+0000 7f3537fff640 1 -- 172.21.15.53:0/1106254503 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35440035f0 con 0x563948477390 2024-08-31T06:21:17.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.884+0000 7f3537fff640 1 -- 172.21.15.53:0/1106254503 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440127b0 con 0x563948477390 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.885+0000 7f355b479740 1 -- 172.21.15.53:0/1106254503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948477390 msgr2=0x563948848ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.885+0000 7f355b479740 1 --2- 172.21.15.53:0/1106254503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948477390 0x563948848ec0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f354401c040 tx=0x7f35440058b0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.885+0000 7f355b479740 1 -- 172.21.15.53:0/1106254503 shutdown_connections 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.885+0000 7f355b479740 1 --2- 172.21.15.53:0/1106254503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563948498070 0x563948845bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.885+0000 7f355b479740 1 --2- 172.21.15.53:0/1106254503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563948477390 0x563948848ec0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.885+0000 7f355b479740 1 --2- 172.21.15.53:0/1106254503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56394846f1b0 0x5639488478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.885+0000 7f355b479740 1 -- 172.21.15.53:0/1106254503 >> 172.21.15.53:0/1106254503 conn(0x56394848c460 msgr2=0x5639488487b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.886+0000 7f355b479740 1 -- 172.21.15.53:0/1106254503 shutdown_connections 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.886+0000 7f355b479740 1 -- 172.21.15.53:0/1106254503 wait complete. 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.886+0000 7f355b479740 1 -- start start 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.886+0000 7f355b479740 1 Processor -- start 2024-08-31T06:21:17.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f355b479740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56394846f1b0 0x563948851430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f355b479740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 0x56394884c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f355b479740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394842bda0 0x56394884ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f355b479740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f35501ae900 con 0x56394842bda0 2024-08-31T06:21:17.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f355b479740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f35501ae170 con 0x56394846f1b0 2024-08-31T06:21:17.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f355b479740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f35501ab330 con 0x563948498070 2024-08-31T06:21:17.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f355b479740 10 client.0 _ll_register_callbacks cb 0x7f3540005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:17.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f354ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394842bda0 0x56394884ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f354ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394842bda0 0x56394884ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41238/0 (socket says 172.21.15.53:41238) 2024-08-31T06:21:17.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f354ed9d640 1 -- 172.21.15.53:0/3035287821 learned_addr learned my addr 172.21.15.53:0/3035287821 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:17.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f354e59c640 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56394846f1b0 0x563948851430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f354dd9b640 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 0x56394884c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f354ed9d640 1 -- 172.21.15.53:0/3035287821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 msgr2=0x56394884c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f354ed9d640 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 0x56394884c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f354ed9d640 1 -- 172.21.15.53:0/3035287821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56394846f1b0 msgr2=0x563948851430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f354ed9d640 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56394846f1b0 0x563948851430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f354ed9d640 1 -- 172.21.15.53:0/3035287821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56394884d460 con 0x56394842bda0 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.887+0000 7f354e59c640 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56394846f1b0 0x563948851430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.888+0000 7f354ed9d640 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394842bda0 0x56394884ce20 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f3548003f30 tx=0x7f3548004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523aef2bed6e01aa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.888+0000 7f3535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.888+0000 7f3535ffb640 1 -- 172.21.15.53:0/3035287821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548004840 con 0x56394842bda0 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.888+0000 7f3535ffb640 1 -- 172.21.15.53:0/3035287821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f354800f5c0 con 0x56394842bda0 2024-08-31T06:21:17.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.888+0000 7f355b479740 1 -- 172.21.15.53:0/3035287821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35440035f0 con 0x56394842bda0 2024-08-31T06:21:17.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.888+0000 7f3535ffb640 1 -- 172.21.15.53:0/3035287821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f354800f7c0 con 0x56394842bda0 2024-08-31T06:21:17.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.888+0000 7f355b479740 10 client.20700 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:17.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.888+0000 7f355b479740 1 -- 172.21.15.53:0/3035287821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5639488cdff0 con 0x56394842bda0 2024-08-31T06:21:17.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.889+0000 7f3535ffb640 1 -- 172.21.15.53:0/3035287821 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35440035f0 con 0x56394842bda0 2024-08-31T06:21:17.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.889+0000 7f3535ffb640 1 -- 172.21.15.53:0/3035287821 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f3548027030 con 0x56394842bda0 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.889+0000 7f355b479740 10 client.20700 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.889+0000 7f355b479740 10 client.20700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.889+0000 7f355b479740 20 client.20700 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.889+0000 7f355b479740 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5639488ce730 0x5639488d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.889+0000 7f355b479740 4 client.20700 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.889+0000 7f355b479740 1 -- 172.21.15.53:0/3035287821 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5639487b2020 con 0x5639488ce730 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.889+0000 7f354e59c640 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5639488ce730 0x5639488d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.890+0000 7f3535ffb640 10 client.20700 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.890+0000 7f354e59c640 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5639488ce730 0x5639488d0b50 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f9098751dd19b17 server_cookie=a65d47fcd2cfbc53 in_seq=0 out_seq=0 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.890+0000 7f3535ffb640 1 -- 172.21.15.53:0/3035287821 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6250 (crc 0 0 0) 0x5639487b2020 con 0x5639488ce730 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.890+0000 7f3535ffb640 10 client.20700 handle_command_reply: tid=0 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.890+0000 7f355b479740 1 client.20700 shutdown 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.890+0000 7f355b479740 1 -- 172.21.15.53:0/3035287821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394842bda0 msgr2=0x56394884ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.890+0000 7f355b479740 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394842bda0 0x56394884ce20 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f3548003f30 tx=0x7f3548004a40 comp rx=0 tx=0).stop 2024-08-31T06:21:17.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.891+0000 7f355b479740 1 -- 172.21.15.53:0/3035287821 shutdown_connections 2024-08-31T06:21:17.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.891+0000 7f355b479740 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5639488ce730 0x5639488d0b50 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.891+0000 7f355b479740 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56394842bda0 0x56394884ce20 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.891+0000 7f355b479740 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563948498070 0x56394884c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.891+0000 7f3535ffb640 0 client.20700 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:17.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.891+0000 7f355b479740 1 --2- 172.21.15.53:0/3035287821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56394846f1b0 0x563948851430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.891+0000 7f355b479740 1 -- 172.21.15.53:0/3035287821 >> 172.21.15.53:0/3035287821 conn(0x56394848c460 msgr2=0x563948849dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:17.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.891+0000 7f355b479740 1 -- 172.21.15.53:0/3035287821 shutdown_connections 2024-08-31T06:21:17.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.891+0000 7f355b479740 1 -- 172.21.15.53:0/3035287821 wait complete. 2024-08-31T06:21:17.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.891+0000 7f355b479740 20 client.20700 trim_cache size 0 max 16384 2024-08-31T06:21:17.896 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "1087e56d-4883-4320-a656-e3bc73bc3344", 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:21:17.897 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.898 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.900 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.902 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:21:17.903 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.905 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:21:17.906 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.908 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:17.909 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:17.910 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:17.910 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:17.910 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:17.910 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:21:17.910 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:21:17.910 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:21:17.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 -- 172.21.15.53:0/1637512372 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f35380b4de0 msgr2=0x7f35380b72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:17.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f35380b4de0 0x7f35380b72f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f35480099a0 tx=0x7f35480098d0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 -- 172.21.15.53:0/1637512372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3550102800 msgr2=0x7f355019c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:17.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3550102800 0x7f355019c3f0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3540009230 tx=0x7f35400319a0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 -- 172.21.15.53:0/1637512372 shutdown_connections 2024-08-31T06:21:17.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f35380b4de0 0x7f35380b72f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3550108a90 0x7f35501a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3550108140 0x7f355019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 --2- 172.21.15.53:0/1637512372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3550102800 0x7f355019c3f0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:17.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 -- 172.21.15.53:0/1637512372 >> 172.21.15.53:0/1637512372 conn(0x7f35500794d0 msgr2=0x7f3550101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:17.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 -- 172.21.15.53:0/1637512372 shutdown_connections 2024-08-31T06:21:17.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:17.892+0000 7f3554f04640 1 -- 172.21.15.53:0/1637512372 wait complete. 2024-08-31T06:21:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:17 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:21:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:17 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:17 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:21:17.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:17 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:17 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:17 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:21:17.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:17 smithi153 ceph-mon[22320]: pgmap v835: 97 pgs: 97 active+clean; 475 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-08-31T06:21:18.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 19035 4.04 MB/sec execute 66 sec latency 64.200 ms 2024-08-31T06:21:18.744 INFO:tasks.cephfs.filesystem:scrub status for tag:1087e56d-4883-4320-a656-e3bc73bc3344 - {'path': '/', 'tag': '1087e56d-4883-4320-a656-e3bc73bc3344', 'options': 'recursive,force'} 2024-08-31T06:21:19.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 19216 4.16 MB/sec execute 67 sec latency 69.244 ms 2024-08-31T06:21:19.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:19 smithi053 ceph-mon[18924]: pgmap v836: 97 pgs: 97 active+clean; 480 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.9 MiB/s wr, 249 op/s 2024-08-31T06:21:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:19 smithi130 ceph-mon[22266]: pgmap v836: 97 pgs: 97 active+clean; 480 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.9 MiB/s wr, 249 op/s 2024-08-31T06:21:20.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:19 smithi153 ceph-mon[22320]: pgmap v836: 97 pgs: 97 active+clean; 480 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.9 MiB/s wr, 249 op/s 2024-08-31T06:21:20.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 19347 4.15 MB/sec execute 68 sec latency 56.177 ms 2024-08-31T06:21:21.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 19505 4.24 MB/sec execute 69 sec latency 47.414 ms 2024-08-31T06:21:21.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:21 smithi053 ceph-mon[18924]: pgmap v837: 97 pgs: 97 active+clean; 491 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 368 op/s 2024-08-31T06:21:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:21 smithi130 ceph-mon[22266]: pgmap v837: 97 pgs: 97 active+clean; 491 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 368 op/s 2024-08-31T06:21:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:21 smithi153 ceph-mon[22320]: pgmap v837: 97 pgs: 97 active+clean; 491 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 368 op/s 2024-08-31T06:21:22.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 19664 4.24 MB/sec execute 70 sec latency 53.315 ms 2024-08-31T06:21:23.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 19825 4.32 MB/sec execute 71 sec latency 56.111 ms 2024-08-31T06:21:23.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:23 smithi053 ceph-mon[18924]: pgmap v838: 97 pgs: 97 active+clean; 495 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 400 op/s 2024-08-31T06:21:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:23 smithi130 ceph-mon[22266]: pgmap v838: 97 pgs: 97 active+clean; 495 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 400 op/s 2024-08-31T06:21:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:23 smithi153 ceph-mon[22320]: pgmap v838: 97 pgs: 97 active+clean; 495 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.3 MiB/s wr, 400 op/s 2024-08-31T06:21:24.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 19974 4.32 MB/sec execute 72 sec latency 61.190 ms 2024-08-31T06:21:25.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 20138 4.30 MB/sec execute 73 sec latency 57.824 ms 2024-08-31T06:21:25.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:25 smithi053 ceph-mon[18924]: pgmap v839: 97 pgs: 97 active+clean; 496 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.1 MiB/s wr, 351 op/s 2024-08-31T06:21:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:25 smithi130 ceph-mon[22266]: pgmap v839: 97 pgs: 97 active+clean; 496 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.1 MiB/s wr, 351 op/s 2024-08-31T06:21:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:25 smithi153 ceph-mon[22320]: pgmap v839: 97 pgs: 97 active+clean; 496 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.1 MiB/s wr, 351 op/s 2024-08-31T06:21:26.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 20311 4.36 MB/sec execute 74 sec latency 102.189 ms 2024-08-31T06:21:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.363+0000 7f1592558640 1 -- 172.21.15.53:0/3295735601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f158c1057f0 msgr2=0x7f158c10f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.363+0000 7f1592558640 1 --2- 172.21.15.53:0/3295735601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f158c1057f0 0x7f158c10f260 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f1584009ca0 tx=0x7f158402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.363+0000 7f1592558640 1 -- 172.21.15.53:0/3295735601 shutdown_connections 2024-08-31T06:21:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.363+0000 7f1592558640 1 --2- 172.21.15.53:0/3295735601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f158c1057f0 0x7f158c10f260 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.363+0000 7f1592558640 1 --2- 172.21.15.53:0/3295735601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f158c104ea0 0x7f158c1052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.363+0000 7f1592558640 1 --2- 172.21.15.53:0/3295735601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f158c102dc0 0x7f158c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.363+0000 7f1592558640 1 -- 172.21.15.53:0/3295735601 >> 172.21.15.53:0/3295735601 conn(0x7f158c079aa0 msgr2=0x7f158c079ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.363+0000 7f1592558640 1 -- 172.21.15.53:0/3295735601 shutdown_connections 2024-08-31T06:21:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.363+0000 7f1592558640 1 -- 172.21.15.53:0/3295735601 wait complete. 2024-08-31T06:21:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.364+0000 7f1592558640 1 Processor -- start 2024-08-31T06:21:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.364+0000 7f1592558640 1 -- start start 2024-08-31T06:21:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.364+0000 7f1592558640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f158c102dc0 0x7f158c19af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.364+0000 7f1592558640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f158c104ea0 0x7f158c19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.364+0000 7f1592558640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f158c1057f0 0x7f158c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.364+0000 7f1592558640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1125e0 con 0x7f158c102dc0 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.364+0000 7f1592558640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f158c112460 con 0x7f158c1057f0 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.364+0000 7f1592558640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f158c112760 con 0x7f158c104ea0 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f1590af5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f158c1057f0 0x7f158c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f158bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f158c102dc0 0x7f158c19af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f158c104ea0 0x7f158c19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f1590af5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f158c1057f0 0x7f158c19b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50936/0 (socket says 172.21.15.53:50936) 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f1590af5640 1 -- 172.21.15.53:0/2377679406 learned_addr learned my addr 172.21.15.53:0/2377679406 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f1590af5640 1 -- 172.21.15.53:0/2377679406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f158c104ea0 msgr2=0x7f158c19b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f1590af5640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f158c104ea0 0x7f158c19b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f1590af5640 1 -- 172.21.15.53:0/2377679406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f158c102dc0 msgr2=0x7f158c19af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f1590af5640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f158c102dc0 0x7f158c19af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f1590af5640 1 -- 172.21.15.53:0/2377679406 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c198dc0 con 0x7f158c1057f0 2024-08-31T06:21:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f1590af5640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f158c1057f0 0x7f158c19b9d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1584005cc0 tx=0x7f1584003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:27.370 INFO:tasks.workunit.client.0.smithi053.stdout: 10 20497 4.41 MB/sec execute 75 sec latency 75.629 ms 2024-08-31T06:21:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f15897fa640 1 -- 172.21.15.53:0/2377679406 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584032c10 con 0x7f158c1057f0 2024-08-31T06:21:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f15897fa640 1 -- 172.21.15.53:0/2377679406 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1584032db0 con 0x7f158c1057f0 2024-08-31T06:21:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f15897fa640 1 -- 172.21.15.53:0/2377679406 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584030a60 con 0x7f158c1057f0 2024-08-31T06:21:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.365+0000 7f1592558640 1 -- 172.21.15.53:0/2377679406 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c199050 con 0x7f158c1057f0 2024-08-31T06:21:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.366+0000 7f1592558640 1 -- 172.21.15.53:0/2377679406 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c1995f0 con 0x7f158c1057f0 2024-08-31T06:21:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.369+0000 7f15897fa640 1 -- 172.21.15.53:0/2377679406 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1584030c20 con 0x7f158c1057f0 2024-08-31T06:21:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.369+0000 7f15994bd740 1 Processor -- start 2024-08-31T06:21:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.369+0000 7f15994bd740 1 -- start start 2024-08-31T06:21:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f15994bd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14c94ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f15994bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c95000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f15994bd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 0x562d14c95540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f15994bd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562d14c0a000 con 0x562d148d04d0 2024-08-31T06:21:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f15994bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562d14bf9590 con 0x562d148c82f0 2024-08-31T06:21:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f15994bd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562d14bfd540 con 0x562d148f11b0 2024-08-31T06:21:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 0x562d14c95540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c95000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14c94ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c95000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50952/0 (socket says 172.21.15.53:50952) 2024-08-31T06:21:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14c94ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44580/0 (socket says 172.21.15.53:44580) 2024-08-31T06:21:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158bfff640 1 -- 172.21.15.53:0/2648228979 learned_addr learned my addr 172.21.15.53:0/2648228979 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f15897fa640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15740b4d20 0x7f15740b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158bfff640 1 -- 172.21.15.53:0/2648228979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 msgr2=0x562d14c94ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158bfff640 1 --2- 172.21.15.53:0/2648228979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14c94ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158bfff640 1 -- 172.21.15.53:0/2648228979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 msgr2=0x562d14c95540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158bfff640 1 --2- 172.21.15.53:0/2648228979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 0x562d14c95540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158bfff640 1 -- 172.21.15.53:0/2648228979 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1495c790 con 0x562d148c82f0 2024-08-31T06:21:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f15897fa640 1 -- 172.21.15.53:0/2377679406 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f15841065d0 con 0x7f158c1057f0 2024-08-31T06:21:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f158b7fe640 1 --2- 172.21.15.53:0/2648228979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14c94ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.370+0000 7f1590af5640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15740b4d20 0x7f15740b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.371+0000 7f158bfff640 1 --2- 172.21.15.53:0/2648228979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c95000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f157c009cc0 tx=0x7f157c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9de0843f86952657 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.371+0000 7f15727fc640 1 -- 172.21.15.53:0/2648228979 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c01e070 con 0x562d148c82f0 2024-08-31T06:21:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.371+0000 7f15727fc640 1 -- 172.21.15.53:0/2648228979 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f157c019ac0 con 0x562d148c82f0 2024-08-31T06:21:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.371+0000 7f15727fc640 1 -- 172.21.15.53:0/2648228979 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c00e8c0 con 0x562d148c82f0 2024-08-31T06:21:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.372+0000 7f15994bd740 1 -- 172.21.15.53:0/2648228979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 msgr2=0x562d14c95000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.372+0000 7f1590af5640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15740b4d20 0x7f15740b7230 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f15840cc9a0 tx=0x7f15840095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.372+0000 7f15994bd740 1 --2- 172.21.15.53:0/2648228979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c95000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f157c009cc0 tx=0x7f157c011810 comp rx=0 tx=0).stop 2024-08-31T06:21:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.372+0000 7f15994bd740 1 -- 172.21.15.53:0/2648228979 shutdown_connections 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.372+0000 7f15994bd740 1 --2- 172.21.15.53:0/2648228979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 0x562d14c95540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.372+0000 7f15994bd740 1 --2- 172.21.15.53:0/2648228979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c95000 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.372+0000 7f15994bd740 1 --2- 172.21.15.53:0/2648228979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14c94ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.372+0000 7f15994bd740 1 -- 172.21.15.53:0/2648228979 >> 172.21.15.53:0/2648228979 conn(0x562d148e5300 msgr2=0x562d14c929b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.372+0000 7f15994bd740 1 -- 172.21.15.53:0/2648228979 shutdown_connections 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.372+0000 7f15994bd740 1 -- 172.21.15.53:0/2648228979 wait complete. 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.373+0000 7f15994bd740 1 -- start start 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.373+0000 7f15994bd740 1 Processor -- start 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.373+0000 7f15994bd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.373+0000 7f15994bd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148d04d0 0x562d14ca0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.373+0000 7f15994bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148f11b0 0x562d14cac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.373+0000 7f15994bd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562d14b32ab0 con 0x562d148c82f0 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.373+0000 7f15994bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562d14b80680 con 0x562d148f11b0 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.373+0000 7f15994bd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562d14ca3290 con 0x562d148d04d0 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f158bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148d04d0 0x562d14ca0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57126/0 (socket says 172.21.15.53:57126) 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f158b7fe640 1 -- 172.21.15.53:0/1313960071 learned_addr learned my addr 172.21.15.53:0/1313960071 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f15994bd740 10 client.0 _ll_register_callbacks cb 0x562d14908a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f158b7fe640 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148f11b0 0x562d14cac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f158b7fe640 1 -- 172.21.15.53:0/1313960071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148d04d0 msgr2=0x562d14ca0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f158b7fe640 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148d04d0 0x562d14ca0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f158b7fe640 1 -- 172.21.15.53:0/1313960071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148f11b0 msgr2=0x562d14cac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f158b7fe640 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148f11b0 0x562d14cac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f158b7fe640 1 -- 172.21.15.53:0/1313960071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d149d5620 con 0x562d148c82f0 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f158b7fe640 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca0680 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f1580010e70 tx=0x7f1580009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1947d9c313c3f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f156b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f156b7fe640 1 -- 172.21.15.53:0/1313960071 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580019040 con 0x562d148c82f0 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f156b7fe640 1 -- 172.21.15.53:0/1313960071 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f1580005220 con 0x562d148c82f0 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.374+0000 7f15994bd740 1 -- 172.21.15.53:0/1313960071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f157c019ac0 con 0x562d148c82f0 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f156b7fe640 1 -- 172.21.15.53:0/1313960071 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f1580005420 con 0x562d148c82f0 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f15994bd740 10 client.20712 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f15994bd740 1 -- 172.21.15.53:0/1313960071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x562d14caf2e0 con 0x562d148c82f0 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f156b7fe640 1 -- 172.21.15.53:0/1313960071 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f157c019ac0 con 0x562d148c82f0 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f156b7fe640 1 -- 172.21.15.53:0/1313960071 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f158001f040 con 0x562d148c82f0 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f15994bd740 10 client.20712 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f15994bd740 10 client.20712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f15994bd740 20 client.20712 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f15994bd740 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562d148afd80 0x562d14cb2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f15994bd740 4 client.20712 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f15994bd740 1 -- 172.21.15.53:0/1313960071 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d14c0bf50 con 0x562d148afd80 2024-08-31T06:21:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.375+0000 7f158bfff640 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562d148afd80 0x562d14cb2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.376+0000 7f158bfff640 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562d148afd80 0x562d14cb2830 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=982bf3a17a6278d1 server_cookie=57828e6f9aa19b17 in_seq=0 out_seq=0 2024-08-31T06:21:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.376+0000 7f156b7fe640 10 client.20712 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f156b7fe640 1 -- 172.21.15.53:0/1313960071 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d14c0bf50 con 0x562d148afd80 2024-08-31T06:21:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f156b7fe640 10 client.20712 handle_command_reply: tid=0 2024-08-31T06:21:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f15994bd740 1 client.20712 shutdown 2024-08-31T06:21:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f15994bd740 1 -- 172.21.15.53:0/1313960071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 msgr2=0x562d14ca0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f15994bd740 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca0680 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f1580010e70 tx=0x7f1580009b40 comp rx=0 tx=0).stop 2024-08-31T06:21:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f15994bd740 1 -- 172.21.15.53:0/1313960071 shutdown_connections 2024-08-31T06:21:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f15994bd740 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562d148afd80 0x562d14cb2830 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f15994bd740 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148f11b0 0x562d14cac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f15994bd740 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148d04d0 0x562d14ca0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f15994bd740 1 --2- 172.21.15.53:0/1313960071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca0680 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f15994bd740 1 -- 172.21.15.53:0/1313960071 >> 172.21.15.53:0/1313960071 conn(0x562d148e5300 msgr2=0x562d14c95af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f156b7fe640 0 client.20712 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f15994bd740 1 -- 172.21.15.53:0/1313960071 shutdown_connections 2024-08-31T06:21:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.377+0000 7f15994bd740 1 -- 172.21.15.53:0/1313960071 wait complete. 2024-08-31T06:21:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.378+0000 7f15994bd740 20 client.20712 trim_cache size 0 max 16384 2024-08-31T06:21:27.407 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.404+0000 7f15994bd740 1 Processor -- start 2024-08-31T06:21:27.407 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.404+0000 7f15994bd740 1 -- start start 2024-08-31T06:21:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f15994bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c99bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f15994bd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 0x562d14c9a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f15994bd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14cb8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f15994bd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1b16e0 con 0x562d148d04d0 2024-08-31T06:21:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f15994bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1b33a0 con 0x562d148c82f0 2024-08-31T06:21:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f15994bd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1b1db0 con 0x562d148f11b0 2024-08-31T06:21:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 0x562d14c9a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c99bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 0x562d14c9a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57130/0 (socket says 172.21.15.53:57130) 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158bfff640 1 -- 172.21.15.53:0/93970483 learned_addr learned my addr 172.21.15.53:0/93970483 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c99bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:50976/0 (socket says 172.21.15.53:50976) 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158b7fe640 1 --2- 172.21.15.53:0/93970483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14cb8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158b7fe640 1 -- 172.21.15.53:0/93970483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 msgr2=0x562d14cb8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158b7fe640 1 --2- 172.21.15.53:0/93970483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14cb8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158b7fe640 1 -- 172.21.15.53:0/93970483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 msgr2=0x562d14c9a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158b7fe640 1 --2- 172.21.15.53:0/93970483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 0x562d14c9a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158b7fe640 1 -- 172.21.15.53:0/93970483 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d14c978d0 con 0x562d148c82f0 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.405+0000 7f158bfff640 1 --2- 172.21.15.53:0/93970483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 0x562d14c9a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.406+0000 7f158b7fe640 1 --2- 172.21.15.53:0/93970483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c99bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1580004f80 tx=0x7f158000ff90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef86fcf2d0793f13 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.406+0000 7f1571ffb640 1 -- 172.21.15.53:0/93970483 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580005000 con 0x562d148c82f0 2024-08-31T06:21:27.411 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.406+0000 7f1571ffb640 1 -- 172.21.15.53:0/93970483 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15800051a0 con 0x562d148c82f0 2024-08-31T06:21:27.411 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.406+0000 7f1571ffb640 1 -- 172.21.15.53:0/93970483 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158000ea80 con 0x562d148c82f0 2024-08-31T06:21:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.407+0000 7f15994bd740 1 -- 172.21.15.53:0/93970483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 msgr2=0x562d14c99bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.407+0000 7f15994bd740 1 --2- 172.21.15.53:0/93970483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c99bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1580004f80 tx=0x7f158000ff90 comp rx=0 tx=0).stop 2024-08-31T06:21:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.407+0000 7f15994bd740 1 -- 172.21.15.53:0/93970483 shutdown_connections 2024-08-31T06:21:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.407+0000 7f15994bd740 1 --2- 172.21.15.53:0/93970483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14cb8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.407+0000 7f15994bd740 1 --2- 172.21.15.53:0/93970483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148d04d0 0x562d14c9a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.407+0000 7f15994bd740 1 --2- 172.21.15.53:0/93970483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148c82f0 0x562d14c99bf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.407+0000 7f15994bd740 1 -- 172.21.15.53:0/93970483 >> 172.21.15.53:0/93970483 conn(0x562d148e5300 msgr2=0x562d14cac690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.407+0000 7f15994bd740 1 -- 172.21.15.53:0/93970483 shutdown_connections 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.407+0000 7f15994bd740 1 -- 172.21.15.53:0/93970483 wait complete. 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.408+0000 7f15994bd740 1 -- start start 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.408+0000 7f15994bd740 1 Processor -- start 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.408+0000 7f15994bd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.408+0000 7f15994bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148d04d0 0x562d14ca61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.408+0000 7f15994bd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14ca6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.408+0000 7f15994bd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1b2cd0 con 0x562d148c82f0 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.408+0000 7f15994bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1b2540 con 0x562d148d04d0 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.408+0000 7f15994bd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1af6e0 con 0x562d148f11b0 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.408+0000 7f15994bd740 10 client.0 _ll_register_callbacks cb 0x7f1580010d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.408+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f158bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148d04d0 0x562d14ca61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f158b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57138/0 (socket says 172.21.15.53:57138) 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f158b7fe640 1 -- 172.21.15.53:0/3854305029 learned_addr learned my addr 172.21.15.53:0/3854305029 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f158b7fe640 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14ca6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f158b7fe640 1 -- 172.21.15.53:0/3854305029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 msgr2=0x562d14ca6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f158b7fe640 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14ca6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f158b7fe640 1 -- 172.21.15.53:0/3854305029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148d04d0 msgr2=0x562d14ca61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f158b7fe640 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148d04d0 0x562d14ca61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f158b7fe640 1 -- 172.21.15.53:0/3854305029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d14ca6ea0 con 0x562d148c82f0 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f158bfff640 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148d04d0 0x562d14ca61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f158b7fe640 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca8cc0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f1580010c70 tx=0x7f1580010520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765d19335ad0650b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f156b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.409+0000 7f156b7fe640 1 -- 172.21.15.53:0/3854305029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580004740 con 0x562d148c82f0 2024-08-31T06:21:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.410+0000 7f156b7fe640 1 -- 172.21.15.53:0/3854305029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f15800048e0 con 0x562d148c82f0 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.410+0000 7f15994bd740 1 -- 172.21.15.53:0/3854305029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15800051a0 con 0x562d148c82f0 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.410+0000 7f156b7fe640 1 -- 172.21.15.53:0/3854305029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f1580004ae0 con 0x562d148c82f0 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.410+0000 7f15994bd740 10 client.20718 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.410+0000 7f15994bd740 1 -- 172.21.15.53:0/3854305029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x562d14d1d1e0 con 0x562d148c82f0 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.410+0000 7f156b7fe640 1 -- 172.21.15.53:0/3854305029 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f158000ecb0 con 0x562d148c82f0 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.410+0000 7f156b7fe640 1 -- 172.21.15.53:0/3854305029 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f1580022690 con 0x562d148c82f0 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.411+0000 7f15994bd740 10 client.20718 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.411+0000 7f15994bd740 10 client.20718 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.411+0000 7f15994bd740 20 client.20718 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.411+0000 7f15994bd740 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562d148851c0 0x562d14d1f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.411+0000 7f15994bd740 4 client.20718 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.411+0000 7f15994bd740 1 -- 172.21.15.53:0/3854305029 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f15800051a0 con 0x562d148851c0 2024-08-31T06:21:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.411+0000 7f158bfff640 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562d148851c0 0x562d14d1f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:27.418 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.411+0000 7f156b7fe640 10 client.20718 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:27.418 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.411+0000 7f158bfff640 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562d148851c0 0x562d14d1f920 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324c5233182092a2 server_cookie=caa0fdd7f47248c6 in_seq=0 out_seq=0 2024-08-31T06:21:27.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.601+0000 7f156b7fe640 1 -- 172.21.15.53:0/3854305029 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f15800051a0 con 0x562d148851c0 2024-08-31T06:21:27.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.601+0000 7f156b7fe640 10 client.20718 handle_command_reply: tid=0 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.601+0000 7f15994bd740 1 client.20718 shutdown 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.601+0000 7f15994bd740 1 -- 172.21.15.53:0/3854305029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 msgr2=0x562d14ca8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.601+0000 7f15994bd740 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca8cc0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f1580010c70 tx=0x7f1580010520 comp rx=0 tx=0).stop 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.602+0000 7f15994bd740 1 -- 172.21.15.53:0/3854305029 shutdown_connections 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.602+0000 7f15994bd740 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562d148851c0 0x562d14d1f920 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.602+0000 7f15994bd740 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d148f11b0 0x562d14ca6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.602+0000 7f15994bd740 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562d148d04d0 0x562d14ca61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.602+0000 7f15994bd740 1 --2- 172.21.15.53:0/3854305029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562d148c82f0 0x562d14ca8cc0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.602+0000 7f15994bd740 1 -- 172.21.15.53:0/3854305029 >> 172.21.15.53:0/3854305029 conn(0x562d148e5300 msgr2=0x562d14c99bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.602+0000 7f156b7fe640 0 client.20718 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.602+0000 7f15994bd740 1 -- 172.21.15.53:0/3854305029 shutdown_connections 2024-08-31T06:21:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.602+0000 7f15994bd740 1 -- 172.21.15.53:0/3854305029 wait complete. 2024-08-31T06:21:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.602+0000 7f15994bd740 20 client.20718 trim_cache size 0 max 16384 2024-08-31T06:21:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:21:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:21:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:21:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:21:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 -- 172.21.15.53:0/2377679406 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15740b4d20 msgr2=0x7f15740b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15740b4d20 0x7f15740b7230 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f15840cc9a0 tx=0x7f15840095c0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 -- 172.21.15.53:0/2377679406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f158c1057f0 msgr2=0x7f158c19b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f158c1057f0 0x7f158c19b9d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1584005cc0 tx=0x7f1584003f90 comp rx=0 tx=0).stop 2024-08-31T06:21:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 -- 172.21.15.53:0/2377679406 shutdown_connections 2024-08-31T06:21:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f15740b4d20 0x7f15740b7230 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f158c1057f0 0x7f158c19b9d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f158c104ea0 0x7f158c19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 --2- 172.21.15.53:0/2377679406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f158c102dc0 0x7f158c19af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 -- 172.21.15.53:0/2377679406 >> 172.21.15.53:0/2377679406 conn(0x7f158c079aa0 msgr2=0x7f158c1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 -- 172.21.15.53:0/2377679406 shutdown_connections 2024-08-31T06:21:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:27.603+0000 7f1592558640 1 -- 172.21.15.53:0/2377679406 wait complete. 2024-08-31T06:21:27.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:27 smithi053 ceph-mon[18924]: pgmap v840: 97 pgs: 97 active+clean; 495 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 371 op/s 2024-08-31T06:21:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:27 smithi130 ceph-mon[22266]: pgmap v840: 97 pgs: 97 active+clean; 495 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 371 op/s 2024-08-31T06:21:28.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:27 smithi153 ceph-mon[22320]: pgmap v840: 97 pgs: 97 active+clean; 495 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 371 op/s 2024-08-31T06:21:28.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 20688 4.48 MB/sec execute 76 sec latency 78.790 ms 2024-08-31T06:21:29.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 20818 4.49 MB/sec execute 77 sec latency 142.839 ms 2024-08-31T06:21:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:29 smithi130 ceph-mon[22266]: pgmap v841: 97 pgs: 97 active+clean; 495 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 372 op/s 2024-08-31T06:21:30.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:29 smithi153 ceph-mon[22320]: pgmap v841: 97 pgs: 97 active+clean; 495 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 372 op/s 2024-08-31T06:21:30.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:29 smithi053 ceph-mon[18924]: pgmap v841: 97 pgs: 97 active+clean; 495 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.9 MiB/s wr, 372 op/s 2024-08-31T06:21:30.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 20973 4.55 MB/sec execute 78 sec latency 69.012 ms 2024-08-31T06:21:30.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:30 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:21:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:30 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:21:31.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:30 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:21:31.368 INFO:tasks.workunit.client.0.smithi053.stdout: 10 21161 4.65 MB/sec execute 79 sec latency 132.432 ms 2024-08-31T06:21:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:21:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:21:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:21:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:21:32.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:31 smithi130 ceph-mon[22266]: pgmap v842: 97 pgs: 97 active+clean; 493 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 428 op/s 2024-08-31T06:21:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:21:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:21:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:21:32.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:21:32.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:31 smithi153 ceph-mon[22320]: pgmap v842: 97 pgs: 97 active+clean; 493 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 428 op/s 2024-08-31T06:21:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:21:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:21:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:21:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:21:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:31 smithi053 ceph-mon[18924]: pgmap v842: 97 pgs: 97 active+clean; 493 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 428 op/s 2024-08-31T06:21:32.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 21367 4.72 MB/sec execute 80 sec latency 57.636 ms 2024-08-31T06:21:33.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 21508 4.73 MB/sec execute 81 sec latency 180.870 ms 2024-08-31T06:21:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:33 smithi130 ceph-mon[22266]: pgmap v843: 97 pgs: 97 active+clean; 492 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 331 op/s 2024-08-31T06:21:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:33 smithi153 ceph-mon[22320]: pgmap v843: 97 pgs: 97 active+clean; 492 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 331 op/s 2024-08-31T06:21:34.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:33 smithi053 ceph-mon[18924]: pgmap v843: 97 pgs: 97 active+clean; 492 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 331 op/s 2024-08-31T06:21:34.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 21659 4.74 MB/sec execute 82 sec latency 56.699 ms 2024-08-31T06:21:35.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 21843 4.91 MB/sec execute 83 sec latency 101.495 ms 2024-08-31T06:21:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:35 smithi130 ceph-mon[22266]: pgmap v844: 97 pgs: 97 active+clean; 496 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 344 op/s 2024-08-31T06:21:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:35 smithi153 ceph-mon[22320]: pgmap v844: 97 pgs: 97 active+clean; 496 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 344 op/s 2024-08-31T06:21:36.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:35 smithi053 ceph-mon[18924]: pgmap v844: 97 pgs: 97 active+clean; 496 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 344 op/s 2024-08-31T06:21:36.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 22041 5.01 MB/sec execute 84 sec latency 54.915 ms 2024-08-31T06:21:37.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 22216 5.12 MB/sec execute 85 sec latency 56.114 ms 2024-08-31T06:21:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:37 smithi130 ceph-mon[22266]: pgmap v845: 97 pgs: 97 active+clean; 503 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 351 op/s 2024-08-31T06:21:38.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:37 smithi153 ceph-mon[22320]: pgmap v845: 97 pgs: 97 active+clean; 503 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 351 op/s 2024-08-31T06:21:38.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:37 smithi053 ceph-mon[18924]: pgmap v845: 97 pgs: 97 active+clean; 503 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 351 op/s 2024-08-31T06:21:38.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 22377 5.16 MB/sec execute 86 sec latency 98.543 ms 2024-08-31T06:21:39.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 22541 5.26 MB/sec execute 87 sec latency 51.193 ms 2024-08-31T06:21:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:39 smithi130 ceph-mon[22266]: pgmap v846: 97 pgs: 97 active+clean; 509 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.6 MiB/s wr, 318 op/s 2024-08-31T06:21:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:39 smithi153 ceph-mon[22320]: pgmap v846: 97 pgs: 97 active+clean; 509 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.6 MiB/s wr, 318 op/s 2024-08-31T06:21:40.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:39 smithi053 ceph-mon[18924]: pgmap v846: 97 pgs: 97 active+clean; 509 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.6 MiB/s wr, 318 op/s 2024-08-31T06:21:40.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 22656 5.26 MB/sec execute 88 sec latency 184.889 ms 2024-08-31T06:21:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.748+0000 7f8cad389640 1 -- 172.21.15.53:0/385789007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca8102770 msgr2=0x7f8ca8102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.748+0000 7f8cad389640 1 --2- 172.21.15.53:0/385789007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca8102770 0x7f8ca8102b80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009900 tx=0x7f8c9802a410 comp rx=0 tx=0).stop 2024-08-31T06:21:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.748+0000 7f8cad389640 1 -- 172.21.15.53:0/385789007 shutdown_connections 2024-08-31T06:21:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.748+0000 7f8cad389640 1 --2- 172.21.15.53:0/385789007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ca81089f0 0x7f8ca810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.748+0000 7f8cad389640 1 --2- 172.21.15.53:0/385789007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca81080a0 0x7f8ca81084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.748+0000 7f8cad389640 1 --2- 172.21.15.53:0/385789007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca8102770 0x7f8ca8102b80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.748+0000 7f8cad389640 1 -- 172.21.15.53:0/385789007 >> 172.21.15.53:0/385789007 conn(0x7f8ca80fe1b0 msgr2=0x7f8ca8100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.749+0000 7f8cad389640 1 -- 172.21.15.53:0/385789007 shutdown_connections 2024-08-31T06:21:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.749+0000 7f8cad389640 1 -- 172.21.15.53:0/385789007 wait complete. 2024-08-31T06:21:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.749+0000 7f8cad389640 1 Processor -- start 2024-08-31T06:21:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8cad389640 1 -- start start 2024-08-31T06:21:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8cad389640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ca8102770 0x7f8ca819af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8cad389640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca81080a0 0x7f8ca819b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8cad389640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca81089f0 0x7f8ca819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8cad389640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81125a0 con 0x7f8ca8102770 2024-08-31T06:21:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8cad389640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca8112420 con 0x7f8ca81089f0 2024-08-31T06:21:40.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8cad389640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca8112720 con 0x7f8ca81080a0 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8ca6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ca8102770 0x7f8ca819af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8ca67fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca81080a0 0x7f8ca819b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8ca6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ca8102770 0x7f8ca819af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56510/0 (socket says 172.21.15.53:56510) 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/2958123746 learned_addr learned my addr 172.21.15.53:0/2958123746 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.750+0000 7f8ca77fe640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca81089f0 0x7f8ca819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/2958123746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca81080a0 msgr2=0x7f8ca819b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8ca6ffd640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca81080a0 0x7f8ca819b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/2958123746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca81089f0 msgr2=0x7f8ca819b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8ca6ffd640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca81089f0 0x7f8ca819b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/2958123746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca81a61d0 con 0x7f8ca8102770 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8ca67fc640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca81080a0 0x7f8ca819b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8ca77fe640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca81089f0 0x7f8ca819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8ca6ffd640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ca8102770 0x7f8ca819af10 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f8c9802a930 tx=0x7f8c98003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8c8ffff640 1 -- 172.21.15.53:0/2958123746 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9803f070 con 0x7f8ca8102770 2024-08-31T06:21:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8cad389640 1 -- 172.21.15.53:0/2958123746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca81a6460 con 0x7f8ca8102770 2024-08-31T06:21:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8c8ffff640 1 -- 172.21.15.53:0/2958123746 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c9803baf0 con 0x7f8ca8102770 2024-08-31T06:21:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8c8ffff640 1 -- 172.21.15.53:0/2958123746 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98035030 con 0x7f8ca8102770 2024-08-31T06:21:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.751+0000 7f8cad389640 1 -- 172.21.15.53:0/2958123746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca81a6950 con 0x7f8ca8102770 2024-08-31T06:21:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.754+0000 7f8cb43ce740 1 Processor -- start 2024-08-31T06:21:40.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8cb43ce740 1 -- start start 2024-08-31T06:21:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 0x55695ba12ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba13220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba13760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8cb43ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55695b988000 con 0x55695b66f1b0 2024-08-31T06:21:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8cb43ce740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55695b977590 con 0x55695b6462f0 2024-08-31T06:21:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8cb43ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55695b97b540 con 0x55695b64e4d0 2024-08-31T06:21:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8ca77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 0x55695ba12ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8ca77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 0x55695ba12ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56514/0 (socket says 172.21.15.53:56514) 2024-08-31T06:21:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8ca67fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba13760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8ca77fe640 1 -- 172.21.15.53:0/2356727751 learned_addr learned my addr 172.21.15.53:0/2356727751 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.755+0000 7f8c8ffff640 1 -- 172.21.15.53:0/2958123746 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8c98042070 con 0x7f8ca8102770 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8ca67fc640 1 -- 172.21.15.53:0/2356727751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 msgr2=0x55695ba13220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8ca67fc640 1 --2- 172.21.15.53:0/2356727751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba13220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8ca67fc640 1 -- 172.21.15.53:0/2356727751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 msgr2=0x55695ba12ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8ca67fc640 1 --2- 172.21.15.53:0/2356727751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 0x55695ba12ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8ca67fc640 1 -- 172.21.15.53:0/2356727751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695b6da790 con 0x55695b64e4d0 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8ca77fe640 1 --2- 172.21.15.53:0/2356727751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 0x55695ba12ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8ca67fc640 1 --2- 172.21.15.53:0/2356727751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba13760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ca806b500 tx=0x7f8c9c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf32f654d8cb84e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8c8ffff640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c900b4ca0 0x7f8c900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8c8d7fa640 1 -- 172.21.15.53:0/2356727751 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c004030 con 0x55695b64e4d0 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8c8d7fa640 1 -- 172.21.15.53:0/2356727751 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c9c005020 con 0x55695b64e4d0 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8c8d7fa640 1 -- 172.21.15.53:0/2356727751 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c004c10 con 0x55695b64e4d0 2024-08-31T06:21:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8ca77fe640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c900b4ca0 0x7f8c900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.756+0000 7f8c8ffff640 1 -- 172.21.15.53:0/2958123746 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f8c98105bf0 con 0x7f8ca8102770 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8cb43ce740 1 -- 172.21.15.53:0/2356727751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 msgr2=0x55695ba13760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8ca77fe640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c900b4ca0 0x7f8c900b71b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009fd0 tx=0x7f8ca0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/2356727751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba13760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ca806b500 tx=0x7f8c9c0118d0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8cb43ce740 1 -- 172.21.15.53:0/2356727751 shutdown_connections 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/2356727751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba13760 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/2356727751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba13220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/2356727751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 0x55695ba12ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8cb43ce740 1 -- 172.21.15.53:0/2356727751 >> 172.21.15.53:0/2356727751 conn(0x55695b663300 msgr2=0x55695ba10bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8cb43ce740 1 -- 172.21.15.53:0/2356727751 shutdown_connections 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8cb43ce740 1 -- 172.21.15.53:0/2356727751 wait complete. 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8cb43ce740 1 -- start start 2024-08-31T06:21:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.758+0000 7f8cb43ce740 1 Processor -- start 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba1e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba1ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 0x55695ba2a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8cb43ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55695b8b0ab0 con 0x55695b66f1b0 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8ca67fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba1ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8ca6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba1e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8ca6ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba1e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:59640/0 (socket says 172.21.15.53:59640) 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/759167848 learned_addr learned my addr 172.21.15.53:0/759167848 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8ca77fe640 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 0x55695ba2a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8cb43ce740 1 -- 172.21.15.53:0/759167848 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55695b8fe680 con 0x55695b6462f0 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8cb43ce740 1 -- 172.21.15.53:0/759167848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55695ba21460 con 0x55695b64e4d0 2024-08-31T06:21:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8cb43ce740 10 client.0 _ll_register_callbacks cb 0x55695b686a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/759167848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 msgr2=0x55695ba1ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8ca6ffd640 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba1ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/759167848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 msgr2=0x55695ba2a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8ca6ffd640 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 0x55695ba2a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.759+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/759167848 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695b753620 con 0x55695b6462f0 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.760+0000 7f8cb43ce740 1 -- 172.21.15.53:0/759167848 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9c005020 con 0x55695b6462f0 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.760+0000 7f8ca6ffd640 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba1e970 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8c98103320 tx=0x7f8c980cbd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a64c8197b870b410 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.760+0000 7f8c8aff5640 10 client.29639 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.760+0000 7f8c8aff5640 1 -- 172.21.15.53:0/759167848 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98049030 con 0x55695b6462f0 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.760+0000 7f8c8aff5640 1 -- 172.21.15.53:0/759167848 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f8c98103540 con 0x55695b6462f0 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.760+0000 7f8c8aff5640 1 -- 172.21.15.53:0/759167848 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f8c98103740 con 0x55695b6462f0 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.760+0000 7f8cb43ce740 10 client.29639 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.760+0000 7f8cb43ce740 1 -- 172.21.15.53:0/759167848 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=60}) -- 0x55695ba2d490 con 0x55695b6462f0 2024-08-31T06:21:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.760+0000 7f8c8aff5640 1 -- 172.21.15.53:0/759167848 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f8c980cc570 con 0x55695b6462f0 2024-08-31T06:21:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.761+0000 7f8cb43ce740 10 client.29639 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.761+0000 7f8cb43ce740 10 client.29639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.761+0000 7f8cb43ce740 20 client.29639 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.761+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55695b62dd80 0x55695ba308b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.761+0000 7f8cb43ce740 4 client.29639 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.761+0000 7f8cb43ce740 1 -- 172.21.15.53:0/759167848 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55695b989f50 con 0x55695b62dd80 2024-08-31T06:21:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.761+0000 7f8ca67fc640 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55695b62dd80 0x55695ba308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.761+0000 7f8ca67fc640 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55695b62dd80 0x55695ba308b0 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a2eaec354ef2a0 server_cookie=9f1e2e81f0886656 in_seq=0 out_seq=0 2024-08-31T06:21:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.761+0000 7f8c8aff5640 10 client.29639 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8c8aff5640 1 -- 172.21.15.53:0/759167848 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55695b989f50 con 0x55695b62dd80 2024-08-31T06:21:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8c8aff5640 10 client.29639 handle_command_reply: tid=0 2024-08-31T06:21:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8cb43ce740 1 client.29639 shutdown 2024-08-31T06:21:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8cb43ce740 1 -- 172.21.15.53:0/759167848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 msgr2=0x55695ba1e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba1e970 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8c98103320 tx=0x7f8c980cbd20 comp rx=0 tx=0).stop 2024-08-31T06:21:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8cb43ce740 1 -- 172.21.15.53:0/759167848 shutdown_connections 2024-08-31T06:21:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55695b62dd80 0x55695ba308b0 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b66f1b0 0x55695ba2a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba1ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8c8aff5640 0 client.29639 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/759167848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba1e970 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8cb43ce740 1 -- 172.21.15.53:0/759167848 >> 172.21.15.53:0/759167848 conn(0x55695b663300 msgr2=0x55695ba13d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8cb43ce740 1 -- 172.21.15.53:0/759167848 shutdown_connections 2024-08-31T06:21:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.762+0000 7f8cb43ce740 1 -- 172.21.15.53:0/759167848 wait complete. 2024-08-31T06:21:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.763+0000 7f8cb43ce740 20 client.29639 trim_cache size 0 max 16384 2024-08-31T06:21:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.789+0000 7f8cb43ce740 1 Processor -- start 2024-08-31T06:21:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.789+0000 7f8cb43ce740 1 -- start start 2024-08-31T06:21:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.789+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b62dd80 0x55695ba1d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.789+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba20390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.789+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba10180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.789+0000 7f8cb43ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81af3a0 con 0x55695b62dd80 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.789+0000 7f8cb43ce740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81b1060 con 0x55695b6462f0 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.789+0000 7f8cb43ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81afa70 con 0x55695b64e4d0 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.789+0000 7f8ca67fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba20390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.789+0000 7f8ca6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b62dd80 0x55695ba1d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8ca67fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba20390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:59654/0 (socket says 172.21.15.53:59654) 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8ca67fc640 1 -- 172.21.15.53:0/212413540 learned_addr learned my addr 172.21.15.53:0/212413540 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8ca77fe640 1 --2- 172.21.15.53:0/212413540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba10180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8ca67fc640 1 -- 172.21.15.53:0/212413540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 msgr2=0x55695ba10180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8ca67fc640 1 --2- 172.21.15.53:0/212413540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba10180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8ca67fc640 1 -- 172.21.15.53:0/212413540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b62dd80 msgr2=0x55695ba1d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8ca67fc640 1 --2- 172.21.15.53:0/212413540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b62dd80 0x55695ba1d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8ca67fc640 1 -- 172.21.15.53:0/212413540 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695ba0ef60 con 0x55695b6462f0 2024-08-31T06:21:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8ca6ffd640 1 --2- 172.21.15.53:0/212413540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b62dd80 0x55695ba1d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8ca67fc640 1 --2- 172.21.15.53:0/212413540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba20390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009380 tx=0x7f8c9c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbe3d0b1e3a8375f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8c8cff9640 1 -- 172.21.15.53:0/212413540 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c031070 con 0x55695b6462f0 2024-08-31T06:21:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8c8cff9640 1 -- 172.21.15.53:0/212413540 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c9c0044d0 con 0x55695b6462f0 2024-08-31T06:21:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.790+0000 7f8c8cff9640 1 -- 172.21.15.53:0/212413540 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0035f0 con 0x55695b6462f0 2024-08-31T06:21:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.791+0000 7f8cb43ce740 1 -- 172.21.15.53:0/212413540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 msgr2=0x55695ba20390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.791+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/212413540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba20390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009380 tx=0x7f8c9c009310 comp rx=0 tx=0).stop 2024-08-31T06:21:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.792+0000 7f8cb43ce740 1 -- 172.21.15.53:0/212413540 shutdown_connections 2024-08-31T06:21:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.792+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/212413540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b64e4d0 0x55695ba10180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.792+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/212413540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b6462f0 0x55695ba20390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.792+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/212413540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b62dd80 0x55695ba1d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.792+0000 7f8cb43ce740 1 -- 172.21.15.53:0/212413540 >> 172.21.15.53:0/212413540 conn(0x55695b663300 msgr2=0x55695ba1fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.792+0000 7f8cb43ce740 1 -- 172.21.15.53:0/212413540 shutdown_connections 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.792+0000 7f8cb43ce740 1 -- 172.21.15.53:0/212413540 wait complete. 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.792+0000 7f8cb43ce740 1 -- start start 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.792+0000 7f8cb43ce740 1 Processor -- start 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b62dd80 0x55695ba26e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b6462f0 0x55695ba22330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8cb43ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b64e4d0 0x55695ba22870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8cb43ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81b0990 con 0x55695b6462f0 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8cb43ce740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81b0200 con 0x55695b64e4d0 2024-08-31T06:21:40.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8cb43ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81ad3a0 con 0x55695b62dd80 2024-08-31T06:21:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8cb43ce740 10 client.0 _ll_register_callbacks cb 0x7f8c98005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8ca6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b62dd80 0x55695ba26e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8ca6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b62dd80 0x55695ba26e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:52406/0 (socket says 172.21.15.53:52406) 2024-08-31T06:21:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/1614506278 learned_addr learned my addr 172.21.15.53:0/1614506278 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8ca77fe640 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b64e4d0 0x55695ba22870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/1614506278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b64e4d0 msgr2=0x55695ba22870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8ca6ffd640 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b64e4d0 0x55695ba22870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/1614506278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b6462f0 msgr2=0x55695ba22330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8ca6ffd640 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b6462f0 0x55695ba22330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8ca6ffd640 1 -- 172.21.15.53:0/1614506278 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695ba22fb0 con 0x55695b62dd80 2024-08-31T06:21:40.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8ca6ffd640 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b62dd80 0x55695ba26e90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8c980cc2a0 tx=0x7f8c98005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=466351eaaba1fc15 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:40.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.793+0000 7f8c8aff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:21:40.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8c8aff5640 1 -- 172.21.15.53:0/1614506278 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c980cc0e0 con 0x55695b62dd80 2024-08-31T06:21:40.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8cb43ce740 1 -- 172.21.15.53:0/1614506278 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9c0044d0 con 0x55695b62dd80 2024-08-31T06:21:40.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8c8aff5640 1 -- 172.21.15.53:0/1614506278 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f8c980d5300 con 0x55695b62dd80 2024-08-31T06:21:40.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8c8aff5640 1 -- 172.21.15.53:0/1614506278 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f8c980d5580 con 0x55695b62dd80 2024-08-31T06:21:40.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8cb43ce740 10 client.29635 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:40.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8cb43ce740 1 -- 172.21.15.53:0/1614506278 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55695baa3950 con 0x55695b62dd80 2024-08-31T06:21:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8c8aff5640 1 -- 172.21.15.53:0/1614506278 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c9c0044d0 con 0x55695b62dd80 2024-08-31T06:21:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8c8aff5640 1 -- 172.21.15.53:0/1614506278 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f8c980c7c80 con 0x55695b62dd80 2024-08-31T06:21:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8cb43ce740 10 client.29635 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8cb43ce740 10 client.29635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8cb43ce740 20 client.29635 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55695b66f1b0 0x55695baa5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8cb43ce740 4 client.29635 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:21:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.794+0000 7f8cb43ce740 1 -- 172.21.15.53:0/1614506278 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55695b9859f0 con 0x55695b66f1b0 2024-08-31T06:21:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.795+0000 7f8ca67fc640 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55695b66f1b0 0x55695baa5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.795+0000 7f8c8aff5640 10 client.29635 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:40.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.795+0000 7f8ca67fc640 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55695b66f1b0 0x55695baa5f50 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d468ac35f664d3fa server_cookie=f180980c1cfde153 in_seq=0 out_seq=0 2024-08-31T06:21:40.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.876+0000 7f8c8aff5640 1 -- 172.21.15.53:0/1614506278 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55695b9859f0 con 0x55695b66f1b0 2024-08-31T06:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.876+0000 7f8c8aff5640 10 client.29635 handle_command_reply: tid=0 2024-08-31T06:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 1 client.29635 shutdown 2024-08-31T06:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 1 -- 172.21.15.53:0/1614506278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b62dd80 msgr2=0x55695ba26e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b62dd80 0x55695ba26e90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8c980cc2a0 tx=0x7f8c98005de0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 1 -- 172.21.15.53:0/1614506278 shutdown_connections 2024-08-31T06:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55695b66f1b0 0x55695baa5f50 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8c8aff5640 0 client.29635 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55695b64e4d0 0x55695ba22870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55695b6462f0 0x55695ba22330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 1 --2- 172.21.15.53:0/1614506278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55695b62dd80 0x55695ba26e90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 1 -- 172.21.15.53:0/1614506278 >> 172.21.15.53:0/1614506278 conn(0x55695b663300 msgr2=0x55695ba1fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:40.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 1 -- 172.21.15.53:0/1614506278 shutdown_connections 2024-08-31T06:21:40.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 1 -- 172.21.15.53:0/1614506278 wait complete. 2024-08-31T06:21:40.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.877+0000 7f8cb43ce740 20 client.29635 trim_cache size 0 max 16384 2024-08-31T06:21:40.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:21:40.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:21:40.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:21:40.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:21:40.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 -- 172.21.15.53:0/2958123746 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c900b4ca0 msgr2=0x7f8c900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:40.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c900b4ca0 0x7f8c900b71b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009fd0 tx=0x7f8ca0009500 comp rx=0 tx=0).stop 2024-08-31T06:21:40.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 -- 172.21.15.53:0/2958123746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ca8102770 msgr2=0x7f8ca819af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:40.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ca8102770 0x7f8ca819af10 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f8c9802a930 tx=0x7f8c98003b90 comp rx=0 tx=0).stop 2024-08-31T06:21:40.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 -- 172.21.15.53:0/2958123746 shutdown_connections 2024-08-31T06:21:40.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8c900b4ca0 0x7f8c900b71b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ca81089f0 0x7f8ca819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca81080a0 0x7f8ca819b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 --2- 172.21.15.53:0/2958123746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ca8102770 0x7f8ca819af10 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:40.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 -- 172.21.15.53:0/2958123746 >> 172.21.15.53:0/2958123746 conn(0x7f8ca80fe1b0 msgr2=0x7f8ca81005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:40.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 -- 172.21.15.53:0/2958123746 shutdown_connections 2024-08-31T06:21:40.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:40.878+0000 7f8cad389640 1 -- 172.21.15.53:0/2958123746 wait complete. 2024-08-31T06:21:41.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 22792 5.32 MB/sec execute 89 sec latency 75.775 ms 2024-08-31T06:21:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:41 smithi130 ceph-mon[22266]: pgmap v847: 97 pgs: 97 active+clean; 518 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.3 MiB/s wr, 358 op/s 2024-08-31T06:21:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:41 smithi153 ceph-mon[22320]: pgmap v847: 97 pgs: 97 active+clean; 518 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.3 MiB/s wr, 358 op/s 2024-08-31T06:21:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:41 smithi053 ceph-mon[18924]: pgmap v847: 97 pgs: 97 active+clean; 518 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.3 MiB/s wr, 358 op/s 2024-08-31T06:21:42.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 22943 5.33 MB/sec execute 90 sec latency 48.430 ms 2024-08-31T06:21:43.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 23086 5.31 MB/sec execute 91 sec latency 47.578 ms 2024-08-31T06:21:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:43 smithi130 ceph-mon[22266]: pgmap v848: 97 pgs: 97 active+clean; 516 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.2 MiB/s wr, 291 op/s 2024-08-31T06:21:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:43 smithi153 ceph-mon[22320]: pgmap v848: 97 pgs: 97 active+clean; 516 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.2 MiB/s wr, 291 op/s 2024-08-31T06:21:44.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:43 smithi053 ceph-mon[18924]: pgmap v848: 97 pgs: 97 active+clean; 516 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.2 MiB/s wr, 291 op/s 2024-08-31T06:21:44.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 23233 5.30 MB/sec execute 92 sec latency 52.216 ms 2024-08-31T06:21:45.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 23386 5.30 MB/sec execute 93 sec latency 61.386 ms 2024-08-31T06:21:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:45 smithi130 ceph-mon[22266]: pgmap v849: 97 pgs: 97 active+clean; 522 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 336 op/s 2024-08-31T06:21:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:45 smithi153 ceph-mon[22320]: pgmap v849: 97 pgs: 97 active+clean; 522 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 336 op/s 2024-08-31T06:21:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:45 smithi053 ceph-mon[18924]: pgmap v849: 97 pgs: 97 active+clean; 522 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 336 op/s 2024-08-31T06:21:46.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 23553 5.33 MB/sec execute 94 sec latency 73.555 ms 2024-08-31T06:21:47.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 23717 5.36 MB/sec execute 95 sec latency 65.293 ms 2024-08-31T06:21:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:47 smithi130 ceph-mon[22266]: pgmap v850: 97 pgs: 97 active+clean; 523 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 368 op/s 2024-08-31T06:21:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:47 smithi153 ceph-mon[22320]: pgmap v850: 97 pgs: 97 active+clean; 523 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 368 op/s 2024-08-31T06:21:48.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:47 smithi053 ceph-mon[18924]: pgmap v850: 97 pgs: 97 active+clean; 523 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 368 op/s 2024-08-31T06:21:48.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 23889 5.41 MB/sec execute 96 sec latency 73.837 ms 2024-08-31T06:21:48.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:21:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:49.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 24062 5.42 MB/sec execute 97 sec latency 65.111 ms 2024-08-31T06:21:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.677+0000 7fcf4e312640 1 -- 172.21.15.53:0/3526431593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf48109270 msgr2=0x7fcf48109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.677+0000 7fcf4e312640 1 --2- 172.21.15.53:0/3526431593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf48109270 0x7fcf48109680 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009900 tx=0x7fcf3c02a410 comp rx=0 tx=0).stop 2024-08-31T06:21:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.677+0000 7fcf4e312640 1 -- 172.21.15.53:0/3526431593 shutdown_connections 2024-08-31T06:21:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.677+0000 7fcf4e312640 1 --2- 172.21.15.53:0/3526431593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf48109bc0 0x7fcf481103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.677+0000 7fcf4e312640 1 --2- 172.21.15.53:0/3526431593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf48109270 0x7fcf48109680 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.677+0000 7fcf4e312640 1 --2- 172.21.15.53:0/3526431593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf48103930 0x7fcf48103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.677+0000 7fcf4e312640 1 -- 172.21.15.53:0/3526431593 >> 172.21.15.53:0/3526431593 conn(0x7fcf480ff380 msgr2=0x7fcf481017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.677+0000 7fcf4e312640 1 -- 172.21.15.53:0/3526431593 shutdown_connections 2024-08-31T06:21:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.678+0000 7fcf4e312640 1 -- 172.21.15.53:0/3526431593 wait complete. 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.679+0000 7fcf4e312640 1 Processor -- start 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.679+0000 7fcf4e312640 1 -- start start 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.679+0000 7fcf4e312640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf48103930 0x7fcf4819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.679+0000 7fcf4e312640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf48109270 0x7fcf4819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.679+0000 7fcf4e312640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf48109bc0 0x7fcf4819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf48103930 0x7fcf4819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf48103930 0x7fcf4819a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37558/0 (socket says 172.21.15.53:37558) 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf48109270 0x7fcf4819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf48109270 0x7fcf4819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51580/0 (socket says 172.21.15.53:51580) 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf47fff640 1 -- 172.21.15.53:0/3636612057 learned_addr learned my addr 172.21.15.53:0/3636612057 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf4e312640 1 -- 172.21.15.53:0/3636612057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48113780 con 0x7fcf48109bc0 2024-08-31T06:21:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf4e312640 1 -- 172.21.15.53:0/3636612057 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48113600 con 0x7fcf48109270 2024-08-31T06:21:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf4c8af640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf48109bc0 0x7fcf4819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf4e312640 1 -- 172.21.15.53:0/3636612057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48113900 con 0x7fcf48103930 2024-08-31T06:21:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf47fff640 1 -- 172.21.15.53:0/3636612057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf48109270 msgr2=0x7fcf4819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf47fff640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf48109270 0x7fcf4819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf47fff640 1 -- 172.21.15.53:0/3636612057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf48109bc0 msgr2=0x7fcf4819f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf47fff640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf48109bc0 0x7fcf4819f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf47fff640 1 -- 172.21.15.53:0/3636612057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf481a00e0 con 0x7fcf48103930 2024-08-31T06:21:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.680+0000 7fcf47fff640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf48103930 0x7fcf4819a170 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800ea60 tx=0x7fcf3800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.681+0000 7fcf457fa640 1 -- 172.21.15.53:0/3636612057 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3800cde0 con 0x7fcf48103930 2024-08-31T06:21:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.681+0000 7fcf4e312640 1 -- 172.21.15.53:0/3636612057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf481a03d0 con 0x7fcf48103930 2024-08-31T06:21:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.681+0000 7fcf457fa640 1 -- 172.21.15.53:0/3636612057 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf380035f0 con 0x7fcf48103930 2024-08-31T06:21:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.681+0000 7fcf457fa640 1 -- 172.21.15.53:0/3636612057 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38010690 con 0x7fcf48103930 2024-08-31T06:21:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.681+0000 7fcf4e312640 1 -- 172.21.15.53:0/3636612057 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf481a6b30 con 0x7fcf48103930 2024-08-31T06:21:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.684+0000 7fcf457fa640 1 -- 172.21.15.53:0/3636612057 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcf38004000 con 0x7fcf48103930 2024-08-31T06:21:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.685+0000 7fcf54887740 1 Processor -- start 2024-08-31T06:21:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.685+0000 7fcf54887740 1 -- start start 2024-08-31T06:21:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf457fa640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf300b4d20 0x7fcf300b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf54887740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88de070 0x563fe8c832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf54887740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 0x563fe8c83800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf54887740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c83d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf457fa640 1 -- 172.21.15.53:0/3636612057 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fcf380e5870 con 0x7fcf48103930 2024-08-31T06:21:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf54887740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563fe8bfa630 con 0x563fe88bd390 2024-08-31T06:21:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf54887740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563fe8be9bc0 con 0x563fe88b51b0 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf54887740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563fe8bedb70 con 0x563fe88de070 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf4c8af640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf300b4d20 0x7fcf300b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88de070 0x563fe8c832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf477fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 0x563fe8c83800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88de070 0x563fe8c832c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37572/0 (socket says 172.21.15.53:37572) 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf47fff640 1 -- 172.21.15.53:0/1347821467 learned_addr learned my addr 172.21.15.53:0/1347821467 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.686+0000 7fcf4c8af640 1 --2- 172.21.15.53:0/1347821467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c83d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.687+0000 7fcf47fff640 1 -- 172.21.15.53:0/1347821467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 msgr2=0x563fe8c83800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.687+0000 7fcf47fff640 1 --2- 172.21.15.53:0/1347821467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 0x563fe8c83800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.687+0000 7fcf47fff640 1 -- 172.21.15.53:0/1347821467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 msgr2=0x563fe8c83d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.687+0000 7fcf47fff640 1 --2- 172.21.15.53:0/1347821467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c83d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.687+0000 7fcf47fff640 1 -- 172.21.15.53:0/1347821467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe8949650 con 0x563fe88de070 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.687+0000 7fcf4c8af640 1 --2- 172.21.15.53:0/1347821467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c83d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.687+0000 7fcf47fff640 1 --2- 172.21.15.53:0/1347821467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88de070 0x563fe8c832c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf380abe70 tx=0x7fcf380ab650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=969c0eea64c0b551 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.687+0000 7fcf2e7fc640 1 -- 172.21.15.53:0/1347821467 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf380ac5e0 con 0x563fe88de070 2024-08-31T06:21:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.687+0000 7fcf4c8af640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf300b4d20 0x7fcf300b7230 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcf40005fd0 tx=0x7fcf40013a80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.687+0000 7fcf2e7fc640 1 -- 172.21.15.53:0/1347821467 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf380abee0 con 0x563fe88de070 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.687+0000 7fcf2e7fc640 1 -- 172.21.15.53:0/1347821467 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf380b03b0 con 0x563fe88de070 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.688+0000 7fcf54887740 1 -- 172.21.15.53:0/1347821467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88de070 msgr2=0x563fe8c832c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.688+0000 7fcf54887740 1 --2- 172.21.15.53:0/1347821467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88de070 0x563fe8c832c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf380abe70 tx=0x7fcf380ab650 comp rx=0 tx=0).stop 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.688+0000 7fcf54887740 1 -- 172.21.15.53:0/1347821467 shutdown_connections 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.688+0000 7fcf54887740 1 --2- 172.21.15.53:0/1347821467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c83d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.688+0000 7fcf54887740 1 --2- 172.21.15.53:0/1347821467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 0x563fe8c83800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.688+0000 7fcf54887740 1 --2- 172.21.15.53:0/1347821467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88de070 0x563fe8c832c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.688+0000 7fcf54887740 1 -- 172.21.15.53:0/1347821467 >> 172.21.15.53:0/1347821467 conn(0x563fe88d2460 msgr2=0x563fe8c811b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.688+0000 7fcf54887740 1 -- 172.21.15.53:0/1347821467 shutdown_connections 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.688+0000 7fcf54887740 1 -- 172.21.15.53:0/1347821467 wait complete. 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.689+0000 7fcf54887740 1 -- start start 2024-08-31T06:21:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.689+0000 7fcf54887740 1 Processor -- start 2024-08-31T06:21:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf54887740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf54887740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c8f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c8f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf54887740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88de070 0x563fe8c94890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c8f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50720/0 (socket says 172.21.15.53:50720) 2024-08-31T06:21:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37576/0 (socket says 172.21.15.53:37576) 2024-08-31T06:21:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf477fe640 1 -- 172.21.15.53:0/1169691590 learned_addr learned my addr 172.21.15.53:0/1169691590 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:49.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf54887740 1 -- 172.21.15.53:0/1169691590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563fe8a4c700 con 0x563fe88bd390 2024-08-31T06:21:49.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf54887740 1 -- 172.21.15.53:0/1169691590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563fe8b70700 con 0x563fe88de070 2024-08-31T06:21:49.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf54887740 1 -- 172.21.15.53:0/1169691590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563fe8c95c70 con 0x563fe88b51b0 2024-08-31T06:21:49.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf4c8af640 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88de070 0x563fe8c94890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf54887740 10 client.0 _ll_register_callbacks cb 0x563fe8b9fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf47fff640 1 -- 172.21.15.53:0/1169691590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88de070 msgr2=0x563fe8c94890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf47fff640 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88de070 0x563fe8c94890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf47fff640 1 -- 172.21.15.53:0/1169691590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 msgr2=0x563fe8c8f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf47fff640 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c8f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.690+0000 7fcf47fff640 1 -- 172.21.15.53:0/1169691590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe8ba98b0 con 0x563fe88b51b0 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.691+0000 7fcf54887740 1 -- 172.21.15.53:0/1169691590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf380abee0 con 0x563fe88b51b0 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.691+0000 7fcf477fe640 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c8f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.691+0000 7fcf47fff640 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8ed50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcf380abe70 tx=0x7fcf3800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d13089eb4e9ec7a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.691+0000 7fcf277fe640 10 client.29647 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.691+0000 7fcf277fe640 1 -- 172.21.15.53:0/1169691590 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38097020 con 0x563fe88b51b0 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.691+0000 7fcf277fe640 1 -- 172.21.15.53:0/1169691590 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fcf380971c0 con 0x563fe88b51b0 2024-08-31T06:21:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.691+0000 7fcf277fe640 1 -- 172.21.15.53:0/1169691590 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fcf380ac5e0 con 0x563fe88b51b0 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.691+0000 7fcf54887740 10 client.29647 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.691+0000 7fcf54887740 1 -- 172.21.15.53:0/1169691590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=60}) -- 0x563fe8ca6030 con 0x563fe88b51b0 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.692+0000 7fcf277fe640 1 -- 172.21.15.53:0/1169691590 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fcf380a8170 con 0x563fe88b51b0 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.692+0000 7fcf54887740 10 client.29647 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.692+0000 7fcf54887740 10 client.29647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.692+0000 7fcf54887740 20 client.29647 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.692+0000 7fcf54887740 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fe889c9f0 0x563fe8ca9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.692+0000 7fcf54887740 4 client.29647 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.692+0000 7fcf54887740 1 -- 172.21.15.53:0/1169691590 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fe8bfc580 con 0x563fe889c9f0 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.692+0000 7fcf477fe640 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fe889c9f0 0x563fe8ca9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.692+0000 7fcf477fe640 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fe889c9f0 0x563fe8ca9390 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39d207f530c9ac13 server_cookie=572a26d8c411a5bc in_seq=0 out_seq=0 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.692+0000 7fcf277fe640 10 client.29647 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.693+0000 7fcf277fe640 1 -- 172.21.15.53:0/1169691590 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563fe8bfc580 con 0x563fe889c9f0 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.693+0000 7fcf277fe640 10 client.29647 handle_command_reply: tid=0 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.693+0000 7fcf54887740 1 client.29647 shutdown 2024-08-31T06:21:49.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.693+0000 7fcf54887740 1 -- 172.21.15.53:0/1169691590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 msgr2=0x563fe8c8ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.694+0000 7fcf54887740 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8ed50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcf380abe70 tx=0x7fcf3800ef90 comp rx=0 tx=0).stop 2024-08-31T06:21:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.694+0000 7fcf54887740 1 -- 172.21.15.53:0/1169691590 shutdown_connections 2024-08-31T06:21:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.694+0000 7fcf54887740 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fe889c9f0 0x563fe8ca9390 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.694+0000 7fcf54887740 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88de070 0x563fe8c94890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.694+0000 7fcf54887740 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c8f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.694+0000 7fcf277fe640 0 client.29647 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.694+0000 7fcf54887740 1 --2- 172.21.15.53:0/1169691590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8ed50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.694+0000 7fcf54887740 1 -- 172.21.15.53:0/1169691590 >> 172.21.15.53:0/1169691590 conn(0x563fe88d2460 msgr2=0x563fe8c86450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.694+0000 7fcf54887740 1 -- 172.21.15.53:0/1169691590 shutdown_connections 2024-08-31T06:21:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.694+0000 7fcf54887740 1 -- 172.21.15.53:0/1169691590 wait complete. 2024-08-31T06:21:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.694+0000 7fcf54887740 20 client.29647 trim_cache size 0 max 16384 2024-08-31T06:21:49.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.721+0000 7fcf54887740 1 Processor -- start 2024-08-31T06:21:49.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.721+0000 7fcf54887740 1 -- start start 2024-08-31T06:21:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf54887740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf54887740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c90980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf54887740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88de070 0x563fe8c8bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf54887740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48075360 con 0x563fe88bd390 2024-08-31T06:21:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf54887740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48077020 con 0x563fe88de070 2024-08-31T06:21:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf54887740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48075a30 con 0x563fe88b51b0 2024-08-31T06:21:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c90980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf4c8af640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88de070 0x563fe8c8bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf4c8af640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88de070 0x563fe8c8bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51612/0 (socket says 172.21.15.53:51612) 2024-08-31T06:21:49.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37578/0 (socket says 172.21.15.53:37578) 2024-08-31T06:21:49.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf4c8af640 1 -- 172.21.15.53:0/1786586736 learned_addr learned my addr 172.21.15.53:0/1786586736 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:49.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf47fff640 1 -- 172.21.15.53:0/1786586736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88de070 msgr2=0x563fe8c8bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:49.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf47fff640 1 --2- 172.21.15.53:0/1786586736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88de070 0x563fe8c8bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf47fff640 1 -- 172.21.15.53:0/1786586736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 msgr2=0x563fe8c90980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:49.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf47fff640 1 --2- 172.21.15.53:0/1786586736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c90980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.722+0000 7fcf47fff640 1 -- 172.21.15.53:0/1786586736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe8c90010 con 0x563fe88b51b0 2024-08-31T06:21:49.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.723+0000 7fcf47fff640 1 --2- 172.21.15.53:0/1786586736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8e260 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcf380a9150 tx=0x7fcf380e5000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bad362df2cb5bfef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:49.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.723+0000 7fcf2dffb640 1 -- 172.21.15.53:0/1786586736 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38097070 con 0x563fe88b51b0 2024-08-31T06:21:49.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.723+0000 7fcf2dffb640 1 -- 172.21.15.53:0/1786586736 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf380abee0 con 0x563fe88b51b0 2024-08-31T06:21:49.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.723+0000 7fcf2dffb640 1 -- 172.21.15.53:0/1786586736 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf380ab430 con 0x563fe88b51b0 2024-08-31T06:21:49.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.724+0000 7fcf54887740 1 -- 172.21.15.53:0/1786586736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 msgr2=0x563fe8c8e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:49.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.724+0000 7fcf54887740 1 --2- 172.21.15.53:0/1786586736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8e260 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcf380a9150 tx=0x7fcf380e5000 comp rx=0 tx=0).stop 2024-08-31T06:21:49.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.724+0000 7fcf54887740 1 -- 172.21.15.53:0/1786586736 shutdown_connections 2024-08-31T06:21:49.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.724+0000 7fcf54887740 1 --2- 172.21.15.53:0/1786586736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88de070 0x563fe8c8bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.724+0000 7fcf54887740 1 --2- 172.21.15.53:0/1786586736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88bd390 0x563fe8c90980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.724+0000 7fcf54887740 1 --2- 172.21.15.53:0/1786586736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88b51b0 0x563fe8c8e260 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.724+0000 7fcf54887740 1 -- 172.21.15.53:0/1786586736 >> 172.21.15.53:0/1786586736 conn(0x563fe88d2460 msgr2=0x563fe8c90270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:49.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.724+0000 7fcf54887740 1 -- 172.21.15.53:0/1786586736 shutdown_connections 2024-08-31T06:21:49.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.724+0000 7fcf54887740 1 -- 172.21.15.53:0/1786586736 wait complete. 2024-08-31T06:21:49.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.725+0000 7fcf54887740 1 -- start start 2024-08-31T06:21:49.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.725+0000 7fcf54887740 1 Processor -- start 2024-08-31T06:21:49.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf54887740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 0x563fe8d07aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf54887740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88bd390 0x563fe8d07fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf54887740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88de070 0x563fe8d08520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf54887740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48076950 con 0x563fe88de070 2024-08-31T06:21:49.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf54887740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcf480761c0 con 0x563fe88b51b0 2024-08-31T06:21:49.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf54887740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48073360 con 0x563fe88bd390 2024-08-31T06:21:49.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf54887740 10 client.0 _ll_register_callbacks cb 0x7fcf380d1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:49.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 0x563fe8d07aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf47fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 0x563fe8d07aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51626/0 (socket says 172.21.15.53:51626) 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf47fff640 1 -- 172.21.15.53:0/2137638540 learned_addr learned my addr 172.21.15.53:0/2137638540 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf477fe640 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88bd390 0x563fe8d07fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf4c8af640 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88de070 0x563fe8d08520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf47fff640 1 -- 172.21.15.53:0/2137638540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88bd390 msgr2=0x563fe8d07fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf47fff640 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88bd390 0x563fe8d07fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf47fff640 1 -- 172.21.15.53:0/2137638540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88de070 msgr2=0x563fe8d08520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf47fff640 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88de070 0x563fe8d08520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf47fff640 1 -- 172.21.15.53:0/2137638540 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe8d12b20 con 0x563fe88b51b0 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.726+0000 7fcf477fe640 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88bd390 0x563fe8d07fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.727+0000 7fcf47fff640 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 0x563fe8d07aa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcf380abe20 tx=0x7fcf380b05c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed8bf068467c7bdc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.727+0000 7fcf277fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.727+0000 7fcf277fe640 1 -- 172.21.15.53:0/2137638540 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38097040 con 0x563fe88b51b0 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.727+0000 7fcf54887740 1 -- 172.21.15.53:0/2137638540 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf380abee0 con 0x563fe88b51b0 2024-08-31T06:21:49.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.727+0000 7fcf277fe640 1 -- 172.21.15.53:0/2137638540 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fcf380a84d0 con 0x563fe88b51b0 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.727+0000 7fcf277fe640 1 -- 172.21.15.53:0/2137638540 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fcf380971e0 con 0x563fe88b51b0 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.727+0000 7fcf54887740 10 client.29663 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.727+0000 7fcf54887740 1 -- 172.21.15.53:0/2137638540 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x563fe8d12b20 con 0x563fe88b51b0 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.727+0000 7fcf277fe640 1 -- 172.21.15.53:0/2137638540 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf380abee0 con 0x563fe88b51b0 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.728+0000 7fcf277fe640 1 -- 172.21.15.53:0/2137638540 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fcf380aac40 con 0x563fe88b51b0 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.728+0000 7fcf54887740 10 client.29663 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.728+0000 7fcf54887740 10 client.29663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.728+0000 7fcf54887740 20 client.29663 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.728+0000 7fcf54887740 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fe8871da0 0x563fe8d16070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.728+0000 7fcf54887740 4 client.29663 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.728+0000 7fcf54887740 1 -- 172.21.15.53:0/2137638540 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563fe8bf8020 con 0x563fe8871da0 2024-08-31T06:21:49.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.728+0000 7fcf477fe640 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fe8871da0 0x563fe8d16070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:49.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.728+0000 7fcf277fe640 10 client.29663 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:49.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.729+0000 7fcf477fe640 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fe8871da0 0x563fe8d16070 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b94e2bf9111bec3e server_cookie=5d3fc4bc961cfbe2 in_seq=0 out_seq=0 2024-08-31T06:21:49.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.729+0000 7fcf277fe640 1 -- 172.21.15.53:0/2137638540 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6054 (crc 0 0 0) 0x563fe8bf8020 con 0x563fe8871da0 2024-08-31T06:21:49.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.729+0000 7fcf277fe640 10 client.29663 handle_command_reply: tid=0 2024-08-31T06:21:49.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.729+0000 7fcf54887740 1 client.29663 shutdown 2024-08-31T06:21:49.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.729+0000 7fcf54887740 1 -- 172.21.15.53:0/2137638540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 msgr2=0x563fe8d07aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:49.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.729+0000 7fcf54887740 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 0x563fe8d07aa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcf380abe20 tx=0x7fcf380b05c0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.730+0000 7fcf54887740 1 -- 172.21.15.53:0/2137638540 shutdown_connections 2024-08-31T06:21:49.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.730+0000 7fcf54887740 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fe8871da0 0x563fe8d16070 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.730+0000 7fcf54887740 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fe88de070 0x563fe8d08520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.730+0000 7fcf54887740 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fe88bd390 0x563fe8d07fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.730+0000 7fcf277fe640 0 client.29663 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:49.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.730+0000 7fcf54887740 1 --2- 172.21.15.53:0/2137638540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fe88b51b0 0x563fe8d07aa0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.730+0000 7fcf54887740 1 -- 172.21.15.53:0/2137638540 >> 172.21.15.53:0/2137638540 conn(0x563fe88d2460 msgr2=0x563fe8c8d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:49.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.730+0000 7fcf54887740 1 -- 172.21.15.53:0/2137638540 shutdown_connections 2024-08-31T06:21:49.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.730+0000 7fcf54887740 1 -- 172.21.15.53:0/2137638540 wait complete. 2024-08-31T06:21:49.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.730+0000 7fcf54887740 20 client.29663 trim_cache size 0 max 16384 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.736 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.737 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.738 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.739 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:21:49.740 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.743 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.744 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:21:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:21:49.746 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:21:49.747 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:21:49.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 -- 172.21.15.53:0/3636612057 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf300b4d20 msgr2=0x7fcf300b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:49.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf300b4d20 0x7fcf300b7230 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcf40005fd0 tx=0x7fcf40013a80 comp rx=0 tx=0).stop 2024-08-31T06:21:49.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 -- 172.21.15.53:0/3636612057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf48103930 msgr2=0x7fcf4819a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:49.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf48103930 0x7fcf4819a170 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800ea60 tx=0x7fcf3800ef20 comp rx=0 tx=0).stop 2024-08-31T06:21:49.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 -- 172.21.15.53:0/3636612057 shutdown_connections 2024-08-31T06:21:49.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcf300b4d20 0x7fcf300b7230 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf48109bc0 0x7fcf4819f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf48109270 0x7fcf4819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 --2- 172.21.15.53:0/3636612057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf48103930 0x7fcf4819a170 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:49.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 -- 172.21.15.53:0/3636612057 >> 172.21.15.53:0/3636612057 conn(0x7fcf480ff380 msgr2=0x7fcf481017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:49.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 -- 172.21.15.53:0/3636612057 shutdown_connections 2024-08-31T06:21:49.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:49.731+0000 7fcf4e312640 1 -- 172.21.15.53:0/3636612057 wait complete. 2024-08-31T06:21:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:49 smithi053 ceph-mon[18924]: pgmap v851: 97 pgs: 97 active+clean; 519 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 357 op/s 2024-08-31T06:21:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:49 smithi130 ceph-mon[22266]: pgmap v851: 97 pgs: 97 active+clean; 519 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 357 op/s 2024-08-31T06:21:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:49 smithi153 ceph-mon[22320]: pgmap v851: 97 pgs: 97 active+clean; 519 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 357 op/s 2024-08-31T06:21:50.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 24233 5.46 MB/sec execute 98 sec latency 89.552 ms 2024-08-31T06:21:50.570 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:21:50.570 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:21:50.946 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:51.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 24363 5.42 MB/sec execute 99 sec latency 79.877 ms 2024-08-31T06:21:51.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.502+0000 7f3722a11640 1 -- 172.21.15.53:0/1078860884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f371c1078d0 msgr2=0x7f371c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:51.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.502+0000 7f3722a11640 1 --2- 172.21.15.53:0/1078860884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f371c1078d0 0x7f371c107ce0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3710009900 tx=0x7f371002a410 comp rx=0 tx=0).stop 2024-08-31T06:21:51.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.502+0000 7f3722a11640 1 -- 172.21.15.53:0/1078860884 shutdown_connections 2024-08-31T06:21:51.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.502+0000 7f3722a11640 1 --2- 172.21.15.53:0/1078860884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371c108220 0x7f371c10ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:51.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.502+0000 7f3722a11640 1 --2- 172.21.15.53:0/1078860884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f371c1078d0 0x7f371c107ce0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:51.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.502+0000 7f3722a11640 1 --2- 172.21.15.53:0/1078860884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c101f90 0x7f371c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:51.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.502+0000 7f3722a11640 1 -- 172.21.15.53:0/1078860884 >> 172.21.15.53:0/1078860884 conn(0x7f371c077a00 msgr2=0x7f371c077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:51.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.502+0000 7f3722a11640 1 -- 172.21.15.53:0/1078860884 shutdown_connections 2024-08-31T06:21:51.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.502+0000 7f3722a11640 1 -- 172.21.15.53:0/1078860884 wait complete. 2024-08-31T06:21:51.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.503+0000 7f3722a11640 1 Processor -- start 2024-08-31T06:21:51.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.503+0000 7f3722a11640 1 -- start start 2024-08-31T06:21:51.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f3722a11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c101f90 0x7f371c19c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:51.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f3722a11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371c1078d0 0x7f371c19c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:51.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f3722a11640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f371c108220 0x7f371c1a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:51.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f3722a11640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f371c113710 con 0x7f371c101f90 2024-08-31T06:21:51.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f3722a11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f371c113590 con 0x7f371c1078d0 2024-08-31T06:21:51.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f3722a11640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f371c113890 con 0x7f371c108220 2024-08-31T06:21:51.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f371bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c101f90 0x7f371c19c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:51.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f3720fae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f371c108220 0x7f371c1a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:51.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f371b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371c1078d0 0x7f371c19c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:51.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f371bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c101f90 0x7f371c19c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50742/0 (socket says 172.21.15.53:50742) 2024-08-31T06:21:51.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f371bfff640 1 -- 172.21.15.53:0/2893149520 learned_addr learned my addr 172.21.15.53:0/2893149520 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:51.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.504+0000 7f3720fae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f371c108220 0x7f371c1a1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37610/0 (socket says 172.21.15.53:37610) 2024-08-31T06:21:51.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f3720fae640 1 -- 172.21.15.53:0/2893149520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371c1078d0 msgr2=0x7f371c19c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:51.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f3720fae640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371c1078d0 0x7f371c19c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:51.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f3720fae640 1 -- 172.21.15.53:0/2893149520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c101f90 msgr2=0x7f371c19c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:51.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f3720fae640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c101f90 0x7f371c19c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:51.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f3720fae640 1 -- 172.21.15.53:0/2893149520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c1a2390 con 0x7f371c108220 2024-08-31T06:21:51.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f371bfff640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c101f90 0x7f371c19c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:51.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f371b7fe640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371c1078d0 0x7f371c19c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:51.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f3720fae640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f371c108220 0x7f371c1a1c60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3714009fd0 tx=0x7f371400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:51.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f37197fa640 1 -- 172.21.15.53:0/2893149520 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371400ce20 con 0x7f371c108220 2024-08-31T06:21:51.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f37197fa640 1 -- 172.21.15.53:0/2893149520 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3714005020 con 0x7f371c108220 2024-08-31T06:21:51.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f3722a11640 1 -- 172.21.15.53:0/2893149520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371c1a2680 con 0x7f371c108220 2024-08-31T06:21:51.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.505+0000 7f3722a11640 1 -- 172.21.15.53:0/2893149520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371c1a8de0 con 0x7f371c108220 2024-08-31T06:21:51.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.506+0000 7f37197fa640 1 -- 172.21.15.53:0/2893149520 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714010690 con 0x7f371c108220 2024-08-31T06:21:51.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.507+0000 7f3722a11640 1 -- 172.21.15.53:0/2893149520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3708005290 con 0x7f371c108220 2024-08-31T06:21:51.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.509+0000 7f37197fa640 1 -- 172.21.15.53:0/2893149520 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3714004b20 con 0x7f371c108220 2024-08-31T06:21:51.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.510+0000 7f37197fa640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37040b4da0 0x7f37040b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:51.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.510+0000 7f371bfff640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37040b4da0 0x7f37040b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:51.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.510+0000 7f37197fa640 1 -- 172.21.15.53:0/2893149520 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f37140e5a20 con 0x7f371c108220 2024-08-31T06:21:51.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.511+0000 7f371bfff640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37040b4da0 0x7f37040b72b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f370c0095f0 tx=0x7f370c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:51.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.516+0000 7f37197fa640 1 -- 172.21.15.53:0/2893149520 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f37140ac790 con 0x7f371c108220 2024-08-31T06:21:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.882+0000 7f3722a11640 1 -- 172.21.15.53:0/2893149520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3708005850 con 0x7f371c108220 2024-08-31T06:21:51.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.883+0000 7f37197fa640 1 -- 172.21.15.53:0/2893149520 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+11999 (secure 0 0 0) 0x7f37140ac090 con 0x7f371c108220 2024-08-31T06:21:51.886 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 60 2024-08-31T06:21:51.886 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:21:51.886 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":60,"btime":"2024-08-31T06:20:55:888273+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":60,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:20:55.550353+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.886+0000 7f3722a11640 1 -- 172.21.15.53:0/2893149520 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37040b4da0 msgr2=0x7f37040b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.886+0000 7f3722a11640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37040b4da0 0x7f37040b72b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f370c0095f0 tx=0x7f370c005f90 comp rx=0 tx=0).stop 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.886+0000 7f3722a11640 1 -- 172.21.15.53:0/2893149520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f371c108220 msgr2=0x7f371c1a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.886+0000 7f3722a11640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f371c108220 0x7f371c1a1c60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3714009fd0 tx=0x7f371400ef10 comp rx=0 tx=0).stop 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.886+0000 7f3722a11640 1 -- 172.21.15.53:0/2893149520 shutdown_connections 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.886+0000 7f3722a11640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f37040b4da0 0x7f37040b72b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.886+0000 7f3722a11640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f371c108220 0x7f371c1a1c60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.886+0000 7f3722a11640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f371c1078d0 0x7f371c19c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.886+0000 7f3722a11640 1 --2- 172.21.15.53:0/2893149520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c101f90 0x7f371c19c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.886+0000 7f3722a11640 1 -- 172.21.15.53:0/2893149520 >> 172.21.15.53:0/2893149520 conn(0x7f371c077a00 msgr2=0x7f371c1057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.886+0000 7f3722a11640 1 -- 172.21.15.53:0/2893149520 shutdown_connections 2024-08-31T06:21:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:51.887+0000 7f3722a11640 1 -- 172.21.15.53:0/2893149520 wait complete. 2024-08-31T06:21:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:51 smithi130 ceph-mon[22266]: pgmap v852: 97 pgs: 97 active+clean; 516 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 408 op/s 2024-08-31T06:21:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:51 smithi153 ceph-mon[22320]: pgmap v852: 97 pgs: 97 active+clean; 516 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 408 op/s 2024-08-31T06:21:52.223 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:51 smithi053 ceph-mon[18924]: pgmap v852: 97 pgs: 97 active+clean; 516 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 408 op/s 2024-08-31T06:21:52.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 24522 5.42 MB/sec execute 100 sec latency 77.613 ms 2024-08-31T06:21:52.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:21:52.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:52 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2893149520' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:21:53.086 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:53.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:52 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2893149520' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:21:53.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:52 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2893149520' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:21:53.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 24687 5.45 MB/sec execute 101 sec latency 65.674 ms 2024-08-31T06:21:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.680+0000 7fc0ae986640 1 -- 172.21.15.53:0/3181490811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8102800 msgr2=0x7fc0a8102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.680+0000 7fc0ae986640 1 --2- 172.21.15.53:0/3181490811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8102800 0x7fc0a8102c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc098009900 tx=0x7fc09802a410 comp rx=0 tx=0).stop 2024-08-31T06:21:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.680+0000 7fc0ae986640 1 -- 172.21.15.53:0/3181490811 shutdown_connections 2024-08-31T06:21:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.680+0000 7fc0ae986640 1 --2- 172.21.15.53:0/3181490811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a8108a90 0x7fc0a810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.681+0000 7fc0ae986640 1 --2- 172.21.15.53:0/3181490811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a8108140 0x7fc0a8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.681+0000 7fc0ae986640 1 --2- 172.21.15.53:0/3181490811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8102800 0x7fc0a8102c10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.681+0000 7fc0ae986640 1 -- 172.21.15.53:0/3181490811 >> 172.21.15.53:0/3181490811 conn(0x7fc0a80794d0 msgr2=0x7fc0a80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.681+0000 7fc0ae986640 1 -- 172.21.15.53:0/3181490811 shutdown_connections 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.681+0000 7fc0ae986640 1 -- 172.21.15.53:0/3181490811 wait complete. 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.681+0000 7fc0ae986640 1 Processor -- start 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.682+0000 7fc0ae986640 1 -- start start 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.682+0000 7fc0ae986640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a8102800 0x7fc0a819c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.682+0000 7fc0ae986640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8108140 0x7fc0a819c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.682+0000 7fc0ae986640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a8108a90 0x7fc0a81a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.682+0000 7fc0ae986640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8110e50 con 0x7fc0a8102800 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.682+0000 7fc0ae986640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8110cd0 con 0x7fc0a8108140 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.682+0000 7fc0ae986640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8110fd0 con 0x7fc0a8108a90 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.682+0000 7fc0a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a8102800 0x7fc0a819c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.682+0000 7fc0a77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8108140 0x7fc0a819c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.682+0000 7fc0a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a8102800 0x7fc0a819c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38364/0 (socket says 172.21.15.53:38364) 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.683+0000 7fc0a77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8108140 0x7fc0a819c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:57692/0 (socket says 172.21.15.53:57692) 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.683+0000 7fc0acf23640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a8108a90 0x7fc0a81a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.683+0000 7fc0a7fff640 1 -- 172.21.15.53:0/2660579130 learned_addr learned my addr 172.21.15.53:0/2660579130 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.683+0000 7fc0a77fe640 1 -- 172.21.15.53:0/2660579130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a8108a90 msgr2=0x7fc0a81a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.683+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a8108a90 0x7fc0a81a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.683+0000 7fc0a77fe640 1 -- 172.21.15.53:0/2660579130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a8102800 msgr2=0x7fc0a819c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.683+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a8102800 0x7fc0a819c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.683+0000 7fc0a77fe640 1 -- 172.21.15.53:0/2660579130 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a81a22b0 con 0x7fc0a8108140 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.683+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a8102800 0x7fc0a819c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.683+0000 7fc0acf23640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a8108a90 0x7fc0a81a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.683+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8108140 0x7fc0a819c8e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00e9c0 tx=0x7fc09c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.684+0000 7fc0a57fa640 1 -- 172.21.15.53:0/2660579130 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c00ccc0 con 0x7fc0a8108140 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.684+0000 7fc0a57fa640 1 -- 172.21.15.53:0/2660579130 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc09c0108c0 con 0x7fc0a8108140 2024-08-31T06:21:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.684+0000 7fc0a57fa640 1 -- 172.21.15.53:0/2660579130 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c018750 con 0x7fc0a8108140 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.684+0000 7fc0ae986640 1 -- 172.21.15.53:0/2660579130 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a81a25a0 con 0x7fc0a8108140 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.684+0000 7fc0ae986640 1 -- 172.21.15.53:0/2660579130 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a81a8d00 con 0x7fc0a8108140 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.688+0000 7fc0b4efb740 1 Processor -- start 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.688+0000 7fc0b4efb740 1 -- start start 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.688+0000 7fc0a57fa640 1 -- 172.21.15.53:0/2660579130 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc09c010430 con 0x7fc0a8108140 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.688+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f93070 0x55a7c7338350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.688+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7338890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.688+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f72390 0x55a7c7338dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.688+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a7c72af680 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.688+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a7c729ec10 con 0x55a7c6f93070 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.688+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a7c72a2bc0 con 0x55a7c6f72390 2024-08-31T06:21:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.689+0000 7fc0a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7338890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.689+0000 7fc0a77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f72390 0x55a7c7338dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.689+0000 7fc0a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7338890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38380/0 (socket says 172.21.15.53:38380) 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.689+0000 7fc0a7fff640 1 -- 172.21.15.53:0/1687770235 learned_addr learned my addr 172.21.15.53:0/1687770235 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.689+0000 7fc0acf23640 1 --2- 172.21.15.53:0/1687770235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f93070 0x55a7c7338350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.689+0000 7fc0a7fff640 1 -- 172.21.15.53:0/1687770235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f72390 msgr2=0x55a7c7338dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.689+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/1687770235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f72390 0x55a7c7338dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.689+0000 7fc0a7fff640 1 -- 172.21.15.53:0/1687770235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f93070 msgr2=0x55a7c7338350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.689+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/1687770235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f93070 0x55a7c7338350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.689+0000 7fc0a7fff640 1 -- 172.21.15.53:0/1687770235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c6ffe650 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.689+0000 7fc0acf23640 1 --2- 172.21.15.53:0/1687770235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f93070 0x55a7c7338350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.690+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/1687770235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7338890 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fc098005e00 tx=0x7fc098032f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226f6a3a77914b08 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.690+0000 7fc0a57fa640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0900b4d20 0x7fc0900b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.690+0000 7fc08e7fc640 1 -- 172.21.15.53:0/1687770235 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098035070 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.690+0000 7fc0acf23640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0900b4d20 0x7fc0900b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.690+0000 7fc0a57fa640 1 -- 172.21.15.53:0/2660579130 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fc09c0e57f0 con 0x7fc0a8108140 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.690+0000 7fc08e7fc640 1 -- 172.21.15.53:0/1687770235 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0980044c0 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.690+0000 7fc08e7fc640 1 -- 172.21.15.53:0/1687770235 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098003e00 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.692+0000 7fc0b4efb740 1 -- 172.21.15.53:0/1687770235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f6a1b0 msgr2=0x55a7c7338890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.692+0000 7fc0acf23640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0900b4d20 0x7fc0900b7230 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005fd0 tx=0x7fc0a00096a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.692+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/1687770235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7338890 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fc098005e00 tx=0x7fc098032f70 comp rx=0 tx=0).stop 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.692+0000 7fc0b4efb740 1 -- 172.21.15.53:0/1687770235 shutdown_connections 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.692+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/1687770235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f72390 0x55a7c7338dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.692+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/1687770235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7338890 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.692+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/1687770235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f93070 0x55a7c7338350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.692+0000 7fc0b4efb740 1 -- 172.21.15.53:0/1687770235 >> 172.21.15.53:0/1687770235 conn(0x55a7c6f87460 msgr2=0x55a7c7336240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.692+0000 7fc0b4efb740 1 -- 172.21.15.53:0/1687770235 shutdown_connections 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.692+0000 7fc0b4efb740 1 -- 172.21.15.53:0/1687770235 wait complete. 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.692+0000 7fc0b4efb740 1 -- start start 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0b4efb740 1 Processor -- start 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c734c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f72390 0x55a7c734c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f93070 0x55a7c7358590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7101700 con 0x55a7c6f93070 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7225750 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a7c734f200 con 0x55a7c6f72390 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0b4efb740 10 client.0 _ll_register_callbacks cb 0x55a7c7254e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0a7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c734c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0a77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f72390 0x55a7c734c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0a7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c734c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:57706/0 (socket says 172.21.15.53:57706) 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0a7fff640 1 -- 172.21.15.53:0/3500156627 learned_addr learned my addr 172.21.15.53:0/3500156627 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.693+0000 7fc0acf23640 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f93070 0x55a7c7358590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.694+0000 7fc0a7fff640 1 -- 172.21.15.53:0/3500156627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f72390 msgr2=0x55a7c734c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.694+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f72390 0x55a7c734c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.694+0000 7fc0a7fff640 1 -- 172.21.15.53:0/3500156627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f93070 msgr2=0x55a7c7358590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.694+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f93070 0x55a7c7358590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.694+0000 7fc0a7fff640 1 -- 172.21.15.53:0/3500156627 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7c725e900 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.694+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c734c2c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc098000c00 tx=0x7fc098003730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70e177ea018b23ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.694+0000 7fc0877fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.694+0000 7fc0877fe640 1 -- 172.21.15.53:0/3500156627 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098053060 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.694+0000 7fc0b4efb740 1 -- 172.21.15.53:0/3500156627 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a7c72b15d0 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.694+0000 7fc0877fe640 1 -- 172.21.15.53:0/3500156627 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fc098003b60 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.695+0000 7fc0877fe640 1 -- 172.21.15.53:0/3500156627 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fc098035040 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.695+0000 7fc0b4efb740 10 client.29678 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.695+0000 7fc0b4efb740 1 -- 172.21.15.53:0/3500156627 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55a7c735afc0 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.695+0000 7fc0877fe640 1 -- 172.21.15.53:0/3500156627 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc098009520 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.695+0000 7fc0877fe640 1 -- 172.21.15.53:0/3500156627 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fc098045a10 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.695+0000 7fc0b4efb740 10 client.29678 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.695+0000 7fc0b4efb740 10 client.29678 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:21:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.695+0000 7fc0b4efb740 20 client.29678 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.695+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a7c6f519f0 0x55a7c735e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.695+0000 7fc0b4efb740 4 client.29678 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.695+0000 7fc0b4efb740 1 -- 172.21.15.53:0/3500156627 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7c72b15d0 con 0x55a7c6f519f0 2024-08-31T06:21:53.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.696+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a7c6f519f0 0x55a7c735e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.696+0000 7fc0877fe640 10 client.29678 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:21:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.696+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a7c6f519f0 0x55a7c735e490 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b4b52262ecf7602b server_cookie=41136c67c01aeb4 in_seq=0 out_seq=0 2024-08-31T06:21:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.697+0000 7fc0877fe640 1 -- 172.21.15.53:0/3500156627 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7c72b15d0 con 0x55a7c6f519f0 2024-08-31T06:21:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.697+0000 7fc0877fe640 10 client.29678 handle_command_reply: tid=0 2024-08-31T06:21:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.697+0000 7fc0b4efb740 1 client.29678 shutdown 2024-08-31T06:21:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0b4efb740 1 -- 172.21.15.53:0/3500156627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 msgr2=0x55a7c734c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c734c2c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc098000c00 tx=0x7fc098003730 comp rx=0 tx=0).stop 2024-08-31T06:21:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0b4efb740 1 -- 172.21.15.53:0/3500156627 shutdown_connections 2024-08-31T06:21:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f93070 0x55a7c7358590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a7c6f519f0 0x55a7c735e490 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f72390 0x55a7c734c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/3500156627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c734c2c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0b4efb740 1 -- 172.21.15.53:0/3500156627 >> 172.21.15.53:0/3500156627 conn(0x55a7c6f87460 msgr2=0x55a7c7334800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:53.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0877fe640 0 client.29678 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:21:53.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0b4efb740 1 -- 172.21.15.53:0/3500156627 shutdown_connections 2024-08-31T06:21:53.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0b4efb740 1 -- 172.21.15.53:0/3500156627 wait complete. 2024-08-31T06:21:53.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.698+0000 7fc0b4efb740 20 client.29678 trim_cache size 0 max 16384 2024-08-31T06:21:53.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.719+0000 7fc0b4efb740 1 Processor -- start 2024-08-31T06:21:53.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.719+0000 7fc0b4efb740 1 -- start start 2024-08-31T06:21:53.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.719+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c734c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.719+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 0x55a7c734c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f93070 0x55a7c73494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81ad330 con 0x55a7c6f72390 2024-08-31T06:21:53.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81aeff0 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81ada00 con 0x55a7c6f93070 2024-08-31T06:21:53.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 0x55a7c734c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 0x55a7c734c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38410/0 (socket says 172.21.15.53:38410) 2024-08-31T06:21:53.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0a77fe640 1 -- 172.21.15.53:0/2789455043 learned_addr learned my addr 172.21.15.53:0/2789455043 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:53.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/2789455043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c734c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0acf23640 1 --2- 172.21.15.53:0/2789455043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f93070 0x55a7c73494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0a77fe640 1 -- 172.21.15.53:0/2789455043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f93070 msgr2=0x55a7c73494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:53.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/2789455043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f93070 0x55a7c73494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0a77fe640 1 -- 172.21.15.53:0/2789455043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 msgr2=0x55a7c734c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:53.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/2789455043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c734c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0a77fe640 1 -- 172.21.15.53:0/2789455043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c734a7c0 con 0x55a7c6f72390 2024-08-31T06:21:53.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.720+0000 7fc0acf23640 1 --2- 172.21.15.53:0/2789455043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f93070 0x55a7c73494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:53.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.721+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/2789455043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 0x55a7c734c5b0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0e2f80 tx=0x7fc09c0abe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c9e35805b3711e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:53.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.721+0000 7fc08dffb640 1 -- 172.21.15.53:0/2789455043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0abf70 con 0x55a7c6f72390 2024-08-31T06:21:53.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.721+0000 7fc08dffb640 1 -- 172.21.15.53:0/2789455043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc09c0e8e50 con 0x55a7c6f72390 2024-08-31T06:21:53.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.721+0000 7fc08dffb640 1 -- 172.21.15.53:0/2789455043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0a8200 con 0x55a7c6f72390 2024-08-31T06:21:53.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.722+0000 7fc0b4efb740 1 -- 172.21.15.53:0/2789455043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 msgr2=0x55a7c734c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:53.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.722+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/2789455043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 0x55a7c734c5b0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0e2f80 tx=0x7fc09c0abe70 comp rx=0 tx=0).stop 2024-08-31T06:21:53.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.722+0000 7fc0b4efb740 1 -- 172.21.15.53:0/2789455043 shutdown_connections 2024-08-31T06:21:53.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.722+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/2789455043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f93070 0x55a7c73494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.722+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/2789455043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 0x55a7c734c5b0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.722+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/2789455043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c734c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.722+0000 7fc0b4efb740 1 -- 172.21.15.53:0/2789455043 >> 172.21.15.53:0/2789455043 conn(0x55a7c6f87460 msgr2=0x55a7c7347430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:53.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.723+0000 7fc0b4efb740 1 -- 172.21.15.53:0/2789455043 shutdown_connections 2024-08-31T06:21:53.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.723+0000 7fc0b4efb740 1 -- 172.21.15.53:0/2789455043 wait complete. 2024-08-31T06:21:53.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.723+0000 7fc0b4efb740 1 -- start start 2024-08-31T06:21:53.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.723+0000 7fc0b4efb740 1 Processor -- start 2024-08-31T06:21:53.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7354b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 0x55a7c734ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0b4efb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f93070 0x55a7c7350500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81ae920 con 0x55a7c6f72390 2024-08-31T06:21:53.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81ae190 con 0x55a7c6f6a1b0 2024-08-31T06:21:53.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0b4efb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81ab370 con 0x55a7c6f93070 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0a7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7354b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0b4efb740 10 client.0 _ll_register_callbacks cb 0x7fc09c0eb420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 0x55a7c734ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0a7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7354b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:57734/0 (socket says 172.21.15.53:57734) 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0a7fff640 1 -- 172.21.15.53:0/7225469 learned_addr learned my addr 172.21.15.53:0/7225469 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.724+0000 7fc0acf23640 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f93070 0x55a7c7350500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.725+0000 7fc0a77fe640 1 -- 172.21.15.53:0/7225469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f93070 msgr2=0x55a7c7350500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.725+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f93070 0x55a7c7350500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.725+0000 7fc0a77fe640 1 -- 172.21.15.53:0/7225469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 msgr2=0x55a7c7354b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.725+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7354b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.725+0000 7fc0a77fe640 1 -- 172.21.15.53:0/7225469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7c7350ac0 con 0x55a7c6f72390 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.725+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7354b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.725+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 0x55a7c734ffc0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x55a7c723e220 tx=0x7fc09c0eb0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f55a966e477edf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:53.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.725+0000 7fc0877fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.725+0000 7fc0877fe640 1 -- 172.21.15.53:0/7225469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0abf70 con 0x55a7c6f72390 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.725+0000 7fc0877fe640 1 -- 172.21.15.53:0/7225469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fc09c0e31a0 con 0x55a7c6f72390 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.725+0000 7fc0b4efb740 1 -- 172.21.15.53:0/7225469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc09c0e8e50 con 0x55a7c6f72390 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.726+0000 7fc0877fe640 1 -- 172.21.15.53:0/7225469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fc09c0a8200 con 0x55a7c6f72390 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.726+0000 7fc0b4efb740 10 client.20772 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.726+0000 7fc0b4efb740 1 -- 172.21.15.53:0/7225469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55a7c73c8b70 con 0x55a7c6f72390 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.726+0000 7fc0877fe640 1 -- 172.21.15.53:0/7225469 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc09c0e8e50 con 0x55a7c6f72390 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.726+0000 7fc0877fe640 1 -- 172.21.15.53:0/7225469 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fc09c0a78e0 con 0x55a7c6f72390 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.726+0000 7fc0b4efb740 10 client.20772 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.726+0000 7fc0b4efb740 10 client.20772 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.726+0000 7fc0b4efb740 20 client.20772 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.726+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a7c6f26da0 0x55a7c73cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:53.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.726+0000 7fc0b4efb740 4 client.20772 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:21:53.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.726+0000 7fc0b4efb740 1 -- 172.21.15.53:0/7225469 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a7c72ad070 con 0x55a7c6f26da0 2024-08-31T06:21:53.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.727+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a7c6f26da0 0x55a7c73cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:53.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.727+0000 7fc0877fe640 10 client.20772 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:21:53.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.727+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a7c6f26da0 0x55a7c73cb230 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c53240aa37a109e7 server_cookie=3927cb91e2ad4c21 in_seq=0 out_seq=0 2024-08-31T06:21:53.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0877fe640 1 -- 172.21.15.53:0/7225469 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a7c72ad070 con 0x55a7c6f26da0 2024-08-31T06:21:53.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0877fe640 10 client.20772 handle_command_reply: tid=0 2024-08-31T06:21:53.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0b4efb740 1 client.20772 shutdown 2024-08-31T06:21:53.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0b4efb740 1 -- 172.21.15.53:0/7225469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 msgr2=0x55a7c734ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:53.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 0x55a7c734ffc0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x55a7c723e220 tx=0x7fc09c0eb0d0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0b4efb740 1 -- 172.21.15.53:0/7225469 shutdown_connections 2024-08-31T06:21:53.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55a7c6f26da0 0x55a7c73cb230 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7c6f93070 0x55a7c7350500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7c6f72390 0x55a7c734ffc0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0877fe640 0 client.20772 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:21:53.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0b4efb740 1 --2- 172.21.15.53:0/7225469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a7c6f6a1b0 0x55a7c7354b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.728+0000 7fc0b4efb740 1 -- 172.21.15.53:0/7225469 >> 172.21.15.53:0/7225469 conn(0x55a7c6f87460 msgr2=0x55a7c734c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:53.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.729+0000 7fc0b4efb740 1 -- 172.21.15.53:0/7225469 shutdown_connections 2024-08-31T06:21:53.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.729+0000 7fc0b4efb740 1 -- 172.21.15.53:0/7225469 wait complete. 2024-08-31T06:21:53.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.729+0000 7fc0b4efb740 20 client.20772 trim_cache size 0 max 16384 2024-08-31T06:21:53.734 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:21:53.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.730+0000 7fc0ae986640 1 -- 172.21.15.53:0/2660579130 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0900b4d20 msgr2=0x7fc0900b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:53.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.730+0000 7fc0ae986640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0900b4d20 0x7fc0900b7230 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005fd0 tx=0x7fc0a00096a0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.730+0000 7fc0ae986640 1 -- 172.21.15.53:0/2660579130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8108140 msgr2=0x7fc0a819c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:53.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.730+0000 7fc0ae986640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8108140 0x7fc0a819c8e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00e9c0 tx=0x7fc09c00ee80 comp rx=0 tx=0).stop 2024-08-31T06:21:53.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.731+0000 7fc0ae986640 1 -- 172.21.15.53:0/2660579130 shutdown_connections 2024-08-31T06:21:53.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.731+0000 7fc0ae986640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0900b4d20 0x7fc0900b7230 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.731+0000 7fc0ae986640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a8108a90 0x7fc0a81a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.731+0000 7fc0ae986640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8108140 0x7fc0a819c8e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.731+0000 7fc0ae986640 1 --2- 172.21.15.53:0/2660579130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a8102800 0x7fc0a819c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:53.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.731+0000 7fc0ae986640 1 -- 172.21.15.53:0/2660579130 >> 172.21.15.53:0/2660579130 conn(0x7fc0a80794d0 msgr2=0x7fc0a8105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:53.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.731+0000 7fc0ae986640 1 -- 172.21.15.53:0/2660579130 shutdown_connections 2024-08-31T06:21:53.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:53.731+0000 7fc0ae986640 1 -- 172.21.15.53:0/2660579130 wait complete. 2024-08-31T06:21:53.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:53 smithi053 ceph-mon[18924]: pgmap v853: 97 pgs: 97 active+clean; 513 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 349 op/s 2024-08-31T06:21:53.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:53 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:21:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.026+0000 7f009b519640 1 -- 172.21.15.53:0/3553439476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0094108a20 msgr2=0x7f009410f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.026+0000 7f009b519640 1 --2- 172.21.15.53:0/3553439476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0094108a20 0x7f009410f250 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f008c009be0 tx=0x7f008c02a6c0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.026+0000 7f009b519640 1 -- 172.21.15.53:0/3553439476 shutdown_connections 2024-08-31T06:21:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.026+0000 7f009b519640 1 --2- 172.21.15.53:0/3553439476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0094108a20 0x7f009410f250 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.026+0000 7f009b519640 1 --2- 172.21.15.53:0/3553439476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00941080d0 0x7f00941084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.026+0000 7f009b519640 1 --2- 172.21.15.53:0/3553439476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0094102f10 0x7f0094103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.026+0000 7f009b519640 1 -- 172.21.15.53:0/3553439476 >> 172.21.15.53:0/3553439476 conn(0x7f0094079c30 msgr2=0x7f009407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.026+0000 7f009b519640 1 -- 172.21.15.53:0/3553439476 shutdown_connections 2024-08-31T06:21:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.026+0000 7f009b519640 1 -- 172.21.15.53:0/3553439476 wait complete. 2024-08-31T06:21:54.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.027+0000 7f009b519640 1 Processor -- start 2024-08-31T06:21:54.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.027+0000 7f009b519640 1 -- start start 2024-08-31T06:21:54.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f009b519640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0094102f10 0x7f0094197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f009b519640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00941080d0 0x7f00941984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f009b519640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0094108a20 0x7f009419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f009b519640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0094111490 con 0x7f00941080d0 2024-08-31T06:21:54.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f009b519640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0094111310 con 0x7f0094108a20 2024-08-31T06:21:54.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f009b519640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0094111610 con 0x7f0094102f10 2024-08-31T06:21:54.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f00992b5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0094102f10 0x7f0094197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f0098ab4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00941080d0 0x7f00941984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f0098ab4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00941080d0 0x7f00941984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38426/0 (socket says 172.21.15.53:38426) 2024-08-31T06:21:54.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f0099ab6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0094108a20 0x7f009419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f0098ab4640 1 -- 172.21.15.53:0/1781230759 learned_addr learned my addr 172.21.15.53:0/1781230759 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f0098ab4640 1 -- 172.21.15.53:0/1781230759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0094102f10 msgr2=0x7f0094197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f0098ab4640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0094102f10 0x7f0094197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f0098ab4640 1 -- 172.21.15.53:0/1781230759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0094108a20 msgr2=0x7f009419d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f0098ab4640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0094108a20 0x7f009419d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f0098ab4640 1 -- 172.21.15.53:0/1781230759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009419de40 con 0x7f00941080d0 2024-08-31T06:21:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.028+0000 7f0099ab6640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0094108a20 0x7f009419d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.029+0000 7f0098ab4640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00941080d0 0x7f00941984b0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f0084009960 tx=0x7f0084009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.029+0000 7f008a7fc640 1 -- 172.21.15.53:0/1781230759 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008400ca60 con 0x7f00941080d0 2024-08-31T06:21:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.029+0000 7f009b519640 1 -- 172.21.15.53:0/1781230759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f009419e130 con 0x7f00941080d0 2024-08-31T06:21:54.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.029+0000 7f008a7fc640 1 -- 172.21.15.53:0/1781230759 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f008400cc00 con 0x7f00941080d0 2024-08-31T06:21:54.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.029+0000 7f008a7fc640 1 -- 172.21.15.53:0/1781230759 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084003b50 con 0x7f00941080d0 2024-08-31T06:21:54.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.029+0000 7f009b519640 1 -- 172.21.15.53:0/1781230759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00941a8cd0 con 0x7f00941080d0 2024-08-31T06:21:54.035 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.033+0000 7f00a2484740 1 Processor -- start 2024-08-31T06:21:54.035 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.033+0000 7f00a2484740 1 -- start start 2024-08-31T06:21:54.035 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.033+0000 7f00a2484740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeaaace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.036 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.033+0000 7f00a2484740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6de2f0 0x55edeeaab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.036 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.033+0000 7f00a2484740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6e64d0 0x55edeeaab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.036 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.033+0000 7f00a2484740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55edeea20000 con 0x55edee6e64d0 2024-08-31T06:21:54.036 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.033+0000 7f00a2484740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55edeea0f590 con 0x55edee7071b0 2024-08-31T06:21:54.036 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.033+0000 7f00a2484740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55edeea13540 con 0x55edee6de2f0 2024-08-31T06:21:54.036 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.034+0000 7f00992b5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6de2f0 0x55edeeaab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.036 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.034+0000 7f0098ab4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6e64d0 0x55edeeaab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.034+0000 7f0098ab4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6e64d0 0x55edeeaab760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38428/0 (socket says 172.21.15.53:38428) 2024-08-31T06:21:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.034+0000 7f0098ab4640 1 -- 172.21.15.53:0/4287830361 learned_addr learned my addr 172.21.15.53:0/4287830361 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.034+0000 7f008a7fc640 1 -- 172.21.15.53:0/1781230759 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0084003cf0 con 0x7f00941080d0 2024-08-31T06:21:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.034+0000 7f00992b5640 1 -- 172.21.15.53:0/4287830361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 msgr2=0x55edeeaaace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.034+0000 7f00992b5640 1 --2- 172.21.15.53:0/4287830361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeaaace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.034+0000 7f00992b5640 1 -- 172.21.15.53:0/4287830361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6e64d0 msgr2=0x55edeeaab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.034+0000 7f00992b5640 1 --2- 172.21.15.53:0/4287830361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6e64d0 0x55edeeaab760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.034+0000 7f00992b5640 1 -- 172.21.15.53:0/4287830361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edee772790 con 0x55edee6de2f0 2024-08-31T06:21:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.035+0000 7f00992b5640 1 --2- 172.21.15.53:0/4287830361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6de2f0 0x55edeeaab220 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0090009c30 tx=0x7f0090011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d792a4b35aaee400 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.035+0000 7f007f7fe640 1 -- 172.21.15.53:0/4287830361 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009001e070 con 0x55edee6de2f0 2024-08-31T06:21:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.035+0000 7f007f7fe640 1 -- 172.21.15.53:0/4287830361 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00900035f0 con 0x55edee6de2f0 2024-08-31T06:21:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.035+0000 7f007f7fe640 1 -- 172.21.15.53:0/4287830361 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00900044e0 con 0x55edee6de2f0 2024-08-31T06:21:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.035+0000 7f008a7fc640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4d20 0x7f00800b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.036+0000 7f0099ab6640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4d20 0x7f00800b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.036+0000 7f008a7fc640 1 -- 172.21.15.53:0/1781230759 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f00840e4ad0 con 0x7f00941080d0 2024-08-31T06:21:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.036+0000 7f00a2484740 1 -- 172.21.15.53:0/4287830361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6de2f0 msgr2=0x55edeeaab220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.036+0000 7f00a2484740 1 --2- 172.21.15.53:0/4287830361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6de2f0 0x55edeeaab220 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0090009c30 tx=0x7f0090011810 comp rx=0 tx=0).stop 2024-08-31T06:21:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.036+0000 7f00a2484740 1 -- 172.21.15.53:0/4287830361 shutdown_connections 2024-08-31T06:21:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.036+0000 7f00a2484740 1 --2- 172.21.15.53:0/4287830361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6e64d0 0x55edeeaab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.036+0000 7f00a2484740 1 --2- 172.21.15.53:0/4287830361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6de2f0 0x55edeeaab220 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.036+0000 7f00a2484740 1 --2- 172.21.15.53:0/4287830361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeaaace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.036+0000 7f00a2484740 1 -- 172.21.15.53:0/4287830361 >> 172.21.15.53:0/4287830361 conn(0x55edee6fb300 msgr2=0x55edeeaa8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.036+0000 7f00a2484740 1 -- 172.21.15.53:0/4287830361 shutdown_connections 2024-08-31T06:21:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.037+0000 7f0099ab6640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4d20 0x7f00800b7230 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f008c009370 tx=0x7f008c005fd0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.037+0000 7f00a2484740 1 -- 172.21.15.53:0/4287830361 wait complete. 2024-08-31T06:21:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.037+0000 7f00a2484740 1 -- start start 2024-08-31T06:21:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.037+0000 7f00a2484740 1 Processor -- start 2024-08-31T06:21:54.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f00a2484740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeab6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f00a2484740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6e64d0 0x55edeeab7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f00a2484740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeabc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f00a2484740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55edee948ab0 con 0x55edee6de2f0 2024-08-31T06:21:54.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f00a2484740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55edee996680 con 0x55edee7071b0 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f00a2484740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55edeeab13c0 con 0x55edee6e64d0 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f00a2484740 10 client.0 _ll_register_callbacks cb 0x55edee71ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f00992b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeab6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f0098ab4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6e64d0 0x55edeeab7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f00992b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeab6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38434/0 (socket says 172.21.15.53:38434) 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f00992b5640 1 -- 172.21.15.53:0/754551627 learned_addr learned my addr 172.21.15.53:0/754551627 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f0099ab6640 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeabc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f0098ab4640 1 -- 172.21.15.53:0/754551627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 msgr2=0x55edeeabc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f0098ab4640 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeabc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.038+0000 7f0098ab4640 1 -- 172.21.15.53:0/754551627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 msgr2=0x55edeeab6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.039+0000 7f0098ab4640 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeab6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.039+0000 7f0098ab4640 1 -- 172.21.15.53:0/754551627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edee7eb620 con 0x55edee6e64d0 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.039+0000 7f0098ab4640 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6e64d0 0x55edeeab7560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00840ab0d0 tx=0x7f0084009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc99d7f55dfe6fd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.039+0000 7f007cff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:21:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.039+0000 7f007cff9640 1 -- 172.21.15.53:0/754551627 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00840aaa90 con 0x55edee6e64d0 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.039+0000 7f00a2484740 1 -- 172.21.15.53:0/754551627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00900035f0 con 0x55edee6e64d0 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.039+0000 7f007cff9640 1 -- 172.21.15.53:0/754551627 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f008400cdb0 con 0x55edee6e64d0 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.039+0000 7f007cff9640 1 -- 172.21.15.53:0/754551627 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f00840aa8b0 con 0x55edee6e64d0 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.039+0000 7f00a2484740 10 client.29686 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.039+0000 7f00a2484740 1 -- 172.21.15.53:0/754551627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55edeead6550 con 0x55edee6e64d0 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.040+0000 7f007cff9640 1 -- 172.21.15.53:0/754551627 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00900035f0 con 0x55edee6e64d0 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.040+0000 7f007cff9640 1 -- 172.21.15.53:0/754551627 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f00840a6ab0 con 0x55edee6e64d0 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.040+0000 7f00a2484740 10 client.29686 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.040+0000 7f00a2484740 10 client.29686 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.040+0000 7f00a2484740 20 client.29686 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.040+0000 7f00a2484740 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55edee6c5d80 0x55edeead9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.040+0000 7f00a2484740 4 client.29686 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.040+0000 7f00a2484740 1 -- 172.21.15.53:0/754551627 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edeea21f50 con 0x55edee6c5d80 2024-08-31T06:21:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.040+0000 7f00992b5640 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55edee6c5d80 0x55edeead9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.041+0000 7f007cff9640 10 client.29686 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.041+0000 7f00992b5640 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55edee6c5d80 0x55edeead9eb0 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45c6c828e3e6b59 server_cookie=ee3cbc86720b18e3 in_seq=0 out_seq=0 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f007cff9640 1 -- 172.21.15.53:0/754551627 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55edeea21f50 con 0x55edee6c5d80 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f007cff9640 10 client.29686 handle_command_reply: tid=0 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f00a2484740 1 client.29686 shutdown 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f00a2484740 1 -- 172.21.15.53:0/754551627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6e64d0 msgr2=0x55edeeab7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f00a2484740 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6e64d0 0x55edeeab7560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00840ab0d0 tx=0x7f0084009f50 comp rx=0 tx=0).stop 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f00a2484740 1 -- 172.21.15.53:0/754551627 shutdown_connections 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f00a2484740 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55edee6c5d80 0x55edeead9eb0 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f00a2484740 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeabc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f00a2484740 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6e64d0 0x55edeeab7560 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f00a2484740 1 --2- 172.21.15.53:0/754551627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeab6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.047 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f00a2484740 1 -- 172.21.15.53:0/754551627 >> 172.21.15.53:0/754551627 conn(0x55edee6fb300 msgr2=0x55edeeaa7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:54.047 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f007cff9640 0 client.29686 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:54.047 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f00a2484740 1 -- 172.21.15.53:0/754551627 shutdown_connections 2024-08-31T06:21:54.047 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.042+0000 7f00a2484740 1 -- 172.21.15.53:0/754551627 wait complete. 2024-08-31T06:21:54.047 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.043+0000 7f00a2484740 20 client.29686 trim_cache size 0 max 16384 2024-08-31T06:21:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f00a2484740 1 Processor -- start 2024-08-31T06:21:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f00a2484740 1 -- start start 2024-08-31T06:21:54.071 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f00a2484740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeaa7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f00a2484740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6e64d0 0x55edeeaa76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f00a2484740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeaa7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f00a2484740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f00941ad380 con 0x55edee6de2f0 2024-08-31T06:21:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f00992b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeaa7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f00a2484740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f00941af040 con 0x55edee7071b0 2024-08-31T06:21:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f00992b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeaa7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38440/0 (socket says 172.21.15.53:38440) 2024-08-31T06:21:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f00a2484740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f00941ada50 con 0x55edee6e64d0 2024-08-31T06:21:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f00992b5640 1 -- 172.21.15.53:0/2443431320 learned_addr learned my addr 172.21.15.53:0/2443431320 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f0098ab4640 1 --2- 172.21.15.53:0/2443431320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6e64d0 0x55edeeaa76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.069+0000 7f0099ab6640 1 --2- 172.21.15.53:0/2443431320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeaa7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.070+0000 7f00992b5640 1 -- 172.21.15.53:0/2443431320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6e64d0 msgr2=0x55edeeaa76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.070+0000 7f00992b5640 1 --2- 172.21.15.53:0/2443431320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6e64d0 0x55edeeaa76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.070+0000 7f00992b5640 1 -- 172.21.15.53:0/2443431320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 msgr2=0x55edeeaa7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.070+0000 7f00992b5640 1 --2- 172.21.15.53:0/2443431320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeaa7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.070+0000 7f00992b5640 1 -- 172.21.15.53:0/2443431320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edeeaa3a90 con 0x55edee6de2f0 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.070+0000 7f0099ab6640 1 --2- 172.21.15.53:0/2443431320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeaa7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.070+0000 7f00992b5640 1 --2- 172.21.15.53:0/2443431320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeaa7170 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f00900099f0 tx=0x7f0090003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca2c7d853545cc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.070+0000 7f007effd640 1 -- 172.21.15.53:0/2443431320 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090033070 con 0x55edee6de2f0 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.070+0000 7f007effd640 1 -- 172.21.15.53:0/2443431320 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f009002b070 con 0x55edee6de2f0 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.070+0000 7f007effd640 1 -- 172.21.15.53:0/2443431320 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009001e040 con 0x55edee6de2f0 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.071+0000 7f00a2484740 1 -- 172.21.15.53:0/2443431320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 msgr2=0x55edeeaa7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.071+0000 7f00a2484740 1 --2- 172.21.15.53:0/2443431320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeaa7170 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f00900099f0 tx=0x7f0090003e90 comp rx=0 tx=0).stop 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.071+0000 7f00a2484740 1 -- 172.21.15.53:0/2443431320 shutdown_connections 2024-08-31T06:21:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.071+0000 7f00a2484740 1 --2- 172.21.15.53:0/2443431320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee7071b0 0x55edeeaa7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.071+0000 7f00a2484740 1 --2- 172.21.15.53:0/2443431320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee6e64d0 0x55edeeaa76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.071+0000 7f00a2484740 1 --2- 172.21.15.53:0/2443431320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeaa7170 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.071+0000 7f00a2484740 1 -- 172.21.15.53:0/2443431320 >> 172.21.15.53:0/2443431320 conn(0x55edee6fb300 msgr2=0x55edeeab55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.072+0000 7f00a2484740 1 -- 172.21.15.53:0/2443431320 shutdown_connections 2024-08-31T06:21:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.072+0000 7f00a2484740 1 -- 172.21.15.53:0/2443431320 wait complete. 2024-08-31T06:21:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.072+0000 7f00a2484740 1 -- start start 2024-08-31T06:21:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.072+0000 7f00a2484740 1 Processor -- start 2024-08-31T06:21:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00a2484740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeab9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00a2484740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee6e64d0 0x55edeeaba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00a2484740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee7071b0 0x55edeeaea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00a2484740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f00941ae970 con 0x55edee6de2f0 2024-08-31T06:21:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00a2484740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f00941ae1e0 con 0x55edee6e64d0 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00a2484740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f00941ab380 con 0x55edee7071b0 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00a2484740 10 client.0 _ll_register_callbacks cb 0x7f00840058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00992b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeab9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00992b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeab9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38448/0 (socket says 172.21.15.53:38448) 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00992b5640 1 -- 172.21.15.53:0/2644756738 learned_addr learned my addr 172.21.15.53:0/2644756738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f0099ab6640 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee7071b0 0x55edeeaea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f0098ab4640 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee6e64d0 0x55edeeaba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00992b5640 1 -- 172.21.15.53:0/2644756738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee7071b0 msgr2=0x55edeeaea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00992b5640 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee7071b0 0x55edeeaea5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00992b5640 1 -- 172.21.15.53:0/2644756738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee6e64d0 msgr2=0x55edeeaba1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00992b5640 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee6e64d0 0x55edeeaba1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.073+0000 7f00992b5640 1 -- 172.21.15.53:0/2644756738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edeeaeab60 con 0x55edee6de2f0 2024-08-31T06:21:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.074+0000 7f00992b5640 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeab9c70 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f0090011850 tx=0x7f0090003ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d69f044f6c0a76 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.074+0000 7f007cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.074+0000 7f007cff9640 1 -- 172.21.15.53:0/2644756738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009001e070 con 0x55edee6de2f0 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.074+0000 7f007cff9640 1 -- 172.21.15.53:0/2644756738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f0090005450 con 0x55edee6de2f0 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.074+0000 7f00a2484740 1 -- 172.21.15.53:0/2644756738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f009002b070 con 0x55edee6de2f0 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.074+0000 7f007cff9640 1 -- 172.21.15.53:0/2644756738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f009003f050 con 0x55edee6de2f0 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.074+0000 7f00a2484740 10 client.20790 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.074+0000 7f00a2484740 1 -- 172.21.15.53:0/2644756738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55edeeaebdf0 con 0x55edee6de2f0 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.075+0000 7f007cff9640 1 -- 172.21.15.53:0/2644756738 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f009002b070 con 0x55edee6de2f0 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.075+0000 7f007cff9640 1 -- 172.21.15.53:0/2644756738 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f0090027c70 con 0x55edee6de2f0 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.075+0000 7f00a2484740 10 client.20790 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.075+0000 7f00a2484740 10 client.20790 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.075+0000 7f00a2484740 20 client.20790 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.075+0000 7f00a2484740 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55edee69b1c0 0x55edeeb46850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.075+0000 7f00a2484740 4 client.20790 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:21:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.075+0000 7f00a2484740 1 -- 172.21.15.53:0/2644756738 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55edeea1d9f0 con 0x55edee69b1c0 2024-08-31T06:21:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.075+0000 7f0098ab4640 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55edee69b1c0 0x55edeeb46850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.076+0000 7f007cff9640 10 client.20790 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.076+0000 7f0098ab4640 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55edee69b1c0 0x55edeeb46850 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fae18c4ff01c328 server_cookie=3c414c9fd516c75b in_seq=0 out_seq=0 2024-08-31T06:21:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:53 smithi130 ceph-mon[22266]: pgmap v853: 97 pgs: 97 active+clean; 513 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 349 op/s 2024-08-31T06:21:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:53 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:21:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f007cff9640 1 -- 172.21.15.53:0/2644756738 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55edeea1d9f0 con 0x55edee69b1c0 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f007cff9640 10 client.20790 handle_command_reply: tid=0 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f00a2484740 1 client.20790 shutdown 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f00a2484740 1 -- 172.21.15.53:0/2644756738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 msgr2=0x55edeeab9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f00a2484740 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeab9c70 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f0090011850 tx=0x7f0090003ad0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f00a2484740 1 -- 172.21.15.53:0/2644756738 shutdown_connections 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f00a2484740 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55edee69b1c0 0x55edeeb46850 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f00a2484740 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edee7071b0 0x55edeeaea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f00a2484740 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55edee6e64d0 0x55edeeaba1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f007cff9640 0 client.20790 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f00a2484740 1 --2- 172.21.15.53:0/2644756738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55edee6de2f0 0x55edeeab9c70 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f00a2484740 1 -- 172.21.15.53:0/2644756738 >> 172.21.15.53:0/2644756738 conn(0x55edee6fb300 msgr2=0x55edeeabcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f00a2484740 1 -- 172.21.15.53:0/2644756738 shutdown_connections 2024-08-31T06:21:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.161+0000 7f00a2484740 1 -- 172.21.15.53:0/2644756738 wait complete. 2024-08-31T06:21:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.162+0000 7f00a2484740 20 client.20790 trim_cache size 0 max 16384 2024-08-31T06:21:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:21:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:21:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:21:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:21:54.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.162+0000 7f009b519640 1 -- 172.21.15.53:0/1781230759 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4d20 msgr2=0x7f00800b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:54.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.162+0000 7f009b519640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4d20 0x7f00800b7230 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f008c009370 tx=0x7f008c005fd0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.162+0000 7f009b519640 1 -- 172.21.15.53:0/1781230759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00941080d0 msgr2=0x7f00941984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:54.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.162+0000 7f009b519640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00941080d0 0x7f00941984b0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f0084009960 tx=0x7f0084009d60 comp rx=0 tx=0).stop 2024-08-31T06:21:54.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.162+0000 7f009b519640 1 -- 172.21.15.53:0/1781230759 shutdown_connections 2024-08-31T06:21:54.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.162+0000 7f009b519640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00800b4d20 0x7f00800b7230 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.162+0000 7f009b519640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0094108a20 0x7f009419d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.162+0000 7f009b519640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00941080d0 0x7f00941984b0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.162+0000 7f009b519640 1 --2- 172.21.15.53:0/1781230759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0094102f10 0x7f0094197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:54.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.162+0000 7f009b519640 1 -- 172.21.15.53:0/1781230759 >> 172.21.15.53:0/1781230759 conn(0x7f0094079c30 msgr2=0x7f00941061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:54.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.163+0000 7f009b519640 1 -- 172.21.15.53:0/1781230759 shutdown_connections 2024-08-31T06:21:54.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:21:54.163+0000 7f009b519640 1 -- 172.21.15.53:0/1781230759 wait complete. 2024-08-31T06:21:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:53 smithi153 ceph-mon[22320]: pgmap v853: 97 pgs: 97 active+clean; 513 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 349 op/s 2024-08-31T06:21:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:53 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:21:54.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 24837 5.49 MB/sec execute 102 sec latency 96.380 ms 2024-08-31T06:21:54.951 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:21:55.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: Unable to set osd_memory_target on smithi130 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: Adjusting osd_memory_target on smithi053 to 177.0M 2024-08-31T06:21:55.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: Unable to set osd_memory_target on smithi053 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T06:21:55.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:21:55.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:21:55.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:21:55.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: Unable to set osd_memory_target on smithi130 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-08-31T06:21:55.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: Adjusting osd_memory_target on smithi053 to 177.0M 2024-08-31T06:21:55.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: Unable to set osd_memory_target on smithi053 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T06:21:55.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:21:55.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:21:55.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:21:55.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: Unable to set osd_memory_target on smithi130 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: Adjusting osd_memory_target on smithi053 to 177.0M 2024-08-31T06:21:55.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: Unable to set osd_memory_target on smithi053 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T06:21:55.228 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:21:55.228 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:21:55.228 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:21:55.329 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:55.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 25020 5.56 MB/sec execute 103 sec latency 60.031 ms 2024-08-31T06:21:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.913+0000 7f28f5436640 1 -- 172.21.15.53:0/545451492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f0109270 msgr2=0x7f28f0109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.914+0000 7f28f5436640 1 --2- 172.21.15.53:0/545451492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f0109270 0x7f28f0109680 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009900 tx=0x7f28e402a410 comp rx=0 tx=0).stop 2024-08-31T06:21:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.914+0000 7f28f5436640 1 -- 172.21.15.53:0/545451492 shutdown_connections 2024-08-31T06:21:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.914+0000 7f28f5436640 1 --2- 172.21.15.53:0/545451492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28f0109bc0 0x7f28f01103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.914+0000 7f28f5436640 1 --2- 172.21.15.53:0/545451492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f0109270 0x7f28f0109680 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.914+0000 7f28f5436640 1 --2- 172.21.15.53:0/545451492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28f0103930 0x7f28f0103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.914+0000 7f28f5436640 1 -- 172.21.15.53:0/545451492 >> 172.21.15.53:0/545451492 conn(0x7f28f00ff380 msgr2=0x7f28f01017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.914+0000 7f28f5436640 1 -- 172.21.15.53:0/545451492 shutdown_connections 2024-08-31T06:21:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.914+0000 7f28f5436640 1 -- 172.21.15.53:0/545451492 wait complete. 2024-08-31T06:21:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.915+0000 7f28f5436640 1 Processor -- start 2024-08-31T06:21:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.915+0000 7f28f5436640 1 -- start start 2024-08-31T06:21:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.915+0000 7f28f5436640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28f0103930 0x7f28f00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.915+0000 7f28f5436640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f0109270 0x7f28f00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.915+0000 7f28f5436640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28f0109bc0 0x7f28f0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28f5436640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f28f0113780 con 0x7f28f0109270 2024-08-31T06:21:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28f5436640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f28f0113600 con 0x7f28f0109bc0 2024-08-31T06:21:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28f5436640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28f0113900 con 0x7f28f0103930 2024-08-31T06:21:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28eeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28f0103930 0x7f28f00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28eeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28f0103930 0x7f28f00754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48486/0 (socket says 172.21.15.53:48486) 2024-08-31T06:21:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28eeffd640 1 -- 172.21.15.53:0/91832941 learned_addr learned my addr 172.21.15.53:0/91832941 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f0109270 0x7f28f00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28ef7fe640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28f0109bc0 0x7f28f0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28eeffd640 1 -- 172.21.15.53:0/91832941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28f0109bc0 msgr2=0x7f28f0075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28eeffd640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28f0109bc0 0x7f28f0075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28eeffd640 1 -- 172.21.15.53:0/91832941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f0109270 msgr2=0x7f28f00759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28eeffd640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f0109270 0x7f28f00759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28eeffd640 1 -- 172.21.15.53:0/91832941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f01a84b0 con 0x7f28f0103930 2024-08-31T06:21:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.916+0000 7f28eeffd640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28f0103930 0x7f28f00754b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f28e000e9f0 tx=0x7f28e000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.917+0000 7f28d7fff640 1 -- 172.21.15.53:0/91832941 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e000cd80 con 0x7f28f0103930 2024-08-31T06:21:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.917+0000 7f28f5436640 1 -- 172.21.15.53:0/91832941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f01a87a0 con 0x7f28f0103930 2024-08-31T06:21:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.917+0000 7f28f5436640 1 -- 172.21.15.53:0/91832941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f01a8d00 con 0x7f28f0103930 2024-08-31T06:21:55.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.917+0000 7f28d7fff640 1 -- 172.21.15.53:0/91832941 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28e00108c0 con 0x7f28f0103930 2024-08-31T06:21:55.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.917+0000 7f28d7fff640 1 -- 172.21.15.53:0/91832941 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00187c0 con 0x7f28f0103930 2024-08-31T06:21:55.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.920+0000 7f28d7fff640 1 -- 172.21.15.53:0/91832941 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f28e0018a40 con 0x7f28f0103930 2024-08-31T06:21:55.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.920+0000 7f28fb9ab740 1 Processor -- start 2024-08-31T06:21:55.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.920+0000 7f28fb9ab740 1 -- start start 2024-08-31T06:21:55.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805d1070 0x55eb80976310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80976850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 0x55eb80976d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28fb9ab740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eb808ed680 con 0x55eb805a81b0 2024-08-31T06:21:55.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28fb9ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55eb808dcc10 con 0x55eb805d1070 2024-08-31T06:21:55.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28fb9ab740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55eb808e0bc0 con 0x55eb805b0390 2024-08-31T06:21:55.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80976850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28ee7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 0x55eb80976d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28ee7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 0x55eb80976d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48488/0 (socket says 172.21.15.53:48488) 2024-08-31T06:21:55.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28ee7fc640 1 -- 172.21.15.53:0/3099092896 learned_addr learned my addr 172.21.15.53:0/3099092896 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:55.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28ef7fe640 1 --2- 172.21.15.53:0/3099092896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805d1070 0x55eb80976310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28ee7fc640 1 -- 172.21.15.53:0/3099092896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805d1070 msgr2=0x55eb80976310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:55.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/3099092896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805d1070 0x55eb80976310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28ee7fc640 1 -- 172.21.15.53:0/3099092896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 msgr2=0x55eb80976850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:55.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/3099092896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80976850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28ee7fc640 1 -- 172.21.15.53:0/3099092896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb8063c650 con 0x55eb805b0390 2024-08-31T06:21:55.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28ef7fe640 1 --2- 172.21.15.53:0/3099092896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805d1070 0x55eb80976310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:55.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28eeffd640 1 --2- 172.21.15.53:0/3099092896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80976850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:55.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.921+0000 7f28d7fff640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28d80b4d20 0x7f28d80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.922+0000 7f28ef7fe640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28d80b4d20 0x7f28d80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.922+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/3099092896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 0x55eb80976d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f28e4005ab0 tx=0x7f28e40040e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b8cbf29bc828086 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:55.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.922+0000 7f28d57fa640 1 -- 172.21.15.53:0/3099092896 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4035030 con 0x55eb805b0390 2024-08-31T06:21:55.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.922+0000 7f28d7fff640 1 -- 172.21.15.53:0/91832941 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f28e00e55f0 con 0x7f28f0103930 2024-08-31T06:21:55.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.922+0000 7f28d57fa640 1 -- 172.21.15.53:0/3099092896 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28e4040070 con 0x55eb805b0390 2024-08-31T06:21:55.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.922+0000 7f28d57fa640 1 -- 172.21.15.53:0/3099092896 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4045830 con 0x55eb805b0390 2024-08-31T06:21:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.923+0000 7f28fb9ab740 1 -- 172.21.15.53:0/3099092896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 msgr2=0x55eb80976d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.923+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/3099092896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 0x55eb80976d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f28e4005ab0 tx=0x7f28e40040e0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.923+0000 7f28ef7fe640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28d80b4d20 0x7f28d80b7230 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f28e8005fd0 tx=0x7f28e8009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.923+0000 7f28fb9ab740 1 -- 172.21.15.53:0/3099092896 shutdown_connections 2024-08-31T06:21:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.923+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/3099092896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 0x55eb80976d90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.923+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/3099092896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80976850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.923+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/3099092896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805d1070 0x55eb80976310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.923+0000 7f28fb9ab740 1 -- 172.21.15.53:0/3099092896 >> 172.21.15.53:0/3099092896 conn(0x55eb805c5460 msgr2=0x55eb80974200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.923+0000 7f28fb9ab740 1 -- 172.21.15.53:0/3099092896 shutdown_connections 2024-08-31T06:21:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.923+0000 7f28fb9ab740 1 -- 172.21.15.53:0/3099092896 wait complete. 2024-08-31T06:21:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.924+0000 7f28fb9ab740 1 -- start start 2024-08-31T06:21:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.924+0000 7f28fb9ab740 1 Processor -- start 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80981ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 0x55eb80981ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805d1070 0x55eb8098dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28fb9ab740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eb8073f700 con 0x55eb805a81b0 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28fb9ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55eb80863750 con 0x55eb805d1070 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28fb9ab740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55eb80984a90 con 0x55eb805b0390 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28fb9ab740 10 client.0 _ll_register_callbacks cb 0x55eb80892e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80981ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80981ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38486/0 (socket says 172.21.15.53:38486) 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28eeffd640 1 -- 172.21.15.53:0/273062714 learned_addr learned my addr 172.21.15.53:0/273062714 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28ef7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805d1070 0x55eb8098dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 0x55eb80981ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28eeffd640 1 -- 172.21.15.53:0/273062714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 msgr2=0x55eb80981ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:55.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28eeffd640 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 0x55eb80981ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28eeffd640 1 -- 172.21.15.53:0/273062714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805d1070 msgr2=0x55eb8098dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:55.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28eeffd640 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805d1070 0x55eb8098dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.925+0000 7f28eeffd640 1 -- 172.21.15.53:0/273062714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb8089c900 con 0x55eb805a81b0 2024-08-31T06:21:55.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.926+0000 7f28d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:21:55.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.926+0000 7f28eeffd640 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80981ab0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f28e000c6a0 tx=0x7f28e0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b730ee04fe092cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:55.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.926+0000 7f28d2ff5640 1 -- 172.21.15.53:0/273062714 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00a7c30 con 0x55eb805a81b0 2024-08-31T06:21:55.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.926+0000 7f28d2ff5640 1 -- 172.21.15.53:0/273062714 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f28e0091b60 con 0x55eb805a81b0 2024-08-31T06:21:55.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.926+0000 7f28fb9ab740 1 -- 172.21.15.53:0/273062714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e4040070 con 0x55eb805a81b0 2024-08-31T06:21:55.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28d2ff5640 1 -- 172.21.15.53:0/273062714 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f28e00ab4e0 con 0x55eb805a81b0 2024-08-31T06:21:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28fb9ab740 10 client.20802 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28fb9ab740 1 -- 172.21.15.53:0/273062714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55eb809908e0 con 0x55eb805a81b0 2024-08-31T06:21:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28d2ff5640 1 -- 172.21.15.53:0/273062714 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28e00ab880 con 0x55eb805a81b0 2024-08-31T06:21:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28d2ff5640 1 -- 172.21.15.53:0/273062714 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f28e00b0160 con 0x55eb805a81b0 2024-08-31T06:21:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28fb9ab740 10 client.20802 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28fb9ab740 10 client.20802 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:21:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28fb9ab740 20 client.20802 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55eb8058f9f0 0x55eb809943d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28fb9ab740 4 client.20802 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28fb9ab740 1 -- 172.21.15.53:0/273062714 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f28e4040070 con 0x55eb8058f9f0 2024-08-31T06:21:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.927+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55eb8058f9f0 0x55eb809943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.928+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55eb8058f9f0 0x55eb809943d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=64424e8c695e078d server_cookie=c9a82f83daf1a77f in_seq=0 out_seq=0 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.928+0000 7f28d2ff5640 10 client.20802 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.929+0000 7f28d2ff5640 1 -- 172.21.15.53:0/273062714 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f28e4040070 con 0x55eb8058f9f0 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.929+0000 7f28d2ff5640 10 client.20802 handle_command_reply: tid=0 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.929+0000 7f28fb9ab740 1 client.20802 shutdown 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.929+0000 7f28fb9ab740 1 -- 172.21.15.53:0/273062714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 msgr2=0x55eb80981ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.929+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80981ab0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f28e000c6a0 tx=0x7f28e0009310 comp rx=0 tx=0).stop 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.929+0000 7f28fb9ab740 1 -- 172.21.15.53:0/273062714 shutdown_connections 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.929+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805d1070 0x55eb8098dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.929+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb805b0390 0x55eb80981ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.929+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55eb8058f9f0 0x55eb809943d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.929+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/273062714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80981ab0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.930+0000 7f28d2ff5640 0 client.20802 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:21:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.930+0000 7f28fb9ab740 1 -- 172.21.15.53:0/273062714 >> 172.21.15.53:0/273062714 conn(0x55eb805c5460 msgr2=0x55eb809794a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.930+0000 7f28fb9ab740 1 -- 172.21.15.53:0/273062714 shutdown_connections 2024-08-31T06:21:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.930+0000 7f28fb9ab740 1 -- 172.21.15.53:0/273062714 wait complete. 2024-08-31T06:21:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.930+0000 7f28fb9ab740 20 client.20802 trim_cache size 0 max 16384 2024-08-31T06:21:55.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28fb9ab740 1 Processor -- start 2024-08-31T06:21:55.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28fb9ab740 1 -- start start 2024-08-31T06:21:55.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 0x55eb8096f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80979410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805b0390 0x55eb80979950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28fb9ab740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc00e8b0 con 0x55eb805a81b0 2024-08-31T06:21:55.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28fb9ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc010570 con 0x55eb805b0390 2024-08-31T06:21:55.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28fb9ab740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc00ef80 con 0x55eb8058f9f0 2024-08-31T06:21:55.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28eeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 0x55eb8096f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28eeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 0x55eb8096f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48506/0 (socket says 172.21.15.53:48506) 2024-08-31T06:21:55.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28eeffd640 1 -- 172.21.15.53:0/526739155 learned_addr learned my addr 172.21.15.53:0/526739155 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:55.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.949+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/526739155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80979410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.950+0000 7f28ef7fe640 1 --2- 172.21.15.53:0/526739155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805b0390 0x55eb80979950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.950+0000 7f28ee7fc640 1 -- 172.21.15.53:0/526739155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 msgr2=0x55eb8096f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.950+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/526739155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 0x55eb8096f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.950+0000 7f28ee7fc640 1 -- 172.21.15.53:0/526739155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805b0390 msgr2=0x55eb80979950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.950+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/526739155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805b0390 0x55eb80979950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.950+0000 7f28ee7fc640 1 -- 172.21.15.53:0/526739155 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb8097ffb0 con 0x55eb805a81b0 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.950+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/526739155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80979410 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f28e402a930 tx=0x7f28e4045470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfd97f5d01432e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.951+0000 7f28d4ff9640 1 -- 172.21.15.53:0/526739155 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4035040 con 0x55eb805a81b0 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.951+0000 7f28d4ff9640 1 -- 172.21.15.53:0/526739155 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28e4040040 con 0x55eb805a81b0 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.951+0000 7f28d4ff9640 1 -- 172.21.15.53:0/526739155 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4045a20 con 0x55eb805a81b0 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.952+0000 7f28fb9ab740 1 -- 172.21.15.53:0/526739155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 msgr2=0x55eb80979410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.952+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/526739155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80979410 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f28e402a930 tx=0x7f28e4045470 comp rx=0 tx=0).stop 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.952+0000 7f28fb9ab740 1 -- 172.21.15.53:0/526739155 shutdown_connections 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.952+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/526739155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805b0390 0x55eb80979950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.952+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/526739155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805a81b0 0x55eb80979410 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.952+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/526739155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 0x55eb8096f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.952+0000 7f28fb9ab740 1 -- 172.21.15.53:0/526739155 >> 172.21.15.53:0/526739155 conn(0x55eb805c5460 msgr2=0x55eb80980330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.952+0000 7f28fb9ab740 1 -- 172.21.15.53:0/526739155 shutdown_connections 2024-08-31T06:21:55.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.952+0000 7f28fb9ab740 1 -- 172.21.15.53:0/526739155 wait complete. 2024-08-31T06:21:55.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.952+0000 7f28fb9ab740 1 -- start start 2024-08-31T06:21:55.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28fb9ab740 1 Processor -- start 2024-08-31T06:21:55.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 0x55eb80987620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805a81b0 0x55eb80987b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28fb9ab740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805b0390 0x55eb80a065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28eeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 0x55eb80987620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28fb9ab740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc00fea0 con 0x55eb805b0390 2024-08-31T06:21:55.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28eeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 0x55eb80987620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48510/0 (socket says 172.21.15.53:48510) 2024-08-31T06:21:55.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28fb9ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc00f710 con 0x55eb805a81b0 2024-08-31T06:21:55.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28eeffd640 1 -- 172.21.15.53:0/2894893945 learned_addr learned my addr 172.21.15.53:0/2894893945 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:55.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28fb9ab740 1 -- 172.21.15.53:0/2894893945 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc00c8b0 con 0x55eb8058f9f0 2024-08-31T06:21:55.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28ef7fe640 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805b0390 0x55eb80a065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805a81b0 0x55eb80987b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28fb9ab740 10 client.0 _ll_register_callbacks cb 0x7f28e000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:55.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28eeffd640 1 -- 172.21.15.53:0/2894893945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805a81b0 msgr2=0x55eb80987b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:55.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28eeffd640 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805a81b0 0x55eb80987b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.953+0000 7f28eeffd640 1 -- 172.21.15.53:0/2894893945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805b0390 msgr2=0x55eb80a065e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:55.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.954+0000 7f28eeffd640 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805b0390 0x55eb80a065e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.954+0000 7f28eeffd640 1 -- 172.21.15.53:0/2894893945 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb80a06b20 con 0x55eb8058f9f0 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.954+0000 7f28eeffd640 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 0x55eb80987620 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009380 tx=0x7f28e00a8280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fe592e43289d31c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.954+0000 7f28d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.954+0000 7f28d2ff5640 1 -- 172.21.15.53:0/2894893945 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00ab6c0 con 0x55eb8058f9f0 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.954+0000 7f28d2ff5640 1 -- 172.21.15.53:0/2894893945 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f28e00ab1e0 con 0x55eb8058f9f0 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.954+0000 7f28fb9ab740 1 -- 172.21.15.53:0/2894893945 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e4040040 con 0x55eb8058f9f0 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.954+0000 7f28d2ff5640 1 -- 172.21.15.53:0/2894893945 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f28e00abb40 con 0x55eb8058f9f0 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.954+0000 7f28fb9ab740 10 client.29710 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.954+0000 7f28fb9ab740 1 -- 172.21.15.53:0/2894893945 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55eb80a07ba0 con 0x55eb8058f9f0 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.955+0000 7f28d2ff5640 1 -- 172.21.15.53:0/2894893945 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28e00ab880 con 0x55eb8058f9f0 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.955+0000 7f28d2ff5640 1 -- 172.21.15.53:0/2894893945 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f28e00e50d0 con 0x55eb8058f9f0 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.955+0000 7f28fb9ab740 10 client.29710 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:55.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.955+0000 7f28fb9ab740 10 client.29710 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:21:55.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.955+0000 7f28fb9ab740 20 client.29710 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:55.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.955+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55eb805d1070 0x55eb80a0a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:55.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.955+0000 7f28fb9ab740 4 client.29710 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:21:55.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.955+0000 7f28fb9ab740 1 -- 172.21.15.53:0/2894893945 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f28e4040040 con 0x55eb805d1070 2024-08-31T06:21:55.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.955+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55eb805d1070 0x55eb80a0a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:55.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28d2ff5640 10 client.29710 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:21:55.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28ee7fc640 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55eb805d1070 0x55eb80a0a300 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=933555955838a042 server_cookie=62ced989e91debd7 in_seq=0 out_seq=0 2024-08-31T06:21:55.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28d2ff5640 1 -- 172.21.15.53:0/2894893945 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f28e4040040 con 0x55eb805d1070 2024-08-31T06:21:55.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28d2ff5640 10 client.29710 handle_command_reply: tid=0 2024-08-31T06:21:55.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28fb9ab740 1 client.29710 shutdown 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28fb9ab740 1 -- 172.21.15.53:0/2894893945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 msgr2=0x55eb80987620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 0x55eb80987620 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009380 tx=0x7f28e00a8280 comp rx=0 tx=0).stop 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28fb9ab740 1 -- 172.21.15.53:0/2894893945 shutdown_connections 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55eb805d1070 0x55eb80a0a300 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb805b0390 0x55eb80a065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28d2ff5640 0 client.29710 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb805a81b0 0x55eb80987b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28fb9ab740 1 --2- 172.21.15.53:0/2894893945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eb8058f9f0 0x55eb80987620 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.956+0000 7f28fb9ab740 1 -- 172.21.15.53:0/2894893945 >> 172.21.15.53:0/2894893945 conn(0x55eb805c5460 msgr2=0x55eb80979410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.957+0000 7f28fb9ab740 1 -- 172.21.15.53:0/2894893945 shutdown_connections 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.957+0000 7f28fb9ab740 1 -- 172.21.15.53:0/2894893945 wait complete. 2024-08-31T06:21:55.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.957+0000 7f28fb9ab740 20 client.29710 trim_cache size 0 max 16384 2024-08-31T06:21:55.964 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:21:55.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.957+0000 7f28f5436640 1 -- 172.21.15.53:0/91832941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28d80b4d20 msgr2=0x7f28d80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:55.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.957+0000 7f28f5436640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28d80b4d20 0x7f28d80b7230 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f28e8005fd0 tx=0x7f28e8009500 comp rx=0 tx=0).stop 2024-08-31T06:21:55.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.957+0000 7f28f5436640 1 -- 172.21.15.53:0/91832941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28f0103930 msgr2=0x7f28f00754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:55.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.957+0000 7f28f5436640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28f0103930 0x7f28f00754b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f28e000e9f0 tx=0x7f28e000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.958+0000 7f28f5436640 1 -- 172.21.15.53:0/91832941 shutdown_connections 2024-08-31T06:21:55.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.958+0000 7f28f5436640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28d80b4d20 0x7f28d80b7230 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.958+0000 7f28f5436640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28f0109bc0 0x7f28f0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.958+0000 7f28f5436640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f0109270 0x7f28f00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.958+0000 7f28f5436640 1 --2- 172.21.15.53:0/91832941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28f0103930 0x7f28f00754b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:55.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.958+0000 7f28f5436640 1 -- 172.21.15.53:0/91832941 >> 172.21.15.53:0/91832941 conn(0x7f28f00ff380 msgr2=0x7f28f01017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:55.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.958+0000 7f28f5436640 1 -- 172.21.15.53:0/91832941 shutdown_connections 2024-08-31T06:21:55.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:55.958+0000 7f28f5436640 1 -- 172.21.15.53:0/91832941 wait complete. 2024-08-31T06:21:56.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 25173 5.60 MB/sec execute 104 sec latency 77.940 ms 2024-08-31T06:21:56.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:56 smithi053 ceph-mon[18924]: pgmap v854: 97 pgs: 97 active+clean; 517 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 385 op/s 2024-08-31T06:21:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:56 smithi130 ceph-mon[22266]: pgmap v854: 97 pgs: 97 active+clean; 517 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 385 op/s 2024-08-31T06:21:56.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:56 smithi153 ceph-mon[22320]: pgmap v854: 97 pgs: 97 active+clean; 517 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 385 op/s 2024-08-31T06:21:56.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:21:57.334 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:57.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 25337 5.66 MB/sec execute 105 sec latency 64.263 ms 2024-08-31T06:21:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.024+0000 7fa2166df640 1 -- 172.21.15.53:0/257198780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa210108140 msgr2=0x7fa210108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.024+0000 7fa2166df640 1 --2- 172.21.15.53:0/257198780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa210108140 0x7fa210108550 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fa204009900 tx=0x7fa20402a410 comp rx=0 tx=0).stop 2024-08-31T06:21:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.024+0000 7fa2166df640 1 -- 172.21.15.53:0/257198780 shutdown_connections 2024-08-31T06:21:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.024+0000 7fa2166df640 1 --2- 172.21.15.53:0/257198780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa210108a90 0x7fa21010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.024+0000 7fa2166df640 1 --2- 172.21.15.53:0/257198780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa210108140 0x7fa210108550 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.024+0000 7fa2166df640 1 --2- 172.21.15.53:0/257198780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa210102800 0x7fa210102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.024+0000 7fa2166df640 1 -- 172.21.15.53:0/257198780 >> 172.21.15.53:0/257198780 conn(0x7fa2100794d0 msgr2=0x7fa2100798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.024+0000 7fa2166df640 1 -- 172.21.15.53:0/257198780 shutdown_connections 2024-08-31T06:21:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.024+0000 7fa2166df640 1 -- 172.21.15.53:0/257198780 wait complete. 2024-08-31T06:21:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.025+0000 7fa2166df640 1 Processor -- start 2024-08-31T06:21:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.025+0000 7fa2166df640 1 -- start start 2024-08-31T06:21:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.026+0000 7fa2166df640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa210102800 0x7fa21019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.026+0000 7fa2166df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa210108140 0x7fa21019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.026+0000 7fa2166df640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa210108a90 0x7fa21019f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.026+0000 7fa2166df640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa2101136c0 con 0x7fa210108140 2024-08-31T06:21:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.026+0000 7fa2166df640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa210113540 con 0x7fa210108a90 2024-08-31T06:21:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.026+0000 7fa2166df640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa210113840 con 0x7fa210102800 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.026+0000 7fa20f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa210108140 0x7fa21019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.026+0000 7fa20f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa210108140 0x7fa21019a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38542/0 (socket says 172.21.15.53:38542) 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.026+0000 7fa20f7fe640 1 -- 172.21.15.53:0/812700738 learned_addr learned my addr 172.21.15.53:0/812700738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.026+0000 7fa20ffff640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa210102800 0x7fa21019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.026+0000 7fa214c7c640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa210108a90 0x7fa21019f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.027+0000 7fa20f7fe640 1 -- 172.21.15.53:0/812700738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa210102800 msgr2=0x7fa21019a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.027+0000 7fa20f7fe640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa210102800 0x7fa21019a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.027+0000 7fa20f7fe640 1 -- 172.21.15.53:0/812700738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa210108a90 msgr2=0x7fa21019f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.027+0000 7fa20f7fe640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa210108a90 0x7fa21019f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.027+0000 7fa20f7fe640 1 -- 172.21.15.53:0/812700738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2101a0120 con 0x7fa210108140 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.027+0000 7fa20f7fe640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa210108140 0x7fa21019a750 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fa204005940 tx=0x7fa204005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.027+0000 7fa214c7c640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa210108a90 0x7fa21019f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.027+0000 7fa20ffff640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa210102800 0x7fa21019a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:21:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.028+0000 7fa20d7fa640 1 -- 172.21.15.53:0/812700738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204035070 con 0x7fa210108140 2024-08-31T06:21:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.028+0000 7fa20d7fa640 1 -- 172.21.15.53:0/812700738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2040043c0 con 0x7fa210108140 2024-08-31T06:21:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.028+0000 7fa20d7fa640 1 -- 172.21.15.53:0/812700738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204003bc0 con 0x7fa210108140 2024-08-31T06:21:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.028+0000 7fa2166df640 1 -- 172.21.15.53:0/812700738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2101a03b0 con 0x7fa210108140 2024-08-31T06:21:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.028+0000 7fa2166df640 1 -- 172.21.15.53:0/812700738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa21010fa30 con 0x7fa210108140 2024-08-31T06:21:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.031+0000 7fa21cc54740 1 Processor -- start 2024-08-31T06:21:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.031+0000 7fa21cc54740 1 -- start start 2024-08-31T06:21:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.031+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561743120070 0x5617434c5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.031+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434c5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617430ff390 0x5617434c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa21cc54740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56174343c680 con 0x561743120070 2024-08-31T06:21:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa21cc54740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56174342bc10 con 0x5617430f71b0 2024-08-31T06:21:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa21cc54740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56174342fbc0 con 0x5617430ff390 2024-08-31T06:21:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:57892/0 (socket says 172.21.15.53:57892) 2024-08-31T06:21:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa214c7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561743120070 0x5617434c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa20ffff640 1 -- 172.21.15.53:0/3932998948 learned_addr learned my addr 172.21.15.53:0/3932998948 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa20ffff640 1 -- 172.21.15.53:0/3932998948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617430ff390 msgr2=0x5617434c5dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:21:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa20ffff640 1 --2- 172.21.15.53:0/3932998948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617430ff390 0x5617434c5dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa20ffff640 1 -- 172.21.15.53:0/3932998948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561743120070 msgr2=0x5617434c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa20d7fa640 1 -- 172.21.15.53:0/812700738 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa20403d760 con 0x7fa210108140 2024-08-31T06:21:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa20ffff640 1 --2- 172.21.15.53:0/3932998948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561743120070 0x5617434c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa20ffff640 1 -- 172.21.15.53:0/3932998948 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56174318b650 con 0x5617430f71b0 2024-08-31T06:21:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.032+0000 7fa214c7c640 1 --2- 172.21.15.53:0/3932998948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561743120070 0x5617434c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.033+0000 7fa20ffff640 1 --2- 172.21.15.53:0/3932998948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434c5890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa200009c60 tx=0x7fa200010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8e8f66f89760bc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.033+0000 7fa1f67fc640 1 -- 172.21.15.53:0/3932998948 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200005020 con 0x5617430f71b0 2024-08-31T06:21:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.033+0000 7fa1f67fc640 1 -- 172.21.15.53:0/3932998948 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2000047a0 con 0x5617430f71b0 2024-08-31T06:21:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.033+0000 7fa20d7fa640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1f80b4d20 0x7fa1f80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa1f67fc640 1 -- 172.21.15.53:0/3932998948 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2000126b0 con 0x5617430f71b0 2024-08-31T06:21:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa214c7c640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1f80b4d20 0x7fa1f80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa20d7fa640 1 -- 172.21.15.53:0/812700738 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fa204105b00 con 0x7fa210108140 2024-08-31T06:21:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa21cc54740 1 -- 172.21.15.53:0/3932998948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 msgr2=0x5617434c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa21cc54740 1 --2- 172.21.15.53:0/3932998948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434c5890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa200009c60 tx=0x7fa200010740 comp rx=0 tx=0).stop 2024-08-31T06:21:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa21cc54740 1 -- 172.21.15.53:0/3932998948 shutdown_connections 2024-08-31T06:21:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa21cc54740 1 --2- 172.21.15.53:0/3932998948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617430ff390 0x5617434c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa21cc54740 1 --2- 172.21.15.53:0/3932998948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434c5890 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa21cc54740 1 --2- 172.21.15.53:0/3932998948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561743120070 0x5617434c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa21cc54740 1 -- 172.21.15.53:0/3932998948 >> 172.21.15.53:0/3932998948 conn(0x561743114460 msgr2=0x5617434c3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa214c7c640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1f80b4d20 0x7fa1f80b7230 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa208005fd0 tx=0x7fa208009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa21cc54740 1 -- 172.21.15.53:0/3932998948 shutdown_connections 2024-08-31T06:21:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.034+0000 7fa21cc54740 1 -- 172.21.15.53:0/3932998948 wait complete. 2024-08-31T06:21:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.035+0000 7fa21cc54740 1 -- start start 2024-08-31T06:21:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.035+0000 7fa21cc54740 1 Processor -- start 2024-08-31T06:21:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.035+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.035+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434d9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.035+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 0x5617434e56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.035+0000 7fa21cc54740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56174328e700 con 0x5617430ff390 2024-08-31T06:21:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.035+0000 7fa21cc54740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5617433b2750 con 0x5617430f71b0 2024-08-31T06:21:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.035+0000 7fa21cc54740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5617434dc300 con 0x561743120070 2024-08-31T06:21:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.035+0000 7fa21cc54740 10 client.0 _ll_register_callbacks cb 0x5617433e1e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:57900/0 (socket says 172.21.15.53:57900) 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa20ffff640 1 -- 172.21.15.53:0/2735562273 learned_addr learned my addr 172.21.15.53:0/2735562273 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa20f7fe640 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434d9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa214c7c640 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 0x5617434e56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa20ffff640 1 -- 172.21.15.53:0/2735562273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 msgr2=0x5617434e56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa20ffff640 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 0x5617434e56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa20ffff640 1 -- 172.21.15.53:0/2735562273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 msgr2=0x5617434d9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa20ffff640 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434d9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa20ffff640 1 -- 172.21.15.53:0/2735562273 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617433eb900 con 0x5617430f71b0 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa214c7c640 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 0x5617434e56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa20ffff640 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d91e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa200000c00 tx=0x7fa200004e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a94eda204a84c66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa1ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa1ef7fe640 1 -- 172.21.15.53:0/2735562273 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20002a060 con 0x5617430f71b0 2024-08-31T06:21:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa21cc54740 1 -- 172.21.15.53:0/2735562273 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2000047a0 con 0x5617430f71b0 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.036+0000 7fa1ef7fe640 1 -- 172.21.15.53:0/2735562273 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fa200005310 con 0x5617430f71b0 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa1ef7fe640 1 -- 172.21.15.53:0/2735562273 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fa200005510 con 0x5617430f71b0 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa21cc54740 10 client.29726 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa21cc54740 1 -- 172.21.15.53:0/2735562273 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5617434e80c0 con 0x5617430f71b0 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa1ef7fe640 1 -- 172.21.15.53:0/2735562273 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2000047a0 con 0x5617430f71b0 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa1ef7fe640 1 -- 172.21.15.53:0/2735562273 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fa20000f040 con 0x5617430f71b0 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa21cc54740 10 client.29726 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa21cc54740 10 client.29726 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa21cc54740 20 client.29726 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa21cc54740 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5617430de9f0 0x5617434eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa21cc54740 4 client.29726 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa21cc54740 1 -- 172.21.15.53:0/2735562273 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56174343e5d0 con 0x5617430de9f0 2024-08-31T06:21:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.037+0000 7fa20f7fe640 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5617430de9f0 0x5617434eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.038+0000 7fa1ef7fe640 10 client.29726 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:21:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.038+0000 7fa20f7fe640 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5617430de9f0 0x5617434eb4d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb179faeab8e8948 server_cookie=2699fb8ff43e1285 in_seq=0 out_seq=0 2024-08-31T06:21:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.039+0000 7fa1ef7fe640 1 -- 172.21.15.53:0/2735562273 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56174343e5d0 con 0x5617430de9f0 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.039+0000 7fa1ef7fe640 10 client.29726 handle_command_reply: tid=0 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.039+0000 7fa21cc54740 1 client.29726 shutdown 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.039+0000 7fa21cc54740 1 -- 172.21.15.53:0/2735562273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 msgr2=0x5617434d91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.039+0000 7fa21cc54740 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d91e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa200000c00 tx=0x7fa200004e30 comp rx=0 tx=0).stop 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.040+0000 7fa21cc54740 1 -- 172.21.15.53:0/2735562273 shutdown_connections 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.040+0000 7fa21cc54740 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5617430de9f0 0x5617434eb4d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.040+0000 7fa21cc54740 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 0x5617434e56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.040+0000 7fa21cc54740 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434d9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.040+0000 7fa21cc54740 1 --2- 172.21.15.53:0/2735562273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d91e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.040+0000 7fa1ef7fe640 0 client.29726 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.040+0000 7fa21cc54740 1 -- 172.21.15.53:0/2735562273 >> 172.21.15.53:0/2735562273 conn(0x561743114460 msgr2=0x5617434c1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.040+0000 7fa21cc54740 1 -- 172.21.15.53:0/2735562273 shutdown_connections 2024-08-31T06:21:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.040+0000 7fa21cc54740 1 -- 172.21.15.53:0/2735562273 wait complete. 2024-08-31T06:21:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.040+0000 7fa21cc54740 20 client.29726 trim_cache size 0 max 16384 2024-08-31T06:21:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa21cc54740 1 Processor -- start 2024-08-31T06:21:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa21cc54740 1 -- start start 2024-08-31T06:21:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 0x5617434d63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa21cc54740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa2101ad3a0 con 0x5617430ff390 2024-08-31T06:21:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa21cc54740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2101af060 con 0x5617430f71b0 2024-08-31T06:21:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa21cc54740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2101ada70 con 0x561743120070 2024-08-31T06:21:58.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa20f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:57912/0 (socket says 172.21.15.53:57912) 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa20ffff640 1 -- 172.21.15.53:0/3452033974 learned_addr learned my addr 172.21.15.53:0/3452033974 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.059+0000 7fa214c7c640 1 --2- 172.21.15.53:0/3452033974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 0x5617434d63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.060+0000 7fa20ffff640 1 -- 172.21.15.53:0/3452033974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 msgr2=0x5617434d63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.060+0000 7fa20ffff640 1 --2- 172.21.15.53:0/3452033974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 0x5617434d63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.060+0000 7fa20ffff640 1 -- 172.21.15.53:0/3452033974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 msgr2=0x5617434cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.060+0000 7fa20ffff640 1 --2- 172.21.15.53:0/3452033974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.060+0000 7fa20ffff640 1 -- 172.21.15.53:0/3452033974 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617434c3bc0 con 0x5617430f71b0 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.060+0000 7fa214c7c640 1 --2- 172.21.15.53:0/3452033974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 0x5617434d63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.060+0000 7fa20f7fe640 1 --2- 172.21.15.53:0/3452033974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.060+0000 7fa20ffff640 1 --2- 172.21.15.53:0/3452033974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d80d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa200010780 tx=0x7fa200009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b9fd82247cf860e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.060+0000 7fa1f5ffb640 1 -- 172.21.15.53:0/3452033974 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20002a040 con 0x5617430f71b0 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.060+0000 7fa1f5ffb640 1 -- 172.21.15.53:0/3452033974 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa200005110 con 0x5617430f71b0 2024-08-31T06:21:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.060+0000 7fa1f5ffb640 1 -- 172.21.15.53:0/3452033974 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200012450 con 0x5617430f71b0 2024-08-31T06:21:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.062+0000 7fa21cc54740 1 -- 172.21.15.53:0/3452033974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 msgr2=0x5617434d80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.062+0000 7fa21cc54740 1 --2- 172.21.15.53:0/3452033974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d80d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa200010780 tx=0x7fa200009f60 comp rx=0 tx=0).stop 2024-08-31T06:21:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.062+0000 7fa21cc54740 1 -- 172.21.15.53:0/3452033974 shutdown_connections 2024-08-31T06:21:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.062+0000 7fa21cc54740 1 --2- 172.21.15.53:0/3452033974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561743120070 0x5617434d63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.062+0000 7fa21cc54740 1 --2- 172.21.15.53:0/3452033974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.062+0000 7fa21cc54740 1 --2- 172.21.15.53:0/3452033974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617430f71b0 0x5617434d80d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.062+0000 7fa21cc54740 1 -- 172.21.15.53:0/3452033974 >> 172.21.15.53:0/3452033974 conn(0x561743114460 msgr2=0x5617434ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.062+0000 7fa21cc54740 1 -- 172.21.15.53:0/3452033974 shutdown_connections 2024-08-31T06:21:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.062+0000 7fa21cc54740 1 -- 172.21.15.53:0/3452033974 wait complete. 2024-08-31T06:21:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.063+0000 7fa21cc54740 1 -- start start 2024-08-31T06:21:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.063+0000 7fa21cc54740 1 Processor -- start 2024-08-31T06:21:58.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617430f71b0 0x5617434dd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434ddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa20f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434ddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617430f71b0 0x5617434dd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa20f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434ddbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38564/0 (socket says 172.21.15.53:38564) 2024-08-31T06:21:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa21cc54740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561743120070 0x5617434de120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617430f71b0 0x5617434dd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48558/0 (socket says 172.21.15.53:48558) 2024-08-31T06:21:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa20f7fe640 1 -- 172.21.15.53:0/1757481564 learned_addr learned my addr 172.21.15.53:0/1757481564 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:21:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa21cc54740 1 -- 172.21.15.53:0/1757481564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa2101ae990 con 0x5617430ff390 2024-08-31T06:21:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa21cc54740 1 -- 172.21.15.53:0/1757481564 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2101ae200 con 0x561743120070 2024-08-31T06:21:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa21cc54740 1 -- 172.21.15.53:0/1757481564 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2101ab3a0 con 0x5617430f71b0 2024-08-31T06:21:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.064+0000 7fa214c7c640 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561743120070 0x5617434de120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa20ffff640 1 -- 172.21.15.53:0/1757481564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561743120070 msgr2=0x5617434de120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:58.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa20ffff640 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561743120070 0x5617434de120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa20ffff640 1 -- 172.21.15.53:0/1757481564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 msgr2=0x5617434ddbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa20ffff640 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434ddbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa21cc54740 10 client.0 _ll_register_callbacks cb 0x7fa2080098e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa20ffff640 1 -- 172.21.15.53:0/1757481564 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561743554e30 con 0x5617430f71b0 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa20f7fe640 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434ddbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa21cc54740 1 -- 172.21.15.53:0/1757481564 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa200005110 con 0x5617430f71b0 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa20ffff640 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617430f71b0 0x5617434dd6a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa200005820 tx=0x7fa200009370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=610b950cfaa026e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa1ef7fe640 10 client.29722 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa1ef7fe640 1 -- 172.21.15.53:0/1757481564 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20002a070 con 0x5617430f71b0 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa1ef7fe640 1 -- 172.21.15.53:0/1757481564 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7fa2000096c0 con 0x5617430f71b0 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa1ef7fe640 1 -- 172.21.15.53:0/1757481564 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fa200004660 con 0x5617430f71b0 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa21cc54740 10 client.29722 fetch_fsmap learned FSMap version 60 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.065+0000 7fa21cc54740 1 -- 172.21.15.53:0/1757481564 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=60}) -- 0x561743555fb0 con 0x5617430f71b0 2024-08-31T06:21:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.066+0000 7fa1ef7fe640 1 -- 172.21.15.53:0/1757481564 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7fa20001a880 con 0x5617430f71b0 2024-08-31T06:21:58.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.066+0000 7fa21cc54740 10 client.29722 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:21:58.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.066+0000 7fa21cc54740 10 client.29722 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:21:58.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.066+0000 7fa21cc54740 20 client.29722 populate_metadata read hostname 'smithi053' 2024-08-31T06:21:58.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.066+0000 7fa21cc54740 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5617430b3da0 0x561743558670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:21:58.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.066+0000 7fa21cc54740 4 client.29722 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:21:58.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.066+0000 7fa21cc54740 1 -- 172.21.15.53:0/1757481564 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5617434d4d90 con 0x5617430b3da0 2024-08-31T06:21:58.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.066+0000 7fa20f7fe640 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5617430b3da0 0x561743558670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:21:58.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa20f7fe640 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5617430b3da0 0x561743558670 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3675a95bf3db693 server_cookie=bf5d8ad62f18b6fd in_seq=0 out_seq=0 2024-08-31T06:21:58.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa1ef7fe640 10 client.29722 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:21:58.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa1ef7fe640 1 -- 172.21.15.53:0/1757481564 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5617434d4d90 con 0x5617430b3da0 2024-08-31T06:21:58.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa1ef7fe640 10 client.29722 handle_command_reply: tid=0 2024-08-31T06:21:58.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa21cc54740 1 client.29722 shutdown 2024-08-31T06:21:58.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa21cc54740 1 -- 172.21.15.53:0/1757481564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617430f71b0 msgr2=0x5617434dd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:58.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa21cc54740 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617430f71b0 0x5617434dd6a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa200005820 tx=0x7fa200009370 comp rx=0 tx=0).stop 2024-08-31T06:21:58.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa21cc54740 1 -- 172.21.15.53:0/1757481564 shutdown_connections 2024-08-31T06:21:58.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa21cc54740 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5617430b3da0 0x561743558670 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa21cc54740 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561743120070 0x5617434de120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa21cc54740 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617430ff390 0x5617434ddbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa21cc54740 1 --2- 172.21.15.53:0/1757481564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617430f71b0 0x5617434dd6a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa21cc54740 1 -- 172.21.15.53:0/1757481564 >> 172.21.15.53:0/1757481564 conn(0x561743114460 msgr2=0x5617434c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:58.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa1ef7fe640 0 client.29722 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:21:58.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa21cc54740 1 -- 172.21.15.53:0/1757481564 shutdown_connections 2024-08-31T06:21:58.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.067+0000 7fa21cc54740 1 -- 172.21.15.53:0/1757481564 wait complete. 2024-08-31T06:21:58.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.068+0000 7fa21cc54740 20 client.29722 trim_cache size 0 max 16384 2024-08-31T06:21:58.073 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:21:58.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.068+0000 7fa2166df640 1 -- 172.21.15.53:0/812700738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1f80b4d20 msgr2=0x7fa1f80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:58.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.069+0000 7fa2166df640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1f80b4d20 0x7fa1f80b7230 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa208005fd0 tx=0x7fa208009500 comp rx=0 tx=0).stop 2024-08-31T06:21:58.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.069+0000 7fa2166df640 1 -- 172.21.15.53:0/812700738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa210108140 msgr2=0x7fa21019a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:21:58.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.069+0000 7fa2166df640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa210108140 0x7fa21019a750 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fa204005940 tx=0x7fa204005e30 comp rx=0 tx=0).stop 2024-08-31T06:21:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.069+0000 7fa2166df640 1 -- 172.21.15.53:0/812700738 shutdown_connections 2024-08-31T06:21:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.069+0000 7fa2166df640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa1f80b4d20 0x7fa1f80b7230 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.069+0000 7fa2166df640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa210108a90 0x7fa21019f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.069+0000 7fa2166df640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa210108140 0x7fa21019a750 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.069+0000 7fa2166df640 1 --2- 172.21.15.53:0/812700738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa210102800 0x7fa21019a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:21:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.069+0000 7fa2166df640 1 -- 172.21.15.53:0/812700738 >> 172.21.15.53:0/812700738 conn(0x7fa2100794d0 msgr2=0x7fa2101042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:21:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.069+0000 7fa2166df640 1 -- 172.21.15.53:0/812700738 shutdown_connections 2024-08-31T06:21:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:58.069+0000 7fa2166df640 1 -- 172.21.15.53:0/812700738 wait complete. 2024-08-31T06:21:58.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 25516 5.73 MB/sec execute 106 sec latency 100.128 ms 2024-08-31T06:21:58.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:21:58 smithi053 ceph-mon[18924]: pgmap v855: 97 pgs: 97 active+clean; 517 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 360 op/s 2024-08-31T06:21:58.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:21:58 smithi130 ceph-mon[22266]: pgmap v855: 97 pgs: 97 active+clean; 517 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 360 op/s 2024-08-31T06:21:58.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:21:58 smithi153 ceph-mon[22320]: pgmap v855: 97 pgs: 97 active+clean; 517 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 360 op/s 2024-08-31T06:21:58.914 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:21:59.283 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:21:59.369 INFO:tasks.workunit.client.0.smithi053.stdout: 10 25715 5.82 MB/sec execute 107 sec latency 64.043 ms 2024-08-31T06:22:00.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.849+0000 7f1421cf5640 1 -- 172.21.15.53:0/2453160240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c109ba0 msgr2=0x7f141c1103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:00.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.849+0000 7f1421cf5640 1 --2- 172.21.15.53:0/2453160240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c109ba0 0x7f141c1103d0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f1414009ca0 tx=0x7f141402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.849+0000 7f1421cf5640 1 -- 172.21.15.53:0/2453160240 shutdown_connections 2024-08-31T06:22:00.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.849+0000 7f1421cf5640 1 --2- 172.21.15.53:0/2453160240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c109ba0 0x7f141c1103d0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.849+0000 7f1421cf5640 1 --2- 172.21.15.53:0/2453160240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f141c109250 0x7f141c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.849+0000 7f1421cf5640 1 --2- 172.21.15.53:0/2453160240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f141c101d10 0x7f141c102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.849+0000 7f1421cf5640 1 -- 172.21.15.53:0/2453160240 >> 172.21.15.53:0/2453160240 conn(0x7f141c077a00 msgr2=0x7f141c077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.849+0000 7f1421cf5640 1 -- 172.21.15.53:0/2453160240 shutdown_connections 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.849+0000 7f1421cf5640 1 -- 172.21.15.53:0/2453160240 wait complete. 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.850+0000 7f1421cf5640 1 Processor -- start 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.851+0000 7f1421cf5640 1 -- start start 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.851+0000 7f1421cf5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f141c101d10 0x7f141c19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.851+0000 7f1421cf5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f141c109250 0x7f141c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.851+0000 7f1421cf5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c109ba0 0x7f141c19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.851+0000 7f1421cf5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f141c113760 con 0x7f141c109ba0 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.851+0000 7f1421cf5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f141c1135e0 con 0x7f141c109250 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.851+0000 7f141bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c109ba0 0x7f141c19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.852+0000 7f1421cf5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f141c1138e0 con 0x7f141c101d10 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.852+0000 7f141bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c109ba0 0x7f141c19f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38582/0 (socket says 172.21.15.53:38582) 2024-08-31T06:22:00.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.852+0000 7f141bfff640 1 -- 172.21.15.53:0/3578785044 learned_addr learned my addr 172.21.15.53:0/3578785044 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.852+0000 7f141affd640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f141c109250 0x7f141c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.852+0000 7f141b7fe640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f141c101d10 0x7f141c19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.852+0000 7f141bfff640 1 -- 172.21.15.53:0/3578785044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f141c101d10 msgr2=0x7f141c19a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.852+0000 7f141bfff640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f141c101d10 0x7f141c19a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.852+0000 7f141bfff640 1 -- 172.21.15.53:0/3578785044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f141c109250 msgr2=0x7f141c19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.852+0000 7f141bfff640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f141c109250 0x7f141c19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.852+0000 7f141bfff640 1 -- 172.21.15.53:0/3578785044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c1a00c0 con 0x7f141c109ba0 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.852+0000 7f141bfff640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c109ba0 0x7f141c19f990 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f1414031040 tx=0x7f1414003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.853+0000 7f1418ff9640 1 -- 172.21.15.53:0/3578785044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141404c070 con 0x7f141c109ba0 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.853+0000 7f1421cf5640 1 -- 172.21.15.53:0/3578785044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141c1a0350 con 0x7f141c109ba0 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.853+0000 7f1418ff9640 1 -- 172.21.15.53:0/3578785044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f141403cbb0 con 0x7f141c109ba0 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.853+0000 7f1421cf5640 1 -- 172.21.15.53:0/3578785044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141c102b90 con 0x7f141c109ba0 2024-08-31T06:22:00.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.853+0000 7f1418ff9640 1 -- 172.21.15.53:0/3578785044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414004460 con 0x7f141c109ba0 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.856+0000 7f142826a740 1 Processor -- start 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.857+0000 7f1418ff9640 1 -- 172.21.15.53:0/3578785044 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f141404f070 con 0x7f141c109ba0 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.857+0000 7f142826a740 1 -- start start 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f142826a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 0x559d6b50ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f142826a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b1341b0 0x559d6b50b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f142826a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b13c390 0x559d6b50b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f142826a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559d6b479680 con 0x559d6b1341b0 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f142826a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559d6b468c10 con 0x559d6b15d070 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f142826a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559d6b46cbc0 con 0x559d6b13c390 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f141affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 0x559d6b50ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f141b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b1341b0 0x559d6b50b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f141affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 0x559d6b50ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:57960/0 (socket says 172.21.15.53:57960) 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f141affd640 1 -- 172.21.15.53:0/324361278 learned_addr learned my addr 172.21.15.53:0/324361278 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f141affd640 1 --2- 172.21.15.53:0/324361278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b13c390 0x559d6b50b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f1418ff9640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f14040b4d20 0x7f14040b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f141affd640 1 -- 172.21.15.53:0/324361278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b13c390 msgr2=0x559d6b50b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f141affd640 1 --2- 172.21.15.53:0/324361278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b13c390 0x559d6b50b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f141affd640 1 -- 172.21.15.53:0/324361278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b1341b0 msgr2=0x559d6b50b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.858+0000 7f141affd640 1 --2- 172.21.15.53:0/324361278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b1341b0 0x559d6b50b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.859+0000 7f141affd640 1 -- 172.21.15.53:0/324361278 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d6b1c8650 con 0x559d6b15d070 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.859+0000 7f141b7fe640 1 --2- 172.21.15.53:0/324361278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b1341b0 0x559d6b50b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.859+0000 7f1418ff9640 1 -- 172.21.15.53:0/3578785044 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f1414105620 con 0x7f141c109ba0 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.859+0000 7f141affd640 1 --2- 172.21.15.53:0/324361278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 0x559d6b50ab20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f14100126d0 tx=0x7f1410004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf0abb5636fa3ba8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.859+0000 7f141bfff640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f14040b4d20 0x7f14040b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.859+0000 7f141bfff640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f14040b4d20 0x7f14040b7230 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1414103350 tx=0x7f141402a8c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.859+0000 7f1401ffb640 1 -- 172.21.15.53:0/324361278 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410012c50 con 0x559d6b15d070 2024-08-31T06:22:00.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.860+0000 7f1401ffb640 1 -- 172.21.15.53:0/324361278 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1410012df0 con 0x559d6b15d070 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.860+0000 7f1401ffb640 1 -- 172.21.15.53:0/324361278 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410005020 con 0x559d6b15d070 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.861+0000 7f142826a740 1 -- 172.21.15.53:0/324361278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 msgr2=0x559d6b50ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.861+0000 7f142826a740 1 --2- 172.21.15.53:0/324361278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 0x559d6b50ab20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f14100126d0 tx=0x7f1410004730 comp rx=0 tx=0).stop 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.861+0000 7f142826a740 1 -- 172.21.15.53:0/324361278 shutdown_connections 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.861+0000 7f142826a740 1 --2- 172.21.15.53:0/324361278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b13c390 0x559d6b50b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.861+0000 7f142826a740 1 --2- 172.21.15.53:0/324361278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b1341b0 0x559d6b50b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.861+0000 7f142826a740 1 --2- 172.21.15.53:0/324361278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 0x559d6b50ab20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.861+0000 7f142826a740 1 -- 172.21.15.53:0/324361278 >> 172.21.15.53:0/324361278 conn(0x559d6b151460 msgr2=0x559d6b508a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.861+0000 7f142826a740 1 -- 172.21.15.53:0/324361278 shutdown_connections 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.861+0000 7f142826a740 1 -- 172.21.15.53:0/324361278 wait complete. 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.861+0000 7f142826a740 1 -- start start 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f142826a740 1 Processor -- start 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f142826a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b516340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f142826a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 0x559d6b516880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f142826a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b15d070 0x559d6b522620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f142826a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559d6b2cb700 con 0x559d6b15d070 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f142826a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559d6b3ef750 con 0x559d6b13c390 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f142826a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559d6b5192a0 con 0x559d6b1341b0 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f141affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b516340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f141b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 0x559d6b516880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f141affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b516340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48584/0 (socket says 172.21.15.53:48584) 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f141affd640 1 -- 172.21.15.53:0/3134407227 learned_addr learned my addr 172.21.15.53:0/3134407227 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f141affd640 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b15d070 0x559d6b522620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.862+0000 7f142826a740 10 client.0 _ll_register_callbacks cb 0x559d6b41ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.863+0000 7f141b7fe640 1 -- 172.21.15.53:0/3134407227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 msgr2=0x559d6b516340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.863+0000 7f141b7fe640 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b516340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.863+0000 7f141b7fe640 1 -- 172.21.15.53:0/3134407227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b15d070 msgr2=0x559d6b522620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.863+0000 7f141b7fe640 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b15d070 0x559d6b522620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.863+0000 7f141b7fe640 1 -- 172.21.15.53:0/3134407227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d6b428900 con 0x559d6b13c390 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.863+0000 7f141b7fe640 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 0x559d6b516880 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f140c0126d0 tx=0x7f140c012b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9faf8a5b7c8d404a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.863+0000 7f13faffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.863+0000 7f13faffd640 1 -- 172.21.15.53:0/3134407227 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c011bb0 con 0x559d6b13c390 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.863+0000 7f142826a740 1 -- 172.21.15.53:0/3134407227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1410012df0 con 0x559d6b13c390 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.863+0000 7f13faffd640 1 -- 172.21.15.53:0/3134407227 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f140c011d50 con 0x559d6b13c390 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.864+0000 7f13faffd640 1 -- 172.21.15.53:0/3134407227 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f140c004020 con 0x559d6b13c390 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.864+0000 7f142826a740 10 client.29744 fetch_fsmap learned FSMap version 60 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.864+0000 7f142826a740 1 -- 172.21.15.53:0/3134407227 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x559d6b5251e0 con 0x559d6b13c390 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.864+0000 7f13faffd640 1 -- 172.21.15.53:0/3134407227 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f140c0041c0 con 0x559d6b13c390 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.864+0000 7f13faffd640 1 -- 172.21.15.53:0/3134407227 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f140c01c470 con 0x559d6b13c390 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.864+0000 7f142826a740 10 client.29744 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.864+0000 7f142826a740 10 client.29744 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.864+0000 7f142826a740 20 client.29744 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.864+0000 7f142826a740 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559d6b11b9f0 0x559d6b5287c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.864+0000 7f142826a740 4 client.29744 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.864+0000 7f142826a740 1 -- 172.21.15.53:0/3134407227 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1410012df0 con 0x559d6b11b9f0 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.865+0000 7f141affd640 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559d6b11b9f0 0x559d6b5287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.865+0000 7f141affd640 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559d6b11b9f0 0x559d6b5287c0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=79e01487e5494c92 server_cookie=becabf9f66acd380 in_seq=0 out_seq=0 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.865+0000 7f13faffd640 10 client.29744 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.866+0000 7f13faffd640 1 -- 172.21.15.53:0/3134407227 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f1410012df0 con 0x559d6b11b9f0 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.866+0000 7f13faffd640 10 client.29744 handle_command_reply: tid=0 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.866+0000 7f142826a740 1 client.29744 shutdown 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f142826a740 1 -- 172.21.15.53:0/3134407227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 msgr2=0x559d6b516880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f142826a740 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 0x559d6b516880 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f140c0126d0 tx=0x7f140c012b90 comp rx=0 tx=0).stop 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f142826a740 1 -- 172.21.15.53:0/3134407227 shutdown_connections 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f142826a740 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559d6b11b9f0 0x559d6b5287c0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f142826a740 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b15d070 0x559d6b522620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f142826a740 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 0x559d6b516880 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f142826a740 1 --2- 172.21.15.53:0/3134407227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b516340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f13faffd640 0 client.29744 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f142826a740 1 -- 172.21.15.53:0/3134407227 >> 172.21.15.53:0/3134407227 conn(0x559d6b151460 msgr2=0x559d6b50dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f142826a740 1 -- 172.21.15.53:0/3134407227 shutdown_connections 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f142826a740 1 -- 172.21.15.53:0/3134407227 wait complete. 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.867+0000 7f142826a740 20 client.29744 trim_cache size 0 max 16384 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.889+0000 7f142826a740 1 Processor -- start 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.889+0000 7f142826a740 1 -- start start 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.889+0000 7f142826a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b516800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.889+0000 7f142826a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b13c390 0x559d6b522520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.889+0000 7f142826a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 0x559d6b522a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f141affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b516800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f141affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b516800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48590/0 (socket says 172.21.15.53:48590) 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f141affd640 1 -- 172.21.15.53:0/2296306719 learned_addr learned my addr 172.21.15.53:0/2296306719 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f142826a740 1 -- 172.21.15.53:0/2296306719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f140800e8a0 con 0x559d6b13c390 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f142826a740 1 -- 172.21.15.53:0/2296306719 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1408010560 con 0x559d6b15d070 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f142826a740 1 -- 172.21.15.53:0/2296306719 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f140800ef70 con 0x559d6b1341b0 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f141b7fe640 1 --2- 172.21.15.53:0/2296306719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b13c390 0x559d6b522520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f141affd640 1 --2- 172.21.15.53:0/2296306719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 0x559d6b522a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f141affd640 1 -- 172.21.15.53:0/2296306719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 msgr2=0x559d6b522a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f141affd640 1 --2- 172.21.15.53:0/2296306719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 0x559d6b522a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f141affd640 1 -- 172.21.15.53:0/2296306719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b13c390 msgr2=0x559d6b522520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f141affd640 1 --2- 172.21.15.53:0/2296306719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b13c390 0x559d6b522520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f141affd640 1 -- 172.21.15.53:0/2296306719 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d6b517600 con 0x559d6b1341b0 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.890+0000 7f141affd640 1 --2- 172.21.15.53:0/2296306719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b516800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1410005fd0 tx=0x7f14100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47c888305dac51f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.891+0000 7f14017fa640 1 -- 172.21.15.53:0/2296306719 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410004020 con 0x559d6b1341b0 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.891+0000 7f14017fa640 1 -- 172.21.15.53:0/2296306719 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1410010bd0 con 0x559d6b1341b0 2024-08-31T06:22:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.891+0000 7f14017fa640 1 -- 172.21.15.53:0/2296306719 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410003850 con 0x559d6b1341b0 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.892+0000 7f142826a740 1 -- 172.21.15.53:0/2296306719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 msgr2=0x559d6b516800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.892+0000 7f142826a740 1 --2- 172.21.15.53:0/2296306719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b516800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1410005fd0 tx=0x7f14100046c0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.892+0000 7f142826a740 1 -- 172.21.15.53:0/2296306719 shutdown_connections 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.892+0000 7f142826a740 1 --2- 172.21.15.53:0/2296306719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b15d070 0x559d6b522a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.892+0000 7f142826a740 1 --2- 172.21.15.53:0/2296306719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b13c390 0x559d6b522520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.892+0000 7f142826a740 1 --2- 172.21.15.53:0/2296306719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b516800 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.892+0000 7f142826a740 1 -- 172.21.15.53:0/2296306719 >> 172.21.15.53:0/2296306719 conn(0x559d6b151460 msgr2=0x559d6b5160f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.892+0000 7f142826a740 1 -- 172.21.15.53:0/2296306719 shutdown_connections 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.892+0000 7f142826a740 1 -- 172.21.15.53:0/2296306719 wait complete. 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.893+0000 7f142826a740 1 -- start start 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.893+0000 7f142826a740 1 Processor -- start 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.893+0000 7f142826a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b51a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.893+0000 7f142826a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 0x559d6b51aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.893+0000 7f142826a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b15d070 0x559d6b51b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.893+0000 7f142826a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f140800fe90 con 0x559d6b15d070 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.893+0000 7f142826a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f140800f700 con 0x559d6b13c390 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.893+0000 7f142826a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f140800c8a0 con 0x559d6b1341b0 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f142826a740 10 client.0 _ll_register_callbacks cb 0x7f140c0096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f141b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 0x559d6b51aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f141affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b15d070 0x559d6b51b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f141affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b51a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f141b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 0x559d6b51aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:57996/0 (socket says 172.21.15.53:57996) 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f141b7fe640 1 -- 172.21.15.53:0/4250680551 learned_addr learned my addr 172.21.15.53:0/4250680551 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f141affd640 1 -- 172.21.15.53:0/4250680551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 msgr2=0x559d6b51aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f141affd640 1 --2- 172.21.15.53:0/4250680551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 0x559d6b51aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f141affd640 1 -- 172.21.15.53:0/4250680551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b15d070 msgr2=0x559d6b51b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:00.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f141affd640 1 --2- 172.21.15.53:0/4250680551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b15d070 0x559d6b51b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f141affd640 1 -- 172.21.15.53:0/4250680551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d6b5923a0 con 0x559d6b1341b0 2024-08-31T06:22:00.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f141affd640 1 --2- 172.21.15.53:0/4250680551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b51a760 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1410015040 tx=0x7f141000bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e8690b18ef3058c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:00.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.894+0000 7f13faffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:22:00.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.895+0000 7f13faffd640 1 -- 172.21.15.53:0/4250680551 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410023020 con 0x559d6b1341b0 2024-08-31T06:22:00.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.895+0000 7f142826a740 1 -- 172.21.15.53:0/4250680551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1410010bd0 con 0x559d6b1341b0 2024-08-31T06:22:00.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.895+0000 7f13faffd640 1 -- 172.21.15.53:0/4250680551 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8557+0+0 (secure 0 0 0) 0x7f1410010940 con 0x559d6b1341b0 2024-08-31T06:22:00.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.895+0000 7f13faffd640 1 -- 172.21.15.53:0/4250680551 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f14100042c0 con 0x559d6b1341b0 2024-08-31T06:22:00.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.895+0000 7f142826a740 10 client.29740 fetch_fsmap learned FSMap version 60 2024-08-31T06:22:00.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.895+0000 7f142826a740 1 -- 172.21.15.53:0/4250680551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x559d6b593600 con 0x559d6b1341b0 2024-08-31T06:22:00.189 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:22:00.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.895+0000 7f13faffd640 1 -- 172.21.15.53:0/4250680551 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1410003a80 con 0x559d6b1341b0 2024-08-31T06:22:00.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.896+0000 7f13faffd640 1 -- 172.21.15.53:0/4250680551 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f1410033070 con 0x559d6b1341b0 2024-08-31T06:22:00.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.896+0000 7f142826a740 10 client.29740 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:22:00.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.896+0000 7f142826a740 10 client.29740 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:22:00.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.896+0000 7f142826a740 20 client.29740 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:00.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.896+0000 7f142826a740 1 --2- 172.21.15.53:0/4250680551 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559d6b0f0da0 0x559d6b595b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:00.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.896+0000 7f142826a740 4 client.29740 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:22:00.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.896+0000 7f142826a740 1 -- 172.21.15.53:0/4250680551 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f1410010bd0 con 0x559d6b0f0da0 2024-08-31T06:22:00.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.896+0000 7f141b7fe640 1 --2- 172.21.15.53:0/4250680551 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559d6b0f0da0 0x559d6b595b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:00.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.896+0000 7f13faffd640 10 client.29740 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:22:00.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.897+0000 7f141b7fe640 1 --2- 172.21.15.53:0/4250680551 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559d6b0f0da0 0x559d6b595b20 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dac9f3e396319cd2 server_cookie=50a8a2d29c1221ae in_seq=0 out_seq=0 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f13faffd640 1 -- 172.21.15.53:0/4250680551 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f1410010bd0 con 0x559d6b0f0da0 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f13faffd640 10 client.29740 handle_command_reply: tid=0 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 1 client.29740 shutdown 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 1 -- 172.21.15.53:0/4250680551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 msgr2=0x559d6b51a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 1 --2- 172.21.15.53:0/4250680551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b51a760 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1410015040 tx=0x7f141000bfa0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 1 -- 172.21.15.53:0/4250680551 shutdown_connections 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 1 --2- 172.21.15.53:0/4250680551 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x559d6b0f0da0 0x559d6b595b20 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 1 --2- 172.21.15.53:0/4250680551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559d6b15d070 0x559d6b51b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f13faffd640 0 client.29740 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 1 --2- 172.21.15.53:0/4250680551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d6b13c390 0x559d6b51aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 1 --2- 172.21.15.53:0/4250680551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559d6b1341b0 0x559d6b51a760 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 1 -- 172.21.15.53:0/4250680551 >> 172.21.15.53:0/4250680551 conn(0x559d6b151460 msgr2=0x559d6b508260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:00.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 1 -- 172.21.15.53:0/4250680551 shutdown_connections 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 1 -- 172.21.15.53:0/4250680551 wait complete. 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.898+0000 7f142826a740 20 client.29740 trim_cache size 0 max 16384 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.899+0000 7f1421cf5640 1 -- 172.21.15.53:0/3578785044 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f14040b4d20 msgr2=0x7f14040b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.899+0000 7f1421cf5640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f14040b4d20 0x7f14040b7230 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1414103350 tx=0x7f141402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.899+0000 7f1421cf5640 1 -- 172.21.15.53:0/3578785044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c109ba0 msgr2=0x7f141c19f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.899+0000 7f1421cf5640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c109ba0 0x7f141c19f990 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f1414031040 tx=0x7f1414003f80 comp rx=0 tx=0).stop 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.899+0000 7f1421cf5640 1 -- 172.21.15.53:0/3578785044 shutdown_connections 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.899+0000 7f1421cf5640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f14040b4d20 0x7f14040b7230 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.899+0000 7f1421cf5640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c109ba0 0x7f141c19f990 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.899+0000 7f1421cf5640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f141c109250 0x7f141c19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.899+0000 7f1421cf5640 1 --2- 172.21.15.53:0/3578785044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f141c101d10 0x7f141c19a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.899+0000 7f1421cf5640 1 -- 172.21.15.53:0/3578785044 >> 172.21.15.53:0/3578785044 conn(0x7f141c077a00 msgr2=0x7f141c105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.899+0000 7f1421cf5640 1 -- 172.21.15.53:0/3578785044 shutdown_connections 2024-08-31T06:22:00.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:21:59.900+0000 7f1421cf5640 1 -- 172.21.15.53:0/3578785044 wait complete. 2024-08-31T06:22:00.370 INFO:tasks.workunit.client.0.smithi053.stdout: 10 25833 5.83 MB/sec execute 108 sec latency 93.374 ms 2024-08-31T06:22:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:00 smithi053 ceph-mon[18924]: pgmap v856: 97 pgs: 97 active+clean; 525 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 338 op/s 2024-08-31T06:22:00.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:00 smithi130 ceph-mon[22266]: pgmap v856: 97 pgs: 97 active+clean; 525 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 338 op/s 2024-08-31T06:22:00.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:00 smithi153 ceph-mon[22320]: pgmap v856: 97 pgs: 97 active+clean; 525 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 338 op/s 2024-08-31T06:22:01.370 INFO:tasks.workunit.client.0.smithi053.stdout: 10 25923 5.83 MB/sec execute 109 sec latency 166.794 ms 2024-08-31T06:22:02.370 INFO:tasks.workunit.client.0.smithi053.stdout: 10 26053 5.88 MB/sec execute 110 sec latency 168.037 ms 2024-08-31T06:22:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:02 smithi053 ceph-mon[18924]: pgmap v857: 97 pgs: 97 active+clean; 534 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 354 op/s 2024-08-31T06:22:02.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:02 smithi130 ceph-mon[22266]: pgmap v857: 97 pgs: 97 active+clean; 534 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 354 op/s 2024-08-31T06:22:02.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:02 smithi153 ceph-mon[22320]: pgmap v857: 97 pgs: 97 active+clean; 534 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 354 op/s 2024-08-31T06:22:03.370 INFO:tasks.workunit.client.0.smithi053.stdout: 10 26179 5.91 MB/sec execute 111 sec latency 96.030 ms 2024-08-31T06:22:04.370 INFO:tasks.workunit.client.0.smithi053.stdout: 10 26294 5.92 MB/sec execute 112 sec latency 160.345 ms 2024-08-31T06:22:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:04 smithi053 ceph-mon[18924]: pgmap v858: 97 pgs: 97 active+clean; 538 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 292 op/s 2024-08-31T06:22:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:04 smithi130 ceph-mon[22266]: pgmap v858: 97 pgs: 97 active+clean; 538 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 292 op/s 2024-08-31T06:22:04.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:04 smithi153 ceph-mon[22320]: pgmap v858: 97 pgs: 97 active+clean; 538 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 292 op/s 2024-08-31T06:22:05.371 INFO:tasks.workunit.client.0.smithi053.stdout: 10 26415 5.89 MB/sec execute 113 sec latency 144.533 ms 2024-08-31T06:22:06.371 INFO:tasks.workunit.client.0.smithi053.stdout: 10 26535 5.87 MB/sec execute 114 sec latency 98.621 ms 2024-08-31T06:22:06.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:06 smithi053 ceph-mon[18924]: pgmap v859: 97 pgs: 97 active+clean; 544 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 329 op/s 2024-08-31T06:22:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:06 smithi130 ceph-mon[22266]: pgmap v859: 97 pgs: 97 active+clean; 544 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 329 op/s 2024-08-31T06:22:06.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:06 smithi153 ceph-mon[22320]: pgmap v859: 97 pgs: 97 active+clean; 544 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 329 op/s 2024-08-31T06:22:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.302+0000 7f0d5b539640 1 -- 172.21.15.53:0/1703593535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d541089d0 msgr2=0x7f0d5410f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.302+0000 7f0d5b539640 1 --2- 172.21.15.53:0/1703593535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d541089d0 0x7f0d5410f200 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009ca0 tx=0x7f0d4c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.302+0000 7f0d5b539640 1 -- 172.21.15.53:0/1703593535 shutdown_connections 2024-08-31T06:22:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.302+0000 7f0d5b539640 1 --2- 172.21.15.53:0/1703593535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d541089d0 0x7f0d5410f200 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.302+0000 7f0d5b539640 1 --2- 172.21.15.53:0/1703593535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d54108080 0x7f0d54108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.302+0000 7f0d5b539640 1 --2- 172.21.15.53:0/1703593535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d54102750 0x7f0d54102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.302+0000 7f0d5b539640 1 -- 172.21.15.53:0/1703593535 >> 172.21.15.53:0/1703593535 conn(0x7f0d5407a4e0 msgr2=0x7f0d5407a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.302+0000 7f0d5b539640 1 -- 172.21.15.53:0/1703593535 shutdown_connections 2024-08-31T06:22:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.302+0000 7f0d5b539640 1 -- 172.21.15.53:0/1703593535 wait complete. 2024-08-31T06:22:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.303+0000 7f0d5b539640 1 Processor -- start 2024-08-31T06:22:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.303+0000 7f0d5b539640 1 -- start start 2024-08-31T06:22:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.303+0000 7f0d5b539640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d54102750 0x7f0d5419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.303+0000 7f0d5b539640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d54108080 0x7f0d5419c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.303+0000 7f0d5b539640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d541089d0 0x7f0d541a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.303+0000 7f0d5b539640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541114a0 con 0x7f0d54108080 2024-08-31T06:22:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.303+0000 7f0d5b539640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54111320 con 0x7f0d541089d0 2024-08-31T06:22:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.303+0000 7f0d5b539640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54111620 con 0x7f0d54102750 2024-08-31T06:22:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.304+0000 7f0d592d5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d54102750 0x7f0d5419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.304+0000 7f0d58ad4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d54108080 0x7f0d5419c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.304+0000 7f0d592d5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d54102750 0x7f0d5419c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51330/0 (socket says 172.21.15.53:51330) 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.304+0000 7f0d592d5640 1 -- 172.21.15.53:0/2940804228 learned_addr learned my addr 172.21.15.53:0/2940804228 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.304+0000 7f0d59ad6640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d541089d0 0x7f0d541a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.304+0000 7f0d58ad4640 1 -- 172.21.15.53:0/2940804228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d54102750 msgr2=0x7f0d5419c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.304+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d54102750 0x7f0d5419c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.304+0000 7f0d58ad4640 1 -- 172.21.15.53:0/2940804228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d541089d0 msgr2=0x7f0d541a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.304+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d541089d0 0x7f0d541a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.304+0000 7f0d58ad4640 1 -- 172.21.15.53:0/2940804228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d541a2250 con 0x7f0d54108080 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.304+0000 7f0d59ad6640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d541089d0 0x7f0d541a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.305+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d54108080 0x7f0d5419c9b0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f0d5406c760 tx=0x7f0d4400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.305+0000 7f0d4a7fc640 1 -- 172.21.15.53:0/2940804228 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4400cc40 con 0x7f0d54108080 2024-08-31T06:22:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.305+0000 7f0d4a7fc640 1 -- 172.21.15.53:0/2940804228 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d4400cde0 con 0x7f0d54108080 2024-08-31T06:22:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.305+0000 7f0d4a7fc640 1 -- 172.21.15.53:0/2940804228 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440186f0 con 0x7f0d54108080 2024-08-31T06:22:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.305+0000 7f0d5b539640 1 -- 172.21.15.53:0/2940804228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d541a2540 con 0x7f0d54108080 2024-08-31T06:22:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.305+0000 7f0d5b539640 1 -- 172.21.15.53:0/2940804228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d541a8cd0 con 0x7f0d54108080 2024-08-31T06:22:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d624ac740 1 Processor -- start 2024-08-31T06:22:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d624ac740 1 -- start start 2024-08-31T06:22:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eeb1b0 0x5575f328ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f328f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eca4d0 0x5575f328f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d624ac740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5575f3204000 con 0x5575f2ec22f0 2024-08-31T06:22:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d624ac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5575f31f3590 con 0x5575f2eeb1b0 2024-08-31T06:22:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d624ac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5575f31f7540 con 0x5575f2eca4d0 2024-08-31T06:22:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d592d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f328f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d592d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f328f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52676/0 (socket says 172.21.15.53:52676) 2024-08-31T06:22:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d4a7fc640 1 -- 172.21.15.53:0/2940804228 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0d44018890 con 0x7f0d54108080 2024-08-31T06:22:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.309+0000 7f0d592d5640 1 -- 172.21.15.53:0/1399455393 learned_addr learned my addr 172.21.15.53:0/1399455393 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.310+0000 7f0d59ad6640 1 --2- 172.21.15.53:0/1399455393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eeb1b0 0x5575f328ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.310+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/1399455393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eca4d0 0x5575f328f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.310+0000 7f0d592d5640 1 -- 172.21.15.53:0/1399455393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eca4d0 msgr2=0x5575f328f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.310+0000 7f0d592d5640 1 --2- 172.21.15.53:0/1399455393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eca4d0 0x5575f328f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.310+0000 7f0d592d5640 1 -- 172.21.15.53:0/1399455393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eeb1b0 msgr2=0x5575f328ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.310+0000 7f0d592d5640 1 --2- 172.21.15.53:0/1399455393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eeb1b0 0x5575f328ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.310+0000 7f0d592d5640 1 -- 172.21.15.53:0/1399455393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575f2f56790 con 0x5575f2ec22f0 2024-08-31T06:22:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.310+0000 7f0d59ad6640 1 --2- 172.21.15.53:0/1399455393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eeb1b0 0x5575f328ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.310+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/1399455393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eca4d0 0x5575f328f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.310+0000 7f0d592d5640 1 --2- 172.21.15.53:0/1399455393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f328f220 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009e10 tx=0x7f0d50011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfef85d7ccbdaea1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.311+0000 7f0d3f7fe640 1 -- 172.21.15.53:0/1399455393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5001e070 con 0x5575f2ec22f0 2024-08-31T06:22:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.311+0000 7f0d3f7fe640 1 -- 172.21.15.53:0/1399455393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d50019ac0 con 0x5575f2ec22f0 2024-08-31T06:22:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.311+0000 7f0d3f7fe640 1 -- 172.21.15.53:0/1399455393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000fa70 con 0x5575f2ec22f0 2024-08-31T06:22:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.311+0000 7f0d4a7fc640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d400b4d20 0x7f0d400b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.311+0000 7f0d59ad6640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d400b4d20 0x7f0d400b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.311+0000 7f0d4a7fc640 1 -- 172.21.15.53:0/2940804228 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8601+0+0 (secure 0 0 0) 0x7f0d440e5760 con 0x7f0d54108080 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.312+0000 7f0d624ac740 1 -- 172.21.15.53:0/1399455393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 msgr2=0x5575f328f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.312+0000 7f0d59ad6640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d400b4d20 0x7f0d400b7230 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c006010 tx=0x7f0d4c004a80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.312+0000 7f0d624ac740 1 --2- 172.21.15.53:0/1399455393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f328f220 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009e10 tx=0x7f0d50011810 comp rx=0 tx=0).stop 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.312+0000 7f0d624ac740 1 -- 172.21.15.53:0/1399455393 shutdown_connections 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.312+0000 7f0d624ac740 1 --2- 172.21.15.53:0/1399455393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eca4d0 0x5575f328f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.312+0000 7f0d624ac740 1 --2- 172.21.15.53:0/1399455393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f328f220 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.312+0000 7f0d624ac740 1 --2- 172.21.15.53:0/1399455393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eeb1b0 0x5575f328ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.312+0000 7f0d624ac740 1 -- 172.21.15.53:0/1399455393 >> 172.21.15.53:0/1399455393 conn(0x5575f2edf300 msgr2=0x5575f328cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.312+0000 7f0d624ac740 1 -- 172.21.15.53:0/1399455393 shutdown_connections 2024-08-31T06:22:07.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.312+0000 7f0d624ac740 1 -- 172.21.15.53:0/1399455393 wait complete. 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.313+0000 7f0d624ac740 1 -- start start 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.313+0000 7f0d624ac740 1 Processor -- start 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f329a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eca4d0 0x5575f329ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eeb1b0 0x5575f32a6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d624ac740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5575f312cab0 con 0x5575f2ec22f0 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d624ac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5575f317a680 con 0x5575f2eeb1b0 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d624ac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5575f329d460 con 0x5575f2eca4d0 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d624ac740 10 client.0 _ll_register_callbacks cb 0x5575f2f02a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d592d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f329a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d592d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f329a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52690/0 (socket says 172.21.15.53:52690) 2024-08-31T06:22:07.318 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d592d5640 1 -- 172.21.15.53:0/2172974003 learned_addr learned my addr 172.21.15.53:0/2172974003 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d59ad6640 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eeb1b0 0x5575f32a6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eca4d0 0x5575f329ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d592d5640 1 -- 172.21.15.53:0/2172974003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eca4d0 msgr2=0x5575f329ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d592d5640 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eca4d0 0x5575f329ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d592d5640 1 -- 172.21.15.53:0/2172974003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eeb1b0 msgr2=0x5575f32a6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d592d5640 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eeb1b0 0x5575f32a6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.314+0000 7f0d592d5640 1 -- 172.21.15.53:0/2172974003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575f2fcf620 con 0x5575f2ec22f0 2024-08-31T06:22:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.315+0000 7f0d592d5640 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f329a8f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f0d50019690 tx=0x7f0d500196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b012383338091989 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.315+0000 7f0d3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.315+0000 7f0d3cff9640 1 -- 172.21.15.53:0/2172974003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50026020 con 0x5575f2ec22f0 2024-08-31T06:22:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.315+0000 7f0d624ac740 1 -- 172.21.15.53:0/2172974003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d50019ac0 con 0x5575f2ec22f0 2024-08-31T06:22:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.315+0000 7f0d3cff9640 1 -- 172.21.15.53:0/2172974003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8601+0+0 (secure 0 0 0) 0x7f0d50004440 con 0x5575f2ec22f0 2024-08-31T06:22:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.315+0000 7f0d3cff9640 1 -- 172.21.15.53:0/2172974003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f0d50031050 con 0x5575f2ec22f0 2024-08-31T06:22:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.315+0000 7f0d624ac740 10 client.20856 fetch_fsmap learned FSMap version 60 2024-08-31T06:22:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.315+0000 7f0d624ac740 1 -- 172.21.15.53:0/2172974003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5575f32a9440 con 0x5575f2ec22f0 2024-08-31T06:22:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.316+0000 7f0d3cff9640 1 -- 172.21.15.53:0/2172974003 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d50019ac0 con 0x5575f2ec22f0 2024-08-31T06:22:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.316+0000 7f0d3cff9640 1 -- 172.21.15.53:0/2172974003 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f0d50004970 con 0x5575f2ec22f0 2024-08-31T06:22:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.316+0000 7f0d624ac740 10 client.20856 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.316+0000 7f0d624ac740 10 client.20856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.316+0000 7f0d624ac740 20 client.20856 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.316+0000 7f0d624ac740 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575f2ea9d80 0x5575f32ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.316+0000 7f0d624ac740 4 client.20856 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.316+0000 7f0d624ac740 1 -- 172.21.15.53:0/2172974003 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575f3205f50 con 0x5575f2ea9d80 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.316+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575f2ea9d80 0x5575f32ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.317+0000 7f0d3cff9640 10 client.20856 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.317+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575f2ea9d80 0x5575f32ac800 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daf37ecde44982a0 server_cookie=c77490a54db99bc6 in_seq=0 out_seq=0 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d3cff9640 1 -- 172.21.15.53:0/2172974003 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575f3205f50 con 0x5575f2ea9d80 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d3cff9640 10 client.20856 handle_command_reply: tid=0 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d624ac740 1 client.20856 shutdown 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d624ac740 1 -- 172.21.15.53:0/2172974003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 msgr2=0x5575f329a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d624ac740 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f329a8f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f0d50019690 tx=0x7f0d500196c0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d624ac740 1 -- 172.21.15.53:0/2172974003 shutdown_connections 2024-08-31T06:22:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d624ac740 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575f2ea9d80 0x5575f32ac800 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d624ac740 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eeb1b0 0x5575f32a6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d624ac740 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eca4d0 0x5575f329ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d624ac740 1 --2- 172.21.15.53:0/2172974003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2ec22f0 0x5575f329a8f0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d624ac740 1 -- 172.21.15.53:0/2172974003 >> 172.21.15.53:0/2172974003 conn(0x5575f2edf300 msgr2=0x5575f328fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d3cff9640 0 client.20856 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d624ac740 1 -- 172.21.15.53:0/2172974003 shutdown_connections 2024-08-31T06:22:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.318+0000 7f0d624ac740 1 -- 172.21.15.53:0/2172974003 wait complete. 2024-08-31T06:22:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.319+0000 7f0d624ac740 20 client.20856 trim_cache size 0 max 16384 2024-08-31T06:22:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.345+0000 7f0d624ac740 1 Processor -- start 2024-08-31T06:22:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.345+0000 7f0d624ac740 1 -- start start 2024-08-31T06:22:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.346+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eca4d0 0x5575f329a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.346+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2eeb1b0 0x5575f3290420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.346+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2e7f1c0 0x5575f328c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.346+0000 7f0d624ac740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541b17d0 con 0x5575f2eeb1b0 2024-08-31T06:22:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.346+0000 7f0d624ac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541b3490 con 0x5575f2eca4d0 2024-08-31T06:22:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.346+0000 7f0d624ac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541b1ea0 con 0x5575f2e7f1c0 2024-08-31T06:22:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.346+0000 7f0d592d5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eca4d0 0x5575f329a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.346+0000 7f0d59ad6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2e7f1c0 0x5575f328c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.347+0000 7f0d59ad6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2e7f1c0 0x5575f328c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51352/0 (socket says 172.21.15.53:51352) 2024-08-31T06:22:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.347+0000 7f0d59ad6640 1 -- 172.21.15.53:0/2366941184 learned_addr learned my addr 172.21.15.53:0/2366941184 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.347+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/2366941184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2eeb1b0 0x5575f3290420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.347+0000 7f0d59ad6640 1 -- 172.21.15.53:0/2366941184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eca4d0 msgr2=0x5575f329a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.347+0000 7f0d59ad6640 1 --2- 172.21.15.53:0/2366941184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eca4d0 0x5575f329a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.347+0000 7f0d59ad6640 1 -- 172.21.15.53:0/2366941184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2eeb1b0 msgr2=0x5575f3290420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.347+0000 7f0d59ad6640 1 --2- 172.21.15.53:0/2366941184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2eeb1b0 0x5575f3290420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.347+0000 7f0d59ad6640 1 -- 172.21.15.53:0/2366941184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575f3286980 con 0x5575f2e7f1c0 2024-08-31T06:22:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.347+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/2366941184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2eeb1b0 0x5575f3290420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.348+0000 7f0d59ad6640 1 --2- 172.21.15.53:0/2366941184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2e7f1c0 0x5575f328c180 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009ca0 tx=0x7f0d4c041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f80c7ae21687652 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.348+0000 7f0d3effd640 1 -- 172.21.15.53:0/2366941184 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c031e10 con 0x5575f2e7f1c0 2024-08-31T06:22:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.348+0000 7f0d3effd640 1 -- 172.21.15.53:0/2366941184 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d4c036050 con 0x5575f2e7f1c0 2024-08-31T06:22:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.348+0000 7f0d3effd640 1 -- 172.21.15.53:0/2366941184 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c030740 con 0x5575f2e7f1c0 2024-08-31T06:22:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.350+0000 7f0d624ac740 1 -- 172.21.15.53:0/2366941184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2e7f1c0 msgr2=0x5575f328c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.350+0000 7f0d624ac740 1 --2- 172.21.15.53:0/2366941184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2e7f1c0 0x5575f328c180 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009ca0 tx=0x7f0d4c041000 comp rx=0 tx=0).stop 2024-08-31T06:22:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.350+0000 7f0d624ac740 1 -- 172.21.15.53:0/2366941184 shutdown_connections 2024-08-31T06:22:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.350+0000 7f0d624ac740 1 --2- 172.21.15.53:0/2366941184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2e7f1c0 0x5575f328c180 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.350+0000 7f0d624ac740 1 --2- 172.21.15.53:0/2366941184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2eeb1b0 0x5575f3290420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.350+0000 7f0d624ac740 1 --2- 172.21.15.53:0/2366941184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eca4d0 0x5575f329a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.350+0000 7f0d624ac740 1 -- 172.21.15.53:0/2366941184 >> 172.21.15.53:0/2366941184 conn(0x5575f2edf300 msgr2=0x5575f328fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.350+0000 7f0d624ac740 1 -- 172.21.15.53:0/2366941184 shutdown_connections 2024-08-31T06:22:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.350+0000 7f0d624ac740 1 -- 172.21.15.53:0/2366941184 wait complete. 2024-08-31T06:22:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.351+0000 7f0d624ac740 1 -- start start 2024-08-31T06:22:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.351+0000 7f0d624ac740 1 Processor -- start 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.351+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2e7f1c0 0x5575f32a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eca4d0 0x5575f329e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d624ac740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eeb1b0 0x5575f329e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d624ac740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541b2dc0 con 0x5575f2e7f1c0 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d624ac740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541b2630 con 0x5575f2eca4d0 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d624ac740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541af7d0 con 0x5575f2eeb1b0 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d592d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2e7f1c0 0x5575f32a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d592d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2e7f1c0 0x5575f32a2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52700/0 (socket says 172.21.15.53:52700) 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d592d5640 1 -- 172.21.15.53:0/3048098550 learned_addr learned my addr 172.21.15.53:0/3048098550 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d624ac740 10 client.0 _ll_register_callbacks cb 0x7f0d5001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d59ad6640 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eeb1b0 0x5575f329e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eca4d0 0x5575f329e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d592d5640 1 -- 172.21.15.53:0/3048098550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eeb1b0 msgr2=0x5575f329e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d592d5640 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eeb1b0 0x5575f329e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d592d5640 1 -- 172.21.15.53:0/3048098550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eca4d0 msgr2=0x5575f329e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d592d5640 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eca4d0 0x5575f329e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.352+0000 7f0d592d5640 1 -- 172.21.15.53:0/3048098550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575f329ee70 con 0x5575f2e7f1c0 2024-08-31T06:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.353+0000 7f0d592d5640 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2e7f1c0 0x5575f32a2dd0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f0d50004dc0 tx=0x7f0d5000f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae690c102ba6119 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.353+0000 7f0d3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.353+0000 7f0d3cff9640 1 -- 172.21.15.53:0/3048098550 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50026040 con 0x5575f2e7f1c0 2024-08-31T06:22:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.353+0000 7f0d3cff9640 1 -- 172.21.15.53:0/3048098550 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8601+0+0 (secure 0 0 0) 0x7f0d50004fb0 con 0x5575f2e7f1c0 2024-08-31T06:22:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.353+0000 7f0d624ac740 1 -- 172.21.15.53:0/3048098550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d4c036050 con 0x5575f2e7f1c0 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.354+0000 7f0d3cff9640 1 -- 172.21.15.53:0/3048098550 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f0d5001e040 con 0x5575f2e7f1c0 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.354+0000 7f0d624ac740 10 client.20859 fetch_fsmap learned FSMap version 60 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.354+0000 7f0d624ac740 1 -- 172.21.15.53:0/3048098550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x5575f331f630 con 0x5575f2e7f1c0 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.354+0000 7f0d3cff9640 1 -- 172.21.15.53:0/3048098550 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d4c036050 con 0x5575f2e7f1c0 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.354+0000 7f0d3cff9640 1 -- 172.21.15.53:0/3048098550 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7f0d50019730 con 0x5575f2e7f1c0 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.354+0000 7f0d624ac740 10 client.20859 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.355+0000 7f0d624ac740 10 client.20859 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.355+0000 7f0d624ac740 20 client.20859 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.355+0000 7f0d624ac740 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575f331fe00 0x5575f3322220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.355+0000 7f0d624ac740 4 client.20859 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.355+0000 7f0d624ac740 1 -- 172.21.15.53:0/3048098550 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5575f32019f0 con 0x5575f331fe00 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.355+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575f331fe00 0x5575f3322220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.355+0000 7f0d3cff9640 10 client.20859 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.355+0000 7f0d58ad4640 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575f331fe00 0x5575f3322220 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=251dc03bf3f8eeb7 server_cookie=633c7a9522375c1b in_seq=0 out_seq=0 2024-08-31T06:22:07.371 INFO:tasks.workunit.client.0.smithi053.stdout: 10 26638 5.84 MB/sec execute 115 sec latency 122.130 ms 2024-08-31T06:22:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.448+0000 7f0d3cff9640 1 -- 172.21.15.53:0/3048098550 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5575f32019f0 con 0x5575f331fe00 2024-08-31T06:22:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.448+0000 7f0d3cff9640 10 client.20859 handle_command_reply: tid=0 2024-08-31T06:22:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.448+0000 7f0d624ac740 1 client.20859 shutdown 2024-08-31T06:22:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d624ac740 1 -- 172.21.15.53:0/3048098550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2e7f1c0 msgr2=0x5575f32a2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d624ac740 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2e7f1c0 0x5575f32a2dd0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f0d50004dc0 tx=0x7f0d5000f8f0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d624ac740 1 -- 172.21.15.53:0/3048098550 shutdown_connections 2024-08-31T06:22:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d624ac740 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5575f331fe00 0x5575f3322220 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d624ac740 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5575f2eeb1b0 0x5575f329e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d624ac740 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575f2eca4d0 0x5575f329e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d624ac740 1 --2- 172.21.15.53:0/3048098550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5575f2e7f1c0 0x5575f32a2dd0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d624ac740 1 -- 172.21.15.53:0/3048098550 >> 172.21.15.53:0/3048098550 conn(0x5575f2edf300 msgr2=0x5575f328fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d3cff9640 0 client.20859 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d624ac740 1 -- 172.21.15.53:0/3048098550 shutdown_connections 2024-08-31T06:22:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d624ac740 1 -- 172.21.15.53:0/3048098550 wait complete. 2024-08-31T06:22:07.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.449+0000 7f0d624ac740 20 client.20859 trim_cache size 0 max 16384 2024-08-31T06:22:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:22:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:22:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:22:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:22:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.453+0000 7f0d5b539640 1 -- 172.21.15.53:0/2940804228 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d400b4d20 msgr2=0x7f0d400b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.453+0000 7f0d5b539640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d400b4d20 0x7f0d400b7230 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c006010 tx=0x7f0d4c004a80 comp rx=0 tx=0).stop 2024-08-31T06:22:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.453+0000 7f0d5b539640 1 -- 172.21.15.53:0/2940804228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d54108080 msgr2=0x7f0d5419c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.453+0000 7f0d5b539640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d54108080 0x7f0d5419c9b0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f0d5406c760 tx=0x7f0d4400ee50 comp rx=0 tx=0).stop 2024-08-31T06:22:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.454+0000 7f0d5b539640 1 -- 172.21.15.53:0/2940804228 shutdown_connections 2024-08-31T06:22:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.454+0000 7f0d5b539640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f0d400b4d20 0x7f0d400b7230 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.454+0000 7f0d5b539640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d541089d0 0x7f0d541a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.454+0000 7f0d5b539640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d54108080 0x7f0d5419c9b0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.454+0000 7f0d5b539640 1 --2- 172.21.15.53:0/2940804228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d54102750 0x7f0d5419c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.454+0000 7f0d5b539640 1 -- 172.21.15.53:0/2940804228 >> 172.21.15.53:0/2940804228 conn(0x7f0d5407a4e0 msgr2=0x7f0d540ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.454+0000 7f0d5b539640 1 -- 172.21.15.53:0/2940804228 shutdown_connections 2024-08-31T06:22:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:07.454+0000 7f0d5b539640 1 -- 172.21.15.53:0/2940804228 wait complete. 2024-08-31T06:22:07.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:07 smithi053 ceph-mon[18924]: osdmap e97: 12 total, 12 up, 12 in 2024-08-31T06:22:07.529 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:07 smithi130 ceph-mon[22266]: osdmap e97: 12 total, 12 up, 12 in 2024-08-31T06:22:07.576 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:07 smithi153 ceph-mon[22320]: osdmap e97: 12 total, 12 up, 12 in 2024-08-31T06:22:07.664 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:22:08.056 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:08.371 INFO:tasks.workunit.client.0.smithi053.stdout: 10 26765 5.81 MB/sec execute 116 sec latency 125.533 ms 2024-08-31T06:22:08.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:08 smithi053 ceph-mon[18924]: pgmap v861: 97 pgs: 97 active+clean; 549 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 319 op/s 2024-08-31T06:22:08.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:08 smithi130 ceph-mon[22266]: pgmap v861: 97 pgs: 97 active+clean; 549 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 319 op/s 2024-08-31T06:22:08.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:08 smithi153 ceph-mon[22320]: pgmap v861: 97 pgs: 97 active+clean; 549 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 319 op/s 2024-08-31T06:22:09.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 26894 5.84 MB/sec execute 117 sec latency 219.353 ms 2024-08-31T06:22:10.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 27030 5.85 MB/sec execute 118 sec latency 146.384 ms 2024-08-31T06:22:10.565 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:10 smithi053 ceph-mon[18924]: pgmap v862: 97 pgs: 97 active+clean; 550 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 296 op/s 2024-08-31T06:22:10.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:10 smithi130 ceph-mon[22266]: pgmap v862: 97 pgs: 97 active+clean; 550 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 296 op/s 2024-08-31T06:22:10.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:10 smithi153 ceph-mon[22320]: pgmap v862: 97 pgs: 97 active+clean; 550 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 296 op/s 2024-08-31T06:22:11.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 27150 5.84 MB/sec execute 119 sec latency 132.830 ms 2024-08-31T06:22:12.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 27285 5.85 MB/sec execute 120 sec latency 137.456 ms 2024-08-31T06:22:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:12 smithi130 ceph-mon[22266]: pgmap v863: 97 pgs: 97 active+clean; 557 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 341 op/s 2024-08-31T06:22:12.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:12 smithi153 ceph-mon[22320]: pgmap v863: 97 pgs: 97 active+clean; 557 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 341 op/s 2024-08-31T06:22:12.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.758+0000 7ff5fc845640 1 -- 172.21.15.53:0/1092052162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f8106020 msgr2=0x7ff5f8106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:12.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.758+0000 7ff5fc845640 1 --2- 172.21.15.53:0/1092052162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f8106020 0x7ff5f8106430 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009900 tx=0x7ff5ec02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.758+0000 7ff5fc845640 1 -- 172.21.15.53:0/1092052162 shutdown_connections 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.758+0000 7ff5fc845640 1 --2- 172.21.15.53:0/1092052162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f8106970 0x7ff5f8110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.758+0000 7ff5fc845640 1 --2- 172.21.15.53:0/1092052162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f8106020 0x7ff5f8106430 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.758+0000 7ff5fc845640 1 --2- 172.21.15.53:0/1092052162 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5f8101dd0 0x7ff5f81021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.758+0000 7ff5fc845640 1 -- 172.21.15.53:0/1092052162 >> 172.21.15.53:0/1092052162 conn(0x7ff5f8077a00 msgr2=0x7ff5f8077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.758+0000 7ff5fc845640 1 -- 172.21.15.53:0/1092052162 shutdown_connections 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.758+0000 7ff5fc845640 1 -- 172.21.15.53:0/1092052162 wait complete. 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.760+0000 7ff5fc845640 1 Processor -- start 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.760+0000 7ff5fc845640 1 -- start start 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.760+0000 7ff5fc845640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f8101dd0 0x7ff5f81a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.760+0000 7ff5fc845640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5f8106020 0x7ff5f81a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.760+0000 7ff5fc845640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f8106970 0x7ff5f81ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.760+0000 7ff5fc845640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81136f0 con 0x7ff5f8106970 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.760+0000 7ff5fc845640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f8113570 con 0x7ff5f8106020 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.760+0000 7ff5fc845640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f8113870 con 0x7ff5f8101dd0 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f8101dd0 0x7ff5f81a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5f8106020 0x7ff5f81a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5f8106020 0x7ff5f81a18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:45332/0 (socket says 172.21.15.53:45332) 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f8101dd0 0x7ff5f81a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51378/0 (socket says 172.21.15.53:51378) 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f5d9b640 1 -- 172.21.15.53:0/2074871432 learned_addr learned my addr 172.21.15.53:0/2074871432 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f6d9d640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f8106970 0x7ff5f81ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f5d9b640 1 -- 172.21.15.53:0/2074871432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f8101dd0 msgr2=0x7ff5f81a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f5d9b640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f8101dd0 0x7ff5f81a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f5d9b640 1 -- 172.21.15.53:0/2074871432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f8106970 msgr2=0x7ff5f81ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f5d9b640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f8106970 0x7ff5f81ac430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f5d9b640 1 -- 172.21.15.53:0/2074871432 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f81ac970 con 0x7ff5f8106020 2024-08-31T06:22:12.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.761+0000 7ff5f5d9b640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5f8106020 0x7ff5f81a18f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec005940 tx=0x7ff5ec032f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.762+0000 7ff5e77fe640 1 -- 172.21.15.53:0/2074871432 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec03f030 con 0x7ff5f8106020 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.762+0000 7ff5fc845640 1 -- 172.21.15.53:0/2074871432 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f81acb40 con 0x7ff5f8106020 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.762+0000 7ff5e77fe640 1 -- 172.21.15.53:0/2074871432 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5ec0043d0 con 0x7ff5f8106020 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.762+0000 7ff5e77fe640 1 -- 172.21.15.53:0/2074871432 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec035070 con 0x7ff5f8106020 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.762+0000 7ff5fc845640 1 -- 172.21.15.53:0/2074871432 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f81acf90 con 0x7ff5f8106020 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.765+0000 7ff602dba740 1 Processor -- start 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.765+0000 7ff602dba740 1 -- start start 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.766+0000 7ff602dba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bc9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.766+0000 7ff602dba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bc9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.766+0000 7ff5f6d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bc9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.766+0000 7ff602dba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bc9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.766+0000 7ff602dba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cd73b40680 con 0x55cd737fb1b0 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.766+0000 7ff602dba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cd73b2fc10 con 0x55cd73803390 2024-08-31T06:22:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.766+0000 7ff602dba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd73b33bc0 con 0x55cd73824070 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.766+0000 7ff5f6d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bc9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51392/0 (socket says 172.21.15.53:51392) 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.766+0000 7ff5f6d9d640 1 -- 172.21.15.53:0/3771123459 learned_addr learned my addr 172.21.15.53:0/3771123459 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.766+0000 7ff5f659c640 1 --2- 172.21.15.53:0/3771123459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bc9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.766+0000 7ff5e77fe640 1 -- 172.21.15.53:0/2074871432 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff5ec042030 con 0x7ff5f8106020 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.767+0000 7ff5f6d9d640 1 -- 172.21.15.53:0/3771123459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 msgr2=0x55cd73bc9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.767+0000 7ff5f5d9b640 1 --2- 172.21.15.53:0/3771123459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bc9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.767+0000 7ff5f6d9d640 1 --2- 172.21.15.53:0/3771123459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bc9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.767+0000 7ff5f6d9d640 1 -- 172.21.15.53:0/3771123459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 msgr2=0x55cd73bc9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.767+0000 7ff5f6d9d640 1 --2- 172.21.15.53:0/3771123459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bc9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.767+0000 7ff5f6d9d640 1 -- 172.21.15.53:0/3771123459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd7388f650 con 0x55cd73824070 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.767+0000 7ff5f659c640 1 --2- 172.21.15.53:0/3771123459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bc9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.767+0000 7ff5f6d9d640 1 --2- 172.21.15.53:0/3771123459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bc9350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009fd0 tx=0x7ff5f00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d390cd724100641a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.768+0000 7ff5e4ff9640 1 -- 172.21.15.53:0/3771123459 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0004d20 con 0x55cd73824070 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.768+0000 7ff5e4ff9640 1 -- 172.21.15.53:0/3771123459 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5f0004050 con 0x55cd73824070 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.768+0000 7ff5e77fe640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5e00b4d20 0x7ff5e00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.768+0000 7ff5e77fe640 1 -- 172.21.15.53:0/2074871432 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8601+0+0 (secure 0 0 0) 0x7ff5ec105880 con 0x7ff5f8106020 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.768+0000 7ff5f659c640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5e00b4d20 0x7ff5e00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.768+0000 7ff5e4ff9640 1 -- 172.21.15.53:0/3771123459 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0005260 con 0x55cd73824070 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.769+0000 7ff5f659c640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5e00b4d20 0x7ff5e00b7230 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55cd73bc7fd0 tx=0x7ff5e8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.769+0000 7ff602dba740 1 -- 172.21.15.53:0/3771123459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 msgr2=0x55cd73bc9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.769+0000 7ff602dba740 1 --2- 172.21.15.53:0/3771123459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bc9350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009fd0 tx=0x7ff5f00118d0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.769+0000 7ff602dba740 1 -- 172.21.15.53:0/3771123459 shutdown_connections 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.769+0000 7ff602dba740 1 --2- 172.21.15.53:0/3771123459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bc9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.769+0000 7ff602dba740 1 --2- 172.21.15.53:0/3771123459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bc9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.769+0000 7ff602dba740 1 --2- 172.21.15.53:0/3771123459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bc9350 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.769+0000 7ff602dba740 1 -- 172.21.15.53:0/3771123459 >> 172.21.15.53:0/3771123459 conn(0x55cd73818460 msgr2=0x55cd73bc7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.769+0000 7ff602dba740 1 -- 172.21.15.53:0/3771123459 shutdown_connections 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.769+0000 7ff602dba740 1 -- 172.21.15.53:0/3771123459 wait complete. 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff602dba740 1 -- start start 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff602dba740 1 Processor -- start 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff602dba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bd4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff602dba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bd4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff602dba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73be0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff602dba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cd73992700 con 0x55cd737fb1b0 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff602dba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cd73ab6750 con 0x55cd73803390 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff602dba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd73bd7bd0 con 0x55cd73824070 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff5f659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bd4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff602dba740 10 client.0 _ll_register_callbacks cb 0x55cd73ae5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff5f659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bd4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52744/0 (socket says 172.21.15.53:52744) 2024-08-31T06:22:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff5f659c640 1 -- 172.21.15.53:0/2593471571 learned_addr learned my addr 172.21.15.53:0/2593471571 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff5f6d9d640 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73be0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.770+0000 7ff5f5d9b640 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bd4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff5f6d9d640 1 -- 172.21.15.53:0/2593471571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 msgr2=0x55cd73bd4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff5f6d9d640 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bd4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff5f6d9d640 1 -- 172.21.15.53:0/2593471571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 msgr2=0x55cd73bd4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff5f6d9d640 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bd4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff5f6d9d640 1 -- 172.21.15.53:0/2593471571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd73aef900 con 0x55cd73824070 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff5f659c640 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bd4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff5f6d9d640 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73be0ef0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0005c40 tx=0x7ff5f0004cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c16a6babdddf38f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff5ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff5ddffb640 1 -- 172.21.15.53:0/2593471571 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0028020 con 0x55cd73824070 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff5ddffb640 1 -- 172.21.15.53:0/2593471571 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8601+0+0 (secure 0 0 0) 0x7ff5f0003c40 con 0x55cd73824070 2024-08-31T06:22:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff602dba740 1 -- 172.21.15.53:0/2593471571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5f0004050 con 0x55cd73824070 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff5ddffb640 1 -- 172.21.15.53:0/2593471571 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7ff5f0033050 con 0x55cd73824070 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff602dba740 10 client.29767 fetch_fsmap learned FSMap version 60 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.771+0000 7ff602dba740 1 -- 172.21.15.53:0/2593471571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55cd73be38d0 con 0x55cd73824070 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.772+0000 7ff5ddffb640 1 -- 172.21.15.53:0/2593471571 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5f0004050 con 0x55cd73824070 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.772+0000 7ff5ddffb640 1 -- 172.21.15.53:0/2593471571 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7ff5f000f4e0 con 0x55cd73824070 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.772+0000 7ff602dba740 10 client.29767 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.772+0000 7ff602dba740 10 client.29767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.772+0000 7ff602dba740 20 client.29767 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.772+0000 7ff602dba740 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cd737e29f0 0x55cd73be6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.772+0000 7ff602dba740 4 client.29767 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.772+0000 7ff602dba740 1 -- 172.21.15.53:0/2593471571 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd73b425d0 con 0x55cd737e29f0 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.772+0000 7ff5f659c640 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cd737e29f0 0x55cd73be6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.773+0000 7ff5ddffb640 10 client.29767 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.773+0000 7ff5f659c640 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cd737e29f0 0x55cd73be6d40 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f251e2a172a7f1e1 server_cookie=bde9f6d09ef11b69 in_seq=0 out_seq=0 2024-08-31T06:22:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.773+0000 7ff5ddffb640 1 -- 172.21.15.53:0/2593471571 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd73b425d0 con 0x55cd737e29f0 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.773+0000 7ff5ddffb640 10 client.29767 handle_command_reply: tid=0 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.773+0000 7ff602dba740 1 client.29767 shutdown 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.773+0000 7ff602dba740 1 -- 172.21.15.53:0/2593471571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 msgr2=0x55cd73be0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.773+0000 7ff602dba740 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73be0ef0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0005c40 tx=0x7ff5f0004cf0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.773+0000 7ff602dba740 1 -- 172.21.15.53:0/2593471571 shutdown_connections 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.773+0000 7ff602dba740 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cd737e29f0 0x55cd73be6d40 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.773+0000 7ff602dba740 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73be0ef0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.773+0000 7ff602dba740 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bd4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.774+0000 7ff5ddffb640 0 client.29767 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.774+0000 7ff602dba740 1 --2- 172.21.15.53:0/2593471571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bd4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.774+0000 7ff602dba740 1 -- 172.21.15.53:0/2593471571 >> 172.21.15.53:0/2593471571 conn(0x55cd73818460 msgr2=0x55cd73bcc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.774+0000 7ff602dba740 1 -- 172.21.15.53:0/2593471571 shutdown_connections 2024-08-31T06:22:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.774+0000 7ff602dba740 1 -- 172.21.15.53:0/2593471571 wait complete. 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.774+0000 7ff602dba740 20 client.29767 trim_cache size 0 max 16384 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.787+0000 7ff602dba740 1 Processor -- start 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.787+0000 7ff602dba740 1 -- start start 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.787+0000 7ff602dba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd737fb1b0 0x55cd73bd50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.787+0000 7ff602dba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd73803390 0x55cd73be0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.787+0000 7ff602dba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bcc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.787+0000 7ff602dba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81af690 con 0x55cd73803390 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.787+0000 7ff602dba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81ad300 con 0x55cd737fb1b0 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.787+0000 7ff602dba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81aefc0 con 0x55cd73824070 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.787+0000 7ff5f5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd73803390 0x55cd73be0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.787+0000 7ff5f5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd73803390 0x55cd73be0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52750/0 (socket says 172.21.15.53:52750) 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.787+0000 7ff5f5d9b640 1 -- 172.21.15.53:0/3216722955 learned_addr learned my addr 172.21.15.53:0/3216722955 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.788+0000 7ff5f659c640 1 --2- 172.21.15.53:0/3216722955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd737fb1b0 0x55cd73bd50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.788+0000 7ff5f5d9b640 1 -- 172.21.15.53:0/3216722955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 msgr2=0x55cd73bcc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.788+0000 7ff5f6d9d640 1 --2- 172.21.15.53:0/3216722955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bcc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.788+0000 7ff5f5d9b640 1 --2- 172.21.15.53:0/3216722955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bcc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.788+0000 7ff5f5d9b640 1 -- 172.21.15.53:0/3216722955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd737fb1b0 msgr2=0x55cd73bd50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.788+0000 7ff5f5d9b640 1 --2- 172.21.15.53:0/3216722955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd737fb1b0 0x55cd73bd50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.788+0000 7ff5f5d9b640 1 -- 172.21.15.53:0/3216722955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd73bcbf90 con 0x55cd73803390 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.788+0000 7ff5f5d9b640 1 --2- 172.21.15.53:0/3216722955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd73803390 0x55cd73be0df0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0cbc70 tx=0x7ff5ec02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb2fc42b6d4fe93 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.788+0000 7ff5dffff640 1 -- 172.21.15.53:0/3216722955 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec049040 con 0x55cd73803390 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.788+0000 7ff5dffff640 1 -- 172.21.15.53:0/3216722955 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5ec0d0730 con 0x55cd73803390 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.788+0000 7ff5dffff640 1 -- 172.21.15.53:0/3216722955 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec108e60 con 0x55cd73803390 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.789+0000 7ff602dba740 1 -- 172.21.15.53:0/3216722955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd73803390 msgr2=0x55cd73be0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.789+0000 7ff602dba740 1 --2- 172.21.15.53:0/3216722955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd73803390 0x55cd73be0df0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0cbc70 tx=0x7ff5ec02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.789+0000 7ff602dba740 1 -- 172.21.15.53:0/3216722955 shutdown_connections 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.789+0000 7ff602dba740 1 --2- 172.21.15.53:0/3216722955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bcc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.789+0000 7ff602dba740 1 --2- 172.21.15.53:0/3216722955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd73803390 0x55cd73be0df0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.789+0000 7ff602dba740 1 --2- 172.21.15.53:0/3216722955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd737fb1b0 0x55cd73bd50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.789+0000 7ff602dba740 1 -- 172.21.15.53:0/3216722955 >> 172.21.15.53:0/3216722955 conn(0x55cd73818460 msgr2=0x55cd73bd49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.789+0000 7ff602dba740 1 -- 172.21.15.53:0/3216722955 shutdown_connections 2024-08-31T06:22:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.789+0000 7ff602dba740 1 -- 172.21.15.53:0/3216722955 wait complete. 2024-08-31T06:22:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.789+0000 7ff602dba740 1 -- start start 2024-08-31T06:22:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.789+0000 7ff602dba740 1 Processor -- start 2024-08-31T06:22:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff602dba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bdd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff602dba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bd8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff602dba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bd8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff602dba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81ae160 con 0x55cd737fb1b0 2024-08-31T06:22:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff602dba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81ad9d0 con 0x55cd73803390 2024-08-31T06:22:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff602dba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81ae8f0 con 0x55cd73824070 2024-08-31T06:22:12.708 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:12 smithi053 ceph-mon[18924]: pgmap v863: 97 pgs: 97 active+clean; 557 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 341 op/s 2024-08-31T06:22:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff602dba740 10 client.0 _ll_register_callbacks cb 0x7ff5e80097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bdd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bdd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52756/0 (socket says 172.21.15.53:52756) 2024-08-31T06:22:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f659c640 1 -- 172.21.15.53:0/3249735090 learned_addr learned my addr 172.21.15.53:0/3249735090 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f5d9b640 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bd8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f6d9d640 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bd8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f659c640 1 -- 172.21.15.53:0/3249735090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 msgr2=0x55cd73bd8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f659c640 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bd8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f659c640 1 -- 172.21.15.53:0/3249735090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 msgr2=0x55cd73bd8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f659c640 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bd8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f659c640 1 -- 172.21.15.53:0/3249735090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd73bd95e0 con 0x55cd737fb1b0 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f6d9d640 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bd8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5f659c640 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bdd550 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x55cd73be7310 tx=0x7ff5e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a5e64fded4643 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5ddffb640 1 -- 172.21.15.53:0/3249735090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8005020 con 0x55cd737fb1b0 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff602dba740 1 -- 172.21.15.53:0/3249735090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5ec0d0730 con 0x55cd737fb1b0 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.790+0000 7ff5ddffb640 1 -- 172.21.15.53:0/3249735090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8601+0+0 (secure 0 0 0) 0x7ff5e80051c0 con 0x55cd737fb1b0 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff5ddffb640 1 -- 172.21.15.53:0/3249735090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7ff5e80053c0 con 0x55cd737fb1b0 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff602dba740 10 client.20877 fetch_fsmap learned FSMap version 60 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff602dba740 1 -- 172.21.15.53:0/3249735090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x55cd73c51420 con 0x55cd737fb1b0 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff5ddffb640 1 -- 172.21.15.53:0/3249735090 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5ec0d0730 con 0x55cd737fb1b0 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff5ddffb640 1 -- 172.21.15.53:0/3249735090 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) ==== 8394+0+0 (secure 0 0 0) 0x7ff5e804a580 con 0x55cd737fb1b0 2024-08-31T06:22:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff602dba740 10 client.20877 fetch_fsmap finished waiting for FSMap version 60 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff602dba740 10 client.20877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff602dba740 20 client.20877 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff602dba740 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cd737b7da0 0x55cd73c53bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff602dba740 4 client.20877 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff602dba740 1 -- 172.21.15.53:0/3249735090 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd73b3e070 con 0x55cd737b7da0 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff5f5d9b640 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cd737b7da0 0x55cd73c53bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff5ddffb640 10 client.20877 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.791+0000 7ff5f5d9b640 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cd737b7da0 0x55cd73c53bb0 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aca11514d45c9556 server_cookie=eec54a0bf9ee8da in_seq=0 out_seq=0 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff5ddffb640 1 -- 172.21.15.53:0/3249735090 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd73b3e070 con 0x55cd737b7da0 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff5ddffb640 10 client.20877 handle_command_reply: tid=0 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 1 client.20877 shutdown 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 1 -- 172.21.15.53:0/3249735090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 msgr2=0x55cd73bdd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bdd550 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x55cd73be7310 tx=0x7ff5e80046c0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 1 -- 172.21.15.53:0/3249735090 shutdown_connections 2024-08-31T06:22:12.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cd737b7da0 0x55cd73c53bb0 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff5ddffb640 0 client.20877 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:12.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd73824070 0x55cd73bd8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd73803390 0x55cd73bd8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.712 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:22:12.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 1 --2- 172.21.15.53:0/3249735090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd737fb1b0 0x55cd73bdd550 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 1 -- 172.21.15.53:0/3249735090 >> 172.21.15.53:0/3249735090 conn(0x55cd73818460 msgr2=0x55cd73bcc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:12.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 1 -- 172.21.15.53:0/3249735090 shutdown_connections 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 1 -- 172.21.15.53:0/3249735090 wait complete. 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.792+0000 7ff602dba740 20 client.20877 trim_cache size 0 max 16384 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 -- 172.21.15.53:0/2074871432 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5e00b4d20 msgr2=0x7ff5e00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5e00b4d20 0x7ff5e00b7230 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55cd73bc7fd0 tx=0x7ff5e8005f90 comp rx=0 tx=0).stop 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 -- 172.21.15.53:0/2074871432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5f8106020 msgr2=0x7ff5f81a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5f8106020 0x7ff5f81a18f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec005940 tx=0x7ff5ec032f90 comp rx=0 tx=0).stop 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 -- 172.21.15.53:0/2074871432 shutdown_connections 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff5e00b4d20 0x7ff5e00b7230 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f8106970 0x7ff5f81ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5f8106020 0x7ff5f81a18f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 --2- 172.21.15.53:0/2074871432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5f8101dd0 0x7ff5f81a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 -- 172.21.15.53:0/2074871432 >> 172.21.15.53:0/2074871432 conn(0x7ff5f8077a00 msgr2=0x7ff5f8107170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:12.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 -- 172.21.15.53:0/2074871432 shutdown_connections 2024-08-31T06:22:12.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:11.793+0000 7ff5fc845640 1 -- 172.21.15.53:0/2074871432 wait complete. 2024-08-31T06:22:13.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 27450 5.88 MB/sec execute 121 sec latency 97.509 ms 2024-08-31T06:22:13.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:13 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:13.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:13 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:13.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:13 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:14.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 27621 5.90 MB/sec execute 122 sec latency 145.790 ms 2024-08-31T06:22:14.592 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:22:14.593 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:22:14.622 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:14 smithi053 ceph-mon[18924]: pgmap v864: 97 pgs: 97 active+clean; 562 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 377 op/s 2024-08-31T06:22:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:14 smithi130 ceph-mon[22266]: pgmap v864: 97 pgs: 97 active+clean; 562 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 377 op/s 2024-08-31T06:22:14.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:14 smithi153 ceph-mon[22320]: pgmap v864: 97 pgs: 97 active+clean; 562 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 377 op/s 2024-08-31T06:22:14.944 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:15.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 27762 5.88 MB/sec execute 123 sec latency 76.046 ms 2024-08-31T06:22:15.416 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:15 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:15.416 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:15 smithi053 ceph-mon[18924]: osdmap e98: 12 total, 12 up, 12 in 2024-08-31T06:22:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.546+0000 7f5deed36640 1 -- 172.21.15.53:0/4117049145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de8102800 msgr2=0x7f5de8102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.546+0000 7f5deed36640 1 --2- 172.21.15.53:0/4117049145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de8102800 0x7f5de8102c10 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009900 tx=0x7f5ddc02a410 comp rx=0 tx=0).stop 2024-08-31T06:22:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.547+0000 7f5deed36640 1 -- 172.21.15.53:0/4117049145 shutdown_connections 2024-08-31T06:22:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.547+0000 7f5deed36640 1 --2- 172.21.15.53:0/4117049145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5de8108a90 0x7f5de810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.547+0000 7f5deed36640 1 --2- 172.21.15.53:0/4117049145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5de8108140 0x7f5de8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.547+0000 7f5deed36640 1 --2- 172.21.15.53:0/4117049145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de8102800 0x7f5de8102c10 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.547+0000 7f5deed36640 1 -- 172.21.15.53:0/4117049145 >> 172.21.15.53:0/4117049145 conn(0x7f5de80794d0 msgr2=0x7f5de80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.547+0000 7f5deed36640 1 -- 172.21.15.53:0/4117049145 shutdown_connections 2024-08-31T06:22:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.547+0000 7f5deed36640 1 -- 172.21.15.53:0/4117049145 wait complete. 2024-08-31T06:22:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5deed36640 1 Processor -- start 2024-08-31T06:22:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5deed36640 1 -- start start 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5deed36640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5de8102800 0x7f5de819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5deed36640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5de8108140 0x7f5de819c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5deed36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de8108a90 0x7f5de81a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5deed36640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5de8112610 con 0x7f5de8108a90 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5deed36640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5de8112490 con 0x7f5de8102800 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5deed36640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5de8112790 con 0x7f5de8108140 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5decad2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5de8102800 0x7f5de819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5de7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5de8108140 0x7f5de819c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5decad2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5de8102800 0x7f5de819c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52608/0 (socket says 172.21.15.53:52608) 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5de7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5de8108140 0x7f5de819c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:32770/0 (socket says 172.21.15.53:32770) 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5decad2640 1 -- 172.21.15.53:0/786905101 learned_addr learned my addr 172.21.15.53:0/786905101 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.548+0000 7f5ded2d3640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de8108a90 0x7f5de81a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.549+0000 7f5ded2d3640 1 -- 172.21.15.53:0/786905101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5de8108140 msgr2=0x7f5de819c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.549+0000 7f5ded2d3640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5de8108140 0x7f5de819c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.549+0000 7f5ded2d3640 1 -- 172.21.15.53:0/786905101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5de8102800 msgr2=0x7f5de819c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.549+0000 7f5ded2d3640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5de8102800 0x7f5de819c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.549+0000 7f5ded2d3640 1 -- 172.21.15.53:0/786905101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de81a2320 con 0x7f5de8108a90 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.549+0000 7f5de7fff640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5de8108140 0x7f5de819c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.549+0000 7f5decad2640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5de8102800 0x7f5de819c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.549+0000 7f5ded2d3640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de8108a90 0x7f5de81a1bf0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009fd0 tx=0x7f5de000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.550+0000 7f5de5ffb640 1 -- 172.21.15.53:0/786905101 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de000ce20 con 0x7f5de8108a90 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.550+0000 7f5de5ffb640 1 -- 172.21.15.53:0/786905101 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5de0005020 con 0x7f5de8108a90 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.550+0000 7f5de5ffb640 1 -- 172.21.15.53:0/786905101 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0010690 con 0x7f5de8108a90 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.550+0000 7f5deed36640 1 -- 172.21.15.53:0/786905101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de81a2610 con 0x7f5de8108a90 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.551+0000 7f5deed36640 1 -- 172.21.15.53:0/786905101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de81a8d70 con 0x7f5de8108a90 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.554+0000 7f5de5ffb640 1 -- 172.21.15.53:0/786905101 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5de0004a40 con 0x7f5de8108a90 2024-08-31T06:22:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.554+0000 7f5df52ab740 1 Processor -- start 2024-08-31T06:22:15.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5df52ab740 1 -- start start 2024-08-31T06:22:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5de5ffb640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dd80b4d20 0x7f5dd80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a36e350 0x55609a714780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a714cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a715200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5df52ab740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55609a68a5f0 con 0x55609a34d670 2024-08-31T06:22:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5df52ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55609a679b80 con 0x55609a345490 2024-08-31T06:22:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5df52ab740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55609a67db30 con 0x55609a36e350 2024-08-31T06:22:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5de7fff640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dd80b4d20 0x7f5dd80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5de7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a714cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5de7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a714cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52624/0 (socket says 172.21.15.53:52624) 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5de7fff640 1 -- 172.21.15.53:0/2423894247 learned_addr learned my addr 172.21.15.53:0/2423894247 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5ded2d3640 1 --2- 172.21.15.53:0/2423894247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a715200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.555+0000 7f5decad2640 1 --2- 172.21.15.53:0/2423894247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a36e350 0x55609a714780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5de5ffb640 1 -- 172.21.15.53:0/786905101 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f5de00e57e0 con 0x7f5de8108a90 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5decad2640 1 -- 172.21.15.53:0/2423894247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 msgr2=0x55609a714cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5decad2640 1 --2- 172.21.15.53:0/2423894247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a714cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5decad2640 1 -- 172.21.15.53:0/2423894247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 msgr2=0x55609a715200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5decad2640 1 --2- 172.21.15.53:0/2423894247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a715200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5decad2640 1 -- 172.21.15.53:0/2423894247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55609a3d9930 con 0x55609a36e350 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5de7fff640 1 --2- 172.21.15.53:0/2423894247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a714cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5de7fff640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dd80b4d20 0x7f5dd80b7230 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40058c0 tx=0x7f5dd4009f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5decad2640 1 --2- 172.21.15.53:0/2423894247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a36e350 0x55609a714780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc006010 tx=0x7f5ddc004480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=150ea90c96be9a5d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5dd2ffd640 1 -- 172.21.15.53:0/2423894247 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc040070 con 0x55609a36e350 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5dd2ffd640 1 -- 172.21.15.53:0/2423894247 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ddc003c80 con 0x55609a36e350 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.556+0000 7f5dd2ffd640 1 -- 172.21.15.53:0/2423894247 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc035040 con 0x55609a36e350 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.558+0000 7f5df52ab740 1 -- 172.21.15.53:0/2423894247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a36e350 msgr2=0x55609a714780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.558+0000 7f5df52ab740 1 --2- 172.21.15.53:0/2423894247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a36e350 0x55609a714780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc006010 tx=0x7f5ddc004480 comp rx=0 tx=0).stop 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.558+0000 7f5df52ab740 1 -- 172.21.15.53:0/2423894247 shutdown_connections 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.558+0000 7f5df52ab740 1 --2- 172.21.15.53:0/2423894247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a715200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.558+0000 7f5df52ab740 1 --2- 172.21.15.53:0/2423894247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a714cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.558+0000 7f5df52ab740 1 --2- 172.21.15.53:0/2423894247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a36e350 0x55609a714780 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.558+0000 7f5df52ab740 1 -- 172.21.15.53:0/2423894247 >> 172.21.15.53:0/2423894247 conn(0x55609a362740 msgr2=0x55609a712670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.558+0000 7f5df52ab740 1 -- 172.21.15.53:0/2423894247 shutdown_connections 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.558+0000 7f5df52ab740 1 -- 172.21.15.53:0/2423894247 wait complete. 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.558+0000 7f5df52ab740 1 -- start start 2024-08-31T06:22:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.559+0000 7f5df52ab740 1 Processor -- start 2024-08-31T06:22:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.559+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a71ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.559+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a720490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.559+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a36e350 0x55609a72c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.559+0000 7f5df52ab740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55609a4dc890 con 0x55609a34d670 2024-08-31T06:22:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.559+0000 7f5df52ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55609a600790 con 0x55609a345490 2024-08-31T06:22:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.559+0000 7f5df52ab740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55609a722f00 con 0x55609a36e350 2024-08-31T06:22:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.559+0000 7f5df52ab740 10 client.0 _ll_register_callbacks cb 0x55609a385ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5de7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a720490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5de7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a720490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48132/0 (socket says 172.21.15.53:48132) 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5de7fff640 1 -- 172.21.15.53:0/4208878559 learned_addr learned my addr 172.21.15.53:0/4208878559 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5decad2640 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a71ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5ded2d3640 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a36e350 0x55609a72c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5de7fff640 1 -- 172.21.15.53:0/4208878559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a36e350 msgr2=0x55609a72c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5de7fff640 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a36e350 0x55609a72c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5de7fff640 1 -- 172.21.15.53:0/4208878559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 msgr2=0x55609a71ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5de7fff640 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a71ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5de7fff640 1 -- 172.21.15.53:0/4208878559 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55609a637f30 con 0x55609a34d670 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5decad2640 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a71ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.560+0000 7f5de7fff640 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a720490 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4004500 tx=0x7f5dd4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c933831404fa7ea7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.561+0000 7f5dc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.561+0000 7f5dc7fff640 1 -- 172.21.15.53:0/4208878559 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4024070 con 0x55609a34d670 2024-08-31T06:22:15.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.561+0000 7f5dc7fff640 1 -- 172.21.15.53:0/4208878559 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f5dd40203f0 con 0x55609a34d670 2024-08-31T06:22:15.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.561+0000 7f5df52ab740 1 -- 172.21.15.53:0/4208878559 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ddc003c80 con 0x55609a34d670 2024-08-31T06:22:15.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.561+0000 7f5dc7fff640 1 -- 172.21.15.53:0/4208878559 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f5dd40205f0 con 0x55609a34d670 2024-08-31T06:22:15.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.561+0000 7f5df52ab740 10 client.20889 fetch_fsmap learned FSMap version 62 2024-08-31T06:22:15.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.561+0000 7f5df52ab740 1 -- 172.21.15.53:0/4208878559 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55609a72ed30 con 0x55609a34d670 2024-08-31T06:22:15.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.562+0000 7f5dc7fff640 1 -- 172.21.15.53:0/4208878559 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ddc003c80 con 0x55609a34d670 2024-08-31T06:22:15.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.562+0000 7f5dc7fff640 1 -- 172.21.15.53:0/4208878559 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) ==== 8390+0+0 (secure 0 0 0) 0x7f5dd4029550 con 0x55609a34d670 2024-08-31T06:22:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.562+0000 7f5df52ab740 10 client.20889 fetch_fsmap finished waiting for FSMap version 62 2024-08-31T06:22:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.562+0000 7f5df52ab740 10 client.20889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.562+0000 7f5df52ab740 20 client.20889 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.562+0000 7f5df52ab740 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609a32ccd0 0x55609a732250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.562+0000 7f5df52ab740 4 client.20889 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.562+0000 7f5df52ab740 1 -- 172.21.15.53:0/4208878559 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55609a68c540 con 0x55609a32ccd0 2024-08-31T06:22:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.565+0000 7f5decad2640 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609a32ccd0 0x55609a732250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.566+0000 7f5dc7fff640 10 client.20889 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.566+0000 7f5decad2640 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609a32ccd0 0x55609a732250 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b363e325f829222 server_cookie=d98d91f2d49ef8e3 in_seq=0 out_seq=0 2024-08-31T06:22:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.569+0000 7f5dc7fff640 1 -- 172.21.15.53:0/4208878559 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55609a68c540 con 0x55609a32ccd0 2024-08-31T06:22:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.569+0000 7f5dc7fff640 10 client.20889 handle_command_reply: tid=0 2024-08-31T06:22:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.569+0000 7f5df52ab740 1 client.20889 shutdown 2024-08-31T06:22:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.570+0000 7f5df52ab740 1 -- 172.21.15.53:0/4208878559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 msgr2=0x55609a720490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.570+0000 7f5df52ab740 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a720490 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4004500 tx=0x7f5dd4005f90 comp rx=0 tx=0).stop 2024-08-31T06:22:15.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.570+0000 7f5df52ab740 1 -- 172.21.15.53:0/4208878559 shutdown_connections 2024-08-31T06:22:15.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.571+0000 7f5df52ab740 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609a32ccd0 0x55609a732250 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.571+0000 7f5dc7fff640 0 client.20889 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:15.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.571+0000 7f5df52ab740 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a36e350 0x55609a72c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.571+0000 7f5df52ab740 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a720490 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.571+0000 7f5df52ab740 1 --2- 172.21.15.53:0/4208878559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a71ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.571+0000 7f5df52ab740 1 -- 172.21.15.53:0/4208878559 >> 172.21.15.53:0/4208878559 conn(0x55609a362740 msgr2=0x55609a717910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:15.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.571+0000 7f5df52ab740 1 -- 172.21.15.53:0/4208878559 shutdown_connections 2024-08-31T06:22:15.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.571+0000 7f5df52ab740 1 -- 172.21.15.53:0/4208878559 wait complete. 2024-08-31T06:22:15.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.571+0000 7f5df52ab740 20 client.20889 trim_cache size 0 max 16384 2024-08-31T06:22:15.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.600+0000 7f5df52ab740 1 Processor -- start 2024-08-31T06:22:15.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.600+0000 7f5df52ab740 1 -- start start 2024-08-31T06:22:15.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.600+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a32ccd0 0x55609a71b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.600+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a717f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.600+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a72c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.600+0000 7f5df52ab740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5de81b1730 con 0x55609a34d670 2024-08-31T06:22:15.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.600+0000 7f5df52ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5de81b33c0 con 0x55609a345490 2024-08-31T06:22:15.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.600+0000 7f5df52ab740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5de81b1e30 con 0x55609a32ccd0 2024-08-31T06:22:15.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.600+0000 7f5de7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a717f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.600+0000 7f5de7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a717f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52646/0 (socket says 172.21.15.53:52646) 2024-08-31T06:22:15.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.600+0000 7f5de7fff640 1 -- 172.21.15.53:0/3501559874 learned_addr learned my addr 172.21.15.53:0/3501559874 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:15.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.601+0000 7f5decad2640 1 --2- 172.21.15.53:0/3501559874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a32ccd0 0x55609a71b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.601+0000 7f5ded2d3640 1 --2- 172.21.15.53:0/3501559874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a72c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.601+0000 7f5decad2640 1 -- 172.21.15.53:0/3501559874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 msgr2=0x55609a717f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:15.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.601+0000 7f5decad2640 1 --2- 172.21.15.53:0/3501559874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a717f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.601+0000 7f5decad2640 1 -- 172.21.15.53:0/3501559874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 msgr2=0x55609a72c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:15.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.601+0000 7f5decad2640 1 --2- 172.21.15.53:0/3501559874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a72c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.601+0000 7f5decad2640 1 -- 172.21.15.53:0/3501559874 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55609a71eeb0 con 0x55609a32ccd0 2024-08-31T06:22:15.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.602+0000 7f5decad2640 1 --2- 172.21.15.53:0/3501559874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a32ccd0 0x55609a71b730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc004650 tx=0x7f5ddc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57847c94980d60cb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:15.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.602+0000 7f5dd27fc640 1 -- 172.21.15.53:0/3501559874 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc035040 con 0x55609a32ccd0 2024-08-31T06:22:15.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.602+0000 7f5dd27fc640 1 -- 172.21.15.53:0/3501559874 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ddc0035f0 con 0x55609a32ccd0 2024-08-31T06:22:15.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.602+0000 7f5dd27fc640 1 -- 172.21.15.53:0/3501559874 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc040040 con 0x55609a32ccd0 2024-08-31T06:22:15.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.603+0000 7f5df52ab740 1 -- 172.21.15.53:0/3501559874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a32ccd0 msgr2=0x55609a71b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:15.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.603+0000 7f5df52ab740 1 --2- 172.21.15.53:0/3501559874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a32ccd0 0x55609a71b730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc004650 tx=0x7f5ddc000bc0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.603+0000 7f5df52ab740 1 -- 172.21.15.53:0/3501559874 shutdown_connections 2024-08-31T06:22:15.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.603+0000 7f5df52ab740 1 --2- 172.21.15.53:0/3501559874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a34d670 0x55609a72c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.603+0000 7f5df52ab740 1 --2- 172.21.15.53:0/3501559874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a717f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.603+0000 7f5df52ab740 1 --2- 172.21.15.53:0/3501559874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a32ccd0 0x55609a71b730 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.603+0000 7f5df52ab740 1 -- 172.21.15.53:0/3501559874 >> 172.21.15.53:0/3501559874 conn(0x55609a362740 msgr2=0x55609a717880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:15.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.603+0000 7f5df52ab740 1 -- 172.21.15.53:0/3501559874 shutdown_connections 2024-08-31T06:22:15.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.603+0000 7f5df52ab740 1 -- 172.21.15.53:0/3501559874 wait complete. 2024-08-31T06:22:15.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.604+0000 7f5df52ab740 1 -- start start 2024-08-31T06:22:15.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.604+0000 7f5df52ab740 1 Processor -- start 2024-08-31T06:22:15.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a32ccd0 0x55609a7288c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a724d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5df52ab740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a34d670 0x55609a7252c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5decad2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a32ccd0 0x55609a7288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5df52ab740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5de81b2cf0 con 0x55609a32ccd0 2024-08-31T06:22:15.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5decad2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a32ccd0 0x55609a7288c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48158/0 (socket says 172.21.15.53:48158) 2024-08-31T06:22:15.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5df52ab740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5de81b2590 con 0x55609a345490 2024-08-31T06:22:15.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5de7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a724d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5decad2640 1 -- 172.21.15.53:0/1624675894 learned_addr learned my addr 172.21.15.53:0/1624675894 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:15.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5df52ab740 1 -- 172.21.15.53:0/1624675894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5de81af730 con 0x55609a34d670 2024-08-31T06:22:15.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5df52ab740 10 client.0 _ll_register_callbacks cb 0x7f5dd40117a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:15.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5ded2d3640 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a34d670 0x55609a7252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5decad2640 1 -- 172.21.15.53:0/1624675894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a34d670 msgr2=0x55609a7252c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:15.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5decad2640 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a34d670 0x55609a7252c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5decad2640 1 -- 172.21.15.53:0/1624675894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 msgr2=0x55609a724d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:15.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5decad2640 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a724d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5decad2640 1 -- 172.21.15.53:0/1624675894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55609a7259d0 con 0x55609a32ccd0 2024-08-31T06:22:15.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5de7fff640 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a724d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:15.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5decad2640 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a32ccd0 0x55609a7288c0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc02a930 tx=0x7f5ddc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64a299a04bd92df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:15.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.605+0000 7f5dc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.606+0000 7f5dc7fff640 1 -- 172.21.15.53:0/1624675894 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc062060 con 0x55609a32ccd0 2024-08-31T06:22:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.606+0000 7f5dc7fff640 1 -- 172.21.15.53:0/1624675894 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f5ddc0039b0 con 0x55609a32ccd0 2024-08-31T06:22:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.606+0000 7f5df52ab740 1 -- 172.21.15.53:0/1624675894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ddc0035f0 con 0x55609a32ccd0 2024-08-31T06:22:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.606+0000 7f5dc7fff640 1 -- 172.21.15.53:0/1624675894 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f5ddc040070 con 0x55609a32ccd0 2024-08-31T06:22:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.607+0000 7f5df52ab740 10 client.20895 fetch_fsmap learned FSMap version 62 2024-08-31T06:22:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.607+0000 7f5df52ab740 1 -- 172.21.15.53:0/1624675894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55609a7a6330 con 0x55609a32ccd0 2024-08-31T06:22:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.607+0000 7f5dc7fff640 1 -- 172.21.15.53:0/1624675894 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ddc0035f0 con 0x55609a32ccd0 2024-08-31T06:22:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.607+0000 7f5dc7fff640 1 -- 172.21.15.53:0/1624675894 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) ==== 8390+0+0 (secure 0 0 0) 0x7f5ddc04f820 con 0x55609a32ccd0 2024-08-31T06:22:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.607+0000 7f5df52ab740 10 client.20895 fetch_fsmap finished waiting for FSMap version 62 2024-08-31T06:22:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.607+0000 7f5df52ab740 10 client.20895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.607+0000 7f5df52ab740 20 client.20895 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.607+0000 7f5df52ab740 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609a36e350 0x55609a7a8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.607+0000 7f5df52ab740 4 client.20895 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:22:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.607+0000 7f5df52ab740 1 -- 172.21.15.53:0/1624675894 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55609a687fe0 con 0x55609a36e350 2024-08-31T06:22:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.609+0000 7f5de7fff640 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609a36e350 0x55609a7a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:15.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.610+0000 7f5de7fff640 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609a36e350 0x55609a7a8610 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcf4c4b05f69fb88 server_cookie=3bdb6e0a96c03e2 in_seq=0 out_seq=0 2024-08-31T06:22:15.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.610+0000 7f5dc7fff640 10 client.20895 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:15.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.612+0000 7f5dc7fff640 1 -- 172.21.15.53:0/1624675894 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55609a687fe0 con 0x55609a36e350 2024-08-31T06:22:15.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.612+0000 7f5dc7fff640 10 client.20895 handle_command_reply: tid=0 2024-08-31T06:22:15.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.612+0000 7f5df52ab740 1 client.20895 shutdown 2024-08-31T06:22:15.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5df52ab740 1 -- 172.21.15.53:0/1624675894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a32ccd0 msgr2=0x55609a7288c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:15.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5df52ab740 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a32ccd0 0x55609a7288c0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc02a930 tx=0x7f5ddc0095c0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5df52ab740 1 -- 172.21.15.53:0/1624675894 shutdown_connections 2024-08-31T06:22:15.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5df52ab740 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55609a36e350 0x55609a7a8610 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5dc7fff640 0 client.20895 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:15.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5df52ab740 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55609a34d670 0x55609a7252c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5df52ab740 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55609a345490 0x55609a724d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5df52ab740 1 --2- 172.21.15.53:0/1624675894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55609a32ccd0 0x55609a7288c0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5df52ab740 1 -- 172.21.15.53:0/1624675894 >> 172.21.15.53:0/1624675894 conn(0x55609a362740 msgr2=0x55609a7157b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:15.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5df52ab740 1 -- 172.21.15.53:0/1624675894 shutdown_connections 2024-08-31T06:22:15.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5df52ab740 1 -- 172.21.15.53:0/1624675894 wait complete. 2024-08-31T06:22:15.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.613+0000 7f5df52ab740 20 client.20895 trim_cache size 0 max 16384 2024-08-31T06:22:15.617 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:22:15.618 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:22:15.618 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "f9469319-2447-4e45-b3a4-9f9a80519da4", 2024-08-31T06:22:15.618 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:22:15.618 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:22:15.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.614+0000 7f5deed36640 1 -- 172.21.15.53:0/786905101 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dd80b4d20 msgr2=0x7f5dd80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:15.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.614+0000 7f5deed36640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dd80b4d20 0x7f5dd80b7230 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40058c0 tx=0x7f5dd4009f90 comp rx=0 tx=0).stop 2024-08-31T06:22:15.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.614+0000 7f5deed36640 1 -- 172.21.15.53:0/786905101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de8108a90 msgr2=0x7f5de81a1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:15.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.614+0000 7f5deed36640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de8108a90 0x7f5de81a1bf0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009fd0 tx=0x7f5de000ef10 comp rx=0 tx=0).stop 2024-08-31T06:22:15.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.614+0000 7f5deed36640 1 -- 172.21.15.53:0/786905101 shutdown_connections 2024-08-31T06:22:15.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.614+0000 7f5deed36640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5dd80b4d20 0x7f5dd80b7230 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.614+0000 7f5deed36640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5de8108a90 0x7f5de81a1bf0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.614+0000 7f5deed36640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5de8108140 0x7f5de819c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.614+0000 7f5deed36640 1 --2- 172.21.15.53:0/786905101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5de8102800 0x7f5de819c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:15.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.614+0000 7f5deed36640 1 -- 172.21.15.53:0/786905101 >> 172.21.15.53:0/786905101 conn(0x7f5de80794d0 msgr2=0x7f5de806ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:15.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.614+0000 7f5deed36640 1 -- 172.21.15.53:0/786905101 shutdown_connections 2024-08-31T06:22:15.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:15.615+0000 7f5deed36640 1 -- 172.21.15.53:0/786905101 wait complete. 2024-08-31T06:22:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:15 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:15.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:15 smithi130 ceph-mon[22266]: osdmap e98: 12 total, 12 up, 12 in 2024-08-31T06:22:15.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:15 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:15.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:15 smithi153 ceph-mon[22320]: osdmap e98: 12 total, 12 up, 12 in 2024-08-31T06:22:16.342 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:22:16.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 27865 5.85 MB/sec execute 124 sec latency 410.014 ms 2024-08-31T06:22:16.404 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: pgmap v866: 97 pgs: 97 active+clean; 564 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 310 op/s 2024-08-31T06:22:16.404 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:22:16.404 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.404 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:16.405 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:16.405 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:16.405 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.405 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:16.405 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.405 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:16.405 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.405 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:16.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:16.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:16.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:16.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:16.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:16.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:16 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: pgmap v866: 97 pgs: 97 active+clean; 564 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 310 op/s 2024-08-31T06:22:16.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:22:16.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:16.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:16.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:16.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:16.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:16.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:16.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:16 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: pgmap v866: 97 pgs: 97 active+clean; 564 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 310 op/s 2024-08-31T06:22:16.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:16.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:16.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:16.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:16.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:16.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:16 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:16.729 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:17.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.263+0000 7f32088cf640 1 -- 172.21.15.53:0/3369197370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3204108a90 msgr2=0x7f320410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:17.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.263+0000 7f32088cf640 1 --2- 172.21.15.53:0/3369197370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3204108a90 0x7f320410f2c0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009ca0 tx=0x7f31fc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.263+0000 7f32088cf640 1 -- 172.21.15.53:0/3369197370 shutdown_connections 2024-08-31T06:22:17.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.263+0000 7f32088cf640 1 --2- 172.21.15.53:0/3369197370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3204108a90 0x7f320410f2c0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.263+0000 7f32088cf640 1 --2- 172.21.15.53:0/3369197370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3204108140 0x7f3204108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.263+0000 7f32088cf640 1 --2- 172.21.15.53:0/3369197370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3204102800 0x7f3204102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.263+0000 7f32088cf640 1 -- 172.21.15.53:0/3369197370 >> 172.21.15.53:0/3369197370 conn(0x7f32040794d0 msgr2=0x7f32040798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:17.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.263+0000 7f32088cf640 1 -- 172.21.15.53:0/3369197370 shutdown_connections 2024-08-31T06:22:17.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.263+0000 7f32088cf640 1 -- 172.21.15.53:0/3369197370 wait complete. 2024-08-31T06:22:17.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.264+0000 7f32088cf640 1 Processor -- start 2024-08-31T06:22:17.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.264+0000 7f32088cf640 1 -- start start 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.264+0000 7f32088cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3204102800 0x7f320419c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f32088cf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3204108140 0x7f320419c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f32088cf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3204108a90 0x7f32041a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f32088cf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32041114f0 con 0x7f3204102800 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f32088cf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3204111370 con 0x7f3204108140 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f32088cf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3204111670 con 0x7f3204108a90 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f320259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3204102800 0x7f320419c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f320259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3204102800 0x7f320419c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48174/0 (socket says 172.21.15.53:48174) 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f320259c640 1 -- 172.21.15.53:0/2967555007 learned_addr learned my addr 172.21.15.53:0/2967555007 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f3202d9d640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3204108a90 0x7f32041a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f3201d9b640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3204108140 0x7f320419c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f320259c640 1 -- 172.21.15.53:0/2967555007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3204108a90 msgr2=0x7f32041a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f320259c640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3204108a90 0x7f32041a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f320259c640 1 -- 172.21.15.53:0/2967555007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3204108140 msgr2=0x7f320419c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f320259c640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3204108140 0x7f320419c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f320259c640 1 -- 172.21.15.53:0/2967555007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32041a2220 con 0x7f3204102800 2024-08-31T06:22:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f3202d9d640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3204108a90 0x7f32041a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.265+0000 7f320259c640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3204102800 0x7f320419c2b0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009990 tx=0x7f31f4009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:17.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.266+0000 7f31f37fe640 1 -- 172.21.15.53:0/2967555007 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f401b070 con 0x7f3204102800 2024-08-31T06:22:17.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.266+0000 7f32088cf640 1 -- 172.21.15.53:0/2967555007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32041a2510 con 0x7f3204102800 2024-08-31T06:22:17.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.266+0000 7f32088cf640 1 -- 172.21.15.53:0/2967555007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32041a8c70 con 0x7f3204102800 2024-08-31T06:22:17.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.266+0000 7f31f37fe640 1 -- 172.21.15.53:0/2967555007 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31f4016410 con 0x7f3204102800 2024-08-31T06:22:17.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.266+0000 7f31f37fe640 1 -- 172.21.15.53:0/2967555007 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f4015610 con 0x7f3204102800 2024-08-31T06:22:17.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.269+0000 7f320ee44740 1 Processor -- start 2024-08-31T06:22:17.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.269+0000 7f320ee44740 1 -- start start 2024-08-31T06:22:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.269+0000 7f320ee44740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9f5070 0x562c3bda2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.269+0000 7f320ee44740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9cc1b0 0x562c3bda3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f320ee44740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9d4390 0x562c3bda3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f320ee44740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562c3bd11630 con 0x562c3b9f5070 2024-08-31T06:22:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f320ee44740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562c3bd00bc0 con 0x562c3b9d4390 2024-08-31T06:22:17.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f320ee44740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562c3bd04b70 con 0x562c3b9cc1b0 2024-08-31T06:22:17.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f3202d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9f5070 0x562c3bda2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f3202d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9f5070 0x562c3bda2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48188/0 (socket says 172.21.15.53:48188) 2024-08-31T06:22:17.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f3202d9d640 1 -- 172.21.15.53:0/4290741614 learned_addr learned my addr 172.21.15.53:0/4290741614 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:17.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f3201d9b640 1 --2- 172.21.15.53:0/4290741614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9d4390 0x562c3bda3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f3202d9d640 1 -- 172.21.15.53:0/4290741614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9cc1b0 msgr2=0x562c3bda3010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:22:17.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f3202d9d640 1 --2- 172.21.15.53:0/4290741614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9cc1b0 0x562c3bda3010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f3202d9d640 1 -- 172.21.15.53:0/4290741614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9d4390 msgr2=0x562c3bda3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:17.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f3202d9d640 1 --2- 172.21.15.53:0/4290741614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9d4390 0x562c3bda3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f3202d9d640 1 -- 172.21.15.53:0/4290741614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c3ba60650 con 0x562c3b9f5070 2024-08-31T06:22:17.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.270+0000 7f3201d9b640 1 --2- 172.21.15.53:0/4290741614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9d4390 0x562c3bda3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:17.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.271+0000 7f31f37fe640 1 -- 172.21.15.53:0/2967555007 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f31f401e070 con 0x7f3204102800 2024-08-31T06:22:17.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.271+0000 7f3202d9d640 1 --2- 172.21.15.53:0/4290741614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9f5070 0x562c3bda2ad0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009ca0 tx=0x7f31fc009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb53b12f79e05a2a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:17.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.271+0000 7f31f0ff9640 1 -- 172.21.15.53:0/4290741614 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc031c40 con 0x562c3b9f5070 2024-08-31T06:22:17.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.271+0000 7f31f0ff9640 1 -- 172.21.15.53:0/4290741614 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31fc036030 con 0x562c3b9f5070 2024-08-31T06:22:17.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.271+0000 7f31f0ff9640 1 -- 172.21.15.53:0/4290741614 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0046e0 con 0x562c3b9f5070 2024-08-31T06:22:17.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.272+0000 7f31f37fe640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31ec0b4da0 0x7f31ec0b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.272+0000 7f31f37fe640 1 -- 172.21.15.53:0/2967555007 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f31f40e4970 con 0x7f3204102800 2024-08-31T06:22:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.272+0000 7f320259c640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31ec0b4da0 0x7f31ec0b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.272+0000 7f320ee44740 1 -- 172.21.15.53:0/4290741614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9f5070 msgr2=0x562c3bda2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.272+0000 7f320ee44740 1 --2- 172.21.15.53:0/4290741614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9f5070 0x562c3bda2ad0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009ca0 tx=0x7f31fc009870 comp rx=0 tx=0).stop 2024-08-31T06:22:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.273+0000 7f320ee44740 1 -- 172.21.15.53:0/4290741614 shutdown_connections 2024-08-31T06:22:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.273+0000 7f320ee44740 1 --2- 172.21.15.53:0/4290741614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9d4390 0x562c3bda3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.273+0000 7f320ee44740 1 --2- 172.21.15.53:0/4290741614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9cc1b0 0x562c3bda3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.273+0000 7f320ee44740 1 --2- 172.21.15.53:0/4290741614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9f5070 0x562c3bda2ad0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.273+0000 7f320ee44740 1 -- 172.21.15.53:0/4290741614 >> 172.21.15.53:0/4290741614 conn(0x562c3b9e9460 msgr2=0x562c3bda09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.273+0000 7f320ee44740 1 -- 172.21.15.53:0/4290741614 shutdown_connections 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.273+0000 7f320ee44740 1 -- 172.21.15.53:0/4290741614 wait complete. 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.273+0000 7f320259c640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31ec0b4da0 0x7f31ec0b72b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x562c3bda1750 tx=0x7f31f400d300 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.273+0000 7f320ee44740 1 -- start start 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f320ee44740 1 Processor -- start 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f320ee44740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9cc1b0 0x562c3bdae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f320ee44740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 0x562c3bdae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f320ee44740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9f5070 0x562c3bdba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f320ee44740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562c3bb63700 con 0x562c3b9d4390 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f320ee44740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562c3bc87700 con 0x562c3b9cc1b0 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f320ee44740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562c3bdb10d0 con 0x562c3b9f5070 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f320ee44740 10 client.0 _ll_register_callbacks cb 0x562c3bcb6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f3201d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 0x562c3bdae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f3201d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 0x562c3bdae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48192/0 (socket says 172.21.15.53:48192) 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f3201d9b640 1 -- 172.21.15.53:0/2748290602 learned_addr learned my addr 172.21.15.53:0/2748290602 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.274+0000 7f3202d9d640 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9f5070 0x562c3bdba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.275+0000 7f3202d9d640 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9cc1b0 0x562c3bdae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.275+0000 7f3202d9d640 1 -- 172.21.15.53:0/2748290602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9cc1b0 msgr2=0x562c3bdae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.275+0000 7f3202d9d640 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9cc1b0 0x562c3bdae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.275+0000 7f3202d9d640 1 -- 172.21.15.53:0/2748290602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 msgr2=0x562c3bdae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.275+0000 7f3202d9d640 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 0x562c3bdae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.275+0000 7f3202d9d640 1 -- 172.21.15.53:0/2748290602 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c3bcc08b0 con 0x562c3b9f5070 2024-08-31T06:22:17.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.275+0000 7f3201d9b640 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 0x562c3bdae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:17.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.275+0000 7f3202d9d640 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9f5070 0x562c3bdba3c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31fc02ade0 tx=0x7f31fc0042c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7753b0f351bf8388 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:17.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.275+0000 7f31e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:22:17.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.276+0000 7f31e9ffb640 1 -- 172.21.15.53:0/2748290602 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc003b70 con 0x562c3b9f5070 2024-08-31T06:22:17.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.276+0000 7f31e9ffb640 1 -- 172.21.15.53:0/2748290602 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f31fc003d10 con 0x562c3b9f5070 2024-08-31T06:22:17.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.276+0000 7f320ee44740 1 -- 172.21.15.53:0/2748290602 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31fc036030 con 0x562c3b9f5070 2024-08-31T06:22:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.276+0000 7f31e9ffb640 1 -- 172.21.15.53:0/2748290602 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f31fc0305c0 con 0x562c3b9f5070 2024-08-31T06:22:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.276+0000 7f320ee44740 10 client.29794 fetch_fsmap learned FSMap version 63 2024-08-31T06:22:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.276+0000 7f320ee44740 1 -- 172.21.15.53:0/2748290602 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) -- 0x562c3bdbcf60 con 0x562c3b9f5070 2024-08-31T06:22:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.277+0000 7f31e9ffb640 1 -- 172.21.15.53:0/2748290602 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31fc036030 con 0x562c3b9f5070 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.277+0000 7f31e9ffb640 1 -- 172.21.15.53:0/2748290602 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 63) ==== 8382+0+0 (secure 0 0 0) 0x7f31fc043070 con 0x562c3b9f5070 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.277+0000 7f320ee44740 10 client.29794 fetch_fsmap finished waiting for FSMap version 63 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.277+0000 7f320ee44740 10 client.29794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.277+0000 7f320ee44740 20 client.29794 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.277+0000 7f320ee44740 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562c3b9b39f0 0x562c3bdc02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.277+0000 7f320ee44740 4 client.29794 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.277+0000 7f320ee44740 1 -- 172.21.15.53:0/2748290602 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c3bd13580 con 0x562c3b9b39f0 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.277+0000 7f3201d9b640 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562c3b9b39f0 0x562c3bdc02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.278+0000 7f31e9ffb640 10 client.29794 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.279+0000 7f3201d9b640 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562c3b9b39f0 0x562c3bdc02c0 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2471e322d05b8a2 server_cookie=c059d82413963c33 in_seq=0 out_seq=0 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.279+0000 7f31e9ffb640 1 -- 172.21.15.53:0/2748290602 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c3bd13580 con 0x562c3b9b39f0 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.279+0000 7f31e9ffb640 10 client.29794 handle_command_reply: tid=0 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.279+0000 7f320ee44740 1 client.29794 shutdown 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.280+0000 7f320ee44740 1 -- 172.21.15.53:0/2748290602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9f5070 msgr2=0x562c3bdba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.280+0000 7f320ee44740 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9f5070 0x562c3bdba3c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31fc02ade0 tx=0x7f31fc0042c0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.280+0000 7f320ee44740 1 -- 172.21.15.53:0/2748290602 shutdown_connections 2024-08-31T06:22:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.280+0000 7f320ee44740 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562c3b9b39f0 0x562c3bdc02c0 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.280+0000 7f320ee44740 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9f5070 0x562c3bdba3c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.280+0000 7f31e9ffb640 0 client.29794 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.280+0000 7f320ee44740 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 0x562c3bdae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.280+0000 7f320ee44740 1 --2- 172.21.15.53:0/2748290602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9cc1b0 0x562c3bdae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.280+0000 7f320ee44740 1 -- 172.21.15.53:0/2748290602 >> 172.21.15.53:0/2748290602 conn(0x562c3b9e9460 msgr2=0x562c3bda5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.280+0000 7f320ee44740 1 -- 172.21.15.53:0/2748290602 shutdown_connections 2024-08-31T06:22:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.281+0000 7f320ee44740 1 -- 172.21.15.53:0/2748290602 wait complete. 2024-08-31T06:22:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.281+0000 7f320ee44740 20 client.29794 trim_cache size 0 max 16384 2024-08-31T06:22:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f320ee44740 1 Processor -- start 2024-08-31T06:22:17.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f320ee44740 1 -- start start 2024-08-31T06:22:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f320ee44740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9b39f0 0x562c3bda6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f320ee44740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9cc1b0 0x562c3bdaff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f320ee44740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9d4390 0x562c3bdba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f320ee44740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32041ad290 con 0x562c3b9cc1b0 2024-08-31T06:22:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f320ee44740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32041aeec0 con 0x562c3b9d4390 2024-08-31T06:22:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f320ee44740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32041ad990 con 0x562c3b9b39f0 2024-08-31T06:22:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f3201d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9cc1b0 0x562c3bdaff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f3202d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9b39f0 0x562c3bda6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f3202d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9b39f0 0x562c3bda6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:32844/0 (socket says 172.21.15.53:32844) 2024-08-31T06:22:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f3201d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9cc1b0 0x562c3bdaff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48206/0 (socket says 172.21.15.53:48206) 2024-08-31T06:22:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.311+0000 7f3202d9d640 1 -- 172.21.15.53:0/1378381518 learned_addr learned my addr 172.21.15.53:0/1378381518 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.312+0000 7f3202d9d640 1 --2- 172.21.15.53:0/1378381518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9d4390 0x562c3bdba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.312+0000 7f3202d9d640 1 -- 172.21.15.53:0/1378381518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9d4390 msgr2=0x562c3bdba2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.312+0000 7f3202d9d640 1 --2- 172.21.15.53:0/1378381518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9d4390 0x562c3bdba2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.312+0000 7f3202d9d640 1 -- 172.21.15.53:0/1378381518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9cc1b0 msgr2=0x562c3bdaff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.312+0000 7f3202d9d640 1 --2- 172.21.15.53:0/1378381518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9cc1b0 0x562c3bdaff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.312+0000 7f3202d9d640 1 -- 172.21.15.53:0/1378381518 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c3bda4dc0 con 0x562c3b9b39f0 2024-08-31T06:22:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.312+0000 7f3201d9b640 1 --2- 172.21.15.53:0/1378381518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9cc1b0 0x562c3bdaff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.312+0000 7f3202d9d640 1 --2- 172.21.15.53:0/1378381518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9b39f0 0x562c3bda6590 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31fc002230 tx=0x7f31fc02a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46f56a36984be6a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:17.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.312+0000 7f31ebfff640 1 -- 172.21.15.53:0/1378381518 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc062040 con 0x562c3b9b39f0 2024-08-31T06:22:17.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.313+0000 7f31ebfff640 1 -- 172.21.15.53:0/1378381518 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31fc063040 con 0x562c3b9b39f0 2024-08-31T06:22:17.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.313+0000 7f31ebfff640 1 -- 172.21.15.53:0/1378381518 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc030760 con 0x562c3b9b39f0 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.313+0000 7f320ee44740 1 -- 172.21.15.53:0/1378381518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9b39f0 msgr2=0x562c3bda6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.313+0000 7f320ee44740 1 --2- 172.21.15.53:0/1378381518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9b39f0 0x562c3bda6590 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31fc002230 tx=0x7f31fc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.314+0000 7f320ee44740 1 -- 172.21.15.53:0/1378381518 shutdown_connections 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.314+0000 7f320ee44740 1 --2- 172.21.15.53:0/1378381518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9d4390 0x562c3bdba2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.314+0000 7f320ee44740 1 --2- 172.21.15.53:0/1378381518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9cc1b0 0x562c3bdaff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.314+0000 7f320ee44740 1 --2- 172.21.15.53:0/1378381518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9b39f0 0x562c3bda6590 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.314+0000 7f320ee44740 1 -- 172.21.15.53:0/1378381518 >> 172.21.15.53:0/1378381518 conn(0x562c3b9e9460 msgr2=0x562c3bdaf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.314+0000 7f320ee44740 1 -- 172.21.15.53:0/1378381518 shutdown_connections 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.314+0000 7f320ee44740 1 -- 172.21.15.53:0/1378381518 wait complete. 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.314+0000 7f320ee44740 1 -- start start 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.314+0000 7f320ee44740 1 Processor -- start 2024-08-31T06:22:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f320ee44740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9b39f0 0x562c3bdb23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f320ee44740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9cc1b0 0x562c3bdb28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f320ee44740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 0x562c3bdb2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f3202d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9b39f0 0x562c3bdb23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f3202d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9b39f0 0x562c3bdb23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52704/0 (socket says 172.21.15.53:52704) 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f3202d9d640 1 -- 172.21.15.53:0/463042782 learned_addr learned my addr 172.21.15.53:0/463042782 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f320ee44740 1 -- 172.21.15.53:0/463042782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f32041ae7f0 con 0x562c3b9d4390 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f320ee44740 1 -- 172.21.15.53:0/463042782 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32041ae0f0 con 0x562c3b9b39f0 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f320ee44740 1 -- 172.21.15.53:0/463042782 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32041ab290 con 0x562c3b9cc1b0 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f3202d9d640 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 0x562c3bdb2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f3201d9b640 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9cc1b0 0x562c3bdb28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f320ee44740 10 client.0 _ll_register_callbacks cb 0x7f31f80097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f3202d9d640 1 -- 172.21.15.53:0/463042782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9cc1b0 msgr2=0x562c3bdb28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f3202d9d640 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9cc1b0 0x562c3bdb28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f3202d9d640 1 -- 172.21.15.53:0/463042782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 msgr2=0x562c3bdb2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f3202d9d640 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 0x562c3bdb2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.315+0000 7f3202d9d640 1 -- 172.21.15.53:0/463042782 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c3be29b40 con 0x562c3b9b39f0 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.316+0000 7f320ee44740 1 -- 172.21.15.53:0/463042782 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31fc063040 con 0x562c3b9b39f0 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.316+0000 7f3202d9d640 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9b39f0 0x562c3bdb23a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31fc05cfd0 tx=0x7f31fc033040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25ceb69d3533ca76 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.316+0000 7f31e9ffb640 10 client.29819 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.316+0000 7f31e9ffb640 1 -- 172.21.15.53:0/463042782 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc062070 con 0x562c3b9b39f0 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.316+0000 7f31e9ffb640 1 -- 172.21.15.53:0/463042782 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f31fc003d80 con 0x562c3b9b39f0 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.316+0000 7f31e9ffb640 1 -- 172.21.15.53:0/463042782 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f31fc004290 con 0x562c3b9b39f0 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.316+0000 7f320ee44740 10 client.29819 fetch_fsmap learned FSMap version 63 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.316+0000 7f320ee44740 1 -- 172.21.15.53:0/463042782 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=63}) -- 0x562c3be2ac10 con 0x562c3b9b39f0 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.317+0000 7f31e9ffb640 1 -- 172.21.15.53:0/463042782 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 63) ==== 8382+0+0 (secure 0 0 0) 0x7f31fc068040 con 0x562c3b9b39f0 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.317+0000 7f320ee44740 10 client.29819 fetch_fsmap finished waiting for FSMap version 63 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.317+0000 7f320ee44740 10 client.29819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:17.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.317+0000 7f320ee44740 20 client.29819 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.317+0000 7f320ee44740 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562c3b9f5070 0x562c3be2d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.317+0000 7f320ee44740 4 client.29819 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.317+0000 7f320ee44740 1 -- 172.21.15.53:0/463042782 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562c3bd0f020 con 0x562c3b9f5070 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.317+0000 7f3201d9b640 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562c3b9f5070 0x562c3be2d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.317+0000 7f31e9ffb640 10 client.29819 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.317+0000 7f3201d9b640 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562c3b9f5070 0x562c3be2d2b0 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=488f120e2f99b32 server_cookie=200a2d11f8019fb8 in_seq=0 out_seq=0 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f31e9ffb640 1 -- 172.21.15.53:0/463042782 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6534 (crc 0 0 0) 0x562c3bd0f020 con 0x562c3b9f5070 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f31e9ffb640 10 client.29819 handle_command_reply: tid=0 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f320ee44740 1 client.29819 shutdown 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f320ee44740 1 -- 172.21.15.53:0/463042782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9b39f0 msgr2=0x562c3bdb23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f320ee44740 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9b39f0 0x562c3bdb23a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f31fc05cfd0 tx=0x7f31fc033040 comp rx=0 tx=0).stop 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f320ee44740 1 -- 172.21.15.53:0/463042782 shutdown_connections 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f320ee44740 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x562c3b9f5070 0x562c3be2d2b0 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f320ee44740 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c3b9d4390 0x562c3bdb2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f31e9ffb640 0 client.29819 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:17.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f320ee44740 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562c3b9cc1b0 0x562c3bdb28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f320ee44740 1 --2- 172.21.15.53:0/463042782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562c3b9b39f0 0x562c3bdb23a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.318+0000 7f320ee44740 1 -- 172.21.15.53:0/463042782 >> 172.21.15.53:0/463042782 conn(0x562c3b9e9460 msgr2=0x562c3bda3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:17.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.319+0000 7f320ee44740 1 -- 172.21.15.53:0/463042782 shutdown_connections 2024-08-31T06:22:17.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.319+0000 7f320ee44740 1 -- 172.21.15.53:0/463042782 wait complete. 2024-08-31T06:22:17.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.319+0000 7f320ee44740 20 client.29819 trim_cache size 0 max 16384 2024-08-31T06:22:17.328 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:22:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "f9469319-2447-4e45-b3a4-9f9a80519da4", 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:22:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:22:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:22:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:22:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:22:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:22:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:22:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:22:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:22:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:22:17.343 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:22:17.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.320+0000 7f32088cf640 1 -- 172.21.15.53:0/2967555007 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31ec0b4da0 msgr2=0x7f31ec0b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:17.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.320+0000 7f32088cf640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31ec0b4da0 0x7f31ec0b72b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x562c3bda1750 tx=0x7f31f400d300 comp rx=0 tx=0).stop 2024-08-31T06:22:17.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.320+0000 7f32088cf640 1 -- 172.21.15.53:0/2967555007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3204102800 msgr2=0x7f320419c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:17.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.320+0000 7f32088cf640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3204102800 0x7f320419c2b0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009990 tx=0x7f31f4009e50 comp rx=0 tx=0).stop 2024-08-31T06:22:17.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.320+0000 7f32088cf640 1 -- 172.21.15.53:0/2967555007 shutdown_connections 2024-08-31T06:22:17.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.320+0000 7f32088cf640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31ec0b4da0 0x7f31ec0b72b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.320+0000 7f32088cf640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3204108a90 0x7f32041a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.320+0000 7f32088cf640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3204108140 0x7f320419c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.320+0000 7f32088cf640 1 --2- 172.21.15.53:0/2967555007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3204102800 0x7f320419c2b0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:17.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.320+0000 7f32088cf640 1 -- 172.21.15.53:0/2967555007 >> 172.21.15.53:0/2967555007 conn(0x7f32040794d0 msgr2=0x7f3204104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:17.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.321+0000 7f32088cf640 1 -- 172.21.15.53:0/2967555007 shutdown_connections 2024-08-31T06:22:17.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:17.321+0000 7f32088cf640 1 -- 172.21.15.53:0/2967555007 wait complete. 2024-08-31T06:22:17.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 28023 5.87 MB/sec execute 125 sec latency 250.421 ms 2024-08-31T06:22:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:17.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:22:17.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:17 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:17.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:17.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:17.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:22:17.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:17 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:17.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:17.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:17.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:17.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:22:17.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:17.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:17 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:22:18.196 INFO:tasks.cephfs.filesystem:scrub status for tag:f9469319-2447-4e45-b3a4-9f9a80519da4 - {'path': '/', 'tag': 'f9469319-2447-4e45-b3a4-9f9a80519da4', 'options': 'recursive,force'} 2024-08-31T06:22:18.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 28201 5.90 MB/sec execute 126 sec latency 94.710 ms 2024-08-31T06:22:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:18 smithi053 ceph-mon[18924]: pgmap v867: 97 pgs: 97 active+clean; 569 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 354 op/s 2024-08-31T06:22:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:18 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:18 smithi130 ceph-mon[22266]: pgmap v867: 97 pgs: 97 active+clean; 569 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 354 op/s 2024-08-31T06:22:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:18 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:18.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:18 smithi153 ceph-mon[22320]: pgmap v867: 97 pgs: 97 active+clean; 569 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 354 op/s 2024-08-31T06:22:18.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:18 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:19.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 28389 5.92 MB/sec execute 127 sec latency 57.953 ms 2024-08-31T06:22:20.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 28551 5.98 MB/sec execute 128 sec latency 52.815 ms 2024-08-31T06:22:20.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.585+0000 7ff2e850b640 1 -- 172.21.15.53:0/2510345959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e0101e00 msgr2=0x7ff2e0102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:20.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.585+0000 7ff2e850b640 1 --2- 172.21.15.53:0/2510345959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e0101e00 0x7ff2e0102210 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009900 tx=0x7ff2dc02a410 comp rx=0 tx=0).stop 2024-08-31T06:22:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.585+0000 7ff2e850b640 1 -- 172.21.15.53:0/2510345959 shutdown_connections 2024-08-31T06:22:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.585+0000 7ff2e850b640 1 --2- 172.21.15.53:0/2510345959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e0109b20 0x7ff2e0110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.585+0000 7ff2e850b640 1 --2- 172.21.15.53:0/2510345959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e01091d0 0x7ff2e01095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.585+0000 7ff2e850b640 1 --2- 172.21.15.53:0/2510345959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e0101e00 0x7ff2e0102210 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.585+0000 7ff2e850b640 1 -- 172.21.15.53:0/2510345959 >> 172.21.15.53:0/2510345959 conn(0x7ff2e0079c30 msgr2=0x7ff2e007a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.585+0000 7ff2e850b640 1 -- 172.21.15.53:0/2510345959 shutdown_connections 2024-08-31T06:22:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.585+0000 7ff2e850b640 1 -- 172.21.15.53:0/2510345959 wait complete. 2024-08-31T06:22:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.586+0000 7ff2e850b640 1 Processor -- start 2024-08-31T06:22:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.586+0000 7ff2e850b640 1 -- start start 2024-08-31T06:22:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.586+0000 7ff2e850b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e0101e00 0x7ff2e019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.586+0000 7ff2e850b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e01091d0 0x7ff2e019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.586+0000 7ff2e850b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e0109b20 0x7ff2e019f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.586+0000 7ff2e850b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e0113670 con 0x7ff2e01091d0 2024-08-31T06:22:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.586+0000 7ff2e850b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e01134f0 con 0x7ff2e0101e00 2024-08-31T06:22:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.586+0000 7ff2e850b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e01137f0 con 0x7ff2e0109b20 2024-08-31T06:22:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e62a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e0101e00 0x7ff2e019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e5aa6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e01091d0 0x7ff2e019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e5aa6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e01091d0 0x7ff2e019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48236/0 (socket says 172.21.15.53:48236) 2024-08-31T06:22:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e5aa6640 1 -- 172.21.15.53:0/4041472791 learned_addr learned my addr 172.21.15.53:0/4041472791 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e0109b20 0x7ff2e019f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e5aa6640 1 -- 172.21.15.53:0/4041472791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e0109b20 msgr2=0x7ff2e019f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e5aa6640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e0109b20 0x7ff2e019f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e5aa6640 1 -- 172.21.15.53:0/4041472791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e0101e00 msgr2=0x7ff2e019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e5aa6640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e0101e00 0x7ff2e019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e5aa6640 1 -- 172.21.15.53:0/4041472791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e01a0060 con 0x7ff2e01091d0 2024-08-31T06:22:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e0109b20 0x7ff2e019f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.587+0000 7ff2e5aa6640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e01091d0 0x7ff2e019a6d0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e970 tx=0x7ff2d000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.588+0000 7ff2d77fe640 1 -- 172.21.15.53:0/4041472791 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000cd80 con 0x7ff2e01091d0 2024-08-31T06:22:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.588+0000 7ff2e850b640 1 -- 172.21.15.53:0/4041472791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e01a0350 con 0x7ff2e01091d0 2024-08-31T06:22:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.588+0000 7ff2d77fe640 1 -- 172.21.15.53:0/4041472791 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2d00035f0 con 0x7ff2e01091d0 2024-08-31T06:22:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.588+0000 7ff2d77fe640 1 -- 172.21.15.53:0/4041472791 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0010690 con 0x7ff2e01091d0 2024-08-31T06:22:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.588+0000 7ff2e850b640 1 -- 172.21.15.53:0/4041472791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e0102c70 con 0x7ff2e01091d0 2024-08-31T06:22:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.591+0000 7ff2ef475740 1 Processor -- start 2024-08-31T06:22:20.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.592+0000 7ff2ef475740 1 -- start start 2024-08-31T06:22:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.592+0000 7ff2ef475740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.592+0000 7ff2ef475740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587b8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.592+0000 7ff2ef475740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587b8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.592+0000 7ff2ef475740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56325872d000 con 0x5632584141b0 2024-08-31T06:22:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.592+0000 7ff2ef475740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56325871c590 con 0x5632583eb2f0 2024-08-31T06:22:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.592+0000 7ff2ef475740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563258720540 con 0x5632583f34d0 2024-08-31T06:22:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.593+0000 7ff2e6aa8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.593+0000 7ff2e62a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.593+0000 7ff2e6aa8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587b7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48248/0 (socket says 172.21.15.53:48248) 2024-08-31T06:22:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.593+0000 7ff2e6aa8640 1 -- 172.21.15.53:0/3879793484 learned_addr learned my addr 172.21.15.53:0/3879793484 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.593+0000 7ff2e6aa8640 1 -- 172.21.15.53:0/3879793484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 msgr2=0x5632587b8540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:22:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.593+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/3879793484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587b8540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.593+0000 7ff2e6aa8640 1 -- 172.21.15.53:0/3879793484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 msgr2=0x5632587b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.593+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/3879793484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587b8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.593+0000 7ff2e6aa8640 1 -- 172.21.15.53:0/3879793484 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56325847f790 con 0x5632584141b0 2024-08-31T06:22:20.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.594+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/3879793484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587b7ac0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8010a80 tx=0x7ff2d8009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0abbd26d38cbe1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:20.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.594+0000 7ff2d77fe640 1 -- 172.21.15.53:0/4041472791 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff2d00108f0 con 0x7ff2e01091d0 2024-08-31T06:22:20.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.594+0000 7ff2d4bfe640 1 -- 172.21.15.53:0/3879793484 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8003c30 con 0x5632584141b0 2024-08-31T06:22:20.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.594+0000 7ff2d4bfe640 1 -- 172.21.15.53:0/3879793484 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2d801f070 con 0x5632584141b0 2024-08-31T06:22:20.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.594+0000 7ff2d4bfe640 1 -- 172.21.15.53:0/3879793484 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8004620 con 0x5632584141b0 2024-08-31T06:22:20.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2ef475740 1 -- 172.21.15.53:0/3879793484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 msgr2=0x5632587b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:20.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2ef475740 1 --2- 172.21.15.53:0/3879793484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587b7ac0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8010a80 tx=0x7ff2d8009500 comp rx=0 tx=0).stop 2024-08-31T06:22:20.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2d77fe640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2cc0b4ca0 0x7ff2cc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2ef475740 1 -- 172.21.15.53:0/3879793484 shutdown_connections 2024-08-31T06:22:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2ef475740 1 --2- 172.21.15.53:0/3879793484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2ef475740 1 --2- 172.21.15.53:0/3879793484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2ef475740 1 --2- 172.21.15.53:0/3879793484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587b7ac0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2cc0b4ca0 0x7ff2cc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2ef475740 1 -- 172.21.15.53:0/3879793484 >> 172.21.15.53:0/3879793484 conn(0x563258408300 msgr2=0x5632587b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2d77fe640 1 -- 172.21.15.53:0/4041472791 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7ff2d00e57c0 con 0x7ff2e01091d0 2024-08-31T06:22:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2ef475740 1 -- 172.21.15.53:0/3879793484 shutdown_connections 2024-08-31T06:22:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.596+0000 7ff2ef475740 1 -- 172.21.15.53:0/3879793484 wait complete. 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2cc0b4ca0 0x7ff2cc0b71b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8012010 tx=0x7ff2d8009f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2ef475740 1 -- start start 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2ef475740 1 Processor -- start 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2ef475740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2ef475740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2ef475740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2ef475740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563258655ab0 con 0x5632584141b0 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2ef475740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5632586a3680 con 0x5632583eb2f0 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2ef475740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5632587c6240 con 0x5632583f34d0 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2ef475740 10 client.0 _ll_register_callbacks cb 0x56325842ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2e62a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2e62a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52734/0 (socket says 172.21.15.53:52734) 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2e62a7640 1 -- 172.21.15.53:0/2398592577 learned_addr learned my addr 172.21.15.53:0/2398592577 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.597+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2e62a7640 1 -- 172.21.15.53:0/2398592577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 msgr2=0x5632587c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2e62a7640 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2e62a7640 1 -- 172.21.15.53:0/2398592577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 msgr2=0x5632587cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2e62a7640 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2e62a7640 1 -- 172.21.15.53:0/2398592577 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632584f8620 con 0x5632583eb2f0 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2e62a7640 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587c3710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc02a930 tx=0x7ff2dc031de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6017b85aea334478 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/2398592577 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc035040 con 0x5632583eb2f0 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/2398592577 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7ff2dc004040 con 0x5632583eb2f0 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2ef475740 1 -- 172.21.15.53:0/2398592577 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2d801f070 con 0x5632583eb2f0 2024-08-31T06:22:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/2398592577 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7ff2dc004240 con 0x5632583eb2f0 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2ef475740 10 client.29831 fetch_fsmap learned FSMap version 64 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.598+0000 7ff2ef475740 1 -- 172.21.15.53:0/2398592577 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x5632587d2300 con 0x5632583eb2f0 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.599+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/2398592577 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2d801f070 con 0x5632583eb2f0 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.599+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/2398592577 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 64) ==== 8382+0+0 (secure 0 0 0) 0x7ff2dc044020 con 0x5632583eb2f0 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.599+0000 7ff2ef475740 10 client.29831 fetch_fsmap finished waiting for FSMap version 64 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.599+0000 7ff2ef475740 10 client.29831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.599+0000 7ff2ef475740 20 client.29831 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.599+0000 7ff2ef475740 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632583d2d80 0x5632587d5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.599+0000 7ff2ef475740 4 client.29831 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.599+0000 7ff2ef475740 1 -- 172.21.15.53:0/2398592577 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56325872ef50 con 0x5632583d2d80 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.599+0000 7ff2e5aa6640 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632583d2d80 0x5632587d5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.600+0000 7ff2c9ffb640 10 client.29831 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.600+0000 7ff2e5aa6640 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632583d2d80 0x5632587d5960 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37f41182918393ea server_cookie=7f57be4935be689d in_seq=0 out_seq=0 2024-08-31T06:22:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/2398592577 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56325872ef50 con 0x5632583d2d80 2024-08-31T06:22:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2c9ffb640 10 client.29831 handle_command_reply: tid=0 2024-08-31T06:22:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 1 client.29831 shutdown 2024-08-31T06:22:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 1 -- 172.21.15.53:0/2398592577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 msgr2=0x5632587c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587c3710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc02a930 tx=0x7ff2dc031de0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 1 -- 172.21.15.53:0/2398592577 shutdown_connections 2024-08-31T06:22:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632583d2d80 0x5632587d5960 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2c9ffb640 0 client.29831 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 1 --2- 172.21.15.53:0/2398592577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587c3710 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 1 -- 172.21.15.53:0/2398592577 >> 172.21.15.53:0/2398592577 conn(0x563258408300 msgr2=0x5632587b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 1 -- 172.21.15.53:0/2398592577 shutdown_connections 2024-08-31T06:22:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 1 -- 172.21.15.53:0/2398592577 wait complete. 2024-08-31T06:22:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.601+0000 7ff2ef475740 20 client.29831 trim_cache size 0 max 16384 2024-08-31T06:22:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:20 smithi130 ceph-mon[22266]: pgmap v868: 97 pgs: 97 active+clean; 571 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 363 op/s 2024-08-31T06:22:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:20 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.630+0000 7ff2ef475740 1 Processor -- start 2024-08-31T06:22:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.630+0000 7ff2ef475740 1 -- start start 2024-08-31T06:22:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.631+0000 7ff2ef475740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632583eb2f0 0x5632587b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.631+0000 7ff2e62a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632583eb2f0 0x5632587b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.631+0000 7ff2e62a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632583eb2f0 0x5632587b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48258/0 (socket says 172.21.15.53:48258) 2024-08-31T06:22:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.631+0000 7ff2e62a7640 1 -- 172.21.15.53:0/421454676 learned_addr learned my addr 172.21.15.53:0/421454676 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.631+0000 7ff2ef475740 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.631+0000 7ff2ef475740 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632584141b0 0x5632587cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.631+0000 7ff2ef475740 1 -- 172.21.15.53:0/421454676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e01ad380 con 0x5632583eb2f0 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.631+0000 7ff2ef475740 1 -- 172.21.15.53:0/421454676 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e01aefb0 con 0x5632584141b0 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.631+0000 7ff2ef475740 1 -- 172.21.15.53:0/421454676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e01adab0 con 0x5632583f34d0 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.631+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632584141b0 0x5632587cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2e5aa6640 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2e6aa8640 1 -- 172.21.15.53:0/421454676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 msgr2=0x5632587b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2e6aa8640 1 -- 172.21.15.53:0/421454676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632583eb2f0 msgr2=0x5632587b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632583eb2f0 0x5632587b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2e6aa8640 1 -- 172.21.15.53:0/421454676 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632587c47c0 con 0x5632584141b0 2024-08-31T06:22:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2e62a7640 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632583eb2f0 0x5632587b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2e5aa6640 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632584141b0 0x5632587cf430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80108c0 tx=0x7ff2d8012040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6313c187bfc3096 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2cbfff640 1 -- 172.21.15.53:0/421454676 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8004790 con 0x5632584141b0 2024-08-31T06:22:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2cbfff640 1 -- 172.21.15.53:0/421454676 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2d801f030 con 0x5632584141b0 2024-08-31T06:22:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.632+0000 7ff2cbfff640 1 -- 172.21.15.53:0/421454676 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8005280 con 0x5632584141b0 2024-08-31T06:22:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.634+0000 7ff2ef475740 1 -- 172.21.15.53:0/421454676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632584141b0 msgr2=0x5632587cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.634+0000 7ff2ef475740 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632584141b0 0x5632587cf430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80108c0 tx=0x7ff2d8012040 comp rx=0 tx=0).stop 2024-08-31T06:22:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.634+0000 7ff2ef475740 1 -- 172.21.15.53:0/421454676 shutdown_connections 2024-08-31T06:22:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.634+0000 7ff2ef475740 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632584141b0 0x5632587cf430 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.634+0000 7ff2ef475740 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.634+0000 7ff2ef475740 1 --2- 172.21.15.53:0/421454676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632583eb2f0 0x5632587b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.634+0000 7ff2ef475740 1 -- 172.21.15.53:0/421454676 >> 172.21.15.53:0/421454676 conn(0x563258408300 msgr2=0x5632587b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.634+0000 7ff2ef475740 1 -- 172.21.15.53:0/421454676 shutdown_connections 2024-08-31T06:22:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.634+0000 7ff2ef475740 1 -- 172.21.15.53:0/421454676 wait complete. 2024-08-31T06:22:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.634+0000 7ff2ef475740 1 -- start start 2024-08-31T06:22:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2ef475740 1 Processor -- start 2024-08-31T06:22:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2ef475740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2ef475740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2ef475740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587c6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2ef475740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e01ae8e0 con 0x5632584141b0 2024-08-31T06:22:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2ef475740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e01ae1e0 con 0x5632583eb2f0 2024-08-31T06:22:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2ef475740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e01ab380 con 0x5632583f34d0 2024-08-31T06:22:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2e5aa6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2e62a7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2e5aa6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:32894/0 (socket says 172.21.15.53:32894) 2024-08-31T06:22:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2e5aa6640 1 -- 172.21.15.53:0/1966028819 learned_addr learned my addr 172.21.15.53:0/1966028819 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2e6aa8640 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.635+0000 7ff2ef475740 10 client.0 _ll_register_callbacks cb 0x7ff2dc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.636+0000 7ff2e5aa6640 1 -- 172.21.15.53:0/1966028819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 msgr2=0x5632587cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.636+0000 7ff2e5aa6640 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.636+0000 7ff2e5aa6640 1 -- 172.21.15.53:0/1966028819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 msgr2=0x5632587c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.636+0000 7ff2e5aa6640 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.636+0000 7ff2e5aa6640 1 -- 172.21.15.53:0/1966028819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632587cc1d0 con 0x5632583f34d0 2024-08-31T06:22:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.636+0000 7ff2e62a7640 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.636+0000 7ff2e5aa6640 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587cb9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00a9100 tx=0x7ff2d00aba60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24ed0ca379fdfaf0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.636+0000 7ff2c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:22:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.636+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/1966028819 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00b0700 con 0x5632583f34d0 2024-08-31T06:22:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.636+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/1966028819 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7ff2d00e3170 con 0x5632583f34d0 2024-08-31T06:22:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.636+0000 7ff2ef475740 1 -- 172.21.15.53:0/1966028819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2d801f030 con 0x5632583f34d0 2024-08-31T06:22:20.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.637+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/1966028819 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7ff2d00b51b0 con 0x5632583f34d0 2024-08-31T06:22:20.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.637+0000 7ff2ef475740 10 client.29809 fetch_fsmap learned FSMap version 64 2024-08-31T06:22:20.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.637+0000 7ff2ef475740 1 -- 172.21.15.53:0/1966028819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x563258840830 con 0x5632583f34d0 2024-08-31T06:22:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.637+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/1966028819 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2d801f030 con 0x5632583f34d0 2024-08-31T06:22:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.637+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/1966028819 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 64) ==== 8382+0+0 (secure 0 0 0) 0x7ff2d0010be0 con 0x5632583f34d0 2024-08-31T06:22:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.637+0000 7ff2ef475740 10 client.29809 fetch_fsmap finished waiting for FSMap version 64 2024-08-31T06:22:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.637+0000 7ff2ef475740 10 client.29809 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.637+0000 7ff2ef475740 20 client.29809 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.637+0000 7ff2ef475740 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632583a81c0 0x563258842f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.637+0000 7ff2ef475740 4 client.29809 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:22:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.637+0000 7ff2ef475740 1 -- 172.21.15.53:0/1966028819 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56325872a9f0 con 0x5632583a81c0 2024-08-31T06:22:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.638+0000 7ff2e62a7640 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632583a81c0 0x563258842f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.638+0000 7ff2e62a7640 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632583a81c0 0x563258842f20 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=409bd3b6ea62df1f server_cookie=cdc7e88747c9af97 in_seq=0 out_seq=0 2024-08-31T06:22:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.638+0000 7ff2c9ffb640 10 client.29809 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:20.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:20 smithi153 ceph-mon[22320]: pgmap v868: 97 pgs: 97 active+clean; 571 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 363 op/s 2024-08-31T06:22:20.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:20 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:20.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:20 smithi053 ceph-mon[18924]: pgmap v868: 97 pgs: 97 active+clean; 571 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 363 op/s 2024-08-31T06:22:20.727 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:20 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.743+0000 7ff2c9ffb640 1 -- 172.21.15.53:0/1966028819 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56325872a9f0 con 0x5632583a81c0 2024-08-31T06:22:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.743+0000 7ff2c9ffb640 10 client.29809 handle_command_reply: tid=0 2024-08-31T06:22:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.744+0000 7ff2ef475740 1 client.29809 shutdown 2024-08-31T06:22:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.744+0000 7ff2ef475740 1 -- 172.21.15.53:0/1966028819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 msgr2=0x5632587cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.744+0000 7ff2ef475740 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587cb9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00a9100 tx=0x7ff2d00aba60 comp rx=0 tx=0).stop 2024-08-31T06:22:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.744+0000 7ff2ef475740 1 -- 172.21.15.53:0/1966028819 shutdown_connections 2024-08-31T06:22:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.744+0000 7ff2ef475740 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5632583a81c0 0x563258842f20 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.744+0000 7ff2ef475740 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5632584141b0 0x5632587c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.744+0000 7ff2ef475740 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5632583f34d0 0x5632587cb9e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.744+0000 7ff2ef475740 1 --2- 172.21.15.53:0/1966028819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5632583eb2f0 0x5632587cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.744+0000 7ff2ef475740 1 -- 172.21.15.53:0/1966028819 >> 172.21.15.53:0/1966028819 conn(0x563258408300 msgr2=0x5632587c4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.745+0000 7ff2c9ffb640 0 client.29809 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.745+0000 7ff2ef475740 1 -- 172.21.15.53:0/1966028819 shutdown_connections 2024-08-31T06:22:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.745+0000 7ff2ef475740 1 -- 172.21.15.53:0/1966028819 wait complete. 2024-08-31T06:22:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.745+0000 7ff2ef475740 20 client.29809 trim_cache size 0 max 16384 2024-08-31T06:22:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:22:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:22:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:22:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:22:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 -- 172.21.15.53:0/4041472791 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2cc0b4ca0 msgr2=0x7ff2cc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2cc0b4ca0 0x7ff2cc0b71b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8012010 tx=0x7ff2d8009f90 comp rx=0 tx=0).stop 2024-08-31T06:22:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 -- 172.21.15.53:0/4041472791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e01091d0 msgr2=0x7ff2e019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e01091d0 0x7ff2e019a6d0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e970 tx=0x7ff2d000ee30 comp rx=0 tx=0).stop 2024-08-31T06:22:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 -- 172.21.15.53:0/4041472791 shutdown_connections 2024-08-31T06:22:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff2cc0b4ca0 0x7ff2cc0b71b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2e0109b20 0x7ff2e019f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e01091d0 0x7ff2e019a6d0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 --2- 172.21.15.53:0/4041472791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e0101e00 0x7ff2e019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 -- 172.21.15.53:0/4041472791 >> 172.21.15.53:0/4041472791 conn(0x7ff2e0079c30 msgr2=0x7ff2e0107370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 -- 172.21.15.53:0/4041472791 shutdown_connections 2024-08-31T06:22:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:20.746+0000 7ff2e850b640 1 -- 172.21.15.53:0/4041472791 wait complete. 2024-08-31T06:22:21.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 28726 6.01 MB/sec execute 129 sec latency 76.285 ms 2024-08-31T06:22:22.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 28906 6.08 MB/sec execute 130 sec latency 57.046 ms 2024-08-31T06:22:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:22 smithi130 ceph-mon[22266]: pgmap v869: 97 pgs: 97 active+clean; 578 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 358 op/s 2024-08-31T06:22:22.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:22 smithi153 ceph-mon[22320]: pgmap v869: 97 pgs: 97 active+clean; 578 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 358 op/s 2024-08-31T06:22:22.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:22 smithi053 ceph-mon[18924]: pgmap v869: 97 pgs: 97 active+clean; 578 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 358 op/s 2024-08-31T06:22:23.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 29076 6.13 MB/sec execute 131 sec latency 61.330 ms 2024-08-31T06:22:24.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 29246 6.16 MB/sec execute 132 sec latency 106.493 ms 2024-08-31T06:22:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:24 smithi130 ceph-mon[22266]: pgmap v870: 97 pgs: 97 active+clean; 576 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 336 op/s 2024-08-31T06:22:24.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:24 smithi153 ceph-mon[22320]: pgmap v870: 97 pgs: 97 active+clean; 576 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 336 op/s 2024-08-31T06:22:24.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:24 smithi053 ceph-mon[18924]: pgmap v870: 97 pgs: 97 active+clean; 576 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 336 op/s 2024-08-31T06:22:25.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 29405 6.20 MB/sec execute 133 sec latency 111.477 ms 2024-08-31T06:22:26.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 29544 6.19 MB/sec execute 134 sec latency 98.960 ms 2024-08-31T06:22:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:26 smithi130 ceph-mon[22266]: pgmap v871: 97 pgs: 97 active+clean; 584 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 393 op/s 2024-08-31T06:22:26.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:26 smithi153 ceph-mon[22320]: pgmap v871: 97 pgs: 97 active+clean; 584 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 393 op/s 2024-08-31T06:22:26.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:26 smithi053 ceph-mon[18924]: pgmap v871: 97 pgs: 97 active+clean; 584 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 393 op/s 2024-08-31T06:22:27.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 29706 6.23 MB/sec execute 135 sec latency 100.325 ms 2024-08-31T06:22:27.746 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 31.7 2024-08-31T06:22:27.746 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:22:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:28.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 29834 6.22 MB/sec execute 136 sec latency 57.960 ms 2024-08-31T06:22:28.531 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:28 smithi053 ceph-mon[18924]: pgmap v872: 97 pgs: 97 active+clean; 590 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 386 op/s 2024-08-31T06:22:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:28 smithi130 ceph-mon[22266]: pgmap v872: 97 pgs: 97 active+clean; 590 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 386 op/s 2024-08-31T06:22:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.660+0000 7fb8cddd1640 1 -- 172.21.15.53:0/717582784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c81050a0 msgr2=0x7fb8c810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.660+0000 7fb8cddd1640 1 --2- 172.21.15.53:0/717582784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c81050a0 0x7fb8c810d5f0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009900 tx=0x7fb8bc02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:22:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.660+0000 7fb8cddd1640 1 -- 172.21.15.53:0/717582784 shutdown_connections 2024-08-31T06:22:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.660+0000 7fb8cddd1640 1 --2- 172.21.15.53:0/717582784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c810dbb0 0x7fb8c81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.660+0000 7fb8cddd1640 1 --2- 172.21.15.53:0/717582784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c81050a0 0x7fb8c810d5f0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.660+0000 7fb8cddd1640 1 --2- 172.21.15.53:0/717582784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c8104750 0x7fb8c8104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.660+0000 7fb8cddd1640 1 -- 172.21.15.53:0/717582784 >> 172.21.15.53:0/717582784 conn(0x7fb8c80794d0 msgr2=0x7fb8c80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:28.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.660+0000 7fb8cddd1640 1 -- 172.21.15.53:0/717582784 shutdown_connections 2024-08-31T06:22:28.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.660+0000 7fb8cddd1640 1 -- 172.21.15.53:0/717582784 wait complete. 2024-08-31T06:22:28.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.661+0000 7fb8cddd1640 1 Processor -- start 2024-08-31T06:22:28.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.661+0000 7fb8cddd1640 1 -- start start 2024-08-31T06:22:28.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8cddd1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c8104750 0x7fb8c810ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:28.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8cddd1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c81050a0 0x7fb8c810b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:28.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8cddd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c810dbb0 0x7fb8c810b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:28.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8cddd1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c8103db0 con 0x7fb8c810dbb0 2024-08-31T06:22:28.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8cddd1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c8103c30 con 0x7fb8c81050a0 2024-08-31T06:22:28.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8cddd1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c8103f30 con 0x7fb8c8104750 2024-08-31T06:22:28.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8c7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c810dbb0 0x7fb8c810b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:28.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8c7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c810dbb0 0x7fb8c810b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39302/0 (socket says 172.21.15.53:39302) 2024-08-31T06:22:28.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8c7fff640 1 -- 172.21.15.53:0/321855646 learned_addr learned my addr 172.21.15.53:0/321855646 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:28.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8c77fe640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c8104750 0x7fb8c810ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:28.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8c6ffd640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c81050a0 0x7fb8c810b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:28.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.662+0000 7fb8c7fff640 1 -- 172.21.15.53:0/321855646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c8104750 msgr2=0x7fb8c810ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:28.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.663+0000 7fb8c7fff640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c8104750 0x7fb8c810ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:28.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.663+0000 7fb8c7fff640 1 -- 172.21.15.53:0/321855646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c81050a0 msgr2=0x7fb8c810b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:28.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.663+0000 7fb8c7fff640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c81050a0 0x7fb8c810b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:28.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.663+0000 7fb8c7fff640 1 -- 172.21.15.53:0/321855646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c819aee0 con 0x7fb8c810dbb0 2024-08-31T06:22:28.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.663+0000 7fb8c7fff640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c810dbb0 0x7fb8c810b590 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000eb10 tx=0x7fb8c000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:28.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.664+0000 7fb8c4ff9640 1 -- 172.21.15.53:0/321855646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0004b20 con 0x7fb8c810dbb0 2024-08-31T06:22:28.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.664+0000 7fb8c4ff9640 1 -- 172.21.15.53:0/321855646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8c0004cc0 con 0x7fb8c810dbb0 2024-08-31T06:22:28.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.664+0000 7fb8cddd1640 1 -- 172.21.15.53:0/321855646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c819b1d0 con 0x7fb8c810dbb0 2024-08-31T06:22:28.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.664+0000 7fb8cddd1640 1 -- 172.21.15.53:0/321855646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c819b690 con 0x7fb8c810dbb0 2024-08-31T06:22:28.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.665+0000 7fb8c4ff9640 1 -- 172.21.15.53:0/321855646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0010690 con 0x7fb8c810dbb0 2024-08-31T06:22:28.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.667+0000 7fb8cddd1640 1 -- 172.21.15.53:0/321855646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c8104b60 con 0x7fb8c810dbb0 2024-08-31T06:22:28.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.667+0000 7fb8c4ff9640 1 -- 172.21.15.53:0/321855646 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb8c0005020 con 0x7fb8c810dbb0 2024-08-31T06:22:28.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.668+0000 7fb8c4ff9640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8b00b4cd0 0x7fb8b00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:28.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.669+0000 7fb8c77fe640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8b00b4cd0 0x7fb8b00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:28.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.669+0000 7fb8c4ff9640 1 -- 172.21.15.53:0/321855646 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7fb8c00e5b40 con 0x7fb8c810dbb0 2024-08-31T06:22:28.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.670+0000 7fb8c77fe640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8b00b4cd0 0x7fb8b00b71e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb8c810d570 tx=0x7fb8b8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:28.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:28 smithi153 ceph-mon[22320]: pgmap v872: 97 pgs: 97 active+clean; 590 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 386 op/s 2024-08-31T06:22:28.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:28.674+0000 7fb8c4ff9640 1 -- 172.21.15.53:0/321855646 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb8c00ac910 con 0x7fb8c810dbb0 2024-08-31T06:22:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.127+0000 7fb8cddd1640 1 -- 172.21.15.53:0/321855646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8c819ba40 con 0x7fb8c810dbb0 2024-08-31T06:22:29.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.129+0000 7fb8c4ff9640 1 -- 172.21.15.53:0/321855646 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+11992 (secure 0 0 0) 0x7fb8c00ac210 con 0x7fb8c810dbb0 2024-08-31T06:22:29.131 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:22:29.132 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":64,"btime":"2024-08-31T06:22:19:257335+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:22:18.810743+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:22:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 64 2024-08-31T06:22:29.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.132+0000 7fb8cddd1640 1 -- 172.21.15.53:0/321855646 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8b00b4cd0 msgr2=0x7fb8b00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:29.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.132+0000 7fb8cddd1640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8b00b4cd0 0x7fb8b00b71e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb8c810d570 tx=0x7fb8b8005f90 comp rx=0 tx=0).stop 2024-08-31T06:22:29.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.132+0000 7fb8cddd1640 1 -- 172.21.15.53:0/321855646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c810dbb0 msgr2=0x7fb8c810b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:29.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.132+0000 7fb8cddd1640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c810dbb0 0x7fb8c810b590 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000eb10 tx=0x7fb8c000c2d0 comp rx=0 tx=0).stop 2024-08-31T06:22:29.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.132+0000 7fb8cddd1640 1 -- 172.21.15.53:0/321855646 shutdown_connections 2024-08-31T06:22:29.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.132+0000 7fb8cddd1640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb8b00b4cd0 0x7fb8b00b71e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:29.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.132+0000 7fb8cddd1640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c810dbb0 0x7fb8c810b590 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:29.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.132+0000 7fb8cddd1640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8c81050a0 0x7fb8c810b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:29.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.132+0000 7fb8cddd1640 1 --2- 172.21.15.53:0/321855646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8c8104750 0x7fb8c810ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:29.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.132+0000 7fb8cddd1640 1 -- 172.21.15.53:0/321855646 >> 172.21.15.53:0/321855646 conn(0x7fb8c80794d0 msgr2=0x7fb8c80ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:29.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.133+0000 7fb8cddd1640 1 -- 172.21.15.53:0/321855646 shutdown_connections 2024-08-31T06:22:29.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:29.133+0000 7fb8cddd1640 1 -- 172.21.15.53:0/321855646 wait complete. 2024-08-31T06:22:29.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 29957 6.21 MB/sec execute 137 sec latency 80.410 ms 2024-08-31T06:22:29.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:29 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/321855646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:22:29.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:29 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/321855646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:22:29.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:29 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/321855646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:22:29.838 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 151.7 --await-for 45.0' 2024-08-31T06:22:29.838 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 151.7 --await-for 45.0 2024-08-31T06:22:30.219 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:30.373 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30107 6.24 MB/sec execute 138 sec latency 86.711 ms 2024-08-31T06:22:30.537 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:30 smithi053 ceph-mon[18924]: pgmap v873: 97 pgs: 97 active+clean; 595 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 360 op/s 2024-08-31T06:22:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:30 smithi130 ceph-mon[22266]: pgmap v873: 97 pgs: 97 active+clean; 595 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 360 op/s 2024-08-31T06:22:30.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:30 smithi153 ceph-mon[22320]: pgmap v873: 97 pgs: 97 active+clean; 595 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 360 op/s 2024-08-31T06:22:30.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.797+0000 7f917eb58640 1 -- 172.21.15.53:0/1147300960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178105290 msgr2=0x7f91781056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:30.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.797+0000 7f917eb58640 1 --2- 172.21.15.53:0/1147300960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178105290 0x7f91781056a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f916c009900 tx=0x7f916c02a410 comp rx=0 tx=0).stop 2024-08-31T06:22:30.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.797+0000 7f917eb58640 1 -- 172.21.15.53:0/1147300960 shutdown_connections 2024-08-31T06:22:30.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.797+0000 7f917eb58640 1 --2- 172.21.15.53:0/1147300960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9178109bc0 0x7f91781103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.797+0000 7f917eb58640 1 --2- 172.21.15.53:0/1147300960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9178109270 0x7f9178109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.797+0000 7f917eb58640 1 --2- 172.21.15.53:0/1147300960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178105290 0x7f91781056a0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.797+0000 7f917eb58640 1 -- 172.21.15.53:0/1147300960 >> 172.21.15.53:0/1147300960 conn(0x7f9178079610 msgr2=0x7f9178079a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.798+0000 7f917eb58640 1 -- 172.21.15.53:0/1147300960 shutdown_connections 2024-08-31T06:22:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.798+0000 7f917eb58640 1 -- 172.21.15.53:0/1147300960 wait complete. 2024-08-31T06:22:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.799+0000 7f917eb58640 1 Processor -- start 2024-08-31T06:22:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.799+0000 7f917eb58640 1 -- start start 2024-08-31T06:22:30.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.799+0000 7f917eb58640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9178105290 0x7f91781a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.799+0000 7f917eb58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178109270 0x7f91781a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.799+0000 7f917eb58640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9178109bc0 0x7f91781ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917eb58640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9178113730 con 0x7f9178109270 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917eb58640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f91781135b0 con 0x7f9178105290 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917eb58640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91781138b0 con 0x7f9178109bc0 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f9177fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178109270 0x7f91781a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917c8f4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9178105290 0x7f91781a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917c8f4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9178105290 0x7f91781a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47240/0 (socket says 172.21.15.53:47240) 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917c8f4640 1 -- 172.21.15.53:0/4202617812 learned_addr learned my addr 172.21.15.53:0/4202617812 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f9177fff640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178109270 0x7f91781a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39308/0 (socket says 172.21.15.53:39308) 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917d0f5640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9178109bc0 0x7f91781ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917c8f4640 1 -- 172.21.15.53:0/4202617812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9178109bc0 msgr2=0x7f91781ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917c8f4640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9178109bc0 0x7f91781ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917c8f4640 1 -- 172.21.15.53:0/4202617812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178109270 msgr2=0x7f91781a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917c8f4640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178109270 0x7f91781a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f917c8f4640 1 -- 172.21.15.53:0/4202617812 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91781ac9d0 con 0x7f9178105290 2024-08-31T06:22:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.800+0000 7f9177fff640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178109270 0x7f91781a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:30.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.801+0000 7f917c8f4640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9178105290 0x7f91781a1410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f916c009230 tx=0x7f916c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:30.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.801+0000 7f9175ffb640 1 -- 172.21.15.53:0/4202617812 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c03f030 con 0x7f9178105290 2024-08-31T06:22:30.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.801+0000 7f917eb58640 1 -- 172.21.15.53:0/4202617812 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91781acba0 con 0x7f9178105290 2024-08-31T06:22:30.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.801+0000 7f9175ffb640 1 -- 172.21.15.53:0/4202617812 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f916c003a80 con 0x7f9178105290 2024-08-31T06:22:30.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.801+0000 7f9175ffb640 1 -- 172.21.15.53:0/4202617812 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c035070 con 0x7f9178105290 2024-08-31T06:22:30.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.801+0000 7f917eb58640 1 -- 172.21.15.53:0/4202617812 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91781ad0a0 con 0x7f9178105290 2024-08-31T06:22:30.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.804+0000 7f9175ffb640 1 -- 172.21.15.53:0/4202617812 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f916c042030 con 0x7f9178105290 2024-08-31T06:22:30.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f91850cd740 1 Processor -- start 2024-08-31T06:22:30.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f91850cd740 1 -- start start 2024-08-31T06:22:30.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f91850cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e246a840 0x55b8e2811c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f91850cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 0x55b8e28121d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f91850cd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 0x55b8e2812710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f91850cd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8e2786330 con 0x55b8e2449b60 2024-08-31T06:22:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f91850cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b8e27758c0 con 0x55b8e246a840 2024-08-31T06:22:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f91850cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b8e2779870 con 0x55b8e2441980 2024-08-31T06:22:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f917c8f4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 0x55b8e28121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f917c8f4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 0x55b8e28121d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:60460/0 (socket says 172.21.15.53:60460) 2024-08-31T06:22:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f9177fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 0x55b8e2812710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.805+0000 7f917c8f4640 1 -- 172.21.15.53:0/3673719155 learned_addr learned my addr 172.21.15.53:0/3673719155 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:30.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.806+0000 7f9175ffb640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91680b4ca0 0x7f91680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.806+0000 7f9177fff640 1 -- 172.21.15.53:0/3673719155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 msgr2=0x55b8e28121d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:30.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.806+0000 7f9177fff640 1 --2- 172.21.15.53:0/3673719155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 0x55b8e28121d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.806+0000 7f9177fff640 1 -- 172.21.15.53:0/3673719155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e246a840 msgr2=0x55b8e2811c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:30.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.806+0000 7f9177fff640 1 --2- 172.21.15.53:0/3673719155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e246a840 0x55b8e2811c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.806+0000 7f917d0f5640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91680b4ca0 0x7f91680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.806+0000 7f9177fff640 1 -- 172.21.15.53:0/3673719155 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8e272ddf0 con 0x55b8e2449b60 2024-08-31T06:22:30.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.806+0000 7f9175ffb640 1 -- 172.21.15.53:0/4202617812 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f916c105f20 con 0x7f9178105290 2024-08-31T06:22:30.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.806+0000 7f9177fff640 1 --2- 172.21.15.53:0/3673719155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 0x55b8e2812710 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f917806a630 tx=0x7f91640118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22e810e8d7f21c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:30.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.807+0000 7f9162ffd640 1 -- 172.21.15.53:0/3673719155 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164004310 con 0x55b8e2449b60 2024-08-31T06:22:30.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.807+0000 7f9162ffd640 1 -- 172.21.15.53:0/3673719155 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91640044b0 con 0x55b8e2449b60 2024-08-31T06:22:30.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.807+0000 7f9162ffd640 1 -- 172.21.15.53:0/3673719155 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916400f8b0 con 0x55b8e2449b60 2024-08-31T06:22:30.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.808+0000 7f91850cd740 1 -- 172.21.15.53:0/3673719155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 msgr2=0x55b8e2812710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:30.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.808+0000 7f917d0f5640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91680b4ca0 0x7f91680b71b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f9170009990 tx=0x7f9170009920 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:30.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.808+0000 7f91850cd740 1 --2- 172.21.15.53:0/3673719155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 0x55b8e2812710 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f917806a630 tx=0x7f91640118d0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.808+0000 7f91850cd740 1 -- 172.21.15.53:0/3673719155 shutdown_connections 2024-08-31T06:22:30.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.808+0000 7f91850cd740 1 --2- 172.21.15.53:0/3673719155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 0x55b8e2812710 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.808+0000 7f91850cd740 1 --2- 172.21.15.53:0/3673719155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 0x55b8e28121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.808+0000 7f91850cd740 1 --2- 172.21.15.53:0/3673719155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e246a840 0x55b8e2811c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.808+0000 7f91850cd740 1 -- 172.21.15.53:0/3673719155 >> 172.21.15.53:0/3673719155 conn(0x55b8e245e990 msgr2=0x55b8e280fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:30.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.808+0000 7f91850cd740 1 -- 172.21.15.53:0/3673719155 shutdown_connections 2024-08-31T06:22:30.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.808+0000 7f91850cd740 1 -- 172.21.15.53:0/3673719155 wait complete. 2024-08-31T06:22:30.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.809+0000 7f91850cd740 1 -- start start 2024-08-31T06:22:30.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.809+0000 7f91850cd740 1 Processor -- start 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.809+0000 7f91850cd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 0x55b8e281d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.809+0000 7f91850cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2449b60 0x55b8e281d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f91850cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e246a840 0x55b8e2829790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f91850cd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8e25d87a0 con 0x55b8e2441980 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f91850cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b8e26fc240 con 0x55b8e246a840 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f91850cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b8e2820470 con 0x55b8e2449b60 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f91850cd740 10 client.0 _ll_register_callbacks cb 0x55b8e2482090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f917c8f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 0x55b8e281d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f917d0f5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e246a840 0x55b8e2829790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f917c8f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 0x55b8e281d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39326/0 (socket says 172.21.15.53:39326) 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f917c8f4640 1 -- 172.21.15.53:0/979642678 learned_addr learned my addr 172.21.15.53:0/979642678 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:30.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f9177fff640 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2449b60 0x55b8e281d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f917c8f4640 1 -- 172.21.15.53:0/979642678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2449b60 msgr2=0x55b8e281d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f917c8f4640 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2449b60 0x55b8e281d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f917c8f4640 1 -- 172.21.15.53:0/979642678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e246a840 msgr2=0x55b8e2829790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f917c8f4640 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e246a840 0x55b8e2829790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.810+0000 7f917c8f4640 1 -- 172.21.15.53:0/979642678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8e27322b0 con 0x55b8e2441980 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.811+0000 7f917c8f4640 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 0x55b8e281d460 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f916c0c8720 tx=0x7f916c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9ee32eb4313532 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.811+0000 7f9157fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.811+0000 7f9157fff640 1 -- 172.21.15.53:0/979642678 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c049050 con 0x55b8e2441980 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.811+0000 7f9157fff640 1 -- 172.21.15.53:0/979642678 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f916c003c30 con 0x55b8e2441980 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.811+0000 7f91850cd740 1 -- 172.21.15.53:0/979642678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91640044b0 con 0x55b8e2441980 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.812+0000 7f9157fff640 1 -- 172.21.15.53:0/979642678 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f916c0cc470 con 0x55b8e2441980 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.812+0000 7f91850cd740 10 client.20949 fetch_fsmap learned FSMap version 64 2024-08-31T06:22:30.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.812+0000 7f91850cd740 1 -- 172.21.15.53:0/979642678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55b8e24e4b90 con 0x55b8e2441980 2024-08-31T06:22:30.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.812+0000 7f9157fff640 1 -- 172.21.15.53:0/979642678 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91640044b0 con 0x55b8e2441980 2024-08-31T06:22:30.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.812+0000 7f9157fff640 1 -- 172.21.15.53:0/979642678 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 64) ==== 8382+0+0 (secure 0 0 0) 0x7f916c109c20 con 0x55b8e2441980 2024-08-31T06:22:30.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.812+0000 7f91850cd740 10 client.20949 fetch_fsmap finished waiting for FSMap version 64 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.812+0000 7f91850cd740 10 client.20949 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.812+0000 7f91850cd740 20 client.20949 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.812+0000 7f91850cd740 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b8e24291c0 0x55b8e282f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.812+0000 7f91850cd740 4 client.20949 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.812+0000 7f91850cd740 1 -- 172.21.15.53:0/979642678 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8e2788280 con 0x55b8e24291c0 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.813+0000 7f9177fff640 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b8e24291c0 0x55b8e282f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.813+0000 7f9157fff640 10 client.20949 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.813+0000 7f9177fff640 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b8e24291c0 0x55b8e282f670 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9be57ea20025ec48 server_cookie=164366c56d131e14 in_seq=0 out_seq=0 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f9157fff640 1 -- 172.21.15.53:0/979642678 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b8e2788280 con 0x55b8e24291c0 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f9157fff640 10 client.20949 handle_command_reply: tid=0 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f91850cd740 1 client.20949 shutdown 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f91850cd740 1 -- 172.21.15.53:0/979642678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 msgr2=0x55b8e281d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f91850cd740 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 0x55b8e281d460 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f916c0c8720 tx=0x7f916c005c90 comp rx=0 tx=0).stop 2024-08-31T06:22:30.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f91850cd740 1 -- 172.21.15.53:0/979642678 shutdown_connections 2024-08-31T06:22:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f91850cd740 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b8e24291c0 0x55b8e282f670 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f9157fff640 0 client.20949 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f91850cd740 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e246a840 0x55b8e2829790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f91850cd740 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2449b60 0x55b8e281d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f91850cd740 1 --2- 172.21.15.53:0/979642678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 0x55b8e281d460 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f91850cd740 1 -- 172.21.15.53:0/979642678 >> 172.21.15.53:0/979642678 conn(0x55b8e245e990 msgr2=0x55b8e2814e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.814+0000 7f91850cd740 1 -- 172.21.15.53:0/979642678 shutdown_connections 2024-08-31T06:22:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.815+0000 7f91850cd740 1 -- 172.21.15.53:0/979642678 wait complete. 2024-08-31T06:22:30.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.815+0000 7f91850cd740 20 client.20949 trim_cache size 0 max 16384 2024-08-31T06:22:30.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.839+0000 7f91850cd740 1 Processor -- start 2024-08-31T06:22:30.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.839+0000 7f91850cd740 1 -- start start 2024-08-31T06:22:30.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.839+0000 7f91850cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e24291c0 0x55b8e281f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.839+0000 7f91850cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 0x55b8e2829690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.839+0000 7f91850cd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 0x55b8e2829bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.839+0000 7f91850cd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f91781b5a50 con 0x55b8e2449b60 2024-08-31T06:22:30.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.839+0000 7f91850cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f91781b7680 con 0x55b8e24291c0 2024-08-31T06:22:30.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.839+0000 7f91850cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91781b6180 con 0x55b8e2441980 2024-08-31T06:22:30.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f917d0f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 0x55b8e2829bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f9177fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 0x55b8e2829690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f917c8f4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e24291c0 0x55b8e281f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f917d0f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 0x55b8e2829bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39334/0 (socket says 172.21.15.53:39334) 2024-08-31T06:22:30.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f9177fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 0x55b8e2829690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:60470/0 (socket says 172.21.15.53:60470) 2024-08-31T06:22:30.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f917d0f5640 1 -- 172.21.15.53:0/3318470100 learned_addr learned my addr 172.21.15.53:0/3318470100 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:30.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f9177fff640 1 -- 172.21.15.53:0/3318470100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e24291c0 msgr2=0x55b8e281f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:30.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f9177fff640 1 --2- 172.21.15.53:0/3318470100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e24291c0 0x55b8e281f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f9177fff640 1 -- 172.21.15.53:0/3318470100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 msgr2=0x55b8e2829bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:30.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f9177fff640 1 --2- 172.21.15.53:0/3318470100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 0x55b8e2829bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f9177fff640 1 -- 172.21.15.53:0/3318470100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8e2745d90 con 0x55b8e2441980 2024-08-31T06:22:30.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f917d0f5640 1 --2- 172.21.15.53:0/3318470100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 0x55b8e2829bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:30.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.840+0000 7f9177fff640 1 --2- 172.21.15.53:0/3318470100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 0x55b8e2829690 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91640096e0 tx=0x7f9164011e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc3eccc6ccf478ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:30.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.841+0000 7f91627fc640 1 -- 172.21.15.53:0/3318470100 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164009b30 con 0x55b8e2441980 2024-08-31T06:22:30.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.841+0000 7f91627fc640 1 -- 172.21.15.53:0/3318470100 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9164030030 con 0x55b8e2441980 2024-08-31T06:22:30.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.841+0000 7f91627fc640 1 -- 172.21.15.53:0/3318470100 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164004a40 con 0x55b8e2441980 2024-08-31T06:22:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.842+0000 7f91850cd740 1 -- 172.21.15.53:0/3318470100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 msgr2=0x55b8e2829690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.842+0000 7f91850cd740 1 --2- 172.21.15.53:0/3318470100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 0x55b8e2829690 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91640096e0 tx=0x7f9164011e50 comp rx=0 tx=0).stop 2024-08-31T06:22:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.842+0000 7f91850cd740 1 -- 172.21.15.53:0/3318470100 shutdown_connections 2024-08-31T06:22:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.842+0000 7f91850cd740 1 --2- 172.21.15.53:0/3318470100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2449b60 0x55b8e2829bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.842+0000 7f91850cd740 1 --2- 172.21.15.53:0/3318470100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e2441980 0x55b8e2829690 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.842+0000 7f91850cd740 1 --2- 172.21.15.53:0/3318470100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e24291c0 0x55b8e281f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.842+0000 7f91850cd740 1 -- 172.21.15.53:0/3318470100 >> 172.21.15.53:0/3318470100 conn(0x55b8e245e990 msgr2=0x55b8e280e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:30.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.842+0000 7f91850cd740 1 -- 172.21.15.53:0/3318470100 shutdown_connections 2024-08-31T06:22:30.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.842+0000 7f91850cd740 1 -- 172.21.15.53:0/3318470100 wait complete. 2024-08-31T06:22:30.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.843+0000 7f91850cd740 1 -- start start 2024-08-31T06:22:30.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.843+0000 7f91850cd740 1 Processor -- start 2024-08-31T06:22:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.843+0000 7f91850cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e24291c0 0x55b8e2825dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.843+0000 7f91850cd740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 0x55b8e28206b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f91850cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e2449b60 0x55b8e2820bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f91850cd740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f91781b6fb0 con 0x55b8e2441980 2024-08-31T06:22:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f91850cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f91781b68b0 con 0x55b8e2449b60 2024-08-31T06:22:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f91850cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91781b3a50 con 0x55b8e24291c0 2024-08-31T06:22:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f91850cd740 10 client.0 _ll_register_callbacks cb 0x7f916c109760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f917c8f4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e24291c0 0x55b8e2825dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f917c8f4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e24291c0 0x55b8e2825dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:60478/0 (socket says 172.21.15.53:60478) 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f917c8f4640 1 -- 172.21.15.53:0/2176653401 learned_addr learned my addr 172.21.15.53:0/2176653401 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f9177fff640 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 0x55b8e28206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f917d0f5640 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e2449b60 0x55b8e2820bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f917c8f4640 1 -- 172.21.15.53:0/2176653401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e2449b60 msgr2=0x55b8e2820bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f917c8f4640 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e2449b60 0x55b8e2820bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f917c8f4640 1 -- 172.21.15.53:0/2176653401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 msgr2=0x55b8e28206b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f917c8f4640 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 0x55b8e28206b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f917c8f4640 1 -- 172.21.15.53:0/2176653401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8e2821260 con 0x55b8e24291c0 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.844+0000 7f9177fff640 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 0x55b8e28206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.845+0000 7f917c8f4640 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e24291c0 0x55b8e2825dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f916c0c9910 tx=0x7f916c0d0fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3fe54f7cd028f92 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:30.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.845+0000 7f9157fff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:22:30.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.845+0000 7f9157fff640 1 -- 172.21.15.53:0/2176653401 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c049040 con 0x55b8e24291c0 2024-08-31T06:22:30.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.845+0000 7f91850cd740 1 -- 172.21.15.53:0/2176653401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9164030030 con 0x55b8e24291c0 2024-08-31T06:22:30.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.845+0000 7f9157fff640 1 -- 172.21.15.53:0/2176653401 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f916c0c8c90 con 0x55b8e24291c0 2024-08-31T06:22:30.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f9157fff640 1 -- 172.21.15.53:0/2176653401 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f916c0cbe10 con 0x55b8e24291c0 2024-08-31T06:22:30.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f91850cd740 10 client.29833 fetch_fsmap learned FSMap version 64 2024-08-31T06:22:30.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f91850cd740 1 -- 172.21.15.53:0/2176653401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55b8e289ae40 con 0x55b8e24291c0 2024-08-31T06:22:30.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f9157fff640 1 -- 172.21.15.53:0/2176653401 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9164030030 con 0x55b8e24291c0 2024-08-31T06:22:30.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f9157fff640 1 -- 172.21.15.53:0/2176653401 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 64) ==== 8382+0+0 (secure 0 0 0) 0x7f916c07c230 con 0x55b8e24291c0 2024-08-31T06:22:30.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f91850cd740 10 client.29833 fetch_fsmap finished waiting for FSMap version 64 2024-08-31T06:22:30.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f91850cd740 10 client.29833 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:22:30.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f91850cd740 20 client.29833 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:30.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f91850cd740 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b8e246a840 0x55b8e289d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:30.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f91850cd740 4 client.29833 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 151.7, "await_for": 45.0}] 2024-08-31T06:22:30.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f91850cd740 1 -- 172.21.15.53:0/2176653401 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 151.7, "await_for": 45.0}) -- 0x55b8e2783d20 con 0x55b8e246a840 2024-08-31T06:22:30.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.846+0000 7f9177fff640 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b8e246a840 0x55b8e289d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:30.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.847+0000 7f9157fff640 10 client.29833 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:30.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:30.847+0000 7f9177fff640 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b8e246a840 0x55b8e289d3f0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58773f8f17ffedad server_cookie=308ba5567df9c399 in_seq=0 out_seq=0 2024-08-31T06:22:31.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f9157fff640 1 -- 172.21.15.53:0/2176653401 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b8e2783d20 con 0x55b8e246a840 2024-08-31T06:22:31.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f9157fff640 10 client.29833 handle_command_reply: tid=0 2024-08-31T06:22:31.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f91850cd740 1 client.29833 shutdown 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f91850cd740 1 -- 172.21.15.53:0/2176653401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e24291c0 msgr2=0x55b8e2825dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f91850cd740 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e24291c0 0x55b8e2825dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f916c0c9910 tx=0x7f916c0d0fe0 comp rx=0 tx=0).stop 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f91850cd740 1 -- 172.21.15.53:0/2176653401 shutdown_connections 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f91850cd740 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b8e246a840 0x55b8e289d3f0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f9157fff640 0 client.29833 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f91850cd740 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b8e2449b60 0x55b8e2820bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f91850cd740 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8e2441980 0x55b8e28206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f91850cd740 1 --2- 172.21.15.53:0/2176653401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8e24291c0 0x55b8e2825dc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.199+0000 7f91850cd740 1 -- 172.21.15.53:0/2176653401 >> 172.21.15.53:0/2176653401 conn(0x55b8e245e990 msgr2=0x55b8e280e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.200+0000 7f91850cd740 1 -- 172.21.15.53:0/2176653401 shutdown_connections 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.200+0000 7f91850cd740 1 -- 172.21.15.53:0/2176653401 wait complete. 2024-08-31T06:22:31.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.200+0000 7f91850cd740 20 client.29833 trim_cache size 0 max 16384 2024-08-31T06:22:31.204 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:22:31.204 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 64, 2024-08-31T06:22:31.204 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:22:31.204 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 58, 2024-08-31T06:22:31.204 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:22:31.204 INFO:teuthology.orchestra.run.smithi053.stdout: "cab2cb4e": { 2024-08-31T06:22:31.204 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 58, 2024-08-31T06:22:31.204 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:22:31.204 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:22:31.204 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 151.7, 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:22:31.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:22:31.206 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:22:31.206 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 -- 172.21.15.53:0/4202617812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91680b4ca0 msgr2=0x7f91680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91680b4ca0 0x7f91680b71b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f9170009990 tx=0x7f9170009920 comp rx=0 tx=0).stop 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 -- 172.21.15.53:0/4202617812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9178105290 msgr2=0x7f91781a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9178105290 0x7f91781a1410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f916c009230 tx=0x7f916c004270 comp rx=0 tx=0).stop 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 -- 172.21.15.53:0/4202617812 shutdown_connections 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91680b4ca0 0x7f91680b71b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9178109bc0 0x7f91781ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9178109270 0x7f91781a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 --2- 172.21.15.53:0/4202617812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9178105290 0x7f91781a1410 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 -- 172.21.15.53:0/4202617812 >> 172.21.15.53:0/4202617812 conn(0x7f9178079610 msgr2=0x7f9178107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 -- 172.21.15.53:0/4202617812 shutdown_connections 2024-08-31T06:22:31.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:31.201+0000 7f917eb58640 1 -- 172.21.15.53:0/4202617812 wait complete. 2024-08-31T06:22:31.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 6.20 MB/sec execute 139 sec latency 533.547 ms 2024-08-31T06:22:31.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:22:31.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:22:31.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:22:31.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:22:31.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:22:31.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:22:31.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:22:31.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:22:31.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:22:32.007 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'cab2cb4e', quiesce took 4.3 seconds. Will release after: 27.4 2024-08-31T06:22:32.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 6.16 MB/sec execute 140 sec latency 1533.590 ms 2024-08-31T06:22:32.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:32 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:22:32.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:32 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:22:32.701 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:32 smithi130 ceph-mon[22266]: pgmap v874: 97 pgs: 97 active+clean; 601 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 388 op/s 2024-08-31T06:22:32.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:32 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:22:32.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:32 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:22:32.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:32 smithi153 ceph-mon[22320]: pgmap v874: 97 pgs: 97 active+clean; 601 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 388 op/s 2024-08-31T06:22:32.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:32 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:22:32.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:32 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:22:32.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:32 smithi053 ceph-mon[18924]: pgmap v874: 97 pgs: 97 active+clean; 601 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 388 op/s 2024-08-31T06:22:33.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 6.12 MB/sec execute 141 sec latency 2533.662 ms 2024-08-31T06:22:33.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:33 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:33.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:33 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:33.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:33 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.863+0000 7fa7673ad640 1 -- 172.21.15.53:0/1818103854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7601080b0 msgr2=0x7fa7601084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.863+0000 7fa7673ad640 1 --2- 172.21.15.53:0/1818103854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7601080b0 0x7fa7601084c0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fa750009900 tx=0x7fa75002a410 comp rx=0 tx=0).stop 2024-08-31T06:22:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.864+0000 7fa7673ad640 1 -- 172.21.15.53:0/1818103854 shutdown_connections 2024-08-31T06:22:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.864+0000 7fa7673ad640 1 --2- 172.21.15.53:0/1818103854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760108a00 0x7fa76010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.864+0000 7fa7673ad640 1 --2- 172.21.15.53:0/1818103854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7601080b0 0x7fa7601084c0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.864+0000 7fa7673ad640 1 --2- 172.21.15.53:0/1818103854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa760102780 0x7fa760102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.864+0000 7fa7673ad640 1 -- 172.21.15.53:0/1818103854 >> 172.21.15.53:0/1818103854 conn(0x7fa7600fe160 msgr2=0x7fa7601005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.864+0000 7fa7673ad640 1 -- 172.21.15.53:0/1818103854 shutdown_connections 2024-08-31T06:22:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.864+0000 7fa7673ad640 1 -- 172.21.15.53:0/1818103854 wait complete. 2024-08-31T06:22:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.864+0000 7fa7673ad640 1 Processor -- start 2024-08-31T06:22:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.864+0000 7fa7673ad640 1 -- start start 2024-08-31T06:22:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa7673ad640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa760102780 0x7fa76019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa7673ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7601080b0 0x7fa76019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa7673ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760108a00 0x7fa76019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa7673ad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa7601125e0 con 0x7fa7601080b0 2024-08-31T06:22:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa7673ad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa760112460 con 0x7fa760108a00 2024-08-31T06:22:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa7673ad640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa760112760 con 0x7fa760102780 2024-08-31T06:22:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa764948640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7601080b0 0x7fa76019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa764948640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7601080b0 0x7fa76019b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56102/0 (socket says 172.21.15.53:56102) 2024-08-31T06:22:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa764948640 1 -- 172.21.15.53:0/1358260400 learned_addr learned my addr 172.21.15.53:0/1358260400 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa76594a640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760108a00 0x7fa76019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa765149640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa760102780 0x7fa76019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa764948640 1 -- 172.21.15.53:0/1358260400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa760102780 msgr2=0x7fa76019af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa764948640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa760102780 0x7fa76019af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa764948640 1 -- 172.21.15.53:0/1358260400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760108a00 msgr2=0x7fa76019b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa764948640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760108a00 0x7fa76019b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa764948640 1 -- 172.21.15.53:0/1358260400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7601a6230 con 0x7fa7601080b0 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.865+0000 7fa764948640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7601080b0 0x7fa76019b4b0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fa75002a930 tx=0x7fa750003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.866+0000 7fa7567fc640 1 -- 172.21.15.53:0/1358260400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75003f070 con 0x7fa7601080b0 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.866+0000 7fa7567fc640 1 -- 172.21.15.53:0/1358260400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa750003e10 con 0x7fa7601080b0 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.866+0000 7fa7673ad640 1 -- 172.21.15.53:0/1358260400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7601a64c0 con 0x7fa7601080b0 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.866+0000 7fa7567fc640 1 -- 172.21.15.53:0/1358260400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750035030 con 0x7fa7601080b0 2024-08-31T06:22:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.866+0000 7fa7673ad640 1 -- 172.21.15.53:0/1358260400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7601a6a30 con 0x7fa7601080b0 2024-08-31T06:22:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa76e3f8740 1 Processor -- start 2024-08-31T06:22:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa76e3f8740 1 -- start start 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899ba1b0 0x561189d5dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899912f0 0x561189d5e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899994d0 0x561189d5e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561189cd3000 con 0x5611899912f0 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561189cc2590 con 0x5611899994d0 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561189cc6540 con 0x5611899ba1b0 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa7567fc640 1 -- 172.21.15.53:0/1358260400 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa750042070 con 0x7fa7601080b0 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa765149640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899912f0 0x561189d5e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa765149640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899912f0 0x561189d5e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56118/0 (socket says 172.21.15.53:56118) 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa765149640 1 -- 172.21.15.53:0/2833449328 learned_addr learned my addr 172.21.15.53:0/2833449328 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa764948640 1 --2- 172.21.15.53:0/2833449328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899994d0 0x561189d5e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.869+0000 7fa76594a640 1 --2- 172.21.15.53:0/2833449328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899ba1b0 0x561189d5dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa765149640 1 -- 172.21.15.53:0/2833449328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899ba1b0 msgr2=0x561189d5dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa765149640 1 --2- 172.21.15.53:0/2833449328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899ba1b0 0x561189d5dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa765149640 1 -- 172.21.15.53:0/2833449328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899994d0 msgr2=0x561189d5e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa765149640 1 --2- 172.21.15.53:0/2833449328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899994d0 0x561189d5e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa765149640 1 -- 172.21.15.53:0/2833449328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561189a25790 con 0x5611899912f0 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa765149640 1 --2- 172.21.15.53:0/2833449328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899912f0 0x561189d5e220 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009a40 tx=0x7fa75c009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c6d38f15bbfc55 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa7567fc640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa74c0b4ca0 0x7fa74c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa74b7fe640 1 -- 172.21.15.53:0/2833449328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c017070 con 0x5611899912f0 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa76594a640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa74c0b4ca0 0x7fa74c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa74b7fe640 1 -- 172.21.15.53:0/2833449328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa75c013470 con 0x5611899912f0 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa74b7fe640 1 -- 172.21.15.53:0/2833449328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c012630 con 0x5611899912f0 2024-08-31T06:22:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.870+0000 7fa7567fc640 1 -- 172.21.15.53:0/1358260400 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7fa750105cc0 con 0x7fa7601080b0 2024-08-31T06:22:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.871+0000 7fa76e3f8740 1 -- 172.21.15.53:0/2833449328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899912f0 msgr2=0x561189d5e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.871+0000 7fa76594a640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa74c0b4ca0 0x7fa74c0b71b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa758005fd0 tx=0x7fa758009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.871+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/2833449328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899912f0 0x561189d5e220 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009a40 tx=0x7fa75c009f00 comp rx=0 tx=0).stop 2024-08-31T06:22:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.871+0000 7fa76e3f8740 1 -- 172.21.15.53:0/2833449328 shutdown_connections 2024-08-31T06:22:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.871+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/2833449328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899994d0 0x561189d5e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.871+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/2833449328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899912f0 0x561189d5e220 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.871+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/2833449328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899ba1b0 0x561189d5dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.871+0000 7fa76e3f8740 1 -- 172.21.15.53:0/2833449328 >> 172.21.15.53:0/2833449328 conn(0x5611899ae300 msgr2=0x561189d5bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.871+0000 7fa76e3f8740 1 -- 172.21.15.53:0/2833449328 shutdown_connections 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.871+0000 7fa76e3f8740 1 -- 172.21.15.53:0/2833449328 wait complete. 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.872+0000 7fa76e3f8740 1 -- start start 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.872+0000 7fa76e3f8740 1 Processor -- start 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.872+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899912f0 0x561189d69850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.872+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899994d0 0x561189d69d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.872+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d75780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.872+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561189bfbab0 con 0x5611899ba1b0 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.872+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561189c49680 con 0x5611899994d0 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.872+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561189d6c460 con 0x5611899912f0 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.872+0000 7fa76e3f8740 10 client.0 _ll_register_callbacks cb 0x5611899d1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.872+0000 7fa76594a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d75780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa76594a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d75780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56122/0 (socket says 172.21.15.53:56122) 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa76594a640 1 -- 172.21.15.53:0/1923135482 learned_addr learned my addr 172.21.15.53:0/1923135482 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa765149640 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899912f0 0x561189d69850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa764948640 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899994d0 0x561189d69d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa76594a640 1 -- 172.21.15.53:0/1923135482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899912f0 msgr2=0x561189d69850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa76594a640 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899912f0 0x561189d69850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa76594a640 1 -- 172.21.15.53:0/1923135482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899994d0 msgr2=0x561189d69d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa76594a640 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899994d0 0x561189d69d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa76594a640 1 -- 172.21.15.53:0/1923135482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561189a9e620 con 0x5611899ba1b0 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa764948640 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899994d0 0x561189d69d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa76594a640 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d75780 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fa758005c40 tx=0x7fa758004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6458d7a47835d11 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa748ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa748ff9640 1 -- 172.21.15.53:0/1923135482 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758020620 con 0x5611899ba1b0 2024-08-31T06:22:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa748ff9640 1 -- 172.21.15.53:0/1923135482 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7fa7580207c0 con 0x5611899ba1b0 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1923135482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa75c013470 con 0x5611899ba1b0 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa748ff9640 1 -- 172.21.15.53:0/1923135482 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fa758020a00 con 0x5611899ba1b0 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa76e3f8740 10 client.20967 fetch_fsmap learned FSMap version 65 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.873+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1923135482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x561189d784b0 con 0x5611899ba1b0 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.874+0000 7fa748ff9640 1 -- 172.21.15.53:0/1923135482 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa75c013470 con 0x5611899ba1b0 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.874+0000 7fa748ff9640 1 -- 172.21.15.53:0/1923135482 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 65) ==== 8378+0+0 (secure 0 0 0) 0x7fa75800f040 con 0x5611899ba1b0 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.874+0000 7fa76e3f8740 10 client.20967 fetch_fsmap finished waiting for FSMap version 65 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.874+0000 7fa76e3f8740 10 client.20967 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.874+0000 7fa76e3f8740 20 client.20967 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.874+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561189978d80 0x561189d7ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.874+0000 7fa76e3f8740 4 client.20967 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.874+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1923135482 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561189cd4f50 con 0x561189978d80 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.874+0000 7fa765149640 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561189978d80 0x561189d7ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.875+0000 7fa765149640 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561189978d80 0x561189d7ba80 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80b3513bf6693d41 server_cookie=1fb0d660a6d1fd33 in_seq=0 out_seq=0 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.875+0000 7fa748ff9640 10 client.20967 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa748ff9640 1 -- 172.21.15.53:0/1923135482 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561189cd4f50 con 0x561189978d80 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa748ff9640 10 client.20967 handle_command_reply: tid=0 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 1 client.20967 shutdown 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1923135482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 msgr2=0x561189d75780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d75780 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fa758005c40 tx=0x7fa758004a40 comp rx=0 tx=0).stop 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1923135482 shutdown_connections 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561189978d80 0x561189d7ba80 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d75780 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899994d0 0x561189d69d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa748ff9640 0 client.20967 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1923135482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899912f0 0x561189d69850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1923135482 >> 172.21.15.53:0/1923135482 conn(0x5611899ae300 msgr2=0x561189d5ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1923135482 shutdown_connections 2024-08-31T06:22:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1923135482 wait complete. 2024-08-31T06:22:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.876+0000 7fa76e3f8740 20 client.20967 trim_cache size 0 max 16384 2024-08-31T06:22:33.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa76e3f8740 1 Processor -- start 2024-08-31T06:22:33.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa76e3f8740 1 -- start start 2024-08-31T06:22:33.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899912f0 0x561189d5bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899994d0 0x561189d75680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899ba1b0 0x561189d75bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa7601af560 con 0x5611899994d0 2024-08-31T06:22:33.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa7601b1160 con 0x5611899912f0 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa7601afc90 con 0x5611899ba1b0 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa764948640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899994d0 0x561189d75680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa764948640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899994d0 0x561189d75680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56130/0 (socket says 172.21.15.53:56130) 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa764948640 1 -- 172.21.15.53:0/4129258905 learned_addr learned my addr 172.21.15.53:0/4129258905 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.891+0000 7fa765149640 1 --2- 172.21.15.53:0/4129258905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899912f0 0x561189d5bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.892+0000 7fa76594a640 1 --2- 172.21.15.53:0/4129258905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899ba1b0 0x561189d75bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.892+0000 7fa764948640 1 -- 172.21.15.53:0/4129258905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899ba1b0 msgr2=0x561189d75bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.892+0000 7fa764948640 1 --2- 172.21.15.53:0/4129258905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899ba1b0 0x561189d75bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.892+0000 7fa764948640 1 -- 172.21.15.53:0/4129258905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899912f0 msgr2=0x561189d5bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.892+0000 7fa764948640 1 --2- 172.21.15.53:0/4129258905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899912f0 0x561189d5bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.892+0000 7fa764948640 1 -- 172.21.15.53:0/4129258905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561189d76100 con 0x5611899994d0 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.892+0000 7fa764948640 1 --2- 172.21.15.53:0/4129258905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899994d0 0x561189d75680 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fa7500c9600 tx=0x7fa750109810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8814398aaf4cd8a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.892+0000 7fa74affd640 1 -- 172.21.15.53:0/4129258905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750107070 con 0x5611899994d0 2024-08-31T06:22:33.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.892+0000 7fa74affd640 1 -- 172.21.15.53:0/4129258905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7500b3050 con 0x5611899994d0 2024-08-31T06:22:33.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.892+0000 7fa74affd640 1 -- 172.21.15.53:0/4129258905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750049030 con 0x5611899994d0 2024-08-31T06:22:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.893+0000 7fa76e3f8740 1 -- 172.21.15.53:0/4129258905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899994d0 msgr2=0x561189d75680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.893+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/4129258905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899994d0 0x561189d75680 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fa7500c9600 tx=0x7fa750109810 comp rx=0 tx=0).stop 2024-08-31T06:22:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.893+0000 7fa76e3f8740 1 -- 172.21.15.53:0/4129258905 shutdown_connections 2024-08-31T06:22:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.893+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/4129258905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899ba1b0 0x561189d75bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.893+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/4129258905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899994d0 0x561189d75680 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.893+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/4129258905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899912f0 0x561189d5bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.893+0000 7fa76e3f8740 1 -- 172.21.15.53:0/4129258905 >> 172.21.15.53:0/4129258905 conn(0x5611899ae300 msgr2=0x561189d5b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.893+0000 7fa76e3f8740 1 -- 172.21.15.53:0/4129258905 shutdown_connections 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.893+0000 7fa76e3f8740 1 -- 172.21.15.53:0/4129258905 wait complete. 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.893+0000 7fa76e3f8740 1 -- start start 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.893+0000 7fa76e3f8740 1 Processor -- start 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899912f0 0x561189d71c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899994d0 0x561189d66290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76e3f8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d667d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa7601b0a90 con 0x5611899ba1b0 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa7601b03c0 con 0x5611899912f0 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76e3f8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa7601ad560 con 0x5611899994d0 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76e3f8740 10 client.0 _ll_register_callbacks cb 0x7fa758009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76594a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76594a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d667d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56136/0 (socket says 172.21.15.53:56136) 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76594a640 1 -- 172.21.15.53:0/1871400646 learned_addr learned my addr 172.21.15.53:0/1871400646 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa765149640 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899912f0 0x561189d71c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa764948640 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899994d0 0x561189d66290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76594a640 1 -- 172.21.15.53:0/1871400646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899994d0 msgr2=0x561189d66290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76594a640 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899994d0 0x561189d66290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76594a640 1 -- 172.21.15.53:0/1871400646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899912f0 msgr2=0x561189d71c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76594a640 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899912f0 0x561189d71c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76594a640 1 -- 172.21.15.53:0/1871400646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561189d66d10 con 0x5611899ba1b0 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa76594a640 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d667d0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fa75801dd70 tx=0x7fa75801fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb43d92859d7eac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.894+0000 7fa748ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa748ff9640 1 -- 172.21.15.53:0/1871400646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580283f0 con 0x5611899ba1b0 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa748ff9640 1 -- 172.21.15.53:0/1871400646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7fa758020420 con 0x5611899ba1b0 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1871400646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7500b3050 con 0x5611899ba1b0 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa748ff9640 1 -- 172.21.15.53:0/1871400646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fa758020620 con 0x5611899ba1b0 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa76e3f8740 10 client.20973 fetch_fsmap learned FSMap version 65 2024-08-31T06:22:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1871400646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x561189d6e3b0 con 0x5611899ba1b0 2024-08-31T06:22:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa748ff9640 1 -- 172.21.15.53:0/1871400646 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7500b3050 con 0x5611899ba1b0 2024-08-31T06:22:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa748ff9640 1 -- 172.21.15.53:0/1871400646 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 65) ==== 8378+0+0 (secure 0 0 0) 0x7fa758038070 con 0x5611899ba1b0 2024-08-31T06:22:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa76e3f8740 10 client.20973 fetch_fsmap finished waiting for FSMap version 65 2024-08-31T06:22:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa76e3f8740 10 client.20973 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa76e3f8740 20 client.20973 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56118994e1c0 0x561189de8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa76e3f8740 4 client.20973 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:22:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1871400646 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561189cd09f0 con 0x56118994e1c0 2024-08-31T06:22:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.895+0000 7fa765149640 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56118994e1c0 0x561189de8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.896+0000 7fa748ff9640 10 client.20973 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:33.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.896+0000 7fa765149640 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56118994e1c0 0x561189de8960 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=397465e9abccf1e0 server_cookie=4e842193cf61c7eb in_seq=0 out_seq=0 2024-08-31T06:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.959+0000 7fa748ff9640 1 -- 172.21.15.53:0/1871400646 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561189cd09f0 con 0x56118994e1c0 2024-08-31T06:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa748ff9640 10 client.20973 handle_command_reply: tid=0 2024-08-31T06:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 1 client.20973 shutdown 2024-08-31T06:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1871400646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 msgr2=0x561189d667d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d667d0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fa75801dd70 tx=0x7fa75801fc10 comp rx=0 tx=0).stop 2024-08-31T06:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1871400646 shutdown_connections 2024-08-31T06:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56118994e1c0 0x561189de8960 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611899ba1b0 0x561189d667d0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa748ff9640 0 client.20973 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5611899994d0 0x561189d66290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 1 --2- 172.21.15.53:0/1871400646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611899912f0 0x561189d71c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1871400646 >> 172.21.15.53:0/1871400646 conn(0x5611899ae300 msgr2=0x561189d5b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1871400646 shutdown_connections 2024-08-31T06:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 1 -- 172.21.15.53:0/1871400646 wait complete. 2024-08-31T06:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.960+0000 7fa76e3f8740 20 client.20973 trim_cache size 0 max 16384 2024-08-31T06:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:22:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 -- 172.21.15.53:0/1358260400 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa74c0b4ca0 msgr2=0x7fa74c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa74c0b4ca0 0x7fa74c0b71b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa758005fd0 tx=0x7fa758009600 comp rx=0 tx=0).stop 2024-08-31T06:22:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 -- 172.21.15.53:0/1358260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7601080b0 msgr2=0x7fa76019b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7601080b0 0x7fa76019b4b0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fa75002a930 tx=0x7fa750003c20 comp rx=0 tx=0).stop 2024-08-31T06:22:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 -- 172.21.15.53:0/1358260400 shutdown_connections 2024-08-31T06:22:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa74c0b4ca0 0x7fa74c0b71b0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa760108a00 0x7fa76019b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7601080b0 0x7fa76019b4b0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 --2- 172.21.15.53:0/1358260400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa760102780 0x7fa76019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 -- 172.21.15.53:0/1358260400 >> 172.21.15.53:0/1358260400 conn(0x7fa7600fe160 msgr2=0x7fa760106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 -- 172.21.15.53:0/1358260400 shutdown_connections 2024-08-31T06:22:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:33.961+0000 7fa7673ad640 1 -- 172.21.15.53:0/1358260400 wait complete. 2024-08-31T06:22:34.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 6.07 MB/sec execute 142 sec latency 3533.760 ms 2024-08-31T06:22:34.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:34 smithi130 ceph-mon[22266]: pgmap v875: 97 pgs: 97 active+clean; 599 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 321 op/s 2024-08-31T06:22:34.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:34 smithi153 ceph-mon[22320]: pgmap v875: 97 pgs: 97 active+clean; 599 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 321 op/s 2024-08-31T06:22:34.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:34 smithi053 ceph-mon[18924]: pgmap v875: 97 pgs: 97 active+clean; 599 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 321 op/s 2024-08-31T06:22:35.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 6.03 MB/sec execute 143 sec latency 4533.808 ms 2024-08-31T06:22:35.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:35 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:35.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:35 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:35.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:35 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:22:36.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.99 MB/sec execute 144 sec latency 5533.876 ms 2024-08-31T06:22:36.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:36 smithi130 ceph-mon[22266]: pgmap v876: 97 pgs: 97 active+clean; 601 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 343 op/s 2024-08-31T06:22:36.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:36 smithi153 ceph-mon[22320]: pgmap v876: 97 pgs: 97 active+clean; 601 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 343 op/s 2024-08-31T06:22:36.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:36 smithi053 ceph-mon[18924]: pgmap v876: 97 pgs: 97 active+clean; 601 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 343 op/s 2024-08-31T06:22:37.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.95 MB/sec execute 145 sec latency 6533.951 ms 2024-08-31T06:22:38.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.91 MB/sec execute 146 sec latency 7534.060 ms 2024-08-31T06:22:38.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:38 smithi130 ceph-mon[22266]: pgmap v877: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 281 op/s 2024-08-31T06:22:38.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:38 smithi153 ceph-mon[22320]: pgmap v877: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 281 op/s 2024-08-31T06:22:38.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:38 smithi053 ceph-mon[18924]: pgmap v877: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 281 op/s 2024-08-31T06:22:39.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.87 MB/sec execute 147 sec latency 8534.153 ms 2024-08-31T06:22:40.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.83 MB/sec execute 148 sec latency 9534.256 ms 2024-08-31T06:22:40.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:40 smithi130 ceph-mon[22266]: pgmap v878: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 243 op/s 2024-08-31T06:22:40.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:40 smithi153 ceph-mon[22320]: pgmap v878: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 243 op/s 2024-08-31T06:22:40.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:40 smithi053 ceph-mon[18924]: pgmap v878: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.0 MiB/s wr, 243 op/s 2024-08-31T06:22:41.374 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.79 MB/sec execute 149 sec latency 10534.335 ms 2024-08-31T06:22:42.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.75 MB/sec execute 150 sec latency 11534.464 ms 2024-08-31T06:22:42.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:42 smithi130 ceph-mon[22266]: pgmap v879: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 199 op/s 2024-08-31T06:22:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:42 smithi153 ceph-mon[22320]: pgmap v879: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 199 op/s 2024-08-31T06:22:42.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:42 smithi053 ceph-mon[18924]: pgmap v879: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 199 op/s 2024-08-31T06:22:43.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.71 MB/sec execute 151 sec latency 12534.621 ms 2024-08-31T06:22:44.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.67 MB/sec execute 152 sec latency 13534.753 ms 2024-08-31T06:22:44.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:44 smithi130 ceph-mon[22266]: pgmap v880: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2024-08-31T06:22:44.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:44 smithi153 ceph-mon[22320]: pgmap v880: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2024-08-31T06:22:44.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:44 smithi053 ceph-mon[18924]: pgmap v880: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2024-08-31T06:22:45.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.64 MB/sec execute 153 sec latency 14534.797 ms 2024-08-31T06:22:46.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.60 MB/sec execute 154 sec latency 15534.856 ms 2024-08-31T06:22:46.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:46 smithi130 ceph-mon[22266]: pgmap v881: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 678 KiB/s wr, 116 op/s 2024-08-31T06:22:46.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:46 smithi153 ceph-mon[22320]: pgmap v881: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 678 KiB/s wr, 116 op/s 2024-08-31T06:22:46.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:46 smithi053 ceph-mon[18924]: pgmap v881: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 678 KiB/s wr, 116 op/s 2024-08-31T06:22:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.071+0000 7f7239abe640 1 -- 172.21.15.53:0/1563981677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72341080b0 msgr2=0x7f72341084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.071+0000 7f7239abe640 1 --2- 172.21.15.53:0/1563981677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72341080b0 0x7f72341084c0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f721c009900 tx=0x7f721c02a410 comp rx=0 tx=0).stop 2024-08-31T06:22:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.071+0000 7f7239abe640 1 -- 172.21.15.53:0/1563981677 shutdown_connections 2024-08-31T06:22:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.071+0000 7f7239abe640 1 --2- 172.21.15.53:0/1563981677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7234108a00 0x7f723410f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.071+0000 7f7239abe640 1 --2- 172.21.15.53:0/1563981677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72341080b0 0x7f72341084c0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.071+0000 7f7239abe640 1 --2- 172.21.15.53:0/1563981677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7234102780 0x7f7234102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.071+0000 7f7239abe640 1 -- 172.21.15.53:0/1563981677 >> 172.21.15.53:0/1563981677 conn(0x7f72340fe160 msgr2=0x7f72341005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.071+0000 7f7239abe640 1 -- 172.21.15.53:0/1563981677 shutdown_connections 2024-08-31T06:22:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.071+0000 7f7239abe640 1 -- 172.21.15.53:0/1563981677 wait complete. 2024-08-31T06:22:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.071+0000 7f7239abe640 1 Processor -- start 2024-08-31T06:22:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7239abe640 1 -- start start 2024-08-31T06:22:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7239abe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7234102780 0x7f7234109200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7239abe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72341080b0 0x7f7234109740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7239abe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7234108a00 0x7f7234109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7239abe640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7234112520 con 0x7f7234108a00 2024-08-31T06:22:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7239abe640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72341123a0 con 0x7f72341080b0 2024-08-31T06:22:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7239abe640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72341126a0 con 0x7f7234102780 2024-08-31T06:22:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7233fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7234108a00 0x7f7234109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7233fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7234108a00 0x7f7234109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43606/0 (socket says 172.21.15.53:43606) 2024-08-31T06:22:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7233fff640 1 -- 172.21.15.53:0/3056044166 learned_addr learned my addr 172.21.15.53:0/3056044166 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f72337fe640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7234102780 0x7f7234109200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f722affd640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72341080b0 0x7f7234109740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7233fff640 1 -- 172.21.15.53:0/3056044166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7234102780 msgr2=0x7f7234109200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7233fff640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7234102780 0x7f7234109200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7233fff640 1 -- 172.21.15.53:0/3056044166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72341080b0 msgr2=0x7f7234109740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7233fff640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72341080b0 0x7f7234109740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.072+0000 7f7233fff640 1 -- 172.21.15.53:0/3056044166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72341a8360 con 0x7f7234108a00 2024-08-31T06:22:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.073+0000 7f722affd640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72341080b0 0x7f7234109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.073+0000 7f7233fff640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7234108a00 0x7f7234109c80 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f722c00cad0 tx=0x7f722c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.073+0000 7f72317fa640 1 -- 172.21.15.53:0/3056044166 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c00ad60 con 0x7f7234108a00 2024-08-31T06:22:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.073+0000 7f7239abe640 1 -- 172.21.15.53:0/3056044166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72341a8650 con 0x7f7234108a00 2024-08-31T06:22:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.073+0000 7f72317fa640 1 -- 172.21.15.53:0/3056044166 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f722c005020 con 0x7f7234108a00 2024-08-31T06:22:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.073+0000 7f72317fa640 1 -- 172.21.15.53:0/3056044166 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c00f6b0 con 0x7f7234108a00 2024-08-31T06:22:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.073+0000 7f7239abe640 1 -- 172.21.15.53:0/3056044166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72341a8b50 con 0x7f7234108a00 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.076+0000 7f72317fa640 1 -- 172.21.15.53:0/3056044166 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f722c00f910 con 0x7f7234108a00 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.076+0000 7f7240a24740 1 Processor -- start 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.076+0000 7f7240a24740 1 -- start start 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.076+0000 7f7240a24740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406771b0 0x55f940a1aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.076+0000 7f7240a24740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f94064e2f0 0x55f940a1b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.076+0000 7f7240a24740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a1b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.076+0000 7f7240a24740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f940990000 con 0x55f9406564d0 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.076+0000 7f7240a24740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f94097f590 con 0x55f9406771b0 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.076+0000 7f7240a24740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f940983540 con 0x55f94064e2f0 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.076+0000 7f722affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a1b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f722affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a1b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43608/0 (socket says 172.21.15.53:43608) 2024-08-31T06:22:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f722affd640 1 -- 172.21.15.53:0/2679446747 learned_addr learned my addr 172.21.15.53:0/2679446747 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f722affd640 1 --2- 172.21.15.53:0/2679446747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406771b0 0x55f940a1aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f72337fe640 1 --2- 172.21.15.53:0/2679446747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f94064e2f0 0x55f940a1b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f722affd640 1 -- 172.21.15.53:0/2679446747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f94064e2f0 msgr2=0x55f940a1b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f722affd640 1 --2- 172.21.15.53:0/2679446747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f94064e2f0 0x55f940a1b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f72317fa640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72200b4ca0 0x7f72200b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f722affd640 1 -- 172.21.15.53:0/2679446747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406771b0 msgr2=0x55f940a1aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f722affd640 1 --2- 172.21.15.53:0/2679446747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406771b0 0x55f940a1aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f722affd640 1 -- 172.21.15.53:0/2679446747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9406e2790 con 0x55f9406564d0 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f7233fff640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72200b4ca0 0x7f72200b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f722affd640 1 --2- 172.21.15.53:0/2679446747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a1b540 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f721c005f70 tx=0x7f721c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ae5624a87c460f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f72317fa640 1 -- 172.21.15.53:0/3056044166 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f722c0e5620 con 0x7f7234108a00 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f7229ffb640 1 -- 172.21.15.53:0/2679446747 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c045070 con 0x55f9406564d0 2024-08-31T06:22:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f7229ffb640 1 -- 172.21.15.53:0/2679446747 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f721c031840 con 0x55f9406564d0 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.077+0000 7f7229ffb640 1 -- 172.21.15.53:0/2679446747 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c035040 con 0x55f9406564d0 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.078+0000 7f7240a24740 1 -- 172.21.15.53:0/2679446747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 msgr2=0x55f940a1b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.078+0000 7f7233fff640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72200b4ca0 0x7f72200b71b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f722c09ffd0 tx=0x7f722c005b20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.078+0000 7f7240a24740 1 --2- 172.21.15.53:0/2679446747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a1b540 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f721c005f70 tx=0x7f721c000bc0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.078+0000 7f7240a24740 1 -- 172.21.15.53:0/2679446747 shutdown_connections 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.078+0000 7f7240a24740 1 --2- 172.21.15.53:0/2679446747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a1b540 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.078+0000 7f7240a24740 1 --2- 172.21.15.53:0/2679446747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f94064e2f0 0x55f940a1b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.078+0000 7f7240a24740 1 --2- 172.21.15.53:0/2679446747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406771b0 0x55f940a1aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.078+0000 7f7240a24740 1 -- 172.21.15.53:0/2679446747 >> 172.21.15.53:0/2679446747 conn(0x55f94066b300 msgr2=0x55f940a189b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.078+0000 7f7240a24740 1 -- 172.21.15.53:0/2679446747 shutdown_connections 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.078+0000 7f7240a24740 1 -- 172.21.15.53:0/2679446747 wait complete. 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.079+0000 7f7240a24740 1 -- start start 2024-08-31T06:22:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.079+0000 7f7240a24740 1 Processor -- start 2024-08-31T06:22:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.079+0000 7f7240a24740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f94064e2f0 0x55f940a26670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.079+0000 7f7240a24740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f9406564d0 0x55f940a26bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.079+0000 7f7240a24740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406771b0 0x55f940a32500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.079+0000 7f7240a24740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f9408b8ab0 con 0x55f94064e2f0 2024-08-31T06:22:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.079+0000 7f7240a24740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f940906680 con 0x55f9406771b0 2024-08-31T06:22:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.079+0000 7f7240a24740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f940a291e0 con 0x55f9406564d0 2024-08-31T06:22:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f7240a24740 10 client.0 _ll_register_callbacks cb 0x55f94068ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f722affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f94064e2f0 0x55f940a26670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f722affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f94064e2f0 0x55f940a26670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43610/0 (socket says 172.21.15.53:43610) 2024-08-31T06:22:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f722affd640 1 -- 172.21.15.53:0/2753356274 learned_addr learned my addr 172.21.15.53:0/2753356274 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f72337fe640 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f9406564d0 0x55f940a26bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f722affd640 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406771b0 0x55f940a32500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f722affd640 1 -- 172.21.15.53:0/2753356274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f9406564d0 msgr2=0x55f940a26bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f722affd640 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f9406564d0 0x55f940a26bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f722affd640 1 -- 172.21.15.53:0/2753356274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406771b0 msgr2=0x55f940a32500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f722affd640 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406771b0 0x55f940a32500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f722affd640 1 -- 172.21.15.53:0/2753356274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f94075b620 con 0x55f94064e2f0 2024-08-31T06:22:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f722affd640 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f94064e2f0 0x55f940a26670 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f721c003b30 tx=0x7f721c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b38a4a91ab757d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f7212ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f7212ffd640 1 -- 172.21.15.53:0/2753356274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c04f020 con 0x55f94064e2f0 2024-08-31T06:22:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f7212ffd640 1 -- 172.21.15.53:0/2753356274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f721c004230 con 0x55f94064e2f0 2024-08-31T06:22:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.080+0000 7f7240a24740 1 -- 172.21.15.53:0/2753356274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f721c031840 con 0x55f94064e2f0 2024-08-31T06:22:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f7212ffd640 1 -- 172.21.15.53:0/2753356274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f721c045070 con 0x55f94064e2f0 2024-08-31T06:22:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f7240a24740 10 client.20985 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f7240a24740 1 -- 172.21.15.53:0/2753356274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55f940a35220 con 0x55f94064e2f0 2024-08-31T06:22:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f7212ffd640 1 -- 172.21.15.53:0/2753356274 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f721c031840 con 0x55f94064e2f0 2024-08-31T06:22:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f7212ffd640 1 -- 172.21.15.53:0/2753356274 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f721c03a040 con 0x55f94064e2f0 2024-08-31T06:22:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f7240a24740 10 client.20985 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f7240a24740 10 client.20985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f7240a24740 20 client.20985 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f7240a24740 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f940635d80 0x55f940a38580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f7240a24740 4 client.20985 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f7240a24740 1 -- 172.21.15.53:0/2753356274 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f940991f50 con 0x55f940635d80 2024-08-31T06:22:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.081+0000 7f72337fe640 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f940635d80 0x55f940a38580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.082+0000 7f7212ffd640 10 client.20985 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.082+0000 7f72337fe640 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f940635d80 0x55f940a38580 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff70619c587324e4 server_cookie=521f04431c26df33 in_seq=0 out_seq=0 2024-08-31T06:22:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7212ffd640 1 -- 172.21.15.53:0/2753356274 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f940991f50 con 0x55f940635d80 2024-08-31T06:22:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7212ffd640 10 client.20985 handle_command_reply: tid=0 2024-08-31T06:22:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 1 client.20985 shutdown 2024-08-31T06:22:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 1 -- 172.21.15.53:0/2753356274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f94064e2f0 msgr2=0x55f940a26670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f94064e2f0 0x55f940a26670 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f721c003b30 tx=0x7f721c005a20 comp rx=0 tx=0).stop 2024-08-31T06:22:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 1 -- 172.21.15.53:0/2753356274 shutdown_connections 2024-08-31T06:22:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f940635d80 0x55f940a38580 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406771b0 0x55f940a32500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f9406564d0 0x55f940a26bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7212ffd640 0 client.20985 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 1 --2- 172.21.15.53:0/2753356274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f94064e2f0 0x55f940a26670 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 1 -- 172.21.15.53:0/2753356274 >> 172.21.15.53:0/2753356274 conn(0x55f94066b300 msgr2=0x55f940a1baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 1 -- 172.21.15.53:0/2753356274 shutdown_connections 2024-08-31T06:22:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 1 -- 172.21.15.53:0/2753356274 wait complete. 2024-08-31T06:22:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.083+0000 7f7240a24740 20 client.20985 trim_cache size 0 max 16384 2024-08-31T06:22:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f7240a24740 1 Processor -- start 2024-08-31T06:22:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f7240a24740 1 -- start start 2024-08-31T06:22:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f7240a24740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f94064e2f0 0x55f940a23630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f7240a24740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a23b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f7240a24740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f9406771b0 0x55f940a3b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f7240a24740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f72341b1630 con 0x55f9406564d0 2024-08-31T06:22:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f7240a24740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72341b31d0 con 0x55f94064e2f0 2024-08-31T06:22:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f7240a24740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72341b1d60 con 0x55f9406771b0 2024-08-31T06:22:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f72337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a23b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f72337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a23b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43616/0 (socket says 172.21.15.53:43616) 2024-08-31T06:22:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f72337fe640 1 -- 172.21.15.53:0/2147170667 learned_addr learned my addr 172.21.15.53:0/2147170667 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f722affd640 1 --2- 172.21.15.53:0/2147170667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f94064e2f0 0x55f940a23630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f72337fe640 1 -- 172.21.15.53:0/2147170667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f9406771b0 msgr2=0x55f940a3b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f72337fe640 1 --2- 172.21.15.53:0/2147170667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f9406771b0 0x55f940a3b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f72337fe640 1 -- 172.21.15.53:0/2147170667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f94064e2f0 msgr2=0x55f940a23630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f72337fe640 1 --2- 172.21.15.53:0/2147170667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f94064e2f0 0x55f940a23630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.098+0000 7f72337fe640 1 -- 172.21.15.53:0/2147170667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f940a1cdc0 con 0x55f9406564d0 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.099+0000 7f72337fe640 1 --2- 172.21.15.53:0/2147170667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a23b70 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f7224000c00 tx=0x7f722400a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7caa7dc747a73a4a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.099+0000 7f72297fa640 1 -- 172.21.15.53:0/2147170667 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224005220 con 0x55f9406564d0 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.099+0000 7f72297fa640 1 -- 172.21.15.53:0/2147170667 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7224004c30 con 0x55f9406564d0 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.099+0000 7f72297fa640 1 -- 172.21.15.53:0/2147170667 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722401d7d0 con 0x55f9406564d0 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.099+0000 7f7240a24740 1 -- 172.21.15.53:0/2147170667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 msgr2=0x55f940a23b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.099+0000 7f7240a24740 1 --2- 172.21.15.53:0/2147170667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a23b70 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f7224000c00 tx=0x7f722400a2d0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.100+0000 7f7240a24740 1 -- 172.21.15.53:0/2147170667 shutdown_connections 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.100+0000 7f7240a24740 1 --2- 172.21.15.53:0/2147170667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f9406771b0 0x55f940a3b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.100+0000 7f7240a24740 1 --2- 172.21.15.53:0/2147170667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406564d0 0x55f940a23b70 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.100+0000 7f7240a24740 1 --2- 172.21.15.53:0/2147170667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f94064e2f0 0x55f940a23630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.100+0000 7f7240a24740 1 -- 172.21.15.53:0/2147170667 >> 172.21.15.53:0/2147170667 conn(0x55f94066b300 msgr2=0x55f940a24cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.100+0000 7f7240a24740 1 -- 172.21.15.53:0/2147170667 shutdown_connections 2024-08-31T06:22:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.100+0000 7f7240a24740 1 -- 172.21.15.53:0/2147170667 wait complete. 2024-08-31T06:22:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.100+0000 7f7240a24740 1 -- start start 2024-08-31T06:22:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.100+0000 7f7240a24740 1 Processor -- start 2024-08-31T06:22:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.100+0000 7f7240a24740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f94064e2f0 0x55f940a96ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.100+0000 7f7240a24740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406564d0 0x55f940a973e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f7240a24740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406771b0 0x55f940aa1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f7240a24740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f72341b2b00 con 0x55f9406771b0 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f7240a24740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72341b2430 con 0x55f9406564d0 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f7240a24740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72341af630 con 0x55f94064e2f0 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f7240a24740 10 client.0 _ll_register_callbacks cb 0x7f721c032e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f722affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406771b0 0x55f940aa1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f722affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406771b0 0x55f940aa1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43622/0 (socket says 172.21.15.53:43622) 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f722affd640 1 -- 172.21.15.53:0/241865642 learned_addr learned my addr 172.21.15.53:0/241865642 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f722affd640 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f94064e2f0 0x55f940a96ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f72337fe640 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406564d0 0x55f940a973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f722affd640 1 -- 172.21.15.53:0/241865642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f94064e2f0 msgr2=0x55f940a96ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f722affd640 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f94064e2f0 0x55f940a96ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f722affd640 1 -- 172.21.15.53:0/241865642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406564d0 msgr2=0x55f940a973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f722affd640 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406564d0 0x55f940a973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f722affd640 1 -- 172.21.15.53:0/241865642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f940aa2300 con 0x55f9406771b0 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f722affd640 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406771b0 0x55f940aa1d10 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f721c005860 tx=0x7f721c003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7627f27c98a38eee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f7212ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f7212ffd640 1 -- 172.21.15.53:0/241865642 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c064020 con 0x55f9406771b0 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f7212ffd640 1 -- 172.21.15.53:0/241865642 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f721c004230 con 0x55f9406771b0 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.101+0000 7f7240a24740 1 -- 172.21.15.53:0/241865642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7224004c30 con 0x55f9406771b0 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f7212ffd640 1 -- 172.21.15.53:0/241865642 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f721c04f040 con 0x55f9406771b0 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f7240a24740 10 client.20991 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f7240a24740 1 -- 172.21.15.53:0/241865642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55f940aa3590 con 0x55f9406771b0 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f7212ffd640 1 -- 172.21.15.53:0/241865642 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7224004c30 con 0x55f9406771b0 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f7212ffd640 1 -- 172.21.15.53:0/241865642 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f721c03a040 con 0x55f9406771b0 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f7240a24740 10 client.20991 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f7240a24740 10 client.20991 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:47.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f7240a24740 20 client.20991 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:47.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f7240a24740 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f94060b1c0 0x55f940aa5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:47.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f7240a24740 4 client.20991 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:22:47.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f7240a24740 1 -- 172.21.15.53:0/241865642 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f94098d9f0 con 0x55f94060b1c0 2024-08-31T06:22:47.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.102+0000 7f72337fe640 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f94060b1c0 0x55f940aa5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:47.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.103+0000 7f72337fe640 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f94060b1c0 0x55f940aa5a20 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42a11aa83336f781 server_cookie=1e8914ed7955f620 in_seq=0 out_seq=0 2024-08-31T06:22:47.112 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.103+0000 7f7212ffd640 10 client.20991 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7212ffd640 1 -- 172.21.15.53:0/241865642 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f94098d9f0 con 0x55f94060b1c0 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7212ffd640 10 client.20991 handle_command_reply: tid=0 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 1 client.20991 shutdown 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 1 -- 172.21.15.53:0/241865642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406771b0 msgr2=0x55f940aa1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406771b0 0x55f940aa1d10 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f721c005860 tx=0x7f721c003b60 comp rx=0 tx=0).stop 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 1 -- 172.21.15.53:0/241865642 shutdown_connections 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f94060b1c0 0x55f940aa5a20 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9406771b0 0x55f940aa1d10 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9406564d0 0x55f940a973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 1 --2- 172.21.15.53:0/241865642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f94064e2f0 0x55f940a96ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 1 -- 172.21.15.53:0/241865642 >> 172.21.15.53:0/241865642 conn(0x55f94066b300 msgr2=0x55f940a27910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7212ffd640 0 client.20991 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:47.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 1 -- 172.21.15.53:0/241865642 shutdown_connections 2024-08-31T06:22:47.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 1 -- 172.21.15.53:0/241865642 wait complete. 2024-08-31T06:22:47.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.131+0000 7f7240a24740 20 client.20991 trim_cache size 0 max 16384 2024-08-31T06:22:47.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:22:47.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:22:47.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:22:47.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:22:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 -- 172.21.15.53:0/3056044166 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72200b4ca0 msgr2=0x7f72200b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72200b4ca0 0x7f72200b71b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f722c09ffd0 tx=0x7f722c005b20 comp rx=0 tx=0).stop 2024-08-31T06:22:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 -- 172.21.15.53:0/3056044166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7234108a00 msgr2=0x7f7234109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7234108a00 0x7f7234109c80 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f722c00cad0 tx=0x7f722c00ced0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 -- 172.21.15.53:0/3056044166 shutdown_connections 2024-08-31T06:22:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72200b4ca0 0x7f72200b71b0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7234108a00 0x7f7234109c80 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72341080b0 0x7f7234109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 --2- 172.21.15.53:0/3056044166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7234102780 0x7f7234109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 -- 172.21.15.53:0/3056044166 >> 172.21.15.53:0/3056044166 conn(0x7f72340fe160 msgr2=0x7f72341015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 -- 172.21.15.53:0/3056044166 shutdown_connections 2024-08-31T06:22:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:22:47.132+0000 7f7239abe640 1 -- 172.21.15.53:0/3056044166 wait complete. 2024-08-31T06:22:47.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.56 MB/sec execute 155 sec latency 16534.949 ms 2024-08-31T06:22:48.197 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:22:48.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.53 MB/sec execute 156 sec latency 17535.016 ms 2024-08-31T06:22:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:48.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:48 smithi053 ceph-mon[18924]: pgmap v882: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 157 KiB/s wr, 54 op/s 2024-08-31T06:22:48.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:48 smithi130 ceph-mon[22266]: pgmap v882: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 157 KiB/s wr, 54 op/s 2024-08-31T06:22:48.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:48 smithi153 ceph-mon[22320]: pgmap v882: 97 pgs: 97 active+clean; 597 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 157 KiB/s wr, 54 op/s 2024-08-31T06:22:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.013+0000 7f645acb2640 1 -- 172.21.15.53:0/1857481643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6454108ac0 msgr2=0x7f645410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.013+0000 7f645acb2640 1 --2- 172.21.15.53:0/1857481643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6454108ac0 0x7f645410f2f0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f644c009ca0 tx=0x7f644c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.013+0000 7f645acb2640 1 -- 172.21.15.53:0/1857481643 shutdown_connections 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.013+0000 7f645acb2640 1 --2- 172.21.15.53:0/1857481643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6454108ac0 0x7f645410f2f0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.013+0000 7f645acb2640 1 --2- 172.21.15.53:0/1857481643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6454108170 0x7f6454108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.013+0000 7f645acb2640 1 --2- 172.21.15.53:0/1857481643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6454102880 0x7f6454102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.013+0000 7f645acb2640 1 -- 172.21.15.53:0/1857481643 >> 172.21.15.53:0/1857481643 conn(0x7f6454079500 msgr2=0x7f6454079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.013+0000 7f645acb2640 1 -- 172.21.15.53:0/1857481643 shutdown_connections 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.013+0000 7f645acb2640 1 -- 172.21.15.53:0/1857481643 wait complete. 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.014+0000 7f645acb2640 1 Processor -- start 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.014+0000 7f645acb2640 1 -- start start 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.014+0000 7f645acb2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6454102880 0x7f645419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.014+0000 7f645acb2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6454108170 0x7f645419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.014+0000 7f645acb2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6454108ac0 0x7f645419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.014+0000 7f645acb2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6454113810 con 0x7f6454102880 2024-08-31T06:22:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.014+0000 7f645acb2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6454113690 con 0x7f6454108ac0 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.014+0000 7f645acb2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6454113990 con 0x7f6454108170 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.014+0000 7f6458a4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6454102880 0x7f645419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6458a4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6454102880 0x7f645419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43646/0 (socket says 172.21.15.53:43646) 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6458a4e640 1 -- 172.21.15.53:0/3762176984 learned_addr learned my addr 172.21.15.53:0/3762176984 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6453fff640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6454108170 0x7f645419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6458a4e640 1 -- 172.21.15.53:0/3762176984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6454108170 msgr2=0x7f645419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6458a4e640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6454108170 0x7f645419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6458a4e640 1 -- 172.21.15.53:0/3762176984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6454108ac0 msgr2=0x7f645419fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f645924f640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6454108ac0 0x7f645419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6458a4e640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6454108ac0 0x7f645419fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6458a4e640 1 -- 172.21.15.53:0/3762176984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64541a01f0 con 0x7f6454102880 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6458a4e640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6454102880 0x7f645419a280 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f644800b4a0 tx=0x7f644800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6451ffb640 1 -- 172.21.15.53:0/3762176984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448014070 con 0x7f6454102880 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6451ffb640 1 -- 172.21.15.53:0/3762176984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6448010aa0 con 0x7f6454102880 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f645acb2640 1 -- 172.21.15.53:0/3762176984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64541a04e0 con 0x7f6454102880 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f6451ffb640 1 -- 172.21.15.53:0/3762176984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448017b70 con 0x7f6454102880 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.015+0000 7f645acb2640 1 -- 172.21.15.53:0/3762176984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64541a6c40 con 0x7f6454102880 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.018+0000 7f6451ffb640 1 -- 172.21.15.53:0/3762176984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6448017070 con 0x7f6454102880 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.018+0000 7f6461227740 1 Processor -- start 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.018+0000 7f6461227740 1 -- start start 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.018+0000 7f6461227740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.018+0000 7f6461227740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee50195800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.018+0000 7f6461227740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdcf390 0x55ee50195d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.018+0000 7f6461227740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ee5010c630 con 0x55ee4fdf0070 2024-08-31T06:22:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.018+0000 7f6461227740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee500fbbc0 con 0x55ee4fdcf390 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.018+0000 7f6461227740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ee500ffb70 con 0x55ee4fdc71b0 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f645924f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f645924f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43648/0 (socket says 172.21.15.53:43648) 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f645924f640 1 -- 172.21.15.53:0/198677093 learned_addr learned my addr 172.21.15.53:0/198677093 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f6453fff640 1 --2- 172.21.15.53:0/198677093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdcf390 0x55ee50195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f6458a4e640 1 --2- 172.21.15.53:0/198677093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee50195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f6451ffb640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64440b4ca0 0x7f64440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f645924f640 1 -- 172.21.15.53:0/198677093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 msgr2=0x55ee50195800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f645924f640 1 --2- 172.21.15.53:0/198677093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee50195800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f645924f640 1 -- 172.21.15.53:0/198677093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdcf390 msgr2=0x55ee50195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f645924f640 1 --2- 172.21.15.53:0/198677093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdcf390 0x55ee50195d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f645924f640 1 -- 172.21.15.53:0/198677093 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee4fe5b650 con 0x55ee4fdf0070 2024-08-31T06:22:49.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f6458a4e640 1 --2- 172.21.15.53:0/198677093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee50195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f645924f640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64440b4ca0 0x7f64440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f6451ffb640 1 -- 172.21.15.53:0/3762176984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f64480e4c40 con 0x7f6454102880 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f645924f640 1 --2- 172.21.15.53:0/198677093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501952c0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f644c005cc0 tx=0x7f644c031670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b37b3973f018266 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.019+0000 7f643effd640 1 -- 172.21.15.53:0/198677093 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c031da0 con 0x55ee4fdf0070 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.020+0000 7f643effd640 1 -- 172.21.15.53:0/198677093 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f644c036070 con 0x55ee4fdf0070 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.020+0000 7f645924f640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64440b4ca0 0x7f64440b71b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f644c047000 tx=0x7f644c048000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.020+0000 7f643effd640 1 -- 172.21.15.53:0/198677093 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c030ce0 con 0x55ee4fdf0070 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.020+0000 7f6461227740 1 -- 172.21.15.53:0/198677093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 msgr2=0x55ee501952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.020+0000 7f6461227740 1 --2- 172.21.15.53:0/198677093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501952c0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f644c005cc0 tx=0x7f644c031670 comp rx=0 tx=0).stop 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.020+0000 7f6461227740 1 -- 172.21.15.53:0/198677093 shutdown_connections 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.020+0000 7f6461227740 1 --2- 172.21.15.53:0/198677093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdcf390 0x55ee50195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.020+0000 7f6461227740 1 --2- 172.21.15.53:0/198677093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee50195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.020+0000 7f6461227740 1 --2- 172.21.15.53:0/198677093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501952c0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.020+0000 7f6461227740 1 -- 172.21.15.53:0/198677093 >> 172.21.15.53:0/198677093 conn(0x55ee4fde4460 msgr2=0x55ee501931b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.021+0000 7f6461227740 1 -- 172.21.15.53:0/198677093 shutdown_connections 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.021+0000 7f6461227740 1 -- 172.21.15.53:0/198677093 wait complete. 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.021+0000 7f6461227740 1 -- start start 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.021+0000 7f6461227740 1 Processor -- start 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.021+0000 7f6461227740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee501a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.021+0000 7f6461227740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdcf390 0x55ee501a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.021+0000 7f6461227740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.021+0000 7f6461227740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ee4ff5e700 con 0x55ee4fdf0070 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.021+0000 7f6461227740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee50082700 con 0x55ee4fdcf390 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.021+0000 7f6461227740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ee501a3920 con 0x55ee4fdc71b0 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f6461227740 10 client.0 _ll_register_callbacks cb 0x55ee500b1dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f645924f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f645924f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501acc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43650/0 (socket says 172.21.15.53:43650) 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f645924f640 1 -- 172.21.15.53:0/1107992686 learned_addr learned my addr 172.21.15.53:0/1107992686 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f6458a4e640 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee501a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f6453fff640 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdcf390 0x55ee501a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f645924f640 1 -- 172.21.15.53:0/1107992686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 msgr2=0x55ee501a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f645924f640 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee501a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f645924f640 1 -- 172.21.15.53:0/1107992686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdcf390 msgr2=0x55ee501a0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f645924f640 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdcf390 0x55ee501a0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f645924f640 1 -- 172.21.15.53:0/1107992686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee500bb8b0 con 0x55ee4fdf0070 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f6453fff640 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdcf390 0x55ee501a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f645924f640 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501acc40 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f644c0097b0 tx=0x7f644c009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f482cff71e3f4f57 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f6433fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f6433fff640 1 -- 172.21.15.53:0/1107992686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c009800 con 0x55ee4fdf0070 2024-08-31T06:22:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.022+0000 7f6433fff640 1 -- 172.21.15.53:0/1107992686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f644c04d050 con 0x55ee4fdf0070 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6461227740 1 -- 172.21.15.53:0/1107992686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f644c036070 con 0x55ee4fdf0070 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6433fff640 1 -- 172.21.15.53:0/1107992686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f644c0307d0 con 0x55ee4fdf0070 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6461227740 10 client.21003 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6461227740 1 -- 172.21.15.53:0/1107992686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55ee501af730 con 0x55ee4fdf0070 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6433fff640 1 -- 172.21.15.53:0/1107992686 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f644c036070 con 0x55ee4fdf0070 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6433fff640 1 -- 172.21.15.53:0/1107992686 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f644c051af0 con 0x55ee4fdf0070 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6461227740 10 client.21003 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6461227740 10 client.21003 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6461227740 20 client.21003 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6461227740 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee4fdae9f0 0x55ee501b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6461227740 4 client.21003 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.023+0000 7f6461227740 1 -- 172.21.15.53:0/1107992686 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee5010e580 con 0x55ee4fdae9f0 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.024+0000 7f6458a4e640 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee4fdae9f0 0x55ee501b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.024+0000 7f6458a4e640 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee4fdae9f0 0x55ee501b2a90 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c57c7a79c8c13e2 server_cookie=c97746a245a2aff8 in_seq=0 out_seq=0 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.024+0000 7f6433fff640 10 client.21003 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6433fff640 1 -- 172.21.15.53:0/1107992686 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee5010e580 con 0x55ee4fdae9f0 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6433fff640 10 client.21003 handle_command_reply: tid=0 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 1 client.21003 shutdown 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 1 -- 172.21.15.53:0/1107992686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 msgr2=0x55ee501acc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501acc40 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f644c0097b0 tx=0x7f644c009480 comp rx=0 tx=0).stop 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 1 -- 172.21.15.53:0/1107992686 shutdown_connections 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee4fdae9f0 0x55ee501b2a90 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdf0070 0x55ee501acc40 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdcf390 0x55ee501a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 1 --2- 172.21.15.53:0/1107992686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee501a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6433fff640 0 client.21003 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 1 -- 172.21.15.53:0/1107992686 >> 172.21.15.53:0/1107992686 conn(0x55ee4fde4460 msgr2=0x55ee501984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 1 -- 172.21.15.53:0/1107992686 shutdown_connections 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 1 -- 172.21.15.53:0/1107992686 wait complete. 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.025+0000 7f6461227740 20 client.21003 trim_cache size 0 max 16384 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.042+0000 7f6461227740 1 Processor -- start 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6461227740 1 -- start start 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6461227740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdae9f0 0x55ee50196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6461227740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdc71b0 0x55ee501a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6461227740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdcf390 0x55ee501acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6461227740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f64541af550 con 0x55ee4fdc71b0 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6461227740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64541b10f0 con 0x55ee4fdae9f0 2024-08-31T06:22:49.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6461227740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64541afc80 con 0x55ee4fdcf390 2024-08-31T06:22:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6453fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdc71b0 0x55ee501a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6453fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdc71b0 0x55ee501a26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43656/0 (socket says 172.21.15.53:43656) 2024-08-31T06:22:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6453fff640 1 -- 172.21.15.53:0/4259661890 learned_addr learned my addr 172.21.15.53:0/4259661890 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6458a4e640 1 --2- 172.21.15.53:0/4259661890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdae9f0 0x55ee50196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f645924f640 1 --2- 172.21.15.53:0/4259661890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdcf390 0x55ee501acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6453fff640 1 -- 172.21.15.53:0/4259661890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdcf390 msgr2=0x55ee501acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6453fff640 1 --2- 172.21.15.53:0/4259661890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdcf390 0x55ee501acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6453fff640 1 -- 172.21.15.53:0/4259661890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdae9f0 msgr2=0x55ee50196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6453fff640 1 --2- 172.21.15.53:0/4259661890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdae9f0 0x55ee50196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6453fff640 1 -- 172.21.15.53:0/4259661890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee501a1020 con 0x55ee4fdc71b0 2024-08-31T06:22:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f645924f640 1 --2- 172.21.15.53:0/4259661890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdcf390 0x55ee501acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:49.118 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:22:49.118 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:22:49.118 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:22:49.118 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:22:49.118 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:22:49.118 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:22:49.118 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.118 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.118 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.119 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:22:49.119 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:22:49.119 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.121 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:22:49.121 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:22:49.121 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:22:49.122 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:22:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:22:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:22:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:22:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:22:49.126 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.127 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.128 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.129 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:22:49.129 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:22:49.129 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.129 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.129 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.129 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.129 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.129 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.130 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.131 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:22:49.132 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:22:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.043+0000 7f6453fff640 1 --2- 172.21.15.53:0/4259661890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdc71b0 0x55ee501a26d0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f644000b7f0 tx=0x7f644000bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899eef9a1c8f6939 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.044+0000 7f643e7fc640 1 -- 172.21.15.53:0/4259661890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644001b070 con 0x55ee4fdc71b0 2024-08-31T06:22:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.044+0000 7f643e7fc640 1 -- 172.21.15.53:0/4259661890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6440015450 con 0x55ee4fdc71b0 2024-08-31T06:22:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.044+0000 7f643e7fc640 1 -- 172.21.15.53:0/4259661890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440014610 con 0x55ee4fdc71b0 2024-08-31T06:22:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.044+0000 7f6461227740 1 -- 172.21.15.53:0/4259661890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdc71b0 msgr2=0x55ee501a26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.044+0000 7f6461227740 1 --2- 172.21.15.53:0/4259661890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdc71b0 0x55ee501a26d0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f644000b7f0 tx=0x7f644000bcb0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.044+0000 7f6461227740 1 -- 172.21.15.53:0/4259661890 shutdown_connections 2024-08-31T06:22:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.044+0000 7f6461227740 1 --2- 172.21.15.53:0/4259661890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdcf390 0x55ee501acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.044+0000 7f6461227740 1 --2- 172.21.15.53:0/4259661890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdc71b0 0x55ee501a26d0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.044+0000 7f6461227740 1 --2- 172.21.15.53:0/4259661890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdae9f0 0x55ee50196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.044+0000 7f6461227740 1 -- 172.21.15.53:0/4259661890 >> 172.21.15.53:0/4259661890 conn(0x55ee4fde4460 msgr2=0x55ee501a1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.045+0000 7f6461227740 1 -- 172.21.15.53:0/4259661890 shutdown_connections 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.045+0000 7f6461227740 1 -- 172.21.15.53:0/4259661890 wait complete. 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.045+0000 7f6461227740 1 -- start start 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.045+0000 7f6461227740 1 Processor -- start 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.045+0000 7f6461227740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdae9f0 0x55ee502113a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.045+0000 7f6461227740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee50211980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.045+0000 7f6461227740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdcf390 0x55ee5021c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.045+0000 7f6461227740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f64541b0a20 con 0x55ee4fdcf390 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.045+0000 7f6461227740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64541b0350 con 0x55ee4fdae9f0 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.045+0000 7f6461227740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64541ad550 con 0x55ee4fdc71b0 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.045+0000 7f6461227740 10 client.0 _ll_register_callbacks cb 0x7f644c04a020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f645924f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdcf390 0x55ee5021c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f645924f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdcf390 0x55ee5021c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43670/0 (socket says 172.21.15.53:43670) 2024-08-31T06:22:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f645924f640 1 -- 172.21.15.53:0/1172777186 learned_addr learned my addr 172.21.15.53:0/1172777186 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f6453fff640 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee50211980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f6458a4e640 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdae9f0 0x55ee502113a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f645924f640 1 -- 172.21.15.53:0/1172777186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 msgr2=0x55ee50211980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f645924f640 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee50211980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f645924f640 1 -- 172.21.15.53:0/1172777186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdae9f0 msgr2=0x55ee502113a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f645924f640 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdae9f0 0x55ee502113a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f645924f640 1 -- 172.21.15.53:0/1172777186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5021c890 con 0x55ee4fdcf390 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f645924f640 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdcf390 0x55ee5021c220 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f644c051e90 tx=0x7f644c005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec437cf4d48b849 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f6433fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f6433fff640 1 -- 172.21.15.53:0/1172777186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c067070 con 0x55ee4fdcf390 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f6461227740 1 -- 172.21.15.53:0/1172777186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6440015450 con 0x55ee4fdcf390 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f6433fff640 1 -- 172.21.15.53:0/1172777186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f644c04d040 con 0x55ee4fdcf390 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f6433fff640 1 -- 172.21.15.53:0/1172777186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f644c031450 con 0x55ee4fdcf390 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f6461227740 10 client.21009 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.046+0000 7f6461227740 1 -- 172.21.15.53:0/1172777186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55ee5021db20 con 0x55ee4fdcf390 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.047+0000 7f6433fff640 1 -- 172.21.15.53:0/1172777186 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6440015450 con 0x55ee4fdcf390 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.047+0000 7f6433fff640 1 -- 172.21.15.53:0/1172777186 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f644c051480 con 0x55ee4fdcf390 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.047+0000 7f6461227740 10 client.21009 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.047+0000 7f6461227740 10 client.21009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.047+0000 7f6461227740 20 client.21009 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.047+0000 7f6461227740 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee4fdf0070 0x55ee50220190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.047+0000 7f6461227740 4 client.21009 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.047+0000 7f6461227740 1 -- 172.21.15.53:0/1172777186 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ee5010a020 con 0x55ee4fdf0070 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.047+0000 7f6458a4e640 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee4fdf0070 0x55ee50220190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6458a4e640 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee4fdf0070 0x55ee50220190 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2adf4b1227f6987a server_cookie=232ea52109fc45ed in_seq=0 out_seq=0 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6433fff640 10 client.21009 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6433fff640 1 -- 172.21.15.53:0/1172777186 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6338 (crc 0 0 0) 0x55ee5010a020 con 0x55ee4fdf0070 2024-08-31T06:22:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6433fff640 10 client.21009 handle_command_reply: tid=0 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 1 client.21009 shutdown 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 1 -- 172.21.15.53:0/1172777186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdcf390 msgr2=0x55ee5021c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdcf390 0x55ee5021c220 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f644c051e90 tx=0x7f644c005d80 comp rx=0 tx=0).stop 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 1 -- 172.21.15.53:0/1172777186 shutdown_connections 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ee4fdf0070 0x55ee50220190 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4fdcf390 0x55ee5021c220 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee4fdc71b0 0x55ee50211980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 1 --2- 172.21.15.53:0/1172777186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee4fdae9f0 0x55ee502113a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 1 -- 172.21.15.53:0/1172777186 >> 172.21.15.53:0/1172777186 conn(0x55ee4fde4460 msgr2=0x55ee50196be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6433fff640 0 client.21009 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 1 -- 172.21.15.53:0/1172777186 shutdown_connections 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 1 -- 172.21.15.53:0/1172777186 wait complete. 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.048+0000 7f6461227740 20 client.21009 trim_cache size 0 max 16384 2024-08-31T06:22:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 -- 172.21.15.53:0/3762176984 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64440b4ca0 msgr2=0x7f64440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64440b4ca0 0x7f64440b71b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f644c047000 tx=0x7f644c048000 comp rx=0 tx=0).stop 2024-08-31T06:22:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 -- 172.21.15.53:0/3762176984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6454102880 msgr2=0x7f645419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6454102880 0x7f645419a280 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f644800b4a0 tx=0x7f644800b960 comp rx=0 tx=0).stop 2024-08-31T06:22:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 -- 172.21.15.53:0/3762176984 shutdown_connections 2024-08-31T06:22:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64440b4ca0 0x7f64440b71b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6454108ac0 0x7f645419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6454108170 0x7f645419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 --2- 172.21.15.53:0/3762176984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6454102880 0x7f645419a280 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 -- 172.21.15.53:0/3762176984 >> 172.21.15.53:0/3762176984 conn(0x7f6454079500 msgr2=0x7f6454105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 -- 172.21.15.53:0/3762176984 shutdown_connections 2024-08-31T06:22:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:49.049+0000 7f645acb2640 1 -- 172.21.15.53:0/3762176984 wait complete. 2024-08-31T06:22:49.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.49 MB/sec execute 157 sec latency 18535.060 ms 2024-08-31T06:22:50.027 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:22:50.027 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:22:50.283 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:50.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.46 MB/sec execute 158 sec latency 19535.122 ms 2024-08-31T06:22:50.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:50 smithi130 ceph-mon[22266]: pgmap v883: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 83 KiB/s wr, 35 op/s 2024-08-31T06:22:50.667 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:50 smithi053 ceph-mon[18924]: pgmap v883: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 83 KiB/s wr, 35 op/s 2024-08-31T06:22:50.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:50 smithi153 ceph-mon[22320]: pgmap v883: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 83 KiB/s wr, 35 op/s 2024-08-31T06:22:50.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.754+0000 7f1f083e0640 1 -- 172.21.15.53:0/3861208655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f00108160 msgr2=0x7f1f00108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.754+0000 7f1f083e0640 1 --2- 172.21.15.53:0/3861208655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f00108160 0x7f1f00108570 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009900 tx=0x7f1ef002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.755+0000 7f1f083e0640 1 -- 172.21.15.53:0/3861208655 shutdown_connections 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.755+0000 7f1f083e0640 1 --2- 172.21.15.53:0/3861208655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00108ab0 0x7f1f0010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.755+0000 7f1f083e0640 1 --2- 172.21.15.53:0/3861208655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f00108160 0x7f1f00108570 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.755+0000 7f1f083e0640 1 --2- 172.21.15.53:0/3861208655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f00102820 0x7f1f00102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.755+0000 7f1f083e0640 1 -- 172.21.15.53:0/3861208655 >> 172.21.15.53:0/3861208655 conn(0x7f1f000794e0 msgr2=0x7f1f000798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.755+0000 7f1f083e0640 1 -- 172.21.15.53:0/3861208655 shutdown_connections 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.755+0000 7f1f083e0640 1 -- 172.21.15.53:0/3861208655 wait complete. 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.755+0000 7f1f083e0640 1 Processor -- start 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.755+0000 7f1f083e0640 1 -- start start 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f083e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f00102820 0x7f1f001990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f083e0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f00108160 0x7f1f00199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:50.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f083e0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00108ab0 0x7f1f0019e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f083e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00112590 con 0x7f1f00102820 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f083e0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00112410 con 0x7f1f00108160 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f083e0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00112710 con 0x7f1f00108ab0 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0617c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f00102820 0x7f1f001990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0617c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f00102820 0x7f1f001990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43678/0 (socket says 172.21.15.53:43678) 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0617c640 1 -- 172.21.15.53:0/3246710423 learned_addr learned my addr 172.21.15.53:0/3246710423 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0697d640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00108ab0 0x7f1f0019e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0597b640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f00108160 0x7f1f00199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0617c640 1 -- 172.21.15.53:0/3246710423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00108ab0 msgr2=0x7f1f0019e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0617c640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00108ab0 0x7f1f0019e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0617c640 1 -- 172.21.15.53:0/3246710423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f00108160 msgr2=0x7f1f00199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0617c640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f00108160 0x7f1f00199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0617c640 1 -- 172.21.15.53:0/3246710423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0019ef70 con 0x7f1f00102820 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0697d640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00108ab0 0x7f1f0019e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0597b640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f00108160 0x7f1f00199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f0617c640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f00102820 0x7f1f001990c0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00c920 tx=0x7f1efc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1ef77fe640 1 -- 172.21.15.53:0/3246710423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc007c70 con 0x7f1f00102820 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1ef77fe640 1 -- 172.21.15.53:0/3246710423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1efc007e10 con 0x7f1f00102820 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.756+0000 7f1f083e0640 1 -- 172.21.15.53:0/3246710423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0019f260 con 0x7f1f00102820 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.757+0000 7f1ef77fe640 1 -- 172.21.15.53:0/3246710423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc018710 con 0x7f1f00102820 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.757+0000 7f1f083e0640 1 -- 172.21.15.53:0/3246710423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f001a5a80 con 0x7f1f00102820 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.758+0000 7f1f083e0640 1 -- 172.21.15.53:0/3246710423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f00103aa0 con 0x7f1f00102820 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.759+0000 7f1ef77fe640 1 -- 172.21.15.53:0/3246710423 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1efc00f450 con 0x7f1f00102820 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.760+0000 7f1ef77fe640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1eec0b4d50 0x7f1eec0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.760+0000 7f1f0597b640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1eec0b4d50 0x7f1eec0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:50.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.761+0000 7f1ef77fe640 1 -- 172.21.15.53:0/3246710423 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f1efc0e5a60 con 0x7f1f00102820 2024-08-31T06:22:50.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.761+0000 7f1f0597b640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1eec0b4d50 0x7f1eec0b7260 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0006010 tx=0x7f1ef0000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:50.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.764+0000 7f1ef77fe640 1 -- 172.21.15.53:0/3246710423 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1efc014030 con 0x7f1f00102820 2024-08-31T06:22:50.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.987+0000 7f1f083e0640 1 -- 172.21.15.53:0/3246710423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f00102c30 con 0x7f1f00102820 2024-08-31T06:22:50.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.987+0000 7f1ef77fe640 1 -- 172.21.15.53:0/3246710423 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+11988 (secure 0 0 0) 0x7f1efc0ac8e0 con 0x7f1f00102820 2024-08-31T06:22:50.990 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:22:50.990 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":66,"btime":"2024-08-31T06:22:34:298615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":66,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:22:33.810373+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:22:50.990 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 66 2024-08-31T06:22:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.989+0000 7f1f083e0640 1 -- 172.21.15.53:0/3246710423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1eec0b4d50 msgr2=0x7f1eec0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.989+0000 7f1f083e0640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1eec0b4d50 0x7f1eec0b7260 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0006010 tx=0x7f1ef0000bc0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.989+0000 7f1f083e0640 1 -- 172.21.15.53:0/3246710423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f00102820 msgr2=0x7f1f001990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.989+0000 7f1f083e0640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f00102820 0x7f1f001990c0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00c920 tx=0x7f1efc00cde0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.989+0000 7f1f083e0640 1 -- 172.21.15.53:0/3246710423 shutdown_connections 2024-08-31T06:22:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.989+0000 7f1f083e0640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1eec0b4d50 0x7f1eec0b7260 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.989+0000 7f1f083e0640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f00108ab0 0x7f1f0019e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.989+0000 7f1f083e0640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f00108160 0x7f1f00199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.989+0000 7f1f083e0640 1 --2- 172.21.15.53:0/3246710423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f00102820 0x7f1f001990c0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.989+0000 7f1f083e0640 1 -- 172.21.15.53:0/3246710423 >> 172.21.15.53:0/3246710423 conn(0x7f1f000794e0 msgr2=0x7f1f00105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.990+0000 7f1f083e0640 1 -- 172.21.15.53:0/3246710423 shutdown_connections 2024-08-31T06:22:50.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:50.990+0000 7f1f083e0640 1 -- 172.21.15.53:0/3246710423 wait complete. 2024-08-31T06:22:51.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.42 MB/sec execute 159 sec latency 20535.189 ms 2024-08-31T06:22:51.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:51 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3246710423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:22:51.662 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:51 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3246710423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:22:51.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:51 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3246710423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:22:51.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:22:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:52.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.39 MB/sec execute 160 sec latency 21535.246 ms 2024-08-31T06:22:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.430+0000 7f3331879640 1 -- 172.21.15.53:0/407939202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f332c109b90 msgr2=0x7f332c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.430+0000 7f3331879640 1 --2- 172.21.15.53:0/407939202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f332c109b90 0x7f332c1103c0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f3324009ca0 tx=0x7f332402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.430+0000 7f3331879640 1 -- 172.21.15.53:0/407939202 shutdown_connections 2024-08-31T06:22:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.430+0000 7f3331879640 1 --2- 172.21.15.53:0/407939202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f332c109b90 0x7f332c1103c0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.430+0000 7f3331879640 1 --2- 172.21.15.53:0/407939202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f332c109240 0x7f332c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.430+0000 7f3331879640 1 --2- 172.21.15.53:0/407939202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f332c103900 0x7f332c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.430+0000 7f3331879640 1 -- 172.21.15.53:0/407939202 >> 172.21.15.53:0/407939202 conn(0x7f332c07b5f0 msgr2=0x7f332c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.430+0000 7f3331879640 1 -- 172.21.15.53:0/407939202 shutdown_connections 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.430+0000 7f3331879640 1 -- 172.21.15.53:0/407939202 wait complete. 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.431+0000 7f3331879640 1 Processor -- start 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.431+0000 7f3331879640 1 -- start start 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f3331879640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f332c103900 0x7f332c19a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f3331879640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f332c109240 0x7f332c19a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f3331879640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f332c109b90 0x7f332c19fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f3331879640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f332c113750 con 0x7f332c109240 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f3331879640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1135d0 con 0x7f332c109b90 2024-08-31T06:22:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f3331879640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1138d0 con 0x7f332c103900 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f332a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f332c109240 0x7f332c19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f332a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f332c109240 0x7f332c19a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43696/0 (socket says 172.21.15.53:43696) 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f332a7fc640 1 -- 172.21.15.53:0/3499459502 learned_addr learned my addr 172.21.15.53:0/3499459502 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f332affd640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f332c103900 0x7f332c19a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f332b7fe640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f332c109b90 0x7f332c19fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f332a7fc640 1 -- 172.21.15.53:0/3499459502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f332c103900 msgr2=0x7f332c19a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f332a7fc640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f332c103900 0x7f332c19a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f332a7fc640 1 -- 172.21.15.53:0/3499459502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f332c109b90 msgr2=0x7f332c19fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f332a7fc640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f332c109b90 0x7f332c19fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f332a7fc640 1 -- 172.21.15.53:0/3499459502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c1a0130 con 0x7f332c109240 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f332a7fc640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f332c109240 0x7f332c19a760 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f332000d740 tx=0x7f332000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.432+0000 7f3330877640 1 -- 172.21.15.53:0/3499459502 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320017070 con 0x7f332c109240 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.433+0000 7f3331879640 1 -- 172.21.15.53:0/3499459502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332c1a0420 con 0x7f332c109240 2024-08-31T06:22:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.433+0000 7f3330877640 1 -- 172.21.15.53:0/3499459502 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f332000de50 con 0x7f332c109240 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.433+0000 7f3330877640 1 -- 172.21.15.53:0/3499459502 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332000f620 con 0x7f332c109240 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.433+0000 7f3331879640 1 -- 172.21.15.53:0/3499459502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f332c1a6b80 con 0x7f332c109240 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f3337dee740 1 Processor -- start 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f3337dee740 1 -- start start 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f3337dee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b1a08070 0x5586b1dad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f3337dee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19df1b0 0x5586b1dad890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f3337dee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1daddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f3337dee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5586b1d24680 con 0x5586b19e7390 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f3337dee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5586b1d13c10 con 0x5586b1a08070 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f3337dee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5586b1d17bc0 con 0x5586b19df1b0 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f3330877640 1 -- 172.21.15.53:0/3499459502 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f332001a070 con 0x7f332c109240 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f332a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1daddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f332a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1daddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43710/0 (socket says 172.21.15.53:43710) 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.435+0000 7f332a7fc640 1 -- 172.21.15.53:0/1866543653 learned_addr learned my addr 172.21.15.53:0/1866543653 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f332affd640 1 --2- 172.21.15.53:0/1866543653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19df1b0 0x5586b1dad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f332b7fe640 1 --2- 172.21.15.53:0/1866543653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b1a08070 0x5586b1dad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f332a7fc640 1 -- 172.21.15.53:0/1866543653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19df1b0 msgr2=0x5586b1dad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f332a7fc640 1 --2- 172.21.15.53:0/1866543653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19df1b0 0x5586b1dad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f332a7fc640 1 -- 172.21.15.53:0/1866543653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b1a08070 msgr2=0x5586b1dad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f332a7fc640 1 --2- 172.21.15.53:0/1866543653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b1a08070 0x5586b1dad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f332a7fc640 1 -- 172.21.15.53:0/1866543653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b1a73650 con 0x5586b19e7390 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f332b7fe640 1 --2- 172.21.15.53:0/1866543653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b1a08070 0x5586b1dad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f332a7fc640 1 --2- 172.21.15.53:0/1866543653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1daddd0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f33200e24d0 tx=0x7f33200ed4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b501b0132f99a6ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f3311ffb640 1 -- 172.21.15.53:0/1866543653 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200f3600 con 0x5586b19e7390 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f3311ffb640 1 -- 172.21.15.53:0/1866543653 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33200f3c30 con 0x5586b19e7390 2024-08-31T06:22:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f3311ffb640 1 -- 172.21.15.53:0/1866543653 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200f2aa0 con 0x5586b19e7390 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.436+0000 7f3330877640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33140b4d20 0x7f33140b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f332b7fe640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33140b4d20 0x7f33140b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f3330877640 1 -- 172.21.15.53:0/3499459502 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f33200e4ec0 con 0x7f332c109240 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f3337dee740 1 -- 172.21.15.53:0/1866543653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 msgr2=0x5586b1daddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f332b7fe640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33140b4d20 0x7f33140b7230 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3324006010 tx=0x7f33240098e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f3337dee740 1 --2- 172.21.15.53:0/1866543653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1daddd0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f33200e24d0 tx=0x7f33200ed4b0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f3337dee740 1 -- 172.21.15.53:0/1866543653 shutdown_connections 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f3337dee740 1 --2- 172.21.15.53:0/1866543653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1daddd0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f3337dee740 1 --2- 172.21.15.53:0/1866543653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19df1b0 0x5586b1dad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f3337dee740 1 --2- 172.21.15.53:0/1866543653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b1a08070 0x5586b1dad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f3337dee740 1 -- 172.21.15.53:0/1866543653 >> 172.21.15.53:0/1866543653 conn(0x5586b19fc460 msgr2=0x5586b1dab240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:52.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f3337dee740 1 -- 172.21.15.53:0/1866543653 shutdown_connections 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.437+0000 7f3337dee740 1 -- 172.21.15.53:0/1866543653 wait complete. 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f3337dee740 1 -- start start 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f3337dee740 1 Processor -- start 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f3337dee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19df1b0 0x5586b1db8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f3337dee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19e7390 0x5586b1db8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f3337dee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b1a08070 0x5586b1dc4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f3337dee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5586b1b76700 con 0x5586b19df1b0 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f3337dee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5586b1c9a750 con 0x5586b19e7390 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f3337dee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5586b1dbbb30 con 0x5586b1a08070 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f3337dee740 10 client.0 _ll_register_callbacks cb 0x5586b1cc9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f332affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19df1b0 0x5586b1db8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f332affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19df1b0 0x5586b1db8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43714/0 (socket says 172.21.15.53:43714) 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f332affd640 1 -- 172.21.15.53:0/3827948382 learned_addr learned my addr 172.21.15.53:0/3827948382 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f332b7fe640 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b1a08070 0x5586b1dc4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.438+0000 7f332a7fc640 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19e7390 0x5586b1db8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f332affd640 1 -- 172.21.15.53:0/3827948382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b1a08070 msgr2=0x5586b1dc4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f332affd640 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b1a08070 0x5586b1dc4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f332affd640 1 -- 172.21.15.53:0/3827948382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19e7390 msgr2=0x5586b1db8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f332affd640 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19e7390 0x5586b1db8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f332affd640 1 -- 172.21.15.53:0/3827948382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586b1cd3900 con 0x5586b19df1b0 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f332a7fc640 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19e7390 0x5586b1db8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f332affd640 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19df1b0 0x5586b1db8a90 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f331c010820 tx=0x7f331c010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90d9e26f5e17de0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f330affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f330affd640 1 -- 172.21.15.53:0/3827948382 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c00fb90 con 0x5586b19df1b0 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f330affd640 1 -- 172.21.15.53:0/3827948382 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f331c00fd30 con 0x5586b19df1b0 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f3337dee740 1 -- 172.21.15.53:0/3827948382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33200f3c30 con 0x5586b19df1b0 2024-08-31T06:22:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f330affd640 1 -- 172.21.15.53:0/3827948382 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f331c005020 con 0x5586b19df1b0 2024-08-31T06:22:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f3337dee740 10 client.21027 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f3337dee740 1 -- 172.21.15.53:0/3827948382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5586b1dc7950 con 0x5586b19df1b0 2024-08-31T06:22:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.439+0000 7f330affd640 1 -- 172.21.15.53:0/3827948382 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33200f3c30 con 0x5586b19df1b0 2024-08-31T06:22:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.440+0000 7f330affd640 1 -- 172.21.15.53:0/3827948382 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f331c022480 con 0x5586b19df1b0 2024-08-31T06:22:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.440+0000 7f3337dee740 10 client.21027 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.440+0000 7f3337dee740 10 client.21027 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:22:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.440+0000 7f3337dee740 20 client.21027 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.440+0000 7f3337dee740 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586b19c69f0 0x5586b1dcaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.440+0000 7f3337dee740 4 client.21027 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.440+0000 7f3337dee740 1 -- 172.21.15.53:0/3827948382 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586b1d265d0 con 0x5586b19c69f0 2024-08-31T06:22:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.440+0000 7f332a7fc640 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586b19c69f0 0x5586b1dcaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.440+0000 7f330affd640 10 client.21027 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:22:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.440+0000 7f332a7fc640 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586b19c69f0 0x5586b1dcaf00 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a4f8ed4b1165327 server_cookie=5a51ccf67788c5ff in_seq=0 out_seq=0 2024-08-31T06:22:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.441+0000 7f330affd640 1 -- 172.21.15.53:0/3827948382 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5586b1d265d0 con 0x5586b19c69f0 2024-08-31T06:22:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.441+0000 7f330affd640 10 client.21027 handle_command_reply: tid=0 2024-08-31T06:22:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.441+0000 7f3337dee740 1 client.21027 shutdown 2024-08-31T06:22:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.441+0000 7f3337dee740 1 -- 172.21.15.53:0/3827948382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19df1b0 msgr2=0x5586b1db8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.441+0000 7f3337dee740 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19df1b0 0x5586b1db8a90 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f331c010820 tx=0x7f331c010ce0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.442+0000 7f3337dee740 1 -- 172.21.15.53:0/3827948382 shutdown_connections 2024-08-31T06:22:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.442+0000 7f3337dee740 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586b19c69f0 0x5586b1dcaf00 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.442+0000 7f3337dee740 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b1a08070 0x5586b1dc4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.442+0000 7f330affd640 0 client.21027 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.442+0000 7f3337dee740 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19e7390 0x5586b1db8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.442+0000 7f3337dee740 1 --2- 172.21.15.53:0/3827948382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19df1b0 0x5586b1db8a90 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.442+0000 7f3337dee740 1 -- 172.21.15.53:0/3827948382 >> 172.21.15.53:0/3827948382 conn(0x5586b19fc460 msgr2=0x5586b1db04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.442+0000 7f3337dee740 1 -- 172.21.15.53:0/3827948382 shutdown_connections 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.442+0000 7f3337dee740 1 -- 172.21.15.53:0/3827948382 wait complete. 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.442+0000 7f3337dee740 20 client.21027 trim_cache size 0 max 16384 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.455+0000 7f3337dee740 1 Processor -- start 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.455+0000 7f3337dee740 1 -- start start 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.455+0000 7f3337dee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19c69f0 0x5586b1daed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.455+0000 7f3337dee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19df1b0 0x5586b1dba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.455+0000 7f3337dee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1dc4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.455+0000 7f3337dee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1af5e0 con 0x5586b19e7390 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.455+0000 7f3337dee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1b1180 con 0x5586b19df1b0 2024-08-31T06:22:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.455+0000 7f3337dee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1afd10 con 0x5586b19c69f0 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.455+0000 7f332b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1dc4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.455+0000 7f332b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1dc4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43720/0 (socket says 172.21.15.53:43720) 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.455+0000 7f332b7fe640 1 -- 172.21.15.53:0/414434924 learned_addr learned my addr 172.21.15.53:0/414434924 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f332a7fc640 1 --2- 172.21.15.53:0/414434924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19df1b0 0x5586b1dba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f332affd640 1 --2- 172.21.15.53:0/414434924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19c69f0 0x5586b1daed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f332b7fe640 1 -- 172.21.15.53:0/414434924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19c69f0 msgr2=0x5586b1daed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f332b7fe640 1 --2- 172.21.15.53:0/414434924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19c69f0 0x5586b1daed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f332b7fe640 1 -- 172.21.15.53:0/414434924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19df1b0 msgr2=0x5586b1dba6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f332b7fe640 1 --2- 172.21.15.53:0/414434924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19df1b0 0x5586b1dba6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f332b7fe640 1 -- 172.21.15.53:0/414434924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b1db9d50 con 0x5586b19e7390 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f332affd640 1 --2- 172.21.15.53:0/414434924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19c69f0 0x5586b1daed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f332b7fe640 1 --2- 172.21.15.53:0/414434924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1dc4d50 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f3324035000 tx=0x7f3324044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46e65e1060f527d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f33117fa640 1 -- 172.21.15.53:0/414434924 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324003e10 con 0x5586b19e7390 2024-08-31T06:22:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f33117fa640 1 -- 172.21.15.53:0/414434924 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3324036050 con 0x5586b19e7390 2024-08-31T06:22:52.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.456+0000 7f33117fa640 1 -- 172.21.15.53:0/414434924 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324030960 con 0x5586b19e7390 2024-08-31T06:22:52.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.457+0000 7f3337dee740 1 -- 172.21.15.53:0/414434924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 msgr2=0x5586b1dc4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:52.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.457+0000 7f3337dee740 1 --2- 172.21.15.53:0/414434924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1dc4d50 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f3324035000 tx=0x7f3324044000 comp rx=0 tx=0).stop 2024-08-31T06:22:52.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.457+0000 7f3337dee740 1 -- 172.21.15.53:0/414434924 shutdown_connections 2024-08-31T06:22:52.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.457+0000 7f3337dee740 1 --2- 172.21.15.53:0/414434924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19e7390 0x5586b1dc4d50 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.457+0000 7f3337dee740 1 --2- 172.21.15.53:0/414434924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19df1b0 0x5586b1dba6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.457+0000 7f3337dee740 1 --2- 172.21.15.53:0/414434924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19c69f0 0x5586b1daed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.457+0000 7f3337dee740 1 -- 172.21.15.53:0/414434924 >> 172.21.15.53:0/414434924 conn(0x5586b19fc460 msgr2=0x5586b1db9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:52.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.457+0000 7f3337dee740 1 -- 172.21.15.53:0/414434924 shutdown_connections 2024-08-31T06:22:52.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.457+0000 7f3337dee740 1 -- 172.21.15.53:0/414434924 wait complete. 2024-08-31T06:22:52.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.457+0000 7f3337dee740 1 -- start start 2024-08-31T06:22:52.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f3337dee740 1 Processor -- start 2024-08-31T06:22:52.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f3337dee740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19c69f0 0x5586b1dbf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f3337dee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19df1b0 0x5586b1dbf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f3337dee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19e7390 0x5586b1e34910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f3337dee740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1b0ab0 con 0x5586b19c69f0 2024-08-31T06:22:52.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f3337dee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1b03e0 con 0x5586b19e7390 2024-08-31T06:22:52.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f3337dee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1ad5e0 con 0x5586b19df1b0 2024-08-31T06:22:52.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f3337dee740 10 client.0 _ll_register_callbacks cb 0x7f331c00a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:52.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f332affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19c69f0 0x5586b1dbf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f332affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19c69f0 0x5586b1dbf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43726/0 (socket says 172.21.15.53:43726) 2024-08-31T06:22:52.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f332affd640 1 -- 172.21.15.53:0/1598290856 learned_addr learned my addr 172.21.15.53:0/1598290856 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:52.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f332b7fe640 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19e7390 0x5586b1e34910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f332a7fc640 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19df1b0 0x5586b1dbf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f332affd640 1 -- 172.21.15.53:0/1598290856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19df1b0 msgr2=0x5586b1dbf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:52.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f332affd640 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19df1b0 0x5586b1dbf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f332affd640 1 -- 172.21.15.53:0/1598290856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19e7390 msgr2=0x5586b1e34910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:52.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f332affd640 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19e7390 0x5586b1e34910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.458+0000 7f332affd640 1 -- 172.21.15.53:0/1598290856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586b1dbfda0 con 0x5586b19c69f0 2024-08-31T06:22:52.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.459+0000 7f332affd640 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19c69f0 0x5586b1dbf040 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f331c000c00 tx=0x7f331c022cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e8c8ae69fd0e1b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:52.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.459+0000 7f330affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:52.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.459+0000 7f330affd640 1 -- 172.21.15.53:0/1598290856 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c031060 con 0x5586b19c69f0 2024-08-31T06:22:52.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.459+0000 7f330affd640 1 -- 172.21.15.53:0/1598290856 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f331c00fda0 con 0x5586b19c69f0 2024-08-31T06:22:52.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.459+0000 7f3337dee740 1 -- 172.21.15.53:0/1598290856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3324036050 con 0x5586b19c69f0 2024-08-31T06:22:52.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.459+0000 7f330affd640 1 -- 172.21.15.53:0/1598290856 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f331c0051c0 con 0x5586b19c69f0 2024-08-31T06:22:52.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.459+0000 7f3337dee740 10 client.21033 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:52.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.459+0000 7f3337dee740 1 -- 172.21.15.53:0/1598290856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5586b1e35e20 con 0x5586b19c69f0 2024-08-31T06:22:52.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.459+0000 7f330affd640 1 -- 172.21.15.53:0/1598290856 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3324036050 con 0x5586b19c69f0 2024-08-31T06:22:52.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f330affd640 1 -- 172.21.15.53:0/1598290856 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f331c004c00 con 0x5586b19c69f0 2024-08-31T06:22:52.484 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:22:52.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f3337dee740 10 client.21033 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:52.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f3337dee740 10 client.21033 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:22:52.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f3337dee740 20 client.21033 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:52.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f3337dee740 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586b1a08070 0x5586b1e38670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:52.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f3337dee740 4 client.21033 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:22:52.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f3337dee740 1 -- 172.21.15.53:0/1598290856 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5586b1d22070 con 0x5586b1a08070 2024-08-31T06:22:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f332a7fc640 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586b1a08070 0x5586b1e38670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f330affd640 10 client.21033 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:22:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f332a7fc640 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586b1a08070 0x5586b1e38670 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3508ecff65dbfa0e server_cookie=4bec361fd1fe6d9 in_seq=0 out_seq=0 2024-08-31T06:22:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f330affd640 1 -- 172.21.15.53:0/1598290856 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5586b1d22070 con 0x5586b1a08070 2024-08-31T06:22:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f330affd640 10 client.21033 handle_command_reply: tid=0 2024-08-31T06:22:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.460+0000 7f3337dee740 1 client.21033 shutdown 2024-08-31T06:22:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3337dee740 1 -- 172.21.15.53:0/1598290856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19c69f0 msgr2=0x5586b1dbf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3337dee740 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19c69f0 0x5586b1dbf040 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f331c000c00 tx=0x7f331c022cf0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3337dee740 1 -- 172.21.15.53:0/1598290856 shutdown_connections 2024-08-31T06:22:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3337dee740 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586b19e7390 0x5586b1e34910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3337dee740 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5586b1a08070 0x5586b1e38670 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3337dee740 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5586b19df1b0 0x5586b1dbf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3337dee740 1 --2- 172.21.15.53:0/1598290856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5586b19c69f0 0x5586b1dbf040 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f330affd640 0 client.21033 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:22:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3337dee740 1 -- 172.21.15.53:0/1598290856 >> 172.21.15.53:0/1598290856 conn(0x5586b19fc460 msgr2=0x5586b1daeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3337dee740 1 -- 172.21.15.53:0/1598290856 shutdown_connections 2024-08-31T06:22:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3337dee740 1 -- 172.21.15.53:0/1598290856 wait complete. 2024-08-31T06:22:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3337dee740 20 client.21033 trim_cache size 0 max 16384 2024-08-31T06:22:52.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3331879640 1 -- 172.21.15.53:0/3499459502 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33140b4d20 msgr2=0x7f33140b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:52.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3331879640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33140b4d20 0x7f33140b7230 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3324006010 tx=0x7f33240098e0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3331879640 1 -- 172.21.15.53:0/3499459502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f332c109240 msgr2=0x7f332c19a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:52.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3331879640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f332c109240 0x7f332c19a760 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f332000d740 tx=0x7f332000dc00 comp rx=0 tx=0).stop 2024-08-31T06:22:52.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3331879640 1 -- 172.21.15.53:0/3499459502 shutdown_connections 2024-08-31T06:22:52.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3331879640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f33140b4d20 0x7f33140b7230 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3331879640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f332c109b90 0x7f332c19fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3331879640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f332c109240 0x7f332c19a760 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3331879640 1 --2- 172.21.15.53:0/3499459502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f332c103900 0x7f332c19a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:52.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.461+0000 7f3331879640 1 -- 172.21.15.53:0/3499459502 >> 172.21.15.53:0/3499459502 conn(0x7f332c07b5f0 msgr2=0x7f332c1052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:52.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.462+0000 7f3331879640 1 -- 172.21.15.53:0/3499459502 shutdown_connections 2024-08-31T06:22:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:52.462+0000 7f3331879640 1 -- 172.21.15.53:0/3499459502 wait complete. 2024-08-31T06:22:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:52 smithi130 ceph-mon[22266]: pgmap v884: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 25 op/s 2024-08-31T06:22:52.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:52 smithi153 ceph-mon[22320]: pgmap v884: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 25 op/s 2024-08-31T06:22:52.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:52 smithi053 ceph-mon[18924]: pgmap v884: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 25 op/s 2024-08-31T06:22:53.156 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:22:53.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.36 MB/sec execute 161 sec latency 22535.275 ms 2024-08-31T06:22:53.407 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:53.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.891+0000 7fd907fd5640 1 -- 172.21.15.53:0/2976732883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd900108150 msgr2=0x7fd900108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.891+0000 7fd907fd5640 1 --2- 172.21.15.53:0/2976732883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd900108150 0x7fd900108560 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009900 tx=0x7fd8f002a410 comp rx=0 tx=0).stop 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.892+0000 7fd907fd5640 1 -- 172.21.15.53:0/2976732883 shutdown_connections 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.892+0000 7fd907fd5640 1 --2- 172.21.15.53:0/2976732883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd900108aa0 0x7fd90010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.892+0000 7fd907fd5640 1 --2- 172.21.15.53:0/2976732883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd900108150 0x7fd900108560 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.892+0000 7fd907fd5640 1 --2- 172.21.15.53:0/2976732883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd900102810 0x7fd900102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.892+0000 7fd907fd5640 1 -- 172.21.15.53:0/2976732883 >> 172.21.15.53:0/2976732883 conn(0x7fd9000794b0 msgr2=0x7fd9000798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.892+0000 7fd907fd5640 1 -- 172.21.15.53:0/2976732883 shutdown_connections 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.892+0000 7fd907fd5640 1 -- 172.21.15.53:0/2976732883 wait complete. 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.892+0000 7fd907fd5640 1 Processor -- start 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.892+0000 7fd907fd5640 1 -- start start 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd907fd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd900102810 0x7fd90019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd907fd5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd900108150 0x7fd90019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd907fd5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd900108aa0 0x7fd90019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd907fd5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001125e0 con 0x7fd900102810 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd907fd5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd900112460 con 0x7fd900108aa0 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd907fd5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd900112760 con 0x7fd900108150 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd905d71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd900102810 0x7fd90019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd905d71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd900102810 0x7fd90019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53580/0 (socket says 172.21.15.53:53580) 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd905d71640 1 -- 172.21.15.53:0/2368508191 learned_addr learned my addr 172.21.15.53:0/2368508191 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd905570640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd900108150 0x7fd90019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd906572640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd900108aa0 0x7fd90019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd905d71640 1 -- 172.21.15.53:0/2368508191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd900108150 msgr2=0x7fd90019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd905d71640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd900108150 0x7fd90019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd905d71640 1 -- 172.21.15.53:0/2368508191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd900108aa0 msgr2=0x7fd90019fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd905d71640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd900108aa0 0x7fd90019fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd905d71640 1 -- 172.21.15.53:0/2368508191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9001a0130 con 0x7fd900102810 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd906572640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd900108aa0 0x7fd90019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.893+0000 7fd905d71640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd900102810 0x7fd90019a1c0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00d950 tx=0x7fd8fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.894+0000 7fd8f6ffd640 1 -- 172.21.15.53:0/2368508191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc017070 con 0x7fd900102810 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.894+0000 7fd907fd5640 1 -- 172.21.15.53:0/2368508191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9001a0420 con 0x7fd900102810 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.894+0000 7fd8f6ffd640 1 -- 172.21.15.53:0/2368508191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8fc009c30 con 0x7fd900102810 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.894+0000 7fd907fd5640 1 -- 172.21.15.53:0/2368508191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9001a6b80 con 0x7fd900102810 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.894+0000 7fd8f6ffd640 1 -- 172.21.15.53:0/2368508191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc020060 con 0x7fd900102810 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.896+0000 7fd90e54a740 1 Processor -- start 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.896+0000 7fd90e54a740 1 -- start start 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.896+0000 7fd8f6ffd640 1 -- 172.21.15.53:0/2368508191 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd8fc010460 con 0x7fd900102810 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93d3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda900d390 0x55cda93d3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd90e54a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cda934a680 con 0x55cda902e070 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd90e54a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cda9339c10 con 0x55cda900d390 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd90e54a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cda933dbc0 con 0x55cda90051b0 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd906572640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd906572640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93d3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53586/0 (socket says 172.21.15.53:53586) 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd906572640 1 -- 172.21.15.53:0/3854815985 learned_addr learned my addr 172.21.15.53:0/3854815985 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd905d71640 1 --2- 172.21.15.53:0/3854815985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93d3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd905570640 1 --2- 172.21.15.53:0/3854815985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda900d390 0x55cda93d3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd906572640 1 -- 172.21.15.53:0/3854815985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 msgr2=0x55cda93d3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd906572640 1 --2- 172.21.15.53:0/3854815985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93d3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd906572640 1 -- 172.21.15.53:0/3854815985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda900d390 msgr2=0x55cda93d3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd906572640 1 --2- 172.21.15.53:0/3854815985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda900d390 0x55cda93d3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd906572640 1 -- 172.21.15.53:0/3854815985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda9099650 con 0x55cda902e070 2024-08-31T06:22:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd905570640 1 --2- 172.21.15.53:0/3854815985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda900d390 0x55cda93d3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.897+0000 7fd8f6ffd640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8ec0b4ca0 0x7fd8ec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.898+0000 7fd905d71640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8ec0b4ca0 0x7fd8ec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.898+0000 7fd906572640 1 --2- 172.21.15.53:0/3854815985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93d3310 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009f30 tx=0x7fd8f8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44baf6d18a59da28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.898+0000 7fd8f6ffd640 1 -- 172.21.15.53:0/2368508191 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7fd8fc0e5230 con 0x7fd900102810 2024-08-31T06:22:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.898+0000 7fd8ebfff640 1 -- 172.21.15.53:0/3854815985 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8016070 con 0x55cda902e070 2024-08-31T06:22:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.898+0000 7fd8ebfff640 1 -- 172.21.15.53:0/3854815985 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8f801baf0 con 0x55cda902e070 2024-08-31T06:22:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.898+0000 7fd8ebfff640 1 -- 172.21.15.53:0/3854815985 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8012b20 con 0x55cda902e070 2024-08-31T06:22:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.899+0000 7fd90e54a740 1 -- 172.21.15.53:0/3854815985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 msgr2=0x55cda93d3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.899+0000 7fd905d71640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8ec0b4ca0 0x7fd8ec0b71b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0e2a10 tx=0x7fd8fc000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.899+0000 7fd90e54a740 1 --2- 172.21.15.53:0/3854815985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93d3310 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009f30 tx=0x7fd8f8010800 comp rx=0 tx=0).stop 2024-08-31T06:22:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.899+0000 7fd90e54a740 1 -- 172.21.15.53:0/3854815985 shutdown_connections 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.899+0000 7fd90e54a740 1 --2- 172.21.15.53:0/3854815985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda900d390 0x55cda93d3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.899+0000 7fd90e54a740 1 --2- 172.21.15.53:0/3854815985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93d3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.899+0000 7fd90e54a740 1 --2- 172.21.15.53:0/3854815985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93d3310 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.899+0000 7fd90e54a740 1 -- 172.21.15.53:0/3854815985 >> 172.21.15.53:0/3854815985 conn(0x55cda9022460 msgr2=0x55cda93d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.899+0000 7fd90e54a740 1 -- 172.21.15.53:0/3854815985 shutdown_connections 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.899+0000 7fd90e54a740 1 -- 172.21.15.53:0/3854815985 wait complete. 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.899+0000 7fd90e54a740 1 -- start start 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd90e54a740 1 Processor -- start 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda900d390 0x55cda93e33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd90e54a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cda919c700 con 0x55cda902e070 2024-08-31T06:22:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd90e54a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cda92c0750 con 0x55cda900d390 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd90e54a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cda93e5e50 con 0x55cda90051b0 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd90e54a740 10 client.0 _ll_register_callbacks cb 0x55cda92efe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd906572640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd906572640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93ef1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53596/0 (socket says 172.21.15.53:53596) 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd906572640 1 -- 172.21.15.53:0/2178427911 learned_addr learned my addr 172.21.15.53:0/2178427911 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd905570640 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda900d390 0x55cda93e33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.900+0000 7fd906572640 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd906572640 1 -- 172.21.15.53:0/2178427911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 msgr2=0x55cda93e2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd906572640 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93e2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd906572640 1 -- 172.21.15.53:0/2178427911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda900d390 msgr2=0x55cda93e33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd906572640 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda900d390 0x55cda93e33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd906572640 1 -- 172.21.15.53:0/2178427911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cda92f9900 con 0x55cda902e070 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd906572640 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93ef1b0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009cc0 tx=0x7fd8f80127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2428472f1039439 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd8e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd8e97fa640 1 -- 172.21.15.53:0/2178427911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8016070 con 0x55cda902e070 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd8e97fa640 1 -- 172.21.15.53:0/2178427911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7fd8f801b830 con 0x55cda902e070 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd90e54a740 1 -- 172.21.15.53:0/2178427911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8f801baf0 con 0x55cda902e070 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd8e97fa640 1 -- 172.21.15.53:0/2178427911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fd8f8004a40 con 0x55cda902e070 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd90e54a740 10 client.21045 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd90e54a740 1 -- 172.21.15.53:0/2178427911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55cda93f1ba0 con 0x55cda902e070 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.901+0000 7fd8e97fa640 1 -- 172.21.15.53:0/2178427911 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8f801baf0 con 0x55cda902e070 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.902+0000 7fd8e97fa640 1 -- 172.21.15.53:0/2178427911 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fd8f800f040 con 0x55cda902e070 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.902+0000 7fd90e54a740 10 client.21045 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.902+0000 7fd90e54a740 10 client.21045 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.902+0000 7fd90e54a740 20 client.21045 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.902+0000 7fd90e54a740 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cda8fec9f0 0x55cda93f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.902+0000 7fd90e54a740 4 client.21045 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.902+0000 7fd90e54a740 1 -- 172.21.15.53:0/2178427911 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cda934c5d0 con 0x55cda8fec9f0 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.902+0000 7fd905570640 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cda8fec9f0 0x55cda93f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.903+0000 7fd905570640 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cda8fec9f0 0x55cda93f4f60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6c93a22b6eaadab1 server_cookie=93d63fd95e9eae8 in_seq=0 out_seq=0 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.903+0000 7fd8e97fa640 10 client.21045 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.903+0000 7fd8e97fa640 1 -- 172.21.15.53:0/2178427911 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cda934c5d0 con 0x55cda8fec9f0 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.903+0000 7fd8e97fa640 10 client.21045 handle_command_reply: tid=0 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.903+0000 7fd90e54a740 1 client.21045 shutdown 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd90e54a740 1 -- 172.21.15.53:0/2178427911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 msgr2=0x55cda93ef1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd90e54a740 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93ef1b0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009cc0 tx=0x7fd8f80127a0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd90e54a740 1 -- 172.21.15.53:0/2178427911 shutdown_connections 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd90e54a740 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cda8fec9f0 0x55cda93f4f60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd90e54a740 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda902e070 0x55cda93ef1b0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd90e54a740 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda900d390 0x55cda93e33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd90e54a740 1 --2- 172.21.15.53:0/2178427911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93e2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd8e97fa640 0 client.21045 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:22:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd90e54a740 1 -- 172.21.15.53:0/2178427911 >> 172.21.15.53:0/2178427911 conn(0x55cda9022460 msgr2=0x55cda93cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd90e54a740 1 -- 172.21.15.53:0/2178427911 shutdown_connections 2024-08-31T06:22:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd90e54a740 1 -- 172.21.15.53:0/2178427911 wait complete. 2024-08-31T06:22:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.904+0000 7fd90e54a740 20 client.21045 trim_cache size 0 max 16384 2024-08-31T06:22:53.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.917+0000 7fd90e54a740 1 Processor -- start 2024-08-31T06:22:53.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.917+0000 7fd90e54a740 1 -- start start 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93ef0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda902e070 0x55cda93e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd90e54a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001ad290 con 0x55cda900d390 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd90e54a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001aee30 con 0x55cda902e070 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd90e54a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001ad9c0 con 0x55cda90051b0 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd905570640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd905570640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53604/0 (socket says 172.21.15.53:53604) 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd905570640 1 -- 172.21.15.53:0/114942529 learned_addr learned my addr 172.21.15.53:0/114942529 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd906572640 1 --2- 172.21.15.53:0/114942529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93ef0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd905570640 1 -- 172.21.15.53:0/114942529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 msgr2=0x55cda93ef0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd905570640 1 --2- 172.21.15.53:0/114942529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93ef0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd906572640 1 --2- 172.21.15.53:0/114942529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda902e070 0x55cda93e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd905570640 1 -- 172.21.15.53:0/114942529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda902e070 msgr2=0x55cda93e05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:53.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd905570640 1 --2- 172.21.15.53:0/114942529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda902e070 0x55cda93e05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd905570640 1 -- 172.21.15.53:0/114942529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda93d6140 con 0x55cda900d390 2024-08-31T06:22:53.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd905570640 1 --2- 172.21.15.53:0/114942529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e0060 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0005940 tx=0x7fd8f00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84bfbe327e00b17 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:53.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd8eb7fe640 1 -- 172.21.15.53:0/114942529 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0035040 con 0x55cda900d390 2024-08-31T06:22:53.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.918+0000 7fd8eb7fe640 1 -- 172.21.15.53:0/114942529 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8f00043f0 con 0x55cda900d390 2024-08-31T06:22:53.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.919+0000 7fd8eb7fe640 1 -- 172.21.15.53:0/114942529 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0003cd0 con 0x55cda900d390 2024-08-31T06:22:53.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.919+0000 7fd90e54a740 1 -- 172.21.15.53:0/114942529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 msgr2=0x55cda93e0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:53.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.919+0000 7fd90e54a740 1 --2- 172.21.15.53:0/114942529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e0060 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0005940 tx=0x7fd8f00058d0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.919+0000 7fd90e54a740 1 -- 172.21.15.53:0/114942529 shutdown_connections 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.919+0000 7fd90e54a740 1 --2- 172.21.15.53:0/114942529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda902e070 0x55cda93e05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.919+0000 7fd90e54a740 1 --2- 172.21.15.53:0/114942529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e0060 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.919+0000 7fd90e54a740 1 --2- 172.21.15.53:0/114942529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93ef0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.919+0000 7fd90e54a740 1 -- 172.21.15.53:0/114942529 >> 172.21.15.53:0/114942529 conn(0x55cda9022460 msgr2=0x55cda93e16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.919+0000 7fd90e54a740 1 -- 172.21.15.53:0/114942529 shutdown_connections 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.919+0000 7fd90e54a740 1 -- 172.21.15.53:0/114942529 wait complete. 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd90e54a740 1 -- start start 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd90e54a740 1 Processor -- start 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd90e54a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda902e070 0x55cda94588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd90e54a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001ae760 con 0x55cda900d390 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd90e54a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001ae090 con 0x55cda902e070 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd90e54a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001ab290 con 0x55cda90051b0 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd90e54a740 10 client.0 _ll_register_callbacks cb 0x7fd8f8009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd905570640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd905570640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53616/0 (socket says 172.21.15.53:53616) 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd905570640 1 -- 172.21.15.53:0/3942968451 learned_addr learned my addr 172.21.15.53:0/3942968451 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.920+0000 7fd906572640 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd906572640 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda902e070 0x55cda94588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd905570640 1 -- 172.21.15.53:0/3942968451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 msgr2=0x55cda93e7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd905570640 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93e7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd905570640 1 -- 172.21.15.53:0/3942968451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda902e070 msgr2=0x55cda94588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd905570640 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda902e070 0x55cda94588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd905570640 1 -- 172.21.15.53:0/3942968451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cda9458f30 con 0x55cda900d390 2024-08-31T06:22:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd906572640 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda902e070 0x55cda94588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd905570640 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e8090 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fd8f002a930 tx=0x7fd8f00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3b7ac043031151 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd8e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd8e97fa640 1 -- 172.21.15.53:0/3942968451 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0050020 con 0x55cda900d390 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd90e54a740 1 -- 172.21.15.53:0/3942968451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8f00043f0 con 0x55cda900d390 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd8e97fa640 1 -- 172.21.15.53:0/3942968451 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7fd8f0003b60 con 0x55cda900d390 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd8e97fa640 1 -- 172.21.15.53:0/3942968451 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fd8f005b050 con 0x55cda900d390 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd90e54a740 10 client.21051 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.921+0000 7fd90e54a740 1 -- 172.21.15.53:0/3942968451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55cda9460250 con 0x55cda900d390 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.922+0000 7fd8e97fa640 1 -- 172.21.15.53:0/3942968451 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8f00043f0 con 0x55cda900d390 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.922+0000 7fd8e97fa640 1 -- 172.21.15.53:0/3942968451 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fd8f003c5d0 con 0x55cda900d390 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.922+0000 7fd90e54a740 10 client.21051 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.922+0000 7fd90e54a740 10 client.21051 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:22:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.922+0000 7fd90e54a740 20 client.21051 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.922+0000 7fd90e54a740 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cda8fc1da0 0x55cda94629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.922+0000 7fd90e54a740 4 client.21051 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.922+0000 7fd90e54a740 1 -- 172.21.15.53:0/3942968451 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cda9348070 con 0x55cda8fc1da0 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.922+0000 7fd906572640 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cda8fc1da0 0x55cda94629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd906572640 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cda8fc1da0 0x55cda94629d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=676ee3b1a4935826 server_cookie=55c5b788f813872e in_seq=0 out_seq=0 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd8e97fa640 10 client.21051 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd8e97fa640 1 -- 172.21.15.53:0/3942968451 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cda9348070 con 0x55cda8fc1da0 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd8e97fa640 10 client.21051 handle_command_reply: tid=0 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 1 client.21051 shutdown 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 1 -- 172.21.15.53:0/3942968451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 msgr2=0x55cda93e8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e8090 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fd8f002a930 tx=0x7fd8f00045e0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 1 -- 172.21.15.53:0/3942968451 shutdown_connections 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cda902e070 0x55cda94588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cda8fc1da0 0x55cda94629d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cda900d390 0x55cda93e8090 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 1 --2- 172.21.15.53:0/3942968451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cda90051b0 0x55cda93e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 1 -- 172.21.15.53:0/3942968451 >> 172.21.15.53:0/3942968451 conn(0x55cda9022460 msgr2=0x55cda93d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:53.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd8e97fa640 0 client.21051 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:22:53.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 1 -- 172.21.15.53:0/3942968451 shutdown_connections 2024-08-31T06:22:53.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 1 -- 172.21.15.53:0/3942968451 wait complete. 2024-08-31T06:22:53.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.923+0000 7fd90e54a740 20 client.21051 trim_cache size 0 max 16384 2024-08-31T06:22:53.930 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:22:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 -- 172.21.15.53:0/2368508191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8ec0b4ca0 msgr2=0x7fd8ec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8ec0b4ca0 0x7fd8ec0b71b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0e2a10 tx=0x7fd8fc000bc0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 -- 172.21.15.53:0/2368508191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd900102810 msgr2=0x7fd90019a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd900102810 0x7fd90019a1c0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00d950 tx=0x7fd8fc00de10 comp rx=0 tx=0).stop 2024-08-31T06:22:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 -- 172.21.15.53:0/2368508191 shutdown_connections 2024-08-31T06:22:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fd8ec0b4ca0 0x7fd8ec0b71b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd900108aa0 0x7fd90019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd900108150 0x7fd90019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 --2- 172.21.15.53:0/2368508191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd900102810 0x7fd90019a1c0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 -- 172.21.15.53:0/2368508191 >> 172.21.15.53:0/2368508191 conn(0x7fd9000794b0 msgr2=0x7fd900101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 -- 172.21.15.53:0/2368508191 shutdown_connections 2024-08-31T06:22:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:53.924+0000 7fd907fd5640 1 -- 172.21.15.53:0/2368508191 wait complete. 2024-08-31T06:22:54.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.32 MB/sec execute 162 sec latency 23535.303 ms 2024-08-31T06:22:54.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:54 smithi130 ceph-mon[22266]: pgmap v885: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 19 op/s 2024-08-31T06:22:54.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:54 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:22:54.663 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:54 smithi053 ceph-mon[18924]: pgmap v885: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 19 op/s 2024-08-31T06:22:54.663 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:54 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:22:54.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:54 smithi153 ceph-mon[22320]: pgmap v885: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 19 op/s 2024-08-31T06:22:54.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:54 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:22:54.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:22:54.955 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:55.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.29 MB/sec execute 163 sec latency 24535.332 ms 2024-08-31T06:22:55.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.466+0000 7f7bab59e640 1 -- 172.21.15.53:0/2346063808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac101c90 msgr2=0x7f7bac1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:55.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.466+0000 7f7bab59e640 1 --2- 172.21.15.53:0/2346063808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac101c90 0x7f7bac1020a0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009900 tx=0x7f7b9c02a410 comp rx=0 tx=0).stop 2024-08-31T06:22:55.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.466+0000 7f7bab59e640 1 -- 172.21.15.53:0/2346063808 shutdown_connections 2024-08-31T06:22:55.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.466+0000 7f7bab59e640 1 --2- 172.21.15.53:0/2346063808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac1067d0 0x7f7bac110220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.466+0000 7f7bab59e640 1 --2- 172.21.15.53:0/2346063808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac105e80 0x7f7bac106290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.466+0000 7f7bab59e640 1 --2- 172.21.15.53:0/2346063808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac101c90 0x7f7bac1020a0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.466+0000 7f7bab59e640 1 -- 172.21.15.53:0/2346063808 >> 172.21.15.53:0/2346063808 conn(0x7f7bac077880 msgr2=0x7f7bac077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:55.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.466+0000 7f7bab59e640 1 -- 172.21.15.53:0/2346063808 shutdown_connections 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.466+0000 7f7bab59e640 1 -- 172.21.15.53:0/2346063808 wait complete. 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7bab59e640 1 Processor -- start 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7bab59e640 1 -- start start 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7bab59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac101c90 0x7f7bac19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7bab59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac105e80 0x7f7bac19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7bab59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac1067d0 0x7f7bac19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7bab59e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac113540 con 0x7f7bac1067d0 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7bab59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1133c0 con 0x7f7bac105e80 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7bab59e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1136c0 con 0x7f7bac101c90 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7baad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac1067d0 0x7f7bac19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7baad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac1067d0 0x7f7bac19f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53630/0 (socket says 172.21.15.53:53630) 2024-08-31T06:22:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7baa59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac101c90 0x7f7bac19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.467+0000 7f7baad9d640 1 -- 172.21.15.53:0/1098492183 learned_addr learned my addr 172.21.15.53:0/1098492183 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac105e80 0x7f7bac19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7baad9d640 1 -- 172.21.15.53:0/1098492183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac101c90 msgr2=0x7f7bac19a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7baad9d640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac101c90 0x7f7bac19a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7baad9d640 1 -- 172.21.15.53:0/1098492183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac105e80 msgr2=0x7f7bac19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7baad9d640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac105e80 0x7f7bac19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7baad9d640 1 -- 172.21.15.53:0/1098492183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bac19ff80 con 0x7f7bac1067d0 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7baad9d640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac1067d0 0x7f7bac19f850 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400eb10 tx=0x7f7ba400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7ba3fff640 1 -- 172.21.15.53:0/1098492183 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4004b20 con 0x7f7bac1067d0 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7bab59e640 1 -- 172.21.15.53:0/1098492183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bac1a0270 con 0x7f7bac1067d0 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7ba3fff640 1 -- 172.21.15.53:0/1098492183 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ba4004cc0 con 0x7f7bac1067d0 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7ba3fff640 1 -- 172.21.15.53:0/1098492183 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4010690 con 0x7f7bac1067d0 2024-08-31T06:22:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.468+0000 7f7bab59e640 1 -- 172.21.15.53:0/1098492183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bac1a69d0 con 0x7f7bac1067d0 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.471+0000 7f7bb6d76740 1 Processor -- start 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.471+0000 7f7ba3fff640 1 -- 172.21.15.53:0/1098492183 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7ba4005020 con 0x7f7bac1067d0 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.471+0000 7f7bb6d76740 1 -- start start 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.471+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d29a8070 0x5643d2d4d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.471+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d4d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.471+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d4df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.471+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5643d2cc4680 con 0x5643d2987390 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.471+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5643d2cb3c10 con 0x5643d29a8070 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.471+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5643d2cb7bc0 con 0x5643d297f1b0 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7ba1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d4df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7ba1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d4df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53646/0 (socket says 172.21.15.53:53646) 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7baa59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d4d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7ba1d9b640 1 -- 172.21.15.53:0/4257171977 learned_addr learned my addr 172.21.15.53:0/4257171977 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/4257171977 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d29a8070 0x5643d2d4d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7baa59c640 1 -- 172.21.15.53:0/4257171977 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d29a8070 msgr2=0x5643d2d4d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7baa59c640 1 --2- 172.21.15.53:0/4257171977 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d29a8070 0x5643d2d4d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7baa59c640 1 -- 172.21.15.53:0/4257171977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 msgr2=0x5643d2d4df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7baa59c640 1 --2- 172.21.15.53:0/4257171977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d4df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7baa59c640 1 -- 172.21.15.53:0/4257171977 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643d2a13650 con 0x5643d297f1b0 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/4257171977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d4df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7ba3fff640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4ca0 0x7f7b980b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4ca0 0x7f7b980b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7baa59c640 1 --2- 172.21.15.53:0/4257171977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d4d9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c005940 tx=0x7f7b9c031af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef93d071e4685ed6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7ba3fff640 1 -- 172.21.15.53:0/1098492183 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f7ba40e5b00 con 0x7f7bac1067d0 2024-08-31T06:22:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7ba0d99640 1 -- 172.21.15.53:0/4257171977 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c035030 con 0x5643d297f1b0 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7ba0d99640 1 -- 172.21.15.53:0/4257171977 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b9c040070 con 0x5643d297f1b0 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.472+0000 7f7ba0d99640 1 -- 172.21.15.53:0/4257171977 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c003850 con 0x5643d297f1b0 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.473+0000 7f7bb6d76740 1 -- 172.21.15.53:0/4257171977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 msgr2=0x5643d2d4d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.473+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4ca0 0x7f7b980b71b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7b940149b0 tx=0x7f7b94004730 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.473+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/4257171977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d4d9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c005940 tx=0x7f7b9c031af0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.473+0000 7f7bb6d76740 1 -- 172.21.15.53:0/4257171977 shutdown_connections 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.473+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/4257171977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d4df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.473+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/4257171977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d4d9f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.473+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/4257171977 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d29a8070 0x5643d2d4d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.473+0000 7f7bb6d76740 1 -- 172.21.15.53:0/4257171977 >> 172.21.15.53:0/4257171977 conn(0x5643d299c460 msgr2=0x5643d2d4b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.473+0000 7f7bb6d76740 1 -- 172.21.15.53:0/4257171977 shutdown_connections 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.473+0000 7f7bb6d76740 1 -- 172.21.15.53:0/4257171977 wait complete. 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7bb6d76740 1 -- start start 2024-08-31T06:22:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7bb6d76740 1 Processor -- start 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d297f1b0 0x5643d2d58c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d59180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d29a8070 0x5643d2d64f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5643d2b16700 con 0x5643d2987390 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5643d2c3a750 con 0x5643d297f1b0 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5643d2d5bc30 con 0x5643d29a8070 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7bb6d76740 10 client.0 _ll_register_callbacks cb 0x5643d2c69e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7ba1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d59180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7ba1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d59180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53650/0 (socket says 172.21.15.53:53650) 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.474+0000 7f7ba1d9b640 1 -- 172.21.15.53:0/2643695038 learned_addr learned my addr 172.21.15.53:0/2643695038 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7baad9d640 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d29a8070 0x5643d2d64f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7baa59c640 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d297f1b0 0x5643d2d58c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7ba1d9b640 1 -- 172.21.15.53:0/2643695038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d29a8070 msgr2=0x5643d2d64f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d29a8070 0x5643d2d64f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7ba1d9b640 1 -- 172.21.15.53:0/2643695038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d297f1b0 msgr2=0x5643d2d58c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d297f1b0 0x5643d2d58c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7ba1d9b640 1 -- 172.21.15.53:0/2643695038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643d2c73900 con 0x5643d2987390 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d59180 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f7b94005880 tx=0x7f7b940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35f34ee119ee292 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7b91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7b91ffb640 1 -- 172.21.15.53:0/2643695038 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400fb90 con 0x5643d2987390 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7b91ffb640 1 -- 172.21.15.53:0/2643695038 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f7b9400fd30 con 0x5643d2987390 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7bb6d76740 1 -- 172.21.15.53:0/2643695038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b9c040070 con 0x5643d2987390 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7b91ffb640 1 -- 172.21.15.53:0/2643695038 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f7b94011440 con 0x5643d2987390 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7bb6d76740 10 client.21063 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.475+0000 7f7bb6d76740 1 -- 172.21.15.53:0/2643695038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5643d2d67aa0 con 0x5643d2987390 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.476+0000 7f7b91ffb640 1 -- 172.21.15.53:0/2643695038 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b9c040070 con 0x5643d2987390 2024-08-31T06:22:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.476+0000 7f7b91ffb640 1 -- 172.21.15.53:0/2643695038 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f7b94029520 con 0x5643d2987390 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.476+0000 7f7bb6d76740 10 client.21063 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.476+0000 7f7bb6d76740 10 client.21063 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.476+0000 7f7bb6d76740 20 client.21063 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.476+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5643d29669f0 0x5643d2d6b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.476+0000 7f7bb6d76740 4 client.21063 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.476+0000 7f7bb6d76740 1 -- 172.21.15.53:0/2643695038 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643d2cc65d0 con 0x5643d29669f0 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.476+0000 7f7baa59c640 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5643d29669f0 0x5643d2d6b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7baa59c640 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5643d29669f0 0x5643d2d6b020 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aecf247a078db9c4 server_cookie=d25fc37b50ba1c7b in_seq=0 out_seq=0 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7b91ffb640 10 client.21063 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7b91ffb640 1 -- 172.21.15.53:0/2643695038 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643d2cc65d0 con 0x5643d29669f0 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7b91ffb640 10 client.21063 handle_command_reply: tid=0 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7bb6d76740 1 client.21063 shutdown 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7bb6d76740 1 -- 172.21.15.53:0/2643695038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 msgr2=0x5643d2d59180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d59180 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f7b94005880 tx=0x7f7b940046c0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7bb6d76740 1 -- 172.21.15.53:0/2643695038 shutdown_connections 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5643d29669f0 0x5643d2d6b020 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d29a8070 0x5643d2d64f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d59180 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7b91ffb640 0 client.21063 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/2643695038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d297f1b0 0x5643d2d58c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.477+0000 7f7bb6d76740 1 -- 172.21.15.53:0/2643695038 >> 172.21.15.53:0/2643695038 conn(0x5643d299c460 msgr2=0x5643d2d50640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.478+0000 7f7bb6d76740 1 -- 172.21.15.53:0/2643695038 shutdown_connections 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.478+0000 7f7bb6d76740 1 -- 172.21.15.53:0/2643695038 wait complete. 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.478+0000 7f7bb6d76740 20 client.21063 trim_cache size 0 max 16384 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7bb6d76740 1 Processor -- start 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7bb6d76740 1 -- start start 2024-08-31T06:22:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d29669f0 0x5643d2d5a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d55e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d56370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1af3d0 con 0x5643d2987390 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1b0f70 con 0x5643d29669f0 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1afb00 con 0x5643d297f1b0 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7baad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d56370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7baad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d56370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53656/0 (socket says 172.21.15.53:53656) 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7baad9d640 1 -- 172.21.15.53:0/4217681869 learned_addr learned my addr 172.21.15.53:0/4217681869 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/4217681869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d55e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7baa59c640 1 --2- 172.21.15.53:0/4217681869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d29669f0 0x5643d2d5a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.491+0000 7f7baad9d640 1 -- 172.21.15.53:0/4217681869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 msgr2=0x5643d2d55e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.492+0000 7f7baad9d640 1 --2- 172.21.15.53:0/4217681869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d55e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.492+0000 7f7baad9d640 1 -- 172.21.15.53:0/4217681869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d29669f0 msgr2=0x5643d2d5a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:55.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.492+0000 7f7baad9d640 1 --2- 172.21.15.53:0/4217681869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d29669f0 0x5643d2d5a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.492+0000 7f7baad9d640 1 -- 172.21.15.53:0/4217681869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643d2d4fd40 con 0x5643d2987390 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.492+0000 7f7baa59c640 1 --2- 172.21.15.53:0/4217681869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d29669f0 0x5643d2d5a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.492+0000 7f7baad9d640 1 --2- 172.21.15.53:0/4217681869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d56370 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f7ba40abed0 tx=0x7f7ba4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6e33cad25e44a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.492+0000 7f7b93fff640 1 -- 172.21.15.53:0/4217681869 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba40ac8d0 con 0x5643d2987390 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.492+0000 7f7b93fff640 1 -- 172.21.15.53:0/4217681869 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ba40ac1d0 con 0x5643d2987390 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.492+0000 7f7b93fff640 1 -- 172.21.15.53:0/4217681869 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba40ac690 con 0x5643d2987390 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.493+0000 7f7bb6d76740 1 -- 172.21.15.53:0/4217681869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 msgr2=0x5643d2d56370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.493+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/4217681869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d56370 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f7ba40abed0 tx=0x7f7ba4000f40 comp rx=0 tx=0).stop 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.493+0000 7f7bb6d76740 1 -- 172.21.15.53:0/4217681869 shutdown_connections 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.493+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/4217681869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d2987390 0x5643d2d56370 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.493+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/4217681869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d55e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.493+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/4217681869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d29669f0 0x5643d2d5a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.493+0000 7f7bb6d76740 1 -- 172.21.15.53:0/4217681869 >> 172.21.15.53:0/4217681869 conn(0x5643d299c460 msgr2=0x5643d2d5a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.493+0000 7f7bb6d76740 1 -- 172.21.15.53:0/4217681869 shutdown_connections 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.493+0000 7f7bb6d76740 1 -- 172.21.15.53:0/4217681869 wait complete. 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.493+0000 7f7bb6d76740 1 -- start start 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.493+0000 7f7bb6d76740 1 Processor -- start 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d29669f0 0x5643d2d61520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d5be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7bb6d76740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d2987390 0x5643d2d5c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1b08a0 con 0x5643d29669f0 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1b01d0 con 0x5643d2987390 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7bb6d76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1ad3d0 con 0x5643d297f1b0 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7bb6d76740 10 client.0 _ll_register_callbacks cb 0x7f7b94005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7baa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d29669f0 0x5643d2d61520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7baa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d29669f0 0x5643d2d61520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53660/0 (socket says 172.21.15.53:53660) 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7baa59c640 1 -- 172.21.15.53:0/590727566 learned_addr learned my addr 172.21.15.53:0/590727566 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d5be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7baad9d640 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d2987390 0x5643d2d5c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7baa59c640 1 -- 172.21.15.53:0/590727566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 msgr2=0x5643d2d5be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7baa59c640 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d5be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7baa59c640 1 -- 172.21.15.53:0/590727566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d2987390 msgr2=0x5643d2d5c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7baa59c640 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d2987390 0x5643d2d5c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7baa59c640 1 -- 172.21.15.53:0/590727566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643d2d5c9c0 con 0x5643d29669f0 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7baad9d640 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d2987390 0x5643d2d5c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7baa59c640 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d29669f0 0x5643d2d61520 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c006010 tx=0x7f7b9c031be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69309bc347c38382 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.494+0000 7f7b91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7b91ffb640 1 -- 172.21.15.53:0/590727566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c035040 con 0x5643d29669f0 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7b91ffb640 1 -- 172.21.15.53:0/590727566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f7b9c031600 con 0x5643d29669f0 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7bb6d76740 1 -- 172.21.15.53:0/590727566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ba40ac1d0 con 0x5643d29669f0 2024-08-31T06:22:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7b91ffb640 1 -- 172.21.15.53:0/590727566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f7b9c009520 con 0x5643d29669f0 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7bb6d76740 10 client.21069 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7bb6d76740 1 -- 172.21.15.53:0/590727566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5643d2dd67c0 con 0x5643d29669f0 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7b91ffb640 1 -- 172.21.15.53:0/590727566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ba40ac1d0 con 0x5643d29669f0 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7b91ffb640 1 -- 172.21.15.53:0/590727566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f7b9c051470 con 0x5643d29669f0 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7bb6d76740 10 client.21069 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7bb6d76740 10 client.21069 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7bb6d76740 20 client.21069 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5643d29a8070 0x5643d2dd8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7bb6d76740 4 client.21069 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.495+0000 7f7bb6d76740 1 -- 172.21.15.53:0/590727566 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643d2cc2070 con 0x5643d29a8070 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5643d29a8070 0x5643d2dd8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7ba1d9b640 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5643d29a8070 0x5643d2dd8b10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cdba6d525dd834dd server_cookie=7a584189870e13fc in_seq=0 out_seq=0 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7b91ffb640 10 client.21069 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:22:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7b91ffb640 1 -- 172.21.15.53:0/590727566 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643d2cc2070 con 0x5643d29a8070 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7b91ffb640 10 client.21069 handle_command_reply: tid=0 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7bb6d76740 1 client.21069 shutdown 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7bb6d76740 1 -- 172.21.15.53:0/590727566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d29669f0 msgr2=0x5643d2d61520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d29669f0 0x5643d2d61520 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c006010 tx=0x7f7b9c031be0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7bb6d76740 1 -- 172.21.15.53:0/590727566 shutdown_connections 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5643d29a8070 0x5643d2dd8b10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643d2987390 0x5643d2d5c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7b91ffb640 0 client.21069 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643d297f1b0 0x5643d2d5be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7bb6d76740 1 --2- 172.21.15.53:0/590727566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643d29669f0 0x5643d2d61520 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.496+0000 7f7bb6d76740 1 -- 172.21.15.53:0/590727566 >> 172.21.15.53:0/590727566 conn(0x5643d299c460 msgr2=0x5643d2d49810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bb6d76740 1 -- 172.21.15.53:0/590727566 shutdown_connections 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bb6d76740 1 -- 172.21.15.53:0/590727566 wait complete. 2024-08-31T06:22:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bb6d76740 20 client.21069 trim_cache size 0 max 16384 2024-08-31T06:22:55.515 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:22:55.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 -- 172.21.15.53:0/1098492183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4ca0 msgr2=0x7f7b980b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:55.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4ca0 0x7f7b980b71b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7b940149b0 tx=0x7f7b94004730 comp rx=0 tx=0).stop 2024-08-31T06:22:55.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 -- 172.21.15.53:0/1098492183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac1067d0 msgr2=0x7f7bac19f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:55.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac1067d0 0x7f7bac19f850 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400eb10 tx=0x7f7ba400c2d0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 -- 172.21.15.53:0/1098492183 shutdown_connections 2024-08-31T06:22:55.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b980b4ca0 0x7f7b980b71b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bac1067d0 0x7f7bac19f850 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bac105e80 0x7f7bac19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 --2- 172.21.15.53:0/1098492183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac101c90 0x7f7bac19a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:55.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 -- 172.21.15.53:0/1098492183 >> 172.21.15.53:0/1098492183 conn(0x7f7bac077880 msgr2=0x7f7bac107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:55.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 -- 172.21.15.53:0/1098492183 shutdown_connections 2024-08-31T06:22:55.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:55.497+0000 7f7bab59e640 1 -- 172.21.15.53:0/1098492183 wait complete. 2024-08-31T06:22:55.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:55 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:22:55.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:55 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:22:55.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:55 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:22:55.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:55 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:22:55.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:55 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:22:55.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:55 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:22:55.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:55 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:22:55.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:55 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:22:55.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:55 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:22:56.216 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:22:56.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.26 MB/sec execute 164 sec latency 25535.362 ms 2024-08-31T06:22:56.471 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:56.606 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:56 smithi053 ceph-mon[18924]: pgmap v886: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-08-31T06:22:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:56 smithi130 ceph-mon[22266]: pgmap v886: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-08-31T06:22:56.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:56 smithi153 ceph-mon[22320]: pgmap v886: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-08-31T06:22:56.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.957+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/328806217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f54108140 msgr2=0x7f1f54108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.957+0000 7f1f5c7c6640 1 --2- 172.21.15.53:0/328806217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f54108140 0x7f1f54108550 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009900 tx=0x7f1f4402a410 comp rx=0 tx=0).stop 2024-08-31T06:22:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.957+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/328806217 shutdown_connections 2024-08-31T06:22:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.957+0000 7f1f5c7c6640 1 --2- 172.21.15.53:0/328806217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f54108a90 0x7f1f5410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.957+0000 7f1f5c7c6640 1 --2- 172.21.15.53:0/328806217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f54108140 0x7f1f54108550 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.957+0000 7f1f5c7c6640 1 --2- 172.21.15.53:0/328806217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f54102800 0x7f1f54102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.957+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/328806217 >> 172.21.15.53:0/328806217 conn(0x7f1f540794d0 msgr2=0x7f1f540798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.957+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/328806217 shutdown_connections 2024-08-31T06:22:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.957+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/328806217 wait complete. 2024-08-31T06:22:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5c7c6640 1 Processor -- start 2024-08-31T06:22:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5c7c6640 1 -- start start 2024-08-31T06:22:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5c7c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f54102800 0x7f1f5419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5c7c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f54108140 0x7f1f5419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5c7c6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f54108a90 0x7f1f5419f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5c7c6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541125f0 con 0x7f1f54102800 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5c7c6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f54112470 con 0x7f1f54108140 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5c7c6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1f54112770 con 0x7f1f54108a90 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5a562640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f54102800 0x7f1f5419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5a562640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f54102800 0x7f1f5419a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53682/0 (socket says 172.21.15.53:53682) 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5a562640 1 -- 172.21.15.53:0/4251935576 learned_addr learned my addr 172.21.15.53:0/4251935576 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f54108a90 0x7f1f5419f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f59d61640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f54108140 0x7f1f5419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5a562640 1 -- 172.21.15.53:0/4251935576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f54108a90 msgr2=0x7f1f5419f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5a562640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f54108a90 0x7f1f5419f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5a562640 1 -- 172.21.15.53:0/4251935576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f54108140 msgr2=0x7f1f5419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5a562640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f54108140 0x7f1f5419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.958+0000 7f1f5a562640 1 -- 172.21.15.53:0/4251935576 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f541a0100 con 0x7f1f54102800 2024-08-31T06:22:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.959+0000 7f1f59d61640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f54108140 0x7f1f5419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:22:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.959+0000 7f1f5a562640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f54102800 0x7f1f5419a190 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000d950 tx=0x7f1f5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.959+0000 7f1f4b7fe640 1 -- 172.21.15.53:0/4251935576 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50017070 con 0x7f1f54102800 2024-08-31T06:22:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.959+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/4251935576 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f541a03f0 con 0x7f1f54102800 2024-08-31T06:22:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.959+0000 7f1f4b7fe640 1 -- 172.21.15.53:0/4251935576 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f50009c30 con 0x7f1f54102800 2024-08-31T06:22:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.959+0000 7f1f4b7fe640 1 -- 172.21.15.53:0/4251935576 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000f620 con 0x7f1f54102800 2024-08-31T06:22:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.959+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/4251935576 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f541a6b50 con 0x7f1f54102800 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f62d3b740 1 Processor -- start 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f62d3b740 1 -- start start 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2d11070 0x563ff30b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2ce81b0 0x563ff30b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2cf0390 0x563ff30b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563ff302d680 con 0x563ff2d11070 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563ff301cc10 con 0x563ff2cf0390 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563ff3020bc0 con 0x563ff2ce81b0 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f4b7fe640 1 -- 172.21.15.53:0/4251935576 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1f50010460 con 0x7f1f54102800 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f5ad63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2d11070 0x563ff30b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f5ad63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2d11070 0x563ff30b6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53686/0 (socket says 172.21.15.53:53686) 2024-08-31T06:22:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f5ad63640 1 -- 172.21.15.53:0/833795767 learned_addr learned my addr 172.21.15.53:0/833795767 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.962+0000 7f1f5a562640 1 --2- 172.21.15.53:0/833795767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2ce81b0 0x563ff30b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f59d61640 1 --2- 172.21.15.53:0/833795767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2cf0390 0x563ff30b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f5ad63640 1 -- 172.21.15.53:0/833795767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2ce81b0 msgr2=0x563ff30b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/833795767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2ce81b0 0x563ff30b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f5ad63640 1 -- 172.21.15.53:0/833795767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2cf0390 msgr2=0x563ff30b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/833795767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2cf0390 0x563ff30b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f5ad63640 1 -- 172.21.15.53:0/833795767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff2d7c650 con 0x563ff2d11070 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f59d61640 1 --2- 172.21.15.53:0/833795767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2cf0390 0x563ff30b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/833795767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2d11070 0x563ff30b6310 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00a430 tx=0x7f1f4c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f50c59a8291039 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f48ff9640 1 -- 172.21.15.53:0/833795767 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c013790 con 0x563ff2d11070 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f48ff9640 1 -- 172.21.15.53:0/833795767 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f4c019070 con 0x563ff2d11070 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f48ff9640 1 -- 172.21.15.53:0/833795767 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c014c00 con 0x563ff2d11070 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f4b7fe640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f400b4ca0 0x7f1f400b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.963+0000 7f1f5a562640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f400b4ca0 0x7f1f400b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.964+0000 7f1f4b7fe640 1 -- 172.21.15.53:0/4251935576 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f1f500e5120 con 0x7f1f54102800 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.964+0000 7f1f62d3b740 1 -- 172.21.15.53:0/833795767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2d11070 msgr2=0x563ff30b6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.964+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/833795767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2d11070 0x563ff30b6310 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00a430 tx=0x7f1f4c009650 comp rx=0 tx=0).stop 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.964+0000 7f1f5a562640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f400b4ca0 0x7f1f400b71b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1f500e29a0 tx=0x7f1f500a7810 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.964+0000 7f1f62d3b740 1 -- 172.21.15.53:0/833795767 shutdown_connections 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.964+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/833795767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2cf0390 0x563ff30b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.964+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/833795767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2ce81b0 0x563ff30b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.964+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/833795767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2d11070 0x563ff30b6310 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.964+0000 7f1f62d3b740 1 -- 172.21.15.53:0/833795767 >> 172.21.15.53:0/833795767 conn(0x563ff2d05460 msgr2=0x563ff30b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.964+0000 7f1f62d3b740 1 -- 172.21.15.53:0/833795767 shutdown_connections 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.964+0000 7f1f62d3b740 1 -- 172.21.15.53:0/833795767 wait complete. 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f62d3b740 1 -- start start 2024-08-31T06:22:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f62d3b740 1 Processor -- start 2024-08-31T06:22:56.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2cf0390 0x563ff30c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2d11070 0x563ff30cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563ff2e7f700 con 0x563ff2ce81b0 2024-08-31T06:22:56.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563ff2fa3750 con 0x563ff2cf0390 2024-08-31T06:22:56.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563ff30c4af0 con 0x563ff2d11070 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f62d3b740 10 client.0 _ll_register_callbacks cb 0x563ff2fd2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f5ad63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f5ad63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30c1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53700/0 (socket says 172.21.15.53:53700) 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f5ad63640 1 -- 172.21.15.53:0/1937188925 learned_addr learned my addr 172.21.15.53:0/1937188925 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f59d61640 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2cf0390 0x563ff30c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f5ad63640 1 -- 172.21.15.53:0/1937188925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2d11070 msgr2=0x563ff30cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2d11070 0x563ff30cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f5ad63640 1 -- 172.21.15.53:0/1937188925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2cf0390 msgr2=0x563ff30c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.965+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2cf0390 0x563ff30c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.966+0000 7f1f5ad63640 1 -- 172.21.15.53:0/1937188925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff2fdc900 con 0x563ff2ce81b0 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.966+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30c1aa0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0147c0 tx=0x7f1f4c014a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b11e694fc2c4a15 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.966+0000 7f1f3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.966+0000 7f1f3dffb640 1 -- 172.21.15.53:0/1937188925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c013790 con 0x563ff2ce81b0 2024-08-31T06:22:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.966+0000 7f1f3dffb640 1 -- 172.21.15.53:0/1937188925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f1f4c013930 con 0x563ff2ce81b0 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.966+0000 7f1f62d3b740 1 -- 172.21.15.53:0/1937188925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f4c019070 con 0x563ff2ce81b0 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.966+0000 7f1f3dffb640 1 -- 172.21.15.53:0/1937188925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f1f4c013b30 con 0x563ff2ce81b0 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.966+0000 7f1f62d3b740 10 client.21081 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.966+0000 7f1f62d3b740 1 -- 172.21.15.53:0/1937188925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x563ff30d0840 con 0x563ff2ce81b0 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.966+0000 7f1f3dffb640 1 -- 172.21.15.53:0/1937188925 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f4c019070 con 0x563ff2ce81b0 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.967+0000 7f1f3dffb640 1 -- 172.21.15.53:0/1937188925 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f1f4c028b60 con 0x563ff2ce81b0 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.967+0000 7f1f62d3b740 10 client.21081 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.967+0000 7f1f62d3b740 10 client.21081 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.967+0000 7f1f62d3b740 20 client.21081 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.967+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563ff2ccf9f0 0x563ff30d3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.967+0000 7f1f62d3b740 4 client.21081 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.967+0000 7f1f62d3b740 1 -- 172.21.15.53:0/1937188925 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ff302f5d0 con 0x563ff2ccf9f0 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.967+0000 7f1f59d61640 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563ff2ccf9f0 0x563ff30d3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.967+0000 7f1f3dffb640 10 client.21081 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:22:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.967+0000 7f1f59d61640 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563ff2ccf9f0 0x563ff30d3cb0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7aa345517fac8419 server_cookie=7f3284409e494882 in_seq=0 out_seq=0 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f3dffb640 1 -- 172.21.15.53:0/1937188925 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ff302f5d0 con 0x563ff2ccf9f0 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f3dffb640 10 client.21081 handle_command_reply: tid=0 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f62d3b740 1 client.21081 shutdown 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f62d3b740 1 -- 172.21.15.53:0/1937188925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 msgr2=0x563ff30c1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30c1aa0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0147c0 tx=0x7f1f4c014a40 comp rx=0 tx=0).stop 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f62d3b740 1 -- 172.21.15.53:0/1937188925 shutdown_connections 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563ff2ccf9f0 0x563ff30d3cb0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2d11070 0x563ff30cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2cf0390 0x563ff30c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f3dffb640 0 client.21081 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/1937188925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30c1aa0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.968+0000 7f1f62d3b740 1 -- 172.21.15.53:0/1937188925 >> 172.21.15.53:0/1937188925 conn(0x563ff2d05460 msgr2=0x563ff30b94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.969+0000 7f1f62d3b740 1 -- 172.21.15.53:0/1937188925 shutdown_connections 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.969+0000 7f1f62d3b740 1 -- 172.21.15.53:0/1937188925 wait complete. 2024-08-31T06:22:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.969+0000 7f1f62d3b740 20 client.21081 trim_cache size 0 max 16384 2024-08-31T06:22:56.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.982+0000 7f1f62d3b740 1 Processor -- start 2024-08-31T06:22:56.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.982+0000 7f1f62d3b740 1 -- start start 2024-08-31T06:22:56.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.982+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.982+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2cf0390 0x563ff30cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.982+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2d11070 0x563ff30b9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.982+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541af610 con 0x563ff2ce81b0 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.982+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541b11b0 con 0x563ff2d11070 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.982+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541afd40 con 0x563ff2cf0390 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.982+0000 7f1f5ad63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.982+0000 7f1f5ad63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53710/0 (socket says 172.21.15.53:53710) 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.982+0000 7f1f5ad63640 1 -- 172.21.15.53:0/2253243884 learned_addr learned my addr 172.21.15.53:0/2253243884 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.983+0000 7f1f59d61640 1 --2- 172.21.15.53:0/2253243884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2cf0390 0x563ff30cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.983+0000 7f1f5ad63640 1 -- 172.21.15.53:0/2253243884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2cf0390 msgr2=0x563ff30cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.983+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/2253243884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2cf0390 0x563ff30cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.983+0000 7f1f5ad63640 1 -- 172.21.15.53:0/2253243884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2d11070 msgr2=0x563ff30b9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.983+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/2253243884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2d11070 0x563ff30b9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.983+0000 7f1f5ad63640 1 -- 172.21.15.53:0/2253243884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff30c2d60 con 0x563ff2ce81b0 2024-08-31T06:22:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.983+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/2253243884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30b4300 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c002230 tx=0x7f1f4c014630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c414df095dea9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:56.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.983+0000 7f1f3ffff640 1 -- 172.21.15.53:0/2253243884 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c035070 con 0x563ff2ce81b0 2024-08-31T06:22:56.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.983+0000 7f1f3ffff640 1 -- 172.21.15.53:0/2253243884 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f4c019050 con 0x563ff2ce81b0 2024-08-31T06:22:56.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.983+0000 7f1f3ffff640 1 -- 172.21.15.53:0/2253243884 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c01e780 con 0x563ff2ce81b0 2024-08-31T06:22:56.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.984+0000 7f1f62d3b740 1 -- 172.21.15.53:0/2253243884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 msgr2=0x563ff30b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.984+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/2253243884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30b4300 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c002230 tx=0x7f1f4c014630 comp rx=0 tx=0).stop 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.984+0000 7f1f62d3b740 1 -- 172.21.15.53:0/2253243884 shutdown_connections 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.984+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/2253243884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2d11070 0x563ff30b9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.984+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/2253243884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2cf0390 0x563ff30cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.984+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/2253243884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2ce81b0 0x563ff30b4300 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.984+0000 7f1f62d3b740 1 -- 172.21.15.53:0/2253243884 >> 172.21.15.53:0/2253243884 conn(0x563ff2d05460 msgr2=0x563ff30b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.984+0000 7f1f62d3b740 1 -- 172.21.15.53:0/2253243884 shutdown_connections 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.984+0000 7f1f62d3b740 1 -- 172.21.15.53:0/2253243884 wait complete. 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.984+0000 7f1f62d3b740 1 -- start start 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.984+0000 7f1f62d3b740 1 Processor -- start 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2ce81b0 0x563ff30d5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2cf0390 0x563ff30d56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f62d3b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2d11070 0x563ff313d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541b0ae0 con 0x563ff2cf0390 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541b0410 con 0x563ff2d11070 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f62d3b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541ad610 con 0x563ff2ce81b0 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f62d3b740 10 client.0 _ll_register_callbacks cb 0x7f1f4c009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f59d61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2cf0390 0x563ff30d56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f59d61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2cf0390 0x563ff30d56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53724/0 (socket says 172.21.15.53:53724) 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f59d61640 1 -- 172.21.15.53:0/3477386444 learned_addr learned my addr 172.21.15.53:0/3477386444 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2ce81b0 0x563ff30d5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2d11070 0x563ff313d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f59d61640 1 -- 172.21.15.53:0/3477386444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2ce81b0 msgr2=0x563ff30d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:56.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f59d61640 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2ce81b0 0x563ff30d5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f59d61640 1 -- 172.21.15.53:0/3477386444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2d11070 msgr2=0x563ff313d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f59d61640 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2d11070 0x563ff313d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f59d61640 1 -- 172.21.15.53:0/3477386444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff313d970 con 0x563ff2cf0390 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f59d61640 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2cf0390 0x563ff30d56c0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f1f44005ab0 tx=0x7f1f44005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad3e1946db0ff41 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.985+0000 7f1f3dffb640 1 -- 172.21.15.53:0/3477386444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44035040 con 0x563ff2cf0390 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f3dffb640 1 -- 172.21.15.53:0/3477386444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f1f44004310 con 0x563ff2cf0390 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f62d3b740 1 -- 172.21.15.53:0/3477386444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f4c019050 con 0x563ff2cf0390 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f3dffb640 1 -- 172.21.15.53:0/3477386444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f1f44050050 con 0x563ff2cf0390 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f62d3b740 10 client.21087 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f62d3b740 1 -- 172.21.15.53:0/3477386444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x563ff313ead0 con 0x563ff2cf0390 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f3dffb640 1 -- 172.21.15.53:0/3477386444 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f4c019050 con 0x563ff2cf0390 2024-08-31T06:22:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f3dffb640 1 -- 172.21.15.53:0/3477386444 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f1f44004a40 con 0x563ff2cf0390 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f62d3b740 10 client.21087 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f62d3b740 10 client.21087 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f62d3b740 20 client.21087 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563ff2ca4da0 0x563ff31412c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f62d3b740 4 client.21087 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.986+0000 7f1f62d3b740 1 -- 172.21.15.53:0/3477386444 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563ff30c2410 con 0x563ff2ca4da0 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563ff2ca4da0 0x563ff31412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f5ad63640 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563ff2ca4da0 0x563ff31412c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c65d8bcd35ac302 server_cookie=3f0c60658ee8d375 in_seq=0 out_seq=0 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f3dffb640 10 client.21087 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f3dffb640 1 -- 172.21.15.53:0/3477386444 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563ff30c2410 con 0x563ff2ca4da0 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f3dffb640 10 client.21087 handle_command_reply: tid=0 2024-08-31T06:22:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f62d3b740 1 client.21087 shutdown 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f62d3b740 1 -- 172.21.15.53:0/3477386444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2cf0390 msgr2=0x563ff30d56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2cf0390 0x563ff30d56c0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f1f44005ab0 tx=0x7f1f44005f20 comp rx=0 tx=0).stop 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f62d3b740 1 -- 172.21.15.53:0/3477386444 shutdown_connections 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x563ff2ca4da0 0x563ff31412c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563ff2d11070 0x563ff313d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563ff2cf0390 0x563ff30d56c0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f3dffb640 0 client.21087 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f62d3b740 1 --2- 172.21.15.53:0/3477386444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563ff2ce81b0 0x563ff30d5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f62d3b740 1 -- 172.21.15.53:0/3477386444 >> 172.21.15.53:0/3477386444 conn(0x563ff2d05460 msgr2=0x563ff30b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f62d3b740 1 -- 172.21.15.53:0/3477386444 shutdown_connections 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.987+0000 7f1f62d3b740 1 -- 172.21.15.53:0/3477386444 wait complete. 2024-08-31T06:22:56.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f62d3b740 20 client.21087 trim_cache size 0 max 16384 2024-08-31T06:22:56.996 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:22:56.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/4251935576 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f400b4ca0 msgr2=0x7f1f400b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:56.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f400b4ca0 0x7f1f400b71b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1f500e29a0 tx=0x7f1f500a7810 comp rx=0 tx=0).stop 2024-08-31T06:22:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/4251935576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f54102800 msgr2=0x7f1f5419a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f54102800 0x7f1f5419a190 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000d950 tx=0x7f1f5000de10 comp rx=0 tx=0).stop 2024-08-31T06:22:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/4251935576 shutdown_connections 2024-08-31T06:22:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1f400b4ca0 0x7f1f400b71b0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f54108a90 0x7f1f5419f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f54108140 0x7f1f5419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 --2- 172.21.15.53:0/4251935576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f54102800 0x7f1f5419a190 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/4251935576 >> 172.21.15.53:0/4251935576 conn(0x7f1f540794d0 msgr2=0x7f1f5406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/4251935576 shutdown_connections 2024-08-31T06:22:56.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:56.988+0000 7f1f5c7c6640 1 -- 172.21.15.53:0/4251935576 wait complete. 2024-08-31T06:22:57.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.23 MB/sec execute 165 sec latency 26535.393 ms 2024-08-31T06:22:57.701 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:22:57.953 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:22:58.375 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.20 MB/sec execute 166 sec latency 27535.423 ms 2024-08-31T06:22:58.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.443+0000 7f30ba02b640 1 -- 172.21.15.53:0/3212326843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b4102820 msgr2=0x7f30b4102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:58.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.443+0000 7f30ba02b640 1 --2- 172.21.15.53:0/3212326843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b4102820 0x7f30b4102c30 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009900 tx=0x7f30a402a410 comp rx=0 tx=0).stop 2024-08-31T06:22:58.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.443+0000 7f30ba02b640 1 -- 172.21.15.53:0/3212326843 shutdown_connections 2024-08-31T06:22:58.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.443+0000 7f30ba02b640 1 --2- 172.21.15.53:0/3212326843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b4108ab0 0x7f30b410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.443+0000 7f30ba02b640 1 --2- 172.21.15.53:0/3212326843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b4108160 0x7f30b4108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.443+0000 7f30ba02b640 1 --2- 172.21.15.53:0/3212326843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b4102820 0x7f30b4102c30 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.443+0000 7f30ba02b640 1 -- 172.21.15.53:0/3212326843 >> 172.21.15.53:0/3212326843 conn(0x7f30b40794e0 msgr2=0x7f30b40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.443+0000 7f30ba02b640 1 -- 172.21.15.53:0/3212326843 shutdown_connections 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.443+0000 7f30ba02b640 1 -- 172.21.15.53:0/3212326843 wait complete. 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.444+0000 7f30ba02b640 1 Processor -- start 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.444+0000 7f30ba02b640 1 -- start start 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.444+0000 7f30ba02b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b4102820 0x7f30b419a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.444+0000 7f30ba02b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b4108160 0x7f30b419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.444+0000 7f30ba02b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b4108ab0 0x7f30b419f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.444+0000 7f30ba02b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41125c0 con 0x7f30b4102820 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.444+0000 7f30ba02b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f30b4112440 con 0x7f30b4108160 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.444+0000 7f30ba02b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30b4112740 con 0x7f30b4108ab0 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.444+0000 7f30b37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b4102820 0x7f30b419a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.444+0000 7f30b37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b4102820 0x7f30b419a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53744/0 (socket says 172.21.15.53:53744) 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.444+0000 7f30b37fe640 1 -- 172.21.15.53:0/2005648698 learned_addr learned my addr 172.21.15.53:0/2005648698 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30b3fff640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b4108ab0 0x7f30b419f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30b2ffd640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b4108160 0x7f30b419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30b37fe640 1 -- 172.21.15.53:0/2005648698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b4108ab0 msgr2=0x7f30b419f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30b37fe640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b4108ab0 0x7f30b419f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30b37fe640 1 -- 172.21.15.53:0/2005648698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b4108160 msgr2=0x7f30b419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30b37fe640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b4108160 0x7f30b419a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30b37fe640 1 -- 172.21.15.53:0/2005648698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b41a00f0 con 0x7f30b4102820 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30b37fe640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b4102820 0x7f30b419a180 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009230 tx=0x7f30a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30b0ff9640 1 -- 172.21.15.53:0/2005648698 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a403f030 con 0x7f30b4102820 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30ba02b640 1 -- 172.21.15.53:0/2005648698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b41a0380 con 0x7f30b4102820 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30b0ff9640 1 -- 172.21.15.53:0/2005648698 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30a4003a80 con 0x7f30b4102820 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30b0ff9640 1 -- 172.21.15.53:0/2005648698 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4035070 con 0x7f30b4102820 2024-08-31T06:22:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.445+0000 7f30ba02b640 1 -- 172.21.15.53:0/2005648698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b41a6b40 con 0x7f30b4102820 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30c05a0740 1 Processor -- start 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30b0ff9640 1 -- 172.21.15.53:0/2005648698 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f30a4042030 con 0x7f30b4102820 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30c05a0740 1 -- start start 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55613259a070 0x55613293f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561325711b0 0x55613293f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556132579390 0x55613293fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30c05a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5561328b6680 con 0x5561325711b0 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30c05a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5561328a5c10 con 0x556132579390 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30c05a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5561328a9bc0 con 0x55613259a070 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30b37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561325711b0 0x55613293f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30b37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561325711b0 0x55613293f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53758/0 (socket says 172.21.15.53:53758) 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30b3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55613259a070 0x55613293f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.448+0000 7f30b37fe640 1 -- 172.21.15.53:0/3418047888 learned_addr learned my addr 172.21.15.53:0/3418047888 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f30b2ffd640 1 --2- 172.21.15.53:0/3418047888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556132579390 0x55613293fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f30b0ff9640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4ca0 0x7f309c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f30b37fe640 1 -- 172.21.15.53:0/3418047888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55613259a070 msgr2=0x55613293f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f30b37fe640 1 --2- 172.21.15.53:0/3418047888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55613259a070 0x55613293f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f30b37fe640 1 -- 172.21.15.53:0/3418047888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556132579390 msgr2=0x55613293fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f30b37fe640 1 --2- 172.21.15.53:0/3418047888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556132579390 0x55613293fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f30b37fe640 1 -- 172.21.15.53:0/3418047888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556132605650 con 0x5561325711b0 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f30b3fff640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4ca0 0x7f309c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f30b0ff9640 1 -- 172.21.15.53:0/2005648698 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f30a4105d90 con 0x7f30b4102820 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f30b3fff640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4ca0 0x7f309c0b71b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f30ac005fd0 tx=0x7f30ac004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f30b37fe640 1 --2- 172.21.15.53:0/3418047888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561325711b0 0x55613293f890 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f30a4103430 tx=0x7f30a40c8150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee510ea45e09d48 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f3099ffb640 1 -- 172.21.15.53:0/3418047888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4049030 con 0x5561325711b0 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f3099ffb640 1 -- 172.21.15.53:0/3418047888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30a40d50c0 con 0x5561325711b0 2024-08-31T06:22:58.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.449+0000 7f3099ffb640 1 -- 172.21.15.53:0/3418047888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a40cbdb0 con 0x5561325711b0 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.450+0000 7f30c05a0740 1 -- 172.21.15.53:0/3418047888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561325711b0 msgr2=0x55613293f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.450+0000 7f30c05a0740 1 --2- 172.21.15.53:0/3418047888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561325711b0 0x55613293f890 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f30a4103430 tx=0x7f30a40c8150 comp rx=0 tx=0).stop 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.450+0000 7f30c05a0740 1 -- 172.21.15.53:0/3418047888 shutdown_connections 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.450+0000 7f30c05a0740 1 --2- 172.21.15.53:0/3418047888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556132579390 0x55613293fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.450+0000 7f30c05a0740 1 --2- 172.21.15.53:0/3418047888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561325711b0 0x55613293f890 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.450+0000 7f30c05a0740 1 --2- 172.21.15.53:0/3418047888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55613259a070 0x55613293f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.450+0000 7f30c05a0740 1 -- 172.21.15.53:0/3418047888 >> 172.21.15.53:0/3418047888 conn(0x55613258e460 msgr2=0x55613293d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.450+0000 7f30c05a0740 1 -- 172.21.15.53:0/3418047888 shutdown_connections 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.450+0000 7f30c05a0740 1 -- 172.21.15.53:0/3418047888 wait complete. 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.451+0000 7f30c05a0740 1 -- start start 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.451+0000 7f30c05a0740 1 Processor -- start 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.451+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561325711b0 0x55613294aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.451+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556132579390 0x55613294afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.451+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x556132956ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.451+0000 7f30c05a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556132708700 con 0x55613259a070 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.451+0000 7f30c05a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55613282c750 con 0x556132579390 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.451+0000 7f30c05a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55613294d8f0 con 0x5561325711b0 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.451+0000 7f30c05a0740 10 client.0 _ll_register_callbacks cb 0x55613285be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.451+0000 7f30b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x556132956ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.451+0000 7f30b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x556132956ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53768/0 (socket says 172.21.15.53:53768) 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30b3fff640 1 -- 172.21.15.53:0/336426751 learned_addr learned my addr 172.21.15.53:0/336426751 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30b37fe640 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561325711b0 0x55613294aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30b2ffd640 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556132579390 0x55613294afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30b3fff640 1 -- 172.21.15.53:0/336426751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561325711b0 msgr2=0x55613294aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30b3fff640 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561325711b0 0x55613294aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30b3fff640 1 -- 172.21.15.53:0/336426751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556132579390 msgr2=0x55613294afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30b3fff640 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556132579390 0x55613294afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30b3fff640 1 -- 172.21.15.53:0/336426751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556132865900 con 0x55613259a070 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30b3fff640 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x556132956ba0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f30ac013970 tx=0x7f30ac004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e531521c7d8fd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f3092ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f3092ffd640 1 -- 172.21.15.53:0/336426751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac01ed70 con 0x55613259a070 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f3092ffd640 1 -- 172.21.15.53:0/336426751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f30ac028470 con 0x55613259a070 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30c05a0740 1 -- 172.21.15.53:0/336426751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5561328b85d0 con 0x55613259a070 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f3092ffd640 1 -- 172.21.15.53:0/336426751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f30ac004b20 con 0x55613259a070 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30c05a0740 10 client.21099 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.452+0000 7f30c05a0740 1 -- 172.21.15.53:0/336426751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x556132959650 con 0x55613259a070 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.453+0000 7f3092ffd640 1 -- 172.21.15.53:0/336426751 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5561328b85d0 con 0x55613259a070 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.453+0000 7f3092ffd640 1 -- 172.21.15.53:0/336426751 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f30ac00f040 con 0x55613259a070 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.453+0000 7f30c05a0740 10 client.21099 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.453+0000 7f30c05a0740 10 client.21099 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.453+0000 7f30c05a0740 20 client.21099 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.453+0000 7f30c05a0740 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561325589f0 0x55613295cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.453+0000 7f30c05a0740 4 client.21099 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.453+0000 7f30c05a0740 1 -- 172.21.15.53:0/336426751 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561328b4070 con 0x5561325589f0 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.453+0000 7f30b37fe640 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561325589f0 0x55613295cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.454+0000 7f3092ffd640 10 client.21099 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.454+0000 7f30b37fe640 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561325589f0 0x55613295cc10 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=222875fd14133878 server_cookie=8f6049d9b7a203fb in_seq=0 out_seq=0 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.454+0000 7f3092ffd640 1 -- 172.21.15.53:0/336426751 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561328b4070 con 0x5561325589f0 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f3092ffd640 10 client.21099 handle_command_reply: tid=0 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 1 client.21099 shutdown 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 1 -- 172.21.15.53:0/336426751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 msgr2=0x556132956ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x556132956ba0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f30ac013970 tx=0x7f30ac004ab0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 1 -- 172.21.15.53:0/336426751 shutdown_connections 2024-08-31T06:22:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561325589f0 0x55613295cc10 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x556132956ba0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f3092ffd640 0 client.21099 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:58.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556132579390 0x55613294afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 1 --2- 172.21.15.53:0/336426751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561325711b0 0x55613294aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 1 -- 172.21.15.53:0/336426751 >> 172.21.15.53:0/336426751 conn(0x55613258e460 msgr2=0x5561329424e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:58.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 1 -- 172.21.15.53:0/336426751 shutdown_connections 2024-08-31T06:22:58.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 1 -- 172.21.15.53:0/336426751 wait complete. 2024-08-31T06:22:58.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.455+0000 7f30c05a0740 20 client.21099 trim_cache size 0 max 16384 2024-08-31T06:22:58.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30c05a0740 1 Processor -- start 2024-08-31T06:22:58.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30c05a0740 1 -- start start 2024-08-31T06:22:58.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561325711b0 0x55613294c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556132579390 0x55613293c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x55613293cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30c05a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41af4d0 con 0x55613259a070 2024-08-31T06:22:58.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30c05a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41b1070 con 0x5561325711b0 2024-08-31T06:22:58.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30c05a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41afc00 con 0x556132579390 2024-08-31T06:22:58.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x55613293cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x55613293cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53782/0 (socket says 172.21.15.53:53782) 2024-08-31T06:22:58.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30b3fff640 1 -- 172.21.15.53:0/2304620553 learned_addr learned my addr 172.21.15.53:0/2304620553 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:58.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30b37fe640 1 --2- 172.21.15.53:0/2304620553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561325711b0 0x55613294c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.469+0000 7f30b2ffd640 1 --2- 172.21.15.53:0/2304620553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556132579390 0x55613293c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.470+0000 7f30b3fff640 1 -- 172.21.15.53:0/2304620553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556132579390 msgr2=0x55613293c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:58.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.470+0000 7f30b3fff640 1 --2- 172.21.15.53:0/2304620553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556132579390 0x55613293c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.470+0000 7f30b3fff640 1 -- 172.21.15.53:0/2304620553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561325711b0 msgr2=0x55613294c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:58.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.470+0000 7f30b3fff640 1 --2- 172.21.15.53:0/2304620553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561325711b0 0x55613294c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.470+0000 7f30b3fff640 1 -- 172.21.15.53:0/2304620553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556132941640 con 0x55613259a070 2024-08-31T06:22:58.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.470+0000 7f30b3fff640 1 --2- 172.21.15.53:0/2304620553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x55613293cd50 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f30ac010d90 tx=0x7f30ac01e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c918631b9ec306 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:58.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.470+0000 7f30997fa640 1 -- 172.21.15.53:0/2304620553 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac01eb70 con 0x55613259a070 2024-08-31T06:22:58.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.470+0000 7f30997fa640 1 -- 172.21.15.53:0/2304620553 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30ac023070 con 0x55613259a070 2024-08-31T06:22:58.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.470+0000 7f30997fa640 1 -- 172.21.15.53:0/2304620553 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac028990 con 0x55613259a070 2024-08-31T06:22:58.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.471+0000 7f30c05a0740 1 -- 172.21.15.53:0/2304620553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 msgr2=0x55613293cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:58.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.471+0000 7f30c05a0740 1 --2- 172.21.15.53:0/2304620553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x55613293cd50 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f30ac010d90 tx=0x7f30ac01e820 comp rx=0 tx=0).stop 2024-08-31T06:22:58.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.471+0000 7f30c05a0740 1 -- 172.21.15.53:0/2304620553 shutdown_connections 2024-08-31T06:22:58.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.471+0000 7f30c05a0740 1 --2- 172.21.15.53:0/2304620553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55613259a070 0x55613293cd50 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.471+0000 7f30c05a0740 1 --2- 172.21.15.53:0/2304620553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556132579390 0x55613293c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.471+0000 7f30c05a0740 1 --2- 172.21.15.53:0/2304620553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561325711b0 0x55613294c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.471+0000 7f30c05a0740 1 -- 172.21.15.53:0/2304620553 >> 172.21.15.53:0/2304620553 conn(0x55613258e460 msgr2=0x55613294bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.471+0000 7f30c05a0740 1 -- 172.21.15.53:0/2304620553 shutdown_connections 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.471+0000 7f30c05a0740 1 -- 172.21.15.53:0/2304620553 wait complete. 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.471+0000 7f30c05a0740 1 -- start start 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30c05a0740 1 Processor -- start 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561325711b0 0x5561329c3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556132579390 0x556132952b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30c05a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55613259a070 0x556132953250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30c05a0740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41b09a0 con 0x556132579390 2024-08-31T06:22:58.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30c05a0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41b02d0 con 0x5561325711b0 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30c05a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41ad4d0 con 0x55613259a070 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30c05a0740 10 client.0 _ll_register_callbacks cb 0x7f30ac009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30b2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556132579390 0x556132952b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30b2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556132579390 0x556132952b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53792/0 (socket says 172.21.15.53:53792) 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30b2ffd640 1 -- 172.21.15.53:0/2780492979 learned_addr learned my addr 172.21.15.53:0/2780492979 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30b37fe640 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561325711b0 0x5561329c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30b3fff640 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55613259a070 0x556132953250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30b2ffd640 1 -- 172.21.15.53:0/2780492979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55613259a070 msgr2=0x556132953250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30b2ffd640 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55613259a070 0x556132953250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30b2ffd640 1 -- 172.21.15.53:0/2780492979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561325711b0 msgr2=0x5561329c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30b2ffd640 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561325711b0 0x5561329c3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.472+0000 7f30b2ffd640 1 -- 172.21.15.53:0/2780492979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561329c04f0 con 0x556132579390 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f30b2ffd640 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556132579390 0x556132952b40 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f30a800fde0 tx=0x7f30a8012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47e6bc5ddb54629 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:22:58.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f3092ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:22:58.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f3092ffd640 1 -- 172.21.15.53:0/2780492979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8020060 con 0x556132579390 2024-08-31T06:22:58.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f3092ffd640 1 -- 172.21.15.53:0/2780492979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f30a8011650 con 0x556132579390 2024-08-31T06:22:58.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f30c05a0740 1 -- 172.21.15.53:0/2780492979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30ac023070 con 0x556132579390 2024-08-31T06:22:58.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f3092ffd640 1 -- 172.21.15.53:0/2780492979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f30a800fe10 con 0x556132579390 2024-08-31T06:22:58.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f30c05a0740 10 client.21105 fetch_fsmap learned FSMap version 66 2024-08-31T06:22:58.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f30c05a0740 1 -- 172.21.15.53:0/2780492979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5561329cbc50 con 0x556132579390 2024-08-31T06:22:58.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f3092ffd640 1 -- 172.21.15.53:0/2780492979 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30ac023070 con 0x556132579390 2024-08-31T06:22:58.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f3092ffd640 1 -- 172.21.15.53:0/2780492979 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f30a80108e0 con 0x556132579390 2024-08-31T06:22:58.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f30c05a0740 10 client.21105 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:22:58.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f30c05a0740 10 client.21105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:22:58.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f30c05a0740 20 client.21105 populate_metadata read hostname 'smithi053' 2024-08-31T06:22:58.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f30c05a0740 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55613252dda0 0x5561329ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:22:58.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f30c05a0740 4 client.21105 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:22:58.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.473+0000 7f30c05a0740 1 -- 172.21.15.53:0/2780492979 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561328b17b0 con 0x55613252dda0 2024-08-31T06:22:58.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f30b37fe640 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55613252dda0 0x5561329ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:22:58.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f3092ffd640 10 client.21105 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:58.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f30b37fe640 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55613252dda0 0x5561329ce440 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98e982d3b174f76 server_cookie=d3900cfade4b9b0e in_seq=0 out_seq=0 2024-08-31T06:22:58.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f3092ffd640 1 -- 172.21.15.53:0/2780492979 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561328b17b0 con 0x55613252dda0 2024-08-31T06:22:58.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f3092ffd640 10 client.21105 handle_command_reply: tid=0 2024-08-31T06:22:58.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f30c05a0740 1 client.21105 shutdown 2024-08-31T06:22:58.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f30c05a0740 1 -- 172.21.15.53:0/2780492979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556132579390 msgr2=0x556132952b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:58.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f30c05a0740 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556132579390 0x556132952b40 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f30a800fde0 tx=0x7f30a8012820 comp rx=0 tx=0).stop 2024-08-31T06:22:58.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f30c05a0740 1 -- 172.21.15.53:0/2780492979 shutdown_connections 2024-08-31T06:22:58.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f30c05a0740 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55613252dda0 0x5561329ce440 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f30c05a0740 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55613259a070 0x556132953250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f30c05a0740 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556132579390 0x556132952b40 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f30c05a0740 1 --2- 172.21.15.53:0/2780492979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561325711b0 0x5561329c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f30c05a0740 1 -- 172.21.15.53:0/2780492979 >> 172.21.15.53:0/2780492979 conn(0x55613258e460 msgr2=0x55613294bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:58.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.474+0000 7f3092ffd640 0 client.21105 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:22:58.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30c05a0740 1 -- 172.21.15.53:0/2780492979 shutdown_connections 2024-08-31T06:22:58.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30c05a0740 1 -- 172.21.15.53:0/2780492979 wait complete. 2024-08-31T06:22:58.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30c05a0740 20 client.21105 trim_cache size 0 max 16384 2024-08-31T06:22:58.485 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:22:58.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30ba02b640 1 -- 172.21.15.53:0/2005648698 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4ca0 msgr2=0x7f309c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:58.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30ba02b640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4ca0 0x7f309c0b71b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f30ac005fd0 tx=0x7f30ac004a40 comp rx=0 tx=0).stop 2024-08-31T06:22:58.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30ba02b640 1 -- 172.21.15.53:0/2005648698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b4102820 msgr2=0x7f30b419a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:22:58.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30ba02b640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b4102820 0x7f30b419a180 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009230 tx=0x7f30a4004270 comp rx=0 tx=0).stop 2024-08-31T06:22:58.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30ba02b640 1 -- 172.21.15.53:0/2005648698 shutdown_connections 2024-08-31T06:22:58.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30ba02b640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4ca0 0x7f309c0b71b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30ba02b640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b4108ab0 0x7f30b419f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30ba02b640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b4108160 0x7f30b419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30ba02b640 1 --2- 172.21.15.53:0/2005648698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b4102820 0x7f30b419a180 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:22:58.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.475+0000 7f30ba02b640 1 -- 172.21.15.53:0/2005648698 >> 172.21.15.53:0/2005648698 conn(0x7f30b40794e0 msgr2=0x7f30b41018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:22:58.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.476+0000 7f30ba02b640 1 -- 172.21.15.53:0/2005648698 shutdown_connections 2024-08-31T06:22:58.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:22:58.476+0000 7f30ba02b640 1 -- 172.21.15.53:0/2005648698 wait complete. 2024-08-31T06:22:58.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:22:58 smithi130 ceph-mon[22266]: pgmap v887: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 17 op/s 2024-08-31T06:22:58.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:22:58 smithi153 ceph-mon[22320]: pgmap v887: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 17 op/s 2024-08-31T06:22:58.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:22:58 smithi053 ceph-mon[18924]: pgmap v887: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 17 op/s 2024-08-31T06:22:59.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.16 MB/sec execute 167 sec latency 28535.458 ms 2024-08-31T06:22:59.407 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:22:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:00.179 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:23:00.179 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:23:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.213+0000 7fafa8478640 1 -- 172.21.15.53:0/3191458478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa0109ba0 msgr2=0x7fafa01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.213+0000 7fafa8478640 1 --2- 172.21.15.53:0/3191458478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa0109ba0 0x7fafa01103d0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7faf98009ca0 tx=0x7faf9802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.214+0000 7fafa8478640 1 -- 172.21.15.53:0/3191458478 shutdown_connections 2024-08-31T06:23:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.214+0000 7fafa8478640 1 --2- 172.21.15.53:0/3191458478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa0109ba0 0x7fafa01103d0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.214+0000 7fafa8478640 1 --2- 172.21.15.53:0/3191458478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa0109250 0x7fafa0109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.214+0000 7fafa8478640 1 --2- 172.21.15.53:0/3191458478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafa0101d10 0x7fafa0102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.214+0000 7fafa8478640 1 -- 172.21.15.53:0/3191458478 >> 172.21.15.53:0/3191458478 conn(0x7fafa0077a00 msgr2=0x7fafa0077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.214+0000 7fafa8478640 1 -- 172.21.15.53:0/3191458478 shutdown_connections 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.214+0000 7fafa8478640 1 -- 172.21.15.53:0/3191458478 wait complete. 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.215+0000 7fafa8478640 1 Processor -- start 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.215+0000 7fafa8478640 1 -- start start 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.215+0000 7fafa8478640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa0101d10 0x7fafa019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.215+0000 7fafa8478640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafa0109250 0x7fafa019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.215+0000 7fafa8478640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa0109ba0 0x7fafa019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.215+0000 7fafa8478640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fafa0113760 con 0x7fafa0109ba0 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.215+0000 7fafa8478640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fafa01135e0 con 0x7fafa0109250 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.215+0000 7fafa8478640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fafa01138e0 con 0x7fafa0101d10 2024-08-31T06:23:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.215+0000 7fafa6a15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa0109ba0 0x7fafa019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.215+0000 7fafa6a15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa0109ba0 0x7fafa019f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53806/0 (socket says 172.21.15.53:53806) 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.215+0000 7fafa6a15640 1 -- 172.21.15.53:0/444916805 learned_addr learned my addr 172.21.15.53:0/444916805 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.216+0000 7fafa6214640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa0101d10 0x7fafa019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.216+0000 7fafa5a13640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafa0109250 0x7fafa019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.216+0000 7fafa6a15640 1 -- 172.21.15.53:0/444916805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa0101d10 msgr2=0x7fafa019a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.216+0000 7fafa6a15640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa0101d10 0x7fafa019a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.216+0000 7fafa6a15640 1 -- 172.21.15.53:0/444916805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafa0109250 msgr2=0x7fafa019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.216+0000 7fafa6a15640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafa0109250 0x7fafa019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.216+0000 7fafa6a15640 1 -- 172.21.15.53:0/444916805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa01a00c0 con 0x7fafa0109ba0 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.216+0000 7fafa6a15640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa0109ba0 0x7fafa019f990 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7faf98005cc0 tx=0x7faf98032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.216+0000 7faf977fe640 1 -- 172.21.15.53:0/444916805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98032e00 con 0x7fafa0109ba0 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.217+0000 7faf977fe640 1 -- 172.21.15.53:0/444916805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf980044d0 con 0x7fafa0109ba0 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.217+0000 7faf977fe640 1 -- 172.21.15.53:0/444916805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98030b70 con 0x7fafa0109ba0 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.217+0000 7fafa8478640 1 -- 172.21.15.53:0/444916805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa01a0350 con 0x7fafa0109ba0 2024-08-31T06:23:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.217+0000 7fafa8478640 1 -- 172.21.15.53:0/444916805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa01a6b10 con 0x7fafa0109ba0 2024-08-31T06:23:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.218+0000 7fafa8478640 1 -- 172.21.15.53:0/444916805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa006a9f0 con 0x7fafa0109ba0 2024-08-31T06:23:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.220+0000 7faf977fe640 1 -- 172.21.15.53:0/444916805 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7faf98030d10 con 0x7fafa0109ba0 2024-08-31T06:23:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.221+0000 7faf977fe640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf8c0b4ca0 0x7faf8c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.221+0000 7faf977fe640 1 -- 172.21.15.53:0/444916805 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7faf98106900 con 0x7fafa0109ba0 2024-08-31T06:23:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.221+0000 7fafa6214640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf8c0b4ca0 0x7faf8c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.222+0000 7fafa6214640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf8c0b4ca0 0x7faf8c0b71b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00bbe0 tx=0x7faf9c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.228+0000 7faf977fe640 1 -- 172.21.15.53:0/444916805 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faf980cd6d0 con 0x7fafa0109ba0 2024-08-31T06:23:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.238+0000 7f7087ba8640 1 -- 172.21.15.53:0/1923530923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70801080d0 msgr2=0x7f70801084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.238+0000 7f7087ba8640 1 --2- 172.21.15.53:0/1923530923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70801080d0 0x7f70801084e0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f7070009900 tx=0x7f707002a410 comp rx=0 tx=0).stop 2024-08-31T06:23:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.238+0000 7f7087ba8640 1 -- 172.21.15.53:0/1923530923 shutdown_connections 2024-08-31T06:23:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.238+0000 7f7087ba8640 1 --2- 172.21.15.53:0/1923530923 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7080108a20 0x7f708010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.238+0000 7f7087ba8640 1 --2- 172.21.15.53:0/1923530923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70801080d0 0x7f70801084e0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.238+0000 7f7087ba8640 1 --2- 172.21.15.53:0/1923530923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7080102f10 0x7f7080103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.238+0000 7f7087ba8640 1 -- 172.21.15.53:0/1923530923 >> 172.21.15.53:0/1923530923 conn(0x7f7080079c30 msgr2=0x7f708007a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.238+0000 7f7087ba8640 1 -- 172.21.15.53:0/1923530923 shutdown_connections 2024-08-31T06:23:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.238+0000 7f7087ba8640 1 -- 172.21.15.53:0/1923530923 wait complete. 2024-08-31T06:23:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7087ba8640 1 Processor -- start 2024-08-31T06:23:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7087ba8640 1 -- start start 2024-08-31T06:23:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7087ba8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7080102f10 0x7f708019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7087ba8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70801080d0 0x7f708019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7087ba8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7080108a20 0x7f708019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7087ba8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f70801136b0 con 0x7f7080108a20 2024-08-31T06:23:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7087ba8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7080113530 con 0x7f7080102f10 2024-08-31T06:23:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7087ba8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7080113830 con 0x7f70801080d0 2024-08-31T06:23:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7086145640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7080108a20 0x7f708019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7086145640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7080108a20 0x7f708019fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53824/0 (socket says 172.21.15.53:53824) 2024-08-31T06:23:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7086145640 1 -- 172.21.15.53:0/530536139 learned_addr learned my addr 172.21.15.53:0/530536139 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.239+0000 7f7085944640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7080102f10 0x7f708019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7085143640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70801080d0 0x7f708019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7086145640 1 -- 172.21.15.53:0/530536139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70801080d0 msgr2=0x7f708019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7086145640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70801080d0 0x7f708019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7086145640 1 -- 172.21.15.53:0/530536139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7080102f10 msgr2=0x7f708019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7086145640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7080102f10 0x7f708019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7086145640 1 -- 172.21.15.53:0/530536139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70801a0100 con 0x7f7080108a20 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7085143640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70801080d0 0x7f708019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7086145640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7080108a20 0x7f708019fa00 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f707800eaa0 tx=0x7f707800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7076ffd640 1 -- 172.21.15.53:0/530536139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707800cdb0 con 0x7f7080108a20 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7087ba8640 1 -- 172.21.15.53:0/530536139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70801a03f0 con 0x7f7080108a20 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7087ba8640 1 -- 172.21.15.53:0/530536139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70801a6b80 con 0x7f7080108a20 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7076ffd640 1 -- 172.21.15.53:0/530536139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7078005020 con 0x7f7080108a20 2024-08-31T06:23:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.240+0000 7f7076ffd640 1 -- 172.21.15.53:0/530536139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707801f060 con 0x7f7080108a20 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.243+0000 7f708ebed740 1 Processor -- start 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.244+0000 7f7076ffd640 1 -- 172.21.15.53:0/530536139 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7078004a40 con 0x7f7080108a20 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.244+0000 7f708ebed740 1 -- start start 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.244+0000 7f708ebed740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x556112989ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.244+0000 7f708ebed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x55611298a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.244+0000 7f708ebed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x55611298a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.244+0000 7f708ebed740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5561128ff000 con 0x5561125e61b0 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.244+0000 7f708ebed740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5561128ee590 con 0x5561125c54d0 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.244+0000 7f708ebed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5561128f2540 con 0x5561125bd2f0 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085143640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x556112989ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085143640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x556112989ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53840/0 (socket says 172.21.15.53:53840) 2024-08-31T06:23:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085143640 1 -- 172.21.15.53:0/3871290604 learned_addr learned my addr 172.21.15.53:0/3871290604 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085944640 1 --2- 172.21.15.53:0/3871290604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x55611298a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085143640 1 --2- 172.21.15.53:0/3871290604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x55611298a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7076ffd640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f706c0b4d20 0x7f706c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085944640 1 -- 172.21.15.53:0/3871290604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 msgr2=0x55611298a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085944640 1 --2- 172.21.15.53:0/3871290604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x55611298a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085944640 1 -- 172.21.15.53:0/3871290604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 msgr2=0x556112989ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085944640 1 --2- 172.21.15.53:0/3871290604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x556112989ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085944640 1 -- 172.21.15.53:0/3871290604 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556112651790 con 0x5561125bd2f0 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085143640 1 --2- 172.21.15.53:0/3871290604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x556112989ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7076ffd640 1 -- 172.21.15.53:0/530536139 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f70780e5570 con 0x7f7080108a20 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7085944640 1 --2- 172.21.15.53:0/3871290604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x55611298a220 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f707c004630 tx=0x7f707c00bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e0a933938667298 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.245+0000 7f7086145640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f706c0b4d20 0x7f706c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.246+0000 7f706bfff640 1 -- 172.21.15.53:0/3871290604 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c003bd0 con 0x5561125bd2f0 2024-08-31T06:23:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.246+0000 7f706bfff640 1 -- 172.21.15.53:0/3871290604 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f707c015070 con 0x5561125bd2f0 2024-08-31T06:23:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.246+0000 7f706bfff640 1 -- 172.21.15.53:0/3871290604 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c004b50 con 0x5561125bd2f0 2024-08-31T06:23:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f708ebed740 1 -- 172.21.15.53:0/3871290604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 msgr2=0x55611298a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f708ebed740 1 --2- 172.21.15.53:0/3871290604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x55611298a220 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f707c004630 tx=0x7f707c00bb20 comp rx=0 tx=0).stop 2024-08-31T06:23:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f7086145640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f706c0b4d20 0x7f706c0b7230 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f70780abbd0 tx=0x7f7078009270 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f708ebed740 1 -- 172.21.15.53:0/3871290604 shutdown_connections 2024-08-31T06:23:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f708ebed740 1 --2- 172.21.15.53:0/3871290604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x55611298a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f708ebed740 1 --2- 172.21.15.53:0/3871290604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x55611298a220 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f708ebed740 1 --2- 172.21.15.53:0/3871290604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x556112989ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f708ebed740 1 -- 172.21.15.53:0/3871290604 >> 172.21.15.53:0/3871290604 conn(0x5561125da300 msgr2=0x556112987bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f708ebed740 1 -- 172.21.15.53:0/3871290604 shutdown_connections 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f708ebed740 1 -- 172.21.15.53:0/3871290604 wait complete. 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f708ebed740 1 -- start start 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.247+0000 7f708ebed740 1 Processor -- start 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f708ebed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x556112999cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f708ebed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x55611299a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f708ebed740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x5561129a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f708ebed740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556112827ab0 con 0x5561125e61b0 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f708ebed740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556112875680 con 0x5561125c54d0 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f708ebed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55611299c840 con 0x5561125bd2f0 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f708ebed740 10 client.0 _ll_register_callbacks cb 0x5561125fda00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f7085143640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x5561129a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f7085143640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x5561129a5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53846/0 (socket says 172.21.15.53:53846) 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f7085143640 1 -- 172.21.15.53:0/3891122164 learned_addr learned my addr 172.21.15.53:0/3891122164 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f7085143640 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x556112999cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f7085944640 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x55611299a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f7085143640 1 -- 172.21.15.53:0/3891122164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 msgr2=0x556112999cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f7085143640 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x556112999cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f7085143640 1 -- 172.21.15.53:0/3891122164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 msgr2=0x55611299a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f7085143640 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x55611299a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f7085143640 1 -- 172.21.15.53:0/3891122164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561126ca620 con 0x5561125e61b0 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f7085143640 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x5561129a5c00 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f7070032d20 tx=0x7f7070009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed0b77c363a20c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.248+0000 7f70697fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.249+0000 7f70697fa640 1 -- 172.21.15.53:0/3891122164 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070035070 con 0x5561125e61b0 2024-08-31T06:23:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.249+0000 7f70697fa640 1 -- 172.21.15.53:0/3891122164 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f7070004100 con 0x5561125e61b0 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.249+0000 7f708ebed740 1 -- 172.21.15.53:0/3891122164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f707c015070 con 0x5561125e61b0 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.249+0000 7f70697fa640 1 -- 172.21.15.53:0/3891122164 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f7070004300 con 0x5561125e61b0 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.249+0000 7f708ebed740 10 client.21123 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.249+0000 7f708ebed740 1 -- 172.21.15.53:0/3891122164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5561129a8920 con 0x5561125e61b0 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.249+0000 7f70697fa640 1 -- 172.21.15.53:0/3891122164 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f707c015070 con 0x5561125e61b0 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.250+0000 7f70697fa640 1 -- 172.21.15.53:0/3891122164 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f7070004a80 con 0x5561125e61b0 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.250+0000 7f708ebed740 10 client.21123 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.250+0000 7f708ebed740 10 client.21123 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.250+0000 7f708ebed740 20 client.21123 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.250+0000 7f708ebed740 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561125a4d80 0x5561129abe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.250+0000 7f708ebed740 4 client.21123 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:00.255 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.250+0000 7f708ebed740 1 -- 172.21.15.53:0/3891122164 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556112900f50 con 0x5561125a4d80 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.250+0000 7f7085944640 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561125a4d80 0x5561129abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.251+0000 7f70697fa640 10 client.21123 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.251+0000 7f7085944640 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561125a4d80 0x5561129abe20 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c720e63f6558699a server_cookie=8b2a4636dc2b9d6 in_seq=0 out_seq=0 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f70697fa640 1 -- 172.21.15.53:0/3891122164 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556112900f50 con 0x5561125a4d80 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f70697fa640 10 client.21123 handle_command_reply: tid=0 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 1 client.21123 shutdown 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 1 -- 172.21.15.53:0/3891122164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 msgr2=0x5561129a5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x5561129a5c00 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f7070032d20 tx=0x7f7070009680 comp rx=0 tx=0).stop 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 1 -- 172.21.15.53:0/3891122164 shutdown_connections 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561125a4d80 0x5561129abe20 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f70697fa640 0 client.21123 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125e61b0 0x5561129a5c00 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x55611299a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 1 --2- 172.21.15.53:0/3891122164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x556112999cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 1 -- 172.21.15.53:0/3891122164 >> 172.21.15.53:0/3891122164 conn(0x5561125da300 msgr2=0x55611298b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 1 -- 172.21.15.53:0/3891122164 shutdown_connections 2024-08-31T06:23:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 1 -- 172.21.15.53:0/3891122164 wait complete. 2024-08-31T06:23:00.258 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.252+0000 7f708ebed740 20 client.21123 trim_cache size 0 max 16384 2024-08-31T06:23:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.267+0000 7f708ebed740 1 Processor -- start 2024-08-31T06:23:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.267+0000 7f708ebed740 1 -- start start 2024-08-31T06:23:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.267+0000 7f708ebed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125a4d80 0x556112998300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.267+0000 7f708ebed740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125bd2f0 0x556112998840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.267+0000 7f708ebed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x556112998f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.267+0000 7f708ebed740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f706400e8c0 con 0x5561125bd2f0 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.267+0000 7f708ebed740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7064010460 con 0x5561125c54d0 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.267+0000 7f708ebed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f706400eff0 con 0x5561125a4d80 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f7085944640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125bd2f0 0x556112998840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f7085944640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125bd2f0 0x556112998840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53862/0 (socket says 172.21.15.53:53862) 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f7085944640 1 -- 172.21.15.53:0/3471348721 learned_addr learned my addr 172.21.15.53:0/3471348721 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f7085143640 1 --2- 172.21.15.53:0/3471348721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125a4d80 0x556112998300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f7085944640 1 -- 172.21.15.53:0/3471348721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125a4d80 msgr2=0x556112998300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f7085944640 1 --2- 172.21.15.53:0/3471348721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125a4d80 0x556112998300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f7085944640 1 -- 172.21.15.53:0/3471348721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 msgr2=0x556112998f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f7085143640 1 --2- 172.21.15.53:0/3471348721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x556112998f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f7085944640 1 --2- 172.21.15.53:0/3471348721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x556112998f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f7085944640 1 -- 172.21.15.53:0/3471348721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55611298ab20 con 0x5561125bd2f0 2024-08-31T06:23:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f7085944640 1 --2- 172.21.15.53:0/3471348721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125bd2f0 0x556112998840 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f707c004580 tx=0x7f707c0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ff16c63a659713 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f706b7fe640 1 -- 172.21.15.53:0/3471348721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c032070 con 0x5561125bd2f0 2024-08-31T06:23:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f706b7fe640 1 -- 172.21.15.53:0/3471348721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f707c015040 con 0x5561125bd2f0 2024-08-31T06:23:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.268+0000 7f706b7fe640 1 -- 172.21.15.53:0/3471348721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c0116a0 con 0x5561125bd2f0 2024-08-31T06:23:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.269+0000 7f708ebed740 1 -- 172.21.15.53:0/3471348721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125bd2f0 msgr2=0x556112998840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.269+0000 7f708ebed740 1 --2- 172.21.15.53:0/3471348721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125bd2f0 0x556112998840 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f707c004580 tx=0x7f707c0047f0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.269+0000 7f708ebed740 1 -- 172.21.15.53:0/3471348721 shutdown_connections 2024-08-31T06:23:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.269+0000 7f708ebed740 1 --2- 172.21.15.53:0/3471348721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125c54d0 0x556112998f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.269+0000 7f708ebed740 1 --2- 172.21.15.53:0/3471348721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125bd2f0 0x556112998840 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.269+0000 7f708ebed740 1 --2- 172.21.15.53:0/3471348721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125a4d80 0x556112998300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.269+0000 7f708ebed740 1 -- 172.21.15.53:0/3471348721 >> 172.21.15.53:0/3471348721 conn(0x5561125da300 msgr2=0x556112994ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.269+0000 7f708ebed740 1 -- 172.21.15.53:0/3471348721 shutdown_connections 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.269+0000 7f708ebed740 1 -- 172.21.15.53:0/3471348721 wait complete. 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f708ebed740 1 -- start start 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f708ebed740 1 Processor -- start 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f708ebed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125a4d80 0x5561129a2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f708ebed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x55611299d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f708ebed740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125c54d0 0x55611299da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f708ebed740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f706400fd90 con 0x5561125c54d0 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f708ebed740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f706400f6c0 con 0x5561125a4d80 2024-08-31T06:23:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f708ebed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f706400c8c0 con 0x5561125bd2f0 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f708ebed740 10 client.0 _ll_register_callbacks cb 0x7f70700051f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f7085143640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125c54d0 0x55611299da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f7085143640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125c54d0 0x55611299da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53876/0 (socket says 172.21.15.53:53876) 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.270+0000 7f7085143640 1 -- 172.21.15.53:0/2555351809 learned_addr learned my addr 172.21.15.53:0/2555351809 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f7085944640 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x55611299d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f7085143640 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125a4d80 0x5561129a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f7085143640 1 -- 172.21.15.53:0/2555351809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 msgr2=0x55611299d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f7085143640 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x55611299d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f7085143640 1 -- 172.21.15.53:0/2555351809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125a4d80 msgr2=0x5561129a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f7085143640 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125a4d80 0x5561129a2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f7085143640 1 -- 172.21.15.53:0/2555351809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55611299df70 con 0x5561125c54d0 2024-08-31T06:23:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f7085944640 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x55611299d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f7085143640 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125c54d0 0x55611299da30 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f7070000c00 tx=0x7f70700052a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f45d21d44b436c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f70697fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f70697fa640 1 -- 172.21.15.53:0/2555351809 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070035040 con 0x5561125c54d0 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f708ebed740 1 -- 172.21.15.53:0/2555351809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f707c015040 con 0x5561125c54d0 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f70697fa640 1 -- 172.21.15.53:0/2555351809 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f7070003c80 con 0x5561125c54d0 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f70697fa640 1 -- 172.21.15.53:0/2555351809 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f7070032e80 con 0x5561125c54d0 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f708ebed740 10 client.21129 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.271+0000 7f708ebed740 1 -- 172.21.15.53:0/2555351809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x556112a16480 con 0x5561125c54d0 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.272+0000 7f70697fa640 1 -- 172.21.15.53:0/2555351809 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f707c015040 con 0x5561125c54d0 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.272+0000 7f70697fa640 1 -- 172.21.15.53:0/2555351809 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f70700048c0 con 0x5561125c54d0 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.272+0000 7f708ebed740 10 client.21129 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.272+0000 7f708ebed740 10 client.21129 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.272+0000 7f708ebed740 20 client.21129 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.272+0000 7f708ebed740 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561125e61b0 0x556112a18b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.272+0000 7f708ebed740 4 client.21129 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:23:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.272+0000 7f708ebed740 1 -- 172.21.15.53:0/2555351809 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5561128fc9f0 con 0x5561125e61b0 2024-08-31T06:23:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.272+0000 7f7085944640 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561125e61b0 0x556112a18b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.273+0000 7f70697fa640 10 client.21129 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.273+0000 7f7085944640 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561125e61b0 0x556112a18b50 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52cc41fe74d1690 server_cookie=6feeff31a7add3de in_seq=0 out_seq=0 2024-08-31T06:23:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.297+0000 7f70697fa640 1 -- 172.21.15.53:0/2555351809 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5561128fc9f0 con 0x5561125e61b0 2024-08-31T06:23:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.297+0000 7f70697fa640 10 client.21129 handle_command_reply: tid=0 2024-08-31T06:23:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.297+0000 7f708ebed740 1 client.21129 shutdown 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.297+0000 7f708ebed740 1 -- 172.21.15.53:0/2555351809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125c54d0 msgr2=0x55611299da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.297+0000 7f708ebed740 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125c54d0 0x55611299da30 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f7070000c00 tx=0x7f70700052a0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.298+0000 7f708ebed740 1 -- 172.21.15.53:0/2555351809 shutdown_connections 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.298+0000 7f708ebed740 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561125e61b0 0x556112a18b50 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.298+0000 7f708ebed740 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561125c54d0 0x55611299da30 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.298+0000 7f708ebed740 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561125bd2f0 0x55611299d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.298+0000 7f708ebed740 1 --2- 172.21.15.53:0/2555351809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561125a4d80 0x5561129a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.298+0000 7f70697fa640 0 client.21129 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.298+0000 7f708ebed740 1 -- 172.21.15.53:0/2555351809 >> 172.21.15.53:0/2555351809 conn(0x5561125da300 msgr2=0x55611298ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.298+0000 7f708ebed740 1 -- 172.21.15.53:0/2555351809 shutdown_connections 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.298+0000 7f708ebed740 1 -- 172.21.15.53:0/2555351809 wait complete. 2024-08-31T06:23:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.298+0000 7f708ebed740 20 client.21129 trim_cache size 0 max 16384 2024-08-31T06:23:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:23:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:23:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:23:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:23:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 -- 172.21.15.53:0/530536139 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f706c0b4d20 msgr2=0x7f706c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f706c0b4d20 0x7f706c0b7230 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f70780abbd0 tx=0x7f7078009270 comp rx=0 tx=0).stop 2024-08-31T06:23:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 -- 172.21.15.53:0/530536139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7080108a20 msgr2=0x7f708019fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7080108a20 0x7f708019fa00 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f707800eaa0 tx=0x7f707800ef60 comp rx=0 tx=0).stop 2024-08-31T06:23:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 -- 172.21.15.53:0/530536139 shutdown_connections 2024-08-31T06:23:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f706c0b4d20 0x7f706c0b7230 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7080108a20 0x7f708019fa00 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70801080d0 0x7f708019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 --2- 172.21.15.53:0/530536139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7080102f10 0x7f708019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 -- 172.21.15.53:0/530536139 >> 172.21.15.53:0/530536139 conn(0x7f7080079c30 msgr2=0x7f7080104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 -- 172.21.15.53:0/530536139 shutdown_connections 2024-08-31T06:23:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:00.299+0000 7f7087ba8640 1 -- 172.21.15.53:0/530536139 wait complete. 2024-08-31T06:23:00.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.13 MB/sec execute 168 sec latency 29535.511 ms 2024-08-31T06:23:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:00.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:00 smithi053 ceph-mon[18924]: pgmap v888: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 19 op/s 2024-08-31T06:23:00.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.525+0000 7fafa8478640 1 -- 172.21.15.53:0/444916805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafa010b990 con 0x7fafa0109ba0 2024-08-31T06:23:00.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.525+0000 7faf977fe640 1 -- 172.21.15.53:0/444916805 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+11988 (secure 0 0 0) 0x7faf980ccfd0 con 0x7fafa0109ba0 2024-08-31T06:23:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:23:00.528 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":66,"btime":"2024-08-31T06:22:34:298615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":66,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:22:33.810373+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:23:00.529 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 66 2024-08-31T06:23:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 -- 172.21.15.53:0/444916805 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf8c0b4ca0 msgr2=0x7faf8c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf8c0b4ca0 0x7faf8c0b71b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00bbe0 tx=0x7faf9c00b390 comp rx=0 tx=0).stop 2024-08-31T06:23:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 -- 172.21.15.53:0/444916805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa0109ba0 msgr2=0x7fafa019f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa0109ba0 0x7fafa019f990 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7faf98005cc0 tx=0x7faf98032a10 comp rx=0 tx=0).stop 2024-08-31T06:23:00.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 -- 172.21.15.53:0/444916805 shutdown_connections 2024-08-31T06:23:00.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf8c0b4ca0 0x7faf8c0b71b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa0109ba0 0x7fafa019f990 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafa0109250 0x7fafa019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 --2- 172.21.15.53:0/444916805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa0101d10 0x7fafa019a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:00.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 -- 172.21.15.53:0/444916805 >> 172.21.15.53:0/444916805 conn(0x7fafa0077a00 msgr2=0x7fafa0105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:00.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 -- 172.21.15.53:0/444916805 shutdown_connections 2024-08-31T06:23:00.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:00.528+0000 7fafa8478640 1 -- 172.21.15.53:0/444916805 wait complete. 2024-08-31T06:23:00.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:00 smithi130 ceph-mon[22266]: pgmap v888: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 19 op/s 2024-08-31T06:23:00.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:00 smithi153 ceph-mon[22320]: pgmap v888: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 19 op/s 2024-08-31T06:23:01.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.10 MB/sec execute 169 sec latency 30535.543 ms 2024-08-31T06:23:01.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:01 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/444916805' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:23:01.628 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:23:01 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:23:01.319+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020c [...20,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL/ auth{1=1,2=1,3=1,4=1} v45172 ap=3 f(v2168 m2024-08-31T06:22:22.042198+0000 8=8+0) n(v73 rc2024-08-31T06:22:22.049326+0000 b1283356 9=8+1) old_inodes=6 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:2307 nref=3)) caps={15441=pAsLsXsFs/-@35874} | dirtyscattered=0 request=1 lock=2 importing=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e67e1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000020c:[<0x10000000009/EXCEL v1138>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x1000000020c:[<0x10000000009/EXCEL v45172>,<0x10000000008/~dmtmp v29638>,<0x10000000007/client0 v2390>,<0x10000000006/clients v2101>,<0x10000000005/tmp v1612>,<0x10000000003/client.0 v1585>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v1566>,<0x10000000001/sv_0 v1560>,<0x10000000000/qa v1543>,<0x1/volumes v1469>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:22:22.009146+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:22:22.049326+0000 b1283356 9=8+1)","memory_value.dirstat":"f(v2168 m2024-08-31T06:22:22.042198+0000 8=8+0)","memory_value.rstat":"n(v73 rc2024-08-31T06:22:22.049326+0000 b1283356 9=8+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:23:01.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:01 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/444916805' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:23:01.723 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:01 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/444916805' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:23:01.752 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id cab2cb4e --release --await' 2024-08-31T06:23:01.752 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id cab2cb4e --release --await 2024-08-31T06:23:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.189+0000 7fc6d4018640 1 -- 172.21.15.53:0/944348591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6cc102800 msgr2=0x7fc6cc102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.189+0000 7fc6d4018640 1 --2- 172.21.15.53:0/944348591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6cc102800 0x7fc6cc102c10 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009ca0 tx=0x7fc6bc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.189+0000 7fc6d4018640 1 -- 172.21.15.53:0/944348591 shutdown_connections 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.189+0000 7fc6d4018640 1 --2- 172.21.15.53:0/944348591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6cc108a90 0x7fc6cc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.189+0000 7fc6d4018640 1 --2- 172.21.15.53:0/944348591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6cc108140 0x7fc6cc108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.189+0000 7fc6d4018640 1 --2- 172.21.15.53:0/944348591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6cc102800 0x7fc6cc102c10 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.189+0000 7fc6d4018640 1 -- 172.21.15.53:0/944348591 >> 172.21.15.53:0/944348591 conn(0x7fc6cc0794d0 msgr2=0x7fc6cc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.189+0000 7fc6d4018640 1 -- 172.21.15.53:0/944348591 shutdown_connections 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.189+0000 7fc6d4018640 1 -- 172.21.15.53:0/944348591 wait complete. 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d4018640 1 Processor -- start 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d4018640 1 -- start start 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d4018640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6cc102800 0x7fc6cc19aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d4018640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6cc108140 0x7fc6cc19b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d4018640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6cc108a90 0x7fc6cc19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d4018640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc112680 con 0x7fc6cc102800 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d4018640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc112500 con 0x7fc6cc108140 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d4018640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc112800 con 0x7fc6cc108a90 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d1db4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6cc102800 0x7fc6cc19aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d1db4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6cc102800 0x7fc6cc19aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53902/0 (socket says 172.21.15.53:53902) 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d1db4640 1 -- 172.21.15.53:0/2828898041 learned_addr learned my addr 172.21.15.53:0/2828898041 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d15b3640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6cc108140 0x7fc6cc19b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6cc108a90 0x7fc6cc19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d1db4640 1 -- 172.21.15.53:0/2828898041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6cc108a90 msgr2=0x7fc6cc19ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6cc108a90 0x7fc6cc19ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d1db4640 1 -- 172.21.15.53:0/2828898041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6cc108140 msgr2=0x7fc6cc19b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6cc108140 0x7fc6cc19b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d1db4640 1 -- 172.21.15.53:0/2828898041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6cc1a62b0 con 0x7fc6cc102800 2024-08-31T06:23:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d15b3640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6cc108140 0x7fc6cc19b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.190+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6cc108a90 0x7fc6cc19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.191+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6cc102800 0x7fc6cc19aff0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009dc0 tx=0x7fc6bc003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.191+0000 7fc6caffd640 1 -- 172.21.15.53:0/2828898041 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc032dd0 con 0x7fc6cc102800 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.191+0000 7fc6caffd640 1 -- 172.21.15.53:0/2828898041 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6bc0044d0 con 0x7fc6cc102800 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.191+0000 7fc6d4018640 1 -- 172.21.15.53:0/2828898041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6cc1a6540 con 0x7fc6cc102800 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.191+0000 7fc6caffd640 1 -- 172.21.15.53:0/2828898041 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc030c50 con 0x7fc6cc102800 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.191+0000 7fc6d4018640 1 -- 172.21.15.53:0/2828898041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6cc1a6a80 con 0x7fc6cc102800 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.194+0000 7fc6da58d740 1 Processor -- start 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.194+0000 7fc6caffd640 1 -- 172.21.15.53:0/2828898041 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc6bc004680 con 0x7fc6cc102800 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.194+0000 7fc6da58d740 1 -- start start 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a860770350 0x55a860b16780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860747490 0x55a860b16cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a86074f670 0x55a860b17200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6da58d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a860a8c5f0 con 0x55a860747490 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6da58d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a860a7bb80 con 0x55a86074f670 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6da58d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a860a7fb30 con 0x55a860770350 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6d1db4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860747490 0x55a860b16cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6d1db4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860747490 0x55a860b16cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53918/0 (socket says 172.21.15.53:53918) 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6d1db4640 1 -- 172.21.15.53:0/2740847118 learned_addr learned my addr 172.21.15.53:0/2740847118 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6caffd640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc6b40b4ca0 0x7fc6b40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6d1db4640 1 -- 172.21.15.53:0/2740847118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a860770350 msgr2=0x55a860b16780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/2740847118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a860770350 0x55a860b16780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6d1db4640 1 -- 172.21.15.53:0/2740847118 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a86074f670 msgr2=0x55a860b17200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/2740847118 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a86074f670 0x55a860b17200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6d1db4640 1 -- 172.21.15.53:0/2740847118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8607db930 con 0x55a860747490 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.195+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc6b40b4ca0 0x7fc6b40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.196+0000 7fc6caffd640 1 -- 172.21.15.53:0/2828898041 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7fc6bc106870 con 0x7fc6cc102800 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.196+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/2740847118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860747490 0x55a860b16cc0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc103f10 tx=0x7fc6bc091950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a51f4848bd2e5b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.196+0000 7fc6b3fff640 1 -- 172.21.15.53:0/2740847118 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0ccd10 con 0x55a860747490 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.196+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc6b40b4ca0 0x7fc6b40b71b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40058c0 tx=0x7fc6c40093d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.196+0000 7fc6b3fff640 1 -- 172.21.15.53:0/2740847118 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6bc0cca50 con 0x55a860747490 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.196+0000 7fc6b3fff640 1 -- 172.21.15.53:0/2740847118 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc097160 con 0x55a860747490 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.197+0000 7fc6da58d740 1 -- 172.21.15.53:0/2740847118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860747490 msgr2=0x55a860b16cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.197+0000 7fc6da58d740 1 --2- 172.21.15.53:0/2740847118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860747490 0x55a860b16cc0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc103f10 tx=0x7fc6bc091950 comp rx=0 tx=0).stop 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.197+0000 7fc6da58d740 1 -- 172.21.15.53:0/2740847118 shutdown_connections 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.197+0000 7fc6da58d740 1 --2- 172.21.15.53:0/2740847118 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a86074f670 0x55a860b17200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.197+0000 7fc6da58d740 1 --2- 172.21.15.53:0/2740847118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860747490 0x55a860b16cc0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.197+0000 7fc6da58d740 1 --2- 172.21.15.53:0/2740847118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a860770350 0x55a860b16780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.197+0000 7fc6da58d740 1 -- 172.21.15.53:0/2740847118 >> 172.21.15.53:0/2740847118 conn(0x55a860764740 msgr2=0x55a860b14670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.197+0000 7fc6da58d740 1 -- 172.21.15.53:0/2740847118 shutdown_connections 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.197+0000 7fc6da58d740 1 -- 172.21.15.53:0/2740847118 wait complete. 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.197+0000 7fc6da58d740 1 -- start start 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.197+0000 7fc6da58d740 1 Processor -- start 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b21f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86074f670 0x55a860b22480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860770350 0x55a860b2de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6da58d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8608de890 con 0x55a860770350 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6da58d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a860a02790 con 0x55a860747490 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6da58d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a860a7bb80 con 0x55a86074f670 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6da58d740 10 client.0 _ll_register_callbacks cb 0x55a860787ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6d25b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860770350 0x55a860b2de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6d25b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860770350 0x55a860b2de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53922/0 (socket says 172.21.15.53:53922) 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6d25b5640 1 -- 172.21.15.53:0/370457286 learned_addr learned my addr 172.21.15.53:0/370457286 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b21f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6d15b3640 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86074f670 0x55a860b22480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6d25b5640 1 -- 172.21.15.53:0/370457286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86074f670 msgr2=0x55a860b22480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86074f670 0x55a860b22480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6d25b5640 1 -- 172.21.15.53:0/370457286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 msgr2=0x55a860b21f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b21f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6d25b5640 1 -- 172.21.15.53:0/370457286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a860a39f30 con 0x55a860770350 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.198+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b21f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.199+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860770350 0x55a860b2de90 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fc6c401c7b0 tx=0x7fc6c4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4933e6f8bbf941 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.199+0000 7fc6b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.199+0000 7fc6b17fa640 1 -- 172.21.15.53:0/370457286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4010bb0 con 0x55a860770350 2024-08-31T06:23:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.199+0000 7fc6b17fa640 1 -- 172.21.15.53:0/370457286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7fc6c4010d50 con 0x55a860770350 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.199+0000 7fc6da58d740 1 -- 172.21.15.53:0/370457286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6bc0cca50 con 0x55a860770350 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.199+0000 7fc6b17fa640 1 -- 172.21.15.53:0/370457286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fc6c4025440 con 0x55a860770350 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.199+0000 7fc6da58d740 10 client.21141 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.199+0000 7fc6da58d740 1 -- 172.21.15.53:0/370457286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55a860b30a30 con 0x55a860770350 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.199+0000 7fc6b17fa640 1 -- 172.21.15.53:0/370457286 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6bc0cca50 con 0x55a860770350 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.199+0000 7fc6b17fa640 1 -- 172.21.15.53:0/370457286 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fc6c4023070 con 0x55a860770350 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.200+0000 7fc6da58d740 10 client.21141 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.200+0000 7fc6da58d740 10 client.21141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.200+0000 7fc6da58d740 20 client.21141 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.200+0000 7fc6da58d740 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a86072ecd0 0x55a860b33fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.200+0000 7fc6da58d740 4 client.21141 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.200+0000 7fc6da58d740 1 -- 172.21.15.53:0/370457286 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a860a8e540 con 0x55a86072ecd0 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.200+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a86072ecd0 0x55a860b33fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.200+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a86072ecd0 0x55a860b33fc0 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f21968fc7c1558f5 server_cookie=f7cd214c19595449 in_seq=0 out_seq=0 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.200+0000 7fc6b17fa640 10 client.21141 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.201+0000 7fc6b17fa640 1 -- 172.21.15.53:0/370457286 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a860a8e540 con 0x55a86072ecd0 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.201+0000 7fc6b17fa640 10 client.21141 handle_command_reply: tid=0 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.201+0000 7fc6da58d740 1 client.21141 shutdown 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.201+0000 7fc6da58d740 1 -- 172.21.15.53:0/370457286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860770350 msgr2=0x55a860b2de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.201+0000 7fc6da58d740 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860770350 0x55a860b2de90 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fc6c401c7b0 tx=0x7fc6c4005f90 comp rx=0 tx=0).stop 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.201+0000 7fc6da58d740 1 -- 172.21.15.53:0/370457286 shutdown_connections 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.201+0000 7fc6da58d740 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a86072ecd0 0x55a860b33fc0 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.201+0000 7fc6da58d740 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a860770350 0x55a860b2de90 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.201+0000 7fc6da58d740 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86074f670 0x55a860b22480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.201+0000 7fc6b17fa640 0 client.21141 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.201+0000 7fc6da58d740 1 --2- 172.21.15.53:0/370457286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b21f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.202+0000 7fc6da58d740 1 -- 172.21.15.53:0/370457286 >> 172.21.15.53:0/370457286 conn(0x55a860764740 msgr2=0x55a860b19910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.202+0000 7fc6da58d740 1 -- 172.21.15.53:0/370457286 shutdown_connections 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.202+0000 7fc6da58d740 1 -- 172.21.15.53:0/370457286 wait complete. 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.202+0000 7fc6da58d740 20 client.21141 trim_cache size 0 max 16384 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6da58d740 1 Processor -- start 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6da58d740 1 -- start start 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86072ecd0 0x55a860b19f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b1f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86074f670 0x55a860b1f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6da58d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1b1130 con 0x55a86074f670 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6da58d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1afcc0 con 0x55a860747490 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6da58d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1b0390 con 0x55a86072ecd0 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6d25b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86074f670 0x55a860b1f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6d25b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86074f670 0x55a860b1f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53938/0 (socket says 172.21.15.53:53938) 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6d25b5640 1 -- 172.21.15.53:0/792535423 learned_addr learned my addr 172.21.15.53:0/792535423 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/792535423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86072ecd0 0x55a860b19f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6d15b3640 1 --2- 172.21.15.53:0/792535423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b1f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6d25b5640 1 -- 172.21.15.53:0/792535423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86072ecd0 msgr2=0x55a860b19f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/792535423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86072ecd0 0x55a860b19f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6d25b5640 1 -- 172.21.15.53:0/792535423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 msgr2=0x55a860b1f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/792535423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b1f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6d25b5640 1 -- 172.21.15.53:0/792535423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a860b20ea0 con 0x55a86074f670 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.220+0000 7fc6d15b3640 1 --2- 172.21.15.53:0/792535423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b1f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.221+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/792535423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86074f670 0x55a860b1f670 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4010800 tx=0x7fc6c4005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707792b3b2a3fdfe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.221+0000 7fc6b37fe640 1 -- 172.21.15.53:0/792535423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c402db50 con 0x55a86074f670 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.221+0000 7fc6b37fe640 1 -- 172.21.15.53:0/792535423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c402d4a0 con 0x55a86074f670 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.221+0000 7fc6b37fe640 1 -- 172.21.15.53:0/792535423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4025db0 con 0x55a86074f670 2024-08-31T06:23:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.222+0000 7fc6da58d740 1 -- 172.21.15.53:0/792535423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86074f670 msgr2=0x55a860b1f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.222+0000 7fc6da58d740 1 --2- 172.21.15.53:0/792535423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86074f670 0x55a860b1f670 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4010800 tx=0x7fc6c4005970 comp rx=0 tx=0).stop 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.222+0000 7fc6da58d740 1 -- 172.21.15.53:0/792535423 shutdown_connections 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.222+0000 7fc6da58d740 1 --2- 172.21.15.53:0/792535423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86074f670 0x55a860b1f670 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.222+0000 7fc6da58d740 1 --2- 172.21.15.53:0/792535423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b1f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.222+0000 7fc6da58d740 1 --2- 172.21.15.53:0/792535423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86072ecd0 0x55a860b19f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.222+0000 7fc6da58d740 1 -- 172.21.15.53:0/792535423 >> 172.21.15.53:0/792535423 conn(0x55a860764740 msgr2=0x55a860b19880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.222+0000 7fc6da58d740 1 -- 172.21.15.53:0/792535423 shutdown_connections 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.222+0000 7fc6da58d740 1 -- 172.21.15.53:0/792535423 wait complete. 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.222+0000 7fc6da58d740 1 -- start start 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.222+0000 7fc6da58d740 1 Processor -- start 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86072ecd0 0x55a860b2a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b26c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6da58d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86074f670 0x55a860b27340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6da58d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1ad590 con 0x55a86072ecd0 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6da58d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1b0a60 con 0x55a860747490 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6da58d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc6cc1adbe0 con 0x55a86074f670 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6da58d740 10 client.0 _ll_register_callbacks cb 0x7fc6c40098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d1db4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86072ecd0 0x55a860b2a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d1db4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86072ecd0 0x55a860b2a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53940/0 (socket says 172.21.15.53:53940) 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d1db4640 1 -- 172.21.15.53:0/1817724760 learned_addr learned my addr 172.21.15.53:0/1817724760 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86074f670 0x55a860b27340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d15b3640 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b26c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d1db4640 1 -- 172.21.15.53:0/1817724760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86074f670 msgr2=0x55a860b27340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86074f670 0x55a860b27340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d1db4640 1 -- 172.21.15.53:0/1817724760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 msgr2=0x55a860b26c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b26c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d1db4640 1 -- 172.21.15.53:0/1817724760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a860b9e990 con 0x55a86072ecd0 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d25b5640 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86074f670 0x55a860b27340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6d1db4640 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86072ecd0 0x55a860b2a790 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0991f0 tx=0x7fc6bc009460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a74005c81b8d39e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.223+0000 7fc6b17fa640 1 -- 172.21.15.53:0/1817724760 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0cc6b0 con 0x55a86072ecd0 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6b17fa640 1 -- 172.21.15.53:0/1817724760 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7fc6bc004040 con 0x55a86072ecd0 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6da58d740 1 -- 172.21.15.53:0/1817724760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6c402d4a0 con 0x55a86072ecd0 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6b17fa640 1 -- 172.21.15.53:0/1817724760 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fc6bc0cc890 con 0x55a86072ecd0 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6da58d740 10 client.21147 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6da58d740 1 -- 172.21.15.53:0/1817724760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55a860b9fac0 con 0x55a86072ecd0 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6b17fa640 1 -- 172.21.15.53:0/1817724760 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c402d4a0 con 0x55a86072ecd0 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6b17fa640 1 -- 172.21.15.53:0/1817724760 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fc6bc104220 con 0x55a86072ecd0 2024-08-31T06:23:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6da58d740 10 client.21147 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6da58d740 10 client.21147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6da58d740 20 client.21147 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6da58d740 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a860770350 0x55a860ba2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6da58d740 4 client.21147 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6da58d740 1 -- 172.21.15.53:0/1817724760 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a860a89fe0 con 0x55a860770350 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.224+0000 7fc6d15b3640 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a860770350 0x55a860ba2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.225+0000 7fc6d15b3640 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a860770350 0x55a860ba2200 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c3c0a02a27c358c server_cookie=7bc3eef609ecbc4e in_seq=0 out_seq=0 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.225+0000 7fc6b17fa640 10 client.21147 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.226+0000 7fc6b17fa640 1 -- 172.21.15.53:0/1817724760 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a860a89fe0 con 0x55a860770350 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.226+0000 7fc6b17fa640 10 client.21147 handle_command_reply: tid=0 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.226+0000 7fc6da58d740 1 client.21147 shutdown 2024-08-31T06:23:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.226+0000 7fc6da58d740 1 -- 172.21.15.53:0/1817724760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86072ecd0 msgr2=0x55a860b2a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.226+0000 7fc6da58d740 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86072ecd0 0x55a860b2a790 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0991f0 tx=0x7fc6bc009460 comp rx=0 tx=0).stop 2024-08-31T06:23:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6da58d740 1 -- 172.21.15.53:0/1817724760 shutdown_connections 2024-08-31T06:23:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6da58d740 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a860770350 0x55a860ba2200 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6da58d740 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a86074f670 0x55a860b27340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6da58d740 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a860747490 0x55a860b26c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6da58d740 1 --2- 172.21.15.53:0/1817724760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a86072ecd0 0x55a860b2a790 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6da58d740 1 -- 172.21.15.53:0/1817724760 >> 172.21.15.53:0/1817724760 conn(0x55a860764740 msgr2=0x55a860b17660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6b17fa640 0 client.21147 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6da58d740 1 -- 172.21.15.53:0/1817724760 shutdown_connections 2024-08-31T06:23:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6da58d740 1 -- 172.21.15.53:0/1817724760 wait complete. 2024-08-31T06:23:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6da58d740 20 client.21147 trim_cache size 0 max 16384 2024-08-31T06:23:01.842 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:23:01.842 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:23:01.842 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "2fed2c78-e329-4f7b-a695-c06d48d6f6a5", 2024-08-31T06:23:01.842 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:23:01.842 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6d4018640 1 -- 172.21.15.53:0/2828898041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc6b40b4ca0 msgr2=0x7fc6b40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6d4018640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc6b40b4ca0 0x7fc6b40b71b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40058c0 tx=0x7fc6c40093d0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6d4018640 1 -- 172.21.15.53:0/2828898041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6cc102800 msgr2=0x7fc6cc19aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.227+0000 7fc6d4018640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6cc102800 0x7fc6cc19aff0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009dc0 tx=0x7fc6bc003f80 comp rx=0 tx=0).stop 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.228+0000 7fc6d4018640 1 -- 172.21.15.53:0/2828898041 shutdown_connections 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.228+0000 7fc6d4018640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc6b40b4ca0 0x7fc6b40b71b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.228+0000 7fc6d4018640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6cc108a90 0x7fc6cc19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.228+0000 7fc6d4018640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6cc108140 0x7fc6cc19b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.228+0000 7fc6d4018640 1 --2- 172.21.15.53:0/2828898041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6cc102800 0x7fc6cc19aff0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.228+0000 7fc6d4018640 1 -- 172.21.15.53:0/2828898041 >> 172.21.15.53:0/2828898041 conn(0x7fc6cc0794d0 msgr2=0x7fc6cc101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.228+0000 7fc6d4018640 1 -- 172.21.15.53:0/2828898041 shutdown_connections 2024-08-31T06:23:01.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:01.228+0000 7fc6d4018640 1 -- 172.21.15.53:0/2828898041 wait complete. 2024-08-31T06:23:02.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30190 5.07 MB/sec execute 170 sec latency 31535.649 ms 2024-08-31T06:23:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: pgmap v889: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-08-31T06:23:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:23:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:23:02.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:23:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:23:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:23:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:23:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL) see mds.b log and `damage ls` output for details 2024-08-31T06:23:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:02 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:02.556 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:23:02.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: pgmap v889: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL) see mds.b log and `damage ls` output for details 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:02 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: pgmap v889: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/EXCEL) see mds.b log and `damage ls` output for details 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:02.677 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:02 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:03.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.036+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1569461014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc108140 msgr2=0x7f8abc108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:03.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.036+0000 7f8ac33eb640 1 --2- 172.21.15.53:0/1569461014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc108140 0x7f8abc108550 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009900 tx=0x7f8aac02a410 comp rx=0 tx=0).stop 2024-08-31T06:23:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.036+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1569461014 shutdown_connections 2024-08-31T06:23:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.036+0000 7f8ac33eb640 1 --2- 172.21.15.53:0/1569461014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc108a90 0x7f8abc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.036+0000 7f8ac33eb640 1 --2- 172.21.15.53:0/1569461014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc108140 0x7f8abc108550 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.036+0000 7f8ac33eb640 1 --2- 172.21.15.53:0/1569461014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8abc102800 0x7f8abc102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.036+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1569461014 >> 172.21.15.53:0/1569461014 conn(0x7f8abc0794d0 msgr2=0x7f8abc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.036+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1569461014 shutdown_connections 2024-08-31T06:23:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.036+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1569461014 wait complete. 2024-08-31T06:23:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.037+0000 7f8ac33eb640 1 Processor -- start 2024-08-31T06:23:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.037+0000 7f8ac33eb640 1 -- start start 2024-08-31T06:23:03.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac33eb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc102800 0x7f8abc199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac33eb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8abc108140 0x7f8abc199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac33eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc108a90 0x7f8abc19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac33eb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc112590 con 0x7f8abc108a90 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac33eb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc112410 con 0x7f8abc102800 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac33eb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc112710 con 0x7f8abc108140 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac1988640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc108a90 0x7f8abc19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac1187640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc102800 0x7f8abc199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac1187640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc102800 0x7f8abc199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:53266/0 (socket says 172.21.15.53:53266) 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac1988640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc108a90 0x7f8abc19e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53958/0 (socket says 172.21.15.53:53958) 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac1187640 1 -- 172.21.15.53:0/1765089236 learned_addr learned my addr 172.21.15.53:0/1765089236 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac0986640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8abc108140 0x7f8abc199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac1187640 1 -- 172.21.15.53:0/1765089236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8abc108140 msgr2=0x7f8abc199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:03.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac1187640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8abc108140 0x7f8abc199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac1187640 1 -- 172.21.15.53:0/1765089236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc108a90 msgr2=0x7f8abc19e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac1187640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc108a90 0x7f8abc19e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac1187640 1 -- 172.21.15.53:0/1765089236 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8abc19eff0 con 0x7f8abc102800 2024-08-31T06:23:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.038+0000 7f8ac1988640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc108a90 0x7f8abc19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.039+0000 7f8ac1187640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc102800 0x7f8abc199080 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800d770 tx=0x7f8ab800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:03.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.039+0000 7f8ab27fc640 1 -- 172.21.15.53:0/1765089236 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8017070 con 0x7f8abc102800 2024-08-31T06:23:03.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.039+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1765089236 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8abc19f2e0 con 0x7f8abc102800 2024-08-31T06:23:03.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.039+0000 7f8ab27fc640 1 -- 172.21.15.53:0/1765089236 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ab80054b0 con 0x7f8abc102800 2024-08-31T06:23:03.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.039+0000 7f8ab27fc640 1 -- 172.21.15.53:0/1765089236 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8004c60 con 0x7f8abc102800 2024-08-31T06:23:03.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.039+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1765089236 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8abc1a5a40 con 0x7f8abc102800 2024-08-31T06:23:03.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.042+0000 7f8ac9960740 1 Processor -- start 2024-08-31T06:23:03.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.042+0000 7f8ac9960740 1 -- start start 2024-08-31T06:23:03.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.042+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb3c8520 0x5618bb770760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.042+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb39f660 0x5618bb76dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.042+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3a7840 0x5618bb76e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.042+0000 7f8ac9960740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618bb6e4a70 con 0x5618bb3a7840 2024-08-31T06:23:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.042+0000 7f8ac9960740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5618bb6d4000 con 0x5618bb39f660 2024-08-31T06:23:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.042+0000 7f8ac9960740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5618bb6d7fb0 con 0x5618bb3c8520 2024-08-31T06:23:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.042+0000 7f8ab27fc640 1 -- 172.21.15.53:0/1765089236 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8ab8004e00 con 0x7f8abc102800 2024-08-31T06:23:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.042+0000 7f8ac0986640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3a7840 0x5618bb76e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac0986640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3a7840 0x5618bb76e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53970/0 (socket says 172.21.15.53:53970) 2024-08-31T06:23:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac0986640 1 -- 172.21.15.53:0/3377164288 learned_addr learned my addr 172.21.15.53:0/3377164288 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3377164288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb3c8520 0x5618bb770760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac1187640 1 --2- 172.21.15.53:0/3377164288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb39f660 0x5618bb76dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac1988640 1 -- 172.21.15.53:0/3377164288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb39f660 msgr2=0x5618bb76dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:03.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3377164288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb39f660 0x5618bb76dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac1988640 1 -- 172.21.15.53:0/3377164288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3a7840 msgr2=0x5618bb76e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:03.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3377164288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3a7840 0x5618bb76e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac1988640 1 -- 172.21.15.53:0/3377164288 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618bb433b00 con 0x5618bb3c8520 2024-08-31T06:23:03.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac0986640 1 --2- 172.21.15.53:0/3377164288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3a7840 0x5618bb76e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:03.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac1187640 1 --2- 172.21.15.53:0/3377164288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb39f660 0x5618bb76dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:23:03.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3377164288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb3c8520 0x5618bb770760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4010710 tx=0x7f8ab4010bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85110a70af46ea0e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:03.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.043+0000 7f8ab27fc640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8aa80b4ca0 0x7f8aa80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.044+0000 7f8aa77fe640 1 -- 172.21.15.53:0/3377164288 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4004b20 con 0x5618bb3c8520 2024-08-31T06:23:03.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.044+0000 7f8ac1187640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8aa80b4ca0 0x7f8aa80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.044+0000 7f8aa77fe640 1 -- 172.21.15.53:0/3377164288 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ab400ed60 con 0x5618bb3c8520 2024-08-31T06:23:03.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.044+0000 7f8aa77fe640 1 -- 172.21.15.53:0/3377164288 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4005530 con 0x5618bb3c8520 2024-08-31T06:23:03.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.044+0000 7f8ab27fc640 1 -- 172.21.15.53:0/1765089236 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f8ab80e4f50 con 0x7f8abc102800 2024-08-31T06:23:03.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac9960740 1 -- 172.21.15.53:0/3377164288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb3c8520 msgr2=0x5618bb770760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:03.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac1187640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8aa80b4ca0 0x7f8aa80b71b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80e2730 tx=0x7f8ab800de80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:03.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3377164288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb3c8520 0x5618bb770760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4010710 tx=0x7f8ab4010bd0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac9960740 1 -- 172.21.15.53:0/3377164288 shutdown_connections 2024-08-31T06:23:03.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3377164288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3a7840 0x5618bb76e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3377164288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb39f660 0x5618bb76dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3377164288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb3c8520 0x5618bb770760 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac9960740 1 -- 172.21.15.53:0/3377164288 >> 172.21.15.53:0/3377164288 conn(0x5618bb3bc910 msgr2=0x5618bb76bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac9960740 1 -- 172.21.15.53:0/3377164288 shutdown_connections 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac9960740 1 -- 172.21.15.53:0/3377164288 wait complete. 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac9960740 1 -- start start 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.045+0000 7f8ac9960740 1 Processor -- start 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb39f660 0x5618bb77dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb3a7840 0x5618bb77e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb789d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac9960740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618bb7807b0 con 0x5618bb3c8520 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac9960740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5618bb695520 con 0x5618bb39f660 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac9960740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5618bb780930 con 0x5618bb3a7840 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac9960740 10 client.0 _ll_register_callbacks cb 0x5618bb6cdc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac1988640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb789d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac1988640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb789d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53972/0 (socket says 172.21.15.53:53972) 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac1988640 1 -- 172.21.15.53:0/28533344 learned_addr learned my addr 172.21.15.53:0/28533344 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac1988640 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb39f660 0x5618bb77dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac0986640 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb3a7840 0x5618bb77e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac1988640 1 -- 172.21.15.53:0/28533344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb3a7840 msgr2=0x5618bb77e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac1988640 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb3a7840 0x5618bb77e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac1988640 1 -- 172.21.15.53:0/28533344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb39f660 msgr2=0x5618bb77dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac1988640 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb39f660 0x5618bb77dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.046+0000 7f8ac1988640 1 -- 172.21.15.53:0/28533344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618bb4aa960 con 0x5618bb3c8520 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8ac1988640 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb789d20 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4005c10 tx=0x7f8ab40103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e14adcfe6f725f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8aa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/28533344 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4020070 con 0x5618bb3c8520 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/28533344 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f8ab400ece0 con 0x5618bb3c8520 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8ac9960740 1 -- 172.21.15.53:0/28533344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5618bb6739a0 con 0x5618bb3c8520 2024-08-31T06:23:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/28533344 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f8ab4034050 con 0x5618bb3c8520 2024-08-31T06:23:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8ac9960740 10 client.21159 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8ac9960740 1 -- 172.21.15.53:0/28533344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5618bb78c8e0 con 0x5618bb3c8520 2024-08-31T06:23:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/28533344 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5618bb6739a0 con 0x5618bb3c8520 2024-08-31T06:23:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/28533344 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f8ab400f040 con 0x5618bb3c8520 2024-08-31T06:23:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8ac9960740 10 client.21159 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8ac9960740 10 client.21159 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:23:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8ac9960740 20 client.21159 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8ac9960740 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5618bb386ea0 0x5618bb78fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8ac9960740 4 client.21159 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.047+0000 7f8ac9960740 1 -- 172.21.15.53:0/28533344 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618bb6e69c0 con 0x5618bb386ea0 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.048+0000 7f8ac0986640 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5618bb386ea0 0x5618bb78fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.048+0000 7f8ac0986640 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5618bb386ea0 0x5618bb78fd00 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c633aeacbd561f28 server_cookie=2ecc931f366c1743 in_seq=0 out_seq=0 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.048+0000 7f8aa4ff9640 10 client.21159 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.049+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/28533344 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618bb6e69c0 con 0x5618bb386ea0 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.049+0000 7f8aa4ff9640 10 client.21159 handle_command_reply: tid=0 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.049+0000 7f8ac9960740 1 client.21159 shutdown 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8ac9960740 1 -- 172.21.15.53:0/28533344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 msgr2=0x5618bb789d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8ac9960740 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb789d20 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4005c10 tx=0x7f8ab40103d0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8ac9960740 1 -- 172.21.15.53:0/28533344 shutdown_connections 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8ac9960740 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5618bb386ea0 0x5618bb78fd00 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8ac9960740 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb789d20 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8ac9960740 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb3a7840 0x5618bb77e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8ac9960740 1 --2- 172.21.15.53:0/28533344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb39f660 0x5618bb77dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8ac9960740 1 -- 172.21.15.53:0/28533344 >> 172.21.15.53:0/28533344 conn(0x5618bb3bc910 msgr2=0x5618bb76f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:03.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8aa4ff9640 0 client.21159 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:03.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8ac9960740 1 -- 172.21.15.53:0/28533344 shutdown_connections 2024-08-31T06:23:03.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8ac9960740 1 -- 172.21.15.53:0/28533344 wait complete. 2024-08-31T06:23:03.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.050+0000 7f8ac9960740 20 client.21159 trim_cache size 0 max 16384 2024-08-31T06:23:03.074 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.075+0000 7f8ac9960740 1 Processor -- start 2024-08-31T06:23:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.075+0000 7f8ac9960740 1 -- start start 2024-08-31T06:23:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.075+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb39f660 0x5618bb775770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.075+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb3a7840 0x5618bb789c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.075+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb78a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.075+0000 7f8ac9960740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1ad210 con 0x5618bb3c8520 2024-08-31T06:23:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.075+0000 7f8ac9960740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1aedb0 con 0x5618bb3a7840 2024-08-31T06:23:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.075+0000 7f8ac9960740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1ad940 con 0x5618bb39f660 2024-08-31T06:23:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac1988640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb78a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac1988640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb78a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53984/0 (socket says 172.21.15.53:53984) 2024-08-31T06:23:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac1988640 1 -- 172.21.15.53:0/3348294841 learned_addr learned my addr 172.21.15.53:0/3348294841 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac0986640 1 --2- 172.21.15.53:0/3348294841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb3a7840 0x5618bb789c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3348294841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb39f660 0x5618bb775770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac1988640 1 -- 172.21.15.53:0/3348294841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb39f660 msgr2=0x5618bb775770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:03.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3348294841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb39f660 0x5618bb775770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac1988640 1 -- 172.21.15.53:0/3348294841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb3a7840 msgr2=0x5618bb789c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:03.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3348294841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb3a7840 0x5618bb789c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac1988640 1 -- 172.21.15.53:0/3348294841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618bb7734e0 con 0x5618bb3c8520 2024-08-31T06:23:03.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac0986640 1 --2- 172.21.15.53:0/3348294841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb3a7840 0x5618bb789c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:03.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.076+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3348294841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb78a160 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x5618bb770d30 tx=0x7f8ab4010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1b8b55ec43fb74 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:03.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.077+0000 7f8aa6ffd640 1 -- 172.21.15.53:0/3348294841 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4020040 con 0x5618bb3c8520 2024-08-31T06:23:03.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.077+0000 7f8aa6ffd640 1 -- 172.21.15.53:0/3348294841 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ab4027040 con 0x5618bb3c8520 2024-08-31T06:23:03.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.077+0000 7f8aa6ffd640 1 -- 172.21.15.53:0/3348294841 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4012450 con 0x5618bb3c8520 2024-08-31T06:23:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.078+0000 7f8ac9960740 1 -- 172.21.15.53:0/3348294841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 msgr2=0x5618bb78a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.078+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3348294841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb78a160 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x5618bb770d30 tx=0x7f8ab4010bd0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.078+0000 7f8ac9960740 1 -- 172.21.15.53:0/3348294841 shutdown_connections 2024-08-31T06:23:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.078+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3348294841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb78a160 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.078+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3348294841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb3a7840 0x5618bb789c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.078+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3348294841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb39f660 0x5618bb775770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.078+0000 7f8ac9960740 1 -- 172.21.15.53:0/3348294841 >> 172.21.15.53:0/3348294841 conn(0x5618bb3bc910 msgr2=0x5618bb77dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.078+0000 7f8ac9960740 1 -- 172.21.15.53:0/3348294841 shutdown_connections 2024-08-31T06:23:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.078+0000 7f8ac9960740 1 -- 172.21.15.53:0/3348294841 wait complete. 2024-08-31T06:23:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.079+0000 7f8ac9960740 1 -- start start 2024-08-31T06:23:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.079+0000 7f8ac9960740 1 Processor -- start 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.079+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb39f660 0x5618bb785e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.079+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb3a7840 0x5618bb786440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac9960740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb794290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac9960740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1ae6e0 con 0x5618bb3c8520 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac9960740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1ae010 con 0x5618bb3a7840 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac9960740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1ab210 con 0x5618bb39f660 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac9960740 10 client.0 _ll_register_callbacks cb 0x7f8ab4016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac1988640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb794290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac1988640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb794290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53990/0 (socket says 172.21.15.53:53990) 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac1988640 1 -- 172.21.15.53:0/3969699325 learned_addr learned my addr 172.21.15.53:0/3969699325 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac0986640 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb3a7840 0x5618bb786440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb39f660 0x5618bb785e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac1988640 1 -- 172.21.15.53:0/3969699325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb39f660 msgr2=0x5618bb785e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb39f660 0x5618bb785e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac1988640 1 -- 172.21.15.53:0/3969699325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb3a7840 msgr2=0x5618bb786440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb3a7840 0x5618bb786440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac1988640 1 -- 172.21.15.53:0/3969699325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618bb790070 con 0x5618bb3c8520 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8ac1988640 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb794290 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40104b0 tx=0x7f8ab40049a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2e8338509b4d40 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.080+0000 7f8aa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.081+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/3969699325 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab404b060 con 0x5618bb3c8520 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.081+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/3969699325 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f8ab4005220 con 0x5618bb3c8520 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.081+0000 7f8ac9960740 1 -- 172.21.15.53:0/3969699325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ab4027040 con 0x5618bb3c8520 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.081+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/3969699325 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f8ab4020040 con 0x5618bb3c8520 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.081+0000 7f8ac9960740 10 client.21165 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.081+0000 7f8ac9960740 1 -- 172.21.15.53:0/3969699325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5618bb795a70 con 0x5618bb3c8520 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.081+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/3969699325 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ab4027040 con 0x5618bb3c8520 2024-08-31T06:23:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.081+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/3969699325 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f8ab4045030 con 0x5618bb3c8520 2024-08-31T06:23:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.082+0000 7f8ac9960740 10 client.21165 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.082+0000 7f8ac9960740 10 client.21165 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:23:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.082+0000 7f8ac9960740 20 client.21165 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.082+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5618bb35c250 0x5618bb7fd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.082+0000 7f8ac9960740 4 client.21165 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cab2cb4e", "release": true, "await": true}] 2024-08-31T06:23:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.082+0000 7f8ac9960740 1 -- 172.21.15.53:0/3969699325 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cab2cb4e", "release": true, "await": true}) -- 0x5618bb6e2460 con 0x5618bb35c250 2024-08-31T06:23:03.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.082+0000 7f8ac0986640 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5618bb35c250 0x5618bb7fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:03.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.083+0000 7f8aa4ff9640 10 client.21165 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:03.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.083+0000 7f8ac0986640 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5618bb35c250 0x5618bb7fd4c0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96b9179c48984ee3 server_cookie=ed7ecc1d891ddec6 in_seq=0 out_seq=0 2024-08-31T06:23:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8aa4ff9640 1 -- 172.21.15.53:0/3969699325 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5618bb6e2460 con 0x5618bb35c250 2024-08-31T06:23:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8aa4ff9640 10 client.21165 handle_command_reply: tid=0 2024-08-31T06:23:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8ac9960740 1 client.21165 shutdown 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8ac9960740 1 -- 172.21.15.53:0/3969699325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 msgr2=0x5618bb794290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb794290 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40104b0 tx=0x7f8ab40049a0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8ac9960740 1 -- 172.21.15.53:0/3969699325 shutdown_connections 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5618bb35c250 0x5618bb7fd4c0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618bb3c8520 0x5618bb794290 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8aa4ff9640 0 client.21165 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5618bb3a7840 0x5618bb786440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8ac9960740 1 --2- 172.21.15.53:0/3969699325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5618bb39f660 0x5618bb785e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.222+0000 7f8ac9960740 1 -- 172.21.15.53:0/3969699325 >> 172.21.15.53:0/3969699325 conn(0x5618bb3bc910 msgr2=0x5618bb77dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.223+0000 7f8ac9960740 1 -- 172.21.15.53:0/3969699325 shutdown_connections 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.223+0000 7f8ac9960740 1 -- 172.21.15.53:0/3969699325 wait complete. 2024-08-31T06:23:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.223+0000 7f8ac9960740 20 client.21165 trim_cache size 0 max 16384 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 66, 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 60, 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout: "cab2cb4e": { 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 60, 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:23:03.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 151.7, 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:03.229 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:03.230 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:23:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.223+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1765089236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8aa80b4ca0 msgr2=0x7f8aa80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.223+0000 7f8ac33eb640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8aa80b4ca0 0x7f8aa80b71b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80e2730 tx=0x7f8ab800de80 comp rx=0 tx=0).stop 2024-08-31T06:23:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.223+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1765089236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc102800 msgr2=0x7f8abc199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.223+0000 7f8ac33eb640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc102800 0x7f8abc199080 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800d770 tx=0x7f8ab800dc30 comp rx=0 tx=0).stop 2024-08-31T06:23:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.224+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1765089236 shutdown_connections 2024-08-31T06:23:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.224+0000 7f8ac33eb640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8aa80b4ca0 0x7f8aa80b71b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.224+0000 7f8ac33eb640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc108a90 0x7f8abc19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.224+0000 7f8ac33eb640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8abc108140 0x7f8abc199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.224+0000 7f8ac33eb640 1 --2- 172.21.15.53:0/1765089236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8abc102800 0x7f8abc199080 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.224+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1765089236 >> 172.21.15.53:0/1765089236 conn(0x7f8abc0794d0 msgr2=0x7f8abc105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.224+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1765089236 shutdown_connections 2024-08-31T06:23:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:03.224+0000 7f8ac33eb640 1 -- 172.21.15.53:0/1765089236 wait complete. 2024-08-31T06:23:03.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30208 5.05 MB/sec execute 171 sec latency 32522.845 ms 2024-08-31T06:23:04.132 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'cab2cb4e', total seconds elapsed: 36.4 2024-08-31T06:23:04.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30341 5.05 MB/sec execute 172 sec latency 32556.574 ms 2024-08-31T06:23:04.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.376+0000 7f0340d57640 1 -- 172.21.15.53:0/83562692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f033c10dbd0 msgr2=0x7f033c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:04.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.376+0000 7f0340d57640 1 --2- 172.21.15.53:0/83562692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f033c10dbd0 0x7f033c1100a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0334009ca0 tx=0x7f033402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.376+0000 7f0340d57640 1 -- 172.21.15.53:0/83562692 shutdown_connections 2024-08-31T06:23:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.376+0000 7f0340d57640 1 --2- 172.21.15.53:0/83562692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f033c10dbd0 0x7f033c1100a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.376+0000 7f0340d57640 1 --2- 172.21.15.53:0/83562692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c105050 0x7f033c10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.376+0000 7f0340d57640 1 --2- 172.21.15.53:0/83562692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f033c104620 0x7f033c104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.376+0000 7f0340d57640 1 -- 172.21.15.53:0/83562692 >> 172.21.15.53:0/83562692 conn(0x7f033c0794d0 msgr2=0x7f033c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.376+0000 7f0340d57640 1 -- 172.21.15.53:0/83562692 shutdown_connections 2024-08-31T06:23:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.376+0000 7f0340d57640 1 -- 172.21.15.53:0/83562692 wait complete. 2024-08-31T06:23:04.380 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:04 smithi053 ceph-mon[18924]: pgmap v890: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 KiB/s wr, 16 op/s 2024-08-31T06:23:04.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.377+0000 7f0340d57640 1 Processor -- start 2024-08-31T06:23:04.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f0340d57640 1 -- start start 2024-08-31T06:23:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f0340d57640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c104620 0x7f033c19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f0340d57640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f033c105050 0x7f033c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f0340d57640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f033c10dbd0 0x7f033c19f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f0340d57640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f033c1137b0 con 0x7f033c104620 2024-08-31T06:23:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f0340d57640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f033c113630 con 0x7f033c105050 2024-08-31T06:23:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f0340d57640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f033c113930 con 0x7f033c10dbd0 2024-08-31T06:23:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f0339d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f033c105050 0x7f033c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f0339d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f033c105050 0x7f033c19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33222/0 (socket says 172.21.15.53:33222) 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f033a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c104620 0x7f033c19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f0339d9b640 1 -- 172.21.15.53:0/73267240 learned_addr learned my addr 172.21.15.53:0/73267240 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.378+0000 7f033ad9d640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f033c10dbd0 0x7f033c19f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.379+0000 7f0339d9b640 1 -- 172.21.15.53:0/73267240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f033c10dbd0 msgr2=0x7f033c19f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.379+0000 7f0339d9b640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f033c10dbd0 0x7f033c19f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.379+0000 7f0339d9b640 1 -- 172.21.15.53:0/73267240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c104620 msgr2=0x7f033c19a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.379+0000 7f0339d9b640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c104620 0x7f033c19a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.379+0000 7f0339d9b640 1 -- 172.21.15.53:0/73267240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c19ff20 con 0x7f033c105050 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.379+0000 7f033a59c640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c104620 0x7f033c19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.379+0000 7f033ad9d640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f033c10dbd0 0x7f033c19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.380+0000 7f0339d9b640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f033c105050 0x7f033c19a740 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f033000d770 tx=0x7f033000db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.380+0000 7f032b7fe640 1 -- 172.21.15.53:0/73267240 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330017070 con 0x7f033c105050 2024-08-31T06:23:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.380+0000 7f0340d57640 1 -- 172.21.15.53:0/73267240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033c1a0210 con 0x7f033c105050 2024-08-31T06:23:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.380+0000 7f0340d57640 1 -- 172.21.15.53:0/73267240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033c1a0750 con 0x7f033c105050 2024-08-31T06:23:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.380+0000 7f032b7fe640 1 -- 172.21.15.53:0/73267240 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0330009820 con 0x7f033c105050 2024-08-31T06:23:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.380+0000 7f032b7fe640 1 -- 172.21.15.53:0/73267240 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330017070 con 0x7f033c105050 2024-08-31T06:23:04.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.383+0000 7f03472cc740 1 Processor -- start 2024-08-31T06:23:04.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.383+0000 7f03472cc740 1 -- start start 2024-08-31T06:23:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f03472cc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a0913f070 0x556a094e42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f03472cc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a091161b0 0x556a094e4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f03472cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a0911e390 0x556a094e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f03472cc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556a0945b630 con 0x556a0913f070 2024-08-31T06:23:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f03472cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556a0944abc0 con 0x556a0911e390 2024-08-31T06:23:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f03472cc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556a0944eb70 con 0x556a091161b0 2024-08-31T06:23:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f033a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a091161b0 0x556a094e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f033ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a0913f070 0x556a094e42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f033a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a091161b0 0x556a094e4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:42090/0 (socket says 172.21.15.53:42090) 2024-08-31T06:23:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f033a59c640 1 -- 172.21.15.53:0/3256370778 learned_addr learned my addr 172.21.15.53:0/3256370778 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f033a59c640 1 -- 172.21.15.53:0/3256370778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a0911e390 msgr2=0x556a094e4d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:23:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f033a59c640 1 --2- 172.21.15.53:0/3256370778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a0911e390 0x556a094e4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f033a59c640 1 -- 172.21.15.53:0/3256370778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a0913f070 msgr2=0x556a094e42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f033a59c640 1 --2- 172.21.15.53:0/3256370778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a0913f070 0x556a094e42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f032b7fe640 1 -- 172.21.15.53:0/73267240 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0330005220 con 0x7f033c105050 2024-08-31T06:23:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.384+0000 7f033a59c640 1 -- 172.21.15.53:0/3256370778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a091aa650 con 0x556a091161b0 2024-08-31T06:23:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.385+0000 7f033a59c640 1 --2- 172.21.15.53:0/3256370778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a091161b0 0x556a094e4800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f032c009e00 tx=0x7f032c00e5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=849c00dc298b2729 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:04.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.385+0000 7f0328ff9640 1 -- 172.21.15.53:0/3256370778 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c017070 con 0x556a091161b0 2024-08-31T06:23:04.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.385+0000 7f0328ff9640 1 -- 172.21.15.53:0/3256370778 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f032c013900 con 0x556a091161b0 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.385+0000 7f0328ff9640 1 -- 172.21.15.53:0/3256370778 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0127c0 con 0x556a091161b0 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.385+0000 7f032b7fe640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03240b50a0 0x7f03240b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.386+0000 7f032b7fe640 1 -- 172.21.15.53:0/73267240 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f0330005020 con 0x7f033c105050 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.386+0000 7f033ad9d640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03240b50a0 0x7f03240b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.386+0000 7f03472cc740 1 -- 172.21.15.53:0/3256370778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a091161b0 msgr2=0x556a094e4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.386+0000 7f03472cc740 1 --2- 172.21.15.53:0/3256370778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a091161b0 0x556a094e4800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f032c009e00 tx=0x7f032c00e5a0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.386+0000 7f033ad9d640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03240b50a0 0x7f03240b75b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0334006010 tx=0x7f03340318e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.386+0000 7f03472cc740 1 -- 172.21.15.53:0/3256370778 shutdown_connections 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.387+0000 7f03472cc740 1 --2- 172.21.15.53:0/3256370778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a0911e390 0x556a094e4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.387+0000 7f03472cc740 1 --2- 172.21.15.53:0/3256370778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a091161b0 0x556a094e4800 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.387+0000 7f03472cc740 1 --2- 172.21.15.53:0/3256370778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a0913f070 0x556a094e42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.387+0000 7f03472cc740 1 -- 172.21.15.53:0/3256370778 >> 172.21.15.53:0/3256370778 conn(0x556a09133460 msgr2=0x556a094e21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.387+0000 7f03472cc740 1 -- 172.21.15.53:0/3256370778 shutdown_connections 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.387+0000 7f03472cc740 1 -- 172.21.15.53:0/3256370778 wait complete. 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.387+0000 7f03472cc740 1 -- start start 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.387+0000 7f03472cc740 1 Processor -- start 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f03472cc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f03472cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a0911e390 0x556a094effe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f03472cc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0913f070 0x556a094fbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f03472cc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556a092ad700 con 0x556a091161b0 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f03472cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556a093d1700 con 0x556a0911e390 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f03472cc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556a094f2aa0 con 0x556a0913f070 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f03472cc740 10 client.0 _ll_register_callbacks cb 0x556a09400dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f033ad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0913f070 0x556a094fbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f0339d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a0911e390 0x556a094effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f033ad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0913f070 0x556a094fbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:42102/0 (socket says 172.21.15.53:42102) 2024-08-31T06:23:04.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f0339d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a0911e390 0x556a094effe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33228/0 (socket says 172.21.15.53:33228) 2024-08-31T06:23:04.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.388+0000 7f033ad9d640 1 -- 172.21.15.53:0/1407472660 learned_addr learned my addr 172.21.15.53:0/1407472660 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f033a59c640 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f0339d9b640 1 -- 172.21.15.53:0/1407472660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0913f070 msgr2=0x556a094fbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f0339d9b640 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0913f070 0x556a094fbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f0339d9b640 1 -- 172.21.15.53:0/1407472660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 msgr2=0x556a094efaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f0339d9b640 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094efaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f0339d9b640 1 -- 172.21.15.53:0/1407472660 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a0940a8b0 con 0x556a0911e390 2024-08-31T06:23:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f033a59c640 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:23:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f033ad9d640 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0913f070 0x556a094fbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f0339d9b640 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a0911e390 0x556a094effe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f03300e1e50 tx=0x7f03300e2380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b28ce2dbb4d80cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f0321ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:23:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f0321ffb640 1 -- 172.21.15.53:0/1407472660 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330017070 con 0x556a0911e390 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f03472cc740 1 -- 172.21.15.53:0/1407472660 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f032c013900 con 0x556a0911e390 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f0321ffb640 1 -- 172.21.15.53:0/1407472660 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f03300920b0 con 0x556a0911e390 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f0321ffb640 1 -- 172.21.15.53:0/1407472660 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f0330020070 con 0x556a0911e390 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f03472cc740 10 client.30008 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.389+0000 7f03472cc740 1 -- 172.21.15.53:0/1407472660 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x556a094fe9c0 con 0x556a0911e390 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.390+0000 7f0321ffb640 1 -- 172.21.15.53:0/1407472660 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f032c013900 con 0x556a0911e390 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.390+0000 7f0321ffb640 1 -- 172.21.15.53:0/1407472660 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f03300af270 con 0x556a0911e390 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.390+0000 7f03472cc740 10 client.30008 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.390+0000 7f03472cc740 10 client.30008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.390+0000 7f03472cc740 20 client.30008 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.390+0000 7f03472cc740 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556a090fd9f0 0x556a09501f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.390+0000 7f03472cc740 4 client.30008 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.390+0000 7f03472cc740 1 -- 172.21.15.53:0/1407472660 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a0945d580 con 0x556a090fd9f0 2024-08-31T06:23:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.390+0000 7f033a59c640 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556a090fd9f0 0x556a09501f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.390+0000 7f0321ffb640 10 client.30008 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.391+0000 7f033a59c640 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556a090fd9f0 0x556a09501f40 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b461848e0b21662 server_cookie=21b72c327a9392e in_seq=0 out_seq=0 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f0321ffb640 1 -- 172.21.15.53:0/1407472660 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a0945d580 con 0x556a090fd9f0 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f0321ffb640 10 client.30008 handle_command_reply: tid=0 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f03472cc740 1 client.30008 shutdown 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f03472cc740 1 -- 172.21.15.53:0/1407472660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a0911e390 msgr2=0x556a094effe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f03472cc740 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a0911e390 0x556a094effe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f03300e1e50 tx=0x7f03300e2380 comp rx=0 tx=0).stop 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f03472cc740 1 -- 172.21.15.53:0/1407472660 shutdown_connections 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f03472cc740 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556a090fd9f0 0x556a09501f40 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f03472cc740 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0913f070 0x556a094fbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f0321ffb640 0 client.30008 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f03472cc740 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a0911e390 0x556a094effe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f03472cc740 1 --2- 172.21.15.53:0/1407472660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f03472cc740 1 -- 172.21.15.53:0/1407472660 >> 172.21.15.53:0/1407472660 conn(0x556a09133460 msgr2=0x556a094e7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f03472cc740 1 -- 172.21.15.53:0/1407472660 shutdown_connections 2024-08-31T06:23:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.392+0000 7f03472cc740 1 -- 172.21.15.53:0/1407472660 wait complete. 2024-08-31T06:23:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.393+0000 7f03472cc740 20 client.30008 trim_cache size 0 max 16384 2024-08-31T06:23:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.418+0000 7f03472cc740 1 Processor -- start 2024-08-31T06:23:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.418+0000 7f03472cc740 1 -- start start 2024-08-31T06:23:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f03472cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 0x556a094e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f03472cc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094e7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f033a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 0x556a094e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f03472cc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0911e390 0x556a094ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f033a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 0x556a094e73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33234/0 (socket says 172.21.15.53:33234) 2024-08-31T06:23:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f03472cc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f031c00e860 con 0x556a091161b0 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f03472cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f031c010400 con 0x556a090fd9f0 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f03472cc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f031c00ef90 con 0x556a0911e390 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f033a59c640 1 -- 172.21.15.53:0/3163639605 learned_addr learned my addr 172.21.15.53:0/3163639605 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f033ad9d640 1 --2- 172.21.15.53:0/3163639605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0911e390 0x556a094ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f033a59c640 1 -- 172.21.15.53:0/3163639605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0911e390 msgr2=0x556a094ecc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f033a59c640 1 --2- 172.21.15.53:0/3163639605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0911e390 0x556a094ecc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f0339d9b640 1 --2- 172.21.15.53:0/3163639605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f033a59c640 1 -- 172.21.15.53:0/3163639605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 msgr2=0x556a094e7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f033a59c640 1 --2- 172.21.15.53:0/3163639605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094e7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.419+0000 7f033a59c640 1 -- 172.21.15.53:0/3163639605 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a094eea00 con 0x556a090fd9f0 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.420+0000 7f0339d9b640 1 --2- 172.21.15.53:0/3163639605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094e7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:23:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.420+0000 7f033a59c640 1 --2- 172.21.15.53:0/3163639605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 0x556a094e73c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x556a094e2f40 tx=0x7f032c004640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7c34e7d2fa20487 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:04.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.420+0000 7f0323fff640 1 -- 172.21.15.53:0/3163639605 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c017040 con 0x556a090fd9f0 2024-08-31T06:23:04.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.420+0000 7f0323fff640 1 -- 172.21.15.53:0/3163639605 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f032c013a50 con 0x556a090fd9f0 2024-08-31T06:23:04.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.420+0000 7f0323fff640 1 -- 172.21.15.53:0/3163639605 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c01ca00 con 0x556a090fd9f0 2024-08-31T06:23:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.421+0000 7f03472cc740 1 -- 172.21.15.53:0/3163639605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 msgr2=0x556a094e73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.421+0000 7f03472cc740 1 --2- 172.21.15.53:0/3163639605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 0x556a094e73c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x556a094e2f40 tx=0x7f032c004640 comp rx=0 tx=0).stop 2024-08-31T06:23:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.421+0000 7f03472cc740 1 -- 172.21.15.53:0/3163639605 shutdown_connections 2024-08-31T06:23:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.421+0000 7f03472cc740 1 --2- 172.21.15.53:0/3163639605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0911e390 0x556a094ecc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.421+0000 7f03472cc740 1 --2- 172.21.15.53:0/3163639605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094e7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.421+0000 7f03472cc740 1 --2- 172.21.15.53:0/3163639605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 0x556a094e73c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.421+0000 7f03472cc740 1 -- 172.21.15.53:0/3163639605 >> 172.21.15.53:0/3163639605 conn(0x556a09133460 msgr2=0x556a094efa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.422+0000 7f03472cc740 1 -- 172.21.15.53:0/3163639605 shutdown_connections 2024-08-31T06:23:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.422+0000 7f03472cc740 1 -- 172.21.15.53:0/3163639605 wait complete. 2024-08-31T06:23:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.422+0000 7f03472cc740 1 -- start start 2024-08-31T06:23:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.422+0000 7f03472cc740 1 Processor -- start 2024-08-31T06:23:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f03472cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 0x556a094f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f03472cc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f03472cc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0911e390 0x556a094f4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f03472cc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f031c00fd30 con 0x556a091161b0 2024-08-31T06:23:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f03472cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f031c00f660 con 0x556a090fd9f0 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f03472cc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f031c00c860 con 0x556a0911e390 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f03472cc740 10 client.0 _ll_register_callbacks cb 0x7f033000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f0339d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f0339d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52470/0 (socket says 172.21.15.53:52470) 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f0339d9b640 1 -- 172.21.15.53:0/1622972365 learned_addr learned my addr 172.21.15.53:0/1622972365 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f033a59c640 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 0x556a094f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.423+0000 7f033ad9d640 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0911e390 0x556a094f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.424+0000 7f033a59c640 1 -- 172.21.15.53:0/1622972365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0911e390 msgr2=0x556a094f4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.424+0000 7f033a59c640 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0911e390 0x556a094f4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.424+0000 7f033a59c640 1 -- 172.21.15.53:0/1622972365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 msgr2=0x556a094f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.424+0000 7f033a59c640 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094f3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.424+0000 7f033a59c640 1 -- 172.21.15.53:0/1622972365 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a0956b900 con 0x556a090fd9f0 2024-08-31T06:23:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.424+0000 7f033a59c640 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 0x556a094f87c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x556a094e2f40 tx=0x7f032c013eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c3975540fa68688 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:04.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.424+0000 7f0321ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:23:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.424+0000 7f0321ffb640 1 -- 172.21.15.53:0/1622972365 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c036060 con 0x556a090fd9f0 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.424+0000 7f0321ffb640 1 -- 172.21.15.53:0/1622972365 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8557+0+0 (secure 0 0 0) 0x7f032c0137d0 con 0x556a090fd9f0 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.424+0000 7f03472cc740 1 -- 172.21.15.53:0/1622972365 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f032c013a50 con 0x556a090fd9f0 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f0321ffb640 1 -- 172.21.15.53:0/1622972365 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f032c01c450 con 0x556a090fd9f0 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f03472cc740 10 client.30014 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f03472cc740 1 -- 172.21.15.53:0/1622972365 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x556a0956ca10 con 0x556a090fd9f0 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f0321ffb640 1 -- 172.21.15.53:0/1622972365 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f032c013a50 con 0x556a090fd9f0 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f0321ffb640 1 -- 172.21.15.53:0/1622972365 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f032c031a40 con 0x556a090fd9f0 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f03472cc740 10 client.30014 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f03472cc740 10 client.30014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f03472cc740 20 client.30014 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f03472cc740 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556a0913f070 0x556a0956ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f03472cc740 4 client.30014 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f03472cc740 1 -- 172.21.15.53:0/1622972365 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556a09459020 con 0x556a0913f070 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.425+0000 7f0339d9b640 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556a0913f070 0x556a0956ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.426+0000 7f0321ffb640 10 client.30014 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.426+0000 7f0339d9b640 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556a0913f070 0x556a0956ee50 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=687e0ec0b5fe7892 server_cookie=95b7bddbcd46dab6 in_seq=0 out_seq=0 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f0321ffb640 1 -- 172.21.15.53:0/1622972365 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6818 (crc 0 0 0) 0x556a09459020 con 0x556a0913f070 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f0321ffb640 10 client.30014 handle_command_reply: tid=0 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 1 client.30014 shutdown 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 1 -- 172.21.15.53:0/1622972365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 msgr2=0x556a094f87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 0x556a094f87c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x556a094e2f40 tx=0x7f032c013eb0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 1 -- 172.21.15.53:0/1622972365 shutdown_connections 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556a0913f070 0x556a0956ee50 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556a0911e390 0x556a094f4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f0321ffb640 0 client.30014 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:04.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556a091161b0 0x556a094f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 1 --2- 172.21.15.53:0/1622972365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556a090fd9f0 0x556a094f87c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 1 -- 172.21.15.53:0/1622972365 >> 172.21.15.53:0/1622972365 conn(0x556a09133460 msgr2=0x556a094e73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:04.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 1 -- 172.21.15.53:0/1622972365 shutdown_connections 2024-08-31T06:23:04.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 1 -- 172.21.15.53:0/1622972365 wait complete. 2024-08-31T06:23:04.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.427+0000 7f03472cc740 20 client.30014 trim_cache size 0 max 16384 2024-08-31T06:23:04.434 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:23:04.434 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:23:04.434 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "2fed2c78-e329-4f7b-a695-c06d48d6f6a5", 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.435 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:23:04.436 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.438 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:23:04.439 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.440 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.441 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.442 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:23:04.443 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.445 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:23:04.446 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.447 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.448 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:23:04.448 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:23:04.448 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.448 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:04.448 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:23:04.449 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:23:04.449 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:04.449 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:04.449 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:04.449 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:04.449 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:04.449 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:04.449 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:04.449 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:23:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 -- 172.21.15.53:0/73267240 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03240b50a0 msgr2=0x7f03240b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03240b50a0 0x7f03240b75b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0334006010 tx=0x7f03340318e0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 -- 172.21.15.53:0/73267240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f033c105050 msgr2=0x7f033c19a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f033c105050 0x7f033c19a740 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f033000d770 tx=0x7f033000db70 comp rx=0 tx=0).stop 2024-08-31T06:23:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 -- 172.21.15.53:0/73267240 shutdown_connections 2024-08-31T06:23:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03240b50a0 0x7f03240b75b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f033c10dbd0 0x7f033c19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f033c105050 0x7f033c19a740 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 --2- 172.21.15.53:0/73267240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c104620 0x7f033c19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 -- 172.21.15.53:0/73267240 >> 172.21.15.53:0/73267240 conn(0x7f033c0794d0 msgr2=0x7f033c107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 -- 172.21.15.53:0/73267240 shutdown_connections 2024-08-31T06:23:04.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:04.428+0000 7f0340d57640 1 -- 172.21.15.53:0/73267240 wait complete. 2024-08-31T06:23:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:04 smithi130 ceph-mon[22266]: pgmap v890: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 KiB/s wr, 16 op/s 2024-08-31T06:23:04.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:04 smithi153 ceph-mon[22320]: pgmap v890: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 KiB/s wr, 16 op/s 2024-08-31T06:23:05.267 INFO:tasks.cephfs.filesystem:scrub status for tag:2fed2c78-e329-4f7b-a695-c06d48d6f6a5 - {'path': '/', 'tag': '2fed2c78-e329-4f7b-a695-c06d48d6f6a5', 'options': 'recursive,force'} 2024-08-31T06:23:05.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30512 5.08 MB/sec execute 173 sec latency 66.482 ms 2024-08-31T06:23:06.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30659 5.08 MB/sec execute 174 sec latency 55.446 ms 2024-08-31T06:23:06.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:06 smithi153 ceph-mon[22320]: pgmap v891: 97 pgs: 97 active+clean; 596 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 211 KiB/s wr, 54 op/s 2024-08-31T06:23:06.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:06 smithi053 ceph-mon[18924]: pgmap v891: 97 pgs: 97 active+clean; 596 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 211 KiB/s wr, 54 op/s 2024-08-31T06:23:06.880 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:06 smithi130 ceph-mon[22266]: pgmap v891: 97 pgs: 97 active+clean; 596 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 211 KiB/s wr, 54 op/s 2024-08-31T06:23:07.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 30817 5.09 MB/sec execute 175 sec latency 71.472 ms 2024-08-31T06:23:07.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:07 smithi153 ceph-mon[22320]: osdmap e99: 12 total, 12 up, 12 in 2024-08-31T06:23:07.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:07 smithi153 ceph-mon[22320]: pgmap v893: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 526 KiB/s wr, 88 op/s 2024-08-31T06:23:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:07 smithi053 ceph-mon[18924]: osdmap e99: 12 total, 12 up, 12 in 2024-08-31T06:23:07.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:07 smithi053 ceph-mon[18924]: pgmap v893: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 526 KiB/s wr, 88 op/s 2024-08-31T06:23:07.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:07 smithi130 ceph-mon[22266]: osdmap e99: 12 total, 12 up, 12 in 2024-08-31T06:23:07.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:07 smithi130 ceph-mon[22266]: pgmap v893: 97 pgs: 97 active+clean; 598 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 526 KiB/s wr, 88 op/s 2024-08-31T06:23:08.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 31000 5.12 MB/sec execute 176 sec latency 62.942 ms 2024-08-31T06:23:09.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 31155 5.14 MB/sec execute 177 sec latency 56.491 ms 2024-08-31T06:23:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:09 smithi130 ceph-mon[22266]: pgmap v894: 97 pgs: 97 active+clean; 602 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-08-31T06:23:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:09 smithi153 ceph-mon[22320]: pgmap v894: 97 pgs: 97 active+clean; 602 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-08-31T06:23:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:09 smithi053 ceph-mon[18924]: pgmap v894: 97 pgs: 97 active+clean; 602 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-08-31T06:23:10.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 31311 5.15 MB/sec execute 178 sec latency 70.773 ms 2024-08-31T06:23:11.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 31474 5.17 MB/sec execute 179 sec latency 59.271 ms 2024-08-31T06:23:12.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:11 smithi130 ceph-mon[22266]: pgmap v895: 97 pgs: 97 active+clean; 611 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 2.4 MiB/s wr, 226 op/s 2024-08-31T06:23:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:11 smithi153 ceph-mon[22320]: pgmap v895: 97 pgs: 97 active+clean; 611 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 2.4 MiB/s wr, 226 op/s 2024-08-31T06:23:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:11 smithi053 ceph-mon[18924]: pgmap v895: 97 pgs: 97 active+clean; 611 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 2.4 MiB/s wr, 226 op/s 2024-08-31T06:23:12.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 31645 5.18 MB/sec execute 180 sec latency 122.884 ms 2024-08-31T06:23:13.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 31816 5.23 MB/sec execute 181 sec latency 52.489 ms 2024-08-31T06:23:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.443+0000 7f4061957640 1 -- 172.21.15.53:0/928570402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f405c104f60 msgr2=0x7f405c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.443+0000 7f4061957640 1 --2- 172.21.15.53:0/928570402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f405c104f60 0x7f405c10d5f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4050009860 tx=0x7f405002a340 comp rx=0 tx=0).stop 2024-08-31T06:23:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.443+0000 7f4061957640 1 -- 172.21.15.53:0/928570402 shutdown_connections 2024-08-31T06:23:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.443+0000 7f4061957640 1 --2- 172.21.15.53:0/928570402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f405c10db30 0x7f405c110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.443+0000 7f4061957640 1 --2- 172.21.15.53:0/928570402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f405c104f60 0x7f405c10d5f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.443+0000 7f4061957640 1 --2- 172.21.15.53:0/928570402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f405c104580 0x7f405c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.443+0000 7f4061957640 1 -- 172.21.15.53:0/928570402 >> 172.21.15.53:0/928570402 conn(0x7f405c07a4e0 msgr2=0x7f405c07a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.443+0000 7f4061957640 1 -- 172.21.15.53:0/928570402 shutdown_connections 2024-08-31T06:23:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.443+0000 7f4061957640 1 -- 172.21.15.53:0/928570402 wait complete. 2024-08-31T06:23:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.444+0000 7f4061957640 1 Processor -- start 2024-08-31T06:23:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.444+0000 7f4061957640 1 -- start start 2024-08-31T06:23:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f4061957640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f405c104580 0x7f405c19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f4061957640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f405c104f60 0x7f405c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f4061957640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f405c10db30 0x7f405c19f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f4061957640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f405c1135f0 con 0x7f405c10db30 2024-08-31T06:23:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f4061957640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f405c113470 con 0x7f405c104f60 2024-08-31T06:23:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f4061957640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f405c113770 con 0x7f405c104580 2024-08-31T06:23:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f405a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f405c104f60 0x7f405c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f405affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f405c104580 0x7f405c19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f405a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f405c104f60 0x7f405c19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43004/0 (socket says 172.21.15.53:43004) 2024-08-31T06:23:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f405a7fc640 1 -- 172.21.15.53:0/537621663 learned_addr learned my addr 172.21.15.53:0/537621663 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f405b7fe640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f405c10db30 0x7f405c19f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f405a7fc640 1 -- 172.21.15.53:0/537621663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f405c104580 msgr2=0x7f405c19a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f405a7fc640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f405c104580 0x7f405c19a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f405a7fc640 1 -- 172.21.15.53:0/537621663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f405c10db30 msgr2=0x7f405c19f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f405a7fc640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f405c10db30 0x7f405c19f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.445+0000 7f405a7fc640 1 -- 172.21.15.53:0/537621663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c19ffb0 con 0x7f405c104f60 2024-08-31T06:23:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.446+0000 7f405a7fc640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f405c104f60 0x7f405c19a6b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4050035040 tx=0x7f4050030ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.446+0000 7f4060955640 1 -- 172.21.15.53:0/537621663 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050037040 con 0x7f405c104f60 2024-08-31T06:23:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.446+0000 7f4061957640 1 -- 172.21.15.53:0/537621663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405c1a0240 con 0x7f405c104f60 2024-08-31T06:23:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.446+0000 7f4060955640 1 -- 172.21.15.53:0/537621663 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4050032df0 con 0x7f405c104f60 2024-08-31T06:23:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.446+0000 7f4060955640 1 -- 172.21.15.53:0/537621663 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40500035f0 con 0x7f405c104f60 2024-08-31T06:23:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.446+0000 7f4061957640 1 -- 172.21.15.53:0/537621663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405c1a06d0 con 0x7f405c104f60 2024-08-31T06:23:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.449+0000 7f40688c4740 1 Processor -- start 2024-08-31T06:23:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.449+0000 7f40688c4740 1 -- start start 2024-08-31T06:23:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.449+0000 7f4060955640 1 -- 172.21.15.53:0/537621663 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4050043020 con 0x7f405c104f60 2024-08-31T06:23:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.449+0000 7f40688c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb511b0 0x55cfefef4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.449+0000 7f40688c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfefef5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.449+0000 7f40688c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 0x55cfefef5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f40688c4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cfefe6a000 con 0x55cfefb304d0 2024-08-31T06:23:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f40688c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cfefe59590 con 0x55cfefb282f0 2024-08-31T06:23:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f40688c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cfefe5d540 con 0x55cfefb511b0 2024-08-31T06:23:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f405b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb511b0 0x55cfefef4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f405b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb511b0 0x55cfefef4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:43166/0 (socket says 172.21.15.53:43166) 2024-08-31T06:23:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f405a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 0x55cfefef5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f405b7fe640 1 -- 172.21.15.53:0/2792915354 learned_addr learned my addr 172.21.15.53:0/2792915354 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f405affd640 1 --2- 172.21.15.53:0/2792915354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfefef5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f405b7fe640 1 -- 172.21.15.53:0/2792915354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 msgr2=0x55cfefef5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f405b7fe640 1 --2- 172.21.15.53:0/2792915354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfefef5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f405b7fe640 1 -- 172.21.15.53:0/2792915354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 msgr2=0x55cfefef5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f405b7fe640 1 --2- 172.21.15.53:0/2792915354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 0x55cfefef5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f405b7fe640 1 -- 172.21.15.53:0/2792915354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfefbbc790 con 0x55cfefb511b0 2024-08-31T06:23:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.450+0000 7f405b7fe640 1 --2- 172.21.15.53:0/2792915354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb511b0 0x55cfefef4ce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4054007f70 tx=0x7f405400f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37ca70f13850f6d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.451+0000 7f4041ffb640 1 -- 172.21.15.53:0/2792915354 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054010900 con 0x55cfefb511b0 2024-08-31T06:23:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.451+0000 7f4060955640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40440b4ca0 0x7f40440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.451+0000 7f4041ffb640 1 -- 172.21.15.53:0/2792915354 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4054014070 con 0x55cfefb511b0 2024-08-31T06:23:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.451+0000 7f4041ffb640 1 -- 172.21.15.53:0/2792915354 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054017c10 con 0x55cfefb511b0 2024-08-31T06:23:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.451+0000 7f405affd640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40440b4ca0 0x7f40440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.451+0000 7f4060955640 1 -- 172.21.15.53:0/537621663 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8601+0+0 (secure 0 0 0) 0x7f4050104a70 con 0x7f405c104f60 2024-08-31T06:23:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.452+0000 7f40688c4740 1 -- 172.21.15.53:0/2792915354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb511b0 msgr2=0x55cfefef4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.452+0000 7f405affd640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40440b4ca0 0x7f40440b71b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x55cfefef3960 tx=0x7f404c009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.452+0000 7f40688c4740 1 --2- 172.21.15.53:0/2792915354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb511b0 0x55cfefef4ce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4054007f70 tx=0x7f405400f850 comp rx=0 tx=0).stop 2024-08-31T06:23:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.452+0000 7f40688c4740 1 -- 172.21.15.53:0/2792915354 shutdown_connections 2024-08-31T06:23:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.452+0000 7f40688c4740 1 --2- 172.21.15.53:0/2792915354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 0x55cfefef5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.452+0000 7f40688c4740 1 --2- 172.21.15.53:0/2792915354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfefef5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.452+0000 7f40688c4740 1 --2- 172.21.15.53:0/2792915354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb511b0 0x55cfefef4ce0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.452+0000 7f40688c4740 1 -- 172.21.15.53:0/2792915354 >> 172.21.15.53:0/2792915354 conn(0x55cfefb45300 msgr2=0x55cfefef2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.452+0000 7f40688c4740 1 -- 172.21.15.53:0/2792915354 shutdown_connections 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.452+0000 7f40688c4740 1 -- 172.21.15.53:0/2792915354 wait complete. 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.452+0000 7f40688c4740 1 -- start start 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f40688c4740 1 Processor -- start 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f40688c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb282f0 0x55cfeff04c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f40688c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb304d0 0x55cfeff051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f40688c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb511b0 0x55cfeff10bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f405a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb304d0 0x55cfeff051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f405b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb511b0 0x55cfeff10bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f405a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb304d0 0x55cfeff051b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43030/0 (socket says 172.21.15.53:43030) 2024-08-31T06:23:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f405affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb282f0 0x55cfeff04c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f405b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb511b0 0x55cfeff10bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42458/0 (socket says 172.21.15.53:42458) 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f405b7fe640 1 -- 172.21.15.53:0/1408339793 learned_addr learned my addr 172.21.15.53:0/1408339793 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f40688c4740 1 -- 172.21.15.53:0/1408339793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cfefd92ab0 con 0x55cfefb511b0 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f40688c4740 1 -- 172.21.15.53:0/1408339793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cfefde0680 con 0x55cfefb304d0 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.453+0000 7f40688c4740 1 -- 172.21.15.53:0/1408339793 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cfeff07840 con 0x55cfefb282f0 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f405a7fc640 1 -- 172.21.15.53:0/1408339793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb282f0 msgr2=0x55cfeff04c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f405a7fc640 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb282f0 0x55cfeff04c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f405a7fc640 1 -- 172.21.15.53:0/1408339793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb511b0 msgr2=0x55cfeff10bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f405a7fc640 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb511b0 0x55cfeff10bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f405a7fc640 1 -- 172.21.15.53:0/1408339793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfefc35620 con 0x55cfefb304d0 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f405b7fe640 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb511b0 0x55cfeff10bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f40688c4740 10 client.0 _ll_register_callbacks cb 0x55cfefb68a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f40688c4740 1 -- 172.21.15.53:0/1408339793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4054014070 con 0x55cfefb304d0 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f405a7fc640 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb304d0 0x55cfeff051b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4050102110 tx=0x7f4050102680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=707fcf336bfafb07 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f403affd640 10 client.30026 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f403affd640 1 -- 172.21.15.53:0/1408339793 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050104e60 con 0x55cfefb304d0 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.454+0000 7f403affd640 1 -- 172.21.15.53:0/1408339793 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8601+0+0 (secure 0 0 0) 0x7f40500d4150 con 0x55cfefb304d0 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.455+0000 7f403affd640 1 -- 172.21.15.53:0/1408339793 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f40500cae80 con 0x55cfefb304d0 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.455+0000 7f40688c4740 10 client.30026 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.455+0000 7f40688c4740 1 -- 172.21.15.53:0/1408339793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=66}) -- 0x55cfeff134e0 con 0x55cfefb304d0 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.455+0000 7f403affd640 1 -- 172.21.15.53:0/1408339793 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f40500ca310 con 0x55cfefb304d0 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.455+0000 7f40688c4740 10 client.30026 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.455+0000 7f40688c4740 10 client.30026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.455+0000 7f40688c4740 20 client.30026 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.455+0000 7f40688c4740 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cfefb0fd80 0x55cfeff16c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.455+0000 7f40688c4740 4 client.30026 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.455+0000 7f40688c4740 1 -- 172.21.15.53:0/1408339793 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfefe6bf50 con 0x55cfefb0fd80 2024-08-31T06:23:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.455+0000 7f405affd640 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cfefb0fd80 0x55cfeff16c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.456+0000 7f405affd640 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cfefb0fd80 0x55cfeff16c80 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85a7b4bb73f88557 server_cookie=583741b7469b46a1 in_seq=0 out_seq=0 2024-08-31T06:23:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.456+0000 7f403affd640 10 client.30026 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f403affd640 1 -- 172.21.15.53:0/1408339793 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cfefe6bf50 con 0x55cfefb0fd80 2024-08-31T06:23:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f403affd640 10 client.30026 handle_command_reply: tid=0 2024-08-31T06:23:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 1 client.30026 shutdown 2024-08-31T06:23:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 1 -- 172.21.15.53:0/1408339793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb304d0 msgr2=0x55cfeff051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb304d0 0x55cfeff051b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4050102110 tx=0x7f4050102680 comp rx=0 tx=0).stop 2024-08-31T06:23:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 1 -- 172.21.15.53:0/1408339793 shutdown_connections 2024-08-31T06:23:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cfefb0fd80 0x55cfeff16c80 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb511b0 0x55cfeff10bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f403affd640 0 client.30026 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb304d0 0x55cfeff051b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 1 --2- 172.21.15.53:0/1408339793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb282f0 0x55cfeff04c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 1 -- 172.21.15.53:0/1408339793 >> 172.21.15.53:0/1408339793 conn(0x55cfefb45300 msgr2=0x55cfefef7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 1 -- 172.21.15.53:0/1408339793 shutdown_connections 2024-08-31T06:23:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 1 -- 172.21.15.53:0/1408339793 wait complete. 2024-08-31T06:23:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.457+0000 7f40688c4740 20 client.30026 trim_cache size 0 max 16384 2024-08-31T06:23:13.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.478+0000 7f40688c4740 1 Processor -- start 2024-08-31T06:23:13.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.478+0000 7f40688c4740 1 -- start start 2024-08-31T06:23:13.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.479+0000 7f40688c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb0fd80 0x55cfefef8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.479+0000 7f40688c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfeff04f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.479+0000 7f40688c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 0x55cfeff06690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.480+0000 7f40688c4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f405c1ad110 con 0x55cfefb304d0 2024-08-31T06:23:13.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.480+0000 7f405b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 0x55cfeff06690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.480+0000 7f405b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 0x55cfeff06690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42474/0 (socket says 172.21.15.53:42474) 2024-08-31T06:23:13.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.480+0000 7f405b7fe640 1 -- 172.21.15.53:0/3732740750 learned_addr learned my addr 172.21.15.53:0/3732740750 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:13.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.480+0000 7f40688c4740 1 -- 172.21.15.53:0/3732740750 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f405c1aecb0 con 0x55cfefb282f0 2024-08-31T06:23:13.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.480+0000 7f40688c4740 1 -- 172.21.15.53:0/3732740750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f405c1ad840 con 0x55cfefb0fd80 2024-08-31T06:23:13.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.480+0000 7f405b7fe640 1 -- 172.21.15.53:0/3732740750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb0fd80 msgr2=0x55cfefef8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:13.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.480+0000 7f405b7fe640 1 --2- 172.21.15.53:0/3732740750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb0fd80 0x55cfefef8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.480+0000 7f405b7fe640 1 -- 172.21.15.53:0/3732740750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 msgr2=0x55cfeff04f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:23:13.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.480+0000 7f405b7fe640 1 --2- 172.21.15.53:0/3732740750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfeff04f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.480+0000 7f405b7fe640 1 -- 172.21.15.53:0/3732740750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfefef34d0 con 0x55cfefb304d0 2024-08-31T06:23:13.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.481+0000 7f405b7fe640 1 --2- 172.21.15.53:0/3732740750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 0x55cfeff06690 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f4054017860 tx=0x7f40540075b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1b884fcab7be41 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:13.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.481+0000 7f40417fa640 1 -- 172.21.15.53:0/3732740750 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054004c00 con 0x55cfefb304d0 2024-08-31T06:23:13.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.482+0000 7f40417fa640 1 -- 172.21.15.53:0/3732740750 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4054007940 con 0x55cfefb304d0 2024-08-31T06:23:13.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.482+0000 7f40417fa640 1 -- 172.21.15.53:0/3732740750 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054010a60 con 0x55cfefb304d0 2024-08-31T06:23:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.484+0000 7f40688c4740 1 -- 172.21.15.53:0/3732740750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 msgr2=0x55cfeff06690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.484+0000 7f40688c4740 1 --2- 172.21.15.53:0/3732740750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 0x55cfeff06690 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f4054017860 tx=0x7f40540075b0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.484+0000 7f40688c4740 1 -- 172.21.15.53:0/3732740750 shutdown_connections 2024-08-31T06:23:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.484+0000 7f40688c4740 1 --2- 172.21.15.53:0/3732740750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb304d0 0x55cfeff06690 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.484+0000 7f40688c4740 1 --2- 172.21.15.53:0/3732740750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfeff04f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.484+0000 7f40688c4740 1 --2- 172.21.15.53:0/3732740750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb0fd80 0x55cfefef8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.484+0000 7f40688c4740 1 -- 172.21.15.53:0/3732740750 >> 172.21.15.53:0/3732740750 conn(0x55cfefb45300 msgr2=0x55cfeff05f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.484+0000 7f40688c4740 1 -- 172.21.15.53:0/3732740750 shutdown_connections 2024-08-31T06:23:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.484+0000 7f40688c4740 1 -- 172.21.15.53:0/3732740750 wait complete. 2024-08-31T06:23:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.485+0000 7f40688c4740 1 -- start start 2024-08-31T06:23:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.485+0000 7f40688c4740 1 Processor -- start 2024-08-31T06:23:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f40688c4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb0fd80 0x55cfeff085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f40688c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfeff08b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f40688c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb304d0 0x55cfeff0ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f40688c4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f405c1ae5e0 con 0x55cfefb0fd80 2024-08-31T06:23:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f40688c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f405c1adf10 con 0x55cfefb282f0 2024-08-31T06:23:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f40688c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f405c1ab110 con 0x55cfefb304d0 2024-08-31T06:23:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f40688c4740 10 client.0 _ll_register_callbacks cb 0x7f4050005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f405a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfeff08b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f405a7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfeff08b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43042/0 (socket says 172.21.15.53:43042) 2024-08-31T06:23:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f405a7fc640 1 -- 172.21.15.53:0/3737051350 learned_addr learned my addr 172.21.15.53:0/3737051350 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f405affd640 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb0fd80 0x55cfeff085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.487+0000 7f405b7fe640 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb304d0 0x55cfeff0ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.488+0000 7f405a7fc640 1 -- 172.21.15.53:0/3737051350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb304d0 msgr2=0x55cfeff0ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.488+0000 7f405a7fc640 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb304d0 0x55cfeff0ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.488+0000 7f405a7fc640 1 -- 172.21.15.53:0/3737051350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb0fd80 msgr2=0x55cfeff085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.488+0000 7f405a7fc640 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb0fd80 0x55cfeff085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.488+0000 7f405a7fc640 1 -- 172.21.15.53:0/3737051350 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfeff0d0a0 con 0x55cfefb282f0 2024-08-31T06:23:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.488+0000 7f405b7fe640 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb304d0 0x55cfeff0ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:23:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.489+0000 7f405a7fc640 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfeff08b80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f40500cb040 tx=0x7f4050106ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8c5aa386f40d824 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.489+0000 7f403affd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:23:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.489+0000 7f403affd640 1 -- 172.21.15.53:0/3737051350 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050104e60 con 0x55cfefb282f0 2024-08-31T06:23:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.489+0000 7f403affd640 1 -- 172.21.15.53:0/3737051350 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8601+0+0 (secure 0 0 0) 0x7f40500d4150 con 0x55cfefb282f0 2024-08-31T06:23:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.489+0000 7f40688c4740 1 -- 172.21.15.53:0/3737051350 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4054007940 con 0x55cfefb282f0 2024-08-31T06:23:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.490+0000 7f403affd640 1 -- 172.21.15.53:0/3737051350 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f40500ca820 con 0x55cfefb282f0 2024-08-31T06:23:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.490+0000 7f40688c4740 10 client.30029 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.490+0000 7f40688c4740 1 -- 172.21.15.53:0/3737051350 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55cfeff921a0 con 0x55cfefb282f0 2024-08-31T06:23:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.490+0000 7f403affd640 1 -- 172.21.15.53:0/3737051350 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4054007940 con 0x55cfefb282f0 2024-08-31T06:23:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.490+0000 7f403affd640 1 -- 172.21.15.53:0/3737051350 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f40500c9f90 con 0x55cfefb282f0 2024-08-31T06:23:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.490+0000 7f40688c4740 10 client.30029 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.490+0000 7f40688c4740 10 client.30029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.490+0000 7f40688c4740 20 client.30029 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.490+0000 7f40688c4740 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cfefb511b0 0x55cfeff94740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.490+0000 7f40688c4740 4 client.30029 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:23:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.490+0000 7f40688c4740 1 -- 172.21.15.53:0/3737051350 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cfefe679f0 con 0x55cfefb511b0 2024-08-31T06:23:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.491+0000 7f405affd640 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cfefb511b0 0x55cfeff94740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.492+0000 7f403affd640 10 client.30029 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.492+0000 7f405affd640 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cfefb511b0 0x55cfeff94740 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8adb30b44d76e73 server_cookie=b541dfa39a7e16e0 in_seq=0 out_seq=0 2024-08-31T06:23:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.577+0000 7f403affd640 1 -- 172.21.15.53:0/3737051350 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cfefe679f0 con 0x55cfefb511b0 2024-08-31T06:23:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.577+0000 7f403affd640 10 client.30029 handle_command_reply: tid=0 2024-08-31T06:23:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.577+0000 7f40688c4740 1 client.30029 shutdown 2024-08-31T06:23:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f40688c4740 1 -- 172.21.15.53:0/3737051350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 msgr2=0x55cfeff08b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f40688c4740 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfeff08b80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f40500cb040 tx=0x7f4050106ec0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f40688c4740 1 -- 172.21.15.53:0/3737051350 shutdown_connections 2024-08-31T06:23:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f40688c4740 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cfefb511b0 0x55cfeff94740 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f40688c4740 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cfefb304d0 0x55cfeff0ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f40688c4740 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfefb282f0 0x55cfeff08b80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f403affd640 0 client.30029 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f40688c4740 1 --2- 172.21.15.53:0/3737051350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cfefb0fd80 0x55cfeff085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f40688c4740 1 -- 172.21.15.53:0/3737051350 >> 172.21.15.53:0/3737051350 conn(0x55cfefb45300 msgr2=0x55cfefef84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f40688c4740 1 -- 172.21.15.53:0/3737051350 shutdown_connections 2024-08-31T06:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f40688c4740 1 -- 172.21.15.53:0/3737051350 wait complete. 2024-08-31T06:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.578+0000 7f40688c4740 20 client.30029 trim_cache size 0 max 16384 2024-08-31T06:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:23:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 -- 172.21.15.53:0/537621663 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40440b4ca0 msgr2=0x7f40440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40440b4ca0 0x7f40440b71b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x55cfefef3960 tx=0x7f404c009260 comp rx=0 tx=0).stop 2024-08-31T06:23:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 -- 172.21.15.53:0/537621663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f405c104f60 msgr2=0x7f405c19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f405c104f60 0x7f405c19a6b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4050035040 tx=0x7f4050030ce0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 -- 172.21.15.53:0/537621663 shutdown_connections 2024-08-31T06:23:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40440b4ca0 0x7f40440b71b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f405c10db30 0x7f405c19f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f405c104f60 0x7f405c19a6b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 --2- 172.21.15.53:0/537621663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f405c104580 0x7f405c19a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 -- 172.21.15.53:0/537621663 >> 172.21.15.53:0/537621663 conn(0x7f405c07a4e0 msgr2=0x7f405c1007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 -- 172.21.15.53:0/537621663 shutdown_connections 2024-08-31T06:23:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:13.579+0000 7f4061957640 1 -- 172.21.15.53:0/537621663 wait complete. 2024-08-31T06:23:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:13 smithi130 ceph-mon[22266]: pgmap v896: 97 pgs: 97 active+clean; 614 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 3.1 MiB/s wr, 241 op/s 2024-08-31T06:23:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:13 smithi153 ceph-mon[22320]: pgmap v896: 97 pgs: 97 active+clean; 614 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 3.1 MiB/s wr, 241 op/s 2024-08-31T06:23:14.228 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:13 smithi053 ceph-mon[18924]: pgmap v896: 97 pgs: 97 active+clean; 614 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 3.1 MiB/s wr, 241 op/s 2024-08-31T06:23:14.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 31986 5.23 MB/sec execute 182 sec latency 129.010 ms 2024-08-31T06:23:15.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 32145 5.26 MB/sec execute 183 sec latency 52.743 ms 2024-08-31T06:23:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:15 smithi130 ceph-mon[22266]: osdmap e100: 12 total, 12 up, 12 in 2024-08-31T06:23:15.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:15 smithi130 ceph-mon[22266]: pgmap v898: 97 pgs: 97 active+clean; 624 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 313 op/s 2024-08-31T06:23:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:15 smithi153 ceph-mon[22320]: osdmap e100: 12 total, 12 up, 12 in 2024-08-31T06:23:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:15 smithi153 ceph-mon[22320]: pgmap v898: 97 pgs: 97 active+clean; 624 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 313 op/s 2024-08-31T06:23:15.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:15 smithi053 ceph-mon[18924]: osdmap e100: 12 total, 12 up, 12 in 2024-08-31T06:23:15.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:15 smithi053 ceph-mon[18924]: pgmap v898: 97 pgs: 97 active+clean; 624 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 313 op/s 2024-08-31T06:23:16.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 32282 5.26 MB/sec execute 184 sec latency 81.155 ms 2024-08-31T06:23:16.880 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:16 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:23:16.880 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:16 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:23:16.880 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:16 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:23:16.880 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:16 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:23:16.880 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:16 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:23:16.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:16 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:23:16.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:16 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:23:16.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:16 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:23:16.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:16 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:23:16.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:16 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:23:16.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:16 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:23:16.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:16 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:23:16.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:16 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:23:16.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:16 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:23:16.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:16 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:23:17.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 32482 5.33 MB/sec execute 185 sec latency 105.218 ms 2024-08-31T06:23:17.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:17 smithi130 ceph-mon[22266]: pgmap v899: 97 pgs: 97 active+clean; 630 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 342 op/s 2024-08-31T06:23:17.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:17 smithi153 ceph-mon[22320]: pgmap v899: 97 pgs: 97 active+clean; 630 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 342 op/s 2024-08-31T06:23:17.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:17 smithi053 ceph-mon[18924]: pgmap v899: 97 pgs: 97 active+clean; 630 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 342 op/s 2024-08-31T06:23:18.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 32638 5.33 MB/sec execute 186 sec latency 57.534 ms 2024-08-31T06:23:19.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 32812 5.37 MB/sec execute 187 sec latency 52.063 ms 2024-08-31T06:23:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:19 smithi130 ceph-mon[22266]: pgmap v900: 97 pgs: 97 active+clean; 633 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.0 MiB/s wr, 350 op/s 2024-08-31T06:23:20.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:19 smithi153 ceph-mon[22320]: pgmap v900: 97 pgs: 97 active+clean; 633 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.0 MiB/s wr, 350 op/s 2024-08-31T06:23:20.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:19 smithi053 ceph-mon[18924]: pgmap v900: 97 pgs: 97 active+clean; 633 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.0 MiB/s wr, 350 op/s 2024-08-31T06:23:20.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 32953 5.39 MB/sec execute 188 sec latency 51.018 ms 2024-08-31T06:23:21.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 33105 5.39 MB/sec execute 189 sec latency 61.433 ms 2024-08-31T06:23:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:21 smithi130 ceph-mon[22266]: pgmap v901: 97 pgs: 97 active+clean; 643 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 351 op/s 2024-08-31T06:23:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:21 smithi153 ceph-mon[22320]: pgmap v901: 97 pgs: 97 active+clean; 643 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 351 op/s 2024-08-31T06:23:22.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:21 smithi053 ceph-mon[18924]: pgmap v901: 97 pgs: 97 active+clean; 643 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 351 op/s 2024-08-31T06:23:22.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 33281 5.42 MB/sec execute 190 sec latency 59.375 ms 2024-08-31T06:23:23.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 33429 5.43 MB/sec execute 191 sec latency 77.275 ms 2024-08-31T06:23:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:23 smithi130 ceph-mon[22266]: pgmap v902: 97 pgs: 97 active+clean; 643 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 348 op/s 2024-08-31T06:23:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:23 smithi153 ceph-mon[22320]: pgmap v902: 97 pgs: 97 active+clean; 643 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 348 op/s 2024-08-31T06:23:24.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:23 smithi053 ceph-mon[18924]: pgmap v902: 97 pgs: 97 active+clean; 643 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 348 op/s 2024-08-31T06:23:24.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 33589 5.44 MB/sec execute 192 sec latency 120.504 ms 2024-08-31T06:23:25.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 33730 5.46 MB/sec execute 193 sec latency 132.353 ms 2024-08-31T06:23:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:25 smithi130 ceph-mon[22266]: pgmap v903: 97 pgs: 97 active+clean; 648 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 327 op/s 2024-08-31T06:23:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:25 smithi153 ceph-mon[22320]: pgmap v903: 97 pgs: 97 active+clean; 648 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 327 op/s 2024-08-31T06:23:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:25 smithi053 ceph-mon[18924]: pgmap v903: 97 pgs: 97 active+clean; 648 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 327 op/s 2024-08-31T06:23:26.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 33865 5.45 MB/sec execute 194 sec latency 52.574 ms 2024-08-31T06:23:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.718+0000 7fb5127a1640 1 -- 172.21.15.53:0/1309897033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c1080e0 msgr2=0x7fb50c1084f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.718+0000 7fb5127a1640 1 --2- 172.21.15.53:0/1309897033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c1080e0 0x7fb50c1084f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb500009900 tx=0x7fb50002a410 comp rx=0 tx=0).stop 2024-08-31T06:23:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.719+0000 7fb5127a1640 1 -- 172.21.15.53:0/1309897033 shutdown_connections 2024-08-31T06:23:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.719+0000 7fb5127a1640 1 --2- 172.21.15.53:0/1309897033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb50c108a30 0x7fb50c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.719+0000 7fb5127a1640 1 --2- 172.21.15.53:0/1309897033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c1080e0 0x7fb50c1084f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.719+0000 7fb5127a1640 1 --2- 172.21.15.53:0/1309897033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb50c1027b0 0x7fb50c102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.719+0000 7fb5127a1640 1 -- 172.21.15.53:0/1309897033 >> 172.21.15.53:0/1309897033 conn(0x7fb50c0fe1b0 msgr2=0x7fb50c100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.719+0000 7fb5127a1640 1 -- 172.21.15.53:0/1309897033 shutdown_connections 2024-08-31T06:23:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.719+0000 7fb5127a1640 1 -- 172.21.15.53:0/1309897033 wait complete. 2024-08-31T06:23:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.719+0000 7fb5127a1640 1 Processor -- start 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.719+0000 7fb5127a1640 1 -- start start 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.720+0000 7fb5127a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb50c1027b0 0x7fb50c0fe6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.720+0000 7fb5127a1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c1080e0 0x7fb50c0fec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.720+0000 7fb5127a1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb50c108a30 0x7fb50c0ff160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.720+0000 7fb5127a1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c112570 con 0x7fb50c1027b0 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.720+0000 7fb5127a1640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c1123f0 con 0x7fb50c1080e0 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.720+0000 7fb5127a1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c1126f0 con 0x7fb50c108a30 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.720+0000 7fb50bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb50c1027b0 0x7fb50c0fe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.720+0000 7fb50bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb50c1027b0 0x7fb50c0fe6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37394/0 (socket says 172.21.15.53:37394) 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.720+0000 7fb50bfff640 1 -- 172.21.15.53:0/4094559295 learned_addr learned my addr 172.21.15.53:0/4094559295 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.720+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c1080e0 0x7fb50c0fec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.720+0000 7fb510d3e640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb50c108a30 0x7fb50c0ff160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.721+0000 7fb50bfff640 1 -- 172.21.15.53:0/4094559295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb50c108a30 msgr2=0x7fb50c0ff160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.721+0000 7fb50bfff640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb50c108a30 0x7fb50c0ff160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.721+0000 7fb50bfff640 1 -- 172.21.15.53:0/4094559295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c1080e0 msgr2=0x7fb50c0fec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.721+0000 7fb50bfff640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c1080e0 0x7fb50c0fec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.721+0000 7fb50bfff640 1 -- 172.21.15.53:0/4094559295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c1a8410 con 0x7fb50c1027b0 2024-08-31T06:23:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.721+0000 7fb50bfff640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb50c1027b0 0x7fb50c0fe6e0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e9f0 tx=0x7fb4fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.721+0000 7fb5097fa640 1 -- 172.21.15.53:0/4094559295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00cd80 con 0x7fb50c1027b0 2024-08-31T06:23:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.721+0000 7fb5097fa640 1 -- 172.21.15.53:0/4094559295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4fc0054b0 con 0x7fb50c1027b0 2024-08-31T06:23:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.721+0000 7fb5127a1640 1 -- 172.21.15.53:0/4094559295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50c1a8700 con 0x7fb50c1027b0 2024-08-31T06:23:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.721+0000 7fb5097fa640 1 -- 172.21.15.53:0/4094559295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc010430 con 0x7fb50c1027b0 2024-08-31T06:23:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.721+0000 7fb5127a1640 1 -- 172.21.15.53:0/4094559295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb50c1a8c20 con 0x7fb50c1027b0 2024-08-31T06:23:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.725+0000 7fb5097fa640 1 -- 172.21.15.53:0/4094559295 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb4fc0105d0 con 0x7fb50c1027b0 2024-08-31T06:23:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.725+0000 7fb5197e6740 1 Processor -- start 2024-08-31T06:23:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.725+0000 7fb5197e6740 1 -- start start 2024-08-31T06:23:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.725+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdba61b0 0x5589bdf49ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.725+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf4a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.725+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdf4a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.725+0000 7fb5197e6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5589bdebf000 con 0x5589bdb7d2f0 2024-08-31T06:23:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.725+0000 7fb5197e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5589bdeae590 con 0x5589bdba61b0 2024-08-31T06:23:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.725+0000 7fb5197e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5589bdeb2540 con 0x5589bdb854d0 2024-08-31T06:23:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb510d3e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdba61b0 0x5589bdf49ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb50b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdf4a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb510d3e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdba61b0 0x5589bdf49ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:59078/0 (socket says 172.21.15.53:59078) 2024-08-31T06:23:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb50bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf4a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/3241027573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdf4a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:41476/0 (socket says 172.21.15.53:41476) 2024-08-31T06:23:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb510d3e640 1 -- 172.21.15.53:0/3241027573 learned_addr learned my addr 172.21.15.53:0/3241027573 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb510d3e640 1 -- 172.21.15.53:0/3241027573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 msgr2=0x5589bdf4a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb510d3e640 1 --2- 172.21.15.53:0/3241027573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdf4a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb510d3e640 1 -- 172.21.15.53:0/3241027573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 msgr2=0x5589bdf4a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb510d3e640 1 --2- 172.21.15.53:0/3241027573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf4a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb510d3e640 1 -- 172.21.15.53:0/3241027573 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589bdc11790 con 0x5589bdba61b0 2024-08-31T06:23:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/3241027573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdf4a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb5097fa640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4f40b4d50 0x7fb4f40b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb510d3e640 1 --2- 172.21.15.53:0/3241027573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdba61b0 0x5589bdf49ce0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb504011440 tx=0x7fb504011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df3a3957d23010e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:26.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.726+0000 7fb50bfff640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4f40b4d50 0x7fb4f40b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.727+0000 7fb4f27fc640 1 -- 172.21.15.53:0/3241027573 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504004d20 con 0x5589bdba61b0 2024-08-31T06:23:26.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.727+0000 7fb4f27fc640 1 -- 172.21.15.53:0/3241027573 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb504004050 con 0x5589bdba61b0 2024-08-31T06:23:26.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.727+0000 7fb4f27fc640 1 -- 172.21.15.53:0/3241027573 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50400f780 con 0x5589bdba61b0 2024-08-31T06:23:26.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.727+0000 7fb5097fa640 1 -- 172.21.15.53:0/4094559295 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fb4fc0e5810 con 0x7fb50c1027b0 2024-08-31T06:23:26.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.728+0000 7fb5197e6740 1 -- 172.21.15.53:0/3241027573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdba61b0 msgr2=0x5589bdf49ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:26.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.728+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3241027573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdba61b0 0x5589bdf49ce0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb504011440 tx=0x7fb504011900 comp rx=0 tx=0).stop 2024-08-31T06:23:26.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.728+0000 7fb50bfff640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4f40b4d50 0x7fb4f40b7260 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0e2ff0 tx=0x7fb4fc0eb550 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:26.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.728+0000 7fb5197e6740 1 -- 172.21.15.53:0/3241027573 shutdown_connections 2024-08-31T06:23:26.734 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.728+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3241027573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdf4a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.728+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3241027573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf4a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.728+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3241027573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdba61b0 0x5589bdf49ce0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.728+0000 7fb5197e6740 1 -- 172.21.15.53:0/3241027573 >> 172.21.15.53:0/3241027573 conn(0x5589bdb9a300 msgr2=0x5589bdf47bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.728+0000 7fb5197e6740 1 -- 172.21.15.53:0/3241027573 shutdown_connections 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.728+0000 7fb5197e6740 1 -- 172.21.15.53:0/3241027573 wait complete. 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.728+0000 7fb5197e6740 1 -- start start 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb5197e6740 1 Processor -- start 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb7d2f0 0x5589bdf55880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdf55dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdba61b0 0x5589bdf617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb5197e6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5589bdde7ab0 con 0x5589bdba61b0 2024-08-31T06:23:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb5197e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5589bde35680 con 0x5589bdb7d2f0 2024-08-31T06:23:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb5197e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5589bdf58460 con 0x5589bdb854d0 2024-08-31T06:23:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb5197e6740 10 client.0 _ll_register_callbacks cb 0x5589bdbbda00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb510d3e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb7d2f0 0x5589bdf55880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb510d3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdba61b0 0x5589bdf617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb510d3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdba61b0 0x5589bdf617b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37406/0 (socket says 172.21.15.53:37406) 2024-08-31T06:23:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.729+0000 7fb510d3e640 1 -- 172.21.15.53:0/2256298292 learned_addr learned my addr 172.21.15.53:0/2256298292 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.730+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdf55dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.730+0000 7fb510d3e640 1 -- 172.21.15.53:0/2256298292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 msgr2=0x5589bdf55dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.730+0000 7fb510d3e640 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdf55dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.730+0000 7fb510d3e640 1 -- 172.21.15.53:0/2256298292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdba61b0 msgr2=0x5589bdf617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.730+0000 7fb510d3e640 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdba61b0 0x5589bdf617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.730+0000 7fb510d3e640 1 -- 172.21.15.53:0/2256298292 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589bdc8a620 con 0x5589bdb7d2f0 2024-08-31T06:23:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.730+0000 7fb510d3e640 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb7d2f0 0x5589bdf55880 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb5040046e0 tx=0x7fb504000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74414170ff5b7d28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.730+0000 7fb4eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:23:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.730+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/2256298292 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50402b030 con 0x5589bdb7d2f0 2024-08-31T06:23:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.730+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/2256298292 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fb504003c60 con 0x5589bdb7d2f0 2024-08-31T06:23:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.730+0000 7fb5197e6740 1 -- 172.21.15.53:0/2256298292 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb504004050 con 0x5589bdb7d2f0 2024-08-31T06:23:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.731+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/2256298292 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fb504035050 con 0x5589bdb7d2f0 2024-08-31T06:23:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.731+0000 7fb5197e6740 10 client.30041 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.731+0000 7fb5197e6740 1 -- 172.21.15.53:0/2256298292 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5589bdf644b0 con 0x5589bdb7d2f0 2024-08-31T06:23:26.739 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.731+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/2256298292 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb504004050 con 0x5589bdb7d2f0 2024-08-31T06:23:26.739 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.731+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/2256298292 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fb504023030 con 0x5589bdb7d2f0 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.731+0000 7fb5197e6740 10 client.30041 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.731+0000 7fb5197e6740 10 client.30041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.731+0000 7fb5197e6740 20 client.30041 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.731+0000 7fb5197e6740 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589bdb64d80 0x5589bdf67920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.732+0000 7fb5197e6740 4 client.30041 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.732+0000 7fb5197e6740 1 -- 172.21.15.53:0/2256298292 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589bdec0f50 con 0x5589bdb64d80 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.732+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589bdb64d80 0x5589bdf67920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.732+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589bdb64d80 0x5589bdf67920 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2daff1743d987f2 server_cookie=60cd1fa8f2800bbe in_seq=0 out_seq=0 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.732+0000 7fb4eb7fe640 10 client.30041 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.733+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/2256298292 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589bdec0f50 con 0x5589bdb64d80 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.733+0000 7fb4eb7fe640 10 client.30041 handle_command_reply: tid=0 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.733+0000 7fb5197e6740 1 client.30041 shutdown 2024-08-31T06:23:26.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb5197e6740 1 -- 172.21.15.53:0/2256298292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb7d2f0 msgr2=0x5589bdf55880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb5197e6740 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb7d2f0 0x5589bdf55880 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb5040046e0 tx=0x7fb504000f40 comp rx=0 tx=0).stop 2024-08-31T06:23:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb5197e6740 1 -- 172.21.15.53:0/2256298292 shutdown_connections 2024-08-31T06:23:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb5197e6740 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589bdb64d80 0x5589bdf67920 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb5197e6740 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdba61b0 0x5589bdf617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb5197e6740 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdf55dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb4eb7fe640 0 client.30041 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb5197e6740 1 --2- 172.21.15.53:0/2256298292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb7d2f0 0x5589bdf55880 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb5197e6740 1 -- 172.21.15.53:0/2256298292 >> 172.21.15.53:0/2256298292 conn(0x5589bdb9a300 msgr2=0x5589bdf4ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb5197e6740 1 -- 172.21.15.53:0/2256298292 shutdown_connections 2024-08-31T06:23:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb5197e6740 1 -- 172.21.15.53:0/2256298292 wait complete. 2024-08-31T06:23:26.741 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.734+0000 7fb5197e6740 20 client.30041 trim_cache size 0 max 16384 2024-08-31T06:23:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.756+0000 7fb5197e6740 1 Processor -- start 2024-08-31T06:23:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.756+0000 7fb5197e6740 1 -- start start 2024-08-31T06:23:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.756+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb64d80 0x5589bdf4b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.756+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf55b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb854d0 0x5589bdf572a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb5197e6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c1b17c0 con 0x5589bdb7d2f0 2024-08-31T06:23:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb5197e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c1b3360 con 0x5589bdb854d0 2024-08-31T06:23:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb5197e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c1b1ef0 con 0x5589bdb64d80 2024-08-31T06:23:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb50b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf55b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb510d3e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb64d80 0x5589bdf4b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb50b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf55b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37414/0 (socket says 172.21.15.53:37414) 2024-08-31T06:23:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb50b7fe640 1 -- 172.21.15.53:0/3351541942 learned_addr learned my addr 172.21.15.53:0/3351541942 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb510d3e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb64d80 0x5589bdf4b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:41504/0 (socket says 172.21.15.53:41504) 2024-08-31T06:23:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb510d3e640 1 --2- 172.21.15.53:0/3351541942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb854d0 0x5589bdf572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb50b7fe640 1 -- 172.21.15.53:0/3351541942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb64d80 msgr2=0x5589bdf4b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/3351541942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb64d80 0x5589bdf4b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb50b7fe640 1 -- 172.21.15.53:0/3351541942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb854d0 msgr2=0x5589bdf572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/3351541942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb854d0 0x5589bdf572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb50b7fe640 1 -- 172.21.15.53:0/3351541942 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589bdf48570 con 0x5589bdb7d2f0 2024-08-31T06:23:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.757+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/3351541942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf55b50 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fb5000057c0 tx=0x7fb5000058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c23343da5eb3fa0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.759+0000 7fb4f1ffb640 1 -- 172.21.15.53:0/3351541942 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500049070 con 0x5589bdb7d2f0 2024-08-31T06:23:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.759+0000 7fb4f1ffb640 1 -- 172.21.15.53:0/3351541942 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb500031890 con 0x5589bdb7d2f0 2024-08-31T06:23:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.759+0000 7fb4f1ffb640 1 -- 172.21.15.53:0/3351541942 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500035040 con 0x5589bdb7d2f0 2024-08-31T06:23:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.760+0000 7fb5197e6740 1 -- 172.21.15.53:0/3351541942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 msgr2=0x5589bdf55b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.760+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3351541942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf55b50 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fb5000057c0 tx=0x7fb5000058d0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.760+0000 7fb5197e6740 1 -- 172.21.15.53:0/3351541942 shutdown_connections 2024-08-31T06:23:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.760+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3351541942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb854d0 0x5589bdf572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.760+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3351541942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf55b50 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.760+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3351541942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb64d80 0x5589bdf4b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.760+0000 7fb5197e6740 1 -- 172.21.15.53:0/3351541942 >> 172.21.15.53:0/3351541942 conn(0x5589bdb9a300 msgr2=0x5589bdf56b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.760+0000 7fb5197e6740 1 -- 172.21.15.53:0/3351541942 shutdown_connections 2024-08-31T06:23:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.760+0000 7fb5197e6740 1 -- 172.21.15.53:0/3351541942 wait complete. 2024-08-31T06:23:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.761+0000 7fb5197e6740 1 -- start start 2024-08-31T06:23:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.761+0000 7fb5197e6740 1 Processor -- start 2024-08-31T06:23:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.761+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb64d80 0x5589bdf58f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.761+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf59450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb5197e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdfd0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb5197e6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c1b2c90 con 0x5589bdb7d2f0 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb5197e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c1b25c0 con 0x5589bdb64d80 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb5197e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c1af7c0 con 0x5589bdb854d0 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb50b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf59450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb50b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf59450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37420/0 (socket says 172.21.15.53:37420) 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb50b7fe640 1 -- 172.21.15.53:0/3962949605 learned_addr learned my addr 172.21.15.53:0/3962949605 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb510d3e640 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb64d80 0x5589bdf58f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb5197e6740 10 client.0 _ll_register_callbacks cb 0x7fb4fc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb510d3e640 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdfd0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb50b7fe640 1 -- 172.21.15.53:0/3962949605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 msgr2=0x5589bdfd0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdfd0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb50b7fe640 1 -- 172.21.15.53:0/3962949605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb64d80 msgr2=0x5589bdf58f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb64d80 0x5589bdf58f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb50b7fe640 1 -- 172.21.15.53:0/3962949605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589bdf50260 con 0x5589bdb7d2f0 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb510d3e640 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb64d80 0x5589bdf58f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb50b7fe640 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf59450 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fb50002a930 tx=0x7fb500009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb9aa1945ba0c37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.762+0000 7fb4eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.763+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/3962949605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500055070 con 0x5589bdb7d2f0 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.763+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/3962949605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fb500031600 con 0x5589bdb7d2f0 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.763+0000 7fb5197e6740 1 -- 172.21.15.53:0/3962949605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb500031890 con 0x5589bdb7d2f0 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.763+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/3962949605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fb500035070 con 0x5589bdb7d2f0 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.763+0000 7fb5197e6740 10 client.21213 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.763+0000 7fb5197e6740 1 -- 172.21.15.53:0/3962949605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5589bdf41980 con 0x5589bdb7d2f0 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.763+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/3962949605 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb500004410 con 0x5589bdb7d2f0 2024-08-31T06:23:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.764+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/3962949605 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fb50004e860 con 0x5589bdb7d2f0 2024-08-31T06:23:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.764+0000 7fb5197e6740 10 client.21213 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.764+0000 7fb5197e6740 10 client.21213 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.764+0000 7fb5197e6740 20 client.21213 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.764+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589bdba61b0 0x5589bdfd3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.764+0000 7fb5197e6740 4 client.21213 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:23:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.764+0000 7fb5197e6740 1 -- 172.21.15.53:0/3962949605 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fb500031890 con 0x5589bdba61b0 2024-08-31T06:23:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.764+0000 7fb510d3e640 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589bdba61b0 0x5589bdfd3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.764+0000 7fb510d3e640 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589bdba61b0 0x5589bdfd3c40 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1a1d8732a8e2da3 server_cookie=6b887bab6cbe389f in_seq=0 out_seq=0 2024-08-31T06:23:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.764+0000 7fb4eb7fe640 10 client.21213 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:26.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.853+0000 7fb4eb7fe640 1 -- 172.21.15.53:0/3962949605 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fb500031890 con 0x5589bdba61b0 2024-08-31T06:23:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.853+0000 7fb4eb7fe640 10 client.21213 handle_command_reply: tid=0 2024-08-31T06:23:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.853+0000 7fb5197e6740 1 client.21213 shutdown 2024-08-31T06:23:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb5197e6740 1 -- 172.21.15.53:0/3962949605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 msgr2=0x5589bdf59450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf59450 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fb50002a930 tx=0x7fb500009660 comp rx=0 tx=0).stop 2024-08-31T06:23:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb5197e6740 1 -- 172.21.15.53:0/3962949605 shutdown_connections 2024-08-31T06:23:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5589bdba61b0 0x5589bdfd3c40 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589bdb854d0 0x5589bdfd0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589bdb7d2f0 0x5589bdf59450 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb5197e6740 1 --2- 172.21.15.53:0/3962949605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589bdb64d80 0x5589bdf58f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb5197e6740 1 -- 172.21.15.53:0/3962949605 >> 172.21.15.53:0/3962949605 conn(0x5589bdb9a300 msgr2=0x5589bdf4b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb4eb7fe640 0 client.21213 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb5197e6740 1 -- 172.21.15.53:0/3962949605 shutdown_connections 2024-08-31T06:23:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb5197e6740 1 -- 172.21.15.53:0/3962949605 wait complete. 2024-08-31T06:23:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.854+0000 7fb5197e6740 20 client.21213 trim_cache size 0 max 16384 2024-08-31T06:23:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:23:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:23:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:23:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:23:26.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.855+0000 7fb5127a1640 1 -- 172.21.15.53:0/4094559295 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4f40b4d50 msgr2=0x7fb4f40b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:26.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.855+0000 7fb5127a1640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4f40b4d50 0x7fb4f40b7260 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0e2ff0 tx=0x7fb4fc0eb550 comp rx=0 tx=0).stop 2024-08-31T06:23:26.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.855+0000 7fb5127a1640 1 -- 172.21.15.53:0/4094559295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb50c1027b0 msgr2=0x7fb50c0fe6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:26.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.855+0000 7fb5127a1640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb50c1027b0 0x7fb50c0fe6e0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e9f0 tx=0x7fb4fc00edf0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.855+0000 7fb5127a1640 1 -- 172.21.15.53:0/4094559295 shutdown_connections 2024-08-31T06:23:26.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.855+0000 7fb5127a1640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb4f40b4d50 0x7fb4f40b7260 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.855+0000 7fb5127a1640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb50c108a30 0x7fb50c0ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.855+0000 7fb5127a1640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb50c1080e0 0x7fb50c0fec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.861 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.855+0000 7fb5127a1640 1 --2- 172.21.15.53:0/4094559295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb50c1027b0 0x7fb50c0fe6e0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:26.861 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.855+0000 7fb5127a1640 1 -- 172.21.15.53:0/4094559295 >> 172.21.15.53:0/4094559295 conn(0x7fb50c0fe1b0 msgr2=0x7fb50c101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:26.861 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.856+0000 7fb5127a1640 1 -- 172.21.15.53:0/4094559295 shutdown_connections 2024-08-31T06:23:26.861 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:26.856+0000 7fb5127a1640 1 -- 172.21.15.53:0/4094559295 wait complete. 2024-08-31T06:23:27.376 INFO:tasks.workunit.client.0.smithi053.stdout: 10 34029 5.45 MB/sec execute 195 sec latency 95.603 ms 2024-08-31T06:23:28.027 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:27 smithi053 ceph-mon[18924]: pgmap v904: 97 pgs: 97 active+clean; 653 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 345 op/s 2024-08-31T06:23:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:27 smithi130 ceph-mon[22266]: pgmap v904: 97 pgs: 97 active+clean; 653 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 345 op/s 2024-08-31T06:23:28.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:27 smithi153 ceph-mon[22320]: pgmap v904: 97 pgs: 97 active+clean; 653 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 345 op/s 2024-08-31T06:23:28.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 34218 5.49 MB/sec execute 196 sec latency 142.395 ms 2024-08-31T06:23:29.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 34378 5.50 MB/sec execute 197 sec latency 181.138 ms 2024-08-31T06:23:29.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:29 smithi053 ceph-mon[18924]: pgmap v905: 97 pgs: 97 active+clean; 653 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 325 op/s 2024-08-31T06:23:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:29 smithi130 ceph-mon[22266]: pgmap v905: 97 pgs: 97 active+clean; 653 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 325 op/s 2024-08-31T06:23:30.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:29 smithi153 ceph-mon[22320]: pgmap v905: 97 pgs: 97 active+clean; 653 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 325 op/s 2024-08-31T06:23:30.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 34529 5.51 MB/sec execute 198 sec latency 73.408 ms 2024-08-31T06:23:31.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 34669 5.52 MB/sec execute 199 sec latency 76.044 ms 2024-08-31T06:23:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:31 smithi130 ceph-mon[22266]: pgmap v906: 97 pgs: 97 active+clean; 654 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 399 op/s 2024-08-31T06:23:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:31 smithi153 ceph-mon[22320]: pgmap v906: 97 pgs: 97 active+clean; 654 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 399 op/s 2024-08-31T06:23:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:31 smithi053 ceph-mon[18924]: pgmap v906: 97 pgs: 97 active+clean; 654 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 399 op/s 2024-08-31T06:23:32.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 34847 5.55 MB/sec execute 200 sec latency 101.016 ms 2024-08-31T06:23:33.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 35037 5.59 MB/sec execute 201 sec latency 76.329 ms 2024-08-31T06:23:34.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:33 smithi130 ceph-mon[22266]: pgmap v907: 97 pgs: 97 active+clean; 654 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 336 op/s 2024-08-31T06:23:34.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:33 smithi153 ceph-mon[22320]: pgmap v907: 97 pgs: 97 active+clean; 654 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 336 op/s 2024-08-31T06:23:34.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:33 smithi053 ceph-mon[18924]: pgmap v907: 97 pgs: 97 active+clean; 654 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 336 op/s 2024-08-31T06:23:34.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 35199 5.59 MB/sec execute 202 sec latency 142.935 ms 2024-08-31T06:23:35.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:23:35.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 35362 5.62 MB/sec execute 203 sec latency 64.772 ms 2024-08-31T06:23:35.643 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:36.083 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:35 smithi053 ceph-mon[18924]: pgmap v908: 97 pgs: 97 active+clean; 658 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 382 op/s 2024-08-31T06:23:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:35 smithi130 ceph-mon[22266]: pgmap v908: 97 pgs: 97 active+clean; 658 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 382 op/s 2024-08-31T06:23:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:35 smithi153 ceph-mon[22320]: pgmap v908: 97 pgs: 97 active+clean; 658 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 382 op/s 2024-08-31T06:23:36.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.209+0000 7fcb1de22640 1 -- 172.21.15.53:0/4116963467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18102880 msgr2=0x7fcb18102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:36.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.209+0000 7fcb1de22640 1 --2- 172.21.15.53:0/4116963467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18102880 0x7fcb18102c90 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009900 tx=0x7fcb0802a410 comp rx=0 tx=0).stop 2024-08-31T06:23:36.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.209+0000 7fcb1de22640 1 -- 172.21.15.53:0/4116963467 shutdown_connections 2024-08-31T06:23:36.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.209+0000 7fcb1de22640 1 --2- 172.21.15.53:0/4116963467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb18108ac0 0x7fcb1810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.209+0000 7fcb1de22640 1 --2- 172.21.15.53:0/4116963467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb18108170 0x7fcb18108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.209+0000 7fcb1de22640 1 --2- 172.21.15.53:0/4116963467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18102880 0x7fcb18102c90 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.209+0000 7fcb1de22640 1 -- 172.21.15.53:0/4116963467 >> 172.21.15.53:0/4116963467 conn(0x7fcb18079530 msgr2=0x7fcb18079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:36.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.209+0000 7fcb1de22640 1 -- 172.21.15.53:0/4116963467 shutdown_connections 2024-08-31T06:23:36.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.209+0000 7fcb1de22640 1 -- 172.21.15.53:0/4116963467 wait complete. 2024-08-31T06:23:36.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.210+0000 7fcb1de22640 1 Processor -- start 2024-08-31T06:23:36.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.211+0000 7fcb1de22640 1 -- start start 2024-08-31T06:23:36.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.212+0000 7fcb1de22640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb18102880 0x7fcb18197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.212+0000 7fcb1de22640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb18108170 0x7fcb18198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.212+0000 7fcb177fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb18102880 0x7fcb18197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.212+0000 7fcb1de22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18108ac0 0x7fcb1819d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.212+0000 7fcb177fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb18102880 0x7fcb18197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50970/0 (socket says 172.21.15.53:50970) 2024-08-31T06:23:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.212+0000 7fcb177fe640 1 -- 172.21.15.53:0/1938906012 learned_addr learned my addr 172.21.15.53:0/1938906012 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.212+0000 7fcb1de22640 1 -- 172.21.15.53:0/1938906012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18111570 con 0x7fcb18108ac0 2024-08-31T06:23:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.212+0000 7fcb1de22640 1 -- 172.21.15.53:0/1938906012 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181113f0 con 0x7fcb18108170 2024-08-31T06:23:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.212+0000 7fcb1de22640 1 -- 172.21.15.53:0/1938906012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181116f0 con 0x7fcb18102880 2024-08-31T06:23:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.212+0000 7fcb16ffd640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb18108170 0x7fcb18198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.212+0000 7fcb17fff640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18108ac0 0x7fcb1819d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.213+0000 7fcb177fe640 1 -- 172.21.15.53:0/1938906012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb18108170 msgr2=0x7fcb18198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.213+0000 7fcb177fe640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb18108170 0x7fcb18198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.213+0000 7fcb177fe640 1 -- 172.21.15.53:0/1938906012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18108ac0 msgr2=0x7fcb1819d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.213+0000 7fcb177fe640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18108ac0 0x7fcb1819d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.213+0000 7fcb177fe640 1 -- 172.21.15.53:0/1938906012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1819ded0 con 0x7fcb18102880 2024-08-31T06:23:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.213+0000 7fcb177fe640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb18102880 0x7fcb18197f60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcb0802a930 tx=0x7fcb08003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.213+0000 7fcb14ff9640 1 -- 172.21.15.53:0/1938906012 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0803f070 con 0x7fcb18102880 2024-08-31T06:23:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.213+0000 7fcb14ff9640 1 -- 172.21.15.53:0/1938906012 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb0803baf0 con 0x7fcb18102880 2024-08-31T06:23:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.213+0000 7fcb1de22640 1 -- 172.21.15.53:0/1938906012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1819e160 con 0x7fcb18102880 2024-08-31T06:23:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.213+0000 7fcb14ff9640 1 -- 172.21.15.53:0/1938906012 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08035030 con 0x7fcb18102880 2024-08-31T06:23:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.214+0000 7fcb1de22640 1 -- 172.21.15.53:0/1938906012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb181a4920 con 0x7fcb18102880 2024-08-31T06:23:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.217+0000 7fcb14ff9640 1 -- 172.21.15.53:0/1938906012 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcb08042070 con 0x7fcb18102880 2024-08-31T06:23:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.217+0000 7fcb24397740 1 Processor -- start 2024-08-31T06:23:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.217+0000 7fcb24397740 1 -- start start 2024-08-31T06:23:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.217+0000 7fcb24397740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f4515070 0x55d1f48b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.217+0000 7fcb24397740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44ec1b0 0x55d1f48b8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.217+0000 7fcb24397740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44f4390 0x55d1f48ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.217+0000 7fcb24397740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d1f4831630 con 0x55d1f44f4390 2024-08-31T06:23:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.217+0000 7fcb24397740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d1f4820bc0 con 0x55d1f44ec1b0 2024-08-31T06:23:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.217+0000 7fcb24397740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d1f4824b70 con 0x55d1f4515070 2024-08-31T06:23:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb177fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44ec1b0 0x55d1f48b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb17fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f4515070 0x55d1f48b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb17fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f4515070 0x55d1f48b7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50982/0 (socket says 172.21.15.53:50982) 2024-08-31T06:23:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb17fff640 1 -- 172.21.15.53:0/920536525 learned_addr learned my addr 172.21.15.53:0/920536525 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb16ffd640 1 --2- 172.21.15.53:0/920536525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44f4390 0x55d1f48ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb17fff640 1 -- 172.21.15.53:0/920536525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44ec1b0 msgr2=0x55d1f48b8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb17fff640 1 --2- 172.21.15.53:0/920536525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44ec1b0 0x55d1f48b8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb17fff640 1 -- 172.21.15.53:0/920536525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44f4390 msgr2=0x55d1f48ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb17fff640 1 --2- 172.21.15.53:0/920536525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44f4390 0x55d1f48ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb17fff640 1 -- 172.21.15.53:0/920536525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f4580650 con 0x55d1f4515070 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb14ff9640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcb000b4d20 0x7fcb000b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.218+0000 7fcb17fff640 1 --2- 172.21.15.53:0/920536525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f4515070 0x55d1f48b7d20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009ef0 tx=0x7fcb10009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6d61ae849ac3dfa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.219+0000 7fcb17fff640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcb000b4d20 0x7fcb000b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.219+0000 7fcb14ff9640 1 -- 172.21.15.53:0/1938906012 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fcb08105b70 con 0x7fcb18102880 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.219+0000 7fcafdffb640 1 -- 172.21.15.53:0/920536525 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1001a040 con 0x55d1f4515070 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.219+0000 7fcafdffb640 1 -- 172.21.15.53:0/920536525 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb1001b020 con 0x55d1f4515070 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.219+0000 7fcafdffb640 1 -- 172.21.15.53:0/920536525 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10016650 con 0x55d1f4515070 2024-08-31T06:23:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.220+0000 7fcb24397740 1 -- 172.21.15.53:0/920536525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f4515070 msgr2=0x55d1f48b7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.220+0000 7fcb17fff640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcb000b4d20 0x7fcb000b7230 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fcb10003fd0 tx=0x7fcb10004920 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.220+0000 7fcb24397740 1 --2- 172.21.15.53:0/920536525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f4515070 0x55d1f48b7d20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009ef0 tx=0x7fcb10009500 comp rx=0 tx=0).stop 2024-08-31T06:23:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.220+0000 7fcb24397740 1 -- 172.21.15.53:0/920536525 shutdown_connections 2024-08-31T06:23:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.220+0000 7fcb24397740 1 --2- 172.21.15.53:0/920536525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44f4390 0x55d1f48ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.220+0000 7fcb24397740 1 --2- 172.21.15.53:0/920536525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44ec1b0 0x55d1f48b8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.220+0000 7fcb24397740 1 --2- 172.21.15.53:0/920536525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f4515070 0x55d1f48b7d20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.220+0000 7fcb24397740 1 -- 172.21.15.53:0/920536525 >> 172.21.15.53:0/920536525 conn(0x55d1f4509460 msgr2=0x55d1f48ba240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.220+0000 7fcb24397740 1 -- 172.21.15.53:0/920536525 shutdown_connections 2024-08-31T06:23:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.220+0000 7fcb24397740 1 -- 172.21.15.53:0/920536525 wait complete. 2024-08-31T06:23:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.221+0000 7fcb24397740 1 -- start start 2024-08-31T06:23:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.221+0000 7fcb24397740 1 Processor -- start 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb24397740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f44ec1b0 0x55d1f48cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb24397740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44f4390 0x55d1f48cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb24397740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f4515070 0x55d1f48d4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb24397740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d1f4683700 con 0x55d1f4515070 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb24397740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d1f47a7700 con 0x55d1f44f4390 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb24397740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d1f48cb230 con 0x55d1f44ec1b0 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb24397740 10 client.0 _ll_register_callbacks cb 0x55d1f47d6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb16ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44f4390 0x55d1f48cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb16ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44f4390 0x55d1f48cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46890/0 (socket says 172.21.15.53:46890) 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb16ffd640 1 -- 172.21.15.53:0/543877540 learned_addr learned my addr 172.21.15.53:0/543877540 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb17fff640 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f4515070 0x55d1f48d4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.222+0000 7fcb177fe640 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f44ec1b0 0x55d1f48cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.223+0000 7fcb177fe640 1 -- 172.21.15.53:0/543877540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44f4390 msgr2=0x55d1f48cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.223+0000 7fcb177fe640 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44f4390 0x55d1f48cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.223+0000 7fcb177fe640 1 -- 172.21.15.53:0/543877540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f4515070 msgr2=0x55d1f48d4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.223+0000 7fcb177fe640 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f4515070 0x55d1f48d4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.223+0000 7fcb177fe640 1 -- 172.21.15.53:0/543877540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f47e08b0 con 0x55d1f44ec1b0 2024-08-31T06:23:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.223+0000 7fcb177fe640 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f44ec1b0 0x55d1f48cea20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb08103240 tx=0x7fcb08009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aca6d0e0c51e00ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.223+0000 7fcaf6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:23:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.223+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/543877540 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08049030 con 0x55d1f44ec1b0 2024-08-31T06:23:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.223+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/543877540 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fcb0803bca0 con 0x55d1f44ec1b0 2024-08-31T06:23:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.224+0000 7fcb24397740 1 -- 172.21.15.53:0/543877540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb1001b020 con 0x55d1f44ec1b0 2024-08-31T06:23:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.224+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/543877540 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fcb080cbbe0 con 0x55d1f44ec1b0 2024-08-31T06:23:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.224+0000 7fcb24397740 10 client.30064 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.224+0000 7fcb24397740 1 -- 172.21.15.53:0/543877540 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55d1f48dcf70 con 0x55d1f44ec1b0 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.224+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/543877540 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb1001b020 con 0x55d1f44ec1b0 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.224+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/543877540 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fcb080c8520 con 0x55d1f44ec1b0 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.224+0000 7fcb24397740 10 client.30064 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.224+0000 7fcb24397740 10 client.30064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.224+0000 7fcb24397740 20 client.30064 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.224+0000 7fcb24397740 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1f44d39f0 0x55d1f48e0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.225+0000 7fcb24397740 4 client.30064 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.225+0000 7fcb24397740 1 -- 172.21.15.53:0/543877540 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1f4833580 con 0x55d1f44d39f0 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.225+0000 7fcb16ffd640 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1f44d39f0 0x55d1f48e0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.225+0000 7fcaf6ffd640 10 client.30064 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.225+0000 7fcb16ffd640 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1f44d39f0 0x55d1f48e0310 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e924cfbcbaf54345 server_cookie=49507677dde2f87d in_seq=0 out_seq=0 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/543877540 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1f4833580 con 0x55d1f44d39f0 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcaf6ffd640 10 client.30064 handle_command_reply: tid=0 2024-08-31T06:23:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcb24397740 1 client.30064 shutdown 2024-08-31T06:23:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcb24397740 1 -- 172.21.15.53:0/543877540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f44ec1b0 msgr2=0x55d1f48cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcb24397740 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f44ec1b0 0x55d1f48cea20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb08103240 tx=0x7fcb08009560 comp rx=0 tx=0).stop 2024-08-31T06:23:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcb24397740 1 -- 172.21.15.53:0/543877540 shutdown_connections 2024-08-31T06:23:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcb24397740 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1f44d39f0 0x55d1f48e0310 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcb24397740 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f4515070 0x55d1f48d4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcb24397740 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44f4390 0x55d1f48cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcaf6ffd640 0 client.30064 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:36.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcb24397740 1 --2- 172.21.15.53:0/543877540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f44ec1b0 0x55d1f48cea20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcb24397740 1 -- 172.21.15.53:0/543877540 >> 172.21.15.53:0/543877540 conn(0x55d1f4509460 msgr2=0x55d1f48b7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:36.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcb24397740 1 -- 172.21.15.53:0/543877540 shutdown_connections 2024-08-31T06:23:36.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.226+0000 7fcb24397740 1 -- 172.21.15.53:0/543877540 wait complete. 2024-08-31T06:23:36.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.227+0000 7fcb24397740 20 client.30064 trim_cache size 0 max 16384 2024-08-31T06:23:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.254+0000 7fcb24397740 1 Processor -- start 2024-08-31T06:23:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb24397740 1 -- start start 2024-08-31T06:23:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb24397740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f4509460 0x55d1f48c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb24397740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f44d39f0 0x55d1f48ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb24397740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44ec1b0 0x55d1f48c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb24397740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181ad390 con 0x55d1f44ec1b0 2024-08-31T06:23:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb24397740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181aef30 con 0x55d1f4509460 2024-08-31T06:23:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb24397740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181adac0 con 0x55d1f44d39f0 2024-08-31T06:23:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44ec1b0 0x55d1f48c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb177fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f4509460 0x55d1f48c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb177fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f4509460 0x55d1f48c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46900/0 (socket says 172.21.15.53:46900) 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb177fe640 1 -- 172.21.15.53:0/194855700 learned_addr learned my addr 172.21.15.53:0/194855700 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb16ffd640 1 --2- 172.21.15.53:0/194855700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f44d39f0 0x55d1f48ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb177fe640 1 -- 172.21.15.53:0/194855700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f44d39f0 msgr2=0x55d1f48ba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb177fe640 1 --2- 172.21.15.53:0/194855700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f44d39f0 0x55d1f48ba200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb177fe640 1 -- 172.21.15.53:0/194855700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44ec1b0 msgr2=0x55d1f48c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.255+0000 7fcb177fe640 1 --2- 172.21.15.53:0/194855700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44ec1b0 0x55d1f48c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.256+0000 7fcb177fe640 1 -- 172.21.15.53:0/194855700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f48b3550 con 0x55d1f4509460 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.256+0000 7fcb17fff640 1 --2- 172.21.15.53:0/194855700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44ec1b0 0x55d1f48c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.256+0000 7fcb177fe640 1 --2- 172.21.15.53:0/194855700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f4509460 0x55d1f48c8410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcb080cbf30 tx=0x7fcb08109690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff76cf75a485324a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.256+0000 7fcafd7fa640 1 -- 172.21.15.53:0/194855700 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08049070 con 0x55d1f4509460 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.256+0000 7fcafd7fa640 1 -- 172.21.15.53:0/194855700 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb080b7040 con 0x55d1f4509460 2024-08-31T06:23:36.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.256+0000 7fcafd7fa640 1 -- 172.21.15.53:0/194855700 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb080cba00 con 0x55d1f4509460 2024-08-31T06:23:36.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.257+0000 7fcb24397740 1 -- 172.21.15.53:0/194855700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f4509460 msgr2=0x55d1f48c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.257+0000 7fcb24397740 1 --2- 172.21.15.53:0/194855700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f4509460 0x55d1f48c8410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcb080cbf30 tx=0x7fcb08109690 comp rx=0 tx=0).stop 2024-08-31T06:23:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.257+0000 7fcb24397740 1 -- 172.21.15.53:0/194855700 shutdown_connections 2024-08-31T06:23:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.257+0000 7fcb24397740 1 --2- 172.21.15.53:0/194855700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44ec1b0 0x55d1f48c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.257+0000 7fcb24397740 1 --2- 172.21.15.53:0/194855700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f44d39f0 0x55d1f48ba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.257+0000 7fcb24397740 1 --2- 172.21.15.53:0/194855700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f4509460 0x55d1f48c8410 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.257+0000 7fcb24397740 1 -- 172.21.15.53:0/194855700 >> 172.21.15.53:0/194855700 conn(0x55d1f48bb770 msgr2=0x55d1f48c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.258+0000 7fcb24397740 1 -- 172.21.15.53:0/194855700 shutdown_connections 2024-08-31T06:23:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.258+0000 7fcb24397740 1 -- 172.21.15.53:0/194855700 wait complete. 2024-08-31T06:23:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.258+0000 7fcb24397740 1 -- start start 2024-08-31T06:23:36.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.258+0000 7fcb24397740 1 Processor -- start 2024-08-31T06:23:36.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.259+0000 7fcb24397740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44d39f0 0x55d1f48daca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.259+0000 7fcb24397740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44ec1b0 0x55d1f48d5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.259+0000 7fcb177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44d39f0 0x55d1f48daca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.259+0000 7fcb177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44d39f0 0x55d1f48daca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46982/0 (socket says 172.21.15.53:46982) 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.259+0000 7fcb24397740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f4509460 0x55d1f48d57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.259+0000 7fcb177fe640 1 -- 172.21.15.53:0/3009836266 learned_addr learned my addr 172.21.15.53:0/3009836266 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.259+0000 7fcb24397740 1 -- 172.21.15.53:0/3009836266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181ae860 con 0x55d1f44d39f0 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.259+0000 7fcb24397740 1 -- 172.21.15.53:0/3009836266 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181ae190 con 0x55d1f44ec1b0 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.259+0000 7fcb24397740 1 -- 172.21.15.53:0/3009836266 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb181ab390 con 0x55d1f4509460 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.259+0000 7fcb24397740 10 client.0 _ll_register_callbacks cb 0x7fcb08005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.259+0000 7fcb16ffd640 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44ec1b0 0x55d1f48d5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcb177fe640 1 -- 172.21.15.53:0/3009836266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f4509460 msgr2=0x55d1f48d57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcb177fe640 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f4509460 0x55d1f48d57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcb177fe640 1 -- 172.21.15.53:0/3009836266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44ec1b0 msgr2=0x55d1f48d5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:36.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcb177fe640 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44ec1b0 0x55d1f48d5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcb177fe640 1 -- 172.21.15.53:0/3009836266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f48d5f60 con 0x55d1f44d39f0 2024-08-31T06:23:36.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcb16ffd640 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44ec1b0 0x55d1f48d5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:23:36.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcb177fe640 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44d39f0 0x55d1f48daca0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fcb080cbf90 tx=0x7fcb08109620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e913a5ea6d98b680 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:36.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcaf6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:36.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/3009836266 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08049070 con 0x55d1f44d39f0 2024-08-31T06:23:36.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/3009836266 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fcb080d5070 con 0x55d1f44d39f0 2024-08-31T06:23:36.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcb24397740 1 -- 172.21.15.53:0/3009836266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb080b7040 con 0x55d1f44d39f0 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/3009836266 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fcb080cba00 con 0x55d1f44d39f0 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcb24397740 10 client.21231 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.260+0000 7fcb24397740 1 -- 172.21.15.53:0/3009836266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55d1f48d5f60 con 0x55d1f44d39f0 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.261+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/3009836266 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb080b7040 con 0x55d1f44d39f0 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.261+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/3009836266 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fcb080cb4f0 con 0x55d1f44d39f0 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.261+0000 7fcb24397740 10 client.21231 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.261+0000 7fcb24397740 10 client.21231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.261+0000 7fcb24397740 20 client.21231 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.261+0000 7fcb24397740 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1f44f4390 0x55d1f494e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.261+0000 7fcb24397740 4 client.21231 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.261+0000 7fcb24397740 1 -- 172.21.15.53:0/3009836266 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d1f482f020 con 0x55d1f44f4390 2024-08-31T06:23:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.261+0000 7fcb16ffd640 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1f44f4390 0x55d1f494e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:36.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.263+0000 7fcb16ffd640 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1f44f4390 0x55d1f494e070 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13847d80f0859ff6 server_cookie=7bf698ca8579916f in_seq=0 out_seq=0 2024-08-31T06:23:36.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.263+0000 7fcaf6ffd640 10 client.21231 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:36.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.263+0000 7fcaf6ffd640 1 -- 172.21.15.53:0/3009836266 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6622 (crc 0 0 0) 0x55d1f482f020 con 0x55d1f44f4390 2024-08-31T06:23:36.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.263+0000 7fcaf6ffd640 10 client.21231 handle_command_reply: tid=0 2024-08-31T06:23:36.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.263+0000 7fcb24397740 1 client.21231 shutdown 2024-08-31T06:23:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.264+0000 7fcb24397740 1 -- 172.21.15.53:0/3009836266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44d39f0 msgr2=0x55d1f48daca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.264+0000 7fcb24397740 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44d39f0 0x55d1f48daca0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fcb080cbf90 tx=0x7fcb08109620 comp rx=0 tx=0).stop 2024-08-31T06:23:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.264+0000 7fcb24397740 1 -- 172.21.15.53:0/3009836266 shutdown_connections 2024-08-31T06:23:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.264+0000 7fcb24397740 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d1f44f4390 0x55d1f494e070 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.264+0000 7fcb24397740 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f4509460 0x55d1f48d57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.264+0000 7fcb24397740 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1f44ec1b0 0x55d1f48d5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.264+0000 7fcaf6ffd640 0 client.21231 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.264+0000 7fcb24397740 1 --2- 172.21.15.53:0/3009836266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d1f44d39f0 0x55d1f48daca0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.264+0000 7fcb24397740 1 -- 172.21.15.53:0/3009836266 >> 172.21.15.53:0/3009836266 conn(0x55d1f48bb770 msgr2=0x55d1f48d2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:36.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.265+0000 7fcb24397740 1 -- 172.21.15.53:0/3009836266 shutdown_connections 2024-08-31T06:23:36.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.265+0000 7fcb24397740 1 -- 172.21.15.53:0/3009836266 wait complete. 2024-08-31T06:23:36.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.265+0000 7fcb24397740 20 client.21231 trim_cache size 0 max 16384 2024-08-31T06:23:36.268 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:23:36.268 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:23:36.268 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.269 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.270 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:23:36.271 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:23:36.271 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.271 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:23:36.271 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:23:36.271 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.271 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.272 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.273 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.274 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:23:36.275 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.277 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.278 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:23:36.279 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.280 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.281 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:36.282 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:23:36.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.266+0000 7fcb1de22640 1 -- 172.21.15.53:0/1938906012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcb000b4d20 msgr2=0x7fcb000b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:36.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.266+0000 7fcb1de22640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcb000b4d20 0x7fcb000b7230 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fcb10003fd0 tx=0x7fcb10004920 comp rx=0 tx=0).stop 2024-08-31T06:23:36.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.266+0000 7fcb1de22640 1 -- 172.21.15.53:0/1938906012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb18102880 msgr2=0x7fcb18197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:36.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.266+0000 7fcb1de22640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb18102880 0x7fcb18197f60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcb0802a930 tx=0x7fcb08003b90 comp rx=0 tx=0).stop 2024-08-31T06:23:36.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.267+0000 7fcb1de22640 1 -- 172.21.15.53:0/1938906012 shutdown_connections 2024-08-31T06:23:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.267+0000 7fcb1de22640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcb000b4d20 0x7fcb000b7230 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.267+0000 7fcb1de22640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18108ac0 0x7fcb1819d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.267+0000 7fcb1de22640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb18108170 0x7fcb18198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.267+0000 7fcb1de22640 1 --2- 172.21.15.53:0/1938906012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb18102880 0x7fcb18197f60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.267+0000 7fcb1de22640 1 -- 172.21.15.53:0/1938906012 >> 172.21.15.53:0/1938906012 conn(0x7fcb18079530 msgr2=0x7fcb18106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.268+0000 7fcb1de22640 1 -- 172.21.15.53:0/1938906012 shutdown_connections 2024-08-31T06:23:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:36.268+0000 7fcb1de22640 1 -- 172.21.15.53:0/1938906012 wait complete. 2024-08-31T06:23:36.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 35464 5.61 MB/sec execute 204 sec latency 81.607 ms 2024-08-31T06:23:37.115 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:23:37.115 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:23:37.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 35608 5.63 MB/sec execute 205 sec latency 63.195 ms 2024-08-31T06:23:37.474 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:37.913 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:37 smithi053 ceph-mon[18924]: pgmap v909: 97 pgs: 97 active+clean; 663 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 384 op/s 2024-08-31T06:23:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:37 smithi130 ceph-mon[22266]: pgmap v909: 97 pgs: 97 active+clean; 663 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 384 op/s 2024-08-31T06:23:38.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:37 smithi153 ceph-mon[22320]: pgmap v909: 97 pgs: 97 active+clean; 663 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 384 op/s 2024-08-31T06:23:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.189+0000 7f976ebdb640 1 -- 172.21.15.53:0/3277257866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768101f90 msgr2=0x7f97681023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.189+0000 7f976ebdb640 1 --2- 172.21.15.53:0/3277257866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768101f90 0x7f97681023a0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f975c009900 tx=0x7f975c02a410 comp rx=0 tx=0).stop 2024-08-31T06:23:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.189+0000 7f976ebdb640 1 -- 172.21.15.53:0/3277257866 shutdown_connections 2024-08-31T06:23:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.189+0000 7f976ebdb640 1 --2- 172.21.15.53:0/3277257866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9768108220 0x7f976810ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.189+0000 7f976ebdb640 1 --2- 172.21.15.53:0/3277257866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97681078d0 0x7f9768107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.189+0000 7f976ebdb640 1 --2- 172.21.15.53:0/3277257866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768101f90 0x7f97681023a0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.189+0000 7f976ebdb640 1 -- 172.21.15.53:0/3277257866 >> 172.21.15.53:0/3277257866 conn(0x7f9768077a00 msgr2=0x7f9768077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.189+0000 7f976ebdb640 1 -- 172.21.15.53:0/3277257866 shutdown_connections 2024-08-31T06:23:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.190+0000 7f976ebdb640 1 -- 172.21.15.53:0/3277257866 wait complete. 2024-08-31T06:23:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.190+0000 7f976ebdb640 1 Processor -- start 2024-08-31T06:23:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976ebdb640 1 -- start start 2024-08-31T06:23:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976ebdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9768101f90 0x7f976819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976ebdb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97681078d0 0x7f976819c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976ebdb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768108220 0x7f97681a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976ebdb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9768113700 con 0x7f9768108220 2024-08-31T06:23:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976ebdb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9768113580 con 0x7f9768101f90 2024-08-31T06:23:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976ebdb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9768113880 con 0x7f97681078d0 2024-08-31T06:23:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976d178640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768108220 0x7f97681a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976c977640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9768101f90 0x7f976819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976d178640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768108220 0x7f97681a1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47006/0 (socket says 172.21.15.53:47006) 2024-08-31T06:23:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976c977640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9768101f90 0x7f976819c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46920/0 (socket says 172.21.15.53:46920) 2024-08-31T06:23:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976d178640 1 -- 172.21.15.53:0/1775432968 learned_addr learned my addr 172.21.15.53:0/1775432968 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f9767fff640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97681078d0 0x7f976819c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976c977640 1 -- 172.21.15.53:0/1775432968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97681078d0 msgr2=0x7f976819c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976c977640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97681078d0 0x7f976819c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976c977640 1 -- 172.21.15.53:0/1775432968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768108220 msgr2=0x7f97681a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.191+0000 7f976c977640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768108220 0x7f97681a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.192+0000 7f976c977640 1 -- 172.21.15.53:0/1775432968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97681a2320 con 0x7f9768101f90 2024-08-31T06:23:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.192+0000 7f976d178640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768108220 0x7f97681a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.192+0000 7f976c977640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9768101f90 0x7f976819c3b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f975c005940 tx=0x7f975c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.192+0000 7f9765ffb640 1 -- 172.21.15.53:0/1775432968 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c03f070 con 0x7f9768101f90 2024-08-31T06:23:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.192+0000 7f976ebdb640 1 -- 172.21.15.53:0/1775432968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97681a25b0 con 0x7f9768101f90 2024-08-31T06:23:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.192+0000 7f9765ffb640 1 -- 172.21.15.53:0/1775432968 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f975c003a80 con 0x7f9768101f90 2024-08-31T06:23:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.192+0000 7f9765ffb640 1 -- 172.21.15.53:0/1775432968 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c035070 con 0x7f9768101f90 2024-08-31T06:23:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.192+0000 7f976ebdb640 1 -- 172.21.15.53:0/1775432968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97681a8d70 con 0x7f9768101f90 2024-08-31T06:23:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.194+0000 7f976ebdb640 1 -- 172.21.15.53:0/1775432968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97681023a0 con 0x7f9768101f90 2024-08-31T06:23:38.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.195+0000 7f9765ffb640 1 -- 172.21.15.53:0/1775432968 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f975c0035f0 con 0x7f9768101f90 2024-08-31T06:23:38.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.196+0000 7f9765ffb640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97580b4ca0 0x7f97580b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:38.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.197+0000 7f9767fff640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97580b4ca0 0x7f97580b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:38.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.197+0000 7f9765ffb640 1 -- 172.21.15.53:0/1775432968 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f975c105780 con 0x7f9768101f90 2024-08-31T06:23:38.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.197+0000 7f9767fff640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97580b4ca0 0x7f97580b71b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f97681047b0 tx=0x7f9754005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:38.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.203+0000 7f9765ffb640 1 -- 172.21.15.53:0/1775432968 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f975c0cbea0 con 0x7f9768101f90 2024-08-31T06:23:38.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 35764 5.64 MB/sec execute 206 sec latency 90.995 ms 2024-08-31T06:23:38.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.580+0000 7f976ebdb640 1 -- 172.21.15.53:0/1775432968 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97681a8fa0 con 0x7f9768101f90 2024-08-31T06:23:38.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.581+0000 7f9765ffb640 1 -- 172.21.15.53:0/1775432968 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+11988 (secure 0 0 0) 0x7f975c0d0660 con 0x7f9768101f90 2024-08-31T06:23:38.583 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:23:38.584 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":66,"btime":"2024-08-31T06:22:34:298615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":66,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:22:33.810373+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:23:38.584 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 66 2024-08-31T06:23:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 -- 172.21.15.53:0/1775432968 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97580b4ca0 msgr2=0x7f97580b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97580b4ca0 0x7f97580b71b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f97681047b0 tx=0x7f9754005f90 comp rx=0 tx=0).stop 2024-08-31T06:23:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 -- 172.21.15.53:0/1775432968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9768101f90 msgr2=0x7f976819c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9768101f90 0x7f976819c3b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f975c005940 tx=0x7f975c004040 comp rx=0 tx=0).stop 2024-08-31T06:23:38.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 -- 172.21.15.53:0/1775432968 shutdown_connections 2024-08-31T06:23:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97580b4ca0 0x7f97580b71b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768108220 0x7f97681a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97681078d0 0x7f976819c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 --2- 172.21.15.53:0/1775432968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9768101f90 0x7f976819c3b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 -- 172.21.15.53:0/1775432968 >> 172.21.15.53:0/1775432968 conn(0x7f9768077a00 msgr2=0x7f97681057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 -- 172.21.15.53:0/1775432968 shutdown_connections 2024-08-31T06:23:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:38.584+0000 7f976ebdb640 1 -- 172.21.15.53:0/1775432968 wait complete. 2024-08-31T06:23:38.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:38 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1775432968' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:23:39.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:38 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1775432968' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:23:39.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:38 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1775432968' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:23:39.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 35925 5.65 MB/sec execute 207 sec latency 71.444 ms 2024-08-31T06:23:39.461 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:23:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.987+0000 7f4f303e6640 1 -- 172.21.15.53:0/2146312355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f28103870 msgr2=0x7f4f28103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.987+0000 7f4f303e6640 1 --2- 172.21.15.53:0/2146312355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f28103870 0x7f4f28103c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009900 tx=0x7f4f2402a400 comp rx=0 tx=0).stop 2024-08-31T06:23:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.987+0000 7f4f303e6640 1 -- 172.21.15.53:0/2146312355 shutdown_connections 2024-08-31T06:23:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.987+0000 7f4f303e6640 1 --2- 172.21.15.53:0/2146312355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28109af0 0x7f4f28110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.987+0000 7f4f303e6640 1 --2- 172.21.15.53:0/2146312355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f281091a0 0x7f4f281095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.987+0000 7f4f303e6640 1 --2- 172.21.15.53:0/2146312355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f28103870 0x7f4f28103c80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.987+0000 7f4f303e6640 1 -- 172.21.15.53:0/2146312355 >> 172.21.15.53:0/2146312355 conn(0x7f4f280ff2b0 msgr2=0x7f4f28101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.988+0000 7f4f303e6640 1 -- 172.21.15.53:0/2146312355 shutdown_connections 2024-08-31T06:23:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.988+0000 7f4f303e6640 1 -- 172.21.15.53:0/2146312355 wait complete. 2024-08-31T06:23:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.988+0000 7f4f303e6640 1 Processor -- start 2024-08-31T06:23:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f303e6640 1 -- start start 2024-08-31T06:23:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f303e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28103870 0x7f4f2819a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f303e6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f281091a0 0x7f4f2819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f303e6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f28109af0 0x7f4f2819f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f303e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281136a0 con 0x7f4f28103870 2024-08-31T06:23:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f303e6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28113520 con 0x7f4f281091a0 2024-08-31T06:23:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f303e6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28113820 con 0x7f4f28109af0 2024-08-31T06:23:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f2d981640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f281091a0 0x7f4f2819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f2e182640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28103870 0x7f4f2819a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f2d981640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f281091a0 0x7f4f2819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46948/0 (socket says 172.21.15.53:46948) 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f2d981640 1 -- 172.21.15.53:0/567235414 learned_addr learned my addr 172.21.15.53:0/567235414 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.989+0000 7f4f2e983640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f28109af0 0x7f4f2819f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.990+0000 7f4f2d981640 1 -- 172.21.15.53:0/567235414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f28109af0 msgr2=0x7f4f2819f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.990+0000 7f4f2d981640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f28109af0 0x7f4f2819f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.990+0000 7f4f2d981640 1 -- 172.21.15.53:0/567235414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28103870 msgr2=0x7f4f2819a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.990+0000 7f4f2d981640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28103870 0x7f4f2819a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.990+0000 7f4f2d981640 1 -- 172.21.15.53:0/567235414 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f281a0070 con 0x7f4f281091a0 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.990+0000 7f4f2d981640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f281091a0 0x7f4f2819a6e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800e9f0 tx=0x7f4f1800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.990+0000 7f4f1f7fe640 1 -- 172.21.15.53:0/567235414 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1800ccc0 con 0x7f4f281091a0 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.990+0000 7f4f1f7fe640 1 -- 172.21.15.53:0/567235414 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f180108c0 con 0x7f4f281091a0 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.990+0000 7f4f1f7fe640 1 -- 172.21.15.53:0/567235414 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18018750 con 0x7f4f281091a0 2024-08-31T06:23:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.990+0000 7f4f303e6640 1 -- 172.21.15.53:0/567235414 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f281a0360 con 0x7f4f281091a0 2024-08-31T06:23:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.991+0000 7f4f303e6640 1 -- 172.21.15.53:0/567235414 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f28075390 con 0x7f4f281091a0 2024-08-31T06:23:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.994+0000 7f4f3742b740 1 Processor -- start 2024-08-31T06:23:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.994+0000 7f4f3742b740 1 -- start start 2024-08-31T06:23:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.994+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098e41b0 0x559609c87ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.994+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098bb2f0 0x559609c88220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098c34d0 0x559609c88760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f3742b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559609bfd000 con 0x5596098c34d0 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f3742b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559609bec590 con 0x5596098bb2f0 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f3742b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559609bf0540 con 0x5596098e41b0 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f2e983640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098e41b0 0x559609c87ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f2e983640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098e41b0 0x559609c87ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51062/0 (socket says 172.21.15.53:51062) 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f2e182640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098bb2f0 0x559609c88220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f2e983640 1 -- 172.21.15.53:0/2198704228 learned_addr learned my addr 172.21.15.53:0/2198704228 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f1f7fe640 1 -- 172.21.15.53:0/567235414 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4f18010430 con 0x7f4f281091a0 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f2e983640 1 -- 172.21.15.53:0/2198704228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098bb2f0 msgr2=0x559609c88220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f2e983640 1 --2- 172.21.15.53:0/2198704228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098bb2f0 0x559609c88220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f2e983640 1 -- 172.21.15.53:0/2198704228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098c34d0 msgr2=0x559609c88760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f2d981640 1 --2- 172.21.15.53:0/2198704228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098c34d0 0x559609c88760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f2e983640 1 --2- 172.21.15.53:0/2198704228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098c34d0 0x559609c88760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:39.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f2e983640 1 -- 172.21.15.53:0/2198704228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55960994f790 con 0x5596098e41b0 2024-08-31T06:23:39.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.995+0000 7f4f2d981640 1 --2- 172.21.15.53:0/2198704228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098c34d0 0x559609c88760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:23:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.996+0000 7f4f2e983640 1 --2- 172.21.15.53:0/2198704228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098e41b0 0x559609c87ce0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4f200103d0 tx=0x7f4f20010890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=176de60302785f8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.996+0000 7f4f1cbfe640 1 -- 172.21.15.53:0/2198704228 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20011700 con 0x5596098e41b0 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.996+0000 7f4f1cbfe640 1 -- 172.21.15.53:0/2198704228 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f20011d30 con 0x5596098e41b0 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.996+0000 7f4f1cbfe640 1 -- 172.21.15.53:0/2198704228 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2001ce00 con 0x5596098e41b0 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.996+0000 7f4f1f7fe640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f140b4d20 0x7f4f140b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.996+0000 7f4f1f7fe640 1 -- 172.21.15.53:0/567235414 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f4f180e58f0 con 0x7f4f281091a0 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.997+0000 7f4f2e182640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f140b4d20 0x7f4f140b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.997+0000 7f4f3742b740 1 -- 172.21.15.53:0/2198704228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098e41b0 msgr2=0x559609c87ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.997+0000 7f4f2e182640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f140b4d20 0x7f4f140b7230 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4f24006010 tx=0x7f4f2403c040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.997+0000 7f4f3742b740 1 --2- 172.21.15.53:0/2198704228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098e41b0 0x559609c87ce0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4f200103d0 tx=0x7f4f20010890 comp rx=0 tx=0).stop 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.997+0000 7f4f3742b740 1 -- 172.21.15.53:0/2198704228 shutdown_connections 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.997+0000 7f4f3742b740 1 --2- 172.21.15.53:0/2198704228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098c34d0 0x559609c88760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.997+0000 7f4f3742b740 1 --2- 172.21.15.53:0/2198704228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098bb2f0 0x559609c88220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.997+0000 7f4f3742b740 1 --2- 172.21.15.53:0/2198704228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098e41b0 0x559609c87ce0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.997+0000 7f4f3742b740 1 -- 172.21.15.53:0/2198704228 >> 172.21.15.53:0/2198704228 conn(0x5596098d8300 msgr2=0x559609c85bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.997+0000 7f4f3742b740 1 -- 172.21.15.53:0/2198704228 shutdown_connections 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.997+0000 7f4f3742b740 1 -- 172.21.15.53:0/2198704228 wait complete. 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.998+0000 7f4f3742b740 1 -- start start 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.998+0000 7f4f3742b740 1 Processor -- start 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.998+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098bb2f0 0x559609c93900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.998+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 0x559609c93e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.998+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c9f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.998+0000 7f4f3742b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559609b25ab0 con 0x5596098bb2f0 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f3742b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559609b73680 con 0x5596098e41b0 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f3742b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559609c96460 con 0x5596098c34d0 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f2d981640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 0x559609c93e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f2e182640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098bb2f0 0x559609c93900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f2d981640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 0x559609c93e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51074/0 (socket says 172.21.15.53:51074) 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f2d981640 1 -- 172.21.15.53:0/591507117 learned_addr learned my addr 172.21.15.53:0/591507117 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f2e983640 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c9f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f3742b740 10 client.0 _ll_register_callbacks cb 0x5596098fba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f2d981640 1 -- 172.21.15.53:0/591507117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 msgr2=0x559609c9f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f2d981640 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c9f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f2d981640 1 -- 172.21.15.53:0/591507117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098bb2f0 msgr2=0x559609c93900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f2d981640 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098bb2f0 0x559609c93900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f2d981640 1 -- 172.21.15.53:0/591507117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596099c8620 con 0x5596098c34d0 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f2d981640 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 0x559609c93e80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4f180abcc0 tx=0x7f4f180107e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe611556b5ff8737 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:23:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f11ffb640 1 -- 172.21.15.53:0/591507117 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f180b0830 con 0x5596098c34d0 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f11ffb640 1 -- 172.21.15.53:0/591507117 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f4f180b0500 con 0x5596098c34d0 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:39.999+0000 7f4f3742b740 1 -- 172.21.15.53:0/591507117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f20011d30 con 0x5596098c34d0 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f11ffb640 1 -- 172.21.15.53:0/591507117 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f4f180b52e0 con 0x5596098c34d0 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f3742b740 10 client.30085 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f3742b740 1 -- 172.21.15.53:0/591507117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x559609ca2450 con 0x5596098c34d0 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f11ffb640 1 -- 172.21.15.53:0/591507117 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f20011d30 con 0x5596098c34d0 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f11ffb640 1 -- 172.21.15.53:0/591507117 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f4f180ae060 con 0x5596098c34d0 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f3742b740 10 client.30085 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f3742b740 10 client.30085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f3742b740 20 client.30085 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f3742b740 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596098a2d80 0x559609ca59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f3742b740 4 client.30085 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f3742b740 1 -- 172.21.15.53:0/591507117 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559609bfef50 con 0x5596098a2d80 2024-08-31T06:23:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.000+0000 7f4f2e182640 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596098a2d80 0x559609ca59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.001+0000 7f4f2e182640 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596098a2d80 0x559609ca59f0 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a14af695fbdcbbff server_cookie=fae7164bc7392978 in_seq=0 out_seq=0 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.001+0000 7f4f11ffb640 10 client.30085 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f11ffb640 1 -- 172.21.15.53:0/591507117 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559609bfef50 con 0x5596098a2d80 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f11ffb640 10 client.30085 handle_command_reply: tid=0 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 1 client.30085 shutdown 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 1 -- 172.21.15.53:0/591507117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 msgr2=0x559609c93e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 0x559609c93e80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4f180abcc0 tx=0x7f4f180107e0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 1 -- 172.21.15.53:0/591507117 shutdown_connections 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596098a2d80 0x559609ca59f0 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c9f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 0x559609c93e80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 1 --2- 172.21.15.53:0/591507117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098bb2f0 0x559609c93900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f11ffb640 0 client.30085 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 1 -- 172.21.15.53:0/591507117 >> 172.21.15.53:0/591507117 conn(0x5596098d8300 msgr2=0x559609c88d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 1 -- 172.21.15.53:0/591507117 shutdown_connections 2024-08-31T06:23:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 1 -- 172.21.15.53:0/591507117 wait complete. 2024-08-31T06:23:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.002+0000 7f4f3742b740 20 client.30085 trim_cache size 0 max 16384 2024-08-31T06:23:40.029 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:39 smithi130 ceph-mon[22266]: pgmap v910: 97 pgs: 97 active+clean; 665 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 332 op/s 2024-08-31T06:23:40.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.030+0000 7f4f3742b740 1 Processor -- start 2024-08-31T06:23:40.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.030+0000 7f4f3742b740 1 -- start start 2024-08-31T06:23:40.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.031+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098bb2f0 0x559609c93d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.031+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 0x559609c92f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.033 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.031+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c854f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.031+0000 7f4f3742b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281ad370 con 0x5596098bb2f0 2024-08-31T06:23:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.031+0000 7f4f3742b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281aef10 con 0x5596098e41b0 2024-08-31T06:23:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.031+0000 7f4f2e983640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c854f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.031+0000 7f4f2e983640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c854f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46980/0 (socket says 172.21.15.53:46980) 2024-08-31T06:23:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.031+0000 7f4f2e983640 1 -- 172.21.15.53:0/357058447 learned_addr learned my addr 172.21.15.53:0/357058447 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.031+0000 7f4f2d981640 1 --2- 172.21.15.53:0/357058447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 0x559609c92f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.031+0000 7f4f3742b740 1 -- 172.21.15.53:0/357058447 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281adaa0 con 0x5596098c34d0 2024-08-31T06:23:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.031+0000 7f4f2e182640 1 --2- 172.21.15.53:0/357058447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098bb2f0 0x559609c93d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.032+0000 7f4f2d981640 1 -- 172.21.15.53:0/357058447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 msgr2=0x559609c854f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.032+0000 7f4f2d981640 1 --2- 172.21.15.53:0/357058447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c854f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.032+0000 7f4f2d981640 1 -- 172.21.15.53:0/357058447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098bb2f0 msgr2=0x559609c93d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.032+0000 7f4f2d981640 1 --2- 172.21.15.53:0/357058447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098bb2f0 0x559609c93d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.032+0000 7f4f2d981640 1 -- 172.21.15.53:0/357058447 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559609c9fac0 con 0x5596098c34d0 2024-08-31T06:23:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.032+0000 7f4f2d981640 1 --2- 172.21.15.53:0/357058447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 0x559609c92f60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4f18023040 tx=0x7f4f18000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9825a2933d3c5ea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.033+0000 7f4f13fff640 1 -- 172.21.15.53:0/357058447 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18097040 con 0x5596098c34d0 2024-08-31T06:23:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.033+0000 7f4f13fff640 1 -- 172.21.15.53:0/357058447 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f180971e0 con 0x5596098c34d0 2024-08-31T06:23:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.033+0000 7f4f13fff640 1 -- 172.21.15.53:0/357058447 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f180930e0 con 0x5596098c34d0 2024-08-31T06:23:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.034+0000 7f4f3742b740 1 -- 172.21.15.53:0/357058447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 msgr2=0x559609c92f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.034+0000 7f4f3742b740 1 --2- 172.21.15.53:0/357058447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 0x559609c92f60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4f18023040 tx=0x7f4f18000bc0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.034+0000 7f4f3742b740 1 -- 172.21.15.53:0/357058447 shutdown_connections 2024-08-31T06:23:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.034+0000 7f4f3742b740 1 --2- 172.21.15.53:0/357058447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c854f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.034+0000 7f4f3742b740 1 --2- 172.21.15.53:0/357058447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098c34d0 0x559609c92f60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.034+0000 7f4f3742b740 1 --2- 172.21.15.53:0/357058447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098bb2f0 0x559609c93d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.034+0000 7f4f3742b740 1 -- 172.21.15.53:0/357058447 >> 172.21.15.53:0/357058447 conn(0x5596098d8300 msgr2=0x559609c93660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.034+0000 7f4f3742b740 1 -- 172.21.15.53:0/357058447 shutdown_connections 2024-08-31T06:23:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.034+0000 7f4f3742b740 1 -- 172.21.15.53:0/357058447 wait complete. 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.034+0000 7f4f3742b740 1 -- start start 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f3742b740 1 Processor -- start 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098bb2f0 0x559609c9c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098c34d0 0x559609c974b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f3742b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c97b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f3742b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281ae840 con 0x5596098c34d0 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f3742b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281ae170 con 0x5596098e41b0 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f3742b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281ab370 con 0x5596098bb2f0 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f3742b740 10 client.0 _ll_register_callbacks cb 0x7f4f180e8f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f2e182640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098bb2f0 0x559609c9c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f2d981640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098c34d0 0x559609c974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f2e182640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098bb2f0 0x559609c9c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51084/0 (socket says 172.21.15.53:51084) 2024-08-31T06:23:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f2e182640 1 -- 172.21.15.53:0/760770272 learned_addr learned my addr 172.21.15.53:0/760770272 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.035+0000 7f4f2e983640 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c97b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.036+0000 7f4f2e182640 1 -- 172.21.15.53:0/760770272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 msgr2=0x559609c97b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.036+0000 7f4f2e182640 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c97b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.036+0000 7f4f2e182640 1 -- 172.21.15.53:0/760770272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098c34d0 msgr2=0x559609c974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.036+0000 7f4f2e182640 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098c34d0 0x559609c974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.036+0000 7f4f2e182640 1 -- 172.21.15.53:0/760770272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559609c982c0 con 0x5596098bb2f0 2024-08-31T06:23:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.036+0000 7f4f2e182640 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098bb2f0 0x559609c9c010 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4f2402a9f0 tx=0x7f4f24009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7a39dd4cf136eb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.036+0000 7f4f11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:23:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.036+0000 7f4f11ffb640 1 -- 172.21.15.53:0/760770272 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24035040 con 0x5596098bb2f0 2024-08-31T06:23:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.036+0000 7f4f11ffb640 1 -- 172.21.15.53:0/760770272 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f4f240035f0 con 0x5596098bb2f0 2024-08-31T06:23:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.036+0000 7f4f3742b740 1 -- 172.21.15.53:0/760770272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f180971e0 con 0x5596098bb2f0 2024-08-31T06:23:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f11ffb640 1 -- 172.21.15.53:0/760770272 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f4f240037f0 con 0x5596098bb2f0 2024-08-31T06:23:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f3742b740 10 client.30091 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f3742b740 1 -- 172.21.15.53:0/760770272 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x559609d104d0 con 0x5596098bb2f0 2024-08-31T06:23:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f11ffb640 1 -- 172.21.15.53:0/760770272 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f180971e0 con 0x5596098bb2f0 2024-08-31T06:23:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f11ffb640 1 -- 172.21.15.53:0/760770272 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f4f24054940 con 0x5596098bb2f0 2024-08-31T06:23:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f3742b740 10 client.30091 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f3742b740 10 client.30091 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f3742b740 20 client.30091 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f3742b740 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596098781c0 0x559609d12cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f3742b740 4 client.30091 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:23:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f3742b740 1 -- 172.21.15.53:0/760770272 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559609bfa9f0 con 0x5596098781c0 2024-08-31T06:23:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.037+0000 7f4f2d981640 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596098781c0 0x559609d12cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.038+0000 7f4f11ffb640 10 client.30091 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.038+0000 7f4f2d981640 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596098781c0 0x559609d12cc0 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ccc5cb66685960a server_cookie=f2b886fe966f0c2c in_seq=0 out_seq=0 2024-08-31T06:23:40.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:39 smithi153 ceph-mon[22320]: pgmap v910: 97 pgs: 97 active+clean; 665 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 332 op/s 2024-08-31T06:23:40.079 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:39 smithi053 ceph-mon[18924]: pgmap v910: 97 pgs: 97 active+clean; 665 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 332 op/s 2024-08-31T06:23:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.122+0000 7f4f11ffb640 1 -- 172.21.15.53:0/760770272 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559609bfa9f0 con 0x5596098781c0 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.122+0000 7f4f11ffb640 10 client.30091 handle_command_reply: tid=0 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.122+0000 7f4f3742b740 1 client.30091 shutdown 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f3742b740 1 -- 172.21.15.53:0/760770272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098bb2f0 msgr2=0x559609c9c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f3742b740 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098bb2f0 0x559609c9c010 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4f2402a9f0 tx=0x7f4f24009260 comp rx=0 tx=0).stop 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f3742b740 1 -- 172.21.15.53:0/760770272 shutdown_connections 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f3742b740 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5596098781c0 0x559609d12cc0 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f3742b740 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5596098e41b0 0x559609c97b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f3742b740 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596098c34d0 0x559609c974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f3742b740 1 --2- 172.21.15.53:0/760770272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5596098bb2f0 0x559609c9c010 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f3742b740 1 -- 172.21.15.53:0/760770272 >> 172.21.15.53:0/760770272 conn(0x5596098d8300 msgr2=0x559609c853c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f11ffb640 0 client.30091 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f3742b740 1 -- 172.21.15.53:0/760770272 shutdown_connections 2024-08-31T06:23:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f3742b740 1 -- 172.21.15.53:0/760770272 wait complete. 2024-08-31T06:23:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.123+0000 7f4f3742b740 20 client.30091 trim_cache size 0 max 16384 2024-08-31T06:23:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:23:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:23:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:23:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:23:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 -- 172.21.15.53:0/567235414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f140b4d20 msgr2=0x7f4f140b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f140b4d20 0x7f4f140b7230 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4f24006010 tx=0x7f4f2403c040 comp rx=0 tx=0).stop 2024-08-31T06:23:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 -- 172.21.15.53:0/567235414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f281091a0 msgr2=0x7f4f2819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f281091a0 0x7f4f2819a6e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800e9f0 tx=0x7f4f1800eeb0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 -- 172.21.15.53:0/567235414 shutdown_connections 2024-08-31T06:23:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f140b4d20 0x7f4f140b7230 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f28109af0 0x7f4f2819f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f281091a0 0x7f4f2819a6e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 --2- 172.21.15.53:0/567235414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28103870 0x7f4f2819a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 -- 172.21.15.53:0/567235414 >> 172.21.15.53:0/567235414 conn(0x7f4f280ff2b0 msgr2=0x7f4f281016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 -- 172.21.15.53:0/567235414 shutdown_connections 2024-08-31T06:23:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:40.124+0000 7f4f303e6640 1 -- 172.21.15.53:0/567235414 wait complete. 2024-08-31T06:23:40.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 36049 5.65 MB/sec execute 208 sec latency 102.676 ms 2024-08-31T06:23:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.450+0000 7f7519ac5640 1 -- 172.21.15.53:0/127768706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7514102840 msgr2=0x7f7514102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.450+0000 7f7519ac5640 1 --2- 172.21.15.53:0/127768706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7514102840 0x7f7514102c50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7504009900 tx=0x7f750402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.451+0000 7f7519ac5640 1 -- 172.21.15.53:0/127768706 shutdown_connections 2024-08-31T06:23:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.451+0000 7f7519ac5640 1 --2- 172.21.15.53:0/127768706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7514108ad0 0x7f751406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.451+0000 7f7519ac5640 1 --2- 172.21.15.53:0/127768706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7514108180 0x7f7514108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.451+0000 7f7519ac5640 1 --2- 172.21.15.53:0/127768706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7514102840 0x7f7514102c50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.451+0000 7f7519ac5640 1 -- 172.21.15.53:0/127768706 >> 172.21.15.53:0/127768706 conn(0x7f75140794f0 msgr2=0x7f7514079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:40.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.452+0000 7f7519ac5640 1 -- 172.21.15.53:0/127768706 shutdown_connections 2024-08-31T06:23:40.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.452+0000 7f7519ac5640 1 -- 172.21.15.53:0/127768706 wait complete. 2024-08-31T06:23:40.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.453+0000 7f7519ac5640 1 Processor -- start 2024-08-31T06:23:40.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.454+0000 7f7519ac5640 1 -- start start 2024-08-31T06:23:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.454+0000 7f7519ac5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7514102840 0x7f7514113350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.454+0000 7f7519ac5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7514108180 0x7f75141138d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.455+0000 7f7519ac5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7514108ad0 0x7f7514118b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.455+0000 7f7519ac5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7514111690 con 0x7f7514102840 2024-08-31T06:23:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.455+0000 7f7519ac5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7514111510 con 0x7f7514108ad0 2024-08-31T06:23:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.455+0000 7f7519ac5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7514111810 con 0x7f7514108180 2024-08-31T06:23:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.455+0000 7f75137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7514102840 0x7f7514113350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.455+0000 7f75137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7514102840 0x7f7514113350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47048/0 (socket says 172.21.15.53:47048) 2024-08-31T06:23:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.455+0000 7f75137fe640 1 -- 172.21.15.53:0/1845786821 learned_addr learned my addr 172.21.15.53:0/1845786821 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.456+0000 7f7513fff640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7514108ad0 0x7f7514118b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.456+0000 7f75137fe640 1 -- 172.21.15.53:0/1845786821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7514108180 msgr2=0x7f75141138d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T06:23:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.456+0000 7f75137fe640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7514108180 0x7f75141138d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.456+0000 7f75137fe640 1 -- 172.21.15.53:0/1845786821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7514108ad0 msgr2=0x7f7514118b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.456+0000 7f75137fe640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7514108ad0 0x7f7514118b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.456+0000 7f75137fe640 1 -- 172.21.15.53:0/1845786821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751411df10 con 0x7f7514102840 2024-08-31T06:23:40.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.456+0000 7f75137fe640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7514102840 0x7f7514113350 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f750402a960 tx=0x7f7504003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:40.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.457+0000 7f7510ff9640 1 -- 172.21.15.53:0/1845786821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750403f070 con 0x7f7514102840 2024-08-31T06:23:40.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.457+0000 7f7510ff9640 1 -- 172.21.15.53:0/1845786821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f750403baf0 con 0x7f7514102840 2024-08-31T06:23:40.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.457+0000 7f7510ff9640 1 -- 172.21.15.53:0/1845786821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504035030 con 0x7f7514102840 2024-08-31T06:23:40.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.457+0000 7f7519ac5640 1 -- 172.21.15.53:0/1845786821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7514119130 con 0x7f7514102840 2024-08-31T06:23:40.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.458+0000 7f7519ac5640 1 -- 172.21.15.53:0/1845786821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75141195c0 con 0x7f7514102840 2024-08-31T06:23:40.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.461+0000 7f752003a740 1 Processor -- start 2024-08-31T06:23:40.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.462+0000 7f752003a740 1 -- start start 2024-08-31T06:23:40.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.462+0000 7f752003a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230925070 0x55c230cca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.462+0000 7f752003a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2308fc1b0 0x55c230cca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.462+0000 7f752003a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230ccad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.462+0000 7f752003a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c230c41680 con 0x55c2308fc1b0 2024-08-31T06:23:40.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.462+0000 7f752003a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c230c30c10 con 0x55c230925070 2024-08-31T06:23:40.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.462+0000 7f752003a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c230c34bc0 con 0x55c230904390 2024-08-31T06:23:40.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.462+0000 7f7513fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230925070 0x55c230cca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.462+0000 7f7513fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230925070 0x55c230cca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47022/0 (socket says 172.21.15.53:47022) 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.462+0000 7f7513fff640 1 -- 172.21.15.53:0/2441268411 learned_addr learned my addr 172.21.15.53:0/2441268411 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.462+0000 7f7512ffd640 1 --2- 172.21.15.53:0/2441268411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230ccad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.463+0000 7f7510ff9640 1 -- 172.21.15.53:0/1845786821 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7504042070 con 0x7f7514102840 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.463+0000 7f7513fff640 1 -- 172.21.15.53:0/2441268411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 msgr2=0x55c230ccad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.463+0000 7f7513fff640 1 --2- 172.21.15.53:0/2441268411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230ccad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.463+0000 7f7513fff640 1 -- 172.21.15.53:0/2441268411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2308fc1b0 msgr2=0x55c230cca850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.463+0000 7f75137fe640 1 --2- 172.21.15.53:0/2441268411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2308fc1b0 0x55c230cca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.463+0000 7f7513fff640 1 --2- 172.21.15.53:0/2441268411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2308fc1b0 0x55c230cca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.463+0000 7f7513fff640 1 -- 172.21.15.53:0/2441268411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c230990650 con 0x55c230925070 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.463+0000 7f75137fe640 1 --2- 172.21.15.53:0/2441268411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2308fc1b0 0x55c230cca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.464+0000 7f7510ff9640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74fc0b4dd0 0x7f74fc0b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.464+0000 7f7513fff640 1 --2- 172.21.15.53:0/2441268411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230925070 0x55c230cca310 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f750c009d70 tx=0x7f750c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee63d0e07cc1090f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:40.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.464+0000 7f7510ff9640 1 -- 172.21.15.53:0/1845786821 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f7504105e30 con 0x7f7514102840 2024-08-31T06:23:40.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.464+0000 7f75137fe640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74fc0b4dd0 0x7f74fc0b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.464+0000 7f74f9ffb640 1 -- 172.21.15.53:0/2441268411 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c003970 con 0x55c230925070 2024-08-31T06:23:40.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.464+0000 7f74f9ffb640 1 -- 172.21.15.53:0/2441268411 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f750c004030 con 0x55c230925070 2024-08-31T06:23:40.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.464+0000 7f74f9ffb640 1 -- 172.21.15.53:0/2441268411 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c0116a0 con 0x55c230925070 2024-08-31T06:23:40.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.465+0000 7f752003a740 1 -- 172.21.15.53:0/2441268411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230925070 msgr2=0x55c230cca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.465+0000 7f75137fe640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74fc0b4dd0 0x7f74fc0b72e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55c230cc8f90 tx=0x7f7504009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.465+0000 7f752003a740 1 --2- 172.21.15.53:0/2441268411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230925070 0x55c230cca310 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f750c009d70 tx=0x7f750c00f730 comp rx=0 tx=0).stop 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.466+0000 7f752003a740 1 -- 172.21.15.53:0/2441268411 shutdown_connections 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.466+0000 7f752003a740 1 --2- 172.21.15.53:0/2441268411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230ccad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.466+0000 7f752003a740 1 --2- 172.21.15.53:0/2441268411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2308fc1b0 0x55c230cca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.466+0000 7f752003a740 1 --2- 172.21.15.53:0/2441268411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230925070 0x55c230cca310 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.466+0000 7f752003a740 1 -- 172.21.15.53:0/2441268411 >> 172.21.15.53:0/2441268411 conn(0x55c230919460 msgr2=0x55c230cc8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.466+0000 7f752003a740 1 -- 172.21.15.53:0/2441268411 shutdown_connections 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.466+0000 7f752003a740 1 -- 172.21.15.53:0/2441268411 wait complete. 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.466+0000 7f752003a740 1 -- start start 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.466+0000 7f752003a740 1 Processor -- start 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f752003a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 0x55c230cd5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f752003a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230cd6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f752003a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230ce1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f752003a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c230a93700 con 0x55c230925070 2024-08-31T06:23:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f752003a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c230bb7750 con 0x55c2308fc1b0 2024-08-31T06:23:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f752003a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c230cd8b40 con 0x55c230904390 2024-08-31T06:23:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f752003a740 10 client.0 _ll_register_callbacks cb 0x55c230be6e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f7513fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230ce1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f7513fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230ce1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47068/0 (socket says 172.21.15.53:47068) 2024-08-31T06:23:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f7513fff640 1 -- 172.21.15.53:0/1459724712 learned_addr learned my addr 172.21.15.53:0/1459724712 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f7512ffd640 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230cd6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f7513fff640 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 0x55c230cd5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.467+0000 7f7513fff640 1 -- 172.21.15.53:0/1459724712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 msgr2=0x55c230cd6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.468+0000 7f7513fff640 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230cd6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.468+0000 7f7513fff640 1 -- 172.21.15.53:0/1459724712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 msgr2=0x55c230cd5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.468+0000 7f7513fff640 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 0x55c230cd5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.468+0000 7f7513fff640 1 -- 172.21.15.53:0/1459724712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c230bf0900 con 0x55c230925070 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.468+0000 7f7513fff640 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230ce1e90 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f750c0048f0 tx=0x7f750c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47ce3dcf4b6aacc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.468+0000 7f74f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.468+0000 7f74f2ffd640 1 -- 172.21.15.53:0/1459724712 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c01e020 con 0x55c230925070 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.468+0000 7f752003a740 1 -- 172.21.15.53:0/1459724712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f750c004030 con 0x55c230925070 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.468+0000 7f74f2ffd640 1 -- 172.21.15.53:0/1459724712 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f750c004a00 con 0x55c230925070 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f74f2ffd640 1 -- 172.21.15.53:0/1459724712 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f750c024040 con 0x55c230925070 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f752003a740 10 client.21261 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f752003a740 1 -- 172.21.15.53:0/1459724712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55c230ce4880 con 0x55c230925070 2024-08-31T06:23:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f74f2ffd640 1 -- 172.21.15.53:0/1459724712 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f750c004030 con 0x55c230925070 2024-08-31T06:23:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f74f2ffd640 1 -- 172.21.15.53:0/1459724712 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f750c01a430 con 0x55c230925070 2024-08-31T06:23:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f752003a740 10 client.21261 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f752003a740 10 client.21261 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:23:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f752003a740 20 client.21261 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f752003a740 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55c2308e39f0 0x55c230ce7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f752003a740 4 client.21261 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f752003a740 1 -- 172.21.15.53:0/1459724712 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c230c435d0 con 0x55c2308e39f0 2024-08-31T06:23:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.469+0000 7f7512ffd640 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55c2308e39f0 0x55c230ce7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.470+0000 7f74f2ffd640 10 client.21261 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:23:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.470+0000 7f7512ffd640 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55c2308e39f0 0x55c230ce7ca0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fc594765a15baa78 server_cookie=cff92e25a0a7ed28 in_seq=0 out_seq=0 2024-08-31T06:23:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f74f2ffd640 1 -- 172.21.15.53:0/1459724712 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c230c435d0 con 0x55c2308e39f0 2024-08-31T06:23:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f74f2ffd640 10 client.21261 handle_command_reply: tid=0 2024-08-31T06:23:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f752003a740 1 client.21261 shutdown 2024-08-31T06:23:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f752003a740 1 -- 172.21.15.53:0/1459724712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 msgr2=0x55c230ce1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f752003a740 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230ce1e90 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f750c0048f0 tx=0x7f750c005a50 comp rx=0 tx=0).stop 2024-08-31T06:23:40.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f752003a740 1 -- 172.21.15.53:0/1459724712 shutdown_connections 2024-08-31T06:23:40.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f752003a740 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230ce1e90 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f752003a740 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55c2308e39f0 0x55c230ce7ca0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f752003a740 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230cd6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f752003a740 1 --2- 172.21.15.53:0/1459724712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 0x55c230cd5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f752003a740 1 -- 172.21.15.53:0/1459724712 >> 172.21.15.53:0/1459724712 conn(0x55c230919460 msgr2=0x55c230ccd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:40.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f74f2ffd640 0 client.21261 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:23:40.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f752003a740 1 -- 172.21.15.53:0/1459724712 shutdown_connections 2024-08-31T06:23:40.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.471+0000 7f752003a740 1 -- 172.21.15.53:0/1459724712 wait complete. 2024-08-31T06:23:40.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.472+0000 7f752003a740 20 client.21261 trim_cache size 0 max 16384 2024-08-31T06:23:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.493+0000 7f752003a740 1 Processor -- start 2024-08-31T06:23:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.493+0000 7f752003a740 1 -- start start 2024-08-31T06:23:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.494+0000 7f752003a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c2308fc1b0 0x55c230ccdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.494+0000 7f752003a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230904390 0x55c230ce1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.494+0000 7f752003a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230cd2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.494+0000 7f752003a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f75141be380 con 0x55c230925070 2024-08-31T06:23:40.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.494+0000 7f752003a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75141bff20 con 0x55c230904390 2024-08-31T06:23:40.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.494+0000 7f752003a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f75141beab0 con 0x55c2308fc1b0 2024-08-31T06:23:40.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.494+0000 7f7513fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c2308fc1b0 0x55c230ccdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.494+0000 7f7513fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c2308fc1b0 0x55c230ccdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51136/0 (socket says 172.21.15.53:51136) 2024-08-31T06:23:40.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.494+0000 7f7513fff640 1 -- 172.21.15.53:0/3898974420 learned_addr learned my addr 172.21.15.53:0/3898974420 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:40.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.494+0000 7f7513fff640 1 --2- 172.21.15.53:0/3898974420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230cd2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.494+0000 7f7512ffd640 1 --2- 172.21.15.53:0/3898974420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230904390 0x55c230ce1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.495+0000 7f7513fff640 1 -- 172.21.15.53:0/3898974420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230904390 msgr2=0x55c230ce1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.495+0000 7f7513fff640 1 --2- 172.21.15.53:0/3898974420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230904390 0x55c230ce1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.495+0000 7f7513fff640 1 -- 172.21.15.53:0/3898974420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 msgr2=0x55c230cd2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.495+0000 7f7513fff640 1 --2- 172.21.15.53:0/3898974420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230cd2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.495+0000 7f7513fff640 1 -- 172.21.15.53:0/3898974420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c230ccd170 con 0x55c2308fc1b0 2024-08-31T06:23:40.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.495+0000 7f7513fff640 1 --2- 172.21.15.53:0/3898974420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c2308fc1b0 0x55c230ccdb20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f750c005fd0 tx=0x7f750c00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6dfbe5ddb19e9f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.495+0000 7f74f97fa640 1 -- 172.21.15.53:0/3898974420 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c01e040 con 0x55c2308fc1b0 2024-08-31T06:23:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.495+0000 7f74f97fa640 1 -- 172.21.15.53:0/3898974420 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f750c005ac0 con 0x55c2308fc1b0 2024-08-31T06:23:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.495+0000 7f74f97fa640 1 -- 172.21.15.53:0/3898974420 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c02b470 con 0x55c2308fc1b0 2024-08-31T06:23:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.496+0000 7f752003a740 1 -- 172.21.15.53:0/3898974420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c2308fc1b0 msgr2=0x55c230ccdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.496+0000 7f752003a740 1 --2- 172.21.15.53:0/3898974420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c2308fc1b0 0x55c230ccdb20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f750c005fd0 tx=0x7f750c00f730 comp rx=0 tx=0).stop 2024-08-31T06:23:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.496+0000 7f752003a740 1 -- 172.21.15.53:0/3898974420 shutdown_connections 2024-08-31T06:23:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.496+0000 7f752003a740 1 --2- 172.21.15.53:0/3898974420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230cd2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.497+0000 7f752003a740 1 --2- 172.21.15.53:0/3898974420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c230904390 0x55c230ce1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.497+0000 7f752003a740 1 --2- 172.21.15.53:0/3898974420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c2308fc1b0 0x55c230ccdb20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.497+0000 7f752003a740 1 -- 172.21.15.53:0/3898974420 >> 172.21.15.53:0/3898974420 conn(0x55c230919460 msgr2=0x55c230ccd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.497+0000 7f752003a740 1 -- 172.21.15.53:0/3898974420 shutdown_connections 2024-08-31T06:23:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.497+0000 7f752003a740 1 -- 172.21.15.53:0/3898974420 wait complete. 2024-08-31T06:23:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.497+0000 7f752003a740 1 -- start start 2024-08-31T06:23:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.497+0000 7f752003a740 1 Processor -- start 2024-08-31T06:23:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f752003a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 0x55c230cde680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f752003a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230cd9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f7513fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 0x55c230cde680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f7513fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 0x55c230cde680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47050/0 (socket says 172.21.15.53:47050) 2024-08-31T06:23:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f7513fff640 1 -- 172.21.15.53:0/3789466072 learned_addr learned my addr 172.21.15.53:0/3789466072 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f752003a740 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230cda160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f752003a740 1 -- 172.21.15.53:0/3789466072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f75141bf850 con 0x55c230925070 2024-08-31T06:23:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f752003a740 1 -- 172.21.15.53:0/3789466072 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75141bf180 con 0x55c2308fc1b0 2024-08-31T06:23:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f752003a740 1 -- 172.21.15.53:0/3789466072 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f75141bc380 con 0x55c230904390 2024-08-31T06:23:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f752003a740 10 client.0 _ll_register_callbacks cb 0x7f7508009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:40.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f7512ffd640 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230cd9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.498+0000 7f7513fff640 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230cda160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.499+0000 7f7513fff640 1 -- 172.21.15.53:0/3789466072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 msgr2=0x55c230cd9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.499+0000 7f7513fff640 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230cd9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.499+0000 7f7513fff640 1 -- 172.21.15.53:0/3789466072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 msgr2=0x55c230cda160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.499+0000 7f7513fff640 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230cda160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.499+0000 7f7513fff640 1 -- 172.21.15.53:0/3789466072 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c230cda8f0 con 0x55c2308fc1b0 2024-08-31T06:23:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.499+0000 7f7513fff640 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 0x55c230cde680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f750c00feb0 tx=0x7f750c0096f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=134f4451a4dfc984 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.499+0000 7f74f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:23:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.499+0000 7f74f2ffd640 1 -- 172.21.15.53:0/3789466072 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c01e030 con 0x55c2308fc1b0 2024-08-31T06:23:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.499+0000 7f74f2ffd640 1 -- 172.21.15.53:0/3789466072 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f750c004890 con 0x55c2308fc1b0 2024-08-31T06:23:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.499+0000 7f752003a740 1 -- 172.21.15.53:0/3789466072 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f750c005ac0 con 0x55c2308fc1b0 2024-08-31T06:23:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.500+0000 7f74f2ffd640 1 -- 172.21.15.53:0/3789466072 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f750c004a90 con 0x55c2308fc1b0 2024-08-31T06:23:40.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.500+0000 7f752003a740 10 client.30104 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:40.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.500+0000 7f752003a740 1 -- 172.21.15.53:0/3789466072 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55c230d524b0 con 0x55c2308fc1b0 2024-08-31T06:23:40.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.500+0000 7f74f2ffd640 1 -- 172.21.15.53:0/3789466072 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f750c005ac0 con 0x55c2308fc1b0 2024-08-31T06:23:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.500+0000 7f74f2ffd640 1 -- 172.21.15.53:0/3789466072 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f750c034070 con 0x55c2308fc1b0 2024-08-31T06:23:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.500+0000 7f752003a740 10 client.30104 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.500+0000 7f752003a740 10 client.30104 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.500+0000 7f752003a740 20 client.30104 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.500+0000 7f752003a740 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55c2308b8da0 0x55c230d54c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.501+0000 7f752003a740 4 client.30104 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.501+0000 7f752003a740 1 -- 172.21.15.53:0/3789466072 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c230cd6450 con 0x55c2308b8da0 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.501+0000 7f7512ffd640 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55c2308b8da0 0x55c230d54c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.501+0000 7f7512ffd640 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55c2308b8da0 0x55c230d54c10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=eeedf5525555e891 server_cookie=42c381bcd7e84111 in_seq=0 out_seq=0 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.501+0000 7f74f2ffd640 10 client.30104 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f74f2ffd640 1 -- 172.21.15.53:0/3789466072 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c230cd6450 con 0x55c2308b8da0 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f74f2ffd640 10 client.30104 handle_command_reply: tid=0 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f752003a740 1 client.30104 shutdown 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f752003a740 1 -- 172.21.15.53:0/3789466072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 msgr2=0x55c230cde680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f752003a740 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 0x55c230cde680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f750c00feb0 tx=0x7f750c0096f0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f752003a740 1 -- 172.21.15.53:0/3789466072 shutdown_connections 2024-08-31T06:23:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f752003a740 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c230925070 0x55c230cda160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f752003a740 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55c2308b8da0 0x55c230d54c10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f752003a740 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c230904390 0x55c230cd9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f752003a740 1 --2- 172.21.15.53:0/3789466072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2308fc1b0 0x55c230cde680 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f74f2ffd640 0 client.30104 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:23:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.502+0000 7f752003a740 1 -- 172.21.15.53:0/3789466072 >> 172.21.15.53:0/3789466072 conn(0x55c230919460 msgr2=0x55c230ccb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.503+0000 7f752003a740 1 -- 172.21.15.53:0/3789466072 shutdown_connections 2024-08-31T06:23:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.503+0000 7f752003a740 1 -- 172.21.15.53:0/3789466072 wait complete. 2024-08-31T06:23:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.503+0000 7f752003a740 20 client.30104 trim_cache size 0 max 16384 2024-08-31T06:23:40.507 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:23:40.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 -- 172.21.15.53:0/1845786821 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74fc0b4dd0 msgr2=0x7f74fc0b72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74fc0b4dd0 0x7f74fc0b72e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55c230cc8f90 tx=0x7f7504009260 comp rx=0 tx=0).stop 2024-08-31T06:23:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 -- 172.21.15.53:0/1845786821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7514102840 msgr2=0x7f7514113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7514102840 0x7f7514113350 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f750402a960 tx=0x7f7504003c00 comp rx=0 tx=0).stop 2024-08-31T06:23:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 -- 172.21.15.53:0/1845786821 shutdown_connections 2024-08-31T06:23:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74fc0b4dd0 0x7f74fc0b72e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7514108ad0 0x7f7514118b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7514108180 0x7f75141138d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 --2- 172.21.15.53:0/1845786821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7514102840 0x7f7514113350 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 -- 172.21.15.53:0/1845786821 >> 172.21.15.53:0/1845786821 conn(0x7f75140794f0 msgr2=0x7f7514106e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 -- 172.21.15.53:0/1845786821 shutdown_connections 2024-08-31T06:23:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:40.504+0000 7f7519ac5640 1 -- 172.21.15.53:0/1845786821 wait complete. 2024-08-31T06:23:41.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 36191 5.66 MB/sec execute 209 sec latency 111.907 ms 2024-08-31T06:23:41.513 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:23:41.873 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:41 smithi130 ceph-mon[22266]: pgmap v911: 97 pgs: 97 active+clean; 668 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 375 op/s 2024-08-31T06:23:42.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:41 smithi053 ceph-mon[18924]: pgmap v911: 97 pgs: 97 active+clean; 668 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 375 op/s 2024-08-31T06:23:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:41 smithi153 ceph-mon[22320]: pgmap v911: 97 pgs: 97 active+clean; 668 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 375 op/s 2024-08-31T06:23:42.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 36335 5.67 MB/sec execute 210 sec latency 70.545 ms 2024-08-31T06:23:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.569+0000 7ff4c187f640 1 -- 172.21.15.53:0/1827462863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4bc10dbb0 msgr2=0x7ff4bc1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.569+0000 7ff4c187f640 1 --2- 172.21.15.53:0/1827462863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4bc10dbb0 0x7ff4bc1100a0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009ca0 tx=0x7ff4b402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.569+0000 7ff4c187f640 1 -- 172.21.15.53:0/1827462863 shutdown_connections 2024-08-31T06:23:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.569+0000 7ff4c187f640 1 --2- 172.21.15.53:0/1827462863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4bc10dbb0 0x7ff4bc1100a0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.569+0000 7ff4c187f640 1 --2- 172.21.15.53:0/1827462863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4bc1050a0 0x7ff4bc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.569+0000 7ff4c187f640 1 --2- 172.21.15.53:0/1827462863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc104750 0x7ff4bc104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.569+0000 7ff4c187f640 1 -- 172.21.15.53:0/1827462863 >> 172.21.15.53:0/1827462863 conn(0x7ff4bc0794d0 msgr2=0x7ff4bc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.569+0000 7ff4c187f640 1 -- 172.21.15.53:0/1827462863 shutdown_connections 2024-08-31T06:23:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.569+0000 7ff4c187f640 1 -- 172.21.15.53:0/1827462863 wait complete. 2024-08-31T06:23:42.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.570+0000 7ff4c187f640 1 Processor -- start 2024-08-31T06:23:42.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.571+0000 7ff4c187f640 1 -- start start 2024-08-31T06:23:42.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.571+0000 7ff4c187f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc104750 0x7ff4bc19c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.571+0000 7ff4c187f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4bc1050a0 0x7ff4bc19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.571+0000 7ff4c187f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4bc10dbb0 0x7ff4bc1a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.571+0000 7ff4c187f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc113710 con 0x7ff4bc10dbb0 2024-08-31T06:23:42.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.571+0000 7ff4c187f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc113590 con 0x7ff4bc1050a0 2024-08-31T06:23:42.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.571+0000 7ff4c187f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc113890 con 0x7ff4bc104750 2024-08-31T06:23:42.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.571+0000 7ff4baffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc104750 0x7ff4bc19c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.571+0000 7ff4baffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc104750 0x7ff4bc19c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51160/0 (socket says 172.21.15.53:51160) 2024-08-31T06:23:42.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.571+0000 7ff4baffd640 1 -- 172.21.15.53:0/4141012055 learned_addr learned my addr 172.21.15.53:0/4141012055 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:42.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.571+0000 7ff4ba7fc640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4bc1050a0 0x7ff4bc19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.572+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4bc10dbb0 0x7ff4bc1a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.572+0000 7ff4baffd640 1 -- 172.21.15.53:0/4141012055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4bc1050a0 msgr2=0x7ff4bc19c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:42.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.572+0000 7ff4baffd640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4bc1050a0 0x7ff4bc19c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.572+0000 7ff4baffd640 1 -- 172.21.15.53:0/4141012055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4bc10dbb0 msgr2=0x7ff4bc1a1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:42.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.572+0000 7ff4baffd640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4bc10dbb0 0x7ff4bc1a1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.572+0000 7ff4baffd640 1 -- 172.21.15.53:0/4141012055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4bc1a22d0 con 0x7ff4bc104750 2024-08-31T06:23:42.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.572+0000 7ff4baffd640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc104750 0x7ff4bc19c360 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00e9c0 tx=0x7ff4ac00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:42.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.573+0000 7ff4c087d640 1 -- 172.21.15.53:0/4141012055 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00cd80 con 0x7ff4bc104750 2024-08-31T06:23:42.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.573+0000 7ff4c087d640 1 -- 172.21.15.53:0/4141012055 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4ac0044b0 con 0x7ff4bc104750 2024-08-31T06:23:42.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.573+0000 7ff4c187f640 1 -- 172.21.15.53:0/4141012055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4bc1a25c0 con 0x7ff4bc104750 2024-08-31T06:23:42.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.573+0000 7ff4c187f640 1 -- 172.21.15.53:0/4141012055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4bc1a8d20 con 0x7ff4bc104750 2024-08-31T06:23:42.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.573+0000 7ff4c087d640 1 -- 172.21.15.53:0/4141012055 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac010430 con 0x7ff4bc104750 2024-08-31T06:23:42.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.577+0000 7ff4c7df4740 1 Processor -- start 2024-08-31T06:23:42.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.577+0000 7ff4c087d640 1 -- 172.21.15.53:0/4141012055 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff4ac0105d0 con 0x7ff4bc104750 2024-08-31T06:23:42.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.577+0000 7ff4c7df4740 1 -- start start 2024-08-31T06:23:42.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.577+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a91f070 0x556d4acc4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.577+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8f61b0 0x556d4acc4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.577+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8fe390 0x556d4acc4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.577+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556d4ac3b680 con 0x556d4a8fe390 2024-08-31T06:23:42.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.577+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556d4ac2ac10 con 0x556d4a8f61b0 2024-08-31T06:23:42.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.577+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556d4ac2ebc0 con 0x556d4a91f070 2024-08-31T06:23:42.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4bb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a91f070 0x556d4acc4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4bb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a91f070 0x556d4acc4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51168/0 (socket says 172.21.15.53:51168) 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4bb7fe640 1 -- 172.21.15.53:0/4226383276 learned_addr learned my addr 172.21.15.53:0/4226383276 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4ba7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8fe390 0x556d4acc4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4baffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8f61b0 0x556d4acc4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4bb7fe640 1 -- 172.21.15.53:0/4226383276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8f61b0 msgr2=0x556d4acc4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/4226383276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8f61b0 0x556d4acc4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4bb7fe640 1 -- 172.21.15.53:0/4226383276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8fe390 msgr2=0x556d4acc4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/4226383276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8fe390 0x556d4acc4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4bb7fe640 1 -- 172.21.15.53:0/4226383276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d4a98a650 con 0x556d4a91f070 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4ba7fc640 1 --2- 172.21.15.53:0/4226383276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8fe390 0x556d4acc4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4c087d640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4a40b4d20 0x7ff4a40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.578+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/4226383276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a91f070 0x556d4acc4350 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009ca0 tx=0x7ff4b4009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=596852deba9173c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.579+0000 7ff4baffd640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4a40b4d20 0x7ff4a40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.579+0000 7ff4c087d640 1 -- 172.21.15.53:0/4141012055 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7ff4ac0e5940 con 0x7ff4bc104750 2024-08-31T06:23:42.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.579+0000 7ff4a1ffb640 1 -- 172.21.15.53:0/4226383276 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4031790 con 0x556d4a91f070 2024-08-31T06:23:42.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.579+0000 7ff4a1ffb640 1 -- 172.21.15.53:0/4226383276 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4b4036030 con 0x556d4a91f070 2024-08-31T06:23:42.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.579+0000 7ff4a1ffb640 1 -- 172.21.15.53:0/4226383276 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4004310 con 0x556d4a91f070 2024-08-31T06:23:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.580+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4226383276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a91f070 msgr2=0x556d4acc4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.580+0000 7ff4baffd640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4a40b4d20 0x7ff4a40b7230 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x556d4acc2fd0 tx=0x7ff4ac0eb530 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.580+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/4226383276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a91f070 0x556d4acc4350 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009ca0 tx=0x7ff4b4009a20 comp rx=0 tx=0).stop 2024-08-31T06:23:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.580+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4226383276 shutdown_connections 2024-08-31T06:23:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.580+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/4226383276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8fe390 0x556d4acc4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.580+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/4226383276 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8f61b0 0x556d4acc4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.580+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/4226383276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a91f070 0x556d4acc4350 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.580+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4226383276 >> 172.21.15.53:0/4226383276 conn(0x556d4a913460 msgr2=0x556d4acc2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.580+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4226383276 shutdown_connections 2024-08-31T06:23:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.580+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4226383276 wait complete. 2024-08-31T06:23:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.581+0000 7ff4c7df4740 1 -- start start 2024-08-31T06:23:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.581+0000 7ff4c7df4740 1 Processor -- start 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.582+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 0x556d4accfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.582+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 0x556d4acd0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.582+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a91f070 0x556d4acdbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.582+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556d4aa8d700 con 0x556d4a8f61b0 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.582+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556d4abb1750 con 0x556d4a91f070 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.582+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556d4acd2950 con 0x556d4a8fe390 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.582+0000 7ff4bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 0x556d4accfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.582+0000 7ff4ba7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 0x556d4acd0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.582+0000 7ff4c7df4740 10 client.0 _ll_register_callbacks cb 0x556d4abe0e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.582+0000 7ff4ba7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 0x556d4acd0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51172/0 (socket says 172.21.15.53:51172) 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.582+0000 7ff4ba7fc640 1 -- 172.21.15.53:0/4159326788 learned_addr learned my addr 172.21.15.53:0/4159326788 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.583+0000 7ff4bb7fe640 1 -- 172.21.15.53:0/4159326788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 msgr2=0x556d4acd0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.583+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 0x556d4acd0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.583+0000 7ff4bb7fe640 1 -- 172.21.15.53:0/4159326788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a91f070 msgr2=0x556d4acdbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.583+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a91f070 0x556d4acdbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.583+0000 7ff4bb7fe640 1 -- 172.21.15.53:0/4159326788 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d4abea900 con 0x556d4a8f61b0 2024-08-31T06:23:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.583+0000 7ff4ba7fc640 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 0x556d4acd0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.583+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 0x556d4accfb80 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4005e30 tx=0x7ff4b4003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10edf59e29792cb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.583+0000 7ff49affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.583+0000 7ff49affd640 1 -- 172.21.15.53:0/4159326788 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b404a040 con 0x556d4a8f61b0 2024-08-31T06:23:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.583+0000 7ff49affd640 1 -- 172.21.15.53:0/4159326788 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7ff4b4031b80 con 0x556d4a8f61b0 2024-08-31T06:23:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.583+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4159326788 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4b4036030 con 0x556d4a8f61b0 2024-08-31T06:23:42.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.584+0000 7ff49affd640 1 -- 172.21.15.53:0/4159326788 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ff4b405e050 con 0x556d4a8f61b0 2024-08-31T06:23:42.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.584+0000 7ff4c7df4740 10 client.21279 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:42.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.584+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4159326788 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x556d4acde7e0 con 0x556d4a8f61b0 2024-08-31T06:23:42.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.584+0000 7ff49affd640 1 -- 172.21.15.53:0/4159326788 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4b4055070 con 0x556d4a8f61b0 2024-08-31T06:23:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.584+0000 7ff49affd640 1 -- 172.21.15.53:0/4159326788 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7ff4b404d030 con 0x556d4a8f61b0 2024-08-31T06:23:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.584+0000 7ff4c7df4740 10 client.21279 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.584+0000 7ff4c7df4740 10 client.21279 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:23:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.584+0000 7ff4c7df4740 20 client.21279 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.584+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x556d4a8dd9f0 0x556d4ace1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.584+0000 7ff4c7df4740 4 client.21279 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.584+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4159326788 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff4b4036030 con 0x556d4a8dd9f0 2024-08-31T06:23:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.585+0000 7ff4ba7fc640 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x556d4a8dd9f0 0x556d4ace1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.585+0000 7ff49affd640 10 client.21279 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:23:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.585+0000 7ff4ba7fc640 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x556d4a8dd9f0 0x556d4ace1b40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5ec951f4eb2377a5 server_cookie=1fe8ebbf69f7863d in_seq=0 out_seq=0 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.586+0000 7ff49affd640 1 -- 172.21.15.53:0/4159326788 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7ff4b4036030 con 0x556d4a8dd9f0 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.586+0000 7ff49affd640 10 client.21279 handle_command_reply: tid=0 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.586+0000 7ff4c7df4740 1 client.21279 shutdown 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4159326788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 msgr2=0x556d4accfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 0x556d4accfb80 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4005e30 tx=0x7ff4b4003b80 comp rx=0 tx=0).stop 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4159326788 shutdown_connections 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a91f070 0x556d4acdbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 0x556d4acd0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x556d4a8dd9f0 0x556d4ace1b40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff49affd640 0 client.21279 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/4159326788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 0x556d4accfb80 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4159326788 >> 172.21.15.53:0/4159326788 conn(0x556d4a913460 msgr2=0x556d4acc74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4159326788 shutdown_connections 2024-08-31T06:23:42.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff4c7df4740 1 -- 172.21.15.53:0/4159326788 wait complete. 2024-08-31T06:23:42.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.587+0000 7ff4c7df4740 20 client.21279 trim_cache size 0 max 16384 2024-08-31T06:23:42.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.605+0000 7ff4c7df4740 1 Processor -- start 2024-08-31T06:23:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.605+0000 7ff4c7df4740 1 -- start start 2024-08-31T06:23:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.605+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8dd9f0 0x556d4acd17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.605+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 0x556d4acccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.605+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8fe390 0x556d4accd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.605+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1b1710 con 0x556d4a8f61b0 2024-08-31T06:23:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.605+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1b32b0 con 0x556d4a8fe390 2024-08-31T06:23:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.605+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1b1e40 con 0x556d4a8dd9f0 2024-08-31T06:23:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.605+0000 7ff4ba7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 0x556d4acccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.605+0000 7ff4ba7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 0x556d4acccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47130/0 (socket says 172.21.15.53:47130) 2024-08-31T06:23:42.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.605+0000 7ff4ba7fc640 1 -- 172.21.15.53:0/1013473572 learned_addr learned my addr 172.21.15.53:0/1013473572 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:42.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.606+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/1013473572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8dd9f0 0x556d4acd17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.606+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/1013473572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8fe390 0x556d4accd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.606+0000 7ff4ba7fc640 1 -- 172.21.15.53:0/1013473572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8dd9f0 msgr2=0x556d4acd17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.606+0000 7ff4ba7fc640 1 --2- 172.21.15.53:0/1013473572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8dd9f0 0x556d4acd17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.606+0000 7ff4ba7fc640 1 -- 172.21.15.53:0/1013473572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8fe390 msgr2=0x556d4accd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.606+0000 7ff4ba7fc640 1 --2- 172.21.15.53:0/1013473572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8fe390 0x556d4accd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.606+0000 7ff4ba7fc640 1 -- 172.21.15.53:0/1013473572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d4acc8370 con 0x556d4a8f61b0 2024-08-31T06:23:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.606+0000 7ff4ba7fc640 1 --2- 172.21.15.53:0/1013473572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 0x556d4acccd70 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0012a70 tx=0x7ff4b0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f7c5894bb7e66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.607+0000 7ff4a17fa640 1 -- 172.21.15.53:0/1013473572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b002a070 con 0x556d4a8f61b0 2024-08-31T06:23:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.607+0000 7ff4a17fa640 1 -- 172.21.15.53:0/1013473572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4b000fd30 con 0x556d4a8f61b0 2024-08-31T06:23:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.607+0000 7ff4a17fa640 1 -- 172.21.15.53:0/1013473572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0025b80 con 0x556d4a8f61b0 2024-08-31T06:23:42.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.608+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1013473572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 msgr2=0x556d4acccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.608+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/1013473572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 0x556d4acccd70 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0012a70 tx=0x7ff4b0005f90 comp rx=0 tx=0).stop 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.608+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1013473572 shutdown_connections 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.608+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/1013473572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8fe390 0x556d4accd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.608+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/1013473572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8f61b0 0x556d4acccd70 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.608+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/1013473572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8dd9f0 0x556d4acd17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.608+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1013473572 >> 172.21.15.53:0/1013473572 conn(0x556d4a913460 msgr2=0x556d4acd10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.608+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1013473572 shutdown_connections 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.608+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1013473572 wait complete. 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.608+0000 7ff4c7df4740 1 -- start start 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4c7df4740 1 Processor -- start 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8dd9f0 0x556d4ad40250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8f61b0 0x556d4ad40790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4c7df4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 0x556d4ad40cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1b2be0 con 0x556d4a8dd9f0 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1b2510 con 0x556d4a8f61b0 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4c7df4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1af710 con 0x556d4a8fe390 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4c7df4740 10 client.0 _ll_register_callbacks cb 0x7ff4b00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8dd9f0 0x556d4ad40250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8dd9f0 0x556d4ad40250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47146/0 (socket says 172.21.15.53:47146) 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4bb7fe640 1 -- 172.21.15.53:0/1375238314 learned_addr learned my addr 172.21.15.53:0/1375238314 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4ba7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8f61b0 0x556d4ad40790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.609+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 0x556d4ad40cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.610+0000 7ff4bb7fe640 1 -- 172.21.15.53:0/1375238314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 msgr2=0x556d4ad40cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.610+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 0x556d4ad40cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.610+0000 7ff4bb7fe640 1 -- 172.21.15.53:0/1375238314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8f61b0 msgr2=0x556d4ad40790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.610+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8f61b0 0x556d4ad40790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.610+0000 7ff4bb7fe640 1 -- 172.21.15.53:0/1375238314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d4ad4b320 con 0x556d4a8dd9f0 2024-08-31T06:23:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.610+0000 7ff4bb7fe640 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8dd9f0 0x556d4ad40250 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4030820 tx=0x7ff4b4003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cf3325f513f241 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.610+0000 7ff49affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.610+0000 7ff49affd640 1 -- 172.21.15.53:0/1375238314 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4031980 con 0x556d4a8dd9f0 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.610+0000 7ff49affd640 1 -- 172.21.15.53:0/1375238314 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7ff4b4031b20 con 0x556d4a8dd9f0 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.610+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1375238314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4b000fd30 con 0x556d4a8dd9f0 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.610+0000 7ff49affd640 1 -- 172.21.15.53:0/1375238314 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ff4b4031d20 con 0x556d4a8dd9f0 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.611+0000 7ff4c7df4740 10 client.21285 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.611+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1375238314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x556d4ad4c5a0 con 0x556d4a8dd9f0 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.612+0000 7ff49affd640 1 -- 172.21.15.53:0/1375238314 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4b4055070 con 0x556d4a8dd9f0 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.612+0000 7ff49affd640 1 -- 172.21.15.53:0/1375238314 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7ff4b404d030 con 0x556d4a8dd9f0 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.612+0000 7ff4c7df4740 10 client.21285 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.612+0000 7ff4c7df4740 10 client.21285 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.612+0000 7ff4c7df4740 20 client.21285 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.612+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x556d4a91f070 0x556d4ad4eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.612+0000 7ff4c7df4740 4 client.21285 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:23:42.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.612+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1375238314 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff4b000fd30 con 0x556d4a91f070 2024-08-31T06:23:42.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.612+0000 7ff4ba7fc640 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x556d4a91f070 0x556d4ad4eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:42.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.613+0000 7ff49affd640 10 client.21285 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:23:42.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.613+0000 7ff4ba7fc640 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x556d4a91f070 0x556d4ad4eba0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3aede8f9c6fe0603 server_cookie=a93150a3248772db in_seq=0 out_seq=0 2024-08-31T06:23:42.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.614+0000 7ff49affd640 1 -- 172.21.15.53:0/1375238314 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff4b000fd30 con 0x556d4a91f070 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.614+0000 7ff49affd640 10 client.21285 handle_command_reply: tid=0 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.614+0000 7ff4c7df4740 1 client.21285 shutdown 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.614+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1375238314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8dd9f0 msgr2=0x556d4ad40250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.615+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8dd9f0 0x556d4ad40250 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4030820 tx=0x7ff4b4003b80 comp rx=0 tx=0).stop 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.615+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1375238314 shutdown_connections 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.615+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d4a8fe390 0x556d4ad40cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.615+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556d4a8f61b0 0x556d4ad40790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.615+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x556d4a91f070 0x556d4ad4eba0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.615+0000 7ff4c7df4740 1 --2- 172.21.15.53:0/1375238314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556d4a8dd9f0 0x556d4ad40250 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.615+0000 7ff49affd640 0 client.21285 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.615+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1375238314 >> 172.21.15.53:0/1375238314 conn(0x556d4a913460 msgr2=0x556d4acd19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.615+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1375238314 shutdown_connections 2024-08-31T06:23:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.615+0000 7ff4c7df4740 1 -- 172.21.15.53:0/1375238314 wait complete. 2024-08-31T06:23:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.615+0000 7ff4c7df4740 20 client.21285 trim_cache size 0 max 16384 2024-08-31T06:23:42.619 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:23:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 -- 172.21.15.53:0/4141012055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4a40b4d20 msgr2=0x7ff4a40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4a40b4d20 0x7ff4a40b7230 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x556d4acc2fd0 tx=0x7ff4ac0eb530 comp rx=0 tx=0).stop 2024-08-31T06:23:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 -- 172.21.15.53:0/4141012055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc104750 msgr2=0x7ff4bc19c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc104750 0x7ff4bc19c360 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00e9c0 tx=0x7ff4ac00ee80 comp rx=0 tx=0).stop 2024-08-31T06:23:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 -- 172.21.15.53:0/4141012055 shutdown_connections 2024-08-31T06:23:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4a40b4d20 0x7ff4a40b7230 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4bc10dbb0 0x7ff4bc1a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4bc1050a0 0x7ff4bc19c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 --2- 172.21.15.53:0/4141012055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc104750 0x7ff4bc19c360 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 -- 172.21.15.53:0/4141012055 >> 172.21.15.53:0/4141012055 conn(0x7ff4bc0794d0 msgr2=0x7ff4bc103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 -- 172.21.15.53:0/4141012055 shutdown_connections 2024-08-31T06:23:42.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:42.616+0000 7ff4c187f640 1 -- 172.21.15.53:0/4141012055 wait complete. 2024-08-31T06:23:43.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 36493 5.67 MB/sec execute 211 sec latency 96.013 ms 2024-08-31T06:23:43.590 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:23:43.955 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:43.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:43 smithi053 ceph-mon[18924]: pgmap v912: 97 pgs: 97 active+clean; 670 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 297 op/s 2024-08-31T06:23:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:43 smithi130 ceph-mon[22266]: pgmap v912: 97 pgs: 97 active+clean; 670 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 297 op/s 2024-08-31T06:23:44.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:43 smithi153 ceph-mon[22320]: pgmap v912: 97 pgs: 97 active+clean; 670 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 297 op/s 2024-08-31T06:23:44.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 36636 5.69 MB/sec execute 212 sec latency 92.129 ms 2024-08-31T06:23:44.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.515+0000 7fac96fa6640 1 -- 172.21.15.53:0/235808056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac90109bc0 msgr2=0x7fac901103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:44.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.515+0000 7fac96fa6640 1 --2- 172.21.15.53:0/235808056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac90109bc0 0x7fac901103f0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fac88009be0 tx=0x7fac8802a6c0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.515+0000 7fac96fa6640 1 -- 172.21.15.53:0/235808056 shutdown_connections 2024-08-31T06:23:44.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.515+0000 7fac96fa6640 1 --2- 172.21.15.53:0/235808056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac90109bc0 0x7fac901103f0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.515+0000 7fac96fa6640 1 --2- 172.21.15.53:0/235808056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90109270 0x7fac90109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.515+0000 7fac96fa6640 1 --2- 172.21.15.53:0/235808056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac90103930 0x7fac90103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.515+0000 7fac96fa6640 1 -- 172.21.15.53:0/235808056 >> 172.21.15.53:0/235808056 conn(0x7fac900ff380 msgr2=0x7fac901017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.515+0000 7fac96fa6640 1 -- 172.21.15.53:0/235808056 shutdown_connections 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.515+0000 7fac96fa6640 1 -- 172.21.15.53:0/235808056 wait complete. 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.516+0000 7fac96fa6640 1 Processor -- start 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.516+0000 7fac96fa6640 1 -- start start 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.517+0000 7fac96fa6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac90103930 0x7fac90115980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.517+0000 7fac96fa6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac90109270 0x7fac90111c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.517+0000 7fac96fa6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90109bc0 0x7fac90112380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.517+0000 7fac96fa6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fac90076f80 con 0x7fac90109270 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.517+0000 7fac96fa6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac90076e00 con 0x7fac90109bc0 2024-08-31T06:23:44.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.517+0000 7fac96fa6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac90077100 con 0x7fac90103930 2024-08-31T06:23:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.517+0000 7fac94d42640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac90103930 0x7fac90115980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.517+0000 7fac95543640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90109bc0 0x7fac90112380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.517+0000 7fac95543640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90109bc0 0x7fac90112380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:56286/0 (socket says 172.21.15.53:56286) 2024-08-31T06:23:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.517+0000 7fac95543640 1 -- 172.21.15.53:0/755995492 learned_addr learned my addr 172.21.15.53:0/755995492 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.518+0000 7fac95543640 1 -- 172.21.15.53:0/755995492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac90103930 msgr2=0x7fac90115980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.518+0000 7fac95543640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac90103930 0x7fac90115980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.518+0000 7fac95543640 1 -- 172.21.15.53:0/755995492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac90109270 msgr2=0x7fac90111c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.518+0000 7fac95543640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac90109270 0x7fac90111c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.518+0000 7fac95543640 1 -- 172.21.15.53:0/755995492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac901ac850 con 0x7fac90109bc0 2024-08-31T06:23:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.519+0000 7fac95543640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90109bc0 0x7fac90112380 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fac88004af0 tx=0x7fac88030b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.519+0000 7fac8dffb640 1 -- 172.21.15.53:0/755995492 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88041020 con 0x7fac90109bc0 2024-08-31T06:23:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.519+0000 7fac96fa6640 1 -- 172.21.15.53:0/755995492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac901aca20 con 0x7fac90109bc0 2024-08-31T06:23:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.520+0000 7fac96fa6640 1 -- 172.21.15.53:0/755995492 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac901acfb0 con 0x7fac90109bc0 2024-08-31T06:23:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.520+0000 7fac8dffb640 1 -- 172.21.15.53:0/755995492 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac88037040 con 0x7fac90109bc0 2024-08-31T06:23:44.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.520+0000 7fac8dffb640 1 -- 172.21.15.53:0/755995492 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88036070 con 0x7fac90109bc0 2024-08-31T06:23:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.524+0000 7fac9d51b740 1 Processor -- start 2024-08-31T06:23:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.524+0000 7fac8dffb640 1 -- 172.21.15.53:0/755995492 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fac88044020 con 0x7fac90109bc0 2024-08-31T06:23:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.525+0000 7fac9d51b740 1 -- start start 2024-08-31T06:23:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.525+0000 7fac9d51b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 0x55919ffc0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.525+0000 7fac9d51b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbf21b0 0x55919ffc0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.525+0000 7fac9d51b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbfa390 0x55919ffc0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac9d51b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55919ff37680 con 0x55919fbfa390 2024-08-31T06:23:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac9d51b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55919ff26c10 con 0x55919fbf21b0 2024-08-31T06:23:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac9d51b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55919ff2abc0 con 0x55919fc1b070 2024-08-31T06:23:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 0x55919ffc0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 0x55919ffc0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50910/0 (socket says 172.21.15.53:50910) 2024-08-31T06:23:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac8ffff640 1 -- 172.21.15.53:0/2987233376 learned_addr learned my addr 172.21.15.53:0/2987233376 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac94d42640 1 --2- 172.21.15.53:0/2987233376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbf21b0 0x55919ffc0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac8ffff640 1 --2- 172.21.15.53:0/2987233376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbfa390 0x55919ffc0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac8ffff640 1 -- 172.21.15.53:0/2987233376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbf21b0 msgr2=0x55919ffc0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac8ffff640 1 --2- 172.21.15.53:0/2987233376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbf21b0 0x55919ffc0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac8ffff640 1 -- 172.21.15.53:0/2987233376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbfa390 msgr2=0x55919ffc0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac8ffff640 1 --2- 172.21.15.53:0/2987233376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbfa390 0x55919ffc0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac8ffff640 1 -- 172.21.15.53:0/2987233376 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55919fc86650 con 0x55919fc1b070 2024-08-31T06:23:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac8dffb640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac800b4ca0 0x7fac800b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.526+0000 7fac8ffff640 1 --2- 172.21.15.53:0/2987233376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 0x55919ffc0310 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005ab0 tx=0x7fac7c009630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c1e71c77506bb22 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.527+0000 7fac94d42640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac800b4ca0 0x7fac800b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.527+0000 7fac8dffb640 1 -- 172.21.15.53:0/755995492 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fac881058e0 con 0x7fac90109bc0 2024-08-31T06:23:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.527+0000 7fac7affd640 1 -- 172.21.15.53:0/2987233376 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c018030 con 0x55919fc1b070 2024-08-31T06:23:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.527+0000 7fac7affd640 1 -- 172.21.15.53:0/2987233376 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac7c0118d0 con 0x55919fc1b070 2024-08-31T06:23:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.527+0000 7fac7affd640 1 -- 172.21.15.53:0/2987233376 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c01c620 con 0x55919fc1b070 2024-08-31T06:23:44.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.528+0000 7fac9d51b740 1 -- 172.21.15.53:0/2987233376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 msgr2=0x55919ffc0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:44.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.528+0000 7fac94d42640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac800b4ca0 0x7fac800b71b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x55919ffbef90 tx=0x7fac84005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:44.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.528+0000 7fac9d51b740 1 --2- 172.21.15.53:0/2987233376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 0x55919ffc0310 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005ab0 tx=0x7fac7c009630 comp rx=0 tx=0).stop 2024-08-31T06:23:44.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.528+0000 7fac9d51b740 1 -- 172.21.15.53:0/2987233376 shutdown_connections 2024-08-31T06:23:44.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.528+0000 7fac9d51b740 1 --2- 172.21.15.53:0/2987233376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbfa390 0x55919ffc0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.528+0000 7fac9d51b740 1 --2- 172.21.15.53:0/2987233376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbf21b0 0x55919ffc0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.528+0000 7fac9d51b740 1 --2- 172.21.15.53:0/2987233376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 0x55919ffc0310 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.528+0000 7fac9d51b740 1 -- 172.21.15.53:0/2987233376 >> 172.21.15.53:0/2987233376 conn(0x55919fc0f460 msgr2=0x55919ffbe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:44.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.529+0000 7fac9d51b740 1 -- 172.21.15.53:0/2987233376 shutdown_connections 2024-08-31T06:23:44.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.529+0000 7fac9d51b740 1 -- 172.21.15.53:0/2987233376 wait complete. 2024-08-31T06:23:44.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.530+0000 7fac9d51b740 1 -- start start 2024-08-31T06:23:44.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.530+0000 7fac9d51b740 1 Processor -- start 2024-08-31T06:23:44.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.531+0000 7fac9d51b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbf21b0 0x55919ffcba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.532+0000 7fac94d42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbf21b0 0x55919ffcba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.532+0000 7fac94d42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbf21b0 0x55919ffcba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35166/0 (socket says 172.21.15.53:35166) 2024-08-31T06:23:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.532+0000 7fac94d42640 1 -- 172.21.15.53:0/451308737 learned_addr learned my addr 172.21.15.53:0/451308737 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.532+0000 7fac9d51b740 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffcbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.532+0000 7fac9d51b740 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 0x55919ffd7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.532+0000 7fac9d51b740 1 -- 172.21.15.53:0/451308737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55919fd89700 con 0x55919fbf21b0 2024-08-31T06:23:44.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.532+0000 7fac9d51b740 1 -- 172.21.15.53:0/451308737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55919fead750 con 0x55919fbfa390 2024-08-31T06:23:44.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.532+0000 7fac8ffff640 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffcbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.532+0000 7fac9d51b740 1 -- 172.21.15.53:0/451308737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55919ffceaf0 con 0x55919fc1b070 2024-08-31T06:23:44.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.532+0000 7fac95543640 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 0x55919ffd7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.533+0000 7fac8ffff640 1 -- 172.21.15.53:0/451308737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 msgr2=0x55919ffd7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:44.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.533+0000 7fac8ffff640 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 0x55919ffd7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.533+0000 7fac8ffff640 1 -- 172.21.15.53:0/451308737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbf21b0 msgr2=0x55919ffcba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:44.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.533+0000 7fac8ffff640 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbf21b0 0x55919ffcba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.533+0000 7fac8ffff640 1 -- 172.21.15.53:0/451308737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55919fee6900 con 0x55919fbfa390 2024-08-31T06:23:44.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.533+0000 7fac94d42640 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbf21b0 0x55919ffcba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:44.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.533+0000 7fac9d51b740 10 client.0 _ll_register_callbacks cb 0x55919fedce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:44.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.533+0000 7fac9d51b740 1 -- 172.21.15.53:0/451308737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac7c0118d0 con 0x55919fbfa390 2024-08-31T06:23:44.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.533+0000 7fac8ffff640 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffcbfd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0096c0 tx=0x7fac7c012d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45f790a9e89a2ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:44.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.533+0000 7fac6ffff640 10 client.30131 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:23:44.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.533+0000 7fac6ffff640 1 -- 172.21.15.53:0/451308737 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c02a060 con 0x55919fbfa390 2024-08-31T06:23:44.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac6ffff640 1 -- 172.21.15.53:0/451308737 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fac7c004450 con 0x55919fbfa390 2024-08-31T06:23:44.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac6ffff640 1 -- 172.21.15.53:0/451308737 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fac7c0035f0 con 0x55919fbfa390 2024-08-31T06:23:44.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac9d51b740 10 client.30131 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:44.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac9d51b740 1 -- 172.21.15.53:0/451308737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=66}) -- 0x55919ffda730 con 0x55919fbfa390 2024-08-31T06:23:44.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac6ffff640 1 -- 172.21.15.53:0/451308737 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fac7c024030 con 0x55919fbfa390 2024-08-31T06:23:44.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac9d51b740 10 client.30131 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:44.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac9d51b740 10 client.30131 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:23:44.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac9d51b740 20 client.30131 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:44.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac9d51b740 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55919fbd99f0 0x55919ffdda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac9d51b740 4 client.30131 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:44.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac9d51b740 1 -- 172.21.15.53:0/451308737 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55919ff395d0 con 0x55919fbd99f0 2024-08-31T06:23:44.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.534+0000 7fac94d42640 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55919fbd99f0 0x55919ffdda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.535+0000 7fac94d42640 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55919fbd99f0 0x55919ffdda90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=93a6b495fc9b585b server_cookie=385f603819cf354f in_seq=0 out_seq=0 2024-08-31T06:23:44.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.535+0000 7fac6ffff640 10 client.30131 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac6ffff640 1 -- 172.21.15.53:0/451308737 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55919ff395d0 con 0x55919fbd99f0 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac6ffff640 10 client.30131 handle_command_reply: tid=0 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac9d51b740 1 client.30131 shutdown 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac9d51b740 1 -- 172.21.15.53:0/451308737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 msgr2=0x55919ffcbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac9d51b740 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffcbfd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0096c0 tx=0x7fac7c012d40 comp rx=0 tx=0).stop 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac9d51b740 1 -- 172.21.15.53:0/451308737 shutdown_connections 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac9d51b740 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55919fbd99f0 0x55919ffdda90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac9d51b740 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fc1b070 0x55919ffd7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac6ffff640 0 client.30131 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac9d51b740 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffcbfd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac9d51b740 1 --2- 172.21.15.53:0/451308737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbf21b0 0x55919ffcba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac9d51b740 1 -- 172.21.15.53:0/451308737 >> 172.21.15.53:0/451308737 conn(0x55919fc0f460 msgr2=0x55919ffc34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:44.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac9d51b740 1 -- 172.21.15.53:0/451308737 shutdown_connections 2024-08-31T06:23:44.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.536+0000 7fac9d51b740 1 -- 172.21.15.53:0/451308737 wait complete. 2024-08-31T06:23:44.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.537+0000 7fac9d51b740 20 client.30131 trim_cache size 0 max 16384 2024-08-31T06:23:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.558+0000 7fac9d51b740 1 Processor -- start 2024-08-31T06:23:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.558+0000 7fac9d51b740 1 -- start start 2024-08-31T06:23:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac9d51b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbd99f0 0x55919ffc3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac9d51b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 0x55919ffc3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac9d51b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffc8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac9d51b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fac7400e8a0 con 0x55919fbd99f0 2024-08-31T06:23:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac9d51b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac74010440 con 0x55919fbfa390 2024-08-31T06:23:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac9d51b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac7400efd0 con 0x55919fbf21b0 2024-08-31T06:23:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac94d42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbd99f0 0x55919ffc3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac95543640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffc8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac94d42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbd99f0 0x55919ffc3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35182/0 (socket says 172.21.15.53:35182) 2024-08-31T06:23:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac94d42640 1 -- 172.21.15.53:0/2355116504 learned_addr learned my addr 172.21.15.53:0/2355116504 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac95543640 1 --2- 172.21.15.53:0/2355116504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffc8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:56318/0 (socket says 172.21.15.53:56318) 2024-08-31T06:23:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac8ffff640 1 --2- 172.21.15.53:0/2355116504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 0x55919ffc3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac94d42640 1 -- 172.21.15.53:0/2355116504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 msgr2=0x55919ffc3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac94d42640 1 --2- 172.21.15.53:0/2355116504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 0x55919ffc3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac94d42640 1 -- 172.21.15.53:0/2355116504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 msgr2=0x55919ffc8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac94d42640 1 --2- 172.21.15.53:0/2355116504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffc8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.559+0000 7fac94d42640 1 -- 172.21.15.53:0/2355116504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55919ffccb30 con 0x55919fbd99f0 2024-08-31T06:23:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.560+0000 7fac94d42640 1 --2- 172.21.15.53:0/2355116504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbd99f0 0x55919ffc3410 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fac84013010 tx=0x7fac8401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f52e9b8fb9c618 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.560+0000 7fac7a7fc640 1 -- 172.21.15.53:0/2355116504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84036070 con 0x55919fbd99f0 2024-08-31T06:23:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.560+0000 7fac7a7fc640 1 -- 172.21.15.53:0/2355116504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac8401dd60 con 0x55919fbd99f0 2024-08-31T06:23:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.560+0000 7fac7a7fc640 1 -- 172.21.15.53:0/2355116504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84031b90 con 0x55919fbd99f0 2024-08-31T06:23:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.561+0000 7fac9d51b740 1 -- 172.21.15.53:0/2355116504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbd99f0 msgr2=0x55919ffc3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.561+0000 7fac9d51b740 1 --2- 172.21.15.53:0/2355116504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbd99f0 0x55919ffc3410 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fac84013010 tx=0x7fac8401a000 comp rx=0 tx=0).stop 2024-08-31T06:23:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.561+0000 7fac9d51b740 1 -- 172.21.15.53:0/2355116504 shutdown_connections 2024-08-31T06:23:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.561+0000 7fac9d51b740 1 --2- 172.21.15.53:0/2355116504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffc8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.561+0000 7fac9d51b740 1 --2- 172.21.15.53:0/2355116504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 0x55919ffc3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.561+0000 7fac9d51b740 1 --2- 172.21.15.53:0/2355116504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fbd99f0 0x55919ffc3410 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.561+0000 7fac9d51b740 1 -- 172.21.15.53:0/2355116504 >> 172.21.15.53:0/2355116504 conn(0x55919fc0f460 msgr2=0x55919ffca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.561+0000 7fac9d51b740 1 -- 172.21.15.53:0/2355116504 shutdown_connections 2024-08-31T06:23:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.562+0000 7fac9d51b740 1 -- 172.21.15.53:0/2355116504 wait complete. 2024-08-31T06:23:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.562+0000 7fac9d51b740 1 -- start start 2024-08-31T06:23:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.562+0000 7fac9d51b740 1 Processor -- start 2024-08-31T06:23:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac9d51b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 0x55919ffd01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac9d51b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffd0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac9d51b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fc1b070 0x5591a0047340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac94d42640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 0x55919ffd01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffd0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac94d42640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 0x55919ffd01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50942/0 (socket says 172.21.15.53:50942) 2024-08-31T06:23:44.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffd0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:56334/0 (socket says 172.21.15.53:56334) 2024-08-31T06:23:44.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac95543640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fc1b070 0x5591a0047340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac95543640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fc1b070 0x5591a0047340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35196/0 (socket says 172.21.15.53:35196) 2024-08-31T06:23:44.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac94d42640 1 -- 172.21.15.53:0/3269593267 learned_addr learned my addr 172.21.15.53:0/3269593267 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:44.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac9d51b740 1 -- 172.21.15.53:0/3269593267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fac7400fd70 con 0x55919fc1b070 2024-08-31T06:23:44.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac9d51b740 1 -- 172.21.15.53:0/3269593267 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac7400f6a0 con 0x55919fbfa390 2024-08-31T06:23:44.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.563+0000 7fac9d51b740 1 -- 172.21.15.53:0/3269593267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac7400c8a0 con 0x55919fbf21b0 2024-08-31T06:23:44.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.564+0000 7fac9d51b740 10 client.0 _ll_register_callbacks cb 0x7fac840095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:44.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.564+0000 7fac94d42640 1 -- 172.21.15.53:0/3269593267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 msgr2=0x55919ffd0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:44.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.564+0000 7fac94d42640 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffd0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.564+0000 7fac94d42640 1 -- 172.21.15.53:0/3269593267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fc1b070 msgr2=0x5591a0047340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:44.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.564+0000 7fac94d42640 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fc1b070 0x5591a0047340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.564+0000 7fac94d42640 1 -- 172.21.15.53:0/3269593267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a0047880 con 0x55919fbf21b0 2024-08-31T06:23:44.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.564+0000 7fac95543640 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fc1b070 0x5591a0047340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:44.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.564+0000 7fac94d42640 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 0x55919ffd01c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fac84004600 tx=0x7fac8401d8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32b9352cefc01d56 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.564+0000 7fac6ffff640 10 client.30142 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.564+0000 7fac9d51b740 1 -- 172.21.15.53:0/3269593267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac8401dd60 con 0x55919fbf21b0 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.565+0000 7fac6ffff640 1 -- 172.21.15.53:0/3269593267 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84036050 con 0x55919fbf21b0 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.565+0000 7fac6ffff640 1 -- 172.21.15.53:0/3269593267 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fac84031410 con 0x55919fbf21b0 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.565+0000 7fac6ffff640 1 -- 172.21.15.53:0/3269593267 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fac84031670 con 0x55919fbf21b0 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.565+0000 7fac9d51b740 10 client.30142 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.565+0000 7fac9d51b740 1 -- 172.21.15.53:0/3269593267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=66}) -- 0x5591a0048860 con 0x55919fbf21b0 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.565+0000 7fac6ffff640 1 -- 172.21.15.53:0/3269593267 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fac84031a10 con 0x55919fbf21b0 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.565+0000 7fac9d51b740 10 client.30142 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.565+0000 7fac9d51b740 10 client.30142 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.565+0000 7fac9d51b740 20 client.30142 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.565+0000 7fac9d51b740 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55919fbaeda0 0x5591a004ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:44.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.566+0000 7fac9d51b740 4 client.30142 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:23:44.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.566+0000 7fac9d51b740 1 -- 172.21.15.53:0/3269593267 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55919ff35070 con 0x55919fbaeda0 2024-08-31T06:23:44.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.566+0000 7fac8ffff640 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55919fbaeda0 0x5591a004ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:44.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.566+0000 7fac6ffff640 10 client.30142 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:23:44.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.566+0000 7fac8ffff640 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55919fbaeda0 0x5591a004ade0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c69f270b5aff4667 server_cookie=3b292c632b9e7f3f in_seq=0 out_seq=0 2024-08-31T06:23:44.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.567+0000 7fac6ffff640 1 -- 172.21.15.53:0/3269593267 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55919ff35070 con 0x55919fbaeda0 2024-08-31T06:23:44.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.567+0000 7fac6ffff640 10 client.30142 handle_command_reply: tid=0 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.567+0000 7fac9d51b740 1 client.30142 shutdown 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.567+0000 7fac9d51b740 1 -- 172.21.15.53:0/3269593267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 msgr2=0x55919ffd01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.567+0000 7fac9d51b740 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 0x55919ffd01c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fac84004600 tx=0x7fac8401d8d0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.568+0000 7fac9d51b740 1 -- 172.21.15.53:0/3269593267 shutdown_connections 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.568+0000 7fac9d51b740 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55919fbaeda0 0x5591a004ade0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.568+0000 7fac6ffff640 0 client.30142 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.568+0000 7fac9d51b740 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55919fc1b070 0x5591a0047340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.568+0000 7fac9d51b740 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55919fbfa390 0x55919ffd0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.568+0000 7fac9d51b740 1 --2- 172.21.15.53:0/3269593267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55919fbf21b0 0x55919ffd01c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.568+0000 7fac9d51b740 1 -- 172.21.15.53:0/3269593267 >> 172.21.15.53:0/3269593267 conn(0x55919fc0f460 msgr2=0x55919ffc33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.568+0000 7fac9d51b740 1 -- 172.21.15.53:0/3269593267 shutdown_connections 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.568+0000 7fac9d51b740 1 -- 172.21.15.53:0/3269593267 wait complete. 2024-08-31T06:23:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.568+0000 7fac9d51b740 20 client.30142 trim_cache size 0 max 16384 2024-08-31T06:23:44.574 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:23:44.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.569+0000 7fac96fa6640 1 -- 172.21.15.53:0/755995492 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac800b4ca0 msgr2=0x7fac800b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.569+0000 7fac96fa6640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac800b4ca0 0x7fac800b71b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x55919ffbef90 tx=0x7fac84005f90 comp rx=0 tx=0).stop 2024-08-31T06:23:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.569+0000 7fac96fa6640 1 -- 172.21.15.53:0/755995492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90109bc0 msgr2=0x7fac90112380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.569+0000 7fac96fa6640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90109bc0 0x7fac90112380 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fac88004af0 tx=0x7fac88030b80 comp rx=0 tx=0).stop 2024-08-31T06:23:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.569+0000 7fac96fa6640 1 -- 172.21.15.53:0/755995492 shutdown_connections 2024-08-31T06:23:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.569+0000 7fac96fa6640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fac800b4ca0 0x7fac800b71b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.569+0000 7fac96fa6640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac90109bc0 0x7fac90112380 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.569+0000 7fac96fa6640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac90109270 0x7fac90111c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.569+0000 7fac96fa6640 1 --2- 172.21.15.53:0/755995492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac90103930 0x7fac90115980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.569+0000 7fac96fa6640 1 -- 172.21.15.53:0/755995492 >> 172.21.15.53:0/755995492 conn(0x7fac900ff380 msgr2=0x7fac901017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.570+0000 7fac96fa6640 1 -- 172.21.15.53:0/755995492 shutdown_connections 2024-08-31T06:23:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:44.570+0000 7fac96fa6640 1 -- 172.21.15.53:0/755995492 wait complete. 2024-08-31T06:23:45.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 36783 5.71 MB/sec execute 213 sec latency 140.094 ms 2024-08-31T06:23:45.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:23:45.788 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:45 smithi053 ceph-mon[18924]: pgmap v913: 97 pgs: 97 active+clean; 673 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 342 op/s 2024-08-31T06:23:45.890 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:45 smithi130 ceph-mon[22266]: pgmap v913: 97 pgs: 97 active+clean; 673 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 342 op/s 2024-08-31T06:23:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:45 smithi153 ceph-mon[22320]: pgmap v913: 97 pgs: 97 active+clean; 673 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 342 op/s 2024-08-31T06:23:46.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 36939 5.72 MB/sec execute 214 sec latency 98.489 ms 2024-08-31T06:23:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.690+0000 7f72d80c5640 1 -- 172.21.15.53:0/353781980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d0104650 msgr2=0x7f72d0104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.690+0000 7f72d80c5640 1 --2- 172.21.15.53:0/353781980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d0104650 0x7f72d0104a60 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009900 tx=0x7f72cc02a410 comp rx=0 tx=0).stop 2024-08-31T06:23:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.690+0000 7f72d80c5640 1 -- 172.21.15.53:0/353781980 shutdown_connections 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.690+0000 7f72d80c5640 1 --2- 172.21.15.53:0/353781980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72d010dc00 0x7f72d01100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.690+0000 7f72d80c5640 1 --2- 172.21.15.53:0/353781980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72d0105080 0x7f72d010d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.690+0000 7f72d80c5640 1 --2- 172.21.15.53:0/353781980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d0104650 0x7f72d0104a60 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.690+0000 7f72d80c5640 1 -- 172.21.15.53:0/353781980 >> 172.21.15.53:0/353781980 conn(0x7f72d00794d0 msgr2=0x7f72d00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.691+0000 7f72d80c5640 1 -- 172.21.15.53:0/353781980 shutdown_connections 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.691+0000 7f72d80c5640 1 -- 172.21.15.53:0/353781980 wait complete. 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.691+0000 7f72d80c5640 1 Processor -- start 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.691+0000 7f72d80c5640 1 -- start start 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d80c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d0104650 0x7f72d019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d80c5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72d0105080 0x7f72d019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d80c5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72d010dc00 0x7f72d019f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d80c5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01136f0 con 0x7f72d0104650 2024-08-31T06:23:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d80c5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72d0113570 con 0x7f72d010dc00 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d80c5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72d0113870 con 0x7f72d0105080 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d5660640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72d0105080 0x7f72d019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d5660640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72d0105080 0x7f72d019a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:50954/0 (socket says 172.21.15.53:50954) 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d6662640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72d010dc00 0x7f72d019f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d5660640 1 -- 172.21.15.53:0/3067988736 learned_addr learned my addr 172.21.15.53:0/3067988736 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d5e61640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d0104650 0x7f72d019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d5660640 1 -- 172.21.15.53:0/3067988736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72d010dc00 msgr2=0x7f72d019f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.692+0000 7f72d5660640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72d010dc00 0x7f72d019f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.693+0000 7f72d5660640 1 -- 172.21.15.53:0/3067988736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d0104650 msgr2=0x7f72d019a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.693+0000 7f72d5660640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d0104650 0x7f72d019a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.693+0000 7f72d5660640 1 -- 172.21.15.53:0/3067988736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d01a00b0 con 0x7f72d0105080 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.693+0000 7f72d5660640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72d0105080 0x7f72d019a6e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f72c000e9c0 tx=0x7f72c000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.693+0000 7f72c6ffd640 1 -- 172.21.15.53:0/3067988736 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c000cd80 con 0x7f72d0105080 2024-08-31T06:23:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.693+0000 7f72d80c5640 1 -- 172.21.15.53:0/3067988736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d01a03a0 con 0x7f72d0105080 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.693+0000 7f72c6ffd640 1 -- 172.21.15.53:0/3067988736 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72c00054b0 con 0x7f72d0105080 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.693+0000 7f72c6ffd640 1 -- 172.21.15.53:0/3067988736 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0010430 con 0x7f72d0105080 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.693+0000 7f72d80c5640 1 -- 172.21.15.53:0/3067988736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d01a6b00 con 0x7f72d0105080 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.696+0000 7f72c6ffd640 1 -- 172.21.15.53:0/3067988736 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f72c0004f20 con 0x7f72d0105080 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.697+0000 7f72de63a740 1 Processor -- start 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.697+0000 7f72de63a740 1 -- start start 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.698+0000 7f72c6ffd640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72bc0b4ca0 0x7f72bc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.698+0000 7f72de63a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf85d070 0x5565bfc02310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.698+0000 7f72de63a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf8341b0 0x5565bfc02850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.698+0000 7f72c6ffd640 1 -- 172.21.15.53:0/3067988736 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f72c00e5af0 con 0x7f72d0105080 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.698+0000 7f72de63a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf83c390 0x5565bfc02d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.698+0000 7f72de63a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5565bfb79680 con 0x5565bf85d070 2024-08-31T06:23:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.698+0000 7f72de63a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565bfb68c10 con 0x5565bf83c390 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.698+0000 7f72de63a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5565bfb6cbc0 con 0x5565bf8341b0 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d6662640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72bc0b4ca0 0x7f72bc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d5e61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf85d070 0x5565bfc02310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d5e61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf85d070 0x5565bfc02310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35234/0 (socket says 172.21.15.53:35234) 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d5e61640 1 -- 172.21.15.53:0/3128521807 learned_addr learned my addr 172.21.15.53:0/3128521807 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d5660640 1 --2- 172.21.15.53:0/3128521807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf8341b0 0x5565bfc02850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d6662640 1 --2- 172.21.15.53:0/3128521807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf83c390 0x5565bfc02d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d5e61640 1 -- 172.21.15.53:0/3128521807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf8341b0 msgr2=0x5565bfc02850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d5e61640 1 --2- 172.21.15.53:0/3128521807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf8341b0 0x5565bfc02850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d5e61640 1 -- 172.21.15.53:0/3128521807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf83c390 msgr2=0x5565bfc02d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d5e61640 1 --2- 172.21.15.53:0/3128521807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf83c390 0x5565bfc02d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d5e61640 1 -- 172.21.15.53:0/3128521807 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565bf8c8650 con 0x5565bf85d070 2024-08-31T06:23:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d6662640 1 --2- 172.21.15.53:0/3128521807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf83c390 0x5565bfc02d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d6662640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72bc0b4ca0 0x7f72bc0b71b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f72c8005fd0 tx=0x7f72c8011870 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.699+0000 7f72d5e61640 1 --2- 172.21.15.53:0/3128521807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf85d070 0x5565bfc02310 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f72cc02a930 tx=0x7f72cc031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df5e41f5cd1662c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.700+0000 7f72bbfff640 1 -- 172.21.15.53:0/3128521807 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc035030 con 0x5565bf85d070 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.700+0000 7f72bbfff640 1 -- 172.21.15.53:0/3128521807 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72cc040070 con 0x5565bf85d070 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.700+0000 7f72bbfff640 1 -- 172.21.15.53:0/3128521807 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc003830 con 0x5565bf85d070 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.701+0000 7f72de63a740 1 -- 172.21.15.53:0/3128521807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf85d070 msgr2=0x5565bfc02310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.701+0000 7f72de63a740 1 --2- 172.21.15.53:0/3128521807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf85d070 0x5565bfc02310 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f72cc02a930 tx=0x7f72cc031a70 comp rx=0 tx=0).stop 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.701+0000 7f72de63a740 1 -- 172.21.15.53:0/3128521807 shutdown_connections 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.701+0000 7f72de63a740 1 --2- 172.21.15.53:0/3128521807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf83c390 0x5565bfc02d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.701+0000 7f72de63a740 1 --2- 172.21.15.53:0/3128521807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf8341b0 0x5565bfc02850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.701+0000 7f72de63a740 1 --2- 172.21.15.53:0/3128521807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf85d070 0x5565bfc02310 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.701+0000 7f72de63a740 1 -- 172.21.15.53:0/3128521807 >> 172.21.15.53:0/3128521807 conn(0x5565bf851460 msgr2=0x5565bfc00200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.701+0000 7f72de63a740 1 -- 172.21.15.53:0/3128521807 shutdown_connections 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.701+0000 7f72de63a740 1 -- 172.21.15.53:0/3128521807 wait complete. 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.702+0000 7f72de63a740 1 -- start start 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.702+0000 7f72de63a740 1 Processor -- start 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.702+0000 7f72de63a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf8341b0 0x5565bfc0df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.702+0000 7f72de63a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 0x5565bfc0e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.702+0000 7f72de63a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf85d070 0x5565bfc136e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.702+0000 7f72de63a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5565bf9cb700 con 0x5565bf83c390 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d5e61640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf8341b0 0x5565bfc0df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72de63a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565bfaef750 con 0x5565bf8341b0 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d5e61640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf8341b0 0x5565bfc0df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:56380/0 (socket says 172.21.15.53:56380) 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d5e61640 1 -- 172.21.15.53:0/1515278619 learned_addr learned my addr 172.21.15.53:0/1515278619 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72de63a740 1 -- 172.21.15.53:0/1515278619 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5565bfc08820 con 0x5565bf85d070 2024-08-31T06:23:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d5660640 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 0x5565bfc0e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72de63a740 10 client.0 _ll_register_callbacks cb 0x5565bfb1ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d6662640 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf85d070 0x5565bfc136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d5660640 1 -- 172.21.15.53:0/1515278619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf85d070 msgr2=0x5565bfc136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d5660640 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf85d070 0x5565bfc136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d5660640 1 -- 172.21.15.53:0/1515278619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf8341b0 msgr2=0x5565bfc0df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d5660640 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf8341b0 0x5565bfc0df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d5660640 1 -- 172.21.15.53:0/1515278619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565bfb28900 con 0x5565bf83c390 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d5e61640 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf8341b0 0x5565bfc0df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72d5660640 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 0x5565bfc0e510 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f72c00e3220 tx=0x7f72c0005440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff6821b21d8808c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.703+0000 7f72b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.704+0000 7f72b97fa640 1 -- 172.21.15.53:0/1515278619 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c00b0a30 con 0x5565bf83c390 2024-08-31T06:23:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.704+0000 7f72b97fa640 1 -- 172.21.15.53:0/1515278619 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f72c00ab420 con 0x5565bf83c390 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.704+0000 7f72de63a740 1 -- 172.21.15.53:0/1515278619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72cc040070 con 0x5565bf83c390 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.704+0000 7f72b97fa640 1 -- 172.21.15.53:0/1515278619 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f72c00b54e0 con 0x5565bf83c390 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.704+0000 7f72de63a740 10 client.21312 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.704+0000 7f72de63a740 1 -- 172.21.15.53:0/1515278619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5565bfc1c890 con 0x5565bf83c390 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.704+0000 7f72b97fa640 1 -- 172.21.15.53:0/1515278619 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72c00ab620 con 0x5565bf83c390 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.705+0000 7f72b97fa640 1 -- 172.21.15.53:0/1515278619 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f72c00b1bc0 con 0x5565bf83c390 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.705+0000 7f72de63a740 10 client.21312 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.705+0000 7f72de63a740 10 client.21312 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.705+0000 7f72de63a740 20 client.21312 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.705+0000 7f72de63a740 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5565bf81b9f0 0x5565bfc1fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.705+0000 7f72de63a740 4 client.21312 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.705+0000 7f72de63a740 1 -- 172.21.15.53:0/1515278619 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f72cc040070 con 0x5565bf81b9f0 2024-08-31T06:23:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.705+0000 7f72d5e61640 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5565bf81b9f0 0x5565bfc1fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.706+0000 7f72d5e61640 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5565bf81b9f0 0x5565bfc1fd40 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6039b7d7d9c415bd server_cookie=e80a5a505f3a139 in_seq=0 out_seq=0 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.706+0000 7f72b97fa640 10 client.21312 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72b97fa640 1 -- 172.21.15.53:0/1515278619 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f72cc040070 con 0x5565bf81b9f0 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72b97fa640 10 client.21312 handle_command_reply: tid=0 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 1 client.21312 shutdown 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 1 -- 172.21.15.53:0/1515278619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 msgr2=0x5565bfc0e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 0x5565bfc0e510 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f72c00e3220 tx=0x7f72c0005440 comp rx=0 tx=0).stop 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 1 -- 172.21.15.53:0/1515278619 shutdown_connections 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5565bf81b9f0 0x5565bfc1fd40 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf85d070 0x5565bfc136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72b97fa640 0 client.21312 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 0x5565bfc0e510 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 1 --2- 172.21.15.53:0/1515278619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf8341b0 0x5565bfc0df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 1 -- 172.21.15.53:0/1515278619 >> 172.21.15.53:0/1515278619 conn(0x5565bf851460 msgr2=0x5565bfbfe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 1 -- 172.21.15.53:0/1515278619 shutdown_connections 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 1 -- 172.21.15.53:0/1515278619 wait complete. 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.707+0000 7f72de63a740 20 client.21312 trim_cache size 0 max 16384 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.728+0000 7f72de63a740 1 Processor -- start 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.728+0000 7f72de63a740 1 -- start start 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72de63a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 0x5565bfc00300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72de63a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf8341b0 0x5565bfc135c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72de63a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 0x5565bfc13b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72d5e61640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 0x5565bfc00300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72d5e61640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 0x5565bfc00300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:56390/0 (socket says 172.21.15.53:56390) 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72d5e61640 1 -- 172.21.15.53:0/1317544266 learned_addr learned my addr 172.21.15.53:0/1317544266 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:46.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72d5660640 1 --2- 172.21.15.53:0/1317544266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf8341b0 0x5565bfc135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72de63a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01ad220 con 0x5565bf83c390 2024-08-31T06:23:46.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72de63a740 1 -- 172.21.15.53:0/1317544266 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01aedc0 con 0x5565bf81b9f0 2024-08-31T06:23:46.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72de63a740 1 -- 172.21.15.53:0/1317544266 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01ad950 con 0x5565bf8341b0 2024-08-31T06:23:46.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72d6662640 1 --2- 172.21.15.53:0/1317544266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 0x5565bfc13b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72d5e61640 1 -- 172.21.15.53:0/1317544266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf8341b0 msgr2=0x5565bfc135c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:46.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72d5e61640 1 --2- 172.21.15.53:0/1317544266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf8341b0 0x5565bfc135c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72d5e61640 1 -- 172.21.15.53:0/1317544266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 msgr2=0x5565bfc13b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:46.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72d5e61640 1 --2- 172.21.15.53:0/1317544266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 0x5565bfc13b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72d5e61640 1 -- 172.21.15.53:0/1317544266 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565bfc0eff0 con 0x5565bf81b9f0 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.729+0000 7f72d6662640 1 --2- 172.21.15.53:0/1317544266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 0x5565bfc13b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.730+0000 7f72d5e61640 1 --2- 172.21.15.53:0/1317544266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 0x5565bfc00300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0057c0 tx=0x7f72cc005900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd50dae9999a59d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.730+0000 7f72bb7fe640 1 -- 172.21.15.53:0/1317544266 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc049040 con 0x5565bf81b9f0 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.730+0000 7f72bb7fe640 1 -- 172.21.15.53:0/1317544266 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72cc040070 con 0x5565bf81b9f0 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.730+0000 7f72bb7fe640 1 -- 172.21.15.53:0/1317544266 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc035040 con 0x5565bf81b9f0 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.731+0000 7f72de63a740 1 -- 172.21.15.53:0/1317544266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 msgr2=0x5565bfc00300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.731+0000 7f72de63a740 1 --2- 172.21.15.53:0/1317544266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 0x5565bfc00300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0057c0 tx=0x7f72cc005900 comp rx=0 tx=0).stop 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.731+0000 7f72de63a740 1 -- 172.21.15.53:0/1317544266 shutdown_connections 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.731+0000 7f72de63a740 1 --2- 172.21.15.53:0/1317544266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf83c390 0x5565bfc13b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.731+0000 7f72de63a740 1 --2- 172.21.15.53:0/1317544266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf8341b0 0x5565bfc135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.731+0000 7f72de63a740 1 --2- 172.21.15.53:0/1317544266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 0x5565bfc00300 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.731+0000 7f72de63a740 1 -- 172.21.15.53:0/1317544266 >> 172.21.15.53:0/1317544266 conn(0x5565bf851460 msgr2=0x5565bfbffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.731+0000 7f72de63a740 1 -- 172.21.15.53:0/1317544266 shutdown_connections 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.731+0000 7f72de63a740 1 -- 172.21.15.53:0/1317544266 wait complete. 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.732+0000 7f72de63a740 1 -- start start 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.732+0000 7f72de63a740 1 Processor -- start 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.732+0000 7f72de63a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 0x5565bfc14b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.732+0000 7f72de63a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf8341b0 0x5565bfc15060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72de63a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf83c390 0x5565bfc19b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72de63a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01ae6f0 con 0x5565bf8341b0 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72de63a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01ae020 con 0x5565bf81b9f0 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72de63a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72d01ab220 con 0x5565bf83c390 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72de63a740 10 client.0 _ll_register_callbacks cb 0x7f72c0005660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72d5660640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf8341b0 0x5565bfc15060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72d5660640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf8341b0 0x5565bfc15060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35248/0 (socket says 172.21.15.53:35248) 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72d5660640 1 -- 172.21.15.53:0/2230535554 learned_addr learned my addr 172.21.15.53:0/2230535554 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72d5e61640 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 0x5565bfc14b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72d6662640 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf83c390 0x5565bfc19b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72d5e61640 1 -- 172.21.15.53:0/2230535554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf83c390 msgr2=0x5565bfc19b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72d5e61640 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf83c390 0x5565bfc19b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72d5e61640 1 -- 172.21.15.53:0/2230535554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf8341b0 msgr2=0x5565bfc15060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72d5e61640 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf8341b0 0x5565bfc15060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72d5e61640 1 -- 172.21.15.53:0/2230535554 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565bfc1a0b0 con 0x5565bf81b9f0 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72d5e61640 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 0x5565bfc14b20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f72cc000c00 tx=0x7f72cc03c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e87703201905502 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.733+0000 7f72b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.734+0000 7f72b97fa640 1 -- 172.21.15.53:0/2230535554 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc049070 con 0x5565bf81b9f0 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.734+0000 7f72b97fa640 1 -- 172.21.15.53:0/2230535554 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f72cc03c9b0 con 0x5565bf81b9f0 2024-08-31T06:23:46.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.734+0000 7f72de63a740 1 -- 172.21.15.53:0/2230535554 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72cc040070 con 0x5565bf81b9f0 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.734+0000 7f72b97fa640 1 -- 172.21.15.53:0/2230535554 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f72cc035040 con 0x5565bf81b9f0 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.734+0000 7f72de63a740 10 client.30155 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.734+0000 7f72de63a740 1 -- 172.21.15.53:0/2230535554 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5565bfc8ad10 con 0x5565bf81b9f0 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.734+0000 7f72b97fa640 1 -- 172.21.15.53:0/2230535554 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72cc031890 con 0x5565bf81b9f0 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.734+0000 7f72b97fa640 1 -- 172.21.15.53:0/2230535554 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f72cc04c070 con 0x5565bf81b9f0 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.735+0000 7f72de63a740 10 client.30155 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.735+0000 7f72de63a740 10 client.30155 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.735+0000 7f72de63a740 20 client.30155 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.735+0000 7f72de63a740 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5565bf85d070 0x5565bfc8d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.735+0000 7f72de63a740 4 client.30155 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.735+0000 7f72de63a740 1 -- 172.21.15.53:0/2230535554 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f72cc040070 con 0x5565bf85d070 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.735+0000 7f72d5660640 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5565bf85d070 0x5565bfc8d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.735+0000 7f72d5660640 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5565bf85d070 0x5565bfc8d040 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ab4ab03abbee564 server_cookie=be9b67021ea4deee in_seq=0 out_seq=0 2024-08-31T06:23:46.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.735+0000 7f72b97fa640 10 client.30155 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:23:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72b97fa640 1 -- 172.21.15.53:0/2230535554 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f72cc040070 con 0x5565bf85d070 2024-08-31T06:23:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72b97fa640 10 client.30155 handle_command_reply: tid=0 2024-08-31T06:23:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 1 client.30155 shutdown 2024-08-31T06:23:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 1 -- 172.21.15.53:0/2230535554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 msgr2=0x5565bfc14b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 0x5565bfc14b20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f72cc000c00 tx=0x7f72cc03c460 comp rx=0 tx=0).stop 2024-08-31T06:23:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 1 -- 172.21.15.53:0/2230535554 shutdown_connections 2024-08-31T06:23:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x5565bf85d070 0x5565bfc8d040 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565bf83c390 0x5565bfc19b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565bf8341b0 0x5565bfc15060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 1 --2- 172.21.15.53:0/2230535554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565bf81b9f0 0x5565bfc14b20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 1 -- 172.21.15.53:0/2230535554 >> 172.21.15.53:0/2230535554 conn(0x5565bf851460 msgr2=0x5565bfc073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:46.781 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:23:46.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72b97fa640 0 client.30155 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:23:46.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 1 -- 172.21.15.53:0/2230535554 shutdown_connections 2024-08-31T06:23:46.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 1 -- 172.21.15.53:0/2230535554 wait complete. 2024-08-31T06:23:46.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.736+0000 7f72de63a740 20 client.30155 trim_cache size 0 max 16384 2024-08-31T06:23:46.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.737+0000 7f72d80c5640 1 -- 172.21.15.53:0/3067988736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72bc0b4ca0 msgr2=0x7f72bc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:46.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.737+0000 7f72d80c5640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72bc0b4ca0 0x7f72bc0b71b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f72c8005fd0 tx=0x7f72c8011870 comp rx=0 tx=0).stop 2024-08-31T06:23:46.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.737+0000 7f72d80c5640 1 -- 172.21.15.53:0/3067988736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72d0105080 msgr2=0x7f72d019a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:46.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.737+0000 7f72d80c5640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72d0105080 0x7f72d019a6e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f72c000e9c0 tx=0x7f72c000ee80 comp rx=0 tx=0).stop 2024-08-31T06:23:46.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.738+0000 7f72d80c5640 1 -- 172.21.15.53:0/3067988736 shutdown_connections 2024-08-31T06:23:46.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.738+0000 7f72d80c5640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72bc0b4ca0 0x7f72bc0b71b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.738+0000 7f72d80c5640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72d010dc00 0x7f72d019f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.738+0000 7f72d80c5640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72d0105080 0x7f72d019a6e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.738+0000 7f72d80c5640 1 --2- 172.21.15.53:0/3067988736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72d0104650 0x7f72d019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:46.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.738+0000 7f72d80c5640 1 -- 172.21.15.53:0/3067988736 >> 172.21.15.53:0/3067988736 conn(0x7f72d00794d0 msgr2=0x7f72d00ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:46.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.738+0000 7f72d80c5640 1 -- 172.21.15.53:0/3067988736 shutdown_connections 2024-08-31T06:23:46.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:46.738+0000 7f72d80c5640 1 -- 172.21.15.53:0/3067988736 wait complete. 2024-08-31T06:23:47.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 37086 5.73 MB/sec execute 215 sec latency 66.673 ms 2024-08-31T06:23:47.492 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:23:47.848 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:48.079 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:47 smithi053 ceph-mon[18924]: pgmap v914: 97 pgs: 97 active+clean; 675 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 347 op/s 2024-08-31T06:23:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:47 smithi130 ceph-mon[22266]: pgmap v914: 97 pgs: 97 active+clean; 675 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 347 op/s 2024-08-31T06:23:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:47 smithi153 ceph-mon[22320]: pgmap v914: 97 pgs: 97 active+clean; 675 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 347 op/s 2024-08-31T06:23:48.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 37230 5.74 MB/sec execute 216 sec latency 138.899 ms 2024-08-31T06:23:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.545+0000 7ff4490e0640 1 -- 172.21.15.53:0/3725399750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff444109270 msgr2=0x7ff444109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.545+0000 7ff4490e0640 1 --2- 172.21.15.53:0/3725399750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff444109270 0x7ff444109680 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7ff438009860 tx=0x7ff43802a340 comp rx=0 tx=0).stop 2024-08-31T06:23:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.545+0000 7ff4490e0640 1 -- 172.21.15.53:0/3725399750 shutdown_connections 2024-08-31T06:23:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.545+0000 7ff4490e0640 1 --2- 172.21.15.53:0/3725399750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff444109bc0 0x7ff4441103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.545+0000 7ff4490e0640 1 --2- 172.21.15.53:0/3725399750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff444109270 0x7ff444109680 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.545+0000 7ff4490e0640 1 --2- 172.21.15.53:0/3725399750 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff444103930 0x7ff444103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.545+0000 7ff4490e0640 1 -- 172.21.15.53:0/3725399750 >> 172.21.15.53:0/3725399750 conn(0x7ff4440ff3a0 msgr2=0x7ff4441017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.545+0000 7ff4490e0640 1 -- 172.21.15.53:0/3725399750 shutdown_connections 2024-08-31T06:23:48.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.545+0000 7ff4490e0640 1 -- 172.21.15.53:0/3725399750 wait complete. 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.546+0000 7ff4490e0640 1 Processor -- start 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff4490e0640 1 -- start start 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff4490e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff444103930 0x7ff44419a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff4490e0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff444109270 0x7ff44419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff4490e0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff444109bc0 0x7ff44419f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff4490e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff444113730 con 0x7ff444103930 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff4490e0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4441135b0 con 0x7ff444109270 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff4490e0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4441138b0 con 0x7ff444109bc0 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff442d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff444103930 0x7ff44419a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff442d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff444103930 0x7ff44419a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35278/0 (socket says 172.21.15.53:35278) 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff442d9d640 1 -- 172.21.15.53:0/2967016991 learned_addr learned my addr 172.21.15.53:0/2967016991 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:48.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff44359e640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff444109bc0 0x7ff44419f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.547+0000 7ff44259c640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff444109270 0x7ff44419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff442d9d640 1 -- 172.21.15.53:0/2967016991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff444109bc0 msgr2=0x7ff44419f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:48.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff442d9d640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff444109bc0 0x7ff44419f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff442d9d640 1 -- 172.21.15.53:0/2967016991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff444109270 msgr2=0x7ff44419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:48.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff442d9d640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff444109270 0x7ff44419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff442d9d640 1 -- 172.21.15.53:0/2967016991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4441a00f0 con 0x7ff444103930 2024-08-31T06:23:48.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff44359e640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff444109bc0 0x7ff44419f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:23:48.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff44259c640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff444109270 0x7ff44419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:23:48.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff442d9d640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff444103930 0x7ff44419a180 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7ff43400e9c0 tx=0x7ff43400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:48.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff42bfff640 1 -- 172.21.15.53:0/2967016991 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43400cde0 con 0x7ff444103930 2024-08-31T06:23:48.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff4490e0640 1 -- 172.21.15.53:0/2967016991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4441a03e0 con 0x7ff444103930 2024-08-31T06:23:48.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff42bfff640 1 -- 172.21.15.53:0/2967016991 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4340035f0 con 0x7ff444103930 2024-08-31T06:23:48.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff4490e0640 1 -- 172.21.15.53:0/2967016991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4441a6b40 con 0x7ff444103930 2024-08-31T06:23:48.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.548+0000 7ff42bfff640 1 -- 172.21.15.53:0/2967016991 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43400cde0 con 0x7ff444103930 2024-08-31T06:23:48.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.552+0000 7ff42bfff640 1 -- 172.21.15.53:0/2967016991 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff434018430 con 0x7ff444103930 2024-08-31T06:23:48.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.552+0000 7ff44f655740 1 Processor -- start 2024-08-31T06:23:48.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.552+0000 7ff44f655740 1 -- start start 2024-08-31T06:23:48.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.552+0000 7ff44f655740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 0x55729bd6a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.552+0000 7ff44f655740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b99c1b0 0x55729bd6a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.552+0000 7ff44f655740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 0x55729bd6add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.552+0000 7ff44f655740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55729bce1680 con 0x55729b9c5070 2024-08-31T06:23:48.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.552+0000 7ff44f655740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55729bcd0c10 con 0x55729b9a4390 2024-08-31T06:23:48.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.552+0000 7ff44f655740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55729bcd4bc0 con 0x55729b99c1b0 2024-08-31T06:23:48.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.553+0000 7ff44359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 0x55729bd6a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.553+0000 7ff442d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b99c1b0 0x55729bd6a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.553+0000 7ff44359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 0x55729bd6a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35280/0 (socket says 172.21.15.53:35280) 2024-08-31T06:23:48.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.553+0000 7ff44359e640 1 -- 172.21.15.53:0/3955720303 learned_addr learned my addr 172.21.15.53:0/3955720303 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:48.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.553+0000 7ff44259c640 1 --2- 172.21.15.53:0/3955720303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 0x55729bd6add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.553+0000 7ff44359e640 1 -- 172.21.15.53:0/3955720303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b99c1b0 msgr2=0x55729bd6a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:48.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.553+0000 7ff44359e640 1 --2- 172.21.15.53:0/3955720303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b99c1b0 0x55729bd6a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.553+0000 7ff44359e640 1 -- 172.21.15.53:0/3955720303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 msgr2=0x55729bd6add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:48.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.553+0000 7ff44359e640 1 --2- 172.21.15.53:0/3955720303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 0x55729bd6add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.553+0000 7ff44359e640 1 -- 172.21.15.53:0/3955720303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729ba30650 con 0x55729b9c5070 2024-08-31T06:23:48.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.553+0000 7ff42bfff640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff42c0b4ea0 0x7ff42c0b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.554+0000 7ff442d9d640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff42c0b4ea0 0x7ff42c0b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.554+0000 7ff44359e640 1 --2- 172.21.15.53:0/3955720303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 0x55729bd6a350 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009fd0 tx=0x7ff43c0108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff22f8f7258675e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:48.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.554+0000 7ff42bfff640 1 -- 172.21.15.53:0/2967016991 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7ff4340e55f0 con 0x7ff444103930 2024-08-31T06:23:48.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.554+0000 7ff4297fa640 1 -- 172.21.15.53:0/3955720303 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c011760 con 0x55729b9c5070 2024-08-31T06:23:48.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.554+0000 7ff4297fa640 1 -- 172.21.15.53:0/3955720303 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff43c011d90 con 0x55729b9c5070 2024-08-31T06:23:48.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.554+0000 7ff4297fa640 1 -- 172.21.15.53:0/3955720303 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00e3c0 con 0x55729b9c5070 2024-08-31T06:23:48.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.555+0000 7ff44f655740 1 -- 172.21.15.53:0/3955720303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 msgr2=0x55729bd6a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:48.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.555+0000 7ff442d9d640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff42c0b4ea0 0x7ff42c0b73b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff4340e2dd0 tx=0x7ff434093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:48.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.555+0000 7ff44f655740 1 --2- 172.21.15.53:0/3955720303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 0x55729bd6a350 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009fd0 tx=0x7ff43c0108e0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.555+0000 7ff44f655740 1 -- 172.21.15.53:0/3955720303 shutdown_connections 2024-08-31T06:23:48.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.555+0000 7ff44f655740 1 --2- 172.21.15.53:0/3955720303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 0x55729bd6add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.555+0000 7ff44f655740 1 --2- 172.21.15.53:0/3955720303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b99c1b0 0x55729bd6a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.555+0000 7ff44f655740 1 --2- 172.21.15.53:0/3955720303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 0x55729bd6a350 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.555+0000 7ff44f655740 1 -- 172.21.15.53:0/3955720303 >> 172.21.15.53:0/3955720303 conn(0x55729b9b9460 msgr2=0x55729bd68240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.555+0000 7ff44f655740 1 -- 172.21.15.53:0/3955720303 shutdown_connections 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.555+0000 7ff44f655740 1 -- 172.21.15.53:0/3955720303 wait complete. 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44f655740 1 -- start start 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44f655740 1 Processor -- start 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44f655740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b99c1b0 0x55729bd75ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44f655740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 0x55729bd75ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44f655740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 0x55729bd862d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44f655740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55729bb33700 con 0x55729b9c5070 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44f655740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55729bc57750 con 0x55729b99c1b0 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44f655740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55729bd7cfe0 con 0x55729b9a4390 2024-08-31T06:23:48.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44f655740 10 client.0 _ll_register_callbacks cb 0x55729bc86e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 0x55729bd75ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 0x55729bd862d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b99c1b0 0x55729bd75ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 0x55729bd75ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51046/0 (socket says 172.21.15.53:51046) 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.556+0000 7ff44259c640 1 -- 172.21.15.53:0/1610807987 learned_addr learned my addr 172.21.15.53:0/1610807987 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff44259c640 1 -- 172.21.15.53:0/1610807987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b99c1b0 msgr2=0x55729bd75ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff44259c640 1 --2- 172.21.15.53:0/1610807987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b99c1b0 0x55729bd75ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff44259c640 1 -- 172.21.15.53:0/1610807987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 msgr2=0x55729bd862d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff44259c640 1 --2- 172.21.15.53:0/1610807987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 0x55729bd862d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff44259c640 1 -- 172.21.15.53:0/1610807987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55729bc90900 con 0x55729b9a4390 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff44259c640 1 --2- 172.21.15.53:0/1610807987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 0x55729bd75ff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff438000c00 tx=0x7ff438030da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bed2a346f2735873 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff426ff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:23:48.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff426ff5640 1 -- 172.21.15.53:0/1610807987 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438042070 con 0x55729b9a4390 2024-08-31T06:23:48.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff44f655740 1 -- 172.21.15.53:0/1610807987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff43c011d90 con 0x55729b9a4390 2024-08-31T06:23:48.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff426ff5640 1 -- 172.21.15.53:0/1610807987 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7ff438004450 con 0x55729b9a4390 2024-08-31T06:23:48.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff426ff5640 1 -- 172.21.15.53:0/1610807987 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ff43804e050 con 0x55729b9a4390 2024-08-31T06:23:48.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff44f655740 10 client.30172 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:48.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.557+0000 7ff44f655740 1 -- 172.21.15.53:0/1610807987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55729bd88de0 con 0x55729b9a4390 2024-08-31T06:23:48.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.558+0000 7ff426ff5640 1 -- 172.21.15.53:0/1610807987 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff43c011d90 con 0x55729b9a4390 2024-08-31T06:23:48.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.558+0000 7ff426ff5640 1 -- 172.21.15.53:0/1610807987 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7ff4380046c0 con 0x55729b9a4390 2024-08-31T06:23:48.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.558+0000 7ff44f655740 10 client.30172 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:48.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.558+0000 7ff44f655740 10 client.30172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:48.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.558+0000 7ff44f655740 20 client.30172 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:48.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.558+0000 7ff44f655740 1 --2- 172.21.15.53:0/1610807987 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55729b9839f0 0x55729bd8c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.558+0000 7ff44f655740 4 client.30172 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:48.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.558+0000 7ff44f655740 1 -- 172.21.15.53:0/1610807987 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55729bce35d0 con 0x55729b9839f0 2024-08-31T06:23:48.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.558+0000 7ff44359e640 1 --2- 172.21.15.53:0/1610807987 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55729b9839f0 0x55729bd8c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.559+0000 7ff44359e640 1 --2- 172.21.15.53:0/1610807987 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55729b9839f0 0x55729bd8c650 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f8f7cd56c5cf02 server_cookie=3463d33b39f33abd in_seq=0 out_seq=0 2024-08-31T06:23:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.559+0000 7ff426ff5640 10 client.30172 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff426ff5640 1 -- 172.21.15.53:0/1610807987 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55729bce35d0 con 0x55729b9839f0 2024-08-31T06:23:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff426ff5640 10 client.30172 handle_command_reply: tid=0 2024-08-31T06:23:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 1 client.30172 shutdown 2024-08-31T06:23:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 1 -- 172.21.15.53:0/1610807987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 msgr2=0x55729bd75ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 1 --2- 172.21.15.53:0/1610807987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 0x55729bd75ff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff438000c00 tx=0x7ff438030da0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 1 -- 172.21.15.53:0/1610807987 shutdown_connections 2024-08-31T06:23:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 1 --2- 172.21.15.53:0/1610807987 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55729b9839f0 0x55729bd8c650 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 1 --2- 172.21.15.53:0/1610807987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b9c5070 0x55729bd862d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 1 --2- 172.21.15.53:0/1610807987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 0x55729bd75ff0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 1 --2- 172.21.15.53:0/1610807987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b99c1b0 0x55729bd75ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 1 -- 172.21.15.53:0/1610807987 >> 172.21.15.53:0/1610807987 conn(0x55729b9b9460 msgr2=0x55729bd6b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff426ff5640 0 client.30172 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 1 -- 172.21.15.53:0/1610807987 shutdown_connections 2024-08-31T06:23:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 1 -- 172.21.15.53:0/1610807987 wait complete. 2024-08-31T06:23:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.560+0000 7ff44f655740 20 client.30172 trim_cache size 0 max 16384 2024-08-31T06:23:48.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44f655740 1 Processor -- start 2024-08-31T06:23:48.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44f655740 1 -- start start 2024-08-31T06:23:48.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44f655740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 0x55729bd6ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44f655740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 0x55729bd861d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44f655740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9c5070 0x55729bd67c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44f655740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff4441ad350 con 0x55729b99c1b0 2024-08-31T06:23:48.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44f655740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4441aeef0 con 0x55729b9a4390 2024-08-31T06:23:48.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44f655740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4441ada80 con 0x55729b9c5070 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 0x55729bd861d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 0x55729bd6ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 0x55729bd861d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:56466/0 (socket says 172.21.15.53:56466) 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44259c640 1 -- 172.21.15.53:0/1026144925 learned_addr learned my addr 172.21.15.53:0/1026144925 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 0x55729bd6ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35298/0 (socket says 172.21.15.53:35298) 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.582+0000 7ff44359e640 1 --2- 172.21.15.53:0/1026144925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9c5070 0x55729bd67c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.583+0000 7ff44259c640 1 -- 172.21.15.53:0/1026144925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9c5070 msgr2=0x55729bd67c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.583+0000 7ff44259c640 1 --2- 172.21.15.53:0/1026144925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9c5070 0x55729bd67c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.583+0000 7ff44259c640 1 -- 172.21.15.53:0/1026144925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 msgr2=0x55729bd6ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.583+0000 7ff44259c640 1 --2- 172.21.15.53:0/1026144925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 0x55729bd6ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.583+0000 7ff44259c640 1 -- 172.21.15.53:0/1026144925 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729bd785e0 con 0x55729b9a4390 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.583+0000 7ff44259c640 1 --2- 172.21.15.53:0/1026144925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 0x55729bd861d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff438035040 tx=0x7ff43802a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2527bc5812de22d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:48.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.583+0000 7ff428ff9640 1 -- 172.21.15.53:0/1026144925 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438042040 con 0x55729b9a4390 2024-08-31T06:23:48.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.583+0000 7ff428ff9640 1 -- 172.21.15.53:0/1026144925 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4380307d0 con 0x55729b9a4390 2024-08-31T06:23:48.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.583+0000 7ff428ff9640 1 -- 172.21.15.53:0/1026144925 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438037040 con 0x55729b9a4390 2024-08-31T06:23:48.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.584+0000 7ff44f655740 1 -- 172.21.15.53:0/1026144925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 msgr2=0x55729bd861d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.584+0000 7ff44f655740 1 --2- 172.21.15.53:0/1026144925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 0x55729bd861d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff438035040 tx=0x7ff43802a340 comp rx=0 tx=0).stop 2024-08-31T06:23:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.584+0000 7ff44f655740 1 -- 172.21.15.53:0/1026144925 shutdown_connections 2024-08-31T06:23:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.584+0000 7ff44f655740 1 --2- 172.21.15.53:0/1026144925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9c5070 0x55729bd67c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.584+0000 7ff44f655740 1 --2- 172.21.15.53:0/1026144925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9a4390 0x55729bd861d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.584+0000 7ff44f655740 1 --2- 172.21.15.53:0/1026144925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 0x55729bd6ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.584+0000 7ff44f655740 1 -- 172.21.15.53:0/1026144925 >> 172.21.15.53:0/1026144925 conn(0x55729b9b9460 msgr2=0x55729bd6b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.585+0000 7ff44f655740 1 -- 172.21.15.53:0/1026144925 shutdown_connections 2024-08-31T06:23:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.585+0000 7ff44f655740 1 -- 172.21.15.53:0/1026144925 wait complete. 2024-08-31T06:23:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.585+0000 7ff44f655740 1 -- start start 2024-08-31T06:23:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.585+0000 7ff44f655740 1 Processor -- start 2024-08-31T06:23:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.585+0000 7ff44f655740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 0x55729bd7e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.585+0000 7ff44f655740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 0x55729bd7e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.585+0000 7ff44f655740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9c5070 0x55729bd7ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.585+0000 7ff44f655740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff4441ae820 con 0x55729b99c1b0 2024-08-31T06:23:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.585+0000 7ff44f655740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4441ae150 con 0x55729b9c5070 2024-08-31T06:23:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.585+0000 7ff44f655740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4441ab350 con 0x55729b9a4390 2024-08-31T06:23:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.585+0000 7ff44f655740 10 client.0 _ll_register_callbacks cb 0x7ff434005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff44359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 0x55729bd7e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff44359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 0x55729bd7e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35312/0 (socket says 172.21.15.53:35312) 2024-08-31T06:23:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff44359e640 1 -- 172.21.15.53:0/3974034506 learned_addr learned my addr 172.21.15.53:0/3974034506 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff44259c640 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 0x55729bd7e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff44359e640 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9c5070 0x55729bd7ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff44359e640 1 -- 172.21.15.53:0/3974034506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 msgr2=0x55729bd7e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff44359e640 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 0x55729bd7e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff44359e640 1 -- 172.21.15.53:0/3974034506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9c5070 msgr2=0x55729bd7ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff44359e640 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9c5070 0x55729bd7ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff44359e640 1 -- 172.21.15.53:0/3974034506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55729bdf6030 con 0x55729b99c1b0 2024-08-31T06:23:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff44359e640 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 0x55729bd7e1d0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7ff43c01ba20 tx=0x7ff43c0108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5dda4831d43f251 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff426ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.586+0000 7ff426ff5640 1 -- 172.21.15.53:0/3974034506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c038060 con 0x55729b99c1b0 2024-08-31T06:23:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff44f655740 1 -- 172.21.15.53:0/3974034506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4380307d0 con 0x55729b99c1b0 2024-08-31T06:23:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff426ff5640 1 -- 172.21.15.53:0/3974034506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7ff43c004bc0 con 0x55729b99c1b0 2024-08-31T06:23:48.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff426ff5640 1 -- 172.21.15.53:0/3974034506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ff43c024040 con 0x55729b99c1b0 2024-08-31T06:23:48.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff44f655740 10 client.21336 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:48.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff44f655740 1 -- 172.21.15.53:0/3974034506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55729bdf72d0 con 0x55729b99c1b0 2024-08-31T06:23:48.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff426ff5640 1 -- 172.21.15.53:0/3974034506 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4380307d0 con 0x55729b99c1b0 2024-08-31T06:23:48.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff426ff5640 1 -- 172.21.15.53:0/3974034506 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7ff43c02a040 con 0x55729b99c1b0 2024-08-31T06:23:48.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff44f655740 10 client.21336 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:48.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff44f655740 10 client.21336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:48.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff44f655740 20 client.21336 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:48.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff44f655740 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55729b958da0 0x55729bdf9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:48.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff44f655740 4 client.21336 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:23:48.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.587+0000 7ff44f655740 1 -- 172.21.15.53:0/3974034506 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55729bcdf070 con 0x55729b958da0 2024-08-31T06:23:48.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.588+0000 7ff44259c640 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55729b958da0 0x55729bdf9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:48.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.588+0000 7ff426ff5640 10 client.21336 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:48.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.588+0000 7ff44259c640 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55729b958da0 0x55729bdf9850 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10ec91aef2eefc99 server_cookie=5260402a90a9a6e1 in_seq=0 out_seq=0 2024-08-31T06:23:48.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.588+0000 7ff426ff5640 1 -- 172.21.15.53:0/3974034506 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55729bcdf070 con 0x55729b958da0 2024-08-31T06:23:48.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.588+0000 7ff426ff5640 10 client.21336 handle_command_reply: tid=0 2024-08-31T06:23:48.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 1 client.21336 shutdown 2024-08-31T06:23:48.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 1 -- 172.21.15.53:0/3974034506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 msgr2=0x55729bd7e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:48.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 0x55729bd7e1d0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7ff43c01ba20 tx=0x7ff43c0108e0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 1 -- 172.21.15.53:0/3974034506 shutdown_connections 2024-08-31T06:23:48.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55729b958da0 0x55729bdf9850 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55729b9c5070 0x55729bd7ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55729b9a4390 0x55729bd7e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff426ff5640 0 client.21336 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:48.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 1 --2- 172.21.15.53:0/3974034506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55729b99c1b0 0x55729bd7e1d0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 1 -- 172.21.15.53:0/3974034506 >> 172.21.15.53:0/3974034506 conn(0x55729b9b9460 msgr2=0x55729bd67a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:48.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 1 -- 172.21.15.53:0/3974034506 shutdown_connections 2024-08-31T06:23:48.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 1 -- 172.21.15.53:0/3974034506 wait complete. 2024-08-31T06:23:48.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.589+0000 7ff44f655740 20 client.21336 trim_cache size 0 max 16384 2024-08-31T06:23:48.597 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:23:48.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 -- 172.21.15.53:0/2967016991 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff42c0b4ea0 msgr2=0x7ff42c0b73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff42c0b4ea0 0x7ff42c0b73b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff4340e2dd0 tx=0x7ff434093040 comp rx=0 tx=0).stop 2024-08-31T06:23:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 -- 172.21.15.53:0/2967016991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff444103930 msgr2=0x7ff44419a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff444103930 0x7ff44419a180 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7ff43400e9c0 tx=0x7ff43400ee80 comp rx=0 tx=0).stop 2024-08-31T06:23:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 -- 172.21.15.53:0/2967016991 shutdown_connections 2024-08-31T06:23:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff42c0b4ea0 0x7ff42c0b73b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff444109bc0 0x7ff44419f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff444109270 0x7ff44419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 --2- 172.21.15.53:0/2967016991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff444103930 0x7ff44419a180 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 -- 172.21.15.53:0/2967016991 >> 172.21.15.53:0/2967016991 conn(0x7ff4440ff3a0 msgr2=0x7ff4441017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:48.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 -- 172.21.15.53:0/2967016991 shutdown_connections 2024-08-31T06:23:48.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:48.590+0000 7ff4490e0640 1 -- 172.21.15.53:0/2967016991 wait complete. 2024-08-31T06:23:49.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 37382 5.74 MB/sec execute 217 sec latency 101.433 ms 2024-08-31T06:23:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:49 smithi130 ceph-mon[22266]: pgmap v915: 97 pgs: 97 active+clean; 674 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 298 op/s 2024-08-31T06:23:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:49 smithi153 ceph-mon[22320]: pgmap v915: 97 pgs: 97 active+clean; 674 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 298 op/s 2024-08-31T06:23:50.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:49 smithi053 ceph-mon[18924]: pgmap v915: 97 pgs: 97 active+clean; 674 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 298 op/s 2024-08-31T06:23:50.341 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:23:50.341 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:23:50.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 37538 5.73 MB/sec execute 218 sec latency 56.214 ms 2024-08-31T06:23:50.719 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.305+0000 7ff6bfe99640 1 -- 172.21.15.53:0/3331332982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6b8102870 msgr2=0x7ff6b8102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.305+0000 7ff6bfe99640 1 --2- 172.21.15.53:0/3331332982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6b8102870 0x7ff6b8102c80 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009900 tx=0x7ff6b402a410 comp rx=0 tx=0).stop 2024-08-31T06:23:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.305+0000 7ff6bfe99640 1 -- 172.21.15.53:0/3331332982 shutdown_connections 2024-08-31T06:23:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.305+0000 7ff6bfe99640 1 --2- 172.21.15.53:0/3331332982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b8108bc0 0x7ff6b810f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.305+0000 7ff6bfe99640 1 --2- 172.21.15.53:0/3331332982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b8108270 0x7ff6b8108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.305+0000 7ff6bfe99640 1 --2- 172.21.15.53:0/3331332982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6b8102870 0x7ff6b8102c80 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.305+0000 7ff6bfe99640 1 -- 172.21.15.53:0/3331332982 >> 172.21.15.53:0/3331332982 conn(0x7ff6b80793f0 msgr2=0x7ff6b8079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:51.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.305+0000 7ff6bfe99640 1 -- 172.21.15.53:0/3331332982 shutdown_connections 2024-08-31T06:23:51.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.305+0000 7ff6bfe99640 1 -- 172.21.15.53:0/3331332982 wait complete. 2024-08-31T06:23:51.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.306+0000 7ff6bfe99640 1 Processor -- start 2024-08-31T06:23:51.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.306+0000 7ff6bfe99640 1 -- start start 2024-08-31T06:23:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.306+0000 7ff6bfe99640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b8102870 0x7ff6b8104200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.306+0000 7ff6bfe99640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b8108270 0x7ff6b8104740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.306+0000 7ff6bfe99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6b8108bc0 0x7ff6b8104c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.306+0000 7ff6bfe99640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b81126c0 con 0x7ff6b8108bc0 2024-08-31T06:23:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.306+0000 7ff6bfe99640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b8112540 con 0x7ff6b8102870 2024-08-31T06:23:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.306+0000 7ff6bfe99640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b8112840 con 0x7ff6b8108270 2024-08-31T06:23:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.306+0000 7ff6bd434640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b8108270 0x7ff6b8104740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.306+0000 7ff6bdc35640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b8102870 0x7ff6b8104200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6be436640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6b8108bc0 0x7ff6b8104c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6bd434640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b8108270 0x7ff6b8104740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51096/0 (socket says 172.21.15.53:51096) 2024-08-31T06:23:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6bd434640 1 -- 172.21.15.53:0/4158032709 learned_addr learned my addr 172.21.15.53:0/4158032709 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6bdc35640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b8102870 0x7ff6b8104200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:56500/0 (socket says 172.21.15.53:56500) 2024-08-31T06:23:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6be436640 1 -- 172.21.15.53:0/4158032709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b8108270 msgr2=0x7ff6b8104740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6be436640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b8108270 0x7ff6b8104740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6be436640 1 -- 172.21.15.53:0/4158032709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b8102870 msgr2=0x7ff6b8104200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6be436640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b8102870 0x7ff6b8104200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6be436640 1 -- 172.21.15.53:0/4158032709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b81a8580 con 0x7ff6b8108bc0 2024-08-31T06:23:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6bdc35640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b8102870 0x7ff6b8104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6be436640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6b8108bc0 0x7ff6b8104c80 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009fd0 tx=0x7ff6b000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.307+0000 7ff6aeffd640 1 -- 172.21.15.53:0/4158032709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b000ce20 con 0x7ff6b8108bc0 2024-08-31T06:23:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.308+0000 7ff6aeffd640 1 -- 172.21.15.53:0/4158032709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6b0005020 con 0x7ff6b8108bc0 2024-08-31T06:23:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.308+0000 7ff6aeffd640 1 -- 172.21.15.53:0/4158032709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0010690 con 0x7ff6b8108bc0 2024-08-31T06:23:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.308+0000 7ff6bfe99640 1 -- 172.21.15.53:0/4158032709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6b81a8870 con 0x7ff6b8108bc0 2024-08-31T06:23:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.308+0000 7ff6bfe99640 1 -- 172.21.15.53:0/4158032709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b81a8d60 con 0x7ff6b8108bc0 2024-08-31T06:23:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.311+0000 7ff6c640e740 1 Processor -- start 2024-08-31T06:23:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.312+0000 7ff6aeffd640 1 -- 172.21.15.53:0/4158032709 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff6b0004a40 con 0x7ff6b8108bc0 2024-08-31T06:23:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.312+0000 7ff6c640e740 1 -- start start 2024-08-31T06:23:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 0x5572694ae780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690df490 0x5572694aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5572690e7670 0x5572694af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6c640e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5572694245f0 con 0x557269108350 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6c640e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557269413b80 con 0x5572690df490 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6c640e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557269417b30 con 0x5572690e7670 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6bd434640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 0x5572694ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6bd434640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 0x5572694ae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35340/0 (socket says 172.21.15.53:35340) 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6bd434640 1 -- 172.21.15.53:0/42036207 learned_addr learned my addr 172.21.15.53:0/42036207 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6bd434640 1 --2- 172.21.15.53:0/42036207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5572690e7670 0x5572694af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6bdc35640 1 --2- 172.21.15.53:0/42036207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690df490 0x5572694aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6bd434640 1 -- 172.21.15.53:0/42036207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5572690e7670 msgr2=0x5572694af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6bd434640 1 --2- 172.21.15.53:0/42036207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5572690e7670 0x5572694af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6bd434640 1 -- 172.21.15.53:0/42036207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690df490 msgr2=0x5572694aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:51.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6bd434640 1 --2- 172.21.15.53:0/42036207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690df490 0x5572694aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6bd434640 1 -- 172.21.15.53:0/42036207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557269173930 con 0x557269108350 2024-08-31T06:23:51.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.313+0000 7ff6bd434640 1 --2- 172.21.15.53:0/42036207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 0x5572694ae780 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80097f0 tx=0x7ff6a8009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a2ed71d69a4fc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:51.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.314+0000 7ff6aeffd640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6a40b4ca0 0x7ff6a40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.314+0000 7ff6aeffd640 1 -- 172.21.15.53:0/4158032709 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7ff6b00e5be0 con 0x7ff6b8108bc0 2024-08-31T06:23:51.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.314+0000 7ff6bdc35640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6a40b4ca0 0x7ff6a40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.314+0000 7ff6a3fff640 1 -- 172.21.15.53:0/42036207 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8013170 con 0x557269108350 2024-08-31T06:23:51.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.314+0000 7ff6a3fff640 1 -- 172.21.15.53:0/42036207 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6a800f8c0 con 0x557269108350 2024-08-31T06:23:51.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.314+0000 7ff6a3fff640 1 -- 172.21.15.53:0/42036207 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8003850 con 0x557269108350 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.315+0000 7ff6c640e740 1 -- 172.21.15.53:0/42036207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 msgr2=0x5572694ae780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.315+0000 7ff6c640e740 1 --2- 172.21.15.53:0/42036207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 0x5572694ae780 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80097f0 tx=0x7ff6a8009550 comp rx=0 tx=0).stop 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.315+0000 7ff6bdc35640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6a40b4ca0 0x7ff6a40b71b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8105c50 tx=0x7ff6b40058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.315+0000 7ff6c640e740 1 -- 172.21.15.53:0/42036207 shutdown_connections 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.315+0000 7ff6c640e740 1 --2- 172.21.15.53:0/42036207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5572690e7670 0x5572694af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.315+0000 7ff6c640e740 1 --2- 172.21.15.53:0/42036207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690df490 0x5572694aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.315+0000 7ff6c640e740 1 --2- 172.21.15.53:0/42036207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 0x5572694ae780 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.315+0000 7ff6c640e740 1 -- 172.21.15.53:0/42036207 >> 172.21.15.53:0/42036207 conn(0x5572690fc740 msgr2=0x5572694ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.316+0000 7ff6c640e740 1 -- 172.21.15.53:0/42036207 shutdown_connections 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.316+0000 7ff6c640e740 1 -- 172.21.15.53:0/42036207 wait complete. 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.316+0000 7ff6c640e740 1 -- start start 2024-08-31T06:23:51.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.316+0000 7ff6c640e740 1 Processor -- start 2024-08-31T06:23:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 0x5572694b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557269108350 0x5572694c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6c640e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557269276890 con 0x5572690df490 2024-08-31T06:23:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6c640e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55726939a790 con 0x5572690e7670 2024-08-31T06:23:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6bdc35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 0x5572694b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6bdc35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 0x5572694b9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35354/0 (socket says 172.21.15.53:35354) 2024-08-31T06:23:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6bdc35640 1 -- 172.21.15.53:0/4184805700 learned_addr learned my addr 172.21.15.53:0/4184805700 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6c640e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5572694bcfb0 con 0x557269108350 2024-08-31T06:23:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6bd434640 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6c640e740 10 client.0 _ll_register_callbacks cb 0x55726911fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.317+0000 7ff6be436640 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557269108350 0x5572694c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.318+0000 7ff6bd434640 1 -- 172.21.15.53:0/4184805700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557269108350 msgr2=0x5572694c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.318+0000 7ff6bd434640 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557269108350 0x5572694c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.318+0000 7ff6bd434640 1 -- 172.21.15.53:0/4184805700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 msgr2=0x5572694b9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.318+0000 7ff6bd434640 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 0x5572694b9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.318+0000 7ff6bd434640 1 -- 172.21.15.53:0/4184805700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572693d1f30 con 0x5572690e7670 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.318+0000 7ff6bd434640 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694ba4c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009250 tx=0x7ff6a8009760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a06f82b87022a2f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.318+0000 7ff6a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.318+0000 7ff6a17fa640 1 -- 172.21.15.53:0/4184805700 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a801f630 con 0x5572690e7670 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.318+0000 7ff6a17fa640 1 -- 172.21.15.53:0/4184805700 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7ff6a801f7d0 con 0x5572690e7670 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.318+0000 7ff6c640e740 1 -- 172.21.15.53:0/4184805700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6a800f8c0 con 0x5572690e7670 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.318+0000 7ff6a17fa640 1 -- 172.21.15.53:0/4184805700 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ff6a801f9f0 con 0x5572690e7670 2024-08-31T06:23:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.319+0000 7ff6c640e740 10 client.30185 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:51.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.319+0000 7ff6c640e740 1 -- 172.21.15.53:0/4184805700 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5572694c8dc0 con 0x5572690e7670 2024-08-31T06:23:51.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.319+0000 7ff6a17fa640 1 -- 172.21.15.53:0/4184805700 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6a801fb90 con 0x5572690e7670 2024-08-31T06:23:51.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.319+0000 7ff6a17fa640 1 -- 172.21.15.53:0/4184805700 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7ff6a8010c10 con 0x5572690e7670 2024-08-31T06:23:51.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.319+0000 7ff6c640e740 10 client.30185 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:51.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.319+0000 7ff6c640e740 10 client.30185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:51.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.319+0000 7ff6c640e740 20 client.30185 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:51.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.319+0000 7ff6c640e740 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5572690c6cd0 0x5572694cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.319+0000 7ff6c640e740 4 client.30185 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:51.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.319+0000 7ff6c640e740 1 -- 172.21.15.53:0/4184805700 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff6a800f8c0 con 0x5572690c6cd0 2024-08-31T06:23:51.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.320+0000 7ff6bdc35640 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5572690c6cd0 0x5572694cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.320+0000 7ff6a17fa640 10 client.30185 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.320+0000 7ff6bdc35640 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5572690c6cd0 0x5572694cc120 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54d7f66309833f3e server_cookie=4cc230b08f0db9da in_seq=0 out_seq=0 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6a17fa640 1 -- 172.21.15.53:0/4184805700 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7ff6a800f8c0 con 0x5572690c6cd0 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6a17fa640 10 client.30185 handle_command_reply: tid=0 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6c640e740 1 client.30185 shutdown 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6c640e740 1 -- 172.21.15.53:0/4184805700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 msgr2=0x5572694ba4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6c640e740 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694ba4c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009250 tx=0x7ff6a8009760 comp rx=0 tx=0).stop 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6c640e740 1 -- 172.21.15.53:0/4184805700 shutdown_connections 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6c640e740 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5572690c6cd0 0x5572694cc120 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6c640e740 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557269108350 0x5572694c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6c640e740 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694ba4c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6c640e740 1 --2- 172.21.15.53:0/4184805700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 0x5572694b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6c640e740 1 -- 172.21.15.53:0/4184805700 >> 172.21.15.53:0/4184805700 conn(0x5572690fc740 msgr2=0x5572694b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:51.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6a17fa640 0 client.30185 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:51.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.321+0000 7ff6c640e740 1 -- 172.21.15.53:0/4184805700 shutdown_connections 2024-08-31T06:23:51.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.322+0000 7ff6c640e740 1 -- 172.21.15.53:0/4184805700 wait complete. 2024-08-31T06:23:51.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.322+0000 7ff6c640e740 20 client.30185 trim_cache size 0 max 16384 2024-08-31T06:23:51.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.348+0000 7ff6c640e740 1 Processor -- start 2024-08-31T06:23:51.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.348+0000 7ff6c640e740 1 -- start start 2024-08-31T06:23:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.348+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 0x5572694c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.348+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.348+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557269108350 0x5572694b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.348+0000 7ff6c640e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b81b17c0 con 0x5572690df490 2024-08-31T06:23:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.348+0000 7ff6c640e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b81b3360 con 0x5572690e7670 2024-08-31T06:23:51.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.348+0000 7ff6c640e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b81b1ef0 con 0x557269108350 2024-08-31T06:23:51.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6bdc35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 0x5572694c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6bdc35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 0x5572694c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35368/0 (socket says 172.21.15.53:35368) 2024-08-31T06:23:51.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6bd434640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6bdc35640 1 -- 172.21.15.53:0/822539331 learned_addr learned my addr 172.21.15.53:0/822539331 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:51.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6be436640 1 --2- 172.21.15.53:0/822539331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557269108350 0x5572694b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6bd434640 1 -- 172.21.15.53:0/822539331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557269108350 msgr2=0x5572694b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6bd434640 1 --2- 172.21.15.53:0/822539331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557269108350 0x5572694b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6bd434640 1 -- 172.21.15.53:0/822539331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 msgr2=0x5572694c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6bd434640 1 --2- 172.21.15.53:0/822539331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 0x5572694c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6bd434640 1 -- 172.21.15.53:0/822539331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572694b0ca0 con 0x5572690e7670 2024-08-31T06:23:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6bdc35640 1 --2- 172.21.15.53:0/822539331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 0x5572694c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6bd434640 1 --2- 172.21.15.53:0/822539331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694c66e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80058c0 tx=0x7ff6a80059b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9fa8255f31e7ad1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.349+0000 7ff6a37fe640 1 -- 172.21.15.53:0/822539331 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8034070 con 0x5572690e7670 2024-08-31T06:23:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.350+0000 7ff6a37fe640 1 -- 172.21.15.53:0/822539331 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6a80276b0 con 0x5572690e7670 2024-08-31T06:23:51.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.350+0000 7ff6a37fe640 1 -- 172.21.15.53:0/822539331 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80050c0 con 0x5572690e7670 2024-08-31T06:23:51.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.350+0000 7ff6c640e740 1 -- 172.21.15.53:0/822539331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 msgr2=0x5572694c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:51.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.350+0000 7ff6c640e740 1 --2- 172.21.15.53:0/822539331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694c66e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80058c0 tx=0x7ff6a80059b0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.351+0000 7ff6c640e740 1 -- 172.21.15.53:0/822539331 shutdown_connections 2024-08-31T06:23:51.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.351+0000 7ff6c640e740 1 --2- 172.21.15.53:0/822539331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557269108350 0x5572694b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.351+0000 7ff6c640e740 1 --2- 172.21.15.53:0/822539331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694c66e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.351+0000 7ff6c640e740 1 --2- 172.21.15.53:0/822539331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572690df490 0x5572694c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.351+0000 7ff6c640e740 1 -- 172.21.15.53:0/822539331 >> 172.21.15.53:0/822539331 conn(0x5572690fc740 msgr2=0x5572694ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.351+0000 7ff6c640e740 1 -- 172.21.15.53:0/822539331 shutdown_connections 2024-08-31T06:23:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.351+0000 7ff6c640e740 1 -- 172.21.15.53:0/822539331 wait complete. 2024-08-31T06:23:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.351+0000 7ff6c640e740 1 -- start start 2024-08-31T06:23:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.351+0000 7ff6c640e740 1 Processor -- start 2024-08-31T06:23:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5572690df490 0x5572694be650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694bec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6c640e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 0x557269535a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6c640e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b81b2c90 con 0x557269108350 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6bdc35640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5572690df490 0x5572694be650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6bd434640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694bec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6bdc35640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5572690df490 0x5572694be650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:51120/0 (socket says 172.21.15.53:51120) 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6bdc35640 1 -- 172.21.15.53:0/1422254500 learned_addr learned my addr 172.21.15.53:0/1422254500 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6c640e740 1 -- 172.21.15.53:0/1422254500 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b81b25c0 con 0x5572690e7670 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6c640e740 1 -- 172.21.15.53:0/1422254500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b81af7c0 con 0x5572690df490 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6be436640 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 0x557269535a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.352+0000 7ff6c640e740 10 client.0 _ll_register_callbacks cb 0x7ff6a80136a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.353+0000 7ff6be436640 1 -- 172.21.15.53:0/1422254500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5572690df490 msgr2=0x5572694be650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.353+0000 7ff6be436640 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5572690df490 0x5572694be650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.353+0000 7ff6be436640 1 -- 172.21.15.53:0/1422254500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 msgr2=0x5572694bec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.353+0000 7ff6be436640 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694bec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.353+0000 7ff6be436640 1 -- 172.21.15.53:0/1422254500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557269535f40 con 0x557269108350 2024-08-31T06:23:51.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.353+0000 7ff6bd434640 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694bec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:51.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.353+0000 7ff6be436640 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 0x557269535a00 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00e3310 tx=0x7ff6b00ac1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de3d8187b71c35d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:51.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.353+0000 7ff6a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:23:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.353+0000 7ff6a17fa640 1 -- 172.21.15.53:0/1422254500 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00b0b20 con 0x557269108350 2024-08-31T06:23:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.353+0000 7ff6a17fa640 1 -- 172.21.15.53:0/1422254500 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7ff6b00a8540 con 0x557269108350 2024-08-31T06:23:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.354+0000 7ff6c640e740 1 -- 172.21.15.53:0/1422254500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6a80276b0 con 0x557269108350 2024-08-31T06:23:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.354+0000 7ff6a17fa640 1 -- 172.21.15.53:0/1422254500 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ff6b00b55d0 con 0x557269108350 2024-08-31T06:23:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.354+0000 7ff6c640e740 10 client.21354 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.354+0000 7ff6c640e740 1 -- 172.21.15.53:0/1422254500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x557269537170 con 0x557269108350 2024-08-31T06:23:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.354+0000 7ff6a17fa640 1 -- 172.21.15.53:0/1422254500 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6a80276b0 con 0x557269108350 2024-08-31T06:23:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.354+0000 7ff6a17fa640 1 -- 172.21.15.53:0/1422254500 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7ff6b00a7e20 con 0x557269108350 2024-08-31T06:23:51.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.354+0000 7ff6c640e740 10 client.21354 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.354+0000 7ff6c640e740 10 client.21354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.355+0000 7ff6c640e740 20 client.21354 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.355+0000 7ff6c640e740 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55726909c080 0x557269539930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.355+0000 7ff6c640e740 4 client.21354 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:23:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.355+0000 7ff6c640e740 1 -- 172.21.15.53:0/1422254500 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557269426540 con 0x55726909c080 2024-08-31T06:23:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.355+0000 7ff6bdc35640 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55726909c080 0x557269539930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.355+0000 7ff6a17fa640 10 client.21354 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:51.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.356+0000 7ff6bdc35640 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55726909c080 0x557269539930 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64435249ee9314d5 server_cookie=c2ec7f175d68da14 in_seq=0 out_seq=0 2024-08-31T06:23:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.357+0000 7ff6a17fa640 1 -- 172.21.15.53:0/1422254500 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557269426540 con 0x55726909c080 2024-08-31T06:23:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.357+0000 7ff6a17fa640 10 client.21354 handle_command_reply: tid=0 2024-08-31T06:23:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.357+0000 7ff6c640e740 1 client.21354 shutdown 2024-08-31T06:23:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.358+0000 7ff6c640e740 1 -- 172.21.15.53:0/1422254500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 msgr2=0x557269535a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.358+0000 7ff6c640e740 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 0x557269535a00 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00e3310 tx=0x7ff6b00ac1b0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.358+0000 7ff6c640e740 1 -- 172.21.15.53:0/1422254500 shutdown_connections 2024-08-31T06:23:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.358+0000 7ff6c640e740 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55726909c080 0x557269539930 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.358+0000 7ff6c640e740 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557269108350 0x557269535a00 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.358+0000 7ff6c640e740 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572690e7670 0x5572694bec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.358+0000 7ff6c640e740 1 --2- 172.21.15.53:0/1422254500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5572690df490 0x5572694be650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.358+0000 7ff6c640e740 1 -- 172.21.15.53:0/1422254500 >> 172.21.15.53:0/1422254500 conn(0x5572690fc740 msgr2=0x5572694ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.358+0000 7ff6a17fa640 0 client.21354 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.358+0000 7ff6c640e740 1 -- 172.21.15.53:0/1422254500 shutdown_connections 2024-08-31T06:23:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.358+0000 7ff6c640e740 1 -- 172.21.15.53:0/1422254500 wait complete. 2024-08-31T06:23:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.359+0000 7ff6c640e740 20 client.21354 trim_cache size 0 max 16384 2024-08-31T06:23:51.363 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:23:51.364 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:23:51.364 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "4457a2b0-b9b7-447a-9934-a20026fc99bb", 2024-08-31T06:23:51.364 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:23:51.364 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:23:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 -- 172.21.15.53:0/4158032709 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6a40b4ca0 msgr2=0x7ff6a40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6a40b4ca0 0x7ff6a40b71b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8105c50 tx=0x7ff6b40058d0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 -- 172.21.15.53:0/4158032709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6b8108bc0 msgr2=0x7ff6b8104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6b8108bc0 0x7ff6b8104c80 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009fd0 tx=0x7ff6b000ef10 comp rx=0 tx=0).stop 2024-08-31T06:23:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 -- 172.21.15.53:0/4158032709 shutdown_connections 2024-08-31T06:23:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff6a40b4ca0 0x7ff6a40b71b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6b8108bc0 0x7ff6b8104c80 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b8108270 0x7ff6b8104740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 --2- 172.21.15.53:0/4158032709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b8102870 0x7ff6b8104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 -- 172.21.15.53:0/4158032709 >> 172.21.15.53:0/4158032709 conn(0x7ff6b80793f0 msgr2=0x7ff6b81066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 -- 172.21.15.53:0/4158032709 shutdown_connections 2024-08-31T06:23:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:51.360+0000 7ff6bfe99640 1 -- 172.21.15.53:0/4158032709 wait complete. 2024-08-31T06:23:51.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 37689 5.74 MB/sec execute 219 sec latency 75.031 ms 2024-08-31T06:23:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:51 smithi130 ceph-mon[22266]: pgmap v916: 97 pgs: 97 active+clean; 681 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 369 op/s 2024-08-31T06:23:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:51 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:23:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:51 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:52.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:51 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:23:52.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:51 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:23:52.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:51 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:23:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:51 smithi153 ceph-mon[22320]: pgmap v916: 97 pgs: 97 active+clean; 681 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 369 op/s 2024-08-31T06:23:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:51 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:23:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:51 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:51 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:23:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:51 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:23:52.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:51 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:23:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:51 smithi053 ceph-mon[18924]: pgmap v916: 97 pgs: 97 active+clean; 681 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 369 op/s 2024-08-31T06:23:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:51 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:23:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:51 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:51 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:23:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:51 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:23:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:51 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:23:52.377 INFO:tasks.workunit.client.0.smithi053.stdout: 10 37813 5.76 MB/sec execute 220 sec latency 463.056 ms 2024-08-31T06:23:53.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:52 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:23:53.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:52 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:23:53.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:52 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:52 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:52 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:52 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:52 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:52 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:23:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:52 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:23:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:52 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:52 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:52 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:52 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:52 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:52 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:23:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:52 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:23:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:52 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:52 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:52 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:52 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:52 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:23:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.265+0000 7f363a76e640 1 -- 172.21.15.53:0/2941210183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36341089f0 msgr2=0x7f363410f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.265+0000 7f363a76e640 1 --2- 172.21.15.53:0/2941210183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36341089f0 0x7f363410f220 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f362c009be0 tx=0x7f362c02a6c0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.265+0000 7f363a76e640 1 -- 172.21.15.53:0/2941210183 shutdown_connections 2024-08-31T06:23:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.265+0000 7f363a76e640 1 --2- 172.21.15.53:0/2941210183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f36341089f0 0x7f363410f220 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.265+0000 7f363a76e640 1 --2- 172.21.15.53:0/2941210183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36341080a0 0x7f36341084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.265+0000 7f363a76e640 1 --2- 172.21.15.53:0/2941210183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3634102770 0x7f3634102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.265+0000 7f363a76e640 1 -- 172.21.15.53:0/2941210183 >> 172.21.15.53:0/2941210183 conn(0x7f363407a490 msgr2=0x7f363407a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.265+0000 7f363a76e640 1 -- 172.21.15.53:0/2941210183 shutdown_connections 2024-08-31T06:23:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.265+0000 7f363a76e640 1 -- 172.21.15.53:0/2941210183 wait complete. 2024-08-31T06:23:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.266+0000 7f363a76e640 1 Processor -- start 2024-08-31T06:23:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.266+0000 7f363a76e640 1 -- start start 2024-08-31T06:23:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.266+0000 7f363a76e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3634102770 0x7f3634198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.266+0000 7f363a76e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36341080a0 0x7f3634199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.266+0000 7f363a76e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36341089f0 0x7f363419e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.266+0000 7f363a76e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3634112570 con 0x7f36341080a0 2024-08-31T06:23:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.266+0000 7f363a76e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f36341123f0 con 0x7f3634102770 2024-08-31T06:23:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.266+0000 7f363a76e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36341126f0 con 0x7f36341089f0 2024-08-31T06:23:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f3633fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3634102770 0x7f3634198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f36337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36341080a0 0x7f3634199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f3633fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3634102770 0x7f3634198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:41066/0 (socket says 172.21.15.53:41066) 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f3633fff640 1 -- 172.21.15.53:0/3082488822 learned_addr learned my addr 172.21.15.53:0/3082488822 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f3638d0b640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36341089f0 0x7f363419e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f3633fff640 1 -- 172.21.15.53:0/3082488822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36341089f0 msgr2=0x7f363419e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f3633fff640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36341089f0 0x7f363419e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f3633fff640 1 -- 172.21.15.53:0/3082488822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36341080a0 msgr2=0x7f3634199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f3633fff640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36341080a0 0x7f3634199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f3633fff640 1 -- 172.21.15.53:0/3082488822 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363419eea0 con 0x7f3634102770 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f3633fff640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3634102770 0x7f3634198f70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f362400e9c0 tx=0x7f362400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.267+0000 7f36317fa640 1 -- 172.21.15.53:0/3082488822 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362400cde0 con 0x7f3634102770 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.268+0000 7f36317fa640 1 -- 172.21.15.53:0/3082488822 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36240035f0 con 0x7f3634102770 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.268+0000 7f36317fa640 1 -- 172.21.15.53:0/3082488822 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624010690 con 0x7f3634102770 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.268+0000 7f363a76e640 1 -- 172.21.15.53:0/3082488822 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363419f190 con 0x7f3634102770 2024-08-31T06:23:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.268+0000 7f363a76e640 1 -- 172.21.15.53:0/3082488822 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f363406b340 con 0x7f3634102770 2024-08-31T06:23:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.271+0000 7f36317fa640 1 -- 172.21.15.53:0/3082488822 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3624004000 con 0x7f3634102770 2024-08-31T06:23:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.271+0000 7f36417bc740 1 Processor -- start 2024-08-31T06:23:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.271+0000 7f36417bc740 1 -- start start 2024-08-31T06:23:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.271+0000 7f36417bc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae539ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.271+0000 7f36417bc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae53a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.271+0000 7f36417bc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 0x5605ae53a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.271+0000 7f36417bc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5605ae4af000 con 0x5605ae1961b0 2024-08-31T06:23:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.271+0000 7f36417bc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5605ae49e590 con 0x5605ae1754d0 2024-08-31T06:23:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.271+0000 7f36417bc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5605ae4a2540 con 0x5605ae16d2f0 2024-08-31T06:23:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f3633fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae53a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f3638d0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae539ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f36337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 0x5605ae53a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f3633fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae53a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:45146/0 (socket says 172.21.15.53:45146) 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f3633fff640 1 -- 172.21.15.53:0/1814798661 learned_addr learned my addr 172.21.15.53:0/1814798661 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f36337fe640 1 --2- 172.21.15.53:0/1814798661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 0x5605ae53a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:41072/0 (socket says 172.21.15.53:41072) 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f36317fa640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f361c0b4ca0 0x7f361c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f3633fff640 1 -- 172.21.15.53:0/1814798661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 msgr2=0x5605ae53a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f3633fff640 1 --2- 172.21.15.53:0/1814798661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 0x5605ae53a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f3633fff640 1 -- 172.21.15.53:0/1814798661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 msgr2=0x5605ae539ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f3633fff640 1 --2- 172.21.15.53:0/1814798661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae539ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f3633fff640 1 -- 172.21.15.53:0/1814798661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605ae201790 con 0x5605ae16d2f0 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f36337fe640 1 --2- 172.21.15.53:0/1814798661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 0x5605ae53a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f3638d0b640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f361c0b4ca0 0x7f361c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f36317fa640 1 -- 172.21.15.53:0/3082488822 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f36240e5820 con 0x7f3634102770 2024-08-31T06:23:53.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.272+0000 7f3633fff640 1 --2- 172.21.15.53:0/1814798661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae53a220 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f36240e2e90 tx=0x7f3624021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e19248928f6fab5d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.273+0000 7f361a7fc640 1 -- 172.21.15.53:0/1814798661 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36240ab840 con 0x5605ae16d2f0 2024-08-31T06:23:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.273+0000 7f361a7fc640 1 -- 172.21.15.53:0/1814798661 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36240aba00 con 0x5605ae16d2f0 2024-08-31T06:23:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.273+0000 7f361a7fc640 1 -- 172.21.15.53:0/1814798661 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36240042f0 con 0x5605ae16d2f0 2024-08-31T06:23:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.274+0000 7f36417bc740 1 -- 172.21.15.53:0/1814798661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 msgr2=0x5605ae53a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.274+0000 7f3638d0b640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f361c0b4ca0 0x7f361c0b71b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f362c009370 tx=0x7f362c009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.274+0000 7f36417bc740 1 --2- 172.21.15.53:0/1814798661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae53a220 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f36240e2e90 tx=0x7f3624021000 comp rx=0 tx=0).stop 2024-08-31T06:23:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.274+0000 7f36417bc740 1 -- 172.21.15.53:0/1814798661 shutdown_connections 2024-08-31T06:23:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.274+0000 7f36417bc740 1 --2- 172.21.15.53:0/1814798661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 0x5605ae53a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.274+0000 7f36417bc740 1 --2- 172.21.15.53:0/1814798661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae53a220 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.274+0000 7f36417bc740 1 --2- 172.21.15.53:0/1814798661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae539ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.274+0000 7f36417bc740 1 -- 172.21.15.53:0/1814798661 >> 172.21.15.53:0/1814798661 conn(0x5605ae18a300 msgr2=0x5605ae537bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.274+0000 7f36417bc740 1 -- 172.21.15.53:0/1814798661 shutdown_connections 2024-08-31T06:23:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.274+0000 7f36417bc740 1 -- 172.21.15.53:0/1814798661 wait complete. 2024-08-31T06:23:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.274+0000 7f36417bc740 1 -- start start 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.275+0000 7f36417bc740 1 Processor -- start 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.275+0000 7f36417bc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 0x5605ae545890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.275+0000 7f36417bc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1754d0 0x5605ae545dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f36417bc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae1961b0 0x5605ae5516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f36417bc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5605ae3d7ab0 con 0x5605ae1754d0 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f36417bc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5605ae425680 con 0x5605ae16d2f0 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f36417bc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5605ae548400 con 0x5605ae1961b0 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f3633fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 0x5605ae545890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f36337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1754d0 0x5605ae545dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f3633fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 0x5605ae545890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:41078/0 (socket says 172.21.15.53:41078) 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f3633fff640 1 -- 172.21.15.53:0/2619573988 learned_addr learned my addr 172.21.15.53:0/2619573988 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f36417bc740 10 client.0 _ll_register_callbacks cb 0x5605ae1ada00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f3633fff640 1 -- 172.21.15.53:0/2619573988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae1961b0 msgr2=0x5605ae5516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f3633fff640 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae1961b0 0x5605ae5516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f3633fff640 1 -- 172.21.15.53:0/2619573988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1754d0 msgr2=0x5605ae545dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f3633fff640 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1754d0 0x5605ae545dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f3633fff640 1 -- 172.21.15.53:0/2619573988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605ae27a620 con 0x5605ae16d2f0 2024-08-31T06:23:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.276+0000 7f36337fe640 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1754d0 0x5605ae545dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.277+0000 7f3633fff640 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 0x5605ae545890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f36240abbf0 tx=0x7f36240e5b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=910e3b0636538211 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.277+0000 7f36137fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:23:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.277+0000 7f36137fe640 1 -- 172.21.15.53:0/2619573988 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36240ab660 con 0x5605ae16d2f0 2024-08-31T06:23:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.277+0000 7f36137fe640 1 -- 172.21.15.53:0/2619573988 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f36240b0430 con 0x5605ae16d2f0 2024-08-31T06:23:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.277+0000 7f36417bc740 1 -- 172.21.15.53:0/2619573988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36240aba00 con 0x5605ae16d2f0 2024-08-31T06:23:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.277+0000 7f36137fe640 1 -- 172.21.15.53:0/2619573988 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f36240042f0 con 0x5605ae16d2f0 2024-08-31T06:23:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.277+0000 7f36417bc740 10 client.30203 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.277+0000 7f36417bc740 1 -- 172.21.15.53:0/2619573988 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5605ae5543f0 con 0x5605ae16d2f0 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.277+0000 7f36137fe640 1 -- 172.21.15.53:0/2619573988 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36240aba00 con 0x5605ae16d2f0 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.278+0000 7f36137fe640 1 -- 172.21.15.53:0/2619573988 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f3624091ce0 con 0x5605ae16d2f0 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.278+0000 7f36417bc740 10 client.30203 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.278+0000 7f36417bc740 10 client.30203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.278+0000 7f36417bc740 20 client.30203 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.278+0000 7f36417bc740 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5605ae154d80 0x5605ae557a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.278+0000 7f36417bc740 4 client.30203 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.278+0000 7f36417bc740 1 -- 172.21.15.53:0/2619573988 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605ae4b0f50 con 0x5605ae154d80 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.278+0000 7f36337fe640 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5605ae154d80 0x5605ae557a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.279+0000 7f36337fe640 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5605ae154d80 0x5605ae557a80 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3379aa1ba337f68c server_cookie=d02ba361813b84b4 in_seq=0 out_seq=0 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.279+0000 7f36137fe640 10 client.30203 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.279+0000 7f36137fe640 1 -- 172.21.15.53:0/2619573988 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605ae4b0f50 con 0x5605ae154d80 2024-08-31T06:23:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.279+0000 7f36137fe640 10 client.30203 handle_command_reply: tid=0 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.280+0000 7f36417bc740 1 client.30203 shutdown 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.280+0000 7f36417bc740 1 -- 172.21.15.53:0/2619573988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 msgr2=0x5605ae545890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.280+0000 7f36417bc740 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 0x5605ae545890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f36240abbf0 tx=0x7f36240e5b90 comp rx=0 tx=0).stop 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.280+0000 7f36417bc740 1 -- 172.21.15.53:0/2619573988 shutdown_connections 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.280+0000 7f36417bc740 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5605ae154d80 0x5605ae557a80 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.280+0000 7f36417bc740 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae1961b0 0x5605ae5516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.280+0000 7f36417bc740 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1754d0 0x5605ae545dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.280+0000 7f36137fe640 0 client.30203 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.280+0000 7f36417bc740 1 --2- 172.21.15.53:0/2619573988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 0x5605ae545890 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.280+0000 7f36417bc740 1 -- 172.21.15.53:0/2619573988 >> 172.21.15.53:0/2619573988 conn(0x5605ae18a300 msgr2=0x5605ae53ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.281+0000 7f36417bc740 1 -- 172.21.15.53:0/2619573988 shutdown_connections 2024-08-31T06:23:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.281+0000 7f36417bc740 1 -- 172.21.15.53:0/2619573988 wait complete. 2024-08-31T06:23:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.281+0000 7f36417bc740 20 client.30203 trim_cache size 0 max 16384 2024-08-31T06:23:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.309+0000 7f36417bc740 1 Processor -- start 2024-08-31T06:23:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.309+0000 7f36417bc740 1 -- start start 2024-08-31T06:23:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.309+0000 7f36417bc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 0x5605ae5472b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.309+0000 7f36417bc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae1754d0 0x5605ae537180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f36417bc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae5376c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f36417bc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ad300 con 0x5605ae1961b0 2024-08-31T06:23:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f36417bc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f36341aeea0 con 0x5605ae16d2f0 2024-08-31T06:23:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f36417bc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ada30 con 0x5605ae1754d0 2024-08-31T06:23:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f3638d0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae5376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f3638d0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae5376c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47192/0 (socket says 172.21.15.53:47192) 2024-08-31T06:23:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f3638d0b640 1 -- 172.21.15.53:0/3662012525 learned_addr learned my addr 172.21.15.53:0/3662012525 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f3633fff640 1 --2- 172.21.15.53:0/3662012525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 0x5605ae5472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f36337fe640 1 --2- 172.21.15.53:0/3662012525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae1754d0 0x5605ae537180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f3638d0b640 1 -- 172.21.15.53:0/3662012525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae1754d0 msgr2=0x5605ae537180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f3638d0b640 1 --2- 172.21.15.53:0/3662012525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae1754d0 0x5605ae537180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f3638d0b640 1 -- 172.21.15.53:0/3662012525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 msgr2=0x5605ae5472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f3638d0b640 1 --2- 172.21.15.53:0/3662012525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 0x5605ae5472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f3638d0b640 1 -- 172.21.15.53:0/3662012525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605ae53c210 con 0x5605ae1961b0 2024-08-31T06:23:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.310+0000 7f3633fff640 1 --2- 172.21.15.53:0/3662012525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 0x5605ae5472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.311+0000 7f3638d0b640 1 --2- 172.21.15.53:0/3662012525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae5376c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f362c006010 tx=0x7f362c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddb24e5253d3cd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.311+0000 7f3619ffb640 1 -- 172.21.15.53:0/3662012525 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c04f070 con 0x5605ae1961b0 2024-08-31T06:23:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.311+0000 7f3619ffb640 1 -- 172.21.15.53:0/3662012525 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f362c037040 con 0x5605ae1961b0 2024-08-31T06:23:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.311+0000 7f3619ffb640 1 -- 172.21.15.53:0/3662012525 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c036040 con 0x5605ae1961b0 2024-08-31T06:23:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.312+0000 7f36417bc740 1 -- 172.21.15.53:0/3662012525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 msgr2=0x5605ae5376c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.312+0000 7f36417bc740 1 --2- 172.21.15.53:0/3662012525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae5376c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f362c006010 tx=0x7f362c02a6c0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.312+0000 7f36417bc740 1 -- 172.21.15.53:0/3662012525 shutdown_connections 2024-08-31T06:23:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.312+0000 7f36417bc740 1 --2- 172.21.15.53:0/3662012525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae5376c0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.312+0000 7f36417bc740 1 --2- 172.21.15.53:0/3662012525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae1754d0 0x5605ae537180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.312+0000 7f36417bc740 1 --2- 172.21.15.53:0/3662012525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae16d2f0 0x5605ae5472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.312+0000 7f36417bc740 1 -- 172.21.15.53:0/3662012525 >> 172.21.15.53:0/3662012525 conn(0x5605ae18a300 msgr2=0x5605ae546ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.312+0000 7f36417bc740 1 -- 172.21.15.53:0/3662012525 shutdown_connections 2024-08-31T06:23:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.312+0000 7f36417bc740 1 -- 172.21.15.53:0/3662012525 wait complete. 2024-08-31T06:23:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.313+0000 7f36417bc740 1 -- start start 2024-08-31T06:23:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.313+0000 7f36417bc740 1 Processor -- start 2024-08-31T06:23:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.313+0000 7f36417bc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae54dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.313+0000 7f36417bc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 0x5605ae5490e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.313+0000 7f36417bc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae549620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f36417bc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ae7d0 con 0x5605ae1961b0 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f36417bc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ae100 con 0x5605ae1754d0 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f36417bc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ab300 con 0x5605ae16d2f0 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f36417bc740 10 client.0 _ll_register_callbacks cb 0x7f3624005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f3633fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae54dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f36337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 0x5605ae5490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f3638d0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae549620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f3633fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae54dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:45156/0 (socket says 172.21.15.53:45156) 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f3633fff640 1 -- 172.21.15.53:0/2837907622 learned_addr learned my addr 172.21.15.53:0/2837907622 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f3633fff640 1 -- 172.21.15.53:0/2837907622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 msgr2=0x5605ae5490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f3633fff640 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 0x5605ae5490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f3633fff640 1 -- 172.21.15.53:0/2837907622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 msgr2=0x5605ae549620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f3633fff640 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae549620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f3633fff640 1 -- 172.21.15.53:0/2837907622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605ae532aa0 con 0x5605ae16d2f0 2024-08-31T06:23:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f36337fe640 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 0x5605ae5490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f3638d0b640 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae549620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f3633fff640 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae54dc40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f36240a8490 tx=0x7f36240abd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af72bf97ef38eb18 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f36137fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:23:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.314+0000 7f36137fe640 1 -- 172.21.15.53:0/2837907622 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36240ab840 con 0x5605ae16d2f0 2024-08-31T06:23:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.315+0000 7f36137fe640 1 -- 172.21.15.53:0/2837907622 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7f36240ac350 con 0x5605ae16d2f0 2024-08-31T06:23:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.315+0000 7f36417bc740 1 -- 172.21.15.53:0/2837907622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f362c037040 con 0x5605ae16d2f0 2024-08-31T06:23:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.315+0000 7f36137fe640 1 -- 172.21.15.53:0/2837907622 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f36240ab660 con 0x5605ae16d2f0 2024-08-31T06:23:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.315+0000 7f36417bc740 10 client.30211 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.315+0000 7f36417bc740 1 -- 172.21.15.53:0/2837907622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5605ae5c1fd0 con 0x5605ae16d2f0 2024-08-31T06:23:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.315+0000 7f36137fe640 1 -- 172.21.15.53:0/2837907622 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f362c037040 con 0x5605ae16d2f0 2024-08-31T06:23:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.316+0000 7f36137fe640 1 -- 172.21.15.53:0/2837907622 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f3624091ce0 con 0x5605ae16d2f0 2024-08-31T06:23:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.316+0000 7f36417bc740 10 client.30211 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.316+0000 7f36417bc740 10 client.30211 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.316+0000 7f36417bc740 20 client.30211 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.316+0000 7f36417bc740 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5605ae12a1c0 0x5605ae5c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.316+0000 7f36417bc740 4 client.30211 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:23:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.316+0000 7f36417bc740 1 -- 172.21.15.53:0/2837907622 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5605ae4ac9f0 con 0x5605ae12a1c0 2024-08-31T06:23:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.317+0000 7f36337fe640 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5605ae12a1c0 0x5605ae5c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.317+0000 7f36337fe640 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5605ae12a1c0 0x5605ae5c45a0 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33ee965099e35d56 server_cookie=577dc97fa87a1f58 in_seq=0 out_seq=0 2024-08-31T06:23:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.317+0000 7f36137fe640 10 client.30211 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:53.379 INFO:tasks.workunit.client.0.smithi053.stdout: 10 37936 5.76 MB/sec execute 221 sec latency 107.419 ms 2024-08-31T06:23:53.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.436+0000 7f36137fe640 1 -- 172.21.15.53:0/2837907622 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5605ae4ac9f0 con 0x5605ae12a1c0 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36137fe640 10 client.30211 handle_command_reply: tid=0 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 1 client.30211 shutdown 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 1 -- 172.21.15.53:0/2837907622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 msgr2=0x5605ae54dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae54dc40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f36240a8490 tx=0x7f36240abd80 comp rx=0 tx=0).stop 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 1 -- 172.21.15.53:0/2837907622 shutdown_connections 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5605ae12a1c0 0x5605ae5c45a0 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605ae1961b0 0x5605ae549620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605ae1754d0 0x5605ae5490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 1 --2- 172.21.15.53:0/2837907622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5605ae16d2f0 0x5605ae54dc40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36137fe640 0 client.30211 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 1 -- 172.21.15.53:0/2837907622 >> 172.21.15.53:0/2837907622 conn(0x5605ae18a300 msgr2=0x5605ae5474f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 1 -- 172.21.15.53:0/2837907622 shutdown_connections 2024-08-31T06:23:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 1 -- 172.21.15.53:0/2837907622 wait complete. 2024-08-31T06:23:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.437+0000 7f36417bc740 20 client.30211 trim_cache size 0 max 16384 2024-08-31T06:23:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:23:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:23:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:23:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:23:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.438+0000 7f363a76e640 1 -- 172.21.15.53:0/3082488822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f361c0b4ca0 msgr2=0x7f361c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.438+0000 7f363a76e640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f361c0b4ca0 0x7f361c0b71b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f362c009370 tx=0x7f362c009500 comp rx=0 tx=0).stop 2024-08-31T06:23:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.438+0000 7f363a76e640 1 -- 172.21.15.53:0/3082488822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3634102770 msgr2=0x7f3634198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.438+0000 7f363a76e640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3634102770 0x7f3634198f70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f362400e9c0 tx=0x7f362400ee80 comp rx=0 tx=0).stop 2024-08-31T06:23:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.438+0000 7f363a76e640 1 -- 172.21.15.53:0/3082488822 shutdown_connections 2024-08-31T06:23:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.438+0000 7f363a76e640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f361c0b4ca0 0x7f361c0b71b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.438+0000 7f363a76e640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36341089f0 0x7f363419e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.438+0000 7f363a76e640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36341080a0 0x7f3634199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.438+0000 7f363a76e640 1 --2- 172.21.15.53:0/3082488822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3634102770 0x7f3634198f70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.438+0000 7f363a76e640 1 -- 172.21.15.53:0/3082488822 >> 172.21.15.53:0/3082488822 conn(0x7f363407a490 msgr2=0x7f3634106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.438+0000 7f363a76e640 1 -- 172.21.15.53:0/3082488822 shutdown_connections 2024-08-31T06:23:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:23:53.439+0000 7f363a76e640 1 -- 172.21.15.53:0/3082488822 wait complete. 2024-08-31T06:23:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:53 smithi130 ceph-mon[22266]: pgmap v917: 97 pgs: 97 active+clean; 683 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 313 op/s 2024-08-31T06:23:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:53 smithi153 ceph-mon[22320]: pgmap v917: 97 pgs: 97 active+clean; 683 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 313 op/s 2024-08-31T06:23:54.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:53 smithi053 ceph-mon[18924]: pgmap v917: 97 pgs: 97 active+clean; 683 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 313 op/s 2024-08-31T06:23:54.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 38090 5.79 MB/sec execute 222 sec latency 110.354 ms 2024-08-31T06:23:54.399 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:23:54.807 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:23:55.380 INFO:tasks.workunit.client.0.smithi053.stdout: 10 38250 5.83 MB/sec execute 223 sec latency 141.233 ms 2024-08-31T06:23:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:55 smithi130 ceph-mon[22266]: pgmap v918: 97 pgs: 97 active+clean; 690 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 384 op/s 2024-08-31T06:23:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:55 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:23:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:55 smithi153 ceph-mon[22320]: pgmap v918: 97 pgs: 97 active+clean; 690 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 384 op/s 2024-08-31T06:23:56.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:55 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:23:56.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:55 smithi053 ceph-mon[18924]: pgmap v918: 97 pgs: 97 active+clean; 690 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 384 op/s 2024-08-31T06:23:56.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:55 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:23:56.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 38391 5.83 MB/sec execute 224 sec latency 133.268 ms 2024-08-31T06:23:57.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 38533 5.84 MB/sec execute 225 sec latency 153.018 ms 2024-08-31T06:23:58.127 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:57 smithi053 ceph-mon[18924]: pgmap v919: 97 pgs: 97 active+clean; 686 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 360 op/s 2024-08-31T06:23:58.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:57 smithi130 ceph-mon[22266]: pgmap v919: 97 pgs: 97 active+clean; 686 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 360 op/s 2024-08-31T06:23:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:57 smithi153 ceph-mon[22320]: pgmap v919: 97 pgs: 97 active+clean; 686 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 360 op/s 2024-08-31T06:23:58.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 38642 5.84 MB/sec execute 226 sec latency 138.972 ms 2024-08-31T06:23:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.970+0000 7fcd92cb0640 1 -- 172.21.15.53:0/1080857123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd8c108a90 msgr2=0x7fcd8c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.970+0000 7fcd92cb0640 1 --2- 172.21.15.53:0/1080857123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd8c108a90 0x7fcd8c10f2c0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009ca0 tx=0x7fcd8402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.971+0000 7fcd92cb0640 1 -- 172.21.15.53:0/1080857123 shutdown_connections 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.971+0000 7fcd92cb0640 1 --2- 172.21.15.53:0/1080857123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd8c108a90 0x7fcd8c10f2c0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.971+0000 7fcd92cb0640 1 --2- 172.21.15.53:0/1080857123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd8c108140 0x7fcd8c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.971+0000 7fcd92cb0640 1 --2- 172.21.15.53:0/1080857123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd8c102800 0x7fcd8c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.971+0000 7fcd92cb0640 1 -- 172.21.15.53:0/1080857123 >> 172.21.15.53:0/1080857123 conn(0x7fcd8c0794d0 msgr2=0x7fcd8c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.971+0000 7fcd92cb0640 1 -- 172.21.15.53:0/1080857123 shutdown_connections 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.971+0000 7fcd92cb0640 1 -- 172.21.15.53:0/1080857123 wait complete. 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd92cb0640 1 Processor -- start 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd92cb0640 1 -- start start 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd92cb0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd8c102800 0x7fcd8c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd92cb0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd8c108140 0x7fcd8c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd92cb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd8c108a90 0x7fcd8c19f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd92cb0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c1125f0 con 0x7fcd8c108a90 2024-08-31T06:23:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd92cb0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c112470 con 0x7fcd8c102800 2024-08-31T06:23:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd92cb0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c112770 con 0x7fcd8c108140 2024-08-31T06:23:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd90a4c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd8c102800 0x7fcd8c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd9124d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd8c108a90 0x7fcd8c19f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd90a4c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd8c102800 0x7fcd8c19a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:41130/0 (socket says 172.21.15.53:41130) 2024-08-31T06:23:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd90a4c640 1 -- 172.21.15.53:0/4065583942 learned_addr learned my addr 172.21.15.53:0/4065583942 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.972+0000 7fcd8bfff640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd8c108140 0x7fcd8c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.973+0000 7fcd9124d640 1 -- 172.21.15.53:0/4065583942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd8c108140 msgr2=0x7fcd8c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.973+0000 7fcd9124d640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd8c108140 0x7fcd8c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.973+0000 7fcd9124d640 1 -- 172.21.15.53:0/4065583942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd8c102800 msgr2=0x7fcd8c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.973+0000 7fcd9124d640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd8c102800 0x7fcd8c19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.973+0000 7fcd9124d640 1 -- 172.21.15.53:0/4065583942 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c1a00e0 con 0x7fcd8c108a90 2024-08-31T06:23:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.973+0000 7fcd9124d640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd8c108a90 0x7fcd8c19f9b0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fcd84031040 tx=0x7fcd84003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.973+0000 7fcd89ffb640 1 -- 172.21.15.53:0/4065583942 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84032c10 con 0x7fcd8c108a90 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.973+0000 7fcd92cb0640 1 -- 172.21.15.53:0/4065583942 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8c1a0370 con 0x7fcd8c108a90 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.973+0000 7fcd89ffb640 1 -- 172.21.15.53:0/4065583942 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd84032db0 con 0x7fcd8c108a90 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.973+0000 7fcd89ffb640 1 -- 172.21.15.53:0/4065583942 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84030a20 con 0x7fcd8c108a90 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.974+0000 7fcd92cb0640 1 -- 172.21.15.53:0/4065583942 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8c1a6b30 con 0x7fcd8c108a90 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.977+0000 7fcd89ffb640 1 -- 172.21.15.53:0/4065583942 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcd84030bc0 con 0x7fcd8c108a90 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.977+0000 7fcd99225740 1 Processor -- start 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.977+0000 7fcd99225740 1 -- start start 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd99225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86b3070 0x558ee8a5c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd99225740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee868a1b0 0x558ee8a5cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd99225740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 0x558ee8a5d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd99225740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ee89cf630 con 0x558ee8692390 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd99225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558ee89bebc0 con 0x558ee86b3070 2024-08-31T06:23:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd99225740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558ee89c2b70 con 0x558ee868a1b0 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 0x558ee8a5d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd90a4c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee868a1b0 0x558ee8a5cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 0x558ee8a5d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47232/0 (socket says 172.21.15.53:47232) 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd8bfff640 1 -- 172.21.15.53:0/1002690792 learned_addr learned my addr 172.21.15.53:0/1002690792 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd8bfff640 1 --2- 172.21.15.53:0/1002690792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86b3070 0x558ee8a5c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.978+0000 7fcd90a4c640 1 -- 172.21.15.53:0/1002690792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86b3070 msgr2=0x558ee8a5c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.979+0000 7fcd90a4c640 1 --2- 172.21.15.53:0/1002690792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86b3070 0x558ee8a5c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.979+0000 7fcd90a4c640 1 -- 172.21.15.53:0/1002690792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 msgr2=0x558ee8a5d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.979+0000 7fcd90a4c640 1 --2- 172.21.15.53:0/1002690792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 0x558ee8a5d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.979+0000 7fcd89ffb640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd7c0b4d20 0x7fcd7c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.979+0000 7fcd90a4c640 1 -- 172.21.15.53:0/1002690792 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee871e650 con 0x558ee868a1b0 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.979+0000 7fcd89ffb640 1 -- 172.21.15.53:0/4065583942 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fcd84106690 con 0x7fcd8c108a90 2024-08-31T06:23:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.979+0000 7fcd8bfff640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd7c0b4d20 0x7fcd7c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.980+0000 7fcd90a4c640 1 --2- 172.21.15.53:0/1002690792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee868a1b0 0x558ee8a5cc10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009d20 tx=0x7fcd80011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e02b1790d9c713 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.980+0000 7fcd8bfff640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd7c0b4d20 0x7fcd7c0b7230 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009fd0 tx=0x7fcd78004730 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.980+0000 7fcd76ffd640 1 -- 172.21.15.53:0/1002690792 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80005220 con 0x558ee868a1b0 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.980+0000 7fcd76ffd640 1 -- 172.21.15.53:0/1002690792 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd80004c30 con 0x558ee868a1b0 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.980+0000 7fcd76ffd640 1 -- 172.21.15.53:0/1002690792 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80019720 con 0x558ee868a1b0 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.982+0000 7fcd99225740 1 -- 172.21.15.53:0/1002690792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee868a1b0 msgr2=0x558ee8a5cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.982+0000 7fcd99225740 1 --2- 172.21.15.53:0/1002690792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee868a1b0 0x558ee8a5cc10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009d20 tx=0x7fcd80011810 comp rx=0 tx=0).stop 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.982+0000 7fcd99225740 1 -- 172.21.15.53:0/1002690792 shutdown_connections 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.982+0000 7fcd99225740 1 --2- 172.21.15.53:0/1002690792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 0x558ee8a5d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.982+0000 7fcd99225740 1 --2- 172.21.15.53:0/1002690792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee868a1b0 0x558ee8a5cc10 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009d20 tx=0x7fcd80011810 comp rx=0 tx=0).stop 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.982+0000 7fcd99225740 1 --2- 172.21.15.53:0/1002690792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86b3070 0x558ee8a5c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.982+0000 7fcd99225740 1 -- 172.21.15.53:0/1002690792 >> 172.21.15.53:0/1002690792 conn(0x558ee86a7460 msgr2=0x558ee8a5a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.982+0000 7fcd99225740 1 -- 172.21.15.53:0/1002690792 shutdown_connections 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.982+0000 7fcd99225740 1 -- 172.21.15.53:0/1002690792 wait complete. 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.982+0000 7fcd99225740 1 -- start start 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.982+0000 7fcd99225740 1 Processor -- start 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.983+0000 7fcd99225740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee8692390 0x558ee8a64250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.983+0000 7fcd99225740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86b3070 0x558ee8a64790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.983+0000 7fcd99225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86719f0 0x558ee8a697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.983+0000 7fcd99225740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ee8821700 con 0x558ee86b3070 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.983+0000 7fcd99225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558ee8945700 con 0x558ee86719f0 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.983+0000 7fcd99225740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558ee8a55bc0 con 0x558ee8692390 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.983+0000 7fcd99225740 10 client.0 _ll_register_callbacks cb 0x558ee8974dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.984+0000 7fcd8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86b3070 0x558ee8a64790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.984+0000 7fcd8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86b3070 0x558ee8a64790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47234/0 (socket says 172.21.15.53:47234) 2024-08-31T06:23:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.984+0000 7fcd8bfff640 1 -- 172.21.15.53:0/323636836 learned_addr learned my addr 172.21.15.53:0/323636836 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.984+0000 7fcd90a4c640 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee8692390 0x558ee8a64250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.984+0000 7fcd9124d640 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86719f0 0x558ee8a697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.984+0000 7fcd9124d640 1 -- 172.21.15.53:0/323636836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee8692390 msgr2=0x558ee8a64250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.984+0000 7fcd9124d640 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee8692390 0x558ee8a64250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.984+0000 7fcd9124d640 1 -- 172.21.15.53:0/323636836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86b3070 msgr2=0x558ee8a64790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.984+0000 7fcd9124d640 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86b3070 0x558ee8a64790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.984+0000 7fcd9124d640 1 -- 172.21.15.53:0/323636836 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee897e8b0 con 0x558ee86719f0 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.985+0000 7fcd9124d640 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86719f0 0x558ee8a697e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcd84103dc0 tx=0x7fcd840cc560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41f8ce3d63761ee6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.985+0000 7fcd6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.985+0000 7fcd6bfff640 1 -- 172.21.15.53:0/323636836 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd840cd4f0 con 0x558ee86719f0 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.985+0000 7fcd99225740 1 -- 172.21.15.53:0/323636836 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd80004c30 con 0x558ee86719f0 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.985+0000 7fcd6bfff640 1 -- 172.21.15.53:0/323636836 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fcd840c9080 con 0x558ee86719f0 2024-08-31T06:23:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.985+0000 7fcd6bfff640 1 -- 172.21.15.53:0/323636836 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fcd840ccdf0 con 0x558ee86719f0 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.985+0000 7fcd99225740 10 client.30221 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.985+0000 7fcd99225740 1 -- 172.21.15.53:0/323636836 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x558ee8a7b1e0 con 0x558ee86719f0 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.986+0000 7fcd6bfff640 1 -- 172.21.15.53:0/323636836 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd80004c30 con 0x558ee86719f0 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.986+0000 7fcd6bfff640 1 -- 172.21.15.53:0/323636836 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fcd840d1270 con 0x558ee86719f0 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.986+0000 7fcd99225740 10 client.30221 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.986+0000 7fcd99225740 10 client.30221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.986+0000 7fcd99225740 20 client.30221 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.986+0000 7fcd99225740 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ee8646da0 0x558ee8a7e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.986+0000 7fcd99225740 4 client.30221 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.986+0000 7fcd99225740 1 -- 172.21.15.53:0/323636836 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ee89d1580 con 0x558ee8646da0 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.986+0000 7fcd90a4c640 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ee8646da0 0x558ee8a7e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.987+0000 7fcd6bfff640 10 client.30221 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.987+0000 7fcd90a4c640 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ee8646da0 0x558ee8a7e7f0 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c08dab8a27be89e4 server_cookie=616b10a472786793 in_seq=0 out_seq=0 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd6bfff640 1 -- 172.21.15.53:0/323636836 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ee89d1580 con 0x558ee8646da0 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd6bfff640 10 client.30221 handle_command_reply: tid=0 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd99225740 1 client.30221 shutdown 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd99225740 1 -- 172.21.15.53:0/323636836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86719f0 msgr2=0x558ee8a697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd99225740 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86719f0 0x558ee8a697e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcd84103dc0 tx=0x7fcd840cc560 comp rx=0 tx=0).stop 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd99225740 1 -- 172.21.15.53:0/323636836 shutdown_connections 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd99225740 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ee8646da0 0x558ee8a7e7f0 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd99225740 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86719f0 0x558ee8a697e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd99225740 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86b3070 0x558ee8a64790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd99225740 1 --2- 172.21.15.53:0/323636836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee8692390 0x558ee8a64250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd99225740 1 -- 172.21.15.53:0/323636836 >> 172.21.15.53:0/323636836 conn(0x558ee86a7460 msgr2=0x558ee8a54770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd6bfff640 0 client.30221 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd99225740 1 -- 172.21.15.53:0/323636836 shutdown_connections 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.988+0000 7fcd99225740 1 -- 172.21.15.53:0/323636836 wait complete. 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:57.989+0000 7fcd99225740 20 client.30221 trim_cache size 0 max 16384 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.021+0000 7fcd99225740 1 Processor -- start 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.021+0000 7fcd99225740 1 -- start start 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.021+0000 7fcd99225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86a7460 0x558ee8a5a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.021+0000 7fcd99225740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86719f0 0x558ee8a686b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.021+0000 7fcd99225740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee8692390 0x558ee8a68bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.021+0000 7fcd99225740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c1ad290 con 0x558ee86719f0 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd99225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c1aee30 con 0x558ee86a7460 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86719f0 0x558ee8a686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd99225740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c1ad9c0 con 0x558ee8692390 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86719f0 0x558ee8a686b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47246/0 (socket says 172.21.15.53:47246) 2024-08-31T06:23:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd8bfff640 1 -- 172.21.15.53:0/2113888012 learned_addr learned my addr 172.21.15.53:0/2113888012 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd9124d640 1 --2- 172.21.15.53:0/2113888012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee8692390 0x558ee8a68bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd8bfff640 1 -- 172.21.15.53:0/2113888012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee8692390 msgr2=0x558ee8a68bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd8bfff640 1 --2- 172.21.15.53:0/2113888012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee8692390 0x558ee8a68bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd90a4c640 1 --2- 172.21.15.53:0/2113888012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86a7460 0x558ee8a5a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd8bfff640 1 -- 172.21.15.53:0/2113888012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86a7460 msgr2=0x558ee8a5a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd8bfff640 1 --2- 172.21.15.53:0/2113888012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86a7460 0x558ee8a5a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd8bfff640 1 -- 172.21.15.53:0/2113888012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee8a51550 con 0x558ee86719f0 2024-08-31T06:23:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.022+0000 7fcd9124d640 1 --2- 172.21.15.53:0/2113888012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee8692390 0x558ee8a68bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:23:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.023+0000 7fcd8bfff640 1 --2- 172.21.15.53:0/2113888012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86719f0 0x558ee8a686b0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fcd78003720 tx=0x7fcd78015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379b082367fb4119 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.023+0000 7fcd767fc640 1 -- 172.21.15.53:0/2113888012 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd780206a0 con 0x558ee86719f0 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.023+0000 7fcd767fc640 1 -- 172.21.15.53:0/2113888012 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd78020cd0 con 0x558ee86719f0 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.023+0000 7fcd767fc640 1 -- 172.21.15.53:0/2113888012 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7802ba00 con 0x558ee86719f0 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.024+0000 7fcd99225740 1 -- 172.21.15.53:0/2113888012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86719f0 msgr2=0x558ee8a686b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.024+0000 7fcd99225740 1 --2- 172.21.15.53:0/2113888012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86719f0 0x558ee8a686b0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fcd78003720 tx=0x7fcd78015000 comp rx=0 tx=0).stop 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.024+0000 7fcd99225740 1 -- 172.21.15.53:0/2113888012 shutdown_connections 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.024+0000 7fcd99225740 1 --2- 172.21.15.53:0/2113888012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee8692390 0x558ee8a68bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.024+0000 7fcd99225740 1 --2- 172.21.15.53:0/2113888012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee86719f0 0x558ee8a686b0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.024+0000 7fcd99225740 1 --2- 172.21.15.53:0/2113888012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86a7460 0x558ee8a5a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.024+0000 7fcd99225740 1 -- 172.21.15.53:0/2113888012 >> 172.21.15.53:0/2113888012 conn(0x558ee8a59ab0 msgr2=0x558ee8a59f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.024+0000 7fcd99225740 1 -- 172.21.15.53:0/2113888012 shutdown_connections 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.025+0000 7fcd99225740 1 -- 172.21.15.53:0/2113888012 wait complete. 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.025+0000 7fcd99225740 1 -- start start 2024-08-31T06:23:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.025+0000 7fcd99225740 1 Processor -- start 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd99225740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee86719f0 0x558ee8a784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd99225740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 0x558ee8a78a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd99225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86a7460 0x558ee8a73480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd99225740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c1ae760 con 0x558ee8692390 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd99225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c1ae090 con 0x558ee86a7460 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd99225740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c1ab290 con 0x558ee86719f0 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd99225740 10 client.0 _ll_register_callbacks cb 0x7fcd84032f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 0x558ee8a78a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd90a4c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee86719f0 0x558ee8a784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd8bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 0x558ee8a78a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47262/0 (socket says 172.21.15.53:47262) 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd8bfff640 1 -- 172.21.15.53:0/123262199 learned_addr learned my addr 172.21.15.53:0/123262199 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd90a4c640 1 -- 172.21.15.53:0/123262199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86a7460 msgr2=0x558ee8a73480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:23:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd90a4c640 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86a7460 0x558ee8a73480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd90a4c640 1 -- 172.21.15.53:0/123262199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 msgr2=0x558ee8a78a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd90a4c640 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 0x558ee8a78a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd90a4c640 1 -- 172.21.15.53:0/123262199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee8a739c0 con 0x558ee86719f0 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.026+0000 7fcd8bfff640 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 0x558ee8a78a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.027+0000 7fcd90a4c640 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee86719f0 0x558ee8a784d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x558ee8a5f3d0 tx=0x7fcd80019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26491b0079f3ba37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.027+0000 7fcd6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.027+0000 7fcd6bfff640 1 -- 172.21.15.53:0/123262199 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80019be0 con 0x558ee86719f0 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.027+0000 7fcd6bfff640 1 -- 172.21.15.53:0/123262199 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fcd80005bf0 con 0x558ee86719f0 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.027+0000 7fcd99225740 1 -- 172.21.15.53:0/123262199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd78020cd0 con 0x558ee86719f0 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.027+0000 7fcd6bfff640 1 -- 172.21.15.53:0/123262199 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fcd80019d80 con 0x558ee86719f0 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.027+0000 7fcd99225740 10 client.30226 fetch_fsmap learned FSMap version 66 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.027+0000 7fcd99225740 1 -- 172.21.15.53:0/123262199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x558ee8ae9790 con 0x558ee86719f0 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.027+0000 7fcd6bfff640 1 -- 172.21.15.53:0/123262199 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd78020cd0 con 0x558ee86719f0 2024-08-31T06:23:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.028+0000 7fcd6bfff640 1 -- 172.21.15.53:0/123262199 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7fcd80024410 con 0x558ee86719f0 2024-08-31T06:23:58.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.028+0000 7fcd99225740 10 client.30226 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:23:58.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.028+0000 7fcd99225740 10 client.30226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:23:58.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.028+0000 7fcd99225740 20 client.30226 populate_metadata read hostname 'smithi053' 2024-08-31T06:23:58.873 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:23:58.873 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:23:58.873 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:23:58.873 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:23:58.873 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.873 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "4457a2b0-b9b7-447a-9934-a20026fc99bb", 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.874 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.875 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.876 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.877 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.878 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.879 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.880 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.880 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.880 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.880 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:23:58.880 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:23:58.880 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.880 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.880 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.880 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.880 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.881 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:23:58.881 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:23:58.881 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.881 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.881 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.881 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.881 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.882 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:23:58.883 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.884 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.885 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.886 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:23:58.887 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:58.888 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:23:58.889 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:23:58.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.028+0000 7fcd99225740 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ee86b3070 0x558ee8aebce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:23:58.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.028+0000 7fcd99225740 4 client.30226 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:23:58.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.028+0000 7fcd99225740 1 -- 172.21.15.53:0/123262199 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558ee89cd020 con 0x558ee86b3070 2024-08-31T06:23:58.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.028+0000 7fcd8bfff640 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ee86b3070 0x558ee8aebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:23:58.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.028+0000 7fcd6bfff640 10 client.30226 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:58.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd8bfff640 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ee86b3070 0x558ee8aebce0 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f11555941af94235 server_cookie=6392923bc9346614 in_seq=0 out_seq=0 2024-08-31T06:23:58.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd6bfff640 1 -- 172.21.15.53:0/123262199 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7102 (crc 0 0 0) 0x558ee89cd020 con 0x558ee86b3070 2024-08-31T06:23:58.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd6bfff640 10 client.30226 handle_command_reply: tid=0 2024-08-31T06:23:58.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd99225740 1 client.30226 shutdown 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd99225740 1 -- 172.21.15.53:0/123262199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee86719f0 msgr2=0x558ee8a784d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd99225740 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee86719f0 0x558ee8a784d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x558ee8a5f3d0 tx=0x7fcd80019660 comp rx=0 tx=0).stop 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd99225740 1 -- 172.21.15.53:0/123262199 shutdown_connections 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd99225740 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ee86b3070 0x558ee8aebce0 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd99225740 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ee86a7460 0x558ee8a73480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd99225740 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ee8692390 0x558ee8a78a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd99225740 1 --2- 172.21.15.53:0/123262199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ee86719f0 0x558ee8a784d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd6bfff640 0 client.30226 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd99225740 1 -- 172.21.15.53:0/123262199 >> 172.21.15.53:0/123262199 conn(0x558ee8a59ab0 msgr2=0x558ee8a68690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.029+0000 7fcd99225740 1 -- 172.21.15.53:0/123262199 shutdown_connections 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.030+0000 7fcd99225740 1 -- 172.21.15.53:0/123262199 wait complete. 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.030+0000 7fcd99225740 20 client.30226 trim_cache size 0 max 16384 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.030+0000 7fcd92cb0640 1 -- 172.21.15.53:0/4065583942 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd7c0b4d20 msgr2=0x7fcd7c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:58.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.030+0000 7fcd92cb0640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd7c0b4d20 0x7fcd7c0b7230 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009fd0 tx=0x7fcd78004730 comp rx=0 tx=0).stop 2024-08-31T06:23:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.030+0000 7fcd92cb0640 1 -- 172.21.15.53:0/4065583942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd8c108a90 msgr2=0x7fcd8c19f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:23:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.030+0000 7fcd92cb0640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd8c108a90 0x7fcd8c19f9b0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fcd84031040 tx=0x7fcd84003f10 comp rx=0 tx=0).stop 2024-08-31T06:23:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.031+0000 7fcd92cb0640 1 -- 172.21.15.53:0/4065583942 shutdown_connections 2024-08-31T06:23:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.031+0000 7fcd92cb0640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcd7c0b4d20 0x7fcd7c0b7230 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.031+0000 7fcd92cb0640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd8c108a90 0x7fcd8c19f9b0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.031+0000 7fcd92cb0640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd8c108140 0x7fcd8c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.031+0000 7fcd92cb0640 1 --2- 172.21.15.53:0/4065583942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd8c102800 0x7fcd8c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:23:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.031+0000 7fcd92cb0640 1 -- 172.21.15.53:0/4065583942 >> 172.21.15.53:0/4065583942 conn(0x7fcd8c0794d0 msgr2=0x7fcd8c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:23:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.031+0000 7fcd92cb0640 1 -- 172.21.15.53:0/4065583942 shutdown_connections 2024-08-31T06:23:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:23:58.031+0000 7fcd92cb0640 1 -- 172.21.15.53:0/4065583942 wait complete. 2024-08-31T06:23:59.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 38751 5.83 MB/sec execute 227 sec latency 107.806 ms 2024-08-31T06:24:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:23:59 smithi130 ceph-mon[22266]: pgmap v920: 97 pgs: 97 active+clean; 690 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 332 op/s 2024-08-31T06:24:00.157 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:23:59 smithi053 ceph-mon[18924]: pgmap v920: 97 pgs: 97 active+clean; 690 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 332 op/s 2024-08-31T06:24:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:23:59 smithi153 ceph-mon[22320]: pgmap v920: 97 pgs: 97 active+clean; 690 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 332 op/s 2024-08-31T06:24:00.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 38876 5.84 MB/sec execute 228 sec latency 134.834 ms 2024-08-31T06:24:01.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 38990 5.84 MB/sec execute 229 sec latency 130.170 ms 2024-08-31T06:24:02.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:01 smithi053 ceph-mon[18924]: pgmap v921: 97 pgs: 97 active+clean; 696 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 391 op/s 2024-08-31T06:24:02.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:01 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:24:02.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:01 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:24:02.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:01 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:24:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:01 smithi130 ceph-mon[22266]: pgmap v921: 97 pgs: 97 active+clean; 696 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 391 op/s 2024-08-31T06:24:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:01 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:24:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:01 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:24:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:01 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:24:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:01 smithi153 ceph-mon[22320]: pgmap v921: 97 pgs: 97 active+clean; 696 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 391 op/s 2024-08-31T06:24:02.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:01 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:24:02.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:01 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:24:02.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:01 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:24:02.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39112 5.83 MB/sec execute 230 sec latency 157.935 ms 2024-08-31T06:24:03.004 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.8 2024-08-31T06:24:03.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:24:03.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39247 5.84 MB/sec execute 231 sec latency 133.765 ms 2024-08-31T06:24:04.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:03 smithi130 ceph-mon[22266]: pgmap v922: 97 pgs: 97 active+clean; 695 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 328 op/s 2024-08-31T06:24:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:03 smithi153 ceph-mon[22320]: pgmap v922: 97 pgs: 97 active+clean; 695 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 328 op/s 2024-08-31T06:24:04.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:03 smithi053 ceph-mon[18924]: pgmap v922: 97 pgs: 97 active+clean; 695 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 328 op/s 2024-08-31T06:24:04.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39396 5.85 MB/sec execute 232 sec latency 90.942 ms 2024-08-31T06:24:04.884 INFO:tasks.cephfs.filesystem:scrub status for tag:4457a2b0-b9b7-447a-9934-a20026fc99bb - {'path': '/', 'tag': '4457a2b0-b9b7-447a-9934-a20026fc99bb', 'options': 'recursive,force'} 2024-08-31T06:24:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:05.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39550 5.86 MB/sec execute 233 sec latency 109.613 ms 2024-08-31T06:24:05.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.574+0000 7fa4bf7fe640 1 -- 172.21.15.53:0/2376891435 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4035020 con 0x7fa4c8102800 2024-08-31T06:24:05.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.575+0000 7fa4cf097640 1 -- 172.21.15.53:0/2376891435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4c8102800 msgr2=0x7fa4c8102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:05.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.575+0000 7fa4cf097640 1 --2- 172.21.15.53:0/2376891435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4c8102800 0x7fa4c8102c10 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009900 tx=0x7fa4c402a410 comp rx=0 tx=0).stop 2024-08-31T06:24:05.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.575+0000 7fa4cf097640 1 -- 172.21.15.53:0/2376891435 shutdown_connections 2024-08-31T06:24:05.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.575+0000 7fa4cf097640 1 --2- 172.21.15.53:0/2376891435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4c8108a90 0x7fa4c810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:05.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.575+0000 7fa4cf097640 1 --2- 172.21.15.53:0/2376891435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4c8108140 0x7fa4c8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:05.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.575+0000 7fa4cf097640 1 --2- 172.21.15.53:0/2376891435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4c8102800 0x7fa4c8102c10 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:05.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.575+0000 7fa4cf097640 1 -- 172.21.15.53:0/2376891435 >> 172.21.15.53:0/2376891435 conn(0x7fa4c80794d0 msgr2=0x7fa4c80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:05.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.576+0000 7fa4cf097640 1 -- 172.21.15.53:0/2376891435 shutdown_connections 2024-08-31T06:24:05.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.576+0000 7fa4cf097640 1 -- 172.21.15.53:0/2376891435 wait complete. 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.576+0000 7fa4cf097640 1 Processor -- start 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.577+0000 7fa4cf097640 1 -- start start 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.577+0000 7fa4cf097640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4c8102800 0x7fa4c819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.577+0000 7fa4cf097640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4c8108140 0x7fa4c81a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.577+0000 7fa4cf097640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4c8108a90 0x7fa4c819ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.577+0000 7fa4cf097640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c8111510 con 0x7fa4c8108140 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.577+0000 7fa4cce33640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4c8102800 0x7fa4c819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.577+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4c8108140 0x7fa4c81a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.577+0000 7fa4cd634640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4c8108a90 0x7fa4c819ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.577+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4c8108140 0x7fa4c81a01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56866/0 (socket says 172.21.15.53:56866) 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.577+0000 7fa4bffff640 1 -- 172.21.15.53:0/2645077190 learned_addr learned my addr 172.21.15.53:0/2645077190 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.577+0000 7fa4cd634640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4c8108a90 0x7fa4c819ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36796/0 (socket says 172.21.15.53:36796) 2024-08-31T06:24:05.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.578+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c806bb30 con 0x7fa4c8108a90 2024-08-31T06:24:05.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.578+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c8111690 con 0x7fa4c8102800 2024-08-31T06:24:05.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.578+0000 7fa4cd634640 1 -- 172.21.15.53:0/2645077190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4c8102800 msgr2=0x7fa4c819fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:05.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.578+0000 7fa4cd634640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4c8102800 0x7fa4c819fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:05.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.578+0000 7fa4cd634640 1 -- 172.21.15.53:0/2645077190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4c8108140 msgr2=0x7fa4c81a01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:05.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.578+0000 7fa4cd634640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4c8108140 0x7fa4c81a01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:05.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.578+0000 7fa4cd634640 1 -- 172.21.15.53:0/2645077190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c819f150 con 0x7fa4c8108a90 2024-08-31T06:24:05.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.578+0000 7fa4bffff640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4c8108140 0x7fa4c81a01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:05.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.579+0000 7fa4cd634640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4c8108a90 0x7fa4c819ea20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009fd0 tx=0x7fa4c000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:05.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.579+0000 7fa4bdffb640 1 -- 172.21.15.53:0/2645077190 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000ce20 con 0x7fa4c8108a90 2024-08-31T06:24:05.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.579+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c819f440 con 0x7fa4c8108a90 2024-08-31T06:24:05.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.579+0000 7fa4bdffb640 1 -- 172.21.15.53:0/2645077190 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4c0005020 con 0x7fa4c8108a90 2024-08-31T06:24:05.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.579+0000 7fa4bdffb640 1 -- 172.21.15.53:0/2645077190 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0010690 con 0x7fa4c8108a90 2024-08-31T06:24:05.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.579+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c81a8de0 con 0x7fa4c8108a90 2024-08-31T06:24:05.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.580+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c8102c10 con 0x7fa4c8108a90 2024-08-31T06:24:05.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.583+0000 7fa4bdffb640 1 -- 172.21.15.53:0/2645077190 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa4c0004a40 con 0x7fa4c8108a90 2024-08-31T06:24:05.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.583+0000 7fa4bdffb640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4b00b4d20 0x7fa4b00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:05.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.584+0000 7fa4cce33640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4b00b4d20 0x7fa4b00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:05.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.584+0000 7fa4bdffb640 1 -- 172.21.15.53:0/2645077190 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8557+0+0 (secure 0 0 0) 0x7fa4c00e5bb0 con 0x7fa4c8108a90 2024-08-31T06:24:05.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.585+0000 7fa4cce33640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4b00b4d20 0x7fa4b00b7230 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4006010 tx=0x7fa4c4005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:05.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.587+0000 7fa4bdffb640 1 -- 172.21.15.53:0/2645077190 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa4c00aca10 con 0x7fa4c8108a90 2024-08-31T06:24:05.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.963+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4c810f500 con 0x7fa4c8108a90 2024-08-31T06:24:05.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.964+0000 7fa4bdffb640 1 -- 172.21.15.53:0/2645077190 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+11988 (secure 0 0 0) 0x7fa4c00ac310 con 0x7fa4c8108a90 2024-08-31T06:24:05.967 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:24:05.967 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":66,"btime":"2024-08-31T06:22:34:298615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":66,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:22:33.810373+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:24:05.967 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 66 2024-08-31T06:24:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.967+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4b00b4d20 msgr2=0x7fa4b00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.967+0000 7fa4cf097640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4b00b4d20 0x7fa4b00b7230 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4006010 tx=0x7fa4c4005a20 comp rx=0 tx=0).stop 2024-08-31T06:24:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.967+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4c8108a90 msgr2=0x7fa4c819ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.967+0000 7fa4cf097640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4c8108a90 0x7fa4c819ea20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009fd0 tx=0x7fa4c000ef10 comp rx=0 tx=0).stop 2024-08-31T06:24:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.968+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 shutdown_connections 2024-08-31T06:24:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.968+0000 7fa4cf097640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4b00b4d20 0x7fa4b00b7230 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.968+0000 7fa4cf097640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4c8108a90 0x7fa4c819ea20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.968+0000 7fa4cf097640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4c8108140 0x7fa4c81a01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.968+0000 7fa4cf097640 1 --2- 172.21.15.53:0/2645077190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4c8102800 0x7fa4c819fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.968+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 >> 172.21.15.53:0/2645077190 conn(0x7fa4c80794d0 msgr2=0x7fa4c8100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.968+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 shutdown_connections 2024-08-31T06:24:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:05.968+0000 7fa4cf097640 1 -- 172.21.15.53:0/2645077190 wait complete. 2024-08-31T06:24:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:05 smithi130 ceph-mon[22266]: pgmap v923: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 367 op/s 2024-08-31T06:24:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:05 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:24:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:05 smithi153 ceph-mon[22320]: pgmap v923: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 367 op/s 2024-08-31T06:24:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:05 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:24:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:05 smithi053 ceph-mon[18924]: pgmap v923: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 367 op/s 2024-08-31T06:24:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:05 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:24:06.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39698 5.85 MB/sec execute 234 sec latency 82.406 ms 2024-08-31T06:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.588+0000 7f3b90939640 1 -- 172.21.15.53:0/2824729246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b8c101f20 msgr2=0x7f3b8c102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.588+0000 7f3b90939640 1 --2- 172.21.15.53:0/2824729246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b8c101f20 0x7f3b8c102330 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009900 tx=0x7f3b7c02a410 comp rx=0 tx=0).stop 2024-08-31T06:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.588+0000 7f3b90939640 1 -- 172.21.15.53:0/2824729246 shutdown_connections 2024-08-31T06:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.588+0000 7f3b90939640 1 --2- 172.21.15.53:0/2824729246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b8c1081a0 0x7f3b8c10e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.588+0000 7f3b90939640 1 --2- 172.21.15.53:0/2824729246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b8c107850 0x7f3b8c107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.588+0000 7f3b90939640 1 --2- 172.21.15.53:0/2824729246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b8c101f20 0x7f3b8c102330 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.588+0000 7f3b90939640 1 -- 172.21.15.53:0/2824729246 >> 172.21.15.53:0/2824729246 conn(0x7f3b8c079c30 msgr2=0x7f3b8c07a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.588+0000 7f3b90939640 1 -- 172.21.15.53:0/2824729246 shutdown_connections 2024-08-31T06:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.588+0000 7f3b90939640 1 -- 172.21.15.53:0/2824729246 wait complete. 2024-08-31T06:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.589+0000 7f3b90939640 1 Processor -- start 2024-08-31T06:24:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.589+0000 7f3b90939640 1 -- start start 2024-08-31T06:24:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.590+0000 7f3b90939640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b8c101f20 0x7f3b8c19c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.590+0000 7f3b90939640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b8c107850 0x7f3b8c19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.590+0000 7f3b90939640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b8c1081a0 0x7f3b8c1a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.590+0000 7f3b90939640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c111490 con 0x7f3b8c107850 2024-08-31T06:24:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.590+0000 7f3b90939640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c111310 con 0x7f3b8c101f20 2024-08-31T06:24:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.590+0000 7f3b90939640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c111610 con 0x7f3b8c1081a0 2024-08-31T06:24:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.590+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b8c101f20 0x7f3b8c19c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.590+0000 7f3b89d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b8c107850 0x7f3b8c19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.590+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b8c101f20 0x7f3b8c19c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36820/0 (socket says 172.21.15.53:36820) 2024-08-31T06:24:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.590+0000 7f3b8a59c640 1 -- 172.21.15.53:0/4279335121 learned_addr learned my addr 172.21.15.53:0/4279335121 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.590+0000 7f3b8ad9d640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b8c1081a0 0x7f3b8c1a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.591+0000 7f3b89d9b640 1 -- 172.21.15.53:0/4279335121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b8c1081a0 msgr2=0x7f3b8c1a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.591+0000 7f3b89d9b640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b8c1081a0 0x7f3b8c1a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.591+0000 7f3b89d9b640 1 -- 172.21.15.53:0/4279335121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b8c101f20 msgr2=0x7f3b8c19c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.591+0000 7f3b89d9b640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b8c101f20 0x7f3b8c19c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.591+0000 7f3b89d9b640 1 -- 172.21.15.53:0/4279335121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c1a22c0 con 0x7f3b8c107850 2024-08-31T06:24:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.591+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b8c101f20 0x7f3b8c19c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.591+0000 7f3b89d9b640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b8c107850 0x7f3b8c19c930 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0756d0 tx=0x7f3b8000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.591+0000 7f3b7b7fe640 1 -- 172.21.15.53:0/4279335121 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80017440 con 0x7f3b8c107850 2024-08-31T06:24:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.591+0000 7f3b7b7fe640 1 -- 172.21.15.53:0/4279335121 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b80016870 con 0x7f3b8c107850 2024-08-31T06:24:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.591+0000 7f3b7b7fe640 1 -- 172.21.15.53:0/4279335121 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80015750 con 0x7f3b8c107850 2024-08-31T06:24:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.592+0000 7f3b90939640 1 -- 172.21.15.53:0/4279335121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c1a25b0 con 0x7f3b8c107850 2024-08-31T06:24:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.592+0000 7f3b90939640 1 -- 172.21.15.53:0/4279335121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c1a8d40 con 0x7f3b8c107850 2024-08-31T06:24:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.595+0000 7f3b978a6740 1 Processor -- start 2024-08-31T06:24:06.598 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.595+0000 7f3b978a6740 1 -- start start 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5421b0 0x55b11c8e5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8e6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5214d0 0x55b11c8e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b978a6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b11c85b000 con 0x55b11c5421b0 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b978a6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b11c84a590 con 0x55b11c5192f0 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b978a6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b11c84e540 con 0x55b11c5214d0 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b8ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5421b0 0x55b11c8e5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8e6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36836/0 (socket says 172.21.15.53:36836) 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b8a59c640 1 -- 172.21.15.53:0/1338494590 learned_addr learned my addr 172.21.15.53:0/1338494590 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b7b7fe640 1 -- 172.21.15.53:0/4279335121 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3b800163e0 con 0x7f3b8c107850 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b89d9b640 1 --2- 172.21.15.53:0/1338494590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5214d0 0x55b11c8e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b8a59c640 1 -- 172.21.15.53:0/1338494590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5214d0 msgr2=0x55b11c8e6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/1338494590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5214d0 0x55b11c8e6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.596+0000 7f3b8a59c640 1 -- 172.21.15.53:0/1338494590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5421b0 msgr2=0x55b11c8e5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:06.601 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.597+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/1338494590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5421b0 0x55b11c8e5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.597+0000 7f3b8a59c640 1 -- 172.21.15.53:0/1338494590 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b11c5ad790 con 0x55b11c5192f0 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.597+0000 7f3b89d9b640 1 --2- 172.21.15.53:0/1338494590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5214d0 0x55b11c8e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.597+0000 7f3b8ad9d640 1 --2- 172.21.15.53:0/1338494590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5421b0 0x55b11c8e5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.597+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/1338494590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8e6220 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009a20 tx=0x7f3b7c032ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=612bbcb87838611a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.597+0000 7f3b78ff9640 1 -- 172.21.15.53:0/1338494590 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c035070 con 0x55b11c5192f0 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.597+0000 7f3b78ff9640 1 -- 172.21.15.53:0/1338494590 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b7c0044c0 con 0x55b11c5192f0 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.597+0000 7f3b7b7fe640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b740b4d20 0x7f3b740b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.598+0000 7f3b78ff9640 1 -- 172.21.15.53:0/1338494590 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c003de0 con 0x55b11c5192f0 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.598+0000 7f3b7b7fe640 1 -- 172.21.15.53:0/4279335121 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8601+0+0 (secure 0 0 0) 0x7f3b800e5ae0 con 0x7f3b8c107850 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.598+0000 7f3b8ad9d640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b740b4d20 0x7f3b740b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.598+0000 7f3b978a6740 1 -- 172.21.15.53:0/1338494590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 msgr2=0x55b11c8e6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.598+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1338494590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8e6220 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009a20 tx=0x7f3b7c032ec0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.599+0000 7f3b978a6740 1 -- 172.21.15.53:0/1338494590 shutdown_connections 2024-08-31T06:24:06.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.599+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1338494590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5214d0 0x55b11c8e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.599+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1338494590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8e6220 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.599+0000 7f3b8ad9d640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b740b4d20 0x7f3b740b7230 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009fd0 tx=0x7f3b84009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:06.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.599+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1338494590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5421b0 0x55b11c8e5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.599+0000 7f3b978a6740 1 -- 172.21.15.53:0/1338494590 >> 172.21.15.53:0/1338494590 conn(0x55b11c536300 msgr2=0x55b11c8e3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:06.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.599+0000 7f3b978a6740 1 -- 172.21.15.53:0/1338494590 shutdown_connections 2024-08-31T06:24:06.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.599+0000 7f3b978a6740 1 -- 172.21.15.53:0/1338494590 wait complete. 2024-08-31T06:24:06.603 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.600+0000 7f3b978a6740 1 -- start start 2024-08-31T06:24:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.600+0000 7f3b978a6740 1 Processor -- start 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.600+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8f1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.600+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 0x55b11c8f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.600+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5421b0 0x55b11c8fd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.600+0000 7f3b978a6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b11c783ab0 con 0x55b11c5214d0 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.600+0000 7f3b978a6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b11c7d1680 con 0x55b11c5192f0 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.600+0000 7f3b978a6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b11c8f44a0 con 0x55b11c5421b0 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b978a6740 10 client.0 _ll_register_callbacks cb 0x55b11c559a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b8ad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5421b0 0x55b11c8fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b8ad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5421b0 0x55b11c8fd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46260/0 (socket says 172.21.15.53:46260) 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b8ad9d640 1 -- 172.21.15.53:0/1015044368 learned_addr learned my addr 172.21.15.53:0/1015044368 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b89d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 0x55b11c8f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b8a59c640 1 -- 172.21.15.53:0/1015044368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5421b0 msgr2=0x55b11c8fd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5421b0 0x55b11c8fd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b8a59c640 1 -- 172.21.15.53:0/1015044368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 msgr2=0x55b11c8f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 0x55b11c8f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b8a59c640 1 -- 172.21.15.53:0/1015044368 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b11c626620 con 0x55b11c5192f0 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b89d9b640 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 0x55b11c8f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8f1920 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c000c00 tx=0x7f3b7c0035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ed3922accf5fb5b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.601+0000 7f3b71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.602+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1015044368 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c035070 con 0x55b11c5192f0 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.602+0000 7f3b978a6740 1 -- 172.21.15.53:0/1015044368 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b11c85cf50 con 0x55b11c5192f0 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.602+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1015044368 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8601+0+0 (secure 0 0 0) 0x7f3b7c031710 con 0x55b11c5192f0 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.602+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1015044368 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f3b7c054050 con 0x55b11c5192f0 2024-08-31T06:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.602+0000 7f3b978a6740 10 client.30239 fetch_fsmap learned FSMap version 66 2024-08-31T06:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.602+0000 7f3b978a6740 1 -- 172.21.15.53:0/1015044368 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55b11c9004a0 con 0x55b11c5192f0 2024-08-31T06:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.602+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1015044368 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b7c003f70 con 0x55b11c5192f0 2024-08-31T06:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.602+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1015044368 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f3b7c0457a0 con 0x55b11c5192f0 2024-08-31T06:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.603+0000 7f3b978a6740 10 client.30239 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.603+0000 7f3b978a6740 10 client.30239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.603+0000 7f3b978a6740 20 client.30239 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.603+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b11c500d80 0x55b11c9039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.603+0000 7f3b978a6740 4 client.30239 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.603+0000 7f3b978a6740 1 -- 172.21.15.53:0/1015044368 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b11c85cf50 con 0x55b11c500d80 2024-08-31T06:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.603+0000 7f3b89d9b640 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b11c500d80 0x55b11c9039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.603+0000 7f3b71ffb640 10 client.30239 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.603+0000 7f3b89d9b640 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b11c500d80 0x55b11c9039e0 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29e9a857aeb01e15 server_cookie=b70e6e3a4c96955f in_seq=0 out_seq=0 2024-08-31T06:24:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.604+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1015044368 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b11c85cf50 con 0x55b11c500d80 2024-08-31T06:24:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.604+0000 7f3b71ffb640 10 client.30239 handle_command_reply: tid=0 2024-08-31T06:24:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.604+0000 7f3b978a6740 1 client.30239 shutdown 2024-08-31T06:24:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.604+0000 7f3b978a6740 1 -- 172.21.15.53:0/1015044368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 msgr2=0x55b11c8f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.604+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8f1920 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c000c00 tx=0x7f3b7c0035f0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.604+0000 7f3b978a6740 1 -- 172.21.15.53:0/1015044368 shutdown_connections 2024-08-31T06:24:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.604+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b11c500d80 0x55b11c9039e0 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.604+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5421b0 0x55b11c8fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.605+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 0x55b11c8f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.605+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1015044368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8f1920 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.605+0000 7f3b978a6740 1 -- 172.21.15.53:0/1015044368 >> 172.21.15.53:0/1015044368 conn(0x55b11c536300 msgr2=0x55b11c8e6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.605+0000 7f3b71ffb640 0 client.30239 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.605+0000 7f3b978a6740 1 -- 172.21.15.53:0/1015044368 shutdown_connections 2024-08-31T06:24:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.605+0000 7f3b978a6740 1 -- 172.21.15.53:0/1015044368 wait complete. 2024-08-31T06:24:06.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.605+0000 7f3b978a6740 20 client.30239 trim_cache size 0 max 16384 2024-08-31T06:24:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.631+0000 7f3b978a6740 1 Processor -- start 2024-08-31T06:24:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.632+0000 7f3b978a6740 1 -- start start 2024-08-31T06:24:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.632+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8eb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.632+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5214d0 0x55b11c8fd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.632+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5421b0 0x55b11c8fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.632+0000 7f3b978a6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1b17c0 con 0x55b11c5421b0 2024-08-31T06:24:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.632+0000 7f3b978a6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1b3360 con 0x55b11c5192f0 2024-08-31T06:24:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.632+0000 7f3b978a6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1b1ef0 con 0x55b11c5214d0 2024-08-31T06:24:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.632+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8eb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.632+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8eb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36852/0 (socket says 172.21.15.53:36852) 2024-08-31T06:24:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.632+0000 7f3b8a59c640 1 -- 172.21.15.53:0/410731894 learned_addr learned my addr 172.21.15.53:0/410731894 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.632+0000 7f3b8ad9d640 1 --2- 172.21.15.53:0/410731894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5421b0 0x55b11c8fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.633+0000 7f3b8a59c640 1 -- 172.21.15.53:0/410731894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5214d0 msgr2=0x55b11c8fd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.633+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/410731894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5214d0 0x55b11c8fd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.633+0000 7f3b8a59c640 1 -- 172.21.15.53:0/410731894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5421b0 msgr2=0x55b11c8fdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.633+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/410731894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5421b0 0x55b11c8fdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.633+0000 7f3b8a59c640 1 -- 172.21.15.53:0/410731894 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b11c8e8210 con 0x55b11c5192f0 2024-08-31T06:24:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.633+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/410731894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8eb520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009800 tx=0x7f3b7c005d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f1a29daa0fcf4ed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.633+0000 7f3b73fff640 1 -- 172.21.15.53:0/410731894 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c035070 con 0x55b11c5192f0 2024-08-31T06:24:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.634+0000 7f3b73fff640 1 -- 172.21.15.53:0/410731894 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b7c045900 con 0x55b11c5192f0 2024-08-31T06:24:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.634+0000 7f3b73fff640 1 -- 172.21.15.53:0/410731894 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0053f0 con 0x55b11c5192f0 2024-08-31T06:24:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.636+0000 7f3b978a6740 1 -- 172.21.15.53:0/410731894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 msgr2=0x55b11c8eb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.636+0000 7f3b978a6740 1 --2- 172.21.15.53:0/410731894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8eb520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009800 tx=0x7f3b7c005d70 comp rx=0 tx=0).stop 2024-08-31T06:24:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.636+0000 7f3b978a6740 1 -- 172.21.15.53:0/410731894 shutdown_connections 2024-08-31T06:24:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.636+0000 7f3b978a6740 1 --2- 172.21.15.53:0/410731894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5421b0 0x55b11c8fdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.636+0000 7f3b978a6740 1 --2- 172.21.15.53:0/410731894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5214d0 0x55b11c8fd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.636+0000 7f3b978a6740 1 --2- 172.21.15.53:0/410731894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5192f0 0x55b11c8eb520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.636+0000 7f3b978a6740 1 -- 172.21.15.53:0/410731894 >> 172.21.15.53:0/410731894 conn(0x55b11c536300 msgr2=0x55b11c8eae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.636+0000 7f3b978a6740 1 -- 172.21.15.53:0/410731894 shutdown_connections 2024-08-31T06:24:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.636+0000 7f3b978a6740 1 -- 172.21.15.53:0/410731894 wait complete. 2024-08-31T06:24:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.638+0000 7f3b978a6740 1 -- start start 2024-08-31T06:24:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.638+0000 7f3b978a6740 1 Processor -- start 2024-08-31T06:24:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.638+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5192f0 0x55b11c8f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.638+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 0x55b11c8f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.638+0000 7f3b978a6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5421b0 0x55b11c8f5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.638+0000 7f3b978a6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1b2c90 con 0x55b11c5214d0 2024-08-31T06:24:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.638+0000 7f3b978a6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1b25c0 con 0x55b11c5421b0 2024-08-31T06:24:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.638+0000 7f3b978a6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1af7c0 con 0x55b11c5192f0 2024-08-31T06:24:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.638+0000 7f3b978a6740 10 client.0 _ll_register_callbacks cb 0x7f3b84009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5192f0 0x55b11c8f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b89d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 0x55b11c8f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5192f0 0x55b11c8f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46288/0 (socket says 172.21.15.53:46288) 2024-08-31T06:24:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b8a59c640 1 -- 172.21.15.53:0/1267950780 learned_addr learned my addr 172.21.15.53:0/1267950780 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b8ad9d640 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5421b0 0x55b11c8f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b8a59c640 1 -- 172.21.15.53:0/1267950780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5421b0 msgr2=0x55b11c8f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5421b0 0x55b11c8f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b8a59c640 1 -- 172.21.15.53:0/1267950780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 msgr2=0x55b11c8f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 0x55b11c8f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b8a59c640 1 -- 172.21.15.53:0/1267950780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b11c96c3a0 con 0x55b11c5192f0 2024-08-31T06:24:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b89d9b640 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 0x55b11c8f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.639+0000 7f3b8a59c640 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5192f0 0x55b11c8f46b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c02a450 tx=0x7f3b7c009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39dad61fb4d503e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.640+0000 7f3b71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:24:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.640+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1267950780 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c035040 con 0x55b11c5192f0 2024-08-31T06:24:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.640+0000 7f3b978a6740 1 -- 172.21.15.53:0/1267950780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b7c045900 con 0x55b11c5192f0 2024-08-31T06:24:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.640+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1267950780 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8601+0+0 (secure 0 0 0) 0x7f3b7c05e070 con 0x55b11c5192f0 2024-08-31T06:24:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.640+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1267950780 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f3b7c045680 con 0x55b11c5192f0 2024-08-31T06:24:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.640+0000 7f3b978a6740 10 client.30244 fetch_fsmap learned FSMap version 66 2024-08-31T06:24:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.640+0000 7f3b978a6740 1 -- 172.21.15.53:0/1267950780 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55b11c96d5d0 con 0x55b11c5192f0 2024-08-31T06:24:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.640+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1267950780 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b7c045900 con 0x55b11c5192f0 2024-08-31T06:24:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.641+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1267950780 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f3b7c004b40 con 0x55b11c5192f0 2024-08-31T06:24:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.641+0000 7f3b978a6740 10 client.30244 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:24:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.641+0000 7f3b978a6740 10 client.30244 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.641+0000 7f3b978a6740 20 client.30244 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.641+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b11c4d61c0 0x55b11c96fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.641+0000 7f3b978a6740 4 client.30244 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:24:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.641+0000 7f3b978a6740 1 -- 172.21.15.53:0/1267950780 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b11c8589f0 con 0x55b11c4d61c0 2024-08-31T06:24:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.641+0000 7f3b89d9b640 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b11c4d61c0 0x55b11c96fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.641+0000 7f3b71ffb640 10 client.30244 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.641+0000 7f3b89d9b640 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b11c4d61c0 0x55b11c96fca0 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1273d89a9d7d8bd server_cookie=264c717cb02c2e12 in_seq=0 out_seq=0 2024-08-31T06:24:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b71ffb640 1 -- 172.21.15.53:0/1267950780 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b11c8589f0 con 0x55b11c4d61c0 2024-08-31T06:24:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b71ffb640 10 client.30244 handle_command_reply: tid=0 2024-08-31T06:24:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 1 client.30244 shutdown 2024-08-31T06:24:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 1 -- 172.21.15.53:0/1267950780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5192f0 msgr2=0x55b11c8f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5192f0 0x55b11c8f46b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c02a450 tx=0x7f3b7c009610 comp rx=0 tx=0).stop 2024-08-31T06:24:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 1 -- 172.21.15.53:0/1267950780 shutdown_connections 2024-08-31T06:24:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b11c4d61c0 0x55b11c96fca0 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b11c5421b0 0x55b11c8f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b11c5214d0 0x55b11c8f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 1 --2- 172.21.15.53:0/1267950780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b11c5192f0 0x55b11c8f46b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 1 -- 172.21.15.53:0/1267950780 >> 172.21.15.53:0/1267950780 conn(0x55b11c536300 msgr2=0x55b11c8efb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b71ffb640 0 client.30244 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 1 -- 172.21.15.53:0/1267950780 shutdown_connections 2024-08-31T06:24:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 1 -- 172.21.15.53:0/1267950780 wait complete. 2024-08-31T06:24:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.761+0000 7f3b978a6740 20 client.30244 trim_cache size 0 max 16384 2024-08-31T06:24:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:24:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:24:06.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:24:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:24:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 -- 172.21.15.53:0/4279335121 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b740b4d20 msgr2=0x7f3b740b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b740b4d20 0x7f3b740b7230 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009fd0 tx=0x7f3b84009500 comp rx=0 tx=0).stop 2024-08-31T06:24:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 -- 172.21.15.53:0/4279335121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b8c107850 msgr2=0x7f3b8c19c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b8c107850 0x7f3b8c19c930 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0756d0 tx=0x7f3b8000eef0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 -- 172.21.15.53:0/4279335121 shutdown_connections 2024-08-31T06:24:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3b740b4d20 0x7f3b740b7230 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b8c1081a0 0x7f3b8c1a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b8c107850 0x7f3b8c19c930 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 --2- 172.21.15.53:0/4279335121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b8c101f20 0x7f3b8c19c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 -- 172.21.15.53:0/4279335121 >> 172.21.15.53:0/4279335121 conn(0x7f3b8c079c30 msgr2=0x7f3b8c105760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 -- 172.21.15.53:0/4279335121 shutdown_connections 2024-08-31T06:24:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:06.762+0000 7f3b90939640 1 -- 172.21.15.53:0/4279335121 wait complete. 2024-08-31T06:24:06.826 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 152.8 --await-for 45.0' 2024-08-31T06:24:06.826 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 152.8 --await-for 45.0 2024-08-31T06:24:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:24:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:24:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:24:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:24:07.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:06 smithi130 ceph-mon[22266]: osdmap e101: 12 total, 12 up, 12 in 2024-08-31T06:24:07.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:06 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2645077190' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:24:07.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:24:07.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:24:07.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:24:07.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:24:07.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:06 smithi153 ceph-mon[22320]: osdmap e101: 12 total, 12 up, 12 in 2024-08-31T06:24:07.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:06 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2645077190' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:24:07.182 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:07.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:24:07.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:24:07.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:24:07.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:24:07.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:06 smithi053 ceph-mon[18924]: osdmap e101: 12 total, 12 up, 12 in 2024-08-31T06:24:07.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:06 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2645077190' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:24:07.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39829 5.86 MB/sec execute 235 sec latency 90.351 ms 2024-08-31T06:24:07.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.761+0000 7f86a9947640 1 -- 172.21.15.53:0/2598839029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86a4104660 msgr2=0x7f86a4104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:07.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.761+0000 7f86a9947640 1 --2- 172.21.15.53:0/2598839029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86a4104660 0x7f86a4104a70 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f8694009900 tx=0x7f869402a410 comp rx=0 tx=0).stop 2024-08-31T06:24:07.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.762+0000 7f86a9947640 1 -- 172.21.15.53:0/2598839029 shutdown_connections 2024-08-31T06:24:07.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.762+0000 7f86a9947640 1 --2- 172.21.15.53:0/2598839029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86a410dc10 0x7f86a41100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.762+0000 7f86a9947640 1 --2- 172.21.15.53:0/2598839029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86a4105090 0x7f86a410d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.762+0000 7f86a9947640 1 --2- 172.21.15.53:0/2598839029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86a4104660 0x7f86a4104a70 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.762+0000 7f86a9947640 1 -- 172.21.15.53:0/2598839029 >> 172.21.15.53:0/2598839029 conn(0x7f86a4079500 msgr2=0x7f86a4079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:07.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.762+0000 7f86a9947640 1 -- 172.21.15.53:0/2598839029 shutdown_connections 2024-08-31T06:24:07.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.762+0000 7f86a9947640 1 -- 172.21.15.53:0/2598839029 wait complete. 2024-08-31T06:24:07.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.763+0000 7f86a9947640 1 Processor -- start 2024-08-31T06:24:07.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.763+0000 7f86a9947640 1 -- start start 2024-08-31T06:24:07.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.763+0000 7f86a9947640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86a4104660 0x7f86a419c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.763+0000 7f86a9947640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86a4105090 0x7f86a419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.763+0000 7f86a9947640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86a410dc10 0x7f86a41a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.763+0000 7f86a9947640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f86a4113700 con 0x7f86a410dc10 2024-08-31T06:24:07.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.763+0000 7f86a9947640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f86a4113580 con 0x7f86a4105090 2024-08-31T06:24:07.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.763+0000 7f86a9947640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86a4113880 con 0x7f86a4104660 2024-08-31T06:24:07.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.764+0000 7f86a27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86a4105090 0x7f86a419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.764+0000 7f86a2ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86a4104660 0x7f86a419c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.764+0000 7f86a27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86a4105090 0x7f86a419c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:36868/0 (socket says 172.21.15.53:36868) 2024-08-31T06:24:07.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.764+0000 7f86a27fc640 1 -- 172.21.15.53:0/611000076 learned_addr learned my addr 172.21.15.53:0/611000076 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:07.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.764+0000 7f86a37fe640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86a410dc10 0x7f86a41a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.764+0000 7f86a27fc640 1 -- 172.21.15.53:0/611000076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86a4104660 msgr2=0x7f86a419c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:07.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.764+0000 7f86a27fc640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86a4104660 0x7f86a419c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.764+0000 7f86a27fc640 1 -- 172.21.15.53:0/611000076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86a410dc10 msgr2=0x7f86a41a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:07.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.765+0000 7f86a27fc640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86a410dc10 0x7f86a41a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.765+0000 7f86a27fc640 1 -- 172.21.15.53:0/611000076 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a41a2280 con 0x7f86a4105090 2024-08-31T06:24:07.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.765+0000 7f86a37fe640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86a410dc10 0x7f86a41a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:07.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.765+0000 7f86a27fc640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86a4105090 0x7f86a419c8b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f869800e9c0 tx=0x7f869800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:07.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.766+0000 7f86a8945640 1 -- 172.21.15.53:0/611000076 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869800cd80 con 0x7f86a4105090 2024-08-31T06:24:07.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.766+0000 7f86a8945640 1 -- 172.21.15.53:0/611000076 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86980054b0 con 0x7f86a4105090 2024-08-31T06:24:07.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.766+0000 7f86a9947640 1 -- 172.21.15.53:0/611000076 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a41a2570 con 0x7f86a4105090 2024-08-31T06:24:07.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.766+0000 7f86a8945640 1 -- 172.21.15.53:0/611000076 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698010430 con 0x7f86a4105090 2024-08-31T06:24:07.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.766+0000 7f86a9947640 1 -- 172.21.15.53:0/611000076 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a4105620 con 0x7f86a4105090 2024-08-31T06:24:07.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.770+0000 7f86a8945640 1 -- 172.21.15.53:0/611000076 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8698005020 con 0x7f86a4105090 2024-08-31T06:24:07.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.770+0000 7f86afebc740 1 Processor -- start 2024-08-31T06:24:07.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.770+0000 7f86afebc740 1 -- start start 2024-08-31T06:24:07.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86afebc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774923c840 0x5577495e3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86afebc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 0x5577495e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86afebc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774921bb60 0x5577495e4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86afebc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557749558330 con 0x55774921bb60 2024-08-31T06:24:07.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86afebc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5577495478c0 con 0x55774923c840 2024-08-31T06:24:07.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86afebc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55774954b870 con 0x557749213980 2024-08-31T06:24:07.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86a2ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 0x5577495e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86a2ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 0x5577495e41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46312/0 (socket says 172.21.15.53:46312) 2024-08-31T06:24:07.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86a2ffd640 1 -- 172.21.15.53:0/309913702 learned_addr learned my addr 172.21.15.53:0/309913702 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:07.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86a37fe640 1 --2- 172.21.15.53:0/309913702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774923c840 0x5577495e3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86a27fc640 1 --2- 172.21.15.53:0/309913702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774921bb60 0x5577495e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86a2ffd640 1 -- 172.21.15.53:0/309913702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774923c840 msgr2=0x5577495e3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86a2ffd640 1 --2- 172.21.15.53:0/309913702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774923c840 0x5577495e3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86a2ffd640 1 -- 172.21.15.53:0/309913702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774921bb60 msgr2=0x5577495e4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86a2ffd640 1 --2- 172.21.15.53:0/309913702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774921bb60 0x5577495e4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.771+0000 7f86a2ffd640 1 -- 172.21.15.53:0/309913702 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577494ffdf0 con 0x557749213980 2024-08-31T06:24:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.772+0000 7f86a8945640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f868c0b4e70 0x7f868c0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.772+0000 7f86a2ffd640 1 --2- 172.21.15.53:0/309913702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 0x5577495e41d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8694009900 tx=0x7f8694005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=857ad5bcf0e3d418 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.772+0000 7f86a8945640 1 -- 172.21.15.53:0/611000076 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8601+0+0 (secure 0 0 0) 0x7f86980e5a20 con 0x7f86a4105090 2024-08-31T06:24:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.772+0000 7f86a37fe640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f868c0b4e70 0x7f868c0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.772+0000 7f8689ffb640 1 -- 172.21.15.53:0/309913702 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869404c020 con 0x557749213980 2024-08-31T06:24:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.772+0000 7f8689ffb640 1 -- 172.21.15.53:0/309913702 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86940044c0 con 0x557749213980 2024-08-31T06:24:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.772+0000 7f8689ffb640 1 -- 172.21.15.53:0/309913702 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8694035050 con 0x557749213980 2024-08-31T06:24:07.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.773+0000 7f86afebc740 1 -- 172.21.15.53:0/309913702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 msgr2=0x5577495e41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:07.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.773+0000 7f86afebc740 1 --2- 172.21.15.53:0/309913702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 0x5577495e41d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8694009900 tx=0x7f8694005f10 comp rx=0 tx=0).stop 2024-08-31T06:24:07.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.773+0000 7f86a37fe640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f868c0b4e70 0x7f868c0b7380 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f869c005fd0 tx=0x7f869c009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.773+0000 7f86afebc740 1 -- 172.21.15.53:0/309913702 shutdown_connections 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.773+0000 7f86afebc740 1 --2- 172.21.15.53:0/309913702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774921bb60 0x5577495e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.773+0000 7f86afebc740 1 --2- 172.21.15.53:0/309913702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 0x5577495e41d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.773+0000 7f86afebc740 1 --2- 172.21.15.53:0/309913702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774923c840 0x5577495e3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.773+0000 7f86afebc740 1 -- 172.21.15.53:0/309913702 >> 172.21.15.53:0/309913702 conn(0x557749230990 msgr2=0x5577495e1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.774+0000 7f86afebc740 1 -- 172.21.15.53:0/309913702 shutdown_connections 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.774+0000 7f86afebc740 1 -- 172.21.15.53:0/309913702 wait complete. 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.774+0000 7f86afebc740 1 -- start start 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.774+0000 7f86afebc740 1 Processor -- start 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86afebc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557749213980 0x5577495ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86afebc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774921bb60 0x5577495ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86afebc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774923c840 0x5577495fb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86afebc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5577493aa7a0 con 0x557749213980 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86afebc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5577494ce240 con 0x55774921bb60 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86afebc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5577495f2410 con 0x55774923c840 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86afebc740 10 client.0 _ll_register_callbacks cb 0x557749254090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86a2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557749213980 0x5577495ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774923c840 0x5577495fb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86a2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557749213980 0x5577495ef3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56988/0 (socket says 172.21.15.53:56988) 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774923c840 0x5577495fb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46322/0 (socket says 172.21.15.53:46322) 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86a2ffd640 1 -- 172.21.15.53:0/2450611431 learned_addr learned my addr 172.21.15.53:0/2450611431 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86a27fc640 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774921bb60 0x5577495ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86a37fe640 1 -- 172.21.15.53:0/2450611431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774921bb60 msgr2=0x5577495ef8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86a37fe640 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774921bb60 0x5577495ef8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86a37fe640 1 -- 172.21.15.53:0/2450611431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557749213980 msgr2=0x5577495ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86a37fe640 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557749213980 0x5577495ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.775+0000 7f86a37fe640 1 -- 172.21.15.53:0/2450611431 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577495042b0 con 0x55774923c840 2024-08-31T06:24:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.776+0000 7f86a37fe640 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774923c840 0x5577495fb730 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f869c010970 tx=0x7f869c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a74fa0f11c629179 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.776+0000 7f8682ffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:24:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.776+0000 7f8682ffd640 1 -- 172.21.15.53:0/2450611431 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c003b70 con 0x55774923c840 2024-08-31T06:24:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.776+0000 7f8682ffd640 1 -- 172.21.15.53:0/2450611431 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8601+0+0 (secure 0 0 0) 0x7f869c003d10 con 0x55774923c840 2024-08-31T06:24:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.776+0000 7f86afebc740 1 -- 172.21.15.53:0/2450611431 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55774955a280 con 0x55774923c840 2024-08-31T06:24:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.777+0000 7f8682ffd640 1 -- 172.21.15.53:0/2450611431 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f869c004020 con 0x55774923c840 2024-08-31T06:24:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.777+0000 7f86afebc740 10 client.30256 fetch_fsmap learned FSMap version 66 2024-08-31T06:24:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.777+0000 7f86afebc740 1 -- 172.21.15.53:0/2450611431 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5577492b6b90 con 0x55774923c840 2024-08-31T06:24:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.777+0000 7f8682ffd640 1 -- 172.21.15.53:0/2450611431 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55774955a280 con 0x55774923c840 2024-08-31T06:24:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.777+0000 7f8682ffd640 1 -- 172.21.15.53:0/2450611431 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f869c01e960 con 0x55774923c840 2024-08-31T06:24:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.777+0000 7f86afebc740 10 client.30256 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:24:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.777+0000 7f86afebc740 10 client.30256 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:24:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.777+0000 7f86afebc740 20 client.30256 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.777+0000 7f86afebc740 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5577491fb1c0 0x5577496019d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.777+0000 7f86afebc740 4 client.30256 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.778+0000 7f86afebc740 1 -- 172.21.15.53:0/2450611431 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557749555d20 con 0x5577491fb1c0 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.778+0000 7f86a2ffd640 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5577491fb1c0 0x5577496019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.778+0000 7f86a2ffd640 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5577491fb1c0 0x5577496019d0 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfb9f007b1969e3b server_cookie=a0b34f7cb5846184 in_seq=0 out_seq=0 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.778+0000 7f8682ffd640 10 client.30256 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f8682ffd640 1 -- 172.21.15.53:0/2450611431 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557749555d20 con 0x5577491fb1c0 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f8682ffd640 10 client.30256 handle_command_reply: tid=0 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f86afebc740 1 client.30256 shutdown 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f86afebc740 1 -- 172.21.15.53:0/2450611431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774923c840 msgr2=0x5577495fb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f86afebc740 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774923c840 0x5577495fb730 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f869c010970 tx=0x7f869c004a40 comp rx=0 tx=0).stop 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f86afebc740 1 -- 172.21.15.53:0/2450611431 shutdown_connections 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f86afebc740 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5577491fb1c0 0x5577496019d0 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f86afebc740 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774923c840 0x5577495fb730 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f86afebc740 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774921bb60 0x5577495ef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f86afebc740 1 --2- 172.21.15.53:0/2450611431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557749213980 0x5577495ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f86afebc740 1 -- 172.21.15.53:0/2450611431 >> 172.21.15.53:0/2450611431 conn(0x557749230990 msgr2=0x5577495e0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.779+0000 7f8682ffd640 0 client.30256 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.780+0000 7f86afebc740 1 -- 172.21.15.53:0/2450611431 shutdown_connections 2024-08-31T06:24:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.780+0000 7f86afebc740 1 -- 172.21.15.53:0/2450611431 wait complete. 2024-08-31T06:24:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.780+0000 7f86afebc740 20 client.30256 trim_cache size 0 max 16384 2024-08-31T06:24:07.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86afebc740 1 Processor -- start 2024-08-31T06:24:07.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86afebc740 1 -- start start 2024-08-31T06:24:07.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86afebc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 0x5577495ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86afebc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774921bb60 0x5577495f1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86afebc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x5577495e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86afebc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41ad3e0 con 0x55774923c840 2024-08-31T06:24:07.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86afebc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41aef80 con 0x55774921bb60 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86afebc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41adb10 con 0x557749213980 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x5577495e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86a27fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774921bb60 0x5577495f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x5577495e53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57000/0 (socket says 172.21.15.53:57000) 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86a37fe640 1 -- 172.21.15.53:0/1253975613 learned_addr learned my addr 172.21.15.53:0/1253975613 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.805+0000 7f86a2ffd640 1 --2- 172.21.15.53:0/1253975613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 0x5577495ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.806+0000 7f86a37fe640 1 -- 172.21.15.53:0/1253975613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 msgr2=0x5577495ef7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.806+0000 7f86a37fe640 1 --2- 172.21.15.53:0/1253975613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 0x5577495ef7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.806+0000 7f86a37fe640 1 -- 172.21.15.53:0/1253975613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774921bb60 msgr2=0x5577495f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.806+0000 7f86a37fe640 1 --2- 172.21.15.53:0/1253975613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774921bb60 0x5577495f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.806+0000 7f86a37fe640 1 -- 172.21.15.53:0/1253975613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557749517d90 con 0x55774923c840 2024-08-31T06:24:07.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.806+0000 7f86a27fc640 1 --2- 172.21.15.53:0/1253975613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774921bb60 0x5577495f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:07.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.806+0000 7f86a37fe640 1 --2- 172.21.15.53:0/1253975613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x5577495e53d0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f869c01ed50 tx=0x7f869c010550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86831c0bf942d6b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:07.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.806+0000 7f86897fa640 1 -- 172.21.15.53:0/1253975613 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c03f070 con 0x55774923c840 2024-08-31T06:24:07.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.807+0000 7f86897fa640 1 -- 172.21.15.53:0/1253975613 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f869c01e4d0 con 0x55774923c840 2024-08-31T06:24:07.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.807+0000 7f86897fa640 1 -- 172.21.15.53:0/1253975613 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c036070 con 0x55774923c840 2024-08-31T06:24:07.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.807+0000 7f86afebc740 1 -- 172.21.15.53:0/1253975613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 msgr2=0x5577495e53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:07.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.807+0000 7f86afebc740 1 --2- 172.21.15.53:0/1253975613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x5577495e53d0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f869c01ed50 tx=0x7f869c010550 comp rx=0 tx=0).stop 2024-08-31T06:24:07.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.808+0000 7f86afebc740 1 -- 172.21.15.53:0/1253975613 shutdown_connections 2024-08-31T06:24:07.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.808+0000 7f86afebc740 1 --2- 172.21.15.53:0/1253975613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x5577495e53d0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.808+0000 7f86afebc740 1 --2- 172.21.15.53:0/1253975613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55774921bb60 0x5577495f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.808+0000 7f86afebc740 1 --2- 172.21.15.53:0/1253975613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557749213980 0x5577495ef7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.808+0000 7f86afebc740 1 -- 172.21.15.53:0/1253975613 >> 172.21.15.53:0/1253975613 conn(0x557749230990 msgr2=0x5577495e4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:07.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.808+0000 7f86afebc740 1 -- 172.21.15.53:0/1253975613 shutdown_connections 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.808+0000 7f86afebc740 1 -- 172.21.15.53:0/1253975613 wait complete. 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.808+0000 7f86afebc740 1 -- start start 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.808+0000 7f86afebc740 1 Processor -- start 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86afebc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557749213980 0x5577496037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86afebc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774921bb60 0x557749603d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86afebc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x55774966b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86afebc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41ae8b0 con 0x55774923c840 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86afebc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41ae1e0 con 0x557749213980 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x55774966b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86afebc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86a41ab3e0 con 0x55774921bb60 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86a2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557749213980 0x5577496037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x55774966b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57002/0 (socket says 172.21.15.53:57002) 2024-08-31T06:24:07.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86a37fe640 1 -- 172.21.15.53:0/3849512754 learned_addr learned my addr 172.21.15.53:0/3849512754 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86a27fc640 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774921bb60 0x557749603d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86afebc740 10 client.0 _ll_register_callbacks cb 0x7f869c009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86a2ffd640 1 -- 172.21.15.53:0/3849512754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774921bb60 msgr2=0x557749603d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86a2ffd640 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774921bb60 0x557749603d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86a2ffd640 1 -- 172.21.15.53:0/3849512754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 msgr2=0x55774966b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86a2ffd640 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x55774966b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.809+0000 7f86a2ffd640 1 -- 172.21.15.53:0/3849512754 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55774966b820 con 0x557749213980 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.810+0000 7f86a37fe640 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x55774966b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.810+0000 7f86a2ffd640 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557749213980 0x5577496037d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f869402a450 tx=0x7f8694009520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea67ad76cfbf8a54 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.810+0000 7f8682ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.810+0000 7f8682ffd640 1 -- 172.21.15.53:0/3849512754 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8694060020 con 0x557749213980 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.810+0000 7f86afebc740 1 -- 172.21.15.53:0/3849512754 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f869c01e4d0 con 0x557749213980 2024-08-31T06:24:07.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.810+0000 7f8682ffd640 1 -- 172.21.15.53:0/3849512754 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8601+0+0 (secure 0 0 0) 0x7f86940048c0 con 0x557749213980 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.810+0000 7f8682ffd640 1 -- 172.21.15.53:0/3849512754 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f8694068050 con 0x557749213980 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.810+0000 7f86afebc740 10 client.30263 fetch_fsmap learned FSMap version 66 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.810+0000 7f86afebc740 1 -- 172.21.15.53:0/3849512754 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55774966ca60 con 0x557749213980 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.811+0000 7f8682ffd640 1 -- 172.21.15.53:0/3849512754 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f869c01e4d0 con 0x557749213980 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.811+0000 7f8682ffd640 1 -- 172.21.15.53:0/3849512754 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f8694051040 con 0x557749213980 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.811+0000 7f86afebc740 10 client.30263 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.811+0000 7f86afebc740 10 client.30263 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.811+0000 7f86afebc740 20 client.30263 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.811+0000 7f86afebc740 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5577491d0570 0x55774966eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.811+0000 7f86afebc740 4 client.30263 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.8, "await_for": 45.0}] 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.811+0000 7f86afebc740 1 -- 172.21.15.53:0/3849512754 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.8, "await_for": 45.0}) -- 0x557749553460 con 0x5577491d0570 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.811+0000 7f86a27fc640 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5577491d0570 0x55774966eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.811+0000 7f8682ffd640 10 client.30263 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:07.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:07.812+0000 7f86a27fc640 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5577491d0570 0x55774966eee0 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64d263f64df976c5 server_cookie=b819680037931bad in_seq=0 out_seq=0 2024-08-31T06:24:07.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:07 smithi053 ceph-mon[18924]: pgmap v925: 97 pgs: 97 active+clean; 708 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 333 op/s 2024-08-31T06:24:08.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:07 smithi130 ceph-mon[22266]: pgmap v925: 97 pgs: 97 active+clean; 708 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 333 op/s 2024-08-31T06:24:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:07 smithi153 ceph-mon[22320]: pgmap v925: 97 pgs: 97 active+clean; 708 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 333 op/s 2024-08-31T06:24:08.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f8682ffd640 1 -- 172.21.15.53:0/3849512754 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557749553460 con 0x5577491d0570 2024-08-31T06:24:08.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f8682ffd640 10 client.30263 handle_command_reply: tid=0 2024-08-31T06:24:08.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 1 client.30263 shutdown 2024-08-31T06:24:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 1 -- 172.21.15.53:0/3849512754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557749213980 msgr2=0x5577496037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557749213980 0x5577496037d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f869402a450 tx=0x7f8694009520 comp rx=0 tx=0).stop 2024-08-31T06:24:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 1 -- 172.21.15.53:0/3849512754 shutdown_connections 2024-08-31T06:24:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5577491d0570 0x55774966eee0 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55774923c840 0x55774966b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f8682ffd640 0 client.30263 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55774921bb60 0x557749603d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 1 --2- 172.21.15.53:0/3849512754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557749213980 0x5577496037d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 1 -- 172.21.15.53:0/3849512754 >> 172.21.15.53:0/3849512754 conn(0x557749230990 msgr2=0x5577495e0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:08.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 1 -- 172.21.15.53:0/3849512754 shutdown_connections 2024-08-31T06:24:08.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 1 -- 172.21.15.53:0/3849512754 wait complete. 2024-08-31T06:24:08.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.190+0000 7f86afebc740 20 client.30263 trim_cache size 0 max 16384 2024-08-31T06:24:08.194 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:24:08.194 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 66, 2024-08-31T06:24:08.194 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:24:08.194 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 62, 2024-08-31T06:24:08.194 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:24:08.194 INFO:teuthology.orchestra.run.smithi053.stdout: "c6ca39cb": { 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 62, 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 152.8, 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:24:08.195 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:24:08.196 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:24:08.196 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:08.196 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:08.196 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:08.196 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:08.196 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:08.196 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 -- 172.21.15.53:0/611000076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f868c0b4e70 msgr2=0x7f868c0b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f868c0b4e70 0x7f868c0b7380 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f869c005fd0 tx=0x7f869c009500 comp rx=0 tx=0).stop 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 -- 172.21.15.53:0/611000076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86a4105090 msgr2=0x7f86a419c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86a4105090 0x7f86a419c8b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f869800e9c0 tx=0x7f869800ee80 comp rx=0 tx=0).stop 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 -- 172.21.15.53:0/611000076 shutdown_connections 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f868c0b4e70 0x7f868c0b7380 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86a410dc10 0x7f86a41a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86a4105090 0x7f86a419c8b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 --2- 172.21.15.53:0/611000076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86a4104660 0x7f86a419c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 -- 172.21.15.53:0/611000076 >> 172.21.15.53:0/611000076 conn(0x7f86a4079500 msgr2=0x7f86a4100a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 -- 172.21.15.53:0/611000076 shutdown_connections 2024-08-31T06:24:08.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:08.191+0000 7f86a9947640 1 -- 172.21.15.53:0/611000076 wait complete. 2024-08-31T06:24:08.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.87 MB/sec execute 236 sec latency 558.340 ms 2024-08-31T06:24:08.943 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c6ca39cb', quiesce took 5.9 seconds. Will release after: 26.9 2024-08-31T06:24:09.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.85 MB/sec execute 237 sec latency 1558.383 ms 2024-08-31T06:24:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:09 smithi130 ceph-mon[22266]: pgmap v926: 97 pgs: 97 active+clean; 707 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 331 op/s 2024-08-31T06:24:10.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:09 smithi153 ceph-mon[22320]: pgmap v926: 97 pgs: 97 active+clean; 707 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 331 op/s 2024-08-31T06:24:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:09 smithi053 ceph-mon[18924]: pgmap v926: 97 pgs: 97 active+clean; 707 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 331 op/s 2024-08-31T06:24:10.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.82 MB/sec execute 238 sec latency 2558.482 ms 2024-08-31T06:24:11.379 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.80 MB/sec execute 239 sec latency 3558.603 ms 2024-08-31T06:24:12.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:11 smithi130 ceph-mon[22266]: pgmap v927: 97 pgs: 97 active+clean; 698 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 350 op/s 2024-08-31T06:24:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:11 smithi153 ceph-mon[22320]: pgmap v927: 97 pgs: 97 active+clean; 698 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 350 op/s 2024-08-31T06:24:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:11 smithi053 ceph-mon[18924]: pgmap v927: 97 pgs: 97 active+clean; 698 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 350 op/s 2024-08-31T06:24:12.378 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.77 MB/sec execute 240 sec latency 4558.725 ms 2024-08-31T06:24:13.379 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.75 MB/sec execute 241 sec latency 5558.852 ms 2024-08-31T06:24:14.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:13 smithi130 ceph-mon[22266]: pgmap v928: 97 pgs: 97 active+clean; 698 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 331 op/s 2024-08-31T06:24:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:13 smithi153 ceph-mon[22320]: pgmap v928: 97 pgs: 97 active+clean; 698 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 331 op/s 2024-08-31T06:24:14.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:13 smithi053 ceph-mon[18924]: pgmap v928: 97 pgs: 97 active+clean; 698 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 331 op/s 2024-08-31T06:24:14.379 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.73 MB/sec execute 242 sec latency 6558.962 ms 2024-08-31T06:24:15.379 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.70 MB/sec execute 243 sec latency 7559.013 ms 2024-08-31T06:24:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:15 smithi130 ceph-mon[22266]: osdmap e102: 12 total, 12 up, 12 in 2024-08-31T06:24:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:15 smithi130 ceph-mon[22266]: pgmap v930: 97 pgs: 97 active+clean; 698 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 2.1 MiB/s wr, 207 op/s 2024-08-31T06:24:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:15 smithi153 ceph-mon[22320]: osdmap e102: 12 total, 12 up, 12 in 2024-08-31T06:24:15.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:15 smithi153 ceph-mon[22320]: pgmap v930: 97 pgs: 97 active+clean; 698 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 2.1 MiB/s wr, 207 op/s 2024-08-31T06:24:15.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:15 smithi053 ceph-mon[18924]: osdmap e102: 12 total, 12 up, 12 in 2024-08-31T06:24:15.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:15 smithi053 ceph-mon[18924]: pgmap v930: 97 pgs: 97 active+clean; 698 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 2.1 MiB/s wr, 207 op/s 2024-08-31T06:24:16.379 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.68 MB/sec execute 244 sec latency 8559.104 ms 2024-08-31T06:24:17.379 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.66 MB/sec execute 245 sec latency 9559.235 ms 2024-08-31T06:24:18.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:17 smithi130 ceph-mon[22266]: pgmap v931: 97 pgs: 97 active+clean; 699 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 1.8 MiB/s wr, 181 op/s 2024-08-31T06:24:18.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:17 smithi153 ceph-mon[22320]: pgmap v931: 97 pgs: 97 active+clean; 699 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 1.8 MiB/s wr, 181 op/s 2024-08-31T06:24:18.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:17 smithi053 ceph-mon[18924]: pgmap v931: 97 pgs: 97 active+clean; 699 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 1.8 MiB/s wr, 181 op/s 2024-08-31T06:24:18.379 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.63 MB/sec execute 246 sec latency 10559.331 ms 2024-08-31T06:24:19.379 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.61 MB/sec execute 247 sec latency 11559.441 ms 2024-08-31T06:24:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.875+0000 7f4d0f150640 1 -- 172.21.15.53:0/4160794280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d08101f20 msgr2=0x7f4d08102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.875+0000 7f4d0f150640 1 --2- 172.21.15.53:0/4160794280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d08101f20 0x7f4d08102330 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009900 tx=0x7f4cfc02a410 comp rx=0 tx=0).stop 2024-08-31T06:24:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.875+0000 7f4d0f150640 1 -- 172.21.15.53:0/4160794280 shutdown_connections 2024-08-31T06:24:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.875+0000 7f4d0f150640 1 --2- 172.21.15.53:0/4160794280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d081081a0 0x7f4d0810e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.875+0000 7f4d0f150640 1 --2- 172.21.15.53:0/4160794280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d08107850 0x7f4d08107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.875+0000 7f4d0f150640 1 --2- 172.21.15.53:0/4160794280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d08101f20 0x7f4d08102330 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.875+0000 7f4d0f150640 1 -- 172.21.15.53:0/4160794280 >> 172.21.15.53:0/4160794280 conn(0x7f4d08077870 msgr2=0x7f4d08077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.875+0000 7f4d0f150640 1 -- 172.21.15.53:0/4160794280 shutdown_connections 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.875+0000 7f4d0f150640 1 -- 172.21.15.53:0/4160794280 wait complete. 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.875+0000 7f4d0f150640 1 Processor -- start 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0f150640 1 -- start start 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0f150640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d08101f20 0x7f4d08199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0f150640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d08107850 0x7f4d081995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0f150640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d081081a0 0x7f4d0819e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0f150640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4d08111d10 con 0x7f4d081081a0 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0f150640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4d08111b90 con 0x7f4d08107850 2024-08-31T06:24:19.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0f150640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4d08111e90 con 0x7f4d08101f20 2024-08-31T06:24:19.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0d6ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d081081a0 0x7f4d0819e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0d6ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d081081a0 0x7f4d0819e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40992/0 (socket says 172.21.15.53:40992) 2024-08-31T06:24:19.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0d6ed640 1 -- 172.21.15.53:0/1294393297 learned_addr learned my addr 172.21.15.53:0/1294393297 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:19.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0ceec640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d08101f20 0x7f4d08199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d07fff640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d08107850 0x7f4d081995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0d6ed640 1 -- 172.21.15.53:0/1294393297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d08101f20 msgr2=0x7f4d08199000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:19.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0d6ed640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d08101f20 0x7f4d08199000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0d6ed640 1 -- 172.21.15.53:0/1294393297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d08107850 msgr2=0x7f4d081995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:19.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0d6ed640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d08107850 0x7f4d081995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d0d6ed640 1 -- 172.21.15.53:0/1294393297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0819ef30 con 0x7f4d081081a0 2024-08-31T06:24:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.876+0000 7f4d07fff640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d08107850 0x7f4d081995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:24:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.877+0000 7f4d0d6ed640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d081081a0 0x7f4d0819e830 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000eaa0 tx=0x7f4d0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.877+0000 7f4d05ffb640 1 -- 172.21.15.53:0/1294393297 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0000cdb0 con 0x7f4d081081a0 2024-08-31T06:24:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.877+0000 7f4d05ffb640 1 -- 172.21.15.53:0/1294393297 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d00005020 con 0x7f4d081081a0 2024-08-31T06:24:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.877+0000 7f4d0f150640 1 -- 172.21.15.53:0/1294393297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0819f220 con 0x7f4d081081a0 2024-08-31T06:24:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.877+0000 7f4d05ffb640 1 -- 172.21.15.53:0/1294393297 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d000116d0 con 0x7f4d081081a0 2024-08-31T06:24:19.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.877+0000 7f4d0f150640 1 -- 172.21.15.53:0/1294393297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d081a59b0 con 0x7f4d081081a0 2024-08-31T06:24:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d05ffb640 1 -- 172.21.15.53:0/1294393297 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4d000051d0 con 0x7f4d081081a0 2024-08-31T06:24:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d160bb740 1 Processor -- start 2024-08-31T06:24:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d160bb740 1 -- start start 2024-08-31T06:24:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e2d1b0 0x561ff71d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 0x561ff71d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e0c4d0 0x561ff71d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d160bb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561ff7146000 con 0x561ff6e0c4d0 2024-08-31T06:24:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d160bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561ff7135590 con 0x561ff6e2d1b0 2024-08-31T06:24:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d160bb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561ff7139540 con 0x561ff6e042f0 2024-08-31T06:24:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e0c4d0 0x561ff71d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e0c4d0 0x561ff71d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41006/0 (socket says 172.21.15.53:41006) 2024-08-31T06:24:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d07fff640 1 -- 172.21.15.53:0/2681903165 learned_addr learned my addr 172.21.15.53:0/2681903165 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.880+0000 7f4d05ffb640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4cf80b6f30 0x7f4cf80b9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.881+0000 7f4d07fff640 1 -- 172.21.15.53:0/2681903165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 msgr2=0x561ff71d1000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:24:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.881+0000 7f4d07fff640 1 --2- 172.21.15.53:0/2681903165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 0x561ff71d1000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.881+0000 7f4d07fff640 1 -- 172.21.15.53:0/2681903165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e2d1b0 msgr2=0x561ff71d0ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:24:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.881+0000 7f4d07fff640 1 --2- 172.21.15.53:0/2681903165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e2d1b0 0x561ff71d0ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.881+0000 7f4d0d6ed640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4cf80b6f30 0x7f4cf80b9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.881+0000 7f4d07fff640 1 -- 172.21.15.53:0/2681903165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ff6e98790 con 0x561ff6e0c4d0 2024-08-31T06:24:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.881+0000 7f4d05ffb640 1 -- 172.21.15.53:0/1294393297 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f4d000e5720 con 0x7f4d081081a0 2024-08-31T06:24:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.881+0000 7f4d07fff640 1 --2- 172.21.15.53:0/2681903165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e0c4d0 0x561ff71d1540 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009c40 tx=0x7f4cf40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadeff69c12c3194 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.881+0000 7f4cf2ffd640 1 -- 172.21.15.53:0/2681903165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4005020 con 0x561ff6e0c4d0 2024-08-31T06:24:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.881+0000 7f4cf2ffd640 1 -- 172.21.15.53:0/2681903165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf40047a0 con 0x561ff6e0c4d0 2024-08-31T06:24:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.881+0000 7f4cf2ffd640 1 -- 172.21.15.53:0/2681903165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40126b0 con 0x561ff6e0c4d0 2024-08-31T06:24:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.882+0000 7f4d0d6ed640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4cf80b6f30 0x7f4cf80b9440 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000cfd0 tx=0x7f4d00079290 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.882+0000 7f4d160bb740 1 -- 172.21.15.53:0/2681903165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e0c4d0 msgr2=0x561ff71d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.882+0000 7f4d160bb740 1 --2- 172.21.15.53:0/2681903165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e0c4d0 0x561ff71d1540 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009c40 tx=0x7f4cf40117b0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.882+0000 7f4d160bb740 1 -- 172.21.15.53:0/2681903165 shutdown_connections 2024-08-31T06:24:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.882+0000 7f4d160bb740 1 --2- 172.21.15.53:0/2681903165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e0c4d0 0x561ff71d1540 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.882+0000 7f4d160bb740 1 --2- 172.21.15.53:0/2681903165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 0x561ff71d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.882+0000 7f4d160bb740 1 --2- 172.21.15.53:0/2681903165 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e2d1b0 0x561ff71d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.882+0000 7f4d160bb740 1 -- 172.21.15.53:0/2681903165 >> 172.21.15.53:0/2681903165 conn(0x561ff6e21300 msgr2=0x561ff71ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.882+0000 7f4d160bb740 1 -- 172.21.15.53:0/2681903165 shutdown_connections 2024-08-31T06:24:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.882+0000 7f4d160bb740 1 -- 172.21.15.53:0/2681903165 wait complete. 2024-08-31T06:24:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.882+0000 7f4d160bb740 1 -- start start 2024-08-31T06:24:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d160bb740 1 Processor -- start 2024-08-31T06:24:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e042f0 0x561ff71dc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71dcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e2d1b0 0x561ff71e2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d160bb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561ff706eab0 con 0x561ff6e042f0 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d160bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561ff70bc680 con 0x561ff6e0c4d0 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d160bb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561ff71df240 con 0x561ff6e2d1b0 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d160bb740 10 client.0 _ll_register_callbacks cb 0x561ff6e44a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e042f0 0x561ff71dc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e042f0 0x561ff71dc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41016/0 (socket says 172.21.15.53:41016) 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d07fff640 1 -- 172.21.15.53:0/3284900805 learned_addr learned my addr 172.21.15.53:0/3284900805 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d0ceec640 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71dcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d07fff640 1 -- 172.21.15.53:0/3284900805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e2d1b0 msgr2=0x561ff71e2500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d07fff640 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e2d1b0 0x561ff71e2500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d07fff640 1 -- 172.21.15.53:0/3284900805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 msgr2=0x561ff71dcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.883+0000 7f4d07fff640 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71dcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.884+0000 7f4d07fff640 1 -- 172.21.15.53:0/3284900805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ff6f11620 con 0x561ff6e042f0 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.884+0000 7f4d0ceec640 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71dcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.884+0000 7f4d07fff640 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e042f0 0x561ff71dc790 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009f60 tx=0x7f4cf4005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62be4c666c1bf503 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.884+0000 7f4ce7fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.884+0000 7f4ce7fff640 1 -- 172.21.15.53:0/3284900805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40053d0 con 0x561ff6e042f0 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.884+0000 7f4ce7fff640 1 -- 172.21.15.53:0/3284900805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f4cf4023480 con 0x561ff6e042f0 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.884+0000 7f4d160bb740 1 -- 172.21.15.53:0/3284900805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cf40047a0 con 0x561ff6e042f0 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.884+0000 7f4ce7fff640 1 -- 172.21.15.53:0/3284900805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f4cf4031050 con 0x561ff6e042f0 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.884+0000 7f4d160bb740 10 client.21441 fetch_fsmap learned FSMap version 66 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.884+0000 7f4d160bb740 1 -- 172.21.15.53:0/3284900805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x561ff71eb380 con 0x561ff6e042f0 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.884+0000 7f4ce7fff640 1 -- 172.21.15.53:0/3284900805 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf40047a0 con 0x561ff6e042f0 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.885+0000 7f4ce7fff640 1 -- 172.21.15.53:0/3284900805 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f4cf4012680 con 0x561ff6e042f0 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.885+0000 7f4d160bb740 10 client.21441 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:24:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.885+0000 7f4d160bb740 10 client.21441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.885+0000 7f4d160bb740 20 client.21441 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.885+0000 7f4d160bb740 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ff6debd80 0x561ff71ee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.885+0000 7f4d160bb740 4 client.21441 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.885+0000 7f4d160bb740 1 -- 172.21.15.53:0/3284900805 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ff7147f50 con 0x561ff6debd80 2024-08-31T06:24:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.885+0000 7f4d0ceec640 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ff6debd80 0x561ff71ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.885+0000 7f4ce7fff640 10 client.21441 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.885+0000 7f4d0ceec640 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ff6debd80 0x561ff71ee740 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a48dcf8a22510a8 server_cookie=b5beecbc3c57ab9b in_seq=0 out_seq=0 2024-08-31T06:24:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4ce7fff640 1 -- 172.21.15.53:0/3284900805 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ff7147f50 con 0x561ff6debd80 2024-08-31T06:24:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4ce7fff640 10 client.21441 handle_command_reply: tid=0 2024-08-31T06:24:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4d160bb740 1 client.21441 shutdown 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4d160bb740 1 -- 172.21.15.53:0/3284900805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e042f0 msgr2=0x561ff71dc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4d160bb740 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e042f0 0x561ff71dc790 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009f60 tx=0x7f4cf4005020 comp rx=0 tx=0).stop 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4d160bb740 1 -- 172.21.15.53:0/3284900805 shutdown_connections 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4d160bb740 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ff6debd80 0x561ff71ee740 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4d160bb740 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e2d1b0 0x561ff71e2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4d160bb740 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71dcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4ce7fff640 0 client.21441 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4d160bb740 1 --2- 172.21.15.53:0/3284900805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e042f0 0x561ff71dc790 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.886+0000 7f4d160bb740 1 -- 172.21.15.53:0/3284900805 >> 172.21.15.53:0/3284900805 conn(0x561ff6e21300 msgr2=0x561ff71d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.887+0000 7f4d160bb740 1 -- 172.21.15.53:0/3284900805 shutdown_connections 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.887+0000 7f4d160bb740 1 -- 172.21.15.53:0/3284900805 wait complete. 2024-08-31T06:24:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.887+0000 7f4d160bb740 20 client.21441 trim_cache size 0 max 16384 2024-08-31T06:24:19.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.901+0000 7f4d160bb740 1 Processor -- start 2024-08-31T06:24:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.901+0000 7f4d160bb740 1 -- start start 2024-08-31T06:24:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 0x561ff71d5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff71d9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d160bb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4d081ad250 con 0x561ff6e2d1b0 2024-08-31T06:24:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d160bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4d081aedf0 con 0x561ff6e0c4d0 2024-08-31T06:24:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d160bb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4d081ad980 con 0x561ff6e042f0 2024-08-31T06:24:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff71d9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff71d9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41032/0 (socket says 172.21.15.53:41032) 2024-08-31T06:24:19.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d07fff640 1 -- 172.21.15.53:0/1351923367 learned_addr learned my addr 172.21.15.53:0/1351923367 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:19.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d07fff640 1 --2- 172.21.15.53:0/1351923367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 0x561ff71d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d0ceec640 1 --2- 172.21.15.53:0/1351923367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d07fff640 1 -- 172.21.15.53:0/1351923367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 msgr2=0x561ff71d5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:19.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d07fff640 1 --2- 172.21.15.53:0/1351923367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 0x561ff71d5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d07fff640 1 -- 172.21.15.53:0/1351923367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 msgr2=0x561ff71d6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:19.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d07fff640 1 --2- 172.21.15.53:0/1351923367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71d6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d07fff640 1 -- 172.21.15.53:0/1351923367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ff71d2ff0 con 0x561ff6e2d1b0 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4d07fff640 1 --2- 172.21.15.53:0/1351923367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff71d9750 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4000c00 tx=0x7f4cf40092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fce990b2a09e493 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4cf27fc640 1 -- 172.21.15.53:0/1351923367 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4039020 con 0x561ff6e2d1b0 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4cf27fc640 1 -- 172.21.15.53:0/1351923367 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf4028070 con 0x561ff6e2d1b0 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.902+0000 7f4cf27fc640 1 -- 172.21.15.53:0/1351923367 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40236e0 con 0x561ff6e2d1b0 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.903+0000 7f4d160bb740 1 -- 172.21.15.53:0/1351923367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 msgr2=0x561ff71d9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.903+0000 7f4d160bb740 1 --2- 172.21.15.53:0/1351923367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff71d9750 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4000c00 tx=0x7f4cf40092a0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.903+0000 7f4d160bb740 1 -- 172.21.15.53:0/1351923367 shutdown_connections 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.903+0000 7f4d160bb740 1 --2- 172.21.15.53:0/1351923367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff71d9750 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.903+0000 7f4d160bb740 1 --2- 172.21.15.53:0/1351923367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71d6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.903+0000 7f4d160bb740 1 --2- 172.21.15.53:0/1351923367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 0x561ff71d5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.903+0000 7f4d160bb740 1 -- 172.21.15.53:0/1351923367 >> 172.21.15.53:0/1351923367 conn(0x561ff6e21300 msgr2=0x561ff71dade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.903+0000 7f4d160bb740 1 -- 172.21.15.53:0/1351923367 shutdown_connections 2024-08-31T06:24:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.903+0000 7f4d160bb740 1 -- 172.21.15.53:0/1351923367 wait complete. 2024-08-31T06:24:19.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d160bb740 1 -- start start 2024-08-31T06:24:19.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d160bb740 1 Processor -- start 2024-08-31T06:24:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 0x561ff71e8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71e8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d160bb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff7250e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d160bb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4d081ae720 con 0x561ff6e2d1b0 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d160bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4d081ae050 con 0x561ff6e0c4d0 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d160bb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4d081ab250 con 0x561ff6e042f0 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d160bb740 10 client.0 _ll_register_callbacks cb 0x7f4cf4009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff7250e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff7250e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41036/0 (socket says 172.21.15.53:41036) 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d07fff640 1 -- 172.21.15.53:0/4280730789 learned_addr learned my addr 172.21.15.53:0/4280730789 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.904+0000 7f4d07fff640 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 0x561ff71e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4d0ceec640 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71e8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4d07fff640 1 -- 172.21.15.53:0/4280730789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 msgr2=0x561ff71e8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4d07fff640 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 0x561ff71e8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4d07fff640 1 -- 172.21.15.53:0/4280730789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 msgr2=0x561ff71e8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4d07fff640 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71e8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4d07fff640 1 -- 172.21.15.53:0/4280730789 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ff72514d0 con 0x561ff6e2d1b0 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4d07fff640 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff7250e90 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4012ad0 tx=0x7f4cf4005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4660e25d6bd89651 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4ce7fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4ce7fff640 1 -- 172.21.15.53:0/4280730789 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4039070 con 0x561ff6e2d1b0 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4ce7fff640 1 -- 172.21.15.53:0/4280730789 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f4cf4023ad0 con 0x561ff6e2d1b0 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4d160bb740 1 -- 172.21.15.53:0/4280730789 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cf4028070 con 0x561ff6e2d1b0 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4ce7fff640 1 -- 172.21.15.53:0/4280730789 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f4cf4023cd0 con 0x561ff6e2d1b0 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4d160bb740 10 client.21447 fetch_fsmap learned FSMap version 66 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4d160bb740 1 -- 172.21.15.53:0/4280730789 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x561ff7258810 con 0x561ff6e2d1b0 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.905+0000 7f4ce7fff640 1 -- 172.21.15.53:0/4280730789 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf4028070 con 0x561ff6e2d1b0 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.906+0000 7f4ce7fff640 1 -- 172.21.15.53:0/4280730789 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) ==== 8370+0+0 (secure 0 0 0) 0x7f4cf400faf0 con 0x561ff6e2d1b0 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.906+0000 7f4d160bb740 10 client.21447 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.906+0000 7f4d160bb740 10 client.21447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.906+0000 7f4d160bb740 20 client.21447 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.906+0000 7f4d160bb740 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ff6dc11c0 0x561ff725ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.906+0000 7f4d160bb740 4 client.21447 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:24:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.906+0000 7f4d160bb740 1 -- 172.21.15.53:0/4280730789 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ff71439f0 con 0x561ff6dc11c0 2024-08-31T06:24:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.906+0000 7f4d0ceec640 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ff6dc11c0 0x561ff725ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.906+0000 7f4d0ceec640 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ff6dc11c0 0x561ff725ae30 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=806aea35d4c3633b server_cookie=8cd7831c7e65d7c0 in_seq=0 out_seq=0 2024-08-31T06:24:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.906+0000 7f4ce7fff640 10 client.21447 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4ce7fff640 1 -- 172.21.15.53:0/4280730789 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ff71439f0 con 0x561ff6dc11c0 2024-08-31T06:24:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4ce7fff640 10 client.21447 handle_command_reply: tid=0 2024-08-31T06:24:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 1 client.21447 shutdown 2024-08-31T06:24:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 1 -- 172.21.15.53:0/4280730789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 msgr2=0x561ff7250e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff7250e90 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4012ad0 tx=0x7f4cf4005970 comp rx=0 tx=0).stop 2024-08-31T06:24:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 1 -- 172.21.15.53:0/4280730789 shutdown_connections 2024-08-31T06:24:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561ff6dc11c0 0x561ff725ae30 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ff6e2d1b0 0x561ff7250e90 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561ff6e0c4d0 0x561ff71e8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4ce7fff640 0 client.21447 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 1 --2- 172.21.15.53:0/4280730789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561ff6e042f0 0x561ff71e8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 1 -- 172.21.15.53:0/4280730789 >> 172.21.15.53:0/4280730789 conn(0x561ff6e21300 msgr2=0x561ff71d5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 1 -- 172.21.15.53:0/4280730789 shutdown_connections 2024-08-31T06:24:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 1 -- 172.21.15.53:0/4280730789 wait complete. 2024-08-31T06:24:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.959+0000 7f4d160bb740 20 client.21447 trim_cache size 0 max 16384 2024-08-31T06:24:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:24:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:24:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:24:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:24:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 -- 172.21.15.53:0/1294393297 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4cf80b6f30 msgr2=0x7f4cf80b9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4cf80b6f30 0x7f4cf80b9440 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000cfd0 tx=0x7f4d00079290 comp rx=0 tx=0).stop 2024-08-31T06:24:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 -- 172.21.15.53:0/1294393297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d081081a0 msgr2=0x7f4d0819e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d081081a0 0x7f4d0819e830 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000eaa0 tx=0x7f4d0000ef60 comp rx=0 tx=0).stop 2024-08-31T06:24:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 -- 172.21.15.53:0/1294393297 shutdown_connections 2024-08-31T06:24:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4cf80b6f30 0x7f4cf80b9440 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d081081a0 0x7f4d0819e830 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d08107850 0x7f4d081995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 --2- 172.21.15.53:0/1294393297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d08101f20 0x7f4d08199000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 -- 172.21.15.53:0/1294393297 >> 172.21.15.53:0/1294393297 conn(0x7f4d08077870 msgr2=0x7f4d08100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 -- 172.21.15.53:0/1294393297 shutdown_connections 2024-08-31T06:24:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:19.960+0000 7f4d0f150640 1 -- 172.21.15.53:0/1294393297 wait complete. 2024-08-31T06:24:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:19 smithi130 ceph-mon[22266]: pgmap v932: 97 pgs: 97 active+clean; 700 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.3 MiB/s wr, 139 op/s 2024-08-31T06:24:20.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:19 smithi153 ceph-mon[22320]: pgmap v932: 97 pgs: 97 active+clean; 700 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.3 MiB/s wr, 139 op/s 2024-08-31T06:24:20.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:19 smithi053 ceph-mon[18924]: pgmap v932: 97 pgs: 97 active+clean; 700 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.3 MiB/s wr, 139 op/s 2024-08-31T06:24:20.379 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.59 MB/sec execute 248 sec latency 12559.549 ms 2024-08-31T06:24:21.380 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.56 MB/sec execute 249 sec latency 13559.661 ms 2024-08-31T06:24:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:21 smithi130 ceph-mon[22266]: pgmap v933: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 360 KiB/s wr, 34 op/s 2024-08-31T06:24:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:21 smithi153 ceph-mon[22320]: pgmap v933: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 360 KiB/s wr, 34 op/s 2024-08-31T06:24:22.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:21 smithi053 ceph-mon[18924]: pgmap v933: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 360 KiB/s wr, 34 op/s 2024-08-31T06:24:22.380 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.54 MB/sec execute 250 sec latency 14559.790 ms 2024-08-31T06:24:23.380 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.52 MB/sec execute 251 sec latency 15559.854 ms 2024-08-31T06:24:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:23 smithi130 ceph-mon[22266]: pgmap v934: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 304 KiB/s wr, 27 op/s 2024-08-31T06:24:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:23 smithi153 ceph-mon[22320]: pgmap v934: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 304 KiB/s wr, 27 op/s 2024-08-31T06:24:24.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:23 smithi053 ceph-mon[18924]: pgmap v934: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 304 KiB/s wr, 27 op/s 2024-08-31T06:24:24.380 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.50 MB/sec execute 252 sec latency 16559.901 ms 2024-08-31T06:24:25.380 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.48 MB/sec execute 253 sec latency 17560.026 ms 2024-08-31T06:24:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:25 smithi130 ceph-mon[22266]: pgmap v935: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 263 KiB/s wr, 29 op/s 2024-08-31T06:24:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:25 smithi153 ceph-mon[22320]: pgmap v935: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 263 KiB/s wr, 29 op/s 2024-08-31T06:24:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:25 smithi053 ceph-mon[18924]: pgmap v935: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 263 KiB/s wr, 29 op/s 2024-08-31T06:24:26.380 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.46 MB/sec execute 254 sec latency 18560.140 ms 2024-08-31T06:24:27.380 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.43 MB/sec execute 255 sec latency 19560.271 ms 2024-08-31T06:24:28.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:27 smithi130 ceph-mon[22266]: pgmap v936: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 231 KiB/s wr, 28 op/s 2024-08-31T06:24:28.185 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:27 smithi153 ceph-mon[22320]: pgmap v936: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 231 KiB/s wr, 28 op/s 2024-08-31T06:24:28.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:27 smithi053 ceph-mon[18924]: pgmap v936: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 231 KiB/s wr, 28 op/s 2024-08-31T06:24:28.380 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.41 MB/sec execute 256 sec latency 20560.362 ms 2024-08-31T06:24:29.380 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.39 MB/sec execute 257 sec latency 21560.465 ms 2024-08-31T06:24:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:29 smithi130 ceph-mon[22266]: pgmap v937: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 168 KiB/s wr, 25 op/s 2024-08-31T06:24:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:29 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:30.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:29 smithi153 ceph-mon[22320]: pgmap v937: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 168 KiB/s wr, 25 op/s 2024-08-31T06:24:30.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:29 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:30.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:29 smithi053 ceph-mon[18924]: pgmap v937: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 168 KiB/s wr, 25 op/s 2024-08-31T06:24:30.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:29 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:30.380 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.37 MB/sec execute 258 sec latency 22560.569 ms 2024-08-31T06:24:31.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.35 MB/sec execute 259 sec latency 23560.677 ms 2024-08-31T06:24:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:31 smithi130 ceph-mon[22266]: pgmap v938: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-08-31T06:24:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:31 smithi153 ceph-mon[22320]: pgmap v938: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-08-31T06:24:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:31 smithi053 ceph-mon[18924]: pgmap v938: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-08-31T06:24:32.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.33 MB/sec execute 260 sec latency 24560.814 ms 2024-08-31T06:24:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.070+0000 7f6f3e74a640 1 -- 172.21.15.53:0/3759220228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f381080a0 msgr2=0x7f6f381084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.070+0000 7f6f3e74a640 1 --2- 172.21.15.53:0/3759220228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f381080a0 0x7f6f381084b0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009900 tx=0x7f6f2c02a440 comp rx=0 tx=0).stop 2024-08-31T06:24:33.073 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.070+0000 7f6f3e74a640 1 -- 172.21.15.53:0/3759220228 shutdown_connections 2024-08-31T06:24:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.070+0000 7f6f3e74a640 1 --2- 172.21.15.53:0/3759220228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f381089f0 0x7f6f3810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.070+0000 7f6f3e74a640 1 --2- 172.21.15.53:0/3759220228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f381080a0 0x7f6f381084b0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.070+0000 7f6f3e74a640 1 --2- 172.21.15.53:0/3759220228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f38102770 0x7f6f38102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.070+0000 7f6f3e74a640 1 -- 172.21.15.53:0/3759220228 >> 172.21.15.53:0/3759220228 conn(0x7f6f380fe190 msgr2=0x7f6f381005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.070+0000 7f6f3e74a640 1 -- 172.21.15.53:0/3759220228 shutdown_connections 2024-08-31T06:24:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.070+0000 7f6f3e74a640 1 -- 172.21.15.53:0/3759220228 wait complete. 2024-08-31T06:24:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.071+0000 7f6f3e74a640 1 Processor -- start 2024-08-31T06:24:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.071+0000 7f6f3e74a640 1 -- start start 2024-08-31T06:24:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.071+0000 7f6f3e74a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f38102770 0x7f6f3819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.071+0000 7f6f3e74a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f381080a0 0x7f6f3819a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3e74a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f381089f0 0x7f6f3819faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3e74a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6f38113740 con 0x7f6f381089f0 2024-08-31T06:24:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3e74a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6f381135c0 con 0x7f6f38102770 2024-08-31T06:24:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3e74a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6f381138c0 con 0x7f6f381080a0 2024-08-31T06:24:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3cce7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f381089f0 0x7f6f3819faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3cce7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f381089f0 0x7f6f3819faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47930/0 (socket says 172.21.15.53:47930) 2024-08-31T06:24:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3cce7640 1 -- 172.21.15.53:0/2074757508 learned_addr learned my addr 172.21.15.53:0/2074757508 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3cce7640 1 -- 172.21.15.53:0/2074757508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f381080a0 msgr2=0x7f6f3819a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3cce7640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f381080a0 0x7f6f3819a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3cce7640 1 -- 172.21.15.53:0/2074757508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f38102770 msgr2=0x7f6f3819a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f37fff640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f38102770 0x7f6f3819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3cce7640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f38102770 0x7f6f3819a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3cce7640 1 -- 172.21.15.53:0/2074757508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f381a01f0 con 0x7f6f381089f0 2024-08-31T06:24:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f37fff640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f38102770 0x7f6f3819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3cce7640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f381089f0 0x7f6f3819faf0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000b990 tx=0x7f6f3000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f357fa640 1 -- 172.21.15.53:0/2074757508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f30019070 con 0x7f6f381089f0 2024-08-31T06:24:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f357fa640 1 -- 172.21.15.53:0/2074757508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f3000cba0 con 0x7f6f381089f0 2024-08-31T06:24:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3e74a640 1 -- 172.21.15.53:0/2074757508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f381a04e0 con 0x7f6f381089f0 2024-08-31T06:24:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f357fa640 1 -- 172.21.15.53:0/2074757508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f300075d0 con 0x7f6f381089f0 2024-08-31T06:24:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.072+0000 7f6f3e74a640 1 -- 172.21.15.53:0/2074757508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f381a6c70 con 0x7f6f381089f0 2024-08-31T06:24:33.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.075+0000 7f6f456b5740 1 Processor -- start 2024-08-31T06:24:33.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.075+0000 7f6f357fa640 1 -- 172.21.15.53:0/2074757508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6f3001c070 con 0x7f6f381089f0 2024-08-31T06:24:33.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f456b5740 1 -- start start 2024-08-31T06:24:33.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33551b0 0x55f6f36f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f332c2f0 0x55f6f36f9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.086 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33344d0 0x55f6f36f9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f456b5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6f366e000 con 0x55f6f33551b0 2024-08-31T06:24:33.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f456b5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f6f365d590 con 0x55f6f33344d0 2024-08-31T06:24:33.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f456b5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f6f3661540 con 0x55f6f332c2f0 2024-08-31T06:24:33.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33551b0 0x55f6f36f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33551b0 0x55f6f36f8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47932/0 (socket says 172.21.15.53:47932) 2024-08-31T06:24:33.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f377fe640 1 -- 172.21.15.53:0/233070302 learned_addr learned my addr 172.21.15.53:0/233070302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:33.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f37fff640 1 --2- 172.21.15.53:0/233070302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f332c2f0 0x55f6f36f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f377fe640 1 --2- 172.21.15.53:0/233070302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33344d0 0x55f6f36f9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f357fa640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6f200b4ca0 0x7f6f200b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f377fe640 1 -- 172.21.15.53:0/233070302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f332c2f0 msgr2=0x55f6f36f9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:33.087 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f377fe640 1 --2- 172.21.15.53:0/233070302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f332c2f0 0x55f6f36f9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f377fe640 1 -- 172.21.15.53:0/233070302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33344d0 msgr2=0x55f6f36f9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f377fe640 1 --2- 172.21.15.53:0/233070302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33344d0 0x55f6f36f9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.076+0000 7f6f377fe640 1 -- 172.21.15.53:0/233070302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f33c0790 con 0x55f6f33551b0 2024-08-31T06:24:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.077+0000 7f6f3cce7640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6f200b4ca0 0x7f6f200b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.077+0000 7f6f377fe640 1 --2- 172.21.15.53:0/233070302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33551b0 0x55f6f36f8ce0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c02a960 tx=0x7f6f2c005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503000243df3cf41 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.077+0000 7f6f357fa640 1 -- 172.21.15.53:0/2074757508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f6f300e4c70 con 0x7f6f381089f0 2024-08-31T06:24:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.077+0000 7f6f1e7fc640 1 -- 172.21.15.53:0/233070302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c035040 con 0x55f6f33551b0 2024-08-31T06:24:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.077+0000 7f6f1e7fc640 1 -- 172.21.15.53:0/233070302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f2c031a70 con 0x55f6f33551b0 2024-08-31T06:24:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.077+0000 7f6f1e7fc640 1 -- 172.21.15.53:0/233070302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c005020 con 0x55f6f33551b0 2024-08-31T06:24:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.078+0000 7f6f456b5740 1 -- 172.21.15.53:0/233070302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33551b0 msgr2=0x55f6f36f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.078+0000 7f6f3cce7640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6f200b4ca0 0x7f6f200b71b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6f300e2450 tx=0x7f6f30077540 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.078+0000 7f6f456b5740 1 --2- 172.21.15.53:0/233070302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33551b0 0x55f6f36f8ce0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c02a960 tx=0x7f6f2c005d90 comp rx=0 tx=0).stop 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.078+0000 7f6f456b5740 1 -- 172.21.15.53:0/233070302 shutdown_connections 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.078+0000 7f6f456b5740 1 --2- 172.21.15.53:0/233070302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33344d0 0x55f6f36f9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.078+0000 7f6f456b5740 1 --2- 172.21.15.53:0/233070302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f332c2f0 0x55f6f36f9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.078+0000 7f6f456b5740 1 --2- 172.21.15.53:0/233070302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33551b0 0x55f6f36f8ce0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.078+0000 7f6f456b5740 1 -- 172.21.15.53:0/233070302 >> 172.21.15.53:0/233070302 conn(0x55f6f3349300 msgr2=0x55f6f36f6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.078+0000 7f6f456b5740 1 -- 172.21.15.53:0/233070302 shutdown_connections 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.078+0000 7f6f456b5740 1 -- 172.21.15.53:0/233070302 wait complete. 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.078+0000 7f6f456b5740 1 -- start start 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f456b5740 1 Processor -- start 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f37048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.089 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33344d0 0x55f6f3704de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33551b0 0x55f6f37106f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f456b5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6f3596ab0 con 0x55f6f332c2f0 2024-08-31T06:24:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f456b5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f6f35e4680 con 0x55f6f33551b0 2024-08-31T06:24:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f456b5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f6f3707400 con 0x55f6f33344d0 2024-08-31T06:24:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f456b5740 10 client.0 _ll_register_callbacks cb 0x55f6f336ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f37048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f37048a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47940/0 (socket says 172.21.15.53:47940) 2024-08-31T06:24:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f377fe640 1 -- 172.21.15.53:0/1747911057 learned_addr learned my addr 172.21.15.53:0/1747911057 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f37fff640 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33344d0 0x55f6f3704de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.090 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f377fe640 1 -- 172.21.15.53:0/1747911057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33344d0 msgr2=0x55f6f3704de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f377fe640 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33344d0 0x55f6f3704de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f377fe640 1 -- 172.21.15.53:0/1747911057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33551b0 msgr2=0x55f6f37106f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:24:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f377fe640 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33551b0 0x55f6f37106f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f377fe640 1 -- 172.21.15.53:0/1747911057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f3439620 con 0x55f6f332c2f0 2024-08-31T06:24:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.079+0000 7f6f37fff640 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33344d0 0x55f6f3704de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:24:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.080+0000 7f6f377fe640 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f37048a0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0095c0 tx=0x7f6f2c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4013450561e4cac4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.080+0000 7f6f177fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.080+0000 7f6f177fe640 1 -- 172.21.15.53:0/1747911057 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c04c070 con 0x55f6f332c2f0 2024-08-31T06:24:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.080+0000 7f6f177fe640 1 -- 172.21.15.53:0/1747911057 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f6f2c0052f0 con 0x55f6f332c2f0 2024-08-31T06:24:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.080+0000 7f6f456b5740 1 -- 172.21.15.53:0/1747911057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f2c031a70 con 0x55f6f332c2f0 2024-08-31T06:24:33.091 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.080+0000 7f6f177fe640 1 -- 172.21.15.53:0/1747911057 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f6f2c058050 con 0x55f6f332c2f0 2024-08-31T06:24:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.080+0000 7f6f456b5740 10 client.21459 fetch_fsmap learned FSMap version 67 2024-08-31T06:24:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.080+0000 7f6f456b5740 1 -- 172.21.15.53:0/1747911057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x55f6f3713410 con 0x55f6f332c2f0 2024-08-31T06:24:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.080+0000 7f6f177fe640 1 -- 172.21.15.53:0/1747911057 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f2c031a70 con 0x55f6f332c2f0 2024-08-31T06:24:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.080+0000 7f6f177fe640 1 -- 172.21.15.53:0/1747911057 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 67) ==== 8366+0+0 (secure 0 0 0) 0x7f6f2c048430 con 0x55f6f332c2f0 2024-08-31T06:24:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.081+0000 7f6f456b5740 10 client.21459 fetch_fsmap finished waiting for FSMap version 67 2024-08-31T06:24:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.081+0000 7f6f456b5740 10 client.21459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.081+0000 7f6f456b5740 20 client.21459 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.081+0000 7f6f456b5740 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f6f3313d80 0x55f6f3716770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.081+0000 7f6f456b5740 4 client.21459 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.081+0000 7f6f456b5740 1 -- 172.21.15.53:0/1747911057 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6f366ff50 con 0x55f6f3313d80 2024-08-31T06:24:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.081+0000 7f6f37fff640 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f6f3313d80 0x55f6f3716770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.081+0000 7f6f177fe640 10 client.21459 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.081+0000 7f6f37fff640 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f6f3313d80 0x55f6f3716770 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=912e039683256d77 server_cookie=951362c203263689 in_seq=0 out_seq=0 2024-08-31T06:24:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f177fe640 1 -- 172.21.15.53:0/1747911057 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f6f366ff50 con 0x55f6f3313d80 2024-08-31T06:24:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f177fe640 10 client.21459 handle_command_reply: tid=0 2024-08-31T06:24:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f456b5740 1 client.21459 shutdown 2024-08-31T06:24:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f456b5740 1 -- 172.21.15.53:0/1747911057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 msgr2=0x55f6f37048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f456b5740 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f37048a0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0095c0 tx=0x7f6f2c009260 comp rx=0 tx=0).stop 2024-08-31T06:24:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f456b5740 1 -- 172.21.15.53:0/1747911057 shutdown_connections 2024-08-31T06:24:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f456b5740 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f6f3313d80 0x55f6f3716770 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f456b5740 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33551b0 0x55f6f37106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f456b5740 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33344d0 0x55f6f3704de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f177fe640 0 client.21459 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f456b5740 1 --2- 172.21.15.53:0/1747911057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f37048a0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.082+0000 7f6f456b5740 1 -- 172.21.15.53:0/1747911057 >> 172.21.15.53:0/1747911057 conn(0x55f6f3349300 msgr2=0x55f6f36f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.083+0000 7f6f456b5740 1 -- 172.21.15.53:0/1747911057 shutdown_connections 2024-08-31T06:24:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.083+0000 7f6f456b5740 1 -- 172.21.15.53:0/1747911057 wait complete. 2024-08-31T06:24:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.083+0000 7f6f456b5740 20 client.21459 trim_cache size 0 max 16384 2024-08-31T06:24:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.097+0000 7f6f456b5740 1 Processor -- start 2024-08-31T06:24:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f456b5740 1 -- start start 2024-08-31T06:24:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f332c2f0 0x55f6f3705bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33344d0 0x55f6f3704b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33551b0 0x55f6f36f6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f456b5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6f381af420 con 0x55f6f33344d0 2024-08-31T06:24:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f456b5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6f381b0f90 con 0x55f6f332c2f0 2024-08-31T06:24:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f456b5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6f381afb20 con 0x55f6f33551b0 2024-08-31T06:24:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f37fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33344d0 0x55f6f3704b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f37fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33344d0 0x55f6f3704b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47944/0 (socket says 172.21.15.53:47944) 2024-08-31T06:24:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f37fff640 1 -- 172.21.15.53:0/3944267903 learned_addr learned my addr 172.21.15.53:0/3944267903 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f37fff640 1 -- 172.21.15.53:0/3944267903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33551b0 msgr2=0x55f6f36f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f37fff640 1 --2- 172.21.15.53:0/3944267903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33551b0 0x55f6f36f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f37fff640 1 -- 172.21.15.53:0/3944267903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f332c2f0 msgr2=0x55f6f3705bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f37fff640 1 --2- 172.21.15.53:0/3944267903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f332c2f0 0x55f6f3705bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f37fff640 1 -- 172.21.15.53:0/3944267903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f3706a60 con 0x55f6f33344d0 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f37fff640 1 --2- 172.21.15.53:0/3944267903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33344d0 0x55f6f3704b70 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x55f6f37074c0 tx=0x7f6f28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2869cb6651aaaa3c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.098+0000 7f6f1dffb640 1 -- 172.21.15.53:0/3944267903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f28020070 con 0x55f6f33344d0 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.099+0000 7f6f1dffb640 1 -- 172.21.15.53:0/3944267903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f28014840 con 0x55f6f33344d0 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.099+0000 7f6f1dffb640 1 -- 172.21.15.53:0/3944267903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f280235c0 con 0x55f6f33344d0 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.099+0000 7f6f456b5740 1 -- 172.21.15.53:0/3944267903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33344d0 msgr2=0x55f6f3704b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.099+0000 7f6f456b5740 1 --2- 172.21.15.53:0/3944267903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33344d0 0x55f6f3704b70 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x55f6f37074c0 tx=0x7f6f28008040 comp rx=0 tx=0).stop 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.099+0000 7f6f456b5740 1 -- 172.21.15.53:0/3944267903 shutdown_connections 2024-08-31T06:24:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.099+0000 7f6f456b5740 1 --2- 172.21.15.53:0/3944267903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33551b0 0x55f6f36f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.099+0000 7f6f456b5740 1 --2- 172.21.15.53:0/3944267903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f33344d0 0x55f6f3704b70 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.099+0000 7f6f456b5740 1 --2- 172.21.15.53:0/3944267903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f332c2f0 0x55f6f3705bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.099+0000 7f6f456b5740 1 -- 172.21.15.53:0/3944267903 >> 172.21.15.53:0/3944267903 conn(0x55f6f3349300 msgr2=0x55f6f36fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.099+0000 7f6f456b5740 1 -- 172.21.15.53:0/3944267903 shutdown_connections 2024-08-31T06:24:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.099+0000 7f6f456b5740 1 -- 172.21.15.53:0/3944267903 wait complete. 2024-08-31T06:24:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f456b5740 1 -- start start 2024-08-31T06:24:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f456b5740 1 Processor -- start 2024-08-31T06:24:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f371a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33344d0 0x55f6f37175b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f456b5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33551b0 0x55f6f3717c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f456b5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6f381b08c0 con 0x55f6f332c2f0 2024-08-31T06:24:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f456b5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6f381b01f0 con 0x55f6f33551b0 2024-08-31T06:24:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f456b5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6f381ad420 con 0x55f6f33344d0 2024-08-31T06:24:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f456b5740 10 client.0 _ll_register_callbacks cb 0x7f6f2800a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f371a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f371a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47950/0 (socket says 172.21.15.53:47950) 2024-08-31T06:24:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.100+0000 7f6f377fe640 1 -- 172.21.15.53:0/70140982 learned_addr learned my addr 172.21.15.53:0/70140982 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f377fe640 1 -- 172.21.15.53:0/70140982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33344d0 msgr2=0x55f6f37175b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:24:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f377fe640 1 --2- 172.21.15.53:0/70140982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33344d0 0x55f6f37175b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f377fe640 1 -- 172.21.15.53:0/70140982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33551b0 msgr2=0x55f6f3717c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:24:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f377fe640 1 --2- 172.21.15.53:0/70140982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33551b0 0x55f6f3717c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f377fe640 1 -- 172.21.15.53:0/70140982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f37183e0 con 0x55f6f332c2f0 2024-08-31T06:24:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f377fe640 1 --2- 172.21.15.53:0/70140982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f371a0f0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c033000 tx=0x7f6f2c0489f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280788fc6d477ad9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f177fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f177fe640 1 -- 172.21.15.53:0/70140982 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c061060 con 0x55f6f332c2f0 2024-08-31T06:24:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f177fe640 1 -- 172.21.15.53:0/70140982 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f6f2c032da0 con 0x55f6f332c2f0 2024-08-31T06:24:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f456b5740 1 -- 172.21.15.53:0/70140982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f28014840 con 0x55f6f332c2f0 2024-08-31T06:24:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f177fe640 1 -- 172.21.15.53:0/70140982 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f6f2c04c030 con 0x55f6f332c2f0 2024-08-31T06:24:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f456b5740 10 client.21465 fetch_fsmap learned FSMap version 67 2024-08-31T06:24:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f456b5740 1 -- 172.21.15.53:0/70140982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x55f6f3780fb0 con 0x55f6f332c2f0 2024-08-31T06:24:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.101+0000 7f6f177fe640 1 -- 172.21.15.53:0/70140982 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f28014840 con 0x55f6f332c2f0 2024-08-31T06:24:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.102+0000 7f6f177fe640 1 -- 172.21.15.53:0/70140982 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 67) ==== 8366+0+0 (secure 0 0 0) 0x7f6f2c0046c0 con 0x55f6f332c2f0 2024-08-31T06:24:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.102+0000 7f6f456b5740 10 client.21465 fetch_fsmap finished waiting for FSMap version 67 2024-08-31T06:24:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.102+0000 7f6f456b5740 10 client.21465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.102+0000 7f6f456b5740 20 client.21465 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.102+0000 7f6f456b5740 1 --2- 172.21.15.53:0/70140982 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f6f32e91c0 0x55f6f3783680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.102+0000 7f6f456b5740 4 client.21465 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:24:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.102+0000 7f6f456b5740 1 -- 172.21.15.53:0/70140982 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f6f366b9f0 con 0x55f6f32e91c0 2024-08-31T06:24:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.102+0000 7f6f37fff640 1 --2- 172.21.15.53:0/70140982 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f6f32e91c0 0x55f6f3783680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.102+0000 7f6f37fff640 1 --2- 172.21.15.53:0/70140982 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f6f32e91c0 0x55f6f3783680 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b80f4ae307cc647 server_cookie=1f03c56365195aba in_seq=0 out_seq=0 2024-08-31T06:24:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.102+0000 7f6f177fe640 10 client.21465 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:33.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f177fe640 1 -- 172.21.15.53:0/70140982 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f6f366b9f0 con 0x55f6f32e91c0 2024-08-31T06:24:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f177fe640 10 client.21465 handle_command_reply: tid=0 2024-08-31T06:24:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 1 client.21465 shutdown 2024-08-31T06:24:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 1 -- 172.21.15.53:0/70140982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 msgr2=0x55f6f371a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 1 --2- 172.21.15.53:0/70140982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f371a0f0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c033000 tx=0x7f6f2c0489f0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 1 -- 172.21.15.53:0/70140982 shutdown_connections 2024-08-31T06:24:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 1 --2- 172.21.15.53:0/70140982 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f6f32e91c0 0x55f6f3783680 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 1 --2- 172.21.15.53:0/70140982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f6f33551b0 0x55f6f3717c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f177fe640 0 client.21465 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 1 --2- 172.21.15.53:0/70140982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6f33344d0 0x55f6f37175b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 1 --2- 172.21.15.53:0/70140982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6f332c2f0 0x55f6f371a0f0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 1 -- 172.21.15.53:0/70140982 >> 172.21.15.53:0/70140982 conn(0x55f6f3349300 msgr2=0x55f6f36fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 1 -- 172.21.15.53:0/70140982 shutdown_connections 2024-08-31T06:24:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 1 -- 172.21.15.53:0/70140982 wait complete. 2024-08-31T06:24:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.135+0000 7f6f456b5740 20 client.21465 trim_cache size 0 max 16384 2024-08-31T06:24:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:24:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:24:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:24:33.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:24:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 -- 172.21.15.53:0/2074757508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6f200b4ca0 msgr2=0x7f6f200b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6f200b4ca0 0x7f6f200b71b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6f300e2450 tx=0x7f6f30077540 comp rx=0 tx=0).stop 2024-08-31T06:24:33.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 -- 172.21.15.53:0/2074757508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f381089f0 msgr2=0x7f6f3819faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f381089f0 0x7f6f3819faf0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000b990 tx=0x7f6f3000be50 comp rx=0 tx=0).stop 2024-08-31T06:24:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 -- 172.21.15.53:0/2074757508 shutdown_connections 2024-08-31T06:24:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6f200b4ca0 0x7f6f200b71b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f381089f0 0x7f6f3819faf0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f381080a0 0x7f6f3819a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 --2- 172.21.15.53:0/2074757508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f38102770 0x7f6f3819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 -- 172.21.15.53:0/2074757508 >> 172.21.15.53:0/2074757508 conn(0x7f6f380fe190 msgr2=0x7f6f381005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 -- 172.21.15.53:0/2074757508 shutdown_connections 2024-08-31T06:24:33.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:33.136+0000 7f6f3e74a640 1 -- 172.21.15.53:0/2074757508 wait complete. 2024-08-31T06:24:33.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.31 MB/sec execute 261 sec latency 25560.954 ms 2024-08-31T06:24:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:33 smithi130 ceph-mon[22266]: pgmap v939: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-08-31T06:24:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:33 smithi153 ceph-mon[22320]: pgmap v939: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-08-31T06:24:34.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:33 smithi053 ceph-mon[18924]: pgmap v939: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-08-31T06:24:34.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.29 MB/sec execute 262 sec latency 26561.059 ms 2024-08-31T06:24:34.885 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:24:35.155 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:35.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.27 MB/sec execute 263 sec latency 27561.172 ms 2024-08-31T06:24:35.844 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:24:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:35 smithi130 ceph-mon[22266]: pgmap v940: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T06:24:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:35 smithi153 ceph-mon[22320]: pgmap v940: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T06:24:36.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:35 smithi053 ceph-mon[18924]: pgmap v940: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T06:24:36.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.25 MB/sec execute 264 sec latency 28561.274 ms 2024-08-31T06:24:36.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.501+0000 7eff33e56640 1 -- 172.21.15.53:0/3565201935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2c103900 msgr2=0x7eff2c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:36.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.501+0000 7eff33e56640 1 --2- 172.21.15.53:0/3565201935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2c103900 0x7eff2c103d10 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7eff28009900 tx=0x7eff2802a410 comp rx=0 tx=0).stop 2024-08-31T06:24:36.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.501+0000 7eff33e56640 1 -- 172.21.15.53:0/3565201935 shutdown_connections 2024-08-31T06:24:36.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.501+0000 7eff33e56640 1 --2- 172.21.15.53:0/3565201935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c109b90 0x7eff2c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.501+0000 7eff33e56640 1 --2- 172.21.15.53:0/3565201935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c109240 0x7eff2c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.501+0000 7eff33e56640 1 --2- 172.21.15.53:0/3565201935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2c103900 0x7eff2c103d10 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.501+0000 7eff33e56640 1 -- 172.21.15.53:0/3565201935 >> 172.21.15.53:0/3565201935 conn(0x7eff2c07b5f0 msgr2=0x7eff2c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.501+0000 7eff33e56640 1 -- 172.21.15.53:0/3565201935 shutdown_connections 2024-08-31T06:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.501+0000 7eff33e56640 1 -- 172.21.15.53:0/3565201935 wait complete. 2024-08-31T06:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff33e56640 1 Processor -- start 2024-08-31T06:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff33e56640 1 -- start start 2024-08-31T06:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff33e56640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c103900 0x7eff2c19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff33e56640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2c109240 0x7eff2c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff33e56640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c109b90 0x7eff2c19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff33e56640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c113700 con 0x7eff2c109240 2024-08-31T06:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff33e56640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c113580 con 0x7eff2c109b90 2024-08-31T06:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff33e56640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c113880 con 0x7eff2c103900 2024-08-31T06:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff313f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2c109240 0x7eff2c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff313f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2c109240 0x7eff2c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38602/0 (socket says 172.21.15.53:38602) 2024-08-31T06:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff313f1640 1 -- 172.21.15.53:0/3118041199 learned_addr learned my addr 172.21.15.53:0/3118041199 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.502+0000 7eff31bf2640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c103900 0x7eff2c19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff323f3640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c109b90 0x7eff2c19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff313f1640 1 -- 172.21.15.53:0/3118041199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c103900 msgr2=0x7eff2c19a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff313f1640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c103900 0x7eff2c19a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff313f1640 1 -- 172.21.15.53:0/3118041199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c109b90 msgr2=0x7eff2c19f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff313f1640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c109b90 0x7eff2c19f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff313f1640 1 -- 172.21.15.53:0/3118041199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c1a00c0 con 0x7eff2c109240 2024-08-31T06:24:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff313f1640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2c109240 0x7eff2c19a6f0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00e9f0 tx=0x7eff1c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff22ffd640 1 -- 172.21.15.53:0/3118041199 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00ccc0 con 0x7eff2c109240 2024-08-31T06:24:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff22ffd640 1 -- 172.21.15.53:0/3118041199 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff1c0108c0 con 0x7eff2c109240 2024-08-31T06:24:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff22ffd640 1 -- 172.21.15.53:0/3118041199 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c018750 con 0x7eff2c109240 2024-08-31T06:24:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff33e56640 1 -- 172.21.15.53:0/3118041199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2c1a03b0 con 0x7eff2c109240 2024-08-31T06:24:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.503+0000 7eff33e56640 1 -- 172.21.15.53:0/3118041199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff2c1a6b10 con 0x7eff2c109240 2024-08-31T06:24:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.506+0000 7eff3a3cb740 1 Processor -- start 2024-08-31T06:24:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff3a3cb740 1 -- start start 2024-08-31T06:24:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb8882c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4ba1b0 0x5620cb888800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4c2390 0x5620cb888d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5620cb7ff630 con 0x5620cb4e3070 2024-08-31T06:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5620cb7eebc0 con 0x5620cb4ba1b0 2024-08-31T06:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5620cb7f2b70 con 0x5620cb4c2390 2024-08-31T06:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff22ffd640 1 -- 172.21.15.53:0/3118041199 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7eff1c010430 con 0x7eff2c109240 2024-08-31T06:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff323f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb8882c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff323f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb8882c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38614/0 (socket says 172.21.15.53:38614) 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff323f3640 1 -- 172.21.15.53:0/4272139100 learned_addr learned my addr 172.21.15.53:0/4272139100 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff31bf2640 1 --2- 172.21.15.53:0/4272139100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4ba1b0 0x5620cb888800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff313f1640 1 --2- 172.21.15.53:0/4272139100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4c2390 0x5620cb888d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.507+0000 7eff323f3640 1 -- 172.21.15.53:0/4272139100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4c2390 msgr2=0x5620cb888d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff323f3640 1 --2- 172.21.15.53:0/4272139100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4c2390 0x5620cb888d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff323f3640 1 -- 172.21.15.53:0/4272139100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4ba1b0 msgr2=0x5620cb888800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff323f3640 1 --2- 172.21.15.53:0/4272139100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4ba1b0 0x5620cb888800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff323f3640 1 -- 172.21.15.53:0/4272139100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620cb54e650 con 0x5620cb4e3070 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff31bf2640 1 --2- 172.21.15.53:0/4272139100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4ba1b0 0x5620cb888800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff323f3640 1 --2- 172.21.15.53:0/4272139100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb8882c0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7eff24009eb0 tx=0x7eff2400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccd46e8bea1d4ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff17fff640 1 -- 172.21.15.53:0/4272139100 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24011640 con 0x5620cb4e3070 2024-08-31T06:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff17fff640 1 -- 172.21.15.53:0/4272139100 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff24011c70 con 0x5620cb4e3070 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff17fff640 1 -- 172.21.15.53:0/4272139100 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2401bb40 con 0x5620cb4e3070 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff22ffd640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff180b4ca0 0x7eff180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff31bf2640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff180b4ca0 0x7eff180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.508+0000 7eff22ffd640 1 -- 172.21.15.53:0/3118041199 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7eff1c0e59d0 con 0x7eff2c109240 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.509+0000 7eff3a3cb740 1 -- 172.21.15.53:0/4272139100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 msgr2=0x5620cb8882c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.509+0000 7eff31bf2640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff180b4ca0 0x7eff180b71b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7eff280057c0 tx=0x7eff280058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.509+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/4272139100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb8882c0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7eff24009eb0 tx=0x7eff2400f730 comp rx=0 tx=0).stop 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.509+0000 7eff3a3cb740 1 -- 172.21.15.53:0/4272139100 shutdown_connections 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.509+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/4272139100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4c2390 0x5620cb888d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.509+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/4272139100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4ba1b0 0x5620cb888800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.509+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/4272139100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb8882c0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.509+0000 7eff3a3cb740 1 -- 172.21.15.53:0/4272139100 >> 172.21.15.53:0/4272139100 conn(0x5620cb4d7460 msgr2=0x5620cb8861b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.509+0000 7eff3a3cb740 1 -- 172.21.15.53:0/4272139100 shutdown_connections 2024-08-31T06:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.509+0000 7eff3a3cb740 1 -- 172.21.15.53:0/4272139100 wait complete. 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff3a3cb740 1 -- start start 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff3a3cb740 1 Processor -- start 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4ba1b0 0x5620cb893af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4c2390 0x5620cb894070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4e3070 0x5620cb89fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5620cb651700 con 0x5620cb4c2390 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5620cb775700 con 0x5620cb4e3070 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5620cb896aa0 con 0x5620cb4ba1b0 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff3a3cb740 10 client.0 _ll_register_callbacks cb 0x5620cb7a4dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff313f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4c2390 0x5620cb894070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff313f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4c2390 0x5620cb894070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38622/0 (socket says 172.21.15.53:38622) 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.510+0000 7eff313f1640 1 -- 172.21.15.53:0/1826828510 learned_addr learned my addr 172.21.15.53:0/1826828510 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff323f3640 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4e3070 0x5620cb89fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff31bf2640 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4ba1b0 0x5620cb893af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff313f1640 1 -- 172.21.15.53:0/1826828510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4ba1b0 msgr2=0x5620cb893af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff313f1640 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4ba1b0 0x5620cb893af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff313f1640 1 -- 172.21.15.53:0/1826828510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4e3070 msgr2=0x5620cb89fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff313f1640 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4e3070 0x5620cb89fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff313f1640 1 -- 172.21.15.53:0/1826828510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620cb7ae8b0 con 0x5620cb4c2390 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff31bf2640 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4ba1b0 0x5620cb893af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff313f1640 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4c2390 0x5620cb894070 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0a80c0 tx=0x7eff1c0abb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4020b9a8c8782c95 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff157fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff157fa640 1 -- 172.21.15.53:0/1826828510 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0b08b0 con 0x5620cb4c2390 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff157fa640 1 -- 172.21.15.53:0/1826828510 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7eff1c0e3320 con 0x5620cb4c2390 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff3a3cb740 1 -- 172.21.15.53:0/1826828510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff24011c70 con 0x5620cb4c2390 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff157fa640 1 -- 172.21.15.53:0/1826828510 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7eff1c0e3520 con 0x5620cb4c2390 2024-08-31T06:24:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff3a3cb740 10 client.21477 fetch_fsmap learned FSMap version 67 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.511+0000 7eff3a3cb740 1 -- 172.21.15.53:0/1826828510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x5620cb8a2870 con 0x5620cb4c2390 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.512+0000 7eff157fa640 1 -- 172.21.15.53:0/1826828510 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff24011c70 con 0x5620cb4c2390 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.512+0000 7eff157fa640 1 -- 172.21.15.53:0/1826828510 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 67) ==== 8366+0+0 (secure 0 0 0) 0x7eff1c0a7b40 con 0x5620cb4c2390 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.512+0000 7eff3a3cb740 10 client.21477 fetch_fsmap finished waiting for FSMap version 67 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.512+0000 7eff3a3cb740 10 client.21477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.512+0000 7eff3a3cb740 20 client.21477 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.512+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620cb4a19f0 0x5620cb8a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.512+0000 7eff3a3cb740 4 client.21477 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.512+0000 7eff3a3cb740 1 -- 172.21.15.53:0/1826828510 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620cb801580 con 0x5620cb4a19f0 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.512+0000 7eff31bf2640 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620cb4a19f0 0x5620cb8a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.513+0000 7eff31bf2640 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620cb4a19f0 0x5620cb8a5dd0 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4142f87fa2865ce5 server_cookie=44bcd71280a5eff4 in_seq=0 out_seq=0 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.513+0000 7eff157fa640 10 client.21477 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.513+0000 7eff157fa640 1 -- 172.21.15.53:0/1826828510 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5620cb801580 con 0x5620cb4a19f0 2024-08-31T06:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.513+0000 7eff157fa640 10 client.21477 handle_command_reply: tid=0 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.513+0000 7eff3a3cb740 1 client.21477 shutdown 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff3a3cb740 1 -- 172.21.15.53:0/1826828510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4c2390 msgr2=0x5620cb894070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4c2390 0x5620cb894070 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0a80c0 tx=0x7eff1c0abb50 comp rx=0 tx=0).stop 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff3a3cb740 1 -- 172.21.15.53:0/1826828510 shutdown_connections 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620cb4a19f0 0x5620cb8a5dd0 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4e3070 0x5620cb89fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4c2390 0x5620cb894070 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/1826828510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4ba1b0 0x5620cb893af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff3a3cb740 1 -- 172.21.15.53:0/1826828510 >> 172.21.15.53:0/1826828510 conn(0x5620cb4d7460 msgr2=0x5620cb88b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff157fa640 0 client.21477 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff3a3cb740 1 -- 172.21.15.53:0/1826828510 shutdown_connections 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff3a3cb740 1 -- 172.21.15.53:0/1826828510 wait complete. 2024-08-31T06:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.514+0000 7eff3a3cb740 20 client.21477 trim_cache size 0 max 16384 2024-08-31T06:24:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff3a3cb740 1 Processor -- start 2024-08-31T06:24:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff3a3cb740 1 -- start start 2024-08-31T06:24:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4ba1b0 0x5620cb886370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4c2390 0x5620cb895720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb89fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1af530 con 0x5620cb4e3070 2024-08-31T06:24:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1b10a0 con 0x5620cb4c2390 2024-08-31T06:24:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1afc30 con 0x5620cb4ba1b0 2024-08-31T06:24:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff323f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb89fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff323f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb89fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38626/0 (socket says 172.21.15.53:38626) 2024-08-31T06:24:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff323f3640 1 -- 172.21.15.53:0/3236216615 learned_addr learned my addr 172.21.15.53:0/3236216615 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff313f1640 1 --2- 172.21.15.53:0/3236216615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4c2390 0x5620cb895720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff31bf2640 1 --2- 172.21.15.53:0/3236216615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4ba1b0 0x5620cb886370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff323f3640 1 -- 172.21.15.53:0/3236216615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4ba1b0 msgr2=0x5620cb886370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff323f3640 1 --2- 172.21.15.53:0/3236216615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4ba1b0 0x5620cb886370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff323f3640 1 -- 172.21.15.53:0/3236216615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4c2390 msgr2=0x5620cb895720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff323f3640 1 --2- 172.21.15.53:0/3236216615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4c2390 0x5620cb895720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.532+0000 7eff323f3640 1 -- 172.21.15.53:0/3236216615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620cb894b90 con 0x5620cb4e3070 2024-08-31T06:24:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.533+0000 7eff323f3640 1 --2- 172.21.15.53:0/3236216615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb89fc90 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7eff24005c40 tx=0x7eff240092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2720d22b9b09ae82 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.533+0000 7eff177fe640 1 -- 172.21.15.53:0/3236216615 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2402a070 con 0x5620cb4e3070 2024-08-31T06:24:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.533+0000 7eff177fe640 1 -- 172.21.15.53:0/3236216615 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff24003db0 con 0x5620cb4e3070 2024-08-31T06:24:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.533+0000 7eff177fe640 1 -- 172.21.15.53:0/3236216615 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24011820 con 0x5620cb4e3070 2024-08-31T06:24:36.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.534+0000 7eff3a3cb740 1 -- 172.21.15.53:0/3236216615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 msgr2=0x5620cb89fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:36.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.534+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/3236216615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb89fc90 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7eff24005c40 tx=0x7eff240092e0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.534+0000 7eff3a3cb740 1 -- 172.21.15.53:0/3236216615 shutdown_connections 2024-08-31T06:24:36.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.534+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/3236216615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4e3070 0x5620cb89fc90 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.534+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/3236216615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4c2390 0x5620cb895720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.534+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/3236216615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4ba1b0 0x5620cb886370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.534+0000 7eff3a3cb740 1 -- 172.21.15.53:0/3236216615 >> 172.21.15.53:0/3236216615 conn(0x5620cb4d7460 msgr2=0x5620cb895010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.534+0000 7eff3a3cb740 1 -- 172.21.15.53:0/3236216615 shutdown_connections 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.534+0000 7eff3a3cb740 1 -- 172.21.15.53:0/3236216615 wait complete. 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.534+0000 7eff3a3cb740 1 -- start start 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.534+0000 7eff3a3cb740 1 Processor -- start 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4ba1b0 0x5620cb8980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4c2390 0x5620cb898650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff3a3cb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4e3070 0x5620cb90f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1b09d0 con 0x5620cb4ba1b0 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1b0300 con 0x5620cb4e3070 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff3a3cb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7eff2c1ad530 con 0x5620cb4c2390 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff3a3cb740 10 client.0 _ll_register_callbacks cb 0x7eff1c0096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:36.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff31bf2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4ba1b0 0x5620cb8980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff31bf2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4ba1b0 0x5620cb8980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38638/0 (socket says 172.21.15.53:38638) 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff31bf2640 1 -- 172.21.15.53:0/2201497640 learned_addr learned my addr 172.21.15.53:0/2201497640 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff313f1640 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4c2390 0x5620cb898650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff323f3640 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4e3070 0x5620cb90f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff31bf2640 1 -- 172.21.15.53:0/2201497640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4c2390 msgr2=0x5620cb898650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff31bf2640 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4c2390 0x5620cb898650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff31bf2640 1 -- 172.21.15.53:0/2201497640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4e3070 msgr2=0x5620cb90f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff31bf2640 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4e3070 0x5620cb90f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff31bf2640 1 -- 172.21.15.53:0/2201497640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620cb90fc80 con 0x5620cb4ba1b0 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff31bf2640 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4ba1b0 0x5620cb8980d0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7eff28000c00 tx=0x7eff2803e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f89952fe53143c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.535+0000 7eff157fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff157fa640 1 -- 172.21.15.53:0/2201497640 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff28035050 con 0x5620cb4ba1b0 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff157fa640 1 -- 172.21.15.53:0/2201497640 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7eff280035f0 con 0x5620cb4ba1b0 2024-08-31T06:24:36.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff3a3cb740 1 -- 172.21.15.53:0/2201497640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff24003db0 con 0x5620cb4ba1b0 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff157fa640 1 -- 172.21.15.53:0/2201497640 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7eff280037f0 con 0x5620cb4ba1b0 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff3a3cb740 10 client.21483 fetch_fsmap learned FSMap version 67 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff3a3cb740 1 -- 172.21.15.53:0/2201497640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x5620cb910e40 con 0x5620cb4ba1b0 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff157fa640 1 -- 172.21.15.53:0/2201497640 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff24003db0 con 0x5620cb4ba1b0 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff157fa640 1 -- 172.21.15.53:0/2201497640 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 67) ==== 8366+0+0 (secure 0 0 0) 0x7eff2803c9e0 con 0x5620cb4ba1b0 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff3a3cb740 10 client.21483 fetch_fsmap finished waiting for FSMap version 67 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff3a3cb740 10 client.21483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff3a3cb740 20 client.21483 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620cb476da0 0x5620cb9135e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff3a3cb740 4 client.21483 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.536+0000 7eff3a3cb740 1 -- 172.21.15.53:0/2201497640 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5620cb7fd020 con 0x5620cb476da0 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.537+0000 7eff313f1640 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620cb476da0 0x5620cb9135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:36.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.537+0000 7eff313f1640 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620cb476da0 0x5620cb9135e0 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a0e37a90e99574b server_cookie=882bda79cd7baad7 in_seq=0 out_seq=0 2024-08-31T06:24:36.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.537+0000 7eff157fa640 10 client.21483 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.537+0000 7eff157fa640 1 -- 172.21.15.53:0/2201497640 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6906 (crc 0 0 0) 0x5620cb7fd020 con 0x5620cb476da0 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.537+0000 7eff157fa640 10 client.21483 handle_command_reply: tid=0 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.537+0000 7eff3a3cb740 1 client.21483 shutdown 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.537+0000 7eff3a3cb740 1 -- 172.21.15.53:0/2201497640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4ba1b0 msgr2=0x5620cb8980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4ba1b0 0x5620cb8980d0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7eff28000c00 tx=0x7eff2803e070 comp rx=0 tx=0).stop 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff3a3cb740 1 -- 172.21.15.53:0/2201497640 shutdown_connections 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5620cb476da0 0x5620cb9135e0 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620cb4e3070 0x5620cb90f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620cb4c2390 0x5620cb898650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff157fa640 0 client.21483 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff3a3cb740 1 --2- 172.21.15.53:0/2201497640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620cb4ba1b0 0x5620cb8980d0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff3a3cb740 1 -- 172.21.15.53:0/2201497640 >> 172.21.15.53:0/2201497640 conn(0x5620cb4d7460 msgr2=0x5620cb88bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:36.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff3a3cb740 1 -- 172.21.15.53:0/2201497640 shutdown_connections 2024-08-31T06:24:36.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff3a3cb740 1 -- 172.21.15.53:0/2201497640 wait complete. 2024-08-31T06:24:36.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff3a3cb740 20 client.21483 trim_cache size 0 max 16384 2024-08-31T06:24:36.545 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:24:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:24:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:24:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:24:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:24:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:24:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:24:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:24:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:24:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:24:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:24:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:24:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:24:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:24:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:24:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:24:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:24:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:24:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:24:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:24:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:24:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:24:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:24:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:24:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:24:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:24:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:24:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:24:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:24:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:24:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:24:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:24:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:24:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:24:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:24:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:36.565 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:24:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff33e56640 1 -- 172.21.15.53:0/3118041199 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff180b4ca0 msgr2=0x7eff180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff33e56640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff180b4ca0 0x7eff180b71b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7eff280057c0 tx=0x7eff280058d0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff33e56640 1 -- 172.21.15.53:0/3118041199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2c109240 msgr2=0x7eff2c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff33e56640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2c109240 0x7eff2c19a6f0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00e9f0 tx=0x7eff1c00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff33e56640 1 -- 172.21.15.53:0/3118041199 shutdown_connections 2024-08-31T06:24:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff33e56640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7eff180b4ca0 0x7eff180b71b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff33e56640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff2c109b90 0x7eff2c19f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff33e56640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2c109240 0x7eff2c19a6f0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff33e56640 1 --2- 172.21.15.53:0/3118041199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c103900 0x7eff2c19a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.538+0000 7eff33e56640 1 -- 172.21.15.53:0/3118041199 >> 172.21.15.53:0/3118041199 conn(0x7eff2c07b5f0 msgr2=0x7eff2c107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.539+0000 7eff33e56640 1 -- 172.21.15.53:0/3118041199 shutdown_connections 2024-08-31T06:24:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:36.539+0000 7eff33e56640 1 -- 172.21.15.53:0/3118041199 wait complete. 2024-08-31T06:24:37.372 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:24:37.372 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:24:37.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.23 MB/sec execute 265 sec latency 29561.318 ms 2024-08-31T06:24:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:37.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.900+0000 7f714b4e6640 1 -- 172.21.15.53:0/1341942777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7144102800 msgr2=0x7f7144102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:37.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.900+0000 7f714b4e6640 1 --2- 172.21.15.53:0/1341942777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7144102800 0x7f7144102c10 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f7140009900 tx=0x7f714002a410 comp rx=0 tx=0).stop 2024-08-31T06:24:37.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.900+0000 7f714b4e6640 1 -- 172.21.15.53:0/1341942777 shutdown_connections 2024-08-31T06:24:37.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.900+0000 7f714b4e6640 1 --2- 172.21.15.53:0/1341942777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7144108a90 0x7f714410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:37.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.900+0000 7f714b4e6640 1 --2- 172.21.15.53:0/1341942777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7144108140 0x7f7144108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:37.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.900+0000 7f714b4e6640 1 --2- 172.21.15.53:0/1341942777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7144102800 0x7f7144102c10 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:37.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.900+0000 7f714b4e6640 1 -- 172.21.15.53:0/1341942777 >> 172.21.15.53:0/1341942777 conn(0x7f71440794d0 msgr2=0x7f71440798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:37.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.900+0000 7f714b4e6640 1 -- 172.21.15.53:0/1341942777 shutdown_connections 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.900+0000 7f714b4e6640 1 -- 172.21.15.53:0/1341942777 wait complete. 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.901+0000 7f714b4e6640 1 Processor -- start 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.901+0000 7f714b4e6640 1 -- start start 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.901+0000 7f714b4e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7144102800 0x7f714419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.901+0000 7f714b4e6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7144108140 0x7f714419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.901+0000 7f714b4e6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7144108a90 0x7f714419f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.901+0000 7f714b4e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f71441125c0 con 0x7f7144102800 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.901+0000 7f714b4e6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7144112440 con 0x7f7144108140 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.901+0000 7f714b4e6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7144112740 con 0x7f7144108a90 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.901+0000 7f7149282640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7144102800 0x7f714419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.901+0000 7f7149282640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7144102800 0x7f714419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38664/0 (socket says 172.21.15.53:38664) 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.901+0000 7f7149282640 1 -- 172.21.15.53:0/2251213113 learned_addr learned my addr 172.21.15.53:0/2251213113 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:37.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f7149a83640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7144108a90 0x7f714419f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f7148a81640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7144108140 0x7f714419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f7149282640 1 -- 172.21.15.53:0/2251213113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7144108a90 msgr2=0x7f714419f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f7149282640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7144108a90 0x7f714419f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f7149282640 1 -- 172.21.15.53:0/2251213113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7144108140 msgr2=0x7f714419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f7149282640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7144108140 0x7f714419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f7149282640 1 -- 172.21.15.53:0/2251213113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71441a0090 con 0x7f7144102800 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f7148a81640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7144108140 0x7f714419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f7149282640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7144102800 0x7f714419a120 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f7140009230 tx=0x7f7140004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f713a7fc640 1 -- 172.21.15.53:0/2251213113 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714003f030 con 0x7f7144102800 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f713a7fc640 1 -- 172.21.15.53:0/2251213113 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7140003a80 con 0x7f7144102800 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f714b4e6640 1 -- 172.21.15.53:0/2251213113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71441a0320 con 0x7f7144102800 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f713a7fc640 1 -- 172.21.15.53:0/2251213113 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140035070 con 0x7f7144102800 2024-08-31T06:24:37.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.902+0000 7f714b4e6640 1 -- 172.21.15.53:0/2251213113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71441a6ae0 con 0x7f7144102800 2024-08-31T06:24:37.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.904+0000 7f714b4e6640 1 -- 172.21.15.53:0/2251213113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7144102c10 con 0x7f7144102800 2024-08-31T06:24:37.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.906+0000 7f713a7fc640 1 -- 172.21.15.53:0/2251213113 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7140042030 con 0x7f7144102800 2024-08-31T06:24:37.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.907+0000 7f713a7fc640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71300b4d20 0x7f71300b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:37.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.907+0000 7f7148a81640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71300b4d20 0x7f71300b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:37.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.907+0000 7f713a7fc640 1 -- 172.21.15.53:0/2251213113 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f7140106090 con 0x7f7144102800 2024-08-31T06:24:37.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.908+0000 7f7148a81640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71300b4d20 0x7f71300b7230 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7144100910 tx=0x7f7134005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:37.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:37.910+0000 7f713a7fc640 1 -- 172.21.15.53:0/2251213113 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f71400cce60 con 0x7f7144102800 2024-08-31T06:24:37.944 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:37.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:37 smithi053 ceph-mon[18924]: pgmap v941: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-08-31T06:24:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:37 smithi130 ceph-mon[22266]: pgmap v941: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-08-31T06:24:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.137+0000 7f714b4e6640 1 -- 172.21.15.53:0/2251213113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f714419b250 con 0x7f7144102800 2024-08-31T06:24:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.137+0000 7f713a7fc640 1 -- 172.21.15.53:0/2251213113 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+11986 (secure 0 0 0) 0x7f714419b250 con 0x7f7144102800 2024-08-31T06:24:38.141 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:24:38.141 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":67,"btime":"2024-08-31T06:24:28:783691+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":67,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:24:28.755753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:24:38.142 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 67 2024-08-31T06:24:38.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.140+0000 7f714b4e6640 1 -- 172.21.15.53:0/2251213113 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71300b4d20 msgr2=0x7f71300b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:38.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.140+0000 7f714b4e6640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71300b4d20 0x7f71300b7230 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7144100910 tx=0x7f7134005e50 comp rx=0 tx=0).stop 2024-08-31T06:24:38.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.140+0000 7f714b4e6640 1 -- 172.21.15.53:0/2251213113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7144102800 msgr2=0x7f714419a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.140+0000 7f714b4e6640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7144102800 0x7f714419a120 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f7140009230 tx=0x7f7140004270 comp rx=0 tx=0).stop 2024-08-31T06:24:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.140+0000 7f714b4e6640 1 -- 172.21.15.53:0/2251213113 shutdown_connections 2024-08-31T06:24:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.140+0000 7f714b4e6640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71300b4d20 0x7f71300b7230 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.140+0000 7f714b4e6640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7144108a90 0x7f714419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.140+0000 7f714b4e6640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7144108140 0x7f714419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.140+0000 7f714b4e6640 1 --2- 172.21.15.53:0/2251213113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7144102800 0x7f714419a120 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.141+0000 7f714b4e6640 1 -- 172.21.15.53:0/2251213113 >> 172.21.15.53:0/2251213113 conn(0x7f71440794d0 msgr2=0x7f71441018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.141+0000 7f714b4e6640 1 -- 172.21.15.53:0/2251213113 shutdown_connections 2024-08-31T06:24:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:38.141+0000 7f714b4e6640 1 -- 172.21.15.53:0/2251213113 wait complete. 2024-08-31T06:24:38.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:37 smithi153 ceph-mon[22320]: pgmap v941: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-08-31T06:24:38.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.21 MB/sec execute 266 sec latency 30561.367 ms 2024-08-31T06:24:38.887 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:38 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2251213113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:24:38.922 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id c6ca39cb --release --await' 2024-08-31T06:24:38.922 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id c6ca39cb --release --await 2024-08-31T06:24:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.106+0000 7f00a63a2640 1 -- 172.21.15.53:0/3926022226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a010fec0 msgr2=0x7f00a01122e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.106+0000 7f00a63a2640 1 --2- 172.21.15.53:0/3926022226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a010fec0 0x7f00a01122e0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f0098009ca0 tx=0x7f009802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:24:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.106+0000 7f00a63a2640 1 -- 172.21.15.53:0/3926022226 shutdown_connections 2024-08-31T06:24:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.106+0000 7f00a63a2640 1 --2- 172.21.15.53:0/3926022226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a010fec0 0x7f00a01122e0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.106+0000 7f00a63a2640 1 --2- 172.21.15.53:0/3926022226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a0075ea0 0x7f00a010f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.106+0000 7f00a63a2640 1 --2- 172.21.15.53:0/3926022226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a0075550 0x7f00a0075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.106+0000 7f00a63a2640 1 -- 172.21.15.53:0/3926022226 >> 172.21.15.53:0/3926022226 conn(0x7f00a007b6b0 msgr2=0x7f00a007bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.106+0000 7f00a63a2640 1 -- 172.21.15.53:0/3926022226 shutdown_connections 2024-08-31T06:24:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.106+0000 7f00a63a2640 1 -- 172.21.15.53:0/3926022226 wait complete. 2024-08-31T06:24:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.107+0000 7f00a63a2640 1 Processor -- start 2024-08-31T06:24:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.107+0000 7f00a63a2640 1 -- start start 2024-08-31T06:24:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.107+0000 7f00a63a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a0075550 0x7f00a019c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.107+0000 7f00a63a2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a0075ea0 0x7f00a019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.107+0000 7f00a63a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a010fec0 0x7f00a01a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f00a63a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0115930 con 0x7f00a0075550 2024-08-31T06:24:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f00a63a2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f00a01157b0 con 0x7f00a0075ea0 2024-08-31T06:24:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f00a63a2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0115ab0 con 0x7f00a010fec0 2024-08-31T06:24:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a0075550 0x7f00a019c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a0075550 0x7f00a019c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38686/0 (socket says 172.21.15.53:38686) 2024-08-31T06:24:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009ffff640 1 -- 172.21.15.53:0/3720202548 learned_addr learned my addr 172.21.15.53:0/3720202548 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:39.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009f7fe640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a0075ea0 0x7f00a019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:39.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f00a493f640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a010fec0 0x7f00a01a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:39.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009ffff640 1 -- 172.21.15.53:0/3720202548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a010fec0 msgr2=0x7f00a01a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:39.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009ffff640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a010fec0 0x7f00a01a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:39.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009ffff640 1 -- 172.21.15.53:0/3720202548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a0075ea0 msgr2=0x7f00a019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:39.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009ffff640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a0075ea0 0x7f00a019c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:39.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009ffff640 1 -- 172.21.15.53:0/3720202548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a01a2250 con 0x7f00a0075550 2024-08-31T06:24:39.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009ffff640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a0075550 0x7f00a019c2e0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f009000c890 tx=0x7f009000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:39.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009d7fa640 1 -- 172.21.15.53:0/3720202548 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090004220 con 0x7f00a0075550 2024-08-31T06:24:39.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f00a63a2640 1 -- 172.21.15.53:0/3720202548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a01a2540 con 0x7f00a0075550 2024-08-31T06:24:39.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.108+0000 7f009d7fa640 1 -- 172.21.15.53:0/3720202548 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0090007e40 con 0x7f00a0075550 2024-08-31T06:24:39.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.109+0000 7f009d7fa640 1 -- 172.21.15.53:0/3720202548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090004a00 con 0x7f00a0075550 2024-08-31T06:24:39.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.109+0000 7f00a63a2640 1 -- 172.21.15.53:0/3720202548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a01a8ca0 con 0x7f00a0075550 2024-08-31T06:24:39.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.110+0000 7f00a63a2640 1 -- 172.21.15.53:0/3720202548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a0075960 con 0x7f00a0075550 2024-08-31T06:24:39.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.112+0000 7f009d7fa640 1 -- 172.21.15.53:0/3720202548 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f00900079b0 con 0x7f00a0075550 2024-08-31T06:24:39.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.113+0000 7f009d7fa640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00880b4ca0 0x7f00880b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:39.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.113+0000 7f009f7fe640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00880b4ca0 0x7f00880b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:39.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.113+0000 7f009d7fa640 1 -- 172.21.15.53:0/3720202548 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f00900e5310 con 0x7f00a0075550 2024-08-31T06:24:39.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.114+0000 7f009f7fe640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00880b4ca0 0x7f00880b71b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f00a0111be0 tx=0x7f009400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:39.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.121+0000 7f009d7fa640 1 -- 172.21.15.53:0/3720202548 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0090014030 con 0x7f00a0075550 2024-08-31T06:24:39.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:38 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2251213113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:24:39.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:38 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2251213113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:24:39.243 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:39.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.362+0000 7f00a63a2640 1 -- 172.21.15.53:0/3720202548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00a019d410 con 0x7f00a0075550 2024-08-31T06:24:39.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.363+0000 7f009d7fa640 1 -- 172.21.15.53:0/3720202548 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+11986 (secure 0 0 0) 0x7f00900ac080 con 0x7f00a0075550 2024-08-31T06:24:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:24:39.365 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":67,"btime":"2024-08-31T06:24:28:783691+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":67,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:24:28.755753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:24:39.365 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 67 2024-08-31T06:24:39.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.366+0000 7f00a63a2640 1 -- 172.21.15.53:0/3720202548 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00880b4ca0 msgr2=0x7f00880b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:39.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.366+0000 7f00a63a2640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00880b4ca0 0x7f00880b71b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f00a0111be0 tx=0x7f009400a2d0 comp rx=0 tx=0).stop 2024-08-31T06:24:39.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.366+0000 7f00a63a2640 1 -- 172.21.15.53:0/3720202548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a0075550 msgr2=0x7f00a019c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:39.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.366+0000 7f00a63a2640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a0075550 0x7f00a019c2e0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f009000c890 tx=0x7f009000cd50 comp rx=0 tx=0).stop 2024-08-31T06:24:39.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.367+0000 7f00a63a2640 1 -- 172.21.15.53:0/3720202548 shutdown_connections 2024-08-31T06:24:39.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.367+0000 7f00a63a2640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f00880b4ca0 0x7f00880b71b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:39.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.367+0000 7f00a63a2640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a010fec0 0x7f00a01a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:39.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.367+0000 7f00a63a2640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00a0075ea0 0x7f00a019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:39.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.367+0000 7f00a63a2640 1 --2- 172.21.15.53:0/3720202548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a0075550 0x7f00a019c2e0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:39.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.367+0000 7f00a63a2640 1 -- 172.21.15.53:0/3720202548 >> 172.21.15.53:0/3720202548 conn(0x7f00a007b6b0 msgr2=0x7f00a0109a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:39.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.367+0000 7f00a63a2640 1 -- 172.21.15.53:0/3720202548 shutdown_connections 2024-08-31T06:24:39.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:39.367+0000 7f00a63a2640 1 -- 172.21.15.53:0/3720202548 wait complete. 2024-08-31T06:24:39.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.19 MB/sec execute 267 sec latency 31561.417 ms 2024-08-31T06:24:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:39 smithi130 ceph-mon[22266]: pgmap v942: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-31T06:24:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:39 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3720202548' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:24:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:39 smithi153 ceph-mon[22320]: pgmap v942: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-31T06:24:40.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:39 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3720202548' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:24:40.219 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:39 smithi053 ceph-mon[18924]: pgmap v942: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-31T06:24:40.219 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:39 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3720202548' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:24:40.251 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:24:40.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 39912 5.17 MB/sec execute 268 sec latency 32561.458 ms 2024-08-31T06:24:40.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.458+0000 7f606a951640 1 -- 172.21.15.53:0/1992608171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6064103930 msgr2=0x7f6064103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.458+0000 7f606a951640 1 --2- 172.21.15.53:0/1992608171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6064103930 0x7f6064103d40 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f6054009900 tx=0x7f605402a410 comp rx=0 tx=0).stop 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.458+0000 7f606a951640 1 -- 172.21.15.53:0/1992608171 shutdown_connections 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.458+0000 7f606a951640 1 --2- 172.21.15.53:0/1992608171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6064109bc0 0x7f60641103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.458+0000 7f606a951640 1 --2- 172.21.15.53:0/1992608171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6064109270 0x7f6064109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.458+0000 7f606a951640 1 --2- 172.21.15.53:0/1992608171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6064103930 0x7f6064103d40 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.458+0000 7f606a951640 1 -- 172.21.15.53:0/1992608171 >> 172.21.15.53:0/1992608171 conn(0x7f60640ff3c0 msgr2=0x7f6064101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.458+0000 7f606a951640 1 -- 172.21.15.53:0/1992608171 shutdown_connections 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.458+0000 7f606a951640 1 -- 172.21.15.53:0/1992608171 wait complete. 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.459+0000 7f606a951640 1 Processor -- start 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.459+0000 7f606a951640 1 -- start start 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.459+0000 7f606a951640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6064103930 0x7f606419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.459+0000 7f606a951640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6064109270 0x7f606419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.459+0000 7f606a951640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6064109bc0 0x7f606419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.459+0000 7f606a951640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6064113730 con 0x7f6064103930 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.459+0000 7f606a951640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f60641135b0 con 0x7f6064109bc0 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.459+0000 7f606a951640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60641138b0 con 0x7f6064109270 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f6063fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6064103930 0x7f606419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f6063fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6064103930 0x7f606419a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38700/0 (socket says 172.21.15.53:38700) 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f6063fff640 1 -- 172.21.15.53:0/2817459604 learned_addr learned my addr 172.21.15.53:0/2817459604 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f6068eee640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6064109bc0 0x7f606419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f60637fe640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6064109270 0x7f606419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f6063fff640 1 -- 172.21.15.53:0/2817459604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6064109270 msgr2=0x7f606419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f6063fff640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6064109270 0x7f606419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f6063fff640 1 -- 172.21.15.53:0/2817459604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6064109bc0 msgr2=0x7f606419f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f6063fff640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6064109bc0 0x7f606419f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f6063fff640 1 -- 172.21.15.53:0/2817459604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60641a0050 con 0x7f6064103930 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f6068eee640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6064109bc0 0x7f606419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f6063fff640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6064103930 0x7f606419a1a0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f6054009230 tx=0x7f6054004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f60617fa640 1 -- 172.21.15.53:0/2817459604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605403f030 con 0x7f6064103930 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f60617fa640 1 -- 172.21.15.53:0/2817459604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6054003a80 con 0x7f6064103930 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f606a951640 1 -- 172.21.15.53:0/2817459604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60641a02e0 con 0x7f6064103930 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f60617fa640 1 -- 172.21.15.53:0/2817459604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054035070 con 0x7f6064103930 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.460+0000 7f606a951640 1 -- 172.21.15.53:0/2817459604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60641a07c0 con 0x7f6064103930 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.463+0000 7f60617fa640 1 -- 172.21.15.53:0/2817459604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6054042030 con 0x7f6064103930 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.463+0000 7f6070ec6740 1 Processor -- start 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.463+0000 7f6070ec6740 1 -- start start 2024-08-31T06:24:40.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.463+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a400520 0x56115a7a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.463+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.463+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3df840 0x56115a7a6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.463+0000 7f6070ec6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56115a71ca70 con 0x56115a400520 2024-08-31T06:24:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.463+0000 7f6070ec6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56115a70c000 con 0x56115a3df840 2024-08-31T06:24:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.463+0000 7f6070ec6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56115a70ffb0 con 0x56115a3d7660 2024-08-31T06:24:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f6068eee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a400520 0x56115a7a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f6068eee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a400520 0x56115a7a5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38716/0 (socket says 172.21.15.53:38716) 2024-08-31T06:24:40.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f6068eee640 1 -- 172.21.15.53:0/980665186 learned_addr learned my addr 172.21.15.53:0/980665186 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f60617fa640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f604c0b4cd0 0x7f604c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f60637fe640 1 --2- 172.21.15.53:0/980665186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3df840 0x56115a7a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f6068eee640 1 -- 172.21.15.53:0/980665186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 msgr2=0x56115a7a61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f6068eee640 1 --2- 172.21.15.53:0/980665186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f6068eee640 1 -- 172.21.15.53:0/980665186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3df840 msgr2=0x56115a7a6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f6068eee640 1 --2- 172.21.15.53:0/980665186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3df840 0x56115a7a6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f6068eee640 1 -- 172.21.15.53:0/980665186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56115a46bb00 con 0x56115a400520 2024-08-31T06:24:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f60637fe640 1 --2- 172.21.15.53:0/980665186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3df840 0x56115a7a6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f60617fa640 1 -- 172.21.15.53:0/2817459604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f6054105e20 con 0x7f6064103930 2024-08-31T06:24:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f6068eee640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f604c0b4cd0 0x7f604c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f6068eee640 1 --2- 172.21.15.53:0/980665186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a400520 0x56115a7a5c80 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f605c00e450 tx=0x7f605c00e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204ebd0c21806de8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f604a7fc640 1 -- 172.21.15.53:0/980665186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c020070 con 0x56115a400520 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f604a7fc640 1 -- 172.21.15.53:0/980665186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f605c01ad50 con 0x56115a400520 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.464+0000 7f604a7fc640 1 -- 172.21.15.53:0/980665186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c019e30 con 0x56115a400520 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.465+0000 7f6070ec6740 1 -- 172.21.15.53:0/980665186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a400520 msgr2=0x56115a7a5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.465+0000 7f6068eee640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f604c0b4cd0 0x7f604c0b71e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f605c01d000 tx=0x7f605c01e000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.465+0000 7f6070ec6740 1 --2- 172.21.15.53:0/980665186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a400520 0x56115a7a5c80 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f605c00e450 tx=0x7f605c00e910 comp rx=0 tx=0).stop 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.465+0000 7f6070ec6740 1 -- 172.21.15.53:0/980665186 shutdown_connections 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.465+0000 7f6070ec6740 1 --2- 172.21.15.53:0/980665186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3df840 0x56115a7a6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.465+0000 7f6070ec6740 1 --2- 172.21.15.53:0/980665186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7a61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.465+0000 7f6070ec6740 1 --2- 172.21.15.53:0/980665186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a400520 0x56115a7a5c80 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.465+0000 7f6070ec6740 1 -- 172.21.15.53:0/980665186 >> 172.21.15.53:0/980665186 conn(0x56115a3f4910 msgr2=0x56115a7a3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.465+0000 7f6070ec6740 1 -- 172.21.15.53:0/980665186 shutdown_connections 2024-08-31T06:24:40.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.466+0000 7f6070ec6740 1 -- 172.21.15.53:0/980665186 wait complete. 2024-08-31T06:24:40.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.466+0000 7f6070ec6740 1 -- start start 2024-08-31T06:24:40.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.466+0000 7f6070ec6740 1 Processor -- start 2024-08-31T06:24:40.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.467+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3d7660 0x56115a7b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.467+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3df840 0x56115a7b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.467+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a400520 0x56115a7c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.467+0000 7f6070ec6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56115a7b87c0 con 0x56115a3df840 2024-08-31T06:24:40.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.467+0000 7f60637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3df840 0x56115a7b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.467+0000 7f6070ec6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56115a6cd520 con 0x56115a3d7660 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.467+0000 7f60637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3df840 0x56115a7b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38720/0 (socket says 172.21.15.53:38720) 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.467+0000 7f6063fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3d7660 0x56115a7b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.467+0000 7f60637fe640 1 -- 172.21.15.53:0/3218868304 learned_addr learned my addr 172.21.15.53:0/3218868304 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.467+0000 7f6070ec6740 1 -- 172.21.15.53:0/3218868304 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56115a7b8940 con 0x56115a400520 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.468+0000 7f6070ec6740 10 client.0 _ll_register_callbacks cb 0x56115a705c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.468+0000 7f6068eee640 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a400520 0x56115a7c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.468+0000 7f60637fe640 1 -- 172.21.15.53:0/3218868304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a400520 msgr2=0x56115a7c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.468+0000 7f60637fe640 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a400520 0x56115a7c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.468+0000 7f60637fe640 1 -- 172.21.15.53:0/3218868304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3d7660 msgr2=0x56115a7b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.468+0000 7f60637fe640 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3d7660 0x56115a7b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.468+0000 7f60637fe640 1 -- 172.21.15.53:0/3218868304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56115a4e2960 con 0x56115a3df840 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.468+0000 7f6068eee640 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a400520 0x56115a7c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:24:40.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.468+0000 7f6063fff640 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3d7660 0x56115a7b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.469+0000 7f60637fe640 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3df840 0x56115a7b61a0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f60580106d0 tx=0x7f6058010b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42a33e92cc60258 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.469+0000 7f60437fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.469+0000 7f60437fe640 1 -- 172.21.15.53:0/3218868304 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605800e8d0 con 0x56115a3df840 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.469+0000 7f60437fe640 1 -- 172.21.15.53:0/3218868304 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f605800ea70 con 0x56115a3df840 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.469+0000 7f6070ec6740 1 -- 172.21.15.53:0/3218868304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56115a6ab9a0 con 0x56115a3df840 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.469+0000 7f60437fe640 1 -- 172.21.15.53:0/3218868304 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f605800ec70 con 0x56115a3df840 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.469+0000 7f6070ec6740 10 client.21507 fetch_fsmap learned FSMap version 67 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.469+0000 7f6070ec6740 1 -- 172.21.15.53:0/3218868304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x56115a7c49c0 con 0x56115a3df840 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.470+0000 7f60437fe640 1 -- 172.21.15.53:0/3218868304 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56115a6ab9a0 con 0x56115a3df840 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.470+0000 7f60437fe640 1 -- 172.21.15.53:0/3218868304 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 67) ==== 8366+0+0 (secure 0 0 0) 0x7f605800f040 con 0x56115a3df840 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.470+0000 7f6070ec6740 10 client.21507 fetch_fsmap finished waiting for FSMap version 67 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.470+0000 7f6070ec6740 10 client.21507 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:24:40.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.470+0000 7f6070ec6740 20 client.21507 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.470+0000 7f6070ec6740 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56115a3beea0 0x56115a7c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.470+0000 7f6070ec6740 4 client.21507 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.470+0000 7f6070ec6740 1 -- 172.21.15.53:0/3218868304 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56115a71e9c0 con 0x56115a3beea0 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.470+0000 7f6063fff640 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56115a3beea0 0x56115a7c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.471+0000 7f6063fff640 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56115a3beea0 0x56115a7c82d0 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6d44c257c57fc11 server_cookie=da377a60f7ac735d in_seq=0 out_seq=0 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.471+0000 7f60437fe640 10 client.21507 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f60437fe640 1 -- 172.21.15.53:0/3218868304 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56115a71e9c0 con 0x56115a3beea0 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f60437fe640 10 client.21507 handle_command_reply: tid=0 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 1 client.21507 shutdown 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 1 -- 172.21.15.53:0/3218868304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3df840 msgr2=0x56115a7b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3df840 0x56115a7b61a0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f60580106d0 tx=0x7f6058010b90 comp rx=0 tx=0).stop 2024-08-31T06:24:40.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 1 -- 172.21.15.53:0/3218868304 shutdown_connections 2024-08-31T06:24:40.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56115a3beea0 0x56115a7c82d0 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a400520 0x56115a7c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f60437fe640 0 client.21507 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:40.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3df840 0x56115a7b61a0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 1 --2- 172.21.15.53:0/3218868304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3d7660 0x56115a7b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 1 -- 172.21.15.53:0/3218868304 >> 172.21.15.53:0/3218868304 conn(0x56115a3f4910 msgr2=0x56115a7a2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:40.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 1 -- 172.21.15.53:0/3218868304 shutdown_connections 2024-08-31T06:24:40.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 1 -- 172.21.15.53:0/3218868304 wait complete. 2024-08-31T06:24:40.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.472+0000 7f6070ec6740 20 client.21507 trim_cache size 0 max 16384 2024-08-31T06:24:40.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.491+0000 7f6070ec6740 1 Processor -- start 2024-08-31T06:24:40.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.491+0000 7f6070ec6740 1 -- start start 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.491+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3f4910 0x56115a7b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.491+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3beea0 0x56115a7b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.491+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7a2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6070ec6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f60641ad220 con 0x56115a3f4910 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6070ec6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f60641aed90 con 0x56115a3beea0 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6063fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3f4910 0x56115a7b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6063fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3f4910 0x56115a7b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38722/0 (socket says 172.21.15.53:38722) 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6070ec6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60641ad920 con 0x56115a3d7660 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6063fff640 1 -- 172.21.15.53:0/3550942795 learned_addr learned my addr 172.21.15.53:0/3550942795 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6068eee640 1 --2- 172.21.15.53:0/3550942795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6063fff640 1 -- 172.21.15.53:0/3550942795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 msgr2=0x56115a7a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6063fff640 1 --2- 172.21.15.53:0/3550942795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6063fff640 1 -- 172.21.15.53:0/3550942795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3beea0 msgr2=0x56115a7b4820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:24:40.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6063fff640 1 --2- 172.21.15.53:0/3550942795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3beea0 0x56115a7b4820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6063fff640 1 -- 172.21.15.53:0/3550942795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56115a7b6340 con 0x56115a3f4910 2024-08-31T06:24:40.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6063fff640 1 --2- 172.21.15.53:0/3550942795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3f4910 0x56115a7b42e0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f6054103b50 tx=0x7f6054105040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b8128520b10db8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:40.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.492+0000 7f6049ffb640 1 -- 172.21.15.53:0/3550942795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054049040 con 0x56115a3f4910 2024-08-31T06:24:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.493+0000 7f6049ffb640 1 -- 172.21.15.53:0/3550942795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60540cc4f0 con 0x56115a3f4910 2024-08-31T06:24:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.493+0000 7f6049ffb640 1 -- 172.21.15.53:0/3550942795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60541037d0 con 0x56115a3f4910 2024-08-31T06:24:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.493+0000 7f6070ec6740 1 -- 172.21.15.53:0/3550942795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3f4910 msgr2=0x56115a7b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.493+0000 7f6070ec6740 1 --2- 172.21.15.53:0/3550942795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3f4910 0x56115a7b42e0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f6054103b50 tx=0x7f6054105040 comp rx=0 tx=0).stop 2024-08-31T06:24:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.493+0000 7f6070ec6740 1 -- 172.21.15.53:0/3550942795 shutdown_connections 2024-08-31T06:24:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.493+0000 7f6070ec6740 1 --2- 172.21.15.53:0/3550942795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.493+0000 7f6070ec6740 1 --2- 172.21.15.53:0/3550942795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3beea0 0x56115a7b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.493+0000 7f6070ec6740 1 --2- 172.21.15.53:0/3550942795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3f4910 0x56115a7b42e0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.493+0000 7f6070ec6740 1 -- 172.21.15.53:0/3550942795 >> 172.21.15.53:0/3550942795 conn(0x56115a79ed50 msgr2=0x56115a7a3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.494+0000 7f6070ec6740 1 -- 172.21.15.53:0/3550942795 shutdown_connections 2024-08-31T06:24:40.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.494+0000 7f6070ec6740 1 -- 172.21.15.53:0/3550942795 wait complete. 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.494+0000 7f6070ec6740 1 -- start start 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.494+0000 7f6070ec6740 1 Processor -- start 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3beea0 0x56115a7bdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7be460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6070ec6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3f4910 0x56115a7b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6070ec6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f60641ae6c0 con 0x56115a3beea0 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6070ec6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f60641adff0 con 0x56115a3f4910 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6070ec6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f60641ab220 con 0x56115a3d7660 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6063fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3beea0 0x56115a7bdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6063fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3beea0 0x56115a7bdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38726/0 (socket says 172.21.15.53:38726) 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6063fff640 1 -- 172.21.15.53:0/516163006 learned_addr learned my addr 172.21.15.53:0/516163006 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6070ec6740 10 client.0 _ll_register_callbacks cb 0x7f6058005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:40.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f60637fe640 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7be460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6063fff640 1 -- 172.21.15.53:0/516163006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 msgr2=0x56115a7be460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6068eee640 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3f4910 0x56115a7b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6063fff640 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7be460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6063fff640 1 -- 172.21.15.53:0/516163006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3f4910 msgr2=0x56115a7b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6063fff640 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3f4910 0x56115a7b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6063fff640 1 -- 172.21.15.53:0/516163006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56115a7b9350 con 0x56115a3beea0 2024-08-31T06:24:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f60637fe640 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7be460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f6063fff640 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3beea0 0x56115a7bdea0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f6054103600 tx=0x7f60540d5810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac67eedf0549e77f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.495+0000 7f60437fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f60437fe640 1 -- 172.21.15.53:0/516163006 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60540b2070 con 0x56115a3beea0 2024-08-31T06:24:40.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f60437fe640 1 -- 172.21.15.53:0/516163006 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f60540f31c0 con 0x56115a3beea0 2024-08-31T06:24:40.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f6070ec6740 1 -- 172.21.15.53:0/516163006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60540cc4f0 con 0x56115a3beea0 2024-08-31T06:24:40.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f60437fe640 1 -- 172.21.15.53:0/516163006 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f6054049040 con 0x56115a3beea0 2024-08-31T06:24:40.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f6070ec6740 10 client.21513 fetch_fsmap learned FSMap version 67 2024-08-31T06:24:40.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f6070ec6740 1 -- 172.21.15.53:0/516163006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x56115a7ac240 con 0x56115a3beea0 2024-08-31T06:24:40.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f60437fe640 1 -- 172.21.15.53:0/516163006 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60540cc4f0 con 0x56115a3beea0 2024-08-31T06:24:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f60437fe640 1 -- 172.21.15.53:0/516163006 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 67) ==== 8366+0+0 (secure 0 0 0) 0x7f60540ef0b0 con 0x56115a3beea0 2024-08-31T06:24:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f6070ec6740 10 client.21513 fetch_fsmap finished waiting for FSMap version 67 2024-08-31T06:24:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f6070ec6740 10 client.21513 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:24:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f6070ec6740 20 client.21513 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f6070ec6740 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56115a3df840 0x56115a7ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f6070ec6740 4 client.21513 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c6ca39cb", "release": true, "await": true}] 2024-08-31T06:24:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.496+0000 7f6070ec6740 1 -- 172.21.15.53:0/516163006 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c6ca39cb", "release": true, "await": true}) -- 0x56115a71a460 con 0x56115a3df840 2024-08-31T06:24:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.497+0000 7f60637fe640 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56115a3df840 0x56115a7ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.500+0000 7f60637fe640 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56115a3df840 0x56115a7ae9c0 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ce62f62c4c9cb53 server_cookie=6310063e55d535c7 in_seq=0 out_seq=0 2024-08-31T06:24:40.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.500+0000 7f60437fe640 10 client.21513 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:40.540 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.539+0000 7f60437fe640 1 -- 172.21.15.53:0/516163006 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56115a71a460 con 0x56115a3df840 2024-08-31T06:24:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.539+0000 7f60437fe640 10 client.21513 handle_command_reply: tid=0 2024-08-31T06:24:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.539+0000 7f6070ec6740 1 client.21513 shutdown 2024-08-31T06:24:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.539+0000 7f6070ec6740 1 -- 172.21.15.53:0/516163006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3beea0 msgr2=0x56115a7bdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.539+0000 7f6070ec6740 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3beea0 0x56115a7bdea0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f6054103600 tx=0x7f60540d5810 comp rx=0 tx=0).stop 2024-08-31T06:24:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.540+0000 7f6070ec6740 1 -- 172.21.15.53:0/516163006 shutdown_connections 2024-08-31T06:24:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.540+0000 7f6070ec6740 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56115a3df840 0x56115a7ae9c0 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.540+0000 7f6070ec6740 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56115a3f4910 0x56115a7b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.540+0000 7f6070ec6740 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56115a3d7660 0x56115a7be460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.540+0000 7f6070ec6740 1 --2- 172.21.15.53:0/516163006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56115a3beea0 0x56115a7bdea0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.540+0000 7f60437fe640 0 client.21513 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.540+0000 7f6070ec6740 1 -- 172.21.15.53:0/516163006 >> 172.21.15.53:0/516163006 conn(0x56115a79ed50 msgr2=0x56115a7b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.540+0000 7f6070ec6740 1 -- 172.21.15.53:0/516163006 shutdown_connections 2024-08-31T06:24:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.540+0000 7f6070ec6740 1 -- 172.21.15.53:0/516163006 wait complete. 2024-08-31T06:24:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.540+0000 7f6070ec6740 20 client.21513 trim_cache size 0 max 16384 2024-08-31T06:24:40.544 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 67, 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 64, 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "c6ca39cb": { 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 64, 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:24:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 152.8, 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:40.546 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:24:40.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 -- 172.21.15.53:0/2817459604 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f604c0b4cd0 msgr2=0x7f604c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:40.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f604c0b4cd0 0x7f604c0b71e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f605c01d000 tx=0x7f605c01e000 comp rx=0 tx=0).stop 2024-08-31T06:24:40.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 -- 172.21.15.53:0/2817459604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6064103930 msgr2=0x7f606419a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:40.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6064103930 0x7f606419a1a0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f6054009230 tx=0x7f6054004270 comp rx=0 tx=0).stop 2024-08-31T06:24:40.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 -- 172.21.15.53:0/2817459604 shutdown_connections 2024-08-31T06:24:40.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f604c0b4cd0 0x7f604c0b71e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6064109bc0 0x7f606419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6064109270 0x7f606419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 --2- 172.21.15.53:0/2817459604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6064103930 0x7f606419a1a0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:40.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 -- 172.21.15.53:0/2817459604 >> 172.21.15.53:0/2817459604 conn(0x7f60640ff3c0 msgr2=0x7f60641017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:40.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 -- 172.21.15.53:0/2817459604 shutdown_connections 2024-08-31T06:24:40.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:40.541+0000 7f606a951640 1 -- 172.21.15.53:0/2817459604 wait complete. 2024-08-31T06:24:41.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.319+0000 7fb92f9a4640 1 -- 172.21.15.53:0/1375782018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb928077120 msgr2=0x7fb928075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:41.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.319+0000 7fb92f9a4640 1 --2- 172.21.15.53:0/1375782018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb928077120 0x7fb928075550 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fb918009ca0 tx=0x7fb91802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.319+0000 7fb92f9a4640 1 -- 172.21.15.53:0/1375782018 shutdown_connections 2024-08-31T06:24:41.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.319+0000 7fb92f9a4640 1 --2- 172.21.15.53:0/1375782018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb928114200 0x7fb9281166d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.319+0000 7fb92f9a4640 1 --2- 172.21.15.53:0/1375782018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb928075b70 0x7fb928075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.319+0000 7fb92f9a4640 1 --2- 172.21.15.53:0/1375782018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb928077120 0x7fb928075550 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.319+0000 7fb92f9a4640 1 -- 172.21.15.53:0/1375782018 >> 172.21.15.53:0/1375782018 conn(0x7fb9280ff380 msgr2=0x7fb9281017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:41.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.319+0000 7fb92f9a4640 1 -- 172.21.15.53:0/1375782018 shutdown_connections 2024-08-31T06:24:41.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.319+0000 7fb92f9a4640 1 -- 172.21.15.53:0/1375782018 wait complete. 2024-08-31T06:24:41.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.320+0000 7fb92f9a4640 1 Processor -- start 2024-08-31T06:24:41.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.320+0000 7fb92f9a4640 1 -- start start 2024-08-31T06:24:41.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.321+0000 7fb92f9a4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb928075b70 0x7fb9281a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.321+0000 7fb92f9a4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb928077120 0x7fb9281a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.321+0000 7fb92f9a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb928114200 0x7fb9281a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.321+0000 7fb92f9a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb928119d40 con 0x7fb928114200 2024-08-31T06:24:41.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.321+0000 7fb92f9a4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb928119bc0 con 0x7fb928075b70 2024-08-31T06:24:41.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.321+0000 7fb92f9a4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb928119ec0 con 0x7fb928077120 2024-08-31T06:24:41.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.321+0000 7fb92cf3f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb928077120 0x7fb9281a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.321+0000 7fb92cf3f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb928077120 0x7fb9281a0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46870/0 (socket says 172.21.15.53:46870) 2024-08-31T06:24:41.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.321+0000 7fb92cf3f640 1 -- 172.21.15.53:0/864466314 learned_addr learned my addr 172.21.15.53:0/864466314 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:41.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.321+0000 7fb92d740640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb928075b70 0x7fb9281a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.321+0000 7fb92df41640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb928114200 0x7fb9281a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.322+0000 7fb92cf3f640 1 -- 172.21.15.53:0/864466314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb928075b70 msgr2=0x7fb9281a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:41.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.322+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb928075b70 0x7fb9281a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.322+0000 7fb92cf3f640 1 -- 172.21.15.53:0/864466314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb928114200 msgr2=0x7fb9281a5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:41.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.322+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb928114200 0x7fb9281a5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.322+0000 7fb92cf3f640 1 -- 172.21.15.53:0/864466314 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9281a6660 con 0x7fb928077120 2024-08-31T06:24:41.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.322+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb928077120 0x7fb9281a0c90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00d770 tx=0x7fb91c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:41.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.322+0000 7fb92df41640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb928114200 0x7fb9281a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:41.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.322+0000 7fb9267fc640 1 -- 172.21.15.53:0/864466314 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c017070 con 0x7fb928077120 2024-08-31T06:24:41.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.323+0000 7fb9267fc640 1 -- 172.21.15.53:0/864466314 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb91c009c30 con 0x7fb928077120 2024-08-31T06:24:41.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.323+0000 7fb9267fc640 1 -- 172.21.15.53:0/864466314 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c00f620 con 0x7fb928077120 2024-08-31T06:24:41.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.323+0000 7fb92f9a4640 1 -- 172.21.15.53:0/864466314 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9281a6950 con 0x7fb928077120 2024-08-31T06:24:41.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.323+0000 7fb92f9a4640 1 -- 172.21.15.53:0/864466314 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9281ad0b0 con 0x7fb928077120 2024-08-31T06:24:41.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.327+0000 7fb935f19740 1 Processor -- start 2024-08-31T06:24:41.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.327+0000 7fb935f19740 1 -- start start 2024-08-31T06:24:41.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.328+0000 7fb935f19740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868437070 0x55f8687dc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.328+0000 7fb935f19740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 0x55f8687dc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.328+0000 7fb935f19740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 0x55f8687dcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.328+0000 7fb935f19740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f868753680 con 0x55f86840e1b0 2024-08-31T06:24:41.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.328+0000 7fb935f19740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f868742c10 con 0x55f868416390 2024-08-31T06:24:41.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.328+0000 7fb935f19740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f868746bc0 con 0x55f868437070 2024-08-31T06:24:41.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.328+0000 7fb92d740640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 0x55f8687dc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.328+0000 7fb92d740640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 0x55f8687dc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38758/0 (socket says 172.21.15.53:38758) 2024-08-31T06:24:41.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.328+0000 7fb92d740640 1 -- 172.21.15.53:0/246997341 learned_addr learned my addr 172.21.15.53:0/246997341 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:41.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.328+0000 7fb9267fc640 1 -- 172.21.15.53:0/864466314 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb91c01a070 con 0x7fb928077120 2024-08-31T06:24:41.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.329+0000 7fb92df41640 1 --2- 172.21.15.53:0/246997341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868437070 0x55f8687dc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.329+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/246997341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 0x55f8687dcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.330+0000 7fb92d740640 1 -- 172.21.15.53:0/246997341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868437070 msgr2=0x55f8687dc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:41.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.330+0000 7fb92d740640 1 --2- 172.21.15.53:0/246997341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868437070 0x55f8687dc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.330+0000 7fb92d740640 1 -- 172.21.15.53:0/246997341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 msgr2=0x55f8687dcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:41.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.330+0000 7fb9267fc640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb9100b4d50 0x7fb9100b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.330+0000 7fb92d740640 1 --2- 172.21.15.53:0/246997341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 0x55f8687dcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.330+0000 7fb9267fc640 1 -- 172.21.15.53:0/864466314 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7fb91c0e4b80 con 0x7fb928077120 2024-08-31T06:24:41.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.331+0000 7fb92d740640 1 -- 172.21.15.53:0/246997341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8684a2650 con 0x55f86840e1b0 2024-08-31T06:24:41.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.331+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/246997341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 0x55f8687dcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:41.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.331+0000 7fb92df41640 1 --2- 172.21.15.53:0/246997341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868437070 0x55f8687dc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:41.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.331+0000 7fb92d740640 1 --2- 172.21.15.53:0/246997341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 0x55f8687dc850 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fb918009ca0 tx=0x7fb918031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0e37a08e978be server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:41.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.331+0000 7fb92df41640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb9100b4d50 0x7fb9100b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.331+0000 7fb90f7fe640 1 -- 172.21.15.53:0/246997341 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918031980 con 0x55f86840e1b0 2024-08-31T06:24:41.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.332+0000 7fb90f7fe640 1 -- 172.21.15.53:0/246997341 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb918036030 con 0x55f86840e1b0 2024-08-31T06:24:41.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.332+0000 7fb90f7fe640 1 -- 172.21.15.53:0/246997341 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9180043c0 con 0x55f86840e1b0 2024-08-31T06:24:41.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.333+0000 7fb935f19740 1 -- 172.21.15.53:0/246997341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 msgr2=0x55f8687dc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:41.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.333+0000 7fb935f19740 1 --2- 172.21.15.53:0/246997341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 0x55f8687dc850 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fb918009ca0 tx=0x7fb918031450 comp rx=0 tx=0).stop 2024-08-31T06:24:41.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.333+0000 7fb92df41640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb9100b4d50 0x7fb9100b7260 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb920013570 tx=0x7fb920005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:41.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.333+0000 7fb935f19740 1 -- 172.21.15.53:0/246997341 shutdown_connections 2024-08-31T06:24:41.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.333+0000 7fb935f19740 1 --2- 172.21.15.53:0/246997341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 0x55f8687dcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.333+0000 7fb935f19740 1 --2- 172.21.15.53:0/246997341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 0x55f8687dc850 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.333+0000 7fb935f19740 1 --2- 172.21.15.53:0/246997341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868437070 0x55f8687dc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.333+0000 7fb935f19740 1 -- 172.21.15.53:0/246997341 >> 172.21.15.53:0/246997341 conn(0x55f86842b460 msgr2=0x55f8687da200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:41.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.333+0000 7fb935f19740 1 -- 172.21.15.53:0/246997341 shutdown_connections 2024-08-31T06:24:41.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.333+0000 7fb935f19740 1 -- 172.21.15.53:0/246997341 wait complete. 2024-08-31T06:24:41.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.333+0000 7fb935f19740 1 -- start start 2024-08-31T06:24:41.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.334+0000 7fb935f19740 1 Processor -- start 2024-08-31T06:24:41.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.334+0000 7fb935f19740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86840e1b0 0x55f8687e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.334+0000 7fb935f19740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 0x55f8687e8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.334+0000 7fb935f19740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868437070 0x55f8687f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.334+0000 7fb935f19740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f8685a5700 con 0x55f868437070 2024-08-31T06:24:41.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.334+0000 7fb935f19740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f8686c9750 con 0x55f868416390 2024-08-31T06:24:41.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.334+0000 7fb935f19740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f8687ea910 con 0x55f86840e1b0 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.334+0000 7fb935f19740 10 client.0 _ll_register_callbacks cb 0x55f8686f8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.334+0000 7fb92cf3f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 0x55f8687e8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.334+0000 7fb92df41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868437070 0x55f8687f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.334+0000 7fb92cf3f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 0x55f8687e8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:45978/0 (socket says 172.21.15.53:45978) 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.335+0000 7fb92cf3f640 1 -- 172.21.15.53:0/1346845041 learned_addr learned my addr 172.21.15.53:0/1346845041 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.335+0000 7fb92df41640 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868437070 0x55f8687f3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38762/0 (socket says 172.21.15.53:38762) 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.335+0000 7fb92d740640 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86840e1b0 0x55f8687e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.335+0000 7fb92df41640 1 -- 172.21.15.53:0/1346845041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86840e1b0 msgr2=0x55f8687e7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.335+0000 7fb92df41640 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86840e1b0 0x55f8687e7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.335+0000 7fb92df41640 1 -- 172.21.15.53:0/1346845041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 msgr2=0x55f8687e8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.335+0000 7fb92df41640 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 0x55f8687e8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.335+0000 7fb92df41640 1 -- 172.21.15.53:0/1346845041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f868702900 con 0x55f868437070 2024-08-31T06:24:41.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.335+0000 7fb92df41640 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868437070 0x55f8687f3c00 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fb920011ab0 tx=0x7fb9200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f376e7d03ce268 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:41.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.335+0000 7fb90cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:41.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.335+0000 7fb90cff9640 1 -- 172.21.15.53:0/1346845041 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92001ec50 con 0x55f868437070 2024-08-31T06:24:41.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb935f19740 1 -- 172.21.15.53:0/1346845041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb918036030 con 0x55f868437070 2024-08-31T06:24:41.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb90cff9640 1 -- 172.21.15.53:0/1346845041 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7fb92001edf0 con 0x55f868437070 2024-08-31T06:24:41.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb90cff9640 1 -- 172.21.15.53:0/1346845041 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fb920004020 con 0x55f868437070 2024-08-31T06:24:41.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb935f19740 10 client.21525 fetch_fsmap learned FSMap version 67 2024-08-31T06:24:41.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb935f19740 1 -- 172.21.15.53:0/1346845041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x55f8687f6730 con 0x55f868437070 2024-08-31T06:24:41.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb90cff9640 1 -- 172.21.15.53:0/1346845041 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb918036030 con 0x55f868437070 2024-08-31T06:24:41.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb90cff9640 1 -- 172.21.15.53:0/1346845041 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 67) ==== 8366+0+0 (secure 0 0 0) 0x7fb920031480 con 0x55f868437070 2024-08-31T06:24:41.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb935f19740 10 client.21525 fetch_fsmap finished waiting for FSMap version 67 2024-08-31T06:24:41.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb935f19740 10 client.21525 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:24:41.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb935f19740 20 client.21525 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:41.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb935f19740 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f8683f59f0 0x55f8687fa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb935f19740 4 client.21525 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:41.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.336+0000 7fb935f19740 1 -- 172.21.15.53:0/1346845041 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8687555d0 con 0x55f8683f59f0 2024-08-31T06:24:41.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.337+0000 7fb92d740640 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f8683f59f0 0x55f8687fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.337+0000 7fb90cff9640 10 client.21525 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:24:41.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.337+0000 7fb92d740640 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f8683f59f0 0x55f8687fa090 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=820dafb518e0ba44 server_cookie=1484e77470dbdbe0 in_seq=0 out_seq=0 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb90cff9640 1 -- 172.21.15.53:0/1346845041 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8687555d0 con 0x55f8683f59f0 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb90cff9640 10 client.21525 handle_command_reply: tid=0 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 1 client.21525 shutdown 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 1 -- 172.21.15.53:0/1346845041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868437070 msgr2=0x55f8687f3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868437070 0x55f8687f3c00 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fb920011ab0 tx=0x7fb9200046c0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 1 -- 172.21.15.53:0/1346845041 shutdown_connections 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868437070 0x55f8687f3c00 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868416390 0x55f8687e8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f8683f59f0 0x55f8687fa090 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 1 --2- 172.21.15.53:0/1346845041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86840e1b0 0x55f8687e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 1 -- 172.21.15.53:0/1346845041 >> 172.21.15.53:0/1346845041 conn(0x55f86842b460 msgr2=0x55f8687df4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb90cff9640 0 client.21525 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 1 -- 172.21.15.53:0/1346845041 shutdown_connections 2024-08-31T06:24:41.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 1 -- 172.21.15.53:0/1346845041 wait complete. 2024-08-31T06:24:41.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.340+0000 7fb935f19740 20 client.21525 trim_cache size 0 max 16384 2024-08-31T06:24:41.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb935f19740 1 Processor -- start 2024-08-31T06:24:41.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb935f19740 1 -- start start 2024-08-31T06:24:41.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb935f19740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 0x55f8687f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb935f19740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868416390 0x55f8687f4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb935f19740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868437070 0x55f8687df410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb935f19740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b5a30 con 0x55f86840e1b0 2024-08-31T06:24:41.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb935f19740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b75a0 con 0x55f868437070 2024-08-31T06:24:41.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb935f19740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b6130 con 0x55f868416390 2024-08-31T06:24:41.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb92cf3f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868416390 0x55f8687f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb92d740640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 0x55f8687f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb92cf3f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868416390 0x55f8687f4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:46888/0 (socket says 172.21.15.53:46888) 2024-08-31T06:24:41.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb92cf3f640 1 -- 172.21.15.53:0/3951217861 learned_addr learned my addr 172.21.15.53:0/3951217861 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:41.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.361+0000 7fb92df41640 1 --2- 172.21.15.53:0/3951217861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868437070 0x55f8687df410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.362+0000 7fb92cf3f640 1 -- 172.21.15.53:0/3951217861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868437070 msgr2=0x55f8687df410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:41.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.362+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/3951217861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868437070 0x55f8687df410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.362+0000 7fb92cf3f640 1 -- 172.21.15.53:0/3951217861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 msgr2=0x55f8687f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:41.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.362+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/3951217861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 0x55f8687f3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.362+0000 7fb92cf3f640 1 -- 172.21.15.53:0/3951217861 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8687de600 con 0x55f868416390 2024-08-31T06:24:41.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.362+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/3951217861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868416390 0x55f8687f4040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0e28b0 tx=0x7fb91c0e86d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89b07f9e9e555818 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:41.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.362+0000 7fb90effd640 1 -- 172.21.15.53:0/3951217861 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c021070 con 0x55f868416390 2024-08-31T06:24:41.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.362+0000 7fb90effd640 1 -- 172.21.15.53:0/3951217861 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb91c0aae10 con 0x55f868416390 2024-08-31T06:24:41.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.362+0000 7fb90effd640 1 -- 172.21.15.53:0/3951217861 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0afac0 con 0x55f868416390 2024-08-31T06:24:41.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.363+0000 7fb935f19740 1 -- 172.21.15.53:0/3951217861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868416390 msgr2=0x55f8687f4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:41.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.363+0000 7fb935f19740 1 --2- 172.21.15.53:0/3951217861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868416390 0x55f8687f4040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0e28b0 tx=0x7fb91c0e86d0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.363+0000 7fb935f19740 1 -- 172.21.15.53:0/3951217861 shutdown_connections 2024-08-31T06:24:41.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.363+0000 7fb935f19740 1 --2- 172.21.15.53:0/3951217861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f868437070 0x55f8687df410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.363+0000 7fb935f19740 1 --2- 172.21.15.53:0/3951217861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868416390 0x55f8687f4040 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.363+0000 7fb935f19740 1 --2- 172.21.15.53:0/3951217861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f86840e1b0 0x55f8687f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.363+0000 7fb935f19740 1 -- 172.21.15.53:0/3951217861 >> 172.21.15.53:0/3951217861 conn(0x55f86842b460 msgr2=0x55f8687e6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:41.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.363+0000 7fb935f19740 1 -- 172.21.15.53:0/3951217861 shutdown_connections 2024-08-31T06:24:41.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.363+0000 7fb935f19740 1 -- 172.21.15.53:0/3951217861 wait complete. 2024-08-31T06:24:41.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.364+0000 7fb935f19740 1 -- start start 2024-08-31T06:24:41.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.364+0000 7fb935f19740 1 Processor -- start 2024-08-31T06:24:41.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb935f19740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f86840e1b0 0x55f8687f0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb935f19740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868416390 0x55f8687eb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb935f19740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868437070 0x55f8687ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb935f19740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b6ed0 con 0x55f868416390 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb935f19740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b6800 con 0x55f86840e1b0 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb92d740640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f86840e1b0 0x55f8687f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb935f19740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b3a30 con 0x55f868437070 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb92d740640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f86840e1b0 0x55f8687f0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:45994/0 (socket says 172.21.15.53:45994) 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb92d740640 1 -- 172.21.15.53:0/1887278289 learned_addr learned my addr 172.21.15.53:0/1887278289 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb935f19740 10 client.0 _ll_register_callbacks cb 0x7fb920009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868416390 0x55f8687eb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb92df41640 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868437070 0x55f8687ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb92cf3f640 1 -- 172.21.15.53:0/1887278289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868437070 msgr2=0x55f8687ebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868437070 0x55f8687ebcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb92cf3f640 1 -- 172.21.15.53:0/1887278289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f86840e1b0 msgr2=0x55f8687f0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f86840e1b0 0x55f8687f0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.365+0000 7fb92cf3f640 1 -- 172.21.15.53:0/1887278289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8687ec430 con 0x55f868416390 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.366+0000 7fb92cf3f640 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868416390 0x55f8687eb7b0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x55f8686cad30 tx=0x7fb91c0e2760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fe4afd25e37a25 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.366+0000 7fb90cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.366+0000 7fb90cff9640 1 -- 172.21.15.53:0/1887278289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c021050 con 0x55f868416390 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.366+0000 7fb90cff9640 1 -- 172.21.15.53:0/1887278289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7fb91c0aa560 con 0x55f868416390 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.366+0000 7fb935f19740 1 -- 172.21.15.53:0/1887278289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb91c0aae10 con 0x55f868416390 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.366+0000 7fb90cff9640 1 -- 172.21.15.53:0/1887278289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fb91c0aac50 con 0x55f868416390 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.366+0000 7fb935f19740 10 client.21531 fetch_fsmap learned FSMap version 67 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.366+0000 7fb935f19740 1 -- 172.21.15.53:0/1887278289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x55f868864960 con 0x55f868416390 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.366+0000 7fb90cff9640 1 -- 172.21.15.53:0/1887278289 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb91c009de0 con 0x55f868416390 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.367+0000 7fb90cff9640 1 -- 172.21.15.53:0/1887278289 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 67) ==== 8366+0+0 (secure 0 0 0) 0x7fb91c0ee040 con 0x55f868416390 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.367+0000 7fb935f19740 10 client.21531 fetch_fsmap finished waiting for FSMap version 67 2024-08-31T06:24:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.367+0000 7fb935f19740 10 client.21531 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.367+0000 7fb935f19740 20 client.21531 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.367+0000 7fb935f19740 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f8683cada0 0x55f8688670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.367+0000 7fb935f19740 4 client.21531 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.367+0000 7fb935f19740 1 -- 172.21.15.53:0/1887278289 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb91c0aae10 con 0x55f8683cada0 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.367+0000 7fb92d740640 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f8683cada0 0x55f8688670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb90cff9640 10 client.21531 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb92d740640 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f8683cada0 0x55f8688670c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b4b1143058876e0e server_cookie=1945bfaaff3e4401 in_seq=0 out_seq=0 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb90cff9640 1 -- 172.21.15.53:0/1887278289 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb91c0aae10 con 0x55f8683cada0 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb90cff9640 10 client.21531 handle_command_reply: tid=0 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb935f19740 1 client.21531 shutdown 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb935f19740 1 -- 172.21.15.53:0/1887278289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868416390 msgr2=0x55f8687eb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb935f19740 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868416390 0x55f8687eb7b0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x55f8686cad30 tx=0x7fb91c0e2760 comp rx=0 tx=0).stop 2024-08-31T06:24:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb935f19740 1 -- 172.21.15.53:0/1887278289 shutdown_connections 2024-08-31T06:24:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb935f19740 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f8683cada0 0x55f8688670c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb935f19740 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f868437070 0x55f8687ebcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb935f19740 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f868416390 0x55f8687eb7b0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb935f19740 1 --2- 172.21.15.53:0/1887278289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f86840e1b0 0x55f8687f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb935f19740 1 -- 172.21.15.53:0/1887278289 >> 172.21.15.53:0/1887278289 conn(0x55f86842b460 msgr2=0x55f8687df410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.368+0000 7fb90cff9640 0 client.21531 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:24:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.369+0000 7fb935f19740 1 -- 172.21.15.53:0/1887278289 shutdown_connections 2024-08-31T06:24:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.369+0000 7fb935f19740 1 -- 172.21.15.53:0/1887278289 wait complete. 2024-08-31T06:24:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.369+0000 7fb935f19740 20 client.21531 trim_cache size 0 max 16384 2024-08-31T06:24:41.378 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:24:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.369+0000 7fb92f9a4640 1 -- 172.21.15.53:0/864466314 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb9100b4d50 msgr2=0x7fb9100b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.369+0000 7fb92f9a4640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb9100b4d50 0x7fb9100b7260 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb920013570 tx=0x7fb920005f90 comp rx=0 tx=0).stop 2024-08-31T06:24:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.369+0000 7fb92f9a4640 1 -- 172.21.15.53:0/864466314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb928077120 msgr2=0x7fb9281a0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.369+0000 7fb92f9a4640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb928077120 0x7fb9281a0c90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00d770 tx=0x7fb91c00dc30 comp rx=0 tx=0).stop 2024-08-31T06:24:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.370+0000 7fb92f9a4640 1 -- 172.21.15.53:0/864466314 shutdown_connections 2024-08-31T06:24:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.370+0000 7fb92f9a4640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb9100b4d50 0x7fb9100b7260 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.370+0000 7fb92f9a4640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb928114200 0x7fb9281a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.370+0000 7fb92f9a4640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb928077120 0x7fb9281a0c90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.370+0000 7fb92f9a4640 1 --2- 172.21.15.53:0/864466314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb928075b70 0x7fb9281a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.370+0000 7fb92f9a4640 1 -- 172.21.15.53:0/864466314 >> 172.21.15.53:0/864466314 conn(0x7fb9280ff380 msgr2=0x7fb928110100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.370+0000 7fb92f9a4640 1 -- 172.21.15.53:0/864466314 shutdown_connections 2024-08-31T06:24:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:41.370+0000 7fb92f9a4640 1 -- 172.21.15.53:0/864466314 wait complete. 2024-08-31T06:24:41.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 40055 5.18 MB/sec execute 269 sec latency 32740.985 ms 2024-08-31T06:24:41.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:41 smithi053 ceph-mon[18924]: pgmap v943: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-31T06:24:42.096 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c6ca39cb', total seconds elapsed: 39.1 2024-08-31T06:24:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:41 smithi130 ceph-mon[22266]: pgmap v943: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-31T06:24:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:41 smithi153 ceph-mon[22320]: pgmap v943: 97 pgs: 97 active+clean; 701 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-31T06:24:42.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 40222 5.17 MB/sec execute 270 sec latency 67.594 ms 2024-08-31T06:24:42.575 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:24:42.939 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:43.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 40375 5.19 MB/sec execute 271 sec latency 58.860 ms 2024-08-31T06:24:43.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.538+0000 7fa7df4b3640 1 -- 172.21.15.53:0/3201107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d8104400 msgr2=0x7fa7d8104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.538+0000 7fa7df4b3640 1 --2- 172.21.15.53:0/3201107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d8104400 0x7fa7d8104810 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009900 tx=0x7fa7d402a410 comp rx=0 tx=0).stop 2024-08-31T06:24:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.538+0000 7fa7df4b3640 1 -- 172.21.15.53:0/3201107 shutdown_connections 2024-08-31T06:24:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.538+0000 7fa7df4b3640 1 --2- 172.21.15.53:0/3201107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7d8102630 0x7fa7d81122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.538+0000 7fa7df4b3640 1 --2- 172.21.15.53:0/3201107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d8101b10 0x7fa7d8101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.538+0000 7fa7df4b3640 1 --2- 172.21.15.53:0/3201107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d8104400 0x7fa7d8104810 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.538+0000 7fa7df4b3640 1 -- 172.21.15.53:0/3201107 >> 172.21.15.53:0/3201107 conn(0x7fa7d8077a00 msgr2=0x7fa7d8077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.538+0000 7fa7df4b3640 1 -- 172.21.15.53:0/3201107 shutdown_connections 2024-08-31T06:24:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.538+0000 7fa7df4b3640 1 -- 172.21.15.53:0/3201107 wait complete. 2024-08-31T06:24:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.539+0000 7fa7df4b3640 1 Processor -- start 2024-08-31T06:24:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7df4b3640 1 -- start start 2024-08-31T06:24:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7df4b3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d8101b10 0x7fa7d819c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7df4b3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7d8102630 0x7fa7d819c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7df4b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d8104400 0x7fa7d81a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7df4b3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8115990 con 0x7fa7d8104400 2024-08-31T06:24:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7df4b3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8115810 con 0x7fa7d8102630 2024-08-31T06:24:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7df4b3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8115b10 con 0x7fa7d8101b10 2024-08-31T06:24:43.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7dda50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d8104400 0x7fa7d81a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7dca4e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7d8102630 0x7fa7d819c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7dda50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d8104400 0x7fa7d81a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45462/0 (socket says 172.21.15.53:45462) 2024-08-31T06:24:43.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7dd24f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d8101b10 0x7fa7d819c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7dda50640 1 -- 172.21.15.53:0/4241076491 learned_addr learned my addr 172.21.15.53:0/4241076491 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.540+0000 7fa7dca4e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7d8102630 0x7fa7d819c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47758/0 (socket says 172.21.15.53:47758) 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.541+0000 7fa7dca4e640 1 -- 172.21.15.53:0/4241076491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d8101b10 msgr2=0x7fa7d819c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.541+0000 7fa7dca4e640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d8101b10 0x7fa7d819c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.541+0000 7fa7dca4e640 1 -- 172.21.15.53:0/4241076491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d8104400 msgr2=0x7fa7d81a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.541+0000 7fa7dca4e640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d8104400 0x7fa7d81a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.541+0000 7fa7dca4e640 1 -- 172.21.15.53:0/4241076491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d81a2350 con 0x7fa7d8102630 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.541+0000 7fa7dca4e640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7d8102630 0x7fa7d819c980 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8075850 tx=0x7fa7c800b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.541+0000 7fa7ce7fc640 1 -- 172.21.15.53:0/4241076491 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8015020 con 0x7fa7d8102630 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.541+0000 7fa7df4b3640 1 -- 172.21.15.53:0/4241076491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d81a2640 con 0x7fa7d8102630 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.541+0000 7fa7ce7fc640 1 -- 172.21.15.53:0/4241076491 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7c8011cc0 con 0x7fa7d8102630 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.541+0000 7fa7df4b3640 1 -- 172.21.15.53:0/4241076491 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d81a8da0 con 0x7fa7d8102630 2024-08-31T06:24:43.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.541+0000 7fa7ce7fc640 1 -- 172.21.15.53:0/4241076491 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8010cc0 con 0x7fa7d8102630 2024-08-31T06:24:43.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.545+0000 7fa7ce7fc640 1 -- 172.21.15.53:0/4241076491 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa7c8018020 con 0x7fa7d8102630 2024-08-31T06:24:43.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.545+0000 7fa7e5a28740 1 Processor -- start 2024-08-31T06:24:43.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.545+0000 7fa7e5a28740 1 -- start start 2024-08-31T06:24:43.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.545+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c3a6070 0x55b61c74b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.545+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c74b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c74bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b61c6c2680 con 0x55b61c37d1b0 2024-08-31T06:24:43.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b61c6b1c10 con 0x55b61c385390 2024-08-31T06:24:43.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b61c6b5bc0 con 0x55b61c3a6070 2024-08-31T06:24:43.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7dd24f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c74b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7dd24f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c74b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45474/0 (socket says 172.21.15.53:45474) 2024-08-31T06:24:43.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7dd24f640 1 -- 172.21.15.53:0/906043317 learned_addr learned my addr 172.21.15.53:0/906043317 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:43.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7dda50640 1 --2- 172.21.15.53:0/906043317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c3a6070 0x55b61c74b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7dca4e640 1 --2- 172.21.15.53:0/906043317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c74bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7dd24f640 1 -- 172.21.15.53:0/906043317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c3a6070 msgr2=0x55b61c74b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/906043317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c3a6070 0x55b61c74b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7dd24f640 1 -- 172.21.15.53:0/906043317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 msgr2=0x55b61c74bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/906043317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c74bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7ce7fc640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa7c40b4d50 0x7fa7c40b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7dd24f640 1 -- 172.21.15.53:0/906043317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b61c411650 con 0x55b61c37d1b0 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.546+0000 7fa7dda50640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa7c40b4d50 0x7fa7c40b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.547+0000 7fa7ce7fc640 1 -- 172.21.15.53:0/4241076491 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7fa7c80e4a20 con 0x7fa7d8102630 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.547+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/906043317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c74b850 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4005ab0 tx=0x7fa7d40042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd8a50431133f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.547+0000 7fa7c37fe640 1 -- 172.21.15.53:0/906043317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4035040 con 0x55b61c37d1b0 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.547+0000 7fa7dda50640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa7c40b4d50 0x7fa7c40b7260 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00049d0 tx=0x7fa7d0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:43.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.547+0000 7fa7c37fe640 1 -- 172.21.15.53:0/906043317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7d4004490 con 0x55b61c37d1b0 2024-08-31T06:24:43.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.547+0000 7fa7c37fe640 1 -- 172.21.15.53:0/906043317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4004e60 con 0x55b61c37d1b0 2024-08-31T06:24:43.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.548+0000 7fa7e5a28740 1 -- 172.21.15.53:0/906043317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 msgr2=0x55b61c74b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:43.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.548+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/906043317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c74b850 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4005ab0 tx=0x7fa7d40042a0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.548+0000 7fa7e5a28740 1 -- 172.21.15.53:0/906043317 shutdown_connections 2024-08-31T06:24:43.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.548+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/906043317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c74bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.548+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/906043317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c74b850 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.548+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/906043317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c3a6070 0x55b61c74b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.548+0000 7fa7e5a28740 1 -- 172.21.15.53:0/906043317 >> 172.21.15.53:0/906043317 conn(0x55b61c39a460 msgr2=0x55b61c749200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:43.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.548+0000 7fa7e5a28740 1 -- 172.21.15.53:0/906043317 shutdown_connections 2024-08-31T06:24:43.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.548+0000 7fa7e5a28740 1 -- 172.21.15.53:0/906043317 wait complete. 2024-08-31T06:24:43.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.549+0000 7fa7e5a28740 1 -- start start 2024-08-31T06:24:43.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.549+0000 7fa7e5a28740 1 Processor -- start 2024-08-31T06:24:43.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.549+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c37d1b0 0x55b61c756a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.549+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c385390 0x55b61c756f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.549+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 0x55b61c76b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.549+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b61c514700 con 0x55b61c3a6070 2024-08-31T06:24:43.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.549+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b61c638750 con 0x55b61c37d1b0 2024-08-31T06:24:43.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.549+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b61c759a90 con 0x55b61c385390 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dda50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 0x55b61c76b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7e5a28740 10 client.0 _ll_register_callbacks cb 0x55b61c667e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dd24f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c37d1b0 0x55b61c756a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dda50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 0x55b61c76b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45478/0 (socket says 172.21.15.53:45478) 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dda50640 1 -- 172.21.15.53:0/4050083546 learned_addr learned my addr 172.21.15.53:0/4050083546 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dca4e640 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c385390 0x55b61c756f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dda50640 1 -- 172.21.15.53:0/4050083546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c385390 msgr2=0x55b61c756f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dda50640 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c385390 0x55b61c756f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dda50640 1 -- 172.21.15.53:0/4050083546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c37d1b0 msgr2=0x55b61c756a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dda50640 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c37d1b0 0x55b61c756a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dda50640 1 -- 172.21.15.53:0/4050083546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b61c671900 con 0x55b61c3a6070 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dca4e640 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c385390 0x55b61c756f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:24:43.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7dda50640 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 0x55b61c76b620 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00099e0 tx=0x7fa7d0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5c3417e151c2de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.550+0000 7fa7c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.551+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/4050083546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000fdf0 con 0x55b61c3a6070 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.551+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/4050083546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7fa7d0018030 con 0x55b61c3a6070 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.551+0000 7fa7e5a28740 1 -- 172.21.15.53:0/4050083546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7d4004490 con 0x55b61c3a6070 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.551+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/4050083546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fa7d0012020 con 0x55b61c3a6070 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.551+0000 7fa7e5a28740 10 client.21543 fetch_fsmap learned FSMap version 67 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.551+0000 7fa7e5a28740 1 -- 172.21.15.53:0/4050083546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x55b61c76e0d0 con 0x55b61c3a6070 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.552+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/4050083546 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7d001edb0 con 0x55b61c3a6070 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.552+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/4050083546 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 67) ==== 8366+0+0 (secure 0 0 0) 0x7fa7d00328a0 con 0x55b61c3a6070 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.552+0000 7fa7e5a28740 10 client.21543 fetch_fsmap finished waiting for FSMap version 67 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.552+0000 7fa7e5a28740 10 client.21543 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.552+0000 7fa7e5a28740 20 client.21543 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.552+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55b61c3649f0 0x55b61c771770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.552+0000 7fa7e5a28740 4 client.21543 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:43.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.552+0000 7fa7e5a28740 1 -- 172.21.15.53:0/4050083546 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa7d4004490 con 0x55b61c3649f0 2024-08-31T06:24:43.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.553+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55b61c3649f0 0x55b61c771770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.554+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55b61c3649f0 0x55b61c771770 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eb4771f391fa4e5c server_cookie=94365703263e1370 in_seq=0 out_seq=0 2024-08-31T06:24:43.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.554+0000 7fa7c0ff9640 10 client.21543 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:24:43.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/4050083546 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa7d4004490 con 0x55b61c3649f0 2024-08-31T06:24:43.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7c0ff9640 10 client.21543 handle_command_reply: tid=0 2024-08-31T06:24:43.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7e5a28740 1 client.21543 shutdown 2024-08-31T06:24:43.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7e5a28740 1 -- 172.21.15.53:0/4050083546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 msgr2=0x55b61c76b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:43.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 0x55b61c76b620 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00099e0 tx=0x7fa7d0004ab0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7e5a28740 1 -- 172.21.15.53:0/4050083546 shutdown_connections 2024-08-31T06:24:43.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55b61c3649f0 0x55b61c771770 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 0x55b61c76b620 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c385390 0x55b61c756f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/4050083546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c37d1b0 0x55b61c756a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7e5a28740 1 -- 172.21.15.53:0/4050083546 >> 172.21.15.53:0/4050083546 conn(0x55b61c39a460 msgr2=0x55b61c74e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:43.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7c0ff9640 0 client.21543 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:24:43.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.555+0000 7fa7e5a28740 1 -- 172.21.15.53:0/4050083546 shutdown_connections 2024-08-31T06:24:43.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.556+0000 7fa7e5a28740 1 -- 172.21.15.53:0/4050083546 wait complete. 2024-08-31T06:24:43.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.556+0000 7fa7e5a28740 20 client.21543 trim_cache size 0 max 16384 2024-08-31T06:24:43.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.581+0000 7fa7e5a28740 1 Processor -- start 2024-08-31T06:24:43.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.581+0000 7fa7e5a28740 1 -- start start 2024-08-31T06:24:43.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.581+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c756800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.581+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c756d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.581+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c3a6070 0x55b61c74e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.581+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc00e8b0 con 0x55b61c37d1b0 2024-08-31T06:24:43.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.581+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc010420 con 0x55b61c385390 2024-08-31T06:24:43.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.581+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc00efb0 con 0x55b61c3a6070 2024-08-31T06:24:43.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.581+0000 7fa7dd24f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c756800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.581+0000 7fa7dd24f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c756800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45494/0 (socket says 172.21.15.53:45494) 2024-08-31T06:24:43.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.581+0000 7fa7dd24f640 1 -- 172.21.15.53:0/865211338 learned_addr learned my addr 172.21.15.53:0/865211338 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:43.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.582+0000 7fa7dda50640 1 --2- 172.21.15.53:0/865211338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c3a6070 0x55b61c74e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.582+0000 7fa7dca4e640 1 --2- 172.21.15.53:0/865211338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c756d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.582+0000 7fa7dd24f640 1 -- 172.21.15.53:0/865211338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c3a6070 msgr2=0x55b61c74e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:43.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.582+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/865211338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c3a6070 0x55b61c74e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.582+0000 7fa7dd24f640 1 -- 172.21.15.53:0/865211338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 msgr2=0x55b61c756d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:43.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.582+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/865211338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c756d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.582+0000 7fa7dd24f640 1 -- 172.21.15.53:0/865211338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b61c74d600 con 0x55b61c37d1b0 2024-08-31T06:24:43.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.582+0000 7fa7dca4e640 1 --2- 172.21.15.53:0/865211338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c756d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:43.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.583+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/865211338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c756800 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009900 tx=0x7fa7d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5ad6d1182fbd3c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:43.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.583+0000 7fa7c2ffd640 1 -- 172.21.15.53:0/865211338 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4035040 con 0x55b61c37d1b0 2024-08-31T06:24:43.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.583+0000 7fa7c2ffd640 1 -- 172.21.15.53:0/865211338 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7d4003a80 con 0x55b61c37d1b0 2024-08-31T06:24:43.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.583+0000 7fa7c2ffd640 1 -- 172.21.15.53:0/865211338 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d403caf0 con 0x55b61c37d1b0 2024-08-31T06:24:43.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.584+0000 7fa7e5a28740 1 -- 172.21.15.53:0/865211338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 msgr2=0x55b61c756800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:43.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.584+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/865211338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c756800 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009900 tx=0x7fa7d4004770 comp rx=0 tx=0).stop 2024-08-31T06:24:43.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.585+0000 7fa7e5a28740 1 -- 172.21.15.53:0/865211338 shutdown_connections 2024-08-31T06:24:43.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.585+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/865211338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c3a6070 0x55b61c74e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.585+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/865211338 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c756d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.585+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/865211338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c37d1b0 0x55b61c756800 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.585+0000 7fa7e5a28740 1 -- 172.21.15.53:0/865211338 >> 172.21.15.53:0/865211338 conn(0x55b61c39a460 msgr2=0x55b61c7552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:43.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.585+0000 7fa7e5a28740 1 -- 172.21.15.53:0/865211338 shutdown_connections 2024-08-31T06:24:43.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.585+0000 7fa7e5a28740 1 -- 172.21.15.53:0/865211338 wait complete. 2024-08-31T06:24:43.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.585+0000 7fa7e5a28740 1 -- start start 2024-08-31T06:24:43.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.585+0000 7fa7e5a28740 1 Processor -- start 2024-08-31T06:24:43.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c37d1b0 0x55b61c768000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c7634f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7e5a28740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 0x55b61c763c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc00fd50 con 0x55b61c3a6070 2024-08-31T06:24:43.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc00f680 con 0x55b61c385390 2024-08-31T06:24:43.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7e5a28740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc00c8b0 con 0x55b61c37d1b0 2024-08-31T06:24:43.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7e5a28740 10 client.0 _ll_register_callbacks cb 0x7fa7d0009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:43.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7dca4e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c7634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7dca4e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c7634f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47792/0 (socket says 172.21.15.53:47792) 2024-08-31T06:24:43.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7dca4e640 1 -- 172.21.15.53:0/2706328858 learned_addr learned my addr 172.21.15.53:0/2706328858 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:43.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7dda50640 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 0x55b61c763c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.586+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c37d1b0 0x55b61c768000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.587+0000 7fa7dd24f640 1 -- 172.21.15.53:0/2706328858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 msgr2=0x55b61c7634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:43.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.587+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c7634f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.587+0000 7fa7dd24f640 1 -- 172.21.15.53:0/2706328858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 msgr2=0x55b61c763c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:43.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.587+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 0x55b61c763c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.587+0000 7fa7dd24f640 1 -- 172.21.15.53:0/2706328858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b61c7db130 con 0x55b61c37d1b0 2024-08-31T06:24:43.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.587+0000 7fa7dd24f640 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c37d1b0 0x55b61c768000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009900 tx=0x7fa7d4003ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=652b6bfa76d19fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:43.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.587+0000 7fa7c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:24:43.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.587+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/2706328858 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4035040 con 0x55b61c37d1b0 2024-08-31T06:24:43.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.587+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/2706328858 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7fa7d403c440 con 0x55b61c37d1b0 2024-08-31T06:24:43.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.588+0000 7fa7e5a28740 1 -- 172.21.15.53:0/2706328858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7d4003a80 con 0x55b61c37d1b0 2024-08-31T06:24:43.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.588+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/2706328858 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fa7d403c640 con 0x55b61c37d1b0 2024-08-31T06:24:43.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.588+0000 7fa7e5a28740 10 client.30340 fetch_fsmap learned FSMap version 67 2024-08-31T06:24:43.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.588+0000 7fa7e5a28740 1 -- 172.21.15.53:0/2706328858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x55b61c7dc280 con 0x55b61c37d1b0 2024-08-31T06:24:43.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.588+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/2706328858 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7d4003a80 con 0x55b61c37d1b0 2024-08-31T06:24:43.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.589+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/2706328858 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 67) ==== 8366+0+0 (secure 0 0 0) 0x7fa7d40507a0 con 0x55b61c37d1b0 2024-08-31T06:24:43.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.589+0000 7fa7e5a28740 10 client.30340 fetch_fsmap finished waiting for FSMap version 67 2024-08-31T06:24:43.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.589+0000 7fa7e5a28740 10 client.30340 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:24:43.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.589+0000 7fa7e5a28740 20 client.30340 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:43.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.589+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55b61c339da0 0x55b61c7de520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:43.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.589+0000 7fa7e5a28740 4 client.30340 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:24:43.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.589+0000 7fa7e5a28740 1 -- 172.21.15.53:0/2706328858 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b61c6c45d0 con 0x55b61c339da0 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.589+0000 7fa7dca4e640 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55b61c339da0 0x55b61c7de520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.590+0000 7fa7c0ff9640 10 client.30340 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.590+0000 7fa7dca4e640 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55b61c339da0 0x55b61c7de520 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aa0e2a91e7e3bfd4 server_cookie=7a2b11995a76686e in_seq=0 out_seq=0 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7c0ff9640 1 -- 172.21.15.53:0/2706328858 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b61c6c45d0 con 0x55b61c339da0 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7c0ff9640 10 client.30340 handle_command_reply: tid=0 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7e5a28740 1 client.30340 shutdown 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7e5a28740 1 -- 172.21.15.53:0/2706328858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c37d1b0 msgr2=0x55b61c768000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c37d1b0 0x55b61c768000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009900 tx=0x7fa7d4003ee0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7e5a28740 1 -- 172.21.15.53:0/2706328858 shutdown_connections 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55b61c339da0 0x55b61c7de520 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b61c3a6070 0x55b61c763c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b61c385390 0x55b61c7634f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7e5a28740 1 --2- 172.21.15.53:0/2706328858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b61c37d1b0 0x55b61c768000 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7e5a28740 1 -- 172.21.15.53:0/2706328858 >> 172.21.15.53:0/2706328858 conn(0x55b61c39a460 msgr2=0x55b61c756800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:43.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7c0ff9640 0 client.30340 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:24:43.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.591+0000 7fa7e5a28740 1 -- 172.21.15.53:0/2706328858 shutdown_connections 2024-08-31T06:24:43.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.592+0000 7fa7e5a28740 1 -- 172.21.15.53:0/2706328858 wait complete. 2024-08-31T06:24:43.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.592+0000 7fa7e5a28740 20 client.30340 trim_cache size 0 max 16384 2024-08-31T06:24:43.598 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:24:43.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 -- 172.21.15.53:0/4241076491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa7c40b4d50 msgr2=0x7fa7c40b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:43.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa7c40b4d50 0x7fa7c40b7260 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00049d0 tx=0x7fa7d0009500 comp rx=0 tx=0).stop 2024-08-31T06:24:43.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 -- 172.21.15.53:0/4241076491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7d8102630 msgr2=0x7fa7d819c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:43.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7d8102630 0x7fa7d819c980 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8075850 tx=0x7fa7c800b850 comp rx=0 tx=0).stop 2024-08-31T06:24:43.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 -- 172.21.15.53:0/4241076491 shutdown_connections 2024-08-31T06:24:43.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa7c40b4d50 0x7fa7c40b7260 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d8104400 0x7fa7d81a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7d8102630 0x7fa7d819c980 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 --2- 172.21.15.53:0/4241076491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d8101b10 0x7fa7d819c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:43.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 -- 172.21.15.53:0/4241076491 >> 172.21.15.53:0/4241076491 conn(0x7fa7d8077a00 msgr2=0x7fa7d8100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:43.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 -- 172.21.15.53:0/4241076491 shutdown_connections 2024-08-31T06:24:43.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:43.593+0000 7fa7df4b3640 1 -- 172.21.15.53:0/4241076491 wait complete. 2024-08-31T06:24:44.099 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:43 smithi053 ceph-mon[18924]: pgmap v944: 97 pgs: 97 active+clean; 702 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 147 KiB/s wr, 15 op/s 2024-08-31T06:24:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:43 smithi130 ceph-mon[22266]: pgmap v944: 97 pgs: 97 active+clean; 702 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 147 KiB/s wr, 15 op/s 2024-08-31T06:24:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:43 smithi153 ceph-mon[22320]: pgmap v944: 97 pgs: 97 active+clean; 702 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 147 KiB/s wr, 15 op/s 2024-08-31T06:24:44.348 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:24:44.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 40511 5.20 MB/sec execute 272 sec latency 64.478 ms 2024-08-31T06:24:44.732 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:45.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:44 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:45.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:44 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:45.221 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:44 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.335+0000 7f7241ee6640 1 -- 172.21.15.53:0/56708164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723c101e30 msgr2=0x7f723c102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.335+0000 7f7241ee6640 1 --2- 172.21.15.53:0/56708164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723c101e30 0x7f723c102240 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f722c009930 tx=0x7f722c02a420 comp rx=0 tx=0).stop 2024-08-31T06:24:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.335+0000 7f7241ee6640 1 -- 172.21.15.53:0/56708164 shutdown_connections 2024-08-31T06:24:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.335+0000 7f7241ee6640 1 --2- 172.21.15.53:0/56708164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f723c106970 0x7f723c110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.335+0000 7f7241ee6640 1 --2- 172.21.15.53:0/56708164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c106020 0x7f723c106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.335+0000 7f7241ee6640 1 --2- 172.21.15.53:0/56708164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723c101e30 0x7f723c102240 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.335+0000 7f7241ee6640 1 -- 172.21.15.53:0/56708164 >> 172.21.15.53:0/56708164 conn(0x7f723c077a00 msgr2=0x7f723c077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.335+0000 7f7241ee6640 1 -- 172.21.15.53:0/56708164 shutdown_connections 2024-08-31T06:24:45.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.335+0000 7f7241ee6640 1 -- 172.21.15.53:0/56708164 wait complete. 2024-08-31T06:24:45.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.336+0000 7f7241ee6640 1 Processor -- start 2024-08-31T06:24:45.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f7241ee6640 1 -- start start 2024-08-31T06:24:45.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f7241ee6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723c101e30 0x7f723c19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f7241ee6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c106020 0x7f723c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f7241ee6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f723c106970 0x7f723c19fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f7241ee6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f723c113760 con 0x7f723c106970 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f7241ee6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1135e0 con 0x7f723c101e30 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f7241ee6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1138e0 con 0x7f723c106020 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723c101e30 0x7f723c19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723c101e30 0x7f723c19a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47812/0 (socket says 172.21.15.53:47812) 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f723b7fe640 1 -- 172.21.15.53:0/3714847972 learned_addr learned my addr 172.21.15.53:0/3714847972 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f723affd640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c106020 0x7f723c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.337+0000 7f723bfff640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f723c106970 0x7f723c19fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.338+0000 7f723b7fe640 1 -- 172.21.15.53:0/3714847972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c106020 msgr2=0x7f723c19a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.338+0000 7f723b7fe640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c106020 0x7f723c19a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.338+0000 7f723b7fe640 1 -- 172.21.15.53:0/3714847972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f723c106970 msgr2=0x7f723c19fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.338+0000 7f723b7fe640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f723c106970 0x7f723c19fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.338+0000 7f723b7fe640 1 -- 172.21.15.53:0/3714847972 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c1a01e0 con 0x7f723c101e30 2024-08-31T06:24:45.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.338+0000 7f723b7fe640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723c101e30 0x7f723c19a270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f722c02a940 tx=0x7f722c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:45.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.339+0000 7f7238ff9640 1 -- 172.21.15.53:0/3714847972 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c03f070 con 0x7f723c101e30 2024-08-31T06:24:45.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.339+0000 7f7238ff9640 1 -- 172.21.15.53:0/3714847972 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f722c03baf0 con 0x7f723c101e30 2024-08-31T06:24:45.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.339+0000 7f7238ff9640 1 -- 172.21.15.53:0/3714847972 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c035030 con 0x7f723c101e30 2024-08-31T06:24:45.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.339+0000 7f7241ee6640 1 -- 172.21.15.53:0/3714847972 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723c1a0470 con 0x7f723c101e30 2024-08-31T06:24:45.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.339+0000 7f7241ee6640 1 -- 172.21.15.53:0/3714847972 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723c1a6c30 con 0x7f723c101e30 2024-08-31T06:24:45.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.342+0000 7f724845b740 1 Processor -- start 2024-08-31T06:24:45.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f724845b740 1 -- start start 2024-08-31T06:24:45.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f724845b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daacc070 0x5598dae71310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f7238ff9640 1 -- 172.21.15.53:0/3714847972 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f722c042070 con 0x7f723c101e30 2024-08-31T06:24:45.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f724845b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 0x5598dae71850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f724845b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae71d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f724845b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5598dade8680 con 0x5598daaa31b0 2024-08-31T06:24:45.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f724845b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5598dadd7c10 con 0x5598daacc070 2024-08-31T06:24:45.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f724845b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5598daddbbc0 con 0x5598daaab390 2024-08-31T06:24:45.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 0x5598dae71850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f723bfff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daacc070 0x5598dae71310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f723affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae71d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f723affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae71d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:47220/0 (socket says 172.21.15.53:47220) 2024-08-31T06:24:45.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.343+0000 7f723affd640 1 -- 172.21.15.53:0/4162227649 learned_addr learned my addr 172.21.15.53:0/4162227649 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:45.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.344+0000 7f723bfff640 1 -- 172.21.15.53:0/4162227649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 msgr2=0x5598dae71d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:45.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.344+0000 7f723bfff640 1 --2- 172.21.15.53:0/4162227649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae71d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.344+0000 7f723bfff640 1 -- 172.21.15.53:0/4162227649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 msgr2=0x5598dae71850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:45.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.345+0000 7f7238ff9640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72240b4d20 0x7f72240b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.345+0000 7f723bfff640 1 --2- 172.21.15.53:0/4162227649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 0x5598dae71850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.345+0000 7f723bfff640 1 -- 172.21.15.53:0/4162227649 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598dab37650 con 0x5598daacc070 2024-08-31T06:24:45.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.345+0000 7f723affd640 1 --2- 172.21.15.53:0/4162227649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae71d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:45.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.345+0000 7f723b7fe640 1 --2- 172.21.15.53:0/4162227649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 0x5598dae71850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.345+0000 7f7238ff9640 1 -- 172.21.15.53:0/3714847972 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f722c105ad0 con 0x7f723c101e30 2024-08-31T06:24:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.345+0000 7f723bfff640 1 --2- 172.21.15.53:0/4162227649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daacc070 0x5598dae71310 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7234009f00 tx=0x7f7234011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9be655076e19d620 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.345+0000 7f723affd640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72240b4d20 0x7f72240b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.346+0000 7f7221ffb640 1 -- 172.21.15.53:0/4162227649 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234004d20 con 0x5598daacc070 2024-08-31T06:24:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.346+0000 7f7221ffb640 1 -- 172.21.15.53:0/4162227649 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7234004050 con 0x5598daacc070 2024-08-31T06:24:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.346+0000 7f7221ffb640 1 -- 172.21.15.53:0/4162227649 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234005280 con 0x5598daacc070 2024-08-31T06:24:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.347+0000 7f724845b740 1 -- 172.21.15.53:0/4162227649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daacc070 msgr2=0x5598dae71310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.347+0000 7f723affd640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72240b4d20 0x7f72240b7230 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7230009f90 tx=0x7f7230005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:45.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.347+0000 7f724845b740 1 --2- 172.21.15.53:0/4162227649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daacc070 0x5598dae71310 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7234009f00 tx=0x7f7234011810 comp rx=0 tx=0).stop 2024-08-31T06:24:45.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.348+0000 7f724845b740 1 -- 172.21.15.53:0/4162227649 shutdown_connections 2024-08-31T06:24:45.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.348+0000 7f724845b740 1 --2- 172.21.15.53:0/4162227649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae71d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.348+0000 7f724845b740 1 --2- 172.21.15.53:0/4162227649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 0x5598dae71850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.348+0000 7f724845b740 1 --2- 172.21.15.53:0/4162227649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daacc070 0x5598dae71310 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.348+0000 7f724845b740 1 -- 172.21.15.53:0/4162227649 >> 172.21.15.53:0/4162227649 conn(0x5598daac0460 msgr2=0x5598dae6f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:45.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.348+0000 7f724845b740 1 -- 172.21.15.53:0/4162227649 shutdown_connections 2024-08-31T06:24:45.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.348+0000 7f724845b740 1 -- 172.21.15.53:0/4162227649 wait complete. 2024-08-31T06:24:45.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.349+0000 7f724845b740 1 -- start start 2024-08-31T06:24:45.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.349+0000 7f724845b740 1 Processor -- start 2024-08-31T06:24:45.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.350+0000 7f724845b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 0x5598dae789e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.350+0000 7f724845b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae78f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.350+0000 7f724845b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 0x5598dae915e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.350+0000 7f723bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 0x5598dae915e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.350+0000 7f723bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 0x5598dae915e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45548/0 (socket says 172.21.15.53:45548) 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.350+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 0x5598dae789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.350+0000 7f723affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae78f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.350+0000 7f723bfff640 1 -- 172.21.15.53:0/3251294845 learned_addr learned my addr 172.21.15.53:0/3251294845 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.350+0000 7f724845b740 1 -- 172.21.15.53:0/3251294845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5598dac3a700 con 0x5598daacc070 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.350+0000 7f724845b740 1 -- 172.21.15.53:0/3251294845 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5598dad5e750 con 0x5598daaa31b0 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.350+0000 7f724845b740 1 -- 172.21.15.53:0/3251294845 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5598dae88280 con 0x5598daaab390 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.351+0000 7f723bfff640 1 -- 172.21.15.53:0/3251294845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 msgr2=0x5598dae78f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.351+0000 7f723bfff640 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae78f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.351+0000 7f723bfff640 1 -- 172.21.15.53:0/3251294845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 msgr2=0x5598dae789e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.351+0000 7f723bfff640 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 0x5598dae789e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.351+0000 7f723bfff640 1 -- 172.21.15.53:0/3251294845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598dad97900 con 0x5598daacc070 2024-08-31T06:24:45.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.351+0000 7f723b7fe640 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 0x5598dae789e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:24:45.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.351+0000 7f724845b740 10 client.0 _ll_register_callbacks cb 0x5598dad8de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:45.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.351+0000 7f724845b740 1 -- 172.21.15.53:0/3251294845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7234004050 con 0x5598daacc070 2024-08-31T06:24:45.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.351+0000 7f723bfff640 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 0x5598dae915e0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f723401b040 tx=0x7f72340044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c28a73ed16aea9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:45.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.351+0000 7f721affd640 10 client.21558 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:45.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.351+0000 7f721affd640 1 -- 172.21.15.53:0/3251294845 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234028020 con 0x5598daacc070 2024-08-31T06:24:45.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.352+0000 7f721affd640 1 -- 172.21.15.53:0/3251294845 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f7234003c40 con 0x5598daacc070 2024-08-31T06:24:45.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.352+0000 7f721affd640 1 -- 172.21.15.53:0/3251294845 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f7234005040 con 0x5598daacc070 2024-08-31T06:24:45.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.352+0000 7f724845b740 10 client.21558 fetch_fsmap learned FSMap version 68 2024-08-31T06:24:45.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.352+0000 7f724845b740 1 -- 172.21.15.53:0/3251294845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({fsmap=68}) -- 0x5598dae93df0 con 0x5598daacc070 2024-08-31T06:24:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.352+0000 7f721affd640 1 -- 172.21.15.53:0/3251294845 <== mon.0 v2:172.21.15.53:3300/0 4 ==== fsmap(e 68) ==== 8370+0+0 (secure 0 0 0) 0x7f72340051e0 con 0x5598daacc070 2024-08-31T06:24:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.353+0000 7f724845b740 10 client.21558 fetch_fsmap finished waiting for FSMap version 68 2024-08-31T06:24:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.353+0000 7f724845b740 10 client.21558 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:24:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.353+0000 7f724845b740 20 client.21558 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.353+0000 7f724845b740 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5598daa8a9f0 0x5598dae971b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.353+0000 7f724845b740 4 client.21558 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.353+0000 7f724845b740 1 -- 172.21.15.53:0/3251294845 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598dadea5d0 con 0x5598daa8a9f0 2024-08-31T06:24:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.353+0000 7f723b7fe640 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5598daa8a9f0 0x5598dae971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.353+0000 7f723b7fe640 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5598daa8a9f0 0x5598dae971b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=403d97ea168dfd6 server_cookie=e8456d362af7f3ff in_seq=0 out_seq=0 2024-08-31T06:24:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.353+0000 7f721affd640 10 client.21558 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:24:45.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f721affd640 1 -- 172.21.15.53:0/3251294845 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f722c0acf90 con 0x5598daa8a9f0 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f721affd640 10 client.21558 handle_command_reply: tid=0 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f724845b740 1 client.21558 shutdown 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f724845b740 1 -- 172.21.15.53:0/3251294845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 msgr2=0x5598dae915e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f724845b740 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 0x5598dae915e0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f723401b040 tx=0x7f72340044b0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f724845b740 1 -- 172.21.15.53:0/3251294845 shutdown_connections 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f724845b740 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5598daa8a9f0 0x5598dae971b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f724845b740 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 0x5598dae915e0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f724845b740 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae78f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f724845b740 1 --2- 172.21.15.53:0/3251294845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 0x5598dae789e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f724845b740 1 -- 172.21.15.53:0/3251294845 >> 172.21.15.53:0/3251294845 conn(0x5598daac0460 msgr2=0x5598dae72d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.355+0000 7f721affd640 0 client.21558 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.356+0000 7f724845b740 1 -- 172.21.15.53:0/3251294845 shutdown_connections 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.356+0000 7f724845b740 1 -- 172.21.15.53:0/3251294845 wait complete. 2024-08-31T06:24:45.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.356+0000 7f724845b740 20 client.21558 trim_cache size 0 max 16384 2024-08-31T06:24:45.381 INFO:tasks.workunit.client.0.smithi053.stdout: 10 40652 5.20 MB/sec execute 273 sec latency 99.110 ms 2024-08-31T06:24:45.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.380+0000 7f724845b740 1 Processor -- start 2024-08-31T06:24:45.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.380+0000 7f724845b740 1 -- start start 2024-08-31T06:24:45.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f724845b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 0x5598dae6f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f724845b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae914e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f724845b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daacc070 0x5598dae75bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f724845b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1ad370 con 0x5598daaa31b0 2024-08-31T06:24:45.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f724845b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1aef10 con 0x5598daacc070 2024-08-31T06:24:45.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f724845b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1adaa0 con 0x5598daaab390 2024-08-31T06:24:45.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 0x5598dae6f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 0x5598dae6f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45560/0 (socket says 172.21.15.53:45560) 2024-08-31T06:24:45.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f723b7fe640 1 -- 172.21.15.53:0/1327227279 learned_addr learned my addr 172.21.15.53:0/1327227279 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:45.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f723affd640 1 --2- 172.21.15.53:0/1327227279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae914e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f723bfff640 1 --2- 172.21.15.53:0/1327227279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daacc070 0x5598dae75bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f723b7fe640 1 -- 172.21.15.53:0/1327227279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 msgr2=0x5598dae914e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:45.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f723b7fe640 1 --2- 172.21.15.53:0/1327227279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae914e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f723b7fe640 1 -- 172.21.15.53:0/1327227279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daacc070 msgr2=0x5598dae75bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:45.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f723b7fe640 1 --2- 172.21.15.53:0/1327227279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daacc070 0x5598dae75bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.381+0000 7f723b7fe640 1 -- 172.21.15.53:0/1327227279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598dae72130 con 0x5598daaa31b0 2024-08-31T06:24:45.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.382+0000 7f723b7fe640 1 --2- 172.21.15.53:0/1327227279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 0x5598dae6f250 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f722c0cc180 tx=0x7f722c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8131fcfded220aa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:45.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.382+0000 7f72217fa640 1 -- 172.21.15.53:0/1327227279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c049040 con 0x5598daaa31b0 2024-08-31T06:24:45.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.382+0000 7f72217fa640 1 -- 172.21.15.53:0/1327227279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5598dadea5d0 con 0x5598daaa31b0 2024-08-31T06:24:45.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.382+0000 7f72217fa640 1 -- 172.21.15.53:0/1327227279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c0c8480 con 0x5598daaa31b0 2024-08-31T06:24:45.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.383+0000 7f724845b740 1 -- 172.21.15.53:0/1327227279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 msgr2=0x5598dae6f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:45.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.383+0000 7f724845b740 1 --2- 172.21.15.53:0/1327227279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 0x5598dae6f250 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f722c0cc180 tx=0x7f722c005de0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.384+0000 7f724845b740 1 -- 172.21.15.53:0/1327227279 shutdown_connections 2024-08-31T06:24:45.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.384+0000 7f724845b740 1 --2- 172.21.15.53:0/1327227279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daacc070 0x5598dae75bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.384+0000 7f724845b740 1 --2- 172.21.15.53:0/1327227279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae914e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.384+0000 7f724845b740 1 --2- 172.21.15.53:0/1327227279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daaa31b0 0x5598dae6f250 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.384+0000 7f724845b740 1 -- 172.21.15.53:0/1327227279 >> 172.21.15.53:0/1327227279 conn(0x5598daac0460 msgr2=0x5598dae6eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:45.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.384+0000 7f724845b740 1 -- 172.21.15.53:0/1327227279 shutdown_connections 2024-08-31T06:24:45.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.384+0000 7f724845b740 1 -- 172.21.15.53:0/1327227279 wait complete. 2024-08-31T06:24:45.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.384+0000 7f724845b740 1 -- start start 2024-08-31T06:24:45.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.384+0000 7f724845b740 1 Processor -- start 2024-08-31T06:24:45.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f724845b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 0x5598dae89ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f724845b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae8a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f724845b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 0x5598daf00ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f724845b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1ae840 con 0x5598daacc070 2024-08-31T06:24:45.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f724845b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1ae170 con 0x5598daaa31b0 2024-08-31T06:24:45.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f724845b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1ab370 con 0x5598daaab390 2024-08-31T06:24:45.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 0x5598dae89ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 0x5598dae89ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47844/0 (socket says 172.21.15.53:47844) 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f723b7fe640 1 -- 172.21.15.53:0/517973753 learned_addr learned my addr 172.21.15.53:0/517973753 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f724845b740 10 client.0 _ll_register_callbacks cb 0x7f7230009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f723affd640 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae8a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.385+0000 7f723bfff640 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 0x5598daf00ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f723b7fe640 1 -- 172.21.15.53:0/517973753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 msgr2=0x5598dae8a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f723b7fe640 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae8a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f723b7fe640 1 -- 172.21.15.53:0/517973753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 msgr2=0x5598daf00ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f723b7fe640 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 0x5598daf00ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f723b7fe640 1 -- 172.21.15.53:0/517973753 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598daf01060 con 0x5598daaa31b0 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f723bfff640 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 0x5598daf00ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f723b7fe640 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 0x5598dae89ca0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f722c0c9460 tx=0x7f722c03bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5dadce8d0528234 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f721affd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:24:45.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f721affd640 1 -- 172.21.15.53:0/517973753 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c049040 con 0x5598daaa31b0 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f721affd640 1 -- 172.21.15.53:0/517973753 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f722c0d4fd0 con 0x5598daaa31b0 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f724845b740 1 -- 172.21.15.53:0/517973753 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5598dadea5d0 con 0x5598daaa31b0 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f721affd640 1 -- 172.21.15.53:0/517973753 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f722c103630 con 0x5598daaa31b0 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f724845b740 10 client.30350 fetch_fsmap learned FSMap version 68 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.386+0000 7f724845b740 1 -- 172.21.15.53:0/517973753 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x5598daf022e0 con 0x5598daaa31b0 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.387+0000 7f721affd640 1 -- 172.21.15.53:0/517973753 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5598dadea5d0 con 0x5598daaa31b0 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.387+0000 7f721affd640 1 -- 172.21.15.53:0/517973753 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 68) ==== 8370+0+0 (secure 0 0 0) 0x7f722c0cb450 con 0x5598daaa31b0 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.387+0000 7f724845b740 10 client.30350 fetch_fsmap finished waiting for FSMap version 68 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.387+0000 7f724845b740 10 client.30350 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.387+0000 7f724845b740 20 client.30350 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.387+0000 7f724845b740 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5598daa5fda0 0x5598daf049c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:45.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.387+0000 7f724845b740 4 client.30350 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:24:45.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.387+0000 7f724845b740 1 -- 172.21.15.53:0/517973753 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5598dade6070 con 0x5598daa5fda0 2024-08-31T06:24:45.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.387+0000 7f723affd640 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5598daa5fda0 0x5598daf049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:45.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.387+0000 7f721affd640 10 client.30350 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:24:45.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.387+0000 7f723affd640 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5598daa5fda0 0x5598daf049c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=864352a342c1a161 server_cookie=1d477046051aa5eb in_seq=0 out_seq=0 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f721affd640 1 -- 172.21.15.53:0/517973753 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5598dade6070 con 0x5598daa5fda0 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f721affd640 10 client.30350 handle_command_reply: tid=0 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f724845b740 1 client.30350 shutdown 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f724845b740 1 -- 172.21.15.53:0/517973753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 msgr2=0x5598dae89ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f724845b740 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 0x5598dae89ca0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f722c0c9460 tx=0x7f722c03bf50 comp rx=0 tx=0).stop 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f724845b740 1 -- 172.21.15.53:0/517973753 shutdown_connections 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f724845b740 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5598daa5fda0 0x5598daf049c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f724845b740 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598daacc070 0x5598daf00ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f724845b740 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598daaab390 0x5598dae8a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f724845b740 1 --2- 172.21.15.53:0/517973753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598daaa31b0 0x5598dae89ca0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f724845b740 1 -- 172.21.15.53:0/517973753 >> 172.21.15.53:0/517973753 conn(0x5598daac0460 msgr2=0x5598dae72300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f721affd640 0 client.30350 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:24:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f724845b740 1 -- 172.21.15.53:0/517973753 shutdown_connections 2024-08-31T06:24:45.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.388+0000 7f724845b740 1 -- 172.21.15.53:0/517973753 wait complete. 2024-08-31T06:24:45.396 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:24:45.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f724845b740 20 client.30350 trim_cache size 0 max 16384 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f7241ee6640 1 -- 172.21.15.53:0/3714847972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72240b4d20 msgr2=0x7f72240b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f7241ee6640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72240b4d20 0x7f72240b7230 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7230009f90 tx=0x7f7230005f90 comp rx=0 tx=0).stop 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f7241ee6640 1 -- 172.21.15.53:0/3714847972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723c101e30 msgr2=0x7f723c19a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f7241ee6640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723c101e30 0x7f723c19a270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f722c02a940 tx=0x7f722c003b90 comp rx=0 tx=0).stop 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f7241ee6640 1 -- 172.21.15.53:0/3714847972 shutdown_connections 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f7241ee6640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72240b4d20 0x7f72240b7230 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f7241ee6640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f723c106970 0x7f723c19fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f7241ee6640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c106020 0x7f723c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f7241ee6640 1 --2- 172.21.15.53:0/3714847972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723c101e30 0x7f723c19a270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f7241ee6640 1 -- 172.21.15.53:0/3714847972 >> 172.21.15.53:0/3714847972 conn(0x7f723c077a00 msgr2=0x7f723c107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.389+0000 7f7241ee6640 1 -- 172.21.15.53:0/3714847972 shutdown_connections 2024-08-31T06:24:45.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:45.390+0000 7f7241ee6640 1 -- 172.21.15.53:0/3714847972 wait complete. 2024-08-31T06:24:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:45 smithi130 ceph-mon[22266]: pgmap v945: 97 pgs: 97 active+clean; 706 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 522 KiB/s wr, 51 op/s 2024-08-31T06:24:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:45 smithi153 ceph-mon[22320]: pgmap v945: 97 pgs: 97 active+clean; 706 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 522 KiB/s wr, 51 op/s 2024-08-31T06:24:46.209 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:45 smithi053 ceph-mon[18924]: pgmap v945: 97 pgs: 97 active+clean; 706 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 522 KiB/s wr, 51 op/s 2024-08-31T06:24:46.253 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:24:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.269+0000 7fb335ca9640 1 -- 172.21.15.53:0/4024959288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb330108080 msgr2=0x7fb330108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.269+0000 7fb335ca9640 1 --2- 172.21.15.53:0/4024959288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb330108080 0x7fb330108490 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fb324009900 tx=0x7fb32402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.269+0000 7fb335ca9640 1 -- 172.21.15.53:0/4024959288 shutdown_connections 2024-08-31T06:24:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.269+0000 7fb335ca9640 1 --2- 172.21.15.53:0/4024959288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3301089d0 0x7fb33010f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.269+0000 7fb335ca9640 1 --2- 172.21.15.53:0/4024959288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb330108080 0x7fb330108490 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.269+0000 7fb335ca9640 1 --2- 172.21.15.53:0/4024959288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb330102750 0x7fb330102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.269+0000 7fb335ca9640 1 -- 172.21.15.53:0/4024959288 >> 172.21.15.53:0/4024959288 conn(0x7fb33007a4e0 msgr2=0x7fb33007a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.269+0000 7fb335ca9640 1 -- 172.21.15.53:0/4024959288 shutdown_connections 2024-08-31T06:24:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.269+0000 7fb335ca9640 1 -- 172.21.15.53:0/4024959288 wait complete. 2024-08-31T06:24:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.270+0000 7fb335ca9640 1 Processor -- start 2024-08-31T06:24:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.270+0000 7fb335ca9640 1 -- start start 2024-08-31T06:24:46.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.270+0000 7fb335ca9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb330102750 0x7fb330197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.270+0000 7fb335ca9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb330108080 0x7fb330198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.270+0000 7fb335ca9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3301089d0 0x7fb33019d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.270+0000 7fb335ca9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb330111440 con 0x7fb3301089d0 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.270+0000 7fb335ca9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301112c0 con 0x7fb330102750 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.270+0000 7fb335ca9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301115c0 con 0x7fb330108080 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb330108080 0x7fb330198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb330102750 0x7fb330197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb330102750 0x7fb330197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47860/0 (socket says 172.21.15.53:47860) 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3301089d0 0x7fb33019d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32f7fe640 1 -- 172.21.15.53:0/1259045959 learned_addr learned my addr 172.21.15.53:0/1259045959 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32ffff640 1 -- 172.21.15.53:0/1259045959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb330108080 msgr2=0x7fb330198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32ffff640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb330108080 0x7fb330198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32ffff640 1 -- 172.21.15.53:0/1259045959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb330102750 msgr2=0x7fb330197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32ffff640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb330102750 0x7fb330197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32ffff640 1 -- 172.21.15.53:0/1259045959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33019de90 con 0x7fb3301089d0 2024-08-31T06:24:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb330102750 0x7fb330197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.271+0000 7fb32ffff640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3301089d0 0x7fb33019d790 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fb328007b20 tx=0x7fb32800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.272+0000 7fb32cff9640 1 -- 172.21.15.53:0/1259045959 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328019070 con 0x7fb3301089d0 2024-08-31T06:24:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.272+0000 7fb32cff9640 1 -- 172.21.15.53:0/1259045959 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb32800b230 con 0x7fb3301089d0 2024-08-31T06:24:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.272+0000 7fb335ca9640 1 -- 172.21.15.53:0/1259045959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33019e180 con 0x7fb3301089d0 2024-08-31T06:24:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.272+0000 7fb32cff9640 1 -- 172.21.15.53:0/1259045959 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328004020 con 0x7fb3301089d0 2024-08-31T06:24:46.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.272+0000 7fb335ca9640 1 -- 172.21.15.53:0/1259045959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3301a4910 con 0x7fb3301089d0 2024-08-31T06:24:46.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.276+0000 7fb33cc1b740 1 Processor -- start 2024-08-31T06:24:46.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.276+0000 7fb32cff9640 1 -- 172.21.15.53:0/1259045959 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb3280041c0 con 0x7fb3301089d0 2024-08-31T06:24:46.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.276+0000 7fb33cc1b740 1 -- start start 2024-08-31T06:24:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.277+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904a8fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.277+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 0x55e904a90000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.277+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904a90540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.277+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e904a05000 con 0x55e9046cb4d0 2024-08-31T06:24:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.277+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e9049f4590 con 0x55e9046ec1b0 2024-08-31T06:24:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.277+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e9049f8540 con 0x55e9046c32f0 2024-08-31T06:24:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.277+0000 7fb32effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904a8fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.277+0000 7fb32effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904a90540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.277+0000 7fb32f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 0x55e904a90000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.277+0000 7fb32effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904a90540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45600/0 (socket says 172.21.15.53:45600) 2024-08-31T06:24:46.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.277+0000 7fb32effd640 1 -- 172.21.15.53:0/2112295952 learned_addr learned my addr 172.21.15.53:0/2112295952 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:46.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb32f7fe640 1 -- 172.21.15.53:0/2112295952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 msgr2=0x55e904a8fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/2112295952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904a8fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb32f7fe640 1 -- 172.21.15.53:0/2112295952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 msgr2=0x55e904a90540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/2112295952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904a90540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb32f7fe640 1 -- 172.21.15.53:0/2112295952 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e904757790 con 0x55e9046c32f0 2024-08-31T06:24:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb32cff9640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3180b4da0 0x7fb3180b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb32effd640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3180b4da0 0x7fb3180b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/2112295952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 0x55e904a90000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb320012540 tx=0x7fb320005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=808a68a2fb8fb5dd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb32cff9640 1 -- 172.21.15.53:0/1259045959 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7fb3280e5500 con 0x7fb3301089d0 2024-08-31T06:24:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb315ffb640 1 -- 172.21.15.53:0/2112295952 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32001e070 con 0x55e9046c32f0 2024-08-31T06:24:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb315ffb640 1 -- 172.21.15.53:0/2112295952 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb32000d4c0 con 0x55e9046c32f0 2024-08-31T06:24:46.282 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.278+0000 7fb315ffb640 1 -- 172.21.15.53:0/2112295952 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32000b810 con 0x55e9046c32f0 2024-08-31T06:24:46.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.279+0000 7fb33cc1b740 1 -- 172.21.15.53:0/2112295952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 msgr2=0x55e904a90000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:46.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.279+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/2112295952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 0x55e904a90000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb320012540 tx=0x7fb320005f90 comp rx=0 tx=0).stop 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.279+0000 7fb32effd640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3180b4da0 0x7fb3180b72b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb324005f70 tx=0x7fb324041040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.279+0000 7fb33cc1b740 1 -- 172.21.15.53:0/2112295952 shutdown_connections 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.279+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/2112295952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904a90540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.279+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/2112295952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 0x55e904a90000 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.279+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/2112295952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904a8fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.279+0000 7fb33cc1b740 1 -- 172.21.15.53:0/2112295952 >> 172.21.15.53:0/2112295952 conn(0x55e9046e0300 msgr2=0x55e904a8d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.279+0000 7fb33cc1b740 1 -- 172.21.15.53:0/2112295952 shutdown_connections 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.279+0000 7fb33cc1b740 1 -- 172.21.15.53:0/2112295952 wait complete. 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.280+0000 7fb33cc1b740 1 -- start start 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.280+0000 7fb33cc1b740 1 Processor -- start 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046c32f0 0x55e904aa3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904aa4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046ec1b0 0x55e904aafd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e90492dab0 con 0x55e9046cb4d0 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e90497b680 con 0x55e9046c32f0 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e904aa6a00 con 0x55e9046ec1b0 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb33cc1b740 10 client.0 _ll_register_callbacks cb 0x55e904703a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046c32f0 0x55e904aa3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046c32f0 0x55e904aa3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47874/0 (socket says 172.21.15.53:47874) 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32f7fe640 1 -- 172.21.15.53:0/151539119 learned_addr learned my addr 172.21.15.53:0/151539119 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32ffff640 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046ec1b0 0x55e904aafd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32effd640 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904aa4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32ffff640 1 -- 172.21.15.53:0/151539119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046c32f0 msgr2=0x55e904aa3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:46.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32ffff640 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046c32f0 0x55e904aa3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32ffff640 1 -- 172.21.15.53:0/151539119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 msgr2=0x55e904aa4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32ffff640 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904aa4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32ffff640 1 -- 172.21.15.53:0/151539119 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9047d0620 con 0x55e9046ec1b0 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046c32f0 0x55e904aa3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb32ffff640 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046ec1b0 0x55e904aafd30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb3280e2bd0 tx=0x7fb3280ab680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6087d14167586b0c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.281+0000 7fb30effd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb30effd640 1 -- 172.21.15.53:0/151539119 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3280abb70 con 0x55e9046ec1b0 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb33cc1b740 1 -- 172.21.15.53:0/151539119 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb32000d4c0 con 0x55e9046ec1b0 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb30effd640 1 -- 172.21.15.53:0/151539119 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7fb3280a7e00 con 0x55e9046ec1b0 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb30effd640 1 -- 172.21.15.53:0/151539119 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7fb3280b03e0 con 0x55e9046ec1b0 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb33cc1b740 10 client.30367 fetch_fsmap learned FSMap version 69 2024-08-31T06:24:46.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb33cc1b740 1 -- 172.21.15.53:0/151539119 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x55e904ab2ad0 con 0x55e9046ec1b0 2024-08-31T06:24:46.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb30effd640 1 -- 172.21.15.53:0/151539119 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb32000d4c0 con 0x55e9046ec1b0 2024-08-31T06:24:46.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb30effd640 1 -- 172.21.15.53:0/151539119 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 69) ==== 8374+0+0 (secure 0 0 0) 0x7fb3280e2ee0 con 0x55e9046ec1b0 2024-08-31T06:24:46.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb33cc1b740 10 client.30367 fetch_fsmap finished waiting for FSMap version 69 2024-08-31T06:24:46.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb33cc1b740 10 client.30367 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:46.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb33cc1b740 20 client.30367 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:46.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e9046aad80 0x55e904ab5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb33cc1b740 4 client.30367 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:46.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.282+0000 7fb33cc1b740 1 -- 172.21.15.53:0/151539119 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e904a06f50 con 0x55e9046aad80 2024-08-31T06:24:46.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.283+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e9046aad80 0x55e904ab5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.283+0000 7fb30effd640 10 client.30367 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:46.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.283+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e9046aad80 0x55e904ab5fa0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814846c1db1bc896 server_cookie=efbe4e04aef2a2da in_seq=0 out_seq=0 2024-08-31T06:24:46.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.284+0000 7fb30effd640 1 -- 172.21.15.53:0/151539119 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e904a06f50 con 0x55e9046aad80 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb30effd640 10 client.30367 handle_command_reply: tid=0 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 1 client.30367 shutdown 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 1 -- 172.21.15.53:0/151539119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046ec1b0 msgr2=0x55e904aafd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046ec1b0 0x55e904aafd30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb3280e2bd0 tx=0x7fb3280ab680 comp rx=0 tx=0).stop 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 1 -- 172.21.15.53:0/151539119 shutdown_connections 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e9046aad80 0x55e904ab5fa0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046ec1b0 0x55e904aafd30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904aa4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/151539119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046c32f0 0x55e904aa3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 1 -- 172.21.15.53:0/151539119 >> 172.21.15.53:0/151539119 conn(0x55e9046e0300 msgr2=0x55e904a8bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb30effd640 0 client.30367 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 1 -- 172.21.15.53:0/151539119 shutdown_connections 2024-08-31T06:24:46.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 1 -- 172.21.15.53:0/151539119 wait complete. 2024-08-31T06:24:46.292 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.285+0000 7fb33cc1b740 20 client.30367 trim_cache size 0 max 16384 2024-08-31T06:24:46.315 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.311+0000 7fb33cc1b740 1 Processor -- start 2024-08-31T06:24:46.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.311+0000 7fb33cc1b740 1 -- start start 2024-08-31T06:24:46.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 0x55e904aa2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904aa2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904aa31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301ad2c0 con 0x55e9046cb4d0 2024-08-31T06:24:46.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301aee90 con 0x55e9046ec1b0 2024-08-31T06:24:46.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301ad9f0 con 0x55e9046c32f0 2024-08-31T06:24:46.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904aa2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 0x55e904aa2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.316 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904aa2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45622/0 (socket says 172.21.15.53:45622) 2024-08-31T06:24:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32effd640 1 -- 172.21.15.53:0/3275960402 learned_addr learned my addr 172.21.15.53:0/3275960402 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32ffff640 1 --2- 172.21.15.53:0/3275960402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904aa31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32f7fe640 1 -- 172.21.15.53:0/3275960402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 msgr2=0x55e904aa31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/3275960402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904aa31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32f7fe640 1 -- 172.21.15.53:0/3275960402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 msgr2=0x55e904aa2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/3275960402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904aa2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32f7fe640 1 -- 172.21.15.53:0/3275960402 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e904a8e340 con 0x55e9046c32f0 2024-08-31T06:24:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32ffff640 1 --2- 172.21.15.53:0/3275960402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904aa31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.312+0000 7fb32effd640 1 --2- 172.21.15.53:0/3275960402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904aa2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.313+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/3275960402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 0x55e904aa2530 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb320003e00 tx=0x7fb320003900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e43009620ab39887 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:46.319 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.313+0000 7fb3157fa640 1 -- 172.21.15.53:0/3275960402 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320033070 con 0x55e9046c32f0 2024-08-31T06:24:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.313+0000 7fb3157fa640 1 -- 172.21.15.53:0/3275960402 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb32002b070 con 0x55e9046c32f0 2024-08-31T06:24:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.313+0000 7fb3157fa640 1 -- 172.21.15.53:0/3275960402 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32001e040 con 0x55e9046c32f0 2024-08-31T06:24:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.314+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3275960402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 msgr2=0x55e904aa2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.314+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/3275960402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 0x55e904aa2530 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb320003e00 tx=0x7fb320003900 comp rx=0 tx=0).stop 2024-08-31T06:24:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.314+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3275960402 shutdown_connections 2024-08-31T06:24:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.314+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/3275960402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904aa31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.314+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/3275960402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046cb4d0 0x55e904aa2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.314+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/3275960402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046c32f0 0x55e904aa2530 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.314+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3275960402 >> 172.21.15.53:0/3275960402 conn(0x55e9046e0300 msgr2=0x55e904a94c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.314+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3275960402 shutdown_connections 2024-08-31T06:24:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.314+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3275960402 wait complete. 2024-08-31T06:24:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.315+0000 7fb33cc1b740 1 -- start start 2024-08-31T06:24:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.315+0000 7fb33cc1b740 1 Processor -- start 2024-08-31T06:24:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.315+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046c32f0 0x55e904aac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.315+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046cb4d0 0x55e904aa0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.315+0000 7fb33cc1b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904aa0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.315+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301ae790 con 0x55e9046c32f0 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.315+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301ae0c0 con 0x55e9046ec1b0 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.315+0000 7fb33cc1b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301ab2c0 con 0x55e9046cb4d0 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.315+0000 7fb33cc1b740 10 client.0 _ll_register_callbacks cb 0x7fb3280a7a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046c32f0 0x55e904aac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046cb4d0 0x55e904aa0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046cb4d0 0x55e904aa0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:47302/0 (socket says 172.21.15.53:47302) 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32effd640 1 -- 172.21.15.53:0/3832323318 learned_addr learned my addr 172.21.15.53:0/3832323318 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046c32f0 0x55e904aac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45638/0 (socket says 172.21.15.53:45638) 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32ffff640 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904aa0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32effd640 1 -- 172.21.15.53:0/3832323318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 msgr2=0x55e904aa0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32effd640 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904aa0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32effd640 1 -- 172.21.15.53:0/3832323318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046c32f0 msgr2=0x55e904aac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32effd640 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046c32f0 0x55e904aac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32effd640 1 -- 172.21.15.53:0/3832323318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e904aa1690 con 0x55e9046cb4d0 2024-08-31T06:24:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.316+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046c32f0 0x55e904aac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.317+0000 7fb32effd640 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046cb4d0 0x55e904aa0ab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb324009230 tx=0x7fb32402a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72cd3af734812e66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.317+0000 7fb30effd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:24:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.317+0000 7fb30effd640 1 -- 172.21.15.53:0/3832323318 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324035040 con 0x55e9046cb4d0 2024-08-31T06:24:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.317+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3832323318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb32002b070 con 0x55e9046cb4d0 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.317+0000 7fb30effd640 1 -- 172.21.15.53:0/3832323318 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7fb3240043a0 con 0x55e9046cb4d0 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.317+0000 7fb30effd640 1 -- 172.21.15.53:0/3832323318 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7fb324003a40 con 0x55e9046cb4d0 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.317+0000 7fb33cc1b740 10 client.30373 fetch_fsmap learned FSMap version 69 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.317+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3832323318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x55e904b20980 con 0x55e9046cb4d0 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.318+0000 7fb30effd640 1 -- 172.21.15.53:0/3832323318 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb32002b070 con 0x55e9046cb4d0 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.318+0000 7fb30effd640 1 -- 172.21.15.53:0/3832323318 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 69) ==== 8374+0+0 (secure 0 0 0) 0x7fb32403dcc0 con 0x55e9046cb4d0 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.318+0000 7fb33cc1b740 10 client.30373 fetch_fsmap finished waiting for FSMap version 69 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.318+0000 7fb33cc1b740 10 client.30373 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.318+0000 7fb33cc1b740 20 client.30373 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.318+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e9046801c0 0x55e904b23020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.318+0000 7fb33cc1b740 4 client.30373 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.318+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3832323318 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e904a029f0 con 0x55e9046801c0 2024-08-31T06:24:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.319+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e9046801c0 0x55e904b23020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.319+0000 7fb30effd640 10 client.30373 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.319+0000 7fb32f7fe640 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e9046801c0 0x55e904b23020 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=617c0e41a9294fac server_cookie=130b9ed3f3a2ba78 in_seq=0 out_seq=0 2024-08-31T06:24:46.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 40790 5.21 MB/sec execute 274 sec latency 122.714 ms 2024-08-31T06:24:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb30effd640 1 -- 172.21.15.53:0/3832323318 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e904a029f0 con 0x55e9046801c0 2024-08-31T06:24:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb30effd640 10 client.30373 handle_command_reply: tid=0 2024-08-31T06:24:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 1 client.30373 shutdown 2024-08-31T06:24:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3832323318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046cb4d0 msgr2=0x55e904aa0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046cb4d0 0x55e904aa0ab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb324009230 tx=0x7fb32402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3832323318 shutdown_connections 2024-08-31T06:24:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e9046801c0 0x55e904b23020 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e9046ec1b0 0x55e904aa0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9046cb4d0 0x55e904aa0ab0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 1 --2- 172.21.15.53:0/3832323318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e9046c32f0 0x55e904aac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3832323318 >> 172.21.15.53:0/3832323318 conn(0x55e9046e0300 msgr2=0x55e904a94c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb30effd640 0 client.30373 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3832323318 shutdown_connections 2024-08-31T06:24:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 1 -- 172.21.15.53:0/3832323318 wait complete. 2024-08-31T06:24:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.393+0000 7fb33cc1b740 20 client.30373 trim_cache size 0 max 16384 2024-08-31T06:24:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:24:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:24:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:24:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:24:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.394+0000 7fb335ca9640 1 -- 172.21.15.53:0/1259045959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3180b4da0 msgr2=0x7fb3180b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.394+0000 7fb335ca9640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3180b4da0 0x7fb3180b72b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb324005f70 tx=0x7fb324041040 comp rx=0 tx=0).stop 2024-08-31T06:24:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.394+0000 7fb335ca9640 1 -- 172.21.15.53:0/1259045959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3301089d0 msgr2=0x7fb33019d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.394+0000 7fb335ca9640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3301089d0 0x7fb33019d790 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fb328007b20 tx=0x7fb32800bf60 comp rx=0 tx=0).stop 2024-08-31T06:24:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.394+0000 7fb335ca9640 1 -- 172.21.15.53:0/1259045959 shutdown_connections 2024-08-31T06:24:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.394+0000 7fb335ca9640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3180b4da0 0x7fb3180b72b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.395+0000 7fb335ca9640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3301089d0 0x7fb33019d790 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.395+0000 7fb335ca9640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb330108080 0x7fb330198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.395+0000 7fb335ca9640 1 --2- 172.21.15.53:0/1259045959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb330102750 0x7fb330197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.395+0000 7fb335ca9640 1 -- 172.21.15.53:0/1259045959 >> 172.21.15.53:0/1259045959 conn(0x7fb33007a4e0 msgr2=0x7fb3301041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.395+0000 7fb335ca9640 1 -- 172.21.15.53:0/1259045959 shutdown_connections 2024-08-31T06:24:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:46.395+0000 7fb335ca9640 1 -- 172.21.15.53:0/1259045959 wait complete. 2024-08-31T06:24:46.671 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:47.114 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:46 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:47.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:46 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:47.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:46 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:47.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.238+0000 7f68e79b7640 1 -- 172.21.15.53:0/4060030730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e0109270 msgr2=0x7f68e0109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:47.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.238+0000 7f68e79b7640 1 --2- 172.21.15.53:0/4060030730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e0109270 0x7f68e0109680 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009900 tx=0x7f68d002a410 comp rx=0 tx=0).stop 2024-08-31T06:24:47.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.238+0000 7f68e79b7640 1 -- 172.21.15.53:0/4060030730 shutdown_connections 2024-08-31T06:24:47.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.238+0000 7f68e79b7640 1 --2- 172.21.15.53:0/4060030730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68e0109bc0 0x7f68e01103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.238+0000 7f68e79b7640 1 --2- 172.21.15.53:0/4060030730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e0109270 0x7f68e0109680 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.238+0000 7f68e79b7640 1 --2- 172.21.15.53:0/4060030730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68e0103930 0x7f68e0103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.238+0000 7f68e79b7640 1 -- 172.21.15.53:0/4060030730 >> 172.21.15.53:0/4060030730 conn(0x7f68e00ff3a0 msgr2=0x7f68e01017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:47.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.238+0000 7f68e79b7640 1 -- 172.21.15.53:0/4060030730 shutdown_connections 2024-08-31T06:24:47.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.238+0000 7f68e79b7640 1 -- 172.21.15.53:0/4060030730 wait complete. 2024-08-31T06:24:47.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.239+0000 7f68e79b7640 1 Processor -- start 2024-08-31T06:24:47.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.239+0000 7f68e79b7640 1 -- start start 2024-08-31T06:24:47.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e79b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68e0103930 0x7f68e00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e79b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68e0109270 0x7f68e00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e79b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e0109bc0 0x7f68e0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e79b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68e01137d0 con 0x7f68e0109bc0 2024-08-31T06:24:47.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e79b7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f68e0113650 con 0x7f68e0109270 2024-08-31T06:24:47.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e79b7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68e0113950 con 0x7f68e0103930 2024-08-31T06:24:47.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e5f54640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e0109bc0 0x7f68e0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e5f54640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e0109bc0 0x7f68e0075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45656/0 (socket says 172.21.15.53:45656) 2024-08-31T06:24:47.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e5f54640 1 -- 172.21.15.53:0/1184825607 learned_addr learned my addr 172.21.15.53:0/1184825607 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:47.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e4f52640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68e0109270 0x7f68e00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e5753640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68e0103930 0x7f68e00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e5f54640 1 -- 172.21.15.53:0/1184825607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68e0103930 msgr2=0x7f68e00754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:47.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e5f54640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68e0103930 0x7f68e00754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e5f54640 1 -- 172.21.15.53:0/1184825607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68e0109270 msgr2=0x7f68e00759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e5f54640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68e0109270 0x7f68e00759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e5f54640 1 -- 172.21.15.53:0/1184825607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e01a8560 con 0x7f68e0109bc0 2024-08-31T06:24:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.240+0000 7f68e5f54640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e0109bc0 0x7f68e0075f30 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f68d800b970 tx=0x7f68d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.241+0000 7f68d67fc640 1 -- 172.21.15.53:0/1184825607 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8019070 con 0x7f68e0109bc0 2024-08-31T06:24:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.241+0000 7f68d67fc640 1 -- 172.21.15.53:0/1184825607 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68d8014440 con 0x7f68e0109bc0 2024-08-31T06:24:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.241+0000 7f68d67fc640 1 -- 172.21.15.53:0/1184825607 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d80075d0 con 0x7f68e0109bc0 2024-08-31T06:24:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.241+0000 7f68e79b7640 1 -- 172.21.15.53:0/1184825607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e01a8850 con 0x7f68e0109bc0 2024-08-31T06:24:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.241+0000 7f68e79b7640 1 -- 172.21.15.53:0/1184825607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e01a8de0 con 0x7f68e0109bc0 2024-08-31T06:24:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.245+0000 7f68edf2c740 1 Processor -- start 2024-08-31T06:24:47.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.245+0000 7f68d67fc640 1 -- 172.21.15.53:0/1184825607 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f68d801c070 con 0x7f68e0109bc0 2024-08-31T06:24:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68edf2c740 1 -- start start 2024-08-31T06:24:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 0x562794722310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x562794722850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 0x562794722d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68edf2c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562794699680 con 0x56279437d070 2024-08-31T06:24:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68edf2c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562794688c10 con 0x5627943541b0 2024-08-31T06:24:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68edf2c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56279468cbc0 con 0x56279435c390 2024-08-31T06:24:47.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68e4f52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 0x562794722310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68e5753640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x562794722850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68e4f52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 0x562794722310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45668/0 (socket says 172.21.15.53:45668) 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68e4f52640 1 -- 172.21.15.53:0/1917876720 learned_addr learned my addr 172.21.15.53:0/1917876720 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.246+0000 7f68e4f52640 1 --2- 172.21.15.53:0/1917876720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 0x562794722d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.247+0000 7f68e5753640 1 -- 172.21.15.53:0/1917876720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 msgr2=0x562794722d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.247+0000 7f68e5753640 1 --2- 172.21.15.53:0/1917876720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 0x562794722d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.247+0000 7f68e5753640 1 -- 172.21.15.53:0/1917876720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 msgr2=0x562794722310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.247+0000 7f68e5753640 1 --2- 172.21.15.53:0/1917876720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 0x562794722310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.247+0000 7f68e5753640 1 -- 172.21.15.53:0/1917876720 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627943e8650 con 0x5627943541b0 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.247+0000 7f68d67fc640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68cc0b4d20 0x7f68cc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.247+0000 7f68e5753640 1 --2- 172.21.15.53:0/1917876720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x562794722850 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00b730 tx=0x7f68dc00bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13f67ff4e8bcfa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:47.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.247+0000 7f68d67fc640 1 -- 172.21.15.53:0/1184825607 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f68d80e4a60 con 0x7f68e0109bc0 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.247+0000 7f68cb7fe640 1 -- 172.21.15.53:0/1917876720 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68dc00be40 con 0x5627943541b0 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.247+0000 7f68e4f52640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68cc0b4d20 0x7f68cc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.248+0000 7f68cb7fe640 1 -- 172.21.15.53:0/1917876720 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68dc019070 con 0x5627943541b0 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.248+0000 7f68cb7fe640 1 -- 172.21.15.53:0/1917876720 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68dc014c20 con 0x5627943541b0 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.249+0000 7f68edf2c740 1 -- 172.21.15.53:0/1917876720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 msgr2=0x562794722850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.249+0000 7f68e4f52640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68cc0b4d20 0x7f68cc0b7230 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f68d0006010 tx=0x7f68d0005a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.249+0000 7f68edf2c740 1 --2- 172.21.15.53:0/1917876720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x562794722850 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00b730 tx=0x7f68dc00bbf0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.249+0000 7f68edf2c740 1 -- 172.21.15.53:0/1917876720 shutdown_connections 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.249+0000 7f68edf2c740 1 --2- 172.21.15.53:0/1917876720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 0x562794722d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.249+0000 7f68edf2c740 1 --2- 172.21.15.53:0/1917876720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x562794722850 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.249+0000 7f68edf2c740 1 --2- 172.21.15.53:0/1917876720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 0x562794722310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.249+0000 7f68edf2c740 1 -- 172.21.15.53:0/1917876720 >> 172.21.15.53:0/1917876720 conn(0x562794371460 msgr2=0x562794720200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.249+0000 7f68edf2c740 1 -- 172.21.15.53:0/1917876720 shutdown_connections 2024-08-31T06:24:47.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.249+0000 7f68edf2c740 1 -- 172.21.15.53:0/1917876720 wait complete. 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.250+0000 7f68edf2c740 1 -- start start 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.250+0000 7f68edf2c740 1 Processor -- start 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.250+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x56279472daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.250+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279435c390 0x56279472dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.250+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 0x562794739e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.250+0000 7f68edf2c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627944eb700 con 0x56279435c390 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.250+0000 7f68edf2c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56279460f750 con 0x5627943541b0 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.250+0000 7f68edf2c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562794730af0 con 0x56279437d070 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e5753640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x56279472daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e5753640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x56279472daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47940/0 (socket says 172.21.15.53:47940) 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e4f52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279435c390 0x56279472dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e5753640 1 -- 172.21.15.53:0/3461472408 learned_addr learned my addr 172.21.15.53:0/3461472408 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:47.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e5f54640 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 0x562794739e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68edf2c740 10 client.0 _ll_register_callbacks cb 0x56279463ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e5753640 1 -- 172.21.15.53:0/3461472408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 msgr2=0x562794739e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e5753640 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 0x562794739e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e5753640 1 -- 172.21.15.53:0/3461472408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279435c390 msgr2=0x56279472dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e5753640 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279435c390 0x56279472dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e5753640 1 -- 172.21.15.53:0/3461472408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562794648900 con 0x5627943541b0 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e5f54640 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 0x562794739e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e4f52640 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279435c390 0x56279472dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68e5753640 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x56279472daa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f68dc004700 tx=0x7f68dc014660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30ad1d0ea7e9c8a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.251+0000 7f68c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.252+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3461472408 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68dc0149a0 con 0x5627943541b0 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.252+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3461472408 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f68dc014b40 con 0x5627943541b0 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.252+0000 7f68edf2c740 1 -- 172.21.15.53:0/3461472408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68dc019070 con 0x5627943541b0 2024-08-31T06:24:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.252+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3461472408 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f68dc014d40 con 0x5627943541b0 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.252+0000 7f68edf2c740 10 client.30377 fetch_fsmap learned FSMap version 69 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.252+0000 7f68edf2c740 1 -- 172.21.15.53:0/3461472408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x56279473c890 con 0x5627943541b0 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.252+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3461472408 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68dc019070 con 0x5627943541b0 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.253+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3461472408 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 69) ==== 8374+0+0 (secure 0 0 0) 0x7f68dc013070 con 0x5627943541b0 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.253+0000 7f68edf2c740 10 client.30377 fetch_fsmap finished waiting for FSMap version 69 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.253+0000 7f68edf2c740 10 client.30377 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.253+0000 7f68edf2c740 20 client.30377 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.253+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56279433b9f0 0x56279473fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.253+0000 7f68edf2c740 4 client.30377 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.253+0000 7f68edf2c740 1 -- 172.21.15.53:0/3461472408 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56279469b5d0 con 0x56279433b9f0 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.254+0000 7f68e4f52640 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56279433b9f0 0x56279473fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.255+0000 7f68e4f52640 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56279433b9f0 0x56279473fd00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=efea3044b068c987 server_cookie=209e4358ea3665d6 in_seq=0 out_seq=0 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.255+0000 7f68c8ff9640 10 client.30377 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:24:47.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.256+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3461472408 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56279469b5d0 con 0x56279433b9f0 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.256+0000 7f68c8ff9640 10 client.30377 handle_command_reply: tid=0 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.256+0000 7f68edf2c740 1 client.30377 shutdown 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.256+0000 7f68edf2c740 1 -- 172.21.15.53:0/3461472408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 msgr2=0x56279472daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.256+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x56279472daa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f68dc004700 tx=0x7f68dc014660 comp rx=0 tx=0).stop 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.257+0000 7f68edf2c740 1 -- 172.21.15.53:0/3461472408 shutdown_connections 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.257+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56279433b9f0 0x56279473fd00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.257+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 0x562794739e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.257+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279435c390 0x56279472dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.257+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3461472408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x56279472daa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.257+0000 7f68edf2c740 1 -- 172.21.15.53:0/3461472408 >> 172.21.15.53:0/3461472408 conn(0x562794371460 msgr2=0x5627947254f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.257+0000 7f68c8ff9640 0 client.30377 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.257+0000 7f68edf2c740 1 -- 172.21.15.53:0/3461472408 shutdown_connections 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.257+0000 7f68edf2c740 1 -- 172.21.15.53:0/3461472408 wait complete. 2024-08-31T06:24:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.257+0000 7f68edf2c740 20 client.30377 trim_cache size 0 max 16384 2024-08-31T06:24:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.276+0000 7f68edf2c740 1 Processor -- start 2024-08-31T06:24:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.276+0000 7f68edf2c740 1 -- start start 2024-08-31T06:24:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627943541b0 0x56279472c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56279435c390 0x56279472c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 0x562794725410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68edf2c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68e01ad480 con 0x5627943541b0 2024-08-31T06:24:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68edf2c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f68e01af050 con 0x56279435c390 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68edf2c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68e01adbb0 con 0x56279437d070 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e5753640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627943541b0 0x56279472c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e4f52640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56279435c390 0x56279472c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e5753640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627943541b0 0x56279472c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45690/0 (socket says 172.21.15.53:45690) 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e4f52640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56279435c390 0x56279472c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47954/0 (socket says 172.21.15.53:47954) 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e5753640 1 -- 172.21.15.53:0/1727433632 learned_addr learned my addr 172.21.15.53:0/1727433632 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e5f54640 1 --2- 172.21.15.53:0/1727433632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 0x562794725410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e4f52640 1 -- 172.21.15.53:0/1727433632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 msgr2=0x562794725410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e4f52640 1 --2- 172.21.15.53:0/1727433632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 0x562794725410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e4f52640 1 -- 172.21.15.53:0/1727433632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627943541b0 msgr2=0x56279472c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e4f52640 1 --2- 172.21.15.53:0/1727433632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627943541b0 0x56279472c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e4f52640 1 -- 172.21.15.53:0/1727433632 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56279473a5b0 con 0x56279435c390 2024-08-31T06:24:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.277+0000 7f68e5f54640 1 --2- 172.21.15.53:0/1727433632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 0x562794725410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.278+0000 7f68e4f52640 1 --2- 172.21.15.53:0/1727433632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56279435c390 0x56279472c860 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f68d0005ab0 tx=0x7f68d003f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a58d167f0d71984 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.278+0000 7f68caffd640 1 -- 172.21.15.53:0/1727433632 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0035040 con 0x56279435c390 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.278+0000 7f68caffd640 1 -- 172.21.15.53:0/1727433632 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68d0003a80 con 0x56279435c390 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.278+0000 7f68caffd640 1 -- 172.21.15.53:0/1727433632 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d004b8f0 con 0x56279435c390 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.279+0000 7f68edf2c740 1 -- 172.21.15.53:0/1727433632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56279435c390 msgr2=0x56279472c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.279+0000 7f68edf2c740 1 --2- 172.21.15.53:0/1727433632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56279435c390 0x56279472c860 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f68d0005ab0 tx=0x7f68d003f040 comp rx=0 tx=0).stop 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.279+0000 7f68edf2c740 1 -- 172.21.15.53:0/1727433632 shutdown_connections 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.279+0000 7f68edf2c740 1 --2- 172.21.15.53:0/1727433632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279437d070 0x562794725410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.279+0000 7f68edf2c740 1 --2- 172.21.15.53:0/1727433632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56279435c390 0x56279472c860 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.279+0000 7f68edf2c740 1 --2- 172.21.15.53:0/1727433632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627943541b0 0x56279472c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.279+0000 7f68edf2c740 1 -- 172.21.15.53:0/1727433632 >> 172.21.15.53:0/1727433632 conn(0x562794371460 msgr2=0x562794728be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.279+0000 7f68edf2c740 1 -- 172.21.15.53:0/1727433632 shutdown_connections 2024-08-31T06:24:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.279+0000 7f68edf2c740 1 -- 172.21.15.53:0/1727433632 wait complete. 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.280+0000 7f68edf2c740 1 -- start start 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.280+0000 7f68edf2c740 1 Processor -- start 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x562794731540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 0x562794731a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68edf2c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 0x5627947a8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68edf2c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68e01ae950 con 0x56279437d070 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68edf2c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f68e01ae280 con 0x5627943541b0 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68edf2c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68e01ab480 con 0x56279435c390 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68edf2c740 10 client.0 _ll_register_callbacks cb 0x7f68d0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68e4f52640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 0x562794731a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68e4f52640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 0x562794731a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:47354/0 (socket says 172.21.15.53:47354) 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68e4f52640 1 -- 172.21.15.53:0/3316282826 learned_addr learned my addr 172.21.15.53:0/3316282826 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68e5f54640 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 0x5627947a8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68e5753640 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x562794731540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68e4f52640 1 -- 172.21.15.53:0/3316282826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 msgr2=0x562794731540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68e4f52640 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x562794731540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68e4f52640 1 -- 172.21.15.53:0/3316282826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 msgr2=0x5627947a8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68e4f52640 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 0x5627947a8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68e4f52640 1 -- 172.21.15.53:0/3316282826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627947a8ac0 con 0x56279435c390 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.281+0000 7f68e5f54640 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 0x5627947a8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.282+0000 7f68e4f52640 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 0x562794731a80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f68d002a450 tx=0x7f68d004b450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3914a8bc127f5da server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.282+0000 7f68c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.282+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3316282826 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0035030 con 0x56279435c390 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.282+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3316282826 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f68d00035f0 con 0x56279435c390 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.282+0000 7f68edf2c740 1 -- 172.21.15.53:0/3316282826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68d0003a80 con 0x56279435c390 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.282+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3316282826 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f68d00037f0 con 0x56279435c390 2024-08-31T06:24:47.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.282+0000 7f68edf2c740 10 client.30388 fetch_fsmap learned FSMap version 69 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.282+0000 7f68edf2c740 1 -- 172.21.15.53:0/3316282826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x5627947a9d40 con 0x56279435c390 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.283+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3316282826 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68d0003a80 con 0x56279435c390 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.283+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3316282826 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 69) ==== 8374+0+0 (secure 0 0 0) 0x7f68d0048040 con 0x56279435c390 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.283+0000 7f68edf2c740 10 client.30388 fetch_fsmap finished waiting for FSMap version 69 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.283+0000 7f68edf2c740 10 client.30388 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.283+0000 7f68edf2c740 20 client.30388 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.283+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x562794310da0 0x5627947ac410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.283+0000 7f68edf2c740 4 client.30388 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.283+0000 7f68edf2c740 1 -- 172.21.15.53:0/3316282826 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562794697070 con 0x562794310da0 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.283+0000 7f68e5753640 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x562794310da0 0x5627947ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.284+0000 7f68e5753640 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x562794310da0 0x5627947ac410 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e223cec1b13b6f6 server_cookie=ba2cce3bbe7f1d81 in_seq=0 out_seq=0 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.284+0000 7f68c8ff9640 10 client.30388 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:24:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.284+0000 7f68c8ff9640 1 -- 172.21.15.53:0/3316282826 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562794697070 con 0x562794310da0 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.284+0000 7f68c8ff9640 10 client.30388 handle_command_reply: tid=0 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.284+0000 7f68edf2c740 1 client.30388 shutdown 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.284+0000 7f68edf2c740 1 -- 172.21.15.53:0/3316282826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 msgr2=0x562794731a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.284+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 0x562794731a80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f68d002a450 tx=0x7f68d004b450 comp rx=0 tx=0).stop 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.285+0000 7f68edf2c740 1 -- 172.21.15.53:0/3316282826 shutdown_connections 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.285+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x562794310da0 0x5627947ac410 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.285+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56279437d070 0x5627947a8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.285+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56279435c390 0x562794731a80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.285+0000 7f68edf2c740 1 --2- 172.21.15.53:0/3316282826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627943541b0 0x562794731540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.285+0000 7f68edf2c740 1 -- 172.21.15.53:0/3316282826 >> 172.21.15.53:0/3316282826 conn(0x562794371460 msgr2=0x56279472d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.285+0000 7f68c8ff9640 0 client.30388 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.285+0000 7f68edf2c740 1 -- 172.21.15.53:0/3316282826 shutdown_connections 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.285+0000 7f68edf2c740 1 -- 172.21.15.53:0/3316282826 wait complete. 2024-08-31T06:24:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.285+0000 7f68edf2c740 20 client.30388 trim_cache size 0 max 16384 2024-08-31T06:24:47.295 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:24:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.286+0000 7f68e79b7640 1 -- 172.21.15.53:0/1184825607 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68cc0b4d20 msgr2=0x7f68cc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.286+0000 7f68e79b7640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68cc0b4d20 0x7f68cc0b7230 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f68d0006010 tx=0x7f68d0005a40 comp rx=0 tx=0).stop 2024-08-31T06:24:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.286+0000 7f68e79b7640 1 -- 172.21.15.53:0/1184825607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e0109bc0 msgr2=0x7f68e0075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.286+0000 7f68e79b7640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e0109bc0 0x7f68e0075f30 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f68d800b970 tx=0x7f68d800be30 comp rx=0 tx=0).stop 2024-08-31T06:24:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.287+0000 7f68e79b7640 1 -- 172.21.15.53:0/1184825607 shutdown_connections 2024-08-31T06:24:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.287+0000 7f68e79b7640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68cc0b4d20 0x7f68cc0b7230 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.287+0000 7f68e79b7640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e0109bc0 0x7f68e0075f30 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.287+0000 7f68e79b7640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68e0109270 0x7f68e00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.287+0000 7f68e79b7640 1 --2- 172.21.15.53:0/1184825607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68e0103930 0x7f68e00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.287+0000 7f68e79b7640 1 -- 172.21.15.53:0/1184825607 >> 172.21.15.53:0/1184825607 conn(0x7f68e00ff3a0 msgr2=0x7f68e01017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.287+0000 7f68e79b7640 1 -- 172.21.15.53:0/1184825607 shutdown_connections 2024-08-31T06:24:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:47.287+0000 7f68e79b7640 1 -- 172.21.15.53:0/1184825607 wait complete. 2024-08-31T06:24:47.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 40944 5.23 MB/sec execute 275 sec latency 224.298 ms 2024-08-31T06:24:47.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:24:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:47 smithi130 ceph-mon[22266]: pgmap v946: 97 pgs: 97 active+clean; 712 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.3 MiB/s wr, 97 op/s 2024-08-31T06:24:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:47 smithi153 ceph-mon[22320]: pgmap v946: 97 pgs: 97 active+clean; 712 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.3 MiB/s wr, 97 op/s 2024-08-31T06:24:48.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:47 smithi053 ceph-mon[18924]: pgmap v946: 97 pgs: 97 active+clean; 712 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.3 MiB/s wr, 97 op/s 2024-08-31T06:24:48.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 41120 5.24 MB/sec execute 276 sec latency 67.504 ms 2024-08-31T06:24:48.393 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:48.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.967+0000 7f25bfd3f640 1 -- 172.21.15.53:0/1295320893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b8106040 msgr2=0x7f25b8106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:48.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.967+0000 7f25bfd3f640 1 --2- 172.21.15.53:0/1295320893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b8106040 0x7f25b8106450 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009890 tx=0x7f25a802a360 comp rx=0 tx=0).stop 2024-08-31T06:24:48.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.967+0000 7f25bfd3f640 1 -- 172.21.15.53:0/1295320893 shutdown_connections 2024-08-31T06:24:48.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.967+0000 7f25bfd3f640 1 --2- 172.21.15.53:0/1295320893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b8106990 0x7f25b8110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.967+0000 7f25bfd3f640 1 --2- 172.21.15.53:0/1295320893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b8106040 0x7f25b8106450 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.967+0000 7f25bfd3f640 1 --2- 172.21.15.53:0/1295320893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b8101df0 0x7f25b8102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.967+0000 7f25bfd3f640 1 -- 172.21.15.53:0/1295320893 >> 172.21.15.53:0/1295320893 conn(0x7f25b8077a00 msgr2=0x7f25b8077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:48.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.967+0000 7f25bfd3f640 1 -- 172.21.15.53:0/1295320893 shutdown_connections 2024-08-31T06:24:48.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.967+0000 7f25bfd3f640 1 -- 172.21.15.53:0/1295320893 wait complete. 2024-08-31T06:24:48.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25bfd3f640 1 Processor -- start 2024-08-31T06:24:48.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25bfd3f640 1 -- start start 2024-08-31T06:24:48.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25bfd3f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b8101df0 0x7f25b8102d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:48.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25bfd3f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b8106040 0x7f25b81032d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:48.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25bfd3f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b8106990 0x7f25b8103810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25bfd3f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81136f0 con 0x7f25b8106040 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25bfd3f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8113570 con 0x7f25b8101df0 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25bfd3f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8113870 con 0x7f25b8106990 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25be2dc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b8106990 0x7f25b8103810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25bd2da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b8106040 0x7f25b81032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25be2dc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b8106990 0x7f25b8103810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:47368/0 (socket says 172.21.15.53:47368) 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.968+0000 7f25be2dc640 1 -- 172.21.15.53:0/855131587 learned_addr learned my addr 172.21.15.53:0/855131587 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.969+0000 7f25bdadb640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b8101df0 0x7f25b8102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.969+0000 7f25bdadb640 1 -- 172.21.15.53:0/855131587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b8106990 msgr2=0x7f25b8103810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.969+0000 7f25bdadb640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b8106990 0x7f25b8103810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.969+0000 7f25bdadb640 1 -- 172.21.15.53:0/855131587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b8106040 msgr2=0x7f25b81032d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.969+0000 7f25bdadb640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b8106040 0x7f25b81032d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.969+0000 7f25bdadb640 1 -- 172.21.15.53:0/855131587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b81a84e0 con 0x7f25b8101df0 2024-08-31T06:24:48.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.969+0000 7f25bdadb640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b8101df0 0x7f25b8102d90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f25b400d6a0 tx=0x7f25b400db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:48.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.969+0000 7f25aeffd640 1 -- 172.21.15.53:0/855131587 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4017070 con 0x7f25b8101df0 2024-08-31T06:24:48.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.969+0000 7f25aeffd640 1 -- 172.21.15.53:0/855131587 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25b4009cb0 con 0x7f25b8101df0 2024-08-31T06:24:48.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.969+0000 7f25bfd3f640 1 -- 172.21.15.53:0/855131587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b81a87d0 con 0x7f25b8101df0 2024-08-31T06:24:48.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.969+0000 7f25aeffd640 1 -- 172.21.15.53:0/855131587 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4003b40 con 0x7f25b8101df0 2024-08-31T06:24:48.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.970+0000 7f25bfd3f640 1 -- 172.21.15.53:0/855131587 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b81a8ce0 con 0x7f25b8101df0 2024-08-31T06:24:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.973+0000 7f25c62b4740 1 Processor -- start 2024-08-31T06:24:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.973+0000 7f25aeffd640 1 -- 172.21.15.53:0/855131587 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f25b4003ce0 con 0x7f25b8101df0 2024-08-31T06:24:48.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.973+0000 7f25c62b4740 1 -- start start 2024-08-31T06:24:48.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.973+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd67070 0x55f2dd10c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:48.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.973+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd10c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:48.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.973+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd46390 0x55f2dd10cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:48.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.973+0000 7f25c62b4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f2dd083680 con 0x55f2dcd3e1b0 2024-08-31T06:24:48.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.973+0000 7f25c62b4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f2dd072c10 con 0x55f2dcd67070 2024-08-31T06:24:48.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.973+0000 7f25c62b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f2dd076bc0 con 0x55f2dcd46390 2024-08-31T06:24:48.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25be2dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd67070 0x55f2dd10c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:48.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25bdadb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd10c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:48.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25be2dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd67070 0x55f2dd10c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47988/0 (socket says 172.21.15.53:47988) 2024-08-31T06:24:48.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25be2dc640 1 -- 172.21.15.53:0/3480129630 learned_addr learned my addr 172.21.15.53:0/3480129630 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:48.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25bd2da640 1 --2- 172.21.15.53:0/3480129630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd46390 0x55f2dd10cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:48.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25be2dc640 1 -- 172.21.15.53:0/3480129630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd46390 msgr2=0x55f2dd10cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:48.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25be2dc640 1 --2- 172.21.15.53:0/3480129630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd46390 0x55f2dd10cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25be2dc640 1 -- 172.21.15.53:0/3480129630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 msgr2=0x55f2dd10c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:48.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25be2dc640 1 --2- 172.21.15.53:0/3480129630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd10c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25be2dc640 1 -- 172.21.15.53:0/3480129630 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2dcdd2650 con 0x55f2dcd67070 2024-08-31T06:24:48.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25aeffd640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f25a40b4da0 0x7f25a40b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:48.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25be2dc640 1 --2- 172.21.15.53:0/3480129630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd67070 0x55f2dd10c350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009fd0 tx=0x7f25b00095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccb246fa65de59 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:48.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.974+0000 7f25bdadb640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f25a40b4da0 0x7f25a40b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:48.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.975+0000 7f25aeffd640 1 -- 172.21.15.53:0/855131587 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f25b40e51c0 con 0x7f25b8101df0 2024-08-31T06:24:48.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.975+0000 7f25a3fff640 1 -- 172.21.15.53:0/3480129630 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b000d910 con 0x55f2dcd67070 2024-08-31T06:24:48.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.975+0000 7f25a3fff640 1 -- 172.21.15.53:0/3480129630 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25b001c070 con 0x55f2dcd67070 2024-08-31T06:24:48.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.975+0000 7f25a3fff640 1 -- 172.21.15.53:0/3480129630 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0017d80 con 0x55f2dcd67070 2024-08-31T06:24:48.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.975+0000 7f25c62b4740 1 -- 172.21.15.53:0/3480129630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd67070 msgr2=0x55f2dd10c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:48.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.975+0000 7f25bdadb640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f25a40b4da0 0x7f25a40b72b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55f2dd10afd0 tx=0x7f25b4004220 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:48.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.975+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3480129630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd67070 0x55f2dd10c350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009fd0 tx=0x7f25b00095c0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.976+0000 7f25c62b4740 1 -- 172.21.15.53:0/3480129630 shutdown_connections 2024-08-31T06:24:48.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.976+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3480129630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd46390 0x55f2dd10cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.976+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3480129630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd10c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.976+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3480129630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd67070 0x55f2dd10c350 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.976+0000 7f25c62b4740 1 -- 172.21.15.53:0/3480129630 >> 172.21.15.53:0/3480129630 conn(0x55f2dcd5b460 msgr2=0x55f2dd10a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:48.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.976+0000 7f25c62b4740 1 -- 172.21.15.53:0/3480129630 shutdown_connections 2024-08-31T06:24:48.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.976+0000 7f25c62b4740 1 -- 172.21.15.53:0/3480129630 wait complete. 2024-08-31T06:24:48.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.976+0000 7f25c62b4740 1 -- start start 2024-08-31T06:24:48.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.976+0000 7f25c62b4740 1 Processor -- start 2024-08-31T06:24:48.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd117ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:48.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd46390 0x55f2dd118020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:48.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd67070 0x55f2dd123e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:48.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25c62b4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f2dced5700 con 0x55f2dcd3e1b0 2024-08-31T06:24:48.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25c62b4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f2dcff9750 con 0x55f2dcd46390 2024-08-31T06:24:48.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25c62b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f2dd11ab30 con 0x55f2dcd67070 2024-08-31T06:24:48.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25c62b4740 10 client.0 _ll_register_callbacks cb 0x55f2dd028e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:48.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25be2dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd117ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:48.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25bd2da640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd46390 0x55f2dd118020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:48.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25bd2da640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd46390 0x55f2dd118020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48002/0 (socket says 172.21.15.53:48002) 2024-08-31T06:24:48.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25bd2da640 1 -- 172.21.15.53:0/3866712997 learned_addr learned my addr 172.21.15.53:0/3866712997 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:48.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25be2dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd117ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45736/0 (socket says 172.21.15.53:45736) 2024-08-31T06:24:48.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25bd2da640 1 -- 172.21.15.53:0/3866712997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd67070 msgr2=0x55f2dd123e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:48.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25bd2da640 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd67070 0x55f2dd123e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.977+0000 7f25bd2da640 1 -- 172.21.15.53:0/3866712997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 msgr2=0x55f2dd117ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.978+0000 7f25bd2da640 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd117ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.978+0000 7f25bd2da640 1 -- 172.21.15.53:0/3866712997 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2dd032900 con 0x55f2dcd46390 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.978+0000 7f25be2dc640 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd117ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.978+0000 7f25bd2da640 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd46390 0x55f2dd118020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f25a8035040 tx=0x7f25a8030ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=286ffbdbfe410e5f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.978+0000 7f25a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.978+0000 7f25a17fa640 1 -- 172.21.15.53:0/3866712997 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8037040 con 0x55f2dcd46390 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.978+0000 7f25c62b4740 1 -- 172.21.15.53:0/3866712997 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25b001c070 con 0x55f2dcd46390 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.978+0000 7f25a17fa640 1 -- 172.21.15.53:0/3866712997 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f25a8004240 con 0x55f2dcd46390 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.978+0000 7f25a17fa640 1 -- 172.21.15.53:0/3866712997 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f25a804d050 con 0x55f2dcd46390 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.979+0000 7f25c62b4740 10 client.30395 fetch_fsmap learned FSMap version 69 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.979+0000 7f25c62b4740 1 -- 172.21.15.53:0/3866712997 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x55f2dd126910 con 0x55f2dcd46390 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.979+0000 7f25a17fa640 1 -- 172.21.15.53:0/3866712997 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25b001c070 con 0x55f2dcd46390 2024-08-31T06:24:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.979+0000 7f25a17fa640 1 -- 172.21.15.53:0/3866712997 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 69) ==== 8374+0+0 (secure 0 0 0) 0x7f25a80051c0 con 0x55f2dcd46390 2024-08-31T06:24:48.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.979+0000 7f25c62b4740 10 client.30395 fetch_fsmap finished waiting for FSMap version 69 2024-08-31T06:24:48.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.979+0000 7f25c62b4740 10 client.30395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:48.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.979+0000 7f25c62b4740 20 client.30395 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:48.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.979+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f2dcd259f0 0x55f2dd129e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:48.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.979+0000 7f25c62b4740 4 client.30395 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:48.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.979+0000 7f25c62b4740 1 -- 172.21.15.53:0/3866712997 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2dd0855d0 con 0x55f2dcd259f0 2024-08-31T06:24:48.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.980+0000 7f25be2dc640 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f2dcd259f0 0x55f2dd129e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:48.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.980+0000 7f25a17fa640 10 client.30395 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:48.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.980+0000 7f25be2dc640 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f2dcd259f0 0x55f2dd129e70 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46a67d9d1e68f573 server_cookie=bbdbf38f5b39a3de in_seq=0 out_seq=0 2024-08-31T06:24:48.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.981+0000 7f25a17fa640 1 -- 172.21.15.53:0/3866712997 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2dd0855d0 con 0x55f2dcd259f0 2024-08-31T06:24:48.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.981+0000 7f25a17fa640 10 client.30395 handle_command_reply: tid=0 2024-08-31T06:24:48.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.981+0000 7f25c62b4740 1 client.30395 shutdown 2024-08-31T06:24:48.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.981+0000 7f25c62b4740 1 -- 172.21.15.53:0/3866712997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd46390 msgr2=0x55f2dd118020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:48.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.981+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd46390 0x55f2dd118020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f25a8035040 tx=0x7f25a8030ce0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.982+0000 7f25c62b4740 1 -- 172.21.15.53:0/3866712997 shutdown_connections 2024-08-31T06:24:48.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.982+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f2dcd259f0 0x55f2dd129e70 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.982+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd67070 0x55f2dd123e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.982+0000 7f25a17fa640 0 client.30395 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:48.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.982+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd46390 0x55f2dd118020 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.982+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3866712997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd117ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:48.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.982+0000 7f25c62b4740 1 -- 172.21.15.53:0/3866712997 >> 172.21.15.53:0/3866712997 conn(0x55f2dcd5b460 msgr2=0x55f2dd10f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:48.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.982+0000 7f25c62b4740 1 -- 172.21.15.53:0/3866712997 shutdown_connections 2024-08-31T06:24:48.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.982+0000 7f25c62b4740 1 -- 172.21.15.53:0/3866712997 wait complete. 2024-08-31T06:24:48.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:48.982+0000 7f25c62b4740 20 client.30395 trim_cache size 0 max 16384 2024-08-31T06:24:49.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.001+0000 7f25c62b4740 1 Processor -- start 2024-08-31T06:24:49.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.001+0000 7f25c62b4740 1 -- start start 2024-08-31T06:24:49.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.001+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 0x55f2dd10da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:49.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.001+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd123d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:49.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.001+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd46390 0x55f2dd114cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:49.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.001+0000 7f25c62b4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81ad320 con 0x55f2dcd46390 2024-08-31T06:24:49.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.001+0000 7f25c62b4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81aeef0 con 0x55f2dcd259f0 2024-08-31T06:24:49.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.001+0000 7f25c62b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81ada50 con 0x55f2dcd3e1b0 2024-08-31T06:24:49.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.001+0000 7f25be2dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd46390 0x55f2dd114cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:49.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.001+0000 7f25be2dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd46390 0x55f2dd114cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45750/0 (socket says 172.21.15.53:45750) 2024-08-31T06:24:49.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.002+0000 7f25be2dc640 1 -- 172.21.15.53:0/1957401840 learned_addr learned my addr 172.21.15.53:0/1957401840 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:49.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.002+0000 7f25bd2da640 1 --2- 172.21.15.53:0/1957401840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd123d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:49.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.002+0000 7f25be2dc640 1 --2- 172.21.15.53:0/1957401840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 0x55f2dd10da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:49.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.002+0000 7f25bd2da640 1 -- 172.21.15.53:0/1957401840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 msgr2=0x55f2dd10da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:49.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.002+0000 7f25bd2da640 1 --2- 172.21.15.53:0/1957401840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 0x55f2dd10da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.002+0000 7f25bd2da640 1 -- 172.21.15.53:0/1957401840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd46390 msgr2=0x55f2dd114cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:49.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.002+0000 7f25bd2da640 1 --2- 172.21.15.53:0/1957401840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd46390 0x55f2dd114cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.002+0000 7f25bd2da640 1 -- 172.21.15.53:0/1957401840 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2dd10e640 con 0x55f2dcd3e1b0 2024-08-31T06:24:49.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.002+0000 7f25bd2da640 1 --2- 172.21.15.53:0/1957401840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd123d20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25a802a3a0 tx=0x7f25a802aca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fffa01b6ed3b31b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:49.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.002+0000 7f25a37fe640 1 -- 172.21.15.53:0/1957401840 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8037050 con 0x55f2dcd3e1b0 2024-08-31T06:24:49.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.003+0000 7f25a37fe640 1 -- 172.21.15.53:0/1957401840 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25a8056070 con 0x55f2dcd3e1b0 2024-08-31T06:24:49.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.003+0000 7f25a37fe640 1 -- 172.21.15.53:0/1957401840 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8004df0 con 0x55f2dcd3e1b0 2024-08-31T06:24:49.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.003+0000 7f25c62b4740 1 -- 172.21.15.53:0/1957401840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd3e1b0 msgr2=0x55f2dd123d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:49.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.003+0000 7f25c62b4740 1 --2- 172.21.15.53:0/1957401840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd123d20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25a802a3a0 tx=0x7f25a802aca0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.003+0000 7f25c62b4740 1 -- 172.21.15.53:0/1957401840 shutdown_connections 2024-08-31T06:24:49.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.003+0000 7f25c62b4740 1 --2- 172.21.15.53:0/1957401840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd46390 0x55f2dd114cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.004+0000 7f25c62b4740 1 --2- 172.21.15.53:0/1957401840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd123d20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.004+0000 7f25c62b4740 1 --2- 172.21.15.53:0/1957401840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 0x55f2dd10da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.004+0000 7f25c62b4740 1 -- 172.21.15.53:0/1957401840 >> 172.21.15.53:0/1957401840 conn(0x55f2dcd5b460 msgr2=0x55f2dd10d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:49.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.004+0000 7f25c62b4740 1 -- 172.21.15.53:0/1957401840 shutdown_connections 2024-08-31T06:24:49.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.004+0000 7f25c62b4740 1 -- 172.21.15.53:0/1957401840 wait complete. 2024-08-31T06:24:49.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.004+0000 7f25c62b4740 1 -- start start 2024-08-31T06:24:49.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.004+0000 7f25c62b4740 1 Processor -- start 2024-08-31T06:24:49.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 0x55f2dd120290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:49.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd11c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:49.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25c62b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd46390 0x55f2dd11cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:49.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25c62b4740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81ae7f0 con 0x55f2dcd3e1b0 2024-08-31T06:24:49.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25c62b4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81ae120 con 0x55f2dcd259f0 2024-08-31T06:24:49.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25c62b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81ab320 con 0x55f2dcd46390 2024-08-31T06:24:49.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25c62b4740 10 client.0 _ll_register_callbacks cb 0x7f25a80096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:49.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25be2dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 0x55f2dd120290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:49.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25be2dc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 0x55f2dd120290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48020/0 (socket says 172.21.15.53:48020) 2024-08-31T06:24:49.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25be2dc640 1 -- 172.21.15.53:0/3675493240 learned_addr learned my addr 172.21.15.53:0/3675493240 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:49.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25bd2da640 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd11c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25be2dc640 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd46390 0x55f2dd11cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25be2dc640 1 -- 172.21.15.53:0/3675493240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd46390 msgr2=0x55f2dd11cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25be2dc640 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd46390 0x55f2dd11cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25be2dc640 1 -- 172.21.15.53:0/3675493240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 msgr2=0x55f2dd11c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25be2dc640 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd11c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.005+0000 7f25be2dc640 1 -- 172.21.15.53:0/3675493240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2dd11d1d0 con 0x55f2dcd259f0 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.006+0000 7f25be2dc640 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 0x55f2dd120290 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009620 tx=0x7f25b0025040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3bdf2e5a83772fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.006+0000 7f25a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.006+0000 7f25a17fa640 1 -- 172.21.15.53:0/3675493240 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0031070 con 0x55f2dcd259f0 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.006+0000 7f25a17fa640 1 -- 172.21.15.53:0/3675493240 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f25b000d710 con 0x55f2dcd259f0 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.006+0000 7f25c62b4740 1 -- 172.21.15.53:0/3675493240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25a8056070 con 0x55f2dcd259f0 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.006+0000 7f25a17fa640 1 -- 172.21.15.53:0/3675493240 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f25b000d910 con 0x55f2dcd259f0 2024-08-31T06:24:49.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.006+0000 7f25c62b4740 10 client.30401 fetch_fsmap learned FSMap version 69 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.006+0000 7f25c62b4740 1 -- 172.21.15.53:0/3675493240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x55f2dd1954a0 con 0x55f2dcd259f0 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.007+0000 7f25a17fa640 1 -- 172.21.15.53:0/3675493240 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25b0032040 con 0x55f2dcd259f0 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.007+0000 7f25a17fa640 1 -- 172.21.15.53:0/3675493240 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 69) ==== 8374+0+0 (secure 0 0 0) 0x7f25b000b040 con 0x55f2dcd259f0 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.007+0000 7f25c62b4740 10 client.30401 fetch_fsmap finished waiting for FSMap version 69 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.007+0000 7f25c62b4740 10 client.30401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.007+0000 7f25c62b4740 20 client.30401 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.007+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f2dcd67070 0x55f2dd1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.007+0000 7f25c62b4740 4 client.30401 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.007+0000 7f25c62b4740 1 -- 172.21.15.53:0/3675493240 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f25a8056070 con 0x55f2dcd67070 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.007+0000 7f25bd2da640 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f2dcd67070 0x55f2dd1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.007+0000 7f25a17fa640 10 client.30401 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25bd2da640 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f2dcd67070 0x55f2dd1979e0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5f44be71b77ed9a server_cookie=817b9ad72df91782 in_seq=0 out_seq=0 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25a17fa640 1 -- 172.21.15.53:0/3675493240 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f25a8056070 con 0x55f2dcd67070 2024-08-31T06:24:49.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25a17fa640 10 client.30401 handle_command_reply: tid=0 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 1 client.30401 shutdown 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 1 -- 172.21.15.53:0/3675493240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 msgr2=0x55f2dd120290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 0x55f2dd120290 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009620 tx=0x7f25b0025040 comp rx=0 tx=0).stop 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 1 -- 172.21.15.53:0/3675493240 shutdown_connections 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f2dcd67070 0x55f2dd1979e0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f2dcd46390 0x55f2dd11cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2dcd3e1b0 0x55f2dd11c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 1 --2- 172.21.15.53:0/3675493240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f2dcd259f0 0x55f2dd120290 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 1 -- 172.21.15.53:0/3675493240 >> 172.21.15.53:0/3675493240 conn(0x55f2dcd5b460 msgr2=0x55f2dd10d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25a17fa640 0 client.30401 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 1 -- 172.21.15.53:0/3675493240 shutdown_connections 2024-08-31T06:24:49.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 1 -- 172.21.15.53:0/3675493240 wait complete. 2024-08-31T06:24:49.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.008+0000 7f25c62b4740 20 client.30401 trim_cache size 0 max 16384 2024-08-31T06:24:49.017 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:24:49.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 -- 172.21.15.53:0/855131587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f25a40b4da0 msgr2=0x7f25a40b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:49.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f25a40b4da0 0x7f25a40b72b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55f2dd10afd0 tx=0x7f25b4004220 comp rx=0 tx=0).stop 2024-08-31T06:24:49.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 -- 172.21.15.53:0/855131587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b8101df0 msgr2=0x7f25b8102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:49.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b8101df0 0x7f25b8102d90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f25b400d6a0 tx=0x7f25b400db60 comp rx=0 tx=0).stop 2024-08-31T06:24:49.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 -- 172.21.15.53:0/855131587 shutdown_connections 2024-08-31T06:24:49.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f25a40b4da0 0x7f25a40b72b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25b8106990 0x7f25b8103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b8106040 0x7f25b81032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 --2- 172.21.15.53:0/855131587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25b8101df0 0x7f25b8102d90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:49.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 -- 172.21.15.53:0/855131587 >> 172.21.15.53:0/855131587 conn(0x7f25b8077a00 msgr2=0x7f25b8107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:49.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 -- 172.21.15.53:0/855131587 shutdown_connections 2024-08-31T06:24:49.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:49.009+0000 7f25bfd3f640 1 -- 172.21.15.53:0/855131587 wait complete. 2024-08-31T06:24:49.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 41271 5.25 MB/sec execute 277 sec latency 184.615 ms 2024-08-31T06:24:49.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:49 smithi053 ceph-mon[18924]: pgmap v947: 97 pgs: 97 active+clean; 716 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 1.8 MiB/s wr, 133 op/s 2024-08-31T06:24:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:49 smithi130 ceph-mon[22266]: pgmap v947: 97 pgs: 97 active+clean; 716 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 1.8 MiB/s wr, 133 op/s 2024-08-31T06:24:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:49 smithi153 ceph-mon[22320]: pgmap v947: 97 pgs: 97 active+clean; 716 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 1.8 MiB/s wr, 133 op/s 2024-08-31T06:24:50.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 41389 5.25 MB/sec execute 278 sec latency 155.783 ms 2024-08-31T06:24:50.739 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:24:50.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:24:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:51.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 41557 5.29 MB/sec execute 279 sec latency 209.060 ms 2024-08-31T06:24:51.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.679+0000 7f204f910640 1 -- 172.21.15.53:0/1640911834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2048109270 msgr2=0x7f2048109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:51.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.679+0000 7f204f910640 1 --2- 172.21.15.53:0/1640911834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2048109270 0x7f2048109680 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f2038009900 tx=0x7f203802a410 comp rx=0 tx=0).stop 2024-08-31T06:24:51.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.679+0000 7f204f910640 1 -- 172.21.15.53:0/1640911834 shutdown_connections 2024-08-31T06:24:51.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.679+0000 7f204f910640 1 --2- 172.21.15.53:0/1640911834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2048109bc0 0x7f20481103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.679+0000 7f204f910640 1 --2- 172.21.15.53:0/1640911834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2048109270 0x7f2048109680 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.679+0000 7f204f910640 1 --2- 172.21.15.53:0/1640911834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2048103930 0x7f2048103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.679+0000 7f204f910640 1 -- 172.21.15.53:0/1640911834 >> 172.21.15.53:0/1640911834 conn(0x7f20480ff3a0 msgr2=0x7f20481017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:51.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.679+0000 7f204f910640 1 -- 172.21.15.53:0/1640911834 shutdown_connections 2024-08-31T06:24:51.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.680+0000 7f204f910640 1 -- 172.21.15.53:0/1640911834 wait complete. 2024-08-31T06:24:51.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.680+0000 7f204f910640 1 Processor -- start 2024-08-31T06:24:51.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204f910640 1 -- start start 2024-08-31T06:24:51.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204f910640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2048103930 0x7f2048076ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204f910640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2048109270 0x7f20480754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204f910640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2048109bc0 0x7f20480759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204f910640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2048113730 con 0x7f2048109270 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204f910640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20481135b0 con 0x7f2048103930 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204f910640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20481138b0 con 0x7f2048109bc0 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204d6ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2048103930 0x7f2048076ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204d6ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2048103930 0x7f2048076ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48030/0 (socket says 172.21.15.53:48030) 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204ceab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2048109270 0x7f20480754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204d6ac640 1 -- 172.21.15.53:0/1528051312 learned_addr learned my addr 172.21.15.53:0/1528051312 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.681+0000 7f204dead640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2048109bc0 0x7f20480759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.682+0000 7f204d6ac640 1 -- 172.21.15.53:0/1528051312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2048109bc0 msgr2=0x7f20480759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.682+0000 7f204d6ac640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2048109bc0 0x7f20480759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.682+0000 7f204d6ac640 1 -- 172.21.15.53:0/1528051312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2048109270 msgr2=0x7f20480754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.682+0000 7f204d6ac640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2048109270 0x7f20480754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.682+0000 7f204d6ac640 1 -- 172.21.15.53:0/1528051312 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2048076210 con 0x7f2048103930 2024-08-31T06:24:51.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.682+0000 7f204d6ac640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2048103930 0x7f2048076ec0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2044009f50 tx=0x7f204400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:51.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.682+0000 7f203e7fc640 1 -- 172.21.15.53:0/1528051312 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204400cce0 con 0x7f2048103930 2024-08-31T06:24:51.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.682+0000 7f203e7fc640 1 -- 172.21.15.53:0/1528051312 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20440218d0 con 0x7f2048103930 2024-08-31T06:24:51.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.682+0000 7f204f910640 1 -- 172.21.15.53:0/1528051312 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204819e2e0 con 0x7f2048103930 2024-08-31T06:24:51.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.683+0000 7f204f910640 1 -- 172.21.15.53:0/1528051312 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204819e840 con 0x7f2048103930 2024-08-31T06:24:51.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.683+0000 7f203e7fc640 1 -- 172.21.15.53:0/1528051312 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044029840 con 0x7f2048103930 2024-08-31T06:24:51.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.686+0000 7f203e7fc640 1 -- 172.21.15.53:0/1528051312 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2044021440 con 0x7f2048103930 2024-08-31T06:24:51.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.687+0000 7f203e7fc640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20340b4d20 0x7f20340b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.688+0000 7f204ceab640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20340b4d20 0x7f20340b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.688+0000 7f203e7fc640 1 -- 172.21.15.53:0/1528051312 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f20440f6610 con 0x7f2048103930 2024-08-31T06:24:51.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.688+0000 7f2055e85740 1 Processor -- start 2024-08-31T06:24:51.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.688+0000 7f2055e85740 1 -- start start 2024-08-31T06:24:51.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f204ceab640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20340b4d20 0x7f20340b7230 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2038005940 tx=0x7f20380058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:51.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f2055e85740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5ea350 0x560c9e990780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f2055e85740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c1490 0x560c9e990cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f2055e85740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e991200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f2055e85740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560c9e9065f0 con 0x560c9e5c1490 2024-08-31T06:24:51.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f2055e85740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560c9e8f5b80 con 0x560c9e5c9670 2024-08-31T06:24:51.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f2055e85740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560c9e8f9b30 con 0x560c9e5ea350 2024-08-31T06:24:51.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f204dead640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e991200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f204dead640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e991200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48042/0 (socket says 172.21.15.53:48042) 2024-08-31T06:24:51.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f204ceab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c1490 0x560c9e990cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f204dead640 1 -- 172.21.15.53:0/1833947333 learned_addr learned my addr 172.21.15.53:0/1833947333 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:51.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.689+0000 7f204d6ac640 1 --2- 172.21.15.53:0/1833947333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5ea350 0x560c9e990780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.690+0000 7f204dead640 1 -- 172.21.15.53:0/1833947333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5ea350 msgr2=0x560c9e990780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:51.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.690+0000 7f204dead640 1 --2- 172.21.15.53:0/1833947333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5ea350 0x560c9e990780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.690+0000 7f204dead640 1 -- 172.21.15.53:0/1833947333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c1490 msgr2=0x560c9e990cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:51.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.690+0000 7f204dead640 1 --2- 172.21.15.53:0/1833947333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c1490 0x560c9e990cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.690+0000 7f204dead640 1 -- 172.21.15.53:0/1833947333 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9e655930 con 0x560c9e5c9670 2024-08-31T06:24:51.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.690+0000 7f204d6ac640 1 --2- 172.21.15.53:0/1833947333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5ea350 0x560c9e990780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:24:51.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.690+0000 7f204dead640 1 --2- 172.21.15.53:0/1833947333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e991200 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2040009f90 tx=0x7f20400118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e75f3eb09ec209a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:51.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.690+0000 7f20337fe640 1 -- 172.21.15.53:0/1833947333 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2040004b20 con 0x560c9e5c9670 2024-08-31T06:24:51.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.690+0000 7f20337fe640 1 -- 172.21.15.53:0/1833947333 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2040004cc0 con 0x560c9e5c9670 2024-08-31T06:24:51.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.690+0000 7f20337fe640 1 -- 172.21.15.53:0/1833947333 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2040004860 con 0x560c9e5c9670 2024-08-31T06:24:51.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.691+0000 7f2055e85740 1 -- 172.21.15.53:0/1833947333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 msgr2=0x560c9e991200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.691+0000 7f2055e85740 1 --2- 172.21.15.53:0/1833947333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e991200 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2040009f90 tx=0x7f20400118d0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.692+0000 7f2055e85740 1 -- 172.21.15.53:0/1833947333 shutdown_connections 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.692+0000 7f2055e85740 1 --2- 172.21.15.53:0/1833947333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e991200 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.692+0000 7f2055e85740 1 --2- 172.21.15.53:0/1833947333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c1490 0x560c9e990cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.692+0000 7f2055e85740 1 --2- 172.21.15.53:0/1833947333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5ea350 0x560c9e990780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.692+0000 7f2055e85740 1 -- 172.21.15.53:0/1833947333 >> 172.21.15.53:0/1833947333 conn(0x560c9e5de740 msgr2=0x560c9e98e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.692+0000 7f2055e85740 1 -- 172.21.15.53:0/1833947333 shutdown_connections 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.692+0000 7f2055e85740 1 -- 172.21.15.53:0/1833947333 wait complete. 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.693+0000 7f2055e85740 1 -- start start 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.693+0000 7f2055e85740 1 Processor -- start 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.693+0000 7f2055e85740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e99bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.693+0000 7f2055e85740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 0x560c9e99c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.693+0000 7f2055e85740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 0x560c9e9a82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.693+0000 7f2055e85740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560c9e758890 con 0x560c9e5c9670 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.693+0000 7f2055e85740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560c9e87c790 con 0x560c9e5ea350 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.693+0000 7f2055e85740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560c9e99ef60 con 0x560c9e5c1490 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.693+0000 7f2055e85740 10 client.0 _ll_register_callbacks cb 0x560c9e601ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.693+0000 7f204ceab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 0x560c9e99c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.694+0000 7f204ceab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 0x560c9e99c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45786/0 (socket says 172.21.15.53:45786) 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.694+0000 7f204ceab640 1 -- 172.21.15.53:0/2519794883 learned_addr learned my addr 172.21.15.53:0/2519794883 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.694+0000 7f204dead640 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 0x560c9e9a82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.694+0000 7f204d6ac640 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e99bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.694+0000 7f204ceab640 1 -- 172.21.15.53:0/2519794883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 msgr2=0x560c9e99bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.694+0000 7f204ceab640 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e99bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.694+0000 7f204ceab640 1 -- 172.21.15.53:0/2519794883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 msgr2=0x560c9e9a82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:51.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.694+0000 7f204ceab640 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 0x560c9e9a82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.694+0000 7f204ceab640 1 -- 172.21.15.53:0/2519794883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9e8b3f30 con 0x560c9e5c9670 2024-08-31T06:24:51.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.694+0000 7f204ceab640 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 0x560c9e99c470 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f2038000c00 tx=0x7f2038009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3cdd7f8cf2a3d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:51.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.694+0000 7f2030ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:51.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.695+0000 7f2030ff9640 1 -- 172.21.15.53:0/2519794883 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2038035040 con 0x560c9e5c9670 2024-08-31T06:24:51.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.695+0000 7f2030ff9640 1 -- 172.21.15.53:0/2519794883 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f20380035f0 con 0x560c9e5c9670 2024-08-31T06:24:51.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.695+0000 7f2055e85740 1 -- 172.21.15.53:0/2519794883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2040004cc0 con 0x560c9e5c9670 2024-08-31T06:24:51.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.695+0000 7f2030ff9640 1 -- 172.21.15.53:0/2519794883 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f20380044d0 con 0x560c9e5c9670 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.695+0000 7f2055e85740 10 client.21630 fetch_fsmap learned FSMap version 70 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.695+0000 7f2055e85740 1 -- 172.21.15.53:0/2519794883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x560c9e9aad70 con 0x560c9e5c9670 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.696+0000 7f2030ff9640 1 -- 172.21.15.53:0/2519794883 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2040004cc0 con 0x560c9e5c9670 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.696+0000 7f2030ff9640 1 -- 172.21.15.53:0/2519794883 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) ==== 8378+0+0 (secure 0 0 0) 0x7f203805a990 con 0x560c9e5c9670 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.696+0000 7f2055e85740 10 client.21630 fetch_fsmap finished waiting for FSMap version 70 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.696+0000 7f2055e85740 10 client.21630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.696+0000 7f2055e85740 20 client.21630 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.696+0000 7f2055e85740 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560c9e5a8cd0 0x560c9e9ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.696+0000 7f2055e85740 4 client.21630 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.696+0000 7f2055e85740 1 -- 172.21.15.53:0/2519794883 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c9e908540 con 0x560c9e5a8cd0 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.696+0000 7f204d6ac640 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560c9e5a8cd0 0x560c9e9ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.697+0000 7f204d6ac640 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560c9e5a8cd0 0x560c9e9ae300 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e7c679158f7c242 server_cookie=51d912e93d6e4e8d in_seq=0 out_seq=0 2024-08-31T06:24:51.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.697+0000 7f2030ff9640 10 client.21630 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2030ff9640 1 -- 172.21.15.53:0/2519794883 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c9e908540 con 0x560c9e5a8cd0 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2030ff9640 10 client.21630 handle_command_reply: tid=0 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2055e85740 1 client.21630 shutdown 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2055e85740 1 -- 172.21.15.53:0/2519794883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 msgr2=0x560c9e99c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2055e85740 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 0x560c9e99c470 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f2038000c00 tx=0x7f2038009260 comp rx=0 tx=0).stop 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2055e85740 1 -- 172.21.15.53:0/2519794883 shutdown_connections 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2055e85740 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560c9e5a8cd0 0x560c9e9ae300 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2055e85740 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 0x560c9e9a82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2055e85740 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 0x560c9e99c470 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2055e85740 1 --2- 172.21.15.53:0/2519794883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e99bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2055e85740 1 -- 172.21.15.53:0/2519794883 >> 172.21.15.53:0/2519794883 conn(0x560c9e5de740 msgr2=0x560c9e993910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2030ff9640 0 client.21630 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:51.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2055e85740 1 -- 172.21.15.53:0/2519794883 shutdown_connections 2024-08-31T06:24:51.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.698+0000 7f2055e85740 1 -- 172.21.15.53:0/2519794883 wait complete. 2024-08-31T06:24:51.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.699+0000 7f2055e85740 20 client.21630 trim_cache size 0 max 16384 2024-08-31T06:24:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.726+0000 7f2055e85740 1 Processor -- start 2024-08-31T06:24:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f2055e85740 1 -- start start 2024-08-31T06:24:51.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f2055e85740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e98e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f2055e85740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e9a81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f2055e85740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5ea350 0x560c9e993880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f2055e85740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f202c00e8b0 con 0x560c9e5ea350 2024-08-31T06:24:51.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f2055e85740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f202c0104b0 con 0x560c9e5c9670 2024-08-31T06:24:51.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f2055e85740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f202c00efe0 con 0x560c9e5c1490 2024-08-31T06:24:51.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f204d6ac640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e98e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f204ceab640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e9a81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f204ceab640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e9a81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48062/0 (socket says 172.21.15.53:48062) 2024-08-31T06:24:51.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f204dead640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5ea350 0x560c9e993880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.727+0000 7f204ceab640 1 -- 172.21.15.53:0/2459671513 learned_addr learned my addr 172.21.15.53:0/2459671513 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:51.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.728+0000 7f204ceab640 1 -- 172.21.15.53:0/2459671513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 msgr2=0x560c9e98e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:51.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.728+0000 7f204ceab640 1 --2- 172.21.15.53:0/2459671513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e98e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.728+0000 7f204ceab640 1 -- 172.21.15.53:0/2459671513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5ea350 msgr2=0x560c9e993880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:51.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.728+0000 7f204ceab640 1 --2- 172.21.15.53:0/2459671513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5ea350 0x560c9e993880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.728+0000 7f204ceab640 1 -- 172.21.15.53:0/2459671513 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9e992a70 con 0x560c9e5c9670 2024-08-31T06:24:51.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.728+0000 7f204dead640 1 --2- 172.21.15.53:0/2459671513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5ea350 0x560c9e993880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:51.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.728+0000 7f204ceab640 1 --2- 172.21.15.53:0/2459671513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e9a81b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2038009230 tx=0x7f203802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9995e0f217c397 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:51.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.729+0000 7f2032ffd640 1 -- 172.21.15.53:0/2459671513 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2038068070 con 0x560c9e5c9670 2024-08-31T06:24:51.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.729+0000 7f2032ffd640 1 -- 172.21.15.53:0/2459671513 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f203803cc90 con 0x560c9e5c9670 2024-08-31T06:24:51.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.729+0000 7f2032ffd640 1 -- 172.21.15.53:0/2459671513 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20380035f0 con 0x560c9e5c9670 2024-08-31T06:24:51.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.730+0000 7f2055e85740 1 -- 172.21.15.53:0/2459671513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 msgr2=0x560c9e9a81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:51.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.730+0000 7f2055e85740 1 --2- 172.21.15.53:0/2459671513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e9a81b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2038009230 tx=0x7f203802a410 comp rx=0 tx=0).stop 2024-08-31T06:24:51.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.730+0000 7f2055e85740 1 -- 172.21.15.53:0/2459671513 shutdown_connections 2024-08-31T06:24:51.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.730+0000 7f2055e85740 1 --2- 172.21.15.53:0/2459671513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5ea350 0x560c9e993880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.730+0000 7f2055e85740 1 --2- 172.21.15.53:0/2459671513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5c9670 0x560c9e9a81b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.730+0000 7f2055e85740 1 --2- 172.21.15.53:0/2459671513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e98e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.730+0000 7f2055e85740 1 -- 172.21.15.53:0/2459671513 >> 172.21.15.53:0/2459671513 conn(0x560c9e5de740 msgr2=0x560c9e98dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:51.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.730+0000 7f2055e85740 1 -- 172.21.15.53:0/2459671513 shutdown_connections 2024-08-31T06:24:51.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.730+0000 7f2055e85740 1 -- 172.21.15.53:0/2459671513 wait complete. 2024-08-31T06:24:51.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.731+0000 7f2055e85740 1 -- start start 2024-08-31T06:24:51.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.731+0000 7f2055e85740 1 Processor -- start 2024-08-31T06:24:51.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.731+0000 7f2055e85740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e9a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.731+0000 7f2055e85740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 0x560c9e9a1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.731+0000 7f2055e85740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 0x560c9ea11c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.731+0000 7f2055e85740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f202c00fd80 con 0x560c9e5c9670 2024-08-31T06:24:51.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.731+0000 7f2055e85740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f202c00f6b0 con 0x560c9e5ea350 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.731+0000 7f2055e85740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f202c00c8b0 con 0x560c9e5c1490 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f2055e85740 10 client.0 _ll_register_callbacks cb 0x7f2044005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204dead640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 0x560c9ea11c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204ceab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 0x560c9e9a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204d6ac640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e9a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204dead640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 0x560c9ea11c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48064/0 (socket says 172.21.15.53:48064) 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204dead640 1 -- 172.21.15.53:0/1637781241 learned_addr learned my addr 172.21.15.53:0/1637781241 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204dead640 1 -- 172.21.15.53:0/1637781241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 msgr2=0x560c9e9a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204dead640 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e9a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204dead640 1 -- 172.21.15.53:0/1637781241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 msgr2=0x560c9e9a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204dead640 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 0x560c9e9a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204dead640 1 -- 172.21.15.53:0/1637781241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9ea12300 con 0x560c9e5ea350 2024-08-31T06:24:51.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204ceab640 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 0x560c9e9a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:51.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f204dead640 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 0x560c9ea11c90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2040009f30 tx=0x7f2040003ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=727fbf1577b6fa68 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:51.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.732+0000 7f2030ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.733+0000 7f2030ff9640 1 -- 172.21.15.53:0/1637781241 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2040004260 con 0x560c9e5ea350 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.733+0000 7f2030ff9640 1 -- 172.21.15.53:0/1637781241 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f2040005020 con 0x560c9e5ea350 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.733+0000 7f2055e85740 1 -- 172.21.15.53:0/1637781241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f203803cc90 con 0x560c9e5ea350 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.733+0000 7f2030ff9640 1 -- 172.21.15.53:0/1637781241 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f2040005240 con 0x560c9e5ea350 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.733+0000 7f2055e85740 10 client.30419 fetch_fsmap learned FSMap version 70 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.733+0000 7f2055e85740 1 -- 172.21.15.53:0/1637781241 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x560c9ea19610 con 0x560c9e5ea350 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.733+0000 7f2030ff9640 1 -- 172.21.15.53:0/1637781241 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f203803cc90 con 0x560c9e5ea350 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.734+0000 7f2030ff9640 1 -- 172.21.15.53:0/1637781241 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 70) ==== 8378+0+0 (secure 0 0 0) 0x7f204000f970 con 0x560c9e5ea350 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.734+0000 7f2055e85740 10 client.30419 fetch_fsmap finished waiting for FSMap version 70 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.734+0000 7f2055e85740 10 client.30419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.734+0000 7f2055e85740 20 client.30419 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.734+0000 7f2055e85740 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560c9e57e080 0x560c9ea1bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:51.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.734+0000 7f2055e85740 4 client.30419 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:24:51.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.734+0000 7f2055e85740 1 -- 172.21.15.53:0/1637781241 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560c9e903fe0 con 0x560c9e57e080 2024-08-31T06:24:51.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.734+0000 7f204d6ac640 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560c9e57e080 0x560c9ea1bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:51.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.735+0000 7f2030ff9640 10 client.30419 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:51.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.735+0000 7f204d6ac640 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560c9e57e080 0x560c9ea1bc60 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9d0bf57484485b5 server_cookie=4de804adbf777929 in_seq=0 out_seq=0 2024-08-31T06:24:51.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.737+0000 7f2030ff9640 1 -- 172.21.15.53:0/1637781241 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560c9e903fe0 con 0x560c9e57e080 2024-08-31T06:24:51.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.737+0000 7f2030ff9640 10 client.30419 handle_command_reply: tid=0 2024-08-31T06:24:51.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.737+0000 7f2055e85740 1 client.30419 shutdown 2024-08-31T06:24:51.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.737+0000 7f2055e85740 1 -- 172.21.15.53:0/1637781241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 msgr2=0x560c9ea11c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:51.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.737+0000 7f2055e85740 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 0x560c9ea11c90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2040009f30 tx=0x7f2040003ee0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.738+0000 7f2055e85740 1 -- 172.21.15.53:0/1637781241 shutdown_connections 2024-08-31T06:24:51.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.738+0000 7f2055e85740 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560c9e57e080 0x560c9ea1bc60 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.738+0000 7f2055e85740 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c9e5ea350 0x560c9ea11c90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.738+0000 7f2055e85740 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560c9e5c9670 0x560c9e9a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.738+0000 7f2055e85740 1 --2- 172.21.15.53:0/1637781241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560c9e5c1490 0x560c9e9a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.738+0000 7f2055e85740 1 -- 172.21.15.53:0/1637781241 >> 172.21.15.53:0/1637781241 conn(0x560c9e5de740 msgr2=0x560c9e993880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:51.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.738+0000 7f2030ff9640 0 client.30419 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:51.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.738+0000 7f2055e85740 1 -- 172.21.15.53:0/1637781241 shutdown_connections 2024-08-31T06:24:51.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.738+0000 7f2055e85740 1 -- 172.21.15.53:0/1637781241 wait complete. 2024-08-31T06:24:51.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.738+0000 7f2055e85740 20 client.30419 trim_cache size 0 max 16384 2024-08-31T06:24:51.743 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:24:51.743 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:24:51.743 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "1ad07a15-8667-4a97-9c5f-5e578a42ded4", 2024-08-31T06:24:51.743 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:24:51.743 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:24:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 -- 172.21.15.53:0/1528051312 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20340b4d20 msgr2=0x7f20340b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20340b4d20 0x7f20340b7230 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2038005940 tx=0x7f20380058d0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 -- 172.21.15.53:0/1528051312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2048103930 msgr2=0x7f2048076ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2048103930 0x7f2048076ec0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2044009f50 tx=0x7f204400ee50 comp rx=0 tx=0).stop 2024-08-31T06:24:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 -- 172.21.15.53:0/1528051312 shutdown_connections 2024-08-31T06:24:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f20340b4d20 0x7f20340b7230 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2048109bc0 0x7f20480759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2048109270 0x7f20480754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 --2- 172.21.15.53:0/1528051312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2048103930 0x7f2048076ec0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 -- 172.21.15.53:0/1528051312 >> 172.21.15.53:0/1528051312 conn(0x7f20480ff3a0 msgr2=0x7f20481017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:51.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 -- 172.21.15.53:0/1528051312 shutdown_connections 2024-08-31T06:24:51.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:51.739+0000 7f204f910640 1 -- 172.21.15.53:0/1528051312 wait complete. 2024-08-31T06:24:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:51 smithi130 ceph-mon[22266]: pgmap v948: 97 pgs: 97 active+clean; 718 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 208 op/s 2024-08-31T06:24:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:51 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:51 smithi153 ceph-mon[22320]: pgmap v948: 97 pgs: 97 active+clean; 718 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 208 op/s 2024-08-31T06:24:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:51 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:51 smithi053 ceph-mon[18924]: pgmap v948: 97 pgs: 97 active+clean; 718 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 208 op/s 2024-08-31T06:24:52.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:51 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:52.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 41661 5.30 MB/sec execute 280 sec latency 608.393 ms 2024-08-31T06:24:52.897 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:24:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:52 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:24:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:52 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:52 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:24:53.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:52 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:24:53.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:52 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:24:53.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:52 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:24:53.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:52 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:24:53.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:52 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:53.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:52 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:52 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:52 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:52 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:24:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:52 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:52 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:24:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:52 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:24:53.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:52 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:24:53.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:52 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:24:53.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:52 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:24:53.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:52 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:53.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:52 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:52 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:52 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.268 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:24:53.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:52 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:24:53.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:52 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:52 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:24:53.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:52 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:24:53.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:52 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:24:53.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:52 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:24:53.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:52 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:24:53.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:52 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:53.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:52 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:52 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:52 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 41837 5.32 MB/sec execute 281 sec latency 65.208 ms 2024-08-31T06:24:53.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.837+0000 7f7b2cc12640 1 -- 172.21.15.53:0/3593603820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b28109bc0 msgr2=0x7f7b281103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:53.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.837+0000 7f7b2cc12640 1 --2- 172.21.15.53:0/3593603820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b28109bc0 0x7f7b281103f0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009ca0 tx=0x7f7b2002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.837+0000 7f7b2cc12640 1 -- 172.21.15.53:0/3593603820 shutdown_connections 2024-08-31T06:24:53.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.837+0000 7f7b2cc12640 1 --2- 172.21.15.53:0/3593603820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b28109bc0 0x7f7b281103f0 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.837+0000 7f7b2cc12640 1 --2- 172.21.15.53:0/3593603820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b28109270 0x7f7b28109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.837+0000 7f7b2cc12640 1 --2- 172.21.15.53:0/3593603820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b28103930 0x7f7b28103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.837+0000 7f7b2cc12640 1 -- 172.21.15.53:0/3593603820 >> 172.21.15.53:0/3593603820 conn(0x7f7b280ff3a0 msgr2=0x7f7b281017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:53.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.837+0000 7f7b2cc12640 1 -- 172.21.15.53:0/3593603820 shutdown_connections 2024-08-31T06:24:53.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.837+0000 7f7b2cc12640 1 -- 172.21.15.53:0/3593603820 wait complete. 2024-08-31T06:24:53.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.838+0000 7f7b2cc12640 1 Processor -- start 2024-08-31T06:24:53.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.838+0000 7f7b2cc12640 1 -- start start 2024-08-31T06:24:53.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.838+0000 7f7b2cc12640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b28103930 0x7f7b2819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.838+0000 7f7b2cc12640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b28109270 0x7f7b2819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.838+0000 7f7b2cc12640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b28109bc0 0x7f7b2819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.838+0000 7f7b2cc12640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281137e0 con 0x7f7b28109270 2024-08-31T06:24:53.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.838+0000 7f7b2cc12640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28113660 con 0x7f7b28109bc0 2024-08-31T06:24:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.838+0000 7f7b2cc12640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28113960 con 0x7f7b28103930 2024-08-31T06:24:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b26d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b28109bc0 0x7f7b2819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b28109270 0x7f7b2819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b26d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b28109bc0 0x7f7b2819f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:48868/0 (socket says 172.21.15.53:48868) 2024-08-31T06:24:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b28109270 0x7f7b2819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44612/0 (socket says 172.21.15.53:44612) 2024-08-31T06:24:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b26d9d640 1 -- 172.21.15.53:0/2116530309 learned_addr learned my addr 172.21.15.53:0/2116530309 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b26d9d640 1 -- 172.21.15.53:0/2116530309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b28103930 msgr2=0x7f7b2819a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b26d9d640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b28103930 0x7f7b2819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b26d9d640 1 -- 172.21.15.53:0/2116530309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b28109270 msgr2=0x7f7b2819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b26d9d640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b28109270 0x7f7b2819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b26d9d640 1 -- 172.21.15.53:0/2116530309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b281a0100 con 0x7f7b28109bc0 2024-08-31T06:24:53.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b26d9d640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b28109bc0 0x7f7b2819f9d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7b20031040 tx=0x7f7b20003f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:53.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b1f7fe640 1 -- 172.21.15.53:0/2116530309 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20032c90 con 0x7f7b28109bc0 2024-08-31T06:24:53.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b1f7fe640 1 -- 172.21.15.53:0/2116530309 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b20032e30 con 0x7f7b28109bc0 2024-08-31T06:24:53.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b1f7fe640 1 -- 172.21.15.53:0/2116530309 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20030af0 con 0x7f7b28109bc0 2024-08-31T06:24:53.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b2cc12640 1 -- 172.21.15.53:0/2116530309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b281a0390 con 0x7f7b28109bc0 2024-08-31T06:24:53.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.840+0000 7f7b2cc12640 1 -- 172.21.15.53:0/2116530309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b281a6b50 con 0x7f7b28109bc0 2024-08-31T06:24:53.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.844+0000 7f7b1f7fe640 1 -- 172.21.15.53:0/2116530309 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7b20030c90 con 0x7f7b28109bc0 2024-08-31T06:24:53.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.845+0000 7f7b33187740 1 Processor -- start 2024-08-31T06:24:53.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.845+0000 7f7b33187740 1 -- start start 2024-08-31T06:24:53.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.846+0000 7f7b33187740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c521070 0x555f9c8c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.846+0000 7f7b33187740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.846+0000 7f7b1f7fe640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b140b4d20 0x7f7b140b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.846+0000 7f7b33187740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c500390 0x555f9c8c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.846+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.846+0000 7f7b1f7fe640 1 -- 172.21.15.53:0/2116530309 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f7b20106700 con 0x7f7b28109bc0 2024-08-31T06:24:53.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.846+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44622/0 (socket says 172.21.15.53:44622) 2024-08-31T06:24:53.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.846+0000 7f7b1ffff640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b140b4d20 0x7f7b140b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.847+0000 7f7b1ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c521070 0x555f9c8c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.847+0000 7f7b1ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c521070 0x555f9c8c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:36628/0 (socket says 172.21.15.53:36628) 2024-08-31T06:24:53.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.847+0000 7f7b2659c640 1 -- 172.21.15.53:0/3461532255 learned_addr learned my addr 172.21.15.53:0/3461532255 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:53.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.847+0000 7f7b26d9d640 1 --2- 172.21.15.53:0/3461532255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c500390 0x555f9c8c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.848+0000 7f7b33187740 1 -- 172.21.15.53:0/3461532255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555f9c83d630 con 0x555f9c4f81b0 2024-08-31T06:24:53.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.848+0000 7f7b33187740 1 -- 172.21.15.53:0/3461532255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555f9c82cbc0 con 0x555f9c500390 2024-08-31T06:24:53.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.848+0000 7f7b33187740 1 -- 172.21.15.53:0/3461532255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555f9c830b70 con 0x555f9c521070 2024-08-31T06:24:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.848+0000 7f7b26d9d640 1 -- 172.21.15.53:0/3461532255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c521070 msgr2=0x555f9c8c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.848+0000 7f7b26d9d640 1 --2- 172.21.15.53:0/3461532255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c521070 0x555f9c8c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.848+0000 7f7b26d9d640 1 -- 172.21.15.53:0/3461532255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 msgr2=0x555f9c8c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.848+0000 7f7b26d9d640 1 --2- 172.21.15.53:0/3461532255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.848+0000 7f7b26d9d640 1 -- 172.21.15.53:0/3461532255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9c58c650 con 0x555f9c500390 2024-08-31T06:24:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.848+0000 7f7b1ffff640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b140b4d20 0x7f7b140b7230 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7b28108be0 tx=0x7f7b10013830 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.849+0000 7f7b2659c640 1 --2- 172.21.15.53:0/3461532255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.849+0000 7f7b26d9d640 1 --2- 172.21.15.53:0/3461532255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c500390 0x555f9c8c6d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b20103e30 tx=0x7f7b200cc600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6b028fd93e8ee12 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.849+0000 7f7b1cff9640 1 -- 172.21.15.53:0/3461532255 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200d1640 con 0x555f9c500390 2024-08-31T06:24:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.850+0000 7f7b1cff9640 1 -- 172.21.15.53:0/3461532255 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b20036040 con 0x555f9c500390 2024-08-31T06:24:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.850+0000 7f7b1cff9640 1 -- 172.21.15.53:0/3461532255 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200d5c60 con 0x555f9c500390 2024-08-31T06:24:53.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.851+0000 7f7b33187740 1 -- 172.21.15.53:0/3461532255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c500390 msgr2=0x555f9c8c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:53.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.851+0000 7f7b33187740 1 --2- 172.21.15.53:0/3461532255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c500390 0x555f9c8c6d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b20103e30 tx=0x7f7b200cc600 comp rx=0 tx=0).stop 2024-08-31T06:24:53.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.851+0000 7f7b33187740 1 -- 172.21.15.53:0/3461532255 shutdown_connections 2024-08-31T06:24:53.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.851+0000 7f7b33187740 1 --2- 172.21.15.53:0/3461532255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c500390 0x555f9c8c6d80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.851+0000 7f7b33187740 1 --2- 172.21.15.53:0/3461532255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.851+0000 7f7b33187740 1 --2- 172.21.15.53:0/3461532255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c521070 0x555f9c8c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.851+0000 7f7b33187740 1 -- 172.21.15.53:0/3461532255 >> 172.21.15.53:0/3461532255 conn(0x555f9c515460 msgr2=0x555f9c8c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.851+0000 7f7b33187740 1 -- 172.21.15.53:0/3461532255 shutdown_connections 2024-08-31T06:24:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.851+0000 7f7b33187740 1 -- 172.21.15.53:0/3461532255 wait complete. 2024-08-31T06:24:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.852+0000 7f7b33187740 1 -- start start 2024-08-31T06:24:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.852+0000 7f7b33187740 1 Processor -- start 2024-08-31T06:24:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b33187740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b33187740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c500390 0x555f9c8d2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b33187740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 0x555f9c8dd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b33187740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555f9c68f700 con 0x555f9c4f81b0 2024-08-31T06:24:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b33187740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555f9c7b3700 con 0x555f9c521070 2024-08-31T06:24:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b33187740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555f9c82cbc0 con 0x555f9c500390 2024-08-31T06:24:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b33187740 10 client.0 _ll_register_callbacks cb 0x555f9c7e2dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b1ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c500390 0x555f9c8d2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b26d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 0x555f9c8dd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8d1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44624/0 (socket says 172.21.15.53:44624) 2024-08-31T06:24:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.853+0000 7f7b2659c640 1 -- 172.21.15.53:0/2731001545 learned_addr learned my addr 172.21.15.53:0/2731001545 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.854+0000 7f7b26d9d640 1 -- 172.21.15.53:0/2731001545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c500390 msgr2=0x555f9c8d2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.854+0000 7f7b26d9d640 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c500390 0x555f9c8d2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.854+0000 7f7b26d9d640 1 -- 172.21.15.53:0/2731001545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 msgr2=0x555f9c8d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.854+0000 7f7b26d9d640 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.854+0000 7f7b26d9d640 1 -- 172.21.15.53:0/2731001545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f9c7ec8b0 con 0x555f9c521070 2024-08-31T06:24:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.854+0000 7f7b2659c640 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.854+0000 7f7b26d9d640 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 0x555f9c8dd980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7b20004fd0 tx=0x7f7b200cc670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21582934c0926c2d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.854+0000 7f7b0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:24:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.854+0000 7f7b0dffb640 1 -- 172.21.15.53:0/2731001545 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200f3070 con 0x555f9c521070 2024-08-31T06:24:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.854+0000 7f7b0dffb640 1 -- 172.21.15.53:0/2731001545 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f7b200cd130 con 0x555f9c521070 2024-08-31T06:24:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.854+0000 7f7b33187740 1 -- 172.21.15.53:0/2731001545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b20036040 con 0x555f9c521070 2024-08-31T06:24:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.855+0000 7f7b0dffb640 1 -- 172.21.15.53:0/2731001545 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f7b200d1640 con 0x555f9c521070 2024-08-31T06:24:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.855+0000 7f7b33187740 10 client.30431 fetch_fsmap learned FSMap version 71 2024-08-31T06:24:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.855+0000 7f7b33187740 1 -- 172.21.15.53:0/2731001545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x555f9c8e0490 con 0x555f9c521070 2024-08-31T06:24:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.855+0000 7f7b0dffb640 1 -- 172.21.15.53:0/2731001545 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b200d60f0 con 0x555f9c521070 2024-08-31T06:24:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.856+0000 7f7b0dffb640 1 -- 172.21.15.53:0/2731001545 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 71) ==== 8382+0+0 (secure 0 0 0) 0x7f7b200b41f0 con 0x555f9c521070 2024-08-31T06:24:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.856+0000 7f7b33187740 10 client.30431 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T06:24:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.856+0000 7f7b33187740 10 client.30431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.856+0000 7f7b33187740 20 client.30431 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.856+0000 7f7b33187740 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555f9c4df9f0 0x555f9c8e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.856+0000 7f7b33187740 4 client.30431 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.856+0000 7f7b33187740 1 -- 172.21.15.53:0/2731001545 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7b20036040 con 0x555f9c4df9f0 2024-08-31T06:24:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.858+0000 7f7b2659c640 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555f9c4df9f0 0x555f9c8e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.861+0000 7f7b0dffb640 10 client.30431 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:53.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.861+0000 7f7b2659c640 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555f9c4df9f0 0x555f9c8e37b0 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e33eee28e41f9b9 server_cookie=5124312f79a2e00f in_seq=0 out_seq=0 2024-08-31T06:24:53.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.862+0000 7f7b0dffb640 1 -- 172.21.15.53:0/2731001545 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f7b20036040 con 0x555f9c4df9f0 2024-08-31T06:24:53.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.862+0000 7f7b0dffb640 10 client.30431 handle_command_reply: tid=0 2024-08-31T06:24:53.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.862+0000 7f7b33187740 1 client.30431 shutdown 2024-08-31T06:24:53.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.863+0000 7f7b33187740 1 -- 172.21.15.53:0/2731001545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 msgr2=0x555f9c8dd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:53.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.863+0000 7f7b33187740 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 0x555f9c8dd980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7b20004fd0 tx=0x7f7b200cc670 comp rx=0 tx=0).stop 2024-08-31T06:24:53.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.863+0000 7f7b33187740 1 -- 172.21.15.53:0/2731001545 shutdown_connections 2024-08-31T06:24:53.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.863+0000 7f7b33187740 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555f9c4df9f0 0x555f9c8e37b0 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.863+0000 7f7b33187740 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 0x555f9c8dd980 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.863+0000 7f7b33187740 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c500390 0x555f9c8d2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.863+0000 7f7b33187740 1 --2- 172.21.15.53:0/2731001545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.863+0000 7f7b33187740 1 -- 172.21.15.53:0/2731001545 >> 172.21.15.53:0/2731001545 conn(0x555f9c515460 msgr2=0x555f9c8c9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:53.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.863+0000 7f7b0dffb640 0 client.30431 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:53.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.863+0000 7f7b33187740 1 -- 172.21.15.53:0/2731001545 shutdown_connections 2024-08-31T06:24:53.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.863+0000 7f7b33187740 1 -- 172.21.15.53:0/2731001545 wait complete. 2024-08-31T06:24:53.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.864+0000 7f7b33187740 20 client.30431 trim_cache size 0 max 16384 2024-08-31T06:24:53.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.895+0000 7f7b33187740 1 Processor -- start 2024-08-31T06:24:53.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.895+0000 7f7b33187740 1 -- start start 2024-08-31T06:24:53.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.895+0000 7f7b33187740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b33187740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c500390 0x555f9c8dd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b33187740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 0x555f9c8dddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b33187740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281af460 con 0x555f9c4f81b0 2024-08-31T06:24:53.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b33187740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281b1090 con 0x555f9c521070 2024-08-31T06:24:53.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b33187740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281afb90 con 0x555f9c500390 2024-08-31T06:24:53.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b26d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 0x555f9c8dddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44628/0 (socket says 172.21.15.53:44628) 2024-08-31T06:24:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b2659c640 1 -- 172.21.15.53:0/3894779202 learned_addr learned my addr 172.21.15.53:0/3894779202 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b1ffff640 1 --2- 172.21.15.53:0/3894779202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c500390 0x555f9c8dd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b2659c640 1 -- 172.21.15.53:0/3894779202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c500390 msgr2=0x555f9c8dd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b2659c640 1 --2- 172.21.15.53:0/3894779202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c500390 0x555f9c8dd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b2659c640 1 -- 172.21.15.53:0/3894779202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 msgr2=0x555f9c8dddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b2659c640 1 --2- 172.21.15.53:0/3894779202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 0x555f9c8dddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b2659c640 1 -- 172.21.15.53:0/3894779202 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9c8d0a60 con 0x555f9c4f81b0 2024-08-31T06:24:53.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.896+0000 7f7b26d9d640 1 --2- 172.21.15.53:0/3894779202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 0x555f9c8dddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:24:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.897+0000 7f7b2659c640 1 --2- 172.21.15.53:0/3894779202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c9b10 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009550 tx=0x7f7b18009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f77b1d7b8c6989 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.897+0000 7f7b0ffff640 1 -- 172.21.15.53:0/3894779202 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18022070 con 0x555f9c4f81b0 2024-08-31T06:24:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.897+0000 7f7b0ffff640 1 -- 172.21.15.53:0/3894779202 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b18016d00 con 0x555f9c4f81b0 2024-08-31T06:24:53.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.897+0000 7f7b0ffff640 1 -- 172.21.15.53:0/3894779202 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18013640 con 0x555f9c4f81b0 2024-08-31T06:24:53.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.898+0000 7f7b33187740 1 -- 172.21.15.53:0/3894779202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 msgr2=0x555f9c8c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.898+0000 7f7b33187740 1 --2- 172.21.15.53:0/3894779202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c9b10 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009550 tx=0x7f7b18009f90 comp rx=0 tx=0).stop 2024-08-31T06:24:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.898+0000 7f7b33187740 1 -- 172.21.15.53:0/3894779202 shutdown_connections 2024-08-31T06:24:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.898+0000 7f7b33187740 1 --2- 172.21.15.53:0/3894779202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c521070 0x555f9c8dddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.898+0000 7f7b33187740 1 --2- 172.21.15.53:0/3894779202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c500390 0x555f9c8dd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.898+0000 7f7b33187740 1 --2- 172.21.15.53:0/3894779202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c4f81b0 0x555f9c8c9b10 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.898+0000 7f7b33187740 1 -- 172.21.15.53:0/3894779202 >> 172.21.15.53:0/3894779202 conn(0x555f9c515460 msgr2=0x555f9c8c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.898+0000 7f7b33187740 1 -- 172.21.15.53:0/3894779202 shutdown_connections 2024-08-31T06:24:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.898+0000 7f7b33187740 1 -- 172.21.15.53:0/3894779202 wait complete. 2024-08-31T06:24:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.899+0000 7f7b33187740 1 -- start start 2024-08-31T06:24:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.899+0000 7f7b33187740 1 Processor -- start 2024-08-31T06:24:53.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.900+0000 7f7b33187740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c4f81b0 0x555f9c947840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.900+0000 7f7b33187740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c500390 0x555f9c947d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.900+0000 7f7b33187740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c521070 0x555f9c8d98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.900+0000 7f7b33187740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281b0960 con 0x555f9c500390 2024-08-31T06:24:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.900+0000 7f7b33187740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281b0260 con 0x555f9c4f81b0 2024-08-31T06:24:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.900+0000 7f7b1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c500390 0x555f9c947d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.900+0000 7f7b33187740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281ad460 con 0x555f9c521070 2024-08-31T06:24:53.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.900+0000 7f7b1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c500390 0x555f9c947d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44638/0 (socket says 172.21.15.53:44638) 2024-08-31T06:24:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.900+0000 7f7b1ffff640 1 -- 172.21.15.53:0/1537682578 learned_addr learned my addr 172.21.15.53:0/1537682578 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.900+0000 7f7b2659c640 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c4f81b0 0x555f9c947840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.900+0000 7f7b33187740 10 client.0 _ll_register_callbacks cb 0x7f7b18009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.901+0000 7f7b1ffff640 1 -- 172.21.15.53:0/1537682578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c521070 msgr2=0x555f9c8d98e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:24:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.901+0000 7f7b1ffff640 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c521070 0x555f9c8d98e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.901+0000 7f7b1ffff640 1 -- 172.21.15.53:0/1537682578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c4f81b0 msgr2=0x555f9c947840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:53.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.901+0000 7f7b1ffff640 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c4f81b0 0x555f9c947840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.901+0000 7f7b1ffff640 1 -- 172.21.15.53:0/1537682578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f9c8d9e20 con 0x555f9c500390 2024-08-31T06:24:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.901+0000 7f7b2659c640 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c4f81b0 0x555f9c947840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.901+0000 7f7b1ffff640 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c500390 0x555f9c947d80 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f7b10004410 tx=0x7f7b10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad61a10b13d5ad1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.901+0000 7f7b0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.901+0000 7f7b0dffb640 1 -- 172.21.15.53:0/1537682578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10005020 con 0x555f9c500390 2024-08-31T06:24:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.901+0000 7f7b0dffb640 1 -- 172.21.15.53:0/1537682578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f7b10026040 con 0x555f9c500390 2024-08-31T06:24:53.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.902+0000 7f7b33187740 1 -- 172.21.15.53:0/1537682578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b18016d00 con 0x555f9c500390 2024-08-31T06:24:53.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.902+0000 7f7b0dffb640 1 -- 172.21.15.53:0/1537682578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f7b10036050 con 0x555f9c500390 2024-08-31T06:24:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.902+0000 7f7b33187740 10 client.21654 fetch_fsmap learned FSMap version 71 2024-08-31T06:24:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.902+0000 7f7b33187740 1 -- 172.21.15.53:0/1537682578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x555f9c952d20 con 0x555f9c500390 2024-08-31T06:24:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.902+0000 7f7b0dffb640 1 -- 172.21.15.53:0/1537682578 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b18016d00 con 0x555f9c500390 2024-08-31T06:24:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.902+0000 7f7b0dffb640 1 -- 172.21.15.53:0/1537682578 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 71) ==== 8382+0+0 (secure 0 0 0) 0x7f7b1001f070 con 0x555f9c500390 2024-08-31T06:24:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.904+0000 7f7b33187740 10 client.21654 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T06:24:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.904+0000 7f7b33187740 10 client.21654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:53.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.904+0000 7f7b33187740 20 client.21654 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.904+0000 7f7b33187740 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555f9c4b4da0 0x555f9c9555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.904+0000 7f7b33187740 4 client.21654 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:24:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.904+0000 7f7b33187740 1 -- 172.21.15.53:0/1537682578 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555f9c83f580 con 0x555f9c4b4da0 2024-08-31T06:24:53.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.905+0000 7f7b2659c640 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555f9c4b4da0 0x555f9c9555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.908+0000 7f7b2659c640 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555f9c4b4da0 0x555f9c9555c0 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=718c776833b678c7 server_cookie=506d09290b35f9f2 in_seq=0 out_seq=0 2024-08-31T06:24:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.910+0000 7f7b0dffb640 10 client.21654 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:53.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.910+0000 7f7b0dffb640 1 -- 172.21.15.53:0/1537682578 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7386 (crc 0 0 0) 0x555f9c83f580 con 0x555f9c4b4da0 2024-08-31T06:24:53.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.910+0000 7f7b0dffb640 10 client.21654 handle_command_reply: tid=0 2024-08-31T06:24:53.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.910+0000 7f7b33187740 1 client.21654 shutdown 2024-08-31T06:24:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.911+0000 7f7b33187740 1 -- 172.21.15.53:0/1537682578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c500390 msgr2=0x555f9c947d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.911+0000 7f7b33187740 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c500390 0x555f9c947d80 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f7b10004410 tx=0x7f7b10004730 comp rx=0 tx=0).stop 2024-08-31T06:24:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.911+0000 7f7b33187740 1 -- 172.21.15.53:0/1537682578 shutdown_connections 2024-08-31T06:24:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.912+0000 7f7b33187740 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555f9c4b4da0 0x555f9c9555c0 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.912+0000 7f7b33187740 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555f9c521070 0x555f9c8d98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.912+0000 7f7b0dffb640 0 client.21654 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.912+0000 7f7b33187740 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555f9c500390 0x555f9c947d80 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.912+0000 7f7b33187740 1 --2- 172.21.15.53:0/1537682578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555f9c4f81b0 0x555f9c947840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.912+0000 7f7b33187740 1 -- 172.21.15.53:0/1537682578 >> 172.21.15.53:0/1537682578 conn(0x555f9c515460 msgr2=0x555f9c8c39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:53.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.912+0000 7f7b33187740 1 -- 172.21.15.53:0/1537682578 shutdown_connections 2024-08-31T06:24:53.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.912+0000 7f7b33187740 1 -- 172.21.15.53:0/1537682578 wait complete. 2024-08-31T06:24:53.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.912+0000 7f7b33187740 20 client.21654 trim_cache size 0 max 16384 2024-08-31T06:24:53.917 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:24:53.917 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:24:53.917 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:24:53.917 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:24:53.917 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.917 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "1ad07a15-8667-4a97-9c5f-5e578a42ded4", 2024-08-31T06:24:53.917 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:24:53.917 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:53.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.918 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:24:53.918 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:24:53.918 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:24:53.918 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.918 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.918 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.918 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.918 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.920 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:24:53.920 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:24:53.920 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.921 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:24:53.921 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:24:53.921 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.921 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.921 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.921 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.921 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.921 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:24:53.921 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:24:53.922 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.922 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.922 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.922 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.922 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.922 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:24:53.922 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:24:53.922 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.923 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:24:53.923 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:24:53.923 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.925 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:24:53.925 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:24:53.925 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.925 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:24:53.925 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:24:53.925 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.926 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:24:53.926 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:24:53.926 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:24:53.927 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:24:53.928 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.928 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:24:53.928 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:24:53.928 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.929 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:24:53.929 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:24:53.929 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.930 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:24:53.930 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:24:53.930 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.930 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:24:53.930 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:24:53.930 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.932 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:24:53.932 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:24:53.932 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.932 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:24:53.932 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:24:53.933 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.933 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:24:53.933 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:24:53.933 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.934 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:24:53.934 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:24:53.934 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.935 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:24:53.935 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:24:53.935 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:24:53.936 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:24:53.936 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:24:53.936 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:24:53.936 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:24:53.936 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:24:53.936 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:24:53.936 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:24:53.936 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:53.936 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:24:53.936 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:24:53.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 -- 172.21.15.53:0/2116530309 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b140b4d20 msgr2=0x7f7b140b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:53.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b140b4d20 0x7f7b140b7230 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7b28108be0 tx=0x7f7b10013830 comp rx=0 tx=0).stop 2024-08-31T06:24:53.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 -- 172.21.15.53:0/2116530309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b28109bc0 msgr2=0x7f7b2819f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:53.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b28109bc0 0x7f7b2819f9d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7b20031040 tx=0x7f7b20003f80 comp rx=0 tx=0).stop 2024-08-31T06:24:53.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 -- 172.21.15.53:0/2116530309 shutdown_connections 2024-08-31T06:24:53.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7b140b4d20 0x7f7b140b7230 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b28109bc0 0x7f7b2819f9d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b28109270 0x7f7b2819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 --2- 172.21.15.53:0/2116530309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b28103930 0x7f7b2819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:53.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 -- 172.21.15.53:0/2116530309 >> 172.21.15.53:0/2116530309 conn(0x7f7b280ff3a0 msgr2=0x7f7b281017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:53.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 -- 172.21.15.53:0/2116530309 shutdown_connections 2024-08-31T06:24:53.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:24:53.914+0000 7f7b2cc12640 1 -- 172.21.15.53:0/2116530309 wait complete. 2024-08-31T06:24:53.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:53 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:53 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:53.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:53 smithi053 ceph-mon[18924]: pgmap v949: 97 pgs: 97 active+clean; 721 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 245 op/s 2024-08-31T06:24:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:53 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:53 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:54.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:53 smithi153 ceph-mon[22320]: pgmap v949: 97 pgs: 97 active+clean; 721 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 245 op/s 2024-08-31T06:24:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:53 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:53 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:24:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:53 smithi130 ceph-mon[22266]: pgmap v949: 97 pgs: 97 active+clean; 721 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 245 op/s 2024-08-31T06:24:54.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 41941 5.31 MB/sec execute 282 sec latency 107.789 ms 2024-08-31T06:24:54.750 INFO:tasks.cephfs.filesystem:scrub status for tag:1ad07a15-8667-4a97-9c5f-5e578a42ded4 - {'path': '/', 'tag': '1ad07a15-8667-4a97-9c5f-5e578a42ded4', 'options': 'recursive,force'} 2024-08-31T06:24:55.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 42039 5.30 MB/sec execute 283 sec latency 152.222 ms 2024-08-31T06:24:56.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:55 smithi153 ceph-mon[22320]: pgmap v950: 97 pgs: 97 active+clean; 730 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.8 MiB/s wr, 321 op/s 2024-08-31T06:24:56.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:55 smithi053 ceph-mon[18924]: pgmap v950: 97 pgs: 97 active+clean; 730 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.8 MiB/s wr, 321 op/s 2024-08-31T06:24:56.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:55 smithi130 ceph-mon[22266]: pgmap v950: 97 pgs: 97 active+clean; 730 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.8 MiB/s wr, 321 op/s 2024-08-31T06:24:56.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 42191 5.33 MB/sec execute 284 sec latency 102.435 ms 2024-08-31T06:24:57.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:56 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:57.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:56 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:57.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:56 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:57.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 42347 5.33 MB/sec execute 285 sec latency 55.014 ms 2024-08-31T06:24:58.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:57 smithi153 ceph-mon[22320]: pgmap v951: 97 pgs: 97 active+clean; 734 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 345 op/s 2024-08-31T06:24:58.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:57 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:58.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:57 smithi053 ceph-mon[18924]: pgmap v951: 97 pgs: 97 active+clean; 734 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 345 op/s 2024-08-31T06:24:58.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:57 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:58.381 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:57 smithi130 ceph-mon[22266]: pgmap v951: 97 pgs: 97 active+clean; 734 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 345 op/s 2024-08-31T06:24:58.381 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:57 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:24:58.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 42490 5.33 MB/sec execute 286 sec latency 124.369 ms 2024-08-31T06:24:59.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 42611 5.32 MB/sec execute 287 sec latency 88.245 ms 2024-08-31T06:24:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.538+0000 7f5b71086640 1 -- 172.21.15.53:0/2277582305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c1089d0 msgr2=0x7f5b6c10f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.538+0000 7f5b71086640 1 --2- 172.21.15.53:0/2277582305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c1089d0 0x7f5b6c10f200 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009900 tx=0x7f5b5c02a420 comp rx=0 tx=0).stop 2024-08-31T06:24:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.538+0000 7f5b71086640 1 -- 172.21.15.53:0/2277582305 shutdown_connections 2024-08-31T06:24:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.538+0000 7f5b71086640 1 --2- 172.21.15.53:0/2277582305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c1089d0 0x7f5b6c10f200 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.538+0000 7f5b71086640 1 --2- 172.21.15.53:0/2277582305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b6c108080 0x7f5b6c108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.538+0000 7f5b71086640 1 --2- 172.21.15.53:0/2277582305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b6c102750 0x7f5b6c102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.538+0000 7f5b71086640 1 -- 172.21.15.53:0/2277582305 >> 172.21.15.53:0/2277582305 conn(0x7f5b6c07a4e0 msgr2=0x7f5b6c07a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.538+0000 7f5b71086640 1 -- 172.21.15.53:0/2277582305 shutdown_connections 2024-08-31T06:24:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.538+0000 7f5b71086640 1 -- 172.21.15.53:0/2277582305 wait complete. 2024-08-31T06:24:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.539+0000 7f5b71086640 1 Processor -- start 2024-08-31T06:24:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.539+0000 7f5b71086640 1 -- start start 2024-08-31T06:24:59.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b71086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c102750 0x7f5b6c10b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.542 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b71086640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b6c108080 0x7f5b6c10bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b71086640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b6c1089d0 0x7f5b6c10c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b71086640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c112650 con 0x7f5b6c102750 2024-08-31T06:24:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b71086640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1124d0 con 0x7f5b6c1089d0 2024-08-31T06:24:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b71086640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1127d0 con 0x7f5b6c108080 2024-08-31T06:24:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b6ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c102750 0x7f5b6c10b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b6ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c102750 0x7f5b6c10b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44670/0 (socket says 172.21.15.53:44670) 2024-08-31T06:24:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b6ad9d640 1 -- 172.21.15.53:0/227620778 learned_addr learned my addr 172.21.15.53:0/227620778 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b6b59e640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b6c1089d0 0x7f5b6c10c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b6c108080 0x7f5b6c10bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b6b59e640 1 -- 172.21.15.53:0/227620778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b6c108080 msgr2=0x7f5b6c10bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:59.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b6b59e640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b6c108080 0x7f5b6c10bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b6b59e640 1 -- 172.21.15.53:0/227620778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c102750 msgr2=0x7f5b6c10b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:59.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b6b59e640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c102750 0x7f5b6c10b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b6b59e640 1 -- 172.21.15.53:0/227620778 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6c1ac890 con 0x7f5b6c1089d0 2024-08-31T06:24:59.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.540+0000 7f5b6ad9d640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c102750 0x7f5b6c10b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:59.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.541+0000 7f5b6b59e640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b6c1089d0 0x7f5b6c10c080 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c02aa10 tx=0x7f5b5c003cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:59.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.541+0000 7f5b53fff640 1 -- 172.21.15.53:0/227620778 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c03f070 con 0x7f5b6c1089d0 2024-08-31T06:24:59.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.541+0000 7f5b71086640 1 -- 172.21.15.53:0/227620778 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6c1acb20 con 0x7f5b6c1089d0 2024-08-31T06:24:59.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.541+0000 7f5b53fff640 1 -- 172.21.15.53:0/227620778 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b5c03baf0 con 0x7f5b6c1089d0 2024-08-31T06:24:59.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.541+0000 7f5b53fff640 1 -- 172.21.15.53:0/227620778 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c035030 con 0x7f5b6c1089d0 2024-08-31T06:24:59.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.541+0000 7f5b71086640 1 -- 172.21.15.53:0/227620778 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b6c1ad090 con 0x7f5b6c1089d0 2024-08-31T06:24:59.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.544+0000 7f5b53fff640 1 -- 172.21.15.53:0/227620778 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5b5c042070 con 0x7f5b6c1089d0 2024-08-31T06:24:59.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.544+0000 7f5b77fed740 1 Processor -- start 2024-08-31T06:24:59.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.544+0000 7f5b77fed740 1 -- start start 2024-08-31T06:24:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.545+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab667b1b0 0x55bab6a1eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.545+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 0x55bab6a1f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.545+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab665a4d0 0x55bab6a1f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.545+0000 7f5b77fed740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bab6994000 con 0x55bab665a4d0 2024-08-31T06:24:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.545+0000 7f5b77fed740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bab6983590 con 0x55bab667b1b0 2024-08-31T06:24:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.545+0000 7f5b77fed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bab6987540 con 0x55bab66522f0 2024-08-31T06:24:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.545+0000 7f5b6a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab665a4d0 0x55bab6a1f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.545+0000 7f5b6a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab665a4d0 0x55bab6a1f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44682/0 (socket says 172.21.15.53:44682) 2024-08-31T06:24:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.545+0000 7f5b6a59c640 1 -- 172.21.15.53:0/3667921360 learned_addr learned my addr 172.21.15.53:0/3667921360 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.545+0000 7f5b53fff640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b540b4d20 0x7f5b540b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.546+0000 7f5b6a59c640 1 -- 172.21.15.53:0/3667921360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 msgr2=0x55bab6a1f000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:24:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.546+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/3667921360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 0x55bab6a1f000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.546+0000 7f5b6a59c640 1 -- 172.21.15.53:0/3667921360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab667b1b0 msgr2=0x55bab6a1eac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:24:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.546+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/3667921360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab667b1b0 0x55bab6a1eac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.546+0000 7f5b6a59c640 1 -- 172.21.15.53:0/3667921360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab66e6790 con 0x55bab665a4d0 2024-08-31T06:24:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.546+0000 7f5b6b59e640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b540b4d20 0x7f5b540b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.546+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/3667921360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab665a4d0 0x55bab6a1f540 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f5b600099a0 tx=0x7f5b60009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14396dff3c151d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.547+0000 7f5b6b59e640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b540b4d20 0x7f5b540b7230 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0c95a0 tx=0x7f5b5c0cc1a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.547+0000 7f5b517fa640 1 -- 172.21.15.53:0/3667921360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60028070 con 0x55bab665a4d0 2024-08-31T06:24:59.553 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.547+0000 7f5b517fa640 1 -- 172.21.15.53:0/3667921360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b60024480 con 0x55bab665a4d0 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.547+0000 7f5b53fff640 1 -- 172.21.15.53:0/227620778 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f5b5c105cc0 con 0x7f5b6c1089d0 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.547+0000 7f5b517fa640 1 -- 172.21.15.53:0/3667921360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60023640 con 0x55bab665a4d0 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.548+0000 7f5b77fed740 1 -- 172.21.15.53:0/3667921360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab665a4d0 msgr2=0x55bab6a1f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.548+0000 7f5b77fed740 1 --2- 172.21.15.53:0/3667921360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab665a4d0 0x55bab6a1f540 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f5b600099a0 tx=0x7f5b60009e60 comp rx=0 tx=0).stop 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.548+0000 7f5b77fed740 1 -- 172.21.15.53:0/3667921360 shutdown_connections 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.548+0000 7f5b77fed740 1 --2- 172.21.15.53:0/3667921360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab665a4d0 0x55bab6a1f540 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.548+0000 7f5b77fed740 1 --2- 172.21.15.53:0/3667921360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 0x55bab6a1f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.548+0000 7f5b77fed740 1 --2- 172.21.15.53:0/3667921360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab667b1b0 0x55bab6a1eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.548+0000 7f5b77fed740 1 -- 172.21.15.53:0/3667921360 >> 172.21.15.53:0/3667921360 conn(0x55bab666f300 msgr2=0x55bab6a1c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.548+0000 7f5b77fed740 1 -- 172.21.15.53:0/3667921360 shutdown_connections 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.548+0000 7f5b77fed740 1 -- 172.21.15.53:0/3667921360 wait complete. 2024-08-31T06:24:59.554 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b77fed740 1 -- start start 2024-08-31T06:24:59.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b77fed740 1 Processor -- start 2024-08-31T06:24:59.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 0x55bab6a2a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 0x55bab6a2ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab667b1b0 0x55bab6a36500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b77fed740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bab68bcab0 con 0x55bab667b1b0 2024-08-31T06:24:59.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b77fed740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bab690a680 con 0x55bab665a4d0 2024-08-31T06:24:59.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b77fed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bab6a2d220 con 0x55bab66522f0 2024-08-31T06:24:59.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b77fed740 10 client.0 _ll_register_callbacks cb 0x55bab6692a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:59.555 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b6a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab667b1b0 0x55bab6a36500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b6a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab667b1b0 0x55bab6a36500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44692/0 (socket says 172.21.15.53:44692) 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.549+0000 7f5b6a59c640 1 -- 172.21.15.53:0/1020511132 learned_addr learned my addr 172.21.15.53:0/1020511132 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 0x55bab6a2a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b6ad9d640 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 0x55bab6a2ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b6a59c640 1 -- 172.21.15.53:0/1020511132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 msgr2=0x55bab6a2a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 0x55bab6a2a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b6a59c640 1 -- 172.21.15.53:0/1020511132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 msgr2=0x55bab6a2ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 0x55bab6a2ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b6a59c640 1 -- 172.21.15.53:0/1020511132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bab675f620 con 0x55bab667b1b0 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b6ad9d640 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 0x55bab6a2ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab667b1b0 0x55bab6a36500 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f5b60024e30 tx=0x7f5b60024e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9288569222bed2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:59.556 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b4eff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b4eff5640 1 -- 172.21.15.53:0/1020511132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60028030 con 0x55bab667b1b0 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b77fed740 1 -- 172.21.15.53:0/1020511132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b60024480 con 0x55bab667b1b0 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.550+0000 7f5b4eff5640 1 -- 172.21.15.53:0/1020511132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f5b6000ec90 con 0x55bab667b1b0 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b4eff5640 1 -- 172.21.15.53:0/1020511132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f5b600059c0 con 0x55bab667b1b0 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b77fed740 10 client.21666 fetch_fsmap learned FSMap version 73 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b77fed740 1 -- 172.21.15.53:0/1020511132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x55bab6a39180 con 0x55bab667b1b0 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b4eff5640 1 -- 172.21.15.53:0/1020511132 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b60024480 con 0x55bab667b1b0 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b4eff5640 1 -- 172.21.15.53:0/1020511132 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 73) ==== 8394+0+0 (secure 0 0 0) 0x7f5b60006020 con 0x55bab667b1b0 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b77fed740 10 client.21666 fetch_fsmap finished waiting for FSMap version 73 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b77fed740 10 client.21666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b77fed740 20 client.21666 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b77fed740 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bab6639d80 0x55bab6a3c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.557 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b77fed740 4 client.21666 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:24:59.558 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b77fed740 1 -- 172.21.15.53:0/1020511132 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bab6995f50 con 0x55bab6639d80 2024-08-31T06:24:59.558 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.551+0000 7f5b6ad9d640 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bab6639d80 0x55bab6a3c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.552+0000 7f5b4eff5640 10 client.21666 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:59.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.552+0000 7f5b6ad9d640 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bab6639d80 0x55bab6a3c990 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45fda8db08bc2eb2 server_cookie=5917d8cef4d7fad2 in_seq=0 out_seq=0 2024-08-31T06:24:59.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b4eff5640 1 -- 172.21.15.53:0/1020511132 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bab6995f50 con 0x55bab6639d80 2024-08-31T06:24:59.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b4eff5640 10 client.21666 handle_command_reply: tid=0 2024-08-31T06:24:59.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b77fed740 1 client.21666 shutdown 2024-08-31T06:24:59.559 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b77fed740 1 -- 172.21.15.53:0/1020511132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab667b1b0 msgr2=0x55bab6a36500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:59.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b77fed740 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab667b1b0 0x55bab6a36500 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f5b60024e30 tx=0x7f5b60024e90 comp rx=0 tx=0).stop 2024-08-31T06:24:59.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b77fed740 1 -- 172.21.15.53:0/1020511132 shutdown_connections 2024-08-31T06:24:59.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b77fed740 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bab6639d80 0x55bab6a3c990 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b77fed740 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab667b1b0 0x55bab6a36500 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b4eff5640 0 client.21666 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:59.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b77fed740 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 0x55bab6a2ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b77fed740 1 --2- 172.21.15.53:0/1020511132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 0x55bab6a2a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b77fed740 1 -- 172.21.15.53:0/1020511132 >> 172.21.15.53:0/1020511132 conn(0x55bab666f300 msgr2=0x55bab6a1faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:59.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b77fed740 1 -- 172.21.15.53:0/1020511132 shutdown_connections 2024-08-31T06:24:59.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.553+0000 7f5b77fed740 1 -- 172.21.15.53:0/1020511132 wait complete. 2024-08-31T06:24:59.560 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.554+0000 7f5b77fed740 20 client.21666 trim_cache size 0 max 16384 2024-08-31T06:24:59.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.579+0000 7f5b77fed740 1 Processor -- start 2024-08-31T06:24:59.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.579+0000 7f5b77fed740 1 -- start start 2024-08-31T06:24:59.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab6639d80 0x55bab6a36ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 0x55bab6a23b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 0x55bab6a240c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b77fed740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1ad3c0 con 0x55bab6639d80 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b77fed740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1af080 con 0x55bab665a4d0 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b77fed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1adaf0 con 0x55bab66522f0 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b6a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab6639d80 0x55bab6a36ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b6a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab6639d80 0x55bab6a36ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44698/0 (socket says 172.21.15.53:44698) 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b6a59c640 1 -- 172.21.15.53:0/402153764 learned_addr learned my addr 172.21.15.53:0/402153764 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b6ad9d640 1 --2- 172.21.15.53:0/402153764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 0x55bab6a23b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b6a59c640 1 -- 172.21.15.53:0/402153764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 msgr2=0x55bab6a23b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/402153764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 0x55bab6a23b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b6a59c640 1 -- 172.21.15.53:0/402153764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 msgr2=0x55bab6a240c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/402153764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 0x55bab6a240c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.583 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.580+0000 7f5b6a59c640 1 -- 172.21.15.53:0/402153764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab6a20ff0 con 0x55bab6639d80 2024-08-31T06:24:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.581+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/402153764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab6639d80 0x55bab6a36ab0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009150 tx=0x7f5b6000afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa74477e6636391b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.581+0000 7f5b50ff9640 1 -- 172.21.15.53:0/402153764 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60028070 con 0x55bab6639d80 2024-08-31T06:24:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.581+0000 7f5b50ff9640 1 -- 172.21.15.53:0/402153764 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b60023de0 con 0x55bab6639d80 2024-08-31T06:24:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.581+0000 7f5b50ff9640 1 -- 172.21.15.53:0/402153764 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000ef10 con 0x55bab6639d80 2024-08-31T06:24:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.582+0000 7f5b77fed740 1 -- 172.21.15.53:0/402153764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab6639d80 msgr2=0x55bab6a36ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.582+0000 7f5b77fed740 1 --2- 172.21.15.53:0/402153764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab6639d80 0x55bab6a36ab0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009150 tx=0x7f5b6000afa0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.582+0000 7f5b77fed740 1 -- 172.21.15.53:0/402153764 shutdown_connections 2024-08-31T06:24:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.582+0000 7f5b77fed740 1 --2- 172.21.15.53:0/402153764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 0x55bab6a240c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.582+0000 7f5b77fed740 1 --2- 172.21.15.53:0/402153764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab66522f0 0x55bab6a23b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.585 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.582+0000 7f5b77fed740 1 --2- 172.21.15.53:0/402153764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab6639d80 0x55bab6a36ab0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.582+0000 7f5b77fed740 1 -- 172.21.15.53:0/402153764 >> 172.21.15.53:0/402153764 conn(0x55bab666f300 msgr2=0x55bab6a25540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:59.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.582+0000 7f5b77fed740 1 -- 172.21.15.53:0/402153764 shutdown_connections 2024-08-31T06:24:59.586 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.583+0000 7f5b77fed740 1 -- 172.21.15.53:0/402153764 wait complete. 2024-08-31T06:24:59.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.583+0000 7f5b77fed740 1 -- start start 2024-08-31T06:24:59.587 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.583+0000 7f5b77fed740 1 Processor -- start 2024-08-31T06:24:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.583+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab6639d80 0x55bab6a2d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab66522f0 0x55bab6a2da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b77fed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 0x55bab6a2dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b77fed740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1ae8f0 con 0x55bab66522f0 2024-08-31T06:24:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b77fed740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1ae1c0 con 0x55bab665a4d0 2024-08-31T06:24:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b77fed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c10c900 con 0x55bab6639d80 2024-08-31T06:24:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b77fed740 10 client.0 _ll_register_callbacks cb 0x7f5b600098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b6ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab66522f0 0x55bab6a2da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b6ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab66522f0 0x55bab6a2da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44712/0 (socket says 172.21.15.53:44712) 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b6ad9d640 1 -- 172.21.15.53:0/2852756438 learned_addr learned my addr 172.21.15.53:0/2852756438 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b6ad9d640 1 -- 172.21.15.53:0/2852756438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab6639d80 msgr2=0x55bab6a2d550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b6ad9d640 1 --2- 172.21.15.53:0/2852756438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab6639d80 0x55bab6a2d550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b6ad9d640 1 -- 172.21.15.53:0/2852756438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 msgr2=0x55bab6a2dfd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b6ad9d640 1 --2- 172.21.15.53:0/2852756438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 0x55bab6a2dfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b6ad9d640 1 -- 172.21.15.53:0/2852756438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bab6aa5480 con 0x55bab66522f0 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b6ad9d640 1 --2- 172.21.15.53:0/2852756438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab66522f0 0x55bab6a2da90 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f5b64000f80 tx=0x7f5b640188a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20795b1cfcb49058 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.584+0000 7f5b4eff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.585+0000 7f5b4eff5640 1 -- 172.21.15.53:0/2852756438 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64024070 con 0x55bab66522f0 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.585+0000 7f5b4eff5640 1 -- 172.21.15.53:0/2852756438 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8557+0+0 (secure 0 0 0) 0x7f5b6401f930 con 0x55bab66522f0 2024-08-31T06:24:59.589 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.585+0000 7f5b77fed740 1 -- 172.21.15.53:0/2852756438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b60023de0 con 0x55bab66522f0 2024-08-31T06:24:59.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.585+0000 7f5b4eff5640 1 -- 172.21.15.53:0/2852756438 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f5b6402e050 con 0x55bab66522f0 2024-08-31T06:24:59.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.586+0000 7f5b77fed740 10 client.21672 fetch_fsmap learned FSMap version 73 2024-08-31T06:24:59.590 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.586+0000 7f5b77fed740 1 -- 172.21.15.53:0/2852756438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x55bab6aa6740 con 0x55bab66522f0 2024-08-31T06:24:59.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.586+0000 7f5b4eff5640 1 -- 172.21.15.53:0/2852756438 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b60023de0 con 0x55bab66522f0 2024-08-31T06:24:59.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.586+0000 7f5b4eff5640 1 -- 172.21.15.53:0/2852756438 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 73) ==== 8394+0+0 (secure 0 0 0) 0x7f5b64029c80 con 0x55bab66522f0 2024-08-31T06:24:59.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.586+0000 7f5b77fed740 10 client.21672 fetch_fsmap finished waiting for FSMap version 73 2024-08-31T06:24:59.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.586+0000 7f5b77fed740 10 client.21672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:24:59.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.586+0000 7f5b77fed740 20 client.21672 populate_metadata read hostname 'smithi053' 2024-08-31T06:24:59.591 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.586+0000 7f5b77fed740 1 --2- 172.21.15.53:0/2852756438 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bab667b1b0 0x55bab6aa8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:24:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.586+0000 7f5b77fed740 4 client.21672 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:24:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.586+0000 7f5b77fed740 1 -- 172.21.15.53:0/2852756438 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bab69919f0 con 0x55bab667b1b0 2024-08-31T06:24:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.587+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/2852756438 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bab667b1b0 0x55bab6aa8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:24:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.587+0000 7f5b4eff5640 10 client.21672 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:59.592 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.587+0000 7f5b6a59c640 1 --2- 172.21.15.53:0/2852756438 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bab667b1b0 0x55bab6aa8ff0 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=937e8fb466214a9 server_cookie=ab9bf027e6faa0c8 in_seq=0 out_seq=0 2024-08-31T06:24:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:24:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:24:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:24:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:24:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b4eff5640 1 -- 172.21.15.53:0/2852756438 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bab69919f0 con 0x55bab667b1b0 2024-08-31T06:24:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b4eff5640 10 client.21672 handle_command_reply: tid=0 2024-08-31T06:24:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b77fed740 1 client.21672 shutdown 2024-08-31T06:24:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b77fed740 1 -- 172.21.15.53:0/2852756438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab66522f0 msgr2=0x55bab6a2da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b77fed740 1 --2- 172.21.15.53:0/2852756438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab66522f0 0x55bab6a2da90 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f5b64000f80 tx=0x7f5b640188a0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b77fed740 1 -- 172.21.15.53:0/2852756438 shutdown_connections 2024-08-31T06:24:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b77fed740 1 --2- 172.21.15.53:0/2852756438 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55bab667b1b0 0x55bab6aa8ff0 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b77fed740 1 --2- 172.21.15.53:0/2852756438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bab665a4d0 0x55bab6a2dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b77fed740 1 --2- 172.21.15.53:0/2852756438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bab66522f0 0x55bab6a2da90 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b77fed740 1 --2- 172.21.15.53:0/2852756438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bab6639d80 0x55bab6a2d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b77fed740 1 -- 172.21.15.53:0/2852756438 >> 172.21.15.53:0/2852756438 conn(0x55bab666f300 msgr2=0x55bab6a28bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.657+0000 7f5b4eff5640 0 client.21672 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:24:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.658+0000 7f5b77fed740 1 -- 172.21.15.53:0/2852756438 shutdown_connections 2024-08-31T06:24:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.658+0000 7f5b77fed740 1 -- 172.21.15.53:0/2852756438 wait complete. 2024-08-31T06:24:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.658+0000 7f5b77fed740 20 client.21672 trim_cache size 0 max 16384 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.661+0000 7f5b71086640 1 -- 172.21.15.53:0/227620778 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b540b4d20 msgr2=0x7f5b540b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.661+0000 7f5b71086640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b540b4d20 0x7f5b540b7230 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0c95a0 tx=0x7f5b5c0cc1a0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.661+0000 7f5b71086640 1 -- 172.21.15.53:0/227620778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b6c1089d0 msgr2=0x7f5b6c10c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.661+0000 7f5b71086640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b6c1089d0 0x7f5b6c10c080 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c02aa10 tx=0x7f5b5c003cb0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.661+0000 7f5b71086640 1 -- 172.21.15.53:0/227620778 shutdown_connections 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.661+0000 7f5b71086640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5b540b4d20 0x7f5b540b7230 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.661+0000 7f5b71086640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b6c1089d0 0x7f5b6c10c080 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.661+0000 7f5b71086640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b6c108080 0x7f5b6c10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.661+0000 7f5b71086640 1 --2- 172.21.15.53:0/227620778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c102750 0x7f5b6c10b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.661+0000 7f5b71086640 1 -- 172.21.15.53:0/227620778 >> 172.21.15.53:0/227620778 conn(0x7f5b6c07a4e0 msgr2=0x7f5b6c069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.661+0000 7f5b71086640 1 -- 172.21.15.53:0/227620778 shutdown_connections 2024-08-31T06:24:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:24:59.662+0000 7f5b71086640 1 -- 172.21.15.53:0/227620778 wait complete. 2024-08-31T06:25:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:24:59 smithi153 ceph-mon[22320]: pgmap v952: 97 pgs: 97 active+clean; 738 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 331 op/s 2024-08-31T06:25:00.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:24:59 smithi053 ceph-mon[18924]: pgmap v952: 97 pgs: 97 active+clean; 738 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 331 op/s 2024-08-31T06:25:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:24:59 smithi130 ceph-mon[22266]: pgmap v952: 97 pgs: 97 active+clean; 738 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 331 op/s 2024-08-31T06:25:00.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 42711 5.31 MB/sec execute 288 sec latency 139.836 ms 2024-08-31T06:25:01.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 42867 5.33 MB/sec execute 289 sec latency 130.977 ms 2024-08-31T06:25:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:01 smithi153 ceph-mon[22320]: pgmap v953: 97 pgs: 97 active+clean; 738 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 342 op/s 2024-08-31T06:25:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:01 smithi153 ceph-mon[22320]: osdmap e103: 12 total, 12 up, 12 in 2024-08-31T06:25:02.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:01 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:25:02.208 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:01 smithi130 ceph-mon[22266]: pgmap v953: 97 pgs: 97 active+clean; 738 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 342 op/s 2024-08-31T06:25:02.208 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:01 smithi130 ceph-mon[22266]: osdmap e103: 12 total, 12 up, 12 in 2024-08-31T06:25:02.209 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:01 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:25:02.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:01 smithi053 ceph-mon[18924]: pgmap v953: 97 pgs: 97 active+clean; 738 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 342 op/s 2024-08-31T06:25:02.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:01 smithi053 ceph-mon[18924]: osdmap e103: 12 total, 12 up, 12 in 2024-08-31T06:25:02.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:01 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:25:02.382 INFO:tasks.workunit.client.0.smithi053.stdout: 10 43019 5.35 MB/sec execute 290 sec latency 149.714 ms 2024-08-31T06:25:03.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 43194 5.37 MB/sec execute 291 sec latency 75.288 ms 2024-08-31T06:25:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:04 smithi130 ceph-mon[22266]: pgmap v955: 97 pgs: 97 active+clean; 731 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 339 op/s 2024-08-31T06:25:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:04.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:04 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:04.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 43316 5.37 MB/sec execute 292 sec latency 94.168 ms 2024-08-31T06:25:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:04 smithi153 ceph-mon[22320]: pgmap v955: 97 pgs: 97 active+clean; 731 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 339 op/s 2024-08-31T06:25:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:04.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:04.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:04.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:04 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:04 smithi053 ceph-mon[18924]: pgmap v955: 97 pgs: 97 active+clean; 731 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 339 op/s 2024-08-31T06:25:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:04.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:04 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:05.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 43451 5.36 MB/sec execute 293 sec latency 97.591 ms 2024-08-31T06:25:05.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:05.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:05.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:05 smithi130 ceph-mon[22266]: pgmap v956: 97 pgs: 97 active+clean; 719 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 329 op/s 2024-08-31T06:25:05.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:25:05.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:25:05.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:05.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:05.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:05.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:05 smithi153 ceph-mon[22320]: pgmap v956: 97 pgs: 97 active+clean; 719 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 329 op/s 2024-08-31T06:25:05.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:25:05.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:25:05.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:05 smithi053 ceph-mon[18924]: pgmap v956: 97 pgs: 97 active+clean; 719 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 329 op/s 2024-08-31T06:25:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:25:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:25:05.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:25:06.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 43645 5.40 MB/sec execute 294 sec latency 53.532 ms 2024-08-31T06:25:06.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:25:06.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:25:06.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:25:06.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:25:06.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:25:06.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:25:06.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:25:06.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:25:06.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:25:06.926 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:25:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:25:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:25:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:25:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:25:06.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:25:07.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 43803 5.40 MB/sec execute 295 sec latency 118.295 ms 2024-08-31T06:25:07.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:07 smithi130 ceph-mon[22266]: pgmap v957: 97 pgs: 97 active+clean; 720 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 324 op/s 2024-08-31T06:25:07.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:07 smithi153 ceph-mon[22320]: pgmap v957: 97 pgs: 97 active+clean; 720 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 324 op/s 2024-08-31T06:25:07.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:07 smithi053 ceph-mon[18924]: pgmap v957: 97 pgs: 97 active+clean; 720 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 324 op/s 2024-08-31T06:25:08.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 43954 5.40 MB/sec execute 296 sec latency 105.147 ms 2024-08-31T06:25:09.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 44099 5.40 MB/sec execute 297 sec latency 58.351 ms 2024-08-31T06:25:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:09 smithi130 ceph-mon[22266]: pgmap v958: 97 pgs: 97 active+clean; 729 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 357 op/s 2024-08-31T06:25:10.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:09 smithi130 ceph-mon[22266]: osdmap e104: 12 total, 12 up, 12 in 2024-08-31T06:25:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:09 smithi153 ceph-mon[22320]: pgmap v958: 97 pgs: 97 active+clean; 729 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 357 op/s 2024-08-31T06:25:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:09 smithi153 ceph-mon[22320]: osdmap e104: 12 total, 12 up, 12 in 2024-08-31T06:25:10.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:09 smithi053 ceph-mon[18924]: pgmap v958: 97 pgs: 97 active+clean; 729 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 357 op/s 2024-08-31T06:25:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:09 smithi053 ceph-mon[18924]: osdmap e104: 12 total, 12 up, 12 in 2024-08-31T06:25:10.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 44285 5.43 MB/sec execute 298 sec latency 54.593 ms 2024-08-31T06:25:11.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 44466 5.45 MB/sec execute 299 sec latency 71.211 ms 2024-08-31T06:25:12.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:11 smithi130 ceph-mon[22266]: pgmap v960: 97 pgs: 97 active+clean; 739 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 386 op/s 2024-08-31T06:25:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:11 smithi153 ceph-mon[22320]: pgmap v960: 97 pgs: 97 active+clean; 739 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 386 op/s 2024-08-31T06:25:12.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:11 smithi053 ceph-mon[18924]: pgmap v960: 97 pgs: 97 active+clean; 739 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 386 op/s 2024-08-31T06:25:12.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 44628 5.45 MB/sec execute 300 sec latency 57.072 ms 2024-08-31T06:25:12.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.763+0000 7f046912c640 1 -- 172.21.15.53:0/340109936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0464102780 msgr2=0x7f0464102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:12.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.763+0000 7f046912c640 1 --2- 172.21.15.53:0/340109936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0464102780 0x7f0464102b90 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f0454009900 tx=0x7f045402a410 comp rx=0 tx=0).stop 2024-08-31T06:25:12.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.763+0000 7f046912c640 1 -- 172.21.15.53:0/340109936 shutdown_connections 2024-08-31T06:25:12.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.763+0000 7f046912c640 1 --2- 172.21.15.53:0/340109936 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0464108a00 0x7f046410f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.763+0000 7f046912c640 1 --2- 172.21.15.53:0/340109936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04641080b0 0x7f04641084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.763+0000 7f046912c640 1 --2- 172.21.15.53:0/340109936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0464102780 0x7f0464102b90 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.763+0000 7f046912c640 1 -- 172.21.15.53:0/340109936 >> 172.21.15.53:0/340109936 conn(0x7f04640fe160 msgr2=0x7f04641005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:12.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.763+0000 7f046912c640 1 -- 172.21.15.53:0/340109936 shutdown_connections 2024-08-31T06:25:12.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.763+0000 7f046912c640 1 -- 172.21.15.53:0/340109936 wait complete. 2024-08-31T06:25:12.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.764+0000 7f046912c640 1 Processor -- start 2024-08-31T06:25:12.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.764+0000 7f046912c640 1 -- start start 2024-08-31T06:25:12.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046912c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0464102780 0x7f046419af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046912c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04641080b0 0x7f046419b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046912c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0464108a00 0x7f046419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046912c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0464112580 con 0x7f0464108a00 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046912c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0464112400 con 0x7f04641080b0 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046912c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0464112700 con 0x7f0464102780 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0464108a00 0x7f046419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0464108a00 0x7f046419b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48454/0 (socket says 172.21.15.53:48454) 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04641080b0 0x7f046419b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046359e640 1 -- 172.21.15.53:0/3191981998 learned_addr learned my addr 172.21.15.53:0/3191981998 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f0462d9d640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0464102780 0x7f046419af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046359e640 1 -- 172.21.15.53:0/3191981998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0464102780 msgr2=0x7f046419af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046359e640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0464102780 0x7f046419af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046359e640 1 -- 172.21.15.53:0/3191981998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04641080b0 msgr2=0x7f046419b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046359e640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04641080b0 0x7f046419b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046359e640 1 -- 172.21.15.53:0/3191981998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04641a61f0 con 0x7f0464108a00 2024-08-31T06:25:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046359e640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0464108a00 0x7f046419b9b0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f045c00eb10 tx=0x7f045c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f044bfff640 1 -- 172.21.15.53:0/3191981998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c004b20 con 0x7f0464108a00 2024-08-31T06:25:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f044bfff640 1 -- 172.21.15.53:0/3191981998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f045c004cc0 con 0x7f0464108a00 2024-08-31T06:25:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f046912c640 1 -- 172.21.15.53:0/3191981998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04641a64e0 con 0x7f0464108a00 2024-08-31T06:25:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.765+0000 7f044bfff640 1 -- 172.21.15.53:0/3191981998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c010690 con 0x7f0464108a00 2024-08-31T06:25:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.766+0000 7f046912c640 1 -- 172.21.15.53:0/3191981998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04641a6a30 con 0x7f0464108a00 2024-08-31T06:25:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.768+0000 7f0470094740 1 Processor -- start 2024-08-31T06:25:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.768+0000 7f044bfff640 1 -- 172.21.15.53:0/3191981998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f045c005020 con 0x7f0464108a00 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.768+0000 7f0470094740 1 -- start start 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.768+0000 7f0470094740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a7706ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.768+0000 7f0470094740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a7706d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.768+0000 7f0470094740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76ca44d0 0x561a7706d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.768+0000 7f0470094740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561a76fde000 con 0x561a76cc51b0 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.768+0000 7f0470094740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561a76fcd590 con 0x561a76c9c2f0 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.768+0000 7f0470094740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a76fd1540 con 0x561a76ca44d0 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f046259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a7706ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f046259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a7706ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48462/0 (socket says 172.21.15.53:48462) 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f046259c640 1 -- 172.21.15.53:0/3289364471 learned_addr learned my addr 172.21.15.53:0/3289364471 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f046259c640 1 --2- 172.21.15.53:0/3289364471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76ca44d0 0x561a7706d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f0462d9d640 1 --2- 172.21.15.53:0/3289364471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a7706d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f044bfff640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f044c0b4ca0 0x7f044c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f046259c640 1 -- 172.21.15.53:0/3289364471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76ca44d0 msgr2=0x561a7706d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f046259c640 1 --2- 172.21.15.53:0/3289364471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76ca44d0 0x561a7706d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f046259c640 1 -- 172.21.15.53:0/3289364471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 msgr2=0x561a7706d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f046259c640 1 --2- 172.21.15.53:0/3289364471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a7706d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f046259c640 1 -- 172.21.15.53:0/3289364471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a76d30790 con 0x561a76cc51b0 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f046359e640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f044c0b4ca0 0x7f044c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f046259c640 1 --2- 172.21.15.53:0/3289364471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a7706ced0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f04580124c0 tx=0x7f045800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93078fe75ed8025 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f044bfff640 1 -- 172.21.15.53:0/3191981998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f045c0e5b00 con 0x7f0464108a00 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f04497fa640 1 -- 172.21.15.53:0/3289364471 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458004030 con 0x561a76cc51b0 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f04497fa640 1 -- 172.21.15.53:0/3289364471 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0458005020 con 0x561a76cc51b0 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.769+0000 7f04497fa640 1 -- 172.21.15.53:0/3289364471 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458004b00 con 0x561a76cc51b0 2024-08-31T06:25:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.770+0000 7f0470094740 1 -- 172.21.15.53:0/3289364471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 msgr2=0x561a7706ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.770+0000 7f046359e640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f044c0b4ca0 0x7f044c0b71b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f045c0e3830 tx=0x7f045c079670 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.770+0000 7f0470094740 1 --2- 172.21.15.53:0/3289364471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a7706ced0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f04580124c0 tx=0x7f045800b820 comp rx=0 tx=0).stop 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.770+0000 7f0470094740 1 -- 172.21.15.53:0/3289364471 shutdown_connections 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.770+0000 7f0470094740 1 --2- 172.21.15.53:0/3289364471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76ca44d0 0x561a7706d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.770+0000 7f0470094740 1 --2- 172.21.15.53:0/3289364471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a7706d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.770+0000 7f0470094740 1 --2- 172.21.15.53:0/3289364471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a7706ced0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.770+0000 7f0470094740 1 -- 172.21.15.53:0/3289364471 >> 172.21.15.53:0/3289364471 conn(0x561a76cb9300 msgr2=0x561a7706adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.770+0000 7f0470094740 1 -- 172.21.15.53:0/3289364471 shutdown_connections 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.770+0000 7f0470094740 1 -- 172.21.15.53:0/3289364471 wait complete. 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f0470094740 1 -- start start 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f0470094740 1 Processor -- start 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f0470094740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76c9c2f0 0x561a77078ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f0470094740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76ca44d0 0x561a77079050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f0470094740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77084940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f0470094740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561a76f06ab0 con 0x561a76cc51b0 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f0470094740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561a76f54680 con 0x561a76ca44d0 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f0470094740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a7707b650 con 0x561a76c9c2f0 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f0470094740 10 client.0 _ll_register_callbacks cb 0x561a76cdca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f046259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77084940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f046259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77084940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48468/0 (socket says 172.21.15.53:48468) 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f046259c640 1 -- 172.21.15.53:0/4089729595 learned_addr learned my addr 172.21.15.53:0/4089729595 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f046259c640 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76c9c2f0 0x561a77078ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.771+0000 7f0462d9d640 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76ca44d0 0x561a77079050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f046259c640 1 -- 172.21.15.53:0/4089729595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76c9c2f0 msgr2=0x561a77078ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f046259c640 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76c9c2f0 0x561a77078ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f046259c640 1 -- 172.21.15.53:0/4089729595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76ca44d0 msgr2=0x561a77079050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f046259c640 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76ca44d0 0x561a77079050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f046259c640 1 -- 172.21.15.53:0/4089729595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a76da9620 con 0x561a76cc51b0 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f046259c640 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77084940 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f0458005680 tx=0x7f045800bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149ec33b33ce45c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f0446ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f0446ff5640 1 -- 172.21.15.53:0/4089729595 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458027040 con 0x561a76cc51b0 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f0470094740 1 -- 172.21.15.53:0/4089729595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0458005020 con 0x561a76cc51b0 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f0446ff5640 1 -- 172.21.15.53:0/4089729595 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f0458004230 con 0x561a76cc51b0 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f0446ff5640 1 -- 172.21.15.53:0/4089729595 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f0458004430 con 0x561a76cc51b0 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f0470094740 10 client.21684 fetch_fsmap learned FSMap version 74 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f0470094740 1 -- 172.21.15.53:0/4089729595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x561a770876c0 con 0x561a76cc51b0 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.772+0000 7f0446ff5640 1 -- 172.21.15.53:0/4089729595 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0458005020 con 0x561a76cc51b0 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.773+0000 7f0446ff5640 1 -- 172.21.15.53:0/4089729595 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 74) ==== 8402+0+0 (secure 0 0 0) 0x7f045801c020 con 0x561a76cc51b0 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.773+0000 7f0470094740 10 client.21684 fetch_fsmap finished waiting for FSMap version 74 2024-08-31T06:25:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.773+0000 7f0470094740 10 client.21684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.773+0000 7f0470094740 20 client.21684 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.773+0000 7f0470094740 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a76c83d80 0x561a7708aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.773+0000 7f0470094740 4 client.21684 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.773+0000 7f0470094740 1 -- 172.21.15.53:0/4089729595 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a76fdff50 con 0x561a76c83d80 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.773+0000 7f0462d9d640 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a76c83d80 0x561a7708aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.773+0000 7f0446ff5640 10 client.21684 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.773+0000 7f0462d9d640 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a76c83d80 0x561a7708aa20 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0f3ea0d1749a52b server_cookie=21b8e9a85f052873 in_seq=0 out_seq=0 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0446ff5640 1 -- 172.21.15.53:0/4089729595 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a76fdff50 con 0x561a76c83d80 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0446ff5640 10 client.21684 handle_command_reply: tid=0 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 1 client.21684 shutdown 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 1 -- 172.21.15.53:0/4089729595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 msgr2=0x561a77084940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77084940 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f0458005680 tx=0x7f045800bf20 comp rx=0 tx=0).stop 2024-08-31T06:25:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 1 -- 172.21.15.53:0/4089729595 shutdown_connections 2024-08-31T06:25:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a76c83d80 0x561a7708aa20 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77084940 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0446ff5640 0 client.21684 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76ca44d0 0x561a77079050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 1 --2- 172.21.15.53:0/4089729595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76c9c2f0 0x561a77078ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 1 -- 172.21.15.53:0/4089729595 >> 172.21.15.53:0/4089729595 conn(0x561a76cb9300 msgr2=0x561a7706df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 1 -- 172.21.15.53:0/4089729595 shutdown_connections 2024-08-31T06:25:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 1 -- 172.21.15.53:0/4089729595 wait complete. 2024-08-31T06:25:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.774+0000 7f0470094740 20 client.21684 trim_cache size 0 max 16384 2024-08-31T06:25:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f0470094740 1 Processor -- start 2024-08-31T06:25:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f0470094740 1 -- start start 2024-08-31T06:25:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f0470094740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a7706df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f0470094740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76ca44d0 0x561a7706e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f0470094740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f0470094740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f04641ad340 con 0x561a76cc51b0 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f0470094740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f04641af060 con 0x561a76c9c2f0 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f0470094740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04641ada70 con 0x561a76ca44d0 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f046259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f046259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48476/0 (socket says 172.21.15.53:48476) 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f046259c640 1 -- 172.21.15.53:0/495752181 learned_addr learned my addr 172.21.15.53:0/495752181 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f046259c640 1 --2- 172.21.15.53:0/495752181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a7706df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f0462d9d640 1 --2- 172.21.15.53:0/495752181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76ca44d0 0x561a7706e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f046259c640 1 -- 172.21.15.53:0/495752181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76ca44d0 msgr2=0x561a7706e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:12.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f046259c640 1 --2- 172.21.15.53:0/495752181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76ca44d0 0x561a7706e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f046259c640 1 -- 172.21.15.53:0/495752181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 msgr2=0x561a7706df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f046259c640 1 --2- 172.21.15.53:0/495752181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a7706df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.789+0000 7f046259c640 1 -- 172.21.15.53:0/495752181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a7706f1d0 con 0x561a76cc51b0 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.790+0000 7f046259c640 1 --2- 172.21.15.53:0/495752181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77071f90 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f04580059f0 tx=0x7f04580045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f27b1a37188b8a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.790+0000 7f0448ff9640 1 -- 172.21.15.53:0/495752181 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458012180 con 0x561a76cc51b0 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.790+0000 7f0448ff9640 1 -- 172.21.15.53:0/495752181 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04580056b0 con 0x561a76cc51b0 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.790+0000 7f0448ff9640 1 -- 172.21.15.53:0/495752181 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458004d10 con 0x561a76cc51b0 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.790+0000 7f0470094740 1 -- 172.21.15.53:0/495752181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 msgr2=0x561a77071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.790+0000 7f0470094740 1 --2- 172.21.15.53:0/495752181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77071f90 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f04580059f0 tx=0x7f04580045d0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 -- 172.21.15.53:0/495752181 shutdown_connections 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 --2- 172.21.15.53:0/495752181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76cc51b0 0x561a77071f90 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 --2- 172.21.15.53:0/495752181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76ca44d0 0x561a7706e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 --2- 172.21.15.53:0/495752181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a7706df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 -- 172.21.15.53:0/495752181 >> 172.21.15.53:0/495752181 conn(0x561a76cb9300 msgr2=0x561a77077120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 -- 172.21.15.53:0/495752181 shutdown_connections 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 -- 172.21.15.53:0/495752181 wait complete. 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 -- start start 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 Processor -- start 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a770810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76ca44d0 0x561a7707c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76cc51b0 0x561a7707cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f04641ae8d0 con 0x561a76ca44d0 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f04641ae140 con 0x561a76c9c2f0 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04641ab340 con 0x561a76cc51b0 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0470094740 10 client.0 _ll_register_callbacks cb 0x7f04580123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0462d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76ca44d0 0x561a7707c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0462d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76ca44d0 0x561a7707c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48488/0 (socket says 172.21.15.53:48488) 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.791+0000 7f0462d9d640 1 -- 172.21.15.53:0/1975177078 learned_addr learned my addr 172.21.15.53:0/1975177078 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f046259c640 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a770810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0462d9d640 1 -- 172.21.15.53:0/1975177078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76cc51b0 msgr2=0x561a7707cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f046259c640 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76cc51b0 0x561a7707cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0462d9d640 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76cc51b0 0x561a7707cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0462d9d640 1 -- 172.21.15.53:0/1975177078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 msgr2=0x561a770810c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0462d9d640 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a770810c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0462d9d640 1 -- 172.21.15.53:0/1975177078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a7707d270 con 0x561a76ca44d0 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0462d9d640 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76ca44d0 0x561a7707c560 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f04540057c0 tx=0x7f0454031930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd591a38d42f8ee4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0446ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0446ff5640 1 -- 172.21.15.53:0/1975177078 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454035040 con 0x561a76ca44d0 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0446ff5640 1 -- 172.21.15.53:0/1975177078 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f0454004450 con 0x561a76ca44d0 2024-08-31T06:25:12.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0470094740 1 -- 172.21.15.53:0/1975177078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04580056b0 con 0x561a76ca44d0 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0446ff5640 1 -- 172.21.15.53:0/1975177078 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f04540035f0 con 0x561a76ca44d0 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0470094740 10 client.21690 fetch_fsmap learned FSMap version 74 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0470094740 1 -- 172.21.15.53:0/1975177078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) -- 0x561a770f5320 con 0x561a76ca44d0 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.792+0000 7f0446ff5640 1 -- 172.21.15.53:0/1975177078 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04580056b0 con 0x561a76ca44d0 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.793+0000 7f0446ff5640 1 -- 172.21.15.53:0/1975177078 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 74) ==== 8402+0+0 (secure 0 0 0) 0x7f045403b7a0 con 0x561a76ca44d0 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.793+0000 7f0470094740 10 client.21690 fetch_fsmap finished waiting for FSMap version 74 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.793+0000 7f0470094740 10 client.21690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.793+0000 7f0470094740 20 client.21690 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.793+0000 7f0470094740 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a76c591c0 0x561a770f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.793+0000 7f0470094740 4 client.21690 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.793+0000 7f0470094740 1 -- 172.21.15.53:0/1975177078 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561a76fdb9f0 con 0x561a76c591c0 2024-08-31T06:25:12.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.793+0000 7f046259c640 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a76c591c0 0x561a770f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.793+0000 7f046259c640 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a76c591c0 0x561a770f7bd0 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7608dbba27017315 server_cookie=1405af66b266bef7 in_seq=0 out_seq=0 2024-08-31T06:25:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.793+0000 7f0446ff5640 10 client.21690 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.913+0000 7f0446ff5640 1 -- 172.21.15.53:0/1975177078 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561a76fdb9f0 con 0x561a76c591c0 2024-08-31T06:25:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.913+0000 7f0446ff5640 10 client.21690 handle_command_reply: tid=0 2024-08-31T06:25:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.914+0000 7f0470094740 1 client.21690 shutdown 2024-08-31T06:25:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.914+0000 7f0470094740 1 -- 172.21.15.53:0/1975177078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76ca44d0 msgr2=0x561a7707c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.914+0000 7f0470094740 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76ca44d0 0x561a7707c560 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f04540057c0 tx=0x7f0454031930 comp rx=0 tx=0).stop 2024-08-31T06:25:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.915+0000 7f0470094740 1 -- 172.21.15.53:0/1975177078 shutdown_connections 2024-08-31T06:25:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.915+0000 7f0470094740 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a76c591c0 0x561a770f7bd0 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.915+0000 7f0470094740 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a76cc51b0 0x561a7707cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.915+0000 7f0446ff5640 0 client.21690 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.915+0000 7f0470094740 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a76ca44d0 0x561a7707c560 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.915+0000 7f0470094740 1 --2- 172.21.15.53:0/1975177078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a76c9c2f0 0x561a770810c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.915+0000 7f0470094740 1 -- 172.21.15.53:0/1975177078 >> 172.21.15.53:0/1975177078 conn(0x561a76cb9300 msgr2=0x561a77071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.915+0000 7f0470094740 1 -- 172.21.15.53:0/1975177078 shutdown_connections 2024-08-31T06:25:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.915+0000 7f0470094740 1 -- 172.21.15.53:0/1975177078 wait complete. 2024-08-31T06:25:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.915+0000 7f0470094740 20 client.21690 trim_cache size 0 max 16384 2024-08-31T06:25:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:25:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:25:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:25:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:25:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 -- 172.21.15.53:0/3191981998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f044c0b4ca0 msgr2=0x7f044c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f044c0b4ca0 0x7f044c0b71b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f045c0e3830 tx=0x7f045c079670 comp rx=0 tx=0).stop 2024-08-31T06:25:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 -- 172.21.15.53:0/3191981998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0464108a00 msgr2=0x7f046419b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0464108a00 0x7f046419b9b0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f045c00eb10 tx=0x7f045c00c2d0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 -- 172.21.15.53:0/3191981998 shutdown_connections 2024-08-31T06:25:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f044c0b4ca0 0x7f044c0b71b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0464108a00 0x7f046419b9b0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f04641080b0 0x7f046419b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 --2- 172.21.15.53:0/3191981998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0464102780 0x7f046419af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 -- 172.21.15.53:0/3191981998 >> 172.21.15.53:0/3191981998 conn(0x7f04640fe160 msgr2=0x7f0464106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 -- 172.21.15.53:0/3191981998 shutdown_connections 2024-08-31T06:25:12.921 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:12.916+0000 7f046912c640 1 -- 172.21.15.53:0/3191981998 wait complete. 2024-08-31T06:25:13.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:12 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:25:13.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:12 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:25:13.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:12 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:25:13.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 44768 5.48 MB/sec execute 301 sec latency 492.014 ms 2024-08-31T06:25:14.066 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:13 smithi130 ceph-mon[22266]: pgmap v961: 97 pgs: 97 active+clean; 745 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.0 MiB/s wr, 348 op/s 2024-08-31T06:25:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:13 smithi153 ceph-mon[22320]: pgmap v961: 97 pgs: 97 active+clean; 745 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.0 MiB/s wr, 348 op/s 2024-08-31T06:25:14.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:13 smithi053 ceph-mon[18924]: pgmap v961: 97 pgs: 97 active+clean; 745 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.0 MiB/s wr, 348 op/s 2024-08-31T06:25:14.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 44963 5.50 MB/sec execute 302 sec latency 63.737 ms 2024-08-31T06:25:15.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 45127 5.52 MB/sec execute 303 sec latency 81.700 ms 2024-08-31T06:25:16.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:15 smithi130 ceph-mon[22266]: pgmap v962: 97 pgs: 97 active+clean; 752 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 340 op/s 2024-08-31T06:25:16.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:15 smithi153 ceph-mon[22320]: pgmap v962: 97 pgs: 97 active+clean; 752 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 340 op/s 2024-08-31T06:25:16.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:15 smithi053 ceph-mon[18924]: pgmap v962: 97 pgs: 97 active+clean; 752 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 340 op/s 2024-08-31T06:25:16.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 45255 5.52 MB/sec execute 304 sec latency 176.344 ms 2024-08-31T06:25:17.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 45439 5.54 MB/sec execute 305 sec latency 52.640 ms 2024-08-31T06:25:18.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:17 smithi130 ceph-mon[22266]: pgmap v963: 97 pgs: 97 active+clean; 761 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 367 op/s 2024-08-31T06:25:18.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:17 smithi153 ceph-mon[22320]: pgmap v963: 97 pgs: 97 active+clean; 761 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 367 op/s 2024-08-31T06:25:18.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:17 smithi053 ceph-mon[18924]: pgmap v963: 97 pgs: 97 active+clean; 761 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 367 op/s 2024-08-31T06:25:18.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 45571 5.54 MB/sec execute 306 sec latency 52.136 ms 2024-08-31T06:25:19.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 45734 5.55 MB/sec execute 307 sec latency 57.342 ms 2024-08-31T06:25:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:19 smithi130 ceph-mon[22266]: pgmap v964: 97 pgs: 97 active+clean; 763 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 337 op/s 2024-08-31T06:25:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:19 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:25:20.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:19 smithi153 ceph-mon[22320]: pgmap v964: 97 pgs: 97 active+clean; 763 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 337 op/s 2024-08-31T06:25:20.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:19 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:25:20.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:19 smithi053 ceph-mon[18924]: pgmap v964: 97 pgs: 97 active+clean; 763 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 337 op/s 2024-08-31T06:25:20.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:19 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:25:20.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 45857 5.54 MB/sec execute 308 sec latency 176.147 ms 2024-08-31T06:25:21.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 46006 5.53 MB/sec execute 309 sec latency 172.816 ms 2024-08-31T06:25:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:21 smithi130 ceph-mon[22266]: pgmap v965: 97 pgs: 97 active+clean; 772 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 392 op/s 2024-08-31T06:25:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:21 smithi153 ceph-mon[22320]: pgmap v965: 97 pgs: 97 active+clean; 772 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 392 op/s 2024-08-31T06:25:22.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:21 smithi053 ceph-mon[18924]: pgmap v965: 97 pgs: 97 active+clean; 772 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 392 op/s 2024-08-31T06:25:22.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 46173 5.54 MB/sec execute 310 sec latency 121.857 ms 2024-08-31T06:25:23.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 46318 5.54 MB/sec execute 311 sec latency 179.055 ms 2024-08-31T06:25:24.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:23 smithi130 ceph-mon[22266]: pgmap v966: 97 pgs: 97 active+clean; 776 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 348 op/s 2024-08-31T06:25:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:23 smithi153 ceph-mon[22320]: pgmap v966: 97 pgs: 97 active+clean; 776 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 348 op/s 2024-08-31T06:25:24.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:23 smithi053 ceph-mon[18924]: pgmap v966: 97 pgs: 97 active+clean; 776 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 348 op/s 2024-08-31T06:25:24.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 46477 5.55 MB/sec execute 312 sec latency 154.624 ms 2024-08-31T06:25:24.750 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:25:25.229 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:25.383 INFO:tasks.workunit.client.0.smithi053.stdout: 10 46660 5.58 MB/sec execute 313 sec latency 100.266 ms 2024-08-31T06:25:25.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:25 smithi153 ceph-mon[22320]: pgmap v967: 97 pgs: 97 active+clean; 773 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.5 MiB/s wr, 351 op/s 2024-08-31T06:25:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:25 smithi130 ceph-mon[22266]: pgmap v967: 97 pgs: 97 active+clean; 773 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.5 MiB/s wr, 351 op/s 2024-08-31T06:25:26.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:25 smithi053 ceph-mon[18924]: pgmap v967: 97 pgs: 97 active+clean; 773 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.5 MiB/s wr, 351 op/s 2024-08-31T06:25:26.385 INFO:tasks.workunit.client.0.smithi053.stdout: 10 46807 5.59 MB/sec execute 314 sec latency 97.650 ms 2024-08-31T06:25:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.707+0000 7f91fca69640 1 -- 172.21.15.53:0/2457611149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91f81027b0 msgr2=0x7f91f8102bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.707+0000 7f91fca69640 1 --2- 172.21.15.53:0/2457611149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91f81027b0 0x7f91f8102bc0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009900 tx=0x7f91e802a410 comp rx=0 tx=0).stop 2024-08-31T06:25:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.707+0000 7f91fca69640 1 -- 172.21.15.53:0/2457611149 shutdown_connections 2024-08-31T06:25:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.707+0000 7f91fca69640 1 --2- 172.21.15.53:0/2457611149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91f8108a30 0x7f91f810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.707+0000 7f91fca69640 1 --2- 172.21.15.53:0/2457611149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f81080e0 0x7f91f81084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.707+0000 7f91fca69640 1 --2- 172.21.15.53:0/2457611149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91f81027b0 0x7f91f8102bc0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.707+0000 7f91fca69640 1 -- 172.21.15.53:0/2457611149 >> 172.21.15.53:0/2457611149 conn(0x7f91f80fe1b0 msgr2=0x7f91f8100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.707+0000 7f91fca69640 1 -- 172.21.15.53:0/2457611149 shutdown_connections 2024-08-31T06:25:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.707+0000 7f91fca69640 1 -- 172.21.15.53:0/2457611149 wait complete. 2024-08-31T06:25:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.708+0000 7f91fca69640 1 Processor -- start 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.708+0000 7f91fca69640 1 -- start start 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91fca69640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f81027b0 0x7f91f819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91fca69640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91f81080e0 0x7f91f819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91fca69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91f8108a30 0x7f91f81a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91fca69640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f91f81125b0 con 0x7f91f8108a30 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91fca69640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f91f8112430 con 0x7f91f81080e0 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91fca69640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91f8112730 con 0x7f91f81027b0 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91f8108a30 0x7f91f81a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f81027b0 0x7f91f819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f5d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91f81080e0 0x7f91f819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91f8108a30 0x7f91f81a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55898/0 (socket says 172.21.15.53:55898) 2024-08-31T06:25:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f6d9d640 1 -- 172.21.15.53:0/2153898065 learned_addr learned my addr 172.21.15.53:0/2153898065 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f6d9d640 1 -- 172.21.15.53:0/2153898065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f81027b0 msgr2=0x7f91f819c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f6d9d640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f81027b0 0x7f91f819c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f6d9d640 1 -- 172.21.15.53:0/2153898065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91f81080e0 msgr2=0x7f91f819c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f6d9d640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91f81080e0 0x7f91f819c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f6d9d640 1 -- 172.21.15.53:0/2153898065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f81a22c0 con 0x7f91f8108a30 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f5d9b640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91f81080e0 0x7f91f819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91f6d9d640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91f8108a30 0x7f91f81a1bc0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f91f000eb10 tx=0x7f91f000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91e77fe640 1 -- 172.21.15.53:0/2153898065 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f0004b20 con 0x7f91f8108a30 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91e77fe640 1 -- 172.21.15.53:0/2153898065 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91f0004cc0 con 0x7f91f8108a30 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91fca69640 1 -- 172.21.15.53:0/2153898065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f81a25b0 con 0x7f91f8108a30 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.709+0000 7f91e77fe640 1 -- 172.21.15.53:0/2153898065 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f0010690 con 0x7f91f8108a30 2024-08-31T06:25:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.710+0000 7f91fca69640 1 -- 172.21.15.53:0/2153898065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f81a8d40 con 0x7f91f8108a30 2024-08-31T06:25:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.712+0000 7f91e77fe640 1 -- 172.21.15.53:0/2153898065 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f91f0005020 con 0x7f91f8108a30 2024-08-31T06:25:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.713+0000 7f91e77fe640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91e00b4d20 0x7f91e00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.713+0000 7f91f659c640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91e00b4d20 0x7f91e00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.713+0000 7f91e77fe640 1 -- 172.21.15.53:0/2153898065 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f91f00e5ad0 con 0x7f91f8108a30 2024-08-31T06:25:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.714+0000 7f91f659c640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91e00b4d20 0x7f91e00b7230 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f91e80057c0 tx=0x7f91e80058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f92039d8740 1 Processor -- start 2024-08-31T06:25:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f92039d8740 1 -- start start 2024-08-31T06:25:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f92039d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 0x5598a5ab9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f92039d8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5aba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f92039d8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56f54d0 0x5598a5aba540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f92039d8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5598a5a2f000 con 0x5598a56ed2f0 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f92039d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5598a5a1e590 con 0x5598a57161b0 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f92039d8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5598a5a22540 con 0x5598a56f54d0 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f91f5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5aba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f91f5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5aba000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55906/0 (socket says 172.21.15.53:55906) 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f91f5d9b640 1 -- 172.21.15.53:0/658562248 learned_addr learned my addr 172.21.15.53:0/658562248 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f91f659c640 1 --2- 172.21.15.53:0/658562248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 0x5598a5ab9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.759+0000 7f91f6d9d640 1 --2- 172.21.15.53:0/658562248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56f54d0 0x5598a5aba540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.760+0000 7f91f5d9b640 1 -- 172.21.15.53:0/658562248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56f54d0 msgr2=0x5598a5aba540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.760+0000 7f91f5d9b640 1 --2- 172.21.15.53:0/658562248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56f54d0 0x5598a5aba540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.760+0000 7f91f5d9b640 1 -- 172.21.15.53:0/658562248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 msgr2=0x5598a5ab9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.760+0000 7f91f5d9b640 1 --2- 172.21.15.53:0/658562248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 0x5598a5ab9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.760+0000 7f91f5d9b640 1 -- 172.21.15.53:0/658562248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598a5781790 con 0x5598a56ed2f0 2024-08-31T06:25:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.760+0000 7f91f5d9b640 1 --2- 172.21.15.53:0/658562248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5aba000 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f91ec011470 tx=0x7f91ec011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e237ba41e88b4af server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:26.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.760+0000 7f91e4ff9640 1 -- 172.21.15.53:0/658562248 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec01e070 con 0x5598a56ed2f0 2024-08-31T06:25:26.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.760+0000 7f91e4ff9640 1 -- 172.21.15.53:0/658562248 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91ec004310 con 0x5598a56ed2f0 2024-08-31T06:25:26.764 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.760+0000 7f91e4ff9640 1 -- 172.21.15.53:0/658562248 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00f860 con 0x5598a56ed2f0 2024-08-31T06:25:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.761+0000 7f92039d8740 1 -- 172.21.15.53:0/658562248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 msgr2=0x5598a5aba000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.761+0000 7f92039d8740 1 --2- 172.21.15.53:0/658562248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5aba000 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f91ec011470 tx=0x7f91ec011930 comp rx=0 tx=0).stop 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.761+0000 7f92039d8740 1 -- 172.21.15.53:0/658562248 shutdown_connections 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.761+0000 7f92039d8740 1 --2- 172.21.15.53:0/658562248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56f54d0 0x5598a5aba540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.761+0000 7f92039d8740 1 --2- 172.21.15.53:0/658562248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5aba000 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.761+0000 7f92039d8740 1 --2- 172.21.15.53:0/658562248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 0x5598a5ab9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.761+0000 7f92039d8740 1 -- 172.21.15.53:0/658562248 >> 172.21.15.53:0/658562248 conn(0x5598a570a300 msgr2=0x5598a5ab79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.762+0000 7f92039d8740 1 -- 172.21.15.53:0/658562248 shutdown_connections 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.762+0000 7f92039d8740 1 -- 172.21.15.53:0/658562248 wait complete. 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.762+0000 7f92039d8740 1 -- start start 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.762+0000 7f92039d8740 1 Processor -- start 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f92039d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a56ed2f0 0x5598a5ac56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f92039d8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56f54d0 0x5598a5ac5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f92039d8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a57161b0 0x5598a5ad1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f92039d8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5598a5957ab0 con 0x5598a57161b0 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f92039d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5598a59a5680 con 0x5598a56ed2f0 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f92039d8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5598a5ac8240 con 0x5598a56f54d0 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f92039d8740 10 client.0 _ll_register_callbacks cb 0x5598a572da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f91f6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a57161b0 0x5598a5ad1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f91f659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a56ed2f0 0x5598a5ac56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f91f6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a57161b0 0x5598a5ad1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55908/0 (socket says 172.21.15.53:55908) 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f91f6d9d640 1 -- 172.21.15.53:0/2210774632 learned_addr learned my addr 172.21.15.53:0/2210774632 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f91f5d9b640 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56f54d0 0x5598a5ac5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f91f659c640 1 -- 172.21.15.53:0/2210774632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56f54d0 msgr2=0x5598a5ac5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f91f659c640 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56f54d0 0x5598a5ac5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f91f659c640 1 -- 172.21.15.53:0/2210774632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a57161b0 msgr2=0x5598a5ad1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f91f659c640 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a57161b0 0x5598a5ad1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f91f659c640 1 -- 172.21.15.53:0/2210774632 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598a57fa620 con 0x5598a56ed2f0 2024-08-31T06:25:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.763+0000 7f91f6d9d640 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a57161b0 0x5598a5ad1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.764+0000 7f91f659c640 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a56ed2f0 0x5598a5ac56c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f91e8005940 tx=0x7f91e802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b02b8d7035f9f445 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.764+0000 7f91ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:25:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.764+0000 7f91ddffb640 1 -- 172.21.15.53:0/2210774632 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e8035050 con 0x5598a56ed2f0 2024-08-31T06:25:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.764+0000 7f92039d8740 1 -- 172.21.15.53:0/2210774632 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91ec004310 con 0x5598a56ed2f0 2024-08-31T06:25:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.764+0000 7f91ddffb640 1 -- 172.21.15.53:0/2210774632 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f91e8004300 con 0x5598a56ed2f0 2024-08-31T06:25:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.764+0000 7f91ddffb640 1 -- 172.21.15.53:0/2210774632 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f91e80035f0 con 0x5598a56ed2f0 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.764+0000 7f92039d8740 10 client.30473 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.764+0000 7f92039d8740 1 -- 172.21.15.53:0/2210774632 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x5598a5adcb40 con 0x5598a56ed2f0 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.764+0000 7f91ddffb640 1 -- 172.21.15.53:0/2210774632 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91ec004310 con 0x5598a56ed2f0 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.765+0000 7f91ddffb640 1 -- 172.21.15.53:0/2210774632 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f91e803c580 con 0x5598a56ed2f0 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.765+0000 7f92039d8740 10 client.30473 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.765+0000 7f92039d8740 10 client.30473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.765+0000 7f92039d8740 20 client.30473 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.765+0000 7f92039d8740 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598a56d4d80 0x5598a5ae0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.765+0000 7f92039d8740 4 client.30473 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.765+0000 7f92039d8740 1 -- 172.21.15.53:0/2210774632 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598a5a30f50 con 0x5598a56d4d80 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.765+0000 7f91f5d9b640 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598a56d4d80 0x5598a5ae0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.765+0000 7f91ddffb640 10 client.30473 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.765+0000 7f91f5d9b640 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598a56d4d80 0x5598a5ae0120 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c7d6be24a772a62 server_cookie=56c05b1d023b8cf7 in_seq=0 out_seq=0 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f91ddffb640 1 -- 172.21.15.53:0/2210774632 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598a5a30f50 con 0x5598a56d4d80 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f91ddffb640 10 client.30473 handle_command_reply: tid=0 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f92039d8740 1 client.30473 shutdown 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f92039d8740 1 -- 172.21.15.53:0/2210774632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a56ed2f0 msgr2=0x5598a5ac56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f92039d8740 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a56ed2f0 0x5598a5ac56c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f91e8005940 tx=0x7f91e802a410 comp rx=0 tx=0).stop 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f92039d8740 1 -- 172.21.15.53:0/2210774632 shutdown_connections 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f92039d8740 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598a56d4d80 0x5598a5ae0120 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f92039d8740 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a57161b0 0x5598a5ad1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f91ddffb640 0 client.30473 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f92039d8740 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56f54d0 0x5598a5ac5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f92039d8740 1 --2- 172.21.15.53:0/2210774632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a56ed2f0 0x5598a5ac56c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.766+0000 7f92039d8740 1 -- 172.21.15.53:0/2210774632 >> 172.21.15.53:0/2210774632 conn(0x5598a570a300 msgr2=0x5598a5abaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:26.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.767+0000 7f92039d8740 1 -- 172.21.15.53:0/2210774632 shutdown_connections 2024-08-31T06:25:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.767+0000 7f92039d8740 1 -- 172.21.15.53:0/2210774632 wait complete. 2024-08-31T06:25:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.767+0000 7f92039d8740 20 client.30473 trim_cache size 0 max 16384 2024-08-31T06:25:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f92039d8740 1 Processor -- start 2024-08-31T06:25:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f92039d8740 1 -- start start 2024-08-31T06:25:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f92039d8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5abeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f92039d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a56f54d0 0x5598a5abf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f92039d8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a57161b0 0x5598a5ac2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f92039d8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f91f81ad220 con 0x5598a56ed2f0 2024-08-31T06:25:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f92039d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f91f81aef70 con 0x5598a56f54d0 2024-08-31T06:25:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f92039d8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91f81ad980 con 0x5598a57161b0 2024-08-31T06:25:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f91f659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5abeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f91f659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5abeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55912/0 (socket says 172.21.15.53:55912) 2024-08-31T06:25:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f91f659c640 1 -- 172.21.15.53:0/515474428 learned_addr learned my addr 172.21.15.53:0/515474428 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.794+0000 7f91f5d9b640 1 --2- 172.21.15.53:0/515474428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a56f54d0 0x5598a5abf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.795+0000 7f91f6d9d640 1 --2- 172.21.15.53:0/515474428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a57161b0 0x5598a5ac2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.795+0000 7f91f659c640 1 -- 172.21.15.53:0/515474428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a57161b0 msgr2=0x5598a5ac2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.795+0000 7f91f659c640 1 --2- 172.21.15.53:0/515474428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a57161b0 0x5598a5ac2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.795+0000 7f91f659c640 1 -- 172.21.15.53:0/515474428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a56f54d0 msgr2=0x5598a5abf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.795+0000 7f91f659c640 1 --2- 172.21.15.53:0/515474428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a56f54d0 0x5598a5abf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.795+0000 7f91f659c640 1 -- 172.21.15.53:0/515474428 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598a5abf600 con 0x5598a56ed2f0 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.795+0000 7f91f659c640 1 --2- 172.21.15.53:0/515474428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5abeb80 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009900 tx=0x7f91e8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc640b6a26dc2bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.795+0000 7f91dffff640 1 -- 172.21.15.53:0/515474428 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e8067070 con 0x5598a56ed2f0 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.795+0000 7f91dffff640 1 -- 172.21.15.53:0/515474428 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91e8004300 con 0x5598a56ed2f0 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.796+0000 7f91dffff640 1 -- 172.21.15.53:0/515474428 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e8035070 con 0x5598a56ed2f0 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.797+0000 7f92039d8740 1 -- 172.21.15.53:0/515474428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 msgr2=0x5598a5abeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.797+0000 7f92039d8740 1 --2- 172.21.15.53:0/515474428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5abeb80 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009900 tx=0x7f91e8005fd0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.797+0000 7f92039d8740 1 -- 172.21.15.53:0/515474428 shutdown_connections 2024-08-31T06:25:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.797+0000 7f92039d8740 1 --2- 172.21.15.53:0/515474428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a57161b0 0x5598a5ac2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.797+0000 7f92039d8740 1 --2- 172.21.15.53:0/515474428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a56f54d0 0x5598a5abf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.797+0000 7f92039d8740 1 --2- 172.21.15.53:0/515474428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56ed2f0 0x5598a5abeb80 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.797+0000 7f92039d8740 1 -- 172.21.15.53:0/515474428 >> 172.21.15.53:0/515474428 conn(0x5598a570a300 msgr2=0x5598a5ac3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.797+0000 7f92039d8740 1 -- 172.21.15.53:0/515474428 shutdown_connections 2024-08-31T06:25:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.797+0000 7f92039d8740 1 -- 172.21.15.53:0/515474428 wait complete. 2024-08-31T06:25:26.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.797+0000 7f92039d8740 1 -- start start 2024-08-31T06:25:26.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.797+0000 7f92039d8740 1 Processor -- start 2024-08-31T06:25:26.802 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f92039d8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56ed2f0 0x5598a5acb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f92039d8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56f54d0 0x5598a5acbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f92039d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 0x5598a5b49af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f92039d8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f91f81ae7e0 con 0x5598a56f54d0 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f92039d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f91f81ae050 con 0x5598a57161b0 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f92039d8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91f81ab220 con 0x5598a56ed2f0 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f92039d8740 10 client.0 _ll_register_callbacks cb 0x7f91e8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f91f5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56f54d0 0x5598a5acbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f91f6d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 0x5598a5b49af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f91f6d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 0x5598a5b49af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:58802/0 (socket says 172.21.15.53:58802) 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f91f5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56f54d0 0x5598a5acbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55920/0 (socket says 172.21.15.53:55920) 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f91f6d9d640 1 -- 172.21.15.53:0/922067785 learned_addr learned my addr 172.21.15.53:0/922067785 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f91f659c640 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56ed2f0 0x5598a5acb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f91f6d9d640 1 -- 172.21.15.53:0/922067785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56ed2f0 msgr2=0x5598a5acb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f91f6d9d640 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56ed2f0 0x5598a5acb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f91f6d9d640 1 -- 172.21.15.53:0/922067785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56f54d0 msgr2=0x5598a5acbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f91f6d9d640 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56f54d0 0x5598a5acbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.798+0000 7f91f6d9d640 1 -- 172.21.15.53:0/922067785 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598a5acc500 con 0x5598a57161b0 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.799+0000 7f91f6d9d640 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 0x5598a5b49af0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91f00ac130 tx=0x7f91f00ac7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9be01c26bd6dc08 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.799+0000 7f91ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.799+0000 7f91ddffb640 1 -- 172.21.15.53:0/922067785 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f00ac8a0 con 0x5598a57161b0 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.799+0000 7f91ddffb640 1 -- 172.21.15.53:0/922067785 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f91f00ab610 con 0x5598a57161b0 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.799+0000 7f92039d8740 1 -- 172.21.15.53:0/922067785 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91e8004300 con 0x5598a57161b0 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.799+0000 7f91ddffb640 1 -- 172.21.15.53:0/922067785 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f91f00ac1a0 con 0x5598a57161b0 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.799+0000 7f92039d8740 10 client.30479 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.799+0000 7f92039d8740 1 -- 172.21.15.53:0/922067785 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x5598a5b4b0b0 con 0x5598a57161b0 2024-08-31T06:25:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.800+0000 7f91ddffb640 1 -- 172.21.15.53:0/922067785 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91e8004300 con 0x5598a57161b0 2024-08-31T06:25:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.800+0000 7f91ddffb640 1 -- 172.21.15.53:0/922067785 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f91f00aae70 con 0x5598a57161b0 2024-08-31T06:25:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.800+0000 7f92039d8740 10 client.30479 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.800+0000 7f92039d8740 10 client.30479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.800+0000 7f92039d8740 20 client.30479 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.800+0000 7f92039d8740 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598a56aa1c0 0x5598a5b4d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.800+0000 7f92039d8740 4 client.30479 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:25:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.800+0000 7f92039d8740 1 -- 172.21.15.53:0/922067785 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5598a5a2c9f0 con 0x5598a56aa1c0 2024-08-31T06:25:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.800+0000 7f91f659c640 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598a56aa1c0 0x5598a5b4d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.801+0000 7f91ddffb640 10 client.30479 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.801+0000 7f91f659c640 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598a56aa1c0 0x5598a5b4d960 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b4e99ab5d5cf4cd server_cookie=cafbd1c009234233 in_seq=0 out_seq=0 2024-08-31T06:25:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.882+0000 7f91ddffb640 1 -- 172.21.15.53:0/922067785 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5598a5a2c9f0 con 0x5598a56aa1c0 2024-08-31T06:25:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.882+0000 7f91ddffb640 10 client.30479 handle_command_reply: tid=0 2024-08-31T06:25:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 1 client.30479 shutdown 2024-08-31T06:25:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 1 -- 172.21.15.53:0/922067785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 msgr2=0x5598a5b49af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 0x5598a5b49af0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91f00ac130 tx=0x7f91f00ac7c0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 1 -- 172.21.15.53:0/922067785 shutdown_connections 2024-08-31T06:25:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5598a56aa1c0 0x5598a5b4d960 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598a57161b0 0x5598a5b49af0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f91ddffb640 0 client.30479 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5598a56f54d0 0x5598a5acbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 1 --2- 172.21.15.53:0/922067785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5598a56ed2f0 0x5598a5acb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 1 -- 172.21.15.53:0/922067785 >> 172.21.15.53:0/922067785 conn(0x5598a570a300 msgr2=0x5598a5ac3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 1 -- 172.21.15.53:0/922067785 shutdown_connections 2024-08-31T06:25:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 1 -- 172.21.15.53:0/922067785 wait complete. 2024-08-31T06:25:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.883+0000 7f92039d8740 20 client.30479 trim_cache size 0 max 16384 2024-08-31T06:25:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:25:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:25:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:25:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:25:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.884+0000 7f91fca69640 1 -- 172.21.15.53:0/2153898065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91e00b4d20 msgr2=0x7f91e00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.884+0000 7f91fca69640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91e00b4d20 0x7f91e00b7230 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f91e80057c0 tx=0x7f91e80058d0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.884+0000 7f91fca69640 1 -- 172.21.15.53:0/2153898065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91f8108a30 msgr2=0x7f91f81a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.884+0000 7f91fca69640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91f8108a30 0x7f91f81a1bc0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f91f000eb10 tx=0x7f91f000c2d0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.885+0000 7f91fca69640 1 -- 172.21.15.53:0/2153898065 shutdown_connections 2024-08-31T06:25:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.885+0000 7f91fca69640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f91e00b4d20 0x7f91e00b7230 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.885+0000 7f91fca69640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91f8108a30 0x7f91f81a1bc0 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.885+0000 7f91fca69640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91f81080e0 0x7f91f819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.885+0000 7f91fca69640 1 --2- 172.21.15.53:0/2153898065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f81027b0 0x7f91f819c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.885+0000 7f91fca69640 1 -- 172.21.15.53:0/2153898065 >> 172.21.15.53:0/2153898065 conn(0x7f91f80fe1b0 msgr2=0x7f91f8107760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.885+0000 7f91fca69640 1 -- 172.21.15.53:0/2153898065 shutdown_connections 2024-08-31T06:25:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:26.885+0000 7f91fca69640 1 -- 172.21.15.53:0/2153898065 wait complete. 2024-08-31T06:25:27.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 46951 5.59 MB/sec execute 315 sec latency 84.338 ms 2024-08-31T06:25:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:27 smithi130 ceph-mon[22266]: pgmap v968: 97 pgs: 97 active+clean; 776 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 350 op/s 2024-08-31T06:25:28.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:27 smithi153 ceph-mon[22320]: pgmap v968: 97 pgs: 97 active+clean; 776 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 350 op/s 2024-08-31T06:25:28.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:27 smithi053 ceph-mon[18924]: pgmap v968: 97 pgs: 97 active+clean; 776 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 350 op/s 2024-08-31T06:25:28.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 47064 5.58 MB/sec execute 316 sec latency 221.748 ms 2024-08-31T06:25:29.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.453+0000 7f72cba44640 1 -- 172.21.15.53:0/565122245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c4108ac0 msgr2=0x7f72c410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:29.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.453+0000 7f72cba44640 1 --2- 172.21.15.53:0/565122245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c4108ac0 0x7f72c410f2f0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009ca0 tx=0x7f72bc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.453+0000 7f72cba44640 1 -- 172.21.15.53:0/565122245 shutdown_connections 2024-08-31T06:25:29.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.453+0000 7f72cba44640 1 --2- 172.21.15.53:0/565122245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c4108ac0 0x7f72c410f2f0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.453+0000 7f72cba44640 1 --2- 172.21.15.53:0/565122245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4108170 0x7f72c4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.453+0000 7f72cba44640 1 --2- 172.21.15.53:0/565122245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c4102880 0x7f72c4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.453+0000 7f72cba44640 1 -- 172.21.15.53:0/565122245 >> 172.21.15.53:0/565122245 conn(0x7f72c4079530 msgr2=0x7f72c4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:29.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.454+0000 7f72cba44640 1 -- 172.21.15.53:0/565122245 shutdown_connections 2024-08-31T06:25:29.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.454+0000 7f72cba44640 1 -- 172.21.15.53:0/565122245 wait complete. 2024-08-31T06:25:29.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.455+0000 7f72cba44640 1 Processor -- start 2024-08-31T06:25:29.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.455+0000 7f72cba44640 1 -- start start 2024-08-31T06:25:29.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.455+0000 7f72cba44640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4102880 0x7f72c419c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.455+0000 7f72cba44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c4108170 0x7f72c419c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.455+0000 7f72cba44640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c4108ac0 0x7f72c41a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.455+0000 7f72cba44640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f72c4115980 con 0x7f72c4108170 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.455+0000 7f72cba44640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72c4115800 con 0x7f72c4102880 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.455+0000 7f72cba44640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72c4115b00 con 0x7f72c4108ac0 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.455+0000 7f72c97e0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4102880 0x7f72c419c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.455+0000 7f72c97e0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4102880 0x7f72c419c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:58814/0 (socket says 172.21.15.53:58814) 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.455+0000 7f72c97e0640 1 -- 172.21.15.53:0/2603518146 learned_addr learned my addr 172.21.15.53:0/2603518146 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.456+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c4108170 0x7f72c419c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.456+0000 7f72c9fe1640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c4108ac0 0x7f72c41a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.456+0000 7f72c97e0640 1 -- 172.21.15.53:0/2603518146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c4108ac0 msgr2=0x7f72c41a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.456+0000 7f72c97e0640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c4108ac0 0x7f72c41a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.456+0000 7f72c97e0640 1 -- 172.21.15.53:0/2603518146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c4108170 msgr2=0x7f72c419c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.456+0000 7f72c97e0640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c4108170 0x7f72c419c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.456+0000 7f72c97e0640 1 -- 172.21.15.53:0/2603518146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c41a2260 con 0x7f72c4102880 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.456+0000 7f72c9fe1640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c4108ac0 0x7f72c41a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.456+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c4108170 0x7f72c419c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.456+0000 7f72c97e0640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4102880 0x7f72c419c2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f72c000e9f0 tx=0x7f72c000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.457+0000 7f72ba7fc640 1 -- 172.21.15.53:0/2603518146 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c000cd80 con 0x7f72c4102880 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.457+0000 7f72cba44640 1 -- 172.21.15.53:0/2603518146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c41a2550 con 0x7f72c4102880 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.457+0000 7f72cba44640 1 -- 172.21.15.53:0/2603518146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c41a8cb0 con 0x7f72c4102880 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.457+0000 7f72ba7fc640 1 -- 172.21.15.53:0/2603518146 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72c00108c0 con 0x7f72c4102880 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.457+0000 7f72ba7fc640 1 -- 172.21.15.53:0/2603518146 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c00187c0 con 0x7f72c4102880 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.460+0000 7f72d1fb9740 1 Processor -- start 2024-08-31T06:25:29.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.460+0000 7f72d1fb9740 1 -- start start 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.460+0000 7f72ba7fc640 1 -- 172.21.15.53:0/2603518146 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f72c0018a40 con 0x7f72c4102880 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.460+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 0x55869ff5e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.460+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fb901b0 0x55869ff5e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.460+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff5ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.460+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55869fed5630 con 0x55869fb98390 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.460+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55869fec4bc0 con 0x55869fb901b0 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.460+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55869fec8b70 con 0x55869fbb9070 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.461+0000 7f72c97e0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fb901b0 0x55869ff5e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.461+0000 7f72c8fdf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff5ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.461+0000 7f72c9fe1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 0x55869ff5e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.461+0000 7f72c8fdf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff5ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55956/0 (socket says 172.21.15.53:55956) 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.461+0000 7f72c8fdf640 1 -- 172.21.15.53:0/3970903662 learned_addr learned my addr 172.21.15.53:0/3970903662 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:29.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.461+0000 7f72c9fe1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 0x55869ff5e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:60512/0 (socket says 172.21.15.53:60512) 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.461+0000 7f72c8fdf640 1 -- 172.21.15.53:0/3970903662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 msgr2=0x55869ff5e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.461+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/3970903662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 0x55869ff5e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.461+0000 7f72c8fdf640 1 -- 172.21.15.53:0/3970903662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fb901b0 msgr2=0x55869ff5e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.461+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/3970903662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fb901b0 0x55869ff5e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.461+0000 7f72c8fdf640 1 -- 172.21.15.53:0/3970903662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55869fc24650 con 0x55869fb98390 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.462+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/3970903662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff5ed40 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f72b4011470 tx=0x7f72b4011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f67607cda49de1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.462+0000 7f72af7fe640 1 -- 172.21.15.53:0/3970903662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b401e070 con 0x55869fb98390 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.462+0000 7f72af7fe640 1 -- 172.21.15.53:0/3970903662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72b400fa90 con 0x55869fb98390 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.462+0000 7f72af7fe640 1 -- 172.21.15.53:0/3970903662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4019a20 con 0x55869fb98390 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.462+0000 7f72ba7fc640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72b00b4d20 0x7f72b00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.462+0000 7f72ba7fc640 1 -- 172.21.15.53:0/2603518146 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f72c00e5730 con 0x7f72c4102880 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.463+0000 7f72c9fe1640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72b00b4d20 0x7f72b00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.463+0000 7f72d1fb9740 1 -- 172.21.15.53:0/3970903662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 msgr2=0x55869ff5ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:29.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.463+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/3970903662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff5ed40 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f72b4011470 tx=0x7f72b4011930 comp rx=0 tx=0).stop 2024-08-31T06:25:29.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.463+0000 7f72c9fe1640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72b00b4d20 0x7f72b00b7230 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f72bc006010 tx=0x7f72bc0098e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:29.102 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:25:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:25:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:25:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:25:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:25:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:25:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:25:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:25:29.117 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:25:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.463+0000 7f72d1fb9740 1 -- 172.21.15.53:0/3970903662 shutdown_connections 2024-08-31T06:25:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.463+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/3970903662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff5ed40 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.463+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/3970903662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fb901b0 0x55869ff5e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.463+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/3970903662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 0x55869ff5e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.463+0000 7f72d1fb9740 1 -- 172.21.15.53:0/3970903662 >> 172.21.15.53:0/3970903662 conn(0x55869fbad460 msgr2=0x55869ff5c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.464+0000 7f72d1fb9740 1 -- 172.21.15.53:0/3970903662 shutdown_connections 2024-08-31T06:25:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.464+0000 7f72d1fb9740 1 -- 172.21.15.53:0/3970903662 wait complete. 2024-08-31T06:25:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.464+0000 7f72d1fb9740 1 -- start start 2024-08-31T06:25:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.464+0000 7f72d1fb9740 1 Processor -- start 2024-08-31T06:25:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 0x55869ff69a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff69f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fbb9070 0x55869ff75df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55869fd27700 con 0x55869fb98390 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55869fe4b700 con 0x55869fbb9070 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55869ff6caa0 con 0x55869fb901b0 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72d1fb9740 10 client.0 _ll_register_callbacks cb 0x55869fe7adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c8fdf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff69f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c97e0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 0x55869ff69a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c9fe1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fbb9070 0x55869ff75df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c8fdf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff69f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55962/0 (socket says 172.21.15.53:55962) 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c97e0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 0x55869ff69a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:60522/0 (socket says 172.21.15.53:60522) 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c8fdf640 1 -- 172.21.15.53:0/4085667554 learned_addr learned my addr 172.21.15.53:0/4085667554 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c8fdf640 1 -- 172.21.15.53:0/4085667554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 msgr2=0x55869ff69a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 0x55869ff69a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c8fdf640 1 -- 172.21.15.53:0/4085667554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fbb9070 msgr2=0x55869ff75df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fbb9070 0x55869ff75df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c8fdf640 1 -- 172.21.15.53:0/4085667554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55869fe848b0 con 0x55869fb98390 2024-08-31T06:25:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c9fe1640 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fbb9070 0x55869ff75df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.465+0000 7f72c97e0640 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 0x55869ff69a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.466+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff69f60 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f72b4011440 tx=0x7f72b4019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5a582b633e8c71 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.466+0000 7f72acff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.466+0000 7f72acff9640 1 -- 172.21.15.53:0/4085667554 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b401e040 con 0x55869fb98390 2024-08-31T06:25:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.466+0000 7f72acff9640 1 -- 172.21.15.53:0/4085667554 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f72b400f740 con 0x55869fb98390 2024-08-31T06:25:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.466+0000 7f72d1fb9740 1 -- 172.21.15.53:0/4085667554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72b400fa90 con 0x55869fb98390 2024-08-31T06:25:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.466+0000 7f72acff9640 1 -- 172.21.15.53:0/4085667554 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f72b4030050 con 0x55869fb98390 2024-08-31T06:25:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.466+0000 7f72d1fb9740 10 client.21720 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.466+0000 7f72d1fb9740 1 -- 172.21.15.53:0/4085667554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55869ff78890 con 0x55869fb98390 2024-08-31T06:25:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.467+0000 7f72acff9640 1 -- 172.21.15.53:0/4085667554 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72b400fa90 con 0x55869fb98390 2024-08-31T06:25:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.467+0000 7f72acff9640 1 -- 172.21.15.53:0/4085667554 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f72b4021070 con 0x55869fb98390 2024-08-31T06:25:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.467+0000 7f72d1fb9740 10 client.21720 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.467+0000 7f72d1fb9740 10 client.21720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.467+0000 7f72d1fb9740 20 client.21720 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.467+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55869fb779f0 0x55869ff7bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.467+0000 7f72d1fb9740 4 client.21720 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.467+0000 7f72d1fb9740 1 -- 172.21.15.53:0/4085667554 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55869fed7580 con 0x55869fb779f0 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.467+0000 7f72c97e0640 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55869fb779f0 0x55869ff7bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.467+0000 7f72acff9640 10 client.21720 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.468+0000 7f72c97e0640 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55869fb779f0 0x55869ff7bbf0 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1a3a02874447d25 server_cookie=ed984f6b1eae7bc7 in_seq=0 out_seq=0 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.468+0000 7f72acff9640 1 -- 172.21.15.53:0/4085667554 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55869fed7580 con 0x55869fb779f0 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.468+0000 7f72acff9640 10 client.21720 handle_command_reply: tid=0 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.468+0000 7f72d1fb9740 1 client.21720 shutdown 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72d1fb9740 1 -- 172.21.15.53:0/4085667554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 msgr2=0x55869ff69f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff69f60 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f72b4011440 tx=0x7f72b4019640 comp rx=0 tx=0).stop 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72d1fb9740 1 -- 172.21.15.53:0/4085667554 shutdown_connections 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55869fb779f0 0x55869ff7bbf0 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72acff9640 0 client.21720 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fbb9070 0x55869ff75df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb98390 0x55869ff69f60 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/4085667554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 0x55869ff69a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72d1fb9740 1 -- 172.21.15.53:0/4085667554 >> 172.21.15.53:0/4085667554 conn(0x55869fbad460 msgr2=0x55869ff61450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72d1fb9740 1 -- 172.21.15.53:0/4085667554 shutdown_connections 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72d1fb9740 1 -- 172.21.15.53:0/4085667554 wait complete. 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.469+0000 7f72d1fb9740 20 client.21720 trim_cache size 0 max 16384 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72d1fb9740 1 Processor -- start 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72d1fb9740 1 -- start start 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb901b0 0x55869ff61ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 0x55869ff69a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fb4cda0 0x55869ff66c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f72a800e8b0 con 0x55869fb901b0 2024-08-31T06:25:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72a8010600 con 0x55869fb4cda0 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72a800f010 con 0x55869fbb9070 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72c97e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb901b0 0x55869ff61ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72c97e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb901b0 0x55869ff61ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55966/0 (socket says 172.21.15.53:55966) 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72c97e0640 1 -- 172.21.15.53:0/3220241989 learned_addr learned my addr 172.21.15.53:0/3220241989 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72c9fe1640 1 --2- 172.21.15.53:0/3220241989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fb4cda0 0x55869ff66c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.487+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/3220241989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 0x55869ff69a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.488+0000 7f72c97e0640 1 -- 172.21.15.53:0/3220241989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 msgr2=0x55869ff69a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.488+0000 7f72c97e0640 1 --2- 172.21.15.53:0/3220241989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 0x55869ff69a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.488+0000 7f72c97e0640 1 -- 172.21.15.53:0/3220241989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fb4cda0 msgr2=0x55869ff66c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.488+0000 7f72c97e0640 1 --2- 172.21.15.53:0/3220241989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fb4cda0 0x55869ff66c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.488+0000 7f72c97e0640 1 -- 172.21.15.53:0/3220241989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55869ff68980 con 0x55869fb901b0 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.488+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/3220241989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 0x55869ff69a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:25:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.488+0000 7f72c97e0640 1 --2- 172.21.15.53:0/3220241989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb901b0 0x55869ff61ad0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f72c00a9070 tx=0x7f72c00e7c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4c2ec97ffaa7f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.488+0000 7f72aeffd640 1 -- 172.21.15.53:0/3220241989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c00ab910 con 0x55869fb901b0 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.488+0000 7f72aeffd640 1 -- 172.21.15.53:0/3220241989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72c00ac500 con 0x55869fb901b0 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.488+0000 7f72aeffd640 1 -- 172.21.15.53:0/3220241989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c00a8090 con 0x55869fb901b0 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.489+0000 7f72d1fb9740 1 -- 172.21.15.53:0/3220241989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb901b0 msgr2=0x55869ff61ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.489+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/3220241989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb901b0 0x55869ff61ad0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f72c00a9070 tx=0x7f72c00e7c40 comp rx=0 tx=0).stop 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.489+0000 7f72d1fb9740 1 -- 172.21.15.53:0/3220241989 shutdown_connections 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.489+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/3220241989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fb4cda0 0x55869ff66c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.489+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/3220241989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fbb9070 0x55869ff69a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.489+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/3220241989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb901b0 0x55869ff61ad0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.489+0000 7f72d1fb9740 1 -- 172.21.15.53:0/3220241989 >> 172.21.15.53:0/3220241989 conn(0x55869fbad460 msgr2=0x55869ff613c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.489+0000 7f72d1fb9740 1 -- 172.21.15.53:0/3220241989 shutdown_connections 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.489+0000 7f72d1fb9740 1 -- 172.21.15.53:0/3220241989 wait complete. 2024-08-31T06:25:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.489+0000 7f72d1fb9740 1 -- start start 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.489+0000 7f72d1fb9740 1 Processor -- start 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb4cda0 0x55869ff6e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 0x55869ff6e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72d1fb9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fbb9070 0x55869ffe5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f72a800fe70 con 0x55869fb4cda0 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72a800f6e0 con 0x55869fbb9070 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72d1fb9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72a800c8b0 con 0x55869fb901b0 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72d1fb9740 10 client.0 _ll_register_callbacks cb 0x7f72b401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72c97e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb4cda0 0x55869ff6e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72c97e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb4cda0 0x55869ff6e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55978/0 (socket says 172.21.15.53:55978) 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72c97e0640 1 -- 172.21.15.53:0/2910017279 learned_addr learned my addr 172.21.15.53:0/2910017279 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72c9fe1640 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fbb9070 0x55869ffe5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 0x55869ff6e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72c97e0640 1 -- 172.21.15.53:0/2910017279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 msgr2=0x55869ff6e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72c97e0640 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 0x55869ff6e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72c97e0640 1 -- 172.21.15.53:0/2910017279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fbb9070 msgr2=0x55869ffe5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72c97e0640 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fbb9070 0x55869ffe5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.490+0000 7f72c97e0640 1 -- 172.21.15.53:0/2910017279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55869ffe5aa0 con 0x55869fb4cda0 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72c97e0640 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb4cda0 0x55869ff6e120 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f72c00abd90 tx=0x7f72c00a82c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1c388b271ada02 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72acff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72acff9640 1 -- 172.21.15.53:0/2910017279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c00ab910 con 0x55869fb4cda0 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72acff9640 1 -- 172.21.15.53:0/2910017279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f72c00a83f0 con 0x55869fb4cda0 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72d1fb9740 1 -- 172.21.15.53:0/2910017279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72c00ac500 con 0x55869fb4cda0 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72acff9640 1 -- 172.21.15.53:0/2910017279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f72c00abe00 con 0x55869fb4cda0 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72d1fb9740 10 client.21726 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72d1fb9740 1 -- 172.21.15.53:0/2910017279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55869ffe6c00 con 0x55869fb4cda0 2024-08-31T06:25:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72acff9640 1 -- 172.21.15.53:0/2910017279 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72c00ac500 con 0x55869fb4cda0 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72acff9640 1 -- 172.21.15.53:0/2910017279 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f72c00b4c90 con 0x55869fb4cda0 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72d1fb9740 10 client.21726 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72d1fb9740 10 client.21726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72d1fb9740 20 client.21726 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55869ffe7400 0x55869ffe9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72d1fb9740 4 client.21726 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.491+0000 7f72d1fb9740 1 -- 172.21.15.53:0/2910017279 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55869fed3020 con 0x55869ffe7400 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.492+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55869ffe7400 0x55869ffe9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.492+0000 7f72acff9640 10 client.21726 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.492+0000 7f72c8fdf640 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55869ffe7400 0x55869ffe9820 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9d023d7b884b03a server_cookie=eff362b6e7e1f62a in_seq=0 out_seq=0 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72acff9640 1 -- 172.21.15.53:0/2910017279 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7190 (crc 0 0 0) 0x55869fed3020 con 0x55869ffe7400 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72acff9640 10 client.21726 handle_command_reply: tid=0 2024-08-31T06:25:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 1 client.21726 shutdown 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 1 -- 172.21.15.53:0/2910017279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb4cda0 msgr2=0x55869ff6e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb4cda0 0x55869ff6e120 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f72c00abd90 tx=0x7f72c00a82c0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 1 -- 172.21.15.53:0/2910017279 shutdown_connections 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55869ffe7400 0x55869ffe9820 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72acff9640 0 client.21726 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55869fbb9070 0x55869ffe5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55869fb901b0 0x55869ff6e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 1 --2- 172.21.15.53:0/2910017279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55869fb4cda0 0x55869ff6e120 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 1 -- 172.21.15.53:0/2910017279 >> 172.21.15.53:0/2910017279 conn(0x55869fbad460 msgr2=0x55869ff5f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 1 -- 172.21.15.53:0/2910017279 shutdown_connections 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 1 -- 172.21.15.53:0/2910017279 wait complete. 2024-08-31T06:25:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72d1fb9740 20 client.21726 trim_cache size 0 max 16384 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72cba44640 1 -- 172.21.15.53:0/2603518146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72b00b4d20 msgr2=0x7f72b00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.493+0000 7f72cba44640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72b00b4d20 0x7f72b00b7230 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f72bc006010 tx=0x7f72bc0098e0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.494+0000 7f72cba44640 1 -- 172.21.15.53:0/2603518146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4102880 msgr2=0x7f72c419c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.494+0000 7f72cba44640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4102880 0x7f72c419c2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f72c000e9f0 tx=0x7f72c000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.494+0000 7f72cba44640 1 -- 172.21.15.53:0/2603518146 shutdown_connections 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.494+0000 7f72cba44640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72b00b4d20 0x7f72b00b7230 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.494+0000 7f72cba44640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72c4108ac0 0x7f72c41a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.494+0000 7f72cba44640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c4108170 0x7f72c419c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.494+0000 7f72cba44640 1 --2- 172.21.15.53:0/2603518146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4102880 0x7f72c419c2f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.494+0000 7f72cba44640 1 -- 172.21.15.53:0/2603518146 >> 172.21.15.53:0/2603518146 conn(0x7f72c4079530 msgr2=0x7f72c41061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.494+0000 7f72cba44640 1 -- 172.21.15.53:0/2603518146 shutdown_connections 2024-08-31T06:25:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:28.494+0000 7f72cba44640 1 -- 172.21.15.53:0/2603518146 wait complete. 2024-08-31T06:25:29.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 47210 5.60 MB/sec execute 317 sec latency 117.424 ms 2024-08-31T06:25:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:29 smithi130 ceph-mon[22266]: pgmap v969: 97 pgs: 97 active+clean; 774 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 336 op/s 2024-08-31T06:25:30.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:29 smithi153 ceph-mon[22320]: pgmap v969: 97 pgs: 97 active+clean; 774 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 336 op/s 2024-08-31T06:25:30.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:29 smithi053 ceph-mon[18924]: pgmap v969: 97 pgs: 97 active+clean; 774 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 336 op/s 2024-08-31T06:25:30.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 47388 5.61 MB/sec execute 318 sec latency 72.819 ms 2024-08-31T06:25:31.385 INFO:tasks.workunit.client.0.smithi053.stdout: 10 47538 5.62 MB/sec execute 319 sec latency 171.952 ms 2024-08-31T06:25:32.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:31 smithi130 ceph-mon[22266]: pgmap v970: 97 pgs: 97 active+clean; 780 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 378 op/s 2024-08-31T06:25:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:31 smithi153 ceph-mon[22320]: pgmap v970: 97 pgs: 97 active+clean; 780 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 378 op/s 2024-08-31T06:25:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:31 smithi053 ceph-mon[18924]: pgmap v970: 97 pgs: 97 active+clean; 780 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 378 op/s 2024-08-31T06:25:32.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 47642 5.62 MB/sec execute 320 sec latency 168.832 ms 2024-08-31T06:25:33.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 47749 5.63 MB/sec execute 321 sec latency 169.083 ms 2024-08-31T06:25:34.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:33 smithi130 ceph-mon[22266]: pgmap v971: 97 pgs: 97 active+clean; 781 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 313 op/s 2024-08-31T06:25:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:33 smithi153 ceph-mon[22320]: pgmap v971: 97 pgs: 97 active+clean; 781 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 313 op/s 2024-08-31T06:25:34.209 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:33 smithi053 ceph-mon[18924]: pgmap v971: 97 pgs: 97 active+clean; 781 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 313 op/s 2024-08-31T06:25:34.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 47878 5.65 MB/sec execute 322 sec latency 132.406 ms 2024-08-31T06:25:34.463 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:25:34.464 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:25:35.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 48061 5.67 MB/sec execute 323 sec latency 137.486 ms 2024-08-31T06:25:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:35 smithi130 ceph-mon[22266]: pgmap v972: 97 pgs: 97 active+clean; 790 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 325 op/s 2024-08-31T06:25:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:35 smithi153 ceph-mon[22320]: pgmap v972: 97 pgs: 97 active+clean; 790 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 325 op/s 2024-08-31T06:25:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:36.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:35 smithi053 ceph-mon[18924]: pgmap v972: 97 pgs: 97 active+clean; 790 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 325 op/s 2024-08-31T06:25:36.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 48206 5.67 MB/sec execute 324 sec latency 159.853 ms 2024-08-31T06:25:37.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 48338 5.67 MB/sec execute 325 sec latency 159.251 ms 2024-08-31T06:25:37.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.313+0000 7f6c488b4640 1 -- 172.21.15.53:0/2103844440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44101f90 msgr2=0x7f6c441023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:37.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.313+0000 7f6c488b4640 1 --2- 172.21.15.53:0/2103844440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44101f90 0x7f6c441023a0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400aa10 tx=0x7f6c3402b720 comp rx=0 tx=0).stop 2024-08-31T06:25:37.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.314+0000 7f6c488b4640 1 -- 172.21.15.53:0/2103844440 shutdown_connections 2024-08-31T06:25:37.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.314+0000 7f6c488b4640 1 --2- 172.21.15.53:0/2103844440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c44108220 0x7f6c4410ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:37.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.314+0000 7f6c488b4640 1 --2- 172.21.15.53:0/2103844440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c441078d0 0x7f6c44107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:37.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.314+0000 7f6c488b4640 1 --2- 172.21.15.53:0/2103844440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44101f90 0x7f6c441023a0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.314+0000 7f6c488b4640 1 -- 172.21.15.53:0/2103844440 >> 172.21.15.53:0/2103844440 conn(0x7f6c44077a00 msgr2=0x7f6c44077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.314+0000 7f6c488b4640 1 -- 172.21.15.53:0/2103844440 shutdown_connections 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.314+0000 7f6c488b4640 1 -- 172.21.15.53:0/2103844440 wait complete. 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.315+0000 7f6c488b4640 1 Processor -- start 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.315+0000 7f6c488b4640 1 -- start start 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.316+0000 7f6c488b4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c44101f90 0x7f6c4419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.316+0000 7f6c488b4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c441078d0 0x7f6c4419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.316+0000 7f6c488b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44108220 0x7f6c4419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.316+0000 7f6c488b4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6c44113770 con 0x7f6c44108220 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.316+0000 7f6c488b4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441135f0 con 0x7f6c441078d0 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.316+0000 7f6c488b4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441138f0 con 0x7f6c44101f90 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.316+0000 7f6c4259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c44101f90 0x7f6c4419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.316+0000 7f6c4259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c44101f90 0x7f6c4419a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:43842/0 (socket says 172.21.15.53:43842) 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.316+0000 7f6c4259c640 1 -- 172.21.15.53:0/3484873567 learned_addr learned my addr 172.21.15.53:0/3484873567 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.316+0000 7f6c42d9d640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44108220 0x7f6c4419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.316+0000 7f6c41d9b640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c441078d0 0x7f6c4419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.317+0000 7f6c4259c640 1 -- 172.21.15.53:0/3484873567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c441078d0 msgr2=0x7f6c4419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.317+0000 7f6c4259c640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c441078d0 0x7f6c4419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.317+0000 7f6c4259c640 1 -- 172.21.15.53:0/3484873567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44108220 msgr2=0x7f6c4419f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.317+0000 7f6c4259c640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44108220 0x7f6c4419f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.317+0000 7f6c4259c640 1 -- 172.21.15.53:0/3484873567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c441a0110 con 0x7f6c44101f90 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.317+0000 7f6c4259c640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c44101f90 0x7f6c4419a1a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6c3402bc40 tx=0x7f6c34003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.317+0000 7f6c337fe640 1 -- 172.21.15.53:0/3484873567 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3403f070 con 0x7f6c44101f90 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.317+0000 7f6c488b4640 1 -- 172.21.15.53:0/3484873567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c441a03a0 con 0x7f6c44101f90 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.318+0000 7f6c488b4640 1 -- 172.21.15.53:0/3484873567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4410ff00 con 0x7f6c44101f90 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.318+0000 7f6c337fe640 1 -- 172.21.15.53:0/3484873567 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c34030ba0 con 0x7f6c44101f90 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.318+0000 7f6c337fe640 1 -- 172.21.15.53:0/3484873567 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34036040 con 0x7f6c44101f90 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.319+0000 7f6c488b4640 1 -- 172.21.15.53:0/3484873567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c44103210 con 0x7f6c44101f90 2024-08-31T06:25:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.321+0000 7f6c337fe640 1 -- 172.21.15.53:0/3484873567 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6c34042070 con 0x7f6c44101f90 2024-08-31T06:25:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.322+0000 7f6c337fe640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c2c0b4d20 0x7f6c2c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.322+0000 7f6c337fe640 1 -- 172.21.15.53:0/3484873567 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f6c34105a20 con 0x7f6c44101f90 2024-08-31T06:25:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.322+0000 7f6c41d9b640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c2c0b4d20 0x7f6c2c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.323+0000 7f6c41d9b640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c2c0b4d20 0x7f6c2c0b7230 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6c44104960 tx=0x7f6c38005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.328+0000 7f6c337fe640 1 -- 172.21.15.53:0/3484873567 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6c340cc140 con 0x7f6c44101f90 2024-08-31T06:25:37.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.722+0000 7f6c488b4640 1 -- 172.21.15.53:0/3484873567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c44109ff0 con 0x7f6c44101f90 2024-08-31T06:25:37.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.723+0000 7f6c337fe640 1 -- 172.21.15.53:0/3484873567 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+12004 (secure 0 0 0) 0x7f6c340d0900 con 0x7f6c44101f90 2024-08-31T06:25:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:25:37.726 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":75,"btime":"2024-08-31T06:25:18:805159+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":75,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:25:18.762328+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:25:37.726 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 75 2024-08-31T06:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 -- 172.21.15.53:0/3484873567 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c2c0b4d20 msgr2=0x7f6c2c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c2c0b4d20 0x7f6c2c0b7230 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6c44104960 tx=0x7f6c38005f90 comp rx=0 tx=0).stop 2024-08-31T06:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 -- 172.21.15.53:0/3484873567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c44101f90 msgr2=0x7f6c4419a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c44101f90 0x7f6c4419a1a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6c3402bc40 tx=0x7f6c34003b90 comp rx=0 tx=0).stop 2024-08-31T06:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 -- 172.21.15.53:0/3484873567 shutdown_connections 2024-08-31T06:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c2c0b4d20 0x7f6c2c0b7230 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44108220 0x7f6c4419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c441078d0 0x7f6c4419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 --2- 172.21.15.53:0/3484873567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c44101f90 0x7f6c4419a1a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 -- 172.21.15.53:0/3484873567 >> 172.21.15.53:0/3484873567 conn(0x7f6c44077a00 msgr2=0x7f6c441059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 -- 172.21.15.53:0/3484873567 shutdown_connections 2024-08-31T06:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:37.726+0000 7f6c488b4640 1 -- 172.21.15.53:0/3484873567 wait complete. 2024-08-31T06:25:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:37 smithi130 ceph-mon[22266]: pgmap v973: 97 pgs: 97 active+clean; 798 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 338 op/s 2024-08-31T06:25:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:37 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3484873567' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:25:38.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:37 smithi153 ceph-mon[22320]: pgmap v973: 97 pgs: 97 active+clean; 798 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 338 op/s 2024-08-31T06:25:38.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:37 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3484873567' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:25:38.228 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:37 smithi053 ceph-mon[18924]: pgmap v973: 97 pgs: 97 active+clean; 798 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.3 MiB/s wr, 338 op/s 2024-08-31T06:25:38.228 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:37 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3484873567' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:25:38.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 48480 5.68 MB/sec execute 326 sec latency 109.879 ms 2024-08-31T06:25:38.937 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:25:39.325 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:39.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 48602 5.68 MB/sec execute 327 sec latency 120.146 ms 2024-08-31T06:25:40.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:39 smithi130 ceph-mon[22266]: pgmap v974: 97 pgs: 97 active+clean; 803 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 305 op/s 2024-08-31T06:25:40.164 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:39 smithi053 ceph-mon[18924]: pgmap v974: 97 pgs: 97 active+clean; 803 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 305 op/s 2024-08-31T06:25:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:39 smithi153 ceph-mon[22320]: pgmap v974: 97 pgs: 97 active+clean; 803 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 305 op/s 2024-08-31T06:25:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.328+0000 7f99d54d3640 1 -- 172.21.15.53:0/2430019403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d0104590 msgr2=0x7f99d01049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.328+0000 7f99d54d3640 1 --2- 172.21.15.53:0/2430019403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d0104590 0x7f99d01049a0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009900 tx=0x7f99c002a410 comp rx=0 tx=0).stop 2024-08-31T06:25:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.329+0000 7f99d54d3640 1 -- 172.21.15.53:0/2430019403 shutdown_connections 2024-08-31T06:25:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.329+0000 7f99d54d3640 1 --2- 172.21.15.53:0/2430019403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d010db40 0x7f99d0110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.329+0000 7f99d54d3640 1 --2- 172.21.15.53:0/2430019403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d0104fc0 0x7f99d010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.329+0000 7f99d54d3640 1 --2- 172.21.15.53:0/2430019403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d0104590 0x7f99d01049a0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.329+0000 7f99d54d3640 1 -- 172.21.15.53:0/2430019403 >> 172.21.15.53:0/2430019403 conn(0x7f99d00fe160 msgr2=0x7f99d01005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.329+0000 7f99d54d3640 1 -- 172.21.15.53:0/2430019403 shutdown_connections 2024-08-31T06:25:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.329+0000 7f99d54d3640 1 -- 172.21.15.53:0/2430019403 wait complete. 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99d54d3640 1 Processor -- start 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99d54d3640 1 -- start start 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99d54d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d0104590 0x7f99d01024a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99d54d3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0104fc0 0x7f99d01029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99d54d3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d010db40 0x7f99d0102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99d54d3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99d0113660 con 0x7f99d0104590 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99d54d3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99d01134e0 con 0x7f99d0104fc0 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99d54d3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99d01137e0 con 0x7f99d010db40 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99ceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d0104590 0x7f99d01024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99c67fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0104fc0 0x7f99d01029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99ceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d0104590 0x7f99d01024a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51124/0 (socket says 172.21.15.53:51124) 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99ceffd640 1 -- 172.21.15.53:0/2423959810 learned_addr learned my addr 172.21.15.53:0/2423959810 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.330+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d010db40 0x7f99d0102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.331+0000 7f99c67fc640 1 -- 172.21.15.53:0/2423959810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d010db40 msgr2=0x7f99d0102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.331+0000 7f99c67fc640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d010db40 0x7f99d0102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.331+0000 7f99c67fc640 1 -- 172.21.15.53:0/2423959810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d0104590 msgr2=0x7f99d01024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.331+0000 7f99c67fc640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d0104590 0x7f99d01024a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.331+0000 7f99c67fc640 1 -- 172.21.15.53:0/2423959810 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d01a8390 con 0x7f99d0104fc0 2024-08-31T06:25:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.331+0000 7f99c67fc640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0104fc0 0x7f99d01029e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f99d006b0b0 tx=0x7f99b800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.331+0000 7f99ccff9640 1 -- 172.21.15.53:0/2423959810 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b800cc40 con 0x7f99d0104fc0 2024-08-31T06:25:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.331+0000 7f99d54d3640 1 -- 172.21.15.53:0/2423959810 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d01a8680 con 0x7f99d0104fc0 2024-08-31T06:25:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.331+0000 7f99d54d3640 1 -- 172.21.15.53:0/2423959810 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d01a8bd0 con 0x7f99d0104fc0 2024-08-31T06:25:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.331+0000 7f99ccff9640 1 -- 172.21.15.53:0/2423959810 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99b800cde0 con 0x7f99d0104fc0 2024-08-31T06:25:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.331+0000 7f99ccff9640 1 -- 172.21.15.53:0/2423959810 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8010430 con 0x7f99d0104fc0 2024-08-31T06:25:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.335+0000 7f99ccff9640 1 -- 172.21.15.53:0/2423959810 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f99b80105d0 con 0x7f99d0104fc0 2024-08-31T06:25:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.335+0000 7f99dc447740 1 Processor -- start 2024-08-31T06:25:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.335+0000 7f99dc447740 1 -- start start 2024-08-31T06:25:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.336+0000 7f99dc447740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.336+0000 7f99dc447740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d052f0 0x55ade80d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.336+0000 7f99dc447740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d0d4d0 0x55ade80d2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.336+0000 7f99dc447740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ade8047000 con 0x55ade7d2e1b0 2024-08-31T06:25:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.336+0000 7f99dc447740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ade8036590 con 0x55ade7d0d4d0 2024-08-31T06:25:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.336+0000 7f99dc447740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ade803a540 con 0x55ade7d052f0 2024-08-31T06:25:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.336+0000 7f99ceffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d052f0 0x55ade80d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.336+0000 7f99ceffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d052f0 0x55ade80d2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:43918/0 (socket says 172.21.15.53:43918) 2024-08-31T06:25:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.336+0000 7f99ceffd640 1 -- 172.21.15.53:0/1926395950 learned_addr learned my addr 172.21.15.53:0/1926395950 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.336+0000 7f99c67fc640 1 --2- 172.21.15.53:0/1926395950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d0d4d0 0x55ade80d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.336+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/1926395950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99ccff9640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d50 0x7f99bc0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99cf7fe640 1 -- 172.21.15.53:0/1926395950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d052f0 msgr2=0x55ade80d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/1926395950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d052f0 0x55ade80d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99cf7fe640 1 -- 172.21.15.53:0/1926395950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d0d4d0 msgr2=0x55ade80d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/1926395950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d0d4d0 0x55ade80d2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99cf7fe640 1 -- 172.21.15.53:0/1926395950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ade7d99790 con 0x55ade7d2e1b0 2024-08-31T06:25:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99c67fc640 1 --2- 172.21.15.53:0/1926395950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d0d4d0 0x55ade80d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:25:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/1926395950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80d1ac0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009f00 tx=0x7f99c8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793715cbba15758d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99ccff9640 1 -- 172.21.15.53:0/2423959810 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f99b80e56d0 con 0x7f99d0104fc0 2024-08-31T06:25:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d50 0x7f99bc0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99c57fa640 1 -- 172.21.15.53:0/1926395950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8003a90 con 0x55ade7d2e1b0 2024-08-31T06:25:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.337+0000 7f99c57fa640 1 -- 172.21.15.53:0/1926395950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c80044c0 con 0x55ade7d2e1b0 2024-08-31T06:25:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.338+0000 7f99c57fa640 1 -- 172.21.15.53:0/1926395950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c800fd00 con 0x55ade7d2e1b0 2024-08-31T06:25:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99dc447740 1 -- 172.21.15.53:0/1926395950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 msgr2=0x55ade80d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99dc447740 1 --2- 172.21.15.53:0/1926395950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80d1ac0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009f00 tx=0x7f99c8011810 comp rx=0 tx=0).stop 2024-08-31T06:25:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d50 0x7f99bc0b7260 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f99c801b000 tx=0x7f99c801a4b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99dc447740 1 -- 172.21.15.53:0/1926395950 shutdown_connections 2024-08-31T06:25:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99dc447740 1 --2- 172.21.15.53:0/1926395950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d0d4d0 0x55ade80d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99dc447740 1 --2- 172.21.15.53:0/1926395950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d052f0 0x55ade80d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99dc447740 1 --2- 172.21.15.53:0/1926395950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80d1ac0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99dc447740 1 -- 172.21.15.53:0/1926395950 >> 172.21.15.53:0/1926395950 conn(0x55ade7d22300 msgr2=0x55ade80cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99dc447740 1 -- 172.21.15.53:0/1926395950 shutdown_connections 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99dc447740 1 -- 172.21.15.53:0/1926395950 wait complete. 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99dc447740 1 -- start start 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.339+0000 7f99dc447740 1 Processor -- start 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99dc447740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 0x55ade80dd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99dc447740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80ddb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99dc447740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80e95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99dc447740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ade7f6fab0 con 0x55ade7d2e1b0 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99dc447740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ade7fbd680 con 0x55ade7d052f0 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99dc447740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ade80e0240 con 0x55ade7d0d4d0 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99dc447740 10 client.0 _ll_register_callbacks cb 0x55ade7d45a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99cf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80e95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99cf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80e95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51148/0 (socket says 172.21.15.53:51148) 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99c67fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80ddb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99cf7fe640 1 -- 172.21.15.53:0/4217113456 learned_addr learned my addr 172.21.15.53:0/4217113456 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.340+0000 7f99ceffd640 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 0x55ade80dd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99cf7fe640 1 -- 172.21.15.53:0/4217113456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 msgr2=0x55ade80ddb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80ddb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99cf7fe640 1 -- 172.21.15.53:0/4217113456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 msgr2=0x55ade80dd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 0x55ade80dd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99cf7fe640 1 -- 172.21.15.53:0/4217113456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ade7e12620 con 0x55ade7d2e1b0 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99c67fc640 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80ddb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80e95c0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f99c800f680 tx=0x7f99c8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76e4e08d7d3a0e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99b67fc640 1 -- 172.21.15.53:0/4217113456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8035020 con 0x55ade7d2e1b0 2024-08-31T06:25:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99dc447740 1 -- 172.21.15.53:0/4217113456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c80044c0 con 0x55ade7d2e1b0 2024-08-31T06:25:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99b67fc640 1 -- 172.21.15.53:0/4217113456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f99c8020040 con 0x55ade7d2e1b0 2024-08-31T06:25:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.341+0000 7f99b67fc640 1 -- 172.21.15.53:0/4217113456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f99c8040050 con 0x55ade7d2e1b0 2024-08-31T06:25:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.342+0000 7f99dc447740 10 client.21762 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.342+0000 7f99dc447740 1 -- 172.21.15.53:0/4217113456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55ade80ec290 con 0x55ade7d2e1b0 2024-08-31T06:25:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.342+0000 7f99b67fc640 1 -- 172.21.15.53:0/4217113456 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c80044c0 con 0x55ade7d2e1b0 2024-08-31T06:25:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.342+0000 7f99b67fc640 1 -- 172.21.15.53:0/4217113456 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f99c8030030 con 0x55ade7d2e1b0 2024-08-31T06:25:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.342+0000 7f99dc447740 10 client.21762 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.342+0000 7f99dc447740 10 client.21762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.342+0000 7f99dc447740 20 client.21762 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.342+0000 7f99dc447740 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ade7cecd80 0x55ade80ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.342+0000 7f99dc447740 4 client.21762 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.342+0000 7f99dc447740 1 -- 172.21.15.53:0/4217113456 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ade8048f50 con 0x55ade7cecd80 2024-08-31T06:25:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.342+0000 7f99ceffd640 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ade7cecd80 0x55ade80ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.343+0000 7f99b67fc640 10 client.21762 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.343+0000 7f99ceffd640 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ade7cecd80 0x55ade80ef7a0 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5d927ed9036ca76 server_cookie=9a1831f0ec8f2c45 in_seq=0 out_seq=0 2024-08-31T06:25:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.345+0000 7f99b67fc640 1 -- 172.21.15.53:0/4217113456 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ade8048f50 con 0x55ade7cecd80 2024-08-31T06:25:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.345+0000 7f99b67fc640 10 client.21762 handle_command_reply: tid=0 2024-08-31T06:25:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.345+0000 7f99dc447740 1 client.21762 shutdown 2024-08-31T06:25:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99dc447740 1 -- 172.21.15.53:0/4217113456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 msgr2=0x55ade80e95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99dc447740 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80e95c0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f99c800f680 tx=0x7f99c8018000 comp rx=0 tx=0).stop 2024-08-31T06:25:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99dc447740 1 -- 172.21.15.53:0/4217113456 shutdown_connections 2024-08-31T06:25:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99dc447740 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ade7cecd80 0x55ade80ef7a0 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99dc447740 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80e95c0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99dc447740 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80ddb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99dc447740 1 --2- 172.21.15.53:0/4217113456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 0x55ade80dd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99dc447740 1 -- 172.21.15.53:0/4217113456 >> 172.21.15.53:0/4217113456 conn(0x55ade7d22300 msgr2=0x55ade80d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99b67fc640 0 client.21762 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99dc447740 1 -- 172.21.15.53:0/4217113456 shutdown_connections 2024-08-31T06:25:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99dc447740 1 -- 172.21.15.53:0/4217113456 wait complete. 2024-08-31T06:25:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.346+0000 7f99dc447740 20 client.21762 trim_cache size 0 max 16384 2024-08-31T06:25:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.373+0000 7f99dc447740 1 Processor -- start 2024-08-31T06:25:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.373+0000 7f99dc447740 1 -- start start 2024-08-31T06:25:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99dc447740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 0x55ade80d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99dc447740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80d70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99dc447740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80dc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99dc447740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99b000e8c0 con 0x55ade7d2e1b0 2024-08-31T06:25:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99ceffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 0x55ade80d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99dc447740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99b0010610 con 0x55ade7d052f0 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99dc447740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99b000f020 con 0x55ade7d0d4d0 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99ceffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 0x55ade80d6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46722/0 (socket says 172.21.15.53:46722) 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99ceffd640 1 -- 172.21.15.53:0/3898320366 learned_addr learned my addr 172.21.15.53:0/3898320366 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/3898320366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80dc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99c67fc640 1 --2- 172.21.15.53:0/3898320366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80d70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99ceffd640 1 -- 172.21.15.53:0/3898320366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 msgr2=0x55ade80d70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99ceffd640 1 --2- 172.21.15.53:0/3898320366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80d70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99ceffd640 1 -- 172.21.15.53:0/3898320366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 msgr2=0x55ade80dc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99ceffd640 1 --2- 172.21.15.53:0/3898320366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80dc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.374+0000 7f99ceffd640 1 -- 172.21.15.53:0/3898320366 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ade80dfb50 con 0x55ade7d052f0 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.375+0000 7f99ceffd640 1 --2- 172.21.15.53:0/3898320366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 0x55ade80d6b80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f99c00057c0 tx=0x7f99c0005d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ba43e0c493c1c2f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.375+0000 7f99c4ff9640 1 -- 172.21.15.53:0/3898320366 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0049020 con 0x55ade7d052f0 2024-08-31T06:25:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.375+0000 7f99c4ff9640 1 -- 172.21.15.53:0/3898320366 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c0031890 con 0x55ade7d052f0 2024-08-31T06:25:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.375+0000 7f99c4ff9640 1 -- 172.21.15.53:0/3898320366 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0035040 con 0x55ade7d052f0 2024-08-31T06:25:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.376+0000 7f99dc447740 1 -- 172.21.15.53:0/3898320366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 msgr2=0x55ade80d6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.376+0000 7f99dc447740 1 --2- 172.21.15.53:0/3898320366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 0x55ade80d6b80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f99c00057c0 tx=0x7f99c0005d70 comp rx=0 tx=0).stop 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.376+0000 7f99dc447740 1 -- 172.21.15.53:0/3898320366 shutdown_connections 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.376+0000 7f99dc447740 1 --2- 172.21.15.53:0/3898320366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d2e1b0 0x55ade80dc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.376+0000 7f99dc447740 1 --2- 172.21.15.53:0/3898320366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80d70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.376+0000 7f99dc447740 1 --2- 172.21.15.53:0/3898320366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d052f0 0x55ade80d6b80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.376+0000 7f99dc447740 1 -- 172.21.15.53:0/3898320366 >> 172.21.15.53:0/3898320366 conn(0x55ade7d22300 msgr2=0x55ade80dbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.376+0000 7f99dc447740 1 -- 172.21.15.53:0/3898320366 shutdown_connections 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.376+0000 7f99dc447740 1 -- 172.21.15.53:0/3898320366 wait complete. 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.377+0000 7f99dc447740 1 -- start start 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.377+0000 7f99dc447740 1 Processor -- start 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.377+0000 7f99dc447740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d052f0 0x55ade80e1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.377+0000 7f99dc447740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80e1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.377+0000 7f99dc447740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d2e1b0 0x55ade80e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.377+0000 7f99dc447740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f99b000fe80 con 0x55ade7d052f0 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99dc447740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99b000f6f0 con 0x55ade7d2e1b0 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99dc447740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f99b000c8c0 con 0x55ade7d0d4d0 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99ceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d052f0 0x55ade80e1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99ceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d052f0 0x55ade80e1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51164/0 (socket says 172.21.15.53:51164) 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99ceffd640 1 -- 172.21.15.53:0/2177575646 learned_addr learned my addr 172.21.15.53:0/2177575646 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99c67fc640 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80e1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d2e1b0 0x55ade80e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99dc447740 10 client.0 _ll_register_callbacks cb 0x7f99b8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99ceffd640 1 -- 172.21.15.53:0/2177575646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 msgr2=0x55ade80e1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99ceffd640 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80e1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99ceffd640 1 -- 172.21.15.53:0/2177575646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d2e1b0 msgr2=0x55ade80e1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99ceffd640 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d2e1b0 0x55ade80e1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99ceffd640 1 -- 172.21.15.53:0/2177575646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ade8161970 con 0x55ade7d052f0 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99c67fc640 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80e1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99ceffd640 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d052f0 0x55ade80e1410 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f99c0004360 tx=0x7f99c0004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8c06cb65f4cd65 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.378+0000 7f99b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99b67fc640 1 -- 172.21.15.53:0/2177575646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0049030 con 0x55ade7d052f0 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99b67fc640 1 -- 172.21.15.53:0/2177575646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f99c0031600 con 0x55ade7d052f0 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99dc447740 1 -- 172.21.15.53:0/2177575646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c0031890 con 0x55ade7d052f0 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99b67fc640 1 -- 172.21.15.53:0/2177575646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f99c0035040 con 0x55ade7d052f0 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99dc447740 10 client.21768 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99dc447740 1 -- 172.21.15.53:0/2177575646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55ade8162b00 con 0x55ade7d052f0 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99b67fc640 1 -- 172.21.15.53:0/2177575646 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c0003a80 con 0x55ade7d052f0 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99b67fc640 1 -- 172.21.15.53:0/2177575646 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f99c003c700 con 0x55ade7d052f0 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99dc447740 10 client.21768 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99dc447740 10 client.21768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99dc447740 20 client.21768 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99dc447740 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ade7cc21c0 0x55ade8165330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.379+0000 7f99dc447740 4 client.21768 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:25:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.380+0000 7f99dc447740 1 -- 172.21.15.53:0/2177575646 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f99c0031890 con 0x55ade7cc21c0 2024-08-31T06:25:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.380+0000 7f99c67fc640 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ade7cc21c0 0x55ade8165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.380+0000 7f99c67fc640 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ade7cc21c0 0x55ade8165330 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b27051868e32289a server_cookie=fa49625e66909daf in_seq=0 out_seq=0 2024-08-31T06:25:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.380+0000 7f99b67fc640 10 client.21768 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:40.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 48735 5.69 MB/sec execute 328 sec latency 141.013 ms 2024-08-31T06:25:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.920+0000 7f9c6f574640 1 -- 172.21.15.53:0/3644215094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c681141d0 msgr2=0x7f9c681166c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.920+0000 7f9c6f574640 1 --2- 172.21.15.53:0/3644215094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c681141d0 0x7f9c681166c0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009ca0 tx=0x7f9c6002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.921+0000 7f9c6f574640 1 -- 172.21.15.53:0/3644215094 shutdown_connections 2024-08-31T06:25:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.921+0000 7f9c6f574640 1 --2- 172.21.15.53:0/3644215094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c681141d0 0x7f9c681166c0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.921+0000 7f9c6f574640 1 --2- 172.21.15.53:0/3644215094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c68075a90 0x7f9c68075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.921+0000 7f9c6f574640 1 --2- 172.21.15.53:0/3644215094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c680770d0 0x7f9c68075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.921+0000 7f9c6f574640 1 -- 172.21.15.53:0/3644215094 >> 172.21.15.53:0/3644215094 conn(0x7f9c6807b6b0 msgr2=0x7f9c6807bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.921+0000 7f9c6f574640 1 -- 172.21.15.53:0/3644215094 shutdown_connections 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.921+0000 7f9c6f574640 1 -- 172.21.15.53:0/3644215094 wait complete. 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.922+0000 7f9c6f574640 1 Processor -- start 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.922+0000 7f9c6f574640 1 -- start start 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.922+0000 7f9c6f574640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c68075a90 0x7f9c681a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.922+0000 7f9c6f574640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c680770d0 0x7f9c681a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6f574640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c681141d0 0x7f9c681a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6f574640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9c68119d30 con 0x7f9c68075a90 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6f574640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c68119bb0 con 0x7f9c681141d0 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6f574640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c68119eb0 con 0x7f9c680770d0 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6d310640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c68075a90 0x7f9c681a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6cb0f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c680770d0 0x7f9c681a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6d310640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c68075a90 0x7f9c681a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51068/0 (socket says 172.21.15.53:51068) 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6d310640 1 -- 172.21.15.53:0/4114135146 learned_addr learned my addr 172.21.15.53:0/4114135146 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6db11640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c681141d0 0x7f9c681a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6cb0f640 1 -- 172.21.15.53:0/4114135146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c681141d0 msgr2=0x7f9c681a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6cb0f640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c681141d0 0x7f9c681a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6cb0f640 1 -- 172.21.15.53:0/4114135146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c68075a90 msgr2=0x7f9c681a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6cb0f640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c68075a90 0x7f9c681a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6cb0f640 1 -- 172.21.15.53:0/4114135146 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c681a6630 con 0x7f9c680770d0 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.923+0000 7f9c6cb0f640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c680770d0 0x7f9c681a0c60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9c681076d0 tx=0x7f9c5800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.924+0000 7f9c5e7fc640 1 -- 172.21.15.53:0/4114135146 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5800cc10 con 0x7f9c680770d0 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.924+0000 7f9c5e7fc640 1 -- 172.21.15.53:0/4114135146 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c5800cdb0 con 0x7f9c680770d0 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.924+0000 7f9c5e7fc640 1 -- 172.21.15.53:0/4114135146 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58003de0 con 0x7f9c680770d0 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.924+0000 7f9c6f574640 1 -- 172.21.15.53:0/4114135146 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c681a6920 con 0x7f9c680770d0 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.924+0000 7f9c6f574640 1 -- 172.21.15.53:0/4114135146 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c681ad080 con 0x7f9c680770d0 2024-08-31T06:25:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.929+0000 7f9c75ae9740 1 Processor -- start 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.929+0000 7f9c75ae9740 1 -- start start 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.929+0000 7f9c5e7fc640 1 -- 172.21.15.53:0/4114135146 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9c580035f0 con 0x7f9c680770d0 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.930+0000 7f9c75ae9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c86b070 0x56118cc10310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.930+0000 7f9c75ae9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 0x56118cc10850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.930+0000 7f9c6db11640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c86b070 0x56118cc10310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.930+0000 7f9c75ae9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c84a390 0x56118cc10d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.930+0000 7f9c75ae9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56118cb87680 con 0x56118c8421b0 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.930+0000 7f9c75ae9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56118cb76c10 con 0x56118c84a390 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.930+0000 7f9c75ae9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56118cb7abc0 con 0x56118c86b070 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.930+0000 7f9c6d310640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 0x56118cc10850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.930+0000 7f9c6d310640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 0x56118cc10850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51072/0 (socket says 172.21.15.53:51072) 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.930+0000 7f9c6d310640 1 -- 172.21.15.53:0/389873769 learned_addr learned my addr 172.21.15.53:0/389873769 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:40.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.931+0000 7f9c6cb0f640 1 --2- 172.21.15.53:0/389873769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c84a390 0x56118cc10d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.931+0000 7f9c5e7fc640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c540b4ca0 0x7f9c540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.931+0000 7f9c6db11640 1 -- 172.21.15.53:0/389873769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c84a390 msgr2=0x56118cc10d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.931+0000 7f9c6db11640 1 --2- 172.21.15.53:0/389873769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c84a390 0x56118cc10d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.931+0000 7f9c6db11640 1 -- 172.21.15.53:0/389873769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 msgr2=0x56118cc10850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.931+0000 7f9c6db11640 1 --2- 172.21.15.53:0/389873769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 0x56118cc10850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.931+0000 7f9c6db11640 1 -- 172.21.15.53:0/389873769 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118c8d6650 con 0x56118c86b070 2024-08-31T06:25:40.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.931+0000 7f9c5e7fc640 1 -- 172.21.15.53:0/4114135146 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f9c580e5a10 con 0x7f9c680770d0 2024-08-31T06:25:40.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.931+0000 7f9c6cb0f640 1 --2- 172.21.15.53:0/389873769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c84a390 0x56118cc10d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:25:40.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.931+0000 7f9c6d310640 1 --2- 172.21.15.53:0/389873769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 0x56118cc10850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:40.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.931+0000 7f9c6db11640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c540b4ca0 0x7f9c540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.932+0000 7f9c6db11640 1 --2- 172.21.15.53:0/389873769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c86b070 0x56118cc10310 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9c60031040 tx=0x7f9c60009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=718e83bd409dca01 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.932+0000 7f9c537fe640 1 -- 172.21.15.53:0/389873769 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60003b70 con 0x56118c86b070 2024-08-31T06:25:40.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.932+0000 7f9c6db11640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c540b4ca0 0x7f9c540b71b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9c60005e30 tx=0x7f9c6004d000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.932+0000 7f9c537fe640 1 -- 172.21.15.53:0/389873769 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c60036030 con 0x56118c86b070 2024-08-31T06:25:40.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.932+0000 7f9c537fe640 1 -- 172.21.15.53:0/389873769 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60030800 con 0x56118c86b070 2024-08-31T06:25:40.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.933+0000 7f9c75ae9740 1 -- 172.21.15.53:0/389873769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c86b070 msgr2=0x56118cc10310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.933+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/389873769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c86b070 0x56118cc10310 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9c60031040 tx=0x7f9c60009a20 comp rx=0 tx=0).stop 2024-08-31T06:25:40.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.933+0000 7f9c75ae9740 1 -- 172.21.15.53:0/389873769 shutdown_connections 2024-08-31T06:25:40.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.933+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/389873769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c84a390 0x56118cc10d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.933+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/389873769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 0x56118cc10850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.933+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/389873769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c86b070 0x56118cc10310 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.933+0000 7f9c75ae9740 1 -- 172.21.15.53:0/389873769 >> 172.21.15.53:0/389873769 conn(0x56118c85f460 msgr2=0x56118cc0e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.933+0000 7f9c75ae9740 1 -- 172.21.15.53:0/389873769 shutdown_connections 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.933+0000 7f9c75ae9740 1 -- 172.21.15.53:0/389873769 wait complete. 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.934+0000 7f9c75ae9740 1 -- start start 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.934+0000 7f9c75ae9740 1 Processor -- start 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.934+0000 7f9c75ae9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8421b0 0x56118cc1bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c75ae9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c84a390 0x56118cc1bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c6cb0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c84a390 0x56118cc1bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c6cb0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c84a390 0x56118cc1bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51080/0 (socket says 172.21.15.53:51080) 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c6d310640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8421b0 0x56118cc1bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c6cb0f640 1 -- 172.21.15.53:0/2185639650 learned_addr learned my addr 172.21.15.53:0/2185639650 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc27cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c75ae9740 1 -- 172.21.15.53:0/2185639650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56118c9d9700 con 0x56118c84a390 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c75ae9740 1 -- 172.21.15.53:0/2185639650 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56118cafd750 con 0x56118c86b070 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c75ae9740 1 -- 172.21.15.53:0/2185639650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56118cc1e9c0 con 0x56118c8421b0 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c75ae9740 10 client.0 _ll_register_callbacks cb 0x56118cb2ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c6db11640 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc27cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c6cb0f640 1 -- 172.21.15.53:0/2185639650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8421b0 msgr2=0x56118cc1bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c6cb0f640 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8421b0 0x56118cc1bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.935+0000 7f9c6cb0f640 1 -- 172.21.15.53:0/2185639650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 msgr2=0x56118cc27cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.936+0000 7f9c6cb0f640 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc27cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.936+0000 7f9c6cb0f640 1 -- 172.21.15.53:0/2185639650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56118cb36900 con 0x56118c84a390 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.936+0000 7f9c6cb0f640 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c84a390 0x56118cc1bff0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f9c580a9350 tx=0x7f9c580ab8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1532868ffb76ed05 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.936+0000 7f9c50ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.936+0000 7f9c50ff9640 1 -- 172.21.15.53:0/2185639650 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c580b0950 con 0x56118c84a390 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.936+0000 7f9c50ff9640 1 -- 172.21.15.53:0/2185639650 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f9c580ab550 con 0x56118c84a390 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.936+0000 7f9c75ae9740 1 -- 172.21.15.53:0/2185639650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c60036030 con 0x56118c84a390 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.936+0000 7f9c50ff9640 1 -- 172.21.15.53:0/2185639650 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f9c580b5400 con 0x56118c84a390 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.936+0000 7f9c75ae9740 10 client.21744 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.936+0000 7f9c75ae9740 1 -- 172.21.15.53:0/2185639650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x56118cc2a710 con 0x56118c84a390 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.937+0000 7f9c50ff9640 1 -- 172.21.15.53:0/2185639650 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c580aadb0 con 0x56118c84a390 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.937+0000 7f9c50ff9640 1 -- 172.21.15.53:0/2185639650 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f9c58097080 con 0x56118c84a390 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.937+0000 7f9c75ae9740 10 client.21744 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.937+0000 7f9c75ae9740 10 client.21744 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.937+0000 7f9c75ae9740 20 client.21744 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.937+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56118c8299f0 0x56118cc2dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.937+0000 7f9c75ae9740 4 client.21744 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.937+0000 7f9c75ae9740 1 -- 172.21.15.53:0/2185639650 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9c60036030 con 0x56118c8299f0 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.937+0000 7f9c6d310640 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56118c8299f0 0x56118cc2dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.938+0000 7f9c6d310640 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56118c8299f0 0x56118cc2dc10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5dae7e6b5f243c9 server_cookie=2f97c5f76c2d9429 in_seq=0 out_seq=0 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.938+0000 7f9c50ff9640 10 client.21744 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c50ff9640 1 -- 172.21.15.53:0/2185639650 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f9c60036030 con 0x56118c8299f0 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c50ff9640 10 client.21744 handle_command_reply: tid=0 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c75ae9740 1 client.21744 shutdown 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c75ae9740 1 -- 172.21.15.53:0/2185639650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c84a390 msgr2=0x56118cc1bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c84a390 0x56118cc1bff0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f9c580a9350 tx=0x7f9c580ab8e0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c75ae9740 1 -- 172.21.15.53:0/2185639650 shutdown_connections 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc27cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c84a390 0x56118cc1bff0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56118c8299f0 0x56118cc2dc10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c50ff9640 0 client.21744 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/2185639650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8421b0 0x56118cc1bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.939+0000 7f9c75ae9740 1 -- 172.21.15.53:0/2185639650 >> 172.21.15.53:0/2185639650 conn(0x56118c85f460 msgr2=0x56118cc134f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.940+0000 7f9c75ae9740 1 -- 172.21.15.53:0/2185639650 shutdown_connections 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.940+0000 7f9c75ae9740 1 -- 172.21.15.53:0/2185639650 wait complete. 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.940+0000 7f9c75ae9740 20 client.21744 trim_cache size 0 max 16384 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c75ae9740 1 Processor -- start 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c75ae9740 1 -- start start 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c75ae9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8299f0 0x56118cc13b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c75ae9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8421b0 0x56118cc18ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c75ae9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc191e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c75ae9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9c681b5a60 con 0x56118c8299f0 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c75ae9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c681b77b0 con 0x56118c86b070 2024-08-31T06:25:40.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c75ae9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c681b61c0 con 0x56118c8421b0 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c6db11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c6d310640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8299f0 0x56118cc13b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c6d310640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8299f0 0x56118cc13b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51092/0 (socket says 172.21.15.53:51092) 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.964+0000 7f9c6d310640 1 -- 172.21.15.53:0/825570958 learned_addr learned my addr 172.21.15.53:0/825570958 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.965+0000 7f9c6db11640 1 -- 172.21.15.53:0/825570958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8421b0 msgr2=0x56118cc18ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.965+0000 7f9c6db11640 1 --2- 172.21.15.53:0/825570958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8421b0 0x56118cc18ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.965+0000 7f9c6db11640 1 -- 172.21.15.53:0/825570958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8299f0 msgr2=0x56118cc13b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.965+0000 7f9c6db11640 1 --2- 172.21.15.53:0/825570958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8299f0 0x56118cc13b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.965+0000 7f9c6db11640 1 -- 172.21.15.53:0/825570958 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118cc1c930 con 0x56118c86b070 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.965+0000 7f9c6d310640 1 --2- 172.21.15.53:0/825570958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8299f0 0x56118cc13b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.965+0000 7f9c6db11640 1 --2- 172.21.15.53:0/825570958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc191e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009ca0 tx=0x7f9c6002a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=181347805329c6fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.965+0000 7f9c52ffd640 1 -- 172.21.15.53:0/825570958 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60060070 con 0x56118c86b070 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.965+0000 7f9c52ffd640 1 -- 172.21.15.53:0/825570958 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c60036070 con 0x56118c86b070 2024-08-31T06:25:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.965+0000 7f9c52ffd640 1 -- 172.21.15.53:0/825570958 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60004040 con 0x56118c86b070 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.967+0000 7f9c75ae9740 1 -- 172.21.15.53:0/825570958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 msgr2=0x56118cc191e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.967+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/825570958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc191e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009ca0 tx=0x7f9c6002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.967+0000 7f9c75ae9740 1 -- 172.21.15.53:0/825570958 shutdown_connections 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.967+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/825570958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc191e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.967+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/825570958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8421b0 0x56118cc18ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.967+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/825570958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8299f0 0x56118cc13b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.967+0000 7f9c75ae9740 1 -- 172.21.15.53:0/825570958 >> 172.21.15.53:0/825570958 conn(0x56118c85f460 msgr2=0x56118cc13410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.967+0000 7f9c75ae9740 1 -- 172.21.15.53:0/825570958 shutdown_connections 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.967+0000 7f9c75ae9740 1 -- 172.21.15.53:0/825570958 wait complete. 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.968+0000 7f9c75ae9740 1 -- start start 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.968+0000 7f9c75ae9740 1 Processor -- start 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.969+0000 7f9c75ae9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8299f0 0x56118cc240d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.969+0000 7f9c75ae9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 0x56118cc20590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.969+0000 7f9c6d310640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8299f0 0x56118cc240d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.969+0000 7f9c6d310640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8299f0 0x56118cc240d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:43896/0 (socket says 172.21.15.53:43896) 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.969+0000 7f9c6cb0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 0x56118cc20590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.969+0000 7f9c6d310640 1 -- 172.21.15.53:0/388308662 learned_addr learned my addr 172.21.15.53:0/388308662 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.969+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc20ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.969+0000 7f9c75ae9740 1 -- 172.21.15.53:0/388308662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9c681b7020 con 0x56118c8421b0 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.969+0000 7f9c75ae9740 1 -- 172.21.15.53:0/388308662 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c681b6890 con 0x56118c86b070 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.969+0000 7f9c75ae9740 1 -- 172.21.15.53:0/388308662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c681b3a60 con 0x56118c8299f0 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.970+0000 7f9c75ae9740 10 client.0 _ll_register_callbacks cb 0x7f9c580046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.970+0000 7f9c6db11640 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc20ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.970+0000 7f9c6db11640 1 -- 172.21.15.53:0/388308662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8299f0 msgr2=0x56118cc240d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.970+0000 7f9c6db11640 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8299f0 0x56118cc240d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.970+0000 7f9c6db11640 1 -- 172.21.15.53:0/388308662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 msgr2=0x56118cc20590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.970+0000 7f9c6db11640 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 0x56118cc20590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.970+0000 7f9c6db11640 1 -- 172.21.15.53:0/388308662 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56118cc21010 con 0x56118c86b070 2024-08-31T06:25:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.970+0000 7f9c6cb0f640 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 0x56118cc20590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.971+0000 7f9c6db11640 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc20ad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9c60000f80 tx=0x7f9c60030dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f3879bc2cc9bb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.971+0000 7f9c50ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:25:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.971+0000 7f9c50ff9640 1 -- 172.21.15.53:0/388308662 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6006a060 con 0x56118c86b070 2024-08-31T06:25:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.971+0000 7f9c50ff9640 1 -- 172.21.15.53:0/388308662 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f9c60003d80 con 0x56118c86b070 2024-08-31T06:25:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.971+0000 7f9c75ae9740 1 -- 172.21.15.53:0/388308662 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c60036070 con 0x56118c86b070 2024-08-31T06:25:40.413 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:25:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.972+0000 7f9c50ff9640 1 -- 172.21.15.53:0/388308662 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f9c60060070 con 0x56118c86b070 2024-08-31T06:25:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.972+0000 7f9c75ae9740 10 client.30518 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.972+0000 7f9c75ae9740 1 -- 172.21.15.53:0/388308662 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x56118cc99160 con 0x56118c86b070 2024-08-31T06:25:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.972+0000 7f9c50ff9640 1 -- 172.21.15.53:0/388308662 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c60036070 con 0x56118c86b070 2024-08-31T06:25:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.973+0000 7f9c50ff9640 1 -- 172.21.15.53:0/388308662 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f9c60053600 con 0x56118c86b070 2024-08-31T06:25:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.973+0000 7f9c75ae9740 10 client.30518 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.973+0000 7f9c75ae9740 10 client.30518 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:25:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.973+0000 7f9c75ae9740 20 client.30518 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.973+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56118c7feda0 0x56118cc9b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.973+0000 7f9c75ae9740 4 client.30518 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:25:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.973+0000 7f9c75ae9740 1 -- 172.21.15.53:0/388308662 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56118cb895d0 con 0x56118c7feda0 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.973+0000 7f9c6d310640 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56118c7feda0 0x56118cc9b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.974+0000 7f9c50ff9640 10 client.30518 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.974+0000 7f9c6d310640 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56118c7feda0 0x56118cc9b550 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9ac3ae845ee0aa18 server_cookie=2982c930ecc2e90b in_seq=0 out_seq=0 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.974+0000 7f9c50ff9640 1 -- 172.21.15.53:0/388308662 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56118cb895d0 con 0x56118c7feda0 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.974+0000 7f9c50ff9640 10 client.30518 handle_command_reply: tid=0 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.974+0000 7f9c75ae9740 1 client.30518 shutdown 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.974+0000 7f9c75ae9740 1 -- 172.21.15.53:0/388308662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 msgr2=0x56118cc20ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.974+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc20ad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9c60000f80 tx=0x7f9c60030dd0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.975+0000 7f9c75ae9740 1 -- 172.21.15.53:0/388308662 shutdown_connections 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.975+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56118c86b070 0x56118cc20ad0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.975+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56118c8421b0 0x56118cc20590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.975+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56118c7feda0 0x56118cc9b550 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.975+0000 7f9c75ae9740 1 --2- 172.21.15.53:0/388308662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56118c8299f0 0x56118cc240d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.975+0000 7f9c50ff9640 0 client.30518 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.975+0000 7f9c75ae9740 1 -- 172.21.15.53:0/388308662 >> 172.21.15.53:0/388308662 conn(0x56118c85f460 msgr2=0x56118cc112f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.975+0000 7f9c75ae9740 1 -- 172.21.15.53:0/388308662 shutdown_connections 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.975+0000 7f9c75ae9740 1 -- 172.21.15.53:0/388308662 wait complete. 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.975+0000 7f9c75ae9740 20 client.30518 trim_cache size 0 max 16384 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.976+0000 7f9c6f574640 1 -- 172.21.15.53:0/4114135146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c540b4ca0 msgr2=0x7f9c540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.976+0000 7f9c6f574640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c540b4ca0 0x7f9c540b71b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9c60005e30 tx=0x7f9c6004d000 comp rx=0 tx=0).stop 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.976+0000 7f9c6f574640 1 -- 172.21.15.53:0/4114135146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c680770d0 msgr2=0x7f9c681a0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.976+0000 7f9c6f574640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c680770d0 0x7f9c681a0c60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9c681076d0 tx=0x7f9c5800ee50 comp rx=0 tx=0).stop 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.976+0000 7f9c6f574640 1 -- 172.21.15.53:0/4114135146 shutdown_connections 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.976+0000 7f9c6f574640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c540b4ca0 0x7f9c540b71b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.976+0000 7f9c6f574640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c681141d0 0x7f9c681a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.976+0000 7f9c6f574640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c680770d0 0x7f9c681a0c60 secure :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9c681076d0 tx=0x7f9c5800ee50 comp rx=0 tx=0).stop 2024-08-31T06:25:40.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.976+0000 7f9c6f574640 1 --2- 172.21.15.53:0/4114135146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c68075a90 0x7f9c681a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.976+0000 7f9c6f574640 1 -- 172.21.15.53:0/4114135146 >> 172.21.15.53:0/4114135146 conn(0x7f9c6807b6b0 msgr2=0x7f9c68112ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.977+0000 7f9c6f574640 1 -- 172.21.15.53:0/4114135146 shutdown_connections 2024-08-31T06:25:40.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:39.977+0000 7f9c6f574640 1 -- 172.21.15.53:0/4114135146 wait complete. 2024-08-31T06:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99b67fc640 1 -- 172.21.15.53:0/2177575646 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f99c0031890 con 0x55ade7cc21c0 2024-08-31T06:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99b67fc640 10 client.21768 handle_command_reply: tid=0 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 1 client.21768 shutdown 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 1 -- 172.21.15.53:0/2177575646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d052f0 msgr2=0x55ade80e1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d052f0 0x55ade80e1410 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f99c0004360 tx=0x7f99c0004390 comp rx=0 tx=0).stop 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 1 -- 172.21.15.53:0/2177575646 shutdown_connections 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ade7cc21c0 0x55ade8165330 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ade7d2e1b0 0x55ade80e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ade7d0d4d0 0x55ade80e1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 1 --2- 172.21.15.53:0/2177575646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ade7d052f0 0x55ade80e1410 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 1 -- 172.21.15.53:0/2177575646 >> 172.21.15.53:0/2177575646 conn(0x55ade7d22300 msgr2=0x55ade80d6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99b67fc640 0 client.21768 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 1 -- 172.21.15.53:0/2177575646 shutdown_connections 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 1 -- 172.21.15.53:0/2177575646 wait complete. 2024-08-31T06:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.479+0000 7f99dc447740 20 client.21768 trim_cache size 0 max 16384 2024-08-31T06:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 -- 172.21.15.53:0/2423959810 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d50 msgr2=0x7f99bc0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d50 0x7f99bc0b7260 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f99c801b000 tx=0x7f99c801a4b0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 -- 172.21.15.53:0/2423959810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0104fc0 msgr2=0x7f99d01029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0104fc0 0x7f99d01029e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f99d006b0b0 tx=0x7f99b800ee50 comp rx=0 tx=0).stop 2024-08-31T06:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 -- 172.21.15.53:0/2423959810 shutdown_connections 2024-08-31T06:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f99bc0b4d50 0x7f99bc0b7260 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d010db40 0x7f99d0102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99d0104fc0 0x7f99d01029e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 --2- 172.21.15.53:0/2423959810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d0104590 0x7f99d01024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 -- 172.21.15.53:0/2423959810 >> 172.21.15.53:0/2423959810 conn(0x7f99d00fe160 msgr2=0x7f99d01065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 -- 172.21.15.53:0/2423959810 shutdown_connections 2024-08-31T06:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:40.480+0000 7f99d54d3640 1 -- 172.21.15.53:0/2423959810 wait complete. 2024-08-31T06:25:41.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 48882 5.69 MB/sec execute 329 sec latency 125.756 ms 2024-08-31T06:25:41.528 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:25:41.917 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:42.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:41 smithi130 ceph-mon[22266]: pgmap v975: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 328 op/s 2024-08-31T06:25:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:41 smithi153 ceph-mon[22320]: pgmap v975: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 328 op/s 2024-08-31T06:25:42.224 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:41 smithi053 ceph-mon[18924]: pgmap v975: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 328 op/s 2024-08-31T06:25:42.384 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49011 5.71 MB/sec execute 330 sec latency 369.060 ms 2024-08-31T06:25:42.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.511+0000 7f2685ae5640 1 -- 172.21.15.53:0/3556047269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680108a90 msgr2=0x7f268010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.511+0000 7f2685ae5640 1 --2- 172.21.15.53:0/3556047269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680108a90 0x7f268010f2c0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f2678009900 tx=0x7f267802a410 comp rx=0 tx=0).stop 2024-08-31T06:25:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.511+0000 7f2685ae5640 1 -- 172.21.15.53:0/3556047269 shutdown_connections 2024-08-31T06:25:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.511+0000 7f2685ae5640 1 --2- 172.21.15.53:0/3556047269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680108a90 0x7f268010f2c0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.511+0000 7f2685ae5640 1 --2- 172.21.15.53:0/3556047269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2680108140 0x7f2680108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.511+0000 7f2685ae5640 1 --2- 172.21.15.53:0/3556047269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2680102800 0x7f2680102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.511+0000 7f2685ae5640 1 -- 172.21.15.53:0/3556047269 >> 172.21.15.53:0/3556047269 conn(0x7f26800794d0 msgr2=0x7f26800798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.511+0000 7f2685ae5640 1 -- 172.21.15.53:0/3556047269 shutdown_connections 2024-08-31T06:25:42.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.511+0000 7f2685ae5640 1 -- 172.21.15.53:0/3556047269 wait complete. 2024-08-31T06:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.512+0000 7f2685ae5640 1 Processor -- start 2024-08-31T06:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.512+0000 7f2685ae5640 1 -- start start 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f2685ae5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680102800 0x7f26800ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f2685ae5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2680108140 0x7f26800ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f267f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680102800 0x7f26800ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f267f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680102800 0x7f26800ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51170/0 (socket says 172.21.15.53:51170) 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f267f7fe640 1 -- 172.21.15.53:0/213531094 learned_addr learned my addr 172.21.15.53:0/213531094 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f2685ae5640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2680108a90 0x7f26800ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f2685ae5640 1 -- 172.21.15.53:0/213531094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f26801125a0 con 0x7f2680102800 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f2685ae5640 1 -- 172.21.15.53:0/213531094 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2680112420 con 0x7f2680108140 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f2685ae5640 1 -- 172.21.15.53:0/213531094 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2680112720 con 0x7f2680108a90 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f2677fff640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2680108140 0x7f26800ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f267ffff640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2680108a90 0x7f26800ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f267f7fe640 1 -- 172.21.15.53:0/213531094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2680108a90 msgr2=0x7f26800ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f267f7fe640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2680108a90 0x7f26800ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f267f7fe640 1 -- 172.21.15.53:0/213531094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2680108140 msgr2=0x7f26800ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.513+0000 7f267f7fe640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2680108140 0x7f26800ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.514+0000 7f267f7fe640 1 -- 172.21.15.53:0/213531094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26801a8420 con 0x7f2680102800 2024-08-31T06:25:42.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.514+0000 7f267f7fe640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680102800 0x7f26800ff410 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f267000ebc0 tx=0x7f267000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:42.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.514+0000 7f267d7fa640 1 -- 172.21.15.53:0/213531094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2670010630 con 0x7f2680102800 2024-08-31T06:25:42.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.514+0000 7f2685ae5640 1 -- 172.21.15.53:0/213531094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26801a8710 con 0x7f2680102800 2024-08-31T06:25:42.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.514+0000 7f267d7fa640 1 -- 172.21.15.53:0/213531094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2670010c60 con 0x7f2680102800 2024-08-31T06:25:42.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.514+0000 7f267d7fa640 1 -- 172.21.15.53:0/213531094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2670018b00 con 0x7f2680102800 2024-08-31T06:25:42.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.514+0000 7f2685ae5640 1 -- 172.21.15.53:0/213531094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26801a8ca0 con 0x7f2680102800 2024-08-31T06:25:42.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.517+0000 7f268c05a740 1 Processor -- start 2024-08-31T06:25:42.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f268c05a740 1 -- start start 2024-08-31T06:25:42.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f268c05a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49bd0070 0x55cd49f75310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f268c05a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49ba71b0 0x55cd49f75850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f268c05a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 0x55cd49f75d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f268c05a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cd49eec680 con 0x55cd49baf390 2024-08-31T06:25:42.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f268c05a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cd49edbc10 con 0x55cd49bd0070 2024-08-31T06:25:42.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f268c05a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd49edfbc0 con 0x55cd49ba71b0 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f2677fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 0x55cd49f75d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f267ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49bd0070 0x55cd49f75310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f2677fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 0x55cd49f75d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51180/0 (socket says 172.21.15.53:51180) 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f2677fff640 1 -- 172.21.15.53:0/2120375019 learned_addr learned my addr 172.21.15.53:0/2120375019 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f267ffff640 1 -- 172.21.15.53:0/2120375019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49ba71b0 msgr2=0x55cd49f75850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f267ffff640 1 --2- 172.21.15.53:0/2120375019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49ba71b0 0x55cd49f75850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f267ffff640 1 -- 172.21.15.53:0/2120375019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 msgr2=0x55cd49f75d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f267ffff640 1 --2- 172.21.15.53:0/2120375019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 0x55cd49f75d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.518+0000 7f267ffff640 1 -- 172.21.15.53:0/2120375019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd49c3b650 con 0x55cd49bd0070 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.519+0000 7f267d7fa640 1 -- 172.21.15.53:0/213531094 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2670018ca0 con 0x7f2680102800 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.519+0000 7f267ffff640 1 --2- 172.21.15.53:0/2120375019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49bd0070 0x55cd49f75310 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f26780057c0 tx=0x7f2678032b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd8bb52148154fcd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.519+0000 7f2675ffb640 1 -- 172.21.15.53:0/2120375019 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267803f070 con 0x55cd49bd0070 2024-08-31T06:25:42.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.519+0000 7f2675ffb640 1 -- 172.21.15.53:0/2120375019 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2678004030 con 0x55cd49bd0070 2024-08-31T06:25:42.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.519+0000 7f2675ffb640 1 -- 172.21.15.53:0/2120375019 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2678035070 con 0x55cd49bd0070 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.520+0000 7f267d7fa640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f266c0b4d20 0x7f266c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.520+0000 7f267d7fa640 1 -- 172.21.15.53:0/213531094 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f26700e5be0 con 0x7f2680102800 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.520+0000 7f267f7fe640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f266c0b4d20 0x7f266c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.520+0000 7f268c05a740 1 -- 172.21.15.53:0/2120375019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49bd0070 msgr2=0x55cd49f75310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.520+0000 7f268c05a740 1 --2- 172.21.15.53:0/2120375019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49bd0070 0x55cd49f75310 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f26780057c0 tx=0x7f2678032b00 comp rx=0 tx=0).stop 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.521+0000 7f268c05a740 1 -- 172.21.15.53:0/2120375019 shutdown_connections 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.521+0000 7f268c05a740 1 --2- 172.21.15.53:0/2120375019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 0x55cd49f75d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.521+0000 7f268c05a740 1 --2- 172.21.15.53:0/2120375019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49ba71b0 0x55cd49f75850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.521+0000 7f268c05a740 1 --2- 172.21.15.53:0/2120375019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49bd0070 0x55cd49f75310 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.521+0000 7f268c05a740 1 -- 172.21.15.53:0/2120375019 >> 172.21.15.53:0/2120375019 conn(0x55cd49bc4460 msgr2=0x55cd49f73200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.521+0000 7f267f7fe640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f266c0b4d20 0x7f266c0b7230 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55cd49f73f90 tx=0x7f267000cf90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.521+0000 7f268c05a740 1 -- 172.21.15.53:0/2120375019 shutdown_connections 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.521+0000 7f268c05a740 1 -- 172.21.15.53:0/2120375019 wait complete. 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.521+0000 7f268c05a740 1 -- start start 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.522+0000 7f268c05a740 1 Processor -- start 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.522+0000 7f268c05a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49ba71b0 0x55cd49f80ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.522+0000 7f268c05a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49baf390 0x55cd49f81000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.522+0000 7f268c05a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49bd0070 0x55cd49f8cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.522+0000 7f268c05a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cd49d3e700 con 0x55cd49ba71b0 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.522+0000 7f268c05a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cd49e62750 con 0x55cd49bd0070 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.522+0000 7f268c05a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd49f83a90 con 0x55cd49baf390 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.522+0000 7f267ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49ba71b0 0x55cd49f80ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.522+0000 7f268c05a740 10 client.0 _ll_register_callbacks cb 0x55cd49e91e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.522+0000 7f267ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49ba71b0 0x55cd49f80ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51186/0 (socket says 172.21.15.53:51186) 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.522+0000 7f267ffff640 1 -- 172.21.15.53:0/1540542566 learned_addr learned my addr 172.21.15.53:0/1540542566 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f2677fff640 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49baf390 0x55cd49f81000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f267ffff640 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49bd0070 0x55cd49f8cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f267ffff640 1 -- 172.21.15.53:0/1540542566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49baf390 msgr2=0x55cd49f81000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f267ffff640 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49baf390 0x55cd49f81000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f267ffff640 1 -- 172.21.15.53:0/1540542566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49bd0070 msgr2=0x55cd49f8cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f267ffff640 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49bd0070 0x55cd49f8cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f267ffff640 1 -- 172.21.15.53:0/1540542566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd49e9b900 con 0x55cd49ba71b0 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f267ffff640 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49ba71b0 0x55cd49f80ac0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f2678005eb0 tx=0x7f2678009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ebc392db3cd4c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f265effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f265effd640 1 -- 172.21.15.53:0/1540542566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267803f070 con 0x55cd49ba71b0 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f268c05a740 1 -- 172.21.15.53:0/1540542566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2678004030 con 0x55cd49ba71b0 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.523+0000 7f265effd640 1 -- 172.21.15.53:0/1540542566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f2678005140 con 0x55cd49ba71b0 2024-08-31T06:25:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.524+0000 7f265effd640 1 -- 172.21.15.53:0/1540542566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f2678035070 con 0x55cd49ba71b0 2024-08-31T06:25:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.524+0000 7f268c05a740 10 client.21780 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.524+0000 7f268c05a740 1 -- 172.21.15.53:0/1540542566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55cd49f8f8c0 con 0x55cd49ba71b0 2024-08-31T06:25:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.524+0000 7f265effd640 1 -- 172.21.15.53:0/1540542566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2678004030 con 0x55cd49ba71b0 2024-08-31T06:25:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.524+0000 7f265effd640 1 -- 172.21.15.53:0/1540542566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f2678004c70 con 0x55cd49ba71b0 2024-08-31T06:25:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.524+0000 7f268c05a740 10 client.21780 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.524+0000 7f268c05a740 10 client.21780 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:25:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.524+0000 7f268c05a740 20 client.21780 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.524+0000 7f268c05a740 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cd49b8e9f0 0x55cd49f92df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.524+0000 7f268c05a740 4 client.21780 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.524+0000 7f268c05a740 1 -- 172.21.15.53:0/1540542566 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd49eee5d0 con 0x55cd49b8e9f0 2024-08-31T06:25:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.525+0000 7f2677fff640 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cd49b8e9f0 0x55cd49f92df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.525+0000 7f265effd640 10 client.21780 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:25:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.525+0000 7f2677fff640 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cd49b8e9f0 0x55cd49f92df0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2d8efa885588f6fd server_cookie=712a58fa61c7a43c in_seq=0 out_seq=0 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f265effd640 1 -- 172.21.15.53:0/1540542566 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd49eee5d0 con 0x55cd49b8e9f0 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f265effd640 10 client.21780 handle_command_reply: tid=0 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f268c05a740 1 client.21780 shutdown 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f268c05a740 1 -- 172.21.15.53:0/1540542566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49ba71b0 msgr2=0x55cd49f80ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f268c05a740 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49ba71b0 0x55cd49f80ac0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f2678005eb0 tx=0x7f2678009260 comp rx=0 tx=0).stop 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f268c05a740 1 -- 172.21.15.53:0/1540542566 shutdown_connections 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f268c05a740 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49bd0070 0x55cd49f8cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f268c05a740 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49baf390 0x55cd49f81000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f268c05a740 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cd49b8e9f0 0x55cd49f92df0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f268c05a740 1 --2- 172.21.15.53:0/1540542566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49ba71b0 0x55cd49f80ac0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f268c05a740 1 -- 172.21.15.53:0/1540542566 >> 172.21.15.53:0/1540542566 conn(0x55cd49bc4460 msgr2=0x55cd49f784a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f265effd640 0 client.21780 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.526+0000 7f268c05a740 1 -- 172.21.15.53:0/1540542566 shutdown_connections 2024-08-31T06:25:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.527+0000 7f268c05a740 1 -- 172.21.15.53:0/1540542566 wait complete. 2024-08-31T06:25:42.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.527+0000 7f268c05a740 20 client.21780 trim_cache size 0 max 16384 2024-08-31T06:25:42.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.549+0000 7f268c05a740 1 Processor -- start 2024-08-31T06:25:42.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.549+0000 7f268c05a740 1 -- start start 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.549+0000 7f268c05a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49ba71b0 0x55cd49f73230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f268c05a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 0x55cd49f8ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f268c05a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49bd0070 0x55cd49f8d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f268c05a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f26801b1780 con 0x55cd49baf390 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f268c05a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f26801b34d0 con 0x55cd49ba71b0 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f268c05a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f26801b1ee0 con 0x55cd49bd0070 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f2677fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 0x55cd49f8ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f2677fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 0x55cd49f8ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51200/0 (socket says 172.21.15.53:51200) 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f2677fff640 1 -- 172.21.15.53:0/2966834608 learned_addr learned my addr 172.21.15.53:0/2966834608 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f267ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49ba71b0 0x55cd49f73230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f267ffff640 1 --2- 172.21.15.53:0/2966834608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49bd0070 0x55cd49f8d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f2677fff640 1 -- 172.21.15.53:0/2966834608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49bd0070 msgr2=0x55cd49f8d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:42.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f2677fff640 1 --2- 172.21.15.53:0/2966834608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49bd0070 0x55cd49f8d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f2677fff640 1 -- 172.21.15.53:0/2966834608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49ba71b0 msgr2=0x55cd49f73230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:42.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f2677fff640 1 --2- 172.21.15.53:0/2966834608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49ba71b0 0x55cd49f73230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f2677fff640 1 -- 172.21.15.53:0/2966834608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd49f78170 con 0x55cd49baf390 2024-08-31T06:25:42.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.550+0000 7f2677fff640 1 --2- 172.21.15.53:0/2966834608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 0x55cd49f8ccb0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f26680058a0 tx=0x7f2668005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3f89c60de1873b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.551+0000 7f26757fa640 1 -- 172.21.15.53:0/2966834608 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668025670 con 0x55cd49baf390 2024-08-31T06:25:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.551+0000 7f26757fa640 1 -- 172.21.15.53:0/2966834608 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26680118d0 con 0x55cd49baf390 2024-08-31T06:25:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.551+0000 7f26757fa640 1 -- 172.21.15.53:0/2966834608 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266801e880 con 0x55cd49baf390 2024-08-31T06:25:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.552+0000 7f268c05a740 1 -- 172.21.15.53:0/2966834608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 msgr2=0x55cd49f8ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.552+0000 7f268c05a740 1 --2- 172.21.15.53:0/2966834608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 0x55cd49f8ccb0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f26680058a0 tx=0x7f2668005f90 comp rx=0 tx=0).stop 2024-08-31T06:25:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.552+0000 7f268c05a740 1 -- 172.21.15.53:0/2966834608 shutdown_connections 2024-08-31T06:25:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.552+0000 7f268c05a740 1 --2- 172.21.15.53:0/2966834608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49bd0070 0x55cd49f8d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.552+0000 7f268c05a740 1 --2- 172.21.15.53:0/2966834608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49baf390 0x55cd49f8ccb0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.552+0000 7f268c05a740 1 --2- 172.21.15.53:0/2966834608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49ba71b0 0x55cd49f73230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.552+0000 7f268c05a740 1 -- 172.21.15.53:0/2966834608 >> 172.21.15.53:0/2966834608 conn(0x55cd49bc4460 msgr2=0x55cd49f72b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:42.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.552+0000 7f268c05a740 1 -- 172.21.15.53:0/2966834608 shutdown_connections 2024-08-31T06:25:42.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.552+0000 7f268c05a740 1 -- 172.21.15.53:0/2966834608 wait complete. 2024-08-31T06:25:42.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.553+0000 7f268c05a740 1 -- start start 2024-08-31T06:25:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.553+0000 7f268c05a740 1 Processor -- start 2024-08-31T06:25:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.553+0000 7f268c05a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49ba71b0 0x55cd49f84fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.553+0000 7f268c05a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49baf390 0x55cd49f854e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f268c05a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49bd0070 0x55cd49f85a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f268c05a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f26801b2d40 con 0x55cd49bd0070 2024-08-31T06:25:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f268c05a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f26801b25b0 con 0x55cd49baf390 2024-08-31T06:25:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f268c05a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f26801af780 con 0x55cd49ba71b0 2024-08-31T06:25:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f268c05a740 10 client.0 _ll_register_callbacks cb 0x7f2668009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f2677fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49baf390 0x55cd49f854e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f2677fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49baf390 0x55cd49f854e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46780/0 (socket says 172.21.15.53:46780) 2024-08-31T06:25:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f267ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49ba71b0 0x55cd49f84fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f2677fff640 1 -- 172.21.15.53:0/1214523477 learned_addr learned my addr 172.21.15.53:0/1214523477 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f267ffff640 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49bd0070 0x55cd49f85a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f2677fff640 1 -- 172.21.15.53:0/1214523477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49ba71b0 msgr2=0x55cd49f84fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f2677fff640 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49ba71b0 0x55cd49f84fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f2677fff640 1 -- 172.21.15.53:0/1214523477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49bd0070 msgr2=0x55cd49f85a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f2677fff640 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49bd0070 0x55cd49f85a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f2677fff640 1 -- 172.21.15.53:0/1214523477 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd49ffc9e0 con 0x55cd49baf390 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f267ffff640 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49bd0070 0x55cd49f85a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f2677fff640 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49baf390 0x55cd49f854e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2668009cb0 tx=0x7f2668011580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88755acdff660110 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.554+0000 7f265effd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f265effd640 1 -- 172.21.15.53:0/1214523477 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668011e90 con 0x55cd49baf390 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f265effd640 1 -- 172.21.15.53:0/1214523477 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f2668005050 con 0x55cd49baf390 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f268c05a740 1 -- 172.21.15.53:0/1214523477 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26680118d0 con 0x55cd49baf390 2024-08-31T06:25:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f265effd640 1 -- 172.21.15.53:0/1214523477 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f266803b050 con 0x55cd49baf390 2024-08-31T06:25:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f268c05a740 10 client.30554 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f268c05a740 1 -- 172.21.15.53:0/1214523477 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55cd49ffdc40 con 0x55cd49baf390 2024-08-31T06:25:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f265effd640 1 -- 172.21.15.53:0/1214523477 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2668004730 con 0x55cd49baf390 2024-08-31T06:25:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f265effd640 1 -- 172.21.15.53:0/1214523477 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f2668036030 con 0x55cd49baf390 2024-08-31T06:25:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f268c05a740 10 client.30554 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f268c05a740 10 client.30554 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:25:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f268c05a740 20 client.30554 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f268c05a740 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cd49b63da0 0x55cd4a000360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f268c05a740 4 client.30554 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:25:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.555+0000 7f268c05a740 1 -- 172.21.15.53:0/1214523477 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f26680118d0 con 0x55cd49b63da0 2024-08-31T06:25:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.556+0000 7f267ffff640 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cd49b63da0 0x55cd4a000360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.556+0000 7f265effd640 10 client.30554 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.556+0000 7f267ffff640 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cd49b63da0 0x55cd4a000360 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ca5d3f7d3674b132 server_cookie=b30c908a2f9b2abd in_seq=0 out_seq=0 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.557+0000 7f265effd640 1 -- 172.21.15.53:0/1214523477 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f26680118d0 con 0x55cd49b63da0 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.557+0000 7f265effd640 10 client.30554 handle_command_reply: tid=0 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.557+0000 7f268c05a740 1 client.30554 shutdown 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f268c05a740 1 -- 172.21.15.53:0/1214523477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49baf390 msgr2=0x55cd49f854e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f268c05a740 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49baf390 0x55cd49f854e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2668009cb0 tx=0x7f2668011580 comp rx=0 tx=0).stop 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f268c05a740 1 -- 172.21.15.53:0/1214523477 shutdown_connections 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f268c05a740 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55cd49b63da0 0x55cd4a000360 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f268c05a740 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cd49bd0070 0x55cd49f85a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f268c05a740 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd49baf390 0x55cd49f854e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f268c05a740 1 --2- 172.21.15.53:0/1214523477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd49ba71b0 0x55cd49f84fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f268c05a740 1 -- 172.21.15.53:0/1214523477 >> 172.21.15.53:0/1214523477 conn(0x55cd49bc4460 msgr2=0x55cd49f78340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:42.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f265effd640 0 client.30554 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:25:42.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f268c05a740 1 -- 172.21.15.53:0/1214523477 shutdown_connections 2024-08-31T06:25:42.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f268c05a740 1 -- 172.21.15.53:0/1214523477 wait complete. 2024-08-31T06:25:42.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.558+0000 7f268c05a740 20 client.30554 trim_cache size 0 max 16384 2024-08-31T06:25:42.564 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:25:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 -- 172.21.15.53:0/213531094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f266c0b4d20 msgr2=0x7f266c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f266c0b4d20 0x7f266c0b7230 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55cd49f73f90 tx=0x7f267000cf90 comp rx=0 tx=0).stop 2024-08-31T06:25:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 -- 172.21.15.53:0/213531094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680102800 msgr2=0x7f26800ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680102800 0x7f26800ff410 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f267000ebc0 tx=0x7f267000c6a0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 -- 172.21.15.53:0/213531094 shutdown_connections 2024-08-31T06:25:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f266c0b4d20 0x7f266c0b7230 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2680108a90 0x7f26800ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2680108140 0x7f26800ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 --2- 172.21.15.53:0/213531094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680102800 0x7f26800ff410 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 -- 172.21.15.53:0/213531094 >> 172.21.15.53:0/213531094 conn(0x7f26800794d0 msgr2=0x7f268006afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 -- 172.21.15.53:0/213531094 shutdown_connections 2024-08-31T06:25:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:42.559+0000 7f2685ae5640 1 -- 172.21.15.53:0/213531094 wait complete. 2024-08-31T06:25:43.012 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.1 2024-08-31T06:25:43.012 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:25:43.385 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49143 5.69 MB/sec execute 331 sec latency 67.717 ms 2024-08-31T06:25:43.421 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:25:43.459 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:43.996 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:43 smithi053 ceph-mon[18924]: pgmap v976: 97 pgs: 97 active+clean; 807 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 268 op/s 2024-08-31T06:25:44.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:43 smithi130 ceph-mon[22266]: pgmap v976: 97 pgs: 97 active+clean; 807 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 268 op/s 2024-08-31T06:25:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:43 smithi153 ceph-mon[22320]: pgmap v976: 97 pgs: 97 active+clean; 807 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 268 op/s 2024-08-31T06:25:44.385 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49252 5.70 MB/sec execute 332 sec latency 281.048 ms 2024-08-31T06:25:44.386 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:25:44.386 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":75,"btime":"2024-08-31T06:25:18:805159+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":75,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:25:18.762328+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:25:44.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.993+0000 7f7a89698640 1 -- 172.21.15.53:0/1631787252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a84108b10 msgr2=0x7f7a8410f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:44.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.993+0000 7f7a89698640 1 --2- 172.21.15.53:0/1631787252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a84108b10 0x7f7a8410f340 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009ca0 tx=0x7f7a7c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:25:44.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.993+0000 7f7a89698640 1 -- 172.21.15.53:0/1631787252 shutdown_connections 2024-08-31T06:25:44.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.993+0000 7f7a89698640 1 --2- 172.21.15.53:0/1631787252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a84108b10 0x7f7a8410f340 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:44.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.993+0000 7f7a89698640 1 --2- 172.21.15.53:0/1631787252 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a841081c0 0x7f7a841085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.993+0000 7f7a89698640 1 --2- 172.21.15.53:0/1631787252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a84102880 0x7f7a84102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.993+0000 7f7a89698640 1 -- 172.21.15.53:0/1631787252 >> 172.21.15.53:0/1631787252 conn(0x7f7a84079510 msgr2=0x7f7a84079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.993+0000 7f7a89698640 1 -- 172.21.15.53:0/1631787252 shutdown_connections 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.993+0000 7f7a89698640 1 -- 172.21.15.53:0/1631787252 wait complete. 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.994+0000 7f7a89698640 1 Processor -- start 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.994+0000 7f7a89698640 1 -- start start 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.994+0000 7f7a89698640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a84102880 0x7f7a8419af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.994+0000 7f7a89698640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a841081c0 0x7f7a8419b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.994+0000 7f7a89698640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a84108b10 0x7f7a8419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a89698640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7a841126e0 con 0x7f7a84102880 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a89698640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7a84112560 con 0x7f7a841081c0 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a89698640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a84112860 con 0x7f7a84108b10 2024-08-31T06:25:44.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a82ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a84102880 0x7f7a8419af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a82ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a84102880 0x7f7a8419af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47642/0 (socket says 172.21.15.53:47642) 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a82ffd640 1 -- 172.21.15.53:0/4224375311 learned_addr learned my addr 172.21.15.53:0/4224375311 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a827fc640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a841081c0 0x7f7a8419b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a837fe640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a84108b10 0x7f7a8419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a82ffd640 1 -- 172.21.15.53:0/4224375311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a84108b10 msgr2=0x7f7a8419b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a82ffd640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a84108b10 0x7f7a8419b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a82ffd640 1 -- 172.21.15.53:0/4224375311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a841081c0 msgr2=0x7f7a8419b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a82ffd640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a841081c0 0x7f7a8419b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a82ffd640 1 -- 172.21.15.53:0/4224375311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a841a6230 con 0x7f7a84102880 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a827fc640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a841081c0 0x7f7a8419b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a82ffd640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a84102880 0x7f7a8419af70 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400e9f0 tx=0x7f7a7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.995+0000 7f7a6bfff640 1 -- 172.21.15.53:0/4224375311 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7400cd80 con 0x7f7a84102880 2024-08-31T06:25:44.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.996+0000 7f7a89698640 1 -- 172.21.15.53:0/4224375311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a841a6520 con 0x7f7a84102880 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.996+0000 7f7a6bfff640 1 -- 172.21.15.53:0/4224375311 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a740108c0 con 0x7f7a84102880 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.996+0000 7f7a6bfff640 1 -- 172.21.15.53:0/4224375311 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a740187c0 con 0x7f7a84102880 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.996+0000 7f7a89698640 1 -- 172.21.15.53:0/4224375311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a841a6a60 con 0x7f7a84102880 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:43.997+0000 7f7a89698640 1 -- 172.21.15.53:0/4224375311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a84103b00 con 0x7f7a84102880 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.000+0000 7f7a6bfff640 1 -- 172.21.15.53:0/4224375311 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7a74010430 con 0x7f7a84102880 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.001+0000 7f7a6bfff640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a6c0b4ca0 0x7f7a6c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.001+0000 7f7a827fc640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a6c0b4ca0 0x7f7a6c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.001+0000 7f7a6bfff640 1 -- 172.21.15.53:0/4224375311 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f7a740e5dd0 con 0x7f7a84102880 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.001+0000 7f7a827fc640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a6c0b4ca0 0x7f7a6c0b71b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7a84107eb0 tx=0x7f7a78005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.005+0000 7f7a6bfff640 1 -- 172.21.15.53:0/4224375311 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7a740ac550 con 0x7f7a84102880 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.342+0000 7f7a89698640 1 -- 172.21.15.53:0/4224375311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a84102c90 con 0x7f7a84102880 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.343+0000 7f7a6bfff640 1 -- 172.21.15.53:0/4224375311 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+12004 (secure 0 0 0) 0x7f7a740b0d10 con 0x7f7a84102880 2024-08-31T06:25:44.389 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 75 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.346+0000 7f7a89698640 1 -- 172.21.15.53:0/4224375311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a6c0b4ca0 msgr2=0x7f7a6c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.346+0000 7f7a89698640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a6c0b4ca0 0x7f7a6c0b71b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7a84107eb0 tx=0x7f7a78005f90 comp rx=0 tx=0).stop 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.346+0000 7f7a89698640 1 -- 172.21.15.53:0/4224375311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a84102880 msgr2=0x7f7a8419af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.346+0000 7f7a89698640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a84102880 0x7f7a8419af70 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400e9f0 tx=0x7f7a7400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.347+0000 7f7a89698640 1 -- 172.21.15.53:0/4224375311 shutdown_connections 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.347+0000 7f7a89698640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7a6c0b4ca0 0x7f7a6c0b71b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.347+0000 7f7a89698640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a84108b10 0x7f7a8419b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.347+0000 7f7a89698640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a841081c0 0x7f7a8419b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.347+0000 7f7a89698640 1 --2- 172.21.15.53:0/4224375311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a84102880 0x7f7a8419af70 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.347+0000 7f7a89698640 1 -- 172.21.15.53:0/4224375311 >> 172.21.15.53:0/4224375311 conn(0x7f7a84079510 msgr2=0x7f7a841061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.347+0000 7f7a89698640 1 -- 172.21.15.53:0/4224375311 shutdown_connections 2024-08-31T06:25:44.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:44.347+0000 7f7a89698640 1 -- 172.21.15.53:0/4224375311 wait complete. 2024-08-31T06:25:45.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:44 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4224375311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:25:45.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:44 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4224375311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:25:45.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:44 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4224375311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:25:45.385 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49378 5.68 MB/sec execute 333 sec latency 184.957 ms 2024-08-31T06:25:46.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:45 smithi130 ceph-mon[22266]: pgmap v977: 97 pgs: 97 active+clean; 809 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 306 op/s 2024-08-31T06:25:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:45 smithi153 ceph-mon[22320]: pgmap v977: 97 pgs: 97 active+clean; 809 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 306 op/s 2024-08-31T06:25:46.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:45 smithi053 ceph-mon[18924]: pgmap v977: 97 pgs: 97 active+clean; 809 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 306 op/s 2024-08-31T06:25:46.385 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49503 5.68 MB/sec execute 334 sec latency 136.045 ms 2024-08-31T06:25:46.594 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:47.224 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 134.1 --await-for 45.0' 2024-08-31T06:25:47.224 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 134.1 --await-for 45.0 2024-08-31T06:25:47.385 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49658 5.68 MB/sec execute 335 sec latency 86.353 ms 2024-08-31T06:25:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.712+0000 7f40dc72a640 1 -- 172.21.15.53:0/1108383267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d4109ba0 msgr2=0x7f40d41103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.712+0000 7f40dc72a640 1 --2- 172.21.15.53:0/1108383267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d4109ba0 0x7f40d41103d0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009ca0 tx=0x7f40cc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.713+0000 7f40dc72a640 1 -- 172.21.15.53:0/1108383267 shutdown_connections 2024-08-31T06:25:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.713+0000 7f40dc72a640 1 --2- 172.21.15.53:0/1108383267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d4109ba0 0x7f40d41103d0 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.713+0000 7f40dc72a640 1 --2- 172.21.15.53:0/1108383267 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40d4109250 0x7f40d4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.713+0000 7f40dc72a640 1 --2- 172.21.15.53:0/1108383267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40d4103910 0x7f40d4103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.713+0000 7f40dc72a640 1 -- 172.21.15.53:0/1108383267 >> 172.21.15.53:0/1108383267 conn(0x7f40d40ff380 msgr2=0x7f40d41017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.713+0000 7f40dc72a640 1 -- 172.21.15.53:0/1108383267 shutdown_connections 2024-08-31T06:25:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.713+0000 7f40dc72a640 1 -- 172.21.15.53:0/1108383267 wait complete. 2024-08-31T06:25:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.714+0000 7f40dc72a640 1 Processor -- start 2024-08-31T06:25:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.714+0000 7f40dc72a640 1 -- start start 2024-08-31T06:25:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40dc72a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d4103910 0x7f40d419c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40dc72a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40d4109250 0x7f40d419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40dc72a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40d4109ba0 0x7f40d41a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40dc72a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4113760 con 0x7f40d4103910 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40dc72a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41135e0 con 0x7f40d4109ba0 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40dc72a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41138e0 con 0x7f40d4109250 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40da4c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d4103910 0x7f40d419c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40da4c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d4103910 0x7f40d419c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47654/0 (socket says 172.21.15.53:47654) 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40da4c6640 1 -- 172.21.15.53:0/2765704012 learned_addr learned my addr 172.21.15.53:0/2765704012 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40dacc7640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40d4109ba0 0x7f40d41a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40d9cc5640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40d4109250 0x7f40d419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40da4c6640 1 -- 172.21.15.53:0/2765704012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40d4109250 msgr2=0x7f40d419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40da4c6640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40d4109250 0x7f40d419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40da4c6640 1 -- 172.21.15.53:0/2765704012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40d4109ba0 msgr2=0x7f40d41a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40da4c6640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40d4109ba0 0x7f40d41a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.715+0000 7f40da4c6640 1 -- 172.21.15.53:0/2765704012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d41a22a0 con 0x7f40d4103910 2024-08-31T06:25:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.716+0000 7f40da4c6640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d4103910 0x7f40d419c330 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e9f0 tx=0x7f40d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.716+0000 7f40cb7fe640 1 -- 172.21.15.53:0/2765704012 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d000cd80 con 0x7f40d4103910 2024-08-31T06:25:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.716+0000 7f40cb7fe640 1 -- 172.21.15.53:0/2765704012 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40d00108c0 con 0x7f40d4103910 2024-08-31T06:25:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.716+0000 7f40cb7fe640 1 -- 172.21.15.53:0/2765704012 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00187c0 con 0x7f40d4103910 2024-08-31T06:25:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.716+0000 7f40dc72a640 1 -- 172.21.15.53:0/2765704012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d41a2590 con 0x7f40d4103910 2024-08-31T06:25:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.717+0000 7f40dc72a640 1 -- 172.21.15.53:0/2765704012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d41a8cf0 con 0x7f40d4103910 2024-08-31T06:25:47.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.720+0000 7f40cb7fe640 1 -- 172.21.15.53:0/2765704012 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f40d0010430 con 0x7f40d4103910 2024-08-31T06:25:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.721+0000 7f40e2c9f740 1 Processor -- start 2024-08-31T06:25:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.721+0000 7f40e2c9f740 1 -- start start 2024-08-31T06:25:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.722+0000 7f40e2c9f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef4577070 0x562ef491c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.722+0000 7f40e2c9f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef491c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.722+0000 7f40e2c9f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef491cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.722+0000 7f40e2c9f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562ef4893680 con 0x562ef454e1b0 2024-08-31T06:25:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.722+0000 7f40e2c9f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562ef4882c10 con 0x562ef4577070 2024-08-31T06:25:47.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.722+0000 7f40e2c9f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562ef4886bc0 con 0x562ef4556390 2024-08-31T06:25:47.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.722+0000 7f40cb7fe640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40c00b4df0 0x7f40c00b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.722+0000 7f40dacc7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef4577070 0x562ef491c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.722+0000 7f40cb7fe640 1 -- 172.21.15.53:0/2765704012 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f40d00e5840 con 0x7f40d4103910 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.722+0000 7f40dacc7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef4577070 0x562ef491c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:34364/0 (socket says 172.21.15.53:34364) 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.722+0000 7f40dacc7640 1 -- 172.21.15.53:0/2513442768 learned_addr learned my addr 172.21.15.53:0/2513442768 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.723+0000 7f40dacc7640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40c00b4df0 0x7f40c00b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.723+0000 7f40d9cc5640 1 --2- 172.21.15.53:0/2513442768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef491cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.723+0000 7f40dacc7640 1 -- 172.21.15.53:0/2513442768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 msgr2=0x562ef491cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.723+0000 7f40dacc7640 1 --2- 172.21.15.53:0/2513442768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef491cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.723+0000 7f40dacc7640 1 -- 172.21.15.53:0/2513442768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 msgr2=0x562ef491c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.723+0000 7f40da4c6640 1 --2- 172.21.15.53:0/2513442768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef491c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.723+0000 7f40dacc7640 1 --2- 172.21.15.53:0/2513442768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef491c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.723+0000 7f40dacc7640 1 -- 172.21.15.53:0/2513442768 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef45e2650 con 0x562ef4577070 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.723+0000 7f40da4c6640 1 --2- 172.21.15.53:0/2513442768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef491c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:25:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.724+0000 7f40dacc7640 1 --2- 172.21.15.53:0/2513442768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef4577070 0x562ef491c310 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009ca0 tx=0x7f40cc031850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0c8027b53185aaa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:47.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.724+0000 7f40dacc7640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40c00b4df0 0x7f40c00b7300 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f40cc035000 tx=0x7f40cc04a000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:47.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.724+0000 7f40c8ff9640 1 -- 172.21.15.53:0/2513442768 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc003e30 con 0x562ef4577070 2024-08-31T06:25:47.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.724+0000 7f40c8ff9640 1 -- 172.21.15.53:0/2513442768 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40cc036070 con 0x562ef4577070 2024-08-31T06:25:47.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.724+0000 7f40c8ff9640 1 -- 172.21.15.53:0/2513442768 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc0308b0 con 0x562ef4577070 2024-08-31T06:25:47.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.725+0000 7f40e2c9f740 1 -- 172.21.15.53:0/2513442768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef4577070 msgr2=0x562ef491c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:47.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.725+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/2513442768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef4577070 0x562ef491c310 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009ca0 tx=0x7f40cc031850 comp rx=0 tx=0).stop 2024-08-31T06:25:47.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.725+0000 7f40e2c9f740 1 -- 172.21.15.53:0/2513442768 shutdown_connections 2024-08-31T06:25:47.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.725+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/2513442768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef491cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.725+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/2513442768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef491c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.725+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/2513442768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef4577070 0x562ef491c310 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.725+0000 7f40e2c9f740 1 -- 172.21.15.53:0/2513442768 >> 172.21.15.53:0/2513442768 conn(0x562ef456b460 msgr2=0x562ef491a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:47.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.725+0000 7f40e2c9f740 1 -- 172.21.15.53:0/2513442768 shutdown_connections 2024-08-31T06:25:47.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.725+0000 7f40e2c9f740 1 -- 172.21.15.53:0/2513442768 wait complete. 2024-08-31T06:25:47.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.726+0000 7f40e2c9f740 1 -- start start 2024-08-31T06:25:47.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.726+0000 7f40e2c9f740 1 Processor -- start 2024-08-31T06:25:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.726+0000 7f40e2c9f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef454e1b0 0x562ef49302b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.726+0000 7f40e2c9f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef4556390 0x562ef49307f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.726+0000 7f40e2c9f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4577070 0x562ef493c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.726+0000 7f40e2c9f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562ef46e5700 con 0x562ef4556390 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.726+0000 7f40e2c9f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562ef4809750 con 0x562ef454e1b0 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.726+0000 7f40e2c9f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562ef4932fe0 con 0x562ef4577070 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.726+0000 7f40e2c9f740 10 client.0 _ll_register_callbacks cb 0x562ef4838e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40d9cc5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef4556390 0x562ef49307f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40d9cc5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef4556390 0x562ef49307f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47670/0 (socket says 172.21.15.53:47670) 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40d9cc5640 1 -- 172.21.15.53:0/952905062 learned_addr learned my addr 172.21.15.53:0/952905062 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40dacc7640 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4577070 0x562ef493c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40da4c6640 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef454e1b0 0x562ef49302b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40d9cc5640 1 -- 172.21.15.53:0/952905062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4577070 msgr2=0x562ef493c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40d9cc5640 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4577070 0x562ef493c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40d9cc5640 1 -- 172.21.15.53:0/952905062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef454e1b0 msgr2=0x562ef49302b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40d9cc5640 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef454e1b0 0x562ef49302b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40d9cc5640 1 -- 172.21.15.53:0/952905062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef4842900 con 0x562ef4556390 2024-08-31T06:25:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40d9cc5640 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef4556390 0x562ef49307f0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f40c4012700 tx=0x7f40c4012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f234f15c9ad3e4d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.727+0000 7f40bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.728+0000 7f40bdffb640 1 -- 172.21.15.53:0/952905062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4004050 con 0x562ef4556390 2024-08-31T06:25:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.728+0000 7f40bdffb640 1 -- 172.21.15.53:0/952905062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f40c40041f0 con 0x562ef4556390 2024-08-31T06:25:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.728+0000 7f40e2c9f740 1 -- 172.21.15.53:0/952905062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40cc036070 con 0x562ef4556390 2024-08-31T06:25:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.728+0000 7f40bdffb640 1 -- 172.21.15.53:0/952905062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f40c40043f0 con 0x562ef4556390 2024-08-31T06:25:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.728+0000 7f40e2c9f740 10 client.21801 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.728+0000 7f40e2c9f740 1 -- 172.21.15.53:0/952905062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x562ef493edd0 con 0x562ef4556390 2024-08-31T06:25:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.728+0000 7f40bdffb640 1 -- 172.21.15.53:0/952905062 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40cc036070 con 0x562ef4556390 2024-08-31T06:25:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.729+0000 7f40bdffb640 1 -- 172.21.15.53:0/952905062 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f40c4003a80 con 0x562ef4556390 2024-08-31T06:25:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.729+0000 7f40e2c9f740 10 client.21801 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.729+0000 7f40e2c9f740 10 client.21801 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:25:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.729+0000 7f40e2c9f740 20 client.21801 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.729+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562ef45359f0 0x562ef49422a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.729+0000 7f40e2c9f740 4 client.21801 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.729+0000 7f40e2c9f740 1 -- 172.21.15.53:0/952905062 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ef48955d0 con 0x562ef45359f0 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.730+0000 7f40da4c6640 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562ef45359f0 0x562ef49422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.730+0000 7f40bdffb640 10 client.21801 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.730+0000 7f40da4c6640 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562ef45359f0 0x562ef49422a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67a33dee7de63c2 server_cookie=1982a1a2b8797df0 in_seq=0 out_seq=0 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.731+0000 7f40bdffb640 1 -- 172.21.15.53:0/952905062 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ef48955d0 con 0x562ef45359f0 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.731+0000 7f40bdffb640 10 client.21801 handle_command_reply: tid=0 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.731+0000 7f40e2c9f740 1 client.21801 shutdown 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.731+0000 7f40e2c9f740 1 -- 172.21.15.53:0/952905062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef4556390 msgr2=0x562ef49307f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.731+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef4556390 0x562ef49307f0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f40c4012700 tx=0x7f40c4012bc0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.731+0000 7f40e2c9f740 1 -- 172.21.15.53:0/952905062 shutdown_connections 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.731+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562ef45359f0 0x562ef49422a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.731+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4577070 0x562ef493c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.731+0000 7f40bdffb640 0 client.21801 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:25:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.731+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef4556390 0x562ef49307f0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.731+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/952905062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef454e1b0 0x562ef49302b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.732+0000 7f40e2c9f740 1 -- 172.21.15.53:0/952905062 >> 172.21.15.53:0/952905062 conn(0x562ef456b460 msgr2=0x562ef49187c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.732+0000 7f40e2c9f740 1 -- 172.21.15.53:0/952905062 shutdown_connections 2024-08-31T06:25:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.732+0000 7f40e2c9f740 1 -- 172.21.15.53:0/952905062 wait complete. 2024-08-31T06:25:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.732+0000 7f40e2c9f740 20 client.21801 trim_cache size 0 max 16384 2024-08-31T06:25:47.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.757+0000 7f40e2c9f740 1 Processor -- start 2024-08-31T06:25:47.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.758+0000 7f40e2c9f740 1 -- start start 2024-08-31T06:25:47.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.758+0000 7f40e2c9f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4930770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.758+0000 7f40e2c9f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef493c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.759+0000 7f40e2c9f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef493c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.759+0000 7f40da4c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4930770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.759+0000 7f40da4c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4930770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:34380/0 (socket says 172.21.15.53:34380) 2024-08-31T06:25:47.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.759+0000 7f40d9cc5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef493c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.759+0000 7f40d9cc5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef493c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47686/0 (socket says 172.21.15.53:47686) 2024-08-31T06:25:47.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.759+0000 7f40e2c9f740 1 -- 172.21.15.53:0/1847171341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41ad420 con 0x562ef454e1b0 2024-08-31T06:25:47.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.759+0000 7f40da4c6640 1 -- 172.21.15.53:0/1847171341 learned_addr learned my addr 172.21.15.53:0/1847171341 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:47.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.759+0000 7f40e2c9f740 1 -- 172.21.15.53:0/1847171341 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41af170 con 0x562ef45359f0 2024-08-31T06:25:47.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.759+0000 7f40e2c9f740 1 -- 172.21.15.53:0/1847171341 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41adb80 con 0x562ef4556390 2024-08-31T06:25:47.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.759+0000 7f40dacc7640 1 --2- 172.21.15.53:0/1847171341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef493c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.760+0000 7f40da4c6640 1 -- 172.21.15.53:0/1847171341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 msgr2=0x562ef493c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.760+0000 7f40da4c6640 1 --2- 172.21.15.53:0/1847171341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef493c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.760+0000 7f40da4c6640 1 -- 172.21.15.53:0/1847171341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 msgr2=0x562ef493c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.760+0000 7f40da4c6640 1 --2- 172.21.15.53:0/1847171341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef493c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.760+0000 7f40da4c6640 1 -- 172.21.15.53:0/1847171341 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef492e7b0 con 0x562ef45359f0 2024-08-31T06:25:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.760+0000 7f40dacc7640 1 --2- 172.21.15.53:0/1847171341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef493c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.760+0000 7f40da4c6640 1 --2- 172.21.15.53:0/1847171341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4930770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f40d00abc10 tx=0x7f40d00ab940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3965853c0a86f584 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.760+0000 7f40bffff640 1 -- 172.21.15.53:0/1847171341 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00d2070 con 0x562ef45359f0 2024-08-31T06:25:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.760+0000 7f40bffff640 1 -- 172.21.15.53:0/1847171341 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40d0010a70 con 0x562ef45359f0 2024-08-31T06:25:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.760+0000 7f40bffff640 1 -- 172.21.15.53:0/1847171341 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00b0260 con 0x562ef45359f0 2024-08-31T06:25:47.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.762+0000 7f40e2c9f740 1 -- 172.21.15.53:0/1847171341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 msgr2=0x562ef4930770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:47.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.762+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/1847171341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4930770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f40d00abc10 tx=0x7f40d00ab940 comp rx=0 tx=0).stop 2024-08-31T06:25:47.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.762+0000 7f40e2c9f740 1 -- 172.21.15.53:0/1847171341 shutdown_connections 2024-08-31T06:25:47.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.762+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/1847171341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef493c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.762+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/1847171341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef493c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.762+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/1847171341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4930770 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.762+0000 7f40e2c9f740 1 -- 172.21.15.53:0/1847171341 >> 172.21.15.53:0/1847171341 conn(0x562ef456b460 msgr2=0x562ef4930060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:47.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.762+0000 7f40e2c9f740 1 -- 172.21.15.53:0/1847171341 shutdown_connections 2024-08-31T06:25:47.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.762+0000 7f40e2c9f740 1 -- 172.21.15.53:0/1847171341 wait complete. 2024-08-31T06:25:47.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.763+0000 7f40e2c9f740 1 -- start start 2024-08-31T06:25:47.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.763+0000 7f40e2c9f740 1 Processor -- start 2024-08-31T06:25:47.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40e2c9f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4938880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40e2c9f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef4933230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40da4c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4938880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40da4c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4938880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:34384/0 (socket says 172.21.15.53:34384) 2024-08-31T06:25:47.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40da4c6640 1 -- 172.21.15.53:0/3671517089 learned_addr learned my addr 172.21.15.53:0/3671517089 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:47.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef4933770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40e2c9f740 1 -- 172.21.15.53:0/3671517089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41ae9e0 con 0x562ef454e1b0 2024-08-31T06:25:47.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40e2c9f740 1 -- 172.21.15.53:0/3671517089 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41ae250 con 0x562ef45359f0 2024-08-31T06:25:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40e2c9f740 1 -- 172.21.15.53:0/3671517089 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41ab440 con 0x562ef4556390 2024-08-31T06:25:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40e2c9f740 10 client.0 _ll_register_callbacks cb 0x7f40c40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40d9cc5640 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef4933230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.764+0000 7f40dacc7640 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef4933770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.765+0000 7f40da4c6640 1 -- 172.21.15.53:0/3671517089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 msgr2=0x562ef4933770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.765+0000 7f40da4c6640 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef4933770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.765+0000 7f40da4c6640 1 -- 172.21.15.53:0/3671517089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 msgr2=0x562ef4933230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.765+0000 7f40da4c6640 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef4933230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.765+0000 7f40da4c6640 1 -- 172.21.15.53:0/3671517089 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef4933d30 con 0x562ef45359f0 2024-08-31T06:25:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.765+0000 7f40da4c6640 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4938880 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f40d000c6a0 tx=0x7f40d0010c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22c551a905d3bcd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.765+0000 7f40bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.765+0000 7f40bdffb640 1 -- 172.21.15.53:0/3671517089 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00c6060 con 0x562ef45359f0 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.765+0000 7f40bdffb640 1 -- 172.21.15.53:0/3671517089 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f40d0097200 con 0x562ef45359f0 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.765+0000 7f40e2c9f740 1 -- 172.21.15.53:0/3671517089 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d0010a70 con 0x562ef45359f0 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40bdffb640 1 -- 172.21.15.53:0/3671517089 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f40d00cd050 con 0x562ef45359f0 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40e2c9f740 10 client.30578 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40e2c9f740 1 -- 172.21.15.53:0/3671517089 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x562ef4922670 con 0x562ef45359f0 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40bdffb640 1 -- 172.21.15.53:0/3671517089 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40d0010a70 con 0x562ef45359f0 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40bdffb640 1 -- 172.21.15.53:0/3671517089 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f40d00b0260 con 0x562ef45359f0 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40e2c9f740 10 client.30578 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40e2c9f740 10 client.30578 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40e2c9f740 20 client.30578 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562ef4577070 0x562ef4924cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40e2c9f740 4 client.30578 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:25:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40e2c9f740 1 -- 172.21.15.53:0/3671517089 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ef4891070 con 0x562ef4577070 2024-08-31T06:25:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.766+0000 7f40d9cc5640 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562ef4577070 0x562ef4924cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.767+0000 7f40d9cc5640 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562ef4577070 0x562ef4924cd0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ccb9e6beced3d2b3 server_cookie=c1c4c3f43329d7c7 in_seq=0 out_seq=0 2024-08-31T06:25:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.767+0000 7f40bdffb640 10 client.30578 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:25:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.767+0000 7f40bdffb640 1 -- 172.21.15.53:0/3671517089 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ef4891070 con 0x562ef4577070 2024-08-31T06:25:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.767+0000 7f40bdffb640 10 client.30578 handle_command_reply: tid=0 2024-08-31T06:25:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40e2c9f740 1 client.30578 shutdown 2024-08-31T06:25:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40e2c9f740 1 -- 172.21.15.53:0/3671517089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 msgr2=0x562ef4938880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4938880 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f40d000c6a0 tx=0x7f40d0010c20 comp rx=0 tx=0).stop 2024-08-31T06:25:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40e2c9f740 1 -- 172.21.15.53:0/3671517089 shutdown_connections 2024-08-31T06:25:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562ef4577070 0x562ef4924cd0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562ef4556390 0x562ef4933770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ef454e1b0 0x562ef4933230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40e2c9f740 1 --2- 172.21.15.53:0/3671517089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562ef45359f0 0x562ef4938880 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40e2c9f740 1 -- 172.21.15.53:0/3671517089 >> 172.21.15.53:0/3671517089 conn(0x562ef456b460 msgr2=0x562ef4919a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40bdffb640 0 client.30578 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:25:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40e2c9f740 1 -- 172.21.15.53:0/3671517089 shutdown_connections 2024-08-31T06:25:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.768+0000 7f40e2c9f740 1 -- 172.21.15.53:0/3671517089 wait complete. 2024-08-31T06:25:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.769+0000 7f40e2c9f740 20 client.30578 trim_cache size 0 max 16384 2024-08-31T06:25:47.773 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:25:47.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.769+0000 7f40dc72a640 1 -- 172.21.15.53:0/2765704012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40c00b4df0 msgr2=0x7f40c00b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:47.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.769+0000 7f40dc72a640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40c00b4df0 0x7f40c00b7300 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f40cc035000 tx=0x7f40cc04a000 comp rx=0 tx=0).stop 2024-08-31T06:25:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.769+0000 7f40dc72a640 1 -- 172.21.15.53:0/2765704012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d4103910 msgr2=0x7f40d419c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.769+0000 7f40dc72a640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d4103910 0x7f40d419c330 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e9f0 tx=0x7f40d000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.769+0000 7f40dc72a640 1 -- 172.21.15.53:0/2765704012 shutdown_connections 2024-08-31T06:25:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.769+0000 7f40dc72a640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f40c00b4df0 0x7f40c00b7300 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.769+0000 7f40dc72a640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40d4109ba0 0x7f40d41a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.769+0000 7f40dc72a640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40d4109250 0x7f40d419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.769+0000 7f40dc72a640 1 --2- 172.21.15.53:0/2765704012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d4103910 0x7f40d419c330 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.769+0000 7f40dc72a640 1 -- 172.21.15.53:0/2765704012 >> 172.21.15.53:0/2765704012 conn(0x7f40d40ff380 msgr2=0x7f40d41088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.770+0000 7f40dc72a640 1 -- 172.21.15.53:0/2765704012 shutdown_connections 2024-08-31T06:25:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:47.770+0000 7f40dc72a640 1 -- 172.21.15.53:0/2765704012 wait complete. 2024-08-31T06:25:47.781 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:47.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:47 smithi053 ceph-mon[18924]: pgmap v978: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 321 op/s 2024-08-31T06:25:48.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:47 smithi130 ceph-mon[22266]: pgmap v978: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 321 op/s 2024-08-31T06:25:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:47 smithi153 ceph-mon[22320]: pgmap v978: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 321 op/s 2024-08-31T06:25:48.385 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49823 5.70 MB/sec execute 336 sec latency 81.798 ms 2024-08-31T06:25:48.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.086+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/1101518926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0103940 msgr2=0x7f7ea0103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.086+0000 7f7ea4fa4640 1 --2- 172.21.15.53:0/1101518926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0103940 0x7f7ea0103d50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009900 tx=0x7f7e9002a410 comp rx=0 tx=0).stop 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.086+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/1101518926 shutdown_connections 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.086+0000 7f7ea4fa4640 1 --2- 172.21.15.53:0/1101518926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0109bd0 0x7f7ea0110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.086+0000 7f7ea4fa4640 1 --2- 172.21.15.53:0/1101518926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0109280 0x7f7ea0109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.086+0000 7f7ea4fa4640 1 --2- 172.21.15.53:0/1101518926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0103940 0x7f7ea0103d50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.086+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/1101518926 >> 172.21.15.53:0/1101518926 conn(0x7f7ea00ff390 msgr2=0x7f7ea01017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.086+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/1101518926 shutdown_connections 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.086+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/1101518926 wait complete. 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7ea4fa4640 1 Processor -- start 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7ea4fa4640 1 -- start start 2024-08-31T06:25:49.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7ea4fa4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0103940 0x7f7ea019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7ea4fa4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0109280 0x7f7ea019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7ea4fa4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0109bd0 0x7f7ea019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7ea4fa4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea0113740 con 0x7f7ea0109bd0 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7ea4fa4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01135c0 con 0x7f7ea0109280 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7ea4fa4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01138c0 con 0x7f7ea0103940 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7e9e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0103940 0x7f7ea019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7e9ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0109bd0 0x7f7ea019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7e9e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0103940 0x7f7ea019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:59474/0 (socket says 172.21.15.53:59474) 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7e9ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0109bd0 0x7f7ea019f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47706/0 (socket says 172.21.15.53:47706) 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7e9e59c640 1 -- 172.21.15.53:0/3687961708 learned_addr learned my addr 172.21.15.53:0/3687961708 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.088+0000 7f7e9dd9b640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0109280 0x7f7ea019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.089+0000 7f7e9e59c640 1 -- 172.21.15.53:0/3687961708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0109280 msgr2=0x7f7ea019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.089+0000 7f7e9e59c640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0109280 0x7f7ea019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.089+0000 7f7e9e59c640 1 -- 172.21.15.53:0/3687961708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0109bd0 msgr2=0x7f7ea019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.089+0000 7f7e9e59c640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0109bd0 0x7f7ea019f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.089+0000 7f7e9e59c640 1 -- 172.21.15.53:0/3687961708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea01a0100 con 0x7f7ea0103940 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.089+0000 7f7e9e59c640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0103940 0x7f7ea019a190 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009230 tx=0x7f7e900319a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.089+0000 7f7e8f7fe640 1 -- 172.21.15.53:0/3687961708 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9003f030 con 0x7f7ea0103940 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.089+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/3687961708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea01a0390 con 0x7f7ea0103940 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.090+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/3687961708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea0075390 con 0x7f7ea0103940 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.090+0000 7f7e8f7fe640 1 -- 172.21.15.53:0/3687961708 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e900043d0 con 0x7f7ea0103940 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.090+0000 7f7e8f7fe640 1 -- 172.21.15.53:0/3687961708 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e90035070 con 0x7f7ea0103940 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.093+0000 7f7eab519740 1 Processor -- start 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.093+0000 7f7eab519740 1 -- start start 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7eab519740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1f1840 0x56462d598c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7eab519740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1c8980 0x56462d5991d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7eab519740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1d0b60 0x56462d599710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7eab519740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56462d50d330 con 0x56462d1d0b60 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7eab519740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56462d4fc8c0 con 0x56462d1c8980 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7eab519740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56462d500870 con 0x56462d1f1840 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7e9ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1f1840 0x56462d598c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7e9ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1f1840 0x56462d598c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:59484/0 (socket says 172.21.15.53:59484) 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7e9ed9d640 1 -- 172.21.15.53:0/2120637643 learned_addr learned my addr 172.21.15.53:0/2120637643 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7e9dd9b640 1 --2- 172.21.15.53:0/2120637643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1d0b60 0x56462d599710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7e9ed9d640 1 -- 172.21.15.53:0/2120637643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1c8980 msgr2=0x56462d5991d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/2120637643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1c8980 0x56462d5991d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7e9ed9d640 1 -- 172.21.15.53:0/2120637643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1d0b60 msgr2=0x56462d599710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/2120637643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1d0b60 0x56462d599710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.094+0000 7f7e9ed9d640 1 -- 172.21.15.53:0/2120637643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56462d4b4df0 con 0x56462d1f1840 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.095+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/2120637643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1f1840 0x56462d598c90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7e98011440 tx=0x7f7e98011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6ab6a6164ff1b30 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.095+0000 7f7e8f7fe640 1 -- 172.21.15.53:0/3687961708 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7e90042030 con 0x7f7ea0103940 2024-08-31T06:25:49.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.095+0000 7f7e8cff9640 1 -- 172.21.15.53:0/2120637643 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98003c30 con 0x56462d1f1840 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.095+0000 7f7e8cff9640 1 -- 172.21.15.53:0/2120637643 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e98003dd0 con 0x56462d1f1840 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.095+0000 7f7e8cff9640 1 -- 172.21.15.53:0/2120637643 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9800fa10 con 0x56462d1f1840 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.096+0000 7f7e8f7fe640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e880b4d20 0x7f7e880b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.096+0000 7f7eab519740 1 -- 172.21.15.53:0/2120637643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1f1840 msgr2=0x56462d598c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.096+0000 7f7eab519740 1 --2- 172.21.15.53:0/2120637643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1f1840 0x56462d598c90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7e98011440 tx=0x7f7e98011900 comp rx=0 tx=0).stop 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.096+0000 7f7e8f7fe640 1 -- 172.21.15.53:0/3687961708 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f7e901058d0 con 0x7f7ea0103940 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.096+0000 7f7eab519740 1 -- 172.21.15.53:0/2120637643 shutdown_connections 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.096+0000 7f7eab519740 1 --2- 172.21.15.53:0/2120637643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1d0b60 0x56462d599710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.096+0000 7f7eab519740 1 --2- 172.21.15.53:0/2120637643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1c8980 0x56462d5991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.096+0000 7f7eab519740 1 --2- 172.21.15.53:0/2120637643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1f1840 0x56462d598c90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.096+0000 7f7eab519740 1 -- 172.21.15.53:0/2120637643 >> 172.21.15.53:0/2120637643 conn(0x56462d1e5990 msgr2=0x56462d596b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.096+0000 7f7e9e59c640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e880b4d20 0x7f7e880b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.097+0000 7f7eab519740 1 -- 172.21.15.53:0/2120637643 shutdown_connections 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.097+0000 7f7eab519740 1 -- 172.21.15.53:0/2120637643 wait complete. 2024-08-31T06:25:49.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.097+0000 7f7e9e59c640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e880b4d20 0x7f7e880b7230 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x56462d597910 tx=0x7f7e900b3040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.097+0000 7f7eab519740 1 -- start start 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.097+0000 7f7eab519740 1 Processor -- start 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.098+0000 7f7eab519740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1c8980 0x56462d5a4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.098+0000 7f7eab519740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5a4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.098+0000 7f7eab519740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1f1840 0x56462d5b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.098+0000 7f7eab519740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56462d35f7a0 con 0x56462d1f1840 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.098+0000 7f7eab519740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56462d483240 con 0x56462d1d0b60 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.098+0000 7f7eab519740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56462d5a7470 con 0x56462d1c8980 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.098+0000 7f7eab519740 10 client.0 _ll_register_callbacks cb 0x56462d209090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.098+0000 7f7e9dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.098+0000 7f7e9dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5a4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:34412/0 (socket says 172.21.15.53:34412) 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.098+0000 7f7e9dd9b640 1 -- 172.21.15.53:0/1974517460 learned_addr learned my addr 172.21.15.53:0/1974517460 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.098+0000 7f7e9dd9b640 1 -- 172.21.15.53:0/1974517460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1c8980 msgr2=0x56462d5a4440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.099+0000 7f7e9dd9b640 1 --2- 172.21.15.53:0/1974517460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1c8980 0x56462d5a4440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.099+0000 7f7e9dd9b640 1 -- 172.21.15.53:0/1974517460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1f1840 msgr2=0x56462d5b0760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.099+0000 7f7e9dd9b640 1 --2- 172.21.15.53:0/1974517460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1f1840 0x56462d5b0760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.099+0000 7f7e9dd9b640 1 -- 172.21.15.53:0/1974517460 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56462d4b92b0 con 0x56462d1d0b60 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.099+0000 7f7e9dd9b640 1 --2- 172.21.15.53:0/1974517460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5a4980 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7e94012700 tx=0x7f7e94012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2483d94f8651283c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.099+0000 7f7e85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.099+0000 7f7e85ffb640 1 -- 172.21.15.53:0/1974517460 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400f920 con 0x56462d1d0b60 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.099+0000 7f7eab519740 1 -- 172.21.15.53:0/1974517460 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e98003dd0 con 0x56462d1d0b60 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.099+0000 7f7e85ffb640 1 -- 172.21.15.53:0/1974517460 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f7e9400fac0 con 0x56462d1d0b60 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.099+0000 7f7e85ffb640 1 -- 172.21.15.53:0/1974517460 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f7e9400fcc0 con 0x56462d1d0b60 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.100+0000 7f7eab519740 10 client.30587 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.100+0000 7f7eab519740 1 -- 172.21.15.53:0/1974517460 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x56462d26bb90 con 0x56462d1d0b60 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.100+0000 7f7e85ffb640 1 -- 172.21.15.53:0/1974517460 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e98003dd0 con 0x56462d1d0b60 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.101+0000 7f7e85ffb640 1 -- 172.21.15.53:0/1974517460 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f7e94024420 con 0x56462d1d0b60 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.101+0000 7f7eab519740 10 client.30587 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.101+0000 7f7eab519740 10 client.30587 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.101+0000 7f7eab519740 20 client.30587 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.101+0000 7f7eab519740 1 --2- 172.21.15.53:0/1974517460 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56462d1b01c0 0x56462d5b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.101+0000 7f7eab519740 4 client.30587 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.101+0000 7f7eab519740 1 -- 172.21.15.53:0/1974517460 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56462d50f280 con 0x56462d1b01c0 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.101+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/1974517460 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56462d1b01c0 0x56462d5b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.101+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/1974517460 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56462d1b01c0 0x56462d5b6800 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eebc589963e1fdb server_cookie=88e9c771b4a5134a in_seq=0 out_seq=0 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.101+0000 7f7e85ffb640 10 client.30587 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.102+0000 7f7e85ffb640 1 -- 172.21.15.53:0/1974517460 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56462d50f280 con 0x56462d1b01c0 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.102+0000 7f7e85ffb640 10 client.30587 handle_command_reply: tid=0 2024-08-31T06:25:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.102+0000 7f7eab519740 1 client.30587 shutdown 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.102+0000 7f7eab519740 1 -- 172.21.15.53:0/1974517460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 msgr2=0x56462d5a4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.102+0000 7f7eab519740 1 --2- 172.21.15.53:0/1974517460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5a4980 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7e94012700 tx=0x7f7e94012bc0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.103+0000 7f7eab519740 1 -- 172.21.15.53:0/1974517460 shutdown_connections 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.103+0000 7f7eab519740 1 --2- 172.21.15.53:0/1974517460 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56462d1b01c0 0x56462d5b6800 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.103+0000 7f7eab519740 1 --2- 172.21.15.53:0/1974517460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1f1840 0x56462d5b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.103+0000 7f7e85ffb640 0 client.30587 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.103+0000 7f7eab519740 1 --2- 172.21.15.53:0/1974517460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5a4980 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.103+0000 7f7eab519740 1 --2- 172.21.15.53:0/1974517460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1c8980 0x56462d5a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.103+0000 7f7eab519740 1 -- 172.21.15.53:0/1974517460 >> 172.21.15.53:0/1974517460 conn(0x56462d1e5990 msgr2=0x56462d595340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.103+0000 7f7eab519740 1 -- 172.21.15.53:0/1974517460 shutdown_connections 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.103+0000 7f7eab519740 1 -- 172.21.15.53:0/1974517460 wait complete. 2024-08-31T06:25:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.103+0000 7f7eab519740 20 client.30587 trim_cache size 0 max 16384 2024-08-31T06:25:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7eab519740 1 Processor -- start 2024-08-31T06:25:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7eab519740 1 -- start start 2024-08-31T06:25:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7eab519740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1b01c0 0x56462d5a4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7eab519740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1c8980 0x56462d5b0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7eab519740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7eab519740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01b1740 con 0x56462d1c8980 2024-08-31T06:25:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7eab519740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01b3490 con 0x56462d1d0b60 2024-08-31T06:25:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7eab519740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01b1ea0 con 0x56462d1b01c0 2024-08-31T06:25:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7e9ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1b01c0 0x56462d5a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7e9ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1b01c0 0x56462d5a4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:59504/0 (socket says 172.21.15.53:59504) 2024-08-31T06:25:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7e9ed9d640 1 -- 172.21.15.53:0/1594658512 learned_addr learned my addr 172.21.15.53:0/1594658512 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/1594658512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.132+0000 7f7e9dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1c8980 0x56462d5b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.133+0000 7f7e9ed9d640 1 -- 172.21.15.53:0/1594658512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 msgr2=0x56462d5b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.133+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/1594658512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.133+0000 7f7e9ed9d640 1 -- 172.21.15.53:0/1594658512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1c8980 msgr2=0x56462d5b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.133+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/1594658512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1c8980 0x56462d5b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.133+0000 7f7e9ed9d640 1 -- 172.21.15.53:0/1594658512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56462d59fcd0 con 0x56462d1b01c0 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.133+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/1594658512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1b01c0 0x56462d5a4860 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7e98011940 tx=0x7f7e98000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=141a2be6b4083c0c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.133+0000 7f7e87fff640 1 -- 172.21.15.53:0/1594658512 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98003b50 con 0x56462d1b01c0 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.134+0000 7f7e87fff640 1 -- 172.21.15.53:0/1594658512 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e98003cf0 con 0x56462d1b01c0 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.134+0000 7f7e87fff640 1 -- 172.21.15.53:0/1594658512 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e980052a0 con 0x56462d1b01c0 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.135+0000 7f7eab519740 1 -- 172.21.15.53:0/1594658512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1b01c0 msgr2=0x56462d5a4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.135+0000 7f7eab519740 1 --2- 172.21.15.53:0/1594658512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1b01c0 0x56462d5a4860 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7e98011940 tx=0x7f7e98000f40 comp rx=0 tx=0).stop 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.135+0000 7f7eab519740 1 -- 172.21.15.53:0/1594658512 shutdown_connections 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.135+0000 7f7eab519740 1 --2- 172.21.15.53:0/1594658512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.135+0000 7f7eab519740 1 --2- 172.21.15.53:0/1594658512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1c8980 0x56462d5b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.135+0000 7f7eab519740 1 --2- 172.21.15.53:0/1594658512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1b01c0 0x56462d5a4860 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.135+0000 7f7eab519740 1 -- 172.21.15.53:0/1594658512 >> 172.21.15.53:0/1594658512 conn(0x56462d1e5990 msgr2=0x56462d59a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.135+0000 7f7eab519740 1 -- 172.21.15.53:0/1594658512 shutdown_connections 2024-08-31T06:25:49.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.135+0000 7f7eab519740 1 -- 172.21.15.53:0/1594658512 wait complete. 2024-08-31T06:25:49.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.135+0000 7f7eab519740 1 -- start start 2024-08-31T06:25:49.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7eab519740 1 Processor -- start 2024-08-31T06:25:49.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7eab519740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1b01c0 0x56462d5acf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7eab519740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1c8980 0x56462d5a7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7eab519740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7eab519740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01b2d00 con 0x56462d1b01c0 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7eab519740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01b2570 con 0x56462d1d0b60 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7eab519740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01af740 con 0x56462d1c8980 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7eab519740 10 client.0 _ll_register_callbacks cb 0x7f7e94009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7e9dd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1c8980 0x56462d5a7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7e9ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1b01c0 0x56462d5acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7e9dd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1c8980 0x56462d5a7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:59520/0 (socket says 172.21.15.53:59520) 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.136+0000 7f7e9dd9b640 1 -- 172.21.15.53:0/3138708437 learned_addr learned my addr 172.21.15.53:0/3138708437 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.137+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.137+0000 7f7e9dd9b640 1 -- 172.21.15.53:0/3138708437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 msgr2=0x56462d5a7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.137+0000 7f7e9dd9b640 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5a7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.137+0000 7f7e9dd9b640 1 -- 172.21.15.53:0/3138708437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1b01c0 msgr2=0x56462d5acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.137+0000 7f7e9dd9b640 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1b01c0 0x56462d5acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.137+0000 7f7e9dd9b640 1 -- 172.21.15.53:0/3138708437 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56462d4ccd90 con 0x56462d1c8980 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.137+0000 7f7e9dd9b640 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1c8980 0x56462d5a7680 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400f890 tx=0x7f7e94024650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5abcbf2b5063e8bf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.137+0000 7f7e85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.137+0000 7f7e85ffb640 1 -- 172.21.15.53:0/3138708437 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400fe60 con 0x56462d1c8980 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.137+0000 7f7e85ffb640 1 -- 172.21.15.53:0/3138708437 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f7e94005300 con 0x56462d1c8980 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.137+0000 7f7eab519740 1 -- 172.21.15.53:0/3138708437 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e98003cf0 con 0x56462d1c8980 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7e85ffb640 1 -- 172.21.15.53:0/3138708437 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f7e94005500 con 0x56462d1c8980 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7eab519740 10 client.30583 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:49.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7eab519740 1 -- 172.21.15.53:0/3138708437 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x56462d62a780 con 0x56462d1c8980 2024-08-31T06:25:49.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7e85ffb640 1 -- 172.21.15.53:0/3138708437 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e940056a0 con 0x56462d1c8980 2024-08-31T06:25:49.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7e85ffb640 1 -- 172.21.15.53:0/3138708437 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f7e9402b020 con 0x56462d1c8980 2024-08-31T06:25:49.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7eab519740 10 client.30583 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:49.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7eab519740 10 client.30583 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:25:49.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7eab519740 20 client.30583 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:49.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7eab519740 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56462d1f1840 0x56462d62cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:49.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7eab519740 4 client.30583 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.1, "await_for": 45.0}] 2024-08-31T06:25:49.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7eab519740 1 -- 172.21.15.53:0/3138708437 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.1, "await_for": 45.0}) -- 0x7f7e98003cf0 con 0x56462d1f1840 2024-08-31T06:25:49.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.138+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56462d1f1840 0x56462d62cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:49.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.139+0000 7f7e85ffb640 10 client.30583 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:49.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.139+0000 7f7e9ed9d640 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56462d1f1840 0x56462d62cfb0 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16b616b83e4353c8 server_cookie=eea24c2107e2ab74 in_seq=0 out_seq=0 2024-08-31T06:25:49.250 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:49.385 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49927 5.69 MB/sec execute 337 sec latency 276.710 ms 2024-08-31T06:25:49.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.532+0000 7f7e85ffb640 1 -- 172.21.15.53:0/3138708437 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f7e98003cf0 con 0x56462d1f1840 2024-08-31T06:25:49.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.532+0000 7f7e85ffb640 10 client.30583 handle_command_reply: tid=0 2024-08-31T06:25:49.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.532+0000 7f7eab519740 1 client.30583 shutdown 2024-08-31T06:25:49.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.532+0000 7f7eab519740 1 -- 172.21.15.53:0/3138708437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1c8980 msgr2=0x56462d5a7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:49.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.532+0000 7f7eab519740 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1c8980 0x56462d5a7680 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400f890 tx=0x7f7e94024650 comp rx=0 tx=0).stop 2024-08-31T06:25:49.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.533+0000 7f7eab519740 1 -- 172.21.15.53:0/3138708437 shutdown_connections 2024-08-31T06:25:49.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.533+0000 7f7eab519740 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56462d1f1840 0x56462d62cfb0 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.533+0000 7f7eab519740 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56462d1d0b60 0x56462d5a7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.533+0000 7f7eab519740 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56462d1c8980 0x56462d5a7680 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.533+0000 7f7e85ffb640 0 client.30583 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:49.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.533+0000 7f7eab519740 1 --2- 172.21.15.53:0/3138708437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56462d1b01c0 0x56462d5acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.533+0000 7f7eab519740 1 -- 172.21.15.53:0/3138708437 >> 172.21.15.53:0/3138708437 conn(0x56462d1e5990 msgr2=0x56462d59a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:49.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.533+0000 7f7eab519740 1 -- 172.21.15.53:0/3138708437 shutdown_connections 2024-08-31T06:25:49.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.533+0000 7f7eab519740 1 -- 172.21.15.53:0/3138708437 wait complete. 2024-08-31T06:25:49.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.533+0000 7f7eab519740 20 client.30583 trim_cache size 0 max 16384 2024-08-31T06:25:49.536 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 75, 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 66, 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: "52882e46": { 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 66, 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:49.537 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 134.1, 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:25:49.538 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:25:49.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/3687961708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e880b4d20 msgr2=0x7f7e880b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:49.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e880b4d20 0x7f7e880b7230 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x56462d597910 tx=0x7f7e900b3040 comp rx=0 tx=0).stop 2024-08-31T06:25:49.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/3687961708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0103940 msgr2=0x7f7ea019a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:49.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0103940 0x7f7ea019a190 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009230 tx=0x7f7e900319a0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/3687961708 shutdown_connections 2024-08-31T06:25:49.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e880b4d20 0x7f7e880b7230 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea0109bd0 0x7f7ea019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ea0109280 0x7f7ea019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 --2- 172.21.15.53:0/3687961708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ea0103940 0x7f7ea019a190 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:49.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/3687961708 >> 172.21.15.53:0/3687961708 conn(0x7f7ea00ff390 msgr2=0x7f7ea01017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:49.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/3687961708 shutdown_connections 2024-08-31T06:25:49.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:49.534+0000 7f7ea4fa4640 1 -- 172.21.15.53:0/3687961708 wait complete. 2024-08-31T06:25:50.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:49 smithi130 ceph-mon[22266]: pgmap v979: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 308 op/s 2024-08-31T06:25:50.146 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:49 smithi053 ceph-mon[18924]: pgmap v979: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 308 op/s 2024-08-31T06:25:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:49 smithi153 ceph-mon[22320]: pgmap v979: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 308 op/s 2024-08-31T06:25:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.237+0000 7fed9e06d640 1 -- 172.21.15.53:0/637177386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed98105030 msgr2=0x7fed9810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.237+0000 7fed9e06d640 1 --2- 172.21.15.53:0/637177386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed98105030 0x7fed9810d670 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fed80009900 tx=0x7fed8002a410 comp rx=0 tx=0).stop 2024-08-31T06:25:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.237+0000 7fed9e06d640 1 -- 172.21.15.53:0/637177386 shutdown_connections 2024-08-31T06:25:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.237+0000 7fed9e06d640 1 --2- 172.21.15.53:0/637177386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed9810dbb0 0x7fed981100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.237+0000 7fed9e06d640 1 --2- 172.21.15.53:0/637177386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed98105030 0x7fed9810d670 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.237+0000 7fed9e06d640 1 --2- 172.21.15.53:0/637177386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed98104600 0x7fed98104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.237+0000 7fed9e06d640 1 -- 172.21.15.53:0/637177386 >> 172.21.15.53:0/637177386 conn(0x7fed980794e0 msgr2=0x7fed980798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.237+0000 7fed9e06d640 1 -- 172.21.15.53:0/637177386 shutdown_connections 2024-08-31T06:25:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.237+0000 7fed9e06d640 1 -- 172.21.15.53:0/637177386 wait complete. 2024-08-31T06:25:50.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.237+0000 7fed9e06d640 1 Processor -- start 2024-08-31T06:25:50.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.237+0000 7fed9e06d640 1 -- start start 2024-08-31T06:25:50.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed9e06d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed98104600 0x7fed9819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed9e06d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed98105030 0x7fed9819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed9e06d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed9810dbb0 0x7fed9819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed9e06d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fed981136a0 con 0x7fed98105030 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed9e06d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed98113520 con 0x7fed9810dbb0 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed9e06d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed98113820 con 0x7fed98104600 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed8effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed98105030 0x7fed9819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed8effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed98105030 0x7fed9819a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47740/0 (socket says 172.21.15.53:47740) 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed8effd640 1 -- 172.21.15.53:0/1524368126 learned_addr learned my addr 172.21.15.53:0/1524368126 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed977fe640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed98104600 0x7fed9819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed97fff640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed9810dbb0 0x7fed9819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed8effd640 1 -- 172.21.15.53:0/1524368126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed98104600 msgr2=0x7fed9819a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed8effd640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed98104600 0x7fed9819a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed8effd640 1 -- 172.21.15.53:0/1524368126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed9810dbb0 msgr2=0x7fed9819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed8effd640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed9810dbb0 0x7fed9819f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed8effd640 1 -- 172.21.15.53:0/1524368126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed981a00c0 con 0x7fed98105030 2024-08-31T06:25:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.238+0000 7fed977fe640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed98104600 0x7fed9819a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:25:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.239+0000 7fed8effd640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed98105030 0x7fed9819a6f0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fed80004770 tx=0x7fed80004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.239+0000 7fed957fa640 1 -- 172.21.15.53:0/1524368126 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8003f030 con 0x7fed98105030 2024-08-31T06:25:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.239+0000 7fed9e06d640 1 -- 172.21.15.53:0/1524368126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed981a0350 con 0x7fed98105030 2024-08-31T06:25:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.239+0000 7fed9e06d640 1 -- 172.21.15.53:0/1524368126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed981a6b10 con 0x7fed98105030 2024-08-31T06:25:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.239+0000 7fed957fa640 1 -- 172.21.15.53:0/1524368126 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed80004440 con 0x7fed98105030 2024-08-31T06:25:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.239+0000 7fed957fa640 1 -- 172.21.15.53:0/1524368126 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed80049060 con 0x7fed98105030 2024-08-31T06:25:50.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.242+0000 7feda45e2740 1 Processor -- start 2024-08-31T06:25:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.242+0000 7feda45e2740 1 -- start start 2024-08-31T06:25:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.242+0000 7feda45e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 0x55b950503350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.242+0000 7feda45e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b950503890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.242+0000 7feda45e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b950503dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.242+0000 7feda45e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b95047a680 con 0x55b9501351b0 2024-08-31T06:25:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.242+0000 7feda45e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b950469c10 con 0x55b95015e070 2024-08-31T06:25:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.242+0000 7feda45e2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b95046dbc0 con 0x55b95013d390 2024-08-31T06:25:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed957fa640 1 -- 172.21.15.53:0/1524368126 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fed80042030 con 0x7fed98105030 2024-08-31T06:25:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b950503890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b950503890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47746/0 (socket says 172.21.15.53:47746) 2024-08-31T06:25:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed977fe640 1 -- 172.21.15.53:0/1459032475 learned_addr learned my addr 172.21.15.53:0/1459032475 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed97fff640 1 --2- 172.21.15.53:0/1459032475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 0x55b950503350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed8effd640 1 --2- 172.21.15.53:0/1459032475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b950503dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed97fff640 1 -- 172.21.15.53:0/1459032475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 msgr2=0x55b950503dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed97fff640 1 --2- 172.21.15.53:0/1459032475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b950503dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed97fff640 1 -- 172.21.15.53:0/1459032475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 msgr2=0x55b950503890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed97fff640 1 --2- 172.21.15.53:0/1459032475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b950503890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed97fff640 1 -- 172.21.15.53:0/1459032475 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9501c9650 con 0x55b95015e070 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed977fe640 1 --2- 172.21.15.53:0/1459032475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b950503890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed97fff640 1 --2- 172.21.15.53:0/1459032475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 0x55b950503350 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fed90009f00 tx=0x7fed90011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580bec2c0d4e29a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.243+0000 7fed957fa640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed840b4ca0 0x7fed840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7fed8dffb640 1 -- 172.21.15.53:0/1459032475 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90004d20 con 0x55b95015e070 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7fed977fe640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed840b4ca0 0x7fed840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7fed8dffb640 1 -- 172.21.15.53:0/1459032475 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed90004030 con 0x55b95015e070 2024-08-31T06:25:50.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7fed8dffb640 1 -- 172.21.15.53:0/1459032475 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90005280 con 0x55b95015e070 2024-08-31T06:25:50.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7fed957fa640 1 -- 172.21.15.53:0/1524368126 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7fed80105490 con 0x7fed98105030 2024-08-31T06:25:50.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7feda45e2740 1 -- 172.21.15.53:0/1459032475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 msgr2=0x55b950503350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:50.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7feda45e2740 1 --2- 172.21.15.53:0/1459032475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 0x55b950503350 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fed90009f00 tx=0x7fed90011810 comp rx=0 tx=0).stop 2024-08-31T06:25:50.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7fed977fe640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed840b4ca0 0x7fed840b71b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55b950501fd0 tx=0x7fed8800b620 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:50.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7feda45e2740 1 -- 172.21.15.53:0/1459032475 shutdown_connections 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7feda45e2740 1 --2- 172.21.15.53:0/1459032475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b950503dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7feda45e2740 1 --2- 172.21.15.53:0/1459032475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b950503890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7feda45e2740 1 --2- 172.21.15.53:0/1459032475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 0x55b950503350 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.244+0000 7feda45e2740 1 -- 172.21.15.53:0/1459032475 >> 172.21.15.53:0/1459032475 conn(0x55b950152460 msgr2=0x55b950501240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.245+0000 7feda45e2740 1 -- 172.21.15.53:0/1459032475 shutdown_connections 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.245+0000 7feda45e2740 1 -- 172.21.15.53:0/1459032475 wait complete. 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.245+0000 7feda45e2740 1 -- start start 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.245+0000 7feda45e2740 1 Processor -- start 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.245+0000 7feda45e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9501351b0 0x55b95050ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7feda45e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b95050efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7feda45e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b95051aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7feda45e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b9502cc700 con 0x55b95015e070 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7feda45e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b9503f0750 con 0x55b9501351b0 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7feda45e2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b950511b30 con 0x55b95013d390 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7feda45e2740 10 client.0 _ll_register_callbacks cb 0x55b95041fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed97fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b95051aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed8effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b95050efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed97fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b95051aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47760/0 (socket says 172.21.15.53:47760) 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed8effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b95050efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:59548/0 (socket says 172.21.15.53:59548) 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed97fff640 1 -- 172.21.15.53:0/3981823632 learned_addr learned my addr 172.21.15.53:0/3981823632 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed977fe640 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9501351b0 0x55b95050ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed8effd640 1 -- 172.21.15.53:0/3981823632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9501351b0 msgr2=0x55b95050ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed8effd640 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9501351b0 0x55b95050ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed8effd640 1 -- 172.21.15.53:0/3981823632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 msgr2=0x55b95051aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:50.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed8effd640 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b95051aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed8effd640 1 -- 172.21.15.53:0/3981823632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b950429900 con 0x55b95013d390 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed97fff640 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b95051aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed8effd640 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b95050efb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fed80102bc0 tx=0x7fed80009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57fc55150e7bb7eb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed76ffd640 1 -- 172.21.15.53:0/3981823632 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed80035040 con 0x55b95013d390 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7fed76ffd640 1 -- 172.21.15.53:0/3981823632 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7fed800cbdc0 con 0x55b95013d390 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.246+0000 7feda45e2740 1 -- 172.21.15.53:0/3981823632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed90004030 con 0x55b95013d390 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7fed76ffd640 1 -- 172.21.15.53:0/3981823632 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fed800cb4b0 con 0x55b95013d390 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7feda45e2740 10 client.30595 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7feda45e2740 1 -- 172.21.15.53:0/3981823632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55b95051d8d0 con 0x55b95013d390 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7fed76ffd640 1 -- 172.21.15.53:0/3981823632 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed90004030 con 0x55b95013d390 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7fed76ffd640 1 -- 172.21.15.53:0/3981823632 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7fed8004c060 con 0x55b95013d390 2024-08-31T06:25:50.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7feda45e2740 10 client.30595 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7feda45e2740 10 client.30595 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7feda45e2740 20 client.30595 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7feda45e2740 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b95011c9f0 0x55b950520e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7feda45e2740 4 client.30595 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7feda45e2740 1 -- 172.21.15.53:0/3981823632 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b95047c5d0 con 0x55b95011c9f0 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.247+0000 7fed977fe640 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b95011c9f0 0x55b950520e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.248+0000 7fed76ffd640 10 client.30595 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.248+0000 7fed977fe640 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b95011c9f0 0x55b950520e80 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae8d8ee7650e85a8 server_cookie=e6fa96607f669875 in_seq=0 out_seq=0 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.248+0000 7fed76ffd640 1 -- 172.21.15.53:0/3981823632 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b95047c5d0 con 0x55b95011c9f0 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.248+0000 7fed76ffd640 10 client.30595 handle_command_reply: tid=0 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 1 client.30595 shutdown 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 1 -- 172.21.15.53:0/3981823632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 msgr2=0x55b95050efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b95050efb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fed80102bc0 tx=0x7fed80009620 comp rx=0 tx=0).stop 2024-08-31T06:25:50.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 1 -- 172.21.15.53:0/3981823632 shutdown_connections 2024-08-31T06:25:50.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b95011c9f0 0x55b950520e80 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b95051aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7fed76ffd640 0 client.30595 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:25:50.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b95050efb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 1 --2- 172.21.15.53:0/3981823632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9501351b0 0x55b95050ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 1 -- 172.21.15.53:0/3981823632 >> 172.21.15.53:0/3981823632 conn(0x55b950152460 msgr2=0x55b9505064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:50.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 1 -- 172.21.15.53:0/3981823632 shutdown_connections 2024-08-31T06:25:50.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 1 -- 172.21.15.53:0/3981823632 wait complete. 2024-08-31T06:25:50.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.249+0000 7feda45e2740 20 client.30595 trim_cache size 0 max 16384 2024-08-31T06:25:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.262+0000 7feda45e2740 1 Processor -- start 2024-08-31T06:25:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7feda45e2740 1 -- start start 2024-08-31T06:25:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7feda45e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9501351b0 0x55b950506b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7feda45e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b95051adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7feda45e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b950500b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7feda45e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fed7800e790 con 0x55b95015e070 2024-08-31T06:25:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7feda45e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed780104e0 con 0x55b9501351b0 2024-08-31T06:25:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7feda45e2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed7800eef0 con 0x55b95013d390 2024-08-31T06:25:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed97fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b950500b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed97fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b950500b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47776/0 (socket says 172.21.15.53:47776) 2024-08-31T06:25:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed97fff640 1 -- 172.21.15.53:0/3618141046 learned_addr learned my addr 172.21.15.53:0/3618141046 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed977fe640 1 --2- 172.21.15.53:0/3618141046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9501351b0 0x55b950506b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed8effd640 1 --2- 172.21.15.53:0/3618141046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b95051adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed97fff640 1 -- 172.21.15.53:0/3618141046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 msgr2=0x55b95051adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed97fff640 1 --2- 172.21.15.53:0/3618141046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b95051adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed97fff640 1 -- 172.21.15.53:0/3618141046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9501351b0 msgr2=0x55b950506b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed97fff640 1 --2- 172.21.15.53:0/3618141046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9501351b0 0x55b950506b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed97fff640 1 -- 172.21.15.53:0/3618141046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b95050fd30 con 0x55b95015e070 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed8effd640 1 --2- 172.21.15.53:0/3618141046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b95051adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.263+0000 7fed97fff640 1 --2- 172.21.15.53:0/3618141046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b950500b60 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fed90005bf0 tx=0x7fed90005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d707a6b69289014f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.264+0000 7fed8d7fa640 1 -- 172.21.15.53:0/3618141046 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90028030 con 0x55b95015e070 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.264+0000 7fed8d7fa640 1 -- 172.21.15.53:0/3618141046 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed90004d50 con 0x55b95015e070 2024-08-31T06:25:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.264+0000 7fed8d7fa640 1 -- 172.21.15.53:0/3618141046 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90024450 con 0x55b95015e070 2024-08-31T06:25:50.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.264+0000 7feda45e2740 1 -- 172.21.15.53:0/3618141046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 msgr2=0x55b950500b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:50.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.264+0000 7feda45e2740 1 --2- 172.21.15.53:0/3618141046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b950500b60 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fed90005bf0 tx=0x7fed90005c20 comp rx=0 tx=0).stop 2024-08-31T06:25:50.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.264+0000 7feda45e2740 1 -- 172.21.15.53:0/3618141046 shutdown_connections 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.264+0000 7feda45e2740 1 --2- 172.21.15.53:0/3618141046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b95015e070 0x55b950500b60 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.265+0000 7feda45e2740 1 --2- 172.21.15.53:0/3618141046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b95051adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.265+0000 7feda45e2740 1 --2- 172.21.15.53:0/3618141046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9501351b0 0x55b950506b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.265+0000 7feda45e2740 1 -- 172.21.15.53:0/3618141046 >> 172.21.15.53:0/3618141046 conn(0x55b950152460 msgr2=0x55b950506450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.265+0000 7feda45e2740 1 -- 172.21.15.53:0/3618141046 shutdown_connections 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.265+0000 7feda45e2740 1 -- 172.21.15.53:0/3618141046 wait complete. 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.265+0000 7feda45e2740 1 -- start start 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.265+0000 7feda45e2740 1 Processor -- start 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.265+0000 7feda45e2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b9505134c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.265+0000 7feda45e2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b950513a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.265+0000 7feda45e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 0x55b95058a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.265+0000 7feda45e2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fed7800fd50 con 0x55b9501351b0 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7feda45e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed7800f5c0 con 0x55b95015e070 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7feda45e2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed7800c790 con 0x55b95013d390 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7feda45e2740 10 client.0 _ll_register_callbacks cb 0x7fed8003b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b9505134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b9505134c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47788/0 (socket says 172.21.15.53:47788) 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed977fe640 1 -- 172.21.15.53:0/3265608127 learned_addr learned my addr 172.21.15.53:0/3265608127 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed97fff640 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 0x55b95058a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed8effd640 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b950513a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed977fe640 1 -- 172.21.15.53:0/3265608127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 msgr2=0x55b950513a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed977fe640 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b950513a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed977fe640 1 -- 172.21.15.53:0/3265608127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 msgr2=0x55b95058a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed977fe640 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 0x55b95058a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed977fe640 1 -- 172.21.15.53:0/3265608127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b95058ad40 con 0x55b9501351b0 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed97fff640 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 0x55b95058a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed977fe640 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b9505134c0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x55b9505215a0 tx=0x7fed880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6966e1571d0e5c82 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed76ffd640 1 -- 172.21.15.53:0/3265608127 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88004220 con 0x55b9501351b0 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7feda45e2740 1 -- 172.21.15.53:0/3265608127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed90004d50 con 0x55b9501351b0 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.266+0000 7fed76ffd640 1 -- 172.21.15.53:0/3265608127 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7fed880043c0 con 0x55b9501351b0 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7fed76ffd640 1 -- 172.21.15.53:0/3265608127 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fed8801f6f0 con 0x55b9501351b0 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7feda45e2740 10 client.21840 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7feda45e2740 1 -- 172.21.15.53:0/3265608127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55b95058bfe0 con 0x55b9501351b0 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7fed76ffd640 1 -- 172.21.15.53:0/3265608127 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed90004d50 con 0x55b9501351b0 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7fed76ffd640 1 -- 172.21.15.53:0/3265608127 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7fed88003be0 con 0x55b9501351b0 2024-08-31T06:25:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7feda45e2740 10 client.21840 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7feda45e2740 10 client.21840 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7feda45e2740 20 client.21840 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7feda45e2740 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b9500f1da0 0x55b95058e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7feda45e2740 4 client.21840 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7feda45e2740 1 -- 172.21.15.53:0/3265608127 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b950478070 con 0x55b9500f1da0 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.267+0000 7fed8effd640 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b9500f1da0 0x55b95058e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7fed76ffd640 10 client.21840 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7fed8effd640 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b9500f1da0 0x55b95058e7f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b365f8c709ca83bb server_cookie=d8e767681cd1ccb0 in_seq=0 out_seq=0 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7fed76ffd640 1 -- 172.21.15.53:0/3265608127 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b950478070 con 0x55b9500f1da0 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7fed76ffd640 10 client.21840 handle_command_reply: tid=0 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 1 client.21840 shutdown 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 1 -- 172.21.15.53:0/3265608127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 msgr2=0x55b9505134c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b9505134c0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x55b9505215a0 tx=0x7fed880046c0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 1 -- 172.21.15.53:0/3265608127 shutdown_connections 2024-08-31T06:25:50.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55b9500f1da0 0x55b95058e7f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b95015e070 0x55b95058a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b95013d390 0x55b950513a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 1 --2- 172.21.15.53:0/3265608127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9501351b0 0x55b9505134c0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 1 -- 172.21.15.53:0/3265608127 >> 172.21.15.53:0/3265608127 conn(0x55b950152460 msgr2=0x55b950500ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:50.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7fed76ffd640 0 client.21840 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:25:50.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 1 -- 172.21.15.53:0/3265608127 shutdown_connections 2024-08-31T06:25:50.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 1 -- 172.21.15.53:0/3265608127 wait complete. 2024-08-31T06:25:50.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.268+0000 7feda45e2740 20 client.21840 trim_cache size 0 max 16384 2024-08-31T06:25:50.276 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:25:50.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 -- 172.21.15.53:0/1524368126 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed840b4ca0 msgr2=0x7fed840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:50.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed840b4ca0 0x7fed840b71b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x55b950501fd0 tx=0x7fed8800b620 comp rx=0 tx=0).stop 2024-08-31T06:25:50.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 -- 172.21.15.53:0/1524368126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed98105030 msgr2=0x7fed9819a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:50.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed98105030 0x7fed9819a6f0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fed80004770 tx=0x7fed80004040 comp rx=0 tx=0).stop 2024-08-31T06:25:50.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 -- 172.21.15.53:0/1524368126 shutdown_connections 2024-08-31T06:25:50.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed840b4ca0 0x7fed840b71b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed9810dbb0 0x7fed9819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed98105030 0x7fed9819a6f0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 --2- 172.21.15.53:0/1524368126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed98104600 0x7fed9819a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:50.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 -- 172.21.15.53:0/1524368126 >> 172.21.15.53:0/1524368126 conn(0x7fed980794e0 msgr2=0x7fed981006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:50.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 -- 172.21.15.53:0/1524368126 shutdown_connections 2024-08-31T06:25:50.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:50.269+0000 7fed9e06d640 1 -- 172.21.15.53:0/1524368126 wait complete. 2024-08-31T06:25:50.385 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49949 5.68 MB/sec execute 338 sec latency 1243.406 ms 2024-08-31T06:25:51.239 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '52882e46', quiesce took 8.2 seconds. Will release after: 5.9 2024-08-31T06:25:51.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49949 5.66 MB/sec execute 339 sec latency 2243.501 ms 2024-08-31T06:25:51.682 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:25:51.948 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:51.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:51 smithi053 ceph-mon[18924]: pgmap v980: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 359 op/s 2024-08-31T06:25:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:51 smithi130 ceph-mon[22266]: pgmap v980: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 359 op/s 2024-08-31T06:25:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:51 smithi153 ceph-mon[22320]: pgmap v980: 97 pgs: 97 active+clean; 810 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 359 op/s 2024-08-31T06:25:52.385 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49949 5.65 MB/sec execute 340 sec latency 3243.550 ms 2024-08-31T06:25:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.457+0000 7f28ac3ea640 1 -- 172.21.15.53:0/2929113885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28a4109240 msgr2=0x7f28a4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.457+0000 7f28ac3ea640 1 --2- 172.21.15.53:0/2929113885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28a4109240 0x7f28a4109650 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f2894009900 tx=0x7f289402a410 comp rx=0 tx=0).stop 2024-08-31T06:25:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.458+0000 7f28ac3ea640 1 -- 172.21.15.53:0/2929113885 shutdown_connections 2024-08-31T06:25:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.458+0000 7f28ac3ea640 1 --2- 172.21.15.53:0/2929113885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a4109b90 0x7f28a41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.458+0000 7f28ac3ea640 1 --2- 172.21.15.53:0/2929113885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28a4109240 0x7f28a4109650 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.458+0000 7f28ac3ea640 1 --2- 172.21.15.53:0/2929113885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28a4103900 0x7f28a4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.458+0000 7f28ac3ea640 1 -- 172.21.15.53:0/2929113885 >> 172.21.15.53:0/2929113885 conn(0x7f28a407b5f0 msgr2=0x7f28a407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:52.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.458+0000 7f28ac3ea640 1 -- 172.21.15.53:0/2929113885 shutdown_connections 2024-08-31T06:25:52.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.458+0000 7f28ac3ea640 1 -- 172.21.15.53:0/2929113885 wait complete. 2024-08-31T06:25:52.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.458+0000 7f28ac3ea640 1 Processor -- start 2024-08-31T06:25:52.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.458+0000 7f28ac3ea640 1 -- start start 2024-08-31T06:25:52.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28ac3ea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28a4103900 0x7f28a419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28ac3ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28a4109240 0x7f28a419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28ac3ea640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a4109b90 0x7f28a419f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28ac3ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f28a4113700 con 0x7f28a4109240 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28ac3ea640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f28a4113580 con 0x7f28a4103900 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28ac3ea640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28a4113880 con 0x7f28a4109b90 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28a9985640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28a4109240 0x7f28a419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28a9985640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28a4109240 0x7f28a419a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47810/0 (socket says 172.21.15.53:47810) 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28a9985640 1 -- 172.21.15.53:0/4000071004 learned_addr learned my addr 172.21.15.53:0/4000071004 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28aa186640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28a4103900 0x7f28a419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28aa987640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a4109b90 0x7f28a419f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28a9985640 1 -- 172.21.15.53:0/4000071004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a4109b90 msgr2=0x7f28a419f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28a9985640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a4109b90 0x7f28a419f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28a9985640 1 -- 172.21.15.53:0/4000071004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28a4103900 msgr2=0x7f28a419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28a9985640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28a4103900 0x7f28a419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28a9985640 1 -- 172.21.15.53:0/4000071004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a41a0060 con 0x7f28a4109240 2024-08-31T06:25:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28aa987640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a4109b90 0x7f28a419f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:25:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.459+0000 7f28a9985640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28a4109240 0x7f28a419a750 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f2894005940 tx=0x7f28940040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.460+0000 7f289b7fe640 1 -- 172.21.15.53:0/4000071004 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289403f030 con 0x7f28a4109240 2024-08-31T06:25:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.460+0000 7f28ac3ea640 1 -- 172.21.15.53:0/4000071004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a41a02f0 con 0x7f28a4109240 2024-08-31T06:25:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.460+0000 7f289b7fe640 1 -- 172.21.15.53:0/4000071004 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2894003a80 con 0x7f28a4109240 2024-08-31T06:25:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.460+0000 7f289b7fe640 1 -- 172.21.15.53:0/4000071004 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894035070 con 0x7f28a4109240 2024-08-31T06:25:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.460+0000 7f28ac3ea640 1 -- 172.21.15.53:0/4000071004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a41a07d0 con 0x7f28a4109240 2024-08-31T06:25:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.462+0000 7f28b295f740 1 Processor -- start 2024-08-31T06:25:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28b295f740 1 -- start start 2024-08-31T06:25:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f289b7fe640 1 -- 172.21.15.53:0/4000071004 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2894042030 con 0x7f28a4109240 2024-08-31T06:25:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28b295f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f794070 0x56521fb39350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28b295f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f76b1b0 0x56521fb39890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28b295f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f773390 0x56521fb39dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28b295f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56521fab0680 con 0x56521f794070 2024-08-31T06:25:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28b295f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56521fa9fc10 con 0x56521f773390 2024-08-31T06:25:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28b295f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56521faa3bc0 con 0x56521f76b1b0 2024-08-31T06:25:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28aa987640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f794070 0x56521fb39350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28aa987640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f794070 0x56521fb39350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47820/0 (socket says 172.21.15.53:47820) 2024-08-31T06:25:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28aa987640 1 -- 172.21.15.53:0/247512229 learned_addr learned my addr 172.21.15.53:0/247512229 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28aa186640 1 --2- 172.21.15.53:0/247512229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f76b1b0 0x56521fb39890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28a9985640 1 --2- 172.21.15.53:0/247512229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f773390 0x56521fb39dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28aa987640 1 -- 172.21.15.53:0/247512229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f76b1b0 msgr2=0x56521fb39890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28aa987640 1 --2- 172.21.15.53:0/247512229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f76b1b0 0x56521fb39890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28aa987640 1 -- 172.21.15.53:0/247512229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f773390 msgr2=0x56521fb39dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28aa987640 1 --2- 172.21.15.53:0/247512229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f773390 0x56521fb39dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.463+0000 7f28aa987640 1 -- 172.21.15.53:0/247512229 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521f7ff650 con 0x56521f794070 2024-08-31T06:25:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.464+0000 7f28aa987640 1 --2- 172.21.15.53:0/247512229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f794070 0x56521fb39350 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f289c009fb0 tx=0x7f289c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81ea76ce88bf68f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.464+0000 7f289b7fe640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28900b4cd0 0x7f28900b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.464+0000 7f2898d9a640 1 -- 172.21.15.53:0/247512229 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c016070 con 0x56521f794070 2024-08-31T06:25:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.464+0000 7f28aa186640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28900b4cd0 0x7f28900b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.464+0000 7f2898d9a640 1 -- 172.21.15.53:0/247512229 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f289c012ba0 con 0x56521f794070 2024-08-31T06:25:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.464+0000 7f2898d9a640 1 -- 172.21.15.53:0/247512229 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c011a90 con 0x56521f794070 2024-08-31T06:25:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.464+0000 7f289b7fe640 1 -- 172.21.15.53:0/4000071004 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f2894105a60 con 0x7f28a4109240 2024-08-31T06:25:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.465+0000 7f28b295f740 1 -- 172.21.15.53:0/247512229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f794070 msgr2=0x56521fb39350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.465+0000 7f28aa186640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28900b4cd0 0x7f28900b71e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x56521fb37fd0 tx=0x7f28a000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.465+0000 7f28b295f740 1 --2- 172.21.15.53:0/247512229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f794070 0x56521fb39350 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f289c009fb0 tx=0x7f289c010800 comp rx=0 tx=0).stop 2024-08-31T06:25:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.465+0000 7f28b295f740 1 -- 172.21.15.53:0/247512229 shutdown_connections 2024-08-31T06:25:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.465+0000 7f28b295f740 1 --2- 172.21.15.53:0/247512229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f773390 0x56521fb39dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.465+0000 7f28b295f740 1 --2- 172.21.15.53:0/247512229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f76b1b0 0x56521fb39890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.465+0000 7f28b295f740 1 --2- 172.21.15.53:0/247512229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f794070 0x56521fb39350 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.465+0000 7f28b295f740 1 -- 172.21.15.53:0/247512229 >> 172.21.15.53:0/247512229 conn(0x56521f788460 msgr2=0x56521fb37240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.465+0000 7f28b295f740 1 -- 172.21.15.53:0/247512229 shutdown_connections 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.465+0000 7f28b295f740 1 -- 172.21.15.53:0/247512229 wait complete. 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.465+0000 7f28b295f740 1 -- start start 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28b295f740 1 Processor -- start 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28b295f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb44b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28b295f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f773390 0x56521fb450f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28b295f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f794070 0x56521fb55260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28b295f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56521f902700 con 0x56521f76b1b0 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28b295f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56521fa26750 con 0x56521f794070 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28b295f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56521fb4bf40 con 0x56521f773390 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28b295f740 10 client.0 _ll_register_callbacks cb 0x56521fa55e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28aa186640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb44b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28aa186640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb44b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47830/0 (socket says 172.21.15.53:47830) 2024-08-31T06:25:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28aa186640 1 -- 172.21.15.53:0/1686097913 learned_addr learned my addr 172.21.15.53:0/1686097913 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28a9985640 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f773390 0x56521fb450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28aa987640 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f794070 0x56521fb55260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28aa186640 1 -- 172.21.15.53:0/1686097913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f773390 msgr2=0x56521fb450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28aa186640 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f773390 0x56521fb450f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28aa186640 1 -- 172.21.15.53:0/1686097913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f794070 msgr2=0x56521fb55260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.466+0000 7f28aa186640 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f794070 0x56521fb55260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.467+0000 7f28aa186640 1 -- 172.21.15.53:0/1686097913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56521fa5f900 con 0x56521f76b1b0 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.467+0000 7f28aa186640 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb44b70 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f28a001cc00 tx=0x7f28a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd39d04a886bbc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.467+0000 7f288dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.467+0000 7f288dffb640 1 -- 172.21.15.53:0/1686097913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a002c060 con 0x56521f76b1b0 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.467+0000 7f288dffb640 1 -- 172.21.15.53:0/1686097913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f28a0016030 con 0x56521f76b1b0 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.467+0000 7f28b295f740 1 -- 172.21.15.53:0/1686097913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f289c012ba0 con 0x56521f76b1b0 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.467+0000 7f288dffb640 1 -- 172.21.15.53:0/1686097913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f28a000adf0 con 0x56521f76b1b0 2024-08-31T06:25:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.467+0000 7f28b295f740 10 client.21852 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.467+0000 7f28b295f740 1 -- 172.21.15.53:0/1686097913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x56521fb57e30 con 0x56521f76b1b0 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.467+0000 7f288dffb640 1 -- 172.21.15.53:0/1686097913 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f289c012ba0 con 0x56521f76b1b0 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.468+0000 7f288dffb640 1 -- 172.21.15.53:0/1686097913 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f28a002f5f0 con 0x56521f76b1b0 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.468+0000 7f28b295f740 10 client.21852 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.468+0000 7f28b295f740 10 client.21852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.468+0000 7f28b295f740 20 client.21852 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.468+0000 7f28b295f740 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56521f7529f0 0x56521fb5b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.468+0000 7f28b295f740 4 client.21852 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.468+0000 7f28b295f740 1 -- 172.21.15.53:0/1686097913 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56521fab25d0 con 0x56521f7529f0 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.468+0000 7f28a9985640 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56521f7529f0 0x56521fb5b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.468+0000 7f28a9985640 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56521f7529f0 0x56521fb5b450 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9b06dcbf532f339 server_cookie=a6921203657375ea in_seq=0 out_seq=0 2024-08-31T06:25:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.468+0000 7f288dffb640 10 client.21852 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.469+0000 7f288dffb640 1 -- 172.21.15.53:0/1686097913 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56521fab25d0 con 0x56521f7529f0 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.469+0000 7f288dffb640 10 client.21852 handle_command_reply: tid=0 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.469+0000 7f28b295f740 1 client.21852 shutdown 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.469+0000 7f28b295f740 1 -- 172.21.15.53:0/1686097913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 msgr2=0x56521fb44b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.469+0000 7f28b295f740 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb44b70 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f28a001cc00 tx=0x7f28a0004730 comp rx=0 tx=0).stop 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.469+0000 7f28b295f740 1 -- 172.21.15.53:0/1686097913 shutdown_connections 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.469+0000 7f28b295f740 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56521f7529f0 0x56521fb5b450 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.469+0000 7f28b295f740 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f794070 0x56521fb55260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.470+0000 7f28b295f740 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f773390 0x56521fb450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.470+0000 7f28b295f740 1 --2- 172.21.15.53:0/1686097913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb44b70 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.470+0000 7f28b295f740 1 -- 172.21.15.53:0/1686097913 >> 172.21.15.53:0/1686097913 conn(0x56521f788460 msgr2=0x56521fb3c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.470+0000 7f288dffb640 0 client.21852 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.470+0000 7f28b295f740 1 -- 172.21.15.53:0/1686097913 shutdown_connections 2024-08-31T06:25:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.470+0000 7f28b295f740 1 -- 172.21.15.53:0/1686097913 wait complete. 2024-08-31T06:25:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.470+0000 7f28b295f740 20 client.21852 trim_cache size 0 max 16384 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28b295f740 1 Processor -- start 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28b295f740 1 -- start start 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28b295f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb3aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28b295f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f773390 0x56521fb41d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28b295f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f794070 0x56521fb422a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28b295f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f28a41ad2d0 con 0x56521f76b1b0 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28b295f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f28a41af020 con 0x56521f773390 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28b295f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28a41ada30 con 0x56521f794070 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28aa186640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb3aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28aa186640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb3aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47832/0 (socket says 172.21.15.53:47832) 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28aa186640 1 -- 172.21.15.53:0/365257779 learned_addr learned my addr 172.21.15.53:0/365257779 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28a9985640 1 --2- 172.21.15.53:0/365257779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f773390 0x56521fb41d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28aa186640 1 -- 172.21.15.53:0/365257779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f794070 msgr2=0x56521fb422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28aa186640 1 --2- 172.21.15.53:0/365257779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f794070 0x56521fb422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28aa186640 1 -- 172.21.15.53:0/365257779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f773390 msgr2=0x56521fb41d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.483+0000 7f28aa186640 1 --2- 172.21.15.53:0/365257779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f773390 0x56521fb41d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.484+0000 7f28aa186640 1 -- 172.21.15.53:0/365257779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521fb43070 con 0x56521f76b1b0 2024-08-31T06:25:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.484+0000 7f28aa186640 1 --2- 172.21.15.53:0/365257779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb3aa90 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f28a0017040 tx=0x7f28a0010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9be4d9772cd6e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.484+0000 7f288ffff640 1 -- 172.21.15.53:0/365257779 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a003c070 con 0x56521f76b1b0 2024-08-31T06:25:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.484+0000 7f288ffff640 1 -- 172.21.15.53:0/365257779 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28a001cdf0 con 0x56521f76b1b0 2024-08-31T06:25:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.484+0000 7f288ffff640 1 -- 172.21.15.53:0/365257779 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a002c030 con 0x56521f76b1b0 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 -- 172.21.15.53:0/365257779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 msgr2=0x56521fb3aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 --2- 172.21.15.53:0/365257779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb3aa90 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f28a0017040 tx=0x7f28a0010d10 comp rx=0 tx=0).stop 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 -- 172.21.15.53:0/365257779 shutdown_connections 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 --2- 172.21.15.53:0/365257779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f794070 0x56521fb422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 --2- 172.21.15.53:0/365257779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f773390 0x56521fb41d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 --2- 172.21.15.53:0/365257779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f76b1b0 0x56521fb3aa90 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 -- 172.21.15.53:0/365257779 >> 172.21.15.53:0/365257779 conn(0x56521f788460 msgr2=0x56521fb3a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 -- 172.21.15.53:0/365257779 shutdown_connections 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 -- 172.21.15.53:0/365257779 wait complete. 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 -- start start 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 Processor -- start 2024-08-31T06:25:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f76b1b0 0x56521fb4f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f773390 0x56521fb4f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f794070 0x56521fb4fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f28a41ae890 con 0x56521f773390 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f28a41ae100 con 0x56521f794070 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.485+0000 7f28b295f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f28a41ab2d0 con 0x56521f76b1b0 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28b295f740 10 client.0 _ll_register_callbacks cb 0x7f28a000a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28a9985640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f773390 0x56521fb4f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28a9985640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f773390 0x56521fb4f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47848/0 (socket says 172.21.15.53:47848) 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28a9985640 1 -- 172.21.15.53:0/444663841 learned_addr learned my addr 172.21.15.53:0/444663841 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28aa987640 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f794070 0x56521fb4fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28aa186640 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f76b1b0 0x56521fb4f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28a9985640 1 -- 172.21.15.53:0/444663841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f76b1b0 msgr2=0x56521fb4f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28a9985640 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f76b1b0 0x56521fb4f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28a9985640 1 -- 172.21.15.53:0/444663841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f794070 msgr2=0x56521fb4fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28a9985640 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f794070 0x56521fb4fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28a9985640 1 -- 172.21.15.53:0/444663841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56521fbc4fa0 con 0x56521f773390 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28a9985640 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f773390 0x56521fb4f870 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f2894103790 tx=0x7f2894005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ef29b9bb7e4df8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f288dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f288dffb640 1 -- 172.21.15.53:0/444663841 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894049040 con 0x56521f773390 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f288dffb640 1 -- 172.21.15.53:0/444663841 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f28940c8720 con 0x56521f773390 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.486+0000 7f28b295f740 1 -- 172.21.15.53:0/444663841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28a001cdf0 con 0x56521f773390 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f288dffb640 1 -- 172.21.15.53:0/444663841 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f28940044e0 con 0x56521f773390 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f28b295f740 10 client.21858 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f28b295f740 1 -- 172.21.15.53:0/444663841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x56521fbc6220 con 0x56521f773390 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f288dffb640 1 -- 172.21.15.53:0/444663841 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28a001cdf0 con 0x56521f773390 2024-08-31T06:25:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f288dffb640 1 -- 172.21.15.53:0/444663841 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f28940c83c0 con 0x56521f773390 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f28b295f740 10 client.21858 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f28b295f740 10 client.21858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f28b295f740 20 client.21858 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f28b295f740 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56521f727da0 0x56521fbc8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f28b295f740 4 client.21858 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f28b295f740 1 -- 172.21.15.53:0/444663841 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56521faae070 con 0x56521f727da0 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.487+0000 7f28aa186640 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56521f727da0 0x56521fbc8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f288dffb640 10 client.21858 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28aa186640 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56521f727da0 0x56521fbc8a20 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f947e8e95afca1d5 server_cookie=692574d80fa00289 in_seq=0 out_seq=0 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f288dffb640 1 -- 172.21.15.53:0/444663841 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56521faae070 con 0x56521f727da0 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f288dffb640 10 client.21858 handle_command_reply: tid=0 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 1 client.21858 shutdown 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 1 -- 172.21.15.53:0/444663841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f773390 msgr2=0x56521fb4f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f773390 0x56521fb4f870 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f2894103790 tx=0x7f2894005d50 comp rx=0 tx=0).stop 2024-08-31T06:25:52.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 1 -- 172.21.15.53:0/444663841 shutdown_connections 2024-08-31T06:25:52.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56521f727da0 0x56521fbc8a20 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56521f794070 0x56521fb4fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56521f773390 0x56521fb4f870 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 1 --2- 172.21.15.53:0/444663841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56521f76b1b0 0x56521fb4f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f288dffb640 0 client.21858 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:52.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 1 -- 172.21.15.53:0/444663841 >> 172.21.15.53:0/444663841 conn(0x56521f788460 msgr2=0x56521fb3cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:52.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 1 -- 172.21.15.53:0/444663841 shutdown_connections 2024-08-31T06:25:52.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 1 -- 172.21.15.53:0/444663841 wait complete. 2024-08-31T06:25:52.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.488+0000 7f28b295f740 20 client.21858 trim_cache size 0 max 16384 2024-08-31T06:25:52.496 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:25:52.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 -- 172.21.15.53:0/4000071004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28900b4cd0 msgr2=0x7f28900b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28900b4cd0 0x7f28900b71e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x56521fb37fd0 tx=0x7f28a000a2d0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 -- 172.21.15.53:0/4000071004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28a4109240 msgr2=0x7f28a419a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28a4109240 0x7f28a419a750 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f2894005940 tx=0x7f28940040e0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 -- 172.21.15.53:0/4000071004 shutdown_connections 2024-08-31T06:25:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f28900b4cd0 0x7f28900b71e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28a4109b90 0x7f28a419f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28a4109240 0x7f28a419a750 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 --2- 172.21.15.53:0/4000071004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28a4103900 0x7f28a419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 -- 172.21.15.53:0/4000071004 >> 172.21.15.53:0/4000071004 conn(0x7f28a407b5f0 msgr2=0x7f28a4107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 -- 172.21.15.53:0/4000071004 shutdown_connections 2024-08-31T06:25:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:52.489+0000 7f28ac3ea640 1 -- 172.21.15.53:0/4000071004 wait complete. 2024-08-31T06:25:53.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49949 5.63 MB/sec execute 341 sec latency 4243.651 ms 2024-08-31T06:25:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.607+0000 7f30ae912640 1 -- 172.21.15.53:0/2466216995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a8104730 msgr2=0x7f30a8104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.607+0000 7f30ae912640 1 --2- 172.21.15.53:0/2466216995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a8104730 0x7f30a8104b40 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f3098009900 tx=0x7f309802a410 comp rx=0 tx=0).stop 2024-08-31T06:25:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.607+0000 7f30ae912640 1 -- 172.21.15.53:0/2466216995 shutdown_connections 2024-08-31T06:25:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.607+0000 7f30ae912640 1 --2- 172.21.15.53:0/2466216995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a810db50 0x7f30a8110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.607+0000 7f30ae912640 1 --2- 172.21.15.53:0/2466216995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a8105080 0x7f30a810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.607+0000 7f30ae912640 1 --2- 172.21.15.53:0/2466216995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a8104730 0x7f30a8104b40 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.607+0000 7f30ae912640 1 -- 172.21.15.53:0/2466216995 >> 172.21.15.53:0/2466216995 conn(0x7f30a80fe160 msgr2=0x7f30a81005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.607+0000 7f30ae912640 1 -- 172.21.15.53:0/2466216995 shutdown_connections 2024-08-31T06:25:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.607+0000 7f30ae912640 1 -- 172.21.15.53:0/2466216995 wait complete. 2024-08-31T06:25:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30ae912640 1 Processor -- start 2024-08-31T06:25:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30ae912640 1 -- start start 2024-08-31T06:25:53.612 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30ae912640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a8104730 0x7f30a8102460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.612 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30ae912640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a8105080 0x7f30a81029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.612 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30ae912640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a810db50 0x7f30a8102ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.612 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30ae912640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8113670 con 0x7f30a8105080 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30ae912640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f30a81134f0 con 0x7f30a8104730 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30ae912640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30a81137f0 con 0x7f30a810db50 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a8105080 0x7f30a81029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a8105080 0x7f30a81029a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53214/0 (socket says 172.21.15.53:53214) 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30a77fe640 1 -- 172.21.15.53:0/1507761029 learned_addr learned my addr 172.21.15.53:0/1507761029 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30a77fe640 1 -- 172.21.15.53:0/1507761029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a810db50 msgr2=0x7f30a8102ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30a77fe640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a810db50 0x7f30a8102ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30a77fe640 1 -- 172.21.15.53:0/1507761029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a8104730 msgr2=0x7f30a8102460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30a77fe640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a8104730 0x7f30a8102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.608+0000 7f30a77fe640 1 -- 172.21.15.53:0/1507761029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a81a84a0 con 0x7f30a8105080 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.609+0000 7f30a77fe640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a8105080 0x7f30a81029a0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f309c00d750 tx=0x7f309c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.609+0000 7f30a57fa640 1 -- 172.21.15.53:0/1507761029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c017070 con 0x7f30a8105080 2024-08-31T06:25:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.609+0000 7f30a57fa640 1 -- 172.21.15.53:0/1507761029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f309c0054b0 con 0x7f30a8105080 2024-08-31T06:25:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.609+0000 7f30a57fa640 1 -- 172.21.15.53:0/1507761029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c004bc0 con 0x7f30a8105080 2024-08-31T06:25:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.609+0000 7f30ae912640 1 -- 172.21.15.53:0/1507761029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a81a8790 con 0x7f30a8105080 2024-08-31T06:25:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.609+0000 7f30ae912640 1 -- 172.21.15.53:0/1507761029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a81a8c90 con 0x7f30a8105080 2024-08-31T06:25:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30b587b740 1 Processor -- start 2024-08-31T06:25:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30b587b740 1 -- start start 2024-08-31T06:25:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30a57fa640 1 -- 172.21.15.53:0/1507761029 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f309c009c30 con 0x7f30a8105080 2024-08-31T06:25:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30b587b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a5f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30b587b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a5f5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30b587b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 0x55757a5f5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30b587b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55757a56a000 con 0x55757a2282f0 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30b587b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55757a559590 con 0x55757a2304d0 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30b587b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55757a55d540 con 0x55757a2511b0 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a5f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a5f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53230/0 (socket says 172.21.15.53:53230) 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30a7fff640 1 -- 172.21.15.53:0/2472093611 learned_addr learned my addr 172.21.15.53:0/2472093611 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30aceaf640 1 --2- 172.21.15.53:0/2472093611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a5f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30a7fff640 1 -- 172.21.15.53:0/2472093611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 msgr2=0x55757a5f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30a7fff640 1 --2- 172.21.15.53:0/2472093611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a5f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30a77fe640 1 --2- 172.21.15.53:0/2472093611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 0x55757a5f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30a7fff640 1 -- 172.21.15.53:0/2472093611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 msgr2=0x55757a5f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.612+0000 7f30a7fff640 1 --2- 172.21.15.53:0/2472093611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 0x55757a5f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.613+0000 7f30a7fff640 1 -- 172.21.15.53:0/2472093611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55757a2bc790 con 0x55757a2282f0 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.613+0000 7f30a77fe640 1 --2- 172.21.15.53:0/2472093611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 0x55757a5f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.613+0000 7f30a57fa640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30900b4cd0 0x7f30900b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.613+0000 7f30a7fff640 1 --2- 172.21.15.53:0/2472093611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a5f5220 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f3098009230 tx=0x7f3098032b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea03fc342f394535 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.613+0000 7f30aceaf640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30900b4cd0 0x7f30900b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.613+0000 7f30a57fa640 1 -- 172.21.15.53:0/1507761029 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f309c0e5000 con 0x7f30a8105080 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.613+0000 7f308e7fc640 1 -- 172.21.15.53:0/2472093611 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098040070 con 0x55757a2282f0 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.613+0000 7f308e7fc640 1 -- 172.21.15.53:0/2472093611 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3098004040 con 0x55757a2282f0 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.613+0000 7f308e7fc640 1 -- 172.21.15.53:0/2472093611 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098035040 con 0x55757a2282f0 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.614+0000 7f30b587b740 1 -- 172.21.15.53:0/2472093611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 msgr2=0x55757a5f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.614+0000 7f30b587b740 1 --2- 172.21.15.53:0/2472093611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a5f5220 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f3098009230 tx=0x7f3098032b00 comp rx=0 tx=0).stop 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.614+0000 7f30aceaf640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30900b4cd0 0x7f30900b71e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009370 tx=0x7f30a00092e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.614+0000 7f30b587b740 1 -- 172.21.15.53:0/2472093611 shutdown_connections 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.614+0000 7f30b587b740 1 --2- 172.21.15.53:0/2472093611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 0x55757a5f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.614+0000 7f30b587b740 1 --2- 172.21.15.53:0/2472093611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a5f5220 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.614+0000 7f30b587b740 1 --2- 172.21.15.53:0/2472093611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a5f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.614+0000 7f30b587b740 1 -- 172.21.15.53:0/2472093611 >> 172.21.15.53:0/2472093611 conn(0x55757a245300 msgr2=0x55757a5f2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.614+0000 7f30b587b740 1 -- 172.21.15.53:0/2472093611 shutdown_connections 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.614+0000 7f30b587b740 1 -- 172.21.15.53:0/2472093611 wait complete. 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.614+0000 7f30b587b740 1 -- start start 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30b587b740 1 Processor -- start 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30b587b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a6008d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30b587b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2304d0 0x55757a600e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30b587b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2511b0 0x55757a60c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30b587b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55757a492ab0 con 0x55757a2282f0 2024-08-31T06:25:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30b587b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55757a4e0680 con 0x55757a2511b0 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30b587b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55757a603400 con 0x55757a2304d0 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30b587b740 10 client.0 _ll_register_callbacks cb 0x55757a268a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a6008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a6008d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53232/0 (socket says 172.21.15.53:53232) 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30a7fff640 1 -- 172.21.15.53:0/1937687819 learned_addr learned my addr 172.21.15.53:0/1937687819 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30a77fe640 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2304d0 0x55757a600e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30aceaf640 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2511b0 0x55757a60c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30a7fff640 1 -- 172.21.15.53:0/1937687819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2304d0 msgr2=0x55757a600e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30a7fff640 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2304d0 0x55757a600e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30a7fff640 1 -- 172.21.15.53:0/1937687819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2511b0 msgr2=0x55757a60c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30a7fff640 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2511b0 0x55757a60c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30a7fff640 1 -- 172.21.15.53:0/1937687819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55757a335620 con 0x55757a2282f0 2024-08-31T06:25:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30aceaf640 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2511b0 0x55757a60c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30a7fff640 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a6008d0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f309802a910 tx=0x7f3098005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3554bfbbca25b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.615+0000 7f30877fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30877fe640 1 -- 172.21.15.53:0/1937687819 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098035040 con 0x55757a2282f0 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30877fe640 1 -- 172.21.15.53:0/1937687819 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f3098031600 con 0x55757a2282f0 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30b587b740 1 -- 172.21.15.53:0/1937687819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3098004040 con 0x55757a2282f0 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30877fe640 1 -- 172.21.15.53:0/1937687819 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f3098040040 con 0x55757a2282f0 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30b587b740 10 client.21870 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30b587b740 1 -- 172.21.15.53:0/1937687819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55757a60f3d0 con 0x55757a2282f0 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30877fe640 1 -- 172.21.15.53:0/1937687819 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3098004040 con 0x55757a2282f0 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30877fe640 1 -- 172.21.15.53:0/1937687819 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f309804e6b0 con 0x55757a2282f0 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30b587b740 10 client.21870 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30b587b740 10 client.21870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30b587b740 20 client.21870 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30b587b740 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55757a20fd80 0x55757a612730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30b587b740 4 client.21870 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.616+0000 7f30b587b740 1 -- 172.21.15.53:0/1937687819 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55757a56bf50 con 0x55757a20fd80 2024-08-31T06:25:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.617+0000 7f30a77fe640 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55757a20fd80 0x55757a612730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.617+0000 7f30a77fe640 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55757a20fd80 0x55757a612730 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d07c6df3f05f5aa server_cookie=92e7545fd70de5fb in_seq=0 out_seq=0 2024-08-31T06:25:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.617+0000 7f30877fe640 10 client.21870 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30877fe640 1 -- 172.21.15.53:0/1937687819 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55757a56bf50 con 0x55757a20fd80 2024-08-31T06:25:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30877fe640 10 client.21870 handle_command_reply: tid=0 2024-08-31T06:25:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30b587b740 1 client.21870 shutdown 2024-08-31T06:25:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30b587b740 1 -- 172.21.15.53:0/1937687819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 msgr2=0x55757a6008d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30b587b740 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a6008d0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f309802a910 tx=0x7f3098005dc0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30b587b740 1 -- 172.21.15.53:0/1937687819 shutdown_connections 2024-08-31T06:25:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30b587b740 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55757a20fd80 0x55757a612730 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30b587b740 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2511b0 0x55757a60c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30b587b740 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2304d0 0x55757a600e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30877fe640 0 client.21870 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30b587b740 1 --2- 172.21.15.53:0/1937687819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a6008d0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.618+0000 7f30b587b740 1 -- 172.21.15.53:0/1937687819 >> 172.21.15.53:0/1937687819 conn(0x55757a245300 msgr2=0x55757a5f5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.619+0000 7f30b587b740 1 -- 172.21.15.53:0/1937687819 shutdown_connections 2024-08-31T06:25:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.619+0000 7f30b587b740 1 -- 172.21.15.53:0/1937687819 wait complete. 2024-08-31T06:25:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.619+0000 7f30b587b740 20 client.21870 trim_cache size 0 max 16384 2024-08-31T06:25:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.633+0000 7f30b587b740 1 Processor -- start 2024-08-31T06:25:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.633+0000 7f30b587b740 1 -- start start 2024-08-31T06:25:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.633+0000 7f30b587b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2282f0 0x55757a5f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.633+0000 7f30b587b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2304d0 0x55757a5fadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.633+0000 7f30b587b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a6022f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.633+0000 7f30b587b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30a81b1710 con 0x55757a2304d0 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.633+0000 7f30b587b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f30a81b3460 con 0x55757a2282f0 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.633+0000 7f30b587b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30a81b1e70 con 0x55757a2511b0 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2304d0 0x55757a5fadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2304d0 0x55757a5fadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53238/0 (socket says 172.21.15.53:53238) 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30a77fe640 1 -- 172.21.15.53:0/494580316 learned_addr learned my addr 172.21.15.53:0/494580316 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30aceaf640 1 --2- 172.21.15.53:0/494580316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a6022f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30a7fff640 1 --2- 172.21.15.53:0/494580316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2282f0 0x55757a5f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30a77fe640 1 -- 172.21.15.53:0/494580316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 msgr2=0x55757a6022f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30a77fe640 1 --2- 172.21.15.53:0/494580316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a6022f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30a77fe640 1 -- 172.21.15.53:0/494580316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2282f0 msgr2=0x55757a5f66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30a77fe640 1 --2- 172.21.15.53:0/494580316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2282f0 0x55757a5f66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30a77fe640 1 -- 172.21.15.53:0/494580316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55757a5feba0 con 0x55757a2304d0 2024-08-31T06:25:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30a7fff640 1 --2- 172.21.15.53:0/494580316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2282f0 0x55757a5f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:25:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f30a77fe640 1 --2- 172.21.15.53:0/494580316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2304d0 0x55757a5fadb0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f309c0ab660 tx=0x7f309c0ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130f5fc760751b5f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f308dffb640 1 -- 172.21.15.53:0/494580316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c020040 con 0x55757a2304d0 2024-08-31T06:25:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f308dffb640 1 -- 172.21.15.53:0/494580316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f309c0ab6d0 con 0x55757a2304d0 2024-08-31T06:25:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.634+0000 7f308dffb640 1 -- 172.21.15.53:0/494580316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c0b4560 con 0x55757a2304d0 2024-08-31T06:25:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.635+0000 7f30b587b740 1 -- 172.21.15.53:0/494580316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2304d0 msgr2=0x55757a5fadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.635+0000 7f30b587b740 1 --2- 172.21.15.53:0/494580316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2304d0 0x55757a5fadb0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f309c0ab660 tx=0x7f309c0ce040 comp rx=0 tx=0).stop 2024-08-31T06:25:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.635+0000 7f30b587b740 1 -- 172.21.15.53:0/494580316 shutdown_connections 2024-08-31T06:25:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.635+0000 7f30b587b740 1 --2- 172.21.15.53:0/494580316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a6022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.635+0000 7f30b587b740 1 --2- 172.21.15.53:0/494580316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2304d0 0x55757a5fadb0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.635+0000 7f30b587b740 1 --2- 172.21.15.53:0/494580316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2282f0 0x55757a5f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.635+0000 7f30b587b740 1 -- 172.21.15.53:0/494580316 >> 172.21.15.53:0/494580316 conn(0x55757a245300 msgr2=0x55757a601be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.635+0000 7f30b587b740 1 -- 172.21.15.53:0/494580316 shutdown_connections 2024-08-31T06:25:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.635+0000 7f30b587b740 1 -- 172.21.15.53:0/494580316 wait complete. 2024-08-31T06:25:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.635+0000 7f30b587b740 1 -- start start 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30b587b740 1 Processor -- start 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30b587b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a608e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30b587b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 0x55757a6042a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30b587b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a6047e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30b587b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30a81b2cd0 con 0x55757a2282f0 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30b587b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f30a81b2540 con 0x55757a2304d0 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30b587b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30a81af710 con 0x55757a2511b0 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30b587b740 10 client.0 _ll_register_callbacks cb 0x7f30980095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a608e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a608e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53248/0 (socket says 172.21.15.53:53248) 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30a7fff640 1 -- 172.21.15.53:0/2720638498 learned_addr learned my addr 172.21.15.53:0/2720638498 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30a77fe640 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 0x55757a6042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30aceaf640 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a6047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30a7fff640 1 -- 172.21.15.53:0/2720638498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 msgr2=0x55757a6047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30a7fff640 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a6047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30a7fff640 1 -- 172.21.15.53:0/2720638498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 msgr2=0x55757a6042a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30a7fff640 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 0x55757a6042a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30a7fff640 1 -- 172.21.15.53:0/2720638498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55757a604f50 con 0x55757a2282f0 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30a77fe640 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 0x55757a6042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30a7fff640 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a608e00 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f3098005760 tx=0x7f3098031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4cc13e4d12f07e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.636+0000 7f30877fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30877fe640 1 -- 172.21.15.53:0/2720638498 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309805b070 con 0x55757a2282f0 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30877fe640 1 -- 172.21.15.53:0/2720638498 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f3098031a00 con 0x55757a2282f0 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30b587b740 1 -- 172.21.15.53:0/2720638498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f309c0ab6d0 con 0x55757a2282f0 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30877fe640 1 -- 172.21.15.53:0/2720638498 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f3098035040 con 0x55757a2282f0 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30b587b740 10 client.21876 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30b587b740 1 -- 172.21.15.53:0/2720638498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55757a67cdb0 con 0x55757a2282f0 2024-08-31T06:25:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30877fe640 1 -- 172.21.15.53:0/2720638498 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f309c0ab6d0 con 0x55757a2282f0 2024-08-31T06:25:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30877fe640 1 -- 172.21.15.53:0/2720638498 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f30980046c0 con 0x55757a2282f0 2024-08-31T06:25:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30b587b740 10 client.21876 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30b587b740 10 client.21876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30b587b740 20 client.21876 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30b587b740 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55757a1e51c0 0x55757a67f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30b587b740 4 client.21876 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:25:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30b587b740 1 -- 172.21.15.53:0/2720638498 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55757a5edac0 con 0x55757a1e51c0 2024-08-31T06:25:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.637+0000 7f30a77fe640 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55757a1e51c0 0x55757a67f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.638+0000 7f30877fe640 10 client.21876 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.638+0000 7f30a77fe640 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55757a1e51c0 0x55757a67f630 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c17215c94c3f31 server_cookie=4ea2ebd419c8053 in_seq=0 out_seq=0 2024-08-31T06:25:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30877fe640 1 -- 172.21.15.53:0/2720638498 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55757a5edac0 con 0x55757a1e51c0 2024-08-31T06:25:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30877fe640 10 client.21876 handle_command_reply: tid=0 2024-08-31T06:25:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 1 client.21876 shutdown 2024-08-31T06:25:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 1 -- 172.21.15.53:0/2720638498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 msgr2=0x55757a608e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:53.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a608e00 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f3098005760 tx=0x7f3098031630 comp rx=0 tx=0).stop 2024-08-31T06:25:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 1 -- 172.21.15.53:0/2720638498 shutdown_connections 2024-08-31T06:25:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55757a1e51c0 0x55757a67f630 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55757a2511b0 0x55757a6047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30877fe640 0 client.21876 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55757a2304d0 0x55757a6042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 1 --2- 172.21.15.53:0/2720638498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55757a2282f0 0x55757a608e00 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 1 -- 172.21.15.53:0/2720638498 >> 172.21.15.53:0/2720638498 conn(0x55757a245300 msgr2=0x55757a5f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 1 -- 172.21.15.53:0/2720638498 shutdown_connections 2024-08-31T06:25:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 1 -- 172.21.15.53:0/2720638498 wait complete. 2024-08-31T06:25:53.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.693+0000 7f30b587b740 20 client.21876 trim_cache size 0 max 16384 2024-08-31T06:25:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:25:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:25:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:25:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:25:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 -- 172.21.15.53:0/1507761029 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30900b4cd0 msgr2=0x7f30900b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30900b4cd0 0x7f30900b71e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009370 tx=0x7f30a00092e0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 -- 172.21.15.53:0/1507761029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a8105080 msgr2=0x7f30a81029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a8105080 0x7f30a81029a0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f309c00d750 tx=0x7f309c00dc10 comp rx=0 tx=0).stop 2024-08-31T06:25:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 -- 172.21.15.53:0/1507761029 shutdown_connections 2024-08-31T06:25:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f30900b4cd0 0x7f30900b71e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30a810db50 0x7f30a8102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a8105080 0x7f30a81029a0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 --2- 172.21.15.53:0/1507761029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30a8104730 0x7f30a8102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 -- 172.21.15.53:0/1507761029 >> 172.21.15.53:0/1507761029 conn(0x7f30a80fe160 msgr2=0x7f30a810fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 -- 172.21.15.53:0/1507761029 shutdown_connections 2024-08-31T06:25:53.699 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:25:53.694+0000 7f30ae912640 1 -- 172.21.15.53:0/1507761029 wait complete. 2024-08-31T06:25:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:53 smithi130 ceph-mon[22266]: pgmap v981: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 282 op/s 2024-08-31T06:25:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:53 smithi153 ceph-mon[22320]: pgmap v981: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 282 op/s 2024-08-31T06:25:54.176 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:25:54.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:25:54.199 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:53 smithi053 ceph-mon[18924]: pgmap v981: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 282 op/s 2024-08-31T06:25:54.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49949 5.61 MB/sec execute 342 sec latency 5243.696 ms 2024-08-31T06:25:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:55.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49949 5.60 MB/sec execute 343 sec latency 6243.749 ms 2024-08-31T06:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.637+0000 7f54f698c640 1 -- 172.21.15.53:0/3562648476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f0109240 msgr2=0x7f54f0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:55.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.637+0000 7f54f698c640 1 --2- 172.21.15.53:0/3562648476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f0109240 0x7f54f0109650 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009900 tx=0x7f54e402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.638+0000 7f54f698c640 1 -- 172.21.15.53:0/3562648476 shutdown_connections 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.638+0000 7f54f698c640 1 --2- 172.21.15.53:0/3562648476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f0109b90 0x7f54f01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.638+0000 7f54f698c640 1 --2- 172.21.15.53:0/3562648476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f0109240 0x7f54f0109650 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.638+0000 7f54f698c640 1 --2- 172.21.15.53:0/3562648476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54f0103900 0x7f54f0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.638+0000 7f54f698c640 1 -- 172.21.15.53:0/3562648476 >> 172.21.15.53:0/3562648476 conn(0x7f54f007b5f0 msgr2=0x7f54f007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.638+0000 7f54f698c640 1 -- 172.21.15.53:0/3562648476 shutdown_connections 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.638+0000 7f54f698c640 1 -- 172.21.15.53:0/3562648476 wait complete. 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.638+0000 7f54f698c640 1 Processor -- start 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.638+0000 7f54f698c640 1 -- start start 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54f698c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f0103900 0x7f54f019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54f698c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f0109240 0x7f54f019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54f698c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54f0109b90 0x7f54f019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54f698c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f54f0113700 con 0x7f54f0109240 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54f698c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54f0113580 con 0x7f54f0109b90 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54f698c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54f0113880 con 0x7f54f0103900 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f0109240 0x7f54f019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f0109240 0x7f54f019a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53264/0 (socket says 172.21.15.53:53264) 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54ef7fe640 1 -- 172.21.15.53:0/1091695306 learned_addr learned my addr 172.21.15.53:0/1091695306 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54f4f29640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54f0109b90 0x7f54f019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54effff640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f0103900 0x7f54f019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54ef7fe640 1 -- 172.21.15.53:0/1091695306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f0103900 msgr2=0x7f54f019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54ef7fe640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f0103900 0x7f54f019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54ef7fe640 1 -- 172.21.15.53:0/1091695306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54f0109b90 msgr2=0x7f54f019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:55.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54ef7fe640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54f0109b90 0x7f54f019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.639+0000 7f54ef7fe640 1 -- 172.21.15.53:0/1091695306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f01a00e0 con 0x7f54f0109240 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.640+0000 7f54ef7fe640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f0109240 0x7f54f019a7d0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f54e4005940 tx=0x7f54e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.640+0000 7f54ed7fa640 1 -- 172.21.15.53:0/1091695306 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e403f030 con 0x7f54f0109240 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.640+0000 7f54ed7fa640 1 -- 172.21.15.53:0/1091695306 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54e4003c90 con 0x7f54f0109240 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.640+0000 7f54f698c640 1 -- 172.21.15.53:0/1091695306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f01a0370 con 0x7f54f0109240 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.640+0000 7f54ed7fa640 1 -- 172.21.15.53:0/1091695306 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4035070 con 0x7f54f0109240 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.640+0000 7f54f698c640 1 -- 172.21.15.53:0/1091695306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f01a08a0 con 0x7f54f0109240 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.643+0000 7f54fcf01740 1 Processor -- start 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.643+0000 7f54fcf01740 1 -- start start 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.643+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.643+0000 7f54ed7fa640 1 -- 172.21.15.53:0/1091695306 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f54e4042030 con 0x7f54f0109240 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.643+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af91fd490 0x564af95cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af9205670 0x564af95cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54fcf01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564af95425f0 con 0x564af9226350 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54fcf01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564af9531b80 con 0x564af91fd490 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54fcf01740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564af9535b30 con 0x564af9205670 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54f4f29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54f4f29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53276/0 (socket says 172.21.15.53:53276) 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54f4f29640 1 -- 172.21.15.53:0/3759942107 learned_addr learned my addr 172.21.15.53:0/3759942107 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54effff640 1 --2- 172.21.15.53:0/3759942107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af91fd490 0x564af95cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54f4f29640 1 -- 172.21.15.53:0/3759942107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af9205670 msgr2=0x564af95cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54f4f29640 1 --2- 172.21.15.53:0/3759942107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af9205670 0x564af95cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54f4f29640 1 -- 172.21.15.53:0/3759942107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af91fd490 msgr2=0x564af95cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54f4f29640 1 --2- 172.21.15.53:0/3759942107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af91fd490 0x564af95cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54f4f29640 1 -- 172.21.15.53:0/3759942107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af9291930 con 0x564af9226350 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54f4f29640 1 --2- 172.21.15.53:0/3759942107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95cc780 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f54e800ae10 tx=0x7f54e800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb2b0a75a0e9226 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:55.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54d67fc640 1 -- 172.21.15.53:0/3759942107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8003b70 con 0x564af9226350 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54d67fc640 1 -- 172.21.15.53:0/3759942107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54e8003d10 con 0x564af9226350 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54ed7fa640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54d80b4d50 0x7f54d80b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.644+0000 7f54d67fc640 1 -- 172.21.15.53:0/3759942107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8010910 con 0x564af9226350 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54effff640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54d80b4d50 0x7f54d80b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54ed7fa640 1 -- 172.21.15.53:0/1091695306 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f54e4105a80 con 0x7f54f0109240 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54fcf01740 1 -- 172.21.15.53:0/3759942107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 msgr2=0x564af95cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54effff640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54d80b4d50 0x7f54d80b7260 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x564af95cb400 tx=0x7f54e000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3759942107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95cc780 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f54e800ae10 tx=0x7f54e800f790 comp rx=0 tx=0).stop 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54fcf01740 1 -- 172.21.15.53:0/3759942107 shutdown_connections 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3759942107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af9205670 0x564af95cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3759942107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af91fd490 0x564af95cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3759942107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95cc780 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54fcf01740 1 -- 172.21.15.53:0/3759942107 >> 172.21.15.53:0/3759942107 conn(0x564af921a740 msgr2=0x564af95ca670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54fcf01740 1 -- 172.21.15.53:0/3759942107 shutdown_connections 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.645+0000 7f54fcf01740 1 -- 172.21.15.53:0/3759942107 wait complete. 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.646+0000 7f54fcf01740 1 -- start start 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.646+0000 7f54fcf01740 1 Processor -- start 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.646+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af91fd490 0x564af95d7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.646+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af9205670 0x564af95d84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.646+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95e42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.646+0000 7f54fcf01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564af9394890 con 0x564af9226350 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.646+0000 7f54fcf01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564af94b8790 con 0x564af9205670 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.646+0000 7f54fcf01740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564af95daf60 con 0x564af91fd490 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.646+0000 7f54fcf01740 10 client.0 _ll_register_callbacks cb 0x564af923dba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54f4f29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95e42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54f4f29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95e42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53286/0 (socket says 172.21.15.53:53286) 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54f4f29640 1 -- 172.21.15.53:0/3564366454 learned_addr learned my addr 172.21.15.53:0/3564366454 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54ef7fe640 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af9205670 0x564af95d84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54effff640 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af91fd490 0x564af95d7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54f4f29640 1 -- 172.21.15.53:0/3564366454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af91fd490 msgr2=0x564af95d7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54f4f29640 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af91fd490 0x564af95d7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54f4f29640 1 -- 172.21.15.53:0/3564366454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af9205670 msgr2=0x564af95d84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54f4f29640 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af9205670 0x564af95d84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54f4f29640 1 -- 172.21.15.53:0/3564366454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af94eff30 con 0x564af9226350 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54f4f29640 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95e42b0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f54e801a040 tx=0x7f54e8004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fcb6170c3bb609 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54cf7fe640 1 -- 172.21.15.53:0/3564366454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8010940 con 0x564af9226350 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54cf7fe640 1 -- 172.21.15.53:0/3564366454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f54e8010ae0 con 0x564af9226350 2024-08-31T06:25:55.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.647+0000 7f54fcf01740 1 -- 172.21.15.53:0/3564366454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54e8003d10 con 0x564af9226350 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54cf7fe640 1 -- 172.21.15.53:0/3564366454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f54e8031050 con 0x564af9226350 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54fcf01740 10 client.21888 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54fcf01740 1 -- 172.21.15.53:0/3564366454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x564af95e6da0 con 0x564af9226350 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54cf7fe640 1 -- 172.21.15.53:0/3564366454 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54e8003d10 con 0x564af9226350 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54cf7fe640 1 -- 172.21.15.53:0/3564366454 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f54e8023470 con 0x564af9226350 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54fcf01740 10 client.21888 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54fcf01740 10 client.21888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54fcf01740 20 client.21888 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564af91e4cd0 0x564af95ea210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54fcf01740 4 client.21888 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54fcf01740 1 -- 172.21.15.53:0/3564366454 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564af9544540 con 0x564af91e4cd0 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.648+0000 7f54effff640 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564af91e4cd0 0x564af95ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.649+0000 7f54effff640 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564af91e4cd0 0x564af95ea210 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e121d57d640a6632 server_cookie=bf16211b8f59b74b in_seq=0 out_seq=0 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.649+0000 7f54cf7fe640 10 client.21888 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54cf7fe640 1 -- 172.21.15.53:0/3564366454 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564af9544540 con 0x564af91e4cd0 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54cf7fe640 10 client.21888 handle_command_reply: tid=0 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 1 client.21888 shutdown 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 1 -- 172.21.15.53:0/3564366454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 msgr2=0x564af95e42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95e42b0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f54e801a040 tx=0x7f54e8004e30 comp rx=0 tx=0).stop 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 1 -- 172.21.15.53:0/3564366454 shutdown_connections 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564af91e4cd0 0x564af95ea210 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9226350 0x564af95e42b0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af9205670 0x564af95d84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54cf7fe640 0 client.21888 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3564366454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af91fd490 0x564af95d7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 1 -- 172.21.15.53:0/3564366454 >> 172.21.15.53:0/3564366454 conn(0x564af921a740 msgr2=0x564af95cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 1 -- 172.21.15.53:0/3564366454 shutdown_connections 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 1 -- 172.21.15.53:0/3564366454 wait complete. 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.650+0000 7f54fcf01740 20 client.21888 trim_cache size 0 max 16384 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54fcf01740 1 Processor -- start 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54fcf01740 1 -- start start 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af91fd490 0x564af95e41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95e46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af9226350 0x564af95d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54fcf01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f54f01af570 con 0x564af9205670 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54fcf01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54f01b12c0 con 0x564af9226350 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54fcf01740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54f01afcd0 con 0x564af91fd490 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95e46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95e46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53300/0 (socket says 172.21.15.53:53300) 2024-08-31T06:25:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54ef7fe640 1 -- 172.21.15.53:0/3450149015 learned_addr learned my addr 172.21.15.53:0/3450149015 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54f4f29640 1 --2- 172.21.15.53:0/3450149015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af9226350 0x564af95d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54effff640 1 --2- 172.21.15.53:0/3450149015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af91fd490 0x564af95e41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54ef7fe640 1 -- 172.21.15.53:0/3450149015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af91fd490 msgr2=0x564af95e41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54ef7fe640 1 --2- 172.21.15.53:0/3450149015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af91fd490 0x564af95e41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54ef7fe640 1 -- 172.21.15.53:0/3450149015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af9226350 msgr2=0x564af95d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54ef7fe640 1 --2- 172.21.15.53:0/3450149015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af9226350 0x564af95d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54ef7fe640 1 -- 172.21.15.53:0/3450149015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af95d9230 con 0x564af9205670 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.668+0000 7f54f4f29640 1 --2- 172.21.15.53:0/3450149015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af9226350 0x564af95d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.669+0000 7f54ef7fe640 1 --2- 172.21.15.53:0/3450149015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95e46f0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f54e40cc080 tx=0x7f54e40cbb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8489a2f03e2c3cde server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.669+0000 7f54d5ffb640 1 -- 172.21.15.53:0/3450149015 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4049040 con 0x564af9205670 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.669+0000 7f54d5ffb640 1 -- 172.21.15.53:0/3450149015 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54e4003e40 con 0x564af9205670 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.669+0000 7f54d5ffb640 1 -- 172.21.15.53:0/3450149015 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e40d0960 con 0x564af9205670 2024-08-31T06:25:55.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.670+0000 7f54fcf01740 1 -- 172.21.15.53:0/3450149015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 msgr2=0x564af95e46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.670+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3450149015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95e46f0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f54e40cc080 tx=0x7f54e40cbb00 comp rx=0 tx=0).stop 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.670+0000 7f54fcf01740 1 -- 172.21.15.53:0/3450149015 shutdown_connections 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.670+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3450149015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af9226350 0x564af95d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.670+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3450149015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95e46f0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.670+0000 7f54fcf01740 1 --2- 172.21.15.53:0/3450149015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af91fd490 0x564af95e41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.670+0000 7f54fcf01740 1 -- 172.21.15.53:0/3450149015 >> 172.21.15.53:0/3450149015 conn(0x564af921a740 msgr2=0x564af95ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.670+0000 7f54fcf01740 1 -- 172.21.15.53:0/3450149015 shutdown_connections 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.670+0000 7f54fcf01740 1 -- 172.21.15.53:0/3450149015 wait complete. 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.670+0000 7f54fcf01740 1 -- start start 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.670+0000 7f54fcf01740 1 Processor -- start 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af91fd490 0x564af95dc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95dce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54fcf01740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af9226350 0x564af96539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54fcf01740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f54f01b0b30 con 0x564af9205670 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54fcf01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54f01b03a0 con 0x564af91fd490 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54fcf01740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54f01ad570 con 0x564af9226350 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54fcf01740 10 client.0 _ll_register_callbacks cb 0x7f54e800ac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95dce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95dce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53314/0 (socket says 172.21.15.53:53314) 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54ef7fe640 1 -- 172.21.15.53:0/2169530519 learned_addr learned my addr 172.21.15.53:0/2169530519 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54effff640 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af91fd490 0x564af95dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54f4f29640 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af9226350 0x564af96539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54ef7fe640 1 -- 172.21.15.53:0/2169530519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af9226350 msgr2=0x564af96539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54ef7fe640 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af9226350 0x564af96539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54ef7fe640 1 -- 172.21.15.53:0/2169530519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af91fd490 msgr2=0x564af95dc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54ef7fe640 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af91fd490 0x564af95dc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54ef7fe640 1 -- 172.21.15.53:0/2169530519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af9653ef0 con 0x564af9205670 2024-08-31T06:25:55.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54ef7fe640 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95dce30 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f54e403b510 tx=0x7f54e4004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42155f2909e0c73c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:55.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:55.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.671+0000 7f54cf7fe640 1 -- 172.21.15.53:0/2169530519 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4049070 con 0x564af9205670 2024-08-31T06:25:55.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54cf7fe640 1 -- 172.21.15.53:0/2169530519 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f54e40c86e0 con 0x564af9205670 2024-08-31T06:25:55.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54fcf01740 1 -- 172.21.15.53:0/2169530519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564af953ffe0 con 0x564af9205670 2024-08-31T06:25:55.698 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:25:55.698 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:25:55.698 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "cb0f8810-b92a-4905-8f2c-4332eba53d62", 2024-08-31T06:25:55.698 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:25:55.698 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:25:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54cf7fe640 1 -- 172.21.15.53:0/2169530519 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f54e40cc7f0 con 0x564af9205670 2024-08-31T06:25:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54fcf01740 10 client.21894 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54fcf01740 1 -- 172.21.15.53:0/2169530519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x564af9655180 con 0x564af9205670 2024-08-31T06:25:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54cf7fe640 1 -- 172.21.15.53:0/2169530519 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564af953ffe0 con 0x564af9205670 2024-08-31T06:25:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54cf7fe640 1 -- 172.21.15.53:0/2169530519 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f54e40d3ce0 con 0x564af9205670 2024-08-31T06:25:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54fcf01740 10 client.21894 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54fcf01740 10 client.21894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54fcf01740 20 client.21894 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54fcf01740 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564af91ba080 0x564af9657840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54fcf01740 4 client.21894 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54fcf01740 1 -- 172.21.15.53:0/2169530519 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564af953d720 con 0x564af91ba080 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.672+0000 7f54effff640 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564af91ba080 0x564af9657840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.673+0000 7f54effff640 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564af91ba080 0x564af9657840 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a9a640b51d33b2d server_cookie=d646609f73ccf8e3 in_seq=0 out_seq=0 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.673+0000 7f54cf7fe640 10 client.21894 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54cf7fe640 1 -- 172.21.15.53:0/2169530519 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564af953d720 con 0x564af91ba080 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54cf7fe640 10 client.21894 handle_command_reply: tid=0 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54fcf01740 1 client.21894 shutdown 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54fcf01740 1 -- 172.21.15.53:0/2169530519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 msgr2=0x564af95dce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54fcf01740 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95dce30 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f54e403b510 tx=0x7f54e4004610 comp rx=0 tx=0).stop 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54fcf01740 1 -- 172.21.15.53:0/2169530519 shutdown_connections 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54fcf01740 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564af91ba080 0x564af9657840 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54fcf01740 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564af9226350 0x564af96539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54fcf01740 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af9205670 0x564af95dce30 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54fcf01740 1 --2- 172.21.15.53:0/2169530519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564af91fd490 0x564af95dc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54fcf01740 1 -- 172.21.15.53:0/2169530519 >> 172.21.15.53:0/2169530519 conn(0x564af921a740 msgr2=0x564af95ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.674+0000 7f54cf7fe640 0 client.21894 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.675+0000 7f54fcf01740 1 -- 172.21.15.53:0/2169530519 shutdown_connections 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.675+0000 7f54fcf01740 1 -- 172.21.15.53:0/2169530519 wait complete. 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.675+0000 7f54fcf01740 20 client.21894 trim_cache size 0 max 16384 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.675+0000 7f54f698c640 1 -- 172.21.15.53:0/1091695306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54d80b4d50 msgr2=0x7f54d80b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.675+0000 7f54f698c640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54d80b4d50 0x7f54d80b7260 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x564af95cb400 tx=0x7f54e000a2d0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.675+0000 7f54f698c640 1 -- 172.21.15.53:0/1091695306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f0109240 msgr2=0x7f54f019a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.675+0000 7f54f698c640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f0109240 0x7f54f019a7d0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f54e4005940 tx=0x7f54e40042f0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.675+0000 7f54f698c640 1 -- 172.21.15.53:0/1091695306 shutdown_connections 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.675+0000 7f54f698c640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f54d80b4d50 0x7f54d80b7260 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.675+0000 7f54f698c640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54f0109b90 0x7f54f019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.675+0000 7f54f698c640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f0109240 0x7f54f019a7d0 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.676+0000 7f54f698c640 1 --2- 172.21.15.53:0/1091695306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f0103900 0x7f54f019a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:55.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.676+0000 7f54f698c640 1 -- 172.21.15.53:0/1091695306 >> 172.21.15.53:0/1091695306 conn(0x7f54f007b5f0 msgr2=0x7f54f0107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:55.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.676+0000 7f54f698c640 1 -- 172.21.15.53:0/1091695306 shutdown_connections 2024-08-31T06:25:55.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:55.676+0000 7f54f698c640 1 -- 172.21.15.53:0/1091695306 wait complete. 2024-08-31T06:25:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:55 smithi130 ceph-mon[22266]: pgmap v982: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 287 op/s 2024-08-31T06:25:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:55 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:25:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:55 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:56.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:55 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:25:56.129 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:25:55 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:25:55.790+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000225 [...26,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM/ auth{1=1,2=1,3=1,4=1} v51897 ap=3 f(v3726 m2024-08-31T06:25:37.018623+0000 3=3+0) n(v53 rc2024-08-31T06:25:37.018623+0000 b780288 4=3+1) old_inodes=6 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:3490 nref=3)) caps={15441=pAsLsXsFs/-@49027} | dirtyscattered=0 request=1 lock=2 importing=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e69bc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000225:[<0x10000000009/PM v1172>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000225:[<0x10000000009/PM v51897>,<0x10000000008/~dmtmp v30801>,<0x10000000007/client0 v2993>,<0x10000000006/clients v2673>,<0x10000000005/tmp v1893>,<0x10000000003/client.0 v1858>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v1829>,<0x10000000001/sv_0 v1822>,<0x10000000000/qa v1800>,<0x1/volumes v1719>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:25:35.908111+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:25:37.018623+0000 b780288 4=3+1)","memory_value.dirstat":"f(v3726 m2024-08-31T06:25:37.018623+0000 3=3+0)","memory_value.rstat":"n(v53 rc2024-08-31T06:25:37.018623+0000 b780288 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:25:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:55 smithi153 ceph-mon[22320]: pgmap v982: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 287 op/s 2024-08-31T06:25:56.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:55 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:25:56.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:55 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:56.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:55 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:25:56.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:55 smithi053 ceph-mon[18924]: pgmap v982: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 287 op/s 2024-08-31T06:25:56.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:55 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:25:56.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:55 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:56.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:55 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:25:56.375 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:25:56.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49949 5.58 MB/sec execute 344 sec latency 7243.860 ms 2024-08-31T06:25:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:57.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:56 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:25:57.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:56 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:25:57.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:56 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:25:57.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:56 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:25:57.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:56 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:25:57.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:56 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:56 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:56 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.018 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:56 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.018 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:56 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.107+0000 7ff130c0f640 1 -- 172.21.15.53:0/245722112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12c102820 msgr2=0x7ff12c102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.107+0000 7ff130c0f640 1 --2- 172.21.15.53:0/245722112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12c102820 0x7ff12c102c30 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009900 tx=0x7ff11c02a410 comp rx=0 tx=0).stop 2024-08-31T06:25:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.108+0000 7ff130c0f640 1 -- 172.21.15.53:0/245722112 shutdown_connections 2024-08-31T06:25:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.108+0000 7ff130c0f640 1 --2- 172.21.15.53:0/245722112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c108ab0 0x7ff12c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.108+0000 7ff130c0f640 1 --2- 172.21.15.53:0/245722112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff12c108160 0x7ff12c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.108+0000 7ff130c0f640 1 --2- 172.21.15.53:0/245722112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12c102820 0x7ff12c102c30 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.108+0000 7ff130c0f640 1 -- 172.21.15.53:0/245722112 >> 172.21.15.53:0/245722112 conn(0x7ff12c0794e0 msgr2=0x7ff12c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.108+0000 7ff130c0f640 1 -- 172.21.15.53:0/245722112 shutdown_connections 2024-08-31T06:25:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.108+0000 7ff130c0f640 1 -- 172.21.15.53:0/245722112 wait complete. 2024-08-31T06:25:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.108+0000 7ff130c0f640 1 Processor -- start 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff130c0f640 1 -- start start 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff130c0f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c102820 0x7ff12c1990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff130c0f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff12c108160 0x7ff12c199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff130c0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12c108ab0 0x7ff12c19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff130c0f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1125c0 con 0x7ff12c108ab0 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff130c0f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c112440 con 0x7ff12c108160 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff130c0f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c112740 con 0x7ff12c102820 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff12ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12c108ab0 0x7ff12c19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff12ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12c108ab0 0x7ff12c19e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53326/0 (socket says 172.21.15.53:53326) 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff12ad9d640 1 -- 172.21.15.53:0/2259476680 learned_addr learned my addr 172.21.15.53:0/2259476680 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff129d9b640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff12c108160 0x7ff12c199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff12a59c640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c102820 0x7ff12c1990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff12ad9d640 1 -- 172.21.15.53:0/2259476680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c102820 msgr2=0x7ff12c1990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff12ad9d640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c102820 0x7ff12c1990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff12ad9d640 1 -- 172.21.15.53:0/2259476680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff12c108160 msgr2=0x7ff12c199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff12ad9d640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff12c108160 0x7ff12c199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.109+0000 7ff12ad9d640 1 -- 172.21.15.53:0/2259476680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c19f020 con 0x7ff12c108ab0 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.110+0000 7ff12ad9d640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12c108ab0 0x7ff12c19e8f0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7ff12400cad0 tx=0x7ff12400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.110+0000 7ff1237fe640 1 -- 172.21.15.53:0/2259476680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12400ae20 con 0x7ff12c108ab0 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.110+0000 7ff1237fe640 1 -- 172.21.15.53:0/2259476680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff124005020 con 0x7ff12c108ab0 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.110+0000 7ff130c0f640 1 -- 172.21.15.53:0/2259476680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12c19f310 con 0x7ff12c108ab0 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.110+0000 7ff1237fe640 1 -- 172.21.15.53:0/2259476680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12400f6b0 con 0x7ff12c108ab0 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.110+0000 7ff130c0f640 1 -- 172.21.15.53:0/2259476680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12c1a5a70 con 0x7ff12c108ab0 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.113+0000 7ff137184740 1 Processor -- start 2024-08-31T06:25:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.113+0000 7ff1237fe640 1 -- 172.21.15.53:0/2259476680 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff1240051d0 con 0x7ff12c108ab0 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.113+0000 7ff137184740 1 -- start start 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff137184740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49e3070 0x5565a4d8ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff137184740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49ba1b0 0x5565a4d882c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff137184740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49c2390 0x5565a4d88950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff137184740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5565a4cff630 con 0x5565a49e3070 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff137184740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565a4ceebc0 con 0x5565a49ba1b0 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff137184740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5565a4cf2b70 con 0x5565a49c2390 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff129d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49e3070 0x5565a4d8ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff129d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49e3070 0x5565a4d8ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53336/0 (socket says 172.21.15.53:53336) 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff129d9b640 1 -- 172.21.15.53:0/189869044 learned_addr learned my addr 172.21.15.53:0/189869044 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff12a59c640 1 --2- 172.21.15.53:0/189869044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49ba1b0 0x5565a4d882c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff129d9b640 1 --2- 172.21.15.53:0/189869044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49c2390 0x5565a4d88950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff1237fe640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff1180b4ca0 0x7ff1180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff12a59c640 1 -- 172.21.15.53:0/189869044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49c2390 msgr2=0x5565a4d88950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff12a59c640 1 --2- 172.21.15.53:0/189869044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49c2390 0x5565a4d88950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff12a59c640 1 -- 172.21.15.53:0/189869044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49e3070 msgr2=0x5565a4d8ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff12a59c640 1 --2- 172.21.15.53:0/189869044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49e3070 0x5565a4d8ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff12a59c640 1 -- 172.21.15.53:0/189869044 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565a4a4e650 con 0x5565a49ba1b0 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.114+0000 7ff12ad9d640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff1180b4ca0 0x7ff1180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.115+0000 7ff1237fe640 1 -- 172.21.15.53:0/2259476680 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7ff1240e5850 con 0x7ff12c108ab0 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.115+0000 7ff12a59c640 1 --2- 172.21.15.53:0/189869044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49ba1b0 0x5565a4d882c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005940 tx=0x7ff11c031dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf0dd6fdef07844c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.115+0000 7ff120ff9640 1 -- 172.21.15.53:0/189869044 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c035030 con 0x5565a49ba1b0 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.115+0000 7ff12ad9d640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff1180b4ca0 0x7ff1180b71b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff1240abcd0 tx=0x7ff12400eb70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.115+0000 7ff120ff9640 1 -- 172.21.15.53:0/189869044 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff11c040070 con 0x5565a49ba1b0 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.115+0000 7ff120ff9640 1 -- 172.21.15.53:0/189869044 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c003970 con 0x5565a49ba1b0 2024-08-31T06:25:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.116+0000 7ff137184740 1 -- 172.21.15.53:0/189869044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49ba1b0 msgr2=0x5565a4d882c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.116+0000 7ff137184740 1 --2- 172.21.15.53:0/189869044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49ba1b0 0x5565a4d882c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005940 tx=0x7ff11c031dc0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.116+0000 7ff137184740 1 -- 172.21.15.53:0/189869044 shutdown_connections 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.116+0000 7ff137184740 1 --2- 172.21.15.53:0/189869044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49c2390 0x5565a4d88950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.116+0000 7ff137184740 1 --2- 172.21.15.53:0/189869044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49ba1b0 0x5565a4d882c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.116+0000 7ff137184740 1 --2- 172.21.15.53:0/189869044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49e3070 0x5565a4d8ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.116+0000 7ff137184740 1 -- 172.21.15.53:0/189869044 >> 172.21.15.53:0/189869044 conn(0x5565a49d7460 msgr2=0x5565a4d861b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.116+0000 7ff137184740 1 -- 172.21.15.53:0/189869044 shutdown_connections 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.116+0000 7ff137184740 1 -- 172.21.15.53:0/189869044 wait complete. 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.116+0000 7ff137184740 1 -- start start 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.116+0000 7ff137184740 1 Processor -- start 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff137184740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4d97fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff137184740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49c2390 0x5565a4d98500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff137184740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49e3070 0x5565a4da4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff137184740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5565a4b51700 con 0x5565a49c2390 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff137184740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565a4c75700 con 0x5565a49e3070 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff137184740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5565a4d9ad90 con 0x5565a49ba1b0 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff137184740 10 client.0 _ll_register_callbacks cb 0x5565a4ca4dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff12a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49c2390 0x5565a4d98500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff12a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49c2390 0x5565a4d98500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53342/0 (socket says 172.21.15.53:53342) 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff12a59c640 1 -- 172.21.15.53:0/3458371496 learned_addr learned my addr 172.21.15.53:0/3458371496 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff129d9b640 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4d97fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff129d9b640 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49e3070 0x5565a4da4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff12a59c640 1 -- 172.21.15.53:0/3458371496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 msgr2=0x5565a4d97fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff12a59c640 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4d97fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff12a59c640 1 -- 172.21.15.53:0/3458371496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49e3070 msgr2=0x5565a4da4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff12a59c640 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49e3070 0x5565a4da4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff12a59c640 1 -- 172.21.15.53:0/3458371496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565a4cae8b0 con 0x5565a49c2390 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff12a59c640 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49c2390 0x5565a4d98500 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0092a0 tx=0x7ff11c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d750a5e78238d8c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.117+0000 7ff111ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff111ffb640 1 -- 172.21.15.53:0/3458371496 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c053060 con 0x5565a49c2390 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff111ffb640 1 -- 172.21.15.53:0/3458371496 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7ff11c004240 con 0x5565a49c2390 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff137184740 1 -- 172.21.15.53:0/3458371496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff11c040070 con 0x5565a49c2390 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff111ffb640 1 -- 172.21.15.53:0/3458371496 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7ff11c035040 con 0x5565a49c2390 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff137184740 10 client.21906 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff137184740 1 -- 172.21.15.53:0/3458371496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x5565a4da6bd0 con 0x5565a49c2390 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff111ffb640 1 -- 172.21.15.53:0/3458371496 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff11c040070 con 0x5565a49c2390 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff111ffb640 1 -- 172.21.15.53:0/3458371496 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7ff11c04d030 con 0x5565a49c2390 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff137184740 10 client.21906 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff137184740 10 client.21906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff137184740 20 client.21906 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff137184740 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5565a49a19f0 0x5565a4da9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff137184740 4 client.21906 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.118+0000 7ff137184740 1 -- 172.21.15.53:0/3458371496 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565a4d01580 con 0x5565a49a19f0 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.119+0000 7ff129d9b640 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5565a49a19f0 0x5565a4da9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.119+0000 7ff129d9b640 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5565a49a19f0 0x5565a4da9f30 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16fefd6a2162d7e1 server_cookie=521633e296f941c5 in_seq=0 out_seq=0 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.119+0000 7ff111ffb640 10 client.21906 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff111ffb640 1 -- 172.21.15.53:0/3458371496 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5565a4d01580 con 0x5565a49a19f0 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff111ffb640 10 client.21906 handle_command_reply: tid=0 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 1 client.21906 shutdown 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 1 -- 172.21.15.53:0/3458371496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49c2390 msgr2=0x5565a4d98500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49c2390 0x5565a4d98500 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0092a0 tx=0x7ff11c031630 comp rx=0 tx=0).stop 2024-08-31T06:25:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 1 -- 172.21.15.53:0/3458371496 shutdown_connections 2024-08-31T06:25:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5565a49a19f0 0x5565a4da9f30 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49e3070 0x5565a4da4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49c2390 0x5565a4d98500 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff111ffb640 0 client.21906 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 1 --2- 172.21.15.53:0/3458371496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4d97fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 1 -- 172.21.15.53:0/3458371496 >> 172.21.15.53:0/3458371496 conn(0x5565a49d7460 msgr2=0x5565a4d84770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 1 -- 172.21.15.53:0/3458371496 shutdown_connections 2024-08-31T06:25:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 1 -- 172.21.15.53:0/3458371496 wait complete. 2024-08-31T06:25:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.120+0000 7ff137184740 20 client.21906 trim_cache size 0 max 16384 2024-08-31T06:25:57.140 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:25:57.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.138+0000 7ff137184740 1 Processor -- start 2024-08-31T06:25:57.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.138+0000 7ff137184740 1 -- start start 2024-08-31T06:25:57.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.138+0000 7ff137184740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4d8e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.138+0000 7ff137184740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4d880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.138+0000 7ff137184740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49c2390 0x5565a4da40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.138+0000 7ff137184740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1ad290 con 0x5565a49a19f0 2024-08-31T06:25:57.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.138+0000 7ff137184740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1aefe0 con 0x5565a49c2390 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.138+0000 7ff137184740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1ad9f0 con 0x5565a49ba1b0 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.138+0000 7ff129d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4d8e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.138+0000 7ff129d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4d8e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53346/0 (socket says 172.21.15.53:53346) 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.138+0000 7ff129d9b640 1 -- 172.21.15.53:0/2563108756 learned_addr learned my addr 172.21.15.53:0/2563108756 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.139+0000 7ff12a59c640 1 --2- 172.21.15.53:0/2563108756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4d880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.139+0000 7ff129d9b640 1 -- 172.21.15.53:0/2563108756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 msgr2=0x5565a4d880e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.139+0000 7ff129d9b640 1 --2- 172.21.15.53:0/2563108756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4d880e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.139+0000 7ff129d9b640 1 -- 172.21.15.53:0/2563108756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49c2390 msgr2=0x5565a4da40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.139+0000 7ff129d9b640 1 --2- 172.21.15.53:0/2563108756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49c2390 0x5565a4da40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.139+0000 7ff129d9b640 1 -- 172.21.15.53:0/2563108756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565a4d99280 con 0x5565a49a19f0 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.139+0000 7ff12a59c640 1 --2- 172.21.15.53:0/2563108756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4d880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.139+0000 7ff129d9b640 1 --2- 172.21.15.53:0/2563108756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4d8e450 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7ff11400bca0 tx=0x7ff114004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368aaee3bb95f527 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.139+0000 7ff113fff640 1 -- 172.21.15.53:0/2563108756 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114005020 con 0x5565a49a19f0 2024-08-31T06:25:57.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.139+0000 7ff113fff640 1 -- 172.21.15.53:0/2563108756 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1140047a0 con 0x5565a49a19f0 2024-08-31T06:25:57.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.139+0000 7ff113fff640 1 -- 172.21.15.53:0/2563108756 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114005650 con 0x5565a49a19f0 2024-08-31T06:25:57.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.140+0000 7ff137184740 1 -- 172.21.15.53:0/2563108756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 msgr2=0x5565a4d8e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:57.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.140+0000 7ff137184740 1 --2- 172.21.15.53:0/2563108756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4d8e450 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7ff11400bca0 tx=0x7ff114004730 comp rx=0 tx=0).stop 2024-08-31T06:25:57.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.140+0000 7ff137184740 1 -- 172.21.15.53:0/2563108756 shutdown_connections 2024-08-31T06:25:57.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.140+0000 7ff137184740 1 --2- 172.21.15.53:0/2563108756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49c2390 0x5565a4da40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.140+0000 7ff137184740 1 --2- 172.21.15.53:0/2563108756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4d880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.140+0000 7ff137184740 1 --2- 172.21.15.53:0/2563108756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4d8e450 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.140+0000 7ff137184740 1 -- 172.21.15.53:0/2563108756 >> 172.21.15.53:0/2563108756 conn(0x5565a49d7460 msgr2=0x5565a4d84ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:57.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.140+0000 7ff137184740 1 -- 172.21.15.53:0/2563108756 shutdown_connections 2024-08-31T06:25:57.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.140+0000 7ff137184740 1 -- 172.21.15.53:0/2563108756 wait complete. 2024-08-31T06:25:57.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.140+0000 7ff137184740 1 -- start start 2024-08-31T06:25:57.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff137184740 1 Processor -- start 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff137184740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4dacf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff137184740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4dad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff137184740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49c2390 0x5565a4da9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff137184740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1ae850 con 0x5565a49a19f0 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff137184740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1ae0c0 con 0x5565a49c2390 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff137184740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1ab290 con 0x5565a49ba1b0 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff137184740 10 client.0 _ll_register_callbacks cb 0x7ff11400bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff129d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4dacf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff129d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4dacf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53350/0 (socket says 172.21.15.53:53350) 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff129d9b640 1 -- 172.21.15.53:0/4273476927 learned_addr learned my addr 172.21.15.53:0/4273476927 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff129d9b640 1 -- 172.21.15.53:0/4273476927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 msgr2=0x5565a4dad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff129d9b640 1 --2- 172.21.15.53:0/4273476927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4dad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff129d9b640 1 -- 172.21.15.53:0/4273476927 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49c2390 msgr2=0x5565a4da9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff129d9b640 1 --2- 172.21.15.53:0/4273476927 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49c2390 0x5565a4da9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.141+0000 7ff129d9b640 1 -- 172.21.15.53:0/4273476927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565a4daa470 con 0x5565a49a19f0 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.142+0000 7ff129d9b640 1 --2- 172.21.15.53:0/4273476927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4dacf60 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7ff114004650 tx=0x7ff114004c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2696e6e2dfc54fda server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.142+0000 7ff111ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.142+0000 7ff111ffb640 1 -- 172.21.15.53:0/4273476927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114005230 con 0x5565a49a19f0 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.142+0000 7ff111ffb640 1 -- 172.21.15.53:0/4273476927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7ff1140053d0 con 0x5565a49a19f0 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.142+0000 7ff137184740 1 -- 172.21.15.53:0/4273476927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1140047a0 con 0x5565a49a19f0 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.142+0000 7ff111ffb640 1 -- 172.21.15.53:0/4273476927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7ff1140055d0 con 0x5565a49a19f0 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.142+0000 7ff137184740 10 client.21912 fetch_fsmap learned FSMap version 75 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.142+0000 7ff137184740 1 -- 172.21.15.53:0/4273476927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x5565a4e14d80 con 0x5565a49a19f0 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.142+0000 7ff111ffb640 1 -- 172.21.15.53:0/4273476927 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1140047a0 con 0x5565a49a19f0 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.142+0000 7ff111ffb640 1 -- 172.21.15.53:0/4273476927 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7ff11403d030 con 0x5565a49a19f0 2024-08-31T06:25:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.143+0000 7ff137184740 10 client.21912 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.143+0000 7ff137184740 10 client.21912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.143+0000 7ff137184740 20 client.21912 populate_metadata read hostname 'smithi053' 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.143+0000 7ff137184740 1 --2- 172.21.15.53:0/4273476927 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5565a49e3070 0x5565a4e17580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.143+0000 7ff137184740 4 client.21912 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.143+0000 7ff137184740 1 -- 172.21.15.53:0/4273476927 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5565a4cfd020 con 0x5565a49e3070 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.143+0000 7ff12a59c640 1 --2- 172.21.15.53:0/4273476927 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5565a49e3070 0x5565a4e17580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.143+0000 7ff111ffb640 10 client.21912 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.143+0000 7ff12a59c640 1 --2- 172.21.15.53:0/4273476927 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5565a49e3070 0x5565a4e17580 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61987ff6bf91cd1b server_cookie=60d74332259f79a in_seq=0 out_seq=0 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff111ffb640 1 -- 172.21.15.53:0/4273476927 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7670 (crc 0 0 0) 0x5565a4cfd020 con 0x5565a49e3070 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff111ffb640 10 client.21912 handle_command_reply: tid=0 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 1 client.21912 shutdown 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 1 -- 172.21.15.53:0/4273476927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 msgr2=0x5565a4dacf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:57.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 1 --2- 172.21.15.53:0/4273476927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4dacf60 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7ff114004650 tx=0x7ff114004c30 comp rx=0 tx=0).stop 2024-08-31T06:25:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 1 -- 172.21.15.53:0/4273476927 shutdown_connections 2024-08-31T06:25:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 1 --2- 172.21.15.53:0/4273476927 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5565a49e3070 0x5565a4e17580 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 1 --2- 172.21.15.53:0/4273476927 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565a49c2390 0x5565a4da9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff111ffb640 0 client.21912 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:25:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 1 --2- 172.21.15.53:0/4273476927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5565a49ba1b0 0x5565a4dad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 1 --2- 172.21.15.53:0/4273476927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565a49a19f0 0x5565a4dacf60 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 1 -- 172.21.15.53:0/4273476927 >> 172.21.15.53:0/4273476927 conn(0x5565a49d7460 msgr2=0x5565a4d99450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 1 -- 172.21.15.53:0/4273476927 shutdown_connections 2024-08-31T06:25:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 1 -- 172.21.15.53:0/4273476927 wait complete. 2024-08-31T06:25:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.144+0000 7ff137184740 20 client.21912 trim_cache size 0 max 16384 2024-08-31T06:25:57.151 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:25:57.152 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:25:57.152 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:25:57.152 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:25:57.152 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.152 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "cb0f8810-b92a-4905-8f2c-4332eba53d62", 2024-08-31T06:25:57.152 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:25:57.152 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:25:57.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.152 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:25:57.152 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:25:57.152 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.154 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:25:55.673122+0000", 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.155 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.156 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.157 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.158 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.159 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.160 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.161 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.162 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.163 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.164 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:25:57.165 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:25:57.167 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:25:57.168 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:25:57.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:25:57.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:25:57.168 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:25:57.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 -- 172.21.15.53:0/2259476680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff1180b4ca0 msgr2=0x7ff1180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:57.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff1180b4ca0 0x7ff1180b71b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff1240abcd0 tx=0x7ff12400eb70 comp rx=0 tx=0).stop 2024-08-31T06:25:57.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 -- 172.21.15.53:0/2259476680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12c108ab0 msgr2=0x7ff12c19e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:57.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12c108ab0 0x7ff12c19e8f0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7ff12400cad0 tx=0x7ff12400cf90 comp rx=0 tx=0).stop 2024-08-31T06:25:57.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 -- 172.21.15.53:0/2259476680 shutdown_connections 2024-08-31T06:25:57.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff1180b4ca0 0x7ff1180b71b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12c108ab0 0x7ff12c19e8f0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff12c108160 0x7ff12c199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 --2- 172.21.15.53:0/2259476680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c102820 0x7ff12c1990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:57.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 -- 172.21.15.53:0/2259476680 >> 172.21.15.53:0/2259476680 conn(0x7ff12c0794e0 msgr2=0x7ff12c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:57.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 -- 172.21.15.53:0/2259476680 shutdown_connections 2024-08-31T06:25:57.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:57.145+0000 7ff130c0f640 1 -- 172.21.15.53:0/2259476680 wait complete. 2024-08-31T06:25:57.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:56 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:25:57.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:56 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:25:57.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:56 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:25:57.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:56 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:25:57.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:56 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:25:57.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:56 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:56 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:56 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:56 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:56 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:56 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:25:57.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:56 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:25:57.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:56 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:25:57.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:56 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:25:57.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:56 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:25:57.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:56 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:56 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:56 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:56 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:56 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:25:57.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49949 5.56 MB/sec execute 345 sec latency 8243.888 ms 2024-08-31T06:25:58.135 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:57 smithi053 ceph-mon[18924]: pgmap v983: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-08-31T06:25:58.169 INFO:tasks.cephfs.filesystem:scrub status for tag:cb0f8810-b92a-4905-8f2c-4332eba53d62 - {'path': '/', 'tag': 'cb0f8810-b92a-4905-8f2c-4332eba53d62', 'options': 'recursive,force'} 2024-08-31T06:25:58.173 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:25:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:57 smithi153 ceph-mon[22320]: pgmap v983: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-08-31T06:25:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:57 smithi130 ceph-mon[22266]: pgmap v983: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-08-31T06:25:58.400 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49949 5.55 MB/sec execute 346 sec latency 9243.921 ms 2024-08-31T06:25:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.614+0000 7ff47e135640 1 -- 172.21.15.53:0/4115849445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff478109240 msgr2=0x7ff478109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.614+0000 7ff47e135640 1 --2- 172.21.15.53:0/4115849445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff478109240 0x7ff478109650 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7ff460009900 tx=0x7ff46002a410 comp rx=0 tx=0).stop 2024-08-31T06:25:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.614+0000 7ff47e135640 1 -- 172.21.15.53:0/4115849445 shutdown_connections 2024-08-31T06:25:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.614+0000 7ff47e135640 1 --2- 172.21.15.53:0/4115849445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff478109b90 0x7ff4781103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.614+0000 7ff47e135640 1 --2- 172.21.15.53:0/4115849445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff478109240 0x7ff478109650 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.615+0000 7ff47e135640 1 --2- 172.21.15.53:0/4115849445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff478103900 0x7ff478103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.615+0000 7ff47e135640 1 -- 172.21.15.53:0/4115849445 >> 172.21.15.53:0/4115849445 conn(0x7ff47807b5f0 msgr2=0x7ff47807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.615+0000 7ff47e135640 1 -- 172.21.15.53:0/4115849445 shutdown_connections 2024-08-31T06:25:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.615+0000 7ff47e135640 1 -- 172.21.15.53:0/4115849445 wait complete. 2024-08-31T06:25:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.615+0000 7ff47e135640 1 Processor -- start 2024-08-31T06:25:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.615+0000 7ff47e135640 1 -- start start 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff47e135640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff478103900 0x7ff47819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff47e135640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff478109240 0x7ff47819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff47e135640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff478109b90 0x7ff47819fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff47e135640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff4781137a0 con 0x7ff478109b90 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff47e135640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff478113620 con 0x7ff478103900 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff47e135640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff478113920 con 0x7ff478109240 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff477fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff478109b90 0x7ff47819fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff477fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff478109b90 0x7ff47819fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53360/0 (socket says 172.21.15.53:53360) 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff477fff640 1 -- 172.21.15.53:0/1758269874 learned_addr learned my addr 172.21.15.53:0/1758269874 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff4777fe640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff478103900 0x7ff47819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff46effd640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff478109240 0x7ff47819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff477fff640 1 -- 172.21.15.53:0/1758269874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff478109240 msgr2=0x7ff47819a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff477fff640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff478109240 0x7ff47819a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff477fff640 1 -- 172.21.15.53:0/1758269874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff478103900 msgr2=0x7ff47819a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff477fff640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff478103900 0x7ff47819a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff477fff640 1 -- 172.21.15.53:0/1758269874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4781a0260 con 0x7ff478109b90 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff4777fe640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff478103900 0x7ff47819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff477fff640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff478109b90 0x7ff47819fb30 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7ff47000b970 tx=0x7ff47000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.616+0000 7ff4757fa640 1 -- 172.21.15.53:0/1758269874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff470019070 con 0x7ff478109b90 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.617+0000 7ff47e135640 1 -- 172.21.15.53:0/1758269874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4781a0550 con 0x7ff478109b90 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.617+0000 7ff4757fa640 1 -- 172.21.15.53:0/1758269874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff470014440 con 0x7ff478109b90 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.617+0000 7ff4757fa640 1 -- 172.21.15.53:0/1758269874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4700075d0 con 0x7ff478109b90 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.617+0000 7ff47e135640 1 -- 172.21.15.53:0/1758269874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4781a6cb0 con 0x7ff478109b90 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.618+0000 7ff47e135640 1 -- 172.21.15.53:0/1758269874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff478103d90 con 0x7ff478109b90 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.619+0000 7ff4757fa640 1 -- 172.21.15.53:0/1758269874 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff47001c070 con 0x7ff478109b90 2024-08-31T06:25:58.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.620+0000 7ff4757fa640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4640b4ca0 0x7ff4640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:25:58.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.620+0000 7ff4777fe640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4640b4ca0 0x7ff4640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:25:58.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.620+0000 7ff4757fa640 1 -- 172.21.15.53:0/1758269874 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7ff4700e4fe0 con 0x7ff478109b90 2024-08-31T06:25:58.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.620+0000 7ff4777fe640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4640b4ca0 0x7ff4640b71b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff468009930 tx=0x7ff468008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:25:58.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.623+0000 7ff4757fa640 1 -- 172.21.15.53:0/1758269874 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff4700abd50 con 0x7ff478109b90 2024-08-31T06:25:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.849+0000 7ff47e135640 1 -- 172.21.15.53:0/1758269874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff47819b420 con 0x7ff478109b90 2024-08-31T06:25:58.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.850+0000 7ff4757fa640 1 -- 172.21.15.53:0/1758269874 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+12004 (secure 0 0 0) 0x7ff47819b420 con 0x7ff478109b90 2024-08-31T06:25:58.852 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:25:58.853 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":75,"btime":"2024-08-31T06:25:18:805159+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":75,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:25:18.762328+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:25:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 75 2024-08-31T06:25:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 -- 172.21.15.53:0/1758269874 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4640b4ca0 msgr2=0x7ff4640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4640b4ca0 0x7ff4640b71b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff468009930 tx=0x7ff468008040 comp rx=0 tx=0).stop 2024-08-31T06:25:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 -- 172.21.15.53:0/1758269874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff478109b90 msgr2=0x7ff47819fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:25:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff478109b90 0x7ff47819fb30 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7ff47000b970 tx=0x7ff47000be30 comp rx=0 tx=0).stop 2024-08-31T06:25:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 -- 172.21.15.53:0/1758269874 shutdown_connections 2024-08-31T06:25:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4640b4ca0 0x7ff4640b71b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff478109b90 0x7ff47819fb30 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff478109240 0x7ff47819a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 --2- 172.21.15.53:0/1758269874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff478103900 0x7ff47819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:25:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 -- 172.21.15.53:0/1758269874 >> 172.21.15.53:0/1758269874 conn(0x7ff47807b5f0 msgr2=0x7ff478107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:25:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 -- 172.21.15.53:0/1758269874 shutdown_connections 2024-08-31T06:25:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:25:58.853+0000 7ff47e135640 1 -- 172.21.15.53:0/1758269874 wait complete. 2024-08-31T06:25:59.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:58 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1758269874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:25:59.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:58 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1758269874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:25:59.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:58 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1758269874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:25:59.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49949 5.53 MB/sec execute 347 sec latency 10243.984 ms 2024-08-31T06:25:59.501 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id 52882e46 --release --await' 2024-08-31T06:25:59.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id 52882e46 --release --await 2024-08-31T06:25:59.794 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:25:59 smithi153 ceph-mon[22320]: pgmap v984: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.7 MiB/s wr, 184 op/s 2024-08-31T06:26:00.176 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:25:59 smithi053 ceph-mon[18924]: pgmap v984: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.7 MiB/s wr, 184 op/s 2024-08-31T06:26:00.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.287+0000 7f79d26fa640 1 -- 172.21.15.53:0/3834916807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79cc104f10 msgr2=0x7f79cc105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:00.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.287+0000 7f79d26fa640 1 --2- 172.21.15.53:0/3834916807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79cc104f10 0x7f79cc105320 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009900 tx=0x7f79c002a410 comp rx=0 tx=0).stop 2024-08-31T06:26:00.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.287+0000 7f79d26fa640 1 -- 172.21.15.53:0/3834916807 shutdown_connections 2024-08-31T06:26:00.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.287+0000 7f79d26fa640 1 --2- 172.21.15.53:0/3834916807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79cc105860 0x7f79cc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.287+0000 7f79d26fa640 1 --2- 172.21.15.53:0/3834916807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79cc104f10 0x7f79cc105320 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.287+0000 7f79d26fa640 1 --2- 172.21.15.53:0/3834916807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79cc102f00 0x7f79cc103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.287+0000 7f79d26fa640 1 -- 172.21.15.53:0/3834916807 >> 172.21.15.53:0/3834916807 conn(0x7f79cc077a00 msgr2=0x7f79cc077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.287+0000 7f79d26fa640 1 -- 172.21.15.53:0/3834916807 shutdown_connections 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.287+0000 7f79d26fa640 1 -- 172.21.15.53:0/3834916807 wait complete. 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.288+0000 7f79d26fa640 1 Processor -- start 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.288+0000 7f79d26fa640 1 -- start start 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79d26fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79cc102f00 0x7f79cc19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79d26fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79cc104f10 0x7f79cc19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79d26fa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79cc105860 0x7f79cc19fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79d26fa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc112630 con 0x7f79cc102f00 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79d26fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc1124b0 con 0x7f79cc104f10 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79d26fa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc1127b0 con 0x7f79cc105860 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79cc102f00 0x7f79cc19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79cc102f00 0x7f79cc19a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53374/0 (socket says 172.21.15.53:53374) 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79cbfff640 1 -- 172.21.15.53:0/2218720859 learned_addr learned my addr 172.21.15.53:0/2218720859 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:00.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79d0c97640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79cc105860 0x7f79cc19fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79cb7fe640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79cc104f10 0x7f79cc19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79cb7fe640 1 -- 172.21.15.53:0/2218720859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79cc105860 msgr2=0x7f79cc19fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79cb7fe640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79cc105860 0x7f79cc19fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79cb7fe640 1 -- 172.21.15.53:0/2218720859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79cc102f00 msgr2=0x7f79cc19a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79cb7fe640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79cc102f00 0x7f79cc19a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.289+0000 7f79cb7fe640 1 -- 172.21.15.53:0/2218720859 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc1a01c0 con 0x7f79cc104f10 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.290+0000 7f79cb7fe640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79cc104f10 0x7f79cc19a7f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f79c002aa00 tx=0x7f79c0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.290+0000 7f79c97fa640 1 -- 172.21.15.53:0/2218720859 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c003f070 con 0x7f79cc104f10 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.290+0000 7f79c97fa640 1 -- 172.21.15.53:0/2218720859 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79c003bb00 con 0x7f79cc104f10 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.290+0000 7f79c97fa640 1 -- 172.21.15.53:0/2218720859 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0035030 con 0x7f79cc104f10 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.290+0000 7f79d26fa640 1 -- 172.21.15.53:0/2218720859 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79cc1a0450 con 0x7f79cc104f10 2024-08-31T06:26:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.290+0000 7f79d26fa640 1 -- 172.21.15.53:0/2218720859 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79cc1092a0 con 0x7f79cc104f10 2024-08-31T06:26:00.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.293+0000 7f79d8c6f740 1 Processor -- start 2024-08-31T06:26:00.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.293+0000 7f79c97fa640 1 -- 172.21.15.53:0/2218720859 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f79c0042070 con 0x7f79cc104f10 2024-08-31T06:26:00.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.293+0000 7f79d8c6f740 1 -- start start 2024-08-31T06:26:00.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.293+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96d8520 0x55eec9a7dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.293+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a7e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.293+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 0x55eec9a7e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eec99f4a70 con 0x55eec96af660 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55eec99e4000 con 0x55eec96b7840 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55eec99e7fb0 con 0x55eec96d8520 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a7e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a7e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53378/0 (socket says 172.21.15.53:53378) 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79cb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 0x55eec9a7e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79cbfff640 1 -- 172.21.15.53:0/4291235898 learned_addr learned my addr 172.21.15.53:0/4291235898 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79cbfff640 1 -- 172.21.15.53:0/4291235898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96d8520 msgr2=0x55eec9a7dc80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79cbfff640 1 --2- 172.21.15.53:0/4291235898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96d8520 0x55eec9a7dc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79cbfff640 1 -- 172.21.15.53:0/4291235898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 msgr2=0x55eec9a7e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79cbfff640 1 --2- 172.21.15.53:0/4291235898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 0x55eec9a7e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79cbfff640 1 -- 172.21.15.53:0/4291235898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec9743b00 con 0x55eec96af660 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79cbfff640 1 --2- 172.21.15.53:0/4291235898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a7e1c0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009dc0 tx=0x7f79bc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716e5890c1398983 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79c97fa640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79b40b4d20 0x7f79b40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.294+0000 7f79d0c97640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79b40b4d20 0x7f79b40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.295+0000 7f79b27fc640 1 -- 172.21.15.53:0/4291235898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc005220 con 0x55eec96af660 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.295+0000 7f79c97fa640 1 -- 172.21.15.53:0/2218720859 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f79c0105ab0 con 0x7f79cc104f10 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.295+0000 7f79b27fc640 1 -- 172.21.15.53:0/4291235898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79bc004c30 con 0x55eec96af660 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.295+0000 7f79b27fc640 1 -- 172.21.15.53:0/4291235898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc019800 con 0x55eec96af660 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.296+0000 7f79d0c97640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79b40b4d20 0x7f79b40b7230 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f79c4005fd0 tx=0x7f79c4012040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.296+0000 7f79d8c6f740 1 -- 172.21.15.53:0/4291235898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 msgr2=0x55eec9a7e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.296+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/4291235898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a7e1c0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009dc0 tx=0x7f79bc011810 comp rx=0 tx=0).stop 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.296+0000 7f79d8c6f740 1 -- 172.21.15.53:0/4291235898 shutdown_connections 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.296+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/4291235898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 0x55eec9a7e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.296+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/4291235898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a7e1c0 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.296+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/4291235898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96d8520 0x55eec9a7dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.296+0000 7f79d8c6f740 1 -- 172.21.15.53:0/4291235898 >> 172.21.15.53:0/4291235898 conn(0x55eec96cc910 msgr2=0x55eec9a7bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.296+0000 7f79d8c6f740 1 -- 172.21.15.53:0/4291235898 shutdown_connections 2024-08-31T06:26:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.296+0000 7f79d8c6f740 1 -- 172.21.15.53:0/4291235898 wait complete. 2024-08-31T06:26:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.297+0000 7f79d8c6f740 1 -- start start 2024-08-31T06:26:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.297+0000 7f79d8c6f740 1 Processor -- start 2024-08-31T06:26:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a89830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 0x55eec9a89d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96d8520 0x55eec9a95900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eec9a8c460 con 0x55eec96af660 2024-08-31T06:26:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55eec99a5520 con 0x55eec96b7840 2024-08-31T06:26:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55eec9a8c5e0 con 0x55eec96d8520 2024-08-31T06:26:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79cb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 0x55eec9a89d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79cb7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 0x55eec9a89d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54958/0 (socket says 172.21.15.53:54958) 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79cb7fe640 1 -- 172.21.15.53:0/1290529380 learned_addr learned my addr 172.21.15.53:0/1290529380 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79d0c97640 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96d8520 0x55eec9a95900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79d8c6f740 10 client.0 _ll_register_callbacks cb 0x55eec99ddc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.298+0000 7f79cbfff640 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a89830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79cb7fe640 1 -- 172.21.15.53:0/1290529380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96d8520 msgr2=0x55eec9a95900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79cb7fe640 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96d8520 0x55eec9a95900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79cb7fe640 1 -- 172.21.15.53:0/1290529380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 msgr2=0x55eec9a89830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79cb7fe640 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a89830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79cb7fe640 1 -- 172.21.15.53:0/1290529380 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eec97ba960 con 0x55eec96b7840 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79cb7fe640 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 0x55eec9a89d70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f79c0000c00 tx=0x7f79c0031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ffb203ca049a12 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79ab7fe640 1 -- 172.21.15.53:0/1290529380 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0049070 con 0x55eec96b7840 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79d8c6f740 1 -- 172.21.15.53:0/1290529380 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eec99839a0 con 0x55eec96b7840 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79ab7fe640 1 -- 172.21.15.53:0/1290529380 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f79c0103460 con 0x55eec96b7840 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79ab7fe640 1 -- 172.21.15.53:0/1290529380 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f79c00cbb80 con 0x55eec96b7840 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79d8c6f740 10 client.30671 fetch_fsmap learned FSMap version 75 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.299+0000 7f79d8c6f740 1 -- 172.21.15.53:0/1290529380 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55eec9a985f0 con 0x55eec96b7840 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.300+0000 7f79ab7fe640 1 -- 172.21.15.53:0/1290529380 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79c010b080 con 0x55eec96b7840 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.300+0000 7f79ab7fe640 1 -- 172.21.15.53:0/1290529380 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f79c00c84c0 con 0x55eec96b7840 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.300+0000 7f79d8c6f740 10 client.30671 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.300+0000 7f79d8c6f740 10 client.30671 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.300+0000 7f79d8c6f740 20 client.30671 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.300+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eec9696ea0 0x55eec9a9baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.300+0000 7f79d8c6f740 4 client.30671 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.300+0000 7f79d8c6f740 1 -- 172.21.15.53:0/1290529380 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eec99f69c0 con 0x55eec9696ea0 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.300+0000 7f79cbfff640 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eec9696ea0 0x55eec9a9baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.301+0000 7f79ab7fe640 10 client.30671 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.301+0000 7f79cbfff640 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eec9696ea0 0x55eec9a9baf0 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3ee04a4af303a64 server_cookie=90dd60322839c497 in_seq=0 out_seq=0 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.301+0000 7f79ab7fe640 1 -- 172.21.15.53:0/1290529380 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eec99f69c0 con 0x55eec9696ea0 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.301+0000 7f79ab7fe640 10 client.30671 handle_command_reply: tid=0 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 1 client.30671 shutdown 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 1 -- 172.21.15.53:0/1290529380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 msgr2=0x55eec9a89d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 0x55eec9a89d70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f79c0000c00 tx=0x7f79c0031630 comp rx=0 tx=0).stop 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 1 -- 172.21.15.53:0/1290529380 shutdown_connections 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eec9696ea0 0x55eec9a9baf0 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96d8520 0x55eec9a95900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96b7840 0x55eec9a89d70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79ab7fe640 0 client.30671 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:00.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/1290529380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a89830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 1 -- 172.21.15.53:0/1290529380 >> 172.21.15.53:0/1290529380 conn(0x55eec96cc910 msgr2=0x55eec9a80e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:00.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 1 -- 172.21.15.53:0/1290529380 shutdown_connections 2024-08-31T06:26:00.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 1 -- 172.21.15.53:0/1290529380 wait complete. 2024-08-31T06:26:00.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.302+0000 7f79d8c6f740 20 client.30671 trim_cache size 0 max 16384 2024-08-31T06:26:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79d8c6f740 1 Processor -- start 2024-08-31T06:26:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79d8c6f740 1 -- start start 2024-08-31T06:26:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a81490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96b7840 0x55eec9a7b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96d8520 0x55eec9a7b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc1ad260 con 0x55eec96af660 2024-08-31T06:26:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc1aefb0 con 0x55eec96d8520 2024-08-31T06:26:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc1ad9c0 con 0x55eec96b7840 2024-08-31T06:26:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a81490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a81490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53402/0 (socket says 172.21.15.53:53402) 2024-08-31T06:26:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79cbfff640 1 -- 172.21.15.53:0/952246948 learned_addr learned my addr 172.21.15.53:0/952246948 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79cbfff640 1 -- 172.21.15.53:0/952246948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96b7840 msgr2=0x55eec9a7b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79cbfff640 1 --2- 172.21.15.53:0/952246948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96b7840 0x55eec9a7b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79cbfff640 1 -- 172.21.15.53:0/952246948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96d8520 msgr2=0x55eec9a7b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79cbfff640 1 --2- 172.21.15.53:0/952246948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96d8520 0x55eec9a7b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.322+0000 7f79cbfff640 1 -- 172.21.15.53:0/952246948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec9a7c460 con 0x55eec96af660 2024-08-31T06:26:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.323+0000 7f79cbfff640 1 --2- 172.21.15.53:0/952246948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a81490 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f79bc005fd0 tx=0x7f79bc019490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc2f8fd93c87341 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.323+0000 7f79b1ffb640 1 -- 172.21.15.53:0/952246948 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc005270 con 0x55eec96af660 2024-08-31T06:26:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.323+0000 7f79b1ffb640 1 -- 172.21.15.53:0/952246948 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79bc005410 con 0x55eec96af660 2024-08-31T06:26:00.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.323+0000 7f79b1ffb640 1 -- 172.21.15.53:0/952246948 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc019530 con 0x55eec96af660 2024-08-31T06:26:00.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.324+0000 7f79d8c6f740 1 -- 172.21.15.53:0/952246948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 msgr2=0x55eec9a81490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:00.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.324+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/952246948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a81490 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f79bc005fd0 tx=0x7f79bc019490 comp rx=0 tx=0).stop 2024-08-31T06:26:00.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.324+0000 7f79d8c6f740 1 -- 172.21.15.53:0/952246948 shutdown_connections 2024-08-31T06:26:00.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.324+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/952246948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96d8520 0x55eec9a7b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.324+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/952246948 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96b7840 0x55eec9a7b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.324+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/952246948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96af660 0x55eec9a81490 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.324+0000 7f79d8c6f740 1 -- 172.21.15.53:0/952246948 >> 172.21.15.53:0/952246948 conn(0x55eec96cc910 msgr2=0x55eec9a80d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.324+0000 7f79d8c6f740 1 -- 172.21.15.53:0/952246948 shutdown_connections 2024-08-31T06:26:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.324+0000 7f79d8c6f740 1 -- 172.21.15.53:0/952246948 wait complete. 2024-08-31T06:26:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.324+0000 7f79d8c6f740 1 -- start start 2024-08-31T06:26:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79d8c6f740 1 Processor -- start 2024-08-31T06:26:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96af660 0x55eec9a8e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96b7840 0x55eec9a8e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79d8c6f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96d8520 0x55eec9aff530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc1ae820 con 0x55eec96b7840 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc1ae090 con 0x55eec96d8520 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79d8c6f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc1ab260 con 0x55eec96af660 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79d8c6f740 10 client.0 _ll_register_callbacks cb 0x7f79c01092f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79cb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96b7840 0x55eec9a8e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79cb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96b7840 0x55eec9a8e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53406/0 (socket says 172.21.15.53:53406) 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79cb7fe640 1 -- 172.21.15.53:0/3572424511 learned_addr learned my addr 172.21.15.53:0/3572424511 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79cbfff640 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96af660 0x55eec9a8e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79cb7fe640 1 -- 172.21.15.53:0/3572424511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96af660 msgr2=0x55eec9a8e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79cb7fe640 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96af660 0x55eec9a8e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79cb7fe640 1 -- 172.21.15.53:0/3572424511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96d8520 msgr2=0x55eec9aff530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79cb7fe640 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96d8520 0x55eec9aff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.325+0000 7f79cb7fe640 1 -- 172.21.15.53:0/3572424511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eec9affba0 con 0x55eec96b7840 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79cb7fe640 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96b7840 0x55eec9a8e810 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f79c0005ab0 tx=0x7f79c00c86f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab3cf465b0cb393 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:00.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79ab7fe640 1 -- 172.21.15.53:0/3572424511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0049070 con 0x55eec96b7840 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79ab7fe640 1 -- 172.21.15.53:0/3572424511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8557+0+0 (secure 0 0 0) 0x7f79c00d5010 con 0x55eec96b7840 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79d8c6f740 1 -- 172.21.15.53:0/3572424511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79bc005410 con 0x55eec96b7840 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79ab7fe640 1 -- 172.21.15.53:0/3572424511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f79c00cb9a0 con 0x55eec96b7840 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79d8c6f740 10 client.21936 fetch_fsmap learned FSMap version 75 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79d8c6f740 1 -- 172.21.15.53:0/3572424511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x55eec9affba0 con 0x55eec96b7840 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79ab7fe640 1 -- 172.21.15.53:0/3572424511 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79bc005410 con 0x55eec96b7840 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79ab7fe640 1 -- 172.21.15.53:0/3572424511 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f79c00f1080 con 0x55eec96b7840 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79d8c6f740 10 client.21936 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79d8c6f740 10 client.21936 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79d8c6f740 20 client.21936 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eec966c250 0x55eec9b09480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:00.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79d8c6f740 4 client.21936 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "52882e46", "release": true, "await": true}] 2024-08-31T06:26:00.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.326+0000 7f79d8c6f740 1 -- 172.21.15.53:0/3572424511 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "52882e46", "release": true, "await": true}) -- 0x55eec99f2460 con 0x55eec966c250 2024-08-31T06:26:00.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.327+0000 7f79cbfff640 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eec966c250 0x55eec9b09480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:00.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.327+0000 7f79cbfff640 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eec966c250 0x55eec9b09480 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdefde24c60647c7 server_cookie=8bfee79c683663e2 in_seq=0 out_seq=0 2024-08-31T06:26:00.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.327+0000 7f79ab7fe640 10 client.21936 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:25:59 smithi130 ceph-mon[22266]: pgmap v984: 97 pgs: 97 active+clean; 809 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.7 MiB/s wr, 184 op/s 2024-08-31T06:26:00.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 49949 5.52 MB/sec execute 348 sec latency 11244.027 ms 2024-08-31T06:26:00.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.456+0000 7f79ab7fe640 1 -- 172.21.15.53:0/3572424511 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55eec99f2460 con 0x55eec966c250 2024-08-31T06:26:00.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.456+0000 7f79ab7fe640 10 client.21936 handle_command_reply: tid=0 2024-08-31T06:26:00.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.456+0000 7f79d8c6f740 1 client.21936 shutdown 2024-08-31T06:26:00.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.456+0000 7f79d8c6f740 1 -- 172.21.15.53:0/3572424511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96b7840 msgr2=0x55eec9a8e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:00.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.456+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96b7840 0x55eec9a8e810 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f79c0005ab0 tx=0x7f79c00c86f0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.456+0000 7f79d8c6f740 1 -- 172.21.15.53:0/3572424511 shutdown_connections 2024-08-31T06:26:00.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.456+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55eec966c250 0x55eec9b09480 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eec96d8520 0x55eec9aff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eec96b7840 0x55eec9a8e810 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79d8c6f740 1 --2- 172.21.15.53:0/3572424511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eec96af660 0x55eec9a8e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79d8c6f740 1 -- 172.21.15.53:0/3572424511 >> 172.21.15.53:0/3572424511 conn(0x55eec96cc910 msgr2=0x55eec9a7ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:00.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79ab7fe640 0 client.21936 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:00.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79d8c6f740 1 -- 172.21.15.53:0/3572424511 shutdown_connections 2024-08-31T06:26:00.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79d8c6f740 1 -- 172.21.15.53:0/3572424511 wait complete. 2024-08-31T06:26:00.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79d8c6f740 20 client.21936 trim_cache size 0 max 16384 2024-08-31T06:26:00.460 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 75, 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 68, 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "52882e46": { 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 68, 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 134.1, 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:00.462 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:26:00.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79d26fa640 1 -- 172.21.15.53:0/2218720859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79b40b4d20 msgr2=0x7f79b40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:00.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79d26fa640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79b40b4d20 0x7f79b40b7230 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f79c4005fd0 tx=0x7f79c4012040 comp rx=0 tx=0).stop 2024-08-31T06:26:00.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79d26fa640 1 -- 172.21.15.53:0/2218720859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79cc104f10 msgr2=0x7f79cc19a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:00.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.457+0000 7f79d26fa640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79cc104f10 0x7f79cc19a7f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f79c002aa00 tx=0x7f79c0003c10 comp rx=0 tx=0).stop 2024-08-31T06:26:00.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.458+0000 7f79d26fa640 1 -- 172.21.15.53:0/2218720859 shutdown_connections 2024-08-31T06:26:00.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.458+0000 7f79d26fa640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f79b40b4d20 0x7f79b40b7230 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.458+0000 7f79d26fa640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79cc105860 0x7f79cc19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.458+0000 7f79d26fa640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f79cc104f10 0x7f79cc19a7f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.458+0000 7f79d26fa640 1 --2- 172.21.15.53:0/2218720859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79cc102f00 0x7f79cc19a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:00.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.458+0000 7f79d26fa640 1 -- 172.21.15.53:0/2218720859 >> 172.21.15.53:0/2218720859 conn(0x7f79cc077a00 msgr2=0x7f79cc106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:00.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.458+0000 7f79d26fa640 1 -- 172.21.15.53:0/2218720859 shutdown_connections 2024-08-31T06:26:00.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:00.458+0000 7f79d26fa640 1 -- 172.21.15.53:0/2218720859 wait complete. 2024-08-31T06:26:01.382 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '52882e46', total seconds elapsed: 18.4 2024-08-31T06:26:01.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 50071 5.51 MB/sec execute 349 sec latency 11321.166 ms 2024-08-31T06:26:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:01 smithi153 ceph-mon[22320]: pgmap v985: 97 pgs: 97 active+clean; 810 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 1.3 MiB/s wr, 165 op/s 2024-08-31T06:26:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:01 smithi153 ceph-mon[22320]: osdmap e105: 12 total, 12 up, 12 in 2024-08-31T06:26:02.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:01 smithi053 ceph-mon[18924]: pgmap v985: 97 pgs: 97 active+clean; 810 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 1.3 MiB/s wr, 165 op/s 2024-08-31T06:26:02.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:01 smithi053 ceph-mon[18924]: osdmap e105: 12 total, 12 up, 12 in 2024-08-31T06:26:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:01 smithi130 ceph-mon[22266]: pgmap v985: 97 pgs: 97 active+clean; 810 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 1.3 MiB/s wr, 165 op/s 2024-08-31T06:26:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:01 smithi130 ceph-mon[22266]: osdmap e105: 12 total, 12 up, 12 in 2024-08-31T06:26:02.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 50240 5.53 MB/sec execute 350 sec latency 60.381 ms 2024-08-31T06:26:03.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 50418 5.54 MB/sec execute 351 sec latency 57.856 ms 2024-08-31T06:26:04.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:03 smithi153 ceph-mon[22320]: pgmap v987: 97 pgs: 97 active+clean; 803 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 566 KiB/s wr, 92 op/s 2024-08-31T06:26:04.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:03 smithi053 ceph-mon[18924]: pgmap v987: 97 pgs: 97 active+clean; 803 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 566 KiB/s wr, 92 op/s 2024-08-31T06:26:04.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:03 smithi130 ceph-mon[22266]: pgmap v987: 97 pgs: 97 active+clean; 803 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 566 KiB/s wr, 92 op/s 2024-08-31T06:26:04.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 50628 5.55 MB/sec execute 352 sec latency 49.024 ms 2024-08-31T06:26:05.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 50800 5.57 MB/sec execute 353 sec latency 86.174 ms 2024-08-31T06:26:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:05 smithi153 ceph-mon[22320]: pgmap v988: 97 pgs: 97 active+clean; 802 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 810 KiB/s wr, 104 op/s 2024-08-31T06:26:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:26:06.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:05 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:05 smithi053 ceph-mon[18924]: pgmap v988: 97 pgs: 97 active+clean; 802 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 810 KiB/s wr, 104 op/s 2024-08-31T06:26:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:26:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:05 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:05 smithi130 ceph-mon[22266]: pgmap v988: 97 pgs: 97 active+clean; 802 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 810 KiB/s wr, 104 op/s 2024-08-31T06:26:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:26:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:05 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:06.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 50953 5.58 MB/sec execute 354 sec latency 189.516 ms 2024-08-31T06:26:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.826+0000 7f2cee28d640 1 -- 172.21.15.53:0/2856831492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce8102750 msgr2=0x7f2ce8102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.826+0000 7f2cee28d640 1 --2- 172.21.15.53:0/2856831492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce8102750 0x7f2ce8102b60 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009900 tx=0x7f2cd802a410 comp rx=0 tx=0).stop 2024-08-31T06:26:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.827+0000 7f2cee28d640 1 -- 172.21.15.53:0/2856831492 shutdown_connections 2024-08-31T06:26:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.827+0000 7f2cee28d640 1 --2- 172.21.15.53:0/2856831492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ce81089d0 0x7f2ce810f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.827+0000 7f2cee28d640 1 --2- 172.21.15.53:0/2856831492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ce8108080 0x7f2ce8108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.827+0000 7f2cee28d640 1 --2- 172.21.15.53:0/2856831492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce8102750 0x7f2ce8102b60 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.827+0000 7f2cee28d640 1 -- 172.21.15.53:0/2856831492 >> 172.21.15.53:0/2856831492 conn(0x7f2ce807a4e0 msgr2=0x7f2ce807a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.827+0000 7f2cee28d640 1 -- 172.21.15.53:0/2856831492 shutdown_connections 2024-08-31T06:26:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.827+0000 7f2cee28d640 1 -- 172.21.15.53:0/2856831492 wait complete. 2024-08-31T06:26:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.828+0000 7f2cee28d640 1 Processor -- start 2024-08-31T06:26:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.828+0000 7f2cee28d640 1 -- start start 2024-08-31T06:26:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.828+0000 7f2cee28d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ce8102750 0x7f2ce8198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.828+0000 7f2cee28d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ce8108080 0x7f2ce8199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.828+0000 7f2cee28d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81089d0 0x7f2ce8199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.828+0000 7f2cee28d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8112550 con 0x7f2ce81089d0 2024-08-31T06:26:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.828+0000 7f2cee28d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81123d0 con 0x7f2ce8102750 2024-08-31T06:26:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.828+0000 7f2cee28d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81126d0 con 0x7f2ce8108080 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.828+0000 7f2cec82a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81089d0 0x7f2ce8199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.829+0000 7f2cec82a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81089d0 0x7f2ce8199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59792/0 (socket says 172.21.15.53:59792) 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.829+0000 7f2cec82a640 1 -- 172.21.15.53:0/1412870183 learned_addr learned my addr 172.21.15.53:0/1412870183 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.829+0000 7f2cec82a640 1 -- 172.21.15.53:0/1412870183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ce8108080 msgr2=0x7f2ce8199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.829+0000 7f2cec82a640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ce8108080 0x7f2ce8199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.829+0000 7f2cec82a640 1 -- 172.21.15.53:0/1412870183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ce8102750 msgr2=0x7f2ce8198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.829+0000 7f2cec82a640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ce8102750 0x7f2ce8198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.829+0000 7f2cec82a640 1 -- 172.21.15.53:0/1412870183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce81a82a0 con 0x7f2ce81089d0 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.829+0000 7f2cec82a640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81089d0 0x7f2ce8199670 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000eb10 tx=0x7f2ce000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.829+0000 7f2ce57fa640 1 -- 172.21.15.53:0/1412870183 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0004b20 con 0x7f2ce81089d0 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.830+0000 7f2ce57fa640 1 -- 172.21.15.53:0/1412870183 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ce0004cc0 con 0x7f2ce81089d0 2024-08-31T06:26:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.830+0000 7f2cee28d640 1 -- 172.21.15.53:0/1412870183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce81a8590 con 0x7f2ce81089d0 2024-08-31T06:26:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.830+0000 7f2ce57fa640 1 -- 172.21.15.53:0/1412870183 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0010690 con 0x7f2ce81089d0 2024-08-31T06:26:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.830+0000 7f2cee28d640 1 -- 172.21.15.53:0/1412870183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce81a8ae0 con 0x7f2ce81089d0 2024-08-31T06:26:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.833+0000 7f2cf51fc740 1 Processor -- start 2024-08-31T06:26:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.833+0000 7f2ce57fa640 1 -- 172.21.15.53:0/1412870183 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2ce0010830 con 0x7f2ce81089d0 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.833+0000 7f2cf51fc740 1 -- start start 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523eb2f0 0x5654527b8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523f34d0 0x5654527b8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56545272d000 con 0x5654524141b0 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56545271c590 con 0x5654523eb2f0 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565452720540 con 0x5654523f34d0 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527b7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59806/0 (socket says 172.21.15.53:59806) 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce77fe640 1 -- 172.21.15.53:0/1041764215 learned_addr learned my addr 172.21.15.53:0/1041764215 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/1041764215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523eb2f0 0x5654527b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/1041764215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523f34d0 0x5654527b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce57fa640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2cd00b4d20 0x7f2cd00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce77fe640 1 -- 172.21.15.53:0/1041764215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523f34d0 msgr2=0x5654527b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/1041764215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523f34d0 0x5654527b8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce77fe640 1 -- 172.21.15.53:0/1041764215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523eb2f0 msgr2=0x5654527b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/1041764215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523eb2f0 0x5654527b8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce77fe640 1 -- 172.21.15.53:0/1041764215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545247f790 con 0x5654524141b0 2024-08-31T06:26:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2ce57fa640 1 -- 172.21.15.53:0/1412870183 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8601+0+0 (secure 0 0 0) 0x7f2ce00e5c50 con 0x7f2ce81089d0 2024-08-31T06:26:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.834+0000 7f2cec82a640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2cd00b4d20 0x7f2cd00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.835+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/1041764215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527b7ac0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc013780 tx=0x7f2cdc0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fc841dd29c5289 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.835+0000 7f2cce7fc640 1 -- 172.21.15.53:0/1041764215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0130d0 con 0x5654524141b0 2024-08-31T06:26:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.835+0000 7f2cec82a640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2cd00b4d20 0x7f2cd00b7230 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00049d0 tx=0x7f2ce000cf10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.835+0000 7f2cce7fc640 1 -- 172.21.15.53:0/1041764215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2cdc0044c0 con 0x5654524141b0 2024-08-31T06:26:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.835+0000 7f2cce7fc640 1 -- 172.21.15.53:0/1041764215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc00edb0 con 0x5654524141b0 2024-08-31T06:26:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.836+0000 7f2cf51fc740 1 -- 172.21.15.53:0/1041764215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 msgr2=0x5654527b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.836+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/1041764215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527b7ac0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc013780 tx=0x7f2cdc0095f0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.836+0000 7f2cf51fc740 1 -- 172.21.15.53:0/1041764215 shutdown_connections 2024-08-31T06:26:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.836+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/1041764215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523f34d0 0x5654527b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.836+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/1041764215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523eb2f0 0x5654527b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.836+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/1041764215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527b7ac0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.836+0000 7f2cf51fc740 1 -- 172.21.15.53:0/1041764215 >> 172.21.15.53:0/1041764215 conn(0x565452408300 msgr2=0x5654527b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.836+0000 7f2cf51fc740 1 -- 172.21.15.53:0/1041764215 shutdown_connections 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.836+0000 7f2cf51fc740 1 -- 172.21.15.53:0/1041764215 wait complete. 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.837+0000 7f2cf51fc740 1 -- start start 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.837+0000 7f2cf51fc740 1 Processor -- start 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.837+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 0x5654527c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x565452655ab0 con 0x5654524141b0 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2ce7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 0x5654527c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5654526a3680 con 0x5654523f34d0 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5654527c61e0 con 0x5654523eb2f0 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2ce7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 0x5654527c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:44742/0 (socket says 172.21.15.53:44742) 2024-08-31T06:26:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2ce7fff640 1 -- 172.21.15.53:0/3324958082 learned_addr learned my addr 172.21.15.53:0/3324958082 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2cf51fc740 10 client.0 _ll_register_callbacks cb 0x56545242ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2ce7fff640 1 -- 172.21.15.53:0/3324958082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 msgr2=0x5654527c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2ce7fff640 1 -- 172.21.15.53:0/3324958082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 msgr2=0x5654527cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.838+0000 7f2ce7fff640 1 -- 172.21.15.53:0/3324958082 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654524f8620 con 0x5654523f34d0 2024-08-31T06:26:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.839+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 0x5654527c3b90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2ce806a8c0 tx=0x7f2cd8032c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cae4804193c94e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.839+0000 7f2cc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:26:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.839+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3324958082 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8040070 con 0x5654523f34d0 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.839+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3324958082 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8601+0+0 (secure 0 0 0) 0x7f2cd8031810 con 0x5654523f34d0 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.839+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3324958082 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56545272ef50 con 0x5654523f34d0 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.839+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3324958082 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f2cd8035040 con 0x5654523f34d0 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.839+0000 7f2cf51fc740 10 client.30680 fetch_fsmap learned FSMap version 75 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.839+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3324958082 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x5654527d21b0 con 0x5654523f34d0 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.840+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3324958082 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56545272ef50 con 0x5654523f34d0 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.840+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3324958082 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f2cd80046c0 con 0x5654523f34d0 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.840+0000 7f2cf51fc740 10 client.30680 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.840+0000 7f2cf51fc740 10 client.30680 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.840+0000 7f2cf51fc740 20 client.30680 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.840+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654523d2d80 0x5654527d57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.840+0000 7f2cf51fc740 4 client.30680 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.840+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3324958082 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56545272a9f0 con 0x5654523d2d80 2024-08-31T06:26:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.840+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654523d2d80 0x5654527d57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.841+0000 7f2cc77fe640 10 client.30680 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:06.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.841+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654523d2d80 0x5654527d57c0 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b25987c75e61693 server_cookie=ef3aca8fbca9c381 in_seq=0 out_seq=0 2024-08-31T06:26:06.845 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3324958082 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56545272a9f0 con 0x5654523d2d80 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cc77fe640 10 client.30680 handle_command_reply: tid=0 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cf51fc740 1 client.30680 shutdown 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3324958082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 msgr2=0x5654527c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 0x5654527c3b90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2ce806a8c0 tx=0x7f2cd8032c90 comp rx=0 tx=0).stop 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3324958082 shutdown_connections 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654523d2d80 0x5654527d57c0 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 0x5654527c3b90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3324958082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3324958082 >> 172.21.15.53:0/3324958082 conn(0x565452408300 msgr2=0x5654527b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.842+0000 7f2cc77fe640 0 client.30680 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.843+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3324958082 shutdown_connections 2024-08-31T06:26:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.843+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3324958082 wait complete. 2024-08-31T06:26:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.843+0000 7f2cf51fc740 20 client.30680 trim_cache size 0 max 16384 2024-08-31T06:26:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.870+0000 7f2cf51fc740 1 Processor -- start 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.870+0000 7f2cf51fc740 1 -- start start 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527bcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 0x5654527bd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527c0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81b1930 con 0x5654524141b0 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81b3680 con 0x5654523f34d0 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81b2090 con 0x5654523eb2f0 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527bcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527c0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59832/0 (socket says 172.21.15.53:59832) 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2ce7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 0x5654527bd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2ce77fe640 1 -- 172.21.15.53:0/1647819714 learned_addr learned my addr 172.21.15.53:0/1647819714 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2ce7fff640 1 -- 172.21.15.53:0/1647819714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 msgr2=0x5654527bcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.871+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/1647819714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527bcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.872+0000 7f2ce7fff640 1 -- 172.21.15.53:0/1647819714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 msgr2=0x5654527c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.872+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/1647819714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527c0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.872+0000 7f2ce7fff640 1 -- 172.21.15.53:0/1647819714 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654527b9dc0 con 0x5654523f34d0 2024-08-31T06:26:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.872+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/1647819714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527c0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.872+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/1647819714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 0x5654527bd0c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8004a90 tx=0x7f2cd8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38cb0ddcd2cad670 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.872+0000 7f2ccdffb640 1 -- 172.21.15.53:0/1647819714 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8040040 con 0x5654523f34d0 2024-08-31T06:26:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.872+0000 7f2ccdffb640 1 -- 172.21.15.53:0/1647819714 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2cd8005850 con 0x5654523f34d0 2024-08-31T06:26:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.872+0000 7f2ccdffb640 1 -- 172.21.15.53:0/1647819714 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8031980 con 0x5654523f34d0 2024-08-31T06:26:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.874+0000 7f2cf51fc740 1 -- 172.21.15.53:0/1647819714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 msgr2=0x5654527bd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.874+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/1647819714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 0x5654527bd0c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8004a90 tx=0x7f2cd8000bc0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.874+0000 7f2cf51fc740 1 -- 172.21.15.53:0/1647819714 shutdown_connections 2024-08-31T06:26:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.874+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/1647819714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654524141b0 0x5654527c0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.874+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/1647819714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654523f34d0 0x5654527bd0c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.874+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/1647819714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527bcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.874+0000 7f2cf51fc740 1 -- 172.21.15.53:0/1647819714 >> 172.21.15.53:0/1647819714 conn(0x565452408300 msgr2=0x5654527be5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.874+0000 7f2cf51fc740 1 -- 172.21.15.53:0/1647819714 shutdown_connections 2024-08-31T06:26:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.874+0000 7f2cf51fc740 1 -- 172.21.15.53:0/1647819714 wait complete. 2024-08-31T06:26:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.875+0000 7f2cf51fc740 1 -- start start 2024-08-31T06:26:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.875+0000 7f2cf51fc740 1 Processor -- start 2024-08-31T06:26:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654523f34d0 0x5654527c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2cf51fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654524141b0 0x5654527c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81b2ef0 con 0x5654523f34d0 2024-08-31T06:26:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81b2760 con 0x5654524141b0 2024-08-31T06:26:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2cf51fc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81af930 con 0x5654523eb2f0 2024-08-31T06:26:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2cf51fc740 10 client.0 _ll_register_callbacks cb 0x7f2cdc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654524141b0 0x5654527c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654524141b0 0x5654527c9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:44752/0 (socket says 172.21.15.53:44752) 2024-08-31T06:26:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2ce77fe640 1 -- 172.21.15.53:0/3397786592 learned_addr learned my addr 172.21.15.53:0/3397786592 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654523f34d0 0x5654527c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2ce77fe640 1 -- 172.21.15.53:0/3397786592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 msgr2=0x5654527c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2ce77fe640 1 -- 172.21.15.53:0/3397786592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654523f34d0 msgr2=0x5654527c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654523f34d0 0x5654527c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.876+0000 7f2ce77fe640 1 -- 172.21.15.53:0/3397786592 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545283f1b0 con 0x5654524141b0 2024-08-31T06:26:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.877+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654524141b0 0x5654527c9e90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc005d00 tx=0x7f2cdc015040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9c234f63340908d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.877+0000 7f2cc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:26:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.877+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3397786592 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0132d0 con 0x5654524141b0 2024-08-31T06:26:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.877+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3397786592 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8601+0+0 (secure 0 0 0) 0x7f2cdc00ea70 con 0x5654524141b0 2024-08-31T06:26:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.877+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3397786592 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cd8005850 con 0x5654524141b0 2024-08-31T06:26:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.878+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3397786592 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f2cdc00ec70 con 0x5654524141b0 2024-08-31T06:26:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.878+0000 7f2cf51fc740 10 client.30686 fetch_fsmap learned FSMap version 75 2024-08-31T06:26:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.878+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3397786592 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) -- 0x565452840440 con 0x5654524141b0 2024-08-31T06:26:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.878+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3397786592 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2cd8005850 con 0x5654524141b0 2024-08-31T06:26:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.878+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3397786592 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 75) ==== 8406+0+0 (secure 0 0 0) 0x7f2cdc035040 con 0x5654524141b0 2024-08-31T06:26:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.878+0000 7f2cf51fc740 10 client.30686 fetch_fsmap finished waiting for FSMap version 75 2024-08-31T06:26:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.878+0000 7f2cf51fc740 10 client.30686 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.878+0000 7f2cf51fc740 20 client.30686 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.878+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654523a81c0 0x565452842a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.878+0000 7f2cf51fc740 4 client.30686 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:26:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.878+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3397786592 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5654527b99e0 con 0x5654523a81c0 2024-08-31T06:26:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.879+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654523a81c0 0x565452842a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.879+0000 7f2cc77fe640 10 client.30686 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.879+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654523a81c0 0x565452842a60 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f189d4a159af896 server_cookie=6e3835551f8ba2df in_seq=0 out_seq=0 2024-08-31T06:26:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cc77fe640 1 -- 172.21.15.53:0/3397786592 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5654527b99e0 con 0x5654523a81c0 2024-08-31T06:26:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cc77fe640 10 client.30686 handle_command_reply: tid=0 2024-08-31T06:26:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cf51fc740 1 client.30686 shutdown 2024-08-31T06:26:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3397786592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654524141b0 msgr2=0x5654527c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654524141b0 0x5654527c9e90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc005d00 tx=0x7f2cdc015040 comp rx=0 tx=0).stop 2024-08-31T06:26:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3397786592 shutdown_connections 2024-08-31T06:26:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5654523a81c0 0x565452842a60 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654524141b0 0x5654527c9e90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654523f34d0 0x5654527c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cf51fc740 1 --2- 172.21.15.53:0/3397786592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654523eb2f0 0x5654527c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cc77fe640 0 client.30686 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.960+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3397786592 >> 172.21.15.53:0/3397786592 conn(0x565452408300 msgr2=0x5654527bcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.961+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3397786592 shutdown_connections 2024-08-31T06:26:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.961+0000 7f2cf51fc740 1 -- 172.21.15.53:0/3397786592 wait complete. 2024-08-31T06:26:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.961+0000 7f2cf51fc740 20 client.30686 trim_cache size 0 max 16384 2024-08-31T06:26:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:26:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:26:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:26:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:26:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.961+0000 7f2cee28d640 1 -- 172.21.15.53:0/1412870183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2cd00b4d20 msgr2=0x7f2cd00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.961+0000 7f2cee28d640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2cd00b4d20 0x7f2cd00b7230 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00049d0 tx=0x7f2ce000cf10 comp rx=0 tx=0).stop 2024-08-31T06:26:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.961+0000 7f2cee28d640 1 -- 172.21.15.53:0/1412870183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81089d0 msgr2=0x7f2ce8199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.961+0000 7f2cee28d640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81089d0 0x7f2ce8199670 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000eb10 tx=0x7f2ce000c2d0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.962+0000 7f2cee28d640 1 -- 172.21.15.53:0/1412870183 shutdown_connections 2024-08-31T06:26:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.962+0000 7f2cee28d640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2cd00b4d20 0x7f2cd00b7230 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.962+0000 7f2cee28d640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81089d0 0x7f2ce8199670 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.962+0000 7f2cee28d640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ce8108080 0x7f2ce8199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.962+0000 7f2cee28d640 1 --2- 172.21.15.53:0/1412870183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ce8102750 0x7f2ce8198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.962+0000 7f2cee28d640 1 -- 172.21.15.53:0/1412870183 >> 172.21.15.53:0/1412870183 conn(0x7f2ce807a4e0 msgr2=0x7f2ce81060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.962+0000 7f2cee28d640 1 -- 172.21.15.53:0/1412870183 shutdown_connections 2024-08-31T06:26:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:06.962+0000 7f2cee28d640 1 -- 172.21.15.53:0/1412870183 wait complete. 2024-08-31T06:26:07.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 51083 5.58 MB/sec execute 355 sec latency 139.157 ms 2024-08-31T06:26:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:07 smithi153 ceph-mon[22320]: pgmap v989: 97 pgs: 97 active+clean; 810 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 2.1 MiB/s wr, 181 op/s 2024-08-31T06:26:08.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:07 smithi053 ceph-mon[18924]: pgmap v989: 97 pgs: 97 active+clean; 810 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 2.1 MiB/s wr, 181 op/s 2024-08-31T06:26:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:07 smithi130 ceph-mon[22266]: pgmap v989: 97 pgs: 97 active+clean; 810 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 2.1 MiB/s wr, 181 op/s 2024-08-31T06:26:08.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 51306 5.64 MB/sec execute 356 sec latency 95.693 ms 2024-08-31T06:26:09.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 51494 5.65 MB/sec execute 357 sec latency 60.935 ms 2024-08-31T06:26:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:09 smithi153 ceph-mon[22320]: pgmap v990: 97 pgs: 97 active+clean; 821 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 202 op/s 2024-08-31T06:26:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:09 smithi153 ceph-mon[22320]: osdmap e106: 12 total, 12 up, 12 in 2024-08-31T06:26:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:09 smithi053 ceph-mon[18924]: pgmap v990: 97 pgs: 97 active+clean; 821 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 202 op/s 2024-08-31T06:26:10.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:09 smithi053 ceph-mon[18924]: osdmap e106: 12 total, 12 up, 12 in 2024-08-31T06:26:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:09 smithi130 ceph-mon[22266]: pgmap v990: 97 pgs: 97 active+clean; 821 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 202 op/s 2024-08-31T06:26:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:09 smithi130 ceph-mon[22266]: osdmap e106: 12 total, 12 up, 12 in 2024-08-31T06:26:10.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 51599 5.65 MB/sec execute 358 sec latency 129.668 ms 2024-08-31T06:26:11.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 51739 5.66 MB/sec execute 359 sec latency 59.657 ms 2024-08-31T06:26:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:11 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:11 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:26:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:11 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:26:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:11 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:26:11.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:11 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:26:11.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:11.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:11 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:11.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:11 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:26:11.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:11 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:26:11.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:11 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:26:11.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:11 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:26:11.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:11.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:11 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:11.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:11 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:26:11.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:11 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:26:11.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:11 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:26:11.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:11 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:26:12.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 51896 5.67 MB/sec execute 360 sec latency 53.681 ms 2024-08-31T06:26:12.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:12 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:26:12.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:12 smithi053 ceph-mon[18924]: pgmap v992: 97 pgs: 97 active+clean; 832 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 313 op/s 2024-08-31T06:26:12.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:12 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:26:12.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:12 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:26:12.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:12 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:12 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:26:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:12 smithi130 ceph-mon[22266]: pgmap v992: 97 pgs: 97 active+clean; 832 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 313 op/s 2024-08-31T06:26:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:12 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:26:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:12 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:26:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:12 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:12.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:12 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:26:12.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:12 smithi153 ceph-mon[22320]: pgmap v992: 97 pgs: 97 active+clean; 832 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 313 op/s 2024-08-31T06:26:12.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:12 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:26:12.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:12 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:26:12.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:12 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:26:13.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 52044 5.66 MB/sec execute 361 sec latency 166.775 ms 2024-08-31T06:26:14.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 52182 5.66 MB/sec execute 362 sec latency 56.432 ms 2024-08-31T06:26:14.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:14 smithi053 ceph-mon[18924]: pgmap v993: 97 pgs: 97 active+clean; 835 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.9 MiB/s wr, 325 op/s 2024-08-31T06:26:14.476 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:14 smithi153 ceph-mon[22320]: pgmap v993: 97 pgs: 97 active+clean; 835 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.9 MiB/s wr, 325 op/s 2024-08-31T06:26:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:14 smithi130 ceph-mon[22266]: pgmap v993: 97 pgs: 97 active+clean; 835 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.9 MiB/s wr, 325 op/s 2024-08-31T06:26:15.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 52320 5.66 MB/sec execute 363 sec latency 93.409 ms 2024-08-31T06:26:16.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 52460 5.66 MB/sec execute 364 sec latency 139.367 ms 2024-08-31T06:26:16.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:16 smithi053 ceph-mon[18924]: pgmap v994: 97 pgs: 97 active+clean; 841 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 338 op/s 2024-08-31T06:26:16.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:16 smithi130 ceph-mon[22266]: pgmap v994: 97 pgs: 97 active+clean; 841 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 338 op/s 2024-08-31T06:26:16.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:16 smithi153 ceph-mon[22320]: pgmap v994: 97 pgs: 97 active+clean; 841 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 338 op/s 2024-08-31T06:26:17.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 52629 5.67 MB/sec execute 365 sec latency 84.890 ms 2024-08-31T06:26:18.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 52794 5.69 MB/sec execute 366 sec latency 61.287 ms 2024-08-31T06:26:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:18 smithi053 ceph-mon[18924]: pgmap v995: 97 pgs: 97 active+clean; 851 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.5 MiB/s wr, 337 op/s 2024-08-31T06:26:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:18 smithi130 ceph-mon[22266]: pgmap v995: 97 pgs: 97 active+clean; 851 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.5 MiB/s wr, 337 op/s 2024-08-31T06:26:18.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:18 smithi153 ceph-mon[22320]: pgmap v995: 97 pgs: 97 active+clean; 851 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.5 MiB/s wr, 337 op/s 2024-08-31T06:26:19.386 INFO:tasks.workunit.client.0.smithi053.stdout: 10 52951 5.68 MB/sec execute 367 sec latency 67.531 ms 2024-08-31T06:26:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.122+0000 7fa06029b640 1 -- 172.21.15.53:0/3695322937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa058102750 msgr2=0x7fa058102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.122+0000 7fa06029b640 1 --2- 172.21.15.53:0/3695322937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa058102750 0x7fa058102b60 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fa050009860 tx=0x7fa05002a340 comp rx=0 tx=0).stop 2024-08-31T06:26:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.122+0000 7fa06029b640 1 -- 172.21.15.53:0/3695322937 shutdown_connections 2024-08-31T06:26:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.122+0000 7fa06029b640 1 --2- 172.21.15.53:0/3695322937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0581089d0 0x7fa05810f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.122+0000 7fa06029b640 1 --2- 172.21.15.53:0/3695322937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa058108080 0x7fa058108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.122+0000 7fa06029b640 1 --2- 172.21.15.53:0/3695322937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa058102750 0x7fa058102b60 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.122+0000 7fa06029b640 1 -- 172.21.15.53:0/3695322937 >> 172.21.15.53:0/3695322937 conn(0x7fa05807a4e0 msgr2=0x7fa05807a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.122+0000 7fa06029b640 1 -- 172.21.15.53:0/3695322937 shutdown_connections 2024-08-31T06:26:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.122+0000 7fa06029b640 1 -- 172.21.15.53:0/3695322937 wait complete. 2024-08-31T06:26:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa06029b640 1 Processor -- start 2024-08-31T06:26:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa06029b640 1 -- start start 2024-08-31T06:26:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa06029b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa058102750 0x7fa05819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa06029b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa058108080 0x7fa05819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa06029b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0581089d0 0x7fa05819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa06029b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa058112550 con 0x7fa058102750 2024-08-31T06:26:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa06029b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0581123d0 con 0x7fa058108080 2024-08-31T06:26:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa06029b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0581126d0 con 0x7fa0581089d0 2024-08-31T06:26:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa05e037640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa058102750 0x7fa05819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa05e037640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa058102750 0x7fa05819a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43540/0 (socket says 172.21.15.53:43540) 2024-08-31T06:26:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa05e037640 1 -- 172.21.15.53:0/1869445191 learned_addr learned my addr 172.21.15.53:0/1869445191 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.123+0000 7fa05d836640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa058108080 0x7fa05819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa05e838640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0581089d0 0x7fa05819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa05e037640 1 -- 172.21.15.53:0/1869445191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0581089d0 msgr2=0x7fa05819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa05e037640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0581089d0 0x7fa05819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa05e037640 1 -- 172.21.15.53:0/1869445191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa058108080 msgr2=0x7fa05819a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa05e037640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa058108080 0x7fa05819a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa05e037640 1 -- 172.21.15.53:0/1869445191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0581a00f0 con 0x7fa058102750 2024-08-31T06:26:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa05d836640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa058108080 0x7fa05819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa05e037640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa058102750 0x7fa05819a1c0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fa0500057c0 tx=0x7fa050030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa04b7fe640 1 -- 172.21.15.53:0/1869445191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050040020 con 0x7fa058102750 2024-08-31T06:26:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa04b7fe640 1 -- 172.21.15.53:0/1869445191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa050032df0 con 0x7fa058102750 2024-08-31T06:26:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa04b7fe640 1 -- 172.21.15.53:0/1869445191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050037040 con 0x7fa058102750 2024-08-31T06:26:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.124+0000 7fa06029b640 1 -- 172.21.15.53:0/1869445191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0581a0380 con 0x7fa058102750 2024-08-31T06:26:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.125+0000 7fa06029b640 1 -- 172.21.15.53:0/1869445191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0581a6b70 con 0x7fa058102750 2024-08-31T06:26:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.128+0000 7fa06720d740 1 Processor -- start 2024-08-31T06:26:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.128+0000 7fa06720d740 1 -- start start 2024-08-31T06:26:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.128+0000 7fa04b7fe640 1 -- 172.21.15.53:0/1869445191 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa050043020 con 0x7fa058102750 2024-08-31T06:26:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.128+0000 7fa06720d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55645829f1b0 0x556458642ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.128+0000 7fa06720d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5564582762f0 0x556458643000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa06720d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458643540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa06720d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5564585b8000 con 0x55645827e4d0 2024-08-31T06:26:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa06720d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5564585a7590 con 0x55645829f1b0 2024-08-31T06:26:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa06720d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5564585ab540 con 0x5564582762f0 2024-08-31T06:26:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa05d836640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458643540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa05e037640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5564582762f0 0x556458643000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa05e838640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55645829f1b0 0x556458642ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa05d836640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458643540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43548/0 (socket says 172.21.15.53:43548) 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa05d836640 1 -- 172.21.15.53:0/1062307224 learned_addr learned my addr 172.21.15.53:0/1062307224 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa05e838640 1 -- 172.21.15.53:0/1062307224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5564582762f0 msgr2=0x556458643000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa05e838640 1 --2- 172.21.15.53:0/1062307224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5564582762f0 0x556458643000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa05e838640 1 -- 172.21.15.53:0/1062307224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 msgr2=0x556458643540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa05e838640 1 --2- 172.21.15.53:0/1062307224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458643540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa05e838640 1 -- 172.21.15.53:0/1062307224 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55645830a790 con 0x55645829f1b0 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.129+0000 7fa05d836640 1 --2- 172.21.15.53:0/1062307224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458643540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.130+0000 7fa05e838640 1 --2- 172.21.15.53:0/1062307224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55645829f1b0 0x556458642ac0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009f80 tx=0x7fa04c003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab375b07d197e37b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.130+0000 7fa04b7fe640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0440b4d20 0x7fa0440b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.130+0000 7fa048bfe640 1 -- 172.21.15.53:0/1062307224 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c011440 con 0x55645829f1b0 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.130+0000 7fa04b7fe640 1 -- 172.21.15.53:0/1869445191 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fa0501055d0 con 0x7fa058102750 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.130+0000 7fa048bfe640 1 -- 172.21.15.53:0/1062307224 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa04c015030 con 0x55645829f1b0 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.130+0000 7fa048bfe640 1 -- 172.21.15.53:0/1062307224 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c0108b0 con 0x55645829f1b0 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.130+0000 7fa05e037640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0440b4d20 0x7fa0440b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.131+0000 7fa06720d740 1 -- 172.21.15.53:0/1062307224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55645829f1b0 msgr2=0x556458642ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.131+0000 7fa06720d740 1 --2- 172.21.15.53:0/1062307224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55645829f1b0 0x556458642ac0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009f80 tx=0x7fa04c003e00 comp rx=0 tx=0).stop 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.131+0000 7fa05e037640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0440b4d20 0x7fa0440b7230 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa050102db0 tx=0x7fa05002a340 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.131+0000 7fa06720d740 1 -- 172.21.15.53:0/1062307224 shutdown_connections 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.131+0000 7fa06720d740 1 --2- 172.21.15.53:0/1062307224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458643540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.131+0000 7fa06720d740 1 --2- 172.21.15.53:0/1062307224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5564582762f0 0x556458643000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.131+0000 7fa06720d740 1 --2- 172.21.15.53:0/1062307224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55645829f1b0 0x556458642ac0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.131+0000 7fa06720d740 1 -- 172.21.15.53:0/1062307224 >> 172.21.15.53:0/1062307224 conn(0x556458293300 msgr2=0x5564586409b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.131+0000 7fa06720d740 1 -- 172.21.15.53:0/1062307224 shutdown_connections 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.131+0000 7fa06720d740 1 -- 172.21.15.53:0/1062307224 wait complete. 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.132+0000 7fa06720d740 1 -- start start 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.132+0000 7fa06720d740 1 Processor -- start 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.132+0000 7fa06720d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x55645864e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.132+0000 7fa06720d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645827e4d0 0x55645864ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.132+0000 7fa06720d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645829f1b0 0x55645865a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.132+0000 7fa06720d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5564584e0ab0 con 0x55645829f1b0 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.132+0000 7fa06720d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55645852e680 con 0x5564582762f0 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.132+0000 7fa06720d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556458651240 con 0x55645827e4d0 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.132+0000 7fa06720d740 10 client.0 _ll_register_callbacks cb 0x5564582b6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa05e838640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x55645864e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa05d836640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645827e4d0 0x55645864ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa05d836640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645827e4d0 0x55645864ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:42814/0 (socket says 172.21.15.53:42814) 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa05d836640 1 -- 172.21.15.53:0/4137237860 learned_addr learned my addr 172.21.15.53:0/4137237860 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa05e838640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645829f1b0 0x55645865a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa05d836640 1 -- 172.21.15.53:0/4137237860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 msgr2=0x55645864e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa05d836640 1 --2- 172.21.15.53:0/4137237860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x55645864e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa05d836640 1 -- 172.21.15.53:0/4137237860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645829f1b0 msgr2=0x55645865a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa05d836640 1 --2- 172.21.15.53:0/4137237860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645829f1b0 0x55645865a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa05d836640 1 -- 172.21.15.53:0/4137237860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556458383620 con 0x55645827e4d0 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa05d836640 1 --2- 172.21.15.53:0/4137237860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645827e4d0 0x55645864ed20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa054011ce0 tx=0x7fa05400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=996013d97ff0723d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.133+0000 7fa041ffb640 1 -- 172.21.15.53:0/4137237860 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05401f060 con 0x55645827e4d0 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.134+0000 7fa041ffb640 1 -- 172.21.15.53:0/4137237860 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fa054004260 con 0x55645827e4d0 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.134+0000 7fa06720d740 1 -- 172.21.15.53:0/4137237860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa04c015030 con 0x55645827e4d0 2024-08-31T06:26:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.134+0000 7fa041ffb640 1 -- 172.21.15.53:0/4137237860 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fa05400fe20 con 0x55645827e4d0 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.134+0000 7fa06720d740 10 client.30697 fetch_fsmap learned FSMap version 76 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.134+0000 7fa06720d740 1 -- 172.21.15.53:0/4137237860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) -- 0x55645865d360 con 0x55645827e4d0 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.134+0000 7fa041ffb640 1 -- 172.21.15.53:0/4137237860 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa04c015030 con 0x55645827e4d0 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.134+0000 7fa041ffb640 1 -- 172.21.15.53:0/4137237860 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 76) ==== 8414+0+0 (secure 0 0 0) 0x7fa05401a4c0 con 0x55645827e4d0 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.134+0000 7fa06720d740 10 client.30697 fetch_fsmap finished waiting for FSMap version 76 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.134+0000 7fa06720d740 10 client.30697 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.135+0000 7fa06720d740 20 client.30697 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.135+0000 7fa06720d740 1 --2- 172.21.15.53:0/4137237860 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55645825dd80 0x5564586609c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.135+0000 7fa06720d740 4 client.30697 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.135+0000 7fa06720d740 1 -- 172.21.15.53:0/4137237860 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564585b9f50 con 0x55645825dd80 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.135+0000 7fa05e838640 1 --2- 172.21.15.53:0/4137237860 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55645825dd80 0x5564586609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.135+0000 7fa05e838640 1 --2- 172.21.15.53:0/4137237860 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55645825dd80 0x5564586609c0 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=766cebfa783f27a1 server_cookie=b650d25b0f042781 in_seq=0 out_seq=0 2024-08-31T06:26:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.135+0000 7fa041ffb640 10 client.30697 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.136+0000 7fa041ffb640 1 -- 172.21.15.53:0/4137237860 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564585b9f50 con 0x55645825dd80 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.136+0000 7fa041ffb640 10 client.30697 handle_command_reply: tid=0 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.136+0000 7fa06720d740 1 client.30697 shutdown 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa06720d740 1 -- 172.21.15.53:0/4137237860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645827e4d0 msgr2=0x55645864ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa06720d740 1 --2- 172.21.15.53:0/4137237860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645827e4d0 0x55645864ed20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa054011ce0 tx=0x7fa05400f790 comp rx=0 tx=0).stop 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa06720d740 1 -- 172.21.15.53:0/4137237860 shutdown_connections 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa06720d740 1 --2- 172.21.15.53:0/4137237860 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55645825dd80 0x5564586609c0 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa06720d740 1 --2- 172.21.15.53:0/4137237860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645829f1b0 0x55645865a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa06720d740 1 --2- 172.21.15.53:0/4137237860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645827e4d0 0x55645864ed20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa06720d740 1 --2- 172.21.15.53:0/4137237860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x55645864e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa06720d740 1 -- 172.21.15.53:0/4137237860 >> 172.21.15.53:0/4137237860 conn(0x556458293300 msgr2=0x556458643af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa041ffb640 0 client.30697 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa06720d740 1 -- 172.21.15.53:0/4137237860 shutdown_connections 2024-08-31T06:26:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa06720d740 1 -- 172.21.15.53:0/4137237860 wait complete. 2024-08-31T06:26:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.137+0000 7fa06720d740 20 client.30697 trim_cache size 0 max 16384 2024-08-31T06:26:20.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.162+0000 7fa06720d740 1 Processor -- start 2024-08-31T06:26:20.165 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.162+0000 7fa06720d740 1 -- start start 2024-08-31T06:26:20.166 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa06720d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x556458647b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa06720d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x5564586480c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa06720d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645829f1b0 0x5564586402d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa06720d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0581af4d0 con 0x55645827e4d0 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa06720d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0581b1280 con 0x5564582762f0 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa06720d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0581afc60 con 0x55645829f1b0 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa05d836640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x5564586480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa05e838640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x556458647b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa05d836640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x5564586480c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43564/0 (socket says 172.21.15.53:43564) 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa05d836640 1 -- 172.21.15.53:0/2390373968 learned_addr learned my addr 172.21.15.53:0/2390373968 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa05e838640 1 --2- 172.21.15.53:0/2390373968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645829f1b0 0x5564586402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa05d836640 1 -- 172.21.15.53:0/2390373968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645829f1b0 msgr2=0x5564586402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa05d836640 1 --2- 172.21.15.53:0/2390373968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645829f1b0 0x5564586402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa05d836640 1 -- 172.21.15.53:0/2390373968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 msgr2=0x556458647b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa05d836640 1 --2- 172.21.15.53:0/2390373968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x556458647b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa05d836640 1 -- 172.21.15.53:0/2390373968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55645864a040 con 0x55645827e4d0 2024-08-31T06:26:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.163+0000 7fa05d836640 1 --2- 172.21.15.53:0/2390373968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x5564586480c0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fa054005c80 tx=0x7fa05401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bcf1a376473e09 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.164+0000 7fa043fff640 1 -- 172.21.15.53:0/2390373968 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054031070 con 0x55645827e4d0 2024-08-31T06:26:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.164+0000 7fa043fff640 1 -- 172.21.15.53:0/2390373968 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa05401a3f0 con 0x55645827e4d0 2024-08-31T06:26:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.164+0000 7fa043fff640 1 -- 172.21.15.53:0/2390373968 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054003b50 con 0x55645827e4d0 2024-08-31T06:26:20.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.165+0000 7fa06720d740 1 -- 172.21.15.53:0/2390373968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 msgr2=0x5564586480c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:20.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.165+0000 7fa06720d740 1 --2- 172.21.15.53:0/2390373968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x5564586480c0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fa054005c80 tx=0x7fa05401acd0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.165+0000 7fa06720d740 1 -- 172.21.15.53:0/2390373968 shutdown_connections 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.165+0000 7fa06720d740 1 --2- 172.21.15.53:0/2390373968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645829f1b0 0x5564586402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.165+0000 7fa06720d740 1 --2- 172.21.15.53:0/2390373968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x5564586480c0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.165+0000 7fa06720d740 1 --2- 172.21.15.53:0/2390373968 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x556458647b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.165+0000 7fa06720d740 1 -- 172.21.15.53:0/2390373968 >> 172.21.15.53:0/2390373968 conn(0x556458293300 msgr2=0x55645864cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.165+0000 7fa06720d740 1 -- 172.21.15.53:0/2390373968 shutdown_connections 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.165+0000 7fa06720d740 1 -- 172.21.15.53:0/2390373968 wait complete. 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa06720d740 1 -- start start 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa06720d740 1 Processor -- start 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa06720d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x556458656c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa06720d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458652110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa06720d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645829f1b0 0x556458652650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa06720d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa0581b0af0 con 0x55645827e4d0 2024-08-31T06:26:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa06720d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0581b0360 con 0x5564582762f0 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa06720d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa0581ad4d0 con 0x55645829f1b0 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa06720d740 10 client.0 _ll_register_callbacks cb 0x7fa054009d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa05d836640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458652110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa05d836640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458652110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43576/0 (socket says 172.21.15.53:43576) 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa05d836640 1 -- 172.21.15.53:0/2078813122 learned_addr learned my addr 172.21.15.53:0/2078813122 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa05e838640 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x556458656c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.166+0000 7fa05e838640 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645829f1b0 0x556458652650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa05d836640 1 -- 172.21.15.53:0/2078813122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645829f1b0 msgr2=0x556458652650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa05d836640 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645829f1b0 0x556458652650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa05d836640 1 -- 172.21.15.53:0/2078813122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 msgr2=0x556458656c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa05d836640 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x556458656c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa05d836640 1 -- 172.21.15.53:0/2078813122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556458652de0 con 0x55645827e4d0 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa05d836640 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458652110 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fa05401a970 tx=0x7fa05401aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b259093d9d79e868 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa041ffb640 1 -- 172.21.15.53:0/2078813122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054031040 con 0x55645827e4d0 2024-08-31T06:26:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa041ffb640 1 -- 172.21.15.53:0/2078813122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fa054005300 con 0x55645827e4d0 2024-08-31T06:26:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa06720d740 1 -- 172.21.15.53:0/2078813122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa05401a3f0 con 0x55645827e4d0 2024-08-31T06:26:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa041ffb640 1 -- 172.21.15.53:0/2078813122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fa054042050 con 0x55645827e4d0 2024-08-31T06:26:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.167+0000 7fa06720d740 10 client.21972 fetch_fsmap learned FSMap version 76 2024-08-31T06:26:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.168+0000 7fa06720d740 1 -- 172.21.15.53:0/2078813122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) -- 0x5564586cf690 con 0x55645827e4d0 2024-08-31T06:26:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.168+0000 7fa041ffb640 1 -- 172.21.15.53:0/2078813122 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa05401a3f0 con 0x55645827e4d0 2024-08-31T06:26:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.168+0000 7fa041ffb640 1 -- 172.21.15.53:0/2078813122 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 76) ==== 8414+0+0 (secure 0 0 0) 0x7fa05403d030 con 0x55645827e4d0 2024-08-31T06:26:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.168+0000 7fa06720d740 10 client.21972 fetch_fsmap finished waiting for FSMap version 76 2024-08-31T06:26:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.168+0000 7fa06720d740 10 client.21972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.168+0000 7fa06720d740 20 client.21972 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.168+0000 7fa06720d740 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5564582331c0 0x5564586d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.168+0000 7fa06720d740 4 client.21972 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:26:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.168+0000 7fa06720d740 1 -- 172.21.15.53:0/2078813122 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564585b59f0 con 0x5564582331c0 2024-08-31T06:26:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.169+0000 7fa05e838640 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5564582331c0 0x5564586d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.169+0000 7fa05e838640 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5564582331c0 0x5564586d1e40 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ef2f074c345c238 server_cookie=6385620a85bb64dd in_seq=0 out_seq=0 2024-08-31T06:26:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.169+0000 7fa041ffb640 10 client.21972 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa041ffb640 1 -- 172.21.15.53:0/2078813122 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564585b59f0 con 0x5564582331c0 2024-08-31T06:26:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa041ffb640 10 client.21972 handle_command_reply: tid=0 2024-08-31T06:26:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa06720d740 1 client.21972 shutdown 2024-08-31T06:26:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa06720d740 1 -- 172.21.15.53:0/2078813122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 msgr2=0x556458652110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa06720d740 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458652110 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fa05401a970 tx=0x7fa05401aab0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa06720d740 1 -- 172.21.15.53:0/2078813122 shutdown_connections 2024-08-31T06:26:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa06720d740 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5564582331c0 0x5564586d1e40 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa06720d740 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55645829f1b0 0x556458652650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa041ffb640 0 client.21972 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa06720d740 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55645827e4d0 0x556458652110 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa06720d740 1 --2- 172.21.15.53:0/2078813122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5564582762f0 0x556458656c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.293+0000 7fa06720d740 1 -- 172.21.15.53:0/2078813122 >> 172.21.15.53:0/2078813122 conn(0x556458293300 msgr2=0x55645864cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.294+0000 7fa06720d740 1 -- 172.21.15.53:0/2078813122 shutdown_connections 2024-08-31T06:26:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.294+0000 7fa06720d740 1 -- 172.21.15.53:0/2078813122 wait complete. 2024-08-31T06:26:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.294+0000 7fa06720d740 20 client.21972 trim_cache size 0 max 16384 2024-08-31T06:26:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:26:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:26:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:26:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:26:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.294+0000 7fa06029b640 1 -- 172.21.15.53:0/1869445191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0440b4d20 msgr2=0x7fa0440b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.294+0000 7fa06029b640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0440b4d20 0x7fa0440b7230 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa050102db0 tx=0x7fa05002a340 comp rx=0 tx=0).stop 2024-08-31T06:26:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.294+0000 7fa06029b640 1 -- 172.21.15.53:0/1869445191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa058102750 msgr2=0x7fa05819a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.294+0000 7fa06029b640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa058102750 0x7fa05819a1c0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fa0500057c0 tx=0x7fa050030d60 comp rx=0 tx=0).stop 2024-08-31T06:26:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.295+0000 7fa06029b640 1 -- 172.21.15.53:0/1869445191 shutdown_connections 2024-08-31T06:26:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.295+0000 7fa06029b640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa0440b4d20 0x7fa0440b7230 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.295+0000 7fa06029b640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0581089d0 0x7fa05819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.295+0000 7fa06029b640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa058108080 0x7fa05819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.295+0000 7fa06029b640 1 --2- 172.21.15.53:0/1869445191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa058102750 0x7fa05819a1c0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.295+0000 7fa06029b640 1 -- 172.21.15.53:0/1869445191 >> 172.21.15.53:0/1869445191 conn(0x7fa05807a4e0 msgr2=0x7fa0581018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.295+0000 7fa06029b640 1 -- 172.21.15.53:0/1869445191 shutdown_connections 2024-08-31T06:26:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:20.295+0000 7fa06029b640 1 -- 172.21.15.53:0/1869445191 wait complete. 2024-08-31T06:26:20.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 53125 5.70 MB/sec execute 368 sec latency 146.539 ms 2024-08-31T06:26:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:20 smithi053 ceph-mon[18924]: pgmap v996: 97 pgs: 97 active+clean; 850 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.2 MiB/s wr, 345 op/s 2024-08-31T06:26:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:20 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:26:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:20 smithi130 ceph-mon[22266]: pgmap v996: 97 pgs: 97 active+clean; 850 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.2 MiB/s wr, 345 op/s 2024-08-31T06:26:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:20 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:26:20.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:20 smithi153 ceph-mon[22320]: pgmap v996: 97 pgs: 97 active+clean; 850 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.2 MiB/s wr, 345 op/s 2024-08-31T06:26:20.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:20 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:26:21.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 53283 5.70 MB/sec execute 369 sec latency 58.877 ms 2024-08-31T06:26:22.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 53406 5.69 MB/sec execute 370 sec latency 194.842 ms 2024-08-31T06:26:22.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:22 smithi053 ceph-mon[18924]: pgmap v997: 97 pgs: 97 active+clean; 852 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 392 op/s 2024-08-31T06:26:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:22 smithi130 ceph-mon[22266]: pgmap v997: 97 pgs: 97 active+clean; 852 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 392 op/s 2024-08-31T06:26:22.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:22 smithi153 ceph-mon[22320]: pgmap v997: 97 pgs: 97 active+clean; 852 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 392 op/s 2024-08-31T06:26:23.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 53550 5.68 MB/sec execute 371 sec latency 176.399 ms 2024-08-31T06:26:24.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 53731 5.69 MB/sec execute 372 sec latency 120.915 ms 2024-08-31T06:26:24.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:24 smithi053 ceph-mon[18924]: pgmap v998: 97 pgs: 97 active+clean; 849 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 311 op/s 2024-08-31T06:26:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:24 smithi130 ceph-mon[22266]: pgmap v998: 97 pgs: 97 active+clean; 849 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 311 op/s 2024-08-31T06:26:24.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:24 smithi153 ceph-mon[22320]: pgmap v998: 97 pgs: 97 active+clean; 849 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 311 op/s 2024-08-31T06:26:25.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 53922 5.71 MB/sec execute 373 sec latency 191.798 ms 2024-08-31T06:26:25.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:25 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:26:25.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:25 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:26:25.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:25 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:26:26.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 54102 5.72 MB/sec execute 374 sec latency 95.359 ms 2024-08-31T06:26:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:26 smithi130 ceph-mon[22266]: pgmap v999: 97 pgs: 97 active+clean; 853 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 363 op/s 2024-08-31T06:26:26.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:26 smithi153 ceph-mon[22320]: pgmap v999: 97 pgs: 97 active+clean; 853 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 363 op/s 2024-08-31T06:26:26.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:26 smithi053 ceph-mon[18924]: pgmap v999: 97 pgs: 97 active+clean; 853 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 363 op/s 2024-08-31T06:26:27.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 54308 5.75 MB/sec execute 375 sec latency 59.813 ms 2024-08-31T06:26:27.569 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T06:26:27.569 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-31T06:26:27.570 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:26:27.934 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:28.170 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:26:28.379 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:28 smithi053 ceph-mon[18924]: pgmap v1000: 97 pgs: 97 active+clean; 854 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 385 op/s 2024-08-31T06:26:28.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 54466 5.77 MB/sec execute 376 sec latency 104.419 ms 2024-08-31T06:26:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:28 smithi130 ceph-mon[22266]: pgmap v1000: 97 pgs: 97 active+clean; 854 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 385 op/s 2024-08-31T06:26:28.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:28 smithi153 ceph-mon[22320]: pgmap v1000: 97 pgs: 97 active+clean; 854 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 385 op/s 2024-08-31T06:26:28.714 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:29.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.290+0000 7fcfbb90f640 1 -- 172.21.15.53:0/1763329857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfb4103930 msgr2=0x7fcfb4103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.290+0000 7fcfbb90f640 1 --2- 172.21.15.53:0/1763329857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfb4103930 0x7fcfb4103d40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009900 tx=0x7fcfb002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.291+0000 7fcfbb90f640 1 -- 172.21.15.53:0/1763329857 shutdown_connections 2024-08-31T06:26:29.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.291+0000 7fcfbb90f640 1 --2- 172.21.15.53:0/1763329857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb4109bc0 0x7fcfb41103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.291+0000 7fcfbb90f640 1 --2- 172.21.15.53:0/1763329857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfb4109270 0x7fcfb4109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.291+0000 7fcfbb90f640 1 --2- 172.21.15.53:0/1763329857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfb4103930 0x7fcfb4103d40 secure :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009900 tx=0x7fcfb002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.291+0000 7fcfbb90f640 1 -- 172.21.15.53:0/1763329857 >> 172.21.15.53:0/1763329857 conn(0x7fcfb40ff3a0 msgr2=0x7fcfb41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.292+0000 7fcfbb90f640 1 -- 172.21.15.53:0/1763329857 shutdown_connections 2024-08-31T06:26:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.292+0000 7fcfbb90f640 1 -- 172.21.15.53:0/1763329857 wait complete. 2024-08-31T06:26:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.294+0000 7fcfbb90f640 1 Processor -- start 2024-08-31T06:26:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.294+0000 7fcfbb90f640 1 -- start start 2024-08-31T06:26:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.294+0000 7fcfbb90f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfb4109270 0x7fcfb419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.294+0000 7fcfbb90f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfb4109bc0 0x7fcfb419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfbb90f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb419fab0 0x7fcfb419fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb96ab640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfb4109270 0x7fcfb419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb8eaa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfb4109bc0 0x7fcfb419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb96ab640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfb4109270 0x7fcfb419a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33826/0 (socket says 172.21.15.53:33826) 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb8eaa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfb4109bc0 0x7fcfb419a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:40422/0 (socket says 172.21.15.53:40422) 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb8eaa640 1 -- 172.21.15.53:0/2647016331 learned_addr learned my addr 172.21.15.53:0/2647016331 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb4113780 con 0x7fcfb419fab0 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb4113600 con 0x7fcfb4109270 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb4113900 con 0x7fcfb4109bc0 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb9eac640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb419fab0 0x7fcfb419fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb8eaa640 1 -- 172.21.15.53:0/2647016331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfb4109270 msgr2=0x7fcfb419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb8eaa640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfb4109270 0x7fcfb419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb8eaa640 1 -- 172.21.15.53:0/2647016331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb419fab0 msgr2=0x7fcfb419fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb8eaa640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb419fab0 0x7fcfb419fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb8eaa640 1 -- 172.21.15.53:0/2647016331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb41a0690 con 0x7fcfb4109bc0 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.295+0000 7fcfb9eac640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb419fab0 0x7fcfb419fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.296+0000 7fcfb8eaa640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfb4109bc0 0x7fcfb419a8d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e9f0 tx=0x7fcfa400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.296+0000 7fcfaa7fc640 1 -- 172.21.15.53:0/2647016331 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400ccc0 con 0x7fcfb4109bc0 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.296+0000 7fcfaa7fc640 1 -- 172.21.15.53:0/2647016331 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcfa40108c0 con 0x7fcfb4109bc0 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.296+0000 7fcfaa7fc640 1 -- 172.21.15.53:0/2647016331 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4018660 con 0x7fcfb4109bc0 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.296+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb4075390 con 0x7fcfb4109bc0 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.296+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb4075810 con 0x7fcfb4109bc0 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.299+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb4103d40 con 0x7fcfb4109bc0 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.300+0000 7fcfaa7fc640 1 -- 172.21.15.53:0/2647016331 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcfa4018800 con 0x7fcfb4109bc0 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.301+0000 7fcfaa7fc640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcfa00b4df0 0x7fcfa00b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.302+0000 7fcfb96ab640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcfa00b4df0 0x7fcfa00b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.302+0000 7fcfaa7fc640 1 -- 172.21.15.53:0/2647016331 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fcfa40e58a0 con 0x7fcfb4109bc0 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.302+0000 7fcfb96ab640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcfa00b4df0 0x7fcfa00b7300 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009230 tx=0x7fcfb0005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.306+0000 7fcfaa7fc640 1 -- 172.21.15.53:0/2647016331 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcfa40ac670 con 0x7fcfb4109bc0 2024-08-31T06:26:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.361+0000 7f61e5941640 1 -- 172.21.15.53:0/1300563854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0108b20 msgr2=0x7f61e010f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.361+0000 7f61e5941640 1 --2- 172.21.15.53:0/1300563854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0108b20 0x7f61e010f350 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f61d8009900 tx=0x7f61d802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.361+0000 7f61e5941640 1 -- 172.21.15.53:0/1300563854 shutdown_connections 2024-08-31T06:26:29.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.361+0000 7f61e5941640 1 --2- 172.21.15.53:0/1300563854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0108b20 0x7f61e010f350 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.361+0000 7f61e5941640 1 --2- 172.21.15.53:0/1300563854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61e01081d0 0x7f61e01085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.361+0000 7f61e5941640 1 --2- 172.21.15.53:0/1300563854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e0102e80 0x7f61e0103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.361+0000 7f61e5941640 1 -- 172.21.15.53:0/1300563854 >> 172.21.15.53:0/1300563854 conn(0x7f61e0077a00 msgr2=0x7f61e0077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:29.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.361+0000 7f61e5941640 1 -- 172.21.15.53:0/1300563854 shutdown_connections 2024-08-31T06:26:29.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.361+0000 7f61e5941640 1 -- 172.21.15.53:0/1300563854 wait complete. 2024-08-31T06:26:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.362+0000 7f61e5941640 1 Processor -- start 2024-08-31T06:26:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.362+0000 7f61e5941640 1 -- start start 2024-08-31T06:26:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61e5941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0102e80 0x7f61e019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61e5941640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e01081d0 0x7f61e0197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61e5941640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61e0108b20 0x7f61e01982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61e5941640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f61e0111590 con 0x7f61e0102e80 2024-08-31T06:26:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61e5941640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f61e0111410 con 0x7f61e01081d0 2024-08-31T06:26:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61e5941640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61e0111710 con 0x7f61e0108b20 2024-08-31T06:26:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0102e80 0x7f61e019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0102e80 0x7f61e019b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51242/0 (socket says 172.21.15.53:51242) 2024-08-31T06:26:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61deffd640 1 -- 172.21.15.53:0/2965311855 learned_addr learned my addr 172.21.15.53:0/2965311855 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:29.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61df7fe640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61e0108b20 0x7f61e01982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61d7fff640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e01081d0 0x7f61e0197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61d7fff640 1 -- 172.21.15.53:0/2965311855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61e0108b20 msgr2=0x7f61e01982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61d7fff640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61e0108b20 0x7f61e01982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61d7fff640 1 -- 172.21.15.53:0/2965311855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0102e80 msgr2=0x7f61e019b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61d7fff640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0102e80 0x7f61e019b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61d7fff640 1 -- 172.21.15.53:0/2965311855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e01ac720 con 0x7f61e01081d0 2024-08-31T06:26:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.363+0000 7f61deffd640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0102e80 0x7f61e019b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.364+0000 7f61d7fff640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e01081d0 0x7f61e0197bd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f61e0075850 tx=0x7f61c8009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.364+0000 7f61e493f640 1 -- 172.21.15.53:0/2965311855 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c800e870 con 0x7f61e01081d0 2024-08-31T06:26:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.364+0000 7f61e493f640 1 -- 172.21.15.53:0/2965311855 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61c8019070 con 0x7f61e01081d0 2024-08-31T06:26:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.364+0000 7f61e493f640 1 -- 172.21.15.53:0/2965311855 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8014e00 con 0x7f61e01081d0 2024-08-31T06:26:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.364+0000 7f61e5941640 1 -- 172.21.15.53:0/2965311855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e01ac950 con 0x7f61e01081d0 2024-08-31T06:26:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.364+0000 7f61e5941640 1 -- 172.21.15.53:0/2965311855 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e01ace40 con 0x7f61e01081d0 2024-08-31T06:26:29.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.368+0000 7f61e493f640 1 -- 172.21.15.53:0/2965311855 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f61c801e460 con 0x7f61e01081d0 2024-08-31T06:26:29.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.369+0000 7f61e493f640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61cc0b4ca0 0x7f61cc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.369+0000 7f61e493f640 1 -- 172.21.15.53:0/2965311855 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f61c80e6090 con 0x7f61e01081d0 2024-08-31T06:26:29.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.369+0000 7f61deffd640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61cc0b4ca0 0x7f61cc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 54642 5.79 MB/sec execute 377 sec latency 68.407 ms 2024-08-31T06:26:29.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.396+0000 7f61deffd640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61cc0b4ca0 0x7f61cc0b71b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f61e019b640 tx=0x7f61d0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:29.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.397+0000 7f61ebeb6740 1 Processor -- start 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.397+0000 7f61ebeb6740 1 -- start start 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.397+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a3342070 0x5624a36e7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.397+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a33191b0 0x5624a36e7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.397+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 0x5624a36e7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.397+0000 7f61ebeb6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5624a365e630 con 0x5624a3342070 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.397+0000 7f61ebeb6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5624a364dbc0 con 0x5624a3321390 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.397+0000 7f61ebeb6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5624a3651b70 con 0x5624a33191b0 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.398+0000 7f61deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a3342070 0x5624a36e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.398+0000 7f61df7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 0x5624a36e7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.398+0000 7f61deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a3342070 0x5624a36e7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51248/0 (socket says 172.21.15.53:51248) 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.398+0000 7f61deffd640 1 -- 172.21.15.53:0/1975796162 learned_addr learned my addr 172.21.15.53:0/1975796162 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:29.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.398+0000 7f61d7fff640 1 --2- 172.21.15.53:0/1975796162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a33191b0 0x5624a36e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.398+0000 7f61df7fe640 1 -- 172.21.15.53:0/1975796162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a33191b0 msgr2=0x5624a36e7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:29.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.398+0000 7f61df7fe640 1 --2- 172.21.15.53:0/1975796162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a33191b0 0x5624a36e7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.398+0000 7f61df7fe640 1 -- 172.21.15.53:0/1975796162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a3342070 msgr2=0x5624a36e7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:29.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.398+0000 7f61df7fe640 1 --2- 172.21.15.53:0/1975796162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a3342070 0x5624a36e7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.398+0000 7f61df7fe640 1 -- 172.21.15.53:0/1975796162 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a33ad650 con 0x5624a3321390 2024-08-31T06:26:29.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.398+0000 7f61df7fe640 1 --2- 172.21.15.53:0/1975796162 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 0x5624a36e7d80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f61d802a910 tx=0x7f61d8009610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20412fcaae4f635 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:29.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.399+0000 7f61d5ffb640 1 -- 172.21.15.53:0/1975796162 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d8035040 con 0x5624a3321390 2024-08-31T06:26:29.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.399+0000 7f61d5ffb640 1 -- 172.21.15.53:0/1975796162 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61d803c440 con 0x5624a3321390 2024-08-31T06:26:29.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.399+0000 7f61d5ffb640 1 -- 172.21.15.53:0/1975796162 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d8044600 con 0x5624a3321390 2024-08-31T06:26:29.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.400+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1975796162 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 msgr2=0x5624a36e7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.400+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/1975796162 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 0x5624a36e7d80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f61d802a910 tx=0x7f61d8009610 comp rx=0 tx=0).stop 2024-08-31T06:26:29.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.400+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1975796162 shutdown_connections 2024-08-31T06:26:29.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.400+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/1975796162 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 0x5624a36e7d80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.400+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/1975796162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a33191b0 0x5624a36e7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.400+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/1975796162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a3342070 0x5624a36e7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.400+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1975796162 >> 172.21.15.53:0/1975796162 conn(0x5624a3336460 msgr2=0x5624a36e51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:29.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.400+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1975796162 shutdown_connections 2024-08-31T06:26:29.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.400+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1975796162 wait complete. 2024-08-31T06:26:29.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.401+0000 7f61ebeb6740 1 -- start start 2024-08-31T06:26:29.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.401+0000 7f61ebeb6740 1 Processor -- start 2024-08-31T06:26:29.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.402+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a33191b0 0x5624a36f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.402+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3321390 0x5624a36f3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.402+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a3342070 0x5624a36fed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.402+0000 7f61deffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a33191b0 0x5624a36f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.402+0000 7f61deffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a33191b0 0x5624a36f2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33848/0 (socket says 172.21.15.53:33848) 2024-08-31T06:26:29.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.403+0000 7f61deffd640 1 -- 172.21.15.53:0/2271752401 learned_addr learned my addr 172.21.15.53:0/2271752401 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:29.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.403+0000 7f61ebeb6740 1 -- 172.21.15.53:0/2271752401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5624a34b0700 con 0x5624a3342070 2024-08-31T06:26:29.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.403+0000 7f61ebeb6740 1 -- 172.21.15.53:0/2271752401 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5624a35d4700 con 0x5624a33191b0 2024-08-31T06:26:29.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.403+0000 7f61ebeb6740 1 -- 172.21.15.53:0/2271752401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5624a36f5a80 con 0x5624a3321390 2024-08-31T06:26:29.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.403+0000 7f61ebeb6740 10 client.0 _ll_register_callbacks cb 0x5624a3603dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:29.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.403+0000 7f61df7fe640 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a3342070 0x5624a36fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.403+0000 7f61deffd640 1 -- 172.21.15.53:0/2271752401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3321390 msgr2=0x5624a36f3040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:26:29.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.403+0000 7f61deffd640 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3321390 0x5624a36f3040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.403+0000 7f61deffd640 1 -- 172.21.15.53:0/2271752401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a3342070 msgr2=0x5624a36fed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:29.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.403+0000 7f61deffd640 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a3342070 0x5624a36fed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.403+0000 7f61deffd640 1 -- 172.21.15.53:0/2271752401 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a360d8b0 con 0x5624a33191b0 2024-08-31T06:26:29.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.404+0000 7f61deffd640 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a33191b0 0x5624a36f2ae0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f61d001f6b0 tx=0x7f61d0004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac404802af70d619 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:29.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.404+0000 7f61beffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:26:29.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.404+0000 7f61beffd640 1 -- 172.21.15.53:0/2271752401 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d002c060 con 0x5624a33191b0 2024-08-31T06:26:29.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.404+0000 7f61ebeb6740 1 -- 172.21.15.53:0/2271752401 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61d803c440 con 0x5624a33191b0 2024-08-31T06:26:29.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.404+0000 7f61beffd640 1 -- 172.21.15.53:0/2271752401 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f61d0009040 con 0x5624a33191b0 2024-08-31T06:26:29.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.405+0000 7f61beffd640 1 -- 172.21.15.53:0/2271752401 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f61d001d7c0 con 0x5624a33191b0 2024-08-31T06:26:29.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.405+0000 7f61ebeb6740 10 client.30722 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:29.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.405+0000 7f61ebeb6740 1 -- 172.21.15.53:0/2271752401 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x5624a3701960 con 0x5624a33191b0 2024-08-31T06:26:29.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.405+0000 7f61beffd640 1 -- 172.21.15.53:0/2271752401 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61d803c440 con 0x5624a33191b0 2024-08-31T06:26:29.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.406+0000 7f61beffd640 1 -- 172.21.15.53:0/2271752401 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f61d0027970 con 0x5624a33191b0 2024-08-31T06:26:29.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.406+0000 7f61ebeb6740 10 client.30722 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:29.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.406+0000 7f61ebeb6740 10 client.30722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.406+0000 7f61ebeb6740 20 client.30722 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.406+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624a33009f0 0x5624a3704ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.406+0000 7f61ebeb6740 4 client.30722 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.406+0000 7f61ebeb6740 1 -- 172.21.15.53:0/2271752401 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624a3660580 con 0x5624a33009f0 2024-08-31T06:26:29.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.407+0000 7f61d7fff640 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624a33009f0 0x5624a3704ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.408+0000 7f61d7fff640 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624a33009f0 0x5624a3704ed0 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b0e2c34f2b939e8 server_cookie=1055996e0641f634 in_seq=0 out_seq=0 2024-08-31T06:26:29.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.408+0000 7f61beffd640 10 client.30722 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:29.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.410+0000 7f61beffd640 1 -- 172.21.15.53:0/2271752401 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624a3660580 con 0x5624a33009f0 2024-08-31T06:26:29.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.410+0000 7f61beffd640 10 client.30722 handle_command_reply: tid=0 2024-08-31T06:26:29.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.410+0000 7f61ebeb6740 1 client.30722 shutdown 2024-08-31T06:26:29.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.412+0000 7f61ebeb6740 1 -- 172.21.15.53:0/2271752401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a33191b0 msgr2=0x5624a36f2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.412+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a33191b0 0x5624a36f2ae0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f61d001f6b0 tx=0x7f61d0004ab0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.412+0000 7f61ebeb6740 1 -- 172.21.15.53:0/2271752401 shutdown_connections 2024-08-31T06:26:29.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.412+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624a33009f0 0x5624a3704ed0 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.412+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a3342070 0x5624a36fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.412+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3321390 0x5624a36f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.412+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/2271752401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a33191b0 0x5624a36f2ae0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.412+0000 7f61ebeb6740 1 -- 172.21.15.53:0/2271752401 >> 172.21.15.53:0/2271752401 conn(0x5624a3336460 msgr2=0x5624a36ea4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:29.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.412+0000 7f61beffd640 0 client.30722 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:29.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.413+0000 7f61ebeb6740 1 -- 172.21.15.53:0/2271752401 shutdown_connections 2024-08-31T06:26:29.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.413+0000 7f61ebeb6740 1 -- 172.21.15.53:0/2271752401 wait complete. 2024-08-31T06:26:29.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.413+0000 7f61ebeb6740 20 client.30722 trim_cache size 0 max 16384 2024-08-31T06:26:29.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.438+0000 7f61ebeb6740 1 Processor -- start 2024-08-31T06:26:29.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.438+0000 7f61ebeb6740 1 -- start start 2024-08-31T06:26:29.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36eab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 0x5624a36fec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3342070 0x5624a36ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 0x5624a36fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 0x5624a36fec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:33852/0 (socket says 172.21.15.53:33852) 2024-08-31T06:26:29.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36eab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51262/0 (socket says 172.21.15.53:51262) 2024-08-31T06:26:29.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61d7fff640 1 -- 172.21.15.53:0/3517856023 learned_addr learned my addr 172.21.15.53:0/3517856023 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:29.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61df7fe640 1 --2- 172.21.15.53:0/3517856023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3342070 0x5624a36ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61ebeb6740 1 -- 172.21.15.53:0/3517856023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f61e01b5b50 con 0x5624a33191b0 2024-08-31T06:26:29.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61ebeb6740 1 -- 172.21.15.53:0/3517856023 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f61e01b7990 con 0x5624a3321390 2024-08-31T06:26:29.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.439+0000 7f61ebeb6740 1 -- 172.21.15.53:0/3517856023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61e01b62e0 con 0x5624a3342070 2024-08-31T06:26:29.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.440+0000 7f61deffd640 1 -- 172.21.15.53:0/3517856023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3342070 msgr2=0x5624a36ff1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:29.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.440+0000 7f61deffd640 1 --2- 172.21.15.53:0/3517856023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3342070 0x5624a36ff1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.440+0000 7f61deffd640 1 -- 172.21.15.53:0/3517856023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 msgr2=0x5624a36fec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:29.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.440+0000 7f61deffd640 1 --2- 172.21.15.53:0/3517856023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 0x5624a36fec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.440+0000 7f61deffd640 1 -- 172.21.15.53:0/3517856023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a3701770 con 0x5624a33191b0 2024-08-31T06:26:29.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.440+0000 7f61d7fff640 1 --2- 172.21.15.53:0/3517856023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 0x5624a36fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:29.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.440+0000 7f61deffd640 1 --2- 172.21.15.53:0/3517856023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36eab10 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f61d0027de0 tx=0x7f61d0009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6c1742bd266026 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:29.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.440+0000 7f61d57fa640 1 -- 172.21.15.53:0/3517856023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011e60 con 0x5624a33191b0 2024-08-31T06:26:29.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.440+0000 7f61d57fa640 1 -- 172.21.15.53:0/3517856023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61d002f510 con 0x5624a33191b0 2024-08-31T06:26:29.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.441+0000 7f61d57fa640 1 -- 172.21.15.53:0/3517856023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d002fcc0 con 0x5624a33191b0 2024-08-31T06:26:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.441+0000 7f61ebeb6740 1 -- 172.21.15.53:0/3517856023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 msgr2=0x5624a36eab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.441+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/3517856023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36eab10 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f61d0027de0 tx=0x7f61d0009f80 comp rx=0 tx=0).stop 2024-08-31T06:26:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.442+0000 7f61ebeb6740 1 -- 172.21.15.53:0/3517856023 shutdown_connections 2024-08-31T06:26:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.442+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/3517856023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3342070 0x5624a36ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.442+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/3517856023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3321390 0x5624a36fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.442+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/3517856023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36eab10 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.442+0000 7f61ebeb6740 1 -- 172.21.15.53:0/3517856023 >> 172.21.15.53:0/3517856023 conn(0x5624a3336460 msgr2=0x5624a36ea400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.442+0000 7f61ebeb6740 1 -- 172.21.15.53:0/3517856023 shutdown_connections 2024-08-31T06:26:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.442+0000 7f61ebeb6740 1 -- 172.21.15.53:0/3517856023 wait complete. 2024-08-31T06:26:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.442+0000 7f61ebeb6740 1 -- start start 2024-08-31T06:26:29.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.443+0000 7f61ebeb6740 1 Processor -- start 2024-08-31T06:26:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36fb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3321390 0x5624a36f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61ebeb6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3342070 0x5624a36f7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61ebeb6740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f61e01b7200 con 0x5624a33191b0 2024-08-31T06:26:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61ebeb6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f61e01b6a70 con 0x5624a3342070 2024-08-31T06:26:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36fb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61ebeb6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61e01b3b50 con 0x5624a3321390 2024-08-31T06:26:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36fb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51270/0 (socket says 172.21.15.53:51270) 2024-08-31T06:26:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61deffd640 1 -- 172.21.15.53:0/1299159025 learned_addr learned my addr 172.21.15.53:0/1299159025 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61ebeb6740 10 client.0 _ll_register_callbacks cb 0x7f61d000fdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61d7fff640 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3321390 0x5624a36f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61df7fe640 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3342070 0x5624a36f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61deffd640 1 -- 172.21.15.53:0/1299159025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3321390 msgr2=0x5624a36f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61deffd640 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3321390 0x5624a36f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61deffd640 1 -- 172.21.15.53:0/1299159025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3342070 msgr2=0x5624a36f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61deffd640 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3342070 0x5624a36f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.444+0000 7f61deffd640 1 -- 172.21.15.53:0/1299159025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a376e8d0 con 0x5624a33191b0 2024-08-31T06:26:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.445+0000 7f61df7fe640 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3342070 0x5624a36f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.445+0000 7f61deffd640 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36fb6f0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f61d0016040 tx=0x7f61d0009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910fa59b7046d1ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.445+0000 7f61beffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.445+0000 7f61beffd640 1 -- 172.21.15.53:0/1299159025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0057060 con 0x5624a33191b0 2024-08-31T06:26:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.445+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1299159025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61d002f510 con 0x5624a33191b0 2024-08-31T06:26:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.445+0000 7f61beffd640 1 -- 172.21.15.53:0/1299159025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f61d0009040 con 0x5624a33191b0 2024-08-31T06:26:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.446+0000 7f61beffd640 1 -- 172.21.15.53:0/1299159025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f61d004e030 con 0x5624a33191b0 2024-08-31T06:26:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.446+0000 7f61ebeb6740 10 client.21996 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.446+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1299159025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x5624a376fa40 con 0x5624a33191b0 2024-08-31T06:26:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.446+0000 7f61beffd640 1 -- 172.21.15.53:0/1299159025 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61d002f510 con 0x5624a33191b0 2024-08-31T06:26:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.446+0000 7f61beffd640 1 -- 172.21.15.53:0/1299159025 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f61d00278e0 con 0x5624a33191b0 2024-08-31T06:26:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.447+0000 7f61ebeb6740 10 client.21996 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.447+0000 7f61ebeb6740 10 client.21996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.447+0000 7f61ebeb6740 20 client.21996 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.447+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624a32d5da0 0x5624a37721d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.447+0000 7f61ebeb6740 4 client.21996 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.447+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1299159025 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5624a365c020 con 0x5624a32d5da0 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.447+0000 7f61d7fff640 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624a32d5da0 0x5624a37721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.447+0000 7f61beffd640 10 client.21996 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.447+0000 7f61d7fff640 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624a32d5da0 0x5624a37721d0 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7baaf07038aecdb server_cookie=c5fa702761cbbbd6 in_seq=0 out_seq=0 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61beffd640 1 -- 172.21.15.53:0/1299159025 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7474 (crc 0 0 0) 0x5624a365c020 con 0x5624a32d5da0 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61beffd640 10 client.21996 handle_command_reply: tid=0 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61ebeb6740 1 client.21996 shutdown 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1299159025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 msgr2=0x5624a36fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36fb6f0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f61d0016040 tx=0x7f61d0009590 comp rx=0 tx=0).stop 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1299159025 shutdown_connections 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5624a32d5da0 0x5624a37721d0 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5624a3342070 0x5624a36f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5624a3321390 0x5624a36f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61ebeb6740 1 --2- 172.21.15.53:0/1299159025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624a33191b0 0x5624a36fb6f0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1299159025 >> 172.21.15.53:0/1299159025 conn(0x5624a3336460 msgr2=0x5624a36eab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.448+0000 7f61beffd640 0 client.21996 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.449+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1299159025 shutdown_connections 2024-08-31T06:26:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.449+0000 7f61ebeb6740 1 -- 172.21.15.53:0/1299159025 wait complete. 2024-08-31T06:26:29.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.449+0000 7f61ebeb6740 20 client.21996 trim_cache size 0 max 16384 2024-08-31T06:26:29.455 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:26:29.455 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:26:29.455 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:26:29.455 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.456 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:26:29.457 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:25:55.673122+0000", 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.458 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.459 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:26:29.460 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.461 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.462 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:26:29.463 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.465 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:26:29.466 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.468 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:26:29.469 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:29.470 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:26:29.471 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:26:29.471 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:29.471 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:29.471 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:29.471 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:29.471 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:29.471 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:29.471 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:29.471 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.450+0000 7f61e5941640 1 -- 172.21.15.53:0/2965311855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61cc0b4ca0 msgr2=0x7f61cc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.450+0000 7f61e5941640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61cc0b4ca0 0x7f61cc0b71b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f61e019b640 tx=0x7f61d0009500 comp rx=0 tx=0).stop 2024-08-31T06:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.450+0000 7f61e5941640 1 -- 172.21.15.53:0/2965311855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e01081d0 msgr2=0x7f61e0197bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.450+0000 7f61e5941640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e01081d0 0x7f61e0197bd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f61e0075850 tx=0x7f61c8009c60 comp rx=0 tx=0).stop 2024-08-31T06:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.450+0000 7f61e5941640 1 -- 172.21.15.53:0/2965311855 shutdown_connections 2024-08-31T06:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.450+0000 7f61e5941640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f61cc0b4ca0 0x7f61cc0b71b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.450+0000 7f61e5941640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61e0108b20 0x7f61e01982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.450+0000 7f61e5941640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61e01081d0 0x7f61e0197bd0 secure :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f61e0075850 tx=0x7f61c8009c60 comp rx=0 tx=0).stop 2024-08-31T06:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.450+0000 7f61e5941640 1 --2- 172.21.15.53:0/2965311855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0102e80 0x7f61e019b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.450+0000 7f61e5941640 1 -- 172.21.15.53:0/2965311855 >> 172.21.15.53:0/2965311855 conn(0x7f61e0077a00 msgr2=0x7f61e00fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.450+0000 7f61e5941640 1 -- 172.21.15.53:0/2965311855 shutdown_connections 2024-08-31T06:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.451+0000 7f61e5941640 1 -- 172.21.15.53:0/2965311855 wait complete. 2024-08-31T06:26:29.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.674+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfb410b990 con 0x7fcfb4109bc0 2024-08-31T06:26:29.679 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:26:29.680 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":77,"btime":"2024-08-31T06:26:24:210897+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":77,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:26:23.909504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:26:29.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.675+0000 7fcfaa7fc640 1 -- 172.21.15.53:0/2647016331 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+12013 (secure 0 0 0) 0x7fcfa40abf70 con 0x7fcfb4109bc0 2024-08-31T06:26:29.680 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 77 2024-08-31T06:26:29.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.679+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcfa00b4df0 msgr2=0x7fcfa00b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.679+0000 7fcfbb90f640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcfa00b4df0 0x7fcfa00b7300 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009230 tx=0x7fcfb0005a20 comp rx=0 tx=0).stop 2024-08-31T06:26:29.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.679+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfb4109bc0 msgr2=0x7fcfb419a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:29.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.679+0000 7fcfbb90f640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfb4109bc0 0x7fcfb419a8d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e9f0 tx=0x7fcfa400edf0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.679+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 shutdown_connections 2024-08-31T06:26:29.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.679+0000 7fcfbb90f640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fcfa00b4df0 0x7fcfa00b7300 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.679+0000 7fcfbb90f640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb419fab0 0x7fcfb419fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.679+0000 7fcfbb90f640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfb4109bc0 0x7fcfb419a8d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.679+0000 7fcfbb90f640 1 --2- 172.21.15.53:0/2647016331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcfb4109270 0x7fcfb419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:29.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.679+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 >> 172.21.15.53:0/2647016331 conn(0x7fcfb40ff3a0 msgr2=0x7fcfb41017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:29.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.679+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 shutdown_connections 2024-08-31T06:26:29.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:29.680+0000 7fcfbb90f640 1 -- 172.21.15.53:0/2647016331 wait complete. 2024-08-31T06:26:30.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 54798 5.80 MB/sec execute 378 sec latency 74.422 ms 2024-08-31T06:26:30.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:30 smithi053 ceph-mon[18924]: pgmap v1001: 97 pgs: 97 active+clean; 860 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.8 MiB/s wr, 336 op/s 2024-08-31T06:26:30.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:30 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2647016331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:26:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:30 smithi130 ceph-mon[22266]: pgmap v1001: 97 pgs: 97 active+clean; 860 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.8 MiB/s wr, 336 op/s 2024-08-31T06:26:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:30 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2647016331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:26:30.652 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:26:30.652 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:26:30.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:30 smithi153 ceph-mon[22320]: pgmap v1001: 97 pgs: 97 active+clean; 860 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.8 MiB/s wr, 336 op/s 2024-08-31T06:26:30.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:30 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2647016331' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:26:31.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 54943 5.82 MB/sec execute 379 sec latency 83.859 ms 2024-08-31T06:26:32.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55052 5.81 MB/sec execute 380 sec latency 115.798 ms 2024-08-31T06:26:32.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:32 smithi130 ceph-mon[22266]: pgmap v1002: 97 pgs: 97 active+clean; 877 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 393 op/s 2024-08-31T06:26:32.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:32 smithi153 ceph-mon[22320]: pgmap v1002: 97 pgs: 97 active+clean; 877 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 393 op/s 2024-08-31T06:26:32.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:32 smithi053 ceph-mon[18924]: pgmap v1002: 97 pgs: 97 active+clean; 877 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 393 op/s 2024-08-31T06:26:33.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55183 5.82 MB/sec execute 381 sec latency 153.641 ms 2024-08-31T06:26:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.436+0000 7f3133053640 1 -- 172.21.15.53:0/289359647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f312c1089f0 msgr2=0x7f312c10f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.436+0000 7f3133053640 1 --2- 172.21.15.53:0/289359647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f312c1089f0 0x7f312c10f220 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f3124009be0 tx=0x7f312402a6c0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.436+0000 7f3133053640 1 -- 172.21.15.53:0/289359647 shutdown_connections 2024-08-31T06:26:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.436+0000 7f3133053640 1 --2- 172.21.15.53:0/289359647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f312c1089f0 0x7f312c10f220 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.436+0000 7f3133053640 1 --2- 172.21.15.53:0/289359647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f312c1080a0 0x7f312c1084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.436+0000 7f3133053640 1 --2- 172.21.15.53:0/289359647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f312c102770 0x7f312c102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.436+0000 7f3133053640 1 -- 172.21.15.53:0/289359647 >> 172.21.15.53:0/289359647 conn(0x7f312c07a490 msgr2=0x7f312c07a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.437+0000 7f3133053640 1 -- 172.21.15.53:0/289359647 shutdown_connections 2024-08-31T06:26:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.437+0000 7f3133053640 1 -- 172.21.15.53:0/289359647 wait complete. 2024-08-31T06:26:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.437+0000 7f3133053640 1 Processor -- start 2024-08-31T06:26:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.437+0000 7f3133053640 1 -- start start 2024-08-31T06:26:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f3133053640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f312c102770 0x7f312c19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f3133053640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f312c1080a0 0x7f312c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f3133053640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f312c1089f0 0x7f312c19f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f3133053640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f312c113680 con 0x7f312c1089f0 2024-08-31T06:26:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f3133053640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f312c113500 con 0x7f312c102770 2024-08-31T06:26:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f3133053640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f312c113800 con 0x7f312c1080a0 2024-08-31T06:26:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f312bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f312c1080a0 0x7f312c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f31315f0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f312c1089f0 0x7f312c19f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f312bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f312c1080a0 0x7f312c19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56528/0 (socket says 172.21.15.53:56528) 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f312bfff640 1 -- 172.21.15.53:0/3700547193 learned_addr learned my addr 172.21.15.53:0/3700547193 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f3130def640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f312c102770 0x7f312c19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f31315f0640 1 -- 172.21.15.53:0/3700547193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f312c1080a0 msgr2=0x7f312c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f31315f0640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f312c1080a0 0x7f312c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f31315f0640 1 -- 172.21.15.53:0/3700547193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f312c102770 msgr2=0x7f312c19a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f31315f0640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f312c102770 0x7f312c19a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.438+0000 7f31315f0640 1 -- 172.21.15.53:0/3700547193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c1a00d0 con 0x7f312c1089f0 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.439+0000 7f31315f0640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f312c1089f0 0x7f312c19f9d0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f3124009b30 tx=0x7f3124030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.439+0000 7f3129ffb640 1 -- 172.21.15.53:0/3700547193 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124041020 con 0x7f312c1089f0 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.439+0000 7f3129ffb640 1 -- 172.21.15.53:0/3700547193 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3124037040 con 0x7f312c1089f0 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.439+0000 7f3129ffb640 1 -- 172.21.15.53:0/3700547193 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124036070 con 0x7f312c1089f0 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.439+0000 7f3133053640 1 -- 172.21.15.53:0/3700547193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312c1a0360 con 0x7f312c1089f0 2024-08-31T06:26:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.439+0000 7f3133053640 1 -- 172.21.15.53:0/3700547193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312c1a6b50 con 0x7f312c1089f0 2024-08-31T06:26:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.443+0000 7f3139fc1740 1 Processor -- start 2024-08-31T06:26:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.443+0000 7f3129ffb640 1 -- 172.21.15.53:0/3700547193 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3124044020 con 0x7f312c1089f0 2024-08-31T06:26:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.443+0000 7f3139fc1740 1 -- start start 2024-08-31T06:26:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.443+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 0x564a3d835ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.443+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4692f0 0x564a3d836000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.443+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4714d0 0x564a3d836540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.443+0000 7f3139fc1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564a3d7ab000 con 0x564a3d4921b0 2024-08-31T06:26:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.443+0000 7f3139fc1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564a3d79a590 con 0x564a3d4692f0 2024-08-31T06:26:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.443+0000 7f3139fc1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564a3d79e540 con 0x564a3d4714d0 2024-08-31T06:26:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f312bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 0x564a3d835ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f312bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 0x564a3d835ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48132/0 (socket says 172.21.15.53:48132) 2024-08-31T06:26:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f312bfff640 1 -- 172.21.15.53:0/3099082910 learned_addr learned my addr 172.21.15.53:0/3099082910 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f3130def640 1 --2- 172.21.15.53:0/3099082910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4692f0 0x564a3d836000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f312bfff640 1 --2- 172.21.15.53:0/3099082910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4714d0 0x564a3d836540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f312bfff640 1 -- 172.21.15.53:0/3099082910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4714d0 msgr2=0x564a3d836540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f3129ffb640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31140b4e70 0x7f31140b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f312bfff640 1 --2- 172.21.15.53:0/3099082910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4714d0 0x564a3d836540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f312bfff640 1 -- 172.21.15.53:0/3099082910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4692f0 msgr2=0x564a3d836000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f31315f0640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31140b4e70 0x7f31140b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f312bfff640 1 --2- 172.21.15.53:0/3099082910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4692f0 0x564a3d836000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.444+0000 7f312bfff640 1 -- 172.21.15.53:0/3099082910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a3d4fd790 con 0x564a3d4921b0 2024-08-31T06:26:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.445+0000 7f3129ffb640 1 -- 172.21.15.53:0/3700547193 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f3124105ee0 con 0x7f312c1089f0 2024-08-31T06:26:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.445+0000 7f3130def640 1 --2- 172.21.15.53:0/3099082910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4692f0 0x564a3d836000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.445+0000 7f312bfff640 1 --2- 172.21.15.53:0/3099082910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 0x564a3d835ac0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f31200135a0 tx=0x7f3120009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4145f2c9a9aa1fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.445+0000 7f3112ffd640 1 -- 172.21.15.53:0/3099082910 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120005020 con 0x564a3d4921b0 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.445+0000 7f3112ffd640 1 -- 172.21.15.53:0/3099082910 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31200047a0 con 0x564a3d4921b0 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.445+0000 7f3112ffd640 1 -- 172.21.15.53:0/3099082910 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120005650 con 0x564a3d4921b0 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.446+0000 7f3139fc1740 1 -- 172.21.15.53:0/3099082910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 msgr2=0x564a3d835ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.446+0000 7f31315f0640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31140b4e70 0x7f31140b7380 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f31240338d0 tx=0x7f3124048000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.446+0000 7f3139fc1740 1 --2- 172.21.15.53:0/3099082910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 0x564a3d835ac0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f31200135a0 tx=0x7f3120009520 comp rx=0 tx=0).stop 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.446+0000 7f3139fc1740 1 -- 172.21.15.53:0/3099082910 shutdown_connections 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.446+0000 7f3139fc1740 1 --2- 172.21.15.53:0/3099082910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4714d0 0x564a3d836540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.446+0000 7f3139fc1740 1 --2- 172.21.15.53:0/3099082910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4692f0 0x564a3d836000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.446+0000 7f3139fc1740 1 --2- 172.21.15.53:0/3099082910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 0x564a3d835ac0 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.446+0000 7f3139fc1740 1 -- 172.21.15.53:0/3099082910 >> 172.21.15.53:0/3099082910 conn(0x564a3d486300 msgr2=0x564a3d8339b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.446+0000 7f3139fc1740 1 -- 172.21.15.53:0/3099082910 shutdown_connections 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.446+0000 7f3139fc1740 1 -- 172.21.15.53:0/3099082910 wait complete. 2024-08-31T06:26:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.447+0000 7f3139fc1740 1 -- start start 2024-08-31T06:26:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.447+0000 7f3139fc1740 1 Processor -- start 2024-08-31T06:26:33.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.447+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4692f0 0x564a3d845ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.447+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4714d0 0x564a3d846020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.447+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4921b0 0x564a3d8518d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.447+0000 7f3139fc1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564a3d6d3ab0 con 0x564a3d4692f0 2024-08-31T06:26:33.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.447+0000 7f3139fc1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564a3d721680 con 0x564a3d4714d0 2024-08-31T06:26:33.453 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.447+0000 7f3139fc1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564a3d8485a0 con 0x564a3d4921b0 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f3139fc1740 10 client.0 _ll_register_callbacks cb 0x564a3d4a9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f312bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4692f0 0x564a3d845ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f312bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4692f0 0x564a3d845ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48140/0 (socket says 172.21.15.53:48140) 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f312bfff640 1 -- 172.21.15.53:0/876200424 learned_addr learned my addr 172.21.15.53:0/876200424 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f312bfff640 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4921b0 0x564a3d8518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f3130def640 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4714d0 0x564a3d846020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f312bfff640 1 -- 172.21.15.53:0/876200424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4921b0 msgr2=0x564a3d8518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f312bfff640 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4921b0 0x564a3d8518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f312bfff640 1 -- 172.21.15.53:0/876200424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4714d0 msgr2=0x564a3d846020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f312bfff640 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4714d0 0x564a3d846020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f312bfff640 1 -- 172.21.15.53:0/876200424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a3d576620 con 0x564a3d4692f0 2024-08-31T06:26:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f312bfff640 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4692f0 0x564a3d845ae0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f3120004770 tx=0x7f31200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c07c19f7279df3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.448+0000 7f310bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.449+0000 7f310bfff640 1 -- 172.21.15.53:0/876200424 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312000f580 con 0x564a3d4692f0 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.449+0000 7f310bfff640 1 -- 172.21.15.53:0/876200424 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f312000f720 con 0x564a3d4692f0 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.449+0000 7f3139fc1740 1 -- 172.21.15.53:0/876200424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31200047a0 con 0x564a3d4692f0 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.449+0000 7f310bfff640 1 -- 172.21.15.53:0/876200424 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f312000f920 con 0x564a3d4692f0 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.449+0000 7f3139fc1740 10 client.22008 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.449+0000 7f3139fc1740 1 -- 172.21.15.53:0/876200424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x564a3d854620 con 0x564a3d4692f0 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.450+0000 7f310bfff640 1 -- 172.21.15.53:0/876200424 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31200047a0 con 0x564a3d4692f0 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.450+0000 7f310bfff640 1 -- 172.21.15.53:0/876200424 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f312001d020 con 0x564a3d4692f0 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.450+0000 7f3139fc1740 10 client.22008 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.450+0000 7f3139fc1740 10 client.22008 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.450+0000 7f3139fc1740 20 client.22008 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.450+0000 7f3139fc1740 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a3d450d80 0x564a3d857a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.450+0000 7f3139fc1740 4 client.22008 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.450+0000 7f3139fc1740 1 -- 172.21.15.53:0/876200424 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a3d7acf50 con 0x564a3d450d80 2024-08-31T06:26:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.450+0000 7f3130def640 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a3d450d80 0x564a3d857a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.451+0000 7f310bfff640 10 client.22008 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.451+0000 7f3130def640 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a3d450d80 0x564a3d857a90 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b534e9a7f4df49a0 server_cookie=a1425b9f12138b90 in_seq=0 out_seq=0 2024-08-31T06:26:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f310bfff640 1 -- 172.21.15.53:0/876200424 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a3d7acf50 con 0x564a3d450d80 2024-08-31T06:26:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f310bfff640 10 client.22008 handle_command_reply: tid=0 2024-08-31T06:26:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f3139fc1740 1 client.22008 shutdown 2024-08-31T06:26:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f3139fc1740 1 -- 172.21.15.53:0/876200424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4692f0 msgr2=0x564a3d845ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f3139fc1740 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4692f0 0x564a3d845ae0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f3120004770 tx=0x7f31200046c0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f3139fc1740 1 -- 172.21.15.53:0/876200424 shutdown_connections 2024-08-31T06:26:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f3139fc1740 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a3d450d80 0x564a3d857a90 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f3139fc1740 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4921b0 0x564a3d8518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f3139fc1740 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4714d0 0x564a3d846020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f3139fc1740 1 --2- 172.21.15.53:0/876200424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4692f0 0x564a3d845ae0 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f3139fc1740 1 -- 172.21.15.53:0/876200424 >> 172.21.15.53:0/876200424 conn(0x564a3d486300 msgr2=0x564a3d831c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.452+0000 7f310bfff640 0 client.22008 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.453+0000 7f3139fc1740 1 -- 172.21.15.53:0/876200424 shutdown_connections 2024-08-31T06:26:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.453+0000 7f3139fc1740 1 -- 172.21.15.53:0/876200424 wait complete. 2024-08-31T06:26:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.453+0000 7f3139fc1740 20 client.22008 trim_cache size 0 max 16384 2024-08-31T06:26:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.480+0000 7f3139fc1740 1 Processor -- start 2024-08-31T06:26:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.480+0000 7f3139fc1740 1 -- start start 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.480+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4714d0 0x564a3d837200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.480+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4921b0 0x564a3d8517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.480+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4261c0 0x564a3d851d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.480+0000 7f3139fc1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1ad360 con 0x564a3d4714d0 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.480+0000 7f3139fc1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1af1a0 con 0x564a3d4921b0 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.480+0000 7f3139fc1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1adaf0 con 0x564a3d4261c0 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.481+0000 7f312bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4714d0 0x564a3d837200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.481+0000 7f312bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4714d0 0x564a3d837200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48154/0 (socket says 172.21.15.53:48154) 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.481+0000 7f312bfff640 1 -- 172.21.15.53:0/1993593696 learned_addr learned my addr 172.21.15.53:0/1993593696 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.481+0000 7f3130def640 1 --2- 172.21.15.53:0/1993593696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4921b0 0x564a3d8517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.481+0000 7f312bfff640 1 --2- 172.21.15.53:0/1993593696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4261c0 0x564a3d851d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.481+0000 7f312bfff640 1 -- 172.21.15.53:0/1993593696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4261c0 msgr2=0x564a3d851d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.481+0000 7f312bfff640 1 --2- 172.21.15.53:0/1993593696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4261c0 0x564a3d851d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.481+0000 7f312bfff640 1 -- 172.21.15.53:0/1993593696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4921b0 msgr2=0x564a3d8517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.481+0000 7f312bfff640 1 --2- 172.21.15.53:0/1993593696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4921b0 0x564a3d8517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.481+0000 7f312bfff640 1 -- 172.21.15.53:0/1993593696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a3d843db0 con 0x564a3d4714d0 2024-08-31T06:26:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.481+0000 7f312bfff640 1 --2- 172.21.15.53:0/1993593696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4714d0 0x564a3d837200 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f31200095f0 tx=0x7f3120004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5d225f1984eb0f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.482+0000 7f31127fc640 1 -- 172.21.15.53:0/1993593696 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312003b040 con 0x564a3d4714d0 2024-08-31T06:26:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.482+0000 7f31127fc640 1 -- 172.21.15.53:0/1993593696 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3120023030 con 0x564a3d4714d0 2024-08-31T06:26:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.482+0000 7f31127fc640 1 -- 172.21.15.53:0/1993593696 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312002fb30 con 0x564a3d4714d0 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.483+0000 7f3139fc1740 1 -- 172.21.15.53:0/1993593696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4714d0 msgr2=0x564a3d837200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.483+0000 7f3139fc1740 1 --2- 172.21.15.53:0/1993593696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4714d0 0x564a3d837200 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f31200095f0 tx=0x7f3120004ca0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.483+0000 7f3139fc1740 1 -- 172.21.15.53:0/1993593696 shutdown_connections 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.483+0000 7f3139fc1740 1 --2- 172.21.15.53:0/1993593696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4261c0 0x564a3d851d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.483+0000 7f3139fc1740 1 --2- 172.21.15.53:0/1993593696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4921b0 0x564a3d8517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.483+0000 7f3139fc1740 1 --2- 172.21.15.53:0/1993593696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4714d0 0x564a3d837200 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.483+0000 7f3139fc1740 1 -- 172.21.15.53:0/1993593696 >> 172.21.15.53:0/1993593696 conn(0x564a3d486300 msgr2=0x564a3d836af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.483+0000 7f3139fc1740 1 -- 172.21.15.53:0/1993593696 shutdown_connections 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.483+0000 7f3139fc1740 1 -- 172.21.15.53:0/1993593696 wait complete. 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.484+0000 7f3139fc1740 1 -- start start 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.484+0000 7f3139fc1740 1 Processor -- start 2024-08-31T06:26:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.484+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4261c0 0x564a3d84e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4714d0 0x564a3d8495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3139fc1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 0x564a3d849be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3139fc1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1aea10 con 0x564a3d4921b0 2024-08-31T06:26:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3139fc1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1ae280 con 0x564a3d4714d0 2024-08-31T06:26:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3139fc1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1ab360 con 0x564a3d4261c0 2024-08-31T06:26:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f312bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 0x564a3d849be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3139fc1740 10 client.0 _ll_register_callbacks cb 0x7f311c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f312bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4261c0 0x564a3d84e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3130def640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4714d0 0x564a3d8495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f312bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4261c0 0x564a3d84e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56574/0 (socket says 172.21.15.53:56574) 2024-08-31T06:26:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f312bfff640 1 -- 172.21.15.53:0/3608649960 learned_addr learned my addr 172.21.15.53:0/3608649960 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3130def640 1 -- 172.21.15.53:0/3608649960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4261c0 msgr2=0x564a3d84e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3130def640 1 --2- 172.21.15.53:0/3608649960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4261c0 0x564a3d84e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3130def640 1 -- 172.21.15.53:0/3608649960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 msgr2=0x564a3d849be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3130def640 1 --2- 172.21.15.53:0/3608649960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 0x564a3d849be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.485+0000 7f3130def640 1 -- 172.21.15.53:0/3608649960 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a3d84a370 con 0x564a3d4714d0 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.486+0000 7f3130def640 1 --2- 172.21.15.53:0/3608649960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4714d0 0x564a3d8495b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x564a3d8580a0 tx=0x7f311c010b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f51b8e58f3d27e48 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.486+0000 7f310bfff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.486+0000 7f310bfff640 1 -- 172.21.15.53:0/3608649960 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c010e30 con 0x564a3d4714d0 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.486+0000 7f310bfff640 1 -- 172.21.15.53:0/3608649960 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f311c00fa80 con 0x564a3d4714d0 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.486+0000 7f3139fc1740 1 -- 172.21.15.53:0/3608649960 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3120023030 con 0x564a3d4714d0 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.486+0000 7f310bfff640 1 -- 172.21.15.53:0/3608649960 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f311c00fc80 con 0x564a3d4714d0 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.486+0000 7f3139fc1740 10 client.30746 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.486+0000 7f3139fc1740 1 -- 172.21.15.53:0/3608649960 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x564a3d8c2460 con 0x564a3d4714d0 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.486+0000 7f310bfff640 1 -- 172.21.15.53:0/3608649960 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3120023030 con 0x564a3d4714d0 2024-08-31T06:26:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.487+0000 7f310bfff640 1 -- 172.21.15.53:0/3608649960 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f311c01e390 con 0x564a3d4714d0 2024-08-31T06:26:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.487+0000 7f3139fc1740 10 client.30746 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.487+0000 7f3139fc1740 10 client.30746 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.487+0000 7f3139fc1740 20 client.30746 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.487+0000 7f3139fc1740 1 --2- 172.21.15.53:0/3608649960 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a3d8c2c20 0x564a3d8c5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.487+0000 7f3139fc1740 4 client.30746 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:26:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.487+0000 7f3139fc1740 1 -- 172.21.15.53:0/3608649960 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a3d7a89f0 con 0x564a3d8c2c20 2024-08-31T06:26:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.487+0000 7f312bfff640 1 --2- 172.21.15.53:0/3608649960 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a3d8c2c20 0x564a3d8c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.488+0000 7f310bfff640 10 client.30746 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.488+0000 7f312bfff640 1 --2- 172.21.15.53:0/3608649960 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a3d8c2c20 0x564a3d8c5040 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1a8dc8943ade644 server_cookie=7f50f10938bf5416 in_seq=0 out_seq=0 2024-08-31T06:26:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.621+0000 7f310bfff640 1 -- 172.21.15.53:0/3608649960 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a3d7a89f0 con 0x564a3d8c2c20 2024-08-31T06:26:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.621+0000 7f310bfff640 10 client.30746 handle_command_reply: tid=0 2024-08-31T06:26:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.621+0000 7f3139fc1740 1 client.30746 shutdown 2024-08-31T06:26:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.621+0000 7f3139fc1740 1 -- 172.21.15.53:0/3608649960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4714d0 msgr2=0x564a3d8495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.621+0000 7f3139fc1740 1 --2- 172.21.15.53:0/3608649960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4714d0 0x564a3d8495b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x564a3d8580a0 tx=0x7f311c010b80 comp rx=0 tx=0).stop 2024-08-31T06:26:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.621+0000 7f3139fc1740 1 -- 172.21.15.53:0/3608649960 shutdown_connections 2024-08-31T06:26:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.621+0000 7f3139fc1740 1 --2- 172.21.15.53:0/3608649960 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564a3d8c2c20 0x564a3d8c5040 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.622+0000 7f3139fc1740 1 --2- 172.21.15.53:0/3608649960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564a3d4921b0 0x564a3d849be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.622+0000 7f3139fc1740 1 --2- 172.21.15.53:0/3608649960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564a3d4714d0 0x564a3d8495b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.622+0000 7f3139fc1740 1 --2- 172.21.15.53:0/3608649960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564a3d4261c0 0x564a3d84e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.622+0000 7f3139fc1740 1 -- 172.21.15.53:0/3608649960 >> 172.21.15.53:0/3608649960 conn(0x564a3d486300 msgr2=0x564a3d837490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.622+0000 7f310bfff640 0 client.30746 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.622+0000 7f3139fc1740 1 -- 172.21.15.53:0/3608649960 shutdown_connections 2024-08-31T06:26:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.622+0000 7f3139fc1740 1 -- 172.21.15.53:0/3608649960 wait complete. 2024-08-31T06:26:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.622+0000 7f3139fc1740 20 client.30746 trim_cache size 0 max 16384 2024-08-31T06:26:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:26:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:26:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:26:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:26:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 -- 172.21.15.53:0/3700547193 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31140b4e70 msgr2=0x7f31140b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31140b4e70 0x7f31140b7380 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f31240338d0 tx=0x7f3124048000 comp rx=0 tx=0).stop 2024-08-31T06:26:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 -- 172.21.15.53:0/3700547193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f312c1089f0 msgr2=0x7f312c19f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f312c1089f0 0x7f312c19f9d0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f3124009b30 tx=0x7f3124030d50 comp rx=0 tx=0).stop 2024-08-31T06:26:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 -- 172.21.15.53:0/3700547193 shutdown_connections 2024-08-31T06:26:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f31140b4e70 0x7f31140b7380 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f312c1089f0 0x7f312c19f9d0 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f312c1080a0 0x7f312c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 --2- 172.21.15.53:0/3700547193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f312c102770 0x7f312c19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 -- 172.21.15.53:0/3700547193 >> 172.21.15.53:0/3700547193 conn(0x7f312c07a490 msgr2=0x7f312c106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 -- 172.21.15.53:0/3700547193 shutdown_connections 2024-08-31T06:26:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:33.625+0000 7f3133053640 1 -- 172.21.15.53:0/3700547193 wait complete. 2024-08-31T06:26:34.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55277 5.82 MB/sec execute 382 sec latency 261.299 ms 2024-08-31T06:26:34.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:34 smithi130 ceph-mon[22266]: pgmap v1003: 97 pgs: 97 active+clean; 878 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 304 op/s 2024-08-31T06:26:34.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:34 smithi153 ceph-mon[22320]: pgmap v1003: 97 pgs: 97 active+clean; 878 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 304 op/s 2024-08-31T06:26:34.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:34 smithi053 ceph-mon[18924]: pgmap v1003: 97 pgs: 97 active+clean; 878 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 304 op/s 2024-08-31T06:26:34.850 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-31T06:26:34.851 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-31T06:26:34.918 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:35.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55401 5.82 MB/sec execute 383 sec latency 70.446 ms 2024-08-31T06:26:36.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55501 5.82 MB/sec execute 384 sec latency 122.449 ms 2024-08-31T06:26:36.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:36 smithi130 ceph-mon[22266]: pgmap v1004: 97 pgs: 97 active+clean; 883 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 323 op/s 2024-08-31T06:26:36.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:36 smithi153 ceph-mon[22320]: pgmap v1004: 97 pgs: 97 active+clean; 883 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 323 op/s 2024-08-31T06:26:36.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:36 smithi053 ceph-mon[18924]: pgmap v1004: 97 pgs: 97 active+clean; 883 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 323 op/s 2024-08-31T06:26:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.165+0000 7f8d7249c640 1 -- 172.21.15.53:0/2907276922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d6c10f870 msgr2=0x7f8d6c10fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.165+0000 7f8d7249c640 1 --2- 172.21.15.53:0/2907276922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d6c10f870 0x7f8d6c10fc80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009860 tx=0x7f8d5402a340 comp rx=0 tx=0).stop 2024-08-31T06:26:37.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.165+0000 7f8d7249c640 1 -- 172.21.15.53:0/2907276922 shutdown_connections 2024-08-31T06:26:37.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.165+0000 7f8d7249c640 1 --2- 172.21.15.53:0/2907276922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d6c1101c0 0x7f8d6c1169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:37.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.165+0000 7f8d7249c640 1 --2- 172.21.15.53:0/2907276922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d6c10f870 0x7f8d6c10fc80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:37.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.165+0000 7f8d7249c640 1 --2- 172.21.15.53:0/2907276922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d6c109f30 0x7f8d6c10a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:37.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.165+0000 7f8d7249c640 1 -- 172.21.15.53:0/2907276922 >> 172.21.15.53:0/2907276922 conn(0x7f8d6c077e90 msgr2=0x7f8d6c107f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:37.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.165+0000 7f8d7249c640 1 -- 172.21.15.53:0/2907276922 shutdown_connections 2024-08-31T06:26:37.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.165+0000 7f8d7249c640 1 -- 172.21.15.53:0/2907276922 wait complete. 2024-08-31T06:26:37.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.166+0000 7f8d7249c640 1 Processor -- start 2024-08-31T06:26:37.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.166+0000 7f8d7249c640 1 -- start start 2024-08-31T06:26:37.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.167+0000 7f8d7249c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d6c109f30 0x7f8d6c1a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:37.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.167+0000 7f8d7249c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d6c10f870 0x7f8d6c1a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.167+0000 7f8d7249c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d6c1101c0 0x7f8d6c1a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.167+0000 7f8d7249c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c119d30 con 0x7f8d6c109f30 2024-08-31T06:26:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.167+0000 7f8d7249c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c119bb0 con 0x7f8d6c1101c0 2024-08-31T06:26:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.167+0000 7f8d7249c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c119eb0 con 0x7f8d6c10f870 2024-08-31T06:26:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.167+0000 7f8d6bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d6c109f30 0x7f8d6c1a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.167+0000 7f8d6bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d6c109f30 0x7f8d6c1a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48162/0 (socket says 172.21.15.53:48162) 2024-08-31T06:26:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.167+0000 7f8d6bfff640 1 -- 172.21.15.53:0/1714598638 learned_addr learned my addr 172.21.15.53:0/1714598638 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.168+0000 7f8d63fff640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d6c10f870 0x7f8d6c1a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.168+0000 7f8d70a39640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d6c1101c0 0x7f8d6c1a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:37.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.168+0000 7f8d6bfff640 1 -- 172.21.15.53:0/1714598638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d6c10f870 msgr2=0x7f8d6c1a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.168+0000 7f8d6bfff640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d6c10f870 0x7f8d6c1a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.168+0000 7f8d6bfff640 1 -- 172.21.15.53:0/1714598638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d6c1101c0 msgr2=0x7f8d6c1a6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.168+0000 7f8d6bfff640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d6c1101c0 0x7f8d6c1a6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.168+0000 7f8d6bfff640 1 -- 172.21.15.53:0/1714598638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c1a6730 con 0x7f8d6c109f30 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.168+0000 7f8d63fff640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d6c10f870 0x7f8d6c1a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.168+0000 7f8d70a39640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d6c1101c0 0x7f8d6c1a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.168+0000 7f8d6bfff640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d6c109f30 0x7f8d6c1a07c0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00e9c0 tx=0x7f8d5c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.168+0000 7f8d69ffb640 1 -- 172.21.15.53:0/1714598638 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c00cde0 con 0x7f8d6c109f30 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.169+0000 7f8d69ffb640 1 -- 172.21.15.53:0/1714598638 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d5c0035f0 con 0x7f8d6c109f30 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.169+0000 7f8d69ffb640 1 -- 172.21.15.53:0/1714598638 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c010690 con 0x7f8d6c109f30 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.169+0000 7f8d7249c640 1 -- 172.21.15.53:0/1714598638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c1a6a20 con 0x7f8d6c109f30 2024-08-31T06:26:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.169+0000 7f8d7249c640 1 -- 172.21.15.53:0/1714598638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c1ad180 con 0x7f8d6c109f30 2024-08-31T06:26:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.170+0000 7f8d7249c640 1 -- 172.21.15.53:0/1714598638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c10b1b0 con 0x7f8d6c109f30 2024-08-31T06:26:37.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.173+0000 7f8d69ffb640 1 -- 172.21.15.53:0/1714598638 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8d5c004000 con 0x7f8d6c109f30 2024-08-31T06:26:37.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.175+0000 7f8d69ffb640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d580b4d20 0x7f8d580b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:37.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.175+0000 7f8d63fff640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d580b4d20 0x7f8d580b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:37.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.176+0000 7f8d69ffb640 1 -- 172.21.15.53:0/1714598638 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f8d5c0e5c10 con 0x7f8d6c109f30 2024-08-31T06:26:37.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.176+0000 7f8d63fff640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d580b4d20 0x7f8d580b7230 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8d5402a860 tx=0x7f8d54005c90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:37.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.179+0000 7f8d69ffb640 1 -- 172.21.15.53:0/1714598638 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d5c056130 con 0x7f8d6c109f30 2024-08-31T06:26:37.219 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:37.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55626 5.81 MB/sec execute 385 sec latency 96.865 ms 2024-08-31T06:26:37.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.570+0000 7f8d7249c640 1 -- 172.21.15.53:0/1714598638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d6c10a340 con 0x7f8d6c109f30 2024-08-31T06:26:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.571+0000 7f8d69ffb640 1 -- 172.21.15.53:0/1714598638 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+12013 (secure 0 0 0) 0x7f8d5c0ac980 con 0x7f8d6c109f30 2024-08-31T06:26:37.573 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:26:37.573 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":77,"btime":"2024-08-31T06:26:24:210897+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":77,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:26:23.909504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:26:37.574 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 77 2024-08-31T06:26:37.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.574+0000 7f8d7249c640 1 -- 172.21.15.53:0/1714598638 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d580b4d20 msgr2=0x7f8d580b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:37.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.574+0000 7f8d7249c640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d580b4d20 0x7f8d580b7230 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8d5402a860 tx=0x7f8d54005c90 comp rx=0 tx=0).stop 2024-08-31T06:26:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.574+0000 7f8d7249c640 1 -- 172.21.15.53:0/1714598638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d6c109f30 msgr2=0x7f8d6c1a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.574+0000 7f8d7249c640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d6c109f30 0x7f8d6c1a07c0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00e9c0 tx=0x7f8d5c00ee80 comp rx=0 tx=0).stop 2024-08-31T06:26:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.574+0000 7f8d7249c640 1 -- 172.21.15.53:0/1714598638 shutdown_connections 2024-08-31T06:26:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.574+0000 7f8d7249c640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d580b4d20 0x7f8d580b7230 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.574+0000 7f8d7249c640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d6c1101c0 0x7f8d6c1a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.574+0000 7f8d7249c640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d6c10f870 0x7f8d6c1a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.574+0000 7f8d7249c640 1 --2- 172.21.15.53:0/1714598638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d6c109f30 0x7f8d6c1a07c0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.574+0000 7f8d7249c640 1 -- 172.21.15.53:0/1714598638 >> 172.21.15.53:0/1714598638 conn(0x7f8d6c077e90 msgr2=0x7f8d6c10dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.574+0000 7f8d7249c640 1 -- 172.21.15.53:0/1714598638 shutdown_connections 2024-08-31T06:26:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.575+0000 7f8d7249c640 1 -- 172.21.15.53:0/1714598638 wait complete. 2024-08-31T06:26:38.385 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:26:38.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.80 MB/sec execute 386 sec latency 551.370 ms 2024-08-31T06:26:38.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:38 smithi053 ceph-mon[18924]: pgmap v1005: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 343 op/s 2024-08-31T06:26:38.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:38 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1714598638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:26:38.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.809+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2472320803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbcc103940 msgr2=0x7ffbcc103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:38.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.809+0000 7ffbd3ae3640 1 --2- 172.21.15.53:0/2472320803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbcc103940 0x7ffbcc103d50 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009900 tx=0x7ffbc802a410 comp rx=0 tx=0).stop 2024-08-31T06:26:38.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.809+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2472320803 shutdown_connections 2024-08-31T06:26:38.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.809+0000 7ffbd3ae3640 1 --2- 172.21.15.53:0/2472320803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbcc109bd0 0x7ffbcc110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.809+0000 7ffbd3ae3640 1 --2- 172.21.15.53:0/2472320803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbcc109280 0x7ffbcc109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.809+0000 7ffbd3ae3640 1 --2- 172.21.15.53:0/2472320803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbcc103940 0x7ffbcc103d50 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.809+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2472320803 >> 172.21.15.53:0/2472320803 conn(0x7ffbcc0ff390 msgr2=0x7ffbcc1017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:38.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.810+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2472320803 shutdown_connections 2024-08-31T06:26:38.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.810+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2472320803 wait complete. 2024-08-31T06:26:38.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd3ae3640 1 Processor -- start 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd3ae3640 1 -- start start 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd3ae3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbcc103940 0x7ffbcc19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd3ae3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbcc109280 0x7ffbcc19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd107e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbcc109280 0x7ffbcc19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd3ae3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbcc109bd0 0x7ffbcc19f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd107e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbcc109280 0x7ffbcc19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48176/0 (socket says 172.21.15.53:48176) 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd107e640 1 -- 172.21.15.53:0/2881544585 learned_addr learned my addr 172.21.15.53:0/2881544585 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd187f640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbcc103940 0x7ffbcc19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2881544585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc113790 con 0x7ffbcc109280 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2881544585 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc113610 con 0x7ffbcc109bd0 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.811+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2881544585 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc113910 con 0x7ffbcc103940 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.812+0000 7ffbd2080640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbcc109bd0 0x7ffbcc19f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.812+0000 7ffbd107e640 1 -- 172.21.15.53:0/2881544585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbcc103940 msgr2=0x7ffbcc19a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.812+0000 7ffbd107e640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbcc103940 0x7ffbcc19a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.812+0000 7ffbd107e640 1 -- 172.21.15.53:0/2881544585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbcc109bd0 msgr2=0x7ffbcc19f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.812+0000 7ffbd107e640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbcc109bd0 0x7ffbcc19f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.812+0000 7ffbd107e640 1 -- 172.21.15.53:0/2881544585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc1a00d0 con 0x7ffbcc109280 2024-08-31T06:26:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.812+0000 7ffbd107e640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbcc109280 0x7ffbcc19a700 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00e9f0 tx=0x7ffbbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.812+0000 7ffbc2ffd640 1 -- 172.21.15.53:0/2881544585 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc00ccc0 con 0x7ffbcc109280 2024-08-31T06:26:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.813+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2881544585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc1a03c0 con 0x7ffbcc109280 2024-08-31T06:26:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.813+0000 7ffbc2ffd640 1 -- 172.21.15.53:0/2881544585 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbbc0108c0 con 0x7ffbcc109280 2024-08-31T06:26:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.813+0000 7ffbc2ffd640 1 -- 172.21.15.53:0/2881544585 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc018750 con 0x7ffbcc109280 2024-08-31T06:26:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.813+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2881544585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc075390 con 0x7ffbcc109280 2024-08-31T06:26:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.816+0000 7ffbda058740 1 Processor -- start 2024-08-31T06:26:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.816+0000 7ffbda058740 1 -- start start 2024-08-31T06:26:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.816+0000 7ffbda058740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ad3840 0x55c9f3e7ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbda058740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 0x55c9f3e7b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbda058740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e7b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbda058740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c9f3def330 con 0x55c9f3ab2b60 2024-08-31T06:26:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbda058740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c9f3dde8c0 con 0x55c9f3aaa980 2024-08-31T06:26:38.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbda058740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c9f3de2870 con 0x55c9f3ad3840 2024-08-31T06:26:38.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbd2080640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ad3840 0x55c9f3e7ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbd187f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 0x55c9f3e7b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbd2080640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ad3840 0x55c9f3e7ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56616/0 (socket says 172.21.15.53:56616) 2024-08-31T06:26:38.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbd2080640 1 -- 172.21.15.53:0/1259028000 learned_addr learned my addr 172.21.15.53:0/1259028000 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:38.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbc2ffd640 1 -- 172.21.15.53:0/2881544585 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ffbbc010430 con 0x7ffbcc109280 2024-08-31T06:26:38.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbd187f640 1 -- 172.21.15.53:0/1259028000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ad3840 msgr2=0x55c9f3e7ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:38.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbd187f640 1 --2- 172.21.15.53:0/1259028000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ad3840 0x55c9f3e7ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbd187f640 1 -- 172.21.15.53:0/1259028000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ab2b60 msgr2=0x55c9f3e7b710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:26:38.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbd187f640 1 --2- 172.21.15.53:0/1259028000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e7b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.817+0000 7ffbd187f640 1 -- 172.21.15.53:0/1259028000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9f3d96df0 con 0x55c9f3aaa980 2024-08-31T06:26:38.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.818+0000 7ffbd187f640 1 --2- 172.21.15.53:0/1259028000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 0x55c9f3e7b1d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ffbc802a930 tx=0x7ffbc8004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83a11aaffd3c1970 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:38.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.818+0000 7ffbb7fff640 1 -- 172.21.15.53:0/1259028000 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8040070 con 0x55c9f3aaa980 2024-08-31T06:26:38.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.818+0000 7ffbb7fff640 1 -- 172.21.15.53:0/1259028000 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbc80054b0 con 0x55c9f3aaa980 2024-08-31T06:26:38.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.818+0000 7ffbb7fff640 1 -- 172.21.15.53:0/1259028000 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8035040 con 0x55c9f3aaa980 2024-08-31T06:26:38.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.818+0000 7ffbc2ffd640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffbb80b4d20 0x7ffbb80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.819+0000 7ffbd2080640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffbb80b4d20 0x7ffbb80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.819+0000 7ffbc2ffd640 1 -- 172.21.15.53:0/2881544585 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7ffbbc0e58f0 con 0x7ffbcc109280 2024-08-31T06:26:38.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.819+0000 7ffbda058740 1 -- 172.21.15.53:0/1259028000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 msgr2=0x55c9f3e7b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:38.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.819+0000 7ffbd2080640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffbb80b4d20 0x7ffbb80b7230 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4003bc0 tx=0x7ffbc4009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:38.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.819+0000 7ffbda058740 1 --2- 172.21.15.53:0/1259028000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 0x55c9f3e7b1d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ffbc802a930 tx=0x7ffbc8004040 comp rx=0 tx=0).stop 2024-08-31T06:26:38.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.819+0000 7ffbda058740 1 -- 172.21.15.53:0/1259028000 shutdown_connections 2024-08-31T06:26:38.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.819+0000 7ffbda058740 1 --2- 172.21.15.53:0/1259028000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e7b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.819+0000 7ffbda058740 1 --2- 172.21.15.53:0/1259028000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 0x55c9f3e7b1d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.819+0000 7ffbda058740 1 --2- 172.21.15.53:0/1259028000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ad3840 0x55c9f3e7ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.819+0000 7ffbda058740 1 -- 172.21.15.53:0/1259028000 >> 172.21.15.53:0/1259028000 conn(0x55c9f3ac7990 msgr2=0x55c9f3e78b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:38.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.819+0000 7ffbda058740 1 -- 172.21.15.53:0/1259028000 shutdown_connections 2024-08-31T06:26:38.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.820+0000 7ffbda058740 1 -- 172.21.15.53:0/1259028000 wait complete. 2024-08-31T06:26:38.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.820+0000 7ffbda058740 1 -- start start 2024-08-31T06:26:38.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.820+0000 7ffbda058740 1 Processor -- start 2024-08-31T06:26:38.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbda058740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3aaa980 0x55c9f3e86430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbda058740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e86970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbda058740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3ad3840 0x55c9f3e92700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbda058740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c9f3c417a0 con 0x55c9f3aaa980 2024-08-31T06:26:38.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbda058740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c9f3d65240 con 0x55c9f3ad3840 2024-08-31T06:26:38.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbd187f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3aaa980 0x55c9f3e86430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbd187f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3aaa980 0x55c9f3e86430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48202/0 (socket says 172.21.15.53:48202) 2024-08-31T06:26:38.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbd187f640 1 -- 172.21.15.53:0/174714228 learned_addr learned my addr 172.21.15.53:0/174714228 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:38.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbda058740 1 -- 172.21.15.53:0/174714228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c9f3e89410 con 0x55c9f3ab2b60 2024-08-31T06:26:38.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbd2080640 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3ad3840 0x55c9f3e92700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbd107e640 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e86970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbda058740 10 client.0 _ll_register_callbacks cb 0x55c9f3aeb090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:38.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbd187f640 1 -- 172.21.15.53:0/174714228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 msgr2=0x55c9f3e86970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:38.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbd187f640 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e86970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbd187f640 1 -- 172.21.15.53:0/174714228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3ad3840 msgr2=0x55c9f3e92700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:38.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbd187f640 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3ad3840 0x55c9f3e92700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.821+0000 7ffbd187f640 1 -- 172.21.15.53:0/174714228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9f3d9b2b0 con 0x55c9f3aaa980 2024-08-31T06:26:38.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.822+0000 7ffbd187f640 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3aaa980 0x55c9f3e86430 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8004f40 tx=0x7ffbc8004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a10199c45db35c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:38.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.822+0000 7ffbb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:38.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.822+0000 7ffbb57fa640 1 -- 172.21.15.53:0/174714228 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8040070 con 0x55c9f3aaa980 2024-08-31T06:26:38.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.822+0000 7ffbb57fa640 1 -- 172.21.15.53:0/174714228 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7ffbc80048c0 con 0x55c9f3aaa980 2024-08-31T06:26:38.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.822+0000 7ffbda058740 1 -- 172.21.15.53:0/174714228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbc80054b0 con 0x55c9f3aaa980 2024-08-31T06:26:38.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.822+0000 7ffbb57fa640 1 -- 172.21.15.53:0/174714228 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7ffbc8035040 con 0x55c9f3aaa980 2024-08-31T06:26:38.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.822+0000 7ffbda058740 10 client.22029 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:38.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.822+0000 7ffbda058740 1 -- 172.21.15.53:0/174714228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x55c9f3b4db90 con 0x55c9f3aaa980 2024-08-31T06:26:38.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.823+0000 7ffbb57fa640 1 -- 172.21.15.53:0/174714228 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbc80054b0 con 0x55c9f3aaa980 2024-08-31T06:26:38.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.823+0000 7ffbb57fa640 1 -- 172.21.15.53:0/174714228 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7ffbc80035f0 con 0x55c9f3aaa980 2024-08-31T06:26:38.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.823+0000 7ffbda058740 10 client.22029 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:38.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.823+0000 7ffbda058740 10 client.22029 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:26:38.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.823+0000 7ffbda058740 20 client.22029 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:38.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.823+0000 7ffbda058740 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c9f3a921c0 0x55c9f3e98740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.823+0000 7ffbda058740 4 client.22029 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:38.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.823+0000 7ffbda058740 1 -- 172.21.15.53:0/174714228 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9f3df1280 con 0x55c9f3a921c0 2024-08-31T06:26:38.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.823+0000 7ffbd107e640 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c9f3a921c0 0x55c9f3e98740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.824+0000 7ffbd107e640 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c9f3a921c0 0x55c9f3e98740 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f36701bc91adc1cb server_cookie=3d57c999278a9518 in_seq=0 out_seq=0 2024-08-31T06:26:38.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.824+0000 7ffbb57fa640 10 client.22029 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:38.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbb57fa640 1 -- 172.21.15.53:0/174714228 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c9f3df1280 con 0x55c9f3a921c0 2024-08-31T06:26:38.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbb57fa640 10 client.22029 handle_command_reply: tid=0 2024-08-31T06:26:38.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 1 client.22029 shutdown 2024-08-31T06:26:38.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 1 -- 172.21.15.53:0/174714228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3aaa980 msgr2=0x55c9f3e86430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:38.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3aaa980 0x55c9f3e86430 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8004f40 tx=0x7ffbc8004f70 comp rx=0 tx=0).stop 2024-08-31T06:26:38.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 1 -- 172.21.15.53:0/174714228 shutdown_connections 2024-08-31T06:26:38.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c9f3a921c0 0x55c9f3e98740 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3ad3840 0x55c9f3e92700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e86970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 1 --2- 172.21.15.53:0/174714228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3aaa980 0x55c9f3e86430 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 1 -- 172.21.15.53:0/174714228 >> 172.21.15.53:0/174714228 conn(0x55c9f3ac7990 msgr2=0x55c9f3e7de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:38.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbb57fa640 0 client.22029 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:38.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 1 -- 172.21.15.53:0/174714228 shutdown_connections 2024-08-31T06:26:38.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 1 -- 172.21.15.53:0/174714228 wait complete. 2024-08-31T06:26:38.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.825+0000 7ffbda058740 20 client.22029 trim_cache size 0 max 16384 2024-08-31T06:26:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.852+0000 7ffbda058740 1 Processor -- start 2024-08-31T06:26:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.852+0000 7ffbda058740 1 -- start start 2024-08-31T06:26:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbda058740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 0x55c9f3e80c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbda058740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e77a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbda058740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ad3840 0x55c9f3e92600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbda058740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1ad310 con 0x55c9f3ad3840 2024-08-31T06:26:38.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbda058740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1af150 con 0x55c9f3aaa980 2024-08-31T06:26:38.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbda058740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1adaa0 con 0x55c9f3ab2b60 2024-08-31T06:26:38.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd107e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e77a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd187f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 0x55c9f3e80c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd2080640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ad3840 0x55c9f3e92600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd107e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e77a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56622/0 (socket says 172.21.15.53:56622) 2024-08-31T06:26:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd2080640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ad3840 0x55c9f3e92600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48212/0 (socket says 172.21.15.53:48212) 2024-08-31T06:26:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd187f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 0x55c9f3e80c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47814/0 (socket says 172.21.15.53:47814) 2024-08-31T06:26:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd107e640 1 -- 172.21.15.53:0/2161151443 learned_addr learned my addr 172.21.15.53:0/2161151443 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd107e640 1 -- 172.21.15.53:0/2161151443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 msgr2=0x55c9f3e80c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:38.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd107e640 1 --2- 172.21.15.53:0/2161151443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 0x55c9f3e80c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd107e640 1 -- 172.21.15.53:0/2161151443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ad3840 msgr2=0x55c9f3e92600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:38.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd107e640 1 --2- 172.21.15.53:0/2161151443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ad3840 0x55c9f3e92600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.853+0000 7ffbd107e640 1 -- 172.21.15.53:0/2161151443 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9f3daed90 con 0x55c9f3ab2b60 2024-08-31T06:26:38.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.854+0000 7ffbd107e640 1 --2- 172.21.15.53:0/2161151443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e77a50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0abcc0 tx=0x7ffbbc0e5bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97d024c9e50067a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:38.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.854+0000 7ffbb77fe640 1 -- 172.21.15.53:0/2161151443 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0b52e0 con 0x55c9f3ab2b60 2024-08-31T06:26:38.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.854+0000 7ffbb77fe640 1 -- 172.21.15.53:0/2161151443 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbbc010d50 con 0x55c9f3ab2b60 2024-08-31T06:26:38.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.854+0000 7ffbb77fe640 1 -- 172.21.15.53:0/2161151443 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0b3bb0 con 0x55c9f3ab2b60 2024-08-31T06:26:38.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.855+0000 7ffbda058740 1 -- 172.21.15.53:0/2161151443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 msgr2=0x55c9f3e77a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:38.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.855+0000 7ffbda058740 1 --2- 172.21.15.53:0/2161151443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e77a50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0abcc0 tx=0x7ffbbc0e5bf0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.855+0000 7ffbda058740 1 -- 172.21.15.53:0/2161151443 shutdown_connections 2024-08-31T06:26:38.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.855+0000 7ffbda058740 1 --2- 172.21.15.53:0/2161151443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ad3840 0x55c9f3e92600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.855+0000 7ffbda058740 1 --2- 172.21.15.53:0/2161151443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e77a50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.855+0000 7ffbda058740 1 --2- 172.21.15.53:0/2161151443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3aaa980 0x55c9f3e80c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.855+0000 7ffbda058740 1 -- 172.21.15.53:0/2161151443 >> 172.21.15.53:0/2161151443 conn(0x55c9f3ac7990 msgr2=0x55c9f3e77340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.855+0000 7ffbda058740 1 -- 172.21.15.53:0/2161151443 shutdown_connections 2024-08-31T06:26:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.855+0000 7ffbda058740 1 -- 172.21.15.53:0/2161151443 wait complete. 2024-08-31T06:26:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.856+0000 7ffbda058740 1 -- start start 2024-08-31T06:26:38.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.856+0000 7ffbda058740 1 Processor -- start 2024-08-31T06:26:38.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.856+0000 7ffbda058740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3aaa980 0x55c9f3e8ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.856+0000 7ffbda058740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e9dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbda058740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3ad3840 0x55c9f3e9e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbda058740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1ae9c0 con 0x55c9f3ab2b60 2024-08-31T06:26:38.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbda058740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1ae230 con 0x55c9f3ad3840 2024-08-31T06:26:38.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbda058740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1ab310 con 0x55c9f3aaa980 2024-08-31T06:26:38.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbd107e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e9dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbd187f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3aaa980 0x55c9f3e8ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbd107e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e9dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48228/0 (socket says 172.21.15.53:48228) 2024-08-31T06:26:38.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbd107e640 1 -- 172.21.15.53:0/1909253293 learned_addr learned my addr 172.21.15.53:0/1909253293 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:38.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbda058740 10 client.0 _ll_register_callbacks cb 0x7ffbc4009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:38.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbd2080640 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3ad3840 0x55c9f3e9e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbd107e640 1 -- 172.21.15.53:0/1909253293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3aaa980 msgr2=0x55c9f3e8ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:38.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbd107e640 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3aaa980 0x55c9f3e8ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbd107e640 1 -- 172.21.15.53:0/1909253293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3ad3840 msgr2=0x55c9f3e9e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:38.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbd107e640 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3ad3840 0x55c9f3e9e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbd107e640 1 -- 172.21.15.53:0/1909253293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9f3e9eaf0 con 0x55c9f3ab2b60 2024-08-31T06:26:38.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbd107e640 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e9dcc0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00e9c0 tx=0x7ffbbc0a7ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520268d3f0582400 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:38.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.857+0000 7ffbb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:38.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.858+0000 7ffbb57fa640 1 -- 172.21.15.53:0/1909253293 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc097070 con 0x55c9f3ab2b60 2024-08-31T06:26:38.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.858+0000 7ffbb57fa640 1 -- 172.21.15.53:0/1909253293 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7ffbbc097210 con 0x55c9f3ab2b60 2024-08-31T06:26:38.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.858+0000 7ffbda058740 1 -- 172.21.15.53:0/1909253293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbbc010d50 con 0x55c9f3ab2b60 2024-08-31T06:26:38.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.858+0000 7ffbb57fa640 1 -- 172.21.15.53:0/1909253293 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7ffbbc0abd90 con 0x55c9f3ab2b60 2024-08-31T06:26:38.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.858+0000 7ffbda058740 10 client.22035 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:38.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.858+0000 7ffbda058740 1 -- 172.21.15.53:0/1909253293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x55c9f3f03200 con 0x55c9f3ab2b60 2024-08-31T06:26:38.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.858+0000 7ffbb57fa640 1 -- 172.21.15.53:0/1909253293 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbbc010d50 con 0x55c9f3ab2b60 2024-08-31T06:26:38.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.859+0000 7ffbb57fa640 1 -- 172.21.15.53:0/1909253293 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7ffbbc0ae070 con 0x55c9f3ab2b60 2024-08-31T06:26:38.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.859+0000 7ffbda058740 10 client.22035 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:38.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.859+0000 7ffbda058740 10 client.22035 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:26:38.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.859+0000 7ffbda058740 20 client.22035 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:38.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.859+0000 7ffbda058740 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c9f3a67570 0x55c9f3f05a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:38.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.859+0000 7ffbda058740 4 client.22035 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-31T06:26:38.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.859+0000 7ffbda058740 1 -- 172.21.15.53:0/1909253293 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55c9f3decd20 con 0x55c9f3a67570 2024-08-31T06:26:38.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.859+0000 7ffbd187f640 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c9f3a67570 0x55c9f3f05a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:38.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.859+0000 7ffbd187f640 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c9f3a67570 0x55c9f3f05a40 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c8c52138e9261e8 server_cookie=b6a90f7d4fce7b55 in_seq=0 out_seq=0 2024-08-31T06:26:38.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:37.859+0000 7ffbb57fa640 10 client.22035 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:38.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.221+0000 7ffbb57fa640 1 -- 172.21.15.53:0/1909253293 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c9f3decd20 con 0x55c9f3a67570 2024-08-31T06:26:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.221+0000 7ffbb57fa640 10 client.22035 handle_command_reply: tid=0 2024-08-31T06:26:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.221+0000 7ffbda058740 1 client.22035 shutdown 2024-08-31T06:26:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.221+0000 7ffbda058740 1 -- 172.21.15.53:0/1909253293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ab2b60 msgr2=0x55c9f3e9dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.221+0000 7ffbda058740 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e9dcc0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00e9c0 tx=0x7ffbbc0a7ea0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.222+0000 7ffbda058740 1 -- 172.21.15.53:0/1909253293 shutdown_connections 2024-08-31T06:26:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.222+0000 7ffbda058740 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c9f3a67570 0x55c9f3f05a40 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.222+0000 7ffbda058740 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9f3ad3840 0x55c9f3e9e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.222+0000 7ffbb57fa640 0 client.22035 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.222+0000 7ffbda058740 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c9f3ab2b60 0x55c9f3e9dcc0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.222+0000 7ffbda058740 1 --2- 172.21.15.53:0/1909253293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9f3aaa980 0x55c9f3e8ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.602 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:26:38.602 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 77, 2024-08-31T06:26:38.602 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:26:38.602 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 70, 2024-08-31T06:26:38.602 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:26:38.602 INFO:teuthology.orchestra.run.smithi053.stdout: "294469b2": { 2024-08-31T06:26:38.602 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 70, 2024-08-31T06:26:38.602 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:26:38.602 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 150.0, 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:38.603 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:38.604 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:38.604 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:38.604 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:38.604 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:26:38.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.222+0000 7ffbda058740 1 -- 172.21.15.53:0/1909253293 >> 172.21.15.53:0/1909253293 conn(0x55c9f3ac7990 msgr2=0x55c9f3e77340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:38.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.222+0000 7ffbda058740 1 -- 172.21.15.53:0/1909253293 shutdown_connections 2024-08-31T06:26:38.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.222+0000 7ffbda058740 1 -- 172.21.15.53:0/1909253293 wait complete. 2024-08-31T06:26:38.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.222+0000 7ffbda058740 20 client.22035 trim_cache size 0 max 16384 2024-08-31T06:26:38.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2881544585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffbb80b4d20 msgr2=0x7ffbb80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:38.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffbb80b4d20 0x7ffbb80b7230 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4003bc0 tx=0x7ffbc4009500 comp rx=0 tx=0).stop 2024-08-31T06:26:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2881544585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbcc109280 msgr2=0x7ffbcc19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbcc109280 0x7ffbcc19a700 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00e9f0 tx=0x7ffbbc00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2881544585 shutdown_connections 2024-08-31T06:26:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ffbb80b4d20 0x7ffbb80b7230 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbcc109bd0 0x7ffbcc19f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbcc109280 0x7ffbcc19a700 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 --2- 172.21.15.53:0/2881544585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbcc103940 0x7ffbcc19a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2881544585 >> 172.21.15.53:0/2881544585 conn(0x7ffbcc0ff390 msgr2=0x7ffbcc1017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2881544585 shutdown_connections 2024-08-31T06:26:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:38.223+0000 7ffbd3ae3640 1 -- 172.21.15.53:0/2881544585 wait complete. 2024-08-31T06:26:38.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:38 smithi130 ceph-mon[22266]: pgmap v1005: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 343 op/s 2024-08-31T06:26:38.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:38 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1714598638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:26:38.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:38 smithi153 ceph-mon[22320]: pgmap v1005: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 343 op/s 2024-08-31T06:26:38.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:38 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1714598638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:26:39.280 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '294469b2', quiesce took 11.7 seconds. Will release after: 18.3 2024-08-31T06:26:39.380 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:39.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.79 MB/sec execute 387 sec latency 1551.411 ms 2024-08-31T06:26:39.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.889+0000 7fa322f20640 1 -- 172.21.15.53:0/3781907103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa31c1082c0 msgr2=0x7fa31c10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:39.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.889+0000 7fa322f20640 1 --2- 172.21.15.53:0/3781907103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa31c1082c0 0x7fa31c10eaf0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fa314009ca0 tx=0x7fa31402a8e0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.889+0000 7fa322f20640 1 -- 172.21.15.53:0/3781907103 shutdown_connections 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.889+0000 7fa322f20640 1 --2- 172.21.15.53:0/3781907103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa31c1082c0 0x7fa31c10eaf0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.889+0000 7fa322f20640 1 --2- 172.21.15.53:0/3781907103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa31c107970 0x7fa31c107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.889+0000 7fa322f20640 1 --2- 172.21.15.53:0/3781907103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa31c102030 0x7fa31c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.889+0000 7fa322f20640 1 -- 172.21.15.53:0/3781907103 >> 172.21.15.53:0/3781907103 conn(0x7fa31c079c40 msgr2=0x7fa31c07a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.889+0000 7fa322f20640 1 -- 172.21.15.53:0/3781907103 shutdown_connections 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.889+0000 7fa322f20640 1 -- 172.21.15.53:0/3781907103 wait complete. 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa322f20640 1 Processor -- start 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa322f20640 1 -- start start 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa322f20640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa31c102030 0x7fa31c19b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa322f20640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa31c107970 0x7fa31c19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa322f20640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa31c1082c0 0x7fa31c19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa322f20640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1126f0 con 0x7fa31c107970 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa322f20640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c112570 con 0x7fa31c102030 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa322f20640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c112870 con 0x7fa31c1082c0 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa31bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa31c107970 0x7fa31c19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa31bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa31c107970 0x7fa31c19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48254/0 (socket says 172.21.15.53:48254) 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa31bfff640 1 -- 172.21.15.53:0/3259765270 learned_addr learned my addr 172.21.15.53:0/3259765270 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa320cbc640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa31c102030 0x7fa31c19b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa3214bd640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa31c1082c0 0x7fa31c19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa31bfff640 1 -- 172.21.15.53:0/3259765270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa31c1082c0 msgr2=0x7fa31c19ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa31bfff640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa31c1082c0 0x7fa31c19ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa31bfff640 1 -- 172.21.15.53:0/3259765270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa31c102030 msgr2=0x7fa31c19b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:39.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa31bfff640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa31c102030 0x7fa31c19b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.890+0000 7fa31bfff640 1 -- 172.21.15.53:0/3259765270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31c1a6290 con 0x7fa31c107970 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.891+0000 7fa31bfff640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa31c107970 0x7fa31c19b540 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fa310006fd0 tx=0x7fa31000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.891+0000 7fa319ffb640 1 -- 172.21.15.53:0/3259765270 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310011830 con 0x7fa31c107970 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.891+0000 7fa319ffb640 1 -- 172.21.15.53:0/3259765270 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa310016070 con 0x7fa31c107970 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.891+0000 7fa319ffb640 1 -- 172.21.15.53:0/3259765270 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310010d30 con 0x7fa31c107970 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.891+0000 7fa322f20640 1 -- 172.21.15.53:0/3259765270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31c1a6580 con 0x7fa31c107970 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.891+0000 7fa322f20640 1 -- 172.21.15.53:0/3259765270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31c1a6a70 con 0x7fa31c107970 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa319ffb640 1 -- 172.21.15.53:0/3259765270 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa3100119d0 con 0x7fa31c107970 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa329495740 1 Processor -- start 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa329495740 1 -- start start 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa329495740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5cb070 0x56087c970310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa329495740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c970850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa329495740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c970d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa329495740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56087c8e7680 con 0x56087c5cb070 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa329495740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56087c8d6c10 con 0x56087c5aa390 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa329495740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56087c8dabc0 con 0x56087c5a21b0 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa3214bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5cb070 0x56087c970310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa3214bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5cb070 0x56087c970310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48256/0 (socket says 172.21.15.53:48256) 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa3214bd640 1 -- 172.21.15.53:0/2287804391 learned_addr learned my addr 172.21.15.53:0/2287804391 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.894+0000 7fa31bfff640 1 --2- 172.21.15.53:0/2287804391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c970d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa3214bd640 1 -- 172.21.15.53:0/2287804391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 msgr2=0x56087c970850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa320cbc640 1 --2- 172.21.15.53:0/2287804391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c970850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa3214bd640 1 --2- 172.21.15.53:0/2287804391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c970850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa3214bd640 1 -- 172.21.15.53:0/2287804391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 msgr2=0x56087c970d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:39.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa3214bd640 1 --2- 172.21.15.53:0/2287804391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c970d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa3214bd640 1 -- 172.21.15.53:0/2287804391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56087c636650 con 0x56087c5cb070 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa31bfff640 1 --2- 172.21.15.53:0/2287804391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c970d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa319ffb640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3040b4cd0 0x7fa3040b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa3214bd640 1 --2- 172.21.15.53:0/2287804391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5cb070 0x56087c970310 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fa314035000 tx=0x7fa3140314f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9836082825cd7ce2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa320cbc640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3040b4cd0 0x7fa3040b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa319ffb640 1 -- 172.21.15.53:0/3259765270 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fa3100e4af0 con 0x7fa31c107970 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa302ffd640 1 -- 172.21.15.53:0/2287804391 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314031a80 con 0x56087c5cb070 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa302ffd640 1 -- 172.21.15.53:0/2287804391 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa314036040 con 0x56087c5cb070 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.895+0000 7fa302ffd640 1 -- 172.21.15.53:0/2287804391 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314004570 con 0x56087c5cb070 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.896+0000 7fa329495740 1 -- 172.21.15.53:0/2287804391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5cb070 msgr2=0x56087c970310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.896+0000 7fa320cbc640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3040b4cd0 0x7fa3040b71e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x56087c96ef90 tx=0x7fa30c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.896+0000 7fa329495740 1 --2- 172.21.15.53:0/2287804391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5cb070 0x56087c970310 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fa314035000 tx=0x7fa3140314f0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.896+0000 7fa329495740 1 -- 172.21.15.53:0/2287804391 shutdown_connections 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.896+0000 7fa329495740 1 --2- 172.21.15.53:0/2287804391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c970d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.896+0000 7fa329495740 1 --2- 172.21.15.53:0/2287804391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c970850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.896+0000 7fa329495740 1 --2- 172.21.15.53:0/2287804391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5cb070 0x56087c970310 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.896+0000 7fa329495740 1 -- 172.21.15.53:0/2287804391 >> 172.21.15.53:0/2287804391 conn(0x56087c5bf460 msgr2=0x56087c96e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.896+0000 7fa329495740 1 -- 172.21.15.53:0/2287804391 shutdown_connections 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.896+0000 7fa329495740 1 -- 172.21.15.53:0/2287804391 wait complete. 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa329495740 1 -- start start 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa329495740 1 Processor -- start 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa329495740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5a21b0 0x56087c97bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa329495740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c97c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa329495740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5cb070 0x56087c987db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa329495740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56087c739700 con 0x56087c5a21b0 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa329495740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56087c85d750 con 0x56087c5aa390 2024-08-31T06:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa329495740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56087c97ea90 con 0x56087c5cb070 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa320cbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5a21b0 0x56087c97bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa329495740 10 client.0 _ll_register_callbacks cb 0x56087c88ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa320cbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5a21b0 0x56087c97bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48266/0 (socket says 172.21.15.53:48266) 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.897+0000 7fa320cbc640 1 -- 172.21.15.53:0/1436898991 learned_addr learned my addr 172.21.15.53:0/1436898991 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa3214bd640 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5cb070 0x56087c987db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa31bfff640 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c97c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa320cbc640 1 -- 172.21.15.53:0/1436898991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5cb070 msgr2=0x56087c987db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa320cbc640 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5cb070 0x56087c987db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa320cbc640 1 -- 172.21.15.53:0/1436898991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 msgr2=0x56087c97c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa320cbc640 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c97c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa320cbc640 1 -- 172.21.15.53:0/1436898991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56087c896900 con 0x56087c5a21b0 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa320cbc640 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5a21b0 0x56087c97bae0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fa30c012700 tx=0x7fa30c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee3d53943f9d986 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa2fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa2fbfff640 1 -- 172.21.15.53:0/1436898991 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c01f830 con 0x56087c5a21b0 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa2fbfff640 1 -- 172.21.15.53:0/1436898991 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fa30c01f9d0 con 0x56087c5a21b0 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa329495740 1 -- 172.21.15.53:0/1436898991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa314036040 con 0x56087c5a21b0 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.898+0000 7fa2fbfff640 1 -- 172.21.15.53:0/1436898991 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fa30c01fbd0 con 0x56087c5a21b0 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.899+0000 7fa329495740 10 client.22047 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.899+0000 7fa329495740 1 -- 172.21.15.53:0/1436898991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x56087c98a920 con 0x56087c5a21b0 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.899+0000 7fa2fbfff640 1 -- 172.21.15.53:0/1436898991 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa314036040 con 0x56087c5a21b0 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.899+0000 7fa2fbfff640 1 -- 172.21.15.53:0/1436898991 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7fa30c02f3d0 con 0x56087c5a21b0 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.899+0000 7fa329495740 10 client.22047 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.899+0000 7fa329495740 10 client.22047 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.899+0000 7fa329495740 20 client.22047 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.899+0000 7fa329495740 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56087c5899f0 0x56087c98dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.899+0000 7fa329495740 4 client.22047 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.899+0000 7fa329495740 1 -- 172.21.15.53:0/1436898991 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56087c8e95d0 con 0x56087c5899f0 2024-08-31T06:26:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.899+0000 7fa31bfff640 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56087c5899f0 0x56087c98dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.900+0000 7fa31bfff640 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56087c5899f0 0x56087c98dea0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=18f5995964777ba0 server_cookie=125cb512bf77b3e in_seq=0 out_seq=0 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.900+0000 7fa2fbfff640 10 client.22047 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa2fbfff640 1 -- 172.21.15.53:0/1436898991 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56087c8e95d0 con 0x56087c5899f0 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa2fbfff640 10 client.22047 handle_command_reply: tid=0 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 1 client.22047 shutdown 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 1 -- 172.21.15.53:0/1436898991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5a21b0 msgr2=0x56087c97bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5a21b0 0x56087c97bae0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fa30c012700 tx=0x7fa30c0046c0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 1 -- 172.21.15.53:0/1436898991 shutdown_connections 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56087c5899f0 0x56087c98dea0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa2fbfff640 0 client.22047 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5cb070 0x56087c987db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c97c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 1 --2- 172.21.15.53:0/1436898991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5a21b0 0x56087c97bae0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 1 -- 172.21.15.53:0/1436898991 >> 172.21.15.53:0/1436898991 conn(0x56087c5bf460 msgr2=0x56087c9734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 1 -- 172.21.15.53:0/1436898991 shutdown_connections 2024-08-31T06:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 1 -- 172.21.15.53:0/1436898991 wait complete. 2024-08-31T06:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.901+0000 7fa329495740 20 client.22047 trim_cache size 0 max 16384 2024-08-31T06:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.914+0000 7fa329495740 1 Processor -- start 2024-08-31T06:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.914+0000 7fa329495740 1 -- start start 2024-08-31T06:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa329495740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5899f0 0x56087c96e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa329495740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c987cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa329495740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5aa390 0x56087c9881f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa329495740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1af570 con 0x56087c5aa390 2024-08-31T06:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa329495740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1b13b0 con 0x56087c5899f0 2024-08-31T06:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa329495740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1afd00 con 0x56087c5a21b0 2024-08-31T06:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3214bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5aa390 0x56087c9881f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3214bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5aa390 0x56087c9881f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48280/0 (socket says 172.21.15.53:48280) 2024-08-31T06:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3214bd640 1 -- 172.21.15.53:0/3269847115 learned_addr learned my addr 172.21.15.53:0/3269847115 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa320cbc640 1 --2- 172.21.15.53:0/3269847115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5899f0 0x56087c96e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa31bfff640 1 --2- 172.21.15.53:0/3269847115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c987cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3214bd640 1 -- 172.21.15.53:0/3269847115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 msgr2=0x56087c987cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3214bd640 1 --2- 172.21.15.53:0/3269847115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c987cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3214bd640 1 -- 172.21.15.53:0/3269847115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5899f0 msgr2=0x56087c96e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3214bd640 1 --2- 172.21.15.53:0/3269847115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5899f0 0x56087c96e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3214bd640 1 -- 172.21.15.53:0/3269847115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56087c97ca20 con 0x56087c5aa390 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa31bfff640 1 --2- 172.21.15.53:0/3269847115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c987cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa320cbc640 1 --2- 172.21.15.53:0/3269847115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5899f0 0x56087c96e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3214bd640 1 --2- 172.21.15.53:0/3269847115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5aa390 0x56087c9881f0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fa314031560 tx=0x7fa314031790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1687fae41b1ddf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3027fc640 1 -- 172.21.15.53:0/3269847115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314049040 con 0x56087c5aa390 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3027fc640 1 -- 172.21.15.53:0/3269847115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa314036040 con 0x56087c5aa390 2024-08-31T06:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.915+0000 7fa3027fc640 1 -- 172.21.15.53:0/3269847115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31404e6c0 con 0x56087c5aa390 2024-08-31T06:26:39.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.916+0000 7fa329495740 1 -- 172.21.15.53:0/3269847115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5aa390 msgr2=0x56087c9881f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:39.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.916+0000 7fa329495740 1 --2- 172.21.15.53:0/3269847115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5aa390 0x56087c9881f0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fa314031560 tx=0x7fa314031790 comp rx=0 tx=0).stop 2024-08-31T06:26:39.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.916+0000 7fa329495740 1 -- 172.21.15.53:0/3269847115 shutdown_connections 2024-08-31T06:26:39.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.916+0000 7fa329495740 1 --2- 172.21.15.53:0/3269847115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5aa390 0x56087c9881f0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.916+0000 7fa329495740 1 --2- 172.21.15.53:0/3269847115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c987cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.916+0000 7fa329495740 1 --2- 172.21.15.53:0/3269847115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5899f0 0x56087c96e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.916+0000 7fa329495740 1 -- 172.21.15.53:0/3269847115 >> 172.21.15.53:0/3269847115 conn(0x56087c5bf460 msgr2=0x56087c96db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:39.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.916+0000 7fa329495740 1 -- 172.21.15.53:0/3269847115 shutdown_connections 2024-08-31T06:26:39.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.916+0000 7fa329495740 1 -- 172.21.15.53:0/3269847115 wait complete. 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa329495740 1 -- start start 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa329495740 1 Processor -- start 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa329495740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5899f0 0x56087c984420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa329495740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c9808e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa329495740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c980e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa329495740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1b0c20 con 0x56087c5899f0 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa329495740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1b0490 con 0x56087c5aa390 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa329495740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c1ad570 con 0x56087c5a21b0 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa329495740 10 client.0 _ll_register_callbacks cb 0x7fa30c005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa320cbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5899f0 0x56087c984420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa320cbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5899f0 0x56087c984420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48282/0 (socket says 172.21.15.53:48282) 2024-08-31T06:26:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.917+0000 7fa320cbc640 1 -- 172.21.15.53:0/3479782249 learned_addr learned my addr 172.21.15.53:0/3479782249 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa3214bd640 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c980e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa31bfff640 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c9808e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa320cbc640 1 -- 172.21.15.53:0/3479782249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 msgr2=0x56087c9808e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa320cbc640 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c9808e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa320cbc640 1 -- 172.21.15.53:0/3479782249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 msgr2=0x56087c980e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa320cbc640 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c980e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa320cbc640 1 -- 172.21.15.53:0/3479782249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56087c981510 con 0x56087c5899f0 2024-08-31T06:26:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa320cbc640 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5899f0 0x56087c984420 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00bfd0 tx=0x7fa30c011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afecf9549e191192 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa2fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa2fbfff640 1 -- 172.21.15.53:0/3479782249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c03e030 con 0x56087c5899f0 2024-08-31T06:26:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa2fbfff640 1 -- 172.21.15.53:0/3479782249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fa30c02f3d0 con 0x56087c5899f0 2024-08-31T06:26:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa329495740 1 -- 172.21.15.53:0/3479782249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa314036040 con 0x56087c5899f0 2024-08-31T06:26:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa2fbfff640 1 -- 172.21.15.53:0/3479782249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fa30c034070 con 0x56087c5899f0 2024-08-31T06:26:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa329495740 10 client.22053 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.918+0000 7fa329495740 1 -- 172.21.15.53:0/3479782249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x56087c9f9700 con 0x56087c5899f0 2024-08-31T06:26:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.919+0000 7fa2fbfff640 1 -- 172.21.15.53:0/3479782249 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa314036040 con 0x56087c5899f0 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.919+0000 7fa2fbfff640 1 -- 172.21.15.53:0/3479782249 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7fa30c030850 con 0x56087c5899f0 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.919+0000 7fa329495740 10 client.22053 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.919+0000 7fa329495740 10 client.22053 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.919+0000 7fa329495740 20 client.22053 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.919+0000 7fa329495740 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56087c5cb070 0x56087c9fbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.919+0000 7fa329495740 4 client.22053 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.919+0000 7fa329495740 1 -- 172.21.15.53:0/3479782249 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56087c8e5070 con 0x56087c5cb070 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.919+0000 7fa31bfff640 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56087c5cb070 0x56087c9fbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa2fbfff640 10 client.22053 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa31bfff640 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56087c5cb070 0x56087c9fbf50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a637e88da82c5917 server_cookie=c5c49821c4b07988 in_seq=0 out_seq=0 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa2fbfff640 1 -- 172.21.15.53:0/3479782249 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56087c8e5070 con 0x56087c5cb070 2024-08-31T06:26:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa2fbfff640 10 client.22053 handle_command_reply: tid=0 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 1 client.22053 shutdown 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 1 -- 172.21.15.53:0/3479782249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5899f0 msgr2=0x56087c984420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5899f0 0x56087c984420 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00bfd0 tx=0x7fa30c011d60 comp rx=0 tx=0).stop 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 1 -- 172.21.15.53:0/3479782249 shutdown_connections 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56087c5aa390 0x56087c980e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56087c5cb070 0x56087c9fbf50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56087c5a21b0 0x56087c9808e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 1 --2- 172.21.15.53:0/3479782249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56087c5899f0 0x56087c984420 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa2fbfff640 0 client.22053 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 1 -- 172.21.15.53:0/3479782249 >> 172.21.15.53:0/3479782249 conn(0x56087c5bf460 msgr2=0x56087c973410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 1 -- 172.21.15.53:0/3479782249 shutdown_connections 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 1 -- 172.21.15.53:0/3479782249 wait complete. 2024-08-31T06:26:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.920+0000 7fa329495740 20 client.22053 trim_cache size 0 max 16384 2024-08-31T06:26:39.930 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:26:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 -- 172.21.15.53:0/3259765270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3040b4cd0 msgr2=0x7fa3040b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3040b4cd0 0x7fa3040b71e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x56087c96ef90 tx=0x7fa30c00b390 comp rx=0 tx=0).stop 2024-08-31T06:26:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 -- 172.21.15.53:0/3259765270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa31c107970 msgr2=0x7fa31c19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa31c107970 0x7fa31c19b540 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fa310006fd0 tx=0x7fa31000b8e0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 -- 172.21.15.53:0/3259765270 shutdown_connections 2024-08-31T06:26:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa3040b4cd0 0x7fa3040b71e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa31c1082c0 0x7fa31c19ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa31c107970 0x7fa31c19b540 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 --2- 172.21.15.53:0/3259765270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa31c102030 0x7fa31c19b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 -- 172.21.15.53:0/3259765270 >> 172.21.15.53:0/3259765270 conn(0x7fa31c079c40 msgr2=0x7fa31c105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 -- 172.21.15.53:0/3259765270 shutdown_connections 2024-08-31T06:26:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:39.921+0000 7fa322f20640 1 -- 172.21.15.53:0/3259765270 wait complete. 2024-08-31T06:26:40.387 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.77 MB/sec execute 388 sec latency 2551.516 ms 2024-08-31T06:26:40.535 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:40 smithi053 ceph-mon[18924]: pgmap v1006: 97 pgs: 97 active+clean; 892 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.2 MiB/s wr, 337 op/s 2024-08-31T06:26:40.626 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:26:40.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:40 smithi130 ceph-mon[22266]: pgmap v1006: 97 pgs: 97 active+clean; 892 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.2 MiB/s wr, 337 op/s 2024-08-31T06:26:40.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:40 smithi153 ceph-mon[22320]: pgmap v1006: 97 pgs: 97 active+clean; 892 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.2 MiB/s wr, 337 op/s 2024-08-31T06:26:40.878 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:41.388 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.76 MB/sec execute 389 sec latency 3551.559 ms 2024-08-31T06:26:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.373+0000 7f4a11ee4640 1 -- 172.21.15.53:0/295364320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a0c109310 msgr2=0x7f4a0c109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.373+0000 7f4a11ee4640 1 --2- 172.21.15.53:0/295364320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a0c109310 0x7f4a0c109720 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009900 tx=0x7f4a0002a410 comp rx=0 tx=0).stop 2024-08-31T06:26:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.374+0000 7f4a11ee4640 1 -- 172.21.15.53:0/295364320 shutdown_connections 2024-08-31T06:26:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.374+0000 7f4a11ee4640 1 --2- 172.21.15.53:0/295364320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a0c109c60 0x7f4a0c110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.374+0000 7f4a11ee4640 1 --2- 172.21.15.53:0/295364320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a0c109310 0x7f4a0c109720 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.374+0000 7f4a11ee4640 1 --2- 172.21.15.53:0/295364320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a0c101e60 0x7f4a0c102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.374+0000 7f4a11ee4640 1 -- 172.21.15.53:0/295364320 >> 172.21.15.53:0/295364320 conn(0x7f4a0c079c60 msgr2=0x7f4a0c07a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.374+0000 7f4a11ee4640 1 -- 172.21.15.53:0/295364320 shutdown_connections 2024-08-31T06:26:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.374+0000 7f4a11ee4640 1 -- 172.21.15.53:0/295364320 wait complete. 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.374+0000 7f4a11ee4640 1 Processor -- start 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.374+0000 7f4a11ee4640 1 -- start start 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a11ee4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a0c101e60 0x7f4a0c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a11ee4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a0c109310 0x7f4a0c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a11ee4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a0c109c60 0x7f4a0c19fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a11ee4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1137e0 con 0x7f4a0c109310 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a11ee4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c113660 con 0x7f4a0c101e60 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a11ee4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c113960 con 0x7f4a0c109c60 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a0affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a0c109310 0x7f4a0c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a0affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a0c109310 0x7f4a0c19a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48300/0 (socket says 172.21.15.53:48300) 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a0affd640 1 -- 172.21.15.53:0/1433029278 learned_addr learned my addr 172.21.15.53:0/1433029278 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a0c101e60 0x7f4a0c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a0bfff640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a0c109c60 0x7f4a0c19fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a0affd640 1 -- 172.21.15.53:0/1433029278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a0c109c60 msgr2=0x7f4a0c19fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a0affd640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a0c109c60 0x7f4a0c19fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a0affd640 1 -- 172.21.15.53:0/1433029278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a0c101e60 msgr2=0x7f4a0c19a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a0affd640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a0c101e60 0x7f4a0c19a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a0affd640 1 -- 172.21.15.53:0/1433029278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c1a01c0 con 0x7f4a0c109310 2024-08-31T06:26:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.375+0000 7f4a0affd640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a0c109310 0x7f4a0c19a7f0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f4a00005940 tx=0x7f4a000040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.376+0000 7f4a08ff9640 1 -- 172.21.15.53:0/1433029278 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0003f030 con 0x7f4a0c109310 2024-08-31T06:26:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.376+0000 7f4a08ff9640 1 -- 172.21.15.53:0/1433029278 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a00003a80 con 0x7f4a0c109310 2024-08-31T06:26:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.376+0000 7f4a11ee4640 1 -- 172.21.15.53:0/1433029278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0c1a0450 con 0x7f4a0c109310 2024-08-31T06:26:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.376+0000 7f4a08ff9640 1 -- 172.21.15.53:0/1433029278 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00035070 con 0x7f4a0c109310 2024-08-31T06:26:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.376+0000 7f4a11ee4640 1 -- 172.21.15.53:0/1433029278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0c1a6c10 con 0x7f4a0c109310 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a08ff9640 1 -- 172.21.15.53:0/1433029278 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4a00042030 con 0x7f4a0c109310 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a18459740 1 Processor -- start 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a18459740 1 -- start start 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a18459740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba5044e070 0x55ba507f3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a18459740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507f3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a18459740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba507f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a18459740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ba5076a680 con 0x55ba504251b0 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a18459740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ba50759c10 con 0x55ba5042d390 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a18459740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ba5075dbc0 con 0x55ba5044e070 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507f3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48310/0 (socket says 172.21.15.53:48310) 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.379+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/573807865 learned_addr learned my addr 172.21.15.53:0/573807865 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a0affd640 1 --2- 172.21.15.53:0/573807865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba507f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a0bfff640 1 --2- 172.21.15.53:0/573807865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba5044e070 0x55ba507f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/573807865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba5044e070 msgr2=0x55ba507f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/573807865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba5044e070 0x55ba507f3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/573807865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 msgr2=0x55ba507f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/573807865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba507f3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a08ff9640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49f40b4ca0 0x7f49f40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/573807865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba504b9650 con 0x55ba504251b0 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a0affd640 1 --2- 172.21.15.53:0/573807865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba507f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a0bfff640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49f40b4ca0 0x7f49f40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a08ff9640 1 -- 172.21.15.53:0/1433029278 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f4a00105a40 con 0x7f4a0c109310 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/573807865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507f3850 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009a70 tx=0x7f49fc009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b902869dc5a08ea3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f49f1ffb640 1 -- 172.21.15.53:0/573807865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc017070 con 0x55ba504251b0 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f49f1ffb640 1 -- 172.21.15.53:0/573807865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49fc013470 con 0x55ba504251b0 2024-08-31T06:26:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.380+0000 7f49f1ffb640 1 -- 172.21.15.53:0/573807865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc012630 con 0x55ba504251b0 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.381+0000 7f4a18459740 1 -- 172.21.15.53:0/573807865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 msgr2=0x55ba507f3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.381+0000 7f4a18459740 1 --2- 172.21.15.53:0/573807865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507f3850 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009a70 tx=0x7f49fc009f30 comp rx=0 tx=0).stop 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.381+0000 7f4a0bfff640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49f40b4ca0 0x7f49f40b71b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4a04005fd0 tx=0x7f4a04009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.381+0000 7f4a18459740 1 -- 172.21.15.53:0/573807865 shutdown_connections 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.381+0000 7f4a18459740 1 --2- 172.21.15.53:0/573807865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba507f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.381+0000 7f4a18459740 1 --2- 172.21.15.53:0/573807865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507f3850 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.381+0000 7f4a18459740 1 --2- 172.21.15.53:0/573807865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba5044e070 0x55ba507f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.381+0000 7f4a18459740 1 -- 172.21.15.53:0/573807865 >> 172.21.15.53:0/573807865 conn(0x55ba50442460 msgr2=0x55ba507f1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.381+0000 7f4a18459740 1 -- 172.21.15.53:0/573807865 shutdown_connections 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.381+0000 7f4a18459740 1 -- 172.21.15.53:0/573807865 wait complete. 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a18459740 1 -- start start 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a18459740 1 Processor -- start 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a18459740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507fea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a18459740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba507fefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a18459740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba5044e070 0x55ba5080f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a18459740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ba505bc700 con 0x55ba504251b0 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a18459740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ba506e0750 con 0x55ba5042d390 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a18459740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ba50805f00 con 0x55ba5044e070 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a18459740 10 client.0 _ll_register_callbacks cb 0x55ba5070fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507fea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507fea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48320/0 (socket says 172.21.15.53:48320) 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/1908039096 learned_addr learned my addr 172.21.15.53:0/1908039096 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.382+0000 7f4a0bfff640 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba5044e070 0x55ba5080f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f4a0affd640 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba507fefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/1908039096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba5044e070 msgr2=0x55ba5080f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba5044e070 0x55ba5080f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/1908039096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 msgr2=0x55ba507fefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:41.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba507fefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/1908039096 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba50719900 con 0x55ba504251b0 2024-08-31T06:26:41.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f4a0bfff640 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba5044e070 0x55ba5080f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:41.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507fea90 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f49fc006b90 tx=0x7f49fc00ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ed985409a4d5c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:41.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f49eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:41.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f49eaffd640 1 -- 172.21.15.53:0/1908039096 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc017050 con 0x55ba504251b0 2024-08-31T06:26:41.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f49eaffd640 1 -- 172.21.15.53:0/1908039096 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f49fc01c650 con 0x55ba504251b0 2024-08-31T06:26:41.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f4a18459740 1 -- 172.21.15.53:0/1908039096 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49fc013470 con 0x55ba504251b0 2024-08-31T06:26:41.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f49eaffd640 1 -- 172.21.15.53:0/1908039096 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f49fc01c850 con 0x55ba504251b0 2024-08-31T06:26:41.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f4a18459740 10 client.22065 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:41.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.383+0000 7f4a18459740 1 -- 172.21.15.53:0/1908039096 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x55ba50811c50 con 0x55ba504251b0 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.384+0000 7f49eaffd640 1 -- 172.21.15.53:0/1908039096 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49fc013470 con 0x55ba504251b0 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.384+0000 7f49eaffd640 1 -- 172.21.15.53:0/1908039096 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f49fc026a50 con 0x55ba504251b0 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.384+0000 7f4a18459740 10 client.22065 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.384+0000 7f4a18459740 10 client.22065 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.384+0000 7f4a18459740 20 client.22065 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.384+0000 7f4a18459740 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba5040c9f0 0x55ba50814fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.384+0000 7f4a18459740 4 client.22065 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.384+0000 7f4a18459740 1 -- 172.21.15.53:0/1908039096 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba5076c5d0 con 0x55ba5040c9f0 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.384+0000 7f4a0affd640 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba5040c9f0 0x55ba50814fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.385+0000 7f49eaffd640 10 client.22065 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.385+0000 7f4a0affd640 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba5040c9f0 0x55ba50814fb0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a394a9065b79a2b7 server_cookie=ea49226225bfd8c8 in_seq=0 out_seq=0 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.385+0000 7f49eaffd640 1 -- 172.21.15.53:0/1908039096 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ba5076c5d0 con 0x55ba5040c9f0 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.385+0000 7f49eaffd640 10 client.22065 handle_command_reply: tid=0 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.385+0000 7f4a18459740 1 client.22065 shutdown 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f4a18459740 1 -- 172.21.15.53:0/1908039096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 msgr2=0x55ba507fea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f4a18459740 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507fea90 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f49fc006b90 tx=0x7f49fc00ef50 comp rx=0 tx=0).stop 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f4a18459740 1 -- 172.21.15.53:0/1908039096 shutdown_connections 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f4a18459740 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba5044e070 0x55ba5080f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f4a18459740 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba507fefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f4a18459740 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba5040c9f0 0x55ba50814fb0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f4a18459740 1 --2- 172.21.15.53:0/1908039096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba504251b0 0x55ba507fea90 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f49eaffd640 0 client.22065 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:26:41.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f4a18459740 1 -- 172.21.15.53:0/1908039096 >> 172.21.15.53:0/1908039096 conn(0x55ba50442460 msgr2=0x55ba507f64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:41.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f4a18459740 1 -- 172.21.15.53:0/1908039096 shutdown_connections 2024-08-31T06:26:41.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f4a18459740 1 -- 172.21.15.53:0/1908039096 wait complete. 2024-08-31T06:26:41.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.386+0000 7f4a18459740 20 client.22065 trim_cache size 0 max 16384 2024-08-31T06:26:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.399+0000 7f4a18459740 1 Processor -- start 2024-08-31T06:26:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.399+0000 7f4a18459740 1 -- start start 2024-08-31T06:26:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a18459740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 0x55ba507f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a18459740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba5080f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a18459740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba5044e070 0x55ba507fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a18459740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1ad300 con 0x55ba5044e070 2024-08-31T06:26:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a18459740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1af140 con 0x55ba5042d390 2024-08-31T06:26:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a18459740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1ada90 con 0x55ba504251b0 2024-08-31T06:26:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a0affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba5080f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 0x55ba507f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a0affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba5080f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:47928/0 (socket says 172.21.15.53:47928) 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a0affd640 1 -- 172.21.15.53:0/2969087893 learned_addr learned my addr 172.21.15.53:0/2969087893 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a0bfff640 1 --2- 172.21.15.53:0/2969087893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba5044e070 0x55ba507fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a0affd640 1 -- 172.21.15.53:0/2969087893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 msgr2=0x55ba507f4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a0affd640 1 --2- 172.21.15.53:0/2969087893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 0x55ba507f4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a0affd640 1 -- 172.21.15.53:0/2969087893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba5044e070 msgr2=0x55ba507fbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a0affd640 1 --2- 172.21.15.53:0/2969087893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba5044e070 0x55ba507fbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a0affd640 1 -- 172.21.15.53:0/2969087893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba507f96c0 con 0x55ba5042d390 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.400+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/2969087893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 0x55ba507f4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.401+0000 7f4a0affd640 1 --2- 172.21.15.53:0/2969087893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba5080f190 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4a000c9380 tx=0x7f4a00009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d623db543f9d1012 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.401+0000 7f49f17fa640 1 -- 172.21.15.53:0/2969087893 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00049040 con 0x55ba5042d390 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.401+0000 7f49f17fa640 1 -- 172.21.15.53:0/2969087893 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a000cbc20 con 0x55ba5042d390 2024-08-31T06:26:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.401+0000 7f49f17fa640 1 -- 172.21.15.53:0/2969087893 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a001033f0 con 0x55ba5042d390 2024-08-31T06:26:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.402+0000 7f4a18459740 1 -- 172.21.15.53:0/2969087893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 msgr2=0x55ba5080f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.402+0000 7f4a18459740 1 --2- 172.21.15.53:0/2969087893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba5080f190 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4a000c9380 tx=0x7f4a00009680 comp rx=0 tx=0).stop 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.402+0000 7f4a18459740 1 -- 172.21.15.53:0/2969087893 shutdown_connections 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.402+0000 7f4a18459740 1 --2- 172.21.15.53:0/2969087893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba5044e070 0x55ba507fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.402+0000 7f4a18459740 1 --2- 172.21.15.53:0/2969087893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba5080f190 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.402+0000 7f4a18459740 1 --2- 172.21.15.53:0/2969087893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 0x55ba507f4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.402+0000 7f4a18459740 1 -- 172.21.15.53:0/2969087893 >> 172.21.15.53:0/2969087893 conn(0x55ba50442460 msgr2=0x55ba507f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.402+0000 7f4a18459740 1 -- 172.21.15.53:0/2969087893 shutdown_connections 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.402+0000 7f4a18459740 1 -- 172.21.15.53:0/2969087893 wait complete. 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.402+0000 7f4a18459740 1 -- start start 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.402+0000 7f4a18459740 1 Processor -- start 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a18459740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 0x55ba508162d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a18459740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba50816810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a18459740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba5044e070 0x55ba5087e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a18459740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1ae9b0 con 0x55ba5044e070 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a18459740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1ae220 con 0x55ba5042d390 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a18459740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1ab300 con 0x55ba504251b0 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a18459740 10 client.0 _ll_register_callbacks cb 0x7f49fc0098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 0x55ba508162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a0bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba5044e070 0x55ba5087e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a0b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 0x55ba508162d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56732/0 (socket says 172.21.15.53:56732) 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/3230731736 learned_addr learned my addr 172.21.15.53:0/3230731736 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a0affd640 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba50816810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a0bfff640 1 -- 172.21.15.53:0/3230731736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 msgr2=0x55ba508162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a0bfff640 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 0x55ba508162d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a0bfff640 1 -- 172.21.15.53:0/3230731736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 msgr2=0x55ba50816810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a0bfff640 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba50816810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.403+0000 7f4a0bfff640 1 -- 172.21.15.53:0/3230731736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba50817090 con 0x55ba5044e070 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.404+0000 7f4a0bfff640 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba5044e070 0x55ba5087e730 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f4a04012010 tx=0x7f4a04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3302d84d33aaa61 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.404+0000 7f49eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.404+0000 7f49eaffd640 1 -- 172.21.15.53:0/3230731736 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04020c50 con 0x55ba5044e070 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.404+0000 7f49eaffd640 1 -- 172.21.15.53:0/3230731736 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f4a04020df0 con 0x55ba5044e070 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.404+0000 7f4a18459740 1 -- 172.21.15.53:0/3230731736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a000cbc20 con 0x55ba5044e070 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.404+0000 7f49eaffd640 1 -- 172.21.15.53:0/3230731736 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f4a04032420 con 0x55ba5044e070 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.404+0000 7f4a18459740 10 client.22071 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.404+0000 7f4a18459740 1 -- 172.21.15.53:0/3230731736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x55ba50801940 con 0x55ba5044e070 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.404+0000 7f49eaffd640 1 -- 172.21.15.53:0/3230731736 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a000cbc20 con 0x55ba5044e070 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.404+0000 7f49eaffd640 1 -- 172.21.15.53:0/3230731736 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f4a0400f040 con 0x55ba5044e070 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.405+0000 7f4a18459740 10 client.22071 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.405+0000 7f4a18459740 10 client.22071 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:26:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.405+0000 7f4a18459740 20 client.22071 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.405+0000 7f4a18459740 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba503e1da0 0x55ba50804180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.405+0000 7f4a18459740 4 client.22071 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:26:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.405+0000 7f4a18459740 1 -- 172.21.15.53:0/3230731736 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ba50768070 con 0x55ba503e1da0 2024-08-31T06:26:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.405+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba503e1da0 0x55ba50804180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.405+0000 7f49eaffd640 10 client.22071 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:26:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.405+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba503e1da0 0x55ba50804180 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f82f7f078bbf5f61 server_cookie=515ccf3602dde1aa in_seq=0 out_seq=0 2024-08-31T06:26:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f49eaffd640 1 -- 172.21.15.53:0/3230731736 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ba50768070 con 0x55ba503e1da0 2024-08-31T06:26:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f49eaffd640 10 client.22071 handle_command_reply: tid=0 2024-08-31T06:26:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 1 client.22071 shutdown 2024-08-31T06:26:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 1 -- 172.21.15.53:0/3230731736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba5044e070 msgr2=0x55ba5087e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba5044e070 0x55ba5087e730 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f4a04012010 tx=0x7f4a04004a40 comp rx=0 tx=0).stop 2024-08-31T06:26:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 1 -- 172.21.15.53:0/3230731736 shutdown_connections 2024-08-31T06:26:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55ba503e1da0 0x55ba50804180 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba5044e070 0x55ba5087e730 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ba5042d390 0x55ba50816810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 1 --2- 172.21.15.53:0/3230731736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba504251b0 0x55ba508162d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 1 -- 172.21.15.53:0/3230731736 >> 172.21.15.53:0/3230731736 conn(0x55ba50442460 msgr2=0x55ba507fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f49eaffd640 0 client.22071 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:26:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 1 -- 172.21.15.53:0/3230731736 shutdown_connections 2024-08-31T06:26:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 1 -- 172.21.15.53:0/3230731736 wait complete. 2024-08-31T06:26:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.406+0000 7f4a18459740 20 client.22071 trim_cache size 0 max 16384 2024-08-31T06:26:41.413 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:26:41.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 -- 172.21.15.53:0/1433029278 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49f40b4ca0 msgr2=0x7f49f40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:41.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49f40b4ca0 0x7f49f40b71b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4a04005fd0 tx=0x7f4a04009600 comp rx=0 tx=0).stop 2024-08-31T06:26:41.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 -- 172.21.15.53:0/1433029278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a0c109310 msgr2=0x7f4a0c19a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:41.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a0c109310 0x7f4a0c19a7f0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f4a00005940 tx=0x7f4a000040e0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 -- 172.21.15.53:0/1433029278 shutdown_connections 2024-08-31T06:26:41.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f49f40b4ca0 0x7f49f40b71b0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a0c109c60 0x7f4a0c19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a0c109310 0x7f4a0c19a7f0 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 --2- 172.21.15.53:0/1433029278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a0c101e60 0x7f4a0c19a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 -- 172.21.15.53:0/1433029278 >> 172.21.15.53:0/1433029278 conn(0x7f4a0c079c60 msgr2=0x7f4a0c1073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 -- 172.21.15.53:0/1433029278 shutdown_connections 2024-08-31T06:26:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:41.407+0000 7f4a11ee4640 1 -- 172.21.15.53:0/1433029278 wait complete. 2024-08-31T06:26:42.185 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:26:42.388 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.75 MB/sec execute 390 sec latency 4551.595 ms 2024-08-31T06:26:42.442 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:42.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:42 smithi053 ceph-mon[18924]: pgmap v1007: 97 pgs: 97 active+clean; 888 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-08-31T06:26:42.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:42 smithi130 ceph-mon[22266]: pgmap v1007: 97 pgs: 97 active+clean; 888 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-08-31T06:26:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:42 smithi153 ceph-mon[22320]: pgmap v1007: 97 pgs: 97 active+clean; 888 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-08-31T06:26:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.906+0000 7f9c4f5da640 1 -- 172.21.15.53:0/2638344943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c48103900 msgr2=0x7f9c48103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.906+0000 7f9c4f5da640 1 --2- 172.21.15.53:0/2638344943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c48103900 0x7f9c48103d10 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009ca0 tx=0x7f9c3802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.906+0000 7f9c4f5da640 1 -- 172.21.15.53:0/2638344943 shutdown_connections 2024-08-31T06:26:42.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.906+0000 7f9c4f5da640 1 --2- 172.21.15.53:0/2638344943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c48109b90 0x7f9c481103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.906+0000 7f9c4f5da640 1 --2- 172.21.15.53:0/2638344943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c48109240 0x7f9c48109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.906+0000 7f9c4f5da640 1 --2- 172.21.15.53:0/2638344943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c48103900 0x7f9c48103d10 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.906+0000 7f9c4f5da640 1 -- 172.21.15.53:0/2638344943 >> 172.21.15.53:0/2638344943 conn(0x7f9c4807b5f0 msgr2=0x7f9c4807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:42.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.906+0000 7f9c4f5da640 1 -- 172.21.15.53:0/2638344943 shutdown_connections 2024-08-31T06:26:42.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.906+0000 7f9c4f5da640 1 -- 172.21.15.53:0/2638344943 wait complete. 2024-08-31T06:26:42.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4f5da640 1 Processor -- start 2024-08-31T06:26:42.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4f5da640 1 -- start start 2024-08-31T06:26:42.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4f5da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c48103900 0x7f9c4819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4f5da640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c48109240 0x7f9c4819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4f5da640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c48109b90 0x7f9c4819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4f5da640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9c48113750 con 0x7f9c48103900 2024-08-31T06:26:42.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4f5da640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481135d0 con 0x7f9c48109b90 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4f5da640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481138d0 con 0x7f9c48109240 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4d376640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c48103900 0x7f9c4819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4d376640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c48103900 0x7f9c4819a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48348/0 (socket says 172.21.15.53:48348) 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4d376640 1 -- 172.21.15.53:0/3066422657 learned_addr learned my addr 172.21.15.53:0/3066422657 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.907+0000 7f9c4cb75640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c48109240 0x7f9c4819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c4db77640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c48109b90 0x7f9c4819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c4d376640 1 -- 172.21.15.53:0/3066422657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c48109240 msgr2=0x7f9c4819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c4d376640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c48109240 0x7f9c4819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c4d376640 1 -- 172.21.15.53:0/3066422657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c48109b90 msgr2=0x7f9c4819f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c4d376640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c48109b90 0x7f9c4819f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c4d376640 1 -- 172.21.15.53:0/3066422657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c481a0110 con 0x7f9c48103900 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c4db77640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c48109b90 0x7f9c4819f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:26:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c4d376640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c48103900 0x7f9c4819a1a0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f9c38006010 tx=0x7f9c38032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c467fc640 1 -- 172.21.15.53:0/3066422657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38004040 con 0x7f9c48103900 2024-08-31T06:26:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c4f5da640 1 -- 172.21.15.53:0/3066422657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c481a03a0 con 0x7f9c48103900 2024-08-31T06:26:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c467fc640 1 -- 172.21.15.53:0/3066422657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c38004670 con 0x7f9c48103900 2024-08-31T06:26:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c467fc640 1 -- 172.21.15.53:0/3066422657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38030da0 con 0x7f9c48103900 2024-08-31T06:26:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.908+0000 7f9c4f5da640 1 -- 172.21.15.53:0/3066422657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c481a6b60 con 0x7f9c48103900 2024-08-31T06:26:42.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c55b4f740 1 Processor -- start 2024-08-31T06:26:42.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c55b4f740 1 -- start start 2024-08-31T06:26:42.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c467fc640 1 -- 172.21.15.53:0/3066422657 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9c380305c0 con 0x7f9c48103900 2024-08-31T06:26:42.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a13a070 0x56426a4df310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4df850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a119390 0x56426a4dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56426a456680 con 0x56426a1111b0 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56426a445c10 con 0x56426a13a070 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56426a449bc0 con 0x56426a119390 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c4d376640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4df850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c4d376640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4df850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48352/0 (socket says 172.21.15.53:48352) 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.911+0000 7f9c4d376640 1 -- 172.21.15.53:0/183175534 learned_addr learned my addr 172.21.15.53:0/183175534 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c4cb75640 1 --2- 172.21.15.53:0/183175534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a119390 0x56426a4dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c4db77640 1 --2- 172.21.15.53:0/183175534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a13a070 0x56426a4df310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c4d376640 1 -- 172.21.15.53:0/183175534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a119390 msgr2=0x56426a4dfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c4d376640 1 --2- 172.21.15.53:0/183175534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a119390 0x56426a4dfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c4d376640 1 -- 172.21.15.53:0/183175534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a13a070 msgr2=0x56426a4df310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c4d376640 1 --2- 172.21.15.53:0/183175534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a13a070 0x56426a4df310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c4d376640 1 -- 172.21.15.53:0/183175534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56426a1a5650 con 0x56426a1111b0 2024-08-31T06:26:42.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c4cb75640 1 --2- 172.21.15.53:0/183175534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a119390 0x56426a4dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:42.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c4db77640 1 --2- 172.21.15.53:0/183175534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a13a070 0x56426a4df310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:42.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c4d376640 1 --2- 172.21.15.53:0/183175534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4df850 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f9c38104190 tx=0x7f9c3810aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917a3d8e9ad81775 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:42.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c467fc640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c300b4ca0 0x7f9c300b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c4db77640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c300b4ca0 0x7f9c300b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.912+0000 7f9c2f7fe640 1 -- 172.21.15.53:0/183175534 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c380c9810 con 0x56426a1111b0 2024-08-31T06:26:42.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.913+0000 7f9c2f7fe640 1 -- 172.21.15.53:0/183175534 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c38004820 con 0x56426a1111b0 2024-08-31T06:26:42.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.913+0000 7f9c2f7fe640 1 -- 172.21.15.53:0/183175534 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c380cc930 con 0x56426a1111b0 2024-08-31T06:26:42.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.913+0000 7f9c467fc640 1 -- 172.21.15.53:0/3066422657 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f9c38106af0 con 0x7f9c48103900 2024-08-31T06:26:42.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.913+0000 7f9c55b4f740 1 -- 172.21.15.53:0/183175534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 msgr2=0x56426a4df850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:42.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.913+0000 7f9c4db77640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c300b4ca0 0x7f9c300b71b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000bc40 tx=0x7f9c40005f10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:42.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.913+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/183175534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4df850 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f9c38104190 tx=0x7f9c3810aba0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.914+0000 7f9c55b4f740 1 -- 172.21.15.53:0/183175534 shutdown_connections 2024-08-31T06:26:42.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.914+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/183175534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a119390 0x56426a4dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.914+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/183175534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4df850 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.914+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/183175534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a13a070 0x56426a4df310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.914+0000 7f9c55b4f740 1 -- 172.21.15.53:0/183175534 >> 172.21.15.53:0/183175534 conn(0x56426a12e460 msgr2=0x56426a4dd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.914+0000 7f9c55b4f740 1 -- 172.21.15.53:0/183175534 shutdown_connections 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.914+0000 7f9c55b4f740 1 -- 172.21.15.53:0/183175534 wait complete. 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.914+0000 7f9c55b4f740 1 -- start start 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.914+0000 7f9c55b4f740 1 Processor -- start 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a1111b0 0x56426a4ea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a119390 0x56426a4eaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a13a070 0x56426a4f6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56426a2a8700 con 0x56426a13a070 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56426a3cc750 con 0x56426a1111b0 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56426a456680 con 0x56426a119390 2024-08-31T06:26:42.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c55b4f740 10 client.0 _ll_register_callbacks cb 0x56426a3fbe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4db77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a13a070 0x56426a4f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4db77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a13a070 0x56426a4f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48366/0 (socket says 172.21.15.53:48366) 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4db77640 1 -- 172.21.15.53:0/3978611462 learned_addr learned my addr 172.21.15.53:0/3978611462 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4cb75640 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a119390 0x56426a4eaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4d376640 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a1111b0 0x56426a4ea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4db77640 1 -- 172.21.15.53:0/3978611462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a119390 msgr2=0x56426a4eaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4db77640 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a119390 0x56426a4eaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4db77640 1 -- 172.21.15.53:0/3978611462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a1111b0 msgr2=0x56426a4ea9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4db77640 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a1111b0 0x56426a4ea9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4db77640 1 -- 172.21.15.53:0/3978611462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56426a405900 con 0x56426a13a070 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4d376640 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a1111b0 0x56426a4ea9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c4db77640 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a13a070 0x56426a4f6990 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f9c40010e30 tx=0x7f9c400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bd4995ef62741e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.915+0000 7f9c2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:42.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.916+0000 7f9c2cff9640 1 -- 172.21.15.53:0/3978611462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4001d420 con 0x56426a13a070 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.916+0000 7f9c2cff9640 1 -- 172.21.15.53:0/3978611462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f9c4001d5c0 con 0x56426a13a070 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.916+0000 7f9c55b4f740 1 -- 172.21.15.53:0/3978611462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c38004820 con 0x56426a13a070 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.916+0000 7f9c2cff9640 1 -- 172.21.15.53:0/3978611462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f9c4001d7c0 con 0x56426a13a070 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.916+0000 7f9c55b4f740 10 client.22083 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.916+0000 7f9c55b4f740 1 -- 172.21.15.53:0/3978611462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x56426a4f9410 con 0x56426a13a070 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.916+0000 7f9c2cff9640 1 -- 172.21.15.53:0/3978611462 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c38004820 con 0x56426a13a070 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.917+0000 7f9c2cff9640 1 -- 172.21.15.53:0/3978611462 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f9c400258c0 con 0x56426a13a070 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.917+0000 7f9c55b4f740 10 client.22083 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.917+0000 7f9c55b4f740 10 client.22083 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.917+0000 7f9c55b4f740 20 client.22083 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.917+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56426a0f89f0 0x56426a4fca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.917+0000 7f9c55b4f740 4 client.22083 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.917+0000 7f9c55b4f740 1 -- 172.21.15.53:0/3978611462 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56426a4585d0 con 0x56426a0f89f0 2024-08-31T06:26:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.917+0000 7f9c4d376640 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56426a0f89f0 0x56426a4fca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.918+0000 7f9c2cff9640 10 client.22083 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.918+0000 7f9c4d376640 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56426a0f89f0 0x56426a4fca00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6346b82462ad547b server_cookie=5be74eab6e1fe4f1 in_seq=0 out_seq=0 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.918+0000 7f9c2cff9640 1 -- 172.21.15.53:0/3978611462 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56426a4585d0 con 0x56426a0f89f0 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.918+0000 7f9c2cff9640 10 client.22083 handle_command_reply: tid=0 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.918+0000 7f9c55b4f740 1 client.22083 shutdown 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c55b4f740 1 -- 172.21.15.53:0/3978611462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a13a070 msgr2=0x56426a4f6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a13a070 0x56426a4f6990 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f9c40010e30 tx=0x7f9c400046c0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c55b4f740 1 -- 172.21.15.53:0/3978611462 shutdown_connections 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56426a0f89f0 0x56426a4fca00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a13a070 0x56426a4f6990 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a119390 0x56426a4eaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/3978611462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a1111b0 0x56426a4ea9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c55b4f740 1 -- 172.21.15.53:0/3978611462 >> 172.21.15.53:0/3978611462 conn(0x56426a12e460 msgr2=0x56426a4e24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:42.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c2cff9640 0 client.22083 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:26:42.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c55b4f740 1 -- 172.21.15.53:0/3978611462 shutdown_connections 2024-08-31T06:26:42.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c55b4f740 1 -- 172.21.15.53:0/3978611462 wait complete. 2024-08-31T06:26:42.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.919+0000 7f9c55b4f740 20 client.22083 trim_cache size 0 max 16384 2024-08-31T06:26:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.932+0000 7f9c55b4f740 1 Processor -- start 2024-08-31T06:26:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.932+0000 7f9c55b4f740 1 -- start start 2024-08-31T06:26:42.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4e0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a119390 0x56426a4f6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a13a070 0x56426a4e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481af500 con 0x56426a1111b0 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481b1340 con 0x56426a119390 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481afc90 con 0x56426a13a070 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4d376640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4e0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4d376640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4e0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48380/0 (socket says 172.21.15.53:48380) 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4d376640 1 -- 172.21.15.53:0/1215686917 learned_addr learned my addr 172.21.15.53:0/1215686917 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4cb75640 1 --2- 172.21.15.53:0/1215686917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a119390 0x56426a4f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4db77640 1 --2- 172.21.15.53:0/1215686917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a13a070 0x56426a4e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4d376640 1 -- 172.21.15.53:0/1215686917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a13a070 msgr2=0x56426a4e7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4d376640 1 --2- 172.21.15.53:0/1215686917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a13a070 0x56426a4e7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4d376640 1 -- 172.21.15.53:0/1215686917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a119390 msgr2=0x56426a4f6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:42.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4d376640 1 --2- 172.21.15.53:0/1215686917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a119390 0x56426a4f6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4d376640 1 -- 172.21.15.53:0/1215686917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56426a4ebcb0 con 0x56426a1111b0 2024-08-31T06:26:42.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4db77640 1 --2- 172.21.15.53:0/1215686917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a13a070 0x56426a4e7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:26:42.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c4d376640 1 --2- 172.21.15.53:0/1215686917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4e0a00 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f9c380cd150 tx=0x7f9c3810a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b4705771a7f5ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:42.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c2effd640 1 -- 172.21.15.53:0/1215686917 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c380ccb10 con 0x56426a1111b0 2024-08-31T06:26:42.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c2effd640 1 -- 172.21.15.53:0/1215686917 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c38036070 con 0x56426a1111b0 2024-08-31T06:26:42.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.933+0000 7f9c2effd640 1 -- 172.21.15.53:0/1215686917 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c380ccd00 con 0x56426a1111b0 2024-08-31T06:26:42.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.934+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1215686917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 msgr2=0x56426a4e0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:42.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.934+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/1215686917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4e0a00 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f9c380cd150 tx=0x7f9c3810a640 comp rx=0 tx=0).stop 2024-08-31T06:26:42.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.934+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1215686917 shutdown_connections 2024-08-31T06:26:42.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.934+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/1215686917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a13a070 0x56426a4e7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.934+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/1215686917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a119390 0x56426a4f6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.934+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/1215686917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a1111b0 0x56426a4e0a00 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.934+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1215686917 >> 172.21.15.53:0/1215686917 conn(0x56426a12e460 msgr2=0x56426a4e02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:42.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.934+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1215686917 shutdown_connections 2024-08-31T06:26:42.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.934+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1215686917 wait complete. 2024-08-31T06:26:42.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c55b4f740 1 -- start start 2024-08-31T06:26:42.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c55b4f740 1 Processor -- start 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a1111b0 0x56426a4f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a119390 0x56426a4ef570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c55b4f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a13a070 0x56426a4efab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481b0bb0 con 0x56426a119390 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481b0420 con 0x56426a1111b0 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c55b4f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481ad500 con 0x56426a13a070 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c55b4f740 10 client.0 _ll_register_callbacks cb 0x7f9c4000b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c4cb75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a119390 0x56426a4ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c4cb75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a119390 0x56426a4ef570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48396/0 (socket says 172.21.15.53:48396) 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.935+0000 7f9c4cb75640 1 -- 172.21.15.53:0/1734358732 learned_addr learned my addr 172.21.15.53:0/1734358732 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c4d376640 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a1111b0 0x56426a4f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c4db77640 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a13a070 0x56426a4efab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c4cb75640 1 -- 172.21.15.53:0/1734358732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a13a070 msgr2=0x56426a4efab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c4cb75640 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a13a070 0x56426a4efab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c4cb75640 1 -- 172.21.15.53:0/1734358732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a1111b0 msgr2=0x56426a4f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c4cb75640 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a1111b0 0x56426a4f30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c4cb75640 1 -- 172.21.15.53:0/1734358732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56426a4f0220 con 0x56426a119390 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c4cb75640 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a119390 0x56426a4ef570 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0107f0 tx=0x7f9c3c010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8a08974e4c5f2b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c2cff9640 1 -- 172.21.15.53:0/1734358732 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00fb30 con 0x56426a119390 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c2cff9640 1 -- 172.21.15.53:0/1734358732 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f9c3c019040 con 0x56426a119390 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1734358732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c38036070 con 0x56426a119390 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c2cff9640 1 -- 172.21.15.53:0/1734358732 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f9c3c029050 con 0x56426a119390 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c55b4f740 10 client.22089 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.936+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1734358732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x56426a5682c0 con 0x56426a119390 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.937+0000 7f9c2cff9640 1 -- 172.21.15.53:0/1734358732 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c38036070 con 0x56426a119390 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.937+0000 7f9c2cff9640 1 -- 172.21.15.53:0/1734358732 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f9c3c0243b0 con 0x56426a119390 2024-08-31T06:26:42.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.937+0000 7f9c55b4f740 10 client.22089 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.937+0000 7f9c55b4f740 10 client.22089 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.937+0000 7f9c55b4f740 20 client.22089 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.937+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56426a0cdda0 0x56426a56abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.937+0000 7f9c55b4f740 4 client.22089 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.937+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1734358732 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56426a454070 con 0x56426a0cdda0 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.937+0000 7f9c4d376640 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56426a0cdda0 0x56426a56abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c2cff9640 10 client.22089 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c4d376640 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56426a0cdda0 0x56426a56abf0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f64ce4300b0254a7 server_cookie=63661eddfd523460 in_seq=0 out_seq=0 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c2cff9640 1 -- 172.21.15.53:0/1734358732 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56426a454070 con 0x56426a0cdda0 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c2cff9640 10 client.22089 handle_command_reply: tid=0 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 1 client.22089 shutdown 2024-08-31T06:26:42.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1734358732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a119390 msgr2=0x56426a4ef570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:42.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a119390 0x56426a4ef570 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0107f0 tx=0x7f9c3c010cb0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1734358732 shutdown_connections 2024-08-31T06:26:42.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x56426a0cdda0 0x56426a56abf0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56426a13a070 0x56426a4efab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56426a119390 0x56426a4ef570 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 1 --2- 172.21.15.53:0/1734358732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56426a1111b0 0x56426a4f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1734358732 >> 172.21.15.53:0/1734358732 conn(0x56426a12e460 msgr2=0x56426a4ebe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:42.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c2cff9640 0 client.22089 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:26:42.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1734358732 shutdown_connections 2024-08-31T06:26:42.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 1 -- 172.21.15.53:0/1734358732 wait complete. 2024-08-31T06:26:42.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.938+0000 7f9c55b4f740 20 client.22089 trim_cache size 0 max 16384 2024-08-31T06:26:42.946 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:26:42.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 -- 172.21.15.53:0/3066422657 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c300b4ca0 msgr2=0x7f9c300b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:42.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c300b4ca0 0x7f9c300b71b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000bc40 tx=0x7f9c40005f10 comp rx=0 tx=0).stop 2024-08-31T06:26:42.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 -- 172.21.15.53:0/3066422657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c48103900 msgr2=0x7f9c4819a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:42.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c48103900 0x7f9c4819a1a0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f9c38006010 tx=0x7f9c38032bc0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 -- 172.21.15.53:0/3066422657 shutdown_connections 2024-08-31T06:26:42.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9c300b4ca0 0x7f9c300b71b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c48109b90 0x7f9c4819f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c48109240 0x7f9c4819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 --2- 172.21.15.53:0/3066422657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c48103900 0x7f9c4819a1a0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:42.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 -- 172.21.15.53:0/3066422657 >> 172.21.15.53:0/3066422657 conn(0x7f9c4807b5f0 msgr2=0x7f9c48107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:42.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 -- 172.21.15.53:0/3066422657 shutdown_connections 2024-08-31T06:26:42.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:42.939+0000 7f9c4f5da640 1 -- 172.21.15.53:0/3066422657 wait complete. 2024-08-31T06:26:43.388 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.73 MB/sec execute 391 sec latency 5551.637 ms 2024-08-31T06:26:43.702 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:26:43.966 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:44.341 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:44 smithi053 ceph-mon[18924]: pgmap v1008: 97 pgs: 97 active+clean; 886 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2024-08-31T06:26:44.388 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.72 MB/sec execute 392 sec latency 6552.020 ms 2024-08-31T06:26:44.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.431+0000 7f53c75c9640 1 -- 172.21.15.53:0/1729264035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53c0109240 msgr2=0x7f53c0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:44.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.431+0000 7f53c75c9640 1 --2- 172.21.15.53:0/1729264035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53c0109240 0x7f53c0109650 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009900 tx=0x7f53b002a410 comp rx=0 tx=0).stop 2024-08-31T06:26:44.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.431+0000 7f53c75c9640 1 -- 172.21.15.53:0/1729264035 shutdown_connections 2024-08-31T06:26:44.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.431+0000 7f53c75c9640 1 --2- 172.21.15.53:0/1729264035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53c0109b90 0x7f53c01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.431+0000 7f53c75c9640 1 --2- 172.21.15.53:0/1729264035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53c0109240 0x7f53c0109650 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.431+0000 7f53c75c9640 1 --2- 172.21.15.53:0/1729264035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0103900 0x7f53c0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.431+0000 7f53c75c9640 1 -- 172.21.15.53:0/1729264035 >> 172.21.15.53:0/1729264035 conn(0x7f53c007b5f0 msgr2=0x7f53c007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:44.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.431+0000 7f53c75c9640 1 -- 172.21.15.53:0/1729264035 shutdown_connections 2024-08-31T06:26:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.431+0000 7f53c75c9640 1 -- 172.21.15.53:0/1729264035 wait complete. 2024-08-31T06:26:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.432+0000 7f53c75c9640 1 Processor -- start 2024-08-31T06:26:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.432+0000 7f53c75c9640 1 -- start start 2024-08-31T06:26:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.432+0000 7f53c75c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53c0103900 0x7f53c019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.432+0000 7f53c75c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0109240 0x7f53c019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.432+0000 7f53c75c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53c0109b90 0x7f53c019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.432+0000 7f53c75c9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f53c0113720 con 0x7f53c0103900 2024-08-31T06:26:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.432+0000 7f53c75c9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53c01135a0 con 0x7f53c0109b90 2024-08-31T06:26:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.432+0000 7f53c75c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f53c01138a0 con 0x7f53c0109240 2024-08-31T06:26:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c5365640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53c0103900 0x7f53c019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c5365640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53c0103900 0x7f53c019a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44274/0 (socket says 172.21.15.53:44274) 2024-08-31T06:26:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c5365640 1 -- 172.21.15.53:0/2131116350 learned_addr learned my addr 172.21.15.53:0/2131116350 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c5b66640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53c0109b90 0x7f53c019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c4b64640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0109240 0x7f53c019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c5365640 1 -- 172.21.15.53:0/2131116350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0109240 msgr2=0x7f53c019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c5365640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0109240 0x7f53c019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c5365640 1 -- 172.21.15.53:0/2131116350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53c0109b90 msgr2=0x7f53c019fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c5365640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53c0109b90 0x7f53c019fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c5365640 1 -- 172.21.15.53:0/2131116350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c01a0160 con 0x7f53c0103900 2024-08-31T06:26:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c4b64640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0109240 0x7f53c019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c5365640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53c0103900 0x7f53c019a1f0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00b4a0 tx=0x7f53bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53b67fc640 1 -- 172.21.15.53:0/2131116350 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc014070 con 0x7f53c0103900 2024-08-31T06:26:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53b67fc640 1 -- 172.21.15.53:0/2131116350 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53bc010aa0 con 0x7f53c0103900 2024-08-31T06:26:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53b67fc640 1 -- 172.21.15.53:0/2131116350 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc017b70 con 0x7f53c0103900 2024-08-31T06:26:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c75c9640 1 -- 172.21.15.53:0/2131116350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c01a0450 con 0x7f53c0103900 2024-08-31T06:26:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.433+0000 7f53c75c9640 1 -- 172.21.15.53:0/2131116350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c01a6bb0 con 0x7f53c0103900 2024-08-31T06:26:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.436+0000 7f53cdb3e740 1 Processor -- start 2024-08-31T06:26:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.436+0000 7f53cdb3e740 1 -- start start 2024-08-31T06:26:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.436+0000 7f53b67fc640 1 -- 172.21.15.53:0/2131116350 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f53bc017070 con 0x7f53c0103900 2024-08-31T06:26:44.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b617070 0x55c14b9bc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5ee1b0 0x55c14b9bc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b5f6390 0x55c14b9bcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c14b933680 con 0x55c14b617070 2024-08-31T06:26:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c14b922c10 con 0x55c14b5ee1b0 2024-08-31T06:26:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c14b926bc0 con 0x55c14b5f6390 2024-08-31T06:26:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53c5b66640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b617070 0x55c14b9bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53c5b66640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b617070 0x55c14b9bc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44286/0 (socket says 172.21.15.53:44286) 2024-08-31T06:26:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53c5b66640 1 -- 172.21.15.53:0/624531946 learned_addr learned my addr 172.21.15.53:0/624531946 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53c5365640 1 --2- 172.21.15.53:0/624531946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5ee1b0 0x55c14b9bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53c4b64640 1 --2- 172.21.15.53:0/624531946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b5f6390 0x55c14b9bcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53c5b66640 1 -- 172.21.15.53:0/624531946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b5f6390 msgr2=0x55c14b9bcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53c5b66640 1 --2- 172.21.15.53:0/624531946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b5f6390 0x55c14b9bcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53c5b66640 1 -- 172.21.15.53:0/624531946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5ee1b0 msgr2=0x55c14b9bc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53c5b66640 1 --2- 172.21.15.53:0/624531946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5ee1b0 0x55c14b9bc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53c5b66640 1 -- 172.21.15.53:0/624531946 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14b682650 con 0x55c14b617070 2024-08-31T06:26:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53b67fc640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f53ac0b4ca0 0x7f53ac0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.437+0000 7f53c5b66640 1 --2- 172.21.15.53:0/624531946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b617070 0x55c14b9bc310 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f53b800ae90 tx=0x7f53b800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3524214b597bfc22 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.438+0000 7f53c5365640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f53ac0b4ca0 0x7f53ac0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.438+0000 7f53ab7fe640 1 -- 172.21.15.53:0/624531946 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8003b70 con 0x55c14b617070 2024-08-31T06:26:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.438+0000 7f53ab7fe640 1 -- 172.21.15.53:0/624531946 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53b8003d10 con 0x55c14b617070 2024-08-31T06:26:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.438+0000 7f53ab7fe640 1 -- 172.21.15.53:0/624531946 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8010a60 con 0x55c14b617070 2024-08-31T06:26:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.438+0000 7f53b67fc640 1 -- 172.21.15.53:0/2131116350 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f53bc0e4b30 con 0x7f53c0103900 2024-08-31T06:26:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53cdb3e740 1 -- 172.21.15.53:0/624531946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b617070 msgr2=0x55c14b9bc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/624531946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b617070 0x55c14b9bc310 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f53b800ae90 tx=0x7f53b800f790 comp rx=0 tx=0).stop 2024-08-31T06:26:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53c5365640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f53ac0b4ca0 0x7f53ac0b71b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0e2310 tx=0x7f53bc0e8680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53cdb3e740 1 -- 172.21.15.53:0/624531946 shutdown_connections 2024-08-31T06:26:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/624531946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b5f6390 0x55c14b9bcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/624531946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5ee1b0 0x55c14b9bc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/624531946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b617070 0x55c14b9bc310 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53cdb3e740 1 -- 172.21.15.53:0/624531946 >> 172.21.15.53:0/624531946 conn(0x55c14b60b460 msgr2=0x55c14b9ba200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53cdb3e740 1 -- 172.21.15.53:0/624531946 shutdown_connections 2024-08-31T06:26:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53cdb3e740 1 -- 172.21.15.53:0/624531946 wait complete. 2024-08-31T06:26:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53cdb3e740 1 -- start start 2024-08-31T06:26:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.439+0000 7f53cdb3e740 1 Processor -- start 2024-08-31T06:26:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5ee1b0 0x55c14b9c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5f6390 0x55c14b9c8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 0x55c14b9d81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c14b785700 con 0x55c14b5f6390 2024-08-31T06:26:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c14b8a9750 con 0x55c14b5ee1b0 2024-08-31T06:26:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c14b9cef00 con 0x55c14b617070 2024-08-31T06:26:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53cdb3e740 10 client.0 _ll_register_callbacks cb 0x55c14b8d8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c4b64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5f6390 0x55c14b9c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c4b64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5f6390 0x55c14b9c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44290/0 (socket says 172.21.15.53:44290) 2024-08-31T06:26:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c4b64640 1 -- 172.21.15.53:0/3795055543 learned_addr learned my addr 172.21.15.53:0/3795055543 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c5b66640 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5ee1b0 0x55c14b9c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c5b66640 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 0x55c14b9d81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c4b64640 1 -- 172.21.15.53:0/3795055543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 msgr2=0x55c14b9d81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c4b64640 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 0x55c14b9d81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c4b64640 1 -- 172.21.15.53:0/3795055543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5ee1b0 msgr2=0x55c14b9c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c4b64640 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5ee1b0 0x55c14b9c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c4b64640 1 -- 172.21.15.53:0/3795055543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14b8e2900 con 0x55c14b5f6390 2024-08-31T06:26:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c5b66640 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 0x55c14b9d81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:26:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53c4b64640 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5f6390 0x55c14b9c8030 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f53b0000c00 tx=0x7f53b0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f21ca0eea2bcf93 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.440+0000 7f53a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.441+0000 7f53a8ff9640 1 -- 172.21.15.53:0/3795055543 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0035030 con 0x55c14b5f6390 2024-08-31T06:26:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.441+0000 7f53a8ff9640 1 -- 172.21.15.53:0/3795055543 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f53b0004040 con 0x55c14b5f6390 2024-08-31T06:26:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.441+0000 7f53cdb3e740 1 -- 172.21.15.53:0/3795055543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53b8003d10 con 0x55c14b5f6390 2024-08-31T06:26:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.441+0000 7f53a8ff9640 1 -- 172.21.15.53:0/3795055543 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f53b0004240 con 0x55c14b5f6390 2024-08-31T06:26:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.441+0000 7f53cdb3e740 10 client.22101 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.441+0000 7f53cdb3e740 1 -- 172.21.15.53:0/3795055543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x55c14b9dad00 con 0x55c14b5f6390 2024-08-31T06:26:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.441+0000 7f53a8ff9640 1 -- 172.21.15.53:0/3795055543 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53b8003d10 con 0x55c14b5f6390 2024-08-31T06:26:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.442+0000 7f53a8ff9640 1 -- 172.21.15.53:0/3795055543 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f53b003c4d0 con 0x55c14b5f6390 2024-08-31T06:26:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.442+0000 7f53cdb3e740 10 client.22101 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.442+0000 7f53cdb3e740 10 client.22101 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:26:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.442+0000 7f53cdb3e740 20 client.22101 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.442+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c14b5d59f0 0x55c14b9de240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.442+0000 7f53cdb3e740 4 client.22101 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.442+0000 7f53cdb3e740 1 -- 172.21.15.53:0/3795055543 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c14b9355d0 con 0x55c14b5d59f0 2024-08-31T06:26:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.442+0000 7f53c5b66640 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c14b5d59f0 0x55c14b9de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.443+0000 7f53c5b66640 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c14b5d59f0 0x55c14b9de240 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ba02e88d41da6d65 server_cookie=38cf8b1fa03054d3 in_seq=0 out_seq=0 2024-08-31T06:26:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.443+0000 7f53a8ff9640 10 client.22101 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:26:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.443+0000 7f53a8ff9640 1 -- 172.21.15.53:0/3795055543 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c14b9355d0 con 0x55c14b5d59f0 2024-08-31T06:26:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53a8ff9640 10 client.22101 handle_command_reply: tid=0 2024-08-31T06:26:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 1 client.22101 shutdown 2024-08-31T06:26:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 1 -- 172.21.15.53:0/3795055543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5f6390 msgr2=0x55c14b9c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5f6390 0x55c14b9c8030 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f53b0000c00 tx=0x7f53b0031400 comp rx=0 tx=0).stop 2024-08-31T06:26:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 1 -- 172.21.15.53:0/3795055543 shutdown_connections 2024-08-31T06:26:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c14b5d59f0 0x55c14b9de240 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 0x55c14b9d81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5f6390 0x55c14b9c8030 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53a8ff9640 0 client.22101 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:26:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/3795055543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5ee1b0 0x55c14b9c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 1 -- 172.21.15.53:0/3795055543 >> 172.21.15.53:0/3795055543 conn(0x55c14b60b460 msgr2=0x55c14b9bf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 1 -- 172.21.15.53:0/3795055543 shutdown_connections 2024-08-31T06:26:44.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 1 -- 172.21.15.53:0/3795055543 wait complete. 2024-08-31T06:26:44.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.444+0000 7f53cdb3e740 20 client.22101 trim_cache size 0 max 16384 2024-08-31T06:26:44.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.457+0000 7f53cdb3e740 1 Processor -- start 2024-08-31T06:26:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.457+0000 7f53cdb3e740 1 -- start start 2024-08-31T06:26:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9bfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5f6390 0x55c14b9c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 0x55c14b9c5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f53c01ad4a0 con 0x55c14b5ee1b0 2024-08-31T06:26:44.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53c01af2e0 con 0x55c14b5f6390 2024-08-31T06:26:44.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f53c01adc30 con 0x55c14b617070 2024-08-31T06:26:44.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53c5b66640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9bfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53c5b66640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9bfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44300/0 (socket says 172.21.15.53:44300) 2024-08-31T06:26:44.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53c5b66640 1 -- 172.21.15.53:0/2779145544 learned_addr learned my addr 172.21.15.53:0/2779145544 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:44.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53c5b66640 1 -- 172.21.15.53:0/2779145544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 msgr2=0x55c14b9c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:44.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53c5b66640 1 --2- 172.21.15.53:0/2779145544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 0x55c14b9c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53c5b66640 1 -- 172.21.15.53:0/2779145544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5f6390 msgr2=0x55c14b9c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:44.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53c5b66640 1 --2- 172.21.15.53:0/2779145544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5f6390 0x55c14b9c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53c5b66640 1 -- 172.21.15.53:0/2779145544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14b9ca620 con 0x55c14b5ee1b0 2024-08-31T06:26:44.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53c5b66640 1 --2- 172.21.15.53:0/2779145544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9bfb20 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f53b80106d0 tx=0x7f53b8005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5275319bce448646 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:44.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53aaffd640 1 -- 172.21.15.53:0/2779145544 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b800a8d0 con 0x55c14b5ee1b0 2024-08-31T06:26:44.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53aaffd640 1 -- 172.21.15.53:0/2779145544 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53b8010770 con 0x55c14b5ee1b0 2024-08-31T06:26:44.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.458+0000 7f53aaffd640 1 -- 172.21.15.53:0/2779145544 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8005280 con 0x55c14b5ee1b0 2024-08-31T06:26:44.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.459+0000 7f53cdb3e740 1 -- 172.21.15.53:0/2779145544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 msgr2=0x55c14b9bfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:44.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.459+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/2779145544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9bfb20 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f53b80106d0 tx=0x7f53b8005c50 comp rx=0 tx=0).stop 2024-08-31T06:26:44.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.459+0000 7f53cdb3e740 1 -- 172.21.15.53:0/2779145544 shutdown_connections 2024-08-31T06:26:44.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.459+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/2779145544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 0x55c14b9c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.459+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/2779145544 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5f6390 0x55c14b9c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.459+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/2779145544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9bfb20 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.459+0000 7f53cdb3e740 1 -- 172.21.15.53:0/2779145544 >> 172.21.15.53:0/2779145544 conn(0x55c14b60b460 msgr2=0x55c14b9bf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:44.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.459+0000 7f53cdb3e740 1 -- 172.21.15.53:0/2779145544 shutdown_connections 2024-08-31T06:26:44.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.459+0000 7f53cdb3e740 1 -- 172.21.15.53:0/2779145544 wait complete. 2024-08-31T06:26:44.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53cdb3e740 1 -- start start 2024-08-31T06:26:44.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53cdb3e740 1 Processor -- start 2024-08-31T06:26:44.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9d4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5f6390 0x55c14b9d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53cdb3e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 0x55c14b9d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f53c01aeb50 con 0x55c14b5ee1b0 2024-08-31T06:26:44.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53c01ae3c0 con 0x55c14b5f6390 2024-08-31T06:26:44.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53cdb3e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f53c01ab4a0 con 0x55c14b617070 2024-08-31T06:26:44.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53cdb3e740 10 client.0 _ll_register_callbacks cb 0x7f53b0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:44.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53c5b66640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9d4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53c5b66640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9d4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44308/0 (socket says 172.21.15.53:44308) 2024-08-31T06:26:44.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53c5b66640 1 -- 172.21.15.53:0/4057353274 learned_addr learned my addr 172.21.15.53:0/4057353274 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:44.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.460+0000 7f53c4b64640 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5f6390 0x55c14b9d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53c5b66640 1 -- 172.21.15.53:0/4057353274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 msgr2=0x55c14b9d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:44.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53c5b66640 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 0x55c14b9d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53c5b66640 1 -- 172.21.15.53:0/4057353274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5f6390 msgr2=0x55c14b9d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:44.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53c5b66640 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5f6390 0x55c14b9d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53c5b66640 1 -- 172.21.15.53:0/4057353274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14b9beb20 con 0x55c14b5ee1b0 2024-08-31T06:26:44.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53c5b66640 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9d4780 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f53b800ac20 tx=0x7f53b8004bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b915cb79a77b597 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:44.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:44.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53a8ff9640 1 -- 172.21.15.53:0/4057353274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8010920 con 0x55c14b5ee1b0 2024-08-31T06:26:44.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53a8ff9640 1 -- 172.21.15.53:0/4057353274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f53b8010ac0 con 0x55c14b5ee1b0 2024-08-31T06:26:44.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53cdb3e740 1 -- 172.21.15.53:0/4057353274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53b8010770 con 0x55c14b5ee1b0 2024-08-31T06:26:44.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53a8ff9640 1 -- 172.21.15.53:0/4057353274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f53b8004f70 con 0x55c14b5ee1b0 2024-08-31T06:26:44.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53cdb3e740 10 client.22107 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:44.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53cdb3e740 1 -- 172.21.15.53:0/4057353274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x55c14ba49810 con 0x55c14b5ee1b0 2024-08-31T06:26:44.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.461+0000 7f53a8ff9640 1 -- 172.21.15.53:0/4057353274 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53b8010770 con 0x55c14b5ee1b0 2024-08-31T06:26:44.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53a8ff9640 1 -- 172.21.15.53:0/4057353274 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f53b8023040 con 0x55c14b5ee1b0 2024-08-31T06:26:44.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53cdb3e740 10 client.22107 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:44.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53cdb3e740 10 client.22107 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:26:44.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53cdb3e740 20 client.22107 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:44.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c14b5aada0 0x55c14ba4be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:44.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53cdb3e740 4 client.22107 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:26:44.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53cdb3e740 1 -- 172.21.15.53:0/4057353274 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c14b931070 con 0x55c14b5aada0 2024-08-31T06:26:44.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53c4b64640 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c14b5aada0 0x55c14ba4be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:44.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53c4b64640 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c14b5aada0 0x55c14ba4be00 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7de35ac03b2a8685 server_cookie=98eb48bd9a3e67ad in_seq=0 out_seq=0 2024-08-31T06:26:44.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53a8ff9640 10 client.22107 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:26:44.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53a8ff9640 1 -- 172.21.15.53:0/4057353274 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c14b931070 con 0x55c14b5aada0 2024-08-31T06:26:44.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.462+0000 7f53a8ff9640 10 client.22107 handle_command_reply: tid=0 2024-08-31T06:26:44.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 1 client.22107 shutdown 2024-08-31T06:26:44.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 1 -- 172.21.15.53:0/4057353274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 msgr2=0x55c14b9d4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:44.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9d4780 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f53b800ac20 tx=0x7f53b8004bf0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 1 -- 172.21.15.53:0/4057353274 shutdown_connections 2024-08-31T06:26:44.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55c14b5aada0 0x55c14ba4be00 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c14b617070 0x55c14b9d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c14b5f6390 0x55c14b9d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 1 --2- 172.21.15.53:0/4057353274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c14b5ee1b0 0x55c14b9d4780 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 1 -- 172.21.15.53:0/4057353274 >> 172.21.15.53:0/4057353274 conn(0x55c14b60b460 msgr2=0x55c14b9bd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:44.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53a8ff9640 0 client.22107 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:26:44.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 1 -- 172.21.15.53:0/4057353274 shutdown_connections 2024-08-31T06:26:44.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 1 -- 172.21.15.53:0/4057353274 wait complete. 2024-08-31T06:26:44.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53cdb3e740 20 client.22107 trim_cache size 0 max 16384 2024-08-31T06:26:44.490 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:26:44.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53c75c9640 1 -- 172.21.15.53:0/2131116350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f53ac0b4ca0 msgr2=0x7f53ac0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:44.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53c75c9640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f53ac0b4ca0 0x7f53ac0b71b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0e2310 tx=0x7f53bc0e8680 comp rx=0 tx=0).stop 2024-08-31T06:26:44.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53c75c9640 1 -- 172.21.15.53:0/2131116350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53c0103900 msgr2=0x7f53c019a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:44.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.463+0000 7f53c75c9640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53c0103900 0x7f53c019a1f0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00b4a0 tx=0x7f53bc00b960 comp rx=0 tx=0).stop 2024-08-31T06:26:44.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.464+0000 7f53c75c9640 1 -- 172.21.15.53:0/2131116350 shutdown_connections 2024-08-31T06:26:44.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.464+0000 7f53c75c9640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f53ac0b4ca0 0x7f53ac0b71b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.464+0000 7f53c75c9640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53c0109b90 0x7f53c019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.464+0000 7f53c75c9640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0109240 0x7f53c019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.464+0000 7f53c75c9640 1 --2- 172.21.15.53:0/2131116350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53c0103900 0x7f53c019a1f0 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:44.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.464+0000 7f53c75c9640 1 -- 172.21.15.53:0/2131116350 >> 172.21.15.53:0/2131116350 conn(0x7f53c007b5f0 msgr2=0x7f53c0107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:44.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.464+0000 7f53c75c9640 1 -- 172.21.15.53:0/2131116350 shutdown_connections 2024-08-31T06:26:44.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:44.464+0000 7f53c75c9640 1 -- 172.21.15.53:0/2131116350 wait complete. 2024-08-31T06:26:44.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:44 smithi130 ceph-mon[22266]: pgmap v1008: 97 pgs: 97 active+clean; 886 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2024-08-31T06:26:44.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:44 smithi153 ceph-mon[22320]: pgmap v1008: 97 pgs: 97 active+clean; 886 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2024-08-31T06:26:45.228 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:26:45.388 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.70 MB/sec execute 393 sec latency 7552.070 ms 2024-08-31T06:26:45.483 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:45.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.972+0000 7fc0a6efa640 1 -- 172.21.15.53:0/4128769295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a0109240 msgr2=0x7fc0a0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.972+0000 7fc0a6efa640 1 --2- 172.21.15.53:0/4128769295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a0109240 0x7fc0a0109650 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fc094009ca0 tx=0x7fc09402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.972+0000 7fc0a6efa640 1 -- 172.21.15.53:0/4128769295 shutdown_connections 2024-08-31T06:26:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.972+0000 7fc0a6efa640 1 --2- 172.21.15.53:0/4128769295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a0109b90 0x7fc0a01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.972+0000 7fc0a6efa640 1 --2- 172.21.15.53:0/4128769295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a0109240 0x7fc0a0109650 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.972+0000 7fc0a6efa640 1 --2- 172.21.15.53:0/4128769295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a0103900 0x7fc0a0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.972+0000 7fc0a6efa640 1 -- 172.21.15.53:0/4128769295 >> 172.21.15.53:0/4128769295 conn(0x7fc0a007b5f0 msgr2=0x7fc0a007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.972+0000 7fc0a6efa640 1 -- 172.21.15.53:0/4128769295 shutdown_connections 2024-08-31T06:26:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.972+0000 7fc0a6efa640 1 -- 172.21.15.53:0/4128769295 wait complete. 2024-08-31T06:26:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.972+0000 7fc0a6efa640 1 Processor -- start 2024-08-31T06:26:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.972+0000 7fc0a6efa640 1 -- start start 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a6efa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a0103900 0x7fc0a019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a6efa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a0109240 0x7fc0a019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a6efa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a0109b90 0x7fc0a019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a6efa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a0113750 con 0x7fc0a0103900 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a6efa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a01135d0 con 0x7fc0a0109240 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a6efa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a01138d0 con 0x7fc0a0109b90 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a4c96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a0103900 0x7fc0a019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a4c96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a0103900 0x7fc0a019a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44334/0 (socket says 172.21.15.53:44334) 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a4c96640 1 -- 172.21.15.53:0/179004268 learned_addr learned my addr 172.21.15.53:0/179004268 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc09ffff640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a0109240 0x7fc0a019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a5497640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a0109b90 0x7fc0a019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a4c96640 1 -- 172.21.15.53:0/179004268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a0109b90 msgr2=0x7fc0a019f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a0109b90 0x7fc0a019f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a4c96640 1 -- 172.21.15.53:0/179004268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a0109240 msgr2=0x7fc0a019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a0109240 0x7fc0a019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a4c96640 1 -- 172.21.15.53:0/179004268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a01a00f0 con 0x7fc0a0103900 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc09ffff640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a0109240 0x7fc0a019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a5497640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a0109b90 0x7fc0a019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.973+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a0103900 0x7fc0a019a180 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fc09000d950 tx=0x7fc09000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.974+0000 7fc09dffb640 1 -- 172.21.15.53:0/179004268 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc090017070 con 0x7fc0a0103900 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.974+0000 7fc0a6efa640 1 -- 172.21.15.53:0/179004268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a01a03e0 con 0x7fc0a0103900 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.974+0000 7fc09dffb640 1 -- 172.21.15.53:0/179004268 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc090009c30 con 0x7fc0a0103900 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.974+0000 7fc09dffb640 1 -- 172.21.15.53:0/179004268 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09000f620 con 0x7fc0a0103900 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.974+0000 7fc0a6efa640 1 -- 172.21.15.53:0/179004268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a01a6b40 con 0x7fc0a0103900 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.976+0000 7fc09dffb640 1 -- 172.21.15.53:0/179004268 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc090010460 con 0x7fc0a0103900 2024-08-31T06:26:45.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.976+0000 7fc0ad46f740 1 Processor -- start 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc0ad46f740 1 -- start start 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad6899070 0x558ad6c3e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68701b0 0x558ad6c3e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6c3ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ad6bb5680 con 0x558ad6878390 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558ad6ba4c10 con 0x558ad6899070 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558ad6ba8bc0 con 0x558ad68701b0 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc09ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6c3ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc09ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6c3ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44342/0 (socket says 172.21.15.53:44342) 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc09ffff640 1 -- 172.21.15.53:0/2702434011 learned_addr learned my addr 172.21.15.53:0/2702434011 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc0a5497640 1 --2- 172.21.15.53:0/2702434011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad6899070 0x558ad6c3e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/2702434011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68701b0 0x558ad6c3e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:45.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc09ffff640 1 -- 172.21.15.53:0/2702434011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68701b0 msgr2=0x558ad6c3e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc09ffff640 1 --2- 172.21.15.53:0/2702434011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68701b0 0x558ad6c3e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc09ffff640 1 -- 172.21.15.53:0/2702434011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad6899070 msgr2=0x558ad6c3e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc09ffff640 1 --2- 172.21.15.53:0/2702434011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad6899070 0x558ad6c3e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc09dffb640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0880b4ca0 0x7fc0880b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc09ffff640 1 -- 172.21.15.53:0/2702434011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ad6904650 con 0x558ad6878390 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.977+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/2702434011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68701b0 0x558ad6c3e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.978+0000 7fc0a5497640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0880b4ca0 0x7fc0880b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.978+0000 7fc09ffff640 1 --2- 172.21.15.53:0/2702434011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6c3ed90 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fc0a006c790 tx=0x7fc094009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec311f0b693f10f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.978+0000 7fc09dffb640 1 -- 172.21.15.53:0/179004268 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fc0900e5260 con 0x7fc0a0103900 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.978+0000 7fc086ffd640 1 -- 172.21.15.53:0/2702434011 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094031980 con 0x558ad6878390 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.978+0000 7fc086ffd640 1 -- 172.21.15.53:0/2702434011 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc094036040 con 0x558ad6878390 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.978+0000 7fc086ffd640 1 -- 172.21.15.53:0/2702434011 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094004420 con 0x558ad6878390 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2702434011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 msgr2=0x558ad6c3ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:45.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0a5497640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0880b4ca0 0x7fc0880b71b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc09800bd60 tx=0x7fc09800b550 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/2702434011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6c3ed90 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fc0a006c790 tx=0x7fc094009a20 comp rx=0 tx=0).stop 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2702434011 shutdown_connections 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/2702434011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6c3ed90 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/2702434011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68701b0 0x558ad6c3e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/2702434011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad6899070 0x558ad6c3e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2702434011 >> 172.21.15.53:0/2702434011 conn(0x558ad688d460 msgr2=0x558ad6c3c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2702434011 shutdown_connections 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2702434011 wait complete. 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0ad46f740 1 -- start start 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.979+0000 7fc0ad46f740 1 Processor -- start 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad68701b0 0x558ad6c49b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:45.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad6878390 0x558ad6c4a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6899070 0x558ad6c5a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ad6a07700 con 0x558ad6899070 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558ad6b2b750 con 0x558ad68701b0 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558ad6c50ea0 con 0x558ad6878390 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0ad46f740 10 client.0 _ll_register_callbacks cb 0x558ad6b5ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0a5497640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6899070 0x558ad6c5a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0a5497640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6899070 0x558ad6c5a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44348/0 (socket says 172.21.15.53:44348) 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0a5497640 1 -- 172.21.15.53:0/2321988874 learned_addr learned my addr 172.21.15.53:0/2321988874 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc09ffff640 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad6878390 0x558ad6c4a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad68701b0 0x558ad6c49b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0a5497640 1 -- 172.21.15.53:0/2321988874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad6878390 msgr2=0x558ad6c4a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:45.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0a5497640 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad6878390 0x558ad6c4a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0a5497640 1 -- 172.21.15.53:0/2321988874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad68701b0 msgr2=0x558ad6c49b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0a5497640 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad68701b0 0x558ad6c49b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0a5497640 1 -- 172.21.15.53:0/2321988874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ad6b64900 con 0x558ad6899070 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.980+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad68701b0 0x558ad6c49b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc0a5497640 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6899070 0x558ad6c5a110 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fc098013fd0 tx=0x7fc0980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50dbb95bcfbc5b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc07ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc07ffff640 1 -- 172.21.15.53:0/2321988874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098029680 con 0x558ad6899070 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc07ffff640 1 -- 172.21.15.53:0/2321988874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fc098029820 con 0x558ad6899070 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2321988874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc094036040 con 0x558ad6899070 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc07ffff640 1 -- 172.21.15.53:0/2321988874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fc098029a20 con 0x558ad6899070 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc0ad46f740 10 client.22119 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:45.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2321988874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x558ad6c5cd10 con 0x558ad6899070 2024-08-31T06:26:45.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc07ffff640 1 -- 172.21.15.53:0/2321988874 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc094036040 con 0x558ad6899070 2024-08-31T06:26:45.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc07ffff640 1 -- 172.21.15.53:0/2321988874 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7fc09801eca0 con 0x558ad6899070 2024-08-31T06:26:45.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc0ad46f740 10 client.22119 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:45.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc0ad46f740 10 client.22119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:45.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc0ad46f740 20 client.22119 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:45.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ad68579f0 0x558ad6c60340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:45.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc0ad46f740 4 client.22119 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:45.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.981+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2321988874 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ad6bb75d0 con 0x558ad68579f0 2024-08-31T06:26:45.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.982+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ad68579f0 0x558ad6c60340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.982+0000 7fc07ffff640 10 client.22119 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.982+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ad68579f0 0x558ad6c60340 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db13834ccfd7cc77 server_cookie=db508ebd9e57ee60 in_seq=0 out_seq=0 2024-08-31T06:26:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc07ffff640 1 -- 172.21.15.53:0/2321988874 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ad6bb75d0 con 0x558ad68579f0 2024-08-31T06:26:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc07ffff640 10 client.22119 handle_command_reply: tid=0 2024-08-31T06:26:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc0ad46f740 1 client.22119 shutdown 2024-08-31T06:26:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2321988874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6899070 msgr2=0x558ad6c5a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6899070 0x558ad6c5a110 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fc098013fd0 tx=0x7fc0980046c0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2321988874 shutdown_connections 2024-08-31T06:26:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ad68579f0 0x558ad6c60340 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc07ffff640 0 client.22119 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:45.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6899070 0x558ad6c5a110 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad6878390 0x558ad6c4a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/2321988874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad68701b0 0x558ad6c49b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:45.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2321988874 >> 172.21.15.53:0/2321988874 conn(0x558ad688d460 msgr2=0x558ad6c414f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:45.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2321988874 shutdown_connections 2024-08-31T06:26:45.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.983+0000 7fc0ad46f740 1 -- 172.21.15.53:0/2321988874 wait complete. 2024-08-31T06:26:45.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.984+0000 7fc0ad46f740 20 client.22119 trim_cache size 0 max 16384 2024-08-31T06:26:45.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0ad46f740 1 Processor -- start 2024-08-31T06:26:46.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0ad46f740 1 -- start start 2024-08-31T06:26:46.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad68579f0 0x558ad6c41410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68701b0 0x558ad6c41950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad6878390 0x558ad6c46d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a01ad310 con 0x558ad68579f0 2024-08-31T06:26:46.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a01af150 con 0x558ad6878390 2024-08-31T06:26:46.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a01adaa0 con 0x558ad68701b0 2024-08-31T06:26:46.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0a4c96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad68579f0 0x558ad6c41410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0a4c96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad68579f0 0x558ad6c41410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44358/0 (socket says 172.21.15.53:44358) 2024-08-31T06:26:46.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0a4c96640 1 -- 172.21.15.53:0/1537596558 learned_addr learned my addr 172.21.15.53:0/1537596558 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:46.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0a5497640 1 --2- 172.21.15.53:0/1537596558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad6878390 0x558ad6c46d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc09ffff640 1 --2- 172.21.15.53:0/1537596558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68701b0 0x558ad6c41950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0a4c96640 1 -- 172.21.15.53:0/1537596558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68701b0 msgr2=0x558ad6c41950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/1537596558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68701b0 0x558ad6c41950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0a4c96640 1 -- 172.21.15.53:0/1537596558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad6878390 msgr2=0x558ad6c46d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/1537596558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad6878390 0x558ad6c46d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.997+0000 7fc0a4c96640 1 -- 172.21.15.53:0/1537596558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ad6c41170 con 0x558ad68579f0 2024-08-31T06:26:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.998+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/1537596558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad68579f0 0x558ad6c41410 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fc0900058c0 tx=0x7fc0900e89c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f66c25e093bc92 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.998+0000 7fc0867fc640 1 -- 172.21.15.53:0/1537596558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc090020040 con 0x558ad68579f0 2024-08-31T06:26:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.998+0000 7fc0867fc640 1 -- 172.21.15.53:0/1537596558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0900ab440 con 0x558ad68579f0 2024-08-31T06:26:46.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.998+0000 7fc0867fc640 1 -- 172.21.15.53:0/1537596558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0900b4c50 con 0x558ad68579f0 2024-08-31T06:26:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.999+0000 7fc0ad46f740 1 -- 172.21.15.53:0/1537596558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad68579f0 msgr2=0x558ad6c41410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.999+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/1537596558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad68579f0 0x558ad6c41410 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fc0900058c0 tx=0x7fc0900e89c0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.999+0000 7fc0ad46f740 1 -- 172.21.15.53:0/1537596558 shutdown_connections 2024-08-31T06:26:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.999+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/1537596558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad6878390 0x558ad6c46d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.999+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/1537596558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68701b0 0x558ad6c41950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.999+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/1537596558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad68579f0 0x558ad6c41410 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.999+0000 7fc0ad46f740 1 -- 172.21.15.53:0/1537596558 >> 172.21.15.53:0/1537596558 conn(0x558ad688d460 msgr2=0x558ad6c483c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.999+0000 7fc0ad46f740 1 -- 172.21.15.53:0/1537596558 shutdown_connections 2024-08-31T06:26:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.999+0000 7fc0ad46f740 1 -- 172.21.15.53:0/1537596558 wait complete. 2024-08-31T06:26:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.999+0000 7fc0ad46f740 1 -- start start 2024-08-31T06:26:46.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:45.999+0000 7fc0ad46f740 1 Processor -- start 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68579f0 0x558ad6c52a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad68701b0 0x558ad6c53010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0ad46f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6cc3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a01ae9c0 con 0x558ad6878390 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a01ae230 con 0x558ad68701b0 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0ad46f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a01ab310 con 0x558ad68579f0 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0ad46f740 10 client.0 _ll_register_callbacks cb 0x7fc09800bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0a5497640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6cc3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0a5497640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6cc3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44362/0 (socket says 172.21.15.53:44362) 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0a5497640 1 -- 172.21.15.53:0/696486593 learned_addr learned my addr 172.21.15.53:0/696486593 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68579f0 0x558ad6c52a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc09ffff640 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad68701b0 0x558ad6c53010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0a5497640 1 -- 172.21.15.53:0/696486593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68579f0 msgr2=0x558ad6c52a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0a5497640 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68579f0 0x558ad6c52a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0a5497640 1 -- 172.21.15.53:0/696486593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad68701b0 msgr2=0x558ad6c53010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0a5497640 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad68701b0 0x558ad6c53010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0a5497640 1 -- 172.21.15.53:0/696486593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ad6cc4340 con 0x558ad6878390 2024-08-31T06:26:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc0a5497640 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6cc3cd0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fc09801b460 tx=0x7fc098012e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae64acbbed870a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.000+0000 7fc07ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc07ffff640 1 -- 172.21.15.53:0/696486593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098035070 con 0x558ad6878390 2024-08-31T06:26:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc07ffff640 1 -- 172.21.15.53:0/696486593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fc098005040 con 0x558ad6878390 2024-08-31T06:26:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc0ad46f740 1 -- 172.21.15.53:0/696486593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0900ab440 con 0x558ad6878390 2024-08-31T06:26:46.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc07ffff640 1 -- 172.21.15.53:0/696486593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fc098005240 con 0x558ad6878390 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc0ad46f740 10 client.22125 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc0ad46f740 1 -- 172.21.15.53:0/696486593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x558ad6ccb710 con 0x558ad6878390 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc07ffff640 1 -- 172.21.15.53:0/696486593 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0900ab440 con 0x558ad6878390 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc07ffff640 1 -- 172.21.15.53:0/696486593 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7fc09801b680 con 0x558ad6878390 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc0ad46f740 10 client.22125 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc0ad46f740 10 client.22125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc0ad46f740 20 client.22125 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ad6899070 0x558ad6ccdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc0ad46f740 4 client.22125 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.001+0000 7fc0ad46f740 1 -- 172.21.15.53:0/696486593 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558ad6bb3070 con 0x558ad6899070 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ad6899070 0x558ad6ccdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc0a4c96640 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ad6899070 0x558ad6ccdf60 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc014af7021172 server_cookie=9a5027ad9f7bec21 in_seq=0 out_seq=0 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc07ffff640 10 client.22125 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc07ffff640 1 -- 172.21.15.53:0/696486593 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558ad6bb3070 con 0x558ad6899070 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc07ffff640 10 client.22125 handle_command_reply: tid=0 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc0ad46f740 1 client.22125 shutdown 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc0ad46f740 1 -- 172.21.15.53:0/696486593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 msgr2=0x558ad6cc3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6cc3cd0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fc09801b460 tx=0x7fc098012e20 comp rx=0 tx=0).stop 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc0ad46f740 1 -- 172.21.15.53:0/696486593 shutdown_connections 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558ad6899070 0x558ad6ccdf60 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad6878390 0x558ad6cc3cd0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558ad68701b0 0x558ad6c53010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc07ffff640 0 client.22125 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc0ad46f740 1 --2- 172.21.15.53:0/696486593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ad68579f0 0x558ad6c52a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.002+0000 7fc0ad46f740 1 -- 172.21.15.53:0/696486593 >> 172.21.15.53:0/696486593 conn(0x558ad688d460 msgr2=0x558ad6c41410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:46.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0ad46f740 1 -- 172.21.15.53:0/696486593 shutdown_connections 2024-08-31T06:26:46.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0ad46f740 1 -- 172.21.15.53:0/696486593 wait complete. 2024-08-31T06:26:46.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0ad46f740 20 client.22125 trim_cache size 0 max 16384 2024-08-31T06:26:46.010 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:26:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 -- 172.21.15.53:0/179004268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0880b4ca0 msgr2=0x7fc0880b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0880b4ca0 0x7fc0880b71b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc09800bd60 tx=0x7fc09800b550 comp rx=0 tx=0).stop 2024-08-31T06:26:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 -- 172.21.15.53:0/179004268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a0103900 msgr2=0x7fc0a019a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a0103900 0x7fc0a019a180 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fc09000d950 tx=0x7fc09000de10 comp rx=0 tx=0).stop 2024-08-31T06:26:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 -- 172.21.15.53:0/179004268 shutdown_connections 2024-08-31T06:26:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0880b4ca0 0x7fc0880b71b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a0109b90 0x7fc0a019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a0109240 0x7fc0a019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 --2- 172.21.15.53:0/179004268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a0103900 0x7fc0a019a180 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 -- 172.21.15.53:0/179004268 >> 172.21.15.53:0/179004268 conn(0x7fc0a007b5f0 msgr2=0x7fc0a0107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 -- 172.21.15.53:0/179004268 shutdown_connections 2024-08-31T06:26:46.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:46.003+0000 7fc0a6efa640 1 -- 172.21.15.53:0/179004268 wait complete. 2024-08-31T06:26:46.388 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.69 MB/sec execute 394 sec latency 8552.163 ms 2024-08-31T06:26:46.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:46 smithi130 ceph-mon[22266]: pgmap v1009: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 274 op/s 2024-08-31T06:26:46.642 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:46 smithi053 ceph-mon[18924]: pgmap v1009: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 274 op/s 2024-08-31T06:26:46.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:46 smithi153 ceph-mon[22320]: pgmap v1009: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 274 op/s 2024-08-31T06:26:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.737+0000 7efd30cd3640 1 -- 172.21.15.53:0/2010483878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd2c102f10 msgr2=0x7efd2c103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.737+0000 7efd30cd3640 1 --2- 172.21.15.53:0/2010483878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd2c102f10 0x7efd2c103320 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009900 tx=0x7efd1c02a410 comp rx=0 tx=0).stop 2024-08-31T06:26:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.737+0000 7efd30cd3640 1 -- 172.21.15.53:0/2010483878 shutdown_connections 2024-08-31T06:26:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.737+0000 7efd30cd3640 1 --2- 172.21.15.53:0/2010483878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd2c108a20 0x7efd2c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.737+0000 7efd30cd3640 1 --2- 172.21.15.53:0/2010483878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1080d0 0x7efd2c1084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.737+0000 7efd30cd3640 1 --2- 172.21.15.53:0/2010483878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd2c102f10 0x7efd2c103320 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.737+0000 7efd30cd3640 1 -- 172.21.15.53:0/2010483878 >> 172.21.15.53:0/2010483878 conn(0x7efd2c079c30 msgr2=0x7efd2c07a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.737+0000 7efd30cd3640 1 -- 172.21.15.53:0/2010483878 shutdown_connections 2024-08-31T06:26:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.737+0000 7efd30cd3640 1 -- 172.21.15.53:0/2010483878 wait complete. 2024-08-31T06:26:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.738+0000 7efd30cd3640 1 Processor -- start 2024-08-31T06:26:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.738+0000 7efd30cd3640 1 -- start start 2024-08-31T06:26:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd30cd3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd2c102f10 0x7efd2c199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd30cd3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1080d0 0x7efd2c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd30cd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd2c108a20 0x7efd2c19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd30cd3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1125a0 con 0x7efd2c108a20 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd30cd3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c112420 con 0x7efd2c102f10 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd30cd3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c112720 con 0x7efd2c1080d0 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd2ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd2c108a20 0x7efd2c19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd29d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1080d0 0x7efd2c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd2a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd2c102f10 0x7efd2c199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd29d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1080d0 0x7efd2c1996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:48762/0 (socket says 172.21.15.53:48762) 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd2a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd2c102f10 0x7efd2c199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60910/0 (socket says 172.21.15.53:60910) 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd29d9b640 1 -- 172.21.15.53:0/2397900508 learned_addr learned my addr 172.21.15.53:0/2397900508 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd29d9b640 1 -- 172.21.15.53:0/2397900508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd2c102f10 msgr2=0x7efd2c199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd29d9b640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd2c102f10 0x7efd2c199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd29d9b640 1 -- 172.21.15.53:0/2397900508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd2c108a20 msgr2=0x7efd2c19e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd29d9b640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd2c108a20 0x7efd2c19e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd29d9b640 1 -- 172.21.15.53:0/2397900508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c19f030 con 0x7efd2c1080d0 2024-08-31T06:26:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd2ad9d640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd2c108a20 0x7efd2c19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.739+0000 7efd2a59c640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd2c102f10 0x7efd2c199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:26:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.740+0000 7efd29d9b640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1080d0 0x7efd2c1996a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efd2000d750 tx=0x7efd2000dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.740+0000 7efd1b7fe640 1 -- 172.21.15.53:0/2397900508 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20017070 con 0x7efd2c1080d0 2024-08-31T06:26:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.740+0000 7efd1b7fe640 1 -- 172.21.15.53:0/2397900508 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd200054b0 con 0x7efd2c1080d0 2024-08-31T06:26:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.740+0000 7efd1b7fe640 1 -- 172.21.15.53:0/2397900508 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20004bc0 con 0x7efd2c1080d0 2024-08-31T06:26:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.740+0000 7efd30cd3640 1 -- 172.21.15.53:0/2397900508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c19f320 con 0x7efd2c1080d0 2024-08-31T06:26:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.740+0000 7efd30cd3640 1 -- 172.21.15.53:0/2397900508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c1a5ab0 con 0x7efd2c1080d0 2024-08-31T06:26:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.742+0000 7efd37c46740 1 Processor -- start 2024-08-31T06:26:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd37c46740 1 -- start start 2024-08-31T06:26:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd1b7fe640 1 -- 172.21.15.53:0/2397900508 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7efd20010460 con 0x7efd2c1080d0 2024-08-31T06:26:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd37c46740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56176491d1b0 0x561764cc0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd37c46740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 0x561764cc1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd37c46740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617648fc4d0 0x561764cc1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd37c46740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561764c36000 con 0x56176491d1b0 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd37c46740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561764c25590 con 0x5617648f42f0 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd37c46740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561764c29540 con 0x5617648fc4d0 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd2ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56176491d1b0 0x561764cc0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd2ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56176491d1b0 0x561764cc0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44374/0 (socket says 172.21.15.53:44374) 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd2ad9d640 1 -- 172.21.15.53:0/566906462 learned_addr learned my addr 172.21.15.53:0/566906462 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd29d9b640 1 --2- 172.21.15.53:0/566906462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617648fc4d0 0x561764cc1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd2a59c640 1 --2- 172.21.15.53:0/566906462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 0x561764cc1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd2ad9d640 1 -- 172.21.15.53:0/566906462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617648fc4d0 msgr2=0x561764cc1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd2ad9d640 1 --2- 172.21.15.53:0/566906462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617648fc4d0 0x561764cc1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd2ad9d640 1 -- 172.21.15.53:0/566906462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 msgr2=0x561764cc1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd2ad9d640 1 --2- 172.21.15.53:0/566906462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 0x561764cc1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.743+0000 7efd2ad9d640 1 -- 172.21.15.53:0/566906462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561764988790 con 0x56176491d1b0 2024-08-31T06:26:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.744+0000 7efd2ad9d640 1 --2- 172.21.15.53:0/566906462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56176491d1b0 0x561764cc0ce0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7efd24010710 tx=0x7efd24010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d416696ac8de47 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.744+0000 7efd1b7fe640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd140b4d20 0x7efd140b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.744+0000 7efd2a59c640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd140b4d20 0x7efd140b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.744+0000 7efd18ff9640 1 -- 172.21.15.53:0/566906462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2400e8d0 con 0x56176491d1b0 2024-08-31T06:26:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.744+0000 7efd1b7fe640 1 -- 172.21.15.53:0/2397900508 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7efd200e4e80 con 0x7efd2c1080d0 2024-08-31T06:26:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.744+0000 7efd18ff9640 1 -- 172.21.15.53:0/566906462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd24012450 con 0x56176491d1b0 2024-08-31T06:26:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.744+0000 7efd18ff9640 1 -- 172.21.15.53:0/566906462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2401c670 con 0x56176491d1b0 2024-08-31T06:26:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.745+0000 7efd37c46740 1 -- 172.21.15.53:0/566906462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56176491d1b0 msgr2=0x561764cc0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.745+0000 7efd2a59c640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd140b4d20 0x7efd140b7230 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0057c0 tx=0x7efd1c0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.745+0000 7efd37c46740 1 --2- 172.21.15.53:0/566906462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56176491d1b0 0x561764cc0ce0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7efd24010710 tx=0x7efd24010bd0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.745+0000 7efd37c46740 1 -- 172.21.15.53:0/566906462 shutdown_connections 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.745+0000 7efd37c46740 1 --2- 172.21.15.53:0/566906462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617648fc4d0 0x561764cc1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.745+0000 7efd37c46740 1 --2- 172.21.15.53:0/566906462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 0x561764cc1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.745+0000 7efd37c46740 1 --2- 172.21.15.53:0/566906462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56176491d1b0 0x561764cc0ce0 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.745+0000 7efd37c46740 1 -- 172.21.15.53:0/566906462 >> 172.21.15.53:0/566906462 conn(0x561764911300 msgr2=0x561764cbebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.745+0000 7efd37c46740 1 -- 172.21.15.53:0/566906462 shutdown_connections 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.745+0000 7efd37c46740 1 -- 172.21.15.53:0/566906462 wait complete. 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd37c46740 1 -- start start 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd37c46740 1 Processor -- start 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd37c46740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 0x561764ccea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd37c46740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764ccefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd37c46740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 0x561764cda970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd37c46740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561764b5eab0 con 0x5617648fc4d0 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd37c46740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561764bac680 con 0x5617648f42f0 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd37c46740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561764cd1640 con 0x56176491d1b0 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd37c46740 10 client.0 _ll_register_callbacks cb 0x561764934a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd29d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764ccefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd2a59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 0x561764ccea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd29d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764ccefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44380/0 (socket says 172.21.15.53:44380) 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd29d9b640 1 -- 172.21.15.53:0/778990500 learned_addr learned my addr 172.21.15.53:0/778990500 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd2ad9d640 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 0x561764cda970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd29d9b640 1 -- 172.21.15.53:0/778990500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 msgr2=0x561764cda970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd29d9b640 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 0x561764cda970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd29d9b640 1 -- 172.21.15.53:0/778990500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 msgr2=0x561764ccea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd29d9b640 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 0x561764ccea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.746+0000 7efd29d9b640 1 -- 172.21.15.53:0/778990500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561764a01620 con 0x5617648fc4d0 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd29d9b640 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764ccefd0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7efd200e2610 tx=0x7efd20005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208a2078168b6f5d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd11ffb640 1 -- 172.21.15.53:0/778990500 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20020050 con 0x5617648fc4d0 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd11ffb640 1 -- 172.21.15.53:0/778990500 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7efd200ce0b0 con 0x5617648fc4d0 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd37c46740 1 -- 172.21.15.53:0/778990500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd24012450 con 0x5617648fc4d0 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd11ffb640 1 -- 172.21.15.53:0/778990500 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7efd200ab3d0 con 0x5617648fc4d0 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd37c46740 10 client.22137 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd37c46740 1 -- 172.21.15.53:0/778990500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x561764cdd670 con 0x5617648fc4d0 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd11ffb640 1 -- 172.21.15.53:0/778990500 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd24012450 con 0x5617648fc4d0 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd11ffb640 1 -- 172.21.15.53:0/778990500 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7efd200e8b80 con 0x5617648fc4d0 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd37c46740 10 client.22137 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd37c46740 10 client.22137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd37c46740 20 client.22137 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd37c46740 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5617648dbd80 0x561764ce0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd37c46740 4 client.22137 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.747+0000 7efd37c46740 1 -- 172.21.15.53:0/778990500 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561764c37f50 con 0x5617648dbd80 2024-08-31T06:26:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.748+0000 7efd2a59c640 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5617648dbd80 0x561764ce0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.748+0000 7efd2a59c640 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5617648dbd80 0x561764ce0bd0 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71249c0c70713d6a server_cookie=d18f4350e2e0568 in_seq=0 out_seq=0 2024-08-31T06:26:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.748+0000 7efd11ffb640 10 client.22137 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd11ffb640 1 -- 172.21.15.53:0/778990500 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561764c37f50 con 0x5617648dbd80 2024-08-31T06:26:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd11ffb640 10 client.22137 handle_command_reply: tid=0 2024-08-31T06:26:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 1 client.22137 shutdown 2024-08-31T06:26:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 1 -- 172.21.15.53:0/778990500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 msgr2=0x561764ccefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764ccefd0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7efd200e2610 tx=0x7efd20005bb0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 1 -- 172.21.15.53:0/778990500 shutdown_connections 2024-08-31T06:26:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5617648dbd80 0x561764ce0bd0 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 0x561764cda970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764ccefd0 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 1 --2- 172.21.15.53:0/778990500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 0x561764ccea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd11ffb640 0 client.22137 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 1 -- 172.21.15.53:0/778990500 >> 172.21.15.53:0/778990500 conn(0x561764911300 msgr2=0x561764cbd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 1 -- 172.21.15.53:0/778990500 shutdown_connections 2024-08-31T06:26:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 1 -- 172.21.15.53:0/778990500 wait complete. 2024-08-31T06:26:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.749+0000 7efd37c46740 20 client.22137 trim_cache size 0 max 16384 2024-08-31T06:26:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.764+0000 7efd37c46740 1 Processor -- start 2024-08-31T06:26:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.764+0000 7efd37c46740 1 -- start start 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.764+0000 7efd37c46740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 0x561764cbd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.764+0000 7efd37c46740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764cbd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.764+0000 7efd37c46740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 0x561764ccba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.764+0000 7efd37c46740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1ad3b0 con 0x5617648fc4d0 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.764+0000 7efd37c46740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1af1f0 con 0x5617648f42f0 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.764+0000 7efd37c46740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1adb40 con 0x56176491d1b0 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.764+0000 7efd29d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764cbd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.764+0000 7efd29d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764cbd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44386/0 (socket says 172.21.15.53:44386) 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.764+0000 7efd29d9b640 1 -- 172.21.15.53:0/2589302859 learned_addr learned my addr 172.21.15.53:0/2589302859 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.765+0000 7efd29d9b640 1 -- 172.21.15.53:0/2589302859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 msgr2=0x561764ccba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.765+0000 7efd29d9b640 1 --2- 172.21.15.53:0/2589302859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 0x561764ccba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.765+0000 7efd29d9b640 1 -- 172.21.15.53:0/2589302859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 msgr2=0x561764cbd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.765+0000 7efd29d9b640 1 --2- 172.21.15.53:0/2589302859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 0x561764cbd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.765+0000 7efd29d9b640 1 -- 172.21.15.53:0/2589302859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561764cb8980 con 0x5617648fc4d0 2024-08-31T06:26:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.765+0000 7efd29d9b640 1 --2- 172.21.15.53:0/2589302859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764cbd6b0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7efd200e2bb0 tx=0x7efd200e2ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1865db352cd57cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.765+0000 7efd13fff640 1 -- 172.21.15.53:0/2589302859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20020050 con 0x5617648fc4d0 2024-08-31T06:26:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.765+0000 7efd13fff640 1 -- 172.21.15.53:0/2589302859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd200ab110 con 0x5617648fc4d0 2024-08-31T06:26:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.765+0000 7efd13fff640 1 -- 172.21.15.53:0/2589302859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd200aad70 con 0x5617648fc4d0 2024-08-31T06:26:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 -- 172.21.15.53:0/2589302859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 msgr2=0x561764cbd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 --2- 172.21.15.53:0/2589302859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764cbd6b0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7efd200e2bb0 tx=0x7efd200e2ad0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 -- 172.21.15.53:0/2589302859 shutdown_connections 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 --2- 172.21.15.53:0/2589302859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 0x561764ccba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 --2- 172.21.15.53:0/2589302859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648fc4d0 0x561764cbd6b0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 --2- 172.21.15.53:0/2589302859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648f42f0 0x561764cbd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 -- 172.21.15.53:0/2589302859 >> 172.21.15.53:0/2589302859 conn(0x561764911300 msgr2=0x561764ccd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 -- 172.21.15.53:0/2589302859 shutdown_connections 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 -- 172.21.15.53:0/2589302859 wait complete. 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 -- start start 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 Processor -- start 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648f42f0 0x561764cd6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648fc4d0 0x561764cd1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 0x561764cd1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1aea60 con 0x5617648f42f0 2024-08-31T06:26:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1ae2d0 con 0x5617648fc4d0 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1ab3b0 con 0x56176491d1b0 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.766+0000 7efd37c46740 10 client.0 _ll_register_callbacks cb 0x7efd2000d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd2a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648f42f0 0x561764cd6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd2a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648f42f0 0x561764cd6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44398/0 (socket says 172.21.15.53:44398) 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd2a59c640 1 -- 172.21.15.53:0/1553827147 learned_addr learned my addr 172.21.15.53:0/1553827147 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd2ad9d640 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 0x561764cd1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd29d9b640 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648fc4d0 0x561764cd1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd2a59c640 1 -- 172.21.15.53:0/1553827147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 msgr2=0x561764cd1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd2a59c640 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 0x561764cd1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd2a59c640 1 -- 172.21.15.53:0/1553827147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648fc4d0 msgr2=0x561764cd1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd2a59c640 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648fc4d0 0x561764cd1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd2a59c640 1 -- 172.21.15.53:0/1553827147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561764cd2390 con 0x5617648f42f0 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd29d9b640 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648fc4d0 0x561764cd1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd2a59c640 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648f42f0 0x561764cd6ef0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7efd1c000c00 tx=0x7efd1c004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc096b092c82a1e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd11ffb640 1 -- 172.21.15.53:0/1553827147 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c035040 con 0x5617648f42f0 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd11ffb640 1 -- 172.21.15.53:0/1553827147 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7efd1c003800 con 0x5617648f42f0 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd37c46740 1 -- 172.21.15.53:0/1553827147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd200ab110 con 0x5617648f42f0 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd11ffb640 1 -- 172.21.15.53:0/1553827147 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7efd1c0044b0 con 0x5617648f42f0 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd37c46740 10 client.22143 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.767+0000 7efd37c46740 1 -- 172.21.15.53:0/1553827147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x561764d4c3a0 con 0x5617648f42f0 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.768+0000 7efd11ffb640 1 -- 172.21.15.53:0/1553827147 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd200ab110 con 0x5617648f42f0 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.768+0000 7efd11ffb640 1 -- 172.21.15.53:0/1553827147 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7efd1c044040 con 0x5617648f42f0 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.768+0000 7efd37c46740 10 client.22143 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.768+0000 7efd37c46740 10 client.22143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.768+0000 7efd37c46740 20 client.22143 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.768+0000 7efd37c46740 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5617648b11c0 0x561764d4ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.768+0000 7efd37c46740 4 client.22143 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:26:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.768+0000 7efd37c46740 1 -- 172.21.15.53:0/1553827147 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561764c339f0 con 0x5617648b11c0 2024-08-31T06:26:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.768+0000 7efd29d9b640 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5617648b11c0 0x561764d4ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.769+0000 7efd29d9b640 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5617648b11c0 0x561764d4ec00 crc :-1 s=READY pgs=513 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef1256b27dae2e76 server_cookie=b87619b6414e9ca8 in_seq=0 out_seq=0 2024-08-31T06:26:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.769+0000 7efd11ffb640 10 client.22143 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.828+0000 7efd11ffb640 1 -- 172.21.15.53:0/1553827147 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561764c339f0 con 0x5617648b11c0 2024-08-31T06:26:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.828+0000 7efd11ffb640 10 client.22143 handle_command_reply: tid=0 2024-08-31T06:26:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.828+0000 7efd37c46740 1 client.22143 shutdown 2024-08-31T06:26:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd37c46740 1 -- 172.21.15.53:0/1553827147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648f42f0 msgr2=0x561764cd6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd37c46740 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648f42f0 0x561764cd6ef0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7efd1c000c00 tx=0x7efd1c004200 comp rx=0 tx=0).stop 2024-08-31T06:26:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd37c46740 1 -- 172.21.15.53:0/1553827147 shutdown_connections 2024-08-31T06:26:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd37c46740 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5617648b11c0 0x561764d4ec00 crc :-1 s=READY pgs=513 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd37c46740 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56176491d1b0 0x561764cd1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd37c46740 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5617648fc4d0 0x561764cd1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd11ffb640 0 client.22143 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd37c46740 1 --2- 172.21.15.53:0/1553827147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617648f42f0 0x561764cd6ef0 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd37c46740 1 -- 172.21.15.53:0/1553827147 >> 172.21.15.53:0/1553827147 conn(0x561764911300 msgr2=0x561764cc5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd37c46740 1 -- 172.21.15.53:0/1553827147 shutdown_connections 2024-08-31T06:26:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd37c46740 1 -- 172.21.15.53:0/1553827147 wait complete. 2024-08-31T06:26:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd37c46740 20 client.22143 trim_cache size 0 max 16384 2024-08-31T06:26:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:26:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:26:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:26:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:26:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd30cd3640 1 -- 172.21.15.53:0/2397900508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd140b4d20 msgr2=0x7efd140b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd30cd3640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd140b4d20 0x7efd140b7230 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0057c0 tx=0x7efd1c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd30cd3640 1 -- 172.21.15.53:0/2397900508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1080d0 msgr2=0x7efd2c1996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd30cd3640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1080d0 0x7efd2c1996a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efd2000d750 tx=0x7efd2000dc10 comp rx=0 tx=0).stop 2024-08-31T06:26:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd30cd3640 1 -- 172.21.15.53:0/2397900508 shutdown_connections 2024-08-31T06:26:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd30cd3640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7efd140b4d20 0x7efd140b7230 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd30cd3640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd2c108a20 0x7efd2c19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.829+0000 7efd30cd3640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2c1080d0 0x7efd2c1996a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.830+0000 7efd30cd3640 1 --2- 172.21.15.53:0/2397900508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd2c102f10 0x7efd2c199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.830+0000 7efd30cd3640 1 -- 172.21.15.53:0/2397900508 >> 172.21.15.53:0/2397900508 conn(0x7efd2c079c30 msgr2=0x7efd2c1062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.830+0000 7efd30cd3640 1 -- 172.21.15.53:0/2397900508 shutdown_connections 2024-08-31T06:26:46.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:46.830+0000 7efd30cd3640 1 -- 172.21.15.53:0/2397900508 wait complete. 2024-08-31T06:26:47.388 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.67 MB/sec execute 395 sec latency 9552.236 ms 2024-08-31T06:26:47.746 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:26:47.747 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:26:48.013 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:48.386 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:48 smithi053 ceph-mon[18924]: pgmap v1010: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-08-31T06:26:48.388 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.66 MB/sec execute 396 sec latency 10552.266 ms 2024-08-31T06:26:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.475+0000 7f34a8d9b640 1 -- 172.21.15.53:0/1024783040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a4109280 msgr2=0x7f34a4109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.475+0000 7f34a8d9b640 1 --2- 172.21.15.53:0/1024783040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a4109280 0x7f34a4109690 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f348c009900 tx=0x7f348c02a410 comp rx=0 tx=0).stop 2024-08-31T06:26:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.475+0000 7f34a8d9b640 1 -- 172.21.15.53:0/1024783040 shutdown_connections 2024-08-31T06:26:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.475+0000 7f34a8d9b640 1 --2- 172.21.15.53:0/1024783040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34a4109bd0 0x7f34a4110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.475+0000 7f34a8d9b640 1 --2- 172.21.15.53:0/1024783040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a4109280 0x7f34a4109690 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.475+0000 7f34a8d9b640 1 --2- 172.21.15.53:0/1024783040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34a4103940 0x7f34a4103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.475+0000 7f34a8d9b640 1 -- 172.21.15.53:0/1024783040 >> 172.21.15.53:0/1024783040 conn(0x7f34a40ff3d0 msgr2=0x7f34a4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.475+0000 7f34a8d9b640 1 -- 172.21.15.53:0/1024783040 shutdown_connections 2024-08-31T06:26:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.475+0000 7f34a8d9b640 1 -- 172.21.15.53:0/1024783040 wait complete. 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.476+0000 7f34a8d9b640 1 Processor -- start 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.476+0000 7f34a8d9b640 1 -- start start 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.476+0000 7f34a8d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34a4103940 0x7f34a419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.476+0000 7f34a8d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a4109280 0x7f34a419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.476+0000 7f34a8d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34a4109bd0 0x7f34a419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.476+0000 7f34a8d9b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41137e0 con 0x7f34a4109280 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.476+0000 7f34a8d9b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34a4113660 con 0x7f34a4103940 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.476+0000 7f34a8d9b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34a4113960 con 0x7f34a4109bd0 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.476+0000 7f34a1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a4109280 0x7f34a419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.476+0000 7f34a1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a4109280 0x7f34a419a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44410/0 (socket says 172.21.15.53:44410) 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.476+0000 7f34a1d9b640 1 -- 172.21.15.53:0/4232778508 learned_addr learned my addr 172.21.15.53:0/4232778508 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f34a2d9d640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34a4109bd0 0x7f34a419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f34a259c640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34a4103940 0x7f34a419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f34a1d9b640 1 -- 172.21.15.53:0/4232778508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34a4109bd0 msgr2=0x7f34a419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f34a1d9b640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34a4109bd0 0x7f34a419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f34a1d9b640 1 -- 172.21.15.53:0/4232778508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34a4103940 msgr2=0x7f34a419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f34a1d9b640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34a4103940 0x7f34a419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f34a1d9b640 1 -- 172.21.15.53:0/4232778508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a41a0280 con 0x7f34a4109280 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f34a259c640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34a4103940 0x7f34a419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f34a1d9b640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a4109280 0x7f34a419a8b0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f348c005940 tx=0x7f348c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f349b7fe640 1 -- 172.21.15.53:0/4232778508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c03f030 con 0x7f34a4109280 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f349b7fe640 1 -- 172.21.15.53:0/4232778508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f348c003c90 con 0x7f34a4109280 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f349b7fe640 1 -- 172.21.15.53:0/4232778508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c035070 con 0x7f34a4109280 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f34a8d9b640 1 -- 172.21.15.53:0/4232778508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a41a0510 con 0x7f34a4109280 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.477+0000 7f34a8d9b640 1 -- 172.21.15.53:0/4232778508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a41a6cd0 con 0x7f34a4109280 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.480+0000 7f349b7fe640 1 -- 172.21.15.53:0/4232778508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f348c042030 con 0x7f34a4109280 2024-08-31T06:26:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.480+0000 7f34af310740 1 Processor -- start 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.480+0000 7f34af310740 1 -- start start 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.480+0000 7f34af310740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff797e350 0x560ff7d24780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34af310740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d24cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34af310740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff795d670 0x560ff7d25200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34af310740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560ff7c9a5f0 con 0x560ff7955490 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34af310740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560ff7c89b80 con 0x560ff795d670 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34af310740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560ff7c8db30 con 0x560ff797e350 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d24cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d24cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44414/0 (socket says 172.21.15.53:44414) 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a259c640 1 -- 172.21.15.53:0/3733163760 learned_addr learned my addr 172.21.15.53:0/3733163760 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a2d9d640 1 --2- 172.21.15.53:0/3733163760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff797e350 0x560ff7d24780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a1d9b640 1 --2- 172.21.15.53:0/3733163760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff795d670 0x560ff7d25200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f349b7fe640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34900b4d20 0x7f34900b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a259c640 1 -- 172.21.15.53:0/3733163760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff797e350 msgr2=0x560ff7d24780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a259c640 1 --2- 172.21.15.53:0/3733163760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff797e350 0x560ff7d24780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a259c640 1 -- 172.21.15.53:0/3733163760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff795d670 msgr2=0x560ff7d25200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a259c640 1 --2- 172.21.15.53:0/3733163760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff795d670 0x560ff7d25200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a259c640 1 -- 172.21.15.53:0/3733163760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ff79e9930 con 0x560ff7955490 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a1d9b640 1 --2- 172.21.15.53:0/3733163760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff795d670 0x560ff7d25200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a2d9d640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34900b4d20 0x7f34900b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f349b7fe640 1 -- 172.21.15.53:0/4232778508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f348c105f30 con 0x7f34a4109280 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.481+0000 7f34a259c640 1 --2- 172.21.15.53:0/3733163760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d24cc0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f3494007fb0 tx=0x7f349400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee87992fd6999eaf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.482+0000 7f3498ff9640 1 -- 172.21.15.53:0/3733163760 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494014070 con 0x560ff7955490 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.482+0000 7f3498ff9640 1 -- 172.21.15.53:0/3733163760 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f349400fce0 con 0x560ff7955490 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.482+0000 7f3498ff9640 1 -- 172.21.15.53:0/3733163760 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349400ebc0 con 0x560ff7955490 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.482+0000 7f34af310740 1 -- 172.21.15.53:0/3733163760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 msgr2=0x560ff7d24cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.482+0000 7f34a2d9d640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34900b4d20 0x7f34900b7230 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f349c006fd0 tx=0x7f349c0047d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.482+0000 7f34af310740 1 --2- 172.21.15.53:0/3733163760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d24cc0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f3494007fb0 tx=0x7f349400c750 comp rx=0 tx=0).stop 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.483+0000 7f34af310740 1 -- 172.21.15.53:0/3733163760 shutdown_connections 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.483+0000 7f34af310740 1 --2- 172.21.15.53:0/3733163760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff795d670 0x560ff7d25200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.483+0000 7f34af310740 1 --2- 172.21.15.53:0/3733163760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d24cc0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.483+0000 7f34af310740 1 --2- 172.21.15.53:0/3733163760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff797e350 0x560ff7d24780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.483+0000 7f34af310740 1 -- 172.21.15.53:0/3733163760 >> 172.21.15.53:0/3733163760 conn(0x560ff7972740 msgr2=0x560ff7d22670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.483+0000 7f34af310740 1 -- 172.21.15.53:0/3733163760 shutdown_connections 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.483+0000 7f34af310740 1 -- 172.21.15.53:0/3733163760 wait complete. 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.483+0000 7f34af310740 1 -- start start 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.483+0000 7f34af310740 1 Processor -- start 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.483+0000 7f34af310740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff7955490 0x560ff7d34290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34af310740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34af310740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d40650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34af310740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560ff7aec890 con 0x560ff797e350 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34af310740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560ff7c10790 con 0x560ff7955490 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34af310740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560ff7d372c0 con 0x560ff795d670 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34af310740 10 client.0 _ll_register_callbacks cb 0x560ff7995ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34a2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d40650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34a2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d40650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44416/0 (socket says 172.21.15.53:44416) 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34a2d9d640 1 -- 172.21.15.53:0/2606817837 learned_addr learned my addr 172.21.15.53:0/2606817837 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34a1d9b640 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34a259c640 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff7955490 0x560ff7d34290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34a2d9d640 1 -- 172.21.15.53:0/2606817837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 msgr2=0x560ff7d347d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34a2d9d640 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d347d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34a2d9d640 1 -- 172.21.15.53:0/2606817837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff7955490 msgr2=0x560ff7d34290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34a2d9d640 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff7955490 0x560ff7d34290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34a2d9d640 1 -- 172.21.15.53:0/2606817837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ff7c47f30 con 0x560ff797e350 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34a2d9d640 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d40650 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f349c00b480 tx=0x7f349c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7dd33d0978ff30 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f3489ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f3489ffb640 1 -- 172.21.15.53:0/2606817837 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c024020 con 0x560ff797e350 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f3489ffb640 1 -- 172.21.15.53:0/2606817837 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f349c0137c0 con 0x560ff797e350 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.484+0000 7f34af310740 1 -- 172.21.15.53:0/2606817837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f349400fce0 con 0x560ff797e350 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f3489ffb640 1 -- 172.21.15.53:0/2606817837 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f349c02f050 con 0x560ff797e350 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f34af310740 10 client.22155 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f34af310740 1 -- 172.21.15.53:0/2606817837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x560ff7d430e0 con 0x560ff797e350 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f3489ffb640 1 -- 172.21.15.53:0/2606817837 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f349400fce0 con 0x560ff797e350 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f3489ffb640 1 -- 172.21.15.53:0/2606817837 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f349c020a40 con 0x560ff797e350 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f34af310740 10 client.22155 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f34af310740 10 client.22155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f34af310740 20 client.22155 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f34af310740 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ff793ccd0 0x560ff7d46720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f34af310740 4 client.22155 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f34af310740 1 -- 172.21.15.53:0/2606817837 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ff7c9c540 con 0x560ff793ccd0 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.485+0000 7f34a259c640 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ff793ccd0 0x560ff7d46720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.486+0000 7f34a259c640 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ff793ccd0 0x560ff7d46720 crc :-1 s=READY pgs=514 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=555b4b37e3e2c457 server_cookie=d517e24cd1b83c54 in_seq=0 out_seq=0 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.486+0000 7f3489ffb640 10 client.22155 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f3489ffb640 1 -- 172.21.15.53:0/2606817837 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560ff7c9c540 con 0x560ff793ccd0 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f3489ffb640 10 client.22155 handle_command_reply: tid=0 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 1 client.22155 shutdown 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 1 -- 172.21.15.53:0/2606817837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 msgr2=0x560ff7d40650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d40650 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f349c00b480 tx=0x7f349c008040 comp rx=0 tx=0).stop 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 1 -- 172.21.15.53:0/2606817837 shutdown_connections 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ff793ccd0 0x560ff7d46720 crc :-1 s=READY pgs=514 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d40650 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d347d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 1 --2- 172.21.15.53:0/2606817837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff7955490 0x560ff7d34290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f3489ffb640 0 client.22155 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:48.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 1 -- 172.21.15.53:0/2606817837 >> 172.21.15.53:0/2606817837 conn(0x560ff7972740 msgr2=0x560ff7d20c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:48.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 1 -- 172.21.15.53:0/2606817837 shutdown_connections 2024-08-31T06:26:48.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 1 -- 172.21.15.53:0/2606817837 wait complete. 2024-08-31T06:26:48.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.487+0000 7f34af310740 20 client.22155 trim_cache size 0 max 16384 2024-08-31T06:26:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34af310740 1 Processor -- start 2024-08-31T06:26:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34af310740 1 -- start start 2024-08-31T06:26:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34af310740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d35ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34af310740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d40550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34af310740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff797e350 0x560ff7d4bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34af310740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41ad420 con 0x560ff7955490 2024-08-31T06:26:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34af310740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41af260 con 0x560ff797e350 2024-08-31T06:26:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34af310740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41adbb0 con 0x560ff795d670 2024-08-31T06:26:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34a259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d35ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34a259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d35ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44432/0 (socket says 172.21.15.53:44432) 2024-08-31T06:26:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34a259c640 1 -- 172.21.15.53:0/4287483578 learned_addr learned my addr 172.21.15.53:0/4287483578 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34a2d9d640 1 --2- 172.21.15.53:0/4287483578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff797e350 0x560ff7d4bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34a259c640 1 -- 172.21.15.53:0/4287483578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 msgr2=0x560ff7d40550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34a259c640 1 --2- 172.21.15.53:0/4287483578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d40550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34a259c640 1 -- 172.21.15.53:0/4287483578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff797e350 msgr2=0x560ff7d4bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34a259c640 1 --2- 172.21.15.53:0/4287483578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff797e350 0x560ff7d4bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.505+0000 7f34a259c640 1 -- 172.21.15.53:0/4287483578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ff7d22fe0 con 0x560ff7955490 2024-08-31T06:26:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.506+0000 7f34a259c640 1 --2- 172.21.15.53:0/4287483578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d35ec0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f349400cc50 tx=0x7f3494007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6eb3ee141472d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.506+0000 7f348bfff640 1 -- 172.21.15.53:0/4287483578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494030070 con 0x560ff7955490 2024-08-31T06:26:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.506+0000 7f348bfff640 1 -- 172.21.15.53:0/4287483578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f349400e420 con 0x560ff7955490 2024-08-31T06:26:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.506+0000 7f348bfff640 1 -- 172.21.15.53:0/4287483578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494014040 con 0x560ff7955490 2024-08-31T06:26:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 -- 172.21.15.53:0/4287483578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 msgr2=0x560ff7d35ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 --2- 172.21.15.53:0/4287483578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d35ec0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f349400cc50 tx=0x7f3494007880 comp rx=0 tx=0).stop 2024-08-31T06:26:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 -- 172.21.15.53:0/4287483578 shutdown_connections 2024-08-31T06:26:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 --2- 172.21.15.53:0/4287483578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff797e350 0x560ff7d4bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 --2- 172.21.15.53:0/4287483578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d40550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 --2- 172.21.15.53:0/4287483578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff7955490 0x560ff7d35ec0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 -- 172.21.15.53:0/4287483578 >> 172.21.15.53:0/4287483578 conn(0x560ff7972740 msgr2=0x560ff7d357b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 -- 172.21.15.53:0/4287483578 shutdown_connections 2024-08-31T06:26:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 -- 172.21.15.53:0/4287483578 wait complete. 2024-08-31T06:26:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 -- start start 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 Processor -- start 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff7955490 0x560ff7d3b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d3bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d3c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.507+0000 7f34af310740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41aead0 con 0x560ff797e350 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34af310740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41ae340 con 0x560ff7955490 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34af310740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41ab420 con 0x560ff795d670 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34af310740 10 client.0 _ll_register_callbacks cb 0x7f349c00b720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d3c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d3c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44438/0 (socket says 172.21.15.53:44438) 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a2d9d640 1 -- 172.21.15.53:0/2873725232 learned_addr learned my addr 172.21.15.53:0/2873725232 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a259c640 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff7955490 0x560ff7d3b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a1d9b640 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d3bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a2d9d640 1 -- 172.21.15.53:0/2873725232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 msgr2=0x560ff7d3bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a2d9d640 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d3bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a2d9d640 1 -- 172.21.15.53:0/2873725232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff7955490 msgr2=0x560ff7d3b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a2d9d640 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff7955490 0x560ff7d3b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a2d9d640 1 -- 172.21.15.53:0/2873725232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ff7db1270 con 0x560ff797e350 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a1d9b640 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d3bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a259c640 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff7955490 0x560ff7d3b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34a2d9d640 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d3c160 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f349c000c00 tx=0x7f349c01f6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da77fd9e8d93bbd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f3489ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f3489ffb640 1 -- 172.21.15.53:0/2873725232 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c024050 con 0x560ff797e350 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f3489ffb640 1 -- 172.21.15.53:0/2873725232 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f349c005dd0 con 0x560ff797e350 2024-08-31T06:26:48.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.508+0000 7f34af310740 1 -- 172.21.15.53:0/2873725232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f349400e420 con 0x560ff797e350 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f3489ffb640 1 -- 172.21.15.53:0/2873725232 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f349c01f850 con 0x560ff797e350 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f34af310740 10 client.22161 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f34af310740 1 -- 172.21.15.53:0/2873725232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x560ff7db2530 con 0x560ff797e350 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f3489ffb640 1 -- 172.21.15.53:0/2873725232 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f349400e420 con 0x560ff797e350 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f3489ffb640 1 -- 172.21.15.53:0/2873725232 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f349c020750 con 0x560ff797e350 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f34af310740 10 client.22161 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f34af310740 10 client.22161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f34af310740 20 client.22161 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f34af310740 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ff7912080 0x560ff7db4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f34af310740 4 client.22161 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f34af310740 1 -- 172.21.15.53:0/2873725232 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560ff7c97fe0 con 0x560ff7912080 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.509+0000 7f34a259c640 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ff7912080 0x560ff7db4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:48.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.510+0000 7f3489ffb640 10 client.22161 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:48.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.510+0000 7f34a259c640 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ff7912080 0x560ff7db4d80 crc :-1 s=READY pgs=515 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7bdd786c22e3248 server_cookie=d6efa120c0bbe380 in_seq=0 out_seq=0 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.511+0000 7f3489ffb640 1 -- 172.21.15.53:0/2873725232 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560ff7c97fe0 con 0x560ff7912080 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.511+0000 7f3489ffb640 10 client.22161 handle_command_reply: tid=0 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.511+0000 7f34af310740 1 client.22161 shutdown 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.511+0000 7f34af310740 1 -- 172.21.15.53:0/2873725232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 msgr2=0x560ff7d3c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.511+0000 7f34af310740 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d3c160 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f349c000c00 tx=0x7f349c01f6b0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34af310740 1 -- 172.21.15.53:0/2873725232 shutdown_connections 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34af310740 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x560ff7912080 0x560ff7db4d80 crc :-1 s=READY pgs=515 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34af310740 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560ff797e350 0x560ff7d3c160 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34af310740 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560ff795d670 0x560ff7d3bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f3489ffb640 0 client.22161 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34af310740 1 --2- 172.21.15.53:0/2873725232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ff7955490 0x560ff7d3b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34af310740 1 -- 172.21.15.53:0/2873725232 >> 172.21.15.53:0/2873725232 conn(0x560ff7972740 msgr2=0x560ff7d3f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:48.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34af310740 1 -- 172.21.15.53:0/2873725232 shutdown_connections 2024-08-31T06:26:48.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34af310740 1 -- 172.21.15.53:0/2873725232 wait complete. 2024-08-31T06:26:48.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34af310740 20 client.22161 trim_cache size 0 max 16384 2024-08-31T06:26:48.519 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:26:48.519 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:26:48.519 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "857f8219-039c-44d2-8dd7-af494d80e735", 2024-08-31T06:26:48.519 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:26:48.519 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:26:48.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34a8d9b640 1 -- 172.21.15.53:0/4232778508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34900b4d20 msgr2=0x7f34900b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:48.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34a8d9b640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34900b4d20 0x7f34900b7230 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f349c006fd0 tx=0x7f349c0047d0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34a8d9b640 1 -- 172.21.15.53:0/4232778508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a4109280 msgr2=0x7f34a419a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:48.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.512+0000 7f34a8d9b640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a4109280 0x7f34a419a8b0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f348c005940 tx=0x7f348c0042f0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.513+0000 7f34a8d9b640 1 -- 172.21.15.53:0/4232778508 shutdown_connections 2024-08-31T06:26:48.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.513+0000 7f34a8d9b640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f34900b4d20 0x7f34900b7230 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.513+0000 7f34a8d9b640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34a4109bd0 0x7f34a419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.513+0000 7f34a8d9b640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a4109280 0x7f34a419a8b0 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.513+0000 7f34a8d9b640 1 --2- 172.21.15.53:0/4232778508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34a4103940 0x7f34a419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:48.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.513+0000 7f34a8d9b640 1 -- 172.21.15.53:0/4232778508 >> 172.21.15.53:0/4232778508 conn(0x7f34a40ff3d0 msgr2=0x7f34a41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:48.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.513+0000 7f34a8d9b640 1 -- 172.21.15.53:0/4232778508 shutdown_connections 2024-08-31T06:26:48.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:48.513+0000 7f34a8d9b640 1 -- 172.21.15.53:0/4232778508 wait complete. 2024-08-31T06:26:48.615 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:48 smithi130 ceph-mon[22266]: pgmap v1010: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-08-31T06:26:48.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:48 smithi153 ceph-mon[22320]: pgmap v1010: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-08-31T06:26:48.878 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:26:48 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:26:48.613+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000225 [...28,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM/ auth{1=1,2=1,3=1,4=1} v53786 ap=3 f(v3874 m2024-08-31T06:26:36.440391+0000 3=3+0) n(v57 rc2024-08-31T06:26:36.440391+0000 b780288 4=3+1) old_inodes=6 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:3927 nref=3)) caps={15441=pAsLsXsFs/-@50259} | dirtyscattered=0 request=1 lock=2 importing=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e69bc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000225:[<0x10000000009/PM v1172>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000225:[<0x10000000009/PM v53786>,<0x10000000008/~dmtmp v31298>,<0x10000000007/client0 v3193>,<0x10000000006/clients v2835>,<0x10000000005/tmp v1981>,<0x10000000003/client.0 v1940>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v1911>,<0x10000000001/sv_0 v1904>,<0x10000000000/qa v1881>,<0x1/volumes v1804>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:26:35.248267+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:26:36.440391+0000 b780288 4=3+1)","memory_value.dirstat":"f(v3874 m2024-08-31T06:26:36.440391+0000 3=3+0)","memory_value.rstat":"n(v57 rc2024-08-31T06:26:36.440391+0000 b780288 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:26:49.226 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:26:49.388 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.64 MB/sec execute 397 sec latency 11552.312 ms 2024-08-31T06:26:49.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:49 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:26:49.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:49 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:49.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:49 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:26:49.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:49 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:26:49.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:49 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:26:49.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:49 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:26:49.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:49 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:26:49.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:49 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:49.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:49 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:49.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:49 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:49.480 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:49.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:49 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:26:49.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:49 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:49.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:49 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:26:49.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:49 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:26:49.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:49 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:26:49.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:49 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:26:49.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:49 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:26:49.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:49 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:49.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:49 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:49.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:49 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:49.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:49 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:26:49.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:49 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:49.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:49 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:26:49.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:49 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:26:49.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:49 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:26:49.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:49 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:26:49.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:49 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:26:49.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:49 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:49.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:49 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:49.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:49 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:50.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.136+0000 7f9c0fffd640 1 -- 172.21.15.53:0/1048007339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c08108170 msgr2=0x7f9c08108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:50.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.136+0000 7f9c0fffd640 1 --2- 172.21.15.53:0/1048007339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c08108170 0x7f9c08108580 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009900 tx=0x7f9bf802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.136+0000 7f9c0fffd640 1 -- 172.21.15.53:0/1048007339 shutdown_connections 2024-08-31T06:26:50.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.136+0000 7f9c0fffd640 1 --2- 172.21.15.53:0/1048007339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c08108ac0 0x7f9c0810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.136+0000 7f9c0fffd640 1 --2- 172.21.15.53:0/1048007339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c08108170 0x7f9c08108580 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.136+0000 7f9c0fffd640 1 --2- 172.21.15.53:0/1048007339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c08102880 0x7f9c08102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.136+0000 7f9c0fffd640 1 -- 172.21.15.53:0/1048007339 >> 172.21.15.53:0/1048007339 conn(0x7f9c08079550 msgr2=0x7f9c08079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.136+0000 7f9c0fffd640 1 -- 172.21.15.53:0/1048007339 shutdown_connections 2024-08-31T06:26:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.136+0000 7f9c0fffd640 1 -- 172.21.15.53:0/1048007339 wait complete. 2024-08-31T06:26:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0fffd640 1 Processor -- start 2024-08-31T06:26:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0fffd640 1 -- start start 2024-08-31T06:26:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0fffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c08102880 0x7f9c0819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0fffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c08108170 0x7f9c0819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0fffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c08108ac0 0x7f9c0819fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0fffd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081125e0 con 0x7f9c08108ac0 2024-08-31T06:26:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0fffd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c08112460 con 0x7f9c08108170 2024-08-31T06:26:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0fffd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c08112760 con 0x7f9c08102880 2024-08-31T06:26:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0e59a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c08108ac0 0x7f9c0819fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0e59a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c08108ac0 0x7f9c0819fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44464/0 (socket says 172.21.15.53:44464) 2024-08-31T06:26:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0e59a640 1 -- 172.21.15.53:0/3251768016 learned_addr learned my addr 172.21.15.53:0/3251768016 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0dd99640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c08102880 0x7f9c0819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0d598640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c08108170 0x7f9c0819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0e59a640 1 -- 172.21.15.53:0/3251768016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c08102880 msgr2=0x7f9c0819a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0e59a640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c08102880 0x7f9c0819a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0e59a640 1 -- 172.21.15.53:0/3251768016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c08108170 msgr2=0x7f9c0819a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0e59a640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c08108170 0x7f9c0819a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.137+0000 7f9c0e59a640 1 -- 172.21.15.53:0/3251768016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c081a0090 con 0x7f9c08108ac0 2024-08-31T06:26:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.138+0000 7f9c0e59a640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c08108ac0 0x7f9c0819fa20 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009fd0 tx=0x7f9c0000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.138+0000 7f9bfeffd640 1 -- 172.21.15.53:0/3251768016 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00017070 con 0x7f9c08108ac0 2024-08-31T06:26:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.138+0000 7f9bfeffd640 1 -- 172.21.15.53:0/3251768016 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c00003e00 con 0x7f9c08108ac0 2024-08-31T06:26:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.138+0000 7f9c0fffd640 1 -- 172.21.15.53:0/3251768016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c081a0380 con 0x7f9c08108ac0 2024-08-31T06:26:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.138+0000 7f9bfeffd640 1 -- 172.21.15.53:0/3251768016 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00010460 con 0x7f9c08108ac0 2024-08-31T06:26:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.138+0000 7f9c0fffd640 1 -- 172.21.15.53:0/3251768016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c081a6ba0 con 0x7f9c08108ac0 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.140+0000 7f9c16572740 1 Processor -- start 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.141+0000 7f9bfeffd640 1 -- 172.21.15.53:0/3251768016 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9c00003970 con 0x7f9c08108ac0 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.141+0000 7f9c16572740 1 -- start start 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.141+0000 7f9c16572740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72abd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.141+0000 7f9c16572740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72abd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.141+0000 7f9c16572740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c726f7390 0x557c72abdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.141+0000 7f9c16572740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557c72a34630 con 0x557c72718070 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.141+0000 7f9c16572740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557c72a23bc0 con 0x557c726ef1b0 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.141+0000 7f9c16572740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557c72a27b70 con 0x557c726f7390 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.141+0000 7f9c0d598640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72abd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.141+0000 7f9c0d598640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72abd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44470/0 (socket says 172.21.15.53:44470) 2024-08-31T06:26:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.141+0000 7f9c0d598640 1 -- 172.21.15.53:0/2526710018 learned_addr learned my addr 172.21.15.53:0/2526710018 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9c0dd99640 1 --2- 172.21.15.53:0/2526710018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72abd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9bfeffd640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9bf40b4cd0 0x7f9bf40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9c0d598640 1 --2- 172.21.15.53:0/2526710018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c726f7390 0x557c72abdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9c0d598640 1 -- 172.21.15.53:0/2526710018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c726f7390 msgr2=0x557c72abdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9c0d598640 1 --2- 172.21.15.53:0/2526710018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c726f7390 0x557c72abdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9c0d598640 1 -- 172.21.15.53:0/2526710018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 msgr2=0x557c72abd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9c0d598640 1 --2- 172.21.15.53:0/2526710018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72abd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9c0d598640 1 -- 172.21.15.53:0/2526710018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c72783650 con 0x557c72718070 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9c0dd99640 1 --2- 172.21.15.53:0/2526710018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72abd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9bfeffd640 1 -- 172.21.15.53:0/3251768016 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f9c000e53a0 con 0x7f9c08108ac0 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9c0e59a640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9bf40b4cd0 0x7f9bf40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9c0d598640 1 --2- 172.21.15.53:0/2526710018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72abd2c0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8006010 tx=0x7f9bf8009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb7e3b3a6adaf9d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9bf3fff640 1 -- 172.21.15.53:0/2526710018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8043020 con 0x557c72718070 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9bf3fff640 1 -- 172.21.15.53:0/2526710018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bf80044c0 con 0x557c72718070 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.142+0000 7f9bf3fff640 1 -- 172.21.15.53:0/2526710018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8035050 con 0x557c72718070 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.143+0000 7f9c16572740 1 -- 172.21.15.53:0/2526710018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 msgr2=0x557c72abd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.143+0000 7f9c0e59a640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9bf40b4cd0 0x7f9bf40b71e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000dfd0 tx=0x7f9c00004950 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.143+0000 7f9c16572740 1 --2- 172.21.15.53:0/2526710018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72abd2c0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8006010 tx=0x7f9bf8009660 comp rx=0 tx=0).stop 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.143+0000 7f9c16572740 1 -- 172.21.15.53:0/2526710018 shutdown_connections 2024-08-31T06:26:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.143+0000 7f9c16572740 1 --2- 172.21.15.53:0/2526710018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c726f7390 0x557c72abdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.143+0000 7f9c16572740 1 --2- 172.21.15.53:0/2526710018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72abd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.143+0000 7f9c16572740 1 --2- 172.21.15.53:0/2526710018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72abd2c0 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.143+0000 7f9c16572740 1 -- 172.21.15.53:0/2526710018 >> 172.21.15.53:0/2526710018 conn(0x557c7270c460 msgr2=0x557c72abb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.143+0000 7f9c16572740 1 -- 172.21.15.53:0/2526710018 shutdown_connections 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.143+0000 7f9c16572740 1 -- 172.21.15.53:0/2526710018 wait complete. 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.144+0000 7f9c16572740 1 -- start start 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.144+0000 7f9c16572740 1 Processor -- start 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.144+0000 7f9c16572740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72acce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.144+0000 7f9c16572740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726f7390 0x557c72acd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.144+0000 7f9c16572740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c72718070 0x557c72ad9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.144+0000 7f9c16572740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557c72886700 con 0x557c726f7390 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.144+0000 7f9c16572740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557c729aa700 con 0x557c726ef1b0 2024-08-31T06:26:50.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.144+0000 7f9c16572740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557c72acfda0 con 0x557c72718070 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.144+0000 7f9c16572740 10 client.0 _ll_register_callbacks cb 0x557c729d9dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c0dd99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726f7390 0x557c72acd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c0dd99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726f7390 0x557c72acd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44484/0 (socket says 172.21.15.53:44484) 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c0dd99640 1 -- 172.21.15.53:0/2074421724 learned_addr learned my addr 172.21.15.53:0/2074421724 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c0d598640 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c72718070 0x557c72ad9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c0d598640 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72acce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c0dd99640 1 -- 172.21.15.53:0/2074421724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c72718070 msgr2=0x557c72ad9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c0dd99640 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c72718070 0x557c72ad9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c0dd99640 1 -- 172.21.15.53:0/2074421724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 msgr2=0x557c72acce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c0dd99640 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72acce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c0dd99640 1 -- 172.21.15.53:0/2074421724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c729e38b0 con 0x557c726f7390 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c0dd99640 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726f7390 0x557c72acd3c0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f9c04010840 tx=0x7f9c04010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb264fd73405289 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9bf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9bf17fa640 1 -- 172.21.15.53:0/2074421724 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0400ed40 con 0x557c726f7390 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9bf17fa640 1 -- 172.21.15.53:0/2074421724 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f9c0401c480 con 0x557c726f7390 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.145+0000 7f9c16572740 1 -- 172.21.15.53:0/2074421724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c72a36580 con 0x557c726f7390 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9bf17fa640 1 -- 172.21.15.53:0/2074421724 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f9c0401c6c0 con 0x557c726f7390 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9c16572740 10 client.22173 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9c16572740 1 -- 172.21.15.53:0/2074421724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x557c72adbca0 con 0x557c726f7390 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9bf17fa640 1 -- 172.21.15.53:0/2074421724 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557c72a36580 con 0x557c726f7390 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9bf17fa640 1 -- 172.21.15.53:0/2074421724 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f9c04011720 con 0x557c726f7390 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9c16572740 10 client.22173 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9c16572740 10 client.22173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9c16572740 20 client.22173 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9c16572740 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c726d69f0 0x557c72adf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9c16572740 4 client.22173 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9c16572740 1 -- 172.21.15.53:0/2074421724 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c72a32020 con 0x557c726d69f0 2024-08-31T06:26:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.146+0000 7f9c0d598640 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c726d69f0 0x557c72adf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.147+0000 7f9bf17fa640 10 client.22173 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.147+0000 7f9c0d598640 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c726d69f0 0x557c72adf1f0 crc :-1 s=READY pgs=516 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=771b819b01478a39 server_cookie=45f746e842c4856d in_seq=0 out_seq=0 2024-08-31T06:26:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9bf17fa640 1 -- 172.21.15.53:0/2074421724 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c72a32020 con 0x557c726d69f0 2024-08-31T06:26:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9bf17fa640 10 client.22173 handle_command_reply: tid=0 2024-08-31T06:26:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 1 client.22173 shutdown 2024-08-31T06:26:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 1 -- 172.21.15.53:0/2074421724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726f7390 msgr2=0x557c72acd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726f7390 0x557c72acd3c0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f9c04010840 tx=0x7f9c04010d00 comp rx=0 tx=0).stop 2024-08-31T06:26:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 1 -- 172.21.15.53:0/2074421724 shutdown_connections 2024-08-31T06:26:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c726d69f0 0x557c72adf1f0 crc :-1 s=READY pgs=516 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c72718070 0x557c72ad9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726f7390 0x557c72acd3c0 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9bf17fa640 0 client.22173 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 1 --2- 172.21.15.53:0/2074421724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72acce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 1 -- 172.21.15.53:0/2074421724 >> 172.21.15.53:0/2074421724 conn(0x557c7270c460 msgr2=0x557c72abecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 1 -- 172.21.15.53:0/2074421724 shutdown_connections 2024-08-31T06:26:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 1 -- 172.21.15.53:0/2074421724 wait complete. 2024-08-31T06:26:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.148+0000 7f9c16572740 20 client.22173 trim_cache size 0 max 16384 2024-08-31T06:26:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c16572740 1 Processor -- start 2024-08-31T06:26:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c16572740 1 -- start start 2024-08-31T06:26:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c16572740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726ef1b0 0x557c72accdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c16572740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726f7390 0x557c72ad9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c16572740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c72718070 0x557c72ad9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c16572740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081ad1c0 con 0x557c726ef1b0 2024-08-31T06:26:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c16572740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081af000 con 0x557c726f7390 2024-08-31T06:26:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c16572740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081ad950 con 0x557c72718070 2024-08-31T06:26:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c0d598640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726ef1b0 0x557c72accdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c0d598640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726ef1b0 0x557c72accdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44488/0 (socket says 172.21.15.53:44488) 2024-08-31T06:26:50.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c0d598640 1 -- 172.21.15.53:0/1331838549 learned_addr learned my addr 172.21.15.53:0/1331838549 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:50.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.166+0000 7f9c0dd99640 1 --2- 172.21.15.53:0/1331838549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726f7390 0x557c72ad9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.167+0000 7f9c0d598640 1 --2- 172.21.15.53:0/1331838549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c72718070 0x557c72ad9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.167+0000 7f9c0d598640 1 -- 172.21.15.53:0/1331838549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c72718070 msgr2=0x557c72ad9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:50.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.167+0000 7f9c0d598640 1 --2- 172.21.15.53:0/1331838549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c72718070 0x557c72ad9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.167+0000 7f9c0d598640 1 -- 172.21.15.53:0/1331838549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726f7390 msgr2=0x557c72ad9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:50.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.167+0000 7f9c0d598640 1 --2- 172.21.15.53:0/1331838549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726f7390 0x557c72ad9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.167+0000 7f9c0d598640 1 -- 172.21.15.53:0/1331838549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c72acd4d0 con 0x557c726ef1b0 2024-08-31T06:26:50.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.167+0000 7f9c0d598640 1 --2- 172.21.15.53:0/1331838549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726ef1b0 0x557c72accdf0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8032e70 tx=0x7f9bf8032ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a2c745210642d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:50.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.167+0000 7f9bf37fe640 1 -- 172.21.15.53:0/1331838549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8043040 con 0x557c726ef1b0 2024-08-31T06:26:50.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.167+0000 7f9bf37fe640 1 -- 172.21.15.53:0/1331838549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bf80324d0 con 0x557c726ef1b0 2024-08-31T06:26:50.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.167+0000 7f9bf37fe640 1 -- 172.21.15.53:0/1331838549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8035040 con 0x557c726ef1b0 2024-08-31T06:26:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.168+0000 7f9c16572740 1 -- 172.21.15.53:0/1331838549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726ef1b0 msgr2=0x557c72accdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.168+0000 7f9c16572740 1 --2- 172.21.15.53:0/1331838549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726ef1b0 0x557c72accdf0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8032e70 tx=0x7f9bf8032ea0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.168+0000 7f9c16572740 1 -- 172.21.15.53:0/1331838549 shutdown_connections 2024-08-31T06:26:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.168+0000 7f9c16572740 1 --2- 172.21.15.53:0/1331838549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c72718070 0x557c72ad9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.168+0000 7f9c16572740 1 --2- 172.21.15.53:0/1331838549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726f7390 0x557c72ad9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.168+0000 7f9c16572740 1 --2- 172.21.15.53:0/1331838549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c726ef1b0 0x557c72accdf0 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.168+0000 7f9c16572740 1 -- 172.21.15.53:0/1331838549 >> 172.21.15.53:0/1331838549 conn(0x557c7270c460 msgr2=0x557c72acb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.168+0000 7f9c16572740 1 -- 172.21.15.53:0/1331838549 shutdown_connections 2024-08-31T06:26:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.168+0000 7f9c16572740 1 -- 172.21.15.53:0/1331838549 wait complete. 2024-08-31T06:26:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.168+0000 7f9c16572740 1 -- start start 2024-08-31T06:26:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.168+0000 7f9c16572740 1 Processor -- start 2024-08-31T06:26:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c16572740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72ad1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c16572740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c726f7390 0x557c72ad1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c16572740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72b48bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c16572740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081ae870 con 0x557c72718070 2024-08-31T06:26:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c16572740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081ae0e0 con 0x557c726ef1b0 2024-08-31T06:26:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c16572740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081ab1e0 con 0x557c726f7390 2024-08-31T06:26:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c16572740 10 client.0 _ll_register_callbacks cb 0x7f9c0400c410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c0d598640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72b48bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c0d598640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72b48bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44504/0 (socket says 172.21.15.53:44504) 2024-08-31T06:26:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c0d598640 1 -- 172.21.15.53:0/752555662 learned_addr learned my addr 172.21.15.53:0/752555662 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c0dd99640 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c726f7390 0x557c72ad1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c0d598640 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72ad1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c0d598640 1 -- 172.21.15.53:0/752555662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c726f7390 msgr2=0x557c72ad1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c0d598640 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c726f7390 0x557c72ad1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c0d598640 1 -- 172.21.15.53:0/752555662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 msgr2=0x557c72ad1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c0d598640 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72ad1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.169+0000 7f9c0d598640 1 -- 172.21.15.53:0/752555662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c72b49130 con 0x557c72718070 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9c0d598640 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72b48bf0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8005f70 tx=0x7f9bf8005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1faabce98606bbc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9bf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9bf17fa640 1 -- 172.21.15.53:0/752555662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8043030 con 0x557c72718070 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9bf17fa640 1 -- 172.21.15.53:0/752555662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f9bf803a480 con 0x557c72718070 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9c16572740 1 -- 172.21.15.53:0/752555662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bf80324d0 con 0x557c72718070 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9bf17fa640 1 -- 172.21.15.53:0/752555662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f9bf8035040 con 0x557c72718070 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9c16572740 10 client.22179 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9c16572740 1 -- 172.21.15.53:0/752555662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x557c72b4a2b0 con 0x557c72718070 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9bf17fa640 1 -- 172.21.15.53:0/752555662 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bf80324d0 con 0x557c72718070 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9bf17fa640 1 -- 172.21.15.53:0/752555662 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7f9bf8056070 con 0x557c72718070 2024-08-31T06:26:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9c16572740 10 client.22179 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:50.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9c16572740 10 client.22179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:50.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9c16572740 20 client.22179 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:50.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9c16572740 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c726abda0 0x557c72b4c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:50.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.170+0000 7f9c16572740 4 client.22179 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:26:50.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.171+0000 7f9c16572740 1 -- 172.21.15.53:0/752555662 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557c72a2f760 con 0x557c726abda0 2024-08-31T06:26:50.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.171+0000 7f9c0dd99640 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c726abda0 0x557c72b4c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:50.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.172+0000 7f9c0dd99640 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c726abda0 0x557c72b4c540 crc :-1 s=READY pgs=517 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e711c976e53fe08e server_cookie=58642f89514a7b83 in_seq=0 out_seq=0 2024-08-31T06:26:50.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.172+0000 7f9bf17fa640 10 client.22179 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:50.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.172+0000 7f9bf17fa640 1 -- 172.21.15.53:0/752555662 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7954 (crc 0 0 0) 0x557c72a2f760 con 0x557c726abda0 2024-08-31T06:26:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.172+0000 7f9bf17fa640 10 client.22179 handle_command_reply: tid=0 2024-08-31T06:26:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.172+0000 7f9c16572740 1 client.22179 shutdown 2024-08-31T06:26:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.172+0000 7f9c16572740 1 -- 172.21.15.53:0/752555662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 msgr2=0x557c72b48bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.172+0000 7f9c16572740 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72b48bf0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8005f70 tx=0x7f9bf8005700 comp rx=0 tx=0).stop 2024-08-31T06:26:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.173+0000 7f9c16572740 1 -- 172.21.15.53:0/752555662 shutdown_connections 2024-08-31T06:26:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.173+0000 7f9c16572740 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557c726abda0 0x557c72b4c540 crc :-1 s=READY pgs=517 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.173+0000 7f9c16572740 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c72718070 0x557c72b48bf0 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.173+0000 7f9c16572740 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557c726f7390 0x557c72ad1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.173+0000 7f9bf17fa640 0 client.22179 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.173+0000 7f9c16572740 1 --2- 172.21.15.53:0/752555662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c726ef1b0 0x557c72ad1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.173+0000 7f9c16572740 1 -- 172.21.15.53:0/752555662 >> 172.21.15.53:0/752555662 conn(0x557c7270c460 msgr2=0x557c72aba990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:50.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.173+0000 7f9c16572740 1 -- 172.21.15.53:0/752555662 shutdown_connections 2024-08-31T06:26:50.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.173+0000 7f9c16572740 1 -- 172.21.15.53:0/752555662 wait complete. 2024-08-31T06:26:50.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.173+0000 7f9c16572740 20 client.22179 trim_cache size 0 max 16384 2024-08-31T06:26:50.181 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:26:50.182 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:26:50.182 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:26:50.182 INFO:teuthology.orchestra.run.smithi053.stdout: "857f8219-039c-44d2-8dd7-af494d80e735": { 2024-08-31T06:26:50.182 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.182 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "857f8219-039c-44d2-8dd7-af494d80e735", 2024-08-31T06:26:50.182 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:26:50.182 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:50.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.182 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:26:50.183 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:26:50.183 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:26:50.183 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.183 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.183 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.183 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.183 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.183 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:26:50.183 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.184 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:25:55.673122+0000", 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.185 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:26:50.186 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.187 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.188 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.189 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.190 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "857f8219-039c-44d2-8dd7-af494d80e735": { 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:26:48.510100+0000", 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.191 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:26:50.192 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.195 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:26:50.196 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:26:50.197 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:26:50.198 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:26:50.199 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:50.199 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:26:50.199 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:26:50.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 -- 172.21.15.53:0/3251768016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9bf40b4cd0 msgr2=0x7f9bf40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:50.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9bf40b4cd0 0x7f9bf40b71e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000dfd0 tx=0x7f9c00004950 comp rx=0 tx=0).stop 2024-08-31T06:26:50.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 -- 172.21.15.53:0/3251768016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c08108ac0 msgr2=0x7f9c0819fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:50.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c08108ac0 0x7f9c0819fa20 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009fd0 tx=0x7f9c0000b260 comp rx=0 tx=0).stop 2024-08-31T06:26:50.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 -- 172.21.15.53:0/3251768016 shutdown_connections 2024-08-31T06:26:50.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9bf40b4cd0 0x7f9bf40b71e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c08108ac0 0x7f9c0819fa20 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c08108170 0x7f9c0819a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 --2- 172.21.15.53:0/3251768016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c08102880 0x7f9c0819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:50.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 -- 172.21.15.53:0/3251768016 >> 172.21.15.53:0/3251768016 conn(0x7f9c08079550 msgr2=0x7f9c0806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:50.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 -- 172.21.15.53:0/3251768016 shutdown_connections 2024-08-31T06:26:50.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:50.174+0000 7f9c0fffd640 1 -- 172.21.15.53:0/3251768016 wait complete. 2024-08-31T06:26:50.388 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.63 MB/sec execute 398 sec latency 12552.354 ms 2024-08-31T06:26:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:50 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:26:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:50 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:50 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:50.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:50 smithi053 ceph-mon[18924]: pgmap v1011: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 158 op/s 2024-08-31T06:26:50.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:50 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:26:50.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:50 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:50.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:50 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:50.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:50 smithi130 ceph-mon[22266]: pgmap v1011: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 158 op/s 2024-08-31T06:26:50.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:50 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:26:50.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:50 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:50.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:50 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:26:50.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:50 smithi153 ceph-mon[22320]: pgmap v1011: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 158 op/s 2024-08-31T06:26:51.144 INFO:tasks.cephfs.filesystem:scrub status for tag:857f8219-039c-44d2-8dd7-af494d80e735 - {'path': '/', 'tag': '857f8219-039c-44d2-8dd7-af494d80e735', 'options': 'recursive,force'} 2024-08-31T06:26:51.388 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.62 MB/sec execute 399 sec latency 13552.468 ms 2024-08-31T06:26:52.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.60 MB/sec execute 400 sec latency 14552.610 ms 2024-08-31T06:26:52.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:52 smithi130 ceph-mon[22266]: pgmap v1012: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 654 KiB/s wr, 118 op/s 2024-08-31T06:26:52.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:52 smithi153 ceph-mon[22320]: pgmap v1012: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 654 KiB/s wr, 118 op/s 2024-08-31T06:26:52.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:52 smithi053 ceph-mon[18924]: pgmap v1012: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 654 KiB/s wr, 118 op/s 2024-08-31T06:26:53.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.59 MB/sec execute 401 sec latency 15552.727 ms 2024-08-31T06:26:54.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.57 MB/sec execute 402 sec latency 16552.799 ms 2024-08-31T06:26:54.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:54 smithi130 ceph-mon[22266]: pgmap v1013: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 263 KiB/s wr, 74 op/s 2024-08-31T06:26:54.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:54 smithi153 ceph-mon[22320]: pgmap v1013: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 263 KiB/s wr, 74 op/s 2024-08-31T06:26:54.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:54 smithi053 ceph-mon[18924]: pgmap v1013: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 263 KiB/s wr, 74 op/s 2024-08-31T06:26:55.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.56 MB/sec execute 403 sec latency 17552.888 ms 2024-08-31T06:26:56.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.55 MB/sec execute 404 sec latency 18552.962 ms 2024-08-31T06:26:56.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:56 smithi130 ceph-mon[22266]: pgmap v1014: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 157 KiB/s wr, 70 op/s 2024-08-31T06:26:56.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:56 smithi153 ceph-mon[22320]: pgmap v1014: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 157 KiB/s wr, 70 op/s 2024-08-31T06:26:56.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:56 smithi053 ceph-mon[18924]: pgmap v1014: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 157 KiB/s wr, 70 op/s 2024-08-31T06:26:57.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.53 MB/sec execute 405 sec latency 19553.054 ms 2024-08-31T06:26:57.581 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:26:57.848 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.330+0000 7f50585c9640 1 -- 172.21.15.53:0/988469351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5050102830 msgr2=0x7f5050102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.330+0000 7f50585c9640 1 --2- 172.21.15.53:0/988469351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5050102830 0x7f5050102c40 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f504c009900 tx=0x7f504c02a410 comp rx=0 tx=0).stop 2024-08-31T06:26:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.330+0000 7f50585c9640 1 -- 172.21.15.53:0/988469351 shutdown_connections 2024-08-31T06:26:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.330+0000 7f50585c9640 1 --2- 172.21.15.53:0/988469351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5050108ac0 0x7f505010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.330+0000 7f50585c9640 1 --2- 172.21.15.53:0/988469351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5050108170 0x7f5050108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.330+0000 7f50585c9640 1 --2- 172.21.15.53:0/988469351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5050102830 0x7f5050102c40 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.330+0000 7f50585c9640 1 -- 172.21.15.53:0/988469351 >> 172.21.15.53:0/988469351 conn(0x7f50500794f0 msgr2=0x7f5050079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.330+0000 7f50585c9640 1 -- 172.21.15.53:0/988469351 shutdown_connections 2024-08-31T06:26:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.330+0000 7f50585c9640 1 -- 172.21.15.53:0/988469351 wait complete. 2024-08-31T06:26:58.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.331+0000 7f50585c9640 1 Processor -- start 2024-08-31T06:26:58.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.331+0000 7f50585c9640 1 -- start start 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.331+0000 7f50585c9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5050102830 0x7f5050104020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f50585c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5050108170 0x7f5050104560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f50585c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5050108ac0 0x7f5050104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f50585c9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f50501125d0 con 0x7f5050108170 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f50585c9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5050112450 con 0x7f5050102830 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f50585c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5050112750 con 0x7f5050108ac0 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5055b64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5050108170 0x7f5050104560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5055b64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5050108170 0x7f5050104560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52282/0 (socket says 172.21.15.53:52282) 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5055b64640 1 -- 172.21.15.53:0/328636167 learned_addr learned my addr 172.21.15.53:0/328636167 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5056365640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5050102830 0x7f5050104020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5056b66640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5050108ac0 0x7f5050104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5055b64640 1 -- 172.21.15.53:0/328636167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5050108ac0 msgr2=0x7f5050104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5055b64640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5050108ac0 0x7f5050104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5055b64640 1 -- 172.21.15.53:0/328636167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5050102830 msgr2=0x7f5050104020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5055b64640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5050102830 0x7f5050104020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5055b64640 1 -- 172.21.15.53:0/328636167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50501a8380 con 0x7f5050108170 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5056b66640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5050108ac0 0x7f5050104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5056365640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5050102830 0x7f5050104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f5055b64640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5050108170 0x7f5050104560 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f504000d770 tx=0x7f504000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f50477fe640 1 -- 172.21.15.53:0/328636167 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5040017070 con 0x7f5050108170 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f50477fe640 1 -- 172.21.15.53:0/328636167 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5040009c30 con 0x7f5050108170 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f50477fe640 1 -- 172.21.15.53:0/328636167 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504000f620 con 0x7f5050108170 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.332+0000 7f50585c9640 1 -- 172.21.15.53:0/328636167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50501a8670 con 0x7f5050108170 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.333+0000 7f50585c9640 1 -- 172.21.15.53:0/328636167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50501a8b60 con 0x7f5050108170 2024-08-31T06:26:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.333+0000 7f50585c9640 1 -- 172.21.15.53:0/328636167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5050103ab0 con 0x7f5050108170 2024-08-31T06:26:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.335+0000 7f50477fe640 1 -- 172.21.15.53:0/328636167 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f504001a070 con 0x7f5050108170 2024-08-31T06:26:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.336+0000 7f50477fe640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f503c0b4d20 0x7f503c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.336+0000 7f5056365640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f503c0b4d20 0x7f503c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.336+0000 7f50477fe640 1 -- 172.21.15.53:0/328636167 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7f50400e50e0 con 0x7f5050108170 2024-08-31T06:26:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.336+0000 7f5056365640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f503c0b4d20 0x7f503c0b7230 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f504c006010 tx=0x7f504c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:58.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.339+0000 7f50477fe640 1 -- 172.21.15.53:0/328636167 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5040009de0 con 0x7f5050108170 2024-08-31T06:26:58.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.52 MB/sec execute 406 sec latency 20553.122 ms 2024-08-31T06:26:58.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.564+0000 7f50585c9640 1 -- 172.21.15.53:0/328636167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5050105320 con 0x7f5050108170 2024-08-31T06:26:58.566 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:58 smithi053 ceph-mon[18924]: pgmap v1015: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 77 KiB/s wr, 53 op/s 2024-08-31T06:26:58.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.565+0000 7f50477fe640 1 -- 172.21.15.53:0/328636167 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+12013 (secure 0 0 0) 0x7f50400abed0 con 0x7f5050108170 2024-08-31T06:26:58.567 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:26:58.567 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":77,"btime":"2024-08-31T06:26:24:210897+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":77,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:26:23.909504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:26:58.568 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 77 2024-08-31T06:26:58.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 -- 172.21.15.53:0/328636167 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f503c0b4d20 msgr2=0x7f503c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f503c0b4d20 0x7f503c0b7230 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f504c006010 tx=0x7f504c005a20 comp rx=0 tx=0).stop 2024-08-31T06:26:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 -- 172.21.15.53:0/328636167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5050108170 msgr2=0x7f5050104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5050108170 0x7f5050104560 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f504000d770 tx=0x7f504000dc30 comp rx=0 tx=0).stop 2024-08-31T06:26:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 -- 172.21.15.53:0/328636167 shutdown_connections 2024-08-31T06:26:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f503c0b4d20 0x7f503c0b7230 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5050108ac0 0x7f5050104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5050108170 0x7f5050104560 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 --2- 172.21.15.53:0/328636167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5050102830 0x7f5050104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 -- 172.21.15.53:0/328636167 >> 172.21.15.53:0/328636167 conn(0x7f50500794f0 msgr2=0x7f5050101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 -- 172.21.15.53:0/328636167 shutdown_connections 2024-08-31T06:26:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:26:58.567+0000 7f50585c9640 1 -- 172.21.15.53:0/328636167 wait complete. 2024-08-31T06:26:58.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:58 smithi130 ceph-mon[22266]: pgmap v1015: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 77 KiB/s wr, 53 op/s 2024-08-31T06:26:58.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:58 smithi153 ceph-mon[22320]: pgmap v1015: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 77 KiB/s wr, 53 op/s 2024-08-31T06:26:59.308 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id 294469b2 --release --await' 2024-08-31T06:26:59.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id 294469b2 --release --await 2024-08-31T06:26:59.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55710 5.51 MB/sec execute 407 sec latency 21553.172 ms 2024-08-31T06:26:59.564 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:26:59.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:26:59 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/328636167' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:26:59.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:26:59 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/328636167' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:26:59.685 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:26:59 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/328636167' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:26:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.931+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3149735116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa444108180 msgr2=0x7fa44410e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.931+0000 7fa44bbc3640 1 --2- 172.21.15.53:0/3149735116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa444108180 0x7fa44410e9b0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009ca0 tx=0x7fa43c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.931+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3149735116 shutdown_connections 2024-08-31T06:26:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.931+0000 7fa44bbc3640 1 --2- 172.21.15.53:0/3149735116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa444108180 0x7fa44410e9b0 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.931+0000 7fa44bbc3640 1 --2- 172.21.15.53:0/3149735116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa444107830 0x7fa444107c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.931+0000 7fa44bbc3640 1 --2- 172.21.15.53:0/3149735116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa444101f00 0x7fa444102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.931+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3149735116 >> 172.21.15.53:0/3149735116 conn(0x7fa444079c60 msgr2=0x7fa44407a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.931+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3149735116 shutdown_connections 2024-08-31T06:26:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.931+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3149735116 wait complete. 2024-08-31T06:26:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44bbc3640 1 Processor -- start 2024-08-31T06:26:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44bbc3640 1 -- start start 2024-08-31T06:26:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44bbc3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa444101f00 0x7fa44419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44bbc3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa444107830 0x7fa44419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44bbc3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa444108180 0x7fa44419f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44bbc3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441136a0 con 0x7fa444108180 2024-08-31T06:26:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44bbc3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa444113520 con 0x7fa444107830 2024-08-31T06:26:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44bbc3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa444113820 con 0x7fa444101f00 2024-08-31T06:26:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44a160640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa444108180 0x7fa44419f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44a160640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa444108180 0x7fa44419f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52296/0 (socket says 172.21.15.53:52296) 2024-08-31T06:26:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44a160640 1 -- 172.21.15.53:0/3908657601 learned_addr learned my addr 172.21.15.53:0/3908657601 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44915e640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa444107830 0x7fa44419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44995f640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa444101f00 0x7fa44419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44a160640 1 -- 172.21.15.53:0/3908657601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa444101f00 msgr2=0x7fa44419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44a160640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa444101f00 0x7fa44419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44a160640 1 -- 172.21.15.53:0/3908657601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa444107830 msgr2=0x7fa44419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44a160640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa444107830 0x7fa44419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.932+0000 7fa44a160640 1 -- 172.21.15.53:0/3908657601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44419ffd0 con 0x7fa444108180 2024-08-31T06:26:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.933+0000 7fa44a160640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa444108180 0x7fa44419f8d0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fa43c005cc0 tx=0x7fa43c032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.933+0000 7fa43affd640 1 -- 172.21.15.53:0/3908657601 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c032e00 con 0x7fa444108180 2024-08-31T06:26:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.933+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3908657601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4441a0260 con 0x7fa444108180 2024-08-31T06:26:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.933+0000 7fa43affd640 1 -- 172.21.15.53:0/3908657601 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa43c0044d0 con 0x7fa444108180 2024-08-31T06:26:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.933+0000 7fa43affd640 1 -- 172.21.15.53:0/3908657601 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c030b70 con 0x7fa444108180 2024-08-31T06:26:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.933+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3908657601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4441a6a50 con 0x7fa444108180 2024-08-31T06:26:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.936+0000 7fa452c0b740 1 Processor -- start 2024-08-31T06:26:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.936+0000 7fa43affd640 1 -- 172.21.15.53:0/3908657601 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa43c004040 con 0x7fa444108180 2024-08-31T06:26:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa452c0b740 1 -- start start 2024-08-31T06:26:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcc3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b8f72f0 0x56153bcc4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcc4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa452c0b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56153bc39000 con 0x56153b9201b0 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa452c0b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56153bc28590 con 0x56153b8ff4d0 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa452c0b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56153bc2c540 con 0x56153b8f72f0 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa44915e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcc3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa44915e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcc3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52300/0 (socket says 172.21.15.53:52300) 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa44915e640 1 -- 172.21.15.53:0/2076490744 learned_addr learned my addr 172.21.15.53:0/2076490744 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa44995f640 1 --2- 172.21.15.53:0/2076490744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b8f72f0 0x56153bcc4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa44915e640 1 --2- 172.21.15.53:0/2076490744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcc4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa43affd640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4300b4ca0 0x7fa4300b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa44915e640 1 -- 172.21.15.53:0/2076490744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b8f72f0 msgr2=0x56153bcc4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa44915e640 1 --2- 172.21.15.53:0/2076490744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b8f72f0 0x56153bcc4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa44915e640 1 -- 172.21.15.53:0/2076490744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 msgr2=0x56153bcc4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa44915e640 1 --2- 172.21.15.53:0/2076490744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcc4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa44915e640 1 -- 172.21.15.53:0/2076490744 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56153b98b790 con 0x56153b9201b0 2024-08-31T06:26:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa44a160640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4300b4ca0 0x7fa4300b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.937+0000 7fa43affd640 1 -- 172.21.15.53:0/3908657601 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fa43c1068c0 con 0x7fa444108180 2024-08-31T06:26:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.938+0000 7fa44915e640 1 --2- 172.21.15.53:0/2076490744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcc3ac0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7fa43400bfc0 tx=0x7fa43400b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0bd7a66aca5e4d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.938+0000 7fa42ffff640 1 -- 172.21.15.53:0/2076490744 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434004230 con 0x56153b9201b0 2024-08-31T06:26:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.938+0000 7fa42ffff640 1 -- 172.21.15.53:0/2076490744 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4340043d0 con 0x56153b9201b0 2024-08-31T06:26:59.942 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.938+0000 7fa42ffff640 1 -- 172.21.15.53:0/2076490744 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4340107d0 con 0x56153b9201b0 2024-08-31T06:26:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa452c0b740 1 -- 172.21.15.53:0/2076490744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 msgr2=0x56153bcc3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa44a160640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4300b4ca0 0x7fa4300b71b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0ca1a0 tx=0x7fa43c091de0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2076490744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcc3ac0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7fa43400bfc0 tx=0x7fa43400b740 comp rx=0 tx=0).stop 2024-08-31T06:26:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa452c0b740 1 -- 172.21.15.53:0/2076490744 shutdown_connections 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2076490744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcc4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2076490744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b8f72f0 0x56153bcc4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2076490744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcc3ac0 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa452c0b740 1 -- 172.21.15.53:0/2076490744 >> 172.21.15.53:0/2076490744 conn(0x56153b914300 msgr2=0x56153bcc19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa452c0b740 1 -- 172.21.15.53:0/2076490744 shutdown_connections 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa452c0b740 1 -- 172.21.15.53:0/2076490744 wait complete. 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa452c0b740 1 -- start start 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.939+0000 7fa452c0b740 1 Processor -- start 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8f72f0 0x56153bccf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8ff4d0 0x56153bccfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b9201b0 0x56153bcdb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa452c0b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56153bb61ab0 con 0x56153b8ff4d0 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa452c0b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56153bbaf680 con 0x56153b8f72f0 2024-08-31T06:26:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa452c0b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56153bcd2240 con 0x56153b9201b0 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa452c0b740 10 client.0 _ll_register_callbacks cb 0x56153b937a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa44995f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8ff4d0 0x56153bccfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa44995f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8ff4d0 0x56153bccfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52302/0 (socket says 172.21.15.53:52302) 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa44995f640 1 -- 172.21.15.53:0/2981369366 learned_addr learned my addr 172.21.15.53:0/2981369366 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa44915e640 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8f72f0 0x56153bccf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa44915e640 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b9201b0 0x56153bcdb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa44995f640 1 -- 172.21.15.53:0/2981369366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b9201b0 msgr2=0x56153bcdb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa44995f640 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b9201b0 0x56153bcdb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa44995f640 1 -- 172.21.15.53:0/2981369366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8f72f0 msgr2=0x56153bccf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa44995f640 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8f72f0 0x56153bccf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa44995f640 1 -- 172.21.15.53:0/2981369366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56153ba04620 con 0x56153b8ff4d0 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa44995f640 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8ff4d0 0x56153bccfc10 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fa4400124d0 tx=0x7fa440012990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a946d84faf2df04e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.940+0000 7fa42d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2981369366 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44001f060 con 0x56153b8ff4d0 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2981369366 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fa4400109e0 con 0x56153b8ff4d0 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa452c0b740 1 -- 172.21.15.53:0/2981369366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4340043d0 con 0x56153b8ff4d0 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2981369366 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fa440010be0 con 0x56153b8ff4d0 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa452c0b740 10 client.22197 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa452c0b740 1 -- 172.21.15.53:0/2981369366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x56153bcde300 con 0x56153b8ff4d0 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2981369366 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4340043d0 con 0x56153b8ff4d0 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2981369366 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7fa440019030 con 0x56153b8ff4d0 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa452c0b740 10 client.22197 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa452c0b740 10 client.22197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa452c0b740 20 client.22197 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56153b8ded80 0x56153bce18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa452c0b740 4 client.22197 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:26:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa452c0b740 1 -- 172.21.15.53:0/2981369366 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56153bc3af50 con 0x56153b8ded80 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.941+0000 7fa44915e640 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56153b8ded80 0x56153bce18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.942+0000 7fa44915e640 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56153b8ded80 0x56153bce18f0 crc :-1 s=READY pgs=518 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e4bfe6ca529b33d server_cookie=cc60817a762a7f0a in_seq=0 out_seq=0 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.942+0000 7fa42d7fa640 10 client.22197 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2981369366 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56153bc3af50 con 0x56153b8ded80 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa42d7fa640 10 client.22197 handle_command_reply: tid=0 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 1 client.22197 shutdown 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 1 -- 172.21.15.53:0/2981369366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8ff4d0 msgr2=0x56153bccfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8ff4d0 0x56153bccfc10 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fa4400124d0 tx=0x7fa440012990 comp rx=0 tx=0).stop 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 1 -- 172.21.15.53:0/2981369366 shutdown_connections 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56153b8ded80 0x56153bce18f0 crc :-1 s=READY pgs=518 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b9201b0 0x56153bcdb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8ff4d0 0x56153bccfc10 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2981369366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8f72f0 0x56153bccf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa42d7fa640 0 client.22197 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 1 -- 172.21.15.53:0/2981369366 >> 172.21.15.53:0/2981369366 conn(0x56153b914300 msgr2=0x56153bcc4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 1 -- 172.21.15.53:0/2981369366 shutdown_connections 2024-08-31T06:26:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 1 -- 172.21.15.53:0/2981369366 wait complete. 2024-08-31T06:26:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.943+0000 7fa452c0b740 20 client.22197 trim_cache size 0 max 16384 2024-08-31T06:26:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa452c0b740 1 Processor -- start 2024-08-31T06:26:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa452c0b740 1 -- start start 2024-08-31T06:26:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b8f72f0 0x56153bcc9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcdb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcdb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa452c0b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441af4a0 con 0x56153b9201b0 2024-08-31T06:26:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa452c0b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b12e0 con 0x56153b8ff4d0 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa452c0b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441afc30 con 0x56153b8f72f0 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44915e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcdb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44915e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcdb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52314/0 (socket says 172.21.15.53:52314) 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44915e640 1 -- 172.21.15.53:0/2291737424 learned_addr learned my addr 172.21.15.53:0/2291737424 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44915e640 1 --2- 172.21.15.53:0/2291737424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b8f72f0 0x56153bcc9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44915e640 1 -- 172.21.15.53:0/2291737424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b8f72f0 msgr2=0x56153bcc9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44915e640 1 --2- 172.21.15.53:0/2291737424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b8f72f0 0x56153bcc9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44915e640 1 -- 172.21.15.53:0/2291737424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 msgr2=0x56153bcdb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44995f640 1 --2- 172.21.15.53:0/2291737424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcdb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44915e640 1 --2- 172.21.15.53:0/2291737424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcdb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44915e640 1 -- 172.21.15.53:0/2291737424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56153bcc5df0 con 0x56153b9201b0 2024-08-31T06:26:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44995f640 1 --2- 172.21.15.53:0/2291737424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcdb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.958+0000 7fa44915e640 1 --2- 172.21.15.53:0/2291737424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcdb970 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7fa434012de0 tx=0x7fa434003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593b43899eb28605 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa42f7fe640 1 -- 172.21.15.53:0/2291737424 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434003f90 con 0x56153b9201b0 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa42f7fe640 1 -- 172.21.15.53:0/2291737424 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa434005050 con 0x56153b9201b0 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa42f7fe640 1 -- 172.21.15.53:0/2291737424 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4340039c0 con 0x56153b9201b0 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa452c0b740 1 -- 172.21.15.53:0/2291737424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 msgr2=0x56153bcdb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2291737424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcdb970 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7fa434012de0 tx=0x7fa434003f20 comp rx=0 tx=0).stop 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa452c0b740 1 -- 172.21.15.53:0/2291737424 shutdown_connections 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2291737424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b9201b0 0x56153bcdb970 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2291737424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcdb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2291737424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b8f72f0 0x56153bcc9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa452c0b740 1 -- 172.21.15.53:0/2291737424 >> 172.21.15.53:0/2291737424 conn(0x56153b914300 msgr2=0x56153bcc8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa452c0b740 1 -- 172.21.15.53:0/2291737424 shutdown_connections 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.959+0000 7fa452c0b740 1 -- 172.21.15.53:0/2291737424 wait complete. 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa452c0b740 1 -- start start 2024-08-31T06:26:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa452c0b740 1 Processor -- start 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8f72f0 0x56153bcd3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcd4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa452c0b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b9201b0 0x56153bd4b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa452c0b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b0b50 con 0x56153b8f72f0 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa452c0b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b03c0 con 0x56153b8ff4d0 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa452c0b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441ad4a0 con 0x56153b9201b0 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa452c0b740 10 client.0 _ll_register_callbacks cb 0x7fa44000d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa44915e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8f72f0 0x56153bcd3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa44915e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8f72f0 0x56153bcd3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52330/0 (socket says 172.21.15.53:52330) 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.960+0000 7fa44915e640 1 -- 172.21.15.53:0/2392948635 learned_addr learned my addr 172.21.15.53:0/2392948635 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa44915e640 1 -- 172.21.15.53:0/2392948635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b9201b0 msgr2=0x56153bd4b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa44915e640 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b9201b0 0x56153bd4b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa44995f640 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcd4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa44915e640 1 -- 172.21.15.53:0/2392948635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 msgr2=0x56153bcd4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa44915e640 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcd4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa44915e640 1 -- 172.21.15.53:0/2392948635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56153bd4b870 con 0x56153b8f72f0 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa44995f640 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcd4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa44915e640 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8f72f0 0x56153bcd3bc0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7fa434005320 tx=0x7fa434005350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc6d4800e3bfd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa42d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2392948635 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4340037f0 con 0x56153b8f72f0 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2392948635 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fa434003990 con 0x56153b8f72f0 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa452c0b740 1 -- 172.21.15.53:0/2392948635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa434005050 con 0x56153b8f72f0 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2392948635 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fa434005630 con 0x56153b8f72f0 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa452c0b740 10 client.22203 fetch_fsmap learned FSMap version 77 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa452c0b740 1 -- 172.21.15.53:0/2392948635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x56153bd4ca50 con 0x56153b8f72f0 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2392948635 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa434005050 con 0x56153b8f72f0 2024-08-31T06:26:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.961+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2392948635 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7fa434034430 con 0x56153b8f72f0 2024-08-31T06:26:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.962+0000 7fa452c0b740 10 client.22203 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:26:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.962+0000 7fa452c0b740 10 client.22203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:26:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.962+0000 7fa452c0b740 20 client.22203 populate_metadata read hostname 'smithi053' 2024-08-31T06:26:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.962+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56153b8b41c0 0x56153bd4f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:26:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.962+0000 7fa452c0b740 4 client.22203 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:26:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.962+0000 7fa452c0b740 1 -- 172.21.15.53:0/2392948635 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56153bc369f0 con 0x56153b8b41c0 2024-08-31T06:26:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.962+0000 7fa44995f640 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56153b8b41c0 0x56153bd4f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:26:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.962+0000 7fa42d7fa640 10 client.22203 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.962+0000 7fa44995f640 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56153b8b41c0 0x56153bd4f0f0 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fe02e5dee8d463 server_cookie=51619626f60cb659 in_seq=0 out_seq=0 2024-08-31T06:26:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.994+0000 7fa42d7fa640 1 -- 172.21.15.53:0/2392948635 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56153bc369f0 con 0x56153b8b41c0 2024-08-31T06:26:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.994+0000 7fa42d7fa640 10 client.22203 handle_command_reply: tid=0 2024-08-31T06:26:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.994+0000 7fa452c0b740 1 client.22203 shutdown 2024-08-31T06:26:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.994+0000 7fa452c0b740 1 -- 172.21.15.53:0/2392948635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8f72f0 msgr2=0x56153bcd3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.994+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8f72f0 0x56153bcd3bc0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7fa434005320 tx=0x7fa434005350 comp rx=0 tx=0).stop 2024-08-31T06:26:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa452c0b740 1 -- 172.21.15.53:0/2392948635 shutdown_connections 2024-08-31T06:26:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56153b8b41c0 0x56153bd4f0f0 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56153b9201b0 0x56153bd4b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56153b8ff4d0 0x56153bcd4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa42d7fa640 0 client.22203 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:26:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa452c0b740 1 --2- 172.21.15.53:0/2392948635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56153b8f72f0 0x56153bcd3bc0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa452c0b740 1 -- 172.21.15.53:0/2392948635 >> 172.21.15.53:0/2392948635 conn(0x56153b914300 msgr2=0x56153bcc1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:26:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa452c0b740 1 -- 172.21.15.53:0/2392948635 shutdown_connections 2024-08-31T06:26:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa452c0b740 1 -- 172.21.15.53:0/2392948635 wait complete. 2024-08-31T06:26:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa452c0b740 20 client.22203 trim_cache size 0 max 16384 2024-08-31T06:26:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:26:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:26:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:26:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:26:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3908657601 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4300b4ca0 msgr2=0x7fa4300b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:26:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa44bbc3640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4300b4ca0 0x7fa4300b71b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0ca1a0 tx=0x7fa43c091de0 comp rx=0 tx=0).stop 2024-08-31T06:26:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3908657601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa444108180 msgr2=0x7fa44419f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa44bbc3640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa444108180 0x7fa44419f8d0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fa43c005cc0 tx=0x7fa43c032a10 comp rx=0 tx=0).stop 2024-08-31T06:27:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3908657601 shutdown_connections 2024-08-31T06:27:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa44bbc3640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa4300b4ca0 0x7fa4300b71b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa44bbc3640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa444108180 0x7fa44419f8d0 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa44bbc3640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa444107830 0x7fa44419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa44bbc3640 1 --2- 172.21.15.53:0/3908657601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa444101f00 0x7fa44419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.995+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3908657601 >> 172.21.15.53:0/3908657601 conn(0x7fa444079c60 msgr2=0x7fa444105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.996+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3908657601 shutdown_connections 2024-08-31T06:27:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:26:59.996+0000 7fa44bbc3640 1 -- 172.21.15.53:0/3908657601 wait complete. 2024-08-31T06:27:00.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.080+0000 7fe21e121640 1 -- 172.21.15.53:0/3193450695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218104f00 msgr2=0x7fe21810d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:00.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.080+0000 7fe21e121640 1 --2- 172.21.15.53:0/3193450695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218104f00 0x7fe21810d450 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fe208009900 tx=0x7fe20802a410 comp rx=0 tx=0).stop 2024-08-31T06:27:00.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.080+0000 7fe21e121640 1 -- 172.21.15.53:0/3193450695 shutdown_connections 2024-08-31T06:27:00.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.080+0000 7fe21e121640 1 --2- 172.21.15.53:0/3193450695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe21810da10 0x7fe21810ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.080+0000 7fe21e121640 1 --2- 172.21.15.53:0/3193450695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe218104f00 0x7fe21810d450 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.080+0000 7fe21e121640 1 --2- 172.21.15.53:0/3193450695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2181045b0 0x7fe2181049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.080+0000 7fe21e121640 1 -- 172.21.15.53:0/3193450695 >> 172.21.15.53:0/3193450695 conn(0x7fe2180fe0f0 msgr2=0x7fe218100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.080+0000 7fe21e121640 1 -- 172.21.15.53:0/3193450695 shutdown_connections 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.080+0000 7fe21e121640 1 -- 172.21.15.53:0/3193450695 wait complete. 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.080+0000 7fe21e121640 1 Processor -- start 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21e121640 1 -- start start 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21e121640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2181045b0 0x7fe218199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21e121640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe218104f00 0x7fe21819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21e121640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21810da10 0x7fe21819f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21e121640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe218113580 con 0x7fe21810da10 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21e121640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe218113400 con 0x7fe2181045b0 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21e121640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe218113700 con 0x7fe218104f00 2024-08-31T06:27:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21d920640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21810da10 0x7fe21819f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21d920640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21810da10 0x7fe21819f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52344/0 (socket says 172.21.15.53:52344) 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21d920640 1 -- 172.21.15.53:0/1569710205 learned_addr learned my addr 172.21.15.53:0/1569710205 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21d11f640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2181045b0 0x7fe218199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21c91e640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe218104f00 0x7fe21819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21d920640 1 -- 172.21.15.53:0/1569710205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe218104f00 msgr2=0x7fe21819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21d920640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe218104f00 0x7fe21819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21d920640 1 -- 172.21.15.53:0/1569710205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2181045b0 msgr2=0x7fe218199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21d920640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2181045b0 0x7fe218199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.081+0000 7fe21d920640 1 -- 172.21.15.53:0/1569710205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21819ff60 con 0x7fe21810da10 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.082+0000 7fe21d920640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21810da10 0x7fe21819f830 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fe21000b970 tx=0x7fe21000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.082+0000 7fe20e7fc640 1 -- 172.21.15.53:0/1569710205 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210019070 con 0x7fe21810da10 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.082+0000 7fe20e7fc640 1 -- 172.21.15.53:0/1569710205 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe210014440 con 0x7fe21810da10 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.082+0000 7fe21e121640 1 -- 172.21.15.53:0/1569710205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2181a0250 con 0x7fe21810da10 2024-08-31T06:27:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.082+0000 7fe20e7fc640 1 -- 172.21.15.53:0/1569710205 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2100075d0 con 0x7fe21810da10 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.082+0000 7fe21e121640 1 -- 172.21.15.53:0/1569710205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2181a69b0 con 0x7fe21810da10 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.084+0000 7fe2258f8740 1 Processor -- start 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe20e7fc640 1 -- 172.21.15.53:0/1569710205 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe21001c070 con 0x7fe21810da10 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe2258f8740 1 -- start start 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f78e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2baa660 0x556ac2f793b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bb2840 0x556ac2f798f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe2258f8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556ac2eefa70 con 0x556ac2bd3520 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe2258f8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556ac2edf000 con 0x556ac2bb2840 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe2258f8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556ac2ee2fb0 con 0x556ac2baa660 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe21c91e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f78e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe21c91e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f78e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52350/0 (socket says 172.21.15.53:52350) 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe21c91e640 1 -- 172.21.15.53:0/3122967837 learned_addr learned my addr 172.21.15.53:0/3122967837 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe21d11f640 1 --2- 172.21.15.53:0/3122967837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2baa660 0x556ac2f793b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.085+0000 7fe21c91e640 1 --2- 172.21.15.53:0/3122967837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bb2840 0x556ac2f798f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe21c91e640 1 -- 172.21.15.53:0/3122967837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2baa660 msgr2=0x556ac2f793b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe20e7fc640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4d20 0x7fe2040b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe21c91e640 1 --2- 172.21.15.53:0/3122967837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2baa660 0x556ac2f793b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe21c91e640 1 -- 172.21.15.53:0/3122967837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bb2840 msgr2=0x556ac2f798f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe21c91e640 1 --2- 172.21.15.53:0/3122967837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bb2840 0x556ac2f798f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe21c91e640 1 -- 172.21.15.53:0/3122967837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac2c3eb00 con 0x556ac2bd3520 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe21d11f640 1 --2- 172.21.15.53:0/3122967837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2baa660 0x556ac2f793b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe21d920640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4d20 0x7fe2040b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe21c91e640 1 --2- 172.21.15.53:0/3122967837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f78e70 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fe208005ab0 tx=0x7fe208005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f23546b3482bb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe20e7fc640 1 -- 172.21.15.53:0/1569710205 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fe2100e4a30 con 0x7fe21810da10 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe2037fe640 1 -- 172.21.15.53:0/3122967837 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208035050 con 0x556ac2bd3520 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe2037fe640 1 -- 172.21.15.53:0/3122967837 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2080044b0 con 0x556ac2bd3520 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe2037fe640 1 -- 172.21.15.53:0/3122967837 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208004700 con 0x556ac2bd3520 2024-08-31T06:27:00.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.086+0000 7fe21d920640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4d20 0x7fe2040b7230 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe2100e2210 tx=0x7fe2100aaed0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.087+0000 7fe2258f8740 1 -- 172.21.15.53:0/3122967837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 msgr2=0x556ac2f78e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.087+0000 7fe2258f8740 1 --2- 172.21.15.53:0/3122967837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f78e70 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fe208005ab0 tx=0x7fe208005a20 comp rx=0 tx=0).stop 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.087+0000 7fe2258f8740 1 -- 172.21.15.53:0/3122967837 shutdown_connections 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.087+0000 7fe2258f8740 1 --2- 172.21.15.53:0/3122967837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bb2840 0x556ac2f798f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.087+0000 7fe2258f8740 1 --2- 172.21.15.53:0/3122967837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2baa660 0x556ac2f793b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.087+0000 7fe2258f8740 1 --2- 172.21.15.53:0/3122967837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f78e70 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.087+0000 7fe2258f8740 1 -- 172.21.15.53:0/3122967837 >> 172.21.15.53:0/3122967837 conn(0x556ac2bc7910 msgr2=0x556ac2f76d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.087+0000 7fe2258f8740 1 -- 172.21.15.53:0/3122967837 shutdown_connections 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.087+0000 7fe2258f8740 1 -- 172.21.15.53:0/3122967837 wait complete. 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe2258f8740 1 -- start start 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe2258f8740 1 Processor -- start 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f88e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2bb2840 0x556ac2f89390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bd3520 0x556ac2f94e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe2258f8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556ac2f8b8f0 con 0x556ac2baa660 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe2258f8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556ac2ea0520 con 0x556ac2bd3520 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe2258f8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556ac2f8ba70 con 0x556ac2bb2840 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe2258f8740 10 client.0 _ll_register_callbacks cb 0x556ac2ed8c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe21c91e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f88e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe21c91e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f88e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52352/0 (socket says 172.21.15.53:52352) 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.088+0000 7fe21c91e640 1 -- 172.21.15.53:0/745243790 learned_addr learned my addr 172.21.15.53:0/745243790 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe21d11f640 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2bb2840 0x556ac2f89390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe21c91e640 1 -- 172.21.15.53:0/745243790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2bb2840 msgr2=0x556ac2f89390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe21c91e640 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2bb2840 0x556ac2f89390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe21c91e640 1 -- 172.21.15.53:0/745243790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bd3520 msgr2=0x556ac2f94e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe21c91e640 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bd3520 0x556ac2f94e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe21c91e640 1 -- 172.21.15.53:0/745243790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac2cb5960 con 0x556ac2baa660 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe21c91e640 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f88e50 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7fe208031970 tx=0x7fe208004020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ac424801b6b710 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe200ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe200ff9640 1 -- 172.21.15.53:0/745243790 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20804f060 con 0x556ac2baa660 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe200ff9640 1 -- 172.21.15.53:0/745243790 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fe208004450 con 0x556ac2baa660 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe2258f8740 1 -- 172.21.15.53:0/745243790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ac2e7e9a0 con 0x556ac2baa660 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe200ff9640 1 -- 172.21.15.53:0/745243790 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fe208035040 con 0x556ac2baa660 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe2258f8740 10 client.22215 fetch_fsmap learned FSMap version 77 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe2258f8740 1 -- 172.21.15.53:0/745243790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x556ac2f97b20 con 0x556ac2baa660 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.089+0000 7fe200ff9640 1 -- 172.21.15.53:0/745243790 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556ac2e7e9a0 con 0x556ac2baa660 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.090+0000 7fe200ff9640 1 -- 172.21.15.53:0/745243790 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7fe2080535a0 con 0x556ac2baa660 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.090+0000 7fe2258f8740 10 client.22215 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.090+0000 7fe2258f8740 10 client.22215 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.090+0000 7fe2258f8740 20 client.22215 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.090+0000 7fe2258f8740 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556ac2b91ea0 0x556ac2f9ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.090+0000 7fe2258f8740 4 client.22215 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.090+0000 7fe2258f8740 1 -- 172.21.15.53:0/745243790 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ac2ef19c0 con 0x556ac2b91ea0 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.090+0000 7fe21d11f640 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556ac2b91ea0 0x556ac2f9ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.091+0000 7fe21d11f640 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556ac2b91ea0 0x556ac2f9ae80 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76a4a7c28daaaf1 server_cookie=8168ccc5891691e0 in_seq=0 out_seq=0 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.091+0000 7fe200ff9640 10 client.22215 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe200ff9640 1 -- 172.21.15.53:0/745243790 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ac2ef19c0 con 0x556ac2b91ea0 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe200ff9640 10 client.22215 handle_command_reply: tid=0 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 1 client.22215 shutdown 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 1 -- 172.21.15.53:0/745243790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 msgr2=0x556ac2f88e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f88e50 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7fe208031970 tx=0x7fe208004020 comp rx=0 tx=0).stop 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 1 -- 172.21.15.53:0/745243790 shutdown_connections 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556ac2b91ea0 0x556ac2f9ae80 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bd3520 0x556ac2f94e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2bb2840 0x556ac2f89390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe200ff9640 0 client.22215 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:00.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 1 --2- 172.21.15.53:0/745243790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f88e50 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 1 -- 172.21.15.53:0/745243790 >> 172.21.15.53:0/745243790 conn(0x556ac2bc7910 msgr2=0x556ac2f753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:00.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 1 -- 172.21.15.53:0/745243790 shutdown_connections 2024-08-31T06:27:00.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 1 -- 172.21.15.53:0/745243790 wait complete. 2024-08-31T06:27:00.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.092+0000 7fe2258f8740 20 client.22215 trim_cache size 0 max 16384 2024-08-31T06:27:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe2258f8740 1 Processor -- start 2024-08-31T06:27:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe2258f8740 1 -- start start 2024-08-31T06:27:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2baa660 0x556ac2f7a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bb2840 0x556ac2f94d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe2258f8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181ad0c0 con 0x556ac2bd3520 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe2258f8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181aef00 con 0x556ac2bb2840 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe2258f8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181ad850 con 0x556ac2baa660 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe21c91e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe21c91e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f952b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52356/0 (socket says 172.21.15.53:52356) 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe21c91e640 1 -- 172.21.15.53:0/2649841263 learned_addr learned my addr 172.21.15.53:0/2649841263 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe21c91e640 1 --2- 172.21.15.53:0/2649841263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2baa660 0x556ac2f7a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe21c91e640 1 -- 172.21.15.53:0/2649841263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2baa660 msgr2=0x556ac2f7a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe21d11f640 1 --2- 172.21.15.53:0/2649841263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bb2840 0x556ac2f94d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe21c91e640 1 --2- 172.21.15.53:0/2649841263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2baa660 0x556ac2f7a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe21c91e640 1 -- 172.21.15.53:0/2649841263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bb2840 msgr2=0x556ac2f94d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:00.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.110+0000 7fe21c91e640 1 --2- 172.21.15.53:0/2649841263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bb2840 0x556ac2f94d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.111+0000 7fe21c91e640 1 -- 172.21.15.53:0/2649841263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac2f7bca0 con 0x556ac2bd3520 2024-08-31T06:27:00.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.111+0000 7fe21c91e640 1 --2- 172.21.15.53:0/2649841263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f952b0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fe208053970 tx=0x7fe208032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139c4a81a54e23b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.111+0000 7fe202ffd640 1 -- 172.21.15.53:0/2649841263 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20804f070 con 0x556ac2bd3520 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.111+0000 7fe202ffd640 1 -- 172.21.15.53:0/2649841263 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe208041070 con 0x556ac2bd3520 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.111+0000 7fe202ffd640 1 -- 172.21.15.53:0/2649841263 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208003c30 con 0x556ac2bd3520 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.112+0000 7fe2258f8740 1 -- 172.21.15.53:0/2649841263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 msgr2=0x556ac2f952b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.112+0000 7fe2258f8740 1 --2- 172.21.15.53:0/2649841263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f952b0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fe208053970 tx=0x7fe208032b60 comp rx=0 tx=0).stop 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.112+0000 7fe2258f8740 1 -- 172.21.15.53:0/2649841263 shutdown_connections 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.112+0000 7fe2258f8740 1 --2- 172.21.15.53:0/2649841263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2bd3520 0x556ac2f952b0 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.112+0000 7fe2258f8740 1 --2- 172.21.15.53:0/2649841263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bb2840 0x556ac2f94d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.112+0000 7fe2258f8740 1 --2- 172.21.15.53:0/2649841263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2baa660 0x556ac2f7a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.112+0000 7fe2258f8740 1 -- 172.21.15.53:0/2649841263 >> 172.21.15.53:0/2649841263 conn(0x556ac2bc7910 msgr2=0x556ac2f76730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.112+0000 7fe2258f8740 1 -- 172.21.15.53:0/2649841263 shutdown_connections 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.112+0000 7fe2258f8740 1 -- 172.21.15.53:0/2649841263 wait complete. 2024-08-31T06:27:00.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.112+0000 7fe2258f8740 1 -- start start 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.112+0000 7fe2258f8740 1 Processor -- start 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f9c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2bb2840 0x556ac2f9ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe2258f8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bd3520 0x556ac2ffe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe2258f8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181ae770 con 0x556ac2baa660 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe2258f8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181adfe0 con 0x556ac2bd3520 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe2258f8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181ab0c0 con 0x556ac2bb2840 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe2258f8740 10 client.0 _ll_register_callbacks cb 0x7fe208032f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe21c91e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f9c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe21c91e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f9c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52362/0 (socket says 172.21.15.53:52362) 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe21c91e640 1 -- 172.21.15.53:0/2207597769 learned_addr learned my addr 172.21.15.53:0/2207597769 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe21d11f640 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2bb2840 0x556ac2f9ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe21c91e640 1 -- 172.21.15.53:0/2207597769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2bb2840 msgr2=0x556ac2f9ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe21c91e640 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2bb2840 0x556ac2f9ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe21c91e640 1 -- 172.21.15.53:0/2207597769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bd3520 msgr2=0x556ac2ffe5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe21c91e640 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bd3520 0x556ac2ffe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe21c91e640 1 -- 172.21.15.53:0/2207597769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac2ffec40 con 0x556ac2baa660 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.113+0000 7fe21d11f640 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2bb2840 0x556ac2f9ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe21c91e640 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f9c710 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fe208009820 tx=0x7fe2080329f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e426b3e9c1b386 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe200ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe200ff9640 1 -- 172.21.15.53:0/2207597769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20804f040 con 0x556ac2baa660 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe200ff9640 1 -- 172.21.15.53:0/2207597769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fe208053480 con 0x556ac2baa660 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe2258f8740 1 -- 172.21.15.53:0/2207597769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe208041070 con 0x556ac2baa660 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe200ff9640 1 -- 172.21.15.53:0/2207597769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fe208053680 con 0x556ac2baa660 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe2258f8740 10 client.22221 fetch_fsmap learned FSMap version 77 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe2258f8740 1 -- 172.21.15.53:0/2207597769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x556ac3005fa0 con 0x556ac2baa660 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe200ff9640 1 -- 172.21.15.53:0/2207597769 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe208041070 con 0x556ac2baa660 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe200ff9640 1 -- 172.21.15.53:0/2207597769 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7fe208068610 con 0x556ac2baa660 2024-08-31T06:27:00.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe2258f8740 10 client.22221 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:27:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe2258f8740 10 client.22221 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:27:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe2258f8740 20 client.22221 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.114+0000 7fe2258f8740 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556ac2b67250 0x556ac3008710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.115+0000 7fe2258f8740 4 client.22221 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "294469b2", "release": true, "await": true}] 2024-08-31T06:27:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.115+0000 7fe2258f8740 1 -- 172.21.15.53:0/2207597769 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "294469b2", "release": true, "await": true}) -- 0x556ac2eed460 con 0x556ac2b67250 2024-08-31T06:27:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.115+0000 7fe21d11f640 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556ac2b67250 0x556ac3008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.115+0000 7fe21d11f640 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556ac2b67250 0x556ac3008710 crc :-1 s=READY pgs=521 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b87f7e7d12975192 server_cookie=80e3ee8964f55e5a in_seq=0 out_seq=0 2024-08-31T06:27:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.115+0000 7fe200ff9640 10 client.22221 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe200ff9640 1 -- 172.21.15.53:0/2207597769 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556ac2eed460 con 0x556ac2b67250 2024-08-31T06:27:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe200ff9640 10 client.22221 handle_command_reply: tid=0 2024-08-31T06:27:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe2258f8740 1 client.22221 shutdown 2024-08-31T06:27:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe2258f8740 1 -- 172.21.15.53:0/2207597769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 msgr2=0x556ac2f9c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe2258f8740 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f9c710 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fe208009820 tx=0x7fe2080329f0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe2258f8740 1 -- 172.21.15.53:0/2207597769 shutdown_connections 2024-08-31T06:27:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe2258f8740 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556ac2b67250 0x556ac3008710 crc :-1 s=READY pgs=521 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe2258f8740 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556ac2bd3520 0x556ac2ffe5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe200ff9640 0 client.22221 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe2258f8740 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ac2bb2840 0x556ac2f9ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe2258f8740 1 --2- 172.21.15.53:0/2207597769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556ac2baa660 0x556ac2f9c710 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe2258f8740 1 -- 172.21.15.53:0/2207597769 >> 172.21.15.53:0/2207597769 conn(0x556ac2bc7910 msgr2=0x556ac2f7e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:00.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe2258f8740 1 -- 172.21.15.53:0/2207597769 shutdown_connections 2024-08-31T06:27:00.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.257+0000 7fe2258f8740 1 -- 172.21.15.53:0/2207597769 wait complete. 2024-08-31T06:27:00.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe2258f8740 20 client.22221 trim_cache size 0 max 16384 2024-08-31T06:27:00.261 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:27:00.261 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 77, 2024-08-31T06:27:00.262 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:27:00.262 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 72, 2024-08-31T06:27:00.262 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:27:00.262 INFO:teuthology.orchestra.run.smithi053.stdout: "294469b2": { 2024-08-31T06:27:00.262 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 72, 2024-08-31T06:27:00.262 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:27:00.263 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:27:00.263 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:27:00.263 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 150.0, 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:00.264 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:00.265 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:00.265 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:27:00.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 -- 172.21.15.53:0/1569710205 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4d20 msgr2=0x7fe2040b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:00.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4d20 0x7fe2040b7230 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe2100e2210 tx=0x7fe2100aaed0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 -- 172.21.15.53:0/1569710205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21810da10 msgr2=0x7fe21819f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:00.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21810da10 0x7fe21819f830 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fe21000b970 tx=0x7fe21000be30 comp rx=0 tx=0).stop 2024-08-31T06:27:00.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 -- 172.21.15.53:0/1569710205 shutdown_connections 2024-08-31T06:27:00.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2040b4d20 0x7fe2040b7230 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21810da10 0x7fe21819f830 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe218104f00 0x7fe21819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 --2- 172.21.15.53:0/1569710205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2181045b0 0x7fe218199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:00.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 -- 172.21.15.53:0/1569710205 >> 172.21.15.53:0/1569710205 conn(0x7fe2180fe0f0 msgr2=0x7fe2180fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:00.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 -- 172.21.15.53:0/1569710205 shutdown_connections 2024-08-31T06:27:00.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:00.258+0000 7fe21e121640 1 -- 172.21.15.53:0/1569710205 wait complete. 2024-08-31T06:27:00.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55714 5.49 MB/sec execute 408 sec latency 22466.149 ms 2024-08-31T06:27:00.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:00 smithi130 ceph-mon[22266]: pgmap v1016: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 58 KiB/s wr, 51 op/s 2024-08-31T06:27:00.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:00 smithi153 ceph-mon[22320]: pgmap v1016: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 58 KiB/s wr, 51 op/s 2024-08-31T06:27:00.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:00 smithi053 ceph-mon[18924]: pgmap v1016: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 58 KiB/s wr, 51 op/s 2024-08-31T06:27:01.056 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '294469b2', total seconds elapsed: 33.5 2024-08-31T06:27:01.056 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-31T06:27:01.056 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:27:01.317 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:01.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55714 5.48 MB/sec execute 409 sec latency 22272.955 ms 2024-08-31T06:27:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.815+0000 7ff436697640 1 -- 172.21.15.53:0/2406846897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff430108b10 msgr2=0x7ff43010f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.815+0000 7ff436697640 1 --2- 172.21.15.53:0/2406846897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff430108b10 0x7ff43010f340 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7ff428009ca0 tx=0x7ff42802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:27:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.815+0000 7ff436697640 1 -- 172.21.15.53:0/2406846897 shutdown_connections 2024-08-31T06:27:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.815+0000 7ff436697640 1 --2- 172.21.15.53:0/2406846897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff430108b10 0x7ff43010f340 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.815+0000 7ff436697640 1 --2- 172.21.15.53:0/2406846897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4301081c0 0x7ff4301085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.815+0000 7ff436697640 1 --2- 172.21.15.53:0/2406846897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff430102880 0x7ff430102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.815+0000 7ff436697640 1 -- 172.21.15.53:0/2406846897 >> 172.21.15.53:0/2406846897 conn(0x7ff430079510 msgr2=0x7ff430079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.815+0000 7ff436697640 1 -- 172.21.15.53:0/2406846897 shutdown_connections 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.815+0000 7ff436697640 1 -- 172.21.15.53:0/2406846897 wait complete. 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.816+0000 7ff436697640 1 Processor -- start 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.816+0000 7ff436697640 1 -- start start 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.816+0000 7ff436697640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff430102880 0x7ff43019af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.816+0000 7ff436697640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4301081c0 0x7ff43019b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.816+0000 7ff436697640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff430108b10 0x7ff43019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.816+0000 7ff436697640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff4301126c0 con 0x7ff4301081c0 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.816+0000 7ff436697640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff430112540 con 0x7ff430108b10 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.816+0000 7ff436697640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff430112840 con 0x7ff430102880 2024-08-31T06:27:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.816+0000 7ff42f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4301081c0 0x7ff43019b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.816+0000 7ff42f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4301081c0 0x7ff43019b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52370/0 (socket says 172.21.15.53:52370) 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.816+0000 7ff42f7fe640 1 -- 172.21.15.53:0/1826912833 learned_addr learned my addr 172.21.15.53:0/1826912833 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff42ffff640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff430102880 0x7ff43019af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff434c34640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff430108b10 0x7ff43019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff42f7fe640 1 -- 172.21.15.53:0/1826912833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff430102880 msgr2=0x7ff43019af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff42f7fe640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff430102880 0x7ff43019af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff42f7fe640 1 -- 172.21.15.53:0/1826912833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff430108b10 msgr2=0x7ff43019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff42f7fe640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff430108b10 0x7ff43019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff42f7fe640 1 -- 172.21.15.53:0/1826912833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4301a61f0 con 0x7ff4301081c0 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff434c34640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff430108b10 0x7ff43019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff42f7fe640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4301081c0 0x7ff43019b470 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7ff42400d740 tx=0x7ff42400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff42d7fa640 1 -- 172.21.15.53:0/1826912833 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424017070 con 0x7ff4301081c0 2024-08-31T06:27:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff42d7fa640 1 -- 172.21.15.53:0/1826912833 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff42400de50 con 0x7ff4301081c0 2024-08-31T06:27:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff436697640 1 -- 172.21.15.53:0/1826912833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4301a64e0 con 0x7ff4301081c0 2024-08-31T06:27:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff42d7fa640 1 -- 172.21.15.53:0/1826912833 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42400f620 con 0x7ff4301081c0 2024-08-31T06:27:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.817+0000 7ff436697640 1 -- 172.21.15.53:0/1826912833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4301a6a20 con 0x7ff4301081c0 2024-08-31T06:27:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.818+0000 7ff436697640 1 -- 172.21.15.53:0/1826912833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff430103b00 con 0x7ff4301081c0 2024-08-31T06:27:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.821+0000 7ff42d7fa640 1 -- 172.21.15.53:0/1826912833 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff42401a070 con 0x7ff4301081c0 2024-08-31T06:27:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.821+0000 7ff42d7fa640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4180b4ca0 0x7ff4180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.822+0000 7ff42d7fa640 1 -- 172.21.15.53:0/1826912833 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7ff4240e4fc0 con 0x7ff4301081c0 2024-08-31T06:27:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.822+0000 7ff42ffff640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4180b4ca0 0x7ff4180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.822+0000 7ff42ffff640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4180b4ca0 0x7ff4180b71b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff43006c480 tx=0x7ff42000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:01.825+0000 7ff42d7fa640 1 -- 172.21.15.53:0/1826912833 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff4240abd30 con 0x7ff4301081c0 2024-08-31T06:27:02.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.048+0000 7ff436697640 1 -- 172.21.15.53:0/1826912833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff43010a960 con 0x7ff4301081c0 2024-08-31T06:27:02.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.048+0000 7ff42d7fa640 1 -- 172.21.15.53:0/1826912833 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+12013 (secure 0 0 0) 0x7ff4240b4270 con 0x7ff4301081c0 2024-08-31T06:27:02.050 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:27:02.051 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":77,"btime":"2024-08-31T06:26:24:210897+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":77,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:26:23.909504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:27:02.051 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 77 2024-08-31T06:27:02.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 -- 172.21.15.53:0/1826912833 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4180b4ca0 msgr2=0x7ff4180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:02.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4180b4ca0 0x7ff4180b71b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff43006c480 tx=0x7ff42000b390 comp rx=0 tx=0).stop 2024-08-31T06:27:02.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 -- 172.21.15.53:0/1826912833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4301081c0 msgr2=0x7ff43019b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:02.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4301081c0 0x7ff43019b470 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7ff42400d740 tx=0x7ff42400dc00 comp rx=0 tx=0).stop 2024-08-31T06:27:02.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 -- 172.21.15.53:0/1826912833 shutdown_connections 2024-08-31T06:27:02.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7ff4180b4ca0 0x7ff4180b71b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:02.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff430108b10 0x7ff43019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:02.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4301081c0 0x7ff43019b470 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:02.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 --2- 172.21.15.53:0/1826912833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff430102880 0x7ff43019af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:02.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 -- 172.21.15.53:0/1826912833 >> 172.21.15.53:0/1826912833 conn(0x7ff430079510 msgr2=0x7ff4301061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:02.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 -- 172.21.15.53:0/1826912833 shutdown_connections 2024-08-31T06:27:02.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:02.051+0000 7ff436697640 1 -- 172.21.15.53:0/1826912833 wait complete. 2024-08-31T06:27:02.365 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:02 smithi053 ceph-mon[18924]: pgmap v1017: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 57 KiB/s wr, 42 op/s 2024-08-31T06:27:02.365 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:02 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1826912833' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:27:02.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55714 5.46 MB/sec execute 410 sec latency 2108.183 ms 2024-08-31T06:27:02.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:02 smithi130 ceph-mon[22266]: pgmap v1017: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 57 KiB/s wr, 42 op/s 2024-08-31T06:27:02.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:02 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1826912833' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:27:02.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:02 smithi153 ceph-mon[22320]: pgmap v1017: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 57 KiB/s wr, 42 op/s 2024-08-31T06:27:02.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:02 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1826912833' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:27:02.703 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-31T06:27:02.703 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-31T06:27:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:03.390 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55714 5.45 MB/sec execute 411 sec latency 3108.254 ms 2024-08-31T06:27:03.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.427+0000 7fed2369b640 1 -- 172.21.15.53:0/144708502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed1c108bc0 msgr2=0x7fed1c10f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.427+0000 7fed2369b640 1 --2- 172.21.15.53:0/144708502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed1c108bc0 0x7fed1c10f3f0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fed14009ca0 tx=0x7fed1402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.427+0000 7fed2369b640 1 -- 172.21.15.53:0/144708502 shutdown_connections 2024-08-31T06:27:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.427+0000 7fed2369b640 1 --2- 172.21.15.53:0/144708502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed1c108bc0 0x7fed1c10f3f0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.427+0000 7fed2369b640 1 --2- 172.21.15.53:0/144708502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed1c108270 0x7fed1c108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.427+0000 7fed2369b640 1 --2- 172.21.15.53:0/144708502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed1c102820 0x7fed1c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.427+0000 7fed2369b640 1 -- 172.21.15.53:0/144708502 >> 172.21.15.53:0/144708502 conn(0x7fed1c0794c0 msgr2=0x7fed1c0798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.427+0000 7fed2369b640 1 -- 172.21.15.53:0/144708502 shutdown_connections 2024-08-31T06:27:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.427+0000 7fed2369b640 1 -- 172.21.15.53:0/144708502 wait complete. 2024-08-31T06:27:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.428+0000 7fed2369b640 1 Processor -- start 2024-08-31T06:27:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.428+0000 7fed2369b640 1 -- start start 2024-08-31T06:27:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.428+0000 7fed2369b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed1c102820 0x7fed1c19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.428+0000 7fed2369b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed1c108270 0x7fed1c19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.428+0000 7fed2369b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed1c108bc0 0x7fed1c19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.428+0000 7fed2369b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c112780 con 0x7fed1c102820 2024-08-31T06:27:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.428+0000 7fed2369b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c112600 con 0x7fed1c108270 2024-08-31T06:27:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.428+0000 7fed2369b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c112900 con 0x7fed1c108bc0 2024-08-31T06:27:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed21437640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed1c102820 0x7fed1c19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed21437640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed1c102820 0x7fed1c19b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48782/0 (socket says 172.21.15.53:48782) 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed21437640 1 -- 172.21.15.53:0/1664426306 learned_addr learned my addr 172.21.15.53:0/1664426306 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed20c36640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed1c108270 0x7fed1c19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed21c38640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed1c108bc0 0x7fed1c19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed21437640 1 -- 172.21.15.53:0/1664426306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed1c108bc0 msgr2=0x7fed1c19bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed21437640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed1c108bc0 0x7fed1c19bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed21437640 1 -- 172.21.15.53:0/1664426306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed1c108270 msgr2=0x7fed1c19b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed21437640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed1c108270 0x7fed1c19b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed21437640 1 -- 172.21.15.53:0/1664426306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c1a6360 con 0x7fed1c102820 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed21437640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed1c102820 0x7fed1c19b0d0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c890 tx=0x7fed1800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed127fc640 1 -- 172.21.15.53:0/1664426306 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18004220 con 0x7fed1c102820 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed2369b640 1 -- 172.21.15.53:0/1664426306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed1c1a6650 con 0x7fed1c102820 2024-08-31T06:27:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed127fc640 1 -- 172.21.15.53:0/1664426306 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed18007e40 con 0x7fed1c102820 2024-08-31T06:27:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.429+0000 7fed127fc640 1 -- 172.21.15.53:0/1664426306 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18004a00 con 0x7fed1c102820 2024-08-31T06:27:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.430+0000 7fed2369b640 1 -- 172.21.15.53:0/1664426306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed1c1a6be0 con 0x7fed1c102820 2024-08-31T06:27:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.432+0000 7fed29c10740 1 Processor -- start 2024-08-31T06:27:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.432+0000 7fed29c10740 1 -- start start 2024-08-31T06:27:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed127fc640 1 -- 172.21.15.53:0/1664426306 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fed180079b0 con 0x7fed1c102820 2024-08-31T06:27:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed29c10740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38bac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed29c10740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34ea980 0x55caf38bb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed29c10740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34f2b60 0x55caf38bb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed29c10740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55caf382f330 con 0x55caf3513840 2024-08-31T06:27:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed29c10740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55caf381e8c0 con 0x55caf34ea980 2024-08-31T06:27:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed29c10740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55caf3822870 con 0x55caf34f2b60 2024-08-31T06:27:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed21c38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38bac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed21c38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38bac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48794/0 (socket says 172.21.15.53:48794) 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed21c38640 1 -- 172.21.15.53:0/3395092736 learned_addr learned my addr 172.21.15.53:0/3395092736 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed21437640 1 --2- 172.21.15.53:0/3395092736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34ea980 0x55caf38bb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed20c36640 1 --2- 172.21.15.53:0/3395092736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34f2b60 0x55caf38bb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed21c38640 1 -- 172.21.15.53:0/3395092736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34f2b60 msgr2=0x55caf38bb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed21c38640 1 --2- 172.21.15.53:0/3395092736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34f2b60 0x55caf38bb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed21c38640 1 -- 172.21.15.53:0/3395092736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34ea980 msgr2=0x55caf38bb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed21c38640 1 --2- 172.21.15.53:0/3395092736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34ea980 0x55caf38bb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.433+0000 7fed21c38640 1 -- 172.21.15.53:0/3395092736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caf37d6df0 con 0x55caf3513840 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.434+0000 7fed127fc640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4d50 0x7fed080b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.434+0000 7fed21c38640 1 --2- 172.21.15.53:0/3395092736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38bac90 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fed14035000 tx=0x7fed14031580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999892bff9351498 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.434+0000 7fed127fc640 1 -- 172.21.15.53:0/1664426306 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fed180e5130 con 0x7fed1c102820 2024-08-31T06:27:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.434+0000 7fed21437640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4d50 0x7fed080b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.434+0000 7fed077fe640 1 -- 172.21.15.53:0/3395092736 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14031b80 con 0x55caf3513840 2024-08-31T06:27:03.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.434+0000 7fed077fe640 1 -- 172.21.15.53:0/3395092736 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed14036040 con 0x55caf3513840 2024-08-31T06:27:03.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.434+0000 7fed077fe640 1 -- 172.21.15.53:0/3395092736 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14004480 con 0x55caf3513840 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed29c10740 1 -- 172.21.15.53:0/3395092736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 msgr2=0x55caf38bac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed21437640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4d50 0x7fed080b7260 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fed180e29b0 tx=0x7fed180e8a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed29c10740 1 --2- 172.21.15.53:0/3395092736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38bac90 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fed14035000 tx=0x7fed14031580 comp rx=0 tx=0).stop 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed29c10740 1 -- 172.21.15.53:0/3395092736 shutdown_connections 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed29c10740 1 --2- 172.21.15.53:0/3395092736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34f2b60 0x55caf38bb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed29c10740 1 --2- 172.21.15.53:0/3395092736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34ea980 0x55caf38bb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed29c10740 1 --2- 172.21.15.53:0/3395092736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38bac90 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed29c10740 1 -- 172.21.15.53:0/3395092736 >> 172.21.15.53:0/3395092736 conn(0x55caf3507990 msgr2=0x55caf38b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed29c10740 1 -- 172.21.15.53:0/3395092736 shutdown_connections 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed29c10740 1 -- 172.21.15.53:0/3395092736 wait complete. 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed29c10740 1 -- start start 2024-08-31T06:27:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.435+0000 7fed29c10740 1 Processor -- start 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed29c10740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34ea980 0x55caf38c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed29c10740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34f2b60 0x55caf38c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed29c10740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38d2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed29c10740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55caf36817a0 con 0x55caf3513840 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed29c10740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55caf37a5240 con 0x55caf34f2b60 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed29c10740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55caf38c9410 con 0x55caf34ea980 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed29c10740 10 client.0 _ll_register_callbacks cb 0x55caf352b090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed21c38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed21c38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38d2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48800/0 (socket says 172.21.15.53:48800) 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed21c38640 1 -- 172.21.15.53:0/1288561105 learned_addr learned my addr 172.21.15.53:0/1288561105 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed20c36640 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34f2b60 0x55caf38c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed21c38640 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34ea980 0x55caf38c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed21c38640 1 -- 172.21.15.53:0/1288561105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34ea980 msgr2=0x55caf38c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed21c38640 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34ea980 0x55caf38c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.436+0000 7fed21c38640 1 -- 172.21.15.53:0/1288561105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34f2b60 msgr2=0x55caf38c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:03.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed21c38640 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34f2b60 0x55caf38c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed21c38640 1 -- 172.21.15.53:0/1288561105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caf37db2b0 con 0x55caf3513840 2024-08-31T06:27:03.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed20c36640 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34f2b60 0x55caf38c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:03.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed21c38640 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38d2700 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fed140099a0 tx=0x7fed1403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e063bd7ee6d03a5e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:03.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:03.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed04ff9640 1 -- 172.21.15.53:0/1288561105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14058060 con 0x55caf3513840 2024-08-31T06:27:03.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed04ff9640 1 -- 172.21.15.53:0/1288561105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fed14031980 con 0x55caf3513840 2024-08-31T06:27:03.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed29c10740 1 -- 172.21.15.53:0/1288561105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed14036040 con 0x55caf3513840 2024-08-31T06:27:03.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed04ff9640 1 -- 172.21.15.53:0/1288561105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fed14004840 con 0x55caf3513840 2024-08-31T06:27:03.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed29c10740 10 client.22239 fetch_fsmap learned FSMap version 77 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed29c10740 1 -- 172.21.15.53:0/1288561105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x55caf358db90 con 0x55caf3513840 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.437+0000 7fed04ff9640 1 -- 172.21.15.53:0/1288561105 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed14036040 con 0x55caf3513840 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.438+0000 7fed04ff9640 1 -- 172.21.15.53:0/1288561105 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7fed14050070 con 0x55caf3513840 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.438+0000 7fed29c10740 10 client.22239 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.438+0000 7fed29c10740 10 client.22239 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.438+0000 7fed29c10740 20 client.22239 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.438+0000 7fed29c10740 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55caf34d21c0 0x55caf38d8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.438+0000 7fed29c10740 4 client.22239 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.438+0000 7fed29c10740 1 -- 172.21.15.53:0/1288561105 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55caf3831280 con 0x55caf34d21c0 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.438+0000 7fed20c36640 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55caf34d21c0 0x55caf38d8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.438+0000 7fed04ff9640 10 client.22239 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.438+0000 7fed20c36640 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55caf34d21c0 0x55caf38d8380 crc :-1 s=READY pgs=522 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=682d5795d0ee84d1 server_cookie=62d5399b2e1ea56d in_seq=0 out_seq=0 2024-08-31T06:27:03.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.439+0000 7fed04ff9640 1 -- 172.21.15.53:0/1288561105 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55caf3831280 con 0x55caf34d21c0 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.439+0000 7fed04ff9640 10 client.22239 handle_command_reply: tid=0 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.439+0000 7fed29c10740 1 client.22239 shutdown 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.439+0000 7fed29c10740 1 -- 172.21.15.53:0/1288561105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 msgr2=0x55caf38d2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.439+0000 7fed29c10740 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38d2700 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fed140099a0 tx=0x7fed1403e040 comp rx=0 tx=0).stop 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.440+0000 7fed29c10740 1 -- 172.21.15.53:0/1288561105 shutdown_connections 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.440+0000 7fed29c10740 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55caf34d21c0 0x55caf38d8380 crc :-1 s=READY pgs=522 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.440+0000 7fed29c10740 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf3513840 0x55caf38d2700 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.440+0000 7fed29c10740 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34f2b60 0x55caf38c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.440+0000 7fed29c10740 1 --2- 172.21.15.53:0/1288561105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34ea980 0x55caf38c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.440+0000 7fed04ff9640 0 client.22239 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.440+0000 7fed29c10740 1 -- 172.21.15.53:0/1288561105 >> 172.21.15.53:0/1288561105 conn(0x55caf3507990 msgr2=0x55caf38b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.440+0000 7fed29c10740 1 -- 172.21.15.53:0/1288561105 shutdown_connections 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.440+0000 7fed29c10740 1 -- 172.21.15.53:0/1288561105 wait complete. 2024-08-31T06:27:03.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.440+0000 7fed29c10740 20 client.22239 trim_cache size 0 max 16384 2024-08-31T06:27:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.457+0000 7fed29c10740 1 Processor -- start 2024-08-31T06:27:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.457+0000 7fed29c10740 1 -- start start 2024-08-31T06:27:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.457+0000 7fed29c10740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34d21c0 0x55caf38bc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.457+0000 7fed29c10740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34ea980 0x55caf38d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.457+0000 7fed29c10740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf38c3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.457+0000 7fed29c10740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c1af5e0 con 0x55caf34f2b60 2024-08-31T06:27:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed29c10740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c1b1420 con 0x55caf34d21c0 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed29c10740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c1afd70 con 0x55caf34ea980 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed21c38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf38c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed21c38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf38c3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48812/0 (socket says 172.21.15.53:48812) 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed21c38640 1 -- 172.21.15.53:0/2910827802 learned_addr learned my addr 172.21.15.53:0/2910827802 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed21c38640 1 --2- 172.21.15.53:0/2910827802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34d21c0 0x55caf38bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed20c36640 1 --2- 172.21.15.53:0/2910827802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34ea980 0x55caf38d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed21c38640 1 -- 172.21.15.53:0/2910827802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34ea980 msgr2=0x55caf38d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed21c38640 1 --2- 172.21.15.53:0/2910827802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34ea980 0x55caf38d2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed21c38640 1 -- 172.21.15.53:0/2910827802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34d21c0 msgr2=0x55caf38bc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed21c38640 1 --2- 172.21.15.53:0/2910827802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34d21c0 0x55caf38bc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed21c38640 1 -- 172.21.15.53:0/2910827802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caf37eed90 con 0x55caf34f2b60 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed21c38640 1 --2- 172.21.15.53:0/2910827802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf38c3630 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fed14056040 tx=0x7fed1402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9f2910cc08002a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed06ffd640 1 -- 172.21.15.53:0/2910827802 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14058040 con 0x55caf34f2b60 2024-08-31T06:27:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed06ffd640 1 -- 172.21.15.53:0/2910827802 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed14036070 con 0x55caf34f2b60 2024-08-31T06:27:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.458+0000 7fed06ffd640 1 -- 172.21.15.53:0/2910827802 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14004690 con 0x55caf34f2b60 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.459+0000 7fed29c10740 1 -- 172.21.15.53:0/2910827802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 msgr2=0x55caf38c3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.459+0000 7fed29c10740 1 --2- 172.21.15.53:0/2910827802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf38c3630 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fed14056040 tx=0x7fed1402bfd0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.459+0000 7fed29c10740 1 -- 172.21.15.53:0/2910827802 shutdown_connections 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.459+0000 7fed29c10740 1 --2- 172.21.15.53:0/2910827802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf38c3630 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.459+0000 7fed29c10740 1 --2- 172.21.15.53:0/2910827802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34ea980 0x55caf38d2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.459+0000 7fed29c10740 1 --2- 172.21.15.53:0/2910827802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34d21c0 0x55caf38bc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.459+0000 7fed29c10740 1 -- 172.21.15.53:0/2910827802 >> 172.21.15.53:0/2910827802 conn(0x55caf3507990 msgr2=0x55caf38c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.459+0000 7fed29c10740 1 -- 172.21.15.53:0/2910827802 shutdown_connections 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.459+0000 7fed29c10740 1 -- 172.21.15.53:0/2910827802 wait complete. 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed29c10740 1 -- start start 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed29c10740 1 Processor -- start 2024-08-31T06:27:03.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed29c10740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34d21c0 0x55caf38d8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed29c10740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34ea980 0x55caf38d9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed29c10740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf3941af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed29c10740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c1b0c90 con 0x55caf34f2b60 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed29c10740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c1b0500 con 0x55caf34ea980 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed29c10740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c1ad5e0 con 0x55caf34d21c0 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed29c10740 10 client.0 _ll_register_callbacks cb 0x7fed14031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed21c38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf3941af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed21c38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf3941af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48818/0 (socket says 172.21.15.53:48818) 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed21c38640 1 -- 172.21.15.53:0/2475642666 learned_addr learned my addr 172.21.15.53:0/2475642666 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.460+0000 7fed20c36640 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34ea980 0x55caf38d9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed21c38640 1 -- 172.21.15.53:0/2475642666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34d21c0 msgr2=0x55caf38d8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed21c38640 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34d21c0 0x55caf38d8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed21c38640 1 -- 172.21.15.53:0/2475642666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34ea980 msgr2=0x55caf38d9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed21c38640 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34ea980 0x55caf38d9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed21c38640 1 -- 172.21.15.53:0/2475642666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caf3942160 con 0x55caf34f2b60 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed21c38640 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf3941af0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fed14030ac0 tx=0x7fed14005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c861bf8c7149a225 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed04ff9640 1 -- 172.21.15.53:0/2475642666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed140317b0 con 0x55caf34f2b60 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed04ff9640 1 -- 172.21.15.53:0/2475642666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8557+0+0 (secure 0 0 0) 0x7fed14030b40 con 0x55caf34f2b60 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed29c10740 1 -- 172.21.15.53:0/2475642666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed14036070 con 0x55caf34f2b60 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed04ff9640 1 -- 172.21.15.53:0/2475642666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fed14030d40 con 0x55caf34f2b60 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed29c10740 10 client.22245 fetch_fsmap learned FSMap version 77 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.461+0000 7fed29c10740 1 -- 172.21.15.53:0/2475642666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x55caf39433c0 con 0x55caf34f2b60 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.462+0000 7fed04ff9640 1 -- 172.21.15.53:0/2475642666 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed14036070 con 0x55caf34f2b60 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.462+0000 7fed04ff9640 1 -- 172.21.15.53:0/2475642666 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 77) ==== 8426+0+0 (secure 0 0 0) 0x7fed14050070 con 0x55caf34f2b60 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.462+0000 7fed29c10740 10 client.22245 fetch_fsmap finished waiting for FSMap version 77 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.462+0000 7fed29c10740 10 client.22245 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:27:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.462+0000 7fed29c10740 20 client.22245 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.462+0000 7fed29c10740 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55caf3513840 0x55caf3945970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.462+0000 7fed29c10740 4 client.22245 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-31T06:27:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.462+0000 7fed29c10740 1 -- 172.21.15.53:0/2475642666 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55caf382cd20 con 0x55caf3513840 2024-08-31T06:27:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.462+0000 7fed20c36640 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55caf3513840 0x55caf3945970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.462+0000 7fed04ff9640 10 client.22245 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.462+0000 7fed20c36640 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55caf3513840 0x55caf3945970 crc :-1 s=READY pgs=523 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2ff38279785dad6 server_cookie=d3b7e5ffcddde5a9 in_seq=0 out_seq=0 2024-08-31T06:27:03.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.708+0000 7fed04ff9640 1 -- 172.21.15.53:0/2475642666 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55caf382cd20 con 0x55caf3513840 2024-08-31T06:27:03.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.708+0000 7fed04ff9640 10 client.22245 handle_command_reply: tid=0 2024-08-31T06:27:03.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.708+0000 7fed29c10740 1 client.22245 shutdown 2024-08-31T06:27:03.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.708+0000 7fed29c10740 1 -- 172.21.15.53:0/2475642666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 msgr2=0x55caf3941af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:03.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.708+0000 7fed29c10740 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf3941af0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fed14030ac0 tx=0x7fed14005c30 comp rx=0 tx=0).stop 2024-08-31T06:27:03.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed29c10740 1 -- 172.21.15.53:0/2475642666 shutdown_connections 2024-08-31T06:27:03.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed29c10740 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55caf3513840 0x55caf3945970 crc :-1 s=READY pgs=523 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed29c10740 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55caf34f2b60 0x55caf3941af0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed04ff9640 0 client.22245 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:03.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed29c10740 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55caf34ea980 0x55caf38d9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed29c10740 1 --2- 172.21.15.53:0/2475642666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55caf34d21c0 0x55caf38d8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed29c10740 1 -- 172.21.15.53:0/2475642666 >> 172.21.15.53:0/2475642666 conn(0x55caf3507990 msgr2=0x55caf38b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:03.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed29c10740 1 -- 172.21.15.53:0/2475642666 shutdown_connections 2024-08-31T06:27:03.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed29c10740 1 -- 172.21.15.53:0/2475642666 wait complete. 2024-08-31T06:27:03.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed29c10740 20 client.22245 trim_cache size 0 max 16384 2024-08-31T06:27:03.712 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:27:03.712 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 77, 2024-08-31T06:27:03.712 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 74, 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "e3c07659": { 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 74, 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 150.0, 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:27:03.713 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:27:03.714 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:27:03.714 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:27:03.714 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:27:03.714 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:03.714 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:03.714 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:03.714 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:03.714 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:03.714 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed2369b640 1 -- 172.21.15.53:0/1664426306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4d50 msgr2=0x7fed080b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed2369b640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4d50 0x7fed080b7260 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fed180e29b0 tx=0x7fed180e8a40 comp rx=0 tx=0).stop 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed2369b640 1 -- 172.21.15.53:0/1664426306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed1c102820 msgr2=0x7fed1c19b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.709+0000 7fed2369b640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed1c102820 0x7fed1c19b0d0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c890 tx=0x7fed1800cd50 comp rx=0 tx=0).stop 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.710+0000 7fed2369b640 1 -- 172.21.15.53:0/1664426306 shutdown_connections 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.710+0000 7fed2369b640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed080b4d50 0x7fed080b7260 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.710+0000 7fed2369b640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed1c108bc0 0x7fed1c19bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.710+0000 7fed2369b640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed1c108270 0x7fed1c19b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.710+0000 7fed2369b640 1 --2- 172.21.15.53:0/1664426306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed1c102820 0x7fed1c19b0d0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.710+0000 7fed2369b640 1 -- 172.21.15.53:0/1664426306 >> 172.21.15.53:0/1664426306 conn(0x7fed1c0794c0 msgr2=0x7fed1c1042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.710+0000 7fed2369b640 1 -- 172.21.15.53:0/1664426306 shutdown_connections 2024-08-31T06:27:03.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:03.710+0000 7fed2369b640 1 -- 172.21.15.53:0/1664426306 wait complete. 2024-08-31T06:27:04.357 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:04 smithi053 ceph-mon[18924]: pgmap v1018: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-08-31T06:27:04.387 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e3c07659', quiesce took 3.3 seconds. Will release after: 26.7 2024-08-31T06:27:04.389 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.44 MB/sec execute 412 sec latency 4101.862 ms 2024-08-31T06:27:04.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:04 smithi130 ceph-mon[22266]: pgmap v1018: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-08-31T06:27:04.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:04 smithi153 ceph-mon[22320]: pgmap v1018: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-08-31T06:27:05.390 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.43 MB/sec execute 413 sec latency 5101.966 ms 2024-08-31T06:27:06.390 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.41 MB/sec execute 414 sec latency 6102.090 ms 2024-08-31T06:27:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:06 smithi130 ceph-mon[22266]: pgmap v1019: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-08-31T06:27:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:27:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:27:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:27:06.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:06 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:27:06.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:06 smithi153 ceph-mon[22320]: pgmap v1019: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-08-31T06:27:06.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:27:06.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:27:06.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:27:06.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:06 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:27:06.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:06 smithi053 ceph-mon[18924]: pgmap v1019: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 33 KiB/s wr, 20 op/s 2024-08-31T06:27:06.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:27:06.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:27:06.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:27:06.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:06 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:27:07.390 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.40 MB/sec execute 415 sec latency 7102.152 ms 2024-08-31T06:27:07.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:07 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:27:07.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:07 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:27:07.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:07 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:27:08.390 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.39 MB/sec execute 416 sec latency 8102.292 ms 2024-08-31T06:27:08.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:08 smithi130 ceph-mon[22266]: pgmap v1020: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 62 KiB/s wr, 21 op/s 2024-08-31T06:27:08.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:08 smithi153 ceph-mon[22320]: pgmap v1020: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 62 KiB/s wr, 21 op/s 2024-08-31T06:27:08.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:08 smithi053 ceph-mon[18924]: pgmap v1020: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 62 KiB/s wr, 21 op/s 2024-08-31T06:27:09.390 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.37 MB/sec execute 417 sec latency 9102.395 ms 2024-08-31T06:27:10.390 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.36 MB/sec execute 418 sec latency 10102.525 ms 2024-08-31T06:27:10.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:10 smithi130 ceph-mon[22266]: pgmap v1021: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 96 KiB/s wr, 38 op/s 2024-08-31T06:27:10.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:10 smithi153 ceph-mon[22320]: pgmap v1021: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 96 KiB/s wr, 38 op/s 2024-08-31T06:27:10.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:10 smithi053 ceph-mon[18924]: pgmap v1021: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 96 KiB/s wr, 38 op/s 2024-08-31T06:27:11.390 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.35 MB/sec execute 419 sec latency 11102.567 ms 2024-08-31T06:27:12.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.33 MB/sec execute 420 sec latency 12102.626 ms 2024-08-31T06:27:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:12 smithi130 ceph-mon[22266]: pgmap v1022: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 108 KiB/s wr, 38 op/s 2024-08-31T06:27:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:12 smithi130 ceph-mon[22266]: osdmap e107: 12 total, 12 up, 12 in 2024-08-31T06:27:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:12 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:27:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:12 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:12 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:12.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:12 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:12.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:12 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:12.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:12 smithi153 ceph-mon[22320]: pgmap v1022: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 108 KiB/s wr, 38 op/s 2024-08-31T06:27:12.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:12 smithi153 ceph-mon[22320]: osdmap e107: 12 total, 12 up, 12 in 2024-08-31T06:27:12.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:12 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:27:12.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:12 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:12.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:12 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:12.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:12 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:12.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:12 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:12 smithi053 ceph-mon[18924]: pgmap v1022: 97 pgs: 97 active+clean; 885 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 108 KiB/s wr, 38 op/s 2024-08-31T06:27:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:12 smithi053 ceph-mon[18924]: osdmap e107: 12 total, 12 up, 12 in 2024-08-31T06:27:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:12 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:27:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:12 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:12 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:12 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:12.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:12 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.103+0000 7f6a24a7e640 1 -- 172.21.15.53:0/1447354151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a201089d0 msgr2=0x7f6a2010f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.103+0000 7f6a24a7e640 1 --2- 172.21.15.53:0/1447354151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a201089d0 0x7f6a2010f200 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009ca0 tx=0x7f6a1802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.103+0000 7f6a24a7e640 1 -- 172.21.15.53:0/1447354151 shutdown_connections 2024-08-31T06:27:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.103+0000 7f6a24a7e640 1 --2- 172.21.15.53:0/1447354151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a201089d0 0x7f6a2010f200 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.103+0000 7f6a24a7e640 1 --2- 172.21.15.53:0/1447354151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a20108080 0x7f6a20108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.103+0000 7f6a24a7e640 1 --2- 172.21.15.53:0/1447354151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20102750 0x7f6a20102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.103+0000 7f6a24a7e640 1 -- 172.21.15.53:0/1447354151 >> 172.21.15.53:0/1447354151 conn(0x7f6a2007a4e0 msgr2=0x7f6a2007a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.103+0000 7f6a24a7e640 1 -- 172.21.15.53:0/1447354151 shutdown_connections 2024-08-31T06:27:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.103+0000 7f6a24a7e640 1 -- 172.21.15.53:0/1447354151 wait complete. 2024-08-31T06:27:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.104+0000 7f6a24a7e640 1 Processor -- start 2024-08-31T06:27:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.104+0000 7f6a24a7e640 1 -- start start 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.104+0000 7f6a24a7e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a20102750 0x7f6a2019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.104+0000 7f6a24a7e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20108080 0x7f6a2019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.104+0000 7f6a24a7e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a201089d0 0x7f6a2019f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a24a7e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a20113690 con 0x7f6a201089d0 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a24a7e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a20113510 con 0x7f6a20102750 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a24a7e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a20113810 con 0x7f6a20108080 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a1ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a201089d0 0x7f6a2019f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a1ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a201089d0 0x7f6a2019f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48830/0 (socket says 172.21.15.53:48830) 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a1ed9d640 1 -- 172.21.15.53:0/2234715622 learned_addr learned my addr 172.21.15.53:0/2234715622 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a1e59c640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a20102750 0x7f6a2019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a17fff640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20108080 0x7f6a2019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a1ed9d640 1 -- 172.21.15.53:0/2234715622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20108080 msgr2=0x7f6a2019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a1ed9d640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20108080 0x7f6a2019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a1ed9d640 1 -- 172.21.15.53:0/2234715622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a20102750 msgr2=0x7f6a2019a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a1ed9d640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a20102750 0x7f6a2019a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a1ed9d640 1 -- 172.21.15.53:0/2234715622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a201a0000 con 0x7f6a201089d0 2024-08-31T06:27:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a1e59c640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a20102750 0x7f6a2019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a1ed9d640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a201089d0 0x7f6a2019f900 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f6a18005e30 tx=0x7f6a180093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.105+0000 7f6a177fe640 1 -- 172.21.15.53:0/2234715622 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a18032d10 con 0x7f6a201089d0 2024-08-31T06:27:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.106+0000 7f6a24a7e640 1 -- 172.21.15.53:0/2234715622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a201a0290 con 0x7f6a201089d0 2024-08-31T06:27:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.106+0000 7f6a177fe640 1 -- 172.21.15.53:0/2234715622 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a18032eb0 con 0x7f6a201089d0 2024-08-31T06:27:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.106+0000 7f6a177fe640 1 -- 172.21.15.53:0/2234715622 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a18030b20 con 0x7f6a201089d0 2024-08-31T06:27:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.106+0000 7f6a24a7e640 1 -- 172.21.15.53:0/2234715622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a201a6a80 con 0x7f6a201089d0 2024-08-31T06:27:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.108+0000 7f6a2b9e9740 1 Processor -- start 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.109+0000 7f6a177fe640 1 -- 172.21.15.53:0/2234715622 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6a18030cc0 con 0x7f6a201089d0 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.109+0000 7f6a2b9e9740 1 -- start start 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fea7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895fea8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895fea8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55895fe1d000 con 0x55895fae34d0 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55895fe0c590 con 0x55895fb041b0 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55895fe10540 con 0x55895fadb2f0 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895fea8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895fea8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48834/0 (socket says 172.21.15.53:48834) 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a17fff640 1 -- 172.21.15.53:0/3069344146 learned_addr learned my addr 172.21.15.53:0/3069344146 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a17fff640 1 --2- 172.21.15.53:0/3069344146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fea7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a1e59c640 1 --2- 172.21.15.53:0/3069344146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895fea8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a177fe640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4ca0 0x7f6a0c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a17fff640 1 -- 172.21.15.53:0/3069344146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 msgr2=0x55895fea8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a1ed9d640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4ca0 0x7f6a0c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a17fff640 1 --2- 172.21.15.53:0/3069344146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895fea8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a17fff640 1 -- 172.21.15.53:0/3069344146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 msgr2=0x55895fea7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a17fff640 1 --2- 172.21.15.53:0/3069344146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fea7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a17fff640 1 -- 172.21.15.53:0/3069344146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55895fb6f790 con 0x55895fae34d0 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a177fe640 1 -- 172.21.15.53:0/2234715622 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8601+0+0 (secure 0 0 0) 0x7f6a181068a0 con 0x7f6a201089d0 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.110+0000 7f6a17fff640 1 --2- 172.21.15.53:0/3069344146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895fea8540 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f6a08014950 tx=0x7f6a0800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19e12bd5b4b78b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.111+0000 7f6a14ff9640 1 -- 172.21.15.53:0/3069344146 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08004030 con 0x55895fae34d0 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.111+0000 7f6a1ed9d640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4ca0 0x7f6a0c0b71b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6a18104050 tx=0x7f6a18099250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.111+0000 7f6a14ff9640 1 -- 172.21.15.53:0/3069344146 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a0800f760 con 0x55895fae34d0 2024-08-31T06:27:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.111+0000 7f6a14ff9640 1 -- 172.21.15.53:0/3069344146 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08003850 con 0x55895fae34d0 2024-08-31T06:27:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.112+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/3069344146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 msgr2=0x55895fea8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.112+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/3069344146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895fea8540 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f6a08014950 tx=0x7f6a0800c450 comp rx=0 tx=0).stop 2024-08-31T06:27:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.112+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/3069344146 shutdown_connections 2024-08-31T06:27:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.112+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/3069344146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895fea8540 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.112+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/3069344146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895fea8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.112+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/3069344146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fea7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.112+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/3069344146 >> 172.21.15.53:0/3069344146 conn(0x55895faf8300 msgr2=0x55895fea59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.112+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/3069344146 shutdown_connections 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.112+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/3069344146 wait complete. 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.112+0000 7f6a2b9e9740 1 -- start start 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.112+0000 7f6a2b9e9740 1 Processor -- start 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895feaf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fae34d0 0x55895feafc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fb041b0 0x55895fec7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55895fd45ab0 con 0x55895fb041b0 2024-08-31T06:27:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55895fd93680 con 0x55895fae34d0 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55895febea30 con 0x55895fadb2f0 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a2b9e9740 10 client.0 _ll_register_callbacks cb 0x55895fb1ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fb041b0 0x55895fec7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a1e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fae34d0 0x55895feafc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fb041b0 0x55895fec7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48842/0 (socket says 172.21.15.53:48842) 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a17fff640 1 -- 172.21.15.53:0/1690702284 learned_addr learned my addr 172.21.15.53:0/1690702284 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a17fff640 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895feaf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a1e59c640 1 -- 172.21.15.53:0/1690702284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 msgr2=0x55895feaf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a1e59c640 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895feaf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a1e59c640 1 -- 172.21.15.53:0/1690702284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fb041b0 msgr2=0x55895fec7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a1e59c640 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fb041b0 0x55895fec7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a1e59c640 1 -- 172.21.15.53:0/1690702284 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55895fbe8620 con 0x55895fae34d0 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a1e59c640 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fae34d0 0x55895feafc20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6a100136e0 tx=0x7f6a10009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd8b49a390f60b9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.113+0000 7f6a05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a05ffb640 1 -- 172.21.15.53:0/1690702284 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a10011e70 con 0x55895fae34d0 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/1690702284 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a0800f760 con 0x55895fae34d0 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a05ffb640 1 -- 172.21.15.53:0/1690702284 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 8601+0+0 (secure 0 0 0) 0x7f6a10005020 con 0x55895fae34d0 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a05ffb640 1 -- 172.21.15.53:0/1690702284 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f6a10005220 con 0x55895fae34d0 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a2b9e9740 10 client.30941 fetch_fsmap learned FSMap version 78 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/1690702284 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) -- 0x55895fecab40 con 0x55895fae34d0 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a05ffb640 1 -- 172.21.15.53:0/1690702284 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a0800f760 con 0x55895fae34d0 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a05ffb640 1 -- 172.21.15.53:0/1690702284 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 78) ==== 8422+0+0 (secure 0 0 0) 0x7f6a1001a030 con 0x55895fae34d0 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a2b9e9740 10 client.30941 fetch_fsmap finished waiting for FSMap version 78 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a2b9e9740 10 client.30941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a2b9e9740 20 client.30941 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55895fac2d80 0x55895fece150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a2b9e9740 4 client.30941 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.114+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/1690702284 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55895fe1ef50 con 0x55895fac2d80 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.115+0000 7f6a17fff640 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55895fac2d80 0x55895fece150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.115+0000 7f6a05ffb640 10 client.30941 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.115+0000 7f6a17fff640 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55895fac2d80 0x55895fece150 crc :-1 s=READY pgs=524 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=452196872bbde588 server_cookie=f2fa118bb3474031 in_seq=0 out_seq=0 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a05ffb640 1 -- 172.21.15.53:0/1690702284 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55895fe1ef50 con 0x55895fac2d80 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a05ffb640 10 client.30941 handle_command_reply: tid=0 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 1 client.30941 shutdown 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/1690702284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fae34d0 msgr2=0x55895feafc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fae34d0 0x55895feafc20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6a100136e0 tx=0x7f6a10009f90 comp rx=0 tx=0).stop 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/1690702284 shutdown_connections 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55895fac2d80 0x55895fece150 crc :-1 s=READY pgs=524 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fb041b0 0x55895fec7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fae34d0 0x55895feafc20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a05ffb640 0 client.30941 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/1690702284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895feaf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/1690702284 >> 172.21.15.53:0/1690702284 conn(0x55895faf8300 msgr2=0x55895fea3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/1690702284 shutdown_connections 2024-08-31T06:27:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/1690702284 wait complete. 2024-08-31T06:27:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.116+0000 7f6a2b9e9740 20 client.30941 trim_cache size 0 max 16384 2024-08-31T06:27:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a2b9e9740 1 Processor -- start 2024-08-31T06:27:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a2b9e9740 1 -- start start 2024-08-31T06:27:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fadb2f0 0x55895fea59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fae34d0 0x55895feaf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fec7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a201ad2e0 con 0x55895fadb2f0 2024-08-31T06:27:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a201af0f0 con 0x55895fb041b0 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a201ada70 con 0x55895fae34d0 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fadb2f0 0x55895fea59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fadb2f0 0x55895fea59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48856/0 (socket says 172.21.15.53:48856) 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a17fff640 1 -- 172.21.15.53:0/3658493382 learned_addr learned my addr 172.21.15.53:0/3658493382 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a1e59c640 1 --2- 172.21.15.53:0/3658493382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fae34d0 0x55895feaf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a17fff640 1 --2- 172.21.15.53:0/3658493382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fec7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a17fff640 1 -- 172.21.15.53:0/3658493382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fae34d0 msgr2=0x55895feaf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a17fff640 1 --2- 172.21.15.53:0/3658493382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fae34d0 0x55895feaf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a17fff640 1 -- 172.21.15.53:0/3658493382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 msgr2=0x55895fec7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a17fff640 1 --2- 172.21.15.53:0/3658493382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fec7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.131+0000 7f6a17fff640 1 -- 172.21.15.53:0/3658493382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55895feca930 con 0x55895fadb2f0 2024-08-31T06:27:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.132+0000 7f6a17fff640 1 --2- 172.21.15.53:0/3658493382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fadb2f0 0x55895fea59e0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c770 tx=0x7f6a08016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a319718a2a772461 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.132+0000 7f6a07fff640 1 -- 172.21.15.53:0/3658493382 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08014240 con 0x55895fadb2f0 2024-08-31T06:27:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.132+0000 7f6a07fff640 1 -- 172.21.15.53:0/3658493382 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a08027070 con 0x55895fadb2f0 2024-08-31T06:27:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.132+0000 7f6a07fff640 1 -- 172.21.15.53:0/3658493382 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a080053c0 con 0x55895fadb2f0 2024-08-31T06:27:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/3658493382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fadb2f0 msgr2=0x55895fea59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/3658493382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fadb2f0 0x55895fea59e0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c770 tx=0x7f6a08016040 comp rx=0 tx=0).stop 2024-08-31T06:27:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/3658493382 shutdown_connections 2024-08-31T06:27:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/3658493382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fec7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/3658493382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fae34d0 0x55895feaf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/3658493382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fadb2f0 0x55895fea59e0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/3658493382 >> 172.21.15.53:0/3658493382 conn(0x55895faf8300 msgr2=0x55895fea52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/3658493382 shutdown_connections 2024-08-31T06:27:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/3658493382 wait complete. 2024-08-31T06:27:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 -- start start 2024-08-31T06:27:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 Processor -- start 2024-08-31T06:27:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895fec4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895febfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fec0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a201ae960 con 0x55895fae34d0 2024-08-31T06:27:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a201ae200 con 0x55895fb041b0 2024-08-31T06:27:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a201ab2e0 con 0x55895fadb2f0 2024-08-31T06:27:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.133+0000 7f6a2b9e9740 10 client.0 _ll_register_callbacks cb 0x7f6a10009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a1e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895febfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a1e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895febfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48868/0 (socket says 172.21.15.53:48868) 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a1e59c640 1 -- 172.21.15.53:0/2455209751 learned_addr learned my addr 172.21.15.53:0/2455209751 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a17fff640 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895fec4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a17fff640 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fec0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a1e59c640 1 -- 172.21.15.53:0/2455209751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 msgr2=0x55895fec4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a1e59c640 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895fec4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a1e59c640 1 -- 172.21.15.53:0/2455209751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 msgr2=0x55895fec0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a1e59c640 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fec0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a1e59c640 1 -- 172.21.15.53:0/2455209751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55895ff37b30 con 0x55895fae34d0 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a1e59c640 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895febfc70 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f6a100136e0 tx=0x7f6a10005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bd7507dba85b45 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a05ffb640 1 -- 172.21.15.53:0/2455209751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a10023b80 con 0x55895fae34d0 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a05ffb640 1 -- 172.21.15.53:0/2455209751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 8601+0+0 (secure 0 0 0) 0x7f6a10023d20 con 0x55895fae34d0 2024-08-31T06:27:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/2455209751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a08027070 con 0x55895fae34d0 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a05ffb640 1 -- 172.21.15.53:0/2455209751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f6a1003b050 con 0x55895fae34d0 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a2b9e9740 10 client.22263 fetch_fsmap learned FSMap version 78 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.134+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/2455209751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) -- 0x55895ff38d00 con 0x55895fae34d0 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.135+0000 7f6a05ffb640 1 -- 172.21.15.53:0/2455209751 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a08027070 con 0x55895fae34d0 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.135+0000 7f6a05ffb640 1 -- 172.21.15.53:0/2455209751 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 78) ==== 8422+0+0 (secure 0 0 0) 0x7f6a1001a040 con 0x55895fae34d0 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.135+0000 7f6a2b9e9740 10 client.22263 fetch_fsmap finished waiting for FSMap version 78 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.135+0000 7f6a2b9e9740 10 client.22263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.135+0000 7f6a2b9e9740 20 client.22263 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.135+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55895fa981c0 0x55895ff3b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.135+0000 7f6a2b9e9740 4 client.22263 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.135+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/2455209751 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55895fe1a9f0 con 0x55895fa981c0 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.135+0000 7f6a17fff640 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55895fa981c0 0x55895ff3b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.135+0000 7f6a05ffb640 10 client.22263 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.135+0000 7f6a17fff640 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55895fa981c0 0x55895ff3b630 crc :-1 s=READY pgs=525 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b9defbb6d55f555 server_cookie=200586b715893a0b in_seq=0 out_seq=0 2024-08-31T06:27:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a05ffb640 1 -- 172.21.15.53:0/2455209751 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55895fe1a9f0 con 0x55895fa981c0 2024-08-31T06:27:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a05ffb640 10 client.22263 handle_command_reply: tid=0 2024-08-31T06:27:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 1 client.22263 shutdown 2024-08-31T06:27:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/2455209751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 msgr2=0x55895febfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895febfc70 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f6a100136e0 tx=0x7f6a10005670 comp rx=0 tx=0).stop 2024-08-31T06:27:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/2455209751 shutdown_connections 2024-08-31T06:27:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55895fa981c0 0x55895ff3b630 crc :-1 s=READY pgs=525 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55895fb041b0 0x55895fec0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55895fae34d0 0x55895febfc70 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a05ffb640 0 client.22263 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 1 --2- 172.21.15.53:0/2455209751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55895fadb2f0 0x55895fec4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/2455209751 >> 172.21.15.53:0/2455209751 conn(0x55895faf8300 msgr2=0x55895fea8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/2455209751 shutdown_connections 2024-08-31T06:27:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 1 -- 172.21.15.53:0/2455209751 wait complete. 2024-08-31T06:27:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a2b9e9740 20 client.22263 trim_cache size 0 max 16384 2024-08-31T06:27:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:27:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:27:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:27:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 -- 172.21.15.53:0/2234715622 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4ca0 msgr2=0x7f6a0c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4ca0 0x7f6a0c0b71b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6a18104050 tx=0x7f6a18099250 comp rx=0 tx=0).stop 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 -- 172.21.15.53:0/2234715622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a201089d0 msgr2=0x7f6a2019f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a201089d0 0x7f6a2019f900 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f6a18005e30 tx=0x7f6a180093d0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 -- 172.21.15.53:0/2234715622 shutdown_connections 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6a0c0b4ca0 0x7f6a0c0b71b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a201089d0 0x7f6a2019f900 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20108080 0x7f6a2019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 --2- 172.21.15.53:0/2234715622 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a20102750 0x7f6a2019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 -- 172.21.15.53:0/2234715622 >> 172.21.15.53:0/2234715622 conn(0x7f6a2007a4e0 msgr2=0x7f6a20104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 -- 172.21.15.53:0/2234715622 shutdown_connections 2024-08-31T06:27:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:13.168+0000 7f6a24a7e640 1 -- 172.21.15.53:0/2234715622 wait complete. 2024-08-31T06:27:13.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.32 MB/sec execute 421 sec latency 13102.656 ms 2024-08-31T06:27:13.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:13 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:13.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:13 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:13.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:13 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:13.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:13 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:27:13.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:13 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:27:13.629 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:13 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:13.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:13 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:13.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:13 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:13.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:13 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:13.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:13 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:27:13.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:13 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:27:13.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:13 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:13.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:13 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:13.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:13 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:13.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:13 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:13.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:13 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:27:13.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:13 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:27:13.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:13 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:27:14.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.31 MB/sec execute 422 sec latency 14102.690 ms 2024-08-31T06:27:14.577 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:14 smithi153 ceph-mon[22320]: pgmap v1024: 97 pgs: 97 active+clean; 880 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 103 KiB/s wr, 42 op/s 2024-08-31T06:27:14.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:14 smithi130 ceph-mon[22266]: pgmap v1024: 97 pgs: 97 active+clean; 880 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 103 KiB/s wr, 42 op/s 2024-08-31T06:27:14.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:14 smithi053 ceph-mon[18924]: pgmap v1024: 97 pgs: 97 active+clean; 880 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 103 KiB/s wr, 42 op/s 2024-08-31T06:27:15.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.30 MB/sec execute 423 sec latency 15102.773 ms 2024-08-31T06:27:16.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.28 MB/sec execute 424 sec latency 16102.847 ms 2024-08-31T06:27:16.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:16 smithi130 ceph-mon[22266]: pgmap v1025: 97 pgs: 97 active+clean; 876 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 103 KiB/s wr, 40 op/s 2024-08-31T06:27:16.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:16 smithi153 ceph-mon[22320]: pgmap v1025: 97 pgs: 97 active+clean; 876 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 103 KiB/s wr, 40 op/s 2024-08-31T06:27:16.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:16 smithi053 ceph-mon[18924]: pgmap v1025: 97 pgs: 97 active+clean; 876 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 103 KiB/s wr, 40 op/s 2024-08-31T06:27:17.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.27 MB/sec execute 425 sec latency 17102.954 ms 2024-08-31T06:27:18.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.26 MB/sec execute 426 sec latency 18103.022 ms 2024-08-31T06:27:18.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:18 smithi130 ceph-mon[22266]: pgmap v1026: 97 pgs: 97 active+clean; 869 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 92 KiB/s wr, 37 op/s 2024-08-31T06:27:18.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:18 smithi153 ceph-mon[22320]: pgmap v1026: 97 pgs: 97 active+clean; 869 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 92 KiB/s wr, 37 op/s 2024-08-31T06:27:18.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:18 smithi053 ceph-mon[18924]: pgmap v1026: 97 pgs: 97 active+clean; 869 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 92 KiB/s wr, 37 op/s 2024-08-31T06:27:19.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.25 MB/sec execute 427 sec latency 19103.132 ms 2024-08-31T06:27:20.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.24 MB/sec execute 428 sec latency 20103.233 ms 2024-08-31T06:27:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:20 smithi130 ceph-mon[22266]: pgmap v1027: 97 pgs: 97 active+clean; 869 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 53 KiB/s wr, 20 op/s 2024-08-31T06:27:20.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:20 smithi130 ceph-mon[22266]: osdmap e108: 12 total, 12 up, 12 in 2024-08-31T06:27:20.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:20 smithi153 ceph-mon[22320]: pgmap v1027: 97 pgs: 97 active+clean; 869 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 53 KiB/s wr, 20 op/s 2024-08-31T06:27:20.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:20 smithi153 ceph-mon[22320]: osdmap e108: 12 total, 12 up, 12 in 2024-08-31T06:27:20.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:20 smithi053 ceph-mon[18924]: pgmap v1027: 97 pgs: 97 active+clean; 869 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 53 KiB/s wr, 20 op/s 2024-08-31T06:27:20.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:20 smithi053 ceph-mon[18924]: osdmap e108: 12 total, 12 up, 12 in 2024-08-31T06:27:21.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:27:21.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.22 MB/sec execute 429 sec latency 21103.296 ms 2024-08-31T06:27:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.884+0000 7f25a7538640 1 -- 172.21.15.53:0/3978384817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a0108b40 msgr2=0x7f25a010f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.884+0000 7f25a7538640 1 --2- 172.21.15.53:0/3978384817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a0108b40 0x7f25a010f370 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f2598009ca0 tx=0x7f259802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.884+0000 7f25a7538640 1 -- 172.21.15.53:0/3978384817 shutdown_connections 2024-08-31T06:27:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.884+0000 7f25a7538640 1 --2- 172.21.15.53:0/3978384817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a0108b40 0x7f25a010f370 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.884+0000 7f25a7538640 1 --2- 172.21.15.53:0/3978384817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25a01081f0 0x7f25a0108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.884+0000 7f25a7538640 1 --2- 172.21.15.53:0/3978384817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a01028b0 0x7f25a0102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.884+0000 7f25a7538640 1 -- 172.21.15.53:0/3978384817 >> 172.21.15.53:0/3978384817 conn(0x7f25a0079470 msgr2=0x7f25a0079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.884+0000 7f25a7538640 1 -- 172.21.15.53:0/3978384817 shutdown_connections 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.884+0000 7f25a7538640 1 -- 172.21.15.53:0/3978384817 wait complete. 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.885+0000 7f25a7538640 1 Processor -- start 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.885+0000 7f25a7538640 1 -- start start 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.885+0000 7f25a7538640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25a01028b0 0x7f25a0197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.885+0000 7f25a7538640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a01081f0 0x7f25a0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.885+0000 7f25a7538640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a0108b40 0x7f25a019d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.885+0000 7f25a7538640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01115f0 con 0x7f25a01081f0 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.885+0000 7f25a7538640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0111470 con 0x7f25a01028b0 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.885+0000 7f25a7538640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0111770 con 0x7f25a0108b40 2024-08-31T06:27:21.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a4ad3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a01081f0 0x7f25a0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a4ad3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a01081f0 0x7f25a0198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39468/0 (socket says 172.21.15.53:39468) 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a4ad3640 1 -- 172.21.15.53:0/281392243 learned_addr learned my addr 172.21.15.53:0/281392243 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a5ad5640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a0108b40 0x7f25a019d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a52d4640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25a01028b0 0x7f25a0197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a4ad3640 1 -- 172.21.15.53:0/281392243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a0108b40 msgr2=0x7f25a019d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a0108b40 0x7f25a019d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a4ad3640 1 -- 172.21.15.53:0/281392243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25a01028b0 msgr2=0x7f25a0197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25a01028b0 0x7f25a0197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a4ad3640 1 -- 172.21.15.53:0/281392243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a019df10 con 0x7f25a01081f0 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a52d4640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25a01028b0 0x7f25a0197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a01081f0 0x7f25a0198540 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f259400c970 tx=0x7f259400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25927fc640 1 -- 172.21.15.53:0/281392243 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594007bb0 con 0x7f25a01081f0 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25927fc640 1 -- 172.21.15.53:0/281392243 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2594007d50 con 0x7f25a01081f0 2024-08-31T06:27:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a7538640 1 -- 172.21.15.53:0/281392243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a019e200 con 0x7f25a01081f0 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25927fc640 1 -- 172.21.15.53:0/281392243 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594004da0 con 0x7f25a01081f0 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.886+0000 7f25a7538640 1 -- 172.21.15.53:0/281392243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a01a4960 con 0x7f25a01081f0 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25adaad740 1 Processor -- start 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25adaad740 1 -- start start 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25adaad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd98070 0x56260d13d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25adaad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd6f1b0 0x56260d13d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25927fc640 1 -- 172.21.15.53:0/281392243 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2594004f80 con 0x7f25a01081f0 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25adaad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d13dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25adaad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56260d0b4630 con 0x56260cd77390 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25adaad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56260d0a3bc0 con 0x56260cd98070 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25adaad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56260d0a7b70 con 0x56260cd6f1b0 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25a4ad3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d13dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25a4ad3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d13dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39484/0 (socket says 172.21.15.53:39484) 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.889+0000 7f25a4ad3640 1 -- 172.21.15.53:0/1510451664 learned_addr learned my addr 172.21.15.53:0/1510451664 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25a5ad5640 1 --2- 172.21.15.53:0/1510451664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd98070 0x56260d13d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25a52d4640 1 --2- 172.21.15.53:0/1510451664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd6f1b0 0x56260d13d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25a4ad3640 1 -- 172.21.15.53:0/1510451664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd6f1b0 msgr2=0x56260d13d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/1510451664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd6f1b0 0x56260d13d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25a4ad3640 1 -- 172.21.15.53:0/1510451664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd98070 msgr2=0x56260d13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/1510451664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd98070 0x56260d13d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25a4ad3640 1 -- 172.21.15.53:0/1510451664 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56260ce03650 con 0x56260cd77390 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25a52d4640 1 --2- 172.21.15.53:0/1510451664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd6f1b0 0x56260d13d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/1510451664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d13dd40 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f25940e29a0 tx=0x7f25940ed9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cd3a55482f63dd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25927fc640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f258c0b6eb0 0x7f258c0b93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f258b7fe640 1 -- 172.21.15.53:0/1510451664 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25940f9070 con 0x56260cd77390 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25a5ad5640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f258c0b6eb0 0x7f258c0b93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.890+0000 7f25927fc640 1 -- 172.21.15.53:0/281392243 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f25940e5300 con 0x7f25a01081f0 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.891+0000 7f258b7fe640 1 -- 172.21.15.53:0/1510451664 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25940046c0 con 0x56260cd77390 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.891+0000 7f258b7fe640 1 -- 172.21.15.53:0/1510451664 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25940ab7a0 con 0x56260cd77390 2024-08-31T06:27:21.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.891+0000 7f25adaad740 1 -- 172.21.15.53:0/1510451664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 msgr2=0x56260d13dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.891+0000 7f25a5ad5640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f258c0b6eb0 0x7f258c0b93c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2598006010 tx=0x7f2598009800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.891+0000 7f25adaad740 1 --2- 172.21.15.53:0/1510451664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d13dd40 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f25940e29a0 tx=0x7f25940ed9f0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 -- 172.21.15.53:0/1510451664 shutdown_connections 2024-08-31T06:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 --2- 172.21.15.53:0/1510451664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d13dd40 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 --2- 172.21.15.53:0/1510451664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd6f1b0 0x56260d13d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 --2- 172.21.15.53:0/1510451664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd98070 0x56260d13d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 -- 172.21.15.53:0/1510451664 >> 172.21.15.53:0/1510451664 conn(0x56260cd8c460 msgr2=0x56260d13b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 -- 172.21.15.53:0/1510451664 shutdown_connections 2024-08-31T06:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 -- 172.21.15.53:0/1510451664 wait complete. 2024-08-31T06:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 -- start start 2024-08-31T06:27:21.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 Processor -- start 2024-08-31T06:27:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d148a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd77390 0x56260d148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56260cf06700 con 0x56260cd6f1b0 2024-08-31T06:27:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56260d02a700 con 0x56260cd77390 2024-08-31T06:27:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56260d14baa0 con 0x56260cd98070 2024-08-31T06:27:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25a52d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25adaad740 10 client.0 _ll_register_callbacks cb 0x56260d059dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:21.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25a52d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d148a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39500/0 (socket says 172.21.15.53:39500) 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25a52d4640 1 -- 172.21.15.53:0/3705554819 learned_addr learned my addr 172.21.15.53:0/3705554819 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd77390 0x56260d148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25a5ad5640 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25a52d4640 1 -- 172.21.15.53:0/3705554819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 msgr2=0x56260d154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25a52d4640 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25a52d4640 1 -- 172.21.15.53:0/3705554819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd77390 msgr2=0x56260d148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25a52d4640 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd77390 0x56260d148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25a52d4640 1 -- 172.21.15.53:0/3705554819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56260d0638b0 con 0x56260cd6f1b0 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f25a52d4640 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d148a80 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f259c00bf00 tx=0x7f259c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b892d1a9fbbd63a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.893+0000 7f2588ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f2588ff9640 1 -- 172.21.15.53:0/3705554819 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c012650 con 0x56260cd6f1b0 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f2588ff9640 1 -- 172.21.15.53:0/3705554819 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f259c0127f0 con 0x56260cd6f1b0 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f25adaad740 1 -- 172.21.15.53:0/3705554819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56260d0b6580 con 0x56260cd6f1b0 2024-08-31T06:27:21.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f2588ff9640 1 -- 172.21.15.53:0/3705554819 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f259c0129f0 con 0x56260cd6f1b0 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f25adaad740 10 client.22275 fetch_fsmap learned FSMap version 78 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f25adaad740 1 -- 172.21.15.53:0/3705554819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) -- 0x56260d157960 con 0x56260cd6f1b0 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f2588ff9640 1 -- 172.21.15.53:0/3705554819 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56260d0b6580 con 0x56260cd6f1b0 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f2588ff9640 1 -- 172.21.15.53:0/3705554819 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 78) ==== 8422+0+0 (secure 0 0 0) 0x7f259c01bce0 con 0x56260cd6f1b0 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f25adaad740 10 client.22275 fetch_fsmap finished waiting for FSMap version 78 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f25adaad740 10 client.22275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f25adaad740 20 client.22275 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f25adaad740 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56260cd569f0 0x56260d15b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f25adaad740 4 client.22275 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.894+0000 7f25adaad740 1 -- 172.21.15.53:0/3705554819 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56260d0b2020 con 0x56260cd569f0 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.895+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56260cd569f0 0x56260d15b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.895+0000 7f2588ff9640 10 client.22275 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.895+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56260cd569f0 0x56260d15b020 crc :-1 s=READY pgs=526 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53b5605402ba30be server_cookie=ecea26004d6396 in_seq=0 out_seq=0 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f2588ff9640 1 -- 172.21.15.53:0/3705554819 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56260d0b2020 con 0x56260cd569f0 2024-08-31T06:27:21.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f2588ff9640 10 client.22275 handle_command_reply: tid=0 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f25adaad740 1 client.22275 shutdown 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f25adaad740 1 -- 172.21.15.53:0/3705554819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 msgr2=0x56260d148a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f25adaad740 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d148a80 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f259c00bf00 tx=0x7f259c0117b0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f25adaad740 1 -- 172.21.15.53:0/3705554819 shutdown_connections 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f25adaad740 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56260cd569f0 0x56260d15b020 crc :-1 s=READY pgs=526 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f25adaad740 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f25adaad740 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd77390 0x56260d148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f2588ff9640 0 client.22275 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f25adaad740 1 --2- 172.21.15.53:0/3705554819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d148a80 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f25adaad740 1 -- 172.21.15.53:0/3705554819 >> 172.21.15.53:0/3705554819 conn(0x56260cd8c460 msgr2=0x56260d140450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f25adaad740 1 -- 172.21.15.53:0/3705554819 shutdown_connections 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.896+0000 7f25adaad740 1 -- 172.21.15.53:0/3705554819 wait complete. 2024-08-31T06:27:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.897+0000 7f25adaad740 20 client.22275 trim_cache size 0 max 16384 2024-08-31T06:27:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.914+0000 7f25adaad740 1 Processor -- start 2024-08-31T06:27:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.914+0000 7f25adaad740 1 -- start start 2024-08-31T06:27:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.914+0000 7f25adaad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.914+0000 7f25adaad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd77390 0x56260d145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.914+0000 7f25adaad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d1461b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.914+0000 7f25adaad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01ad2f0 con 0x56260cd6f1b0 2024-08-31T06:27:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.914+0000 7f25adaad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01af100 con 0x56260cd77390 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.914+0000 7f25adaad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01ada80 con 0x56260cd98070 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.914+0000 7f25a52d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.914+0000 7f25a52d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d140ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39508/0 (socket says 172.21.15.53:39508) 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.914+0000 7f25a52d4640 1 -- 172.21.15.53:0/1861678914 learned_addr learned my addr 172.21.15.53:0/1861678914 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f25a5ad5640 1 --2- 172.21.15.53:0/1861678914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d1461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/1861678914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd77390 0x56260d145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f25a52d4640 1 -- 172.21.15.53:0/1861678914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 msgr2=0x56260d1461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f25a52d4640 1 --2- 172.21.15.53:0/1861678914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d1461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f25a52d4640 1 -- 172.21.15.53:0/1861678914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd77390 msgr2=0x56260d145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f25a52d4640 1 --2- 172.21.15.53:0/1861678914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd77390 0x56260d145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f25a52d4640 1 -- 172.21.15.53:0/1861678914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56260d1479e0 con 0x56260cd6f1b0 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/1861678914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd77390 0x56260d145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f25a52d4640 1 --2- 172.21.15.53:0/1861678914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d140ad0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f259c011cb0 tx=0x7f259c023a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bffc23f388b819 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f258affd640 1 -- 172.21.15.53:0/1861678914 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c023d90 con 0x56260cd6f1b0 2024-08-31T06:27:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f258affd640 1 -- 172.21.15.53:0/1861678914 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f259c012b90 con 0x56260cd6f1b0 2024-08-31T06:27:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.915+0000 7f258affd640 1 -- 172.21.15.53:0/1861678914 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c005570 con 0x56260cd6f1b0 2024-08-31T06:27:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.916+0000 7f25adaad740 1 -- 172.21.15.53:0/1861678914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 msgr2=0x56260d140ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.916+0000 7f25adaad740 1 --2- 172.21.15.53:0/1861678914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d140ad0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f259c011cb0 tx=0x7f259c023a20 comp rx=0 tx=0).stop 2024-08-31T06:27:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.916+0000 7f25adaad740 1 -- 172.21.15.53:0/1861678914 shutdown_connections 2024-08-31T06:27:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.916+0000 7f25adaad740 1 --2- 172.21.15.53:0/1861678914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d1461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.916+0000 7f25adaad740 1 --2- 172.21.15.53:0/1861678914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd77390 0x56260d145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.916+0000 7f25adaad740 1 --2- 172.21.15.53:0/1861678914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd6f1b0 0x56260d140ad0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.916+0000 7f25adaad740 1 -- 172.21.15.53:0/1861678914 >> 172.21.15.53:0/1861678914 conn(0x56260cd8c460 msgr2=0x56260d1403c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.916+0000 7f25adaad740 1 -- 172.21.15.53:0/1861678914 shutdown_connections 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.916+0000 7f25adaad740 1 -- 172.21.15.53:0/1861678914 wait complete. 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.916+0000 7f25adaad740 1 -- start start 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.916+0000 7f25adaad740 1 Processor -- start 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25adaad740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd6f1b0 0x56260d14f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25adaad740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d14f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25adaad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d1c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25adaad740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01ae970 con 0x56260cd77390 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25adaad740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01ae210 con 0x56260cd6f1b0 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25adaad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01ab2f0 con 0x56260cd98070 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25adaad740 10 client.0 _ll_register_callbacks cb 0x7f259c00b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25a4ad3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d14f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25a4ad3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d14f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39512/0 (socket says 172.21.15.53:39512) 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25a4ad3640 1 -- 172.21.15.53:0/2845439492 learned_addr learned my addr 172.21.15.53:0/2845439492 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25a52d4640 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd6f1b0 0x56260d14f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25a5ad5640 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d1c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25a4ad3640 1 -- 172.21.15.53:0/2845439492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 msgr2=0x56260d1c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d1c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25a4ad3640 1 -- 172.21.15.53:0/2845439492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd6f1b0 msgr2=0x56260d14f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd6f1b0 0x56260d14f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25a4ad3640 1 -- 172.21.15.53:0/2845439492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56260d1c4f60 con 0x56260cd77390 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f25a4ad3640 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d14f9c0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f25940a7a50 tx=0x7f25940e5260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9614a7d273db9fd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.917+0000 7f2588ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f2588ff9640 1 -- 172.21.15.53:0/2845439492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25940154e0 con 0x56260cd77390 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f2588ff9640 1 -- 172.21.15.53:0/2845439492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f25940ed150 con 0x56260cd77390 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f25adaad740 1 -- 172.21.15.53:0/2845439492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f259c012b90 con 0x56260cd77390 2024-08-31T06:27:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f2588ff9640 1 -- 172.21.15.53:0/2845439492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f2594015740 con 0x56260cd77390 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f25adaad740 10 client.22281 fetch_fsmap learned FSMap version 78 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f25adaad740 1 -- 172.21.15.53:0/2845439492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) -- 0x56260d1c6160 con 0x56260cd77390 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f2588ff9640 1 -- 172.21.15.53:0/2845439492 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f259c012b90 con 0x56260cd77390 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f2588ff9640 1 -- 172.21.15.53:0/2845439492 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 78) ==== 8422+0+0 (secure 0 0 0) 0x7f25940e2cb0 con 0x56260cd77390 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f25adaad740 10 client.22281 fetch_fsmap finished waiting for FSMap version 78 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f25adaad740 10 client.22281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f25adaad740 20 client.22281 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f25adaad740 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56260cd2bda0 0x56260d1c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f25adaad740 4 client.22281 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.918+0000 7f25adaad740 1 -- 172.21.15.53:0/2845439492 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56260d0af760 con 0x56260cd2bda0 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.919+0000 7f25a52d4640 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56260cd2bda0 0x56260d1c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.919+0000 7f25a52d4640 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56260cd2bda0 0x56260d1c8410 crc :-1 s=READY pgs=527 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c772248f0fd0c04 server_cookie=c85cdc2f6f87523e in_seq=0 out_seq=0 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.919+0000 7f2588ff9640 10 client.22281 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f2588ff9640 1 -- 172.21.15.53:0/2845439492 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7758 (crc 0 0 0) 0x56260d0af760 con 0x56260cd2bda0 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f2588ff9640 10 client.22281 handle_command_reply: tid=0 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 1 client.22281 shutdown 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 1 -- 172.21.15.53:0/2845439492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 msgr2=0x56260d14f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d14f9c0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f25940a7a50 tx=0x7f25940e5260 comp rx=0 tx=0).stop 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 1 -- 172.21.15.53:0/2845439492 shutdown_connections 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56260cd2bda0 0x56260d1c8410 crc :-1 s=READY pgs=527 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56260cd98070 0x56260d1c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260cd77390 0x56260d14f9c0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 1 --2- 172.21.15.53:0/2845439492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56260cd6f1b0 0x56260d14f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 1 -- 172.21.15.53:0/2845439492 >> 172.21.15.53:0/2845439492 conn(0x56260cd8c460 msgr2=0x56260d13e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f2588ff9640 0 client.22281 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 1 -- 172.21.15.53:0/2845439492 shutdown_connections 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 1 -- 172.21.15.53:0/2845439492 wait complete. 2024-08-31T06:27:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.920+0000 7f25adaad740 20 client.22281 trim_cache size 0 max 16384 2024-08-31T06:27:21.928 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:27:21.928 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:27:21.928 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:27:21.928 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:27:21.928 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:27:21.928 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:27:21.928 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:27:21.929 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.930 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:25:55.673122+0000", 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:27:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:27:21.934 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "857f8219-039c-44d2-8dd7-af494d80e735": { 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:26:48.510100+0000", 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.936 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:27:21.937 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.938 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.940 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.941 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:27:21.942 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:21.943 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 -- 172.21.15.53:0/281392243 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f258c0b6eb0 msgr2=0x7f258c0b93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f258c0b6eb0 0x7f258c0b93c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2598006010 tx=0x7f2598009800 comp rx=0 tx=0).stop 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 -- 172.21.15.53:0/281392243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a01081f0 msgr2=0x7f25a0198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a01081f0 0x7f25a0198540 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f259400c970 tx=0x7f259400ce30 comp rx=0 tx=0).stop 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 -- 172.21.15.53:0/281392243 shutdown_connections 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f258c0b6eb0 0x7f258c0b93c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a0108b40 0x7f25a019d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a01081f0 0x7f25a0198540 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 --2- 172.21.15.53:0/281392243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25a01028b0 0x7f25a0197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 -- 172.21.15.53:0/281392243 >> 172.21.15.53:0/281392243 conn(0x7f25a0079470 msgr2=0x7f25a01041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 -- 172.21.15.53:0/281392243 shutdown_connections 2024-08-31T06:27:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:21.921+0000 7f25a7538640 1 -- 172.21.15.53:0/281392243 wait complete. 2024-08-31T06:27:22.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.21 MB/sec execute 430 sec latency 22103.353 ms 2024-08-31T06:27:22.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:22 smithi130 ceph-mon[22266]: pgmap v1029: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 49 KiB/s wr, 18 op/s 2024-08-31T06:27:22.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:22 smithi153 ceph-mon[22320]: pgmap v1029: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 49 KiB/s wr, 18 op/s 2024-08-31T06:27:22.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:22 smithi053 ceph-mon[18924]: pgmap v1029: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 49 KiB/s wr, 18 op/s 2024-08-31T06:27:22.815 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:27:22.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:27:23.072 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:23.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.20 MB/sec execute 431 sec latency 23103.378 ms 2024-08-31T06:27:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.579+0000 7f6842a67640 1 -- 172.21.15.53:0/789261352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c108140 msgr2=0x7f683c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.579+0000 7f6842a67640 1 --2- 172.21.15.53:0/789261352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c108140 0x7f683c108550 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f6824009900 tx=0x7f682402a410 comp rx=0 tx=0).stop 2024-08-31T06:27:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.579+0000 7f6842a67640 1 -- 172.21.15.53:0/789261352 shutdown_connections 2024-08-31T06:27:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.579+0000 7f6842a67640 1 --2- 172.21.15.53:0/789261352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f683c108a90 0x7f683c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.579+0000 7f6842a67640 1 --2- 172.21.15.53:0/789261352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c108140 0x7f683c108550 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.579+0000 7f6842a67640 1 --2- 172.21.15.53:0/789261352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f683c102800 0x7f683c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.579+0000 7f6842a67640 1 -- 172.21.15.53:0/789261352 >> 172.21.15.53:0/789261352 conn(0x7f683c0794d0 msgr2=0x7f683c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.579+0000 7f6842a67640 1 -- 172.21.15.53:0/789261352 shutdown_connections 2024-08-31T06:27:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.579+0000 7f6842a67640 1 -- 172.21.15.53:0/789261352 wait complete. 2024-08-31T06:27:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.579+0000 7f6842a67640 1 Processor -- start 2024-08-31T06:27:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.579+0000 7f6842a67640 1 -- start start 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f6842a67640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f683c102800 0x7f683c199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f6842a67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c108140 0x7f683c1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f6842a67640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f683c108a90 0x7f683c19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f6842a67640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f683c112570 con 0x7f683c108140 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f6842a67640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f683c1123f0 con 0x7f683c108a90 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f6842a67640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f683c1126f0 con 0x7f683c102800 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f683bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c108140 0x7f683c1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f683bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c108140 0x7f683c1995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38230/0 (socket says 172.21.15.53:38230) 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f683bfff640 1 -- 172.21.15.53:0/3999449908 learned_addr learned my addr 172.21.15.53:0/3999449908 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f6840803640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f683c102800 0x7f683c199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f6841004640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f683c108a90 0x7f683c19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f683bfff640 1 -- 172.21.15.53:0/3999449908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f683c102800 msgr2=0x7f683c199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f683bfff640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f683c102800 0x7f683c199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f683bfff640 1 -- 172.21.15.53:0/3999449908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f683c108a90 msgr2=0x7f683c19e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f683bfff640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f683c108a90 0x7f683c19e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f683bfff640 1 -- 172.21.15.53:0/3999449908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c19ef90 con 0x7f683c108140 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.580+0000 7f683bfff640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c108140 0x7f683c1995c0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f6824005940 tx=0x7f68240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.581+0000 7f6839ffb640 1 -- 172.21.15.53:0/3999449908 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682403f030 con 0x7f683c108140 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.581+0000 7f6842a67640 1 -- 172.21.15.53:0/3999449908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683c19f220 con 0x7f683c108140 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.581+0000 7f6839ffb640 1 -- 172.21.15.53:0/3999449908 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6824003c90 con 0x7f683c108140 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.581+0000 7f6839ffb640 1 -- 172.21.15.53:0/3999449908 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824035070 con 0x7f683c108140 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.581+0000 7f6842a67640 1 -- 172.21.15.53:0/3999449908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f683c1a59e0 con 0x7f683c108140 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.582+0000 7f6842a67640 1 -- 172.21.15.53:0/3999449908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f683c102c10 con 0x7f683c108140 2024-08-31T06:27:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.584+0000 7f6839ffb640 1 -- 172.21.15.53:0/3999449908 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6824042030 con 0x7f683c108140 2024-08-31T06:27:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.585+0000 7f6839ffb640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68280b4ca0 0x7f68280b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.585+0000 7f6840803640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68280b4ca0 0x7f68280b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.585+0000 7f6839ffb640 1 -- 172.21.15.53:0/3999449908 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f6824105e30 con 0x7f683c108140 2024-08-31T06:27:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.585+0000 7f6840803640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68280b4ca0 0x7f68280b71b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f682c00bbe0 tx=0x7f682c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.588+0000 7f6839ffb640 1 -- 172.21.15.53:0/3999449908 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f68240cc5b0 con 0x7f683c108140 2024-08-31T06:27:23.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.812+0000 7f6842a67640 1 -- 172.21.15.53:0/3999449908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f683c10a8b0 con 0x7f683c108140 2024-08-31T06:27:23.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.813+0000 7f6839ffb640 1 -- 172.21.15.53:0/3999449908 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+12011 (secure 0 0 0) 0x7f68240d0d70 con 0x7f683c108140 2024-08-31T06:27:23.815 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:27:23.815 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":78,"btime":"2024-08-31T06:27:12:315545+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":78,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:27:11.403875+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:27:23.815 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 78 2024-08-31T06:27:23.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 -- 172.21.15.53:0/3999449908 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68280b4ca0 msgr2=0x7f68280b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:23.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68280b4ca0 0x7f68280b71b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f682c00bbe0 tx=0x7f682c00b390 comp rx=0 tx=0).stop 2024-08-31T06:27:23.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 -- 172.21.15.53:0/3999449908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c108140 msgr2=0x7f683c1995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:23.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c108140 0x7f683c1995c0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f6824005940 tx=0x7f68240042f0 comp rx=0 tx=0).stop 2024-08-31T06:27:23.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 -- 172.21.15.53:0/3999449908 shutdown_connections 2024-08-31T06:27:23.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f68280b4ca0 0x7f68280b71b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:23.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f683c108a90 0x7f683c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:23.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c108140 0x7f683c1995c0 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:23.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 --2- 172.21.15.53:0/3999449908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f683c102800 0x7f683c199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:23.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 -- 172.21.15.53:0/3999449908 >> 172.21.15.53:0/3999449908 conn(0x7f683c0794d0 msgr2=0x7f683c1050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:23.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 -- 172.21.15.53:0/3999449908 shutdown_connections 2024-08-31T06:27:23.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:23.815+0000 7f6842a67640 1 -- 172.21.15.53:0/3999449908 wait complete. 2024-08-31T06:27:24.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.19 MB/sec execute 432 sec latency 24103.459 ms 2024-08-31T06:27:24.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:24 smithi053 ceph-mon[18924]: pgmap v1030: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 46 KiB/s wr, 18 op/s 2024-08-31T06:27:24.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:24 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3999449908' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:27:24.510 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:27:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:24 smithi130 ceph-mon[22266]: pgmap v1030: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 46 KiB/s wr, 18 op/s 2024-08-31T06:27:24.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:24 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3999449908' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:27:24.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:24 smithi153 ceph-mon[22320]: pgmap v1030: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 46 KiB/s wr, 18 op/s 2024-08-31T06:27:24.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:24 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3999449908' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:27:24.769 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:25.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.230+0000 7f1b17fff640 1 -- 172.21.15.53:0/852318015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b18102610 msgr2=0x7f1b18102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.230+0000 7f1b17fff640 1 --2- 172.21.15.53:0/852318015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b18102610 0x7f1b18102a20 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009900 tx=0x7f1b0802a410 comp rx=0 tx=0).stop 2024-08-31T06:27:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.230+0000 7f1b17fff640 1 -- 172.21.15.53:0/852318015 shutdown_connections 2024-08-31T06:27:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.230+0000 7f1b17fff640 1 --2- 172.21.15.53:0/852318015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b181088a0 0x7f1b1810f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.230+0000 7f1b17fff640 1 --2- 172.21.15.53:0/852318015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b18107f50 0x7f1b18108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.230+0000 7f1b17fff640 1 --2- 172.21.15.53:0/852318015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b18102610 0x7f1b18102a20 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.230+0000 7f1b17fff640 1 -- 172.21.15.53:0/852318015 >> 172.21.15.53:0/852318015 conn(0x7f1b180fe060 msgr2=0x7f1b181004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.230+0000 7f1b17fff640 1 -- 172.21.15.53:0/852318015 shutdown_connections 2024-08-31T06:27:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.230+0000 7f1b17fff640 1 -- 172.21.15.53:0/852318015 wait complete. 2024-08-31T06:27:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.230+0000 7f1b17fff640 1 Processor -- start 2024-08-31T06:27:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b17fff640 1 -- start start 2024-08-31T06:27:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b18102610 0x7f1b1819c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b17fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b18107f50 0x7f1b1819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b17fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b181088a0 0x7f1b181a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b17fff640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1b18113530 con 0x7f1b18102610 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b17fff640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b181133b0 con 0x7f1b181088a0 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b17fff640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1b181136b0 con 0x7f1b18107f50 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b16ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b18102610 0x7f1b1819c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b16ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b18102610 0x7f1b1819c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38258/0 (socket says 172.21.15.53:38258) 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b16ffd640 1 -- 172.21.15.53:0/3914462564 learned_addr learned my addr 172.21.15.53:0/3914462564 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b167fc640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b18107f50 0x7f1b1819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b177fe640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b181088a0 0x7f1b181a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b16ffd640 1 -- 172.21.15.53:0/3914462564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b18107f50 msgr2=0x7f1b1819c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b18107f50 0x7f1b1819c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b16ffd640 1 -- 172.21.15.53:0/3914462564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b181088a0 msgr2=0x7f1b181a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b181088a0 0x7f1b181a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b16ffd640 1 -- 172.21.15.53:0/3914462564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b181a21d0 con 0x7f1b18102610 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.231+0000 7f1b177fe640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b181088a0 0x7f1b181a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.232+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b18102610 0x7f1b1819c260 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009230 tx=0x7f1b08004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.232+0000 7f1afffff640 1 -- 172.21.15.53:0/3914462564 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0803f030 con 0x7f1b18102610 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.232+0000 7f1b17fff640 1 -- 172.21.15.53:0/3914462564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b181a2460 con 0x7f1b18102610 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.232+0000 7f1afffff640 1 -- 172.21.15.53:0/3914462564 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b08003a80 con 0x7f1b18102610 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.232+0000 7f1afffff640 1 -- 172.21.15.53:0/3914462564 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08035070 con 0x7f1b18102610 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.232+0000 7f1b17fff640 1 -- 172.21.15.53:0/3914462564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b181a8c20 con 0x7f1b18102610 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.234+0000 7f1b23c79740 1 Processor -- start 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.234+0000 7f1b23c79740 1 -- start start 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1afffff640 1 -- 172.21.15.53:0/3914462564 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1b08042030 con 0x7f1b18102610 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493ccf81b0 0x56493d0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b23c79740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56493d03d680 con 0x56493cd00390 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b23c79740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56493d02cc10 con 0x56493ccf81b0 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b23c79740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56493d030bc0 con 0x56493cd21070 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38262/0 (socket says 172.21.15.53:38262) 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b167fc640 1 -- 172.21.15.53:0/4062159557 learned_addr learned my addr 172.21.15.53:0/4062159557 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b177fe640 1 --2- 172.21.15.53:0/4062159557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/4062159557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493ccf81b0 0x56493d0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b167fc640 1 -- 172.21.15.53:0/4062159557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 msgr2=0x56493d0c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b167fc640 1 --2- 172.21.15.53:0/4062159557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b167fc640 1 -- 172.21.15.53:0/4062159557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493ccf81b0 msgr2=0x56493d0c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b167fc640 1 --2- 172.21.15.53:0/4062159557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493ccf81b0 0x56493d0c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1b167fc640 1 -- 172.21.15.53:0/4062159557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493cd8c650 con 0x56493cd00390 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.235+0000 7f1afffff640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1b000b4ca0 0x7f1b000b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.236+0000 7f1b177fe640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1b000b4ca0 0x7f1b000b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.236+0000 7f1b167fc640 1 --2- 172.21.15.53:0/4062159557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0c6f70 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00bc10 tx=0x7f1b0c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc64a278743e755c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.236+0000 7f1afffff640 1 -- 172.21.15.53:0/3914462564 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f1b08105d70 con 0x7f1b18102610 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.236+0000 7f1afd7fa640 1 -- 172.21.15.53:0/4062159557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c015070 con 0x56493cd00390 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.236+0000 7f1afd7fa640 1 -- 172.21.15.53:0/4062159557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b0c01a8f0 con 0x56493cd00390 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.236+0000 7f1afd7fa640 1 -- 172.21.15.53:0/4062159557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c011710 con 0x56493cd00390 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b23c79740 1 -- 172.21.15.53:0/4062159557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 msgr2=0x56493d0c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b177fe640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1b000b4ca0 0x7f1b000b71b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1b10005fd0 tx=0x7f1b10009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b23c79740 1 --2- 172.21.15.53:0/4062159557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0c6f70 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00bc10 tx=0x7f1b0c00f730 comp rx=0 tx=0).stop 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b23c79740 1 -- 172.21.15.53:0/4062159557 shutdown_connections 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b23c79740 1 --2- 172.21.15.53:0/4062159557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0c6f70 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b23c79740 1 --2- 172.21.15.53:0/4062159557 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493ccf81b0 0x56493d0c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b23c79740 1 --2- 172.21.15.53:0/4062159557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b23c79740 1 -- 172.21.15.53:0/4062159557 >> 172.21.15.53:0/4062159557 conn(0x56493cd15460 msgr2=0x56493d0c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b23c79740 1 -- 172.21.15.53:0/4062159557 shutdown_connections 2024-08-31T06:27:25.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b23c79740 1 -- 172.21.15.53:0/4062159557 wait complete. 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b23c79740 1 -- start start 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.237+0000 7f1b23c79740 1 Processor -- start 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493ccf81b0 0x56493d0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0ddff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b23c79740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56493ce8f700 con 0x56493cd00390 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b23c79740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56493cfb3750 con 0x56493ccf81b0 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b23c79740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56493d0d4cd0 con 0x56493cd21070 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b23c79740 10 client.0 _ll_register_callbacks cb 0x56493cfe2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0d2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38268/0 (socket says 172.21.15.53:38268) 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b167fc640 1 -- 172.21.15.53:0/3452729537 learned_addr learned my addr 172.21.15.53:0/3452729537 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493ccf81b0 0x56493d0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b177fe640 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0ddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b167fc640 1 -- 172.21.15.53:0/3452729537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 msgr2=0x56493d0ddff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b167fc640 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0ddff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b167fc640 1 -- 172.21.15.53:0/3452729537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493ccf81b0 msgr2=0x56493d0d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b167fc640 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493ccf81b0 0x56493d0d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b167fc640 1 -- 172.21.15.53:0/3452729537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56493cfec900 con 0x56493cd00390 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b177fe640 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0ddff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1b167fc640 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0d2170 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c006010 tx=0x7f1b0c01a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136fd06355f57cda server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.238+0000 7f1afaff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1afaff5640 1 -- 172.21.15.53:0/3452729537 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c015070 con 0x56493cd00390 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1b23c79740 1 -- 172.21.15.53:0/3452729537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b0c01a8f0 con 0x56493cd00390 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1afaff5640 1 -- 172.21.15.53:0/3452729537 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f1b0c00be40 con 0x56493cd00390 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1afaff5640 1 -- 172.21.15.53:0/3452729537 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f1b0c01acb0 con 0x56493cd00390 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1b23c79740 10 client.22299 fetch_fsmap learned FSMap version 78 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1b23c79740 1 -- 172.21.15.53:0/3452729537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) -- 0x56493d0e0a90 con 0x56493cd00390 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1afaff5640 1 -- 172.21.15.53:0/3452729537 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b0c01a8f0 con 0x56493cd00390 2024-08-31T06:27:25.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1afaff5640 1 -- 172.21.15.53:0/3452729537 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 78) ==== 8422+0+0 (secure 0 0 0) 0x7f1b0c0046c0 con 0x56493cd00390 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1b23c79740 10 client.22299 fetch_fsmap finished waiting for FSMap version 78 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1b23c79740 10 client.22299 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1b23c79740 20 client.22299 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1b23c79740 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56493ccdf9f0 0x56493d0e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1b23c79740 4 client.22299 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.239+0000 7f1b23c79740 1 -- 172.21.15.53:0/3452729537 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56493d03f5d0 con 0x56493ccdf9f0 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.240+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56493ccdf9f0 0x56493d0e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.240+0000 7f1afaff5640 10 client.22299 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.240+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56493ccdf9f0 0x56493d0e3df0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a6ae1f6bc86bcfbc server_cookie=c2d392db1551dca3 in_seq=0 out_seq=0 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1afaff5640 1 -- 172.21.15.53:0/3452729537 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56493d03f5d0 con 0x56493ccdf9f0 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1afaff5640 10 client.22299 handle_command_reply: tid=0 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 1 client.22299 shutdown 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 1 -- 172.21.15.53:0/3452729537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 msgr2=0x56493d0d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0d2170 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c006010 tx=0x7f1b0c01a690 comp rx=0 tx=0).stop 2024-08-31T06:27:25.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 1 -- 172.21.15.53:0/3452729537 shutdown_connections 2024-08-31T06:27:25.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56493ccdf9f0 0x56493d0e3df0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0ddff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493cd00390 0x56493d0d2170 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1afaff5640 0 client.22299 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:27:25.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 1 --2- 172.21.15.53:0/3452729537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493ccf81b0 0x56493d0d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 1 -- 172.21.15.53:0/3452729537 >> 172.21.15.53:0/3452729537 conn(0x56493cd15460 msgr2=0x56493d0c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:25.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 1 -- 172.21.15.53:0/3452729537 shutdown_connections 2024-08-31T06:27:25.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 1 -- 172.21.15.53:0/3452729537 wait complete. 2024-08-31T06:27:25.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.241+0000 7f1b23c79740 20 client.22299 trim_cache size 0 max 16384 2024-08-31T06:27:25.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.255+0000 7f1b23c79740 1 Processor -- start 2024-08-31T06:27:25.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.255+0000 7f1b23c79740 1 -- start start 2024-08-31T06:27:25.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.255+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.255+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd00390 0x56493d0ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493cd21070 0x56493d0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b23c79740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1b181b1570 con 0x56493ccf81b0 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b23c79740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b181b3380 con 0x56493cd21070 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b23c79740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1b181b1d00 con 0x56493cd00390 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b16ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b16ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38276/0 (socket says 172.21.15.53:38276) 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b16ffd640 1 -- 172.21.15.53:0/3605020301 learned_addr learned my addr 172.21.15.53:0/3605020301 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b177fe640 1 --2- 172.21.15.53:0/3605020301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493cd21070 0x56493d0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b16ffd640 1 -- 172.21.15.53:0/3605020301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd00390 msgr2=0x56493d0ddef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/3605020301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd00390 0x56493d0ddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b16ffd640 1 -- 172.21.15.53:0/3605020301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493cd21070 msgr2=0x56493d0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:25.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/3605020301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493cd21070 0x56493d0cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b16ffd640 1 -- 172.21.15.53:0/3605020301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493d0d4370 con 0x56493ccf81b0 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b177fe640 1 --2- 172.21.15.53:0/3605020301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493cd21070 0x56493d0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/3605020301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d20f0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f1b08103500 tx=0x7f1b080ef040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e98608ad187293 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1afcff9640 1 -- 172.21.15.53:0/3605020301 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08049040 con 0x56493ccf81b0 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.256+0000 7f1afcff9640 1 -- 172.21.15.53:0/3605020301 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b080ccb40 con 0x56493ccf81b0 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.257+0000 7f1afcff9640 1 -- 172.21.15.53:0/3605020301 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080c86d0 con 0x56493ccf81b0 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.257+0000 7f1b23c79740 1 -- 172.21.15.53:0/3605020301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 msgr2=0x56493d0d20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.257+0000 7f1b23c79740 1 --2- 172.21.15.53:0/3605020301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d20f0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f1b08103500 tx=0x7f1b080ef040 comp rx=0 tx=0).stop 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.257+0000 7f1b23c79740 1 -- 172.21.15.53:0/3605020301 shutdown_connections 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.257+0000 7f1b23c79740 1 --2- 172.21.15.53:0/3605020301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493cd21070 0x56493d0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.257+0000 7f1b23c79740 1 --2- 172.21.15.53:0/3605020301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd00390 0x56493d0ddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.257+0000 7f1b23c79740 1 --2- 172.21.15.53:0/3605020301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d20f0 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.257+0000 7f1b23c79740 1 -- 172.21.15.53:0/3605020301 >> 172.21.15.53:0/3605020301 conn(0x56493cd15460 msgr2=0x56493d0d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b23c79740 1 -- 172.21.15.53:0/3605020301 shutdown_connections 2024-08-31T06:27:25.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b23c79740 1 -- 172.21.15.53:0/3605020301 wait complete. 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b23c79740 1 -- start start 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b23c79740 1 Processor -- start 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493cd00390 0x56493d0da4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b23c79740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b23c79740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1b181b2bf0 con 0x56493ccf81b0 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b23c79740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b181b2490 con 0x56493cd00390 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b23c79740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1b181af570 con 0x56493cd21070 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b23c79740 10 client.0 _ll_register_callbacks cb 0x7f1b10009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b16ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b16ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38278/0 (socket says 172.21.15.53:38278) 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.258+0000 7f1b16ffd640 1 -- 172.21.15.53:0/2076735897 learned_addr learned my addr 172.21.15.53:0/2076735897 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:25.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1b177fe640 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0d4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1b167fc640 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493cd00390 0x56493d0da4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1b16ffd640 1 -- 172.21.15.53:0/2076735897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 msgr2=0x56493d0d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0d4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1b16ffd640 1 -- 172.21.15.53:0/2076735897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493cd00390 msgr2=0x56493d0da4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493cd00390 0x56493d0da4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1b16ffd640 1 -- 172.21.15.53:0/2076735897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56493d0daa60 con 0x56493ccf81b0 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1b16ffd640 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d9f60 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f1b080cc140 tx=0x7f1b080cc340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c42174b1d3537c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1afaff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1afaff5640 1 -- 172.21.15.53:0/2076735897 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080b7070 con 0x56493ccf81b0 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1afaff5640 1 -- 172.21.15.53:0/2076735897 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f1b080c86d0 con 0x56493ccf81b0 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1b23c79740 1 -- 172.21.15.53:0/2076735897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b080ccb40 con 0x56493ccf81b0 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1afaff5640 1 -- 172.21.15.53:0/2076735897 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f1b08049070 con 0x56493ccf81b0 2024-08-31T06:27:25.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1b23c79740 10 client.22305 fetch_fsmap learned FSMap version 78 2024-08-31T06:27:25.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1b23c79740 1 -- 172.21.15.53:0/2076735897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) -- 0x56493d14e8a0 con 0x56493ccf81b0 2024-08-31T06:27:25.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.259+0000 7f1afaff5640 1 -- 172.21.15.53:0/2076735897 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b080ccb40 con 0x56493ccf81b0 2024-08-31T06:27:25.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.260+0000 7f1afaff5640 1 -- 172.21.15.53:0/2076735897 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 78) ==== 8422+0+0 (secure 0 0 0) 0x7f1b08109040 con 0x56493ccf81b0 2024-08-31T06:27:25.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.260+0000 7f1b23c79740 10 client.22305 fetch_fsmap finished waiting for FSMap version 78 2024-08-31T06:27:25.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.260+0000 7f1b23c79740 10 client.22305 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:27:25.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.260+0000 7f1b23c79740 20 client.22305 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:25.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.260+0000 7f1b23c79740 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56493ccb4da0 0x56493d151040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:25.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.260+0000 7f1b23c79740 4 client.22305 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:27:25.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.260+0000 7f1b23c79740 1 -- 172.21.15.53:0/2076735897 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56493d03b070 con 0x56493ccb4da0 2024-08-31T06:27:25.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.260+0000 7f1b167fc640 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56493ccb4da0 0x56493d151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:25.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.260+0000 7f1b167fc640 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56493ccb4da0 0x56493d151040 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5ff695276b9bbcf3 server_cookie=721ac81330214bc7 in_seq=0 out_seq=0 2024-08-31T06:27:25.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.260+0000 7f1afaff5640 10 client.22305 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1afaff5640 1 -- 172.21.15.53:0/2076735897 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56493d03b070 con 0x56493ccb4da0 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1afaff5640 10 client.22305 handle_command_reply: tid=0 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 1 client.22305 shutdown 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 1 -- 172.21.15.53:0/2076735897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 msgr2=0x56493d0d9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d9f60 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f1b080cc140 tx=0x7f1b080cc340 comp rx=0 tx=0).stop 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 1 -- 172.21.15.53:0/2076735897 shutdown_connections 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x56493ccb4da0 0x56493d151040 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56493cd21070 0x56493d0d4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56493cd00390 0x56493d0da4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 1 --2- 172.21.15.53:0/2076735897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56493ccf81b0 0x56493d0d9f60 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1afaff5640 0 client.22305 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 1 -- 172.21.15.53:0/2076735897 >> 172.21.15.53:0/2076735897 conn(0x56493cd15460 msgr2=0x56493d0c3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:25.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 1 -- 172.21.15.53:0/2076735897 shutdown_connections 2024-08-31T06:27:25.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 1 -- 172.21.15.53:0/2076735897 wait complete. 2024-08-31T06:27:25.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.261+0000 7f1b23c79740 20 client.22305 trim_cache size 0 max 16384 2024-08-31T06:27:25.269 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:27:25.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 -- 172.21.15.53:0/3914462564 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1b000b4ca0 msgr2=0x7f1b000b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:25.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1b000b4ca0 0x7f1b000b71b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1b10005fd0 tx=0x7f1b10009680 comp rx=0 tx=0).stop 2024-08-31T06:27:25.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 -- 172.21.15.53:0/3914462564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b18102610 msgr2=0x7f1b1819c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:25.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b18102610 0x7f1b1819c260 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009230 tx=0x7f1b08004270 comp rx=0 tx=0).stop 2024-08-31T06:27:25.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 -- 172.21.15.53:0/3914462564 shutdown_connections 2024-08-31T06:27:25.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1b000b4ca0 0x7f1b000b71b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b181088a0 0x7f1b181a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b18107f50 0x7f1b1819c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 --2- 172.21.15.53:0/3914462564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b18102610 0x7f1b1819c260 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:25.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 -- 172.21.15.53:0/3914462564 >> 172.21.15.53:0/3914462564 conn(0x7f1b180fe060 msgr2=0x7f1b1810d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:25.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 -- 172.21.15.53:0/3914462564 shutdown_connections 2024-08-31T06:27:25.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:25.262+0000 7f1b17fff640 1 -- 172.21.15.53:0/3914462564 wait complete. 2024-08-31T06:27:25.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.17 MB/sec execute 433 sec latency 25103.568 ms 2024-08-31T06:27:26.109 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:27:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.269+0000 7fb4b7825640 1 -- 172.21.15.53:0/1094024036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4b01091d0 msgr2=0x7fb4b01095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.269+0000 7fb4b7825640 1 --2- 172.21.15.53:0/1094024036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4b01091d0 0x7fb4b01095e0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009900 tx=0x7fb4ac02a410 comp rx=0 tx=0).stop 2024-08-31T06:27:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.269+0000 7fb4b7825640 1 -- 172.21.15.53:0/1094024036 shutdown_connections 2024-08-31T06:27:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.269+0000 7fb4b7825640 1 --2- 172.21.15.53:0/1094024036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4b0109b20 0x7fb4b0110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.269+0000 7fb4b7825640 1 --2- 172.21.15.53:0/1094024036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4b01091d0 0x7fb4b01095e0 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.269+0000 7fb4b7825640 1 --2- 172.21.15.53:0/1094024036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4b01038a0 0x7fb4b0103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.269+0000 7fb4b7825640 1 -- 172.21.15.53:0/1094024036 >> 172.21.15.53:0/1094024036 conn(0x7fb4b00ff2a0 msgr2=0x7fb4b01016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.270+0000 7fb4b7825640 1 -- 172.21.15.53:0/1094024036 shutdown_connections 2024-08-31T06:27:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.270+0000 7fb4b7825640 1 -- 172.21.15.53:0/1094024036 wait complete. 2024-08-31T06:27:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b7825640 1 Processor -- start 2024-08-31T06:27:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b7825640 1 -- start start 2024-08-31T06:27:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b7825640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4b01038a0 0x7fb4b019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b7825640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4b01091d0 0x7fb4b019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b7825640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4b0109b20 0x7fb4b019f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b7825640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b0113630 con 0x7fb4b0109b20 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b7825640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b01134b0 con 0x7fb4b01091d0 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b7825640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b01137b0 con 0x7fb4b01038a0 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b5dc2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4b0109b20 0x7fb4b019f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b5dc2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4b0109b20 0x7fb4b019f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38296/0 (socket says 172.21.15.53:38296) 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b5dc2640 1 -- 172.21.15.53:0/269784390 learned_addr learned my addr 172.21.15.53:0/269784390 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4b01038a0 0x7fb4b019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.271+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4b01091d0 0x7fb4b019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4b5dc2640 1 -- 172.21.15.53:0/269784390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4b01038a0 msgr2=0x7fb4b019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4b5dc2640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4b01038a0 0x7fb4b019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4b5dc2640 1 -- 172.21.15.53:0/269784390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4b01091d0 msgr2=0x7fb4b019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4b5dc2640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4b01091d0 0x7fb4b019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4b5dc2640 1 -- 172.21.15.53:0/269784390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b01a0060 con 0x7fb4b0109b20 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4b01091d0 0x7fb4b019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:27:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4b5dc2640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4b0109b20 0x7fb4b019f960 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800cad0 tx=0x7fb4a800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4a67fc640 1 -- 172.21.15.53:0/269784390 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800ae20 con 0x7fb4b0109b20 2024-08-31T06:27:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4a67fc640 1 -- 172.21.15.53:0/269784390 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4a8005020 con 0x7fb4b0109b20 2024-08-31T06:27:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4a67fc640 1 -- 172.21.15.53:0/269784390 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800f6b0 con 0x7fb4b0109b20 2024-08-31T06:27:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4b7825640 1 -- 172.21.15.53:0/269784390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b01a0350 con 0x7fb4b0109b20 2024-08-31T06:27:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.272+0000 7fb4b7825640 1 -- 172.21.15.53:0/269784390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b01a6ae0 con 0x7fb4b0109b20 2024-08-31T06:27:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.275+0000 7fb4be871740 1 Processor -- start 2024-08-31T06:27:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.275+0000 7fb4a67fc640 1 -- 172.21.15.53:0/269784390 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb4a80051d0 con 0x7fb4b0109b20 2024-08-31T06:27:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.275+0000 7fb4be871740 1 -- start start 2024-08-31T06:27:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4be871740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85681b0 0x55a5d890bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4be871740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 0x55a5d890c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4be871740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d890c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4be871740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8881000 con 0x55a5d85474d0 2024-08-31T06:27:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4be871740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8870590 con 0x55a5d853f2f0 2024-08-31T06:27:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4be871740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8874540 con 0x55a5d85681b0 2024-08-31T06:27:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4b4dc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d890c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4b4dc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d890c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38300/0 (socket says 172.21.15.53:38300) 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4b4dc0640 1 -- 172.21.15.53:0/3471897568 learned_addr learned my addr 172.21.15.53:0/3471897568 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/3471897568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 0x55a5d890c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/3471897568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85681b0 0x55a5d890bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4b4dc0640 1 -- 172.21.15.53:0/3471897568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85681b0 msgr2=0x55a5d890bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/3471897568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85681b0 0x55a5d890bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4b4dc0640 1 -- 172.21.15.53:0/3471897568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 msgr2=0x55a5d890c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/3471897568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 0x55a5d890c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4b4dc0640 1 -- 172.21.15.53:0/3471897568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d85d3790 con 0x55a5d85474d0 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.276+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/3471897568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 0x55a5d890c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.277+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/3471897568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d890c540 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009900 tx=0x7fb4ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4397f4aacc2144b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.277+0000 7fb4a67fc640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb49c0b4d20 0x7fb49c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.277+0000 7fb49b7fe640 1 -- 172.21.15.53:0/3471897568 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac035040 con 0x55a5d85474d0 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.277+0000 7fb49b7fe640 1 -- 172.21.15.53:0/3471897568 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4ac0044c0 con 0x55a5d85474d0 2024-08-31T06:27:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.277+0000 7fb49b7fe640 1 -- 172.21.15.53:0/3471897568 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac004900 con 0x55a5d85474d0 2024-08-31T06:27:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.277+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb49c0b4d20 0x7fb49c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.277+0000 7fb4a67fc640 1 -- 172.21.15.53:0/269784390 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7fb4a80e58c0 con 0x7fb4b0109b20 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4be871740 1 -- 172.21.15.53:0/3471897568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 msgr2=0x55a5d890c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4be871740 1 --2- 172.21.15.53:0/3471897568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d890c540 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009900 tx=0x7fb4ac000bc0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb49c0b4d20 0x7fb49c0b7230 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x55a5d890a740 tx=0x7fb4a000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4be871740 1 -- 172.21.15.53:0/3471897568 shutdown_connections 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4be871740 1 --2- 172.21.15.53:0/3471897568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d890c540 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4be871740 1 --2- 172.21.15.53:0/3471897568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 0x55a5d890c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4be871740 1 --2- 172.21.15.53:0/3471897568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85681b0 0x55a5d890bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4be871740 1 -- 172.21.15.53:0/3471897568 >> 172.21.15.53:0/3471897568 conn(0x55a5d855c300 msgr2=0x55a5d89099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4be871740 1 -- 172.21.15.53:0/3471897568 shutdown_connections 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4be871740 1 -- 172.21.15.53:0/3471897568 wait complete. 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4be871740 1 -- start start 2024-08-31T06:27:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.278+0000 7fb4be871740 1 Processor -- start 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4be871740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d853f2f0 0x55a5d89176c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4be871740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85474d0 0x55a5d8917c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4be871740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 0x55a5d8923500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4be871740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a5d87a9ab0 con 0x55a5d853f2f0 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4be871740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a5d87f7680 con 0x55a5d85681b0 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4be871740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a5d891a1e0 con 0x55a5d85474d0 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4be871740 10 client.0 _ll_register_callbacks cb 0x55a5d857fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b55c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d853f2f0 0x55a5d89176c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b55c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d853f2f0 0x55a5d89176c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38312/0 (socket says 172.21.15.53:38312) 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b55c1640 1 -- 172.21.15.53:0/493870393 learned_addr learned my addr 172.21.15.53:0/493870393 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85474d0 0x55a5d8917c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b5dc2640 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 0x55a5d8923500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b55c1640 1 -- 172.21.15.53:0/493870393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85474d0 msgr2=0x55a5d8917c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85474d0 0x55a5d8917c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b55c1640 1 -- 172.21.15.53:0/493870393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 msgr2=0x55a5d8923500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 0x55a5d8923500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b55c1640 1 -- 172.21.15.53:0/493870393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d864c620 con 0x55a5d853f2f0 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b5dc2640 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 0x55a5d8923500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85474d0 0x55a5d8917c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d853f2f0 0x55a5d89176c0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0003d10 tx=0x7fb4a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e6ac63ece65a7d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.279+0000 7fb498ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb498ff9640 1 -- 172.21.15.53:0/493870393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a002c060 con 0x55a5d853f2f0 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb498ff9640 1 -- 172.21.15.53:0/493870393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7fb4a0017030 con 0x55a5d853f2f0 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb4be871740 1 -- 172.21.15.53:0/493870393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a5d8882f50 con 0x55a5d853f2f0 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb498ff9640 1 -- 172.21.15.53:0/493870393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fb4a0030430 con 0x55a5d853f2f0 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb4be871740 10 client.22317 fetch_fsmap learned FSMap version 78 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb4be871740 1 -- 172.21.15.53:0/493870393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) -- 0x55a5d8926330 con 0x55a5d853f2f0 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb498ff9640 1 -- 172.21.15.53:0/493870393 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a5d8882f50 con 0x55a5d853f2f0 2024-08-31T06:27:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb498ff9640 1 -- 172.21.15.53:0/493870393 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 78) ==== 8422+0+0 (secure 0 0 0) 0x7fb4a001c3f0 con 0x55a5d853f2f0 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb4be871740 10 client.22317 fetch_fsmap finished waiting for FSMap version 78 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb4be871740 10 client.22317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb4be871740 20 client.22317 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb4be871740 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5d8526d80 0x55a5d8929960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb4be871740 4 client.22317 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.280+0000 7fb4be871740 1 -- 172.21.15.53:0/493870393 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5d887e9f0 con 0x55a5d8526d80 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.281+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5d8526d80 0x55a5d8929960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.281+0000 7fb498ff9640 10 client.22317 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.281+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5d8526d80 0x55a5d8929960 crc :-1 s=READY pgs=528 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee94c239966757fb server_cookie=ab9696f728cac598 in_seq=0 out_seq=0 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb498ff9640 1 -- 172.21.15.53:0/493870393 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a5d887e9f0 con 0x55a5d8526d80 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb498ff9640 10 client.22317 handle_command_reply: tid=0 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb4be871740 1 client.22317 shutdown 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb4be871740 1 -- 172.21.15.53:0/493870393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d853f2f0 msgr2=0x55a5d89176c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb4be871740 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d853f2f0 0x55a5d89176c0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0003d10 tx=0x7fb4a0004730 comp rx=0 tx=0).stop 2024-08-31T06:27:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb4be871740 1 -- 172.21.15.53:0/493870393 shutdown_connections 2024-08-31T06:27:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb4be871740 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5d8526d80 0x55a5d8929960 crc :-1 s=READY pgs=528 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb4be871740 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 0x55a5d8923500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb4be871740 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85474d0 0x55a5d8917c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb498ff9640 0 client.22317 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb4be871740 1 --2- 172.21.15.53:0/493870393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d853f2f0 0x55a5d89176c0 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb4be871740 1 -- 172.21.15.53:0/493870393 >> 172.21.15.53:0/493870393 conn(0x55a5d855c300 msgr2=0x55a5d890caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb4be871740 1 -- 172.21.15.53:0/493870393 shutdown_connections 2024-08-31T06:27:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.282+0000 7fb4be871740 1 -- 172.21.15.53:0/493870393 wait complete. 2024-08-31T06:27:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.283+0000 7fb4be871740 20 client.22317 trim_cache size 0 max 16384 2024-08-31T06:27:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.297+0000 7fb4be871740 1 Processor -- start 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.297+0000 7fb4be871740 1 -- start start 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4be871740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d853f2f0 0x55a5d8910bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4be871740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d8911130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4be871740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 0x55a5d8914680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4be871740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b01af420 con 0x55a5d85474d0 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4be871740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b01b1230 con 0x55a5d85681b0 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4be871740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b01afbb0 con 0x55a5d853f2f0 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b4dc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d8911130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b4dc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d8911130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38324/0 (socket says 172.21.15.53:38324) 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b4dc0640 1 -- 172.21.15.53:0/3966140683 learned_addr learned my addr 172.21.15.53:0/3966140683 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/3966140683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d853f2f0 0x55a5d8910bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b5dc2640 1 --2- 172.21.15.53:0/3966140683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 0x55a5d8914680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b4dc0640 1 -- 172.21.15.53:0/3966140683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d853f2f0 msgr2=0x55a5d8910bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/3966140683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d853f2f0 0x55a5d8910bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b4dc0640 1 -- 172.21.15.53:0/3966140683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 msgr2=0x55a5d8914680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/3966140683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 0x55a5d8914680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b4dc0640 1 -- 172.21.15.53:0/3966140683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d890a350 con 0x55a5d85474d0 2024-08-31T06:27:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b5dc2640 1 --2- 172.21.15.53:0/3966140683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 0x55a5d8914680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.298+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/3966140683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d8911130 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0057c0 tx=0x7fb4ac0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80beccc4d9f20de7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.299+0000 7fb49affd640 1 -- 172.21.15.53:0/3966140683 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac035040 con 0x55a5d85474d0 2024-08-31T06:27:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.299+0000 7fb49affd640 1 -- 172.21.15.53:0/3966140683 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4ac042040 con 0x55a5d85474d0 2024-08-31T06:27:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.299+0000 7fb49affd640 1 -- 172.21.15.53:0/3966140683 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac032290 con 0x55a5d85474d0 2024-08-31T06:27:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.300+0000 7fb4be871740 1 -- 172.21.15.53:0/3966140683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 msgr2=0x55a5d8911130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.300+0000 7fb4be871740 1 --2- 172.21.15.53:0/3966140683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d8911130 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0057c0 tx=0x7fb4ac0056d0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.300+0000 7fb4be871740 1 -- 172.21.15.53:0/3966140683 shutdown_connections 2024-08-31T06:27:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.300+0000 7fb4be871740 1 --2- 172.21.15.53:0/3966140683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d85681b0 0x55a5d8914680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.300+0000 7fb4be871740 1 --2- 172.21.15.53:0/3966140683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d8911130 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.300+0000 7fb4be871740 1 --2- 172.21.15.53:0/3966140683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d853f2f0 0x55a5d8910bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.300+0000 7fb4be871740 1 -- 172.21.15.53:0/3966140683 >> 172.21.15.53:0/3966140683 conn(0x55a5d855c300 msgr2=0x55a5d8915d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.300+0000 7fb4be871740 1 -- 172.21.15.53:0/3966140683 shutdown_connections 2024-08-31T06:27:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.300+0000 7fb4be871740 1 -- 172.21.15.53:0/3966140683 wait complete. 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.300+0000 7fb4be871740 1 -- start start 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.300+0000 7fb4be871740 1 Processor -- start 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4be871740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 0x55a5d891d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4be871740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d891d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4be871740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85681b0 0x55a5d891dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4be871740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b01b0aa0 con 0x55a5d85474d0 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4be871740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b01b0340 con 0x55a5d853f2f0 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4be871740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b01ad420 con 0x55a5d85681b0 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4be871740 10 client.0 _ll_register_callbacks cb 0x7fb4a000b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4b4dc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d891d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4b55c1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 0x55a5d891d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4b55c1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 0x55a5d891d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39058/0 (socket says 172.21.15.53:39058) 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4b55c1640 1 -- 172.21.15.53:0/2872013706 learned_addr learned my addr 172.21.15.53:0/2872013706 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4b5dc2640 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85681b0 0x55a5d891dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4b55c1640 1 -- 172.21.15.53:0/2872013706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85681b0 msgr2=0x55a5d891dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85681b0 0x55a5d891dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.301+0000 7fb4b55c1640 1 -- 172.21.15.53:0/2872013706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 msgr2=0x55a5d891d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d891d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb4b55c1640 1 -- 172.21.15.53:0/2872013706 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d89048c0 con 0x55a5d853f2f0 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d891d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb4b55c1640 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 0x55a5d891d420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00059d0 tx=0x7fb4a001c620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=968d4dda53b1b6a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb498ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb498ff9640 1 -- 172.21.15.53:0/2872013706 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0004bb0 con 0x55a5d853f2f0 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb4be871740 1 -- 172.21.15.53:0/2872013706 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4ac042040 con 0x55a5d853f2f0 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb498ff9640 1 -- 172.21.15.53:0/2872013706 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7fb4a0004d50 con 0x55a5d853f2f0 2024-08-31T06:27:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb498ff9640 1 -- 172.21.15.53:0/2872013706 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fb4a0005040 con 0x55a5d853f2f0 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb4be871740 10 client.30983 fetch_fsmap learned FSMap version 78 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb4be871740 1 -- 172.21.15.53:0/2872013706 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) -- 0x55a5d890dff0 con 0x55a5d853f2f0 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.302+0000 7fb498ff9640 1 -- 172.21.15.53:0/2872013706 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4ac042040 con 0x55a5d853f2f0 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.303+0000 7fb498ff9640 1 -- 172.21.15.53:0/2872013706 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 78) ==== 8422+0+0 (secure 0 0 0) 0x7fb4a0030b40 con 0x55a5d853f2f0 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.303+0000 7fb4be871740 10 client.30983 fetch_fsmap finished waiting for FSMap version 78 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.303+0000 7fb4be871740 10 client.30983 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.303+0000 7fb4be871740 20 client.30983 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.303+0000 7fb4be871740 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5d84fc1c0 0x55a5d899aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.303+0000 7fb4be871740 4 client.30983 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.303+0000 7fb4be871740 1 -- 172.21.15.53:0/2872013706 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a5d887c130 con 0x55a5d84fc1c0 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.303+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5d84fc1c0 0x55a5d899aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.303+0000 7fb498ff9640 10 client.30983 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.303+0000 7fb4b4dc0640 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5d84fc1c0 0x55a5d899aed0 crc :-1 s=READY pgs=529 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9852ee06f7c8cad0 server_cookie=af2ac8fc0739cdb6 in_seq=0 out_seq=0 2024-08-31T06:27:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb498ff9640 1 -- 172.21.15.53:0/2872013706 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a5d887c130 con 0x55a5d84fc1c0 2024-08-31T06:27:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb498ff9640 10 client.30983 handle_command_reply: tid=0 2024-08-31T06:27:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb4be871740 1 client.30983 shutdown 2024-08-31T06:27:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb4be871740 1 -- 172.21.15.53:0/2872013706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 msgr2=0x55a5d891d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb4be871740 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 0x55a5d891d420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00059d0 tx=0x7fb4a001c620 comp rx=0 tx=0).stop 2024-08-31T06:27:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb4be871740 1 -- 172.21.15.53:0/2872013706 shutdown_connections 2024-08-31T06:27:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb4be871740 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55a5d84fc1c0 0x55a5d899aed0 crc :-1 s=READY pgs=529 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb4be871740 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5d85681b0 0x55a5d891dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb4be871740 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5d85474d0 0x55a5d891d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb498ff9640 0 client.30983 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb4be871740 1 --2- 172.21.15.53:0/2872013706 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a5d853f2f0 0x55a5d891d420 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb4be871740 1 -- 172.21.15.53:0/2872013706 >> 172.21.15.53:0/2872013706 conn(0x55a5d855c300 msgr2=0x55a5d8910bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb4be871740 1 -- 172.21.15.53:0/2872013706 shutdown_connections 2024-08-31T06:27:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.333+0000 7fb4be871740 1 -- 172.21.15.53:0/2872013706 wait complete. 2024-08-31T06:27:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4be871740 20 client.30983 trim_cache size 0 max 16384 2024-08-31T06:27:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:27:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:27:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:27:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:27:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 -- 172.21.15.53:0/269784390 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb49c0b4d20 msgr2=0x7fb49c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb49c0b4d20 0x7fb49c0b7230 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x55a5d890a740 tx=0x7fb4a000b390 comp rx=0 tx=0).stop 2024-08-31T06:27:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 -- 172.21.15.53:0/269784390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4b0109b20 msgr2=0x7fb4b019f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4b0109b20 0x7fb4b019f960 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800cad0 tx=0x7fb4a800cf90 comp rx=0 tx=0).stop 2024-08-31T06:27:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 -- 172.21.15.53:0/269784390 shutdown_connections 2024-08-31T06:27:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb49c0b4d20 0x7fb49c0b7230 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4b0109b20 0x7fb4b019f960 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4b01091d0 0x7fb4b019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 --2- 172.21.15.53:0/269784390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4b01038a0 0x7fb4b019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 -- 172.21.15.53:0/269784390 >> 172.21.15.53:0/269784390 conn(0x7fb4b00ff2a0 msgr2=0x7fb4b01016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 -- 172.21.15.53:0/269784390 shutdown_connections 2024-08-31T06:27:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:26.334+0000 7fb4b7825640 1 -- 172.21.15.53:0/269784390 wait complete. 2024-08-31T06:27:26.348 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:26 smithi053 ceph-mon[18924]: pgmap v1031: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 15 op/s 2024-08-31T06:27:26.377 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:26.391 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.16 MB/sec execute 434 sec latency 26103.597 ms 2024-08-31T06:27:26.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:26 smithi130 ceph-mon[22266]: pgmap v1031: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 15 op/s 2024-08-31T06:27:26.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:26 smithi153 ceph-mon[22320]: pgmap v1031: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 15 op/s 2024-08-31T06:27:26.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.846+0000 7fbf6bce2640 1 -- 172.21.15.53:0/2912307797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf64103900 msgr2=0x7fbf64103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.846+0000 7fbf6bce2640 1 --2- 172.21.15.53:0/2912307797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf64103900 0x7fbf64103d10 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7fbf60009900 tx=0x7fbf6002a410 comp rx=0 tx=0).stop 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.846+0000 7fbf6bce2640 1 -- 172.21.15.53:0/2912307797 shutdown_connections 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.846+0000 7fbf6bce2640 1 --2- 172.21.15.53:0/2912307797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf64109b90 0x7fbf641103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.846+0000 7fbf6bce2640 1 --2- 172.21.15.53:0/2912307797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf64109240 0x7fbf64109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.846+0000 7fbf6bce2640 1 --2- 172.21.15.53:0/2912307797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf64103900 0x7fbf64103d10 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.846+0000 7fbf6bce2640 1 -- 172.21.15.53:0/2912307797 >> 172.21.15.53:0/2912307797 conn(0x7fbf6407b5f0 msgr2=0x7fbf6407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.847+0000 7fbf6bce2640 1 -- 172.21.15.53:0/2912307797 shutdown_connections 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.847+0000 7fbf6bce2640 1 -- 172.21.15.53:0/2912307797 wait complete. 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.847+0000 7fbf6bce2640 1 Processor -- start 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.847+0000 7fbf6bce2640 1 -- start start 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.847+0000 7fbf6bce2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf64103900 0x7fbf6419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.847+0000 7fbf6bce2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf64109240 0x7fbf6419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6bce2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf64109b90 0x7fbf6419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6bce2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64113700 con 0x7fbf64109b90 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6bce2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64113580 con 0x7fbf64103900 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6bce2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64113880 con 0x7fbf64109240 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6a27f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf64109b90 0x7fbf6419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6a27f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf64109b90 0x7fbf6419fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38334/0 (socket says 172.21.15.53:38334) 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6a27f640 1 -- 172.21.15.53:0/3757367296 learned_addr learned my addr 172.21.15.53:0/3757367296 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6927d640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf64109240 0x7fbf6419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf69a7e640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf64103900 0x7fbf6419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6a27f640 1 -- 172.21.15.53:0/3757367296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf64109240 msgr2=0x7fbf6419a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6a27f640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf64109240 0x7fbf6419a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6a27f640 1 -- 172.21.15.53:0/3757367296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf64103900 msgr2=0x7fbf6419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6a27f640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf64103900 0x7fbf6419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6a27f640 1 -- 172.21.15.53:0/3757367296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf641a0140 con 0x7fbf64109b90 2024-08-31T06:27:26.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6a27f640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf64109b90 0x7fbf6419fa10 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00eaa0 tx=0x7fbf5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf5affd640 1 -- 172.21.15.53:0/3757367296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c00cdb0 con 0x7fbf64109b90 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf6bce2640 1 -- 172.21.15.53:0/3757367296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf641a0430 con 0x7fbf64109b90 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf5affd640 1 -- 172.21.15.53:0/3757367296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf5c005020 con 0x7fbf64109b90 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.848+0000 7fbf5affd640 1 -- 172.21.15.53:0/3757367296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c0116d0 con 0x7fbf64109b90 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.849+0000 7fbf6bce2640 1 -- 172.21.15.53:0/3757367296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf641a6b90 con 0x7fbf64109b90 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.851+0000 7fbf5affd640 1 -- 172.21.15.53:0/3757367296 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbf5c0051d0 con 0x7fbf64109b90 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.851+0000 7fbf72257740 1 Processor -- start 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.851+0000 7fbf72257740 1 -- start start 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf72257740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2ee6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf72257740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ee6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf72257740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ee6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf72257740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c6b2e5d680 con 0x55c6b2b41070 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf72257740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c6b2e4cc10 con 0x55c6b2b20390 2024-08-31T06:27:26.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf72257740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c6b2e50bc0 con 0x55c6b2b181b0 2024-08-31T06:27:26.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf6927d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2ee6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf6927d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2ee6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38346/0 (socket says 172.21.15.53:38346) 2024-08-31T06:27:26.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf6927d640 1 -- 172.21.15.53:0/2365606314 learned_addr learned my addr 172.21.15.53:0/2365606314 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:26.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf5affd640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf500b4ca0 0x7fbf500b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf6927d640 1 --2- 172.21.15.53:0/2365606314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ee6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf69a7e640 1 --2- 172.21.15.53:0/2365606314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ee6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf6a27f640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf500b4ca0 0x7fbf500b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf6927d640 1 -- 172.21.15.53:0/2365606314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 msgr2=0x55c6b2ee6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf6927d640 1 --2- 172.21.15.53:0/2365606314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ee6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf6927d640 1 -- 172.21.15.53:0/2365606314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 msgr2=0x55c6b2ee6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf6927d640 1 --2- 172.21.15.53:0/2365606314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ee6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf5affd640 1 -- 172.21.15.53:0/3757367296 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7fbf5c0e5630 con 0x7fbf64109b90 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.852+0000 7fbf6927d640 1 -- 172.21.15.53:0/2365606314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6b2bac650 con 0x55c6b2b41070 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.853+0000 7fbf6927d640 1 --2- 172.21.15.53:0/2365606314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2ee6350 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fbf54012750 tx=0x7fbf5400b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1005b0700aeea276 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.853+0000 7fbf4ffff640 1 -- 172.21.15.53:0/2365606314 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf540120d0 con 0x55c6b2b41070 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.853+0000 7fbf6a27f640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf500b4ca0 0x7fbf500b71b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0e2e10 tx=0x7fbf5c070c00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.853+0000 7fbf4ffff640 1 -- 172.21.15.53:0/2365606314 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf54005020 con 0x55c6b2b41070 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.853+0000 7fbf4ffff640 1 -- 172.21.15.53:0/2365606314 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf540044c0 con 0x55c6b2b41070 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.854+0000 7fbf72257740 1 -- 172.21.15.53:0/2365606314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 msgr2=0x55c6b2ee6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.854+0000 7fbf72257740 1 --2- 172.21.15.53:0/2365606314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2ee6350 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fbf54012750 tx=0x7fbf5400b820 comp rx=0 tx=0).stop 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.854+0000 7fbf72257740 1 -- 172.21.15.53:0/2365606314 shutdown_connections 2024-08-31T06:27:26.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.854+0000 7fbf72257740 1 --2- 172.21.15.53:0/2365606314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ee6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.854+0000 7fbf72257740 1 --2- 172.21.15.53:0/2365606314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ee6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.854+0000 7fbf72257740 1 --2- 172.21.15.53:0/2365606314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2ee6350 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.854+0000 7fbf72257740 1 -- 172.21.15.53:0/2365606314 >> 172.21.15.53:0/2365606314 conn(0x55c6b2b35460 msgr2=0x55c6b2ee4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.854+0000 7fbf72257740 1 -- 172.21.15.53:0/2365606314 shutdown_connections 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.854+0000 7fbf72257740 1 -- 172.21.15.53:0/2365606314 wait complete. 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.854+0000 7fbf72257740 1 -- start start 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.854+0000 7fbf72257740 1 Processor -- start 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf72257740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf72257740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ef1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf72257740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2efddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf72257740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c6b2caf700 con 0x55c6b2b41070 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf72257740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c6b2dd3750 con 0x55c6b2b20390 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf72257740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c6b2ef4ad0 con 0x55c6b2b181b0 2024-08-31T06:27:26.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf72257740 10 client.0 _ll_register_callbacks cb 0x55c6b2e02e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf6927d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2efddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf6927d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2efddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38354/0 (socket says 172.21.15.53:38354) 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf6927d640 1 -- 172.21.15.53:0/3886427818 learned_addr learned my addr 172.21.15.53:0/3886427818 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf6927d640 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf69a7e640 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ef1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf6927d640 1 -- 172.21.15.53:0/3886427818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 msgr2=0x55c6b2ef1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf6927d640 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf6927d640 1 -- 172.21.15.53:0/3886427818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 msgr2=0x55c6b2ef1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf6927d640 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ef1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.855+0000 7fbf6927d640 1 -- 172.21.15.53:0/3886427818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6b2e0c900 con 0x55c6b2b41070 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.856+0000 7fbf6927d640 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2efddc0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7fbf54005f80 tx=0x7fbf5400bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d9833dfd0ea96 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.856+0000 7fbf4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.856+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/3886427818 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54004230 con 0x55c6b2b41070 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.856+0000 7fbf72257740 1 -- 172.21.15.53:0/3886427818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf54005020 con 0x55c6b2b41070 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.856+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/3886427818 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7fbf540043d0 con 0x55c6b2b41070 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.856+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/3886427818 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fbf5400e960 con 0x55c6b2b41070 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.856+0000 7fbf72257740 10 client.22335 fetch_fsmap learned FSMap version 79 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.856+0000 7fbf72257740 1 -- 172.21.15.53:0/3886427818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x55c6b2f00880 con 0x55c6b2b41070 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.856+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/3886427818 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf54005020 con 0x55c6b2b41070 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.856+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/3886427818 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 79) ==== 8414+0+0 (secure 0 0 0) 0x7fbf54004b80 con 0x55c6b2b41070 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.857+0000 7fbf72257740 10 client.22335 fetch_fsmap finished waiting for FSMap version 79 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.857+0000 7fbf72257740 10 client.22335 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.857+0000 7fbf72257740 20 client.22335 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.857+0000 7fbf72257740 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c6b2aff9f0 0x55c6b2f040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.857+0000 7fbf72257740 4 client.22335 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.857+0000 7fbf72257740 1 -- 172.21.15.53:0/3886427818 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6b2e5f5d0 con 0x55c6b2aff9f0 2024-08-31T06:27:26.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.857+0000 7fbf69a7e640 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c6b2aff9f0 0x55c6b2f040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.857+0000 7fbf4d7fa640 10 client.22335 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.857+0000 7fbf69a7e640 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c6b2aff9f0 0x55c6b2f040b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=78163e6e1861d7a server_cookie=b167a26bd014fa62 in_seq=0 out_seq=0 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.858+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/3886427818 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c6b2e5f5d0 con 0x55c6b2aff9f0 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.858+0000 7fbf4d7fa640 10 client.22335 handle_command_reply: tid=0 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.858+0000 7fbf72257740 1 client.22335 shutdown 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.858+0000 7fbf72257740 1 -- 172.21.15.53:0/3886427818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 msgr2=0x55c6b2efddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.858+0000 7fbf72257740 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2efddc0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7fbf54005f80 tx=0x7fbf5400bfa0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.858+0000 7fbf72257740 1 -- 172.21.15.53:0/3886427818 shutdown_connections 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.858+0000 7fbf72257740 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c6b2aff9f0 0x55c6b2f040b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.859+0000 7fbf72257740 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b41070 0x55c6b2efddc0 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.859+0000 7fbf72257740 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ef1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.859+0000 7fbf4d7fa640 0 client.22335 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:27:26.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.859+0000 7fbf72257740 1 --2- 172.21.15.53:0/3886427818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.859+0000 7fbf72257740 1 -- 172.21.15.53:0/3886427818 >> 172.21.15.53:0/3886427818 conn(0x55c6b2b35460 msgr2=0x55c6b2ee9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.859+0000 7fbf72257740 1 -- 172.21.15.53:0/3886427818 shutdown_connections 2024-08-31T06:27:26.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.859+0000 7fbf72257740 1 -- 172.21.15.53:0/3886427818 wait complete. 2024-08-31T06:27:26.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.859+0000 7fbf72257740 20 client.22335 trim_cache size 0 max 16384 2024-08-31T06:27:26.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf72257740 1 Processor -- start 2024-08-31T06:27:26.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf72257740 1 -- start start 2024-08-31T06:27:26.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf72257740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2aff9f0 0x55c6b2edf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf72257740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf72257740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b20390 0x55c6b2ee9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf72257740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbf641af5a0 con 0x55c6b2b20390 2024-08-31T06:27:26.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf72257740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf641b1350 con 0x55c6b2aff9f0 2024-08-31T06:27:26.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf72257740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf641afd30 con 0x55c6b2b181b0 2024-08-31T06:27:26.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf6927d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b20390 0x55c6b2ee9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf6927d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b20390 0x55c6b2ee9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38356/0 (socket says 172.21.15.53:38356) 2024-08-31T06:27:26.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf6927d640 1 -- 172.21.15.53:0/2210094495 learned_addr learned my addr 172.21.15.53:0/2210094495 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.872+0000 7fbf6927d640 1 --2- 172.21.15.53:0/2210094495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2aff9f0 0x55c6b2edf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.873+0000 7fbf6927d640 1 -- 172.21.15.53:0/2210094495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 msgr2=0x55c6b2ef1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.873+0000 7fbf69a7e640 1 --2- 172.21.15.53:0/2210094495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.873+0000 7fbf6927d640 1 --2- 172.21.15.53:0/2210094495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.873+0000 7fbf6927d640 1 -- 172.21.15.53:0/2210094495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2aff9f0 msgr2=0x55c6b2edf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.873+0000 7fbf6927d640 1 --2- 172.21.15.53:0/2210094495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2aff9f0 0x55c6b2edf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.873+0000 7fbf6927d640 1 -- 172.21.15.53:0/2210094495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6b2ef0a10 con 0x55c6b2b20390 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.873+0000 7fbf69a7e640 1 --2- 172.21.15.53:0/2210094495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.873+0000 7fbf6927d640 1 --2- 172.21.15.53:0/2210094495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b20390 0x55c6b2ee9450 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7fbf54005980 tx=0x7fbf540120d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c000bf356212b9c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.873+0000 7fbf4f7fe640 1 -- 172.21.15.53:0/2210094495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54005b90 con 0x55c6b2b20390 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.873+0000 7fbf4f7fe640 1 -- 172.21.15.53:0/2210094495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf54005000 con 0x55c6b2b20390 2024-08-31T06:27:26.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.873+0000 7fbf4f7fe640 1 -- 172.21.15.53:0/2210094495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54004aa0 con 0x55c6b2b20390 2024-08-31T06:27:26.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.874+0000 7fbf72257740 1 -- 172.21.15.53:0/2210094495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b20390 msgr2=0x55c6b2ee9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.874+0000 7fbf72257740 1 --2- 172.21.15.53:0/2210094495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b20390 0x55c6b2ee9450 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7fbf54005980 tx=0x7fbf540120d0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.874+0000 7fbf72257740 1 -- 172.21.15.53:0/2210094495 shutdown_connections 2024-08-31T06:27:26.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.874+0000 7fbf72257740 1 --2- 172.21.15.53:0/2210094495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b20390 0x55c6b2ee9450 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.874+0000 7fbf72257740 1 --2- 172.21.15.53:0/2210094495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.874+0000 7fbf72257740 1 --2- 172.21.15.53:0/2210094495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2aff9f0 0x55c6b2edf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.874+0000 7fbf72257740 1 -- 172.21.15.53:0/2210094495 >> 172.21.15.53:0/2210094495 conn(0x55c6b2b35460 msgr2=0x55c6b2ef1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.874+0000 7fbf72257740 1 -- 172.21.15.53:0/2210094495 shutdown_connections 2024-08-31T06:27:26.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.874+0000 7fbf72257740 1 -- 172.21.15.53:0/2210094495 wait complete. 2024-08-31T06:27:26.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.874+0000 7fbf72257740 1 -- start start 2024-08-31T06:27:26.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.874+0000 7fbf72257740 1 Processor -- start 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf72257740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2aff9f0 0x55c6b2efa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf72257740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf72257740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ef5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf72257740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbf641b0c20 con 0x55c6b2b181b0 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf72257740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf641b04c0 con 0x55c6b2b20390 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf72257740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf641ad5a0 con 0x55c6b2aff9f0 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf72257740 10 client.0 _ll_register_callbacks cb 0x7fbf5400bd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf69a7e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf69a7e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38360/0 (socket says 172.21.15.53:38360) 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf69a7e640 1 -- 172.21.15.53:0/1474692047 learned_addr learned my addr 172.21.15.53:0/1474692047 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf6927d640 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2aff9f0 0x55c6b2efa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf6927d640 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ef5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf69a7e640 1 -- 172.21.15.53:0/1474692047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2aff9f0 msgr2=0x55c6b2efa2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf69a7e640 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2aff9f0 0x55c6b2efa2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf69a7e640 1 -- 172.21.15.53:0/1474692047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 msgr2=0x55c6b2ef5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf69a7e640 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ef5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf69a7e640 1 -- 172.21.15.53:0/1474692047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6b2ef6240 con 0x55c6b2b181b0 2024-08-31T06:27:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf69a7e640 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef5790 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7fbf600057c0 tx=0x7fbf60004450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693777344c09c533 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.875+0000 7fbf4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/1474692047 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf60035040 con 0x55c6b2b181b0 2024-08-31T06:27:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/1474692047 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7fbf60031810 con 0x55c6b2b181b0 2024-08-31T06:27:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf72257740 1 -- 172.21.15.53:0/1474692047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf54005000 con 0x55c6b2b181b0 2024-08-31T06:27:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/1474692047 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fbf60054050 con 0x55c6b2b181b0 2024-08-31T06:27:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf72257740 10 client.22341 fetch_fsmap learned FSMap version 79 2024-08-31T06:27:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf72257740 1 -- 172.21.15.53:0/1474692047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x55c6b2f6e770 con 0x55c6b2b181b0 2024-08-31T06:27:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/1474692047 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf54005000 con 0x55c6b2b181b0 2024-08-31T06:27:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/1474692047 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 79) ==== 8414+0+0 (secure 0 0 0) 0x7fbf60045450 con 0x55c6b2b181b0 2024-08-31T06:27:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf72257740 10 client.22341 fetch_fsmap finished waiting for FSMap version 79 2024-08-31T06:27:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf72257740 10 client.22341 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:27:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf72257740 20 client.22341 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf72257740 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c6b2b41070 0x55c6b2f70fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf72257740 4 client.22341 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:27:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.876+0000 7fbf72257740 1 -- 172.21.15.53:0/1474692047 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c6b2e5b070 con 0x55c6b2b41070 2024-08-31T06:27:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.877+0000 7fbf6927d640 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c6b2b41070 0x55c6b2f70fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.877+0000 7fbf6927d640 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c6b2b41070 0x55c6b2f70fb0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=add5259e51dfbad1 server_cookie=a6183c79e9f6a0d4 in_seq=0 out_seq=0 2024-08-31T06:27:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.877+0000 7fbf4d7fa640 10 client.22341 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:27:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.877+0000 7fbf4d7fa640 1 -- 172.21.15.53:0/1474692047 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c6b2e5b070 con 0x55c6b2b41070 2024-08-31T06:27:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.877+0000 7fbf4d7fa640 10 client.22341 handle_command_reply: tid=0 2024-08-31T06:27:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.877+0000 7fbf72257740 1 client.22341 shutdown 2024-08-31T06:27:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.877+0000 7fbf72257740 1 -- 172.21.15.53:0/1474692047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b181b0 msgr2=0x55c6b2ef5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf72257740 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef5790 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7fbf600057c0 tx=0x7fbf60004450 comp rx=0 tx=0).stop 2024-08-31T06:27:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf72257740 1 -- 172.21.15.53:0/1474692047 shutdown_connections 2024-08-31T06:27:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf72257740 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6b2b20390 0x55c6b2ef5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf72257740 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55c6b2b41070 0x55c6b2f70fb0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf4d7fa640 0 client.22341 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:27:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf72257740 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6b2b181b0 0x55c6b2ef5790 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf72257740 1 --2- 172.21.15.53:0/1474692047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c6b2aff9f0 0x55c6b2efa2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf72257740 1 -- 172.21.15.53:0/1474692047 >> 172.21.15.53:0/1474692047 conn(0x55c6b2b35460 msgr2=0x55c6b2ee9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf72257740 1 -- 172.21.15.53:0/1474692047 shutdown_connections 2024-08-31T06:27:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf72257740 1 -- 172.21.15.53:0/1474692047 wait complete. 2024-08-31T06:27:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf72257740 20 client.22341 trim_cache size 0 max 16384 2024-08-31T06:27:26.886 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:27:26.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf6bce2640 1 -- 172.21.15.53:0/3757367296 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf500b4ca0 msgr2=0x7fbf500b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf6bce2640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf500b4ca0 0x7fbf500b71b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0e2e10 tx=0x7fbf5c070c00 comp rx=0 tx=0).stop 2024-08-31T06:27:26.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf6bce2640 1 -- 172.21.15.53:0/3757367296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf64109b90 msgr2=0x7fbf6419fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:26.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf6bce2640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf64109b90 0x7fbf6419fa10 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00eaa0 tx=0x7fbf5c00ef60 comp rx=0 tx=0).stop 2024-08-31T06:27:26.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf6bce2640 1 -- 172.21.15.53:0/3757367296 shutdown_connections 2024-08-31T06:27:26.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf6bce2640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbf500b4ca0 0x7fbf500b71b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf6bce2640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf64109b90 0x7fbf6419fa10 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf6bce2640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf64109240 0x7fbf6419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf6bce2640 1 --2- 172.21.15.53:0/3757367296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf64103900 0x7fbf6419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.878+0000 7fbf6bce2640 1 -- 172.21.15.53:0/3757367296 >> 172.21.15.53:0/3757367296 conn(0x7fbf6407b5f0 msgr2=0x7fbf641073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.879+0000 7fbf6bce2640 1 -- 172.21.15.53:0/3757367296 shutdown_connections 2024-08-31T06:27:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:26.879+0000 7fbf6bce2640 1 -- 172.21.15.53:0/3757367296 wait complete. 2024-08-31T06:27:27.392 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.15 MB/sec execute 435 sec latency 27103.695 ms 2024-08-31T06:27:27.604 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:27 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:27.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:27 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:27.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:27:27.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:27 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:27.888 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:28.392 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.14 MB/sec execute 436 sec latency 28103.739 ms 2024-08-31T06:27:28.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.399+0000 7f1976202640 1 -- 172.21.15.53:0/3924722539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f197010d9d0 msgr2=0x7f197010fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:28.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.399+0000 7f1976202640 1 --2- 172.21.15.53:0/3924722539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f197010d9d0 0x7f197010fec0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f1968009900 tx=0x7f196802a410 comp rx=0 tx=0).stop 2024-08-31T06:27:28.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.399+0000 7f1976202640 1 -- 172.21.15.53:0/3924722539 shutdown_connections 2024-08-31T06:27:28.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.399+0000 7f1976202640 1 --2- 172.21.15.53:0/3924722539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f197010d9d0 0x7f197010fec0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.399+0000 7f1976202640 1 --2- 172.21.15.53:0/3924722539 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1970104ec0 0x7f197010d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.399+0000 7f1976202640 1 --2- 172.21.15.53:0/3924722539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1970104570 0x7f1970104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.399+0000 7f1976202640 1 -- 172.21.15.53:0/3924722539 >> 172.21.15.53:0/3924722539 conn(0x7f19700fe070 msgr2=0x7f19701004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:28.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.399+0000 7f1976202640 1 -- 172.21.15.53:0/3924722539 shutdown_connections 2024-08-31T06:27:28.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.399+0000 7f1976202640 1 -- 172.21.15.53:0/3924722539 wait complete. 2024-08-31T06:27:28.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1976202640 1 Processor -- start 2024-08-31T06:27:28.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1976202640 1 -- start start 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1976202640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1970104570 0x7f1970199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1976202640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1970104ec0 0x7f197019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1976202640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197010d9d0 0x7f197019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1976202640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f19701134f0 con 0x7f1970104570 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1976202640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1970113370 con 0x7f197010d9d0 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1976202640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1970113670 con 0x7f1970104ec0 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1975200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1970104570 0x7f1970199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1975200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1970104570 0x7f1970199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38384/0 (socket says 172.21.15.53:38384) 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1975200640 1 -- 172.21.15.53:0/634678736 learned_addr learned my addr 172.21.15.53:0/634678736 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f19749ff640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1970104ec0 0x7f197019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1975a01640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197010d9d0 0x7f197019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1975200640 1 -- 172.21.15.53:0/634678736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1970104ec0 msgr2=0x7f197019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1975200640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1970104ec0 0x7f197019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1975200640 1 -- 172.21.15.53:0/634678736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197010d9d0 msgr2=0x7f197019f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1975200640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197010d9d0 0x7f197019f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1975200640 1 -- 172.21.15.53:0/634678736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197019fef0 con 0x7f1970104570 2024-08-31T06:27:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f19749ff640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1970104ec0 0x7f197019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.400+0000 7f1975a01640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197010d9d0 0x7f197019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.401+0000 7f1975200640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1970104570 0x7f1970199f80 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f196400db80 tx=0x7f196400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.401+0000 7f196e7fc640 1 -- 172.21.15.53:0/634678736 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1964017070 con 0x7f1970104570 2024-08-31T06:27:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.401+0000 7f196e7fc640 1 -- 172.21.15.53:0/634678736 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1964004020 con 0x7f1970104570 2024-08-31T06:27:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.401+0000 7f1976202640 1 -- 172.21.15.53:0/634678736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19701a01e0 con 0x7f1970104570 2024-08-31T06:27:28.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.401+0000 7f196e7fc640 1 -- 172.21.15.53:0/634678736 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196400be60 con 0x7f1970104570 2024-08-31T06:27:28.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.401+0000 7f1976202640 1 -- 172.21.15.53:0/634678736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19701a6940 con 0x7f1970104570 2024-08-31T06:27:28.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f196e7fc640 1 -- 172.21.15.53:0/634678736 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1964003b70 con 0x7f1970104570 2024-08-31T06:27:28.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f197d9d9740 1 Processor -- start 2024-08-31T06:27:28.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f197d9d9740 1 -- start start 2024-08-31T06:27:28.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c224f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d18541b0 0x55f7d1c22a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 0x55f7d1c22f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f197d9d9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7d1b99680 con 0x55f7d187d070 2024-08-31T06:27:28.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f197d9d9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f7d1b88c10 con 0x55f7d185c390 2024-08-31T06:27:28.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f197d9d9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f7d1b8cbc0 con 0x55f7d18541b0 2024-08-31T06:27:28.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f1975a01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f1975a01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c224f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38394/0 (socket says 172.21.15.53:38394) 2024-08-31T06:27:28.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.404+0000 7f1975a01640 1 -- 172.21.15.53:0/313225346 learned_addr learned my addr 172.21.15.53:0/313225346 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:28.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f19749ff640 1 --2- 172.21.15.53:0/313225346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 0x55f7d1c22f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f1975200640 1 --2- 172.21.15.53:0/313225346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d18541b0 0x55f7d1c22a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f1975a01640 1 -- 172.21.15.53:0/313225346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d18541b0 msgr2=0x55f7d1c22a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:28.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f1975a01640 1 --2- 172.21.15.53:0/313225346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d18541b0 0x55f7d1c22a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f196e7fc640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19600b4ca0 0x7f19600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f1975a01640 1 -- 172.21.15.53:0/313225346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 msgr2=0x55f7d1c22f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:28.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f1975a01640 1 --2- 172.21.15.53:0/313225346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 0x55f7d1c22f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f1975a01640 1 -- 172.21.15.53:0/313225346 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d18e8650 con 0x55f7d187d070 2024-08-31T06:27:28.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f19749ff640 1 --2- 172.21.15.53:0/313225346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 0x55f7d1c22f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:28.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f196e7fc640 1 -- 172.21.15.53:0/634678736 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f19640e5750 con 0x7f1970104570 2024-08-31T06:27:28.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f1975a01640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19600b4ca0 0x7f19600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f1975a01640 1 --2- 172.21.15.53:0/313225346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c224f0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f1968009900 tx=0x7f1968032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b2a5d84684d2b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:28.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.405+0000 7f195b7fe640 1 -- 172.21.15.53:0/313225346 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196804b070 con 0x55f7d187d070 2024-08-31T06:27:28.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.406+0000 7f195b7fe640 1 -- 172.21.15.53:0/313225346 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19680054d0 con 0x55f7d187d070 2024-08-31T06:27:28.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.406+0000 7f195b7fe640 1 -- 172.21.15.53:0/313225346 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196803f070 con 0x55f7d187d070 2024-08-31T06:27:28.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.406+0000 7f197d9d9740 1 -- 172.21.15.53:0/313225346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 msgr2=0x55f7d1c224f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:28.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.406+0000 7f197d9d9740 1 --2- 172.21.15.53:0/313225346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c224f0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f1968009900 tx=0x7f1968032c40 comp rx=0 tx=0).stop 2024-08-31T06:27:28.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.406+0000 7f1975a01640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19600b4ca0 0x7f19600b71b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1968048000 tx=0x7f196804b000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:28.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.407+0000 7f197d9d9740 1 -- 172.21.15.53:0/313225346 shutdown_connections 2024-08-31T06:27:28.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.407+0000 7f197d9d9740 1 --2- 172.21.15.53:0/313225346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 0x55f7d1c22f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.407+0000 7f197d9d9740 1 --2- 172.21.15.53:0/313225346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d18541b0 0x55f7d1c22a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.407+0000 7f197d9d9740 1 --2- 172.21.15.53:0/313225346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c224f0 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.407+0000 7f197d9d9740 1 -- 172.21.15.53:0/313225346 >> 172.21.15.53:0/313225346 conn(0x55f7d1871460 msgr2=0x55f7d1c203e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.407+0000 7f197d9d9740 1 -- 172.21.15.53:0/313225346 shutdown_connections 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.407+0000 7f197d9d9740 1 -- 172.21.15.53:0/313225346 wait complete. 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.407+0000 7f197d9d9740 1 -- start start 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.407+0000 7f197d9d9740 1 Processor -- start 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d18541b0 0x55f7d1c2dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 0x55f7d1c2e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d187d070 0x55f7d1c3a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f197d9d9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7d19eb700 con 0x55f7d18541b0 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f197d9d9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f7d1b0f750 con 0x55f7d185c390 2024-08-31T06:27:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f197d9d9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f7d1c30cd0 con 0x55f7d187d070 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f197d9d9740 10 client.0 _ll_register_callbacks cb 0x55f7d1b3ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1975200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d18541b0 0x55f7d1c2dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1975200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d18541b0 0x55f7d1c2dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38400/0 (socket says 172.21.15.53:38400) 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1975200640 1 -- 172.21.15.53:0/1419726295 learned_addr learned my addr 172.21.15.53:0/1419726295 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1975a01640 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d187d070 0x55f7d1c3a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f19749ff640 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 0x55f7d1c2e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1975200640 1 -- 172.21.15.53:0/1419726295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d187d070 msgr2=0x55f7d1c3a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1975200640 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d187d070 0x55f7d1c3a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1975200640 1 -- 172.21.15.53:0/1419726295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 msgr2=0x55f7d1c2e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1975200640 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 0x55f7d1c2e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1975200640 1 -- 172.21.15.53:0/1419726295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7d1b48900 con 0x55f7d18541b0 2024-08-31T06:27:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f19749ff640 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 0x55f7d1c2e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1975200640 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d18541b0 0x55f7d1c2dc30 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f196400dfd0 tx=0x7f19640abd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f99ee25e79971c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1958ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1958ff9640 1 -- 172.21.15.53:0/1419726295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640ab930 con 0x55f7d18541b0 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f197d9d9740 1 -- 172.21.15.53:0/1419726295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19680054d0 con 0x55f7d18541b0 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.408+0000 7f1958ff9640 1 -- 172.21.15.53:0/1419726295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f19640930b0 con 0x55f7d18541b0 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.409+0000 7f1958ff9640 1 -- 172.21.15.53:0/1419726295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f19640932b0 con 0x55f7d18541b0 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.409+0000 7f197d9d9740 10 client.22353 fetch_fsmap learned FSMap version 79 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.409+0000 7f197d9d9740 1 -- 172.21.15.53:0/1419726295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x55f7d1c3cb10 con 0x55f7d18541b0 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.409+0000 7f1958ff9640 1 -- 172.21.15.53:0/1419726295 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19680054d0 con 0x55f7d18541b0 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.409+0000 7f1958ff9640 1 -- 172.21.15.53:0/1419726295 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 79) ==== 8414+0+0 (secure 0 0 0) 0x7f1964023060 con 0x55f7d18541b0 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.409+0000 7f197d9d9740 10 client.22353 fetch_fsmap finished waiting for FSMap version 79 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.409+0000 7f197d9d9740 10 client.22353 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:27:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.409+0000 7f197d9d9740 20 client.22353 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.409+0000 7f197d9d9740 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7d183b9f0 0x55f7d1c40000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.409+0000 7f197d9d9740 4 client.22353 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.409+0000 7f197d9d9740 1 -- 172.21.15.53:0/1419726295 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7d1b9b5d0 con 0x55f7d183b9f0 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.410+0000 7f19749ff640 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7d183b9f0 0x55f7d1c40000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.410+0000 7f1958ff9640 10 client.22353 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.410+0000 7f19749ff640 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7d183b9f0 0x55f7d1c40000 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3edc44b162d37396 server_cookie=abe5bbaa3f72faa7 in_seq=0 out_seq=0 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f1958ff9640 1 -- 172.21.15.53:0/1419726295 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7d1b9b5d0 con 0x55f7d183b9f0 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f1958ff9640 10 client.22353 handle_command_reply: tid=0 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f197d9d9740 1 client.22353 shutdown 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f197d9d9740 1 -- 172.21.15.53:0/1419726295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d18541b0 msgr2=0x55f7d1c2dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f197d9d9740 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d18541b0 0x55f7d1c2dc30 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f196400dfd0 tx=0x7f19640abd00 comp rx=0 tx=0).stop 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f197d9d9740 1 -- 172.21.15.53:0/1419726295 shutdown_connections 2024-08-31T06:27:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f197d9d9740 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7d183b9f0 0x55f7d1c40000 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f197d9d9740 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d187d070 0x55f7d1c3a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f197d9d9740 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d185c390 0x55f7d1c2e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f197d9d9740 1 --2- 172.21.15.53:0/1419726295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d18541b0 0x55f7d1c2dc30 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f197d9d9740 1 -- 172.21.15.53:0/1419726295 >> 172.21.15.53:0/1419726295 conn(0x55f7d1871460 msgr2=0x55f7d1c256d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.411+0000 7f1958ff9640 0 client.22353 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:27:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.412+0000 7f197d9d9740 1 -- 172.21.15.53:0/1419726295 shutdown_connections 2024-08-31T06:27:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.412+0000 7f197d9d9740 1 -- 172.21.15.53:0/1419726295 wait complete. 2024-08-31T06:27:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.412+0000 7f197d9d9740 20 client.22353 trim_cache size 0 max 16384 2024-08-31T06:27:28.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.425+0000 7f197d9d9740 1 Processor -- start 2024-08-31T06:27:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.425+0000 7f197d9d9740 1 -- start start 2024-08-31T06:27:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d18541b0 0x55f7d1c2f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d185c390 0x55f7d1c39f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d187d070 0x55f7d1c2ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f197d9d9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f19701af3d0 con 0x55f7d185c390 2024-08-31T06:27:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f197d9d9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f19701b1180 con 0x55f7d18541b0 2024-08-31T06:27:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f197d9d9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f19701afb60 con 0x55f7d187d070 2024-08-31T06:27:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f19749ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d185c390 0x55f7d1c39f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f19749ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d185c390 0x55f7d1c39f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38414/0 (socket says 172.21.15.53:38414) 2024-08-31T06:27:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f19749ff640 1 -- 172.21.15.53:0/109575682 learned_addr learned my addr 172.21.15.53:0/109575682 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f1975200640 1 --2- 172.21.15.53:0/109575682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d18541b0 0x55f7d1c2f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f1975a01640 1 --2- 172.21.15.53:0/109575682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d187d070 0x55f7d1c2ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f19749ff640 1 -- 172.21.15.53:0/109575682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d187d070 msgr2=0x55f7d1c2ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f19749ff640 1 --2- 172.21.15.53:0/109575682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d187d070 0x55f7d1c2ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f19749ff640 1 -- 172.21.15.53:0/109575682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d18541b0 msgr2=0x55f7d1c2f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f19749ff640 1 --2- 172.21.15.53:0/109575682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d18541b0 0x55f7d1c2f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f19749ff640 1 -- 172.21.15.53:0/109575682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d1c1a590 con 0x55f7d185c390 2024-08-31T06:27:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.426+0000 7f19749ff640 1 --2- 172.21.15.53:0/109575682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d185c390 0x55f7d1c39f10 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f197006b240 tx=0x7f195c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e88393c88ac2a33 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.427+0000 7f195affd640 1 -- 172.21.15.53:0/109575682 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c0142d0 con 0x55f7d185c390 2024-08-31T06:27:28.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.427+0000 7f195affd640 1 -- 172.21.15.53:0/109575682 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f195c014e60 con 0x55f7d185c390 2024-08-31T06:27:28.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.427+0000 7f195affd640 1 -- 172.21.15.53:0/109575682 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c0116a0 con 0x55f7d185c390 2024-08-31T06:27:28.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.427+0000 7f197d9d9740 1 -- 172.21.15.53:0/109575682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d185c390 msgr2=0x55f7d1c39f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.427+0000 7f197d9d9740 1 --2- 172.21.15.53:0/109575682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d185c390 0x55f7d1c39f10 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f197006b240 tx=0x7f195c004040 comp rx=0 tx=0).stop 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.427+0000 7f197d9d9740 1 -- 172.21.15.53:0/109575682 shutdown_connections 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.427+0000 7f197d9d9740 1 --2- 172.21.15.53:0/109575682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d187d070 0x55f7d1c2ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.427+0000 7f197d9d9740 1 --2- 172.21.15.53:0/109575682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d185c390 0x55f7d1c39f10 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.427+0000 7f197d9d9740 1 --2- 172.21.15.53:0/109575682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d18541b0 0x55f7d1c2f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.427+0000 7f197d9d9740 1 -- 172.21.15.53:0/109575682 >> 172.21.15.53:0/109575682 conn(0x55f7d1871460 msgr2=0x55f7d1c2f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.428+0000 7f197d9d9740 1 -- 172.21.15.53:0/109575682 shutdown_connections 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.428+0000 7f197d9d9740 1 -- 172.21.15.53:0/109575682 wait complete. 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.428+0000 7f197d9d9740 1 -- start start 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.428+0000 7f197d9d9740 1 Processor -- start 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d18541b0 0x55f7d1c35f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d185c390 0x55f7d1c364c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f197d9d9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c30f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f197d9d9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f19701b0a50 con 0x55f7d187d070 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f197d9d9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f19701b02f0 con 0x55f7d18541b0 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f197d9d9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f19701ad3d0 con 0x55f7d185c390 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f197d9d9740 10 client.0 _ll_register_callbacks cb 0x7f19640ab840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f1975a01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c30f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f1975a01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c30f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38430/0 (socket says 172.21.15.53:38430) 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f1975a01640 1 -- 172.21.15.53:0/4131492239 learned_addr learned my addr 172.21.15.53:0/4131492239 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f19749ff640 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d185c390 0x55f7d1c364c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f1975200640 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d18541b0 0x55f7d1c35f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f1975a01640 1 -- 172.21.15.53:0/4131492239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d185c390 msgr2=0x55f7d1c364c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f1975a01640 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d185c390 0x55f7d1c364c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f1975a01640 1 -- 172.21.15.53:0/4131492239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d18541b0 msgr2=0x55f7d1c35f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:28.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f1975a01640 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d18541b0 0x55f7d1c35f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f1975a01640 1 -- 172.21.15.53:0/4131492239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7d1c36a00 con 0x55f7d187d070 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f1975a01640 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c30f30 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f1968033000 tx=0x7f1968009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5facfe1f2e48bc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.429+0000 7f1958ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f1958ff9640 1 -- 172.21.15.53:0/4131492239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196805f060 con 0x55f7d187d070 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f1958ff9640 1 -- 172.21.15.53:0/4131492239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f1968004b00 con 0x55f7d187d070 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f197d9d9740 1 -- 172.21.15.53:0/4131492239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f195c014e60 con 0x55f7d187d070 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f1958ff9640 1 -- 172.21.15.53:0/4131492239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f196803f040 con 0x55f7d187d070 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f197d9d9740 10 client.22359 fetch_fsmap learned FSMap version 79 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f197d9d9740 1 -- 172.21.15.53:0/4131492239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x55f7d1caaca0 con 0x55f7d187d070 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f1958ff9640 1 -- 172.21.15.53:0/4131492239 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f195c014e60 con 0x55f7d187d070 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f1958ff9640 1 -- 172.21.15.53:0/4131492239 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 79) ==== 8414+0+0 (secure 0 0 0) 0x7f19680035f0 con 0x55f7d187d070 2024-08-31T06:27:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f197d9d9740 10 client.22359 fetch_fsmap finished waiting for FSMap version 79 2024-08-31T06:27:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f197d9d9740 10 client.22359 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:27:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f197d9d9740 20 client.22359 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f197d9d9740 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7d1810da0 0x55f7d1cad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f197d9d9740 4 client.22359 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:27:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f197d9d9740 1 -- 172.21.15.53:0/4131492239 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f7d1b97070 con 0x55f7d1810da0 2024-08-31T06:27:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.430+0000 7f1975200640 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7d1810da0 0x55f7d1cad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f1975200640 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7d1810da0 0x55f7d1cad0f0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5a96bbf351eeb63 server_cookie=83b5806f73328160 in_seq=0 out_seq=0 2024-08-31T06:27:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f1958ff9640 10 client.22359 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:27:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f1958ff9640 1 -- 172.21.15.53:0/4131492239 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f7d1b97070 con 0x55f7d1810da0 2024-08-31T06:27:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f1958ff9640 10 client.22359 handle_command_reply: tid=0 2024-08-31T06:27:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f197d9d9740 1 client.22359 shutdown 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f197d9d9740 1 -- 172.21.15.53:0/4131492239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 msgr2=0x55f7d1c30f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f197d9d9740 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c30f30 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f1968033000 tx=0x7f1968009880 comp rx=0 tx=0).stop 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f197d9d9740 1 -- 172.21.15.53:0/4131492239 shutdown_connections 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f197d9d9740 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f7d1810da0 0x55f7d1cad0f0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f197d9d9740 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7d187d070 0x55f7d1c30f30 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f197d9d9740 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7d185c390 0x55f7d1c364c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f197d9d9740 1 --2- 172.21.15.53:0/4131492239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7d18541b0 0x55f7d1c35f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f197d9d9740 1 -- 172.21.15.53:0/4131492239 >> 172.21.15.53:0/4131492239 conn(0x55f7d1871460 msgr2=0x55f7d1c1f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f1958ff9640 0 client.22359 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f197d9d9740 1 -- 172.21.15.53:0/4131492239 shutdown_connections 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.431+0000 7f197d9d9740 1 -- 172.21.15.53:0/4131492239 wait complete. 2024-08-31T06:27:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f197d9d9740 20 client.22359 trim_cache size 0 max 16384 2024-08-31T06:27:28.440 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:27:28.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 -- 172.21.15.53:0/634678736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19600b4ca0 msgr2=0x7f19600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:28.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19600b4ca0 0x7f19600b71b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1968048000 tx=0x7f196804b000 comp rx=0 tx=0).stop 2024-08-31T06:27:28.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 -- 172.21.15.53:0/634678736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1970104570 msgr2=0x7f1970199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:28.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1970104570 0x7f1970199f80 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f196400db80 tx=0x7f196400b630 comp rx=0 tx=0).stop 2024-08-31T06:27:28.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 -- 172.21.15.53:0/634678736 shutdown_connections 2024-08-31T06:27:28.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f19600b4ca0 0x7f19600b71b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f197010d9d0 0x7f197019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1970104ec0 0x7f197019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 --2- 172.21.15.53:0/634678736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1970104570 0x7f1970199f80 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:28.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 -- 172.21.15.53:0/634678736 >> 172.21.15.53:0/634678736 conn(0x7f19700fe070 msgr2=0x7f19701063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:28.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 -- 172.21.15.53:0/634678736 shutdown_connections 2024-08-31T06:27:28.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:28.432+0000 7f1976202640 1 -- 172.21.15.53:0/634678736 wait complete. 2024-08-31T06:27:28.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:28 smithi130 ceph-mon[22266]: pgmap v1032: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-08-31T06:27:28.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:28 smithi153 ceph-mon[22320]: pgmap v1032: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-08-31T06:27:28.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:28 smithi053 ceph-mon[18924]: pgmap v1032: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-08-31T06:27:29.392 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.13 MB/sec execute 437 sec latency 29103.879 ms 2024-08-31T06:27:29.432 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:27:29.690 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:30.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.166+0000 7fc28c459640 1 -- 172.21.15.53:0/1386561815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc284103900 msgr2=0x7fc284103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:30.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.166+0000 7fc28c459640 1 --2- 172.21.15.53:0/1386561815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc284103900 0x7fc284103d10 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7fc280009900 tx=0x7fc28002a410 comp rx=0 tx=0).stop 2024-08-31T06:27:30.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.167+0000 7fc28c459640 1 -- 172.21.15.53:0/1386561815 shutdown_connections 2024-08-31T06:27:30.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.167+0000 7fc28c459640 1 --2- 172.21.15.53:0/1386561815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc284109b90 0x7fc2841103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.167+0000 7fc28c459640 1 --2- 172.21.15.53:0/1386561815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc284109240 0x7fc284109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.167+0000 7fc28c459640 1 --2- 172.21.15.53:0/1386561815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc284103900 0x7fc284103d10 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.167+0000 7fc28c459640 1 -- 172.21.15.53:0/1386561815 >> 172.21.15.53:0/1386561815 conn(0x7fc28407b5f0 msgr2=0x7fc28407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:30.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.167+0000 7fc28c459640 1 -- 172.21.15.53:0/1386561815 shutdown_connections 2024-08-31T06:27:30.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.167+0000 7fc28c459640 1 -- 172.21.15.53:0/1386561815 wait complete. 2024-08-31T06:27:30.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.167+0000 7fc28c459640 1 Processor -- start 2024-08-31T06:27:30.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.167+0000 7fc28c459640 1 -- start start 2024-08-31T06:27:30.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28c459640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc284103900 0x7fc2840754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28c459640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc284109240 0x7fc2840759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28c459640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc284109b90 0x7fc284075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28c459640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc284113700 con 0x7fc284109b90 2024-08-31T06:27:30.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28c459640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc284113580 con 0x7fc284109240 2024-08-31T06:27:30.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28c459640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc284113880 con 0x7fc284103900 2024-08-31T06:27:30.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28a9f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc284109b90 0x7fc284075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28a9f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc284109b90 0x7fc284075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38442/0 (socket says 172.21.15.53:38442) 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28a9f6640 1 -- 172.21.15.53:0/1357908090 learned_addr learned my addr 172.21.15.53:0/1357908090 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc284103900 0x7fc2840754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc2899f4640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc284109240 0x7fc2840759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28a9f6640 1 -- 172.21.15.53:0/1357908090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc284103900 msgr2=0x7fc2840754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28a9f6640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc284103900 0x7fc2840754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28a9f6640 1 -- 172.21.15.53:0/1357908090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc284109240 msgr2=0x7fc2840759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28a9f6640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc284109240 0x7fc2840759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28a9f6640 1 -- 172.21.15.53:0/1357908090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2841a8490 con 0x7fc284109b90 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.168+0000 7fc28a9f6640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc284109b90 0x7fc284075f30 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009fd0 tx=0x7fc27c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.169+0000 7fc27b7fe640 1 -- 172.21.15.53:0/1357908090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c017070 con 0x7fc284109b90 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.169+0000 7fc28c459640 1 -- 172.21.15.53:0/1357908090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2841a8780 con 0x7fc284109b90 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.169+0000 7fc27b7fe640 1 -- 172.21.15.53:0/1357908090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc27c003e00 con 0x7fc284109b90 2024-08-31T06:27:30.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.169+0000 7fc27b7fe640 1 -- 172.21.15.53:0/1357908090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c010460 con 0x7fc284109b90 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.169+0000 7fc28c459640 1 -- 172.21.15.53:0/1357908090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2841a8d10 con 0x7fc284109b90 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.171+0000 7fc2929ce740 1 Processor -- start 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.171+0000 7fc27b7fe640 1 -- 172.21.15.53:0/1357908090 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc27c003970 con 0x7fc284109b90 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.171+0000 7fc2929ce740 1 -- start start 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c20723070 0x555c20ac8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c206fa1b0 0x555c20ac8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20702390 0x555c20ac8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc2929ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555c20a3f680 con 0x555c206fa1b0 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc2929ce740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555c20a2ec10 con 0x555c20723070 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc2929ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555c20a32bc0 con 0x555c20702390 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc28a1f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c206fa1b0 0x555c20ac8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc28a1f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c206fa1b0 0x555c20ac8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38450/0 (socket says 172.21.15.53:38450) 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc28a1f5640 1 -- 172.21.15.53:0/2262793086 learned_addr learned my addr 172.21.15.53:0/2262793086 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc2899f4640 1 --2- 172.21.15.53:0/2262793086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20702390 0x555c20ac8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc2899f4640 1 --2- 172.21.15.53:0/2262793086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c20723070 0x555c20ac8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc27b7fe640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2700b4ca0 0x7fc2700b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc28a1f5640 1 -- 172.21.15.53:0/2262793086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20702390 msgr2=0x555c20ac8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/2262793086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20702390 0x555c20ac8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc28a1f5640 1 -- 172.21.15.53:0/2262793086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c20723070 msgr2=0x555c20ac8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/2262793086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c20723070 0x555c20ac8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc28a1f5640 1 -- 172.21.15.53:0/2262793086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c2078e650 con 0x555c206fa1b0 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc2899f4640 1 --2- 172.21.15.53:0/2262793086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c20723070 0x555c20ac8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc28a9f6640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2700b4ca0 0x7fc2700b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.172+0000 7fc27b7fe640 1 -- 172.21.15.53:0/1357908090 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7fc27c0e56d0 con 0x7fc284109b90 2024-08-31T06:27:30.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.173+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/2262793086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c206fa1b0 0x555c20ac8850 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7fc280000c00 tx=0x7fc280031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea8627f071625a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.173+0000 7fc278d9a640 1 -- 172.21.15.53:0/2262793086 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280035030 con 0x555c206fa1b0 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.173+0000 7fc278d9a640 1 -- 172.21.15.53:0/2262793086 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc280040070 con 0x555c206fa1b0 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.173+0000 7fc28a9f6640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2700b4ca0 0x7fc2700b71b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0a9010 tx=0x7fc27c077fa0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.173+0000 7fc278d9a640 1 -- 172.21.15.53:0/2262793086 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280003850 con 0x555c206fa1b0 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.174+0000 7fc2929ce740 1 -- 172.21.15.53:0/2262793086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c206fa1b0 msgr2=0x555c20ac8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.174+0000 7fc2929ce740 1 --2- 172.21.15.53:0/2262793086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c206fa1b0 0x555c20ac8850 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7fc280000c00 tx=0x7fc280031bb0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.174+0000 7fc2929ce740 1 -- 172.21.15.53:0/2262793086 shutdown_connections 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.174+0000 7fc2929ce740 1 --2- 172.21.15.53:0/2262793086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20702390 0x555c20ac8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.174+0000 7fc2929ce740 1 --2- 172.21.15.53:0/2262793086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c206fa1b0 0x555c20ac8850 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.174+0000 7fc2929ce740 1 --2- 172.21.15.53:0/2262793086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c20723070 0x555c20ac8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.174+0000 7fc2929ce740 1 -- 172.21.15.53:0/2262793086 >> 172.21.15.53:0/2262793086 conn(0x555c20717460 msgr2=0x555c20ac6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.174+0000 7fc2929ce740 1 -- 172.21.15.53:0/2262793086 shutdown_connections 2024-08-31T06:27:30.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.174+0000 7fc2929ce740 1 -- 172.21.15.53:0/2262793086 wait complete. 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.174+0000 7fc2929ce740 1 -- start start 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.174+0000 7fc2929ce740 1 Processor -- start 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c206fa1b0 0x555c20ad3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20702390 0x555c20ad4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20723070 0x555c20adfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2929ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555c20891700 con 0x555c20723070 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2929ce740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555c209b5750 con 0x555c206fa1b0 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2929ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555c20ad6a90 con 0x555c20702390 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2929ce740 10 client.0 _ll_register_callbacks cb 0x555c209e4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2899f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20723070 0x555c20adfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2899f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20723070 0x555c20adfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38464/0 (socket says 172.21.15.53:38464) 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2899f4640 1 -- 172.21.15.53:0/3013214700 learned_addr learned my addr 172.21.15.53:0/3013214700 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:30.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20702390 0x555c20ad4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2899f4640 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c206fa1b0 0x555c20ad3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2899f4640 1 -- 172.21.15.53:0/3013214700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20702390 msgr2=0x555c20ad4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2899f4640 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20702390 0x555c20ad4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2899f4640 1 -- 172.21.15.53:0/3013214700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c206fa1b0 msgr2=0x555c20ad3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2899f4640 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c206fa1b0 0x555c20ad3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2899f4640 1 -- 172.21.15.53:0/3013214700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c209ee900 con 0x555c20723070 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2899f4640 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20723070 0x555c20adfd80 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7fc27400cf00 tx=0x7fc27400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cbb892cc574df9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc26dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc26dffb640 1 -- 172.21.15.53:0/3013214700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc274011640 con 0x555c20723070 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc26dffb640 1 -- 172.21.15.53:0/3013214700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7fc2740117e0 con 0x555c20723070 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.175+0000 7fc2929ce740 1 -- 172.21.15.53:0/3013214700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc280040070 con 0x555c20723070 2024-08-31T06:27:30.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc26dffb640 1 -- 172.21.15.53:0/3013214700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fc274027050 con 0x555c20723070 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc2929ce740 10 client.22371 fetch_fsmap learned FSMap version 79 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc2929ce740 1 -- 172.21.15.53:0/3013214700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x555c20ae28f0 con 0x555c20723070 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc26dffb640 1 -- 172.21.15.53:0/3013214700 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc280040070 con 0x555c20723070 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc26dffb640 1 -- 172.21.15.53:0/3013214700 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 79) ==== 8414+0+0 (secure 0 0 0) 0x7fc2740228a0 con 0x555c20723070 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc2929ce740 10 client.22371 fetch_fsmap finished waiting for FSMap version 79 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc2929ce740 10 client.22371 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc2929ce740 20 client.22371 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x555c206e19f0 0x555c20ae5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc2929ce740 4 client.22371 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc2929ce740 1 -- 172.21.15.53:0/3013214700 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c20a415d0 con 0x555c206e19f0 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.176+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x555c206e19f0 0x555c20ae5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.177+0000 7fc26dffb640 10 client.22371 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:27:30.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.177+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x555c206e19f0 0x555c20ae5e90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd3fd8f1207bbdbf server_cookie=5ae64cf39ff47e5f in_seq=0 out_seq=0 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc26dffb640 1 -- 172.21.15.53:0/3013214700 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c20a415d0 con 0x555c206e19f0 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc26dffb640 10 client.22371 handle_command_reply: tid=0 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 1 client.22371 shutdown 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 1 -- 172.21.15.53:0/3013214700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20723070 msgr2=0x555c20adfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20723070 0x555c20adfd80 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7fc27400cf00 tx=0x7fc27400cb30 comp rx=0 tx=0).stop 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 1 -- 172.21.15.53:0/3013214700 shutdown_connections 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x555c206e19f0 0x555c20ae5e90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20723070 0x555c20adfd80 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20702390 0x555c20ad4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc26dffb640 0 client.22371 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3013214700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c206fa1b0 0x555c20ad3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 1 -- 172.21.15.53:0/3013214700 >> 172.21.15.53:0/3013214700 conn(0x555c20717460 msgr2=0x555c20acb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 1 -- 172.21.15.53:0/3013214700 shutdown_connections 2024-08-31T06:27:30.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 1 -- 172.21.15.53:0/3013214700 wait complete. 2024-08-31T06:27:30.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.178+0000 7fc2929ce740 20 client.22371 trim_cache size 0 max 16384 2024-08-31T06:27:30.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.191+0000 7fc2929ce740 1 Processor -- start 2024-08-31T06:27:30.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.191+0000 7fc2929ce740 1 -- start start 2024-08-31T06:27:30.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c206fa1b0 0x555c20acbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c20723070 0x555c20ad1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc2929ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc2841b16d0 con 0x555c20702390 2024-08-31T06:27:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc2929ce740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2841b3480 con 0x555c20723070 2024-08-31T06:27:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc2929ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2841b1e60 con 0x555c206fa1b0 2024-08-31T06:27:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc28a1f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc28a1f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38470/0 (socket says 172.21.15.53:38470) 2024-08-31T06:27:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc28a1f5640 1 -- 172.21.15.53:0/2548204870 learned_addr learned my addr 172.21.15.53:0/2548204870 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc28a1f5640 1 -- 172.21.15.53:0/2548204870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c206fa1b0 msgr2=0x555c20acbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/2548204870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c206fa1b0 0x555c20acbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc28a1f5640 1 -- 172.21.15.53:0/2548204870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c20723070 msgr2=0x555c20ad1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:30.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/2548204870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c20723070 0x555c20ad1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc28a1f5640 1 -- 172.21.15.53:0/2548204870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c20acc060 con 0x555c20702390 2024-08-31T06:27:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/2548204870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad0cc0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fc280009900 tx=0x7fc2800318b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdad3a51f8eea80c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.192+0000 7fc26ffff640 1 -- 172.21.15.53:0/2548204870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280035040 con 0x555c20702390 2024-08-31T06:27:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.193+0000 7fc26ffff640 1 -- 172.21.15.53:0/2548204870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc280040050 con 0x555c20702390 2024-08-31T06:27:30.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.193+0000 7fc26ffff640 1 -- 172.21.15.53:0/2548204870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280056430 con 0x555c20702390 2024-08-31T06:27:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.193+0000 7fc2929ce740 1 -- 172.21.15.53:0/2548204870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 msgr2=0x555c20ad0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.193+0000 7fc2929ce740 1 --2- 172.21.15.53:0/2548204870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad0cc0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fc280009900 tx=0x7fc2800318b0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.193+0000 7fc2929ce740 1 -- 172.21.15.53:0/2548204870 shutdown_connections 2024-08-31T06:27:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.193+0000 7fc2929ce740 1 --2- 172.21.15.53:0/2548204870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c20723070 0x555c20ad1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.193+0000 7fc2929ce740 1 --2- 172.21.15.53:0/2548204870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad0cc0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.193+0000 7fc2929ce740 1 --2- 172.21.15.53:0/2548204870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c206fa1b0 0x555c20acbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.193+0000 7fc2929ce740 1 -- 172.21.15.53:0/2548204870 >> 172.21.15.53:0/2548204870 conn(0x555c20717460 msgr2=0x555c20acb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.193+0000 7fc2929ce740 1 -- 172.21.15.53:0/2548204870 shutdown_connections 2024-08-31T06:27:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.193+0000 7fc2929ce740 1 -- 172.21.15.53:0/2548204870 wait complete. 2024-08-31T06:27:30.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc2929ce740 1 -- start start 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc2929ce740 1 Processor -- start 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c206fa1b0 0x555c20ad8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc2929ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20723070 0x555c20b49940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc2929ce740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc2841b2d50 con 0x555c20702390 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc2929ce740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2841b25f0 con 0x555c206fa1b0 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc2929ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2841af6d0 con 0x555c20723070 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc2929ce740 10 client.0 _ll_register_callbacks cb 0x7fc27400cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc28a1f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc28a1f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38482/0 (socket says 172.21.15.53:38482) 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc28a1f5640 1 -- 172.21.15.53:0/3753884944 learned_addr learned my addr 172.21.15.53:0/3753884944 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:30.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc2899f4640 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c206fa1b0 0x555c20ad8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.194+0000 7fc2899f4640 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20723070 0x555c20b49940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc28a1f5640 1 -- 172.21.15.53:0/3753884944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20723070 msgr2=0x555c20b49940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20723070 0x555c20b49940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc28a1f5640 1 -- 172.21.15.53:0/3753884944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c206fa1b0 msgr2=0x555c20ad8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c206fa1b0 0x555c20ad8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc28a1f5640 1 -- 172.21.15.53:0/3753884944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c20b49fb0 con 0x555c20702390 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc2899f4640 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c206fa1b0 0x555c20ad8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc28a1f5640 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad8ce0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fc2800057c0 tx=0x7fc2800317a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9c91d2cfe28389 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc26dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc26dffb640 1 -- 172.21.15.53:0/3753884944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28005a020 con 0x555c20702390 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc26dffb640 1 -- 172.21.15.53:0/3753884944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7fc2800035f0 con 0x555c20702390 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc2929ce740 1 -- 172.21.15.53:0/3753884944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc280040050 con 0x555c20702390 2024-08-31T06:27:30.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc26dffb640 1 -- 172.21.15.53:0/3753884944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fc280065050 con 0x555c20702390 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc2929ce740 10 client.22377 fetch_fsmap learned FSMap version 79 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc2929ce740 1 -- 172.21.15.53:0/3753884944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x555c20b51380 con 0x555c20702390 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.195+0000 7fc26dffb640 1 -- 172.21.15.53:0/3753884944 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc280040050 con 0x555c20702390 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.196+0000 7fc26dffb640 1 -- 172.21.15.53:0/3753884944 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 79) ==== 8414+0+0 (secure 0 0 0) 0x7fc28004d070 con 0x555c20702390 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.196+0000 7fc2929ce740 10 client.22377 fetch_fsmap finished waiting for FSMap version 79 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.196+0000 7fc2929ce740 10 client.22377 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.196+0000 7fc2929ce740 20 client.22377 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.196+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x555c206b6da0 0x555c20b53780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.196+0000 7fc2929ce740 4 client.22377 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.196+0000 7fc2929ce740 1 -- 172.21.15.53:0/3753884944 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555c20a3d070 con 0x555c206b6da0 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.196+0000 7fc2899f4640 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x555c206b6da0 0x555c20b53780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:30.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.196+0000 7fc2899f4640 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x555c206b6da0 0x555c20b53780 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9424e1c53233b718 server_cookie=1175ae3fc42f7210 in_seq=0 out_seq=0 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.196+0000 7fc26dffb640 10 client.22377 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc26dffb640 1 -- 172.21.15.53:0/3753884944 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555c20a3d070 con 0x555c206b6da0 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc26dffb640 10 client.22377 handle_command_reply: tid=0 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 1 client.22377 shutdown 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 1 -- 172.21.15.53:0/3753884944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 msgr2=0x555c20ad8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad8ce0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fc2800057c0 tx=0x7fc2800317a0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 1 -- 172.21.15.53:0/3753884944 shutdown_connections 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x555c206b6da0 0x555c20b53780 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc26dffb640 0 client.22377 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c20723070 0x555c20b49940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c20702390 0x555c20ad8ce0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 1 --2- 172.21.15.53:0/3753884944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c206fa1b0 0x555c20ad8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 1 -- 172.21.15.53:0/3753884944 >> 172.21.15.53:0/3753884944 conn(0x555c20717460 msgr2=0x555c20ad4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:30.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 1 -- 172.21.15.53:0/3753884944 shutdown_connections 2024-08-31T06:27:30.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 1 -- 172.21.15.53:0/3753884944 wait complete. 2024-08-31T06:27:30.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.197+0000 7fc2929ce740 20 client.22377 trim_cache size 0 max 16384 2024-08-31T06:27:30.206 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:27:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 -- 172.21.15.53:0/1357908090 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2700b4ca0 msgr2=0x7fc2700b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2700b4ca0 0x7fc2700b71b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0a9010 tx=0x7fc27c077fa0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 -- 172.21.15.53:0/1357908090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc284109b90 msgr2=0x7fc284075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc284109b90 0x7fc284075f30 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009fd0 tx=0x7fc27c00b260 comp rx=0 tx=0).stop 2024-08-31T06:27:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 -- 172.21.15.53:0/1357908090 shutdown_connections 2024-08-31T06:27:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc2700b4ca0 0x7fc2700b71b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc284109b90 0x7fc284075f30 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc284109240 0x7fc2840759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 --2- 172.21.15.53:0/1357908090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc284103900 0x7fc2840754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:30.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 -- 172.21.15.53:0/1357908090 >> 172.21.15.53:0/1357908090 conn(0x7fc28407b5f0 msgr2=0x7fc2841073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:30.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 -- 172.21.15.53:0/1357908090 shutdown_connections 2024-08-31T06:27:30.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:30.198+0000 7fc28c459640 1 -- 172.21.15.53:0/1357908090 wait complete. 2024-08-31T06:27:30.392 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.12 MB/sec execute 438 sec latency 30103.960 ms 2024-08-31T06:27:30.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:30 smithi130 ceph-mon[22266]: pgmap v1033: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-08-31T06:27:30.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:30 smithi153 ceph-mon[22320]: pgmap v1033: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-08-31T06:27:30.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:30 smithi053 ceph-mon[18924]: pgmap v1033: 97 pgs: 97 active+clean; 870 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-08-31T06:27:30.921 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:27:31.088 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:27:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:31.392 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.10 MB/sec execute 439 sec latency 31104.059 ms 2024-08-31T06:27:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.693+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2078817540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d2c104620 msgr2=0x7f6d2c104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.693+0000 7f6d31cd8640 1 --2- 172.21.15.53:0/2078817540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d2c104620 0x7f6d2c104a30 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009900 tx=0x7f6d1c02a410 comp rx=0 tx=0).stop 2024-08-31T06:27:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.693+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2078817540 shutdown_connections 2024-08-31T06:27:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.693+0000 7f6d31cd8640 1 --2- 172.21.15.53:0/2078817540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d2c10dbd0 0x7f6d2c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.693+0000 7f6d31cd8640 1 --2- 172.21.15.53:0/2078817540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d2c105050 0x7f6d2c10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.693+0000 7f6d31cd8640 1 --2- 172.21.15.53:0/2078817540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d2c104620 0x7f6d2c104a30 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.693+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2078817540 >> 172.21.15.53:0/2078817540 conn(0x7f6d2c0794d0 msgr2=0x7f6d2c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.693+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2078817540 shutdown_connections 2024-08-31T06:27:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.693+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2078817540 wait complete. 2024-08-31T06:27:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.694+0000 7f6d31cd8640 1 Processor -- start 2024-08-31T06:27:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.694+0000 7f6d31cd8640 1 -- start start 2024-08-31T06:27:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d31cd8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d2c104620 0x7f6d2c19a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d31cd8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d2c105050 0x7f6d2c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d31cd8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d2c10dbd0 0x7f6d2c19f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d31cd8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1136c0 con 0x7f6d2c104620 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d31cd8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c113540 con 0x7f6d2c105050 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d31cd8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c113840 con 0x7f6d2c10dbd0 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d2b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d2c104620 0x7f6d2c19a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d2b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d2c104620 0x7f6d2c19a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38498/0 (socket says 172.21.15.53:38498) 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d2b7fe640 1 -- 172.21.15.53:0/2167502435 learned_addr learned my addr 172.21.15.53:0/2167502435 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d2c10dbd0 0x7f6d2c19f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d2affd640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d2c105050 0x7f6d2c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d2b7fe640 1 -- 172.21.15.53:0/2167502435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d2c10dbd0 msgr2=0x7f6d2c19f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d2b7fe640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d2c10dbd0 0x7f6d2c19f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d2b7fe640 1 -- 172.21.15.53:0/2167502435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d2c105050 msgr2=0x7f6d2c19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d2b7fe640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d2c105050 0x7f6d2c19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.695+0000 7f6d2b7fe640 1 -- 172.21.15.53:0/2167502435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c1a00a0 con 0x7f6d2c104620 2024-08-31T06:27:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.696+0000 7f6d2b7fe640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d2c104620 0x7f6d2c19a130 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c005940 tx=0x7f6d1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.696+0000 7f6d28ff9640 1 -- 172.21.15.53:0/2167502435 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c03f030 con 0x7f6d2c104620 2024-08-31T06:27:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.696+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2167502435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2c1a0330 con 0x7f6d2c104620 2024-08-31T06:27:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.696+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2167502435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2c1a6af0 con 0x7f6d2c104620 2024-08-31T06:27:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.696+0000 7f6d28ff9640 1 -- 172.21.15.53:0/2167502435 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d1c003c90 con 0x7f6d2c104620 2024-08-31T06:27:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.696+0000 7f6d28ff9640 1 -- 172.21.15.53:0/2167502435 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c035070 con 0x7f6d2c104620 2024-08-31T06:27:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d3824d740 1 Processor -- start 2024-08-31T06:27:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d3824d740 1 -- start start 2024-08-31T06:27:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe4589070 0x564fe492e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d28ff9640 1 -- 172.21.15.53:0/2167502435 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6d1c042030 con 0x7f6d2c104620 2024-08-31T06:27:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe45601b0 0x564fe492e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe492ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d3824d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564fe48a5680 con 0x564fe4589070 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d3824d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564fe4894c10 con 0x564fe45601b0 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d3824d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564fe4898bc0 con 0x564fe4568390 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe4589070 0x564fe492e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe4589070 0x564fe492e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38510/0 (socket says 172.21.15.53:38510) 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d2bfff640 1 -- 172.21.15.53:0/2468224910 learned_addr learned my addr 172.21.15.53:0/2468224910 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d2b7fe640 1 --2- 172.21.15.53:0/2468224910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe45601b0 0x564fe492e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.699+0000 7f6d2affd640 1 --2- 172.21.15.53:0/2468224910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe492ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d2bfff640 1 -- 172.21.15.53:0/2468224910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 msgr2=0x564fe492ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/2468224910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe492ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d2bfff640 1 -- 172.21.15.53:0/2468224910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe45601b0 msgr2=0x564fe492e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/2468224910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe45601b0 0x564fe492e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d2bfff640 1 -- 172.21.15.53:0/2468224910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe45f4650 con 0x564fe4589070 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/2468224910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe4589070 0x564fe492e310 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f6d24010370 tx=0x7f6d24010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6821d97d6c524ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d28ff9640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d140b4d20 0x7f6d140b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d11ffb640 1 -- 172.21.15.53:0/2468224910 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24016070 con 0x564fe4589070 2024-08-31T06:27:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d2b7fe640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d140b4d20 0x7f6d140b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d11ffb640 1 -- 172.21.15.53:0/2468224910 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d24004d20 con 0x564fe4589070 2024-08-31T06:27:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d11ffb640 1 -- 172.21.15.53:0/2468224910 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24005280 con 0x564fe4589070 2024-08-31T06:27:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.700+0000 7f6d28ff9640 1 -- 172.21.15.53:0/2167502435 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f6d1c105990 con 0x7f6d2c104620 2024-08-31T06:27:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.701+0000 7f6d3824d740 1 -- 172.21.15.53:0/2468224910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe4589070 msgr2=0x564fe492e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.701+0000 7f6d2b7fe640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d140b4d20 0x7f6d140b7230 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c103170 tx=0x7f6d1c0b3040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.701+0000 7f6d3824d740 1 --2- 172.21.15.53:0/2468224910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe4589070 0x564fe492e310 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f6d24010370 tx=0x7f6d24010830 comp rx=0 tx=0).stop 2024-08-31T06:27:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.701+0000 7f6d3824d740 1 -- 172.21.15.53:0/2468224910 shutdown_connections 2024-08-31T06:27:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.701+0000 7f6d3824d740 1 --2- 172.21.15.53:0/2468224910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe492ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.701+0000 7f6d3824d740 1 --2- 172.21.15.53:0/2468224910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe45601b0 0x564fe492e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.701+0000 7f6d3824d740 1 --2- 172.21.15.53:0/2468224910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe4589070 0x564fe492e310 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.701+0000 7f6d3824d740 1 -- 172.21.15.53:0/2468224910 >> 172.21.15.53:0/2468224910 conn(0x564fe457d460 msgr2=0x564fe492c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.701+0000 7f6d3824d740 1 -- 172.21.15.53:0/2468224910 shutdown_connections 2024-08-31T06:27:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.701+0000 7f6d3824d740 1 -- 172.21.15.53:0/2468224910 wait complete. 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.702+0000 7f6d3824d740 1 -- start start 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.702+0000 7f6d3824d740 1 Processor -- start 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.702+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45601b0 0x564fe4935a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe4935f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe4589070 0x564fe494e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d3824d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564fe46f7700 con 0x564fe45601b0 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d3824d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564fe481b750 con 0x564fe4589070 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d3824d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564fe4945280 con 0x564fe4568390 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d3824d740 10 client.0 _ll_register_callbacks cb 0x564fe484ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45601b0 0x564fe4935a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45601b0 0x564fe4935a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38520/0 (socket says 172.21.15.53:38520) 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2bfff640 1 -- 172.21.15.53:0/174203102 learned_addr learned my addr 172.21.15.53:0/174203102 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2affd640 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe4935f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe4589070 0x564fe494e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2bfff640 1 -- 172.21.15.53:0/174203102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 msgr2=0x564fe4935f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe4935f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2bfff640 1 -- 172.21.15.53:0/174203102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe4589070 msgr2=0x564fe494e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe4589070 0x564fe494e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2bfff640 1 -- 172.21.15.53:0/174203102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe4854900 con 0x564fe45601b0 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2affd640 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe4935f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45601b0 0x564fe4935a50 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f6d24014000 tx=0x7f6d24009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436834e5cf320694 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.703+0000 7f6d0affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.704+0000 7f6d0affd640 1 -- 172.21.15.53:0/174203102 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24016070 con 0x564fe45601b0 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.704+0000 7f6d0affd640 1 -- 172.21.15.53:0/174203102 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f6d24004450 con 0x564fe45601b0 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.704+0000 7f6d3824d740 1 -- 172.21.15.53:0/174203102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d24004d20 con 0x564fe45601b0 2024-08-31T06:27:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.704+0000 7f6d0affd640 1 -- 172.21.15.53:0/174203102 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f6d24004650 con 0x564fe45601b0 2024-08-31T06:27:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.704+0000 7f6d3824d740 10 client.22389 fetch_fsmap learned FSMap version 79 2024-08-31T06:27:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.704+0000 7f6d3824d740 1 -- 172.21.15.53:0/174203102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x564fe4951070 con 0x564fe45601b0 2024-08-31T06:27:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.704+0000 7f6d0affd640 1 -- 172.21.15.53:0/174203102 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d24004d20 con 0x564fe45601b0 2024-08-31T06:27:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.704+0000 7f6d0affd640 1 -- 172.21.15.53:0/174203102 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 79) ==== 8414+0+0 (secure 0 0 0) 0x7f6d2400f040 con 0x564fe45601b0 2024-08-31T06:27:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.704+0000 7f6d3824d740 10 client.22389 fetch_fsmap finished waiting for FSMap version 79 2024-08-31T06:27:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.704+0000 7f6d3824d740 10 client.22389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.705+0000 7f6d3824d740 20 client.22389 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.705+0000 7f6d3824d740 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564fe45479f0 0x564fe49543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.705+0000 7f6d3824d740 4 client.22389 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.705+0000 7f6d3824d740 1 -- 172.21.15.53:0/174203102 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fe48a75d0 con 0x564fe45479f0 2024-08-31T06:27:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.705+0000 7f6d2affd640 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564fe45479f0 0x564fe49543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.705+0000 7f6d0affd640 10 client.22389 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:31.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.705+0000 7f6d2affd640 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564fe45479f0 0x564fe49543d0 crc :-1 s=READY pgs=530 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=179ea1e400b2d1c9 server_cookie=dfbbd643caf431a4 in_seq=0 out_seq=0 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d0affd640 1 -- 172.21.15.53:0/174203102 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564fe48a75d0 con 0x564fe45479f0 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d0affd640 10 client.22389 handle_command_reply: tid=0 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d3824d740 1 client.22389 shutdown 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d3824d740 1 -- 172.21.15.53:0/174203102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45601b0 msgr2=0x564fe4935a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d3824d740 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45601b0 0x564fe4935a50 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f6d24014000 tx=0x7f6d24009c50 comp rx=0 tx=0).stop 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d3824d740 1 -- 172.21.15.53:0/174203102 shutdown_connections 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d3824d740 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564fe45479f0 0x564fe49543d0 crc :-1 s=READY pgs=530 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d0affd640 0 client.22389 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d3824d740 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe4589070 0x564fe494e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d3824d740 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe4935f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d3824d740 1 --2- 172.21.15.53:0/174203102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45601b0 0x564fe4935a50 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.706+0000 7f6d3824d740 1 -- 172.21.15.53:0/174203102 >> 172.21.15.53:0/174203102 conn(0x564fe457d460 msgr2=0x564fe492a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:31.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.707+0000 7f6d3824d740 1 -- 172.21.15.53:0/174203102 shutdown_connections 2024-08-31T06:27:31.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.707+0000 7f6d3824d740 1 -- 172.21.15.53:0/174203102 wait complete. 2024-08-31T06:27:31.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.707+0000 7f6d3824d740 20 client.22389 trim_cache size 0 max 16384 2024-08-31T06:27:31.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.726+0000 7f6d3824d740 1 Processor -- start 2024-08-31T06:27:31.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.726+0000 7f6d3824d740 1 -- start start 2024-08-31T06:27:31.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.726+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4927230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe45601b0 0x564fe492c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe4568390 0x564fe494e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d3824d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1ad2a0 con 0x564fe45479f0 2024-08-31T06:27:31.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d3824d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1af050 con 0x564fe4568390 2024-08-31T06:27:31.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d3824d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1ada30 con 0x564fe45601b0 2024-08-31T06:27:31.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4927230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4927230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38532/0 (socket says 172.21.15.53:38532) 2024-08-31T06:27:31.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d2bfff640 1 -- 172.21.15.53:0/898374778 learned_addr learned my addr 172.21.15.53:0/898374778 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:31.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d2affd640 1 --2- 172.21.15.53:0/898374778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe45601b0 0x564fe492c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d2bfff640 1 -- 172.21.15.53:0/898374778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe45601b0 msgr2=0x564fe492c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:31.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/898374778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe45601b0 0x564fe492c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d2bfff640 1 -- 172.21.15.53:0/898374778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe4568390 msgr2=0x564fe494e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:31.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/898374778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe4568390 0x564fe494e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d2bfff640 1 -- 172.21.15.53:0/898374778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe4936d10 con 0x564fe45479f0 2024-08-31T06:27:31.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d2affd640 1 --2- 172.21.15.53:0/898374778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe45601b0 0x564fe492c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:27:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.727+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/898374778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4927230 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009f40 tx=0x7f6d24009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9118c26a1ca6d104 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.728+0000 7f6d117fa640 1 -- 172.21.15.53:0/898374778 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24016040 con 0x564fe45479f0 2024-08-31T06:27:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.728+0000 7f6d117fa640 1 -- 172.21.15.53:0/898374778 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d2401f030 con 0x564fe45479f0 2024-08-31T06:27:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.728+0000 7f6d117fa640 1 -- 172.21.15.53:0/898374778 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2402cbb0 con 0x564fe45479f0 2024-08-31T06:27:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.729+0000 7f6d3824d740 1 -- 172.21.15.53:0/898374778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 msgr2=0x564fe4927230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.729+0000 7f6d3824d740 1 --2- 172.21.15.53:0/898374778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4927230 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009f40 tx=0x7f6d24009d40 comp rx=0 tx=0).stop 2024-08-31T06:27:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.729+0000 7f6d3824d740 1 -- 172.21.15.53:0/898374778 shutdown_connections 2024-08-31T06:27:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.729+0000 7f6d3824d740 1 --2- 172.21.15.53:0/898374778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe4568390 0x564fe494e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.729+0000 7f6d3824d740 1 --2- 172.21.15.53:0/898374778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe45601b0 0x564fe492c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.729+0000 7f6d3824d740 1 --2- 172.21.15.53:0/898374778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4927230 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.729+0000 7f6d3824d740 1 -- 172.21.15.53:0/898374778 >> 172.21.15.53:0/898374778 conn(0x564fe457d460 msgr2=0x564fe492bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.729+0000 7f6d3824d740 1 -- 172.21.15.53:0/898374778 shutdown_connections 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.729+0000 7f6d3824d740 1 -- 172.21.15.53:0/898374778 wait complete. 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.729+0000 7f6d3824d740 1 -- start start 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.729+0000 7f6d3824d740 1 Processor -- start 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.730+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4955ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.730+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe45601b0 0x564fe4956010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.730+0000 7f6d3824d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe49bdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.730+0000 7f6d3824d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1ae920 con 0x564fe45479f0 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.730+0000 7f6d3824d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1ae1c0 con 0x564fe45601b0 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.730+0000 7f6d3824d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1ab2a0 con 0x564fe4568390 2024-08-31T06:27:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.730+0000 7f6d3824d740 10 client.0 _ll_register_callbacks cb 0x7f6d1c10d040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.730+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4955ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.730+0000 7f6d2affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe45601b0 0x564fe4956010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.730+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4955ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38540/0 (socket says 172.21.15.53:38540) 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.730+0000 7f6d2bfff640 1 -- 172.21.15.53:0/1727768363 learned_addr learned my addr 172.21.15.53:0/1727768363 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.731+0000 7f6d2affd640 1 -- 172.21.15.53:0/1727768363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 msgr2=0x564fe49bdb50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.731+0000 7f6d2affd640 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe49bdb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.731+0000 7f6d2affd640 1 -- 172.21.15.53:0/1727768363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 msgr2=0x564fe4955ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.731+0000 7f6d2affd640 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4955ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.731+0000 7f6d2affd640 1 -- 172.21.15.53:0/1727768363 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe49be090 con 0x564fe45601b0 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.731+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4955ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.731+0000 7f6d2affd640 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe45601b0 0x564fe4956010 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x564fe481b870 tx=0x7f6d2000be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985206b8012880f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.731+0000 7f6d0affd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:27:31.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.732+0000 7f6d0affd640 1 -- 172.21.15.53:0/1727768363 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d20003df0 con 0x564fe45601b0 2024-08-31T06:27:31.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.732+0000 7f6d0affd640 1 -- 172.21.15.53:0/1727768363 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f6d2001d470 con 0x564fe45601b0 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.732+0000 7f6d3824d740 1 -- 172.21.15.53:0/1727768363 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d2401f030 con 0x564fe45601b0 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.732+0000 7f6d0affd640 1 -- 172.21.15.53:0/1727768363 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f6d2001d670 con 0x564fe45601b0 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.732+0000 7f6d3824d740 10 client.31046 fetch_fsmap learned FSMap version 79 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.732+0000 7f6d3824d740 1 -- 172.21.15.53:0/1727768363 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x564fe49bf270 con 0x564fe45601b0 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.732+0000 7f6d0affd640 1 -- 172.21.15.53:0/1727768363 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d2401f030 con 0x564fe45601b0 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.732+0000 7f6d0affd640 1 -- 172.21.15.53:0/1727768363 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 79) ==== 8414+0+0 (secure 0 0 0) 0x7f6d200118d0 con 0x564fe45601b0 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.733+0000 7f6d3824d740 10 client.31046 fetch_fsmap finished waiting for FSMap version 79 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.733+0000 7f6d3824d740 10 client.31046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.733+0000 7f6d3824d740 20 client.31046 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.733+0000 7f6d3824d740 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564fe4589070 0x564fe49c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.733+0000 7f6d3824d740 4 client.31046 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.733+0000 7f6d3824d740 1 -- 172.21.15.53:0/1727768363 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564fe48a3070 con 0x564fe4589070 2024-08-31T06:27:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.733+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564fe4589070 0x564fe49c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.733+0000 7f6d0affd640 10 client.31046 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.733+0000 7f6d2bfff640 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564fe4589070 0x564fe49c1ab0 crc :-1 s=READY pgs=531 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cda8665c9f17b25 server_cookie=e74cd0a0aafa2f49 in_seq=0 out_seq=0 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d0affd640 1 -- 172.21.15.53:0/1727768363 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564fe48a3070 con 0x564fe4589070 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d0affd640 10 client.31046 handle_command_reply: tid=0 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 1 client.31046 shutdown 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 1 -- 172.21.15.53:0/1727768363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe45601b0 msgr2=0x564fe4956010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe45601b0 0x564fe4956010 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x564fe481b870 tx=0x7f6d2000be90 comp rx=0 tx=0).stop 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 1 -- 172.21.15.53:0/1727768363 shutdown_connections 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564fe4589070 0x564fe49c1ab0 crc :-1 s=READY pgs=531 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d0affd640 0 client.31046 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564fe4568390 0x564fe49bdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fe45601b0 0x564fe4956010 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 1 --2- 172.21.15.53:0/1727768363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fe45479f0 0x564fe4955ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 1 -- 172.21.15.53:0/1727768363 >> 172.21.15.53:0/1727768363 conn(0x564fe457d460 msgr2=0x564fe4936ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 1 -- 172.21.15.53:0/1727768363 shutdown_connections 2024-08-31T06:27:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 1 -- 172.21.15.53:0/1727768363 wait complete. 2024-08-31T06:27:31.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.734+0000 7f6d3824d740 20 client.31046 trim_cache size 0 max 16384 2024-08-31T06:27:31.741 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:27:31.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2167502435 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d140b4d20 msgr2=0x7f6d140b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:31.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d140b4d20 0x7f6d140b7230 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c103170 tx=0x7f6d1c0b3040 comp rx=0 tx=0).stop 2024-08-31T06:27:31.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2167502435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d2c104620 msgr2=0x7f6d2c19a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:31.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d2c104620 0x7f6d2c19a130 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c005940 tx=0x7f6d1c0042f0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2167502435 shutdown_connections 2024-08-31T06:27:31.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6d140b4d20 0x7f6d140b7230 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d2c10dbd0 0x7f6d2c19f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d2c105050 0x7f6d2c19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 --2- 172.21.15.53:0/2167502435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d2c104620 0x7f6d2c19a130 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2167502435 >> 172.21.15.53:0/2167502435 conn(0x7f6d2c0794d0 msgr2=0x7f6d2c100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2167502435 shutdown_connections 2024-08-31T06:27:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:31.735+0000 7f6d31cd8640 1 -- 172.21.15.53:0/2167502435 wait complete. 2024-08-31T06:27:31.743 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:32.392 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.09 MB/sec execute 440 sec latency 32104.154 ms 2024-08-31T06:27:32.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:32 smithi130 ceph-mon[22266]: pgmap v1034: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-08-31T06:27:32.641 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:32 smithi053 ceph-mon[18924]: pgmap v1034: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-08-31T06:27:32.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:32 smithi153 ceph-mon[22320]: pgmap v1034: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-08-31T06:27:32.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.976+0000 7f13b72cd640 1 -- 172.21.15.53:0/503089586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13b0109b90 msgr2=0x7f13b01103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.976+0000 7f13b72cd640 1 --2- 172.21.15.53:0/503089586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13b0109b90 0x7f13b01103c0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009ca0 tx=0x7f13a802a8e0 comp rx=0 tx=0).stop 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.976+0000 7f13b72cd640 1 -- 172.21.15.53:0/503089586 shutdown_connections 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.976+0000 7f13b72cd640 1 --2- 172.21.15.53:0/503089586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13b0109b90 0x7f13b01103c0 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.976+0000 7f13b72cd640 1 --2- 172.21.15.53:0/503089586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13b0109240 0x7f13b0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.976+0000 7f13b72cd640 1 --2- 172.21.15.53:0/503089586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b0103900 0x7f13b0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.976+0000 7f13b72cd640 1 -- 172.21.15.53:0/503089586 >> 172.21.15.53:0/503089586 conn(0x7f13b007b5f0 msgr2=0x7f13b007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.976+0000 7f13b72cd640 1 -- 172.21.15.53:0/503089586 shutdown_connections 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.976+0000 7f13b72cd640 1 -- 172.21.15.53:0/503089586 wait complete. 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.977+0000 7f13b72cd640 1 Processor -- start 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.977+0000 7f13b72cd640 1 -- start start 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.977+0000 7f13b72cd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13b0103900 0x7f13b019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:32.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.977+0000 7f13b72cd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b0109240 0x7f13b019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.977+0000 7f13b72cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13b0109b90 0x7f13b019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.977+0000 7f13b72cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0113760 con 0x7f13b0109b90 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.977+0000 7f13b72cd640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13b01135e0 con 0x7f13b0103900 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.977+0000 7f13b72cd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13b01138e0 con 0x7f13b0109240 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b586a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13b0109b90 0x7f13b019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b586a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13b0109b90 0x7f13b019fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38564/0 (socket says 172.21.15.53:38564) 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b586a640 1 -- 172.21.15.53:0/453731584 learned_addr learned my addr 172.21.15.53:0/453731584 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b5069640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13b0103900 0x7f13b019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b4868640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b0109240 0x7f13b019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b586a640 1 -- 172.21.15.53:0/453731584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b0109240 msgr2=0x7f13b019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b586a640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b0109240 0x7f13b019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:32.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b586a640 1 -- 172.21.15.53:0/453731584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13b0103900 msgr2=0x7f13b019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b586a640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13b0103900 0x7f13b019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b586a640 1 -- 172.21.15.53:0/453731584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b01a0160 con 0x7f13b0109b90 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b4868640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b0109240 0x7f13b019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b586a640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13b0109b90 0x7f13b019fa30 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f13a8006010 tx=0x7f13a8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13a67fc640 1 -- 172.21.15.53:0/453731584 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8004240 con 0x7f13b0109b90 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13a67fc640 1 -- 172.21.15.53:0/453731584 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13a8003e10 con 0x7f13b0109b90 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.978+0000 7f13b72cd640 1 -- 172.21.15.53:0/453731584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b01a03f0 con 0x7f13b0109b90 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.979+0000 7f13a67fc640 1 -- 172.21.15.53:0/453731584 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8030d70 con 0x7f13b0109b90 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.979+0000 7f13b72cd640 1 -- 172.21.15.53:0/453731584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b01a6bb0 con 0x7f13b0109b90 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.980+0000 7f13b72cd640 1 -- 172.21.15.53:0/453731584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b0103d10 con 0x7f13b0109b90 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.981+0000 7f13a67fc640 1 -- 172.21.15.53:0/453731584 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f13a8004b40 con 0x7f13b0109b90 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.982+0000 7f13a67fc640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f139c0b4d20 0x7f139c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.982+0000 7f13b5069640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f139c0b4d20 0x7f139c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:32.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.982+0000 7f13a67fc640 1 -- 172.21.15.53:0/453731584 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f13a8106960 con 0x7f13b0109b90 2024-08-31T06:27:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.983+0000 7f13b5069640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f139c0b4d20 0x7f139c0b7230 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f13ac005fd0 tx=0x7f13ac00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:32.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:32.986+0000 7f13a67fc640 1 -- 172.21.15.53:0/453731584 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f13a80cd730 con 0x7f13b0109b90 2024-08-31T06:27:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.209+0000 7f13b72cd640 1 -- 172.21.15.53:0/453731584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13b019b320 con 0x7f13b0109b90 2024-08-31T06:27:33.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.210+0000 7f13a67fc640 1 -- 172.21.15.53:0/453731584 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+12005 (secure 0 0 0) 0x7f13b019b320 con 0x7f13b0109b90 2024-08-31T06:27:33.212 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:27:33.212 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":80,"btime":"2024-08-31T06:27:32:358785+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":80,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:27:31.404359+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:27:33.212 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 80 2024-08-31T06:27:33.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 -- 172.21.15.53:0/453731584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f139c0b4d20 msgr2=0x7f139c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:33.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f139c0b4d20 0x7f139c0b7230 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f13ac005fd0 tx=0x7f13ac00b390 comp rx=0 tx=0).stop 2024-08-31T06:27:33.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 -- 172.21.15.53:0/453731584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13b0109b90 msgr2=0x7f13b019fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:33.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13b0109b90 0x7f13b019fa30 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f13a8006010 tx=0x7f13a8003c20 comp rx=0 tx=0).stop 2024-08-31T06:27:33.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 -- 172.21.15.53:0/453731584 shutdown_connections 2024-08-31T06:27:33.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f139c0b4d20 0x7f139c0b7230 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:33.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13b0109b90 0x7f13b019fa30 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:33.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13b0109240 0x7f13b019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:33.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 --2- 172.21.15.53:0/453731584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13b0103900 0x7f13b019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:33.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 -- 172.21.15.53:0/453731584 >> 172.21.15.53:0/453731584 conn(0x7f13b007b5f0 msgr2=0x7f13b01052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:33.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 -- 172.21.15.53:0/453731584 shutdown_connections 2024-08-31T06:27:33.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:33.212+0000 7f13b72cd640 1 -- 172.21.15.53:0/453731584 wait complete. 2024-08-31T06:27:33.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.08 MB/sec execute 441 sec latency 33104.241 ms 2024-08-31T06:27:33.546 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:27:33.546 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:27:33.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:33 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:33.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:33 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/453731584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:27:33.644 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:33 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:33.644 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:33 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/453731584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:27:33.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:33 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:33.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:33 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/453731584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:27:33.928 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id e3c07659 --release --await' 2024-08-31T06:27:33.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id e3c07659 --release --await 2024-08-31T06:27:33.983 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:34.392 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.07 MB/sec execute 442 sec latency 34104.295 ms 2024-08-31T06:27:34.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.479+0000 7f459ea19640 1 -- 172.21.15.53:0/3298909928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4598108160 msgr2=0x7f4598108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:34.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.479+0000 7f459ea19640 1 --2- 172.21.15.53:0/3298909928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4598108160 0x7f4598108570 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f458c009900 tx=0x7f458c02a410 comp rx=0 tx=0).stop 2024-08-31T06:27:34.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.479+0000 7f459ea19640 1 -- 172.21.15.53:0/3298909928 shutdown_connections 2024-08-31T06:27:34.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.479+0000 7f459ea19640 1 --2- 172.21.15.53:0/3298909928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4598108ab0 0x7f459810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.479+0000 7f459ea19640 1 --2- 172.21.15.53:0/3298909928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4598108160 0x7f4598108570 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.479+0000 7f459ea19640 1 --2- 172.21.15.53:0/3298909928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4598102820 0x7f4598102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.479+0000 7f459ea19640 1 -- 172.21.15.53:0/3298909928 >> 172.21.15.53:0/3298909928 conn(0x7f45980794e0 msgr2=0x7f45980798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:34.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.479+0000 7f459ea19640 1 -- 172.21.15.53:0/3298909928 shutdown_connections 2024-08-31T06:27:34.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.479+0000 7f459ea19640 1 -- 172.21.15.53:0/3298909928 wait complete. 2024-08-31T06:27:34.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.480+0000 7f459ea19640 1 Processor -- start 2024-08-31T06:27:34.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.480+0000 7f459ea19640 1 -- start start 2024-08-31T06:27:34.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.480+0000 7f459ea19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4598102820 0x7f459819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.480+0000 7f459ea19640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4598108160 0x7f459819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.480+0000 7f459ea19640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4598108ab0 0x7f459819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.480+0000 7f459ea19640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f45981125b0 con 0x7f4598102820 2024-08-31T06:27:34.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.480+0000 7f459ea19640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4598112430 con 0x7f4598108ab0 2024-08-31T06:27:34.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.480+0000 7f459ea19640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4598112730 con 0x7f4598108160 2024-08-31T06:27:34.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.480+0000 7f4597fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4598102820 0x7f459819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.480+0000 7f4597fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4598102820 0x7f459819af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41560/0 (socket says 172.21.15.53:41560) 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.480+0000 7f4597fff640 1 -- 172.21.15.53:0/3805379472 learned_addr learned my addr 172.21.15.53:0/3805379472 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f45977fe640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4598108160 0x7f459819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f459cfb6640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4598108ab0 0x7f459819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f4597fff640 1 -- 172.21.15.53:0/3805379472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4598108160 msgr2=0x7f459819b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f4597fff640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4598108160 0x7f459819b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f4597fff640 1 -- 172.21.15.53:0/3805379472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4598108ab0 msgr2=0x7f459819b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f4597fff640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4598108ab0 0x7f459819b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f4597fff640 1 -- 172.21.15.53:0/3805379472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45981a6210 con 0x7f4598102820 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f459cfb6640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4598108ab0 0x7f459819b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f4597fff640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4598102820 0x7f459819af00 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f458800d770 tx=0x7f458800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f45957fa640 1 -- 172.21.15.53:0/3805379472 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588017070 con 0x7f4598102820 2024-08-31T06:27:34.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f45957fa640 1 -- 172.21.15.53:0/3805379472 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45880054b0 con 0x7f4598102820 2024-08-31T06:27:34.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f45957fa640 1 -- 172.21.15.53:0/3805379472 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588004c60 con 0x7f4598102820 2024-08-31T06:27:34.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.481+0000 7f459ea19640 1 -- 172.21.15.53:0/3805379472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45981a6500 con 0x7f4598102820 2024-08-31T06:27:34.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.482+0000 7f459ea19640 1 -- 172.21.15.53:0/3805379472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45981a69c0 con 0x7f4598102820 2024-08-31T06:27:34.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.484+0000 7f45a4f8e740 1 Processor -- start 2024-08-31T06:27:34.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.484+0000 7f45a4f8e740 1 -- start start 2024-08-31T06:27:34.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.484+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff2a4350 0x563fff64a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.484+0000 7f45957fa640 1 -- 172.21.15.53:0/3805379472 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4588004e00 con 0x7f4598102820 2024-08-31T06:27:34.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.484+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff27b490 0x563fff64acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.484+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff283670 0x563fff64b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.484+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563fff5c05f0 con 0x563fff283670 2024-08-31T06:27:34.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.484+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563fff5afb80 con 0x563fff2a4350 2024-08-31T06:27:34.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.484+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563fff5b3b30 con 0x563fff27b490 2024-08-31T06:27:34.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f45977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff283670 0x563fff64b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f45977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff283670 0x563fff64b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41564/0 (socket says 172.21.15.53:41564) 2024-08-31T06:27:34.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f45977fe640 1 -- 172.21.15.53:0/2634369363 learned_addr learned my addr 172.21.15.53:0/2634369363 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:34.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f4597fff640 1 --2- 172.21.15.53:0/2634369363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff27b490 0x563fff64acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f459cfb6640 1 --2- 172.21.15.53:0/2634369363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff2a4350 0x563fff64a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f45977fe640 1 -- 172.21.15.53:0/2634369363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff27b490 msgr2=0x563fff64acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:34.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f45977fe640 1 --2- 172.21.15.53:0/2634369363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff27b490 0x563fff64acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f45977fe640 1 -- 172.21.15.53:0/2634369363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff2a4350 msgr2=0x563fff64a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:34.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f45977fe640 1 --2- 172.21.15.53:0/2634369363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff2a4350 0x563fff64a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f45977fe640 1 -- 172.21.15.53:0/2634369363 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fff30f930 con 0x563fff283670 2024-08-31T06:27:34.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f459cfb6640 1 --2- 172.21.15.53:0/2634369363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff2a4350 0x563fff64a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:34.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.485+0000 7f45977fe640 1 --2- 172.21.15.53:0/2634369363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff283670 0x563fff64b200 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f458c0057c0 tx=0x7f458c031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4744e9bcdd8855b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:34.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.486+0000 7f457e7fc640 1 -- 172.21.15.53:0/2634369363 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c035030 con 0x563fff283670 2024-08-31T06:27:34.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.486+0000 7f457e7fc640 1 -- 172.21.15.53:0/2634369363 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f458c040070 con 0x563fff283670 2024-08-31T06:27:34.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.486+0000 7f457e7fc640 1 -- 172.21.15.53:0/2634369363 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c003830 con 0x563fff283670 2024-08-31T06:27:34.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.486+0000 7f45957fa640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45800b4d20 0x7f45800b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.490 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:34 smithi053 ceph-mon[18924]: pgmap v1035: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-31T06:27:34.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.486+0000 7f459cfb6640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45800b4d20 0x7f45800b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.486+0000 7f45957fa640 1 -- 172.21.15.53:0/3805379472 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f45880e4f80 con 0x7f4598102820 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.487+0000 7f45a4f8e740 1 -- 172.21.15.53:0/2634369363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff283670 msgr2=0x563fff64b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.487+0000 7f459cfb6640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45800b4d20 0x7f45800b7230 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f459806c9c0 tx=0x7f4590009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.487+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/2634369363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff283670 0x563fff64b200 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f458c0057c0 tx=0x7f458c031af0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.487+0000 7f45a4f8e740 1 -- 172.21.15.53:0/2634369363 shutdown_connections 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.487+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/2634369363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff283670 0x563fff64b200 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.487+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/2634369363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff27b490 0x563fff64acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.487+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/2634369363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff2a4350 0x563fff64a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.487+0000 7f45a4f8e740 1 -- 172.21.15.53:0/2634369363 >> 172.21.15.53:0/2634369363 conn(0x563fff298740 msgr2=0x563fff648670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.487+0000 7f45a4f8e740 1 -- 172.21.15.53:0/2634369363 shutdown_connections 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.487+0000 7f45a4f8e740 1 -- 172.21.15.53:0/2634369363 wait complete. 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.487+0000 7f45a4f8e740 1 -- start start 2024-08-31T06:27:34.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f45a4f8e740 1 Processor -- start 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff27b490 0x563fff65a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff283670 0x563fff65a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff2a4350 0x563fff666590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563fff412890 con 0x563fff27b490 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563fff536790 con 0x563fff283670 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563fff65d260 con 0x563fff2a4350 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f45a4f8e740 10 client.0 _ll_register_callbacks cb 0x563fff2bbba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f4597fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff27b490 0x563fff65a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f4597fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff27b490 0x563fff65a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41566/0 (socket says 172.21.15.53:41566) 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f4597fff640 1 -- 172.21.15.53:0/3719151635 learned_addr learned my addr 172.21.15.53:0/3719151635 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f45977fe640 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff283670 0x563fff65a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.488+0000 7f459cfb6640 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff2a4350 0x563fff666590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f4597fff640 1 -- 172.21.15.53:0/3719151635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff2a4350 msgr2=0x563fff666590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f4597fff640 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff2a4350 0x563fff666590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f4597fff640 1 -- 172.21.15.53:0/3719151635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff283670 msgr2=0x563fff65a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f4597fff640 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff283670 0x563fff65a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f4597fff640 1 -- 172.21.15.53:0/3719151635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fff56df30 con 0x563fff27b490 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f45977fe640 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff283670 0x563fff65a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f4597fff640 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff27b490 0x563fff65a360 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f45880e2710 tx=0x7f45880a7510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83884e76c58fa437 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f45777fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f45777fe640 1 -- 172.21.15.53:0/3719151635 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588020050 con 0x563fff27b490 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f45777fe640 1 -- 172.21.15.53:0/3719151635 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f45880a7c40 con 0x563fff27b490 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f45a4f8e740 1 -- 172.21.15.53:0/3719151635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f458c040070 con 0x563fff27b490 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f45777fe640 1 -- 172.21.15.53:0/3719151635 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f45880aadc0 con 0x563fff27b490 2024-08-31T06:27:34.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f45a4f8e740 10 client.22413 fetch_fsmap learned FSMap version 80 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.489+0000 7f45a4f8e740 1 -- 172.21.15.53:0/3719151635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) -- 0x563fff6690a0 con 0x563fff27b490 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.490+0000 7f45777fe640 1 -- 172.21.15.53:0/3719151635 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f458c040070 con 0x563fff27b490 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.490+0000 7f45777fe640 1 -- 172.21.15.53:0/3719151635 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 80) ==== 8410+0+0 (secure 0 0 0) 0x7f45880e7110 con 0x563fff27b490 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.490+0000 7f45a4f8e740 10 client.22413 fetch_fsmap finished waiting for FSMap version 80 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.490+0000 7f45a4f8e740 10 client.22413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.490+0000 7f45a4f8e740 20 client.22413 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.490+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fff262cd0 0x563fff66c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.490+0000 7f45a4f8e740 4 client.22413 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.490+0000 7f45a4f8e740 1 -- 172.21.15.53:0/3719151635 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fff5c2540 con 0x563fff262cd0 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.490+0000 7f45977fe640 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fff262cd0 0x563fff66c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.491+0000 7f45777fe640 10 client.22413 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:34.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.491+0000 7f45977fe640 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fff262cd0 0x563fff66c5a0 crc :-1 s=READY pgs=532 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcf4b9f9d9ec85df server_cookie=41bbe95b28bc4f54 in_seq=0 out_seq=0 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45777fe640 1 -- 172.21.15.53:0/3719151635 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563fff5c2540 con 0x563fff262cd0 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45777fe640 10 client.22413 handle_command_reply: tid=0 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 1 client.22413 shutdown 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 1 -- 172.21.15.53:0/3719151635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff27b490 msgr2=0x563fff65a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff27b490 0x563fff65a360 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f45880e2710 tx=0x7f45880a7510 comp rx=0 tx=0).stop 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 1 -- 172.21.15.53:0/3719151635 shutdown_connections 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fff262cd0 0x563fff66c5a0 crc :-1 s=READY pgs=532 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff2a4350 0x563fff666590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff283670 0x563fff65a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/3719151635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff27b490 0x563fff65a360 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 1 -- 172.21.15.53:0/3719151635 >> 172.21.15.53:0/3719151635 conn(0x563fff298740 msgr2=0x563fff646c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:34.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45777fe640 0 client.22413 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:34.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 1 -- 172.21.15.53:0/3719151635 shutdown_connections 2024-08-31T06:27:34.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 1 -- 172.21.15.53:0/3719151635 wait complete. 2024-08-31T06:27:34.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.492+0000 7f45a4f8e740 20 client.22413 trim_cache size 0 max 16384 2024-08-31T06:27:34.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.514+0000 7f45a4f8e740 1 Processor -- start 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.514+0000 7f45a4f8e740 1 -- start start 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.514+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff6486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.514+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff283670 0x563fff666490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.514+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 0x563fff6669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.514+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f45981ad250 con 0x563fff2a4350 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.514+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f45981aefd0 con 0x563fff27b490 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.514+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f45981ad9e0 con 0x563fff283670 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.514+0000 7f459cfb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 0x563fff6669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.514+0000 7f4597fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff6486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.515+0000 7f4597fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff6486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52732/0 (socket says 172.21.15.53:52732) 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.515+0000 7f4597fff640 1 -- 172.21.15.53:0/2458226847 learned_addr learned my addr 172.21.15.53:0/2458226847 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:34.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.515+0000 7f45977fe640 1 --2- 172.21.15.53:0/2458226847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff283670 0x563fff666490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.515+0000 7f4597fff640 1 -- 172.21.15.53:0/2458226847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff283670 msgr2=0x563fff666490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:34.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.515+0000 7f4597fff640 1 --2- 172.21.15.53:0/2458226847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff283670 0x563fff666490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.515+0000 7f4597fff640 1 -- 172.21.15.53:0/2458226847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 msgr2=0x563fff6669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:34.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.515+0000 7f4597fff640 1 --2- 172.21.15.53:0/2458226847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 0x563fff6669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.515+0000 7f4597fff640 1 -- 172.21.15.53:0/2458226847 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fff6592c0 con 0x563fff27b490 2024-08-31T06:27:34.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.515+0000 7f459cfb6640 1 --2- 172.21.15.53:0/2458226847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 0x563fff6669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:34.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.515+0000 7f4597fff640 1 --2- 172.21.15.53:0/2458226847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff6486a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f45880a88c0 tx=0x7f45880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0fa0fa8fe4fbac2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:34.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.516+0000 7f457dffb640 1 -- 172.21.15.53:0/2458226847 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588020070 con 0x563fff27b490 2024-08-31T06:27:34.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.516+0000 7f457dffb640 1 -- 172.21.15.53:0/2458226847 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45880ab160 con 0x563fff27b490 2024-08-31T06:27:34.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.516+0000 7f457dffb640 1 -- 172.21.15.53:0/2458226847 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880050f0 con 0x563fff27b490 2024-08-31T06:27:34.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.517+0000 7f45a4f8e740 1 -- 172.21.15.53:0/2458226847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 msgr2=0x563fff6486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:34.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.517+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/2458226847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff6486a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f45880a88c0 tx=0x7f45880046c0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.517+0000 7f45a4f8e740 1 -- 172.21.15.53:0/2458226847 shutdown_connections 2024-08-31T06:27:34.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.517+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/2458226847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 0x563fff6669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.517+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/2458226847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff283670 0x563fff666490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.517+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/2458226847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff6486a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.517+0000 7f45a4f8e740 1 -- 172.21.15.53:0/2458226847 >> 172.21.15.53:0/2458226847 conn(0x563fff298740 msgr2=0x563fff647f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:34.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.517+0000 7f45a4f8e740 1 -- 172.21.15.53:0/2458226847 shutdown_connections 2024-08-31T06:27:34.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.517+0000 7f45a4f8e740 1 -- 172.21.15.53:0/2458226847 wait complete. 2024-08-31T06:27:34.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.517+0000 7f45a4f8e740 1 -- start start 2024-08-31T06:27:34.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.517+0000 7f45a4f8e740 1 Processor -- start 2024-08-31T06:27:34.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff65eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff283670 0x563fff65f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f45a4f8e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 0x563fff6d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f45981ae8a0 con 0x563fff2a4350 2024-08-31T06:27:34.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f45981ae170 con 0x563fff27b490 2024-08-31T06:27:34.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f45a4f8e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f45981ab250 con 0x563fff283670 2024-08-31T06:27:34.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f45a4f8e740 10 client.0 _ll_register_callbacks cb 0x7f4588009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:34.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f459cfb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 0x563fff6d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f4597fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff65eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f459cfb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 0x563fff6d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41584/0 (socket says 172.21.15.53:41584) 2024-08-31T06:27:34.522 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:34.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f459cfb6640 1 -- 172.21.15.53:0/466237225 learned_addr learned my addr 172.21.15.53:0/466237225 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:34.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f45977fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff283670 0x563fff65f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f4597fff640 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff65eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52740/0 (socket says 172.21.15.53:52740) 2024-08-31T06:27:34.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f4597fff640 1 -- 172.21.15.53:0/466237225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff283670 msgr2=0x563fff65f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:34.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f4597fff640 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff283670 0x563fff65f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f4597fff640 1 -- 172.21.15.53:0/466237225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 msgr2=0x563fff6d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:34.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f4597fff640 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 0x563fff6d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f4597fff640 1 -- 172.21.15.53:0/466237225 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fff6d06c0 con 0x563fff27b490 2024-08-31T06:27:34.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.518+0000 7f45977fe640 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff283670 0x563fff65f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:34.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.519+0000 7f4597fff640 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff65eeb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f458800d740 tx=0x7f4588004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a1099020719a38f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:34.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.519+0000 7f45777fe640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.519+0000 7f45777fe640 1 -- 172.21.15.53:0/466237225 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588020070 con 0x563fff27b490 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.519+0000 7f45777fe640 1 -- 172.21.15.53:0/466237225 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f45880aaac0 con 0x563fff27b490 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.519+0000 7f45a4f8e740 1 -- 172.21.15.53:0/466237225 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45880ab160 con 0x563fff27b490 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.519+0000 7f45777fe640 1 -- 172.21.15.53:0/466237225 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f45880b4970 con 0x563fff27b490 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.519+0000 7f45a4f8e740 10 client.31067 fetch_fsmap learned FSMap version 80 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.519+0000 7f45a4f8e740 1 -- 172.21.15.53:0/466237225 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) -- 0x563fff6d7a40 con 0x563fff27b490 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.519+0000 7f45777fe640 1 -- 172.21.15.53:0/466237225 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45880ab160 con 0x563fff27b490 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.520+0000 7f45777fe640 1 -- 172.21.15.53:0/466237225 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 80) ==== 8410+0+0 (secure 0 0 0) 0x7f458805b1b0 con 0x563fff27b490 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.520+0000 7f45a4f8e740 10 client.31067 fetch_fsmap finished waiting for FSMap version 80 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.520+0000 7f45a4f8e740 10 client.31067 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.520+0000 7f45a4f8e740 20 client.31067 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.520+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fff238080 0x563fff6d9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:34.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.520+0000 7f45a4f8e740 4 client.31067 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:27:34.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.520+0000 7f45a4f8e740 1 -- 172.21.15.53:0/466237225 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563fff5bdfe0 con 0x563fff238080 2024-08-31T06:27:34.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.520+0000 7f45977fe640 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fff238080 0x563fff6d9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:34.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.520+0000 7f45777fe640 10 client.31067 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:34.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.520+0000 7f45977fe640 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fff238080 0x563fff6d9f20 crc :-1 s=READY pgs=533 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4357a871528c5fe server_cookie=9c398e419c7150df in_seq=0 out_seq=0 2024-08-31T06:27:34.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45777fe640 1 -- 172.21.15.53:0/466237225 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563fff5bdfe0 con 0x563fff238080 2024-08-31T06:27:34.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45777fe640 10 client.31067 handle_command_reply: tid=0 2024-08-31T06:27:34.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45a4f8e740 1 client.31067 shutdown 2024-08-31T06:27:34.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45a4f8e740 1 -- 172.21.15.53:0/466237225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 msgr2=0x563fff65eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:34.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff65eeb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f458800d740 tx=0x7f4588004730 comp rx=0 tx=0).stop 2024-08-31T06:27:34.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45a4f8e740 1 -- 172.21.15.53:0/466237225 shutdown_connections 2024-08-31T06:27:34.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x563fff238080 0x563fff6d9f20 crc :-1 s=READY pgs=533 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563fff2a4350 0x563fff6d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45777fe640 0 client.31067 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:34.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563fff283670 0x563fff65f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45a4f8e740 1 --2- 172.21.15.53:0/466237225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563fff27b490 0x563fff65eeb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45a4f8e740 1 -- 172.21.15.53:0/466237225 >> 172.21.15.53:0/466237225 conn(0x563fff298740 msgr2=0x563fff64f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:34.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.522+0000 7f45a4f8e740 1 -- 172.21.15.53:0/466237225 shutdown_connections 2024-08-31T06:27:34.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f45a4f8e740 1 -- 172.21.15.53:0/466237225 wait complete. 2024-08-31T06:27:34.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f45a4f8e740 20 client.31067 trim_cache size 0 max 16384 2024-08-31T06:27:34.528 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:27:34.528 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:27:34.528 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "cac6d546-f1c8-4203-803b-7c8d84c48507", 2024-08-31T06:27:34.528 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:27:34.528 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:27:34.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f459ea19640 1 -- 172.21.15.53:0/3805379472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45800b4d20 msgr2=0x7f45800b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:34.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f459ea19640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45800b4d20 0x7f45800b7230 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f459806c9c0 tx=0x7f4590009500 comp rx=0 tx=0).stop 2024-08-31T06:27:34.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f459ea19640 1 -- 172.21.15.53:0/3805379472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4598102820 msgr2=0x7f459819af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:34.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f459ea19640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4598102820 0x7f459819af00 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f458800d770 tx=0x7f458800dc30 comp rx=0 tx=0).stop 2024-08-31T06:27:34.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f459ea19640 1 -- 172.21.15.53:0/3805379472 shutdown_connections 2024-08-31T06:27:34.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f459ea19640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f45800b4d20 0x7f45800b7230 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f459ea19640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4598108ab0 0x7f459819b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f459ea19640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4598108160 0x7f459819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f459ea19640 1 --2- 172.21.15.53:0/3805379472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4598102820 0x7f459819af00 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:34.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.523+0000 7f459ea19640 1 -- 172.21.15.53:0/3805379472 >> 172.21.15.53:0/3805379472 conn(0x7f45980794e0 msgr2=0x7f45981050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:34.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.524+0000 7f459ea19640 1 -- 172.21.15.53:0/3805379472 shutdown_connections 2024-08-31T06:27:34.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:34.524+0000 7f459ea19640 1 -- 172.21.15.53:0/3805379472 wait complete. 2024-08-31T06:27:34.628 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:34 smithi130 ceph-mon[22266]: pgmap v1035: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-31T06:27:34.628 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:27:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:27:34.623+0000 7f2f9e70b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000225 [...28,head] /volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM/ auth{1=1,2=1,3=1,4=1} v53786 ap=3 f(v3874 m2024-08-31T06:26:36.440391+0000 3=3+0) n(v57 rc2024-08-31T06:26:36.440391+0000 b780288 4=3+1) old_inodes=6 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:4390 nref=3)) caps={15441=pAsLsXsFs/-@50264} | dirtyscattered=0 request=1 lock=2 importing=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5613e69bc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000225:[<0x10000000009/PM v1172>,<0x10000000008/~dmtmp v52>,<0x10000000007/client0 v34>,<0x10000000006/clients v14>,<0x10000000005/tmp v14>,<0x10000000003/client.0 v16>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v32>,<0x10000000001/sv_0 v55>,<0x10000000000/qa v43>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000225:[<0x10000000009/PM v53786>,<0x10000000008/~dmtmp v31303>,<0x10000000007/client0 v3209>,<0x10000000006/clients v2869>,<0x10000000005/tmp v2007>,<0x10000000003/client.0 v1968>,<0x10000000002/74239040-7d9a-4899-9df1-7e6cb2c8232f v1942>,<0x10000000001/sv_0 v1935>,<0x10000000000/qa v1912>,<0x1/volumes v1835>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-31T06:26:35.248267+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-08-31T06:26:36.440391+0000 b780288 4=3+1)","memory_value.dirstat":"f(v3874 m2024-08-31T06:26:36.440391+0000 3=3+0)","memory_value.rstat":"n(v57 rc2024-08-31T06:26:36.440391+0000 b780288 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-31T06:27:34.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:34 smithi153 ceph-mon[22320]: pgmap v1035: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-31T06:27:35.392 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55716 5.06 MB/sec execute 443 sec latency 35104.374 ms 2024-08-31T06:27:35.480 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:27:35.633 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:35 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:27:35.633 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:35 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.633 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:35 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:27:35.633 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:35 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:27:35.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:35 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:27:35.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:35 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:27:35.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:35 smithi053 ceph-mon[18924]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:27:35.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:35 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:35 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.634 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:35 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:35 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:27:35.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:35 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:35 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:27:35.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:35 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:27:35.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:35 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:27:35.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:35 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:27:35.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:35 smithi153 ceph-mon[22320]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:27:35.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:35 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:35 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:35 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.730+0000 7f64a65e6640 1 -- 172.21.15.53:0/2465928322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64a0102800 msgr2=0x7f64a0102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:35.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.730+0000 7f64a65e6640 1 --2- 172.21.15.53:0/2465928322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64a0102800 0x7f64a0102c10 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f6490009900 tx=0x7f649002a410 comp rx=0 tx=0).stop 2024-08-31T06:27:35.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.730+0000 7f64a65e6640 1 -- 172.21.15.53:0/2465928322 shutdown_connections 2024-08-31T06:27:35.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.730+0000 7f64a65e6640 1 --2- 172.21.15.53:0/2465928322 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a0108a90 0x7f64a010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.730+0000 7f64a65e6640 1 --2- 172.21.15.53:0/2465928322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64a0108140 0x7f64a0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.730+0000 7f64a65e6640 1 --2- 172.21.15.53:0/2465928322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64a0102800 0x7f64a0102c10 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.730+0000 7f64a65e6640 1 -- 172.21.15.53:0/2465928322 >> 172.21.15.53:0/2465928322 conn(0x7f64a00794d0 msgr2=0x7f64a00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:35.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.730+0000 7f64a65e6640 1 -- 172.21.15.53:0/2465928322 shutdown_connections 2024-08-31T06:27:35.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.730+0000 7f64a65e6640 1 -- 172.21.15.53:0/2465928322 wait complete. 2024-08-31T06:27:35.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f64a65e6640 1 Processor -- start 2024-08-31T06:27:35.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f64a65e6640 1 -- start start 2024-08-31T06:27:35.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f64a65e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64a0102800 0x7f64a019af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f64a65e6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a0108140 0x7f64a019b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f64a65e6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64a0108a90 0x7f64a019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f64a65e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01125c0 con 0x7f64a0102800 2024-08-31T06:27:35.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f64a65e6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64a0112440 con 0x7f64a0108140 2024-08-31T06:27:35.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f64a65e6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64a0112740 con 0x7f64a0108a90 2024-08-31T06:27:35.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f649ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64a0102800 0x7f64a019af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f649ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64a0102800 0x7f64a019af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41606/0 (socket says 172.21.15.53:41606) 2024-08-31T06:27:35.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f649ffff640 1 -- 172.21.15.53:0/1976947269 learned_addr learned my addr 172.21.15.53:0/1976947269 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:35.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f64a4b83640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64a0108a90 0x7f64a019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.731+0000 7f649f7fe640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a0108140 0x7f64a019b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f649ffff640 1 -- 172.21.15.53:0/1976947269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64a0108a90 msgr2=0x7f64a019b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:35.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f649ffff640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64a0108a90 0x7f64a019b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f649ffff640 1 -- 172.21.15.53:0/1976947269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a0108140 msgr2=0x7f64a019b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:35.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f649ffff640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a0108140 0x7f64a019b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f649ffff640 1 -- 172.21.15.53:0/1976947269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a01a61d0 con 0x7f64a0102800 2024-08-31T06:27:35.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f649f7fe640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a0108140 0x7f64a019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:27:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f64a4b83640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64a0108a90 0x7f64a019b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f649ffff640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64a0102800 0x7f64a019af10 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f6490009230 tx=0x7f64900319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f649d7fa640 1 -- 172.21.15.53:0/1976947269 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649003f030 con 0x7f64a0102800 2024-08-31T06:27:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f64a65e6640 1 -- 172.21.15.53:0/1976947269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a01a6460 con 0x7f64a0102800 2024-08-31T06:27:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f649d7fa640 1 -- 172.21.15.53:0/1976947269 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64900043d0 con 0x7f64a0102800 2024-08-31T06:27:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f649d7fa640 1 -- 172.21.15.53:0/1976947269 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490035070 con 0x7f64a0102800 2024-08-31T06:27:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.732+0000 7f64a65e6640 1 -- 172.21.15.53:0/1976947269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a01a6940 con 0x7f64a0102800 2024-08-31T06:27:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f64acb5b740 1 Processor -- start 2024-08-31T06:27:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f64acb5b740 1 -- start start 2024-08-31T06:27:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f649d7fa640 1 -- 172.21.15.53:0/1976947269 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6490042030 con 0x7f64a0102800 2024-08-31T06:27:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2222ae520 0x55d222653c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d222285660 0x55d2226541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222654700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f64acb5b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d2225caa70 con 0x55d2222ae520 2024-08-31T06:27:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f64acb5b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d2225ba000 con 0x55d22228d840 2024-08-31T06:27:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f64acb5b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d2225bdfb0 con 0x55d222285660 2024-08-31T06:27:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f64a4b83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2222ae520 0x55d222653c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f64a4b83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2222ae520 0x55d222653c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41610/0 (socket says 172.21.15.53:41610) 2024-08-31T06:27:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f64a4b83640 1 -- 172.21.15.53:0/3340302115 learned_addr learned my addr 172.21.15.53:0/3340302115 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f649f7fe640 1 --2- 172.21.15.53:0/3340302115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222654700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.735+0000 7f649ffff640 1 --2- 172.21.15.53:0/3340302115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d222285660 0x55d2226541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f64a4b83640 1 -- 172.21.15.53:0/3340302115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d222285660 msgr2=0x55d2226541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f64a4b83640 1 --2- 172.21.15.53:0/3340302115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d222285660 0x55d2226541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f64a4b83640 1 -- 172.21.15.53:0/3340302115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 msgr2=0x55d222654700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f64a4b83640 1 --2- 172.21.15.53:0/3340302115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222654700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f64a4b83640 1 -- 172.21.15.53:0/3340302115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d222319b00 con 0x55d2222ae520 2024-08-31T06:27:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f649ffff640 1 --2- 172.21.15.53:0/3340302115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d222285660 0x55d2226541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:27:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f649d7fa640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64880b4ca0 0x7f64880b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f64a4b83640 1 --2- 172.21.15.53:0/3340302115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2222ae520 0x55d222653c80 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f6498009fd0 tx=0x7f64980108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f898a44678336103 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f649d7fa640 1 -- 172.21.15.53:0/1976947269 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f6490105a90 con 0x7f64a0102800 2024-08-31T06:27:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f649ffff640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64880b4ca0 0x7f64880b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f64867fc640 1 -- 172.21.15.53:0/3340302115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498011760 con 0x55d2222ae520 2024-08-31T06:27:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f64867fc640 1 -- 172.21.15.53:0/3340302115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6498011d90 con 0x55d2222ae520 2024-08-31T06:27:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.736+0000 7f64867fc640 1 -- 172.21.15.53:0/3340302115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649801be50 con 0x55d2222ae520 2024-08-31T06:27:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.737+0000 7f64acb5b740 1 -- 172.21.15.53:0/3340302115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2222ae520 msgr2=0x55d222653c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.737+0000 7f649ffff640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64880b4ca0 0x7f64880b71b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6490103270 tx=0x7f6490009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.737+0000 7f64acb5b740 1 --2- 172.21.15.53:0/3340302115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2222ae520 0x55d222653c80 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f6498009fd0 tx=0x7f64980108e0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.737+0000 7f64acb5b740 1 -- 172.21.15.53:0/3340302115 shutdown_connections 2024-08-31T06:27:35.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.737+0000 7f64acb5b740 1 --2- 172.21.15.53:0/3340302115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222654700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.737+0000 7f64acb5b740 1 --2- 172.21.15.53:0/3340302115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d222285660 0x55d2226541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.737+0000 7f64acb5b740 1 --2- 172.21.15.53:0/3340302115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2222ae520 0x55d222653c80 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.737+0000 7f64acb5b740 1 -- 172.21.15.53:0/3340302115 >> 172.21.15.53:0/3340302115 conn(0x55d2222a2910 msgr2=0x55d222651b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.737+0000 7f64acb5b740 1 -- 172.21.15.53:0/3340302115 shutdown_connections 2024-08-31T06:27:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.737+0000 7f64acb5b740 1 -- 172.21.15.53:0/3340302115 wait complete. 2024-08-31T06:27:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.737+0000 7f64acb5b740 1 -- start start 2024-08-31T06:27:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f64acb5b740 1 Processor -- start 2024-08-31T06:27:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d22265f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d22265fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 0x55d22266b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f64acb5b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d222662460 con 0x55d222285660 2024-08-31T06:27:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f64acb5b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d22257b520 con 0x55d22228d840 2024-08-31T06:27:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f64acb5b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d2226625e0 con 0x55d2222ae520 2024-08-31T06:27:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f64acb5b740 10 client.0 _ll_register_callbacks cb 0x55d2225b3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f64a4b83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d22265f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f64a4b83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d22265f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41620/0 (socket says 172.21.15.53:41620) 2024-08-31T06:27:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f64a4b83640 1 -- 172.21.15.53:0/1645105764 learned_addr learned my addr 172.21.15.53:0/1645105764 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.738+0000 7f649f7fe640 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d22265fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f64a4b83640 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 0x55d22266b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f64a4b83640 1 -- 172.21.15.53:0/1645105764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 msgr2=0x55d22266b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f64a4b83640 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 0x55d22266b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f64a4b83640 1 -- 172.21.15.53:0/1645105764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 msgr2=0x55d22265fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f64a4b83640 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d22265fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f64a4b83640 1 -- 172.21.15.53:0/1645105764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d222390960 con 0x55d222285660 2024-08-31T06:27:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f64a4b83640 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d22265f8a0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f64980092f0 tx=0x7f6498005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135fc7609cb658eb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:35.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f647f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:35.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f647f7fe640 1 -- 172.21.15.53:0/1645105764 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498011760 con 0x55d222285660 2024-08-31T06:27:35.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f647f7fe640 1 -- 172.21.15.53:0/1645105764 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f6498011900 con 0x55d222285660 2024-08-31T06:27:35.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f64acb5b740 1 -- 172.21.15.53:0/1645105764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d2225599a0 con 0x55d222285660 2024-08-31T06:27:35.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f647f7fe640 1 -- 172.21.15.53:0/1645105764 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f6498011b00 con 0x55d222285660 2024-08-31T06:27:35.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f64acb5b740 10 client.22431 fetch_fsmap learned FSMap version 80 2024-08-31T06:27:35.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f64acb5b740 1 -- 172.21.15.53:0/1645105764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) -- 0x55d22266e5e0 con 0x55d222285660 2024-08-31T06:27:35.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.739+0000 7f647f7fe640 1 -- 172.21.15.53:0/1645105764 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d2225599a0 con 0x55d222285660 2024-08-31T06:27:35.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.740+0000 7f647f7fe640 1 -- 172.21.15.53:0/1645105764 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 80) ==== 8410+0+0 (secure 0 0 0) 0x7f6498029020 con 0x55d222285660 2024-08-31T06:27:35.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.740+0000 7f64acb5b740 10 client.22431 fetch_fsmap finished waiting for FSMap version 80 2024-08-31T06:27:35.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.740+0000 7f64acb5b740 10 client.22431 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:27:35.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.740+0000 7f64acb5b740 20 client.22431 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:35.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.740+0000 7f64acb5b740 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d22226cea0 0x55d222671940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.740+0000 7f64acb5b740 4 client.22431 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:35.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.740+0000 7f64acb5b740 1 -- 172.21.15.53:0/1645105764 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2225cc9c0 con 0x55d22226cea0 2024-08-31T06:27:35.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.740+0000 7f649f7fe640 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d22226cea0 0x55d222671940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.740+0000 7f647f7fe640 10 client.22431 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:35.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.740+0000 7f649f7fe640 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d22226cea0 0x55d222671940 crc :-1 s=READY pgs=534 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=463fe318ffaebee2 server_cookie=fe76af5a4a0dd6d0 in_seq=0 out_seq=0 2024-08-31T06:27:35.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.741+0000 7f647f7fe640 1 -- 172.21.15.53:0/1645105764 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2225cc9c0 con 0x55d22226cea0 2024-08-31T06:27:35.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.741+0000 7f647f7fe640 10 client.22431 handle_command_reply: tid=0 2024-08-31T06:27:35.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.741+0000 7f64acb5b740 1 client.22431 shutdown 2024-08-31T06:27:35.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.741+0000 7f64acb5b740 1 -- 172.21.15.53:0/1645105764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 msgr2=0x55d22265f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:35.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.741+0000 7f64acb5b740 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d22265f8a0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f64980092f0 tx=0x7f6498005c60 comp rx=0 tx=0).stop 2024-08-31T06:27:35.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.742+0000 7f64acb5b740 1 -- 172.21.15.53:0/1645105764 shutdown_connections 2024-08-31T06:27:35.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.742+0000 7f64acb5b740 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d22226cea0 0x55d222671940 crc :-1 s=READY pgs=534 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.742+0000 7f64acb5b740 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 0x55d22266b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.742+0000 7f64acb5b740 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d22265fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.742+0000 7f64acb5b740 1 --2- 172.21.15.53:0/1645105764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d22265f8a0 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.742+0000 7f64acb5b740 1 -- 172.21.15.53:0/1645105764 >> 172.21.15.53:0/1645105764 conn(0x55d2222a2910 msgr2=0x55d222656e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:35.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.742+0000 7f647f7fe640 0 client.22431 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:35.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.742+0000 7f64acb5b740 1 -- 172.21.15.53:0/1645105764 shutdown_connections 2024-08-31T06:27:35.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.742+0000 7f64acb5b740 1 -- 172.21.15.53:0/1645105764 wait complete. 2024-08-31T06:27:35.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.742+0000 7f64acb5b740 20 client.22431 trim_cache size 0 max 16384 2024-08-31T06:27:35.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.760+0000 7f64acb5b740 1 Processor -- start 2024-08-31T06:27:35.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.760+0000 7f64acb5b740 1 -- start start 2024-08-31T06:27:35.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.760+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226612d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.760+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222658f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.760+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 0x55d222659440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.760+0000 7f64acb5b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01af4f0 con 0x55d222285660 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.760+0000 7f64acb5b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01b1270 con 0x55d22228d840 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.760+0000 7f64acb5b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01afc80 con 0x55d2222ae520 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.761+0000 7f64a4b83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.761+0000 7f64a4b83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226612d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41624/0 (socket says 172.21.15.53:41624) 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.761+0000 7f64a4b83640 1 -- 172.21.15.53:0/1208795012 learned_addr learned my addr 172.21.15.53:0/1208795012 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.761+0000 7f649f7fe640 1 --2- 172.21.15.53:0/1208795012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222658f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.761+0000 7f64a4b83640 1 --2- 172.21.15.53:0/1208795012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 0x55d222659440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.761+0000 7f64a4b83640 1 -- 172.21.15.53:0/1208795012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 msgr2=0x55d222659440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.761+0000 7f64a4b83640 1 --2- 172.21.15.53:0/1208795012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 0x55d222659440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.761+0000 7f64a4b83640 1 -- 172.21.15.53:0/1208795012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 msgr2=0x55d222658f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.761+0000 7f64a4b83640 1 --2- 172.21.15.53:0/1208795012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222658f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.761+0000 7f64a4b83640 1 -- 172.21.15.53:0/1208795012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d222661fd0 con 0x55d222285660 2024-08-31T06:27:35.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.761+0000 7f64a4b83640 1 --2- 172.21.15.53:0/1208795012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226612d0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f64980092c0 tx=0x7f6498009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f205afe4deb4d1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.762+0000 7f6485ffb640 1 -- 172.21.15.53:0/1208795012 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498011560 con 0x55d222285660 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.762+0000 7f6485ffb640 1 -- 172.21.15.53:0/1208795012 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6498020030 con 0x55d222285660 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.762+0000 7f6485ffb640 1 -- 172.21.15.53:0/1208795012 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649801b800 con 0x55d222285660 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.762+0000 7f64acb5b740 1 -- 172.21.15.53:0/1208795012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 msgr2=0x55d2226612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.762+0000 7f64acb5b740 1 --2- 172.21.15.53:0/1208795012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226612d0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f64980092c0 tx=0x7f6498009500 comp rx=0 tx=0).stop 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.763+0000 7f64acb5b740 1 -- 172.21.15.53:0/1208795012 shutdown_connections 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.763+0000 7f64acb5b740 1 --2- 172.21.15.53:0/1208795012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 0x55d222659440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.763+0000 7f64acb5b740 1 --2- 172.21.15.53:0/1208795012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222658f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.763+0000 7f64acb5b740 1 --2- 172.21.15.53:0/1208795012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226612d0 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.763+0000 7f64acb5b740 1 -- 172.21.15.53:0/1208795012 >> 172.21.15.53:0/1208795012 conn(0x55d2222a2910 msgr2=0x55d222660bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.763+0000 7f64acb5b740 1 -- 172.21.15.53:0/1208795012 shutdown_connections 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.763+0000 7f64acb5b740 1 -- 172.21.15.53:0/1208795012 wait complete. 2024-08-31T06:27:35.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.763+0000 7f64acb5b740 1 -- start start 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.763+0000 7f64acb5b740 1 Processor -- start 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222671760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64acb5b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 0x55d2226df4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64acb5b740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01b0b40 con 0x55d222285660 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64acb5b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01b0410 con 0x55d22228d840 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64acb5b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01ad4f0 con 0x55d2222ae520 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64acb5b740 10 client.0 _ll_register_callbacks cb 0x7f6498009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64a4b83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64a4b83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41630/0 (socket says 172.21.15.53:41630) 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64a4b83640 1 -- 172.21.15.53:0/4175237605 learned_addr learned my addr 172.21.15.53:0/4175237605 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:35.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f649f7fe640 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222671760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64a4b83640 1 -- 172.21.15.53:0/4175237605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 msgr2=0x55d2226df4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64a4b83640 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 0x55d2226df4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64a4b83640 1 -- 172.21.15.53:0/4175237605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 msgr2=0x55d222671760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64a4b83640 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222671760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64a4b83640 1 -- 172.21.15.53:0/4175237605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2226dfb30 con 0x55d222285660 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f64a4b83640 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226711a0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f64980092f0 tx=0x7f6498034770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80941fe9f728056d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.764+0000 7f647f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.765+0000 7f647f7fe640 1 -- 172.21.15.53:0/4175237605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64980348a0 con 0x55d222285660 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.765+0000 7f647f7fe640 1 -- 172.21.15.53:0/4175237605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f6498034a40 con 0x55d222285660 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.765+0000 7f64acb5b740 1 -- 172.21.15.53:0/4175237605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6498020030 con 0x55d222285660 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.765+0000 7f647f7fe640 1 -- 172.21.15.53:0/4175237605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f6498034c40 con 0x55d222285660 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.765+0000 7f64acb5b740 10 client.22437 fetch_fsmap learned FSMap version 80 2024-08-31T06:27:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.765+0000 7f64acb5b740 1 -- 172.21.15.53:0/4175237605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) -- 0x55d2226e0dd0 con 0x55d222285660 2024-08-31T06:27:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.765+0000 7f647f7fe640 1 -- 172.21.15.53:0/4175237605 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6498020030 con 0x55d222285660 2024-08-31T06:27:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.766+0000 7f647f7fe640 1 -- 172.21.15.53:0/4175237605 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 80) ==== 8410+0+0 (secure 0 0 0) 0x7f6498029050 con 0x55d222285660 2024-08-31T06:27:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.766+0000 7f64acb5b740 10 client.22437 fetch_fsmap finished waiting for FSMap version 80 2024-08-31T06:27:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.766+0000 7f64acb5b740 10 client.22437 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:27:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.766+0000 7f64acb5b740 20 client.22437 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.766+0000 7f64acb5b740 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d222242250 0x55d2226e3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.766+0000 7f64acb5b740 4 client.22437 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e3c07659", "release": true, "await": true}] 2024-08-31T06:27:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.766+0000 7f64acb5b740 1 -- 172.21.15.53:0/4175237605 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e3c07659", "release": true, "await": true}) -- 0x55d2225c8460 con 0x55d222242250 2024-08-31T06:27:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.766+0000 7f649f7fe640 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d222242250 0x55d2226e3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.767+0000 7f647f7fe640 10 client.22437 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.767+0000 7f649f7fe640 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d222242250 0x55d2226e3480 crc :-1 s=READY pgs=535 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1c3c8db9263257b server_cookie=ce5551304d38ada8 in_seq=0 out_seq=0 2024-08-31T06:27:35.817 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:27:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:35 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:27:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:35 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:35 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:27:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:35 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:27:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:35 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:27:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:35 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:27:35.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:35 smithi130 ceph-mon[22266]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/PM) see mds.b log and `damage ls` output for details 2024-08-31T06:27:35.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:35 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:35 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.879 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:35 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f647f7fe640 1 -- 172.21.15.53:0/4175237605 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d2225c8460 con 0x55d222242250 2024-08-31T06:27:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f647f7fe640 10 client.22437 handle_command_reply: tid=0 2024-08-31T06:27:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f64acb5b740 1 client.22437 shutdown 2024-08-31T06:27:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f64acb5b740 1 -- 172.21.15.53:0/4175237605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 msgr2=0x55d2226711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f64acb5b740 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226711a0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f64980092f0 tx=0x7f6498034770 comp rx=0 tx=0).stop 2024-08-31T06:27:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f64acb5b740 1 -- 172.21.15.53:0/4175237605 shutdown_connections 2024-08-31T06:27:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f64acb5b740 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55d222242250 0x55d2226e3480 crc :-1 s=READY pgs=535 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f64acb5b740 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d2222ae520 0x55d2226df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f64acb5b740 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d22228d840 0x55d222671760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f64acb5b740 1 --2- 172.21.15.53:0/4175237605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d222285660 0x55d2226711a0 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f647f7fe640 0 client.22437 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f64acb5b740 1 -- 172.21.15.53:0/4175237605 >> 172.21.15.53:0/4175237605 conn(0x55d2222a2910 msgr2=0x55d222657740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:35.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.909+0000 7f64acb5b740 1 -- 172.21.15.53:0/4175237605 shutdown_connections 2024-08-31T06:27:35.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.910+0000 7f64acb5b740 1 -- 172.21.15.53:0/4175237605 wait complete. 2024-08-31T06:27:35.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.910+0000 7f64acb5b740 20 client.22437 trim_cache size 0 max 16384 2024-08-31T06:27:35.913 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:27:35.913 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 80, 2024-08-31T06:27:35.913 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:27:35.913 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 76, 2024-08-31T06:27:35.913 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "e3c07659": { 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 76, 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 150.0, 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:27:35.914 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:27:35.915 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:27:35.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:35.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:35.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:35.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:35.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:35.915 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:27:35.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.910+0000 7f64a65e6640 1 -- 172.21.15.53:0/1976947269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64880b4ca0 msgr2=0x7f64880b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:35.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.910+0000 7f64a65e6640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64880b4ca0 0x7f64880b71b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6490103270 tx=0x7f6490009260 comp rx=0 tx=0).stop 2024-08-31T06:27:35.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.910+0000 7f64a65e6640 1 -- 172.21.15.53:0/1976947269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64a0102800 msgr2=0x7f64a019af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:35.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.910+0000 7f64a65e6640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64a0102800 0x7f64a019af10 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f6490009230 tx=0x7f64900319a0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.911+0000 7f64a65e6640 1 -- 172.21.15.53:0/1976947269 shutdown_connections 2024-08-31T06:27:35.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.911+0000 7f64a65e6640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f64880b4ca0 0x7f64880b71b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.911+0000 7f64a65e6640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64a0108a90 0x7f64a019b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.911+0000 7f64a65e6640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a0108140 0x7f64a019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.911+0000 7f64a65e6640 1 --2- 172.21.15.53:0/1976947269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64a0102800 0x7f64a019af10 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:35.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.911+0000 7f64a65e6640 1 -- 172.21.15.53:0/1976947269 >> 172.21.15.53:0/1976947269 conn(0x7f64a00794d0 msgr2=0x7f64a01012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:35.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.911+0000 7f64a65e6640 1 -- 172.21.15.53:0/1976947269 shutdown_connections 2024-08-31T06:27:35.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:35.911+0000 7f64a65e6640 1 -- 172.21.15.53:0/1976947269 wait complete. 2024-08-31T06:27:36.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55785 5.05 MB/sec execute 444 sec latency 35628.503 ms 2024-08-31T06:27:36.452 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:36 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:27:36.453 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:36 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:36.453 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:36 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:36.453 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:36 smithi053 ceph-mon[18924]: pgmap v1036: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-08-31T06:27:36.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.480+0000 7f6ea7697640 1 -- 172.21.15.53:0/1918433179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea0108140 msgr2=0x7f6ea0108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:36.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.480+0000 7f6ea7697640 1 --2- 172.21.15.53:0/1918433179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea0108140 0x7f6ea0108550 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009900 tx=0x7f6e9002a410 comp rx=0 tx=0).stop 2024-08-31T06:27:36.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.480+0000 7f6ea7697640 1 -- 172.21.15.53:0/1918433179 shutdown_connections 2024-08-31T06:27:36.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.480+0000 7f6ea7697640 1 --2- 172.21.15.53:0/1918433179 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ea0108a90 0x7f6ea010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.480+0000 7f6ea7697640 1 --2- 172.21.15.53:0/1918433179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea0108140 0x7f6ea0108550 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.480+0000 7f6ea7697640 1 --2- 172.21.15.53:0/1918433179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea0102800 0x7f6ea0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.480+0000 7f6ea7697640 1 -- 172.21.15.53:0/1918433179 >> 172.21.15.53:0/1918433179 conn(0x7f6ea00794d0 msgr2=0x7f6ea00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:36.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.480+0000 7f6ea7697640 1 -- 172.21.15.53:0/1918433179 shutdown_connections 2024-08-31T06:27:36.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.480+0000 7f6ea7697640 1 -- 172.21.15.53:0/1918433179 wait complete. 2024-08-31T06:27:36.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.481+0000 7f6ea7697640 1 Processor -- start 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.481+0000 7f6ea7697640 1 -- start start 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.481+0000 7f6ea7697640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ea0102800 0x7f6ea019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea7697640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea0108140 0x7f6ea019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea7697640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea0108a90 0x7f6ea019f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea7697640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea01125c0 con 0x7f6ea0108a90 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea7697640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea0112440 con 0x7f6ea0102800 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea7697640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea0112740 con 0x7f6ea0108140 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea5433640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ea0102800 0x7f6ea019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea4c32640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea0108140 0x7f6ea019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea5433640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ea0102800 0x7f6ea019a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52818/0 (socket says 172.21.15.53:52818) 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea5433640 1 -- 172.21.15.53:0/3734628925 learned_addr learned my addr 172.21.15.53:0/3734628925 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:36.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea5c34640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea0108a90 0x7f6ea019f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea4c32640 1 -- 172.21.15.53:0/3734628925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ea0102800 msgr2=0x7f6ea019a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:36.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea4c32640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ea0102800 0x7f6ea019a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea4c32640 1 -- 172.21.15.53:0/3734628925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea0108a90 msgr2=0x7f6ea019f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:36.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea4c32640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea0108a90 0x7f6ea019f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea4c32640 1 -- 172.21.15.53:0/3734628925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea01a00b0 con 0x7f6ea0108140 2024-08-31T06:27:36.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea5433640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ea0102800 0x7f6ea019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:36.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.482+0000 7f6ea4c32640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea0108140 0x7f6ea019a6e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009230 tx=0x7f6e90003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:36.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.483+0000 7f6e967fc640 1 -- 172.21.15.53:0/3734628925 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9003f070 con 0x7f6ea0108140 2024-08-31T06:27:36.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.483+0000 7f6ea7697640 1 -- 172.21.15.53:0/3734628925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea01a0340 con 0x7f6ea0108140 2024-08-31T06:27:36.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.483+0000 7f6e967fc640 1 -- 172.21.15.53:0/3734628925 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e9003baf0 con 0x7f6ea0108140 2024-08-31T06:27:36.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.483+0000 7f6e967fc640 1 -- 172.21.15.53:0/3734628925 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90035030 con 0x7f6ea0108140 2024-08-31T06:27:36.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.483+0000 7f6ea7697640 1 -- 172.21.15.53:0/3734628925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea00ff2f0 con 0x7f6ea0108140 2024-08-31T06:27:36.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.486+0000 7f6e967fc640 1 -- 172.21.15.53:0/3734628925 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6e90042070 con 0x7f6ea0108140 2024-08-31T06:27:36.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.487+0000 7f6eadc0c740 1 Processor -- start 2024-08-31T06:27:36.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.487+0000 7f6eadc0c740 1 -- start start 2024-08-31T06:27:36.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.487+0000 7f6e967fc640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6e8c0b4d20 0x7f6e8c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.487+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca98070 0x561a5ce3d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 0x561a5ce3d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca77390 0x561a5ce3dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6ea5c34640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6e8c0b4d20 0x7f6e8c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6e967fc640 1 -- 172.21.15.53:0/3734628925 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f6e90105a30 con 0x7f6ea0108140 2024-08-31T06:27:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6ea4c32640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 0x561a5ce3d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6ea4c32640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 0x561a5ce3d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52830/0 (socket says 172.21.15.53:52830) 2024-08-31T06:27:36.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6ea4c32640 1 -- 172.21.15.53:0/1170861911 learned_addr learned my addr 172.21.15.53:0/1170861911 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6ea5433640 1 --2- 172.21.15.53:0/1170861911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca98070 0x561a5ce3d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1170861911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561a5cdb4630 con 0x561a5ca77390 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1170861911 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561a5cda3bc0 con 0x561a5ca6f1b0 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1170861911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a5cda7b70 con 0x561a5ca98070 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6ea5c34640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6e8c0b4d20 0x7f6e8c0b7230 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6e98005fd0 tx=0x7f6e98009b00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.488+0000 7f6ea5c34640 1 --2- 172.21.15.53:0/1170861911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca77390 0x561a5ce3dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.489+0000 7f6ea5433640 1 -- 172.21.15.53:0/1170861911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 msgr2=0x561a5ce3d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.489+0000 7f6ea5433640 1 --2- 172.21.15.53:0/1170861911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 0x561a5ce3d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.489+0000 7f6ea5433640 1 -- 172.21.15.53:0/1170861911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca77390 msgr2=0x561a5ce3dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.489+0000 7f6ea5433640 1 --2- 172.21.15.53:0/1170861911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca77390 0x561a5ce3dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.489+0000 7f6ea5433640 1 -- 172.21.15.53:0/1170861911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a5cb03650 con 0x561a5ca98070 2024-08-31T06:27:36.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.489+0000 7f6ea5433640 1 --2- 172.21.15.53:0/1170861911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca98070 0x561a5ce3d2c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0114f0 tx=0x7f6e9c0119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed694625ff577ea5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:36.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.489+0000 7f6e8b7fe640 1 -- 172.21.15.53:0/1170861911 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c01e070 con 0x561a5ca98070 2024-08-31T06:27:36.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.489+0000 7f6e8b7fe640 1 -- 172.21.15.53:0/1170861911 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e9c0044c0 con 0x561a5ca98070 2024-08-31T06:27:36.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.489+0000 7f6e8b7fe640 1 -- 172.21.15.53:0/1170861911 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c00f820 con 0x561a5ca98070 2024-08-31T06:27:36.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.490+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1170861911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca98070 msgr2=0x561a5ce3d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:36.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.490+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/1170861911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca98070 0x561a5ce3d2c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0114f0 tx=0x7f6e9c0119b0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.490+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1170861911 shutdown_connections 2024-08-31T06:27:36.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.490+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/1170861911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca77390 0x561a5ce3dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.490+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/1170861911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 0x561a5ce3d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.490+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/1170861911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca98070 0x561a5ce3d2c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.490+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1170861911 >> 172.21.15.53:0/1170861911 conn(0x561a5ca8c460 msgr2=0x561a5ce3b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:36.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.490+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1170861911 shutdown_connections 2024-08-31T06:27:36.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.490+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1170861911 wait complete. 2024-08-31T06:27:36.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.491+0000 7f6eadc0c740 1 -- start start 2024-08-31T06:27:36.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.491+0000 7f6eadc0c740 1 Processor -- start 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.491+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca6f1b0 0x561a5ce48a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca77390 0x561a5ce48f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca98070 0x561a5ce54e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6ea5433640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca6f1b0 0x561a5ce48a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6ea5433640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca6f1b0 0x561a5ce48a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41660/0 (socket says 172.21.15.53:41660) 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6ea5433640 1 -- 172.21.15.53:0/1112395950 learned_addr learned my addr 172.21.15.53:0/1112395950 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1112395950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561a5cc06700 con 0x561a5ca6f1b0 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6ea4c32640 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca77390 0x561a5ce48f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1112395950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561a5cd2a700 con 0x561a5ca77390 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6ea5c34640 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca98070 0x561a5ce54e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1112395950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a5ce4bb40 con 0x561a5ca98070 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6eadc0c740 10 client.0 _ll_register_callbacks cb 0x561a5cd59dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6ea5433640 1 -- 172.21.15.53:0/1112395950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca98070 msgr2=0x561a5ce54e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:36.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6ea5433640 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca98070 0x561a5ce54e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6ea5433640 1 -- 172.21.15.53:0/1112395950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca77390 msgr2=0x561a5ce48f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6ea5433640 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca77390 0x561a5ce48f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6ea5433640 1 -- 172.21.15.53:0/1112395950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a5cd638b0 con 0x561a5ca6f1b0 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.492+0000 7f6ea4c32640 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca77390 0x561a5ce48f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.493+0000 7f6ea5433640 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca6f1b0 0x561a5ce48a30 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c005e00 tx=0x7f6e9c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b009b0ddd85bbde server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.493+0000 7f6e88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.493+0000 7f6e88ff9640 1 -- 172.21.15.53:0/1112395950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c01e040 con 0x561a5ca6f1b0 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.493+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1112395950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a5cdb6580 con 0x561a5ca6f1b0 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.493+0000 7f6e88ff9640 1 -- 172.21.15.53:0/1112395950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f6e9c0037e0 con 0x561a5ca6f1b0 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.493+0000 7f6e88ff9640 1 -- 172.21.15.53:0/1112395950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f6e9c02f050 con 0x561a5ca6f1b0 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.493+0000 7f6eadc0c740 10 client.22449 fetch_fsmap learned FSMap version 80 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.493+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1112395950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) -- 0x561a5ce578d0 con 0x561a5ca6f1b0 2024-08-31T06:27:36.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.494+0000 7f6e88ff9640 1 -- 172.21.15.53:0/1112395950 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x561a5cdb6580 con 0x561a5ca6f1b0 2024-08-31T06:27:36.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.494+0000 7f6e88ff9640 1 -- 172.21.15.53:0/1112395950 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 80) ==== 8410+0+0 (secure 0 0 0) 0x7f6e9c02a030 con 0x561a5ca6f1b0 2024-08-31T06:27:36.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.494+0000 7f6eadc0c740 10 client.22449 fetch_fsmap finished waiting for FSMap version 80 2024-08-31T06:27:36.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.494+0000 7f6eadc0c740 10 client.22449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:36.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.494+0000 7f6eadc0c740 20 client.22449 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:36.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.494+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a5ca569f0 0x561a5ce5b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.494+0000 7f6eadc0c740 4 client.22449 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:36.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.494+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1112395950 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a5cdb2020 con 0x561a5ca569f0 2024-08-31T06:27:36.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.494+0000 7f6ea4c32640 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a5ca569f0 0x561a5ce5b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.495+0000 7f6e88ff9640 10 client.22449 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.495+0000 7f6ea4c32640 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a5ca569f0 0x561a5ce5b180 crc :-1 s=READY pgs=536 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=642e2c6e1616d0cd server_cookie=f20859d5bc664443 in_seq=0 out_seq=0 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6e88ff9640 1 -- 172.21.15.53:0/1112395950 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a5cdb2020 con 0x561a5ca569f0 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6e88ff9640 10 client.22449 handle_command_reply: tid=0 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 1 client.22449 shutdown 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1112395950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca6f1b0 msgr2=0x561a5ce48a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca6f1b0 0x561a5ce48a30 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c005e00 tx=0x7f6e9c0035f0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1112395950 shutdown_connections 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a5ca569f0 0x561a5ce5b180 crc :-1 s=READY pgs=536 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca98070 0x561a5ce54e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca77390 0x561a5ce48f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/1112395950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca6f1b0 0x561a5ce48a30 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1112395950 >> 172.21.15.53:0/1112395950 conn(0x561a5ca8c460 msgr2=0x561a5ce404a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6e88ff9640 0 client.22449 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:36.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1112395950 shutdown_connections 2024-08-31T06:27:36.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 1 -- 172.21.15.53:0/1112395950 wait complete. 2024-08-31T06:27:36.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.496+0000 7f6eadc0c740 20 client.22449 trim_cache size 0 max 16384 2024-08-31T06:27:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.522+0000 7f6eadc0c740 1 Processor -- start 2024-08-31T06:27:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.522+0000 7f6eadc0c740 1 -- start start 2024-08-31T06:27:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.522+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 0x561a5ce54d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.522+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca77390 0x561a5ce3aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.522+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca98070 0x561a5ce3b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.522+0000 7f6eadc0c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea01b1690 con 0x561a5ca98070 2024-08-31T06:27:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.522+0000 7f6eadc0c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea01b3410 con 0x561a5ca6f1b0 2024-08-31T06:27:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.522+0000 7f6eadc0c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea01b1e20 con 0x561a5ca77390 2024-08-31T06:27:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.522+0000 7f6ea5c34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca98070 0x561a5ce3b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.522+0000 7f6ea5c34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca98070 0x561a5ce3b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41674/0 (socket says 172.21.15.53:41674) 2024-08-31T06:27:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.522+0000 7f6ea5c34640 1 -- 172.21.15.53:0/3499808995 learned_addr learned my addr 172.21.15.53:0/3499808995 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:36.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.523+0000 7f6ea5433640 1 --2- 172.21.15.53:0/3499808995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 0x561a5ce54d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.523+0000 7f6ea5c34640 1 -- 172.21.15.53:0/3499808995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca77390 msgr2=0x561a5ce3aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.523+0000 7f6ea5c34640 1 --2- 172.21.15.53:0/3499808995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca77390 0x561a5ce3aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.523+0000 7f6ea5c34640 1 -- 172.21.15.53:0/3499808995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 msgr2=0x561a5ce54d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.523+0000 7f6ea5c34640 1 --2- 172.21.15.53:0/3499808995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 0x561a5ce54d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.523+0000 7f6ea5c34640 1 -- 172.21.15.53:0/3499808995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a5ca56c20 con 0x561a5ca98070 2024-08-31T06:27:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.523+0000 7f6ea5433640 1 --2- 172.21.15.53:0/3499808995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 0x561a5ce54d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.523+0000 7f6ea5c34640 1 --2- 172.21.15.53:0/3499808995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca98070 0x561a5ce3b0e0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800f8f0 tx=0x7f6e98009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b6a62849d63b46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.524+0000 7f6e8affd640 1 -- 172.21.15.53:0/3499808995 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e980120d0 con 0x561a5ca98070 2024-08-31T06:27:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.524+0000 7f6e8affd640 1 -- 172.21.15.53:0/3499808995 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e9802d070 con 0x561a5ca98070 2024-08-31T06:27:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.524+0000 7f6e8affd640 1 -- 172.21.15.53:0/3499808995 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9801e670 con 0x561a5ca98070 2024-08-31T06:27:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.525+0000 7f6eadc0c740 1 -- 172.21.15.53:0/3499808995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca98070 msgr2=0x561a5ce3b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.525+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/3499808995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca98070 0x561a5ce3b0e0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800f8f0 tx=0x7f6e98009f90 comp rx=0 tx=0).stop 2024-08-31T06:27:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.525+0000 7f6eadc0c740 1 -- 172.21.15.53:0/3499808995 shutdown_connections 2024-08-31T06:27:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.525+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/3499808995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca98070 0x561a5ce3b0e0 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.525+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/3499808995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca77390 0x561a5ce3aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.525+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/3499808995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca6f1b0 0x561a5ce54d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.525+0000 7f6eadc0c740 1 -- 172.21.15.53:0/3499808995 >> 172.21.15.53:0/3499808995 conn(0x561a5ca8c460 msgr2=0x561a5ce472b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.526+0000 7f6eadc0c740 1 -- 172.21.15.53:0/3499808995 shutdown_connections 2024-08-31T06:27:36.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.526+0000 7f6eadc0c740 1 -- 172.21.15.53:0/3499808995 wait complete. 2024-08-31T06:27:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.526+0000 7f6eadc0c740 1 -- start start 2024-08-31T06:27:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.527+0000 7f6eadc0c740 1 Processor -- start 2024-08-31T06:27:36.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.527+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca6f1b0 0x561a5ce513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.528+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca77390 0x561a5ce4c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.528+0000 7f6eadc0c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca98070 0x561a5ce4cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.528+0000 7f6ea5433640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca6f1b0 0x561a5ce513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.528+0000 7f6ea5433640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca6f1b0 0x561a5ce513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:45770/0 (socket says 172.21.15.53:45770) 2024-08-31T06:27:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.528+0000 7f6ea5433640 1 -- 172.21.15.53:0/296586070 learned_addr learned my addr 172.21.15.53:0/296586070 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.528+0000 7f6ea5c34640 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca98070 0x561a5ce4cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.528+0000 7f6ea4c32640 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca77390 0x561a5ce4c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.528+0000 7f6eadc0c740 1 -- 172.21.15.53:0/296586070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea01b2ce0 con 0x561a5ca77390 2024-08-31T06:27:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.528+0000 7f6eadc0c740 1 -- 172.21.15.53:0/296586070 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea01b25b0 con 0x561a5ca98070 2024-08-31T06:27:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.528+0000 7f6eadc0c740 1 -- 172.21.15.53:0/296586070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea01af690 con 0x561a5ca6f1b0 2024-08-31T06:27:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.528+0000 7f6eadc0c740 10 client.0 _ll_register_callbacks cb 0x7f6e9c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.529+0000 7f6ea5433640 1 -- 172.21.15.53:0/296586070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca98070 msgr2=0x561a5ce4cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.529+0000 7f6ea5433640 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca98070 0x561a5ce4cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.529+0000 7f6ea5433640 1 -- 172.21.15.53:0/296586070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca77390 msgr2=0x561a5ce4c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.529+0000 7f6ea5433640 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca77390 0x561a5ce4c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.529+0000 7f6ea5433640 1 -- 172.21.15.53:0/296586070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a5ce4d3c0 con 0x561a5ca6f1b0 2024-08-31T06:27:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.529+0000 7f6ea5433640 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca6f1b0 0x561a5ce513e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0097f0 tx=0x7f6e9c00f5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc9347c4608a996 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.529+0000 7f6e88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:27:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.529+0000 7f6e88ff9640 1 -- 172.21.15.53:0/296586070 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c01e070 con 0x561a5ca6f1b0 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.530+0000 7f6e88ff9640 1 -- 172.21.15.53:0/296586070 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f6e9c003860 con 0x561a5ca6f1b0 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.530+0000 7f6eadc0c740 1 -- 172.21.15.53:0/296586070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e9802d070 con 0x561a5ca6f1b0 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.530+0000 7f6e88ff9640 1 -- 172.21.15.53:0/296586070 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f6e9c003a60 con 0x561a5ca6f1b0 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.530+0000 7f6eadc0c740 10 client.31090 fetch_fsmap learned FSMap version 80 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.530+0000 7f6eadc0c740 1 -- 172.21.15.53:0/296586070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) -- 0x561a5cec58b0 con 0x561a5ca6f1b0 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.530+0000 7f6e88ff9640 1 -- 172.21.15.53:0/296586070 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e9802d070 con 0x561a5ca6f1b0 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.530+0000 7f6e88ff9640 1 -- 172.21.15.53:0/296586070 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 80) ==== 8410+0+0 (secure 0 0 0) 0x7f6e9c02a040 con 0x561a5ca6f1b0 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.531+0000 7f6eadc0c740 10 client.31090 fetch_fsmap finished waiting for FSMap version 80 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.531+0000 7f6eadc0c740 10 client.31090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.531+0000 7f6eadc0c740 20 client.31090 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.531+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a5ca2bda0 0x561a5cec7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.531+0000 7f6eadc0c740 4 client.31090 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.531+0000 7f6eadc0c740 1 -- 172.21.15.53:0/296586070 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561a5cdaf760 con 0x561a5ca2bda0 2024-08-31T06:27:36.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.531+0000 7f6ea4c32640 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a5ca2bda0 0x561a5cec7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.531+0000 7f6e88ff9640 10 client.31090 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:36.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.531+0000 7f6ea4c32640 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a5ca2bda0 0x561a5cec7fe0 crc :-1 s=READY pgs=537 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d504d4620c16f552 server_cookie=226f7be3809fe0e2 in_seq=0 out_seq=0 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6e88ff9640 1 -- 172.21.15.53:0/296586070 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8238 (crc 0 0 0) 0x561a5cdaf760 con 0x561a5ca2bda0 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6e88ff9640 10 client.31090 handle_command_reply: tid=0 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6eadc0c740 1 client.31090 shutdown 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6eadc0c740 1 -- 172.21.15.53:0/296586070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca6f1b0 msgr2=0x561a5ce513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca6f1b0 0x561a5ce513e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0097f0 tx=0x7f6e9c00f5c0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6eadc0c740 1 -- 172.21.15.53:0/296586070 shutdown_connections 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x561a5ca2bda0 0x561a5cec7fe0 crc :-1 s=READY pgs=537 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a5ca98070 0x561a5ce4cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a5ca77390 0x561a5ce4c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6eadc0c740 1 --2- 172.21.15.53:0/296586070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a5ca6f1b0 0x561a5ce513e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6eadc0c740 1 -- 172.21.15.53:0/296586070 >> 172.21.15.53:0/296586070 conn(0x561a5ca8c460 msgr2=0x561a5ce3ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:36.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.532+0000 7f6e88ff9640 0 client.31090 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:36.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.533+0000 7f6eadc0c740 1 -- 172.21.15.53:0/296586070 shutdown_connections 2024-08-31T06:27:36.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.533+0000 7f6eadc0c740 1 -- 172.21.15.53:0/296586070 wait complete. 2024-08-31T06:27:36.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.533+0000 7f6eadc0c740 20 client.31090 trim_cache size 0 max 16384 2024-08-31T06:27:36.537 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:27:36.537 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:27:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:27:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: "cac6d546-f1c8-4203-803b-7c8d84c48507": { 2024-08-31T06:27:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "cac6d546-f1c8-4203-803b-7c8d84c48507", 2024-08-31T06:27:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:27:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "cac6d546-f1c8-4203-803b-7c8d84c48507": { 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:27:34.520218+0000", 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:27:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:27:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:27:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:27:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.542 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.542 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.542 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:27:36.542 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:27:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:27:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:25:55.673122+0000", 2024-08-31T06:27:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:27:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:27:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:27:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:27:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "857f8219-039c-44d2-8dd7-af494d80e735": { 2024-08-31T06:27:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:26:48.510100+0000", 2024-08-31T06:27:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:27:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:27:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:27:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:27:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:27:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:27:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:27:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:27:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:27:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:27:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:27:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:27:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:27:36.558 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 -- 172.21.15.53:0/3734628925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6e8c0b4d20 msgr2=0x7f6e8c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6e8c0b4d20 0x7f6e8c0b7230 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6e98005fd0 tx=0x7f6e98009b00 comp rx=0 tx=0).stop 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 -- 172.21.15.53:0/3734628925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea0108140 msgr2=0x7f6ea019a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea0108140 0x7f6ea019a6e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009230 tx=0x7f6e90003b90 comp rx=0 tx=0).stop 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 -- 172.21.15.53:0/3734628925 shutdown_connections 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6e8c0b4d20 0x7f6e8c0b7230 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea0108a90 0x7f6ea019f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea0108140 0x7f6ea019a6e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 --2- 172.21.15.53:0/3734628925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ea0102800 0x7f6ea019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 -- 172.21.15.53:0/3734628925 >> 172.21.15.53:0/3734628925 conn(0x7f6ea00794d0 msgr2=0x7f6ea006afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 -- 172.21.15.53:0/3734628925 shutdown_connections 2024-08-31T06:27:36.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:27:36.534+0000 7f6ea7697640 1 -- 172.21.15.53:0/3734628925 wait complete. 2024-08-31T06:27:36.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:36 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:27:36.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:36 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:36.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:36 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:36.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:36 smithi153 ceph-mon[22320]: pgmap v1036: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-08-31T06:27:36.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:36 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:27:36.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:36 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:36.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:36 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:27:36.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:36 smithi130 ceph-mon[22266]: pgmap v1036: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-08-31T06:27:37.392 INFO:tasks.workunit.client.0.smithi053.stdout: 10 55922 5.05 MB/sec execute 445 sec latency 60.201 ms 2024-08-31T06:27:37.563 INFO:tasks.cephfs.filesystem:scrub status for tag:cac6d546-f1c8-4203-803b-7c8d84c48507 - {'path': '/', 'tag': 'cac6d546-f1c8-4203-803b-7c8d84c48507', 'options': 'recursive,force'} 2024-08-31T06:27:37.897 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e3c07659', total seconds elapsed: 36.8 2024-08-31T06:27:38.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 56070 5.05 MB/sec execute 446 sec latency 55.128 ms 2024-08-31T06:27:38.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:38 smithi153 ceph-mon[22320]: pgmap v1037: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 52 KiB/s wr, 25 op/s 2024-08-31T06:27:38.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:38 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:38.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:38 smithi053 ceph-mon[18924]: pgmap v1037: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 52 KiB/s wr, 25 op/s 2024-08-31T06:27:38.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:38 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:38.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:38 smithi130 ceph-mon[22266]: pgmap v1037: 97 pgs: 97 active+clean; 870 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 52 KiB/s wr, 25 op/s 2024-08-31T06:27:38.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:38 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:39.392 INFO:tasks.workunit.client.0.smithi053.stdout: 10 56253 5.08 MB/sec execute 447 sec latency 66.668 ms 2024-08-31T06:27:39.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.475+0000 7f771069b640 1 -- 172.21.15.53:0/93262716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7708102770 msgr2=0x7f7708102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:39.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.475+0000 7f771069b640 1 --2- 172.21.15.53:0/93262716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7708102770 0x7f7708102b80 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f7704009900 tx=0x7f770402a410 comp rx=0 tx=0).stop 2024-08-31T06:27:39.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.475+0000 7f771069b640 1 -- 172.21.15.53:0/93262716 shutdown_connections 2024-08-31T06:27:39.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.475+0000 7f771069b640 1 --2- 172.21.15.53:0/93262716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77081089f0 0x7f770810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.475+0000 7f771069b640 1 --2- 172.21.15.53:0/93262716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77081080a0 0x7f77081084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.475+0000 7f771069b640 1 --2- 172.21.15.53:0/93262716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7708102770 0x7f7708102b80 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.475+0000 7f771069b640 1 -- 172.21.15.53:0/93262716 >> 172.21.15.53:0/93262716 conn(0x7f770807a490 msgr2=0x7f770807a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:39.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.475+0000 7f771069b640 1 -- 172.21.15.53:0/93262716 shutdown_connections 2024-08-31T06:27:39.478 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.475+0000 7f771069b640 1 -- 172.21.15.53:0/93262716 wait complete. 2024-08-31T06:27:39.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f771069b640 1 Processor -- start 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f771069b640 1 -- start start 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f771069b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7708102770 0x7f770819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f771069b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77081080a0 0x7f770819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f771069b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77081089f0 0x7f770819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f770e437640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7708102770 0x7f770819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f770dc36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77081080a0 0x7f770819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f771069b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7708112550 con 0x7f77081080a0 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f770e437640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7708102770 0x7f770819af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:45778/0 (socket says 172.21.15.53:45778) 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f770e437640 1 -- 172.21.15.53:0/1656817959 learned_addr learned my addr 172.21.15.53:0/1656817959 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f771069b640 1 -- 172.21.15.53:0/1656817959 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f77081123d0 con 0x7f77081089f0 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f771069b640 1 -- 172.21.15.53:0/1656817959 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f77081126d0 con 0x7f7708102770 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.476+0000 7f770ec38640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77081089f0 0x7f770819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.477+0000 7f770dc36640 1 -- 172.21.15.53:0/1656817959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7708102770 msgr2=0x7f770819af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.477+0000 7f770dc36640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7708102770 0x7f770819af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.477+0000 7f770dc36640 1 -- 172.21.15.53:0/1656817959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77081089f0 msgr2=0x7f770819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.477+0000 7f770dc36640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77081089f0 0x7f770819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.477+0000 7f770dc36640 1 -- 172.21.15.53:0/1656817959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77081a61b0 con 0x7f77081080a0 2024-08-31T06:27:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.477+0000 7f770dc36640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77081080a0 0x7f770819b460 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f770806c720 tx=0x7f76f800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.477+0000 7f76ff7fe640 1 -- 172.21.15.53:0/1656817959 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f800cc40 con 0x7f77081080a0 2024-08-31T06:27:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.478+0000 7f76ff7fe640 1 -- 172.21.15.53:0/1656817959 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76f800cde0 con 0x7f77081080a0 2024-08-31T06:27:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.478+0000 7f771069b640 1 -- 172.21.15.53:0/1656817959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77081a64a0 con 0x7f77081080a0 2024-08-31T06:27:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.478+0000 7f76ff7fe640 1 -- 172.21.15.53:0/1656817959 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f80187a0 con 0x7f77081080a0 2024-08-31T06:27:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.478+0000 7f771069b640 1 -- 172.21.15.53:0/1656817959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77081a6a40 con 0x7f77081080a0 2024-08-31T06:27:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.481+0000 7f76ff7fe640 1 -- 172.21.15.53:0/1656817959 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f76f8018940 con 0x7f77081080a0 2024-08-31T06:27:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.481+0000 7f771760d740 1 Processor -- start 2024-08-31T06:27:39.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f771760d740 1 -- start start 2024-08-31T06:27:39.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f771760d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 0x55f43b50cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f771760d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1402f0 0x55f43b50d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.484 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f771760d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b1484d0 0x55f43b50d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f771760d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f43b482000 con 0x55f43b1691b0 2024-08-31T06:27:39.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f771760d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f43b471590 con 0x55f43b1484d0 2024-08-31T06:27:39.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f771760d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f43b475540 con 0x55f43b1402f0 2024-08-31T06:27:39.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f770ec38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 0x55f43b50cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f770e437640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1402f0 0x55f43b50d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f770dc36640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b1484d0 0x55f43b50d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f770e437640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1402f0 0x55f43b50d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:45792/0 (socket says 172.21.15.53:45792) 2024-08-31T06:27:39.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f770ec38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 0x55f43b50cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41720/0 (socket says 172.21.15.53:41720) 2024-08-31T06:27:39.485 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.482+0000 7f770e437640 1 -- 172.21.15.53:0/3706148301 learned_addr learned my addr 172.21.15.53:0/3706148301 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:39.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.483+0000 7f76ff7fe640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76f40b4d20 0x7f76f40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.483+0000 7f770ec38640 1 -- 172.21.15.53:0/3706148301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1402f0 msgr2=0x55f43b50d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.483+0000 7f770ec38640 1 --2- 172.21.15.53:0/3706148301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1402f0 0x55f43b50d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.483+0000 7f770ec38640 1 -- 172.21.15.53:0/3706148301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b1484d0 msgr2=0x55f43b50d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.483+0000 7f770ec38640 1 --2- 172.21.15.53:0/3706148301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b1484d0 0x55f43b50d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.483+0000 7f770ec38640 1 -- 172.21.15.53:0/3706148301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f43b1d4790 con 0x55f43b1691b0 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.483+0000 7f76ff7fe640 1 -- 172.21.15.53:0/1656817959 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f76f80e5890 con 0x7f77081080a0 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.483+0000 7f770ec38640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76f40b4d20 0x7f76f40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.483+0000 7f770ec38640 1 --2- 172.21.15.53:0/3706148301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 0x55f43b50cac0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f7700009f00 tx=0x7f7700011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467b24ef638048fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.484+0000 7f76fcbfe640 1 -- 172.21.15.53:0/3706148301 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700004030 con 0x55f43b1691b0 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.484+0000 7f76fcbfe640 1 -- 172.21.15.53:0/3706148301 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7700004830 con 0x55f43b1691b0 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.484+0000 7f76fcbfe640 1 -- 172.21.15.53:0/3706148301 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770001c620 con 0x55f43b1691b0 2024-08-31T06:27:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.485+0000 7f771760d740 1 -- 172.21.15.53:0/3706148301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 msgr2=0x55f43b50cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.485+0000 7f770ec38640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76f40b4d20 0x7f76f40b7230 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7700020000 tx=0x7f7700021000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.485+0000 7f771760d740 1 --2- 172.21.15.53:0/3706148301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 0x55f43b50cac0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f7700009f00 tx=0x7f7700011810 comp rx=0 tx=0).stop 2024-08-31T06:27:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.485+0000 7f771760d740 1 -- 172.21.15.53:0/3706148301 shutdown_connections 2024-08-31T06:27:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.485+0000 7f771760d740 1 --2- 172.21.15.53:0/3706148301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b1484d0 0x55f43b50d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.485+0000 7f771760d740 1 --2- 172.21.15.53:0/3706148301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1402f0 0x55f43b50d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.485+0000 7f771760d740 1 --2- 172.21.15.53:0/3706148301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 0x55f43b50cac0 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.485+0000 7f771760d740 1 -- 172.21.15.53:0/3706148301 >> 172.21.15.53:0/3706148301 conn(0x55f43b15d300 msgr2=0x55f43b50a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.485+0000 7f771760d740 1 -- 172.21.15.53:0/3706148301 shutdown_connections 2024-08-31T06:27:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.485+0000 7f771760d740 1 -- 172.21.15.53:0/3706148301 wait complete. 2024-08-31T06:27:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f771760d740 1 -- start start 2024-08-31T06:27:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f771760d740 1 Processor -- start 2024-08-31T06:27:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f771760d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1402f0 0x55f43b5186e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f771760d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b1484d0 0x55f43b518c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f771760d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1691b0 0x55f43b528a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f771760d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f43b3aaab0 con 0x55f43b1402f0 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f771760d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f43b3f8680 con 0x55f43b1484d0 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f771760d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f43b51f6f0 con 0x55f43b1691b0 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f771760d740 10 client.0 _ll_register_callbacks cb 0x55f43b180a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f770ec38640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1691b0 0x55f43b528a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f770e437640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1402f0 0x55f43b5186e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f770ec38640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1691b0 0x55f43b528a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:45802/0 (socket says 172.21.15.53:45802) 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f770ec38640 1 -- 172.21.15.53:0/73452393 learned_addr learned my addr 172.21.15.53:0/73452393 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.486+0000 7f770dc36640 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b1484d0 0x55f43b518c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.487+0000 7f770e437640 1 -- 172.21.15.53:0/73452393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1691b0 msgr2=0x55f43b528a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.487+0000 7f770e437640 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1691b0 0x55f43b528a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.487+0000 7f770e437640 1 -- 172.21.15.53:0/73452393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b1484d0 msgr2=0x55f43b518c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.487+0000 7f770e437640 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b1484d0 0x55f43b518c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.487+0000 7f770e437640 1 -- 172.21.15.53:0/73452393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f43b24d620 con 0x55f43b1402f0 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.487+0000 7f770e437640 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1402f0 0x55f43b5186e0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x55f43b50b740 tx=0x7f7704031f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621811582bd6b84d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.487+0000 7f76f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.487+0000 7f76f1ffb640 1 -- 172.21.15.53:0/73452393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704035030 con 0x55f43b1402f0 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.487+0000 7f76f1ffb640 1 -- 172.21.15.53:0/73452393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f7704004040 con 0x55f43b1402f0 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.487+0000 7f771760d740 1 -- 172.21.15.53:0/73452393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7700004830 con 0x55f43b1402f0 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.488+0000 7f76f1ffb640 1 -- 172.21.15.53:0/73452393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f7704004240 con 0x55f43b1402f0 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.488+0000 7f771760d740 10 client.22467 fetch_fsmap learned FSMap version 81 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.488+0000 7f771760d740 1 -- 172.21.15.53:0/73452393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=4+}) -- 0x55f43b52b710 con 0x55f43b1402f0 2024-08-31T06:27:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.488+0000 7f76f1ffb640 1 -- 172.21.15.53:0/73452393 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7700004830 con 0x55f43b1402f0 2024-08-31T06:27:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.488+0000 7f76f1ffb640 1 -- 172.21.15.53:0/73452393 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 81) ==== 8406+0+0 (secure 0 0 0) 0x7f7704045480 con 0x55f43b1402f0 2024-08-31T06:27:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.488+0000 7f771760d740 10 client.22467 fetch_fsmap finished waiting for FSMap version 81 2024-08-31T06:27:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.488+0000 7f771760d740 10 client.22467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.488+0000 7f771760d740 20 client.22467 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.488+0000 7f771760d740 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f43b127d80 0x55f43b52ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.488+0000 7f771760d740 4 client.22467 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.488+0000 7f771760d740 1 -- 172.21.15.53:0/73452393 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f43b483f50 con 0x55f43b127d80 2024-08-31T06:27:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.489+0000 7f770dc36640 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f43b127d80 0x55f43b52ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.489+0000 7f76f1ffb640 10 client.22467 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.489+0000 7f770dc36640 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f43b127d80 0x55f43b52ec70 crc :-1 s=READY pgs=538 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d99768f56097d0f server_cookie=321a117dd27d3f1d in_seq=0 out_seq=0 2024-08-31T06:27:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.490+0000 7f76f1ffb640 1 -- 172.21.15.53:0/73452393 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f43b483f50 con 0x55f43b127d80 2024-08-31T06:27:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.490+0000 7f76f1ffb640 10 client.22467 handle_command_reply: tid=0 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.490+0000 7f771760d740 1 client.22467 shutdown 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f771760d740 1 -- 172.21.15.53:0/73452393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1402f0 msgr2=0x55f43b5186e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f771760d740 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1402f0 0x55f43b5186e0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x55f43b50b740 tx=0x7f7704031f20 comp rx=0 tx=0).stop 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f771760d740 1 -- 172.21.15.53:0/73452393 shutdown_connections 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f771760d740 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f43b127d80 0x55f43b52ec70 crc :-1 s=READY pgs=538 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f771760d740 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1691b0 0x55f43b528a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f771760d740 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b1484d0 0x55f43b518c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f771760d740 1 --2- 172.21.15.53:0/73452393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1402f0 0x55f43b5186e0 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f771760d740 1 -- 172.21.15.53:0/73452393 >> 172.21.15.53:0/73452393 conn(0x55f43b15d300 msgr2=0x55f43b50daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f76f1ffb640 0 client.22467 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f771760d740 1 -- 172.21.15.53:0/73452393 shutdown_connections 2024-08-31T06:27:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f771760d740 1 -- 172.21.15.53:0/73452393 wait complete. 2024-08-31T06:27:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.491+0000 7f771760d740 20 client.22467 trim_cache size 0 max 16384 2024-08-31T06:27:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f771760d740 1 Processor -- start 2024-08-31T06:27:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f771760d740 1 -- start start 2024-08-31T06:27:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f771760d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1484d0 0x55f43b511b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f771760d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1691b0 0x55f43b5120c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f771760d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 0x55f43b5156a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f771760d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f77081ad2c0 con 0x55f43b1484d0 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f771760d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f77081af010 con 0x55f43b0fd1c0 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f771760d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f77081ada50 con 0x55f43b1691b0 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f770e437640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1484d0 0x55f43b511b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f770e437640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1484d0 0x55f43b511b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41738/0 (socket says 172.21.15.53:41738) 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f770e437640 1 -- 172.21.15.53:0/597673270 learned_addr learned my addr 172.21.15.53:0/597673270 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f770dc36640 1 --2- 172.21.15.53:0/597673270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1691b0 0x55f43b5120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.517+0000 7f770ec38640 1 --2- 172.21.15.53:0/597673270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 0x55f43b5156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.518+0000 7f770e437640 1 -- 172.21.15.53:0/597673270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1691b0 msgr2=0x55f43b5120c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.518+0000 7f770e437640 1 --2- 172.21.15.53:0/597673270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1691b0 0x55f43b5120c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.518+0000 7f770e437640 1 -- 172.21.15.53:0/597673270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 msgr2=0x55f43b5156a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.518+0000 7f770e437640 1 --2- 172.21.15.53:0/597673270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 0x55f43b5156a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.518+0000 7f770e437640 1 -- 172.21.15.53:0/597673270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f43b50e9e0 con 0x55f43b1484d0 2024-08-31T06:27:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.518+0000 7f770e437640 1 --2- 172.21.15.53:0/597673270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1484d0 0x55f43b511b80 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f7704009a20 tx=0x7f770402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452e24489be8e404 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.518+0000 7f76f3fff640 1 -- 172.21.15.53:0/597673270 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704051070 con 0x55f43b1484d0 2024-08-31T06:27:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.518+0000 7f76f3fff640 1 -- 172.21.15.53:0/597673270 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7704005850 con 0x55f43b1484d0 2024-08-31T06:27:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.518+0000 7f76f3fff640 1 -- 172.21.15.53:0/597673270 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704045a60 con 0x55f43b1484d0 2024-08-31T06:27:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.519+0000 7f771760d740 1 -- 172.21.15.53:0/597673270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1484d0 msgr2=0x55f43b511b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.519+0000 7f771760d740 1 --2- 172.21.15.53:0/597673270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1484d0 0x55f43b511b80 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f7704009a20 tx=0x7f770402a410 comp rx=0 tx=0).stop 2024-08-31T06:27:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.519+0000 7f771760d740 1 -- 172.21.15.53:0/597673270 shutdown_connections 2024-08-31T06:27:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.519+0000 7f771760d740 1 --2- 172.21.15.53:0/597673270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 0x55f43b5156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.519+0000 7f771760d740 1 --2- 172.21.15.53:0/597673270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1691b0 0x55f43b5120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.519+0000 7f771760d740 1 --2- 172.21.15.53:0/597673270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1484d0 0x55f43b511b80 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.519+0000 7f771760d740 1 -- 172.21.15.53:0/597673270 >> 172.21.15.53:0/597673270 conn(0x55f43b15d300 msgr2=0x55f43b513640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.520+0000 7f771760d740 1 -- 172.21.15.53:0/597673270 shutdown_connections 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.520+0000 7f771760d740 1 -- 172.21.15.53:0/597673270 wait complete. 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.520+0000 7f771760d740 1 -- start start 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.520+0000 7f771760d740 1 Processor -- start 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.520+0000 7f771760d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 0x55f43b522950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.520+0000 7f771760d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1484d0 0x55f43b522e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f771760d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 0x55f43b5233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f771760d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f77081ae8e0 con 0x55f43b1691b0 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f771760d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f77081ae1e0 con 0x55f43b0fd1c0 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f771760d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f77081ab2c0 con 0x55f43b1484d0 2024-08-31T06:27:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f771760d740 10 client.0 _ll_register_callbacks cb 0x7f7704009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770e437640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 0x55f43b522950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770e437640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 0x55f43b522950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52916/0 (socket says 172.21.15.53:52916) 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770dc36640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1484d0 0x55f43b522e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770e437640 1 -- 172.21.15.53:0/503581583 learned_addr learned my addr 172.21.15.53:0/503581583 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770ec38640 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 0x55f43b5233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770e437640 1 -- 172.21.15.53:0/503581583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1484d0 msgr2=0x55f43b522e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770e437640 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1484d0 0x55f43b522e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770e437640 1 -- 172.21.15.53:0/503581583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 msgr2=0x55f43b5233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770e437640 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 0x55f43b5233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770e437640 1 -- 172.21.15.53:0/503581583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f43b598690 con 0x55f43b0fd1c0 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770dc36640 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1484d0 0x55f43b522e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f770e437640 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 0x55f43b522950 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7704005db0 tx=0x7f7704009590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efa9eab9ba3e8e17 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.521+0000 7f76f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f76f1ffb640 1 -- 172.21.15.53:0/503581583 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704035040 con 0x55f43b0fd1c0 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f771760d740 1 -- 172.21.15.53:0/503581583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7704005850 con 0x55f43b0fd1c0 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f76f1ffb640 1 -- 172.21.15.53:0/503581583 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f7704005230 con 0x55f43b0fd1c0 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f76f1ffb640 1 -- 172.21.15.53:0/503581583 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f7704066050 con 0x55f43b0fd1c0 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f771760d740 10 client.31118 fetch_fsmap learned FSMap version 81 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f771760d740 1 -- 172.21.15.53:0/503581583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=4+}) -- 0x55f43b5998c0 con 0x55f43b0fd1c0 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f76f1ffb640 1 -- 172.21.15.53:0/503581583 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7704005850 con 0x55f43b0fd1c0 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f76f1ffb640 1 -- 172.21.15.53:0/503581583 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 81) ==== 8406+0+0 (secure 0 0 0) 0x7f770403c440 con 0x55f43b0fd1c0 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f771760d740 10 client.31118 fetch_fsmap finished waiting for FSMap version 81 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f771760d740 10 client.31118 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f771760d740 20 client.31118 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f771760d740 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f43b59a020 0x55f43b59c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f771760d740 4 client.31118 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:27:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.522+0000 7f771760d740 1 -- 172.21.15.53:0/503581583 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f43b47f9f0 con 0x55f43b59a020 2024-08-31T06:27:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.523+0000 7f770dc36640 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f43b59a020 0x55f43b59c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.523+0000 7f76f1ffb640 10 client.31118 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.524+0000 7f770dc36640 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f43b59a020 0x55f43b59c440 crc :-1 s=READY pgs=539 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=276dc0c78f607be9 server_cookie=c37e9aad4bc29606 in_seq=0 out_seq=0 2024-08-31T06:27:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.603+0000 7f76f1ffb640 1 -- 172.21.15.53:0/503581583 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f43b47f9f0 con 0x55f43b59a020 2024-08-31T06:27:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f76f1ffb640 10 client.31118 handle_command_reply: tid=0 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 1 client.31118 shutdown 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 1 -- 172.21.15.53:0/503581583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 msgr2=0x55f43b522950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 0x55f43b522950 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7704005db0 tx=0x7f7704009590 comp rx=0 tx=0).stop 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 1 -- 172.21.15.53:0/503581583 shutdown_connections 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55f43b59a020 0x55f43b59c440 crc :-1 s=READY pgs=539 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f43b1691b0 0x55f43b5233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f76f1ffb640 0 client.31118 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f43b1484d0 0x55f43b522e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 1 --2- 172.21.15.53:0/503581583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f43b0fd1c0 0x55f43b522950 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 1 -- 172.21.15.53:0/503581583 >> 172.21.15.53:0/503581583 conn(0x55f43b15d300 msgr2=0x55f43b513640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 1 -- 172.21.15.53:0/503581583 shutdown_connections 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 1 -- 172.21.15.53:0/503581583 wait complete. 2024-08-31T06:27:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.604+0000 7f771760d740 20 client.31118 trim_cache size 0 max 16384 2024-08-31T06:27:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:27:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:27:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:27:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:27:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 -- 172.21.15.53:0/1656817959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76f40b4d20 msgr2=0x7f76f40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76f40b4d20 0x7f76f40b7230 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7700020000 tx=0x7f7700021000 comp rx=0 tx=0).stop 2024-08-31T06:27:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 -- 172.21.15.53:0/1656817959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77081080a0 msgr2=0x7f770819b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77081080a0 0x7f770819b460 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f770806c720 tx=0x7f76f800ee50 comp rx=0 tx=0).stop 2024-08-31T06:27:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 -- 172.21.15.53:0/1656817959 shutdown_connections 2024-08-31T06:27:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f76f40b4d20 0x7f76f40b7230 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77081089f0 0x7f770819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77081080a0 0x7f770819b460 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 --2- 172.21.15.53:0/1656817959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7708102770 0x7f770819af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 -- 172.21.15.53:0/1656817959 >> 172.21.15.53:0/1656817959 conn(0x7f770807a490 msgr2=0x7f7708106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 -- 172.21.15.53:0/1656817959 shutdown_connections 2024-08-31T06:27:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:39.605+0000 7f771069b640 1 -- 172.21.15.53:0/1656817959 wait complete. 2024-08-31T06:27:40.392 INFO:tasks.workunit.client.0.smithi053.stdout: 10 56381 5.07 MB/sec execute 448 sec latency 94.086 ms 2024-08-31T06:27:40.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:40 smithi153 ceph-mon[22320]: pgmap v1038: 97 pgs: 97 active+clean; 874 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 436 KiB/s wr, 53 op/s 2024-08-31T06:27:40.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:40 smithi053 ceph-mon[18924]: pgmap v1038: 97 pgs: 97 active+clean; 874 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 436 KiB/s wr, 53 op/s 2024-08-31T06:27:40.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:40 smithi130 ceph-mon[22266]: pgmap v1038: 97 pgs: 97 active+clean; 874 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 436 KiB/s wr, 53 op/s 2024-08-31T06:27:41.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 56523 5.07 MB/sec execute 449 sec latency 93.573 ms 2024-08-31T06:27:42.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 56703 5.08 MB/sec execute 450 sec latency 111.249 ms 2024-08-31T06:27:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:42 smithi153 ceph-mon[22320]: pgmap v1039: 97 pgs: 97 active+clean; 876 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.0 MiB/s wr, 104 op/s 2024-08-31T06:27:42.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:42 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:42.680 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:42 smithi130 ceph-mon[22266]: pgmap v1039: 97 pgs: 97 active+clean; 876 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.0 MiB/s wr, 104 op/s 2024-08-31T06:27:42.680 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:42 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:42.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:42 smithi053 ceph-mon[18924]: pgmap v1039: 97 pgs: 97 active+clean; 876 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.0 MiB/s wr, 104 op/s 2024-08-31T06:27:42.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:42 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:43.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 56876 5.09 MB/sec execute 451 sec latency 84.184 ms 2024-08-31T06:27:44.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 57029 5.08 MB/sec execute 452 sec latency 88.775 ms 2024-08-31T06:27:44.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:44 smithi153 ceph-mon[22320]: pgmap v1040: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.8 MiB/s wr, 142 op/s 2024-08-31T06:27:44.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:44 smithi053 ceph-mon[18924]: pgmap v1040: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.8 MiB/s wr, 142 op/s 2024-08-31T06:27:44.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:44 smithi130 ceph-mon[22266]: pgmap v1040: 97 pgs: 97 active+clean; 884 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.8 MiB/s wr, 142 op/s 2024-08-31T06:27:45.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 57197 5.09 MB/sec execute 453 sec latency 91.094 ms 2024-08-31T06:27:46.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 57328 5.09 MB/sec execute 454 sec latency 88.946 ms 2024-08-31T06:27:46.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:46 smithi153 ceph-mon[22320]: pgmap v1041: 97 pgs: 97 active+clean; 890 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 197 op/s 2024-08-31T06:27:46.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:46 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:27:46.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:46 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:27:46.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:46 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:27:46.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:46 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:27:46.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:46 smithi053 ceph-mon[18924]: pgmap v1041: 97 pgs: 97 active+clean; 890 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 197 op/s 2024-08-31T06:27:46.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:46 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:27:46.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:46 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:27:46.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:46 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:27:46.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:46 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:27:46.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:46 smithi130 ceph-mon[22266]: pgmap v1041: 97 pgs: 97 active+clean; 890 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 197 op/s 2024-08-31T06:27:46.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:46 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:27:46.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:46 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:27:46.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:46 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:27:46.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:46 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:27:47.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 57508 5.11 MB/sec execute 455 sec latency 88.785 ms 2024-08-31T06:27:47.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:47 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:27:47.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:47 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:47.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:47 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:27:47.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:47 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:47.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:47 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:27:47.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:47 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:27:48.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 57709 5.13 MB/sec execute 456 sec latency 62.017 ms 2024-08-31T06:27:48.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:48 smithi153 ceph-mon[22320]: pgmap v1042: 97 pgs: 97 active+clean; 899 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 257 op/s 2024-08-31T06:27:48.728 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:48 smithi053 ceph-mon[18924]: pgmap v1042: 97 pgs: 97 active+clean; 899 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 257 op/s 2024-08-31T06:27:48.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:48 smithi130 ceph-mon[22266]: pgmap v1042: 97 pgs: 97 active+clean; 899 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 257 op/s 2024-08-31T06:27:49.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 57880 5.14 MB/sec execute 457 sec latency 95.290 ms 2024-08-31T06:27:49.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:49 smithi053 ceph-mon[18924]: pgmap v1043: 97 pgs: 97 active+clean; 906 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 282 op/s 2024-08-31T06:27:49.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:49 smithi130 ceph-mon[22266]: pgmap v1043: 97 pgs: 97 active+clean; 906 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 282 op/s 2024-08-31T06:27:49.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:49 smithi153 ceph-mon[22320]: pgmap v1043: 97 pgs: 97 active+clean; 906 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 282 op/s 2024-08-31T06:27:50.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 58021 5.15 MB/sec execute 458 sec latency 105.866 ms 2024-08-31T06:27:51.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 58176 5.17 MB/sec execute 459 sec latency 66.287 ms 2024-08-31T06:27:52.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:51 smithi130 ceph-mon[22266]: pgmap v1044: 97 pgs: 97 active+clean; 914 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 320 op/s 2024-08-31T06:27:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:51 smithi153 ceph-mon[22320]: pgmap v1044: 97 pgs: 97 active+clean; 914 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 320 op/s 2024-08-31T06:27:52.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:51 smithi053 ceph-mon[18924]: pgmap v1044: 97 pgs: 97 active+clean; 914 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 320 op/s 2024-08-31T06:27:52.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 58330 5.18 MB/sec execute 460 sec latency 123.783 ms 2024-08-31T06:27:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.849+0000 7f23165e6640 1 -- 172.21.15.53:0/1110829803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2310108a20 msgr2=0x7f231010f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.849+0000 7f23165e6640 1 --2- 172.21.15.53:0/1110829803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2310108a20 0x7f231010f250 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f2308009ca0 tx=0x7f230802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.849+0000 7f23165e6640 1 -- 172.21.15.53:0/1110829803 shutdown_connections 2024-08-31T06:27:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.849+0000 7f23165e6640 1 --2- 172.21.15.53:0/1110829803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2310108a20 0x7f231010f250 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.849+0000 7f23165e6640 1 --2- 172.21.15.53:0/1110829803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23101080d0 0x7f23101084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.849+0000 7f23165e6640 1 --2- 172.21.15.53:0/1110829803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2310102f10 0x7f2310103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.849+0000 7f23165e6640 1 -- 172.21.15.53:0/1110829803 >> 172.21.15.53:0/1110829803 conn(0x7f2310079c30 msgr2=0x7f231007a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.849+0000 7f23165e6640 1 -- 172.21.15.53:0/1110829803 shutdown_connections 2024-08-31T06:27:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.849+0000 7f23165e6640 1 -- 172.21.15.53:0/1110829803 wait complete. 2024-08-31T06:27:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.850+0000 7f23165e6640 1 Processor -- start 2024-08-31T06:27:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.850+0000 7f23165e6640 1 -- start start 2024-08-31T06:27:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f23165e6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2310102f10 0x7f2310198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f23165e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23101080d0 0x7f23101991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f23165e6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2310108a20 0x7f23101996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f23165e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23101125f0 con 0x7f23101080d0 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f23165e6640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2310112470 con 0x7f2310108a20 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f23165e6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2310112770 con 0x7f2310102f10 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f230f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23101080d0 0x7f23101991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f230f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23101080d0 0x7f23101991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40920/0 (socket says 172.21.15.53:40920) 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f230f7fe640 1 -- 172.21.15.53:0/3004785736 learned_addr learned my addr 172.21.15.53:0/3004785736 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f2314b83640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2310108a20 0x7f23101996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f230ffff640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2310102f10 0x7f2310198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f2314b83640 1 -- 172.21.15.53:0/3004785736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2310102f10 msgr2=0x7f2310198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f2314b83640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2310102f10 0x7f2310198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f2314b83640 1 -- 172.21.15.53:0/3004785736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23101080d0 msgr2=0x7f23101991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f2314b83640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23101080d0 0x7f23101991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f2314b83640 1 -- 172.21.15.53:0/3004785736 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23101a8370 con 0x7f2310108a20 2024-08-31T06:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.851+0000 7f2314b83640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2310108a20 0x7f23101996f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2308031040 tx=0x7f2308003f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.852+0000 7f230d7fa640 1 -- 172.21.15.53:0/3004785736 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308032c10 con 0x7f2310108a20 2024-08-31T06:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.852+0000 7f23165e6640 1 -- 172.21.15.53:0/3004785736 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23101a8600 con 0x7f2310108a20 2024-08-31T06:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.852+0000 7f230d7fa640 1 -- 172.21.15.53:0/3004785736 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2308032db0 con 0x7f2310108a20 2024-08-31T06:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.852+0000 7f230d7fa640 1 -- 172.21.15.53:0/3004785736 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308030ab0 con 0x7f2310108a20 2024-08-31T06:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.852+0000 7f23165e6640 1 -- 172.21.15.53:0/3004785736 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23101a8b20 con 0x7f2310108a20 2024-08-31T06:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.855+0000 7f231d62d740 1 Processor -- start 2024-08-31T06:27:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f230d7fa640 1 -- 172.21.15.53:0/3004785736 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2308030c50 con 0x7f2310108a20 2024-08-31T06:27:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f231d62d740 1 -- start start 2024-08-31T06:27:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f231d62d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 0x557f5b94bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f231d62d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 0x557f5b94c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f231d62d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b94c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f231d62d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557f5b8c1000 con 0x557f5b5874d0 2024-08-31T06:27:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f231d62d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557f5b8b0590 con 0x557f5b5a81b0 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f231d62d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557f5b8b4540 con 0x557f5b57f2f0 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f230ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 0x557f5b94c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f230f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 0x557f5b94bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f230ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 0x557f5b94c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44226/0 (socket says 172.21.15.53:44226) 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.856+0000 7f230ffff640 1 -- 172.21.15.53:0/2935809933 learned_addr learned my addr 172.21.15.53:0/2935809933 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f230f7fe640 1 --2- 172.21.15.53:0/2935809933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b94c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f230ffff640 1 -- 172.21.15.53:0/2935809933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 msgr2=0x557f5b94bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f230ffff640 1 --2- 172.21.15.53:0/2935809933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 0x557f5b94bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f230ffff640 1 -- 172.21.15.53:0/2935809933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 msgr2=0x557f5b94c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f230ffff640 1 --2- 172.21.15.53:0/2935809933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b94c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f230ffff640 1 -- 172.21.15.53:0/2935809933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5b613790 con 0x557f5b57f2f0 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f230d7fa640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22f80b4ca0 0x7f22f80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f230ffff640 1 --2- 172.21.15.53:0/2935809933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 0x557f5b94c000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2300009cd0 tx=0x7f2300011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a73d3c57ad96f087 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f22f67fc640 1 -- 172.21.15.53:0/2935809933 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300005020 con 0x557f5b57f2f0 2024-08-31T06:27:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f230f7fe640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22f80b4ca0 0x7f22f80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f22f67fc640 1 -- 172.21.15.53:0/2935809933 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23000047a0 con 0x557f5b57f2f0 2024-08-31T06:27:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f22f67fc640 1 -- 172.21.15.53:0/2935809933 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300005650 con 0x557f5b57f2f0 2024-08-31T06:27:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.857+0000 7f230d7fa640 1 -- 172.21.15.53:0/3004785736 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f2308106540 con 0x7f2310108a20 2024-08-31T06:27:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.858+0000 7f231d62d740 1 -- 172.21.15.53:0/2935809933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 msgr2=0x557f5b94c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.858+0000 7f230f7fe640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22f80b4ca0 0x7f22f80b71b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f23040095c0 tx=0x7f2304005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.858+0000 7f231d62d740 1 --2- 172.21.15.53:0/2935809933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 0x557f5b94c000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2300009cd0 tx=0x7f2300011810 comp rx=0 tx=0).stop 2024-08-31T06:27:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.859+0000 7f231d62d740 1 -- 172.21.15.53:0/2935809933 shutdown_connections 2024-08-31T06:27:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.859+0000 7f231d62d740 1 --2- 172.21.15.53:0/2935809933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b94c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.859+0000 7f231d62d740 1 --2- 172.21.15.53:0/2935809933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 0x557f5b94c000 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.859+0000 7f231d62d740 1 --2- 172.21.15.53:0/2935809933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 0x557f5b94bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.859+0000 7f231d62d740 1 -- 172.21.15.53:0/2935809933 >> 172.21.15.53:0/2935809933 conn(0x557f5b59c300 msgr2=0x557f5b9499b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.859+0000 7f231d62d740 1 -- 172.21.15.53:0/2935809933 shutdown_connections 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.859+0000 7f231d62d740 1 -- 172.21.15.53:0/2935809933 wait complete. 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.859+0000 7f231d62d740 1 -- start start 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.859+0000 7f231d62d740 1 Processor -- start 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f231d62d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b57f2f0 0x557f5b9576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f230ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b57f2f0 0x557f5b9576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f230ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b57f2f0 0x557f5b9576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40934/0 (socket says 172.21.15.53:40934) 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f230ffff640 1 -- 172.21.15.53:0/1245770416 learned_addr learned my addr 172.21.15.53:0/1245770416 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f231d62d740 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5874d0 0x557f5b957be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f231d62d740 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b5a81b0 0x557f5b963530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f231d62d740 1 -- 172.21.15.53:0/1245770416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557f5b7e9ab0 con 0x557f5b57f2f0 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f231d62d740 1 -- 172.21.15.53:0/1245770416 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557f5b837680 con 0x557f5b5874d0 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f231d62d740 1 -- 172.21.15.53:0/1245770416 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557f5b95a240 con 0x557f5b5a81b0 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f230f7fe640 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5874d0 0x557f5b957be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f231d62d740 10 client.0 _ll_register_callbacks cb 0x557f5b5bfa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.860+0000 7f2314b83640 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b5a81b0 0x557f5b963530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f230ffff640 1 -- 172.21.15.53:0/1245770416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b5a81b0 msgr2=0x557f5b963530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f230ffff640 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b5a81b0 0x557f5b963530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f230ffff640 1 -- 172.21.15.53:0/1245770416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5874d0 msgr2=0x557f5b957be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f230ffff640 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5874d0 0x557f5b957be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f230ffff640 1 -- 172.21.15.53:0/1245770416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5b68c620 con 0x557f5b57f2f0 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f2314b83640 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b5a81b0 0x557f5b963530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f230f7fe640 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5874d0 0x557f5b957be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f230ffff640 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b57f2f0 0x557f5b9576a0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f2300009870 tx=0x7f2300005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de006c61e398ee89 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f22ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1245770416 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300026030 con 0x557f5b57f2f0 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1245770416 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f2300016040 con 0x557f5b57f2f0 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f231d62d740 1 -- 172.21.15.53:0/1245770416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23000047a0 con 0x557f5b57f2f0 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1245770416 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f2300030050 con 0x557f5b57f2f0 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f231d62d740 10 client.22485 fetch_fsmap learned FSMap version 83 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.861+0000 7f231d62d740 1 -- 172.21.15.53:0/1245770416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) -- 0x557f5b966280 con 0x557f5b57f2f0 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.862+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1245770416 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23000047a0 con 0x557f5b57f2f0 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.862+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1245770416 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 83) ==== 8398+0+0 (secure 0 0 0) 0x7f23000035f0 con 0x557f5b57f2f0 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.862+0000 7f231d62d740 10 client.22485 fetch_fsmap finished waiting for FSMap version 83 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.862+0000 7f231d62d740 10 client.22485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.862+0000 7f231d62d740 20 client.22485 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.862+0000 7f231d62d740 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557f5b566d80 0x557f5b9696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.862+0000 7f231d62d740 4 client.22485 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:27:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.862+0000 7f231d62d740 1 -- 172.21.15.53:0/1245770416 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f5b8c2f50 con 0x557f5b566d80 2024-08-31T06:27:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.862+0000 7f230f7fe640 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557f5b566d80 0x557f5b9696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.863+0000 7f230f7fe640 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557f5b566d80 0x557f5b9696f0 crc :-1 s=READY pgs=540 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f3ce2ddafb39d0e server_cookie=2f3633e5e23a6636 in_seq=0 out_seq=0 2024-08-31T06:27:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.863+0000 7f22ef7fe640 10 client.22485 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.863+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1245770416 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f5b8c2f50 con 0x557f5b566d80 2024-08-31T06:27:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.863+0000 7f22ef7fe640 10 client.22485 handle_command_reply: tid=0 2024-08-31T06:27:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.863+0000 7f231d62d740 1 client.22485 shutdown 2024-08-31T06:27:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f231d62d740 1 -- 172.21.15.53:0/1245770416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b57f2f0 msgr2=0x557f5b9576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f231d62d740 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b57f2f0 0x557f5b9576a0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f2300009870 tx=0x7f2300005130 comp rx=0 tx=0).stop 2024-08-31T06:27:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f231d62d740 1 -- 172.21.15.53:0/1245770416 shutdown_connections 2024-08-31T06:27:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f231d62d740 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557f5b566d80 0x557f5b9696f0 crc :-1 s=READY pgs=540 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f231d62d740 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b5a81b0 0x557f5b963530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f231d62d740 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5874d0 0x557f5b957be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f231d62d740 1 --2- 172.21.15.53:0/1245770416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b57f2f0 0x557f5b9576a0 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f231d62d740 1 -- 172.21.15.53:0/1245770416 >> 172.21.15.53:0/1245770416 conn(0x557f5b59c300 msgr2=0x557f5b94caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f22ef7fe640 0 client.22485 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f231d62d740 1 -- 172.21.15.53:0/1245770416 shutdown_connections 2024-08-31T06:27:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f231d62d740 1 -- 172.21.15.53:0/1245770416 wait complete. 2024-08-31T06:27:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.864+0000 7f231d62d740 20 client.22485 trim_cache size 0 max 16384 2024-08-31T06:27:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f231d62d740 1 Processor -- start 2024-08-31T06:27:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f231d62d740 1 -- start start 2024-08-31T06:27:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f231d62d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b57f2f0 0x557f5b951300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f231d62d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b96edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f231d62d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b5a81b0 0x557f5b96f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f231d62d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23101b1580 con 0x557f5b5874d0 2024-08-31T06:27:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f231d62d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f23101b3270 con 0x557f5b57f2f0 2024-08-31T06:27:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f231d62d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23101b1d10 con 0x557f5b5a81b0 2024-08-31T06:27:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f230f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b96edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f230ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b57f2f0 0x557f5b951300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f230f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b96edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40944/0 (socket says 172.21.15.53:40944) 2024-08-31T06:27:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f230f7fe640 1 -- 172.21.15.53:0/1636968119 learned_addr learned my addr 172.21.15.53:0/1636968119 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.889+0000 7f2314b83640 1 --2- 172.21.15.53:0/1636968119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b5a81b0 0x557f5b96f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.890+0000 7f230ffff640 1 -- 172.21.15.53:0/1636968119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b5a81b0 msgr2=0x557f5b96f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.890+0000 7f230ffff640 1 --2- 172.21.15.53:0/1636968119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b5a81b0 0x557f5b96f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.890+0000 7f230ffff640 1 -- 172.21.15.53:0/1636968119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 msgr2=0x557f5b96edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.890+0000 7f230ffff640 1 --2- 172.21.15.53:0/1636968119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b96edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.890+0000 7f230ffff640 1 -- 172.21.15.53:0/1636968119 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5b952fc0 con 0x557f5b57f2f0 2024-08-31T06:27:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.890+0000 7f230f7fe640 1 --2- 172.21.15.53:0/1636968119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b96edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.890+0000 7f230ffff640 1 --2- 172.21.15.53:0/1636968119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b57f2f0 0x557f5b951300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2300003c00 tx=0x7f2300005970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8baa61a30f38fcec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.890+0000 7f22f5ffb640 1 -- 172.21.15.53:0/1636968119 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300026040 con 0x557f5b57f2f0 2024-08-31T06:27:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.890+0000 7f22f5ffb640 1 -- 172.21.15.53:0/1636968119 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2300009e80 con 0x557f5b57f2f0 2024-08-31T06:27:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.890+0000 7f22f5ffb640 1 -- 172.21.15.53:0/1636968119 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300004110 con 0x557f5b57f2f0 2024-08-31T06:27:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.892+0000 7f231d62d740 1 -- 172.21.15.53:0/1636968119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b57f2f0 msgr2=0x557f5b951300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.892+0000 7f231d62d740 1 --2- 172.21.15.53:0/1636968119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b57f2f0 0x557f5b951300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2300003c00 tx=0x7f2300005970 comp rx=0 tx=0).stop 2024-08-31T06:27:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.892+0000 7f231d62d740 1 -- 172.21.15.53:0/1636968119 shutdown_connections 2024-08-31T06:27:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.892+0000 7f231d62d740 1 --2- 172.21.15.53:0/1636968119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b5a81b0 0x557f5b96f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.892+0000 7f231d62d740 1 --2- 172.21.15.53:0/1636968119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b96edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.892+0000 7f231d62d740 1 --2- 172.21.15.53:0/1636968119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b57f2f0 0x557f5b951300 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.892+0000 7f231d62d740 1 -- 172.21.15.53:0/1636968119 >> 172.21.15.53:0/1636968119 conn(0x557f5b59c300 msgr2=0x557f5b950bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.892+0000 7f231d62d740 1 -- 172.21.15.53:0/1636968119 shutdown_connections 2024-08-31T06:27:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.892+0000 7f231d62d740 1 -- 172.21.15.53:0/1636968119 wait complete. 2024-08-31T06:27:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.892+0000 7f231d62d740 1 -- start start 2024-08-31T06:27:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.892+0000 7f231d62d740 1 Processor -- start 2024-08-31T06:27:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f231d62d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 0x557f5b95cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f231d62d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b95d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f231d62d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 0x557f5b9d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f231d62d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f23101b2ba0 con 0x557f5b5874d0 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f231d62d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f23101b24a0 con 0x557f5b5a81b0 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f231d62d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f23101af580 con 0x557f5b57f2f0 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f231d62d740 10 client.0 _ll_register_callbacks cb 0x7f2304009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f230ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 0x557f5b95cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f230f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b95d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f2314b83640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 0x557f5b9d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f2314b83640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 0x557f5b9d1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:51126/0 (socket says 172.21.15.53:51126) 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f2314b83640 1 -- 172.21.15.53:0/1435236228 learned_addr learned my addr 172.21.15.53:0/1435236228 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:27:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.893+0000 7f230ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 0x557f5b95cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44268/0 (socket says 172.21.15.53:44268) 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.894+0000 7f230f7fe640 1 -- 172.21.15.53:0/1435236228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 msgr2=0x557f5b95cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.894+0000 7f230f7fe640 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 0x557f5b95cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.894+0000 7f230f7fe640 1 -- 172.21.15.53:0/1435236228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 msgr2=0x557f5b9d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.894+0000 7f230f7fe640 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 0x557f5b9d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.894+0000 7f230f7fe640 1 -- 172.21.15.53:0/1435236228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5b9d2690 con 0x557f5b5874d0 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.894+0000 7f2314b83640 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 0x557f5b9d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.894+0000 7f230f7fe640 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b95d2f0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f2304009a90 tx=0x7f23040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ceb8562215f2e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.894+0000 7f22ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.894+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1435236228 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304039060 con 0x557f5b5874d0 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1435236228 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 8557+0+0 (secure 0 0 0) 0x7f23040204d0 con 0x557f5b5874d0 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f231d62d740 1 -- 172.21.15.53:0/1435236228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f5b8be9f0 con 0x557f5b5874d0 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1435236228 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f23040206d0 con 0x557f5b5874d0 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f231d62d740 10 client.22491 fetch_fsmap learned FSMap version 83 2024-08-31T06:27:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f231d62d740 1 -- 172.21.15.53:0/1435236228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) -- 0x557f5b9d3960 con 0x557f5b5874d0 2024-08-31T06:27:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1435236228 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2304020d00 con 0x557f5b5874d0 2024-08-31T06:27:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1435236228 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 83) ==== 8398+0+0 (secure 0 0 0) 0x7f2304033070 con 0x557f5b5874d0 2024-08-31T06:27:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f231d62d740 10 client.22491 fetch_fsmap finished waiting for FSMap version 83 2024-08-31T06:27:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f231d62d740 10 client.22491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:27:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f231d62d740 20 client.22491 populate_metadata read hostname 'smithi053' 2024-08-31T06:27:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f231d62d740 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557f5b53c1c0 0x557f5b9d60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:27:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f231d62d740 4 client.22491 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:27:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.895+0000 7f231d62d740 1 -- 172.21.15.53:0/1435236228 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f5b8be9f0 con 0x557f5b53c1c0 2024-08-31T06:27:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.896+0000 7f230ffff640 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557f5b53c1c0 0x557f5b9d60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:27:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.896+0000 7f22ef7fe640 10 client.22491 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:52.896+0000 7f230ffff640 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557f5b53c1c0 0x557f5b9d60a0 crc :-1 s=READY pgs=541 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2bfd31f147f4ca0 server_cookie=4d9e98f91820f931 in_seq=0 out_seq=0 2024-08-31T06:27:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f22ef7fe640 1 -- 172.21.15.53:0/1435236228 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f5b8be9f0 con 0x557f5b53c1c0 2024-08-31T06:27:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f22ef7fe640 10 client.22491 handle_command_reply: tid=0 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f231d62d740 1 client.22491 shutdown 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f231d62d740 1 -- 172.21.15.53:0/1435236228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 msgr2=0x557f5b95d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f231d62d740 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b95d2f0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f2304009a90 tx=0x7f23040046c0 comp rx=0 tx=0).stop 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f231d62d740 1 -- 172.21.15.53:0/1435236228 shutdown_connections 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f231d62d740 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x557f5b53c1c0 0x557f5b9d60a0 crc :-1 s=READY pgs=541 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f22ef7fe640 0 client.22491 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f231d62d740 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557f5b5a81b0 0x557f5b9d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f231d62d740 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557f5b5874d0 0x557f5b95d2f0 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f231d62d740 1 --2- 172.21.15.53:0/1435236228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f5b57f2f0 0x557f5b95cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f231d62d740 1 -- 172.21.15.53:0/1435236228 >> 172.21.15.53:0/1435236228 conn(0x557f5b59c300 msgr2=0x557f5b958810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f231d62d740 1 -- 172.21.15.53:0/1435236228 shutdown_connections 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.027+0000 7f231d62d740 1 -- 172.21.15.53:0/1435236228 wait complete. 2024-08-31T06:27:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.028+0000 7f231d62d740 20 client.22491 trim_cache size 0 max 16384 2024-08-31T06:27:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:27:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:27:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:27:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.028+0000 7f23165e6640 1 -- 172.21.15.53:0/3004785736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22f80b4ca0 msgr2=0x7f22f80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.028+0000 7f23165e6640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22f80b4ca0 0x7f22f80b71b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f23040095c0 tx=0x7f2304005f90 comp rx=0 tx=0).stop 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.028+0000 7f23165e6640 1 -- 172.21.15.53:0/3004785736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2310108a20 msgr2=0x7f23101996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.028+0000 7f23165e6640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2310108a20 0x7f23101996f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2308031040 tx=0x7f2308003f30 comp rx=0 tx=0).stop 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.028+0000 7f23165e6640 1 -- 172.21.15.53:0/3004785736 shutdown_connections 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.028+0000 7f23165e6640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22f80b4ca0 0x7f22f80b71b0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.028+0000 7f23165e6640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2310108a20 0x7f23101996f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.028+0000 7f23165e6640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23101080d0 0x7f23101991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.028+0000 7f23165e6640 1 --2- 172.21.15.53:0/3004785736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2310102f10 0x7f2310198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.028+0000 7f23165e6640 1 -- 172.21.15.53:0/3004785736 >> 172.21.15.53:0/3004785736 conn(0x7f2310079c30 msgr2=0x7f23101040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.029+0000 7f23165e6640 1 -- 172.21.15.53:0/3004785736 shutdown_connections 2024-08-31T06:27:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:27:53.029+0000 7f23165e6640 1 -- 172.21.15.53:0/3004785736 wait complete. 2024-08-31T06:27:53.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 58453 5.18 MB/sec execute 461 sec latency 97.902 ms 2024-08-31T06:27:54.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:53 smithi130 ceph-mon[22266]: pgmap v1045: 97 pgs: 97 active+clean; 920 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-08-31T06:27:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:53 smithi153 ceph-mon[22320]: pgmap v1045: 97 pgs: 97 active+clean; 920 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-08-31T06:27:54.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:53 smithi053 ceph-mon[18924]: pgmap v1045: 97 pgs: 97 active+clean; 920 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-08-31T06:27:54.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 58605 5.19 MB/sec execute 462 sec latency 102.031 ms 2024-08-31T06:27:55.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 58752 5.20 MB/sec execute 463 sec latency 63.882 ms 2024-08-31T06:27:56.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:55 smithi130 ceph-mon[22266]: pgmap v1046: 97 pgs: 97 active+clean; 930 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 330 op/s 2024-08-31T06:27:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:55 smithi153 ceph-mon[22320]: pgmap v1046: 97 pgs: 97 active+clean; 930 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 330 op/s 2024-08-31T06:27:56.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:55 smithi053 ceph-mon[18924]: pgmap v1046: 97 pgs: 97 active+clean; 930 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.5 MiB/s wr, 330 op/s 2024-08-31T06:27:56.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 58912 5.21 MB/sec execute 464 sec latency 91.738 ms 2024-08-31T06:27:57.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 59030 5.20 MB/sec execute 465 sec latency 51.821 ms 2024-08-31T06:27:58.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:57 smithi130 ceph-mon[22266]: pgmap v1047: 97 pgs: 97 active+clean; 935 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.2 MiB/s wr, 348 op/s 2024-08-31T06:27:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:57 smithi153 ceph-mon[22320]: pgmap v1047: 97 pgs: 97 active+clean; 935 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.2 MiB/s wr, 348 op/s 2024-08-31T06:27:58.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:57 smithi053 ceph-mon[18924]: pgmap v1047: 97 pgs: 97 active+clean; 935 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.2 MiB/s wr, 348 op/s 2024-08-31T06:27:58.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 59169 5.20 MB/sec execute 466 sec latency 56.590 ms 2024-08-31T06:27:59.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 59324 5.21 MB/sec execute 467 sec latency 109.750 ms 2024-08-31T06:28:00.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:27:59 smithi130 ceph-mon[22266]: pgmap v1048: 97 pgs: 97 active+clean; 937 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 314 op/s 2024-08-31T06:28:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:27:59 smithi153 ceph-mon[22320]: pgmap v1048: 97 pgs: 97 active+clean; 937 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 314 op/s 2024-08-31T06:28:00.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:27:59 smithi053 ceph-mon[18924]: pgmap v1048: 97 pgs: 97 active+clean; 937 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 314 op/s 2024-08-31T06:28:00.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 59495 5.22 MB/sec execute 468 sec latency 148.940 ms 2024-08-31T06:28:01.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 59546 5.21 MB/sec execute 469 sec latency 738.212 ms 2024-08-31T06:28:02.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:01 smithi130 ceph-mon[22266]: pgmap v1049: 97 pgs: 97 active+clean; 945 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-08-31T06:28:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:01 smithi153 ceph-mon[22320]: pgmap v1049: 97 pgs: 97 active+clean; 945 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-08-31T06:28:02.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:01 smithi053 ceph-mon[18924]: pgmap v1049: 97 pgs: 97 active+clean; 945 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-08-31T06:28:02.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 59546 5.20 MB/sec execute 470 sec latency 1738.338 ms 2024-08-31T06:28:03.394 INFO:tasks.workunit.client.0.smithi053.stdout: 10 59546 5.19 MB/sec execute 471 sec latency 2738.432 ms 2024-08-31T06:28:04.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:03 smithi130 ceph-mon[22266]: pgmap v1050: 97 pgs: 97 active+clean; 945 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 341 op/s 2024-08-31T06:28:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:03 smithi153 ceph-mon[22320]: pgmap v1050: 97 pgs: 97 active+clean; 945 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 341 op/s 2024-08-31T06:28:04.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:03 smithi053 ceph-mon[18924]: pgmap v1050: 97 pgs: 97 active+clean; 945 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 341 op/s 2024-08-31T06:28:04.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 59621 5.18 MB/sec execute 472 sec latency 3227.990 ms 2024-08-31T06:28:05.393 INFO:tasks.workunit.client.0.smithi053.stdout: 10 59765 5.18 MB/sec execute 473 sec latency 54.898 ms 2024-08-31T06:28:06.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:05 smithi130 ceph-mon[22266]: pgmap v1051: 97 pgs: 97 active+clean; 942 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 345 op/s 2024-08-31T06:28:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:05 smithi153 ceph-mon[22320]: pgmap v1051: 97 pgs: 97 active+clean; 942 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 345 op/s 2024-08-31T06:28:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.178+0000 7fef67de4640 1 -- 172.21.15.53:0/3967960547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef601091a0 msgr2=0x7fef601095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.178+0000 7fef67de4640 1 --2- 172.21.15.53:0/3967960547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef601091a0 0x7fef601095b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fef50009860 tx=0x7fef5002a340 comp rx=0 tx=0).stop 2024-08-31T06:28:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.179+0000 7fef67de4640 1 -- 172.21.15.53:0/3967960547 shutdown_connections 2024-08-31T06:28:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.179+0000 7fef67de4640 1 --2- 172.21.15.53:0/3967960547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef60109af0 0x7fef60110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.179+0000 7fef67de4640 1 --2- 172.21.15.53:0/3967960547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef601091a0 0x7fef601095b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.179+0000 7fef67de4640 1 --2- 172.21.15.53:0/3967960547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef60103870 0x7fef60103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.179+0000 7fef67de4640 1 -- 172.21.15.53:0/3967960547 >> 172.21.15.53:0/3967960547 conn(0x7fef600ff2b0 msgr2=0x7fef60101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.179+0000 7fef67de4640 1 -- 172.21.15.53:0/3967960547 shutdown_connections 2024-08-31T06:28:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.179+0000 7fef67de4640 1 -- 172.21.15.53:0/3967960547 wait complete. 2024-08-31T06:28:06.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.180+0000 7fef67de4640 1 Processor -- start 2024-08-31T06:28:06.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.180+0000 7fef67de4640 1 -- start start 2024-08-31T06:28:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.180+0000 7fef67de4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef60103870 0x7fef6019c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.180+0000 7fef67de4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef601091a0 0x7fef6019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.180+0000 7fef67de4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef60109af0 0x7fef601a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.180+0000 7fef67de4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fef60113610 con 0x7fef60109af0 2024-08-31T06:28:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.180+0000 7fef67de4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fef60113490 con 0x7fef60103870 2024-08-31T06:28:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.180+0000 7fef67de4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef60113790 con 0x7fef601091a0 2024-08-31T06:28:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.181+0000 7fef65b80640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef60103870 0x7fef6019c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.181+0000 7fef6537f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef601091a0 0x7fef6019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.181+0000 7fef65b80640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef60103870 0x7fef6019c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:34320/0 (socket says 172.21.15.53:34320) 2024-08-31T06:28:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.181+0000 7fef66381640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef60109af0 0x7fef601a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.181+0000 7fef65b80640 1 -- 172.21.15.53:0/2660808374 learned_addr learned my addr 172.21.15.53:0/2660808374 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.181+0000 7fef65b80640 1 -- 172.21.15.53:0/2660808374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef601091a0 msgr2=0x7fef6019c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.181+0000 7fef65b80640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef601091a0 0x7fef6019c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.181+0000 7fef65b80640 1 -- 172.21.15.53:0/2660808374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef60109af0 msgr2=0x7fef601a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.181+0000 7fef65b80640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef60109af0 0x7fef601a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.181+0000 7fef65b80640 1 -- 172.21.15.53:0/2660808374 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef601a2080 con 0x7fef60103870 2024-08-31T06:28:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.181+0000 7fef66381640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef60109af0 0x7fef601a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.182+0000 7fef65b80640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef60103870 0x7fef6019c150 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00e9c0 tx=0x7fef5c00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.182+0000 7fef56ffd640 1 -- 172.21.15.53:0/2660808374 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00ccc0 con 0x7fef60103870 2024-08-31T06:28:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.182+0000 7fef67de4640 1 -- 172.21.15.53:0/2660808374 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef601a2370 con 0x7fef60103870 2024-08-31T06:28:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.182+0000 7fef67de4640 1 -- 172.21.15.53:0/2660808374 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef601a8b00 con 0x7fef60103870 2024-08-31T06:28:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.182+0000 7fef56ffd640 1 -- 172.21.15.53:0/2660808374 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef5c0054b0 con 0x7fef60103870 2024-08-31T06:28:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.182+0000 7fef56ffd640 1 -- 172.21.15.53:0/2660808374 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c004cf0 con 0x7fef60103870 2024-08-31T06:28:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.185+0000 7fef6ee33740 1 Processor -- start 2024-08-31T06:28:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.185+0000 7fef6ee33740 1 -- start start 2024-08-31T06:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.185+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f271b0 0x5594572caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.185+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.185+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f064d0 0x5594572cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.185+0000 7fef6ee33740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559457240000 con 0x559456f271b0 2024-08-31T06:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.185+0000 7fef6ee33740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55945722f590 con 0x559456efe2f0 2024-08-31T06:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.185+0000 7fef6ee33740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559457233540 con 0x559456f064d0 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef66381640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f271b0 0x5594572caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef6537f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f064d0 0x5594572cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef6537f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f064d0 0x5594572cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37358/0 (socket says 172.21.15.53:37358) 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef6537f640 1 -- 172.21.15.53:0/1947620685 learned_addr learned my addr 172.21.15.53:0/1947620685 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef66381640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f271b0 0x5594572caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47900/0 (socket says 172.21.15.53:47900) 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef56ffd640 1 -- 172.21.15.53:0/2660808374 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fef5c005020 con 0x7fef60103870 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef66381640 1 -- 172.21.15.53:0/1947620685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f064d0 msgr2=0x5594572cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef66381640 1 --2- 172.21.15.53:0/1947620685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f064d0 0x5594572cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef66381640 1 -- 172.21.15.53:0/1947620685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 msgr2=0x5594572cb000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef66381640 1 --2- 172.21.15.53:0/1947620685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572cb000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef66381640 1 -- 172.21.15.53:0/1947620685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559456f92790 con 0x559456f271b0 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef6537f640 1 --2- 172.21.15.53:0/1947620685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f064d0 0x5594572cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.186+0000 7fef66381640 1 --2- 172.21.15.53:0/1947620685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f271b0 0x5594572caac0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fef58011760 tx=0x7fef58011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a898f63d05d8de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:06.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.187+0000 7fef4bfff640 1 -- 172.21.15.53:0/1947620685 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58004d20 con 0x559456f271b0 2024-08-31T06:28:06.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.187+0000 7fef4bfff640 1 -- 172.21.15.53:0/1947620685 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef58003970 con 0x559456f271b0 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.187+0000 7fef4bfff640 1 -- 172.21.15.53:0/1947620685 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef580043a0 con 0x559456f271b0 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.187+0000 7fef56ffd640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef4c0b4d20 0x7fef4c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef56ffd640 1 -- 172.21.15.53:0/2660808374 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 8601+0+0 (secure 0 0 0) 0x7fef5c0e5760 con 0x7fef60103870 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef65b80640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef4c0b4d20 0x7fef4c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef6ee33740 1 -- 172.21.15.53:0/1947620685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f271b0 msgr2=0x5594572caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1947620685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f271b0 0x5594572caac0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fef58011760 tx=0x7fef58011c20 comp rx=0 tx=0).stop 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef6ee33740 1 -- 172.21.15.53:0/1947620685 shutdown_connections 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1947620685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f064d0 0x5594572cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1947620685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1947620685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f271b0 0x5594572caac0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef6ee33740 1 -- 172.21.15.53:0/1947620685 >> 172.21.15.53:0/1947620685 conn(0x559456f1b300 msgr2=0x5594572c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef6ee33740 1 -- 172.21.15.53:0/1947620685 shutdown_connections 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef6ee33740 1 -- 172.21.15.53:0/1947620685 wait complete. 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.188+0000 7fef65b80640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef4c0b4d20 0x7fef4c0b7230 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x5594572c9740 tx=0x7fef5c000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.189+0000 7fef6ee33740 1 -- start start 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.189+0000 7fef6ee33740 1 Processor -- start 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.189+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572d66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.189+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572d6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f271b0 0x5594572e25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6ee33740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559457168ab0 con 0x559456f064d0 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6ee33740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5594571b6680 con 0x559456efe2f0 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6ee33740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5594572d9240 con 0x559456f271b0 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6537f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572d6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6ee33740 10 client.0 _ll_register_callbacks cb 0x559456f3ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef66381640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572d66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6537f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572d6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47912/0 (socket says 172.21.15.53:47912) 2024-08-31T06:28:06.195 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6537f640 1 -- 172.21.15.53:0/1437749731 learned_addr learned my addr 172.21.15.53:0/1437749731 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:06.195 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef66381640 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f271b0 0x5594572e25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6537f640 1 -- 172.21.15.53:0/1437749731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f271b0 msgr2=0x5594572e25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6537f640 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f271b0 0x5594572e25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6537f640 1 -- 172.21.15.53:0/1437749731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 msgr2=0x5594572d66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6537f640 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572d66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6537f640 1 -- 172.21.15.53:0/1437749731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55945700b620 con 0x559456f064d0 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef6537f640 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572d6c40 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fef50009860 tx=0x7fef50030ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e31ee64a76eb40 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.190+0000 7fef497fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.191+0000 7fef497fa640 1 -- 172.21.15.53:0/1437749731 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef50042030 con 0x559456f064d0 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.191+0000 7fef497fa640 1 -- 172.21.15.53:0/1437749731 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 8601+0+0 (secure 0 0 0) 0x7fef50004250 con 0x559456f064d0 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.191+0000 7fef6ee33740 1 -- 172.21.15.53:0/1437749731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef58003970 con 0x559456f064d0 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.191+0000 7fef497fa640 1 -- 172.21.15.53:0/1437749731 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fef50037040 con 0x559456f064d0 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.191+0000 7fef6ee33740 10 client.22503 fetch_fsmap learned FSMap version 83 2024-08-31T06:28:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.191+0000 7fef6ee33740 1 -- 172.21.15.53:0/1437749731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) -- 0x5594572e5350 con 0x559456f064d0 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.191+0000 7fef497fa640 1 -- 172.21.15.53:0/1437749731 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef58003970 con 0x559456f064d0 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.191+0000 7fef497fa640 1 -- 172.21.15.53:0/1437749731 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 83) ==== 8398+0+0 (secure 0 0 0) 0x7fef50003800 con 0x559456f064d0 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.191+0000 7fef6ee33740 10 client.22503 fetch_fsmap finished waiting for FSMap version 83 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.191+0000 7fef6ee33740 10 client.22503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.192+0000 7fef6ee33740 20 client.22503 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.192+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559456ee5d80 0x5594572e8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.192+0000 7fef6ee33740 4 client.22503 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.192+0000 7fef6ee33740 1 -- 172.21.15.53:0/1437749731 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559457241f50 con 0x559456ee5d80 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.192+0000 7fef66381640 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559456ee5d80 0x5594572e8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.192+0000 7fef497fa640 10 client.22503 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.192+0000 7fef66381640 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559456ee5d80 0x5594572e8920 crc :-1 s=READY pgs=542 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48e499080c64a5ae server_cookie=904ba50a6b547417 in_seq=0 out_seq=0 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.194+0000 7fef497fa640 1 -- 172.21.15.53:0/1437749731 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559457241f50 con 0x559456ee5d80 2024-08-31T06:28:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.194+0000 7fef497fa640 10 client.22503 handle_command_reply: tid=0 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.194+0000 7fef6ee33740 1 client.22503 shutdown 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.194+0000 7fef6ee33740 1 -- 172.21.15.53:0/1437749731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 msgr2=0x5594572d6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.194+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572d6c40 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fef50009860 tx=0x7fef50030ce0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.195+0000 7fef6ee33740 1 -- 172.21.15.53:0/1437749731 shutdown_connections 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.195+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559456ee5d80 0x5594572e8920 crc :-1 s=READY pgs=542 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.195+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456f271b0 0x5594572e25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.195+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572d6c40 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.195+0000 7fef497fa640 0 client.22503 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.195+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1437749731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572d66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.195+0000 7fef6ee33740 1 -- 172.21.15.53:0/1437749731 >> 172.21.15.53:0/1437749731 conn(0x559456f1b300 msgr2=0x5594572cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.195+0000 7fef6ee33740 1 -- 172.21.15.53:0/1437749731 shutdown_connections 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.195+0000 7fef6ee33740 1 -- 172.21.15.53:0/1437749731 wait complete. 2024-08-31T06:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.195+0000 7fef6ee33740 20 client.22503 trim_cache size 0 max 16384 2024-08-31T06:28:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.216+0000 7fef6ee33740 1 Processor -- start 2024-08-31T06:28:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.216+0000 7fef6ee33740 1 -- start start 2024-08-31T06:28:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456ee5d80 0x5594572d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456efe2f0 0x5594572d4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572d5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef6ee33740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fef4400e950 con 0x559456f064d0 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef6ee33740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fef44010640 con 0x559456ee5d80 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef6ee33740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef4400f0e0 con 0x559456efe2f0 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef66381640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456ee5d80 0x5594572d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef66381640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456ee5d80 0x5594572d0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:34346/0 (socket says 172.21.15.53:34346) 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef66381640 1 -- 172.21.15.53:0/1393182249 learned_addr learned my addr 172.21.15.53:0/1393182249 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef6537f640 1 --2- 172.21.15.53:0/1393182249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456efe2f0 0x5594572d4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef66381640 1 --2- 172.21.15.53:0/1393182249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572d5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef66381640 1 -- 172.21.15.53:0/1393182249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456efe2f0 msgr2=0x5594572d4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef66381640 1 --2- 172.21.15.53:0/1393182249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456efe2f0 0x5594572d4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef66381640 1 -- 172.21.15.53:0/1393182249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 msgr2=0x5594572d5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef66381640 1 --2- 172.21.15.53:0/1393182249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572d5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.217+0000 7fef66381640 1 -- 172.21.15.53:0/1393182249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594572d4990 con 0x559456ee5d80 2024-08-31T06:28:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.218+0000 7fef66381640 1 --2- 172.21.15.53:0/1393182249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456ee5d80 0x5594572d0850 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fef58000f80 tx=0x7fef5800ffd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5deef752efa45df1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.218+0000 7fef4b7fe640 1 -- 172.21.15.53:0/1393182249 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5801d040 con 0x559456ee5d80 2024-08-31T06:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.218+0000 7fef4b7fe640 1 -- 172.21.15.53:0/1393182249 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef58005030 con 0x559456ee5d80 2024-08-31T06:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.218+0000 7fef4b7fe640 1 -- 172.21.15.53:0/1393182249 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58019690 con 0x559456ee5d80 2024-08-31T06:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.219+0000 7fef6ee33740 1 -- 172.21.15.53:0/1393182249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456ee5d80 msgr2=0x5594572d0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.219+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1393182249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456ee5d80 0x5594572d0850 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fef58000f80 tx=0x7fef5800ffd0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.219+0000 7fef6ee33740 1 -- 172.21.15.53:0/1393182249 shutdown_connections 2024-08-31T06:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.219+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1393182249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572d5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.219+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1393182249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456efe2f0 0x5594572d4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.219+0000 7fef6ee33740 1 --2- 172.21.15.53:0/1393182249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456ee5d80 0x5594572d0850 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.219+0000 7fef6ee33740 1 -- 172.21.15.53:0/1393182249 >> 172.21.15.53:0/1393182249 conn(0x559456f1b300 msgr2=0x5594572d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.219+0000 7fef6ee33740 1 -- 172.21.15.53:0/1393182249 shutdown_connections 2024-08-31T06:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.219+0000 7fef6ee33740 1 -- 172.21.15.53:0/1393182249 wait complete. 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.219+0000 7fef6ee33740 1 -- start start 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef6ee33740 1 Processor -- start 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456ee5d80 0x5594572da650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572dab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef6ee33740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572db0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef6ee33740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fef4400ff70 con 0x559456f064d0 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef6ee33740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fef4400f870 con 0x559456efe2f0 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef6ee33740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef4400c950 con 0x559456ee5d80 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef6ee33740 10 client.0 _ll_register_callbacks cb 0x7fef5c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef66381640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572db0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef66381640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456ee5d80 0x5594572da650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef66381640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572db0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47944/0 (socket says 172.21.15.53:47944) 2024-08-31T06:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.220+0000 7fef66381640 1 -- 172.21.15.53:0/3480717446 learned_addr learned my addr 172.21.15.53:0/3480717446 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef6537f640 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572dab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef66381640 1 -- 172.21.15.53:0/3480717446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456ee5d80 msgr2=0x5594572da650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef66381640 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456ee5d80 0x5594572da650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef66381640 1 -- 172.21.15.53:0/3480717446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 msgr2=0x5594572dab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef66381640 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572dab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef66381640 1 -- 172.21.15.53:0/3480717446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594573523f0 con 0x559456f064d0 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef6537f640 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572dab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef66381640 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572db0d0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x559456f3ea40 tx=0x7fef58011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8715abe723714a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef497fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef497fa640 1 -- 172.21.15.53:0/3480717446 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58045060 con 0x559456f064d0 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef497fa640 1 -- 172.21.15.53:0/3480717446 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 8601+0+0 (secure 0 0 0) 0x7fef580051e0 con 0x559456f064d0 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.221+0000 7fef6ee33740 1 -- 172.21.15.53:0/3480717446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef58005030 con 0x559456f064d0 2024-08-31T06:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.222+0000 7fef497fa640 1 -- 172.21.15.53:0/3480717446 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fef5801d040 con 0x559456f064d0 2024-08-31T06:28:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.222+0000 7fef6ee33740 10 client.22509 fetch_fsmap learned FSMap version 83 2024-08-31T06:28:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.222+0000 7fef6ee33740 1 -- 172.21.15.53:0/3480717446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) -- 0x559457353680 con 0x559456f064d0 2024-08-31T06:28:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.222+0000 7fef497fa640 1 -- 172.21.15.53:0/3480717446 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef58005030 con 0x559456f064d0 2024-08-31T06:28:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.222+0000 7fef497fa640 1 -- 172.21.15.53:0/3480717446 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 83) ==== 8398+0+0 (secure 0 0 0) 0x7fef58023040 con 0x559456f064d0 2024-08-31T06:28:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.222+0000 7fef6ee33740 10 client.22509 fetch_fsmap finished waiting for FSMap version 83 2024-08-31T06:28:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.222+0000 7fef6ee33740 10 client.22509 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.222+0000 7fef6ee33740 20 client.22509 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.222+0000 7fef6ee33740 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559456f271b0 0x559457355bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.222+0000 7fef6ee33740 4 client.22509 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:28:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.222+0000 7fef6ee33740 1 -- 172.21.15.53:0/3480717446 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55945723d9f0 con 0x559456f271b0 2024-08-31T06:28:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.223+0000 7fef6537f640 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559456f271b0 0x559457355bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:06.229 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:05 smithi053 ceph-mon[18924]: pgmap v1051: 97 pgs: 97 active+clean; 942 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 345 op/s 2024-08-31T06:28:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.223+0000 7fef497fa640 10 client.22509 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.223+0000 7fef6537f640 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559456f271b0 0x559457355bc0 crc :-1 s=READY pgs=543 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1995ac4cfc94c1 server_cookie=cd0e1ba2fe3bc8f1 in_seq=0 out_seq=0 2024-08-31T06:28:06.354 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.350+0000 7fef497fa640 1 -- 172.21.15.53:0/3480717446 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55945723d9f0 con 0x559456f271b0 2024-08-31T06:28:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.350+0000 7fef497fa640 10 client.22509 handle_command_reply: tid=0 2024-08-31T06:28:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.350+0000 7fef6ee33740 1 client.22509 shutdown 2024-08-31T06:28:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.350+0000 7fef6ee33740 1 -- 172.21.15.53:0/3480717446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 msgr2=0x5594572db0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.350+0000 7fef6ee33740 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572db0d0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x559456f3ea40 tx=0x7fef58011c20 comp rx=0 tx=0).stop 2024-08-31T06:28:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.350+0000 7fef6ee33740 1 -- 172.21.15.53:0/3480717446 shutdown_connections 2024-08-31T06:28:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.350+0000 7fef6ee33740 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559456f271b0 0x559457355bc0 crc :-1 s=READY pgs=543 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.350+0000 7fef497fa640 0 client.22509 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.350+0000 7fef6ee33740 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559456f064d0 0x5594572db0d0 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.350+0000 7fef6ee33740 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559456efe2f0 0x5594572dab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.350+0000 7fef6ee33740 1 --2- 172.21.15.53:0/3480717446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559456ee5d80 0x5594572da650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.351+0000 7fef6ee33740 1 -- 172.21.15.53:0/3480717446 >> 172.21.15.53:0/3480717446 conn(0x559456f1b300 msgr2=0x5594572d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.351+0000 7fef6ee33740 1 -- 172.21.15.53:0/3480717446 shutdown_connections 2024-08-31T06:28:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.351+0000 7fef6ee33740 1 -- 172.21.15.53:0/3480717446 wait complete. 2024-08-31T06:28:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.351+0000 7fef6ee33740 20 client.22509 trim_cache size 0 max 16384 2024-08-31T06:28:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:28:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:28:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:28:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:28:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.352+0000 7fef67de4640 1 -- 172.21.15.53:0/2660808374 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef4c0b4d20 msgr2=0x7fef4c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.352+0000 7fef67de4640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef4c0b4d20 0x7fef4c0b7230 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x5594572c9740 tx=0x7fef5c000bc0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.352+0000 7fef67de4640 1 -- 172.21.15.53:0/2660808374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef60103870 msgr2=0x7fef6019c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.352+0000 7fef67de4640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef60103870 0x7fef6019c150 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00e9c0 tx=0x7fef5c00edc0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.352+0000 7fef67de4640 1 -- 172.21.15.53:0/2660808374 shutdown_connections 2024-08-31T06:28:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.352+0000 7fef67de4640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fef4c0b4d20 0x7fef4c0b7230 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.352+0000 7fef67de4640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef60109af0 0x7fef601a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.352+0000 7fef67de4640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef601091a0 0x7fef6019c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.352+0000 7fef67de4640 1 --2- 172.21.15.53:0/2660808374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef60103870 0x7fef6019c150 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.352+0000 7fef67de4640 1 -- 172.21.15.53:0/2660808374 >> 172.21.15.53:0/2660808374 conn(0x7fef600ff2b0 msgr2=0x7fef60107700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.353+0000 7fef67de4640 1 -- 172.21.15.53:0/2660808374 shutdown_connections 2024-08-31T06:28:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:06.353+0000 7fef67de4640 1 -- 172.21.15.53:0/2660808374 wait complete. 2024-08-31T06:28:06.523 INFO:tasks.workunit.client.0.smithi053.stdout: 10 59903 5.19 MB/sec execute 474 sec latency 100.690 ms 2024-08-31T06:28:07.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:06 smithi130 ceph-mon[22266]: osdmap e109: 12 total, 12 up, 12 in 2024-08-31T06:28:07.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:06 smithi153 ceph-mon[22320]: osdmap e109: 12 total, 12 up, 12 in 2024-08-31T06:28:07.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:06 smithi053 ceph-mon[18924]: osdmap e109: 12 total, 12 up, 12 in 2024-08-31T06:28:07.394 INFO:tasks.workunit.client.0.smithi053.stdout: 10 60078 5.20 MB/sec execute 475 sec latency 66.300 ms 2024-08-31T06:28:07.564 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:28:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:28:08.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:07 smithi130 ceph-mon[22266]: pgmap v1053: 97 pgs: 97 active+clean; 937 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 290 op/s 2024-08-31T06:28:08.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:07 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:07 smithi153 ceph-mon[22320]: pgmap v1053: 97 pgs: 97 active+clean; 937 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 290 op/s 2024-08-31T06:28:08.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:07 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:08.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:07 smithi053 ceph-mon[18924]: pgmap v1053: 97 pgs: 97 active+clean; 937 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 290 op/s 2024-08-31T06:28:08.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:07 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:08.394 INFO:tasks.workunit.client.0.smithi053.stdout: 10 60239 5.20 MB/sec execute 476 sec latency 82.933 ms 2024-08-31T06:28:08.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.600+0000 7fb524305640 1 -- 172.21.15.53:0/3080445806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c105010 msgr2=0x7fb51c10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:08.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.600+0000 7fb524305640 1 --2- 172.21.15.53:0/3080445806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c105010 0x7fb51c10d650 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fb50c009900 tx=0x7fb50c02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.600+0000 7fb524305640 1 -- 172.21.15.53:0/3080445806 shutdown_connections 2024-08-31T06:28:08.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.600+0000 7fb524305640 1 --2- 172.21.15.53:0/3080445806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb51c10db90 0x7fb51c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.600+0000 7fb524305640 1 --2- 172.21.15.53:0/3080445806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c105010 0x7fb51c10d650 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.600+0000 7fb524305640 1 --2- 172.21.15.53:0/3080445806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c1045e0 0x7fb51c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.600+0000 7fb524305640 1 -- 172.21.15.53:0/3080445806 >> 172.21.15.53:0/3080445806 conn(0x7fb51c0794d0 msgr2=0x7fb51c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:08.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.600+0000 7fb524305640 1 -- 172.21.15.53:0/3080445806 shutdown_connections 2024-08-31T06:28:08.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.600+0000 7fb524305640 1 -- 172.21.15.53:0/3080445806 wait complete. 2024-08-31T06:28:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.601+0000 7fb524305640 1 Processor -- start 2024-08-31T06:28:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.601+0000 7fb524305640 1 -- start start 2024-08-31T06:28:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb524305640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c1045e0 0x7fb51c19a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb524305640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c105010 0x7fb51c19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb524305640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb51c10db90 0x7fb51c19f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb524305640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c1136f0 con 0x7fb51c105010 2024-08-31T06:28:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb524305640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c113570 con 0x7fb51c1045e0 2024-08-31T06:28:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb524305640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c113870 con 0x7fb51c10db90 2024-08-31T06:28:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb5228a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb51c10db90 0x7fb51c19f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb5220a1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c1045e0 0x7fb51c19a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb5218a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c105010 0x7fb51c19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb5220a1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c1045e0 0x7fb51c19a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:34384/0 (socket says 172.21.15.53:34384) 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb5220a1640 1 -- 172.21.15.53:0/3178604060 learned_addr learned my addr 172.21.15.53:0/3178604060 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb5220a1640 1 -- 172.21.15.53:0/3178604060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb51c10db90 msgr2=0x7fb51c19f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb5220a1640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb51c10db90 0x7fb51c19f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb5220a1640 1 -- 172.21.15.53:0/3178604060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c105010 msgr2=0x7fb51c19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb5220a1640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c105010 0x7fb51c19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.602+0000 7fb5220a1640 1 -- 172.21.15.53:0/3178604060 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c1a00f0 con 0x7fb51c1045e0 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.603+0000 7fb5228a2640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb51c10db90 0x7fb51c19f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.603+0000 7fb5220a1640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c1045e0 0x7fb51c19a180 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb51800e9c0 tx=0x7fb51800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.603+0000 7fb5137fe640 1 -- 172.21.15.53:0/3178604060 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51800cde0 con 0x7fb51c1045e0 2024-08-31T06:28:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.603+0000 7fb524305640 1 -- 172.21.15.53:0/3178604060 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51c1a03e0 con 0x7fb51c1045e0 2024-08-31T06:28:08.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.603+0000 7fb5137fe640 1 -- 172.21.15.53:0/3178604060 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5180108c0 con 0x7fb51c1045e0 2024-08-31T06:28:08.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.603+0000 7fb5137fe640 1 -- 172.21.15.53:0/3178604060 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518018820 con 0x7fb51c1045e0 2024-08-31T06:28:08.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.603+0000 7fb524305640 1 -- 172.21.15.53:0/3178604060 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51c1023d0 con 0x7fb51c1045e0 2024-08-31T06:28:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb52a87a740 1 Processor -- start 2024-08-31T06:28:08.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb52a87a740 1 -- start start 2024-08-31T06:28:08.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb5137fe640 1 -- 172.21.15.53:0/3178604060 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb51801f020 con 0x7fb51c1045e0 2024-08-31T06:28:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f8000c070 0x558f803b1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffe31b0 0x558f803b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffeb390 0x558f803b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb52a87a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558f80328630 con 0x558f7ffe31b0 2024-08-31T06:28:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb52a87a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558f80317bc0 con 0x558f7ffeb390 2024-08-31T06:28:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb52a87a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558f8031bb70 con 0x558f8000c070 2024-08-31T06:28:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb5228a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f8000c070 0x558f803b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb5228a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f8000c070 0x558f803b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37412/0 (socket says 172.21.15.53:37412) 2024-08-31T06:28:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.607+0000 7fb5228a2640 1 -- 172.21.15.53:0/543618383 learned_addr learned my addr 172.21.15.53:0/543618383 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.608+0000 7fb5218a0640 1 --2- 172.21.15.53:0/543618383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffeb390 0x558f803b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.608+0000 7fb5228a2640 1 -- 172.21.15.53:0/543618383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffeb390 msgr2=0x558f803b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.608+0000 7fb5228a2640 1 --2- 172.21.15.53:0/543618383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffeb390 0x558f803b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.608+0000 7fb5228a2640 1 -- 172.21.15.53:0/543618383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffe31b0 msgr2=0x558f803b1840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:28:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.608+0000 7fb5228a2640 1 --2- 172.21.15.53:0/543618383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffe31b0 0x558f803b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.608+0000 7fb5228a2640 1 -- 172.21.15.53:0/543618383 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f80077650 con 0x558f8000c070 2024-08-31T06:28:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.608+0000 7fb5228a2640 1 --2- 172.21.15.53:0/543618383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f8000c070 0x558f803b1300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb5140117e0 tx=0x7fb514011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=527ed1673dd1d9a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.609+0000 7fb510d9a640 1 -- 172.21.15.53:0/543618383 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514011310 con 0x558f8000c070 2024-08-31T06:28:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.609+0000 7fb510d9a640 1 -- 172.21.15.53:0/543618383 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb514003e00 con 0x558f8000c070 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.609+0000 7fb510d9a640 1 -- 172.21.15.53:0/543618383 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514004430 con 0x558f8000c070 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.609+0000 7fb5137fe640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5080b4d20 0x7fb5080b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.609+0000 7fb52a87a740 1 -- 172.21.15.53:0/543618383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f8000c070 msgr2=0x558f803b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.609+0000 7fb52a87a740 1 --2- 172.21.15.53:0/543618383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f8000c070 0x558f803b1300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb5140117e0 tx=0x7fb514011ca0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.610+0000 7fb52a87a740 1 -- 172.21.15.53:0/543618383 shutdown_connections 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.610+0000 7fb52a87a740 1 --2- 172.21.15.53:0/543618383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffeb390 0x558f803b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.610+0000 7fb52a87a740 1 --2- 172.21.15.53:0/543618383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffe31b0 0x558f803b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.610+0000 7fb52a87a740 1 --2- 172.21.15.53:0/543618383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f8000c070 0x558f803b1300 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.610+0000 7fb52a87a740 1 -- 172.21.15.53:0/543618383 >> 172.21.15.53:0/543618383 conn(0x558f80000460 msgr2=0x558f803af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.610+0000 7fb5137fe640 1 -- 172.21.15.53:0/3178604060 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 8601+0+0 (secure 0 0 0) 0x7fb5180e57a0 con 0x7fb51c1045e0 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.610+0000 7fb5220a1640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5080b4d20 0x7fb5080b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.610+0000 7fb52a87a740 1 -- 172.21.15.53:0/543618383 shutdown_connections 2024-08-31T06:28:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.610+0000 7fb52a87a740 1 -- 172.21.15.53:0/543618383 wait complete. 2024-08-31T06:28:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb52a87a740 1 -- start start 2024-08-31T06:28:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb5220a1640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5080b4d20 0x7fb5080b7230 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x558f803aff80 tx=0x7fb51800c850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb52a87a740 1 Processor -- start 2024-08-31T06:28:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 0x558f803c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803c5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f8000c070 0x558f803d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb52a87a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558f8017a700 con 0x558f7ffeb390 2024-08-31T06:28:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb5218a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb5228a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 0x558f803c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb5228a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 0x558f803c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:37426/0 (socket says 172.21.15.53:37426) 2024-08-31T06:28:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb5218a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47988/0 (socket says 172.21.15.53:47988) 2024-08-31T06:28:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.611+0000 7fb5228a2640 1 -- 172.21.15.53:0/4089294294 learned_addr learned my addr 172.21.15.53:0/4089294294 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb52a87a740 1 -- 172.21.15.53:0/4089294294 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558f8029e700 con 0x558f8000c070 2024-08-31T06:28:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb52a87a740 1 -- 172.21.15.53:0/4089294294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558f803c8210 con 0x558f7ffe31b0 2024-08-31T06:28:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb52a87a740 10 client.0 _ll_register_callbacks cb 0x558f802cddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb5228a2640 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f8000c070 0x558f803d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb5228a2640 1 -- 172.21.15.53:0/4089294294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f8000c070 msgr2=0x558f803d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb5228a2640 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f8000c070 0x558f803d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb5228a2640 1 -- 172.21.15.53:0/4089294294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 msgr2=0x558f803c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb5228a2640 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb5228a2640 1 -- 172.21.15.53:0/4089294294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f802d78b0 con 0x558f7ffe31b0 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb5218a0640 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb5228a2640 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 0x558f803c52c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb514005b40 tx=0x7fb514005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75f09a2a36721102 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb505ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.612+0000 7fb505ffb640 1 -- 172.21.15.53:0/4089294294 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514022040 con 0x558f7ffe31b0 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb52a87a740 1 -- 172.21.15.53:0/4089294294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb514003e00 con 0x558f7ffe31b0 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb505ffb640 1 -- 172.21.15.53:0/4089294294 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 8601+0+0 (secure 0 0 0) 0x7fb51400fdd0 con 0x558f7ffe31b0 2024-08-31T06:28:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb505ffb640 1 -- 172.21.15.53:0/4089294294 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fb5140041b0 con 0x558f7ffe31b0 2024-08-31T06:28:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb52a87a740 10 client.31156 fetch_fsmap learned FSMap version 84 2024-08-31T06:28:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb52a87a740 1 -- 172.21.15.53:0/4089294294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) -- 0x558f803d4040 con 0x558f7ffe31b0 2024-08-31T06:28:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb505ffb640 1 -- 172.21.15.53:0/4089294294 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb514003e00 con 0x558f7ffe31b0 2024-08-31T06:28:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb505ffb640 1 -- 172.21.15.53:0/4089294294 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 84) ==== 8394+0+0 (secure 0 0 0) 0x7fb514028020 con 0x558f7ffe31b0 2024-08-31T06:28:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb52a87a740 10 client.31156 fetch_fsmap finished waiting for FSMap version 84 2024-08-31T06:28:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb52a87a740 10 client.31156 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb52a87a740 20 client.31156 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb52a87a740 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558f7ffca9f0 0x558f803d73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb52a87a740 4 client.31156 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.613+0000 7fb52a87a740 1 -- 172.21.15.53:0/4089294294 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f8032a580 con 0x558f7ffca9f0 2024-08-31T06:28:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.614+0000 7fb5218a0640 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558f7ffca9f0 0x558f803d73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.614+0000 7fb505ffb640 10 client.31156 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:08.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.614+0000 7fb5218a0640 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558f7ffca9f0 0x558f803d73a0 crc :-1 s=READY pgs=544 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329432f3f4ea4db6 server_cookie=f56476295785b5b in_seq=0 out_seq=0 2024-08-31T06:28:08.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb505ffb640 1 -- 172.21.15.53:0/4089294294 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558f8032a580 con 0x558f7ffca9f0 2024-08-31T06:28:08.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb505ffb640 10 client.31156 handle_command_reply: tid=0 2024-08-31T06:28:08.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 1 client.31156 shutdown 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 1 -- 172.21.15.53:0/4089294294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 msgr2=0x558f803c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 0x558f803c52c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb514005b40 tx=0x7fb514005a90 comp rx=0 tx=0).stop 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 1 -- 172.21.15.53:0/4089294294 shutdown_connections 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558f7ffca9f0 0x558f803d73a0 crc :-1 s=READY pgs=544 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f8000c070 0x558f803d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 1 --2- 172.21.15.53:0/4089294294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 0x558f803c52c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb505ffb640 0 client.31156 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 1 -- 172.21.15.53:0/4089294294 >> 172.21.15.53:0/4089294294 conn(0x558f80000460 msgr2=0x558f803ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 1 -- 172.21.15.53:0/4089294294 shutdown_connections 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 1 -- 172.21.15.53:0/4089294294 wait complete. 2024-08-31T06:28:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.615+0000 7fb52a87a740 20 client.31156 trim_cache size 0 max 16384 2024-08-31T06:28:08.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.646+0000 7fb52a87a740 1 Processor -- start 2024-08-31T06:28:08.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.646+0000 7fb52a87a740 1 -- start start 2024-08-31T06:28:08.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.646+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 0x558f803c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.646+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.646+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f8000c070 0x558f803d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.646+0000 7fb52a87a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c1ad430 con 0x558f7ffeb390 2024-08-31T06:28:08.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.646+0000 7fb52a87a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c1af0f0 con 0x558f8000c070 2024-08-31T06:28:08.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.646+0000 7fb52a87a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c1adbc0 con 0x558f7ffe31b0 2024-08-31T06:28:08.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.646+0000 7fb5218a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.646+0000 7fb5218a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803d1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48000/0 (socket says 172.21.15.53:48000) 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.646+0000 7fb5218a0640 1 -- 172.21.15.53:0/1075711206 learned_addr learned my addr 172.21.15.53:0/1075711206 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.647+0000 7fb5228a2640 1 --2- 172.21.15.53:0/1075711206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f8000c070 0x558f803d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.647+0000 7fb5228a2640 1 --2- 172.21.15.53:0/1075711206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 0x558f803c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.647+0000 7fb5218a0640 1 -- 172.21.15.53:0/1075711206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 msgr2=0x558f803c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.647+0000 7fb5218a0640 1 --2- 172.21.15.53:0/1075711206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 0x558f803c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.647+0000 7fb5218a0640 1 -- 172.21.15.53:0/1075711206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f8000c070 msgr2=0x558f803d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.647+0000 7fb5218a0640 1 --2- 172.21.15.53:0/1075711206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f8000c070 0x558f803d19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.647+0000 7fb5218a0640 1 -- 172.21.15.53:0/1075711206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f803a93c0 con 0x558f7ffeb390 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.647+0000 7fb5218a0640 1 --2- 172.21.15.53:0/1075711206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803d1470 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fb50c005ab0 tx=0x7fb50c004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffd91efc0fbcae8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.647+0000 7fb507fff640 1 -- 172.21.15.53:0/1075711206 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c035040 con 0x558f7ffeb390 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.647+0000 7fb507fff640 1 -- 172.21.15.53:0/1075711206 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb50c003c80 con 0x558f7ffeb390 2024-08-31T06:28:08.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.647+0000 7fb507fff640 1 -- 172.21.15.53:0/1075711206 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c03cb60 con 0x558f7ffeb390 2024-08-31T06:28:08.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.649+0000 7fb52a87a740 1 -- 172.21.15.53:0/1075711206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 msgr2=0x558f803d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.649+0000 7fb52a87a740 1 --2- 172.21.15.53:0/1075711206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803d1470 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fb50c005ab0 tx=0x7fb50c004390 comp rx=0 tx=0).stop 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.649+0000 7fb52a87a740 1 -- 172.21.15.53:0/1075711206 shutdown_connections 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.649+0000 7fb52a87a740 1 --2- 172.21.15.53:0/1075711206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f8000c070 0x558f803d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.649+0000 7fb52a87a740 1 --2- 172.21.15.53:0/1075711206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f7ffeb390 0x558f803d1470 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.649+0000 7fb52a87a740 1 --2- 172.21.15.53:0/1075711206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffe31b0 0x558f803c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.649+0000 7fb52a87a740 1 -- 172.21.15.53:0/1075711206 >> 172.21.15.53:0/1075711206 conn(0x558f80000460 msgr2=0x558f803c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.649+0000 7fb52a87a740 1 -- 172.21.15.53:0/1075711206 shutdown_connections 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.649+0000 7fb52a87a740 1 -- 172.21.15.53:0/1075711206 wait complete. 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.650+0000 7fb52a87a740 1 -- start start 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.650+0000 7fb52a87a740 1 Processor -- start 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.650+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffe31b0 0x558f803c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.650+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffeb390 0x558f803c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.650+0000 7fb52a87a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f8000c070 0x558f80440ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.650+0000 7fb52a87a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c1aea20 con 0x558f8000c070 2024-08-31T06:28:08.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.650+0000 7fb52a87a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c1ae350 con 0x558f7ffe31b0 2024-08-31T06:28:08.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.650+0000 7fb52a87a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c1ab430 con 0x558f7ffeb390 2024-08-31T06:28:08.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.650+0000 7fb52a87a740 10 client.0 _ll_register_callbacks cb 0x7fb5140093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:08.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb5228a2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffe31b0 0x558f803c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb5228a2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffe31b0 0x558f803c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:34442/0 (socket says 172.21.15.53:34442) 2024-08-31T06:28:08.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb5228a2640 1 -- 172.21.15.53:0/1380472158 learned_addr learned my addr 172.21.15.53:0/1380472158 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:08.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb5218a0640 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffeb390 0x558f803c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb5228a2640 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f8000c070 0x558f80440ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb5228a2640 1 -- 172.21.15.53:0/1380472158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffeb390 msgr2=0x558f803c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:08.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb5228a2640 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffeb390 0x558f803c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb5228a2640 1 -- 172.21.15.53:0/1380472158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f8000c070 msgr2=0x558f80440ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb5228a2640 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f8000c070 0x558f80440ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb5228a2640 1 -- 172.21.15.53:0/1380472158 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f803ca590 con 0x558f7ffe31b0 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb5228a2640 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffe31b0 0x558f803c97b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb5140117e0 tx=0x7fb514005a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=511b56abef426b83 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.651+0000 7fb505ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.652+0000 7fb505ffb640 1 -- 172.21.15.53:0/1380472158 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514005bd0 con 0x558f7ffe31b0 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.652+0000 7fb52a87a740 1 -- 172.21.15.53:0/1380472158 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb50c003c80 con 0x558f7ffe31b0 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.652+0000 7fb505ffb640 1 -- 172.21.15.53:0/1380472158 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 8601+0+0 (secure 0 0 0) 0x7fb514003ef0 con 0x558f7ffe31b0 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.652+0000 7fb505ffb640 1 -- 172.21.15.53:0/1380472158 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fb51400fe50 con 0x558f7ffe31b0 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.652+0000 7fb52a87a740 10 client.31169 fetch_fsmap learned FSMap version 84 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.652+0000 7fb52a87a740 1 -- 172.21.15.53:0/1380472158 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) -- 0x558f804420e0 con 0x558f7ffe31b0 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.652+0000 7fb505ffb640 1 -- 172.21.15.53:0/1380472158 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb50c003c80 con 0x558f7ffe31b0 2024-08-31T06:28:08.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.653+0000 7fb505ffb640 1 -- 172.21.15.53:0/1380472158 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 84) ==== 8394+0+0 (secure 0 0 0) 0x7fb51403b070 con 0x558f7ffe31b0 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.653+0000 7fb52a87a740 10 client.31169 fetch_fsmap finished waiting for FSMap version 84 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.653+0000 7fb52a87a740 10 client.31169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.653+0000 7fb52a87a740 20 client.31169 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.653+0000 7fb52a87a740 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558f7ff9fda0 0x558f804447e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.653+0000 7fb52a87a740 4 client.31169 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.653+0000 7fb52a87a740 1 -- 172.21.15.53:0/1380472158 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f80326020 con 0x558f7ff9fda0 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.653+0000 7fb5218a0640 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558f7ff9fda0 0x558f804447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.653+0000 7fb505ffb640 10 client.31169 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.654+0000 7fb5218a0640 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558f7ff9fda0 0x558f804447e0 crc :-1 s=READY pgs=545 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba17d9027ef3ce4c server_cookie=ab74be804d3d4e0f in_seq=0 out_seq=0 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.654+0000 7fb505ffb640 1 -- 172.21.15.53:0/1380472158 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8042 (crc 0 0 0) 0x558f80326020 con 0x558f7ff9fda0 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.654+0000 7fb505ffb640 10 client.31169 handle_command_reply: tid=0 2024-08-31T06:28:08.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 1 client.31169 shutdown 2024-08-31T06:28:08.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 1 -- 172.21.15.53:0/1380472158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffe31b0 msgr2=0x558f803c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:08.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffe31b0 0x558f803c97b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb5140117e0 tx=0x7fb514005a90 comp rx=0 tx=0).stop 2024-08-31T06:28:08.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 1 -- 172.21.15.53:0/1380472158 shutdown_connections 2024-08-31T06:28:08.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558f7ff9fda0 0x558f804447e0 crc :-1 s=READY pgs=545 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f8000c070 0x558f80440ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558f7ffeb390 0x558f803c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 1 --2- 172.21.15.53:0/1380472158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f7ffe31b0 0x558f803c97b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 1 -- 172.21.15.53:0/1380472158 >> 172.21.15.53:0/1380472158 conn(0x558f80000460 msgr2=0x558f803b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:08.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb505ffb640 0 client.31169 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:08.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 1 -- 172.21.15.53:0/1380472158 shutdown_connections 2024-08-31T06:28:08.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 1 -- 172.21.15.53:0/1380472158 wait complete. 2024-08-31T06:28:08.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.655+0000 7fb52a87a740 20 client.31169 trim_cache size 0 max 16384 2024-08-31T06:28:08.662 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:28:08.662 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:28:08.662 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:28:08.662 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:28:08.662 INFO:teuthology.orchestra.run.smithi053.stdout: "cac6d546-f1c8-4203-803b-7c8d84c48507": { 2024-08-31T06:28:08.662 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:27:34.520218+0000", 2024-08-31T06:28:08.662 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.662 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.662 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.662 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.662 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.663 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.664 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:25:55.673122+0000", 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.665 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:28:08.666 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.668 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:28:08.669 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: "857f8219-039c-44d2-8dd7-af494d80e735": { 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:26:48.510100+0000", 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.671 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:28:08.672 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.673 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:28:08.674 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.675 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.676 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:28:08.677 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:08.679 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:28:08.679 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:28:08.679 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:08.679 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:08.679 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:08.679 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:08.679 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:08.679 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:28:08.679 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:28:08.679 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:28:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.656+0000 7fb524305640 1 -- 172.21.15.53:0/3178604060 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5080b4d20 msgr2=0x7fb5080b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.656+0000 7fb524305640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5080b4d20 0x7fb5080b7230 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x558f803aff80 tx=0x7fb51800c850 comp rx=0 tx=0).stop 2024-08-31T06:28:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.656+0000 7fb524305640 1 -- 172.21.15.53:0/3178604060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c1045e0 msgr2=0x7fb51c19a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.656+0000 7fb524305640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c1045e0 0x7fb51c19a180 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb51800e9c0 tx=0x7fb51800ee80 comp rx=0 tx=0).stop 2024-08-31T06:28:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.657+0000 7fb524305640 1 -- 172.21.15.53:0/3178604060 shutdown_connections 2024-08-31T06:28:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.657+0000 7fb524305640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb5080b4d20 0x7fb5080b7230 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.657+0000 7fb524305640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb51c10db90 0x7fb51c19f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.657+0000 7fb524305640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c105010 0x7fb51c19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.657+0000 7fb524305640 1 --2- 172.21.15.53:0/3178604060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51c1045e0 0x7fb51c19a180 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.657+0000 7fb524305640 1 -- 172.21.15.53:0/3178604060 >> 172.21.15.53:0/3178604060 conn(0x7fb51c0794d0 msgr2=0x7fb51c100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.657+0000 7fb524305640 1 -- 172.21.15.53:0/3178604060 shutdown_connections 2024-08-31T06:28:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:08.657+0000 7fb524305640 1 -- 172.21.15.53:0/3178604060 wait complete. 2024-08-31T06:28:09.394 INFO:tasks.workunit.client.0.smithi053.stdout: 10 60367 5.21 MB/sec execute 477 sec latency 87.614 ms 2024-08-31T06:28:09.636 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:28:09.636 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:28:10.011 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:28:10.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:09 smithi053 ceph-mon[18924]: pgmap v1054: 97 pgs: 97 active+clean; 931 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-08-31T06:28:10.140 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:09 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:09 smithi153 ceph-mon[22320]: pgmap v1054: 97 pgs: 97 active+clean; 931 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-08-31T06:28:10.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:09 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:09 smithi130 ceph-mon[22266]: pgmap v1054: 97 pgs: 97 active+clean; 931 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-08-31T06:28:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:09 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:10.394 INFO:tasks.workunit.client.0.smithi053.stdout: 10 60510 5.21 MB/sec execute 478 sec latency 81.822 ms 2024-08-31T06:28:10.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.598+0000 7f4afc68b640 1 -- 172.21.15.53:0/1467836060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41045f0 msgr2=0x7f4af4104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.598+0000 7f4afc68b640 1 --2- 172.21.15.53:0/1467836060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41045f0 0x7f4af4104a00 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009900 tx=0x7f4af002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.598+0000 7f4afc68b640 1 -- 172.21.15.53:0/1467836060 shutdown_connections 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.598+0000 7f4afc68b640 1 --2- 172.21.15.53:0/1467836060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4af410dba0 0x7f4af41100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.598+0000 7f4afc68b640 1 --2- 172.21.15.53:0/1467836060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4af4105020 0x7f4af410d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.598+0000 7f4afc68b640 1 --2- 172.21.15.53:0/1467836060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41045f0 0x7f4af4104a00 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.598+0000 7f4afc68b640 1 -- 172.21.15.53:0/1467836060 >> 172.21.15.53:0/1467836060 conn(0x7f4af40794d0 msgr2=0x7f4af40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.599+0000 7f4afc68b640 1 -- 172.21.15.53:0/1467836060 shutdown_connections 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.599+0000 7f4afc68b640 1 -- 172.21.15.53:0/1467836060 wait complete. 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4afc68b640 1 Processor -- start 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4afc68b640 1 -- start start 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4afc68b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41045f0 0x7f4af4197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:10.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4afc68b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4af4105020 0x7f4af4198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4afc68b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4af410dba0 0x7f4af419d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4afa427640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41045f0 0x7f4af4197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4afc68b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4af41114e0 con 0x7f4af41045f0 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4afc68b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4af4111360 con 0x7f4af4105020 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4afc68b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4af4111660 con 0x7f4af410dba0 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4af9c26640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4af4105020 0x7f4af4198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4af9c26640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4af4105020 0x7f4af4198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:34470/0 (socket says 172.21.15.53:34470) 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4af9c26640 1 -- 172.21.15.53:0/1624680632 learned_addr learned my addr 172.21.15.53:0/1624680632 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.600+0000 7f4afac28640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4af410dba0 0x7f4af419d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.601+0000 7f4afac28640 1 -- 172.21.15.53:0/1624680632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4af4105020 msgr2=0x7f4af4198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.601+0000 7f4afac28640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4af4105020 0x7f4af4198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.601+0000 7f4afac28640 1 -- 172.21.15.53:0/1624680632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41045f0 msgr2=0x7f4af4197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:10.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.601+0000 7f4afac28640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41045f0 0x7f4af4197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.601+0000 7f4afac28640 1 -- 172.21.15.53:0/1624680632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af419df60 con 0x7f4af410dba0 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.601+0000 7f4afac28640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4af410dba0 0x7f4af419d830 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00b990 tx=0x7f4aec00be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.601+0000 7f4aeb7fe640 1 -- 172.21.15.53:0/1624680632 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec004b20 con 0x7f4af410dba0 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.602+0000 7f4aeb7fe640 1 -- 172.21.15.53:0/1624680632 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aec010d00 con 0x7f4af410dba0 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.602+0000 7f4afc68b640 1 -- 172.21.15.53:0/1624680632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af419e250 con 0x7f4af410dba0 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.602+0000 7f4aeb7fe640 1 -- 172.21.15.53:0/1624680632 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0056f0 con 0x7f4af410dba0 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.602+0000 7f4afc68b640 1 -- 172.21.15.53:0/1624680632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af41a49b0 con 0x7f4af410dba0 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.603+0000 7f4afc68b640 1 -- 172.21.15.53:0/1624680632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad80052c0 con 0x7f4af410dba0 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.605+0000 7f4aeb7fe640 1 -- 172.21.15.53:0/1624680632 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4aec005890 con 0x7f4af410dba0 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.606+0000 7f4aeb7fe640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4ae00b4d20 0x7f4ae00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.606+0000 7f4afa427640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4ae00b4d20 0x7f4ae00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.606+0000 7f4aeb7fe640 1 -- 172.21.15.53:0/1624680632 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 8601+0+0 (secure 0 0 0) 0x7f4aec0e5060 con 0x7f4af410dba0 2024-08-31T06:28:10.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.607+0000 7f4afa427640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4ae00b4d20 0x7f4ae00b7230 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f4af0004770 tx=0x7f4af00058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:10.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.613+0000 7f4aeb7fe640 1 -- 172.21.15.53:0/1624680632 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4aec0abe00 con 0x7f4af410dba0 2024-08-31T06:28:10.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.972+0000 7f4afc68b640 1 -- 172.21.15.53:0/1624680632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ad8005880 con 0x7f4af410dba0 2024-08-31T06:28:10.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.973+0000 7f4aeb7fe640 1 -- 172.21.15.53:0/1624680632 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+11993 (secure 0 0 0) 0x7f4aec0a5e20 con 0x7f4af410dba0 2024-08-31T06:28:10.976 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:28:10.976 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":85,"btime":"2024-08-31T06:28:08:874932+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":85,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:28:08.765543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:28:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 85 2024-08-31T06:28:10.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 -- 172.21.15.53:0/1624680632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4ae00b4d20 msgr2=0x7f4ae00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:10.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4ae00b4d20 0x7f4ae00b7230 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f4af0004770 tx=0x7f4af00058d0 comp rx=0 tx=0).stop 2024-08-31T06:28:10.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 -- 172.21.15.53:0/1624680632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4af410dba0 msgr2=0x7f4af419d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:10.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4af410dba0 0x7f4af419d830 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00b990 tx=0x7f4aec00be50 comp rx=0 tx=0).stop 2024-08-31T06:28:10.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 -- 172.21.15.53:0/1624680632 shutdown_connections 2024-08-31T06:28:10.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4ae00b4d20 0x7f4ae00b7230 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:10.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4af410dba0 0x7f4af419d830 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:10.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4af4105020 0x7f4af4198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:10.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 --2- 172.21.15.53:0/1624680632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41045f0 0x7f4af4197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:10.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 -- 172.21.15.53:0/1624680632 >> 172.21.15.53:0/1624680632 conn(0x7f4af40794d0 msgr2=0x7f4af40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:10.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 -- 172.21.15.53:0/1624680632 shutdown_connections 2024-08-31T06:28:10.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:10.976+0000 7f4afc68b640 1 -- 172.21.15.53:0/1624680632 wait complete. 2024-08-31T06:28:11.394 INFO:tasks.workunit.client.0.smithi053.stdout: 10 60672 5.22 MB/sec execute 479 sec latency 151.453 ms 2024-08-31T06:28:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:11 smithi153 ceph-mon[22320]: pgmap v1055: 97 pgs: 97 active+clean; 926 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-08-31T06:28:12.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:11 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1624680632' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:28:12.180 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:11 smithi130 ceph-mon[22266]: pgmap v1055: 97 pgs: 97 active+clean; 926 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-08-31T06:28:12.180 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:11 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1624680632' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:28:12.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:11 smithi053 ceph-mon[18924]: pgmap v1055: 97 pgs: 97 active+clean; 926 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-08-31T06:28:12.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:11 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1624680632' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:28:12.394 INFO:tasks.workunit.client.0.smithi053.stdout: 10 60827 5.23 MB/sec execute 480 sec latency 121.378 ms 2024-08-31T06:28:13.161 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:12 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:28:13.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:12 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:28:13.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:28:13.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:12 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:28:13.394 INFO:tasks.workunit.client.0.smithi053.stdout: 10 60977 5.23 MB/sec execute 481 sec latency 119.280 ms 2024-08-31T06:28:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:28:13.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:13 smithi053 ceph-mon[18924]: pgmap v1056: 97 pgs: 97 active+clean; 934 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 297 op/s 2024-08-31T06:28:13.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:13 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:28:13.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:13 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:28:13.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:13 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:28:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:13 smithi153 ceph-mon[22320]: pgmap v1056: 97 pgs: 97 active+clean; 934 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 297 op/s 2024-08-31T06:28:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:13 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:28:14.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:13 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:28:14.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:13 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:28:14.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.166+0000 7f97e9c25640 1 -- 172.21.15.53:0/4229508264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e41050e0 msgr2=0x7f97e410d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:14.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.166+0000 7f97e9c25640 1 --2- 172.21.15.53:0/4229508264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e41050e0 0x7f97e410d630 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009900 tx=0x7f97d802a410 comp rx=0 tx=0).stop 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.166+0000 7f97e9c25640 1 -- 172.21.15.53:0/4229508264 shutdown_connections 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.166+0000 7f97e9c25640 1 --2- 172.21.15.53:0/4229508264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e410dbf0 0x7f97e41100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.166+0000 7f97e9c25640 1 --2- 172.21.15.53:0/4229508264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e41050e0 0x7f97e410d630 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.166+0000 7f97e9c25640 1 --2- 172.21.15.53:0/4229508264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97e4104790 0x7f97e4104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.166+0000 7f97e9c25640 1 -- 172.21.15.53:0/4229508264 >> 172.21.15.53:0/4229508264 conn(0x7f97e40794f0 msgr2=0x7f97e4079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.166+0000 7f97e9c25640 1 -- 172.21.15.53:0/4229508264 shutdown_connections 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.166+0000 7f97e9c25640 1 -- 172.21.15.53:0/4229508264 wait complete. 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.167+0000 7f97e9c25640 1 Processor -- start 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.168+0000 7f97e9c25640 1 -- start start 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.168+0000 7f97e9c25640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e4104790 0x7f97e419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.168+0000 7f97e9c25640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97e41050e0 0x7f97e419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.168+0000 7f97e9c25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e410dbf0 0x7f97e419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.168+0000 7f97e37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e4104790 0x7f97e419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.168+0000 7f97e2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97e41050e0 0x7f97e419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.168+0000 7f97e37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e4104790 0x7f97e419a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:43990/0 (socket says 172.21.15.53:43990) 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.168+0000 7f97e2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97e41050e0 0x7f97e419a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46264/0 (socket says 172.21.15.53:46264) 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.168+0000 7f97e37fe640 1 -- 172.21.15.53:0/3272452346 learned_addr learned my addr 172.21.15.53:0/3272452346 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.169+0000 7f97e9c25640 1 -- 172.21.15.53:0/3272452346 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f97e4113750 con 0x7f97e410dbf0 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.169+0000 7f97e9c25640 1 -- 172.21.15.53:0/3272452346 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97e41135d0 con 0x7f97e41050e0 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.169+0000 7f97e9c25640 1 -- 172.21.15.53:0/3272452346 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97e41138d0 con 0x7f97e4104790 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.169+0000 7f97e3fff640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e410dbf0 0x7f97e419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.169+0000 7f97e2ffd640 1 -- 172.21.15.53:0/3272452346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e4104790 msgr2=0x7f97e419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.169+0000 7f97e2ffd640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e4104790 0x7f97e419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.169+0000 7f97e2ffd640 1 -- 172.21.15.53:0/3272452346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e410dbf0 msgr2=0x7f97e419f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.169+0000 7f97e2ffd640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e410dbf0 0x7f97e419f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.169+0000 7f97e2ffd640 1 -- 172.21.15.53:0/3272452346 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e41a0110 con 0x7f97e41050e0 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.169+0000 7f97e37fe640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e4104790 0x7f97e419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.170+0000 7f97e2ffd640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97e41050e0 0x7f97e419a740 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f97d802aa00 tx=0x7f97d8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.170+0000 7f97e0ff9640 1 -- 172.21.15.53:0/3272452346 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d803f070 con 0x7f97e41050e0 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.170+0000 7f97e0ff9640 1 -- 172.21.15.53:0/3272452346 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97d803bb00 con 0x7f97e41050e0 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.170+0000 7f97e9c25640 1 -- 172.21.15.53:0/3272452346 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e41a03a0 con 0x7f97e41050e0 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.170+0000 7f97e9c25640 1 -- 172.21.15.53:0/3272452346 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e41a6b60 con 0x7f97e41050e0 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.170+0000 7f97e0ff9640 1 -- 172.21.15.53:0/3272452346 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8035030 con 0x7f97e41050e0 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.173+0000 7f97e0ff9640 1 -- 172.21.15.53:0/3272452346 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f97d8042070 con 0x7f97e41050e0 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.173+0000 7f97f019a740 1 Processor -- start 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97f019a740 1 -- start start 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97f019a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3a20350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97f019a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 0x5581a3a20890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97f019a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a365a390 0x5581a3a20dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97f019a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5581a3997680 con 0x5581a365a390 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97f019a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5581a3986c10 con 0x5581a36521b0 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97f019a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5581a398abc0 con 0x5581a367b070 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97e3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3a20350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97e3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3a20350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:43998/0 (socket says 172.21.15.53:43998) 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97e3fff640 1 -- 172.21.15.53:0/3347883550 learned_addr learned my addr 172.21.15.53:0/3347883550 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97e37fe640 1 --2- 172.21.15.53:0/3347883550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 0x5581a3a20890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.174+0000 7f97e2ffd640 1 --2- 172.21.15.53:0/3347883550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a365a390 0x5581a3a20dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97e3fff640 1 -- 172.21.15.53:0/3347883550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 msgr2=0x5581a3a20890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97e3fff640 1 --2- 172.21.15.53:0/3347883550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 0x5581a3a20890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97e3fff640 1 -- 172.21.15.53:0/3347883550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a365a390 msgr2=0x5581a3a20dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97e3fff640 1 --2- 172.21.15.53:0/3347883550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a365a390 0x5581a3a20dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97e3fff640 1 -- 172.21.15.53:0/3347883550 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a36e6650 con 0x5581a367b070 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97e0ff9640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97cc0b4d20 0x7f97cc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97e2ffd640 1 --2- 172.21.15.53:0/3347883550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a365a390 0x5581a3a20dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97e37fe640 1 --2- 172.21.15.53:0/3347883550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 0x5581a3a20890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97e37fe640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97cc0b4d20 0x7f97cc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97e3fff640 1 --2- 172.21.15.53:0/3347883550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3a20350 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009f50 tx=0x7f97dc0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fd1217cd697597b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97e0ff9640 1 -- 172.21.15.53:0/3272452346 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 8601+0+0 (secure 0 0 0) 0x7f97d8105ae0 con 0x7f97e41050e0 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.175+0000 7f97c9ffb640 1 -- 172.21.15.53:0/3347883550 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97dc004b20 con 0x5581a367b070 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.176+0000 7f97c9ffb640 1 -- 172.21.15.53:0/3347883550 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97dc004cc0 con 0x5581a367b070 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.176+0000 7f97c9ffb640 1 -- 172.21.15.53:0/3347883550 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97dc005020 con 0x5581a367b070 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97f019a740 1 -- 172.21.15.53:0/3347883550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 msgr2=0x5581a3a20350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97f019a740 1 --2- 172.21.15.53:0/3347883550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3a20350 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009f50 tx=0x7f97dc0118d0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97e37fe640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97cc0b4d20 0x7f97cc0b7230 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x5581a3a1efd0 tx=0x7f97d4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97f019a740 1 -- 172.21.15.53:0/3347883550 shutdown_connections 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97f019a740 1 --2- 172.21.15.53:0/3347883550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a365a390 0x5581a3a20dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97f019a740 1 --2- 172.21.15.53:0/3347883550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 0x5581a3a20890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97f019a740 1 --2- 172.21.15.53:0/3347883550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3a20350 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97f019a740 1 -- 172.21.15.53:0/3347883550 >> 172.21.15.53:0/3347883550 conn(0x5581a366f460 msgr2=0x5581a3a1e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97f019a740 1 -- 172.21.15.53:0/3347883550 shutdown_connections 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97f019a740 1 -- 172.21.15.53:0/3347883550 wait complete. 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97f019a740 1 -- start start 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.177+0000 7f97f019a740 1 Processor -- start 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97f019a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 0x5581a3a2bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97f019a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a365a390 0x5581a3a2c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97f019a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a367b070 0x5581a3a2c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97f019a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5581a37e9700 con 0x5581a367b070 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97f019a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5581a390d750 con 0x5581a36521b0 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97f019a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5581a3a2eb30 con 0x5581a365a390 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97f019a740 10 client.0 _ll_register_callbacks cb 0x5581a393ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97e37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 0x5581a3a2bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97e2ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a365a390 0x5581a3a2c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97e37fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 0x5581a3a2bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46276/0 (socket says 172.21.15.53:46276) 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97e2ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a365a390 0x5581a3a2c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44008/0 (socket says 172.21.15.53:44008) 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97e37fe640 1 -- 172.21.15.53:0/815005431 learned_addr learned my addr 172.21.15.53:0/815005431 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97e3fff640 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a367b070 0x5581a3a2c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97e37fe640 1 -- 172.21.15.53:0/815005431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a365a390 msgr2=0x5581a3a2c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97e37fe640 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a365a390 0x5581a3a2c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97e37fe640 1 -- 172.21.15.53:0/815005431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a367b070 msgr2=0x5581a3a2c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97e37fe640 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a367b070 0x5581a3a2c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.178+0000 7f97e37fe640 1 -- 172.21.15.53:0/815005431 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a3946900 con 0x5581a36521b0 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.179+0000 7f97e37fe640 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 0x5581a3a2bae0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f97d40045e0 tx=0x7f97d4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f75cb83973167cfd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.179+0000 7f97c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.179+0000 7f97c2ffd640 1 -- 172.21.15.53:0/815005431 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4003af0 con 0x5581a36521b0 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.179+0000 7f97f019a740 1 -- 172.21.15.53:0/815005431 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97dc004cc0 con 0x5581a36521b0 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.179+0000 7f97c2ffd640 1 -- 172.21.15.53:0/815005431 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 8601+0+0 (secure 0 0 0) 0x7f97d4003c90 con 0x5581a36521b0 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.179+0000 7f97c2ffd640 1 -- 172.21.15.53:0/815005431 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f97d401e470 con 0x5581a36521b0 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.179+0000 7f97f019a740 10 client.31187 fetch_fsmap learned FSMap version 85 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.179+0000 7f97f019a740 1 -- 172.21.15.53:0/815005431 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=4+}) -- 0x5581a3a43200 con 0x5581a36521b0 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.179+0000 7f97c2ffd640 1 -- 172.21.15.53:0/815005431 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97dc004cc0 con 0x5581a36521b0 2024-08-31T06:28:14.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.180+0000 7f97c2ffd640 1 -- 172.21.15.53:0/815005431 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 85) ==== 8382+0+0 (secure 0 0 0) 0x7f97d4027070 con 0x5581a36521b0 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.180+0000 7f97f019a740 10 client.31187 fetch_fsmap finished waiting for FSMap version 85 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.180+0000 7f97f019a740 10 client.31187 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.180+0000 7f97f019a740 20 client.31187 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.180+0000 7f97f019a740 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5581a36399f0 0x5581a3a46700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.180+0000 7f97f019a740 4 client.31187 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.180+0000 7f97f019a740 1 -- 172.21.15.53:0/815005431 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581a39995d0 con 0x5581a36399f0 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.180+0000 7f97e2ffd640 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5581a36399f0 0x5581a3a46700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.180+0000 7f97c2ffd640 10 client.31187 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.180+0000 7f97e2ffd640 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5581a36399f0 0x5581a3a46700 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=55994b672fe720d2 server_cookie=a4b85ea475bc3f34 in_seq=0 out_seq=0 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.181+0000 7f97c2ffd640 1 -- 172.21.15.53:0/815005431 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5581a39995d0 con 0x5581a36399f0 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.181+0000 7f97c2ffd640 10 client.31187 handle_command_reply: tid=0 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.181+0000 7f97f019a740 1 client.31187 shutdown 2024-08-31T06:28:14.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97f019a740 1 -- 172.21.15.53:0/815005431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 msgr2=0x5581a3a2bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:14.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97f019a740 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 0x5581a3a2bae0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f97d40045e0 tx=0x7f97d4004730 comp rx=0 tx=0).stop 2024-08-31T06:28:14.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97f019a740 1 -- 172.21.15.53:0/815005431 shutdown_connections 2024-08-31T06:28:14.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97f019a740 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a367b070 0x5581a3a2c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97f019a740 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5581a36399f0 0x5581a3a46700 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97f019a740 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a365a390 0x5581a3a2c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97f019a740 1 --2- 172.21.15.53:0/815005431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a36521b0 0x5581a3a2bae0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97f019a740 1 -- 172.21.15.53:0/815005431 >> 172.21.15.53:0/815005431 conn(0x5581a366f460 msgr2=0x5581a3a234e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:14.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97c2ffd640 0 client.31187 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:28:14.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97f019a740 1 -- 172.21.15.53:0/815005431 shutdown_connections 2024-08-31T06:28:14.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97f019a740 1 -- 172.21.15.53:0/815005431 wait complete. 2024-08-31T06:28:14.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.182+0000 7f97f019a740 20 client.31187 trim_cache size 0 max 16384 2024-08-31T06:28:14.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.204+0000 7f97f019a740 1 Processor -- start 2024-08-31T06:28:14.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.204+0000 7f97f019a740 1 -- start start 2024-08-31T06:28:14.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97f019a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 0x5581a3a31d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97f019a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 0x5581a3a2d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97f019a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3a28cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97f019a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f97e41ad330 con 0x5581a36521b0 2024-08-31T06:28:14.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97f019a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97e41aef60 con 0x5581a365a390 2024-08-31T06:28:14.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97f019a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97e41ada30 con 0x5581a367b070 2024-08-31T06:28:14.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97e37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 0x5581a3a31d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97e37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 0x5581a3a31d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32796/0 (socket says 172.21.15.53:32796) 2024-08-31T06:28:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97e37fe640 1 -- 172.21.15.53:0/1129257720 learned_addr learned my addr 172.21.15.53:0/1129257720 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97e2ffd640 1 --2- 172.21.15.53:0/1129257720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 0x5581a3a2d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97e3fff640 1 --2- 172.21.15.53:0/1129257720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3a28cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97e37fe640 1 -- 172.21.15.53:0/1129257720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 msgr2=0x5581a3a28cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97e37fe640 1 --2- 172.21.15.53:0/1129257720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3a28cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97e37fe640 1 -- 172.21.15.53:0/1129257720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 msgr2=0x5581a3a2d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97e37fe640 1 --2- 172.21.15.53:0/1129257720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 0x5581a3a2d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.205+0000 7f97e37fe640 1 -- 172.21.15.53:0/1129257720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a3a231b0 con 0x5581a36521b0 2024-08-31T06:28:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.206+0000 7f97e37fe640 1 --2- 172.21.15.53:0/1129257720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 0x5581a3a31d60 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009620 tx=0x7f97d400ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c0f07e26d6534f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:14.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.206+0000 7f97c97fa640 1 -- 172.21.15.53:0/1129257720 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d40039c0 con 0x5581a36521b0 2024-08-31T06:28:14.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.206+0000 7f97c97fa640 1 -- 172.21.15.53:0/1129257720 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97d401e610 con 0x5581a36521b0 2024-08-31T06:28:14.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.206+0000 7f97c97fa640 1 -- 172.21.15.53:0/1129257720 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d401f640 con 0x5581a36521b0 2024-08-31T06:28:14.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.207+0000 7f97f019a740 1 -- 172.21.15.53:0/1129257720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 msgr2=0x5581a3a31d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:14.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.207+0000 7f97f019a740 1 --2- 172.21.15.53:0/1129257720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 0x5581a3a31d60 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009620 tx=0x7f97d400ff60 comp rx=0 tx=0).stop 2024-08-31T06:28:14.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.208+0000 7f97f019a740 1 -- 172.21.15.53:0/1129257720 shutdown_connections 2024-08-31T06:28:14.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.208+0000 7f97f019a740 1 --2- 172.21.15.53:0/1129257720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3a28cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.208+0000 7f97f019a740 1 --2- 172.21.15.53:0/1129257720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 0x5581a3a2d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.208+0000 7f97f019a740 1 --2- 172.21.15.53:0/1129257720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 0x5581a3a31d60 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.208+0000 7f97f019a740 1 -- 172.21.15.53:0/1129257720 >> 172.21.15.53:0/1129257720 conn(0x5581a366f460 msgr2=0x5581a3a2d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:14.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.208+0000 7f97f019a740 1 -- 172.21.15.53:0/1129257720 shutdown_connections 2024-08-31T06:28:14.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.208+0000 7f97f019a740 1 -- 172.21.15.53:0/1129257720 wait complete. 2024-08-31T06:28:14.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.208+0000 7f97f019a740 1 -- start start 2024-08-31T06:28:14.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.208+0000 7f97f019a740 1 Processor -- start 2024-08-31T06:28:14.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97f019a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 0x5581a3a3d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97f019a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 0x5581a3a3d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97f019a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3ab0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97f019a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f97e41ae890 con 0x5581a36521b0 2024-08-31T06:28:14.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97f019a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97e41ae1c0 con 0x5581a365a390 2024-08-31T06:28:14.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97f019a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97e41ab330 con 0x5581a367b070 2024-08-31T06:28:14.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97f019a740 10 client.0 _ll_register_callbacks cb 0x7f97d4012ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:14.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97e2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 0x5581a3a3d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97e2ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 0x5581a3a3d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46302/0 (socket says 172.21.15.53:46302) 2024-08-31T06:28:14.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97e2ffd640 1 -- 172.21.15.53:0/1730389498 learned_addr learned my addr 172.21.15.53:0/1730389498 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:14.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97e37fe640 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 0x5581a3a3d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97e3fff640 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3ab0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.209+0000 7f97e2ffd640 1 -- 172.21.15.53:0/1730389498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 msgr2=0x5581a3ab0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:14.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97e2ffd640 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3ab0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97e2ffd640 1 -- 172.21.15.53:0/1730389498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 msgr2=0x5581a3a3d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:14.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97e2ffd640 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 0x5581a3a3d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97e2ffd640 1 -- 172.21.15.53:0/1730389498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a3ab0640 con 0x5581a365a390 2024-08-31T06:28:14.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97e37fe640 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 0x5581a3a3d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:14.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97e2ffd640 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 0x5581a3a3d6a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f97d80c82b0 tx=0x7f97d80ef0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=329758ec9241710e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:14.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:28:14.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97c2ffd640 1 -- 172.21.15.53:0/1730389498 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8049040 con 0x5581a365a390 2024-08-31T06:28:14.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97c2ffd640 1 -- 172.21.15.53:0/1730389498 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 8601+0+0 (secure 0 0 0) 0x7f97d8103460 con 0x5581a365a390 2024-08-31T06:28:14.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97f019a740 1 -- 172.21.15.53:0/1730389498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97d401e610 con 0x5581a365a390 2024-08-31T06:28:14.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97c2ffd640 1 -- 172.21.15.53:0/1730389498 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f97d80cbd40 con 0x5581a365a390 2024-08-31T06:28:14.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97f019a740 10 client.31193 fetch_fsmap learned FSMap version 85 2024-08-31T06:28:14.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.210+0000 7f97f019a740 1 -- 172.21.15.53:0/1730389498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=4+}) -- 0x5581a3ab18d0 con 0x5581a365a390 2024-08-31T06:28:14.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.211+0000 7f97c2ffd640 1 -- 172.21.15.53:0/1730389498 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97d80cc230 con 0x5581a365a390 2024-08-31T06:28:14.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.211+0000 7f97c2ffd640 1 -- 172.21.15.53:0/1730389498 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 85) ==== 8382+0+0 (secure 0 0 0) 0x7f97d80cc490 con 0x5581a365a390 2024-08-31T06:28:14.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.211+0000 7f97f019a740 10 client.31193 fetch_fsmap finished waiting for FSMap version 85 2024-08-31T06:28:14.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.211+0000 7f97f019a740 10 client.31193 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:28:14.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.211+0000 7f97f019a740 20 client.31193 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:14.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.211+0000 7f97f019a740 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5581a360eda0 0x5581a3ab3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:14.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.211+0000 7f97f019a740 4 client.31193 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:28:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.211+0000 7f97f019a740 1 -- 172.21.15.53:0/1730389498 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f97d401e610 con 0x5581a360eda0 2024-08-31T06:28:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.211+0000 7f97e37fe640 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5581a360eda0 0x5581a3ab3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.212+0000 7f97e37fe640 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5581a360eda0 0x5581a3ab3fe0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b099d18342af9cda server_cookie=56cb97d7458e8a6c in_seq=0 out_seq=0 2024-08-31T06:28:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.212+0000 7f97c2ffd640 10 client.31193 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:28:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.212+0000 7f97c2ffd640 1 -- 172.21.15.53:0/1730389498 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f97d401e610 con 0x5581a360eda0 2024-08-31T06:28:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.212+0000 7f97c2ffd640 10 client.31193 handle_command_reply: tid=0 2024-08-31T06:28:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.212+0000 7f97f019a740 1 client.31193 shutdown 2024-08-31T06:28:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97f019a740 1 -- 172.21.15.53:0/1730389498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 msgr2=0x5581a3a3d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97f019a740 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 0x5581a3a3d6a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f97d80c82b0 tx=0x7f97d80ef0d0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97f019a740 1 -- 172.21.15.53:0/1730389498 shutdown_connections 2024-08-31T06:28:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97f019a740 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x5581a360eda0 0x5581a3ab3fe0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97f019a740 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5581a367b070 0x5581a3ab0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97f019a740 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5581a365a390 0x5581a3a3d6a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97f019a740 1 --2- 172.21.15.53:0/1730389498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581a36521b0 0x5581a3a3d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97f019a740 1 -- 172.21.15.53:0/1730389498 >> 172.21.15.53:0/1730389498 conn(0x5581a366f460 msgr2=0x5581a3a21d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:14.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97c2ffd640 0 client.31193 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:28:14.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97f019a740 1 -- 172.21.15.53:0/1730389498 shutdown_connections 2024-08-31T06:28:14.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97f019a740 1 -- 172.21.15.53:0/1730389498 wait complete. 2024-08-31T06:28:14.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.213+0000 7f97f019a740 20 client.31193 trim_cache size 0 max 16384 2024-08-31T06:28:14.221 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:28:14.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 -- 172.21.15.53:0/3272452346 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97cc0b4d20 msgr2=0x7f97cc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97cc0b4d20 0x7f97cc0b7230 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x5581a3a1efd0 tx=0x7f97d4005f90 comp rx=0 tx=0).stop 2024-08-31T06:28:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 -- 172.21.15.53:0/3272452346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97e41050e0 msgr2=0x7f97e419a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97e41050e0 0x7f97e419a740 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f97d802aa00 tx=0x7f97d8003c10 comp rx=0 tx=0).stop 2024-08-31T06:28:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 -- 172.21.15.53:0/3272452346 shutdown_connections 2024-08-31T06:28:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f97cc0b4d20 0x7f97cc0b7230 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e410dbf0 0x7f97e419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97e41050e0 0x7f97e419a740 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 --2- 172.21.15.53:0/3272452346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e4104790 0x7f97e419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 -- 172.21.15.53:0/3272452346 >> 172.21.15.53:0/3272452346 conn(0x7f97e40794f0 msgr2=0x7f97e40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 -- 172.21.15.53:0/3272452346 shutdown_connections 2024-08-31T06:28:14.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:14.214+0000 7f97e9c25640 1 -- 172.21.15.53:0/3272452346 wait complete. 2024-08-31T06:28:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:13 smithi130 ceph-mon[22266]: pgmap v1056: 97 pgs: 97 active+clean; 934 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 297 op/s 2024-08-31T06:28:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:13 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:28:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:13 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:28:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:13 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:28:14.394 INFO:tasks.workunit.client.0.smithi053.stdout: 10 61080 5.23 MB/sec execute 482 sec latency 85.607 ms 2024-08-31T06:28:15.394 INFO:tasks.workunit.client.0.smithi053.stdout: 10 61215 5.23 MB/sec execute 483 sec latency 145.321 ms 2024-08-31T06:28:15.706 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:28:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:15 smithi130 ceph-mon[22266]: osdmap e110: 12 total, 12 up, 12 in 2024-08-31T06:28:15.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:15 smithi130 ceph-mon[22266]: pgmap v1058: 97 pgs: 97 active+clean; 941 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 289 op/s 2024-08-31T06:28:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:15 smithi153 ceph-mon[22320]: osdmap e110: 12 total, 12 up, 12 in 2024-08-31T06:28:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:15 smithi153 ceph-mon[22320]: pgmap v1058: 97 pgs: 97 active+clean; 941 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 289 op/s 2024-08-31T06:28:15.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:15 smithi053 ceph-mon[18924]: osdmap e110: 12 total, 12 up, 12 in 2024-08-31T06:28:15.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:15 smithi053 ceph-mon[18924]: pgmap v1058: 97 pgs: 97 active+clean; 941 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 289 op/s 2024-08-31T06:28:16.061 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:28:16.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 61399 5.26 MB/sec execute 484 sec latency 61.530 ms 2024-08-31T06:28:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.657+0000 7fea395ac640 1 -- 172.21.15.53:0/1634612713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea3410ffc0 msgr2=0x7fea341123e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.657+0000 7fea395ac640 1 --2- 172.21.15.53:0/1634612713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea3410ffc0 0x7fea341123e0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009ca0 tx=0x7fea2c02a950 comp rx=0 tx=0).stop 2024-08-31T06:28:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.657+0000 7fea395ac640 1 -- 172.21.15.53:0/1634612713 shutdown_connections 2024-08-31T06:28:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.657+0000 7fea395ac640 1 --2- 172.21.15.53:0/1634612713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea3410ffc0 0x7fea341123e0 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.657+0000 7fea395ac640 1 --2- 172.21.15.53:0/1634612713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea34102d60 0x7fea3410fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.657+0000 7fea395ac640 1 --2- 172.21.15.53:0/1634612713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea34102410 0x7fea34102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.657+0000 7fea395ac640 1 -- 172.21.15.53:0/1634612713 >> 172.21.15.53:0/1634612713 conn(0x7fea340794f0 msgr2=0x7fea34079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.657+0000 7fea395ac640 1 -- 172.21.15.53:0/1634612713 shutdown_connections 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.657+0000 7fea395ac640 1 -- 172.21.15.53:0/1634612713 wait complete. 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.658+0000 7fea395ac640 1 Processor -- start 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.658+0000 7fea395ac640 1 -- start start 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.658+0000 7fea395ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea34102410 0x7fea3419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea395ac640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea34102d60 0x7fea3419c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea395ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3410ffc0 0x7fea341a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea395ac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fea34115960 con 0x7fea34102410 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea395ac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fea341157e0 con 0x7fea3410ffc0 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea395ac640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fea34115ae0 con 0x7fea34102d60 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea32ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea34102410 0x7fea3419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3410ffc0 0x7fea341a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea327fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea34102d60 0x7fea3419c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea32ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea34102410 0x7fea3419c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32810/0 (socket says 172.21.15.53:32810) 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea337fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3410ffc0 0x7fea341a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46316/0 (socket says 172.21.15.53:46316) 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea32ffd640 1 -- 172.21.15.53:0/1038053699 learned_addr learned my addr 172.21.15.53:0/1038053699 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea337fe640 1 -- 172.21.15.53:0/1038053699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea34102d60 msgr2=0x7fea3419c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea337fe640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea34102d60 0x7fea3419c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea337fe640 1 -- 172.21.15.53:0/1038053699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea34102410 msgr2=0x7fea3419c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea337fe640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea34102410 0x7fea3419c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea337fe640 1 -- 172.21.15.53:0/1038053699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea341a22e0 con 0x7fea3410ffc0 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea32ffd640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea34102410 0x7fea3419c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.659+0000 7fea327fc640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea34102d60 0x7fea3419c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.660+0000 7fea337fe640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3410ffc0 0x7fea341a1bb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fea2c005e30 tx=0x7fea2c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.660+0000 7fea1bfff640 1 -- 172.21.15.53:0/1038053699 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c034040 con 0x7fea3410ffc0 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.660+0000 7fea1bfff640 1 -- 172.21.15.53:0/1038053699 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea2c02fcf0 con 0x7fea3410ffc0 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.660+0000 7fea395ac640 1 -- 172.21.15.53:0/1038053699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea341a2570 con 0x7fea3410ffc0 2024-08-31T06:28:16.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.660+0000 7fea1bfff640 1 -- 172.21.15.53:0/1038053699 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c0044d0 con 0x7fea3410ffc0 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.660+0000 7fea395ac640 1 -- 172.21.15.53:0/1038053699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea341a8d30 con 0x7fea3410ffc0 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.663+0000 7fea3fb21740 1 Processor -- start 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.663+0000 7fea1bfff640 1 -- 172.21.15.53:0/1038053699 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fea2c037020 con 0x7fea3410ffc0 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea3fb21740 1 -- start start 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc618070 0x5643fc9bd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 0x5643fc9bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5f7390 0x5643fc9bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea3fb21740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5643fc934680 con 0x5643fc618070 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea3fb21740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5643fc923c10 con 0x5643fc5ef1b0 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea3fb21740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5643fc927bc0 con 0x5643fc5f7390 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc618070 0x5643fc9bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc618070 0x5643fc9bd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32820/0 (socket says 172.21.15.53:32820) 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea327fc640 1 -- 172.21.15.53:0/2685790123 learned_addr learned my addr 172.21.15.53:0/2685790123 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2685790123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 0x5643fc9bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea327fc640 1 --2- 172.21.15.53:0/2685790123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5f7390 0x5643fc9bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea32ffd640 1 -- 172.21.15.53:0/2685790123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5f7390 msgr2=0x5643fc9bdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.664+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2685790123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5f7390 0x5643fc9bdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.665+0000 7fea32ffd640 1 -- 172.21.15.53:0/2685790123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc618070 msgr2=0x5643fc9bd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.665+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2685790123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc618070 0x5643fc9bd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.665+0000 7fea32ffd640 1 -- 172.21.15.53:0/2685790123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643fc683650 con 0x5643fc5ef1b0 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.665+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2685790123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 0x5643fc9bd850 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fea240114f0 tx=0x7fea240119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72403f636703fab3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.665+0000 7fea197fa640 1 -- 172.21.15.53:0/2685790123 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2401e070 con 0x5643fc5ef1b0 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.665+0000 7fea197fa640 1 -- 172.21.15.53:0/2685790123 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea240044c0 con 0x5643fc5ef1b0 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.665+0000 7fea197fa640 1 -- 172.21.15.53:0/2685790123 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2400f820 con 0x5643fc5ef1b0 2024-08-31T06:28:16.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.666+0000 7fea1bfff640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea1c0b4d20 0x7fea1c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.666+0000 7fea1bfff640 1 -- 172.21.15.53:0/1038053699 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7fea2c106160 con 0x7fea3410ffc0 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.666+0000 7fea327fc640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea1c0b4d20 0x7fea1c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.666+0000 7fea3fb21740 1 -- 172.21.15.53:0/2685790123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 msgr2=0x5643fc9bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.666+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2685790123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 0x5643fc9bd850 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fea240114f0 tx=0x7fea240119b0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.666+0000 7fea3fb21740 1 -- 172.21.15.53:0/2685790123 shutdown_connections 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.666+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2685790123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5f7390 0x5643fc9bdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.666+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2685790123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 0x5643fc9bd850 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.666+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2685790123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc618070 0x5643fc9bd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.666+0000 7fea3fb21740 1 -- 172.21.15.53:0/2685790123 >> 172.21.15.53:0/2685790123 conn(0x5643fc60c460 msgr2=0x5643fc9bb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.667+0000 7fea3fb21740 1 -- 172.21.15.53:0/2685790123 shutdown_connections 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.667+0000 7fea327fc640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea1c0b4d20 0x7fea1c0b7230 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fea28009710 tx=0x7fea28015040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.667+0000 7fea3fb21740 1 -- 172.21.15.53:0/2685790123 wait complete. 2024-08-31T06:28:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.667+0000 7fea3fb21740 1 -- start start 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.667+0000 7fea3fb21740 1 Processor -- start 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 0x5643fc9c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 0x5643fc9c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc618070 0x5643fc9d4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea3fb21740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5643fc786700 con 0x5643fc5f7390 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea3fb21740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5643fc8aa750 con 0x5643fc5ef1b0 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea3fb21740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5643fc9cbb90 con 0x5643fc618070 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea3fb21740 10 client.0 _ll_register_callbacks cb 0x5643fc8d9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 0x5643fc9c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 0x5643fc9c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32824/0 (socket says 172.21.15.53:32824) 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea327fc640 1 -- 172.21.15.53:0/2084856490 learned_addr learned my addr 172.21.15.53:0/2084856490 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 0x5643fc9c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea337fe640 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc618070 0x5643fc9d4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea327fc640 1 -- 172.21.15.53:0/2084856490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc618070 msgr2=0x5643fc9d4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.668+0000 7fea327fc640 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc618070 0x5643fc9d4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea327fc640 1 -- 172.21.15.53:0/2084856490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 msgr2=0x5643fc9c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea327fc640 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 0x5643fc9c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea327fc640 1 -- 172.21.15.53:0/2084856490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643fc8e3900 con 0x5643fc5f7390 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea337fe640 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc618070 0x5643fc9d4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 0x5643fc9c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea327fc640 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 0x5643fc9c8f80 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7fea28004480 tx=0x7fea28005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555c743afc352836 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea16ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea16ff5640 1 -- 172.21.15.53:0/2084856490 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28003d70 con 0x5643fc5f7390 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea16ff5640 1 -- 172.21.15.53:0/2084856490 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7fea28023420 con 0x5643fc5f7390 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea3fb21740 1 -- 172.21.15.53:0/2084856490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5643fc9365d0 con 0x5643fc5f7390 2024-08-31T06:28:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea16ff5640 1 -- 172.21.15.53:0/2084856490 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fea28023620 con 0x5643fc5f7390 2024-08-31T06:28:16.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea3fb21740 10 client.22560 fetch_fsmap learned FSMap version 85 2024-08-31T06:28:16.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.669+0000 7fea3fb21740 1 -- 172.21.15.53:0/2084856490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=4+}) -- 0x5643fc9d7940 con 0x5643fc5f7390 2024-08-31T06:28:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.670+0000 7fea16ff5640 1 -- 172.21.15.53:0/2084856490 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5643fc9365d0 con 0x5643fc5f7390 2024-08-31T06:28:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.670+0000 7fea16ff5640 1 -- 172.21.15.53:0/2084856490 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 85) ==== 8382+0+0 (secure 0 0 0) 0x7fea280337b0 con 0x5643fc5f7390 2024-08-31T06:28:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.670+0000 7fea3fb21740 10 client.22560 fetch_fsmap finished waiting for FSMap version 85 2024-08-31T06:28:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.670+0000 7fea3fb21740 10 client.22560 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:28:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.670+0000 7fea3fb21740 20 client.22560 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.670+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5643fc5d69f0 0x5643fc9db280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.670+0000 7fea3fb21740 4 client.22560 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.670+0000 7fea3fb21740 1 -- 172.21.15.53:0/2084856490 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643fc932070 con 0x5643fc5d69f0 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.671+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5643fc5d69f0 0x5643fc9db280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.671+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5643fc5d69f0 0x5643fc9db280 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f5968fd20921d6c0 server_cookie=8ec27319451dafda in_seq=0 out_seq=0 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.671+0000 7fea16ff5640 10 client.22560 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.673+0000 7fea16ff5640 1 -- 172.21.15.53:0/2084856490 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643fc932070 con 0x5643fc5d69f0 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.673+0000 7fea16ff5640 10 client.22560 handle_command_reply: tid=0 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.673+0000 7fea3fb21740 1 client.22560 shutdown 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.673+0000 7fea3fb21740 1 -- 172.21.15.53:0/2084856490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 msgr2=0x5643fc9c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.673+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 0x5643fc9c8f80 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7fea28004480 tx=0x7fea28005f90 comp rx=0 tx=0).stop 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.673+0000 7fea3fb21740 1 -- 172.21.15.53:0/2084856490 shutdown_connections 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.673+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc618070 0x5643fc9d4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.673+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5643fc5d69f0 0x5643fc9db280 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.673+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 0x5643fc9c8f80 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.673+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2084856490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5ef1b0 0x5643fc9c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.674+0000 7fea16ff5640 0 client.22560 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:28:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.674+0000 7fea3fb21740 1 -- 172.21.15.53:0/2084856490 >> 172.21.15.53:0/2084856490 conn(0x5643fc60c460 msgr2=0x5643fc9c04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.674+0000 7fea3fb21740 1 -- 172.21.15.53:0/2084856490 shutdown_connections 2024-08-31T06:28:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.674+0000 7fea3fb21740 1 -- 172.21.15.53:0/2084856490 wait complete. 2024-08-31T06:28:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.674+0000 7fea3fb21740 20 client.22560 trim_cache size 0 max 16384 2024-08-31T06:28:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.700+0000 7fea3fb21740 1 Processor -- start 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.700+0000 7fea3fb21740 1 -- start start 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.700+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 0x5643fc9c0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5ef1b0 0x5643fc9c0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5f7390 0x5643fc9c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea3fb21740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fea341b1690 con 0x5643fc5ef1b0 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea3fb21740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fea341b32c0 con 0x5643fc5d69f0 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea3fb21740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fea341b1d90 con 0x5643fc5f7390 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5ef1b0 0x5643fc9c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5ef1b0 0x5643fc9c0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32830/0 (socket says 172.21.15.53:32830) 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea327fc640 1 -- 172.21.15.53:0/2841602209 learned_addr learned my addr 172.21.15.53:0/2841602209 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2841602209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 0x5643fc9c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea327fc640 1 -- 172.21.15.53:0/2841602209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5f7390 msgr2=0x5643fc9c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea327fc640 1 --2- 172.21.15.53:0/2841602209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5f7390 0x5643fc9c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea327fc640 1 -- 172.21.15.53:0/2841602209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 msgr2=0x5643fc9c0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea327fc640 1 --2- 172.21.15.53:0/2841602209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 0x5643fc9c0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.701+0000 7fea327fc640 1 -- 172.21.15.53:0/2841602209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643fc9b53d0 con 0x5643fc5ef1b0 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.702+0000 7fea327fc640 1 --2- 172.21.15.53:0/2841602209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5ef1b0 0x5643fc9c0950 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7fea28005de0 tx=0x7fea2802b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63558d4e7e0bb254 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.702+0000 7fea18ff9640 1 -- 172.21.15.53:0/2841602209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28023420 con 0x5643fc5ef1b0 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.702+0000 7fea18ff9640 1 -- 172.21.15.53:0/2841602209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea28038070 con 0x5643fc5ef1b0 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.702+0000 7fea18ff9640 1 -- 172.21.15.53:0/2841602209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28023a20 con 0x5643fc5ef1b0 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.703+0000 7fea3fb21740 1 -- 172.21.15.53:0/2841602209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5ef1b0 msgr2=0x5643fc9c0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.703+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2841602209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5ef1b0 0x5643fc9c0950 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7fea28005de0 tx=0x7fea2802b400 comp rx=0 tx=0).stop 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.703+0000 7fea3fb21740 1 -- 172.21.15.53:0/2841602209 shutdown_connections 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.703+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2841602209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5f7390 0x5643fc9c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.703+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2841602209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5ef1b0 0x5643fc9c0950 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.703+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2841602209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 0x5643fc9c0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.703+0000 7fea3fb21740 1 -- 172.21.15.53:0/2841602209 >> 172.21.15.53:0/2841602209 conn(0x5643fc60c460 msgr2=0x5643fc9c72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.703+0000 7fea3fb21740 1 -- 172.21.15.53:0/2841602209 shutdown_connections 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.703+0000 7fea3fb21740 1 -- 172.21.15.53:0/2841602209 wait complete. 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.704+0000 7fea3fb21740 1 -- start start 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.704+0000 7fea3fb21740 1 Processor -- start 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.704+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 0x5643fc9d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.704+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5ef1b0 0x5643fc9cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.704+0000 7fea3fb21740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 0x5643fc9ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.704+0000 7fea3fb21740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fea341b2bf0 con 0x5643fc5f7390 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.704+0000 7fea3fb21740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fea341b2520 con 0x5643fc5d69f0 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.704+0000 7fea3fb21740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fea341af690 con 0x5643fc5ef1b0 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.704+0000 7fea3fb21740 10 client.0 _ll_register_callbacks cb 0x7fea28013750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea32ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 0x5643fc9d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea32ffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 0x5643fc9d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46350/0 (socket says 172.21.15.53:46350) 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea32ffd640 1 -- 172.21.15.53:0/2893698385 learned_addr learned my addr 172.21.15.53:0/2893698385 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea337fe640 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 0x5643fc9ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea327fc640 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5ef1b0 0x5643fc9cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea32ffd640 1 -- 172.21.15.53:0/2893698385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5ef1b0 msgr2=0x5643fc9cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5ef1b0 0x5643fc9cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea32ffd640 1 -- 172.21.15.53:0/2893698385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 msgr2=0x5643fc9ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 0x5643fc9ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea32ffd640 1 -- 172.21.15.53:0/2893698385 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643fc9cd2c0 con 0x5643fc5d69f0 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea327fc640 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5ef1b0 0x5643fc9cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea32ffd640 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 0x5643fc9d12f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fea240097f0 tx=0x7fea240095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0327509607cc53c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.705+0000 7fea16ff5640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:28:16.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea16ff5640 1 -- 172.21.15.53:0/2893698385 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24031060 con 0x5643fc5d69f0 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea3fb21740 1 -- 172.21.15.53:0/2893698385 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea28038070 con 0x5643fc5d69f0 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea16ff5640 1 -- 172.21.15.53:0/2893698385 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7fea24003850 con 0x5643fc5d69f0 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea16ff5640 1 -- 172.21.15.53:0/2893698385 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fea2401e040 con 0x5643fc5d69f0 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea3fb21740 10 client.31211 fetch_fsmap learned FSMap version 85 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea3fb21740 1 -- 172.21.15.53:0/2893698385 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=4+}) -- 0x5643fca458c0 con 0x5643fc5d69f0 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea16ff5640 1 -- 172.21.15.53:0/2893698385 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea28038070 con 0x5643fc5d69f0 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea16ff5640 1 -- 172.21.15.53:0/2893698385 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 85) ==== 8382+0+0 (secure 0 0 0) 0x7fea24004680 con 0x5643fc5d69f0 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea3fb21740 10 client.31211 fetch_fsmap finished waiting for FSMap version 85 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea3fb21740 10 client.31211 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea3fb21740 20 client.31211 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5643fc618070 0x5643fca47e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea3fb21740 4 client.31211 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.706+0000 7fea3fb21740 1 -- 172.21.15.53:0/2893698385 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643fc9db870 con 0x5643fc618070 2024-08-31T06:28:16.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.707+0000 7fea327fc640 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5643fc618070 0x5643fca47e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:16.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.707+0000 7fea16ff5640 10 client.31211 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:28:16.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.707+0000 7fea327fc640 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5643fc618070 0x5643fca47e60 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9e6cea148746d71f server_cookie=7dc4c0af897b8c21 in_seq=0 out_seq=0 2024-08-31T06:28:16.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea16ff5640 1 -- 172.21.15.53:0/2893698385 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643fc9db870 con 0x5643fc618070 2024-08-31T06:28:16.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea16ff5640 10 client.31211 handle_command_reply: tid=0 2024-08-31T06:28:16.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 1 client.31211 shutdown 2024-08-31T06:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 1 -- 172.21.15.53:0/2893698385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 msgr2=0x5643fc9d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 0x5643fc9d12f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fea240097f0 tx=0x7fea240095c0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 1 -- 172.21.15.53:0/2893698385 shutdown_connections 2024-08-31T06:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x5643fc618070 0x5643fca47e60 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643fc5f7390 0x5643fc9ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5643fc5ef1b0 0x5643fc9cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 1 --2- 172.21.15.53:0/2893698385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5643fc5d69f0 0x5643fc9d12f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 1 -- 172.21.15.53:0/2893698385 >> 172.21.15.53:0/2893698385 conn(0x5643fc60c460 msgr2=0x5643fc9c0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea16ff5640 0 client.31211 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 1 -- 172.21.15.53:0/2893698385 shutdown_connections 2024-08-31T06:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 1 -- 172.21.15.53:0/2893698385 wait complete. 2024-08-31T06:28:16.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.708+0000 7fea3fb21740 20 client.31211 trim_cache size 0 max 16384 2024-08-31T06:28:16.717 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:28:16.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.709+0000 7fea395ac640 1 -- 172.21.15.53:0/1038053699 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea1c0b4d20 msgr2=0x7fea1c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:16.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.709+0000 7fea395ac640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea1c0b4d20 0x7fea1c0b7230 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fea28009710 tx=0x7fea28015040 comp rx=0 tx=0).stop 2024-08-31T06:28:16.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.709+0000 7fea395ac640 1 -- 172.21.15.53:0/1038053699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3410ffc0 msgr2=0x7fea341a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:16.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.709+0000 7fea395ac640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3410ffc0 0x7fea341a1bb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fea2c005e30 tx=0x7fea2c003c10 comp rx=0 tx=0).stop 2024-08-31T06:28:16.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.709+0000 7fea395ac640 1 -- 172.21.15.53:0/1038053699 shutdown_connections 2024-08-31T06:28:16.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.709+0000 7fea395ac640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fea1c0b4d20 0x7fea1c0b7230 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.709+0000 7fea395ac640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea3410ffc0 0x7fea341a1bb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.710+0000 7fea395ac640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea34102d60 0x7fea3419c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.710+0000 7fea395ac640 1 --2- 172.21.15.53:0/1038053699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea34102410 0x7fea3419c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:16.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.710+0000 7fea395ac640 1 -- 172.21.15.53:0/1038053699 >> 172.21.15.53:0/1038053699 conn(0x7fea340794f0 msgr2=0x7fea34108a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:16.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.710+0000 7fea395ac640 1 -- 172.21.15.53:0/1038053699 shutdown_connections 2024-08-31T06:28:16.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:16.710+0000 7fea395ac640 1 -- 172.21.15.53:0/1038053699 wait complete. 2024-08-31T06:28:17.402 INFO:tasks.workunit.client.0.smithi053.stdout: 10 61548 5.27 MB/sec execute 485 sec latency 85.934 ms 2024-08-31T06:28:18.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:17 smithi130 ceph-mon[22266]: pgmap v1059: 97 pgs: 97 active+clean; 947 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 310 op/s 2024-08-31T06:28:18.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:17 smithi153 ceph-mon[22320]: pgmap v1059: 97 pgs: 97 active+clean; 947 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 310 op/s 2024-08-31T06:28:18.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:17 smithi053 ceph-mon[18924]: pgmap v1059: 97 pgs: 97 active+clean; 947 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 310 op/s 2024-08-31T06:28:18.402 INFO:tasks.workunit.client.0.smithi053.stdout: 10 61676 5.27 MB/sec execute 486 sec latency 130.264 ms 2024-08-31T06:28:19.178 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:28:19.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 61824 5.28 MB/sec execute 487 sec latency 141.100 ms 2024-08-31T06:28:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.529+0000 7f2753696640 1 -- 172.21.15.53:0/1272272954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274c102770 msgr2=0x7f274c102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.529+0000 7f2753696640 1 --2- 172.21.15.53:0/1272272954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274c102770 0x7f274c102b80 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f2748009900 tx=0x7f274802a410 comp rx=0 tx=0).stop 2024-08-31T06:28:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.530+0000 7f2753696640 1 -- 172.21.15.53:0/1272272954 shutdown_connections 2024-08-31T06:28:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.530+0000 7f2753696640 1 --2- 172.21.15.53:0/1272272954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c1089f0 0x7f274c10f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.530+0000 7f2753696640 1 --2- 172.21.15.53:0/1272272954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c1080a0 0x7f274c1084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.530+0000 7f2753696640 1 --2- 172.21.15.53:0/1272272954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274c102770 0x7f274c102b80 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.530+0000 7f2753696640 1 -- 172.21.15.53:0/1272272954 >> 172.21.15.53:0/1272272954 conn(0x7f274c07a490 msgr2=0x7f274c07a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.530+0000 7f2753696640 1 -- 172.21.15.53:0/1272272954 shutdown_connections 2024-08-31T06:28:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.530+0000 7f2753696640 1 -- 172.21.15.53:0/1272272954 wait complete. 2024-08-31T06:28:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.531+0000 7f2753696640 1 Processor -- start 2024-08-31T06:28:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.531+0000 7f2753696640 1 -- start start 2024-08-31T06:28:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.531+0000 7f2753696640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c102770 0x7f274c197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.531+0000 7f2753696640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c1080a0 0x7f274c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.531+0000 7f2753696640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274c1089f0 0x7f274c19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.531+0000 7f2753696640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f274c1114a0 con 0x7f274c1089f0 2024-08-31T06:28:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.531+0000 7f2753696640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f274c111320 con 0x7f274c102770 2024-08-31T06:28:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.531+0000 7f2753696640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f274c111620 con 0x7f274c1080a0 2024-08-31T06:28:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.531+0000 7f2751c33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274c1089f0 0x7f274c19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.531+0000 7f2751432640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c102770 0x7f274c197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.532+0000 7f2751c33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274c1089f0 0x7f274c19d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32862/0 (socket says 172.21.15.53:32862) 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.532+0000 7f2751432640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c102770 0x7f274c197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46358/0 (socket says 172.21.15.53:46358) 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.532+0000 7f2751c33640 1 -- 172.21.15.53:0/81517263 learned_addr learned my addr 172.21.15.53:0/81517263 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.532+0000 7f2750c31640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c1080a0 0x7f274c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.532+0000 7f2751432640 1 -- 172.21.15.53:0/81517263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c1080a0 msgr2=0x7f274c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.532+0000 7f2751432640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c1080a0 0x7f274c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.532+0000 7f2751432640 1 -- 172.21.15.53:0/81517263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274c1089f0 msgr2=0x7f274c19d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.532+0000 7f2751432640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274c1089f0 0x7f274c19d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.532+0000 7f2751432640 1 -- 172.21.15.53:0/81517263 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274c19de30 con 0x7f274c102770 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.532+0000 7f2751c33640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274c1089f0 0x7f274c19d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.532+0000 7f2751432640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c102770 0x7f274c197f00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f274802a930 tx=0x7f2748003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.533+0000 7f27427fc640 1 -- 172.21.15.53:0/81517263 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274803f070 con 0x7f274c102770 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.533+0000 7f27427fc640 1 -- 172.21.15.53:0/81517263 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f274803baf0 con 0x7f274c102770 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.533+0000 7f2753696640 1 -- 172.21.15.53:0/81517263 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274c19e0c0 con 0x7f274c102770 2024-08-31T06:28:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.533+0000 7f2753696640 1 -- 172.21.15.53:0/81517263 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f274c1a8cc0 con 0x7f274c102770 2024-08-31T06:28:19.537 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.533+0000 7f27427fc640 1 -- 172.21.15.53:0/81517263 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748035030 con 0x7f274c102770 2024-08-31T06:28:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.536+0000 7f275a5ff740 1 Processor -- start 2024-08-31T06:28:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.536+0000 7f275a5ff740 1 -- start start 2024-08-31T06:28:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.536+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176411b0 0x556b179e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.536+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176182f0 0x556b179e5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.536+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176204d0 0x556b179e5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.536+0000 7f275a5ff740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556b1795a000 con 0x556b176411b0 2024-08-31T06:28:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.536+0000 7f275a5ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556b17949590 con 0x556b176182f0 2024-08-31T06:28:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.536+0000 7f275a5ff740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556b1794d540 con 0x556b176204d0 2024-08-31T06:28:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.537+0000 7f2751c33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176411b0 0x556b179e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.537+0000 7f2751c33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176411b0 0x556b179e4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32878/0 (socket says 172.21.15.53:32878) 2024-08-31T06:28:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.537+0000 7f2751c33640 1 -- 172.21.15.53:0/3033348745 learned_addr learned my addr 172.21.15.53:0/3033348745 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.537+0000 7f2750c31640 1 --2- 172.21.15.53:0/3033348745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176204d0 0x556b179e5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.537+0000 7f27427fc640 1 -- 172.21.15.53:0/81517263 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2748042070 con 0x7f274c102770 2024-08-31T06:28:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.537+0000 7f2751c33640 1 -- 172.21.15.53:0/3033348745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176204d0 msgr2=0x556b179e5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.537+0000 7f2751c33640 1 --2- 172.21.15.53:0/3033348745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176204d0 0x556b179e5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.537+0000 7f2751c33640 1 -- 172.21.15.53:0/3033348745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176182f0 msgr2=0x556b179e5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.537+0000 7f2751c33640 1 --2- 172.21.15.53:0/3033348745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176182f0 0x556b179e5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.537+0000 7f2751c33640 1 -- 172.21.15.53:0/3033348745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b176ac790 con 0x556b176411b0 2024-08-31T06:28:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.537+0000 7f2751c33640 1 --2- 172.21.15.53:0/3033348745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176411b0 0x556b179e4ac0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f27440118b0 tx=0x7f2744011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d235cdca4bf656e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.538+0000 7f27377fe640 1 -- 172.21.15.53:0/3033348745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274401e070 con 0x556b176411b0 2024-08-31T06:28:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.538+0000 7f27377fe640 1 -- 172.21.15.53:0/3033348745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f274400fe50 con 0x556b176411b0 2024-08-31T06:28:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.538+0000 7f27377fe640 1 -- 172.21.15.53:0/3033348745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2744010b40 con 0x556b176411b0 2024-08-31T06:28:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.538+0000 7f27427fc640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27380b4d90 0x7f27380b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f2751432640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27380b4d90 0x7f27380b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f27427fc640 1 -- 172.21.15.53:0/81517263 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f27481058d0 con 0x7f274c102770 2024-08-31T06:28:19.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f275a5ff740 1 -- 172.21.15.53:0/3033348745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176411b0 msgr2=0x556b179e4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:19.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f275a5ff740 1 --2- 172.21.15.53:0/3033348745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176411b0 0x556b179e4ac0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f27440118b0 tx=0x7f2744011d70 comp rx=0 tx=0).stop 2024-08-31T06:28:19.545 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f275a5ff740 1 -- 172.21.15.53:0/3033348745 shutdown_connections 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f275a5ff740 1 --2- 172.21.15.53:0/3033348745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176204d0 0x556b179e5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f275a5ff740 1 --2- 172.21.15.53:0/3033348745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176182f0 0x556b179e5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f275a5ff740 1 --2- 172.21.15.53:0/3033348745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176411b0 0x556b179e4ac0 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f275a5ff740 1 -- 172.21.15.53:0/3033348745 >> 172.21.15.53:0/3033348745 conn(0x556b17635300 msgr2=0x556b179e29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f2751432640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27380b4d90 0x7f27380b72a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x556b179e3740 tx=0x7f274802a410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f275a5ff740 1 -- 172.21.15.53:0/3033348745 shutdown_connections 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.539+0000 7f275a5ff740 1 -- 172.21.15.53:0/3033348745 wait complete. 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f275a5ff740 1 -- start start 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f275a5ff740 1 Processor -- start 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176204d0 0x556b179f9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176411b0 0x556b17a04dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f275a5ff740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556b17882ab0 con 0x556b176182f0 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f275a5ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556b178d0680 con 0x556b176204d0 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f275a5ff740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556b179fba00 con 0x556b176411b0 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f275a5ff740 10 client.0 _ll_register_callbacks cb 0x556b17658a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f2751c33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f2751c33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32888/0 (socket says 172.21.15.53:32888) 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.540+0000 7f2751c33640 1 -- 172.21.15.53:0/1039309380 learned_addr learned my addr 172.21.15.53:0/1039309380 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2750c31640 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176204d0 0x556b179f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2751c33640 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176411b0 0x556b17a04dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2750c31640 1 -- 172.21.15.53:0/1039309380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176411b0 msgr2=0x556b17a04dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2750c31640 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176411b0 0x556b17a04dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2750c31640 1 -- 172.21.15.53:0/1039309380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 msgr2=0x556b179f8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2750c31640 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179f8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2750c31640 1 -- 172.21.15.53:0/1039309380 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b17725620 con 0x556b176204d0 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2751c33640 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2750c31640 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176204d0 0x556b179f9310 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f274c06c490 tx=0x7f273c012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fe6f897e9fb0ce8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2734ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2734ff9640 1 -- 172.21.15.53:0/1039309380 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c00f8f0 con 0x556b176204d0 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.541+0000 7f2734ff9640 1 -- 172.21.15.53:0/1039309380 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f273c00fa90 con 0x556b176204d0 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.542+0000 7f275a5ff740 1 -- 172.21.15.53:0/1039309380 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f274400fe50 con 0x556b176204d0 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.542+0000 7f2734ff9640 1 -- 172.21.15.53:0/1039309380 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f273c00fc90 con 0x556b176204d0 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.542+0000 7f275a5ff740 10 client.31220 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.542+0000 7f275a5ff740 1 -- 172.21.15.53:0/1039309380 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x556b17a07a80 con 0x556b176204d0 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.542+0000 7f2734ff9640 1 -- 172.21.15.53:0/1039309380 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f273c00fe30 con 0x556b176204d0 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.543+0000 7f2734ff9640 1 -- 172.21.15.53:0/1039309380 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7f273c024420 con 0x556b176204d0 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.543+0000 7f275a5ff740 10 client.31220 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.543+0000 7f275a5ff740 10 client.31220 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.543+0000 7f275a5ff740 20 client.31220 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.543+0000 7f275a5ff740 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556b175ffd80 0x556b17a0b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.543+0000 7f275a5ff740 4 client.31220 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.543+0000 7f275a5ff740 1 -- 172.21.15.53:0/1039309380 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f274400fe50 con 0x556b175ffd80 2024-08-31T06:28:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.543+0000 7f2751c33640 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556b175ffd80 0x556b17a0b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.543+0000 7f2751c33640 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556b175ffd80 0x556b17a0b020 crc :-1 s=READY pgs=546 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a1e5b2eb570dc09 server_cookie=2815b8bdb3d10bb1 in_seq=0 out_seq=0 2024-08-31T06:28:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.543+0000 7f2734ff9640 10 client.31220 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.544+0000 7f2734ff9640 1 -- 172.21.15.53:0/1039309380 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f274400fe50 con 0x556b175ffd80 2024-08-31T06:28:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.544+0000 7f2734ff9640 10 client.31220 handle_command_reply: tid=0 2024-08-31T06:28:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.544+0000 7f275a5ff740 1 client.31220 shutdown 2024-08-31T06:28:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.544+0000 7f275a5ff740 1 -- 172.21.15.53:0/1039309380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176204d0 msgr2=0x556b179f9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.544+0000 7f275a5ff740 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176204d0 0x556b179f9310 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f274c06c490 tx=0x7f273c012b60 comp rx=0 tx=0).stop 2024-08-31T06:28:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.544+0000 7f275a5ff740 1 -- 172.21.15.53:0/1039309380 shutdown_connections 2024-08-31T06:28:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.544+0000 7f275a5ff740 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556b175ffd80 0x556b17a0b020 crc :-1 s=READY pgs=546 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.545+0000 7f2734ff9640 0 client.31220 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.545+0000 7f275a5ff740 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176411b0 0x556b17a04dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.545+0000 7f275a5ff740 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176204d0 0x556b179f9310 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.545+0000 7f275a5ff740 1 --2- 172.21.15.53:0/1039309380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.545+0000 7f275a5ff740 1 -- 172.21.15.53:0/1039309380 >> 172.21.15.53:0/1039309380 conn(0x556b17635300 msgr2=0x556b179e7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.545+0000 7f275a5ff740 1 -- 172.21.15.53:0/1039309380 shutdown_connections 2024-08-31T06:28:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.545+0000 7f275a5ff740 1 -- 172.21.15.53:0/1039309380 wait complete. 2024-08-31T06:28:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.545+0000 7f275a5ff740 20 client.31220 trim_cache size 0 max 16384 2024-08-31T06:28:19.559 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:28:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f275a5ff740 1 Processor -- start 2024-08-31T06:28:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f275a5ff740 1 -- start start 2024-08-31T06:28:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b175ffd80 0x556b179ea5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179f7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176204d0 0x556b179f7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f275a5ff740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f273000e8c0 con 0x556b176182f0 2024-08-31T06:28:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f275a5ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27300104c0 con 0x556b176204d0 2024-08-31T06:28:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f275a5ff740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f273000ef90 con 0x556b175ffd80 2024-08-31T06:28:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f2751c33640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b175ffd80 0x556b179ea5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f2750c31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f2751c33640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b175ffd80 0x556b179ea5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44128/0 (socket says 172.21.15.53:44128) 2024-08-31T06:28:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f2751c33640 1 -- 172.21.15.53:0/3534721515 learned_addr learned my addr 172.21.15.53:0/3534721515 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.569+0000 7f2751c33640 1 --2- 172.21.15.53:0/3534721515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176204d0 0x556b179f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.570+0000 7f2750c31640 1 -- 172.21.15.53:0/3534721515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b175ffd80 msgr2=0x556b179ea5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.570+0000 7f2750c31640 1 --2- 172.21.15.53:0/3534721515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b175ffd80 0x556b179ea5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.570+0000 7f2750c31640 1 -- 172.21.15.53:0/3534721515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176204d0 msgr2=0x556b179f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.570+0000 7f2750c31640 1 --2- 172.21.15.53:0/3534721515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176204d0 0x556b179f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.570+0000 7f2750c31640 1 -- 172.21.15.53:0/3534721515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b179f9e80 con 0x556b176182f0 2024-08-31T06:28:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.570+0000 7f2750c31640 1 --2- 172.21.15.53:0/3534721515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179f7420 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f273c009e00 tx=0x7f273c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c4dc885dc20053 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.570+0000 7f2736ffd640 1 -- 172.21.15.53:0/3534721515 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c00f8f0 con 0x556b176182f0 2024-08-31T06:28:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.571+0000 7f2736ffd640 1 -- 172.21.15.53:0/3534721515 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f273c00fa90 con 0x556b176182f0 2024-08-31T06:28:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.571+0000 7f2736ffd640 1 -- 172.21.15.53:0/3534721515 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c0035f0 con 0x556b176182f0 2024-08-31T06:28:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.572+0000 7f275a5ff740 1 -- 172.21.15.53:0/3534721515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 msgr2=0x556b179f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.572+0000 7f275a5ff740 1 --2- 172.21.15.53:0/3534721515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179f7420 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f273c009e00 tx=0x7f273c009f70 comp rx=0 tx=0).stop 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.572+0000 7f275a5ff740 1 -- 172.21.15.53:0/3534721515 shutdown_connections 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.572+0000 7f275a5ff740 1 --2- 172.21.15.53:0/3534721515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b176204d0 0x556b179f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.572+0000 7f275a5ff740 1 --2- 172.21.15.53:0/3534721515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179f7420 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.572+0000 7f275a5ff740 1 --2- 172.21.15.53:0/3534721515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b175ffd80 0x556b179ea5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.572+0000 7f275a5ff740 1 -- 172.21.15.53:0/3534721515 >> 172.21.15.53:0/3534721515 conn(0x556b17635300 msgr2=0x556b179f3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.572+0000 7f275a5ff740 1 -- 172.21.15.53:0/3534721515 shutdown_connections 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.572+0000 7f275a5ff740 1 -- 172.21.15.53:0/3534721515 wait complete. 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.573+0000 7f275a5ff740 1 -- start start 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.573+0000 7f275a5ff740 1 Processor -- start 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.573+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b175ffd80 0x556b17a01570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.573+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179fca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.573+0000 7f275a5ff740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176204d0 0x556b179fcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f275a5ff740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f273000fdf0 con 0x556b176182f0 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f2750c31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f2751c33640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b175ffd80 0x556b17a01570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f2750c31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179fca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32902/0 (socket says 172.21.15.53:32902) 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f2750c31640 1 -- 172.21.15.53:0/4251761166 learned_addr learned my addr 172.21.15.53:0/4251761166 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f275a5ff740 1 -- 172.21.15.53:0/4251761166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f273000f720 con 0x556b175ffd80 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f275a5ff740 1 -- 172.21.15.53:0/4251761166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f273000c8c0 con 0x556b176204d0 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f2751c33640 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176204d0 0x556b179fcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f275a5ff740 10 client.0 _ll_register_callbacks cb 0x7f273c009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f2751c33640 1 -- 172.21.15.53:0/4251761166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176204d0 msgr2=0x556b179fcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f2751c33640 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176204d0 0x556b179fcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f2751c33640 1 -- 172.21.15.53:0/4251761166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 msgr2=0x556b179fca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f2751c33640 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179fca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f2751c33640 1 -- 172.21.15.53:0/4251761166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b179fd740 con 0x556b175ffd80 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f2750c31640 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179fca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.574+0000 7f275a5ff740 1 -- 172.21.15.53:0/4251761166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f273c00fa90 con 0x556b175ffd80 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.575+0000 7f2751c33640 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b175ffd80 0x556b17a01570 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2744004a10 tx=0x7f273c009e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de4e69b0e2c394af server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.575+0000 7f2734ff9640 10 client.31226 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.575+0000 7f2734ff9640 1 -- 172.21.15.53:0/4251761166 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274401e040 con 0x556b175ffd80 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.575+0000 7f2734ff9640 1 -- 172.21.15.53:0/4251761166 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f2744011470 con 0x556b175ffd80 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.575+0000 7f2734ff9640 1 -- 172.21.15.53:0/4251761166 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f2744010830 con 0x556b175ffd80 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.575+0000 7f275a5ff740 10 client.31226 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.575+0000 7f275a5ff740 1 -- 172.21.15.53:0/4251761166 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=86}) -- 0x556b17a75920 con 0x556b175ffd80 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.576+0000 7f2734ff9640 1 -- 172.21.15.53:0/4251761166 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7f27440109d0 con 0x556b175ffd80 2024-08-31T06:28:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.576+0000 7f275a5ff740 10 client.31226 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.576+0000 7f275a5ff740 10 client.31226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.576+0000 7f275a5ff740 20 client.31226 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.576+0000 7f275a5ff740 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556b176411b0 0x556b17a77de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.576+0000 7f275a5ff740 4 client.31226 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:28:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.576+0000 7f275a5ff740 1 -- 172.21.15.53:0/4251761166 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556b1795bf50 con 0x556b176411b0 2024-08-31T06:28:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.576+0000 7f2750c31640 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556b176411b0 0x556b17a77de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.576+0000 7f2750c31640 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556b176411b0 0x556b17a77de0 crc :-1 s=READY pgs=547 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cdbfd56ca3bd3f0 server_cookie=3100e737a094f21b in_seq=0 out_seq=0 2024-08-31T06:28:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.576+0000 7f2734ff9640 10 client.31226 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f2734ff9640 1 -- 172.21.15.53:0/4251761166 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556b1795bf50 con 0x556b176411b0 2024-08-31T06:28:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f2734ff9640 10 client.31226 handle_command_reply: tid=0 2024-08-31T06:28:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f275a5ff740 1 client.31226 shutdown 2024-08-31T06:28:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f275a5ff740 1 -- 172.21.15.53:0/4251761166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b175ffd80 msgr2=0x556b17a01570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f275a5ff740 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b175ffd80 0x556b17a01570 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2744004a10 tx=0x7f273c009e30 comp rx=0 tx=0).stop 2024-08-31T06:28:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f275a5ff740 1 -- 172.21.15.53:0/4251761166 shutdown_connections 2024-08-31T06:28:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f275a5ff740 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556b176411b0 0x556b17a77de0 crc :-1 s=READY pgs=547 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f275a5ff740 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b176204d0 0x556b179fcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f275a5ff740 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b176182f0 0x556b179fca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f275a5ff740 1 --2- 172.21.15.53:0/4251761166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556b175ffd80 0x556b17a01570 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f275a5ff740 1 -- 172.21.15.53:0/4251761166 >> 172.21.15.53:0/4251761166 conn(0x556b17635300 msgr2=0x556b179e5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f2734ff9640 0 client.31226 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f275a5ff740 1 -- 172.21.15.53:0/4251761166 shutdown_connections 2024-08-31T06:28:19.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.689+0000 7f275a5ff740 1 -- 172.21.15.53:0/4251761166 wait complete. 2024-08-31T06:28:19.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.690+0000 7f275a5ff740 20 client.31226 trim_cache size 0 max 16384 2024-08-31T06:28:19.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:28:19.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:28:19.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:28:19.694 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:28:19.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.690+0000 7f2753696640 1 -- 172.21.15.53:0/81517263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27380b4d90 msgr2=0x7f27380b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:19.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.690+0000 7f2753696640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27380b4d90 0x7f27380b72a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x556b179e3740 tx=0x7f274802a410 comp rx=0 tx=0).stop 2024-08-31T06:28:19.695 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.690+0000 7f2753696640 1 -- 172.21.15.53:0/81517263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c102770 msgr2=0x7f274c197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.690+0000 7f2753696640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c102770 0x7f274c197f00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f274802a930 tx=0x7f2748003b90 comp rx=0 tx=0).stop 2024-08-31T06:28:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.690+0000 7f2753696640 1 -- 172.21.15.53:0/81517263 shutdown_connections 2024-08-31T06:28:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.690+0000 7f2753696640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f27380b4d90 0x7f27380b72a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.690+0000 7f2753696640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274c1089f0 0x7f274c19d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.690+0000 7f2753696640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f274c1080a0 0x7f274c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.690+0000 7f2753696640 1 --2- 172.21.15.53:0/81517263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c102770 0x7f274c197f00 secure :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f274802a930 tx=0x7f2748003b90 comp rx=0 tx=0).stop 2024-08-31T06:28:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.690+0000 7f2753696640 1 -- 172.21.15.53:0/81517263 >> 172.21.15.53:0/81517263 conn(0x7f274c07a490 msgr2=0x7f274c1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.691+0000 7f2753696640 1 -- 172.21.15.53:0/81517263 shutdown_connections 2024-08-31T06:28:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:19.691+0000 7f2753696640 1 -- 172.21.15.53:0/81517263 wait complete. 2024-08-31T06:28:19.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:19 smithi053 ceph-mon[18924]: pgmap v1060: 97 pgs: 97 active+clean; 954 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 313 op/s 2024-08-31T06:28:19.976 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:19 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:19 smithi130 ceph-mon[22266]: pgmap v1060: 97 pgs: 97 active+clean; 954 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 313 op/s 2024-08-31T06:28:20.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:19 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:20.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:19 smithi153 ceph-mon[22320]: pgmap v1060: 97 pgs: 97 active+clean; 954 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 313 op/s 2024-08-31T06:28:20.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:19 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:20.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.177+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/1996456754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb8108170 msgr2=0x7f5eb8108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:20.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.177+0000 7f5ebfd1c640 1 --2- 172.21.15.53:0/1996456754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb8108170 0x7f5eb8108580 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009900 tx=0x7f5eac02a410 comp rx=0 tx=0).stop 2024-08-31T06:28:20.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.177+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/1996456754 shutdown_connections 2024-08-31T06:28:20.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.177+0000 7f5ebfd1c640 1 --2- 172.21.15.53:0/1996456754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb8108ac0 0x7f5eb810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.177+0000 7f5ebfd1c640 1 --2- 172.21.15.53:0/1996456754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb8108170 0x7f5eb8108580 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.177+0000 7f5ebfd1c640 1 --2- 172.21.15.53:0/1996456754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb8102880 0x7f5eb8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.177+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/1996456754 >> 172.21.15.53:0/1996456754 conn(0x7f5eb8079530 msgr2=0x7f5eb8079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:20.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.178+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/1996456754 shutdown_connections 2024-08-31T06:28:20.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.178+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/1996456754 wait complete. 2024-08-31T06:28:20.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.178+0000 7f5ebfd1c640 1 Processor -- start 2024-08-31T06:28:20.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.178+0000 7f5ebfd1c640 1 -- start start 2024-08-31T06:28:20.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebfd1c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb8102880 0x7f5eb810fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebfd1c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb8108ac0 0x7f5eb8110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebfd1c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb81106d0 0x7f5eb81a8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebfd1c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8113720 con 0x7f5eb8108ac0 2024-08-31T06:28:20.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebfd1c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81135a0 con 0x7f5eb81106d0 2024-08-31T06:28:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebfd1c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81138a0 con 0x7f5eb8102880 2024-08-31T06:28:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebdab8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb8102880 0x7f5eb810fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebdab8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb8102880 0x7f5eb810fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44154/0 (socket says 172.21.15.53:44154) 2024-08-31T06:28:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebd2b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb8108ac0 0x7f5eb8110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebdab8640 1 -- 172.21.15.53:0/3113718497 learned_addr learned my addr 172.21.15.53:0/3113718497 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:20.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebe2b9640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb81106d0 0x7f5eb81a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebdab8640 1 -- 172.21.15.53:0/3113718497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb81106d0 msgr2=0x7f5eb81a8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebdab8640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb81106d0 0x7f5eb81a8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebdab8640 1 -- 172.21.15.53:0/3113718497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb8108ac0 msgr2=0x7f5eb8110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebdab8640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb8108ac0 0x7f5eb8110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebdab8640 1 -- 172.21.15.53:0/3113718497 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb81a8970 con 0x7f5eb8102880 2024-08-31T06:28:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.179+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb8108ac0 0x7f5eb8110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.180+0000 7f5ebdab8640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb8102880 0x7f5eb810fc50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400ea20 tx=0x7f5eb400eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.180+0000 7f5eaaffd640 1 -- 172.21.15.53:0/3113718497 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400cd80 con 0x7f5eb8102880 2024-08-31T06:28:20.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.180+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/3113718497 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb81a8c60 con 0x7f5eb8102880 2024-08-31T06:28:20.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.180+0000 7f5eaaffd640 1 -- 172.21.15.53:0/3113718497 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5eb40108c0 con 0x7f5eb8102880 2024-08-31T06:28:20.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.180+0000 7f5eaaffd640 1 -- 172.21.15.53:0/3113718497 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4018710 con 0x7f5eb8102880 2024-08-31T06:28:20.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.180+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/3113718497 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb81a9170 con 0x7f5eb8102880 2024-08-31T06:28:20.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.184+0000 7f5eaaffd640 1 -- 172.21.15.53:0/3113718497 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5eb40188b0 con 0x7f5eb8102880 2024-08-31T06:28:20.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.184+0000 7f5ec6291740 1 Processor -- start 2024-08-31T06:28:20.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.184+0000 7f5ec6291740 1 -- start start 2024-08-31T06:28:20.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.184+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 0x55f503a3f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a3f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 0x55f503a3fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5ec6291740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f5039b6680 con 0x55f5036711b0 2024-08-31T06:28:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5ec6291740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f5039a5c10 con 0x55f50369a070 2024-08-31T06:28:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5ec6291740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f5039a9bc0 con 0x55f503679390 2024-08-31T06:28:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5ebd2b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 0x55f503a3fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5ebd2b7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 0x55f503a3fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44156/0 (socket says 172.21.15.53:44156) 2024-08-31T06:28:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5ebd2b7640 1 -- 172.21.15.53:0/3736586454 learned_addr learned my addr 172.21.15.53:0/3736586454 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5ebe2b9640 1 --2- 172.21.15.53:0/3736586454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 0x55f503a3f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5ebdab8640 1 --2- 172.21.15.53:0/3736586454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a3f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5eaaffd640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ea40b4d20 0x7f5ea40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5ebd2b7640 1 -- 172.21.15.53:0/3736586454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 msgr2=0x55f503a3f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:20.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.185+0000 7f5eaaffd640 1 -- 172.21.15.53:0/3113718497 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f5eb40e5980 con 0x7f5eb8102880 2024-08-31T06:28:20.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.186+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/3736586454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 0x55f503a3f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.186+0000 7f5ebd2b7640 1 -- 172.21.15.53:0/3736586454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 msgr2=0x55f503a3f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:20.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.186+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/3736586454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a3f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.186+0000 7f5ebd2b7640 1 -- 172.21.15.53:0/3736586454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f503705650 con 0x55f503679390 2024-08-31T06:28:20.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.186+0000 7f5ebe2b9640 1 --2- 172.21.15.53:0/3736586454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 0x55f503a3f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:28:20.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.186+0000 7f5ebdab8640 1 --2- 172.21.15.53:0/3736586454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a3f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:28:20.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.186+0000 7f5ebe2b9640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ea40b4d20 0x7f5ea40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.186+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/3736586454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 0x55f503a3fd90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5eac005760 tx=0x7f5eac005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a7fdf4118377775 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:20.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.187+0000 7f5ebe2b9640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ea40b4d20 0x7f5ea40b7230 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0005fd0 tx=0x7f5eb0014040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.187+0000 7f5ea3fff640 1 -- 172.21.15.53:0/3736586454 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac035040 con 0x55f503679390 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.187+0000 7f5ea3fff640 1 -- 172.21.15.53:0/3736586454 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5eac0044b0 con 0x55f503679390 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.187+0000 7f5ea3fff640 1 -- 172.21.15.53:0/3736586454 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac003d10 con 0x55f503679390 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.188+0000 7f5ec6291740 1 -- 172.21.15.53:0/3736586454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 msgr2=0x55f503a3fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.188+0000 7f5ec6291740 1 --2- 172.21.15.53:0/3736586454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 0x55f503a3fd90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5eac005760 tx=0x7f5eac005e50 comp rx=0 tx=0).stop 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.188+0000 7f5ec6291740 1 -- 172.21.15.53:0/3736586454 shutdown_connections 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.188+0000 7f5ec6291740 1 --2- 172.21.15.53:0/3736586454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 0x55f503a3fd90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.188+0000 7f5ec6291740 1 --2- 172.21.15.53:0/3736586454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a3f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.188+0000 7f5ec6291740 1 --2- 172.21.15.53:0/3736586454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 0x55f503a3f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.188+0000 7f5ec6291740 1 -- 172.21.15.53:0/3736586454 >> 172.21.15.53:0/3736586454 conn(0x55f50368e460 msgr2=0x55f503a3d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.188+0000 7f5ec6291740 1 -- 172.21.15.53:0/3736586454 shutdown_connections 2024-08-31T06:28:20.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.188+0000 7f5ec6291740 1 -- 172.21.15.53:0/3736586454 wait complete. 2024-08-31T06:28:20.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.188+0000 7f5ec6291740 1 -- start start 2024-08-31T06:28:20.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.188+0000 7f5ec6291740 1 Processor -- start 2024-08-31T06:28:20.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a53270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 0x55f503a537b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 0x55f503a5f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ec6291740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f503808700 con 0x55f5036711b0 2024-08-31T06:28:20.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ec6291740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f50392c750 con 0x55f50369a070 2024-08-31T06:28:20.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ec6291740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f503a561c0 con 0x55f503679390 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ebdab8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a53270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ebdab8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a53270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32946/0 (socket says 172.21.15.53:32946) 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ebdab8640 1 -- 172.21.15.53:0/2089621984 learned_addr learned my addr 172.21.15.53:0/2089621984 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ec6291740 10 client.0 _ll_register_callbacks cb 0x55f50395be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ebe2b9640 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 0x55f503a5f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.189+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 0x55f503a537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.190+0000 7f5ebdab8640 1 -- 172.21.15.53:0/2089621984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 msgr2=0x55f503a537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.190+0000 7f5ebdab8640 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 0x55f503a537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.190+0000 7f5ebdab8640 1 -- 172.21.15.53:0/2089621984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 msgr2=0x55f503a5f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.190+0000 7f5ebdab8640 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 0x55f503a5f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.190+0000 7f5ebdab8640 1 -- 172.21.15.53:0/2089621984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f503965900 con 0x55f5036711b0 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.190+0000 7f5ebe2b9640 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 0x55f503a5f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:20.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.190+0000 7f5ebdab8640 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a53270 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009830 tx=0x7f5eb40abbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abf4448fb3c6b5f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.190+0000 7f5ea17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.190+0000 7f5ea17fa640 1 -- 172.21.15.53:0/2089621984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40b5310 con 0x55f5036711b0 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.190+0000 7f5ea17fa640 1 -- 172.21.15.53:0/2089621984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f5eb40b0530 con 0x55f5036711b0 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.190+0000 7f5ec6291740 1 -- 172.21.15.53:0/2089621984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5eac0044b0 con 0x55f5036711b0 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ea17fa640 1 -- 172.21.15.53:0/2089621984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f5eb40d1020 con 0x55f5036711b0 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ec6291740 10 client.22593 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ec6291740 1 -- 172.21.15.53:0/2089621984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x55f503a61f10 con 0x55f5036711b0 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ea17fa640 1 -- 172.21.15.53:0/2089621984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5eb40b4e80 con 0x55f5036711b0 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ea17fa640 1 -- 172.21.15.53:0/2089621984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7f5eb40ab300 con 0x55f5036711b0 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ec6291740 10 client.22593 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ec6291740 10 client.22593 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:28:20.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ec6291740 20 client.22593 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:20.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ec6291740 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f5036589f0 0x55f503a653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ec6291740 4 client.22593 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:20.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ec6291740 1 -- 172.21.15.53:0/2089621984 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5eac0044b0 con 0x55f5036589f0 2024-08-31T06:28:20.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.191+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f5036589f0 0x55f503a653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.192+0000 7f5ea17fa640 10 client.22593 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:28:20.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.192+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f5036589f0 0x55f503a653a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1796ed090cefcef server_cookie=c8d56519c06ea45d in_seq=0 out_seq=0 2024-08-31T06:28:20.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ea17fa640 1 -- 172.21.15.53:0/2089621984 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f5eac0044b0 con 0x55f5036589f0 2024-08-31T06:28:20.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ea17fa640 10 client.22593 handle_command_reply: tid=0 2024-08-31T06:28:20.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ec6291740 1 client.22593 shutdown 2024-08-31T06:28:20.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ec6291740 1 -- 172.21.15.53:0/2089621984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 msgr2=0x55f503a53270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:20.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ec6291740 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a53270 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009830 tx=0x7f5eb40abbb0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ec6291740 1 -- 172.21.15.53:0/2089621984 shutdown_connections 2024-08-31T06:28:20.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ec6291740 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f5036589f0 0x55f503a653a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ec6291740 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f50369a070 0x55f503a5f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ea17fa640 0 client.22593 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:28:20.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ec6291740 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f503679390 0x55f503a537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ec6291740 1 --2- 172.21.15.53:0/2089621984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a53270 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.193+0000 7f5ec6291740 1 -- 172.21.15.53:0/2089621984 >> 172.21.15.53:0/2089621984 conn(0x55f50368e460 msgr2=0x55f503a3b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:20.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.194+0000 7f5ec6291740 1 -- 172.21.15.53:0/2089621984 shutdown_connections 2024-08-31T06:28:20.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.194+0000 7f5ec6291740 1 -- 172.21.15.53:0/2089621984 wait complete. 2024-08-31T06:28:20.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.194+0000 7f5ec6291740 20 client.22593 trim_cache size 0 max 16384 2024-08-31T06:28:20.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.213+0000 7f5ec6291740 1 Processor -- start 2024-08-31T06:28:20.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.213+0000 7f5ec6291740 1 -- start start 2024-08-31T06:28:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.213+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5036589f0 0x55f503a53730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.213+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a3d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.213+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f503679390 0x55f503a5f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.213+0000 7f5ec6291740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81ad7d0 con 0x55f5036711b0 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.213+0000 7f5ec6291740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81af3d0 con 0x55f503679390 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.213+0000 7f5ec6291740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81adea0 con 0x55f5036589f0 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ebd2b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a3d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ebdab8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5036589f0 0x55f503a53730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ebe2b9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f503679390 0x55f503a5f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ebd2b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a3d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32958/0 (socket says 172.21.15.53:32958) 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ebd2b7640 1 -- 172.21.15.53:0/1617360765 learned_addr learned my addr 172.21.15.53:0/1617360765 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ebd2b7640 1 -- 172.21.15.53:0/1617360765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5036589f0 msgr2=0x55f503a53730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/1617360765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5036589f0 0x55f503a53730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ebd2b7640 1 -- 172.21.15.53:0/1617360765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f503679390 msgr2=0x55f503a5f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/1617360765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f503679390 0x55f503a5f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ebd2b7640 1 -- 172.21.15.53:0/1617360765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f503a51770 con 0x55f5036711b0 2024-08-31T06:28:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/1617360765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a3d2b0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009900 tx=0x7f5eac049040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47531bbc25398ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.214+0000 7f5ea37fe640 1 -- 172.21.15.53:0/1617360765 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac035040 con 0x55f5036711b0 2024-08-31T06:28:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.215+0000 7f5ea37fe640 1 -- 172.21.15.53:0/1617360765 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5eac0528c0 con 0x55f5036711b0 2024-08-31T06:28:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.215+0000 7f5ea37fe640 1 -- 172.21.15.53:0/1617360765 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac000e60 con 0x55f5036711b0 2024-08-31T06:28:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.216+0000 7f5ec6291740 1 -- 172.21.15.53:0/1617360765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 msgr2=0x55f503a3d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.216+0000 7f5ec6291740 1 --2- 172.21.15.53:0/1617360765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a3d2b0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009900 tx=0x7f5eac049040 comp rx=0 tx=0).stop 2024-08-31T06:28:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.216+0000 7f5ec6291740 1 -- 172.21.15.53:0/1617360765 shutdown_connections 2024-08-31T06:28:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.216+0000 7f5ec6291740 1 --2- 172.21.15.53:0/1617360765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f503679390 0x55f503a5f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.216+0000 7f5ec6291740 1 --2- 172.21.15.53:0/1617360765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036711b0 0x55f503a3d2b0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.216+0000 7f5ec6291740 1 --2- 172.21.15.53:0/1617360765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5036589f0 0x55f503a53730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.216+0000 7f5ec6291740 1 -- 172.21.15.53:0/1617360765 >> 172.21.15.53:0/1617360765 conn(0x55f50368e460 msgr2=0x55f503a53020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.216+0000 7f5ec6291740 1 -- 172.21.15.53:0/1617360765 shutdown_connections 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.216+0000 7f5ec6291740 1 -- 172.21.15.53:0/1617360765 wait complete. 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.216+0000 7f5ec6291740 1 -- start start 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ec6291740 1 Processor -- start 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036589f0 0x55f503a57e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5036711b0 0x55f503a58430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ebdab8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036589f0 0x55f503a57e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ebdab8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036589f0 0x55f503a57e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32964/0 (socket says 172.21.15.53:32964) 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ec6291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f503679390 0x55f503ac8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ebdab8640 1 -- 172.21.15.53:0/783736847 learned_addr learned my addr 172.21.15.53:0/783736847 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ec6291740 1 -- 172.21.15.53:0/783736847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81aed00 con 0x55f5036589f0 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ec6291740 1 -- 172.21.15.53:0/783736847 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81ae630 con 0x55f503679390 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ec6291740 1 -- 172.21.15.53:0/783736847 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81ab7f0 con 0x55f5036711b0 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ec6291740 10 client.0 _ll_register_callbacks cb 0x7f5eb400ef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.217+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5036711b0 0x55f503a58430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ebe2b9640 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f503679390 0x55f503ac8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ebdab8640 1 -- 172.21.15.53:0/783736847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5036711b0 msgr2=0x55f503a58430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ebdab8640 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5036711b0 0x55f503a58430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ebdab8640 1 -- 172.21.15.53:0/783736847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f503679390 msgr2=0x55f503ac8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ebdab8640 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f503679390 0x55f503ac8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ebdab8640 1 -- 172.21.15.53:0/783736847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f503ac9410 con 0x55f5036589f0 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ebe2b9640 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f503679390 0x55f503ac8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:28:20.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ebdab8640 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036589f0 0x55f503a57e90 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40ac260 tx=0x7f5eb400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5902933a0c3fa67 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ea17fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ea17fa640 1 -- 172.21.15.53:0/783736847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40c6060 con 0x55f5036589f0 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ea17fa640 1 -- 172.21.15.53:0/783736847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f5eb40b4e80 con 0x55f5036589f0 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.218+0000 7f5ec6291740 1 -- 172.21.15.53:0/783736847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5eac0528c0 con 0x55f5036589f0 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ea17fa640 1 -- 172.21.15.53:0/783736847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f5eb40cd050 con 0x55f5036589f0 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ec6291740 10 client.22599 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ec6291740 1 -- 172.21.15.53:0/783736847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x55f503ad0830 con 0x55f5036589f0 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ea17fa640 1 -- 172.21.15.53:0/783736847 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5eb40b5310 con 0x55f5036589f0 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ea17fa640 1 -- 172.21.15.53:0/783736847 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7f5eb4097110 con 0x55f5036589f0 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ec6291740 10 client.22599 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ec6291740 10 client.22599 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:28:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ec6291740 20 client.22599 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:20.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ec6291740 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f50369a070 0x55f503ad2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:20.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ec6291740 4 client.22599 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:28:20.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ec6291740 1 -- 172.21.15.53:0/783736847 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5eac0528c0 con 0x55f50369a070 2024-08-31T06:28:20.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.219+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f50369a070 0x55f503ad2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:20.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ea17fa640 10 client.22599 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:28:20.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ebd2b7640 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f50369a070 0x55f503ad2ee0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=34ad2ddbd88918e server_cookie=c6e24ae549c031b0 in_seq=0 out_seq=0 2024-08-31T06:28:20.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ea17fa640 1 -- 172.21.15.53:0/783736847 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5eac0528c0 con 0x55f50369a070 2024-08-31T06:28:20.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ea17fa640 10 client.22599 handle_command_reply: tid=0 2024-08-31T06:28:20.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ec6291740 1 client.22599 shutdown 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ec6291740 1 -- 172.21.15.53:0/783736847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036589f0 msgr2=0x55f503a57e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ec6291740 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036589f0 0x55f503a57e90 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40ac260 tx=0x7f5eb400c840 comp rx=0 tx=0).stop 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ec6291740 1 -- 172.21.15.53:0/783736847 shutdown_connections 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ec6291740 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x55f50369a070 0x55f503ad2ee0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ea17fa640 0 client.22599 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ec6291740 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f503679390 0x55f503ac8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ec6291740 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f5036711b0 0x55f503a58430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ec6291740 1 --2- 172.21.15.53:0/783736847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5036589f0 0x55f503a57e90 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.220+0000 7f5ec6291740 1 -- 172.21.15.53:0/783736847 >> 172.21.15.53:0/783736847 conn(0x55f50368e460 msgr2=0x55f503a40340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.221+0000 7f5ec6291740 1 -- 172.21.15.53:0/783736847 shutdown_connections 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.221+0000 7f5ec6291740 1 -- 172.21.15.53:0/783736847 wait complete. 2024-08-31T06:28:20.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.221+0000 7f5ec6291740 20 client.22599 trim_cache size 0 max 16384 2024-08-31T06:28:20.228 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:28:20.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.221+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/3113718497 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ea40b4d20 msgr2=0x7f5ea40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:20.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.221+0000 7f5ebfd1c640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ea40b4d20 0x7f5ea40b7230 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0005fd0 tx=0x7f5eb0014040 comp rx=0 tx=0).stop 2024-08-31T06:28:20.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.222+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/3113718497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb8102880 msgr2=0x7f5eb810fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:20.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.222+0000 7f5ebfd1c640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb8102880 0x7f5eb810fc50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400ea20 tx=0x7f5eb400eee0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.222+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/3113718497 shutdown_connections 2024-08-31T06:28:20.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.222+0000 7f5ebfd1c640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5ea40b4d20 0x7f5ea40b7230 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.222+0000 7f5ebfd1c640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5eb81106d0 0x7f5eb81a8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.222+0000 7f5ebfd1c640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb8108ac0 0x7f5eb8110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.222+0000 7f5ebfd1c640 1 --2- 172.21.15.53:0/3113718497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5eb8102880 0x7f5eb810fc50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:20.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.222+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/3113718497 >> 172.21.15.53:0/3113718497 conn(0x7f5eb8079530 msgr2=0x7f5eb81062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:20.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.222+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/3113718497 shutdown_connections 2024-08-31T06:28:20.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:20.222+0000 7f5ebfd1c640 1 -- 172.21.15.53:0/3113718497 wait complete. 2024-08-31T06:28:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 61955 5.28 MB/sec execute 488 sec latency 101.354 ms 2024-08-31T06:28:20.992 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:28:21.363 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:28:21.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 62091 5.29 MB/sec execute 489 sec latency 153.041 ms 2024-08-31T06:28:21.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.936+0000 7f9ef3a63640 1 -- 172.21.15.53:0/2577399036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9eec109bd0 msgr2=0x7f9eec110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:21.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.936+0000 7f9ef3a63640 1 --2- 172.21.15.53:0/2577399036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9eec109bd0 0x7f9eec110400 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009ca0 tx=0x7f9ee402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.936+0000 7f9ef3a63640 1 -- 172.21.15.53:0/2577399036 shutdown_connections 2024-08-31T06:28:21.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.936+0000 7f9ef3a63640 1 --2- 172.21.15.53:0/2577399036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9eec109bd0 0x7f9eec110400 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.936+0000 7f9ef3a63640 1 --2- 172.21.15.53:0/2577399036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9eec109280 0x7f9eec109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.936+0000 7f9ef3a63640 1 --2- 172.21.15.53:0/2577399036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eec103940 0x7f9eec103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.936+0000 7f9ef3a63640 1 -- 172.21.15.53:0/2577399036 >> 172.21.15.53:0/2577399036 conn(0x7f9eec0ff3d0 msgr2=0x7f9eec101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:21.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.937+0000 7f9ef3a63640 1 -- 172.21.15.53:0/2577399036 shutdown_connections 2024-08-31T06:28:21.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.937+0000 7f9ef3a63640 1 -- 172.21.15.53:0/2577399036 wait complete. 2024-08-31T06:28:21.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.938+0000 7f9ef3a63640 1 Processor -- start 2024-08-31T06:28:21.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.938+0000 7f9ef3a63640 1 -- start start 2024-08-31T06:28:21.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.938+0000 7f9ef3a63640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eec103940 0x7f9eec10d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.938+0000 7f9ef3a63640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9eec109280 0x7f9eec10dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.938+0000 7f9ef3a63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9eec109bd0 0x7f9eec10e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.938+0000 7f9ef3a63640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec076c90 con 0x7f9eec109bd0 2024-08-31T06:28:21.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.938+0000 7f9ef3a63640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec076b10 con 0x7f9eec109280 2024-08-31T06:28:21.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.938+0000 7f9ef3a63640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec076e10 con 0x7f9eec103940 2024-08-31T06:28:21.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.938+0000 7f9ef2000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9eec109bd0 0x7f9eec10e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.938+0000 7f9ef2000640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9eec109bd0 0x7f9eec10e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32980/0 (socket says 172.21.15.53:32980) 2024-08-31T06:28:21.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.938+0000 7f9ef2000640 1 -- 172.21.15.53:0/3196134525 learned_addr learned my addr 172.21.15.53:0/3196134525 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:21.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.939+0000 7f9ef17ff640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eec103940 0x7f9eec10d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.939+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9eec109280 0x7f9eec10dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.939+0000 7f9ef2000640 1 -- 172.21.15.53:0/3196134525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eec103940 msgr2=0x7f9eec10d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:21.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.939+0000 7f9ef2000640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eec103940 0x7f9eec10d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.939+0000 7f9ef2000640 1 -- 172.21.15.53:0/3196134525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9eec109280 msgr2=0x7f9eec10dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:21.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.939+0000 7f9ef2000640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9eec109280 0x7f9eec10dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.939+0000 7f9ef2000640 1 -- 172.21.15.53:0/3196134525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eec1ac820 con 0x7f9eec109bd0 2024-08-31T06:28:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.939+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9eec109280 0x7f9eec10dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:28:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.939+0000 7f9ef2000640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9eec109bd0 0x7f9eec10e180 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4005cc0 tx=0x7f9ee4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.940+0000 7f9ee27fc640 1 -- 172.21.15.53:0/3196134525 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4032c10 con 0x7f9eec109bd0 2024-08-31T06:28:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.940+0000 7f9ee27fc640 1 -- 172.21.15.53:0/3196134525 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ee4032db0 con 0x7f9eec109bd0 2024-08-31T06:28:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.940+0000 7f9ef3a63640 1 -- 172.21.15.53:0/3196134525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eec1acab0 con 0x7f9eec109bd0 2024-08-31T06:28:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.940+0000 7f9ee27fc640 1 -- 172.21.15.53:0/3196134525 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4030a60 con 0x7f9eec109bd0 2024-08-31T06:28:21.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.940+0000 7f9ef3a63640 1 -- 172.21.15.53:0/3196134525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eec1ad010 con 0x7f9eec109bd0 2024-08-31T06:28:21.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.943+0000 7f9ef9fd8740 1 Processor -- start 2024-08-31T06:28:21.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.944+0000 7f9ee27fc640 1 -- 172.21.15.53:0/3196134525 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9ee4030c00 con 0x7f9eec109bd0 2024-08-31T06:28:21.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.944+0000 7f9ef9fd8740 1 -- start start 2024-08-31T06:28:21.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.944+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c870310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.944+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4a21b0 0x55782c870850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.944+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4aa390 0x55782c870d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.944+0000 7f9ef9fd8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55782c7e7680 con 0x55782c4a21b0 2024-08-31T06:28:21.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.944+0000 7f9ef9fd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55782c7d6c10 con 0x55782c4cb070 2024-08-31T06:28:21.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.944+0000 7f9ef9fd8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55782c7dabc0 con 0x55782c4aa390 2024-08-31T06:28:21.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ef17ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4a21b0 0x55782c870850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ef17ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4a21b0 0x55782c870850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32988/0 (socket says 172.21.15.53:32988) 2024-08-31T06:28:21.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ef17ff640 1 -- 172.21.15.53:0/2279543237 learned_addr learned my addr 172.21.15.53:0/2279543237 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:21.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/2279543237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c870310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/2279543237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4aa390 0x55782c870d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ef17ff640 1 -- 172.21.15.53:0/2279543237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4aa390 msgr2=0x55782c870d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:21.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ef17ff640 1 --2- 172.21.15.53:0/2279543237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4aa390 0x55782c870d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ef17ff640 1 -- 172.21.15.53:0/2279543237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 msgr2=0x55782c870310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:21.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ef17ff640 1 --2- 172.21.15.53:0/2279543237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c870310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ef17ff640 1 -- 172.21.15.53:0/2279543237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55782c536650 con 0x55782c4a21b0 2024-08-31T06:28:21.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ee27fc640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ed80b4da0 0x7f9ed80b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ef17ff640 1 --2- 172.21.15.53:0/2279543237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4a21b0 0x55782c870850 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009ca0 tx=0x7f9ee8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcac0fbfd6082e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.945+0000 7f9ee27fc640 1 -- 172.21.15.53:0/3196134525 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f9ee41068f0 con 0x7f9eec109bd0 2024-08-31T06:28:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.946+0000 7f9ed77fe640 1 -- 172.21.15.53:0/2279543237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8005220 con 0x55782c4a21b0 2024-08-31T06:28:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.946+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ed80b4da0 0x7f9ed80b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.946+0000 7f9ed77fe640 1 -- 172.21.15.53:0/2279543237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ee8004c30 con 0x55782c4a21b0 2024-08-31T06:28:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.946+0000 7f9ed77fe640 1 -- 172.21.15.53:0/2279543237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8019690 con 0x55782c4a21b0 2024-08-31T06:28:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.947+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2279543237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4a21b0 msgr2=0x55782c870850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.947+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ed80b4da0 0x7f9ed80b72b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009fd0 tx=0x7f9edc009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.947+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/2279543237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4a21b0 0x55782c870850 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009ca0 tx=0x7f9ee8011810 comp rx=0 tx=0).stop 2024-08-31T06:28:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.947+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2279543237 shutdown_connections 2024-08-31T06:28:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.947+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/2279543237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4aa390 0x55782c870d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.947+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/2279543237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4a21b0 0x55782c870850 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.947+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/2279543237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c870310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.947+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2279543237 >> 172.21.15.53:0/2279543237 conn(0x55782c4bf460 msgr2=0x55782c86e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.947+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2279543237 shutdown_connections 2024-08-31T06:28:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.948+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2279543237 wait complete. 2024-08-31T06:28:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.948+0000 7f9ef9fd8740 1 -- start start 2024-08-31T06:28:21.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.948+0000 7f9ef9fd8740 1 Processor -- start 2024-08-31T06:28:21.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4a21b0 0x55782c87ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4aa390 0x55782c87bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4cb070 0x55782c887de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef9fd8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55782c639700 con 0x55782c4cb070 2024-08-31T06:28:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef9fd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55782c75d750 con 0x55782c4a21b0 2024-08-31T06:28:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef9fd8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55782c87eaf0 con 0x55782c4aa390 2024-08-31T06:28:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef17ff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4a21b0 0x55782c87ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef17ff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4a21b0 0x55782c87ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46464/0 (socket says 172.21.15.53:46464) 2024-08-31T06:28:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef17ff640 1 -- 172.21.15.53:0/1635645393 learned_addr learned my addr 172.21.15.53:0/1635645393 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef9fd8740 10 client.0 _ll_register_callbacks cb 0x55782c78ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4aa390 0x55782c87bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef2000640 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4cb070 0x55782c887de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef17ff640 1 -- 172.21.15.53:0/1635645393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4aa390 msgr2=0x55782c87bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef17ff640 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4aa390 0x55782c87bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef17ff640 1 -- 172.21.15.53:0/1635645393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4cb070 msgr2=0x55782c887de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef17ff640 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4cb070 0x55782c887de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef17ff640 1 -- 172.21.15.53:0/1635645393 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55782c796900 con 0x55782c4a21b0 2024-08-31T06:28:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.949+0000 7f9ef2000640 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4cb070 0x55782c887de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:28:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.950+0000 7f9ef17ff640 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4a21b0 0x55782c87ba50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9ee801b040 tx=0x7f9ee8005010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12dc26561b416bdb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.950+0000 7f9ed4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:28:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.950+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/1635645393 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8029070 con 0x55782c4a21b0 2024-08-31T06:28:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.950+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/1635645393 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f9ee8023630 con 0x55782c4a21b0 2024-08-31T06:28:21.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.950+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1635645393 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ee8004c30 con 0x55782c4a21b0 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.950+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/1635645393 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f9ee8035050 con 0x55782c4a21b0 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.950+0000 7f9ef9fd8740 10 client.31256 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.950+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1635645393 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x55782c88a840 con 0x55782c4a21b0 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.950+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/1635645393 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ee8004c30 con 0x55782c4a21b0 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.951+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/1635645393 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7f9ee80194c0 con 0x55782c4a21b0 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.951+0000 7f9ef9fd8740 10 client.31256 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.951+0000 7f9ef9fd8740 10 client.31256 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.951+0000 7f9ef9fd8740 20 client.31256 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.952+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55782c4899f0 0x55782c88dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.952+0000 7f9ef9fd8740 4 client.31256 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.952+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1635645393 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55782c7e95d0 con 0x55782c4899f0 2024-08-31T06:28:21.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.952+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55782c4899f0 0x55782c88dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.953+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55782c4899f0 0x55782c88dba0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=16e2f380c035bf6b server_cookie=6b20db2cc7a8d67e in_seq=0 out_seq=0 2024-08-31T06:28:21.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.953+0000 7f9ed4ff9640 10 client.31256 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:28:21.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.954+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/1635645393 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55782c7e95d0 con 0x55782c4899f0 2024-08-31T06:28:21.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.954+0000 7f9ed4ff9640 10 client.31256 handle_command_reply: tid=0 2024-08-31T06:28:21.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.954+0000 7f9ef9fd8740 1 client.31256 shutdown 2024-08-31T06:28:21.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.955+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1635645393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4a21b0 msgr2=0x55782c87ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:21.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.955+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4a21b0 0x55782c87ba50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9ee801b040 tx=0x7f9ee8005010 comp rx=0 tx=0).stop 2024-08-31T06:28:21.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.955+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1635645393 shutdown_connections 2024-08-31T06:28:21.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.955+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55782c4899f0 0x55782c88dba0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.955+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4cb070 0x55782c887de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.955+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4aa390 0x55782c87bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.955+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/1635645393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4a21b0 0x55782c87ba50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.955+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1635645393 >> 172.21.15.53:0/1635645393 conn(0x55782c4bf460 msgr2=0x55782c8734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:21.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.955+0000 7f9ed4ff9640 0 client.31256 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:28:21.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.955+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1635645393 shutdown_connections 2024-08-31T06:28:21.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.955+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1635645393 wait complete. 2024-08-31T06:28:21.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.956+0000 7f9ef9fd8740 20 client.31256 trim_cache size 0 max 16384 2024-08-31T06:28:21.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.978+0000 7f9ef9fd8740 1 Processor -- start 2024-08-31T06:28:21.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.978+0000 7f9ef9fd8740 1 -- start start 2024-08-31T06:28:21.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.978+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4a21b0 0x55782c86e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.978+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 0x55782c887ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.978+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c878c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.978+0000 7f9ef9fd8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1b5af0 con 0x55782c4aa390 2024-08-31T06:28:21.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.978+0000 7f9ef9fd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1b76f0 con 0x55782c4cb070 2024-08-31T06:28:21.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.978+0000 7f9ef9fd8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1b61c0 con 0x55782c4a21b0 2024-08-31T06:28:21.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.979+0000 7f9ef2000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c878c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.979+0000 7f9ef2000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c878c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:46474/0 (socket says 172.21.15.53:46474) 2024-08-31T06:28:21.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.979+0000 7f9ef2000640 1 -- 172.21.15.53:0/1804974853 learned_addr learned my addr 172.21.15.53:0/1804974853 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:21.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.979+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/1804974853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 0x55782c887ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.979+0000 7f9ef2000640 1 -- 172.21.15.53:0/1804974853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4a21b0 msgr2=0x55782c86e270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:28:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.979+0000 7f9ef2000640 1 --2- 172.21.15.53:0/1804974853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4a21b0 0x55782c86e270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.979+0000 7f9ef2000640 1 -- 172.21.15.53:0/1804974853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 msgr2=0x55782c887ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.979+0000 7f9ef2000640 1 --2- 172.21.15.53:0/1804974853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 0x55782c887ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.979+0000 7f9ef2000640 1 -- 172.21.15.53:0/1804974853 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55782c872600 con 0x55782c4cb070 2024-08-31T06:28:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.979+0000 7f9ef2000640 1 --2- 172.21.15.53:0/1804974853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c878c40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4005e30 tx=0x7f9ee40cc790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d49de742c2ff8cf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.980+0000 7f9ed6ffd640 1 -- 172.21.15.53:0/1804974853 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40b2e60 con 0x55782c4cb070 2024-08-31T06:28:21.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.980+0000 7f9ed6ffd640 1 -- 172.21.15.53:0/1804974853 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ee4036030 con 0x55782c4cb070 2024-08-31T06:28:21.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.980+0000 7f9ed6ffd640 1 -- 172.21.15.53:0/1804974853 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40d1340 con 0x55782c4cb070 2024-08-31T06:28:21.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.981+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1804974853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 msgr2=0x55782c878c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:21.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.981+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/1804974853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c878c40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4005e30 tx=0x7f9ee40cc790 comp rx=0 tx=0).stop 2024-08-31T06:28:21.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.981+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1804974853 shutdown_connections 2024-08-31T06:28:21.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.981+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/1804974853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c878c40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.981+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/1804974853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 0x55782c887ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.981+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/1804974853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4a21b0 0x55782c86e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.981+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1804974853 >> 172.21.15.53:0/1804974853 conn(0x55782c4bf460 msgr2=0x55782c86db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:21.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.981+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1804974853 shutdown_connections 2024-08-31T06:28:21.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.981+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/1804974853 wait complete. 2024-08-31T06:28:21.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.981+0000 7f9ef9fd8740 1 -- start start 2024-08-31T06:28:21.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.982+0000 7f9ef9fd8740 1 Processor -- start 2024-08-31T06:28:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.982+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4a21b0 0x55782c87fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.982+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 0x55782c8803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.982+0000 7f9ef9fd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c880900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.982+0000 7f9ef9fd8740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1b7020 con 0x55782c4aa390 2024-08-31T06:28:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef0ffe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 0x55782c8803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef0ffe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 0x55782c8803c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33030/0 (socket says 172.21.15.53:33030) 2024-08-31T06:28:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef0ffe640 1 -- 172.21.15.53:0/2336852566 learned_addr learned my addr 172.21.15.53:0/2336852566 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef17ff640 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4a21b0 0x55782c87fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef2000640 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c880900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef9fd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1b6950 con 0x55782c4cb070 2024-08-31T06:28:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2336852566 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1b3af0 con 0x55782c4a21b0 2024-08-31T06:28:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef9fd8740 10 client.0 _ll_register_callbacks cb 0x7f9edc009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef0ffe640 1 -- 172.21.15.53:0/2336852566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4a21b0 msgr2=0x55782c87fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4a21b0 0x55782c87fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef0ffe640 1 -- 172.21.15.53:0/2336852566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 msgr2=0x55782c880900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c880900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.983+0000 7f9ef0ffe640 1 -- 172.21.15.53:0/2336852566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55782c8f7600 con 0x55782c4aa390 2024-08-31T06:28:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.984+0000 7f9ef0ffe640 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 0x55782c8803c0 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x55782c88e240 tx=0x7f9edc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c92f84a778b4a97 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.984+0000 7f9ed4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.984+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/2336852566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc004230 con 0x55782c4aa390 2024-08-31T06:28:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.984+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/2336852566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f9edc0043d0 con 0x55782c4aa390 2024-08-31T06:28:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.984+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2336852566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ee4036030 con 0x55782c4aa390 2024-08-31T06:28:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.984+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/2336852566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f9edc022630 con 0x55782c4aa390 2024-08-31T06:28:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.984+0000 7f9ef9fd8740 10 client.22614 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.984+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2336852566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x55782c8f88f0 con 0x55782c4aa390 2024-08-31T06:28:21.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.985+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/2336852566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ee4036030 con 0x55782c4aa390 2024-08-31T06:28:21.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.985+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/2336852566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7f9edc003870 con 0x55782c4aa390 2024-08-31T06:28:21.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.985+0000 7f9ef9fd8740 10 client.22614 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:21.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.985+0000 7f9ef9fd8740 10 client.22614 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:28:21.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.985+0000 7f9ef9fd8740 20 client.22614 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:21.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.985+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55782c45eda0 0x55782c8fb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:21.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.985+0000 7f9ef9fd8740 4 client.22614 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:28:21.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.985+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2336852566 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55782c7e5070 con 0x55782c45eda0 2024-08-31T06:28:21.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.987+0000 7f9ef17ff640 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55782c45eda0 0x55782c8fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:21.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.987+0000 7f9ef17ff640 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55782c45eda0 0x55782c8fb110 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=54cbc7824a00d0cd server_cookie=1a8bcddd36c33e1 in_seq=0 out_seq=0 2024-08-31T06:28:21.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.987+0000 7f9ed4ff9640 10 client.22614 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:28:21.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.988+0000 7f9ed4ff9640 1 -- 172.21.15.53:0/2336852566 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55782c7e5070 con 0x55782c45eda0 2024-08-31T06:28:21.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.988+0000 7f9ed4ff9640 10 client.22614 handle_command_reply: tid=0 2024-08-31T06:28:21.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.988+0000 7f9ef9fd8740 1 client.22614 shutdown 2024-08-31T06:28:21.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.988+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2336852566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 msgr2=0x55782c8803c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:21.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.988+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 0x55782c8803c0 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x55782c88e240 tx=0x7f9edc004730 comp rx=0 tx=0).stop 2024-08-31T06:28:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.988+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2336852566 shutdown_connections 2024-08-31T06:28:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.988+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55782c45eda0 0x55782c8fb110 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.988+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55782c4cb070 0x55782c880900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.988+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55782c4aa390 0x55782c8803c0 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.988+0000 7f9ef9fd8740 1 --2- 172.21.15.53:0/2336852566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55782c4a21b0 0x55782c87fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.989+0000 7f9ed4ff9640 0 client.22614 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:28:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.989+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2336852566 >> 172.21.15.53:0/2336852566 conn(0x55782c4bf460 msgr2=0x55782c871340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.989+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2336852566 shutdown_connections 2024-08-31T06:28:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.990+0000 7f9ef9fd8740 1 -- 172.21.15.53:0/2336852566 wait complete. 2024-08-31T06:28:21.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.990+0000 7f9ef9fd8740 20 client.22614 trim_cache size 0 max 16384 2024-08-31T06:28:21.994 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:28:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 -- 172.21.15.53:0/3196134525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ed80b4da0 msgr2=0x7f9ed80b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ed80b4da0 0x7f9ed80b72b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009fd0 tx=0x7f9edc009680 comp rx=0 tx=0).stop 2024-08-31T06:28:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 -- 172.21.15.53:0/3196134525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9eec109bd0 msgr2=0x7f9eec10e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9eec109bd0 0x7f9eec10e180 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4005cc0 tx=0x7f9ee4003f90 comp rx=0 tx=0).stop 2024-08-31T06:28:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 -- 172.21.15.53:0/3196134525 shutdown_connections 2024-08-31T06:28:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9ed80b4da0 0x7f9ed80b72b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9eec109bd0 0x7f9eec10e180 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9eec109280 0x7f9eec10dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 --2- 172.21.15.53:0/3196134525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eec103940 0x7f9eec10d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 -- 172.21.15.53:0/3196134525 >> 172.21.15.53:0/3196134525 conn(0x7f9eec0ff3d0 msgr2=0x7f9eec106780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 -- 172.21.15.53:0/3196134525 shutdown_connections 2024-08-31T06:28:21.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:21.991+0000 7f9ef3a63640 1 -- 172.21.15.53:0/3196134525 wait complete. 2024-08-31T06:28:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:21 smithi130 ceph-mon[22266]: pgmap v1061: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 300 op/s 2024-08-31T06:28:22.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:21 smithi153 ceph-mon[22320]: pgmap v1061: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 300 op/s 2024-08-31T06:28:22.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:21 smithi053 ceph-mon[18924]: pgmap v1061: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 300 op/s 2024-08-31T06:28:22.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 62224 5.29 MB/sec execute 490 sec latency 175.946 ms 2024-08-31T06:28:22.789 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:28:23.151 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:28:23.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 62364 5.29 MB/sec execute 491 sec latency 66.061 ms 2024-08-31T06:28:23.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.721+0000 7f0140290640 1 -- 172.21.15.53:0/721448416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0138108a90 msgr2=0x7f013810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:23.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.721+0000 7f0140290640 1 --2- 172.21.15.53:0/721448416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0138108a90 0x7f013810f2c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0130009be0 tx=0x7f013002a6c0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.722+0000 7f0140290640 1 -- 172.21.15.53:0/721448416 shutdown_connections 2024-08-31T06:28:23.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.722+0000 7f0140290640 1 --2- 172.21.15.53:0/721448416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0138108a90 0x7f013810f2c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.722+0000 7f0140290640 1 --2- 172.21.15.53:0/721448416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0138108140 0x7f0138108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.722+0000 7f0140290640 1 --2- 172.21.15.53:0/721448416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138102800 0x7f0138102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.722+0000 7f0140290640 1 -- 172.21.15.53:0/721448416 >> 172.21.15.53:0/721448416 conn(0x7f01380794d0 msgr2=0x7f01380798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:23.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.722+0000 7f0140290640 1 -- 172.21.15.53:0/721448416 shutdown_connections 2024-08-31T06:28:23.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.722+0000 7f0140290640 1 -- 172.21.15.53:0/721448416 wait complete. 2024-08-31T06:28:23.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.723+0000 7f0140290640 1 Processor -- start 2024-08-31T06:28:23.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.723+0000 7f0140290640 1 -- start start 2024-08-31T06:28:23.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f0140290640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138102800 0x7f013819c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f0140290640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0138108140 0x7f013819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f0140290640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0138108a90 0x7f01381a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f0140290640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01381114c0 con 0x7f0138102800 2024-08-31T06:28:23.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f0140290640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0138111340 con 0x7f0138108140 2024-08-31T06:28:23.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f0140290640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0138111640 con 0x7f0138108a90 2024-08-31T06:28:23.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f013e02c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138102800 0x7f013819c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f013d82b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0138108140 0x7f013819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f013e02c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138102800 0x7f013819c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33570/0 (socket says 172.21.15.53:33570) 2024-08-31T06:28:23.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f013e82d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0138108a90 0x7f01381a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f013e02c640 1 -- 172.21.15.53:0/3298957655 learned_addr learned my addr 172.21.15.53:0/3298957655 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:23.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f013e82d640 1 -- 172.21.15.53:0/3298957655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0138108140 msgr2=0x7f013819c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:23.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f013e82d640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0138108140 0x7f013819c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f013e82d640 1 -- 172.21.15.53:0/3298957655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138102800 msgr2=0x7f013819c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:23.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f013e82d640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138102800 0x7f013819c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.724+0000 7f013e82d640 1 -- 172.21.15.53:0/3298957655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01381a2260 con 0x7f0138108a90 2024-08-31T06:28:23.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.725+0000 7f013e82d640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0138108a90 0x7f01381a1b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f013002abe0 tx=0x7f0130030c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:23.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.725+0000 7f013e02c640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138102800 0x7f013819c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:28:23.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.725+0000 7f012f7fe640 1 -- 172.21.15.53:0/3298957655 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130041020 con 0x7f0138108a90 2024-08-31T06:28:23.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.725+0000 7f012f7fe640 1 -- 172.21.15.53:0/3298957655 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0130037040 con 0x7f0138108a90 2024-08-31T06:28:23.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.726+0000 7f012f7fe640 1 -- 172.21.15.53:0/3298957655 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130036070 con 0x7f0138108a90 2024-08-31T06:28:23.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.726+0000 7f0140290640 1 -- 172.21.15.53:0/3298957655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01381a24f0 con 0x7f0138108a90 2024-08-31T06:28:23.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.726+0000 7f0140290640 1 -- 172.21.15.53:0/3298957655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01381a8cb0 con 0x7f0138108a90 2024-08-31T06:28:23.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.729+0000 7f012f7fe640 1 -- 172.21.15.53:0/3298957655 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0130044020 con 0x7f0138108a90 2024-08-31T06:28:23.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.730+0000 7f0146805740 1 Processor -- start 2024-08-31T06:28:23.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.730+0000 7f0146805740 1 -- start start 2024-08-31T06:28:23.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.730+0000 7f012f7fe640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4df0 0x7f01240b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.731+0000 7f012f7fe640 1 -- 172.21.15.53:0/3298957655 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f0130105fe0 con 0x7f0138108a90 2024-08-31T06:28:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.731+0000 7f013d82b640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4df0 0x7f01240b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.731+0000 7f0146805740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa2019d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.731+0000 7f0146805740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 0x55fa2019d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.731+0000 7f0146805740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa2019ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.731+0000 7f013e02c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa2019d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.731+0000 7f013e02c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa2019d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60692/0 (socket says 172.21.15.53:60692) 2024-08-31T06:28:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.731+0000 7f013e02c640 1 -- 172.21.15.53:0/514436314 learned_addr learned my addr 172.21.15.53:0/514436314 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.731+0000 7f013e82d640 1 --2- 172.21.15.53:0/514436314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa2019ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.732+0000 7f013d82b640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4df0 0x7f01240b7300 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0138105a90 tx=0x7f012800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:23.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.732+0000 7f013d82b640 1 --2- 172.21.15.53:0/514436314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 0x55fa2019d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.732+0000 7f0146805740 1 -- 172.21.15.53:0/514436314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa20114680 con 0x55fa1fdcf1b0 2024-08-31T06:28:23.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.732+0000 7f0146805740 1 -- 172.21.15.53:0/514436314 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fa20103c10 con 0x55fa1fdf8070 2024-08-31T06:28:23.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.732+0000 7f0146805740 1 -- 172.21.15.53:0/514436314 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fa20107bc0 con 0x55fa1fdd7390 2024-08-31T06:28:23.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.733+0000 7f013e02c640 1 -- 172.21.15.53:0/514436314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 msgr2=0x55fa2019ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.733+0000 7f013e02c640 1 --2- 172.21.15.53:0/514436314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa2019ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.733+0000 7f013e02c640 1 -- 172.21.15.53:0/514436314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 msgr2=0x55fa2019d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.733+0000 7f013e02c640 1 --2- 172.21.15.53:0/514436314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 0x55fa2019d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.733+0000 7f013e02c640 1 -- 172.21.15.53:0/514436314 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa1fe63650 con 0x55fa1fdf8070 2024-08-31T06:28:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.733+0000 7f013e82d640 1 --2- 172.21.15.53:0/514436314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa2019ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.733+0000 7f013e02c640 1 --2- 172.21.15.53:0/514436314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa2019d350 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0134009dc0 tx=0x7f01340117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb37de6614f83ee5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.733+0000 7f012cd9a640 1 -- 172.21.15.53:0/514436314 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134012650 con 0x55fa1fdf8070 2024-08-31T06:28:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.733+0000 7f012cd9a640 1 -- 172.21.15.53:0/514436314 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0134012c80 con 0x55fa1fdf8070 2024-08-31T06:28:23.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.733+0000 7f012cd9a640 1 -- 172.21.15.53:0/514436314 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013400fc70 con 0x55fa1fdf8070 2024-08-31T06:28:23.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.734+0000 7f0146805740 1 -- 172.21.15.53:0/514436314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 msgr2=0x55fa2019d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:23.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.734+0000 7f0146805740 1 --2- 172.21.15.53:0/514436314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa2019d350 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0134009dc0 tx=0x7f01340117b0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.735+0000 7f0146805740 1 -- 172.21.15.53:0/514436314 shutdown_connections 2024-08-31T06:28:23.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.735+0000 7f0146805740 1 --2- 172.21.15.53:0/514436314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa2019ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.735+0000 7f0146805740 1 --2- 172.21.15.53:0/514436314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 0x55fa2019d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.735+0000 7f0146805740 1 --2- 172.21.15.53:0/514436314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa2019d350 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.735+0000 7f0146805740 1 -- 172.21.15.53:0/514436314 >> 172.21.15.53:0/514436314 conn(0x55fa1fdec460 msgr2=0x55fa2019b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:23.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.735+0000 7f0146805740 1 -- 172.21.15.53:0/514436314 shutdown_connections 2024-08-31T06:28:23.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.735+0000 7f0146805740 1 -- 172.21.15.53:0/514436314 wait complete. 2024-08-31T06:28:23.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.735+0000 7f0146805740 1 -- start start 2024-08-31T06:28:23.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f0146805740 1 Processor -- start 2024-08-31T06:28:23.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f0146805740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 0x55fa201a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f0146805740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201a9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f0146805740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa201b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f0146805740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa1ff66700 con 0x55fa1fdcf1b0 2024-08-31T06:28:23.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f0146805740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fa2008a750 con 0x55fa1fdf8070 2024-08-31T06:28:23.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f0146805740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fa201abb30 con 0x55fa1fdd7390 2024-08-31T06:28:23.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f0146805740 10 client.0 _ll_register_callbacks cb 0x55fa200b9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:23.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f013e02c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 0x55fa201a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f013e02c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 0x55fa201a8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33594/0 (socket says 172.21.15.53:33594) 2024-08-31T06:28:23.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f013e02c640 1 -- 172.21.15.53:0/71274910 learned_addr learned my addr 172.21.15.53:0/71274910 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.736+0000 7f013e82d640 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa201b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.737+0000 7f013d82b640 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.737+0000 7f013e02c640 1 -- 172.21.15.53:0/71274910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 msgr2=0x55fa201a9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.737+0000 7f013e02c640 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201a9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.737+0000 7f013e02c640 1 -- 172.21.15.53:0/71274910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 msgr2=0x55fa201b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.737+0000 7f013e02c640 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa201b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.737+0000 7f013e02c640 1 -- 172.21.15.53:0/71274910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa200c3900 con 0x55fa1fdcf1b0 2024-08-31T06:28:23.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.737+0000 7f013e02c640 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 0x55fa201a8b50 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f0134004530 tx=0x7f0134004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313204cad0ec06b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.737+0000 7f0121ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.738+0000 7f0121ffb640 1 -- 172.21.15.53:0/71274910 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134028020 con 0x55fa1fdcf1b0 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.738+0000 7f0121ffb640 1 -- 172.21.15.53:0/71274910 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f013400fcc0 con 0x55fa1fdcf1b0 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.738+0000 7f0146805740 1 -- 172.21.15.53:0/71274910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0134012c80 con 0x55fa1fdcf1b0 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.738+0000 7f0121ffb640 1 -- 172.21.15.53:0/71274910 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f0134033050 con 0x55fa1fdcf1b0 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.738+0000 7f0146805740 10 client.22626 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.738+0000 7f0146805740 1 -- 172.21.15.53:0/71274910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x55fa201b7930 con 0x55fa1fdcf1b0 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.739+0000 7f0121ffb640 1 -- 172.21.15.53:0/71274910 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0134012c80 con 0x55fa1fdcf1b0 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.739+0000 7f0121ffb640 1 -- 172.21.15.53:0/71274910 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7f0134005260 con 0x55fa1fdcf1b0 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.739+0000 7f0146805740 10 client.22626 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.739+0000 7f0146805740 10 client.22626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:23.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.739+0000 7f0146805740 20 client.22626 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:23.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.739+0000 7f0146805740 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fa1fdb69f0 0x55fa201bacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.739+0000 7f0146805740 4 client.22626 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:23.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.739+0000 7f0146805740 1 -- 172.21.15.53:0/71274910 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa201165d0 con 0x55fa1fdb69f0 2024-08-31T06:28:23.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.740+0000 7f013d82b640 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fa1fdb69f0 0x55fa201bacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.741+0000 7f0121ffb640 10 client.22626 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.741+0000 7f013d82b640 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fa1fdb69f0 0x55fa201bacf0 crc :-1 s=READY pgs=548 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b195dd6305af57d server_cookie=c38873bfd8afcce9 in_seq=0 out_seq=0 2024-08-31T06:28:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.742+0000 7f0121ffb640 1 -- 172.21.15.53:0/71274910 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa201165d0 con 0x55fa1fdb69f0 2024-08-31T06:28:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.742+0000 7f0121ffb640 10 client.22626 handle_command_reply: tid=0 2024-08-31T06:28:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.742+0000 7f0146805740 1 client.22626 shutdown 2024-08-31T06:28:23.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.742+0000 7f0146805740 1 -- 172.21.15.53:0/71274910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 msgr2=0x55fa201a8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.742+0000 7f0146805740 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 0x55fa201a8b50 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f0134004530 tx=0x7f0134004560 comp rx=0 tx=0).stop 2024-08-31T06:28:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.743+0000 7f0146805740 1 -- 172.21.15.53:0/71274910 shutdown_connections 2024-08-31T06:28:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.743+0000 7f0146805740 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fa1fdb69f0 0x55fa201bacf0 crc :-1 s=READY pgs=548 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.743+0000 7f0146805740 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa201b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.743+0000 7f0146805740 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201a9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.743+0000 7f0146805740 1 --2- 172.21.15.53:0/71274910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdcf1b0 0x55fa201a8b50 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.743+0000 7f0146805740 1 -- 172.21.15.53:0/71274910 >> 172.21.15.53:0/71274910 conn(0x55fa1fdec460 msgr2=0x55fa201a0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.743+0000 7f0121ffb640 0 client.22626 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.743+0000 7f0146805740 1 -- 172.21.15.53:0/71274910 shutdown_connections 2024-08-31T06:28:23.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.743+0000 7f0146805740 1 -- 172.21.15.53:0/71274910 wait complete. 2024-08-31T06:28:23.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.743+0000 7f0146805740 20 client.22626 trim_cache size 0 max 16384 2024-08-31T06:28:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.769+0000 7f0146805740 1 Processor -- start 2024-08-31T06:28:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.770+0000 7f0146805740 1 -- start start 2024-08-31T06:28:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.771+0000 7f0146805740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.771+0000 7f0146805740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdf8070 0x55fa201b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f0146805740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fd8bda0 0x55fa201a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f013d82b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdf8070 0x55fa201b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f013d82b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdf8070 0x55fa201b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33598/0 (socket says 172.21.15.53:33598) 2024-08-31T06:28:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f013d82b640 1 -- 172.21.15.53:0/2086338158 learned_addr learned my addr 172.21.15.53:0/2086338158 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f0146805740 1 -- 172.21.15.53:0/2086338158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01381b1680 con 0x55fa1fdf8070 2024-08-31T06:28:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f0146805740 1 -- 172.21.15.53:0/2086338158 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01381b3280 con 0x55fa1fd8bda0 2024-08-31T06:28:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f0146805740 1 -- 172.21.15.53:0/2086338158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01381b1d50 con 0x55fa1fdd7390 2024-08-31T06:28:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f013e02c640 1 --2- 172.21.15.53:0/2086338158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f013e82d640 1 --2- 172.21.15.53:0/2086338158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fd8bda0 0x55fa201a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f013e02c640 1 -- 172.21.15.53:0/2086338158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fd8bda0 msgr2=0x55fa201a5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f013e02c640 1 --2- 172.21.15.53:0/2086338158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fd8bda0 0x55fa201a5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f013e02c640 1 -- 172.21.15.53:0/2086338158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdf8070 msgr2=0x55fa201b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f013e02c640 1 --2- 172.21.15.53:0/2086338158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdf8070 0x55fa201b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f013e02c640 1 -- 172.21.15.53:0/2086338158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa1fdb6c20 con 0x55fa1fdd7390 2024-08-31T06:28:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.772+0000 7f013d82b640 1 --2- 172.21.15.53:0/2086338158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdf8070 0x55fa201b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:28:23.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.773+0000 7f013e02c640 1 --2- 172.21.15.53:0/2086338158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201a0b60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0134014000 tx=0x7f0134004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eed275acbb35fde server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.773+0000 7f0123fff640 1 -- 172.21.15.53:0/2086338158 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134028070 con 0x55fa1fdd7390 2024-08-31T06:28:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.773+0000 7f0123fff640 1 -- 172.21.15.53:0/2086338158 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0134009c40 con 0x55fa1fdd7390 2024-08-31T06:28:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.773+0000 7f0123fff640 1 -- 172.21.15.53:0/2086338158 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01340126b0 con 0x55fa1fdd7390 2024-08-31T06:28:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.774+0000 7f0146805740 1 -- 172.21.15.53:0/2086338158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 msgr2=0x55fa201a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:23.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.775+0000 7f0146805740 1 --2- 172.21.15.53:0/2086338158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201a0b60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0134014000 tx=0x7f0134004250 comp rx=0 tx=0).stop 2024-08-31T06:28:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.775+0000 7f0146805740 1 -- 172.21.15.53:0/2086338158 shutdown_connections 2024-08-31T06:28:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.775+0000 7f0146805740 1 --2- 172.21.15.53:0/2086338158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fd8bda0 0x55fa201a5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.775+0000 7f0146805740 1 --2- 172.21.15.53:0/2086338158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fdf8070 0x55fa201b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.775+0000 7f0146805740 1 --2- 172.21.15.53:0/2086338158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201a0b60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.775+0000 7f0146805740 1 -- 172.21.15.53:0/2086338158 >> 172.21.15.53:0/2086338158 conn(0x55fa1fdec460 msgr2=0x55fa201a0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.775+0000 7f0146805740 1 -- 172.21.15.53:0/2086338158 shutdown_connections 2024-08-31T06:28:23.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.775+0000 7f0146805740 1 -- 172.21.15.53:0/2086338158 wait complete. 2024-08-31T06:28:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.776+0000 7f0146805740 1 -- start start 2024-08-31T06:28:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.776+0000 7f0146805740 1 Processor -- start 2024-08-31T06:28:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.776+0000 7f0146805740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fd8bda0 0x55fa201bbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.776+0000 7f0146805740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201bc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.776+0000 7f0146805740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa201bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.777+0000 7f0146805740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f01381b2bb0 con 0x55fa1fd8bda0 2024-08-31T06:28:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.777+0000 7f0146805740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01381b24e0 con 0x55fa1fdf8070 2024-08-31T06:28:23.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.777+0000 7f0146805740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01381af680 con 0x55fa1fdd7390 2024-08-31T06:28:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.777+0000 7f0146805740 10 client.0 _ll_register_callbacks cb 0x7f012800b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.777+0000 7f013e02c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fd8bda0 0x55fa201bbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.777+0000 7f013e02c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fd8bda0 0x55fa201bbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33614/0 (socket says 172.21.15.53:33614) 2024-08-31T06:28:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.777+0000 7f013e82d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa201bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.777+0000 7f013e02c640 1 -- 172.21.15.53:0/3804747464 learned_addr learned my addr 172.21.15.53:0/3804747464 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.778+0000 7f013d82b640 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201bc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.778+0000 7f013e02c640 1 -- 172.21.15.53:0/3804747464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 msgr2=0x55fa201bc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.778+0000 7f013e02c640 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201bc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.778+0000 7f013e02c640 1 -- 172.21.15.53:0/3804747464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 msgr2=0x55fa201bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.778+0000 7f013e02c640 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa201bc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.778+0000 7f013e02c640 1 -- 172.21.15.53:0/3804747464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa20224470 con 0x55fa1fd8bda0 2024-08-31T06:28:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.778+0000 7f013e02c640 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fd8bda0 0x55fa201bbce0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f0134005600 tx=0x7f0134009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8871315160e1fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.778+0000 7f0121ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.779+0000 7f0121ffb640 1 -- 172.21.15.53:0/3804747464 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134043020 con 0x55fa1fd8bda0 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.779+0000 7f0121ffb640 1 -- 172.21.15.53:0/3804747464 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f013400fac0 con 0x55fa1fd8bda0 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.779+0000 7f0146805740 1 -- 172.21.15.53:0/3804747464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0134009c40 con 0x55fa1fd8bda0 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.779+0000 7f0121ffb640 1 -- 172.21.15.53:0/3804747464 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f0134028040 con 0x55fa1fd8bda0 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.779+0000 7f0146805740 10 client.22629 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.779+0000 7f0146805740 1 -- 172.21.15.53:0/3804747464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x55fa202255d0 con 0x55fa1fd8bda0 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.780+0000 7f0121ffb640 1 -- 172.21.15.53:0/3804747464 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0134009c40 con 0x55fa1fd8bda0 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.780+0000 7f0121ffb640 1 -- 172.21.15.53:0/3804747464 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7f01340035f0 con 0x55fa1fd8bda0 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.780+0000 7f0146805740 10 client.22629 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.780+0000 7f0146805740 10 client.22629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.780+0000 7f0146805740 20 client.22629 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.780+0000 7f0146805740 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fa20225be0 0x55fa20228000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.780+0000 7f0146805740 4 client.22629 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:28:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.780+0000 7f0146805740 1 -- 172.21.15.53:0/3804747464 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa20112070 con 0x55fa20225be0 2024-08-31T06:28:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.781+0000 7f013d82b640 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fa20225be0 0x55fa20228000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.781+0000 7f0121ffb640 10 client.22629 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f013d82b640 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fa20225be0 0x55fa20228000 crc :-1 s=READY pgs=549 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1b47621d6a0a15d server_cookie=b1a893801e37e66c in_seq=0 out_seq=0 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f0121ffb640 1 -- 172.21.15.53:0/3804747464 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa20112070 con 0x55fa20225be0 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f0121ffb640 10 client.22629 handle_command_reply: tid=0 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f0146805740 1 client.22629 shutdown 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f0146805740 1 -- 172.21.15.53:0/3804747464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fd8bda0 msgr2=0x55fa201bbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f0146805740 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fd8bda0 0x55fa201bbce0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f0134005600 tx=0x7f0134009680 comp rx=0 tx=0).stop 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f0146805740 1 -- 172.21.15.53:0/3804747464 shutdown_connections 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f0146805740 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55fa20225be0 0x55fa20228000 crc :-1 s=READY pgs=549 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f0146805740 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fa1fdf8070 0x55fa201bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f0146805740 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa1fdd7390 0x55fa201bc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f0146805740 1 --2- 172.21.15.53:0/3804747464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa1fd8bda0 0x55fa201bbce0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.782+0000 7f0146805740 1 -- 172.21.15.53:0/3804747464 >> 172.21.15.53:0/3804747464 conn(0x55fa1fdec460 msgr2=0x55fa201a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.783+0000 7f0121ffb640 0 client.22629 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.783+0000 7f0146805740 1 -- 172.21.15.53:0/3804747464 shutdown_connections 2024-08-31T06:28:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.784+0000 7f0146805740 1 -- 172.21.15.53:0/3804747464 wait complete. 2024-08-31T06:28:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.784+0000 7f0146805740 20 client.22629 trim_cache size 0 max 16384 2024-08-31T06:28:23.786 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:28:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.785+0000 7f0140290640 1 -- 172.21.15.53:0/3298957655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4df0 msgr2=0x7f01240b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.785+0000 7f0140290640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4df0 0x7f01240b7300 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0138105a90 tx=0x7f012800b390 comp rx=0 tx=0).stop 2024-08-31T06:28:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.785+0000 7f0140290640 1 -- 172.21.15.53:0/3298957655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0138108a90 msgr2=0x7f01381a1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.785+0000 7f0140290640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0138108a90 0x7f01381a1b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f013002abe0 tx=0x7f0130030c50 comp rx=0 tx=0).stop 2024-08-31T06:28:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.785+0000 7f0140290640 1 -- 172.21.15.53:0/3298957655 shutdown_connections 2024-08-31T06:28:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.785+0000 7f0140290640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f01240b4df0 0x7f01240b7300 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.785+0000 7f0140290640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0138108a90 0x7f01381a1b30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.785+0000 7f0140290640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0138108140 0x7f013819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.785+0000 7f0140290640 1 --2- 172.21.15.53:0/3298957655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138102800 0x7f013819c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.785+0000 7f0140290640 1 -- 172.21.15.53:0/3298957655 >> 172.21.15.53:0/3298957655 conn(0x7f01380794d0 msgr2=0x7f0138104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.786+0000 7f0140290640 1 -- 172.21.15.53:0/3298957655 shutdown_connections 2024-08-31T06:28:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:23.786+0000 7f0140290640 1 -- 172.21.15.53:0/3298957655 wait complete. 2024-08-31T06:28:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:23 smithi130 ceph-mon[22266]: pgmap v1062: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 286 op/s 2024-08-31T06:28:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:23 smithi153 ceph-mon[22320]: pgmap v1062: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 286 op/s 2024-08-31T06:28:24.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:23 smithi053 ceph-mon[18924]: pgmap v1062: 97 pgs: 97 active+clean; 961 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 286 op/s 2024-08-31T06:28:24.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 62488 5.29 MB/sec execute 492 sec latency 353.197 ms 2024-08-31T06:28:25.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 62617 5.29 MB/sec execute 493 sec latency 143.206 ms 2024-08-31T06:28:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:25 smithi130 ceph-mon[22266]: pgmap v1063: 97 pgs: 97 active+clean; 968 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 310 op/s 2024-08-31T06:28:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:25 smithi153 ceph-mon[22320]: pgmap v1063: 97 pgs: 97 active+clean; 968 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 310 op/s 2024-08-31T06:28:26.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:25 smithi053 ceph-mon[18924]: pgmap v1063: 97 pgs: 97 active+clean; 968 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 310 op/s 2024-08-31T06:28:26.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 62759 5.30 MB/sec execute 494 sec latency 174.521 ms 2024-08-31T06:28:27.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 62890 5.30 MB/sec execute 495 sec latency 90.291 ms 2024-08-31T06:28:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:27 smithi130 ceph-mon[22266]: pgmap v1064: 97 pgs: 97 active+clean; 975 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 346 op/s 2024-08-31T06:28:28.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:27 smithi153 ceph-mon[22320]: pgmap v1064: 97 pgs: 97 active+clean; 975 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 346 op/s 2024-08-31T06:28:28.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:27 smithi053 ceph-mon[18924]: pgmap v1064: 97 pgs: 97 active+clean; 975 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 346 op/s 2024-08-31T06:28:28.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 63053 5.31 MB/sec execute 496 sec latency 69.338 ms 2024-08-31T06:28:28.496 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:28:28.496 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:28:28.866 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:28:29.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 63214 5.32 MB/sec execute 497 sec latency 140.660 ms 2024-08-31T06:28:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.454+0000 7f51f4bd9640 1 -- 172.21.15.53:0/466027867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108a90 msgr2=0x7f51f010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.454+0000 7f51f4bd9640 1 --2- 172.21.15.53:0/466027867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108a90 0x7f51f010f2c0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009ca0 tx=0x7f51e802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.455+0000 7f51f4bd9640 1 -- 172.21.15.53:0/466027867 shutdown_connections 2024-08-31T06:28:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.455+0000 7f51f4bd9640 1 --2- 172.21.15.53:0/466027867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108a90 0x7f51f010f2c0 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.455+0000 7f51f4bd9640 1 --2- 172.21.15.53:0/466027867 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 0x7f51f0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.455+0000 7f51f4bd9640 1 --2- 172.21.15.53:0/466027867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0102800 0x7f51f0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.455+0000 7f51f4bd9640 1 -- 172.21.15.53:0/466027867 >> 172.21.15.53:0/466027867 conn(0x7f51f00794d0 msgr2=0x7f51f00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.455+0000 7f51f4bd9640 1 -- 172.21.15.53:0/466027867 shutdown_connections 2024-08-31T06:28:29.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.455+0000 7f51f4bd9640 1 -- 172.21.15.53:0/466027867 wait complete. 2024-08-31T06:28:29.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51f4bd9640 1 Processor -- start 2024-08-31T06:28:29.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51f4bd9640 1 -- start start 2024-08-31T06:28:29.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51f4bd9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0102800 0x7f51f010fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51f4bd9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 0x7f51f0110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51f4bd9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108a90 0x7f51f01107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51f4bd9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0113700 con 0x7f51f0108a90 2024-08-31T06:28:29.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51f4bd9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0113580 con 0x7f51f0108140 2024-08-31T06:28:29.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51f4bd9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0113880 con 0x7f51f0102800 2024-08-31T06:28:29.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51eed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108a90 0x7f51f01107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51ee59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0102800 0x7f51f010fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51eed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108a90 0x7f51f01107d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33624/0 (socket says 172.21.15.53:33624) 2024-08-31T06:28:29.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51eed9d640 1 -- 172.21.15.53:0/3706360472 learned_addr learned my addr 172.21.15.53:0/3706360472 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:29.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.456+0000 7f51edd9b640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 0x7f51f0110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.457+0000 7f51edd9b640 1 -- 172.21.15.53:0/3706360472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0102800 msgr2=0x7f51f010fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:29.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.457+0000 7f51edd9b640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0102800 0x7f51f010fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.457+0000 7f51edd9b640 1 -- 172.21.15.53:0/3706360472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108a90 msgr2=0x7f51f01107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:29.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.457+0000 7f51edd9b640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108a90 0x7f51f01107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.457+0000 7f51edd9b640 1 -- 172.21.15.53:0/3706360472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f01a8370 con 0x7f51f0108140 2024-08-31T06:28:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.457+0000 7f51eed9d640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108a90 0x7f51f01107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.457+0000 7f51edd9b640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 0x7f51f0110290 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f51e400e9c0 tx=0x7f51e400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.457+0000 7f51df7fe640 1 -- 172.21.15.53:0/3706360472 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e400ccc0 con 0x7f51f0108140 2024-08-31T06:28:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.457+0000 7f51df7fe640 1 -- 172.21.15.53:0/3706360472 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51e40108c0 con 0x7f51f0108140 2024-08-31T06:28:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.458+0000 7f51f4bd9640 1 -- 172.21.15.53:0/3706360472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f01a8660 con 0x7f51f0108140 2024-08-31T06:28:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.458+0000 7f51df7fe640 1 -- 172.21.15.53:0/3706360472 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4018750 con 0x7f51f0108140 2024-08-31T06:28:29.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.458+0000 7f51f4bd9640 1 -- 172.21.15.53:0/3706360472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f01a8ba0 con 0x7f51f0108140 2024-08-31T06:28:29.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.461+0000 7f51fb14e740 1 Processor -- start 2024-08-31T06:28:29.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.461+0000 7f51df7fe640 1 -- 172.21.15.53:0/3706360472 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f51e4010430 con 0x7f51f0108140 2024-08-31T06:28:29.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.461+0000 7f51fb14e740 1 -- start start 2024-08-31T06:28:29.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a78350 0x564570e1e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a4f490 0x564570e1ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 0x564570e1f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51fb14e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564570d945f0 con 0x564570a4f490 2024-08-31T06:28:29.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51fb14e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564570d83b80 con 0x564570a57670 2024-08-31T06:28:29.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51fb14e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564570d87b30 con 0x564570a78350 2024-08-31T06:28:29.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51eed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a78350 0x564570e1e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51edd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 0x564570e1f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51eed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a78350 0x564570e1e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:54420/0 (socket says 172.21.15.53:54420) 2024-08-31T06:28:29.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51eed9d640 1 -- 172.21.15.53:0/779922670 learned_addr learned my addr 172.21.15.53:0/779922670 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:29.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51ee59c640 1 --2- 172.21.15.53:0/779922670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a4f490 0x564570e1ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51eed9d640 1 -- 172.21.15.53:0/779922670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 msgr2=0x564570e1f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:29.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51eed9d640 1 --2- 172.21.15.53:0/779922670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 0x564570e1f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.462+0000 7f51eed9d640 1 -- 172.21.15.53:0/779922670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a4f490 msgr2=0x564570e1ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:29.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.463+0000 7f51eed9d640 1 --2- 172.21.15.53:0/779922670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a4f490 0x564570e1ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.463+0000 7f51df7fe640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4ca0 0x7f51d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.463+0000 7f51eed9d640 1 -- 172.21.15.53:0/779922670 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564570ae3930 con 0x564570a78350 2024-08-31T06:28:29.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.463+0000 7f51ee59c640 1 --2- 172.21.15.53:0/779922670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a4f490 0x564570e1ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:29.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.463+0000 7f51df7fe640 1 -- 172.21.15.53:0/3706360472 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f51e40e58c0 con 0x7f51f0108140 2024-08-31T06:28:29.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.463+0000 7f51eed9d640 1 --2- 172.21.15.53:0/779922670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a78350 0x564570e1e780 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009dc0 tx=0x7f51e80098a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d42e1ab36d00fc85 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:29.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.463+0000 7f51edd9b640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4ca0 0x7f51d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.463+0000 7f51dcff9640 1 -- 172.21.15.53:0/779922670 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8031c00 con 0x564570a78350 2024-08-31T06:28:29.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.463+0000 7f51dcff9640 1 -- 172.21.15.53:0/779922670 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51e8036030 con 0x564570a78350 2024-08-31T06:28:29.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.464+0000 7f51dcff9640 1 -- 172.21.15.53:0/779922670 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e80046b0 con 0x564570a78350 2024-08-31T06:28:29.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.464+0000 7f51fb14e740 1 -- 172.21.15.53:0/779922670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a78350 msgr2=0x564570e1e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.464+0000 7f51edd9b640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4ca0 0x7f51d80b71b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f51e4000c00 tx=0x7f51e40eb530 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.464+0000 7f51fb14e740 1 --2- 172.21.15.53:0/779922670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a78350 0x564570e1e780 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009dc0 tx=0x7f51e80098a0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.464+0000 7f51fb14e740 1 -- 172.21.15.53:0/779922670 shutdown_connections 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.464+0000 7f51fb14e740 1 --2- 172.21.15.53:0/779922670 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 0x564570e1f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.464+0000 7f51fb14e740 1 --2- 172.21.15.53:0/779922670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a4f490 0x564570e1ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.464+0000 7f51fb14e740 1 --2- 172.21.15.53:0/779922670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a78350 0x564570e1e780 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.464+0000 7f51fb14e740 1 -- 172.21.15.53:0/779922670 >> 172.21.15.53:0/779922670 conn(0x564570a6c740 msgr2=0x564570e1c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.465+0000 7f51fb14e740 1 -- 172.21.15.53:0/779922670 shutdown_connections 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.465+0000 7f51fb14e740 1 -- 172.21.15.53:0/779922670 wait complete. 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.465+0000 7f51fb14e740 1 -- start start 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.465+0000 7f51fb14e740 1 Processor -- start 2024-08-31T06:28:29.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.465+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a4f490 0x564570e29ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.465+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 0x564570e2a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.465+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a78350 0x564570e360c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.465+0000 7f51fb14e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564570be6890 con 0x564570a78350 2024-08-31T06:28:29.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.465+0000 7f51fb14e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564570d0a790 con 0x564570a57670 2024-08-31T06:28:29.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.465+0000 7f51fb14e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564570e2cdd0 con 0x564570a4f490 2024-08-31T06:28:29.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.465+0000 7f51fb14e740 10 client.0 _ll_register_callbacks cb 0x564570a8fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:29.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51ee59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 0x564570e2a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51eed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a78350 0x564570e360c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51ee59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 0x564570e2a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60768/0 (socket says 172.21.15.53:60768) 2024-08-31T06:28:29.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51ee59c640 1 -- 172.21.15.53:0/1758635869 learned_addr learned my addr 172.21.15.53:0/1758635869 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51eed9d640 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a4f490 0x564570e29ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51ee59c640 1 -- 172.21.15.53:0/1758635869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a4f490 msgr2=0x564570e29ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51ee59c640 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a4f490 0x564570e29ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51ee59c640 1 -- 172.21.15.53:0/1758635869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a78350 msgr2=0x564570e360c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51ee59c640 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a78350 0x564570e360c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51ee59c640 1 -- 172.21.15.53:0/1758635869 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564570d41f30 con 0x564570a57670 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51eed9d640 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a78350 0x564570e360c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51ee59c640 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 0x564570e2a430 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f51e00058c0 tx=0x7f51e0012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70408217f5399e53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.466+0000 7f51d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.467+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1758635869 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e0004230 con 0x564570a57670 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.467+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1758635869 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f51e00043d0 con 0x564570a57670 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.467+0000 7f51fb14e740 1 -- 172.21.15.53:0/1758635869 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e8036030 con 0x564570a57670 2024-08-31T06:28:29.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.467+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1758635869 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f51e000f920 con 0x564570a57670 2024-08-31T06:28:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.467+0000 7f51fb14e740 10 client.31289 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.467+0000 7f51fb14e740 1 -- 172.21.15.53:0/1758635869 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x564570e38c30 con 0x564570a57670 2024-08-31T06:28:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.467+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1758635869 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51e00035f0 con 0x564570a57670 2024-08-31T06:28:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.468+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1758635869 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7f51e002d430 con 0x564570a57670 2024-08-31T06:28:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.468+0000 7f51fb14e740 10 client.31289 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.468+0000 7f51fb14e740 10 client.31289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.468+0000 7f51fb14e740 20 client.31289 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.468+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564570a36cd0 0x564570e3c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.468+0000 7f51fb14e740 4 client.31289 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.468+0000 7f51fb14e740 1 -- 172.21.15.53:0/1758635869 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f51e8036030 con 0x564570a36cd0 2024-08-31T06:28:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.468+0000 7f51eed9d640 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564570a36cd0 0x564570e3c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.469+0000 7f51eed9d640 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564570a36cd0 0x564570e3c080 crc :-1 s=READY pgs=550 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=673c759a47a97ea7 server_cookie=549b186fd257bdc2 in_seq=0 out_seq=0 2024-08-31T06:28:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.469+0000 7f51d5ffb640 10 client.31289 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1758635869 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f51e8036030 con 0x564570a36cd0 2024-08-31T06:28:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51d5ffb640 10 client.31289 handle_command_reply: tid=0 2024-08-31T06:28:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51fb14e740 1 client.31289 shutdown 2024-08-31T06:28:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51fb14e740 1 -- 172.21.15.53:0/1758635869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 msgr2=0x564570e2a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 0x564570e2a430 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f51e00058c0 tx=0x7f51e0012b60 comp rx=0 tx=0).stop 2024-08-31T06:28:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51fb14e740 1 -- 172.21.15.53:0/1758635869 shutdown_connections 2024-08-31T06:28:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564570a36cd0 0x564570e3c080 crc :-1 s=READY pgs=550 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51d5ffb640 0 client.31289 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a78350 0x564570e360c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a57670 0x564570e2a430 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1758635869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a4f490 0x564570e29ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.470+0000 7f51fb14e740 1 -- 172.21.15.53:0/1758635869 >> 172.21.15.53:0/1758635869 conn(0x564570a6c740 msgr2=0x564570e21910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.471+0000 7f51fb14e740 1 -- 172.21.15.53:0/1758635869 shutdown_connections 2024-08-31T06:28:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.471+0000 7f51fb14e740 1 -- 172.21.15.53:0/1758635869 wait complete. 2024-08-31T06:28:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.471+0000 7f51fb14e740 20 client.31289 trim_cache size 0 max 16384 2024-08-31T06:28:29.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.499+0000 7f51fb14e740 1 Processor -- start 2024-08-31T06:28:29.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.499+0000 7f51fb14e740 1 -- start start 2024-08-31T06:28:29.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.499+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a36cd0 0x564570e2a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.499+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a4f490 0x564570e21f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.499+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a57670 0x564570e35fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.499+0000 7f51fb14e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01ad260 con 0x564570a57670 2024-08-31T06:28:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.499+0000 7f51fb14e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01aee60 con 0x564570a4f490 2024-08-31T06:28:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.499+0000 7f51fb14e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01ad930 con 0x564570a36cd0 2024-08-31T06:28:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.499+0000 7f51eed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a57670 0x564570e35fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.499+0000 7f51eed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a57670 0x564570e35fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33656/0 (socket says 172.21.15.53:33656) 2024-08-31T06:28:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.499+0000 7f51eed9d640 1 -- 172.21.15.53:0/1021225228 learned_addr learned my addr 172.21.15.53:0/1021225228 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.500+0000 7f51eed9d640 1 -- 172.21.15.53:0/1021225228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a36cd0 msgr2=0x564570e2a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.500+0000 7f51eed9d640 1 --2- 172.21.15.53:0/1021225228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a36cd0 0x564570e2a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.500+0000 7f51eed9d640 1 -- 172.21.15.53:0/1021225228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a4f490 msgr2=0x564570e21f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.500+0000 7f51eed9d640 1 --2- 172.21.15.53:0/1021225228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a4f490 0x564570e21f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.500+0000 7f51eed9d640 1 -- 172.21.15.53:0/1021225228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564570e1cf60 con 0x564570a57670 2024-08-31T06:28:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.500+0000 7f51eed9d640 1 --2- 172.21.15.53:0/1021225228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a57670 0x564570e35fc0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f51e8031870 tx=0x7f51e8031800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a8e84159b01730 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.500+0000 7f51d7fff640 1 -- 172.21.15.53:0/1021225228 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8004760 con 0x564570a57670 2024-08-31T06:28:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.500+0000 7f51d7fff640 1 -- 172.21.15.53:0/1021225228 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51e8036040 con 0x564570a57670 2024-08-31T06:28:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.500+0000 7f51d7fff640 1 -- 172.21.15.53:0/1021225228 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e80305c0 con 0x564570a57670 2024-08-31T06:28:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.501+0000 7f51fb14e740 1 -- 172.21.15.53:0/1021225228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a57670 msgr2=0x564570e35fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.501+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1021225228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a57670 0x564570e35fc0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f51e8031870 tx=0x7f51e8031800 comp rx=0 tx=0).stop 2024-08-31T06:28:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.501+0000 7f51fb14e740 1 -- 172.21.15.53:0/1021225228 shutdown_connections 2024-08-31T06:28:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.501+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1021225228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a57670 0x564570e35fc0 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.501+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1021225228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a4f490 0x564570e21f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.501+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1021225228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a36cd0 0x564570e2a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.501+0000 7f51fb14e740 1 -- 172.21.15.53:0/1021225228 >> 172.21.15.53:0/1021225228 conn(0x564570a6c740 msgr2=0x564570e21880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:29.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.501+0000 7f51fb14e740 1 -- 172.21.15.53:0/1021225228 shutdown_connections 2024-08-31T06:28:29.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.502+0000 7f51fb14e740 1 -- 172.21.15.53:0/1021225228 wait complete. 2024-08-31T06:28:29.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.502+0000 7f51fb14e740 1 -- start start 2024-08-31T06:28:29.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.502+0000 7f51fb14e740 1 Processor -- start 2024-08-31T06:28:29.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.502+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a36cd0 0x564570e32800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.502+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a4f490 0x564570e2ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.502+0000 7f51fb14e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a57670 0x564570e2f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.502+0000 7f51fb14e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01ae790 con 0x564570a4f490 2024-08-31T06:28:29.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.502+0000 7f51fb14e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01ae0c0 con 0x564570a36cd0 2024-08-31T06:28:29.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.502+0000 7f51fb14e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51f01ab280 con 0x564570a57670 2024-08-31T06:28:29.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51fb14e740 10 client.0 _ll_register_callbacks cb 0x7f51e0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:29.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51eed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a36cd0 0x564570e32800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51eed9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a36cd0 0x564570e32800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60786/0 (socket says 172.21.15.53:60786) 2024-08-31T06:28:29.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51eed9d640 1 -- 172.21.15.53:0/1987336400 learned_addr learned my addr 172.21.15.53:0/1987336400 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51ee59c640 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a4f490 0x564570e2ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51eed9d640 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a57670 0x564570e2f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51eed9d640 1 -- 172.21.15.53:0/1987336400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a57670 msgr2=0x564570e2f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51eed9d640 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a57670 0x564570e2f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51eed9d640 1 -- 172.21.15.53:0/1987336400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a4f490 msgr2=0x564570e2ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51eed9d640 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a4f490 0x564570e2ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51eed9d640 1 -- 172.21.15.53:0/1987336400 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564570e2f9e0 con 0x564570a36cd0 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51eed9d640 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a36cd0 0x564570e32800 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f51e8000f80 tx=0x7f51e8005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7a03f039494d1a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.503+0000 7f51d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.504+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1987336400 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e806b060 con 0x564570a36cd0 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.504+0000 7f51fb14e740 1 -- 172.21.15.53:0/1987336400 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564570e1cbd0 con 0x564570a36cd0 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.504+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1987336400 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f51e8003d80 con 0x564570a36cd0 2024-08-31T06:28:29.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.504+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1987336400 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f51e8003f80 con 0x564570a36cd0 2024-08-31T06:28:29.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.504+0000 7f51fb14e740 10 client.31292 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:29.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.504+0000 7f51fb14e740 1 -- 172.21.15.53:0/1987336400 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x564570ea7980 con 0x564570a36cd0 2024-08-31T06:28:29.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.504+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1987336400 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564570e1cbd0 con 0x564570a36cd0 2024-08-31T06:28:29.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.505+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1987336400 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7f51e8043070 con 0x564570a36cd0 2024-08-31T06:28:29.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.505+0000 7f51fb14e740 10 client.31292 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:29.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.505+0000 7f51fb14e740 10 client.31292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:29.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.505+0000 7f51fb14e740 20 client.31292 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:29.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.505+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564570a78350 0x564570ea9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:29.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.505+0000 7f51fb14e740 4 client.31292 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:28:29.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.505+0000 7f51fb14e740 1 -- 172.21.15.53:0/1987336400 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564570d96540 con 0x564570a78350 2024-08-31T06:28:29.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.505+0000 7f51ee59c640 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564570a78350 0x564570ea9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:29.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.506+0000 7f51ee59c640 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564570a78350 0x564570ea9cd0 crc :-1 s=READY pgs=551 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c63550c293c6a4c server_cookie=a5500aefbebe6e7d in_seq=0 out_seq=0 2024-08-31T06:28:29.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.506+0000 7f51d5ffb640 10 client.31292 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:29.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.507+0000 7f51d5ffb640 1 -- 172.21.15.53:0/1987336400 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564570d96540 con 0x564570a78350 2024-08-31T06:28:29.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.507+0000 7f51d5ffb640 10 client.31292 handle_command_reply: tid=0 2024-08-31T06:28:29.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.507+0000 7f51fb14e740 1 client.31292 shutdown 2024-08-31T06:28:29.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.507+0000 7f51fb14e740 1 -- 172.21.15.53:0/1987336400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a36cd0 msgr2=0x564570e32800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:29.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.507+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a36cd0 0x564570e32800 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f51e8000f80 tx=0x7f51e8005fd0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.507+0000 7f51fb14e740 1 -- 172.21.15.53:0/1987336400 shutdown_connections 2024-08-31T06:28:29.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.507+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564570a78350 0x564570ea9cd0 crc :-1 s=READY pgs=551 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.507+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564570a57670 0x564570e2f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.507+0000 7f51d5ffb640 0 client.31292 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:29.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.508+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564570a4f490 0x564570e2ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.508+0000 7f51fb14e740 1 --2- 172.21.15.53:0/1987336400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564570a36cd0 0x564570e32800 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.508+0000 7f51fb14e740 1 -- 172.21.15.53:0/1987336400 >> 172.21.15.53:0/1987336400 conn(0x564570a6c740 msgr2=0x564570e1f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:29.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.508+0000 7f51fb14e740 1 -- 172.21.15.53:0/1987336400 shutdown_connections 2024-08-31T06:28:29.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.508+0000 7f51fb14e740 1 -- 172.21.15.53:0/1987336400 wait complete. 2024-08-31T06:28:29.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.508+0000 7f51fb14e740 20 client.31292 trim_cache size 0 max 16384 2024-08-31T06:28:29.512 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:28:29.512 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:28:29.513 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "e839581e-94c5-4714-a1a6-40730925f6b8", 2024-08-31T06:28:29.513 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:28:29.513 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:28:29.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.509+0000 7f51f4bd9640 1 -- 172.21.15.53:0/3706360472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4ca0 msgr2=0x7f51d80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:29.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.509+0000 7f51f4bd9640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4ca0 0x7f51d80b71b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f51e4000c00 tx=0x7f51e40eb530 comp rx=0 tx=0).stop 2024-08-31T06:28:29.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.509+0000 7f51f4bd9640 1 -- 172.21.15.53:0/3706360472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 msgr2=0x7f51f0110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:29.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.509+0000 7f51f4bd9640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 0x7f51f0110290 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f51e400e9c0 tx=0x7f51e400ee80 comp rx=0 tx=0).stop 2024-08-31T06:28:29.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.509+0000 7f51f4bd9640 1 -- 172.21.15.53:0/3706360472 shutdown_connections 2024-08-31T06:28:29.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.509+0000 7f51f4bd9640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f51d80b4ca0 0x7f51d80b71b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.509+0000 7f51f4bd9640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0108a90 0x7f51f01107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.509+0000 7f51f4bd9640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51f0108140 0x7f51f0110290 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.509+0000 7f51f4bd9640 1 --2- 172.21.15.53:0/3706360472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f0102800 0x7f51f010fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:29.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.509+0000 7f51f4bd9640 1 -- 172.21.15.53:0/3706360472 >> 172.21.15.53:0/3706360472 conn(0x7f51f00794d0 msgr2=0x7f51f0104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:29.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.510+0000 7f51f4bd9640 1 -- 172.21.15.53:0/3706360472 shutdown_connections 2024-08-31T06:28:29.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:29.510+0000 7f51f4bd9640 1 -- 172.21.15.53:0/3706360472 wait complete. 2024-08-31T06:28:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:29 smithi130 ceph-mon[22266]: pgmap v1065: 97 pgs: 97 active+clean; 978 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 348 op/s 2024-08-31T06:28:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:29 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:28:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:29 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:29 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:28:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:29 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:28:30.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:29 smithi153 ceph-mon[22320]: pgmap v1065: 97 pgs: 97 active+clean; 978 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 348 op/s 2024-08-31T06:28:30.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:29 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:28:30.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:29 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:30.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:29 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:28:30.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:29 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:28:30.199 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:29 smithi053 ceph-mon[18924]: pgmap v1065: 97 pgs: 97 active+clean; 978 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 348 op/s 2024-08-31T06:28:30.199 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:29 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:28:30.199 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:29 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:30.199 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:29 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:28:30.199 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:29 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:28:30.235 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:28:30.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 63312 5.31 MB/sec execute 498 sec latency 540.910 ms 2024-08-31T06:28:30.600 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:28:31.037 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:30 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:28:31.037 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:30 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:28:31.037 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:30 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:28:31.037 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:30 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.037 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:30 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.037 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:30 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.037 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:30 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.037 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:30 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:30 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:28:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:30 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:28:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:30 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:28:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:30 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:30 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:30 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:30 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:30 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.166+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2130274710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5d8109bd0 msgr2=0x7fc5d8110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.166+0000 7fc5de4a0640 1 --2- 172.21.15.53:0/2130274710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5d8109bd0 0x7fc5d8110400 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009ca0 tx=0x7fc5d002a8b0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.166+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2130274710 shutdown_connections 2024-08-31T06:28:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.166+0000 7fc5de4a0640 1 --2- 172.21.15.53:0/2130274710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5d8109bd0 0x7fc5d8110400 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.166+0000 7fc5de4a0640 1 --2- 172.21.15.53:0/2130274710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d8109280 0x7fc5d8109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.166+0000 7fc5de4a0640 1 --2- 172.21.15.53:0/2130274710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5d8103940 0x7fc5d8103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.166+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2130274710 >> 172.21.15.53:0/2130274710 conn(0x7fc5d80ff3d0 msgr2=0x7fc5d8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:31.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.166+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2130274710 shutdown_connections 2024-08-31T06:28:31.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.167+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2130274710 wait complete. 2024-08-31T06:28:31.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.167+0000 7fc5de4a0640 1 Processor -- start 2024-08-31T06:28:31.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.167+0000 7fc5de4a0640 1 -- start start 2024-08-31T06:28:31.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5de4a0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5d8103940 0x7fc5d819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5de4a0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d8109280 0x7fc5d819c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5de4a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5d8109bd0 0x7fc5d81a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5de4a0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d8113740 con 0x7fc5d8109bd0 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5de4a0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81135c0 con 0x7fc5d8103940 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5de4a0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81138c0 con 0x7fc5d8109280 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5d7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5d8103940 0x7fc5d819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d8109280 0x7fc5d819c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5d7fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5d8103940 0x7fc5d819c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60802/0 (socket says 172.21.15.53:60802) 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d8109280 0x7fc5d819c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:54470/0 (socket says 172.21.15.53:54470) 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5d7fff640 1 -- 172.21.15.53:0/2270808812 learned_addr learned my addr 172.21.15.53:0/2270808812 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.168+0000 7fc5dca3d640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5d8109bd0 0x7fc5d81a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.169+0000 7fc5d7fff640 1 -- 172.21.15.53:0/2270808812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d8109280 msgr2=0x7fc5d819c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.169+0000 7fc5d7fff640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d8109280 0x7fc5d819c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.169+0000 7fc5d7fff640 1 -- 172.21.15.53:0/2270808812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5d8109bd0 msgr2=0x7fc5d81a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:31.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.169+0000 7fc5d7fff640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5d8109bd0 0x7fc5d81a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.169+0000 7fc5d7fff640 1 -- 172.21.15.53:0/2270808812 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d81a2320 con 0x7fc5d8103940 2024-08-31T06:28:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.169+0000 7fc5d7fff640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5d8103940 0x7fc5d819c3b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800e9f0 tx=0x7fc5c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.169+0000 7fc5d57fa640 1 -- 172.21.15.53:0/2270808812 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800cd80 con 0x7fc5d8103940 2024-08-31T06:28:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.169+0000 7fc5d57fa640 1 -- 172.21.15.53:0/2270808812 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5c80108c0 con 0x7fc5d8103940 2024-08-31T06:28:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.169+0000 7fc5d57fa640 1 -- 172.21.15.53:0/2270808812 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80187c0 con 0x7fc5d8103940 2024-08-31T06:28:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.169+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2270808812 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d81a2610 con 0x7fc5d8103940 2024-08-31T06:28:31.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.169+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2270808812 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d81a8d70 con 0x7fc5d8103940 2024-08-31T06:28:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5e4a15740 1 Processor -- start 2024-08-31T06:28:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5d57fa640 1 -- 172.21.15.53:0/2270808812 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc5c8010430 con 0x7fc5d8103940 2024-08-31T06:28:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5e4a15740 1 -- start start 2024-08-31T06:28:31.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:30 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:28:31.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:30 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:28:31.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:30 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:28:31.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:30 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:30 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:30 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:30 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:30 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:28:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c51e070 0x559e6c8c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4f51b0 0x559e6c8c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4fd390 0x559e6c8c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5e4a15740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559e6c83a630 con 0x559e6c4fd390 2024-08-31T06:28:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5e4a15740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559e6c829bc0 con 0x559e6c51e070 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5e4a15740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559e6c82db70 con 0x559e6c4f51b0 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5dca3d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c51e070 0x559e6c8c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4fd390 0x559e6c8c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4fd390 0x559e6c8c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33700/0 (socket says 172.21.15.53:33700) 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5dca3d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c51e070 0x559e6c8c32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60816/0 (socket says 172.21.15.53:60816) 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5d77fe640 1 -- 172.21.15.53:0/2486294426 learned_addr learned my addr 172.21.15.53:0/2486294426 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.173+0000 7fc5d7fff640 1 --2- 172.21.15.53:0/2486294426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4f51b0 0x559e6c8c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.174+0000 7fc5dca3d640 1 -- 172.21.15.53:0/2486294426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4f51b0 msgr2=0x559e6c8c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.174+0000 7fc5dca3d640 1 --2- 172.21.15.53:0/2486294426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4f51b0 0x559e6c8c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.174+0000 7fc5dca3d640 1 -- 172.21.15.53:0/2486294426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4fd390 msgr2=0x559e6c8c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.174+0000 7fc5dca3d640 1 --2- 172.21.15.53:0/2486294426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4fd390 0x559e6c8c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.174+0000 7fc5dca3d640 1 -- 172.21.15.53:0/2486294426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e6c589650 con 0x559e6c51e070 2024-08-31T06:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.174+0000 7fc5d77fe640 1 --2- 172.21.15.53:0/2486294426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4fd390 0x559e6c8c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.174+0000 7fc5d57fa640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5c00b4d50 0x7fc5c00b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.174+0000 7fc5dca3d640 1 --2- 172.21.15.53:0/2486294426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c51e070 0x559e6c8c32c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0006010 tx=0x7fc5d0009900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b7554a47a3c0976 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.175+0000 7fc5d7fff640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5c00b4d50 0x7fc5c00b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.175+0000 7fc5d57fa640 1 -- 172.21.15.53:0/2270808812 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7fc5c80e5980 con 0x7fc5d8103940 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.175+0000 7fc5be7fc640 1 -- 172.21.15.53:0/2486294426 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d00305a0 con 0x559e6c51e070 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.175+0000 7fc5be7fc640 1 -- 172.21.15.53:0/2486294426 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5d0036040 con 0x559e6c51e070 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.175+0000 7fc5be7fc640 1 -- 172.21.15.53:0/2486294426 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d00042a0 con 0x559e6c51e070 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.176+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2486294426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c51e070 msgr2=0x559e6c8c32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.176+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/2486294426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c51e070 0x559e6c8c32c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0006010 tx=0x7fc5d0009900 comp rx=0 tx=0).stop 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.176+0000 7fc5d7fff640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5c00b4d50 0x7fc5c00b7260 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x559e6c8c1f40 tx=0x7fc5c80eb530 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.176+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2486294426 shutdown_connections 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.176+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/2486294426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4fd390 0x559e6c8c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.176+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/2486294426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4f51b0 0x559e6c8c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.176+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/2486294426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c51e070 0x559e6c8c32c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.176+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2486294426 >> 172.21.15.53:0/2486294426 conn(0x559e6c512460 msgr2=0x559e6c8c11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.176+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2486294426 shutdown_connections 2024-08-31T06:28:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.176+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2486294426 wait complete. 2024-08-31T06:28:31.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.177+0000 7fc5e4a15740 1 -- start start 2024-08-31T06:28:31.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.177+0000 7fc5e4a15740 1 Processor -- start 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4fd390 0x559e6c8cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5dca3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c51e070 0x559e6c8dad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5e4a15740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559e6c68c700 con 0x559e6c4f51b0 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5dca3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33702/0 (socket says 172.21.15.53:33702) 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5dca3d640 1 -- 172.21.15.53:0/1684921311 learned_addr learned my addr 172.21.15.53:0/1684921311 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5e4a15740 1 -- 172.21.15.53:0/1684921311 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559e6c7b0700 con 0x559e6c51e070 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5e4a15740 1 -- 172.21.15.53:0/1684921311 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559e6c8d1a40 con 0x559e6c4fd390 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5d77fe640 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4fd390 0x559e6c8cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5e4a15740 10 client.0 _ll_register_callbacks cb 0x559e6c7dfdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5d77fe640 1 -- 172.21.15.53:0/1684921311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c51e070 msgr2=0x559e6c8dad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5d77fe640 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c51e070 0x559e6c8dad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5d77fe640 1 -- 172.21.15.53:0/1684921311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 msgr2=0x559e6c8cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5d77fe640 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.178+0000 7fc5d77fe640 1 -- 172.21.15.53:0/1684921311 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e6c7e98b0 con 0x559e6c4fd390 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.179+0000 7fc5d77fe640 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4fd390 0x559e6c8cefc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc012700 tx=0x7fc5cc012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe93057d5252a60b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.179+0000 7fc5b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.179+0000 7fc5b77fe640 1 -- 172.21.15.53:0/1684921311 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc00f920 con 0x559e6c4fd390 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.179+0000 7fc5b77fe640 1 -- 172.21.15.53:0/1684921311 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7fc5cc00fac0 con 0x559e6c4fd390 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.179+0000 7fc5e4a15740 1 -- 172.21.15.53:0/1684921311 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5d0036040 con 0x559e6c4fd390 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.179+0000 7fc5b77fe640 1 -- 172.21.15.53:0/1684921311 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fc5cc00fcc0 con 0x559e6c4fd390 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.179+0000 7fc5e4a15740 10 client.31294 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.179+0000 7fc5e4a15740 1 -- 172.21.15.53:0/1684921311 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x559e6c8dd8c0 con 0x559e6c4fd390 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.180+0000 7fc5b77fe640 1 -- 172.21.15.53:0/1684921311 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5d0036040 con 0x559e6c4fd390 2024-08-31T06:28:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.180+0000 7fc5b77fe640 1 -- 172.21.15.53:0/1684921311 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7fc5cc01c420 con 0x559e6c4fd390 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.180+0000 7fc5e4a15740 10 client.31294 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.180+0000 7fc5e4a15740 10 client.31294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.180+0000 7fc5e4a15740 20 client.31294 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.180+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559e6c4dc9f0 0x559e6c8e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.180+0000 7fc5e4a15740 4 client.31294 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.180+0000 7fc5e4a15740 1 -- 172.21.15.53:0/1684921311 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e6c83c580 con 0x559e6c4dc9f0 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.180+0000 7fc5dca3d640 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559e6c4dc9f0 0x559e6c8e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.181+0000 7fc5b77fe640 10 client.31294 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.181+0000 7fc5dca3d640 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559e6c4dc9f0 0x559e6c8e0ee0 crc :-1 s=READY pgs=552 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3ad7b64164d9295 server_cookie=4927db9b0ae71d71 in_seq=0 out_seq=0 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5b77fe640 1 -- 172.21.15.53:0/1684921311 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e6c83c580 con 0x559e6c4dc9f0 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5b77fe640 10 client.31294 handle_command_reply: tid=0 2024-08-31T06:28:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 1 client.31294 shutdown 2024-08-31T06:28:31.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 1 -- 172.21.15.53:0/1684921311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4fd390 msgr2=0x559e6c8cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:31.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4fd390 0x559e6c8cefc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc012700 tx=0x7fc5cc012bc0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 1 -- 172.21.15.53:0/1684921311 shutdown_connections 2024-08-31T06:28:31.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559e6c4dc9f0 0x559e6c8e0ee0 crc :-1 s=READY pgs=552 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5b77fe640 0 client.31294 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:31.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c51e070 0x559e6c8dad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4fd390 0x559e6c8cefc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/1684921311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 1 -- 172.21.15.53:0/1684921311 >> 172.21.15.53:0/1684921311 conn(0x559e6c512460 msgr2=0x559e6c8c6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:31.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 1 -- 172.21.15.53:0/1684921311 shutdown_connections 2024-08-31T06:28:31.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 1 -- 172.21.15.53:0/1684921311 wait complete. 2024-08-31T06:28:31.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.182+0000 7fc5e4a15740 20 client.31294 trim_cache size 0 max 16384 2024-08-31T06:28:31.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.207+0000 7fc5e4a15740 1 Processor -- start 2024-08-31T06:28:31.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.207+0000 7fc5e4a15740 1 -- start start 2024-08-31T06:28:31.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.207+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4dc9f0 0x559e6c8cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.207+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8dac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.207+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c4fd390 0x559e6c8db1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.207+0000 7fc5e4a15740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81b17f0 con 0x559e6c4f51b0 2024-08-31T06:28:31.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.207+0000 7fc5e4a15740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81b33f0 con 0x559e6c4fd390 2024-08-31T06:28:31.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.207+0000 7fc5e4a15740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81b1ec0 con 0x559e6c4dc9f0 2024-08-31T06:28:31.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5dca3d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c4fd390 0x559e6c8db1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8dac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33710/0 (socket says 172.21.15.53:33710) 2024-08-31T06:28:31.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5dca3d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c4fd390 0x559e6c8db1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60834/0 (socket says 172.21.15.53:60834) 2024-08-31T06:28:31.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5d77fe640 1 -- 172.21.15.53:0/272412277 learned_addr learned my addr 172.21.15.53:0/272412277 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:31.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5dca3d640 1 --2- 172.21.15.53:0/272412277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4dc9f0 0x559e6c8cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5d77fe640 1 -- 172.21.15.53:0/272412277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4dc9f0 msgr2=0x559e6c8cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:31.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5d77fe640 1 --2- 172.21.15.53:0/272412277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4dc9f0 0x559e6c8cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5d77fe640 1 -- 172.21.15.53:0/272412277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c4fd390 msgr2=0x559e6c8db1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:31.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5d77fe640 1 --2- 172.21.15.53:0/272412277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c4fd390 0x559e6c8db1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5d77fe640 1 -- 172.21.15.53:0/272412277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e6c8c55e0 con 0x559e6c4f51b0 2024-08-31T06:28:31.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.208+0000 7fc5d77fe640 1 --2- 172.21.15.53:0/272412277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8dac60 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc01c830 tx=0x7fc5cc009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25da7911bd1e6fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:31.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.209+0000 7fc5bdffb640 1 -- 172.21.15.53:0/272412277 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc000e60 con 0x559e6c4f51b0 2024-08-31T06:28:31.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.209+0000 7fc5bdffb640 1 -- 172.21.15.53:0/272412277 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5cc00f920 con 0x559e6c4f51b0 2024-08-31T06:28:31.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.209+0000 7fc5bdffb640 1 -- 172.21.15.53:0/272412277 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0054c0 con 0x559e6c4f51b0 2024-08-31T06:28:31.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.210+0000 7fc5e4a15740 1 -- 172.21.15.53:0/272412277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 msgr2=0x559e6c8dac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:31.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.210+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/272412277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8dac60 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc01c830 tx=0x7fc5cc009fd0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.210+0000 7fc5e4a15740 1 -- 172.21.15.53:0/272412277 shutdown_connections 2024-08-31T06:28:31.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.210+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/272412277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c4fd390 0x559e6c8db1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.210+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/272412277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8dac60 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.210+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/272412277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4dc9f0 0x559e6c8cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.210+0000 7fc5e4a15740 1 -- 172.21.15.53:0/272412277 >> 172.21.15.53:0/272412277 conn(0x559e6c512460 msgr2=0x559e6c8ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:31.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.210+0000 7fc5e4a15740 1 -- 172.21.15.53:0/272412277 shutdown_connections 2024-08-31T06:28:31.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.210+0000 7fc5e4a15740 1 -- 172.21.15.53:0/272412277 wait complete. 2024-08-31T06:28:31.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.211+0000 7fc5e4a15740 1 -- start start 2024-08-31T06:28:31.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.211+0000 7fc5e4a15740 1 Processor -- start 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c4dc9f0 0x559e6c8d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8d3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5e4a15740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4fd390 0x559e6c9530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5e4a15740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81b2d20 con 0x559e6c4f51b0 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5e4a15740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81b2650 con 0x559e6c4dc9f0 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5e4a15740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81af7f0 con 0x559e6c4fd390 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5e4a15740 10 client.0 _ll_register_callbacks cb 0x7fc5cc009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8d3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5dca3d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c4dc9f0 0x559e6c8d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8d3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33726/0 (socket says 172.21.15.53:33726) 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5d77fe640 1 -- 172.21.15.53:0/2738869686 learned_addr learned my addr 172.21.15.53:0/2738869686 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5dca3d640 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4fd390 0x559e6c9530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5d77fe640 1 -- 172.21.15.53:0/2738869686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4fd390 msgr2=0x559e6c9530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:31.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5d77fe640 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4fd390 0x559e6c9530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5d77fe640 1 -- 172.21.15.53:0/2738869686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c4dc9f0 msgr2=0x559e6c8d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:31.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5d77fe640 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c4dc9f0 0x559e6c8d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.212+0000 7fc5d77fe640 1 -- 172.21.15.53:0/2738869686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e6c9535f0 con 0x559e6c4f51b0 2024-08-31T06:28:31.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.213+0000 7fc5d77fe640 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8d3550 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc005270 tx=0x7fc5cc0052a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ca6dbd7aae74d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:31.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.213+0000 7fc5b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:31.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.213+0000 7fc5b77fe640 1 -- 172.21.15.53:0/2738869686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc000e40 con 0x559e6c4f51b0 2024-08-31T06:28:31.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.213+0000 7fc5b77fe640 1 -- 172.21.15.53:0/2738869686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7fc5cc029040 con 0x559e6c4f51b0 2024-08-31T06:28:31.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.213+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2738869686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5cc00f920 con 0x559e6c4f51b0 2024-08-31T06:28:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.213+0000 7fc5b77fe640 1 -- 172.21.15.53:0/2738869686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fc5cc03e050 con 0x559e6c4f51b0 2024-08-31T06:28:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.213+0000 7fc5e4a15740 10 client.22665 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.213+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2738869686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x559e6c9546c0 con 0x559e6c4f51b0 2024-08-31T06:28:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.214+0000 7fc5b77fe640 1 -- 172.21.15.53:0/2738869686 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5cc00f920 con 0x559e6c4f51b0 2024-08-31T06:28:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.214+0000 7fc5b77fe640 1 -- 172.21.15.53:0/2738869686 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7fc5cc003a80 con 0x559e6c4f51b0 2024-08-31T06:28:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.214+0000 7fc5e4a15740 10 client.22665 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.214+0000 7fc5e4a15740 10 client.22665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.214+0000 7fc5e4a15740 20 client.22665 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.214+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559e6c51e070 0x559e6c956e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.214+0000 7fc5e4a15740 4 client.22665 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:28:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.214+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2738869686 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e6c838020 con 0x559e6c51e070 2024-08-31T06:28:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.214+0000 7fc5dca3d640 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559e6c51e070 0x559e6c956e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.215+0000 7fc5b77fe640 10 client.22665 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.215+0000 7fc5dca3d640 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559e6c51e070 0x559e6c956e30 crc :-1 s=READY pgs=553 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5a2b405e32a354d server_cookie=5ed8828db565ceef in_seq=0 out_seq=0 2024-08-31T06:28:31.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5b77fe640 1 -- 172.21.15.53:0/2738869686 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8522 (crc 0 0 0) 0x559e6c838020 con 0x559e6c51e070 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5b77fe640 10 client.22665 handle_command_reply: tid=0 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5e4a15740 1 client.22665 shutdown 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2738869686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 msgr2=0x559e6c8d3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8d3550 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc005270 tx=0x7fc5cc0052a0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2738869686 shutdown_connections 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x559e6c51e070 0x559e6c956e30 crc :-1 s=READY pgs=553 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e6c4fd390 0x559e6c9530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e6c4f51b0 0x559e6c8d3550 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5e4a15740 1 --2- 172.21.15.53:0/2738869686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e6c4dc9f0 0x559e6c8d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5b77fe640 0 client.22665 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.216+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2738869686 >> 172.21.15.53:0/2738869686 conn(0x559e6c512460 msgr2=0x559e6c8c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.217+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2738869686 shutdown_connections 2024-08-31T06:28:31.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.217+0000 7fc5e4a15740 1 -- 172.21.15.53:0/2738869686 wait complete. 2024-08-31T06:28:31.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.217+0000 7fc5e4a15740 20 client.22665 trim_cache size 0 max 16384 2024-08-31T06:28:31.221 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:28:31.221 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:28:31.221 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:28:31.221 INFO:teuthology.orchestra.run.smithi053.stdout: "e839581e-94c5-4714-a1a6-40730925f6b8": { 2024-08-31T06:28:31.221 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.221 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "e839581e-94c5-4714-a1a6-40730925f6b8", 2024-08-31T06:28:31.221 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: "cac6d546-f1c8-4203-803b-7c8d84c48507": { 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:27:34.520218+0000", 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: "e839581e-94c5-4714-a1a6-40730925f6b8": { 2024-08-31T06:28:31.222 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:28:29.506188+0000", 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.223 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.224 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:28:31.225 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:25:55.673122+0000", 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.226 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:28:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:28:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.229 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.230 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "857f8219-039c-44d2-8dd7-af494d80e735": { 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:26:48.510100+0000", 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.231 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:28:31.232 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.233 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.234 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.235 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.236 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.237 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:28:31.238 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:28:31.239 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:28:31.240 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:28:31.240 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:28:31.240 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:28:31.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2270808812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5c00b4d50 msgr2=0x7fc5c00b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:31.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5c00b4d50 0x7fc5c00b7260 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x559e6c8c1f40 tx=0x7fc5c80eb530 comp rx=0 tx=0).stop 2024-08-31T06:28:31.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2270808812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5d8103940 msgr2=0x7fc5d819c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5d8103940 0x7fc5d819c3b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800e9f0 tx=0x7fc5c800eeb0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2270808812 shutdown_connections 2024-08-31T06:28:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc5c00b4d50 0x7fc5c00b7260 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5d8109bd0 0x7fc5d81a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d8109280 0x7fc5d819c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 --2- 172.21.15.53:0/2270808812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5d8103940 0x7fc5d819c3b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2270808812 >> 172.21.15.53:0/2270808812 conn(0x7fc5d80ff3d0 msgr2=0x7fc5d8108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2270808812 shutdown_connections 2024-08-31T06:28:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:28:31.218+0000 7fc5de4a0640 1 -- 172.21.15.53:0/2270808812 wait complete. 2024-08-31T06:28:31.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 63461 5.31 MB/sec execute 499 sec latency 98.233 ms 2024-08-31T06:28:31.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:31 smithi053 ceph-mon[18924]: pgmap v1066: 97 pgs: 97 active+clean; 980 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 373 op/s 2024-08-31T06:28:32.066 INFO:tasks.cephfs.filesystem:scrub status for tag:e839581e-94c5-4714-a1a6-40730925f6b8 - {'path': '/', 'tag': 'e839581e-94c5-4714-a1a6-40730925f6b8', 'options': 'recursive,force'} 2024-08-31T06:28:32.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:31 smithi153 ceph-mon[22320]: pgmap v1066: 97 pgs: 97 active+clean; 980 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 373 op/s 2024-08-31T06:28:32.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:31 smithi130 ceph-mon[22266]: pgmap v1066: 97 pgs: 97 active+clean; 980 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 373 op/s 2024-08-31T06:28:32.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 63605 5.32 MB/sec execute 500 sec latency 83.973 ms 2024-08-31T06:28:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.828+0000 7fa227807640 1 -- 172.21.15.53:0/2599279282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa220104ff0 msgr2=0x7fa22010d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.828+0000 7fa227807640 1 --2- 172.21.15.53:0/2599279282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa220104ff0 0x7fa22010d530 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fa210009900 tx=0x7fa21002a410 comp rx=0 tx=0).stop 2024-08-31T06:28:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.828+0000 7fa227807640 1 -- 172.21.15.53:0/2599279282 shutdown_connections 2024-08-31T06:28:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.828+0000 7fa227807640 1 --2- 172.21.15.53:0/2599279282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22010db00 0x7fa22010fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.828+0000 7fa227807640 1 --2- 172.21.15.53:0/2599279282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa220104ff0 0x7fa22010d530 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.828+0000 7fa227807640 1 --2- 172.21.15.53:0/2599279282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2201046a0 0x7fa220104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.828+0000 7fa227807640 1 -- 172.21.15.53:0/2599279282 >> 172.21.15.53:0/2599279282 conn(0x7fa22007a4e0 msgr2=0x7fa22007a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.828+0000 7fa227807640 1 -- 172.21.15.53:0/2599279282 shutdown_connections 2024-08-31T06:28:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.828+0000 7fa227807640 1 -- 172.21.15.53:0/2599279282 wait complete. 2024-08-31T06:28:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.829+0000 7fa227807640 1 Processor -- start 2024-08-31T06:28:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.829+0000 7fa227807640 1 -- start start 2024-08-31T06:28:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa227807640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2201046a0 0x7fa22019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa227807640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa220104ff0 0x7fa22019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa227807640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22010db00 0x7fa22019f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa227807640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa220113650 con 0x7fa220104ff0 2024-08-31T06:28:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa227807640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2201134d0 con 0x7fa2201046a0 2024-08-31T06:28:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa227807640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2201137d0 con 0x7fa22010db00 2024-08-31T06:28:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa224da2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa220104ff0 0x7fa22019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa2255a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2201046a0 0x7fa22019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa224da2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa220104ff0 0x7fa22019a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33744/0 (socket says 172.21.15.53:33744) 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa224da2640 1 -- 172.21.15.53:0/1657879111 learned_addr learned my addr 172.21.15.53:0/1657879111 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa225da4640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22010db00 0x7fa22019f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa2255a3640 1 -- 172.21.15.53:0/1657879111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22010db00 msgr2=0x7fa22019f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa2255a3640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22010db00 0x7fa22019f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa2255a3640 1 -- 172.21.15.53:0/1657879111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa220104ff0 msgr2=0x7fa22019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa2255a3640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa220104ff0 0x7fa22019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa2255a3640 1 -- 172.21.15.53:0/1657879111 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2201a0020 con 0x7fa2201046a0 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa224da2640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa220104ff0 0x7fa22019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa225da4640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22010db00 0x7fa22019f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.830+0000 7fa2255a3640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2201046a0 0x7fa22019a0f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00e9f0 tx=0x7fa21c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.831+0000 7fa2167fc640 1 -- 172.21.15.53:0/1657879111 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00ccc0 con 0x7fa2201046a0 2024-08-31T06:28:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.831+0000 7fa227807640 1 -- 172.21.15.53:0/1657879111 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2201a0310 con 0x7fa2201046a0 2024-08-31T06:28:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.831+0000 7fa227807640 1 -- 172.21.15.53:0/1657879111 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2201a6aa0 con 0x7fa2201046a0 2024-08-31T06:28:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.831+0000 7fa2167fc640 1 -- 172.21.15.53:0/1657879111 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa21c0108c0 con 0x7fa2201046a0 2024-08-31T06:28:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.831+0000 7fa2167fc640 1 -- 172.21.15.53:0/1657879111 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c0187c0 con 0x7fa2201046a0 2024-08-31T06:28:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.834+0000 7fa22e851740 1 Processor -- start 2024-08-31T06:28:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.834+0000 7fa22e851740 1 -- start start 2024-08-31T06:28:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.834+0000 7fa2167fc640 1 -- 172.21.15.53:0/1657879111 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa21c010430 con 0x7fa2201046a0 2024-08-31T06:28:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.834+0000 7fa22e851740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086bab1b0 0x564086f4eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.834+0000 7fa22e851740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 0x564086f4f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.834+0000 7fa22e851740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086b8a4d0 0x564086f4f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa22e851740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564086ec4000 con 0x564086b822f0 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa22e851740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564086eb3590 con 0x564086b8a4d0 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa22e851740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564086eb7540 con 0x564086bab1b0 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa225da4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086bab1b0 0x564086f4eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa225da4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086bab1b0 0x564086f4eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:54534/0 (socket says 172.21.15.53:54534) 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa225da4640 1 -- 172.21.15.53:0/3949100969 learned_addr learned my addr 172.21.15.53:0/3949100969 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa224da2640 1 --2- 172.21.15.53:0/3949100969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086b8a4d0 0x564086f4f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa2255a3640 1 --2- 172.21.15.53:0/3949100969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 0x564086f4f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa225da4640 1 -- 172.21.15.53:0/3949100969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086b8a4d0 msgr2=0x564086f4f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa225da4640 1 --2- 172.21.15.53:0/3949100969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086b8a4d0 0x564086f4f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa225da4640 1 -- 172.21.15.53:0/3949100969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 msgr2=0x564086f4f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa225da4640 1 --2- 172.21.15.53:0/3949100969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 0x564086f4f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa225da4640 1 -- 172.21.15.53:0/3949100969 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564086c16790 con 0x564086bab1b0 2024-08-31T06:28:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa2255a3640 1 --2- 172.21.15.53:0/3949100969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 0x564086f4f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:28:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.835+0000 7fa225da4640 1 --2- 172.21.15.53:0/3949100969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086bab1b0 0x564086f4eac0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa218010450 tx=0x7fa218010910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61fe5f7cfe663de5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.836+0000 7fa2167fc640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa20c0b4ca0 0x7fa20c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.836+0000 7fa20b7fe640 1 -- 172.21.15.53:0/3949100969 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218017070 con 0x564086bab1b0 2024-08-31T06:28:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.836+0000 7fa20b7fe640 1 -- 172.21.15.53:0/3949100969 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa218011bf0 con 0x564086bab1b0 2024-08-31T06:28:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.836+0000 7fa20b7fe640 1 -- 172.21.15.53:0/3949100969 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21801ac20 con 0x564086bab1b0 2024-08-31T06:28:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.836+0000 7fa2167fc640 1 -- 172.21.15.53:0/1657879111 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7fa21c0e5810 con 0x7fa2201046a0 2024-08-31T06:28:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.836+0000 7fa2255a3640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa20c0b4ca0 0x7fa20c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.837+0000 7fa22e851740 1 -- 172.21.15.53:0/3949100969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086bab1b0 msgr2=0x564086f4eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.837+0000 7fa22e851740 1 --2- 172.21.15.53:0/3949100969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086bab1b0 0x564086f4eac0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa218010450 tx=0x7fa218010910 comp rx=0 tx=0).stop 2024-08-31T06:28:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.837+0000 7fa22e851740 1 -- 172.21.15.53:0/3949100969 shutdown_connections 2024-08-31T06:28:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.837+0000 7fa22e851740 1 --2- 172.21.15.53:0/3949100969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086b8a4d0 0x564086f4f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.837+0000 7fa22e851740 1 --2- 172.21.15.53:0/3949100969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 0x564086f4f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.837+0000 7fa22e851740 1 --2- 172.21.15.53:0/3949100969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086bab1b0 0x564086f4eac0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.837+0000 7fa22e851740 1 -- 172.21.15.53:0/3949100969 >> 172.21.15.53:0/3949100969 conn(0x564086b9f300 msgr2=0x564086f4c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.837+0000 7fa2255a3640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa20c0b4ca0 0x7fa20c0b71b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa21c0e2ff0 tx=0x7fa21c009700 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.837+0000 7fa22e851740 1 -- 172.21.15.53:0/3949100969 shutdown_connections 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.837+0000 7fa22e851740 1 -- 172.21.15.53:0/3949100969 wait complete. 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.838+0000 7fa22e851740 1 -- start start 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.838+0000 7fa22e851740 1 Processor -- start 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.838+0000 7fa22e851740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b822f0 0x564086f5f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.838+0000 7fa22e851740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b8a4d0 0x564086f5f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.838+0000 7fa22e851740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086bab1b0 0x564086f647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa22e851740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564086decab0 con 0x564086b8a4d0 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa22e851740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564086e3a680 con 0x564086bab1b0 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa22e851740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564086f5d240 con 0x564086b822f0 2024-08-31T06:28:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa225da4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b822f0 0x564086f5f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa225da4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b822f0 0x564086f5f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:54542/0 (socket says 172.21.15.53:54542) 2024-08-31T06:28:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa225da4640 1 -- 172.21.15.53:0/3758750041 learned_addr learned my addr 172.21.15.53:0/3758750041 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa225da4640 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086bab1b0 0x564086f647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa224da2640 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b8a4d0 0x564086f5f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa22e851740 10 client.0 _ll_register_callbacks cb 0x564086bc2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa225da4640 1 -- 172.21.15.53:0/3758750041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086bab1b0 msgr2=0x564086f647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa225da4640 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086bab1b0 0x564086f647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa225da4640 1 -- 172.21.15.53:0/3758750041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b8a4d0 msgr2=0x564086f5f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa225da4640 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b8a4d0 0x564086f5f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa225da4640 1 -- 172.21.15.53:0/3758750041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564086c8f620 con 0x564086b822f0 2024-08-31T06:28:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa225da4640 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b822f0 0x564086f5f1d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa218009e10 tx=0x7fa21801a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39c614cc8fe7672c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.839+0000 7fa208ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:28:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.840+0000 7fa208ff9640 1 -- 172.21.15.53:0/3758750041 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218017070 con 0x564086b822f0 2024-08-31T06:28:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.840+0000 7fa208ff9640 1 -- 172.21.15.53:0/3758750041 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7fa218004a40 con 0x564086b822f0 2024-08-31T06:28:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.840+0000 7fa22e851740 1 -- 172.21.15.53:0/3758750041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa218011bf0 con 0x564086b822f0 2024-08-31T06:28:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.840+0000 7fa208ff9640 1 -- 172.21.15.53:0/3758750041 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fa218004c40 con 0x564086b822f0 2024-08-31T06:28:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.840+0000 7fa22e851740 10 client.31312 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.840+0000 7fa22e851740 1 -- 172.21.15.53:0/3758750041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x564086f6d6b0 con 0x564086b822f0 2024-08-31T06:28:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.840+0000 7fa208ff9640 1 -- 172.21.15.53:0/3758750041 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2180119f0 con 0x564086b822f0 2024-08-31T06:28:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.840+0000 7fa208ff9640 1 -- 172.21.15.53:0/3758750041 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7fa218026040 con 0x564086b822f0 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.841+0000 7fa22e851740 10 client.31312 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.841+0000 7fa22e851740 10 client.31312 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.841+0000 7fa22e851740 20 client.31312 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.841+0000 7fa22e851740 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564086b69d80 0x564086f70ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.841+0000 7fa22e851740 4 client.31312 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.841+0000 7fa22e851740 1 -- 172.21.15.53:0/3758750041 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa218011bf0 con 0x564086b69d80 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.841+0000 7fa224da2640 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564086b69d80 0x564086f70ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.841+0000 7fa208ff9640 10 client.31312 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.842+0000 7fa224da2640 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564086b69d80 0x564086f70ad0 crc :-1 s=READY pgs=554 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6886a4c91d6667 server_cookie=39d9e7993a813d83 in_seq=0 out_seq=0 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa208ff9640 1 -- 172.21.15.53:0/3758750041 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa218011bf0 con 0x564086b69d80 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa208ff9640 10 client.31312 handle_command_reply: tid=0 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa22e851740 1 client.31312 shutdown 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa22e851740 1 -- 172.21.15.53:0/3758750041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b822f0 msgr2=0x564086f5f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa22e851740 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b822f0 0x564086f5f1d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa218009e10 tx=0x7fa21801a780 comp rx=0 tx=0).stop 2024-08-31T06:28:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa22e851740 1 -- 172.21.15.53:0/3758750041 shutdown_connections 2024-08-31T06:28:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa22e851740 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564086b69d80 0x564086f70ad0 crc :-1 s=READY pgs=554 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa22e851740 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086bab1b0 0x564086f647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa208ff9640 0 client.31312 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa22e851740 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b8a4d0 0x564086f5f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa22e851740 1 --2- 172.21.15.53:0/3758750041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b822f0 0x564086f5f1d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa22e851740 1 -- 172.21.15.53:0/3758750041 >> 172.21.15.53:0/3758750041 conn(0x564086b9f300 msgr2=0x564086f4faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.843+0000 7fa22e851740 1 -- 172.21.15.53:0/3758750041 shutdown_connections 2024-08-31T06:28:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.844+0000 7fa22e851740 1 -- 172.21.15.53:0/3758750041 wait complete. 2024-08-31T06:28:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.844+0000 7fa22e851740 20 client.31312 trim_cache size 0 max 16384 2024-08-31T06:28:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.870+0000 7fa22e851740 1 Processor -- start 2024-08-31T06:28:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.870+0000 7fa22e851740 1 -- start start 2024-08-31T06:28:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa22e851740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086b822f0 0x564086f4ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa22e851740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b8a4d0 0x564086f6b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa22e851740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086bab1b0 0x564086f581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa22e851740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa20400e8c0 con 0x564086bab1b0 2024-08-31T06:28:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa22e851740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2040104c0 con 0x564086b822f0 2024-08-31T06:28:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa22e851740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa20400ef90 con 0x564086b8a4d0 2024-08-31T06:28:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa225da4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086b822f0 0x564086f4ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa225da4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086b822f0 0x564086f4ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:60894/0 (socket says 172.21.15.53:60894) 2024-08-31T06:28:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa225da4640 1 -- 172.21.15.53:0/3202246225 learned_addr learned my addr 172.21.15.53:0/3202246225 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa225da4640 1 --2- 172.21.15.53:0/3202246225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086bab1b0 0x564086f581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa224da2640 1 --2- 172.21.15.53:0/3202246225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b8a4d0 0x564086f6b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa225da4640 1 -- 172.21.15.53:0/3202246225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b8a4d0 msgr2=0x564086f6b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa225da4640 1 --2- 172.21.15.53:0/3202246225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b8a4d0 0x564086f6b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa225da4640 1 -- 172.21.15.53:0/3202246225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086b822f0 msgr2=0x564086f4ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa225da4640 1 --2- 172.21.15.53:0/3202246225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086b822f0 0x564086f4ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa225da4640 1 -- 172.21.15.53:0/3202246225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564086f518d0 con 0x564086bab1b0 2024-08-31T06:28:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.871+0000 7fa225da4640 1 --2- 172.21.15.53:0/3202246225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086bab1b0 0x564086f581c0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fa218005770 tx=0x7fa218005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf8859fe239373f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.872+0000 7fa20affd640 1 -- 172.21.15.53:0/3202246225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218017040 con 0x564086bab1b0 2024-08-31T06:28:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.872+0000 7fa20affd640 1 -- 172.21.15.53:0/3202246225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2180058b0 con 0x564086bab1b0 2024-08-31T06:28:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.872+0000 7fa20affd640 1 -- 172.21.15.53:0/3202246225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21801a420 con 0x564086bab1b0 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.873+0000 7fa22e851740 1 -- 172.21.15.53:0/3202246225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086bab1b0 msgr2=0x564086f581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.873+0000 7fa22e851740 1 --2- 172.21.15.53:0/3202246225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086bab1b0 0x564086f581c0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fa218005770 tx=0x7fa218005fd0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.873+0000 7fa22e851740 1 -- 172.21.15.53:0/3202246225 shutdown_connections 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.873+0000 7fa22e851740 1 --2- 172.21.15.53:0/3202246225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086bab1b0 0x564086f581c0 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.873+0000 7fa22e851740 1 --2- 172.21.15.53:0/3202246225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b8a4d0 0x564086f6b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.873+0000 7fa22e851740 1 --2- 172.21.15.53:0/3202246225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086b822f0 0x564086f4ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.873+0000 7fa22e851740 1 -- 172.21.15.53:0/3202246225 >> 172.21.15.53:0/3202246225 conn(0x564086b9f300 msgr2=0x564086f4c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.873+0000 7fa22e851740 1 -- 172.21.15.53:0/3202246225 shutdown_connections 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.873+0000 7fa22e851740 1 -- 172.21.15.53:0/3202246225 wait complete. 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.873+0000 7fa22e851740 1 -- start start 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.873+0000 7fa22e851740 1 Processor -- start 2024-08-31T06:28:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa22e851740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 0x564086f6b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa22e851740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b8a4d0 0x564086f648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa22e851740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086bab1b0 0x564086f64e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa22e851740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa20400fdf0 con 0x564086b822f0 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa22e851740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa20400f720 con 0x564086bab1b0 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa22e851740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa20400c8c0 con 0x564086b8a4d0 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa22e851740 10 client.0 _ll_register_callbacks cb 0x7fa2180093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa225da4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 0x564086f6b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa225da4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 0x564086f6b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33772/0 (socket says 172.21.15.53:33772) 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa225da4640 1 -- 172.21.15.53:0/118802958 learned_addr learned my addr 172.21.15.53:0/118802958 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa225da4640 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086bab1b0 0x564086f64e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.874+0000 7fa224da2640 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b8a4d0 0x564086f648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.875+0000 7fa225da4640 1 -- 172.21.15.53:0/118802958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b8a4d0 msgr2=0x564086f648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.875+0000 7fa225da4640 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b8a4d0 0x564086f648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.875+0000 7fa225da4640 1 -- 172.21.15.53:0/118802958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086bab1b0 msgr2=0x564086f64e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.875+0000 7fa225da4640 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086bab1b0 0x564086f64e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.875+0000 7fa225da4640 1 -- 172.21.15.53:0/118802958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564086f655e0 con 0x564086b822f0 2024-08-31T06:28:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.875+0000 7fa225da4640 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 0x564086f6b3e0 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fa218005b70 tx=0x7fa218010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac7070db626aec4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.875+0000 7fa208ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.875+0000 7fa208ff9640 1 -- 172.21.15.53:0/118802958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218017070 con 0x564086b822f0 2024-08-31T06:28:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.875+0000 7fa208ff9640 1 -- 172.21.15.53:0/118802958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7fa218020070 con 0x564086b822f0 2024-08-31T06:28:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.875+0000 7fa22e851740 1 -- 172.21.15.53:0/118802958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2180058b0 con 0x564086b822f0 2024-08-31T06:28:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.876+0000 7fa208ff9640 1 -- 172.21.15.53:0/118802958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fa218051050 con 0x564086b822f0 2024-08-31T06:28:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.876+0000 7fa22e851740 10 client.22683 fetch_fsmap learned FSMap version 86 2024-08-31T06:28:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.876+0000 7fa22e851740 1 -- 172.21.15.53:0/118802958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x564086fdb2a0 con 0x564086b822f0 2024-08-31T06:28:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.876+0000 7fa208ff9640 1 -- 172.21.15.53:0/118802958 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2180058b0 con 0x564086b822f0 2024-08-31T06:28:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.876+0000 7fa208ff9640 1 -- 172.21.15.53:0/118802958 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 86) ==== 8378+0+0 (secure 0 0 0) 0x7fa2180116f0 con 0x564086b822f0 2024-08-31T06:28:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.876+0000 7fa22e851740 10 client.22683 fetch_fsmap finished waiting for FSMap version 86 2024-08-31T06:28:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.876+0000 7fa22e851740 10 client.22683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.876+0000 7fa22e851740 20 client.22683 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.876+0000 7fa22e851740 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564086b3f1c0 0x564086fdd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.876+0000 7fa22e851740 4 client.22683 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:28:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.876+0000 7fa22e851740 1 -- 172.21.15.53:0/118802958 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564086ec5f50 con 0x564086b3f1c0 2024-08-31T06:28:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.877+0000 7fa224da2640 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564086b3f1c0 0x564086fdd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.877+0000 7fa208ff9640 10 client.22683 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:32.877+0000 7fa224da2640 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564086b3f1c0 0x564086fdd8a0 crc :-1 s=READY pgs=555 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1726f465a080116 server_cookie=9c79114daedc5698 in_seq=0 out_seq=0 2024-08-31T06:28:33.015 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa208ff9640 1 -- 172.21.15.53:0/118802958 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564086ec5f50 con 0x564086b3f1c0 2024-08-31T06:28:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa208ff9640 10 client.22683 handle_command_reply: tid=0 2024-08-31T06:28:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 1 client.22683 shutdown 2024-08-31T06:28:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 1 -- 172.21.15.53:0/118802958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 msgr2=0x564086f6b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 0x564086f6b3e0 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fa218005b70 tx=0x7fa218010910 comp rx=0 tx=0).stop 2024-08-31T06:28:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 1 -- 172.21.15.53:0/118802958 shutdown_connections 2024-08-31T06:28:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x564086b3f1c0 0x564086fdd8a0 crc :-1 s=READY pgs=555 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa208ff9640 0 client.22683 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564086bab1b0 0x564086f64e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564086b8a4d0 0x564086f648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 1 --2- 172.21.15.53:0/118802958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564086b822f0 0x564086f6b3e0 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 1 -- 172.21.15.53:0/118802958 >> 172.21.15.53:0/118802958 conn(0x564086b9f300 msgr2=0x564086f63590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 1 -- 172.21.15.53:0/118802958 shutdown_connections 2024-08-31T06:28:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 1 -- 172.21.15.53:0/118802958 wait complete. 2024-08-31T06:28:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.013+0000 7fa22e851740 20 client.22683 trim_cache size 0 max 16384 2024-08-31T06:28:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:28:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:28:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:28:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:28:33.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 -- 172.21.15.53:0/1657879111 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa20c0b4ca0 msgr2=0x7fa20c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:33.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa20c0b4ca0 0x7fa20c0b71b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa21c0e2ff0 tx=0x7fa21c009700 comp rx=0 tx=0).stop 2024-08-31T06:28:33.018 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 -- 172.21.15.53:0/1657879111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2201046a0 msgr2=0x7fa22019a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2201046a0 0x7fa22019a0f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00e9f0 tx=0x7fa21c00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:28:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 -- 172.21.15.53:0/1657879111 shutdown_connections 2024-08-31T06:28:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa20c0b4ca0 0x7fa20c0b71b0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa22010db00 0x7fa22019f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa220104ff0 0x7fa22019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 --2- 172.21.15.53:0/1657879111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2201046a0 0x7fa22019a0f0 secure :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00e9f0 tx=0x7fa21c00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:28:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 -- 172.21.15.53:0/1657879111 >> 172.21.15.53:0/1657879111 conn(0x7fa22007a4e0 msgr2=0x7fa220107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 -- 172.21.15.53:0/1657879111 shutdown_connections 2024-08-31T06:28:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:33.014+0000 7fa227807640 1 -- 172.21.15.53:0/1657879111 wait complete. 2024-08-31T06:28:33.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 63744 5.33 MB/sec execute 501 sec latency 92.856 ms 2024-08-31T06:28:34.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:33 smithi153 ceph-mon[22320]: pgmap v1067: 97 pgs: 97 active+clean; 982 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 319 op/s 2024-08-31T06:28:34.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:33 smithi053 ceph-mon[18924]: pgmap v1067: 97 pgs: 97 active+clean; 982 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 319 op/s 2024-08-31T06:28:34.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:33 smithi130 ceph-mon[22266]: pgmap v1067: 97 pgs: 97 active+clean; 982 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 319 op/s 2024-08-31T06:28:34.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 63925 5.34 MB/sec execute 502 sec latency 74.208 ms 2024-08-31T06:28:35.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 64084 5.34 MB/sec execute 503 sec latency 119.351 ms 2024-08-31T06:28:36.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:35 smithi153 ceph-mon[22320]: pgmap v1068: 97 pgs: 97 active+clean; 987 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 380 op/s 2024-08-31T06:28:36.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:35 smithi053 ceph-mon[18924]: pgmap v1068: 97 pgs: 97 active+clean; 987 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 380 op/s 2024-08-31T06:28:36.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:35 smithi130 ceph-mon[22266]: pgmap v1068: 97 pgs: 97 active+clean; 987 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 380 op/s 2024-08-31T06:28:36.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 64259 5.35 MB/sec execute 504 sec latency 95.230 ms 2024-08-31T06:28:37.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 64393 5.35 MB/sec execute 505 sec latency 76.846 ms 2024-08-31T06:28:38.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:37 smithi153 ceph-mon[22320]: pgmap v1069: 97 pgs: 97 active+clean; 987 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 392 op/s 2024-08-31T06:28:38.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:37 smithi053 ceph-mon[18924]: pgmap v1069: 97 pgs: 97 active+clean; 987 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 392 op/s 2024-08-31T06:28:38.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:37 smithi130 ceph-mon[22266]: pgmap v1069: 97 pgs: 97 active+clean; 987 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 392 op/s 2024-08-31T06:28:38.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 64554 5.36 MB/sec execute 506 sec latency 76.272 ms 2024-08-31T06:28:39.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 64733 5.37 MB/sec execute 507 sec latency 171.017 ms 2024-08-31T06:28:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:39 smithi153 ceph-mon[22320]: pgmap v1070: 97 pgs: 97 active+clean; 997 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 372 op/s 2024-08-31T06:28:40.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:39 smithi053 ceph-mon[18924]: pgmap v1070: 97 pgs: 97 active+clean; 997 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 372 op/s 2024-08-31T06:28:40.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:39 smithi130 ceph-mon[22266]: pgmap v1070: 97 pgs: 97 active+clean; 997 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 372 op/s 2024-08-31T06:28:40.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 64899 5.38 MB/sec execute 508 sec latency 52.965 ms 2024-08-31T06:28:41.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:40 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:28:41.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:40 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:28:41.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:40 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:28:41.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:40 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:28:41.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:40 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:28:41.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:40 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:28:41.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 65054 5.38 MB/sec execute 509 sec latency 80.926 ms 2024-08-31T06:28:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:41 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:28:42.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:41 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:28:42.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:41 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:28:42.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:41 smithi153 ceph-mon[22320]: pgmap v1071: 97 pgs: 97 active+clean; 1004 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 370 op/s 2024-08-31T06:28:42.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:41 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:28:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:41 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:28:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:41 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:28:42.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:41 smithi053 ceph-mon[18924]: pgmap v1071: 97 pgs: 97 active+clean; 1004 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 370 op/s 2024-08-31T06:28:42.279 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:41 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:28:42.279 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:41 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:28:42.279 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:41 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:28:42.279 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:41 smithi130 ceph-mon[22266]: pgmap v1071: 97 pgs: 97 active+clean; 1004 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 370 op/s 2024-08-31T06:28:42.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 65181 5.39 MB/sec execute 510 sec latency 106.809 ms 2024-08-31T06:28:43.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 65337 5.40 MB/sec execute 511 sec latency 159.451 ms 2024-08-31T06:28:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:43 smithi153 ceph-mon[22320]: pgmap v1072: 97 pgs: 97 active+clean; 1003 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 328 op/s 2024-08-31T06:28:44.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:43 smithi053 ceph-mon[18924]: pgmap v1072: 97 pgs: 97 active+clean; 1003 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 328 op/s 2024-08-31T06:28:44.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:43 smithi130 ceph-mon[22266]: pgmap v1072: 97 pgs: 97 active+clean; 1003 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 328 op/s 2024-08-31T06:28:44.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 65516 5.41 MB/sec execute 512 sec latency 95.240 ms 2024-08-31T06:28:45.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 65660 5.42 MB/sec execute 513 sec latency 73.951 ms 2024-08-31T06:28:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.168+0000 7f7e84ef2640 1 -- 172.21.15.53:0/2240193603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e80101e00 msgr2=0x7f7e80102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.168+0000 7f7e84ef2640 1 --2- 172.21.15.53:0/2240193603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e80101e00 0x7f7e80102210 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009900 tx=0x7f7e7002a410 comp rx=0 tx=0).stop 2024-08-31T06:28:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.168+0000 7f7e84ef2640 1 -- 172.21.15.53:0/2240193603 shutdown_connections 2024-08-31T06:28:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.168+0000 7f7e84ef2640 1 --2- 172.21.15.53:0/2240193603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e80109c30 0x7f7e80110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.168+0000 7f7e84ef2640 1 --2- 172.21.15.53:0/2240193603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e801092e0 0x7f7e801096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.168+0000 7f7e84ef2640 1 --2- 172.21.15.53:0/2240193603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e80101e00 0x7f7e80102210 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.168+0000 7f7e84ef2640 1 -- 172.21.15.53:0/2240193603 >> 172.21.15.53:0/2240193603 conn(0x7f7e80079c30 msgr2=0x7f7e8007a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.168+0000 7f7e84ef2640 1 -- 172.21.15.53:0/2240193603 shutdown_connections 2024-08-31T06:28:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.168+0000 7f7e84ef2640 1 -- 172.21.15.53:0/2240193603 wait complete. 2024-08-31T06:28:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.169+0000 7f7e84ef2640 1 Processor -- start 2024-08-31T06:28:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.169+0000 7f7e84ef2640 1 -- start start 2024-08-31T06:28:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e84ef2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e80101e00 0x7f7e8019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e84ef2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e801092e0 0x7f7e8019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e84ef2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e80109c30 0x7f7e8019fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e84ef2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801137f0 con 0x7f7e801092e0 2024-08-31T06:28:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e84ef2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7e80113670 con 0x7f7e80101e00 2024-08-31T06:28:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e84ef2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e80113970 con 0x7f7e80109c30 2024-08-31T06:28:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e7dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e801092e0 0x7f7e8019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e7dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e801092e0 0x7f7e8019a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46154/0 (socket says 172.21.15.53:46154) 2024-08-31T06:28:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e7dd9b640 1 -- 172.21.15.53:0/1948307528 learned_addr learned my addr 172.21.15.53:0/1948307528 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e80101e00 0x7f7e8019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e7ed9d640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e80109c30 0x7f7e8019fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e7dd9b640 1 -- 172.21.15.53:0/1948307528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e80109c30 msgr2=0x7f7e8019fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e7dd9b640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e80109c30 0x7f7e8019fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e7dd9b640 1 -- 172.21.15.53:0/1948307528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e80101e00 msgr2=0x7f7e8019a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e7dd9b640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e80101e00 0x7f7e8019a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e7dd9b640 1 -- 172.21.15.53:0/1948307528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e801a0260 con 0x7f7e801092e0 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.170+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e80101e00 0x7f7e8019a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.171+0000 7f7e7dd9b640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e801092e0 0x7f7e8019a8d0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f7e74012f30 tx=0x7f7e7400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.171+0000 7f7e6f7fe640 1 -- 172.21.15.53:0/1948307528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74016020 con 0x7f7e801092e0 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.171+0000 7f7e84ef2640 1 -- 172.21.15.53:0/1948307528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e801a0550 con 0x7f7e801092e0 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.171+0000 7f7e84ef2640 1 -- 172.21.15.53:0/1948307528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e80102c70 con 0x7f7e801092e0 2024-08-31T06:28:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.171+0000 7f7e6f7fe640 1 -- 172.21.15.53:0/1948307528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e7400f450 con 0x7f7e801092e0 2024-08-31T06:28:46.176 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.171+0000 7f7e6f7fe640 1 -- 172.21.15.53:0/1948307528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400e610 con 0x7f7e801092e0 2024-08-31T06:28:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:45 smithi153 ceph-mon[22320]: pgmap v1073: 97 pgs: 97 active+clean; 1011 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 371 op/s 2024-08-31T06:28:46.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:45 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.175+0000 7f7e8be5e740 1 Processor -- start 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.175+0000 7f7e8be5e740 1 -- start start 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e8be5e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 0x5613ea222ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e6f7fe640 1 -- 172.21.15.53:0/1948307528 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7e74019020 con 0x7f7e801092e0 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e8be5e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea223220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e8be5e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 0x5613ea223760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e8be5e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613ea198000 con 0x5613e9e5e4d0 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e8be5e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5613ea187590 con 0x5613e9e562f0 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e8be5e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5613ea18b540 con 0x5613e9e7f1b0 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e7e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea223220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e7ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 0x5613ea222ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e7e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea223220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43128/0 (socket says 172.21.15.53:43128) 2024-08-31T06:28:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e7e59c640 1 -- 172.21.15.53:0/2263439839 learned_addr learned my addr 172.21.15.53:0/2263439839 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e7dd9b640 1 --2- 172.21.15.53:0/2263439839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 0x5613ea223760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e7e59c640 1 -- 172.21.15.53:0/2263439839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 msgr2=0x5613ea222ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/2263439839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 0x5613ea222ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.176+0000 7f7e7e59c640 1 -- 172.21.15.53:0/2263439839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 msgr2=0x5613ea223760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.177+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/2263439839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 0x5613ea223760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.177+0000 7f7e6f7fe640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4ca0 0x7f7e680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.177+0000 7f7e7e59c640 1 -- 172.21.15.53:0/2263439839 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613e9eea790 con 0x5613e9e562f0 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.177+0000 7f7e7ed9d640 1 --2- 172.21.15.53:0/2263439839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 0x5613ea222ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.177+0000 7f7e7dd9b640 1 --2- 172.21.15.53:0/2263439839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 0x5613ea223760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.177+0000 7f7e7ed9d640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4ca0 0x7f7e680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.177+0000 7f7e6f7fe640 1 -- 172.21.15.53:0/1948307528 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f7e740e5370 con 0x7f7e801092e0 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.177+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/2263439839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea223220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7e70033000 tx=0x7f7e70004480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=369bb14d74bca437 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.177+0000 7f7e6cff9640 1 -- 172.21.15.53:0/2263439839 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70035040 con 0x5613e9e562f0 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.178+0000 7f7e6cff9640 1 -- 172.21.15.53:0/2263439839 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e70003d00 con 0x5613e9e562f0 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.178+0000 7f7e6cff9640 1 -- 172.21.15.53:0/2263439839 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7003cdf0 con 0x5613e9e562f0 2024-08-31T06:28:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e7ed9d640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4ca0 0x7f7e680b71b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7e78005fd0 tx=0x7f7e78018040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2263439839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 msgr2=0x5613ea223220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2263439839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea223220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7e70033000 tx=0x7f7e70004480 comp rx=0 tx=0).stop 2024-08-31T06:28:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2263439839 shutdown_connections 2024-08-31T06:28:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2263439839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 0x5613ea223760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2263439839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea223220 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2263439839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 0x5613ea222ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2263439839 >> 172.21.15.53:0/2263439839 conn(0x5613e9e73300 msgr2=0x5613ea220bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2263439839 shutdown_connections 2024-08-31T06:28:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2263439839 wait complete. 2024-08-31T06:28:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e8be5e740 1 -- start start 2024-08-31T06:28:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.179+0000 7f7e8be5e740 1 Processor -- start 2024-08-31T06:28:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.180+0000 7f7e8be5e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea22e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.180+0000 7f7e8be5e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 0x5613ea22ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.180+0000 7f7e7dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 0x5613ea22ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.180+0000 7f7e7e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea22e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.180+0000 7f7e7dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 0x5613ea22ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46164/0 (socket says 172.21.15.53:46164) 2024-08-31T06:28:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.180+0000 7f7e7dd9b640 1 -- 172.21.15.53:0/2803450773 learned_addr learned my addr 172.21.15.53:0/2803450773 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.180+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 0x5613ea23a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.180+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2803450773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613ea0c0ab0 con 0x5613e9e5e4d0 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.180+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2803450773 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5613ea10e680 con 0x5613e9e562f0 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.180+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2803450773 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5613ea231400 con 0x5613e9e7f1b0 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.180+0000 7f7e8be5e740 10 client.0 _ll_register_callbacks cb 0x5613e9e96a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e7ed9d640 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 0x5613ea23a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e7dd9b640 1 -- 172.21.15.53:0/2803450773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 msgr2=0x5613ea23a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e7dd9b640 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 0x5613ea23a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e7dd9b640 1 -- 172.21.15.53:0/2803450773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 msgr2=0x5613ea22e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e7dd9b640 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea22e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e7dd9b640 1 -- 172.21.15.53:0/2803450773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613e9f63620 con 0x5613e9e5e4d0 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e7ed9d640 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 0x5613ea23a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea22e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e7dd9b640 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 0x5613ea22ed70 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f7e74000c00 tx=0x7f7e740e8bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f8c4c9249f7e35 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e65ffb640 1 -- 172.21.15.53:0/2803450773 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e740ab810 con 0x5613e9e5e4d0 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e65ffb640 1 -- 172.21.15.53:0/2803450773 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f7e740a75c0 con 0x5613e9e5e4d0 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2803450773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e70003d00 con 0x5613e9e5e4d0 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e65ffb640 1 -- 172.21.15.53:0/2803450773 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f7e740ab1b0 con 0x5613e9e5e4d0 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e8be5e740 10 client.22695 fetch_fsmap learned FSMap version 87 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.181+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2803450773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) -- 0x5613ea23d430 con 0x5613e9e5e4d0 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.182+0000 7f7e65ffb640 1 -- 172.21.15.53:0/2803450773 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e70003d00 con 0x5613e9e5e4d0 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.182+0000 7f7e65ffb640 1 -- 172.21.15.53:0/2803450773 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 87) ==== 8366+0+0 (secure 0 0 0) 0x7f7e740b1440 con 0x5613e9e5e4d0 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.182+0000 7f7e8be5e740 10 client.22695 fetch_fsmap finished waiting for FSMap version 87 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.182+0000 7f7e8be5e740 10 client.22695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.182+0000 7f7e8be5e740 20 client.22695 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.182+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5613e9e3dd80 0x5613ea240920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.182+0000 7f7e8be5e740 4 client.22695 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.182+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2803450773 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613ea199f50 con 0x5613e9e3dd80 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.182+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5613e9e3dd80 0x5613ea240920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.183+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5613e9e3dd80 0x5613ea240920 crc :-1 s=READY pgs=556 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c86b59b9ddf53a30 server_cookie=a1c04571251f98c5 in_seq=0 out_seq=0 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.183+0000 7f7e65ffb640 10 client.22695 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e65ffb640 1 -- 172.21.15.53:0/2803450773 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5613ea199f50 con 0x5613e9e3dd80 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e65ffb640 10 client.22695 handle_command_reply: tid=0 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e8be5e740 1 client.22695 shutdown 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2803450773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 msgr2=0x5613ea22ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 0x5613ea22ed70 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f7e74000c00 tx=0x7f7e740e8bb0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2803450773 shutdown_connections 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5613e9e3dd80 0x5613ea240920 crc :-1 s=READY pgs=556 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e7f1b0 0x5613ea23a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e5e4d0 0x5613ea22ed70 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2803450773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea22e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2803450773 >> 172.21.15.53:0/2803450773 conn(0x5613e9e73300 msgr2=0x5613ea223d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.184+0000 7f7e65ffb640 0 client.22695 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.185+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2803450773 shutdown_connections 2024-08-31T06:28:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.185+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2803450773 wait complete. 2024-08-31T06:28:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.185+0000 7f7e8be5e740 20 client.22695 trim_cache size 0 max 16384 2024-08-31T06:28:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.208+0000 7f7e8be5e740 1 Processor -- start 2024-08-31T06:28:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.208+0000 7f7e8be5e740 1 -- start start 2024-08-31T06:28:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.208+0000 7f7e8be5e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea22e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.208+0000 7f7e8be5e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e5e4d0 0x5613ea220180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.208+0000 7f7e8be5e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 0x5613ea2206c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.208+0000 7f7e8be5e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6000e890 con 0x5613e9e7f1b0 2024-08-31T06:28:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.208+0000 7f7e8be5e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7e60010400 con 0x5613e9e562f0 2024-08-31T06:28:46.211 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.208+0000 7f7e8be5e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6000ef60 con 0x5613e9e5e4d0 2024-08-31T06:28:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e7e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea22e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e7e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea22e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:43140/0 (socket says 172.21.15.53:43140) 2024-08-31T06:28:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e7e59c640 1 -- 172.21.15.53:0/2173479903 learned_addr learned my addr 172.21.15.53:0/2173479903 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e7ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 0x5613ea2206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e7dd9b640 1 --2- 172.21.15.53:0/2173479903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e5e4d0 0x5613ea220180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e7e59c640 1 -- 172.21.15.53:0/2173479903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e5e4d0 msgr2=0x5613ea220180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/2173479903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e5e4d0 0x5613ea220180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e7e59c640 1 -- 172.21.15.53:0/2173479903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 msgr2=0x5613ea2206c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/2173479903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 0x5613ea2206c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e7e59c640 1 -- 172.21.15.53:0/2173479903 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ea225010 con 0x5613e9e562f0 2024-08-31T06:28:46.212 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/2173479903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea22e200 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7e7002aa00 tx=0x7f7e7003c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef21fd7c848dc2ea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:46.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.209+0000 7f7e67fff640 1 -- 172.21.15.53:0/2173479903 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70035040 con 0x5613e9e562f0 2024-08-31T06:28:46.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.210+0000 7f7e67fff640 1 -- 172.21.15.53:0/2173479903 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e7003cc40 con 0x5613e9e562f0 2024-08-31T06:28:46.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.210+0000 7f7e67fff640 1 -- 172.21.15.53:0/2173479903 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70051460 con 0x5613e9e562f0 2024-08-31T06:28:46.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.210+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2173479903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 msgr2=0x5613ea22e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:46.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.210+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2173479903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea22e200 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7e7002aa00 tx=0x7f7e7003c9d0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2173479903 shutdown_connections 2024-08-31T06:28:46.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2173479903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 0x5613ea2206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2173479903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e5e4d0 0x5613ea220180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/2173479903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e562f0 0x5613ea22e200 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2173479903 >> 172.21.15.53:0/2173479903 conn(0x5613e9e73300 msgr2=0x5613ea22daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2173479903 shutdown_connections 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 -- 172.21.15.53:0/2173479903 wait complete. 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 -- start start 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 Processor -- start 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e562f0 0x5613ea231850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e5e4d0 0x5613ea231d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.211+0000 7f7e8be5e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 0x5613ea2322d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e8be5e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6000fd30 con 0x5613e9e7f1b0 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e8be5e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6000f660 con 0x5613e9e5e4d0 2024-08-31T06:28:46.217 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e8be5e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6000c890 con 0x5613e9e562f0 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 0x5613ea2322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7dd9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e5e4d0 0x5613ea231d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 0x5613ea2322d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46184/0 (socket says 172.21.15.53:46184) 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7ed9d640 1 -- 172.21.15.53:0/217985302 learned_addr learned my addr 172.21.15.53:0/217985302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e562f0 0x5613ea231850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e8be5e740 10 client.0 _ll_register_callbacks cb 0x7f7e7400cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7ed9d640 1 -- 172.21.15.53:0/217985302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e562f0 msgr2=0x5613ea231850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7ed9d640 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e562f0 0x5613ea231850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7ed9d640 1 -- 172.21.15.53:0/217985302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e5e4d0 msgr2=0x5613ea231d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7ed9d640 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e5e4d0 0x5613ea231d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7ed9d640 1 -- 172.21.15.53:0/217985302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ea2a9480 con 0x5613e9e7f1b0 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7dd9b640 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e5e4d0 0x5613ea231d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e7ed9d640 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 0x5613ea2322d0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f7e78022710 tx=0x7f7e78004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54ce1593f8cb788 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.212+0000 7f7e65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.213+0000 7f7e65ffb640 1 -- 172.21.15.53:0/217985302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78034020 con 0x5613e9e7f1b0 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.213+0000 7f7e65ffb640 1 -- 172.21.15.53:0/217985302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f7e78009040 con 0x5613e9e7f1b0 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.213+0000 7f7e8be5e740 1 -- 172.21.15.53:0/217985302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e7003cc40 con 0x5613e9e7f1b0 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.213+0000 7f7e65ffb640 1 -- 172.21.15.53:0/217985302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f7e7803f050 con 0x5613e9e7f1b0 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.213+0000 7f7e8be5e740 10 client.22701 fetch_fsmap learned FSMap version 87 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.213+0000 7f7e8be5e740 1 -- 172.21.15.53:0/217985302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) -- 0x5613ea2aa750 con 0x5613e9e7f1b0 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.213+0000 7f7e65ffb640 1 -- 172.21.15.53:0/217985302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e7003cc40 con 0x5613e9e7f1b0 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.214+0000 7f7e65ffb640 1 -- 172.21.15.53:0/217985302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 87) ==== 8366+0+0 (secure 0 0 0) 0x7f7e78030840 con 0x5613e9e7f1b0 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.214+0000 7f7e8be5e740 10 client.22701 fetch_fsmap finished waiting for FSMap version 87 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.214+0000 7f7e8be5e740 10 client.22701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.214+0000 7f7e8be5e740 20 client.22701 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:46.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.214+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5613e9e131c0 0x5613ea2acf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:46.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.214+0000 7f7e8be5e740 4 client.22701 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:28:46.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.214+0000 7f7e8be5e740 1 -- 172.21.15.53:0/217985302 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5613ea1959f0 con 0x5613e9e131c0 2024-08-31T06:28:46.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.214+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5613e9e131c0 0x5613ea2acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:46.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.214+0000 7f7e65ffb640 10 client.22701 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:46.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.214+0000 7f7e7e59c640 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5613e9e131c0 0x5613ea2acf70 crc :-1 s=READY pgs=557 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c943d4c4637f6d3d server_cookie=b80cb953b686585 in_seq=0 out_seq=0 2024-08-31T06:28:46.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:45 smithi053 ceph-mon[18924]: pgmap v1073: 97 pgs: 97 active+clean; 1011 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 371 op/s 2024-08-31T06:28:46.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:45 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.338+0000 7f7e65ffb640 1 -- 172.21.15.53:0/217985302 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5613ea1959f0 con 0x5613e9e131c0 2024-08-31T06:28:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.338+0000 7f7e65ffb640 10 client.22701 handle_command_reply: tid=0 2024-08-31T06:28:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.338+0000 7f7e8be5e740 1 client.22701 shutdown 2024-08-31T06:28:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.339+0000 7f7e8be5e740 1 -- 172.21.15.53:0/217985302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 msgr2=0x5613ea2322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.339+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 0x5613ea2322d0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f7e78022710 tx=0x7f7e78004ab0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.339+0000 7f7e8be5e740 1 -- 172.21.15.53:0/217985302 shutdown_connections 2024-08-31T06:28:46.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.339+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5613e9e131c0 0x5613ea2acf70 crc :-1 s=READY pgs=557 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.339+0000 7f7e65ffb640 0 client.22701 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:46.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.339+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613e9e7f1b0 0x5613ea2322d0 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.339+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5613e9e5e4d0 0x5613ea231d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.339+0000 7f7e8be5e740 1 --2- 172.21.15.53:0/217985302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5613e9e562f0 0x5613ea231850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.339+0000 7f7e8be5e740 1 -- 172.21.15.53:0/217985302 >> 172.21.15.53:0/217985302 conn(0x5613e9e73300 msgr2=0x5613ea22fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:46.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.340+0000 7f7e8be5e740 1 -- 172.21.15.53:0/217985302 shutdown_connections 2024-08-31T06:28:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.340+0000 7f7e8be5e740 1 -- 172.21.15.53:0/217985302 wait complete. 2024-08-31T06:28:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.340+0000 7f7e8be5e740 20 client.22701 trim_cache size 0 max 16384 2024-08-31T06:28:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:28:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:28:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:28:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:28:46.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.340+0000 7f7e84ef2640 1 -- 172.21.15.53:0/1948307528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4ca0 msgr2=0x7f7e680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:46.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.340+0000 7f7e84ef2640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4ca0 0x7f7e680b71b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7e78005fd0 tx=0x7f7e78018040 comp rx=0 tx=0).stop 2024-08-31T06:28:46.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.340+0000 7f7e84ef2640 1 -- 172.21.15.53:0/1948307528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e801092e0 msgr2=0x7f7e8019a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:46.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.340+0000 7f7e84ef2640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e801092e0 0x7f7e8019a8d0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f7e74012f30 tx=0x7f7e7400c760 comp rx=0 tx=0).stop 2024-08-31T06:28:46.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.341+0000 7f7e84ef2640 1 -- 172.21.15.53:0/1948307528 shutdown_connections 2024-08-31T06:28:46.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.341+0000 7f7e84ef2640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7e680b4ca0 0x7f7e680b71b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.341+0000 7f7e84ef2640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e80109c30 0x7f7e8019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.341+0000 7f7e84ef2640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e801092e0 0x7f7e8019a8d0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.341+0000 7f7e84ef2640 1 --2- 172.21.15.53:0/1948307528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e80101e00 0x7f7e8019a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:46.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.341+0000 7f7e84ef2640 1 -- 172.21.15.53:0/1948307528 >> 172.21.15.53:0/1948307528 conn(0x7f7e80079c30 msgr2=0x7f7e80107480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:46.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.341+0000 7f7e84ef2640 1 -- 172.21.15.53:0/1948307528 shutdown_connections 2024-08-31T06:28:46.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:46.341+0000 7f7e84ef2640 1 -- 172.21.15.53:0/1948307528 wait complete. 2024-08-31T06:28:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:45 smithi130 ceph-mon[22266]: pgmap v1073: 97 pgs: 97 active+clean; 1011 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 371 op/s 2024-08-31T06:28:46.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:45 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:28:46.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 65784 5.41 MB/sec execute 514 sec latency 109.549 ms 2024-08-31T06:28:47.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 65925 5.42 MB/sec execute 515 sec latency 83.551 ms 2024-08-31T06:28:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:47 smithi153 ceph-mon[22320]: pgmap v1074: 97 pgs: 97 active+clean; 1016 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 323 op/s 2024-08-31T06:28:48.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:47 smithi053 ceph-mon[18924]: pgmap v1074: 97 pgs: 97 active+clean; 1016 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 323 op/s 2024-08-31T06:28:48.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:47 smithi130 ceph-mon[22266]: pgmap v1074: 97 pgs: 97 active+clean; 1016 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 323 op/s 2024-08-31T06:28:48.403 INFO:tasks.workunit.client.0.smithi053.stdout: 10 66043 5.42 MB/sec execute 516 sec latency 327.532 ms 2024-08-31T06:28:49.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 66172 5.42 MB/sec execute 517 sec latency 93.724 ms 2024-08-31T06:28:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:49 smithi153 ceph-mon[22320]: pgmap v1075: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 348 op/s 2024-08-31T06:28:50.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:49 smithi053 ceph-mon[18924]: pgmap v1075: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 348 op/s 2024-08-31T06:28:50.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:49 smithi130 ceph-mon[22266]: pgmap v1075: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 348 op/s 2024-08-31T06:28:50.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 66323 5.42 MB/sec execute 518 sec latency 325.264 ms 2024-08-31T06:28:51.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 66494 5.42 MB/sec execute 519 sec latency 86.006 ms 2024-08-31T06:28:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:51 smithi153 ceph-mon[22320]: pgmap v1076: 97 pgs: 97 active+clean; 1022 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.7 MiB/s wr, 348 op/s 2024-08-31T06:28:52.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:51 smithi053 ceph-mon[18924]: pgmap v1076: 97 pgs: 97 active+clean; 1022 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.7 MiB/s wr, 348 op/s 2024-08-31T06:28:52.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:51 smithi130 ceph-mon[22266]: pgmap v1076: 97 pgs: 97 active+clean; 1022 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.7 MiB/s wr, 348 op/s 2024-08-31T06:28:52.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 66649 5.42 MB/sec execute 520 sec latency 60.851 ms 2024-08-31T06:28:53.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 66807 5.43 MB/sec execute 521 sec latency 52.543 ms 2024-08-31T06:28:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:53 smithi153 ceph-mon[22320]: pgmap v1077: 97 pgs: 97 active+clean; 1022 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 311 op/s 2024-08-31T06:28:54.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:53 smithi053 ceph-mon[18924]: pgmap v1077: 97 pgs: 97 active+clean; 1022 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 311 op/s 2024-08-31T06:28:54.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:53 smithi130 ceph-mon[22266]: pgmap v1077: 97 pgs: 97 active+clean; 1022 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 311 op/s 2024-08-31T06:28:54.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 66986 5.45 MB/sec execute 522 sec latency 78.594 ms 2024-08-31T06:28:55.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 67175 5.46 MB/sec execute 523 sec latency 65.791 ms 2024-08-31T06:28:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:55 smithi153 ceph-mon[22320]: pgmap v1078: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 368 op/s 2024-08-31T06:28:56.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:55 smithi053 ceph-mon[18924]: pgmap v1078: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 368 op/s 2024-08-31T06:28:56.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:55 smithi130 ceph-mon[22266]: pgmap v1078: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 368 op/s 2024-08-31T06:28:56.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 67351 5.47 MB/sec execute 524 sec latency 81.290 ms 2024-08-31T06:28:57.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 67482 5.47 MB/sec execute 525 sec latency 78.325 ms 2024-08-31T06:28:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:57 smithi153 ceph-mon[22320]: pgmap v1079: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 351 op/s 2024-08-31T06:28:58.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:57 smithi053 ceph-mon[18924]: pgmap v1079: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 351 op/s 2024-08-31T06:28:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:57 smithi130 ceph-mon[22266]: pgmap v1079: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 351 op/s 2024-08-31T06:28:58.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 67624 5.47 MB/sec execute 526 sec latency 249.168 ms 2024-08-31T06:28:59.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 67787 5.48 MB/sec execute 527 sec latency 208.915 ms 2024-08-31T06:28:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.496+0000 7f03cc87e640 1 -- 172.21.15.53:0/3234705792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c8101e00 msgr2=0x7f03c8102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.496+0000 7f03cc87e640 1 --2- 172.21.15.53:0/3234705792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c8101e00 0x7f03c8102210 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009900 tx=0x7f03b802a410 comp rx=0 tx=0).stop 2024-08-31T06:28:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.496+0000 7f03cc87e640 1 -- 172.21.15.53:0/3234705792 shutdown_connections 2024-08-31T06:28:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.496+0000 7f03cc87e640 1 --2- 172.21.15.53:0/3234705792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c8109b20 0x7f03c8110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.496+0000 7f03cc87e640 1 --2- 172.21.15.53:0/3234705792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c81091d0 0x7f03c81095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.496+0000 7f03cc87e640 1 --2- 172.21.15.53:0/3234705792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c8101e00 0x7f03c8102210 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.496+0000 7f03cc87e640 1 -- 172.21.15.53:0/3234705792 >> 172.21.15.53:0/3234705792 conn(0x7f03c8079c30 msgr2=0x7f03c807a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.496+0000 7f03cc87e640 1 -- 172.21.15.53:0/3234705792 shutdown_connections 2024-08-31T06:28:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.496+0000 7f03cc87e640 1 -- 172.21.15.53:0/3234705792 wait complete. 2024-08-31T06:28:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03cc87e640 1 Processor -- start 2024-08-31T06:28:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03cc87e640 1 -- start start 2024-08-31T06:28:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03cc87e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c8101e00 0x7f03c819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03cc87e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c81091d0 0x7f03c819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03cc87e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8109b20 0x7f03c819f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03cc87e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f03c8113670 con 0x7f03c81091d0 2024-08-31T06:28:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03cc87e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f03c81134f0 con 0x7f03c8101e00 2024-08-31T06:28:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03cc87e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f03c81137f0 con 0x7f03c8109b20 2024-08-31T06:28:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03c5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c81091d0 0x7f03c819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03c659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c8101e00 0x7f03c819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03c5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c81091d0 0x7f03c819a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38656/0 (socket says 172.21.15.53:38656) 2024-08-31T06:28:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03c5d9b640 1 -- 172.21.15.53:0/399950683 learned_addr learned my addr 172.21.15.53:0/399950683 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.497+0000 7f03c6d9d640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8109b20 0x7f03c819f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03c659c640 1 -- 172.21.15.53:0/399950683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8109b20 msgr2=0x7f03c819f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03c659c640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8109b20 0x7f03c819f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03c659c640 1 -- 172.21.15.53:0/399950683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c81091d0 msgr2=0x7f03c819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03c659c640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c81091d0 0x7f03c819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03c659c640 1 -- 172.21.15.53:0/399950683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c81a0060 con 0x7f03c8101e00 2024-08-31T06:28:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c81091d0 0x7f03c819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03c659c640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c8101e00 0x7f03c819a130 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f03b8005940 tx=0x7f03b8005e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03b77fe640 1 -- 172.21.15.53:0/399950683 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b803f070 con 0x7f03c8101e00 2024-08-31T06:28:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03cc87e640 1 -- 172.21.15.53:0/399950683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c81a02f0 con 0x7f03c8101e00 2024-08-31T06:28:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03cc87e640 1 -- 172.21.15.53:0/399950683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c81a6ae0 con 0x7f03c8101e00 2024-08-31T06:28:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03b77fe640 1 -- 172.21.15.53:0/399950683 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03b8003a80 con 0x7f03c8101e00 2024-08-31T06:28:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.498+0000 7f03b77fe640 1 -- 172.21.15.53:0/399950683 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b8035070 con 0x7f03c8101e00 2024-08-31T06:28:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.501+0000 7f03d37e5740 1 Processor -- start 2024-08-31T06:28:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.501+0000 7f03d37e5740 1 -- start start 2024-08-31T06:28:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03b77fe640 1 -- 172.21.15.53:0/399950683 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f03b8043400 con 0x7f03c8101e00 2024-08-31T06:28:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f1eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b522f0 0x55ec87f1f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03c659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b522f0 0x55ec87f1f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03c659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b522f0 0x55ec87f1f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38666/0 (socket says 172.21.15.53:38666) 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03c6d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f1eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03c6d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f1eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52246/0 (socket says 172.21.15.53:52246) 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b5a4d0 0x55ec87f1f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03c659c640 1 -- 172.21.15.53:0/4055225170 learned_addr learned my addr 172.21.15.53:0/4055225170 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03d37e5740 1 -- 172.21.15.53:0/4055225170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ec87e94000 con 0x55ec87b522f0 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03d37e5740 1 -- 172.21.15.53:0/4055225170 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec87e83590 con 0x55ec87b7b1b0 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.502+0000 7f03d37e5740 1 -- 172.21.15.53:0/4055225170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ec87e87540 con 0x55ec87b5a4d0 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.503+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/4055225170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b5a4d0 0x55ec87f1f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.503+0000 7f03c659c640 1 -- 172.21.15.53:0/4055225170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b5a4d0 msgr2=0x55ec87f1f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.503+0000 7f03c659c640 1 --2- 172.21.15.53:0/4055225170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b5a4d0 0x55ec87f1f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.503+0000 7f03c659c640 1 -- 172.21.15.53:0/4055225170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 msgr2=0x55ec87f1eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:59.508 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.503+0000 7f03c659c640 1 --2- 172.21.15.53:0/4055225170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f1eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.503+0000 7f03c659c640 1 -- 172.21.15.53:0/4055225170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec87be6790 con 0x55ec87b522f0 2024-08-31T06:28:59.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.503+0000 7f03b77fe640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03b00b4d20 0x7f03b00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.503+0000 7f03c6d9d640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03b00b4d20 0x7f03b00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.503+0000 7f03c659c640 1 --2- 172.21.15.53:0/4055225170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b522f0 0x55ec87f1f000 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f03b8102c60 tx=0x7f03b810bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a78c580b435517 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:59.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.503+0000 7f03b4ff9640 1 -- 172.21.15.53:0/4055225170 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b80c7c30 con 0x55ec87b522f0 2024-08-31T06:28:59.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.504+0000 7f03b4ff9640 1 -- 172.21.15.53:0/4055225170 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03b80cb880 con 0x55ec87b522f0 2024-08-31T06:28:59.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.504+0000 7f03b4ff9640 1 -- 172.21.15.53:0/4055225170 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b80933a0 con 0x55ec87b522f0 2024-08-31T06:28:59.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.504+0000 7f03c6d9d640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03b00b4d20 0x7f03b00b7230 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f03c0005fd0 tx=0x7f03c0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:59.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.504+0000 7f03b77fe640 1 -- 172.21.15.53:0/399950683 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f03b8105650 con 0x7f03c8101e00 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.505+0000 7f03d37e5740 1 -- 172.21.15.53:0/4055225170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b522f0 msgr2=0x55ec87f1f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.505+0000 7f03d37e5740 1 --2- 172.21.15.53:0/4055225170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b522f0 0x55ec87f1f000 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f03b8102c60 tx=0x7f03b810bcb0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.505+0000 7f03d37e5740 1 -- 172.21.15.53:0/4055225170 shutdown_connections 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.505+0000 7f03d37e5740 1 --2- 172.21.15.53:0/4055225170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b5a4d0 0x55ec87f1f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.505+0000 7f03d37e5740 1 --2- 172.21.15.53:0/4055225170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b522f0 0x55ec87f1f000 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.505+0000 7f03d37e5740 1 --2- 172.21.15.53:0/4055225170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f1eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.505+0000 7f03d37e5740 1 -- 172.21.15.53:0/4055225170 >> 172.21.15.53:0/4055225170 conn(0x55ec87b6f300 msgr2=0x55ec87f1c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.505+0000 7f03d37e5740 1 -- 172.21.15.53:0/4055225170 shutdown_connections 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.505+0000 7f03d37e5740 1 -- 172.21.15.53:0/4055225170 wait complete. 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.506+0000 7f03d37e5740 1 -- start start 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.506+0000 7f03d37e5740 1 Processor -- start 2024-08-31T06:28:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.506+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 0x55ec87f2a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.506+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f2ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.506+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f36260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.506+0000 7f03d37e5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ec87dbcab0 con 0x55ec87b5a4d0 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03d37e5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec87e0a680 con 0x55ec87b7b1b0 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03d37e5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ec87f2d000 con 0x55ec87b522f0 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f2ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03d37e5740 10 client.0 _ll_register_callbacks cb 0x55ec87b92a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f2ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38676/0 (socket says 172.21.15.53:38676) 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c5d9b640 1 -- 172.21.15.53:0/228526227 learned_addr learned my addr 172.21.15.53:0/228526227 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c6d9d640 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f36260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c659c640 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 0x55ec87f2a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c5d9b640 1 -- 172.21.15.53:0/228526227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 msgr2=0x55ec87f2a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 0x55ec87f2a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c5d9b640 1 -- 172.21.15.53:0/228526227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 msgr2=0x55ec87f36260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f36260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c5d9b640 1 -- 172.21.15.53:0/228526227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec87c5f620 con 0x55ec87b5a4d0 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c6d9d640 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f36260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f2ab80 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f03bc012cf0 tx=0x7f03bc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e7809369b86966 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03adffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03adffb640 1 -- 172.21.15.53:0/228526227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0120d0 con 0x55ec87b5a4d0 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.507+0000 7f03adffb640 1 -- 172.21.15.53:0/228526227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f03bc010430 con 0x55ec87b5a4d0 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03d37e5740 1 -- 172.21.15.53:0/228526227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03b80cb880 con 0x55ec87b5a4d0 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03adffb640 1 -- 172.21.15.53:0/228526227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f03bc012270 con 0x55ec87b5a4d0 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03d37e5740 10 client.22713 fetch_fsmap learned FSMap version 87 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03d37e5740 1 -- 172.21.15.53:0/228526227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) -- 0x55ec87f38fa0 con 0x55ec87b5a4d0 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03adffb640 1 -- 172.21.15.53:0/228526227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03b80cb880 con 0x55ec87b5a4d0 2024-08-31T06:28:59.516 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03adffb640 1 -- 172.21.15.53:0/228526227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 87) ==== 8366+0+0 (secure 0 0 0) 0x7f03bc026700 con 0x55ec87b5a4d0 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03d37e5740 10 client.22713 fetch_fsmap finished waiting for FSMap version 87 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03d37e5740 10 client.22713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03d37e5740 20 client.22713 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03d37e5740 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ec87b39d80 0x55ec87f3c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03d37e5740 4 client.22713 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.508+0000 7f03d37e5740 1 -- 172.21.15.53:0/228526227 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec87e95f50 con 0x55ec87b39d80 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.509+0000 7f03c659c640 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ec87b39d80 0x55ec87f3c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.509+0000 7f03adffb640 10 client.22713 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.509+0000 7f03c659c640 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ec87b39d80 0x55ec87f3c490 crc :-1 s=READY pgs=558 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e771fb503aa9349 server_cookie=29849e13dd3a9bab in_seq=0 out_seq=0 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03adffb640 1 -- 172.21.15.53:0/228526227 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec87e95f50 con 0x55ec87b39d80 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03adffb640 10 client.22713 handle_command_reply: tid=0 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03d37e5740 1 client.22713 shutdown 2024-08-31T06:28:59.517 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03d37e5740 1 -- 172.21.15.53:0/228526227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 msgr2=0x55ec87f2ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03d37e5740 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f2ab80 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f03bc012cf0 tx=0x7f03bc00f790 comp rx=0 tx=0).stop 2024-08-31T06:28:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03d37e5740 1 -- 172.21.15.53:0/228526227 shutdown_connections 2024-08-31T06:28:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03d37e5740 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ec87b39d80 0x55ec87f3c490 crc :-1 s=READY pgs=558 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03d37e5740 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f36260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03d37e5740 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f2ab80 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03d37e5740 1 --2- 172.21.15.53:0/228526227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 0x55ec87f2a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03d37e5740 1 -- 172.21.15.53:0/228526227 >> 172.21.15.53:0/228526227 conn(0x55ec87b6f300 msgr2=0x55ec87f1faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03adffb640 0 client.22713 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.510+0000 7f03d37e5740 1 -- 172.21.15.53:0/228526227 shutdown_connections 2024-08-31T06:28:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.511+0000 7f03d37e5740 1 -- 172.21.15.53:0/228526227 wait complete. 2024-08-31T06:28:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.511+0000 7f03d37e5740 20 client.22713 trim_cache size 0 max 16384 2024-08-31T06:28:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.538+0000 7f03d37e5740 1 Processor -- start 2024-08-31T06:28:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.538+0000 7f03d37e5740 1 -- start start 2024-08-31T06:28:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b522f0 0x55ec87f28c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f291d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b7b1b0 0x55ec87f23b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03d37e5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f03c81ad370 con 0x55ec87b5a4d0 2024-08-31T06:28:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03d37e5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f03c81aeee0 con 0x55ec87b522f0 2024-08-31T06:28:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03d37e5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f03c81ada40 con 0x55ec87b7b1b0 2024-08-31T06:28:59.543 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03c5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f291d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03c5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f291d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38688/0 (socket says 172.21.15.53:38688) 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03c5d9b640 1 -- 172.21.15.53:0/3088968082 learned_addr learned my addr 172.21.15.53:0/3088968082 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03c6d9d640 1 --2- 172.21.15.53:0/3088968082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b7b1b0 0x55ec87f23b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03c659c640 1 --2- 172.21.15.53:0/3088968082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b522f0 0x55ec87f28c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03c5d9b640 1 -- 172.21.15.53:0/3088968082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b7b1b0 msgr2=0x55ec87f23b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/3088968082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b7b1b0 0x55ec87f23b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03c5d9b640 1 -- 172.21.15.53:0/3088968082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b522f0 msgr2=0x55ec87f28c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/3088968082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b522f0 0x55ec87f28c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.539+0000 7f03c5d9b640 1 -- 172.21.15.53:0/3088968082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec87f20ff0 con 0x55ec87b5a4d0 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.540+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/3088968082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f291d0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f03bc026b20 tx=0x7f03bc009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e594ecf79265ddb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.540+0000 7f03affff640 1 -- 172.21.15.53:0/3088968082 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc02b030 con 0x55ec87b5a4d0 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.540+0000 7f03affff640 1 -- 172.21.15.53:0/3088968082 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03bc026900 con 0x55ec87b5a4d0 2024-08-31T06:28:59.544 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.540+0000 7f03affff640 1 -- 172.21.15.53:0/3088968082 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0035f0 con 0x55ec87b5a4d0 2024-08-31T06:28:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.541+0000 7f03d37e5740 1 -- 172.21.15.53:0/3088968082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 msgr2=0x55ec87f291d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.541+0000 7f03d37e5740 1 --2- 172.21.15.53:0/3088968082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f291d0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f03bc026b20 tx=0x7f03bc009240 comp rx=0 tx=0).stop 2024-08-31T06:28:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.541+0000 7f03d37e5740 1 -- 172.21.15.53:0/3088968082 shutdown_connections 2024-08-31T06:28:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.541+0000 7f03d37e5740 1 --2- 172.21.15.53:0/3088968082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b7b1b0 0x55ec87f23b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.541+0000 7f03d37e5740 1 --2- 172.21.15.53:0/3088968082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b5a4d0 0x55ec87f291d0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.541+0000 7f03d37e5740 1 --2- 172.21.15.53:0/3088968082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b522f0 0x55ec87f28c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.541+0000 7f03d37e5740 1 -- 172.21.15.53:0/3088968082 >> 172.21.15.53:0/3088968082 conn(0x55ec87b6f300 msgr2=0x55ec87f255a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.541+0000 7f03d37e5740 1 -- 172.21.15.53:0/3088968082 shutdown_connections 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.542+0000 7f03d37e5740 1 -- 172.21.15.53:0/3088968082 wait complete. 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.542+0000 7f03d37e5740 1 -- start start 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.542+0000 7f03d37e5740 1 Processor -- start 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 0x55ec87f32650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f2db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03d37e5740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b0f1c0 0x55ec87f2e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03d37e5740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f03c81ae810 con 0x55ec87b0f1c0 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03d37e5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f03c81ae140 con 0x55ec87b7b1b0 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03d37e5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f03c81ab370 con 0x55ec87b522f0 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03c659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 0x55ec87f32650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03d37e5740 10 client.0 _ll_register_callbacks cb 0x7f03bc012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03c659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 0x55ec87f32650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:33832/0 (socket says 172.21.15.53:33832) 2024-08-31T06:28:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03c659c640 1 -- 172.21.15.53:0/2826414664 learned_addr learned my addr 172.21.15.53:0/2826414664 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f2db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03c6d9d640 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b0f1c0 0x55ec87f2e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03c5d9b640 1 -- 172.21.15.53:0/2826414664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 msgr2=0x55ec87f32650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 0x55ec87f32650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.543+0000 7f03c5d9b640 1 -- 172.21.15.53:0/2826414664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b0f1c0 msgr2=0x55ec87f2e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.544+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b0f1c0 0x55ec87f2e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.544+0000 7f03c5d9b640 1 -- 172.21.15.53:0/2826414664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec87f2e5c0 con 0x55ec87b7b1b0 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.544+0000 7f03c659c640 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 0x55ec87f32650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.544+0000 7f03c6d9d640 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b0f1c0 0x55ec87f2e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.544+0000 7f03c5d9b640 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f2db40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55ec87f24ec0 tx=0x7f03bc0266a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da7591564f5eb714 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.544+0000 7f03adffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.544+0000 7f03adffb640 1 -- 172.21.15.53:0/2826414664 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc003800 con 0x55ec87b7b1b0 2024-08-31T06:28:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.544+0000 7f03adffb640 1 -- 172.21.15.53:0/2826414664 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f03bc018040 con 0x55ec87b7b1b0 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.544+0000 7f03d37e5740 1 -- 172.21.15.53:0/2826414664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03bc026900 con 0x55ec87b7b1b0 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03adffb640 1 -- 172.21.15.53:0/2826414664 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f03bc03d050 con 0x55ec87b7b1b0 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03d37e5740 10 client.31361 fetch_fsmap learned FSMap version 87 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03d37e5740 1 -- 172.21.15.53:0/2826414664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) -- 0x55ec87fa6ac0 con 0x55ec87b7b1b0 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03adffb640 1 -- 172.21.15.53:0/2826414664 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03bc026900 con 0x55ec87b7b1b0 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03adffb640 1 -- 172.21.15.53:0/2826414664 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 87) ==== 8366+0+0 (secure 0 0 0) 0x7f03bc010430 con 0x55ec87b7b1b0 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03d37e5740 10 client.31361 fetch_fsmap finished waiting for FSMap version 87 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03d37e5740 10 client.31361 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03d37e5740 20 client.31361 populate_metadata read hostname 'smithi053' 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03d37e5740 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ec87fa7110 0x55ec87fa9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03d37e5740 4 client.31361 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03d37e5740 1 -- 172.21.15.53:0/2826414664 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ec87e919f0 con 0x55ec87fa7110 2024-08-31T06:28:59.551 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.545+0000 7f03c659c640 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ec87fa7110 0x55ec87fa9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:28:59.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.546+0000 7f03adffb640 10 client.31361 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:59.552 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.546+0000 7f03c659c640 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ec87fa7110 0x55ec87fa9530 crc :-1 s=READY pgs=559 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73205a7b55a91889 server_cookie=8c0226031214e106 in_seq=0 out_seq=0 2024-08-31T06:28:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.664+0000 7f03adffb640 1 -- 172.21.15.53:0/2826414664 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ec87e919f0 con 0x55ec87fa7110 2024-08-31T06:28:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.664+0000 7f03adffb640 10 client.31361 handle_command_reply: tid=0 2024-08-31T06:28:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.664+0000 7f03d37e5740 1 client.31361 shutdown 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03d37e5740 1 -- 172.21.15.53:0/2826414664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 msgr2=0x55ec87f2db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03d37e5740 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f2db40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55ec87f24ec0 tx=0x7f03bc0266a0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03d37e5740 1 -- 172.21.15.53:0/2826414664 shutdown_connections 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03d37e5740 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ec87fa7110 0x55ec87fa9530 crc :-1 s=READY pgs=559 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03adffb640 0 client.31361 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03d37e5740 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec87b0f1c0 0x55ec87f2e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03d37e5740 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec87b7b1b0 0x55ec87f2db40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03d37e5740 1 --2- 172.21.15.53:0/2826414664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ec87b522f0 0x55ec87f32650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03d37e5740 1 -- 172.21.15.53:0/2826414664 >> 172.21.15.53:0/2826414664 conn(0x55ec87b6f300 msgr2=0x55ec87f23b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03d37e5740 1 -- 172.21.15.53:0/2826414664 shutdown_connections 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03d37e5740 1 -- 172.21.15.53:0/2826414664 wait complete. 2024-08-31T06:28:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.665+0000 7f03d37e5740 20 client.31361 trim_cache size 0 max 16384 2024-08-31T06:28:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:28:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:28:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:28:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:28:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 -- 172.21.15.53:0/399950683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03b00b4d20 msgr2=0x7f03b00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03b00b4d20 0x7f03b00b7230 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f03c0005fd0 tx=0x7f03c0009500 comp rx=0 tx=0).stop 2024-08-31T06:28:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 -- 172.21.15.53:0/399950683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c8101e00 msgr2=0x7f03c819a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:28:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c8101e00 0x7f03c819a130 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f03b8005940 tx=0x7f03b8005e10 comp rx=0 tx=0).stop 2024-08-31T06:28:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 -- 172.21.15.53:0/399950683 shutdown_connections 2024-08-31T06:28:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f03b00b4d20 0x7f03b00b7230 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03c8109b20 0x7f03c819f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c81091d0 0x7f03c819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 --2- 172.21.15.53:0/399950683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03c8101e00 0x7f03c819a130 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:28:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 -- 172.21.15.53:0/399950683 >> 172.21.15.53:0/399950683 conn(0x7f03c8079c30 msgr2=0x7f03c8107370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:28:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 -- 172.21.15.53:0/399950683 shutdown_connections 2024-08-31T06:28:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:28:59.666+0000 7f03cc87e640 1 -- 172.21.15.53:0/399950683 wait complete. 2024-08-31T06:29:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:28:59 smithi153 ceph-mon[22320]: pgmap v1080: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.6 MiB/s wr, 380 op/s 2024-08-31T06:29:00.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:28:59 smithi053 ceph-mon[18924]: pgmap v1080: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.6 MiB/s wr, 380 op/s 2024-08-31T06:29:00.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:28:59 smithi130 ceph-mon[22266]: pgmap v1080: 97 pgs: 97 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.6 MiB/s wr, 380 op/s 2024-08-31T06:29:00.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 67926 5.48 MB/sec execute 528 sec latency 106.305 ms 2024-08-31T06:29:01.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 67999 5.48 MB/sec execute 529 sec latency 484.925 ms 2024-08-31T06:29:02.068 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:29:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:01 smithi153 ceph-mon[22320]: pgmap v1081: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 334 op/s 2024-08-31T06:29:02.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:01 smithi053 ceph-mon[18924]: pgmap v1081: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 334 op/s 2024-08-31T06:29:02.343 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:01 smithi130 ceph-mon[22266]: pgmap v1081: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 334 op/s 2024-08-31T06:29:02.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 67999 5.47 MB/sec execute 530 sec latency 1484.961 ms 2024-08-31T06:29:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.871+0000 7f4355aac640 1 -- 172.21.15.53:0/1445875803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4350103900 msgr2=0x7f4350103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.871+0000 7f4355aac640 1 --2- 172.21.15.53:0/1445875803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4350103900 0x7f4350103d10 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f4340009900 tx=0x7f434002a410 comp rx=0 tx=0).stop 2024-08-31T06:29:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.871+0000 7f4355aac640 1 -- 172.21.15.53:0/1445875803 shutdown_connections 2024-08-31T06:29:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.871+0000 7f4355aac640 1 --2- 172.21.15.53:0/1445875803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4350109b90 0x7f43501103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.871+0000 7f4355aac640 1 --2- 172.21.15.53:0/1445875803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4350109240 0x7f4350109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.871+0000 7f4355aac640 1 --2- 172.21.15.53:0/1445875803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4350103900 0x7f4350103d10 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.871+0000 7f4355aac640 1 -- 172.21.15.53:0/1445875803 >> 172.21.15.53:0/1445875803 conn(0x7f435007b5f0 msgr2=0x7f435007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.871+0000 7f4355aac640 1 -- 172.21.15.53:0/1445875803 shutdown_connections 2024-08-31T06:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.871+0000 7f4355aac640 1 -- 172.21.15.53:0/1445875803 wait complete. 2024-08-31T06:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f4355aac640 1 Processor -- start 2024-08-31T06:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f4355aac640 1 -- start start 2024-08-31T06:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f4355aac640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4350103900 0x7f435019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f4355aac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4350109240 0x7f435019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f4355aac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4350109b90 0x7f435019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f4355aac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4350113700 con 0x7f4350109240 2024-08-31T06:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f4355aac640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4350113580 con 0x7f4350109b90 2024-08-31T06:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f4355aac640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4350113880 con 0x7f4350103900 2024-08-31T06:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f434effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4350109240 0x7f435019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f434effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4350109240 0x7f435019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38718/0 (socket says 172.21.15.53:38718) 2024-08-31T06:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f434effd640 1 -- 172.21.15.53:0/3750946317 learned_addr learned my addr 172.21.15.53:0/3750946317 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f434f7fe640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4350103900 0x7f435019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f434ffff640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4350109b90 0x7f435019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f434effd640 1 -- 172.21.15.53:0/3750946317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4350103900 msgr2=0x7f435019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f434effd640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4350103900 0x7f435019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f434effd640 1 -- 172.21.15.53:0/3750946317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4350109b90 msgr2=0x7f435019fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f434effd640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4350109b90 0x7f435019fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.872+0000 7f434effd640 1 -- 172.21.15.53:0/3750946317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43501a0160 con 0x7f4350109240 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.873+0000 7f434ffff640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4350109b90 0x7f435019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.873+0000 7f434effd640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4350109240 0x7f435019a790 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f434400e9f0 tx=0x7f434400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.873+0000 7f434cff9640 1 -- 172.21.15.53:0/3750946317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434400ccc0 con 0x7f4350109240 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.873+0000 7f4355aac640 1 -- 172.21.15.53:0/3750946317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43501a0450 con 0x7f4350109240 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.873+0000 7f434cff9640 1 -- 172.21.15.53:0/3750946317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43440108c0 con 0x7f4350109240 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.873+0000 7f434cff9640 1 -- 172.21.15.53:0/3750946317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344018660 con 0x7f4350109240 2024-08-31T06:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.873+0000 7f4355aac640 1 -- 172.21.15.53:0/3750946317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43501a6bb0 con 0x7f4350109240 2024-08-31T06:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f434cff9640 1 -- 172.21.15.53:0/3750946317 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4344010430 con 0x7f4350109240 2024-08-31T06:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f435c021740 1 Processor -- start 2024-08-31T06:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f435c021740 1 -- start start 2024-08-31T06:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f435c021740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f435c021740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf081b0 0x555fbe2d6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f435c021740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf10390 0x555fbe2d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f435c021740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555fbe24d630 con 0x555fbdf31070 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f435c021740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555fbe23cbc0 con 0x555fbdf10390 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f435c021740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555fbe240b70 con 0x555fbdf081b0 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f434ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f434ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2d62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38730/0 (socket says 172.21.15.53:38730) 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f434ffff640 1 -- 172.21.15.53:0/1049584649 learned_addr learned my addr 172.21.15.53:0/1049584649 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.876+0000 7f434effd640 1 --2- 172.21.15.53:0/1049584649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf10390 0x555fbe2d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f434f7fe640 1 --2- 172.21.15.53:0/1049584649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf081b0 0x555fbe2d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f434ffff640 1 -- 172.21.15.53:0/1049584649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf081b0 msgr2=0x555fbe2d6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f434ffff640 1 --2- 172.21.15.53:0/1049584649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf081b0 0x555fbe2d6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f434ffff640 1 -- 172.21.15.53:0/1049584649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf10390 msgr2=0x555fbe2d6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f434ffff640 1 --2- 172.21.15.53:0/1049584649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf10390 0x555fbe2d6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f434ffff640 1 -- 172.21.15.53:0/1049584649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fbdf9c650 con 0x555fbdf31070 2024-08-31T06:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f434cff9640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f43380b4ca0 0x7f43380b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f434ffff640 1 --2- 172.21.15.53:0/1049584649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2d62c0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f4348009ea0 tx=0x7f4348009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4573155df765d19 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:02.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f434f7fe640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f43380b4ca0 0x7f43380b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f434cff9640 1 -- 172.21.15.53:0/3750946317 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f43440e5ab0 con 0x7f4350109240 2024-08-31T06:29:02.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f4335ffb640 1 -- 172.21.15.53:0/1049584649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348016070 con 0x555fbdf31070 2024-08-31T06:29:02.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f4335ffb640 1 -- 172.21.15.53:0/1049584649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f434800ee80 con 0x555fbdf31070 2024-08-31T06:29:02.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.877+0000 7f4335ffb640 1 -- 172.21.15.53:0/1049584649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480116d0 con 0x555fbdf31070 2024-08-31T06:29:02.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.878+0000 7f435c021740 1 -- 172.21.15.53:0/1049584649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 msgr2=0x555fbe2d62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:02.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.878+0000 7f434f7fe640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f43380b4ca0 0x7f43380b71b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4340000c00 tx=0x7f43400058b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.878+0000 7f435c021740 1 --2- 172.21.15.53:0/1049584649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2d62c0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f4348009ea0 tx=0x7f4348009f90 comp rx=0 tx=0).stop 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.878+0000 7f435c021740 1 -- 172.21.15.53:0/1049584649 shutdown_connections 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.878+0000 7f435c021740 1 --2- 172.21.15.53:0/1049584649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf10390 0x555fbe2d6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.878+0000 7f435c021740 1 --2- 172.21.15.53:0/1049584649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf081b0 0x555fbe2d6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.878+0000 7f435c021740 1 --2- 172.21.15.53:0/1049584649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2d62c0 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.878+0000 7f435c021740 1 -- 172.21.15.53:0/1049584649 >> 172.21.15.53:0/1049584649 conn(0x555fbdf25460 msgr2=0x555fbe2d41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.878+0000 7f435c021740 1 -- 172.21.15.53:0/1049584649 shutdown_connections 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.878+0000 7f435c021740 1 -- 172.21.15.53:0/1049584649 wait complete. 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f435c021740 1 -- start start 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f435c021740 1 Processor -- start 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f435c021740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf081b0 0x555fbe2e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f435c021740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2e1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f435c021740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2edd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f435c021740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555fbe09f700 con 0x555fbdf31070 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f435c021740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555fbe1c3700 con 0x555fbdf081b0 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f435c021740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555fbe2e4aa0 con 0x555fbdf10390 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f435c021740 10 client.0 _ll_register_callbacks cb 0x555fbe1f2dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f434ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f434ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2edd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38740/0 (socket says 172.21.15.53:38740) 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f434ffff640 1 -- 172.21.15.53:0/2888309515 learned_addr learned my addr 172.21.15.53:0/2888309515 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f434effd640 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2e1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.879+0000 7f434f7fe640 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf081b0 0x555fbe2e1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f434ffff640 1 -- 172.21.15.53:0/2888309515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 msgr2=0x555fbe2e1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f434ffff640 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2e1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f434ffff640 1 -- 172.21.15.53:0/2888309515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf081b0 msgr2=0x555fbe2e1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:02.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f434ffff640 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf081b0 0x555fbe2e1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f434ffff640 1 -- 172.21.15.53:0/2888309515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fbe1fc8b0 con 0x555fbdf31070 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f434effd640 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2e1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f434ffff640 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2edd90 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f4348011bf0 tx=0x7f4348011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd423626d6dd0fb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f432effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f432effd640 1 -- 172.21.15.53:0/2888309515 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348028060 con 0x555fbdf31070 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f432effd640 1 -- 172.21.15.53:0/2888309515 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f4348023410 con 0x555fbdf31070 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f435c021740 1 -- 172.21.15.53:0/2888309515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555fbe24f580 con 0x555fbdf31070 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f432effd640 1 -- 172.21.15.53:0/2888309515 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f4348016040 con 0x555fbdf31070 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f435c021740 10 client.22731 fetch_fsmap learned FSMap version 87 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.880+0000 7f435c021740 1 -- 172.21.15.53:0/2888309515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) -- 0x555fbe2f0880 con 0x555fbdf31070 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.881+0000 7f432effd640 1 -- 172.21.15.53:0/2888309515 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555fbe24f580 con 0x555fbdf31070 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.881+0000 7f432effd640 1 -- 172.21.15.53:0/2888309515 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 87) ==== 8366+0+0 (secure 0 0 0) 0x7f434800f040 con 0x555fbdf31070 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.881+0000 7f435c021740 10 client.22731 fetch_fsmap finished waiting for FSMap version 87 2024-08-31T06:29:02.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.881+0000 7f435c021740 10 client.22731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.881+0000 7f435c021740 20 client.22731 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.881+0000 7f435c021740 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555fbdeef9f0 0x555fbe2f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.881+0000 7f435c021740 4 client.22731 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.881+0000 7f435c021740 1 -- 172.21.15.53:0/2888309515 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fbe24b020 con 0x555fbdeef9f0 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.881+0000 7f434f7fe640 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555fbdeef9f0 0x555fbe2f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.881+0000 7f432effd640 10 client.22731 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.881+0000 7f434f7fe640 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555fbdeef9f0 0x555fbe2f3cf0 crc :-1 s=READY pgs=560 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=717f18155811b361 server_cookie=67ce9e27bca9a0a4 in_seq=0 out_seq=0 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f432effd640 1 -- 172.21.15.53:0/2888309515 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555fbe24b020 con 0x555fbdeef9f0 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f432effd640 10 client.22731 handle_command_reply: tid=0 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f435c021740 1 client.22731 shutdown 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f435c021740 1 -- 172.21.15.53:0/2888309515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 msgr2=0x555fbe2edd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f435c021740 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2edd90 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f4348011bf0 tx=0x7f4348011c20 comp rx=0 tx=0).stop 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f435c021740 1 -- 172.21.15.53:0/2888309515 shutdown_connections 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f435c021740 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555fbdeef9f0 0x555fbe2f3cf0 crc :-1 s=READY pgs=560 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f435c021740 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2edd90 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f435c021740 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2e1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f435c021740 1 --2- 172.21.15.53:0/2888309515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf081b0 0x555fbe2e1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f435c021740 1 -- 172.21.15.53:0/2888309515 >> 172.21.15.53:0/2888309515 conn(0x555fbdf25460 msgr2=0x555fbe2d94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:02.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.882+0000 7f432effd640 0 client.22731 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:02.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.883+0000 7f435c021740 1 -- 172.21.15.53:0/2888309515 shutdown_connections 2024-08-31T06:29:02.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.883+0000 7f435c021740 1 -- 172.21.15.53:0/2888309515 wait complete. 2024-08-31T06:29:02.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.883+0000 7f435c021740 20 client.22731 trim_cache size 0 max 16384 2024-08-31T06:29:02.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.900+0000 7f435c021740 1 Processor -- start 2024-08-31T06:29:02.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.900+0000 7f435c021740 1 -- start start 2024-08-31T06:29:02.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.900+0000 7f435c021740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf081b0 0x555fbe2e3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.900+0000 7f435c021740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2edd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.900+0000 7f435c021740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2dec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.900+0000 7f435c021740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f43501af5e0 con 0x555fbdf31070 2024-08-31T06:29:02.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.900+0000 7f435c021740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f43501b1150 con 0x555fbdf081b0 2024-08-31T06:29:02.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.900+0000 7f435c021740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43501afcb0 con 0x555fbdf10390 2024-08-31T06:29:02.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2dec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38748/0 (socket says 172.21.15.53:38748) 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434ffff640 1 -- 172.21.15.53:0/888498148 learned_addr learned my addr 172.21.15.53:0/888498148 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434f7fe640 1 --2- 172.21.15.53:0/888498148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf081b0 0x555fbe2e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434effd640 1 --2- 172.21.15.53:0/888498148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434ffff640 1 -- 172.21.15.53:0/888498148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 msgr2=0x555fbe2edd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434ffff640 1 --2- 172.21.15.53:0/888498148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2edd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434ffff640 1 -- 172.21.15.53:0/888498148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf081b0 msgr2=0x555fbe2e3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434ffff640 1 --2- 172.21.15.53:0/888498148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf081b0 0x555fbe2e3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434ffff640 1 -- 172.21.15.53:0/888498148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fbe2d4db0 con 0x555fbdf31070 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434f7fe640 1 --2- 172.21.15.53:0/888498148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf081b0 0x555fbe2e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434effd640 1 --2- 172.21.15.53:0/888498148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f434ffff640 1 --2- 172.21.15.53:0/888498148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2dec40 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7f4348014040 tx=0x7f43480092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f29b1c7f8076f7d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.901+0000 7f43357fa640 1 -- 172.21.15.53:0/888498148 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348028050 con 0x555fbdf31070 2024-08-31T06:29:02.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.902+0000 7f43357fa640 1 -- 172.21.15.53:0/888498148 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43480117f0 con 0x555fbdf31070 2024-08-31T06:29:02.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.902+0000 7f43357fa640 1 -- 172.21.15.53:0/888498148 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434802c480 con 0x555fbdf31070 2024-08-31T06:29:02.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.902+0000 7f435c021740 1 -- 172.21.15.53:0/888498148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 msgr2=0x555fbe2dec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:02.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.902+0000 7f435c021740 1 --2- 172.21.15.53:0/888498148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2dec40 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7f4348014040 tx=0x7f43480092c0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.902+0000 7f435c021740 1 -- 172.21.15.53:0/888498148 shutdown_connections 2024-08-31T06:29:02.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 --2- 172.21.15.53:0/888498148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf31070 0x555fbe2dec40 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 --2- 172.21.15.53:0/888498148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 --2- 172.21.15.53:0/888498148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf081b0 0x555fbe2e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 -- 172.21.15.53:0/888498148 >> 172.21.15.53:0/888498148 conn(0x555fbdf25460 msgr2=0x555fbe2e2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:02.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 -- 172.21.15.53:0/888498148 shutdown_connections 2024-08-31T06:29:02.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 -- 172.21.15.53:0/888498148 wait complete. 2024-08-31T06:29:02.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 -- start start 2024-08-31T06:29:02.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 Processor -- start 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf081b0 0x555fbe2f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2f5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf31070 0x555fbe2f5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f43501b0a80 con 0x555fbdf081b0 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f43501b03b0 con 0x555fbdf31070 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43501ad5e0 con 0x555fbdf10390 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.903+0000 7f435c021740 10 client.0 _ll_register_callbacks cb 0x7f43440e94d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf081b0 0x555fbe2f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf081b0 0x555fbe2f4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38756/0 (socket says 172.21.15.53:38756) 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f434f7fe640 1 -- 172.21.15.53:0/1312549974 learned_addr learned my addr 172.21.15.53:0/1312549974 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f434ffff640 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf31070 0x555fbe2f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f434effd640 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f434f7fe640 1 -- 172.21.15.53:0/1312549974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 msgr2=0x555fbe2f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f434f7fe640 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f434f7fe640 1 -- 172.21.15.53:0/1312549974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf31070 msgr2=0x555fbe2f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f434f7fe640 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf31070 0x555fbe2f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f434f7fe640 1 -- 172.21.15.53:0/1312549974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fbe35d520 con 0x555fbdf081b0 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f434f7fe640 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf081b0 0x555fbe2f4dc0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f434002a930 tx=0x7f4340009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e773a3a11448e61 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f432effd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f432effd640 1 -- 172.21.15.53:0/1312549974 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340035050 con 0x555fbdf081b0 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f432effd640 1 -- 172.21.15.53:0/1312549974 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7f4340004450 con 0x555fbdf081b0 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f435c021740 1 -- 172.21.15.53:0/1312549974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43480117f0 con 0x555fbdf081b0 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f432effd640 1 -- 172.21.15.53:0/1312549974 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f434005e050 con 0x555fbdf081b0 2024-08-31T06:29:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.904+0000 7f435c021740 10 client.22737 fetch_fsmap learned FSMap version 87 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.905+0000 7f435c021740 1 -- 172.21.15.53:0/1312549974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) -- 0x555fbe35e7e0 con 0x555fbdf081b0 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.905+0000 7f432effd640 1 -- 172.21.15.53:0/1312549974 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43480117f0 con 0x555fbdf081b0 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.905+0000 7f432effd640 1 -- 172.21.15.53:0/1312549974 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 87) ==== 8366+0+0 (secure 0 0 0) 0x7f4340004a60 con 0x555fbdf081b0 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.905+0000 7f435c021740 10 client.22737 fetch_fsmap finished waiting for FSMap version 87 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.905+0000 7f435c021740 10 client.22737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.905+0000 7f435c021740 20 client.22737 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.905+0000 7f435c021740 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555fbdec4da0 0x555fbe360fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.905+0000 7f435c021740 4 client.22737 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.905+0000 7f435c021740 1 -- 172.21.15.53:0/1312549974 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555fbe248760 con 0x555fbdec4da0 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.905+0000 7f434effd640 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555fbdec4da0 0x555fbe360fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f434effd640 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555fbdec4da0 0x555fbe360fd0 crc :-1 s=READY pgs=561 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f5af3d85b130a5e server_cookie=eede35c6c1c3e608 in_seq=0 out_seq=0 2024-08-31T06:29:02.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f432effd640 10 client.22737 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:02.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f432effd640 1 -- 172.21.15.53:0/1312549974 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8326 (crc 0 0 0) 0x555fbe248760 con 0x555fbdec4da0 2024-08-31T06:29:02.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f432effd640 10 client.22737 handle_command_reply: tid=0 2024-08-31T06:29:02.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 1 client.22737 shutdown 2024-08-31T06:29:02.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 1 -- 172.21.15.53:0/1312549974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf081b0 msgr2=0x555fbe2f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:02.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf081b0 0x555fbe2f4dc0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f434002a930 tx=0x7f4340009260 comp rx=0 tx=0).stop 2024-08-31T06:29:02.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 1 -- 172.21.15.53:0/1312549974 shutdown_connections 2024-08-31T06:29:02.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x555fbdec4da0 0x555fbe360fd0 crc :-1 s=READY pgs=561 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555fbdf31070 0x555fbe2f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fbdf10390 0x555fbe2f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 1 --2- 172.21.15.53:0/1312549974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555fbdf081b0 0x555fbe2f4dc0 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 1 -- 172.21.15.53:0/1312549974 >> 172.21.15.53:0/1312549974 conn(0x555fbdf25460 msgr2=0x555fbe2e02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f432effd640 0 client.22737 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 1 -- 172.21.15.53:0/1312549974 shutdown_connections 2024-08-31T06:29:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 1 -- 172.21.15.53:0/1312549974 wait complete. 2024-08-31T06:29:02.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.906+0000 7f435c021740 20 client.22737 trim_cache size 0 max 16384 2024-08-31T06:29:02.915 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:29:02.915 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "cac6d546-f1c8-4203-803b-7c8d84c48507": { 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:27:34.520218+0000", 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "e839581e-94c5-4714-a1a6-40730925f6b8": { 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:28:29.506188+0000", 2024-08-31T06:29:02.916 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.917 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.918 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.919 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:25:55.673122+0000", 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.920 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.921 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:29:02.922 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.924 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:29:02.924 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:29:02.924 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.924 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.924 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.924 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.924 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.924 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:29:02.924 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:29:02.924 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: "857f8219-039c-44d2-8dd7-af494d80e735": { 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:26:48.510100+0000", 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.925 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.926 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:29:02.927 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.930 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:29:02.931 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:02.933 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:29:02.933 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:29:02.933 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:02.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:02.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:02.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:02.933 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:02.933 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:02.933 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:02.934 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:29:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 -- 172.21.15.53:0/3750946317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f43380b4ca0 msgr2=0x7f43380b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f43380b4ca0 0x7f43380b71b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4340000c00 tx=0x7f43400058b0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 -- 172.21.15.53:0/3750946317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4350109240 msgr2=0x7f435019a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4350109240 0x7f435019a790 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f434400e9f0 tx=0x7f434400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 -- 172.21.15.53:0/3750946317 shutdown_connections 2024-08-31T06:29:02.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f43380b4ca0 0x7f43380b71b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4350109b90 0x7f435019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4350109240 0x7f435019a790 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 --2- 172.21.15.53:0/3750946317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4350103900 0x7f435019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:02.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 -- 172.21.15.53:0/3750946317 >> 172.21.15.53:0/3750946317 conn(0x7f435007b5f0 msgr2=0x7f43501073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:02.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 -- 172.21.15.53:0/3750946317 shutdown_connections 2024-08-31T06:29:02.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:02.907+0000 7f4355aac640 1 -- 172.21.15.53:0/3750946317 wait complete. 2024-08-31T06:29:03.404 INFO:tasks.workunit.client.0.smithi053.stdout: 10 67999 5.46 MB/sec execute 531 sec latency 2485.030 ms 2024-08-31T06:29:03.854 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:29:03.855 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:29:04.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:03 smithi053 ceph-mon[18924]: pgmap v1082: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.3 MiB/s wr, 306 op/s 2024-08-31T06:29:04.232 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:03 smithi130 ceph-mon[22266]: pgmap v1082: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.3 MiB/s wr, 306 op/s 2024-08-31T06:29:04.406 INFO:tasks.workunit.client.0.smithi053.stdout: 10 68069 5.45 MB/sec execute 532 sec latency 2943.965 ms 2024-08-31T06:29:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:03 smithi153 ceph-mon[22320]: pgmap v1082: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.3 MiB/s wr, 306 op/s 2024-08-31T06:29:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.080+0000 7fda6f16e640 1 -- 172.21.15.53:0/1654125035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda681081a0 msgr2=0x7fda681085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.080+0000 7fda6f16e640 1 --2- 172.21.15.53:0/1654125035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda681081a0 0x7fda681085b0 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009900 tx=0x7fda5c02a410 comp rx=0 tx=0).stop 2024-08-31T06:29:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.081+0000 7fda6f16e640 1 -- 172.21.15.53:0/1654125035 shutdown_connections 2024-08-31T06:29:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.081+0000 7fda6f16e640 1 --2- 172.21.15.53:0/1654125035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda68108af0 0x7fda6810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.081+0000 7fda6f16e640 1 --2- 172.21.15.53:0/1654125035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda681081a0 0x7fda681085b0 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.081+0000 7fda6f16e640 1 --2- 172.21.15.53:0/1654125035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda68102f70 0x7fda68103380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.081+0000 7fda6f16e640 1 -- 172.21.15.53:0/1654125035 >> 172.21.15.53:0/1654125035 conn(0x7fda68079d30 msgr2=0x7fda6807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.081+0000 7fda6f16e640 1 -- 172.21.15.53:0/1654125035 shutdown_connections 2024-08-31T06:29:05.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.081+0000 7fda6f16e640 1 -- 172.21.15.53:0/1654125035 wait complete. 2024-08-31T06:29:05.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda6f16e640 1 Processor -- start 2024-08-31T06:29:05.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda6f16e640 1 -- start start 2024-08-31T06:29:05.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda6f16e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda68102f70 0x7fda6819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:05.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda6f16e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda681081a0 0x7fda6819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:05.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda6f16e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda68108af0 0x7fda6819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:05.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda6f16e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fda68112610 con 0x7fda68108af0 2024-08-31T06:29:05.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda6f16e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fda68112490 con 0x7fda681081a0 2024-08-31T06:29:05.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda6f16e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda68112790 con 0x7fda68102f70 2024-08-31T06:29:05.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda67fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda681081a0 0x7fda6819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:05.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda6d70b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda68108af0 0x7fda6819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda6d70b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda68108af0 0x7fda6819bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49500/0 (socket says 172.21.15.53:49500) 2024-08-31T06:29:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda6d70b640 1 -- 172.21.15.53:0/1000711050 learned_addr learned my addr 172.21.15.53:0/1000711050 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.082+0000 7fda67fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda681081a0 0x7fda6819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38164/0 (socket says 172.21.15.53:38164) 2024-08-31T06:29:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.083+0000 7fda67fff640 1 -- 172.21.15.53:0/1000711050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda68102f70 msgr2=0x7fda6819b0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T06:29:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.083+0000 7fda67fff640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda68102f70 0x7fda6819b0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.083+0000 7fda67fff640 1 -- 172.21.15.53:0/1000711050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda68108af0 msgr2=0x7fda6819bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.083+0000 7fda67fff640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda68108af0 0x7fda6819bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.083+0000 7fda67fff640 1 -- 172.21.15.53:0/1000711050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda681a63f0 con 0x7fda681081a0 2024-08-31T06:29:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.083+0000 7fda67fff640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda681081a0 0x7fda6819b620 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fda5c02a930 tx=0x7fda5c005e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.084+0000 7fda65ffb640 1 -- 172.21.15.53:0/1000711050 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c03f070 con 0x7fda681081a0 2024-08-31T06:29:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.084+0000 7fda6f16e640 1 -- 172.21.15.53:0/1000711050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda681a6680 con 0x7fda681081a0 2024-08-31T06:29:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.084+0000 7fda65ffb640 1 -- 172.21.15.53:0/1000711050 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda5c003a80 con 0x7fda681081a0 2024-08-31T06:29:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.084+0000 7fda65ffb640 1 -- 172.21.15.53:0/1000711050 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c035070 con 0x7fda681081a0 2024-08-31T06:29:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.084+0000 7fda6f16e640 1 -- 172.21.15.53:0/1000711050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda681a6b80 con 0x7fda681081a0 2024-08-31T06:29:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.085+0000 7fda6f16e640 1 -- 172.21.15.53:0/1000711050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda68103380 con 0x7fda681081a0 2024-08-31T06:29:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.087+0000 7fda65ffb640 1 -- 172.21.15.53:0/1000711050 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fda5c0035f0 con 0x7fda681081a0 2024-08-31T06:29:05.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.088+0000 7fda65ffb640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fda500b4d20 0x7fda500b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:05.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.088+0000 7fda6cf0a640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fda500b4d20 0x7fda500b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:05.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.088+0000 7fda65ffb640 1 -- 172.21.15.53:0/1000711050 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8557+0+0 (secure 0 0 0) 0x7fda5c1059c0 con 0x7fda681081a0 2024-08-31T06:29:05.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.089+0000 7fda6cf0a640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fda500b4d20 0x7fda500b7230 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fda68102790 tx=0x7fda60005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.091+0000 7fda65ffb640 1 -- 172.21.15.53:0/1000711050 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fda5c0cc730 con 0x7fda681081a0 2024-08-31T06:29:05.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:04 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:29:05.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:04 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:29:05.406 INFO:tasks.workunit.client.0.smithi053.stdout: 10 68218 5.46 MB/sec execute 533 sec latency 88.261 ms 2024-08-31T06:29:05.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:04 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:29:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.477+0000 7fda6f16e640 1 -- 172.21.15.53:0/1000711050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda6810a8a0 con 0x7fda681081a0 2024-08-31T06:29:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.478+0000 7fda65ffb640 1 -- 172.21.15.53:0/1000711050 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+11985 (secure 0 0 0) 0x7fda5c0cc030 con 0x7fda681081a0 2024-08-31T06:29:05.480 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:29:05.480 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":88,"btime":"2024-08-31T06:29:03:922171+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":88,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:29:03.915470+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:29:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 88 2024-08-31T06:29:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.482+0000 7fda6f16e640 1 -- 172.21.15.53:0/1000711050 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fda500b4d20 msgr2=0x7fda500b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.482+0000 7fda6f16e640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fda500b4d20 0x7fda500b7230 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fda68102790 tx=0x7fda60005f90 comp rx=0 tx=0).stop 2024-08-31T06:29:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.482+0000 7fda6f16e640 1 -- 172.21.15.53:0/1000711050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda681081a0 msgr2=0x7fda6819b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.482+0000 7fda6f16e640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda681081a0 0x7fda6819b620 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fda5c02a930 tx=0x7fda5c005e10 comp rx=0 tx=0).stop 2024-08-31T06:29:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.482+0000 7fda6f16e640 1 -- 172.21.15.53:0/1000711050 shutdown_connections 2024-08-31T06:29:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.482+0000 7fda6f16e640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fda500b4d20 0x7fda500b7230 secure :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fda68102790 tx=0x7fda60005f90 comp rx=0 tx=0).stop 2024-08-31T06:29:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.482+0000 7fda6f16e640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda68108af0 0x7fda6819bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.482+0000 7fda6f16e640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda681081a0 0x7fda6819b620 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.482+0000 7fda6f16e640 1 --2- 172.21.15.53:0/1000711050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda68102f70 0x7fda6819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.482+0000 7fda6f16e640 1 -- 172.21.15.53:0/1000711050 >> 172.21.15.53:0/1000711050 conn(0x7fda68079d30 msgr2=0x7fda68106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.483+0000 7fda6f16e640 1 -- 172.21.15.53:0/1000711050 shutdown_connections 2024-08-31T06:29:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:05.483+0000 7fda6f16e640 1 -- 172.21.15.53:0/1000711050 wait complete. 2024-08-31T06:29:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:05 smithi053 ceph-mon[18924]: pgmap v1083: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 339 op/s 2024-08-31T06:29:06.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:05 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1000711050' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:29:06.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:29:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:05 smithi130 ceph-mon[22266]: pgmap v1083: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 339 op/s 2024-08-31T06:29:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:05 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1000711050' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:29:06.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 68351 5.47 MB/sec execute 534 sec latency 129.015 ms 2024-08-31T06:29:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:05 smithi153 ceph-mon[22320]: pgmap v1083: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 339 op/s 2024-08-31T06:29:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:05 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1000711050' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:29:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:07.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:06 smithi053 ceph-mon[18924]: osdmap e111: 12 total, 12 up, 12 in 2024-08-31T06:29:07.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.285+0000 7f2f51de5640 1 -- 172.21.15.53:0/1386217863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f4c102800 msgr2=0x7f2f4c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:07.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.285+0000 7f2f51de5640 1 --2- 172.21.15.53:0/1386217863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f4c102800 0x7f2f4c102c10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009900 tx=0x7f2f3c02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.285+0000 7f2f51de5640 1 -- 172.21.15.53:0/1386217863 shutdown_connections 2024-08-31T06:29:07.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.285+0000 7f2f51de5640 1 --2- 172.21.15.53:0/1386217863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f4c108a90 0x7f2f4c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.285+0000 7f2f51de5640 1 --2- 172.21.15.53:0/1386217863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f4c108140 0x7f2f4c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.285+0000 7f2f51de5640 1 --2- 172.21.15.53:0/1386217863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f4c102800 0x7f2f4c102c10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.285+0000 7f2f51de5640 1 -- 172.21.15.53:0/1386217863 >> 172.21.15.53:0/1386217863 conn(0x7f2f4c0794d0 msgr2=0x7f2f4c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:07.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.285+0000 7f2f51de5640 1 -- 172.21.15.53:0/1386217863 shutdown_connections 2024-08-31T06:29:07.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.286+0000 7f2f51de5640 1 -- 172.21.15.53:0/1386217863 wait complete. 2024-08-31T06:29:07.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.287+0000 7f2f51de5640 1 Processor -- start 2024-08-31T06:29:07.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.287+0000 7f2f51de5640 1 -- start start 2024-08-31T06:29:07.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.288+0000 7f2f51de5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f4c102800 0x7f2f4c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.288+0000 7f2f51de5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f4c108140 0x7f2f4c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.288+0000 7f2f4b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f4c102800 0x7f2f4c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.288+0000 7f2f4b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f4c102800 0x7f2f4c197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49516/0 (socket says 172.21.15.53:49516) 2024-08-31T06:29:07.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.288+0000 7f2f4b7fe640 1 -- 172.21.15.53:0/1011450841 learned_addr learned my addr 172.21.15.53:0/1011450841 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:07.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.288+0000 7f2f51de5640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f4c108a90 0x7f2f4c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.288+0000 7f2f4affd640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f4c108140 0x7f2f4c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.288+0000 7f2f51de5640 1 -- 172.21.15.53:0/1011450841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c1114f0 con 0x7f2f4c102800 2024-08-31T06:29:07.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.288+0000 7f2f51de5640 1 -- 172.21.15.53:0/1011450841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c111370 con 0x7f2f4c108140 2024-08-31T06:29:07.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.288+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f4c108a90 0x7f2f4c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.289+0000 7f2f51de5640 1 -- 172.21.15.53:0/1011450841 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c111670 con 0x7f2f4c108a90 2024-08-31T06:29:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.289+0000 7f2f4b7fe640 1 -- 172.21.15.53:0/1011450841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f4c108a90 msgr2=0x7f2f4c19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.289+0000 7f2f4b7fe640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f4c108a90 0x7f2f4c19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.289+0000 7f2f4b7fe640 1 -- 172.21.15.53:0/1011450841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f4c108140 msgr2=0x7f2f4c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.289+0000 7f2f4b7fe640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f4c108140 0x7f2f4c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.289+0000 7f2f4b7fe640 1 -- 172.21.15.53:0/1011450841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4c19de30 con 0x7f2f4c102800 2024-08-31T06:29:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.289+0000 7f2f4affd640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f4c108140 0x7f2f4c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.290+0000 7f2f4b7fe640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f4c102800 0x7f2f4c197ec0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c02a910 tx=0x7f2f3c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.290+0000 7f2f48ff9640 1 -- 172.21.15.53:0/1011450841 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c03f070 con 0x7f2f4c102800 2024-08-31T06:29:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.290+0000 7f2f48ff9640 1 -- 172.21.15.53:0/1011450841 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f3c003e40 con 0x7f2f4c102800 2024-08-31T06:29:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.291+0000 7f2f48ff9640 1 -- 172.21.15.53:0/1011450841 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c035030 con 0x7f2f4c102800 2024-08-31T06:29:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.291+0000 7f2f51de5640 1 -- 172.21.15.53:0/1011450841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4c19e0c0 con 0x7f2f4c102800 2024-08-31T06:29:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.291+0000 7f2f51de5640 1 -- 172.21.15.53:0/1011450841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f4c1a4880 con 0x7f2f4c102800 2024-08-31T06:29:07.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.296+0000 7f2f48ff9640 1 -- 172.21.15.53:0/1011450841 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2f3c042070 con 0x7f2f4c102800 2024-08-31T06:29:07.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.296+0000 7f2f5835a740 1 Processor -- start 2024-08-31T06:29:07.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.296+0000 7f2f5835a740 1 -- start start 2024-08-31T06:29:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.297+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 0x56506139a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.297+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x56506139a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.297+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x56506139ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.297+0000 7f2f5835a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x565061311680 con 0x565060fcc1b0 2024-08-31T06:29:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.297+0000 7f2f5835a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x565061300c10 con 0x565060fd4390 2024-08-31T06:29:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.297+0000 7f2f5835a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565061304bc0 con 0x565060ff5070 2024-08-31T06:29:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.297+0000 7f2f4bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 0x56506139a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.297+0000 7f2f4affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x56506139ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.297+0000 7f2f4affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x56506139ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38194/0 (socket says 172.21.15.53:38194) 2024-08-31T06:29:07.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.297+0000 7f2f4affd640 1 -- 172.21.15.53:0/102298279 learned_addr learned my addr 172.21.15.53:0/102298279 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:07.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.297+0000 7f2f4b7fe640 1 --2- 172.21.15.53:0/102298279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x56506139a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.298+0000 7f2f4bfff640 1 -- 172.21.15.53:0/102298279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 msgr2=0x56506139ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.298+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/102298279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x56506139ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.298+0000 7f2f4bfff640 1 -- 172.21.15.53:0/102298279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 msgr2=0x56506139a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.298+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/102298279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x56506139a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.298+0000 7f2f4bfff640 1 -- 172.21.15.53:0/102298279 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565061060650 con 0x565060ff5070 2024-08-31T06:29:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.298+0000 7f2f4affd640 1 --2- 172.21.15.53:0/102298279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x56506139ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.299+0000 7f2f48ff9640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2f340b4df0 0x7f2f340b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.299+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/102298279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 0x56506139a310 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009620 tx=0x7f2f44010f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a875d76cff5facc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.299+0000 7f2f4b7fe640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2f340b4df0 0x7f2f340b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.299+0000 7f2f31ffb640 1 -- 172.21.15.53:0/102298279 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44004d20 con 0x565060ff5070 2024-08-31T06:29:07.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.299+0000 7f2f31ffb640 1 -- 172.21.15.53:0/102298279 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f4401acf0 con 0x565060ff5070 2024-08-31T06:29:07.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.299+0000 7f2f31ffb640 1 -- 172.21.15.53:0/102298279 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44005780 con 0x565060ff5070 2024-08-31T06:29:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.299+0000 7f2f48ff9640 1 -- 172.21.15.53:0/1011450841 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f2f3c105c40 con 0x7f2f4c102800 2024-08-31T06:29:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.300+0000 7f2f5835a740 1 -- 172.21.15.53:0/102298279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 msgr2=0x56506139a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.300+0000 7f2f4b7fe640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2f340b4df0 0x7f2f340b7300 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c1033f0 tx=0x7f2f3c109780 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.300+0000 7f2f5835a740 1 --2- 172.21.15.53:0/102298279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 0x56506139a310 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009620 tx=0x7f2f44010f90 comp rx=0 tx=0).stop 2024-08-31T06:29:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.300+0000 7f2f5835a740 1 -- 172.21.15.53:0/102298279 shutdown_connections 2024-08-31T06:29:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.300+0000 7f2f5835a740 1 --2- 172.21.15.53:0/102298279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x56506139ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.300+0000 7f2f5835a740 1 --2- 172.21.15.53:0/102298279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x56506139a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.300+0000 7f2f5835a740 1 --2- 172.21.15.53:0/102298279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 0x56506139a310 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.300+0000 7f2f5835a740 1 -- 172.21.15.53:0/102298279 >> 172.21.15.53:0/102298279 conn(0x565060fe9460 msgr2=0x565061398200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.301+0000 7f2f5835a740 1 -- 172.21.15.53:0/102298279 shutdown_connections 2024-08-31T06:29:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.301+0000 7f2f5835a740 1 -- 172.21.15.53:0/102298279 wait complete. 2024-08-31T06:29:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.301+0000 7f2f5835a740 1 -- start start 2024-08-31T06:29:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.301+0000 7f2f5835a740 1 Processor -- start 2024-08-31T06:29:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x5650613a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x5650613a6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 0x5650613b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f5835a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x565061163700 con 0x565060fcc1b0 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f5835a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x565061287750 con 0x565060fd4390 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f5835a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5650613a8af0 con 0x565060ff5070 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f5835a740 10 client.0 _ll_register_callbacks cb 0x5650612b6e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f4affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x5650613a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f4affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x5650613a6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38196/0 (socket says 172.21.15.53:38196) 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f4affd640 1 -- 172.21.15.53:0/1711493875 learned_addr learned my addr 172.21.15.53:0/1711493875 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x5650613a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 0x5650613b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f4affd640 1 -- 172.21.15.53:0/1711493875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 msgr2=0x5650613b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f4affd640 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 0x5650613b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f4affd640 1 -- 172.21.15.53:0/1711493875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 msgr2=0x5650613a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f4affd640 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x5650613a5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f4affd640 1 -- 172.21.15.53:0/1711493875 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650612c0900 con 0x565060fd4390 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.302+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 0x5650613b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.303+0000 7f2f4affd640 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x5650613a6090 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009cf0 tx=0x7f2f40013600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e17929d62d7ac9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.303+0000 7f2f2affd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.303+0000 7f2f2affd640 1 -- 172.21.15.53:0/1711493875 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4001d030 con 0x565060fd4390 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.303+0000 7f2f2affd640 1 -- 172.21.15.53:0/1711493875 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f2f40009040 con 0x565060fd4390 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.303+0000 7f2f5835a740 1 -- 172.21.15.53:0/1711493875 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f4401acf0 con 0x565060fd4390 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.303+0000 7f2f2affd640 1 -- 172.21.15.53:0/1711493875 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f2f40027050 con 0x565060fd4390 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.303+0000 7f2f5835a740 10 client.31394 fetch_fsmap learned FSMap version 88 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.303+0000 7f2f5835a740 1 -- 172.21.15.53:0/1711493875 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) -- 0x5650613b4a00 con 0x565060fd4390 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.303+0000 7f2f2affd640 1 -- 172.21.15.53:0/1711493875 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f4401acf0 con 0x565060fd4390 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.304+0000 7f2f2affd640 1 -- 172.21.15.53:0/1711493875 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 88) ==== 8362+0+0 (secure 0 0 0) 0x7f2f40017410 con 0x565060fd4390 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.304+0000 7f2f5835a740 10 client.31394 fetch_fsmap finished waiting for FSMap version 88 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.304+0000 7f2f5835a740 10 client.31394 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:29:07.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.304+0000 7f2f5835a740 20 client.31394 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:07.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.304+0000 7f2f5835a740 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x565060fb39f0 0x5650613b8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.304+0000 7f2f5835a740 4 client.31394 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:07.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.304+0000 7f2f5835a740 1 -- 172.21.15.53:0/1711493875 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650613135d0 con 0x565060fb39f0 2024-08-31T06:29:07.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.304+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x565060fb39f0 0x5650613b8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.304+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x565060fb39f0 0x5650613b8380 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ee7e3d4a89de9dce server_cookie=faa997813d90e330 in_seq=0 out_seq=0 2024-08-31T06:29:07.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.304+0000 7f2f2affd640 10 client.31394 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:29:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.305+0000 7f2f2affd640 1 -- 172.21.15.53:0/1711493875 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5650613135d0 con 0x565060fb39f0 2024-08-31T06:29:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.305+0000 7f2f2affd640 10 client.31394 handle_command_reply: tid=0 2024-08-31T06:29:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.305+0000 7f2f5835a740 1 client.31394 shutdown 2024-08-31T06:29:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.305+0000 7f2f5835a740 1 -- 172.21.15.53:0/1711493875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 msgr2=0x5650613a6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.305+0000 7f2f5835a740 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x5650613a6090 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009cf0 tx=0x7f2f40013600 comp rx=0 tx=0).stop 2024-08-31T06:29:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.305+0000 7f2f5835a740 1 -- 172.21.15.53:0/1711493875 shutdown_connections 2024-08-31T06:29:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.305+0000 7f2f5835a740 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x565060fb39f0 0x5650613b8380 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.306+0000 7f2f2affd640 0 client.31394 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:29:07.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.305+0000 7f2f5835a740 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060ff5070 0x5650613b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.306+0000 7f2f5835a740 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x5650613a6090 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.306+0000 7f2f5835a740 1 --2- 172.21.15.53:0/1711493875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x5650613a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.306+0000 7f2f5835a740 1 -- 172.21.15.53:0/1711493875 >> 172.21.15.53:0/1711493875 conn(0x565060fe9460 msgr2=0x56506139d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:07.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.306+0000 7f2f5835a740 1 -- 172.21.15.53:0/1711493875 shutdown_connections 2024-08-31T06:29:07.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.306+0000 7f2f5835a740 1 -- 172.21.15.53:0/1711493875 wait complete. 2024-08-31T06:29:07.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.306+0000 7f2f5835a740 20 client.31394 trim_cache size 0 max 16384 2024-08-31T06:29:07.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.328+0000 7f2f5835a740 1 Processor -- start 2024-08-31T06:29:07.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.328+0000 7f2f5835a740 1 -- start start 2024-08-31T06:29:07.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.329+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fb39f0 0x5650613a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.329+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fcc1b0 0x56506139d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.329+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x56506139d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.329+0000 7f2f5835a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c1ad1c0 con 0x565060fb39f0 2024-08-31T06:29:07.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.329+0000 7f2f5835a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c1aed00 con 0x565060fd4390 2024-08-31T06:29:07.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.329+0000 7f2f5835a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c1ad890 con 0x565060fcc1b0 2024-08-31T06:29:07.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.329+0000 7f2f4affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fcc1b0 0x56506139d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.330+0000 7f2f4affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fcc1b0 0x56506139d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44038/0 (socket says 172.21.15.53:44038) 2024-08-31T06:29:07.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.330+0000 7f2f4affd640 1 -- 172.21.15.53:0/2739601612 learned_addr learned my addr 172.21.15.53:0/2739601612 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:07.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.330+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/2739601612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x56506139d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.330+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/2739601612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fb39f0 0x5650613a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.330+0000 7f2f4affd640 1 -- 172.21.15.53:0/2739601612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 msgr2=0x56506139d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.330+0000 7f2f4affd640 1 --2- 172.21.15.53:0/2739601612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x56506139d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.330+0000 7f2f4affd640 1 -- 172.21.15.53:0/2739601612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fb39f0 msgr2=0x5650613a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.330+0000 7f2f4affd640 1 --2- 172.21.15.53:0/2739601612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fb39f0 0x5650613a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.330+0000 7f2f4affd640 1 -- 172.21.15.53:0/2739601612 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650613a6510 con 0x565060fcc1b0 2024-08-31T06:29:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.330+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/2739601612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fb39f0 0x5650613a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.330+0000 7f2f4affd640 1 --2- 172.21.15.53:0/2739601612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fcc1b0 0x56506139d410 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2f40005670 tx=0x7f2f400056a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=559ddc08873b5260 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.331+0000 7f2f317fa640 1 -- 172.21.15.53:0/2739601612 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4001d070 con 0x565060fcc1b0 2024-08-31T06:29:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.331+0000 7f2f317fa640 1 -- 172.21.15.53:0/2739601612 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f40013b00 con 0x565060fcc1b0 2024-08-31T06:29:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.331+0000 7f2f317fa640 1 -- 172.21.15.53:0/2739601612 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40019cb0 con 0x565060fcc1b0 2024-08-31T06:29:07.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.332+0000 7f2f5835a740 1 -- 172.21.15.53:0/2739601612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fcc1b0 msgr2=0x56506139d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:07.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.332+0000 7f2f5835a740 1 --2- 172.21.15.53:0/2739601612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fcc1b0 0x56506139d410 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2f40005670 tx=0x7f2f400056a0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.332+0000 7f2f5835a740 1 -- 172.21.15.53:0/2739601612 shutdown_connections 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.332+0000 7f2f5835a740 1 --2- 172.21.15.53:0/2739601612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x56506139d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.332+0000 7f2f5835a740 1 --2- 172.21.15.53:0/2739601612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fcc1b0 0x56506139d410 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.332+0000 7f2f5835a740 1 --2- 172.21.15.53:0/2739601612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fb39f0 0x5650613a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.332+0000 7f2f5835a740 1 -- 172.21.15.53:0/2739601612 >> 172.21.15.53:0/2739601612 conn(0x565060fe9460 msgr2=0x5650613a58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.332+0000 7f2f5835a740 1 -- 172.21.15.53:0/2739601612 shutdown_connections 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.332+0000 7f2f5835a740 1 -- 172.21.15.53:0/2739601612 wait complete. 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.333+0000 7f2f5835a740 1 -- start start 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.333+0000 7f2f5835a740 1 Processor -- start 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.333+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fb39f0 0x5650613a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.333+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x5650613aa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.333+0000 7f2f5835a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x5650613aa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.333+0000 7f2f5835a740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c1ae630 con 0x565060fcc1b0 2024-08-31T06:29:07.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.333+0000 7f2f5835a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c1adf60 con 0x565060fd4390 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.333+0000 7f2f5835a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c1ab1c0 con 0x565060fb39f0 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.333+0000 7f2f5835a740 10 client.0 _ll_register_callbacks cb 0x7f2f40009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.333+0000 7f2f4affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x5650613aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f4affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x5650613aa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49556/0 (socket says 172.21.15.53:49556) 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f4affd640 1 -- 172.21.15.53:0/208727075 learned_addr learned my addr 172.21.15.53:0/208727075 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fb39f0 0x5650613a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f4affd640 1 -- 172.21.15.53:0/208727075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fb39f0 msgr2=0x5650613a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x5650613aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f4affd640 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fb39f0 0x5650613a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f4affd640 1 -- 172.21.15.53:0/208727075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 msgr2=0x5650613aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f4affd640 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x5650613aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f4affd640 1 -- 172.21.15.53:0/208727075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565061421d80 con 0x565060fcc1b0 2024-08-31T06:29:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x5650613aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:29:07.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f4affd640 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x5650613aa250 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f2f400057c0 tx=0x7f2f40017640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b2f70bf22a5787 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:07.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.334+0000 7f2f2affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:07.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.335+0000 7f2f2affd640 1 -- 172.21.15.53:0/208727075 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4003a060 con 0x565060fcc1b0 2024-08-31T06:29:07.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.335+0000 7f2f2affd640 1 -- 172.21.15.53:0/208727075 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f2f40035670 con 0x565060fcc1b0 2024-08-31T06:29:07.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.335+0000 7f2f5835a740 1 -- 172.21.15.53:0/208727075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f40013b00 con 0x565060fcc1b0 2024-08-31T06:29:07.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.335+0000 7f2f2affd640 1 -- 172.21.15.53:0/208727075 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f2f4001d040 con 0x565060fcc1b0 2024-08-31T06:29:07.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.335+0000 7f2f5835a740 10 client.22761 fetch_fsmap learned FSMap version 88 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.335+0000 7f2f5835a740 1 -- 172.21.15.53:0/208727075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) -- 0x565061422fa0 con 0x565060fcc1b0 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.335+0000 7f2f2affd640 1 -- 172.21.15.53:0/208727075 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f40013b00 con 0x565060fcc1b0 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.335+0000 7f2f2affd640 1 -- 172.21.15.53:0/208727075 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 88) ==== 8362+0+0 (secure 0 0 0) 0x7f2f40019760 con 0x565060fcc1b0 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.336+0000 7f2f5835a740 10 client.22761 fetch_fsmap finished waiting for FSMap version 88 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.336+0000 7f2f5835a740 10 client.22761 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.336+0000 7f2f5835a740 20 client.22761 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.336+0000 7f2f5835a740 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x565060ff5070 0x565061425670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.336+0000 7f2f5835a740 4 client.22761 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.336+0000 7f2f5835a740 1 -- 172.21.15.53:0/208727075 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56506130f070 con 0x565060ff5070 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.336+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x565060ff5070 0x565061425670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.336+0000 7f2f2affd640 10 client.22761 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.336+0000 7f2f4bfff640 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x565060ff5070 0x565061425670 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d54f056b18a0bd38 server_cookie=9a78080492cf08ca in_seq=0 out_seq=0 2024-08-31T06:29:07.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f2affd640 1 -- 172.21.15.53:0/208727075 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56506130f070 con 0x565060ff5070 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f2affd640 10 client.22761 handle_command_reply: tid=0 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 1 client.22761 shutdown 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 1 -- 172.21.15.53:0/208727075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 msgr2=0x5650613aa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x5650613aa250 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f2f400057c0 tx=0x7f2f40017640 comp rx=0 tx=0).stop 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 1 -- 172.21.15.53:0/208727075 shutdown_connections 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565060fd4390 0x5650613aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565060fcc1b0 0x5650613aa250 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x565060ff5070 0x565061425670 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 1 --2- 172.21.15.53:0/208727075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565060fb39f0 0x5650613a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 1 -- 172.21.15.53:0/208727075 >> 172.21.15.53:0/208727075 conn(0x565060fe9460 msgr2=0x56506139d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f2affd640 0 client.22761 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 1 -- 172.21.15.53:0/208727075 shutdown_connections 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 1 -- 172.21.15.53:0/208727075 wait complete. 2024-08-31T06:29:07.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.337+0000 7f2f5835a740 20 client.22761 trim_cache size 0 max 16384 2024-08-31T06:29:07.343 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:29:07.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 -- 172.21.15.53:0/1011450841 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2f340b4df0 msgr2=0x7f2f340b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:07.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2f340b4df0 0x7f2f340b7300 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c1033f0 tx=0x7f2f3c109780 comp rx=0 tx=0).stop 2024-08-31T06:29:07.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 -- 172.21.15.53:0/1011450841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f4c102800 msgr2=0x7f2f4c197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:07.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f4c102800 0x7f2f4c197ec0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c02a910 tx=0x7f2f3c003c20 comp rx=0 tx=0).stop 2024-08-31T06:29:07.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 -- 172.21.15.53:0/1011450841 shutdown_connections 2024-08-31T06:29:07.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2f340b4df0 0x7f2f340b7300 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f4c108a90 0x7f2f4c19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f4c108140 0x7f2f4c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 --2- 172.21.15.53:0/1011450841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f4c102800 0x7f2f4c197ec0 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:07.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 -- 172.21.15.53:0/1011450841 >> 172.21.15.53:0/1011450841 conn(0x7f2f4c0794d0 msgr2=0x7f2f4c101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:07.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 -- 172.21.15.53:0/1011450841 shutdown_connections 2024-08-31T06:29:07.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:07.338+0000 7f2f51de5640 1 -- 172.21.15.53:0/1011450841 wait complete. 2024-08-31T06:29:07.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:06 smithi130 ceph-mon[22266]: osdmap e111: 12 total, 12 up, 12 in 2024-08-31T06:29:07.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 68515 5.47 MB/sec execute 535 sec latency 69.034 ms 2024-08-31T06:29:07.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:06 smithi153 ceph-mon[22320]: osdmap e111: 12 total, 12 up, 12 in 2024-08-31T06:29:08.132 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:07 smithi053 ceph-mon[18924]: pgmap v1085: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 284 op/s 2024-08-31T06:29:08.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:29:08.384 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:07 smithi130 ceph-mon[22266]: pgmap v1085: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 284 op/s 2024-08-31T06:29:08.418 INFO:tasks.workunit.client.0.smithi053.stdout: 10 68642 5.46 MB/sec execute 536 sec latency 85.944 ms 2024-08-31T06:29:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:07 smithi153 ceph-mon[22320]: pgmap v1085: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 284 op/s 2024-08-31T06:29:08.542 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:09.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.130+0000 7f8d45acf640 1 -- 172.21.15.53:0/2622903575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d4010f870 msgr2=0x7f8d4010fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:09.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.130+0000 7f8d45acf640 1 --2- 172.21.15.53:0/2622903575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d4010f870 0x7f8d4010fc80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009900 tx=0x7f8d3402a400 comp rx=0 tx=0).stop 2024-08-31T06:29:09.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.130+0000 7f8d45acf640 1 -- 172.21.15.53:0/2622903575 shutdown_connections 2024-08-31T06:29:09.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.130+0000 7f8d45acf640 1 --2- 172.21.15.53:0/2622903575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d401101c0 0x7f8d401169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.130+0000 7f8d45acf640 1 --2- 172.21.15.53:0/2622903575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d4010f870 0x7f8d4010fc80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.130+0000 7f8d45acf640 1 --2- 172.21.15.53:0/2622903575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d40109f30 0x7f8d4010a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.130+0000 7f8d45acf640 1 -- 172.21.15.53:0/2622903575 >> 172.21.15.53:0/2622903575 conn(0x7f8d40077e90 msgr2=0x7f8d40107f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:09.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.130+0000 7f8d45acf640 1 -- 172.21.15.53:0/2622903575 shutdown_connections 2024-08-31T06:29:09.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.130+0000 7f8d45acf640 1 -- 172.21.15.53:0/2622903575 wait complete. 2024-08-31T06:29:09.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.131+0000 7f8d45acf640 1 Processor -- start 2024-08-31T06:29:09.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.131+0000 7f8d45acf640 1 -- start start 2024-08-31T06:29:09.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d45acf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d40109f30 0x7f8d401a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d45acf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d4010f870 0x7f8d401a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d45acf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d401101c0 0x7f8d401a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d45acf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40119d80 con 0x7f8d4010f870 2024-08-31T06:29:09.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d45acf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40119c00 con 0x7f8d401101c0 2024-08-31T06:29:09.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d45acf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40119f00 con 0x7f8d40109f30 2024-08-31T06:29:09.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d4010f870 0x7f8d401a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d4010f870 0x7f8d401a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49580/0 (socket says 172.21.15.53:49580) 2024-08-31T06:29:09.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d401101c0 0x7f8d401a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d3effd640 1 -- 172.21.15.53:0/1208434055 learned_addr learned my addr 172.21.15.53:0/1208434055 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:09.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d3f7fe640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d40109f30 0x7f8d401a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d3effd640 1 -- 172.21.15.53:0/1208434055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d40109f30 msgr2=0x7f8d401a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:09.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d3effd640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d40109f30 0x7f8d401a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d3effd640 1 -- 172.21.15.53:0/1208434055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d401101c0 msgr2=0x7f8d401a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:09.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d3effd640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d401101c0 0x7f8d401a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d3effd640 1 -- 172.21.15.53:0/1208434055 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d401a6700 con 0x7f8d4010f870 2024-08-31T06:29:09.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.132+0000 7f8d3ffff640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d401101c0 0x7f8d401a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:09.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.133+0000 7f8d3f7fe640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d40109f30 0x7f8d401a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:09.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.133+0000 7f8d3effd640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d4010f870 0x7f8d401a0d30 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f8d3402a920 tx=0x7f8d34003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:09.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.133+0000 7f8d3cff9640 1 -- 172.21.15.53:0/1208434055 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3403f070 con 0x7f8d4010f870 2024-08-31T06:29:09.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.133+0000 7f8d45acf640 1 -- 172.21.15.53:0/1208434055 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d401a6990 con 0x7f8d4010f870 2024-08-31T06:29:09.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.133+0000 7f8d3cff9640 1 -- 172.21.15.53:0/1208434055 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d3403bd00 con 0x7f8d4010f870 2024-08-31T06:29:09.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.133+0000 7f8d3cff9640 1 -- 172.21.15.53:0/1208434055 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34035030 con 0x7f8d4010f870 2024-08-31T06:29:09.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.133+0000 7f8d45acf640 1 -- 172.21.15.53:0/1208434055 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d401ad150 con 0x7f8d4010f870 2024-08-31T06:29:09.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.136+0000 7f8d4c044740 1 Processor -- start 2024-08-31T06:29:09.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.136+0000 7f8d3cff9640 1 -- 172.21.15.53:0/1208434055 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8d34042070 con 0x7f8d4010f870 2024-08-31T06:29:09.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.137+0000 7f8d4c044740 1 -- start start 2024-08-31T06:29:09.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.137+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e1b8070 0x55816e55d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.137+0000 7f8d3cff9640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d280b4ca0 0x7f8d280b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.137+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e55d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.137+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e197390 0x55816e55dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.137+0000 7f8d4c044740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55816e4d4680 con 0x55816e197390 2024-08-31T06:29:09.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.137+0000 7f8d4c044740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55816e4c3c10 con 0x55816e1b8070 2024-08-31T06:29:09.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.137+0000 7f8d4c044740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55816e4c7bc0 con 0x55816e18f1b0 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.137+0000 7f8d3cff9640 1 -- 172.21.15.53:0/1208434055 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f8d34105c90 con 0x7f8d4010f870 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.137+0000 7f8d3f7fe640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d280b4ca0 0x7f8d280b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e197390 0x55816e55dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e55d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e197390 0x55816e55dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49582/0 (socket says 172.21.15.53:49582) 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3ffff640 1 -- 172.21.15.53:0/3366527530 learned_addr learned my addr 172.21.15.53:0/3366527530 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3ffff640 1 --2- 172.21.15.53:0/3366527530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e1b8070 0x55816e55d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3effd640 1 -- 172.21.15.53:0/3366527530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e1b8070 msgr2=0x55816e55d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3effd640 1 --2- 172.21.15.53:0/3366527530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e1b8070 0x55816e55d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3effd640 1 -- 172.21.15.53:0/3366527530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e197390 msgr2=0x55816e55dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3effd640 1 --2- 172.21.15.53:0/3366527530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e197390 0x55816e55dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3effd640 1 -- 172.21.15.53:0/3366527530 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55816e223650 con 0x55816e18f1b0 2024-08-31T06:29:09.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3f7fe640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d280b4ca0 0x7f8d280b71b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000bce0 tx=0x7f8d3000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:09.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d3effd640 1 --2- 172.21.15.53:0/3366527530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e55d850 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8d34103390 tx=0x7f8d3402a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ef10ef5cc58a3b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:09.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d25ffb640 1 -- 172.21.15.53:0/3366527530 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34049070 con 0x55816e18f1b0 2024-08-31T06:29:09.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.138+0000 7f8d25ffb640 1 -- 172.21.15.53:0/3366527530 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d340cbef0 con 0x55816e18f1b0 2024-08-31T06:29:09.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.139+0000 7f8d25ffb640 1 -- 172.21.15.53:0/3366527530 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d340d0ba0 con 0x55816e18f1b0 2024-08-31T06:29:09.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.140+0000 7f8d4c044740 1 -- 172.21.15.53:0/3366527530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 msgr2=0x55816e55d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:09.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.140+0000 7f8d4c044740 1 --2- 172.21.15.53:0/3366527530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e55d850 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8d34103390 tx=0x7f8d3402a400 comp rx=0 tx=0).stop 2024-08-31T06:29:09.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.140+0000 7f8d4c044740 1 -- 172.21.15.53:0/3366527530 shutdown_connections 2024-08-31T06:29:09.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.140+0000 7f8d4c044740 1 --2- 172.21.15.53:0/3366527530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e197390 0x55816e55dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.140+0000 7f8d4c044740 1 --2- 172.21.15.53:0/3366527530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e55d850 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.140+0000 7f8d4c044740 1 --2- 172.21.15.53:0/3366527530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e1b8070 0x55816e55d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.140+0000 7f8d4c044740 1 -- 172.21.15.53:0/3366527530 >> 172.21.15.53:0/3366527530 conn(0x55816e1ac460 msgr2=0x55816e55b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:09.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.140+0000 7f8d4c044740 1 -- 172.21.15.53:0/3366527530 shutdown_connections 2024-08-31T06:29:09.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.140+0000 7f8d4c044740 1 -- 172.21.15.53:0/3366527530 wait complete. 2024-08-31T06:29:09.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.141+0000 7f8d4c044740 1 -- start start 2024-08-31T06:29:09.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.141+0000 7f8d4c044740 1 Processor -- start 2024-08-31T06:29:09.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e18f1b0 0x55816e568ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e197390 0x55816e568ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e1b8070 0x55816e574b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d3f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e18f1b0 0x55816e568ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d4c044740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55816e326700 con 0x55816e18f1b0 2024-08-31T06:29:09.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d4c044740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55816e44a750 con 0x55816e1b8070 2024-08-31T06:29:09.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e1b8070 0x55816e574b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d4c044740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55816e56b8b0 con 0x55816e197390 2024-08-31T06:29:09.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e197390 0x55816e568ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e1b8070 0x55816e574b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38238/0 (socket says 172.21.15.53:38238) 2024-08-31T06:29:09.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d3ffff640 1 -- 172.21.15.53:0/2017038648 learned_addr learned my addr 172.21.15.53:0/2017038648 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:09.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d3f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e18f1b0 0x55816e568ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49590/0 (socket says 172.21.15.53:49590) 2024-08-31T06:29:09.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d4c044740 10 client.0 _ll_register_callbacks cb 0x55816e479e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:09.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d3effd640 1 -- 172.21.15.53:0/2017038648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e1b8070 msgr2=0x55816e574b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:09.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d3effd640 1 --2- 172.21.15.53:0/2017038648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e1b8070 0x55816e574b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d3effd640 1 -- 172.21.15.53:0/2017038648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e18f1b0 msgr2=0x55816e568ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:09.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d3effd640 1 --2- 172.21.15.53:0/2017038648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e18f1b0 0x55816e568ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.142+0000 7f8d3effd640 1 -- 172.21.15.53:0/2017038648 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55816e483900 con 0x55816e197390 2024-08-31T06:29:09.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.143+0000 7f8d3effd640 1 --2- 172.21.15.53:0/2017038648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e197390 0x55816e568ff0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8d3403c460 tx=0x7f8d34009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ba6829132fd55d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:09.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.143+0000 7f8d1effd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:29:09.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.143+0000 7f8d1effd640 1 -- 172.21.15.53:0/2017038648 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34049040 con 0x55816e197390 2024-08-31T06:29:09.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.143+0000 7f8d1effd640 1 -- 172.21.15.53:0/2017038648 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f8d340c89d0 con 0x55816e197390 2024-08-31T06:29:09.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.143+0000 7f8d4c044740 1 -- 172.21.15.53:0/2017038648 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d340cbef0 con 0x55816e197390 2024-08-31T06:29:09.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.143+0000 7f8d1effd640 1 -- 172.21.15.53:0/2017038648 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f8d340d5650 con 0x55816e197390 2024-08-31T06:29:09.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.143+0000 7f8d4c044740 10 client.31405 fetch_fsmap learned FSMap version 88 2024-08-31T06:29:09.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.143+0000 7f8d4c044740 1 -- 172.21.15.53:0/2017038648 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) -- 0x55816e5775e0 con 0x55816e197390 2024-08-31T06:29:09.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.144+0000 7f8d1effd640 1 -- 172.21.15.53:0/2017038648 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d340cbef0 con 0x55816e197390 2024-08-31T06:29:09.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.144+0000 7f8d1effd640 1 -- 172.21.15.53:0/2017038648 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 88) ==== 8362+0+0 (secure 0 0 0) 0x7f8d3400a250 con 0x55816e197390 2024-08-31T06:29:09.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.144+0000 7f8d4c044740 10 client.31405 fetch_fsmap finished waiting for FSMap version 88 2024-08-31T06:29:09.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.144+0000 7f8d4c044740 10 client.31405 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:29:09.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.144+0000 7f8d4c044740 20 client.31405 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:09.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.144+0000 7f8d4c044740 1 --2- 172.21.15.53:0/2017038648 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55816e1769f0 0x55816e57a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.144+0000 7f8d4c044740 4 client.31405 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:09.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.144+0000 7f8d4c044740 1 -- 172.21.15.53:0/2017038648 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55816e4d65d0 con 0x55816e1769f0 2024-08-31T06:29:09.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.145+0000 7f8d3f7fe640 1 --2- 172.21.15.53:0/2017038648 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55816e1769f0 0x55816e57a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.145+0000 7f8d1effd640 10 client.31405 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:29:09.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.145+0000 7f8d3f7fe640 1 --2- 172.21.15.53:0/2017038648 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55816e1769f0 0x55816e57a940 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dd2e305e921e0bd4 server_cookie=1be0cef518e3d1b7 in_seq=0 out_seq=0 2024-08-31T06:29:09.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d1effd640 1 -- 172.21.15.53:0/2017038648 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55816e4d65d0 con 0x55816e1769f0 2024-08-31T06:29:09.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d1effd640 10 client.31405 handle_command_reply: tid=0 2024-08-31T06:29:09.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d4c044740 1 client.31405 shutdown 2024-08-31T06:29:09.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d4c044740 1 -- 172.21.15.53:0/2017038648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e197390 msgr2=0x55816e568ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:09.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d4c044740 1 --2- 172.21.15.53:0/2017038648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e197390 0x55816e568ff0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8d3403c460 tx=0x7f8d34009260 comp rx=0 tx=0).stop 2024-08-31T06:29:09.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d4c044740 1 -- 172.21.15.53:0/2017038648 shutdown_connections 2024-08-31T06:29:09.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d4c044740 1 --2- 172.21.15.53:0/2017038648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e1b8070 0x55816e574b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d4c044740 1 --2- 172.21.15.53:0/2017038648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e197390 0x55816e568ff0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d4c044740 1 --2- 172.21.15.53:0/2017038648 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55816e1769f0 0x55816e57a940 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d4c044740 1 --2- 172.21.15.53:0/2017038648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e18f1b0 0x55816e568ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d4c044740 1 -- 172.21.15.53:0/2017038648 >> 172.21.15.53:0/2017038648 conn(0x55816e1ac460 msgr2=0x55816e5604f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:09.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.147+0000 7f8d1effd640 0 client.31405 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:29:09.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.148+0000 7f8d4c044740 1 -- 172.21.15.53:0/2017038648 shutdown_connections 2024-08-31T06:29:09.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.148+0000 7f8d4c044740 1 -- 172.21.15.53:0/2017038648 wait complete. 2024-08-31T06:29:09.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.148+0000 7f8d4c044740 20 client.31405 trim_cache size 0 max 16384 2024-08-31T06:29:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.170+0000 7f8d4c044740 1 Processor -- start 2024-08-31T06:29:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.171+0000 7f8d4c044740 1 -- start start 2024-08-31T06:29:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.171+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e56a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.171+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 0x55816e55ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.171+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e1b8070 0x55816e5749d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.171+0000 7f8d4c044740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401b5ae0 con 0x55816e1b8070 2024-08-31T06:29:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.171+0000 7f8d4c044740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401b7620 con 0x55816e197390 2024-08-31T06:29:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.171+0000 7f8d4c044740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401b61b0 con 0x55816e18f1b0 2024-08-31T06:29:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.171+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e1b8070 0x55816e5749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.171+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e1b8070 0x55816e5749d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49594/0 (socket says 172.21.15.53:49594) 2024-08-31T06:29:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.171+0000 7f8d3ffff640 1 -- 172.21.15.53:0/2079284472 learned_addr learned my addr 172.21.15.53:0/2079284472 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.171+0000 7f8d3effd640 1 --2- 172.21.15.53:0/2079284472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 0x55816e55ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.172+0000 7f8d3f7fe640 1 --2- 172.21.15.53:0/2079284472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e56a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.172+0000 7f8d3effd640 1 -- 172.21.15.53:0/2079284472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 msgr2=0x55816e56a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.172+0000 7f8d3effd640 1 --2- 172.21.15.53:0/2079284472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e56a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.172+0000 7f8d3effd640 1 -- 172.21.15.53:0/2079284472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e1b8070 msgr2=0x55816e5749d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.172+0000 7f8d3effd640 1 --2- 172.21.15.53:0/2079284472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e1b8070 0x55816e5749d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.172+0000 7f8d3effd640 1 -- 172.21.15.53:0/2079284472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55816e569d70 con 0x55816e197390 2024-08-31T06:29:09.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.172+0000 7f8d3ffff640 1 --2- 172.21.15.53:0/2079284472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e1b8070 0x55816e5749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:09.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.172+0000 7f8d3effd640 1 --2- 172.21.15.53:0/2079284472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 0x55816e55ea00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8d34000c00 tx=0x7f8d3403b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bf50300955cd008 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:09.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.172+0000 7f8d257fa640 1 -- 172.21.15.53:0/2079284472 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34049040 con 0x55816e197390 2024-08-31T06:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.172+0000 7f8d257fa640 1 -- 172.21.15.53:0/2079284472 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d340cbef0 con 0x55816e197390 2024-08-31T06:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.172+0000 7f8d257fa640 1 -- 172.21.15.53:0/2079284472 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400a250 con 0x55816e197390 2024-08-31T06:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.174+0000 7f8d4c044740 1 -- 172.21.15.53:0/2079284472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 msgr2=0x55816e55ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.174+0000 7f8d4c044740 1 --2- 172.21.15.53:0/2079284472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 0x55816e55ea00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8d34000c00 tx=0x7f8d3403b000 comp rx=0 tx=0).stop 2024-08-31T06:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.174+0000 7f8d4c044740 1 -- 172.21.15.53:0/2079284472 shutdown_connections 2024-08-31T06:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.174+0000 7f8d4c044740 1 --2- 172.21.15.53:0/2079284472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e1b8070 0x55816e5749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.174+0000 7f8d4c044740 1 --2- 172.21.15.53:0/2079284472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 0x55816e55ea00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.174+0000 7f8d4c044740 1 --2- 172.21.15.53:0/2079284472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e56a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.174+0000 7f8d4c044740 1 -- 172.21.15.53:0/2079284472 >> 172.21.15.53:0/2079284472 conn(0x55816e1ac460 msgr2=0x55816e55e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.174+0000 7f8d4c044740 1 -- 172.21.15.53:0/2079284472 shutdown_connections 2024-08-31T06:29:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.174+0000 7f8d4c044740 1 -- 172.21.15.53:0/2079284472 wait complete. 2024-08-31T06:29:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.175+0000 7f8d4c044740 1 -- start start 2024-08-31T06:29:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.175+0000 7f8d4c044740 1 Processor -- start 2024-08-31T06:29:09.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.175+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e5713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.175+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 0x55816e56c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.175+0000 7f8d4c044740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e1b8070 0x55816e56cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d4c044740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401b6f50 con 0x55816e1b8070 2024-08-31T06:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d4c044740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401b6880 con 0x55816e197390 2024-08-31T06:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d4c044740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401b3ae0 con 0x55816e18f1b0 2024-08-31T06:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d4c044740 10 client.0 _ll_register_callbacks cb 0x7f8d3800ae60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 0x55816e56c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 0x55816e56c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38256/0 (socket says 172.21.15.53:38256) 2024-08-31T06:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d3effd640 1 -- 172.21.15.53:0/3961326341 learned_addr learned my addr 172.21.15.53:0/3961326341 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d3f7fe640 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e5713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d3effd640 1 -- 172.21.15.53:0/3961326341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 msgr2=0x55816e5713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d3effd640 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e5713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d3effd640 1 -- 172.21.15.53:0/3961326341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e1b8070 msgr2=0x55816e56cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d3effd640 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e1b8070 0x55816e56cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.176+0000 7f8d3effd640 1 -- 172.21.15.53:0/3961326341 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55816e5e4240 con 0x55816e197390 2024-08-31T06:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.177+0000 7f8d3effd640 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 0x55816e56c880 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8d34034fd0 tx=0x7f8d34009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a293722a723848 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.177+0000 7f8d1effd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.177+0000 7f8d1effd640 1 -- 172.21.15.53:0/3961326341 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34049070 con 0x55816e197390 2024-08-31T06:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.177+0000 7f8d4c044740 1 -- 172.21.15.53:0/3961326341 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d340cbef0 con 0x55816e197390 2024-08-31T06:29:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.177+0000 7f8d1effd640 1 -- 172.21.15.53:0/3961326341 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f8d340b3b40 con 0x55816e197390 2024-08-31T06:29:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.178+0000 7f8d1effd640 1 -- 172.21.15.53:0/3961326341 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f8d3407c120 con 0x55816e197390 2024-08-31T06:29:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.178+0000 7f8d4c044740 10 client.31415 fetch_fsmap learned FSMap version 88 2024-08-31T06:29:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.178+0000 7f8d4c044740 1 -- 172.21.15.53:0/3961326341 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) -- 0x55816e5e4240 con 0x55816e197390 2024-08-31T06:29:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.178+0000 7f8d1effd640 1 -- 172.21.15.53:0/3961326341 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d340cbef0 con 0x55816e197390 2024-08-31T06:29:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.178+0000 7f8d1effd640 1 -- 172.21.15.53:0/3961326341 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 88) ==== 8362+0+0 (secure 0 0 0) 0x7f8d340c6b00 con 0x55816e197390 2024-08-31T06:29:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.180+0000 7f8d4c044740 10 client.31415 fetch_fsmap finished waiting for FSMap version 88 2024-08-31T06:29:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.180+0000 7f8d4c044740 10 client.31415 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:29:09.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.180+0000 7f8d4c044740 20 client.31415 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:09.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.180+0000 7f8d4c044740 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55816e14bda0 0x55816e5e7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:09.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.180+0000 7f8d4c044740 4 client.31415 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:29:09.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.180+0000 7f8d4c044740 1 -- 172.21.15.53:0/3961326341 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55816e4d2070 con 0x55816e14bda0 2024-08-31T06:29:09.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.180+0000 7f8d3f7fe640 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55816e14bda0 0x55816e5e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:09.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.181+0000 7f8d3f7fe640 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55816e14bda0 0x55816e5e7640 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3463bc662e3de3e server_cookie=738752c8a47c4634 in_seq=0 out_seq=0 2024-08-31T06:29:09.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.181+0000 7f8d1effd640 10 client.31415 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:29:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.181+0000 7f8d1effd640 1 -- 172.21.15.53:0/3961326341 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55816e4d2070 con 0x55816e14bda0 2024-08-31T06:29:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.181+0000 7f8d1effd640 10 client.31415 handle_command_reply: tid=0 2024-08-31T06:29:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.182+0000 7f8d4c044740 1 client.31415 shutdown 2024-08-31T06:29:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.182+0000 7f8d4c044740 1 -- 172.21.15.53:0/3961326341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 msgr2=0x55816e56c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.182+0000 7f8d4c044740 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 0x55816e56c880 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8d34034fd0 tx=0x7f8d34009260 comp rx=0 tx=0).stop 2024-08-31T06:29:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.182+0000 7f8d4c044740 1 -- 172.21.15.53:0/3961326341 shutdown_connections 2024-08-31T06:29:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.182+0000 7f8d4c044740 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x55816e14bda0 0x55816e5e7640 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.182+0000 7f8d4c044740 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55816e1b8070 0x55816e56cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.182+0000 7f8d4c044740 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55816e197390 0x55816e56c880 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.182+0000 7f8d4c044740 1 --2- 172.21.15.53:0/3961326341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55816e18f1b0 0x55816e5713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.182+0000 7f8d4c044740 1 -- 172.21.15.53:0/3961326341 >> 172.21.15.53:0/3961326341 conn(0x55816e1ac460 msgr2=0x55816e55ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.182+0000 7f8d1effd640 0 client.31415 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:29:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.182+0000 7f8d4c044740 1 -- 172.21.15.53:0/3961326341 shutdown_connections 2024-08-31T06:29:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.183+0000 7f8d4c044740 1 -- 172.21.15.53:0/3961326341 wait complete. 2024-08-31T06:29:09.187 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:29:09.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.183+0000 7f8d4c044740 20 client.31415 trim_cache size 0 max 16384 2024-08-31T06:29:09.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.184+0000 7f8d45acf640 1 -- 172.21.15.53:0/1208434055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d280b4ca0 msgr2=0x7f8d280b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:09.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.184+0000 7f8d45acf640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d280b4ca0 0x7f8d280b71b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000bce0 tx=0x7f8d3000b390 comp rx=0 tx=0).stop 2024-08-31T06:29:09.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.184+0000 7f8d45acf640 1 -- 172.21.15.53:0/1208434055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d4010f870 msgr2=0x7f8d401a0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:09.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.184+0000 7f8d45acf640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d4010f870 0x7f8d401a0d30 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f8d3402a920 tx=0x7f8d34003c20 comp rx=0 tx=0).stop 2024-08-31T06:29:09.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.184+0000 7f8d45acf640 1 -- 172.21.15.53:0/1208434055 shutdown_connections 2024-08-31T06:29:09.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.184+0000 7f8d45acf640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8d280b4ca0 0x7f8d280b71b0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.184+0000 7f8d45acf640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d401101c0 0x7f8d401a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.184+0000 7f8d45acf640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d4010f870 0x7f8d401a0d30 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.184+0000 7f8d45acf640 1 --2- 172.21.15.53:0/1208434055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d40109f30 0x7f8d401a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:09.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.184+0000 7f8d45acf640 1 -- 172.21.15.53:0/1208434055 >> 172.21.15.53:0/1208434055 conn(0x7f8d40077e90 msgr2=0x7f8d4010b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:09.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.184+0000 7f8d45acf640 1 -- 172.21.15.53:0/1208434055 shutdown_connections 2024-08-31T06:29:09.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:09.185+0000 7f8d45acf640 1 -- 172.21.15.53:0/1208434055 wait complete. 2024-08-31T06:29:09.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 68759 5.46 MB/sec execute 537 sec latency 77.925 ms 2024-08-31T06:29:09.961 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:09 smithi053 ceph-mon[18924]: pgmap v1086: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 280 op/s 2024-08-31T06:29:10.239 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:29:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:09 smithi130 ceph-mon[22266]: pgmap v1086: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 280 op/s 2024-08-31T06:29:10.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 68914 5.47 MB/sec execute 538 sec latency 69.664 ms 2024-08-31T06:29:10.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:09 smithi153 ceph-mon[22320]: pgmap v1086: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 280 op/s 2024-08-31T06:29:10.622 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:11.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 69079 5.48 MB/sec execute 539 sec latency 118.300 ms 2024-08-31T06:29:11.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.459+0000 7feff58b2640 1 -- 172.21.15.53:0/3994133603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feff0109ba0 msgr2=0x7feff01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:11.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.459+0000 7feff58b2640 1 --2- 172.21.15.53:0/3994133603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feff0109ba0 0x7feff01103d0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009ca0 tx=0x7fefe802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.459+0000 7feff58b2640 1 -- 172.21.15.53:0/3994133603 shutdown_connections 2024-08-31T06:29:11.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.459+0000 7feff58b2640 1 --2- 172.21.15.53:0/3994133603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feff0109ba0 0x7feff01103d0 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.459+0000 7feff58b2640 1 --2- 172.21.15.53:0/3994133603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff0109250 0x7feff0109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.459+0000 7feff58b2640 1 --2- 172.21.15.53:0/3994133603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feff0101d10 0x7feff0102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.459+0000 7feff58b2640 1 -- 172.21.15.53:0/3994133603 >> 172.21.15.53:0/3994133603 conn(0x7feff0077a00 msgr2=0x7feff0077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:11.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.460+0000 7feff58b2640 1 -- 172.21.15.53:0/3994133603 shutdown_connections 2024-08-31T06:29:11.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.460+0000 7feff58b2640 1 -- 172.21.15.53:0/3994133603 wait complete. 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.460+0000 7feff58b2640 1 Processor -- start 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7feff58b2640 1 -- start start 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7feff58b2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff0101d10 0x7feff019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7feff58b2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feff0109250 0x7feff019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7feff58b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feff0109ba0 0x7feff019f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7feff58b2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feff0113760 con 0x7feff0109ba0 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7feff58b2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feff01135e0 con 0x7feff0101d10 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7feff58b2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feff01138e0 con 0x7feff0109250 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7fefeeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff0101d10 0x7feff019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7fefee7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feff0109250 0x7feff019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7fefeeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff0101d10 0x7feff019a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38268/0 (socket says 172.21.15.53:38268) 2024-08-31T06:29:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7fefeeffd640 1 -- 172.21.15.53:0/4069779540 learned_addr learned my addr 172.21.15.53:0/4069779540 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:11.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.461+0000 7fefef7fe640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feff0109ba0 0x7feff019f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7fefeeffd640 1 -- 172.21.15.53:0/4069779540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feff0109250 msgr2=0x7feff019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:11.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7fefeeffd640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feff0109250 0x7feff019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7fefeeffd640 1 -- 172.21.15.53:0/4069779540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feff0109ba0 msgr2=0x7feff019f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7fefeeffd640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feff0109ba0 0x7feff019f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7fefeeffd640 1 -- 172.21.15.53:0/4069779540 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff01a0020 con 0x7feff0101d10 2024-08-31T06:29:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7fefef7fe640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feff0109ba0 0x7feff019f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7fefeeffd640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff0101d10 0x7feff019a0b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009de0 tx=0x7fefe000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7feff48b0640 1 -- 172.21.15.53:0/4069779540 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe001f070 con 0x7feff0101d10 2024-08-31T06:29:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7feff58b2640 1 -- 172.21.15.53:0/4069779540 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff01a0310 con 0x7feff0101d10 2024-08-31T06:29:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7feff48b0640 1 -- 172.21.15.53:0/4069779540 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefe00124c0 con 0x7feff0101d10 2024-08-31T06:29:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7feff48b0640 1 -- 172.21.15.53:0/4069779540 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe001a670 con 0x7feff0101d10 2024-08-31T06:29:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.462+0000 7feff58b2640 1 -- 172.21.15.53:0/4069779540 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff0102b90 con 0x7feff0101d10 2024-08-31T06:29:11.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.466+0000 7feff48b0640 1 -- 172.21.15.53:0/4069779540 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fefe0022070 con 0x7feff0101d10 2024-08-31T06:29:11.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.466+0000 7feffbe27740 1 Processor -- start 2024-08-31T06:29:11.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.466+0000 7feffbe27740 1 -- start start 2024-08-31T06:29:11.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7feffbe27740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d9f070 0x561db1144350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7feffbe27740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7feffbe27740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d7e390 0x561db1144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7feffbe27740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561db10bb680 con 0x561db0d7e390 2024-08-31T06:29:11.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7feffbe27740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561db10aac10 con 0x561db0d9f070 2024-08-31T06:29:11.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7feffbe27740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561db10aebc0 con 0x561db0d761b0 2024-08-31T06:29:11.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7fefeeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7fefeeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44138/0 (socket says 172.21.15.53:44138) 2024-08-31T06:29:11.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7fefeeffd640 1 -- 172.21.15.53:0/2267222369 learned_addr learned my addr 172.21.15.53:0/2267222369 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:11.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7fefee7fc640 1 --2- 172.21.15.53:0/2267222369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d7e390 0x561db1144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7fefef7fe640 1 --2- 172.21.15.53:0/2267222369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d9f070 0x561db1144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7fefeeffd640 1 -- 172.21.15.53:0/2267222369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d9f070 msgr2=0x561db1144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7fefeeffd640 1 --2- 172.21.15.53:0/2267222369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d9f070 0x561db1144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7fefeeffd640 1 -- 172.21.15.53:0/2267222369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d7e390 msgr2=0x561db1144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7fefeeffd640 1 --2- 172.21.15.53:0/2267222369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d7e390 0x561db1144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7fefeeffd640 1 -- 172.21.15.53:0/2267222369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561db0e0a650 con 0x561db0d761b0 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7fefef7fe640 1 --2- 172.21.15.53:0/2267222369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d9f070 0x561db1144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.467+0000 7feff48b0640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fefd80b4d20 0x7fefd80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.468+0000 7fefef7fe640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fefd80b4d20 0x7fefd80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.468+0000 7fefeeffd640 1 --2- 172.21.15.53:0/2267222369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1144890 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fefe00e6680 tx=0x7fefe0010f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e10f42125d3c0831 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.468+0000 7feff48b0640 1 -- 172.21.15.53:0/4069779540 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7fefe00e8fe0 con 0x7feff0101d10 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.468+0000 7fefd5ffb640 1 -- 172.21.15.53:0/2267222369 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00ab5f0 con 0x561db0d761b0 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.468+0000 7fefd5ffb640 1 -- 172.21.15.53:0/2267222369 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefe00a9e50 con 0x561db0d761b0 2024-08-31T06:29:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.468+0000 7fefd5ffb640 1 -- 172.21.15.53:0/2267222369 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00aeea0 con 0x561db0d761b0 2024-08-31T06:29:11.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.469+0000 7feffbe27740 1 -- 172.21.15.53:0/2267222369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 msgr2=0x561db1144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.469+0000 7fefef7fe640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fefd80b4d20 0x7fefd80b7230 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009a60 tx=0x7fefe8005c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.469+0000 7feffbe27740 1 --2- 172.21.15.53:0/2267222369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1144890 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fefe00e6680 tx=0x7fefe0010f60 comp rx=0 tx=0).stop 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.469+0000 7feffbe27740 1 -- 172.21.15.53:0/2267222369 shutdown_connections 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.469+0000 7feffbe27740 1 --2- 172.21.15.53:0/2267222369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d7e390 0x561db1144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.469+0000 7feffbe27740 1 --2- 172.21.15.53:0/2267222369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1144890 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.469+0000 7feffbe27740 1 --2- 172.21.15.53:0/2267222369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d9f070 0x561db1144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.469+0000 7feffbe27740 1 -- 172.21.15.53:0/2267222369 >> 172.21.15.53:0/2267222369 conn(0x561db0d93460 msgr2=0x561db1142240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.469+0000 7feffbe27740 1 -- 172.21.15.53:0/2267222369 shutdown_connections 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.469+0000 7feffbe27740 1 -- 172.21.15.53:0/2267222369 wait complete. 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.470+0000 7feffbe27740 1 -- start start 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.470+0000 7feffbe27740 1 Processor -- start 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.470+0000 7feffbe27740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.470+0000 7feffbe27740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db11587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.470+0000 7feffbe27740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d9f070 0x561db11645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.470+0000 7feffbe27740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561db0f0d700 con 0x561db0d9f070 2024-08-31T06:29:11.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.470+0000 7feffbe27740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561db1031750 con 0x561db0d7e390 2024-08-31T06:29:11.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.470+0000 7feffbe27740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561db115b260 con 0x561db0d761b0 2024-08-31T06:29:11.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.470+0000 7feffbe27740 10 client.0 _ll_register_callbacks cb 0x561db1060e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:11.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.471+0000 7fefeeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.471+0000 7fefee7fc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db11587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.471+0000 7fefeeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44144/0 (socket says 172.21.15.53:44144) 2024-08-31T06:29:11.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.471+0000 7fefeeffd640 1 -- 172.21.15.53:0/80653051 learned_addr learned my addr 172.21.15.53:0/80653051 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:11.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.471+0000 7fefef7fe640 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d9f070 0x561db11645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.471+0000 7fefeeffd640 1 -- 172.21.15.53:0/80653051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 msgr2=0x561db11587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:11.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.471+0000 7fefeeffd640 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db11587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.471+0000 7fefeeffd640 1 -- 172.21.15.53:0/80653051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d9f070 msgr2=0x561db11645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:11.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.471+0000 7fefeeffd640 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d9f070 0x561db11645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.471+0000 7fefeeffd640 1 -- 172.21.15.53:0/80653051 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561db106a900 con 0x561db0d761b0 2024-08-31T06:29:11.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.471+0000 7fefeeffd640 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1158270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fefe00af6c0 tx=0x7fefe0011060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6208093373096e8a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:11.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.472+0000 7fefceffd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:29:11.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.472+0000 7fefceffd640 1 -- 172.21.15.53:0/80653051 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00af080 con 0x561db0d761b0 2024-08-31T06:29:11.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.472+0000 7fefceffd640 1 -- 172.21.15.53:0/80653051 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7fefe00117e0 con 0x561db0d761b0 2024-08-31T06:29:11.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.472+0000 7feffbe27740 1 -- 172.21.15.53:0/80653051 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefe00a9e50 con 0x561db0d761b0 2024-08-31T06:29:11.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.473+0000 7fefceffd640 1 -- 172.21.15.53:0/80653051 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fefe00af500 con 0x561db0d761b0 2024-08-31T06:29:11.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.473+0000 7feffbe27740 10 client.31423 fetch_fsmap learned FSMap version 88 2024-08-31T06:29:11.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.473+0000 7feffbe27740 1 -- 172.21.15.53:0/80653051 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) -- 0x561db1167020 con 0x561db0d761b0 2024-08-31T06:29:11.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.474+0000 7fefceffd640 1 -- 172.21.15.53:0/80653051 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefe00a9e50 con 0x561db0d761b0 2024-08-31T06:29:11.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.474+0000 7fefceffd640 1 -- 172.21.15.53:0/80653051 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 88) ==== 8362+0+0 (secure 0 0 0) 0x7fefe00ab9c0 con 0x561db0d761b0 2024-08-31T06:29:11.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.474+0000 7feffbe27740 10 client.31423 fetch_fsmap finished waiting for FSMap version 88 2024-08-31T06:29:11.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.474+0000 7feffbe27740 10 client.31423 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:29:11.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.474+0000 7feffbe27740 20 client.31423 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:11.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.474+0000 7feffbe27740 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x561db0d5d9f0 0x561db116a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.474+0000 7feffbe27740 4 client.31423 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:11.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.474+0000 7feffbe27740 1 -- 172.21.15.53:0/80653051 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561db10bd5d0 con 0x561db0d5d9f0 2024-08-31T06:29:11.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.475+0000 7fefee7fc640 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x561db0d5d9f0 0x561db116a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.476+0000 7fefee7fc640 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x561db0d5d9f0 0x561db116a380 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9695eed2408f265b server_cookie=83b3d49e97cae3f4 in_seq=0 out_seq=0 2024-08-31T06:29:11.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.476+0000 7fefceffd640 10 client.31423 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:29:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7fefceffd640 1 -- 172.21.15.53:0/80653051 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561db10bd5d0 con 0x561db0d5d9f0 2024-08-31T06:29:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7fefceffd640 10 client.31423 handle_command_reply: tid=0 2024-08-31T06:29:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7feffbe27740 1 client.31423 shutdown 2024-08-31T06:29:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7feffbe27740 1 -- 172.21.15.53:0/80653051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 msgr2=0x561db1158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7feffbe27740 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1158270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fefe00af6c0 tx=0x7fefe0011060 comp rx=0 tx=0).stop 2024-08-31T06:29:11.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7feffbe27740 1 -- 172.21.15.53:0/80653051 shutdown_connections 2024-08-31T06:29:11.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7feffbe27740 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x561db0d5d9f0 0x561db116a380 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7feffbe27740 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d9f070 0x561db11645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7fefceffd640 0 client.31423 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:29:11.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7feffbe27740 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db11587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7feffbe27740 1 --2- 172.21.15.53:0/80653051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1158270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.477+0000 7feffbe27740 1 -- 172.21.15.53:0/80653051 >> 172.21.15.53:0/80653051 conn(0x561db0d93460 msgr2=0x561db1140800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:11.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.478+0000 7feffbe27740 1 -- 172.21.15.53:0/80653051 shutdown_connections 2024-08-31T06:29:11.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.478+0000 7feffbe27740 1 -- 172.21.15.53:0/80653051 wait complete. 2024-08-31T06:29:11.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.478+0000 7feffbe27740 20 client.31423 trim_cache size 0 max 16384 2024-08-31T06:29:11.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.501+0000 7feffbe27740 1 Processor -- start 2024-08-31T06:29:11.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.501+0000 7feffbe27740 1 -- start start 2024-08-31T06:29:11.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.501+0000 7feffbe27740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 0x561db1145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.501+0000 7feffbe27740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1164530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.501+0000 7feffbe27740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db1155460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.501+0000 7fefeeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 0x561db1145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7feffbe27740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feff01ad460 con 0x561db0d5d9f0 2024-08-31T06:29:11.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7fefeeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 0x561db1145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49626/0 (socket says 172.21.15.53:49626) 2024-08-31T06:29:11.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7feffbe27740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feff01aefa0 con 0x561db0d7e390 2024-08-31T06:29:11.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7feffbe27740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feff01adb30 con 0x561db0d761b0 2024-08-31T06:29:11.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7fefeeffd640 1 -- 172.21.15.53:0/224623189 learned_addr learned my addr 172.21.15.53:0/224623189 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:11.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7fefee7fc640 1 --2- 172.21.15.53:0/224623189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1164530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7fefef7fe640 1 --2- 172.21.15.53:0/224623189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db1155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7fefeeffd640 1 -- 172.21.15.53:0/224623189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 msgr2=0x561db1164530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:11.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7fefeeffd640 1 --2- 172.21.15.53:0/224623189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1164530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7fefeeffd640 1 -- 172.21.15.53:0/224623189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 msgr2=0x561db1155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:11.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7fefeeffd640 1 --2- 172.21.15.53:0/224623189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db1155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7fefeeffd640 1 -- 172.21.15.53:0/224623189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561db1147160 con 0x561db0d5d9f0 2024-08-31T06:29:11.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.502+0000 7fefee7fc640 1 --2- 172.21.15.53:0/224623189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1164530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:11.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.503+0000 7fefeeffd640 1 --2- 172.21.15.53:0/224623189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 0x561db1145a90 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7fefe000d360 tx=0x7fefe00af810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b454c8a3856f1f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:11.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.503+0000 7fefd57fa640 1 -- 172.21.15.53:0/224623189 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00aeea0 con 0x561db0d5d9f0 2024-08-31T06:29:11.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.503+0000 7fefd57fa640 1 -- 172.21.15.53:0/224623189 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefe00a9e50 con 0x561db0d5d9f0 2024-08-31T06:29:11.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.503+0000 7fefd57fa640 1 -- 172.21.15.53:0/224623189 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe00ab5f0 con 0x561db0d5d9f0 2024-08-31T06:29:11.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.504+0000 7feffbe27740 1 -- 172.21.15.53:0/224623189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 msgr2=0x561db1145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:11.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.504+0000 7feffbe27740 1 --2- 172.21.15.53:0/224623189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 0x561db1145a90 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7fefe000d360 tx=0x7fefe00af810 comp rx=0 tx=0).stop 2024-08-31T06:29:11.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.504+0000 7feffbe27740 1 -- 172.21.15.53:0/224623189 shutdown_connections 2024-08-31T06:29:11.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.504+0000 7feffbe27740 1 --2- 172.21.15.53:0/224623189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db1155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.504+0000 7feffbe27740 1 --2- 172.21.15.53:0/224623189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db1164530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.504+0000 7feffbe27740 1 --2- 172.21.15.53:0/224623189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 0x561db1145a90 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.504+0000 7feffbe27740 1 -- 172.21.15.53:0/224623189 >> 172.21.15.53:0/224623189 conn(0x561db0d93460 msgr2=0x561db1145380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:11.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.505+0000 7feffbe27740 1 -- 172.21.15.53:0/224623189 shutdown_connections 2024-08-31T06:29:11.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.505+0000 7feffbe27740 1 -- 172.21.15.53:0/224623189 wait complete. 2024-08-31T06:29:11.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.505+0000 7feffbe27740 1 -- start start 2024-08-31T06:29:11.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.506+0000 7feffbe27740 1 Processor -- start 2024-08-31T06:29:11.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.507+0000 7feffbe27740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 0x561db116b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.507+0000 7feffbe27740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db116bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.507+0000 7feffbe27740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db11e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.507+0000 7fefee7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db116bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.507+0000 7fefee7fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db116bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44162/0 (socket says 172.21.15.53:44162) 2024-08-31T06:29:11.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.507+0000 7fefee7fc640 1 -- 172.21.15.53:0/588306705 learned_addr learned my addr 172.21.15.53:0/588306705 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:11.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.507+0000 7fefef7fe640 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db11e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.507+0000 7feffbe27740 1 -- 172.21.15.53:0/588306705 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7feff01ae8d0 con 0x561db0d5d9f0 2024-08-31T06:29:11.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.507+0000 7feffbe27740 1 -- 172.21.15.53:0/588306705 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feff01ae200 con 0x561db0d7e390 2024-08-31T06:29:11.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.507+0000 7feffbe27740 1 -- 172.21.15.53:0/588306705 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feff01ab460 con 0x561db0d761b0 2024-08-31T06:29:11.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.508+0000 7fefeeffd640 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 0x561db116b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.508+0000 7fefef7fe640 1 -- 172.21.15.53:0/588306705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 msgr2=0x561db116bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:11.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.508+0000 7fefef7fe640 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db116bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.508+0000 7fefef7fe640 1 -- 172.21.15.53:0/588306705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 msgr2=0x561db116b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:11.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.508+0000 7fefef7fe640 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 0x561db116b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.508+0000 7fefef7fe640 1 -- 172.21.15.53:0/588306705 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561db116c340 con 0x561db0d7e390 2024-08-31T06:29:11.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.508+0000 7fefee7fc640 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db116bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:11.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.508+0000 7fefeeffd640 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 0x561db116b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:11.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.509+0000 7feffbe27740 10 client.0 _ll_register_callbacks cb 0x7fefe40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:11.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.509+0000 7feffbe27740 1 -- 172.21.15.53:0/588306705 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefe00a9e50 con 0x561db0d7e390 2024-08-31T06:29:11.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.509+0000 7fefef7fe640 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db11e4b10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fefe8006010 tx=0x7fefe80095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dbeeb818bb45c37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:11.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.509+0000 7fefceffd640 10 client.31433 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:29:11.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.509+0000 7fefceffd640 1 -- 172.21.15.53:0/588306705 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8056060 con 0x561db0d7e390 2024-08-31T06:29:11.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.509+0000 7fefceffd640 1 -- 172.21.15.53:0/588306705 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7fefe8004790 con 0x561db0d7e390 2024-08-31T06:29:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.509+0000 7fefceffd640 1 -- 172.21.15.53:0/588306705 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fefe8031e90 con 0x561db0d7e390 2024-08-31T06:29:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.509+0000 7feffbe27740 10 client.31433 fetch_fsmap learned FSMap version 88 2024-08-31T06:29:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.509+0000 7feffbe27740 1 -- 172.21.15.53:0/588306705 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=88}) -- 0x561db11e5e80 con 0x561db0d7e390 2024-08-31T06:29:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.510+0000 7fefceffd640 1 -- 172.21.15.53:0/588306705 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 88) ==== 8362+0+0 (secure 0 0 0) 0x7fefe8044040 con 0x561db0d7e390 2024-08-31T06:29:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.510+0000 7feffbe27740 10 client.31433 fetch_fsmap finished waiting for FSMap version 88 2024-08-31T06:29:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.510+0000 7feffbe27740 10 client.31433 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:29:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.510+0000 7feffbe27740 20 client.31433 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.510+0000 7feffbe27740 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x561db0d9f070 0x561db11e8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.510+0000 7feffbe27740 4 client.31433 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:29:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.510+0000 7feffbe27740 1 -- 172.21.15.53:0/588306705 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561db10b9070 con 0x561db0d9f070 2024-08-31T06:29:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.510+0000 7fefeeffd640 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x561db0d9f070 0x561db11e8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:11.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.511+0000 7fefceffd640 10 client.31433 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:29:11.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.511+0000 7fefeeffd640 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x561db0d9f070 0x561db11e8550 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bdf03be8561c1aba server_cookie=d99df1b83a5cb88b in_seq=0 out_seq=0 2024-08-31T06:29:11.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.511+0000 7fefceffd640 1 -- 172.21.15.53:0/588306705 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561db10b9070 con 0x561db0d9f070 2024-08-31T06:29:11.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.511+0000 7fefceffd640 10 client.31433 handle_command_reply: tid=0 2024-08-31T06:29:11.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.511+0000 7feffbe27740 1 client.31433 shutdown 2024-08-31T06:29:11.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.511+0000 7feffbe27740 1 -- 172.21.15.53:0/588306705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 msgr2=0x561db11e4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:11.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.511+0000 7feffbe27740 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db11e4b10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fefe8006010 tx=0x7fefe80095c0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.511+0000 7feffbe27740 1 -- 172.21.15.53:0/588306705 shutdown_connections 2024-08-31T06:29:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.511+0000 7feffbe27740 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x561db0d9f070 0x561db11e8550 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.512+0000 7feffbe27740 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561db0d7e390 0x561db11e4b10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.512+0000 7fefceffd640 0 client.31433 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:29:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.512+0000 7feffbe27740 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561db0d761b0 0x561db116bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.512+0000 7feffbe27740 1 --2- 172.21.15.53:0/588306705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561db0d5d9f0 0x561db116b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.512+0000 7feffbe27740 1 -- 172.21.15.53:0/588306705 >> 172.21.15.53:0/588306705 conn(0x561db0d93460 msgr2=0x561db11566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.512+0000 7feffbe27740 1 -- 172.21.15.53:0/588306705 shutdown_connections 2024-08-31T06:29:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.512+0000 7feffbe27740 1 -- 172.21.15.53:0/588306705 wait complete. 2024-08-31T06:29:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.512+0000 7feffbe27740 20 client.31433 trim_cache size 0 max 16384 2024-08-31T06:29:11.519 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 -- 172.21.15.53:0/4069779540 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fefd80b4d20 msgr2=0x7fefd80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fefd80b4d20 0x7fefd80b7230 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009a60 tx=0x7fefe8005c30 comp rx=0 tx=0).stop 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 -- 172.21.15.53:0/4069779540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff0101d10 msgr2=0x7feff019a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff0101d10 0x7feff019a0b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009de0 tx=0x7fefe000c6a0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 -- 172.21.15.53:0/4069779540 shutdown_connections 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fefd80b4d20 0x7fefd80b7230 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feff0109ba0 0x7feff019f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feff0109250 0x7feff019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 --2- 172.21.15.53:0/4069779540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff0101d10 0x7feff019a0b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 -- 172.21.15.53:0/4069779540 >> 172.21.15.53:0/4069779540 conn(0x7feff0077a00 msgr2=0x7feff01051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 -- 172.21.15.53:0/4069779540 shutdown_connections 2024-08-31T06:29:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:11.513+0000 7feff58b2640 1 -- 172.21.15.53:0/4069779540 wait complete. 2024-08-31T06:29:12.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:11 smithi053 ceph-mon[18924]: pgmap v1087: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 253 op/s 2024-08-31T06:29:12.292 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:29:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:11 smithi130 ceph-mon[22266]: pgmap v1087: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 253 op/s 2024-08-31T06:29:12.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 69221 5.50 MB/sec execute 540 sec latency 93.291 ms 2024-08-31T06:29:12.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:11 smithi153 ceph-mon[22320]: pgmap v1087: 97 pgs: 97 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 253 op/s 2024-08-31T06:29:12.677 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.821+0000 7f9ddc453640 1 -- 172.21.15.53:0/2833749109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dd410daf0 msgr2=0x7f9dd4110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.821+0000 7f9ddc453640 1 --2- 172.21.15.53:0/2833749109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dd410daf0 0x7f9dd4110000 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009ca0 tx=0x7f9dcc02a8b0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.821+0000 7f9ddc453640 1 -- 172.21.15.53:0/2833749109 shutdown_connections 2024-08-31T06:29:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.821+0000 7f9ddc453640 1 --2- 172.21.15.53:0/2833749109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dd410daf0 0x7f9dd4110000 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.821+0000 7f9ddc453640 1 --2- 172.21.15.53:0/2833749109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd4104f70 0x7f9dd410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.821+0000 7f9ddc453640 1 --2- 172.21.15.53:0/2833749109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd4104540 0x7f9dd4104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.821+0000 7f9ddc453640 1 -- 172.21.15.53:0/2833749109 >> 172.21.15.53:0/2833749109 conn(0x7f9dd407a4e0 msgr2=0x7f9dd407a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.821+0000 7f9ddc453640 1 -- 172.21.15.53:0/2833749109 shutdown_connections 2024-08-31T06:29:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.821+0000 7f9ddc453640 1 -- 172.21.15.53:0/2833749109 wait complete. 2024-08-31T06:29:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.822+0000 7f9ddc453640 1 Processor -- start 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.822+0000 7f9ddc453640 1 -- start start 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.822+0000 7f9ddc453640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dd4104540 0x7f9dd4199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.822+0000 7f9ddc453640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd4104f70 0x7f9dd419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.822+0000 7f9ddc453640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd410daf0 0x7f9dd419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.822+0000 7f9ddc453640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4113680 con 0x7f9dd4104f70 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.822+0000 7f9ddc453640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4113500 con 0x7f9dd410daf0 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.822+0000 7f9ddc453640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4113800 con 0x7f9dd4104540 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dd99ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd4104f70 0x7f9dd419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dda1ef640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dd4104540 0x7f9dd4199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dda1ef640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dd4104540 0x7f9dd4199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44176/0 (socket says 172.21.15.53:44176) 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dda1ef640 1 -- 172.21.15.53:0/459936856 learned_addr learned my addr 172.21.15.53:0/459936856 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dda9f0640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd410daf0 0x7f9dd419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dda1ef640 1 -- 172.21.15.53:0/459936856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd410daf0 msgr2=0x7f9dd419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dda1ef640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd410daf0 0x7f9dd419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dda1ef640 1 -- 172.21.15.53:0/459936856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd4104f70 msgr2=0x7f9dd419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dda1ef640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd4104f70 0x7f9dd419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dda1ef640 1 -- 172.21.15.53:0/459936856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd419fe40 con 0x7f9dd4104540 2024-08-31T06:29:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dda1ef640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dd4104540 0x7f9dd4199fa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c920 tx=0x7f9dd000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dcb7fe640 1 -- 172.21.15.53:0/459936856 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0007bf0 con 0x7f9dd4104540 2024-08-31T06:29:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.823+0000 7f9dcb7fe640 1 -- 172.21.15.53:0/459936856 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9dd0007d90 con 0x7f9dd4104540 2024-08-31T06:29:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.824+0000 7f9dcb7fe640 1 -- 172.21.15.53:0/459936856 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0018730 con 0x7f9dd4104540 2024-08-31T06:29:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.824+0000 7f9ddc453640 1 -- 172.21.15.53:0/459936856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd41a0130 con 0x7f9dd4104540 2024-08-31T06:29:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.824+0000 7f9ddc453640 1 -- 172.21.15.53:0/459936856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd41a05d0 con 0x7f9dd4104540 2024-08-31T06:29:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.827+0000 7f9dcb7fe640 1 -- 172.21.15.53:0/459936856 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9dd000f450 con 0x7f9dd4104540 2024-08-31T06:29:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.827+0000 7f9de33c1740 1 Processor -- start 2024-08-31T06:29:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.827+0000 7f9de33c1740 1 -- start start 2024-08-31T06:29:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.827+0000 7f9dcb7fe640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9dc00b4ca0 0x7f9dc00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7e51b0 0x55b99fb88ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb89220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7c44d0 0x55b99fb89760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9de33c1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b99fafe000 con 0x55b99f7bc2f0 2024-08-31T06:29:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9de33c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b99faed590 con 0x55b99f7c44d0 2024-08-31T06:29:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9de33c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b99faf1540 con 0x55b99f7e51b0 2024-08-31T06:29:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9dd99ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb89220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9dcb7fe640 1 -- 172.21.15.53:0/459936856 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f9dd00e55c0 con 0x7f9dd4104540 2024-08-31T06:29:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9dd99ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb89220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49652/0 (socket says 172.21.15.53:49652) 2024-08-31T06:29:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9dd99ee640 1 -- 172.21.15.53:0/262181903 learned_addr learned my addr 172.21.15.53:0/262181903 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9dda9f0640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9dc00b4ca0 0x7f9dc00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9dda1ef640 1 --2- 172.21.15.53:0/262181903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7e51b0 0x55b99fb88ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9dd99ee640 1 -- 172.21.15.53:0/262181903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7e51b0 msgr2=0x55b99fb88ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/262181903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7e51b0 0x55b99fb88ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9dd99ee640 1 -- 172.21.15.53:0/262181903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7c44d0 msgr2=0x55b99fb89760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:29:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/262181903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7c44d0 0x55b99fb89760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.828+0000 7f9dd99ee640 1 -- 172.21.15.53:0/262181903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99f850790 con 0x55b99f7bc2f0 2024-08-31T06:29:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.829+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/262181903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb89220 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4010ab0 tx=0x7f9dc4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d842bee6ab5e38 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.829+0000 7f9dda9f0640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9dc00b4ca0 0x7f9dc00b71b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009a60 tx=0x7f9dcc043040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.829+0000 7f9dc8bfe640 1 -- 172.21.15.53:0/262181903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4004050 con 0x55b99f7bc2f0 2024-08-31T06:29:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.829+0000 7f9dc8bfe640 1 -- 172.21.15.53:0/262181903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9dc4005020 con 0x55b99f7bc2f0 2024-08-31T06:29:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.829+0000 7f9dc8bfe640 1 -- 172.21.15.53:0/262181903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4004ad0 con 0x55b99f7bc2f0 2024-08-31T06:29:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.830+0000 7f9de33c1740 1 -- 172.21.15.53:0/262181903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 msgr2=0x55b99fb89220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.830+0000 7f9de33c1740 1 --2- 172.21.15.53:0/262181903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb89220 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4010ab0 tx=0x7f9dc4005f90 comp rx=0 tx=0).stop 2024-08-31T06:29:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.830+0000 7f9de33c1740 1 -- 172.21.15.53:0/262181903 shutdown_connections 2024-08-31T06:29:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.830+0000 7f9de33c1740 1 --2- 172.21.15.53:0/262181903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7c44d0 0x55b99fb89760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.830+0000 7f9de33c1740 1 --2- 172.21.15.53:0/262181903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb89220 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.830+0000 7f9de33c1740 1 --2- 172.21.15.53:0/262181903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7e51b0 0x55b99fb88ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.830+0000 7f9de33c1740 1 -- 172.21.15.53:0/262181903 >> 172.21.15.53:0/262181903 conn(0x55b99f7d9300 msgr2=0x55b99fb86bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.830+0000 7f9de33c1740 1 -- 172.21.15.53:0/262181903 shutdown_connections 2024-08-31T06:29:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.830+0000 7f9de33c1740 1 -- 172.21.15.53:0/262181903 wait complete. 2024-08-31T06:29:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9de33c1740 1 -- start start 2024-08-31T06:29:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9de33c1740 1 Processor -- start 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb94870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb94db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7e51b0 0x55b99fba0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9dda1ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb94870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9de33c1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b99fa26ab0 con 0x55b99f7bc2f0 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9de33c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b99fa74680 con 0x55b99f7e51b0 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9de33c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b99fb97460 con 0x55b99f7c44d0 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9dda1ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb94870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49666/0 (socket says 172.21.15.53:49666) 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9dda1ef640 1 -- 172.21.15.53:0/3675520148 learned_addr learned my addr 172.21.15.53:0/3675520148 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.831+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb94db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9dda9f0640 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7e51b0 0x55b99fba0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9de33c1740 10 client.0 _ll_register_callbacks cb 0x55b99f7fca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9dda1ef640 1 -- 172.21.15.53:0/3675520148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 msgr2=0x55b99fb94db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9dda1ef640 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb94db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9dda1ef640 1 -- 172.21.15.53:0/3675520148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7e51b0 msgr2=0x55b99fba0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9dda1ef640 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7e51b0 0x55b99fba0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9dda1ef640 1 -- 172.21.15.53:0/3675520148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b99f8c9620 con 0x55b99f7bc2f0 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9dda1ef640 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb94870 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00abbf0 tx=0x7f9dd000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e63a73bc7626c2b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9dbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9dbdffb640 1 -- 172.21.15.53:0/3675520148 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00ac360 con 0x55b99f7bc2f0 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9dbdffb640 1 -- 172.21.15.53:0/3675520148 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f9dd008b030 con 0x55b99f7bc2f0 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.832+0000 7f9de33c1740 1 -- 172.21.15.53:0/3675520148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dc4005020 con 0x55b99f7bc2f0 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.833+0000 7f9dbdffb640 1 -- 172.21.15.53:0/3675520148 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f9dd00abc60 con 0x55b99f7bc2f0 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.833+0000 7f9de33c1740 10 client.22800 fetch_fsmap learned FSMap version 89 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.833+0000 7f9de33c1740 1 -- 172.21.15.53:0/3675520148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) -- 0x55b99fbb44d0 con 0x55b99f7bc2f0 2024-08-31T06:29:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.833+0000 7f9dbdffb640 1 -- 172.21.15.53:0/3675520148 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9dc4005020 con 0x55b99f7bc2f0 2024-08-31T06:29:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.833+0000 7f9dbdffb640 1 -- 172.21.15.53:0/3675520148 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 89) ==== 8366+0+0 (secure 0 0 0) 0x7f9dd00a7ef0 con 0x55b99f7bc2f0 2024-08-31T06:29:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.833+0000 7f9de33c1740 10 client.22800 fetch_fsmap finished waiting for FSMap version 89 2024-08-31T06:29:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.833+0000 7f9de33c1740 10 client.22800 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.833+0000 7f9de33c1740 20 client.22800 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.833+0000 7f9de33c1740 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b99f7a3d80 0x55b99fbb79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.833+0000 7f9de33c1740 4 client.22800 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.833+0000 7f9de33c1740 1 -- 172.21.15.53:0/3675520148 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b99fafff50 con 0x55b99f7a3d80 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.834+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b99f7a3d80 0x55b99fbb79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.834+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b99f7a3d80 0x55b99fbb79a0 crc :-1 s=READY pgs=562 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2d18d626bef0a96 server_cookie=6fd2168354418775 in_seq=0 out_seq=0 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.834+0000 7f9dbdffb640 10 client.22800 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9dbdffb640 1 -- 172.21.15.53:0/3675520148 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b99fafff50 con 0x55b99f7a3d80 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9dbdffb640 10 client.22800 handle_command_reply: tid=0 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9de33c1740 1 client.22800 shutdown 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9de33c1740 1 -- 172.21.15.53:0/3675520148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 msgr2=0x55b99fb94870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9de33c1740 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb94870 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00abbf0 tx=0x7f9dd000fc30 comp rx=0 tx=0).stop 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9de33c1740 1 -- 172.21.15.53:0/3675520148 shutdown_connections 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9de33c1740 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b99f7a3d80 0x55b99fbb79a0 crc :-1 s=READY pgs=562 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9de33c1740 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7e51b0 0x55b99fba0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9de33c1740 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb94db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9dbdffb640 0 client.22800 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9de33c1740 1 --2- 172.21.15.53:0/3675520148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb94870 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.835+0000 7f9de33c1740 1 -- 172.21.15.53:0/3675520148 >> 172.21.15.53:0/3675520148 conn(0x55b99f7d9300 msgr2=0x55b99fb89d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.836+0000 7f9de33c1740 1 -- 172.21.15.53:0/3675520148 shutdown_connections 2024-08-31T06:29:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.836+0000 7f9de33c1740 1 -- 172.21.15.53:0/3675520148 wait complete. 2024-08-31T06:29:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.836+0000 7f9de33c1740 20 client.22800 trim_cache size 0 max 16384 2024-08-31T06:29:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.860+0000 7f9de33c1740 1 Processor -- start 2024-08-31T06:29:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.860+0000 7f9de33c1740 1 -- start start 2024-08-31T06:29:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.860+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7a3d80 0x55b99fb8a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.860+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb8edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.860+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb96220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.860+0000 7f9de33c1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4073470 con 0x55b99f7bc2f0 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.860+0000 7f9de33c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4074fe0 con 0x55b99f7a3d80 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.860+0000 7f9de33c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4073b40 con 0x55b99f7c44d0 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.860+0000 7f9dd99ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb8edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dd99ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb8edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49676/0 (socket says 172.21.15.53:49676) 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dd99ee640 1 -- 172.21.15.53:0/2330882418 learned_addr learned my addr 172.21.15.53:0/2330882418 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dda9f0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb96220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dda1ef640 1 --2- 172.21.15.53:0/2330882418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7a3d80 0x55b99fb8a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dd99ee640 1 -- 172.21.15.53:0/2330882418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 msgr2=0x55b99fb96220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/2330882418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb96220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dd99ee640 1 -- 172.21.15.53:0/2330882418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7a3d80 msgr2=0x55b99fb8a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/2330882418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7a3d80 0x55b99fb8a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dd99ee640 1 -- 172.21.15.53:0/2330882418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99fb8baf0 con 0x55b99f7bc2f0 2024-08-31T06:29:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/2330882418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb8edb0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009230 tx=0x7f9dc4010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ae2b78d097d1d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dbffff640 1 -- 172.21.15.53:0/2330882418 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4005490 con 0x55b99f7bc2f0 2024-08-31T06:29:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dbffff640 1 -- 172.21.15.53:0/2330882418 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9dc4005630 con 0x55b99f7bc2f0 2024-08-31T06:29:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.861+0000 7f9dbffff640 1 -- 172.21.15.53:0/2330882418 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40185e0 con 0x55b99f7bc2f0 2024-08-31T06:29:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.863+0000 7f9de33c1740 1 -- 172.21.15.53:0/2330882418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 msgr2=0x55b99fb8edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.863+0000 7f9de33c1740 1 --2- 172.21.15.53:0/2330882418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb8edb0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009230 tx=0x7f9dc4010830 comp rx=0 tx=0).stop 2024-08-31T06:29:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.863+0000 7f9de33c1740 1 -- 172.21.15.53:0/2330882418 shutdown_connections 2024-08-31T06:29:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.863+0000 7f9de33c1740 1 --2- 172.21.15.53:0/2330882418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb96220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.863+0000 7f9de33c1740 1 --2- 172.21.15.53:0/2330882418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7bc2f0 0x55b99fb8edb0 secure :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009230 tx=0x7f9dc4010830 comp rx=0 tx=0).stop 2024-08-31T06:29:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.863+0000 7f9de33c1740 1 --2- 172.21.15.53:0/2330882418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7a3d80 0x55b99fb8a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.863+0000 7f9de33c1740 1 -- 172.21.15.53:0/2330882418 >> 172.21.15.53:0/2330882418 conn(0x55b99f7d9300 msgr2=0x55b99fb95b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.863+0000 7f9de33c1740 1 -- 172.21.15.53:0/2330882418 shutdown_connections 2024-08-31T06:29:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.863+0000 7f9de33c1740 1 -- 172.21.15.53:0/2330882418 wait complete. 2024-08-31T06:29:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.864+0000 7f9de33c1740 1 -- start start 2024-08-31T06:29:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.864+0000 7f9de33c1740 1 Processor -- start 2024-08-31T06:29:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.864+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7a3d80 0x55b99fb986c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.864+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb98c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.864+0000 7f9de33c1740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7e51b0 0x55b99fb99140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9de33c1740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4074910 con 0x55b99f7e51b0 2024-08-31T06:29:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9de33c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4074210 con 0x55b99f7a3d80 2024-08-31T06:29:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9de33c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4071470 con 0x55b99f7c44d0 2024-08-31T06:29:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9de33c1740 10 client.0 _ll_register_callbacks cb 0x7f9dd000a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9dd99ee640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb98c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9dd99ee640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb98c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:44214/0 (socket says 172.21.15.53:44214) 2024-08-31T06:29:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9dd99ee640 1 -- 172.21.15.53:0/239907713 learned_addr learned my addr 172.21.15.53:0/239907713 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9dda1ef640 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7a3d80 0x55b99fb986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9dd99ee640 1 -- 172.21.15.53:0/239907713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7a3d80 msgr2=0x55b99fb986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7a3d80 0x55b99fb986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9dd99ee640 1 -- 172.21.15.53:0/239907713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7e51b0 msgr2=0x55b99fb99140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9dda9f0640 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7e51b0 0x55b99fb99140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7e51b0 0x55b99fb99140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9dd99ee640 1 -- 172.21.15.53:0/239907713 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b99fc21330 con 0x55b99f7c44d0 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.865+0000 7f9dda9f0640 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7e51b0 0x55b99fb99140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.866+0000 7f9dd99ee640 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb98c00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4010530 tx=0x7f9dc4009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=843f9537c3bedbbd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.866+0000 7f9dbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.866+0000 7f9dbdffb640 1 -- 172.21.15.53:0/239907713 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc403a070 con 0x55b99f7c44d0 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.866+0000 7f9dbdffb640 1 -- 172.21.15.53:0/239907713 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f9dc40035f0 con 0x55b99f7c44d0 2024-08-31T06:29:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.866+0000 7f9de33c1740 1 -- 172.21.15.53:0/239907713 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b99fafb9f0 con 0x55b99f7c44d0 2024-08-31T06:29:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.867+0000 7f9dbdffb640 1 -- 172.21.15.53:0/239907713 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f9dc4046050 con 0x55b99f7c44d0 2024-08-31T06:29:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.867+0000 7f9de33c1740 10 client.31444 fetch_fsmap learned FSMap version 89 2024-08-31T06:29:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.867+0000 7f9de33c1740 1 -- 172.21.15.53:0/239907713 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) -- 0x55b99fc22590 con 0x55b99f7c44d0 2024-08-31T06:29:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.867+0000 7f9dbdffb640 1 -- 172.21.15.53:0/239907713 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b99fafb9f0 con 0x55b99f7c44d0 2024-08-31T06:29:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.868+0000 7f9dbdffb640 1 -- 172.21.15.53:0/239907713 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 89) ==== 8366+0+0 (secure 0 0 0) 0x7f9dc4018660 con 0x55b99f7c44d0 2024-08-31T06:29:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.868+0000 7f9de33c1740 10 client.31444 fetch_fsmap finished waiting for FSMap version 89 2024-08-31T06:29:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.868+0000 7f9de33c1740 10 client.31444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.868+0000 7f9de33c1740 20 client.31444 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.868+0000 7f9de33c1740 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b99f7791c0 0x55b99fc249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.868+0000 7f9de33c1740 4 client.31444 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:29:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.868+0000 7f9de33c1740 1 -- 172.21.15.53:0/239907713 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b99faf9130 con 0x55b99f7791c0 2024-08-31T06:29:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.868+0000 7f9dda1ef640 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b99f7791c0 0x55b99fc249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.868+0000 7f9dbdffb640 10 client.31444 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:12.869+0000 7f9dda1ef640 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b99f7791c0 0x55b99fc249d0 crc :-1 s=READY pgs=563 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a5699730d8fe990 server_cookie=9e7f25d2611e1478 in_seq=0 out_seq=0 2024-08-31T06:29:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.134+0000 7f9dbdffb640 1 -- 172.21.15.53:0/239907713 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b99faf9130 con 0x55b99f7791c0 2024-08-31T06:29:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.134+0000 7f9dbdffb640 10 client.31444 handle_command_reply: tid=0 2024-08-31T06:29:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.134+0000 7f9de33c1740 1 client.31444 shutdown 2024-08-31T06:29:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9de33c1740 1 -- 172.21.15.53:0/239907713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 msgr2=0x55b99fb98c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9de33c1740 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb98c00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4010530 tx=0x7f9dc4009f00 comp rx=0 tx=0).stop 2024-08-31T06:29:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9de33c1740 1 -- 172.21.15.53:0/239907713 shutdown_connections 2024-08-31T06:29:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9de33c1740 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55b99f7791c0 0x55b99fc249d0 crc :-1 s=READY pgs=563 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9de33c1740 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b99f7e51b0 0x55b99fb99140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9de33c1740 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b99f7c44d0 0x55b99fb98c00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9de33c1740 1 --2- 172.21.15.53:0/239907713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b99f7a3d80 0x55b99fb986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9de33c1740 1 -- 172.21.15.53:0/239907713 >> 172.21.15.53:0/239907713 conn(0x55b99f7d9300 msgr2=0x55b99fb95920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9dbdffb640 0 client.31444 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9de33c1740 1 -- 172.21.15.53:0/239907713 shutdown_connections 2024-08-31T06:29:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9de33c1740 1 -- 172.21.15.53:0/239907713 wait complete. 2024-08-31T06:29:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.135+0000 7f9de33c1740 20 client.31444 trim_cache size 0 max 16384 2024-08-31T06:29:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:29:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:29:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:29:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:29:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.136+0000 7f9ddc453640 1 -- 172.21.15.53:0/459936856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9dc00b4ca0 msgr2=0x7f9dc00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.136+0000 7f9ddc453640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9dc00b4ca0 0x7f9dc00b71b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009a60 tx=0x7f9dcc043040 comp rx=0 tx=0).stop 2024-08-31T06:29:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.136+0000 7f9ddc453640 1 -- 172.21.15.53:0/459936856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dd4104540 msgr2=0x7f9dd4199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.136+0000 7f9ddc453640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dd4104540 0x7f9dd4199fa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c920 tx=0x7f9dd000cde0 comp rx=0 tx=0).stop 2024-08-31T06:29:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.136+0000 7f9ddc453640 1 -- 172.21.15.53:0/459936856 shutdown_connections 2024-08-31T06:29:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.136+0000 7f9ddc453640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f9dc00b4ca0 0x7f9dc00b71b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.136+0000 7f9ddc453640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd410daf0 0x7f9dd419f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.136+0000 7f9ddc453640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd4104f70 0x7f9dd419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.136+0000 7f9ddc453640 1 --2- 172.21.15.53:0/459936856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9dd4104540 0x7f9dd4199fa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.136+0000 7f9ddc453640 1 -- 172.21.15.53:0/459936856 >> 172.21.15.53:0/459936856 conn(0x7f9dd407a4e0 msgr2=0x7f9dd4107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.137+0000 7f9ddc453640 1 -- 172.21.15.53:0/459936856 shutdown_connections 2024-08-31T06:29:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:13.137+0000 7f9ddc453640 1 -- 172.21.15.53:0/459936856 wait complete. 2024-08-31T06:29:13.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:12 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:29:13.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:12 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:29:13.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 69343 5.50 MB/sec execute 541 sec latency 265.705 ms 2024-08-31T06:29:13.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:12 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:29:14.229 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:13 smithi053 ceph-mon[18924]: pgmap v1088: 97 pgs: 97 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 261 op/s 2024-08-31T06:29:14.229 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:13 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:29:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.365+0000 7f5036f27640 1 -- 172.21.15.53:0/2677704331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5030108170 msgr2=0x7f5030108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:14.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.365+0000 7f5036f27640 1 --2- 172.21.15.53:0/2677704331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5030108170 0x7f5030108580 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f501c009900 tx=0x7f501c02a410 comp rx=0 tx=0).stop 2024-08-31T06:29:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.365+0000 7f5036f27640 1 -- 172.21.15.53:0/2677704331 shutdown_connections 2024-08-31T06:29:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.365+0000 7f5036f27640 1 --2- 172.21.15.53:0/2677704331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5030108ac0 0x7f503010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.365+0000 7f5036f27640 1 --2- 172.21.15.53:0/2677704331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5030108170 0x7f5030108580 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.365+0000 7f5036f27640 1 --2- 172.21.15.53:0/2677704331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5030102880 0x7f5030102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.365+0000 7f5036f27640 1 -- 172.21.15.53:0/2677704331 >> 172.21.15.53:0/2677704331 conn(0x7f5030079530 msgr2=0x7f5030079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:14.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.365+0000 7f5036f27640 1 -- 172.21.15.53:0/2677704331 shutdown_connections 2024-08-31T06:29:14.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.365+0000 7f5036f27640 1 -- 172.21.15.53:0/2677704331 wait complete. 2024-08-31T06:29:14.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.366+0000 7f5036f27640 1 Processor -- start 2024-08-31T06:29:14.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.366+0000 7f5036f27640 1 -- start start 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.367+0000 7f5036f27640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5030102880 0x7f5030197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.367+0000 7f5036f27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5030108170 0x7f5030198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.367+0000 7f5036f27640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5030108ac0 0x7f503019d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.367+0000 7f5034cc3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5030102880 0x7f5030197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.367+0000 7f5036f27640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5030112630 con 0x7f5030108170 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.367+0000 7f502ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5030108170 0x7f5030198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.367+0000 7f5034cc3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5030102880 0x7f5030197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49070/0 (socket says 172.21.15.53:49070) 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.367+0000 7f5034cc3640 1 -- 172.21.15.53:0/1076909219 learned_addr learned my addr 172.21.15.53:0/1076909219 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.367+0000 7f50354c4640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5030108ac0 0x7f503019d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.367+0000 7f5036f27640 1 -- 172.21.15.53:0/1076909219 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50301124b0 con 0x7f5030108ac0 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.367+0000 7f5036f27640 1 -- 172.21.15.53:0/1076909219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f50301127b0 con 0x7f5030102880 2024-08-31T06:29:14.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.368+0000 7f5034cc3640 1 -- 172.21.15.53:0/1076909219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5030108ac0 msgr2=0x7f503019d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:14.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.368+0000 7f5034cc3640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5030108ac0 0x7f503019d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.368+0000 7f5034cc3640 1 -- 172.21.15.53:0/1076909219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5030108170 msgr2=0x7f5030198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:14.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.368+0000 7f5034cc3640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5030108170 0x7f5030198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.368+0000 7f5034cc3640 1 -- 172.21.15.53:0/1076909219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503019dd10 con 0x7f5030102880 2024-08-31T06:29:14.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.369+0000 7f502ffff640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5030108170 0x7f5030198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:14.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.369+0000 7f5034cc3640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5030102880 0x7f5030197da0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5024009f50 tx=0x7f502400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:14.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.369+0000 7f502dffb640 1 -- 172.21.15.53:0/1076909219 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502400cce0 con 0x7f5030102880 2024-08-31T06:29:14.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.369+0000 7f502dffb640 1 -- 172.21.15.53:0/1076909219 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f50240218d0 con 0x7f5030102880 2024-08-31T06:29:14.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.369+0000 7f502dffb640 1 -- 172.21.15.53:0/1076909219 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024029840 con 0x7f5030102880 2024-08-31T06:29:14.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.369+0000 7f5036f27640 1 -- 172.21.15.53:0/1076909219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503019dfa0 con 0x7f5030102880 2024-08-31T06:29:14.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.370+0000 7f5036f27640 1 -- 172.21.15.53:0/1076909219 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f503019e750 con 0x7f5030102880 2024-08-31T06:29:14.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.373+0000 7f503d49c740 1 Processor -- start 2024-08-31T06:29:14.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.373+0000 7f503d49c740 1 -- start start 2024-08-31T06:29:14.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.373+0000 7f503d49c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f420537350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.373+0000 7f503d49c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420537890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.373+0000 7f503d49c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420537dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.373+0000 7f503d49c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f4204ae680 con 0x55f420171390 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.373+0000 7f503d49c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f42049dc10 con 0x55f4201691b0 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.373+0000 7f503d49c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f4204a1bc0 con 0x55f420192070 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.374+0000 7f502ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420537dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.374+0000 7f502ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420537dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35138/0 (socket says 172.21.15.53:35138) 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.374+0000 7f502ffff640 1 -- 172.21.15.53:0/3608724260 learned_addr learned my addr 172.21.15.53:0/3608724260 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.374+0000 7f50354c4640 1 --2- 172.21.15.53:0/3608724260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f420537350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.374+0000 7f50354c4640 1 -- 172.21.15.53:0/3608724260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 msgr2=0x55f420537890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.374+0000 7f50354c4640 1 --2- 172.21.15.53:0/3608724260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420537890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.374+0000 7f50354c4640 1 -- 172.21.15.53:0/3608724260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 msgr2=0x55f420537dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.374+0000 7f50354c4640 1 --2- 172.21.15.53:0/3608724260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420537dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.374+0000 7f50354c4640 1 -- 172.21.15.53:0/3608724260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4201fd650 con 0x55f420192070 2024-08-31T06:29:14.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.375+0000 7f502ffff640 1 --2- 172.21.15.53:0/3608724260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420537dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:14.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.375+0000 7f502dffb640 1 -- 172.21.15.53:0/1076909219 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5024021440 con 0x7f5030102880 2024-08-31T06:29:14.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.375+0000 7f50354c4640 1 --2- 172.21.15.53:0/3608724260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f420537350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5028009f00 tx=0x7f5028011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb7e5812599ac0f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:14.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.375+0000 7f501affd640 1 -- 172.21.15.53:0/3608724260 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028004d20 con 0x55f420192070 2024-08-31T06:29:14.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.375+0000 7f501affd640 1 -- 172.21.15.53:0/3608724260 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5028004030 con 0x55f420192070 2024-08-31T06:29:14.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.375+0000 7f501affd640 1 -- 172.21.15.53:0/3608724260 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028005260 con 0x55f420192070 2024-08-31T06:29:14.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:13 smithi130 ceph-mon[22266]: pgmap v1088: 97 pgs: 97 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 261 op/s 2024-08-31T06:29:14.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:13 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:29:14.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.376+0000 7f502dffb640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50200b4d20 0x7f50200b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.376+0000 7f5034cc3640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50200b4d20 0x7f50200b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.376+0000 7f502dffb640 1 -- 172.21.15.53:0/1076909219 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f50240f6870 con 0x7f5030102880 2024-08-31T06:29:14.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.376+0000 7f503d49c740 1 -- 172.21.15.53:0/3608724260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 msgr2=0x55f420537350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:14.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.376+0000 7f503d49c740 1 --2- 172.21.15.53:0/3608724260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f420537350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5028009f00 tx=0x7f5028011810 comp rx=0 tx=0).stop 2024-08-31T06:29:14.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.377+0000 7f503d49c740 1 -- 172.21.15.53:0/3608724260 shutdown_connections 2024-08-31T06:29:14.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.377+0000 7f503d49c740 1 --2- 172.21.15.53:0/3608724260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420537dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.377+0000 7f503d49c740 1 --2- 172.21.15.53:0/3608724260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420537890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.377+0000 7f503d49c740 1 --2- 172.21.15.53:0/3608724260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f420537350 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.377+0000 7f503d49c740 1 -- 172.21.15.53:0/3608724260 >> 172.21.15.53:0/3608724260 conn(0x55f420186460 msgr2=0x55f420535240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.377+0000 7f503d49c740 1 -- 172.21.15.53:0/3608724260 shutdown_connections 2024-08-31T06:29:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.377+0000 7f503d49c740 1 -- 172.21.15.53:0/3608724260 wait complete. 2024-08-31T06:29:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.378+0000 7f503d49c740 1 -- start start 2024-08-31T06:29:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.378+0000 7f503d49c740 1 Processor -- start 2024-08-31T06:29:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.378+0000 7f5034cc3640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50200b4d20 0x7f50200b7230 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55f420535fd0 tx=0x7f502400ce80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.378+0000 7f503d49c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4201691b0 0x55f420542ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.378+0000 7f503d49c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420171390 0x55f420543010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.378+0000 7f503d49c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f420192070 0x55f42054ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.378+0000 7f503d49c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f420300700 con 0x55f4201691b0 2024-08-31T06:29:14.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.378+0000 7f503d49c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f420424750 con 0x55f420192070 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.378+0000 7f503d49c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f420545b30 con 0x55f420171390 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.379+0000 7f503d49c740 10 client.0 _ll_register_callbacks cb 0x55f420453e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.379+0000 7f502ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420171390 0x55f420543010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.379+0000 7f502ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420171390 0x55f420543010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49086/0 (socket says 172.21.15.53:49086) 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.379+0000 7f502ffff640 1 -- 172.21.15.53:0/1832026954 learned_addr learned my addr 172.21.15.53:0/1832026954 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.379+0000 7f50354c4640 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4201691b0 0x55f420542ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.379+0000 7f50354c4640 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f420192070 0x55f42054ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.379+0000 7f502ffff640 1 -- 172.21.15.53:0/1832026954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f420192070 msgr2=0x55f42054ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.379+0000 7f502ffff640 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f420192070 0x55f42054ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.379+0000 7f502ffff640 1 -- 172.21.15.53:0/1832026954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4201691b0 msgr2=0x55f420542ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.379+0000 7f502ffff640 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4201691b0 0x55f420542ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.379+0000 7f502ffff640 1 -- 172.21.15.53:0/1832026954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42045d900 con 0x55f420171390 2024-08-31T06:29:14.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.380+0000 7f502ffff640 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420171390 0x55f420543010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f501c02aa00 tx=0x7f501c0043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb68d703d259072d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:14.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.380+0000 7f500ffff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:29:14.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.380+0000 7f500ffff640 1 -- 172.21.15.53:0/1832026954 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c035040 con 0x55f420171390 2024-08-31T06:29:14.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.380+0000 7f500ffff640 1 -- 172.21.15.53:0/1832026954 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f501c032bd0 con 0x55f420171390 2024-08-31T06:29:14.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.380+0000 7f503d49c740 1 -- 172.21.15.53:0/1832026954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5028004030 con 0x55f420171390 2024-08-31T06:29:14.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.381+0000 7f500ffff640 1 -- 172.21.15.53:0/1832026954 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f501c032e10 con 0x55f420171390 2024-08-31T06:29:14.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.381+0000 7f503d49c740 10 client.31456 fetch_fsmap learned FSMap version 89 2024-08-31T06:29:14.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.381+0000 7f503d49c740 1 -- 172.21.15.53:0/1832026954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) -- 0x55f420551940 con 0x55f420171390 2024-08-31T06:29:14.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.381+0000 7f500ffff640 1 -- 172.21.15.53:0/1832026954 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5028004030 con 0x55f420171390 2024-08-31T06:29:14.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.381+0000 7f500ffff640 1 -- 172.21.15.53:0/1832026954 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 89) ==== 8366+0+0 (secure 0 0 0) 0x7f501c044020 con 0x55f420171390 2024-08-31T06:29:14.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.381+0000 7f503d49c740 10 client.31456 fetch_fsmap finished waiting for FSMap version 89 2024-08-31T06:29:14.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.381+0000 7f503d49c740 10 client.31456 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.381+0000 7f503d49c740 20 client.31456 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.381+0000 7f503d49c740 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f4201509f0 0x55f420555120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.381+0000 7f503d49c740 4 client.31456 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.381+0000 7f503d49c740 1 -- 172.21.15.53:0/1832026954 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4204b05d0 con 0x55f4201509f0 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.382+0000 7f50354c4640 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f4201509f0 0x55f420555120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.382+0000 7f50354c4640 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f4201509f0 0x55f420555120 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c87870a31477563d server_cookie=ae02f4f5d03a84a in_seq=0 out_seq=0 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.382+0000 7f500ffff640 10 client.31456 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.384+0000 7f500ffff640 1 -- 172.21.15.53:0/1832026954 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f4204b05d0 con 0x55f4201509f0 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.384+0000 7f500ffff640 10 client.31456 handle_command_reply: tid=0 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.384+0000 7f503d49c740 1 client.31456 shutdown 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.384+0000 7f503d49c740 1 -- 172.21.15.53:0/1832026954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420171390 msgr2=0x55f420543010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:14.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.384+0000 7f503d49c740 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420171390 0x55f420543010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f501c02aa00 tx=0x7f501c0043b0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.385+0000 7f503d49c740 1 -- 172.21.15.53:0/1832026954 shutdown_connections 2024-08-31T06:29:14.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.385+0000 7f503d49c740 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f4201509f0 0x55f420555120 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.385+0000 7f503d49c740 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f420192070 0x55f42054ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.385+0000 7f503d49c740 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420171390 0x55f420543010 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.385+0000 7f503d49c740 1 --2- 172.21.15.53:0/1832026954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4201691b0 0x55f420542ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.385+0000 7f503d49c740 1 -- 172.21.15.53:0/1832026954 >> 172.21.15.53:0/1832026954 conn(0x55f420186460 msgr2=0x55f42053a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:14.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.385+0000 7f500ffff640 0 client.31456 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:29:14.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.385+0000 7f503d49c740 1 -- 172.21.15.53:0/1832026954 shutdown_connections 2024-08-31T06:29:14.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.385+0000 7f503d49c740 1 -- 172.21.15.53:0/1832026954 wait complete. 2024-08-31T06:29:14.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.386+0000 7f503d49c740 20 client.31456 trim_cache size 0 max 16384 2024-08-31T06:29:14.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 69430 5.50 MB/sec execute 542 sec latency 206.741 ms 2024-08-31T06:29:14.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.410+0000 7f503d49c740 1 Processor -- start 2024-08-31T06:29:14.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.410+0000 7f503d49c740 1 -- start start 2024-08-31T06:29:14.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.410+0000 7f503d49c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420541350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.410+0000 7f503d49c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420541890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f502ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420541890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f50354c4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420541350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f50354c4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420541350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39170/0 (socket says 172.21.15.53:39170) 2024-08-31T06:29:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f502ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420541890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35154/0 (socket says 172.21.15.53:35154) 2024-08-31T06:29:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f503d49c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f42053a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f50354c4640 1 -- 172.21.15.53:0/576987648 learned_addr learned my addr 172.21.15.53:0/576987648 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f503d49c740 1 -- 172.21.15.53:0/576987648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5030073c30 con 0x55f420171390 2024-08-31T06:29:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f503d49c740 1 -- 172.21.15.53:0/576987648 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50301b7760 con 0x55f4201691b0 2024-08-31T06:29:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f503d49c740 1 -- 172.21.15.53:0/576987648 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5030074300 con 0x55f420192070 2024-08-31T06:29:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f50354c4640 1 --2- 172.21.15.53:0/576987648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f42053a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f50354c4640 1 -- 172.21.15.53:0/576987648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 msgr2=0x55f42053a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f50354c4640 1 --2- 172.21.15.53:0/576987648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f42053a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f50354c4640 1 -- 172.21.15.53:0/576987648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 msgr2=0x55f420541890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f50354c4640 1 --2- 172.21.15.53:0/576987648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420541890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f50354c4640 1 -- 172.21.15.53:0/576987648 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f420543d90 con 0x55f4201691b0 2024-08-31T06:29:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.411+0000 7f50354c4640 1 --2- 172.21.15.53:0/576987648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420541350 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5028009ed0 tx=0x7f5028005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ddc282fca348e28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.412+0000 7f501a7fc640 1 -- 172.21.15.53:0/576987648 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028034070 con 0x55f4201691b0 2024-08-31T06:29:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.412+0000 7f501a7fc640 1 -- 172.21.15.53:0/576987648 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5028003a30 con 0x55f4201691b0 2024-08-31T06:29:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.412+0000 7f501a7fc640 1 -- 172.21.15.53:0/576987648 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028005290 con 0x55f4201691b0 2024-08-31T06:29:14.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.413+0000 7f503d49c740 1 -- 172.21.15.53:0/576987648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 msgr2=0x55f420541350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:14.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.413+0000 7f503d49c740 1 --2- 172.21.15.53:0/576987648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420541350 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5028009ed0 tx=0x7f5028005bd0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.413+0000 7f503d49c740 1 -- 172.21.15.53:0/576987648 shutdown_connections 2024-08-31T06:29:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.413+0000 7f503d49c740 1 --2- 172.21.15.53:0/576987648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f42053a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.413+0000 7f503d49c740 1 --2- 172.21.15.53:0/576987648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420541890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.413+0000 7f503d49c740 1 --2- 172.21.15.53:0/576987648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420541350 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.413+0000 7f503d49c740 1 -- 172.21.15.53:0/576987648 >> 172.21.15.53:0/576987648 conn(0x55f420186460 msgr2=0x55f42053dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.414+0000 7f503d49c740 1 -- 172.21.15.53:0/576987648 shutdown_connections 2024-08-31T06:29:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.414+0000 7f503d49c740 1 -- 172.21.15.53:0/576987648 wait complete. 2024-08-31T06:29:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.414+0000 7f503d49c740 1 -- start start 2024-08-31T06:29:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.415+0000 7f503d49c740 1 Processor -- start 2024-08-31T06:29:14.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.415+0000 7f503d49c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420555b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.415+0000 7f503d49c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420556160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.415+0000 7f503d49c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f4205b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.415+0000 7f503d49c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f50300750d0 con 0x55f420171390 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.415+0000 7f503d49c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50300749d0 con 0x55f4201691b0 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.415+0000 7f503d49c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5030071c30 con 0x55f420192070 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.415+0000 7f503d49c740 10 client.0 _ll_register_callbacks cb 0x7f501c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.415+0000 7f50354c4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420555b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f50354c4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420555b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39178/0 (socket says 172.21.15.53:39178) 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f50354c4640 1 -- 172.21.15.53:0/4119373472 learned_addr learned my addr 172.21.15.53:0/4119373472 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f50354c4640 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f4205b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f50354c4640 1 -- 172.21.15.53:0/4119373472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 msgr2=0x55f420555b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f50354c4640 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420555b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f50354c4640 1 -- 172.21.15.53:0/4119373472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 msgr2=0x55f420556160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:14.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f502ffff640 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420556160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f50354c4640 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420556160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f50354c4640 1 -- 172.21.15.53:0/4119373472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4205b7030 con 0x55f420192070 2024-08-31T06:29:14.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f502ffff640 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420556160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:29:14.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f500ffff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:29:14.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f50354c4640 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f4205b69c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5028009d40 tx=0x7f5028011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c15192269f61496a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:14.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f500ffff640 1 -- 172.21.15.53:0/4119373472 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028034070 con 0x55f420192070 2024-08-31T06:29:14.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f500ffff640 1 -- 172.21.15.53:0/4119373472 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 8601+0+0 (secure 0 0 0) 0x7f5028004080 con 0x55f420192070 2024-08-31T06:29:14.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.416+0000 7f503d49c740 1 -- 172.21.15.53:0/4119373472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5028003a30 con 0x55f420192070 2024-08-31T06:29:14.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.417+0000 7f500ffff640 1 -- 172.21.15.53:0/4119373472 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f5028045050 con 0x55f420192070 2024-08-31T06:29:14.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.417+0000 7f503d49c740 10 client.31462 fetch_fsmap learned FSMap version 89 2024-08-31T06:29:14.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.417+0000 7f503d49c740 1 -- 172.21.15.53:0/4119373472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) -- 0x55f4205bf550 con 0x55f420192070 2024-08-31T06:29:14.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.417+0000 7f500ffff640 1 -- 172.21.15.53:0/4119373472 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5028003a30 con 0x55f420192070 2024-08-31T06:29:14.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.418+0000 7f500ffff640 1 -- 172.21.15.53:0/4119373472 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 89) ==== 8366+0+0 (secure 0 0 0) 0x7f5028018070 con 0x55f420192070 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.418+0000 7f503d49c740 10 client.31462 fetch_fsmap finished waiting for FSMap version 89 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.418+0000 7f503d49c740 10 client.31462 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.418+0000 7f503d49c740 20 client.31462 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.418+0000 7f503d49c740 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f420125da0 0x55f4205c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.418+0000 7f503d49c740 4 client.31462 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.418+0000 7f503d49c740 1 -- 172.21.15.53:0/4119373472 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f4204ac070 con 0x55f420125da0 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.418+0000 7f502ffff640 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f420125da0 0x55f4205c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.418+0000 7f502ffff640 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f420125da0 0x55f4205c1aa0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d21a8db1d2327375 server_cookie=7239997bfe328f41 in_seq=0 out_seq=0 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.418+0000 7f500ffff640 10 client.31462 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.418+0000 7f500ffff640 1 -- 172.21.15.53:0/4119373472 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f4204ac070 con 0x55f420125da0 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f500ffff640 10 client.31462 handle_command_reply: tid=0 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 1 client.31462 shutdown 2024-08-31T06:29:14.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 1 -- 172.21.15.53:0/4119373472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 msgr2=0x55f4205b69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:14.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f4205b69c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5028009d40 tx=0x7f5028011810 comp rx=0 tx=0).stop 2024-08-31T06:29:14.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 1 -- 172.21.15.53:0/4119373472 shutdown_connections 2024-08-31T06:29:14.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55f420125da0 0x55f4205c1aa0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f420192070 0x55f4205b69c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f420171390 0x55f420556160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f500ffff640 0 client.31462 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:29:14.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 1 --2- 172.21.15.53:0/4119373472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f4201691b0 0x55f420555b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 1 -- 172.21.15.53:0/4119373472 >> 172.21.15.53:0/4119373472 conn(0x55f420186460 msgr2=0x55f42053dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:14.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 1 -- 172.21.15.53:0/4119373472 shutdown_connections 2024-08-31T06:29:14.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 1 -- 172.21.15.53:0/4119373472 wait complete. 2024-08-31T06:29:14.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.419+0000 7f503d49c740 20 client.31462 trim_cache size 0 max 16384 2024-08-31T06:29:14.424 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:29:14.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 -- 172.21.15.53:0/1076909219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50200b4d20 msgr2=0x7f50200b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:14.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50200b4d20 0x7f50200b7230 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55f420535fd0 tx=0x7f502400ce80 comp rx=0 tx=0).stop 2024-08-31T06:29:14.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 -- 172.21.15.53:0/1076909219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5030102880 msgr2=0x7f5030197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:14.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5030102880 0x7f5030197da0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5024009f50 tx=0x7f502400ee50 comp rx=0 tx=0).stop 2024-08-31T06:29:14.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 -- 172.21.15.53:0/1076909219 shutdown_connections 2024-08-31T06:29:14.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f50200b4d20 0x7f50200b7230 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5030108ac0 0x7f503019d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5030108170 0x7f5030198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 --2- 172.21.15.53:0/1076909219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5030102880 0x7f5030197da0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:14.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 -- 172.21.15.53:0/1076909219 >> 172.21.15.53:0/1076909219 conn(0x7f5030079530 msgr2=0x7f503006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:14.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 -- 172.21.15.53:0/1076909219 shutdown_connections 2024-08-31T06:29:14.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:14.420+0000 7f5036f27640 1 -- 172.21.15.53:0/1076909219 wait complete. 2024-08-31T06:29:14.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:13 smithi153 ceph-mon[22320]: pgmap v1088: 97 pgs: 97 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 261 op/s 2024-08-31T06:29:14.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:13 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:29:15.178 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:29:15.178 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:29:15.178 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:29:15.178 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:14 smithi053 ceph-mon[18924]: osdmap e112: 12 total, 12 up, 12 in 2024-08-31T06:29:15.213 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:29:15.326 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:29:15.326 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:29:15.326 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:29:15.326 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:14 smithi153 ceph-mon[22320]: osdmap e112: 12 total, 12 up, 12 in 2024-08-31T06:29:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:29:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:29:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:29:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:14 smithi130 ceph-mon[22266]: osdmap e112: 12 total, 12 up, 12 in 2024-08-31T06:29:15.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 69571 5.50 MB/sec execute 543 sec latency 62.244 ms 2024-08-31T06:29:15.593 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:16.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.152+0000 7f82fb245640 1 -- 172.21.15.53:0/4267820014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f410dbf0 msgr2=0x7f82f41100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:16.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.152+0000 7f82fb245640 1 --2- 172.21.15.53:0/4267820014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f410dbf0 0x7f82f41100e0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009ca0 tx=0x7f82ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.152+0000 7f82fb245640 1 -- 172.21.15.53:0/4267820014 shutdown_connections 2024-08-31T06:29:16.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.152+0000 7f82fb245640 1 --2- 172.21.15.53:0/4267820014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f410dbf0 0x7f82f41100e0 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.152+0000 7f82fb245640 1 --2- 172.21.15.53:0/4267820014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82f41050e0 0x7f82f410d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.152+0000 7f82fb245640 1 --2- 172.21.15.53:0/4267820014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f4104790 0x7f82f4104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.152+0000 7f82fb245640 1 -- 172.21.15.53:0/4267820014 >> 172.21.15.53:0/4267820014 conn(0x7f82f4079580 msgr2=0x7f82f4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:16.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.152+0000 7f82fb245640 1 -- 172.21.15.53:0/4267820014 shutdown_connections 2024-08-31T06:29:16.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.152+0000 7f82fb245640 1 -- 172.21.15.53:0/4267820014 wait complete. 2024-08-31T06:29:16.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.153+0000 7f82fb245640 1 Processor -- start 2024-08-31T06:29:16.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.154+0000 7f82fb245640 1 -- start start 2024-08-31T06:29:16.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.154+0000 7f82fb245640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f4104790 0x7f82f419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.154+0000 7f82fb245640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f41050e0 0x7f82f419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.155+0000 7f82f8fe1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f4104790 0x7f82f419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.155+0000 7f82f8fe1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f4104790 0x7f82f419a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35174/0 (socket says 172.21.15.53:35174) 2024-08-31T06:29:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.155+0000 7f82f8fe1640 1 -- 172.21.15.53:0/1463762131 learned_addr learned my addr 172.21.15.53:0/1463762131 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.155+0000 7f82f3fff640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f41050e0 0x7f82f419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.155+0000 7f82fb245640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82f410dbf0 0x7f82f419f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.155+0000 7f82fb245640 1 -- 172.21.15.53:0/1463762131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f82f4113750 con 0x7f82f4104790 2024-08-31T06:29:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.155+0000 7f82fb245640 1 -- 172.21.15.53:0/1463762131 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82f41135d0 con 0x7f82f41050e0 2024-08-31T06:29:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.155+0000 7f82f97e2640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82f410dbf0 0x7f82f419f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.156+0000 7f82fb245640 1 -- 172.21.15.53:0/1463762131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82f41138d0 con 0x7f82f410dbf0 2024-08-31T06:29:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.156+0000 7f82f97e2640 1 -- 172.21.15.53:0/1463762131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f41050e0 msgr2=0x7f82f419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.156+0000 7f82f97e2640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f41050e0 0x7f82f419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.156+0000 7f82f97e2640 1 -- 172.21.15.53:0/1463762131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f4104790 msgr2=0x7f82f419a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.156+0000 7f82f97e2640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f4104790 0x7f82f419a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.156+0000 7f82f97e2640 1 -- 172.21.15.53:0/1463762131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f41a0050 con 0x7f82f410dbf0 2024-08-31T06:29:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.156+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f4104790 0x7f82f419a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.156+0000 7f82f3fff640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f41050e0 0x7f82f419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.157+0000 7f82f97e2640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82f410dbf0 0x7f82f419f920 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f82ec031040 tx=0x7f82ec003f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.157+0000 7f82f1ffb640 1 -- 172.21.15.53:0/1463762131 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec032c10 con 0x7f82f410dbf0 2024-08-31T06:29:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.157+0000 7f82f1ffb640 1 -- 172.21.15.53:0/1463762131 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82ec032db0 con 0x7f82f410dbf0 2024-08-31T06:29:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.157+0000 7f82f1ffb640 1 -- 172.21.15.53:0/1463762131 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec030ab0 con 0x7f82f410dbf0 2024-08-31T06:29:16.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.157+0000 7f82fb245640 1 -- 172.21.15.53:0/1463762131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f41a02e0 con 0x7f82f410dbf0 2024-08-31T06:29:16.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.157+0000 7f82fb245640 1 -- 172.21.15.53:0/1463762131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f41a6aa0 con 0x7f82f410dbf0 2024-08-31T06:29:16.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.161+0000 7f83017ba740 1 Processor -- start 2024-08-31T06:29:16.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.162+0000 7f82f1ffb640 1 -- 172.21.15.53:0/1463762131 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f82ec030c50 con 0x7f82f410dbf0 2024-08-31T06:29:16.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.162+0000 7f83017ba740 1 -- start start 2024-08-31T06:29:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f83017ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b92070 0x558e02f37310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f83017ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f37850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f83017ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 0x558e02f37d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f83017ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558e02eae680 con 0x558e02b691b0 2024-08-31T06:29:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f83017ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558e02e9dc10 con 0x558e02b71390 2024-08-31T06:29:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f83017ba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558e02ea1bc0 con 0x558e02b92070 2024-08-31T06:29:16.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f82f8fe1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f37850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f82f8fe1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f37850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35190/0 (socket says 172.21.15.53:35190) 2024-08-31T06:29:16.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f82f8fe1640 1 -- 172.21.15.53:0/2618610383 learned_addr learned my addr 172.21.15.53:0/2618610383 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:16.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f82f1ffb640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82e40b4da0 0x7f82e40b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f82f3fff640 1 --2- 172.21.15.53:0/2618610383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b92070 0x558e02f37310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.163+0000 7f82f3fff640 1 --2- 172.21.15.53:0/2618610383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 0x558e02f37d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.164+0000 7f82f97e2640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82e40b4da0 0x7f82e40b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.164+0000 7f82f8fe1640 1 -- 172.21.15.53:0/2618610383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b92070 msgr2=0x558e02f37310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.164+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/2618610383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b92070 0x558e02f37310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.164+0000 7f82f8fe1640 1 -- 172.21.15.53:0/2618610383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 msgr2=0x558e02f37d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.164+0000 7f82f1ffb640 1 -- 172.21.15.53:0/1463762131 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f82ec1064e0 con 0x7f82f410dbf0 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.164+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/2618610383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 0x558e02f37d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.164+0000 7f82f8fe1640 1 -- 172.21.15.53:0/2618610383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e02bfd650 con 0x558e02b691b0 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.164+0000 7f82f3fff640 1 --2- 172.21.15.53:0/2618610383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 0x558e02f37d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.164+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/2618610383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f37850 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f82e80115c0 tx=0x7f82e8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71fa475e0515943 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.164+0000 7f82f97e2640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82e40b4da0 0x7f82e40b72b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0ccb70 tx=0x7f82ec09a190 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.165+0000 7f82deffd640 1 -- 172.21.15.53:0/2618610383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8005020 con 0x558e02b691b0 2024-08-31T06:29:16.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.165+0000 7f82deffd640 1 -- 172.21.15.53:0/2618610383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82e80047a0 con 0x558e02b691b0 2024-08-31T06:29:16.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.165+0000 7f82deffd640 1 -- 172.21.15.53:0/2618610383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e800f8c0 con 0x558e02b691b0 2024-08-31T06:29:16.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.165+0000 7f83017ba740 1 -- 172.21.15.53:0/2618610383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 msgr2=0x558e02f37850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.165+0000 7f83017ba740 1 --2- 172.21.15.53:0/2618610383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f37850 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f82e80115c0 tx=0x7f82e8011a80 comp rx=0 tx=0).stop 2024-08-31T06:29:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.166+0000 7f83017ba740 1 -- 172.21.15.53:0/2618610383 shutdown_connections 2024-08-31T06:29:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.166+0000 7f83017ba740 1 --2- 172.21.15.53:0/2618610383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 0x558e02f37d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.166+0000 7f83017ba740 1 --2- 172.21.15.53:0/2618610383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f37850 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.166+0000 7f83017ba740 1 --2- 172.21.15.53:0/2618610383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b92070 0x558e02f37310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.166+0000 7f83017ba740 1 -- 172.21.15.53:0/2618610383 >> 172.21.15.53:0/2618610383 conn(0x558e02b86460 msgr2=0x558e02f35200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.166+0000 7f83017ba740 1 -- 172.21.15.53:0/2618610383 shutdown_connections 2024-08-31T06:29:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.166+0000 7f83017ba740 1 -- 172.21.15.53:0/2618610383 wait complete. 2024-08-31T06:29:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.166+0000 7f83017ba740 1 -- start start 2024-08-31T06:29:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.167+0000 7f83017ba740 1 Processor -- start 2024-08-31T06:29:16.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.167+0000 7f83017ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f46e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.167+0000 7f83017ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 0x558e02f473d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.167+0000 7f83017ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b92070 0x558e02f47910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.167+0000 7f82f8fe1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 0x558e02f473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.167+0000 7f82f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f46e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.167+0000 7f82f8fe1640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 0x558e02f473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39222/0 (socket says 172.21.15.53:39222) 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.167+0000 7f82f8fe1640 1 -- 172.21.15.53:0/1800269507 learned_addr learned my addr 172.21.15.53:0/1800269507 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.167+0000 7f83017ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558e02d00700 con 0x558e02b691b0 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.167+0000 7f83017ba740 1 -- 172.21.15.53:0/1800269507 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558e02e24750 con 0x558e02b71390 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.167+0000 7f83017ba740 1 -- 172.21.15.53:0/1800269507 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558e02f49e50 con 0x558e02b92070 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.168+0000 7f83017ba740 10 client.0 _ll_register_callbacks cb 0x558e02e53e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.168+0000 7f82f3fff640 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b92070 0x558e02f47910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.168+0000 7f82f8fe1640 1 -- 172.21.15.53:0/1800269507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b92070 msgr2=0x558e02f47910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:16.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.168+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b92070 0x558e02f47910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.168+0000 7f82f8fe1640 1 -- 172.21.15.53:0/1800269507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 msgr2=0x558e02f46e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:16.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.168+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f46e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.168+0000 7f82f8fe1640 1 -- 172.21.15.53:0/1800269507 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e02e5d900 con 0x558e02b71390 2024-08-31T06:29:16.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.168+0000 7f82f3fff640 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f46e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:16.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.168+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 0x558e02f473d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f82e80057c0 tx=0x7f82e8005150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d43eb6ee71c056a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:16.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.168+0000 7f82d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:29:16.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.169+0000 7f82d3fff640 1 -- 172.21.15.53:0/1800269507 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8028020 con 0x558e02b71390 2024-08-31T06:29:16.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.169+0000 7f82d3fff640 1 -- 172.21.15.53:0/1800269507 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f82e80052c0 con 0x558e02b71390 2024-08-31T06:29:16.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.169+0000 7f83017ba740 1 -- 172.21.15.53:0/1800269507 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82e80047a0 con 0x558e02b71390 2024-08-31T06:29:16.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.170+0000 7f82d3fff640 1 -- 172.21.15.53:0/1800269507 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f82e8033050 con 0x558e02b71390 2024-08-31T06:29:16.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.170+0000 7f83017ba740 10 client.31472 fetch_fsmap learned FSMap version 89 2024-08-31T06:29:16.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.170+0000 7f83017ba740 1 -- 172.21.15.53:0/1800269507 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) -- 0x558e02f5a070 con 0x558e02b71390 2024-08-31T06:29:16.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.170+0000 7f82d3fff640 1 -- 172.21.15.53:0/1800269507 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82e80047a0 con 0x558e02b71390 2024-08-31T06:29:16.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.171+0000 7f82d3fff640 1 -- 172.21.15.53:0/1800269507 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 89) ==== 8366+0+0 (secure 0 0 0) 0x7f82e8023470 con 0x558e02b71390 2024-08-31T06:29:16.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.171+0000 7f83017ba740 10 client.31472 fetch_fsmap finished waiting for FSMap version 89 2024-08-31T06:29:16.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.171+0000 7f83017ba740 10 client.31472 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:16.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.171+0000 7f83017ba740 20 client.31472 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:16.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.171+0000 7f83017ba740 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558e02b509f0 0x558e02f5d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.171+0000 7f83017ba740 4 client.31472 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:16.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.172+0000 7f83017ba740 1 -- 172.21.15.53:0/1800269507 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e02eb05d0 con 0x558e02b509f0 2024-08-31T06:29:16.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.172+0000 7f82f3fff640 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558e02b509f0 0x558e02f5d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.172+0000 7f82f3fff640 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558e02b509f0 0x558e02f5d430 crc :-1 s=READY pgs=564 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5941d665fdbf8da3 server_cookie=8aefa692cb8577e7 in_seq=0 out_seq=0 2024-08-31T06:29:16.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.172+0000 7f82d3fff640 10 client.31472 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:16.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.173+0000 7f82d3fff640 1 -- 172.21.15.53:0/1800269507 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e02eb05d0 con 0x558e02b509f0 2024-08-31T06:29:16.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.173+0000 7f82d3fff640 10 client.31472 handle_command_reply: tid=0 2024-08-31T06:29:16.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.173+0000 7f83017ba740 1 client.31472 shutdown 2024-08-31T06:29:16.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.173+0000 7f83017ba740 1 -- 172.21.15.53:0/1800269507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 msgr2=0x558e02f473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:16.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.173+0000 7f83017ba740 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 0x558e02f473d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f82e80057c0 tx=0x7f82e8005150 comp rx=0 tx=0).stop 2024-08-31T06:29:16.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.173+0000 7f83017ba740 1 -- 172.21.15.53:0/1800269507 shutdown_connections 2024-08-31T06:29:16.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.173+0000 7f83017ba740 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558e02b509f0 0x558e02f5d430 crc :-1 s=READY pgs=564 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.174+0000 7f83017ba740 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b92070 0x558e02f47910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.174+0000 7f83017ba740 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b71390 0x558e02f473d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.174+0000 7f83017ba740 1 --2- 172.21.15.53:0/1800269507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f46e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.174+0000 7f82d3fff640 0 client.31472 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:16.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.174+0000 7f83017ba740 1 -- 172.21.15.53:0/1800269507 >> 172.21.15.53:0/1800269507 conn(0x558e02b86460 msgr2=0x558e02f38d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:16.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.174+0000 7f83017ba740 1 -- 172.21.15.53:0/1800269507 shutdown_connections 2024-08-31T06:29:16.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.174+0000 7f83017ba740 1 -- 172.21.15.53:0/1800269507 wait complete. 2024-08-31T06:29:16.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.174+0000 7f83017ba740 20 client.31472 trim_cache size 0 max 16384 2024-08-31T06:29:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.197+0000 7f83017ba740 1 Processor -- start 2024-08-31T06:29:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.197+0000 7f83017ba740 1 -- start start 2024-08-31T06:29:16.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f83017ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b691b0 0x558e02f40620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f83017ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b71390 0x558e02f44080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f83017ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b92070 0x558e02f445c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f83017ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f82f41ad2b0 con 0x558e02b71390 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f83017ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82f41aee20 con 0x558e02b92070 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f83017ba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82f41ad980 con 0x558e02b691b0 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f82f8fe1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b71390 0x558e02f44080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f82f8fe1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b71390 0x558e02f44080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35212/0 (socket says 172.21.15.53:35212) 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f82f3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b691b0 0x558e02f40620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f82f8fe1640 1 -- 172.21.15.53:0/780434175 learned_addr learned my addr 172.21.15.53:0/780434175 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f82f3fff640 1 --2- 172.21.15.53:0/780434175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b92070 0x558e02f445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f82f8fe1640 1 -- 172.21.15.53:0/780434175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b691b0 msgr2=0x558e02f40620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/780434175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b691b0 0x558e02f40620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f82f8fe1640 1 -- 172.21.15.53:0/780434175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b92070 msgr2=0x558e02f445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/780434175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b92070 0x558e02f445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.198+0000 7f82f8fe1640 1 -- 172.21.15.53:0/780434175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e02f3ca80 con 0x558e02b71390 2024-08-31T06:29:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.199+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/780434175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b71390 0x558e02f44080 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f82e80238c0 tx=0x7f82e8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f85ef81464b0cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.199+0000 7f82de7fc640 1 -- 172.21.15.53:0/780434175 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8028070 con 0x558e02b71390 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.199+0000 7f82de7fc640 1 -- 172.21.15.53:0/780434175 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82e8023470 con 0x558e02b71390 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.199+0000 7f82de7fc640 1 -- 172.21.15.53:0/780434175 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e801d040 con 0x558e02b71390 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.200+0000 7f83017ba740 1 -- 172.21.15.53:0/780434175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b71390 msgr2=0x558e02f44080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.200+0000 7f83017ba740 1 --2- 172.21.15.53:0/780434175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b71390 0x558e02f44080 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f82e80238c0 tx=0x7f82e8011a80 comp rx=0 tx=0).stop 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.200+0000 7f83017ba740 1 -- 172.21.15.53:0/780434175 shutdown_connections 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.200+0000 7f83017ba740 1 --2- 172.21.15.53:0/780434175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b92070 0x558e02f445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.200+0000 7f83017ba740 1 --2- 172.21.15.53:0/780434175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b71390 0x558e02f44080 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.200+0000 7f83017ba740 1 --2- 172.21.15.53:0/780434175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b691b0 0x558e02f40620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.200+0000 7f83017ba740 1 -- 172.21.15.53:0/780434175 >> 172.21.15.53:0/780434175 conn(0x558e02b86460 msgr2=0x558e02f3ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.200+0000 7f83017ba740 1 -- 172.21.15.53:0/780434175 shutdown_connections 2024-08-31T06:29:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.200+0000 7f83017ba740 1 -- 172.21.15.53:0/780434175 wait complete. 2024-08-31T06:29:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.201+0000 7f83017ba740 1 -- start start 2024-08-31T06:29:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.201+0000 7f83017ba740 1 Processor -- start 2024-08-31T06:29:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.201+0000 7f83017ba740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f538e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.201+0000 7f83017ba740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b71390 0x558e02f53e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.201+0000 7f83017ba740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b92070 0x558e02f54360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.201+0000 7f83017ba740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f82f41ae750 con 0x558e02b691b0 2024-08-31T06:29:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.201+0000 7f83017ba740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82f41ae050 con 0x558e02b92070 2024-08-31T06:29:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.201+0000 7f83017ba740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82f41ab2b0 con 0x558e02b71390 2024-08-31T06:29:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.201+0000 7f83017ba740 10 client.0 _ll_register_callbacks cb 0x7f82e0009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.201+0000 7f82f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.201+0000 7f82f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35214/0 (socket says 172.21.15.53:35214) 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82f3fff640 1 -- 172.21.15.53:0/2117577756 learned_addr learned my addr 172.21.15.53:0/2117577756 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b71390 0x558e02f53e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82f3fff640 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b92070 0x558e02f54360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82f8fe1640 1 -- 172.21.15.53:0/2117577756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b92070 msgr2=0x558e02f54360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b92070 0x558e02f54360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82f8fe1640 1 -- 172.21.15.53:0/2117577756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 msgr2=0x558e02f538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82f8fe1640 1 -- 172.21.15.53:0/2117577756 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e02fc6c00 con 0x558e02b71390 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82f3fff640 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82f8fe1640 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b71390 0x558e02f53e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009230 tx=0x7f82e8009d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fee427f3ee69401f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.202+0000 7f82d3fff640 1 -- 172.21.15.53:0/2117577756 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e801d070 con 0x558e02b71390 2024-08-31T06:29:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f82d3fff640 1 -- 172.21.15.53:0/2117577756 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f82e8011240 con 0x558e02b71390 2024-08-31T06:29:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f83017ba740 1 -- 172.21.15.53:0/2117577756 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82e8023470 con 0x558e02b71390 2024-08-31T06:29:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f82d3fff640 1 -- 172.21.15.53:0/2117577756 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f82e8028040 con 0x558e02b71390 2024-08-31T06:29:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f83017ba740 10 client.31477 fetch_fsmap learned FSMap version 89 2024-08-31T06:29:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f83017ba740 1 -- 172.21.15.53:0/2117577756 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) -- 0x558e02fc7da0 con 0x558e02b71390 2024-08-31T06:29:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f82d3fff640 1 -- 172.21.15.53:0/2117577756 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82e8023470 con 0x558e02b71390 2024-08-31T06:29:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f82d3fff640 1 -- 172.21.15.53:0/2117577756 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 89) ==== 8366+0+0 (secure 0 0 0) 0x7f82e8004330 con 0x558e02b71390 2024-08-31T06:29:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f83017ba740 10 client.31477 fetch_fsmap finished waiting for FSMap version 89 2024-08-31T06:29:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f83017ba740 10 client.31477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f83017ba740 20 client.31477 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f83017ba740 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558e02b25da0 0x558e02fca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:16.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f83017ba740 4 client.31477 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:29:16.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.203+0000 7f83017ba740 1 -- 172.21.15.53:0/2117577756 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558e02eac070 con 0x558e02b25da0 2024-08-31T06:29:16.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.204+0000 7f82f3fff640 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558e02b25da0 0x558e02fca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:16.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.204+0000 7f82d3fff640 10 client.31477 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:16.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.204+0000 7f82f3fff640 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558e02b25da0 0x558e02fca440 crc :-1 s=READY pgs=565 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=436557b0572bb49a server_cookie=746185478b68f0a in_seq=0 out_seq=0 2024-08-31T06:29:16.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.204+0000 7f82d3fff640 1 -- 172.21.15.53:0/2117577756 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558e02eac070 con 0x558e02b25da0 2024-08-31T06:29:16.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.204+0000 7f82d3fff640 10 client.31477 handle_command_reply: tid=0 2024-08-31T06:29:16.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.204+0000 7f83017ba740 1 client.31477 shutdown 2024-08-31T06:29:16.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f83017ba740 1 -- 172.21.15.53:0/2117577756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b71390 msgr2=0x558e02f53e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f83017ba740 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b71390 0x558e02f53e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009230 tx=0x7f82e8009d80 comp rx=0 tx=0).stop 2024-08-31T06:29:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f83017ba740 1 -- 172.21.15.53:0/2117577756 shutdown_connections 2024-08-31T06:29:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f83017ba740 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x558e02b25da0 0x558e02fca440 crc :-1 s=READY pgs=565 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f82d3fff640 0 client.31477 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f83017ba740 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e02b92070 0x558e02f54360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f83017ba740 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558e02b71390 0x558e02f53e20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f83017ba740 1 --2- 172.21.15.53:0/2117577756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558e02b691b0 0x558e02f538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f83017ba740 1 -- 172.21.15.53:0/2117577756 >> 172.21.15.53:0/2117577756 conn(0x558e02b86460 msgr2=0x558e02f38340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f83017ba740 1 -- 172.21.15.53:0/2117577756 shutdown_connections 2024-08-31T06:29:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f83017ba740 1 -- 172.21.15.53:0/2117577756 wait complete. 2024-08-31T06:29:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.205+0000 7f83017ba740 20 client.31477 trim_cache size 0 max 16384 2024-08-31T06:29:16.212 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:29:16.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 -- 172.21.15.53:0/1463762131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82e40b4da0 msgr2=0x7f82e40b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:16.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82e40b4da0 0x7f82e40b72b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0ccb70 tx=0x7f82ec09a190 comp rx=0 tx=0).stop 2024-08-31T06:29:16.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 -- 172.21.15.53:0/1463762131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82f410dbf0 msgr2=0x7f82f419f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:16.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82f410dbf0 0x7f82f419f920 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f82ec031040 tx=0x7f82ec003f30 comp rx=0 tx=0).stop 2024-08-31T06:29:16.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 -- 172.21.15.53:0/1463762131 shutdown_connections 2024-08-31T06:29:16.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f82e40b4da0 0x7f82e40b72b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82f410dbf0 0x7f82f419f920 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f41050e0 0x7f82f419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 --2- 172.21.15.53:0/1463762131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f4104790 0x7f82f419a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:16.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 -- 172.21.15.53:0/1463762131 >> 172.21.15.53:0/1463762131 conn(0x7f82f4079580 msgr2=0x7f82f4100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:16.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 -- 172.21.15.53:0/1463762131 shutdown_connections 2024-08-31T06:29:16.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:16.206+0000 7f82fb245640 1 -- 172.21.15.53:0/1463762131 wait complete. 2024-08-31T06:29:16.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:15 smithi130 ceph-mon[22266]: pgmap v1090: 97 pgs: 97 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 327 op/s 2024-08-31T06:29:16.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 69715 5.50 MB/sec execute 544 sec latency 67.743 ms 2024-08-31T06:29:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:15 smithi153 ceph-mon[22320]: pgmap v1090: 97 pgs: 97 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 327 op/s 2024-08-31T06:29:16.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:15 smithi053 ceph-mon[18924]: pgmap v1090: 97 pgs: 97 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.2 MiB/s wr, 327 op/s 2024-08-31T06:29:17.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 69832 5.49 MB/sec execute 545 sec latency 78.302 ms 2024-08-31T06:29:18.007 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:29:18.008 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:29:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:18.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:17 smithi130 ceph-mon[22266]: pgmap v1091: 97 pgs: 97 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.3 MiB/s wr, 322 op/s 2024-08-31T06:29:18.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:17 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:29:18.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 69957 5.50 MB/sec execute 546 sec latency 132.112 ms 2024-08-31T06:29:18.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:17 smithi153 ceph-mon[22320]: pgmap v1091: 97 pgs: 97 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.3 MiB/s wr, 322 op/s 2024-08-31T06:29:18.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:17 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:29:18.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:17 smithi053 ceph-mon[18924]: pgmap v1091: 97 pgs: 97 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.3 MiB/s wr, 322 op/s 2024-08-31T06:29:18.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:17 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:29:18.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.973+0000 7fdb66490640 1 -- 172.21.15.53:0/1108075149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60102880 msgr2=0x7fdb60102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:18.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.973+0000 7fdb66490640 1 --2- 172.21.15.53:0/1108075149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60102880 0x7fdb60102c90 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009900 tx=0x7fdb5002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:29:18.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.973+0000 7fdb66490640 1 -- 172.21.15.53:0/1108075149 shutdown_connections 2024-08-31T06:29:18.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.973+0000 7fdb66490640 1 --2- 172.21.15.53:0/1108075149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb60108ac0 0x7fdb6010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:18.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.973+0000 7fdb66490640 1 --2- 172.21.15.53:0/1108075149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb60108170 0x7fdb60108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:18.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.973+0000 7fdb66490640 1 --2- 172.21.15.53:0/1108075149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60102880 0x7fdb60102c90 secure :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009900 tx=0x7fdb5002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:29:18.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.973+0000 7fdb66490640 1 -- 172.21.15.53:0/1108075149 >> 172.21.15.53:0/1108075149 conn(0x7fdb60079530 msgr2=0x7fdb60079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.974+0000 7fdb66490640 1 -- 172.21.15.53:0/1108075149 shutdown_connections 2024-08-31T06:29:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.974+0000 7fdb66490640 1 -- 172.21.15.53:0/1108075149 wait complete. 2024-08-31T06:29:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.975+0000 7fdb66490640 1 Processor -- start 2024-08-31T06:29:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.975+0000 7fdb66490640 1 -- start start 2024-08-31T06:29:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.976+0000 7fdb66490640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60108170 0x7fdb60100e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.976+0000 7fdb66490640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb60108ac0 0x7fdb600ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.976+0000 7fdb66490640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb600ff950 0x7fdb600ffe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.976+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60108170 0x7fdb60100e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.976+0000 7fdb66490640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdb60112640 con 0x7fdb60108170 2024-08-31T06:29:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.976+0000 7fdb66490640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601124c0 con 0x7fdb60108ac0 2024-08-31T06:29:18.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.976+0000 7fdb66490640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601127c0 con 0x7fdb600ff950 2024-08-31T06:29:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.976+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60108170 0x7fdb60100e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35238/0 (socket says 172.21.15.53:35238) 2024-08-31T06:29:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.976+0000 7fdb5ffff640 1 -- 172.21.15.53:0/3002139062 learned_addr learned my addr 172.21.15.53:0/3002139062 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.976+0000 7fdb5f7fe640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb60108ac0 0x7fdb600ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.976+0000 7fdb64a2d640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb600ff950 0x7fdb600ffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.977+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/3002139062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb600ff950 msgr2=0x7fdb600ffe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.977+0000 7fdb5f7fe640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb600ff950 0x7fdb600ffe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.977+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/3002139062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60108170 msgr2=0x7fdb60100e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.977+0000 7fdb5f7fe640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60108170 0x7fdb60100e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.977+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/3002139062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb601ace10 con 0x7fdb60108ac0 2024-08-31T06:29:18.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.977+0000 7fdb64a2d640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb600ff950 0x7fdb600ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:18.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.977+0000 7fdb5f7fe640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb60108ac0 0x7fdb600ff410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdb6006a8c0 tx=0x7fdb5400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:18.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.978+0000 7fdb5d7fa640 1 -- 172.21.15.53:0/3002139062 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400cc40 con 0x7fdb60108ac0 2024-08-31T06:29:18.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.978+0000 7fdb66490640 1 -- 172.21.15.53:0/3002139062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb601ad100 con 0x7fdb60108ac0 2024-08-31T06:29:18.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.978+0000 7fdb5d7fa640 1 -- 172.21.15.53:0/3002139062 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb5400cde0 con 0x7fdb60108ac0 2024-08-31T06:29:18.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.978+0000 7fdb66490640 1 -- 172.21.15.53:0/3002139062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb601ad690 con 0x7fdb60108ac0 2024-08-31T06:29:18.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.978+0000 7fdb5d7fa640 1 -- 172.21.15.53:0/3002139062 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540186f0 con 0x7fdb60108ac0 2024-08-31T06:29:18.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.981+0000 7fdb6ca05740 1 Processor -- start 2024-08-31T06:29:18.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.981+0000 7fdb6ca05740 1 -- start start 2024-08-31T06:29:18.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.981+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a96c6350 0x5585a9a6c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:18.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.981+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a969d490 0x5585a9a6ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:18.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.981+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 0x5585a9a6d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:18.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.981+0000 7fdb6ca05740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5585a99e25f0 con 0x5585a969d490 2024-08-31T06:29:18.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.981+0000 7fdb6ca05740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585a99d1b80 con 0x5585a96c6350 2024-08-31T06:29:18.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.981+0000 7fdb6ca05740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5585a99d5b30 con 0x5585a96a5670 2024-08-31T06:29:18.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 0x5585a9a6d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:18.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb5d7fa640 1 -- 172.21.15.53:0/3002139062 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdb54018890 con 0x7fdb60108ac0 2024-08-31T06:29:18.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a969d490 0x5585a9a6ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:18.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 0x5585a9a6d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49208/0 (socket says 172.21.15.53:49208) 2024-08-31T06:29:18.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/767358638 learned_addr learned my addr 172.21.15.53:0/767358638 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:18.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb64a2d640 1 --2- 172.21.15.53:0/767358638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a96c6350 0x5585a9a6c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:18.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb5ffff640 1 -- 172.21.15.53:0/767358638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 msgr2=0x5585a9a6d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:18.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb5ffff640 1 --2- 172.21.15.53:0/767358638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 0x5585a9a6d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:18.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb5ffff640 1 -- 172.21.15.53:0/767358638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a96c6350 msgr2=0x5585a9a6c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:18.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb5ffff640 1 --2- 172.21.15.53:0/767358638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a96c6350 0x5585a9a6c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:18.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb5ffff640 1 -- 172.21.15.53:0/767358638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585a9731930 con 0x5585a969d490 2024-08-31T06:29:18.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.982+0000 7fdb64a2d640 1 --2- 172.21.15.53:0/767358638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a96c6350 0x5585a9a6c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:18.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.983+0000 7fdb5ffff640 1 --2- 172.21.15.53:0/767358638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a969d490 0x5585a9a6ccc0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7fdb50004770 tx=0x7fdb50031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782053fb4454c35 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:18.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.983+0000 7fdb467fc640 1 -- 172.21.15.53:0/767358638 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50035030 con 0x5585a969d490 2024-08-31T06:29:18.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.983+0000 7fdb467fc640 1 -- 172.21.15.53:0/767358638 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb50040070 con 0x5585a969d490 2024-08-31T06:29:18.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.983+0000 7fdb467fc640 1 -- 172.21.15.53:0/767358638 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb500044e0 con 0x5585a969d490 2024-08-31T06:29:18.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.984+0000 7fdb6ca05740 1 -- 172.21.15.53:0/767358638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a969d490 msgr2=0x5585a9a6ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:18.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.984+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/767358638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a969d490 0x5585a9a6ccc0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7fdb50004770 tx=0x7fdb50031a70 comp rx=0 tx=0).stop 2024-08-31T06:29:18.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.984+0000 7fdb5d7fa640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdb480b4da0 0x7fdb480b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:18.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.985+0000 7fdb6ca05740 1 -- 172.21.15.53:0/767358638 shutdown_connections 2024-08-31T06:29:18.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.985+0000 7fdb64a2d640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdb480b4da0 0x7fdb480b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:18.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.985+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/767358638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 0x5585a9a6d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:18.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.985+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/767358638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a969d490 0x5585a9a6ccc0 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:18.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.985+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/767358638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a96c6350 0x5585a9a6c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:18.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.985+0000 7fdb6ca05740 1 -- 172.21.15.53:0/767358638 >> 172.21.15.53:0/767358638 conn(0x5585a96ba740 msgr2=0x5585a9a6a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:18.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.985+0000 7fdb6ca05740 1 -- 172.21.15.53:0/767358638 shutdown_connections 2024-08-31T06:29:18.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.985+0000 7fdb5d7fa640 1 -- 172.21.15.53:0/3002139062 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7fdb540e58d0 con 0x7fdb60108ac0 2024-08-31T06:29:18.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.985+0000 7fdb6ca05740 1 -- 172.21.15.53:0/767358638 wait complete. 2024-08-31T06:29:18.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.985+0000 7fdb64a2d640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdb480b4da0 0x7fdb480b72b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009cf0 tx=0x7fdb58009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:18.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.986+0000 7fdb6ca05740 1 -- start start 2024-08-31T06:29:18.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.986+0000 7fdb6ca05740 1 Processor -- start 2024-08-31T06:29:18.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a969d490 0x5585a9a78030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:18.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 0x5585a9a78570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:18.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a96c6350 0x5585a9a84220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:18.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb6ca05740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5585a9834890 con 0x5585a96a5670 2024-08-31T06:29:18.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb6ca05740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585a9958790 con 0x5585a96c6350 2024-08-31T06:29:18.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb6ca05740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5585a9a7af00 con 0x5585a969d490 2024-08-31T06:29:18.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb6ca05740 10 client.0 _ll_register_callbacks cb 0x5585a96ddba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:18.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a969d490 0x5585a9a78030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:18.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 0x5585a9a78570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:18.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 0x5585a9a78570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35262/0 (socket says 172.21.15.53:35262) 2024-08-31T06:29:18.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/3421957907 learned_addr learned my addr 172.21.15.53:0/3421957907 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/3421957907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a969d490 msgr2=0x5585a9a78030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb5f7fe640 1 --2- 172.21.15.53:0/3421957907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a969d490 0x5585a9a78030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.987+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/3421957907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a96c6350 msgr2=0x5585a9a84220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:29:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.988+0000 7fdb5f7fe640 1 --2- 172.21.15.53:0/3421957907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a96c6350 0x5585a9a84220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.988+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/3421957907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585a998ff30 con 0x5585a96a5670 2024-08-31T06:29:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.988+0000 7fdb5f7fe640 1 --2- 172.21.15.53:0/3421957907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 0x5585a9a78570 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7fdb540abc40 tx=0x7fdb54009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55de56a1989b0ddc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:19.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.988+0000 7fdb3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:19.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.989+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/3421957907 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540ab6b0 con 0x5585a96a5670 2024-08-31T06:29:19.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.990+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/3421957907 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7fdb54018b80 con 0x5585a96a5670 2024-08-31T06:29:19.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.990+0000 7fdb6ca05740 1 -- 172.21.15.53:0/3421957907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb50040070 con 0x5585a96a5670 2024-08-31T06:29:19.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.990+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/3421957907 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fdb540aba50 con 0x5585a96a5670 2024-08-31T06:29:19.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.990+0000 7fdb6ca05740 10 client.22848 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.990+0000 7fdb6ca05740 1 -- 172.21.15.53:0/3421957907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x5585a9a86dc0 con 0x5585a96a5670 2024-08-31T06:29:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.990+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/3421957907 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb50040070 con 0x5585a96a5670 2024-08-31T06:29:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.990+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/3421957907 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7fdb540ab1a0 con 0x5585a96a5670 2024-08-31T06:29:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.990+0000 7fdb6ca05740 10 client.22848 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.990+0000 7fdb6ca05740 10 client.22848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.991+0000 7fdb6ca05740 20 client.22848 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.991+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/3421957907 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585a9684cd0 0x5585a9a8a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.991+0000 7fdb6ca05740 4 client.22848 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.991+0000 7fdb6ca05740 1 -- 172.21.15.53:0/3421957907 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585a99e4540 con 0x5585a9684cd0 2024-08-31T06:29:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.991+0000 7fdb5ffff640 1 --2- 172.21.15.53:0/3421957907 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585a9684cd0 0x5585a9a8a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.991+0000 7fdb3f7fe640 10 client.22848 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.991+0000 7fdb5ffff640 1 --2- 172.21.15.53:0/3421957907 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585a9684cd0 0x5585a9a8a270 crc :-1 s=READY pgs=566 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37317211c1aaeb1e server_cookie=8d05be51b40f1441 in_seq=0 out_seq=0 2024-08-31T06:29:19.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.992+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/3421957907 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585a99e4540 con 0x5585a9684cd0 2024-08-31T06:29:19.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.992+0000 7fdb3f7fe640 10 client.22848 handle_command_reply: tid=0 2024-08-31T06:29:19.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.992+0000 7fdb6ca05740 1 client.22848 shutdown 2024-08-31T06:29:19.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.992+0000 7fdb6ca05740 1 -- 172.21.15.53:0/3421957907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 msgr2=0x5585a9a78570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:19.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.992+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/3421957907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 0x5585a9a78570 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7fdb540abc40 tx=0x7fdb54009700 comp rx=0 tx=0).stop 2024-08-31T06:29:19.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.993+0000 7fdb6ca05740 1 -- 172.21.15.53:0/3421957907 shutdown_connections 2024-08-31T06:29:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.993+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/3421957907 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585a9684cd0 0x5585a9a8a270 crc :-1 s=READY pgs=566 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.993+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/3421957907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a96c6350 0x5585a9a84220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.993+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/3421957907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 0x5585a9a78570 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.993+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/3421957907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a969d490 0x5585a9a78030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.993+0000 7fdb3f7fe640 0 client.22848 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.993+0000 7fdb6ca05740 1 -- 172.21.15.53:0/3421957907 >> 172.21.15.53:0/3421957907 conn(0x5585a96ba740 msgr2=0x5585a9a6f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.993+0000 7fdb6ca05740 1 -- 172.21.15.53:0/3421957907 shutdown_connections 2024-08-31T06:29:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.993+0000 7fdb6ca05740 1 -- 172.21.15.53:0/3421957907 wait complete. 2024-08-31T06:29:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:18.993+0000 7fdb6ca05740 20 client.22848 trim_cache size 0 max 16384 2024-08-31T06:29:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.017+0000 7fdb6ca05740 1 Processor -- start 2024-08-31T06:29:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.017+0000 7fdb6ca05740 1 -- start start 2024-08-31T06:29:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 0x5585a9a6fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 0x5585a9a6e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96c6350 0x5585a9a79c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb6ca05740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601b6160 con 0x5585a96a5670 2024-08-31T06:29:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 0x5585a9a6e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 0x5585a9a6fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 0x5585a9a6fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:39288/0 (socket says 172.21.15.53:39288) 2024-08-31T06:29:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb5ffff640 1 -- 172.21.15.53:0/1266501207 learned_addr learned my addr 172.21.15.53:0/1266501207 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb6ca05740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601b7d60 con 0x5585a969d490 2024-08-31T06:29:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb6ca05740 1 -- 172.21.15.53:0/1266501207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601b6830 con 0x5585a96c6350 2024-08-31T06:29:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb64a2d640 1 --2- 172.21.15.53:0/1266501207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96c6350 0x5585a9a79c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:19.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb5ffff640 1 -- 172.21.15.53:0/1266501207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96c6350 msgr2=0x5585a9a79c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:19.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb5ffff640 1 --2- 172.21.15.53:0/1266501207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96c6350 0x5585a9a79c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb5ffff640 1 -- 172.21.15.53:0/1266501207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 msgr2=0x5585a9a6e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:19.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb5ffff640 1 --2- 172.21.15.53:0/1266501207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 0x5585a9a6e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.018+0000 7fdb5ffff640 1 -- 172.21.15.53:0/1266501207 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585a9a6f5e0 con 0x5585a969d490 2024-08-31T06:29:19.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.019+0000 7fdb5ffff640 1 --2- 172.21.15.53:0/1266501207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 0x5585a9a6fef0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009230 tx=0x7fdb50009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d288d53d60af84b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:19.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.019+0000 7fdb45ffb640 1 -- 172.21.15.53:0/1266501207 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50035040 con 0x5585a969d490 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.019+0000 7fdb45ffb640 1 -- 172.21.15.53:0/1266501207 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb50040040 con 0x5585a969d490 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.019+0000 7fdb45ffb640 1 -- 172.21.15.53:0/1266501207 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50056e40 con 0x5585a969d490 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.020+0000 7fdb6ca05740 1 -- 172.21.15.53:0/1266501207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 msgr2=0x5585a9a6fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.020+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/1266501207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 0x5585a9a6fef0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009230 tx=0x7fdb50009260 comp rx=0 tx=0).stop 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.020+0000 7fdb6ca05740 1 -- 172.21.15.53:0/1266501207 shutdown_connections 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.020+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/1266501207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96c6350 0x5585a9a79c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.020+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/1266501207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96a5670 0x5585a9a6e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.020+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/1266501207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 0x5585a9a6fef0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.020+0000 7fdb6ca05740 1 -- 172.21.15.53:0/1266501207 >> 172.21.15.53:0/1266501207 conn(0x5585a96ba740 msgr2=0x5585a9a79550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.020+0000 7fdb6ca05740 1 -- 172.21.15.53:0/1266501207 shutdown_connections 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.020+0000 7fdb6ca05740 1 -- 172.21.15.53:0/1266501207 wait complete. 2024-08-31T06:29:19.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.021+0000 7fdb6ca05740 1 -- start start 2024-08-31T06:29:19.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.021+0000 7fdb6ca05740 1 Processor -- start 2024-08-31T06:29:19.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.021+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 0x5585a9a7e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.021+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 0x5585a9a7ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.021+0000 7fdb6ca05740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96c6350 0x5585a9af3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.021+0000 7fdb6ca05740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601b7690 con 0x5585a96c6350 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.021+0000 7fdb6ca05740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601b6f00 con 0x5585a969d490 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.021+0000 7fdb6ca05740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601b4160 con 0x5585a96a5670 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.021+0000 7fdb6ca05740 10 client.0 _ll_register_callbacks cb 0x7fdb540a7e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 0x5585a9a7ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 0x5585a9a7ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49228/0 (socket says 172.21.15.53:49228) 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/2313622876 learned_addr learned my addr 172.21.15.53:0/2313622876 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb5ffff640 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 0x5585a9a7e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb64a2d640 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96c6350 0x5585a9af3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/2313622876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 msgr2=0x5585a9a7e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:19.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb5f7fe640 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 0x5585a9a7e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/2313622876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96c6350 msgr2=0x5585a9af3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:19.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb5f7fe640 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96c6350 0x5585a9af3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb5f7fe640 1 -- 172.21.15.53:0/2313622876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585a9af4180 con 0x5585a96a5670 2024-08-31T06:29:19.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb5f7fe640 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 0x5585a9a7ede0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdb540b5420 tx=0x7fdb54093300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9defcacedc1afa62 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:19.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.022+0000 7fdb3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:29:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.023+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/2313622876 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540ab6b0 con 0x5585a96a5670 2024-08-31T06:29:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.023+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/2313622876 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7fdb540a8530 con 0x5585a96a5670 2024-08-31T06:29:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.023+0000 7fdb6ca05740 1 -- 172.21.15.53:0/2313622876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb50040040 con 0x5585a96a5670 2024-08-31T06:29:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.023+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/2313622876 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fdb540eb4d0 con 0x5585a96a5670 2024-08-31T06:29:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.023+0000 7fdb6ca05740 10 client.31495 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.023+0000 7fdb6ca05740 1 -- 172.21.15.53:0/2313622876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x5585a9af5450 con 0x5585a96a5670 2024-08-31T06:29:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.023+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/2313622876 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb540ac640 con 0x5585a96a5670 2024-08-31T06:29:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.023+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/2313622876 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7fdb540cd310 con 0x5585a96a5670 2024-08-31T06:29:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.023+0000 7fdb6ca05740 10 client.31495 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.023+0000 7fdb6ca05740 10 client.31495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:19.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.023+0000 7fdb6ca05740 20 client.31495 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:19.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.024+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585a965a080 0x5585a9af7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:19.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.024+0000 7fdb6ca05740 4 client.31495 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:29:19.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.024+0000 7fdb6ca05740 1 -- 172.21.15.53:0/2313622876 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fdb50040040 con 0x5585a965a080 2024-08-31T06:29:19.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.024+0000 7fdb5ffff640 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585a965a080 0x5585a9af7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:19.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.024+0000 7fdb3f7fe640 10 client.31495 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:19.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.025+0000 7fdb5ffff640 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585a965a080 0x5585a9af7c40 crc :-1 s=READY pgs=567 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dac16fea3848965 server_cookie=7f111d6efd0419ab in_seq=0 out_seq=0 2024-08-31T06:29:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb3f7fe640 1 -- 172.21.15.53:0/2313622876 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fdb50040040 con 0x5585a965a080 2024-08-31T06:29:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb3f7fe640 10 client.31495 handle_command_reply: tid=0 2024-08-31T06:29:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb6ca05740 1 client.31495 shutdown 2024-08-31T06:29:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb6ca05740 1 -- 172.21.15.53:0/2313622876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 msgr2=0x5585a9a7ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 0x5585a9a7ede0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdb540b5420 tx=0x7fdb54093300 comp rx=0 tx=0).stop 2024-08-31T06:29:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb6ca05740 1 -- 172.21.15.53:0/2313622876 shutdown_connections 2024-08-31T06:29:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5585a965a080 0x5585a9af7c40 crc :-1 s=READY pgs=567 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585a96c6350 0x5585a9af3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb3f7fe640 0 client.31495 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585a96a5670 0x5585a9a7ede0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb6ca05740 1 --2- 172.21.15.53:0/2313622876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585a969d490 0x5585a9a7e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.027+0000 7fdb6ca05740 1 -- 172.21.15.53:0/2313622876 >> 172.21.15.53:0/2313622876 conn(0x5585a96ba740 msgr2=0x5585a9a6ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:19.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.028+0000 7fdb6ca05740 1 -- 172.21.15.53:0/2313622876 shutdown_connections 2024-08-31T06:29:19.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.028+0000 7fdb6ca05740 1 -- 172.21.15.53:0/2313622876 wait complete. 2024-08-31T06:29:19.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.028+0000 7fdb6ca05740 20 client.31495 trim_cache size 0 max 16384 2024-08-31T06:29:19.031 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:29:19.031 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:29:19.031 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "a8c7f914-8c3b-4a6f-8f93-71d6ae7dd589", 2024-08-31T06:29:19.031 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:29:19.031 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:29:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.028+0000 7fdb66490640 1 -- 172.21.15.53:0/3002139062 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdb480b4da0 msgr2=0x7fdb480b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.028+0000 7fdb66490640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdb480b4da0 0x7fdb480b72b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009cf0 tx=0x7fdb58009500 comp rx=0 tx=0).stop 2024-08-31T06:29:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.028+0000 7fdb66490640 1 -- 172.21.15.53:0/3002139062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb60108ac0 msgr2=0x7fdb600ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.028+0000 7fdb66490640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb60108ac0 0x7fdb600ff410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdb6006a8c0 tx=0x7fdb5400ee50 comp rx=0 tx=0).stop 2024-08-31T06:29:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.029+0000 7fdb66490640 1 -- 172.21.15.53:0/3002139062 shutdown_connections 2024-08-31T06:29:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.029+0000 7fdb66490640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdb480b4da0 0x7fdb480b72b0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.029+0000 7fdb66490640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb600ff950 0x7fdb600ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.029+0000 7fdb66490640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb60108ac0 0x7fdb600ff410 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.029+0000 7fdb66490640 1 --2- 172.21.15.53:0/3002139062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60108170 0x7fdb60100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.029+0000 7fdb66490640 1 -- 172.21.15.53:0/3002139062 >> 172.21.15.53:0/3002139062 conn(0x7fdb60079530 msgr2=0x7fdb60101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.029+0000 7fdb66490640 1 -- 172.21.15.53:0/3002139062 shutdown_connections 2024-08-31T06:29:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:19.029+0000 7fdb66490640 1 -- 172.21.15.53:0/3002139062 wait complete. 2024-08-31T06:29:19.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 70058 5.50 MB/sec execute 547 sec latency 351.328 ms 2024-08-31T06:29:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: pgmap v1092: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 335 op/s 2024-08-31T06:29:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:29:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:20.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:20.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:19 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 70196 5.50 MB/sec execute 548 sec latency 550.305 ms 2024-08-31T06:29:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: pgmap v1092: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 335 op/s 2024-08-31T06:29:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:29:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:20.426 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:20.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.427 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:19 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: pgmap v1092: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 335 op/s 2024-08-31T06:29:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:29:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:20.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:20.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:20.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:20.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:20.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:20.477 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:19 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:20 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:21.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:20 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:20 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:21.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:20 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:20 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:29:21.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:20 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.379 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:20 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 70338 5.51 MB/sec execute 549 sec latency 261.175 ms 2024-08-31T06:29:21.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:20 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:21.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:20 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:20 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:21.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:20 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:20 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:29:21.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:20 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:20 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:20 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:21.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:20 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:20 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:21.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:20 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:20 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:29:21.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:20 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:21.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:20 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:29:22.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:21 smithi053 ceph-mon[18924]: pgmap v1093: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 352 op/s 2024-08-31T06:29:22.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:21 smithi130 ceph-mon[22266]: pgmap v1093: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 352 op/s 2024-08-31T06:29:22.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 70448 5.51 MB/sec execute 550 sec latency 281.469 ms 2024-08-31T06:29:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:21 smithi153 ceph-mon[22320]: pgmap v1093: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 352 op/s 2024-08-31T06:29:23.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 70576 5.51 MB/sec execute 551 sec latency 110.636 ms 2024-08-31T06:29:24.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:23 smithi130 ceph-mon[22266]: pgmap v1094: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 355 op/s 2024-08-31T06:29:24.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 70688 5.52 MB/sec execute 552 sec latency 135.433 ms 2024-08-31T06:29:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:23 smithi153 ceph-mon[22320]: pgmap v1094: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 355 op/s 2024-08-31T06:29:24.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:23 smithi053 ceph-mon[18924]: pgmap v1094: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 355 op/s 2024-08-31T06:29:24.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:29:25.092 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:25.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 70842 5.52 MB/sec execute 553 sec latency 59.270 ms 2024-08-31T06:29:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.288+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/2416407103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad0075550 msgr2=0x7f3ad0075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.288+0000 7f3ad5bc3640 1 --2- 172.21.15.53:0/2416407103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad0075550 0x7f3ad0075960 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009ca0 tx=0x7f3ac802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.288+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/2416407103 shutdown_connections 2024-08-31T06:29:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.288+0000 7f3ad5bc3640 1 --2- 172.21.15.53:0/2416407103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad010fdc0 0x7f3ad0112220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.288+0000 7f3ad5bc3640 1 --2- 172.21.15.53:0/2416407103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ad0075ea0 0x7f3ad010f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.288+0000 7f3ad5bc3640 1 --2- 172.21.15.53:0/2416407103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad0075550 0x7f3ad0075960 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.288+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/2416407103 >> 172.21.15.53:0/2416407103 conn(0x7f3ad00ff2b0 msgr2=0x7f3ad0101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.288+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/2416407103 shutdown_connections 2024-08-31T06:29:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.288+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/2416407103 wait complete. 2024-08-31T06:29:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.290+0000 7f3ad5bc3640 1 Processor -- start 2024-08-31T06:29:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.290+0000 7f3ad5bc3640 1 -- start start 2024-08-31T06:29:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.290+0000 7f3ad5bc3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0075550 0x7f3ad010f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.290+0000 7f3ad5bc3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ad0075ea0 0x7f3ad01069b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.290+0000 7f3ad5bc3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad010fdc0 0x7f3ad0106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.290+0000 7f3ad5bc3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad0104e90 con 0x7f3ad010fdc0 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.290+0000 7f3ad5bc3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad0104d10 con 0x7f3ad0075ea0 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.290+0000 7f3ad5bc3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad0105010 con 0x7f3ad0075550 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3acffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad010fdc0 0x7f3ad0106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3acffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad010fdc0 0x7f3ad0106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48374/0 (socket says 172.21.15.53:48374) 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3acffff640 1 -- 172.21.15.53:0/226497680 learned_addr learned my addr 172.21.15.53:0/226497680 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3acf7fe640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0075550 0x7f3ad010f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3aceffd640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ad0075ea0 0x7f3ad01069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3acffff640 1 -- 172.21.15.53:0/226497680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0075550 msgr2=0x7f3ad010f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3acffff640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0075550 0x7f3ad010f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3acffff640 1 -- 172.21.15.53:0/226497680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ad0075ea0 msgr2=0x7f3ad01069b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3acffff640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ad0075ea0 0x7f3ad01069b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3acffff640 1 -- 172.21.15.53:0/226497680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad0107460 con 0x7f3ad010fdc0 2024-08-31T06:29:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3aceffd640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ad0075ea0 0x7f3ad01069b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:29:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.291+0000 7f3acffff640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad010fdc0 0x7f3ad0106ef0 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400e9b0 tx=0x7f3ac400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.292+0000 7f3accff9640 1 -- 172.21.15.53:0/226497680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400cd80 con 0x7f3ad010fdc0 2024-08-31T06:29:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.292+0000 7f3accff9640 1 -- 172.21.15.53:0/226497680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ac40035f0 con 0x7f3ad010fdc0 2024-08-31T06:29:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.292+0000 7f3accff9640 1 -- 172.21.15.53:0/226497680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4010690 con 0x7f3ad010fdc0 2024-08-31T06:29:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.292+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/226497680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad010c1e0 con 0x7f3ad010fdc0 2024-08-31T06:29:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.292+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/226497680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad010c730 con 0x7f3ad010fdc0 2024-08-31T06:29:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.296+0000 7f3adcc09740 1 Processor -- start 2024-08-31T06:29:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3accff9640 1 -- 172.21.15.53:0/226497680 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3ac4010830 con 0x7f3ad010fdc0 2024-08-31T06:29:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3adcc09740 1 -- start start 2024-08-31T06:29:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 0x55ff199e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199e5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199e5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3adcc09740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ff1995a000 con 0x55ff196182f0 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3adcc09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ff19949590 con 0x55ff196411b0 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3adcc09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ff1994d540 con 0x55ff196204d0 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3aceffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 0x55ff199e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3acf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199e5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3aceffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 0x55ff199e4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:55838/0 (socket says 172.21.15.53:55838) 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3acf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199e5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48388/0 (socket says 172.21.15.53:48388) 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.297+0000 7f3aceffd640 1 -- 172.21.15.53:0/3269631768 learned_addr learned my addr 172.21.15.53:0/3269631768 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.298+0000 7f3aceffd640 1 --2- 172.21.15.53:0/3269631768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199e5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.298+0000 7f3acf7fe640 1 -- 172.21.15.53:0/3269631768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 msgr2=0x55ff199e5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.298+0000 7f3acf7fe640 1 --2- 172.21.15.53:0/3269631768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199e5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.298+0000 7f3acf7fe640 1 -- 172.21.15.53:0/3269631768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 msgr2=0x55ff199e4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.298+0000 7f3acf7fe640 1 --2- 172.21.15.53:0/3269631768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 0x55ff199e4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.298+0000 7f3acf7fe640 1 -- 172.21.15.53:0/3269631768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff196ac790 con 0x55ff196182f0 2024-08-31T06:29:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.298+0000 7f3aceffd640 1 --2- 172.21.15.53:0/3269631768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 0x55ff199e4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.298+0000 7f3accff9640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ab80b4e30 0x7f3ab80b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.299+0000 7f3aceffd640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ab80b4e30 0x7f3ab80b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.299+0000 7f3acf7fe640 1 --2- 172.21.15.53:0/3269631768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199e5000 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8000f80 tx=0x7f3ac8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18127937e95f0c88 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.299+0000 7f3accff9640 1 -- 172.21.15.53:0/226497680 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f3ac40e5840 con 0x7f3ad010fdc0 2024-08-31T06:29:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.299+0000 7f3aceffd640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ab80b4e30 0x7f3ab80b7340 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00058c0 tx=0x7f3ac00096e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.299+0000 7f3ab5ffb640 1 -- 172.21.15.53:0/3269631768 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8031980 con 0x55ff196182f0 2024-08-31T06:29:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.299+0000 7f3ab5ffb640 1 -- 172.21.15.53:0/3269631768 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ac8036030 con 0x55ff196182f0 2024-08-31T06:29:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.299+0000 7f3ab5ffb640 1 -- 172.21.15.53:0/3269631768 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80042a0 con 0x55ff196182f0 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.300+0000 7f3adcc09740 1 -- 172.21.15.53:0/3269631768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 msgr2=0x55ff199e5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.300+0000 7f3adcc09740 1 --2- 172.21.15.53:0/3269631768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199e5000 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8000f80 tx=0x7f3ac8009a20 comp rx=0 tx=0).stop 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.300+0000 7f3adcc09740 1 -- 172.21.15.53:0/3269631768 shutdown_connections 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.300+0000 7f3adcc09740 1 --2- 172.21.15.53:0/3269631768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199e5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.300+0000 7f3adcc09740 1 --2- 172.21.15.53:0/3269631768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199e5000 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.300+0000 7f3adcc09740 1 --2- 172.21.15.53:0/3269631768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 0x55ff199e4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.300+0000 7f3adcc09740 1 -- 172.21.15.53:0/3269631768 >> 172.21.15.53:0/3269631768 conn(0x55ff19635300 msgr2=0x55ff199e29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.300+0000 7f3adcc09740 1 -- 172.21.15.53:0/3269631768 shutdown_connections 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.301+0000 7f3adcc09740 1 -- 172.21.15.53:0/3269631768 wait complete. 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.301+0000 7f3adcc09740 1 -- start start 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.301+0000 7f3adcc09740 1 Processor -- start 2024-08-31T06:29:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196182f0 0x55ff199f0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196204d0 0x55ff199f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 0x55ff199fc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3aceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196204d0 0x55ff199f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3acf7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196182f0 0x55ff199f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3aceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196204d0 0x55ff199f0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48402/0 (socket says 172.21.15.53:48402) 2024-08-31T06:29:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3acf7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196182f0 0x55ff199f0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:42472/0 (socket says 172.21.15.53:42472) 2024-08-31T06:29:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3aceffd640 1 -- 172.21.15.53:0/541037394 learned_addr learned my addr 172.21.15.53:0/541037394 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3adcc09740 1 -- 172.21.15.53:0/541037394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ff19882ab0 con 0x55ff196204d0 2024-08-31T06:29:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3adcc09740 1 -- 172.21.15.53:0/541037394 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ff198d0680 con 0x55ff196411b0 2024-08-31T06:29:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3adcc09740 1 -- 172.21.15.53:0/541037394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ff199f3060 con 0x55ff196182f0 2024-08-31T06:29:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.302+0000 7f3acffff640 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 0x55ff199fc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.303+0000 7f3acf7fe640 1 -- 172.21.15.53:0/541037394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 msgr2=0x55ff199fc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.303+0000 7f3acf7fe640 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 0x55ff199fc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.303+0000 7f3acf7fe640 1 -- 172.21.15.53:0/541037394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196204d0 msgr2=0x55ff199f0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.303+0000 7f3adcc09740 10 client.0 _ll_register_callbacks cb 0x55ff19658a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.303+0000 7f3acf7fe640 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196204d0 0x55ff199f0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.303+0000 7f3acf7fe640 1 -- 172.21.15.53:0/541037394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff19725620 con 0x55ff196182f0 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.303+0000 7f3adcc09740 1 -- 172.21.15.53:0/541037394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ac8036030 con 0x55ff196182f0 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.303+0000 7f3aceffd640 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196204d0 0x55ff199f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.303+0000 7f3acf7fe640 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196182f0 0x55ff199f0680 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80094e0 tx=0x7f3ac80093d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3793eee8c4081a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.303+0000 7f3aaeffd640 10 client.31507 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.303+0000 7f3aaeffd640 1 -- 172.21.15.53:0/541037394 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac804a040 con 0x55ff196182f0 2024-08-31T06:29:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.304+0000 7f3aaeffd640 1 -- 172.21.15.53:0/541037394 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f3ac8031b80 con 0x55ff196182f0 2024-08-31T06:29:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.304+0000 7f3aaeffd640 1 -- 172.21.15.53:0/541037394 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f3ac8031e00 con 0x55ff196182f0 2024-08-31T06:29:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.304+0000 7f3adcc09740 10 client.31507 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.304+0000 7f3adcc09740 1 -- 172.21.15.53:0/541037394 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=90}) -- 0x55ff199feef0 con 0x55ff196182f0 2024-08-31T06:29:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.304+0000 7f3aaeffd640 1 -- 172.21.15.53:0/541037394 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f3ac804d030 con 0x55ff196182f0 2024-08-31T06:29:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.304+0000 7f3adcc09740 10 client.31507 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.304+0000 7f3adcc09740 10 client.31507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.304+0000 7f3adcc09740 20 client.31507 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.304+0000 7f3adcc09740 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ff195ffd80 0x55ff19a02250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.304+0000 7f3adcc09740 4 client.31507 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.304+0000 7f3adcc09740 1 -- 172.21.15.53:0/541037394 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff1995bf50 con 0x55ff195ffd80 2024-08-31T06:29:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.305+0000 7f3aceffd640 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ff195ffd80 0x55ff19a02250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.305+0000 7f3aaeffd640 10 client.31507 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.305+0000 7f3aceffd640 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ff195ffd80 0x55ff19a02250 crc :-1 s=READY pgs=568 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4df00d305e27ca4 server_cookie=316fe3588baeb717 in_seq=0 out_seq=0 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.306+0000 7f3aaeffd640 1 -- 172.21.15.53:0/541037394 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff1995bf50 con 0x55ff195ffd80 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.306+0000 7f3aaeffd640 10 client.31507 handle_command_reply: tid=0 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.306+0000 7f3adcc09740 1 client.31507 shutdown 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3adcc09740 1 -- 172.21.15.53:0/541037394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196182f0 msgr2=0x55ff199f0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3adcc09740 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196182f0 0x55ff199f0680 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80094e0 tx=0x7f3ac80093d0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3adcc09740 1 -- 172.21.15.53:0/541037394 shutdown_connections 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3adcc09740 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ff195ffd80 0x55ff19a02250 crc :-1 s=READY pgs=568 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3aaeffd640 0 client.31507 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3adcc09740 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff196411b0 0x55ff199fc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3adcc09740 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196204d0 0x55ff199f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3adcc09740 1 --2- 172.21.15.53:0/541037394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196182f0 0x55ff199f0680 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3adcc09740 1 -- 172.21.15.53:0/541037394 >> 172.21.15.53:0/541037394 conn(0x55ff19635300 msgr2=0x55ff199e5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3adcc09740 1 -- 172.21.15.53:0/541037394 shutdown_connections 2024-08-31T06:29:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3adcc09740 1 -- 172.21.15.53:0/541037394 wait complete. 2024-08-31T06:29:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.307+0000 7f3adcc09740 20 client.31507 trim_cache size 0 max 16384 2024-08-31T06:29:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3adcc09740 1 Processor -- start 2024-08-31T06:29:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3adcc09740 1 -- start start 2024-08-31T06:29:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 0x55ff199e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199ea0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199ed640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3adcc09740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad01be0e0 con 0x55ff196182f0 2024-08-31T06:29:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3adcc09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad01bfce0 con 0x55ff195ffd80 2024-08-31T06:29:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3adcc09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad01be7b0 con 0x55ff196204d0 2024-08-31T06:29:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3aceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199ea0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3aceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199ea0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48408/0 (socket says 172.21.15.53:48408) 2024-08-31T06:29:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3aceffd640 1 -- 172.21.15.53:0/1840131321 learned_addr learned my addr 172.21.15.53:0/1840131321 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3acffff640 1 --2- 172.21.15.53:0/1840131321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.333+0000 7f3acf7fe640 1 --2- 172.21.15.53:0/1840131321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 0x55ff199e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.334+0000 7f3aceffd640 1 -- 172.21.15.53:0/1840131321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 msgr2=0x55ff199ed640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.334+0000 7f3aceffd640 1 --2- 172.21.15.53:0/1840131321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199ed640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.334+0000 7f3aceffd640 1 -- 172.21.15.53:0/1840131321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 msgr2=0x55ff199e9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.334+0000 7f3aceffd640 1 --2- 172.21.15.53:0/1840131321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 0x55ff199e9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.334+0000 7f3aceffd640 1 -- 172.21.15.53:0/1840131321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff19a02580 con 0x55ff196182f0 2024-08-31T06:29:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.334+0000 7f3acffff640 1 --2- 172.21.15.53:0/1840131321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199ed640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.334+0000 7f3aceffd640 1 --2- 172.21.15.53:0/1840131321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199ea0c0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0012820 tx=0x7f3ac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ca4d3e3a020e25 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.334+0000 7f3ab57fa640 1 -- 172.21.15.53:0/1840131321 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0004370 con 0x55ff196182f0 2024-08-31T06:29:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.334+0000 7f3ab57fa640 1 -- 172.21.15.53:0/1840131321 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ac0024460 con 0x55ff196182f0 2024-08-31T06:29:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.334+0000 7f3ab57fa640 1 -- 172.21.15.53:0/1840131321 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000f450 con 0x55ff196182f0 2024-08-31T06:29:26.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.335+0000 7f3adcc09740 1 -- 172.21.15.53:0/1840131321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 msgr2=0x55ff199ea0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:26.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.336+0000 7f3adcc09740 1 --2- 172.21.15.53:0/1840131321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199ea0c0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0012820 tx=0x7f3ac00046c0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.342 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.336+0000 7f3adcc09740 1 -- 172.21.15.53:0/1840131321 shutdown_connections 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.336+0000 7f3adcc09740 1 --2- 172.21.15.53:0/1840131321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199ed640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.336+0000 7f3adcc09740 1 --2- 172.21.15.53:0/1840131321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199ea0c0 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.336+0000 7f3adcc09740 1 --2- 172.21.15.53:0/1840131321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 0x55ff199e9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.336+0000 7f3adcc09740 1 -- 172.21.15.53:0/1840131321 >> 172.21.15.53:0/1840131321 conn(0x55ff19635300 msgr2=0x55ff199eecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.336+0000 7f3adcc09740 1 -- 172.21.15.53:0/1840131321 shutdown_connections 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.336+0000 7f3adcc09740 1 -- 172.21.15.53:0/1840131321 wait complete. 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.337+0000 7f3adcc09740 1 -- start start 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.337+0000 7f3adcc09740 1 Processor -- start 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.337+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 0x55ff199f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.337+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199f6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3adcc09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3adcc09740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad01bf610 con 0x55ff196182f0 2024-08-31T06:29:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3adcc09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad01bee80 con 0x55ff195ffd80 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3adcc09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad01bc0e0 con 0x55ff196204d0 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3adcc09740 10 client.0 _ll_register_callbacks cb 0x7f3ac0009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3acf7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 0x55ff199f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3acffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3acf7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 0x55ff199f63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:55860/0 (socket says 172.21.15.53:55860) 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3acf7fe640 1 -- 172.21.15.53:0/2950038168 learned_addr learned my addr 172.21.15.53:0/2950038168 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3aceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3acf7fe640 1 -- 172.21.15.53:0/2950038168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 msgr2=0x55ff199f6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3acf7fe640 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199f6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3acf7fe640 1 -- 172.21.15.53:0/2950038168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 msgr2=0x55ff199f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3acf7fe640 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199f6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3acf7fe640 1 -- 172.21.15.53:0/2950038168 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff19a6bb60 con 0x55ff195ffd80 2024-08-31T06:29:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3acffff640 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.338+0000 7f3aceffd640 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.339+0000 7f3acf7fe640 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 0x55ff199f63f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009620 tx=0x7f3ac8031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b63a4cf5023e65ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.339+0000 7f3aaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.339+0000 7f3aaeffd640 1 -- 172.21.15.53:0/2950038168 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8003b80 con 0x55ff195ffd80 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.339+0000 7f3aaeffd640 1 -- 172.21.15.53:0/2950038168 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f3ac8030d60 con 0x55ff195ffd80 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.339+0000 7f3adcc09740 1 -- 172.21.15.53:0/2950038168 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ac0024460 con 0x55ff195ffd80 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.339+0000 7f3aaeffd640 1 -- 172.21.15.53:0/2950038168 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f3ac8031c60 con 0x55ff195ffd80 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.339+0000 7f3adcc09740 10 client.31508 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.339+0000 7f3adcc09740 1 -- 172.21.15.53:0/2950038168 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x55ff19a6cdf0 con 0x55ff195ffd80 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.339+0000 7f3aaeffd640 1 -- 172.21.15.53:0/2950038168 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ac0024460 con 0x55ff195ffd80 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.339+0000 7f3aaeffd640 1 -- 172.21.15.53:0/2950038168 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f3ac804d040 con 0x55ff195ffd80 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.340+0000 7f3adcc09740 10 client.31508 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.340+0000 7f3adcc09740 10 client.31508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.340+0000 7f3adcc09740 20 client.31508 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.340+0000 7f3adcc09740 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ff196411b0 0x55ff19a6f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.340+0000 7f3adcc09740 4 client.31508 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:29:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.340+0000 7f3adcc09740 1 -- 172.21.15.53:0/2950038168 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff199579f0 con 0x55ff196411b0 2024-08-31T06:29:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.340+0000 7f3aceffd640 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ff196411b0 0x55ff19a6f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.340+0000 7f3aaeffd640 10 client.31508 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.340+0000 7f3aceffd640 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ff196411b0 0x55ff19a6f460 crc :-1 s=READY pgs=569 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42405b0c953301ab server_cookie=4eed3417b23a6cd9 in_seq=0 out_seq=0 2024-08-31T06:29:26.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:26 smithi130 ceph-mon[22266]: pgmap v1095: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 302 op/s 2024-08-31T06:29:26.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 70998 5.53 MB/sec execute 554 sec latency 133.029 ms 2024-08-31T06:29:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:26 smithi153 ceph-mon[22320]: pgmap v1095: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 302 op/s 2024-08-31T06:29:26.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:25 smithi053 ceph-mon[18924]: pgmap v1095: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 302 op/s 2024-08-31T06:29:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3aaeffd640 1 -- 172.21.15.53:0/2950038168 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff199579f0 con 0x55ff196411b0 2024-08-31T06:29:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3aaeffd640 10 client.31508 handle_command_reply: tid=0 2024-08-31T06:29:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 1 client.31508 shutdown 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 1 -- 172.21.15.53:0/2950038168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 msgr2=0x55ff199f63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 0x55ff199f63f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009620 tx=0x7f3ac8031000 comp rx=0 tx=0).stop 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 1 -- 172.21.15.53:0/2950038168 shutdown_connections 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ff196411b0 0x55ff19a6f460 crc :-1 s=READY pgs=569 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff196204d0 0x55ff199f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3aaeffd640 0 client.31508 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ff196182f0 0x55ff199f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 1 --2- 172.21.15.53:0/2950038168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff195ffd80 0x55ff199f63f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 1 -- 172.21.15.53:0/2950038168 >> 172.21.15.53:0/2950038168 conn(0x55ff19635300 msgr2=0x55ff199eec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 1 -- 172.21.15.53:0/2950038168 shutdown_connections 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 1 -- 172.21.15.53:0/2950038168 wait complete. 2024-08-31T06:29:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.488+0000 7f3adcc09740 20 client.31508 trim_cache size 0 max 16384 2024-08-31T06:29:26.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:29:26.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:29:26.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:29:26.492 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:29:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.489+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/226497680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ab80b4e30 msgr2=0x7f3ab80b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.489+0000 7f3ad5bc3640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ab80b4e30 0x7f3ab80b7340 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00058c0 tx=0x7f3ac00096e0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.489+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/226497680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad010fdc0 msgr2=0x7f3ad0106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.489+0000 7f3ad5bc3640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad010fdc0 0x7f3ad0106ef0 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400e9b0 tx=0x7f3ac400ee70 comp rx=0 tx=0).stop 2024-08-31T06:29:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.489+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/226497680 shutdown_connections 2024-08-31T06:29:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.489+0000 7f3ad5bc3640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3ab80b4e30 0x7f3ab80b7340 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.489+0000 7f3ad5bc3640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad010fdc0 0x7f3ad0106ef0 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.489+0000 7f3ad5bc3640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ad0075ea0 0x7f3ad01069b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.489+0000 7f3ad5bc3640 1 --2- 172.21.15.53:0/226497680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ad0075550 0x7f3ad010f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.489+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/226497680 >> 172.21.15.53:0/226497680 conn(0x7f3ad00ff2b0 msgr2=0x7f3ad0114e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:26.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.489+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/226497680 shutdown_connections 2024-08-31T06:29:26.494 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:26.490+0000 7f3ad5bc3640 1 -- 172.21.15.53:0/226497680 wait complete. 2024-08-31T06:29:27.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 71129 5.53 MB/sec execute 555 sec latency 124.820 ms 2024-08-31T06:29:28.272 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:28 smithi053 ceph-mon[18924]: pgmap v1096: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 328 op/s 2024-08-31T06:29:28.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:28 smithi130 ceph-mon[22266]: pgmap v1096: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 328 op/s 2024-08-31T06:29:28.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 71249 5.53 MB/sec execute 556 sec latency 104.304 ms 2024-08-31T06:29:28.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:28 smithi153 ceph-mon[22320]: pgmap v1096: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 328 op/s 2024-08-31T06:29:28.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.228+0000 7fce88874640 1 -- 172.21.15.53:0/2313253789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84109bd0 msgr2=0x7fce84110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:28.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.228+0000 7fce88874640 1 --2- 172.21.15.53:0/2313253789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84109bd0 0x7fce84110400 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009ca0 tx=0x7fce7c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.228+0000 7fce88874640 1 -- 172.21.15.53:0/2313253789 shutdown_connections 2024-08-31T06:29:28.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.228+0000 7fce88874640 1 --2- 172.21.15.53:0/2313253789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84109bd0 0x7fce84110400 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.228+0000 7fce88874640 1 --2- 172.21.15.53:0/2313253789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce84109280 0x7fce84109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.228+0000 7fce88874640 1 --2- 172.21.15.53:0/2313253789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce84103940 0x7fce84103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.228+0000 7fce88874640 1 -- 172.21.15.53:0/2313253789 >> 172.21.15.53:0/2313253789 conn(0x7fce840ff3d0 msgr2=0x7fce84101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.228+0000 7fce88874640 1 -- 172.21.15.53:0/2313253789 shutdown_connections 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.228+0000 7fce88874640 1 -- 172.21.15.53:0/2313253789 wait complete. 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.229+0000 7fce88874640 1 Processor -- start 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.229+0000 7fce88874640 1 -- start start 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.229+0000 7fce88874640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84103940 0x7fce8419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.229+0000 7fce88874640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce84109280 0x7fce8419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce88874640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce84109bd0 0x7fce8419f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce88874640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce84113790 con 0x7fce84103940 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce81d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce84109280 0x7fce8419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce8259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84103940 0x7fce8419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce81d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce84109280 0x7fce8419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:55882/0 (socket says 172.21.15.53:55882) 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce8259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84103940 0x7fce8419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48428/0 (socket says 172.21.15.53:48428) 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce88874640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce84113610 con 0x7fce84109280 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce81d9b640 1 -- 172.21.15.53:0/371920 learned_addr learned my addr 172.21.15.53:0/371920 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce88874640 1 -- 172.21.15.53:0/371920 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce84113910 con 0x7fce84109bd0 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce82d9d640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce84109bd0 0x7fce8419f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce81d9b640 1 -- 172.21.15.53:0/371920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce84109bd0 msgr2=0x7fce8419f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce81d9b640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce84109bd0 0x7fce8419f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce81d9b640 1 -- 172.21.15.53:0/371920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84103940 msgr2=0x7fce8419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce81d9b640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84103940 0x7fce8419a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce81d9b640 1 -- 172.21.15.53:0/371920 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce841a0090 con 0x7fce84109280 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce82d9d640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce84109bd0 0x7fce8419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce8259c640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84103940 0x7fce8419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.230+0000 7fce81d9b640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce84109280 0x7fce8419a6c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fce7800e9f0 tx=0x7fce7800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.231+0000 7fce737fe640 1 -- 172.21.15.53:0/371920 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7800ccc0 con 0x7fce84109280 2024-08-31T06:29:28.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.231+0000 7fce88874640 1 -- 172.21.15.53:0/371920 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce841a0380 con 0x7fce84109280 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.231+0000 7fce737fe640 1 -- 172.21.15.53:0/371920 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce780108c0 con 0x7fce84109280 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.231+0000 7fce737fe640 1 -- 172.21.15.53:0/371920 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce78018750 con 0x7fce84109280 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.231+0000 7fce88874640 1 -- 172.21.15.53:0/371920 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce841a6ae0 con 0x7fce84109280 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.234+0000 7fce8ede9740 1 Processor -- start 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.234+0000 7fce8ede9740 1 -- start start 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.234+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35142070 0x55cb354e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.234+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb351191b0 0x55cb354e7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb35121390 0x55cb354e7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce8ede9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb3545e630 con 0x55cb35121390 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce8ede9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cb3544dbc0 con 0x55cb351191b0 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce8ede9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cb35451b70 con 0x55cb35142070 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce82d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35142070 0x55cb354e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce82d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35142070 0x55cb354e72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:42528/0 (socket says 172.21.15.53:42528) 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce82d9d640 1 -- 172.21.15.53:0/947347642 learned_addr learned my addr 172.21.15.53:0/947347642 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce8259c640 1 --2- 172.21.15.53:0/947347642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb351191b0 0x55cb354e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce82d9d640 1 -- 172.21.15.53:0/947347642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb351191b0 msgr2=0x55cb354e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce82d9d640 1 --2- 172.21.15.53:0/947347642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb351191b0 0x55cb354e7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce82d9d640 1 -- 172.21.15.53:0/947347642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb35121390 msgr2=0x55cb354e7d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce82d9d640 1 --2- 172.21.15.53:0/947347642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb35121390 0x55cb354e7d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce82d9d640 1 -- 172.21.15.53:0/947347642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb351ad650 con 0x55cb35142070 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce8259c640 1 --2- 172.21.15.53:0/947347642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb351191b0 0x55cb354e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.235+0000 7fce737fe640 1 -- 172.21.15.53:0/371920 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fce78010430 con 0x7fce84109280 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.236+0000 7fce82d9d640 1 --2- 172.21.15.53:0/947347642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35142070 0x55cb354e72c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0094b0 tx=0x7fce7c009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b2c2f839716b618 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.236+0000 7fce70ff9640 1 -- 172.21.15.53:0/947347642 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c031980 con 0x55cb35142070 2024-08-31T06:29:28.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.236+0000 7fce70ff9640 1 -- 172.21.15.53:0/947347642 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce7c036040 con 0x55cb35142070 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.236+0000 7fce70ff9640 1 -- 172.21.15.53:0/947347642 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c004350 con 0x55cb35142070 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.236+0000 7fce737fe640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce6c0b4d20 0x7fce6c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.237+0000 7fce8259c640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce6c0b4d20 0x7fce6c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.237+0000 7fce737fe640 1 -- 172.21.15.53:0/371920 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7fce780e5950 con 0x7fce84109280 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.237+0000 7fce8ede9740 1 -- 172.21.15.53:0/947347642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35142070 msgr2=0x55cb354e72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.237+0000 7fce8ede9740 1 --2- 172.21.15.53:0/947347642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35142070 0x55cb354e72c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0094b0 tx=0x7fce7c009a20 comp rx=0 tx=0).stop 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.237+0000 7fce8ede9740 1 -- 172.21.15.53:0/947347642 shutdown_connections 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.237+0000 7fce8ede9740 1 --2- 172.21.15.53:0/947347642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb35121390 0x55cb354e7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.237+0000 7fce8ede9740 1 --2- 172.21.15.53:0/947347642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb351191b0 0x55cb354e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.237+0000 7fce8259c640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce6c0b4d20 0x7fce6c0b7230 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fce74009fd0 tx=0x7fce74005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.237+0000 7fce8ede9740 1 --2- 172.21.15.53:0/947347642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35142070 0x55cb354e72c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.237+0000 7fce8ede9740 1 -- 172.21.15.53:0/947347642 >> 172.21.15.53:0/947347642 conn(0x55cb35136460 msgr2=0x55cb354e51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.238+0000 7fce8ede9740 1 -- 172.21.15.53:0/947347642 shutdown_connections 2024-08-31T06:29:28.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.238+0000 7fce8ede9740 1 -- 172.21.15.53:0/947347642 wait complete. 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.238+0000 7fce8ede9740 1 -- start start 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.238+0000 7fce8ede9740 1 Processor -- start 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb354f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35121390 0x55cb354f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35142070 0x55cb35503100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce8ede9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb352b0700 con 0x55cb351191b0 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce8ede9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cb353d4700 con 0x55cb35142070 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce8ede9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cb354f9da0 con 0x55cb35121390 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce8ede9740 10 client.0 _ll_register_callbacks cb 0x55cb35403dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce81d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35121390 0x55cb354f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce8259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb354f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce81d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35121390 0x55cb354f74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:42530/0 (socket says 172.21.15.53:42530) 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce81d9b640 1 -- 172.21.15.53:0/4289167006 learned_addr learned my addr 172.21.15.53:0/4289167006 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:28.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.239+0000 7fce82d9d640 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35142070 0x55cb35503100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.240+0000 7fce8259c640 1 -- 172.21.15.53:0/4289167006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35121390 msgr2=0x55cb354f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.240+0000 7fce8259c640 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35121390 0x55cb354f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.240+0000 7fce8259c640 1 -- 172.21.15.53:0/4289167006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35142070 msgr2=0x55cb35503100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.240+0000 7fce8259c640 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35142070 0x55cb35503100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.240+0000 7fce8259c640 1 -- 172.21.15.53:0/4289167006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb3540d8b0 con 0x55cb351191b0 2024-08-31T06:29:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.240+0000 7fce8259c640 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb354f6f40 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fce74012d70 tx=0x7fce74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5c496d9846a5a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.240+0000 7fce69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.241+0000 7fce69ffb640 1 -- 172.21.15.53:0/4289167006 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74004030 con 0x55cb351191b0 2024-08-31T06:29:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.241+0000 7fce69ffb640 1 -- 172.21.15.53:0/4289167006 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7fce740041d0 con 0x55cb351191b0 2024-08-31T06:29:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.241+0000 7fce8ede9740 1 -- 172.21.15.53:0/4289167006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce7c036040 con 0x55cb351191b0 2024-08-31T06:29:28.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.241+0000 7fce69ffb640 1 -- 172.21.15.53:0/4289167006 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fce740043d0 con 0x55cb351191b0 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.241+0000 7fce8ede9740 10 client.22881 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.241+0000 7fce8ede9740 1 -- 172.21.15.53:0/4289167006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x55cb354ed6a0 con 0x55cb351191b0 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.242+0000 7fce69ffb640 1 -- 172.21.15.53:0/4289167006 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce7c036040 con 0x55cb351191b0 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.242+0000 7fce69ffb640 1 -- 172.21.15.53:0/4289167006 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7fce74027020 con 0x55cb351191b0 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.242+0000 7fce8ede9740 10 client.22881 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.242+0000 7fce8ede9740 10 client.22881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.242+0000 7fce8ede9740 20 client.22881 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.242+0000 7fce8ede9740 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cb351009f0 0x55cb354f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.242+0000 7fce8ede9740 4 client.22881 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.242+0000 7fce8ede9740 1 -- 172.21.15.53:0/4289167006 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb35460580 con 0x55cb351009f0 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.242+0000 7fce81d9b640 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cb351009f0 0x55cb354f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.243+0000 7fce69ffb640 10 client.22881 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:28.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.243+0000 7fce81d9b640 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cb351009f0 0x55cb354f0ac0 crc :-1 s=READY pgs=570 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1a06bd64f93b65 server_cookie=4da0db13c09ba45c in_seq=0 out_seq=0 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.244+0000 7fce69ffb640 1 -- 172.21.15.53:0/4289167006 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb35460580 con 0x55cb351009f0 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.244+0000 7fce69ffb640 10 client.22881 handle_command_reply: tid=0 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.244+0000 7fce8ede9740 1 client.22881 shutdown 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.244+0000 7fce8ede9740 1 -- 172.21.15.53:0/4289167006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 msgr2=0x55cb354f6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.244+0000 7fce8ede9740 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb354f6f40 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fce74012d70 tx=0x7fce74004730 comp rx=0 tx=0).stop 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.244+0000 7fce8ede9740 1 -- 172.21.15.53:0/4289167006 shutdown_connections 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.244+0000 7fce8ede9740 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cb351009f0 0x55cb354f0ac0 crc :-1 s=READY pgs=570 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.244+0000 7fce8ede9740 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35142070 0x55cb35503100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.244+0000 7fce8ede9740 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35121390 0x55cb354f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.244+0000 7fce8ede9740 1 --2- 172.21.15.53:0/4289167006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb354f6f40 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.245+0000 7fce8ede9740 1 -- 172.21.15.53:0/4289167006 >> 172.21.15.53:0/4289167006 conn(0x55cb35136460 msgr2=0x55cb354e8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:28.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.245+0000 7fce69ffb640 0 client.22881 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.245+0000 7fce8ede9740 1 -- 172.21.15.53:0/4289167006 shutdown_connections 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.245+0000 7fce8ede9740 1 -- 172.21.15.53:0/4289167006 wait complete. 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.245+0000 7fce8ede9740 20 client.22881 trim_cache size 0 max 16384 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.270+0000 7fce8ede9740 1 Processor -- start 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.270+0000 7fce8ede9740 1 -- start start 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.270+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35136460 0x55cb354f8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.270+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb354f4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.270+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35121390 0x55cb354f4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.270+0000 7fce8ede9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce841b5bb0 con 0x55cb351191b0 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.270+0000 7fce8ede9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce841b77b0 con 0x55cb35121390 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.270+0000 7fce8ede9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce841b6280 con 0x55cb35136460 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce8259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35136460 0x55cb354f8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce81d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb354f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce82d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35121390 0x55cb354f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce8259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35136460 0x55cb354f8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:42546/0 (socket says 172.21.15.53:42546) 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce8259c640 1 -- 172.21.15.53:0/342772182 learned_addr learned my addr 172.21.15.53:0/342772182 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce82d9d640 1 -- 172.21.15.53:0/342772182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35136460 msgr2=0x55cb354f8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce82d9d640 1 --2- 172.21.15.53:0/342772182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35136460 0x55cb354f8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce82d9d640 1 -- 172.21.15.53:0/342772182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 msgr2=0x55cb354f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce82d9d640 1 --2- 172.21.15.53:0/342772182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb354f4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce82d9d640 1 -- 172.21.15.53:0/342772182 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb354f7920 con 0x55cb35121390 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce81d9b640 1 --2- 172.21.15.53:0/342772182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb354f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce82d9d640 1 --2- 172.21.15.53:0/342772182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35121390 0x55cb354f4670 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009bf0 tx=0x7fce7c02af40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2462f8eca9fda27c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.271+0000 7fce6bfff640 1 -- 172.21.15.53:0/342772182 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c04a040 con 0x55cb35121390 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.272+0000 7fce6bfff640 1 -- 172.21.15.53:0/342772182 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce7c036040 con 0x55cb35121390 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.272+0000 7fce6bfff640 1 -- 172.21.15.53:0/342772182 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c004290 con 0x55cb35121390 2024-08-31T06:29:28.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.273+0000 7fce8ede9740 1 -- 172.21.15.53:0/342772182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35121390 msgr2=0x55cb354f4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.273+0000 7fce8ede9740 1 --2- 172.21.15.53:0/342772182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35121390 0x55cb354f4670 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009bf0 tx=0x7fce7c02af40 comp rx=0 tx=0).stop 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.273+0000 7fce8ede9740 1 -- 172.21.15.53:0/342772182 shutdown_connections 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.273+0000 7fce8ede9740 1 --2- 172.21.15.53:0/342772182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35121390 0x55cb354f4670 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.273+0000 7fce8ede9740 1 --2- 172.21.15.53:0/342772182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb354f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.273+0000 7fce8ede9740 1 --2- 172.21.15.53:0/342772182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35136460 0x55cb354f8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.273+0000 7fce8ede9740 1 -- 172.21.15.53:0/342772182 >> 172.21.15.53:0/342772182 conn(0x55cb354f1930 msgr2=0x55cb354f8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.273+0000 7fce8ede9740 1 -- 172.21.15.53:0/342772182 shutdown_connections 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.273+0000 7fce8ede9740 1 -- 172.21.15.53:0/342772182 wait complete. 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.273+0000 7fce8ede9740 1 -- start start 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.273+0000 7fce8ede9740 1 Processor -- start 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb3550ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35121390 0x55cb3550b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8ede9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35136460 0x55cb355683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8ede9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce841b70e0 con 0x55cb351191b0 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8ede9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce841b6950 con 0x55cb35136460 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8ede9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce841b3bb0 con 0x55cb35121390 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8ede9740 10 client.0 _ll_register_callbacks cb 0x7fce74009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb3550ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb3550ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48474/0 (socket says 172.21.15.53:48474) 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8259c640 1 -- 172.21.15.53:0/1581644516 learned_addr learned my addr 172.21.15.53:0/1581644516 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce81d9b640 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35121390 0x55cb3550b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce82d9d640 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35136460 0x55cb355683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8259c640 1 -- 172.21.15.53:0/1581644516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35121390 msgr2=0x55cb3550b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:28.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8259c640 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35121390 0x55cb3550b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8259c640 1 -- 172.21.15.53:0/1581644516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35136460 msgr2=0x55cb355683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8259c640 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35136460 0x55cb355683d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.274+0000 7fce8259c640 1 -- 172.21.15.53:0/1581644516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb35568a40 con 0x55cb351191b0 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.275+0000 7fce8259c640 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb3550ab90 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fce74019040 tx=0x7fce74003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e9deb22491d7b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.275+0000 7fce69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.275+0000 7fce69ffb640 1 -- 172.21.15.53:0/1581644516 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74011c20 con 0x55cb351191b0 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.275+0000 7fce69ffb640 1 -- 172.21.15.53:0/1581644516 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7fce74011dc0 con 0x55cb351191b0 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.275+0000 7fce8ede9740 1 -- 172.21.15.53:0/1581644516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce7c036040 con 0x55cb351191b0 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.275+0000 7fce69ffb640 1 -- 172.21.15.53:0/1581644516 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fce740123f0 con 0x55cb351191b0 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.275+0000 7fce8ede9740 10 client.22887 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.275+0000 7fce8ede9740 1 -- 172.21.15.53:0/1581644516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x55cb3556fe70 con 0x55cb351191b0 2024-08-31T06:29:28.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.276+0000 7fce69ffb640 1 -- 172.21.15.53:0/1581644516 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce7c036040 con 0x55cb351191b0 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.276+0000 7fce69ffb640 1 -- 172.21.15.53:0/1581644516 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7fce74027050 con 0x55cb351191b0 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.276+0000 7fce8ede9740 10 client.22887 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.276+0000 7fce8ede9740 10 client.22887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.276+0000 7fce8ede9740 20 client.22887 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.277+0000 7fce8ede9740 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cb35142070 0x55cb355725d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.277+0000 7fce8ede9740 4 client.22887 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.277+0000 7fce8ede9740 1 -- 172.21.15.53:0/1581644516 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cb3545c020 con 0x55cb35142070 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.277+0000 7fce81d9b640 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cb35142070 0x55cb355725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.277+0000 7fce81d9b640 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cb35142070 0x55cb355725d0 crc :-1 s=READY pgs=571 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bfaecdbbdbed303 server_cookie=792b056c0a385ec in_seq=0 out_seq=0 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.277+0000 7fce69ffb640 10 client.22887 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce69ffb640 1 -- 172.21.15.53:0/1581644516 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8806 (crc 0 0 0) 0x55cb3545c020 con 0x55cb35142070 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce69ffb640 10 client.22887 handle_command_reply: tid=0 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce8ede9740 1 client.22887 shutdown 2024-08-31T06:29:28.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce8ede9740 1 -- 172.21.15.53:0/1581644516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 msgr2=0x55cb3550ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce8ede9740 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb3550ab90 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fce74019040 tx=0x7fce74003820 comp rx=0 tx=0).stop 2024-08-31T06:29:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce8ede9740 1 -- 172.21.15.53:0/1581644516 shutdown_connections 2024-08-31T06:29:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce8ede9740 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55cb35142070 0x55cb355725d0 crc :-1 s=READY pgs=571 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce8ede9740 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cb35136460 0x55cb355683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce8ede9740 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cb35121390 0x55cb3550b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce8ede9740 1 --2- 172.21.15.53:0/1581644516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb351191b0 0x55cb3550ab90 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce8ede9740 1 -- 172.21.15.53:0/1581644516 >> 172.21.15.53:0/1581644516 conn(0x55cb354f1930 msgr2=0x55cb354e8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce69ffb640 0 client.22887 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:28.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.279+0000 7fce8ede9740 1 -- 172.21.15.53:0/1581644516 shutdown_connections 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": { 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: "a8c7f914-8c3b-4a6f-8f93-71d6ae7dd589": { 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: "tag": "a8c7f914-8c3b-4a6f-8f93-71d6ae7dd589", 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: "options": "recursive,force" 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: "a8c7f914-8c3b-4a6f-8f93-71d6ae7dd589": { 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:29:19.025262+0000", 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:28.994 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:28.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:28.996 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:28.997 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:28.998 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:28.999 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:29:29.000 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.001 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: "857f8219-039c-44d2-8dd7-af494d80e735": { 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:26:48.510100+0000", 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:29:29.002 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.003 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.004 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:29:29.005 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.006 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.007 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:25:55.673122+0000", 2024-08-31T06:29:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "e839581e-94c5-4714-a1a6-40730925f6b8": { 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:28:29.506188+0000", 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "cac6d546-f1c8-4203-803b-7c8d84c48507": { 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:27:34.520218+0000", 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:29.012 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce8ede9740 1 -- 172.21.15.53:0/1581644516 wait complete. 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce8ede9740 20 client.22887 trim_cache size 0 max 16384 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce88874640 1 -- 172.21.15.53:0/371920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce6c0b4d20 msgr2=0x7fce6c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce88874640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce6c0b4d20 0x7fce6c0b7230 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fce74009fd0 tx=0x7fce74005f90 comp rx=0 tx=0).stop 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce88874640 1 -- 172.21.15.53:0/371920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce84109280 msgr2=0x7fce8419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce88874640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce84109280 0x7fce8419a6c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fce7800e9f0 tx=0x7fce7800eeb0 comp rx=0 tx=0).stop 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce88874640 1 -- 172.21.15.53:0/371920 shutdown_connections 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce88874640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fce6c0b4d20 0x7fce6c0b7230 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce88874640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce84109bd0 0x7fce8419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce88874640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce84109280 0x7fce8419a6c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce88874640 1 --2- 172.21.15.53:0/371920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce84103940 0x7fce8419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:29.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.280+0000 7fce88874640 1 -- 172.21.15.53:0/371920 >> 172.21.15.53:0/371920 conn(0x7fce840ff3d0 msgr2=0x7fce841017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:29.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.281+0000 7fce88874640 1 -- 172.21.15.53:0/371920 shutdown_connections 2024-08-31T06:29:29.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:28.281+0000 7fce88874640 1 -- 172.21.15.53:0/371920 wait complete. 2024-08-31T06:29:29.326 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-08-31T06:29:29.327 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:29:29.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 71358 5.53 MB/sec execute 557 sec latency 137.848 ms 2024-08-31T06:29:30.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:30 smithi130 ceph-mon[22266]: pgmap v1097: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 324 op/s 2024-08-31T06:29:30.407 INFO:tasks.workunit.client.0.smithi053.stdout: 10 71489 5.53 MB/sec execute 558 sec latency 122.461 ms 2024-08-31T06:29:30.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:30 smithi153 ceph-mon[22320]: pgmap v1097: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 324 op/s 2024-08-31T06:29:30.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:30 smithi053 ceph-mon[18924]: pgmap v1097: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 324 op/s 2024-08-31T06:29:31.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:29:31.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:29:31.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:31 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:29:31.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 71623 5.53 MB/sec execute 559 sec latency 122.418 ms 2024-08-31T06:29:31.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:29:31.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:29:31.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:31 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:29:31.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:29:31.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:29:31.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:31 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:29:32.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:32 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:29:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:32 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:29:32.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:32 smithi053 ceph-mon[18924]: pgmap v1098: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 320 op/s 2024-08-31T06:29:32.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:32 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:29:32.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:32 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:29:32.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:32 smithi130 ceph-mon[22266]: pgmap v1098: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 320 op/s 2024-08-31T06:29:32.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 71794 5.54 MB/sec execute 560 sec latency 69.172 ms 2024-08-31T06:29:32.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:32 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:29:32.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:32 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:29:32.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:32 smithi153 ceph-mon[22320]: pgmap v1098: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 320 op/s 2024-08-31T06:29:32.677 INFO:tasks.cephfs.filesystem:scrub status for tag:a8c7f914-8c3b-4a6f-8f93-71d6ae7dd589 - {'path': '/', 'tag': 'a8c7f914-8c3b-4a6f-8f93-71d6ae7dd589', 'options': 'recursive,force'} 2024-08-31T06:29:32.761 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:33.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.330+0000 7fb32de8e640 1 -- 172.21.15.53:0/3746018899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb328108160 msgr2=0x7fb328108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:33.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.330+0000 7fb32de8e640 1 --2- 172.21.15.53:0/3746018899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb328108160 0x7fb328108570 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009900 tx=0x7fb31c02a410 comp rx=0 tx=0).stop 2024-08-31T06:29:33.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.330+0000 7fb32de8e640 1 -- 172.21.15.53:0/3746018899 shutdown_connections 2024-08-31T06:29:33.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.330+0000 7fb32de8e640 1 --2- 172.21.15.53:0/3746018899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb328108ab0 0x7fb32810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:33.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.330+0000 7fb32de8e640 1 --2- 172.21.15.53:0/3746018899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb328108160 0x7fb328108570 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:33.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.330+0000 7fb32de8e640 1 --2- 172.21.15.53:0/3746018899 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb328102870 0x7fb328102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:33.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.330+0000 7fb32de8e640 1 -- 172.21.15.53:0/3746018899 >> 172.21.15.53:0/3746018899 conn(0x7fb328079470 msgr2=0x7fb328079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:33.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.330+0000 7fb32de8e640 1 -- 172.21.15.53:0/3746018899 shutdown_connections 2024-08-31T06:29:33.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.330+0000 7fb32de8e640 1 -- 172.21.15.53:0/3746018899 wait complete. 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.331+0000 7fb32de8e640 1 Processor -- start 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.331+0000 7fb32de8e640 1 -- start start 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb32de8e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb328102870 0x7fb32819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb32de8e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb328108160 0x7fb32819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb32de8e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb328108ab0 0x7fb32819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb32de8e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb3281125f0 con 0x7fb328102870 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb32de8e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb328112470 con 0x7fb328108160 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb32de8e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb328112770 con 0x7fb328108ab0 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb3277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb328102870 0x7fb32819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb3277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb328102870 0x7fb32819a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53558/0 (socket says 172.21.15.53:53558) 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb3277fe640 1 -- 172.21.15.53:0/225823679 learned_addr learned my addr 172.21.15.53:0/225823679 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:33.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb326ffd640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb328108160 0x7fb32819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb327fff640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb328108ab0 0x7fb32819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb3277fe640 1 -- 172.21.15.53:0/225823679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb328108ab0 msgr2=0x7fb32819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb3277fe640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb328108ab0 0x7fb32819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb3277fe640 1 -- 172.21.15.53:0/225823679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb328108160 msgr2=0x7fb32819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb3277fe640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb328108160 0x7fb32819a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.332+0000 7fb3277fe640 1 -- 172.21.15.53:0/225823679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3281a0120 con 0x7fb328102870 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.333+0000 7fb3277fe640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb328102870 0x7fb32819a1b0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7fb31800e9f0 tx=0x7fb31800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.333+0000 7fb324ff9640 1 -- 172.21.15.53:0/225823679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31800cd80 con 0x7fb328102870 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.333+0000 7fb32de8e640 1 -- 172.21.15.53:0/225823679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3281a0410 con 0x7fb328102870 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.333+0000 7fb32de8e640 1 -- 172.21.15.53:0/225823679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3281a6b70 con 0x7fb328102870 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.333+0000 7fb324ff9640 1 -- 172.21.15.53:0/225823679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3180054b0 con 0x7fb328102870 2024-08-31T06:29:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.333+0000 7fb324ff9640 1 -- 172.21.15.53:0/225823679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318010430 con 0x7fb328102870 2024-08-31T06:29:33.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.334+0000 7fb32de8e640 1 -- 172.21.15.53:0/225823679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3140052c0 con 0x7fb328102870 2024-08-31T06:29:33.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.336+0000 7fb324ff9640 1 -- 172.21.15.53:0/225823679 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb3180046c0 con 0x7fb328102870 2024-08-31T06:29:33.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.337+0000 7fb324ff9640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3100b4ca0 0x7fb3100b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:33.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.337+0000 7fb324ff9640 1 -- 172.21.15.53:0/225823679 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7fb3180e59b0 con 0x7fb328102870 2024-08-31T06:29:33.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.337+0000 7fb326ffd640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3100b4ca0 0x7fb3100b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:33.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.338+0000 7fb326ffd640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3100b4ca0 0x7fb3100b71b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb31c005940 tx=0x7fb31c0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:33.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.343+0000 7fb324ff9640 1 -- 172.21.15.53:0/225823679 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb3180ac780 con 0x7fb328102870 2024-08-31T06:29:33.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 71958 5.54 MB/sec execute 561 sec latency 84.605 ms 2024-08-31T06:29:33.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.759+0000 7fb32de8e640 1 -- 172.21.15.53:0/225823679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3140055b0 con 0x7fb328102870 2024-08-31T06:29:33.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.760+0000 7fb324ff9640 1 -- 172.21.15.53:0/225823679 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+11992 (secure 0 0 0) 0x7fb3180ac080 con 0x7fb328102870 2024-08-31T06:29:33.762 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:29:33.762 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":90,"btime":"2024-08-31T06:29:16:977675+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":90,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:29:16.408419+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:29:33.762 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 90 2024-08-31T06:29:33.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 -- 172.21.15.53:0/225823679 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3100b4ca0 msgr2=0x7fb3100b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:33.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3100b4ca0 0x7fb3100b71b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb31c005940 tx=0x7fb31c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:29:33.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 -- 172.21.15.53:0/225823679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb328102870 msgr2=0x7fb32819a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:33.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb328102870 0x7fb32819a1b0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7fb31800e9f0 tx=0x7fb31800edf0 comp rx=0 tx=0).stop 2024-08-31T06:29:33.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 -- 172.21.15.53:0/225823679 shutdown_connections 2024-08-31T06:29:33.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb3100b4ca0 0x7fb3100b71b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:33.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb328108ab0 0x7fb32819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:33.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb328108160 0x7fb32819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:33.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 --2- 172.21.15.53:0/225823679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb328102870 0x7fb32819a1b0 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:33.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 -- 172.21.15.53:0/225823679 >> 172.21.15.53:0/225823679 conn(0x7fb328079470 msgr2=0x7fb328101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:33.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 -- 172.21.15.53:0/225823679 shutdown_connections 2024-08-31T06:29:33.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:33.763+0000 7fb32de8e640 1 -- 172.21.15.53:0/225823679 wait complete. 2024-08-31T06:29:34.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:34 smithi130 ceph-mon[22266]: pgmap v1099: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-08-31T06:29:34.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:34 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/225823679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:29:34.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72081 5.54 MB/sec execute 562 sec latency 173.516 ms 2024-08-31T06:29:34.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:34 smithi153 ceph-mon[22320]: pgmap v1099: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-08-31T06:29:34.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:34 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/225823679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:29:34.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:34 smithi053 ceph-mon[18924]: pgmap v1099: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-08-31T06:29:34.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:34 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/225823679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:29:34.878 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-08-31T06:29:34.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-08-31T06:29:35.249 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:35.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72238 5.55 MB/sec execute 563 sec latency 100.788 ms 2024-08-31T06:29:35.900 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:35 smithi053 ceph-mon[18924]: pgmap v1100: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 299 op/s 2024-08-31T06:29:35.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:35 smithi153 ceph-mon[22320]: pgmap v1100: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 299 op/s 2024-08-31T06:29:36.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:35 smithi130 ceph-mon[22266]: pgmap v1100: 97 pgs: 97 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 299 op/s 2024-08-31T06:29:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.869+0000 7f1d3c311640 1 -- 172.21.15.53:0/2032753560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d34102820 msgr2=0x7f1d34102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.869+0000 7f1d3c311640 1 --2- 172.21.15.53:0/2032753560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d34102820 0x7f1d34102c30 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009900 tx=0x7f1d3002a410 comp rx=0 tx=0).stop 2024-08-31T06:29:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.869+0000 7f1d3c311640 1 -- 172.21.15.53:0/2032753560 shutdown_connections 2024-08-31T06:29:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.869+0000 7f1d3c311640 1 --2- 172.21.15.53:0/2032753560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d34108ab0 0x7f1d3410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.869+0000 7f1d3c311640 1 --2- 172.21.15.53:0/2032753560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d34108160 0x7f1d34108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.869+0000 7f1d3c311640 1 --2- 172.21.15.53:0/2032753560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d34102820 0x7f1d34102c30 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.869+0000 7f1d3c311640 1 -- 172.21.15.53:0/2032753560 >> 172.21.15.53:0/2032753560 conn(0x7f1d340795d0 msgr2=0x7f1d340799e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.869+0000 7f1d3c311640 1 -- 172.21.15.53:0/2032753560 shutdown_connections 2024-08-31T06:29:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.869+0000 7f1d3c311640 1 -- 172.21.15.53:0/2032753560 wait complete. 2024-08-31T06:29:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3c311640 1 Processor -- start 2024-08-31T06:29:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3c311640 1 -- start start 2024-08-31T06:29:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3c311640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d34102820 0x7f1d3419a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3c311640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d34108160 0x7f1d3419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3c311640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d34108ab0 0x7f1d3419f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3c311640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1d34113710 con 0x7f1d34108ab0 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3c311640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1d34113590 con 0x7f1d34108160 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3c311640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1d34113890 con 0x7f1d34102820 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3a8ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d34108ab0 0x7f1d3419f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3a8ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d34108ab0 0x7f1d3419f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53582/0 (socket says 172.21.15.53:53582) 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3a8ae640 1 -- 172.21.15.53:0/2801067618 learned_addr learned my addr 172.21.15.53:0/2801067618 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3a0ad640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d34102820 0x7f1d3419a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d398ac640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d34108160 0x7f1d3419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3a8ae640 1 -- 172.21.15.53:0/2801067618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d34102820 msgr2=0x7f1d3419a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3a8ae640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d34102820 0x7f1d3419a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3a8ae640 1 -- 172.21.15.53:0/2801067618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d34108160 msgr2=0x7f1d3419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3a8ae640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d34108160 0x7f1d3419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.870+0000 7f1d3a8ae640 1 -- 172.21.15.53:0/2801067618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d341a00f0 con 0x7f1d34108ab0 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.871+0000 7f1d3a8ae640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d34108ab0 0x7f1d3419f9c0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009fd0 tx=0x7f1d2c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.871+0000 7f1d277fe640 1 -- 172.21.15.53:0/2801067618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c017070 con 0x7f1d34108ab0 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.871+0000 7f1d277fe640 1 -- 172.21.15.53:0/2801067618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d2c003e00 con 0x7f1d34108ab0 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.871+0000 7f1d3c311640 1 -- 172.21.15.53:0/2801067618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d341a03e0 con 0x7f1d34108ab0 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.871+0000 7f1d277fe640 1 -- 172.21.15.53:0/2801067618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c010460 con 0x7f1d34108ab0 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.871+0000 7f1d3c311640 1 -- 172.21.15.53:0/2801067618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d341a6b40 con 0x7f1d34108ab0 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.873+0000 7f1d42886740 1 Processor -- start 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.873+0000 7f1d277fe640 1 -- 172.21.15.53:0/2801067618 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1d2c003970 con 0x7f1d34108ab0 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d42886740 1 -- start start 2024-08-31T06:29:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d42886740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d42886740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d42886740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154e7b60 0x5557158b0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d42886740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555715824330 con 0x5557154df980 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d42886740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5557158138c0 con 0x555715508840 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d42886740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555715817870 con 0x5557154e7b60 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d3a0ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d3a0ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53590/0 (socket says 172.21.15.53:53590) 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d3a0ad640 1 -- 172.21.15.53:0/2675806930 learned_addr learned my addr 172.21.15.53:0/2675806930 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d277fe640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1d200b4ca0 0x7f1d200b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d398ac640 1 --2- 172.21.15.53:0/2675806930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d3a8ae640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1d200b4ca0 0x7f1d200b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d3a0ad640 1 -- 172.21.15.53:0/2675806930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154e7b60 msgr2=0x5557158b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d3a0ad640 1 --2- 172.21.15.53:0/2675806930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154e7b60 0x5557158b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d3a0ad640 1 -- 172.21.15.53:0/2675806930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 msgr2=0x5557158afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d3a0ad640 1 --2- 172.21.15.53:0/2675806930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d3a0ad640 1 -- 172.21.15.53:0/2675806930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557157cbdf0 con 0x5557154df980 2024-08-31T06:29:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d398ac640 1 --2- 172.21.15.53:0/2675806930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:29:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.874+0000 7f1d277fe640 1 -- 172.21.15.53:0/2801067618 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f1d2c0e5630 con 0x7f1d34108ab0 2024-08-31T06:29:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.875+0000 7f1d3a0ad640 1 --2- 172.21.15.53:0/2675806930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158b01d0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f1d3002a930 tx=0x7f1d30031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135b6b0ae033e7b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.875+0000 7f1d3a8ae640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1d200b4ca0 0x7f1d200b71b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0e2e10 tx=0x7f1d2c077fb0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.875+0000 7f1d24d9a640 1 -- 172.21.15.53:0/2675806930 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30035030 con 0x5557154df980 2024-08-31T06:29:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.875+0000 7f1d24d9a640 1 -- 172.21.15.53:0/2675806930 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d30040070 con 0x5557154df980 2024-08-31T06:29:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.875+0000 7f1d24d9a640 1 -- 172.21.15.53:0/2675806930 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d300038c0 con 0x5557154df980 2024-08-31T06:29:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.876+0000 7f1d42886740 1 -- 172.21.15.53:0/2675806930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 msgr2=0x5557158b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.876+0000 7f1d42886740 1 --2- 172.21.15.53:0/2675806930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158b01d0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f1d3002a930 tx=0x7f1d30031af0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.876+0000 7f1d42886740 1 -- 172.21.15.53:0/2675806930 shutdown_connections 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.876+0000 7f1d42886740 1 --2- 172.21.15.53:0/2675806930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154e7b60 0x5557158b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.876+0000 7f1d42886740 1 --2- 172.21.15.53:0/2675806930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158b01d0 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.876+0000 7f1d42886740 1 --2- 172.21.15.53:0/2675806930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.876+0000 7f1d42886740 1 -- 172.21.15.53:0/2675806930 >> 172.21.15.53:0/2675806930 conn(0x5557154fc990 msgr2=0x5557158adb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.876+0000 7f1d42886740 1 -- 172.21.15.53:0/2675806930 shutdown_connections 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.876+0000 7f1d42886740 1 -- 172.21.15.53:0/2675806930 wait complete. 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.876+0000 7f1d42886740 1 -- start start 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.876+0000 7f1d42886740 1 Processor -- start 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d42886740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154df980 0x5557158bb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d42886740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557154e7b60 0x5557158bb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d42886740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555715508840 0x5557158c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d42886740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5557156767a0 con 0x555715508840 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d42886740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55571579a240 con 0x5557154e7b60 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d42886740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5557158be410 con 0x5557154df980 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d42886740 10 client.0 _ll_register_callbacks cb 0x555715520090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d398ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555715508840 0x5557158c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d398ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555715508840 0x5557158c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53592/0 (socket says 172.21.15.53:53592) 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d398ac640 1 -- 172.21.15.53:0/4277407571 learned_addr learned my addr 172.21.15.53:0/4277407571 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d3a0ad640 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557154e7b60 0x5557158bb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d398ac640 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154df980 0x5557158bb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d398ac640 1 -- 172.21.15.53:0/4277407571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154df980 msgr2=0x5557158bb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d398ac640 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154df980 0x5557158bb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d398ac640 1 -- 172.21.15.53:0/4277407571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557154e7b60 msgr2=0x5557158bb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d398ac640 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557154e7b60 0x5557158bb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d398ac640 1 -- 172.21.15.53:0/4277407571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557157d02b0 con 0x555715508840 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d3a0ad640 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557154e7b60 0x5557158bb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d398ac640 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555715508840 0x5557158c7760 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009730 tx=0x7f1d280096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71800ed5d69d8887 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.877+0000 7f1d1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d1dffb640 1 -- 172.21.15.53:0/4277407571 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800fc50 con 0x555715508840 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d1dffb640 1 -- 172.21.15.53:0/4277407571 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f1d2800fdf0 con 0x555715508840 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d42886740 1 -- 172.21.15.53:0/4277407571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d30040070 con 0x555715508840 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d1dffb640 1 -- 172.21.15.53:0/4277407571 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f1d28026420 con 0x555715508840 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d42886740 10 client.22905 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d42886740 1 -- 172.21.15.53:0/4277407571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x555715582b90 con 0x555715508840 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d1dffb640 1 -- 172.21.15.53:0/4277407571 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d30040070 con 0x555715508840 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d1dffb640 1 -- 172.21.15.53:0/4277407571 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f1d2801e600 con 0x555715508840 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d42886740 10 client.22905 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d42886740 10 client.22905 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:29:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d42886740 20 client.22905 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d42886740 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5557154c71c0 0x5557158cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d42886740 4 client.22905 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.878+0000 7f1d42886740 1 -- 172.21.15.53:0/4277407571 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555715826280 con 0x5557154c71c0 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.879+0000 7f1d3a0ad640 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5557154c71c0 0x5557158cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.879+0000 7f1d3a0ad640 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5557154c71c0 0x5557158cd580 crc :-1 s=READY pgs=572 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11574c54af4d2b5 server_cookie=153b9bdea3fe413f in_seq=0 out_seq=0 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.879+0000 7f1d1dffb640 10 client.22905 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d1dffb640 1 -- 172.21.15.53:0/4277407571 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555715826280 con 0x5557154c71c0 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d1dffb640 10 client.22905 handle_command_reply: tid=0 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 1 client.22905 shutdown 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 1 -- 172.21.15.53:0/4277407571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555715508840 msgr2=0x5557158c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555715508840 0x5557158c7760 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009730 tx=0x7f1d280096a0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 1 -- 172.21.15.53:0/4277407571 shutdown_connections 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5557154c71c0 0x5557158cd580 crc :-1 s=READY pgs=572 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555715508840 0x5557158c7760 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557154e7b60 0x5557158bb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 1 --2- 172.21.15.53:0/4277407571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154df980 0x5557158bb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 1 -- 172.21.15.53:0/4277407571 >> 172.21.15.53:0/4277407571 conn(0x5557154fc990 msgr2=0x5557158b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d1dffb640 0 client.22905 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 1 -- 172.21.15.53:0/4277407571 shutdown_connections 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 1 -- 172.21.15.53:0/4277407571 wait complete. 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.880+0000 7f1d42886740 20 client.22905 trim_cache size 0 max 16384 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.898+0000 7f1d42886740 1 Processor -- start 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.898+0000 7f1d42886740 1 -- start start 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.898+0000 7f1d42886740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.898+0000 7f1d42886740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154e7b60 0x5557158bb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.898+0000 7f1d42886740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158bb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.898+0000 7f1d42886740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341ad310 con 0x5557154df980 2024-08-31T06:29:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.898+0000 7f1d42886740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341aef10 con 0x555715508840 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.898+0000 7f1d42886740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341ad9e0 con 0x5557154e7b60 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.898+0000 7f1d398ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.898+0000 7f1d398ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53606/0 (socket says 172.21.15.53:53606) 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.898+0000 7f1d398ac640 1 -- 172.21.15.53:0/1097041231 learned_addr learned my addr 172.21.15.53:0/1097041231 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.899+0000 7f1d398ac640 1 -- 172.21.15.53:0/1097041231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154e7b60 msgr2=0x5557158bb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.899+0000 7f1d398ac640 1 --2- 172.21.15.53:0/1097041231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154e7b60 0x5557158bb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.899+0000 7f1d398ac640 1 -- 172.21.15.53:0/1097041231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 msgr2=0x5557158bb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.899+0000 7f1d398ac640 1 --2- 172.21.15.53:0/1097041231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158bb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.899+0000 7f1d398ac640 1 -- 172.21.15.53:0/1097041231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557157e3d90 con 0x5557154df980 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.899+0000 7f1d398ac640 1 --2- 172.21.15.53:0/1097041231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158c7660 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800f790 tx=0x7f1d2801ffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189d0d62fb3fe284 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.899+0000 7f1d1ffff640 1 -- 172.21.15.53:0/1097041231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28033070 con 0x5557154df980 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.899+0000 7f1d1ffff640 1 -- 172.21.15.53:0/1097041231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d2800fc50 con 0x5557154df980 2024-08-31T06:29:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.899+0000 7f1d1ffff640 1 -- 172.21.15.53:0/1097041231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d280054d0 con 0x5557154df980 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.900+0000 7f1d42886740 1 -- 172.21.15.53:0/1097041231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 msgr2=0x5557158c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.900+0000 7f1d42886740 1 --2- 172.21.15.53:0/1097041231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158c7660 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800f790 tx=0x7f1d2801ffb0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.900+0000 7f1d42886740 1 -- 172.21.15.53:0/1097041231 shutdown_connections 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.900+0000 7f1d42886740 1 --2- 172.21.15.53:0/1097041231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158bb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.900+0000 7f1d42886740 1 --2- 172.21.15.53:0/1097041231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154e7b60 0x5557158bb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.900+0000 7f1d42886740 1 --2- 172.21.15.53:0/1097041231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154df980 0x5557158c7660 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.900+0000 7f1d42886740 1 -- 172.21.15.53:0/1097041231 >> 172.21.15.53:0/1097041231 conn(0x5557154fc990 msgr2=0x5557158b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.900+0000 7f1d42886740 1 -- 172.21.15.53:0/1097041231 shutdown_connections 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.900+0000 7f1d42886740 1 -- 172.21.15.53:0/1097041231 wait complete. 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.900+0000 7f1d42886740 1 -- start start 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d42886740 1 Processor -- start 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d42886740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154df980 0x5557158c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d42886740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154e7b60 0x5557158b80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d42886740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d42886740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341ae840 con 0x5557154e7b60 2024-08-31T06:29:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d42886740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341ae0b0 con 0x555715508840 2024-08-31T06:29:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d42886740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341ab310 con 0x5557154df980 2024-08-31T06:29:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d42886740 10 client.0 _ll_register_callbacks cb 0x7f1d28005740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d3a0ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154e7b60 0x5557158b80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d3a0ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154e7b60 0x5557158b80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53612/0 (socket says 172.21.15.53:53612) 2024-08-31T06:29:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d3a0ad640 1 -- 172.21.15.53:0/932755526 learned_addr learned my addr 172.21.15.53:0/932755526 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:36.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d398ac640 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154df980 0x5557158c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d398ac640 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d3a0ad640 1 -- 172.21.15.53:0/932755526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154df980 msgr2=0x5557158c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d3a0ad640 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154df980 0x5557158c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d3a0ad640 1 -- 172.21.15.53:0/932755526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 msgr2=0x5557158b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d3a0ad640 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158b8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d3a0ad640 1 -- 172.21.15.53:0/932755526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557158b8b40 con 0x5557154e7b60 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d398ac640 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154df980 0x5557158c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d3a0ad640 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154e7b60 0x5557158b80c0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009900 tx=0x7f1d30031c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7508b77d4a9d3fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.901+0000 7f1d1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d1dffb640 1 -- 172.21.15.53:0/932755526 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30054020 con 0x5557154e7b60 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d1dffb640 1 -- 172.21.15.53:0/932755526 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f1d30004240 con 0x5557154e7b60 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d42886740 1 -- 172.21.15.53:0/932755526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d2800fc50 con 0x5557154e7b60 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d1dffb640 1 -- 172.21.15.53:0/932755526 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f1d3005f050 con 0x5557154e7b60 2024-08-31T06:29:36.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d42886740 10 client.22911 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d42886740 1 -- 172.21.15.53:0/932755526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x5557158c3550 con 0x5557154e7b60 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d1dffb640 1 -- 172.21.15.53:0/932755526 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d2800fc50 con 0x5557154e7b60 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d1dffb640 1 -- 172.21.15.53:0/932755526 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f1d30003880 con 0x5557154e7b60 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d42886740 10 client.22911 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d42886740 10 client.22911 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d42886740 20 client.22911 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d42886740 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55571549c570 0x555715939fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d42886740 4 client.22911 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.902+0000 7f1d42886740 1 -- 172.21.15.53:0/932755526 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x555715821d20 con 0x55571549c570 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.903+0000 7f1d398ac640 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55571549c570 0x555715939fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.903+0000 7f1d398ac640 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55571549c570 0x555715939fa0 crc :-1 s=READY pgs=573 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6d8cf218cad710d server_cookie=1b07a4ecb99c993 in_seq=0 out_seq=0 2024-08-31T06:29:36.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:35.903+0000 7f1d1dffb640 10 client.22911 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:36.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d1dffb640 1 -- 172.21.15.53:0/932755526 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555715821d20 con 0x55571549c570 2024-08-31T06:29:36.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d1dffb640 10 client.22911 handle_command_reply: tid=0 2024-08-31T06:29:36.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d42886740 1 client.22911 shutdown 2024-08-31T06:29:36.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d42886740 1 -- 172.21.15.53:0/932755526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154e7b60 msgr2=0x5557158b80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:36.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d42886740 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154e7b60 0x5557158b80c0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009900 tx=0x7f1d30031c60 comp rx=0 tx=0).stop 2024-08-31T06:29:36.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d42886740 1 -- 172.21.15.53:0/932755526 shutdown_connections 2024-08-31T06:29:36.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d42886740 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55571549c570 0x555715939fa0 crc :-1 s=READY pgs=573 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d42886740 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555715508840 0x5557158b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d1dffb640 0 client.22911 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:36.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d42886740 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557154e7b60 0x5557158b80c0 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d42886740 1 --2- 172.21.15.53:0/932755526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5557154df980 0x5557158c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.309+0000 7f1d42886740 1 -- 172.21.15.53:0/932755526 >> 172.21.15.53:0/932755526 conn(0x5557154fc990 msgr2=0x5557158b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:36.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.310+0000 7f1d42886740 1 -- 172.21.15.53:0/932755526 shutdown_connections 2024-08-31T06:29:36.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.310+0000 7f1d42886740 1 -- 172.21.15.53:0/932755526 wait complete. 2024-08-31T06:29:36.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.310+0000 7f1d42886740 20 client.22911 trim_cache size 0 max 16384 2024-08-31T06:29:36.313 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:29:36.313 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 90, 2024-08-31T06:29:36.313 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:29:36.313 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 78, 2024-08-31T06:29:36.313 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "751a9f77": { 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 78, 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 130.0, 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:29:36.314 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:29:36.315 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:36.315 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:36.315 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:36.315 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:36.315 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:36.315 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:29:36.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.310+0000 7f1d3c311640 1 -- 172.21.15.53:0/2801067618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1d200b4ca0 msgr2=0x7f1d200b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:36.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.310+0000 7f1d3c311640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1d200b4ca0 0x7f1d200b71b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0e2e10 tx=0x7f1d2c077fb0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.310+0000 7f1d3c311640 1 -- 172.21.15.53:0/2801067618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d34108ab0 msgr2=0x7f1d3419f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:36.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.310+0000 7f1d3c311640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d34108ab0 0x7f1d3419f9c0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009fd0 tx=0x7f1d2c00b260 comp rx=0 tx=0).stop 2024-08-31T06:29:36.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.311+0000 7f1d3c311640 1 -- 172.21.15.53:0/2801067618 shutdown_connections 2024-08-31T06:29:36.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.311+0000 7f1d3c311640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1d200b4ca0 0x7f1d200b71b0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.311+0000 7f1d3c311640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d34108ab0 0x7f1d3419f9c0 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.311+0000 7f1d3c311640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d34108160 0x7f1d3419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.311+0000 7f1d3c311640 1 --2- 172.21.15.53:0/2801067618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d34102820 0x7f1d3419a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:36.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.311+0000 7f1d3c311640 1 -- 172.21.15.53:0/2801067618 >> 172.21.15.53:0/2801067618 conn(0x7f1d340795d0 msgr2=0x7f1d341062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:36.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.311+0000 7f1d3c311640 1 -- 172.21.15.53:0/2801067618 shutdown_connections 2024-08-31T06:29:36.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:36.311+0000 7f1d3c311640 1 -- 172.21.15.53:0/2801067618 wait complete. 2024-08-31T06:29:36.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72313 5.55 MB/sec execute 564 sec latency 571.796 ms 2024-08-31T06:29:37.390 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '751a9f77', quiesce took 8.1 seconds. Will release after: 1.9000000000000004 2024-08-31T06:29:37.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72314 5.54 MB/sec execute 565 sec latency 1571.875 ms 2024-08-31T06:29:38.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:37 smithi130 ceph-mon[22266]: pgmap v1101: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 336 op/s 2024-08-31T06:29:38.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:37 smithi153 ceph-mon[22320]: pgmap v1101: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 336 op/s 2024-08-31T06:29:38.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:37 smithi053 ceph-mon[18924]: pgmap v1101: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 336 op/s 2024-08-31T06:29:38.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72314 5.53 MB/sec execute 566 sec latency 2571.976 ms 2024-08-31T06:29:39.291 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:29:39.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72314 5.52 MB/sec execute 567 sec latency 3572.040 ms 2024-08-31T06:29:39.568 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.604+0000 7f71a1532640 1 -- 172.21.15.53:0/3962540281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c108080 msgr2=0x7f719c108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.604+0000 7f71a1532640 1 --2- 172.21.15.53:0/3962540281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c108080 0x7f719c108490 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f7190009900 tx=0x7f719002a410 comp rx=0 tx=0).stop 2024-08-31T06:29:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.604+0000 7f71a1532640 1 -- 172.21.15.53:0/3962540281 shutdown_connections 2024-08-31T06:29:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.604+0000 7f71a1532640 1 --2- 172.21.15.53:0/3962540281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f719c1089d0 0x7f719c10f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.604+0000 7f71a1532640 1 --2- 172.21.15.53:0/3962540281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c108080 0x7f719c108490 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.604+0000 7f71a1532640 1 --2- 172.21.15.53:0/3962540281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f719c102750 0x7f719c102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.604+0000 7f71a1532640 1 -- 172.21.15.53:0/3962540281 >> 172.21.15.53:0/3962540281 conn(0x7f719c07a4e0 msgr2=0x7f719c07a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.604+0000 7f71a1532640 1 -- 172.21.15.53:0/3962540281 shutdown_connections 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.604+0000 7f71a1532640 1 -- 172.21.15.53:0/3962540281 wait complete. 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f71a1532640 1 Processor -- start 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f71a1532640 1 -- start start 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f71a1532640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c102750 0x7f719c199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f71a1532640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f719c108080 0x7f719c1995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f71a1532640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f719c1089d0 0x7f719c19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f71a1532640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f719c112510 con 0x7f719c102750 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f71a1532640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f719c112390 con 0x7f719c108080 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f71a1532640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f719c112690 con 0x7f719c1089d0 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f719affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c102750 0x7f719c199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f719affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c102750 0x7f719c199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53626/0 (socket says 172.21.15.53:53626) 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f719affd640 1 -- 172.21.15.53:0/3058325866 learned_addr learned my addr 172.21.15.53:0/3058325866 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f719a7fc640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f719c108080 0x7f719c1995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.605+0000 7f719b7fe640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f719c1089d0 0x7f719c19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f719affd640 1 -- 172.21.15.53:0/3058325866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f719c1089d0 msgr2=0x7f719c19e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f719affd640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f719c1089d0 0x7f719c19e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f719affd640 1 -- 172.21.15.53:0/3058325866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f719c108080 msgr2=0x7f719c1995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f719affd640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f719c108080 0x7f719c1995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f719affd640 1 -- 172.21.15.53:0/3058325866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c19ef60 con 0x7f719c102750 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f719b7fe640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f719c1089d0 0x7f719c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f719affd640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c102750 0x7f719c199030 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f718c00e9f0 tx=0x7f718c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f7183fff640 1 -- 172.21.15.53:0/3058325866 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c00cd80 con 0x7f719c102750 2024-08-31T06:29:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f71a1532640 1 -- 172.21.15.53:0/3058325866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719c19f250 con 0x7f719c102750 2024-08-31T06:29:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f7183fff640 1 -- 172.21.15.53:0/3058325866 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f718c0054b0 con 0x7f719c102750 2024-08-31T06:29:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f7183fff640 1 -- 172.21.15.53:0/3058325866 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c010430 con 0x7f719c102750 2024-08-31T06:29:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.606+0000 7f71a1532640 1 -- 172.21.15.53:0/3058325866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719c1a59e0 con 0x7f719c102750 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f71a84a2740 1 Processor -- start 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f71a84a2740 1 -- start start 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f7183fff640 1 -- 172.21.15.53:0/3058325866 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f718c0046c0 con 0x7f719c102750 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf880ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4b42f0 0x55dfcf881220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf881760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f71a84a2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dfcf7f6000 con 0x55dfcf4b42f0 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f71a84a2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dfcf7e5590 con 0x55dfcf4bc4d0 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f71a84a2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55dfcf7e9540 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f719affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4b42f0 0x55dfcf881220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f719affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4b42f0 0x55dfcf881220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53638/0 (socket says 172.21.15.53:53638) 2024-08-31T06:29:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f719affd640 1 -- 172.21.15.53:0/2826609723 learned_addr learned my addr 172.21.15.53:0/2826609723 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.609+0000 7f719b7fe640 1 --2- 172.21.15.53:0/2826609723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf880ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f719a7fc640 1 --2- 172.21.15.53:0/2826609723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf881760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f719affd640 1 -- 172.21.15.53:0/2826609723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4dd1b0 msgr2=0x55dfcf880ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f719affd640 1 --2- 172.21.15.53:0/2826609723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf880ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f719affd640 1 -- 172.21.15.53:0/2826609723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 msgr2=0x55dfcf881760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f719affd640 1 --2- 172.21.15.53:0/2826609723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf881760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f719affd640 1 -- 172.21.15.53:0/2826609723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfcf548790 con 0x55dfcf4b42f0 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f719a7fc640 1 --2- 172.21.15.53:0/2826609723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf881760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f7183fff640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71840b6eb0 0x7f71840b93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f719affd640 1 --2- 172.21.15.53:0/2826609723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4b42f0 0x55dfcf881220 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f718c0e3030 tx=0x7f718c0e9a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d5ffcb29c22c38 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f719b7fe640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71840b6eb0 0x7f71840b93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f7183fff640 1 -- 172.21.15.53:0/3058325866 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f718c0e5990 con 0x7f719c102750 2024-08-31T06:29:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f71817fa640 1 -- 172.21.15.53:0/2826609723 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0f0040 con 0x55dfcf4b42f0 2024-08-31T06:29:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f71817fa640 1 -- 172.21.15.53:0/2826609723 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f718c091e50 con 0x55dfcf4b42f0 2024-08-31T06:29:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.610+0000 7f71817fa640 1 -- 172.21.15.53:0/2826609723 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c0abe30 con 0x55dfcf4b42f0 2024-08-31T06:29:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.611+0000 7f71a84a2740 1 -- 172.21.15.53:0/2826609723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4b42f0 msgr2=0x55dfcf881220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.611+0000 7f719b7fe640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71840b6eb0 0x7f71840b93c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7194005fd0 tx=0x7f7194009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.611+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2826609723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4b42f0 0x55dfcf881220 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f718c0e3030 tx=0x7f718c0e9a20 comp rx=0 tx=0).stop 2024-08-31T06:29:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.611+0000 7f71a84a2740 1 -- 172.21.15.53:0/2826609723 shutdown_connections 2024-08-31T06:29:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.611+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2826609723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf881760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.611+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2826609723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4b42f0 0x55dfcf881220 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.611+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2826609723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf880ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.611+0000 7f71a84a2740 1 -- 172.21.15.53:0/2826609723 >> 172.21.15.53:0/2826609723 conn(0x55dfcf4d1300 msgr2=0x55dfcf87ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.611+0000 7f71a84a2740 1 -- 172.21.15.53:0/2826609723 shutdown_connections 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.611+0000 7f71a84a2740 1 -- 172.21.15.53:0/2826609723 wait complete. 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f71a84a2740 1 -- start start 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f71a84a2740 1 Processor -- start 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf88c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf88ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf898780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f71a84a2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dfcf71eab0 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f71a84a2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dfcf76c680 con 0x55dfcf4bc4d0 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f71a84a2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55dfcf88f460 con 0x55dfcf4b42f0 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f71a84a2740 10 client.0 _ll_register_callbacks cb 0x55dfcf4f4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f719b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf898780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f719b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf898780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53642/0 (socket says 172.21.15.53:53642) 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f719b7fe640 1 -- 172.21.15.53:0/2529287702 learned_addr learned my addr 172.21.15.53:0/2529287702 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f719affd640 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf88c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f719b7fe640 1 -- 172.21.15.53:0/2529287702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 msgr2=0x55dfcf88c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f719b7fe640 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf88c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f719b7fe640 1 -- 172.21.15.53:0/2529287702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 msgr2=0x55dfcf88ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f719b7fe640 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf88ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f719b7fe640 1 -- 172.21.15.53:0/2529287702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfcf5c1620 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.612+0000 7f719affd640 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf88c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f719b7fe640 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf898780 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f7194010bb0 tx=0x7f7194004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc734c7db97c090a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f717eff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f717eff5640 1 -- 172.21.15.53:0/2529287702 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719402c060 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f71a84a2740 1 -- 172.21.15.53:0/2529287702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f718c091e50 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f717eff5640 1 -- 172.21.15.53:0/2529287702 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f7194017030 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f717eff5640 1 -- 172.21.15.53:0/2529287702 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f719401fd40 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f71a84a2740 10 client.22923 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f71a84a2740 1 -- 172.21.15.53:0/2529287702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x55dfcf89b5d0 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f717eff5640 1 -- 172.21.15.53:0/2529287702 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f718c091e50 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f717eff5640 1 -- 172.21.15.53:0/2529287702 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f719401c480 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f71a84a2740 10 client.22923 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f71a84a2740 10 client.22923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f71a84a2740 20 client.22923 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dfcf49bd80 0x55dfcf89eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f71a84a2740 4 client.22923 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.613+0000 7f71a84a2740 1 -- 172.21.15.53:0/2529287702 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfcf7f7f50 con 0x55dfcf49bd80 2024-08-31T06:29:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.614+0000 7f719affd640 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dfcf49bd80 0x55dfcf89eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.614+0000 7f719affd640 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dfcf49bd80 0x55dfcf89eaa0 crc :-1 s=READY pgs=574 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de5dea3756038f20 server_cookie=1084894898901b0d in_seq=0 out_seq=0 2024-08-31T06:29:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.614+0000 7f717eff5640 10 client.22923 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f717eff5640 1 -- 172.21.15.53:0/2529287702 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dfcf7f7f50 con 0x55dfcf49bd80 2024-08-31T06:29:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f717eff5640 10 client.22923 handle_command_reply: tid=0 2024-08-31T06:29:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 1 client.22923 shutdown 2024-08-31T06:29:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 1 -- 172.21.15.53:0/2529287702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 msgr2=0x55dfcf898780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf898780 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f7194010bb0 tx=0x7f7194004a40 comp rx=0 tx=0).stop 2024-08-31T06:29:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 1 -- 172.21.15.53:0/2529287702 shutdown_connections 2024-08-31T06:29:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dfcf49bd80 0x55dfcf89eaa0 crc :-1 s=READY pgs=574 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf898780 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf88ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2529287702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf88c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f717eff5640 0 client.22923 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 1 -- 172.21.15.53:0/2529287702 >> 172.21.15.53:0/2529287702 conn(0x55dfcf4d1300 msgr2=0x55dfcf881d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 1 -- 172.21.15.53:0/2529287702 shutdown_connections 2024-08-31T06:29:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 1 -- 172.21.15.53:0/2529287702 wait complete. 2024-08-31T06:29:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.615+0000 7f71a84a2740 20 client.22923 trim_cache size 0 max 16384 2024-08-31T06:29:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f71a84a2740 1 Processor -- start 2024-08-31T06:29:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f71a84a2740 1 -- start start 2024-08-31T06:29:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf88c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf87e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf87e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f71a84a2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f719c1ad320 con 0x55dfcf4bc4d0 2024-08-31T06:29:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f71a84a2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f719c1aef20 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f71a84a2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f719c1ad9f0 con 0x55dfcf4b42f0 2024-08-31T06:29:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f719a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf87e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f719a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf87e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53646/0 (socket says 172.21.15.53:53646) 2024-08-31T06:29:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f719a7fc640 1 -- 172.21.15.53:0/3327696510 learned_addr learned my addr 172.21.15.53:0/3327696510 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f719affd640 1 --2- 172.21.15.53:0/3327696510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf88c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.630+0000 7f719b7fe640 1 --2- 172.21.15.53:0/3327696510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf87e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.631+0000 7f719a7fc640 1 -- 172.21.15.53:0/3327696510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 msgr2=0x55dfcf88c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.631+0000 7f719a7fc640 1 --2- 172.21.15.53:0/3327696510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf88c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.631+0000 7f719a7fc640 1 -- 172.21.15.53:0/3327696510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4dd1b0 msgr2=0x55dfcf87e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.631+0000 7f719a7fc640 1 --2- 172.21.15.53:0/3327696510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf87e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.631+0000 7f719a7fc640 1 -- 172.21.15.53:0/3327696510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfcf879aa0 con 0x55dfcf4bc4d0 2024-08-31T06:29:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.631+0000 7f719affd640 1 --2- 172.21.15.53:0/3327696510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf88c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:29:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.631+0000 7f719a7fc640 1 --2- 172.21.15.53:0/3327696510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf87e180 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f719c06c760 tx=0x7f7190005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cacbf5110114be server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.631+0000 7f7180ff9640 1 -- 172.21.15.53:0/3327696510 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7190035040 con 0x55dfcf4bc4d0 2024-08-31T06:29:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.631+0000 7f7180ff9640 1 -- 172.21.15.53:0/3327696510 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7190031db0 con 0x55dfcf4bc4d0 2024-08-31T06:29:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.631+0000 7f7180ff9640 1 -- 172.21.15.53:0/3327696510 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7190003850 con 0x55dfcf4bc4d0 2024-08-31T06:29:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 -- 172.21.15.53:0/3327696510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4bc4d0 msgr2=0x55dfcf87e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 --2- 172.21.15.53:0/3327696510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf87e180 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f719c06c760 tx=0x7f7190005fd0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 -- 172.21.15.53:0/3327696510 shutdown_connections 2024-08-31T06:29:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 --2- 172.21.15.53:0/3327696510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf87e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 --2- 172.21.15.53:0/3327696510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf87e180 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 --2- 172.21.15.53:0/3327696510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf88c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 -- 172.21.15.53:0/3327696510 >> 172.21.15.53:0/3327696510 conn(0x55dfcf4d1300 msgr2=0x55dfcf88bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 -- 172.21.15.53:0/3327696510 shutdown_connections 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 -- 172.21.15.53:0/3327696510 wait complete. 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 -- start start 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 Processor -- start 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf894ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf890360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf8908a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f719c1ae850 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f719c1ae0c0 con 0x55dfcf4bc4d0 2024-08-31T06:29:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.632+0000 7f71a84a2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f719c1ab320 con 0x55dfcf4b42f0 2024-08-31T06:29:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f71a84a2740 10 client.0 _ll_register_callbacks cb 0x7f7194009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf8908a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf8908a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53654/0 (socket says 172.21.15.53:53654) 2024-08-31T06:29:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719b7fe640 1 -- 172.21.15.53:0/2875527091 learned_addr learned my addr 172.21.15.53:0/2875527091 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719affd640 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf894ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719a7fc640 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf890360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719b7fe640 1 -- 172.21.15.53:0/2875527091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 msgr2=0x55dfcf894ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719b7fe640 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf894ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719b7fe640 1 -- 172.21.15.53:0/2875527091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 msgr2=0x55dfcf890360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719b7fe640 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf890360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719b7fe640 1 -- 172.21.15.53:0/2875527091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfcf891030 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719a7fc640 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf890360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f719b7fe640 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf8908a0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f719401ca60 tx=0x7f719401c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38925b47bf04f824 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f717eff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f717eff5640 1 -- 172.21.15.53:0/2875527091 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194005040 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f717eff5640 1 -- 172.21.15.53:0/2875527091 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f71940051e0 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f71a84a2740 1 -- 172.21.15.53:0/2875527091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7190031db0 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f717eff5640 1 -- 172.21.15.53:0/2875527091 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f719402c020 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f71a84a2740 10 client.22929 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.633+0000 7f71a84a2740 1 -- 172.21.15.53:0/2875527091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x55dfcf909370 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.634+0000 7f717eff5640 1 -- 172.21.15.53:0/2875527091 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7190031db0 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.634+0000 7f717eff5640 1 -- 172.21.15.53:0/2875527091 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f7194039660 con 0x55dfcf4dd1b0 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.634+0000 7f71a84a2740 10 client.22929 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.634+0000 7f71a84a2740 10 client.22929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.634+0000 7f71a84a2740 20 client.22929 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.634+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dfcf4711c0 0x55dfcf90bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.634+0000 7f71a84a2740 4 client.22929 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:29:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.634+0000 7f71a84a2740 1 -- 172.21.15.53:0/2875527091 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dfcf7f39f0 con 0x55dfcf4711c0 2024-08-31T06:29:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.634+0000 7f719affd640 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dfcf4711c0 0x55dfcf90bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.635+0000 7f719affd640 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dfcf4711c0 0x55dfcf90bb00 crc :-1 s=READY pgs=575 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fef1f7f483d7a1d2 server_cookie=dc3f859b2bbea3dc in_seq=0 out_seq=0 2024-08-31T06:29:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.635+0000 7f717eff5640 10 client.22929 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f717eff5640 1 -- 172.21.15.53:0/2875527091 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dfcf7f39f0 con 0x55dfcf4711c0 2024-08-31T06:29:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f717eff5640 10 client.22929 handle_command_reply: tid=0 2024-08-31T06:29:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f71a84a2740 1 client.22929 shutdown 2024-08-31T06:29:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f71a84a2740 1 -- 172.21.15.53:0/2875527091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 msgr2=0x55dfcf8908a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf8908a0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f719401ca60 tx=0x7f719401c6a0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f71a84a2740 1 -- 172.21.15.53:0/2875527091 shutdown_connections 2024-08-31T06:29:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55dfcf4711c0 0x55dfcf90bb00 crc :-1 s=READY pgs=575 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfcf4dd1b0 0x55dfcf8908a0 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f717eff5640 0 client.22929 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dfcf4bc4d0 0x55dfcf890360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f71a84a2740 1 --2- 172.21.15.53:0/2875527091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dfcf4b42f0 0x55dfcf894ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.712+0000 7f71a84a2740 1 -- 172.21.15.53:0/2875527091 >> 172.21.15.53:0/2875527091 conn(0x55dfcf4d1300 msgr2=0x55dfcf881d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:39.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a84a2740 1 -- 172.21.15.53:0/2875527091 shutdown_connections 2024-08-31T06:29:39.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a84a2740 1 -- 172.21.15.53:0/2875527091 wait complete. 2024-08-31T06:29:39.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a84a2740 20 client.22929 trim_cache size 0 max 16384 2024-08-31T06:29:39.718 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:29:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:29:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:29:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:29:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a1532640 1 -- 172.21.15.53:0/3058325866 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71840b6eb0 msgr2=0x7f71840b93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a1532640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71840b6eb0 0x7f71840b93c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7194005fd0 tx=0x7f7194009500 comp rx=0 tx=0).stop 2024-08-31T06:29:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a1532640 1 -- 172.21.15.53:0/3058325866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c102750 msgr2=0x7f719c199030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a1532640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c102750 0x7f719c199030 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f718c00e9f0 tx=0x7f718c00edf0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a1532640 1 -- 172.21.15.53:0/3058325866 shutdown_connections 2024-08-31T06:29:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a1532640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f71840b6eb0 0x7f71840b93c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a1532640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f719c1089d0 0x7f719c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a1532640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f719c108080 0x7f719c1995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a1532640 1 --2- 172.21.15.53:0/3058325866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c102750 0x7f719c199030 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.713+0000 7f71a1532640 1 -- 172.21.15.53:0/3058325866 >> 172.21.15.53:0/3058325866 conn(0x7f719c07a4e0 msgr2=0x7f719c1041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.714+0000 7f71a1532640 1 -- 172.21.15.53:0/3058325866 shutdown_connections 2024-08-31T06:29:39.721 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:39.714+0000 7f71a1532640 1 -- 172.21.15.53:0/3058325866 wait complete. 2024-08-31T06:29:39.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:39 smithi053 ceph-mon[18924]: pgmap v1102: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 292 op/s 2024-08-31T06:29:40.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.069+0000 7f72ab6ca640 1 -- 172.21.15.53:0/66494015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72a4108140 msgr2=0x7f72a4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:40.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.069+0000 7f72ab6ca640 1 --2- 172.21.15.53:0/66494015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72a4108140 0x7f72a4108550 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009900 tx=0x7f72a002a410 comp rx=0 tx=0).stop 2024-08-31T06:29:40.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.069+0000 7f72ab6ca640 1 -- 172.21.15.53:0/66494015 shutdown_connections 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.069+0000 7f72ab6ca640 1 --2- 172.21.15.53:0/66494015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4108a90 0x7f72a410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.069+0000 7f72ab6ca640 1 --2- 172.21.15.53:0/66494015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72a4108140 0x7f72a4108550 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.069+0000 7f72ab6ca640 1 --2- 172.21.15.53:0/66494015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72a4102800 0x7f72a4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.069+0000 7f72ab6ca640 1 -- 172.21.15.53:0/66494015 >> 172.21.15.53:0/66494015 conn(0x7f72a40794d0 msgr2=0x7f72a40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.069+0000 7f72ab6ca640 1 -- 172.21.15.53:0/66494015 shutdown_connections 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.069+0000 7f72ab6ca640 1 -- 172.21.15.53:0/66494015 wait complete. 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72ab6ca640 1 Processor -- start 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72ab6ca640 1 -- start start 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72ab6ca640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72a4102800 0x7f72a419a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72ab6ca640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4108140 0x7f72a419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72ab6ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72a4108a90 0x7f72a419f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72ab6ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f72a4112590 con 0x7f72a4108a90 2024-08-31T06:29:40.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72ab6ca640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72a4112410 con 0x7f72a4102800 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72ab6ca640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f72a4112710 con 0x7f72a4108140 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72a8c65640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4108140 0x7f72a419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72a8c65640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4108140 0x7f72a419a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57134/0 (socket says 172.21.15.53:57134) 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72a8c65640 1 -- 172.21.15.53:0/106605091 learned_addr learned my addr 172.21.15.53:0/106605091 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72a9c67640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72a4108a90 0x7f72a419f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.070+0000 7f72a9466640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72a4102800 0x7f72a419a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72a9c67640 1 -- 172.21.15.53:0/106605091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4108140 msgr2=0x7f72a419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72a9c67640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4108140 0x7f72a419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72a9c67640 1 -- 172.21.15.53:0/106605091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72a4102800 msgr2=0x7f72a419a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72a9c67640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72a4102800 0x7f72a419a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72a9c67640 1 -- 172.21.15.53:0/106605091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a41a00a0 con 0x7f72a4108a90 2024-08-31T06:29:40.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72a9466640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72a4102800 0x7f72a419a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:40.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72a9c67640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72a4108a90 0x7f72a419f970 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e940 tx=0x7f729c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:40.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72967fc640 1 -- 172.21.15.53:0/106605091 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c004d20 con 0x7f72a4108a90 2024-08-31T06:29:40.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72ab6ca640 1 -- 172.21.15.53:0/106605091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a41a0390 con 0x7f72a4108a90 2024-08-31T06:29:40.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72967fc640 1 -- 172.21.15.53:0/106605091 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f729c005020 con 0x7f72a4108a90 2024-08-31T06:29:40.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72967fc640 1 -- 172.21.15.53:0/106605091 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c0116d0 con 0x7f72a4108a90 2024-08-31T06:29:40.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.071+0000 7f72ab6ca640 1 -- 172.21.15.53:0/106605091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a41a6af0 con 0x7f72a4108a90 2024-08-31T06:29:40.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.072+0000 7f72ab6ca640 1 -- 172.21.15.53:0/106605091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a4102c10 con 0x7f72a4108a90 2024-08-31T06:29:40.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.074+0000 7f72967fc640 1 -- 172.21.15.53:0/106605091 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f729c00cb20 con 0x7f72a4108a90 2024-08-31T06:29:40.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.075+0000 7f72967fc640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72900b4ca0 0x7f72900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:40.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.075+0000 7f72a9466640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72900b4ca0 0x7f72900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:40.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.075+0000 7f72967fc640 1 -- 172.21.15.53:0/106605091 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f729c0e5a60 con 0x7f72a4108a90 2024-08-31T06:29:40.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.075+0000 7f72a9466640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72900b4ca0 0x7f72900b71b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7298009fc0 tx=0x7f7298005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:40.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.078+0000 7f72967fc640 1 -- 172.21.15.53:0/106605091 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f729c016030 con 0x7f72a4108a90 2024-08-31T06:29:40.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:39 smithi153 ceph-mon[22320]: pgmap v1102: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 292 op/s 2024-08-31T06:29:40.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.301+0000 7f72ab6ca640 1 -- 172.21.15.53:0/106605091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72a419b260 con 0x7f72a4108a90 2024-08-31T06:29:40.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.302+0000 7f72967fc640 1 -- 172.21.15.53:0/106605091 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+11992 (secure 0 0 0) 0x7f72a419b260 con 0x7f72a4108a90 2024-08-31T06:29:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:29:40.305 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":90,"btime":"2024-08-31T06:29:16:977675+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":90,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:29:16.408419+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:29:40.307 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 90 2024-08-31T06:29:40.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 -- 172.21.15.53:0/106605091 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72900b4ca0 msgr2=0x7f72900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:40.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72900b4ca0 0x7f72900b71b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7298009fc0 tx=0x7f7298005f90 comp rx=0 tx=0).stop 2024-08-31T06:29:40.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 -- 172.21.15.53:0/106605091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72a4108a90 msgr2=0x7f72a419f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72a4108a90 0x7f72a419f970 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e940 tx=0x7f729c00ee00 comp rx=0 tx=0).stop 2024-08-31T06:29:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 -- 172.21.15.53:0/106605091 shutdown_connections 2024-08-31T06:29:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f72900b4ca0 0x7f72900b71b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72a4108a90 0x7f72a419f970 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72a4108140 0x7f72a419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:40.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 --2- 172.21.15.53:0/106605091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72a4102800 0x7f72a419a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:40.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 -- 172.21.15.53:0/106605091 >> 172.21.15.53:0/106605091 conn(0x7f72a40794d0 msgr2=0x7f72a406b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:40.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 -- 172.21.15.53:0/106605091 shutdown_connections 2024-08-31T06:29:40.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:40.304+0000 7f72ab6ca640 1 -- 172.21.15.53:0/106605091 wait complete. 2024-08-31T06:29:40.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:39 smithi130 ceph-mon[22266]: pgmap v1102: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 292 op/s 2024-08-31T06:29:40.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72314 5.51 MB/sec execute 568 sec latency 4572.112 ms 2024-08-31T06:29:40.989 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id 751a9f77 --release --await' 2024-08-31T06:29:40.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id 751a9f77 --release --await 2024-08-31T06:29:41.013 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:40 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/106605091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:29:41.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:40 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/106605091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:29:41.244 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:29:41.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:40 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/106605091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:29:41.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72314 5.50 MB/sec execute 569 sec latency 5572.173 ms 2024-08-31T06:29:41.975 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:41 smithi053 ceph-mon[18924]: pgmap v1103: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 307 op/s 2024-08-31T06:29:42.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:41 smithi153 ceph-mon[22320]: pgmap v1103: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 307 op/s 2024-08-31T06:29:42.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.692+0000 7f5a7c95a640 1 -- 172.21.15.53:0/1145412549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a78102d60 msgr2=0x7f5a7810fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:42.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.692+0000 7f5a7c95a640 1 --2- 172.21.15.53:0/1145412549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a78102d60 0x7f5a7810fa80 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009900 tx=0x7f5a6c02a480 comp rx=0 tx=0).stop 2024-08-31T06:29:42.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.692+0000 7f5a7c95a640 1 -- 172.21.15.53:0/1145412549 shutdown_connections 2024-08-31T06:29:42.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.692+0000 7f5a7c95a640 1 --2- 172.21.15.53:0/1145412549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a7810ffc0 0x7f5a781123e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.692+0000 7f5a7c95a640 1 --2- 172.21.15.53:0/1145412549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a78102d60 0x7f5a7810fa80 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.692+0000 7f5a7c95a640 1 --2- 172.21.15.53:0/1145412549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a78102410 0x7f5a78102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.692+0000 7f5a7c95a640 1 -- 172.21.15.53:0/1145412549 >> 172.21.15.53:0/1145412549 conn(0x7f5a780794e0 msgr2=0x7f5a780798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:42.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.692+0000 7f5a7c95a640 1 -- 172.21.15.53:0/1145412549 shutdown_connections 2024-08-31T06:29:42.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.692+0000 7f5a7c95a640 1 -- 172.21.15.53:0/1145412549 wait complete. 2024-08-31T06:29:42.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.693+0000 7f5a7c95a640 1 Processor -- start 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.693+0000 7f5a7c95a640 1 -- start start 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.693+0000 7f5a7c95a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a78102410 0x7f5a7819c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.693+0000 7f5a7c95a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a78102d60 0x7f5a7819c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.693+0000 7f5a7c95a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a7810ffc0 0x7f5a781a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.693+0000 7f5a7c95a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78115900 con 0x7f5a78102d60 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.693+0000 7f5a7c95a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78115780 con 0x7f5a7810ffc0 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.693+0000 7f5a7c95a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78115a80 con 0x7f5a78102410 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.693+0000 7f5a75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a78102d60 0x7f5a7819c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.693+0000 7f5a75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a78102d60 0x7f5a7819c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53680/0 (socket says 172.21.15.53:53680) 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.693+0000 7f5a75d9b640 1 -- 172.21.15.53:0/3483580628 learned_addr learned my addr 172.21.15.53:0/3483580628 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a76d9d640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a7810ffc0 0x7f5a781a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a7659c640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a78102410 0x7f5a7819c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a75d9b640 1 -- 172.21.15.53:0/3483580628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a78102410 msgr2=0x7f5a7819c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a78102410 0x7f5a7819c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a75d9b640 1 -- 172.21.15.53:0/3483580628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a7810ffc0 msgr2=0x7f5a781a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a7810ffc0 0x7f5a781a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a75d9b640 1 -- 172.21.15.53:0/3483580628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a781a23c0 con 0x7f5a78102d60 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a76d9d640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a7810ffc0 0x7f5a781a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a78102d60 0x7f5a7819c9f0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009a20 tx=0x7f5a6c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a677fe640 1 -- 172.21.15.53:0/3483580628 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c03f030 con 0x7f5a78102d60 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a677fe640 1 -- 172.21.15.53:0/3483580628 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a6c0035f0 con 0x7f5a78102d60 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a7c95a640 1 -- 172.21.15.53:0/3483580628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a781a2650 con 0x7f5a78102d60 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a677fe640 1 -- 172.21.15.53:0/3483580628 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c035070 con 0x7f5a78102d60 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.694+0000 7f5a7c95a640 1 -- 172.21.15.53:0/3483580628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a781a8e10 con 0x7f5a78102d60 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.697+0000 7f5a82ecf740 1 Processor -- start 2024-08-31T06:29:42.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.697+0000 7f5a82ecf740 1 -- start start 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.697+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be3a520 0x55795c1dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.697+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 0x55795c1e01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.697+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be19840 0x55795c1e0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.697+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55795c156a70 con 0x55795be3a520 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.697+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55795c146000 con 0x55795be11660 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.697+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55795c149fb0 con 0x55795be19840 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.697+0000 7f5a677fe640 1 -- 172.21.15.53:0/3483580628 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5a6c003aa0 con 0x7f5a78102d60 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a76d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be3a520 0x55795c1dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a7659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 0x55795c1e01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a7659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 0x55795c1e01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:54704/0 (socket says 172.21.15.53:54704) 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a76d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be3a520 0x55795c1dfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53694/0 (socket says 172.21.15.53:53694) 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a7659c640 1 -- 172.21.15.53:0/2058551800 learned_addr learned my addr 172.21.15.53:0/2058551800 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/2058551800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be19840 0x55795c1e0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a76d9d640 1 -- 172.21.15.53:0/2058551800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be19840 msgr2=0x55795c1e0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a76d9d640 1 --2- 172.21.15.53:0/2058551800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be19840 0x55795c1e0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a76d9d640 1 -- 172.21.15.53:0/2058551800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 msgr2=0x55795c1e01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a76d9d640 1 --2- 172.21.15.53:0/2058551800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 0x55795c1e01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a76d9d640 1 -- 172.21.15.53:0/2058551800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55795bea5b00 con 0x55795be3a520 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a7659c640 1 --2- 172.21.15.53:0/2058551800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 0x55795c1e01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/2058551800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be19840 0x55795c1e0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a76d9d640 1 --2- 172.21.15.53:0/2058551800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be3a520 0x55795c1dfc80 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000ae40 tx=0x7f5a7000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40226b2a26f4cee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a64ff9640 1 -- 172.21.15.53:0/2058551800 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70003b70 con 0x55795be3a520 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a677fe640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a600b4ca0 0x7f5a600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.698+0000 7f5a64ff9640 1 -- 172.21.15.53:0/2058551800 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a70003d10 con 0x55795be3a520 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.699+0000 7f5a64ff9640 1 -- 172.21.15.53:0/2058551800 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70010930 con 0x55795be3a520 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.699+0000 7f5a7659c640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a600b4ca0 0x7f5a600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.699+0000 7f5a677fe640 1 -- 172.21.15.53:0/3483580628 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f5a6c105fa0 con 0x7f5a78102d60 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.699+0000 7f5a82ecf740 1 -- 172.21.15.53:0/2058551800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be3a520 msgr2=0x55795c1dfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.699+0000 7f5a7659c640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a600b4ca0 0x7f5a600b71b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x55795c1de900 tx=0x7f5a68008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.699+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/2058551800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be3a520 0x55795c1dfc80 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000ae40 tx=0x7f5a7000e720 comp rx=0 tx=0).stop 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 -- 172.21.15.53:0/2058551800 shutdown_connections 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/2058551800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be19840 0x55795c1e0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/2058551800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 0x55795c1e01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/2058551800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be3a520 0x55795c1dfc80 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 -- 172.21.15.53:0/2058551800 >> 172.21.15.53:0/2058551800 conn(0x55795be2e910 msgr2=0x55795c1ddb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 -- 172.21.15.53:0/2058551800 shutdown_connections 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 -- 172.21.15.53:0/2058551800 wait complete. 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 -- start start 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 Processor -- start 2024-08-31T06:29:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be11660 0x55795c1eb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1ebdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be3a520 0x55795c1f7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55795c1ee460 con 0x55795be19840 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55795c107520 con 0x55795be3a520 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55795c1ee5e0 con 0x55795be11660 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.700+0000 7f5a82ecf740 10 client.0 _ll_register_callbacks cb 0x55795c13fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1ebdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1ebdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53704/0 (socket says 172.21.15.53:53704) 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a75d9b640 1 -- 172.21.15.53:0/3924203460 learned_addr learned my addr 172.21.15.53:0/3924203460 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a76d9d640 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be3a520 0x55795c1f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a7659c640 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be11660 0x55795c1eb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a75d9b640 1 -- 172.21.15.53:0/3924203460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be11660 msgr2=0x55795c1eb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be11660 0x55795c1eb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a75d9b640 1 -- 172.21.15.53:0/3924203460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be3a520 msgr2=0x55795c1f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be3a520 0x55795c1f7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a75d9b640 1 -- 172.21.15.53:0/3924203460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55795bf1c960 con 0x55795be19840 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a7659c640 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be11660 0x55795c1eb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1ebdf0 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c032fd0 tx=0x7f5a6c0cbea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8108856128b980f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a5dffb640 1 -- 172.21.15.53:0/3924203460 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c049040 con 0x55795be19840 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a5dffb640 1 -- 172.21.15.53:0/3924203460 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f5a6c0c8900 con 0x55795be19840 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3924203460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55795c0e59a0 con 0x55795be19840 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a5dffb640 1 -- 172.21.15.53:0/3924203460 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f5a6c0d0ee0 con 0x55795be19840 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a82ecf740 10 client.22947 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.701+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3924203460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x55795c1fa5c0 con 0x55795be19840 2024-08-31T06:29:42.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.702+0000 7f5a5dffb640 1 -- 172.21.15.53:0/3924203460 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55795c0e59a0 con 0x55795be19840 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.702+0000 7f5a5dffb640 1 -- 172.21.15.53:0/3924203460 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f5a6c0f3170 con 0x55795be19840 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.702+0000 7f5a82ecf740 10 client.22947 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.702+0000 7f5a82ecf740 10 client.22947 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.702+0000 7f5a82ecf740 20 client.22947 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.702+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55795bdf8ea0 0x55795c1fda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.702+0000 7f5a82ecf740 4 client.22947 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.702+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3924203460 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55795c1589c0 con 0x55795bdf8ea0 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.702+0000 7f5a7659c640 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55795bdf8ea0 0x55795c1fda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.703+0000 7f5a5dffb640 10 client.22947 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.703+0000 7f5a7659c640 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55795bdf8ea0 0x55795c1fda70 crc :-1 s=READY pgs=576 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=488031be0e83ebe3 server_cookie=7bc74b7e433f5547 in_seq=0 out_seq=0 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.703+0000 7f5a5dffb640 1 -- 172.21.15.53:0/3924203460 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55795c1589c0 con 0x55795bdf8ea0 2024-08-31T06:29:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a5dffb640 10 client.22947 handle_command_reply: tid=0 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 1 client.22947 shutdown 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3924203460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 msgr2=0x55795c1ebdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1ebdf0 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c032fd0 tx=0x7f5a6c0cbea0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3924203460 shutdown_connections 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55795bdf8ea0 0x55795c1fda70 crc :-1 s=READY pgs=576 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be3a520 0x55795c1f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1ebdf0 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a5dffb640 0 client.22947 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/3924203460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be11660 0x55795c1eb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3924203460 >> 172.21.15.53:0/3924203460 conn(0x55795be2e910 msgr2=0x55795c1e2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3924203460 shutdown_connections 2024-08-31T06:29:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3924203460 wait complete. 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.704+0000 7f5a82ecf740 20 client.22947 trim_cache size 0 max 16384 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.721+0000 7f5a82ecf740 1 Processor -- start 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.721+0000 7f5a82ecf740 1 -- start start 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.721+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be11660 0x55795c1f7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.721+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be19840 0x55795c1e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.721+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 0x55795c1e52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.721+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781b1770 con 0x55795be11660 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.721+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781b3370 con 0x55795be19840 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.721+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781b1e40 con 0x55795be3a520 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.721+0000 7f5a7659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be11660 0x55795c1f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a7659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be11660 0x55795c1f7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53716/0 (socket says 172.21.15.53:53716) 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a7659c640 1 -- 172.21.15.53:0/3189761021 learned_addr learned my addr 172.21.15.53:0/3189761021 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/3189761021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be19840 0x55795c1e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a7659c640 1 -- 172.21.15.53:0/3189761021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 msgr2=0x55795c1e52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a76d9d640 1 --2- 172.21.15.53:0/3189761021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 0x55795c1e52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a7659c640 1 --2- 172.21.15.53:0/3189761021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 0x55795c1e52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a7659c640 1 -- 172.21.15.53:0/3189761021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be19840 msgr2=0x55795c1e4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a7659c640 1 --2- 172.21.15.53:0/3189761021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be19840 0x55795c1e4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a7659c640 1 -- 172.21.15.53:0/3189761021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55795c1e2510 con 0x55795be11660 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/3189761021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be19840 0x55795c1e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a76d9d640 1 --2- 172.21.15.53:0/3189761021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 0x55795c1e52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a7659c640 1 --2- 172.21.15.53:0/3189761021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be11660 0x55795c1f7800 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f5a68006e10 tx=0x7f5a68013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e44acb64461949 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a5ffff640 1 -- 172.21.15.53:0/3189761021 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6801c030 con 0x55795be11660 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a5ffff640 1 -- 172.21.15.53:0/3189761021 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a6802e070 con 0x55795be11660 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.722+0000 7f5a5ffff640 1 -- 172.21.15.53:0/3189761021 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68014430 con 0x55795be11660 2024-08-31T06:29:42.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.723+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3189761021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be11660 msgr2=0x55795c1f7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.723+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/3189761021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be11660 0x55795c1f7800 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f5a68006e10 tx=0x7f5a68013000 comp rx=0 tx=0).stop 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.723+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3189761021 shutdown_connections 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.723+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/3189761021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 0x55795c1e52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.723+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/3189761021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be19840 0x55795c1e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.723+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/3189761021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be11660 0x55795c1f7800 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.723+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3189761021 >> 172.21.15.53:0/3189761021 conn(0x55795be2e910 msgr2=0x55795c1dd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.723+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3189761021 shutdown_connections 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.723+0000 7f5a82ecf740 1 -- 172.21.15.53:0/3189761021 wait complete. 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.723+0000 7f5a82ecf740 1 -- start start 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.723+0000 7f5a82ecf740 1 Processor -- start 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 0x55795c1f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a82ecf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 0x55795c1f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781b2ca0 con 0x55795be19840 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781b2510 con 0x55795be11660 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a82ecf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781af770 con 0x55795be3a520 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a82ecf740 10 client.0 _ll_register_callbacks cb 0x7f5a6c0cbfc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a75d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1f03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53720/0 (socket says 172.21.15.53:53720) 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a75d9b640 1 -- 172.21.15.53:0/1998446753 learned_addr learned my addr 172.21.15.53:0/1998446753 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a7659c640 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 0x55795c1f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a76d9d640 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 0x55795c1f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a75d9b640 1 -- 172.21.15.53:0/1998446753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 msgr2=0x55795c1f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 0x55795c1f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a75d9b640 1 -- 172.21.15.53:0/1998446753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 msgr2=0x55795c1f3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:42.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 0x55795c1f3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a75d9b640 1 -- 172.21.15.53:0/1998446753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55795c1f0f30 con 0x55795be19840 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a76d9d640 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 0x55795c1f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a75d9b640 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1f03b0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0c98e0 tx=0x7f5a6c0d5710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adb919ffeff523a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.724+0000 7f5a5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a5dffb640 1 -- 172.21.15.53:0/1998446753 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c049070 con 0x55795be19840 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a5dffb640 1 -- 172.21.15.53:0/1998446753 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f5a6c0f31a0 con 0x55795be19840 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a82ecf740 1 -- 172.21.15.53:0/1998446753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a6802e070 con 0x55795be19840 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a5dffb640 1 -- 172.21.15.53:0/1998446753 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f5a6c0cc440 con 0x55795be19840 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a82ecf740 10 client.22953 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a82ecf740 1 -- 172.21.15.53:0/1998446753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x55795c269190 con 0x55795be19840 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a5dffb640 1 -- 172.21.15.53:0/1998446753 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a6802e070 con 0x55795be19840 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a5dffb640 1 -- 172.21.15.53:0/1998446753 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f5a6c07c1a0 con 0x55795be19840 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a82ecf740 10 client.22953 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:42.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a82ecf740 10 client.22953 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:29:42.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a82ecf740 20 client.22953 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:42.256 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:29:42.256 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 90, 2024-08-31T06:29:42.256 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:29:42.256 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 80, 2024-08-31T06:29:42.256 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:29:42.256 INFO:teuthology.orchestra.run.smithi053.stdout: "751a9f77": { 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 80, 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 130.0, 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:29:42.257 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:29:42.258 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:29:42.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:42.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:42.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:42.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:42.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:29:42.258 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:29:42.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55795bdce250 0x55795c26b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:42.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a82ecf740 4 client.22953 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "751a9f77", "release": true, "await": true}] 2024-08-31T06:29:42.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a82ecf740 1 -- 172.21.15.53:0/1998446753 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "751a9f77", "release": true, "await": true}) -- 0x55795c154460 con 0x55795bdce250 2024-08-31T06:29:42.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.725+0000 7f5a7659c640 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55795bdce250 0x55795c26b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.726+0000 7f5a7659c640 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55795bdce250 0x55795c26b7f0 crc :-1 s=READY pgs=577 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ce1fcc2fdab38a5 server_cookie=c967c307d0ce95bf in_seq=0 out_seq=0 2024-08-31T06:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.726+0000 7f5a5dffb640 10 client.22953 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a5dffb640 1 -- 172.21.15.53:0/1998446753 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55795c154460 con 0x55795bdce250 2024-08-31T06:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a5dffb640 10 client.22953 handle_command_reply: tid=0 2024-08-31T06:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a82ecf740 1 client.22953 shutdown 2024-08-31T06:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a82ecf740 1 -- 172.21.15.53:0/1998446753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 msgr2=0x55795c1f03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1f03b0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0c98e0 tx=0x7f5a6c0d5710 comp rx=0 tx=0).stop 2024-08-31T06:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a82ecf740 1 -- 172.21.15.53:0/1998446753 shutdown_connections 2024-08-31T06:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55795bdce250 0x55795c26b7f0 crc :-1 s=READY pgs=577 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55795be3a520 0x55795c1f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55795be19840 0x55795c1f03b0 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a5dffb640 0 client.22953 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a82ecf740 1 --2- 172.21.15.53:0/1998446753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55795be11660 0x55795c1f3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.764+0000 7f5a82ecf740 1 -- 172.21.15.53:0/1998446753 >> 172.21.15.53:0/1998446753 conn(0x55795be2e910 msgr2=0x55795c1e0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.765+0000 7f5a82ecf740 1 -- 172.21.15.53:0/1998446753 shutdown_connections 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.765+0000 7f5a82ecf740 1 -- 172.21.15.53:0/1998446753 wait complete. 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.765+0000 7f5a82ecf740 20 client.22953 trim_cache size 0 max 16384 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.765+0000 7f5a7c95a640 1 -- 172.21.15.53:0/3483580628 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a600b4ca0 msgr2=0x7f5a600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.765+0000 7f5a7c95a640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a600b4ca0 0x7f5a600b71b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x55795c1de900 tx=0x7f5a68008040 comp rx=0 tx=0).stop 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.765+0000 7f5a7c95a640 1 -- 172.21.15.53:0/3483580628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a78102d60 msgr2=0x7f5a7819c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.765+0000 7f5a7c95a640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a78102d60 0x7f5a7819c9f0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009a20 tx=0x7f5a6c004270 comp rx=0 tx=0).stop 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.766+0000 7f5a7c95a640 1 -- 172.21.15.53:0/3483580628 shutdown_connections 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.766+0000 7f5a7c95a640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f5a600b4ca0 0x7f5a600b71b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.766+0000 7f5a7c95a640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a7810ffc0 0x7f5a781a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.766+0000 7f5a7c95a640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a78102d60 0x7f5a7819c9f0 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.766+0000 7f5a7c95a640 1 --2- 172.21.15.53:0/3483580628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a78102410 0x7f5a7819c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:42.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.766+0000 7f5a7c95a640 1 -- 172.21.15.53:0/3483580628 >> 172.21.15.53:0/3483580628 conn(0x7f5a780794e0 msgr2=0x7f5a78111550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:42.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.766+0000 7f5a7c95a640 1 -- 172.21.15.53:0/3483580628 shutdown_connections 2024-08-31T06:29:42.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:29:41.766+0000 7f5a7c95a640 1 -- 172.21.15.53:0/3483580628 wait complete. 2024-08-31T06:29:42.279 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:41 smithi130 ceph-mon[22266]: pgmap v1103: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 307 op/s 2024-08-31T06:29:42.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72416 5.50 MB/sec execute 570 sec latency 5940.212 ms 2024-08-31T06:29:43.135 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '751a9f77', total seconds elapsed: 13.8 2024-08-31T06:29:43.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72580 5.52 MB/sec execute 571 sec latency 1631.980 ms 2024-08-31T06:29:44.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:43 smithi153 ceph-mon[22320]: pgmap v1104: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 239 op/s 2024-08-31T06:29:44.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:43 smithi053 ceph-mon[18924]: pgmap v1104: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 239 op/s 2024-08-31T06:29:44.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:43 smithi130 ceph-mon[22266]: pgmap v1104: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 239 op/s 2024-08-31T06:29:44.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72750 5.52 MB/sec execute 572 sec latency 2632.009 ms 2024-08-31T06:29:45.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 72880 5.53 MB/sec execute 573 sec latency 3632.041 ms 2024-08-31T06:29:46.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:45 smithi153 ceph-mon[22320]: pgmap v1105: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 219 op/s 2024-08-31T06:29:46.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:45 smithi053 ceph-mon[18924]: pgmap v1105: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 219 op/s 2024-08-31T06:29:46.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:45 smithi130 ceph-mon[22266]: pgmap v1105: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 219 op/s 2024-08-31T06:29:46.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 73022 5.54 MB/sec execute 574 sec latency 4499.108 ms 2024-08-31T06:29:47.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 73158 5.54 MB/sec execute 575 sec latency 61.960 ms 2024-08-31T06:29:48.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:47 smithi153 ceph-mon[22320]: pgmap v1106: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 275 op/s 2024-08-31T06:29:48.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:47 smithi053 ceph-mon[18924]: pgmap v1106: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 275 op/s 2024-08-31T06:29:48.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:47 smithi130 ceph-mon[22266]: pgmap v1106: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 275 op/s 2024-08-31T06:29:48.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 73283 5.54 MB/sec execute 576 sec latency 57.640 ms 2024-08-31T06:29:49.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 73430 5.53 MB/sec execute 577 sec latency 78.867 ms 2024-08-31T06:29:50.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:49 smithi153 ceph-mon[22320]: pgmap v1107: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 220 op/s 2024-08-31T06:29:50.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:49 smithi053 ceph-mon[18924]: pgmap v1107: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 220 op/s 2024-08-31T06:29:50.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:49 smithi130 ceph-mon[22266]: pgmap v1107: 97 pgs: 97 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 220 op/s 2024-08-31T06:29:50.408 INFO:tasks.workunit.client.0.smithi053.stdout: 10 73572 5.53 MB/sec execute 578 sec latency 82.067 ms 2024-08-31T06:29:51.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 73729 5.53 MB/sec execute 579 sec latency 149.576 ms 2024-08-31T06:29:52.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:51 smithi153 ceph-mon[22320]: pgmap v1108: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-08-31T06:29:52.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:51 smithi053 ceph-mon[18924]: pgmap v1108: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-08-31T06:29:52.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:51 smithi130 ceph-mon[22266]: pgmap v1108: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-08-31T06:29:52.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 73896 5.54 MB/sec execute 580 sec latency 68.900 ms 2024-08-31T06:29:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.859+0000 7fe3fae3f640 1 -- 172.21.15.53:0/166034633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f41091d0 msgr2=0x7fe3f41095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.859+0000 7fe3fae3f640 1 --2- 172.21.15.53:0/166034633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f41091d0 0x7fe3f41095e0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009900 tx=0x7fe3e002a410 comp rx=0 tx=0).stop 2024-08-31T06:29:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.860+0000 7fe3fae3f640 1 -- 172.21.15.53:0/166034633 shutdown_connections 2024-08-31T06:29:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.860+0000 7fe3fae3f640 1 --2- 172.21.15.53:0/166034633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3f4109b20 0x7fe3f4110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.860+0000 7fe3fae3f640 1 --2- 172.21.15.53:0/166034633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f41091d0 0x7fe3f41095e0 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.860+0000 7fe3fae3f640 1 --2- 172.21.15.53:0/166034633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3f41038a0 0x7fe3f4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.860+0000 7fe3fae3f640 1 -- 172.21.15.53:0/166034633 >> 172.21.15.53:0/166034633 conn(0x7fe3f40ff2a0 msgr2=0x7fe3f41016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.860+0000 7fe3fae3f640 1 -- 172.21.15.53:0/166034633 shutdown_connections 2024-08-31T06:29:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.860+0000 7fe3fae3f640 1 -- 172.21.15.53:0/166034633 wait complete. 2024-08-31T06:29:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3fae3f640 1 Processor -- start 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3fae3f640 1 -- start start 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3fae3f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f41038a0 0x7fe3f40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3fae3f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3f41091d0 0x7fe3f40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3fae3f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3f4109b20 0x7fe3f4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3fae3f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f4113630 con 0x7fe3f41038a0 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3fae3f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f41134b0 con 0x7fe3f41091d0 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3fae3f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f41137b0 con 0x7fe3f4109b20 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3f8bdb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f41038a0 0x7fe3f40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3f8bdb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f41038a0 0x7fe3f40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59424/0 (socket says 172.21.15.53:59424) 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3f8bdb640 1 -- 172.21.15.53:0/3977759176 learned_addr learned my addr 172.21.15.53:0/3977759176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3f3fff640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3f41091d0 0x7fe3f40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.861+0000 7fe3f93dc640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3f4109b20 0x7fe3f4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3f8bdb640 1 -- 172.21.15.53:0/3977759176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3f4109b20 msgr2=0x7fe3f4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3f4109b20 0x7fe3f4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3f8bdb640 1 -- 172.21.15.53:0/3977759176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3f41091d0 msgr2=0x7fe3f40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3f41091d0 0x7fe3f40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3f8bdb640 1 -- 172.21.15.53:0/3977759176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f41a83c0 con 0x7fe3f41038a0 2024-08-31T06:29:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3f3fff640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3f41091d0 0x7fe3f40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f41038a0 0x7fe3f40754b0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800ea60 tx=0x7fe3e800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3f1ffb640 1 -- 172.21.15.53:0/3977759176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e800cde0 con 0x7fe3f41038a0 2024-08-31T06:29:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3fae3f640 1 -- 172.21.15.53:0/3977759176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f41a86b0 con 0x7fe3f41038a0 2024-08-31T06:29:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3f1ffb640 1 -- 172.21.15.53:0/3977759176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3e80035f0 con 0x7fe3f41038a0 2024-08-31T06:29:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3fae3f640 1 -- 172.21.15.53:0/3977759176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f41a8c20 con 0x7fe3f41038a0 2024-08-31T06:29:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.862+0000 7fe3f1ffb640 1 -- 172.21.15.53:0/3977759176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8010690 con 0x7fe3f41038a0 2024-08-31T06:29:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.865+0000 7fe401e84740 1 Processor -- start 2024-08-31T06:29:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.865+0000 7fe401e84740 1 -- start start 2024-08-31T06:29:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe3f1ffb640 1 -- 172.21.15.53:0/3977759176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe3e8010830 con 0x7fe3f41038a0 2024-08-31T06:29:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe401e84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767f161b0 0x5567682b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe401e84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682ba220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe401e84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767ef54d0 0x5567682ba760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe401e84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55676822f000 con 0x556767f161b0 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe401e84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55676821e590 con 0x556767eed2f0 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe401e84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556768222540 con 0x556767ef54d0 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe3f93dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767f161b0 0x5567682b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe3f93dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767f161b0 0x5567682b9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59440/0 (socket says 172.21.15.53:59440) 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe3f8bdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682ba220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe3f93dc640 1 -- 172.21.15.53:0/3414323176 learned_addr learned my addr 172.21.15.53:0/3414323176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe3f3fff640 1 --2- 172.21.15.53:0/3414323176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767ef54d0 0x5567682ba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe3f8bdb640 1 -- 172.21.15.53:0/3414323176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767ef54d0 msgr2=0x5567682ba760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.866+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/3414323176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767ef54d0 0x5567682ba760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.867+0000 7fe3f8bdb640 1 -- 172.21.15.53:0/3414323176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767f161b0 msgr2=0x5567682b9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.867+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/3414323176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767f161b0 0x5567682b9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.867+0000 7fe3f8bdb640 1 -- 172.21.15.53:0/3414323176 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556767f81790 con 0x556767eed2f0 2024-08-31T06:29:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.867+0000 7fe3f93dc640 1 --2- 172.21.15.53:0/3414323176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767f161b0 0x5567682b9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:29:52.874 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.867+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/3414323176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682ba220 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80e2f00 tx=0x7fe3e80ebf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7366a402e1c2f35 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.867+0000 7fe3f1ffb640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe3e40b4cd0 0x7fe3e40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.867+0000 7fe3deffd640 1 -- 172.21.15.53:0/3414323176 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80f4070 con 0x556767eed2f0 2024-08-31T06:29:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.867+0000 7fe3f93dc640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe3e40b4cd0 0x7fe3e40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.867+0000 7fe3f1ffb640 1 -- 172.21.15.53:0/3977759176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7fe3e80e5800 con 0x7fe3f41038a0 2024-08-31T06:29:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.867+0000 7fe3deffd640 1 -- 172.21.15.53:0/3414323176 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3e80ab9e0 con 0x556767eed2f0 2024-08-31T06:29:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.867+0000 7fe3deffd640 1 -- 172.21.15.53:0/3414323176 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80e8e60 con 0x556767eed2f0 2024-08-31T06:29:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.868+0000 7fe401e84740 1 -- 172.21.15.53:0/3414323176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 msgr2=0x5567682ba220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.868+0000 7fe401e84740 1 --2- 172.21.15.53:0/3414323176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682ba220 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80e2f00 tx=0x7fe3e80ebf10 comp rx=0 tx=0).stop 2024-08-31T06:29:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.868+0000 7fe3f93dc640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe3e40b4cd0 0x7fe3e40b71e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec011890 tx=0x7fe3ec009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.869+0000 7fe401e84740 1 -- 172.21.15.53:0/3414323176 shutdown_connections 2024-08-31T06:29:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.869+0000 7fe401e84740 1 --2- 172.21.15.53:0/3414323176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767ef54d0 0x5567682ba760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.869+0000 7fe401e84740 1 --2- 172.21.15.53:0/3414323176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682ba220 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.869+0000 7fe401e84740 1 --2- 172.21.15.53:0/3414323176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767f161b0 0x5567682b9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.869+0000 7fe401e84740 1 -- 172.21.15.53:0/3414323176 >> 172.21.15.53:0/3414323176 conn(0x556767f0a300 msgr2=0x5567682b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.869+0000 7fe401e84740 1 -- 172.21.15.53:0/3414323176 shutdown_connections 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.869+0000 7fe401e84740 1 -- 172.21.15.53:0/3414323176 wait complete. 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.869+0000 7fe401e84740 1 -- start start 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.869+0000 7fe401e84740 1 Processor -- start 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe401e84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe401e84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe401e84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767f161b0 0x5567682d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe401e84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556768157ab0 con 0x556767ef54d0 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe401e84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5567681a5680 con 0x556767eed2f0 2024-08-31T06:29:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe401e84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5567682c8460 con 0x556767f161b0 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3f8bdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3f8bdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38034/0 (socket says 172.21.15.53:38034) 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3f8bdb640 1 -- 172.21.15.53:0/1934828296 learned_addr learned my addr 172.21.15.53:0/1934828296 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3f93dc640 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767f161b0 0x5567682d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe401e84740 10 client.0 _ll_register_callbacks cb 0x556767f2da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3f8bdb640 1 -- 172.21.15.53:0/1934828296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767f161b0 msgr2=0x5567682d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767f161b0 0x5567682d1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3f8bdb640 1 -- 172.21.15.53:0/1934828296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 msgr2=0x5567682c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682c5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3f8bdb640 1 -- 172.21.15.53:0/1934828296 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556767ffa620 con 0x556767eed2f0 2024-08-31T06:29:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c58f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80abbd0 tx=0x7fe3e80e2f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b35c8b7c3433f49 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.870+0000 7fe3d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe3d3fff640 1 -- 172.21.15.53:0/1934828296 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80f4070 con 0x556767eed2f0 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe3d3fff640 1 -- 172.21.15.53:0/1934828296 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7fe3e80e31b0 con 0x556767eed2f0 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe401e84740 1 -- 172.21.15.53:0/1934828296 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e80ab9e0 con 0x556767eed2f0 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe3d3fff640 1 -- 172.21.15.53:0/1934828296 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fe3e80e8e60 con 0x556767eed2f0 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe401e84740 10 client.31586 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe401e84740 1 -- 172.21.15.53:0/1934828296 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x5567682d44d0 con 0x556767eed2f0 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe3d3fff640 1 -- 172.21.15.53:0/1934828296 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3e80ab9e0 con 0x556767eed2f0 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe3d3fff640 1 -- 172.21.15.53:0/1934828296 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7fe3e80b0050 con 0x556767eed2f0 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe401e84740 10 client.31586 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe401e84740 10 client.31586 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe401e84740 20 client.31586 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe401e84740 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556767ed4d80 0x5567682d7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe401e84740 4 client.31586 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:29:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.871+0000 7fe401e84740 1 -- 172.21.15.53:0/1934828296 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556768230f50 con 0x556767ed4d80 2024-08-31T06:29:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.872+0000 7fe3f3fff640 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556767ed4d80 0x5567682d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.872+0000 7fe3d3fff640 10 client.31586 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.872+0000 7fe3f3fff640 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556767ed4d80 0x5567682d7830 crc :-1 s=READY pgs=578 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=196ff4902482ff04 server_cookie=261f10336a45b3ca in_seq=0 out_seq=0 2024-08-31T06:29:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe3d3fff640 1 -- 172.21.15.53:0/1934828296 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556768230f50 con 0x556767ed4d80 2024-08-31T06:29:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe3d3fff640 10 client.31586 handle_command_reply: tid=0 2024-08-31T06:29:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 1 client.31586 shutdown 2024-08-31T06:29:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 1 -- 172.21.15.53:0/1934828296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 msgr2=0x5567682c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c58f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80abbd0 tx=0x7fe3e80e2f00 comp rx=0 tx=0).stop 2024-08-31T06:29:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 1 -- 172.21.15.53:0/1934828296 shutdown_connections 2024-08-31T06:29:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556767ed4d80 0x5567682d7830 crc :-1 s=READY pgs=578 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe3d3fff640 0 client.31586 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767f161b0 0x5567682d1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 1 --2- 172.21.15.53:0/1934828296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c58f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 1 -- 172.21.15.53:0/1934828296 >> 172.21.15.53:0/1934828296 conn(0x556767f0a300 msgr2=0x5567682bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 1 -- 172.21.15.53:0/1934828296 shutdown_connections 2024-08-31T06:29:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 1 -- 172.21.15.53:0/1934828296 wait complete. 2024-08-31T06:29:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.873+0000 7fe401e84740 20 client.31586 trim_cache size 0 max 16384 2024-08-31T06:29:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.897+0000 7fe401e84740 1 Processor -- start 2024-08-31T06:29:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.897+0000 7fe401e84740 1 -- start start 2024-08-31T06:29:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe401e84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767ed4d80 0x5567682c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe401e84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe401e84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682beda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe401e84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f41ad200 con 0x556767ef54d0 2024-08-31T06:29:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe401e84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f41aee00 con 0x556767eed2f0 2024-08-31T06:29:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe401e84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f41ad8d0 con 0x556767ed4d80 2024-08-31T06:29:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe3f3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe3f8bdb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767ed4d80 0x5567682c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe3f3fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38044/0 (socket says 172.21.15.53:38044) 2024-08-31T06:29:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe3f3fff640 1 -- 172.21.15.53:0/2077955719 learned_addr learned my addr 172.21.15.53:0/2077955719 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe3f93dc640 1 --2- 172.21.15.53:0/2077955719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe3f3fff640 1 -- 172.21.15.53:0/2077955719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767ed4d80 msgr2=0x5567682c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe3f3fff640 1 --2- 172.21.15.53:0/2077955719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767ed4d80 0x5567682c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe3f3fff640 1 -- 172.21.15.53:0/2077955719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 msgr2=0x5567682beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe3f3fff640 1 --2- 172.21.15.53:0/2077955719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682beda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.898+0000 7fe3f3fff640 1 -- 172.21.15.53:0/2077955719 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567682b1980 con 0x556767eed2f0 2024-08-31T06:29:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.899+0000 7fe3f3fff640 1 --2- 172.21.15.53:0/2077955719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c4480 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0005940 tx=0x7fe3e0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52b2657f3182af22 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.899+0000 7fe3de7fc640 1 -- 172.21.15.53:0/2077955719 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e004c030 con 0x556767eed2f0 2024-08-31T06:29:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.899+0000 7fe3de7fc640 1 -- 172.21.15.53:0/2077955719 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3e00044d0 con 0x556767eed2f0 2024-08-31T06:29:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.899+0000 7fe3de7fc640 1 -- 172.21.15.53:0/2077955719 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0035040 con 0x556767eed2f0 2024-08-31T06:29:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.900+0000 7fe401e84740 1 -- 172.21.15.53:0/2077955719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 msgr2=0x5567682c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.900+0000 7fe401e84740 1 --2- 172.21.15.53:0/2077955719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c4480 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0005940 tx=0x7fe3e0009260 comp rx=0 tx=0).stop 2024-08-31T06:29:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.900+0000 7fe401e84740 1 -- 172.21.15.53:0/2077955719 shutdown_connections 2024-08-31T06:29:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.900+0000 7fe401e84740 1 --2- 172.21.15.53:0/2077955719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.900+0000 7fe401e84740 1 --2- 172.21.15.53:0/2077955719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767eed2f0 0x5567682c4480 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.900+0000 7fe401e84740 1 --2- 172.21.15.53:0/2077955719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767ed4d80 0x5567682c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.900+0000 7fe401e84740 1 -- 172.21.15.53:0/2077955719 >> 172.21.15.53:0/2077955719 conn(0x556767f0a300 msgr2=0x5567682c0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.900+0000 7fe401e84740 1 -- 172.21.15.53:0/2077955719 shutdown_connections 2024-08-31T06:29:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.900+0000 7fe401e84740 1 -- 172.21.15.53:0/2077955719 wait complete. 2024-08-31T06:29:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.901+0000 7fe401e84740 1 -- start start 2024-08-31T06:29:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.901+0000 7fe401e84740 1 Processor -- start 2024-08-31T06:29:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.901+0000 7fe401e84740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767ed4d80 0x5567682d87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.901+0000 7fe401e84740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767eed2f0 0x5567682d8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.901+0000 7fe401e84740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682d9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.901+0000 7fe401e84740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f41ae730 con 0x556767ef54d0 2024-08-31T06:29:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe401e84740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f41adfa0 con 0x556767ed4d80 2024-08-31T06:29:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe401e84740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f41ab200 con 0x556767eed2f0 2024-08-31T06:29:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767eed2f0 0x5567682d8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767eed2f0 0x5567682d8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:56394/0 (socket says 172.21.15.53:56394) 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f3fff640 1 -- 172.21.15.53:0/2256567841 learned_addr learned my addr 172.21.15.53:0/2256567841 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f8bdb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767ed4d80 0x5567682d87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f93dc640 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682d9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe401e84740 10 client.0 _ll_register_callbacks cb 0x7fe3ec009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f3fff640 1 -- 172.21.15.53:0/2256567841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767ed4d80 msgr2=0x5567682d87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f3fff640 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767ed4d80 0x5567682d87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f3fff640 1 -- 172.21.15.53:0/2256567841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 msgr2=0x5567682d9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f3fff640 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682d9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f3fff640 1 -- 172.21.15.53:0/2256567841 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567682bcaf0 con 0x556767eed2f0 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767ed4d80 0x5567682d87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3f3fff640 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767eed2f0 0x5567682d8ce0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009850 tx=0x7fe3e002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d1b14cde57a1f1d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:29:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.902+0000 7fe3d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:29:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.904+0000 7fe3d3fff640 1 -- 172.21.15.53:0/2256567841 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e004c040 con 0x556767eed2f0 2024-08-31T06:29:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.904+0000 7fe401e84740 1 -- 172.21.15.53:0/2256567841 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e00044d0 con 0x556767eed2f0 2024-08-31T06:29:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.904+0000 7fe3d3fff640 1 -- 172.21.15.53:0/2256567841 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7fe3e0004040 con 0x556767eed2f0 2024-08-31T06:29:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.904+0000 7fe3d3fff640 1 -- 172.21.15.53:0/2256567841 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fe3e0035040 con 0x556767eed2f0 2024-08-31T06:29:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.904+0000 7fe401e84740 10 client.31594 fetch_fsmap learned FSMap version 90 2024-08-31T06:29:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.904+0000 7fe401e84740 1 -- 172.21.15.53:0/2256567841 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x556768341fb0 con 0x556767eed2f0 2024-08-31T06:29:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.905+0000 7fe3d3fff640 1 -- 172.21.15.53:0/2256567841 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3e00044d0 con 0x556767eed2f0 2024-08-31T06:29:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.905+0000 7fe3d3fff640 1 -- 172.21.15.53:0/2256567841 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7fe3e0031540 con 0x556767eed2f0 2024-08-31T06:29:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.905+0000 7fe401e84740 10 client.31594 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:29:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.905+0000 7fe401e84740 10 client.31594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:29:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.905+0000 7fe401e84740 20 client.31594 populate_metadata read hostname 'smithi053' 2024-08-31T06:29:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.905+0000 7fe401e84740 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556767f161b0 0x556768344730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:29:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.905+0000 7fe401e84740 4 client.31594 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:29:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.905+0000 7fe401e84740 1 -- 172.21.15.53:0/2256567841 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55676822c9f0 con 0x556767f161b0 2024-08-31T06:29:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.905+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556767f161b0 0x556768344730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:29:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.906+0000 7fe3d3fff640 10 client.31594 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:52.906+0000 7fe3f8bdb640 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556767f161b0 0x556768344730 crc :-1 s=READY pgs=579 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5569e47f608aa991 server_cookie=118d828afcb530d6 in_seq=0 out_seq=0 2024-08-31T06:29:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.021+0000 7fe3d3fff640 1 -- 172.21.15.53:0/2256567841 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55676822c9f0 con 0x556767f161b0 2024-08-31T06:29:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe3d3fff640 10 client.31594 handle_command_reply: tid=0 2024-08-31T06:29:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 1 client.31594 shutdown 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 1 -- 172.21.15.53:0/2256567841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767eed2f0 msgr2=0x5567682d8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767eed2f0 0x5567682d8ce0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009850 tx=0x7fe3e002a410 comp rx=0 tx=0).stop 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 1 -- 172.21.15.53:0/2256567841 shutdown_connections 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x556767f161b0 0x556768344730 crc :-1 s=READY pgs=579 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556767ef54d0 0x5567682d9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556767eed2f0 0x5567682d8ce0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 1 --2- 172.21.15.53:0/2256567841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556767ed4d80 0x5567682d87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 1 -- 172.21.15.53:0/2256567841 >> 172.21.15.53:0/2256567841 conn(0x556767f0a300 msgr2=0x5567682c0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe3d3fff640 0 client.31594 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 1 -- 172.21.15.53:0/2256567841 shutdown_connections 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 1 -- 172.21.15.53:0/2256567841 wait complete. 2024-08-31T06:29:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.022+0000 7fe401e84740 20 client.31594 trim_cache size 0 max 16384 2024-08-31T06:29:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:29:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:29:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:29:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:29:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.023+0000 7fe3fae3f640 1 -- 172.21.15.53:0/3977759176 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe3e40b4cd0 msgr2=0x7fe3e40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.023+0000 7fe3fae3f640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe3e40b4cd0 0x7fe3e40b71e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec011890 tx=0x7fe3ec009500 comp rx=0 tx=0).stop 2024-08-31T06:29:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.023+0000 7fe3fae3f640 1 -- 172.21.15.53:0/3977759176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f41038a0 msgr2=0x7fe3f40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:29:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.023+0000 7fe3fae3f640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f41038a0 0x7fe3f40754b0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800ea60 tx=0x7fe3e800ef20 comp rx=0 tx=0).stop 2024-08-31T06:29:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.023+0000 7fe3fae3f640 1 -- 172.21.15.53:0/3977759176 shutdown_connections 2024-08-31T06:29:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.023+0000 7fe3fae3f640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe3e40b4cd0 0x7fe3e40b71e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.023+0000 7fe3fae3f640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3f4109b20 0x7fe3f4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.023+0000 7fe3fae3f640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3f41091d0 0x7fe3f40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.023+0000 7fe3fae3f640 1 --2- 172.21.15.53:0/3977759176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3f41038a0 0x7fe3f40754b0 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:29:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.023+0000 7fe3fae3f640 1 -- 172.21.15.53:0/3977759176 >> 172.21.15.53:0/3977759176 conn(0x7fe3f40ff2a0 msgr2=0x7fe3f41016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:29:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.024+0000 7fe3fae3f640 1 -- 172.21.15.53:0/3977759176 shutdown_connections 2024-08-31T06:29:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:29:53.024+0000 7fe3fae3f640 1 -- 172.21.15.53:0/3977759176 wait complete. 2024-08-31T06:29:53.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 74027 5.54 MB/sec execute 581 sec latency 99.611 ms 2024-08-31T06:29:54.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:53 smithi153 ceph-mon[22320]: pgmap v1109: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 240 op/s 2024-08-31T06:29:54.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:53 smithi053 ceph-mon[18924]: pgmap v1109: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 240 op/s 2024-08-31T06:29:54.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:53 smithi130 ceph-mon[22266]: pgmap v1109: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 240 op/s 2024-08-31T06:29:54.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 74207 5.55 MB/sec execute 582 sec latency 75.563 ms 2024-08-31T06:29:55.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 74415 5.56 MB/sec execute 583 sec latency 53.240 ms 2024-08-31T06:29:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:55 smithi153 ceph-mon[22320]: pgmap v1110: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 341 op/s 2024-08-31T06:29:56.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:55 smithi053 ceph-mon[18924]: pgmap v1110: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 341 op/s 2024-08-31T06:29:56.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:55 smithi130 ceph-mon[22266]: pgmap v1110: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 341 op/s 2024-08-31T06:29:56.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 74584 5.57 MB/sec execute 584 sec latency 68.912 ms 2024-08-31T06:29:57.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 74724 5.57 MB/sec execute 585 sec latency 102.902 ms 2024-08-31T06:29:58.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:57 smithi153 ceph-mon[22320]: pgmap v1111: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 365 op/s 2024-08-31T06:29:58.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:57 smithi053 ceph-mon[18924]: pgmap v1111: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 365 op/s 2024-08-31T06:29:58.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:57 smithi130 ceph-mon[22266]: pgmap v1111: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 365 op/s 2024-08-31T06:29:58.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 74885 5.58 MB/sec execute 586 sec latency 75.575 ms 2024-08-31T06:29:59.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 75031 5.58 MB/sec execute 587 sec latency 83.598 ms 2024-08-31T06:30:00.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:29:59 smithi153 ceph-mon[22320]: pgmap v1112: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 332 op/s 2024-08-31T06:30:00.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:29:59 smithi053 ceph-mon[18924]: pgmap v1112: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 332 op/s 2024-08-31T06:30:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:29:59 smithi130 ceph-mon[22266]: pgmap v1112: 97 pgs: 97 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 332 op/s 2024-08-31T06:30:00.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 75173 5.58 MB/sec execute 588 sec latency 65.963 ms 2024-08-31T06:30:01.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:00 smithi153 ceph-mon[22320]: overall HEALTH_OK 2024-08-31T06:30:01.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:00 smithi053 ceph-mon[18924]: overall HEALTH_OK 2024-08-31T06:30:01.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:00 smithi130 ceph-mon[22266]: overall HEALTH_OK 2024-08-31T06:30:01.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 75345 5.59 MB/sec execute 589 sec latency 93.725 ms 2024-08-31T06:30:01.707 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.3 2024-08-31T06:30:01.708 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:30:02.116 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:02.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:01 smithi153 ceph-mon[22320]: pgmap v1113: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-08-31T06:30:02.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:01 smithi053 ceph-mon[18924]: pgmap v1113: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-08-31T06:30:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:01 smithi130 ceph-mon[22266]: pgmap v1113: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-08-31T06:30:02.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 75499 5.60 MB/sec execute 590 sec latency 61.182 ms 2024-08-31T06:30:02.678 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:30:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.843+0000 7f22712aa640 1 -- 172.21.15.53:0/4250166781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268031800 con 0x7f226c103930 2024-08-31T06:30:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.844+0000 7f2274510640 1 -- 172.21.15.53:0/4250166781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f226c103930 msgr2=0x7f226c103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.844+0000 7f2274510640 1 --2- 172.21.15.53:0/4250166781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f226c103930 0x7f226c103d40 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f2268009900 tx=0x7f226802a410 comp rx=0 tx=0).stop 2024-08-31T06:30:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.844+0000 7f2274510640 1 -- 172.21.15.53:0/4250166781 shutdown_connections 2024-08-31T06:30:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.844+0000 7f2274510640 1 --2- 172.21.15.53:0/4250166781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f226c109bc0 0x7f226c1103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.844+0000 7f2274510640 1 --2- 172.21.15.53:0/4250166781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f226c109270 0x7f226c109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.844+0000 7f2274510640 1 --2- 172.21.15.53:0/4250166781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f226c103930 0x7f226c103d40 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.844+0000 7f2274510640 1 -- 172.21.15.53:0/4250166781 >> 172.21.15.53:0/4250166781 conn(0x7f226c0ff380 msgr2=0x7f226c1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.844+0000 7f2274510640 1 -- 172.21.15.53:0/4250166781 shutdown_connections 2024-08-31T06:30:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.844+0000 7f2274510640 1 -- 172.21.15.53:0/4250166781 wait complete. 2024-08-31T06:30:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.846+0000 7f2274510640 1 Processor -- start 2024-08-31T06:30:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.846+0000 7f2274510640 1 -- start start 2024-08-31T06:30:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.847+0000 7f2274510640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f226c103930 0x7f226c19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.847+0000 7f2274510640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f226c109270 0x7f226c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.847+0000 7f2274510640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f226c109bc0 0x7f226c19f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.847+0000 7f22722ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f226c103930 0x7f226c19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.847+0000 7f22722ac640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f226c103930 0x7f226c19a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:38042/0 (socket says 172.21.15.53:38042) 2024-08-31T06:30:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.847+0000 7f22722ac640 1 -- 172.21.15.53:0/4118252891 learned_addr learned my addr 172.21.15.53:0/4118252891 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.847+0000 7f2271aab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f226c109270 0x7f226c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.847+0000 7f2272aad640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f226c109bc0 0x7f226c19f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.847+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f226c113780 con 0x7f226c109270 2024-08-31T06:30:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.847+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f226c113600 con 0x7f226c103930 2024-08-31T06:30:02.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.847+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f226c113900 con 0x7f226c109bc0 2024-08-31T06:30:02.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.848+0000 7f2271aab640 1 -- 172.21.15.53:0/4118252891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f226c109bc0 msgr2=0x7f226c19f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.848+0000 7f2271aab640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f226c109bc0 0x7f226c19f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.848+0000 7f2271aab640 1 -- 172.21.15.53:0/4118252891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f226c103930 msgr2=0x7f226c19a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.848+0000 7f2271aab640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f226c103930 0x7f226c19a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.848+0000 7f2271aab640 1 -- 172.21.15.53:0/4118252891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c1a00d0 con 0x7f226c109270 2024-08-31T06:30:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.848+0000 7f2271aab640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f226c109270 0x7f226c19a700 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f226c06b8d0 tx=0x7f225c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.848+0000 7f22637fe640 1 -- 172.21.15.53:0/4118252891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c00cc40 con 0x7f226c109270 2024-08-31T06:30:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.849+0000 7f22637fe640 1 -- 172.21.15.53:0/4118252891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f225c00cde0 con 0x7f226c109270 2024-08-31T06:30:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.849+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f226c1a03c0 con 0x7f226c109270 2024-08-31T06:30:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.849+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f226c1a6b20 con 0x7f226c109270 2024-08-31T06:30:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.849+0000 7f22637fe640 1 -- 172.21.15.53:0/4118252891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c0186f0 con 0x7f226c109270 2024-08-31T06:30:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.850+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22500052c0 con 0x7f226c109270 2024-08-31T06:30:02.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.853+0000 7f22637fe640 1 -- 172.21.15.53:0/4118252891 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f225c018890 con 0x7f226c109270 2024-08-31T06:30:02.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.854+0000 7f22637fe640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22580b4d20 0x7f22580b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:02.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.855+0000 7f22637fe640 1 -- 172.21.15.53:0/4118252891 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f225c0e5ab0 con 0x7f226c109270 2024-08-31T06:30:02.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.855+0000 7f22722ac640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22580b4d20 0x7f22580b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.855+0000 7f22722ac640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22580b4d20 0x7f22580b7230 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2268000c00 tx=0x7f2268009580 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:02.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:02.859+0000 7f22637fe640 1 -- 172.21.15.53:0/4118252891 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f225c0ac230 con 0x7f226c109270 2024-08-31T06:30:03.060 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.227+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22500055b0 con 0x7f226c109270 2024-08-31T06:30:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.228+0000 7f22637fe640 1 -- 172.21.15.53:0/4118252891 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+11992 (secure 0 0 0) 0x7f225c0b09f0 con 0x7f226c109270 2024-08-31T06:30:03.230 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:30:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 90 2024-08-31T06:30:03.230 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":90,"btime":"2024-08-31T06:29:16:977675+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":90,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:29:16.408419+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:30:03.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22580b4d20 msgr2=0x7f22580b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:03.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22580b4d20 0x7f22580b7230 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2268000c00 tx=0x7f2268009580 comp rx=0 tx=0).stop 2024-08-31T06:30:03.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f226c109270 msgr2=0x7f226c19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:03.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f226c109270 0x7f226c19a700 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f226c06b8d0 tx=0x7f225c00ee50 comp rx=0 tx=0).stop 2024-08-31T06:30:03.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 shutdown_connections 2024-08-31T06:30:03.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f22580b4d20 0x7f22580b7230 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f226c109bc0 0x7f226c19f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f226c109270 0x7f226c19a700 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 --2- 172.21.15.53:0/4118252891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f226c103930 0x7f226c19a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 >> 172.21.15.53:0/4118252891 conn(0x7f226c0ff380 msgr2=0x7f226c1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:03.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 shutdown_connections 2024-08-31T06:30:03.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.231+0000 7f2274510640 1 -- 172.21.15.53:0/4118252891 wait complete. 2024-08-31T06:30:03.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 75620 5.60 MB/sec execute 591 sec latency 112.660 ms 2024-08-31T06:30:03.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.786+0000 7f23a4029640 1 -- 172.21.15.53:0/4085213886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f239c10dbb0 msgr2=0x7f239c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:03.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.786+0000 7f23a4029640 1 --2- 172.21.15.53:0/4085213886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f239c10dbb0 0x7f239c1100a0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7f2394009ca0 tx=0x7f239402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.786+0000 7f23a4029640 1 -- 172.21.15.53:0/4085213886 shutdown_connections 2024-08-31T06:30:03.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.786+0000 7f23a4029640 1 --2- 172.21.15.53:0/4085213886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f239c10dbb0 0x7f239c1100a0 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.786+0000 7f23a4029640 1 --2- 172.21.15.53:0/4085213886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239c1050a0 0x7f239c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.786+0000 7f23a4029640 1 --2- 172.21.15.53:0/4085213886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f239c104750 0x7f239c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.786+0000 7f23a4029640 1 -- 172.21.15.53:0/4085213886 >> 172.21.15.53:0/4085213886 conn(0x7f239c0794d0 msgr2=0x7f239c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:03.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.786+0000 7f23a4029640 1 -- 172.21.15.53:0/4085213886 shutdown_connections 2024-08-31T06:30:03.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.786+0000 7f23a4029640 1 -- 172.21.15.53:0/4085213886 wait complete. 2024-08-31T06:30:03.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.787+0000 7f23a4029640 1 Processor -- start 2024-08-31T06:30:03.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.787+0000 7f23a4029640 1 -- start start 2024-08-31T06:30:03.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.787+0000 7f23a4029640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239c104750 0x7f239c103ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.787+0000 7f23a4029640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f239c1050a0 0x7f239c1024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.787+0000 7f23a4029640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f239c10dbb0 0x7f239c102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.787+0000 7f23a4029640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f239c113710 con 0x7f239c1050a0 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.787+0000 7f23a4029640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f239c113590 con 0x7f239c10dbb0 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.787+0000 7f23a4029640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f239c113890 con 0x7f239c104750 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.788+0000 7f23a15c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f239c1050a0 0x7f239c1024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.788+0000 7f23a1dc5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239c104750 0x7f239c103ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.788+0000 7f23a15c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f239c1050a0 0x7f239c1024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60664/0 (socket says 172.21.15.53:60664) 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.788+0000 7f23a15c4640 1 -- 172.21.15.53:0/1120580941 learned_addr learned my addr 172.21.15.53:0/1120580941 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.788+0000 7f23a25c6640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f239c10dbb0 0x7f239c102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.788+0000 7f23a1dc5640 1 -- 172.21.15.53:0/1120580941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f239c10dbb0 msgr2=0x7f239c102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.788+0000 7f23a1dc5640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f239c10dbb0 0x7f239c102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.788+0000 7f23a1dc5640 1 -- 172.21.15.53:0/1120580941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f239c1050a0 msgr2=0x7f239c1024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.788+0000 7f23a1dc5640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f239c1050a0 0x7f239c1024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.788+0000 7f23a1dc5640 1 -- 172.21.15.53:0/1120580941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239c103230 con 0x7f239c104750 2024-08-31T06:30:03.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.788+0000 7f23a15c4640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f239c1050a0 0x7f239c1024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:03.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.789+0000 7f23a1dc5640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239c104750 0x7f239c103ec0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f239800e9c0 tx=0x7f239800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:03.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.789+0000 7f2392ffd640 1 -- 172.21.15.53:0/1120580941 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239800ccc0 con 0x7f239c104750 2024-08-31T06:30:03.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.789+0000 7f2392ffd640 1 -- 172.21.15.53:0/1120580941 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23980044b0 con 0x7f239c104750 2024-08-31T06:30:03.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.789+0000 7f23a4029640 1 -- 172.21.15.53:0/1120580941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239c1acaa0 con 0x7f239c104750 2024-08-31T06:30:03.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.789+0000 7f2392ffd640 1 -- 172.21.15.53:0/1120580941 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398003e10 con 0x7f239c104750 2024-08-31T06:30:03.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.789+0000 7f23a4029640 1 -- 172.21.15.53:0/1120580941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f239c1acfb0 con 0x7f239c104750 2024-08-31T06:30:03.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23aa59e740 1 Processor -- start 2024-08-31T06:30:03.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23aa59e740 1 -- start start 2024-08-31T06:30:03.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f2392ffd640 1 -- 172.21.15.53:0/1120580941 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2398004000 con 0x7f239c104750 2024-08-31T06:30:03.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b8918070 0x5595b8cbd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 0x5595b8cbd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b88f7390 0x5595b8cbdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23aa59e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5595b8c34630 con 0x5595b8918070 2024-08-31T06:30:03.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23aa59e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5595b8c23bc0 con 0x5595b88f7390 2024-08-31T06:30:03.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23aa59e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5595b8c27b70 con 0x5595b88ef1b0 2024-08-31T06:30:03.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23a25c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b8918070 0x5595b8cbd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23a25c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b8918070 0x5595b8cbd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60668/0 (socket says 172.21.15.53:60668) 2024-08-31T06:30:03.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23a25c6640 1 -- 172.21.15.53:0/2276137999 learned_addr learned my addr 172.21.15.53:0/2276137999 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:03.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.793+0000 7f23a15c4640 1 --2- 172.21.15.53:0/2276137999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b88f7390 0x5595b8cbdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.794+0000 7f23a1dc5640 1 --2- 172.21.15.53:0/2276137999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 0x5595b8cbd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.794+0000 7f23a25c6640 1 -- 172.21.15.53:0/2276137999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 msgr2=0x5595b8cbd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:03.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.794+0000 7f23a25c6640 1 --2- 172.21.15.53:0/2276137999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 0x5595b8cbd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.794+0000 7f23a25c6640 1 -- 172.21.15.53:0/2276137999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b88f7390 msgr2=0x5595b8cbdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:03.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.794+0000 7f23a25c6640 1 --2- 172.21.15.53:0/2276137999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b88f7390 0x5595b8cbdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.794+0000 7f23a25c6640 1 -- 172.21.15.53:0/2276137999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b8983650 con 0x5595b8918070 2024-08-31T06:30:03.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.794+0000 7f23a1dc5640 1 --2- 172.21.15.53:0/2276137999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 0x5595b8cbd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:03.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.794+0000 7f23a25c6640 1 --2- 172.21.15.53:0/2276137999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b8918070 0x5595b8cbd2c0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f2394009ca0 tx=0x7f2394009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f212c31d936bad0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:03.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.794+0000 7f2392ffd640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4da0 0x7f23880b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.795+0000 7f2392ffd640 1 -- 172.21.15.53:0/1120580941 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f23980e59a0 con 0x7f239c104750 2024-08-31T06:30:03.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.795+0000 7f23a1dc5640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4da0 0x7f23880b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.795+0000 7f2387fff640 1 -- 172.21.15.53:0/2276137999 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23940316d0 con 0x5595b8918070 2024-08-31T06:30:03.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.795+0000 7f2387fff640 1 -- 172.21.15.53:0/2276137999 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2394036030 con 0x5595b8918070 2024-08-31T06:30:03.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.795+0000 7f2387fff640 1 -- 172.21.15.53:0/2276137999 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394004330 con 0x5595b8918070 2024-08-31T06:30:03.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.796+0000 7f23aa59e740 1 -- 172.21.15.53:0/2276137999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b8918070 msgr2=0x5595b8cbd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:03.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.796+0000 7f23a1dc5640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4da0 0x7f23880b72b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x5595b8cbbf40 tx=0x7f2398009310 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:03.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.796+0000 7f23aa59e740 1 --2- 172.21.15.53:0/2276137999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b8918070 0x5595b8cbd2c0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f2394009ca0 tx=0x7f2394009a20 comp rx=0 tx=0).stop 2024-08-31T06:30:03.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.796+0000 7f23aa59e740 1 -- 172.21.15.53:0/2276137999 shutdown_connections 2024-08-31T06:30:03.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.796+0000 7f23aa59e740 1 --2- 172.21.15.53:0/2276137999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b88f7390 0x5595b8cbdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.796+0000 7f23aa59e740 1 --2- 172.21.15.53:0/2276137999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 0x5595b8cbd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.796+0000 7f23aa59e740 1 --2- 172.21.15.53:0/2276137999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b8918070 0x5595b8cbd2c0 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.796+0000 7f23aa59e740 1 -- 172.21.15.53:0/2276137999 >> 172.21.15.53:0/2276137999 conn(0x5595b890c460 msgr2=0x5595b8cbb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:03.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.796+0000 7f23aa59e740 1 -- 172.21.15.53:0/2276137999 shutdown_connections 2024-08-31T06:30:03.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.796+0000 7f23aa59e740 1 -- 172.21.15.53:0/2276137999 wait complete. 2024-08-31T06:30:03.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.797+0000 7f23aa59e740 1 -- start start 2024-08-31T06:30:03.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.797+0000 7f23aa59e740 1 Processor -- start 2024-08-31T06:30:03.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.797+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 0x5595b8cc8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88f7390 0x5595b8cc9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b8918070 0x5595b8cd4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23aa59e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5595b8a86700 con 0x5595b88f7390 2024-08-31T06:30:03.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23aa59e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5595b8baa700 con 0x5595b8918070 2024-08-31T06:30:03.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23aa59e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5595b8ccb8c0 con 0x5595b88ef1b0 2024-08-31T06:30:03.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23aa59e740 10 client.0 _ll_register_callbacks cb 0x5595b8bd9dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:03.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23a15c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88f7390 0x5595b8cc9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23a25c6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 0x5595b8cc8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23a25c6640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b8918070 0x5595b8cd4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23a25c6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 0x5595b8cc8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57588/0 (socket says 172.21.15.53:57588) 2024-08-31T06:30:03.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23a25c6640 1 -- 172.21.15.53:0/3352482444 learned_addr learned my addr 172.21.15.53:0/3352482444 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:03.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23a25c6640 1 -- 172.21.15.53:0/3352482444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b8918070 msgr2=0x5595b8cd4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:03.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23a25c6640 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b8918070 0x5595b8cd4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23a25c6640 1 -- 172.21.15.53:0/3352482444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88f7390 msgr2=0x5595b8cc9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:03.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23a25c6640 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88f7390 0x5595b8cc9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23a25c6640 1 -- 172.21.15.53:0/3352482444 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b8be38b0 con 0x5595b88ef1b0 2024-08-31T06:30:03.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.798+0000 7f23a15c4640 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88f7390 0x5595b8cc9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:03.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.799+0000 7f23a25c6640 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 0x5595b8cc8ac0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2394009620 tx=0x7f2394003e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dcf1c05193650ea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:03.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.799+0000 7f23857fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.799+0000 7f23857fa640 1 -- 172.21.15.53:0/3352482444 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239404a040 con 0x5595b88ef1b0 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.799+0000 7f23aa59e740 1 -- 172.21.15.53:0/3352482444 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2394036030 con 0x5595b88ef1b0 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.799+0000 7f23857fa640 1 -- 172.21.15.53:0/3352482444 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f2394004670 con 0x5595b88ef1b0 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.799+0000 7f23857fa640 1 -- 172.21.15.53:0/3352482444 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f2394004b40 con 0x5595b88ef1b0 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.799+0000 7f23aa59e740 10 client.31609 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.799+0000 7f23aa59e740 1 -- 172.21.15.53:0/3352482444 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x5595b8cd7690 con 0x5595b88ef1b0 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.800+0000 7f23857fa640 1 -- 172.21.15.53:0/3352482444 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2394036030 con 0x5595b88ef1b0 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.800+0000 7f23857fa640 1 -- 172.21.15.53:0/3352482444 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f2394043070 con 0x5595b88ef1b0 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.800+0000 7f23aa59e740 10 client.31609 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.800+0000 7f23aa59e740 10 client.31609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.800+0000 7f23aa59e740 20 client.31609 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:03.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.800+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595b88d69f0 0x5595b8cdab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.800+0000 7f23aa59e740 4 client.31609 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:03.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.800+0000 7f23aa59e740 1 -- 172.21.15.53:0/3352482444 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595b8c36580 con 0x5595b88d69f0 2024-08-31T06:30:03.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.800+0000 7f23a15c4640 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595b88d69f0 0x5595b8cdab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.801+0000 7f23857fa640 10 client.31609 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:03.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.801+0000 7f23a15c4640 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595b88d69f0 0x5595b8cdab20 crc :-1 s=READY pgs=580 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0ba5f6b34b6bc85 server_cookie=e3a53425d773fefb in_seq=0 out_seq=0 2024-08-31T06:30:03.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.801+0000 7f23857fa640 1 -- 172.21.15.53:0/3352482444 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595b8c36580 con 0x5595b88d69f0 2024-08-31T06:30:03.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.801+0000 7f23857fa640 10 client.31609 handle_command_reply: tid=0 2024-08-31T06:30:03.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 1 client.31609 shutdown 2024-08-31T06:30:03.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 1 -- 172.21.15.53:0/3352482444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 msgr2=0x5595b8cc8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:03.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 0x5595b8cc8ac0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2394009620 tx=0x7f2394003e70 comp rx=0 tx=0).stop 2024-08-31T06:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 1 -- 172.21.15.53:0/3352482444 shutdown_connections 2024-08-31T06:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595b88d69f0 0x5595b8cdab20 crc :-1 s=READY pgs=580 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b8918070 0x5595b8cd4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88f7390 0x5595b8cc9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3352482444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88ef1b0 0x5595b8cc8ac0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23857fa640 0 client.31609 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 1 -- 172.21.15.53:0/3352482444 >> 172.21.15.53:0/3352482444 conn(0x5595b890c460 msgr2=0x5595b8cc04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 1 -- 172.21.15.53:0/3352482444 shutdown_connections 2024-08-31T06:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 1 -- 172.21.15.53:0/3352482444 wait complete. 2024-08-31T06:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.802+0000 7f23aa59e740 20 client.31609 trim_cache size 0 max 16384 2024-08-31T06:30:03.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.831+0000 7f23aa59e740 1 Processor -- start 2024-08-31T06:30:03.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.831+0000 7f23aa59e740 1 -- start start 2024-08-31T06:30:03.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.831+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.831+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b88f7390 0x5595b8cd4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.831+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b8918070 0x5595b8cd4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.831+0000 7f23aa59e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1b5a40 con 0x5595b88ef1b0 2024-08-31T06:30:03.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.831+0000 7f23aa59e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1b7640 con 0x5595b88f7390 2024-08-31T06:30:03.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.831+0000 7f23aa59e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1b6110 con 0x5595b8918070 2024-08-31T06:30:03.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23a25c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23a25c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60672/0 (socket says 172.21.15.53:60672) 2024-08-31T06:30:03.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23a15c4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b88f7390 0x5595b8cd4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23a25c6640 1 -- 172.21.15.53:0/4118299413 learned_addr learned my addr 172.21.15.53:0/4118299413 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:03.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23a25c6640 1 --2- 172.21.15.53:0/4118299413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b8918070 0x5595b8cd4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23a25c6640 1 -- 172.21.15.53:0/4118299413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b8918070 msgr2=0x5595b8cd4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:03.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23a25c6640 1 --2- 172.21.15.53:0/4118299413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b8918070 0x5595b8cd4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23a25c6640 1 -- 172.21.15.53:0/4118299413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b88f7390 msgr2=0x5595b8cd4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:03.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23a25c6640 1 --2- 172.21.15.53:0/4118299413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b88f7390 0x5595b8cd4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23a25c6640 1 -- 172.21.15.53:0/4118299413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b8ccb5d0 con 0x5595b88ef1b0 2024-08-31T06:30:03.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23a25c6640 1 --2- 172.21.15.53:0/4118299413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cca6f0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f23940093c0 tx=0x7f2394009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32de95a01ae8d7ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.832+0000 7f23877fe640 1 -- 172.21.15.53:0/4118299413 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394003ee0 con 0x5595b88ef1b0 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.833+0000 7f23877fe640 1 -- 172.21.15.53:0/4118299413 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2394036030 con 0x5595b88ef1b0 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.833+0000 7f23877fe640 1 -- 172.21.15.53:0/4118299413 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394004690 con 0x5595b88ef1b0 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.834+0000 7f23aa59e740 1 -- 172.21.15.53:0/4118299413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 msgr2=0x5595b8cca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.834+0000 7f23aa59e740 1 --2- 172.21.15.53:0/4118299413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cca6f0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f23940093c0 tx=0x7f2394009a20 comp rx=0 tx=0).stop 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.834+0000 7f23aa59e740 1 -- 172.21.15.53:0/4118299413 shutdown_connections 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.834+0000 7f23aa59e740 1 --2- 172.21.15.53:0/4118299413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b8918070 0x5595b8cd4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.834+0000 7f23aa59e740 1 --2- 172.21.15.53:0/4118299413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b88f7390 0x5595b8cd4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.834+0000 7f23aa59e740 1 --2- 172.21.15.53:0/4118299413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cca6f0 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.834+0000 7f23aa59e740 1 -- 172.21.15.53:0/4118299413 >> 172.21.15.53:0/4118299413 conn(0x5595b890c460 msgr2=0x5595b8cc9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.834+0000 7f23aa59e740 1 -- 172.21.15.53:0/4118299413 shutdown_connections 2024-08-31T06:30:03.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.834+0000 7f23aa59e740 1 -- 172.21.15.53:0/4118299413 wait complete. 2024-08-31T06:30:03.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.835+0000 7f23aa59e740 1 -- start start 2024-08-31T06:30:03.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.835+0000 7f23aa59e740 1 Processor -- start 2024-08-31T06:30:03.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.835+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cd12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.835+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88f7390 0x5595b8ccc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.835+0000 7f23aa59e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b8918070 0x5595b8ccccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.835+0000 7f23aa59e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1b6f70 con 0x5595b88ef1b0 2024-08-31T06:30:03.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.835+0000 7f23a25c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cd12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.835+0000 7f23a25c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cd12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60678/0 (socket says 172.21.15.53:60678) 2024-08-31T06:30:03.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.835+0000 7f23a25c6640 1 -- 172.21.15.53:0/3936466215 learned_addr learned my addr 172.21.15.53:0/3936466215 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:03.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.835+0000 7f23aa59e740 1 -- 172.21.15.53:0/3936466215 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1b67e0 con 0x5595b8918070 2024-08-31T06:30:03.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.835+0000 7f23aa59e740 1 -- 172.21.15.53:0/3936466215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f239c1b3a90 con 0x5595b88f7390 2024-08-31T06:30:03.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.836+0000 7f23aa59e740 10 client.0 _ll_register_callbacks cb 0x7f2394009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:03.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.836+0000 7f23a25c6640 1 -- 172.21.15.53:0/3936466215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88f7390 msgr2=0x5595b8ccc780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:30:03.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.836+0000 7f23a25c6640 1 --2- 172.21.15.53:0/3936466215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88f7390 0x5595b8ccc780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.836+0000 7f23a25c6640 1 -- 172.21.15.53:0/3936466215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b8918070 msgr2=0x5595b8ccccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.836+0000 7f23a25c6640 1 --2- 172.21.15.53:0/3936466215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b8918070 0x5595b8ccccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.836+0000 7f23a25c6640 1 -- 172.21.15.53:0/3936466215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b8ccd430 con 0x5595b88ef1b0 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.836+0000 7f23a25c6640 1 --2- 172.21.15.53:0/3936466215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cd12d0 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f239405f040 tx=0x7f2394031f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da8b173e5930e33 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.836+0000 7f23857fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.836+0000 7f23857fa640 1 -- 172.21.15.53:0/3936466215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239406d060 con 0x5595b88ef1b0 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.837+0000 7f23aa59e740 1 -- 172.21.15.53:0/3936466215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2394036030 con 0x5595b88ef1b0 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.837+0000 7f23857fa640 1 -- 172.21.15.53:0/3936466215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 8557+0+0 (secure 0 0 0) 0x7f23940043c0 con 0x5595b88ef1b0 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.837+0000 7f23857fa640 1 -- 172.21.15.53:0/3936466215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f2394003b40 con 0x5595b88ef1b0 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.837+0000 7f23aa59e740 10 client.22995 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.837+0000 7f23aa59e740 1 -- 172.21.15.53:0/3936466215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x5595b8d45410 con 0x5595b88ef1b0 2024-08-31T06:30:03.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.837+0000 7f23857fa640 1 -- 172.21.15.53:0/3936466215 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2394036030 con 0x5595b88ef1b0 2024-08-31T06:30:03.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.838+0000 7f23857fa640 1 -- 172.21.15.53:0/3936466215 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f2394043040 con 0x5595b88ef1b0 2024-08-31T06:30:03.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.838+0000 7f23aa59e740 10 client.22995 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:03.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.838+0000 7f23aa59e740 10 client.22995 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:03.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.838+0000 7f23aa59e740 20 client.22995 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:03.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.838+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3936466215 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595b88abda0 0x5595b8d47ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:03.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.838+0000 7f23aa59e740 4 client.22995 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:30:03.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.838+0000 7f23aa59e740 1 -- 172.21.15.53:0/3936466215 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5595b8c32020 con 0x5595b88abda0 2024-08-31T06:30:03.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.838+0000 7f23a15c4640 1 --2- 172.21.15.53:0/3936466215 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595b88abda0 0x5595b8d47ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:03.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.838+0000 7f23857fa640 10 client.22995 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:03.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.840+0000 7f23a15c4640 1 --2- 172.21.15.53:0/3936466215 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595b88abda0 0x5595b8d47ab0 crc :-1 s=READY pgs=581 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f133e1d945955eec server_cookie=8cd5ad288d622336 in_seq=0 out_seq=0 2024-08-31T06:30:03.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.841+0000 7f23857fa640 1 -- 172.21.15.53:0/3936466215 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8610 (crc 0 0 0) 0x5595b8c32020 con 0x5595b88abda0 2024-08-31T06:30:03.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.841+0000 7f23857fa640 10 client.22995 handle_command_reply: tid=0 2024-08-31T06:30:03.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 1 client.22995 shutdown 2024-08-31T06:30:03.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 1 -- 172.21.15.53:0/3936466215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 msgr2=0x5595b8cd12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:03.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3936466215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cd12d0 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f239405f040 tx=0x7f2394031f30 comp rx=0 tx=0).stop 2024-08-31T06:30:03.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 1 -- 172.21.15.53:0/3936466215 shutdown_connections 2024-08-31T06:30:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3936466215 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5595b88abda0 0x5595b8d47ab0 crc :-1 s=READY pgs=581 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3936466215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5595b8918070 0x5595b8ccccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23857fa640 0 client.22995 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3936466215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595b88f7390 0x5595b8ccc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 1 --2- 172.21.15.53:0/3936466215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5595b88ef1b0 0x5595b8cd12d0 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 1 -- 172.21.15.53:0/3936466215 >> 172.21.15.53:0/3936466215 conn(0x5595b890c460 msgr2=0x5595b8cca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 1 -- 172.21.15.53:0/3936466215 shutdown_connections 2024-08-31T06:30:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 1 -- 172.21.15.53:0/3936466215 wait complete. 2024-08-31T06:30:03.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.842+0000 7f23aa59e740 20 client.22995 trim_cache size 0 max 16384 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "a8c7f914-8c3b-4a6f-8f93-71d6ae7dd589": { 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:29:19.025262+0000", 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:30:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "857f8219-039c-44d2-8dd7-af494d80e735": { 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:26:48.510100+0000", 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:30:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:30:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:30:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:25:55.673122+0000", 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:30:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "e839581e-94c5-4714-a1a6-40730925f6b8": { 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:28:29.506188+0000", 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "cac6d546-f1c8-4203-803b-7c8d84c48507": { 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:27:34.520218+0000", 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:03.864 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:30:03.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 -- 172.21.15.53:0/1120580941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4da0 msgr2=0x7f23880b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:03.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4da0 0x7f23880b72b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x5595b8cbbf40 tx=0x7f2398009310 comp rx=0 tx=0).stop 2024-08-31T06:30:03.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 -- 172.21.15.53:0/1120580941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239c104750 msgr2=0x7f239c103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:03.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239c104750 0x7f239c103ec0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f239800e9c0 tx=0x7f239800ee80 comp rx=0 tx=0).stop 2024-08-31T06:30:03.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 -- 172.21.15.53:0/1120580941 shutdown_connections 2024-08-31T06:30:03.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f23880b4da0 0x7f23880b72b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f239c10dbb0 0x7f239c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f239c1050a0 0x7f239c1024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 --2- 172.21.15.53:0/1120580941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f239c104750 0x7f239c103ec0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:03.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 -- 172.21.15.53:0/1120580941 >> 172.21.15.53:0/1120580941 conn(0x7f239c0794d0 msgr2=0x7f239c100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:03.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 -- 172.21.15.53:0/1120580941 shutdown_connections 2024-08-31T06:30:03.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:03.844+0000 7f23a4029640 1 -- 172.21.15.53:0/1120580941 wait complete. 2024-08-31T06:30:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:03 smithi153 ceph-mon[22320]: pgmap v1114: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 324 op/s 2024-08-31T06:30:04.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:03 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/4118252891' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:04.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:03 smithi053 ceph-mon[18924]: pgmap v1114: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 324 op/s 2024-08-31T06:30:04.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:03 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/4118252891' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:03 smithi130 ceph-mon[22266]: pgmap v1114: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 324 op/s 2024-08-31T06:30:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:03 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/4118252891' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:04.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 75768 5.60 MB/sec execute 592 sec latency 110.992 ms 2024-08-31T06:30:05.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 75921 5.62 MB/sec execute 593 sec latency 106.799 ms 2024-08-31T06:30:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.168+0000 7f30b9070640 1 -- 172.21.15.53:0/3490587370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b4109cc0 msgr2=0x7f30b410a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.168+0000 7f30b9070640 1 --2- 172.21.15.53:0/3490587370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b4109cc0 0x7f30b410a0d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009860 tx=0x7f30a402a340 comp rx=0 tx=0).stop 2024-08-31T06:30:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.168+0000 7f30b9070640 1 -- 172.21.15.53:0/3490587370 shutdown_connections 2024-08-31T06:30:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.168+0000 7f30b9070640 1 --2- 172.21.15.53:0/3490587370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b410ff40 0x7f30b4116770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.168+0000 7f30b9070640 1 --2- 172.21.15.53:0/3490587370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b410f5f0 0x7f30b410fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.168+0000 7f30b9070640 1 --2- 172.21.15.53:0/3490587370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b4109cc0 0x7f30b410a0d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.168+0000 7f30b9070640 1 -- 172.21.15.53:0/3490587370 >> 172.21.15.53:0/3490587370 conn(0x7f30b4079390 msgr2=0x7f30b4107f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.168+0000 7f30b9070640 1 -- 172.21.15.53:0/3490587370 shutdown_connections 2024-08-31T06:30:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.169+0000 7f30b9070640 1 -- 172.21.15.53:0/3490587370 wait complete. 2024-08-31T06:30:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.170+0000 7f30b9070640 1 Processor -- start 2024-08-31T06:30:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.170+0000 7f30b9070640 1 -- start start 2024-08-31T06:30:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.170+0000 7f30b9070640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b410f5f0 0x7f30b40748a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.170+0000 7f30b9070640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b410ff40 0x7f30b4074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.170+0000 7f30b9070640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b406dc70 0x7f30b406e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.170+0000 7f30b9070640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30b4119b00 con 0x7f30b406dc70 2024-08-31T06:30:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.170+0000 7f30b9070640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f30b4119980 con 0x7f30b410ff40 2024-08-31T06:30:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.170+0000 7f30b9070640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30b4119c80 con 0x7f30b410f5f0 2024-08-31T06:30:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.171+0000 7f30b359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b406dc70 0x7f30b406e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.171+0000 7f30b359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b406dc70 0x7f30b406e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60692/0 (socket says 172.21.15.53:60692) 2024-08-31T06:30:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.171+0000 7f30b359e640 1 -- 172.21.15.53:0/2821624041 learned_addr learned my addr 172.21.15.53:0/2821624041 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.172+0000 7f30b259c640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b410ff40 0x7f30b4074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.172+0000 7f30b259c640 1 -- 172.21.15.53:0/2821624041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b410f5f0 msgr2=0x7f30b40748a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.172+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b410f5f0 0x7f30b40748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.172+0000 7f30b259c640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b410f5f0 0x7f30b40748a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.172+0000 7f30b259c640 1 -- 172.21.15.53:0/2821624041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b406dc70 msgr2=0x7f30b406e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.172+0000 7f30b259c640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b406dc70 0x7f30b406e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.172+0000 7f30b259c640 1 -- 172.21.15.53:0/2821624041 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b4073440 con 0x7f30b410ff40 2024-08-31T06:30:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.173+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b410f5f0 0x7f30b40748a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.173+0000 7f30b259c640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b410ff40 0x7f30b4074e40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f30b406c460 tx=0x7f30ac00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.173+0000 7f309bfff640 1 -- 172.21.15.53:0/2821624041 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac01b070 con 0x7f30b410ff40 2024-08-31T06:30:06.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:05 smithi153 ceph-mon[22320]: pgmap v1115: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2024-08-31T06:30:06.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.173+0000 7f30b9070640 1 -- 172.21.15.53:0/2821624041 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b4073730 con 0x7f30b410ff40 2024-08-31T06:30:06.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.173+0000 7f30b9070640 1 -- 172.21.15.53:0/2821624041 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b4073cd0 con 0x7f30b410ff40 2024-08-31T06:30:06.178 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.176+0000 7f309bfff640 1 -- 172.21.15.53:0/2821624041 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30ac00ba00 con 0x7f30b410ff40 2024-08-31T06:30:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.176+0000 7f309bfff640 1 -- 172.21.15.53:0/2821624041 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac016b50 con 0x7f30b410ff40 2024-08-31T06:30:06.180 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.179+0000 7f30bffdc740 1 Processor -- start 2024-08-31T06:30:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.179+0000 7f30bffdc740 1 -- start start 2024-08-31T06:30:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.182+0000 7f309bfff640 1 -- 172.21.15.53:0/2821624041 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f30ac01e070 con 0x7f30b410ff40 2024-08-31T06:30:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.182+0000 7f30bffdc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ab0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.182+0000 7f30bffdc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 0x562395ab1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.182+0000 7f30bffdc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956ec4d0 0x562395ab1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.182+0000 7f30bffdc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562395a26000 con 0x5623956ec4d0 2024-08-31T06:30:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.182+0000 7f30bffdc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562395a15590 con 0x56239570d1b0 2024-08-31T06:30:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.182+0000 7f30bffdc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562395a19540 con 0x5623956e42f0 2024-08-31T06:30:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.183+0000 7f30b359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ab0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.183+0000 7f30b359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ab0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:44400/0 (socket says 172.21.15.53:44400) 2024-08-31T06:30:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.183+0000 7f30b359e640 1 -- 172.21.15.53:0/2655022131 learned_addr learned my addr 172.21.15.53:0/2655022131 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.183+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/2655022131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 0x562395ab1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.183+0000 7f30b359e640 1 -- 172.21.15.53:0/2655022131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 msgr2=0x562395ab1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.183+0000 7f30b359e640 1 --2- 172.21.15.53:0/2655022131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 0x562395ab1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.183+0000 7f30b359e640 1 -- 172.21.15.53:0/2655022131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956ec4d0 msgr2=0x562395ab1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.183+0000 7f30b359e640 1 --2- 172.21.15.53:0/2655022131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956ec4d0 0x562395ab1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.183+0000 7f30b359e640 1 -- 172.21.15.53:0/2655022131 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562395778790 con 0x56239570d1b0 2024-08-31T06:30:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.183+0000 7f30b359e640 1 --2- 172.21.15.53:0/2655022131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ab0cc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009d10 tx=0x7f30a80117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baa9e71fe664fbe9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.184+0000 7f30997fa640 1 -- 172.21.15.53:0/2655022131 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a801b470 con 0x56239570d1b0 2024-08-31T06:30:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.184+0000 7f30997fa640 1 -- 172.21.15.53:0/2655022131 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30a8016070 con 0x56239570d1b0 2024-08-31T06:30:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.184+0000 7f309bfff640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4d60 0x7f309c0b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.184+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4d60 0x7f309c0b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.185+0000 7f309bfff640 1 -- 172.21.15.53:0/2821624041 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7f30ac0e54e0 con 0x7f30b410ff40 2024-08-31T06:30:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.185+0000 7f30997fa640 1 -- 172.21.15.53:0/2655022131 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8012910 con 0x56239570d1b0 2024-08-31T06:30:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.185+0000 7f30bffdc740 1 -- 172.21.15.53:0/2655022131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 msgr2=0x562395ab0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.185+0000 7f30bffdc740 1 --2- 172.21.15.53:0/2655022131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ab0cc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009d10 tx=0x7f30a80117b0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.185+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4d60 0x7f309c0b7270 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f30a4000c00 tx=0x7f30a402a840 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.186+0000 7f30bffdc740 1 -- 172.21.15.53:0/2655022131 shutdown_connections 2024-08-31T06:30:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.186+0000 7f30bffdc740 1 --2- 172.21.15.53:0/2655022131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956ec4d0 0x562395ab1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.186+0000 7f30bffdc740 1 --2- 172.21.15.53:0/2655022131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 0x562395ab1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.186+0000 7f30bffdc740 1 --2- 172.21.15.53:0/2655022131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ab0cc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.186+0000 7f30bffdc740 1 -- 172.21.15.53:0/2655022131 >> 172.21.15.53:0/2655022131 conn(0x562395701300 msgr2=0x562395aaebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.186+0000 7f30bffdc740 1 -- 172.21.15.53:0/2655022131 shutdown_connections 2024-08-31T06:30:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.186+0000 7f30bffdc740 1 -- 172.21.15.53:0/2655022131 wait complete. 2024-08-31T06:30:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.187+0000 7f30bffdc740 1 -- start start 2024-08-31T06:30:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.187+0000 7f30bffdc740 1 Processor -- start 2024-08-31T06:30:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30bffdc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 0x562395abc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30bffdc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956ec4d0 0x562395abced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30bffdc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ac8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30bffdc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56239594eab0 con 0x5623956ec4d0 2024-08-31T06:30:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30bffdc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56239599c680 con 0x56239570d1b0 2024-08-31T06:30:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30bffdc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562395abf490 con 0x5623956e42f0 2024-08-31T06:30:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30bffdc740 10 client.0 _ll_register_callbacks cb 0x562395724a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30b2d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 0x562395abc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30b2d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 0x562395abc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57642/0 (socket says 172.21.15.53:57642) 2024-08-31T06:30:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30b2d9d640 1 -- 172.21.15.53:0/992959396 learned_addr learned my addr 172.21.15.53:0/992959396 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30b259c640 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956ec4d0 0x562395abced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.188+0000 7f30b359e640 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ac8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.189+0000 7f30b2d9d640 1 -- 172.21.15.53:0/992959396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 msgr2=0x562395ac8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:06.192 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.189+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ac8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.189+0000 7f30b2d9d640 1 -- 172.21.15.53:0/992959396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956ec4d0 msgr2=0x562395abced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.189+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956ec4d0 0x562395abced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.189+0000 7f30b2d9d640 1 -- 172.21.15.53:0/992959396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623957f1620 con 0x5623956e42f0 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.189+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 0x562395abc910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f30a4034000 tx=0x7f30a402a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52423c392bf7ee73 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.189+0000 7f3096ff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.189+0000 7f3096ff5640 1 -- 172.21.15.53:0/992959396 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4045040 con 0x5623956e42f0 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.189+0000 7f30bffdc740 1 -- 172.21.15.53:0/992959396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30a8016070 con 0x5623956e42f0 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.189+0000 7f3096ff5640 1 -- 172.21.15.53:0/992959396 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7f30a4004300 con 0x5623956e42f0 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.189+0000 7f3096ff5640 1 -- 172.21.15.53:0/992959396 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f30a4037040 con 0x5623956e42f0 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.190+0000 7f30bffdc740 10 client.31621 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.190+0000 7f30bffdc740 1 -- 172.21.15.53:0/992959396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x562395acb680 con 0x5623956e42f0 2024-08-31T06:30:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.190+0000 7f3096ff5640 1 -- 172.21.15.53:0/992959396 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30a404e070 con 0x5623956e42f0 2024-08-31T06:30:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.190+0000 7f3096ff5640 1 -- 172.21.15.53:0/992959396 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f30a403e510 con 0x5623956e42f0 2024-08-31T06:30:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.190+0000 7f30bffdc740 10 client.31621 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.190+0000 7f30bffdc740 10 client.31621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.190+0000 7f30bffdc740 20 client.31621 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.190+0000 7f30bffdc740 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623956cbd80 0x562395acf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.190+0000 7f30bffdc740 4 client.31621 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.191+0000 7f30bffdc740 1 -- 172.21.15.53:0/992959396 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f30a8016070 con 0x5623956cbd80 2024-08-31T06:30:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.191+0000 7f30b259c640 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623956cbd80 0x562395acf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.191+0000 7f30b259c640 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623956cbd80 0x562395acf010 crc :-1 s=READY pgs=582 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcfcfa61154313bb server_cookie=6657b3d5f6622f15 in_seq=0 out_seq=0 2024-08-31T06:30:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.191+0000 7f3096ff5640 10 client.31621 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.192+0000 7f3096ff5640 1 -- 172.21.15.53:0/992959396 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f30a8016070 con 0x5623956cbd80 2024-08-31T06:30:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.192+0000 7f3096ff5640 10 client.31621 handle_command_reply: tid=0 2024-08-31T06:30:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.192+0000 7f30bffdc740 1 client.31621 shutdown 2024-08-31T06:30:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.193+0000 7f30bffdc740 1 -- 172.21.15.53:0/992959396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 msgr2=0x562395abc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.193+0000 7f30bffdc740 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 0x562395abc910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f30a4034000 tx=0x7f30a402a340 comp rx=0 tx=0).stop 2024-08-31T06:30:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.193+0000 7f30bffdc740 1 -- 172.21.15.53:0/992959396 shutdown_connections 2024-08-31T06:30:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.193+0000 7f30bffdc740 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623956cbd80 0x562395acf010 crc :-1 s=READY pgs=582 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.193+0000 7f30bffdc740 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ac8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.193+0000 7f30bffdc740 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956ec4d0 0x562395abced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.193+0000 7f30bffdc740 1 --2- 172.21.15.53:0/992959396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956e42f0 0x562395abc910 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.194+0000 7f30bffdc740 1 -- 172.21.15.53:0/992959396 >> 172.21.15.53:0/992959396 conn(0x562395701300 msgr2=0x562395ab1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.194+0000 7f3096ff5640 0 client.31621 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.194+0000 7f30bffdc740 1 -- 172.21.15.53:0/992959396 shutdown_connections 2024-08-31T06:30:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.194+0000 7f30bffdc740 1 -- 172.21.15.53:0/992959396 wait complete. 2024-08-31T06:30:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.194+0000 7f30bffdc740 20 client.31621 trim_cache size 0 max 16384 2024-08-31T06:30:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.214+0000 7f30bffdc740 1 Processor -- start 2024-08-31T06:30:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.215+0000 7f30bffdc740 1 -- start start 2024-08-31T06:30:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.215+0000 7f30bffdc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956e42f0 0x562395ab2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.215+0000 7f30bffdc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 0x562395ab5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.215+0000 7f30b2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956e42f0 0x562395ab2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.215+0000 7f30b2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956e42f0 0x562395ab2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60708/0 (socket says 172.21.15.53:60708) 2024-08-31T06:30:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.215+0000 7f30b2d9d640 1 -- 172.21.15.53:0/3929798326 learned_addr learned my addr 172.21.15.53:0/3929798326 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.215+0000 7f30bffdc740 1 --2- 172.21.15.53:0/3929798326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ab62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.216+0000 7f30bffdc740 1 -- 172.21.15.53:0/3929798326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30a000e970 con 0x5623956e42f0 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.216+0000 7f30bffdc740 1 -- 172.21.15.53:0/3929798326 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f30a0010570 con 0x56239570d1b0 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.216+0000 7f30bffdc740 1 -- 172.21.15.53:0/3929798326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30a000f040 con 0x5623956ec4d0 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.216+0000 7f30b259c640 1 --2- 172.21.15.53:0/3929798326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 0x562395ab5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.216+0000 7f30b359e640 1 --2- 172.21.15.53:0/3929798326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ab62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.216+0000 7f30b2d9d640 1 -- 172.21.15.53:0/3929798326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 msgr2=0x562395ab5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.216+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/3929798326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 0x562395ab5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.216+0000 7f30b2d9d640 1 -- 172.21.15.53:0/3929798326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 msgr2=0x562395ab62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.216+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/3929798326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ab62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.216+0000 7f30b2d9d640 1 -- 172.21.15.53:0/3929798326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562395ab2fc0 con 0x5623956e42f0 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.216+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/3929798326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956e42f0 0x562395ab2400 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f30a403eb70 tx=0x7f30a4005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968c055a2b3941a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.217+0000 7f3098ff9640 1 -- 172.21.15.53:0/3929798326 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4060070 con 0x5623956e42f0 2024-08-31T06:30:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.217+0000 7f3098ff9640 1 -- 172.21.15.53:0/3929798326 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30a404e040 con 0x5623956e42f0 2024-08-31T06:30:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.217+0000 7f3098ff9640 1 -- 172.21.15.53:0/3929798326 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4045070 con 0x5623956e42f0 2024-08-31T06:30:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.218+0000 7f30bffdc740 1 -- 172.21.15.53:0/3929798326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956e42f0 msgr2=0x562395ab2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.218+0000 7f30bffdc740 1 --2- 172.21.15.53:0/3929798326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956e42f0 0x562395ab2400 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f30a403eb70 tx=0x7f30a4005d30 comp rx=0 tx=0).stop 2024-08-31T06:30:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.218+0000 7f30bffdc740 1 -- 172.21.15.53:0/3929798326 shutdown_connections 2024-08-31T06:30:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.218+0000 7f30bffdc740 1 --2- 172.21.15.53:0/3929798326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56239570d1b0 0x562395ab62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.218+0000 7f30bffdc740 1 --2- 172.21.15.53:0/3929798326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 0x562395ab5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.218+0000 7f30bffdc740 1 --2- 172.21.15.53:0/3929798326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623956e42f0 0x562395ab2400 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.218+0000 7f30bffdc740 1 -- 172.21.15.53:0/3929798326 >> 172.21.15.53:0/3929798326 conn(0x562395701300 msgr2=0x562395ab1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.218+0000 7f30bffdc740 1 -- 172.21.15.53:0/3929798326 shutdown_connections 2024-08-31T06:30:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.218+0000 7f30bffdc740 1 -- 172.21.15.53:0/3929798326 wait complete. 2024-08-31T06:30:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.218+0000 7f30bffdc740 1 -- start start 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30bffdc740 1 Processor -- start 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30bffdc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623956e42f0 0x562395ac2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30bffdc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 0x562395ac25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30bffdc740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56239570d1b0 0x562395b319a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30bffdc740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30a000fea0 con 0x56239570d1b0 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30bffdc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f30a000f710 con 0x5623956e42f0 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30bffdc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f30a000c970 con 0x5623956ec4d0 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30bffdc740 10 client.0 _ll_register_callbacks cb 0x7f30a4042040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30b2d9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623956e42f0 0x562395ac2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30b359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56239570d1b0 0x562395b319a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30b259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 0x562395ac25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30b259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 0x562395ac25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57654/0 (socket says 172.21.15.53:57654) 2024-08-31T06:30:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.219+0000 7f30b259c640 1 -- 172.21.15.53:0/1867339176 learned_addr learned my addr 172.21.15.53:0/1867339176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f30b359e640 1 -- 172.21.15.53:0/1867339176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 msgr2=0x562395ac25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f30b359e640 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 0x562395ac25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f30b359e640 1 -- 172.21.15.53:0/1867339176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623956e42f0 msgr2=0x562395ac2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f30b359e640 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623956e42f0 0x562395ac2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f30b359e640 1 -- 172.21.15.53:0/1867339176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562395b31fe0 con 0x56239570d1b0 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623956e42f0 0x562395ac2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f30b259c640 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 0x562395ac25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f30b359e640 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56239570d1b0 0x562395b319a0 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009ca0 tx=0x7f30a80056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5de9030162a516 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f3096ff5640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f3096ff5640 1 -- 172.21.15.53:0/1867339176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a802b070 con 0x56239570d1b0 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f3096ff5640 1 -- 172.21.15.53:0/1867339176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7f30a8004880 con 0x56239570d1b0 2024-08-31T06:30:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f30bffdc740 1 -- 172.21.15.53:0/1867339176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30a404e040 con 0x56239570d1b0 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f3096ff5640 1 -- 172.21.15.53:0/1867339176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f30a8004a80 con 0x56239570d1b0 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f30bffdc740 10 client.23010 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.220+0000 7f30bffdc740 1 -- 172.21.15.53:0/1867339176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x562395b39320 con 0x56239570d1b0 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.221+0000 7f3096ff5640 1 -- 172.21.15.53:0/1867339176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30a404e040 con 0x56239570d1b0 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.221+0000 7f3096ff5640 1 -- 172.21.15.53:0/1867339176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f30a802e020 con 0x56239570d1b0 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.221+0000 7f30bffdc740 10 client.23010 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.221+0000 7f30bffdc740 10 client.23010 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.221+0000 7f30bffdc740 20 client.23010 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.221+0000 7f30bffdc740 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623956a11c0 0x562395b3b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.221+0000 7f30bffdc740 4 client.23010 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.221+0000 7f30bffdc740 1 -- 172.21.15.53:0/1867339176 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562395a27f50 con 0x5623956a11c0 2024-08-31T06:30:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.221+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623956a11c0 0x562395b3b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.222+0000 7f3096ff5640 10 client.23010 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.222+0000 7f30b2d9d640 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623956a11c0 0x562395b3b770 crc :-1 s=READY pgs=583 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a320ee79818fd024 server_cookie=ba450af82c952197 in_seq=0 out_seq=0 2024-08-31T06:30:06.227 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:05 smithi053 ceph-mon[18924]: pgmap v1115: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2024-08-31T06:30:06.358 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f3096ff5640 1 -- 172.21.15.53:0/1867339176 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562395a27f50 con 0x5623956a11c0 2024-08-31T06:30:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f3096ff5640 10 client.23010 handle_command_reply: tid=0 2024-08-31T06:30:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 1 client.23010 shutdown 2024-08-31T06:30:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 1 -- 172.21.15.53:0/1867339176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56239570d1b0 msgr2=0x562395b319a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56239570d1b0 0x562395b319a0 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009ca0 tx=0x7f30a80056c0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 1 -- 172.21.15.53:0/1867339176 shutdown_connections 2024-08-31T06:30:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5623956a11c0 0x562395b3b770 crc :-1 s=READY pgs=583 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56239570d1b0 0x562395b319a0 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623956ec4d0 0x562395ac25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 1 --2- 172.21.15.53:0/1867339176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5623956e42f0 0x562395ac2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 1 -- 172.21.15.53:0/1867339176 >> 172.21.15.53:0/1867339176 conn(0x562395701300 msgr2=0x562395ab5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f3096ff5640 0 client.23010 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 1 -- 172.21.15.53:0/1867339176 shutdown_connections 2024-08-31T06:30:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 1 -- 172.21.15.53:0/1867339176 wait complete. 2024-08-31T06:30:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.353+0000 7f30bffdc740 20 client.23010 trim_cache size 0 max 16384 2024-08-31T06:30:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:30:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:30:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:30:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:30:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 -- 172.21.15.53:0/2821624041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4d60 msgr2=0x7f309c0b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4d60 0x7f309c0b7270 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f30a4000c00 tx=0x7f30a402a840 comp rx=0 tx=0).stop 2024-08-31T06:30:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 -- 172.21.15.53:0/2821624041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b410ff40 msgr2=0x7f30b4074e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b410ff40 0x7f30b4074e40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f30b406c460 tx=0x7f30ac00c800 comp rx=0 tx=0).stop 2024-08-31T06:30:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 -- 172.21.15.53:0/2821624041 shutdown_connections 2024-08-31T06:30:06.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f309c0b4d60 0x7f309c0b7270 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30b406dc70 0x7f30b406e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f30b410ff40 0x7f30b4074e40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 --2- 172.21.15.53:0/2821624041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30b410f5f0 0x7f30b40748a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:06.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 -- 172.21.15.53:0/2821624041 >> 172.21.15.53:0/2821624041 conn(0x7f30b4079390 msgr2=0x7f30b410d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:06.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 -- 172.21.15.53:0/2821624041 shutdown_connections 2024-08-31T06:30:06.362 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:06.354+0000 7f30b9070640 1 -- 172.21.15.53:0/2821624041 wait complete. 2024-08-31T06:30:06.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:05 smithi130 ceph-mon[22266]: pgmap v1115: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2024-08-31T06:30:06.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 76048 5.62 MB/sec execute 594 sec latency 193.846 ms 2024-08-31T06:30:07.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:06 smithi053 ceph-mon[18924]: osdmap e113: 12 total, 12 up, 12 in 2024-08-31T06:30:07.348 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:30:07.349 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:30:07.365 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db / --timeout 90 --expiration 131.3 --await-for 45.0' 2024-08-31T06:30:07.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db / --timeout 90 --expiration 131.3 --await-for 45.0 2024-08-31T06:30:07.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:06 smithi130 ceph-mon[22266]: osdmap e113: 12 total, 12 up, 12 in 2024-08-31T06:30:07.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 76161 5.62 MB/sec execute 595 sec latency 265.284 ms 2024-08-31T06:30:07.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:06 smithi153 ceph-mon[22320]: osdmap e113: 12 total, 12 up, 12 in 2024-08-31T06:30:07.723 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:08.012 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:08.138 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:07 smithi053 ceph-mon[18924]: pgmap v1117: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.6 MiB/s wr, 303 op/s 2024-08-31T06:30:08.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.292+0000 7f8cdc931640 1 -- 172.21.15.53:0/911375299 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4031800 con 0x7f8cd8103900 2024-08-31T06:30:08.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.293+0000 7f8cdfb97640 1 -- 172.21.15.53:0/911375299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8103900 msgr2=0x7f8cd8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:08.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.293+0000 7f8cdfb97640 1 --2- 172.21.15.53:0/911375299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8103900 0x7f8cd8103d10 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009900 tx=0x7f8cd402a410 comp rx=0 tx=0).stop 2024-08-31T06:30:08.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.293+0000 7f8cdfb97640 1 -- 172.21.15.53:0/911375299 shutdown_connections 2024-08-31T06:30:08.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.293+0000 7f8cdfb97640 1 --2- 172.21.15.53:0/911375299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8109b90 0x7f8cd81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.293+0000 7f8cdfb97640 1 --2- 172.21.15.53:0/911375299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd8109240 0x7f8cd8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.293+0000 7f8cdfb97640 1 --2- 172.21.15.53:0/911375299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8103900 0x7f8cd8103d10 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.293+0000 7f8cdfb97640 1 -- 172.21.15.53:0/911375299 >> 172.21.15.53:0/911375299 conn(0x7f8cd807b5f0 msgr2=0x7f8cd807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:08.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.294+0000 7f8cdfb97640 1 -- 172.21.15.53:0/911375299 shutdown_connections 2024-08-31T06:30:08.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.294+0000 7f8cdfb97640 1 -- 172.21.15.53:0/911375299 wait complete. 2024-08-31T06:30:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.294+0000 7f8cdfb97640 1 Processor -- start 2024-08-31T06:30:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.294+0000 7f8cdfb97640 1 -- start start 2024-08-31T06:30:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.295+0000 7f8cdfb97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8103900 0x7f8cd819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.295+0000 7f8cdfb97640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8109240 0x7f8cd819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.295+0000 7f8cdfb97640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd8109b90 0x7f8cd819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.295+0000 7f8cdfb97640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd8113700 con 0x7f8cd8103900 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.295+0000 7f8cdfb97640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd8113580 con 0x7f8cd8109b90 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.295+0000 7f8cdfb97640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd8113880 con 0x7f8cd8109240 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.295+0000 7f8cdd933640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8103900 0x7f8cd819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.295+0000 7f8cdd132640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8109240 0x7f8cd819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.295+0000 7f8cdd933640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8103900 0x7f8cd819a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60734/0 (socket says 172.21.15.53:60734) 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.295+0000 7f8cdd933640 1 -- 172.21.15.53:0/1853311115 learned_addr learned my addr 172.21.15.53:0/1853311115 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.296+0000 7f8cdd933640 1 -- 172.21.15.53:0/1853311115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8109240 msgr2=0x7f8cd819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.296+0000 7f8cdd933640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8109240 0x7f8cd819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.296+0000 7f8cdd933640 1 -- 172.21.15.53:0/1853311115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd8109b90 msgr2=0x7f8cd819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.296+0000 7f8cde134640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd8109b90 0x7f8cd819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.296+0000 7f8cdd933640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd8109b90 0x7f8cd819fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.296+0000 7f8cdd933640 1 -- 172.21.15.53:0/1853311115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd81a0140 con 0x7f8cd8103900 2024-08-31T06:30:08.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.296+0000 7f8cdd132640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8109240 0x7f8cd819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.296+0000 7f8cdd933640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8103900 0x7f8cd819a1d0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009230 tx=0x7f8cd40319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.296+0000 7f8cceffd640 1 -- 172.21.15.53:0/1853311115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd403f030 con 0x7f8cd8103900 2024-08-31T06:30:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.297+0000 7f8cceffd640 1 -- 172.21.15.53:0/1853311115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cd40043d0 con 0x7f8cd8103900 2024-08-31T06:30:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.297+0000 7f8cdfb97640 1 -- 172.21.15.53:0/1853311115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd81a03d0 con 0x7f8cd8103900 2024-08-31T06:30:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.297+0000 7f8cceffd640 1 -- 172.21.15.53:0/1853311115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4035070 con 0x7f8cd8103900 2024-08-31T06:30:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.297+0000 7f8cdfb97640 1 -- 172.21.15.53:0/1853311115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd81a6b90 con 0x7f8cd8103900 2024-08-31T06:30:08.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.298+0000 7f8cdfb97640 1 -- 172.21.15.53:0/1853311115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd8103d10 con 0x7f8cd8103900 2024-08-31T06:30:08.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.301+0000 7f8cceffd640 1 -- 172.21.15.53:0/1853311115 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8cd4042030 con 0x7f8cd8103900 2024-08-31T06:30:08.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.302+0000 7f8cceffd640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4d20 0x7f8cc40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.302+0000 7f8cdd132640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4d20 0x7f8cc40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.303+0000 7f8cdd132640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4d20 0x7f8cc40b7230 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8cd81062d0 tx=0x7f8cc8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:08.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.303+0000 7f8cceffd640 1 -- 172.21.15.53:0/1853311115 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7f8cd4105cd0 con 0x7f8cd8103900 2024-08-31T06:30:08.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.305+0000 7f8cceffd640 1 -- 172.21.15.53:0/1853311115 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8cd40cca70 con 0x7f8cd8103900 2024-08-31T06:30:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:07 smithi130 ceph-mon[22266]: pgmap v1117: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.6 MiB/s wr, 303 op/s 2024-08-31T06:30:08.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 76298 5.62 MB/sec execute 596 sec latency 128.979 ms 2024-08-31T06:30:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:07 smithi153 ceph-mon[22320]: pgmap v1117: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.6 MiB/s wr, 303 op/s 2024-08-31T06:30:08.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.633+0000 7f8cdfb97640 1 -- 172.21.15.53:0/1853311115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cd819b300 con 0x7f8cd8103900 2024-08-31T06:30:08.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.634+0000 7f8cceffd640 1 -- 172.21.15.53:0/1853311115 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+11992 (secure 0 0 0) 0x7f8cd40cc370 con 0x7f8cd8103900 2024-08-31T06:30:08.636 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:30:08.636 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":90,"btime":"2024-08-31T06:29:16:977675+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":90,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:29:16.408419+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:30:08.637 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 90 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 -- 172.21.15.53:0/1853311115 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4d20 msgr2=0x7f8cc40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4d20 0x7f8cc40b7230 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8cd81062d0 tx=0x7f8cc8005f90 comp rx=0 tx=0).stop 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 -- 172.21.15.53:0/1853311115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8103900 msgr2=0x7f8cd819a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8103900 0x7f8cd819a1d0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009230 tx=0x7f8cd40319a0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 -- 172.21.15.53:0/1853311115 shutdown_connections 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f8cc40b4d20 0x7f8cc40b7230 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cd8109b90 0x7f8cd819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cd8109240 0x7f8cd819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 --2- 172.21.15.53:0/1853311115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cd8103900 0x7f8cd819a1d0 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 -- 172.21.15.53:0/1853311115 >> 172.21.15.53:0/1853311115 conn(0x7f8cd807b5f0 msgr2=0x7f8cd81073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 -- 172.21.15.53:0/1853311115 shutdown_connections 2024-08-31T06:30:08.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.638+0000 7f8cdfb97640 1 -- 172.21.15.53:0/1853311115 wait complete. 2024-08-31T06:30:08.977 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:08 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1853311115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:08.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.970+0000 7f8624e84640 1 -- 172.21.15.53:0/4160172807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8620108ab0 msgr2=0x7f862010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:08.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.970+0000 7f8624e84640 1 --2- 172.21.15.53:0/4160172807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8620108ab0 0x7f862010f2e0 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f8618009ca0 tx=0x7f861802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.970+0000 7f8624e84640 1 -- 172.21.15.53:0/4160172807 shutdown_connections 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.970+0000 7f8624e84640 1 --2- 172.21.15.53:0/4160172807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8620108ab0 0x7f862010f2e0 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.970+0000 7f8624e84640 1 --2- 172.21.15.53:0/4160172807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8620108160 0x7f8620108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.970+0000 7f8624e84640 1 --2- 172.21.15.53:0/4160172807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8620102820 0x7f8620102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.970+0000 7f8624e84640 1 -- 172.21.15.53:0/4160172807 >> 172.21.15.53:0/4160172807 conn(0x7f8620079500 msgr2=0x7f8620079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.970+0000 7f8624e84640 1 -- 172.21.15.53:0/4160172807 shutdown_connections 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.970+0000 7f8624e84640 1 -- 172.21.15.53:0/4160172807 wait complete. 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f8624e84640 1 Processor -- start 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f8624e84640 1 -- start start 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f8624e84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8620102820 0x7f8620104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f8624e84640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8620108160 0x7f86201053e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f8624e84640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8620108ab0 0x7f8620105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f8624e84640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8620112630 con 0x7f8620102820 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f8624e84640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f86201124b0 con 0x7f8620108ab0 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f8624e84640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86201127b0 con 0x7f8620108160 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f861e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8620102820 0x7f8620104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f861e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8620102820 0x7f8620104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60748/0 (socket says 172.21.15.53:60748) 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f861e59c640 1 -- 172.21.15.53:0/1903037632 learned_addr learned my addr 172.21.15.53:0/1903037632 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.971+0000 7f861ed9d640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8620108ab0 0x7f8620105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f861dd9b640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8620108160 0x7f86201053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f861e59c640 1 -- 172.21.15.53:0/1903037632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8620108160 msgr2=0x7f86201053e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f861e59c640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8620108160 0x7f86201053e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f861e59c640 1 -- 172.21.15.53:0/1903037632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8620108ab0 msgr2=0x7f8620105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f861e59c640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8620108ab0 0x7f8620105920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f861e59c640 1 -- 172.21.15.53:0/1903037632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86201a8400 con 0x7f8620102820 2024-08-31T06:30:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f861e59c640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8620102820 0x7f8620104ea0 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f861000e9f0 tx=0x7f861000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f860f7fe640 1 -- 172.21.15.53:0/1903037632 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861000cd80 con 0x7f8620102820 2024-08-31T06:30:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f860f7fe640 1 -- 172.21.15.53:0/1903037632 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86100108c0 con 0x7f8620102820 2024-08-31T06:30:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f8624e84640 1 -- 172.21.15.53:0/1903037632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86201a86f0 con 0x7f8620102820 2024-08-31T06:30:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f860f7fe640 1 -- 172.21.15.53:0/1903037632 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86100187c0 con 0x7f8620102820 2024-08-31T06:30:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.972+0000 7f8624e84640 1 -- 172.21.15.53:0/1903037632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86201a8c80 con 0x7f8620102820 2024-08-31T06:30:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.975+0000 7f860f7fe640 1 -- 172.21.15.53:0/1903037632 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8610010430 con 0x7f8620102820 2024-08-31T06:30:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.975+0000 7f862b3f9740 1 Processor -- start 2024-08-31T06:30:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.976+0000 7f862b3f9740 1 -- start start 2024-08-31T06:30:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.976+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee326840 0x55e4ee6d64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.976+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6d69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.976+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6d6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.976+0000 7f862b3f9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee642330 con 0x55e4ee2fd980 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.976+0000 7f862b3f9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee6318c0 con 0x55e4ee326840 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.976+0000 7f862b3f9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee635870 con 0x55e4ee305b60 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.976+0000 7f861e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6d69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f861e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6d69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60764/0 (socket says 172.21.15.53:60764) 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f861e59c640 1 -- 172.21.15.53:0/2887986297 learned_addr learned my addr 172.21.15.53:0/2887986297 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f861dd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6d6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f861ed9d640 1 --2- 172.21.15.53:0/2887986297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee326840 0x55e4ee6d64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f860f7fe640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f86080b4d20 0x7f86080b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f861e59c640 1 -- 172.21.15.53:0/2887986297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 msgr2=0x55e4ee6d6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f861e59c640 1 --2- 172.21.15.53:0/2887986297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6d6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f861e59c640 1 -- 172.21.15.53:0/2887986297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee326840 msgr2=0x55e4ee6d64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f861e59c640 1 --2- 172.21.15.53:0/2887986297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee326840 0x55e4ee6d64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f861e59c640 1 -- 172.21.15.53:0/2887986297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ee5e9df0 con 0x55e4ee2fd980 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f861ed9d640 1 --2- 172.21.15.53:0/2887986297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee326840 0x55e4ee6d64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f860f7fe640 1 -- 172.21.15.53:0/1903037632 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7f86100e58a0 con 0x7f8620102820 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.977+0000 7f861ed9d640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f86080b4d20 0x7f86080b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.978+0000 7f861e59c640 1 --2- 172.21.15.53:0/2887986297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6d69e0 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f86100e2f10 tx=0x7f8610070a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd17b4c86a93c9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:08.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.978+0000 7f860cff9640 1 -- 172.21.15.53:0/2887986297 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86100ab940 con 0x55e4ee2fd980 2024-08-31T06:30:08.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.978+0000 7f860cff9640 1 -- 172.21.15.53:0/2887986297 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86100abb00 con 0x55e4ee2fd980 2024-08-31T06:30:08.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.978+0000 7f860cff9640 1 -- 172.21.15.53:0/2887986297 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610010720 con 0x55e4ee2fd980 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.979+0000 7f861ed9d640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f86080b4d20 0x7f86080b7230 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8618006010 tx=0x7f86180095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.979+0000 7f862b3f9740 1 -- 172.21.15.53:0/2887986297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 msgr2=0x55e4ee6d69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.979+0000 7f862b3f9740 1 --2- 172.21.15.53:0/2887986297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6d69e0 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f86100e2f10 tx=0x7f8610070a60 comp rx=0 tx=0).stop 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.980+0000 7f862b3f9740 1 -- 172.21.15.53:0/2887986297 shutdown_connections 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.980+0000 7f862b3f9740 1 --2- 172.21.15.53:0/2887986297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6d6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.980+0000 7f862b3f9740 1 --2- 172.21.15.53:0/2887986297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6d69e0 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.980+0000 7f862b3f9740 1 --2- 172.21.15.53:0/2887986297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee326840 0x55e4ee6d64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.980+0000 7f862b3f9740 1 -- 172.21.15.53:0/2887986297 >> 172.21.15.53:0/2887986297 conn(0x55e4ee31a990 msgr2=0x55e4ee6d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.980+0000 7f862b3f9740 1 -- 172.21.15.53:0/2887986297 shutdown_connections 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.980+0000 7f862b3f9740 1 -- 172.21.15.53:0/2887986297 wait complete. 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.980+0000 7f862b3f9740 1 -- start start 2024-08-31T06:30:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.981+0000 7f862b3f9740 1 Processor -- start 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.981+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.981+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee305b60 0x55e4ee6e20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.981+0000 7f861e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.981+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee326840 0x55e4ee6edf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.981+0000 7f861e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60780/0 (socket says 172.21.15.53:60780) 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.981+0000 7f862b3f9740 1 -- 172.21.15.53:0/1897243181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee4947a0 con 0x55e4ee2fd980 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.981+0000 7f861e59c640 1 -- 172.21.15.53:0/1897243181 learned_addr learned my addr 172.21.15.53:0/1897243181 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.981+0000 7f862b3f9740 1 -- 172.21.15.53:0/1897243181 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee5b8240 con 0x55e4ee305b60 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.981+0000 7f862b3f9740 1 -- 172.21.15.53:0/1897243181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee6e4c20 con 0x55e4ee326840 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.981+0000 7f862b3f9740 10 client.0 _ll_register_callbacks cb 0x55e4ee33e090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.982+0000 7f861ed9d640 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee326840 0x55e4ee6edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.982+0000 7f861e59c640 1 -- 172.21.15.53:0/1897243181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee326840 msgr2=0x55e4ee6edf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.982+0000 7f861e59c640 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee326840 0x55e4ee6edf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.982+0000 7f861e59c640 1 -- 172.21.15.53:0/1897243181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee305b60 msgr2=0x55e4ee6e20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.982+0000 7f861e59c640 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee305b60 0x55e4ee6e20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.982+0000 7f861e59c640 1 -- 172.21.15.53:0/1897243181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ee5ee2b0 con 0x55e4ee2fd980 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.982+0000 7f861e59c640 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e1ba0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f86100e21a0 tx=0x7f86100e2070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ee64e2aa8ac0bf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.982+0000 7f8605ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.982+0000 7f8605ffb640 1 -- 172.21.15.53:0/1897243181 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86100ab760 con 0x55e4ee2fd980 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.983+0000 7f8605ffb640 1 -- 172.21.15.53:0/1897243181 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7f8610010a70 con 0x55e4ee2fd980 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.983+0000 7f862b3f9740 1 -- 172.21.15.53:0/1897243181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86100abb00 con 0x55e4ee2fd980 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.983+0000 7f8605ffb640 1 -- 172.21.15.53:0/1897243181 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f8610010720 con 0x55e4ee2fd980 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.983+0000 7f862b3f9740 10 client.23028 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.983+0000 7f862b3f9740 1 -- 172.21.15.53:0/1897243181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x55e4ee3a0b90 con 0x55e4ee2fd980 2024-08-31T06:30:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.983+0000 7f8605ffb640 1 -- 172.21.15.53:0/1897243181 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86100abb00 con 0x55e4ee2fd980 2024-08-31T06:30:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.984+0000 7f8605ffb640 1 -- 172.21.15.53:0/1897243181 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f86100af030 con 0x55e4ee2fd980 2024-08-31T06:30:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.984+0000 7f862b3f9740 10 client.23028 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.984+0000 7f862b3f9740 10 client.23028 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:30:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.984+0000 7f862b3f9740 20 client.23028 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.984+0000 7f862b3f9740 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4ee2e51c0 0x55e4ee6f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.984+0000 7f862b3f9740 4 client.23028 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.984+0000 7f862b3f9740 1 -- 172.21.15.53:0/1897243181 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4ee644280 con 0x55e4ee2e51c0 2024-08-31T06:30:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.984+0000 7f861dd9b640 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4ee2e51c0 0x55e4ee6f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.985+0000 7f861dd9b640 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4ee2e51c0 0x55e4ee6f3a40 crc :-1 s=READY pgs=584 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60e6c9821bd57138 server_cookie=5f26888238ffa56c in_seq=0 out_seq=0 2024-08-31T06:30:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.985+0000 7f8605ffb640 10 client.23028 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:08.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f8605ffb640 1 -- 172.21.15.53:0/1897243181 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e4ee644280 con 0x55e4ee2e51c0 2024-08-31T06:30:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f8605ffb640 10 client.23028 handle_command_reply: tid=0 2024-08-31T06:30:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f862b3f9740 1 client.23028 shutdown 2024-08-31T06:30:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f862b3f9740 1 -- 172.21.15.53:0/1897243181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 msgr2=0x55e4ee6e1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f862b3f9740 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e1ba0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f86100e21a0 tx=0x7f86100e2070 comp rx=0 tx=0).stop 2024-08-31T06:30:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f862b3f9740 1 -- 172.21.15.53:0/1897243181 shutdown_connections 2024-08-31T06:30:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f862b3f9740 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4ee2e51c0 0x55e4ee6f3a40 crc :-1 s=READY pgs=584 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f862b3f9740 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee326840 0x55e4ee6edf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f862b3f9740 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee305b60 0x55e4ee6e20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f862b3f9740 1 --2- 172.21.15.53:0/1897243181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e1ba0 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f862b3f9740 1 -- 172.21.15.53:0/1897243181 >> 172.21.15.53:0/1897243181 conn(0x55e4ee31a990 msgr2=0x55e4ee6ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f8605ffb640 0 client.23028 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:08.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f862b3f9740 1 -- 172.21.15.53:0/1897243181 shutdown_connections 2024-08-31T06:30:08.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.986+0000 7f862b3f9740 1 -- 172.21.15.53:0/1897243181 wait complete. 2024-08-31T06:30:08.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:08.987+0000 7f862b3f9740 20 client.23028 trim_cache size 0 max 16384 2024-08-31T06:30:09.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f862b3f9740 1 Processor -- start 2024-08-31T06:30:09.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f862b3f9740 1 -- start start 2024-08-31T06:30:09.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:09.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6e3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:09.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6d7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:09.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f862b3f9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f86201ad3b0 con 0x55e4ee326840 2024-08-31T06:30:09.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f862b3f9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f86201aefb0 con 0x55e4ee2fd980 2024-08-31T06:30:09.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f862b3f9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86201ada80 con 0x55e4ee305b60 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f861ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6d7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f861ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6d7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60784/0 (socket says 172.21.15.53:60784) 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f861ed9d640 1 -- 172.21.15.53:0/71786394 learned_addr learned my addr 172.21.15.53:0/71786394 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f861e59c640 1 --2- 172.21.15.53:0/71786394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.012+0000 7f861dd9b640 1 --2- 172.21.15.53:0/71786394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6e3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.013+0000 7f861e59c640 1 -- 172.21.15.53:0/71786394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 msgr2=0x55e4ee6e3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.013+0000 7f861e59c640 1 --2- 172.21.15.53:0/71786394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6e3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.013+0000 7f861e59c640 1 -- 172.21.15.53:0/71786394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 msgr2=0x55e4ee6d7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.013+0000 7f861e59c640 1 --2- 172.21.15.53:0/71786394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6d7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.013+0000 7f861e59c640 1 -- 172.21.15.53:0/71786394 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ee6d8d30 con 0x55e4ee2fd980 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.013+0000 7f861ed9d640 1 --2- 172.21.15.53:0/71786394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6d7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.013+0000 7f861e59c640 1 --2- 172.21.15.53:0/71786394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e1fc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f86100b0850 tx=0x7f86100a7bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3971ee6067eb079e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:09.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.013+0000 7f8607fff640 1 -- 172.21.15.53:0/71786394 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86100ab940 con 0x55e4ee2fd980 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.013+0000 7f8607fff640 1 -- 172.21.15.53:0/71786394 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86100abb00 con 0x55e4ee2fd980 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.013+0000 7f8607fff640 1 -- 172.21.15.53:0/71786394 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86100ac250 con 0x55e4ee2fd980 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.014+0000 7f862b3f9740 1 -- 172.21.15.53:0/71786394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 msgr2=0x55e4ee6e1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.014+0000 7f862b3f9740 1 --2- 172.21.15.53:0/71786394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e1fc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f86100b0850 tx=0x7f86100a7bf0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.014+0000 7f862b3f9740 1 -- 172.21.15.53:0/71786394 shutdown_connections 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.014+0000 7f862b3f9740 1 --2- 172.21.15.53:0/71786394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6d7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.014+0000 7f862b3f9740 1 --2- 172.21.15.53:0/71786394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6e3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.014+0000 7f862b3f9740 1 --2- 172.21.15.53:0/71786394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e1fc0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.014+0000 7f862b3f9740 1 -- 172.21.15.53:0/71786394 >> 172.21.15.53:0/71786394 conn(0x55e4ee31a990 msgr2=0x55e4ee6d74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.014+0000 7f862b3f9740 1 -- 172.21.15.53:0/71786394 shutdown_connections 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.014+0000 7f862b3f9740 1 -- 172.21.15.53:0/71786394 wait complete. 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f862b3f9740 1 -- start start 2024-08-31T06:30:09.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f862b3f9740 1 Processor -- start 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f862b3f9740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f862b3f9740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f86201ae8e0 con 0x55e4ee326840 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f862b3f9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f86201ae150 con 0x55e4ee2fd980 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f862b3f9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86201ab3f0 con 0x55e4ee305b60 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f862b3f9740 10 client.0 _ll_register_callbacks cb 0x7f8614009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f861ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f861e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f861ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6e6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60794/0 (socket says 172.21.15.53:60794) 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f861ed9d640 1 -- 172.21.15.53:0/3317261830 learned_addr learned my addr 172.21.15.53:0/3317261830 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.015+0000 7f861dd9b640 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f861ed9d640 1 -- 172.21.15.53:0/3317261830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 msgr2=0x55e4ee6e69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f861ed9d640 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6e69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f861ed9d640 1 -- 172.21.15.53:0/3317261830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 msgr2=0x55e4ee6e6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f861ed9d640 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f861ed9d640 1 -- 172.21.15.53:0/3317261830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ee601d90 con 0x55e4ee326840 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f861dd9b640 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f861e59c640 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f861ed9d640 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6e6f00 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f8618005e30 tx=0x7f861802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9c4ac353700810 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f8605ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f8605ffb640 1 -- 172.21.15.53:0/3317261830 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618057060 con 0x55e4ee326840 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f862b3f9740 1 -- 172.21.15.53:0/3317261830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86100abb00 con 0x55e4ee326840 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f8605ffb640 1 -- 172.21.15.53:0/3317261830 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7f8618004240 con 0x55e4ee326840 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f8605ffb640 1 -- 172.21.15.53:0/3317261830 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f8618004440 con 0x55e4ee326840 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f862b3f9740 10 client.23034 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.016+0000 7f862b3f9740 1 -- 172.21.15.53:0/3317261830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x55e4ee75f380 con 0x55e4ee326840 2024-08-31T06:30:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.017+0000 7f8605ffb640 1 -- 172.21.15.53:0/3317261830 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86100abb00 con 0x55e4ee326840 2024-08-31T06:30:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.017+0000 7f8605ffb640 1 -- 172.21.15.53:0/3317261830 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f8618051070 con 0x55e4ee326840 2024-08-31T06:30:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.017+0000 7f862b3f9740 10 client.23034 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.017+0000 7f862b3f9740 10 client.23034 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:30:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.017+0000 7f862b3f9740 20 client.23034 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.017+0000 7f862b3f9740 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4ee2ba570 0x55e4ee761c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.017+0000 7f862b3f9740 4 client.23034 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.3, "await_for": 45.0}] 2024-08-31T06:30:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.017+0000 7f862b3f9740 1 -- 172.21.15.53:0/3317261830 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.3, "await_for": 45.0}) -- 0x55e4ee63fd20 con 0x55e4ee2ba570 2024-08-31T06:30:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.017+0000 7f861e59c640 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4ee2ba570 0x55e4ee761c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.018+0000 7f8605ffb640 10 client.23034 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.018+0000 7f861e59c640 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4ee2ba570 0x55e4ee761c10 crc :-1 s=READY pgs=585 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32de42d6f0740ea0 server_cookie=19ffae47da179522 in_seq=0 out_seq=0 2024-08-31T06:30:09.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:08 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1853311115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:09.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 76350 5.61 MB/sec execute 597 sec latency 491.549 ms 2024-08-31T06:30:09.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:08 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1853311115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:09.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.601+0000 7f8605ffb640 1 -- 172.21.15.53:0/3317261830 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e4ee63fd20 con 0x55e4ee2ba570 2024-08-31T06:30:09.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.601+0000 7f8605ffb640 10 client.23034 handle_command_reply: tid=0 2024-08-31T06:30:09.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.601+0000 7f862b3f9740 1 client.23034 shutdown 2024-08-31T06:30:09.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.601+0000 7f862b3f9740 1 -- 172.21.15.53:0/3317261830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 msgr2=0x55e4ee6e6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:09.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.602+0000 7f862b3f9740 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6e6f00 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f8618005e30 tx=0x7f861802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.602+0000 7f862b3f9740 1 -- 172.21.15.53:0/3317261830 shutdown_connections 2024-08-31T06:30:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.602+0000 7f862b3f9740 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55e4ee2ba570 0x55e4ee761c10 crc :-1 s=READY pgs=585 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.602+0000 7f862b3f9740 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee326840 0x55e4ee6e6f00 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.602+0000 7f8605ffb640 0 client.23034 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.602+0000 7f862b3f9740 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e4ee305b60 0x55e4ee6e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.602+0000 7f862b3f9740 1 --2- 172.21.15.53:0/3317261830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e4ee2fd980 0x55e4ee6e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.602+0000 7f862b3f9740 1 -- 172.21.15.53:0/3317261830 >> 172.21.15.53:0/3317261830 conn(0x55e4ee31a990 msgr2=0x55e4ee6e37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.602+0000 7f862b3f9740 1 -- 172.21.15.53:0/3317261830 shutdown_connections 2024-08-31T06:30:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.602+0000 7f862b3f9740 1 -- 172.21.15.53:0/3317261830 wait complete. 2024-08-31T06:30:09.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.603+0000 7f862b3f9740 20 client.23034 trim_cache size 0 max 16384 2024-08-31T06:30:09.605 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 90, 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 82, 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "5e6f3376": { 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 82, 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 131.3, 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "QUIESCED", 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:09.607 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:30:09.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.604+0000 7f8624e84640 1 -- 172.21.15.53:0/1903037632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f86080b4d20 msgr2=0x7f86080b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:09.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.604+0000 7f8624e84640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f86080b4d20 0x7f86080b7230 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8618006010 tx=0x7f86180095c0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.604+0000 7f8624e84640 1 -- 172.21.15.53:0/1903037632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8620102820 msgr2=0x7f8620104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.604+0000 7f8624e84640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8620102820 0x7f8620104ea0 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f861000e9f0 tx=0x7f861000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.605+0000 7f8624e84640 1 -- 172.21.15.53:0/1903037632 shutdown_connections 2024-08-31T06:30:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.605+0000 7f8624e84640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f86080b4d20 0x7f86080b7230 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.605+0000 7f8624e84640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8620108ab0 0x7f8620105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.605+0000 7f8624e84640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8620108160 0x7f86201053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.605+0000 7f8624e84640 1 --2- 172.21.15.53:0/1903037632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8620102820 0x7f8620104ea0 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.605+0000 7f8624e84640 1 -- 172.21.15.53:0/1903037632 >> 172.21.15.53:0/1903037632 conn(0x7f8620079500 msgr2=0x7f86200ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.606+0000 7f8624e84640 1 -- 172.21.15.53:0/1903037632 shutdown_connections 2024-08-31T06:30:09.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:09.606+0000 7f8624e84640 1 -- 172.21.15.53:0/1903037632 wait complete. 2024-08-31T06:30:10.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:09 smithi053 ceph-mon[18924]: pgmap v1118: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.2 MiB/s wr, 335 op/s 2024-08-31T06:30:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:09 smithi130 ceph-mon[22266]: pgmap v1118: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.2 MiB/s wr, 335 op/s 2024-08-31T06:30:10.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 76354 5.61 MB/sec execute 598 sec latency 1311.830 ms 2024-08-31T06:30:10.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:09 smithi153 ceph-mon[22320]: pgmap v1118: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.2 MiB/s wr, 335 op/s 2024-08-31T06:30:11.138 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:30:11.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 76354 5.60 MB/sec execute 599 sec latency 2311.860 ms 2024-08-31T06:30:11.597 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5e6f3376', quiesce took 9.9 seconds. Will release after: 1.4000000000000004 2024-08-31T06:30:11.672 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:12.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:11 smithi053 ceph-mon[18924]: pgmap v1119: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 376 op/s 2024-08-31T06:30:12.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.284+0000 7f3e029aa640 1 -- 172.21.15.53:0/4016695703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dfc108ac0 msgr2=0x7f3dfc10f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.284+0000 7f3e029aa640 1 --2- 172.21.15.53:0/4016695703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dfc108ac0 0x7f3dfc10f2f0 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009ca0 tx=0x7f3df402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.284+0000 7f3e029aa640 1 -- 172.21.15.53:0/4016695703 shutdown_connections 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.284+0000 7f3e029aa640 1 --2- 172.21.15.53:0/4016695703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dfc108ac0 0x7f3dfc10f2f0 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.284+0000 7f3e029aa640 1 --2- 172.21.15.53:0/4016695703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dfc108170 0x7f3dfc108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.284+0000 7f3e029aa640 1 --2- 172.21.15.53:0/4016695703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dfc102880 0x7f3dfc102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.284+0000 7f3e029aa640 1 -- 172.21.15.53:0/4016695703 >> 172.21.15.53:0/4016695703 conn(0x7f3dfc079500 msgr2=0x7f3dfc079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.284+0000 7f3e029aa640 1 -- 172.21.15.53:0/4016695703 shutdown_connections 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.284+0000 7f3e029aa640 1 -- 172.21.15.53:0/4016695703 wait complete. 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.285+0000 7f3e029aa640 1 Processor -- start 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.285+0000 7f3e029aa640 1 -- start start 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.285+0000 7f3e029aa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dfc102880 0x7f3dfc19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.285+0000 7f3e029aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dfc108170 0x7f3dfc19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.285+0000 7f3e029aa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dfc108ac0 0x7f3dfc19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.285+0000 7f3e029aa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc113810 con 0x7f3dfc108170 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.285+0000 7f3e029aa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc113690 con 0x7f3dfc108ac0 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.285+0000 7f3e029aa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc113990 con 0x7f3dfc102880 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3dfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dfc108170 0x7f3dfc19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3dfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dfc108170 0x7f3dfc19a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60810/0 (socket says 172.21.15.53:60810) 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3dfb7fe640 1 -- 172.21.15.53:0/1101792153 learned_addr learned my addr 172.21.15.53:0/1101792153 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dfc102880 0x7f3dfc19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3e00f47640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dfc108ac0 0x7f3dfc19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3dfb7fe640 1 -- 172.21.15.53:0/1101792153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dfc102880 msgr2=0x7f3dfc19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dfc102880 0x7f3dfc19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3dfb7fe640 1 -- 172.21.15.53:0/1101792153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dfc108ac0 msgr2=0x7f3dfc19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dfc108ac0 0x7f3dfc19fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3dfb7fe640 1 -- 172.21.15.53:0/1101792153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc1a01f0 con 0x7f3dfc108170 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dfc102880 0x7f3dfc19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dfc108170 0x7f3dfc19a820 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f3df000b450 tx=0x7f3df000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3df97fa640 1 -- 172.21.15.53:0/1101792153 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0015020 con 0x7f3dfc108170 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3e029aa640 1 -- 172.21.15.53:0/1101792153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dfc1a04e0 con 0x7f3dfc108170 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3df97fa640 1 -- 172.21.15.53:0/1101792153 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df0011d20 con 0x7f3dfc108170 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3df97fa640 1 -- 172.21.15.53:0/1101792153 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0010e10 con 0x7f3dfc108170 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.286+0000 7f3e029aa640 1 -- 172.21.15.53:0/1101792153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dfc1a6c40 con 0x7f3dfc108170 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.289+0000 7f3e08f1f740 1 Processor -- start 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.289+0000 7f3e08f1f740 1 -- start start 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.289+0000 7f3df97fa640 1 -- 172.21.15.53:0/1101792153 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3df0018020 con 0x7f3dfc108170 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.289+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f73d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.289+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f36f1b0 0x55850f73d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.289+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f377390 0x55850f73ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.289+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55850f6b4680 con 0x55850f377390 2024-08-31T06:30:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.289+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55850f6a3c10 con 0x55850f36f1b0 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.289+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55850f6a7bc0 con 0x55850f398070 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3dfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f377390 0x55850f73ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3e00f47640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f73d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3dfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f377390 0x55850f73ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60824/0 (socket says 172.21.15.53:60824) 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3e00f47640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f73d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:57754/0 (socket says 172.21.15.53:57754) 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3dfb7fe640 1 -- 172.21.15.53:0/3586127255 learned_addr learned my addr 172.21.15.53:0/3586127255 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/3586127255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f36f1b0 0x55850f73d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3dfb7fe640 1 -- 172.21.15.53:0/3586127255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 msgr2=0x55850f73d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/3586127255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f73d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3dfb7fe640 1 -- 172.21.15.53:0/3586127255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f36f1b0 msgr2=0x55850f73d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/3586127255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f36f1b0 0x55850f73d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3dfb7fe640 1 -- 172.21.15.53:0/3586127255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55850f403650 con 0x55850f377390 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3e00f47640 1 --2- 172.21.15.53:0/3586127255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f73d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/3586127255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f377390 0x55850f73ddd0 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f3df00e26c0 tx=0x7f3df00ed780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a23eb1b2fe5d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.290+0000 7f3df97fa640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3de40b4ca0 0x7f3de40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.291+0000 7f3de27fc640 1 -- 172.21.15.53:0/3586127255 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df00f8070 con 0x55850f377390 2024-08-31T06:30:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.291+0000 7f3e00f47640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3de40b4ca0 0x7f3de40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.291+0000 7f3de27fc640 1 -- 172.21.15.53:0/3586127255 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df00ab200 con 0x55850f377390 2024-08-31T06:30:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.291+0000 7f3de27fc640 1 -- 172.21.15.53:0/3586127255 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df00ab040 con 0x55850f377390 2024-08-31T06:30:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.291+0000 7f3df97fa640 1 -- 172.21.15.53:0/1101792153 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7f3df00e5050 con 0x7f3dfc108170 2024-08-31T06:30:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3586127255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f377390 msgr2=0x55850f73ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e00f47640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3de40b4ca0 0x7f3de40b71b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3df4031040 tx=0x7f3df4005c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/3586127255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f377390 0x55850f73ddd0 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f3df00e26c0 tx=0x7f3df00ed780 comp rx=0 tx=0).stop 2024-08-31T06:30:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3586127255 shutdown_connections 2024-08-31T06:30:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/3586127255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f377390 0x55850f73ddd0 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/3586127255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f36f1b0 0x55850f73d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/3586127255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f73d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3586127255 >> 172.21.15.53:0/3586127255 conn(0x55850f38c460 msgr2=0x55850f73b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3586127255 shutdown_connections 2024-08-31T06:30:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3586127255 wait complete. 2024-08-31T06:30:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e08f1f740 1 -- start start 2024-08-31T06:30:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.292+0000 7f3e08f1f740 1 Processor -- start 2024-08-31T06:30:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f36f1b0 0x55850f748a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f748f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f398070 0x55850f759230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55850f506700 con 0x55850f398070 2024-08-31T06:30:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55850f62a750 con 0x55850f377390 2024-08-31T06:30:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55850f74ff40 con 0x55850f36f1b0 2024-08-31T06:30:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e08f1f740 10 client.0 _ll_register_callbacks cb 0x55850f659e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e00f47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f398070 0x55850f759230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e00f47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f398070 0x55850f759230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60840/0 (socket says 172.21.15.53:60840) 2024-08-31T06:30:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3dfbfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f36f1b0 0x55850f748a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e00f47640 1 -- 172.21.15.53:0/1936649090 learned_addr learned my addr 172.21.15.53:0/1936649090 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f748f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e00f47640 1 -- 172.21.15.53:0/1936649090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f36f1b0 msgr2=0x55850f748a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e00f47640 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f36f1b0 0x55850f748a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e00f47640 1 -- 172.21.15.53:0/1936649090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 msgr2=0x55850f748f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e00f47640 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f748f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3e00f47640 1 -- 172.21.15.53:0/1936649090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55850f663900 con 0x55850f398070 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.293+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f36f1b0 0x55850f748a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.294+0000 7f3e00f47640 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f398070 0x55850f759230 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f3df4035000 tx=0x7f3df402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff581af6e5480874 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.294+0000 7f3ddb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.294+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/1936649090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4031570 con 0x55850f398070 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.294+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/1936649090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7f3df4004250 con 0x55850f398070 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.294+0000 7f3e08f1f740 1 -- 172.21.15.53:0/1936649090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df00ab200 con 0x55850f398070 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.294+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/1936649090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f3df4004450 con 0x55850f398070 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.294+0000 7f3e08f1f740 10 client.23046 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.294+0000 7f3e08f1f740 1 -- 172.21.15.53:0/1936649090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x55850f75bc60 con 0x55850f398070 2024-08-31T06:30:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.294+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/1936649090 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df00ab200 con 0x55850f398070 2024-08-31T06:30:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.294+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/1936649090 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f3df4051070 con 0x55850f398070 2024-08-31T06:30:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.294+0000 7f3e08f1f740 10 client.23046 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.295+0000 7f3e08f1f740 10 client.23046 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:30:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.295+0000 7f3e08f1f740 20 client.23046 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.295+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55850f3569f0 0x55850f75f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.295+0000 7f3e08f1f740 4 client.23046 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.295+0000 7f3e08f1f740 1 -- 172.21.15.53:0/1936649090 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55850f6b65d0 con 0x55850f3569f0 2024-08-31T06:30:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.295+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55850f3569f0 0x55850f75f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.295+0000 7f3ddb7fe640 10 client.23046 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:30:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.295+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55850f3569f0 0x55850f75f0e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9884498747dfffa8 server_cookie=c793dcfb5ad5aec2 in_seq=0 out_seq=0 2024-08-31T06:30:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.296+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/1936649090 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55850f6b65d0 con 0x55850f3569f0 2024-08-31T06:30:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.296+0000 7f3ddb7fe640 10 client.23046 handle_command_reply: tid=0 2024-08-31T06:30:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.296+0000 7f3e08f1f740 1 client.23046 shutdown 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3e08f1f740 1 -- 172.21.15.53:0/1936649090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f398070 msgr2=0x55850f759230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f398070 0x55850f759230 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f3df4035000 tx=0x7f3df402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3e08f1f740 1 -- 172.21.15.53:0/1936649090 shutdown_connections 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f398070 0x55850f759230 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f748f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55850f3569f0 0x55850f75f0e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/1936649090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f36f1b0 0x55850f748a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3ddb7fe640 0 client.23046 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3e08f1f740 1 -- 172.21.15.53:0/1936649090 >> 172.21.15.53:0/1936649090 conn(0x55850f38c460 msgr2=0x55850f7404e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3e08f1f740 1 -- 172.21.15.53:0/1936649090 shutdown_connections 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3e08f1f740 1 -- 172.21.15.53:0/1936649090 wait complete. 2024-08-31T06:30:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.297+0000 7f3e08f1f740 20 client.23046 trim_cache size 0 max 16384 2024-08-31T06:30:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.310+0000 7f3e08f1f740 1 Processor -- start 2024-08-31T06:30:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.310+0000 7f3e08f1f740 1 -- start start 2024-08-31T06:30:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.310+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f73ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.310+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f74a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.310+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f759130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.310+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1ad420 con 0x55850f36f1b0 2024-08-31T06:30:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.310+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1af020 con 0x55850f377390 2024-08-31T06:30:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.310+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1adaf0 con 0x55850f398070 2024-08-31T06:30:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3dfbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f73ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3dfbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f73ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60852/0 (socket says 172.21.15.53:60852) 2024-08-31T06:30:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3dfbfff640 1 -- 172.21.15.53:0/2302348754 learned_addr learned my addr 172.21.15.53:0/2302348754 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/2302348754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f74a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3e00f47640 1 --2- 172.21.15.53:0/2302348754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f759130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3dfbfff640 1 -- 172.21.15.53:0/2302348754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 msgr2=0x55850f759130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:12.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/2302348754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f759130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3dfbfff640 1 -- 172.21.15.53:0/2302348754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 msgr2=0x55850f74a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:12.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/2302348754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f74a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3dfbfff640 1 -- 172.21.15.53:0/2302348754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55850f746f20 con 0x55850f36f1b0 2024-08-31T06:30:12.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/2302348754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f74a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:12.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/2302348754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f73ed40 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f3dec007df0 tx=0x7f3dec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca0ed8ea0163df3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:12.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3de1ffb640 1 -- 172.21.15.53:0/2302348754 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec020070 con 0x55850f36f1b0 2024-08-31T06:30:12.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3de1ffb640 1 -- 172.21.15.53:0/2302348754 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dec015e00 con 0x55850f36f1b0 2024-08-31T06:30:12.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.311+0000 7f3de1ffb640 1 -- 172.21.15.53:0/2302348754 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec0235c0 con 0x55850f36f1b0 2024-08-31T06:30:12.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.312+0000 7f3e08f1f740 1 -- 172.21.15.53:0/2302348754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 msgr2=0x55850f73ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:12.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.312+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/2302348754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f73ed40 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f3dec007df0 tx=0x7f3dec008040 comp rx=0 tx=0).stop 2024-08-31T06:30:12.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.312+0000 7f3e08f1f740 1 -- 172.21.15.53:0/2302348754 shutdown_connections 2024-08-31T06:30:12.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.312+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/2302348754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f759130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.312+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/2302348754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f74a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.312+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/2302348754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f73ed40 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.312+0000 7f3e08f1f740 1 -- 172.21.15.53:0/2302348754 >> 172.21.15.53:0/2302348754 conn(0x55850f38c460 msgr2=0x55850f749f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:12.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.312+0000 7f3e08f1f740 1 -- 172.21.15.53:0/2302348754 shutdown_connections 2024-08-31T06:30:12.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.312+0000 7f3e08f1f740 1 -- 172.21.15.53:0/2302348754 wait complete. 2024-08-31T06:30:12.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3e08f1f740 1 -- start start 2024-08-31T06:30:12.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3e08f1f740 1 Processor -- start 2024-08-31T06:30:12.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f751270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f7517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3e08f1f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f751cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1ae950 con 0x55850f36f1b0 2024-08-31T06:30:12.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1ae1c0 con 0x55850f377390 2024-08-31T06:30:12.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3e08f1f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1ab420 con 0x55850f398070 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3dfbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f751270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3dfbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f751270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60862/0 (socket says 172.21.15.53:60862) 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3e08f1f740 10 client.0 _ll_register_callbacks cb 0x7f3df4009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3dfbfff640 1 -- 172.21.15.53:0/3779237833 learned_addr learned my addr 172.21.15.53:0/3779237833 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3e00f47640 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f751cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.313+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f7517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3dfbfff640 1 -- 172.21.15.53:0/3779237833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 msgr2=0x55850f751cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f751cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3dfbfff640 1 -- 172.21.15.53:0/3779237833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 msgr2=0x55850f7517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f7517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3dfbfff640 1 -- 172.21.15.53:0/3779237833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55850f7c8ba0 con 0x55850f36f1b0 2024-08-31T06:30:12.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3dfbfff640 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f751270 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0149e0 tx=0x7f3dec014a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b53d1ccca9edd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:12.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3ddb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:12.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/3779237833 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec029070 con 0x55850f36f1b0 2024-08-31T06:30:12.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/3779237833 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7f3dec014e40 con 0x55850f36f1b0 2024-08-31T06:30:12.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3779237833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dec015e00 con 0x55850f36f1b0 2024-08-31T06:30:12.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/3779237833 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f3dec020070 con 0x55850f36f1b0 2024-08-31T06:30:12.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3e08f1f740 10 client.23052 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:12.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3779237833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x55850f7c9e50 con 0x55850f36f1b0 2024-08-31T06:30:12.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.314+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/3779237833 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dec015e00 con 0x55850f36f1b0 2024-08-31T06:30:12.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.315+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/3779237833 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f3dec025680 con 0x55850f36f1b0 2024-08-31T06:30:12.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.315+0000 7f3e08f1f740 10 client.23052 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:12.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.315+0000 7f3e08f1f740 10 client.23052 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:30:12.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.315+0000 7f3e08f1f740 20 client.23052 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:12.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.315+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55850f32bda0 0x55850f7cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:12.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.315+0000 7f3e08f1f740 4 client.23052 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:30:12.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.315+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3779237833 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55850f6b2070 con 0x55850f32bda0 2024-08-31T06:30:12.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.315+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55850f32bda0 0x55850f7cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:12.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.315+0000 7f3dfb7fe640 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55850f32bda0 0x55850f7cc5c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=352f881732621726 server_cookie=3654c23513e3040 in_seq=0 out_seq=0 2024-08-31T06:30:12.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.315+0000 7f3ddb7fe640 10 client.23052 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:30:12.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3ddb7fe640 1 -- 172.21.15.53:0/3779237833 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55850f6b2070 con 0x55850f32bda0 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3ddb7fe640 10 client.23052 handle_command_reply: tid=0 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 1 client.23052 shutdown 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3779237833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 msgr2=0x55850f751270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f751270 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0149e0 tx=0x7f3dec014a10 comp rx=0 tx=0).stop 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3779237833 shutdown_connections 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55850f32bda0 0x55850f7cc5c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55850f398070 0x55850f751cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55850f377390 0x55850f7517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3ddb7fe640 0 client.23052 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 1 --2- 172.21.15.53:0/3779237833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55850f36f1b0 0x55850f751270 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3779237833 >> 172.21.15.53:0/3779237833 conn(0x55850f38c460 msgr2=0x55850f74a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3779237833 shutdown_connections 2024-08-31T06:30:12.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 1 -- 172.21.15.53:0/3779237833 wait complete. 2024-08-31T06:30:12.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e08f1f740 20 client.23052 trim_cache size 0 max 16384 2024-08-31T06:30:12.325 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:30:12.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e029aa640 1 -- 172.21.15.53:0/1101792153 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3de40b4ca0 msgr2=0x7f3de40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:12.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e029aa640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3de40b4ca0 0x7f3de40b71b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3df4031040 tx=0x7f3df4005c30 comp rx=0 tx=0).stop 2024-08-31T06:30:12.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e029aa640 1 -- 172.21.15.53:0/1101792153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dfc108170 msgr2=0x7f3dfc19a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:12.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.316+0000 7f3e029aa640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dfc108170 0x7f3dfc19a820 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f3df000b450 tx=0x7f3df000b910 comp rx=0 tx=0).stop 2024-08-31T06:30:12.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.317+0000 7f3e029aa640 1 -- 172.21.15.53:0/1101792153 shutdown_connections 2024-08-31T06:30:12.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.317+0000 7f3e029aa640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3de40b4ca0 0x7f3de40b71b0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.317+0000 7f3e029aa640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dfc108ac0 0x7f3dfc19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.317+0000 7f3e029aa640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dfc108170 0x7f3dfc19a820 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.317+0000 7f3e029aa640 1 --2- 172.21.15.53:0/1101792153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dfc102880 0x7f3dfc19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:12.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.317+0000 7f3e029aa640 1 -- 172.21.15.53:0/1101792153 >> 172.21.15.53:0/1101792153 conn(0x7f3dfc079500 msgr2=0x7f3dfc105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:12.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.317+0000 7f3e029aa640 1 -- 172.21.15.53:0/1101792153 shutdown_connections 2024-08-31T06:30:12.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:12.317+0000 7f3e029aa640 1 -- 172.21.15.53:0/1101792153 wait complete. 2024-08-31T06:30:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:11 smithi130 ceph-mon[22266]: pgmap v1119: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 376 op/s 2024-08-31T06:30:12.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 600 sec 2024-08-31T06:30:12.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:11 smithi153 ceph-mon[22320]: pgmap v1119: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 376 op/s 2024-08-31T06:30:12.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:30:12.998 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:30:13.252 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:13.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 601 sec 2024-08-31T06:30:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:13.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.752+0000 7fed9bb29640 1 -- 172.21.15.53:0/2006224011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed94108150 msgr2=0x7fed94108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:13.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.752+0000 7fed9bb29640 1 --2- 172.21.15.53:0/2006224011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed94108150 0x7fed94108560 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fed84009900 tx=0x7fed8402a410 comp rx=0 tx=0).stop 2024-08-31T06:30:13.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.753+0000 7fed9bb29640 1 -- 172.21.15.53:0/2006224011 shutdown_connections 2024-08-31T06:30:13.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.753+0000 7fed9bb29640 1 --2- 172.21.15.53:0/2006224011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed94108aa0 0x7fed9410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.753+0000 7fed9bb29640 1 --2- 172.21.15.53:0/2006224011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed94108150 0x7fed94108560 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.753+0000 7fed9bb29640 1 --2- 172.21.15.53:0/2006224011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed94102860 0x7fed94102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.753+0000 7fed9bb29640 1 -- 172.21.15.53:0/2006224011 >> 172.21.15.53:0/2006224011 conn(0x7fed940794c0 msgr2=0x7fed940798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:13.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.753+0000 7fed9bb29640 1 -- 172.21.15.53:0/2006224011 shutdown_connections 2024-08-31T06:30:13.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.753+0000 7fed9bb29640 1 -- 172.21.15.53:0/2006224011 wait complete. 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.753+0000 7fed9bb29640 1 Processor -- start 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed9bb29640 1 -- start start 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed9bb29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed94102860 0x7fed94199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed9bb29640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed94108150 0x7fed941996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed9bb29640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed94108aa0 0x7fed9419e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed9bb29640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fed941125c0 con 0x7fed94102860 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed9bb29640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed94112440 con 0x7fed94108aa0 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed9bb29640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed94112740 con 0x7fed94108150 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed998c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed94102860 0x7fed94199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed998c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed94102860 0x7fed94199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40870/0 (socket says 172.21.15.53:40870) 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed998c5640 1 -- 172.21.15.53:0/1965824453 learned_addr learned my addr 172.21.15.53:0/1965824453 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:13.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed990c4640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed94108150 0x7fed941996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed94108aa0 0x7fed9419e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed998c5640 1 -- 172.21.15.53:0/1965824453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed94108150 msgr2=0x7fed941996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed998c5640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed94108150 0x7fed941996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed998c5640 1 -- 172.21.15.53:0/1965824453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed94108aa0 msgr2=0x7fed9419e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed998c5640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed94108aa0 0x7fed9419e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed998c5640 1 -- 172.21.15.53:0/1965824453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9419efc0 con 0x7fed94102860 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.754+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed94108aa0 0x7fed9419e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.755+0000 7fed998c5640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed94102860 0x7fed94199110 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fed9000c890 tx=0x7fed9000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.755+0000 7fed8affd640 1 -- 172.21.15.53:0/1965824453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90004220 con 0x7fed94102860 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.755+0000 7fed8affd640 1 -- 172.21.15.53:0/1965824453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed90007e40 con 0x7fed94102860 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.755+0000 7fed9bb29640 1 -- 172.21.15.53:0/1965824453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9419f2b0 con 0x7fed94102860 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.755+0000 7fed8affd640 1 -- 172.21.15.53:0/1965824453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90004a00 con 0x7fed94102860 2024-08-31T06:30:13.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.755+0000 7fed9bb29640 1 -- 172.21.15.53:0/1965824453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed941a5ad0 con 0x7fed94102860 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7feda209e740 1 Processor -- start 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7feda209e740 1 -- start start 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7fed8affd640 1 -- 172.21.15.53:0/1965824453 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fed900079b0 con 0x7fed94102860 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7feda209e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b237b6070 0x555b23b5b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7feda209e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b2378d1b0 0x555b23b5b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7feda209e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 0x555b23b5bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7feda209e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b23ad2680 con 0x555b237b6070 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7feda209e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555b23ac1c10 con 0x555b23795390 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7feda209e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555b23ac5bc0 con 0x555b2378d1b0 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7fed9a0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b237b6070 0x555b23b5b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7fed9a0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b237b6070 0x555b23b5b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40880/0 (socket says 172.21.15.53:40880) 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.758+0000 7fed9a0c6640 1 -- 172.21.15.53:0/1754463563 learned_addr learned my addr 172.21.15.53:0/1754463563 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:13.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed998c5640 1 --2- 172.21.15.53:0/1754463563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b2378d1b0 0x555b23b5b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed990c4640 1 --2- 172.21.15.53:0/1754463563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 0x555b23b5bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed9a0c6640 1 -- 172.21.15.53:0/1754463563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b2378d1b0 msgr2=0x555b23b5b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/1754463563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b2378d1b0 0x555b23b5b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed9a0c6640 1 -- 172.21.15.53:0/1754463563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 msgr2=0x555b23b5bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/1754463563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 0x555b23b5bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed9a0c6640 1 -- 172.21.15.53:0/1754463563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b23821650 con 0x555b237b6070 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed990c4640 1 --2- 172.21.15.53:0/1754463563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 0x555b23b5bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed8affd640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed800b4d50 0x7fed800b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/1754463563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b237b6070 0x555b23b5b310 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fed8c007e60 tx=0x7fed8c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a92f07cdfb21ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed998c5640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed800b4d50 0x7fed800b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed7ffff640 1 -- 172.21.15.53:0/1754463563 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c014070 con 0x555b237b6070 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed8affd640 1 -- 172.21.15.53:0/1965824453 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7fed900e5160 con 0x7fed94102860 2024-08-31T06:30:13.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed7ffff640 1 -- 172.21.15.53:0/1754463563 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed8c003e00 con 0x555b237b6070 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.759+0000 7fed7ffff640 1 -- 172.21.15.53:0/1754463563 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c004660 con 0x555b237b6070 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.760+0000 7feda209e740 1 -- 172.21.15.53:0/1754463563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b237b6070 msgr2=0x555b23b5b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.760+0000 7fed998c5640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed800b4d50 0x7fed800b7260 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fed900e29b0 tx=0x7fed900a7870 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.760+0000 7feda209e740 1 --2- 172.21.15.53:0/1754463563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b237b6070 0x555b23b5b310 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fed8c007e60 tx=0x7fed8c00e720 comp rx=0 tx=0).stop 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.760+0000 7feda209e740 1 -- 172.21.15.53:0/1754463563 shutdown_connections 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.760+0000 7feda209e740 1 --2- 172.21.15.53:0/1754463563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 0x555b23b5bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.760+0000 7feda209e740 1 --2- 172.21.15.53:0/1754463563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b2378d1b0 0x555b23b5b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.760+0000 7feda209e740 1 --2- 172.21.15.53:0/1754463563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b237b6070 0x555b23b5b310 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.760+0000 7feda209e740 1 -- 172.21.15.53:0/1754463563 >> 172.21.15.53:0/1754463563 conn(0x555b237aa460 msgr2=0x555b23b59200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.760+0000 7feda209e740 1 -- 172.21.15.53:0/1754463563 shutdown_connections 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.760+0000 7feda209e740 1 -- 172.21.15.53:0/1754463563 wait complete. 2024-08-31T06:30:13.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7feda209e740 1 -- start start 2024-08-31T06:30:13.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7feda209e740 1 Processor -- start 2024-08-31T06:30:13.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7feda209e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b68c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7feda209e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b23795390 0x555b23b69170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7feda209e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b237b6070 0x555b23b74f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7feda209e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b23924700 con 0x555b2378d1b0 2024-08-31T06:30:13.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7feda209e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555b23a48750 con 0x555b237b6070 2024-08-31T06:30:13.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7feda209e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555b23b6bc20 con 0x555b23795390 2024-08-31T06:30:13.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7fed9a0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b68c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7feda209e740 10 client.0 _ll_register_callbacks cb 0x555b23a77e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:13.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7fed9a0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b68c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40896/0 (socket says 172.21.15.53:40896) 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7fed9a0c6640 1 -- 172.21.15.53:0/524002672 learned_addr learned my addr 172.21.15.53:0/524002672 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7fed990c4640 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b23795390 0x555b23b69170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.761+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b237b6070 0x555b23b74f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.762+0000 7fed9a0c6640 1 -- 172.21.15.53:0/524002672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b23795390 msgr2=0x555b23b69170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.762+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b23795390 0x555b23b69170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.762+0000 7fed9a0c6640 1 -- 172.21.15.53:0/524002672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b237b6070 msgr2=0x555b23b74f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.762+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b237b6070 0x555b23b74f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.762+0000 7fed9a0c6640 1 -- 172.21.15.53:0/524002672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b23a81900 con 0x555b2378d1b0 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.762+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b68c30 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0044d0 tx=0x7fed8c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde7367ef5bc31d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.762+0000 7fed7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.762+0000 7fed7d7fa640 1 -- 172.21.15.53:0/524002672 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c014030 con 0x555b2378d1b0 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.762+0000 7fed7d7fa640 1 -- 172.21.15.53:0/524002672 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7fed8c004c40 con 0x555b2378d1b0 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.762+0000 7feda209e740 1 -- 172.21.15.53:0/524002672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed8c003e00 con 0x555b2378d1b0 2024-08-31T06:30:13.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.763+0000 7fed7d7fa640 1 -- 172.21.15.53:0/524002672 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fed8c02f050 con 0x555b2378d1b0 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.763+0000 7feda209e740 10 client.23064 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.763+0000 7feda209e740 1 -- 172.21.15.53:0/524002672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x555b23b779d0 con 0x555b2378d1b0 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.763+0000 7fed7d7fa640 1 -- 172.21.15.53:0/524002672 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed8c003e00 con 0x555b2378d1b0 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.763+0000 7fed7d7fa640 1 -- 172.21.15.53:0/524002672 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7fed8c005050 con 0x555b2378d1b0 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.763+0000 7feda209e740 10 client.23064 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.763+0000 7feda209e740 10 client.23064 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.763+0000 7feda209e740 20 client.23064 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.763+0000 7feda209e740 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555b237749f0 0x555b23b7ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.763+0000 7feda209e740 4 client.23064 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.763+0000 7feda209e740 1 -- 172.21.15.53:0/524002672 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b23ad45d0 con 0x555b237749f0 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.764+0000 7fed990c4640 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555b237749f0 0x555b23b7ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.764+0000 7fed990c4640 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555b237749f0 0x555b23b7ad30 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f070d2323c302138 server_cookie=bfbdd7a0123a47c4 in_seq=0 out_seq=0 2024-08-31T06:30:13.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.764+0000 7fed7d7fa640 10 client.23064 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7fed7d7fa640 1 -- 172.21.15.53:0/524002672 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b23ad45d0 con 0x555b237749f0 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7fed7d7fa640 10 client.23064 handle_command_reply: tid=0 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 1 client.23064 shutdown 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 1 -- 172.21.15.53:0/524002672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 msgr2=0x555b23b68c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b68c30 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0044d0 tx=0x7fed8c005c50 comp rx=0 tx=0).stop 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 1 -- 172.21.15.53:0/524002672 shutdown_connections 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b237b6070 0x555b23b74f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b23795390 0x555b23b69170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555b237749f0 0x555b23b7ad30 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 1 --2- 172.21.15.53:0/524002672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b68c30 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7fed7d7fa640 0 client.23064 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 1 -- 172.21.15.53:0/524002672 >> 172.21.15.53:0/524002672 conn(0x555b237aa460 msgr2=0x555b23b5e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:13.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 1 -- 172.21.15.53:0/524002672 shutdown_connections 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 1 -- 172.21.15.53:0/524002672 wait complete. 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.765+0000 7feda209e740 20 client.23064 trim_cache size 0 max 16384 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.780+0000 7feda209e740 1 Processor -- start 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.780+0000 7feda209e740 1 -- start start 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7feda209e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b6ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7feda209e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 0x555b23b74ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7feda209e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b237b6070 0x555b23b5ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7feda209e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fed941ad3f0 con 0x555b2378d1b0 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7feda209e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed941aeff0 con 0x555b23795390 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7feda209e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed941adac0 con 0x555b237b6070 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed9a0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b6ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed9a0c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b6ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40906/0 (socket says 172.21.15.53:40906) 2024-08-31T06:30:13.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed9a0c6640 1 -- 172.21.15.53:0/15398361 learned_addr learned my addr 172.21.15.53:0/15398361 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed990c4640 1 --2- 172.21.15.53:0/15398361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 0x555b23b74ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed9a0c6640 1 -- 172.21.15.53:0/15398361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b237b6070 msgr2=0x555b23b5ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/15398361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b237b6070 0x555b23b5ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed9a0c6640 1 -- 172.21.15.53:0/15398361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 msgr2=0x555b23b74ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/15398361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 0x555b23b74ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed9a0c6640 1 -- 172.21.15.53:0/15398361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b23b5d830 con 0x555b2378d1b0 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed990c4640 1 --2- 172.21.15.53:0/15398361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 0x555b23b74ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/15398361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b6ab10 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7fed8c008010 tx=0x7fed8c00efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0b248c6cf04ddc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.781+0000 7fed7f7fe640 1 -- 172.21.15.53:0/15398361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c038070 con 0x555b2378d1b0 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.782+0000 7fed7f7fe640 1 -- 172.21.15.53:0/15398361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed8c023040 con 0x555b2378d1b0 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.782+0000 7fed7f7fe640 1 -- 172.21.15.53:0/15398361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c014040 con 0x555b2378d1b0 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.782+0000 7feda209e740 1 -- 172.21.15.53:0/15398361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 msgr2=0x555b23b6ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:13.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.782+0000 7feda209e740 1 --2- 172.21.15.53:0/15398361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b6ab10 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7fed8c008010 tx=0x7fed8c00efb0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.782+0000 7feda209e740 1 -- 172.21.15.53:0/15398361 shutdown_connections 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.782+0000 7feda209e740 1 --2- 172.21.15.53:0/15398361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b237b6070 0x555b23b5ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 --2- 172.21.15.53:0/15398361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b23795390 0x555b23b74ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 --2- 172.21.15.53:0/15398361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b2378d1b0 0x555b23b6ab10 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 -- 172.21.15.53:0/15398361 >> 172.21.15.53:0/15398361 conn(0x555b237aa460 msgr2=0x555b23b5e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 -- 172.21.15.53:0/15398361 shutdown_connections 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 -- 172.21.15.53:0/15398361 wait complete. 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 -- start start 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 Processor -- start 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b2378d1b0 0x555b23b7e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b23795390 0x555b23b7bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b237b6070 0x555b23b7c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:13.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fed941ae920 con 0x555b23795390 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed941ae190 con 0x555b237b6070 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed941ab3f0 con 0x555b2378d1b0 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7feda209e740 10 client.0 _ll_register_callbacks cb 0x7fed8c007ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.783+0000 7fed990c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b23795390 0x555b23b7bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed990c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b23795390 0x555b23b7bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40910/0 (socket says 172.21.15.53:40910) 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed990c4640 1 -- 172.21.15.53:0/1202967880 learned_addr learned my addr 172.21.15.53:0/1202967880 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b2378d1b0 0x555b23b7e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b237b6070 0x555b23b7c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed990c4640 1 -- 172.21.15.53:0/1202967880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b2378d1b0 msgr2=0x555b23b7e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed990c4640 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b2378d1b0 0x555b23b7e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed990c4640 1 -- 172.21.15.53:0/1202967880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b237b6070 msgr2=0x555b23b7c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:14.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed990c4640 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b237b6070 0x555b23b7c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:14.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed990c4640 1 -- 172.21.15.53:0/1202967880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b23be44b0 con 0x555b23795390 2024-08-31T06:30:14.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed990c4640 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b23795390 0x555b23b7bba0 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fed84005940 tx=0x7fed840042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db341066017460d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:14.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:14.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed7d7fa640 1 -- 172.21.15.53:0/1202967880 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84035040 con 0x555b23795390 2024-08-31T06:30:14.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed7d7fa640 1 -- 172.21.15.53:0/1202967880 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 8601+0+0 (secure 0 0 0) 0x7fed84031610 con 0x555b23795390 2024-08-31T06:30:14.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7feda209e740 1 -- 172.21.15.53:0/1202967880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed8c023040 con 0x555b23795390 2024-08-31T06:30:14.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7fed7d7fa640 1 -- 172.21.15.53:0/1202967880 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fed84031810 con 0x555b23795390 2024-08-31T06:30:14.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.784+0000 7feda209e740 10 client.23070 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:14.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.785+0000 7feda209e740 1 -- 172.21.15.53:0/1202967880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x555b23be55e0 con 0x555b23795390 2024-08-31T06:30:14.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.785+0000 7fed7d7fa640 1 -- 172.21.15.53:0/1202967880 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed8c023040 con 0x555b23795390 2024-08-31T06:30:14.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.785+0000 7fed7d7fa640 1 -- 172.21.15.53:0/1202967880 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7fed84046540 con 0x555b23795390 2024-08-31T06:30:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.785+0000 7feda209e740 10 client.23070 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.785+0000 7feda209e740 10 client.23070 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:30:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.785+0000 7feda209e740 20 client.23070 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.785+0000 7feda209e740 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555b23749da0 0x555b23be7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.785+0000 7feda209e740 4 client.23070 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:30:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.785+0000 7feda209e740 1 -- 172.21.15.53:0/1202967880 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b23ad0070 con 0x555b23749da0 2024-08-31T06:30:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.785+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555b23749da0 0x555b23be7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7fed7d7fa640 10 client.23070 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:30:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7fed9a0c6640 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555b23749da0 0x555b23be7dc0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=61154544f299bf20 server_cookie=fc47567bede448c1 in_seq=0 out_seq=0 2024-08-31T06:30:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7fed7d7fa640 1 -- 172.21.15.53:0/1202967880 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b23ad0070 con 0x555b23749da0 2024-08-31T06:30:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7fed7d7fa640 10 client.23070 handle_command_reply: tid=0 2024-08-31T06:30:14.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 1 client.23070 shutdown 2024-08-31T06:30:14.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 1 -- 172.21.15.53:0/1202967880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b23795390 msgr2=0x555b23b7bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:14.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b23795390 0x555b23b7bba0 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fed84005940 tx=0x7fed840042c0 comp rx=0 tx=0).stop 2024-08-31T06:30:14.003 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:30:14.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 1 -- 172.21.15.53:0/1202967880 shutdown_connections 2024-08-31T06:30:14.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555b237b6070 0x555b23b7c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x555b23749da0 0x555b23be7dc0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b23795390 0x555b23b7bba0 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 1 --2- 172.21.15.53:0/1202967880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555b2378d1b0 0x555b23b7e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 1 -- 172.21.15.53:0/1202967880 >> 172.21.15.53:0/1202967880 conn(0x555b237aa460 msgr2=0x555b23b5e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7fed7d7fa640 0 client.23070 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 1 -- 172.21.15.53:0/1202967880 shutdown_connections 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 1 -- 172.21.15.53:0/1202967880 wait complete. 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.786+0000 7feda209e740 20 client.23070 trim_cache size 0 max 16384 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 -- 172.21.15.53:0/1965824453 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed800b4d50 msgr2=0x7fed800b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed800b4d50 0x7fed800b7260 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fed900e29b0 tx=0x7fed900a7870 comp rx=0 tx=0).stop 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 -- 172.21.15.53:0/1965824453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed94102860 msgr2=0x7fed94199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed94102860 0x7fed94199110 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fed9000c890 tx=0x7fed9000cd50 comp rx=0 tx=0).stop 2024-08-31T06:30:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 -- 172.21.15.53:0/1965824453 shutdown_connections 2024-08-31T06:30:14.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fed800b4d50 0x7fed800b7260 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:14.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed94108aa0 0x7fed9419e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:14.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed94108150 0x7fed941996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:14.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 --2- 172.21.15.53:0/1965824453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed94102860 0x7fed94199110 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:14.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 -- 172.21.15.53:0/1965824453 >> 172.21.15.53:0/1965824453 conn(0x7fed940794c0 msgr2=0x7fed94106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:14.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 -- 172.21.15.53:0/1965824453 shutdown_connections 2024-08-31T06:30:14.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:13.787+0000 7fed9bb29640 1 -- 172.21.15.53:0/1965824453 wait complete. 2024-08-31T06:30:14.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:13 smithi053 ceph-mon[18924]: pgmap v1120: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 349 op/s 2024-08-31T06:30:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:13 smithi130 ceph-mon[22266]: pgmap v1120: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 349 op/s 2024-08-31T06:30:14.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 602 sec 2024-08-31T06:30:14.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:13 smithi153 ceph-mon[22320]: pgmap v1120: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.2 MiB/s wr, 349 op/s 2024-08-31T06:30:14.712 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:30:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.976+0000 7fc73835b640 1 -- 172.21.15.53:0/3297158862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc730102820 msgr2=0x7fc730102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.976+0000 7fc73835b640 1 --2- 172.21.15.53:0/3297158862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc730102820 0x7fc730102c30 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009900 tx=0x7fc72c02a410 comp rx=0 tx=0).stop 2024-08-31T06:30:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.976+0000 7fc73835b640 1 -- 172.21.15.53:0/3297158862 shutdown_connections 2024-08-31T06:30:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.976+0000 7fc73835b640 1 --2- 172.21.15.53:0/3297158862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc730108ab0 0x7fc73010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.976+0000 7fc73835b640 1 --2- 172.21.15.53:0/3297158862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc730108160 0x7fc730108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.976+0000 7fc73835b640 1 --2- 172.21.15.53:0/3297158862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc730102820 0x7fc730102c30 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.976+0000 7fc73835b640 1 -- 172.21.15.53:0/3297158862 >> 172.21.15.53:0/3297158862 conn(0x7fc7300794e0 msgr2=0x7fc7300798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.976+0000 7fc73835b640 1 -- 172.21.15.53:0/3297158862 shutdown_connections 2024-08-31T06:30:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.976+0000 7fc73835b640 1 -- 172.21.15.53:0/3297158862 wait complete. 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc73835b640 1 Processor -- start 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc73835b640 1 -- start start 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc73835b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc730102820 0x7fc73019afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc73835b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc730108160 0x7fc73019b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc73835b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc730108ab0 0x7fc73019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc73835b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc730112610 con 0x7fc730102820 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc73835b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc730112490 con 0x7fc730108ab0 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc73835b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc730112790 con 0x7fc730108160 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc7360f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc730102820 0x7fc73019afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc7360f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc730102820 0x7fc73019afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40932/0 (socket says 172.21.15.53:40932) 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc7360f7640 1 -- 172.21.15.53:0/483791849 learned_addr learned my addr 172.21.15.53:0/483791849 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc7368f8640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc730108ab0 0x7fc73019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc7358f6640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc730108160 0x7fc73019b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc7360f7640 1 -- 172.21.15.53:0/483791849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc730108160 msgr2=0x7fc73019b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc7360f7640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc730108160 0x7fc73019b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc7360f7640 1 -- 172.21.15.53:0/483791849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc730108ab0 msgr2=0x7fc73019ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc7360f7640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc730108ab0 0x7fc73019ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.977+0000 7fc7360f7640 1 -- 172.21.15.53:0/483791849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7301a6270 con 0x7fc730102820 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.978+0000 7fc7360f7640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc730102820 0x7fc73019afe0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7fc72c02a930 tx=0x7fc72c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.978+0000 7fc7277fe640 1 -- 172.21.15.53:0/483791849 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c03f070 con 0x7fc730102820 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.978+0000 7fc7277fe640 1 -- 172.21.15.53:0/483791849 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc72c03baf0 con 0x7fc730102820 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.978+0000 7fc73835b640 1 -- 172.21.15.53:0/483791849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7301a6500 con 0x7fc730102820 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.978+0000 7fc7277fe640 1 -- 172.21.15.53:0/483791849 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c035030 con 0x7fc730102820 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.978+0000 7fc73835b640 1 -- 172.21.15.53:0/483791849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7301a6a30 con 0x7fc730102820 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.979+0000 7fc73835b640 1 -- 172.21.15.53:0/483791849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc730102c30 con 0x7fc730102820 2024-08-31T06:30:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.981+0000 7fc7277fe640 1 -- 172.21.15.53:0/483791849 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc72c042070 con 0x7fc730102820 2024-08-31T06:30:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.982+0000 7fc7277fe640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc71c0b4d50 0x7fc71c0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.982+0000 7fc7358f6640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc71c0b4d50 0x7fc71c0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.982+0000 7fc7277fe640 1 -- 172.21.15.53:0/483791849 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fc72c105a70 con 0x7fc730102820 2024-08-31T06:30:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.982+0000 7fc7358f6640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc71c0b4d50 0x7fc71c0b7260 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc7301009a0 tx=0x7fc720005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:14.986+0000 7fc7277fe640 1 -- 172.21.15.53:0/483791849 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc72c0cc1f0 con 0x7fc730102820 2024-08-31T06:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:15.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.216+0000 7fc73835b640 1 -- 172.21.15.53:0/483791849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc73002e430 con 0x7fc730102820 2024-08-31T06:30:15.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.217+0000 7fc7277fe640 1 -- 172.21.15.53:0/483791849 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+11992 (secure 0 0 0) 0x7fc72c0d09b0 con 0x7fc730102820 2024-08-31T06:30:15.219 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:30:15.219 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":90,"btime":"2024-08-31T06:29:16:977675+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":90,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:29:16.408419+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:30:15.219 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 90 2024-08-31T06:30:15.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.219+0000 7fc73835b640 1 -- 172.21.15.53:0/483791849 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc71c0b4d50 msgr2=0x7fc71c0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:15.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.219+0000 7fc73835b640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc71c0b4d50 0x7fc71c0b7260 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc7301009a0 tx=0x7fc720005f90 comp rx=0 tx=0).stop 2024-08-31T06:30:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.219+0000 7fc73835b640 1 -- 172.21.15.53:0/483791849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc730102820 msgr2=0x7fc73019afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.219+0000 7fc73835b640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc730102820 0x7fc73019afe0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7fc72c02a930 tx=0x7fc72c003b90 comp rx=0 tx=0).stop 2024-08-31T06:30:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.219+0000 7fc73835b640 1 -- 172.21.15.53:0/483791849 shutdown_connections 2024-08-31T06:30:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.219+0000 7fc73835b640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc71c0b4d50 0x7fc71c0b7260 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.219+0000 7fc73835b640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc730108ab0 0x7fc73019ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.219+0000 7fc73835b640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc730108160 0x7fc73019b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.219+0000 7fc73835b640 1 --2- 172.21.15.53:0/483791849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc730102820 0x7fc73019afe0 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.219+0000 7fc73835b640 1 -- 172.21.15.53:0/483791849 >> 172.21.15.53:0/483791849 conn(0x7fc7300794e0 msgr2=0x7fc730101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.220+0000 7fc73835b640 1 -- 172.21.15.53:0/483791849 shutdown_connections 2024-08-31T06:30:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:15.220+0000 7fc73835b640 1 -- 172.21.15.53:0/483791849 wait complete. 2024-08-31T06:30:15.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:30:15.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:14 smithi053 ceph-mon[18924]: osdmap e114: 12 total, 12 up, 12 in 2024-08-31T06:30:15.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:30:15.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:30:15.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:14 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:30:15.327 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:30:15.327 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:14 smithi153 ceph-mon[22320]: osdmap e114: 12 total, 12 up, 12 in 2024-08-31T06:30:15.327 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:30:15.327 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:30:15.327 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:14 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:30:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:30:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:14 smithi130 ceph-mon[22266]: osdmap e114: 12 total, 12 up, 12 in 2024-08-31T06:30:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:30:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:30:15.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:14 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:30:15.410 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 603 sec 2024-08-31T06:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.002+0000 7f97881fa640 1 -- 172.21.15.53:0/2684159456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9780103900 msgr2=0x7f9780103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.002+0000 7f97881fa640 1 --2- 172.21.15.53:0/2684159456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9780103900 0x7f9780103d10 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f977c009900 tx=0x7f977c02a410 comp rx=0 tx=0).stop 2024-08-31T06:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.002+0000 7f97881fa640 1 -- 172.21.15.53:0/2684159456 shutdown_connections 2024-08-31T06:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.002+0000 7f97881fa640 1 --2- 172.21.15.53:0/2684159456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780109b90 0x7f97801103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.002+0000 7f97881fa640 1 --2- 172.21.15.53:0/2684159456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9780109240 0x7f9780109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.002+0000 7f97881fa640 1 --2- 172.21.15.53:0/2684159456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9780103900 0x7f9780103d10 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.002+0000 7f97881fa640 1 -- 172.21.15.53:0/2684159456 >> 172.21.15.53:0/2684159456 conn(0x7f978007b5f0 msgr2=0x7f978007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.002+0000 7f97881fa640 1 -- 172.21.15.53:0/2684159456 shutdown_connections 2024-08-31T06:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.002+0000 7f97881fa640 1 -- 172.21.15.53:0/2684159456 wait complete. 2024-08-31T06:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f97881fa640 1 Processor -- start 2024-08-31T06:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f97881fa640 1 -- start start 2024-08-31T06:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f97881fa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780103900 0x7f978019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f97881fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9780109240 0x7f978019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f97881fa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9780109b90 0x7f978019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f97881fa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9780113700 con 0x7f9780109240 2024-08-31T06:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f97881fa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9780113580 con 0x7f9780109b90 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f97881fa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9780113880 con 0x7f9780103900 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f9785795640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9780109240 0x7f978019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f9785795640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9780109240 0x7f978019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40960/0 (socket says 172.21.15.53:40960) 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f9785795640 1 -- 172.21.15.53:0/1039467900 learned_addr learned my addr 172.21.15.53:0/1039467900 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f9786797640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9780109b90 0x7f978019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f9785f96640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780103900 0x7f978019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f9785795640 1 -- 172.21.15.53:0/1039467900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780103900 msgr2=0x7f978019a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.003+0000 7f9785795640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780103900 0x7f978019a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.004+0000 7f9785795640 1 -- 172.21.15.53:0/1039467900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9780109b90 msgr2=0x7f978019f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.004+0000 7f9785795640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9780109b90 0x7f978019f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.004+0000 7f9785795640 1 -- 172.21.15.53:0/1039467900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97801a00c0 con 0x7f9780109240 2024-08-31T06:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.004+0000 7f9786797640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9780109b90 0x7f978019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:16.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.004+0000 7f9785795640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9780109240 0x7f978019a6f0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f977000d740 tx=0x7f977000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:16.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.004+0000 7f9776ffd640 1 -- 172.21.15.53:0/1039467900 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770017070 con 0x7f9780109240 2024-08-31T06:30:16.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.004+0000 7f9776ffd640 1 -- 172.21.15.53:0/1039467900 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f977000de50 con 0x7f9780109240 2024-08-31T06:30:16.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.004+0000 7f97881fa640 1 -- 172.21.15.53:0/1039467900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97801a03b0 con 0x7f9780109240 2024-08-31T06:30:16.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.004+0000 7f9776ffd640 1 -- 172.21.15.53:0/1039467900 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977000f620 con 0x7f9780109240 2024-08-31T06:30:16.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.004+0000 7f97881fa640 1 -- 172.21.15.53:0/1039467900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97801a6b10 con 0x7f9780109240 2024-08-31T06:30:16.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f978e76f740 1 Processor -- start 2024-08-31T06:30:16.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f978e76f740 1 -- start start 2024-08-31T06:30:16.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f9776ffd640 1 -- 172.21.15.53:0/1039467900 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f977001a070 con 0x7f9780109240 2024-08-31T06:30:16.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f978e76f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feb2b070 0x5585feed0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f978e76f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feed0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f978e76f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585feed0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f978e76f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5585fee47680 con 0x5585feb021b0 2024-08-31T06:30:16.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f978e76f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585fee36c10 con 0x5585feb2b070 2024-08-31T06:30:16.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f978e76f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5585fee3abc0 con 0x5585feb0a390 2024-08-31T06:30:16.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f9785f96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feed0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f9785f96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feed0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40962/0 (socket says 172.21.15.53:40962) 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f9785f96640 1 -- 172.21.15.53:0/3702950810 learned_addr learned my addr 172.21.15.53:0/3702950810 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.007+0000 7f9786797640 1 --2- 172.21.15.53:0/3702950810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feb2b070 0x5585feed0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f9785795640 1 --2- 172.21.15.53:0/3702950810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585feed0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f9785f96640 1 -- 172.21.15.53:0/3702950810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 msgr2=0x5585feed0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f9785f96640 1 --2- 172.21.15.53:0/3702950810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585feed0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f9785f96640 1 -- 172.21.15.53:0/3702950810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feb2b070 msgr2=0x5585feed0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f9785f96640 1 --2- 172.21.15.53:0/3702950810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feb2b070 0x5585feed0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f9785f96640 1 -- 172.21.15.53:0/3702950810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585feb96650 con 0x5585feb021b0 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f9785795640 1 --2- 172.21.15.53:0/3702950810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585feed0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f9776ffd640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f976c0b4ca0 0x7f976c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f9785f96640 1 --2- 172.21.15.53:0/3702950810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feed0850 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f977c009900 tx=0x7f977c032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba63767ec699d72 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f9786797640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f976c0b4ca0 0x7f976c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f9776ffd640 1 -- 172.21.15.53:0/1039467900 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f97700e5090 con 0x7f9780109240 2024-08-31T06:30:16.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f976bfff640 1 -- 172.21.15.53:0/3702950810 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c03f070 con 0x5585feb021b0 2024-08-31T06:30:16.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f976bfff640 1 -- 172.21.15.53:0/3702950810 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f977c004030 con 0x5585feb021b0 2024-08-31T06:30:16.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.008+0000 7f976bfff640 1 -- 172.21.15.53:0/3702950810 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c035070 con 0x5585feb021b0 2024-08-31T06:30:16.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.009+0000 7f978e76f740 1 -- 172.21.15.53:0/3702950810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 msgr2=0x5585feed0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:16.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.009+0000 7f9786797640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f976c0b4ca0 0x7f976c0b71b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9778005fd0 tx=0x7f9778009800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:16.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.009+0000 7f978e76f740 1 --2- 172.21.15.53:0/3702950810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feed0850 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f977c009900 tx=0x7f977c032ba0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.009+0000 7f978e76f740 1 -- 172.21.15.53:0/3702950810 shutdown_connections 2024-08-31T06:30:16.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.009+0000 7f978e76f740 1 --2- 172.21.15.53:0/3702950810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585feed0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.009+0000 7f978e76f740 1 --2- 172.21.15.53:0/3702950810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feed0850 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.009+0000 7f978e76f740 1 --2- 172.21.15.53:0/3702950810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feb2b070 0x5585feed0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.009+0000 7f978e76f740 1 -- 172.21.15.53:0/3702950810 >> 172.21.15.53:0/3702950810 conn(0x5585feb1f460 msgr2=0x5585feece200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:16.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.009+0000 7f978e76f740 1 -- 172.21.15.53:0/3702950810 shutdown_connections 2024-08-31T06:30:16.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.009+0000 7f978e76f740 1 -- 172.21.15.53:0/3702950810 wait complete. 2024-08-31T06:30:16.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f978e76f740 1 -- start start 2024-08-31T06:30:16.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f978e76f740 1 Processor -- start 2024-08-31T06:30:16.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f978e76f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feedfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f978e76f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585feee0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f978e76f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feb2b070 0x5585feeec180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f978e76f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5585fec99700 con 0x5585feb021b0 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f978e76f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585fedbd750 con 0x5585feb2b070 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f978e76f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5585feee2df0 con 0x5585feb0a390 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f978e76f740 10 client.0 _ll_register_callbacks cb 0x5585fedece10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f9785f96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feedfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f9785f96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feedfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40976/0 (socket says 172.21.15.53:40976) 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f9785f96640 1 -- 172.21.15.53:0/1182728181 learned_addr learned my addr 172.21.15.53:0/1182728181 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f9786797640 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feb2b070 0x5585feeec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.010+0000 7f9785795640 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585feee0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f9785f96640 1 -- 172.21.15.53:0/1182728181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 msgr2=0x5585feee0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f9785f96640 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585feee0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f9785f96640 1 -- 172.21.15.53:0/1182728181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feb2b070 msgr2=0x5585feeec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:16.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f9785f96640 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feb2b070 0x5585feeec180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f9785f96640 1 -- 172.21.15.53:0/1182728181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585fedf6900 con 0x5585feb021b0 2024-08-31T06:30:16.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f9785f96640 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feedfed0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f977c02a930 tx=0x7f977c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4509db1dfffafe16 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:16.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f97697fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:16.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f97697fa640 1 -- 172.21.15.53:0/1182728181 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c03f070 con 0x5585feb021b0 2024-08-31T06:30:16.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f97697fa640 1 -- 172.21.15.53:0/1182728181 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f977c005250 con 0x5585feb021b0 2024-08-31T06:30:16.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f978e76f740 1 -- 172.21.15.53:0/1182728181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f977c004030 con 0x5585feb021b0 2024-08-31T06:30:16.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f97697fa640 1 -- 172.21.15.53:0/1182728181 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f977c035040 con 0x5585feb021b0 2024-08-31T06:30:16.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f978e76f740 10 client.23088 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:16.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f978e76f740 1 -- 172.21.15.53:0/1182728181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x5585feeeebe0 con 0x5585feb021b0 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.011+0000 7f97697fa640 1 -- 172.21.15.53:0/1182728181 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f977c004030 con 0x5585feb021b0 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.012+0000 7f97697fa640 1 -- 172.21.15.53:0/1182728181 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f977c0046c0 con 0x5585feb021b0 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.012+0000 7f978e76f740 10 client.23088 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.012+0000 7f978e76f740 10 client.23088 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.012+0000 7f978e76f740 20 client.23088 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.012+0000 7f978e76f740 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5585feae99f0 0x5585feef1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.012+0000 7f978e76f740 4 client.23088 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.012+0000 7f978e76f740 1 -- 172.21.15.53:0/1182728181 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585fee495d0 con 0x5585feae99f0 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.012+0000 7f9785795640 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5585feae99f0 0x5585feef1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.012+0000 7f97697fa640 10 client.23088 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.012+0000 7f9785795640 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5585feae99f0 0x5585feef1f40 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4982c0ef28876416 server_cookie=d8327696d148fae7 in_seq=0 out_seq=0 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f97697fa640 1 -- 172.21.15.53:0/1182728181 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585fee495d0 con 0x5585feae99f0 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f97697fa640 10 client.23088 handle_command_reply: tid=0 2024-08-31T06:30:16.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f978e76f740 1 client.23088 shutdown 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f978e76f740 1 -- 172.21.15.53:0/1182728181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 msgr2=0x5585feedfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f978e76f740 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feedfed0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f977c02a930 tx=0x7f977c0045e0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f978e76f740 1 -- 172.21.15.53:0/1182728181 shutdown_connections 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f978e76f740 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5585feae99f0 0x5585feef1f40 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f978e76f740 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feb2b070 0x5585feeec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f97697fa640 0 client.23088 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f978e76f740 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585feee0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f978e76f740 1 --2- 172.21.15.53:0/1182728181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feedfed0 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.013+0000 7f978e76f740 1 -- 172.21.15.53:0/1182728181 >> 172.21.15.53:0/1182728181 conn(0x5585feb1f460 msgr2=0x5585feecc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.014+0000 7f978e76f740 1 -- 172.21.15.53:0/1182728181 shutdown_connections 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.014+0000 7f978e76f740 1 -- 172.21.15.53:0/1182728181 wait complete. 2024-08-31T06:30:16.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.014+0000 7f978e76f740 20 client.23088 trim_cache size 0 max 16384 2024-08-31T06:30:16.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f978e76f740 1 Processor -- start 2024-08-31T06:30:16.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f978e76f740 1 -- start start 2024-08-31T06:30:16.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f978e76f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feae99f0 0x5585feedd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f978e76f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb021b0 0x5585feedd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f978e76f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb0a390 0x5585feed1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f978e76f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f97801ad240 con 0x5585feb0a390 2024-08-31T06:30:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f978e76f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97801aee40 con 0x5585feae99f0 2024-08-31T06:30:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f978e76f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97801ad910 con 0x5585feb021b0 2024-08-31T06:30:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f9786797640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb0a390 0x5585feed1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f9786797640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb0a390 0x5585feed1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40986/0 (socket says 172.21.15.53:40986) 2024-08-31T06:30:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f9786797640 1 -- 172.21.15.53:0/4213345816 learned_addr learned my addr 172.21.15.53:0/4213345816 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.027+0000 7f9785f96640 1 --2- 172.21.15.53:0/4213345816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feae99f0 0x5585feedd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.028+0000 7f9785795640 1 --2- 172.21.15.53:0/4213345816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb021b0 0x5585feedd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.028+0000 7f9786797640 1 -- 172.21.15.53:0/4213345816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb021b0 msgr2=0x5585feedd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.028+0000 7f9786797640 1 --2- 172.21.15.53:0/4213345816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb021b0 0x5585feedd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.028+0000 7f9786797640 1 -- 172.21.15.53:0/4213345816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feae99f0 msgr2=0x5585feedd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.028+0000 7f9786797640 1 --2- 172.21.15.53:0/4213345816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feae99f0 0x5585feedd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.028+0000 7f9786797640 1 -- 172.21.15.53:0/4213345816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585feee2d30 con 0x5585feb0a390 2024-08-31T06:30:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.028+0000 7f9785795640 1 --2- 172.21.15.53:0/4213345816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb021b0 0x5585feedd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.028+0000 7f9786797640 1 --2- 172.21.15.53:0/4213345816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb0a390 0x5585feed1340 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f9778011790 tx=0x7f9778016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccc3da2f697ff26 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.028+0000 7f976b7fe640 1 -- 172.21.15.53:0/4213345816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778004b20 con 0x5585feb0a390 2024-08-31T06:30:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.028+0000 7f976b7fe640 1 -- 172.21.15.53:0/4213345816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9778004cc0 con 0x5585feb0a390 2024-08-31T06:30:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.028+0000 7f976b7fe640 1 -- 172.21.15.53:0/4213345816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778028670 con 0x5585feb0a390 2024-08-31T06:30:16.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.029+0000 7f978e76f740 1 -- 172.21.15.53:0/4213345816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb0a390 msgr2=0x5585feed1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:16.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.029+0000 7f978e76f740 1 --2- 172.21.15.53:0/4213345816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb0a390 0x5585feed1340 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f9778011790 tx=0x7f9778016000 comp rx=0 tx=0).stop 2024-08-31T06:30:16.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.029+0000 7f978e76f740 1 -- 172.21.15.53:0/4213345816 shutdown_connections 2024-08-31T06:30:16.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.029+0000 7f978e76f740 1 --2- 172.21.15.53:0/4213345816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb0a390 0x5585feed1340 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.029+0000 7f978e76f740 1 --2- 172.21.15.53:0/4213345816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb021b0 0x5585feedd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.029+0000 7f978e76f740 1 --2- 172.21.15.53:0/4213345816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feae99f0 0x5585feedd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.029+0000 7f978e76f740 1 -- 172.21.15.53:0/4213345816 >> 172.21.15.53:0/4213345816 conn(0x5585feb1f460 msgr2=0x5585feede750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:16.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.029+0000 7f978e76f740 1 -- 172.21.15.53:0/4213345816 shutdown_connections 2024-08-31T06:30:16.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.029+0000 7f978e76f740 1 -- 172.21.15.53:0/4213345816 wait complete. 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.029+0000 7f978e76f740 1 -- start start 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.029+0000 7f978e76f740 1 Processor -- start 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f978e76f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feae99f0 0x5585feef3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f978e76f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feef3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f978e76f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585fef5b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f978e76f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f97801ae770 con 0x5585feb021b0 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f978e76f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97801adfe0 con 0x5585feae99f0 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f978e76f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97801ab240 con 0x5585feb0a390 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f978e76f740 10 client.0 _ll_register_callbacks cb 0x7f97780096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9785795640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feef3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9785795640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feef3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40992/0 (socket says 172.21.15.53:40992) 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9785795640 1 -- 172.21.15.53:0/3759194440 learned_addr learned my addr 172.21.15.53:0/3759194440 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9785f96640 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feae99f0 0x5585feef3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9786797640 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585fef5b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9785795640 1 -- 172.21.15.53:0/3759194440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 msgr2=0x5585fef5b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9785795640 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585fef5b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9785795640 1 -- 172.21.15.53:0/3759194440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feae99f0 msgr2=0x5585feef3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9785795640 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feae99f0 0x5585feef3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9785795640 1 -- 172.21.15.53:0/3759194440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585feef3fc0 con 0x5585feb021b0 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9786797640 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585fef5b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f9785795640 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feef3770 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f97700a89d0 tx=0x7f977000b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d718ddc7e6b26ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.030+0000 7f97697fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f97697fa640 1 -- 172.21.15.53:0/3759194440 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770021040 con 0x5585feb021b0 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f97697fa640 1 -- 172.21.15.53:0/3759194440 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f97700a79f0 con 0x5585feb021b0 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f978e76f740 1 -- 172.21.15.53:0/3759194440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9778004cc0 con 0x5585feb021b0 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f97697fa640 1 -- 172.21.15.53:0/3759194440 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f97700affd0 con 0x5585feb021b0 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f978e76f740 10 client.23094 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f978e76f740 1 -- 172.21.15.53:0/3759194440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x5585fef5cb80 con 0x5585feb021b0 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f97697fa640 1 -- 172.21.15.53:0/3759194440 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9778004cc0 con 0x5585feb021b0 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f97697fa640 1 -- 172.21.15.53:0/3759194440 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f97700aa9c0 con 0x5585feb021b0 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f978e76f740 10 client.23094 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f978e76f740 10 client.23094 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f978e76f740 20 client.23094 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f978e76f740 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5585feb2b070 0x5585fef5f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f978e76f740 4 client.23094 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f978e76f740 1 -- 172.21.15.53:0/3759194440 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585fee45070 con 0x5585feb2b070 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.031+0000 7f9785f96640 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5585feb2b070 0x5585fef5f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f97697fa640 10 client.23094 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f9785f96640 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5585feb2b070 0x5585fef5f2c0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f1502cd1c820761 server_cookie=f37487798106217b in_seq=0 out_seq=0 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f97697fa640 1 -- 172.21.15.53:0/3759194440 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585fee45070 con 0x5585feb2b070 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f97697fa640 10 client.23094 handle_command_reply: tid=0 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 1 client.23094 shutdown 2024-08-31T06:30:16.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 1 -- 172.21.15.53:0/3759194440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 msgr2=0x5585feef3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feef3770 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f97700a89d0 tx=0x7f977000b4c0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 1 -- 172.21.15.53:0/3759194440 shutdown_connections 2024-08-31T06:30:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x5585feb2b070 0x5585fef5f2c0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5585feb0a390 0x5585fef5b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5585feb021b0 0x5585feef3770 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f97697fa640 0 client.23094 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:30:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 1 --2- 172.21.15.53:0/3759194440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585feae99f0 0x5585feef3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 1 -- 172.21.15.53:0/3759194440 >> 172.21.15.53:0/3759194440 conn(0x5585feb1f460 msgr2=0x5585feed1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 1 -- 172.21.15.53:0/3759194440 shutdown_connections 2024-08-31T06:30:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 1 -- 172.21.15.53:0/3759194440 wait complete. 2024-08-31T06:30:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.032+0000 7f978e76f740 20 client.23094 trim_cache size 0 max 16384 2024-08-31T06:30:16.041 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:30:16.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 -- 172.21.15.53:0/1039467900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f976c0b4ca0 msgr2=0x7f976c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:16.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f976c0b4ca0 0x7f976c0b71b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9778005fd0 tx=0x7f9778009800 comp rx=0 tx=0).stop 2024-08-31T06:30:16.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 -- 172.21.15.53:0/1039467900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9780109240 msgr2=0x7f978019a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9780109240 0x7f978019a6f0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f977000d740 tx=0x7f977000dc00 comp rx=0 tx=0).stop 2024-08-31T06:30:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 -- 172.21.15.53:0/1039467900 shutdown_connections 2024-08-31T06:30:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f976c0b4ca0 0x7f976c0b71b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9780109b90 0x7f978019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9780109240 0x7f978019a6f0 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 --2- 172.21.15.53:0/1039467900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780103900 0x7f978019a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 -- 172.21.15.53:0/1039467900 >> 172.21.15.53:0/1039467900 conn(0x7f978007b5f0 msgr2=0x7f9780107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 -- 172.21.15.53:0/1039467900 shutdown_connections 2024-08-31T06:30:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:16.033+0000 7f97881fa640 1 -- 172.21.15.53:0/1039467900 wait complete. 2024-08-31T06:30:16.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:15 smithi053 ceph-mon[18924]: pgmap v1122: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 295 op/s 2024-08-31T06:30:16.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:15 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/483791849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:15 smithi130 ceph-mon[22266]: pgmap v1122: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 295 op/s 2024-08-31T06:30:16.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:15 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/483791849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:16.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 604 sec 2024-08-31T06:30:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:15 smithi153 ceph-mon[22320]: pgmap v1122: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 295 op/s 2024-08-31T06:30:16.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:15 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/483791849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:16.438 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --set-id 5e6f3376 --release --await' 2024-08-31T06:30:16.438 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --set-id 5e6f3376 --release --await 2024-08-31T06:30:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:17.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:30:17.409 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 605 sec 2024-08-31T06:30:17.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.649+0000 7f746c690640 1 -- 172.21.15.53:0/3155378771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7464102820 msgr2=0x7f7464102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:17.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.649+0000 7f746c690640 1 --2- 172.21.15.53:0/3155378771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7464102820 0x7f7464102c30 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f7460009900 tx=0x7f746002a410 comp rx=0 tx=0).stop 2024-08-31T06:30:17.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.649+0000 7f746c690640 1 -- 172.21.15.53:0/3155378771 shutdown_connections 2024-08-31T06:30:17.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.649+0000 7f746c690640 1 --2- 172.21.15.53:0/3155378771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7464108ab0 0x7f746410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.649+0000 7f746c690640 1 --2- 172.21.15.53:0/3155378771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7464108160 0x7f7464108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.649+0000 7f746c690640 1 --2- 172.21.15.53:0/3155378771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7464102820 0x7f7464102c30 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.649+0000 7f746c690640 1 -- 172.21.15.53:0/3155378771 >> 172.21.15.53:0/3155378771 conn(0x7f74640794e0 msgr2=0x7f74640798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:17.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.649+0000 7f746c690640 1 -- 172.21.15.53:0/3155378771 shutdown_connections 2024-08-31T06:30:17.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.649+0000 7f746c690640 1 -- 172.21.15.53:0/3155378771 wait complete. 2024-08-31T06:30:17.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.650+0000 7f746c690640 1 Processor -- start 2024-08-31T06:30:17.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.650+0000 7f746c690640 1 -- start start 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746c690640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7464102820 0x7f746419c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746c690640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7464108160 0x7f746419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746c690640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7464108ab0 0x7f74641a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746c690640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f74641125c0 con 0x7f7464102820 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746c690640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7464112440 con 0x7f7464108160 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746c690640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7464112740 con 0x7f7464108ab0 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746a42c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7464102820 0x7f746419c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746a42c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7464102820 0x7f746419c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41012/0 (socket says 172.21.15.53:41012) 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746a42c640 1 -- 172.21.15.53:0/1903533122 learned_addr learned my addr 172.21.15.53:0/1903533122 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f7469c2b640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7464108160 0x7f746419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746ac2d640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7464108ab0 0x7f74641a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746a42c640 1 -- 172.21.15.53:0/1903533122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7464108ab0 msgr2=0x7f74641a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746a42c640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7464108ab0 0x7f74641a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746a42c640 1 -- 172.21.15.53:0/1903533122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7464108160 msgr2=0x7f746419c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:17.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746a42c640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7464108160 0x7f746419c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746a42c640 1 -- 172.21.15.53:0/1903533122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74641a2350 con 0x7f7464102820 2024-08-31T06:30:17.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746ac2d640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7464108ab0 0x7f74641a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:17.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.651+0000 7f746a42c640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7464102820 0x7f746419c3e0 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f7460009230 tx=0x7f7460004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:17.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.652+0000 7f745b7fe640 1 -- 172.21.15.53:0/1903533122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746003f030 con 0x7f7464102820 2024-08-31T06:30:17.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.652+0000 7f745b7fe640 1 -- 172.21.15.53:0/1903533122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7460003a80 con 0x7f7464102820 2024-08-31T06:30:17.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.652+0000 7f745b7fe640 1 -- 172.21.15.53:0/1903533122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460035070 con 0x7f7464102820 2024-08-31T06:30:17.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.652+0000 7f746c690640 1 -- 172.21.15.53:0/1903533122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74641a25e0 con 0x7f7464102820 2024-08-31T06:30:17.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.652+0000 7f746c690640 1 -- 172.21.15.53:0/1903533122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74641a8da0 con 0x7f7464102820 2024-08-31T06:30:17.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f745b7fe640 1 -- 172.21.15.53:0/1903533122 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7460042030 con 0x7f7464102820 2024-08-31T06:30:17.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f7472c05740 1 Processor -- start 2024-08-31T06:30:17.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f7472c05740 1 -- start start 2024-08-31T06:30:17.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f7472c05740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c288520 0x56311c62dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f7472c05740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c62e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f7472c05740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c62e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f7472c05740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56311c5a4a70 con 0x56311c25f660 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f7472c05740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56311c594000 con 0x56311c288520 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f7472c05740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56311c597fb0 con 0x56311c267840 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f746a42c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c62e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f746a42c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c62e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41020/0 (socket says 172.21.15.53:41020) 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f746a42c640 1 -- 172.21.15.53:0/2670643668 learned_addr learned my addr 172.21.15.53:0/2670643668 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.655+0000 7f746ac2d640 1 --2- 172.21.15.53:0/2670643668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c288520 0x56311c62dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f7469c2b640 1 --2- 172.21.15.53:0/2670643668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c62e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f746a42c640 1 -- 172.21.15.53:0/2670643668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 msgr2=0x56311c62e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f746a42c640 1 --2- 172.21.15.53:0/2670643668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c62e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f746a42c640 1 -- 172.21.15.53:0/2670643668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c288520 msgr2=0x56311c62dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:17.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f746a42c640 1 --2- 172.21.15.53:0/2670643668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c288520 0x56311c62dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f746a42c640 1 -- 172.21.15.53:0/2670643668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311c2f3b00 con 0x56311c25f660 2024-08-31T06:30:17.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f745b7fe640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74500b4d20 0x7f74500b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f746ac2d640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74500b4d20 0x7f74500b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f746a42c640 1 --2- 172.21.15.53:0/2670643668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c62e1c0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f74601032f0 tx=0x7f7460109f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc88a3868b307aab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:17.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f745b7fe640 1 -- 172.21.15.53:0/1903533122 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f7460105c50 con 0x7f7464102820 2024-08-31T06:30:17.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f7458ff9640 1 -- 172.21.15.53:0/2670643668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600c81e0 con 0x56311c25f660 2024-08-31T06:30:17.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f7458ff9640 1 -- 172.21.15.53:0/2670643668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74600cbe30 con 0x56311c25f660 2024-08-31T06:30:17.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.656+0000 7f7458ff9640 1 -- 172.21.15.53:0/2670643668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600cba90 con 0x56311c25f660 2024-08-31T06:30:17.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.657+0000 7f7472c05740 1 -- 172.21.15.53:0/2670643668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 msgr2=0x56311c62e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.657+0000 7f7472c05740 1 --2- 172.21.15.53:0/2670643668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c62e1c0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f74601032f0 tx=0x7f7460109f20 comp rx=0 tx=0).stop 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.657+0000 7f746ac2d640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74500b4d20 0x7f74500b7230 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f745c005fd0 tx=0x7f745c009780 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.657+0000 7f7472c05740 1 -- 172.21.15.53:0/2670643668 shutdown_connections 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.657+0000 7f7472c05740 1 --2- 172.21.15.53:0/2670643668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c62e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.657+0000 7f7472c05740 1 --2- 172.21.15.53:0/2670643668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c62e1c0 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.657+0000 7f7472c05740 1 --2- 172.21.15.53:0/2670643668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c288520 0x56311c62dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.657+0000 7f7472c05740 1 -- 172.21.15.53:0/2670643668 >> 172.21.15.53:0/2670643668 conn(0x56311c27c910 msgr2=0x56311c62bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.657+0000 7f7472c05740 1 -- 172.21.15.53:0/2670643668 shutdown_connections 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.657+0000 7f7472c05740 1 -- 172.21.15.53:0/2670643668 wait complete. 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.658+0000 7f7472c05740 1 -- start start 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.658+0000 7f7472c05740 1 Processor -- start 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.658+0000 7f7472c05740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c25f660 0x56311c639840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.658+0000 7f7472c05740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c267840 0x56311c639d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.658+0000 7f7472c05740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c645600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.658+0000 7f7472c05740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56311c63c220 con 0x56311c288520 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.658+0000 7f7472c05740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56311c555520 con 0x56311c267840 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.658+0000 7f746ac2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c645600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.658+0000 7f7472c05740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56311c63c3a0 con 0x56311c25f660 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f746ac2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c645600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41024/0 (socket says 172.21.15.53:41024) 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f746ac2d640 1 -- 172.21.15.53:0/391749928 learned_addr learned my addr 172.21.15.53:0/391749928 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f7472c05740 10 client.0 _ll_register_callbacks cb 0x56311c58dc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f746a42c640 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c25f660 0x56311c639840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f7469c2b640 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c267840 0x56311c639d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f746ac2d640 1 -- 172.21.15.53:0/391749928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c25f660 msgr2=0x56311c639840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f746ac2d640 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c25f660 0x56311c639840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f746ac2d640 1 -- 172.21.15.53:0/391749928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c267840 msgr2=0x56311c639d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:17.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f746ac2d640 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c267840 0x56311c639d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f746ac2d640 1 -- 172.21.15.53:0/391749928 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311c36a960 con 0x56311c288520 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f7469c2b640 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c267840 0x56311c639d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f746ac2d640 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c645600 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f745c011c80 tx=0x7f745c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87714a159faac130 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f744dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f744dffb640 1 -- 172.21.15.53:0/391749928 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c010ea0 con 0x56311c288520 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f744dffb640 1 -- 172.21.15.53:0/391749928 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f745c028600 con 0x56311c288520 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f7472c05740 1 -- 172.21.15.53:0/391749928 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56311c5339a0 con 0x56311c288520 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f744dffb640 1 -- 172.21.15.53:0/391749928 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f745c028800 con 0x56311c288520 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.659+0000 7f7472c05740 10 client.23106 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.660+0000 7f7472c05740 1 -- 172.21.15.53:0/391749928 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x56311c648350 con 0x56311c288520 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.660+0000 7f744dffb640 1 -- 172.21.15.53:0/391749928 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56311c5339a0 con 0x56311c288520 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.660+0000 7f744dffb640 1 -- 172.21.15.53:0/391749928 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f745c00f040 con 0x56311c288520 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.660+0000 7f7472c05740 10 client.23106 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.660+0000 7f7472c05740 10 client.23106 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.660+0000 7f7472c05740 20 client.23106 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:17.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.660+0000 7f7472c05740 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56311c246ea0 0x56311c64b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.660+0000 7f7472c05740 4 client.23106 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.660+0000 7f7472c05740 1 -- 172.21.15.53:0/391749928 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56311c5a69c0 con 0x56311c246ea0 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.660+0000 7f746a42c640 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56311c246ea0 0x56311c64b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.661+0000 7f746a42c640 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56311c246ea0 0x56311c64b8a0 crc :-1 s=READY pgs=586 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a1267bf946ab0e7 server_cookie=ac4c02ccb36a3289 in_seq=0 out_seq=0 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.661+0000 7f744dffb640 10 client.23106 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.661+0000 7f744dffb640 1 -- 172.21.15.53:0/391749928 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56311c5a69c0 con 0x56311c246ea0 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f744dffb640 10 client.23106 handle_command_reply: tid=0 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 1 client.23106 shutdown 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 1 -- 172.21.15.53:0/391749928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 msgr2=0x56311c645600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c645600 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f745c011c80 tx=0x7f745c004a40 comp rx=0 tx=0).stop 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 1 -- 172.21.15.53:0/391749928 shutdown_connections 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56311c246ea0 0x56311c64b8a0 crc :-1 s=READY pgs=586 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c645600 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f744dffb640 0 client.23106 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c267840 0x56311c639d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 1 --2- 172.21.15.53:0/391749928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c25f660 0x56311c639840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 1 -- 172.21.15.53:0/391749928 >> 172.21.15.53:0/391749928 conn(0x56311c27c910 msgr2=0x56311c630e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:17.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 1 -- 172.21.15.53:0/391749928 shutdown_connections 2024-08-31T06:30:17.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 1 -- 172.21.15.53:0/391749928 wait complete. 2024-08-31T06:30:17.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.662+0000 7f7472c05740 20 client.23106 trim_cache size 0 max 16384 2024-08-31T06:30:17.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.685+0000 7f7472c05740 1 Processor -- start 2024-08-31T06:30:17.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.685+0000 7f7472c05740 1 -- start start 2024-08-31T06:30:17.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.685+0000 7f7472c05740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c25f660 0x56311c632d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.685+0000 7f7472c05740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c6332d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.685+0000 7f7472c05740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c62b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.685+0000 7f7472c05740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f74641b1780 con 0x56311c288520 2024-08-31T06:30:17.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.685+0000 7f7472c05740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f74641b3380 con 0x56311c25f660 2024-08-31T06:30:17.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.685+0000 7f7472c05740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f74641b1e50 con 0x56311c267840 2024-08-31T06:30:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.685+0000 7f746ac2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c62b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.685+0000 7f746ac2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c62b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41036/0 (socket says 172.21.15.53:41036) 2024-08-31T06:30:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.685+0000 7f746ac2d640 1 -- 172.21.15.53:0/1644700120 learned_addr learned my addr 172.21.15.53:0/1644700120 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f7469c2b640 1 --2- 172.21.15.53:0/1644700120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c6332d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f746a42c640 1 --2- 172.21.15.53:0/1644700120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c25f660 0x56311c632d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f746ac2d640 1 -- 172.21.15.53:0/1644700120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 msgr2=0x56311c6332d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f746ac2d640 1 --2- 172.21.15.53:0/1644700120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c6332d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f746ac2d640 1 -- 172.21.15.53:0/1644700120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c25f660 msgr2=0x56311c632d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f746ac2d640 1 --2- 172.21.15.53:0/1644700120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c25f660 0x56311c632d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f746ac2d640 1 -- 172.21.15.53:0/1644700120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311c639f20 con 0x56311c288520 2024-08-31T06:30:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f746a42c640 1 --2- 172.21.15.53:0/1644700120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c25f660 0x56311c632d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:17.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f746ac2d640 1 --2- 172.21.15.53:0/1644700120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c62b160 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f745c005fa0 tx=0x7f745c009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e851ded18cb35d7f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:17.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f744ffff640 1 -- 172.21.15.53:0/1644700120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c034070 con 0x56311c288520 2024-08-31T06:30:17.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f744ffff640 1 -- 172.21.15.53:0/1644700120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f745c035040 con 0x56311c288520 2024-08-31T06:30:17.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.686+0000 7f744ffff640 1 -- 172.21.15.53:0/1644700120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c011220 con 0x56311c288520 2024-08-31T06:30:17.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.687+0000 7f7472c05740 1 -- 172.21.15.53:0/1644700120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 msgr2=0x56311c62b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:17.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.687+0000 7f7472c05740 1 --2- 172.21.15.53:0/1644700120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c62b160 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f745c005fa0 tx=0x7f745c009910 comp rx=0 tx=0).stop 2024-08-31T06:30:17.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.687+0000 7f7472c05740 1 -- 172.21.15.53:0/1644700120 shutdown_connections 2024-08-31T06:30:17.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.687+0000 7f7472c05740 1 --2- 172.21.15.53:0/1644700120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c288520 0x56311c62b160 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.687+0000 7f7472c05740 1 --2- 172.21.15.53:0/1644700120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c6332d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.687+0000 7f7472c05740 1 --2- 172.21.15.53:0/1644700120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c25f660 0x56311c632d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.687+0000 7f7472c05740 1 -- 172.21.15.53:0/1644700120 >> 172.21.15.53:0/1644700120 conn(0x56311c27c910 msgr2=0x56311c637ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:17.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.688+0000 7f7472c05740 1 -- 172.21.15.53:0/1644700120 shutdown_connections 2024-08-31T06:30:17.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.688+0000 7f7472c05740 1 -- 172.21.15.53:0/1644700120 wait complete. 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.688+0000 7f7472c05740 1 -- start start 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.688+0000 7f7472c05740 1 Processor -- start 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.688+0000 7f7472c05740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c63de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.688+0000 7f7472c05740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c63e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f7472c05740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c288520 0x56311c6af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f7472c05740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f74641b2cb0 con 0x56311c25f660 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f7472c05740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f74641b2520 con 0x56311c288520 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f7472c05740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f74641af780 con 0x56311c267840 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f7472c05740 10 client.0 _ll_register_callbacks cb 0x7f745c009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f746a42c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c63de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f746a42c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c63de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41052/0 (socket says 172.21.15.53:41052) 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f746a42c640 1 -- 172.21.15.53:0/3239125409 learned_addr learned my addr 172.21.15.53:0/3239125409 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f7469c2b640 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c63e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f746ac2d640 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c288520 0x56311c6af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f746a42c640 1 -- 172.21.15.53:0/3239125409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 msgr2=0x56311c63e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f746a42c640 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c63e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f746a42c640 1 -- 172.21.15.53:0/3239125409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c288520 msgr2=0x56311c6af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f746a42c640 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c288520 0x56311c6af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f746a42c640 1 -- 172.21.15.53:0/3239125409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311c6af910 con 0x56311c25f660 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f746a42c640 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c63de90 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f7460000c00 tx=0x7f7460005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8881f867f7b15da1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.689+0000 7f744dffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.690+0000 7f744dffb640 1 -- 172.21.15.53:0/3239125409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460049040 con 0x56311c25f660 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.690+0000 7f744dffb640 1 -- 172.21.15.53:0/3239125409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f7460003c30 con 0x56311c25f660 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.690+0000 7f7472c05740 1 -- 172.21.15.53:0/3239125409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f745c035040 con 0x56311c25f660 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.690+0000 7f744dffb640 1 -- 172.21.15.53:0/3239125409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f74600cbc70 con 0x56311c25f660 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.690+0000 7f7472c05740 10 client.23112 fetch_fsmap learned FSMap version 90 2024-08-31T06:30:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.690+0000 7f7472c05740 1 -- 172.21.15.53:0/3239125409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) -- 0x56311c6b6d10 con 0x56311c25f660 2024-08-31T06:30:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.690+0000 7f744dffb640 1 -- 172.21.15.53:0/3239125409 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f745c035040 con 0x56311c25f660 2024-08-31T06:30:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.690+0000 7f744dffb640 1 -- 172.21.15.53:0/3239125409 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 90) ==== 8378+0+0 (secure 0 0 0) 0x7f7460103600 con 0x56311c25f660 2024-08-31T06:30:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.690+0000 7f7472c05740 10 client.23112 fetch_fsmap finished waiting for FSMap version 90 2024-08-31T06:30:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.691+0000 7f7472c05740 10 client.23112 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:30:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.691+0000 7f7472c05740 20 client.23112 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.691+0000 7f7472c05740 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56311c21c250 0x56311c6b9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.691+0000 7f7472c05740 4 client.23112 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5e6f3376", "release": true, "await": true}] 2024-08-31T06:30:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.691+0000 7f7472c05740 1 -- 172.21.15.53:0/3239125409 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5e6f3376", "release": true, "await": true}) -- 0x56311c5a2460 con 0x56311c21c250 2024-08-31T06:30:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.691+0000 7f7469c2b640 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56311c21c250 0x56311c6b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.691+0000 7f7469c2b640 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56311c21c250 0x56311c6b9340 crc :-1 s=READY pgs=587 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cc347ca9e30b55f server_cookie=938e382b6ddce1f9 in_seq=0 out_seq=0 2024-08-31T06:30:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.691+0000 7f744dffb640 10 client.23112 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:17.733 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.735+0000 7f744dffb640 1 -- 172.21.15.53:0/3239125409 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56311c5a2460 con 0x56311c21c250 2024-08-31T06:30:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.735+0000 7f744dffb640 10 client.23112 handle_command_reply: tid=0 2024-08-31T06:30:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.735+0000 7f7472c05740 1 client.23112 shutdown 2024-08-31T06:30:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f7472c05740 1 -- 172.21.15.53:0/3239125409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 msgr2=0x56311c63de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f7472c05740 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c63de90 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f7460000c00 tx=0x7f7460005ef0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f7472c05740 1 -- 172.21.15.53:0/3239125409 shutdown_connections 2024-08-31T06:30:17.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f7472c05740 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x56311c21c250 0x56311c6b9340 crc :-1 s=READY pgs=587 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f7472c05740 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56311c288520 0x56311c6af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f7472c05740 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56311c267840 0x56311c63e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f7472c05740 1 --2- 172.21.15.53:0/3239125409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56311c25f660 0x56311c63de90 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f7472c05740 1 -- 172.21.15.53:0/3239125409 >> 172.21.15.53:0/3239125409 conn(0x56311c27c910 msgr2=0x56311c632d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f744dffb640 0 client.23112 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f7472c05740 1 -- 172.21.15.53:0/3239125409 shutdown_connections 2024-08-31T06:30:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f7472c05740 1 -- 172.21.15.53:0/3239125409 wait complete. 2024-08-31T06:30:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.736+0000 7f7472c05740 20 client.23112 trim_cache size 0 max 16384 2024-08-31T06:30:17.739 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:30:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 90, 2024-08-31T06:30:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:30:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 84, 2024-08-31T06:30:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": { 2024-08-31T06:30:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "5e6f3376": { 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "version": 84, 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "age_ref": 0.0, 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "timeout": 90.0, 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "expiration": 131.3, 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "members": { 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "file:/": { 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "excluded": false, 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "state": { 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RELEASED", 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.0 2024-08-31T06:30:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:17.741 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:30:17.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 -- 172.21.15.53:0/1903533122 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74500b4d20 msgr2=0x7f74500b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:17.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74500b4d20 0x7f74500b7230 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f745c005fd0 tx=0x7f745c009780 comp rx=0 tx=0).stop 2024-08-31T06:30:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 -- 172.21.15.53:0/1903533122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7464102820 msgr2=0x7f746419c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7464102820 0x7f746419c3e0 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f7460009230 tx=0x7f7460004270 comp rx=0 tx=0).stop 2024-08-31T06:30:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 -- 172.21.15.53:0/1903533122 shutdown_connections 2024-08-31T06:30:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f74500b4d20 0x7f74500b7230 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7464108ab0 0x7f74641a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7464108160 0x7f746419c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 --2- 172.21.15.53:0/1903533122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7464102820 0x7f746419c3e0 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 -- 172.21.15.53:0/1903533122 >> 172.21.15.53:0/1903533122 conn(0x7f74640794e0 msgr2=0x7f746406ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 -- 172.21.15.53:0/1903533122 shutdown_connections 2024-08-31T06:30:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:17.737+0000 7f746c690640 1 -- 172.21.15.53:0/1903533122 wait complete. 2024-08-31T06:30:18.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:17 smithi130 ceph-mon[22266]: pgmap v1123: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-08-31T06:30:18.410 INFO:tasks.workunit.client.0.smithi053.stdout: 10 cleanup 606 sec 2024-08-31T06:30:18.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:17 smithi153 ceph-mon[22320]: pgmap v1123: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-08-31T06:30:18.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:17 smithi053 ceph-mon[18924]: pgmap v1123: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-08-31T06:30:18.474 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5e6f3376', total seconds elapsed: 16.8 2024-08-31T06:30:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.000+0000 7fae0c5d2640 1 -- 172.21.15.53:0/1560306725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04109ba0 msgr2=0x7fae041103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.000+0000 7fae0c5d2640 1 --2- 172.21.15.53:0/1560306725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04109ba0 0x7fae041103d0 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009ca0 tx=0x7fadfc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.000+0000 7fae0c5d2640 1 -- 172.21.15.53:0/1560306725 shutdown_connections 2024-08-31T06:30:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.000+0000 7fae0c5d2640 1 --2- 172.21.15.53:0/1560306725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04109ba0 0x7fae041103d0 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.000+0000 7fae0c5d2640 1 --2- 172.21.15.53:0/1560306725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04109250 0x7fae04109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.000+0000 7fae0c5d2640 1 --2- 172.21.15.53:0/1560306725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04101d10 0x7fae04102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.000+0000 7fae0c5d2640 1 -- 172.21.15.53:0/1560306725 >> 172.21.15.53:0/1560306725 conn(0x7fae04077a00 msgr2=0x7fae04077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.000+0000 7fae0c5d2640 1 -- 172.21.15.53:0/1560306725 shutdown_connections 2024-08-31T06:30:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.000+0000 7fae0c5d2640 1 -- 172.21.15.53:0/1560306725 wait complete. 2024-08-31T06:30:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.001+0000 7fae0c5d2640 1 Processor -- start 2024-08-31T06:30:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.001+0000 7fae0c5d2640 1 -- start start 2024-08-31T06:30:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.001+0000 7fae0c5d2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04101d10 0x7fae0419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0c5d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04109250 0x7fae0419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0c5d2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04109ba0 0x7fae0419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0c5d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fae04113760 con 0x7fae04109250 2024-08-31T06:30:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0c5d2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae041135e0 con 0x7fae04109ba0 2024-08-31T06:30:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0c5d2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae041138e0 con 0x7fae04101d10 2024-08-31T06:30:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae09b6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04109250 0x7fae0419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0a36e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04101d10 0x7fae0419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0a36e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04101d10 0x7fae0419a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49284/0 (socket says 172.21.15.53:49284) 2024-08-31T06:30:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0a36e640 1 -- 172.21.15.53:0/762450256 learned_addr learned my addr 172.21.15.53:0/762450256 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04109ba0 0x7fae0419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0a36e640 1 -- 172.21.15.53:0/762450256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04109ba0 msgr2=0x7fae0419f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0a36e640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04109ba0 0x7fae0419f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0a36e640 1 -- 172.21.15.53:0/762450256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04109250 msgr2=0x7fae0419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0a36e640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04109250 0x7fae0419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0a36e640 1 -- 172.21.15.53:0/762450256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae041a0060 con 0x7fae04101d10 2024-08-31T06:30:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.002+0000 7fae0a36e640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04101d10 0x7fae0419a0f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae0000e9f0 tx=0x7fae0000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.003+0000 7fadfb7fe640 1 -- 172.21.15.53:0/762450256 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0000cd80 con 0x7fae04101d10 2024-08-31T06:30:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.003+0000 7fae0c5d2640 1 -- 172.21.15.53:0/762450256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae041a0350 con 0x7fae04101d10 2024-08-31T06:30:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.003+0000 7fadfb7fe640 1 -- 172.21.15.53:0/762450256 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae000054b0 con 0x7fae04101d10 2024-08-31T06:30:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.003+0000 7fadfb7fe640 1 -- 172.21.15.53:0/762450256 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00010430 con 0x7fae04101d10 2024-08-31T06:30:19.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.003+0000 7fae0c5d2640 1 -- 172.21.15.53:0/762450256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae04102b90 con 0x7fae04101d10 2024-08-31T06:30:19.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae12b47740 1 Processor -- start 2024-08-31T06:30:19.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae12b47740 1 -- start start 2024-08-31T06:30:19.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae12b47740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa4e070 0x56348adf3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae12b47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa251b0 0x56348adf3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae12b47740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 0x56348adf3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae12b47740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56348ad6a680 con 0x56348aa4e070 2024-08-31T06:30:19.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae12b47740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56348ad59c10 con 0x56348aa2d390 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae12b47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56348ad5dbc0 con 0x56348aa251b0 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae0ab6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa4e070 0x56348adf3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae09b6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 0x56348adf3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae09b6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 0x56348adf3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52194/0 (socket says 172.21.15.53:52194) 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.006+0000 7fae09b6d640 1 -- 172.21.15.53:0/2304028209 learned_addr learned my addr 172.21.15.53:0/2304028209 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.007+0000 7fadfb7fe640 1 -- 172.21.15.53:0/762450256 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fae000046c0 con 0x7fae04101d10 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.007+0000 7fae0a36e640 1 --2- 172.21.15.53:0/2304028209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa251b0 0x56348adf3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.007+0000 7fae0ab6f640 1 -- 172.21.15.53:0/2304028209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa251b0 msgr2=0x56348adf3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.007+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/2304028209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa251b0 0x56348adf3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.007+0000 7fae0ab6f640 1 -- 172.21.15.53:0/2304028209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 msgr2=0x56348adf3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.007+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/2304028209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 0x56348adf3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.007+0000 7fae0ab6f640 1 -- 172.21.15.53:0/2304028209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348aab9650 con 0x56348aa4e070 2024-08-31T06:30:19.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.007+0000 7fae09b6d640 1 --2- 172.21.15.53:0/2304028209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 0x56348adf3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:19.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.007+0000 7fae0a36e640 1 --2- 172.21.15.53:0/2304028209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa251b0 0x56348adf3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:19.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.007+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/2304028209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa4e070 0x56348adf3310 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fadfc031040 tx=0x7fadfc009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4a9b6d071b7a31 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.007+0000 7fadf8ff9640 1 -- 172.21.15.53:0/2304028209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc031790 con 0x56348aa4e070 2024-08-31T06:30:19.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.008+0000 7fadf8ff9640 1 -- 172.21.15.53:0/2304028209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadfc036030 con 0x56348aa4e070 2024-08-31T06:30:19.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.008+0000 7fadf8ff9640 1 -- 172.21.15.53:0/2304028209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc004330 con 0x56348aa4e070 2024-08-31T06:30:19.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.008+0000 7fadfb7fe640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadf00b9130 0x7fadf00bb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.008+0000 7fae0a36e640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadf00b9130 0x7fadf00bb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.008+0000 7fadfb7fe640 1 -- 172.21.15.53:0/762450256 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fae000e5940 con 0x7fae04101d10 2024-08-31T06:30:19.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae12b47740 1 -- 172.21.15.53:0/2304028209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa4e070 msgr2=0x56348adf3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae0a36e640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadf00b9130 0x7fadf00bb640 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x56348adf1f90 tx=0x7fae00070a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae12b47740 1 --2- 172.21.15.53:0/2304028209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa4e070 0x56348adf3310 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fadfc031040 tx=0x7fadfc009a20 comp rx=0 tx=0).stop 2024-08-31T06:30:19.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae12b47740 1 -- 172.21.15.53:0/2304028209 shutdown_connections 2024-08-31T06:30:19.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae12b47740 1 --2- 172.21.15.53:0/2304028209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 0x56348adf3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae12b47740 1 --2- 172.21.15.53:0/2304028209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa251b0 0x56348adf3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae12b47740 1 --2- 172.21.15.53:0/2304028209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa4e070 0x56348adf3310 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae12b47740 1 -- 172.21.15.53:0/2304028209 >> 172.21.15.53:0/2304028209 conn(0x56348aa42460 msgr2=0x56348adf1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae12b47740 1 -- 172.21.15.53:0/2304028209 shutdown_connections 2024-08-31T06:30:19.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae12b47740 1 -- 172.21.15.53:0/2304028209 wait complete. 2024-08-31T06:30:19.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae12b47740 1 -- start start 2024-08-31T06:30:19.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.009+0000 7fae12b47740 1 Processor -- start 2024-08-31T06:30:19.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae12b47740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348adfeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae12b47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa2d390 0x56348adff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae12b47740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa4e070 0x56348ae0ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae12b47740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56348abbc700 con 0x56348aa251b0 2024-08-31T06:30:19.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae12b47740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56348ace0750 con 0x56348aa4e070 2024-08-31T06:30:19.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae12b47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56348ae01910 con 0x56348aa2d390 2024-08-31T06:30:19.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae12b47740 10 client.0 _ll_register_callbacks cb 0x56348ad0fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:19.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae0ab6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348adfeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae09b6d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa2d390 0x56348adff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae0ab6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348adfeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41086/0 (socket says 172.21.15.53:41086) 2024-08-31T06:30:19.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae09b6d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa2d390 0x56348adff0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49296/0 (socket says 172.21.15.53:49296) 2024-08-31T06:30:19.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae0ab6f640 1 -- 172.21.15.53:0/4168425518 learned_addr learned my addr 172.21.15.53:0/4168425518 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:19.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.010+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa4e070 0x56348ae0ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.011+0000 7fae0ab6f640 1 -- 172.21.15.53:0/4168425518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa2d390 msgr2=0x56348adff0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.011+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa2d390 0x56348adff0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.011+0000 7fae0ab6f640 1 -- 172.21.15.53:0/4168425518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa4e070 msgr2=0x56348ae0ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.011+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa4e070 0x56348ae0ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.011+0000 7fae0ab6f640 1 -- 172.21.15.53:0/4168425518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348ad19900 con 0x56348aa251b0 2024-08-31T06:30:19.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.011+0000 7fae09b6d640 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa2d390 0x56348adff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:19.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.011+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348adfeb20 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0097b0 tx=0x7fadfc0095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7db0c9b1cc7af2c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.011+0000 7fadedffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:19.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.011+0000 7fadedffb640 1 -- 172.21.15.53:0/4168425518 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc059060 con 0x56348aa251b0 2024-08-31T06:30:19.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.011+0000 7fadedffb640 1 -- 172.21.15.53:0/4168425518 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fadfc003da0 con 0x56348aa251b0 2024-08-31T06:30:19.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.011+0000 7fae12b47740 1 -- 172.21.15.53:0/4168425518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadfc036030 con 0x56348aa251b0 2024-08-31T06:30:19.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fadedffb640 1 -- 172.21.15.53:0/4168425518 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fadfc0040b0 con 0x56348aa251b0 2024-08-31T06:30:19.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fae12b47740 10 client.23124 fetch_fsmap learned FSMap version 91 2024-08-31T06:30:19.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fae12b47740 1 -- 172.21.15.53:0/4168425518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) -- 0x56348ae0d6e0 con 0x56348aa251b0 2024-08-31T06:30:19.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fadedffb640 1 -- 172.21.15.53:0/4168425518 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadfc036030 con 0x56348aa251b0 2024-08-31T06:30:19.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fadedffb640 1 -- 172.21.15.53:0/4168425518 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 91) ==== 8390+0+0 (secure 0 0 0) 0x7fadfc043070 con 0x56348aa251b0 2024-08-31T06:30:19.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fae12b47740 10 client.23124 fetch_fsmap finished waiting for FSMap version 91 2024-08-31T06:30:19.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fae12b47740 10 client.23124 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fae12b47740 20 client.23124 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fae12b47740 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56348aa0c9f0 0x56348ae10a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fae12b47740 4 client.23124 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fae12b47740 1 -- 172.21.15.53:0/4168425518 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56348ad6c5d0 con 0x56348aa0c9f0 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.012+0000 7fae09b6d640 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56348aa0c9f0 0x56348ae10a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.013+0000 7fadedffb640 10 client.23124 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.013+0000 7fae09b6d640 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56348aa0c9f0 0x56348ae10a40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a3a910f1d28d2f5f server_cookie=85b0b5ee122fb579 in_seq=0 out_seq=0 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.014+0000 7fadedffb640 1 -- 172.21.15.53:0/4168425518 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56348ad6c5d0 con 0x56348aa0c9f0 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.014+0000 7fadedffb640 10 client.23124 handle_command_reply: tid=0 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.014+0000 7fae12b47740 1 client.23124 shutdown 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.014+0000 7fae12b47740 1 -- 172.21.15.53:0/4168425518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 msgr2=0x56348adfeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.014+0000 7fae12b47740 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348adfeb20 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0097b0 tx=0x7fadfc0095e0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.015+0000 7fae12b47740 1 -- 172.21.15.53:0/4168425518 shutdown_connections 2024-08-31T06:30:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.015+0000 7fae12b47740 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56348aa0c9f0 0x56348ae10a40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.015+0000 7fae12b47740 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa4e070 0x56348ae0ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.015+0000 7fae12b47740 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa2d390 0x56348adff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.015+0000 7fae12b47740 1 --2- 172.21.15.53:0/4168425518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348adfeb20 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.015+0000 7fadedffb640 0 client.23124 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:30:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.015+0000 7fae12b47740 1 -- 172.21.15.53:0/4168425518 >> 172.21.15.53:0/4168425518 conn(0x56348aa42460 msgr2=0x56348adf64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.015+0000 7fae12b47740 1 -- 172.21.15.53:0/4168425518 shutdown_connections 2024-08-31T06:30:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.015+0000 7fae12b47740 1 -- 172.21.15.53:0/4168425518 wait complete. 2024-08-31T06:30:19.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.015+0000 7fae12b47740 20 client.23124 trim_cache size 0 max 16384 2024-08-31T06:30:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.029+0000 7fae12b47740 1 Processor -- start 2024-08-31T06:30:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.029+0000 7fae12b47740 1 -- start start 2024-08-31T06:30:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae12b47740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa251b0 0x56348adf6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae12b47740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa2d390 0x56348ae00750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae12b47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa4e070 0x56348ae0ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae12b47740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fae041ad0f0 con 0x56348aa2d390 2024-08-31T06:30:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae12b47740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae041aed80 con 0x56348aa251b0 2024-08-31T06:30:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae12b47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae041ad850 con 0x56348aa4e070 2024-08-31T06:30:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae09b6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa2d390 0x56348ae00750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae09b6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa2d390 0x56348ae00750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41088/0 (socket says 172.21.15.53:41088) 2024-08-31T06:30:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae09b6d640 1 -- 172.21.15.53:0/564207807 learned_addr learned my addr 172.21.15.53:0/564207807 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/564207807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa251b0 0x56348adf6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/564207807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa4e070 0x56348ae0ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae09b6d640 1 -- 172.21.15.53:0/564207807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa4e070 msgr2=0x56348ae0ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae09b6d640 1 --2- 172.21.15.53:0/564207807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa4e070 0x56348ae0ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae09b6d640 1 -- 172.21.15.53:0/564207807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa251b0 msgr2=0x56348adf6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae09b6d640 1 --2- 172.21.15.53:0/564207807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa251b0 0x56348adf6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae09b6d640 1 -- 172.21.15.53:0/564207807 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348adff7b0 con 0x56348aa2d390 2024-08-31T06:30:19.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.030+0000 7fae09b6d640 1 --2- 172.21.15.53:0/564207807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa2d390 0x56348ae00750 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x56348ad59d60 tx=0x7fadf4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2dcd3b5342d95fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.031+0000 7fadeffff640 1 -- 172.21.15.53:0/564207807 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40035f0 con 0x56348aa2d390 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.031+0000 7fadeffff640 1 -- 172.21.15.53:0/564207807 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadf4003c20 con 0x56348aa2d390 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.031+0000 7fadeffff640 1 -- 172.21.15.53:0/564207807 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4025a90 con 0x56348aa2d390 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.032+0000 7fae12b47740 1 -- 172.21.15.53:0/564207807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa2d390 msgr2=0x56348ae00750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.032+0000 7fae12b47740 1 --2- 172.21.15.53:0/564207807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa2d390 0x56348ae00750 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x56348ad59d60 tx=0x7fadf4005f90 comp rx=0 tx=0).stop 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.032+0000 7fae12b47740 1 -- 172.21.15.53:0/564207807 shutdown_connections 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.032+0000 7fae12b47740 1 --2- 172.21.15.53:0/564207807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa4e070 0x56348ae0ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.032+0000 7fae12b47740 1 --2- 172.21.15.53:0/564207807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa2d390 0x56348ae00750 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.032+0000 7fae12b47740 1 --2- 172.21.15.53:0/564207807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa251b0 0x56348adf6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.032+0000 7fae12b47740 1 -- 172.21.15.53:0/564207807 >> 172.21.15.53:0/564207807 conn(0x56348aa42460 msgr2=0x56348ae00040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.032+0000 7fae12b47740 1 -- 172.21.15.53:0/564207807 shutdown_connections 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.032+0000 7fae12b47740 1 -- 172.21.15.53:0/564207807 wait complete. 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.032+0000 7fae12b47740 1 -- start start 2024-08-31T06:30:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.032+0000 7fae12b47740 1 Processor -- start 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae12b47740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348ae03430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae12b47740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 0x56348ae039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae12b47740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa4e070 0x56348ae741b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae12b47740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fae041ae6b0 con 0x56348aa251b0 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae12b47740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae041adf20 con 0x56348aa2d390 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae12b47740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae041ab0f0 con 0x56348aa4e070 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae12b47740 10 client.0 _ll_register_callbacks cb 0x7fadf40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae0ab6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348ae03430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae0ab6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348ae03430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41104/0 (socket says 172.21.15.53:41104) 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae0ab6f640 1 -- 172.21.15.53:0/2753025675 learned_addr learned my addr 172.21.15.53:0/2753025675 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae09b6d640 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 0x56348ae039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.033+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa4e070 0x56348ae741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.034+0000 7fae0ab6f640 1 -- 172.21.15.53:0/2753025675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa4e070 msgr2=0x56348ae741b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.034+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa4e070 0x56348ae741b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.034+0000 7fae0ab6f640 1 -- 172.21.15.53:0/2753025675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 msgr2=0x56348ae039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.034+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 0x56348ae039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.034+0000 7fae0ab6f640 1 -- 172.21.15.53:0/2753025675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348ae74820 con 0x56348aa251b0 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.034+0000 7fae0ab6f640 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348ae03430 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fadfc02ade0 tx=0x7fadfc031690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80ec2e7a2048d96 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.034+0000 7fadedffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.034+0000 7fadedffb640 1 -- 172.21.15.53:0/2753025675 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc06c060 con 0x56348aa251b0 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.034+0000 7fadedffb640 1 -- 172.21.15.53:0/2753025675 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fadfc003d90 con 0x56348aa251b0 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.034+0000 7fae12b47740 1 -- 172.21.15.53:0/2753025675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf4003c20 con 0x56348aa251b0 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fadedffb640 1 -- 172.21.15.53:0/2753025675 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fadfc059070 con 0x56348aa251b0 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fae12b47740 10 client.23130 fetch_fsmap learned FSMap version 91 2024-08-31T06:30:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fae12b47740 1 -- 172.21.15.53:0/2753025675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) -- 0x56348ae7bb40 con 0x56348aa251b0 2024-08-31T06:30:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fadedffb640 1 -- 172.21.15.53:0/2753025675 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadf4003c20 con 0x56348aa251b0 2024-08-31T06:30:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fadedffb640 1 -- 172.21.15.53:0/2753025675 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 91) ==== 8390+0+0 (secure 0 0 0) 0x7fadfc043050 con 0x56348aa251b0 2024-08-31T06:30:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fae12b47740 10 client.23130 fetch_fsmap finished waiting for FSMap version 91 2024-08-31T06:30:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fae12b47740 10 client.23130 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:30:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fae12b47740 20 client.23130 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fae12b47740 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56348a9e1da0 0x56348ae7e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fae12b47740 4 client.23130 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:30:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fae12b47740 1 -- 172.21.15.53:0/2753025675 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56348ad68070 con 0x56348a9e1da0 2024-08-31T06:30:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.035+0000 7fae09b6d640 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56348a9e1da0 0x56348ae7e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.036+0000 7fae09b6d640 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56348a9e1da0 0x56348ae7e360 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7bd50bd7d0a6bbb4 server_cookie=91af5b52d86e3ff9 in_seq=0 out_seq=0 2024-08-31T06:30:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.036+0000 7fadedffb640 10 client.23130 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:30:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fadedffb640 1 -- 172.21.15.53:0/2753025675 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56348ad68070 con 0x56348a9e1da0 2024-08-31T06:30:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fadedffb640 10 client.23130 handle_command_reply: tid=0 2024-08-31T06:30:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fae12b47740 1 client.23130 shutdown 2024-08-31T06:30:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fae12b47740 1 -- 172.21.15.53:0/2753025675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 msgr2=0x56348ae03430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fae12b47740 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348ae03430 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fadfc02ade0 tx=0x7fadfc031690 comp rx=0 tx=0).stop 2024-08-31T06:30:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fae12b47740 1 -- 172.21.15.53:0/2753025675 shutdown_connections 2024-08-31T06:30:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fae12b47740 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x56348a9e1da0 0x56348ae7e360 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fae12b47740 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56348aa4e070 0x56348ae741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fadedffb640 0 client.23130 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:30:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fae12b47740 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56348aa2d390 0x56348ae039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fae12b47740 1 --2- 172.21.15.53:0/2753025675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56348aa251b0 0x56348ae03430 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.039+0000 7fae12b47740 1 -- 172.21.15.53:0/2753025675 >> 172.21.15.53:0/2753025675 conn(0x56348aa42460 msgr2=0x56348adf4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.040+0000 7fae12b47740 1 -- 172.21.15.53:0/2753025675 shutdown_connections 2024-08-31T06:30:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.040+0000 7fae12b47740 1 -- 172.21.15.53:0/2753025675 wait complete. 2024-08-31T06:30:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.040+0000 7fae12b47740 20 client.23130 trim_cache size 0 max 16384 2024-08-31T06:30:19.044 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 -- 172.21.15.53:0/762450256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadf00b9130 msgr2=0x7fadf00bb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadf00b9130 0x7fadf00bb640 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x56348adf1f90 tx=0x7fae00070a20 comp rx=0 tx=0).stop 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 -- 172.21.15.53:0/762450256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04101d10 msgr2=0x7fae0419a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04101d10 0x7fae0419a0f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae0000e9f0 tx=0x7fae0000edf0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 -- 172.21.15.53:0/762450256 shutdown_connections 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fadf00b9130 0x7fadf00bb640 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04109ba0 0x7fae0419f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae04109250 0x7fae0419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 --2- 172.21.15.53:0/762450256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae04101d10 0x7fae0419a0f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 -- 172.21.15.53:0/762450256 >> 172.21.15.53:0/762450256 conn(0x7fae04077a00 msgr2=0x7fae04107260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 -- 172.21.15.53:0/762450256 shutdown_connections 2024-08-31T06:30:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:19.041+0000 7fae0c5d2640 1 -- 172.21.15.53:0/762450256 wait complete. 2024-08-31T06:30:19.409 INFO:tasks.workunit.client.0.smithi053.stdout: 6 cleanup 607 sec 2024-08-31T06:30:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.470+0000 7fe22e063640 1 -- 172.21.15.53:0/41642562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe228108180 msgr2=0x7fe22810e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.470+0000 7fe22e063640 1 --2- 172.21.15.53:0/41642562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe228108180 0x7fe22810e9b0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fe22000adb0 tx=0x7fe22002b7a0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.471+0000 7fe22e063640 1 -- 172.21.15.53:0/41642562 shutdown_connections 2024-08-31T06:30:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.471+0000 7fe22e063640 1 --2- 172.21.15.53:0/41642562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe228108180 0x7fe22810e9b0 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.471+0000 7fe22e063640 1 --2- 172.21.15.53:0/41642562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe228107830 0x7fe228107c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.471+0000 7fe22e063640 1 --2- 172.21.15.53:0/41642562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe228101f00 0x7fe228102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.471+0000 7fe22e063640 1 -- 172.21.15.53:0/41642562 >> 172.21.15.53:0/41642562 conn(0x7fe228079c60 msgr2=0x7fe22807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.471+0000 7fe22e063640 1 -- 172.21.15.53:0/41642562 shutdown_connections 2024-08-31T06:30:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.471+0000 7fe22e063640 1 -- 172.21.15.53:0/41642562 wait complete. 2024-08-31T06:30:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.471+0000 7fe22e063640 1 Processor -- start 2024-08-31T06:30:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.471+0000 7fe22e063640 1 -- start start 2024-08-31T06:30:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe22e063640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe228101f00 0x7fe228197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe22e063640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe228107830 0x7fe228198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe22e063640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe228108180 0x7fe22819d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe22e063640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe228111470 con 0x7fe228107830 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe22e063640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2281112f0 con 0x7fe228108180 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe22e063640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2281115f0 con 0x7fe228101f00 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe228107830 0x7fe228198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe228107830 0x7fe228198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41110/0 (socket says 172.21.15.53:41110) 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe226ffd640 1 -- 172.21.15.53:0/2287521600 learned_addr learned my addr 172.21.15.53:0/2287521600 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe227fff640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe228108180 0x7fe22819d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe2277fe640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe228101f00 0x7fe228197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe226ffd640 1 -- 172.21.15.53:0/2287521600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe228101f00 msgr2=0x7fe228197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe226ffd640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe228101f00 0x7fe228197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe226ffd640 1 -- 172.21.15.53:0/2287521600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe228108180 msgr2=0x7fe22819d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.472+0000 7fe226ffd640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe228108180 0x7fe22819d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.473+0000 7fe226ffd640 1 -- 172.21.15.53:0/2287521600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22819de00 con 0x7fe228107830 2024-08-31T06:30:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.473+0000 7fe226ffd640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe228107830 0x7fe228198470 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00eb00 tx=0x7fe21c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.473+0000 7fe224ff9640 1 -- 172.21.15.53:0/2287521600 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c01c070 con 0x7fe228107830 2024-08-31T06:30:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.473+0000 7fe22e063640 1 -- 172.21.15.53:0/2287521600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22819e0f0 con 0x7fe228107830 2024-08-31T06:30:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.473+0000 7fe224ff9640 1 -- 172.21.15.53:0/2287521600 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe21c00bbd0 con 0x7fe228107830 2024-08-31T06:30:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.473+0000 7fe224ff9640 1 -- 172.21.15.53:0/2287521600 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0163d0 con 0x7fe228107830 2024-08-31T06:30:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.473+0000 7fe22e063640 1 -- 172.21.15.53:0/2287521600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2281a4880 con 0x7fe228107830 2024-08-31T06:30:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.476+0000 7fe234fcf740 1 Processor -- start 2024-08-31T06:30:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.476+0000 7fe234fcf740 1 -- start start 2024-08-31T06:30:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.476+0000 7fe224ff9640 1 -- 172.21.15.53:0/2287521600 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe21c01f070 con 0x7fe228107830 2024-08-31T06:30:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.476+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d65ebce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.476+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d65ec220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.476+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65ec760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.476+0000 7fe234fcf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5588d6561000 con 0x5588d62274d0 2024-08-31T06:30:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.476+0000 7fe234fcf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5588d6550590 con 0x5588d62481b0 2024-08-31T06:30:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.476+0000 7fe234fcf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5588d6554540 con 0x5588d621f2f0 2024-08-31T06:30:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65ec760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65ec760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41122/0 (socket says 172.21.15.53:41122) 2024-08-31T06:30:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe226ffd640 1 -- 172.21.15.53:0/3552722000 learned_addr learned my addr 172.21.15.53:0/3552722000 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe227fff640 1 --2- 172.21.15.53:0/3552722000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d65ebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe2277fe640 1 --2- 172.21.15.53:0/3552722000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d65ec220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe226ffd640 1 -- 172.21.15.53:0/3552722000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 msgr2=0x5588d65ec220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe226ffd640 1 --2- 172.21.15.53:0/3552722000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d65ec220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe226ffd640 1 -- 172.21.15.53:0/3552722000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 msgr2=0x5588d65ebce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe226ffd640 1 --2- 172.21.15.53:0/3552722000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d65ebce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe226ffd640 1 -- 172.21.15.53:0/3552722000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d62b3790 con 0x5588d62274d0 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe226ffd640 1 --2- 172.21.15.53:0/3552722000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65ec760 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0e42e0 tx=0x7fe21c0ef780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f85a4f3400c13f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe224ff9640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2100b4ca0 0x7fe2100b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe20dffb640 1 -- 172.21.15.53:0/3552722000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0efe60 con 0x5588d62274d0 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.477+0000 7fe227fff640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2100b4ca0 0x7fe2100b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.478+0000 7fe224ff9640 1 -- 172.21.15.53:0/2287521600 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fe21c0e6c40 con 0x7fe228107830 2024-08-31T06:30:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.478+0000 7fe20dffb640 1 -- 172.21.15.53:0/3552722000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe21c0f4070 con 0x5588d62274d0 2024-08-31T06:30:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.478+0000 7fe20dffb640 1 -- 172.21.15.53:0/3552722000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0a9280 con 0x5588d62274d0 2024-08-31T06:30:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.478+0000 7fe234fcf740 1 -- 172.21.15.53:0/3552722000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 msgr2=0x5588d65ec760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 --2- 172.21.15.53:0/3552722000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65ec760 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0e42e0 tx=0x7fe21c0ef780 comp rx=0 tx=0).stop 2024-08-31T06:30:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.478+0000 7fe227fff640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2100b4ca0 0x7fe2100b71b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe22002c010 tx=0x7fe22002bfa0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 -- 172.21.15.53:0/3552722000 shutdown_connections 2024-08-31T06:30:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 --2- 172.21.15.53:0/3552722000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65ec760 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 --2- 172.21.15.53:0/3552722000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d65ec220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 --2- 172.21.15.53:0/3552722000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d65ebce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 -- 172.21.15.53:0/3552722000 >> 172.21.15.53:0/3552722000 conn(0x5588d623c300 msgr2=0x5588d65e9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 -- 172.21.15.53:0/3552722000 shutdown_connections 2024-08-31T06:30:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 -- 172.21.15.53:0/3552722000 wait complete. 2024-08-31T06:30:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 -- start start 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 Processor -- start 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d65f7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.479+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d6603780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe234fcf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5588d6489ab0 con 0x5588d62274d0 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe234fcf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5588d64d7680 con 0x5588d62481b0 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe234fcf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5588d65fa460 con 0x5588d621f2f0 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe2277fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d65f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41134/0 (socket says 172.21.15.53:41134) 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe226ffd640 1 -- 172.21.15.53:0/2459519486 learned_addr learned my addr 172.21.15.53:0/2459519486 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe2277fe640 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d65f7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.53:49346/0 (socket says 172.21.15.53:49346) 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe234fcf740 10 client.0 _ll_register_callbacks cb 0x5588d625fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe227fff640 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d6603780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe226ffd640 1 -- 172.21.15.53:0/2459519486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 msgr2=0x5588d65f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe226ffd640 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d65f7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe226ffd640 1 -- 172.21.15.53:0/2459519486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 msgr2=0x5588d6603780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe226ffd640 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d6603780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe226ffd640 1 -- 172.21.15.53:0/2459519486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d632c620 con 0x5588d62274d0 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe227fff640 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d6603780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe226ffd640 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f7dd0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0e4420 tx=0x7fe21c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6e1c4eae516033 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe206ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe206ffd640 1 -- 172.21.15.53:0/2459519486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0acb30 con 0x5588d62274d0 2024-08-31T06:30:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe234fcf740 1 -- 172.21.15.53:0/2459519486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe21c0f4070 con 0x5588d62274d0 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe206ffd640 1 -- 172.21.15.53:0/2459519486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fe21c0a99b0 con 0x5588d62274d0 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.480+0000 7fe206ffd640 1 -- 172.21.15.53:0/2459519486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fe21c0acd10 con 0x5588d62274d0 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.481+0000 7fe234fcf740 10 client.23142 fetch_fsmap learned FSMap version 91 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.481+0000 7fe234fcf740 1 -- 172.21.15.53:0/2459519486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) -- 0x5588d6606480 con 0x5588d62274d0 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.481+0000 7fe206ffd640 1 -- 172.21.15.53:0/2459519486 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe21c0f4070 con 0x5588d62274d0 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.481+0000 7fe206ffd640 1 -- 172.21.15.53:0/2459519486 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 91) ==== 8390+0+0 (secure 0 0 0) 0x7fe21c0ad620 con 0x5588d62274d0 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.481+0000 7fe234fcf740 10 client.23142 fetch_fsmap finished waiting for FSMap version 91 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.481+0000 7fe234fcf740 10 client.23142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.481+0000 7fe234fcf740 20 client.23142 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.481+0000 7fe234fcf740 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5588d6206d80 0x5588d66097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.481+0000 7fe234fcf740 4 client.23142 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.481+0000 7fe234fcf740 1 -- 172.21.15.53:0/2459519486 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588d6562f50 con 0x5588d6206d80 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.481+0000 7fe2277fe640 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5588d6206d80 0x5588d66097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.482+0000 7fe206ffd640 10 client.23142 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.482+0000 7fe2277fe640 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5588d6206d80 0x5588d66097e0 crc :-1 s=READY pgs=588 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0b685973b224939 server_cookie=9a649a8b9c2cba62 in_seq=0 out_seq=0 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe206ffd640 1 -- 172.21.15.53:0/2459519486 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588d6562f50 con 0x5588d6206d80 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe206ffd640 10 client.23142 handle_command_reply: tid=0 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 1 client.23142 shutdown 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 1 -- 172.21.15.53:0/2459519486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 msgr2=0x5588d65f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f7dd0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0e4420 tx=0x7fe21c00b840 comp rx=0 tx=0).stop 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 1 -- 172.21.15.53:0/2459519486 shutdown_connections 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5588d6206d80 0x5588d66097e0 crc :-1 s=READY pgs=588 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d6603780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe206ffd640 0 client.23142 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f7dd0 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 1 --2- 172.21.15.53:0/2459519486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d65f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 1 -- 172.21.15.53:0/2459519486 >> 172.21.15.53:0/2459519486 conn(0x5588d623c300 msgr2=0x5588d65ecd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 1 -- 172.21.15.53:0/2459519486 shutdown_connections 2024-08-31T06:30:19.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 1 -- 172.21.15.53:0/2459519486 wait complete. 2024-08-31T06:30:19.491 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.483+0000 7fe234fcf740 20 client.23142 trim_cache size 0 max 16384 2024-08-31T06:30:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.500+0000 7fe234fcf740 1 Processor -- start 2024-08-31T06:30:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.500+0000 7fe234fcf740 1 -- start start 2024-08-31T06:30:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d621f2f0 0x5588d65ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d62481b0 0x5588d65f92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe234fcf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe2281ad270 con 0x5588d62274d0 2024-08-31T06:30:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe234fcf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2281aef00 con 0x5588d621f2f0 2024-08-31T06:30:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe234fcf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2281ad9d0 con 0x5588d62481b0 2024-08-31T06:30:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41146/0 (socket says 172.21.15.53:41146) 2024-08-31T06:30:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe226ffd640 1 -- 172.21.15.53:0/183648516 learned_addr learned my addr 172.21.15.53:0/183648516 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe227fff640 1 --2- 172.21.15.53:0/183648516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d62481b0 0x5588d65f92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe2277fe640 1 --2- 172.21.15.53:0/183648516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d621f2f0 0x5588d65ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe226ffd640 1 -- 172.21.15.53:0/183648516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d62481b0 msgr2=0x5588d65f92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe226ffd640 1 --2- 172.21.15.53:0/183648516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d62481b0 0x5588d65f92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe226ffd640 1 -- 172.21.15.53:0/183648516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d621f2f0 msgr2=0x5588d65ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe226ffd640 1 --2- 172.21.15.53:0/183648516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d621f2f0 0x5588d65ed6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe226ffd640 1 -- 172.21.15.53:0/183648516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d65e4a90 con 0x5588d62274d0 2024-08-31T06:30:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.501+0000 7fe227fff640 1 --2- 172.21.15.53:0/183648516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d62481b0 0x5588d65f92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.502+0000 7fe226ffd640 1 --2- 172.21.15.53:0/183648516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f1e20 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0ad0c0 tx=0x7fe21c0ea620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cde6257449ba378 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.502+0000 7fe20d7fa640 1 -- 172.21.15.53:0/183648516 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0ad190 con 0x5588d62274d0 2024-08-31T06:30:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.502+0000 7fe20d7fa640 1 -- 172.21.15.53:0/183648516 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe21c0f4070 con 0x5588d62274d0 2024-08-31T06:30:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.502+0000 7fe20d7fa640 1 -- 172.21.15.53:0/183648516 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0a9280 con 0x5588d62274d0 2024-08-31T06:30:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.503+0000 7fe234fcf740 1 -- 172.21.15.53:0/183648516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 msgr2=0x5588d65f1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.503+0000 7fe234fcf740 1 --2- 172.21.15.53:0/183648516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f1e20 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0ad0c0 tx=0x7fe21c0ea620 comp rx=0 tx=0).stop 2024-08-31T06:30:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.503+0000 7fe234fcf740 1 -- 172.21.15.53:0/183648516 shutdown_connections 2024-08-31T06:30:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.503+0000 7fe234fcf740 1 --2- 172.21.15.53:0/183648516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d62481b0 0x5588d65f92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.503+0000 7fe234fcf740 1 --2- 172.21.15.53:0/183648516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d65f1e20 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.503+0000 7fe234fcf740 1 --2- 172.21.15.53:0/183648516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d621f2f0 0x5588d65ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.503+0000 7fe234fcf740 1 -- 172.21.15.53:0/183648516 >> 172.21.15.53:0/183648516 conn(0x5588d623c300 msgr2=0x5588d65f8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.503+0000 7fe234fcf740 1 -- 172.21.15.53:0/183648516 shutdown_connections 2024-08-31T06:30:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.503+0000 7fe234fcf740 1 -- 172.21.15.53:0/183648516 wait complete. 2024-08-31T06:30:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.503+0000 7fe234fcf740 1 -- start start 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.503+0000 7fe234fcf740 1 Processor -- start 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d660a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d660a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe234fcf740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d666af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe234fcf740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe2281ae830 con 0x5588d62274d0 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe234fcf740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2281ae0a0 con 0x5588d62481b0 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe234fcf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2281ab270 con 0x5588d621f2f0 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe234fcf740 10 client.0 _ll_register_callbacks cb 0x7fe21c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d660a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d660a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41162/0 (socket says 172.21.15.53:41162) 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe2277fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d660a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe226ffd640 1 -- 172.21.15.53:0/4276493195 learned_addr learned my addr 172.21.15.53:0/4276493195 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe227fff640 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d666af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe226ffd640 1 -- 172.21.15.53:0/4276493195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 msgr2=0x5588d660a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe226ffd640 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d660a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe226ffd640 1 -- 172.21.15.53:0/4276493195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 msgr2=0x5588d666af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe226ffd640 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d666af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe226ffd640 1 -- 172.21.15.53:0/4276493195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d666b5f0 con 0x5588d62274d0 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe226ffd640 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d660a8e0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0b6650 tx=0x7fe21c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255ed15fd28d0dbc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe206ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe206ffd640 1 -- 172.21.15.53:0/4276493195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0a9280 con 0x5588d62274d0 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe206ffd640 1 -- 172.21.15.53:0/4276493195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fe21c0ea2a0 con 0x5588d62274d0 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.504+0000 7fe234fcf740 1 -- 172.21.15.53:0/4276493195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe21c0f4070 con 0x5588d62274d0 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe206ffd640 1 -- 172.21.15.53:0/4276493195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fe21c0ad190 con 0x5588d62274d0 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe234fcf740 10 client.23148 fetch_fsmap learned FSMap version 91 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe234fcf740 1 -- 172.21.15.53:0/4276493195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) -- 0x5588d6673b20 con 0x5588d62274d0 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe206ffd640 1 -- 172.21.15.53:0/4276493195 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe21c0f4070 con 0x5588d62274d0 2024-08-31T06:30:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe206ffd640 1 -- 172.21.15.53:0/4276493195 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 91) ==== 8390+0+0 (secure 0 0 0) 0x7fe21c0a7ae0 con 0x5588d62274d0 2024-08-31T06:30:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe234fcf740 10 client.23148 fetch_fsmap finished waiting for FSMap version 91 2024-08-31T06:30:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe234fcf740 10 client.23148 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe234fcf740 20 client.23148 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe234fcf740 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5588d61dc1c0 0x5588d6676060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe234fcf740 4 client.23148 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:30:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe234fcf740 1 -- 172.21.15.53:0/4276493195 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5588d655e9f0 con 0x5588d61dc1c0 2024-08-31T06:30:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.505+0000 7fe2277fe640 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5588d61dc1c0 0x5588d6676060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.506+0000 7fe2277fe640 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5588d61dc1c0 0x5588d6676060 crc :-1 s=READY pgs=589 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3326abf4932c89f1 server_cookie=b85ceddc5897618a in_seq=0 out_seq=0 2024-08-31T06:30:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.506+0000 7fe206ffd640 10 client.23148 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:19.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.708+0000 7fe206ffd640 1 -- 172.21.15.53:0/4276493195 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5588d655e9f0 con 0x5588d61dc1c0 2024-08-31T06:30:19.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.708+0000 7fe206ffd640 10 client.23148 handle_command_reply: tid=0 2024-08-31T06:30:19.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.708+0000 7fe234fcf740 1 client.23148 shutdown 2024-08-31T06:30:19.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.708+0000 7fe234fcf740 1 -- 172.21.15.53:0/4276493195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 msgr2=0x5588d660a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.708+0000 7fe234fcf740 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d660a8e0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0b6650 tx=0x7fe21c00b840 comp rx=0 tx=0).stop 2024-08-31T06:30:19.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.708+0000 7fe234fcf740 1 -- 172.21.15.53:0/4276493195 shutdown_connections 2024-08-31T06:30:19.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.708+0000 7fe234fcf740 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5588d61dc1c0 0x5588d6676060 crc :-1 s=READY pgs=589 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.709+0000 7fe234fcf740 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588d62481b0 0x5588d666af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.709+0000 7fe206ffd640 0 client.23148 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:19.711 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.709+0000 7fe234fcf740 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5588d62274d0 0x5588d660a8e0 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.709+0000 7fe234fcf740 1 --2- 172.21.15.53:0/4276493195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588d621f2f0 0x5588d660a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.709+0000 7fe234fcf740 1 -- 172.21.15.53:0/4276493195 >> 172.21.15.53:0/4276493195 conn(0x5588d623c300 msgr2=0x5588d65f9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.709+0000 7fe234fcf740 1 -- 172.21.15.53:0/4276493195 shutdown_connections 2024-08-31T06:30:19.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.709+0000 7fe234fcf740 1 -- 172.21.15.53:0/4276493195 wait complete. 2024-08-31T06:30:19.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.709+0000 7fe234fcf740 20 client.23148 trim_cache size 0 max 16384 2024-08-31T06:30:19.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:{ 2024-08-31T06:30:19.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "message": "", 2024-08-31T06:30:19.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout: "return_code": 0 2024-08-31T06:30:19.712 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stdout:} 2024-08-31T06:30:19.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 -- 172.21.15.53:0/2287521600 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2100b4ca0 msgr2=0x7fe2100b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2100b4ca0 0x7fe2100b71b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe22002c010 tx=0x7fe22002bfa0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 -- 172.21.15.53:0/2287521600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe228107830 msgr2=0x7fe228198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:19.713 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe228107830 0x7fe228198470 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00eb00 tx=0x7fe21c009ec0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 -- 172.21.15.53:0/2287521600 shutdown_connections 2024-08-31T06:30:19.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe2100b4ca0 0x7fe2100b71b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe228108180 0x7fe22819d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe228107830 0x7fe228198470 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 --2- 172.21.15.53:0/2287521600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe228101f00 0x7fe228197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:19.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 -- 172.21.15.53:0/2287521600 >> 172.21.15.53:0/2287521600 conn(0x7fe228079c60 msgr2=0x7fe2281058c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:19.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 -- 172.21.15.53:0/2287521600 shutdown_connections 2024-08-31T06:30:19.714 INFO:teuthology.task.background_exec.ubuntu@smithi053.front.sepia.ceph.com.smithi053.stderr:2024-08-31T06:30:19.710+0000 7fe22e063640 1 -- 172.21.15.53:0/2287521600 wait complete. 2024-08-31T06:30:19.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:30:20.137 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:20.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:19 smithi053 ceph-mon[18924]: pgmap v1124: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2024-08-31T06:30:20.226 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:19 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:20.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:19 smithi130 ceph-mon[22266]: pgmap v1124: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2024-08-31T06:30:20.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:19 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:20.402 INFO:tasks.workunit.client.0.smithi053.stdout: 0 cleanup 608 sec 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: Operation Count AvgLat MaxLat 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: ---------------------------------------- 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: NTCreateX 107536 18.075 32652.581 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: Close 78962 0.197 79.737 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: Rename 4553 57.836 32740.977 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: Unlink 21738 36.572 35628.495 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: Qpathinfo 97363 8.518 3313.876 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: Qfileinfo 16960 0.411 380.450 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: Qfsinfo 17901 0.968 106.224 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: Sfileinfo 8725 28.755 31961.302 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: Find 37651 42.795 3345.430 2024-08-31T06:30:20.403 INFO:tasks.workunit.client.0.smithi053.stdout: WriteX 53002 4.740 32350.956 2024-08-31T06:30:20.404 INFO:tasks.workunit.client.0.smithi053.stdout: ReadX 168691 0.012 19.161 2024-08-31T06:30:20.404 INFO:tasks.workunit.client.0.smithi053.stdout: LockX 350 1.994 8.102 2024-08-31T06:30:20.404 INFO:tasks.workunit.client.0.smithi053.stdout: UnlockX 350 1.879 13.338 2024-08-31T06:30:20.404 INFO:tasks.workunit.client.0.smithi053.stdout: Flush 7500 8.455 400.516 2024-08-31T06:30:20.404 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-08-31T06:30:20.404 INFO:tasks.workunit.client.0.smithi053.stdout:Throughput 5.59595 MB/sec 10 clients 10 procs max_latency=35628.503 ms 2024-08-31T06:30:20.404 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T06:30:20.404 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T06:30:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:19 smithi153 ceph-mon[22320]: pgmap v1124: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2024-08-31T06:30:20.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:19 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:20.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.722+0000 7f9928f52640 1 -- 172.21.15.53:0/622305697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108140 msgr2=0x7f9924108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:20.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.722+0000 7f9928f52640 1 --2- 172.21.15.53:0/622305697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108140 0x7f9924108550 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7f9918009900 tx=0x7f991802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.722+0000 7f9928f52640 1 -- 172.21.15.53:0/622305697 shutdown_connections 2024-08-31T06:30:20.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.722+0000 7f9928f52640 1 --2- 172.21.15.53:0/622305697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108a90 0x7f992410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.722+0000 7f9928f52640 1 --2- 172.21.15.53:0/622305697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108140 0x7f9924108550 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.722+0000 7f9928f52640 1 --2- 172.21.15.53:0/622305697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924102800 0x7f9924102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.722+0000 7f9928f52640 1 -- 172.21.15.53:0/622305697 >> 172.21.15.53:0/622305697 conn(0x7f99240794d0 msgr2=0x7f99240798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:20.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.722+0000 7f9928f52640 1 -- 172.21.15.53:0/622305697 shutdown_connections 2024-08-31T06:30:20.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.722+0000 7f9928f52640 1 -- 172.21.15.53:0/622305697 wait complete. 2024-08-31T06:30:20.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.723+0000 7f9928f52640 1 Processor -- start 2024-08-31T06:30:20.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.723+0000 7f9928f52640 1 -- start start 2024-08-31T06:30:20.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.723+0000 7f9928f52640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924102800 0x7f992419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.723+0000 7f9928f52640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108140 0x7f992419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.723+0000 7f9928f52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108a90 0x7f99241a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9928f52640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f992406b760 con 0x7f9924108a90 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9928f52640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f992406b5e0 con 0x7f9924102800 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9928f52640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f992406b8e0 con 0x7f9924108140 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9922d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108a90 0x7f99241a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f992259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924102800 0x7f992419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9922d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108a90 0x7f99241a1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41188/0 (socket says 172.21.15.53:41188) 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9922d9d640 1 -- 172.21.15.53:0/2902130649 learned_addr learned my addr 172.21.15.53:0/2902130649 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9921d9b640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108140 0x7f992419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9922d9d640 1 -- 172.21.15.53:0/2902130649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108140 msgr2=0x7f992419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9922d9d640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108140 0x7f992419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9922d9d640 1 -- 172.21.15.53:0/2902130649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924102800 msgr2=0x7f992419c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:20.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9922d9d640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924102800 0x7f992419c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9922d9d640 1 -- 172.21.15.53:0/2902130649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99241a24a0 con 0x7f9924108a90 2024-08-31T06:30:20.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9921d9b640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108140 0x7f992419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:20.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.724+0000 7f9922d9d640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108a90 0x7f99241a1d70 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f991c00b970 tx=0x7f991c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:20.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.725+0000 7f99137fe640 1 -- 172.21.15.53:0/2902130649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c019070 con 0x7f9924108a90 2024-08-31T06:30:20.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.725+0000 7f9928f52640 1 -- 172.21.15.53:0/2902130649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99241a2790 con 0x7f9924108a90 2024-08-31T06:30:20.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.725+0000 7f9928f52640 1 -- 172.21.15.53:0/2902130649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99241a8ef0 con 0x7f9924108a90 2024-08-31T06:30:20.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.725+0000 7f99137fe640 1 -- 172.21.15.53:0/2902130649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f991c01d3b0 con 0x7f9924108a90 2024-08-31T06:30:20.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.725+0000 7f99137fe640 1 -- 172.21.15.53:0/2902130649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c023060 con 0x7f9924108a90 2024-08-31T06:30:20.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.729+0000 7f992f4c7740 1 Processor -- start 2024-08-31T06:30:20.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.729+0000 7f99137fe640 1 -- 172.21.15.53:0/2902130649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f991c01c070 con 0x7f9924108a90 2024-08-31T06:30:20.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.729+0000 7f992f4c7740 1 -- start start 2024-08-31T06:30:20.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8086070 0x55ada842b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada842b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 0x55ada842bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f992f4c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ada83a2680 con 0x55ada805d1b0 2024-08-31T06:30:20.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f992f4c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ada8391c10 con 0x55ada8086070 2024-08-31T06:30:20.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f992f4c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ada8395bc0 con 0x55ada8065390 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f992259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada842b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f992259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada842b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41196/0 (socket says 172.21.15.53:41196) 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f992259c640 1 -- 172.21.15.53:0/3554976023 learned_addr learned my addr 172.21.15.53:0/3554976023 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f9921d9b640 1 --2- 172.21.15.53:0/3554976023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8086070 0x55ada842b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f99137fe640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4d20 0x7f990c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f9921d9b640 1 --2- 172.21.15.53:0/3554976023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 0x55ada842bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f9922d9d640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4d20 0x7f990c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f992259c640 1 -- 172.21.15.53:0/3554976023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 msgr2=0x55ada842bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.730+0000 7f992259c640 1 --2- 172.21.15.53:0/3554976023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 0x55ada842bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.731+0000 7f992259c640 1 -- 172.21.15.53:0/3554976023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8086070 msgr2=0x55ada842b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.731+0000 7f992259c640 1 --2- 172.21.15.53:0/3554976023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8086070 0x55ada842b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.731+0000 7f992259c640 1 -- 172.21.15.53:0/3554976023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada80f1650 con 0x55ada805d1b0 2024-08-31T06:30:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.731+0000 7f9921d9b640 1 --2- 172.21.15.53:0/3554976023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 0x55ada842bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.731+0000 7f99137fe640 1 -- 172.21.15.53:0/2902130649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f991c0e4960 con 0x7f9924108a90 2024-08-31T06:30:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.731+0000 7f992259c640 1 --2- 172.21.15.53:0/3554976023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada842b890 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f9914009a70 tx=0x7f9914009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd376da88f3e59c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.731+0000 7f9910ff9640 1 -- 172.21.15.53:0/3554976023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914017070 con 0x55ada805d1b0 2024-08-31T06:30:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.731+0000 7f9910ff9640 1 -- 172.21.15.53:0/3554976023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9914013470 con 0x55ada805d1b0 2024-08-31T06:30:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.732+0000 7f9910ff9640 1 -- 172.21.15.53:0/3554976023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914017070 con 0x55ada805d1b0 2024-08-31T06:30:20.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.732+0000 7f992f4c7740 1 -- 172.21.15.53:0/3554976023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 msgr2=0x55ada842b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:20.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.732+0000 7f992f4c7740 1 --2- 172.21.15.53:0/3554976023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada842b890 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f9914009a70 tx=0x7f9914009f30 comp rx=0 tx=0).stop 2024-08-31T06:30:20.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.732+0000 7f9922d9d640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4d20 0x7f990c0b7230 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f991c0a7050 tx=0x7f991c0db1d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:20.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.733+0000 7f992f4c7740 1 -- 172.21.15.53:0/3554976023 shutdown_connections 2024-08-31T06:30:20.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.733+0000 7f992f4c7740 1 --2- 172.21.15.53:0/3554976023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 0x55ada842bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.733+0000 7f992f4c7740 1 --2- 172.21.15.53:0/3554976023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada842b890 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.733+0000 7f992f4c7740 1 --2- 172.21.15.53:0/3554976023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8086070 0x55ada842b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.733+0000 7f992f4c7740 1 -- 172.21.15.53:0/3554976023 >> 172.21.15.53:0/3554976023 conn(0x55ada807a460 msgr2=0x55ada8429240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.733+0000 7f992f4c7740 1 -- 172.21.15.53:0/3554976023 shutdown_connections 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.733+0000 7f992f4c7740 1 -- 172.21.15.53:0/3554976023 wait complete. 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.734+0000 7f992f4c7740 1 -- start start 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.734+0000 7f992f4c7740 1 Processor -- start 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.734+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada84369a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.735+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 0x55ada8436ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.735+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8086070 0x55ada8437440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.735+0000 7f992f4c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ada81f4700 con 0x55ada805d1b0 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.735+0000 7f992f4c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ada8318750 con 0x55ada8086070 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.735+0000 7f992f4c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ada8439b80 con 0x55ada8065390 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.735+0000 7f992f4c7740 10 client.0 _ll_register_callbacks cb 0x55ada8347e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.735+0000 7f9921d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8086070 0x55ada8437440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.735+0000 7f9921d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada84369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.735+0000 7f9921d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada84369a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41202/0 (socket says 172.21.15.53:41202) 2024-08-31T06:30:20.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.735+0000 7f9921d9b640 1 -- 172.21.15.53:0/1548122945 learned_addr learned my addr 172.21.15.53:0/1548122945 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:20.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.736+0000 7f992259c640 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 0x55ada8436ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.736+0000 7f9921d9b640 1 -- 172.21.15.53:0/1548122945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 msgr2=0x55ada8436ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:20.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.736+0000 7f9921d9b640 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 0x55ada8436ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.736+0000 7f9921d9b640 1 -- 172.21.15.53:0/1548122945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8086070 msgr2=0x55ada8437440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:20.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.736+0000 7f9921d9b640 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8086070 0x55ada8437440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.736+0000 7f9921d9b640 1 -- 172.21.15.53:0/1548122945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada8351900 con 0x55ada805d1b0 2024-08-31T06:30:20.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.736+0000 7f992259c640 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 0x55ada8436ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:20.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.737+0000 7f9921d9b640 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada84369a0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x55ada8437980 tx=0x7f9918000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c1fdc438f13e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:20.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.737+0000 7f9909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:20.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.737+0000 7f9909ffb640 1 -- 172.21.15.53:0/1548122945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918035070 con 0x55ada805d1b0 2024-08-31T06:30:20.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.737+0000 7f992f4c7740 1 -- 172.21.15.53:0/1548122945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9914013470 con 0x55ada805d1b0 2024-08-31T06:30:20.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.737+0000 7f9909ffb640 1 -- 172.21.15.53:0/1548122945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f991803eac0 con 0x55ada805d1b0 2024-08-31T06:30:20.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.738+0000 7f9909ffb640 1 -- 172.21.15.53:0/1548122945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f9918052050 con 0x55ada805d1b0 2024-08-31T06:30:20.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.738+0000 7f992f4c7740 10 client.23160 fetch_fsmap learned FSMap version 91 2024-08-31T06:30:20.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.738+0000 7f992f4c7740 1 -- 172.21.15.53:0/1548122945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) -- 0x55ada844e040 con 0x55ada805d1b0 2024-08-31T06:30:20.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.738+0000 7f9909ffb640 1 -- 172.21.15.53:0/1548122945 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f991803ecc0 con 0x55ada805d1b0 2024-08-31T06:30:20.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.739+0000 7f9909ffb640 1 -- 172.21.15.53:0/1548122945 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 91) ==== 8390+0+0 (secure 0 0 0) 0x7f991803a040 con 0x55ada805d1b0 2024-08-31T06:30:20.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.739+0000 7f992f4c7740 10 client.23160 fetch_fsmap finished waiting for FSMap version 91 2024-08-31T06:30:20.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.739+0000 7f992f4c7740 10 client.23160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:20.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.739+0000 7f992f4c7740 20 client.23160 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:20.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.739+0000 7f992f4c7740 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ada80449f0 0x55ada8451a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.739+0000 7f992f4c7740 4 client.23160 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:20.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.739+0000 7f992f4c7740 1 -- 172.21.15.53:0/1548122945 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9914013470 con 0x55ada80449f0 2024-08-31T06:30:20.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.740+0000 7f992259c640 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ada80449f0 0x55ada8451a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.741+0000 7f992259c640 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ada80449f0 0x55ada8451a30 crc :-1 s=READY pgs=590 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca964dca79447c54 server_cookie=7d62398401d4f503 in_seq=0 out_seq=0 2024-08-31T06:30:20.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.741+0000 7f9909ffb640 10 client.23160 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:20.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.742+0000 7f9909ffb640 1 -- 172.21.15.53:0/1548122945 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f9914013470 con 0x55ada80449f0 2024-08-31T06:30:20.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.742+0000 7f9909ffb640 10 client.23160 handle_command_reply: tid=0 2024-08-31T06:30:20.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.742+0000 7f992f4c7740 1 client.23160 shutdown 2024-08-31T06:30:20.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.743+0000 7f992f4c7740 1 -- 172.21.15.53:0/1548122945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 msgr2=0x55ada84369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:20.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.743+0000 7f992f4c7740 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada84369a0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x55ada8437980 tx=0x7f9918000bc0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.744+0000 7f992f4c7740 1 -- 172.21.15.53:0/1548122945 shutdown_connections 2024-08-31T06:30:20.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.744+0000 7f992f4c7740 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ada80449f0 0x55ada8451a30 crc :-1 s=READY pgs=590 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.744+0000 7f992f4c7740 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8086070 0x55ada8437440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.744+0000 7f992f4c7740 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8065390 0x55ada8436ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.744+0000 7f992f4c7740 1 --2- 172.21.15.53:0/1548122945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada805d1b0 0x55ada84369a0 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.744+0000 7f992f4c7740 1 -- 172.21.15.53:0/1548122945 >> 172.21.15.53:0/1548122945 conn(0x55ada807a460 msgr2=0x55ada842e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:20.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.744+0000 7f9909ffb640 0 client.23160 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:20.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.744+0000 7f992f4c7740 1 -- 172.21.15.53:0/1548122945 shutdown_connections 2024-08-31T06:30:20.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.744+0000 7f992f4c7740 1 -- 172.21.15.53:0/1548122945 wait complete. 2024-08-31T06:30:20.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.744+0000 7f992f4c7740 20 client.23160 trim_cache size 0 max 16384 2024-08-31T06:30:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.767+0000 7f992f4c7740 1 Processor -- start 2024-08-31T06:30:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.767+0000 7f992f4c7740 1 -- start start 2024-08-31T06:30:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.767+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada805d1b0 0x55ada842ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.767+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada8065390 0x55ada8433b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.767+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8086070 0x55ada84340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.767+0000 7f992f4c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f990400e970 con 0x55ada8065390 2024-08-31T06:30:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.767+0000 7f992f4c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9904010600 con 0x55ada805d1b0 2024-08-31T06:30:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.767+0000 7f992f4c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f990400f0d0 con 0x55ada8086070 2024-08-31T06:30:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f9921d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada805d1b0 0x55ada842ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f9921d9b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada805d1b0 0x55ada842ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52326/0 (socket says 172.21.15.53:52326) 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f9921d9b640 1 -- 172.21.15.53:0/210873205 learned_addr learned my addr 172.21.15.53:0/210873205 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f9921d9b640 1 --2- 172.21.15.53:0/210873205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8086070 0x55ada84340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f9921d9b640 1 -- 172.21.15.53:0/210873205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8086070 msgr2=0x55ada84340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f9921d9b640 1 --2- 172.21.15.53:0/210873205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8086070 0x55ada84340d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f9921d9b640 1 -- 172.21.15.53:0/210873205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada8065390 msgr2=0x55ada8433b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f992259c640 1 --2- 172.21.15.53:0/210873205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada8065390 0x55ada8433b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f9921d9b640 1 --2- 172.21.15.53:0/210873205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada8065390 0x55ada8433b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f9921d9b640 1 -- 172.21.15.53:0/210873205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada842d640 con 0x55ada805d1b0 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f992259c640 1 --2- 172.21.15.53:0/210873205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada8065390 0x55ada8433b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.768+0000 7f9921d9b640 1 --2- 172.21.15.53:0/210873205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada805d1b0 0x55ada842ca90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f99180059d0 tx=0x7f991802a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=252bf7fd3e9ccf8f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.769+0000 7f990bfff640 1 -- 172.21.15.53:0/210873205 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991805d070 con 0x55ada805d1b0 2024-08-31T06:30:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.769+0000 7f990bfff640 1 -- 172.21.15.53:0/210873205 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f991803e260 con 0x55ada805d1b0 2024-08-31T06:30:20.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.769+0000 7f990bfff640 1 -- 172.21.15.53:0/210873205 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918035030 con 0x55ada805d1b0 2024-08-31T06:30:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.770+0000 7f992f4c7740 1 -- 172.21.15.53:0/210873205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada805d1b0 msgr2=0x55ada842ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.770+0000 7f992f4c7740 1 --2- 172.21.15.53:0/210873205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada805d1b0 0x55ada842ca90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f99180059d0 tx=0x7f991802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.770+0000 7f992f4c7740 1 -- 172.21.15.53:0/210873205 shutdown_connections 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.770+0000 7f992f4c7740 1 --2- 172.21.15.53:0/210873205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada8086070 0x55ada84340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.770+0000 7f992f4c7740 1 --2- 172.21.15.53:0/210873205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada8065390 0x55ada8433b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.770+0000 7f992f4c7740 1 --2- 172.21.15.53:0/210873205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada805d1b0 0x55ada842ca90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.770+0000 7f992f4c7740 1 -- 172.21.15.53:0/210873205 >> 172.21.15.53:0/210873205 conn(0x55ada807a460 msgr2=0x55ada842c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.770+0000 7f992f4c7740 1 -- 172.21.15.53:0/210873205 shutdown_connections 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.770+0000 7f992f4c7740 1 -- 172.21.15.53:0/210873205 wait complete. 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.771+0000 7f992f4c7740 1 -- start start 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.771+0000 7f992f4c7740 1 Processor -- start 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.772+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada805d1b0 0x55ada843b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.772+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8065390 0x55ada843bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.772+0000 7f992f4c7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada8086070 0x55ada84b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.772+0000 7f992f4c7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f990400ff30 con 0x55ada8086070 2024-08-31T06:30:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.772+0000 7f992f4c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f990400f7a0 con 0x55ada8065390 2024-08-31T06:30:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.772+0000 7f992f4c7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f990400c970 con 0x55ada805d1b0 2024-08-31T06:30:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.772+0000 7f992f4c7740 10 client.0 _ll_register_callbacks cb 0x7f9918009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.772+0000 7f992259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8065390 0x55ada843bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.772+0000 7f992259c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8065390 0x55ada843bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.53:52338/0 (socket says 172.21.15.53:52338) 2024-08-31T06:30:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.772+0000 7f992259c640 1 -- 172.21.15.53:0/393966848 learned_addr learned my addr 172.21.15.53:0/393966848 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.773+0000 7f992259c640 1 -- 172.21.15.53:0/393966848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada805d1b0 msgr2=0x55ada843b910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:30:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.773+0000 7f992259c640 1 --2- 172.21.15.53:0/393966848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada805d1b0 0x55ada843b910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.773+0000 7f992259c640 1 -- 172.21.15.53:0/393966848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada8086070 msgr2=0x55ada84b5520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.773+0000 7f992259c640 1 --2- 172.21.15.53:0/393966848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada8086070 0x55ada84b5520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.773+0000 7f992259c640 1 -- 172.21.15.53:0/393966848 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada84b5b90 con 0x55ada8065390 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.773+0000 7f992259c640 1 --2- 172.21.15.53:0/393966848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8065390 0x55ada843bef0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9914013dd0 tx=0x7f99140047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34e837709f7f5196 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.773+0000 7f9909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.773+0000 7f9909ffb640 1 -- 172.21.15.53:0/393966848 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914017070 con 0x55ada8065390 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.774+0000 7f9909ffb640 1 -- 172.21.15.53:0/393966848 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f991400f040 con 0x55ada8065390 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.774+0000 7f992f4c7740 1 -- 172.21.15.53:0/393966848 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f991803e260 con 0x55ada8065390 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.774+0000 7f9909ffb640 1 -- 172.21.15.53:0/393966848 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f9914006d60 con 0x55ada8065390 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.774+0000 7f992f4c7740 10 client.31763 fetch_fsmap learned FSMap version 91 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.774+0000 7f992f4c7740 1 -- 172.21.15.53:0/393966848 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) -- 0x55ada84cdf00 con 0x55ada8065390 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.774+0000 7f9909ffb640 1 -- 172.21.15.53:0/393966848 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f991803e260 con 0x55ada8065390 2024-08-31T06:30:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.775+0000 7f9909ffb640 1 -- 172.21.15.53:0/393966848 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 91) ==== 8390+0+0 (secure 0 0 0) 0x7f9914026550 con 0x55ada8065390 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.775+0000 7f992f4c7740 10 client.31763 fetch_fsmap finished waiting for FSMap version 91 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.775+0000 7f992f4c7740 10 client.31763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.775+0000 7f992f4c7740 20 client.31763 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.775+0000 7f992f4c7740 1 --2- 172.21.15.53:0/393966848 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ada8019da0 0x55ada84d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.775+0000 7f992f4c7740 4 client.31763 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.775+0000 7f992f4c7740 1 -- 172.21.15.53:0/393966848 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ada83a45d0 con 0x55ada8019da0 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.775+0000 7f9921d9b640 1 --2- 172.21.15.53:0/393966848 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ada8019da0 0x55ada84d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.775+0000 7f9909ffb640 10 client.31763 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.775+0000 7f9921d9b640 1 --2- 172.21.15.53:0/393966848 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ada8019da0 0x55ada84d0490 crc :-1 s=READY pgs=591 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef8c2f53fac17222 server_cookie=74cc37e343a35250 in_seq=0 out_seq=0 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f9909ffb640 1 -- 172.21.15.53:0/393966848 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ada83a45d0 con 0x55ada8019da0 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f9909ffb640 10 client.31763 handle_command_reply: tid=0 2024-08-31T06:30:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f992f4c7740 1 client.31763 shutdown 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f992f4c7740 1 -- 172.21.15.53:0/393966848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8065390 msgr2=0x55ada843bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f992f4c7740 1 --2- 172.21.15.53:0/393966848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8065390 0x55ada843bef0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9914013dd0 tx=0x7f99140047d0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f992f4c7740 1 -- 172.21.15.53:0/393966848 shutdown_connections 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f992f4c7740 1 --2- 172.21.15.53:0/393966848 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ada8019da0 0x55ada84d0490 crc :-1 s=READY pgs=591 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f992f4c7740 1 --2- 172.21.15.53:0/393966848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ada8086070 0x55ada84b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f9909ffb640 0 client.31763 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f992f4c7740 1 --2- 172.21.15.53:0/393966848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ada8065390 0x55ada843bef0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f992f4c7740 1 --2- 172.21.15.53:0/393966848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ada805d1b0 0x55ada843b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f992f4c7740 1 -- 172.21.15.53:0/393966848 >> 172.21.15.53:0/393966848 conn(0x55ada807a460 msgr2=0x55ada842c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f992f4c7740 1 -- 172.21.15.53:0/393966848 shutdown_connections 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.776+0000 7f992f4c7740 1 -- 172.21.15.53:0/393966848 wait complete. 2024-08-31T06:30:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f992f4c7740 20 client.31763 trim_cache size 0 max 16384 2024-08-31T06:30:20.783 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:30:20.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f9928f52640 1 -- 172.21.15.53:0/2902130649 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4d20 msgr2=0x7f990c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:20.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f9928f52640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4d20 0x7f990c0b7230 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f991c0a7050 tx=0x7f991c0db1d0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f9928f52640 1 -- 172.21.15.53:0/2902130649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108a90 msgr2=0x7f99241a1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f9928f52640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108a90 0x7f99241a1d70 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f991c00b970 tx=0x7f991c00bd70 comp rx=0 tx=0).stop 2024-08-31T06:30:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f9928f52640 1 -- 172.21.15.53:0/2902130649 shutdown_connections 2024-08-31T06:30:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f9928f52640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f990c0b4d20 0x7f990c0b7230 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f9928f52640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9924108a90 0x7f99241a1d70 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f9928f52640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9924108140 0x7f992419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f9928f52640 1 --2- 172.21.15.53:0/2902130649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9924102800 0x7f992419c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f9928f52640 1 -- 172.21.15.53:0/2902130649 >> 172.21.15.53:0/2902130649 conn(0x7f99240794d0 msgr2=0x7f9924111be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.777+0000 7f9928f52640 1 -- 172.21.15.53:0/2902130649 shutdown_connections 2024-08-31T06:30:20.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:20.778+0000 7f9928f52640 1 -- 172.21.15.53:0/2902130649 wait complete. 2024-08-31T06:30:22.102 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-08-31T06:30:22.102 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-31T06:30:22.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:21 smithi130 ceph-mon[22266]: pgmap v1125: 97 pgs: 97 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 150 op/s 2024-08-31T06:30:22.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:21 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:22.400 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:21 smithi053 ceph-mon[18924]: pgmap v1125: 97 pgs: 97 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 150 op/s 2024-08-31T06:30:22.400 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:21 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:22.401 DEBUG:teuthology.parallel:result is None 2024-08-31T06:30:22.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-31T06:30:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:21 smithi153 ceph-mon[22320]: pgmap v1125: 97 pgs: 97 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 150 op/s 2024-08-31T06:30:22.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:21 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:22.438 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-31T06:30:22.438 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-08-31T06:30:22.448 INFO:tasks.quiescer:joining Quiescers 2024-08-31T06:30:22.448 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-08-31T06:30:22.448 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:30:22.516 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:30:22.516 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:30:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:23.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.227+0000 7fc8cbc64640 1 -- 172.21.15.53:0/1722861038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4108ac0 msgr2=0x7fc8c410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:23.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.227+0000 7fc8cbc64640 1 --2- 172.21.15.53:0/1722861038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4108ac0 0x7fc8c410f2f0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009be0 tx=0x7fc8bc02a6c0 comp rx=0 tx=0).stop 2024-08-31T06:30:23.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.227+0000 7fc8cbc64640 1 -- 172.21.15.53:0/1722861038 shutdown_connections 2024-08-31T06:30:23.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.227+0000 7fc8cbc64640 1 --2- 172.21.15.53:0/1722861038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4108ac0 0x7fc8c410f2f0 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:23.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.228+0000 7fc8cbc64640 1 --2- 172.21.15.53:0/1722861038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8c4108170 0x7fc8c4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:23.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.228+0000 7fc8cbc64640 1 --2- 172.21.15.53:0/1722861038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c4102880 0x7fc8c4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:23.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.228+0000 7fc8cbc64640 1 -- 172.21.15.53:0/1722861038 >> 172.21.15.53:0/1722861038 conn(0x7fc8c4079500 msgr2=0x7fc8c4079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:23.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.228+0000 7fc8cbc64640 1 -- 172.21.15.53:0/1722861038 shutdown_connections 2024-08-31T06:30:23.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.228+0000 7fc8cbc64640 1 -- 172.21.15.53:0/1722861038 wait complete. 2024-08-31T06:30:23.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.228+0000 7fc8cbc64640 1 Processor -- start 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.228+0000 7fc8cbc64640 1 -- start start 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8cbc64640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8c4102880 0x7fc8c4198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8cbc64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4108170 0x7fc8c4199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8cbc64640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c4108ac0 0x7fc8c419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8cbc64640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41125d0 con 0x7fc8c4108170 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8cbc64640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c4112450 con 0x7fc8c4102880 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8cbc64640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c4112750 con 0x7fc8c4108ac0 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8c91ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4108170 0x7fc8c4199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8c91ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4108170 0x7fc8c4199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41234/0 (socket says 172.21.15.53:41234) 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8c91ff640 1 -- 172.21.15.53:0/492873194 learned_addr learned my addr 172.21.15.53:0/492873194 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8c9a00640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8c4102880 0x7fc8c4198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8ca201640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c4108ac0 0x7fc8c419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8c91ff640 1 -- 172.21.15.53:0/492873194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c4108ac0 msgr2=0x7fc8c419e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:23.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8c91ff640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c4108ac0 0x7fc8c419e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8c91ff640 1 -- 172.21.15.53:0/492873194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8c4102880 msgr2=0x7fc8c4198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8c91ff640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8c4102880 0x7fc8c4198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8c91ff640 1 -- 172.21.15.53:0/492873194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c419ef10 con 0x7fc8c4108170 2024-08-31T06:30:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8c91ff640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4108170 0x7fc8c4199540 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400ead0 tx=0x7fc8b400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8baffd640 1 -- 172.21.15.53:0/492873194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400bbd0 con 0x7fc8c4108170 2024-08-31T06:30:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8cbc64640 1 -- 172.21.15.53:0/492873194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c419f200 con 0x7fc8c4108170 2024-08-31T06:30:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8baffd640 1 -- 172.21.15.53:0/492873194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8b400bd70 con 0x7fc8c4108170 2024-08-31T06:30:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8baffd640 1 -- 172.21.15.53:0/492873194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4004e00 con 0x7fc8c4108170 2024-08-31T06:30:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.229+0000 7fc8cbc64640 1 -- 172.21.15.53:0/492873194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c406b8e0 con 0x7fc8c4108170 2024-08-31T06:30:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.231+0000 7fc8cbc64640 1 -- 172.21.15.53:0/492873194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c4103ab0 con 0x7fc8c4108170 2024-08-31T06:30:23.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.232+0000 7fc8baffd640 1 -- 172.21.15.53:0/492873194 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc8b4004fa0 con 0x7fc8c4108170 2024-08-31T06:30:23.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.233+0000 7fc8baffd640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8b00b4ca0 0x7fc8b00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:23.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.233+0000 7fc8c9a00640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8b00b4ca0 0x7fc8b00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:23.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.233+0000 7fc8baffd640 1 -- 172.21.15.53:0/492873194 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fc8b40e75f0 con 0x7fc8c4108170 2024-08-31T06:30:23.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.233+0000 7fc8c9a00640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8b00b4ca0 0x7fc8b00b71b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009530 tx=0x7fc8c0009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:23.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.236+0000 7fc8baffd640 1 -- 172.21.15.53:0/492873194 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc8b40ae360 con 0x7fc8c4108170 2024-08-31T06:30:23.252 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:23.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.473+0000 7fc8cbc64640 1 -- 172.21.15.53:0/492873194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8c4102c90 con 0x7fc8c4108170 2024-08-31T06:30:23.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.474+0000 7fc8baffd640 1 -- 172.21.15.53:0/492873194 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) ==== 94+0+12000 (secure 0 0 0) 0x7fc8b40adc60 con 0x7fc8c4108170 2024-08-31T06:30:23.476 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:30:23.476 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":92,"btime":"2024-08-31T06:30:20:982574+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":92,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:30:20.566954+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24613,24619,24632,24640,24668]},"id":1}]} 2024-08-31T06:30:23.477 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 92 2024-08-31T06:30:23.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 -- 172.21.15.53:0/492873194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8b00b4ca0 msgr2=0x7fc8b00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8b00b4ca0 0x7fc8b00b71b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009530 tx=0x7fc8c0009260 comp rx=0 tx=0).stop 2024-08-31T06:30:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 -- 172.21.15.53:0/492873194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4108170 msgr2=0x7fc8c4199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4108170 0x7fc8c4199540 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400ead0 tx=0x7fc8b400ef90 comp rx=0 tx=0).stop 2024-08-31T06:30:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 -- 172.21.15.53:0/492873194 shutdown_connections 2024-08-31T06:30:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc8b00b4ca0 0x7fc8b00b71b0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c4108ac0 0x7fc8c419e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4108170 0x7fc8c4199540 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 --2- 172.21.15.53:0/492873194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8c4102880 0x7fc8c4198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 -- 172.21.15.53:0/492873194 >> 172.21.15.53:0/492873194 conn(0x7fc8c4079500 msgr2=0x7fc8c4105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 -- 172.21.15.53:0/492873194 shutdown_connections 2024-08-31T06:30:23.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:23.477+0000 7fc8cbc64640 1 -- 172.21.15.53:0/492873194 wait complete. 2024-08-31T06:30:24.156 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24668 quiesce db --cancel --all' 2024-08-31T06:30:24.157 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24668 quiesce db --cancel --all 2024-08-31T06:30:24.312 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:23 smithi053 ceph-mon[18924]: pgmap v1126: 97 pgs: 97 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-08-31T06:30:24.312 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:23 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/492873194' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:24.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:23 smithi130 ceph-mon[22266]: pgmap v1126: 97 pgs: 97 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-08-31T06:30:24.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:23 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/492873194' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:23 smithi153 ceph-mon[22320]: pgmap v1126: 97 pgs: 97 active+clean; 1.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-08-31T06:30:24.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:23 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/492873194' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:24.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.406+0000 7f3a3700c640 1 -- 172.21.15.53:0/1316333586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a30109240 msgr2=0x7f3a30109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.406+0000 7f3a3700c640 1 --2- 172.21.15.53:0/1316333586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a30109240 0x7f3a30109650 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009900 tx=0x7f3a1c02a410 comp rx=0 tx=0).stop 2024-08-31T06:30:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.406+0000 7f3a3700c640 1 -- 172.21.15.53:0/1316333586 shutdown_connections 2024-08-31T06:30:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.406+0000 7f3a3700c640 1 --2- 172.21.15.53:0/1316333586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a30109b90 0x7f3a301103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.406+0000 7f3a3700c640 1 --2- 172.21.15.53:0/1316333586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a30109240 0x7f3a30109650 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.406+0000 7f3a3700c640 1 --2- 172.21.15.53:0/1316333586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a30103900 0x7f3a30103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.406+0000 7f3a3700c640 1 -- 172.21.15.53:0/1316333586 >> 172.21.15.53:0/1316333586 conn(0x7f3a3007b5f0 msgr2=0x7f3a3007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.406+0000 7f3a3700c640 1 -- 172.21.15.53:0/1316333586 shutdown_connections 2024-08-31T06:30:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.406+0000 7f3a3700c640 1 -- 172.21.15.53:0/1316333586 wait complete. 2024-08-31T06:30:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a3700c640 1 Processor -- start 2024-08-31T06:30:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a3700c640 1 -- start start 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a3700c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a30103900 0x7f3a3019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a3700c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a30109240 0x7f3a3019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a3700c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a30109b90 0x7f3a3019fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a3700c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3a30113720 con 0x7f3a30109240 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a3700c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a301135a0 con 0x7f3a30103900 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a3700c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a301138a0 con 0x7f3a30109b90 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a30109240 0x7f3a3019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a30109240 0x7f3a3019a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37500/0 (socket says 172.21.15.53:37500) 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a2ffff640 1 -- 172.21.15.53:0/1738646273 learned_addr learned my addr 172.21.15.53:0/1738646273 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a34da8640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a30103900 0x7f3a3019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a355a9640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a30109b90 0x7f3a3019fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a2ffff640 1 -- 172.21.15.53:0/1738646273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a30109b90 msgr2=0x7f3a3019fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a2ffff640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a30109b90 0x7f3a3019fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a2ffff640 1 -- 172.21.15.53:0/1738646273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a30103900 msgr2=0x7f3a3019a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a2ffff640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a30103900 0x7f3a3019a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.407+0000 7f3a2ffff640 1 -- 172.21.15.53:0/1738646273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a301a01c0 con 0x7f3a30109240 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.408+0000 7f3a2ffff640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a30109240 0x7f3a3019a7f0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c005940 tx=0x7f3a1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.408+0000 7f3a2dffb640 1 -- 172.21.15.53:0/1738646273 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c03f030 con 0x7f3a30109240 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.408+0000 7f3a2dffb640 1 -- 172.21.15.53:0/1738646273 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a1c003c90 con 0x7f3a30109240 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.408+0000 7f3a3700c640 1 -- 172.21.15.53:0/1738646273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a301a0450 con 0x7f3a30109240 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.408+0000 7f3a2dffb640 1 -- 172.21.15.53:0/1738646273 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c035070 con 0x7f3a30109240 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.408+0000 7f3a3700c640 1 -- 172.21.15.53:0/1738646273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a301a6c10 con 0x7f3a30109240 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a3d581740 1 Processor -- start 2024-08-31T06:30:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a3d581740 1 -- start start 2024-08-31T06:30:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a2dffb640 1 -- 172.21.15.53:0/1738646273 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3a1c042030 con 0x7f3a30109240 2024-08-31T06:30:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409cd350 0x55c040d73780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409a4490 0x55c040d73cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409ac670 0x55c040d74200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a3d581740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c040ce95f0 con 0x55c0409ac670 2024-08-31T06:30:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a3d581740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c040cd8b80 con 0x55c0409a4490 2024-08-31T06:30:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a3d581740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c040cdcb30 con 0x55c0409cd350 2024-08-31T06:30:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409ac670 0x55c040d74200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409ac670 0x55c040d74200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37510/0 (socket says 172.21.15.53:37510) 2024-08-31T06:30:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a2ffff640 1 -- 172.21.15.53:0/3160359459 learned_addr learned my addr 172.21.15.53:0/3160359459 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a34da8640 1 --2- 172.21.15.53:0/3160359459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409a4490 0x55c040d73cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.411+0000 7f3a355a9640 1 --2- 172.21.15.53:0/3160359459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409cd350 0x55c040d73780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a2ffff640 1 -- 172.21.15.53:0/3160359459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409cd350 msgr2=0x55c040d73780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a2ffff640 1 --2- 172.21.15.53:0/3160359459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409cd350 0x55c040d73780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a2ffff640 1 -- 172.21.15.53:0/3160359459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409a4490 msgr2=0x55c040d73cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a2ffff640 1 --2- 172.21.15.53:0/3160359459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409a4490 0x55c040d73cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a2ffff640 1 -- 172.21.15.53:0/3160359459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c040a38930 con 0x55c0409ac670 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a34da8640 1 --2- 172.21.15.53:0/3160359459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409a4490 0x55c040d73cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a2dffb640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3a200b4ca0 0x7f3a200b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a355a9640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3a200b4ca0 0x7f3a200b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a2ffff640 1 --2- 172.21.15.53:0/3160359459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409ac670 0x55c040d74200 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c103560 tx=0x7f3a1c10e220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33613abb9b61cdc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a2dffb640 1 -- 172.21.15.53:0/1738646273 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f3a1c105ec0 con 0x7f3a30109240 2024-08-31T06:30:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a1affd640 1 -- 172.21.15.53:0/3160359459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c049020 con 0x55c0409ac670 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a1affd640 1 -- 172.21.15.53:0/3160359459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a1c0d5030 con 0x55c0409ac670 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.412+0000 7f3a1affd640 1 -- 172.21.15.53:0/3160359459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0c8450 con 0x55c0409ac670 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.413+0000 7f3a3d581740 1 -- 172.21.15.53:0/3160359459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409ac670 msgr2=0x55c040d74200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.413+0000 7f3a3d581740 1 --2- 172.21.15.53:0/3160359459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409ac670 0x55c040d74200 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c103560 tx=0x7f3a1c10e220 comp rx=0 tx=0).stop 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.413+0000 7f3a355a9640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3a200b4ca0 0x7f3a200b71b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800b4d0 tx=0x7f3a2800e040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.413+0000 7f3a3d581740 1 -- 172.21.15.53:0/3160359459 shutdown_connections 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.413+0000 7f3a3d581740 1 --2- 172.21.15.53:0/3160359459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409ac670 0x55c040d74200 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.413+0000 7f3a3d581740 1 --2- 172.21.15.53:0/3160359459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409a4490 0x55c040d73cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.413+0000 7f3a3d581740 1 --2- 172.21.15.53:0/3160359459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409cd350 0x55c040d73780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.413+0000 7f3a3d581740 1 -- 172.21.15.53:0/3160359459 >> 172.21.15.53:0/3160359459 conn(0x55c0409c1740 msgr2=0x55c040d71670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.413+0000 7f3a3d581740 1 -- 172.21.15.53:0/3160359459 shutdown_connections 2024-08-31T06:30:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.413+0000 7f3a3d581740 1 -- 172.21.15.53:0/3160359459 wait complete. 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a3d581740 1 -- start start 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a3d581740 1 Processor -- start 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d7ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409ac670 0x55c040d7f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409cd350 0x55c040d8af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a3d581740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c040b3b890 con 0x55c0409a4490 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a34da8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d7ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a34da8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d7ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37526/0 (socket says 172.21.15.53:37526) 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a34da8640 1 -- 172.21.15.53:0/4022613341 learned_addr learned my addr 172.21.15.53:0/4022613341 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a3d581740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c040c5f790 con 0x55c0409cd350 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a3d581740 1 -- 172.21.15.53:0/4022613341 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c040d81d20 con 0x55c0409ac670 2024-08-31T06:30:24.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a3d581740 10 client.0 _ll_register_callbacks cb 0x55c0409e4ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.414+0000 7f3a2ffff640 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409ac670 0x55c040d7f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a355a9640 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409cd350 0x55c040d8af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a34da8640 1 -- 172.21.15.53:0/4022613341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409ac670 msgr2=0x55c040d7f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a34da8640 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409ac670 0x55c040d7f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a34da8640 1 -- 172.21.15.53:0/4022613341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409cd350 msgr2=0x55c040d8af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a34da8640 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409cd350 0x55c040d8af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a34da8640 1 -- 172.21.15.53:0/4022613341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c040c96f30 con 0x55c0409a4490 2024-08-31T06:30:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a34da8640 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d7ef20 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f3a24010820 tx=0x7f3a24010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38997dc267b99f14 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a0ffff640 1 -- 172.21.15.53:0/4022613341 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2401e060 con 0x55c0409a4490 2024-08-31T06:30:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a0ffff640 1 -- 172.21.15.53:0/4022613341 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f3a2400fb10 con 0x55c0409a4490 2024-08-31T06:30:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a3d581740 1 -- 172.21.15.53:0/4022613341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a1c0d5030 con 0x55c0409a4490 2024-08-31T06:30:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a0ffff640 1 -- 172.21.15.53:0/4022613341 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f3a2400fd10 con 0x55c0409a4490 2024-08-31T06:30:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a3d581740 10 client.23178 fetch_fsmap learned FSMap version 93 2024-08-31T06:30:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a3d581740 1 -- 172.21.15.53:0/4022613341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=4+}) -- 0x55c040d8dab0 con 0x55c0409a4490 2024-08-31T06:30:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.415+0000 7f3a0ffff640 1 -- 172.21.15.53:0/4022613341 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a1c0d5030 con 0x55c0409a4490 2024-08-31T06:30:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.416+0000 7f3a0ffff640 1 -- 172.21.15.53:0/4022613341 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 93) ==== 8406+0+0 (secure 0 0 0) 0x7f3a240213d0 con 0x55c0409a4490 2024-08-31T06:30:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.416+0000 7f3a3d581740 10 client.23178 fetch_fsmap finished waiting for FSMap version 93 2024-08-31T06:30:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.416+0000 7f3a3d581740 10 client.23178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.416+0000 7f3a3d581740 20 client.23178 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.416+0000 7f3a3d581740 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c04098bcd0 0x55c040d91060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.416+0000 7f3a3d581740 4 client.23178 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.416+0000 7f3a3d581740 1 -- 172.21.15.53:0/4022613341 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c040ceb540 con 0x55c04098bcd0 2024-08-31T06:30:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.416+0000 7f3a2ffff640 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c04098bcd0 0x55c040d91060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.416+0000 7f3a2ffff640 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c04098bcd0 0x55c040d91060 crc :-1 s=READY pgs=592 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1910071572426813 server_cookie=8454ad8f154cab9e in_seq=0 out_seq=0 2024-08-31T06:30:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.416+0000 7f3a0ffff640 10 client.23178 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a0ffff640 1 -- 172.21.15.53:0/4022613341 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c040ceb540 con 0x55c04098bcd0 2024-08-31T06:30:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a0ffff640 10 client.23178 handle_command_reply: tid=0 2024-08-31T06:30:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a3d581740 1 client.23178 shutdown 2024-08-31T06:30:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a3d581740 1 -- 172.21.15.53:0/4022613341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 msgr2=0x55c040d7ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a3d581740 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d7ef20 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f3a24010820 tx=0x7f3a24010ce0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a3d581740 1 -- 172.21.15.53:0/4022613341 shutdown_connections 2024-08-31T06:30:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a3d581740 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c04098bcd0 0x55c040d91060 crc :-1 s=READY pgs=592 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a3d581740 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409cd350 0x55c040d8af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a3d581740 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409ac670 0x55c040d7f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a0ffff640 0 client.23178 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a3d581740 1 --2- 172.21.15.53:0/4022613341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d7ef20 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.417+0000 7f3a3d581740 1 -- 172.21.15.53:0/4022613341 >> 172.21.15.53:0/4022613341 conn(0x55c0409c1740 msgr2=0x55c040d76910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.418+0000 7f3a3d581740 1 -- 172.21.15.53:0/4022613341 shutdown_connections 2024-08-31T06:30:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.418+0000 7f3a3d581740 1 -- 172.21.15.53:0/4022613341 wait complete. 2024-08-31T06:30:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.418+0000 7f3a3d581740 20 client.23178 trim_cache size 0 max 16384 2024-08-31T06:30:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.435+0000 7f3a3d581740 1 Processor -- start 2024-08-31T06:30:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.435+0000 7f3a3d581740 1 -- start start 2024-08-31T06:30:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d75170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409ac670 0x55c040d8adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409cd350 0x55c040d8b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a3d581740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3a301af5c0 con 0x55c0409a4490 2024-08-31T06:30:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a3d581740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a301b1310 con 0x55c0409ac670 2024-08-31T06:30:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a3d581740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a301afd50 con 0x55c0409cd350 2024-08-31T06:30:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a34da8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d75170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a34da8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d75170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37540/0 (socket says 172.21.15.53:37540) 2024-08-31T06:30:24.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a34da8640 1 -- 172.21.15.53:0/1287992672 learned_addr learned my addr 172.21.15.53:0/1287992672 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:24.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a355a9640 1 --2- 172.21.15.53:0/1287992672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409cd350 0x55c040d8b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a2ffff640 1 --2- 172.21.15.53:0/1287992672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409ac670 0x55c040d8adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a34da8640 1 -- 172.21.15.53:0/1287992672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409cd350 msgr2=0x55c040d8b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:24.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a34da8640 1 --2- 172.21.15.53:0/1287992672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409cd350 0x55c040d8b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a34da8640 1 -- 172.21.15.53:0/1287992672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409ac670 msgr2=0x55c040d8adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:24.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a34da8640 1 --2- 172.21.15.53:0/1287992672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409ac670 0x55c040d8adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a34da8640 1 -- 172.21.15.53:0/1287992672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c040d71f60 con 0x55c0409a4490 2024-08-31T06:30:24.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.436+0000 7f3a34da8640 1 --2- 172.21.15.53:0/1287992672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d75170 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f3a24000c00 tx=0x7f3a240104b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfc572c2b8e0d4f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:24.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.437+0000 7f3a1a7fc640 1 -- 172.21.15.53:0/1287992672 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24030070 con 0x55c0409a4490 2024-08-31T06:30:24.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.437+0000 7f3a1a7fc640 1 -- 172.21.15.53:0/1287992672 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a2400a340 con 0x55c0409a4490 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.437+0000 7f3a1a7fc640 1 -- 172.21.15.53:0/1287992672 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2402b8e0 con 0x55c0409a4490 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.437+0000 7f3a3d581740 1 -- 172.21.15.53:0/1287992672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 msgr2=0x55c040d75170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.437+0000 7f3a3d581740 1 --2- 172.21.15.53:0/1287992672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d75170 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f3a24000c00 tx=0x7f3a240104b0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.437+0000 7f3a3d581740 1 -- 172.21.15.53:0/1287992672 shutdown_connections 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.437+0000 7f3a3d581740 1 --2- 172.21.15.53:0/1287992672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409cd350 0x55c040d8b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.437+0000 7f3a3d581740 1 --2- 172.21.15.53:0/1287992672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409ac670 0x55c040d8adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.437+0000 7f3a3d581740 1 --2- 172.21.15.53:0/1287992672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409a4490 0x55c040d75170 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.437+0000 7f3a3d581740 1 -- 172.21.15.53:0/1287992672 >> 172.21.15.53:0/1287992672 conn(0x55c0409c1740 msgr2=0x55c040d78890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.438+0000 7f3a3d581740 1 -- 172.21.15.53:0/1287992672 shutdown_connections 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.438+0000 7f3a3d581740 1 -- 172.21.15.53:0/1287992672 wait complete. 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.438+0000 7f3a3d581740 1 -- start start 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.438+0000 7f3a3d581740 1 Processor -- start 2024-08-31T06:30:24.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.438+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409a4490 0x55c040d87370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.438+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409ac670 0x55c040d83880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.438+0000 7f3a3d581740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409cd350 0x55c040d83dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.438+0000 7f3a3d581740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3a301b0be0 con 0x55c0409cd350 2024-08-31T06:30:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.438+0000 7f3a3d581740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a301b0450 con 0x55c0409a4490 2024-08-31T06:30:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.438+0000 7f3a3d581740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3a301ad5c0 con 0x55c0409ac670 2024-08-31T06:30:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a3d581740 10 client.0 _ll_register_callbacks cb 0x7f3a2400a780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a355a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409cd350 0x55c040d83dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a355a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409cd350 0x55c040d83dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37542/0 (socket says 172.21.15.53:37542) 2024-08-31T06:30:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a355a9640 1 -- 172.21.15.53:0/3562767326 learned_addr learned my addr 172.21.15.53:0/3562767326 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:24.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a2ffff640 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409ac670 0x55c040d83880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a34da8640 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409a4490 0x55c040d87370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a355a9640 1 -- 172.21.15.53:0/3562767326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409ac670 msgr2=0x55c040d83880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a355a9640 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409ac670 0x55c040d83880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a355a9640 1 -- 172.21.15.53:0/3562767326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409a4490 msgr2=0x55c040d87370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a355a9640 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409a4490 0x55c040d87370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a355a9640 1 -- 172.21.15.53:0/3562767326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c040d84300 con 0x55c0409cd350 2024-08-31T06:30:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a355a9640 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409cd350 0x55c040d83dc0 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f3a28018dc0 tx=0x7f3a28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4937419d708de1ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a0ffff640 1 -- 172.21.15.53:0/3562767326 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28026070 con 0x55c0409cd350 2024-08-31T06:30:24.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.439+0000 7f3a0ffff640 1 -- 172.21.15.53:0/3562767326 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f3a28022610 con 0x55c0409cd350 2024-08-31T06:30:24.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a3d581740 1 -- 172.21.15.53:0/3562767326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a2400a340 con 0x55c0409cd350 2024-08-31T06:30:24.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a0ffff640 1 -- 172.21.15.53:0/3562767326 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f3a28032050 con 0x55c0409cd350 2024-08-31T06:30:24.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a3d581740 10 client.23184 fetch_fsmap learned FSMap version 93 2024-08-31T06:30:24.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a3d581740 1 -- 172.21.15.53:0/3562767326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=4+}) -- 0x55c040dfc770 con 0x55c0409cd350 2024-08-31T06:30:24.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a0ffff640 1 -- 172.21.15.53:0/3562767326 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a2400a340 con 0x55c0409cd350 2024-08-31T06:30:24.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a0ffff640 1 -- 172.21.15.53:0/3562767326 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 93) ==== 8406+0+0 (secure 0 0 0) 0x7f3a28021070 con 0x55c0409cd350 2024-08-31T06:30:24.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a3d581740 10 client.23184 fetch_fsmap finished waiting for FSMap version 93 2024-08-31T06:30:24.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a3d581740 10 client.23184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:24.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a3d581740 20 client.23184 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:24.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a3d581740 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c040961080 0x55c040dfeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:24.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a3d581740 4 client.23184 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a3d581740 1 -- 172.21.15.53:0/3562767326 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c040ce6fe0 con 0x55c040961080 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.440+0000 7f3a34da8640 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c040961080 0x55c040dfeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.441+0000 7f3a0ffff640 10 client.23184 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.441+0000 7f3a34da8640 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c040961080 0x55c040dfeff0 crc :-1 s=READY pgs=593 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b247f76f5c6e58cb server_cookie=781c751bc828f18b in_seq=0 out_seq=0 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a0ffff640 1 -- 172.21.15.53:0/3562767326 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c040ce6fe0 con 0x55c040961080 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a0ffff640 10 client.23184 handle_command_reply: tid=0 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 1 client.23184 shutdown 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 1 -- 172.21.15.53:0/3562767326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409cd350 msgr2=0x55c040d83dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409cd350 0x55c040d83dc0 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f3a28018dc0 tx=0x7f3a28004a40 comp rx=0 tx=0).stop 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 1 -- 172.21.15.53:0/3562767326 shutdown_connections 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c040961080 0x55c040dfeff0 crc :-1 s=READY pgs=593 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0409cd350 0x55c040d83dc0 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c0409ac670 0x55c040d83880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 1 --2- 172.21.15.53:0/3562767326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0409a4490 0x55c040d87370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a0ffff640 0 client.23184 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:24.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 1 -- 172.21.15.53:0/3562767326 >> 172.21.15.53:0/3562767326 conn(0x55c0409c1740 msgr2=0x55c040d74f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:24.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 1 -- 172.21.15.53:0/3562767326 shutdown_connections 2024-08-31T06:30:24.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 1 -- 172.21.15.53:0/3562767326 wait complete. 2024-08-31T06:30:24.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.442+0000 7f3a3d581740 20 client.23184 trim_cache size 0 max 16384 2024-08-31T06:30:24.452 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:30:24.453 INFO:teuthology.orchestra.run.smithi053.stdout: "return_code": 0, 2024-08-31T06:30:24.453 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_tag": "6fe44679-ed78-4545-985c-f14e714c05d2", 2024-08-31T06:30:24.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": "asynchronous" 2024-08-31T06:30:24.453 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:30:24.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 -- 172.21.15.53:0/1738646273 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3a200b4ca0 msgr2=0x7f3a200b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:24.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3a200b4ca0 0x7f3a200b71b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800b4d0 tx=0x7f3a2800e040 comp rx=0 tx=0).stop 2024-08-31T06:30:24.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 -- 172.21.15.53:0/1738646273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a30109240 msgr2=0x7f3a3019a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:24.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a30109240 0x7f3a3019a7f0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c005940 tx=0x7f3a1c0042f0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 -- 172.21.15.53:0/1738646273 shutdown_connections 2024-08-31T06:30:24.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f3a200b4ca0 0x7f3a200b71b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a30109b90 0x7f3a3019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a30109240 0x7f3a3019a7f0 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 --2- 172.21.15.53:0/1738646273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a30103900 0x7f3a3019a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:24.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 -- 172.21.15.53:0/1738646273 >> 172.21.15.53:0/1738646273 conn(0x7f3a3007b5f0 msgr2=0x7f3a301073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:24.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 -- 172.21.15.53:0/1738646273 shutdown_connections 2024-08-31T06:30:24.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:24.443+0000 7f3a3700c640 1 -- 172.21.15.53:0/1738646273 wait complete. 2024-08-31T06:30:25.150 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:24 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:25.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:24 smithi053 ceph-mon[18924]: scrub queued for path: / 2024-08-31T06:30:25.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:24 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:30:25.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:24 smithi053 ceph-mon[18924]: scrub summary: active paths [/] 2024-08-31T06:30:25.151 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:24 smithi053 ceph-mon[18924]: scrub summary: idle+waiting paths [/] 2024-08-31T06:30:25.179 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:30:25.233 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:25.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:24 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:25.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:24 smithi130 ceph-mon[22266]: scrub queued for path: / 2024-08-31T06:30:25.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:24 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:30:25.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:24 smithi130 ceph-mon[22266]: scrub summary: active paths [/] 2024-08-31T06:30:25.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:24 smithi130 ceph-mon[22266]: scrub summary: idle+waiting paths [/] 2024-08-31T06:30:25.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:24 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:25.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:24 smithi153 ceph-mon[22320]: scrub queued for path: / 2024-08-31T06:30:25.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:24 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:30:25.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:24 smithi153 ceph-mon[22320]: scrub summary: active paths [/] 2024-08-31T06:30:25.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:24 smithi153 ceph-mon[22320]: scrub summary: idle+waiting paths [/] 2024-08-31T06:30:25.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.723+0000 7fe8fb086640 1 -- 172.21.15.53:0/4292777562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8f4103940 msgr2=0x7fe8f4103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:25.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.723+0000 7fe8fb086640 1 --2- 172.21.15.53:0/4292777562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8f4103940 0x7fe8f4103d50 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009900 tx=0x7fe8f002a410 comp rx=0 tx=0).stop 2024-08-31T06:30:25.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.723+0000 7fe8fb086640 1 -- 172.21.15.53:0/4292777562 shutdown_connections 2024-08-31T06:30:25.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.723+0000 7fe8fb086640 1 --2- 172.21.15.53:0/4292777562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f4109bd0 0x7fe8f4110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.723+0000 7fe8fb086640 1 --2- 172.21.15.53:0/4292777562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8f4109280 0x7fe8f4109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.723+0000 7fe8fb086640 1 --2- 172.21.15.53:0/4292777562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8f4103940 0x7fe8f4103d50 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.723+0000 7fe8fb086640 1 -- 172.21.15.53:0/4292777562 >> 172.21.15.53:0/4292777562 conn(0x7fe8f40ff3d0 msgr2=0x7fe8f4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:25.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.723+0000 7fe8fb086640 1 -- 172.21.15.53:0/4292777562 shutdown_connections 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.723+0000 7fe8fb086640 1 -- 172.21.15.53:0/4292777562 wait complete. 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8fb086640 1 Processor -- start 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8fb086640 1 -- start start 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8fb086640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8f4103940 0x7fe8f40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8fb086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8f4109280 0x7fe8f40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8fb086640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f4109bd0 0x7fe8f4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8fb086640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41137c0 con 0x7fe8f4109280 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8fb086640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f4113640 con 0x7fe8f4109bd0 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8fb086640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f4113940 con 0x7fe8f4103940 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8f4109280 0x7fe8f40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8f4109280 0x7fe8f40759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37550/0 (socket says 172.21.15.53:37550) 2024-08-31T06:30:25.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8ebfff640 1 -- 172.21.15.53:0/1721802255 learned_addr learned my addr 172.21.15.53:0/1721802255 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8f4103940 0x7fe8f40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8f9623640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f4109bd0 0x7fe8f4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8ebfff640 1 -- 172.21.15.53:0/1721802255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8f4103940 msgr2=0x7fe8f40754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8f4103940 0x7fe8f40754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8ebfff640 1 -- 172.21.15.53:0/1721802255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f4109bd0 msgr2=0x7fe8f4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f4109bd0 0x7fe8f4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.724+0000 7fe8ebfff640 1 -- 172.21.15.53:0/1721802255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f41a84d0 con 0x7fe8f4109280 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.725+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8f4109280 0x7fe8f40759f0 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400d750 tx=0x7fe8e400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.725+0000 7fe8e9ffb640 1 -- 172.21.15.53:0/1721802255 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4017070 con 0x7fe8f4109280 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.725+0000 7fe8fb086640 1 -- 172.21.15.53:0/1721802255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f41a87c0 con 0x7fe8f4109280 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.725+0000 7fe8e9ffb640 1 -- 172.21.15.53:0/1721802255 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8e40054b0 con 0x7fe8f4109280 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.725+0000 7fe8e9ffb640 1 -- 172.21.15.53:0/1721802255 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4004bc0 con 0x7fe8f4109280 2024-08-31T06:30:25.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.725+0000 7fe8fb086640 1 -- 172.21.15.53:0/1721802255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f41a8d30 con 0x7fe8f4109280 2024-08-31T06:30:25.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe8e9ffb640 1 -- 172.21.15.53:0/1721802255 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe8e4009c30 con 0x7fe8f4109280 2024-08-31T06:30:25.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe9015fb740 1 Processor -- start 2024-08-31T06:30:25.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe9015fb740 1 -- start start 2024-08-31T06:30:25.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e7bd2d0 0x55ae0eb62d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e794410 0x55ae0eb63240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb63780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe9015fb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ead9610 con 0x55ae0e7bd2d0 2024-08-31T06:30:25.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe9015fb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ae0eac8ba0 con 0x55ae0e794410 2024-08-31T06:30:25.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe9015fb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ae0eaccb50 con 0x55ae0e79c5f0 2024-08-31T06:30:25.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe8f9623640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e7bd2d0 0x55ae0eb62d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe8f9623640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e7bd2d0 0x55ae0eb62d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37554/0 (socket says 172.21.15.53:37554) 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.728+0000 7fe8f9623640 1 -- 172.21.15.53:0/3940263786 learned_addr learned my addr 172.21.15.53:0/3940263786 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/3940263786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e794410 0x55ae0eb63240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/3940263786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb63780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8e9ffb640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8dc0b4ca0 0x7fe8dc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8f9623640 1 -- 172.21.15.53:0/3940263786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e79c5f0 msgr2=0x55ae0eb63780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8f9623640 1 --2- 172.21.15.53:0/3940263786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb63780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8f9623640 1 -- 172.21.15.53:0/3940263786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e794410 msgr2=0x55ae0eb63240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8f9623640 1 --2- 172.21.15.53:0/3940263786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e794410 0x55ae0eb63240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8f9623640 1 -- 172.21.15.53:0/3940263786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0e8288b0 con 0x55ae0e7bd2d0 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8e9ffb640 1 -- 172.21.15.53:0/1721802255 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fe8e40e5050 con 0x7fe8f4109280 2024-08-31T06:30:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8f9623640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8dc0b4ca0 0x7fe8dc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8f9623640 1 --2- 172.21.15.53:0/3940263786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e7bd2d0 0x55ae0eb62d00 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009f20 tx=0x7fe8ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac3602f36b58d1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8daffd640 1 -- 172.21.15.53:0/3940263786 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec0076a0 con 0x55ae0e7bd2d0 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8daffd640 1 -- 172.21.15.53:0/3940263786 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8ec007e10 con 0x55ae0e7bd2d0 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.729+0000 7fe8daffd640 1 -- 172.21.15.53:0/3940263786 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec015970 con 0x55ae0e7bd2d0 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.730+0000 7fe9015fb740 1 -- 172.21.15.53:0/3940263786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e7bd2d0 msgr2=0x55ae0eb62d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.730+0000 7fe8f9623640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8dc0b4ca0 0x7fe8dc0b71b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c3f0 tx=0x7fe8ec01d000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.730+0000 7fe9015fb740 1 --2- 172.21.15.53:0/3940263786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e7bd2d0 0x55ae0eb62d00 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009f20 tx=0x7fe8ec00c8b0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.730+0000 7fe9015fb740 1 -- 172.21.15.53:0/3940263786 shutdown_connections 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.730+0000 7fe9015fb740 1 --2- 172.21.15.53:0/3940263786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb63780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.730+0000 7fe9015fb740 1 --2- 172.21.15.53:0/3940263786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e794410 0x55ae0eb63240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.730+0000 7fe9015fb740 1 --2- 172.21.15.53:0/3940263786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e7bd2d0 0x55ae0eb62d00 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.730+0000 7fe9015fb740 1 -- 172.21.15.53:0/3940263786 >> 172.21.15.53:0/3940263786 conn(0x55ae0e7b16c0 msgr2=0x55ae0eb60bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.730+0000 7fe9015fb740 1 -- 172.21.15.53:0/3940263786 shutdown_connections 2024-08-31T06:30:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.730+0000 7fe9015fb740 1 -- 172.21.15.53:0/3940263786 wait complete. 2024-08-31T06:30:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.731+0000 7fe9015fb740 1 -- start start 2024-08-31T06:30:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.731+0000 7fe9015fb740 1 Processor -- start 2024-08-31T06:30:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.731+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e794410 0x55ae0eb6e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.731+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb6ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.731+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e7bd2d0 0x55ae0eb7a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.731+0000 7fe9015fb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ae0e92b810 con 0x55ae0e79c5f0 2024-08-31T06:30:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.731+0000 7fe9015fb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ea4f960 con 0x55ae0e7bd2d0 2024-08-31T06:30:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.731+0000 7fe9015fb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ae0eb714e0 con 0x55ae0e794410 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.731+0000 7fe9015fb740 10 client.0 _ll_register_callbacks cb 0x55ae0e7d4b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.731+0000 7fe8ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb6ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb6ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37562/0 (socket says 172.21.15.53:37562) 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8ebfff640 1 -- 172.21.15.53:0/2619654360 learned_addr learned my addr 172.21.15.53:0/2619654360 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8f9623640 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e7bd2d0 0x55ae0eb7a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e794410 0x55ae0eb6e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8ebfff640 1 -- 172.21.15.53:0/2619654360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e794410 msgr2=0x55ae0eb6e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e794410 0x55ae0eb6e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8ebfff640 1 -- 172.21.15.53:0/2619654360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e7bd2d0 msgr2=0x55ae0eb7a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e7bd2d0 0x55ae0eb7a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8ebfff640 1 -- 172.21.15.53:0/2619654360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae0eb7ad10 con 0x55ae0e79c5f0 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb6ed60 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40e27e0 tx=0x7fe8e40a7c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0869435c4c480f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8d3fff640 1 -- 172.21.15.53:0/2619654360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4020050 con 0x55ae0e79c5f0 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8d3fff640 1 -- 172.21.15.53:0/2619654360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fe8e40aab90 con 0x55ae0e79c5f0 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe9015fb740 1 -- 172.21.15.53:0/2619654360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8ec007e10 con 0x55ae0e79c5f0 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe8d3fff640 1 -- 172.21.15.53:0/2619654360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fe8e40aae90 con 0x55ae0e79c5f0 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe9015fb740 10 client.23196 fetch_fsmap learned FSMap version 93 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.732+0000 7fe9015fb740 1 -- 172.21.15.53:0/2619654360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=4+}) -- 0x55ae0eb7d620 con 0x55ae0e79c5f0 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.733+0000 7fe8d3fff640 1 -- 172.21.15.53:0/2619654360 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8ec007e10 con 0x55ae0e79c5f0 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.733+0000 7fe8d3fff640 1 -- 172.21.15.53:0/2619654360 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 93) ==== 8406+0+0 (secure 0 0 0) 0x7fe8e40e7110 con 0x55ae0e79c5f0 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.733+0000 7fe9015fb740 10 client.23196 fetch_fsmap finished waiting for FSMap version 93 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.733+0000 7fe9015fb740 10 client.23196 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.733+0000 7fe9015fb740 20 client.23196 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.733+0000 7fe9015fb740 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae0e77bc50 0x55ae0eb80af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.733+0000 7fe9015fb740 4 client.23196 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.733+0000 7fe9015fb740 1 -- 172.21.15.53:0/2619654360 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae0eadb560 con 0x55ae0e77bc50 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.733+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae0e77bc50 0x55ae0eb80af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.734+0000 7fe8d3fff640 10 client.23196 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.734+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae0e77bc50 0x55ae0eb80af0 crc :-1 s=READY pgs=594 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99ca0830569998d0 server_cookie=b25ef78e2823fd33 in_seq=0 out_seq=0 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.734+0000 7fe8d3fff640 1 -- 172.21.15.53:0/2619654360 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae0eadb560 con 0x55ae0e77bc50 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.734+0000 7fe8d3fff640 10 client.23196 handle_command_reply: tid=0 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.734+0000 7fe9015fb740 1 client.23196 shutdown 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.734+0000 7fe9015fb740 1 -- 172.21.15.53:0/2619654360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 msgr2=0x55ae0eb6ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.734+0000 7fe9015fb740 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb6ed60 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40e27e0 tx=0x7fe8e40a7c40 comp rx=0 tx=0).stop 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.734+0000 7fe9015fb740 1 -- 172.21.15.53:0/2619654360 shutdown_connections 2024-08-31T06:30:25.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.734+0000 7fe9015fb740 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae0e77bc50 0x55ae0eb80af0 crc :-1 s=READY pgs=594 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.735+0000 7fe8d3fff640 0 client.23196 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:25.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.735+0000 7fe9015fb740 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e7bd2d0 0x55ae0eb7a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.735+0000 7fe9015fb740 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb6ed60 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.735+0000 7fe9015fb740 1 --2- 172.21.15.53:0/2619654360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e794410 0x55ae0eb6e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.735+0000 7fe9015fb740 1 -- 172.21.15.53:0/2619654360 >> 172.21.15.53:0/2619654360 conn(0x55ae0e7b16c0 msgr2=0x55ae0eb65ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:25.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.735+0000 7fe9015fb740 1 -- 172.21.15.53:0/2619654360 shutdown_connections 2024-08-31T06:30:25.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.735+0000 7fe9015fb740 1 -- 172.21.15.53:0/2619654360 wait complete. 2024-08-31T06:30:25.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.735+0000 7fe9015fb740 20 client.23196 trim_cache size 0 max 16384 2024-08-31T06:30:25.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe9015fb740 1 Processor -- start 2024-08-31T06:30:25.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe9015fb740 1 -- start start 2024-08-31T06:30:25.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e77bc50 0x55ae0eb7a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e794410 0x55ae0eb67de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb68320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe9015fb740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41b1800 con 0x55ae0e79c5f0 2024-08-31T06:30:25.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe9015fb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41b3550 con 0x55ae0e77bc50 2024-08-31T06:30:25.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe9015fb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41b1f90 con 0x55ae0e794410 2024-08-31T06:30:25.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe8f9623640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb68320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe8f9623640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb68320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37570/0 (socket says 172.21.15.53:37570) 2024-08-31T06:30:25.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe8f9623640 1 -- 172.21.15.53:0/2611797368 learned_addr learned my addr 172.21.15.53:0/2611797368 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/2611797368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e77bc50 0x55ae0eb7a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.753+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/2611797368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e794410 0x55ae0eb67de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.754+0000 7fe8f8e22640 1 -- 172.21.15.53:0/2611797368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e794410 msgr2=0x55ae0eb67de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.754+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/2611797368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e794410 0x55ae0eb67de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.754+0000 7fe8f8e22640 1 -- 172.21.15.53:0/2611797368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 msgr2=0x55ae0eb68320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.754+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/2611797368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb68320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.754+0000 7fe8f8e22640 1 -- 172.21.15.53:0/2611797368 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0eb6d580 con 0x55ae0e77bc50 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.754+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/2611797368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e794410 0x55ae0eb67de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.754+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/2611797368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e77bc50 0x55ae0eb7a6d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4076f00 tx=0x7fe8f0009660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26f42b49b4bbcb00 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.754+0000 7fe8da7fc640 1 -- 172.21.15.53:0/2611797368 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0035040 con 0x55ae0e77bc50 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.754+0000 7fe8da7fc640 1 -- 172.21.15.53:0/2611797368 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8f00054d0 con 0x55ae0e77bc50 2024-08-31T06:30:25.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.754+0000 7fe8da7fc640 1 -- 172.21.15.53:0/2611797368 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00035f0 con 0x55ae0e77bc50 2024-08-31T06:30:25.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.756+0000 7fe9015fb740 1 -- 172.21.15.53:0/2611797368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e77bc50 msgr2=0x55ae0eb7a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:25.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.756+0000 7fe9015fb740 1 --2- 172.21.15.53:0/2611797368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e77bc50 0x55ae0eb7a6d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4076f00 tx=0x7fe8f0009660 comp rx=0 tx=0).stop 2024-08-31T06:30:25.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.756+0000 7fe9015fb740 1 -- 172.21.15.53:0/2611797368 shutdown_connections 2024-08-31T06:30:25.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.756+0000 7fe9015fb740 1 --2- 172.21.15.53:0/2611797368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb68320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.756+0000 7fe9015fb740 1 --2- 172.21.15.53:0/2611797368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e794410 0x55ae0eb67de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.756+0000 7fe9015fb740 1 --2- 172.21.15.53:0/2611797368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e77bc50 0x55ae0eb7a6d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.756+0000 7fe9015fb740 1 -- 172.21.15.53:0/2611797368 >> 172.21.15.53:0/2611797368 conn(0x55ae0e7b16c0 msgr2=0x55ae0eb65e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:25.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.756+0000 7fe9015fb740 1 -- 172.21.15.53:0/2611797368 shutdown_connections 2024-08-31T06:30:25.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.756+0000 7fe9015fb740 1 -- 172.21.15.53:0/2611797368 wait complete. 2024-08-31T06:30:25.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.756+0000 7fe9015fb740 1 -- start start 2024-08-31T06:30:25.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.756+0000 7fe9015fb740 1 Processor -- start 2024-08-31T06:30:25.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.757+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e77bc50 0x55ae0eb76e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.757+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e794410 0x55ae0eb716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.757+0000 7fe9015fb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb71c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.757+0000 7fe8ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e794410 0x55ae0eb716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.757+0000 7fe8ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e794410 0x55ae0eb716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37580/0 (socket says 172.21.15.53:37580) 2024-08-31T06:30:25.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.757+0000 7fe8ebfff640 1 -- 172.21.15.53:0/3660099510 learned_addr learned my addr 172.21.15.53:0/3660099510 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:25.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.757+0000 7fe9015fb740 1 -- 172.21.15.53:0/3660099510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41b2e20 con 0x55ae0e794410 2024-08-31T06:30:25.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.757+0000 7fe9015fb740 1 -- 172.21.15.53:0/3660099510 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41b2690 con 0x55ae0e79c5f0 2024-08-31T06:30:25.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.757+0000 7fe9015fb740 1 -- 172.21.15.53:0/3660099510 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41af800 con 0x55ae0e77bc50 2024-08-31T06:30:25.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.757+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e77bc50 0x55ae0eb76e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe8f9623640 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb71c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe9015fb740 10 client.0 _ll_register_callbacks cb 0x7fe8e40e2c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe8ebfff640 1 -- 172.21.15.53:0/3660099510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e77bc50 msgr2=0x55ae0eb76e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e77bc50 0x55ae0eb76e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe8ebfff640 1 -- 172.21.15.53:0/3660099510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e79c5f0 msgr2=0x55ae0eb71c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb71c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe8ebfff640 1 -- 172.21.15.53:0/3660099510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae0eb722d0 con 0x55ae0e794410 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe8f9623640 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb71c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe8ebfff640 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e794410 0x55ae0eb716f0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40a8990 tx=0x7fe8e400def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b58abd347aa73 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe8d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe8d3fff640 1 -- 172.21.15.53:0/3660099510 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4020070 con 0x55ae0e794410 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe9015fb740 1 -- 172.21.15.53:0/3660099510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8f00054d0 con 0x55ae0e794410 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.758+0000 7fe8d3fff640 1 -- 172.21.15.53:0/3660099510 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fe8e40a72a0 con 0x55ae0e794410 2024-08-31T06:30:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.759+0000 7fe8d3fff640 1 -- 172.21.15.53:0/3660099510 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fe8e40b4380 con 0x55ae0e794410 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.759+0000 7fe9015fb740 10 client.23202 fetch_fsmap learned FSMap version 93 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.759+0000 7fe9015fb740 1 -- 172.21.15.53:0/3660099510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=4+}) -- 0x55ae0ebec340 con 0x55ae0e794410 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.759+0000 7fe8d3fff640 1 -- 172.21.15.53:0/3660099510 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8f00054d0 con 0x55ae0e794410 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.759+0000 7fe8d3fff640 1 -- 172.21.15.53:0/3660099510 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 93) ==== 8406+0+0 (secure 0 0 0) 0x7fe8e40d21a0 con 0x55ae0e794410 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.759+0000 7fe9015fb740 10 client.23202 fetch_fsmap finished waiting for FSMap version 93 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.759+0000 7fe9015fb740 10 client.23202 resolve_mds: validated gid 24668 aka daemon mds.b 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.759+0000 7fe9015fb740 20 client.23202 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.759+0000 7fe9015fb740 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae0e7bd2d0 0x55ae0ebeeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.759+0000 7fe9015fb740 4 client.23202 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.759+0000 7fe9015fb740 1 -- 172.21.15.53:0/3660099510 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55ae0ead7000 con 0x55ae0e7bd2d0 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.760+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae0e7bd2d0 0x55ae0ebeeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.760+0000 7fe8d3fff640 10 client.23202 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:25.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.761+0000 7fe8f8e22640 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae0e7bd2d0 0x55ae0ebeeb90 crc :-1 s=READY pgs=595 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6ded35aa293d48d server_cookie=80fb21104a850e78 in_seq=0 out_seq=0 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe8d3fff640 1 -- 172.21.15.53:0/3660099510 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55ae0ead7000 con 0x55ae0e7bd2d0 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe8d3fff640 10 client.23202 handle_command_reply: tid=0 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 1 client.23202 shutdown 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 1 -- 172.21.15.53:0/3660099510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e794410 msgr2=0x55ae0eb716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e794410 0x55ae0eb716f0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40a8990 tx=0x7fe8e400def0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 1 -- 172.21.15.53:0/3660099510 shutdown_connections 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55ae0e7bd2d0 0x55ae0ebeeb90 crc :-1 s=READY pgs=595 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ae0e79c5f0 0x55ae0eb71c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae0e794410 0x55ae0eb716f0 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe8d3fff640 0 client.23202 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 1 --2- 172.21.15.53:0/3660099510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ae0e77bc50 0x55ae0eb76e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 1 -- 172.21.15.53:0/3660099510 >> 172.21.15.53:0/3660099510 conn(0x55ae0e7b16c0 msgr2=0x55ae0eb60400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:25.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 1 -- 172.21.15.53:0/3660099510 shutdown_connections 2024-08-31T06:30:25.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 1 -- 172.21.15.53:0/3660099510 wait complete. 2024-08-31T06:30:25.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.762+0000 7fe9015fb740 20 client.23202 trim_cache size 0 max 16384 2024-08-31T06:30:25.768 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:30:25.768 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 93, 2024-08-31T06:30:25.768 INFO:teuthology.orchestra.run.smithi053.stdout: "leader": 24668, 2024-08-31T06:30:25.768 INFO:teuthology.orchestra.run.smithi053.stdout: "set_version": 84, 2024-08-31T06:30:25.768 INFO:teuthology.orchestra.run.smithi053.stdout: "sets": {} 2024-08-31T06:30:25.768 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:30:25.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.763+0000 7fe8fb086640 1 -- 172.21.15.53:0/1721802255 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8dc0b4ca0 msgr2=0x7fe8dc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:25.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.763+0000 7fe8fb086640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8dc0b4ca0 0x7fe8dc0b71b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c3f0 tx=0x7fe8ec01d000 comp rx=0 tx=0).stop 2024-08-31T06:30:25.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.763+0000 7fe8fb086640 1 -- 172.21.15.53:0/1721802255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8f4109280 msgr2=0x7fe8f40759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:25.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.763+0000 7fe8fb086640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8f4109280 0x7fe8f40759f0 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400d750 tx=0x7fe8e400dc10 comp rx=0 tx=0).stop 2024-08-31T06:30:25.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.763+0000 7fe8fb086640 1 -- 172.21.15.53:0/1721802255 shutdown_connections 2024-08-31T06:30:25.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.763+0000 7fe8fb086640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe8dc0b4ca0 0x7fe8dc0b71b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.763+0000 7fe8fb086640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8f4109bd0 0x7fe8f4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.763+0000 7fe8fb086640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8f4109280 0x7fe8f40759f0 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.763+0000 7fe8fb086640 1 --2- 172.21.15.53:0/1721802255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8f4103940 0x7fe8f40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:25.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.763+0000 7fe8fb086640 1 -- 172.21.15.53:0/1721802255 >> 172.21.15.53:0/1721802255 conn(0x7fe8f40ff3d0 msgr2=0x7fe8f41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:25.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.764+0000 7fe8fb086640 1 -- 172.21.15.53:0/1721802255 shutdown_connections 2024-08-31T06:30:25.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:25.764+0000 7fe8fb086640 1 -- 172.21.15.53:0/1721802255 wait complete. 2024-08-31T06:30:26.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:26 smithi130 ceph-mon[22266]: pgmap v1127: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 252 op/s 2024-08-31T06:30:26.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:26 smithi130 ceph-mon[22266]: scrub summary: idle 2024-08-31T06:30:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:26 smithi153 ceph-mon[22320]: pgmap v1127: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 252 op/s 2024-08-31T06:30:26.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:26 smithi153 ceph-mon[22320]: scrub summary: idle 2024-08-31T06:30:26.426 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:26 smithi053 ceph-mon[18924]: pgmap v1127: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 252 op/s 2024-08-31T06:30:26.426 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:26 smithi053 ceph-mon[18924]: scrub summary: idle 2024-08-31T06:30:26.454 INFO:tasks.quiescer:done joining Quiescers 2024-08-31T06:30:26.454 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-31T06:30:26.464 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi053.front.sepia.ceph.com 2024-08-31T06:30:26.472 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-08-31T06:30:26.482 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-08-31T06:30:26.482 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T06:30:26.482 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi053.front.sepia.ceph.com 2024-08-31T06:30:26.482 DEBUG:teuthology.orchestra.run.smithi053:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-08-31T06:30:26.514 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:26.563 DEBUG:teuthology.orchestra.run.smithi053:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-08-31T06:30:26.600 DEBUG:teuthology.orchestra.run.smithi053:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-31T06:30:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.752+0000 7fb2af93a640 1 -- 172.21.15.53:0/963923323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2a8102750 msgr2=0x7fb2a8102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.752+0000 7fb2af93a640 1 --2- 172.21.15.53:0/963923323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2a8102750 0x7fb2a8102b60 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009900 tx=0x7fb2a002a410 comp rx=0 tx=0).stop 2024-08-31T06:30:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.752+0000 7fb2af93a640 1 -- 172.21.15.53:0/963923323 shutdown_connections 2024-08-31T06:30:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.752+0000 7fb2af93a640 1 --2- 172.21.15.53:0/963923323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a81089d0 0x7fb2a810f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.752+0000 7fb2af93a640 1 --2- 172.21.15.53:0/963923323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a8108080 0x7fb2a8108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.752+0000 7fb2af93a640 1 --2- 172.21.15.53:0/963923323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2a8102750 0x7fb2a8102b60 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.752+0000 7fb2af93a640 1 -- 172.21.15.53:0/963923323 >> 172.21.15.53:0/963923323 conn(0x7fb2a807a4e0 msgr2=0x7fb2a807a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.752+0000 7fb2af93a640 1 -- 172.21.15.53:0/963923323 shutdown_connections 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.752+0000 7fb2af93a640 1 -- 172.21.15.53:0/963923323 wait complete. 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2af93a640 1 Processor -- start 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2af93a640 1 -- start start 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2af93a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a8102750 0x7fb2a819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2af93a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2a8108080 0x7fb2a819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2af93a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a81089d0 0x7fb2a819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2af93a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a8113660 con 0x7fb2a8108080 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2af93a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a81134e0 con 0x7fb2a81089d0 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2af93a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a81137e0 con 0x7fb2a8102750 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2aced5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2a8108080 0x7fb2a819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2aced5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2a8108080 0x7fb2a819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37610/0 (socket says 172.21.15.53:37610) 2024-08-31T06:30:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2aced5640 1 -- 172.21.15.53:0/1626686290 learned_addr learned my addr 172.21.15.53:0/1626686290 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2ad6d6640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a8102750 0x7fb2a819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2aced5640 1 -- 172.21.15.53:0/1626686290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a8102750 msgr2=0x7fb2a819a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2aced5640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a8102750 0x7fb2a819a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2aced5640 1 -- 172.21.15.53:0/1626686290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a81089d0 msgr2=0x7fb2a819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2aded7640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a81089d0 0x7fb2a819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2aced5640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a81089d0 0x7fb2a819f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2aced5640 1 -- 172.21.15.53:0/1626686290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a81a0000 con 0x7fb2a8108080 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.753+0000 7fb2aded7640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a81089d0 0x7fb2a819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.754+0000 7fb2aced5640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2a8108080 0x7fb2a819a700 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00d740 tx=0x7fb29c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.754+0000 7fb2a67fc640 1 -- 172.21.15.53:0/1626686290 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c017070 con 0x7fb2a8108080 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.754+0000 7fb2a67fc640 1 -- 172.21.15.53:0/1626686290 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb29c00de50 con 0x7fb2a8108080 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.754+0000 7fb2af93a640 1 -- 172.21.15.53:0/1626686290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a81a02f0 con 0x7fb2a8108080 2024-08-31T06:30:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.754+0000 7fb2a67fc640 1 -- 172.21.15.53:0/1626686290 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c00f620 con 0x7fb2a8108080 2024-08-31T06:30:26.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.754+0000 7fb2af93a640 1 -- 172.21.15.53:0/1626686290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a81a6b10 con 0x7fb2a8108080 2024-08-31T06:30:26.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.755+0000 7fb2af93a640 1 -- 172.21.15.53:0/1626686290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a8102b60 con 0x7fb2a8108080 2024-08-31T06:30:26.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.756+0000 7fb2a67fc640 1 -- 172.21.15.53:0/1626686290 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb29c01a070 con 0x7fb2a8108080 2024-08-31T06:30:26.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.757+0000 7fb2a67fc640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2900b4d20 0x7fb2900b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:26.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.757+0000 7fb2ad6d6640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2900b4d20 0x7fb2900b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:26.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.757+0000 7fb2a67fc640 1 -- 172.21.15.53:0/1626686290 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fb29c0e4ea0 con 0x7fb2a8108080 2024-08-31T06:30:26.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.758+0000 7fb2ad6d6640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2900b4d20 0x7fb2900b7230 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00057c0 tx=0x7fb2a00058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:26.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.760+0000 7fb2a67fc640 1 -- 172.21.15.53:0/1626686290 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb29c0abcf0 con 0x7fb2a8108080 2024-08-31T06:30:26.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.974+0000 7fb2af93a640 1 -- 172.21.15.53:0/1626686290 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fb2a80635a0 con 0x7fb2900b4d20 2024-08-31T06:30:26.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.985+0000 7fb2a67fc640 1 -- 172.21.15.53:0/1626686290 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fb2a80635a0 con 0x7fb2900b4d20 2024-08-31T06:30:26.987 INFO:teuthology.orchestra.run.smithi053.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-31T00:00:00", "created": "2024-08-31T06:04:31", "first": "2024-08-31T06:05:00", "last": "2024-08-31T06:30:00", "last_pruned": "2024-08-31T06:30:01", "created_count": 26, "pruned_count": 20, "active": true} 2024-08-31T06:30:26.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.987+0000 7fb2af93a640 1 -- 172.21.15.53:0/1626686290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2900b4d20 msgr2=0x7fb2900b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:26.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.987+0000 7fb2af93a640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2900b4d20 0x7fb2900b7230 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00057c0 tx=0x7fb2a00058d0 comp rx=0 tx=0).stop 2024-08-31T06:30:26.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.987+0000 7fb2af93a640 1 -- 172.21.15.53:0/1626686290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2a8108080 msgr2=0x7fb2a819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:26.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.987+0000 7fb2af93a640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2a8108080 0x7fb2a819a700 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00d740 tx=0x7fb29c00dc00 comp rx=0 tx=0).stop 2024-08-31T06:30:26.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.988+0000 7fb2af93a640 1 -- 172.21.15.53:0/1626686290 shutdown_connections 2024-08-31T06:30:26.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.988+0000 7fb2af93a640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fb2900b4d20 0x7fb2900b7230 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:26.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.988+0000 7fb2af93a640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2a81089d0 0x7fb2a819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:26.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.988+0000 7fb2af93a640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2a8108080 0x7fb2a819a700 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:26.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.988+0000 7fb2af93a640 1 --2- 172.21.15.53:0/1626686290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a8102750 0x7fb2a819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:26.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.988+0000 7fb2af93a640 1 -- 172.21.15.53:0/1626686290 >> 172.21.15.53:0/1626686290 conn(0x7fb2a807a4e0 msgr2=0x7fb2a81061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:26.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.988+0000 7fb2af93a640 1 -- 172.21.15.53:0/1626686290 shutdown_connections 2024-08-31T06:30:26.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:26.988+0000 7fb2af93a640 1 -- 172.21.15.53:0/1626686290 wait complete. 2024-08-31T06:30:27.003 DEBUG:teuthology.orchestra.run.smithi053:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-31T06:30:27.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.034+0000 7f7ce37d8640 1 -- 172.21.15.53:0/1662591100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cdc101dd0 msgr2=0x7f7cdc1021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.034+0000 7f7ce37d8640 1 --2- 172.21.15.53:0/1662591100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cdc101dd0 0x7f7cdc1021e0 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009900 tx=0x7f7cd802a410 comp rx=0 tx=0).stop 2024-08-31T06:30:27.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.034+0000 7f7ce37d8640 1 -- 172.21.15.53:0/1662591100 shutdown_connections 2024-08-31T06:30:27.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.034+0000 7f7ce37d8640 1 --2- 172.21.15.53:0/1662591100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc106970 0x7f7cdc110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.034+0000 7f7ce37d8640 1 --2- 172.21.15.53:0/1662591100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cdc106020 0x7f7cdc106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.034+0000 7f7ce37d8640 1 --2- 172.21.15.53:0/1662591100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cdc101dd0 0x7f7cdc1021e0 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.034+0000 7f7ce37d8640 1 -- 172.21.15.53:0/1662591100 >> 172.21.15.53:0/1662591100 conn(0x7f7cdc077a00 msgr2=0x7f7cdc077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:27.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.034+0000 7f7ce37d8640 1 -- 172.21.15.53:0/1662591100 shutdown_connections 2024-08-31T06:30:27.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.034+0000 7f7ce37d8640 1 -- 172.21.15.53:0/1662591100 wait complete. 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.035+0000 7f7ce37d8640 1 Processor -- start 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.035+0000 7f7ce37d8640 1 -- start start 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.035+0000 7f7ce37d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cdc101dd0 0x7f7cdc19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.035+0000 7f7ce37d8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cdc106020 0x7f7cdc19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.035+0000 7f7ce37d8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc106970 0x7f7cdc19f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.035+0000 7f7ce37d8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc113710 con 0x7f7cdc101dd0 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.035+0000 7f7ce37d8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc113590 con 0x7f7cdc106970 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.035+0000 7f7ce1574640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cdc101dd0 0x7f7cdc19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.035+0000 7f7ce37d8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc113890 con 0x7f7cdc106020 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.035+0000 7f7ce1574640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cdc101dd0 0x7f7cdc19a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37628/0 (socket says 172.21.15.53:37628) 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.035+0000 7f7ce1574640 1 -- 172.21.15.53:0/2181989637 learned_addr learned my addr 172.21.15.53:0/2181989637 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cdc106020 0x7f7cdc19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc106970 0x7f7cdc19f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7ce1574640 1 -- 172.21.15.53:0/2181989637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cdc106020 msgr2=0x7f7cdc19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7ce1574640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cdc106020 0x7f7cdc19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7ce1574640 1 -- 172.21.15.53:0/2181989637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc106970 msgr2=0x7f7cdc19f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7ce1574640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc106970 0x7f7cdc19f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7ce1574640 1 -- 172.21.15.53:0/2181989637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc1a0110 con 0x7f7cdc101dd0 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc106970 0x7f7cdc19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7ce1574640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cdc101dd0 0x7f7cdc19a1a0 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8005940 tx=0x7f7cd8032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7cce7fc640 1 -- 172.21.15.53:0/2181989637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd803f030 con 0x7f7cdc101dd0 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7ce37d8640 1 -- 172.21.15.53:0/2181989637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc1a03a0 con 0x7f7cdc101dd0 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7cce7fc640 1 -- 172.21.15.53:0/2181989637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cd8004450 con 0x7f7cdc101dd0 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7ce37d8640 1 -- 172.21.15.53:0/2181989637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc1a6b60 con 0x7f7cdc101dd0 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.036+0000 7f7cce7fc640 1 -- 172.21.15.53:0/2181989637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8035070 con 0x7f7cdc101dd0 2024-08-31T06:30:27.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.039+0000 7f7ce9d4d740 1 Processor -- start 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.039+0000 7f7ce9d4d740 1 -- start start 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.039+0000 7f7cce7fc640 1 -- 172.21.15.53:0/2181989637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7cd8042030 con 0x7f7cdc101dd0 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.039+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581979300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.039+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581979840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.039+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815b3390 0x55c581979d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.039+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c5818f0630 con 0x55c5815d4070 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.039+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c5818dfbc0 con 0x55c5815ab1b0 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.039+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c5818e3b70 con 0x55c5815b3390 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7ce1d75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581979300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7ce1d75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581979300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37636/0 (socket says 172.21.15.53:37636) 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7ce1d75640 1 -- 172.21.15.53:0/2703904723 learned_addr learned my addr 172.21.15.53:0/2703904723 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/2703904723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815b3390 0x55c581979d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7ce1574640 1 --2- 172.21.15.53:0/2703904723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581979840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7ce1d75640 1 -- 172.21.15.53:0/2703904723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815b3390 msgr2=0x55c581979d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/2703904723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815b3390 0x55c581979d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7ce1d75640 1 -- 172.21.15.53:0/2703904723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 msgr2=0x55c581979840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/2703904723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581979840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7ce1d75640 1 -- 172.21.15.53:0/2703904723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c58163f650 con 0x55c5815d4070 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/2703904723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581979300 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009f10 tx=0x7f7cd400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323d256dcfd4d2a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.040+0000 7f7cc77fe640 1 -- 172.21.15.53:0/2703904723 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4016070 con 0x55c5815d4070 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.041+0000 7f7cce7fc640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cc80b4ca0 0x7f7cc80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.041+0000 7f7cc77fe640 1 -- 172.21.15.53:0/2703904723 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cd4004d20 con 0x55c5815d4070 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.041+0000 7f7cc77fe640 1 -- 172.21.15.53:0/2703904723 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd40116d0 con 0x55c5815d4070 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.041+0000 7f7ce1574640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cc80b4ca0 0x7f7cc80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.041+0000 7f7cce7fc640 1 -- 172.21.15.53:0/2181989637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f7cd8105b40 con 0x7f7cdc101dd0 2024-08-31T06:30:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/2703904723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 msgr2=0x55c581979300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce1574640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cc80b4ca0 0x7f7cc80b71b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8103320 tx=0x7f7cd8109690 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/2703904723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581979300 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009f10 tx=0x7f7cd400e6c0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/2703904723 shutdown_connections 2024-08-31T06:30:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/2703904723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815b3390 0x55c581979d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/2703904723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581979840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/2703904723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581979300 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/2703904723 >> 172.21.15.53:0/2703904723 conn(0x55c5815c8460 msgr2=0x55c5819771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/2703904723 shutdown_connections 2024-08-31T06:30:27.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/2703904723 wait complete. 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce9d4d740 1 -- start start 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.042+0000 7f7ce9d4d740 1 Processor -- start 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815ab1b0 0x55c581984a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581984fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815d4070 0x55c581990e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c581742700 con 0x55c5815b3390 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c581866700 con 0x55c5815d4070 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c581987ae0 con 0x55c5815ab1b0 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce9d4d740 10 client.0 _ll_register_callbacks cb 0x55c581895dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce0d73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581984fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce0d73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581984fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37648/0 (socket says 172.21.15.53:37648) 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce0d73640 1 -- 172.21.15.53:0/980499468 learned_addr learned my addr 172.21.15.53:0/980499468 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:27.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815ab1b0 0x55c581984a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815d4070 0x55c581990e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce0d73640 1 -- 172.21.15.53:0/980499468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815ab1b0 msgr2=0x55c581984a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815ab1b0 0x55c581984a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce0d73640 1 -- 172.21.15.53:0/980499468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815d4070 msgr2=0x55c581990e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815d4070 0x55c581990e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce0d73640 1 -- 172.21.15.53:0/980499468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c58189f8b0 con 0x55c5815b3390 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.043+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815d4070 0x55c581990e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.044+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581984fc0 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0012700 tx=0x7f7cd0012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e9e06ccb752057 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.044+0000 7f7cc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.044+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/980499468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0004260 con 0x55c5815b3390 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.044+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/980499468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f7cd0004400 con 0x55c5815b3390 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.044+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/980499468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cd4004d20 con 0x55c5815b3390 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.044+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/980499468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f7cd00119a0 con 0x55c5815b3390 2024-08-31T06:30:27.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.044+0000 7f7ce9d4d740 10 client.23220 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.044+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/980499468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x55c581993920 con 0x55c5815b3390 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.044+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/980499468 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cd4004d20 con 0x55c5815b3390 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.044+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/980499468 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7f7cd000f440 con 0x55c5815b3390 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.045+0000 7f7ce9d4d740 10 client.23220 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.045+0000 7f7ce9d4d740 10 client.23220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.045+0000 7f7ce9d4d740 20 client.23220 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.045+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5815929f0 0x55c581996f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.045+0000 7f7ce9d4d740 4 client.23220 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.045+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/980499468 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5818f2580 con 0x55c5815929f0 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.045+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5815929f0 0x55c581996f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.045+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5815929f0 0x55c581996f30 crc :-1 s=READY pgs=596 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a76205948b33534f server_cookie=257e118b596bdcef in_seq=0 out_seq=0 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.045+0000 7f7cc4ff9640 10 client.23220 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:27.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/980499468 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c5818f2580 con 0x55c5815929f0 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7cc4ff9640 10 client.23220 handle_command_reply: tid=0 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7ce9d4d740 1 client.23220 shutdown 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/980499468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 msgr2=0x55c581984fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581984fc0 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0012700 tx=0x7f7cd0012bc0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/980499468 shutdown_connections 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c5815929f0 0x55c581996f30 crc :-1 s=READY pgs=596 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815d4070 0x55c581990e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7cc4ff9640 0 client.23220 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581984fc0 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/980499468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815ab1b0 0x55c581984a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/980499468 >> 172.21.15.53:0/980499468 conn(0x55c5815c8460 msgr2=0x55c58197c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.046+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/980499468 shutdown_connections 2024-08-31T06:30:27.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.047+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/980499468 wait complete. 2024-08-31T06:30:27.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.047+0000 7f7ce9d4d740 20 client.23220 trim_cache size 0 max 16384 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.080+0000 7f7ce9d4d740 1 Processor -- start 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.080+0000 7f7ce9d4d740 1 -- start start 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.080+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581990d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581976b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815d4070 0x55c581977050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1af510 con 0x55c5815b3390 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1b1290 con 0x55c5815ab1b0 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1afca0 con 0x55c5815d4070 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce0d73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581976b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce0d73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581976b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37656/0 (socket says 172.21.15.53:37656) 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce0d73640 1 -- 172.21.15.53:0/3451713784 learned_addr learned my addr 172.21.15.53:0/3451713784 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/3451713784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815d4070 0x55c581977050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/3451713784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581990d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce0d73640 1 -- 172.21.15.53:0/3451713784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815d4070 msgr2=0x55c581977050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/3451713784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815d4070 0x55c581977050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce0d73640 1 -- 172.21.15.53:0/3451713784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 msgr2=0x55c581990d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/3451713784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581990d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce0d73640 1 -- 172.21.15.53:0/3451713784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c581982f80 con 0x55c5815b3390 2024-08-31T06:30:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/3451713784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581976b10 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000f860 tx=0x7f7cd0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddae6758534f9cf6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:27.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.081+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/3451713784 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0031070 con 0x55c5815b3390 2024-08-31T06:30:27.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.082+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/3451713784 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cd000f440 con 0x55c5815b3390 2024-08-31T06:30:27.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.082+0000 7f7cc6ffd640 1 -- 172.21.15.53:0/3451713784 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0028040 con 0x55c5815b3390 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.082+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3451713784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 msgr2=0x55c581976b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.082+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/3451713784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581976b10 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000f860 tx=0x7f7cd0000bc0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.082+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3451713784 shutdown_connections 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.082+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/3451713784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815d4070 0x55c581977050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.083+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/3451713784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815b3390 0x55c581976b10 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.083+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/3451713784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581990d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.083+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3451713784 >> 172.21.15.53:0/3451713784 conn(0x55c5815c8460 msgr2=0x55c581983300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.083+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3451713784 shutdown_connections 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.083+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3451713784 wait complete. 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.083+0000 7f7ce9d4d740 1 -- start start 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.083+0000 7f7ce9d4d740 1 Processor -- start 2024-08-31T06:30:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581988f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815b3390 0x55c5819894d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce9d4d740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581a008f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1b0b30 con 0x55c5815d4070 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1b03a0 con 0x55c5815ab1b0 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce9d4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1ad510 con 0x55c5815b3390 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce9d4d740 10 client.0 _ll_register_callbacks cb 0x7f7cd00096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce1d75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581a008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce1d75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581a008f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37662/0 (socket says 172.21.15.53:37662) 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce1d75640 1 -- 172.21.15.53:0/3998477208 learned_addr learned my addr 172.21.15.53:0/3998477208 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815b3390 0x55c5819894d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581988f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce1d75640 1 -- 172.21.15.53:0/3998477208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815b3390 msgr2=0x55c5819894d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815b3390 0x55c5819894d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce1d75640 1 -- 172.21.15.53:0/3998477208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 msgr2=0x55c581988f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581988f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce1d75640 1 -- 172.21.15.53:0/3998477208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c581989cc0 con 0x55c5815d4070 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815b3390 0x55c5819894d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7ce1d75640 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581a008f0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x55c581994e20 tx=0x7f7cd0009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67d2a7b2ceef71d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.084+0000 7f7cc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/3998477208 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4016040 con 0x55c5815d4070 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3998477208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cd000f440 con 0x55c5815d4070 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/3998477208 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f7cd4011900 con 0x55c5815d4070 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/3998477208 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f7cd4011b00 con 0x55c5815d4070 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7ce9d4d740 10 client.23226 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3998477208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x55c581a01e50 con 0x55c5815d4070 2024-08-31T06:30:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/3998477208 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cd000f440 con 0x55c5815d4070 2024-08-31T06:30:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/3998477208 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7f7cd400f040 con 0x55c5815d4070 2024-08-31T06:30:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7ce9d4d740 10 client.23226 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7ce9d4d740 10 client.23226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7ce9d4d740 20 client.23226 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c581567da0 0x55c581a044b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7ce9d4d740 4 client.23226 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:30:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.085+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3998477208 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c5818ee020 con 0x55c581567da0 2024-08-31T06:30:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.086+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c581567da0 0x55c581a044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.086+0000 7f7ce0d73640 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c581567da0 0x55c581a044b0 crc :-1 s=READY pgs=597 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=719fd877a3fb75d6 server_cookie=230f49b1f5220ab7 in_seq=0 out_seq=0 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.086+0000 7f7cc4ff9640 10 client.23226 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.086+0000 7f7cc4ff9640 1 -- 172.21.15.53:0/3998477208 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8894 (crc 0 0 0) 0x55c5818ee020 con 0x55c581567da0 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7cc4ff9640 10 client.23226 handle_command_reply: tid=0 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 1 client.23226 shutdown 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3998477208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 msgr2=0x55c581a008f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581a008f0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x55c581994e20 tx=0x7f7cd0009ce0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3998477208 shutdown_connections 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x55c581567da0 0x55c581a044b0 crc :-1 s=READY pgs=597 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c5815d4070 0x55c581a008f0 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7cc4ff9640 0 client.23226 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5815b3390 0x55c5819894d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 1 --2- 172.21.15.53:0/3998477208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c5815ab1b0 0x55c581988f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3998477208 >> 172.21.15.53:0/3998477208 conn(0x55c5815c8460 msgr2=0x55c58197c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:27.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3998477208 shutdown_connections 2024-08-31T06:30:27.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 1 -- 172.21.15.53:0/3998477208 wait complete. 2024-08-31T06:30:27.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.087+0000 7f7ce9d4d740 20 client.23226 trim_cache size 0 max 16384 2024-08-31T06:30:27.094 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:30:27.094 INFO:teuthology.orchestra.run.smithi053.stdout: "status": "no active scrubs running", 2024-08-31T06:30:27.094 INFO:teuthology.orchestra.run.smithi053.stdout: "scrubs": {}, 2024-08-31T06:30:27.094 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_stats": { 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "a8c7f914-8c3b-4a6f-8f93-71d6ae7dd589": { 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:29:19.025262+0000", 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "414a1081-11c9-4d68-99ae-4d7c02bab716": { 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:03.741212+0000", 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.095 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "abd92b8d-89e2-4a96-b2e5-c9a89ac76d61": { 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:15:25.524426+0000", 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "0a265333-0ba8-49b6-b77e-feff777f1223": { 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:05:23.518503+0000", 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "447f8d1c-f2e9-441a-9a82-2758f6950c38": { 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:12:18.174114+0000", 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.097 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "935f53e4-02aa-49a7-b769-bab4481269e9": { 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:20:13.481800+0000", 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "6ca348ee-0457-4977-87ef-85a069fa32d3": { 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:11:28.542109+0000", 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.098 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "3e7cb90c-5b9b-4a75-b575-b69641d835a2": { 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:10:10.734673+0000", 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "db980a93-0473-48c6-b079-63ebf1ca0908": { 2024-08-31T06:30:27.099 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:14:38.350349+0000", 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: "1b03aadd-4a9d-4b56-95ef-ec885b6cfed9": { 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:13:49.182316+0000", 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.100 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "37b8d261-d715-40ef-b11a-10da2f3a9885": { 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:47.012582+0000", 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "4457a2b0-b9b7-447a-9934-a20026fc99bb": { 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:51.357541+0000", 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.101 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: "857f8219-039c-44d2-8dd7-af494d80e735": { 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:26:48.510100+0000", 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.102 INFO:teuthology.orchestra.run.smithi053.stdout: "fa5ace9d-f238-4ef4-9c35-2f21c99cf66b": { 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:07:00.745524+0000", 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "1087e56d-4883-4320-a656-e3bc73bc3344": { 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:21:15.724583+0000", 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "bbc79bfb-4ac7-40d3-b8c3-9b806c769ac5": { 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:19:24.201763+0000", 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "1ad07a15-8667-4a97-9c5f-5e578a42ded4": { 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:24:51.737364+0000", 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.104 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "b0975b60-4943-46fa-8c34-072ffbab94be": { 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:06:09.607564+0000", 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "2fed2c78-e329-4f7b-a695-c06d48d6f6a5": { 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:23:01.225520+0000", 2024-08-31T06:30:27.105 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.106 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.106 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.106 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.106 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.106 INFO:teuthology.orchestra.run.smithi053.stdout: "b8913bba-c1e2-47fb-86e0-4a4609bf2808": { 2024-08-31T06:30:27.106 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:08:33.001648+0000", 2024-08-31T06:30:27.107 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.107 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.107 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.107 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: "3c548943-e999-41ac-a451-79dccf0c05e3": { 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:17:44.777705+0000", 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: "d594849b-7418-4d8f-b5b0-5c03697b954c": { 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:09:19.315711+0000", 2024-08-31T06:30:27.108 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: "0450956f-5b94-476e-9a3a-8abca9e5b7df": { 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:04:31.773558+0000", 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "cb0f8810-b92a-4905-8f2c-4332eba53d62": { 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:25:55.673122+0000", 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "c852752b-53bf-4f84-90ac-1759f148a9bf": { 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:12.784503+0000", 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.110 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: "00e51c37-5337-4356-af2b-24afda8741d6": { 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:16:58.122617+0000", 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: "a849b420-52ce-457c-9b7e-01903fe0dfa3": { 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:18:31.789786+0000", 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.111 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.112 INFO:teuthology.orchestra.run.smithi053.stdout: "f9469319-2447-4e45-b3a4-9f9a80519da4": { 2024-08-31T06:30:27.112 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:22:15.611412+0000", 2024-08-31T06:30:27.112 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.112 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.118 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.119 INFO:teuthology.orchestra.run.smithi053.stdout: "e839581e-94c5-4714-a1a6-40730925f6b8": { 2024-08-31T06:30:27.119 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:28:29.506188+0000", 2024-08-31T06:30:27.119 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: "6fe44679-ed78-4545-985c-f14e714c05d2": { 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:30:24.441027+0000", 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: "cac6d546-f1c8-4203-803b-7c8d84c48507": { 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: "start_time": "2024-08-31T06:27:34.520218+0000", 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/", 2024-08-31T06:30:27.120 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:27.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_passed": 0, 2024-08-31T06:30:27.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_failed": 0, 2024-08-31T06:30:27.121 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_skipped": 0 2024-08-31T06:30:27.121 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:27.121 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:27.121 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:30:27.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 -- 172.21.15.53:0/2181989637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cc80b4ca0 msgr2=0x7f7cc80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cc80b4ca0 0x7f7cc80b71b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8103320 tx=0x7f7cd8109690 comp rx=0 tx=0).stop 2024-08-31T06:30:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 -- 172.21.15.53:0/2181989637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cdc101dd0 msgr2=0x7f7cdc19a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cdc101dd0 0x7f7cdc19a1a0 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8005940 tx=0x7f7cd8032f90 comp rx=0 tx=0).stop 2024-08-31T06:30:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 -- 172.21.15.53:0/2181989637 shutdown_connections 2024-08-31T06:30:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7cc80b4ca0 0x7f7cc80b71b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc106970 0x7f7cdc19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7cdc106020 0x7f7cdc19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 --2- 172.21.15.53:0/2181989637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cdc101dd0 0x7f7cdc19a1a0 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 -- 172.21.15.53:0/2181989637 >> 172.21.15.53:0/2181989637 conn(0x7f7cdc077a00 msgr2=0x7f7cdc1072f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 -- 172.21.15.53:0/2181989637 shutdown_connections 2024-08-31T06:30:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.088+0000 7f7ce37d8640 1 -- 172.21.15.53:0/2181989637 wait complete. 2024-08-31T06:30:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.137+0000 7f2a40ad5640 1 -- 172.21.15.53:0/2992058698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3c109af0 msgr2=0x7f2a3c110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.137+0000 7f2a40ad5640 1 --2- 172.21.15.53:0/2992058698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3c109af0 0x7f2a3c110320 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009ca0 tx=0x7f2a3402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.137+0000 7f2a40ad5640 1 -- 172.21.15.53:0/2992058698 shutdown_connections 2024-08-31T06:30:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.137+0000 7f2a40ad5640 1 --2- 172.21.15.53:0/2992058698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3c109af0 0x7f2a3c110320 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.137+0000 7f2a40ad5640 1 --2- 172.21.15.53:0/2992058698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a3c1091a0 0x7f2a3c1095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.137+0000 7f2a40ad5640 1 --2- 172.21.15.53:0/2992058698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a3c103870 0x7f2a3c103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.137+0000 7f2a40ad5640 1 -- 172.21.15.53:0/2992058698 >> 172.21.15.53:0/2992058698 conn(0x7f2a3c0ff2b0 msgr2=0x7f2a3c101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.137+0000 7f2a40ad5640 1 -- 172.21.15.53:0/2992058698 shutdown_connections 2024-08-31T06:30:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.137+0000 7f2a40ad5640 1 -- 172.21.15.53:0/2992058698 wait complete. 2024-08-31T06:30:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a40ad5640 1 Processor -- start 2024-08-31T06:30:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a40ad5640 1 -- start start 2024-08-31T06:30:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a40ad5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a3c103870 0x7f2a3c19a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a40ad5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3c1091a0 0x7f2a3c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a40ad5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a3c109af0 0x7f2a3c19f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a40ad5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c1136c0 con 0x7f2a3c1091a0 2024-08-31T06:30:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a40ad5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c113540 con 0x7f2a3c109af0 2024-08-31T06:30:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a40ad5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c113840 con 0x7f2a3c103870 2024-08-31T06:30:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a39d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3c1091a0 0x7f2a3c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a39d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3c1091a0 0x7f2a3c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37682/0 (socket says 172.21.15.53:37682) 2024-08-31T06:30:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a39d9b640 1 -- 172.21.15.53:0/536378293 learned_addr learned my addr 172.21.15.53:0/536378293 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a3ad9d640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a3c109af0 0x7f2a3c19f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a3a59c640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a3c103870 0x7f2a3c19a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a39d9b640 1 -- 172.21.15.53:0/536378293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a3c103870 msgr2=0x7f2a3c19a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a39d9b640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a3c103870 0x7f2a3c19a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a39d9b640 1 -- 172.21.15.53:0/536378293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a3c109af0 msgr2=0x7f2a3c19f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a39d9b640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a3c109af0 0x7f2a3c19f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a39d9b640 1 -- 172.21.15.53:0/536378293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c19ffd0 con 0x7f2a3c1091a0 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.138+0000 7f2a3a59c640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a3c103870 0x7f2a3c19a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.139+0000 7f2a39d9b640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3c1091a0 0x7f2a3c19a640 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000e9c0 tx=0x7f2a3000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.139+0000 7f2a2b7fe640 1 -- 172.21.15.53:0/536378293 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3000ccc0 con 0x7f2a3c1091a0 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.139+0000 7f2a2b7fe640 1 -- 172.21.15.53:0/536378293 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a300054b0 con 0x7f2a3c1091a0 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.139+0000 7f2a40ad5640 1 -- 172.21.15.53:0/536378293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3c1a02c0 con 0x7f2a3c1091a0 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.139+0000 7f2a2b7fe640 1 -- 172.21.15.53:0/536378293 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30010430 con 0x7f2a3c1091a0 2024-08-31T06:30:27.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.139+0000 7f2a40ad5640 1 -- 172.21.15.53:0/536378293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a3c1a6a50 con 0x7f2a3c1091a0 2024-08-31T06:30:27.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.140+0000 7f2a40ad5640 1 -- 172.21.15.53:0/536378293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a3c104ae0 con 0x7f2a3c1091a0 2024-08-31T06:30:27.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.141+0000 7f2a2b7fe640 1 -- 172.21.15.53:0/536378293 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2a30004f00 con 0x7f2a3c1091a0 2024-08-31T06:30:27.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.142+0000 7f2a2b7fe640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a240b4ca0 0x7f2a240b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:27.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.142+0000 7f2a3a59c640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a240b4ca0 0x7f2a240b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:27.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.142+0000 7f2a2b7fe640 1 -- 172.21.15.53:0/536378293 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f2a300e5bf0 con 0x7f2a3c1091a0 2024-08-31T06:30:27.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.143+0000 7f2a3a59c640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a240b4ca0 0x7f2a240b71b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0058c0 tx=0x7f2a2c005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:27.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.145+0000 7f2a2b7fe640 1 -- 172.21.15.53:0/536378293 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2a30056130 con 0x7f2a3c1091a0 2024-08-31T06:30:27.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:27 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:27.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.356+0000 7f2a40ad5640 1 -- 172.21.15.53:0/536378293 --> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f2a3c0635a0 con 0x7f2a240b4ca0 2024-08-31T06:30:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.367+0000 7f2a2b7fe640 1 -- 172.21.15.53:0/536378293 <== mgr.14220 v2:172.21.15.53:6800/1345161100 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f2a3c0635a0 con 0x7f2a240b4ca0 2024-08-31T06:30:27.369 INFO:teuthology.orchestra.run.smithi053.stdout:/ 1m 6m3h 2024-08-31T06:30:27.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.369+0000 7f2a40ad5640 1 -- 172.21.15.53:0/536378293 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a240b4ca0 msgr2=0x7f2a240b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.369+0000 7f2a40ad5640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a240b4ca0 0x7f2a240b71b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0058c0 tx=0x7f2a2c005850 comp rx=0 tx=0).stop 2024-08-31T06:30:27.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.369+0000 7f2a40ad5640 1 -- 172.21.15.53:0/536378293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3c1091a0 msgr2=0x7f2a3c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:27.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.369+0000 7f2a40ad5640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3c1091a0 0x7f2a3c19a640 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000e9c0 tx=0x7f2a3000ee80 comp rx=0 tx=0).stop 2024-08-31T06:30:27.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.369+0000 7f2a40ad5640 1 -- 172.21.15.53:0/536378293 shutdown_connections 2024-08-31T06:30:27.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.369+0000 7f2a40ad5640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f2a240b4ca0 0x7f2a240b71b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.369+0000 7f2a40ad5640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a3c109af0 0x7f2a3c19f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.369+0000 7f2a40ad5640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a3c1091a0 0x7f2a3c19a640 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.369+0000 7f2a40ad5640 1 --2- 172.21.15.53:0/536378293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a3c103870 0x7f2a3c19a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:27.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.369+0000 7f2a40ad5640 1 -- 172.21.15.53:0/536378293 >> 172.21.15.53:0/536378293 conn(0x7f2a3c0ff2b0 msgr2=0x7f2a3c1016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:27.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.370+0000 7f2a40ad5640 1 -- 172.21.15.53:0/536378293 shutdown_connections 2024-08-31T06:30:27.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:27.370+0000 7f2a40ad5640 1 -- 172.21.15.53:0/536378293 wait complete. 2024-08-31T06:30:27.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:27 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:27.383 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-31T06:30:27.393 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-31T06:30:27.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:27 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:27.861 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:30:27.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:30:28.113 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:28.342 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:28 smithi053 ceph-mon[18924]: pgmap v1128: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 246 op/s 2024-08-31T06:30:28.342 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:28 smithi053 ceph-mon[18924]: from='client.23208 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:28.342 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:28 smithi053 ceph-mon[18924]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:28.342 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:28 smithi053 ceph-mon[18924]: from='client.23232 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:28.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:28 smithi130 ceph-mon[22266]: pgmap v1128: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 246 op/s 2024-08-31T06:30:28.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:28 smithi130 ceph-mon[22266]: from='client.23208 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:28.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:28 smithi130 ceph-mon[22266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:28.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:28 smithi130 ceph-mon[22266]: from='client.23232 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:28.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:28 smithi153 ceph-mon[22320]: pgmap v1128: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 246 op/s 2024-08-31T06:30:28.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:28 smithi153 ceph-mon[22320]: from='client.23208 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:28.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:28 smithi153 ceph-mon[22320]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T06:30:28.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:28 smithi153 ceph-mon[22320]: from='client.23232 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:28.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.569+0000 7faf71b8b640 1 -- 172.21.15.53:0/409742965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6c102880 msgr2=0x7faf6c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:28.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.569+0000 7faf71b8b640 1 --2- 172.21.15.53:0/409742965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6c102880 0x7faf6c102c90 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009900 tx=0x7faf5c02a410 comp rx=0 tx=0).stop 2024-08-31T06:30:28.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.569+0000 7faf71b8b640 1 -- 172.21.15.53:0/409742965 shutdown_connections 2024-08-31T06:30:28.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.569+0000 7faf71b8b640 1 --2- 172.21.15.53:0/409742965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf6c108b10 0x7faf6c10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:28.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.569+0000 7faf71b8b640 1 --2- 172.21.15.53:0/409742965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf6c1081c0 0x7faf6c1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:28.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.569+0000 7faf71b8b640 1 --2- 172.21.15.53:0/409742965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6c102880 0x7faf6c102c90 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:28.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.569+0000 7faf71b8b640 1 -- 172.21.15.53:0/409742965 >> 172.21.15.53:0/409742965 conn(0x7faf6c079510 msgr2=0x7faf6c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:28.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.569+0000 7faf71b8b640 1 -- 172.21.15.53:0/409742965 shutdown_connections 2024-08-31T06:30:28.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.569+0000 7faf71b8b640 1 -- 172.21.15.53:0/409742965 wait complete. 2024-08-31T06:30:28.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.570+0000 7faf71b8b640 1 Processor -- start 2024-08-31T06:30:28.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.570+0000 7faf71b8b640 1 -- start start 2024-08-31T06:30:28.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.570+0000 7faf71b8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6c102880 0x7faf6c19b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:28.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.570+0000 7faf71b8b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf6c1081c0 0x7faf6c19b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:28.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.570+0000 7faf71b8b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf6c108b10 0x7faf6c19baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:28.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.570+0000 7faf71b8b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c112670 con 0x7faf6c102880 2024-08-31T06:30:28.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.570+0000 7faf71b8b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c1124f0 con 0x7faf6c108b10 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.570+0000 7faf71b8b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c1127f0 con 0x7faf6c1081c0 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf6b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6c102880 0x7faf6c19b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf6b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6c102880 0x7faf6c19b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37698/0 (socket says 172.21.15.53:37698) 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf6b7fe640 1 -- 172.21.15.53:0/2808793971 learned_addr learned my addr 172.21.15.53:0/2808793971 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf6affd640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf6c1081c0 0x7faf6c19b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf6bfff640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf6c108b10 0x7faf6c19baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf6b7fe640 1 -- 172.21.15.53:0/2808793971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf6c1081c0 msgr2=0x7faf6c19b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf6b7fe640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf6c1081c0 0x7faf6c19b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf6b7fe640 1 -- 172.21.15.53:0/2808793971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf6c108b10 msgr2=0x7faf6c19baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf6b7fe640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf6c108b10 0x7faf6c19baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf6b7fe640 1 -- 172.21.15.53:0/2808793971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c1a62b0 con 0x7faf6c102880 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf6b7fe640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6c102880 0x7faf6c19b020 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009230 tx=0x7faf5c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:28.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf68ff9640 1 -- 172.21.15.53:0/2808793971 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c03f030 con 0x7faf6c102880 2024-08-31T06:30:28.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf68ff9640 1 -- 172.21.15.53:0/2808793971 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf5c003a80 con 0x7faf6c102880 2024-08-31T06:30:28.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf71b8b640 1 -- 172.21.15.53:0/2808793971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf6c1a6540 con 0x7faf6c102880 2024-08-31T06:30:28.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.571+0000 7faf68ff9640 1 -- 172.21.15.53:0/2808793971 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c035070 con 0x7faf6c102880 2024-08-31T06:30:28.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.572+0000 7faf71b8b640 1 -- 172.21.15.53:0/2808793971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf6c1a6a70 con 0x7faf6c102880 2024-08-31T06:30:28.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.573+0000 7faf71b8b640 1 -- 172.21.15.53:0/2808793971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6c103b00 con 0x7faf6c102880 2024-08-31T06:30:28.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.574+0000 7faf68ff9640 1 -- 172.21.15.53:0/2808793971 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7faf5c042030 con 0x7faf6c102880 2024-08-31T06:30:28.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.575+0000 7faf68ff9640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf540b4d50 0x7faf540b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:28.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.575+0000 7faf6affd640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf540b4d50 0x7faf540b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:28.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.575+0000 7faf68ff9640 1 -- 172.21.15.53:0/2808793971 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7faf5c105a60 con 0x7faf6c102880 2024-08-31T06:30:28.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.575+0000 7faf6affd640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf540b4d50 0x7faf540b7260 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faf6c1051e0 tx=0x7faf6000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:28.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.579+0000 7faf68ff9640 1 -- 172.21.15.53:0/2808793971 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faf5c0cc830 con 0x7faf6c102880 2024-08-31T06:30:28.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.804+0000 7faf71b8b640 1 -- 172.21.15.53:0/2808793971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf6c102c90 con 0x7faf6c102880 2024-08-31T06:30:28.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.804+0000 7faf68ff9640 1 -- 172.21.15.53:0/2808793971 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+12006 (secure 0 0 0) 0x7faf5c0cc130 con 0x7faf6c102880 2024-08-31T06:30:28.806 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:30:28.806 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":95,"btime":"2024-08-31T06:30:27:012060+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":95,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:30:26.264627+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:30:28.807 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 95 2024-08-31T06:30:28.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.806+0000 7faf71b8b640 1 -- 172.21.15.53:0/2808793971 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf540b4d50 msgr2=0x7faf540b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:28.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.806+0000 7faf71b8b640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf540b4d50 0x7faf540b7260 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faf6c1051e0 tx=0x7faf6000b390 comp rx=0 tx=0).stop 2024-08-31T06:30:28.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.806+0000 7faf71b8b640 1 -- 172.21.15.53:0/2808793971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6c102880 msgr2=0x7faf6c19b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:28.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.806+0000 7faf71b8b640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6c102880 0x7faf6c19b020 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009230 tx=0x7faf5c004270 comp rx=0 tx=0).stop 2024-08-31T06:30:28.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.806+0000 7faf71b8b640 1 -- 172.21.15.53:0/2808793971 shutdown_connections 2024-08-31T06:30:28.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.806+0000 7faf71b8b640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf540b4d50 0x7faf540b7260 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:28.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.806+0000 7faf71b8b640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf6c108b10 0x7faf6c19baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:28.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.806+0000 7faf71b8b640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf6c1081c0 0x7faf6c19b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:28.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.806+0000 7faf71b8b640 1 --2- 172.21.15.53:0/2808793971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6c102880 0x7faf6c19b020 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:28.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.807+0000 7faf71b8b640 1 -- 172.21.15.53:0/2808793971 >> 172.21.15.53:0/2808793971 conn(0x7faf6c079510 msgr2=0x7faf6c106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:28.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.807+0000 7faf71b8b640 1 -- 172.21.15.53:0/2808793971 shutdown_connections 2024-08-31T06:30:28.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:28.807+0000 7faf71b8b640 1 -- 172.21.15.53:0/2808793971 wait complete. 2024-08-31T06:30:29.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:29 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2808793971' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:29.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:29 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2808793971' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:29.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:29 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2808793971' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:30:29.598 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T06:30:29.860 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:30.244 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:30 smithi053 ceph-mon[18924]: pgmap v1129: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 246 op/s 2024-08-31T06:30:30.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:30 smithi130 ceph-mon[22266]: pgmap v1129: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 246 op/s 2024-08-31T06:30:30.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:30 smithi153 ceph-mon[22320]: pgmap v1129: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 246 op/s 2024-08-31T06:30:30.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.536+0000 7fa286793640 1 -- 172.21.15.53:0/1940876232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa28010dbb0 msgr2=0x7fa2801100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:30.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.536+0000 7fa286793640 1 --2- 172.21.15.53:0/1940876232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa28010dbb0 0x7fa2801100a0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7fa278009ca0 tx=0x7fa27802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.536+0000 7fa286793640 1 -- 172.21.15.53:0/1940876232 shutdown_connections 2024-08-31T06:30:30.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.536+0000 7fa286793640 1 --2- 172.21.15.53:0/1940876232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa28010dbb0 0x7fa2801100a0 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.536+0000 7fa286793640 1 --2- 172.21.15.53:0/1940876232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2801050a0 0x7fa28010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.536+0000 7fa286793640 1 --2- 172.21.15.53:0/1940876232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa280104750 0x7fa280104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.536+0000 7fa286793640 1 -- 172.21.15.53:0/1940876232 >> 172.21.15.53:0/1940876232 conn(0x7fa2800794a0 msgr2=0x7fa2800798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.536+0000 7fa286793640 1 -- 172.21.15.53:0/1940876232 shutdown_connections 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.537+0000 7fa286793640 1 -- 172.21.15.53:0/1940876232 wait complete. 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.537+0000 7fa286793640 1 Processor -- start 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.537+0000 7fa286793640 1 -- start start 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa286793640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa280104750 0x7fa28019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa286793640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2801050a0 0x7fa28019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa286793640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa28010dbb0 0x7fa28019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa286793640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa280113730 con 0x7fa280104750 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa286793640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801135b0 con 0x7fa28010dbb0 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa286793640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801138b0 con 0x7fa2801050a0 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa27ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa280104750 0x7fa28019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa27ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa280104750 0x7fa28019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37708/0 (socket says 172.21.15.53:37708) 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa27ffff640 1 -- 172.21.15.53:0/2238896772 learned_addr learned my addr 172.21.15.53:0/2238896772 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2801050a0 0x7fa28019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa284d30640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa28010dbb0 0x7fa28019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa27ffff640 1 -- 172.21.15.53:0/2238896772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2801050a0 msgr2=0x7fa28019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa27ffff640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2801050a0 0x7fa28019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa27ffff640 1 -- 172.21.15.53:0/2238896772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa28010dbb0 msgr2=0x7fa28019fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa27ffff640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa28010dbb0 0x7fa28019fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa27ffff640 1 -- 172.21.15.53:0/2238896772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2801a0130 con 0x7fa280104750 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2801050a0 0x7fa28019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.538+0000 7fa284d30640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa28010dbb0 0x7fa28019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.539+0000 7fa27ffff640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa280104750 0x7fa28019a1c0 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7fa27000d770 tx=0x7fa27000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:30.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.539+0000 7fa27d7fa640 1 -- 172.21.15.53:0/2238896772 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270017070 con 0x7fa280104750 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.539+0000 7fa286793640 1 -- 172.21.15.53:0/2238896772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2801a0420 con 0x7fa280104750 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.539+0000 7fa27d7fa640 1 -- 172.21.15.53:0/2238896772 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2700054b0 con 0x7fa280104750 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.539+0000 7fa27d7fa640 1 -- 172.21.15.53:0/2238896772 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270004c60 con 0x7fa280104750 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.539+0000 7fa286793640 1 -- 172.21.15.53:0/2238896772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2801a6b80 con 0x7fa280104750 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.542+0000 7fa27d7fa640 1 -- 172.21.15.53:0/2238896772 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa270010460 con 0x7fa280104750 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.542+0000 7fa28cd08740 1 Processor -- start 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.542+0000 7fa28cd08740 1 -- start start 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.542+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd0f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.542+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd0f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.542+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd0fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.542+0000 7fa28cd08740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7fcc86680 con 0x55f7fc949390 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.542+0000 7fa28cd08740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f7fcc75c10 con 0x55f7fc96a070 2024-08-31T06:30:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.542+0000 7fa28cd08740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f7fcc79bc0 con 0x55f7fc9411b0 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd0fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd0fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37716/0 (socket says 172.21.15.53:37716) 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27f7fe640 1 -- 172.21.15.53:0/84957132 learned_addr learned my addr 172.21.15.53:0/84957132 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27d7fa640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2680b4ca0 0x7fa2680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27ffff640 1 --2- 172.21.15.53:0/84957132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd0f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa284d30640 1 --2- 172.21.15.53:0/84957132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd0f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa284d30640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2680b4ca0 0x7fa2680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27f7fe640 1 -- 172.21.15.53:0/84957132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 msgr2=0x55f7fcd0f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/84957132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd0f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27f7fe640 1 -- 172.21.15.53:0/84957132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 msgr2=0x55f7fcd0f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/84957132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd0f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27f7fe640 1 -- 172.21.15.53:0/84957132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fc9d5650 con 0x55f7fc949390 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27d7fa640 1 -- 172.21.15.53:0/2238896772 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fa2700e50a0 con 0x7fa280104750 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/84957132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd0fd90 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7fa27400bc60 tx=0x7fa27400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbf46c2f0830c2a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa284d30640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2680b4ca0 0x7fa2680b71b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa2780094e0 tx=0x7fa2780095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.543+0000 7fa2667fc640 1 -- 172.21.15.53:0/84957132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274015070 con 0x55f7fc949390 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.544+0000 7fa2667fc640 1 -- 172.21.15.53:0/84957132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa27401a8f0 con 0x55f7fc949390 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.544+0000 7fa2667fc640 1 -- 172.21.15.53:0/84957132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2740118c0 con 0x55f7fc949390 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.544+0000 7fa28cd08740 1 -- 172.21.15.53:0/84957132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 msgr2=0x55f7fcd0fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.544+0000 7fa28cd08740 1 --2- 172.21.15.53:0/84957132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd0fd90 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7fa27400bc60 tx=0x7fa27400f730 comp rx=0 tx=0).stop 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.544+0000 7fa28cd08740 1 -- 172.21.15.53:0/84957132 shutdown_connections 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.544+0000 7fa28cd08740 1 --2- 172.21.15.53:0/84957132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd0fd90 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.544+0000 7fa28cd08740 1 --2- 172.21.15.53:0/84957132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd0f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.544+0000 7fa28cd08740 1 --2- 172.21.15.53:0/84957132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd0f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.544+0000 7fa28cd08740 1 -- 172.21.15.53:0/84957132 >> 172.21.15.53:0/84957132 conn(0x55f7fc95e460 msgr2=0x55f7fcd0d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.545+0000 7fa28cd08740 1 -- 172.21.15.53:0/84957132 shutdown_connections 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.545+0000 7fa28cd08740 1 -- 172.21.15.53:0/84957132 wait complete. 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.545+0000 7fa28cd08740 1 -- start start 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.545+0000 7fa28cd08740 1 Processor -- start 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.545+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc9411b0 0x55f7fcd1eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.545+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc949390 0x55f7fcd1f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.545+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc96a070 0x55f7fcd2b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.545+0000 7fa28cd08740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7fcad8700 con 0x55f7fc96a070 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.545+0000 7fa28cd08740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f7fcbfc750 con 0x55f7fc9411b0 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.545+0000 7fa28cd08740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f7fcd21e50 con 0x55f7fc949390 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.546+0000 7fa28cd08740 10 client.0 _ll_register_callbacks cb 0x55f7fcc2be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.546+0000 7fa284d30640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc96a070 0x55f7fcd2b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.546+0000 7fa284d30640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc96a070 0x55f7fcd2b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37724/0 (socket says 172.21.15.53:37724) 2024-08-31T06:30:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.546+0000 7fa284d30640 1 -- 172.21.15.53:0/638185055 learned_addr learned my addr 172.21.15.53:0/638185055 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.546+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc949390 0x55f7fcd1f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.546+0000 7fa27ffff640 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc9411b0 0x55f7fcd1eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.546+0000 7fa27f7fe640 1 -- 172.21.15.53:0/638185055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc9411b0 msgr2=0x55f7fcd1eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.546+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc9411b0 0x55f7fcd1eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.546+0000 7fa27f7fe640 1 -- 172.21.15.53:0/638185055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc96a070 msgr2=0x55f7fcd2b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.546+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc96a070 0x55f7fcd2b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.546+0000 7fa27f7fe640 1 -- 172.21.15.53:0/638185055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7fcc35900 con 0x55f7fc949390 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.547+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc949390 0x55f7fcd1f3e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa274005fb0 tx=0x7fa27400bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e96a78e9f4aa7334 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.547+0000 7fa25f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.547+0000 7fa25f7fe640 1 -- 172.21.15.53:0/638185055 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274028060 con 0x55f7fc949390 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.547+0000 7fa25f7fe640 1 -- 172.21.15.53:0/638185055 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fa27401a670 con 0x55f7fc949390 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.547+0000 7fa28cd08740 1 -- 172.21.15.53:0/638185055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa27401a8f0 con 0x55f7fc949390 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.548+0000 7fa25f7fe640 1 -- 172.21.15.53:0/638185055 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fa274015070 con 0x55f7fc949390 2024-08-31T06:30:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.548+0000 7fa28cd08740 10 client.31834 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.548+0000 7fa28cd08740 1 -- 172.21.15.53:0/638185055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x55f7fcd2dc40 con 0x55f7fc949390 2024-08-31T06:30:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.548+0000 7fa25f7fe640 1 -- 172.21.15.53:0/638185055 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa27401a8f0 con 0x55f7fc949390 2024-08-31T06:30:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.548+0000 7fa25f7fe640 1 -- 172.21.15.53:0/638185055 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7fa2740046c0 con 0x55f7fc949390 2024-08-31T06:30:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.548+0000 7fa28cd08740 10 client.31834 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.548+0000 7fa28cd08740 10 client.31834 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:30:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.548+0000 7fa28cd08740 20 client.31834 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.548+0000 7fa28cd08740 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f7fc9289f0 0x55f7fcd310b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.548+0000 7fa28cd08740 4 client.31834 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.548+0000 7fa28cd08740 1 -- 172.21.15.53:0/638185055 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7fcc885d0 con 0x55f7fc9289f0 2024-08-31T06:30:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.549+0000 7fa27ffff640 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f7fc9289f0 0x55f7fcd310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.549+0000 7fa25f7fe640 10 client.31834 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.549+0000 7fa27ffff640 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f7fc9289f0 0x55f7fcd310b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ea8677799a057852 server_cookie=2ff6bc999fd5c55e in_seq=0 out_seq=0 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa25f7fe640 1 -- 172.21.15.53:0/638185055 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7fcc885d0 con 0x55f7fc9289f0 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa25f7fe640 10 client.31834 handle_command_reply: tid=0 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa28cd08740 1 client.31834 shutdown 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa28cd08740 1 -- 172.21.15.53:0/638185055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc949390 msgr2=0x55f7fcd1f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa28cd08740 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc949390 0x55f7fcd1f3e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa274005fb0 tx=0x7fa27400bf80 comp rx=0 tx=0).stop 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa28cd08740 1 -- 172.21.15.53:0/638185055 shutdown_connections 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa28cd08740 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc96a070 0x55f7fcd2b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa28cd08740 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f7fc9289f0 0x55f7fcd310b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa28cd08740 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc949390 0x55f7fcd1f3e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa28cd08740 1 --2- 172.21.15.53:0/638185055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc9411b0 0x55f7fcd1eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa28cd08740 1 -- 172.21.15.53:0/638185055 >> 172.21.15.53:0/638185055 conn(0x55f7fc95e460 msgr2=0x55f7fcd0b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.550+0000 7fa25f7fe640 0 client.31834 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:30:30.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.551+0000 7fa28cd08740 1 -- 172.21.15.53:0/638185055 shutdown_connections 2024-08-31T06:30:30.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.551+0000 7fa28cd08740 1 -- 172.21.15.53:0/638185055 wait complete. 2024-08-31T06:30:30.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.551+0000 7fa28cd08740 20 client.31834 trim_cache size 0 max 16384 2024-08-31T06:30:30.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa28cd08740 1 Processor -- start 2024-08-31T06:30:30.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa28cd08740 1 -- start start 2024-08-31T06:30:30.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd10a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd2b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd1c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa28cd08740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801ad210 con 0x55f7fc949390 2024-08-31T06:30:30.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa28cd08740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801aef90 con 0x55f7fc96a070 2024-08-31T06:30:30.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa28cd08740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801ad9a0 con 0x55f7fc9411b0 2024-08-31T06:30:30.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa27f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd2b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa27f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd2b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37734/0 (socket says 172.21.15.53:37734) 2024-08-31T06:30:30.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa27f7fe640 1 -- 172.21.15.53:0/3274602241 learned_addr learned my addr 172.21.15.53:0/3274602241 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:30.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa27ffff640 1 --2- 172.21.15.53:0/3274602241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd10a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.564+0000 7fa284d30640 1 --2- 172.21.15.53:0/3274602241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd1c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.565+0000 7fa27f7fe640 1 -- 172.21.15.53:0/3274602241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 msgr2=0x55f7fcd10a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.565+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/3274602241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd10a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.565+0000 7fa27f7fe640 1 -- 172.21.15.53:0/3274602241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 msgr2=0x55f7fcd1c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.565+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/3274602241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd1c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.565+0000 7fa27f7fe640 1 -- 172.21.15.53:0/3274602241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fcd219b0 con 0x55f7fc949390 2024-08-31T06:30:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.565+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/3274602241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd2b080 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fa274000c00 tx=0x7fa27400ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e33880079a24c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.565+0000 7fa265ffb640 1 -- 172.21.15.53:0/3274602241 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274028040 con 0x55f7fc949390 2024-08-31T06:30:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.565+0000 7fa265ffb640 1 -- 172.21.15.53:0/3274602241 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa27400b3a0 con 0x55f7fc949390 2024-08-31T06:30:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.565+0000 7fa265ffb640 1 -- 172.21.15.53:0/3274602241 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274011820 con 0x55f7fc949390 2024-08-31T06:30:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.566+0000 7fa28cd08740 1 -- 172.21.15.53:0/3274602241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 msgr2=0x55f7fcd2b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.566+0000 7fa28cd08740 1 --2- 172.21.15.53:0/3274602241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd2b080 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fa274000c00 tx=0x7fa27400ff20 comp rx=0 tx=0).stop 2024-08-31T06:30:30.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.566+0000 7fa28cd08740 1 -- 172.21.15.53:0/3274602241 shutdown_connections 2024-08-31T06:30:30.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.567+0000 7fa28cd08740 1 --2- 172.21.15.53:0/3274602241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd1c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.567+0000 7fa28cd08740 1 --2- 172.21.15.53:0/3274602241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd2b080 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.567+0000 7fa28cd08740 1 --2- 172.21.15.53:0/3274602241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd10a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.567+0000 7fa28cd08740 1 -- 172.21.15.53:0/3274602241 >> 172.21.15.53:0/3274602241 conn(0x55f7fc95e460 msgr2=0x55f7fcd10340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:30.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.567+0000 7fa28cd08740 1 -- 172.21.15.53:0/3274602241 shutdown_connections 2024-08-31T06:30:30.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.567+0000 7fa28cd08740 1 -- 172.21.15.53:0/3274602241 wait complete. 2024-08-31T06:30:30.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.567+0000 7fa28cd08740 1 -- start start 2024-08-31T06:30:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.567+0000 7fa28cd08740 1 Processor -- start 2024-08-31T06:30:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd278d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd22dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa28cd08740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd23310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa28cd08740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801ae830 con 0x55f7fc949390 2024-08-31T06:30:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa28cd08740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801ae0a0 con 0x55f7fc96a070 2024-08-31T06:30:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa28cd08740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801ab210 con 0x55f7fc9411b0 2024-08-31T06:30:30.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa28cd08740 10 client.0 _ll_register_callbacks cb 0x7fa2700ab540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:30.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa27f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd22dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa27f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd22dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37750/0 (socket says 172.21.15.53:37750) 2024-08-31T06:30:30.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa27f7fe640 1 -- 172.21.15.53:0/360909375 learned_addr learned my addr 172.21.15.53:0/360909375 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:30.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa284d30640 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd23310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.568+0000 7fa27ffff640 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd278d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.569+0000 7fa27ffff640 1 -- 172.21.15.53:0/360909375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 msgr2=0x55f7fcd23310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:30.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.569+0000 7fa27ffff640 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd23310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.569+0000 7fa27ffff640 1 -- 172.21.15.53:0/360909375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 msgr2=0x55f7fcd22dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:30.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.569+0000 7fa27ffff640 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd22dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.569+0000 7fa27ffff640 1 -- 172.21.15.53:0/360909375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7fcd23aa0 con 0x55f7fc9411b0 2024-08-31T06:30:30.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.569+0000 7fa27ffff640 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd278d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa2700e27d0 tx=0x7fa2700ce040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47fe81640bc8e35a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.569+0000 7fa25f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.569+0000 7fa25f7fe640 1 -- 172.21.15.53:0/360909375 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270020040 con 0x55f7fc9411b0 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.569+0000 7fa25f7fe640 1 -- 172.21.15.53:0/360909375 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fa2700a7a00 con 0x55f7fc9411b0 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa28cd08740 1 -- 172.21.15.53:0/360909375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa27400b3a0 con 0x55f7fc9411b0 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa25f7fe640 1 -- 172.21.15.53:0/360909375 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fa2700abe70 con 0x55f7fc9411b0 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa28cd08740 10 client.31840 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa28cd08740 1 -- 172.21.15.53:0/360909375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x55f7fcd16590 con 0x55f7fc9411b0 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa25f7fe640 1 -- 172.21.15.53:0/360909375 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2700affe0 con 0x55f7fc9411b0 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa25f7fe640 1 -- 172.21.15.53:0/360909375 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7fa2700ab9d0 con 0x55f7fc9411b0 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa28cd08740 10 client.31840 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa28cd08740 10 client.31840 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa28cd08740 20 client.31840 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:30.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa28cd08740 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f7fc8fdda0 0x55f7fcd18d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa28cd08740 4 client.31840 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:30:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.570+0000 7fa28cd08740 1 -- 172.21.15.53:0/360909375 --> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa27400b3a0 con 0x55f7fc8fdda0 2024-08-31T06:30:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.571+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f7fc8fdda0 0x55f7fcd18d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.571+0000 7fa25f7fe640 10 client.31840 ms_handle_connect on v2:172.21.15.153:6834/1480674420 2024-08-31T06:30:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.571+0000 7fa27f7fe640 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f7fc8fdda0 0x55f7fcd18d20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=80f1bd07f99dca79 server_cookie=958d0dec68e870cf in_seq=0 out_seq=0 2024-08-31T06:30:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa25f7fe640 1 -- 172.21.15.53:0/360909375 <== mds.4 v2:172.21.15.153:6834/1480674420 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa27400b3a0 con 0x55f7fc8fdda0 2024-08-31T06:30:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa25f7fe640 10 client.31840 handle_command_reply: tid=0 2024-08-31T06:30:30.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa28cd08740 1 client.31840 shutdown 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa28cd08740 1 -- 172.21.15.53:0/360909375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 msgr2=0x55f7fcd278d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa28cd08740 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd278d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa2700e27d0 tx=0x7fa2700ce040 comp rx=0 tx=0).stop 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa28cd08740 1 -- 172.21.15.53:0/360909375 shutdown_connections 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa28cd08740 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7fc96a070 0x55f7fcd23310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa28cd08740 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fc949390 0x55f7fcd22dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa28cd08740 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.153:6834/1480674420,v1:172.21.15.153:6835/1480674420] conn(0x55f7fc8fdda0 0x55f7fcd18d20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa28cd08740 1 --2- 172.21.15.53:0/360909375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7fc9411b0 0x55f7fcd278d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa25f7fe640 0 client.31840 ms_handle_reset on v2:172.21.15.153:6834/1480674420 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa28cd08740 1 -- 172.21.15.53:0/360909375 >> 172.21.15.53:0/360909375 conn(0x55f7fc95e460 msgr2=0x55f7fcd20300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa28cd08740 1 -- 172.21.15.53:0/360909375 shutdown_connections 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.572+0000 7fa28cd08740 1 -- 172.21.15.53:0/360909375 wait complete. 2024-08-31T06:30:30.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.573+0000 7fa28cd08740 20 client.31840 trim_cache size 0 max 16384 2024-08-31T06:30:30.578 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:30:30.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.574+0000 7fa286793640 1 -- 172.21.15.53:0/2238896772 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2680b4ca0 msgr2=0x7fa2680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:30.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.574+0000 7fa286793640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2680b4ca0 0x7fa2680b71b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa2780094e0 tx=0x7fa2780095c0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.574+0000 7fa286793640 1 -- 172.21.15.53:0/2238896772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa280104750 msgr2=0x7fa28019a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:30.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.574+0000 7fa286793640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa280104750 0x7fa28019a1c0 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7fa27000d770 tx=0x7fa27000dc30 comp rx=0 tx=0).stop 2024-08-31T06:30:30.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.574+0000 7fa286793640 1 -- 172.21.15.53:0/2238896772 shutdown_connections 2024-08-31T06:30:30.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.574+0000 7fa286793640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fa2680b4ca0 0x7fa2680b71b0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.574+0000 7fa286793640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa28010dbb0 0x7fa28019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.574+0000 7fa286793640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2801050a0 0x7fa28019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.574+0000 7fa286793640 1 --2- 172.21.15.53:0/2238896772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa280104750 0x7fa28019a1c0 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:30.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.574+0000 7fa286793640 1 -- 172.21.15.53:0/2238896772 >> 172.21.15.53:0/2238896772 conn(0x7fa2800794a0 msgr2=0x7fa2801076d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:30.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.575+0000 7fa286793640 1 -- 172.21.15.53:0/2238896772 shutdown_connections 2024-08-31T06:30:30.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:30.575+0000 7fa286793640 1 -- 172.21.15.53:0/2238896772 wait complete. 2024-08-31T06:30:31.285 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T06:30:31.540 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:32.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.034+0000 7f4f5e594640 1 -- 172.21.15.53:0/2595567054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f58109b90 msgr2=0x7f4f581103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:32.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.034+0000 7f4f5e594640 1 --2- 172.21.15.53:0/2595567054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f58109b90 0x7f4f581103c0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009ca0 tx=0x7f4f5002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.034+0000 7f4f5e594640 1 -- 172.21.15.53:0/2595567054 shutdown_connections 2024-08-31T06:30:32.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.034+0000 7f4f5e594640 1 --2- 172.21.15.53:0/2595567054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f58109b90 0x7f4f581103c0 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.034+0000 7f4f5e594640 1 --2- 172.21.15.53:0/2595567054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f58109240 0x7f4f58109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.034+0000 7f4f5e594640 1 --2- 172.21.15.53:0/2595567054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f58103900 0x7f4f58103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.034+0000 7f4f5e594640 1 -- 172.21.15.53:0/2595567054 >> 172.21.15.53:0/2595567054 conn(0x7f4f5807b5f0 msgr2=0x7f4f5807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.034+0000 7f4f5e594640 1 -- 172.21.15.53:0/2595567054 shutdown_connections 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.034+0000 7f4f5e594640 1 -- 172.21.15.53:0/2595567054 wait complete. 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f5e594640 1 Processor -- start 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f5e594640 1 -- start start 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f5e594640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f58103900 0x7f4f580754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f5e594640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f58109240 0x7f4f580759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f5e594640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f58109b90 0x7f4f58075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f5e594640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4f58113750 con 0x7f4f58109b90 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f5e594640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4f581135d0 con 0x7f4f58103900 2024-08-31T06:30:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f5e594640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f581138d0 con 0x7f4f58109240 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f5cb31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f58109b90 0x7f4f58075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f5cb31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f58109b90 0x7f4f58075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37770/0 (socket says 172.21.15.53:37770) 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f5cb31640 1 -- 172.21.15.53:0/1728347816 learned_addr learned my addr 172.21.15.53:0/1728347816 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f57fff640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f58103900 0x7f4f580754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.035+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f58109240 0x7f4f580759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.036+0000 7f4f5cb31640 1 -- 172.21.15.53:0/1728347816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f58109240 msgr2=0x7f4f580759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.036+0000 7f4f5cb31640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f58109240 0x7f4f580759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.036+0000 7f4f5cb31640 1 -- 172.21.15.53:0/1728347816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f58103900 msgr2=0x7f4f580754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.036+0000 7f4f5cb31640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f58103900 0x7f4f580754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.036+0000 7f4f5cb31640 1 -- 172.21.15.53:0/1728347816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f581a83e0 con 0x7f4f58109b90 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.036+0000 7f4f5cb31640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f58109b90 0x7f4f58075f30 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f4f50031040 tx=0x7f4f50032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.036+0000 7f4f55ffb640 1 -- 172.21.15.53:0/1728347816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f50004040 con 0x7f4f58109b90 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.036+0000 7f4f55ffb640 1 -- 172.21.15.53:0/1728347816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f50004670 con 0x7f4f58109b90 2024-08-31T06:30:32.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.036+0000 7f4f5e594640 1 -- 172.21.15.53:0/1728347816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f581a8670 con 0x7f4f58109b90 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.036+0000 7f4f55ffb640 1 -- 172.21.15.53:0/1728347816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f50030bb0 con 0x7f4f58109b90 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.036+0000 7f4f5e594640 1 -- 172.21.15.53:0/1728347816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f581a8bb0 con 0x7f4f58109b90 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.039+0000 7f4f64b09740 1 Processor -- start 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.039+0000 7f4f55ffb640 1 -- 172.21.15.53:0/1728347816 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4f500041e0 con 0x7f4f58109b90 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.039+0000 7f4f64b09740 1 -- start start 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.039+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x560628943310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.039+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x560628943850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.039+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062857d390 0x560628943d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.039+0000 7f4f64b09740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606288ba680 con 0x56062859e070 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.039+0000 7f4f64b09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5606288a9c10 con 0x5606285751b0 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.039+0000 7f4f64b09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5606288adbc0 con 0x56062857d390 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x560628943310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x560628943310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37772/0 (socket says 172.21.15.53:37772) 2024-08-31T06:30:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4ffff640 1 -- 172.21.15.53:0/1820857705 learned_addr learned my addr 172.21.15.53:0/1820857705 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f55ffb640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f440b4ca0 0x7f4f440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f57fff640 1 --2- 172.21.15.53:0/1820857705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x560628943850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/1820857705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062857d390 0x560628943d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4ffff640 1 -- 172.21.15.53:0/1820857705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062857d390 msgr2=0x560628943d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/1820857705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062857d390 0x560628943d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f5cb31640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f440b4ca0 0x7f4f440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4ffff640 1 -- 172.21.15.53:0/1820857705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 msgr2=0x560628943850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/1820857705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x560628943850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4ffff640 1 -- 172.21.15.53:0/1820857705 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560628609650 con 0x56062859e070 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f57fff640 1 --2- 172.21.15.53:0/1820857705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x560628943850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f55ffb640 1 -- 172.21.15.53:0/1728347816 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f4f50106740 con 0x7f4f58109b90 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/1820857705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x560628943310 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f4f40012440 tx=0x7f4f4000b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbd0364d162178a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4e7fc640 1 -- 172.21.15.53:0/1820857705 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40004030 con 0x56062859e070 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f5cb31640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f440b4ca0 0x7f4f440b71b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4f50103f20 tx=0x7f4f500c1690 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4e7fc640 1 -- 172.21.15.53:0/1820857705 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f40005020 con 0x56062859e070 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.040+0000 7f4f4e7fc640 1 -- 172.21.15.53:0/1820857705 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40004a00 con 0x56062859e070 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.041+0000 7f4f64b09740 1 -- 172.21.15.53:0/1820857705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 msgr2=0x560628943310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.041+0000 7f4f64b09740 1 --2- 172.21.15.53:0/1820857705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x560628943310 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f4f40012440 tx=0x7f4f4000b740 comp rx=0 tx=0).stop 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.041+0000 7f4f64b09740 1 -- 172.21.15.53:0/1820857705 shutdown_connections 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.041+0000 7f4f64b09740 1 --2- 172.21.15.53:0/1820857705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062857d390 0x560628943d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.041+0000 7f4f64b09740 1 --2- 172.21.15.53:0/1820857705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x560628943850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.041+0000 7f4f64b09740 1 --2- 172.21.15.53:0/1820857705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x560628943310 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.041+0000 7f4f64b09740 1 -- 172.21.15.53:0/1820857705 >> 172.21.15.53:0/1820857705 conn(0x560628592460 msgr2=0x560628941200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.041+0000 7f4f64b09740 1 -- 172.21.15.53:0/1820857705 shutdown_connections 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.042+0000 7f4f64b09740 1 -- 172.21.15.53:0/1820857705 wait complete. 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.042+0000 7f4f64b09740 1 -- start start 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.042+0000 7f4f64b09740 1 Processor -- start 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.042+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x56062894ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.042+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062857d390 0x56062894f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.042+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062895ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.042+0000 7f4f64b09740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56062870c700 con 0x56062859e070 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.042+0000 7f4f64b09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560628830750 con 0x5606285751b0 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.042+0000 7f4f64b09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560628951af0 con 0x56062857d390 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f64b09740 10 client.0 _ll_register_callbacks cb 0x56062885fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f4ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062895ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f4ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062895ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37784/0 (socket says 172.21.15.53:37784) 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f4ffff640 1 -- 172.21.15.53:0/3416684714 learned_addr learned my addr 172.21.15.53:0/3416684714 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f57fff640 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062857d390 0x56062894f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x56062894ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f4ffff640 1 -- 172.21.15.53:0/3416684714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062857d390 msgr2=0x56062894f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062857d390 0x56062894f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f4ffff640 1 -- 172.21.15.53:0/3416684714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 msgr2=0x56062894ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:32.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x56062894ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f4ffff640 1 -- 172.21.15.53:0/3416684714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560628869900 con 0x56062859e070 2024-08-31T06:30:32.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f57fff640 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062857d390 0x56062894f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:32.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062895ade0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000b450 tx=0x7f4f4000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61b2ee2ccdd22ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:32.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f377fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:32.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f377fe640 1 -- 172.21.15.53:0/3416684714 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40004230 con 0x56062859e070 2024-08-31T06:30:32.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f377fe640 1 -- 172.21.15.53:0/3416684714 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f4f400043d0 con 0x56062859e070 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f64b09740 1 -- 172.21.15.53:0/3416684714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f40005020 con 0x56062859e070 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.043+0000 7f4f377fe640 1 -- 172.21.15.53:0/3416684714 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f4f400048d0 con 0x56062859e070 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.044+0000 7f4f64b09740 10 client.23268 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.044+0000 7f4f64b09740 1 -- 172.21.15.53:0/3416684714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x56062895d8d0 con 0x56062859e070 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.044+0000 7f4f377fe640 1 -- 172.21.15.53:0/3416684714 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f40005020 con 0x56062859e070 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.044+0000 7f4f377fe640 1 -- 172.21.15.53:0/3416684714 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7f4f4001c020 con 0x56062859e070 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.044+0000 7f4f64b09740 10 client.23268 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.044+0000 7f4f64b09740 10 client.23268 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.044+0000 7f4f64b09740 20 client.23268 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.044+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x56062855c9f0 0x560628960ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.044+0000 7f4f64b09740 4 client.23268 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:32.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.044+0000 7f4f64b09740 1 -- 172.21.15.53:0/3416684714 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606288bc5d0 con 0x56062855c9f0 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.044+0000 7f4f57fff640 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x56062855c9f0 0x560628960ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.045+0000 7f4f57fff640 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x56062855c9f0 0x560628960ce0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=20f13a39f686e635 server_cookie=ebc9594a30e87162 in_seq=0 out_seq=0 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.045+0000 7f4f377fe640 10 client.23268 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.045+0000 7f4f377fe640 1 -- 172.21.15.53:0/3416684714 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5606288bc5d0 con 0x56062855c9f0 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.045+0000 7f4f377fe640 10 client.23268 handle_command_reply: tid=0 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.045+0000 7f4f64b09740 1 client.23268 shutdown 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f64b09740 1 -- 172.21.15.53:0/3416684714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 msgr2=0x56062895ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062895ade0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000b450 tx=0x7f4f4000b830 comp rx=0 tx=0).stop 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f64b09740 1 -- 172.21.15.53:0/3416684714 shutdown_connections 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x56062855c9f0 0x560628960ce0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062895ade0 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062857d390 0x56062894f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f377fe640 0 client.23268 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:30:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3416684714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x56062894ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f64b09740 1 -- 172.21.15.53:0/3416684714 >> 172.21.15.53:0/3416684714 conn(0x560628592460 msgr2=0x5606289464f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f64b09740 1 -- 172.21.15.53:0/3416684714 shutdown_connections 2024-08-31T06:30:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f64b09740 1 -- 172.21.15.53:0/3416684714 wait complete. 2024-08-31T06:30:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.046+0000 7f4f64b09740 20 client.23268 trim_cache size 0 max 16384 2024-08-31T06:30:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.059+0000 7f4f64b09740 1 Processor -- start 2024-08-31T06:30:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.059+0000 7f4f64b09740 1 -- start start 2024-08-31T06:30:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.059+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606285751b0 0x56062894d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.059+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56062857d390 0x560628946b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.059+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062894bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.059+0000 7f4f64b09740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4f581b16d0 con 0x56062859e070 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.059+0000 7f4f64b09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4f581b3450 con 0x56062857d390 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.059+0000 7f4f64b09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f581b1e60 con 0x5606285751b0 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.059+0000 7f4f4ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062894bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062894bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37786/0 (socket says 172.21.15.53:37786) 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4ffff640 1 -- 172.21.15.53:0/1823549507 learned_addr learned my addr 172.21.15.53:0/1823549507 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f57fff640 1 --2- 172.21.15.53:0/1823549507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56062857d390 0x560628946b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/1823549507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606285751b0 0x56062894d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4ffff640 1 -- 172.21.15.53:0/1823549507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606285751b0 msgr2=0x56062894d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/1823549507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606285751b0 0x56062894d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4ffff640 1 -- 172.21.15.53:0/1823549507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56062857d390 msgr2=0x560628946b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/1823549507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56062857d390 0x560628946b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4ffff640 1 -- 172.21.15.53:0/1823549507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560628945600 con 0x56062859e070 2024-08-31T06:30:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/1823549507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062894bcc0 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000b900 tx=0x7f4f4000bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a801308b2c585a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4dffb640 1 -- 172.21.15.53:0/1823549507 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f400035f0 con 0x56062859e070 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4dffb640 1 -- 172.21.15.53:0/1823549507 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f40023030 con 0x56062859e070 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.060+0000 7f4f4dffb640 1 -- 172.21.15.53:0/1823549507 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40003d70 con 0x56062859e070 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.061+0000 7f4f64b09740 1 -- 172.21.15.53:0/1823549507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 msgr2=0x56062894bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.061+0000 7f4f64b09740 1 --2- 172.21.15.53:0/1823549507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062894bcc0 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000b900 tx=0x7f4f4000bec0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.061+0000 7f4f64b09740 1 -- 172.21.15.53:0/1823549507 shutdown_connections 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.061+0000 7f4f64b09740 1 --2- 172.21.15.53:0/1823549507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062859e070 0x56062894bcc0 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.061+0000 7f4f64b09740 1 --2- 172.21.15.53:0/1823549507 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56062857d390 0x560628946b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.061+0000 7f4f64b09740 1 --2- 172.21.15.53:0/1823549507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5606285751b0 0x56062894d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.061+0000 7f4f64b09740 1 -- 172.21.15.53:0/1823549507 >> 172.21.15.53:0/1823549507 conn(0x560628592460 msgr2=0x560628946410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.061+0000 7f4f64b09740 1 -- 172.21.15.53:0/1823549507 shutdown_connections 2024-08-31T06:30:32.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.061+0000 7f4f64b09740 1 -- 172.21.15.53:0/1823549507 wait complete. 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.061+0000 7f4f64b09740 1 -- start start 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f64b09740 1 Processor -- start 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x5606289533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062857d390 0x560628953930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f64b09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062859e070 0x5606289ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f64b09740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4f581b2cf0 con 0x56062857d390 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f64b09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4f581b2560 con 0x5606285751b0 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f64b09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4f581af6d0 con 0x56062859e070 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f64b09740 10 client.0 _ll_register_callbacks cb 0x7f4f4000bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f57fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062857d390 0x560628953930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f57fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062857d390 0x560628953930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37792/0 (socket says 172.21.15.53:37792) 2024-08-31T06:30:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f57fff640 1 -- 172.21.15.53:0/3239507084 learned_addr learned my addr 172.21.15.53:0/3239507084 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x5606289533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062859e070 0x5606289ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f57fff640 1 -- 172.21.15.53:0/3239507084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062859e070 msgr2=0x5606289ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f57fff640 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062859e070 0x5606289ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f57fff640 1 -- 172.21.15.53:0/3239507084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 msgr2=0x5606289533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f57fff640 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x5606289533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.062+0000 7f4f57fff640 1 -- 172.21.15.53:0/3239507084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606289caa80 con 0x56062857d390 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062859e070 0x5606289ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f57fff640 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062857d390 0x560628953930 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f4f58076f00 tx=0x7f4f48013ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f677c18086ee4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f377fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f377fe640 1 -- 172.21.15.53:0/3239507084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f48004020 con 0x56062857d390 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f377fe640 1 -- 172.21.15.53:0/3239507084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f4f480041c0 con 0x56062857d390 2024-08-31T06:30:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f64b09740 1 -- 172.21.15.53:0/3239507084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f40023030 con 0x56062857d390 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f377fe640 1 -- 172.21.15.53:0/3239507084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f4f480043c0 con 0x56062857d390 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f64b09740 10 client.23274 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f64b09740 1 -- 172.21.15.53:0/3239507084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x5606289cbcc0 con 0x56062857d390 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f377fe640 1 -- 172.21.15.53:0/3239507084 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f40023030 con 0x56062857d390 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f377fe640 1 -- 172.21.15.53:0/3239507084 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7f4f48004b80 con 0x56062857d390 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f64b09740 10 client.23274 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f64b09740 10 client.23274 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f64b09740 20 client.23274 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x560628531da0 0x5606289ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f64b09740 4 client.23274 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.063+0000 7f4f64b09740 1 -- 172.21.15.53:0/3239507084 --> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5606288b8070 con 0x560628531da0 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.064+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x560628531da0 0x5606289ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:32.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.064+0000 7f4f4ffff640 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x560628531da0 0x5606289ce530 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=71cf58e2806d55f5 server_cookie=7fabf9a0e87556be in_seq=0 out_seq=0 2024-08-31T06:30:32.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.064+0000 7f4f377fe640 10 client.23274 ms_handle_connect on v2:172.21.15.153:6836/3972541540 2024-08-31T06:30:32.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.064+0000 7f4f377fe640 1 -- 172.21.15.53:0/3239507084 <== mds.3 v2:172.21.15.153:6836/3972541540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5606288b8070 con 0x560628531da0 2024-08-31T06:30:32.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.064+0000 7f4f377fe640 10 client.23274 handle_command_reply: tid=0 2024-08-31T06:30:32.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.064+0000 7f4f64b09740 1 client.23274 shutdown 2024-08-31T06:30:32.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f64b09740 1 -- 172.21.15.53:0/3239507084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062857d390 msgr2=0x560628953930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:32.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062857d390 0x560628953930 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f4f58076f00 tx=0x7f4f48013ae0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.090 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:30:32.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f64b09740 1 -- 172.21.15.53:0/3239507084 shutdown_connections 2024-08-31T06:30:32.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56062859e070 0x5606289ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.153:6836/3972541540,v1:172.21.15.153:6837/3972541540] conn(0x560628531da0 0x5606289ce530 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56062857d390 0x560628953930 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f64b09740 1 --2- 172.21.15.53:0/3239507084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606285751b0 0x5606289533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f377fe640 0 client.23274 ms_handle_reset on v2:172.21.15.153:6836/3972541540 2024-08-31T06:30:32.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f64b09740 1 -- 172.21.15.53:0/3239507084 >> 172.21.15.53:0/3239507084 conn(0x560628592460 msgr2=0x560628944320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:32.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f64b09740 1 -- 172.21.15.53:0/3239507084 shutdown_connections 2024-08-31T06:30:32.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f64b09740 1 -- 172.21.15.53:0/3239507084 wait complete. 2024-08-31T06:30:32.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f64b09740 20 client.23274 trim_cache size 0 max 16384 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 -- 172.21.15.53:0/1728347816 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f440b4ca0 msgr2=0x7f4f440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f440b4ca0 0x7f4f440b71b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4f50103f20 tx=0x7f4f500c1690 comp rx=0 tx=0).stop 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 -- 172.21.15.53:0/1728347816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f58109b90 msgr2=0x7f4f58075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f58109b90 0x7f4f58075f30 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f4f50031040 tx=0x7f4f50032bc0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 -- 172.21.15.53:0/1728347816 shutdown_connections 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4f440b4ca0 0x7f4f440b71b0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f58109b90 0x7f4f58075f30 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f58109240 0x7f4f580759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 --2- 172.21.15.53:0/1728347816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f58103900 0x7f4f580754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 -- 172.21.15.53:0/1728347816 >> 172.21.15.53:0/1728347816 conn(0x7f4f5807b5f0 msgr2=0x7f4f581072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 -- 172.21.15.53:0/1728347816 shutdown_connections 2024-08-31T06:30:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:32.065+0000 7f4f5e594640 1 -- 172.21.15.53:0/1728347816 wait complete. 2024-08-31T06:30:32.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:32 smithi053 ceph-mon[18924]: pgmap v1130: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 248 op/s 2024-08-31T06:30:32.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:32 smithi130 ceph-mon[22266]: pgmap v1130: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 248 op/s 2024-08-31T06:30:32.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:32 smithi153 ceph-mon[22320]: pgmap v1130: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 248 op/s 2024-08-31T06:30:32.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:30:32.988 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:33.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.498+0000 7f7c5041a640 1 -- 172.21.15.53:0/3711428644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48108140 msgr2=0x7f7c48108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:33.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.498+0000 7f7c5041a640 1 --2- 172.21.15.53:0/3711428644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48108140 0x7f7c48108550 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009900 tx=0x7f7c4402a410 comp rx=0 tx=0).stop 2024-08-31T06:30:33.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.498+0000 7f7c5041a640 1 -- 172.21.15.53:0/3711428644 shutdown_connections 2024-08-31T06:30:33.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.498+0000 7f7c5041a640 1 --2- 172.21.15.53:0/3711428644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c48108a90 0x7f7c4810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.498+0000 7f7c5041a640 1 --2- 172.21.15.53:0/3711428644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48108140 0x7f7c48108550 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.498+0000 7f7c5041a640 1 --2- 172.21.15.53:0/3711428644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c48102800 0x7f7c48102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.498+0000 7f7c5041a640 1 -- 172.21.15.53:0/3711428644 >> 172.21.15.53:0/3711428644 conn(0x7f7c480794d0 msgr2=0x7f7c480798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:33.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.498+0000 7f7c5041a640 1 -- 172.21.15.53:0/3711428644 shutdown_connections 2024-08-31T06:30:33.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.498+0000 7f7c5041a640 1 -- 172.21.15.53:0/3711428644 wait complete. 2024-08-31T06:30:33.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c5041a640 1 Processor -- start 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c5041a640 1 -- start start 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c5041a640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c48102800 0x7f7c4819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c5041a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48108140 0x7f7c4819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c5041a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c48108a90 0x7f7c4819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c5041a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7c48112570 con 0x7f7c48108140 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c5041a640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7c481123f0 con 0x7f7c48102800 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c5041a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c481126f0 con 0x7f7c48108a90 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c4d9b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48108140 0x7f7c4819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c4d9b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48108140 0x7f7c4819b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44788/0 (socket says 172.21.15.53:44788) 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c4d9b5640 1 -- 172.21.15.53:0/2762160921 learned_addr learned my addr 172.21.15.53:0/2762160921 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c4e1b6640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c48102800 0x7f7c4819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c4e9b7640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c48108a90 0x7f7c4819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.499+0000 7f7c4d9b5640 1 -- 172.21.15.53:0/2762160921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c48108a90 msgr2=0x7f7c4819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.500+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c48108a90 0x7f7c4819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.500+0000 7f7c4d9b5640 1 -- 172.21.15.53:0/2762160921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c48102800 msgr2=0x7f7c4819af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.500+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c48102800 0x7f7c4819af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.500+0000 7f7c4d9b5640 1 -- 172.21.15.53:0/2762160921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c481a61e0 con 0x7f7c48108140 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.500+0000 7f7c4e9b7640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c48108a90 0x7f7c4819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.500+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48108140 0x7f7c4819b460 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f7c44005940 tx=0x7f7c440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.500+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/2762160921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4403f030 con 0x7f7c48108140 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.500+0000 7f7c5041a640 1 -- 172.21.15.53:0/2762160921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c481a6470 con 0x7f7c48108140 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.500+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/2762160921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c44003c90 con 0x7f7c48108140 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.500+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/2762160921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c44035070 con 0x7f7c48108140 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.500+0000 7f7c5041a640 1 -- 172.21.15.53:0/2762160921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c481a6950 con 0x7f7c48108140 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.503+0000 7f7c5698f740 1 Processor -- start 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.503+0000 7f7c5698f740 1 -- start start 2024-08-31T06:30:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac54310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8861b0 0x562dfac54850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac54d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c5698f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562dfabcb680 con 0x562dfa8af070 2024-08-31T06:30:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c5698f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562dfabbac10 con 0x562dfa8861b0 2024-08-31T06:30:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/2762160921 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7c44042030 con 0x7f7c48108140 2024-08-31T06:30:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c5698f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562dfabbebc0 con 0x562dfa88e390 2024-08-31T06:30:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4e9b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac54310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4e9b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac54310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44794/0 (socket says 172.21.15.53:44794) 2024-08-31T06:30:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4e9b7640 1 -- 172.21.15.53:0/125071614 learned_addr learned my addr 172.21.15.53:0/125071614 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4e1b6640 1 --2- 172.21.15.53:0/125071614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8861b0 0x562dfac54850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/125071614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac54d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4e9b7640 1 -- 172.21.15.53:0/125071614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 msgr2=0x562dfac54d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4e9b7640 1 --2- 172.21.15.53:0/125071614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac54d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4e9b7640 1 -- 172.21.15.53:0/125071614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8861b0 msgr2=0x562dfac54850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4e9b7640 1 --2- 172.21.15.53:0/125071614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8861b0 0x562dfac54850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4e9b7640 1 -- 172.21.15.53:0/125071614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dfa91a650 con 0x562dfa8af070 2024-08-31T06:30:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/125071614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac54d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.504+0000 7f7c4e9b7640 1 --2- 172.21.15.53:0/125071614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac54310 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009ea0 tx=0x7f7c40009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e87379164a0809 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.505+0000 7f7c3f7fe640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7c340b4ca0 0x7f7c340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.505+0000 7f7c3cd9a640 1 -- 172.21.15.53:0/125071614 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40004d20 con 0x562dfa8af070 2024-08-31T06:30:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.505+0000 7f7c3cd9a640 1 -- 172.21.15.53:0/125071614 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c400054b0 con 0x562dfa8af070 2024-08-31T06:30:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.505+0000 7f7c3cd9a640 1 -- 172.21.15.53:0/125071614 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c400116f0 con 0x562dfa8af070 2024-08-31T06:30:33.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.505+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/2762160921 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f7c44105ad0 con 0x7f7c48108140 2024-08-31T06:30:33.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.505+0000 7f7c4e1b6640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7c340b4ca0 0x7f7c340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c5698f740 1 -- 172.21.15.53:0/125071614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 msgr2=0x562dfac54310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c4e1b6640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7c340b4ca0 0x7f7c340b71b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x562dfac52f90 tx=0x7f7c3800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c5698f740 1 --2- 172.21.15.53:0/125071614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac54310 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009ea0 tx=0x7f7c40009f90 comp rx=0 tx=0).stop 2024-08-31T06:30:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c5698f740 1 -- 172.21.15.53:0/125071614 shutdown_connections 2024-08-31T06:30:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c5698f740 1 --2- 172.21.15.53:0/125071614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac54d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c5698f740 1 --2- 172.21.15.53:0/125071614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8861b0 0x562dfac54850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c5698f740 1 --2- 172.21.15.53:0/125071614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac54310 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c5698f740 1 -- 172.21.15.53:0/125071614 >> 172.21.15.53:0/125071614 conn(0x562dfa8a3460 msgr2=0x562dfac52200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c5698f740 1 -- 172.21.15.53:0/125071614 shutdown_connections 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c5698f740 1 -- 172.21.15.53:0/125071614 wait complete. 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c5698f740 1 -- start start 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.506+0000 7f7c5698f740 1 Processor -- start 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac5fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac60000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8af070 0x562dfac6be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c5698f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562dfaa1d700 con 0x562dfa8861b0 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c5698f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562dfab41750 con 0x562dfa8af070 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c5698f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562dfac62af0 con 0x562dfa88e390 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c5698f740 10 client.0 _ll_register_callbacks cb 0x562dfab70e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c4e1b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac5fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c4e1b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac5fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44796/0 (socket says 172.21.15.53:44796) 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c4e1b6640 1 -- 172.21.15.53:0/2944315285 learned_addr learned my addr 172.21.15.53:0/2944315285 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac60000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c4e9b7640 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8af070 0x562dfac6be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c4e1b6640 1 -- 172.21.15.53:0/2944315285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 msgr2=0x562dfac60000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c4e1b6640 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac60000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c4e1b6640 1 -- 172.21.15.53:0/2944315285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8af070 msgr2=0x562dfac6be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c4e1b6640 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8af070 0x562dfac6be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c4e1b6640 1 -- 172.21.15.53:0/2944315285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dfab7a900 con 0x562dfa8861b0 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c4e1b6640 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac5fac0 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f7c3801cbe0 tx=0x7f7c38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6e7cb495c48271 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.507+0000 7f7c31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c31ffb640 1 -- 172.21.15.53:0/2944315285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800ae70 con 0x562dfa8861b0 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c31ffb640 1 -- 172.21.15.53:0/2944315285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f7c38016030 con 0x562dfa8861b0 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c5698f740 1 -- 172.21.15.53:0/2944315285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c400054b0 con 0x562dfa8861b0 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c31ffb640 1 -- 172.21.15.53:0/2944315285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f7c3801ccd0 con 0x562dfa8861b0 2024-08-31T06:30:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c5698f740 10 client.23286 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c5698f740 1 -- 172.21.15.53:0/2944315285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x562dfac6e900 con 0x562dfa8861b0 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c31ffb640 1 -- 172.21.15.53:0/2944315285 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c400054b0 con 0x562dfa8861b0 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c31ffb640 1 -- 172.21.15.53:0/2944315285 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7f7c38027790 con 0x562dfa8861b0 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c5698f740 10 client.23286 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c5698f740 10 client.23286 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c5698f740 20 client.23286 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c5698f740 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562dfa86d9f0 0x562dfac71e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c5698f740 4 client.23286 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.508+0000 7f7c5698f740 1 -- 172.21.15.53:0/2944315285 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562dfabcd5d0 con 0x562dfa86d9f0 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.509+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562dfa86d9f0 0x562dfac71e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.509+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562dfa86d9f0 0x562dfac71e40 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e181cf511ca019dd server_cookie=dc8ded9be1a0f5d1 in_seq=0 out_seq=0 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.509+0000 7f7c31ffb640 10 client.23286 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c31ffb640 1 -- 172.21.15.53:0/2944315285 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562dfabcd5d0 con 0x562dfa86d9f0 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c31ffb640 10 client.23286 handle_command_reply: tid=0 2024-08-31T06:30:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 1 client.23286 shutdown 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 1 -- 172.21.15.53:0/2944315285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 msgr2=0x562dfac5fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac5fac0 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f7c3801cbe0 tx=0x7f7c38004730 comp rx=0 tx=0).stop 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 1 -- 172.21.15.53:0/2944315285 shutdown_connections 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562dfa86d9f0 0x562dfac71e40 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8af070 0x562dfac6be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac60000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 1 --2- 172.21.15.53:0/2944315285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac5fac0 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 1 -- 172.21.15.53:0/2944315285 >> 172.21.15.53:0/2944315285 conn(0x562dfa8a3460 msgr2=0x562dfac574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c31ffb640 0 client.23286 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 1 -- 172.21.15.53:0/2944315285 shutdown_connections 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 1 -- 172.21.15.53:0/2944315285 wait complete. 2024-08-31T06:30:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.510+0000 7f7c5698f740 20 client.23286 trim_cache size 0 max 16384 2024-08-31T06:30:33.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.523+0000 7f7c5698f740 1 Processor -- start 2024-08-31T06:30:33.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.523+0000 7f7c5698f740 1 -- start start 2024-08-31T06:30:33.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8861b0 0x562dfac600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac57410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac57950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c5698f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7c481af4d0 con 0x562dfa8af070 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c5698f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7c481b1250 con 0x562dfa8861b0 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c5698f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c481afc60 con 0x562dfa88e390 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c4e9b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac57950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c4e9b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac57950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44804/0 (socket says 172.21.15.53:44804) 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c4e9b7640 1 -- 172.21.15.53:0/4268578110 learned_addr learned my addr 172.21.15.53:0/4268578110 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c4e1b6640 1 --2- 172.21.15.53:0/4268578110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8861b0 0x562dfac600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/4268578110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac57410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c4e9b7640 1 -- 172.21.15.53:0/4268578110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 msgr2=0x562dfac57410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c4e9b7640 1 --2- 172.21.15.53:0/4268578110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac57410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c4e9b7640 1 -- 172.21.15.53:0/4268578110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8861b0 msgr2=0x562dfac600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c4e9b7640 1 --2- 172.21.15.53:0/4268578110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8861b0 0x562dfac600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c4e9b7640 1 -- 172.21.15.53:0/4268578110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dfac6c5f0 con 0x562dfa8af070 2024-08-31T06:30:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c4e9b7640 1 --2- 172.21.15.53:0/4268578110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac57950 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000ff60 tx=0x7f7c40004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f71664c1e28cb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:33.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.524+0000 7f7c33fff640 1 -- 172.21.15.53:0/4268578110 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4002a070 con 0x562dfa8af070 2024-08-31T06:30:33.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.525+0000 7f7c33fff640 1 -- 172.21.15.53:0/4268578110 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c400054d0 con 0x562dfa8af070 2024-08-31T06:30:33.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.525+0000 7f7c33fff640 1 -- 172.21.15.53:0/4268578110 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40011800 con 0x562dfa8af070 2024-08-31T06:30:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.525+0000 7f7c5698f740 1 -- 172.21.15.53:0/4268578110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 msgr2=0x562dfac57950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.525+0000 7f7c5698f740 1 --2- 172.21.15.53:0/4268578110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac57950 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000ff60 tx=0x7f7c40004c70 comp rx=0 tx=0).stop 2024-08-31T06:30:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.525+0000 7f7c5698f740 1 -- 172.21.15.53:0/4268578110 shutdown_connections 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.525+0000 7f7c5698f740 1 --2- 172.21.15.53:0/4268578110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8af070 0x562dfac57950 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.525+0000 7f7c5698f740 1 --2- 172.21.15.53:0/4268578110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa88e390 0x562dfac57410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.525+0000 7f7c5698f740 1 --2- 172.21.15.53:0/4268578110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa8861b0 0x562dfac600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.525+0000 7f7c5698f740 1 -- 172.21.15.53:0/4268578110 >> 172.21.15.53:0/4268578110 conn(0x562dfa8a3460 msgr2=0x562dfac5e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.525+0000 7f7c5698f740 1 -- 172.21.15.53:0/4268578110 shutdown_connections 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.525+0000 7f7c5698f740 1 -- 172.21.15.53:0/4268578110 wait complete. 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c5698f740 1 -- start start 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c5698f740 1 Processor -- start 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa88e390 0x562dfac63c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c5698f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa8af070 0x562dfac643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c5698f740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7c481b0af0 con 0x562dfa8861b0 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c5698f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7c481b0360 con 0x562dfa88e390 2024-08-31T06:30:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c5698f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c481ad4d0 con 0x562dfa8af070 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c5698f740 10 client.0 _ll_register_callbacks cb 0x7f7c3800a660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c4e1b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c4e1b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac687a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44818/0 (socket says 172.21.15.53:44818) 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c4e1b6640 1 -- 172.21.15.53:0/1757678400 learned_addr learned my addr 172.21.15.53:0/1757678400 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c4e9b7640 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa8af070 0x562dfac643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.526+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa88e390 0x562dfac63c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c4e1b6640 1 -- 172.21.15.53:0/1757678400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa8af070 msgr2=0x562dfac643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c4e1b6640 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa8af070 0x562dfac643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c4e1b6640 1 -- 172.21.15.53:0/1757678400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa88e390 msgr2=0x562dfac63c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c4e1b6640 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa88e390 0x562dfac63c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c4e1b6640 1 -- 172.21.15.53:0/1757678400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dfacdb840 con 0x562dfa8861b0 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c4e1b6640 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac687a0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f7c38011010 tx=0x7f7c38015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c300c967c6133e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c31ffb640 1 -- 172.21.15.53:0/1757678400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c38040060 con 0x562dfa8861b0 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c31ffb640 1 -- 172.21.15.53:0/1757678400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f7c3800fa00 con 0x562dfa8861b0 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c5698f740 1 -- 172.21.15.53:0/1757678400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c400054d0 con 0x562dfa8861b0 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c31ffb640 1 -- 172.21.15.53:0/1757678400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f7c3801c7c0 con 0x562dfa8861b0 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c5698f740 10 client.23292 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.527+0000 7f7c5698f740 1 -- 172.21.15.53:0/1757678400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x562dfacdc9c0 con 0x562dfa8861b0 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.528+0000 7f7c31ffb640 1 -- 172.21.15.53:0/1757678400 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c400054d0 con 0x562dfa8861b0 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.528+0000 7f7c31ffb640 1 -- 172.21.15.53:0/1757678400 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7f7c38030a30 con 0x562dfa8861b0 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.528+0000 7f7c5698f740 10 client.23292 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.528+0000 7f7c5698f740 10 client.23292 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.528+0000 7f7c5698f740 20 client.23292 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.528+0000 7f7c5698f740 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562dfa842da0 0x562dfacdf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.528+0000 7f7c5698f740 4 client.23292 mds_command: new command op to 24632 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.528+0000 7f7c5698f740 1 -- 172.21.15.53:0/1757678400 --> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562dfabc9070 con 0x562dfa842da0 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.528+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562dfa842da0 0x562dfacdf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.528+0000 7f7c4d9b5640 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562dfa842da0 0x562dfacdf1e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb611d6edc262313 server_cookie=b4b4886c1e0179c4 in_seq=0 out_seq=0 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.528+0000 7f7c31ffb640 10 client.23292 ms_handle_connect on v2:172.21.15.130:6836/1323127878 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c31ffb640 1 -- 172.21.15.53:0/1757678400 <== mds.2 v2:172.21.15.130:6836/1323127878 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562dfabc9070 con 0x562dfa842da0 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c31ffb640 10 client.23292 handle_command_reply: tid=0 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 1 client.23292 shutdown 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 1 -- 172.21.15.53:0/1757678400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 msgr2=0x562dfac687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac687a0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f7c38011010 tx=0x7f7c38015000 comp rx=0 tx=0).stop 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 1 -- 172.21.15.53:0/1757678400 shutdown_connections 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.130:6836/1323127878,v1:172.21.15.130:6837/1323127878] conn(0x562dfa842da0 0x562dfacdf1e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562dfa8af070 0x562dfac643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562dfa88e390 0x562dfac63c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 1 --2- 172.21.15.53:0/1757678400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562dfa8861b0 0x562dfac687a0 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c31ffb640 0 client.23292 ms_handle_reset on v2:172.21.15.130:6836/1323127878 2024-08-31T06:30:33.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 1 -- 172.21.15.53:0/1757678400 >> 172.21.15.53:0/1757678400 conn(0x562dfa8a3460 msgr2=0x562dfac60f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:33.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 1 -- 172.21.15.53:0/1757678400 shutdown_connections 2024-08-31T06:30:33.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 1 -- 172.21.15.53:0/1757678400 wait complete. 2024-08-31T06:30:33.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.529+0000 7f7c5698f740 20 client.23292 trim_cache size 0 max 16384 2024-08-31T06:30:33.537 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:30:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 -- 172.21.15.53:0/2762160921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7c340b4ca0 msgr2=0x7f7c340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7c340b4ca0 0x7f7c340b71b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x562dfac52f90 tx=0x7f7c3800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 -- 172.21.15.53:0/2762160921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48108140 msgr2=0x7f7c4819b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48108140 0x7f7c4819b460 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f7c44005940 tx=0x7f7c440042f0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 -- 172.21.15.53:0/2762160921 shutdown_connections 2024-08-31T06:30:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f7c340b4ca0 0x7f7c340b71b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c48108a90 0x7f7c4819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48108140 0x7f7c4819b460 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 --2- 172.21.15.53:0/2762160921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c48102800 0x7f7c4819af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 -- 172.21.15.53:0/2762160921 >> 172.21.15.53:0/2762160921 conn(0x7f7c480794d0 msgr2=0x7f7c481050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 -- 172.21.15.53:0/2762160921 shutdown_connections 2024-08-31T06:30:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:33.530+0000 7f7c5041a640 1 -- 172.21.15.53:0/2762160921 wait complete. 2024-08-31T06:30:34.223 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:30:34.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:34 smithi130 ceph-mon[22266]: pgmap v1131: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 785 KiB/s wr, 163 op/s 2024-08-31T06:30:34.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:34 smithi153 ceph-mon[22320]: pgmap v1131: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 785 KiB/s wr, 163 op/s 2024-08-31T06:30:34.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:34 smithi053 ceph-mon[18924]: pgmap v1131: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 785 KiB/s wr, 163 op/s 2024-08-31T06:30:34.478 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:35.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.029+0000 7faa470de640 1 -- 172.21.15.53:0/4053072629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40108b10 msgr2=0x7faa4010f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:35.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.029+0000 7faa470de640 1 --2- 172.21.15.53:0/4053072629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40108b10 0x7faa4010f340 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7faa38009900 tx=0x7faa3802a410 comp rx=0 tx=0).stop 2024-08-31T06:30:35.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.029+0000 7faa470de640 1 -- 172.21.15.53:0/4053072629 shutdown_connections 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.029+0000 7faa470de640 1 --2- 172.21.15.53:0/4053072629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40108b10 0x7faa4010f340 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.029+0000 7faa470de640 1 --2- 172.21.15.53:0/4053072629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa401081c0 0x7faa401085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.029+0000 7faa470de640 1 --2- 172.21.15.53:0/4053072629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa40102880 0x7faa40102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.029+0000 7faa470de640 1 -- 172.21.15.53:0/4053072629 >> 172.21.15.53:0/4053072629 conn(0x7faa40079510 msgr2=0x7faa40079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.029+0000 7faa470de640 1 -- 172.21.15.53:0/4053072629 shutdown_connections 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.029+0000 7faa470de640 1 -- 172.21.15.53:0/4053072629 wait complete. 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.029+0000 7faa470de640 1 Processor -- start 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.029+0000 7faa470de640 1 -- start start 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa470de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40102880 0x7faa4019b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa470de640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa401081c0 0x7faa4019b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa470de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa40108b10 0x7faa4019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa470de640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7faa40112700 con 0x7faa40102880 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa470de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faa40112580 con 0x7faa40108b10 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa470de640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faa40112880 con 0x7faa401081c0 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa44e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40102880 0x7faa4019b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa44e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40102880 0x7faa4019b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44832/0 (socket says 172.21.15.53:44832) 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa44e7a640 1 -- 172.21.15.53:0/3587527766 learned_addr learned my addr 172.21.15.53:0/3587527766 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa4567b640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa40108b10 0x7faa4019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa3ffff640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa401081c0 0x7faa4019b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa44e7a640 1 -- 172.21.15.53:0/3587527766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa401081c0 msgr2=0x7faa4019b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa44e7a640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa401081c0 0x7faa4019b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa44e7a640 1 -- 172.21.15.53:0/3587527766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa40108b10 msgr2=0x7faa4019bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa44e7a640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa40108b10 0x7faa4019bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa44e7a640 1 -- 172.21.15.53:0/3587527766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa401a6340 con 0x7faa40102880 2024-08-31T06:30:35.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa3ffff640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa401081c0 0x7faa4019b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.030+0000 7faa44e7a640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40102880 0x7faa4019b0b0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7faa2800b4a0 tx=0x7faa2800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.031+0000 7faa3dffb640 1 -- 172.21.15.53:0/3587527766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28014070 con 0x7faa40102880 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.031+0000 7faa3dffb640 1 -- 172.21.15.53:0/3587527766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa28010aa0 con 0x7faa40102880 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.031+0000 7faa470de640 1 -- 172.21.15.53:0/3587527766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa401a6630 con 0x7faa40102880 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.031+0000 7faa3dffb640 1 -- 172.21.15.53:0/3587527766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28017b70 con 0x7faa40102880 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.031+0000 7faa470de640 1 -- 172.21.15.53:0/3587527766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa401a6b70 con 0x7faa40102880 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa3dffb640 1 -- 172.21.15.53:0/3587527766 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7faa28017070 con 0x7faa40102880 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa4d653740 1 Processor -- start 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa4d653740 1 -- start start 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa4d653740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad27070 0x55aa4b0cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa4d653740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa4d653740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad06390 0x55aa4b0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa4d653740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55aa4b043680 con 0x55aa4acfe1b0 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa4d653740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55aa4b032c10 con 0x55aa4ad27070 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa4d653740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa4b036bc0 con 0x55aa4ad06390 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa44e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa44e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44834/0 (socket says 172.21.15.53:44834) 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa44e7a640 1 -- 172.21.15.53:0/2511521458 learned_addr learned my addr 172.21.15.53:0/2511521458 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa4567b640 1 --2- 172.21.15.53:0/2511521458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad27070 0x55aa4b0cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.034+0000 7faa3ffff640 1 --2- 172.21.15.53:0/2511521458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad06390 0x55aa4b0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.035+0000 7faa44e7a640 1 -- 172.21.15.53:0/2511521458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad06390 msgr2=0x55aa4b0ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.035+0000 7faa44e7a640 1 --2- 172.21.15.53:0/2511521458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad06390 0x55aa4b0ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.035+0000 7faa44e7a640 1 -- 172.21.15.53:0/2511521458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad27070 msgr2=0x55aa4b0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.035+0000 7faa44e7a640 1 --2- 172.21.15.53:0/2511521458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad27070 0x55aa4b0cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.035+0000 7faa44e7a640 1 -- 172.21.15.53:0/2511521458 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa4ad92650 con 0x55aa4acfe1b0 2024-08-31T06:30:35.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.035+0000 7faa3dffb640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faa2c0b4cd0 0x7faa2c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.035+0000 7faa4567b640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faa2c0b4cd0 0x7faa2c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.035+0000 7faa44e7a640 1 --2- 172.21.15.53:0/2511521458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0cc850 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7faa280e1e40 tx=0x7faa280ec690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be80b8d2efcc3697 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.035+0000 7faa3dffb640 1 -- 172.21.15.53:0/3587527766 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7faa280e47a0 con 0x7faa40102880 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.036+0000 7faa4567b640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faa2c0b4cd0 0x7faa2c0b71e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7faa38006010 tx=0x7faa38005e70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.037+0000 7faa36ffd640 1 -- 172.21.15.53:0/2511521458 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2801e070 con 0x55aa4acfe1b0 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.037+0000 7faa36ffd640 1 -- 172.21.15.53:0/2511521458 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa28017360 con 0x55aa4acfe1b0 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.037+0000 7faa36ffd640 1 -- 172.21.15.53:0/2511521458 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa280aac40 con 0x55aa4acfe1b0 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.038+0000 7faa4d653740 1 -- 172.21.15.53:0/2511521458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 msgr2=0x55aa4b0cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.038+0000 7faa4d653740 1 --2- 172.21.15.53:0/2511521458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0cc850 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7faa280e1e40 tx=0x7faa280ec690 comp rx=0 tx=0).stop 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.038+0000 7faa4d653740 1 -- 172.21.15.53:0/2511521458 shutdown_connections 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.038+0000 7faa4d653740 1 --2- 172.21.15.53:0/2511521458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad06390 0x55aa4b0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.038+0000 7faa4d653740 1 --2- 172.21.15.53:0/2511521458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0cc850 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.038+0000 7faa4d653740 1 --2- 172.21.15.53:0/2511521458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad27070 0x55aa4b0cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.038+0000 7faa4d653740 1 -- 172.21.15.53:0/2511521458 >> 172.21.15.53:0/2511521458 conn(0x55aa4ad1b460 msgr2=0x55aa4b0ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.038+0000 7faa4d653740 1 -- 172.21.15.53:0/2511521458 shutdown_connections 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.038+0000 7faa4d653740 1 -- 172.21.15.53:0/2511521458 wait complete. 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.038+0000 7faa4d653740 1 -- start start 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.038+0000 7faa4d653740 1 Processor -- start 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa4d653740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0d7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa4d653740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad06390 0x55aa4b0d7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa4d653740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad27070 0x55aa4b0e81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa4d653740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55aa4ae95700 con 0x55aa4acfe1b0 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa4d653740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55aa4afb9750 con 0x55aa4ad06390 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa4d653740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa4b0def00 con 0x55aa4ad27070 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa4d653740 10 client.0 _ll_register_callbacks cb 0x55aa4afe8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa44e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0d7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa44e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0d7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44846/0 (socket says 172.21.15.53:44846) 2024-08-31T06:30:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa44e7a640 1 -- 172.21.15.53:0/4065949131 learned_addr learned my addr 172.21.15.53:0/4065949131 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa3ffff640 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad06390 0x55aa4b0d7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa4567b640 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad27070 0x55aa4b0e81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa44e7a640 1 -- 172.21.15.53:0/4065949131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad27070 msgr2=0x55aa4b0e81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa44e7a640 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad27070 0x55aa4b0e81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa44e7a640 1 -- 172.21.15.53:0/4065949131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad06390 msgr2=0x55aa4b0d7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa44e7a640 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad06390 0x55aa4b0d7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa44e7a640 1 -- 172.21.15.53:0/4065949131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa4aff2900 con 0x55aa4acfe1b0 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa4567b640 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad27070 0x55aa4b0e81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa44e7a640 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0d7a90 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7faa280e1f80 tx=0x7faa280047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b7da0751b9a33b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.039+0000 7faa1ffff640 1 -- 172.21.15.53:0/4065949131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2801e070 con 0x55aa4acfe1b0 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa1ffff640 1 -- 172.21.15.53:0/4065949131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7faa28010c50 con 0x55aa4acfe1b0 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa4d653740 1 -- 172.21.15.53:0/4065949131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aa4b0455d0 con 0x55aa4acfe1b0 2024-08-31T06:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa1ffff640 1 -- 172.21.15.53:0/4065949131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7faa280aa5e0 con 0x55aa4acfe1b0 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa4d653740 10 client.23304 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa4d653740 1 -- 172.21.15.53:0/4065949131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x55aa4b0eacb0 con 0x55aa4acfe1b0 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa1ffff640 1 -- 172.21.15.53:0/4065949131 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55aa4b0455d0 con 0x55aa4acfe1b0 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa1ffff640 1 -- 172.21.15.53:0/4065949131 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7faa280e2150 con 0x55aa4acfe1b0 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa4d653740 10 client.23304 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa4d653740 10 client.23304 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa4d653740 20 client.23304 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa4d653740 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55aa4ace59f0 0x55aa4b0ee010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa4d653740 4 client.23304 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa4d653740 1 -- 172.21.15.53:0/4065949131 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa4b041070 con 0x55aa4ace59f0 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.040+0000 7faa3ffff640 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55aa4ace59f0 0x55aa4b0ee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.041+0000 7faa1ffff640 10 client.23304 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.041+0000 7faa3ffff640 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55aa4ace59f0 0x55aa4b0ee010 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36395f51085cbb55 server_cookie=588375ee5b5a83d5 in_seq=0 out_seq=0 2024-08-31T06:30:35.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa1ffff640 1 -- 172.21.15.53:0/4065949131 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa4b041070 con 0x55aa4ace59f0 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa1ffff640 10 client.23304 handle_command_reply: tid=0 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 1 client.23304 shutdown 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 1 -- 172.21.15.53:0/4065949131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 msgr2=0x55aa4b0d7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0d7a90 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7faa280e1f80 tx=0x7faa280047d0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 1 -- 172.21.15.53:0/4065949131 shutdown_connections 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55aa4ace59f0 0x55aa4b0ee010 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad27070 0x55aa4b0e81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad06390 0x55aa4b0d7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 1 --2- 172.21.15.53:0/4065949131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0d7a90 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa1ffff640 0 client.23304 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 1 -- 172.21.15.53:0/4065949131 >> 172.21.15.53:0/4065949131 conn(0x55aa4ad1b460 msgr2=0x55aa4b0cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:35.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 1 -- 172.21.15.53:0/4065949131 shutdown_connections 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 1 -- 172.21.15.53:0/4065949131 wait complete. 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.042+0000 7faa4d653740 20 client.23304 trim_cache size 0 max 16384 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.055+0000 7faa4d653740 1 Processor -- start 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.055+0000 7faa4d653740 1 -- start start 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4d653740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4d653740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad06390 0x55aa4b0e8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4d653740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4ad27070 0x55aa4b0cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4d653740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7faa401ad3f0 con 0x55aa4ad27070 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4d653740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faa401af170 con 0x55aa4ad06390 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4d653740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faa401adb80 con 0x55aa4acfe1b0 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4567b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4ad27070 0x55aa4b0cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4567b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4ad27070 0x55aa4b0cf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44854/0 (socket says 172.21.15.53:44854) 2024-08-31T06:30:35.092 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:30:35.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4567b640 1 -- 172.21.15.53:0/3916560354 learned_addr learned my addr 172.21.15.53:0/3916560354 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:35.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa3ffff640 1 --2- 172.21.15.53:0/3916560354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad06390 0x55aa4b0e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa44e7a640 1 --2- 172.21.15.53:0/3916560354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4567b640 1 -- 172.21.15.53:0/3916560354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4acfe1b0 msgr2=0x55aa4b0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:35.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4567b640 1 --2- 172.21.15.53:0/3916560354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4567b640 1 -- 172.21.15.53:0/3916560354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad06390 msgr2=0x55aa4b0e8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:35.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4567b640 1 --2- 172.21.15.53:0/3916560354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad06390 0x55aa4b0e8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4567b640 1 -- 172.21.15.53:0/3916560354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa4b0d5f90 con 0x55aa4ad27070 2024-08-31T06:30:35.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa44e7a640 1 --2- 172.21.15.53:0/3916560354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:30:35.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa4567b640 1 --2- 172.21.15.53:0/3916560354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4ad27070 0x55aa4b0cf410 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7faa38033000 tx=0x7faa38040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d80553572b4caf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:35.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa367fc640 1 -- 172.21.15.53:0/3916560354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38035040 con 0x55aa4ad27070 2024-08-31T06:30:35.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa367fc640 1 -- 172.21.15.53:0/3916560354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa380043c0 con 0x55aa4ad27070 2024-08-31T06:30:35.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.056+0000 7faa367fc640 1 -- 172.21.15.53:0/3916560354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38051750 con 0x55aa4ad27070 2024-08-31T06:30:35.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.057+0000 7faa4d653740 1 -- 172.21.15.53:0/3916560354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4ad27070 msgr2=0x55aa4b0cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.057+0000 7faa4d653740 1 --2- 172.21.15.53:0/3916560354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4ad27070 0x55aa4b0cf410 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7faa38033000 tx=0x7faa38040000 comp rx=0 tx=0).stop 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.057+0000 7faa4d653740 1 -- 172.21.15.53:0/3916560354 shutdown_connections 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.057+0000 7faa4d653740 1 --2- 172.21.15.53:0/3916560354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4ad27070 0x55aa4b0cf410 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.057+0000 7faa4d653740 1 --2- 172.21.15.53:0/3916560354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad06390 0x55aa4b0e8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.057+0000 7faa4d653740 1 --2- 172.21.15.53:0/3916560354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.057+0000 7faa4d653740 1 -- 172.21.15.53:0/3916560354 >> 172.21.15.53:0/3916560354 conn(0x55aa4ad1b460 msgr2=0x55aa4b0c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.057+0000 7faa4d653740 1 -- 172.21.15.53:0/3916560354 shutdown_connections 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.057+0000 7faa4d653740 1 -- 172.21.15.53:0/3916560354 wait complete. 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa4d653740 1 -- start start 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa4d653740 1 Processor -- start 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa4d653740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0ef300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa4d653740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad06390 0x55aa4b0ef840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa4d653740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad27070 0x55aa4b157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa4d653740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7faa401aea10 con 0x55aa4acfe1b0 2024-08-31T06:30:35.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa4d653740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faa401ae280 con 0x55aa4ad27070 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa4d653740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faa401ab3f0 con 0x55aa4ad06390 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa4d653740 10 client.0 _ll_register_callbacks cb 0x7faa38009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa44e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa44e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0ef300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44862/0 (socket says 172.21.15.53:44862) 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa44e7a640 1 -- 172.21.15.53:0/194944788 learned_addr learned my addr 172.21.15.53:0/194944788 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa4567b640 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad27070 0x55aa4b157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.058+0000 7faa3ffff640 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad06390 0x55aa4b0ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa44e7a640 1 -- 172.21.15.53:0/194944788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad06390 msgr2=0x55aa4b0ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa44e7a640 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad06390 0x55aa4b0ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa44e7a640 1 -- 172.21.15.53:0/194944788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad27070 msgr2=0x55aa4b157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa44e7a640 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad27070 0x55aa4b157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa44e7a640 1 -- 172.21.15.53:0/194944788 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa4b0f0090 con 0x55aa4acfe1b0 2024-08-31T06:30:35.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa44e7a640 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0ef300 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7faa2800b470 tx=0x7faa28017f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8527092bf6fc7ed8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:35.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:35.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa1ffff640 1 -- 172.21.15.53:0/194944788 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2801e050 con 0x55aa4acfe1b0 2024-08-31T06:30:35.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa1ffff640 1 -- 172.21.15.53:0/194944788 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7faa280961b0 con 0x55aa4acfe1b0 2024-08-31T06:30:35.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa4d653740 1 -- 172.21.15.53:0/194944788 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa380043c0 con 0x55aa4acfe1b0 2024-08-31T06:30:35.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa1ffff640 1 -- 172.21.15.53:0/194944788 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7faa280aa7c0 con 0x55aa4acfe1b0 2024-08-31T06:30:35.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa4d653740 10 client.23310 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:35.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa4d653740 1 -- 172.21.15.53:0/194944788 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x55aa4b0f0090 con 0x55aa4acfe1b0 2024-08-31T06:30:35.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa1ffff640 1 -- 172.21.15.53:0/194944788 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa380043c0 con 0x55aa4acfe1b0 2024-08-31T06:30:35.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.059+0000 7faa1ffff640 1 -- 172.21.15.53:0/194944788 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7faa280a7100 con 0x55aa4acfe1b0 2024-08-31T06:30:35.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.060+0000 7faa4d653740 10 client.23310 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.060+0000 7faa4d653740 10 client.23310 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.060+0000 7faa4d653740 20 client.23310 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.060+0000 7faa4d653740 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55aa4acbada0 0x55aa4b15afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.060+0000 7faa4d653740 4 client.23310 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.060+0000 7faa4d653740 1 -- 172.21.15.53:0/194944788 --> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aa4b0d8400 con 0x55aa4acbada0 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.060+0000 7faa3ffff640 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55aa4acbada0 0x55aa4b15afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.060+0000 7faa1ffff640 10 client.23310 ms_handle_connect on v2:172.21.15.153:6838/268646865 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.060+0000 7faa3ffff640 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55aa4acbada0 0x55aa4b15afe0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f43bb3a92656ce8 server_cookie=1c79aac9fd911b40 in_seq=0 out_seq=0 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.060+0000 7faa1ffff640 1 -- 172.21.15.53:0/194944788 <== mds.1 v2:172.21.15.153:6838/268646865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aa4b0d8400 con 0x55aa4acbada0 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa1ffff640 10 client.23310 handle_command_reply: tid=0 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 1 client.23310 shutdown 2024-08-31T06:30:35.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 1 -- 172.21.15.53:0/194944788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 msgr2=0x55aa4b0ef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0ef300 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7faa2800b470 tx=0x7faa28017f20 comp rx=0 tx=0).stop 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 1 -- 172.21.15.53:0/194944788 shutdown_connections 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.153:6838/268646865,v1:172.21.15.153:6839/268646865] conn(0x55aa4acbada0 0x55aa4b15afe0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55aa4ad27070 0x55aa4b157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa4ad06390 0x55aa4b0ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa1ffff640 0 client.23310 ms_handle_reset on v2:172.21.15.153:6838/268646865 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 1 --2- 172.21.15.53:0/194944788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa4acfe1b0 0x55aa4b0ef300 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 1 -- 172.21.15.53:0/194944788 >> 172.21.15.53:0/194944788 conn(0x55aa4ad1b460 msgr2=0x55aa4b0cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 1 -- 172.21.15.53:0/194944788 shutdown_connections 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 1 -- 172.21.15.53:0/194944788 wait complete. 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.061+0000 7faa4d653740 20 client.23310 trim_cache size 0 max 16384 2024-08-31T06:30:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 -- 172.21.15.53:0/3587527766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faa2c0b4cd0 msgr2=0x7faa2c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faa2c0b4cd0 0x7faa2c0b71e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7faa38006010 tx=0x7faa38005e70 comp rx=0 tx=0).stop 2024-08-31T06:30:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 -- 172.21.15.53:0/3587527766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40102880 msgr2=0x7faa4019b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40102880 0x7faa4019b0b0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7faa2800b4a0 tx=0x7faa2800b960 comp rx=0 tx=0).stop 2024-08-31T06:30:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 -- 172.21.15.53:0/3587527766 shutdown_connections 2024-08-31T06:30:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faa2c0b4cd0 0x7faa2c0b71e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa40108b10 0x7faa4019bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa401081c0 0x7faa4019b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 --2- 172.21.15.53:0/3587527766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40102880 0x7faa4019b0b0 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 -- 172.21.15.53:0/3587527766 >> 172.21.15.53:0/3587527766 conn(0x7faa40079510 msgr2=0x7faa401062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 -- 172.21.15.53:0/3587527766 shutdown_connections 2024-08-31T06:30:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:35.062+0000 7faa470de640 1 -- 172.21.15.53:0/3587527766 wait complete. 2024-08-31T06:30:35.835 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:30:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:36.214 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:36 smithi053 ceph-mon[18924]: pgmap v1132: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 663 KiB/s wr, 124 op/s 2024-08-31T06:30:36.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:36 smithi130 ceph-mon[22266]: pgmap v1132: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 663 KiB/s wr, 124 op/s 2024-08-31T06:30:36.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:36 smithi153 ceph-mon[22320]: pgmap v1132: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 663 KiB/s wr, 124 op/s 2024-08-31T06:30:36.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.591+0000 7fe5d5994640 1 -- 172.21.15.53:0/1233642535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0103940 msgr2=0x7fe5d0103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:36.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.591+0000 7fe5d5994640 1 --2- 172.21.15.53:0/1233642535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0103940 0x7fe5d0103d50 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009900 tx=0x7fe5c002a410 comp rx=0 tx=0).stop 2024-08-31T06:30:36.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.591+0000 7fe5d5994640 1 -- 172.21.15.53:0/1233642535 shutdown_connections 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.591+0000 7fe5d5994640 1 --2- 172.21.15.53:0/1233642535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0109bd0 0x7fe5d0110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.591+0000 7fe5d5994640 1 --2- 172.21.15.53:0/1233642535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0109280 0x7fe5d0109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.591+0000 7fe5d5994640 1 --2- 172.21.15.53:0/1233642535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0103940 0x7fe5d0103d50 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.591+0000 7fe5d5994640 1 -- 172.21.15.53:0/1233642535 >> 172.21.15.53:0/1233642535 conn(0x7fe5d00ff3d0 msgr2=0x7fe5d0101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.591+0000 7fe5d5994640 1 -- 172.21.15.53:0/1233642535 shutdown_connections 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.591+0000 7fe5d5994640 1 -- 172.21.15.53:0/1233642535 wait complete. 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5d5994640 1 Processor -- start 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5d5994640 1 -- start start 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5d5994640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0103940 0x7fe5d019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5d5994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109280 0x7fe5d019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5d5994640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0109bd0 0x7fe5d019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5d5994640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d0113740 con 0x7fe5d0109280 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5d5994640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d01135c0 con 0x7fe5d0109bd0 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5d5994640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d01138c0 con 0x7fe5d0103940 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5ce7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109280 0x7fe5d019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5ce7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109280 0x7fe5d019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44886/0 (socket says 172.21.15.53:44886) 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/1858339131 learned_addr learned my addr 172.21.15.53:0/1858339131 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5ceffd640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0103940 0x7fe5d019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.592+0000 7fe5cf7fe640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0109bd0 0x7fe5d019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.593+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/1858339131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0103940 msgr2=0x7fe5d019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.593+0000 7fe5ce7fc640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0103940 0x7fe5d019a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.593+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/1858339131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0109bd0 msgr2=0x7fe5d019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.593+0000 7fe5ce7fc640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0109bd0 0x7fe5d019f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.593+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/1858339131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d01a0100 con 0x7fe5d0109280 2024-08-31T06:30:36.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.593+0000 7fe5ce7fc640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109280 0x7fe5d019a730 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400c970 tx=0x7fe5c400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:36.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.593+0000 7fe5d4992640 1 -- 172.21.15.53:0/1858339131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4007bb0 con 0x7fe5d0109280 2024-08-31T06:30:36.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.593+0000 7fe5d4992640 1 -- 172.21.15.53:0/1858339131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5c4007d50 con 0x7fe5d0109280 2024-08-31T06:30:36.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.593+0000 7fe5d4992640 1 -- 172.21.15.53:0/1858339131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4004da0 con 0x7fe5d0109280 2024-08-31T06:30:36.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.593+0000 7fe5d5994640 1 -- 172.21.15.53:0/1858339131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d01a03f0 con 0x7fe5d0109280 2024-08-31T06:30:36.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.593+0000 7fe5d5994640 1 -- 172.21.15.53:0/1858339131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d01a6b50 con 0x7fe5d0109280 2024-08-31T06:30:36.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.596+0000 7fe5dbf09740 1 Processor -- start 2024-08-31T06:30:36.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.596+0000 7fe5dbf09740 1 -- start start 2024-08-31T06:30:36.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33f51b0 0x5561d37c3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33fd390 0x5561d37c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5561d373a680 con 0x5561d341e070 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5561d3729c10 con 0x5561d33fd390 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5561d372dbc0 con 0x5561d33f51b0 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5cf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5cf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44894/0 (socket says 172.21.15.53:44894) 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5cf7fe640 1 -- 172.21.15.53:0/2190424905 learned_addr learned my addr 172.21.15.53:0/2190424905 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5ceffd640 1 --2- 172.21.15.53:0/2190424905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33f51b0 0x5561d37c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5cf7fe640 1 -- 172.21.15.53:0/2190424905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33f51b0 msgr2=0x5561d37c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5cf7fe640 1 --2- 172.21.15.53:0/2190424905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33f51b0 0x5561d37c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5cf7fe640 1 -- 172.21.15.53:0/2190424905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33fd390 msgr2=0x5561d37c3dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5cf7fe640 1 --2- 172.21.15.53:0/2190424905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33fd390 0x5561d37c3dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.597+0000 7fe5cf7fe640 1 -- 172.21.15.53:0/2190424905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d3489650 con 0x5561d341e070 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.598+0000 7fe5d4992640 1 -- 172.21.15.53:0/1858339131 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe5c4004f80 con 0x7fe5d0109280 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.598+0000 7fe5cf7fe640 1 --2- 172.21.15.53:0/2190424905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37c3350 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009ee0 tx=0x7fe5c8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1fb241a361ac9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.598+0000 7fe5b5ffb640 1 -- 172.21.15.53:0/2190424905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8016070 con 0x5561d341e070 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.598+0000 7fe5b5ffb640 1 -- 172.21.15.53:0/2190424905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5c8004d20 con 0x5561d341e070 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.598+0000 7fe5b5ffb640 1 -- 172.21.15.53:0/2190424905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80126b0 con 0x5561d341e070 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.598+0000 7fe5d4992640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5b80b4ca0 0x7fe5b80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5ceffd640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5b80b4ca0 0x7fe5b80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5d4992640 1 -- 172.21.15.53:0/1858339131 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fe5c40e53b0 con 0x7fe5d0109280 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5dbf09740 1 -- 172.21.15.53:0/2190424905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 msgr2=0x5561d37c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/2190424905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37c3350 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009ee0 tx=0x7fe5c8010740 comp rx=0 tx=0).stop 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5dbf09740 1 -- 172.21.15.53:0/2190424905 shutdown_connections 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/2190424905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33fd390 0x5561d37c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/2190424905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33f51b0 0x5561d37c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/2190424905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37c3350 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5dbf09740 1 -- 172.21.15.53:0/2190424905 >> 172.21.15.53:0/2190424905 conn(0x5561d3412460 msgr2=0x5561d37c1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5dbf09740 1 -- 172.21.15.53:0/2190424905 shutdown_connections 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5ceffd640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5b80b4ca0 0x7fe5b80b71b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0000c00 tx=0x7fe5c0009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.599+0000 7fe5dbf09740 1 -- 172.21.15.53:0/2190424905 wait complete. 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5dbf09740 1 -- start start 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5dbf09740 1 Processor -- start 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33f51b0 0x5561d37ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d341e070 0x5561d37dae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5561d358c700 con 0x5561d33fd390 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5561d36b0750 con 0x5561d33f51b0 2024-08-31T06:30:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5561d37d1b30 con 0x5561d341e070 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5dbf09740 10 client.0 _ll_register_callbacks cb 0x5561d36dfe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5ce7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5ce7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44904/0 (socket says 172.21.15.53:44904) 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/3811550496 learned_addr learned my addr 172.21.15.53:0/3811550496 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.600+0000 7fe5cf7fe640 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d341e070 0x5561d37dae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5ceffd640 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33f51b0 0x5561d37ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/3811550496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d341e070 msgr2=0x5561d37dae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5ce7fc640 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d341e070 0x5561d37dae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/3811550496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33f51b0 msgr2=0x5561d37ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5ce7fc640 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33f51b0 0x5561d37ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/3811550496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561d36e9900 con 0x5561d33fd390 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5ce7fc640 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37cf0e0 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40e2b40 tx=0x7fe5c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35c41b9ee512ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3811550496 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40b0020 con 0x5561d33fd390 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3811550496 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fe5c40a7d10 con 0x5561d33fd390 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3811550496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c8004d20 con 0x5561d33fd390 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3811550496 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fe5c401d040 con 0x5561d33fd390 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5dbf09740 10 client.23322 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3811550496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x5561d37dd990 con 0x5561d33fd390 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.601+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3811550496 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5c8004d20 con 0x5561d33fd390 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.602+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3811550496 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7fe5c40a73f0 con 0x5561d33fd390 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.602+0000 7fe5dbf09740 10 client.23322 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.602+0000 7fe5dbf09740 10 client.23322 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.602+0000 7fe5dbf09740 20 client.23322 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.602+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561d33dc9f0 0x5561d37e0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.602+0000 7fe5dbf09740 4 client.23322 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.602+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3811550496 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561d373c5d0 con 0x5561d33dc9f0 2024-08-31T06:30:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.602+0000 7fe5ceffd640 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561d33dc9f0 0x5561d37e0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.603+0000 7fe5aeffd640 10 client.23322 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:36.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.603+0000 7fe5ceffd640 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561d33dc9f0 0x5561d37e0e50 crc :-1 s=READY pgs=598 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ab9e240b8ae8eb server_cookie=26ec8333c781f29c in_seq=0 out_seq=0 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.603+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3811550496 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561d373c5d0 con 0x5561d33dc9f0 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.603+0000 7fe5aeffd640 10 client.23322 handle_command_reply: tid=0 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.603+0000 7fe5dbf09740 1 client.23322 shutdown 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3811550496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 msgr2=0x5561d37cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37cf0e0 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40e2b40 tx=0x7fe5c40046c0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3811550496 shutdown_connections 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561d33dc9f0 0x5561d37e0e50 crc :-1 s=READY pgs=598 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d341e070 0x5561d37dae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37cf0e0 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3811550496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33f51b0 0x5561d37ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3811550496 >> 172.21.15.53:0/3811550496 conn(0x5561d3412460 msgr2=0x5561d37c6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5aeffd640 0 client.23322 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3811550496 shutdown_connections 2024-08-31T06:30:36.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3811550496 wait complete. 2024-08-31T06:30:36.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.604+0000 7fe5dbf09740 20 client.23322 trim_cache size 0 max 16384 2024-08-31T06:30:36.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.617+0000 7fe5dbf09740 1 Processor -- start 2024-08-31T06:30:36.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.617+0000 7fe5dbf09740 1 -- start start 2024-08-31T06:30:36.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.617+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33f51b0 0x5561d37c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.617+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.617+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d341e070 0x5561d37d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.617+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d01af590 con 0x5561d33fd390 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.617+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d01b1310 con 0x5561d341e070 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.617+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d01afd20 con 0x5561d33f51b0 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5ce7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5ce7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37c1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44912/0 (socket says 172.21.15.53:44912) 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/1045024709 learned_addr learned my addr 172.21.15.53:0/1045024709 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5ceffd640 1 --2- 172.21.15.53:0/1045024709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33f51b0 0x5561d37c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5cf7fe640 1 --2- 172.21.15.53:0/1045024709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d341e070 0x5561d37d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/1045024709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33f51b0 msgr2=0x5561d37c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5ce7fc640 1 --2- 172.21.15.53:0/1045024709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33f51b0 0x5561d37c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/1045024709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d341e070 msgr2=0x5561d37d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5ce7fc640 1 --2- 172.21.15.53:0/1045024709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d341e070 0x5561d37d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5ce7fc640 1 -- 172.21.15.53:0/1045024709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d37c5b50 con 0x5561d33fd390 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5ce7fc640 1 --2- 172.21.15.53:0/1045024709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37c1400 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40e30e0 tx=0x7fe5c4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec5938e5fa1f747 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:36.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5b57fa640 1 -- 172.21.15.53:0/1045024709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40b0040 con 0x5561d33fd390 2024-08-31T06:30:36.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5b57fa640 1 -- 172.21.15.53:0/1045024709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5c40b02f0 con 0x5561d33fd390 2024-08-31T06:30:36.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.618+0000 7fe5b57fa640 1 -- 172.21.15.53:0/1045024709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40a7d10 con 0x5561d33fd390 2024-08-31T06:30:36.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.619+0000 7fe5dbf09740 1 -- 172.21.15.53:0/1045024709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 msgr2=0x5561d37c1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:36.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.619+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/1045024709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37c1400 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40e30e0 tx=0x7fe5c4000bc0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.619+0000 7fe5dbf09740 1 -- 172.21.15.53:0/1045024709 shutdown_connections 2024-08-31T06:30:36.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.619+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/1045024709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d341e070 0x5561d37d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.619+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/1045024709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d33fd390 0x5561d37c1400 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.619+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/1045024709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33f51b0 0x5561d37c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.619+0000 7fe5dbf09740 1 -- 172.21.15.53:0/1045024709 >> 172.21.15.53:0/1045024709 conn(0x5561d3412460 msgr2=0x5561d37d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.619+0000 7fe5dbf09740 1 -- 172.21.15.53:0/1045024709 shutdown_connections 2024-08-31T06:30:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.619+0000 7fe5dbf09740 1 -- 172.21.15.53:0/1045024709 wait complete. 2024-08-31T06:30:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.619+0000 7fe5dbf09740 1 -- start start 2024-08-31T06:30:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5dbf09740 1 Processor -- start 2024-08-31T06:30:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33f51b0 0x5561d37d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33fd390 0x5561d37d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5dbf09740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d01b0bb0 con 0x5561d341e070 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d01b0420 con 0x5561d33f51b0 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5dbf09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d01ad590 con 0x5561d33fd390 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5dbf09740 10 client.0 _ll_register_callbacks cb 0x7fe5c400a470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5cf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5cf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37d39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44920/0 (socket says 172.21.15.53:44920) 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5cf7fe640 1 -- 172.21.15.53:0/3080576464 learned_addr learned my addr 172.21.15.53:0/3080576464 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5ceffd640 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33f51b0 0x5561d37d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.620+0000 7fe5ce7fc640 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33fd390 0x5561d37d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5cf7fe640 1 -- 172.21.15.53:0/3080576464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33fd390 msgr2=0x5561d37d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5cf7fe640 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33fd390 0x5561d37d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5cf7fe640 1 -- 172.21.15.53:0/3080576464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33f51b0 msgr2=0x5561d37d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5cf7fe640 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33f51b0 0x5561d37d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5cf7fe640 1 -- 172.21.15.53:0/3080576464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561d384aa10 con 0x5561d341e070 2024-08-31T06:30:36.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5cf7fe640 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37d39e0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8006010 tx=0x7fe5c8012680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90edfd952d90ec46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3080576464 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8016040 con 0x5561d341e070 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3080576464 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fe5c8012b80 con 0x5561d341e070 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3080576464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c40b02f0 con 0x5561d341e070 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3080576464 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fe5c8034050 con 0x5561d341e070 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5dbf09740 10 client.23328 fetch_fsmap learned FSMap version 95 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3080576464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) -- 0x5561d384bc90 con 0x5561d341e070 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.621+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3080576464 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5c40b02f0 con 0x5561d341e070 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.622+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3080576464 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 95) ==== 8414+0+0 (secure 0 0 0) 0x7fe5c800f040 con 0x5561d341e070 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.622+0000 7fe5dbf09740 10 client.23328 fetch_fsmap finished waiting for FSMap version 95 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.622+0000 7fe5dbf09740 10 client.23328 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.622+0000 7fe5dbf09740 20 client.23328 populate_metadata read hostname 'smithi053' 2024-08-31T06:30:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.622+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561d33b1da0 0x5561d384e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.622+0000 7fe5dbf09740 4 client.23328 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.622+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3080576464 --> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561d3738070 con 0x5561d33b1da0 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.622+0000 7fe5ceffd640 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561d33b1da0 0x5561d384e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.622+0000 7fe5ceffd640 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561d33b1da0 0x5561d384e1c0 crc :-1 s=READY pgs=599 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5a64b38da93551e server_cookie=d5311a18c08fc166 in_seq=0 out_seq=0 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.622+0000 7fe5aeffd640 10 client.23328 ms_handle_connect on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5aeffd640 1 -- 172.21.15.53:0/3080576464 <== mds.0 v2:172.21.15.130:6838/3403731647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561d3738070 con 0x5561d33b1da0 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5aeffd640 10 client.23328 handle_command_reply: tid=0 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 1 client.23328 shutdown 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3080576464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 msgr2=0x5561d37d39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37d39e0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8006010 tx=0x7fe5c8012680 comp rx=0 tx=0).stop 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3080576464 shutdown_connections 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.130:6838/3403731647,v1:172.21.15.130:6839/3403731647] conn(0x5561d33b1da0 0x5561d384e1c0 crc :-1 s=READY pgs=599 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5aeffd640 0 client.23328 ms_handle_reset on v2:172.21.15.130:6838/3403731647 2024-08-31T06:30:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561d341e070 0x5561d37d39e0 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5561d33fd390 0x5561d37d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 1 --2- 172.21.15.53:0/3080576464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5561d33f51b0 0x5561d37d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3080576464 >> 172.21.15.53:0/3080576464 conn(0x5561d3412460 msgr2=0x5561d37c6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3080576464 shutdown_connections 2024-08-31T06:30:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 1 -- 172.21.15.53:0/3080576464 wait complete. 2024-08-31T06:30:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.623+0000 7fe5dbf09740 20 client.23328 trim_cache size 0 max 16384 2024-08-31T06:30:36.631 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-08-31T06:30:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 -- 172.21.15.53:0/1858339131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5b80b4ca0 msgr2=0x7fe5b80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5b80b4ca0 0x7fe5b80b71b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0000c00 tx=0x7fe5c0009680 comp rx=0 tx=0).stop 2024-08-31T06:30:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 -- 172.21.15.53:0/1858339131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109280 msgr2=0x7fe5d019a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109280 0x7fe5d019a730 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400c970 tx=0x7fe5c400ce30 comp rx=0 tx=0).stop 2024-08-31T06:30:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 -- 172.21.15.53:0/1858339131 shutdown_connections 2024-08-31T06:30:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fe5b80b4ca0 0x7fe5b80b71b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5d0109bd0 0x7fe5d019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5d0109280 0x7fe5d019a730 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 --2- 172.21.15.53:0/1858339131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d0103940 0x7fe5d019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:36.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 -- 172.21.15.53:0/1858339131 >> 172.21.15.53:0/1858339131 conn(0x7fe5d00ff3d0 msgr2=0x7fe5d01017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:36.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 -- 172.21.15.53:0/1858339131 shutdown_connections 2024-08-31T06:30:36.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:36.624+0000 7fe5d5994640 1 -- 172.21.15.53:0/1858339131 wait complete. 2024-08-31T06:30:37.449 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-08-31T06:30:37.450 INFO:tasks.fwd_scrub:done joining 2024-08-31T06:30:37.450 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-31T06:30:37.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T06:30:37.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.591+0000 7f4bfb653640 1 -- 172.21.15.53:0/472633218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf4104540 msgr2=0x7f4bf4104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:37.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.591+0000 7f4bfb653640 1 --2- 172.21.15.53:0/472633218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf4104540 0x7f4bf4104950 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009900 tx=0x7f4be402a410 comp rx=0 tx=0).stop 2024-08-31T06:30:37.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.591+0000 7f4bfb653640 1 -- 172.21.15.53:0/472633218 shutdown_connections 2024-08-31T06:30:37.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.591+0000 7f4bfb653640 1 --2- 172.21.15.53:0/472633218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf410daf0 0x7f4bf4110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.591+0000 7f4bfb653640 1 --2- 172.21.15.53:0/472633218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bf4104f70 0x7f4bf410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.591+0000 7f4bfb653640 1 --2- 172.21.15.53:0/472633218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf4104540 0x7f4bf4104950 unknown :-1 s=CLOSED pgs=2389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.591+0000 7f4bfb653640 1 -- 172.21.15.53:0/472633218 >> 172.21.15.53:0/472633218 conn(0x7f4bf40fe190 msgr2=0x7f4bf41005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:37.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.592+0000 7f4bfb653640 1 -- 172.21.15.53:0/472633218 shutdown_connections 2024-08-31T06:30:37.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.592+0000 7f4bfb653640 1 -- 172.21.15.53:0/472633218 wait complete. 2024-08-31T06:30:37.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.592+0000 7f4bfb653640 1 Processor -- start 2024-08-31T06:30:37.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.592+0000 7f4bfb653640 1 -- start start 2024-08-31T06:30:37.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.592+0000 7f4bfb653640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bf4104540 0x7f4bf419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:37.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.592+0000 7f4bfb653640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf4104f70 0x7f4bf419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:37.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.592+0000 7f4bfb653640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf410daf0 0x7f4bf419f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:37.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.592+0000 7f4bfb653640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf4113630 con 0x7f4bf4104f70 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.592+0000 7f4bfb653640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf41134b0 con 0x7f4bf4104540 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.592+0000 7f4bfb653640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf41137b0 con 0x7f4bf410daf0 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf8bee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf4104f70 0x7f4bf419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf8bee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf4104f70 0x7f4bf419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44926/0 (socket says 172.21.15.53:44926) 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf8bee640 1 -- 172.21.15.53:0/3408261826 learned_addr learned my addr 172.21.15.53:0/3408261826 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf9bf0640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf410daf0 0x7f4bf419f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf93ef640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bf4104540 0x7f4bf419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf8bee640 1 -- 172.21.15.53:0/3408261826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf410daf0 msgr2=0x7f4bf419f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf8bee640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf410daf0 0x7f4bf419f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf8bee640 1 -- 172.21.15.53:0/3408261826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bf4104540 msgr2=0x7f4bf419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf8bee640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bf4104540 0x7f4bf419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf8bee640 1 -- 172.21.15.53:0/3408261826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf41a0040 con 0x7f4bf4104f70 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf8bee640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf4104f70 0x7f4bf419a6b0 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f4be800d950 tx=0x7f4be800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:37.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf27fc640 1 -- 172.21.15.53:0/3408261826 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be8017070 con 0x7f4bf4104f70 2024-08-31T06:30:37.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf27fc640 1 -- 172.21.15.53:0/3408261826 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4be8009c30 con 0x7f4bf4104f70 2024-08-31T06:30:37.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bfb653640 1 -- 172.21.15.53:0/3408261826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf41a0330 con 0x7f4bf4104f70 2024-08-31T06:30:37.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bf27fc640 1 -- 172.21.15.53:0/3408261826 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be80047a0 con 0x7f4bf4104f70 2024-08-31T06:30:37.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.593+0000 7f4bfb653640 1 -- 172.21.15.53:0/3408261826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf41a6ac0 con 0x7f4bf4104f70 2024-08-31T06:30:37.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.594+0000 7f4bfb653640 1 -- 172.21.15.53:0/3408261826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf4104950 con 0x7f4bf4104f70 2024-08-31T06:30:37.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.596+0000 7f4bf27fc640 1 -- 172.21.15.53:0/3408261826 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4be8004020 con 0x7f4bf4104f70 2024-08-31T06:30:37.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.596+0000 7f4bf27fc640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4bdc0b4d20 0x7f4bdc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:37.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.597+0000 7f4bf93ef640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4bdc0b4d20 0x7f4bdc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:37.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.597+0000 7f4bf27fc640 1 -- 172.21.15.53:0/3408261826 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f4be80e53a0 con 0x7f4bf4104f70 2024-08-31T06:30:37.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.597+0000 7f4bf93ef640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4bdc0b4d20 0x7f4bdc0b7230 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4be4000c00 tx=0x7f4be4009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:37.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.601+0000 7f4bf27fc640 1 -- 172.21.15.53:0/3408261826 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4be8020020 con 0x7f4bf4104f70 2024-08-31T06:30:37.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.789+0000 7f4bfb653640 1 -- 172.21.15.53:0/3408261826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bf402e430 con 0x7f4bf4104f70 2024-08-31T06:30:37.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.790+0000 7f4bf27fc640 1 -- 172.21.15.53:0/3408261826 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+23195 (secure 0 0 0) 0x7f4be80ac110 con 0x7f4bf4104f70 2024-08-31T06:30:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:30:37.793 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":114,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:30:14.638882+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":47,"snap_epoch":113,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":34,"length":1},{"begin":47,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:30:37.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.792+0000 7f4bfb653640 1 -- 172.21.15.53:0/3408261826 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4bdc0b4d20 msgr2=0x7f4bdc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:37.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.793+0000 7f4bfb653640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4bdc0b4d20 0x7f4bdc0b7230 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4be4000c00 tx=0x7f4be4009680 comp rx=0 tx=0).stop 2024-08-31T06:30:37.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.793+0000 7f4bfb653640 1 -- 172.21.15.53:0/3408261826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf4104f70 msgr2=0x7f4bf419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:37.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.793+0000 7f4bfb653640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf4104f70 0x7f4bf419a6b0 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f4be800d950 tx=0x7f4be800de10 comp rx=0 tx=0).stop 2024-08-31T06:30:37.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.793+0000 7f4bfb653640 1 -- 172.21.15.53:0/3408261826 shutdown_connections 2024-08-31T06:30:37.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.793+0000 7f4bfb653640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f4bdc0b4d20 0x7f4bdc0b7230 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.793+0000 7f4bfb653640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf410daf0 0x7f4bf419f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.793+0000 7f4bfb653640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf4104f70 0x7f4bf419a6b0 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.793+0000 7f4bfb653640 1 --2- 172.21.15.53:0/3408261826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bf4104540 0x7f4bf419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.793+0000 7f4bfb653640 1 -- 172.21.15.53:0/3408261826 >> 172.21.15.53:0/3408261826 conn(0x7f4bf40fe190 msgr2=0x7f4bf40fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:37.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.793+0000 7f4bfb653640 1 -- 172.21.15.53:0/3408261826 shutdown_connections 2024-08-31T06:30:37.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.793+0000 7f4bfb653640 1 -- 172.21.15.53:0/3408261826 wait complete. 2024-08-31T06:30:37.807 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T05:58:04.713426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T06:02:26.602694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T06:02:29.237487+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 47, 'snap_epoch': 113, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T06:30:37.807 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T06:30:37.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.920+0000 7f57e4086640 1 -- 172.21.15.53:0/2208390268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc103850 msgr2=0x7f57dc103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:37.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.920+0000 7f57e4086640 1 --2- 172.21.15.53:0/2208390268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc103850 0x7f57dc103c60 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009900 tx=0x7f57d802a410 comp rx=0 tx=0).stop 2024-08-31T06:30:37.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.920+0000 7f57e4086640 1 -- 172.21.15.53:0/2208390268 shutdown_connections 2024-08-31T06:30:37.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.920+0000 7f57e4086640 1 --2- 172.21.15.53:0/2208390268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57dc109ad0 0x7f57dc110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.920+0000 7f57e4086640 1 --2- 172.21.15.53:0/2208390268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57dc109180 0x7f57dc109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.920+0000 7f57e4086640 1 --2- 172.21.15.53:0/2208390268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc103850 0x7f57dc103c60 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.920+0000 7f57e4086640 1 -- 172.21.15.53:0/2208390268 >> 172.21.15.53:0/2208390268 conn(0x7f57dc0ff270 msgr2=0x7f57dc1016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:37.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.920+0000 7f57e4086640 1 -- 172.21.15.53:0/2208390268 shutdown_connections 2024-08-31T06:30:37.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.920+0000 7f57e4086640 1 -- 172.21.15.53:0/2208390268 wait complete. 2024-08-31T06:30:37.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.920+0000 7f57e4086640 1 Processor -- start 2024-08-31T06:30:37.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.920+0000 7f57e4086640 1 -- start start 2024-08-31T06:30:37.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e4086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc103850 0x7f57dc19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:37.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e4086640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57dc109180 0x7f57dc19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:37.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e4086640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57dc109ad0 0x7f57dc19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:37.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e4086640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc113650 con 0x7f57dc103850 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e4086640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc1134d0 con 0x7f57dc109ad0 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e4086640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc1137d0 con 0x7f57dc109180 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e1e22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc103850 0x7f57dc19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e1e22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc103850 0x7f57dc19a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44946/0 (socket says 172.21.15.53:44946) 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e1e22640 1 -- 172.21.15.53:0/3640582918 learned_addr learned my addr 172.21.15.53:0/3640582918 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e1621640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57dc109180 0x7f57dc19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e2623640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57dc109ad0 0x7f57dc19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e1e22640 1 -- 172.21.15.53:0/3640582918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57dc109180 msgr2=0x7f57dc19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e1e22640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57dc109180 0x7f57dc19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e1e22640 1 -- 172.21.15.53:0/3640582918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57dc109ad0 msgr2=0x7f57dc19f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e1e22640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57dc109ad0 0x7f57dc19f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e1e22640 1 -- 172.21.15.53:0/3640582918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc1a0020 con 0x7f57dc103850 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e1621640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57dc109180 0x7f57dc19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.921+0000 7f57e1e22640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc103850 0x7f57dc19a0f0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009230 tx=0x7f57d80319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:37.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.922+0000 7f57d2ffd640 1 -- 172.21.15.53:0/3640582918 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d803f030 con 0x7f57dc103850 2024-08-31T06:30:37.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.922+0000 7f57d2ffd640 1 -- 172.21.15.53:0/3640582918 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57d80043d0 con 0x7f57dc103850 2024-08-31T06:30:37.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.922+0000 7f57e4086640 1 -- 172.21.15.53:0/3640582918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc1a02b0 con 0x7f57dc103850 2024-08-31T06:30:37.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.922+0000 7f57d2ffd640 1 -- 172.21.15.53:0/3640582918 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8035070 con 0x7f57dc103850 2024-08-31T06:30:37.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.922+0000 7f57e4086640 1 -- 172.21.15.53:0/3640582918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc1a6aa0 con 0x7f57dc103850 2024-08-31T06:30:37.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.923+0000 7f57e4086640 1 -- 172.21.15.53:0/3640582918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57dc103c60 con 0x7f57dc103850 2024-08-31T06:30:37.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.924+0000 7f57d2ffd640 1 -- 172.21.15.53:0/3640582918 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f57d8042030 con 0x7f57dc103850 2024-08-31T06:30:37.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.925+0000 7f57d2ffd640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57c80b4ca0 0x7f57c80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:37.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.926+0000 7f57e1621640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57c80b4ca0 0x7f57c80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:37.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.926+0000 7f57d2ffd640 1 -- 172.21.15.53:0/3640582918 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f57d8105e50 con 0x7f57dc103850 2024-08-31T06:30:37.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.926+0000 7f57e1621640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57c80b4ca0 0x7f57c80b71b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f57dc06a480 tx=0x7f57cc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:37.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:37.929+0000 7f57d2ffd640 1 -- 172.21.15.53:0/3640582918 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f57d80ccc20 con 0x7f57dc103850 2024-08-31T06:30:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.113+0000 7f57e4086640 1 -- 172.21.15.53:0/3640582918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f57dc10b880 con 0x7f57dc103850 2024-08-31T06:30:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.114+0000 7f57d2ffd640 1 -- 172.21.15.53:0/3640582918 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) ==== 93+0+10 (secure 0 0 0) 0x7f57d80cc520 con 0x7f57dc103850 2024-08-31T06:30:38.116 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-08-31T06:30:38.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 -- 172.21.15.53:0/3640582918 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57c80b4ca0 msgr2=0x7f57c80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57c80b4ca0 0x7f57c80b71b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f57dc06a480 tx=0x7f57cc005f90 comp rx=0 tx=0).stop 2024-08-31T06:30:38.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 -- 172.21.15.53:0/3640582918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc103850 msgr2=0x7f57dc19a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc103850 0x7f57dc19a0f0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009230 tx=0x7f57d80319a0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 -- 172.21.15.53:0/3640582918 shutdown_connections 2024-08-31T06:30:38.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f57c80b4ca0 0x7f57c80b71b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57dc109ad0 0x7f57dc19f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57dc109180 0x7f57dc19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 --2- 172.21.15.53:0/3640582918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc103850 0x7f57dc19a0f0 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 -- 172.21.15.53:0/3640582918 >> 172.21.15.53:0/3640582918 conn(0x7f57dc0ff270 msgr2=0x7f57dc101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:38.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 -- 172.21.15.53:0/3640582918 shutdown_connections 2024-08-31T06:30:38.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.116+0000 7f57e4086640 1 -- 172.21.15.53:0/3640582918 wait complete. 2024-08-31T06:30:38.129 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:38 smithi053 ceph-mon[18924]: pgmap v1133: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 239 KiB/s wr, 54 op/s 2024-08-31T06:30:38.129 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:38 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3408261826' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:30:38.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T06:30:38.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.241+0000 7faf2b32b640 1 -- 172.21.15.53:0/3249315760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf24102e80 msgr2=0x7faf24103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.241+0000 7faf2b32b640 1 --2- 172.21.15.53:0/3249315760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf24102e80 0x7faf24103290 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009900 tx=0x7faf1c02a410 comp rx=0 tx=0).stop 2024-08-31T06:30:38.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.241+0000 7faf2b32b640 1 -- 172.21.15.53:0/3249315760 shutdown_connections 2024-08-31T06:30:38.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.241+0000 7faf2b32b640 1 --2- 172.21.15.53:0/3249315760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf24105790 0x7faf2410f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.241+0000 7faf2b32b640 1 --2- 172.21.15.53:0/3249315760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf24104e40 0x7faf24105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.241+0000 7faf2b32b640 1 --2- 172.21.15.53:0/3249315760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf24102e80 0x7faf24103290 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.241+0000 7faf2b32b640 1 -- 172.21.15.53:0/3249315760 >> 172.21.15.53:0/3249315760 conn(0x7faf24079ba0 msgr2=0x7faf24079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:38.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.241+0000 7faf2b32b640 1 -- 172.21.15.53:0/3249315760 shutdown_connections 2024-08-31T06:30:38.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.241+0000 7faf2b32b640 1 -- 172.21.15.53:0/3249315760 wait complete. 2024-08-31T06:30:38.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf2b32b640 1 Processor -- start 2024-08-31T06:30:38.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf2b32b640 1 -- start start 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf2b32b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf24102e80 0x7faf2419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf2b32b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf24104e40 0x7faf2419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf2b32b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf24105790 0x7faf2419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf2b32b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7faf24112550 con 0x7faf24105790 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf2b32b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faf241123d0 con 0x7faf24104e40 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf2b32b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf241126d0 con 0x7faf24102e80 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf298c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf24105790 0x7faf2419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf298c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf24105790 0x7faf2419fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44972/0 (socket says 172.21.15.53:44972) 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf298c8640 1 -- 172.21.15.53:0/3036798349 learned_addr learned my addr 172.21.15.53:0/3036798349 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf290c7640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf24102e80 0x7faf2419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf288c6640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf24104e40 0x7faf2419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf298c8640 1 -- 172.21.15.53:0/3036798349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf24102e80 msgr2=0x7faf2419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf298c8640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf24102e80 0x7faf2419a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf298c8640 1 -- 172.21.15.53:0/3036798349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf24104e40 msgr2=0x7faf2419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf298c8640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf24104e40 0x7faf2419a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.242+0000 7faf298c8640 1 -- 172.21.15.53:0/3036798349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf241a0130 con 0x7faf24105790 2024-08-31T06:30:38.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.243+0000 7faf298c8640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf24105790 0x7faf2419fa30 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c970 tx=0x7faf1400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:38.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.243+0000 7faf227fc640 1 -- 172.21.15.53:0/3036798349 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14007bb0 con 0x7faf24105790 2024-08-31T06:30:38.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.243+0000 7faf227fc640 1 -- 172.21.15.53:0/3036798349 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf14007d50 con 0x7faf24105790 2024-08-31T06:30:38.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.243+0000 7faf227fc640 1 -- 172.21.15.53:0/3036798349 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14004d50 con 0x7faf24105790 2024-08-31T06:30:38.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.243+0000 7faf2b32b640 1 -- 172.21.15.53:0/3036798349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf241a0420 con 0x7faf24105790 2024-08-31T06:30:38.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.243+0000 7faf2b32b640 1 -- 172.21.15.53:0/3036798349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf241a6bb0 con 0x7faf24105790 2024-08-31T06:30:38.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.244+0000 7faf2b32b640 1 -- 172.21.15.53:0/3036798349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2419b320 con 0x7faf24105790 2024-08-31T06:30:38.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.245+0000 7faf227fc640 1 -- 172.21.15.53:0/3036798349 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7faf14004f10 con 0x7faf24105790 2024-08-31T06:30:38.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.246+0000 7faf227fc640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf0c0b4d20 0x7faf0c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.246+0000 7faf227fc640 1 -- 172.21.15.53:0/3036798349 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7faf140e5650 con 0x7faf24105790 2024-08-31T06:30:38.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.246+0000 7faf290c7640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf0c0b4d20 0x7faf0c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.247+0000 7faf290c7640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf0c0b4d20 0x7faf0c0b7230 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7faf1c005f70 tx=0x7faf1c000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:38.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.249+0000 7faf227fc640 1 -- 172.21.15.53:0/3036798349 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faf14014030 con 0x7faf24105790 2024-08-31T06:30:38.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:38 smithi130 ceph-mon[22266]: pgmap v1133: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 239 KiB/s wr, 54 op/s 2024-08-31T06:30:38.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:38 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3408261826' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:30:38.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:38 smithi153 ceph-mon[22320]: pgmap v1133: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 239 KiB/s wr, 54 op/s 2024-08-31T06:30:38.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:38 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3408261826' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:30:38.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.435+0000 7faf2b32b640 1 -- 172.21.15.53:0/3036798349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faf2402e430 con 0x7faf24105790 2024-08-31T06:30:38.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.435+0000 7faf227fc640 1 -- 172.21.15.53:0/3036798349 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) ==== 104+0+11 (secure 0 0 0) 0x7faf140ac440 con 0x7faf24105790 2024-08-31T06:30:38.438 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-08-31T06:30:38.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.437+0000 7faf2b32b640 1 -- 172.21.15.53:0/3036798349 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf0c0b4d20 msgr2=0x7faf0c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.437+0000 7faf2b32b640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf0c0b4d20 0x7faf0c0b7230 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7faf1c005f70 tx=0x7faf1c000bc0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.437+0000 7faf2b32b640 1 -- 172.21.15.53:0/3036798349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf24105790 msgr2=0x7faf2419fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.437+0000 7faf2b32b640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf24105790 0x7faf2419fa30 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c970 tx=0x7faf1400ce30 comp rx=0 tx=0).stop 2024-08-31T06:30:38.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.437+0000 7faf2b32b640 1 -- 172.21.15.53:0/3036798349 shutdown_connections 2024-08-31T06:30:38.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.437+0000 7faf2b32b640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7faf0c0b4d20 0x7faf0c0b7230 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.437+0000 7faf2b32b640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf24105790 0x7faf2419fa30 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.437+0000 7faf2b32b640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf24104e40 0x7faf2419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.437+0000 7faf2b32b640 1 --2- 172.21.15.53:0/3036798349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf24102e80 0x7faf2419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.437+0000 7faf2b32b640 1 -- 172.21.15.53:0/3036798349 >> 172.21.15.53:0/3036798349 conn(0x7faf24079ba0 msgr2=0x7faf24101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:38.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.437+0000 7faf2b32b640 1 -- 172.21.15.53:0/3036798349 shutdown_connections 2024-08-31T06:30:38.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.438+0000 7faf2b32b640 1 -- 172.21.15.53:0/3036798349 wait complete. 2024-08-31T06:30:38.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T06:30:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.563+0000 7f051fb12640 1 -- 172.21.15.53:0/2489136435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f051810db50 msgr2=0x7f0518110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.563+0000 7f051fb12640 1 --2- 172.21.15.53:0/2489136435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f051810db50 0x7f0518110030 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f0510009ca0 tx=0x7f051002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.563+0000 7f051fb12640 1 -- 172.21.15.53:0/2489136435 shutdown_connections 2024-08-31T06:30:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.563+0000 7f051fb12640 1 --2- 172.21.15.53:0/2489136435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f051810db50 0x7f0518110030 unknown :-1 s=CLOSED pgs=2395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.563+0000 7f051fb12640 1 --2- 172.21.15.53:0/2489136435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0518105080 0x7f051810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.563+0000 7f051fb12640 1 --2- 172.21.15.53:0/2489136435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0518104730 0x7f0518104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.563+0000 7f051fb12640 1 -- 172.21.15.53:0/2489136435 >> 172.21.15.53:0/2489136435 conn(0x7f05180fe160 msgr2=0x7f05181005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.563+0000 7f051fb12640 1 -- 172.21.15.53:0/2489136435 shutdown_connections 2024-08-31T06:30:38.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.563+0000 7f051fb12640 1 -- 172.21.15.53:0/2489136435 wait complete. 2024-08-31T06:30:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.563+0000 7f051fb12640 1 Processor -- start 2024-08-31T06:30:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051fb12640 1 -- start start 2024-08-31T06:30:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051fb12640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0518104730 0x7f051819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051fb12640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0518105080 0x7f051819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051fb12640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f051810db50 0x7f051819f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051fb12640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f05181136c0 con 0x7f0518105080 2024-08-31T06:30:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051fb12640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0518113540 con 0x7f051810db50 2024-08-31T06:30:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051fb12640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0518113840 con 0x7f0518104730 2024-08-31T06:30:38.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051d0ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0518105080 0x7f051819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051d0ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0518105080 0x7f051819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44978/0 (socket says 172.21.15.53:44978) 2024-08-31T06:30:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051d0ad640 1 -- 172.21.15.53:0/3482126592 learned_addr learned my addr 172.21.15.53:0/3482126592 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051e0af640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f051810db50 0x7f051819f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051d8ae640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0518104730 0x7f051819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051d0ad640 1 -- 172.21.15.53:0/3482126592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0518104730 msgr2=0x7f051819a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051d0ad640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0518104730 0x7f051819a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051d0ad640 1 -- 172.21.15.53:0/3482126592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f051810db50 msgr2=0x7f051819f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051d0ad640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f051810db50 0x7f051819f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051d0ad640 1 -- 172.21.15.53:0/3482126592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051819ffd0 con 0x7f0518105080 2024-08-31T06:30:38.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.564+0000 7f051e0af640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f051810db50 0x7f051819f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.565+0000 7f051d0ad640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0518105080 0x7f051819a640 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f050800d950 tx=0x7f050800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.565+0000 7f050effd640 1 -- 172.21.15.53:0/3482126592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508017070 con 0x7f0518105080 2024-08-31T06:30:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.565+0000 7f051fb12640 1 -- 172.21.15.53:0/3482126592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05181a02c0 con 0x7f0518105080 2024-08-31T06:30:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.565+0000 7f050effd640 1 -- 172.21.15.53:0/3482126592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0508009c30 con 0x7f0518105080 2024-08-31T06:30:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.565+0000 7f050effd640 1 -- 172.21.15.53:0/3482126592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05080047a0 con 0x7f0518105080 2024-08-31T06:30:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.565+0000 7f051fb12640 1 -- 172.21.15.53:0/3482126592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05181a6a50 con 0x7f0518105080 2024-08-31T06:30:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.566+0000 7f051fb12640 1 -- 172.21.15.53:0/3482126592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0518104b40 con 0x7f0518105080 2024-08-31T06:30:38.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.567+0000 7f050effd640 1 -- 172.21.15.53:0/3482126592 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0508004020 con 0x7f0518105080 2024-08-31T06:30:38.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.568+0000 7f050effd640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05040b4ca0 0x7f05040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.568+0000 7f051d8ae640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05040b4ca0 0x7f05040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.568+0000 7f050effd640 1 -- 172.21.15.53:0/3482126592 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f05080e5310 con 0x7f0518105080 2024-08-31T06:30:38.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.569+0000 7f051d8ae640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05040b4ca0 0x7f05040b71b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0514009bd0 tx=0x7f0514005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:38.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.572+0000 7f050effd640 1 -- 172.21.15.53:0/3482126592 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0508020020 con 0x7f0518105080 2024-08-31T06:30:38.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.768+0000 7f051fb12640 1 -- 172.21.15.53:0/3482126592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f05181a6d30 con 0x7f0518105080 2024-08-31T06:30:38.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.769+0000 7f050effd640 1 -- 172.21.15.53:0/3482126592 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) ==== 100+0+11 (secure 0 0 0) 0x7f05080ac080 con 0x7f0518105080 2024-08-31T06:30:38.772 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-08-31T06:30:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 -- 172.21.15.53:0/3482126592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05040b4ca0 msgr2=0x7f05040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05040b4ca0 0x7f05040b71b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0514009bd0 tx=0x7f0514005f90 comp rx=0 tx=0).stop 2024-08-31T06:30:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 -- 172.21.15.53:0/3482126592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0518105080 msgr2=0x7f051819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0518105080 0x7f051819a640 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f050800d950 tx=0x7f050800de10 comp rx=0 tx=0).stop 2024-08-31T06:30:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 -- 172.21.15.53:0/3482126592 shutdown_connections 2024-08-31T06:30:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f05040b4ca0 0x7f05040b71b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f051810db50 0x7f051819f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0518105080 0x7f051819a640 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 --2- 172.21.15.53:0/3482126592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0518104730 0x7f051819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 -- 172.21.15.53:0/3482126592 >> 172.21.15.53:0/3482126592 conn(0x7f05180fe160 msgr2=0x7f0518105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 -- 172.21.15.53:0/3482126592 shutdown_connections 2024-08-31T06:30:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.771+0000 7f051fb12640 1 -- 172.21.15.53:0/3482126592 wait complete. 2024-08-31T06:30:38.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-31T06:30:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.893+0000 7fde5c19b640 1 -- 172.21.15.53:0/362653926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde541046a0 msgr2=0x7fde54104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.893+0000 7fde5c19b640 1 --2- 172.21.15.53:0/362653926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde541046a0 0x7fde54104ab0 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009900 tx=0x7fde4c02a410 comp rx=0 tx=0).stop 2024-08-31T06:30:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.893+0000 7fde5c19b640 1 -- 172.21.15.53:0/362653926 shutdown_connections 2024-08-31T06:30:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.893+0000 7fde5c19b640 1 --2- 172.21.15.53:0/362653926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5410db00 0x7fde5410fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.893+0000 7fde5c19b640 1 --2- 172.21.15.53:0/362653926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde54104ff0 0x7fde5410d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.893+0000 7fde5c19b640 1 --2- 172.21.15.53:0/362653926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde541046a0 0x7fde54104ab0 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.893+0000 7fde5c19b640 1 -- 172.21.15.53:0/362653926 >> 172.21.15.53:0/362653926 conn(0x7fde540fe1b0 msgr2=0x7fde54100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.893+0000 7fde5c19b640 1 -- 172.21.15.53:0/362653926 shutdown_connections 2024-08-31T06:30:38.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.893+0000 7fde5c19b640 1 -- 172.21.15.53:0/362653926 wait complete. 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde5c19b640 1 Processor -- start 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde5c19b640 1 -- start start 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde5c19b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde541046a0 0x7fde5419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde5c19b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde54104ff0 0x7fde5419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde5c19b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5410db00 0x7fde5419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde5c19b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fde54113620 con 0x7fde54104ff0 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde5c19b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fde541134a0 con 0x7fde5410db00 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde5c19b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fde541137a0 con 0x7fde541046a0 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde59736640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde54104ff0 0x7fde5419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde59736640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde54104ff0 0x7fde5419a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45002/0 (socket says 172.21.15.53:45002) 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde59736640 1 -- 172.21.15.53:0/2242983358 learned_addr learned my addr 172.21.15.53:0/2242983358 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde5a738640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5410db00 0x7fde5419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.894+0000 7fde59f37640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde541046a0 0x7fde5419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde59736640 1 -- 172.21.15.53:0/2242983358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde541046a0 msgr2=0x7fde5419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde59736640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde541046a0 0x7fde5419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde59736640 1 -- 172.21.15.53:0/2242983358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5410db00 msgr2=0x7fde5419f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde59736640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5410db00 0x7fde5419f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde59736640 1 -- 172.21.15.53:0/2242983358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde541a0030 con 0x7fde54104ff0 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde5a738640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5410db00 0x7fde5419f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde59736640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde54104ff0 0x7fde5419a6a0 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d950 tx=0x7fde4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde52ffd640 1 -- 172.21.15.53:0/2242983358 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48017070 con 0x7fde54104ff0 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde52ffd640 1 -- 172.21.15.53:0/2242983358 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde48009c30 con 0x7fde54104ff0 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde5c19b640 1 -- 172.21.15.53:0/2242983358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde541a0320 con 0x7fde54104ff0 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde52ffd640 1 -- 172.21.15.53:0/2242983358 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde480047a0 con 0x7fde54104ff0 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.895+0000 7fde5c19b640 1 -- 172.21.15.53:0/2242983358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde541a6ab0 con 0x7fde54104ff0 2024-08-31T06:30:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.896+0000 7fde5c19b640 1 -- 172.21.15.53:0/2242983358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde5406ba00 con 0x7fde54104ff0 2024-08-31T06:30:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.898+0000 7fde52ffd640 1 -- 172.21.15.53:0/2242983358 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fde48004020 con 0x7fde54104ff0 2024-08-31T06:30:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.899+0000 7fde52ffd640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde3c0b4ca0 0x7fde3c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:30:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.899+0000 7fde59f37640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde3c0b4ca0 0x7fde3c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:30:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.899+0000 7fde52ffd640 1 -- 172.21.15.53:0/2242983358 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fde480e5760 con 0x7fde54104ff0 2024-08-31T06:30:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.899+0000 7fde59f37640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde3c0b4ca0 0x7fde3c0b71b0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000c00 tx=0x7fde4c009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:30:38.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:38.902+0000 7fde52ffd640 1 -- 172.21.15.53:0/2242983358 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fde48020020 con 0x7fde54104ff0 2024-08-31T06:30:39.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.140+0000 7fde5c19b640 1 -- 172.21.15.53:0/2242983358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fde541a6d60 con 0x7fde54104ff0 2024-08-31T06:30:39.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.148+0000 7fde52ffd640 1 -- 172.21.15.53:0/2242983358 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) ==== 81+0+826324 (secure 0 0 0) 0x7fde480ac530 con 0x7fde54104ff0 2024-08-31T06:30:39.161 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:30:39.161 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:30:39.161 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 24, 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: "active_gid": 14220, 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: "active_name": "x", 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: "active_addrs": { 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6800", 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1345161100 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-08-31T06:30:39.162 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6801", 2024-08-31T06:30:39.163 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1345161100 2024-08-31T06:30:39.163 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.163 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T06:30:39.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.163 INFO:teuthology.orchestra.run.smithi053.stdout: "active_addr": "172.21.15.53:6801/1345161100", 2024-08-31T06:30:39.163 INFO:teuthology.orchestra.run.smithi053.stdout: "active_change": "2024-08-31T05:56:14.253774+0000", 2024-08-31T06:30:39.163 INFO:teuthology.orchestra.run.smithi053.stdout: "active_mgr_features": 4540701547738038271, 2024-08-31T06:30:39.163 INFO:teuthology.orchestra.run.smithi053.stdout: "available": true, 2024-08-31T06:30:39.163 INFO:teuthology.orchestra.run.smithi053.stdout: "standbys": [ 2024-08-31T06:30:39.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.163 INFO:teuthology.orchestra.run.smithi053.stdout: "gid": 24145, 2024-08-31T06:30:39.164 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "z", 2024-08-31T06:30:39.164 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_features": 4540701547738038271, 2024-08-31T06:30:39.164 INFO:teuthology.orchestra.run.smithi053.stdout: "available_modules": [ 2024-08-31T06:30:39.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.164 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "alerts", 2024-08-31T06:30:39.164 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.164 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.164 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.164 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:39.164 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:39.164 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.165 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.166 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.166 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.166 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.166 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.166 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.166 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.166 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.166 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.166 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.166 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.167 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.168 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.169 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.170 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.170 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.170 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.170 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.170 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.170 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.170 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.170 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.170 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.170 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_destination": { 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_destination", 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.171 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Email address to send alerts to", 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_from_name": { 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_from_name", 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.172 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "Ceph", 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Email From: name", 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_host": { 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_host", 2024-08-31T06:30:39.173 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP server", 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_password": { 2024-08-31T06:30:39.174 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_password", 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Password to authenticate with", 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_port": { 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_port", 2024-08-31T06:30:39.175 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.176 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.176 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.176 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "465", 2024-08-31T06:30:39.176 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.176 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.176 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.176 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP port", 2024-08-31T06:30:39.176 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.176 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.176 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_sender": { 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_sender", 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP envelope sender", 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.177 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_ssl": { 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_ssl", 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T06:30:39.178 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_user": { 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_user", 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "User to authenticate as", 2024-08-31T06:30:39.179 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.180 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "balancer", 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.181 INFO:teuthology.orchestra.run.smithi053.stdout: "active": { 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "active", 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.183 INFO:teuthology.orchestra.run.smithi053.stdout: "begin_time": { 2024-08-31T06:30:39.183 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "begin_time", 2024-08-31T06:30:39.183 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.183 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.183 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.183 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0000", 2024-08-31T06:30:39.183 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.183 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.183 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.183 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "begin_weekday": { 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "begin_weekday", 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0", 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "6", 2024-08-31T06:30:39.184 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_max_iterations": { 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_max_iterations", 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "25", 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "250", 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.185 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_metrics": { 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_metrics", 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.186 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_step": { 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_step", 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0.5", 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0.001", 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "0.999", 2024-08-31T06:30:39.187 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "aggressiveness of optimization", 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "end_time": { 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "end_time", 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "2359", 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.188 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "end_weekday": { 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "end_weekday", 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0", 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "6", 2024-08-31T06:30:39.189 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.190 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.191 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.192 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.193 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.194 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "min_score": { 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "min_score", 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.195 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": { 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mode", 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.196 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "upmap", 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "crush-compat", 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "none", 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "read", 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap", 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap-read" 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Balancer mode", 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_ids": { 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pool_ids", 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap_max_deviation": { 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "upmap_max_deviation", 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap_max_optimizations": { 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "upmap_max_optimizations", 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.202 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephadm", 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_down_multiplier": { 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_down_multiplier", 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.203 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3.0", 2024-08-31T06:30:39.204 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.204 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.204 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.204 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T06:30:39.204 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.204 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.204 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.204 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_refresh_rate": { 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_refresh_rate", 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "20", 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_starting_port": { 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_starting_port", 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "4721", 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_ptrace": { 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_ptrace", 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.207 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: "autotune_interval": { 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "autotune_interval", 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T06:30:39.208 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "autotune_memory_target_ratio": { 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0.7", 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.209 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T06:30:39.210 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.210 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.210 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.210 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm_log_destination": { 2024-08-31T06:30:39.210 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephadm_log_destination", 2024-08-31T06:30:39.210 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.210 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.210 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.210 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.210 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.211 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.211 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.211 INFO:teuthology.orchestra.run.smithi053.stdout: "file", 2024-08-31T06:30:39.211 INFO:teuthology.orchestra.run.smithi053.stdout: "file,syslog", 2024-08-31T06:30:39.211 INFO:teuthology.orchestra.run.smithi053.stdout: "syslog" 2024-08-31T06:30:39.211 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.211 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T06:30:39.211 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.211 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: "cgroups_split": { 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cgroups_split", 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.212 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "config_checks_enabled": { 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_checks_enabled", 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T06:30:39.213 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "config_dashboard": { 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_dashboard", 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.214 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_alertmanager": { 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_alertmanager", 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.216 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_base": { 2024-08-31T06:30:39.216 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_base", 2024-08-31T06:30:39.216 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.216 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.216 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.216 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T06:30:39.216 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.216 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.216 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.216 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Container image name, without the tag", 2024-08-31T06:30:39.216 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_elasticsearch": { 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_elasticsearch", 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.217 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "elasticsearch container image", 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_grafana": { 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_grafana", 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.218 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_haproxy": { 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_haproxy", 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.219 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "HAproxy container image", 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_agent": { 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_agent", 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.220 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger agent container image", 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_collector": { 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_collector", 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger collector container image", 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_query": { 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_query", 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.222 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger query container image", 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_keepalived": { 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_keepalived", 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T06:30:39.223 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Keepalived container image", 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_loki": { 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_loki", 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.224 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Loki container image", 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_nginx": { 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_nginx", 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.225 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Nginx container image", 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_node_exporter": { 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_node_exporter", 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T06:30:39.226 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_nvmeof": { 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_nvmeof", 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T06:30:39.227 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Nvme-of container image", 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_oauth2_proxy": { 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.228 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "oauth2-proxy container image", 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_prometheus": { 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_prometheus", 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.229 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_promtail": { 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_promtail", 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.230 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Promtail container image", 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_samba": { 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_samba", 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.231 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Samba/SMB container image", 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_snmp_gateway": { 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_snmp_gateway", 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.232 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SNMP Gateway container image", 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "container_init": { 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_init", 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.233 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "daemon_cache_timeout": { 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "daemon_cache_timeout", 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.234 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "default_cephadm_command_timeout": { 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.235 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.236 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.236 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "900", 2024-08-31T06:30:39.236 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.236 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.236 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.236 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T06:30:39.236 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.236 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.236 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.236 INFO:teuthology.orchestra.run.smithi053.stdout: "default_registry": { 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "default_registry", 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io", 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.237 INFO:teuthology.orchestra.run.smithi053.stdout: "device_cache_timeout": { 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_cache_timeout", 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1800", 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache device inventory", 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.238 INFO:teuthology.orchestra.run.smithi053.stdout: "device_enhanced_scan": { 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_enhanced_scan", 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "facts_cache_timeout": { 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "facts_cache_timeout", 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache host facts data", 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.240 INFO:teuthology.orchestra.run.smithi053.stdout: "grafana_dashboards_path": { 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "grafana_dashboards_path", 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "host_check_interval": { 2024-08-31T06:30:39.241 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "host_check_interval", 2024-08-31T06:30:39.242 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.242 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.242 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.242 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:39.242 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.242 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.242 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.242 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to perform a host check", 2024-08-31T06:30:39.242 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.242 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.242 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "hw_monitoring": { 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "hw_monitoring", 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "inventory_list_all": { 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "inventory_list_all", 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.245 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "log_refresh_metadata": { 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_refresh_metadata", 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.246 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.248 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.249 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.249 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.249 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.249 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.249 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.249 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.249 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.249 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.249 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.249 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T06:30:39.251 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "*", 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.252 INFO:teuthology.orchestra.run.smithi053.stdout: "max_count_per_host": { 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_count_per_host", 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "max number of daemons per service per host", 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "max_osd_draining_count": { 2024-08-31T06:30:39.253 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_osd_draining_count", 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "migration_current": { 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "migration_current", 2024-08-31T06:30:39.254 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "internal - do not modify", 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": { 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mode", 2024-08-31T06:30:39.255 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "root", 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm-package", 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "root" 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.256 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "oob_default_addr": { 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "oob_default_addr", 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "169.254.1.1", 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.257 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "prometheus_alerts_path": { 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prometheus_alerts_path", 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.258 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_insecure": { 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_insecure", 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.259 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.260 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_password": { 2024-08-31T06:30:39.260 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_password", 2024-08-31T06:30:39.260 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.260 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.260 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.260 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.261 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.261 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.261 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.261 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T06:30:39.261 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.262 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.262 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.262 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_url": { 2024-08-31T06:30:39.262 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_url", 2024-08-31T06:30:39.262 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.262 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_username": { 2024-08-31T06:30:39.263 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_username", 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "secure_monitoring_stack": { 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "secure_monitoring_stack", 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.266 INFO:teuthology.orchestra.run.smithi053.stdout: "service_discovery_port": { 2024-08-31T06:30:39.266 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "service_discovery_port", 2024-08-31T06:30:39.266 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.266 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.266 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.266 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8765", 2024-08-31T06:30:39.266 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.266 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "cephadm service discovery port", 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.267 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "ssh_config_file": { 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssh_config_file", 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.268 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "use_agent": { 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "use_agent", 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.269 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.270 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.270 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.270 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.270 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T06:30:39.270 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.270 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.270 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.270 INFO:teuthology.orchestra.run.smithi053.stdout: "use_repo_digest": { 2024-08-31T06:30:39.270 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "use_repo_digest", 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_failed_host_check": { 2024-08-31T06:30:39.271 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_failed_host_check", 2024-08-31T06:30:39.272 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.272 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.272 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.272 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.272 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.272 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.272 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.272 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T06:30:39.272 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.272 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.272 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_stray_daemons": { 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_stray_daemons", 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.273 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.274 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.274 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_stray_hosts": { 2024-08-31T06:30:39.274 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_stray_hosts", 2024-08-31T06:30:39.274 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.274 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.274 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.274 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.274 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.274 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crash", 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.275 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.276 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.277 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.277 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.277 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.277 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.277 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.277 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.277 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.277 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.277 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.277 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.278 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.279 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.280 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "retain_interval": { 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "retain_interval", 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "31536000", 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.281 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.282 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.283 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.283 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.283 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.283 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_recent_interval": { 2024-08-31T06:30:39.283 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_recent_interval", 2024-08-31T06:30:39.283 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.283 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.283 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.283 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1209600", 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "dashboard", 2024-08-31T06:30:39.284 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.285 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.285 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.285 INFO:teuthology.orchestra.run.smithi053.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T06:30:39.285 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T06:30:39.285 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.285 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.285 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.286 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.286 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.286 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.286 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.286 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.286 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.286 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.286 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.287 INFO:teuthology.orchestra.run.smithi053.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T06:30:39.287 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T06:30:39.287 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.287 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.287 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.288 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.288 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.288 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.288 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.288 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.288 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.288 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.289 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.289 INFO:teuthology.orchestra.run.smithi053.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T06:30:39.289 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T06:30:39.289 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.289 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.289 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.290 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.290 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.290 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.290 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.290 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.290 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.290 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.290 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.291 INFO:teuthology.orchestra.run.smithi053.stdout: "AUDIT_API_ENABLED": { 2024-08-31T06:30:39.291 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T06:30:39.291 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.291 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.291 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.291 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.291 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.292 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.292 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.292 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.292 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.292 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.292 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.292 INFO:teuthology.orchestra.run.smithi053.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T06:30:39.292 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T06:30:39.293 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.293 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.293 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.293 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.293 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.293 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.293 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.293 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.294 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.294 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.294 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.294 INFO:teuthology.orchestra.run.smithi053.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T06:30:39.294 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T06:30:39.294 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T06:30:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T06:30:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T06:30:39.297 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.297 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.297 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.297 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.297 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.297 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.297 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.297 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.297 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.297 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.298 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.300 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.301 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.302 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.303 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.304 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.305 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.305 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.305 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.305 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.305 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.305 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T06:30:39.305 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T06:30:39.305 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.305 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.305 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_URL": { 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_URL", 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.306 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.307 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.308 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T06:30:39.309 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.310 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.311 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.311 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.311 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.311 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.311 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.311 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.311 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.311 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.312 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.312 INFO:teuthology.orchestra.run.smithi053.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T06:30:39.312 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T06:30:39.312 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.312 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.312 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.312 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.312 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.312 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.312 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "[]", 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.313 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "{}", 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.314 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.315 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.316 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.317 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.318 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.319 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.320 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.321 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.322 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.323 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.324 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.325 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T06:30:39.326 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T06:30:39.327 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8", 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "45", 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.329 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.330 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.331 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.332 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.333 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.334 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.335 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.336 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.336 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.336 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.336 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.336 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.336 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.336 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.336 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T06:30:39.336 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T06:30:39.336 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T06:30:39.337 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "cross_origin_url": { 2024-08-31T06:30:39.338 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cross_origin_url", 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.339 INFO:teuthology.orchestra.run.smithi053.stdout: "crt_file": { 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crt_file", 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "debug": { 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "debug", 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable/disable debug options", 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.341 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "jwt_token_ttl": { 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "jwt_token_ttl", 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "28800", 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "key_file": { 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "key_file", 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.344 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.345 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.346 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.347 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.348 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "motd": { 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "motd", 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.349 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "The message of the day", 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "redirect_resolve_ip_addr": { 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.350 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "::", 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.351 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8080", 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.352 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.353 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl": { 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl", 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.354 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl_server_port": { 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl_server_port", 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8443", 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.355 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_behaviour": { 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_behaviour", 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "redirect", 2024-08-31T06:30:39.356 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: "redirect" 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_error_status_code": { 2024-08-31T06:30:39.357 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_error_status_code", 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "400", 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "599", 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.358 INFO:teuthology.orchestra.run.smithi053.stdout: "url_prefix": { 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "url_prefix", 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.359 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "devicehealth", 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_monitoring": { 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enable_monitoring", 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.360 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "monitor device health metrics", 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.361 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.362 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.363 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.364 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "mark_out_threshold": { 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mark_out_threshold", 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "2419200", 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": { 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pool_name", 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "device_health_metrics", 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "retention_period": { 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "retention_period", 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15552000", 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.369 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long to retain device health metrics", 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "scrape_frequency": { 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "scrape_frequency", 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "86400", 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.370 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.371 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.371 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T06:30:39.371 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.371 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.371 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.371 INFO:teuthology.orchestra.run.smithi053.stdout: "self_heal": { 2024-08-31T06:30:39.371 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "self_heal", 2024-08-31T06:30:39.371 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.371 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.371 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.372 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.372 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.372 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.372 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.372 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T06:30:39.372 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.372 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.372 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.372 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:39.372 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.373 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.374 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.374 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.374 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.374 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.374 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.374 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.374 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.374 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.374 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.375 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.375 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.375 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.375 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_threshold": { 2024-08-31T06:30:39.375 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_threshold", 2024-08-31T06:30:39.375 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.375 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.375 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.375 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "7257600", 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "diskprediction_local", 2024-08-31T06:30:39.376 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.377 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.378 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.378 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.378 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.378 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.378 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.378 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.378 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.378 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.378 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.378 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.379 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.380 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.381 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "predict_interval": { 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "predict_interval", 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.382 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "86400", 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: "predictor_model": { 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "predictor_model", 2024-08-31T06:30:39.383 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.384 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.384 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.384 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "prophetstor", 2024-08-31T06:30:39.384 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.384 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.384 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.384 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.384 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.384 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.384 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.385 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.386 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "influx", 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": false, 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "influxdb python module not found", 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: "batch_size": { 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "batch_size", 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.387 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5000", 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "database": { 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "database", 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "ceph", 2024-08-31T06:30:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T06:30:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": { 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "hostname", 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB server hostname", 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "30", 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "5", 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.391 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.392 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.393 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.394 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "password": { 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "password", 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "password of InfluxDB server user", 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.397 INFO:teuthology.orchestra.run.smithi053.stdout: "port": { 2024-08-31T06:30:39.398 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "port", 2024-08-31T06:30:39.398 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.398 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.398 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.398 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8086", 2024-08-31T06:30:39.398 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.398 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.398 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.398 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB server port", 2024-08-31T06:30:39.398 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.398 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.399 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl": { 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl", 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "false", 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.400 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "threads": { 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "threads", 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "32", 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.401 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "username": { 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "username", 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "username of InfluxDB server user", 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.402 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "verify_ssl": { 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "verify_ssl", 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "true", 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:30:39.403 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "insights", 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.404 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.405 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.405 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.405 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.405 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.405 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.405 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.405 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.405 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.405 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.405 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.406 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.407 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.408 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.409 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.410 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.411 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.411 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.411 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.411 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.411 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.411 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "iostat", 2024-08-31T06:30:39.411 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.411 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.411 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.412 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.412 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.412 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.412 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.412 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.412 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.412 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.412 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.412 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.412 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.412 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.413 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.413 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.413 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.413 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.413 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.413 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.413 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.413 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.413 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.413 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.414 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.415 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.416 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.417 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "k8sevents", 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_event_retention_days": { 2024-08-31T06:30:39.418 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ceph_event_retention_days", 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "7", 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "config_check_secs": { 2024-08-31T06:30:39.419 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_check_secs", 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "10", 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.420 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.421 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.422 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.423 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.424 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.425 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.426 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "localpool", 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: "failure_domain": { 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "failure_domain", 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.427 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "host", 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "failure domain for any created local pool", 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.428 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.429 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.430 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.431 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.432 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": { 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "min_size", 2024-08-31T06:30:39.433 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default min_size for any created local pool", 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "num_rep": { 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "num_rep", 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.434 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3", 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default replica count for any created local pool", 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": { 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pg_num", 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.435 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "128", 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "prefix": { 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prefix", 2024-08-31T06:30:39.436 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "name prefix for any created local pool", 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.437 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "subtree": { 2024-08-31T06:30:39.438 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "subtree", 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "rack", 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mds_autoscaler", 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.441 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.442 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.443 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.444 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.445 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.446 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.446 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.446 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.446 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.446 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.446 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.446 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.446 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mirroring", 2024-08-31T06:30:39.446 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.447 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.448 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.449 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.450 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.452 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "nfs", 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.453 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.454 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.457 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.458 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "orchestrator", 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: "fail_fs": { 2024-08-31T06:30:39.459 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "fail_fs", 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.460 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.461 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.462 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.463 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.465 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator": { 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "orchestrator", 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm", 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "rook", 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: "test_orchestrator" 2024-08-31T06:30:39.466 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Orchestrator backend", 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.467 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "osd_perf_query", 2024-08-31T06:30:39.468 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.469 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.471 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.471 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.471 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.471 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.471 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.471 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.471 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.471 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.471 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.471 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.472 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.473 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.474 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.475 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.475 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.475 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.475 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.475 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.475 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.475 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "osd_support", 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.477 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.478 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.479 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.480 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.481 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pg_autoscaler", 2024-08-31T06:30:39.482 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.483 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.484 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.484 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.484 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.484 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.484 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.484 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.484 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.484 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.484 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.485 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.486 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.487 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.488 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.489 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "threshold": { 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "threshold", 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3.0", 2024-08-31T06:30:39.490 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1.0", 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "scaling threshold", 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "progress", 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.491 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_pg_recovery_event": { 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_pg_recovery_event", 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "enabled": { 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enabled", 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.494 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.495 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.496 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.497 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.498 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "max_completed_events": { 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_completed_events", 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "50", 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "number of past completed events to remember", 2024-08-31T06:30:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long the module is going to sleep", 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.500 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.501 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prometheus", 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: "cache": { 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cache", 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.502 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: "exclude_perf_counters": { 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "exclude_perf_counters", 2024-08-31T06:30:39.503 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.504 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.505 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.505 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.505 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.505 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.505 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.505 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.505 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.505 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.505 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.505 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.506 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.507 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.508 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.509 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_stats_pools": { 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_stats_pools", 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.510 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T06:30:39.511 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.512 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.512 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.512 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "300", 2024-08-31T06:30:39.512 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.512 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.512 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.512 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.512 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.512 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "scrape_interval": { 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "scrape_interval", 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15.0", 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.513 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "::", 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.514 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "9283", 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.515 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.516 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "stale_cache_strategy": { 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "stale_cache_strategy", 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "log", 2024-08-31T06:30:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_behaviour": { 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_behaviour", 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "default", 2024-08-31T06:30:39.518 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: "default", 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: "error" 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_error_status_code": { 2024-08-31T06:30:39.519 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_error_status_code", 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "400", 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "599", 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.520 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_support", 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.521 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.523 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.524 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.524 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.524 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.524 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.524 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.524 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.524 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.524 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.524 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.524 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.525 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "max_concurrent_snap_create": { 2024-08-31T06:30:39.526 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_concurrent_snap_create", 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.527 INFO:teuthology.orchestra.run.smithi053.stdout: "mirror_snapshot_schedule": { 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "trash_purge_schedule": { 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "trash_purge_schedule", 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.530 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "restful", 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_auth": { 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enable_auth", 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.531 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "key_file": { 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "key_file", 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.532 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.533 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.534 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.535 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.536 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.537 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.537 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.537 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.537 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.537 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.537 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.537 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.537 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.537 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.537 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.538 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "max_requests": { 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_requests", 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.539 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.540 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.541 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.542 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.543 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rgw", 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.544 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.545 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.547 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.548 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.549 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.550 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rook", 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.552 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.553 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.554 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.555 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.556 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.557 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "storage_class": { 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "storage_class", 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.558 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.559 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.559 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "local", 2024-08-31T06:30:39.559 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.559 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.559 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.559 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "selftest", 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.560 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.561 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.562 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.562 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.562 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.562 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.562 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.562 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.562 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.562 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.562 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.562 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.563 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.564 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.565 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "roption1": { 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "roption1", 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.566 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "roption2": { 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "roption2", 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "xyz", 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.567 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.568 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.568 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.568 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.568 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.568 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.568 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption1": { 2024-08-31T06:30:39.568 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption1", 2024-08-31T06:30:39.568 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.568 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.568 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption2": { 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption2", 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.569 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption3": { 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption3", 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.570 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption4": { 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption4", 2024-08-31T06:30:39.571 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption5": { 2024-08-31T06:30:39.572 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption5", 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.573 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption6": { 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption6", 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.574 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption7": { 2024-08-31T06:30:39.575 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption7", 2024-08-31T06:30:39.575 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.575 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.575 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.575 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.575 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:39.575 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "42", 2024-08-31T06:30:39.575 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.575 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.575 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.575 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.576 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.576 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.576 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.576 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.576 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.576 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.576 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.576 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.576 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.576 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "testkey": { 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testkey", 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.577 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: "testlkey": { 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testlkey", 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.578 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "testnewline": { 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testnewline", 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.579 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.580 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.580 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.580 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.580 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.580 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.580 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.580 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.580 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.580 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smb", 2024-08-31T06:30:39.581 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.581 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.581 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.581 INFO:teuthology.orchestra.run.smithi053.stdout: "internal_store_backend": { 2024-08-31T06:30:39.581 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "internal_store_backend", 2024-08-31T06:30:39.581 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.581 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.581 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.581 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.581 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.582 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.583 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.584 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.584 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.584 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.584 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.584 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.584 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.584 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.584 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.584 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.585 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.586 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "update_orchestration": { 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "update_orchestration", 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.589 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snap_schedule", 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_m_granularity": { 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_m_granularity", 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.590 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "dump_on_update": { 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "dump_on_update", 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.591 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "dump database to debug log on update", 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.592 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.595 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.596 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.597 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "stats", 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.598 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.599 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.600 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.600 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.600 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.600 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.600 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.601 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.602 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.603 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.605 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.606 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.606 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "status", 2024-08-31T06:30:39.606 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.606 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.606 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.606 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.606 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.606 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.606 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.607 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.608 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.609 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.610 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.611 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "telegraf", 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: "address": { 2024-08-31T06:30:39.613 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "address", 2024-08-31T06:30:39.614 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.614 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.614 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.614 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T06:30:39.614 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.614 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.614 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.614 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.614 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.614 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.614 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15", 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.615 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.616 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.617 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.618 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.620 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.621 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "telemetry", 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_basic": { 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_basic", 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.622 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_crash": { 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_crash", 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.623 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.624 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T06:30:39.624 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.624 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.624 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.624 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_device": { 2024-08-31T06:30:39.624 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_device", 2024-08-31T06:30:39.624 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.624 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.624 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.624 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_ident": { 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_ident", 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.625 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_perf": { 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_perf", 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.626 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "contact": { 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "contact", 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.627 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "description": { 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "description", 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.628 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "device_url": { 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_url", 2024-08-31T06:30:39.629 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "enabled": { 2024-08-31T06:30:39.630 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enabled", 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.631 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "24", 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "8", 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.632 INFO:teuthology.orchestra.run.smithi053.stdout: "last_opt_revision": { 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "last_opt_revision", 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1", 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.633 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "leaderboard": { 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "leaderboard", 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.634 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "leaderboard_description": { 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "leaderboard_description", 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.635 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.636 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.637 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.638 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.639 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.639 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.639 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.639 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.639 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.639 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.639 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.639 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.639 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.639 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.640 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.641 INFO:teuthology.orchestra.run.smithi053.stdout: "organization": { 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "organization", 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "proxy": { 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "proxy", 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.644 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: "url": { 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "url", 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.645 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "test_orchestrator", 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.646 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.647 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.647 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.647 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.647 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.647 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.647 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.647 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.647 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.647 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.647 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.648 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.649 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.650 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.652 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.653 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.653 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-08-31T06:30:39.653 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.653 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.653 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.653 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.653 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.653 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.653 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.654 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.654 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.654 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.654 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.654 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.654 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.654 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.654 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.654 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.654 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.655 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.656 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.656 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.656 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.656 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.656 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.656 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.656 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.656 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.656 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.657 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.658 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "max_concurrent_clones": { 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_concurrent_clones", 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "4", 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.659 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.660 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T06:30:39.660 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.660 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.660 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.660 INFO:teuthology.orchestra.run.smithi053.stdout: "periodic_async_work": { 2024-08-31T06:30:39.660 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "periodic_async_work", 2024-08-31T06:30:39.660 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.660 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.660 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.660 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Periodically check for async work", 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot_clone_delay": { 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snapshot_clone_delay", 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.661 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot_clone_no_wait": { 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.662 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.663 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix", 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "discovery_interval": { 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "discovery_interval", 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "100", 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.665 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "identifier": { 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "identifier", 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.666 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.667 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.668 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.668 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.668 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.668 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.668 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.668 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.668 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.668 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.668 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.671 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_host": { 2024-08-31T06:30:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_host", 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_port": { 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_port", 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10051", 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.676 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.677 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.677 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_sender": { 2024-08-31T06:30:39.677 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_sender", 2024-08-31T06:30:39.677 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.677 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.677 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.677 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T06:30:39.677 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.677 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: "gid": 24173, 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "y", 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_features": 4540701547738038271, 2024-08-31T06:30:39.678 INFO:teuthology.orchestra.run.smithi053.stdout: "available_modules": [ 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "alerts", 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.679 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.680 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.681 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.681 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.681 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.681 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.681 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.681 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.681 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.681 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.681 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.681 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.681 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.682 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.683 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.684 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.685 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.685 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.685 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.685 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.685 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.685 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.685 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.685 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_destination": { 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_destination", 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.686 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Email address to send alerts to", 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_from_name": { 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_from_name", 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "Ceph", 2024-08-31T06:30:39.687 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Email From: name", 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_host": { 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_host", 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.688 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP server", 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_password": { 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_password", 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.689 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Password to authenticate with", 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_port": { 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_port", 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.690 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "465", 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP port", 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_sender": { 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_sender", 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.691 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP envelope sender", 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_ssl": { 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_ssl", 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.692 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_user": { 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_user", 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.693 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "User to authenticate as", 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.694 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.696 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "balancer", 2024-08-31T06:30:39.696 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.696 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.696 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.696 INFO:teuthology.orchestra.run.smithi053.stdout: "active": { 2024-08-31T06:30:39.696 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "active", 2024-08-31T06:30:39.696 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.696 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.696 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.696 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.696 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "begin_time": { 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "begin_time", 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.697 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0000", 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: "begin_weekday": { 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "begin_weekday", 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:39.698 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0", 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "6", 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_max_iterations": { 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_max_iterations", 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:39.699 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "25", 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "250", 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_metrics": { 2024-08-31T06:30:39.700 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_metrics", 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_step": { 2024-08-31T06:30:39.701 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_step", 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0.5", 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0.001", 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "0.999", 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "aggressiveness of optimization", 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "end_time": { 2024-08-31T06:30:39.702 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "end_time", 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "2359", 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "end_weekday": { 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "end_weekday", 2024-08-31T06:30:39.703 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0", 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "6", 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.705 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.706 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.706 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.706 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.706 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.706 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.706 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.706 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.706 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.706 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.707 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.708 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.709 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "min_score": { 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "min_score", 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.710 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": { 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mode", 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "upmap", 2024-08-31T06:30:39.711 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: "crush-compat", 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: "none", 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: "read", 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap", 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap-read" 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Balancer mode", 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.712 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.713 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_ids": { 2024-08-31T06:30:39.713 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pool_ids", 2024-08-31T06:30:39.713 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.713 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.713 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.713 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.713 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.713 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.713 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:39.714 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.715 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.715 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.715 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T06:30:39.715 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.715 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.715 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.715 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.715 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.715 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.715 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap_max_deviation": { 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "upmap_max_deviation", 2024-08-31T06:30:39.716 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap_max_optimizations": { 2024-08-31T06:30:39.717 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "upmap_max_optimizations", 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephadm", 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_down_multiplier": { 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_down_multiplier", 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3.0", 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.719 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_refresh_rate": { 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_refresh_rate", 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.720 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "20", 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_starting_port": { 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_starting_port", 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.721 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "4721", 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_ptrace": { 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_ptrace", 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.722 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: "autotune_interval": { 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "autotune_interval", 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.723 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: "autotune_memory_target_ratio": { 2024-08-31T06:30:39.724 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T06:30:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0.7", 2024-08-31T06:30:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T06:30:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm_log_destination": { 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephadm_log_destination", 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "file", 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "file,syslog", 2024-08-31T06:30:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: "syslog" 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "cgroups_split": { 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cgroups_split", 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "config_checks_enabled": { 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_checks_enabled", 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: "config_dashboard": { 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_dashboard", 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_alertmanager": { 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_alertmanager", 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_base": { 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_base", 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.731 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Container image name, without the tag", 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_elasticsearch": { 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_elasticsearch", 2024-08-31T06:30:39.732 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "elasticsearch container image", 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_grafana": { 2024-08-31T06:30:39.733 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_grafana", 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_haproxy": { 2024-08-31T06:30:39.734 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_haproxy", 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "HAproxy container image", 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_agent": { 2024-08-31T06:30:39.735 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_agent", 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger agent container image", 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_collector": { 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_collector", 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger collector container image", 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.738 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_query": { 2024-08-31T06:30:39.738 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_query", 2024-08-31T06:30:39.738 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.738 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.738 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.738 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T06:30:39.738 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.738 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.738 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.738 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger query container image", 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_keepalived": { 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_keepalived", 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.739 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Keepalived container image", 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_loki": { 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_loki", 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Loki container image", 2024-08-31T06:30:39.740 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_nginx": { 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_nginx", 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.741 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.742 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Nginx container image", 2024-08-31T06:30:39.742 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.742 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.742 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.742 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_node_exporter": { 2024-08-31T06:30:39.742 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_node_exporter", 2024-08-31T06:30:39.742 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.742 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.742 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_nvmeof": { 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_nvmeof", 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.743 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Nvme-of container image", 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_oauth2_proxy": { 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.744 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "oauth2-proxy container image", 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_prometheus": { 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_prometheus", 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.745 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.746 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T06:30:39.746 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.746 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.746 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.746 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:39.746 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.746 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.746 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.746 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_promtail": { 2024-08-31T06:30:39.746 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_promtail", 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Promtail container image", 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_samba": { 2024-08-31T06:30:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_samba", 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Samba/SMB container image", 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_snmp_gateway": { 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_snmp_gateway", 2024-08-31T06:30:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SNMP Gateway container image", 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "container_init": { 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_init", 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.749 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "daemon_cache_timeout": { 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "daemon_cache_timeout", 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.750 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "default_cephadm_command_timeout": { 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.751 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "900", 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "default_registry": { 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "default_registry", 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.752 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io", 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "device_cache_timeout": { 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_cache_timeout", 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.753 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1800", 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache device inventory", 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "device_enhanced_scan": { 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_enhanced_scan", 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.754 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "facts_cache_timeout": { 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "facts_cache_timeout", 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.755 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.756 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:39.756 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.756 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.756 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.756 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache host facts data", 2024-08-31T06:30:39.756 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.756 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.756 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.756 INFO:teuthology.orchestra.run.smithi053.stdout: "grafana_dashboards_path": { 2024-08-31T06:30:39.756 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "grafana_dashboards_path", 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "host_check_interval": { 2024-08-31T06:30:39.757 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "host_check_interval", 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to perform a host check", 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "hw_monitoring": { 2024-08-31T06:30:39.758 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "hw_monitoring", 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "inventory_list_all": { 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "inventory_list_all", 2024-08-31T06:30:39.759 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.761 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "log_refresh_metadata": { 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_refresh_metadata", 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.762 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.763 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.766 INFO:teuthology.orchestra.run.smithi053.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "*", 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.768 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "max_count_per_host": { 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_count_per_host", 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "max number of daemons per service per host", 2024-08-31T06:30:39.769 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "max_osd_draining_count": { 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_osd_draining_count", 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T06:30:39.770 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "migration_current": { 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "migration_current", 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "internal - do not modify", 2024-08-31T06:30:39.771 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.772 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.772 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.772 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": { 2024-08-31T06:30:39.772 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mode", 2024-08-31T06:30:39.772 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.772 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.772 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.772 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "root", 2024-08-31T06:30:39.772 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.772 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm-package", 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "root" 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "oob_default_addr": { 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "oob_default_addr", 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.773 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "169.254.1.1", 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "prometheus_alerts_path": { 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prometheus_alerts_path", 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.774 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_insecure": { 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_insecure", 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.775 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.776 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.776 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.776 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.776 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T06:30:39.776 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.776 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.776 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.776 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_password": { 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_password", 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.777 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_url": { 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_url", 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.778 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_username": { 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_username", 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T06:30:39.779 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "secure_monitoring_stack": { 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "secure_monitoring_stack", 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.780 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: "service_discovery_port": { 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "service_discovery_port", 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8765", 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.781 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "cephadm service discovery port", 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.782 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "ssh_config_file": { 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssh_config_file", 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.783 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "use_agent": { 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "use_agent", 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.784 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.785 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.785 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.785 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.785 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T06:30:39.785 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.785 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.785 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.785 INFO:teuthology.orchestra.run.smithi053.stdout: "use_repo_digest": { 2024-08-31T06:30:39.785 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "use_repo_digest", 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_failed_host_check": { 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_failed_host_check", 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.787 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_stray_daemons": { 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_stray_daemons", 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.788 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_stray_hosts": { 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_stray_hosts", 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.789 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crash", 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.790 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.793 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.794 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "retain_interval": { 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "retain_interval", 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "31536000", 2024-08-31T06:30:39.795 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.796 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_recent_interval": { 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_recent_interval", 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.797 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1209600", 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.798 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "dashboard", 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.799 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.800 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.801 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "AUDIT_API_ENABLED": { 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.802 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.803 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.804 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.805 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T06:30:39.806 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.807 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.810 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.812 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.813 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.813 INFO:teuthology.orchestra.run.smithi053.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T06:30:39.813 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T06:30:39.813 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.813 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.813 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.813 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.813 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-08-31T06:30:39.814 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.815 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_URL": { 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_URL", 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.816 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.817 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T06:30:39.818 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "[]", 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.823 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "{}", 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.824 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.825 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.825 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.825 INFO:teuthology.orchestra.run.smithi053.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T06:30:39.825 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T06:30:39.825 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.825 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.825 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.825 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.825 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.825 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.826 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.827 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.828 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.829 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.830 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.831 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.832 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.833 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.834 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T06:30:39.835 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.836 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8", 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "45", 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.839 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.840 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T06:30:39.841 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.842 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T06:30:39.843 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T06:30:39.844 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T06:30:39.845 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.846 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T06:30:39.847 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T06:30:39.847 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.847 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.847 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.847 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:39.847 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.847 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.847 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.847 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.847 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "cross_origin_url": { 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cross_origin_url", 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.848 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "crt_file": { 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crt_file", 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "debug": { 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "debug", 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable/disable debug options", 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.850 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "jwt_token_ttl": { 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "jwt_token_ttl", 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "28800", 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "key_file": { 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "key_file", 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.852 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.853 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.854 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.855 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.856 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.857 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: "motd": { 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "motd", 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.858 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "The message of the day", 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "redirect_resolve_ip_addr": { 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.859 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "::", 2024-08-31T06:30:39.860 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8080", 2024-08-31T06:30:39.861 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.862 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.862 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.862 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.862 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.862 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.862 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.862 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.863 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.863 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.863 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.863 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.863 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.864 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.864 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.864 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.864 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.864 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.864 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.865 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.865 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl": { 2024-08-31T06:30:39.865 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl", 2024-08-31T06:30:39.865 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.866 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.866 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.866 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.866 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.866 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.866 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.866 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.866 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.866 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl_server_port": { 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl_server_port", 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8443", 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.867 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_behaviour": { 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_behaviour", 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "redirect", 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.868 INFO:teuthology.orchestra.run.smithi053.stdout: "redirect" 2024-08-31T06:30:39.869 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.869 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.869 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.869 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.869 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.869 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_error_status_code": { 2024-08-31T06:30:39.869 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_error_status_code", 2024-08-31T06:30:39.869 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.869 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.869 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "400", 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "599", 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "url_prefix": { 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "url_prefix", 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.870 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "devicehealth", 2024-08-31T06:30:39.871 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_monitoring": { 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enable_monitoring", 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "monitor device health metrics", 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.872 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.873 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.874 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.875 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.876 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.876 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.876 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.876 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.876 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.876 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.876 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.876 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.876 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.876 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.877 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: "mark_out_threshold": { 2024-08-31T06:30:39.878 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mark_out_threshold", 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "2419200", 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": { 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pool_name", 2024-08-31T06:30:39.879 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "device_health_metrics", 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "retention_period": { 2024-08-31T06:30:39.880 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "retention_period", 2024-08-31T06:30:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15552000", 2024-08-31T06:30:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long to retain device health metrics", 2024-08-31T06:30:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.881 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.882 INFO:teuthology.orchestra.run.smithi053.stdout: "scrape_frequency": { 2024-08-31T06:30:39.882 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "scrape_frequency", 2024-08-31T06:30:39.882 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.882 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.883 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.883 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "86400", 2024-08-31T06:30:39.883 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.883 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.883 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.883 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T06:30:39.883 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.884 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.884 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.884 INFO:teuthology.orchestra.run.smithi053.stdout: "self_heal": { 2024-08-31T06:30:39.884 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "self_heal", 2024-08-31T06:30:39.884 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.884 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.885 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.885 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:39.885 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.885 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.885 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.885 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T06:30:39.885 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.887 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_threshold": { 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_threshold", 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.888 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "7257600", 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "diskprediction_local", 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.889 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.890 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.891 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.893 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.894 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "predict_interval": { 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "predict_interval", 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "86400", 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.895 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "predictor_model": { 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "predictor_model", 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "prophetstor", 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.896 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.897 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.897 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.897 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.897 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.897 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.897 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:39.897 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:39.897 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.897 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.897 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.898 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "influx", 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": false, 2024-08-31T06:30:39.899 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "influxdb python module not found", 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "batch_size": { 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "batch_size", 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5000", 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.900 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.901 INFO:teuthology.orchestra.run.smithi053.stdout: "database": { 2024-08-31T06:30:39.901 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "database", 2024-08-31T06:30:39.901 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.901 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.901 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.901 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "ceph", 2024-08-31T06:30:39.901 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.901 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.901 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.901 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": { 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "hostname", 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.902 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB server hostname", 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "30", 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "5", 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.903 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.904 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.905 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.906 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.907 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.907 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.907 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.907 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.907 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.907 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.907 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.907 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.907 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.907 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.908 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "password": { 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "password", 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.909 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "password of InfluxDB server user", 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "port": { 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "port", 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.910 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8086", 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB server port", 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.911 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl": { 2024-08-31T06:30:39.912 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl", 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "false", 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.914 INFO:teuthology.orchestra.run.smithi053.stdout: "threads": { 2024-08-31T06:30:39.914 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "threads", 2024-08-31T06:30:39.914 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.914 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.914 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.914 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:39.914 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:39.914 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "32", 2024-08-31T06:30:39.914 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.914 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "username": { 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "username", 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.915 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "username of InfluxDB server user", 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "verify_ssl": { 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "verify_ssl", 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "true", 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.916 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "insights", 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.917 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.918 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.919 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.920 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.920 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.920 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.920 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.920 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.920 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.920 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.920 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.920 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.920 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.921 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.922 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.923 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "iostat", 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.924 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.925 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.926 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.927 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.928 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.929 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.930 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "k8sevents", 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_event_retention_days": { 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ceph_event_retention_days", 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.931 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "7", 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "config_check_secs": { 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_check_secs", 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.932 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "10", 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.933 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.936 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.937 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.938 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.939 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "localpool", 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "failure_domain": { 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "failure_domain", 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "host", 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.940 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "failure domain for any created local pool", 2024-08-31T06:30:39.941 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T06:30:39.941 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.941 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.941 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.941 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.941 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.941 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.941 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.941 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.941 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.942 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.944 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.945 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": { 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "min_size", 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.946 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default min_size for any created local pool", 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "num_rep": { 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "num_rep", 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3", 2024-08-31T06:30:39.947 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default replica count for any created local pool", 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": { 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pg_num", 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "128", 2024-08-31T06:30:39.948 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "prefix": { 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prefix", 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.949 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.951 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "name prefix for any created local pool", 2024-08-31T06:30:39.952 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.952 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.952 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.952 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.952 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.952 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.953 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.953 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.953 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.953 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.953 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.953 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.953 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.953 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.953 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.953 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "subtree": { 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "subtree", 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "rack", 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T06:30:39.954 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.955 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.955 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.955 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.955 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mds_autoscaler", 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.956 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.957 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.958 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.959 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.960 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.961 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mirroring", 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.962 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.963 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.965 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.966 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.967 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "nfs", 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.969 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.970 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.971 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.972 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.973 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.974 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "orchestrator", 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "fail_fs": { 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "fail_fs", 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.975 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.976 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.977 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.978 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.979 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.980 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator": { 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "orchestrator", 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.981 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm", 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "rook", 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "test_orchestrator" 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Orchestrator backend", 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.982 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "osd_perf_query", 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.983 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.984 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.985 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.986 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.987 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.988 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.989 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "osd_support", 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.990 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.991 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.992 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.993 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.994 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:39.995 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:39.996 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pg_autoscaler", 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:39.997 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:39.998 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:39.999 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.000 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.001 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.002 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.003 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "threshold": { 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "threshold", 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3.0", 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1.0", 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "scaling threshold", 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T06:30:40.004 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "progress", 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_pg_recovery_event": { 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_pg_recovery_event", 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.005 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "enabled": { 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enabled", 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.006 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.007 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.009 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "max_completed_events": { 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_completed_events", 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "50", 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "number of past completed events to remember", 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long the module is going to sleep", 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prometheus", 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "cache": { 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cache", 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "exclude_perf_counters": { 2024-08-31T06:30:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "exclude_perf_counters", 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_stats_pools": { 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_stats_pools", 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "300", 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "scrape_interval": { 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "scrape_interval", 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15.0", 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "::", 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "9283", 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "stale_cache_strategy": { 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "stale_cache_strategy", 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "log", 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_behaviour": { 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_behaviour", 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "default", 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "default", 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "error" 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_error_status_code": { 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_error_status_code", 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-08-31T06:30:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "400", 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "599", 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_support", 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "max_concurrent_snap_create": { 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_concurrent_snap_create", 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "mirror_snapshot_schedule": { 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "trash_purge_schedule": { 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "trash_purge_schedule", 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "restful", 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_auth": { 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enable_auth", 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "key_file": { 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "key_file", 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "max_requests": { 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_requests", 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rgw", 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rook", 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "storage_class": { 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "storage_class", 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "local", 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T06:30:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "selftest", 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "roption1": { 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "roption1", 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "roption2": { 2024-08-31T06:30:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "roption2", 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "xyz", 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption1": { 2024-08-31T06:30:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption1", 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption2": { 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption2", 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption3": { 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption3", 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption4": { 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption4", 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption5": { 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption5", 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption6": { 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption6", 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption7": { 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption7", 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "42", 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "testkey": { 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testkey", 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "testlkey": { 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testlkey", 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "testnewline": { 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testnewline", 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smb", 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "internal_store_backend": { 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "internal_store_backend", 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "update_orchestration": { 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "update_orchestration", 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snap_schedule", 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_m_granularity": { 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_m_granularity", 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "dump_on_update": { 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "dump_on_update", 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "dump database to debug log on update", 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "stats", 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "status", 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "telegraf", 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "address": { 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "address", 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15", 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.123 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.124 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.125 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.126 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "telemetry", 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_basic": { 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_basic", 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.127 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_crash": { 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_crash", 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.128 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_device": { 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_device", 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.129 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_ident": { 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_ident", 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.130 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_perf": { 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_perf", 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.131 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "contact": { 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "contact", 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.132 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "description": { 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "description", 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.133 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "device_url": { 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_url", 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "enabled": { 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enabled", 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.135 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:40.136 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:40.137 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.137 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.137 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.137 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "24", 2024-08-31T06:30:40.137 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "8", 2024-08-31T06:30:40.137 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.137 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.137 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.137 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.137 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "last_opt_revision": { 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "last_opt_revision", 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1", 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "leaderboard": { 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "leaderboard", 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.139 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "leaderboard_description": { 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "leaderboard_description", 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.140 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.141 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.142 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.143 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.143 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.143 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.143 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.143 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.143 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.143 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.143 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.144 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.145 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "organization": { 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "organization", 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.146 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "proxy": { 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "proxy", 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.147 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.148 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "url": { 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "url", 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.149 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "test_orchestrator", 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.150 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.151 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.152 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.153 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.154 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.154 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.154 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.154 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.154 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.154 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.154 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.155 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.155 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.155 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.155 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.156 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.158 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.159 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.160 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.161 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "max_concurrent_clones": { 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_concurrent_clones", 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "4", 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: "periodic_async_work": { 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "periodic_async_work", 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Periodically check for async work", 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot_clone_delay": { 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snapshot_clone_delay", 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot_clone_no_wait": { 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.166 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.167 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix", 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "discovery_interval": { 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "discovery_interval", 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "100", 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.168 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "identifier": { 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "identifier", 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.169 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.170 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.171 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.172 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.173 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.174 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.175 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.176 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.177 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.177 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.177 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.177 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.177 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.177 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.177 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.177 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.177 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_host": { 2024-08-31T06:30:40.177 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_host", 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_port": { 2024-08-31T06:30:40.178 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_port", 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10051", 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.179 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_sender": { 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_sender", 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.180 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: "modules": [ 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm", 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: "dashboard", 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: "iostat", 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: "nfs", 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: "restful", 2024-08-31T06:30:40.181 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_schedule" 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: "available_modules": [ 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "alerts", 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.182 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.183 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.184 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.185 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.186 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.187 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_destination": { 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_destination", 2024-08-31T06:30:40.188 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Email address to send alerts to", 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_from_name": { 2024-08-31T06:30:40.189 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_from_name", 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "Ceph", 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Email From: name", 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_host": { 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_host", 2024-08-31T06:30:40.190 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP server", 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_password": { 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_password", 2024-08-31T06:30:40.191 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Password to authenticate with", 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.192 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_port": { 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_port", 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "465", 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP port", 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.193 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_sender": { 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_sender", 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP envelope sender", 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_ssl": { 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_ssl", 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.195 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_user": { 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_user", 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "User to authenticate as", 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.196 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.197 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "balancer", 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: "active": { 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "active", 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.198 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "begin_time": { 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "begin_time", 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.199 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0000", 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "begin_weekday": { 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "begin_weekday", 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.200 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0", 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "6", 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_max_iterations": { 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_max_iterations", 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.201 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "25", 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "250", 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_metrics": { 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_metrics", 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.202 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_step": { 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_step", 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.203 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0.5", 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0.001", 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "0.999", 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "aggressiveness of optimization", 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "end_time": { 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "end_time", 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.204 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "2359", 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "end_weekday": { 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "end_weekday", 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.205 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0", 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "6", 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.206 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.208 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.209 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.210 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: "min_score": { 2024-08-31T06:30:40.211 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "min_score", 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.212 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": { 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mode", 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "upmap", 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "crush-compat", 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "none", 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "read", 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap", 2024-08-31T06:30:40.213 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap-read" 2024-08-31T06:30:40.214 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.214 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Balancer mode", 2024-08-31T06:30:40.214 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.214 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.214 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.214 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_ids": { 2024-08-31T06:30:40.214 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pool_ids", 2024-08-31T06:30:40.214 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.214 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.214 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.215 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.216 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap_max_deviation": { 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "upmap_max_deviation", 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.217 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap_max_optimizations": { 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "upmap_max_optimizations", 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:40.218 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.219 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephadm", 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_down_multiplier": { 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_down_multiplier", 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3.0", 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T06:30:40.220 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_refresh_rate": { 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_refresh_rate", 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "20", 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.221 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_starting_port": { 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_starting_port", 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "4721", 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.222 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_ptrace": { 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_ptrace", 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T06:30:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "autotune_interval": { 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "autotune_interval", 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "autotune_memory_target_ratio": { 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0.7", 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T06:30:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm_log_destination": { 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephadm_log_destination", 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "file", 2024-08-31T06:30:40.226 INFO:teuthology.orchestra.run.smithi053.stdout: "file,syslog", 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "syslog" 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "cgroups_split": { 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cgroups_split", 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.227 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "config_checks_enabled": { 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_checks_enabled", 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.228 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "config_dashboard": { 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_dashboard", 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.229 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_alertmanager": { 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_alertmanager", 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.230 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_base": { 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_base", 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.231 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Container image name, without the tag", 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_elasticsearch": { 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_elasticsearch", 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.232 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "elasticsearch container image", 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_grafana": { 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_grafana", 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.233 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_haproxy": { 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_haproxy", 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.234 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "HAproxy container image", 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_agent": { 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_agent", 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T06:30:40.235 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger agent container image", 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_collector": { 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_collector", 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T06:30:40.236 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger collector container image", 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_query": { 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_query", 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T06:30:40.237 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger query container image", 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_keepalived": { 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_keepalived", 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.238 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Keepalived container image", 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_loki": { 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_loki", 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.239 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Loki container image", 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_nginx": { 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_nginx", 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.240 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Nginx container image", 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_node_exporter": { 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_node_exporter", 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T06:30:40.241 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_nvmeof": { 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_nvmeof", 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.242 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Nvme-of container image", 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_oauth2_proxy": { 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.243 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "oauth2-proxy container image", 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_prometheus": { 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_prometheus", 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.244 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_promtail": { 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_promtail", 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.245 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Promtail container image", 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_samba": { 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_samba", 2024-08-31T06:30:40.246 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Samba/SMB container image", 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_snmp_gateway": { 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_snmp_gateway", 2024-08-31T06:30:40.247 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SNMP Gateway container image", 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.248 INFO:teuthology.orchestra.run.smithi053.stdout: "container_init": { 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_init", 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "daemon_cache_timeout": { 2024-08-31T06:30:40.249 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "daemon_cache_timeout", 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "default_cephadm_command_timeout": { 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.250 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "900", 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "default_registry": { 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "default_registry", 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.251 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io", 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "device_cache_timeout": { 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_cache_timeout", 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.252 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.253 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1800", 2024-08-31T06:30:40.253 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.253 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.253 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.253 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache device inventory", 2024-08-31T06:30:40.253 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.253 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.253 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.253 INFO:teuthology.orchestra.run.smithi053.stdout: "device_enhanced_scan": { 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_enhanced_scan", 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "facts_cache_timeout": { 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "facts_cache_timeout", 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache host facts data", 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.255 INFO:teuthology.orchestra.run.smithi053.stdout: "grafana_dashboards_path": { 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "grafana_dashboards_path", 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "host_check_interval": { 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "host_check_interval", 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to perform a host check", 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.257 INFO:teuthology.orchestra.run.smithi053.stdout: "hw_monitoring": { 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "hw_monitoring", 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.258 INFO:teuthology.orchestra.run.smithi053.stdout: "inventory_list_all": { 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "inventory_list_all", 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.259 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.260 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "log_refresh_metadata": { 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_refresh_metadata", 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.261 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.262 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.263 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "*", 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.267 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "max_count_per_host": { 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_count_per_host", 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "max number of daemons per service per host", 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "max_osd_draining_count": { 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_osd_draining_count", 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.269 INFO:teuthology.orchestra.run.smithi053.stdout: "migration_current": { 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "migration_current", 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "internal - do not modify", 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": { 2024-08-31T06:30:40.270 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mode", 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "root", 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm-package", 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "root" 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.271 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "oob_default_addr": { 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "oob_default_addr", 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "169.254.1.1", 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.272 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "prometheus_alerts_path": { 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prometheus_alerts_path", 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.273 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_insecure": { 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_insecure", 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_password": { 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_password", 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.275 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_url": { 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_url", 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.276 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_username": { 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_username", 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.277 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "secure_monitoring_stack": { 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "secure_monitoring_stack", 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.278 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "service_discovery_port": { 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "service_discovery_port", 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8765", 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.279 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "cephadm service discovery port", 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.280 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "ssh_config_file": { 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssh_config_file", 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.281 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "use_agent": { 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "use_agent", 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.282 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "use_repo_digest": { 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "use_repo_digest", 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.283 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_failed_host_check": { 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_failed_host_check", 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.284 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_stray_daemons": { 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_stray_daemons", 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.285 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_stray_hosts": { 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_stray_hosts", 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.286 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crash", 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.287 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.288 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.289 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.290 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "retain_interval": { 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "retain_interval", 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "31536000", 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.293 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.294 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_recent_interval": { 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_recent_interval", 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1209600", 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.295 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "dashboard", 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.296 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.297 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.298 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "AUDIT_API_ENABLED": { 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.300 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.301 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.302 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.303 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.304 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.305 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.306 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.308 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_URL": { 2024-08-31T06:30:40.311 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_URL", 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.312 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.313 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T06:30:40.314 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T06:30:40.315 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T06:30:40.316 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T06:30:40.317 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "[]", 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T06:30:40.318 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "{}", 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.319 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.320 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T06:30:40.321 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T06:30:40.322 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T06:30:40.323 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T06:30:40.324 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T06:30:40.325 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.329 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.330 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8", 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.332 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "45", 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.334 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.335 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.337 INFO:teuthology.orchestra.run.smithi053.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.338 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.339 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T06:30:40.340 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "cross_origin_url": { 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cross_origin_url", 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.341 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "crt_file": { 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crt_file", 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.342 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "debug": { 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "debug", 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.343 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable/disable debug options", 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "jwt_token_ttl": { 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "jwt_token_ttl", 2024-08-31T06:30:40.344 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "28800", 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "key_file": { 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "key_file", 2024-08-31T06:30:40.345 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.346 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.347 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.348 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.349 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.350 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.351 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: "motd": { 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "motd", 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "The message of the day", 2024-08-31T06:30:40.352 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "redirect_resolve_ip_addr": { 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.353 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "::", 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.354 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8080", 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.355 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.356 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl": { 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl", 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl_server_port": { 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl_server_port", 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8443", 2024-08-31T06:30:40.358 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_behaviour": { 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_behaviour", 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "redirect", 2024-08-31T06:30:40.359 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: "redirect" 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_error_status_code": { 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_error_status_code", 2024-08-31T06:30:40.360 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "400", 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "599", 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.361 INFO:teuthology.orchestra.run.smithi053.stdout: "url_prefix": { 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "url_prefix", 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.362 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "devicehealth", 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_monitoring": { 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enable_monitoring", 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.363 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "monitor device health metrics", 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.364 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.365 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.366 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.367 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.368 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.369 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: "mark_out_threshold": { 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mark_out_threshold", 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "2419200", 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T06:30:40.370 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": { 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pool_name", 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "device_health_metrics", 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T06:30:40.371 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "retention_period": { 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "retention_period", 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15552000", 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.372 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long to retain device health metrics", 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "scrape_frequency": { 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "scrape_frequency", 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "86400", 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T06:30:40.373 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "self_heal": { 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "self_heal", 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T06:30:40.374 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T06:30:40.375 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.376 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_threshold": { 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_threshold", 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "7257600", 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "diskprediction_local", 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.378 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.379 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.380 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.381 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.382 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "predict_interval": { 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "predict_interval", 2024-08-31T06:30:40.383 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "86400", 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "predictor_model": { 2024-08-31T06:30:40.384 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "predictor_model", 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "prophetstor", 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.385 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.386 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "influx", 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": false, 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "influxdb python module not found", 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "batch_size": { 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "batch_size", 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5000", 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.388 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "database": { 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "database", 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "ceph", 2024-08-31T06:30:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": { 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "hostname", 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB server hostname", 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "30", 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "5", 2024-08-31T06:30:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "password": { 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "password", 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "password of InfluxDB server user", 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "port": { 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "port", 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8086", 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB server port", 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl": { 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl", 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "false", 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "threads": { 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "threads", 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "32", 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "username": { 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "username", 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "username of InfluxDB server user", 2024-08-31T06:30:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "verify_ssl": { 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "verify_ssl", 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "true", 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "insights", 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "iostat", 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "k8sevents", 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_event_retention_days": { 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ceph_event_retention_days", 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "7", 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "config_check_secs": { 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_check_secs", 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "10", 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "localpool", 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "failure_domain": { 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "failure_domain", 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "host", 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "failure domain for any created local pool", 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T06:30:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": { 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "min_size", 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default min_size for any created local pool", 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "num_rep": { 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "num_rep", 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3", 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default replica count for any created local pool", 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": { 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pg_num", 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "128", 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "prefix": { 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prefix", 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "name prefix for any created local pool", 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "subtree": { 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "subtree", 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "rack", 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mds_autoscaler", 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mirroring", 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "nfs", 2024-08-31T06:30:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "orchestrator", 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "fail_fs": { 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "fail_fs", 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator": { 2024-08-31T06:30:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "orchestrator", 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm", 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "rook", 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "test_orchestrator" 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Orchestrator backend", 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "osd_perf_query", 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "osd_support", 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pg_autoscaler", 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "threshold": { 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "threshold", 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3.0", 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1.0", 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "scaling threshold", 2024-08-31T06:30:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "progress", 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_pg_recovery_event": { 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_pg_recovery_event", 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "enabled": { 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enabled", 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "max_completed_events": { 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_completed_events", 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "50", 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "number of past completed events to remember", 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long the module is going to sleep", 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prometheus", 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "cache": { 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cache", 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "exclude_perf_counters": { 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "exclude_perf_counters", 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_stats_pools": { 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_stats_pools", 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "300", 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "scrape_interval": { 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "scrape_interval", 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15.0", 2024-08-31T06:30:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "::", 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "9283", 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "stale_cache_strategy": { 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "stale_cache_strategy", 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "log", 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_behaviour": { 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_behaviour", 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "default", 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "default", 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "error" 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_error_status_code": { 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_error_status_code", 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "400", 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "599", 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_support", 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "max_concurrent_snap_create": { 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_concurrent_snap_create", 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "mirror_snapshot_schedule": { 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "trash_purge_schedule": { 2024-08-31T06:30:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "trash_purge_schedule", 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "restful", 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_auth": { 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enable_auth", 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "key_file": { 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "key_file", 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "max_requests": { 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_requests", 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rgw", 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rook", 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "storage_class": { 2024-08-31T06:30:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "storage_class", 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "local", 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "selftest", 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "roption1": { 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "roption1", 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "roption2": { 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "roption2", 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "xyz", 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption1": { 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption1", 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption2": { 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption2", 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption3": { 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption3", 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.561 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption4": { 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption4", 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.562 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption5": { 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption5", 2024-08-31T06:30:40.563 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption6": { 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption6", 2024-08-31T06:30:40.564 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption7": { 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption7", 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.565 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.566 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.566 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.566 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-08-31T06:30:40.566 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "42", 2024-08-31T06:30:40.566 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.566 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.566 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.566 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.568 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "testkey": { 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testkey", 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.569 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: "testlkey": { 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testlkey", 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.570 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "testnewline": { 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testnewline", 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.571 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smb", 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.572 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "internal_store_backend": { 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "internal_store_backend", 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.573 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.574 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.575 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.576 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.577 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.578 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.579 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "update_orchestration": { 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "update_orchestration", 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T06:30:40.580 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snap_schedule", 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_m_granularity": { 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_m_granularity", 2024-08-31T06:30:40.581 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.582 INFO:teuthology.orchestra.run.smithi053.stdout: "dump_on_update": { 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "dump_on_update", 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "dump database to debug log on update", 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.583 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.584 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.585 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.586 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.587 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.588 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.589 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "stats", 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.590 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.592 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.593 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.594 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.595 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.596 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "status", 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.597 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.598 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.599 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.601 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.602 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "telegraf", 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "address": { 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "address", 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.603 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15", 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.604 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.605 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.606 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.607 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.608 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.609 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.610 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "telemetry", 2024-08-31T06:30:40.611 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_basic": { 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_basic", 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T06:30:40.612 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_crash": { 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_crash", 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.613 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_device": { 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_device", 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.614 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_ident": { 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_ident", 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.615 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_perf": { 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_perf", 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.616 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: "contact": { 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "contact", 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.617 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "description": { 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "description", 2024-08-31T06:30:40.618 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "device_url": { 2024-08-31T06:30:40.619 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_url", 2024-08-31T06:30:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T06:30:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.620 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "enabled": { 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enabled", 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.621 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "24", 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "8", 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.622 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "last_opt_revision": { 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "last_opt_revision", 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1", 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.623 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "leaderboard": { 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "leaderboard", 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.624 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "leaderboard_description": { 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "leaderboard_description", 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.625 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.626 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.627 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.628 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "organization": { 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "organization", 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "proxy": { 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "proxy", 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "url": { 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "url", 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "test_orchestrator", 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "max_concurrent_clones": { 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_concurrent_clones", 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "4", 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T06:30:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "periodic_async_work": { 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "periodic_async_work", 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Periodically check for async work", 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot_clone_delay": { 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snapshot_clone_delay", 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot_clone_no_wait": { 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.649 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix", 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "discovery_interval": { 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "discovery_interval", 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "100", 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.651 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "identifier": { 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "identifier", 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.652 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.653 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.654 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.655 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.656 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-08-31T06:30:40.657 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "sqlite3_killpoint": { 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:30:40.658 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "dev", 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_host": { 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_host", 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.659 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_port": { 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_port", 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.660 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10051", 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_sender": { 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_sender", 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T06:30:40.661 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: "services": { 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: "dashboard": "https://172.21.15.53:8443/" 2024-08-31T06:30:40.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "always_on_modules": { 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "octopus": [ 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "balancer", 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "crash", 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "devicehealth", 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator", 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscaler", 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "progress", 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_support", 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "status", 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "telemetry", 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "volumes" 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.663 INFO:teuthology.orchestra.run.smithi053.stdout: "pacific": [ 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "balancer", 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "crash", 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "devicehealth", 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator", 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscaler", 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "progress", 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_support", 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "status", 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "telemetry", 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "volumes" 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "quincy": [ 2024-08-31T06:30:40.664 INFO:teuthology.orchestra.run.smithi053.stdout: "balancer", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "crash", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "devicehealth", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscaler", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "progress", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_support", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "status", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "telemetry", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "volumes" 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "reef": [ 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "balancer", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "crash", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "devicehealth", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator", 2024-08-31T06:30:40.665 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscaler", 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "progress", 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_support", 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "status", 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "telemetry", 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "volumes" 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "squid": [ 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "balancer", 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "crash", 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "devicehealth", 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator", 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscaler", 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "progress", 2024-08-31T06:30:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_support", 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: "status", 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: "telemetry", 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: "volumes" 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: "last_failure_osd_epoch": 5, 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: "active_clients": [ 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "devicehealth", 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:0", 2024-08-31T06:30:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1278905576 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "libcephsqlite", 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:0", 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1540260730 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_support", 2024-08-31T06:30:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:0", 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4057719034 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snap_schedule", 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:0", 2024-08-31T06:30:40.669 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2262178340 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snap_schedule", 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:0", 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3540289935 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T06:30:40.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:0", 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3487714730 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-08-31T06:30:40.671 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:30:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 -- 172.21.15.53:0/2242983358 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde3c0b4ca0 msgr2=0x7fde3c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde3c0b4ca0 0x7fde3c0b71b0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000c00 tx=0x7fde4c009680 comp rx=0 tx=0).stop 2024-08-31T06:30:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 -- 172.21.15.53:0/2242983358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde54104ff0 msgr2=0x7fde5419a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:30:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde54104ff0 0x7fde5419a6a0 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d950 tx=0x7fde4800de10 comp rx=0 tx=0).stop 2024-08-31T06:30:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 -- 172.21.15.53:0/2242983358 shutdown_connections 2024-08-31T06:30:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fde3c0b4ca0 0x7fde3c0b71b0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde5410db00 0x7fde5419f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde54104ff0 0x7fde5419a6a0 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 --2- 172.21.15.53:0/2242983358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde541046a0 0x7fde5419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:30:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 -- 172.21.15.53:0/2242983358 >> 172.21.15.53:0/2242983358 conn(0x7fde540fe1b0 msgr2=0x7fde54107670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:30:40.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 -- 172.21.15.53:0/2242983358 shutdown_connections 2024-08-31T06:30:40.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:30:39.154+0000 7fde5c19b640 1 -- 172.21.15.53:0/2242983358 wait complete. 2024-08-31T06:30:40.680 DEBUG:tasks.check_counter:Getting stats from a 2024-08-31T06:30:40.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-31T06:30:40.680 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:39 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3640582918' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:30:40.680 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:39 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3036798349' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:30:40.680 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:39 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3482126592' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:30:40.681 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:40 smithi053 ceph-mon[18924]: pgmap v1134: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 61 KiB/s wr, 25 op/s 2024-08-31T06:30:40.681 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:40 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2242983358' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T06:30:40.682 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:39 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3640582918' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:30:40.682 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:39 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3036798349' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:30:40.682 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:39 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3482126592' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:30:40.682 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:40 smithi153 ceph-mon[22320]: pgmap v1134: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 61 KiB/s wr, 25 op/s 2024-08-31T06:30:40.682 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:40 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2242983358' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T06:30:40.682 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:39 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3640582918' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:30:40.682 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:39 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3036798349' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:30:40.682 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:39 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3482126592' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:30:40.682 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:40 smithi130 ceph-mon[22266]: pgmap v1134: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 61 KiB/s wr, 25 op/s 2024-08-31T06:30:40.682 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:40 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2242983358' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T06:30:40.945 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:42.149 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:42 smithi053 ceph-mon[18924]: pgmap v1135: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-08-31T06:30:42.192 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:30:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:30:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 3017, 2024-08-31T06:30:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 3019, 2024-08-31T06:30:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 55434395, 2024-08-31T06:30:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 959407, 2024-08-31T06:30:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 8, 2024-08-31T06:30:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 4, 2024-08-31T06:30:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.353599397, 2024-08-31T06:30:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.136083983, 2024-08-31T06:30:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.108824475, 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.086389207, 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 3017, 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.091262118, 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000030249 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:30:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 1946, 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 2289, 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 101168566, 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 1322370, 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 7, 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 6, 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.283482105, 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.099725395, 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.114626798, 2024-08-31T06:30:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.053170412, 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 2287, 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.067503125, 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000029516 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T06:30:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 703792 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 1352, 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 1277, 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 52810196, 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 535108, 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 6, 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 4, 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.182833798, 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.071582229, 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.096996638, 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.020313472, 2024-08-31T06:30:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 1277, 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.049986996, 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000039144 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 1402912, 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 288976 2024-08-31T06:30:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "cct": { 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "total_workers": 1, 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "unhealthy_workers": 0 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-MDSRank": { 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 9668, 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.246661343, 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000025513 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-PurgeQueue": { 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "request": 0, 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "reply": 0, 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "reply_latency": { 2024-08-31T06:30:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_reply": 0, 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "forward": 0, 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_complete": 0, 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_keys": 0, 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_commit": 0, 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_split": 0, 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_merge": 0, 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes": 8090, 2024-08-31T06:30:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_top": 0, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_bottom": 8090, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pin_tail": 0, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pinned": 8090, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_expired": 0, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_with_caps": 0, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": 0, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "subtrees": 1, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse": 0, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_hit": 0, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_forward": 0, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_discover": 0, 2024-08-31T06:30:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_remote_ino": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_lock": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "load_cent": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "q": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "exported": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "exported_inodes": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "imported": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "imported_inodes": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_dir_fetch": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_backtrace_fetch": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_peer_discover": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rfiles": 0, 2024-08-31T06:30:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rbytes": 0, 2024-08-31T06:30:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rsnaps": 0, 2024-08-31T06:30:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T06:30:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_set_tag": 0, 2024-08-31T06:30:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:30:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:30:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_inodes": 0, 2024-08-31T06:30:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:30:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T06:30:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_file_inodes": 0, 2024-08-31T06:30:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_inode_file_caps": 0, 2024-08-31T06:30:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_grant": 0, 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps": 0, 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps_dirty": 0, 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_cap_release": 0, 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "process_request_cap_release": 0 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache": { 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update": 0, 2024-08-31T06:30:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update_receipt": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_try_discover": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_send_discover": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_handle_discover": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_delayed": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_created": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_enqueued": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_reintegrated": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_migrated": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_processing": 0, 2024-08-31T06:30:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_started": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_completed": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_quiesce_path": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_quiesce_inode": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_exportdir": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_flush": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragmentdir": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragstats": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_inodestats": 0, 2024-08-31T06:30:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_succeeded": 0, 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_write_failed": 0 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log": { 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "evlrg": 0, 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "evadd": 0, 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "evex": 0, 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "evtrm": 0, 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "ev": 43285, 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "evexg": 0, 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "evexd": 0, 2024-08-31T06:30:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "segadd": 0, 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "segex": 0, 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "segtrm": 0, 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "seg": 67, 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "segmjr": 5, 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "segexg": 0, 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "segexd": 0, 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "expos": 4194304, 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "wrpos": 210585911, 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "rdpos": 210583085, 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "jlat": { 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "replayed": 43285 2024-08-31T06:30:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_mem": { 2024-08-31T06:30:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "ino": 1588, 2024-08-31T06:30:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "ino+": 8003, 2024-08-31T06:30:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "ino-": 6415, 2024-08-31T06:30:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "dir": 59, 2024-08-31T06:30:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "dir+": 86, 2024-08-31T06:30:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "dir-": 27, 2024-08-31T06:30:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "dn": 8090, 2024-08-31T06:30:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "dn+": 8287, 2024-08-31T06:30:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "dn-": 197, 2024-08-31T06:30:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "cap": 0, 2024-08-31T06:30:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "cap+": 0, 2024-08-31T06:30:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "cap-": 0, 2024-08-31T06:30:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "rss": 131660, 2024-08-31T06:30:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "heap": 335503360 2024-08-31T06:30:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_server": { 2024-08-31T06:30:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_client_request": 0, 2024-08-31T06:30:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_server_request": 0, 2024-08-31T06:30:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_request": 0, 2024-08-31T06:30:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_session": 0, 2024-08-31T06:30:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_peer_request": 0, 2024-08-31T06:30:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "req_create_latency": { 2024-08-31T06:30:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getattr_latency": { 2024-08-31T06:30:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getfilelock_latency": { 2024-08-31T06:30:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "req_link_latency": { 2024-08-31T06:30:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookup_latency": { 2024-08-31T06:30:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookuphash_latency": { 2024-08-31T06:30:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupino_latency": { 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupname_latency": { 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupparent_latency": { 2024-08-31T06:30:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupsnap_latency": { 2024-08-31T06:30:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lssnap_latency": { 2024-08-31T06:30:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mkdir_latency": { 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mknod_latency": { 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mksnap_latency": { 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "req_open_latency": { 2024-08-31T06:30:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "req_readdir_latency": { 2024-08-31T06:30:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rename_latency": { 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "req_renamesnap_latency": { 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "req_snapdiff_latency": { 2024-08-31T06:30:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmdir_latency": { 2024-08-31T06:30:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmsnap_latency": { 2024-08-31T06:30:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmxattr_latency": { 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setattr_latency": { 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setdirlayout_latency": { 2024-08-31T06:30:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setfilelock_latency": { 2024-08-31T06:30:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.224 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setlayout_latency": { 2024-08-31T06:30:42.224 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.224 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.224 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.224 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setxattr_latency": { 2024-08-31T06:30:42.224 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.224 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.224 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.224 INFO:teuthology.orchestra.run.smithi053.stdout: "req_symlink_latency": { 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: "req_unlink_latency": { 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:30:42.225 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getvxattr_latency": { 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_sessions": { 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: "session_count": 2, 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: "session_add": 2, 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: "session_remove": 0, 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_open": 2, 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_stale": 0, 2024-08-31T06:30:42.226 INFO:teuthology.orchestra.run.smithi053.stdout: "total_load": 0, 2024-08-31T06:30:42.227 INFO:teuthology.orchestra.run.smithi053.stdout: "average_load": 0, 2024-08-31T06:30:42.227 INFO:teuthology.orchestra.run.smithi053.stdout: "avg_session_uptime": 2577, 2024-08-31T06:30:42.227 INFO:teuthology.orchestra.run.smithi053.stdout: "mdthresh_evicted": 0 2024-08-31T06:30:42.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.227 INFO:teuthology.orchestra.run.smithi053.stdout: "mempool": { 2024-08-31T06:30:42.227 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:30:42.227 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_items": 0, 2024-08-31T06:30:42.227 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:30:42.227 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:30:42.227 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:30:42.227 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:30:42.228 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:30:42.228 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:30:42.228 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:30:42.228 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:30:42.228 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:30:42.228 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:30:42.228 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:30:42.228 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:30:42.228 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:30:42.228 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_items": 0, 2024-08-31T06:30:42.228 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:30:42.229 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_items": 0, 2024-08-31T06:30:42.229 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:30:42.229 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:30:42.229 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:30:42.229 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:30:42.229 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:30:42.229 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:30:42.229 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:30:42.229 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_items": 0, 2024-08-31T06:30:42.229 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:30:42.230 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:30:42.230 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:30:42.230 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_items": 0, 2024-08-31T06:30:42.230 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_bytes": 0, 2024-08-31T06:30:42.230 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_items": 0, 2024-08-31T06:30:42.230 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:30:42.230 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:30:42.230 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:30:42.230 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:30:42.230 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_bytes": 241863, 2024-08-31T06:30:42.230 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_items": 86, 2024-08-31T06:30:42.231 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:30:42.231 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_items": 0, 2024-08-31T06:30:42.231 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bytes": 0, 2024-08-31T06:30:42.231 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_items": 0, 2024-08-31T06:30:42.231 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:30:42.231 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_items": 0, 2024-08-31T06:30:42.231 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:30:42.231 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_items": 0, 2024-08-31T06:30:42.231 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_bytes": 8352, 2024-08-31T06:30:42.231 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_items": 184, 2024-08-31T06:30:42.231 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_bytes": 0, 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_items": 0, 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_bytes": 9172590, 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_items": 40018, 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_bytes": 0, 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_items": 0, 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_bytes": 0, 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_items": 0 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter": { 2024-08-31T06:30:42.232 INFO:teuthology.orchestra.run.smithi053.stdout: "op_active": 0, 2024-08-31T06:30:42.233 INFO:teuthology.orchestra.run.smithi053.stdout: "op_laggy": 0, 2024-08-31T06:30:42.233 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send": 5736, 2024-08-31T06:30:42.233 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send_bytes": 21, 2024-08-31T06:30:42.233 INFO:teuthology.orchestra.run.smithi053.stdout: "op_resend": 3, 2024-08-31T06:30:42.233 INFO:teuthology.orchestra.run.smithi053.stdout: "op_reply": 5736, 2024-08-31T06:30:42.233 INFO:teuthology.orchestra.run.smithi053.stdout: "op_latency": { 2024-08-31T06:30:42.233 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 5736, 2024-08-31T06:30:42.233 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 5.094895937, 2024-08-31T06:30:42.233 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000888231 2024-08-31T06:30:42.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: "op_inflight": 0, 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: "oplen_avg": { 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 5736, 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 5737 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: "op": 5736, 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: "op_r": 5736, 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: "op_w": 0, 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: "op_rmw": 0, 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: "op_pg": 0, 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_stat": 3290, 2024-08-31T06:30:42.234 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_create": 0, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_read": 2444, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_write": 0, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writefull": 0, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writesame": 0, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_append": 0, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_zero": 0, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_truncate": 0, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_delete": 0, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_mapext": 0, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_sparse_read": 0, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_clonerange": 0, 2024-08-31T06:30:42.235 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_getxattr": 1, 2024-08-31T06:30:42.236 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_setxattr": 0, 2024-08-31T06:30:42.236 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:30:42.236 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_rmxattr": 0, 2024-08-31T06:30:42.236 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:30:42.236 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_call": 0, 2024-08-31T06:30:42.236 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_watch": 0, 2024-08-31T06:30:42.236 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_notify": 0, 2024-08-31T06:30:42.236 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:30:42.236 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls": 0, 2024-08-31T06:30:42.236 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:30:42.236 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_other": 0, 2024-08-31T06:30:42.237 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_active": 0, 2024-08-31T06:30:42.237 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_send": 0, 2024-08-31T06:30:42.237 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_resend": 0, 2024-08-31T06:30:42.237 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_ping": 0, 2024-08-31T06:30:42.237 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_active": 0, 2024-08-31T06:30:42.237 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_send": 0, 2024-08-31T06:30:42.237 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_resend": 0, 2024-08-31T06:30:42.237 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_active": 0, 2024-08-31T06:30:42.237 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_send": 0, 2024-08-31T06:30:42.237 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_resend": 0, 2024-08-31T06:30:42.237 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_active": 0, 2024-08-31T06:30:42.238 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_send": 0, 2024-08-31T06:30:42.238 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_resend": 0, 2024-08-31T06:30:42.238 INFO:teuthology.orchestra.run.smithi053.stdout: "command_active": 0, 2024-08-31T06:30:42.238 INFO:teuthology.orchestra.run.smithi053.stdout: "command_send": 0, 2024-08-31T06:30:42.238 INFO:teuthology.orchestra.run.smithi053.stdout: "command_resend": 0, 2024-08-31T06:30:42.238 INFO:teuthology.orchestra.run.smithi053.stdout: "map_epoch": 114, 2024-08-31T06:30:42.238 INFO:teuthology.orchestra.run.smithi053.stdout: "map_full": 0, 2024-08-31T06:30:42.238 INFO:teuthology.orchestra.run.smithi053.stdout: "map_inc": 44, 2024-08-31T06:30:42.238 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_sessions": 11, 2024-08-31T06:30:42.238 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_open": 12, 2024-08-31T06:30:42.238 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_close": 1, 2024-08-31T06:30:42.239 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_laggy": 0, 2024-08-31T06:30:42.239 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_wr": 0, 2024-08-31T06:30:42.239 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_rd": 2, 2024-08-31T06:30:42.239 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_del": 0 2024-08-31T06:30:42.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.239 INFO:teuthology.orchestra.run.smithi053.stdout: "oft": { 2024-08-31T06:30:42.239 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_objs": 0, 2024-08-31T06:30:42.239 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:30:42.239 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_updates": 0, 2024-08-31T06:30:42.239 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_removes": 0 2024-08-31T06:30:42.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.240 INFO:teuthology.orchestra.run.smithi053.stdout: "purge_queue": { 2024-08-31T06:30:42.240 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops": 0, 2024-08-31T06:30:42.240 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T06:30:42.240 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing": 0, 2024-08-31T06:30:42.240 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_high_water": 0, 2024-08-31T06:30:42.240 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executed_ops": 0, 2024-08-31T06:30:42.240 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executed": 0, 2024-08-31T06:30:42.240 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_item_in_journal": 0 2024-08-31T06:30:42.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.240 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:30:42.241 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:42.241 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2024-08-31T06:30:42.241 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:42.241 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 6311, 2024-08-31T06:30:42.241 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 208813086, 2024-08-31T06:30:42.241 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:42.241 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 6311, 2024-08-31T06:30:42.241 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2024-08-31T06:30:42.241 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2024-08-31T06:30:42.241 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 6311, 2024-08-31T06:30:42.241 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 208813086, 2024-08-31T06:30:42.242 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:42.242 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.242 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.242 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.242 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:42.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.242 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_bytes": { 2024-08-31T06:30:42.242 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:42.242 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2024-08-31T06:30:42.242 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:42.242 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 5736, 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 206414979, 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 5736, 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 206414979, 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.243 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_ops": { 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 1024, 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 5736, 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 5736, 2024-08-31T06:30:42.244 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 5736, 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 5736, 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:42.245 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 0, 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 0, 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.246 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle-0x5617c79208f0": { 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2024-08-31T06:30:42.247 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 0, 2024-08-31T06:30:42.248 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 0, 2024-08-31T06:30:42.248 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:42.248 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:42.248 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:42.248 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:42.248 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:42.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:42.248 INFO:teuthology.orchestra.run.smithi053.stdout: "trackedop": { 2024-08-31T06:30:42.248 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_ops_count": 0 2024-08-31T06:30:42.248 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:42.248 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:30:42.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:42 smithi130 ceph-mon[22266]: pgmap v1135: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-08-31T06:30:42.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:42 smithi153 ceph-mon[22320]: pgmap v1135: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-08-31T06:30:43.192 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-08-31T06:30:43.192 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-08-31T06:30:43.192 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-08-31T06:30:43.192 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-08-31T06:30:43.192 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-08-31T06:30:43.192 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:30:43.193 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:30:43.193 DEBUG:tasks.check_counter:Getting stats from d 2024-08-31T06:30:43.193 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-31T06:30:43.446 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:43.990 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:30:43.990 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 462, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 457, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 897184, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 283152, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 4, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 0, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.069581160, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.036421335, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.041083739, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 456, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.019353330, 2024-08-31T06:30:43.991 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000042441 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 897184, 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 283152 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 6, 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 351, 2024-08-31T06:30:43.992 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 3264, 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 222000, 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 4, 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 2, 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.030666982, 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.024200208, 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.003647527, 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 350, 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.017423967, 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000049782 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:43.993 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 222000 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 0, 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 2, 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 0, 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 0, 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 2, 2024-08-31T06:30:43.994 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 1, 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.000318002, 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.000245980, 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:43.995 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:43.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:43.996 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:30:43.996 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:30:43.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:43.996 INFO:teuthology.orchestra.run.smithi053.stdout: "cct": { 2024-08-31T06:30:43.996 INFO:teuthology.orchestra.run.smithi053.stdout: "total_workers": 0, 2024-08-31T06:30:43.996 INFO:teuthology.orchestra.run.smithi053.stdout: "unhealthy_workers": 0 2024-08-31T06:30:43.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:43.996 INFO:teuthology.orchestra.run.smithi053.stdout: "mempool": { 2024-08-31T06:30:43.996 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:30:43.996 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_items": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:30:43.997 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_items": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_items": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_items": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:30:43.998 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_items": 0, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_bytes": 0, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_items": 0, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_bytes": 148744, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_items": 30, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_items": 0, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bytes": 0, 2024-08-31T06:30:43.999 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_items": 0, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_items": 0, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_items": 0, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_bytes": 0, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_items": 0, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_bytes": 0, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_items": 0, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_bytes": 928, 2024-08-31T06:30:44.000 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_items": 2, 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_bytes": 0, 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_items": 0, 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_bytes": 0, 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_items": 0 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 464, 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 831836, 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:44.001 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 464, 2024-08-31T06:30:44.002 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2024-08-31T06:30:44.002 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2024-08-31T06:30:44.002 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 464, 2024-08-31T06:30:44.002 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 831836, 2024-08-31T06:30:44.002 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:44.002 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:44.002 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:44.002 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:44.002 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:44.002 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:44.002 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:30:44.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:44 smithi053 ceph-mon[18924]: pgmap v1136: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-08-31T06:30:44.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:44 smithi130 ceph-mon[22266]: pgmap v1136: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-08-31T06:30:44.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:44 smithi153 ceph-mon[22320]: pgmap v1136: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-08-31T06:30:44.820 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-31T06:30:44.821 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-31T06:30:44.821 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-08-31T06:30:44.821 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-08-31T06:30:44.821 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-08-31T06:30:44.821 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-08-31T06:30:44.821 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-08-31T06:30:44.821 DEBUG:tasks.check_counter:Getting stats from g 2024-08-31T06:30:44.821 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-31T06:30:45.076 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:45.630 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:30:45.631 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:30:45.631 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 2245, 2024-08-31T06:30:45.631 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 2247, 2024-08-31T06:30:45.631 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 67815565, 2024-08-31T06:30:45.631 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 713911, 2024-08-31T06:30:45.631 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 9, 2024-08-31T06:30:45.631 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 4, 2024-08-31T06:30:45.631 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.303541695, 2024-08-31T06:30:45.631 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.126224697, 2024-08-31T06:30:45.632 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.093183706, 2024-08-31T06:30:45.632 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.065961786, 2024-08-31T06:30:45.632 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:45.632 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 2245, 2024-08-31T06:30:45.632 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.079540612, 2024-08-31T06:30:45.632 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000035430 2024-08-31T06:30:45.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.632 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:45.632 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.632 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.632 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.633 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:30:45.633 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:30:45.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.633 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:30:45.633 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 2674, 2024-08-31T06:30:45.633 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 3017, 2024-08-31T06:30:45.633 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 75418025, 2024-08-31T06:30:45.633 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 1644801, 2024-08-31T06:30:45.634 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 8, 2024-08-31T06:30:45.634 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 6, 2024-08-31T06:30:45.634 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.299608173, 2024-08-31T06:30:45.634 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.108664852, 2024-08-31T06:30:45.634 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.110593990, 2024-08-31T06:30:45.634 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.064076126, 2024-08-31T06:30:45.634 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:45.634 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 3016, 2024-08-31T06:30:45.634 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.101057782, 2024-08-31T06:30:45.634 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000033507 2024-08-31T06:30:45.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.635 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:45.635 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.635 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.635 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.635 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-08-31T06:30:45.635 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 796320 2024-08-31T06:30:45.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.635 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:30:45.635 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 1197, 2024-08-31T06:30:45.636 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 1124, 2024-08-31T06:30:45.636 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 72863202, 2024-08-31T06:30:45.636 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 486975, 2024-08-31T06:30:45.636 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 5, 2024-08-31T06:30:45.636 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 4, 2024-08-31T06:30:45.636 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.187831838, 2024-08-31T06:30:45.636 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.062860780, 2024-08-31T06:30:45.636 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.115683585, 2024-08-31T06:30:45.636 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.016444334, 2024-08-31T06:30:45.636 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:45.637 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 1123, 2024-08-31T06:30:45.637 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.038742032, 2024-08-31T06:30:45.637 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000034498 2024-08-31T06:30:45.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.637 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:45.637 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.637 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.637 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.637 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 1400240, 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 289168 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: "cct": { 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: "total_workers": 1, 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: "unhealthy_workers": 0 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-MDSRank": { 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 9336, 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.225359239, 2024-08-31T06:30:45.638 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000024138 2024-08-31T06:30:45.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:45.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.639 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-PurgeQueue": { 2024-08-31T06:30:45.639 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2024-08-31T06:30:45.639 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2024-08-31T06:30:45.639 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.639 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.639 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:45.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.639 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-08-31T06:30:45.640 INFO:teuthology.orchestra.run.smithi053.stdout: "request": 0, 2024-08-31T06:30:45.640 INFO:teuthology.orchestra.run.smithi053.stdout: "reply": 0, 2024-08-31T06:30:45.640 INFO:teuthology.orchestra.run.smithi053.stdout: "reply_latency": { 2024-08-31T06:30:45.640 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.640 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.640 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.640 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_reply": 0, 2024-08-31T06:30:45.640 INFO:teuthology.orchestra.run.smithi053.stdout: "forward": 0, 2024-08-31T06:30:45.640 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_complete": 0, 2024-08-31T06:30:45.640 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_keys": 0, 2024-08-31T06:30:45.641 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_commit": 0, 2024-08-31T06:30:45.641 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_split": 0, 2024-08-31T06:30:45.641 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_merge": 0, 2024-08-31T06:30:45.641 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes": 12024, 2024-08-31T06:30:45.641 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_top": 0, 2024-08-31T06:30:45.641 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_bottom": 12024, 2024-08-31T06:30:45.641 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pin_tail": 0, 2024-08-31T06:30:45.641 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pinned": 12024, 2024-08-31T06:30:45.641 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_expired": 0, 2024-08-31T06:30:45.641 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_with_caps": 0, 2024-08-31T06:30:45.641 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": 0, 2024-08-31T06:30:45.642 INFO:teuthology.orchestra.run.smithi053.stdout: "subtrees": 1, 2024-08-31T06:30:45.642 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse": 0, 2024-08-31T06:30:45.642 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_hit": 0, 2024-08-31T06:30:45.642 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_forward": 0, 2024-08-31T06:30:45.642 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_discover": 0, 2024-08-31T06:30:45.642 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:30:45.642 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_remote_ino": 0, 2024-08-31T06:30:45.642 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_lock": 0, 2024-08-31T06:30:45.642 INFO:teuthology.orchestra.run.smithi053.stdout: "load_cent": 0, 2024-08-31T06:30:45.642 INFO:teuthology.orchestra.run.smithi053.stdout: "q": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "exported": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "exported_inodes": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "imported": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "imported_inodes": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_dir_fetch": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_backtrace_fetch": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_peer_discover": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rfiles": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rbytes": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rsnaps": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_set_tag": 0, 2024-08-31T06:30:45.643 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_inodes": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_file_inodes": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_inode_file_caps": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_grant": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:30:45.644 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps": 0, 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps_dirty": 0, 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_cap_release": 0, 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: "process_request_cap_release": 0 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache": { 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update": 0, 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update_receipt": 0, 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_try_discover": 0, 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_send_discover": 0, 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_handle_discover": 0, 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays": 0, 2024-08-31T06:30:45.645 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_delayed": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_created": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_enqueued": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_reintegrated": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_migrated": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_processing": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_started": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_completed": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_quiesce_path": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_quiesce_inode": 0, 2024-08-31T06:30:45.646 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_exportdir": 0, 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_flush": 0, 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragmentdir": 0, 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragstats": 0, 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_inodestats": 0, 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_started": 0, 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_succeeded": 0, 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: "uninline_write_failed": 0 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log": { 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: "evlrg": 0, 2024-08-31T06:30:45.647 INFO:teuthology.orchestra.run.smithi053.stdout: "evadd": 0, 2024-08-31T06:30:45.648 INFO:teuthology.orchestra.run.smithi053.stdout: "evex": 0, 2024-08-31T06:30:45.648 INFO:teuthology.orchestra.run.smithi053.stdout: "evtrm": 0, 2024-08-31T06:30:45.648 INFO:teuthology.orchestra.run.smithi053.stdout: "ev": 99110, 2024-08-31T06:30:45.648 INFO:teuthology.orchestra.run.smithi053.stdout: "evexg": 0, 2024-08-31T06:30:45.648 INFO:teuthology.orchestra.run.smithi053.stdout: "evexd": 0, 2024-08-31T06:30:45.648 INFO:teuthology.orchestra.run.smithi053.stdout: "segadd": 0, 2024-08-31T06:30:45.648 INFO:teuthology.orchestra.run.smithi053.stdout: "segex": 0, 2024-08-31T06:30:45.648 INFO:teuthology.orchestra.run.smithi053.stdout: "segtrm": 0, 2024-08-31T06:30:45.648 INFO:teuthology.orchestra.run.smithi053.stdout: "seg": 126, 2024-08-31T06:30:45.648 INFO:teuthology.orchestra.run.smithi053.stdout: "segmjr": 10, 2024-08-31T06:30:45.648 INFO:teuthology.orchestra.run.smithi053.stdout: "segexg": 0, 2024-08-31T06:30:45.649 INFO:teuthology.orchestra.run.smithi053.stdout: "segexd": 0, 2024-08-31T06:30:45.649 INFO:teuthology.orchestra.run.smithi053.stdout: "expos": 4194304, 2024-08-31T06:30:45.649 INFO:teuthology.orchestra.run.smithi053.stdout: "wrpos": 217342449, 2024-08-31T06:30:45.649 INFO:teuthology.orchestra.run.smithi053.stdout: "rdpos": 217333739, 2024-08-31T06:30:45.649 INFO:teuthology.orchestra.run.smithi053.stdout: "jlat": { 2024-08-31T06:30:45.649 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.649 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.649 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.649 INFO:teuthology.orchestra.run.smithi053.stdout: "replayed": 99110 2024-08-31T06:30:45.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.650 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_mem": { 2024-08-31T06:30:45.650 INFO:teuthology.orchestra.run.smithi053.stdout: "ino": 765, 2024-08-31T06:30:45.650 INFO:teuthology.orchestra.run.smithi053.stdout: "ino+": 14614, 2024-08-31T06:30:45.650 INFO:teuthology.orchestra.run.smithi053.stdout: "ino-": 13849, 2024-08-31T06:30:45.650 INFO:teuthology.orchestra.run.smithi053.stdout: "dir": 35, 2024-08-31T06:30:45.650 INFO:teuthology.orchestra.run.smithi053.stdout: "dir+": 152, 2024-08-31T06:30:45.650 INFO:teuthology.orchestra.run.smithi053.stdout: "dir-": 117, 2024-08-31T06:30:45.650 INFO:teuthology.orchestra.run.smithi053.stdout: "dn": 12024, 2024-08-31T06:30:45.650 INFO:teuthology.orchestra.run.smithi053.stdout: "dn+": 15147, 2024-08-31T06:30:45.650 INFO:teuthology.orchestra.run.smithi053.stdout: "dn-": 3123, 2024-08-31T06:30:45.651 INFO:teuthology.orchestra.run.smithi053.stdout: "cap": 0, 2024-08-31T06:30:45.651 INFO:teuthology.orchestra.run.smithi053.stdout: "cap+": 0, 2024-08-31T06:30:45.651 INFO:teuthology.orchestra.run.smithi053.stdout: "cap-": 0, 2024-08-31T06:30:45.651 INFO:teuthology.orchestra.run.smithi053.stdout: "rss": 140200, 2024-08-31T06:30:45.651 INFO:teuthology.orchestra.run.smithi053.stdout: "heap": 346533888 2024-08-31T06:30:45.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.651 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_server": { 2024-08-31T06:30:45.651 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_client_request": 0, 2024-08-31T06:30:45.651 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_server_request": 0, 2024-08-31T06:30:45.651 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_request": 0, 2024-08-31T06:30:45.652 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_session": 0, 2024-08-31T06:30:45.652 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_peer_request": 0, 2024-08-31T06:30:45.652 INFO:teuthology.orchestra.run.smithi053.stdout: "req_create_latency": { 2024-08-31T06:30:45.652 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.652 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.652 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.652 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getattr_latency": { 2024-08-31T06:30:45.652 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.653 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.653 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.653 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getfilelock_latency": { 2024-08-31T06:30:45.653 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.653 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.653 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.653 INFO:teuthology.orchestra.run.smithi053.stdout: "req_link_latency": { 2024-08-31T06:30:45.653 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.654 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.654 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.654 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookup_latency": { 2024-08-31T06:30:45.654 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.654 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.654 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.654 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookuphash_latency": { 2024-08-31T06:30:45.654 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.654 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.655 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.655 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupino_latency": { 2024-08-31T06:30:45.655 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.655 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.655 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.655 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupname_latency": { 2024-08-31T06:30:45.655 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.655 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.656 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.656 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupparent_latency": { 2024-08-31T06:30:45.656 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.656 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.656 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.656 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupsnap_latency": { 2024-08-31T06:30:45.656 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.656 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.657 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.657 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lssnap_latency": { 2024-08-31T06:30:45.657 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.658 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.658 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.658 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mkdir_latency": { 2024-08-31T06:30:45.658 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.658 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.658 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.658 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mknod_latency": { 2024-08-31T06:30:45.658 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.659 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.659 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.659 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mksnap_latency": { 2024-08-31T06:30:45.659 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.659 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.659 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.659 INFO:teuthology.orchestra.run.smithi053.stdout: "req_open_latency": { 2024-08-31T06:30:45.659 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.659 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.660 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.660 INFO:teuthology.orchestra.run.smithi053.stdout: "req_readdir_latency": { 2024-08-31T06:30:45.660 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.660 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.660 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.660 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rename_latency": { 2024-08-31T06:30:45.660 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.660 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.660 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.661 INFO:teuthology.orchestra.run.smithi053.stdout: "req_renamesnap_latency": { 2024-08-31T06:30:45.661 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.661 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.661 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.661 INFO:teuthology.orchestra.run.smithi053.stdout: "req_snapdiff_latency": { 2024-08-31T06:30:45.661 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.661 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.661 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmdir_latency": { 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmsnap_latency": { 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.662 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmxattr_latency": { 2024-08-31T06:30:45.663 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.663 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.663 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.663 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setattr_latency": { 2024-08-31T06:30:45.663 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.663 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.663 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.663 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setdirlayout_latency": { 2024-08-31T06:30:45.663 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.664 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.664 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.664 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setfilelock_latency": { 2024-08-31T06:30:45.664 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.664 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.664 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.664 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setlayout_latency": { 2024-08-31T06:30:45.664 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.664 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.665 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.665 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setxattr_latency": { 2024-08-31T06:30:45.665 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.665 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.665 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.665 INFO:teuthology.orchestra.run.smithi053.stdout: "req_symlink_latency": { 2024-08-31T06:30:45.665 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.665 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.665 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.666 INFO:teuthology.orchestra.run.smithi053.stdout: "req_unlink_latency": { 2024-08-31T06:30:45.666 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.666 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.666 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.666 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:30:45.666 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:30:45.666 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getvxattr_latency": { 2024-08-31T06:30:45.666 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.666 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.667 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.667 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:45.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.667 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_sessions": { 2024-08-31T06:30:45.667 INFO:teuthology.orchestra.run.smithi053.stdout: "session_count": 1, 2024-08-31T06:30:45.667 INFO:teuthology.orchestra.run.smithi053.stdout: "session_add": 1, 2024-08-31T06:30:45.667 INFO:teuthology.orchestra.run.smithi053.stdout: "session_remove": 0, 2024-08-31T06:30:45.667 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_open": 1, 2024-08-31T06:30:45.667 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_stale": 0, 2024-08-31T06:30:45.667 INFO:teuthology.orchestra.run.smithi053.stdout: "total_load": 0, 2024-08-31T06:30:45.667 INFO:teuthology.orchestra.run.smithi053.stdout: "average_load": 0, 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: "avg_session_uptime": 2584, 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: "mdthresh_evicted": 0 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: "mempool": { 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_items": 0, 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:30:45.668 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:30:45.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:30:45.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:30:45.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:30:45.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:30:45.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:30:45.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:30:45.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:30:45.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_items": 0, 2024-08-31T06:30:45.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:30:45.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_items": 0, 2024-08-31T06:30:45.669 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:30:45.670 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:30:45.670 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:30:45.670 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:30:45.670 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:30:45.670 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:30:45.670 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:30:45.670 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_items": 0, 2024-08-31T06:30:45.670 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:30:45.670 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:30:45.670 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:30:45.670 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_items": 0, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_bytes": 0, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_items": 0, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_bytes": 240272, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_items": 82, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_items": 0, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bytes": 0, 2024-08-31T06:30:45.671 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_items": 0, 2024-08-31T06:30:45.672 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:30:45.672 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_items": 0, 2024-08-31T06:30:45.672 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:30:45.672 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_items": 0, 2024-08-31T06:30:45.672 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_bytes": 8352, 2024-08-31T06:30:45.672 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_items": 184, 2024-08-31T06:30:45.672 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:30:45.672 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:30:45.672 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_bytes": 0, 2024-08-31T06:30:45.672 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_items": 0, 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_bytes": 10014299, 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_items": 51953, 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_bytes": 0, 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_items": 0, 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_bytes": 0, 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_items": 0 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter": { 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: "op_active": 0, 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: "op_laggy": 0, 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send": 5535, 2024-08-31T06:30:45.673 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send_bytes": 21, 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: "op_resend": 3, 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: "op_reply": 5535, 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: "op_latency": { 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 5535, 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 4.456908856, 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000805222 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: "op_inflight": 0, 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: "oplen_avg": { 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 5535, 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 5536 2024-08-31T06:30:45.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "op": 5535, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "op_r": 5535, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "op_w": 0, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "op_rmw": 0, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "op_pg": 0, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_stat": 3276, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_create": 0, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_read": 2257, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_write": 0, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writefull": 0, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writesame": 0, 2024-08-31T06:30:45.675 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_append": 0, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_zero": 0, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_truncate": 0, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_delete": 0, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_mapext": 0, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_sparse_read": 0, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_clonerange": 0, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_getxattr": 1, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_setxattr": 0, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_rmxattr": 0, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:30:45.676 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_call": 0, 2024-08-31T06:30:45.677 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_watch": 0, 2024-08-31T06:30:45.677 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_notify": 0, 2024-08-31T06:30:45.677 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:30:45.677 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls": 0, 2024-08-31T06:30:45.677 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:30:45.677 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_other": 0, 2024-08-31T06:30:45.677 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_active": 0, 2024-08-31T06:30:45.677 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_send": 0, 2024-08-31T06:30:45.677 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_resend": 0, 2024-08-31T06:30:45.677 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_ping": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_active": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_send": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_resend": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_active": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_send": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_resend": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_active": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_send": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_resend": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "command_active": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "command_send": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "command_resend": 0, 2024-08-31T06:30:45.678 INFO:teuthology.orchestra.run.smithi053.stdout: "map_epoch": 114, 2024-08-31T06:30:45.679 INFO:teuthology.orchestra.run.smithi053.stdout: "map_full": 0, 2024-08-31T06:30:45.679 INFO:teuthology.orchestra.run.smithi053.stdout: "map_inc": 44, 2024-08-31T06:30:45.679 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_sessions": 11, 2024-08-31T06:30:45.679 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_open": 12, 2024-08-31T06:30:45.679 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_close": 1, 2024-08-31T06:30:45.679 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_laggy": 0, 2024-08-31T06:30:45.679 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_wr": 0, 2024-08-31T06:30:45.679 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_rd": 2, 2024-08-31T06:30:45.679 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_del": 0 2024-08-31T06:30:45.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.680 INFO:teuthology.orchestra.run.smithi053.stdout: "oft": { 2024-08-31T06:30:45.680 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_objs": 0, 2024-08-31T06:30:45.680 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:30:45.680 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_updates": 0, 2024-08-31T06:30:45.680 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_removes": 0 2024-08-31T06:30:45.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.680 INFO:teuthology.orchestra.run.smithi053.stdout: "purge_queue": { 2024-08-31T06:30:45.680 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops": 0, 2024-08-31T06:30:45.680 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T06:30:45.680 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing": 0, 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_high_water": 0, 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executed_ops": 0, 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executed": 0, 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_item_in_journal": 0 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 6112, 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 215514536, 2024-08-31T06:30:45.681 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 6112, 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 6112, 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 215514536, 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.682 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_bytes": { 2024-08-31T06:30:45.683 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:45.683 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2024-08-31T06:30:45.683 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:45.683 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2024-08-31T06:30:45.683 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2024-08-31T06:30:45.683 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:45.683 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:45.683 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 5535, 2024-08-31T06:30:45.683 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 213148434, 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 5535, 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 213148434, 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_ops": { 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 1024, 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:45.684 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2024-08-31T06:30:45.685 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2024-08-31T06:30:45.685 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:45.685 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:45.685 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 5535, 2024-08-31T06:30:45.685 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 5535, 2024-08-31T06:30:45.685 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 5535, 2024-08-31T06:30:45.685 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 5535, 2024-08-31T06:30:45.685 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:45.685 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.686 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.686 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.686 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:45.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.686 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:30:45.686 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:45.686 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2024-08-31T06:30:45.686 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:45.686 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2024-08-31T06:30:45.686 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2024-08-31T06:30:45.687 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:45.687 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:45.687 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2024-08-31T06:30:45.687 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2024-08-31T06:30:45.687 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 0, 2024-08-31T06:30:45.687 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 0, 2024-08-31T06:30:45.687 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:45.687 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.687 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.687 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.687 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:45.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.688 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle-0x557123d9a8f0": { 2024-08-31T06:30:45.688 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:45.688 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2024-08-31T06:30:45.688 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:45.688 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2024-08-31T06:30:45.688 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2024-08-31T06:30:45.688 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:45.688 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:45.688 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2024-08-31T06:30:45.688 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 0, 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 0, 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout: "trackedop": { 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_ops_count": 0 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:45.689 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:30:46.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:46 smithi053 ceph-mon[18924]: pgmap v1137: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-08-31T06:30:46.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:46 smithi130 ceph-mon[22266]: pgmap v1137: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-08-31T06:30:46.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:46 smithi153 ceph-mon[22320]: pgmap v1137: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-08-31T06:30:46.458 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-08-31T06:30:46.458 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-08-31T06:30:46.459 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-08-31T06:30:46.459 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-08-31T06:30:46.459 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-08-31T06:30:46.459 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:30:46.459 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:30:46.459 DEBUG:tasks.check_counter:Getting stats from j 2024-08-31T06:30:46.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-31T06:30:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:30:47.237 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-08-31T06:30:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:30:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 0, 2024-08-31T06:30:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 2, 2024-08-31T06:30:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 0, 2024-08-31T06:30:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 0, 2024-08-31T06:30:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 4, 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 0, 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.001127414, 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.000194609, 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 6, 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 353, 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 3264, 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 222352, 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 4, 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 2, 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.032313159, 2024-08-31T06:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.025806621, 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.003723463, 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 352, 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.017752161, 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000050432 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-08-31T06:30:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 222352 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 463, 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 458, 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 897456, 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 283792, 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 2, 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 1, 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.067232592, 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.034612119, 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.041082328, 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 457, 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.018422950, 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000040312 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 897456, 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 283792 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "cct": { 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "total_workers": 0, 2024-08-31T06:30:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "unhealthy_workers": 0 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "mempool": { 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_items": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:30:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_items": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_items": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_items": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:30:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_items": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_bytes": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_items": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_bytes": 148704, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_items": 29, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_items": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bytes": 0, 2024-08-31T06:30:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_items": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_items": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_items": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_bytes": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_items": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_bytes": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_items": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_bytes": 928, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_items": 2, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_bytes": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_items": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_bytes": 0, 2024-08-31T06:30:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_items": 0 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 465, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 831966, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 465, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 465, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 831966, 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2024-08-31T06:30:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2024-08-31T06:30:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2024-08-31T06:30:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2024-08-31T06:30:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-08-31T06:30:47.248 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-08-31T06:30:48.008 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-31T06:30:48.008 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-31T06:30:48.008 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-08-31T06:30:48.008 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-08-31T06:30:48.008 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-08-31T06:30:48.008 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-08-31T06:30:48.008 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-08-31T06:30:48.008 DEBUG:tasks.check_counter:Getting stats from b 2024-08-31T06:30:48.009 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-31T06:30:48.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:48 smithi053 ceph-mon[18924]: pgmap v1138: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 KiB/s wr, 11 op/s 2024-08-31T06:30:48.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:48 smithi130 ceph-mon[22266]: pgmap v1138: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 KiB/s wr, 11 op/s 2024-08-31T06:30:48.401 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:30:48.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:48 smithi153 ceph-mon[22320]: pgmap v1138: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 KiB/s wr, 11 op/s 2024-08-31T06:30:49.059 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-31T06:30:49.059 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:30:49.059 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 841023, 2024-08-31T06:30:49.059 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 903081, 2024-08-31T06:30:49.059 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 250404708, 2024-08-31T06:30:49.059 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 639092508, 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 575, 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 10, 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 50.662339644, 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 25.915382711, 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 29.343435368, 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.761587916, 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 903076, 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 17.146591041, 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000018986 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1689868, 2024-08-31T06:30:49.060 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.253416232, 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000149 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 58160, 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 29856 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 194246, 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 242448, 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 55359143, 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 190660241, 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 10, 2024-08-31T06:30:49.061 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 6, 2024-08-31T06:30:49.062 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 16.655159466, 2024-08-31T06:30:49.062 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 9.054279686, 2024-08-31T06:30:49.062 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 8.256394477, 2024-08-31T06:30:49.062 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.636546624, 2024-08-31T06:30:49.062 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:49.062 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 242450, 2024-08-31T06:30:49.062 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 9.803654816, 2024-08-31T06:30:49.062 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000040435 2024-08-31T06:30:49.062 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.062 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 387946, 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.071540602, 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000184 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 1448464, 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 350496 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 287004, 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 354888, 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 80793514, 2024-08-31T06:30:49.063 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 190874278, 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 19, 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 7, 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 19.376063255, 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 9.791023908, 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 10.760118510, 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.456969463, 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 354887, 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 8.613289667, 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000024270 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.064 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 611216, 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.103425649, 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000169 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 838416, 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 999552 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 1, 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.065 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-MDSRank": { 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 69245, 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 39.716855426, 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000573570 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-PurgeQueue": { 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 12864, 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.899974963, 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000069960 2024-08-31T06:30:49.066 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": { 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "request": 638333, 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "reply": 609216, 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "reply_latency": { 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 609216, 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 1211.375737207, 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.001988417 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_reply": 0, 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "forward": 29117, 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_complete": 29, 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_keys": 3, 2024-08-31T06:30:49.067 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_commit": 3573, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_split": 7, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_merge": 4, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes": 1747, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_top": 969, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_bottom": 615, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pin_tail": 163, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pinned": 363, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_expired": 4267, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_with_caps": 3, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": 3, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "subtrees": 6, 2024-08-31T06:30:49.068 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse": 1235007, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_hit": 1190566, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_forward": 12000, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_discover": 254, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_dir_fetch": 1, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_remote_ino": 0, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_lock": 179, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "load_cent": 333, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "q": 0, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "exported": 99, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "exported_inodes": 3547, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "imported": 105, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "imported_inodes": 2955, 2024-08-31T06:30:49.069 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_dir_fetch": 0, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_backtrace_fetch": 2768, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_peer_discover": 0, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rfiles": 4, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rbytes": 234, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rsnaps": 6, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_fetch": 2768, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_set_tag": 0, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_inodes": 699, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_base_inodes": 31, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dirfrag_rstats": 668, 2024-08-31T06:30:49.070 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_file_inodes": 2069, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_inode_file_caps": 1119, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_revoke": 46745, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_grant": 19155, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps": 57613, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps_dirty": 8337, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_cap_release": 647, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "process_request_cap_release": 20931 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_cache": { 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update": 3745, 2024-08-31T06:30:49.071 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update_receipt": 382, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_try_discover": 235, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_send_discover": 472, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_handle_discover": 8103, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays": 23, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_delayed": 0, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_created": 5614, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_enqueued": 5591, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_reintegrated": 0, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_migrated": 0, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_processing": 0, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:30:49.072 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_started": 0, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_completed": 0, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_path": 21, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_inode": 3061, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_enqueue_scrub": 31, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_exportdir": 106, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_flush": 0, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragmentdir": 11, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragstats": 0, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_inodestats": 0, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_started": 0, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_succeeded": 0, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_write_failed": 0 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.073 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_log": { 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "evlrg": 0, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "evadd": 71751, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "evex": 71322, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "evtrm": 71322, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "ev": 429, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "evexg": 0, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "evexd": 1053, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "segadd": 202, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "segex": 200, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "segtrm": 200, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "seg": 2, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "segmjr": 1, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "segexg": 0, 2024-08-31T06:30:49.074 INFO:teuthology.orchestra.run.smithi130.stdout: "segexd": 2, 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "expos": 263179112, 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "wrpos": 265350686, 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "rdpos": 0, 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "jlat": { 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 33609, 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 142.718752191, 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.004246444 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "replayed": 0 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_mem": { 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "ino": 1429, 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "ino+": 10815, 2024-08-31T06:30:49.075 INFO:teuthology.orchestra.run.smithi130.stdout: "ino-": 9386, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "dir": 144, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "dir+": 566, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "dir-": 422, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "dn": 1831, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "dn+": 17959, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "dn-": 16128, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "cap": 3, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "cap+": 6555, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "cap-": 6552, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "rss": 160492, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "heap": 380510208 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_server": { 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_client_request": 756618, 2024-08-31T06:30:49.076 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_server_request": 15992, 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_request": 638333, 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_session": 467, 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_peer_request": 59214, 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "req_create_latency": { 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 6021, 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 131.151008233, 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.021782263 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getattr_latency": { 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 518963, 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 169.651423677, 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000326904 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.077 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getfilelock_latency": { 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "req_link_latency": { 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookup_latency": { 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 46684, 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 422.635220247, 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.009053106 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.078 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookuphash_latency": { 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupino_latency": { 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupname_latency": { 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.079 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupparent_latency": { 2024-08-31T06:30:49.080 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.080 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.080 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.080 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.080 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupsnap_latency": { 2024-08-31T06:30:49.080 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.080 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lssnap_latency": { 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 26, 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.007977666, 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000306833 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mkdir_latency": { 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 119, 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 22.069328399, 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.185456541 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.081 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mknod_latency": { 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mksnap_latency": { 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 26, 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 13.793586284, 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.530522549 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: "req_open_latency": { 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 4161, 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 3.243130684, 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000779411 2024-08-31T06:30:49.082 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "req_readdir_latency": { 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 26257, 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 44.334342356, 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.001688477 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rename_latency": { 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1191, 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 102.027532201, 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.085665434 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "req_renamesnap_latency": { 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.083 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: "req_snapdiff_latency": { 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmdir_latency": { 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 34, 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.313925203, 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.009233094 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmsnap_latency": { 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 20, 2024-08-31T06:30:49.084 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 2.511793499, 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.125589674 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmxattr_latency": { 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setattr_latency": { 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 8, 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 72.843738681, 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 9.105467335 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setdirlayout_latency": { 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.085 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setfilelock_latency": { 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 108, 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.043921380, 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000406679 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setlayout_latency": { 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setxattr_latency": { 2024-08-31T06:30:49.086 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 7, 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.021299927, 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.003042846 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: "req_symlink_latency": { 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: "req_unlink_latency": { 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 5591, 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 226.727508770, 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.040552228 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.087 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getvxattr_latency": { 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_sessions": { 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "session_count": 2, 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "session_add": 3, 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "session_remove": 1, 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_open": 2, 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_stale": 0, 2024-08-31T06:30:49.088 INFO:teuthology.orchestra.run.smithi130.stdout: "total_load": 35768, 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "average_load": 17884, 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "avg_session_uptime": 1564, 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "mdthresh_evicted": 0 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:30:49.089 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:30:49.090 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:30:49.091 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 496138, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 162, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 8352, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 184, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-31T06:30:49.092 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 4981373, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 21881, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "objecter": { 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "op_active": 0, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "op_laggy": 0, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send": 52561, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send_bytes": 276176077, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "op_resend": 37, 2024-08-31T06:30:49.093 INFO:teuthology.orchestra.run.smithi130.stdout: "op_reply": 52561, 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "op_latency": { 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 52561, 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 343.764351538, 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.006540293 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "op_inflight": 0, 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "oplen_avg": { 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 52561, 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 66054 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "op": 52561, 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "op_r": 3940, 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "op_w": 48621, 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "op_rmw": 0, 2024-08-31T06:30:49.094 INFO:teuthology.orchestra.run.smithi130.stdout: "op_pg": 0, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_stat": 3467, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_create": 2219, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_read": 1075, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_write": 34653, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writefull": 1036, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writesame": 0, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_append": 0, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_zero": 0, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_truncate": 5, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_delete": 6236, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_mapext": 0, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_sparse_read": 0, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_clonerange": 0, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_getxattr": 2818, 2024-08-31T06:30:49.095 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_setxattr": 4438, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_rmxattr": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_call": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_watch": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_notify": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_other": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_active": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_send": 0, 2024-08-31T06:30:49.096 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_resend": 0, 2024-08-31T06:30:49.097 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_ping": 0, 2024-08-31T06:30:49.097 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_active": 0, 2024-08-31T06:30:49.097 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_send": 0, 2024-08-31T06:30:49.097 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_resend": 0, 2024-08-31T06:30:49.097 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_active": 0, 2024-08-31T06:30:49.097 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_send": 0, 2024-08-31T06:30:49.097 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_resend": 0, 2024-08-31T06:30:49.097 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_active": 0, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_send": 0, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_resend": 0, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "command_active": 0, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "command_send": 0, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "command_resend": 0, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "map_epoch": 114, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "map_full": 0, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "map_inc": 44, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_sessions": 12, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_open": 12, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_close": 0, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_laggy": 0, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_wr": 8124, 2024-08-31T06:30:49.098 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_rd": 98, 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_del": 1885 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "oft": { 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_objs": 1, 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_updates": 0, 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_removes": 0 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "purge_queue": { 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops": 0, 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops_high_water": 6, 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing": 0, 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_high_water": 6, 2024-08-31T06:30:49.099 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed_ops": 5591, 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed": 5591, 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_item_in_journal": 0 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 1322269, 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 267420992, 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 1322269, 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:49.100 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:49.101 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 1322269, 2024-08-31T06:30:49.101 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 267420992, 2024-08-31T06:30:49.101 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:49.101 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.101 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.101 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.101 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:49.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.101 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_bytes": { 2024-08-31T06:30:49.101 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:49.101 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-31T06:30:49.102 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:49.102 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:49.102 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:49.102 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:49.102 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:49.102 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 52561, 2024-08-31T06:30:49.102 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 276748603, 2024-08-31T06:30:49.102 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 52561, 2024-08-31T06:30:49.102 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 276748603, 2024-08-31T06:30:49.102 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:49.102 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_ops": { 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 1024, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 52561, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 52561, 2024-08-31T06:30:49.103 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 52561, 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 52561, 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 5591, 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 573987, 2024-08-31T06:30:49.104 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 5591, 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 1044, 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 573987, 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle-0x5613e64e2820": { 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:49.105 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 71751, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 261156382, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 71751, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 33609, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 261156382, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:49.106 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:49.107 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:49.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:49.107 INFO:teuthology.orchestra.run.smithi130.stdout: "trackedop": { 2024-08-31T06:30:49.107 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_ops_count": 2694 2024-08-31T06:30:49.107 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:49.107 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-31T06:30:50.112 INFO:tasks.check_counter:Daemon mds.b mds.exported=99 2024-08-31T06:30:50.112 INFO:tasks.check_counter:Daemon mds.b mds.imported=105 2024-08-31T06:30:50.112 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=3745 2024-08-31T06:30:50.112 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=382 2024-08-31T06:30:50.112 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-08-31T06:30:50.112 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=26 2024-08-31T06:30:50.112 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=20 2024-08-31T06:30:50.113 DEBUG:tasks.check_counter:Getting stats from e 2024-08-31T06:30:50.113 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-31T06:30:50.368 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:30:50.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:50 smithi130 ceph-mon[22266]: pgmap v1139: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-08-31T06:30:50.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:50 smithi153 ceph-mon[22320]: pgmap v1139: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-08-31T06:30:50.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:50 smithi053 ceph-mon[18924]: pgmap v1139: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-08-31T06:30:51.095 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-31T06:30:51.095 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:30:51.095 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 3924, 2024-08-31T06:30:51.095 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 3849, 2024-08-31T06:30:51.095 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 91581136, 2024-08-31T06:30:51.095 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 1354624, 2024-08-31T06:30:51.095 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 7, 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 3, 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.449269307, 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.195416030, 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.160493609, 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.083536103, 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 3849, 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.134067072, 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000034831 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.096 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 1405040, 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 293136 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 1336, 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 1684, 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 88419658, 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 1130932, 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 7, 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 6, 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.184054672, 2024-08-31T06:30:51.097 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.059930326, 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.083056131, 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.030332546, 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1682, 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.051559010, 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000030653 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.098 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 706336 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 1589, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 1591, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 84286648, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 505309, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 6, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 5, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.196089669, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.055574786, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.088982811, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.040695093, 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:51.099 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1589, 2024-08-31T06:30:51.100 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.047012129, 2024-08-31T06:30:51.100 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000029585 2024-08-31T06:30:51.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.100 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:51.100 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.100 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.100 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.100 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:30:51.100 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:30:51.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 1, 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-MDSRank": { 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 10708, 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.351729277, 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000032847 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:51.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.102 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-PurgeQueue": { 2024-08-31T06:30:51.102 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-31T06:30:51.102 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-31T06:30:51.102 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.102 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.102 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.102 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:51.102 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.102 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": { 2024-08-31T06:30:51.102 INFO:teuthology.orchestra.run.smithi130.stdout: "request": 0, 2024-08-31T06:30:51.102 INFO:teuthology.orchestra.run.smithi130.stdout: "reply": 0, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "reply_latency": { 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_reply": 0, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "forward": 0, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_complete": 0, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_keys": 0, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_commit": 0, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_split": 0, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_merge": 0, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes": 7362, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_top": 4900, 2024-08-31T06:30:51.103 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_bottom": 2462, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pin_tail": 0, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pinned": 363, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_expired": 0, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_with_caps": 0, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": 0, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "subtrees": 2, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse": 0, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_hit": 0, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_forward": 0, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_discover": 0, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_remote_ino": 0, 2024-08-31T06:30:51.104 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_lock": 0, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "load_cent": 0, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "q": 0, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "exported": 0, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "exported_inodes": 0, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "imported": 0, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "imported_inodes": 0, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_dir_fetch": 0, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_backtrace_fetch": 0, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_peer_discover": 0, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rfiles": 4, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rbytes": 234, 2024-08-31T06:30:51.105 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rsnaps": 6, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_set_tag": 0, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_inodes": 0, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_file_inodes": 0, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_inode_file_caps": 0, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_grant": 0, 2024-08-31T06:30:51.106 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps_dirty": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_cap_release": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "process_request_cap_release": 0 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_cache": { 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update_receipt": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_try_discover": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_send_discover": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_handle_discover": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays": 0, 2024-08-31T06:30:51.107 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_delayed": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_created": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_enqueued": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_reintegrated": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_migrated": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_processing": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_started": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_completed": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_path": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_inode": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:30:51.108 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_exportdir": 0, 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_flush": 0, 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragmentdir": 0, 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragstats": 0, 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_inodestats": 0, 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_started": 0, 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_succeeded": 0, 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_write_failed": 0 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_log": { 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: "evlrg": 0, 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: "evadd": 0, 2024-08-31T06:30:51.109 INFO:teuthology.orchestra.run.smithi130.stdout: "evex": 0, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "evtrm": 0, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "ev": 71751, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "evexg": 0, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "evexd": 0, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "segadd": 0, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "segex": 0, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "segtrm": 0, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "seg": 2, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "segmjr": 119, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "segexg": 0, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "segexd": 0, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "expos": 263179112, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "wrpos": 265350686, 2024-08-31T06:30:51.110 INFO:teuthology.orchestra.run.smithi130.stdout: "rdpos": 265339165, 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "jlat": { 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "replayed": 71751 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_mem": { 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "ino": 1528, 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "ino+": 10503, 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "ino-": 8975, 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "dir": 92, 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "dir+": 256, 2024-08-31T06:30:51.111 INFO:teuthology.orchestra.run.smithi130.stdout: "dir-": 164, 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: "dn": 7362, 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: "dn+": 11093, 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: "dn-": 3731, 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: "cap": 0, 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: "cap+": 0, 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: "cap-": 0, 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: "rss": 138452, 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: "heap": 336474112 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_server": { 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_client_request": 0, 2024-08-31T06:30:51.112 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_server_request": 0, 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_request": 0, 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_session": 0, 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_peer_request": 0, 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "req_create_latency": { 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getattr_latency": { 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getfilelock_latency": { 2024-08-31T06:30:51.113 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.114 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.114 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.114 INFO:teuthology.orchestra.run.smithi130.stdout: "req_link_latency": { 2024-08-31T06:30:51.114 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.114 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.114 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.114 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.114 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookup_latency": { 2024-08-31T06:30:51.115 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.115 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.115 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.115 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.115 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookuphash_latency": { 2024-08-31T06:30:51.115 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.116 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.116 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.116 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.116 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupino_latency": { 2024-08-31T06:30:51.116 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.116 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.117 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.117 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupname_latency": { 2024-08-31T06:30:51.117 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.117 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.117 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.117 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.118 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupparent_latency": { 2024-08-31T06:30:51.118 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.118 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.118 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.118 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.118 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupsnap_latency": { 2024-08-31T06:30:51.118 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lssnap_latency": { 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mkdir_latency": { 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.119 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.120 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mknod_latency": { 2024-08-31T06:30:51.120 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.120 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.120 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.120 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.120 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mksnap_latency": { 2024-08-31T06:30:51.120 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.120 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.120 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: "req_open_latency": { 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: "req_readdir_latency": { 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rename_latency": { 2024-08-31T06:30:51.121 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: "req_renamesnap_latency": { 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: "req_snapdiff_latency": { 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.122 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmdir_latency": { 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmsnap_latency": { 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmxattr_latency": { 2024-08-31T06:30:51.123 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setattr_latency": { 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setdirlayout_latency": { 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.124 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setfilelock_latency": { 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setlayout_latency": { 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setxattr_latency": { 2024-08-31T06:30:51.125 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: "req_symlink_latency": { 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: "req_unlink_latency": { 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.127 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:30:51.127 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:30:51.127 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getvxattr_latency": { 2024-08-31T06:30:51.127 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.127 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.127 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.127 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_sessions": { 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: "session_count": 2, 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: "session_add": 3, 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: "session_remove": 1, 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_open": 2, 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_stale": 0, 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: "total_load": 0, 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: "average_load": 0, 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: "avg_session_uptime": 2556, 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: "mdthresh_evicted": 0 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.128 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:30:51.129 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:30:51.130 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 240999, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 82, 2024-08-31T06:30:51.131 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:30:51.132 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-31T06:30:51.132 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-31T06:30:51.132 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-31T06:30:51.132 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:30:51.132 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-31T06:30:51.132 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:30:51.132 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-31T06:30:51.132 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 8352, 2024-08-31T06:30:51.132 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 184, 2024-08-31T06:30:51.132 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 8412696, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 34171, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "objecter": { 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "op_active": 0, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "op_laggy": 0, 2024-08-31T06:30:51.133 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send": 6262, 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send_bytes": 26, 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: "op_resend": 4, 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: "op_reply": 6262, 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: "op_latency": { 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 6262, 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 4.528911273, 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000723237 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: "op_inflight": 0, 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: "oplen_avg": { 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 6262, 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 6263 2024-08-31T06:30:51.134 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "op": 6262, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "op_r": 6262, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "op_w": 0, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "op_rmw": 0, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "op_pg": 0, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_stat": 3349, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_create": 0, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_read": 2910, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_write": 0, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writefull": 0, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writesame": 0, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_append": 0, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_zero": 0, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_truncate": 0, 2024-08-31T06:30:51.135 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_delete": 0, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_mapext": 0, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_sparse_read": 0, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_clonerange": 0, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_getxattr": 2, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_setxattr": 0, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_rmxattr": 0, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_call": 0, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_watch": 0, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_notify": 0, 2024-08-31T06:30:51.136 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_other": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_active": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_send": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_resend": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_ping": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_active": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_send": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_resend": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_active": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_send": 0, 2024-08-31T06:30:51.137 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_resend": 0, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_active": 0, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_send": 0, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_resend": 0, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "command_active": 0, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "command_send": 0, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "command_resend": 0, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "map_epoch": 114, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "map_full": 0, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "map_inc": 44, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_sessions": 11, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_open": 11, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_close": 0, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_laggy": 0, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_wr": 0, 2024-08-31T06:30:51.138 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_rd": 2, 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_del": 0 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: "oft": { 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_objs": 0, 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_updates": 0, 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_removes": 0 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: "purge_queue": { 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops": 0, 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T06:30:51.139 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing": 0, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_high_water": 0, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed_ops": 0, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed": 0, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_item_in_journal": 0 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 6845, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 263638901, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 6845, 2024-08-31T06:30:51.140 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 6845, 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 263638901, 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_bytes": { 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:51.141 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 6262, 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 261156392, 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 6262, 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 261156392, 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:51.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_ops": { 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 1024, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 6262, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 6262, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 6262, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 6262, 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:51.143 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:51.144 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle-0x55a24a9d0750": { 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:51.145 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:51.146 INFO:teuthology.orchestra.run.smithi130.stdout: "trackedop": { 2024-08-31T06:30:51.147 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_ops_count": 0 2024-08-31T06:30:51.147 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:51.147 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-31T06:30:51.936 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-31T06:30:51.936 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-31T06:30:51.936 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-08-31T06:30:51.936 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-08-31T06:30:51.937 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-08-31T06:30:51.937 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:30:51.937 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:30:51.937 DEBUG:tasks.check_counter:Getting stats from h 2024-08-31T06:30:51.937 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-31T06:30:52.189 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:30:52.309 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:52 smithi130 ceph-mon[22266]: pgmap v1140: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-08-31T06:30:52.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:52 smithi153 ceph-mon[22320]: pgmap v1140: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-08-31T06:30:52.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:52 smithi053 ceph-mon[18924]: pgmap v1140: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-08-31T06:30:52.752 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-31T06:30:52.752 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:30:52.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 498188, 2024-08-31T06:30:52.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 525728, 2024-08-31T06:30:52.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 147960293, 2024-08-31T06:30:52.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 351838838, 2024-08-31T06:30:52.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 68, 2024-08-31T06:30:52.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 9, 2024-08-31T06:30:52.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 31.468459328, 2024-08-31T06:30:52.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 15.959641067, 2024-08-31T06:30:52.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 18.888342375, 2024-08-31T06:30:52.754 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.271566408, 2024-08-31T06:30:52.754 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:52.754 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 525726, 2024-08-31T06:30:52.754 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 9.223556229, 2024-08-31T06:30:52.754 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000017544 2024-08-31T06:30:52.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.754 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:52.754 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 987187, 2024-08-31T06:30:52.754 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.168037836, 2024-08-31T06:30:52.754 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000170 2024-08-31T06:30:52.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 928, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 736 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 126434, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 125943, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 36520753, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 120540950, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 17, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 7, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 8.338555457, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 4.083358758, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 4.543371550, 2024-08-31T06:30:52.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.426530096, 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 125942, 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 2.585727010, 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000020531 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 221552, 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.039303746, 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000177 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 6272, 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 726208 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.756 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 322920, 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 283788, 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 109763805, 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 154677318, 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 14, 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 7, 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 20.002745182, 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 10.200846606, 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 12.224762678, 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.301838415, 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 283787, 2024-08-31T06:30:52.757 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 5.499576716, 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000019379 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 578080, 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.094484579, 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000163 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 1435008, 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 337952 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 1, 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.758 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-MDSRank": { 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 48607, 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 20.026953322, 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000412017 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-PurgeQueue": { 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 11484, 2024-08-31T06:30:52.759 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.677509184, 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000058995 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": { 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: "request": 369010, 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: "reply": 348831, 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: "reply_latency": { 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 348831, 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 411.133335225, 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.001178603 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_reply": 0, 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: "forward": 20179, 2024-08-31T06:30:52.760 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_complete": 2, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_keys": 0, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_commit": 19, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_split": 1, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_merge": 0, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes": 2739, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_top": 956, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_bottom": 1658, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pin_tail": 125, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pinned": 1291, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_expired": 1764, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_with_caps": 1, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": 1, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "subtrees": 6, 2024-08-31T06:30:52.761 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse": 724877, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_hit": 693487, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_forward": 4477, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_discover": 585, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_remote_ino": 0, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_lock": 149, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "load_cent": 0, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "q": 0, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "exported": 47, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "exported_inodes": 1203, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "imported": 82, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "imported_inodes": 2857, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_dir_fetch": 0, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_backtrace_fetch": 1533, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_peer_discover": 0, 2024-08-31T06:30:52.762 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rfiles": 126, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rbytes": 37209000, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rsnaps": 6, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_fetch": 1533, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_set_tag": 0, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_inodes": 405, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dirfrag_rstats": 405, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_file_inodes": 1128, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_inode_file_caps": 134, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_revoke": 18753, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_grant": 13169, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:30:52.763 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps": 25447, 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps_dirty": 5223, 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_cap_release": 590, 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "process_request_cap_release": 16628 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_cache": { 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update": 733, 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update_receipt": 5014, 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_try_discover": 2645, 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_send_discover": 5230, 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_handle_discover": 6028, 2024-08-31T06:30:52.764 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays": 30, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_delayed": 0, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_created": 4693, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_enqueued": 4663, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_reintegrated": 0, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_migrated": 0, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_processing": 0, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_started": 0, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_completed": 0, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_path": 21, 2024-08-31T06:30:52.765 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_inode": 2185, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_exportdir": 51, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_flush": 0, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragmentdir": 1, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragstats": 0, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_inodestats": 0, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_started": 0, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_succeeded": 0, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_write_failed": 0 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_log": { 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "evlrg": 0, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "evadd": 47787, 2024-08-31T06:30:52.766 INFO:teuthology.orchestra.run.smithi130.stdout: "evex": 0, 2024-08-31T06:30:52.767 INFO:teuthology.orchestra.run.smithi130.stdout: "evtrm": 0, 2024-08-31T06:30:52.767 INFO:teuthology.orchestra.run.smithi130.stdout: "ev": 47787, 2024-08-31T06:30:52.767 INFO:teuthology.orchestra.run.smithi130.stdout: "evexg": 0, 2024-08-31T06:30:52.767 INFO:teuthology.orchestra.run.smithi130.stdout: "evexd": 0, 2024-08-31T06:30:52.767 INFO:teuthology.orchestra.run.smithi130.stdout: "segadd": 78, 2024-08-31T06:30:52.767 INFO:teuthology.orchestra.run.smithi130.stdout: "segex": 0, 2024-08-31T06:30:52.767 INFO:teuthology.orchestra.run.smithi130.stdout: "segtrm": 0, 2024-08-31T06:30:52.767 INFO:teuthology.orchestra.run.smithi130.stdout: "seg": 78, 2024-08-31T06:30:52.767 INFO:teuthology.orchestra.run.smithi130.stdout: "segmjr": 5, 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: "segexg": 0, 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: "segexd": 0, 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: "expos": 4194304, 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: "wrpos": 229983179, 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: "rdpos": 0, 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: "jlat": { 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 24673, 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 118.897092636, 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.004818915 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: "replayed": 0 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.768 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_mem": { 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "ino": 2314, 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "ino+": 8296, 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "ino-": 5982, 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "dir": 111, 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "dir+": 2813, 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "dir-": 2702, 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "dn": 2741, 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "dn+": 12023, 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "dn-": 9282, 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "cap": 1, 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "cap+": 4974, 2024-08-31T06:30:52.769 INFO:teuthology.orchestra.run.smithi130.stdout: "cap-": 4973, 2024-08-31T06:30:52.770 INFO:teuthology.orchestra.run.smithi130.stdout: "rss": 145604, 2024-08-31T06:30:52.770 INFO:teuthology.orchestra.run.smithi130.stdout: "heap": 353247232 2024-08-31T06:30:52.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.770 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_server": { 2024-08-31T06:30:52.770 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_client_request": 395974, 2024-08-31T06:30:52.770 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_server_request": 24608, 2024-08-31T06:30:52.770 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_request": 369010, 2024-08-31T06:30:52.771 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_session": 334, 2024-08-31T06:30:52.771 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_peer_request": 54444, 2024-08-31T06:30:52.771 INFO:teuthology.orchestra.run.smithi130.stdout: "req_create_latency": { 2024-08-31T06:30:52.771 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 4637, 2024-08-31T06:30:52.771 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 48.664906425, 2024-08-31T06:30:52.771 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.010494911 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getattr_latency": { 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 321953, 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 116.399891926, 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000361543 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getfilelock_latency": { 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: "req_link_latency": { 2024-08-31T06:30:52.772 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookup_latency": { 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 6722, 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 13.718819200, 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.002040883 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookuphash_latency": { 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupino_latency": { 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupname_latency": { 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupparent_latency": { 2024-08-31T06:30:52.774 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupsnap_latency": { 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lssnap_latency": { 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.775 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mkdir_latency": { 2024-08-31T06:30:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mknod_latency": { 2024-08-31T06:30:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mksnap_latency": { 2024-08-31T06:30:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: "req_open_latency": { 2024-08-31T06:30:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2453, 2024-08-31T06:30:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 1.774553708, 2024-08-31T06:30:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000723421 2024-08-31T06:30:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: "req_readdir_latency": { 2024-08-31T06:30:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 7468, 2024-08-31T06:30:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 16.762491594, 2024-08-31T06:30:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.002244575 2024-08-31T06:30:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rename_latency": { 2024-08-31T06:30:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 867, 2024-08-31T06:30:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 27.875685830, 2024-08-31T06:30:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.032151886 2024-08-31T06:30:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: "req_renamesnap_latency": { 2024-08-31T06:30:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: "req_snapdiff_latency": { 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmdir_latency": { 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 30, 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.192084559, 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.006402818 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmsnap_latency": { 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmxattr_latency": { 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setattr_latency": { 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 6, 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 35.803006832, 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 5.967167805 2024-08-31T06:30:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setdirlayout_latency": { 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setfilelock_latency": { 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 32, 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.011809314, 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000369041 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setlayout_latency": { 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.782 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.782 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setxattr_latency": { 2024-08-31T06:30:52.782 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.782 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.782 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.782 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.782 INFO:teuthology.orchestra.run.smithi130.stdout: "req_symlink_latency": { 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "req_unlink_latency": { 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 4663, 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 149.930085837, 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.032153138 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getvxattr_latency": { 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.784 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:52.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.784 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_sessions": { 2024-08-31T06:30:52.784 INFO:teuthology.orchestra.run.smithi130.stdout: "session_count": 2, 2024-08-31T06:30:52.784 INFO:teuthology.orchestra.run.smithi130.stdout: "session_add": 3, 2024-08-31T06:30:52.784 INFO:teuthology.orchestra.run.smithi130.stdout: "session_remove": 1, 2024-08-31T06:30:52.784 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_open": 2, 2024-08-31T06:30:52.784 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_stale": 0, 2024-08-31T06:30:52.784 INFO:teuthology.orchestra.run.smithi130.stdout: "total_load": 40188, 2024-08-31T06:30:52.784 INFO:teuthology.orchestra.run.smithi130.stdout: "average_load": 20094, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "avg_session_uptime": 1567, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "mdthresh_evicted": 0 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:30:52.785 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:30:52.786 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 552802, 2024-08-31T06:30:52.787 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 178, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 8352, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 184, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-31T06:30:52.788 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 7248286, 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 26427, 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "objecter": { 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "op_active": 0, 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "op_laggy": 0, 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send": 34636, 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send_bytes": 226694817, 2024-08-31T06:30:52.789 INFO:teuthology.orchestra.run.smithi130.stdout: "op_resend": 33, 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "op_reply": 34636, 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "op_latency": { 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 34636, 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 141.822257575, 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.004094648 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "op_inflight": 0, 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "oplen_avg": { 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 34636, 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 36028 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "op": 34636, 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "op_r": 2587, 2024-08-31T06:30:52.790 INFO:teuthology.orchestra.run.smithi130.stdout: "op_w": 32049, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "op_rmw": 0, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "op_pg": 0, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_stat": 0, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_create": 10, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_read": 1052, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_write": 25725, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writefull": 679, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writesame": 0, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_append": 0, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_zero": 0, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_truncate": 1, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_delete": 4728, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_mapext": 0, 2024-08-31T06:30:52.791 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_sparse_read": 0, 2024-08-31T06:30:52.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_clonerange": 0, 2024-08-31T06:30:52.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_getxattr": 1535, 2024-08-31T06:30:52.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_setxattr": 20, 2024-08-31T06:30:52.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:30:52.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_rmxattr": 0, 2024-08-31T06:30:52.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:30:52.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_call": 0, 2024-08-31T06:30:52.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_watch": 0, 2024-08-31T06:30:52.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_notify": 0, 2024-08-31T06:30:52.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:30:52.792 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_other": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_active": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_send": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_resend": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_ping": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_active": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_send": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_resend": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_active": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_send": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_resend": 0, 2024-08-31T06:30:52.793 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_active": 0, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_send": 0, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_resend": 0, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "command_active": 0, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "command_send": 0, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "command_resend": 0, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "map_epoch": 114, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "map_full": 0, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "map_inc": 44, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_sessions": 12, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_open": 12, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_close": 0, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_laggy": 0, 2024-08-31T06:30:52.794 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_wr": 1572, 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_rd": 4, 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_del": 702 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: "oft": { 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_objs": 1, 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_updates": 0, 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_removes": 0 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: "purge_queue": { 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops": 0, 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops_high_water": 6, 2024-08-31T06:30:52.795 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing": 0, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_high_water": 6, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed_ops": 4663, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed": 4663, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_item_in_journal": 0 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 947538, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 208929016, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 947538, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:52.796 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 947538, 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 208929016, 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_bytes": { 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:52.797 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 34636, 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 227169692, 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 34636, 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 227169692, 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.798 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_ops": { 2024-08-31T06:30:52.799 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:52.799 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 1024, 2024-08-31T06:30:52.799 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:52.799 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:52.799 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:52.799 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:52.799 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:52.799 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 34636, 2024-08-31T06:30:52.799 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 34636, 2024-08-31T06:30:52.799 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 34636, 2024-08-31T06:30:52.799 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 34636, 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 4663, 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 474907, 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:52.800 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 4663, 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 1052, 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 474907, 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle-0x558fdf8b28f0": { 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-31T06:30:52.801 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:52.802 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 47787, 2024-08-31T06:30:52.802 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 225788875, 2024-08-31T06:30:52.802 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:52.802 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 47787, 2024-08-31T06:30:52.802 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:52.802 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:52.802 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 24673, 2024-08-31T06:30:52.802 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 225788875, 2024-08-31T06:30:52.802 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:52.802 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:52.802 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:52.803 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:52.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:52.803 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:52.803 INFO:teuthology.orchestra.run.smithi130.stdout: "trackedop": { 2024-08-31T06:30:52.803 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_ops_count": 1938 2024-08-31T06:30:52.803 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:52.803 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-31T06:30:53.467 INFO:tasks.check_counter:Daemon mds.h mds.exported=47 2024-08-31T06:30:53.467 INFO:tasks.check_counter:Daemon mds.h mds.imported=82 2024-08-31T06:30:53.468 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=733 2024-08-31T06:30:53.468 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=5014 2024-08-31T06:30:53.468 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-08-31T06:30:53.468 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:30:53.468 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:30:53.468 DEBUG:tasks.check_counter:Getting stats from k 2024-08-31T06:30:53.468 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-31T06:30:53.714 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:30:54.110 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:54 smithi130 ceph-mon[22266]: pgmap v1141: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-31T06:30:54.251 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-31T06:30:54.251 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 3579, 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 3579, 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 84934893, 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 1137305, 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 8, 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 4, 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.391245965, 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.155205395, 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.121777582, 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.089747757, 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:54.252 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 3578, 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.114604454, 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000032030 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:30:54.253 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 1724, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 1651, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 77189016, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 657030, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 6, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 5, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.213239999, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.078627387, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.114479969, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.026822681, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1650, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.051243031, 2024-08-31T06:30:54.254 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000031056 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 1402752, 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 294448 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 1284, 2024-08-31T06:30:54.255 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 1635, 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 98775374, 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 1207884, 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 8, 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 5, 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.186852166, 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.063307539, 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.082891861, 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.029896704, 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1633, 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.054116668, 2024-08-31T06:30:54.256 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000033139 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 800208 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 1, 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-31T06:30:54.257 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-MDSRank": { 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 10209, 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.225398841, 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000022078 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-PurgeQueue": { 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.258 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": { 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: "request": 0, 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: "reply": 0, 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: "reply_latency": { 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_reply": 0, 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: "forward": 0, 2024-08-31T06:30:54.259 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_complete": 0, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_keys": 0, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_commit": 0, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_split": 0, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_merge": 0, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes": 9035, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_top": 244, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_bottom": 8791, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pin_tail": 0, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pinned": 8685, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_expired": 0, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_with_caps": 0, 2024-08-31T06:30:54.260 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "subtrees": 1, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_hit": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_forward": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_discover": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_remote_ino": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_lock": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "load_cent": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "q": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "exported": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "exported_inodes": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "imported": 0, 2024-08-31T06:30:54.261 INFO:teuthology.orchestra.run.smithi130.stdout: "imported_inodes": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_dir_fetch": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_backtrace_fetch": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_peer_discover": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rfiles": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rbytes": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rsnaps": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_set_tag": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_inodes": 0, 2024-08-31T06:30:54.262 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_file_inodes": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_inode_file_caps": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_grant": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps_dirty": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_cap_release": 0, 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: "process_request_cap_release": 0 2024-08-31T06:30:54.263 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_cache": { 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update": 0, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update_receipt": 0, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_try_discover": 0, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_send_discover": 0, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_handle_discover": 0, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays": 0, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_delayed": 0, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_created": 0, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_enqueued": 0, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_reintegrated": 0, 2024-08-31T06:30:54.264 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_migrated": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_processing": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_started": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_completed": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_path": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_inode": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_exportdir": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_flush": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragmentdir": 0, 2024-08-31T06:30:54.265 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragstats": 0, 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_inodestats": 0, 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_started": 0, 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_succeeded": 0, 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "uninline_write_failed": 0 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_log": { 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "evlrg": 0, 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "evadd": 0, 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "evex": 0, 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "evtrm": 0, 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "ev": 72420, 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "evexg": 0, 2024-08-31T06:30:54.266 INFO:teuthology.orchestra.run.smithi130.stdout: "evexd": 0, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "segadd": 0, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "segex": 0, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "segtrm": 0, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "seg": 105, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "segmjr": 7, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "segexg": 0, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "segexd": 0, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "expos": 4194304, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "wrpos": 262025660, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "rdpos": 262003189, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "jlat": { 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.267 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: "replayed": 72420 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_mem": { 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: "ino": 2314, 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: "ino+": 10578, 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: "ino-": 8264, 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: "dir": 83, 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: "dir+": 155, 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: "dir-": 72, 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: "dn": 9035, 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: "dn+": 11309, 2024-08-31T06:30:54.268 INFO:teuthology.orchestra.run.smithi130.stdout: "dn-": 2274, 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "cap": 0, 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "cap+": 0, 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "cap-": 0, 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "rss": 133196, 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "heap": 337989632 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_server": { 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_client_request": 0, 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_server_request": 0, 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_request": 0, 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_session": 0, 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_peer_request": 0, 2024-08-31T06:30:54.269 INFO:teuthology.orchestra.run.smithi130.stdout: "req_create_latency": { 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getattr_latency": { 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getfilelock_latency": { 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.270 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "req_link_latency": { 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookup_latency": { 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookuphash_latency": { 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.271 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupino_latency": { 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupname_latency": { 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupparent_latency": { 2024-08-31T06:30:54.272 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.273 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.273 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.273 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupsnap_latency": { 2024-08-31T06:30:54.273 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.273 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.273 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.273 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.273 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lssnap_latency": { 2024-08-31T06:30:54.274 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.274 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.274 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.274 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mkdir_latency": { 2024-08-31T06:30:54.274 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.274 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.274 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.274 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.274 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mknod_latency": { 2024-08-31T06:30:54.274 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mksnap_latency": { 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: "req_open_latency": { 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.275 INFO:teuthology.orchestra.run.smithi130.stdout: "req_readdir_latency": { 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rename_latency": { 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: "req_renamesnap_latency": { 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.276 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "req_snapdiff_latency": { 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmdir_latency": { 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmsnap_latency": { 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.277 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.278 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmxattr_latency": { 2024-08-31T06:30:54.278 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.278 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.278 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.278 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setattr_latency": { 2024-08-31T06:30:54.278 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.278 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.278 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.278 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.278 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setdirlayout_latency": { 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setfilelock_latency": { 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setlayout_latency": { 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.279 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setxattr_latency": { 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: "req_symlink_latency": { 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi130.stdout: "req_unlink_latency": { 2024-08-31T06:30:54.281 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.281 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.281 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.281 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.281 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:30:54.281 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:30:54.281 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getvxattr_latency": { 2024-08-31T06:30:54.281 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.281 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.281 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.281 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_sessions": { 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: "session_count": 2, 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: "session_add": 3, 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: "session_remove": 1, 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_open": 2, 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_stale": 0, 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: "total_load": 0, 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: "average_load": 0, 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: "avg_session_uptime": 2562, 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: "mdthresh_evicted": 0 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.282 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:30:54.283 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 242567, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 86, 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 8352, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 184, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-31T06:30:54.286 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 11355025, 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 45827, 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "objecter": { 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "op_active": 0, 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "op_laggy": 0, 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send": 5997, 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send_bytes": 21, 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "op_resend": 3, 2024-08-31T06:30:54.287 INFO:teuthology.orchestra.run.smithi130.stdout: "op_reply": 5997, 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: "op_latency": { 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 5997, 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 4.282916196, 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000714176 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: "op_inflight": 0, 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: "oplen_avg": { 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 5997, 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 5998 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: "op": 5997, 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: "op_r": 5997, 2024-08-31T06:30:54.288 INFO:teuthology.orchestra.run.smithi130.stdout: "op_w": 0, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "op_rmw": 0, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "op_pg": 0, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_stat": 3305, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_create": 0, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_read": 2690, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_write": 0, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writefull": 0, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writesame": 0, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_append": 0, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_zero": 0, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_truncate": 0, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_delete": 0, 2024-08-31T06:30:54.289 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_mapext": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_sparse_read": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_clonerange": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_getxattr": 1, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_setxattr": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_rmxattr": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_call": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_watch": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_notify": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:30:54.290 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_other": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_active": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_send": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_resend": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_ping": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_active": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_send": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_resend": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_active": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_send": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_resend": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_active": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_send": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_resend": 0, 2024-08-31T06:30:54.291 INFO:teuthology.orchestra.run.smithi130.stdout: "command_active": 0, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "command_send": 0, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "command_resend": 0, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "map_epoch": 114, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "map_full": 0, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "map_inc": 44, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_sessions": 11, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_open": 12, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_close": 1, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_laggy": 0, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_wr": 0, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_rd": 2, 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_del": 0 2024-08-31T06:30:54.292 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "oft": { 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_objs": 0, 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_updates": 0, 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_removes": 0 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "purge_queue": { 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops": 0, 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing": 0, 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_high_water": 0, 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed_ops": 0, 2024-08-31T06:30:54.293 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed": 0, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_item_in_journal": 0 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 6583, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 260274169, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 6583, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 6583, 2024-08-31T06:30:54.294 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 260274169, 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_bytes": { 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:54.295 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 5997, 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 257831361, 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 5997, 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 257831361, 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.296 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_ops": { 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 1024, 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 5997, 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 5997, 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 5997, 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 5997, 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:54.297 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:54.298 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle-0x55dc1b11c8f0": { 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-31T06:30:54.299 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "trackedop": { 2024-08-31T06:30:54.300 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_ops_count": 0 2024-08-31T06:30:54.301 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-31T06:30:54.301 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-31T06:30:54.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:54 smithi153 ceph-mon[22320]: pgmap v1141: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-31T06:30:54.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:54 smithi053 ceph-mon[18924]: pgmap v1141: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-31T06:30:55.118 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-08-31T06:30:55.119 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-08-31T06:30:55.119 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-08-31T06:30:55.119 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-08-31T06:30:55.119 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-08-31T06:30:55.119 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:30:55.119 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:30:55.119 DEBUG:tasks.check_counter:Getting stats from c 2024-08-31T06:30:55.119 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-31T06:30:55.448 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:30:56.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:56 smithi153 ceph-mon[22320]: pgmap v1142: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-08-31T06:30:56.194 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-31T06:30:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:30:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 332424, 2024-08-31T06:30:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 361579, 2024-08-31T06:30:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 99249039, 2024-08-31T06:30:56.194 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 302537707, 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 67, 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 9, 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 25.217954212, 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 13.251399029, 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 14.139889414, 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.407405000, 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 361575, 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 10.698001855, 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000029587 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.195 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 664992, 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.134040935, 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000201 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3168, 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 15712 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 169523, 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 171438, 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 48888471, 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 155304699, 2024-08-31T06:30:56.196 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 10, 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 6, 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 12.784322247, 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 6.729324663, 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 7.107392058, 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.353768592, 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 171439, 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 6.494865212, 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000037884 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 321450, 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.059722164, 2024-08-31T06:30:56.197 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000185 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 711856 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 271382, 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 226927, 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 93053635, 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 113325119, 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 21, 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 7, 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 18.525436196, 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 9.267103740, 2024-08-31T06:30:56.198 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 11.276358442, 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.472195827, 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 226926, 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 7.399331927, 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000032606 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 474214, 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.088730796, 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000187 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1428800, 2024-08-31T06:30:56.199 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 319168 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 23933, 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 25.765843858, 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001076582 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.200 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 14112, 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.144527974, 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000081103 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 293341, 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 290239, 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 290239, 2024-08-31T06:30:56.201 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 646.927773574, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.002228948 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 3102, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 55, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 5, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 1887, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 242, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 1589, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 56, 2024-08-31T06:30:56.202 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 1541, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 463, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 0, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 0, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 6, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 568729, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 543527, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 3102, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 529, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 342, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 10, 2024-08-31T06:30:56.203 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 182, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 3, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 187, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 2103, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 126, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 37209000, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 6, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 2103, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:30:56.204 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 260, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 260, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 1843, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 2, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 19349, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 19342, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 30149, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 7865, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 621, 2024-08-31T06:30:56.205 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 22511 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 605, 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 8452, 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 4289, 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 9096, 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 849, 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 20, 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 6227, 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 6207, 2024-08-31T06:30:56.206 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_path": 21, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_inode": 2814, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 10, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 5, 2024-08-31T06:30:56.207 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0, 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_started": 0, 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_succeeded": 0, 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_write_failed": 0 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 0, 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 43285, 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 43285, 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-08-31T06:30:56.208 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 67, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 67, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 5, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 4194304, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 210585911, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 0, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 11974, 2024-08-31T06:30:56.209 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 62.707847053, 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.005237000 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 0 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 1596, 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 8123, 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 6527, 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 72, 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 4727, 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 4655, 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 1887, 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 12180, 2024-08-31T06:30:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 10293, 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 0, 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 6296, 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 6296, 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 142532, 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 350101504 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 320514, 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 562, 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 293341, 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 702, 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 1584, 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-08-31T06:30:56.211 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6092, 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 179.152142796, 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.029407771 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 243579, 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 103.778745385, 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000426057 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 10970, 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 12.412992559, 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001131539 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.213 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.214 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-08-31T06:30:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.216 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4562, 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 3.957499724, 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000867492 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-08-31T06:30:56.217 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 17289, 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 57.573454447, 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.003330062 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1330, 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.739272161, 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.003563362 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.218 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 20, 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.186287882, 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.009314394 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6, 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 166.607989641, 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 27.767998273 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.220 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 184, 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.068661426, 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000373159 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.221 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6207, 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 118.450727553, 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.019083410 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.222 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 2, 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 2, 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 0, 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 2, 2024-08-31T06:30:56.223 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 33849, 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 16924, 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 1570, 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:30:56.224 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:30:56.225 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:30:56.226 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 457335, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 155, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-08-31T06:30:56.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8352, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 184, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 5010091, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 21140, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-08-31T06:30:56.228 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 24156, 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 208121968, 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 33, 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 24156, 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 24156, 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 94.983464582, 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.003932085 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-08-31T06:30:56.229 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 24156, 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 25562 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 24156, 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 3219, 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 20937, 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 0, 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 10, 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 1116, 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 13090, 2024-08-31T06:30:56.230 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 687, 2024-08-31T06:30:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-08-31T06:30:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-08-31T06:30:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-08-31T06:30:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 5, 2024-08-31T06:30:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 6268, 2024-08-31T06:30:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-08-31T06:30:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-08-31T06:30:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-08-31T06:30:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 2103, 2024-08-31T06:30:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 20, 2024-08-31T06:30:56.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-08-31T06:30:56.232 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-08-31T06:30:56.233 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 114, 2024-08-31T06:30:56.234 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-08-31T06:30:56.234 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 44, 2024-08-31T06:30:56.234 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 12, 2024-08-31T06:30:56.234 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 12, 2024-08-31T06:30:56.234 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-08-31T06:30:56.234 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-08-31T06:30:56.234 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 1563, 2024-08-31T06:30:56.234 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 0, 2024-08-31T06:30:56.234 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 700 2024-08-31T06:30:56.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 1, 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 6, 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 6, 2024-08-31T06:30:56.235 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed_ops": 6207, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 6207, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 773325, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 171555032, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 773325, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:30:56.236 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 773325, 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 171555032, 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-08-31T06:30:56.237 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 24156, 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 208757499, 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 24156, 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 208757499, 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-08-31T06:30:56.238 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 24156, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 24156, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 24156, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 24156, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.239 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 6207, 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 635531, 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 6207, 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 1116, 2024-08-31T06:30:56.240 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 635531, 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x564f8b4e08f0": { 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 43285, 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 206391607, 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:56.241 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 43285, 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 11974, 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 206391607, 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: "trackedop": { 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 2488 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:56.242 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-31T06:30:56.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:56 smithi130 ceph-mon[22266]: pgmap v1142: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-08-31T06:30:56.476 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:56 smithi053 ceph-mon[18924]: pgmap v1142: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-08-31T06:30:57.310 INFO:tasks.check_counter:Daemon mds.c mds.exported=10 2024-08-31T06:30:57.311 INFO:tasks.check_counter:Daemon mds.c mds.imported=3 2024-08-31T06:30:57.311 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=605 2024-08-31T06:30:57.311 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=8452 2024-08-31T06:30:57.311 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-08-31T06:30:57.311 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:30:57.311 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:30:57.311 DEBUG:tasks.check_counter:Getting stats from f 2024-08-31T06:30:57.311 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-31T06:30:57.560 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:30:58.100 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-31T06:30:58.100 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:30:58.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 262055, 2024-08-31T06:30:58.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 222219, 2024-08-31T06:30:58.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 92577171, 2024-08-31T06:30:58.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 133167862, 2024-08-31T06:30:58.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 11, 2024-08-31T06:30:58.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 5, 2024-08-31T06:30:58.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 19.064640290, 2024-08-31T06:30:58.101 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 9.171801321, 2024-08-31T06:30:58.101 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 11.111759445, 2024-08-31T06:30:58.101 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 1.146194390, 2024-08-31T06:30:58.101 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:58.101 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 222217, 2024-08-31T06:30:58.101 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 6.708433249, 2024-08-31T06:30:58.101 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000030188 2024-08-31T06:30:58.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.101 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:58.101 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 449166, 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.086704967, 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000193 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 248911, 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 299651, 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 77693135, 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 252508303, 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 46, 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 8, 2024-08-31T06:30:58.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 20.694474456, 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 10.860249882, 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 11.073792055, 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.669372647, 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 299649, 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 9.604655050, 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000032053 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 511201, 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.111660232, 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000218 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1422672, 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 711808 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 186395, 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 170042, 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 58560876, 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 149375544, 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 44, 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 8, 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 14.120087382, 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 7.143257647, 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 7.664333229, 2024-08-31T06:30:58.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.776107463, 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 170042, 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 5.986113845, 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000035203 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 319936, 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.062703447, 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000195 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 405200 2024-08-31T06:30:58.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 46649, 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 41.026154831, 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000879464 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.106 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 21793, 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.930879007, 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000088600 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 199418, 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 197915, 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 197915, 2024-08-31T06:30:58.107 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 975.787713927, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.004930337 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 1503, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 5, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 91, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 9, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 1, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 747, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 4, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 5, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 738, 2024-08-31T06:30:58.108 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 741, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 3612, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 0, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 0, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 6, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 409815, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 337515, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 1501, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 387, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 167, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 3, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-08-31T06:30:58.109 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 82, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 2877, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 34, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 1012, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 3199, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 126, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 37209000, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 6, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 3199, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 130, 2024-08-31T06:30:58.110 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 130, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 3069, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 44, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 22462, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 30799, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 37382, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 11609, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 538, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 38925 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 4441, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 4939, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 2536, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 5202, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 5008, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 10, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 11123, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 11113, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-08-31T06:30:58.112 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_path": 21, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_inode": 3768, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 111, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 10, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_started": 0, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_succeeded": 0, 2024-08-31T06:30:58.113 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_write_failed": 0 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 0, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 99110, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 99110, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 126, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 126, 2024-08-31T06:30:58.114 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 10, 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 4194304, 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 217342449, 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 0, 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 24006, 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 130.942089802, 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.005454556 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 0 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-08-31T06:30:58.115 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 605, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 14752, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 14147, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 49, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 2825, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 2776, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 747, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 22011, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 21264, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 0, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 11235, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 11235, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 148608, 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 356397056 2024-08-31T06:30:58.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 269129, 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 1220, 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 199418, 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 812, 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 18562, 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 10898, 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 416.014242647, 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.038173448 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 125015, 2024-08-31T06:30:58.117 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 58.603973086, 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000468775 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-08-31T06:30:58.118 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 14654, 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 18.913693515, 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001290684 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-08-31T06:30:58.119 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.120 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.120 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.120 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-08-31T06:30:58.120 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.120 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-08-31T06:30:58.122 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6441, 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 6.551711323, 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001017188 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 27390, 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 44.414612995, 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001621563 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.123 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1936, 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 85.849571071, 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.044343786 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 10, 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.131412261, 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.013141226 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.125 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.126 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-08-31T06:30:58.126 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2, 2024-08-31T06:30:58.126 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 27.802319257, 2024-08-31T06:30:58.126 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 13.901159628 2024-08-31T06:30:58.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.126 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-08-31T06:30:58.126 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.126 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.126 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 456, 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.259484755, 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000569045 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.127 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 11113, 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 317.246693017, 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.028547349 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:30:58.128 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 1, 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 1, 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 0, 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 1, 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 26946, 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 26946, 2024-08-31T06:30:58.129 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 1592, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:30:58.130 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:30:58.131 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 368765, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 129, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:30:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8352, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 184, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 2088928, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 8957, 2024-08-31T06:30:58.133 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 41498, 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 215960409, 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 32, 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 41498, 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 41498, 2024-08-31T06:30:58.134 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 185.183011592, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.004462456 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 41498, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 42655 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 41498, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 4164, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 37334, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 0, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 10, 2024-08-31T06:30:58.135 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 958, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 24964, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 538, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 9, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 11177, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 3199, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 20, 2024-08-31T06:30:58.136 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-08-31T06:30:58.137 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 114, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 44, 2024-08-31T06:30:58.138 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 12, 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 15, 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 3, 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 1228, 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 12, 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 540 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 1, 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.139 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 6, 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 6, 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed_ops": 11113, 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 11113, 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:58.140 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 697357, 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 166033774, 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 697357, 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 697357, 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 166033774, 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.141 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 41498, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 217097836, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 41498, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 217097836, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.142 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 41498, 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 41498, 2024-08-31T06:30:58.143 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 41498, 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 41498, 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 11113, 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 1137565, 2024-08-31T06:30:58.144 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 11113, 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 958, 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 1137565, 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x5590d1c725b0": { 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:58.145 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 99110, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 213148145, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 99110, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 24006, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 213148145, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:58.146 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:58.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:58.147 INFO:teuthology.orchestra.run.smithi153.stdout: "trackedop": { 2024-08-31T06:30:58.147 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 3238 2024-08-31T06:30:58.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:58.147 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-31T06:30:58.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:30:58 smithi130 ceph-mon[22266]: pgmap v1143: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-31T06:30:58.413 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:30:58 smithi153 ceph-mon[22320]: pgmap v1143: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-31T06:30:58.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:30:58 smithi053 ceph-mon[18924]: pgmap v1143: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-31T06:30:58.901 INFO:tasks.check_counter:Daemon mds.f mds.exported=82 2024-08-31T06:30:58.901 INFO:tasks.check_counter:Daemon mds.f mds.imported=34 2024-08-31T06:30:58.901 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=4441 2024-08-31T06:30:58.901 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=4939 2024-08-31T06:30:58.901 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-08-31T06:30:58.901 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:30:58.901 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:30:58.901 DEBUG:tasks.check_counter:Getting stats from i 2024-08-31T06:30:58.902 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-31T06:30:59.148 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:30:59.659 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-31T06:30:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:30:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 628860, 2024-08-31T06:30:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 669557, 2024-08-31T06:30:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 190357882, 2024-08-31T06:30:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 435513369, 2024-08-31T06:30:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 73, 2024-08-31T06:30:59.659 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 5, 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 47.354961411, 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 25.627347397, 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 26.940174581, 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.377698219, 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 669555, 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 21.699048385, 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000032408 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1248274, 2024-08-31T06:30:59.660 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.239645551, 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000191 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 1440 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 208318, 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 180613, 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 71381640, 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 130305221, 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 12, 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 7, 2024-08-31T06:30:59.661 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 14.232749749, 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 6.809049439, 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 8.576151000, 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.501725532, 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 180611, 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 5.544774957, 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000030700 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 361301, 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.070740229, 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000195 2024-08-31T06:30:59.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3328, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 728912 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 130734, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 131553, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 38037975, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 144656605, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 15, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 7, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 10.421196541, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 5.092904588, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 5.485866936, 2024-08-31T06:30:59.663 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.705241330, 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 131553, 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 5.423050706, 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000041223 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 222271, 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.049922093, 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000224 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1441872, 2024-08-31T06:30:59.664 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 328544 2024-08-31T06:30:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-08-31T06:30:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-08-31T06:30:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-08-31T06:30:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-08-31T06:30:59.665 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 58111, 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 28.827464834, 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000496075 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 15427, 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.961726267, 2024-08-31T06:30:59.666 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000062340 2024-08-31T06:30:59.667 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:59.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.667 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-08-31T06:30:59.667 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 381466, 2024-08-31T06:30:59.667 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 366811, 2024-08-31T06:30:59.667 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-08-31T06:30:59.668 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 366811, 2024-08-31T06:30:59.668 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 556.187701542, 2024-08-31T06:30:59.668 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001516278 2024-08-31T06:30:59.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.668 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-08-31T06:30:59.668 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 14655, 2024-08-31T06:30:59.668 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 29, 2024-08-31T06:30:59.668 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-08-31T06:30:59.668 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 46, 2024-08-31T06:30:59.668 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 4, 2024-08-31T06:30:59.668 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 2722, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 350, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 2296, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 76, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 2207, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 2853, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 2, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 2, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 6, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 748930, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 709103, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 3523, 2024-08-31T06:30:59.669 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 475, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 244, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 64, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 2211, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 78, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 3009, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 2548, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-08-31T06:30:59.670 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 126, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 37209000, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 6, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 2548, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 390, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 390, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 2158, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 331, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 22336, 2024-08-31T06:30:59.671 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 20059, 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 1, 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 35462, 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 10826, 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 775, 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 23951 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 1822, 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 4770, 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 2506, 2024-08-31T06:30:59.672 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 4961, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 4973, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 30, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 6308, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 6278, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-08-31T06:30:59.673 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_path": 21, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_inode": 2907, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 68, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 6, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_started": 0, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_succeeded": 0, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_write_failed": 0 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 0, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 72420, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 72420, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 105, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 105, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 7, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-08-31T06:30:59.675 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 4194304, 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 262025660, 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 0, 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 29516, 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 125.419541585, 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.004249205 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 0 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 2283, 2024-08-31T06:30:59.676 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 10985, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 8702, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 109, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 2686, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 2577, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 2722, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 15471, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 12749, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 2, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 6559, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 6557, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 145056, 2024-08-31T06:30:59.677 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 352206848 2024-08-31T06:30:59.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.678 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-08-31T06:30:59.678 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 419087, 2024-08-31T06:30:59.678 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 20406, 2024-08-31T06:30:59.678 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 381466, 2024-08-31T06:30:59.678 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 635, 2024-08-31T06:30:59.678 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 48214, 2024-08-31T06:30:59.678 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-08-31T06:30:59.678 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6208, 2024-08-31T06:30:59.678 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 244.810537141, 2024-08-31T06:30:59.678 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.039434687 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 317999, 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 135.705658035, 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000426748 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.679 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.680 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.680 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-08-31T06:30:59.680 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 10866, 2024-08-31T06:30:59.680 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 22.947931774, 2024-08-31T06:30:59.680 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.002111902 2024-08-31T06:30:59.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.680 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-08-31T06:30:59.680 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.680 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.682 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-08-31T06:30:59.682 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.682 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.682 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.683 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-08-31T06:30:59.683 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.683 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.683 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.683 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-08-31T06:30:59.683 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.683 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.683 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.684 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-08-31T06:30:59.684 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.684 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.684 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.684 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-08-31T06:30:59.684 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.684 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 5224, 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.113939950, 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000787507 2024-08-31T06:30:59.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 18212, 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 29.448700202, 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001616994 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1697, 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 47.360004893, 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.027908075 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.686 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 30, 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.222482810, 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.007416093 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.687 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.688 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.688 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-08-31T06:30:59.688 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.688 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.688 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.688 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-08-31T06:30:59.688 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2024-08-31T06:30:59.689 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 21.592555925, 2024-08-31T06:30:59.689 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 21.592555925 2024-08-31T06:30:59.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.689 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-08-31T06:30:59.689 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.689 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.689 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.689 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-08-31T06:30:59.689 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 296, 2024-08-31T06:30:59.689 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.100757928, 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000340398 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6278, 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 49.885132884, 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.007946023 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.691 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 2, 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 3, 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 1, 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 2, 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 41058, 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 20529, 2024-08-31T06:30:59.692 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 1575, 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:30:59.693 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:30:59.694 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:30:59.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 519719, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 156, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8352, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 184, 2024-08-31T06:30:59.696 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 7190182, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 28246, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-08-31T06:30:59.697 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 43250, 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 259540281, 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 31, 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 43250, 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 43250, 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 156.262459239, 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.003613004 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 43250, 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 44956 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.698 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 43250, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 4049, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 39201, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 0, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 10, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 1446, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 30962, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 852, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 4, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 6351, 2024-08-31T06:30:59.699 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-08-31T06:30:59.700 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-08-31T06:30:59.700 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-08-31T06:30:59.700 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 2548, 2024-08-31T06:30:59.700 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 20, 2024-08-31T06:30:59.700 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:30:59.700 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-08-31T06:30:59.700 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:30:59.700 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-08-31T06:30:59.700 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-08-31T06:30:59.701 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 114, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-08-31T06:30:59.702 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 44, 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 12, 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 12, 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 1847, 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 84, 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 832 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 1, 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-08-31T06:30:59.703 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-08-31T06:30:59.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.704 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-08-31T06:30:59.704 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-08-31T06:30:59.704 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 6, 2024-08-31T06:30:59.704 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-08-31T06:30:59.704 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 6, 2024-08-31T06:30:59.704 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed_ops": 6278, 2024-08-31T06:30:59.705 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 6278, 2024-08-31T06:30:59.705 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-08-31T06:30:59.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.705 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:30:59.705 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:59.705 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-08-31T06:30:59.705 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:59.705 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 967908, 2024-08-31T06:30:59.705 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 212628223, 2024-08-31T06:30:59.705 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:59.706 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 967908, 2024-08-31T06:30:59.706 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:30:59.706 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:30:59.706 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 967908, 2024-08-31T06:30:59.706 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 212628223, 2024-08-31T06:30:59.706 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:59.706 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.706 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.706 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 43250, 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 260180477, 2024-08-31T06:30:59.707 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 43250, 2024-08-31T06:30:59.708 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 260180477, 2024-08-31T06:30:59.708 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:59.708 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.708 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.708 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.708 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:59.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.708 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-08-31T06:30:59.708 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:59.708 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-08-31T06:30:59.708 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-08-31T06:30:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-08-31T06:30:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-08-31T06:30:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 43250, 2024-08-31T06:30:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 43250, 2024-08-31T06:30:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 43250, 2024-08-31T06:30:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 43250, 2024-08-31T06:30:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 6278, 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 641438, 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 6278, 2024-08-31T06:30:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 1446, 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 641438, 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x55fb212fa750": { 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:30:59.711 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-08-31T06:30:59.712 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:30:59.712 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 72420, 2024-08-31T06:30:59.712 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 257831356, 2024-08-31T06:30:59.712 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:30:59.712 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 72420, 2024-08-31T06:30:59.712 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:30:59.712 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:30:59.712 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 29516, 2024-08-31T06:30:59.712 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 257831356, 2024-08-31T06:30:59.712 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:30:59.713 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:30:59.713 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:30:59.713 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:30:59.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:59.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:30:59.713 INFO:teuthology.orchestra.run.smithi153.stdout: "trackedop": { 2024-08-31T06:30:59.713 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 2760 2024-08-31T06:30:59.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:30:59.713 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-31T06:31:00.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:00 smithi130 ceph-mon[22266]: pgmap v1144: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:31:00.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:00 smithi153 ceph-mon[22320]: pgmap v1144: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:31:00.453 INFO:tasks.check_counter:Daemon mds.i mds.exported=64 2024-08-31T06:31:00.453 INFO:tasks.check_counter:Daemon mds.i mds.imported=78 2024-08-31T06:31:00.453 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1822 2024-08-31T06:31:00.453 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=4770 2024-08-31T06:31:00.453 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-08-31T06:31:00.453 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:31:00.453 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:31:00.453 DEBUG:tasks.check_counter:Getting stats from l 2024-08-31T06:31:00.454 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-31T06:31:00.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:00 smithi053 ceph-mon[18924]: pgmap v1144: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T06:31:00.702 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:31:01.254 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-08-31T06:31:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:31:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 1598, 2024-08-31T06:31:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 1598, 2024-08-31T06:31:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 67519643, 2024-08-31T06:31:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 507404, 2024-08-31T06:31:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 8, 2024-08-31T06:31:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-08-31T06:31:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.195004883, 2024-08-31T06:31:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.065342807, 2024-08-31T06:31:01.254 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.076902357, 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.040328614, 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1597, 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.056008052, 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000035070 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T06:31:01.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 2449, 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 2376, 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 102537264, 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 888167, 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.299610470, 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.115772937, 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.137881892, 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.048114250, 2024-08-31T06:31:01.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2375, 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.080570994, 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000033924 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1403296, 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 295728 2024-08-31T06:31:01.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 2524, 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 2877, 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 58796305, 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 1514458, 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 6, 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 5, 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.341371970, 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.134928816, 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.102723466, 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.080028125, 2024-08-31T06:31:01.258 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2875, 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.116513054, 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000040526 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 712144 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.259 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 10123, 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.256001333, 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000025289 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.260 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 0, 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 0, 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 0, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 7398, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 1038, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 6360, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2024-08-31T06:31:01.262 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 5918, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 0, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 0, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 0, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 1, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 0, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 0, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-08-31T06:31:01.263 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-08-31T06:31:01.264 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:31:01.265 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 0, 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 0, 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 0, 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 0 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 0, 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 0, 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 0, 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 0, 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 0, 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-08-31T06:31:01.266 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_path": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_inode": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:31:01.267 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_started": 0, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_succeeded": 0, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "uninline_write_failed": 0 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 0, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 0, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-08-31T06:31:01.268 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 47787, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 0, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 78, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 5, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 4194304, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 229983179, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 229968793, 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-08-31T06:31:01.269 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 47787 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 2305, 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 7958, 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 5653, 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 83, 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 116, 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 33, 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 7398, 2024-08-31T06:31:01.270 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 8628, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 1230, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 0, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 0, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 0, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 132152, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 334307328 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 0, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 0, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 0, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2024-08-31T06:31:01.271 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.272 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-08-31T06:31:01.273 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.274 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-08-31T06:31:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-08-31T06:31:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.275 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-08-31T06:31:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-08-31T06:31:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-08-31T06:31:01.276 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.277 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.279 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.280 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.281 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-08-31T06:31:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-08-31T06:31:01.282 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:31:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:31:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-08-31T06:31:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.283 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 2, 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 3, 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 1, 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 2, 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 0, 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 0, 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 2555, 2024-08-31T06:31:01.284 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:31:01.285 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:31:01.286 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 232959, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 79, 2024-08-31T06:31:01.287 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8352, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 184, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-08-31T06:31:01.288 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 10207737, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 36133, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 5980, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 21, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 3, 2024-08-31T06:31:01.289 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 5980, 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 5980, 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.578925323, 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000765706 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 5980, 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 5981 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 5980, 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 5980, 2024-08-31T06:31:01.290 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 0, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 3332, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 0, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 2646, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 0, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 0, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 0, 2024-08-31T06:31:01.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 1, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-08-31T06:31:01.292 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-08-31T06:31:01.293 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 114, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 44, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 10, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 10, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 0, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 2, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 0 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 0, 2024-08-31T06:31:01.294 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 0, 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed_ops": 0, 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 0, 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:31:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 6567, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 228229477, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 6567, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 6567, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 228229477, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.296 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 5980, 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 225788880, 2024-08-31T06:31:01.297 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 5980, 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 225788880, 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-08-31T06:31:01.298 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 5980, 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 5980, 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 5980, 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 5980, 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.299 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:31:01.300 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x561b05f5c340": { 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-08-31T06:31:01.301 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "trackedop": { 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-08-31T06:31:01.302 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-08-31T06:31:02.047 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-08-31T06:31:02.047 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-08-31T06:31:02.047 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-08-31T06:31:02.047 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-08-31T06:31:02.048 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-08-31T06:31:02.048 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:31:02.048 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:31:02.048 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-31T06:31:02.066 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-31T06:31:02.067 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T06:31:02.067 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T06:31:02.102 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T06:31:02.102 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T06:31:02.162 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T06:31:02.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:02 smithi130 ceph-mon[22266]: pgmap v1145: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:31:02.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:02 smithi153 ceph-mon[22320]: pgmap v1145: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:31:02.469 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:31:02.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:02 smithi053 ceph-mon[18924]: pgmap v1145: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T06:31:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.939+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3805098754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddf8108170 msgr2=0x7fddf8108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.939+0000 7fddfe8f4640 1 --2- 172.21.15.53:0/3805098754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddf8108170 0x7fddf8108580 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7fddec009900 tx=0x7fddec02a410 comp rx=0 tx=0).stop 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.939+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3805098754 shutdown_connections 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.939+0000 7fddfe8f4640 1 --2- 172.21.15.53:0/3805098754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddf8108ac0 0x7fddf810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.939+0000 7fddfe8f4640 1 --2- 172.21.15.53:0/3805098754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddf8108170 0x7fddf8108580 unknown :-1 s=CLOSED pgs=2399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.939+0000 7fddfe8f4640 1 --2- 172.21.15.53:0/3805098754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf8102880 0x7fddf8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.939+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3805098754 >> 172.21.15.53:0/3805098754 conn(0x7fddf8079500 msgr2=0x7fddf8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.939+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3805098754 shutdown_connections 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.939+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3805098754 wait complete. 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.939+0000 7fddfe8f4640 1 Processor -- start 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.939+0000 7fddfe8f4640 1 -- start start 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddfe8f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddf8102880 0x7fddf819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddfe8f4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddf8108170 0x7fddf819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddfe8f4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf8108ac0 0x7fddf819f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddfe8f4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fddf8113700 con 0x7fddf8102880 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddfe8f4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fddf8113580 con 0x7fddf8108170 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddfe8f4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fddf8113880 con 0x7fddf8108ac0 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddf7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddf8102880 0x7fddf819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddf7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddf8102880 0x7fddf819a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54320/0 (socket says 172.21.15.53:54320) 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddf7fff640 1 -- 172.21.15.53:0/3722176532 learned_addr learned my addr 172.21.15.53:0/3722176532 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddf77fe640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddf8108170 0x7fddf819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddfce91640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf8108ac0 0x7fddf819f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddf7fff640 1 -- 172.21.15.53:0/3722176532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf8108ac0 msgr2=0x7fddf819f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddf7fff640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf8108ac0 0x7fddf819f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddf7fff640 1 -- 172.21.15.53:0/3722176532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddf8108170 msgr2=0x7fddf819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddf7fff640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddf8108170 0x7fddf819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.940+0000 7fddf7fff640 1 -- 172.21.15.53:0/3722176532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf81a00a0 con 0x7fddf8102880 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.941+0000 7fddf7fff640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddf8102880 0x7fddf819a130 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fdde800e9f0 tx=0x7fdde800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.941+0000 7fddf57fa640 1 -- 172.21.15.53:0/3722176532 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde800cd80 con 0x7fddf8102880 2024-08-31T06:31:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.941+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3722176532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf81a0390 con 0x7fddf8102880 2024-08-31T06:31:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.941+0000 7fddf57fa640 1 -- 172.21.15.53:0/3722176532 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdde80108c0 con 0x7fddf8102880 2024-08-31T06:31:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.941+0000 7fddf57fa640 1 -- 172.21.15.53:0/3722176532 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde80187c0 con 0x7fddf8102880 2024-08-31T06:31:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.941+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3722176532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf81a6af0 con 0x7fddf8102880 2024-08-31T06:31:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.942+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3722176532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf8103ab0 con 0x7fddf8102880 2024-08-31T06:31:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.944+0000 7fddf57fa640 1 -- 172.21.15.53:0/3722176532 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdde8010430 con 0x7fddf8102880 2024-08-31T06:31:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.944+0000 7fddf57fa640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdde00b4ca0 0x7fdde00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.944+0000 7fddf77fe640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdde00b4ca0 0x7fdde00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.944+0000 7fddf57fa640 1 -- 172.21.15.53:0/3722176532 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7fdde80e5e40 con 0x7fddf8102880 2024-08-31T06:31:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.945+0000 7fddf77fe640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdde00b4ca0 0x7fdde00b71b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fddec004770 tx=0x7fddec0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:02.947+0000 7fddf57fa640 1 -- 172.21.15.53:0/3722176532 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdde80acc10 con 0x7fddf8102880 2024-08-31T06:31:03.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.146+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3722176532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fddf810a8c0 con 0x7fddf8102880 2024-08-31T06:31:03.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.146+0000 7fddf57fa640 1 -- 172.21.15.53:0/3722176532 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v114) ==== 81+0+888 (secure 0 0 0) 0x7fdde80ac510 con 0x7fddf8102880 2024-08-31T06:31:03.148 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1171085527 2024-09-01T05:56:14.253642+0000 2024-08-31T06:31:03.148 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6800/1409851736 2024-09-01T05:54:47.617757+0000 2024-08-31T06:31:03.148 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6801/1409851736 2024-09-01T05:54:47.617757+0000 2024-08-31T06:31:03.148 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/3530571634 2024-09-01T05:54:47.617757+0000 2024-08-31T06:31:03.148 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6800/2874060887 2024-09-01T05:55:12.269899+0000 2024-08-31T06:31:03.148 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/3925890211 2024-09-01T05:56:14.253642+0000 2024-08-31T06:31:03.148 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1611320170 2024-09-01T05:54:47.617757+0000 2024-08-31T06:31:03.148 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6801/2874060887 2024-09-01T05:55:12.269899+0000 2024-08-31T06:31:03.149 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6801/3855814836 2024-09-01T05:56:14.253642+0000 2024-08-31T06:31:03.149 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2127129432 2024-09-01T05:55:12.269899+0000 2024-08-31T06:31:03.149 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2464556072 2024-09-01T05:54:47.617757+0000 2024-08-31T06:31:03.149 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2655797197 2024-09-01T05:55:12.269899+0000 2024-08-31T06:31:03.149 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6800/3855814836 2024-09-01T05:56:14.253642+0000 2024-08-31T06:31:03.149 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1663932105 2024-09-01T05:55:12.269899+0000 2024-08-31T06:31:03.149 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2624965482 2024-09-01T05:56:14.253642+0000 2024-08-31T06:31:03.149 INFO:teuthology.orchestra.run.smithi053.stderr:listed 15 entries 2024-08-31T06:31:03.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3722176532 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdde00b4ca0 msgr2=0x7fdde00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:03.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdde00b4ca0 0x7fdde00b71b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fddec004770 tx=0x7fddec0058d0 comp rx=0 tx=0).stop 2024-08-31T06:31:03.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3722176532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddf8102880 msgr2=0x7fddf819a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:03.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddf8102880 0x7fddf819a130 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fdde800e9f0 tx=0x7fdde800eeb0 comp rx=0 tx=0).stop 2024-08-31T06:31:03.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3722176532 shutdown_connections 2024-08-31T06:31:03.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdde00b4ca0 0x7fdde00b71b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf8108ac0 0x7fddf819f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddf8108170 0x7fddf819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 --2- 172.21.15.53:0/3722176532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddf8102880 0x7fddf819a130 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3722176532 >> 172.21.15.53:0/3722176532 conn(0x7fddf8079500 msgr2=0x7fddf81042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3722176532 shutdown_connections 2024-08-31T06:31:03.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:03.148+0000 7fddfe8f4640 1 -- 172.21.15.53:0/3722176532 wait complete. 2024-08-31T06:31:03.995 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-08-31T06:31:03.995 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T06:31:04.014 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T06:31:04.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:04 smithi053 ceph-mon[18924]: pgmap v1146: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-31T06:31:04.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:04 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/3722176532' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:31:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:31:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:04 smithi130 ceph-mon[22266]: pgmap v1146: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-31T06:31:04.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:04 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/3722176532' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:31:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:04 smithi153 ceph-mon[22320]: pgmap v1146: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-31T06:31:04.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:04 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/3722176532' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:31:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.787+0000 7f11266d3640 1 -- 172.21.15.53:0/2543812118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120103900 msgr2=0x7f1120103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.787+0000 7f11266d3640 1 --2- 172.21.15.53:0/2543812118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120103900 0x7f1120103d10 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7f1110009900 tx=0x7f111002a410 comp rx=0 tx=0).stop 2024-08-31T06:31:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.787+0000 7f11266d3640 1 -- 172.21.15.53:0/2543812118 shutdown_connections 2024-08-31T06:31:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.787+0000 7f11266d3640 1 --2- 172.21.15.53:0/2543812118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1120109b90 0x7f11201103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.787+0000 7f11266d3640 1 --2- 172.21.15.53:0/2543812118 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1120109240 0x7f1120109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.787+0000 7f11266d3640 1 --2- 172.21.15.53:0/2543812118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120103900 0x7f1120103d10 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.787+0000 7f11266d3640 1 -- 172.21.15.53:0/2543812118 >> 172.21.15.53:0/2543812118 conn(0x7f112007b5f0 msgr2=0x7f112007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.787+0000 7f11266d3640 1 -- 172.21.15.53:0/2543812118 shutdown_connections 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.787+0000 7f11266d3640 1 -- 172.21.15.53:0/2543812118 wait complete. 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.787+0000 7f11266d3640 1 Processor -- start 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.787+0000 7f11266d3640 1 -- start start 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f11266d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120103900 0x7f112019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f11266d3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1120109240 0x7f112019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f11266d3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1120109b90 0x7f112019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f11266d3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1120113700 con 0x7f1120103900 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f11266d3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1120113580 con 0x7f1120109240 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f11266d3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1120113880 con 0x7f1120109b90 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f111ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120103900 0x7f112019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f111ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120103900 0x7f112019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60040/0 (socket says 172.21.15.53:60040) 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f111ffff640 1 -- 172.21.15.53:0/1483782463 learned_addr learned my addr 172.21.15.53:0/1483782463 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f1124c70640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1120109b90 0x7f112019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:04.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f111f7fe640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1120109240 0x7f112019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f111ffff640 1 -- 172.21.15.53:0/1483782463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1120109b90 msgr2=0x7f112019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f111ffff640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1120109b90 0x7f112019f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f111ffff640 1 -- 172.21.15.53:0/1483782463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1120109240 msgr2=0x7f112019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f111ffff640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1120109240 0x7f112019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f111ffff640 1 -- 172.21.15.53:0/1483782463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11201a0020 con 0x7f1120103900 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f111f7fe640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1120109240 0x7f112019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.788+0000 7f111ffff640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120103900 0x7f112019a170 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f1110009230 tx=0x7f1110004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.789+0000 7f111d7fa640 1 -- 172.21.15.53:0/1483782463 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111003f030 con 0x7f1120103900 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.789+0000 7f111d7fa640 1 -- 172.21.15.53:0/1483782463 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1110003a80 con 0x7f1120103900 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.789+0000 7f11266d3640 1 -- 172.21.15.53:0/1483782463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11201a02b0 con 0x7f1120103900 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.789+0000 7f111d7fa640 1 -- 172.21.15.53:0/1483782463 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110035070 con 0x7f1120103900 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.789+0000 7f11266d3640 1 -- 172.21.15.53:0/1483782463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11201a0790 con 0x7f1120103900 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.790+0000 7f11266d3640 1 -- 172.21.15.53:0/1483782463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1120103d10 con 0x7f1120103900 2024-08-31T06:31:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.791+0000 7f111d7fa640 1 -- 172.21.15.53:0/1483782463 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1110042030 con 0x7f1120103900 2024-08-31T06:31:04.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.792+0000 7f111d7fa640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f11080b4cd0 0x7f11080b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:04.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.792+0000 7f111f7fe640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f11080b4cd0 0x7f11080b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:04.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.792+0000 7f111d7fa640 1 -- 172.21.15.53:0/1483782463 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8557+0+0 (secure 0 0 0) 0x7f1110105d30 con 0x7f1120103900 2024-08-31T06:31:04.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.793+0000 7f111f7fe640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f11080b4cd0 0x7f11080b71e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1120106340 tx=0x7f111400a5c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:04.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.797+0000 7f111d7fa640 1 -- 172.21.15.53:0/1483782463 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f11100ccaa0 con 0x7f1120103900 2024-08-31T06:31:04.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.994+0000 7f11266d3640 1 -- 172.21.15.53:0/1483782463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f112002e430 con 0x7f1120103900 2024-08-31T06:31:04.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.994+0000 7f111d7fa640 1 -- 172.21.15.53:0/1483782463 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v114) ==== 81+0+888 (secure 0 0 0) 0x7f11100cc3a0 con 0x7f1120103900 2024-08-31T06:31:04.996 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1171085527 2024-09-01T05:56:14.253642+0000 2024-08-31T06:31:04.996 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6800/1409851736 2024-09-01T05:54:47.617757+0000 2024-08-31T06:31:04.996 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6801/1409851736 2024-09-01T05:54:47.617757+0000 2024-08-31T06:31:04.996 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/3530571634 2024-09-01T05:54:47.617757+0000 2024-08-31T06:31:04.997 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6800/2874060887 2024-09-01T05:55:12.269899+0000 2024-08-31T06:31:04.997 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/3925890211 2024-09-01T05:56:14.253642+0000 2024-08-31T06:31:04.997 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1611320170 2024-09-01T05:54:47.617757+0000 2024-08-31T06:31:04.997 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6801/2874060887 2024-09-01T05:55:12.269899+0000 2024-08-31T06:31:04.997 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6801/3855814836 2024-09-01T05:56:14.253642+0000 2024-08-31T06:31:04.997 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2127129432 2024-09-01T05:55:12.269899+0000 2024-08-31T06:31:04.997 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2464556072 2024-09-01T05:54:47.617757+0000 2024-08-31T06:31:04.997 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2655797197 2024-09-01T05:55:12.269899+0000 2024-08-31T06:31:04.997 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6800/3855814836 2024-09-01T05:56:14.253642+0000 2024-08-31T06:31:04.997 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1663932105 2024-09-01T05:55:12.269899+0000 2024-08-31T06:31:04.998 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2624965482 2024-09-01T05:56:14.253642+0000 2024-08-31T06:31:04.998 INFO:teuthology.orchestra.run.smithi053.stderr:listed 15 entries 2024-08-31T06:31:04.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.996+0000 7f11266d3640 1 -- 172.21.15.53:0/1483782463 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f11080b4cd0 msgr2=0x7f11080b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.996+0000 7f11266d3640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f11080b4cd0 0x7f11080b71e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1120106340 tx=0x7f111400a5c0 comp rx=0 tx=0).stop 2024-08-31T06:31:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.996+0000 7f11266d3640 1 -- 172.21.15.53:0/1483782463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120103900 msgr2=0x7f112019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.996+0000 7f11266d3640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120103900 0x7f112019a170 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f1110009230 tx=0x7f1110004270 comp rx=0 tx=0).stop 2024-08-31T06:31:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.996+0000 7f11266d3640 1 -- 172.21.15.53:0/1483782463 shutdown_connections 2024-08-31T06:31:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.996+0000 7f11266d3640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f11080b4cd0 0x7f11080b71e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.996+0000 7f11266d3640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1120109b90 0x7f112019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.996+0000 7f11266d3640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1120109240 0x7f112019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.996+0000 7f11266d3640 1 --2- 172.21.15.53:0/1483782463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120103900 0x7f112019a170 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.996+0000 7f11266d3640 1 -- 172.21.15.53:0/1483782463 >> 172.21.15.53:0/1483782463 conn(0x7f112007b5f0 msgr2=0x7f1120107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.996+0000 7f11266d3640 1 -- 172.21.15.53:0/1483782463 shutdown_connections 2024-08-31T06:31:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:04.997+0000 7f11266d3640 1 -- 172.21.15.53:0/1483782463 wait complete. 2024-08-31T06:31:05.367 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:05 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1483782463' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:31:05.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:05 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1483782463' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:31:05.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:05 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1483782463' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:31:05.772 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-08-31T06:31:05.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:31:05.772 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-31T06:31:05.826 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T06:31:05.826 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[75048]: fuse finished with error 0 and tester_r 0 2024-08-31T06:31:06.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:06 smithi130 ceph-mon[22266]: pgmap v1147: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-31T06:31:06.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:06 smithi153 ceph-mon[22320]: pgmap v1147: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-31T06:31:06.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:06 smithi053 ceph-mon[18924]: pgmap v1147: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-31T06:31:07.377 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:07 smithi130 ceph-mon[22266]: osdmap e115: 12 total, 12 up, 12 in 2024-08-31T06:31:07.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:07 smithi153 ceph-mon[22320]: osdmap e115: 12 total, 12 up, 12 in 2024-08-31T06:31:07.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:07 smithi053 ceph-mon[18924]: osdmap e115: 12 total, 12 up, 12 in 2024-08-31T06:31:08.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:08 smithi130 ceph-mon[22266]: pgmap v1149: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-08-31T06:31:08.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:08 smithi153 ceph-mon[22320]: pgmap v1149: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-08-31T06:31:08.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:08 smithi053 ceph-mon[18924]: pgmap v1149: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-08-31T06:31:10.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:10 smithi130 ceph-mon[22266]: pgmap v1150: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-08-31T06:31:10.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:10 smithi153 ceph-mon[22320]: pgmap v1150: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-08-31T06:31:10.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:10 smithi053 ceph-mon[18924]: pgmap v1150: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-08-31T06:31:11.927 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-08-31T06:31:11.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:31:11.927 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-31T06:31:11.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:31:11.959 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-08-31T06:31:12.018 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-31T06:31:12.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:31:12.018 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:31:12.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:31:12.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2024-08-31T06:31:12.190 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-31T06:31:12.202 INFO:tasks.cephadm:Teardown begin 2024-08-31T06:31:12.203 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-31T06:31:12.203 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:31:12.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:12 smithi130 ceph-mon[22266]: pgmap v1151: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-08-31T06:31:12.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:12 smithi153 ceph-mon[22320]: pgmap v1151: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-08-31T06:31:12.465 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:31:12.475 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:12 smithi053 ceph-mon[18924]: pgmap v1151: 97 pgs: 4 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 91 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-08-31T06:31:13.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.107+0000 7fbacecaf640 1 -- 172.21.15.53:0/1478912967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac8103920 msgr2=0x7fbac8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:13.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.107+0000 7fbacecaf640 1 --2- 172.21.15.53:0/1478912967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac8103920 0x7fbac8103d30 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009900 tx=0x7fbabc02a410 comp rx=0 tx=0).stop 2024-08-31T06:31:13.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.107+0000 7fbacecaf640 1 -- 172.21.15.53:0/1478912967 shutdown_connections 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.107+0000 7fbacecaf640 1 --2- 172.21.15.53:0/1478912967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac8109bb0 0x7fbac81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.107+0000 7fbacecaf640 1 --2- 172.21.15.53:0/1478912967 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac8109260 0x7fbac8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.107+0000 7fbacecaf640 1 --2- 172.21.15.53:0/1478912967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac8103920 0x7fbac8103d30 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.107+0000 7fbacecaf640 1 -- 172.21.15.53:0/1478912967 >> 172.21.15.53:0/1478912967 conn(0x7fbac80ff350 msgr2=0x7fbac81017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.107+0000 7fbacecaf640 1 -- 172.21.15.53:0/1478912967 shutdown_connections 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.107+0000 7fbacecaf640 1 -- 172.21.15.53:0/1478912967 wait complete. 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.108+0000 7fbacecaf640 1 Processor -- start 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.108+0000 7fbacecaf640 1 -- start start 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.108+0000 7fbacecaf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac8103920 0x7fbac819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.108+0000 7fbacecaf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac8109260 0x7fbac819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.108+0000 7fbacecaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac8109bb0 0x7fbac819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:13.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.108+0000 7fbacecaf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbac8113720 con 0x7fbac8109bb0 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.108+0000 7fbacecaf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbac81135a0 con 0x7fbac8103920 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.108+0000 7fbacecaf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbac81138a0 con 0x7fbac8109260 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacd24c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac8109bb0 0x7fbac819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacd24c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac8109bb0 0x7fbac819f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60058/0 (socket says 172.21.15.53:60058) 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacca4b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac8103920 0x7fbac819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacd24c640 1 -- 172.21.15.53:0/1324544302 learned_addr learned my addr 172.21.15.53:0/1324544302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbac7fff640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac8109260 0x7fbac819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacd24c640 1 -- 172.21.15.53:0/1324544302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac8109260 msgr2=0x7fbac819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacd24c640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac8109260 0x7fbac819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacd24c640 1 -- 172.21.15.53:0/1324544302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac8103920 msgr2=0x7fbac819a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacd24c640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac8103920 0x7fbac819a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:13.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacd24c640 1 -- 172.21.15.53:0/1324544302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac81a00e0 con 0x7fbac8109bb0 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacca4b640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac8103920 0x7fbac819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacd24c640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac8109bb0 0x7fbac819f9b0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7fbac000eaa0 tx=0x7fbac000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbac5ffb640 1 -- 172.21.15.53:0/1324544302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac000cdb0 con 0x7fbac8109bb0 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbac5ffb640 1 -- 172.21.15.53:0/1324544302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbac0005020 con 0x7fbac8109bb0 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbacecaf640 1 -- 172.21.15.53:0/1324544302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac81a03d0 con 0x7fbac8109bb0 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.109+0000 7fbac5ffb640 1 -- 172.21.15.53:0/1324544302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac00116d0 con 0x7fbac8109bb0 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.110+0000 7fbacecaf640 1 -- 172.21.15.53:0/1324544302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac81a6b30 con 0x7fbac8109bb0 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.110+0000 7fbacecaf640 1 -- 172.21.15.53:0/1324544302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac8104ba0 con 0x7fbac8109bb0 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.112+0000 7fbac5ffb640 1 -- 172.21.15.53:0/1324544302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbac00051d0 con 0x7fbac8109bb0 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.113+0000 7fbac5ffb640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbab80b4ca0 0x7fbab80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.113+0000 7fbacca4b640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbab80b4ca0 0x7fbab80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:13.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.113+0000 7fbac5ffb640 1 -- 172.21.15.53:0/1324544302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 8601+0+0 (secure 0 0 0) 0x7fbac00e56d0 con 0x7fbac8109bb0 2024-08-31T06:31:13.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.113+0000 7fbacca4b640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbab80b4ca0 0x7fbab80b71b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0057c0 tx=0x7fbabc0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:13.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.120+0000 7fbac5ffb640 1 -- 172.21.15.53:0/1324544302 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbac0016030 con 0x7fbac8109bb0 2024-08-31T06:31:13.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.345+0000 7fbacecaf640 1 -- 172.21.15.53:0/1324544302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbac802e430 con 0x7fbac8109bb0 2024-08-31T06:31:13.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.345+0000 7fbac5ffb640 1 -- 172.21.15.53:0/1324544302 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+12006 (secure 0 0 0) 0x7fbac00abe20 con 0x7fbac8109bb0 2024-08-31T06:31:13.347 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:31:13.347 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":95,"btime":"2024-08-31T06:30:27:012060+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":95,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:30:26.264627+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:31:13.348 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 95 2024-08-31T06:31:13.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 -- 172.21.15.53:0/1324544302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbab80b4ca0 msgr2=0x7fbab80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:13.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbab80b4ca0 0x7fbab80b71b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0057c0 tx=0x7fbabc0058d0 comp rx=0 tx=0).stop 2024-08-31T06:31:13.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 -- 172.21.15.53:0/1324544302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac8109bb0 msgr2=0x7fbac819f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:13.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac8109bb0 0x7fbac819f9b0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7fbac000eaa0 tx=0x7fbac000ef60 comp rx=0 tx=0).stop 2024-08-31T06:31:13.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 -- 172.21.15.53:0/1324544302 shutdown_connections 2024-08-31T06:31:13.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fbab80b4ca0 0x7fbab80b71b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:13.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac8109bb0 0x7fbac819f9b0 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:13.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac8109260 0x7fbac819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:13.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 --2- 172.21.15.53:0/1324544302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbac8103920 0x7fbac819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:13.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 -- 172.21.15.53:0/1324544302 >> 172.21.15.53:0/1324544302 conn(0x7fbac80ff350 msgr2=0x7fbac8108940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:13.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 -- 172.21.15.53:0/1324544302 shutdown_connections 2024-08-31T06:31:13.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:13.348+0000 7fbacecaf640 1 -- 172.21.15.53:0/1324544302 wait complete. 2024-08-31T06:31:14.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:31:14.306 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:31:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:14 smithi130 ceph-mon[22266]: pgmap v1152: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 KiB/s wr, 15 op/s 2024-08-31T06:31:14.378 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:14 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1324544302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:31:14.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:14 smithi153 ceph-mon[22320]: pgmap v1152: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 KiB/s wr, 15 op/s 2024-08-31T06:31:14.425 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:14 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1324544302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:31:14.427 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:14 smithi053 ceph-mon[18924]: pgmap v1152: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 KiB/s wr, 15 op/s 2024-08-31T06:31:14.427 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:14 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1324544302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:31:14.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.780+0000 7f7106089640 1 -- 172.21.15.53:0/3057421495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7100109310 msgr2=0x7f7100109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.780+0000 7f7106089640 1 --2- 172.21.15.53:0/3057421495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7100109310 0x7f7100109720 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009900 tx=0x7f70f402a410 comp rx=0 tx=0).stop 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.780+0000 7f7106089640 1 -- 172.21.15.53:0/3057421495 shutdown_connections 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.781+0000 7f7106089640 1 --2- 172.21.15.53:0/3057421495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7100109c60 0x7f7100110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.781+0000 7f7106089640 1 --2- 172.21.15.53:0/3057421495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7100109310 0x7f7100109720 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.781+0000 7f7106089640 1 --2- 172.21.15.53:0/3057421495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71001039d0 0x7f7100103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.781+0000 7f7106089640 1 -- 172.21.15.53:0/3057421495 >> 172.21.15.53:0/3057421495 conn(0x7f710007b670 msgr2=0x7f710007ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.781+0000 7f7106089640 1 -- 172.21.15.53:0/3057421495 shutdown_connections 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.781+0000 7f7106089640 1 -- 172.21.15.53:0/3057421495 wait complete. 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.781+0000 7f7106089640 1 Processor -- start 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.781+0000 7f7106089640 1 -- start start 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f7106089640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71001039d0 0x7f710019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:14.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f7106089640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7100109310 0x7f710019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f7106089640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7100109c60 0x7f710019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f7106089640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7100113730 con 0x7f7100109c60 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f7106089640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71001135b0 con 0x7f71001039d0 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f7106089640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f71001138b0 con 0x7f7100109310 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f70fffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7100109c60 0x7f710019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f70fffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7100109c60 0x7f710019f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48756/0 (socket says 172.21.15.53:48756) 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f70fffff640 1 -- 172.21.15.53:0/1081980924 learned_addr learned my addr 172.21.15.53:0/1081980924 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f70feffd640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7100109310 0x7f710019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f70ff7fe640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71001039d0 0x7f710019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f70fffff640 1 -- 172.21.15.53:0/1081980924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7100109310 msgr2=0x7f710019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f70fffff640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7100109310 0x7f710019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f70fffff640 1 -- 172.21.15.53:0/1081980924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71001039d0 msgr2=0x7f710019a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f70fffff640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71001039d0 0x7f710019a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:14.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f70fffff640 1 -- 172.21.15.53:0/1081980924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71001a00f0 con 0x7f7100109c60 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.782+0000 7f70fffff640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7100109c60 0x7f710019f9c0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f70f800eb10 tx=0x7f70f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.783+0000 7f70fcff9640 1 -- 172.21.15.53:0/1081980924 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8004b20 con 0x7f7100109c60 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.783+0000 7f7106089640 1 -- 172.21.15.53:0/1081980924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71001a03e0 con 0x7f7100109c60 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.783+0000 7f70fcff9640 1 -- 172.21.15.53:0/1081980924 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70f8004cc0 con 0x7f7100109c60 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.783+0000 7f7106089640 1 -- 172.21.15.53:0/1081980924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71001a6b40 con 0x7f7100109c60 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.783+0000 7f70fcff9640 1 -- 172.21.15.53:0/1081980924 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8010690 con 0x7f7100109c60 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.784+0000 7f7106089640 1 -- 172.21.15.53:0/1081980924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7100103de0 con 0x7f7100109c60 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.785+0000 7f70fcff9640 1 -- 172.21.15.53:0/1081980924 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f70f8005000 con 0x7f7100109c60 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.786+0000 7f70fcff9640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70e80b4d20 0x7f70e80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.786+0000 7f70ff7fe640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70e80b4d20 0x7f70e80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.786+0000 7f70fcff9640 1 -- 172.21.15.53:0/1081980924 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8557+0+0 (secure 0 0 0) 0x7f70f80e5c50 con 0x7f7100109c60 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.787+0000 7f70ff7fe640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70e80b4d20 0x7f70e80b7230 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009bd0 tx=0x7f70f0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:14.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:14.789+0000 7f70fcff9640 1 -- 172.21.15.53:0/1081980924 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f70f8056130 con 0x7f7100109c60 2024-08-31T06:31:15.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.025+0000 7f7106089640 1 -- 172.21.15.53:0/1081980924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f710019b2b0 con 0x7f7100109c60 2024-08-31T06:31:15.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.025+0000 7f70fcff9640 1 -- 172.21.15.53:0/1081980924 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+12006 (secure 0 0 0) 0x7f70f80ac9c0 con 0x7f7100109c60 2024-08-31T06:31:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:31:15.027 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":95,"btime":"2024-08-31T06:30:27:012060+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2455063100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2455063100},{"type":"v1","addr":"172.21.15.53:6835","nonce":2455063100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/3626996637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":3626996637},{"type":"v1","addr":"172.21.15.53:6837","nonce":3626996637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":95,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:02:31.233616+0000","modified":"2024-08-31T06:30:26.264627+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24668,"mds_1":24640,"mds_2":24632,"mds_3":24619,"mds_4":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14829":{"gid":14829,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6839/1079311184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1079311184},{"type":"v1","addr":"172.21.15.53:6839","nonce":1079311184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14841":{"gid":14841,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6841/2812306532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6840","nonce":2812306532},{"type":"v1","addr":"172.21.15.53:6841","nonce":2812306532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/4101202303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4101202303},{"type":"v1","addr":"172.21.15.153:6833","nonce":4101202303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/4017894222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4017894222},{"type":"v1","addr":"172.21.15.130:6833","nonce":4017894222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/3456535570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3456535570},{"type":"v1","addr":"172.21.15.130:6835","nonce":3456535570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.153:6835/1480674420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1480674420},{"type":"v1","addr":"172.21.15.153:6835","nonce":1480674420}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.153:6837/3972541540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3972541540},{"type":"v1","addr":"172.21.15.153:6837","nonce":3972541540}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.130:6837/1323127878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1323127878},{"type":"v1","addr":"172.21.15.130:6837","nonce":1323127878}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/268646865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":268646865},{"type":"v1","addr":"172.21.15.153:6839","nonce":268646865}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.130:6839/3403731647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":3403731647},{"type":"v1","addr":"172.21.15.130:6839","nonce":3403731647}]},"join_fscid":-1,"export_targets":[1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24640,24632,24619,24613]},"id":1}]} 2024-08-31T06:31:15.028 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 95 2024-08-31T06:31:15.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 -- 172.21.15.53:0/1081980924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70e80b4d20 msgr2=0x7f70e80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:15.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70e80b4d20 0x7f70e80b7230 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009bd0 tx=0x7f70f0005f90 comp rx=0 tx=0).stop 2024-08-31T06:31:15.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 -- 172.21.15.53:0/1081980924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7100109c60 msgr2=0x7f710019f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:15.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7100109c60 0x7f710019f9c0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f70f800eb10 tx=0x7f70f800c2d0 comp rx=0 tx=0).stop 2024-08-31T06:31:15.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 -- 172.21.15.53:0/1081980924 shutdown_connections 2024-08-31T06:31:15.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f70e80b4d20 0x7f70e80b7230 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:15.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7100109c60 0x7f710019f9c0 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:15.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7100109310 0x7f710019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:15.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 --2- 172.21.15.53:0/1081980924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71001039d0 0x7f710019a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:15.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 -- 172.21.15.53:0/1081980924 >> 172.21.15.53:0/1081980924 conn(0x7f710007b670 msgr2=0x7f7100107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:15.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 -- 172.21.15.53:0/1081980924 shutdown_connections 2024-08-31T06:31:15.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:15.028+0000 7f7106089640 1 -- 172.21.15.53:0/1081980924 wait complete. 2024-08-31T06:31:15.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:15 smithi053 ceph-mon[18924]: osdmap e116: 12 total, 12 up, 12 in 2024-08-31T06:31:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:15 smithi053 ceph-mon[18924]: pgmap v1154: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-08-31T06:31:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:15 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:31:15.726 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:15 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1081980924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:31:15.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:31:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:15 smithi153 ceph-mon[22320]: osdmap e116: 12 total, 12 up, 12 in 2024-08-31T06:31:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:15 smithi153 ceph-mon[22320]: pgmap v1154: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-08-31T06:31:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:15 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:31:15.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:15 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1081980924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:31:16.009 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:15 smithi130 ceph-mon[22266]: osdmap e116: 12 total, 12 up, 12 in 2024-08-31T06:31:16.009 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:15 smithi130 ceph-mon[22266]: pgmap v1154: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-08-31T06:31:16.009 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:15 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:31:16.009 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:15 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1081980924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:31:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:31:17.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.251+0000 7f6c353ad640 1 -- 172.21.15.53:0/1658769197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c30108160 msgr2=0x7f6c30108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:17.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.251+0000 7f6c353ad640 1 --2- 172.21.15.53:0/1658769197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c30108160 0x7f6c30108570 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009900 tx=0x7f6c2402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.251+0000 7f6c353ad640 1 -- 172.21.15.53:0/1658769197 shutdown_connections 2024-08-31T06:31:17.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.251+0000 7f6c353ad640 1 --2- 172.21.15.53:0/1658769197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c30108ab0 0x7f6c3010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.251+0000 7f6c353ad640 1 --2- 172.21.15.53:0/1658769197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c30108160 0x7f6c30108570 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.251+0000 7f6c353ad640 1 --2- 172.21.15.53:0/1658769197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c30102820 0x7f6c30102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.251+0000 7f6c353ad640 1 -- 172.21.15.53:0/1658769197 >> 172.21.15.53:0/1658769197 conn(0x7f6c300794e0 msgr2=0x7f6c300798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.251+0000 7f6c353ad640 1 -- 172.21.15.53:0/1658769197 shutdown_connections 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.251+0000 7f6c353ad640 1 -- 172.21.15.53:0/1658769197 wait complete. 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c353ad640 1 Processor -- start 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c353ad640 1 -- start start 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c353ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c30102820 0x7f6c301990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c353ad640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c30108160 0x7f6c30199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c353ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c30108ab0 0x7f6c3019e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c353ad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30112590 con 0x7f6c30102820 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c353ad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30112410 con 0x7f6c30108ab0 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c353ad640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30112710 con 0x7f6c30108160 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c2effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c30102820 0x7f6c301990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c2effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c30102820 0x7f6c301990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48774/0 (socket says 172.21.15.53:48774) 2024-08-31T06:31:17.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c2effd640 1 -- 172.21.15.53:0/2126713890 learned_addr learned my addr 172.21.15.53:0/2126713890 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.252+0000 7f6c2e7fc640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c30108160 0x7f6c30199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c2f7fe640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c30108ab0 0x7f6c3019e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c2effd640 1 -- 172.21.15.53:0/2126713890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c30108160 msgr2=0x7f6c30199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c2effd640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c30108160 0x7f6c30199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c2effd640 1 -- 172.21.15.53:0/2126713890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c30108ab0 msgr2=0x7f6c3019e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c2effd640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c30108ab0 0x7f6c3019e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c2effd640 1 -- 172.21.15.53:0/2126713890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3019ef50 con 0x7f6c30102820 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c2f7fe640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c30108ab0 0x7f6c3019e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c2effd640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c30102820 0x7f6c301990a0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000c920 tx=0x7f6c2000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c17fff640 1 -- 172.21.15.53:0/2126713890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20007c70 con 0x7f6c30102820 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c353ad640 1 -- 172.21.15.53:0/2126713890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3019f240 con 0x7f6c30102820 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c17fff640 1 -- 172.21.15.53:0/2126713890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c20007e10 con 0x7f6c30102820 2024-08-31T06:31:17.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c353ad640 1 -- 172.21.15.53:0/2126713890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c301a5a60 con 0x7f6c30102820 2024-08-31T06:31:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.253+0000 7f6c17fff640 1 -- 172.21.15.53:0/2126713890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c200186f0 con 0x7f6c30102820 2024-08-31T06:31:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.254+0000 7f6c353ad640 1 -- 172.21.15.53:0/2126713890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c30103aa0 con 0x7f6c30102820 2024-08-31T06:31:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.256+0000 7f6c17fff640 1 -- 172.21.15.53:0/2126713890 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6c2000f450 con 0x7f6c30102820 2024-08-31T06:31:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.257+0000 7f6c17fff640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c180b4cd0 0x7f6c180b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.257+0000 7f6c2e7fc640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c180b4cd0 0x7f6c180b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.257+0000 7f6c17fff640 1 -- 172.21.15.53:0/2126713890 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8557+0+0 (secure 0 0 0) 0x7f6c200e5730 con 0x7f6c30102820 2024-08-31T06:31:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.257+0000 7f6c2e7fc640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c180b4cd0 0x7f6c180b71e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f6c24005ec0 tx=0x7f6c240058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.261+0000 7f6c17fff640 1 -- 172.21.15.53:0/2126713890 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6c20014030 con 0x7f6c30102820 2024-08-31T06:31:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.452+0000 7f6c353ad640 1 -- 172.21.15.53:0/2126713890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c30102c30 con 0x7f6c30102820 2024-08-31T06:31:17.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.453+0000 7f6c17fff640 1 -- 172.21.15.53:0/2126713890 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+23195 (secure 0 0 0) 0x7f6c200ac500 con 0x7f6c30102820 2024-08-31T06:31:17.455 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-08-31T06:31:17.455 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":116,"fsid":"580e8a36-675d-11ef-bcd4-c7b262605968","created":"2024-08-31T05:54:18.180159+0000","modified":"2024-08-31T06:31:14.655908+0000","last_up_change":"2024-08-31T06:01:39.768623+0000","last_in_change":"2024-08-31T06:01:17.824283+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:58:04.713426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:02:26.602694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:02:29.237487+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":49,"snap_epoch":115,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a814231b-c1a5-4760-90e4-4eb5e2b05107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6803","nonce":2893726672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6805","nonce":2893726672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6809","nonce":2893726672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2893726672},{"type":"v1","addr":"172.21.15.53:6807","nonce":2893726672}]},"public_addr":"172.21.15.53:6803/2893726672","cluster_addr":"172.21.15.53:6805/2893726672","heartbeat_back_addr":"172.21.15.53:6809/2893726672","heartbeat_front_addr":"172.21.15.53:6807/2893726672","state":["exists","up"]},{"osd":1,"uuid":"c3387502-2a41-4afb-8e8b-321e68a8e362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6801","nonce":3394793383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6803","nonce":3394793383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6807","nonce":3394793383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3394793383},{"type":"v1","addr":"172.21.15.130:6805","nonce":3394793383}]},"public_addr":"172.21.15.130:6801/3394793383","cluster_addr":"172.21.15.130:6803/3394793383","heartbeat_back_addr":"172.21.15.130:6807/3394793383","heartbeat_front_addr":"172.21.15.130:6805/3394793383","state":["exists","up"]},{"osd":2,"uuid":"d9ffe46e-6cc8-419d-9078-dbb40bfa3b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6801","nonce":3220443014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6803","nonce":3220443014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6807","nonce":3220443014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3220443014},{"type":"v1","addr":"172.21.15.153:6805","nonce":3220443014}]},"public_addr":"172.21.15.153:6801/3220443014","cluster_addr":"172.21.15.153:6803/3220443014","heartbeat_back_addr":"172.21.15.153:6807/3220443014","heartbeat_front_addr":"172.21.15.153:6805/3220443014","state":["exists","up"]},{"osd":3,"uuid":"251aec00-eb9e-49b9-8c6b-816e44a7da13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6811","nonce":1900570211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6813","nonce":1900570211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6817","nonce":1900570211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1900570211},{"type":"v1","addr":"172.21.15.53:6815","nonce":1900570211}]},"public_addr":"172.21.15.53:6811/1900570211","cluster_addr":"172.21.15.53:6813/1900570211","heartbeat_back_addr":"172.21.15.53:6817/1900570211","heartbeat_front_addr":"172.21.15.53:6815/1900570211","state":["exists","up"]},{"osd":4,"uuid":"03860b7f-13ce-4461-8d17-b44bb2bc232a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6809","nonce":862414664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6811","nonce":862414664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6815","nonce":862414664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":862414664},{"type":"v1","addr":"172.21.15.130:6813","nonce":862414664}]},"public_addr":"172.21.15.130:6809/862414664","cluster_addr":"172.21.15.130:6811/862414664","heartbeat_back_addr":"172.21.15.130:6815/862414664","heartbeat_front_addr":"172.21.15.130:6813/862414664","state":["exists","up"]},{"osd":5,"uuid":"9fc8b987-9839-4db8-a64e-15c233be0651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6809","nonce":4190084031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6811","nonce":4190084031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6815","nonce":4190084031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4190084031},{"type":"v1","addr":"172.21.15.153:6813","nonce":4190084031}]},"public_addr":"172.21.15.153:6809/4190084031","cluster_addr":"172.21.15.153:6811/4190084031","heartbeat_back_addr":"172.21.15.153:6815/4190084031","heartbeat_front_addr":"172.21.15.153:6813/4190084031","state":["exists","up"]},{"osd":6,"uuid":"57f5870f-b022-4942-ab08-80d3bdf8d51b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6819","nonce":997206382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6821","nonce":997206382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6825","nonce":997206382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":997206382},{"type":"v1","addr":"172.21.15.53:6823","nonce":997206382}]},"public_addr":"172.21.15.53:6819/997206382","cluster_addr":"172.21.15.53:6821/997206382","heartbeat_back_addr":"172.21.15.53:6825/997206382","heartbeat_front_addr":"172.21.15.53:6823/997206382","state":["exists","up"]},{"osd":7,"uuid":"29c0cbe5-22d9-4256-92c3-44edf317fd58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6817","nonce":3016906156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6819","nonce":3016906156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6823","nonce":3016906156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3016906156},{"type":"v1","addr":"172.21.15.130:6821","nonce":3016906156}]},"public_addr":"172.21.15.130:6817/3016906156","cluster_addr":"172.21.15.130:6819/3016906156","heartbeat_back_addr":"172.21.15.130:6823/3016906156","heartbeat_front_addr":"172.21.15.130:6821/3016906156","state":["exists","up"]},{"osd":8,"uuid":"b05f2429-ef03-4103-b2f0-a4bc66189d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6817","nonce":2889781578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6819","nonce":2889781578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6823","nonce":2889781578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2889781578},{"type":"v1","addr":"172.21.15.153:6821","nonce":2889781578}]},"public_addr":"172.21.15.153:6817/2889781578","cluster_addr":"172.21.15.153:6819/2889781578","heartbeat_back_addr":"172.21.15.153:6823/2889781578","heartbeat_front_addr":"172.21.15.153:6821/2889781578","state":["exists","up"]},{"osd":9,"uuid":"a462e056-c6d3-45bd-ad44-c7a6f3c25033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6827","nonce":2148315365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6829","nonce":2148315365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6833","nonce":2148315365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":2148315365},{"type":"v1","addr":"172.21.15.53:6831","nonce":2148315365}]},"public_addr":"172.21.15.53:6827/2148315365","cluster_addr":"172.21.15.53:6829/2148315365","heartbeat_back_addr":"172.21.15.53:6833/2148315365","heartbeat_front_addr":"172.21.15.53:6831/2148315365","state":["exists","up"]},{"osd":10,"uuid":"05716830-2ec8-49f3-9cce-3efc73c935c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6825","nonce":982629437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6827","nonce":982629437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6831","nonce":982629437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":982629437},{"type":"v1","addr":"172.21.15.130:6829","nonce":982629437}]},"public_addr":"172.21.15.130:6825/982629437","cluster_addr":"172.21.15.130:6827/982629437","heartbeat_back_addr":"172.21.15.130:6831/982629437","heartbeat_front_addr":"172.21.15.130:6829/982629437","state":["exists","up"]},{"osd":11,"uuid":"99124195-0220-48f7-88fe-200568ae4d31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6825","nonce":16997062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6827","nonce":16997062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6831","nonce":16997062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":16997062},{"type":"v1","addr":"172.21.15.153:6829","nonce":16997062}]},"public_addr":"172.21.15.153:6825/16997062","cluster_addr":"172.21.15.153:6827/16997062","heartbeat_back_addr":"172.21.15.153:6831/16997062","heartbeat_front_addr":"172.21.15.153:6829/16997062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:14.220603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:57:38.458486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:02.821032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:27.124772+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:58:50.179045+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:13.019943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:59:38.501290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:02.498011+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:26.011172+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:00:50.370141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:14.392201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:01:38.374849+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":7}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1171085527":"2024-09-01T05:56:14.253642+0000","172.21.15.53:6800/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/1409851736":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/3530571634":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6800/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/3925890211":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1611320170":"2024-09-01T05:54:47.617757+0000","172.21.15.53:6801/2874060887":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6801/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/2127129432":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2464556072":"2024-09-01T05:54:47.617757+0000","172.21.15.53:0/2655797197":"2024-09-01T05:55:12.269899+0000","172.21.15.53:6800/3855814836":"2024-09-01T05:56:14.253642+0000","172.21.15.53:0/1663932105":"2024-09-01T05:55:12.269899+0000","172.21.15.53:0/2624965482":"2024-09-01T05:56:14.253642+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":36,"length":1},{"begin":49,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:31:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 -- 172.21.15.53:0/2126713890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c180b4cd0 msgr2=0x7f6c180b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c180b4cd0 0x7f6c180b71e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f6c24005ec0 tx=0x7f6c240058d0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 -- 172.21.15.53:0/2126713890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c30102820 msgr2=0x7f6c301990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c30102820 0x7f6c301990a0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000c920 tx=0x7f6c2000cde0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 -- 172.21.15.53:0/2126713890 shutdown_connections 2024-08-31T06:31:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f6c180b4cd0 0x7f6c180b71e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c30108ab0 0x7f6c3019e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c30108160 0x7f6c30199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 --2- 172.21.15.53:0/2126713890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c30102820 0x7f6c301990a0 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 -- 172.21.15.53:0/2126713890 >> 172.21.15.53:0/2126713890 conn(0x7f6c300794e0 msgr2=0x7f6c301042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 -- 172.21.15.53:0/2126713890 shutdown_connections 2024-08-31T06:31:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:17.456+0000 7f6c353ad640 1 -- 172.21.15.53:0/2126713890 wait complete. 2024-08-31T06:31:18.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:17 smithi153 ceph-mon[22320]: pgmap v1155: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-08-31T06:31:18.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:17 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/2126713890' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:31:18.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:17 smithi053 ceph-mon[18924]: pgmap v1155: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-08-31T06:31:18.225 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:17 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/2126713890' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:31:18.229 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:17 smithi130 ceph-mon[22266]: pgmap v1155: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-08-31T06:31:18.230 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:17 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/2126713890' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:31:18.653 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs fail cephfs 2024-08-31T06:31:18.948 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:31:19.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.585+0000 7fae813e0640 1 -- 172.21.15.53:0/3682712466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c10dbd0 msgr2=0x7fae7c1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:19.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.585+0000 7fae813e0640 1 --2- 172.21.15.53:0/3682712466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c10dbd0 0x7fae7c1100c0 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7fae74009ca0 tx=0x7fae7402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:31:19.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.585+0000 7fae813e0640 1 -- 172.21.15.53:0/3682712466 shutdown_connections 2024-08-31T06:31:19.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.585+0000 7fae813e0640 1 --2- 172.21.15.53:0/3682712466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c10dbd0 0x7fae7c1100c0 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.585+0000 7fae813e0640 1 --2- 172.21.15.53:0/3682712466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae7c1050c0 0x7fae7c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.585+0000 7fae813e0640 1 --2- 172.21.15.53:0/3682712466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae7c104770 0x7fae7c104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.585+0000 7fae813e0640 1 -- 172.21.15.53:0/3682712466 >> 172.21.15.53:0/3682712466 conn(0x7fae7c0794e0 msgr2=0x7fae7c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.585+0000 7fae813e0640 1 -- 172.21.15.53:0/3682712466 shutdown_connections 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.585+0000 7fae813e0640 1 -- 172.21.15.53:0/3682712466 wait complete. 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae813e0640 1 Processor -- start 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae813e0640 1 -- start start 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae813e0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae7c104770 0x7fae7c19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae813e0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae7c1050c0 0x7fae7c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae813e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c10dbd0 0x7fae7c19f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae813e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c113750 con 0x7fae7c10dbd0 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae813e0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c1135d0 con 0x7fae7c1050c0 2024-08-31T06:31:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae813e0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c1138d0 con 0x7fae7c104770 2024-08-31T06:31:19.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae7b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c10dbd0 0x7fae7c19f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:19.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae7b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c10dbd0 0x7fae7c19f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48792/0 (socket says 172.21.15.53:48792) 2024-08-31T06:31:19.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae7b7fe640 1 -- 172.21.15.53:0/663585525 learned_addr learned my addr 172.21.15.53:0/663585525 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:31:19.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.586+0000 7fae7affd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae7c104770 0x7fae7c19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:19.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.587+0000 7fae7a7fc640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae7c1050c0 0x7fae7c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:19.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.587+0000 7fae7b7fe640 1 -- 172.21.15.53:0/663585525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae7c104770 msgr2=0x7fae7c19a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:19.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.587+0000 7fae7b7fe640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae7c104770 0x7fae7c19a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.587+0000 7fae7b7fe640 1 -- 172.21.15.53:0/663585525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae7c1050c0 msgr2=0x7fae7c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.587+0000 7fae7b7fe640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae7c1050c0 0x7fae7c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.587+0000 7fae7b7fe640 1 -- 172.21.15.53:0/663585525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7c1a00b0 con 0x7fae7c10dbd0 2024-08-31T06:31:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.587+0000 7fae7affd640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae7c104770 0x7fae7c19a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:31:19.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.587+0000 7fae7b7fe640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c10dbd0 0x7fae7c19f980 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7fae74005e30 tx=0x7fae740093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.591+0000 7fae63fff640 1 -- 172.21.15.53:0/663585525 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74032d10 con 0x7fae7c10dbd0 2024-08-31T06:31:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.591+0000 7fae63fff640 1 -- 172.21.15.53:0/663585525 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae74032eb0 con 0x7fae7c10dbd0 2024-08-31T06:31:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.591+0000 7fae813e0640 1 -- 172.21.15.53:0/663585525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae7c1a0340 con 0x7fae7c10dbd0 2024-08-31T06:31:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.591+0000 7fae63fff640 1 -- 172.21.15.53:0/663585525 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74030b20 con 0x7fae7c10dbd0 2024-08-31T06:31:19.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.591+0000 7fae813e0640 1 -- 172.21.15.53:0/663585525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae7c1a6b00 con 0x7fae7c10dbd0 2024-08-31T06:31:19.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.592+0000 7fae813e0640 1 -- 172.21.15.53:0/663585525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae7c104b80 con 0x7fae7c10dbd0 2024-08-31T06:31:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.594+0000 7fae63fff640 1 -- 172.21.15.53:0/663585525 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fae74030cc0 con 0x7fae7c10dbd0 2024-08-31T06:31:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.595+0000 7fae63fff640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae640b4d20 0x7fae640b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.595+0000 7fae7affd640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae640b4d20 0x7fae640b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.595+0000 7fae63fff640 1 -- 172.21.15.53:0/663585525 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 8557+0+0 (secure 0 0 0) 0x7fae74106830 con 0x7fae7c10dbd0 2024-08-31T06:31:19.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.595+0000 7fae7affd640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae640b4d20 0x7fae640b7230 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fae6c005fd0 tx=0x7fae6c00b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:19.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.601+0000 7fae63fff640 1 -- 172.21.15.53:0/663585525 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fae740cd5a0 con 0x7fae7c10dbd0 2024-08-31T06:31:19.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.824+0000 7fae813e0640 1 -- 172.21.15.53:0/663585525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fae7c19b270 con 0x7fae7c10dbd0 2024-08-31T06:31:19.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.826+0000 7fae63fff640 1 -- 172.21.15.53:0/663585525 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v96) ==== 161+0+0 (secure 0 0 0) 0x7fae7c19b270 con 0x7fae7c10dbd0 2024-08-31T06:31:19.828 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-31T06:31:19.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.830+0000 7fae813e0640 1 -- 172.21.15.53:0/663585525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae640b4d20 msgr2=0x7fae640b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:19.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.830+0000 7fae813e0640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae640b4d20 0x7fae640b7230 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fae6c005fd0 tx=0x7fae6c00b410 comp rx=0 tx=0).stop 2024-08-31T06:31:19.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.830+0000 7fae813e0640 1 -- 172.21.15.53:0/663585525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c10dbd0 msgr2=0x7fae7c19f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:19.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.830+0000 7fae813e0640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c10dbd0 0x7fae7c19f980 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7fae74005e30 tx=0x7fae740093d0 comp rx=0 tx=0).stop 2024-08-31T06:31:19.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.830+0000 7fae813e0640 1 -- 172.21.15.53:0/663585525 shutdown_connections 2024-08-31T06:31:19.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.830+0000 7fae813e0640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fae640b4d20 0x7fae640b7230 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:19.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.830+0000 7fae813e0640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c10dbd0 0x7fae7c19f980 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:19.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.830+0000 7fae813e0640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae7c1050c0 0x7fae7c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:19.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.830+0000 7fae813e0640 1 --2- 172.21.15.53:0/663585525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae7c104770 0x7fae7c19a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:19.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.830+0000 7fae813e0640 1 -- 172.21.15.53:0/663585525 >> 172.21.15.53:0/663585525 conn(0x7fae7c0794e0 msgr2=0x7fae7c0ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:19.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.830+0000 7fae813e0640 1 -- 172.21.15.53:0/663585525 shutdown_connections 2024-08-31T06:31:19.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:19.831+0000 7fae813e0640 1 -- 172.21.15.53:0/663585525 wait complete. 2024-08-31T06:31:19.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:19.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:19.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-mon[18924]: pgmap v1156: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 716 B/s wr, 11 op/s 2024-08-31T06:31:19.848 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a[18920]: 2024-08-31T06:31:19.825+0000 7f85b6a26640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T06:31:19.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:19.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:19.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-mon[22266]: pgmap v1156: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 716 B/s wr, 11 op/s 2024-08-31T06:31:19.918 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:19.918 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:19.918 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-mon[22320]: pgmap v1156: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 716 B/s wr, 11 op/s 2024-08-31T06:31:20.175 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c[53556]: ignoring --setuser ceph since I am not root 2024-08-31T06:31:20.175 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c[53556]: ignoring --setgroup ceph since I am not root 2024-08-31T06:31:20.175 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-mds[53560]: -- 172.21.15.153:0/824891350 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561d17539860 con 0x561d1b6dfa80 2024-08-31T06:31:20.175 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c[53556]: starting mds.c at 2024-08-31T06:31:20.176 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i[53855]: ignoring --setuser ceph since I am not root 2024-08-31T06:31:20.176 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i[53855]: ignoring --setgroup ceph since I am not root 2024-08-31T06:31:20.176 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-mds[53859]: -- 172.21.15.153:0/1688642512 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b7466c5520 con 0x55b74a861180 2024-08-31T06:31:20.176 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-mds[53859]: -- 172.21.15.153:0/1688642512 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b7466bb860 con 0x55b74a861180 2024-08-31T06:31:20.176 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i[53855]: starting mds.i at 2024-08-31T06:31:20.176 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f[53255]: ignoring --setuser ceph since I am not root 2024-08-31T06:31:20.176 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f[53255]: ignoring --setgroup ceph since I am not root 2024-08-31T06:31:20.177 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-mds[53259]: -- 172.21.15.153:0/607455443 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4f9c9d860 con 0x55a4fde43a80 2024-08-31T06:31:20.177 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f[53255]: starting mds.f at 2024-08-31T06:31:20.177 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l[52940]: ignoring --setuser ceph since I am not root 2024-08-31T06:31:20.177 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l[52940]: ignoring --setgroup ceph since I am not root 2024-08-31T06:31:20.177 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-mds[52944]: -- 172.21.15.153:0/4260974965 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d5a4f5860 con 0x562d5e69b600 2024-08-31T06:31:20.177 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:31:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l[52940]: starting mds.l at 2024-08-31T06:31:20.226 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a[64078]: ignoring --setuser ceph since I am not root 2024-08-31T06:31:20.226 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a[64078]: ignoring --setgroup ceph since I am not root 2024-08-31T06:31:20.226 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-mds[64082]: -- 172.21.15.53:0/1714330127 <== mon.0 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562452b5f860 con 0x562456d05180 2024-08-31T06:31:20.226 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a[64078]: starting mds.a at 2024-08-31T06:31:20.226 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g[63687]: ignoring --setuser ceph since I am not root 2024-08-31T06:31:20.226 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g[63687]: ignoring --setgroup ceph since I am not root 2024-08-31T06:31:20.226 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-mds[63702]: -- 172.21.15.53:0/2580217056 <== mon.0 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a097d77860 con 0x55a09bf1d600 2024-08-31T06:31:20.226 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:31:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g[63687]: starting mds.g at 2024-08-31T06:31:20.378 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e[53323]: ignoring --setuser ceph since I am not root 2024-08-31T06:31:20.378 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e[53323]: ignoring --setgroup ceph since I am not root 2024-08-31T06:31:20.378 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-mds[53327]: -- 172.21.15.130:0/3099207092 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55be3e8f9860 con 0x55be42a9f180 2024-08-31T06:31:20.378 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e[53323]: starting mds.e at 2024-08-31T06:31:20.379 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h[53621]: ignoring --setuser ceph since I am not root 2024-08-31T06:31:20.379 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h[53621]: ignoring --setgroup ceph since I am not root 2024-08-31T06:31:20.379 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-mds[53625]: -- 172.21.15.130:0/4156739010 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5596b2a93860 con 0x5596b6c39a80 2024-08-31T06:31:20.379 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h[53621]: starting mds.h at 2024-08-31T06:31:20.379 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k[53004]: ignoring --setuser ceph since I am not root 2024-08-31T06:31:20.379 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k[53004]: ignoring --setgroup ceph since I am not root 2024-08-31T06:31:20.379 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-mds[53008]: -- 172.21.15.130:0/733375173 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5637924db860 con 0x563796681180 2024-08-31T06:31:20.379 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k[53004]: starting mds.k at 2024-08-31T06:31:20.380 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: ignoring --setuser ceph since I am not root 2024-08-31T06:31:20.380 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: ignoring --setgroup ceph since I am not root 2024-08-31T06:31:20.380 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-mds[53928]: -- 172.21.15.130:0/1829581937 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c51e621860 con 0x55c5227c7a80 2024-08-31T06:31:20.380 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:31:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: starting mds.b at 2024-08-31T06:31:20.716 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:20 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/663585525' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T06:31:20.716 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:20 smithi053 ceph-mon[18924]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T06:31:20.716 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:20 smithi053 ceph-mon[18924]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T06:31:20.716 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:20 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/663585525' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T06:31:20.716 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:20 smithi053 ceph-mon[18924]: osdmap e117: 12 total, 12 up, 12 in 2024-08-31T06:31:20.716 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:20 smithi053 ceph-mon[18924]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-31T06:31:20.749 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-31T06:31:20.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:20 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/663585525' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T06:31:20.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:20 smithi130 ceph-mon[22266]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T06:31:20.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:20 smithi130 ceph-mon[22266]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T06:31:20.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:20 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/663585525' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T06:31:20.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:20 smithi130 ceph-mon[22266]: osdmap e117: 12 total, 12 up, 12 in 2024-08-31T06:31:20.878 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:20 smithi130 ceph-mon[22266]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-31T06:31:20.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:20 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/663585525' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T06:31:20.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:20 smithi153 ceph-mon[22320]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T06:31:20.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:20 smithi153 ceph-mon[22320]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T06:31:20.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:20 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/663585525' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T06:31:20.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:20 smithi153 ceph-mon[22320]: osdmap e117: 12 total, 12 up, 12 in 2024-08-31T06:31:20.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:20 smithi153 ceph-mon[22320]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-31T06:31:21.356 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:31:21.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.865+0000 7f1be071f640 1 -- 172.21.15.53:0/2615594663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd8109be0 msgr2=0x7f1bd8110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.865+0000 7f1be071f640 1 --2- 172.21.15.53:0/2615594663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd8109be0 0x7f1bd8110410 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009ca0 tx=0x7f1bd002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:31:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.866+0000 7f1be071f640 1 -- 172.21.15.53:0/2615594663 shutdown_connections 2024-08-31T06:31:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.866+0000 7f1be071f640 1 --2- 172.21.15.53:0/2615594663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd8109be0 0x7f1bd8110410 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.866+0000 7f1be071f640 1 --2- 172.21.15.53:0/2615594663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bd8109290 0x7f1bd81096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.866+0000 7f1be071f640 1 --2- 172.21.15.53:0/2615594663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8103950 0x7f1bd8103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.866+0000 7f1be071f640 1 -- 172.21.15.53:0/2615594663 >> 172.21.15.53:0/2615594663 conn(0x7f1bd80ff3a0 msgr2=0x7f1bd81017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.866+0000 7f1be071f640 1 -- 172.21.15.53:0/2615594663 shutdown_connections 2024-08-31T06:31:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.866+0000 7f1be071f640 1 -- 172.21.15.53:0/2615594663 wait complete. 2024-08-31T06:31:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.866+0000 7f1be071f640 1 Processor -- start 2024-08-31T06:31:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.866+0000 7f1be071f640 1 -- start start 2024-08-31T06:31:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1be071f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8103950 0x7f1bd819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1be071f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bd8109290 0x7f1bd819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1be071f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd8109be0 0x7f1bd819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1be071f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd81137a0 con 0x7f1bd8109be0 2024-08-31T06:31:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1be071f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8113620 con 0x7f1bd8103950 2024-08-31T06:31:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1be071f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8113920 con 0x7f1bd8109290 2024-08-31T06:31:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bdecbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd8109be0 0x7f1bd819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bdecbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd8109be0 0x7f1bd819f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48830/0 (socket says 172.21.15.53:48830) 2024-08-31T06:31:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bdecbc640 1 -- 172.21.15.53:0/1671788317 learned_addr learned my addr 172.21.15.53:0/1671788317 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:31:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bde4bb640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8103950 0x7f1bd819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bddcba640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bd8109290 0x7f1bd819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bdecbc640 1 -- 172.21.15.53:0/1671788317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bd8109290 msgr2=0x7f1bd819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bdecbc640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bd8109290 0x7f1bd819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bdecbc640 1 -- 172.21.15.53:0/1671788317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8103950 msgr2=0x7f1bd819a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bdecbc640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8103950 0x7f1bd819a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bdecbc640 1 -- 172.21.15.53:0/1671788317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd81a00c0 con 0x7f1bd8109be0 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bdecbc640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd8109be0 0x7f1bd819f990 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0005cc0 tx=0x7f1bd0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bcf7fe640 1 -- 172.21.15.53:0/1671788317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0032e00 con 0x7f1bd8109be0 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.867+0000 7f1bcf7fe640 1 -- 172.21.15.53:0/1671788317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bd00044d0 con 0x7f1bd8109be0 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.868+0000 7f1be071f640 1 -- 172.21.15.53:0/1671788317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd81a0350 con 0x7f1bd8109be0 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.868+0000 7f1bcf7fe640 1 -- 172.21.15.53:0/1671788317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0030b70 con 0x7f1bd8109be0 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.868+0000 7f1be071f640 1 -- 172.21.15.53:0/1671788317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd81a6b10 con 0x7f1bd8109be0 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.869+0000 7f1be071f640 1 -- 172.21.15.53:0/1671788317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd8103d60 con 0x7f1bd8109be0 2024-08-31T06:31:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.870+0000 7f1bcf7fe640 1 -- 172.21.15.53:0/1671788317 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1bd0030d10 con 0x7f1bd8109be0 2024-08-31T06:31:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.871+0000 7f1bcf7fe640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1bc40b4ca0 0x7f1bc40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.872+0000 7f1bde4bb640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1bc40b4ca0 0x7f1bc40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.872+0000 7f1bcf7fe640 1 -- 172.21.15.53:0/1671788317 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8943+0+0 (secure 0 0 0) 0x7f1bd0106bc0 con 0x7f1bd8109be0 2024-08-31T06:31:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.872+0000 7f1bde4bb640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1bc40b4ca0 0x7f1bc40b71b0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4005fd0 tx=0x7f1bd4005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:21.875+0000 7f1bcf7fe640 1 -- 172.21.15.53:0/1671788317 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1bd00cd810 con 0x7f1bd8109be0 2024-08-31T06:31:22.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.099+0000 7f1be071f640 1 -- 172.21.15.53:0/1671788317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1bd810ba30 con 0x7f1bd8109be0 2024-08-31T06:31:22.101 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.130:6832/1502939471,v1:172.21.15.130:6834/1502939471] up:boot 2024-08-31T06:31:22.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.130:6833/2955880575,v1:172.21.15.130:6835/2955880575] up:boot 2024-08-31T06:31:22.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.153:6832/4256606549,v1:172.21.15.153:6834/4256606549] up:boot 2024-08-31T06:31:22.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.153:6833/844093820,v1:172.21.15.153:6835/844093820] up:boot 2024-08-31T06:31:22.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.153:6837/1709261789,v1:172.21.15.153:6839/1709261789] up:boot 2024-08-31T06:31:22.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.153:6836/1533671433,v1:172.21.15.153:6838/1533671433] up:boot 2024-08-31T06:31:22.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.130:6836/801639740,v1:172.21.15.130:6837/801639740] up:boot 2024-08-31T06:31:22.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.130:6838/4052024337,v1:172.21.15.130:6839/4052024337] up:boot 2024-08-31T06:31:22.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.53:6838/964814129,v1:172.21.15.53:6839/964814129] up:boot 2024-08-31T06:31:22.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: mds.? [v2:172.21.15.53:6840/3575955687,v1:172.21.15.53:6841/3575955687] up:boot 2024-08-31T06:31:22.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-31T06:31:22.102 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: pgmap v1158: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:31:22.103 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:31:22.104 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:21 smithi053 ceph-mon[18924]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.130:6832/1502939471,v1:172.21.15.130:6834/1502939471] up:boot 2024-08-31T06:31:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.130:6833/2955880575,v1:172.21.15.130:6835/2955880575] up:boot 2024-08-31T06:31:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.153:6832/4256606549,v1:172.21.15.153:6834/4256606549] up:boot 2024-08-31T06:31:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.153:6833/844093820,v1:172.21.15.153:6835/844093820] up:boot 2024-08-31T06:31:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.153:6837/1709261789,v1:172.21.15.153:6839/1709261789] up:boot 2024-08-31T06:31:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.153:6836/1533671433,v1:172.21.15.153:6838/1533671433] up:boot 2024-08-31T06:31:22.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.130:6836/801639740,v1:172.21.15.130:6837/801639740] up:boot 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.130:6838/4052024337,v1:172.21.15.130:6839/4052024337] up:boot 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.53:6838/964814129,v1:172.21.15.53:6839/964814129] up:boot 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: mds.? [v2:172.21.15.53:6840/3575955687,v1:172.21.15.53:6841/3575955687] up:boot 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:31:22.129 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:31:22.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T06:31:22.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:31:22.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: pgmap v1158: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-08-31T06:31:22.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:22.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:22.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:31:22.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:31:22.130 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:21 smithi130 ceph-mon[22266]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:22.176 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.130:6832/1502939471,v1:172.21.15.130:6834/1502939471] up:boot 2024-08-31T06:31:22.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.130:6833/2955880575,v1:172.21.15.130:6835/2955880575] up:boot 2024-08-31T06:31:22.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.153:6832/4256606549,v1:172.21.15.153:6834/4256606549] up:boot 2024-08-31T06:31:22.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.153:6833/844093820,v1:172.21.15.153:6835/844093820] up:boot 2024-08-31T06:31:22.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.153:6837/1709261789,v1:172.21.15.153:6839/1709261789] up:boot 2024-08-31T06:31:22.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.153:6836/1533671433,v1:172.21.15.153:6838/1533671433] up:boot 2024-08-31T06:31:22.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.130:6836/801639740,v1:172.21.15.130:6837/801639740] up:boot 2024-08-31T06:31:22.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.130:6838/4052024337,v1:172.21.15.130:6839/4052024337] up:boot 2024-08-31T06:31:22.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.53:6838/964814129,v1:172.21.15.53:6839/964814129] up:boot 2024-08-31T06:31:22.177 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: mds.? [v2:172.21.15.53:6840/3575955687,v1:172.21.15.53:6841/3575955687] up:boot 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: pgmap v1158: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:22.178 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:22.179 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:31:22.179 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:31:22.179 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:21 smithi153 ceph-mon[22320]: from='mgr.14220 172.21.15.53:0/3061429231' entity='mgr.x' 2024-08-31T06:31:22.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.841+0000 7f1bcf7fe640 1 -- 172.21.15.53:0/1671788317 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v98) ==== 104+0+0 (secure 0 0 0) 0x7f1bd00cd110 con 0x7f1bd8109be0 2024-08-31T06:31:22.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.845+0000 7f1be071f640 1 -- 172.21.15.53:0/1671788317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1bc40b4ca0 msgr2=0x7f1bc40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:22.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.845+0000 7f1be071f640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1bc40b4ca0 0x7f1bc40b71b0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4005fd0 tx=0x7f1bd4005850 comp rx=0 tx=0).stop 2024-08-31T06:31:22.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.845+0000 7f1be071f640 1 -- 172.21.15.53:0/1671788317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd8109be0 msgr2=0x7f1bd819f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:22.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.845+0000 7f1be071f640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd8109be0 0x7f1bd819f990 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0005cc0 tx=0x7f1bd0032a10 comp rx=0 tx=0).stop 2024-08-31T06:31:22.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.846+0000 7f1be071f640 1 -- 172.21.15.53:0/1671788317 shutdown_connections 2024-08-31T06:31:22.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.846+0000 7f1be071f640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7f1bc40b4ca0 0x7f1bc40b71b0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:22.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.846+0000 7f1be071f640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd8109be0 0x7f1bd819f990 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:22.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.846+0000 7f1be071f640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bd8109290 0x7f1bd819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:22.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.846+0000 7f1be071f640 1 --2- 172.21.15.53:0/1671788317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8103950 0x7f1bd819a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:22.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.846+0000 7f1be071f640 1 -- 172.21.15.53:0/1671788317 >> 172.21.15.53:0/1671788317 conn(0x7f1bd80ff3a0 msgr2=0x7f1bd81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:22.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.846+0000 7f1be071f640 1 -- 172.21.15.53:0/1671788317 shutdown_connections 2024-08-31T06:31:22.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:22.846+0000 7f1be071f640 1 -- 172.21.15.53:0/1671788317 wait complete. 2024-08-31T06:31:23.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:22 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1671788317' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:31:23.159 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:22 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1671788317' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:31:23.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:22 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1671788317' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:31:23.497 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-31T06:31:23.758 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:31:24.122 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:23 smithi053 ceph-mon[18924]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T06:31:24.122 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:23 smithi053 ceph-mon[18924]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T06:31:24.122 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:23 smithi053 ceph-mon[18924]: Cluster is now healthy 2024-08-31T06:31:24.122 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:23 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/1671788317' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T06:31:24.122 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:23 smithi053 ceph-mon[18924]: fsmap 12 up:standby 2024-08-31T06:31:24.123 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:23 smithi053 ceph-mon[18924]: pgmap v1159: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-31T06:31:24.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:23 smithi130 ceph-mon[22266]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T06:31:24.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:23 smithi130 ceph-mon[22266]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T06:31:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:23 smithi130 ceph-mon[22266]: Cluster is now healthy 2024-08-31T06:31:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:23 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/1671788317' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T06:31:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:23 smithi130 ceph-mon[22266]: fsmap 12 up:standby 2024-08-31T06:31:24.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:23 smithi130 ceph-mon[22266]: pgmap v1159: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-31T06:31:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:23 smithi153 ceph-mon[22320]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T06:31:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:23 smithi153 ceph-mon[22320]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T06:31:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:23 smithi153 ceph-mon[22320]: Cluster is now healthy 2024-08-31T06:31:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:23 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/1671788317' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T06:31:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:23 smithi153 ceph-mon[22320]: fsmap 12 up:standby 2024-08-31T06:31:24.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:23 smithi153 ceph-mon[22320]: pgmap v1159: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-31T06:31:24.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.215+0000 7fdb13928640 1 -- 172.21.15.53:0/2732204995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c102800 msgr2=0x7fdb0c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.215+0000 7fdb13928640 1 --2- 172.21.15.53:0/2732204995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c102800 0x7fdb0c102c10 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009900 tx=0x7fdb0802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:31:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.215+0000 7fdb13928640 1 -- 172.21.15.53:0/2732204995 shutdown_connections 2024-08-31T06:31:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.215+0000 7fdb13928640 1 --2- 172.21.15.53:0/2732204995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb0c108a90 0x7fdb0c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.215+0000 7fdb13928640 1 --2- 172.21.15.53:0/2732204995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c108140 0x7fdb0c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.215+0000 7fdb13928640 1 --2- 172.21.15.53:0/2732204995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c102800 0x7fdb0c102c10 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.215+0000 7fdb13928640 1 -- 172.21.15.53:0/2732204995 >> 172.21.15.53:0/2732204995 conn(0x7fdb0c0794d0 msgr2=0x7fdb0c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.215+0000 7fdb13928640 1 -- 172.21.15.53:0/2732204995 shutdown_connections 2024-08-31T06:31:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.215+0000 7fdb13928640 1 -- 172.21.15.53:0/2732204995 wait complete. 2024-08-31T06:31:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.216+0000 7fdb13928640 1 Processor -- start 2024-08-31T06:31:24.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.216+0000 7fdb13928640 1 -- start start 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.216+0000 7fdb13928640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb0c102800 0x7fdb0c19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.216+0000 7fdb13928640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c108140 0x7fdb0c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.216+0000 7fdb13928640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c108a90 0x7fdb0c19f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.216+0000 7fdb13928640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c1136d0 con 0x7fdb0c108a90 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.216+0000 7fdb13928640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c113550 con 0x7fdb0c102800 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.216+0000 7fdb13928640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c113850 con 0x7fdb0c108140 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb11ec5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c108a90 0x7fdb0c19f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb11ec5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c108a90 0x7fdb0c19f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48470/0 (socket says 172.21.15.53:48470) 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb11ec5640 1 -- 172.21.15.53:0/34836949 learned_addr learned my addr 172.21.15.53:0/34836949 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb10ec3640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c108140 0x7fdb0c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb116c4640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb0c102800 0x7fdb0c19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb11ec5640 1 -- 172.21.15.53:0/34836949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c108140 msgr2=0x7fdb0c19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:24.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb11ec5640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c108140 0x7fdb0c19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb11ec5640 1 -- 172.21.15.53:0/34836949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb0c102800 msgr2=0x7fdb0c19a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb11ec5640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb0c102800 0x7fdb0c19a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb11ec5640 1 -- 172.21.15.53:0/34836949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c1a0010 con 0x7fdb0c108a90 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb10ec3640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c108140 0x7fdb0c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb116c4640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb0c102800 0x7fdb0c19a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb11ec5640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c108a90 0x7fdb0c19f9a0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400cce0 tx=0x7fdb0400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb027fc640 1 -- 172.21.15.53:0/34836949 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400f450 con 0x7fdb0c108a90 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb13928640 1 -- 172.21.15.53:0/34836949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0c1a0300 con 0x7fdb0c108a90 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb027fc640 1 -- 172.21.15.53:0/34836949 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb0400fa80 con 0x7fdb0c108a90 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb027fc640 1 -- 172.21.15.53:0/34836949 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04018ad0 con 0x7fdb0c108a90 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.217+0000 7fdb13928640 1 -- 172.21.15.53:0/34836949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0c1a6b20 con 0x7fdb0c108a90 2024-08-31T06:31:24.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.218+0000 7fdb13928640 1 -- 172.21.15.53:0/34836949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0c102c10 con 0x7fdb0c108a90 2024-08-31T06:31:24.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.221+0000 7fdb027fc640 1 -- 172.21.15.53:0/34836949 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdb0400f5f0 con 0x7fdb0c108a90 2024-08-31T06:31:24.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.222+0000 7fdb027fc640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdaf80b4cd0 0x7fdaf80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:24.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.222+0000 7fdb116c4640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdaf80b4cd0 0x7fdaf80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:24.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.222+0000 7fdb027fc640 1 -- 172.21.15.53:0/34836949 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 8943+0+0 (secure 0 0 0) 0x7fdb040e6080 con 0x7fdb0c108a90 2024-08-31T06:31:24.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.222+0000 7fdb116c4640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdaf80b4cd0 0x7fdaf80b71e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdb08006010 tx=0x7fdb08000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:24.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.225+0000 7fdb027fc640 1 -- 172.21.15.53:0/34836949 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdb04014030 con 0x7fdb0c108a90 2024-08-31T06:31:24.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.410+0000 7fdb13928640 1 -- 172.21.15.53:0/34836949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdb0c19b290 con 0x7fdb0c108a90 2024-08-31T06:31:24.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.850+0000 7fdb027fc640 1 -- 172.21.15.53:0/34836949 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v118) ==== 181+0+0 (secure 0 0 0) 0x7fdb0c19b290 con 0x7fdb0c108a90 2024-08-31T06:31:24.853 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-08-31T06:31:24.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.853+0000 7fdb13928640 1 -- 172.21.15.53:0/34836949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdaf80b4cd0 msgr2=0x7fdaf80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:24.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.853+0000 7fdb13928640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdaf80b4cd0 0x7fdaf80b71e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdb08006010 tx=0x7fdb08000bc0 comp rx=0 tx=0).stop 2024-08-31T06:31:24.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.853+0000 7fdb13928640 1 -- 172.21.15.53:0/34836949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c108a90 msgr2=0x7fdb0c19f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:24.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.853+0000 7fdb13928640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c108a90 0x7fdb0c19f9a0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400cce0 tx=0x7fdb0400a620 comp rx=0 tx=0).stop 2024-08-31T06:31:24.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.854+0000 7fdb13928640 1 -- 172.21.15.53:0/34836949 shutdown_connections 2024-08-31T06:31:24.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.854+0000 7fdb13928640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fdaf80b4cd0 0x7fdaf80b71e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:24.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.854+0000 7fdb13928640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c108a90 0x7fdb0c19f9a0 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:24.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.854+0000 7fdb13928640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb0c108140 0x7fdb0c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:24.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.854+0000 7fdb13928640 1 --2- 172.21.15.53:0/34836949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb0c102800 0x7fdb0c19a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:24.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.854+0000 7fdb13928640 1 -- 172.21.15.53:0/34836949 >> 172.21.15.53:0/34836949 conn(0x7fdb0c0794d0 msgr2=0x7fdb0c1013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:24.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.854+0000 7fdb13928640 1 -- 172.21.15.53:0/34836949 shutdown_connections 2024-08-31T06:31:24.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:24.854+0000 7fdb13928640 1 -- 172.21.15.53:0/34836949 wait complete. 2024-08-31T06:31:25.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:24 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/34836949' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:31:25.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:24 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/34836949' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:31:25.195 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:24 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/34836949' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:31:25.514 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-31T06:31:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:31:26.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:25 smithi130 ceph-mon[22266]: pgmap v1160: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-08-31T06:31:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:25 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/34836949' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:31:26.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:25 smithi130 ceph-mon[22266]: osdmap e118: 12 total, 12 up, 12 in 2024-08-31T06:31:26.166 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:25 smithi053 ceph-mon[18924]: pgmap v1160: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-08-31T06:31:26.166 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:25 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/34836949' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:31:26.166 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:25 smithi053 ceph-mon[18924]: osdmap e118: 12 total, 12 up, 12 in 2024-08-31T06:31:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:25 smithi153 ceph-mon[22320]: pgmap v1160: 97 pgs: 97 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-08-31T06:31:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:25 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/34836949' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:31:26.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:25 smithi153 ceph-mon[22320]: osdmap e118: 12 total, 12 up, 12 in 2024-08-31T06:31:26.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.258+0000 7fc10e19e640 1 -- 172.21.15.53:0/3904213715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc108101d90 msgr2=0x7fc1081021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:26.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.258+0000 7fc10e19e640 1 --2- 172.21.15.53:0/3904213715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc108101d90 0x7fc1081021a0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009900 tx=0x7fc0f802a410 comp rx=0 tx=0).stop 2024-08-31T06:31:26.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.258+0000 7fc10e19e640 1 -- 172.21.15.53:0/3904213715 shutdown_connections 2024-08-31T06:31:26.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.258+0000 7fc10e19e640 1 --2- 172.21.15.53:0/3904213715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1081069c0 0x7fc108110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:26.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.258+0000 7fc10e19e640 1 --2- 172.21.15.53:0/3904213715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc108106070 0x7fc108106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:26.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.258+0000 7fc10e19e640 1 --2- 172.21.15.53:0/3904213715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc108101d90 0x7fc1081021a0 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:26.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.258+0000 7fc10e19e640 1 -- 172.21.15.53:0/3904213715 >> 172.21.15.53:0/3904213715 conn(0x7fc108079bd0 msgr2=0x7fc108079fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.258+0000 7fc10e19e640 1 -- 172.21.15.53:0/3904213715 shutdown_connections 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.258+0000 7fc10e19e640 1 -- 172.21.15.53:0/3904213715 wait complete. 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.259+0000 7fc10e19e640 1 Processor -- start 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.259+0000 7fc10e19e640 1 -- start start 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.259+0000 7fc10e19e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc108101d90 0x7fc10819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.259+0000 7fc10e19e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc108106070 0x7fc10819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.259+0000 7fc10e19e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1081069c0 0x7fc10819f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.259+0000 7fc10e19e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc108113710 con 0x7fc108101d90 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.259+0000 7fc10e19e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc108113590 con 0x7fc108106070 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.259+0000 7fc10e19e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc108113890 con 0x7fc1081069c0 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.259+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc108101d90 0x7fc10819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc107fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1081069c0 0x7fc10819f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:26.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc108101d90 0x7fc10819a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48476/0 (socket says 172.21.15.53:48476) 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc1077fe640 1 -- 172.21.15.53:0/463305896 learned_addr learned my addr 172.21.15.53:0/463305896 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc0feffd640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc108106070 0x7fc10819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc1077fe640 1 -- 172.21.15.53:0/463305896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1081069c0 msgr2=0x7fc10819f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc1077fe640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1081069c0 0x7fc10819f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc1077fe640 1 -- 172.21.15.53:0/463305896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc108106070 msgr2=0x7fc10819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc1077fe640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc108106070 0x7fc10819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc1077fe640 1 -- 172.21.15.53:0/463305896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1081a00d0 con 0x7fc108101d90 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc107fff640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1081069c0 0x7fc10819f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc1077fe640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc108101d90 0x7fc10819a160 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009230 tx=0x7fc0f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc1057fa640 1 -- 172.21.15.53:0/463305896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f803f030 con 0x7fc108101d90 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc10e19e640 1 -- 172.21.15.53:0/463305896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1081a0360 con 0x7fc108101d90 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc1057fa640 1 -- 172.21.15.53:0/463305896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0f8003a80 con 0x7fc108101d90 2024-08-31T06:31:26.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc1057fa640 1 -- 172.21.15.53:0/463305896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8035070 con 0x7fc108101d90 2024-08-31T06:31:26.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.260+0000 7fc10e19e640 1 -- 172.21.15.53:0/463305896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1081a6b20 con 0x7fc108101d90 2024-08-31T06:31:26.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.261+0000 7fc10e19e640 1 -- 172.21.15.53:0/463305896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1081021a0 con 0x7fc108101d90 2024-08-31T06:31:26.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.263+0000 7fc1057fa640 1 -- 172.21.15.53:0/463305896 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc0f8042030 con 0x7fc108101d90 2024-08-31T06:31:26.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.264+0000 7fc1057fa640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0f40b4ca0 0x7fc0f40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:31:26.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.264+0000 7fc0feffd640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0f40b4ca0 0x7fc0f40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:31:26.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.264+0000 7fc1057fa640 1 -- 172.21.15.53:0/463305896 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 8418+0+0 (secure 0 0 0) 0x7fc0f8105fe0 con 0x7fc108101d90 2024-08-31T06:31:26.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.265+0000 7fc0feffd640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0f40b4ca0 0x7fc0f40b71b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc10806b1b0 tx=0x7fc0f000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:31:26.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.268+0000 7fc1057fa640 1 -- 172.21.15.53:0/463305896 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc0f80cc7e0 con 0x7fc108101d90 2024-08-31T06:31:26.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.451+0000 7fc10e19e640 1 -- 172.21.15.53:0/463305896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc10819b290 con 0x7fc108101d90 2024-08-31T06:31:26.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.866+0000 7fc1057fa640 1 -- 172.21.15.53:0/463305896 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v119) ==== 169+0+0 (secure 0 0 0) 0x7fc0f80d5370 con 0x7fc108101d90 2024-08-31T06:31:26.869 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-08-31T06:31:26.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.869+0000 7fc10e19e640 1 -- 172.21.15.53:0/463305896 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0f40b4ca0 msgr2=0x7fc0f40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:26.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.869+0000 7fc10e19e640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0f40b4ca0 0x7fc0f40b71b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc10806b1b0 tx=0x7fc0f000b390 comp rx=0 tx=0).stop 2024-08-31T06:31:26.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.869+0000 7fc10e19e640 1 -- 172.21.15.53:0/463305896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc108101d90 msgr2=0x7fc10819a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:31:26.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.869+0000 7fc10e19e640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc108101d90 0x7fc10819a160 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009230 tx=0x7fc0f8004270 comp rx=0 tx=0).stop 2024-08-31T06:31:26.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.870+0000 7fc10e19e640 1 -- 172.21.15.53:0/463305896 shutdown_connections 2024-08-31T06:31:26.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.870+0000 7fc10e19e640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.53:6800/1345161100,v1:172.21.15.53:6801/1345161100] conn(0x7fc0f40b4ca0 0x7fc0f40b71b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:26.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.870+0000 7fc10e19e640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1081069c0 0x7fc10819f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:26.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.870+0000 7fc10e19e640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc108106070 0x7fc10819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:26.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.870+0000 7fc10e19e640 1 --2- 172.21.15.53:0/463305896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc108101d90 0x7fc10819a160 unknown :-1 s=CLOSED pgs=2421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:31:26.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.870+0000 7fc10e19e640 1 -- 172.21.15.53:0/463305896 >> 172.21.15.53:0/463305896 conn(0x7fc108079bd0 msgr2=0x7fc108107f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:31:26.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.871+0000 7fc10e19e640 1 -- 172.21.15.53:0/463305896 shutdown_connections 2024-08-31T06:31:26.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-08-31T06:31:26.871+0000 7fc10e19e640 1 -- 172.21.15.53:0/463305896 wait complete. 2024-08-31T06:31:27.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:26 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/463305896' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:31:27.175 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:26 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/463305896' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:31:27.212 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:26 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/463305896' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:31:27.557 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:31:27.582 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:31:27.633 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:31:27.663 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-31T06:31:27.663 DEBUG:teuthology.orchestra.run.smithi053:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T06:31:27.694 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T06:31:27.711 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T06:31:27.736 INFO:tasks.cephadm:Stopping all daemons... 2024-08-31T06:31:27.737 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-31T06:31:27.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.a 2024-08-31T06:31:27.874 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:27 smithi053 systemd[1]: Stopping Ceph mon.a for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:31:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:27 smithi153 ceph-mon[22320]: pgmap v1162: 65 pgs: 65 active+clean; 287 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:31:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:27 smithi153 ceph-mon[22320]: from='client.? 172.21.15.53:0/463305896' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:31:27.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:27 smithi153 ceph-mon[22320]: osdmap e119: 12 total, 12 up, 12 in 2024-08-31T06:31:28.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:27 smithi130 ceph-mon[22266]: pgmap v1162: 65 pgs: 65 active+clean; 287 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:31:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:27 smithi130 ceph-mon[22266]: from='client.? 172.21.15.53:0/463305896' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:31:28.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:27 smithi130 ceph-mon[22266]: osdmap e119: 12 total, 12 up, 12 in 2024-08-31T06:31:28.133 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:27 smithi053 ceph-mon[18924]: pgmap v1162: 65 pgs: 65 active+clean; 287 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:31:28.133 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:27 smithi053 ceph-mon[18924]: from='client.? 172.21.15.53:0/463305896' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:31:28.133 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:27 smithi053 ceph-mon[18924]: osdmap e119: 12 total, 12 up, 12 in 2024-08-31T06:31:28.133 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:28 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a[18920]: 2024-08-31T06:31:28.098+0000 7f85bc231640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:31:28.133 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:28 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a[18920]: 2024-08-31T06:31:28.098+0000 7f85bc231640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-31T06:31:28.404 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:28 smithi053 podman[144283]: 2024-08-31 06:31:28.132346443 +0000 UTC m=+0.163599317 container died f269de74543e1cd427361da5b4cfe03d44bc86990c4055da0eebd78e54df0641 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-08-31T06:31:28.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:28 smithi053 podman[144283]: 2024-08-31 06:31:28.541457884 +0000 UTC m=+0.572710753 container cleanup f269de74543e1cd427361da5b4cfe03d44bc86990c4055da0eebd78e54df0641 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:31:28.725 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:28 smithi053 bash[144283]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a 2024-08-31T06:31:29.074 INFO:journalctl@ceph.mon.a.smithi053.stdout:Aug 31 06:31:28 smithi053 podman[144295]: 2024-08-31 06:31:28.818550423 +0000 UTC m=+0.687545262 container remove f269de74543e1cd427361da5b4cfe03d44bc86990c4055da0eebd78e54df0641 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:31:29.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.a.service' 2024-08-31T06:31:29.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:31:29.127 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-31T06:31:29.127 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-31T06:31:29.127 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.b 2024-08-31T06:31:29.442 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:29 smithi130 systemd[1]: Stopping Ceph mon.b for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:31:29.776 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:29 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-b[22262]: 2024-08-31T06:31:29.440+0000 7f69b833c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:31:29.776 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:29 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-b[22262]: 2024-08-31T06:31:29.440+0000 7f69b833c640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-31T06:31:29.776 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:29 smithi130 podman[65815]: 2024-08-31 06:31:29.491620794 +0000 UTC m=+0.156832442 container died 5efdc58039f122fea57be8e55e36e876cb37a80c98c57d44789d9d2ef550c63f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-31T06:31:30.127 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:29 smithi130 podman[65815]: 2024-08-31 06:31:29.882367975 +0000 UTC m=+0.547579657 container cleanup 5efdc58039f122fea57be8e55e36e876cb37a80c98c57d44789d9d2ef550c63f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0) 2024-08-31T06:31:30.128 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 31 06:31:29 smithi130 bash[65815]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-b 2024-08-31T06:31:30.280 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.b.service' 2024-08-31T06:31:30.323 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:31:30.324 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-31T06:31:30.324 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-31T06:31:30.324 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.c 2024-08-31T06:31:30.647 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:30 smithi153 systemd[1]: Stopping Ceph mon.c for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:31:30.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:30 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-c[22316]: 2024-08-31T06:31:30.645+0000 7f0104508640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:31:30.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:30 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-c[22316]: 2024-08-31T06:31:30.645+0000 7f0104508640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-31T06:31:30.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:30 smithi153 podman[61624]: 2024-08-31 06:31:30.79822194 +0000 UTC m=+0.249642189 container died edfdf3191eb47f791829c4eb2b780d4848024d627dffc6feee4ec0ca2884943e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-31T06:31:31.365 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:31 smithi153 podman[61624]: 2024-08-31 06:31:31.137471698 +0000 UTC m=+0.588891945 container cleanup edfdf3191eb47f791829c4eb2b780d4848024d627dffc6feee4ec0ca2884943e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-31T06:31:31.366 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:31 smithi153 bash[61624]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-c 2024-08-31T06:31:31.615 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:31 smithi153 podman[61636]: 2024-08-31 06:31:31.364284723 +0000 UTC m=+0.562320414 container remove edfdf3191eb47f791829c4eb2b780d4848024d627dffc6feee4ec0ca2884943e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mon-c, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, ceph=True, org.label-schema.license=GPLv2) 2024-08-31T06:31:31.615 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:31 smithi153 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.c.service: Deactivated successfully. 2024-08-31T06:31:31.616 INFO:journalctl@ceph.mon.c.smithi153.stdout:Aug 31 06:31:31 smithi153 systemd[1]: Stopped Ceph mon.c for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:31:31.618 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mon.c.service' 2024-08-31T06:31:31.679 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:31:31.680 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-31T06:31:31.680 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-31T06:31:31.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T06:31:31.975 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:31:31 smithi053 systemd[1]: Stopping Ceph mgr.x for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:31:32.476 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:31:31 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x[19151]: 2024-08-31T06:31:31.986+0000 7ff4728a7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:31:32.476 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:31:32 smithi053 podman[144415]: 2024-08-31 06:31:32.019029352 +0000 UTC m=+0.137064461 container stop c16941624955e357dc03a3bb69ef86ca61bca62f02b2425b6ebdc23da24848cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-31T06:31:32.476 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:31:32 smithi053 podman[144415]: 2024-08-31 06:31:32.044727081 +0000 UTC m=+0.162762188 container died c16941624955e357dc03a3bb69ef86ca61bca62f02b2425b6ebdc23da24848cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-31T06:31:32.900 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:31:32 smithi053 podman[144415]: 2024-08-31 06:31:32.714211656 +0000 UTC m=+0.832246794 container cleanup c16941624955e357dc03a3bb69ef86ca61bca62f02b2425b6ebdc23da24848cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-31T06:31:32.900 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:31:32 smithi053 bash[144415]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x 2024-08-31T06:31:33.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.x.service' 2024-08-31T06:31:33.163 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:31:32 smithi053 podman[144428]: 2024-08-31 06:31:32.899353647 +0000 UTC m=+0.873960011 container remove c16941624955e357dc03a3bb69ef86ca61bca62f02b2425b6ebdc23da24848cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:31:33.163 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:31:33 smithi053 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.x.service: Deactivated successfully. 2024-08-31T06:31:33.163 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:31:33 smithi053 systemd[1]: Stopped Ceph mgr.x for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:31:33.164 INFO:journalctl@ceph.mgr.x.smithi053.stdout:Aug 31 06:31:33 smithi053 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.x.service: Consumed 1min 7.397s CPU time. 2024-08-31T06:31:33.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:31:33.179 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-31T06:31:33.179 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-31T06:31:33.179 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.y 2024-08-31T06:31:33.483 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 06:31:33 smithi130 systemd[1]: Stopping Ceph mgr.y for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:31:33.739 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 06:31:33 smithi130 podman[65936]: 2024-08-31 06:31:33.482235182 +0000 UTC m=+0.118314235 container died ce9573d8edcf829f17ea3da5bb93bafd33562f23211371c26341bae855eeeb26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-31T06:31:34.047 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 06:31:33 smithi130 podman[65936]: 2024-08-31 06:31:33.827893207 +0000 UTC m=+0.463972263 container cleanup ce9573d8edcf829f17ea3da5bb93bafd33562f23211371c26341bae855eeeb26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T06:31:34.047 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 06:31:33 smithi130 bash[65936]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-y 2024-08-31T06:31:34.297 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 06:31:34 smithi130 podman[65948]: 2024-08-31 06:31:34.046471743 +0000 UTC m=+0.558579851 container remove ce9573d8edcf829f17ea3da5bb93bafd33562f23211371c26341bae855eeeb26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:31:34.298 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 06:31:34 smithi130 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-08-31T06:31:34.298 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 06:31:34 smithi130 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-08-31T06:31:34.298 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 06:31:34 smithi130 systemd[1]: Stopped Ceph mgr.y for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:31:34.298 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 31 06:31:34 smithi130 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.y.service: Consumed 7.772s CPU time. 2024-08-31T06:31:34.299 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.y.service' 2024-08-31T06:31:34.335 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:31:34.335 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-31T06:31:34.335 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-31T06:31:34.335 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.z 2024-08-31T06:31:34.673 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 06:31:34 smithi153 systemd[1]: Stopping Ceph mgr.z for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:31:34.925 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 06:31:34 smithi153 podman[61746]: 2024-08-31 06:31:34.671986432 +0000 UTC m=+0.138696807 container died dffe1658655773ba9f7baff0d2dcb52911d9f03e6ca82c6ec5f658ca113e8727 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-z, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-31T06:31:35.303 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 06:31:35 smithi153 podman[61746]: 2024-08-31 06:31:35.034411961 +0000 UTC m=+0.501122332 container cleanup dffe1658655773ba9f7baff0d2dcb52911d9f03e6ca82c6ec5f658ca113e8727 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True) 2024-08-31T06:31:35.303 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Aug 31 06:31:35 smithi153 bash[61746]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mgr-z 2024-08-31T06:31:35.454 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mgr.z.service' 2024-08-31T06:31:35.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:31:35.490 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-31T06:31:35.490 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-31T06:31:35.490 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.0 2024-08-31T06:31:35.804 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:35 smithi053 systemd[1]: Stopping Ceph osd.0 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:31:36.225 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:35 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0[36903]: 2024-08-31T06:31:35.801+0000 7f6849da0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:31:36.225 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:35 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0[36903]: 2024-08-31T06:31:35.801+0000 7f6849da0640 -1 osd.0 119 *** Got signal Terminated *** 2024-08-31T06:31:36.225 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:35 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0[36903]: 2024-08-31T06:31:35.801+0000 7f6849da0640 -1 osd.0 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:31:41.597 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:41 smithi053 podman[144538]: 2024-08-31 06:31:41.2750974 +0000 UTC m=+5.590475485 container died fc6d5c8545b30e814289607819ddee93d6e8d119cf2ba75b88183be1124877c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:31:41.975 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:41 smithi053 podman[144538]: 2024-08-31 06:31:41.761668437 +0000 UTC m=+6.077046553 container cleanup fc6d5c8545b30e814289607819ddee93d6e8d119cf2ba75b88183be1124877c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T06:31:41.975 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:41 smithi053 bash[144538]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0 2024-08-31T06:31:42.438 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:42 smithi053 podman[144554]: 2024-08-31 06:31:42.088629032 +0000 UTC m=+0.810027439 container remove fc6d5c8545b30e814289607819ddee93d6e8d119cf2ba75b88183be1124877c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-31T06:31:42.725 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:42 smithi053 podman[144647]: 2024-08-31 06:31:42.339696447 +0000 UTC m=+0.016054736 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:31:42.726 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:42 smithi053 podman[144647]: 2024-08-31 06:31:42.508209843 +0000 UTC m=+0.184568119 container create 7e14e7185e13300355498e56b484e2dc573b38f6f1b59fe2149c13f358ce51a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-31T06:31:43.226 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:42 smithi053 podman[144647]: 2024-08-31 06:31:42.750454207 +0000 UTC m=+0.426812484 container init 7e14e7185e13300355498e56b484e2dc573b38f6f1b59fe2149c13f358ce51a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-31T06:31:43.226 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:42 smithi053 podman[144647]: 2024-08-31 06:31:42.7536973 +0000 UTC m=+0.430055577 container start 7e14e7185e13300355498e56b484e2dc573b38f6f1b59fe2149c13f358ce51a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-31T06:31:43.226 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:42 smithi053 podman[144647]: 2024-08-31 06:31:42.833875229 +0000 UTC m=+0.510233519 container attach 7e14e7185e13300355498e56b484e2dc573b38f6f1b59fe2149c13f358ce51a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-08-31T06:31:43.226 INFO:journalctl@ceph.osd.0.smithi053.stdout:Aug 31 06:31:42 smithi053 podman[144647]: 2024-08-31 06:31:42.950861535 +0000 UTC m=+0.627219834 container died 7e14e7185e13300355498e56b484e2dc573b38f6f1b59fe2149c13f358ce51a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-0-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-31T06:31:43.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.0.service' 2024-08-31T06:31:43.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:31:43.762 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-31T06:31:43.762 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-31T06:31:43.763 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.1 2024-08-31T06:31:43.917 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:43 smithi130 systemd[1]: Stopping Ceph osd.1 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:31:44.378 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:44 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1[27911]: 2024-08-31T06:31:44.073+0000 7fa2720a1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:31:44.378 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:44 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1[27911]: 2024-08-31T06:31:44.073+0000 7fa2720a1640 -1 osd.1 119 *** Got signal Terminated *** 2024-08-31T06:31:44.378 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:44 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1[27911]: 2024-08-31T06:31:44.074+0000 7fa2720a1640 -1 osd.1 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:31:49.768 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:49 smithi130 podman[66063]: 2024-08-31 06:31:49.477380534 +0000 UTC m=+5.528432794 container died f6f8f229950d443412ac7343fd6679a2d197585320c979c8debbc6b94c76d850 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True) 2024-08-31T06:31:49.768 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:49 smithi130 podman[66063]: 2024-08-31 06:31:49.765691934 +0000 UTC m=+5.816744184 container cleanup f6f8f229950d443412ac7343fd6679a2d197585320c979c8debbc6b94c76d850 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1) 2024-08-31T06:31:50.127 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:49 smithi130 bash[66063]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1 2024-08-31T06:31:50.127 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:50 smithi130 podman[66089]: 2024-08-31 06:31:50.008721029 +0000 UTC m=+0.531068745 container remove f6f8f229950d443412ac7343fd6679a2d197585320c979c8debbc6b94c76d850 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-31T06:31:50.563 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:50 smithi130 podman[66180]: 2024-08-31 06:31:50.31002131 +0000 UTC m=+0.104250847 container create 3bc03f7142702c6af23400458c19a322775db5456838ac2cdad631761f9ac0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-31T06:31:50.563 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:50 smithi130 podman[66180]: 2024-08-31 06:31:50.221428202 +0000 UTC m=+0.015657693 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:31:50.878 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:50 smithi130 podman[66180]: 2024-08-31 06:31:50.562294862 +0000 UTC m=+0.356524353 container init 3bc03f7142702c6af23400458c19a322775db5456838ac2cdad631761f9ac0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-08-31T06:31:50.878 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:50 smithi130 podman[66180]: 2024-08-31 06:31:50.565822723 +0000 UTC m=+0.360052215 container start 3bc03f7142702c6af23400458c19a322775db5456838ac2cdad631761f9ac0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:31:50.878 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:50 smithi130 podman[66180]: 2024-08-31 06:31:50.628826465 +0000 UTC m=+0.423055975 container attach 3bc03f7142702c6af23400458c19a322775db5456838ac2cdad631761f9ac0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-31T06:31:50.878 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:50 smithi130 podman[66180]: 2024-08-31 06:31:50.760149781 +0000 UTC m=+0.554379282 container died 3bc03f7142702c6af23400458c19a322775db5456838ac2cdad631761f9ac0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-31T06:31:51.301 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 31 06:31:51 smithi130 podman[66203]: 2024-08-31 06:31:51.282460957 +0000 UTC m=+0.512746349 container remove 3bc03f7142702c6af23400458c19a322775db5456838ac2cdad631761f9ac0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T06:31:51.306 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.1.service' 2024-08-31T06:31:51.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:31:51.347 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-31T06:31:51.348 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-31T06:31:51.348 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.2 2024-08-31T06:31:51.672 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:51 smithi153 systemd[1]: Stopping Ceph osd.2 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:31:51.925 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:51 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2[28428]: 2024-08-31T06:31:51.670+0000 7f51f4995640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:31:51.925 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:51 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2[28428]: 2024-08-31T06:31:51.670+0000 7f51f4995640 -1 osd.2 119 *** Got signal Terminated *** 2024-08-31T06:31:51.925 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:51 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2[28428]: 2024-08-31T06:31:51.670+0000 7f51f4995640 -1 osd.2 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:31:57.423 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:57 smithi153 podman[61870]: 2024-08-31 06:31:57.140550209 +0000 UTC m=+5.597928856 container died 40e0b971e19568b58f5540c76afbc0456063a8353b9e89031d5d031c4df2cf2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:31:57.675 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:57 smithi153 podman[61870]: 2024-08-31 06:31:57.521235127 +0000 UTC m=+5.978613774 container cleanup 40e0b971e19568b58f5540c76afbc0456063a8353b9e89031d5d031c4df2cf2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:31:57.675 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:57 smithi153 bash[61870]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2 2024-08-31T06:31:58.136 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:57 smithi153 podman[61897]: 2024-08-31 06:31:57.797803278 +0000 UTC m=+0.657155555 container remove 40e0b971e19568b58f5540c76afbc0456063a8353b9e89031d5d031c4df2cf2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-08-31T06:31:58.403 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:58 smithi153 podman[61989]: 2024-08-31 06:31:58.038106207 +0000 UTC m=+0.016462089 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:31:58.404 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:58 smithi153 podman[61989]: 2024-08-31 06:31:58.156829022 +0000 UTC m=+0.135184897 container create af92e322843abb802b94d8dbcd5323e223d11a77b520b8f0ac4fec8dfbec87e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-31T06:31:58.404 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:58 smithi153 podman[61989]: 2024-08-31 06:31:58.402489223 +0000 UTC m=+0.380845095 container init af92e322843abb802b94d8dbcd5323e223d11a77b520b8f0ac4fec8dfbec87e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-31T06:31:58.655 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:58 smithi153 podman[61989]: 2024-08-31 06:31:58.405880536 +0000 UTC m=+0.384236409 container start af92e322843abb802b94d8dbcd5323e223d11a77b520b8f0ac4fec8dfbec87e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:31:58.656 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:58 smithi153 podman[61989]: 2024-08-31 06:31:58.501590679 +0000 UTC m=+0.479946564 container attach af92e322843abb802b94d8dbcd5323e223d11a77b520b8f0ac4fec8dfbec87e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-08-31T06:31:58.925 INFO:journalctl@ceph.osd.2.smithi153.stdout:Aug 31 06:31:58 smithi153 podman[61989]: 2024-08-31 06:31:58.654539451 +0000 UTC m=+0.632895332 container died af92e322843abb802b94d8dbcd5323e223d11a77b520b8f0ac4fec8dfbec87e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-31T06:31:59.409 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.2.service' 2024-08-31T06:31:59.451 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:31:59.451 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-31T06:31:59.451 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-31T06:31:59.452 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.3 2024-08-31T06:31:59.759 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:31:59 smithi053 systemd[1]: Stopping Ceph osd.3 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:32:00.225 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:31:59 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3[43509]: 2024-08-31T06:31:59.757+0000 7f1c8f2a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:32:00.225 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:31:59 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3[43509]: 2024-08-31T06:31:59.757+0000 7f1c8f2a4640 -1 osd.3 119 *** Got signal Terminated *** 2024-08-31T06:32:00.226 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:31:59 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3[43509]: 2024-08-31T06:31:59.757+0000 7f1c8f2a4640 -1 osd.3 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:32:02.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:01 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:01.912+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:02.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:02.629+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:02.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:02.543+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:03.225 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:02 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3[43509]: 2024-08-31T06:32:02.859+0000 7f1c8b88f640 -1 osd.3 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.153849+0000 front 2024-08-31T06:31:38.154099+0000 (oldest deadline 2024-08-31T06:32:02.854025+0000) 2024-08-31T06:32:03.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:02 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:02.929+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:03.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:03.671+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:03.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:03.552+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:04.146 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:03 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3[43509]: 2024-08-31T06:32:03.854+0000 7f1c8b88f640 -1 osd.3 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.153849+0000 front 2024-08-31T06:31:38.154099+0000 (oldest deadline 2024-08-31T06:32:02.854025+0000) 2024-08-31T06:32:04.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:03 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:03.956+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:04.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:04 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:04.145+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:04.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:04 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:04.691+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:04.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:04 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:04.569+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:05.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:05 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:05.004+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:05.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:05 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:05.161+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:05.476 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:05 smithi053 podman[144762]: 2024-08-31 06:32:05.282707209 +0000 UTC m=+5.622171427 container died 7a4ef25bf89ddf94041cdf418fb204a3c4349cfa506d016fb36dd096bb8aaff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T06:32:05.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:05 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:05.655+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:05.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:05 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:05.616+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:05.975 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:05 smithi053 podman[144762]: 2024-08-31 06:32:05.766755191 +0000 UTC m=+6.106219449 container cleanup 7a4ef25bf89ddf94041cdf418fb204a3c4349cfa506d016fb36dd096bb8aaff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:32:05.976 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:05 smithi053 bash[144762]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3 2024-08-31T06:32:05.976 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:05 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:05.617+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:06.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:06 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:06.025+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:06.386 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:06 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:06.118+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:06.386 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:06 smithi053 podman[144791]: 2024-08-31 06:32:06.051688786 +0000 UTC m=+0.769182933 container remove 7a4ef25bf89ddf94041cdf418fb204a3c4349cfa506d016fb36dd096bb8aaff9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T06:32:06.639 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:06 smithi053 podman[144880]: 2024-08-31 06:32:06.385836437 +0000 UTC m=+0.106497362 container create 763c1e897403989b6bae54961ac816effdf586a948fe48326dc76c36f7a5b996 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-08-31T06:32:06.639 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:06 smithi053 podman[144880]: 2024-08-31 06:32:06.29569506 +0000 UTC m=+0.016355985 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:32:06.639 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:06 smithi053 podman[144880]: 2024-08-31 06:32:06.6383105 +0000 UTC m=+0.358971426 container init 763c1e897403989b6bae54961ac816effdf586a948fe48326dc76c36f7a5b996 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0) 2024-08-31T06:32:06.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:06 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:06.607+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:06.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:06 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:06.625+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:06.975 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:06 smithi053 podman[144880]: 2024-08-31 06:32:06.641751714 +0000 UTC m=+0.362412639 container start 763c1e897403989b6bae54961ac816effdf586a948fe48326dc76c36f7a5b996 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:32:06.976 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:06 smithi053 podman[144880]: 2024-08-31 06:32:06.722067922 +0000 UTC m=+0.442728880 container attach 763c1e897403989b6bae54961ac816effdf586a948fe48326dc76c36f7a5b996 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-31T06:32:06.976 INFO:journalctl@ceph.osd.3.smithi053.stdout:Aug 31 06:32:06 smithi053 podman[144880]: 2024-08-31 06:32:06.831925852 +0000 UTC m=+0.552586777 container died 763c1e897403989b6bae54961ac816effdf586a948fe48326dc76c36f7a5b996 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.1, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:32:06.976 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:06 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:06.665+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:07.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:06 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:06.990+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:07.435 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:07 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:07.112+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:07.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.3.service' 2024-08-31T06:32:07.504 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:32:07.504 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-31T06:32:07.504 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-31T06:32:07.504 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.4 2024-08-31T06:32:07.725 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:07 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:07.641+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:07.794 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:07 smithi130 systemd[1]: Stopping Ceph osd.4 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:32:07.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:07 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:07.620+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:07.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:07 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:07.671+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:08.127 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:07 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:07.955+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:08.128 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:07 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4[34509]: 2024-08-31T06:32:07.792+0000 7f813c03b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:32:08.128 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:07 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4[34509]: 2024-08-31T06:32:07.792+0000 7f813c03b640 -1 osd.4 119 *** Got signal Terminated *** 2024-08-31T06:32:08.128 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:07 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4[34509]: 2024-08-31T06:32:07.792+0000 7f813c03b640 -1 osd.4 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:32:08.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:08 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:08.068+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:08.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:08 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:08.631+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:08.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:08 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:08.702+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:08.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:08 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:08.662+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:09.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:08 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:08.923+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:09.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:09 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:09.039+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:09.746 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:09 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:09.636+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:09.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:09 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:09.711+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:10.041 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:09 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:09.744+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:10.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:09 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:09.892+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:10.128 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:09 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:09.739+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:10.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:10 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:10.040+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:10.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:10 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:10.064+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:10.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:10 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:10.699+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:10.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:10 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:10.636+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:10.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:10 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:10.636+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.861190+0000 front 2024-08-31T06:31:48.861258+0000 (oldest deadline 2024-08-31T06:32:09.961154+0000) 2024-08-31T06:32:10.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:10 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:10.673+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:11.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:10 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:10.920+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:11.128 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:10 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:10.747+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:11.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:11 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:11.004+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:11.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:11 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:11.078+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:11.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:11 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:11.663+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:11.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:11 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:11.671+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:11.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:11 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:11.671+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.861190+0000 front 2024-08-31T06:31:48.861258+0000 (oldest deadline 2024-08-31T06:32:09.961154+0000) 2024-08-31T06:32:11.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:11 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:11.670+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:12.029 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:11 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:11.875+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:12.029 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:11 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:11.709+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:12.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:11 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:11.982+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:12.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:12 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:12.088+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:12.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:12 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:12.709+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:12.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:12 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:12.653+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:12.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:12 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:12.653+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.861190+0000 front 2024-08-31T06:31:48.861258+0000 (oldest deadline 2024-08-31T06:32:09.961154+0000) 2024-08-31T06:32:12.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:12 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:12.660+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:12.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:12 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:12.660+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:13.127 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:12 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:12.700+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:13.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:12 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:12.865+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:13.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:13 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:13.015+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:13.466 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:13 smithi130 podman[66283]: 2024-08-31 06:32:13.206447407 +0000 UTC m=+5.512114035 container died e1c6938abb2b2ce03bb99811b5dbb455c2617866fa483941221f9bc91e64ac9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-31T06:32:13.466 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:13 smithi130 podman[66283]: 2024-08-31 06:32:13.442426257 +0000 UTC m=+5.748092884 container cleanup e1c6938abb2b2ce03bb99811b5dbb455c2617866fa483941221f9bc91e64ac9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1) 2024-08-31T06:32:13.466 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:13 smithi130 bash[66283]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4 2024-08-31T06:32:13.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:13 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:13.076+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:13.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:13 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:13.076+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:13.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:13 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:13.664+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:13.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:13 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:13.621+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:13.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:13 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:13.621+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.861190+0000 front 2024-08-31T06:31:48.861258+0000 (oldest deadline 2024-08-31T06:32:09.961154+0000) 2024-08-31T06:32:13.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:13 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:13.682+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:13.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:13 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:13.682+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:14.111 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:13 smithi130 podman[66298]: 2024-08-31 06:32:13.677139897 +0000 UTC m=+0.466494035 container remove e1c6938abb2b2ce03bb99811b5dbb455c2617866fa483941221f9bc91e64ac9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-31T06:32:14.111 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:13 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:13.695+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:14.111 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:13 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:13.899+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:14.111 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:13 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:13.899+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:14.378 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:14 smithi130 podman[66387]: 2024-08-31 06:32:14.012786267 +0000 UTC m=+0.015697428 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:32:14.378 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:14 smithi130 podman[66387]: 2024-08-31 06:32:14.12784676 +0000 UTC m=+0.130757964 container create 492dcc688644f4ca274362cfa7ab091c8f96c065dab6a96a51066c8b8ede0f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0) 2024-08-31T06:32:14.378 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:14 smithi130 podman[66387]: 2024-08-31 06:32:14.355459978 +0000 UTC m=+0.358371140 container init 492dcc688644f4ca274362cfa7ab091c8f96c065dab6a96a51066c8b8ede0f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:32:14.378 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:14 smithi130 podman[66387]: 2024-08-31 06:32:14.358729191 +0000 UTC m=+0.361640357 container start 492dcc688644f4ca274362cfa7ab091c8f96c065dab6a96a51066c8b8ede0f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-08-31T06:32:14.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:14 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:14.021+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:14.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:14 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:14.096+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:14.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:14 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:14.096+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:14.826 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:14 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:14.659+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:14.826 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:14 smithi130 podman[66387]: 2024-08-31 06:32:14.464039591 +0000 UTC m=+0.466950759 container attach 492dcc688644f4ca274362cfa7ab091c8f96c065dab6a96a51066c8b8ede0f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4-deactivate, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:32:14.826 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 31 06:32:14 smithi130 podman[66410]: 2024-08-31 06:32:14.571872921 +0000 UTC m=+0.015956098 container died 492dcc688644f4ca274362cfa7ab091c8f96c065dab6a96a51066c8b8ede0f7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T06:32:14.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:14 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:14.702+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:14.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:14 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:14.702+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:14.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:14 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:14.616+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:14.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:14 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:14.616+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.861190+0000 front 2024-08-31T06:31:48.861258+0000 (oldest deadline 2024-08-31T06:32:09.961154+0000) 2024-08-31T06:32:14.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:14 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:14.719+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:14.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:14 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:14.719+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:15.126 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:14 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:14.931+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:15.127 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:14 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:14.931+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:15.145 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.4.service' 2024-08-31T06:32:15.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:32:15.184 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-31T06:32:15.184 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-31T06:32:15.184 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.5 2024-08-31T06:32:15.425 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:15 smithi153 systemd[1]: Stopping Ceph osd.5 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:32:15.426 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:15 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:15.010+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:15.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:15.070+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:15.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:15.070+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:15.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:15 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:15.653+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:15.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:15 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:15.653+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:15.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:15 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:15.466+0000 7fdc02b32640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:32:15.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:15 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:15.466+0000 7fdc02b32640 -1 osd.5 119 *** Got signal Terminated *** 2024-08-31T06:32:15.926 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:15 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:15.466+0000 7fdc02b32640 -1 osd.5 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:32:15.926 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:15 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:15.655+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:15.926 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:15 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:15.655+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.861190+0000 front 2024-08-31T06:31:48.861258+0000 (oldest deadline 2024-08-31T06:32:09.961154+0000) 2024-08-31T06:32:15.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:15.676+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:15.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:15 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:15.676+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:16.127 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:15 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:15.700+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:16.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:15 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:15.934+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:16.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:15 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:15.934+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:16.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:16 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:16.057+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:16.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:16 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:16.083+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:16.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:16 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:16.083+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:16.920 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:16 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:16.663+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:16.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:16 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:16.640+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:16.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:16 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:16.640+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.861190+0000 front 2024-08-31T06:31:48.861258+0000 (oldest deadline 2024-08-31T06:32:09.961154+0000) 2024-08-31T06:32:16.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:16 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:16.703+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:16.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:16 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:16.703+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:16.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:16 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:16.663+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:16.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:16 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:16.663+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:17.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:16 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:16.918+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:17.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:16 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:16.918+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:17.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:17 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:17.077+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:17.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:17 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:17.041+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:17.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:17 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:17.041+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:17.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:17 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:17.623+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:17.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:17 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:17.604+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:17.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:17 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:17.604+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.861190+0000 front 2024-08-31T06:31:48.861258+0000 (oldest deadline 2024-08-31T06:32:09.961154+0000) 2024-08-31T06:32:17.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:17 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:17.751+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:17.926 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:17 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:17.751+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:17.926 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:17 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:17.751+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:17.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:17 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:17.670+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:17.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:17 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:17.670+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:18.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:17 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:17.904+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:18.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:17 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:17.904+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:18.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:18 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:18.073+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:18.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:18 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:18.003+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:18.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:18 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:18.003+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:18.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:18 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:18.003+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:18.911 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:18 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:18.650+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:18.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:18 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:18.577+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:18.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:18 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:18.577+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.861190+0000 front 2024-08-31T06:31:48.861258+0000 (oldest deadline 2024-08-31T06:32:09.961154+0000) 2024-08-31T06:32:18.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:18 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:18.725+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:18.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:18 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:18.725+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:18.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:18 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:18.725+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:18.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:18 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:18.626+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:18.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:18 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:18.626+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:18.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:18 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:18.626+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:52.630844+0000 front 2024-08-31T06:31:52.630809+0000 (oldest deadline 2024-08-31T06:32:18.531009+0000) 2024-08-31T06:32:19.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:18 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:18.909+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:19.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:18 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:18.909+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:19.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:19.075+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:19.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:19.075+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:19.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:19.006+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:19.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:19.006+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:19.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:19.006+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:19.864 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:19.611+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:19.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:19.575+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.159040+0000 front 2024-08-31T06:31:40.159136+0000 (oldest deadline 2024-08-31T06:32:01.859062+0000) 2024-08-31T06:32:19.925 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5[34842]: 2024-08-31T06:32:19.575+0000 7fdbff11d640 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.861190+0000 front 2024-08-31T06:31:48.861258+0000 (oldest deadline 2024-08-31T06:32:09.961154+0000) 2024-08-31T06:32:19.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:19.753+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:19.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:19.753+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:19.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:19 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:19.753+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:19.973 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:19.582+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:19.973 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:19.582+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:19.974 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:19.582+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:52.630844+0000 front 2024-08-31T06:31:52.630809+0000 (oldest deadline 2024-08-31T06:32:18.531009+0000) 2024-08-31T06:32:20.127 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:19.862+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:20.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:19.862+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:20.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:19 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:19.862+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:20.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:19.971+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:20.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:19.971+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:20.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:19 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:19.971+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:20.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:20 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:20.063+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:20.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:20 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:20.063+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:20.948 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:20 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:20.557+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:20.948 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:20 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:20.557+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:20.948 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:20 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:20.557+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:52.630844+0000 front 2024-08-31T06:31:52.630809+0000 (oldest deadline 2024-08-31T06:32:18.531009+0000) 2024-08-31T06:32:21.105 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:20 smithi153 podman[62092]: 2024-08-31 06:32:20.960087495 +0000 UTC m=+5.581092292 container died 007590d747e61f61cf5066db62a2f28973c5b5d34433788d5b5d5964eac41a13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-31T06:32:21.105 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:20 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:20.779+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:21.105 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:20 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:20.779+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:21.105 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:20 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:20.779+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:21.127 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:20 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:20.639+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:21.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:20 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:20.867+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:21.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:20 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:20.867+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:21.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:20 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:20.867+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:21.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:20 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:20.946+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:21.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:20 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:20.946+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:21.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:20 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:20.946+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:21.378 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:21 smithi153 podman[62092]: 2024-08-31 06:32:21.332911416 +0000 UTC m=+5.953916210 container cleanup 007590d747e61f61cf5066db62a2f28973c5b5d34433788d5b5d5964eac41a13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-31T06:32:21.378 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:21 smithi153 bash[62092]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5 2024-08-31T06:32:21.378 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:21 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:21.102+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:21.378 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:21 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:21.102+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:21.675 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:21 smithi153 podman[62108]: 2024-08-31 06:32:21.60100068 +0000 UTC m=+0.643223347 container remove 007590d747e61f61cf5066db62a2f28973c5b5d34433788d5b5d5964eac41a13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-31T06:32:21.965 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:21 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:21.558+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:21.965 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:21 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:21.558+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:21.965 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:21 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:21.558+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:52.630844+0000 front 2024-08-31T06:31:52.630809+0000 (oldest deadline 2024-08-31T06:32:18.531009+0000) 2024-08-31T06:32:22.057 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:21 smithi153 podman[62206]: 2024-08-31 06:32:21.845231286 +0000 UTC m=+0.020148202 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:32:22.057 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:21 smithi153 podman[62206]: 2024-08-31 06:32:21.951734553 +0000 UTC m=+0.126651450 container create 45f8823a3687fc5ca9b785c882e2531c38075ce0f6348f3e2b134d78da203ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T06:32:22.058 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:21 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:21.748+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:22.058 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:21 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:21.748+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:22.058 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:21 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:21.748+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:22.128 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:21 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:21.641+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:22.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:21 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:21.878+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:22.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:21 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:21.878+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:22.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:21 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:21.878+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:22.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:21 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:21.963+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:22.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:21 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:21.963+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:22.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:21 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:21.963+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:22.380 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:22 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:22.054+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:22.380 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:22 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:22.054+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:22.381 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:22 smithi153 podman[62206]: 2024-08-31 06:32:22.17908698 +0000 UTC m=+0.354003880 container init 45f8823a3687fc5ca9b785c882e2531c38075ce0f6348f3e2b134d78da203ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_BRANCH=HEAD) 2024-08-31T06:32:22.381 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:22 smithi153 podman[62206]: 2024-08-31 06:32:22.182542933 +0000 UTC m=+0.357459841 container start 45f8823a3687fc5ca9b785c882e2531c38075ce0f6348f3e2b134d78da203ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:32:22.381 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:22 smithi153 podman[62206]: 2024-08-31 06:32:22.245616731 +0000 UTC m=+0.420533637 container attach 45f8823a3687fc5ca9b785c882e2531c38075ce0f6348f3e2b134d78da203ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-31T06:32:22.666 INFO:journalctl@ceph.osd.5.smithi153.stdout:Aug 31 06:32:22 smithi153 podman[62206]: 2024-08-31 06:32:22.380073955 +0000 UTC m=+0.554990864 container died 45f8823a3687fc5ca9b785c882e2531c38075ce0f6348f3e2b134d78da203ca8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-31T06:32:22.877 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:22 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:22.607+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:22.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:22 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:22.607+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:22.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:22 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:22.770+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:22.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:22 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:22.770+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:22.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:22 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:22.770+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:22.949 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:22 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:22.541+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:22.949 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:22 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:22.541+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:22.949 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:22 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:22.541+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:52.630844+0000 front 2024-08-31T06:31:52.630809+0000 (oldest deadline 2024-08-31T06:32:18.531009+0000) 2024-08-31T06:32:22.965 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.5.service' 2024-08-31T06:32:23.005 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:32:23.005 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-31T06:32:23.005 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-31T06:32:23.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.6 2024-08-31T06:32:23.225 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:23 smithi053 systemd[1]: Stopping Ceph osd.6 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:32:23.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:22 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:22.947+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:23.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:22 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:22.947+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:23.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:22 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:22.947+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:23.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:22 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:22.922+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:23.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:22 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:22.922+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:23.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:22 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:22.922+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:23.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:23 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:23.045+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:23.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:23 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:23.045+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:23.590 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:23 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:23.319+0000 7ffa54511640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:32:23.591 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:23 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:23.319+0000 7ffa54511640 -1 osd.6 119 *** Got signal Terminated *** 2024-08-31T06:32:23.591 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:23 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:23.319+0000 7ffa54511640 -1 osd.6 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:32:23.591 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:23 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:23.587+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:23.591 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:23 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:23.587+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:23.959 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:23 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:23.627+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:23.960 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:23 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:23.627+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:23.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:23 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:23.587+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:52.630844+0000 front 2024-08-31T06:31:52.630809+0000 (oldest deadline 2024-08-31T06:32:18.531009+0000) 2024-08-31T06:32:24.086 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:23 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:23.804+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:24.087 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:23 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:23.804+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:24.087 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:23 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:23.804+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:24.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:23 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:23.957+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:24.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:23 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:23.957+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:24.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:23 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:23.957+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:24.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:24 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:24.083+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:24.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:24 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:24.083+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:24.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:23 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:23.982+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:24.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:23 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:23.982+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:24.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:23 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:23.982+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:24.877 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:24 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:24.617+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:24.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:24 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:24.617+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:24.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:24 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:24.563+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:24.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:24 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:24.563+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:24.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:24 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:24.563+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:52.630844+0000 front 2024-08-31T06:31:52.630809+0000 (oldest deadline 2024-08-31T06:32:18.531009+0000) 2024-08-31T06:32:25.104 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:24 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:24.765+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:25.104 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:24 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:24.765+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:25.104 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:24 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:24.765+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:25.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:24 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:24.972+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:25.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:24 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:24.972+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:25.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:24 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:24.972+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:25.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:25 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:25.101+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:25.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:25 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:25.101+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:25.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:24 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:24.986+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:25.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:24 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:24.986+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:25.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:24 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:24.986+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:25.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:25 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:25.534+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:25.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:25 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:25.534+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:25.976 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:25 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:25.534+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:52.630844+0000 front 2024-08-31T06:31:52.630809+0000 (oldest deadline 2024-08-31T06:32:18.531009+0000) 2024-08-31T06:32:26.006 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:25 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:25.656+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:26.007 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:25 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:25.656+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:26.133 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:25 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:25.771+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:26.133 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:25 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:25.771+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:26.133 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:25 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:25.771+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:26.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:26 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:26.005+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:26.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:26 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:26.005+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:26.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:26 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:26.005+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:26.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:26 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:26.131+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:26.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:26 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:26.131+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:26.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:26 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:26.018+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:26.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:26 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:26.018+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:26.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:26 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:26.018+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:26.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:26 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:26.582+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:26.976 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:26 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:26.582+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:26.976 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:26 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:26.582+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:52.630844+0000 front 2024-08-31T06:31:52.630809+0000 (oldest deadline 2024-08-31T06:32:18.531009+0000) 2024-08-31T06:32:27.024 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:26 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:26.630+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:27.024 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:26 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:26.630+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:27.024 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:26 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:26.630+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:02.291416+0000 front 2024-08-31T06:32:02.291442+0000 (oldest deadline 2024-08-31T06:32:26.391348+0000) 2024-08-31T06:32:27.172 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:26 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:26.790+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:27.173 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:26 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:26.790+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:27.173 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:26 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:26.790+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:27.173 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:26 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:26.790+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:27.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:27 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:27.022+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:27.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:27 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:27.022+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:27.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:27 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:27.022+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:27.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:27 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:27.022+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:27.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:27 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:27.170+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:27.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:27 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:27.170+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:27.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:27 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:27.010+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:27.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:27 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:27.010+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:27.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:27 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:27.010+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:27.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:27 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:27.584+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:27.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:27 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:27.584+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:27.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:27 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:27.584+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:02.291416+0000 front 2024-08-31T06:32:02.291442+0000 (oldest deadline 2024-08-31T06:32:26.391348+0000) 2024-08-31T06:32:27.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:27 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:27.550+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:40.329178+0000 front 2024-08-31T06:31:40.329377+0000 (oldest deadline 2024-08-31T06:32:05.029316+0000) 2024-08-31T06:32:27.975 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:27 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:27.550+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.530296+0000 front 2024-08-31T06:31:48.530431+0000 (oldest deadline 2024-08-31T06:32:12.630375+0000) 2024-08-31T06:32:27.976 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:27 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6[49963]: 2024-08-31T06:32:27.550+0000 7ffa50afc640 -1 osd.6 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:52.630844+0000 front 2024-08-31T06:31:52.630809+0000 (oldest deadline 2024-08-31T06:32:18.531009+0000) 2024-08-31T06:32:28.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:27 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:27.787+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:28.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:27 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:27.787+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:28.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:27 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:27.787+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:28.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:27 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:27.787+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:28.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:28 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:28.002+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:28.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:28 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:28.002+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:28.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:28 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:28.002+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:28.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:28 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:28.002+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:28.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:28 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:28.036+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:28.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:28 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:28.037+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:28.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:28 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:28.037+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:28.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:28 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:28.208+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:28.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:28 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:28.208+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:28.877 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:28 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:28.608+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:28.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:28 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:28.608+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:28.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:28 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:28.608+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:02.291416+0000 front 2024-08-31T06:32:02.291442+0000 (oldest deadline 2024-08-31T06:32:26.391348+0000) 2024-08-31T06:32:29.122 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:28 smithi053 podman[144983]: 2024-08-31 06:32:28.849870186 +0000 UTC m=+5.645341701 container died 149d5d3bf15d8d6d05ad06a9ec2cf22b7009d21c07b1166da73f786d3cc9ab3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-31T06:32:29.122 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:29 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:29.059+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:29.122 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:29 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:29.059+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:29.123 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:29 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:29.059+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:29.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:28 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:28.767+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:29.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:28 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:28.767+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:29.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:28 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:28.767+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:29.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:28 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:28.767+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:29.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:29 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:29.044+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:29.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:29 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:29.044+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:29.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:29 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:29.044+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:29.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:29 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:29.044+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:29.476 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:29 smithi053 podman[144983]: 2024-08-31 06:32:29.295418298 +0000 UTC m=+6.090889858 container cleanup 149d5d3bf15d8d6d05ad06a9ec2cf22b7009d21c07b1166da73f786d3cc9ab3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0) 2024-08-31T06:32:29.477 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:29 smithi053 bash[144983]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6 2024-08-31T06:32:29.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:29 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:29.235+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:29.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:29 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:29.235+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:29.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:29 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:29.235+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:29.877 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:29 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:29.564+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:29.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:29 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:29.564+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:29.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:29 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:29.564+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:02.291416+0000 front 2024-08-31T06:32:02.291442+0000 (oldest deadline 2024-08-31T06:32:26.391348+0000) 2024-08-31T06:32:29.965 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:29 smithi053 podman[144998]: 2024-08-31 06:32:29.605370871 +0000 UTC m=+0.752710408 container remove 149d5d3bf15d8d6d05ad06a9ec2cf22b7009d21c07b1166da73f786d3cc9ab3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-31T06:32:30.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:29 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:29.730+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:30.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:29 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:29.730+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:30.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:29 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:29.730+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:30.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:29 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:29.730+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:30.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:30 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:30.048+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:30.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:30 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:30.048+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:30.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:30 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:30.048+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:30.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:30 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:30.048+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:30.226 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:29 smithi053 podman[145091]: 2024-08-31 06:32:29.866823066 +0000 UTC m=+0.015844191 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:32:30.226 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:29 smithi053 podman[145091]: 2024-08-31 06:32:29.990043797 +0000 UTC m=+0.139064961 container create 4fffb191b7cdbec64c8d8855783dd4be27378f93afc9519c909783163ff71fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T06:32:30.226 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:30 smithi053 podman[145091]: 2024-08-31 06:32:30.200693586 +0000 UTC m=+0.349714711 container init 4fffb191b7cdbec64c8d8855783dd4be27378f93afc9519c909783163ff71fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-08-31T06:32:30.226 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:30 smithi053 podman[145091]: 2024-08-31 06:32:30.203891981 +0000 UTC m=+0.352913099 container start 4fffb191b7cdbec64c8d8855783dd4be27378f93afc9519c909783163ff71fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-31T06:32:30.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:30 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:30.089+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:30.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:30 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:30.089+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:30.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:30 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:30.089+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:30.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:30 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:30.089+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:30.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:30 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:30.236+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:30.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:30 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:30.236+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:30.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:30 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:30.236+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:30.679 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:30 smithi053 podman[145091]: 2024-08-31 06:32:30.317456413 +0000 UTC m=+0.466477530 container attach 4fffb191b7cdbec64c8d8855783dd4be27378f93afc9519c909783163ff71fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2) 2024-08-31T06:32:30.679 INFO:journalctl@ceph.osd.6.smithi053.stdout:Aug 31 06:32:30 smithi053 podman[145114]: 2024-08-31 06:32:30.413322105 +0000 UTC m=+0.016461349 container died 4fffb191b7cdbec64c8d8855783dd4be27378f93afc9519c909783163ff71fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-31T06:32:30.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:30 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:30.612+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:30.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:30 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:30.612+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:30.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:30 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:30.612+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:02.291416+0000 front 2024-08-31T06:32:02.291442+0000 (oldest deadline 2024-08-31T06:32:26.391348+0000) 2024-08-31T06:32:30.988 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.6.service' 2024-08-31T06:32:31.029 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:32:31.029 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-31T06:32:31.029 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-31T06:32:31.029 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.7 2024-08-31T06:32:31.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:30 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:30.757+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:31.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:30 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:30.757+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:31.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:30 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:30.757+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:31.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:30 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:30.757+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:31.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:31 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:31.029+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:31.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:31 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:31.029+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:31.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:31 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:31.029+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:31.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:31 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:31.029+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:31.338 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:31 smithi130 systemd[1]: Stopping Ceph osd.7 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:32:31.338 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:31 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:31.090+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:31.338 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:31 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:31.090+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:31.338 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:31 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:31.090+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:31.338 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:31 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:31.090+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:31.611 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:31 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:31.336+0000 7fd061f3c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:32:31.611 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:31 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:31.336+0000 7fd061f3c640 -1 osd.7 119 *** Got signal Terminated *** 2024-08-31T06:32:31.611 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:31 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:31.336+0000 7fd061f3c640 -1 osd.7 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:32:31.611 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:31 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:31.609+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:31.611 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:31 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:31.609+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:31.611 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:31 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:31.609+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:02.291416+0000 front 2024-08-31T06:32:02.291442+0000 (oldest deadline 2024-08-31T06:32:26.391348+0000) 2024-08-31T06:32:31.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:31 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:31.256+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:31.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:31 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:31.256+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:31.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:31 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:31.256+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:32.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:31 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:31.723+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:32.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:31 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:31.723+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:32.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:31 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:31.723+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:32.175 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:31 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:31.723+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:32.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:32 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:32.075+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:32.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:32 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:32.075+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:32.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:32 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:32.075+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:32.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:32 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:32.075+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:32.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:32 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:32.072+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:32.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:32 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:32.072+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:32.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:32 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:32.072+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:32.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:32 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:32.072+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:32.500 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:32 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:32.232+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:32.500 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:32 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:32.232+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:32.500 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:32 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:32.232+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:32.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:32 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:32.613+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:32.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:32 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:32.613+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:32.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:32 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:32.613+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:02.291416+0000 front 2024-08-31T06:32:02.291442+0000 (oldest deadline 2024-08-31T06:32:26.391348+0000) 2024-08-31T06:32:32.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:32 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:32.714+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:32.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:32 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:32.714+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:32.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:32 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:32.714+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:32.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:32 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:32.714+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:33.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:33.044+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:33.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:33.044+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:33.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:33.044+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:33.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:33.044+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:33.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:33 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:33.114+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:33.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:33 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:33.114+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:33.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:33 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:33.114+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:33.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:33 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:33.114+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:33.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:33 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:33.189+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:33.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:33 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:33.189+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:33.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:33 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:33.189+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:33.877 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:33.584+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:33.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:33.584+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:33.878 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:33 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:33.584+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:02.291416+0000 front 2024-08-31T06:32:02.291442+0000 (oldest deadline 2024-08-31T06:32:26.391348+0000) 2024-08-31T06:32:34.149 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:33 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:33.696+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:34.149 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:33 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:33.696+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:34.149 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:33 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:33.696+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:34.149 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:33 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:33.696+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:34.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:34.010+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:34.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:34.010+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:34.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:34.010+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:34.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:34.010+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:34.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:34.010+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:34.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:34 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:34.147+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:34.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:34 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:34.147+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:34.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:34 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:34.147+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:34.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:34 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:34.158+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:34.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:34 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:34.158+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:34.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:34 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:34.158+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:34.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:34 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:34.158+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:34.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:34 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:34.666+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:34.926 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:34 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:34.666+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:34.926 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:34 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:34.666+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:34.926 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:34 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:34.666+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:34.926 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:34 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:34.666+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:34.972 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:34.630+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:34.972 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:34.630+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:34.972 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:34.630+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:02.291416+0000 front 2024-08-31T06:32:02.291442+0000 (oldest deadline 2024-08-31T06:32:26.391348+0000) 2024-08-31T06:32:34.972 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:34.630+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:08.692249+0000 front 2024-08-31T06:32:08.692272+0000 (oldest deadline 2024-08-31T06:32:33.992397+0000) 2024-08-31T06:32:35.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:34.969+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:35.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:34.969+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:35.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:34.969+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:35.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:34.969+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:35.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:34 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:34.969+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:35.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:35 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:35.157+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:35.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:35 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:35.157+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:35.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:35 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:35.157+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:35.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:35 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:35.157+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:12.038360+0000 front 2024-08-31T06:32:12.038432+0000 (oldest deadline 2024-08-31T06:32:34.938396+0000) 2024-08-31T06:32:35.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:35 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:35.128+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:35.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:35 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:35.128+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:35.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:35 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:35.128+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:35.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:35 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:35.128+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:35.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:35 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:35.632+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:35.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:35 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:35.632+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:35.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:35 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:35.632+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:35.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:35 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:35.632+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:35.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:35 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:35.632+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:35.943 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:35 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:35.641+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.386835+0000 front 2024-08-31T06:31:47.386861+0000 (oldest deadline 2024-08-31T06:32:09.687080+0000) 2024-08-31T06:32:35.943 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:35 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:35.641+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.989694+0000 front 2024-08-31T06:31:55.989665+0000 (oldest deadline 2024-08-31T06:32:21.790183+0000) 2024-08-31T06:32:35.943 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:35 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:35.641+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:02.291416+0000 front 2024-08-31T06:32:02.291442+0000 (oldest deadline 2024-08-31T06:32:26.391348+0000) 2024-08-31T06:32:35.943 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:35 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7[41312]: 2024-08-31T06:32:35.641+0000 7fd05e527640 -1 osd.7 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:08.692249+0000 front 2024-08-31T06:32:08.692272+0000 (oldest deadline 2024-08-31T06:32:33.992397+0000) 2024-08-31T06:32:36.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:35 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:35.941+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:36.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:35 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:35.941+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:36.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:35 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:35.941+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:36.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:35 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:35.941+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:36.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:35 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:35.941+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:36.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:36 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:36.122+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:36.429 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:36 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:36.122+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:36.429 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:36 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:36.122+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:36.429 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:36 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:36.122+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:12.038360+0000 front 2024-08-31T06:32:12.038432+0000 (oldest deadline 2024-08-31T06:32:34.938396+0000) 2024-08-31T06:32:36.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:36 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:36.158+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:36.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:36 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:36.158+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:36.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:36 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:36.158+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:36.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:36 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:36.158+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:36.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:36 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:36.158+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:36.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:36 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:36.582+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:36.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:36 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:36.582+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:36.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:36 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:36.582+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:36.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:36 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:36.582+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:36.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:36 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:36.582+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:37.030 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:36 smithi130 podman[66489]: 2024-08-31 06:32:36.761028692 +0000 UTC m=+5.536109461 container died 89563586b33fc22e83bd770d007f80416f929ad3601893b62d0b0235b6676c9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:32:37.031 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:36 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:36.947+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:37.031 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:36 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:36.947+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:37.031 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:36 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:36.947+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:37.031 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:36 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:36.947+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:37.031 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:36 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:36.947+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:37.378 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:37 smithi130 podman[66489]: 2024-08-31 06:32:37.181995626 +0000 UTC m=+5.957076396 container cleanup 89563586b33fc22e83bd770d007f80416f929ad3601893b62d0b0235b6676c9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-31T06:32:37.378 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:37 smithi130 bash[66489]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7 2024-08-31T06:32:37.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:37 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:37.121+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:37.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:37 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:37.121+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:37.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:37 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:37.121+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:37.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:37 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:37.121+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:12.038360+0000 front 2024-08-31T06:32:12.038432+0000 (oldest deadline 2024-08-31T06:32:34.938396+0000) 2024-08-31T06:32:37.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:37 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:37.145+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:37.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:37 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:37.145+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:37.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:37 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:37.145+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:37.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:37 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:37.145+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:37.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:37 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:37.145+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:37.845 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:37 smithi130 podman[66505]: 2024-08-31 06:32:37.42084889 +0000 UTC m=+0.659682797 container remove 89563586b33fc22e83bd770d007f80416f929ad3601893b62d0b0235b6676c9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:32:37.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:37 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:37.543+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:37.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:37 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:37.543+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:37.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:37 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:37.543+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:37.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:37 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:37.543+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:37.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:37 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:37.543+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:38.117 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:37 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:37.941+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:38.117 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:37 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:37.941+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:38.117 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:37 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:37.941+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:38.118 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:37 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:37.941+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:38.118 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:37 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:37.941+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:38.118 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:37 smithi130 podman[66598]: 2024-08-31 06:32:37.74674836 +0000 UTC m=+0.015783579 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:32:38.118 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:37 smithi130 podman[66598]: 2024-08-31 06:32:37.863190301 +0000 UTC m=+0.132225509 container create 177998cde8ee22de8a1ead715dcc8af5b6bcf8cb4157b7ddc36b3f0af15b8913 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-31T06:32:38.118 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:38 smithi130 podman[66598]: 2024-08-31 06:32:38.116298746 +0000 UTC m=+0.385333958 container init 177998cde8ee22de8a1ead715dcc8af5b6bcf8cb4157b7ddc36b3f0af15b8913 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-08-31T06:32:38.378 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:38 smithi130 podman[66598]: 2024-08-31 06:32:38.120179243 +0000 UTC m=+0.389214450 container start 177998cde8ee22de8a1ead715dcc8af5b6bcf8cb4157b7ddc36b3f0af15b8913 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-31T06:32:38.378 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:38 smithi130 podman[66598]: 2024-08-31 06:32:38.207481825 +0000 UTC m=+0.476517040 container attach 177998cde8ee22de8a1ead715dcc8af5b6bcf8cb4157b7ddc36b3f0af15b8913 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-08-31T06:32:38.378 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 31 06:32:38 smithi130 podman[66598]: 2024-08-31 06:32:38.316815149 +0000 UTC m=+0.585850369 container died 177998cde8ee22de8a1ead715dcc8af5b6bcf8cb4157b7ddc36b3f0af15b8913 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:32:38.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:38 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:38.073+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:38.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:38 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:38.073+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:38.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:38 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:38.073+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:38.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:38 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:38.073+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:12.038360+0000 front 2024-08-31T06:32:12.038432+0000 (oldest deadline 2024-08-31T06:32:34.938396+0000) 2024-08-31T06:32:38.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:38 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:38.194+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:38.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:38 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:38.194+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:38.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:38 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:38.194+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:38.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:38 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:38.194+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:38.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:38 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:38.194+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:38.895 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.7.service' 2024-08-31T06:32:38.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:38 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:38.502+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:38.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:38 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:38.502+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:38.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:38 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:38.502+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:38.926 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:38 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:38.502+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:38.926 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:38 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:38.502+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:38.934 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:32:38.934 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-31T06:32:38.935 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-31T06:32:38.935 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.8 2024-08-31T06:32:39.127 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:38 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:38.977+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:39.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:38 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:38.977+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:39.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:38 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:38.977+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:39.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:38 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:38.977+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:39.128 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:38 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:38.977+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:39.228 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:38 smithi153 systemd[1]: Stopping Ceph osd.8 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:32:39.228 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:39.052+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:39.228 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:39.052+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:39.228 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:39.052+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:39.228 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:39.052+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:12.038360+0000 front 2024-08-31T06:32:12.038432+0000 (oldest deadline 2024-08-31T06:32:34.938396+0000) 2024-08-31T06:32:39.228 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:39.226+0000 7f5e3d314640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:32:39.229 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:39.226+0000 7f5e3d314640 -1 osd.8 119 *** Got signal Terminated *** 2024-08-31T06:32:39.229 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:39.226+0000 7f5e3d314640 -1 osd.8 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:32:39.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:39 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:39.215+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:39.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:39 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:39.215+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:39.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:39 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:39.215+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:39.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:39 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:39.215+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:39.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:39 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:39.215+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:39.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:39.469+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:39.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:39.469+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:39.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:39.469+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:39.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:39.469+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:39.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:39 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:39.469+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:40.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:39 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:39.975+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:40.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:39 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:39.975+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:40.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:39 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:39.975+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:40.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:39 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:39.975+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:40.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:39 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:39.975+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:40.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:40 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:40.033+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:40.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:40 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:40.033+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:40.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:40 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:40.033+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:40.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:40 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:40.033+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:12.038360+0000 front 2024-08-31T06:32:12.038432+0000 (oldest deadline 2024-08-31T06:32:34.938396+0000) 2024-08-31T06:32:40.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:40 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:40.214+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:40.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:40 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:40.214+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:40.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:40 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:40.214+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:40.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:40 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:40.214+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:40.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:40 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:40.214+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:40.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:40 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:40.468+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:40.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:40 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:40.468+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:40.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:40 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:40.468+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:40.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:40 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:40.468+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:40.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:40 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:40.468+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:41.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:40 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:40.989+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:41.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:40 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:40.989+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:41.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:40 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:40.989+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:41.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:40 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:40.989+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:41.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:40 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:40.989+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:41.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:40 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:40.989+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:41.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:41 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:41.053+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:41.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:41 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:41.053+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:41.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:41 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:41.053+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:41.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:41 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:41.053+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:12.038360+0000 front 2024-08-31T06:32:12.038432+0000 (oldest deadline 2024-08-31T06:32:34.938396+0000) 2024-08-31T06:32:41.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:41 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:41.230+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:41.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:41 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:41.230+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:41.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:41 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:41.230+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:41.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:41 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:41.230+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:41.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:41 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:41.230+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:41.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:41 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:41.468+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:41.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:41 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:41.468+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:41.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:41 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:41.468+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:41.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:41 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:41.468+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:41.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:41 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:41.468+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:42.290 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:42 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:42.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:42.291 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:42 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:42.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:42.291 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:42 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:42.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:42.291 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:42 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:42.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:42.291 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:42 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:42.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:42.291 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:42 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:42.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:42.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:42 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:42.035+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:42.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:42 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:42.035+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:42.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:42 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:42.035+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:42.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:42 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:42.035+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:12.038360+0000 front 2024-08-31T06:32:12.038432+0000 (oldest deadline 2024-08-31T06:32:34.938396+0000) 2024-08-31T06:32:42.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:42 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:42.265+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:42.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:42 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:42.265+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:42.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:42 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:42.265+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:42.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:42 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:42.265+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:42.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:42 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:42.265+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:42.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:42 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:42.493+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:42.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:42 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:42.493+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:42.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:42 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:42.493+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:42.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:42 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:42.493+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:42.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:42 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:42.493+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:42.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:42 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:42.493+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:43.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:43 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:43.076+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:43.413 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:43 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:43.076+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:43.413 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:43 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:43.076+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:43.413 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:43 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:43.076+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:43.413 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:43 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:43.076+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:43.413 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:43 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:43.076+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:43.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:43 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:43.037+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:43.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:43 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:43.037+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:43.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:43 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:43.037+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:43.425 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:43 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:43.037+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:12.038360+0000 front 2024-08-31T06:32:12.038432+0000 (oldest deadline 2024-08-31T06:32:34.938396+0000) 2024-08-31T06:32:43.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:43 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:43.279+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:43.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:43 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:43.279+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:43.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:43 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:43.279+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:43.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:43 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:43.279+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:43.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:43 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:43.279+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:43.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:43 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:43.279+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:19.896020+0000 front 2024-08-31T06:32:19.895896+0000 (oldest deadline 2024-08-31T06:32:42.795751+0000) 2024-08-31T06:32:43.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:43 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:43.445+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:43.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:43 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:43.445+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:43.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:43 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:43.445+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:43.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:43 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:43.445+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:43.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:43 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:43.445+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:43.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:43 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:43.445+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:44.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:44 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:44.075+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:44.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:44 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:44.075+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:44.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:44 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:44.075+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:44.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:44 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:44.075+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:44.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:44 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:44.075+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:44.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:44 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:44.075+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:44.419 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:44 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:44.038+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:48.233590+0000 front 2024-08-31T06:31:48.233495+0000 (oldest deadline 2024-08-31T06:32:09.933445+0000) 2024-08-31T06:32:44.419 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:44 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:44.038+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.234412+0000 front 2024-08-31T06:31:55.234529+0000 (oldest deadline 2024-08-31T06:32:18.134523+0000) 2024-08-31T06:32:44.419 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:44 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:44.038+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.936724+0000 front 2024-08-31T06:32:03.936551+0000 (oldest deadline 2024-08-31T06:32:28.636697+0000) 2024-08-31T06:32:44.420 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:44 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:44.038+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:12.038360+0000 front 2024-08-31T06:32:12.038432+0000 (oldest deadline 2024-08-31T06:32:34.938396+0000) 2024-08-31T06:32:44.420 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:44 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8[41308]: 2024-08-31T06:32:44.038+0000 7f5e358f7640 -1 osd.8 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.839497+0000 front 2024-08-31T06:32:17.839534+0000 (oldest deadline 2024-08-31T06:32:43.739820+0000) 2024-08-31T06:32:44.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:44 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:44.417+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:44.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:44 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:44.417+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:44.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:44 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:44.417+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:44.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:44 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:44.417+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:44.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:44 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:44.417+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:44.676 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:44 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:44.417+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:44.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:44 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:44.236+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:44.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:44 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:44.236+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:44.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:44 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:44.236+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:44.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:44 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:44.236+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:44.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:44 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:44.236+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:44.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:44 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:44.236+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:19.896020+0000 front 2024-08-31T06:32:19.895896+0000 (oldest deadline 2024-08-31T06:32:42.795751+0000) 2024-08-31T06:32:44.944 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:44 smithi153 podman[62312]: 2024-08-31 06:32:44.693440075 +0000 UTC m=+5.562179815 container died 32a4c7b8758f9532bad290e785cfd4153eb549b11f491dbf16a0b5ba64dbd479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-31T06:32:45.270 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:45 smithi153 podman[62312]: 2024-08-31 06:32:45.060433995 +0000 UTC m=+5.929173717 container cleanup 32a4c7b8758f9532bad290e785cfd4153eb549b11f491dbf16a0b5ba64dbd479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-31T06:32:45.270 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:45 smithi153 bash[62312]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8 2024-08-31T06:32:45.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:45 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:45.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:45.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:45 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:45.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:45.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:45 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:45.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:45.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:45 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:45.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:45.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:45 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:45.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:45.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:45 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:45.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:45.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:45 smithi153 podman[62326]: 2024-08-31 06:32:45.269370119 +0000 UTC m=+0.569381299 container remove 32a4c7b8758f9532bad290e785cfd4153eb549b11f491dbf16a0b5ba64dbd479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-31T06:32:45.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:45 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:45.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:45.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:45 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:45.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:45.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:45 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:45.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:45.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:45 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:45.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:45.676 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:45 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:45.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:45.676 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:45 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:45.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:45.725 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:45 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:45.237+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:45.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:45 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:45.237+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:45.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:45 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:45.237+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:45.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:45 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:45.237+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:45.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:45 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:45.237+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:45.726 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:45 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:45.237+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:19.896020+0000 front 2024-08-31T06:32:19.895896+0000 (oldest deadline 2024-08-31T06:32:42.795751+0000) 2024-08-31T06:32:45.998 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:45 smithi153 podman[62414]: 2024-08-31 06:32:45.582435023 +0000 UTC m=+0.015794463 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:32:45.998 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:45 smithi153 podman[62414]: 2024-08-31 06:32:45.694948875 +0000 UTC m=+0.128308284 container create 024152c81689a87610940917e481342572c0756344765238b18928a4a62595b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-08-31T06:32:45.998 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:45 smithi153 podman[62414]: 2024-08-31 06:32:45.905635254 +0000 UTC m=+0.338994674 container init 024152c81689a87610940917e481342572c0756344765238b18928a4a62595b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-31T06:32:45.999 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:45 smithi153 podman[62414]: 2024-08-31 06:32:45.908950562 +0000 UTC m=+0.342309982 container start 024152c81689a87610940917e481342572c0756344765238b18928a4a62595b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2) 2024-08-31T06:32:46.367 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:45 smithi153 podman[62414]: 2024-08-31 06:32:45.997226515 +0000 UTC m=+0.430585940 container attach 024152c81689a87610940917e481342572c0756344765238b18928a4a62595b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-31T06:32:46.368 INFO:journalctl@ceph.osd.8.smithi153.stdout:Aug 31 06:32:46 smithi153 podman[62414]: 2024-08-31 06:32:46.097210486 +0000 UTC m=+0.530569896 container died 024152c81689a87610940917e481342572c0756344765238b18928a4a62595b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1) 2024-08-31T06:32:46.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:46 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:46.095+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:46.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:46 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:46.095+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:46.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:46 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:46.095+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:46.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:46 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:46.095+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:46.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:46 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:46.095+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:46.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:46 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:46.095+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:46.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:46 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:46.195+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:46.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:46 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:46.195+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:46.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:46 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:46.195+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:46.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:46 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:46.195+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:46.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:46 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:46.195+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:46.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:46 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:46.195+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:19.896020+0000 front 2024-08-31T06:32:19.895896+0000 (oldest deadline 2024-08-31T06:32:42.795751+0000) 2024-08-31T06:32:46.586 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.8.service' 2024-08-31T06:32:46.624 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:46 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:46.452+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:46.624 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:46 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:46.452+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:46.624 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:46 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:46.452+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:46.624 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:46 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:46.452+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:46.625 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:46 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:46.452+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:46.625 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:46 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:46.452+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:46.626 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:32:46.626 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-31T06:32:46.626 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-31T06:32:46.626 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.9 2024-08-31T06:32:46.934 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:46 smithi053 systemd[1]: Stopping Ceph osd.9 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:32:47.225 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:46 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:46.932+0000 7fc785f85640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:32:47.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:46 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:46.932+0000 7fc785f85640 -1 osd.9 119 *** Got signal Terminated *** 2024-08-31T06:32:47.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:46 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:46.932+0000 7fc785f85640 -1 osd.9 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:32:47.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:47 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:47.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:47.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:47 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:47.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:47.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:47 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:47.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:47.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:47 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:47.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:47.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:47 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:47.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:47.226 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:47 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:47.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:19.896020+0000 front 2024-08-31T06:32:19.895896+0000 (oldest deadline 2024-08-31T06:32:42.795751+0000) 2024-08-31T06:32:47.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:47 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:47.064+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:47.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:47 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:47.064+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:47.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:47 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:47.064+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:47.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:47 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:47.064+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:47.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:47 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:47.064+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:47.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:47 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:47.064+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:47.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:47 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:47.485+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:47.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:47 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:47.485+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:47.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:47 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:47.485+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:47.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:47 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:47.485+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:47.676 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:47 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:47.485+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:47.676 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:47 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:47.485+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:48.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:48 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:48.106+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:48.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:48 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:48.106+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:48.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:48 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:48.106+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:48.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:48 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:48.106+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:48.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:48 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:48.106+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:48.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:48 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:48.106+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:48.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:48 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:48.120+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:48.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:48 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:48.120+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:48.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:48 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:48.120+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:48.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:48 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:48.120+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:48.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:48 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:48.120+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:48.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:48 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:48.120+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:19.896020+0000 front 2024-08-31T06:32:19.895896+0000 (oldest deadline 2024-08-31T06:32:42.795751+0000) 2024-08-31T06:32:48.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:48 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:48.520+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:48.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:48 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:48.520+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:48.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:48 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:48.520+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:48.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:48 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:48.520+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:48.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:48 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:48.520+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:48.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:48 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:48.520+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:49.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:49 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:49.123+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:49.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:49 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:49.123+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:49.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:49 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:49.123+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:49.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:49 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:49.123+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:49.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:49 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:49.123+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:49.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:49 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:49.123+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:49.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:49 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:49.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:49.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:49 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:49.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:49.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:49 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:49.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:49.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:49 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:49.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:49.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:49 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:49.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:49.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:49 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:49.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:19.896020+0000 front 2024-08-31T06:32:19.895896+0000 (oldest deadline 2024-08-31T06:32:42.795751+0000) 2024-08-31T06:32:49.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:49 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:49.162+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6822 osd.6 since back 2024-08-31T06:32:27.396987+0000 front 2024-08-31T06:32:27.397045+0000 (oldest deadline 2024-08-31T06:32:49.097084+0000) 2024-08-31T06:32:49.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:49 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:49.513+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:49.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:49 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:49.513+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:49.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:49 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:49.513+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:49.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:49 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:49.513+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:49.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:49 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:49.513+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:49.926 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:49 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:49.513+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:50.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:50 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:50.078+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:50.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:50 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:50.078+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:50.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:50 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:50.078+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:50.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:50 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:50.078+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:50.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:50 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:50.078+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:50.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:50 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:50.078+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:50.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:50.173+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:50.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:50.173+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:50.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:50.173+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:50.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:50.173+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:50.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:50.173+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:50.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:50.173+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:19.896020+0000 front 2024-08-31T06:32:19.895896+0000 (oldest deadline 2024-08-31T06:32:42.795751+0000) 2024-08-31T06:32:50.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:50 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:50.173+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6822 osd.6 since back 2024-08-31T06:32:27.396987+0000 front 2024-08-31T06:32:27.397045+0000 (oldest deadline 2024-08-31T06:32:49.097084+0000) 2024-08-31T06:32:50.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:50 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:50.510+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:50.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:50 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:50.510+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:50.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:50 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:50.510+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:50.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:50 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:50.510+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:50.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:50 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:50.510+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:50.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:50 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:50.510+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:51.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:51 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:51.091+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:51.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:51 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:51.091+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:51.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:51 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:51.091+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:51.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:51 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:51.091+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:51.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:51 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:51.091+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:51.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:51 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:51.091+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:51.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:51 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:51.189+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.588574+0000 front 2024-08-31T06:31:38.588631+0000 (oldest deadline 2024-08-31T06:32:03.888796+0000) 2024-08-31T06:32:51.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:51 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:51.189+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.290690+0000 front 2024-08-31T06:31:47.290530+0000 (oldest deadline 2024-08-31T06:32:12.590671+0000) 2024-08-31T06:32:51.475 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:51 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:51.189+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:55.491736+0000 front 2024-08-31T06:31:55.491752+0000 (oldest deadline 2024-08-31T06:32:17.191605+0000) 2024-08-31T06:32:51.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:51 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:51.189+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:04.693331+0000 front 2024-08-31T06:32:04.693370+0000 (oldest deadline 2024-08-31T06:32:29.393471+0000) 2024-08-31T06:32:51.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:51 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:51.189+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.694818+0000 front 2024-08-31T06:32:11.694908+0000 (oldest deadline 2024-08-31T06:32:35.794734+0000) 2024-08-31T06:32:51.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:51 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:51.189+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:19.896020+0000 front 2024-08-31T06:32:19.895896+0000 (oldest deadline 2024-08-31T06:32:42.795751+0000) 2024-08-31T06:32:51.476 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:51 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9[56889]: 2024-08-31T06:32:51.189+0000 7fc77e568640 -1 osd.9 119 heartbeat_check: no reply from 172.21.15.53:6822 osd.6 since back 2024-08-31T06:32:27.396987+0000 front 2024-08-31T06:32:27.397045+0000 (oldest deadline 2024-08-31T06:32:49.097084+0000) 2024-08-31T06:32:51.826 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:51 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:51.483+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:51.827 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:51 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:51.483+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:51.827 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:51 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:51.483+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:51.827 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:51 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:51.483+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:51.827 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:51 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:51.483+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:51.827 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:51 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:51.483+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:52.333 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:52 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:52.068+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:52.333 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:52 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:52.068+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:52.333 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:52 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:52.068+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:52.333 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:52 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:52.068+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:52.333 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:52 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:52.068+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:52.333 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:52 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:52.068+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:52.334 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:52 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:52.068+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6822 osd.6 since back 2024-08-31T06:32:26.783558+0000 front 2024-08-31T06:32:26.783451+0000 (oldest deadline 2024-08-31T06:32:51.483359+0000) 2024-08-31T06:32:52.626 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:52 smithi053 podman[145205]: 2024-08-31 06:32:52.352672074 +0000 UTC m=+5.528636531 container died 7a8533ea5390de961a4cabb95a8b5d50c925de3d3644eee1d8af04cb9acef574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-31T06:32:52.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:52 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:52.449+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:52.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:52 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:52.449+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:52.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:52 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:52.449+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:52.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:52 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:52.449+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:52.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:52 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:52.449+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:52.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:52 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:52.449+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:52.975 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:52 smithi053 podman[145205]: 2024-08-31 06:32:52.782379193 +0000 UTC m=+5.958343648 container cleanup 7a8533ea5390de961a4cabb95a8b5d50c925de3d3644eee1d8af04cb9acef574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-31T06:32:52.976 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:52 smithi053 bash[145205]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9 2024-08-31T06:32:53.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:53 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:53.049+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:53.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:53 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:53.049+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:53.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:53 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:53.049+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:53.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:53 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:53.049+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:53.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:53 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:53.049+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:53.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:53 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:53.049+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:53.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:53 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:53.049+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6822 osd.6 since back 2024-08-31T06:32:26.783558+0000 front 2024-08-31T06:32:26.783451+0000 (oldest deadline 2024-08-31T06:32:51.483359+0000) 2024-08-31T06:32:53.402 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:52 smithi053 podman[145223]: 2024-08-31 06:32:52.992372262 +0000 UTC m=+0.634274683 container remove 7a8533ea5390de961a4cabb95a8b5d50c925de3d3644eee1d8af04cb9acef574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T06:32:53.696 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:53 smithi053 podman[145309]: 2024-08-31 06:32:53.401421199 +0000 UTC m=+0.098501497 container create 265eb73ca16b2a25993f2473f86c945cc9e1a3016f98102b6101b82173a03a4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-08-31T06:32:53.696 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:53 smithi053 podman[145309]: 2024-08-31 06:32:53.319280968 +0000 UTC m=+0.016361269 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:32:53.697 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:53 smithi053 podman[145309]: 2024-08-31 06:32:53.612096624 +0000 UTC m=+0.309176922 container init 265eb73ca16b2a25993f2473f86c945cc9e1a3016f98102b6101b82173a03a4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T06:32:53.697 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:53 smithi053 podman[145309]: 2024-08-31 06:32:53.615296643 +0000 UTC m=+0.312376949 container start 265eb73ca16b2a25993f2473f86c945cc9e1a3016f98102b6101b82173a03a4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:32:53.697 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:53 smithi053 podman[145309]: 2024-08-31 06:32:53.695359892 +0000 UTC m=+0.392440191 container attach 265eb73ca16b2a25993f2473f86c945cc9e1a3016f98102b6101b82173a03a4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD) 2024-08-31T06:32:53.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:53 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:53.423+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:53.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:53 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:53.423+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:53.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:53 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:53.423+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:53.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:53 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:53.423+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:53.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:53 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:53.423+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:53.926 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:53 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:53.423+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:53.976 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:53 smithi053 podman[145309]: 2024-08-31 06:32:53.808192876 +0000 UTC m=+0.505273177 container died 265eb73ca16b2a25993f2473f86c945cc9e1a3016f98102b6101b82173a03a4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9-deactivate, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-31T06:32:54.348 INFO:journalctl@ceph.osd.9.smithi053.stdout:Aug 31 06:32:54 smithi053 podman[145332]: 2024-08-31 06:32:54.332137274 +0000 UTC m=+0.517899784 container remove 265eb73ca16b2a25993f2473f86c945cc9e1a3016f98102b6101b82173a03a4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-31T06:32:54.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.9.service' 2024-08-31T06:32:54.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:54 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:54.037+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:54.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:54 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:54.037+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:54.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:54 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:54.037+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:54.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:54 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:54.037+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:54.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:54 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:54.037+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:54.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:54 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:54.037+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:54.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:54 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:54.037+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6822 osd.6 since back 2024-08-31T06:32:26.783558+0000 front 2024-08-31T06:32:26.783451+0000 (oldest deadline 2024-08-31T06:32:51.483359+0000) 2024-08-31T06:32:54.396 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:32:54.397 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-31T06:32:54.397 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-31T06:32:54.397 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.10 2024-08-31T06:32:54.697 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:54 smithi130 systemd[1]: Stopping Ceph osd.10 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:32:54.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:54 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:54.448+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:54.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:54 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:54.448+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:54.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:54 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:54.448+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:54.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:54 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:54.448+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:54.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:54 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:54.448+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:54.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:54 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:54.448+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:55.085 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:54 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:54.696+0000 7f8d9819b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:32:55.085 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:54 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:54.696+0000 7f8d9819b640 -1 osd.10 119 *** Got signal Terminated *** 2024-08-31T06:32:55.085 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:54 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:54.696+0000 7f8d9819b640 -1 osd.10 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:32:55.085 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:55 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:55.084+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:55.085 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:55 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:55.084+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:55.085 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:55 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:55.084+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:55.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:55 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:55.084+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:55.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:55 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:55.084+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:55.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:55 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:55.084+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:55.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:55 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:55.084+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6822 osd.6 since back 2024-08-31T06:32:26.783558+0000 front 2024-08-31T06:32:26.783451+0000 (oldest deadline 2024-08-31T06:32:51.483359+0000) 2024-08-31T06:32:55.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:55 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:55.419+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:55.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:55 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:55.419+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:55.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:55 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:55.419+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:55.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:55 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:55.419+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:55.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:55 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:55.419+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:55.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:55 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:55.419+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:56.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:56 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:56.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:56.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:56 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:56.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:56.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:56 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:56.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:56.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:56 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:56.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:56.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:56 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:56.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:56.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:56 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:56.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:56.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:56 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:56.059+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6822 osd.6 since back 2024-08-31T06:32:26.783558+0000 front 2024-08-31T06:32:26.783451+0000 (oldest deadline 2024-08-31T06:32:51.483359+0000) 2024-08-31T06:32:56.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:56 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:56.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:56.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:56 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:56.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:56.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:56 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:56.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:56.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:56 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:56.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:56.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:56 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:56.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:56.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:56 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:56.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:57.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:57 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:57.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:57.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:57 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:57.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:57.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:57 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:57.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:57.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:57 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:57.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:57.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:57 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:57.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:57.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:57 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:57.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:57.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:57 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:57.033+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6822 osd.6 since back 2024-08-31T06:32:26.783558+0000 front 2024-08-31T06:32:26.783451+0000 (oldest deadline 2024-08-31T06:32:51.483359+0000) 2024-08-31T06:32:57.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:57 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:57.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:57.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:57 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:57.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:57.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:57 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:57.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:57.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:57 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:57.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:57.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:57 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:57.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:57.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:57 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:57.433+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:58.377 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:58 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:58.073+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:58.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:58 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:58.073+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:58.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:58 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:58.073+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:58.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:58 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:58.073+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:58.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:58 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:58.073+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:58.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:58 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:58.073+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:58.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:58 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:58.073+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6822 osd.6 since back 2024-08-31T06:32:26.783558+0000 front 2024-08-31T06:32:26.783451+0000 (oldest deadline 2024-08-31T06:32:51.483359+0000) 2024-08-31T06:32:58.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:58 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:58.401+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:58.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:58 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:58.401+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:58.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:58 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:58.401+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:58.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:58 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:58.401+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:58.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:58 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:58.401+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:58.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:58 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:58.401+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:59.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:59 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:59.043+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:38.273866+0000 front 2024-08-31T06:31:38.273825+0000 (oldest deadline 2024-08-31T06:32:01.773770+0000) 2024-08-31T06:32:59.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:59 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:59.043+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.575474+0000 front 2024-08-31T06:31:47.575528+0000 (oldest deadline 2024-08-31T06:32:12.875594+0000) 2024-08-31T06:32:59.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:59 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:59.043+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:56.277366+0000 front 2024-08-31T06:31:56.277554+0000 (oldest deadline 2024-08-31T06:32:19.177373+0000) 2024-08-31T06:32:59.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:59 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:59.043+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:03.778945+0000 front 2024-08-31T06:32:03.779035+0000 (oldest deadline 2024-08-31T06:32:26.678701+0000) 2024-08-31T06:32:59.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:59 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:59.043+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:11.681017+0000 front 2024-08-31T06:32:11.681076+0000 (oldest deadline 2024-08-31T06:32:33.981009+0000) 2024-08-31T06:32:59.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:59 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:59.043+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:16.282046+0000 front 2024-08-31T06:32:16.282142+0000 (oldest deadline 2024-08-31T06:32:40.981990+0000) 2024-08-31T06:32:59.378 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:32:59 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10[48285]: 2024-08-31T06:32:59.043+0000 7f8d9077e640 -1 osd.10 119 heartbeat_check: no reply from 172.21.15.53:6822 osd.6 since back 2024-08-31T06:32:26.783558+0000 front 2024-08-31T06:32:26.783451+0000 (oldest deadline 2024-08-31T06:32:51.483359+0000) 2024-08-31T06:32:59.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:59 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:59.403+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:32:59.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:59 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:59.403+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:32:59.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:59 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:59.403+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:32:59.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:59 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:59.403+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:32:59.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:59 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:59.403+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:32:59.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:59 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:59.403+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:32:59.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:32:59 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:32:59.403+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-31T06:32:35.846130+0000 front 2024-08-31T06:32:35.846144+0000 (oldest deadline 2024-08-31T06:32:59.345968+0000) 2024-08-31T06:33:00.440 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:33:00 smithi130 podman[66714]: 2024-08-31 06:33:00.188399329 +0000 UTC m=+5.599466338 container died d42edbd51a937684db598c6907ae207ab3b98a872bc36e156e509238e3e87b52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-31T06:33:00.698 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:33:00 smithi130 podman[66714]: 2024-08-31 06:33:00.512647113 +0000 UTC m=+5.923714113 container cleanup d42edbd51a937684db598c6907ae207ab3b98a872bc36e156e509238e3e87b52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-31T06:33:00.698 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:33:00 smithi130 bash[66714]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10 2024-08-31T06:33:00.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:00 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:00.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:33:00.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:00 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:00.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:33:00.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:00 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:00.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:33:00.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:00 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:00.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:33:00.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:00 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:00.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:33:00.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:00 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:00.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:33:00.925 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:00 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:00.447+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-31T06:32:35.846130+0000 front 2024-08-31T06:32:35.846144+0000 (oldest deadline 2024-08-31T06:32:59.345968+0000) 2024-08-31T06:33:01.103 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:33:00 smithi130 podman[66731]: 2024-08-31 06:33:00.697054448 +0000 UTC m=+0.511788308 container remove d42edbd51a937684db598c6907ae207ab3b98a872bc36e156e509238e3e87b52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-31T06:33:01.368 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:33:01 smithi130 podman[66819]: 2024-08-31 06:33:01.005055043 +0000 UTC m=+0.015479887 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:33:01.368 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:33:01 smithi130 podman[66819]: 2024-08-31 06:33:01.114309421 +0000 UTC m=+0.124734254 container create 56981edf2c380333f6756c5a334db65b4c376cc6f3172cabfd3a0560f45abf05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-08-31T06:33:01.368 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:33:01 smithi130 podman[66819]: 2024-08-31 06:33:01.367017693 +0000 UTC m=+0.377442528 container init 56981edf2c380333f6756c5a334db65b4c376cc6f3172cabfd3a0560f45abf05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:33:01.628 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:33:01 smithi130 podman[66819]: 2024-08-31 06:33:01.370275551 +0000 UTC m=+0.380700386 container start 56981edf2c380333f6756c5a334db65b4c376cc6f3172cabfd3a0560f45abf05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10-deactivate, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-31T06:33:01.628 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:33:01 smithi130 podman[66819]: 2024-08-31 06:33:01.450187533 +0000 UTC m=+0.460612370 container attach 56981edf2c380333f6756c5a334db65b4c376cc6f3172cabfd3a0560f45abf05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=) 2024-08-31T06:33:01.628 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 31 06:33:01 smithi130 podman[66842]: 2024-08-31 06:33:01.592871693 +0000 UTC m=+0.016207144 container died 56981edf2c380333f6756c5a334db65b4c376cc6f3172cabfd3a0560f45abf05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-31T06:33:01.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:01 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:01.404+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:33:01.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:01 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:01.404+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:33:01.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:01 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:01.404+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:33:01.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:01 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:01.404+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:33:01.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:01 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:01.404+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:33:01.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:01 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:01.404+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:33:01.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:01 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:01.404+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-31T06:32:35.846130+0000 front 2024-08-31T06:32:35.846144+0000 (oldest deadline 2024-08-31T06:32:59.345968+0000) 2024-08-31T06:33:02.113 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.10.service' 2024-08-31T06:33:02.151 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:02.151 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-31T06:33:02.151 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-31T06:33:02.151 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.11 2024-08-31T06:33:02.438 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:02 smithi153 systemd[1]: Stopping Ceph osd.11 for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:02.438 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:02.375+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:33:02.438 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:02.375+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:33:02.438 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:02.375+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:33:02.438 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:02.375+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:33:02.438 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:02.375+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:33:02.438 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:02.375+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:33:02.438 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:02.375+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-31T06:32:35.846130+0000 front 2024-08-31T06:32:35.846144+0000 (oldest deadline 2024-08-31T06:32:59.345968+0000) 2024-08-31T06:33:02.438 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:02.436+0000 7ff947995640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:02.439 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:02.436+0000 7ff947995640 -1 osd.11 119 *** Got signal Terminated *** 2024-08-31T06:33:02.439 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:02 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:02.436+0000 7ff947995640 -1 osd.11 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:33:03.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:03.358+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:33:03.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:03.358+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:33:03.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:03.358+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:33:03.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:03.358+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:33:03.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:03.358+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:33:03.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:03.358+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:33:03.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:03 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:03.358+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-31T06:32:35.846130+0000 front 2024-08-31T06:32:35.846144+0000 (oldest deadline 2024-08-31T06:32:59.345968+0000) 2024-08-31T06:33:04.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:04 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:04.336+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:33:04.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:04 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:04.336+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:33:04.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:04 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:04.336+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:33:04.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:04 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:04.336+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:33:04.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:04 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:04.336+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:33:04.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:04 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:04.336+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:33:04.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:04 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:04.336+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-31T06:32:35.846130+0000 front 2024-08-31T06:32:35.846144+0000 (oldest deadline 2024-08-31T06:32:59.345968+0000) 2024-08-31T06:33:05.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:05 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:05.369+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:33:05.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:05 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:05.369+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:33:05.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:05 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:05.369+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:33:05.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:05 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:05.369+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:33:05.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:05 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:05.369+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:33:05.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:05 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:05.369+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:33:05.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:05 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:05.369+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-31T06:32:35.846130+0000 front 2024-08-31T06:32:35.846144+0000 (oldest deadline 2024-08-31T06:32:59.345968+0000) 2024-08-31T06:33:06.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:06 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:06.408+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:33:06.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:06 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:06.408+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:33:06.676 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:06 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:06.408+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:33:06.676 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:06 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:06.408+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:33:06.676 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:06 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:06.408+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:33:06.676 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:06 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:06.408+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:33:06.676 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:06 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:06.408+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-31T06:32:35.846130+0000 front 2024-08-31T06:32:35.846144+0000 (oldest deadline 2024-08-31T06:32:59.345968+0000) 2024-08-31T06:33:07.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:07 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:07.380+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-08-31T06:31:37.839254+0000 front 2024-08-31T06:31:37.839286+0000 (oldest deadline 2024-08-31T06:32:01.939294+0000) 2024-08-31T06:33:07.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:07 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:07.380+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-31T06:31:47.840398+0000 front 2024-08-31T06:31:47.840576+0000 (oldest deadline 2024-08-31T06:32:13.740432+0000) 2024-08-31T06:33:07.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:07 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:07.380+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-08-31T06:31:53.740811+0000 front 2024-08-31T06:31:53.740735+0000 (oldest deadline 2024-08-31T06:32:17.241063+0000) 2024-08-31T06:33:07.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:07 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:07.380+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.53:6814 osd.3 since back 2024-08-31T06:32:01.341991+0000 front 2024-08-31T06:32:01.341902+0000 (oldest deadline 2024-08-31T06:32:26.641846+0000) 2024-08-31T06:33:07.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:07 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:07.380+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-31T06:32:10.142995+0000 front 2024-08-31T06:32:10.143071+0000 (oldest deadline 2024-08-31T06:32:34.242902+0000) 2024-08-31T06:33:07.675 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:07 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:07.380+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-08-31T06:32:17.644500+0000 front 2024-08-31T06:32:17.644435+0000 (oldest deadline 2024-08-31T06:32:42.344472+0000) 2024-08-31T06:33:07.676 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:07 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11[48284]: 2024-08-31T06:33:07.380+0000 7ff943f80640 -1 osd.11 119 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-31T06:32:35.846130+0000 front 2024-08-31T06:32:35.846144+0000 (oldest deadline 2024-08-31T06:32:59.345968+0000) 2024-08-31T06:33:08.067 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:07 smithi153 podman[62528]: 2024-08-31 06:33:07.791947532 +0000 UTC m=+5.460027727 container died 12fd1b4f6f215555a80bf0ff896c3b06611f52e7fec29ea8f47c651a6ef94755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-31T06:33:08.425 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:08 smithi153 podman[62528]: 2024-08-31 06:33:08.177687495 +0000 UTC m=+5.845767680 container cleanup 12fd1b4f6f215555a80bf0ff896c3b06611f52e7fec29ea8f47c651a6ef94755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:33:08.425 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:08 smithi153 bash[62528]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11 2024-08-31T06:33:08.772 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:08 smithi153 podman[62545]: 2024-08-31 06:33:08.437175425 +0000 UTC m=+0.642425395 container remove 12fd1b4f6f215555a80bf0ff896c3b06611f52e7fec29ea8f47c651a6ef94755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:33:09.041 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:08 smithi153 podman[62632]: 2024-08-31 06:33:08.771474976 +0000 UTC m=+0.092002232 container create c6c6ded0f3e34d884c60b48e6787beb4bf80a01be0c6392be10c810f7f1fb75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True) 2024-08-31T06:33:09.041 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:08 smithi153 podman[62632]: 2024-08-31 06:33:08.695282657 +0000 UTC m=+0.015809918 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:33:09.041 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:08 smithi153 podman[62632]: 2024-08-31 06:33:08.957032681 +0000 UTC m=+0.277559938 container init c6c6ded0f3e34d884c60b48e6787beb4bf80a01be0c6392be10c810f7f1fb75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:33:09.041 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:08 smithi153 podman[62632]: 2024-08-31 06:33:08.960339711 +0000 UTC m=+0.280866967 container start c6c6ded0f3e34d884c60b48e6787beb4bf80a01be0c6392be10c810f7f1fb75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:33:09.041 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:09 smithi153 podman[62632]: 2024-08-31 06:33:09.040258765 +0000 UTC m=+0.360786026 container attach c6c6ded0f3e34d884c60b48e6787beb4bf80a01be0c6392be10c810f7f1fb75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-31T06:33:09.425 INFO:journalctl@ceph.osd.11.smithi153.stdout:Aug 31 06:33:09 smithi153 podman[62632]: 2024-08-31 06:33:09.147378145 +0000 UTC m=+0.467905402 container died c6c6ded0f3e34d884c60b48e6787beb4bf80a01be0c6392be10c810f7f1fb75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:33:09.731 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@osd.11.service' 2024-08-31T06:33:09.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:09.769 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-31T06:33:09.769 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-31T06:33:09.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.a 2024-08-31T06:33:10.056 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:33:09 smithi053 systemd[1]: Stopping Ceph mds.a for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:10.310 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:33:10 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a[64078]: 2024-08-31T06:33:10.071+0000 7ff64a4f4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:10.311 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:33:10 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a[64078]: 2024-08-31T06:33:10.071+0000 7ff64a4f4640 -1 mds.a *** got signal Terminated *** 2024-08-31T06:33:12.302 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:33:12 smithi053 podman[145411]: 2024-08-31 06:33:12.027335899 +0000 UTC m=+2.057376090 container died a5e77ff2626b0e7b1eaf7b7a4e55a4c3d398292379e78fd6cd8544c35a9dab89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True) 2024-08-31T06:33:12.725 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:33:12 smithi053 podman[145411]: 2024-08-31 06:33:12.475942522 +0000 UTC m=+2.505982755 container cleanup a5e77ff2626b0e7b1eaf7b7a4e55a4c3d398292379e78fd6cd8544c35a9dab89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-31T06:33:12.725 INFO:journalctl@ceph.mds.a.smithi053.stdout:Aug 31 06:33:12 smithi053 bash[145411]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-a 2024-08-31T06:33:12.894 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.a.service' 2024-08-31T06:33:12.930 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:12.930 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-31T06:33:12.930 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-31T06:33:12.930 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.d 2024-08-31T06:33:13.475 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:33:13 smithi053 systemd[1]: Stopping Ceph mds.d for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:13.475 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:33:13 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-d[62898]: 2024-08-31T06:33:13.254+0000 7fe413f8e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:13.475 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:33:13 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-d[62898]: 2024-08-31T06:33:13.254+0000 7fe413f8e640 -1 mds.d *** got signal Terminated *** 2024-08-31T06:33:15.383 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:33:15 smithi053 podman[145545]: 2024-08-31 06:33:15.090562586 +0000 UTC m=+1.934742677 container died 5cde249fd20d9287dcc3e36dd224480e3f4b256b09ee30d5ebf60bbae8306342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-d, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-08-31T06:33:15.725 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:33:15 smithi053 podman[145545]: 2024-08-31 06:33:15.547564034 +0000 UTC m=+2.391744110 container cleanup 5cde249fd20d9287dcc3e36dd224480e3f4b256b09ee30d5ebf60bbae8306342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-d, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-31T06:33:15.725 INFO:journalctl@ceph.mds.d.smithi053.stdout:Aug 31 06:33:15 smithi053 bash[145545]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-d 2024-08-31T06:33:15.954 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.d.service' 2024-08-31T06:33:15.988 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:15.988 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-31T06:33:15.988 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-31T06:33:15.988 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.g 2024-08-31T06:33:16.475 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:33:16 smithi053 systemd[1]: Stopping Ceph mds.g for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:16.475 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:33:16 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g[63687]: 2024-08-31T06:33:16.283+0000 7f0b02758640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:16.475 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:33:16 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g[63687]: 2024-08-31T06:33:16.283+0000 7f0b02758640 -1 mds.g *** got signal Terminated *** 2024-08-31T06:33:20.304 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:33:20 smithi053 podman[145667]: 2024-08-31 06:33:20.018471768 +0000 UTC m=+3.813068911 container died 139dbbde6324d185cd0abdde001f454a5089716a748379660212f339b62949f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T06:33:20.696 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:33:20 smithi053 podman[145667]: 2024-08-31 06:33:20.452179481 +0000 UTC m=+4.246776656 container cleanup 139dbbde6324d185cd0abdde001f454a5089716a748379660212f339b62949f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1) 2024-08-31T06:33:20.696 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:33:20 smithi053 bash[145667]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g 2024-08-31T06:33:20.945 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.g.service' 2024-08-31T06:33:20.966 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:33:20 smithi053 podman[145680]: 2024-08-31 06:33:20.695202328 +0000 UTC m=+0.668191344 container remove 139dbbde6324d185cd0abdde001f454a5089716a748379660212f339b62949f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-g, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-31T06:33:20.966 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:33:20 smithi053 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.g.service: Deactivated successfully. 2024-08-31T06:33:20.966 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:33:20 smithi053 systemd[1]: Stopped Ceph mds.g for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:33:20.966 INFO:journalctl@ceph.mds.g.smithi053.stdout:Aug 31 06:33:20 smithi053 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.g.service: Consumed 18.702s CPU time. 2024-08-31T06:33:20.978 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:20.978 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-31T06:33:20.978 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-31T06:33:20.978 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.j 2024-08-31T06:33:21.225 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:33:21 smithi053 systemd[1]: Stopping Ceph mds.j for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:21.725 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:33:21 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-j[62488]: 2024-08-31T06:33:21.322+0000 7f32d3521640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:21.726 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:33:21 smithi053 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-j[62488]: 2024-08-31T06:33:21.322+0000 7f32d3521640 -1 mds.j *** got signal Terminated *** 2024-08-31T06:33:23.579 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:33:23 smithi053 podman[145789]: 2024-08-31 06:33:23.302148406 +0000 UTC m=+2.095604431 container died 2c78564a4a1b810b7b1df6a27bab114ae1d71777ba46b98fba149c8a69eb2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-j, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:33:23.943 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:33:23 smithi053 podman[145789]: 2024-08-31 06:33:23.723558084 +0000 UTC m=+2.517014101 container cleanup 2c78564a4a1b810b7b1df6a27bab114ae1d71777ba46b98fba149c8a69eb2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2) 2024-08-31T06:33:23.943 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:33:23 smithi053 bash[145789]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-j 2024-08-31T06:33:24.171 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.j.service' 2024-08-31T06:33:24.193 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:33:23 smithi053 podman[145802]: 2024-08-31 06:33:23.941565841 +0000 UTC m=+0.627841764 container remove 2c78564a4a1b810b7b1df6a27bab114ae1d71777ba46b98fba149c8a69eb2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-j, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:33:24.194 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:33:24 smithi053 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.j.service: Deactivated successfully. 2024-08-31T06:33:24.194 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:33:24 smithi053 systemd[1]: Stopped Ceph mds.j for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:33:24.194 INFO:journalctl@ceph.mds.j.smithi053.stdout:Aug 31 06:33:24 smithi053 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.j.service: Consumed 1.228s CPU time. 2024-08-31T06:33:24.203 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:24.203 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-31T06:33:24.203 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-31T06:33:24.204 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.b 2024-08-31T06:33:24.489 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:33:24 smithi130 systemd[1]: Stopping Ceph mds.b for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:24.746 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:33:24 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:33:24.487+0000 7fbbf2dcd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:24.746 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:33:24 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b[53924]: 2024-08-31T06:33:24.487+0000 7fbbf2dcd640 -1 mds.b *** got signal Terminated *** 2024-08-31T06:33:28.238 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:33:27 smithi130 podman[66921]: 2024-08-31 06:33:27.941498017 +0000 UTC m=+3.549953306 container died a9e57cff43b68878e811b84a711a063f87da9d77135d9e9398ed8de7e8fdcfa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-31T06:33:28.614 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:33:28 smithi130 podman[66921]: 2024-08-31 06:33:28.336660132 +0000 UTC m=+3.945115431 container cleanup a9e57cff43b68878e811b84a711a063f87da9d77135d9e9398ed8de7e8fdcfa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-31T06:33:28.614 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 31 06:33:28 smithi130 bash[66921]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-b 2024-08-31T06:33:28.732 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.b.service' 2024-08-31T06:33:28.768 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:28.768 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-31T06:33:28.768 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-31T06:33:28.769 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.e 2024-08-31T06:33:28.877 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:33:28 smithi130 systemd[1]: Stopping Ceph mds.e for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:29.377 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:33:29 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e[53323]: 2024-08-31T06:33:29.091+0000 7fe380a90640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:29.378 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:33:29 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e[53323]: 2024-08-31T06:33:29.091+0000 7fe380a90640 -1 mds.e *** got signal Terminated *** 2024-08-31T06:33:32.202 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:33:31 smithi130 podman[67055]: 2024-08-31 06:33:31.936281628 +0000 UTC m=+2.945508513 container died db2c1bd3c1b7ea20be5b91a94f49940b5c969fcf06bf42876b450c0675b54bd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1) 2024-08-31T06:33:32.627 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:33:32 smithi130 podman[67055]: 2024-08-31 06:33:32.274395859 +0000 UTC m=+3.283622753 container cleanup db2c1bd3c1b7ea20be5b91a94f49940b5c969fcf06bf42876b450c0675b54bd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-31T06:33:32.628 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:33:32 smithi130 bash[67055]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e 2024-08-31T06:33:32.628 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 31 06:33:32 smithi130 podman[67066]: 2024-08-31 06:33:32.433670853 +0000 UTC m=+0.486351789 container remove db2c1bd3c1b7ea20be5b91a94f49940b5c969fcf06bf42876b450c0675b54bd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0) 2024-08-31T06:33:32.650 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.e.service' 2024-08-31T06:33:32.683 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:32.683 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-31T06:33:32.683 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-31T06:33:32.683 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.h 2024-08-31T06:33:32.996 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:33:32 smithi130 systemd[1]: Stopping Ceph mds.h for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:33.377 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:33:32 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h[53621]: 2024-08-31T06:33:32.994+0000 7f034ec55640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:33.378 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:33:32 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h[53621]: 2024-08-31T06:33:32.994+0000 7f034ec55640 -1 mds.h *** got signal Terminated *** 2024-08-31T06:33:36.127 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:33:35 smithi130 podman[67174]: 2024-08-31 06:33:35.953575001 +0000 UTC m=+3.055039099 container died ccd3bda244674cbe9768c2dd18b69c16003e65f6b921f93c796557f850733113 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-31T06:33:36.479 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:33:36 smithi130 podman[67174]: 2024-08-31 06:33:36.285929325 +0000 UTC m=+3.387393412 container cleanup ccd3bda244674cbe9768c2dd18b69c16003e65f6b921f93c796557f850733113 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-31T06:33:36.480 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:33:36 smithi130 bash[67174]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h 2024-08-31T06:33:36.713 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.h.service' 2024-08-31T06:33:36.734 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:33:36 smithi130 podman[67186]: 2024-08-31 06:33:36.478730848 +0000 UTC m=+0.519538895 container remove ccd3bda244674cbe9768c2dd18b69c16003e65f6b921f93c796557f850733113 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-h, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_CLEAN=True) 2024-08-31T06:33:36.734 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:33:36 smithi130 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.h.service: Deactivated successfully. 2024-08-31T06:33:36.734 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:33:36 smithi130 systemd[1]: Stopped Ceph mds.h for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:33:36.735 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 31 06:33:36 smithi130 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.h.service: Consumed 7min 27.638s CPU time. 2024-08-31T06:33:36.745 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:36.745 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-31T06:33:36.745 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-31T06:33:36.745 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.k 2024-08-31T06:33:37.066 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:33:36 smithi130 systemd[1]: Stopping Ceph mds.k for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:37.377 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:33:37 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k[53004]: 2024-08-31T06:33:37.064+0000 7fdcccf0b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:37.378 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:33:37 smithi130 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k[53004]: 2024-08-31T06:33:37.064+0000 7fdcccf0b640 -1 mds.k *** got signal Terminated *** 2024-08-31T06:33:40.300 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:33:39 smithi130 podman[67297]: 2024-08-31 06:33:39.953116729 +0000 UTC m=+2.996002298 container died 57d40490a116ba986f54699352cd4a7f067cdfb75ed241407df5f253a6f3c6de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-31T06:33:40.566 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:33:40 smithi130 podman[67297]: 2024-08-31 06:33:40.372887829 +0000 UTC m=+3.415773396 container cleanup 57d40490a116ba986f54699352cd4a7f067cdfb75ed241407df5f253a6f3c6de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:33:40.566 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 31 06:33:40 smithi130 bash[67297]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-k 2024-08-31T06:33:40.694 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.k.service' 2024-08-31T06:33:40.725 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:40.725 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-31T06:33:40.726 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-31T06:33:40.726 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.c 2024-08-31T06:33:41.036 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:33:40 smithi153 systemd[1]: Stopping Ceph mds.c for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:41.289 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:33:41 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c[53556]: 2024-08-31T06:33:41.034+0000 7fdc00d3e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:41.289 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:33:41 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c[53556]: 2024-08-31T06:33:41.034+0000 7fdc00d3e640 -1 mds.c *** got signal Terminated *** 2024-08-31T06:33:44.237 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:33:43 smithi153 podman[62738]: 2024-08-31 06:33:43.952132344 +0000 UTC m=+3.023019912 container died 0ab220a68f515ccc2274c639f0940781e480d60c7aa7a2a29a5ee2b7600a81c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T06:33:44.586 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:33:44 smithi153 podman[62738]: 2024-08-31 06:33:44.31781835 +0000 UTC m=+3.388705919 container cleanup 0ab220a68f515ccc2274c639f0940781e480d60c7aa7a2a29a5ee2b7600a81c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:33:44.587 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:33:44 smithi153 bash[62738]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c 2024-08-31T06:33:44.768 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.c.service' 2024-08-31T06:33:44.893 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:33:44 smithi153 podman[62760]: 2024-08-31 06:33:44.585956046 +0000 UTC m=+0.621795256 container remove 0ab220a68f515ccc2274c639f0940781e480d60c7aa7a2a29a5ee2b7600a81c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-c, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-31T06:33:44.893 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:33:44 smithi153 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.c.service: Deactivated successfully. 2024-08-31T06:33:44.893 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:33:44 smithi153 systemd[1]: Stopped Ceph mds.c for 580e8a36-675d-11ef-bcd4-c7b262605968. 2024-08-31T06:33:44.893 INFO:journalctl@ceph.mds.c.smithi153.stdout:Aug 31 06:33:44 smithi153 systemd[1]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.c.service: Consumed 7min 11.807s CPU time. 2024-08-31T06:33:44.907 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:44.908 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-31T06:33:44.908 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-31T06:33:44.908 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.f 2024-08-31T06:33:45.175 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:33:44 smithi153 systemd[1]: Stopping Ceph mds.f for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:45.675 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:33:45 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f[53255]: 2024-08-31T06:33:45.230+0000 7fbd0b42e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:45.675 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:33:45 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f[53255]: 2024-08-31T06:33:45.230+0000 7fbd0b42e640 -1 mds.f *** got signal Terminated *** 2024-08-31T06:33:48.225 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:33:47 smithi153 podman[62870]: 2024-08-31 06:33:47.944758779 +0000 UTC m=+2.815098463 container died 2f3551e89d687e25748f1a0a33fb269961ed1205b02d6e6e5fb4cd48eea66a1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-31T06:33:48.540 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:33:48 smithi153 podman[62870]: 2024-08-31 06:33:48.321728921 +0000 UTC m=+3.192068606 container cleanup 2f3551e89d687e25748f1a0a33fb269961ed1205b02d6e6e5fb4cd48eea66a1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-31T06:33:48.540 INFO:journalctl@ceph.mds.f.smithi153.stdout:Aug 31 06:33:48 smithi153 bash[62870]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-f 2024-08-31T06:33:48.677 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.f.service' 2024-08-31T06:33:48.712 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:48.712 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-31T06:33:48.712 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-31T06:33:48.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.i 2024-08-31T06:33:49.068 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:33:48 smithi153 systemd[1]: Stopping Ceph mds.i for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:49.425 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:33:49 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i[53855]: 2024-08-31T06:33:49.067+0000 7febb9bfc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:49.425 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:33:49 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i[53855]: 2024-08-31T06:33:49.067+0000 7febb9bfc640 -1 mds.i *** got signal Terminated *** 2024-08-31T06:33:52.276 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:33:51 smithi153 podman[62990]: 2024-08-31 06:33:51.953160069 +0000 UTC m=+3.014589865 container died e4de4d4a385aabf8abfa6c158a7a68d29ccb15887d3b3e4df762fc4318cf4bde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-08-31T06:33:52.276 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:33:52 smithi153 podman[62990]: 2024-08-31 06:33:52.275347235 +0000 UTC m=+3.336777090 container cleanup e4de4d4a385aabf8abfa6c158a7a68d29ccb15887d3b3e4df762fc4318cf4bde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-31T06:33:52.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:33:52 smithi153 bash[62990]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i 2024-08-31T06:33:52.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Aug 31 06:33:52 smithi153 podman[63004]: 2024-08-31 06:33:52.460205512 +0000 UTC m=+0.502643492 container remove e4de4d4a385aabf8abfa6c158a7a68d29ccb15887d3b3e4df762fc4318cf4bde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-i, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T06:33:52.701 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.i.service' 2024-08-31T06:33:52.733 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:52.733 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-31T06:33:52.734 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-31T06:33:52.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.l 2024-08-31T06:33:53.055 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:33:52 smithi153 systemd[1]: Stopping Ceph mds.l for 580e8a36-675d-11ef-bcd4-c7b262605968... 2024-08-31T06:33:53.425 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:33:53 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l[52940]: 2024-08-31T06:33:53.054+0000 7fef00073640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:33:53.425 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:33:53 smithi153 ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l[52940]: 2024-08-31T06:33:53.054+0000 7fef00073640 -1 mds.l *** got signal Terminated *** 2024-08-31T06:33:56.281 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:33:55 smithi153 podman[63111]: 2024-08-31 06:33:55.943601151 +0000 UTC m=+2.991176730 container died 223cfc7e0ce950ea0f1413e86ca896ae071c706e6b56881b818e1c5d426ba421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-31T06:33:56.597 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:33:56 smithi153 podman[63111]: 2024-08-31 06:33:56.33751782 +0000 UTC m=+3.385093388 container cleanup 223cfc7e0ce950ea0f1413e86ca896ae071c706e6b56881b818e1c5d426ba421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-31T06:33:56.597 INFO:journalctl@ceph.mds.l.smithi153.stdout:Aug 31 06:33:56 smithi153 bash[63111]: ceph-580e8a36-675d-11ef-bcd4-c7b262605968-mds-l 2024-08-31T06:33:56.713 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-580e8a36-675d-11ef-bcd4-c7b262605968@mds.l.service' 2024-08-31T06:33:56.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:33:56.746 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-31T06:33:56.747 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T06:33:56.959 INFO:teuthology.orchestra.run.smithi053.stdout:Deleting cluster with fsid: 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T06:33:59.515 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T06:33:59.717 INFO:teuthology.orchestra.run.smithi130.stdout:Deleting cluster with fsid: 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T06:34:02.270 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T06:34:02.472 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T06:34:04.945 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:34:04.979 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:34:05.011 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:34:05.038 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-31T06:34:05.040 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380/remote/smithi053/crash 2024-08-31T06:34:05.041 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T06:34:05.078 INFO:teuthology.orchestra.run.smithi053.stderr:tar: /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T06:34:05.079 INFO:teuthology.orchestra.run.smithi053.stderr:tar: Error is not recoverable: exiting now 2024-08-31T06:34:05.080 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380/remote/smithi130/crash 2024-08-31T06:34:05.081 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T06:34:05.121 INFO:teuthology.orchestra.run.smithi130.stderr:tar: /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T06:34:05.121 INFO:teuthology.orchestra.run.smithi130.stderr:tar: Error is not recoverable: exiting now 2024-08-31T06:34:05.123 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380/remote/smithi153/crash 2024-08-31T06:34:05.124 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T06:34:05.161 INFO:teuthology.orchestra.run.smithi153.stderr:tar: /var/lib/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T06:34:05.161 INFO:teuthology.orchestra.run.smithi153.stderr:tar: Error is not recoverable: exiting now 2024-08-31T06:34:05.162 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-31T06:34:05.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-31T06:34:05.260 INFO:teuthology.orchestra.run.smithi053.stdout:2024-08-31T06:08:33.018248+0000 mds.b (mds.0) 29 : cluster [WRN] Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2024-08-31T06:34:05.261 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-31T06:34:05.261 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[SEC\]' /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-31T06:34:05.297 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]' /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-31T06:34:05.373 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[WRN\]' /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-31T06:34:05.448 INFO:teuthology.orchestra.run.smithi053.stdout:2024-08-31T06:08:33.018248+0000 mds.b (mds.0) 29 : cluster [WRN] Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2024-08-31T06:34:05.448 INFO:tasks.cephadm:Compressing logs... 2024-08-31T06:34:05.449 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T06:34:05.490 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T06:34:05.493 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T06:34:05.528 INFO:teuthology.orchestra.run.smithi130.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-31T06:34:05.528 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.10.log 2024-08-31T06:34:05.529 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.1.log 2024-08-31T06:34:05.529 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.7.log 2024-08-31T06:34:05.530 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.10.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T06:34:05.530 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.b.log 2024-08-31T06:34:05.530 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.k.log 2024-08-31T06:34:05.531 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.4.log 2024-08-31T06:34:05.531 INFO:teuthology.orchestra.run.smithi053.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-31T06:34:05.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.b.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T06:34:05.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T06:34:05.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mgr.y.log 2024-08-31T06:34:05.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T06:34:05.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.h.log 2024-08-31T06:34:05.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mon.b.log 2024-08-31T06:34:05.534 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.e.log 2024-08-31T06:34:05.534 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T06:34:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-31T06:34:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T06:34:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T06:34:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.i.log 2024-08-31T06:34:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-volume.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mon.c.log 2024-08-31T06:34:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T06:34:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.11.log 2024-08-31T06:34:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.2.log 2024-08-31T06:34:05.541 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.5.log 2024-08-31T06:34:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T06:34:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.l.log 2024-08-31T06:34:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.8.log 2024-08-31T06:34:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mgr.z.log 2024-08-31T06:34:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.c.log 2024-08-31T06:34:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.f.log 2024-08-31T06:34:05.542 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.i.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.0.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.9.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.0.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.a.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mon.a.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.g.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.6.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.d.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mgr.x.log 2024-08-31T06:34:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.j.log 2024-08-31T06:34:05.544 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.3.log 2024-08-31T06:34:05.544 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-08-31T06:34:05.544 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T06:34:05.544 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 87.2% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T06:34:05.608 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mon.c.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.cephadm.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.11.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.2.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.5.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.l.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.f.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.8.log: /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mgr.z.log: /var/log/ceph/cephadm.log: 90.4% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T06:34:05.619 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.3% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T06:34:05.643 INFO:teuthology.orchestra.run.smithi153.stderr: 82.2% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T06:34:05.680 INFO:teuthology.orchestra.run.smithi130.stderr: 93.2% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mgr.y.log.gz 2024-08-31T06:34:05.723 INFO:teuthology.orchestra.run.smithi130.stderr: 90.3% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T06:34:05.728 INFO:teuthology.orchestra.run.smithi053.stderr: 90.2% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T06:34:05.735 INFO:teuthology.orchestra.run.smithi153.stderr: 93.3% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mgr.z.log.gz 2024-08-31T06:34:05.751 INFO:teuthology.orchestra.run.smithi153.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T06:34:05.767 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T06:34:05.791 INFO:teuthology.orchestra.run.smithi053.stderr: 84.6% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T06:34:05.812 INFO:teuthology.orchestra.run.smithi153.stderr: 91.0% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T06:34:05.870 INFO:teuthology.orchestra.run.smithi130.stderr: 91.0% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T06:34:05.923 INFO:teuthology.orchestra.run.smithi053.stderr: 95.2% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.j.log.gz 2024-08-31T06:34:05.924 INFO:teuthology.orchestra.run.smithi053.stderr: 95.1% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.d.log.gz 2024-08-31T06:34:05.950 INFO:teuthology.orchestra.run.smithi053.stderr: 90.9% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T06:34:06.284 INFO:teuthology.orchestra.run.smithi130.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T06:34:06.320 INFO:teuthology.orchestra.run.smithi053.stderr: 95.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T06:34:06.329 INFO:teuthology.orchestra.run.smithi130.stderr: 87.2% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T06:34:07.560 INFO:teuthology.orchestra.run.smithi053.stderr: 90.5% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mgr.x.log.gz 2024-08-31T06:34:10.988 INFO:teuthology.orchestra.run.smithi053.stderr: 90.7% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mon.a.log.gz 2024-08-31T06:34:17.990 INFO:teuthology.orchestra.run.smithi130.stderr: 91.5% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mon.b.log.gz 2024-08-31T06:34:20.702 INFO:teuthology.orchestra.run.smithi153.stderr: 91.5% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mon.c.log.gz 2024-08-31T06:34:24.679 INFO:teuthology.orchestra.run.smithi130.stderr: 95.0% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.k.log.gz 2024-08-31T06:34:30.124 INFO:teuthology.orchestra.run.smithi053.stderr: 93.8% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.6.log.gz 2024-08-31T06:34:39.395 INFO:teuthology.orchestra.run.smithi130.stderr: 94.7% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.e.log.gz 2024-08-31T06:34:40.474 INFO:teuthology.orchestra.run.smithi053.stderr: 95.0% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.a.log.gz 2024-08-31T06:34:41.012 INFO:teuthology.orchestra.run.smithi130.stderr: 93.7% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.1.log.gz 2024-08-31T06:34:46.702 INFO:teuthology.orchestra.run.smithi053.stderr: 93.6% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.0.log.gz 2024-08-31T06:34:52.768 INFO:teuthology.orchestra.run.smithi053.stderr: 94.6% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.g.log.gz 2024-08-31T06:34:57.376 INFO:teuthology.orchestra.run.smithi130.stderr: 93.8% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.4.log.gz 2024-08-31T06:34:58.258 INFO:teuthology.orchestra.run.smithi130.stderr: 93.7% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.10.log.gz 2024-08-31T06:34:59.572 INFO:teuthology.orchestra.run.smithi053.stderr: 93.8% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.9.log.gz 2024-08-31T06:35:03.836 INFO:teuthology.orchestra.run.smithi130.stderr: 93.9% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.7.log.gz 2024-08-31T06:35:07.621 INFO:teuthology.orchestra.run.smithi053.stderr: 93.7% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.3.log.gz 2024-08-31T06:35:08.329 INFO:teuthology.orchestra.run.smithi153.stderr: 95.1% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.l.log.gz 2024-08-31T06:35:30.373 INFO:teuthology.orchestra.run.smithi153.stderr: 93.9% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.5.log.gz 2024-08-31T06:36:09.021 INFO:teuthology.orchestra.run.smithi153.stderr: 93.7% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.11.log.gz 2024-08-31T06:36:31.443 INFO:teuthology.orchestra.run.smithi153.stderr: 93.8% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.2.log.gz 2024-08-31T06:36:48.814 INFO:teuthology.orchestra.run.smithi153.stderr: 93.9% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-osd.8.log.gz 2024-08-31T06:39:35.085 INFO:teuthology.orchestra.run.smithi053.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-08-31T06:39:35.086 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-08-31T06:39:35.086 INFO:teuthology.orchestra.run.smithi053.stderr:real 5m29.585s 2024-08-31T06:39:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:user 5m3.617s 2024-08-31T06:39:35.087 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m9.893s 2024-08-31T06:41:07.414 INFO:teuthology.orchestra.run.smithi153.stderr: 93.3% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.f.log.gz 2024-08-31T06:44:45.193 INFO:teuthology.orchestra.run.smithi130.stderr: 94.3% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.h.log.gz 2024-08-31T06:45:41.954 INFO:teuthology.orchestra.run.smithi153.stderr: 94.2% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.c.log.gz 2024-08-31T06:46:08.740 INFO:teuthology.orchestra.run.smithi153.stderr: 94.1% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.i.log.gz 2024-08-31T06:46:08.742 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-08-31T06:46:08.742 INFO:teuthology.orchestra.run.smithi153.stderr:real 12m3.234s 2024-08-31T06:46:08.742 INFO:teuthology.orchestra.run.smithi153.stderr:user 5m56.738s 2024-08-31T06:46:08.743 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m17.247s 2024-08-31T06:46:31.560 INFO:teuthology.orchestra.run.smithi130.stderr: 94.8% -- replaced with /var/log/ceph/580e8a36-675d-11ef-bcd4-c7b262605968/ceph-mds.b.log.gz 2024-08-31T06:46:31.562 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-08-31T06:46:31.562 INFO:teuthology.orchestra.run.smithi130.stderr:real 12m26.055s 2024-08-31T06:46:31.562 INFO:teuthology.orchestra.run.smithi130.stderr:user 5m34.395s 2024-08-31T06:46:31.562 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m16.378s 2024-08-31T06:46:31.564 INFO:tasks.cephadm:Archiving logs... 2024-08-31T06:46:31.565 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380/remote/smithi053/log 2024-08-31T06:46:31.566 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T06:47:18.804 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380/remote/smithi130/log 2024-08-31T06:47:18.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T06:48:03.120 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380/remote/smithi153/log 2024-08-31T06:48:03.122 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T06:48:53.139 INFO:tasks.cephadm:Removing cluster... 2024-08-31T06:48:53.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 --force 2024-08-31T06:48:53.369 INFO:teuthology.orchestra.run.smithi053.stdout:Deleting cluster with fsid: 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T06:48:53.678 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 --force 2024-08-31T06:48:53.914 INFO:teuthology.orchestra.run.smithi130.stdout:Deleting cluster with fsid: 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T06:48:54.484 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 580e8a36-675d-11ef-bcd4-c7b262605968 --force 2024-08-31T06:48:54.943 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: 580e8a36-675d-11ef-bcd4-c7b262605968 2024-08-31T06:48:55.605 INFO:tasks.cephadm:Removing cephadm ... 2024-08-31T06:48:55.606 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T06:48:55.625 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T06:48:55.645 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T06:48:55.660 INFO:tasks.cephadm:Teardown complete 2024-08-31T06:48:55.661 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-31T06:48:55.809 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-31T06:48:55.809 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T06:48:55.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T06:48:55.814 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T06:48:55.930 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-31T06:48:55.941 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-31T06:48:55.941 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T06:48:55.944 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T06:48:55.947 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T06:48:55.959 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-08-31T06:48:55.961 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-08-31T06:48:55.961 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-08-31T06:48:55.978 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T06:48:55.978 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-08-31T06:48:55.978 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 -389us[ -406us] +/- 53ms 2024-08-31T06:48:55.978 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 +55us[ +37us] +/- 59ms 2024-08-31T06:48:55.979 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +476us[ +459us] +/- 81ms 2024-08-31T06:48:55.979 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:48:55.988 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T06:48:55.988 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-08-31T06:48:55.988 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 -340us[ -305us] +/- 53ms 2024-08-31T06:48:55.988 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 +41us[ +81us] +/- 59ms 2024-08-31T06:48:55.989 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +442us[ +482us] +/- 61ms 2024-08-31T06:48:55.989 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:48:55.998 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T06:48:55.998 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-08-31T06:48:55.998 INFO:teuthology.orchestra.run.smithi053.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 -336us[ -313us] +/- 54ms 2024-08-31T06:48:55.998 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 +52us[ +80us] +/- 59ms 2024-08-31T06:48:55.998 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +475us[ +503us] +/- 81ms 2024-08-31T06:48:55.998 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:48:55.999 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-31T06:48:56.009 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-31T06:48:56.010 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-31T06:48:56.020 DEBUG:teuthology.orchestra.run.smithi053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T06:48:56.171 DEBUG:teuthology.orchestra.run.smithi130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T06:48:56.251 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T06:48:56.327 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T06:48:56.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:48:56.360 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T06:48:56.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:48:56.390 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T06:48:56.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:48:56.417 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-31T06:48:56.431 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-31T06:48:56.441 INFO:teuthology.task.internal:Duration was 3542.466416 seconds 2024-08-31T06:48:56.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-31T06:48:56.453 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-31T06:48:56.453 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T06:48:56.456 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T06:48:56.458 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T06:48:56.513 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T06:48:56.526 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T06:48:56.537 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T06:48:56.935 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-31T06:48:56.935 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2024-08-31T06:48:56.935 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T06:48:56.959 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-08-31T06:48:56.959 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T06:48:56.990 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-08-31T06:48:56.991 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T06:48:57.027 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-31T06:48:57.027 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T06:48:57.030 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T06:48:57.033 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T06:48:57.095 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-31T06:48:57.096 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T06:48:57.101 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T06:48:57.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T06:48:59.518 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-31T06:48:59.530 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-31T06:48:59.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T06:48:59.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T06:48:59.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T06:48:59.650 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-31T06:48:59.662 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:48:59.664 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:48:59.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:48:59.698 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-08-31T06:48:59.700 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2024-08-31T06:48:59.714 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-08-31T06:48:59.733 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:48:59.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:48:59.785 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:48:59.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:48:59.801 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:48:59.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:48:59.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-31T06:48:59.829 INFO:teuthology.task.internal:Transferring archived files... 2024-08-31T06:48:59.831 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380/remote/smithi053 2024-08-31T06:48:59.831 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T06:48:59.911 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380/remote/smithi130 2024-08-31T06:48:59.911 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T06:48:59.947 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881380/remote/smithi153 2024-08-31T06:48:59.947 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T06:48:59.983 INFO:teuthology.task.internal:Removing archive directory... 2024-08-31T06:48:59.983 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T06:48:59.986 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T06:48:59.988 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T06:49:00.036 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-31T06:49:00.047 INFO:teuthology.task.internal:Not uploading archives. 2024-08-31T06:49:00.048 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-31T06:49:00.059 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-31T06:49:00.059 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T06:49:00.061 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T06:49:00.064 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T06:49:00.074 INFO:teuthology.orchestra.run.smithi053.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 06:48 /home/ubuntu/cephtest 2024-08-31T06:49:00.078 INFO:teuthology.orchestra.run.smithi130.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 06:49 /home/ubuntu/cephtest 2024-08-31T06:49:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 06:49 /home/ubuntu/cephtest 2024-08-31T06:49:00.095 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-31T06:49:00.107 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-31T06:49:00.134 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} duration: 3542.4664158821106 failure_reason: '"2024-08-31T06:08:33.018248+0000 mds.b (mds.0) 29 : cluster [WRN] Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/74239040-7d9a-4899-9df1-7e6cb2c8232f/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details" in cluster log' flavor: default owner: scheduled_mchangir@teuthology success: false 2024-08-31T06:49:00.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T06:49:00.360 INFO:teuthology.run:FAIL